-- Logs begin at Sat 2022-10-08 20:01:32 UTC, end at Sat 2022-10-08 22:27:05 UTC. -- Oct 08 20:40:13.412535 ncdv-master-1 systemd[1]: Starting Devstack devstack@n-api.service... Oct 08 20:40:13.421061 ncdv-master-1 devstack@n-api.service[123985]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 08 20:40:13.423094 ncdv-master-1 devstack@n-api.service[123985]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Oct 8 20:40:13 2022] *** Oct 08 20:40:13.423094 ncdv-master-1 devstack@n-api.service[123985]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 08 20:40:13.423094 ncdv-master-1 devstack@n-api.service[123985]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 08 20:40:13.423094 ncdv-master-1 devstack@n-api.service[123985]: nodename: ncdv-master-1 Oct 08 20:40:13.423094 ncdv-master-1 devstack@n-api.service[123985]: machine: x86_64 Oct 08 20:40:13.423094 ncdv-master-1 devstack@n-api.service[123985]: clock source: unix Oct 08 20:40:13.423094 ncdv-master-1 devstack@n-api.service[123985]: pcre jit disabled Oct 08 20:40:13.423094 ncdv-master-1 devstack@n-api.service[123985]: detected number of CPU cores: 4 Oct 08 20:40:13.423094 ncdv-master-1 devstack@n-api.service[123985]: current working directory: / Oct 08 20:40:13.423094 ncdv-master-1 devstack@n-api.service[123985]: detected binary path: /usr/bin/uwsgi-core Oct 08 20:40:13.423094 ncdv-master-1 devstack@n-api.service[123985]: your processes number limit is 47680 Oct 08 20:40:13.423758 ncdv-master-1 devstack@n-api.service[123985]: your memory page size is 4096 bytes Oct 08 20:40:13.423758 ncdv-master-1 devstack@n-api.service[123985]: detected max file descriptor number: 2048 Oct 08 20:40:13.423758 ncdv-master-1 devstack@n-api.service[123985]: lock engine: pthread robust mutexes Oct 08 20:40:13.423758 ncdv-master-1 devstack@n-api.service[123985]: thunder lock: enabled Oct 08 20:40:13.423758 ncdv-master-1 devstack@n-api.service[123985]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 08 20:40:13.423758 ncdv-master-1 devstack@n-api.service[123985]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 08 20:40:13.467931 ncdv-master-1 devstack@n-api.service[123985]: Python main interpreter initialized at 0x560448a049c0 Oct 08 20:40:13.467931 ncdv-master-1 devstack@n-api.service[123985]: python threads support enabled Oct 08 20:40:13.467931 ncdv-master-1 devstack@n-api.service[123985]: your server socket listen backlog is limited to 100 connections Oct 08 20:40:13.467931 ncdv-master-1 devstack@n-api.service[123985]: your mercy for graceful operations on workers is 90 seconds Oct 08 20:40:13.468274 ncdv-master-1 devstack@n-api.service[123985]: mapped 403077 bytes (393 KB) for 2 cores Oct 08 20:40:13.468355 ncdv-master-1 devstack@n-api.service[123985]: *** Operational MODE: preforking *** Oct 08 20:40:13.468592 ncdv-master-1 devstack@n-api.service[123985]: *** uWSGI is running in multiple interpreter mode *** Oct 08 20:40:13.468592 ncdv-master-1 devstack@n-api.service[123985]: spawned uWSGI master process (pid: 123985) Oct 08 20:40:13.468757 ncdv-master-1 systemd[1]: Started Devstack devstack@n-api.service. Oct 08 20:40:13.469493 ncdv-master-1 devstack@n-api.service[123985]: spawned uWSGI worker 1 (pid: 123986, cores: 1) Oct 08 20:40:13.473314 ncdv-master-1 devstack@n-api.service[123985]: spawned uWSGI worker 2 (pid: 123987, cores: 1) Oct 08 20:40:13.473314 ncdv-master-1 devstack@n-api.service[123985]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 08 20:40:14.764304 ncdv-master-1 devstack@n-api.service[123986]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 08 20:40:14.771072 ncdv-master-1 devstack@n-api.service[123987]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 08 20:40:15.442382 ncdv-master-1 devstack@n-api.service[123986]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 08 20:40:15.442382 ncdv-master-1 devstack@n-api.service[123986]: from cryptography.utils import int_from_bytes Oct 08 20:40:15.442700 ncdv-master-1 devstack@n-api.service[123986]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 08 20:40:15.442700 ncdv-master-1 devstack@n-api.service[123986]: from cryptography.utils import int_from_bytes Oct 08 20:40:15.444586 ncdv-master-1 devstack@n-api.service[123987]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 08 20:40:15.444586 ncdv-master-1 devstack@n-api.service[123987]: from cryptography.utils import int_from_bytes Oct 08 20:40:15.444896 ncdv-master-1 devstack@n-api.service[123987]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 08 20:40:15.444896 ncdv-master-1 devstack@n-api.service[123987]: from cryptography.utils import int_from_bytes Oct 08 20:40:18.023076 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 08 20:40:18.023649 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 08 20:40:18.024006 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 08 20:40:18.024095 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 08 20:40:18.024183 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 08 20:40:18.024270 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 08 20:40:18.024355 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 08 20:40:18.024452 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 08 20:40:18.024545 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 08 20:40:18.024622 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 08 20:40:18.024835 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.024942 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.025158 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.025271 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.025502 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.025612 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.025819 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.025914 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.026146 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.026244 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.026455 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.026551 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.026773 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.026882 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.027090 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.027176 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.027415 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.027522 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.027682 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.027832 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.027992 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.028091 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.028312 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] console_host = ncdv-master-1 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.028399 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] console_host = ncdv-master-1 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.028631 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.028718 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.028933 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.029026 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.029266 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.029370 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.029582 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.029668 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.029883 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.029980 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.030202 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.030288 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.030507 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.030602 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.030998 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.031101 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.031432 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.031539 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.031736 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.031835 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.032044 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.032143 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.032377 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.032570 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.032730 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.032846 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.032984 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.033114 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.033318 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.033455 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.033616 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.033701 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.033937 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.034030 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.034242 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.034330 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.034635 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] host = ncdv-master-1 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.034731 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] host = ncdv-master-1 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.034950 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.035042 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.035259 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.035343 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.035570 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.035700 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.035974 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.036073 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.036281 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.036367 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.036587 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.036673 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.036907 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.037019 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.037279 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.037380 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.037587 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.037672 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.037916 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.038021 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.038228 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.038321 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.038542 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.038636 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.038857 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.038951 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.039155 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.039241 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.039462 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.039546 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.039764 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.039858 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.040078 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.040163 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.040380 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.040464 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.040681 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.040778 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.040930 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.041017 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.041274 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.041365 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.041599 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.041685 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.041902 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.041988 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.042222 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.042350 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.042458 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.042539 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.042707 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.042811 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.043022 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.043120 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.043337 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.043431 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.043644 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.043728 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.043945 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.044056 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.044247 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.044333 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.044548 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.044632 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.044850 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.044937 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.045151 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.045258 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.045481 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.045578 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.045773 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.045873 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.046087 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.046173 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.046397 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.046489 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.046715 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.046799 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.047014 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.047099 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.047329 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.047422 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.047716 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.047861 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.048008 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.048095 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.048252 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.048348 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.048583 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.048669 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.048898 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.048983 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.049214 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.049317 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.049532 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.049618 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.049847 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.049932 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.050149 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.050243 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.050449 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.050540 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.050751 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.050843 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.051069 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.051154 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.051386 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.051469 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.051685 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.051768 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.051932 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.052022 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.052230 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.052325 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.052531 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.052622 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.053407 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.053511 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.053720 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.053806 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.054029 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.054114 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.054330 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.054422 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.054630 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.054721 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.054931 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.055023 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.055232 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.055338 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.055530 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.055627 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.055831 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.055928 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.056129 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.056225 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.056429 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.056514 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.056729 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.056823 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.057031 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.057116 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.057354 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.057442 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.057656 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.057751 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.057971 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.058095 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.058283 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.058368 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.058584 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.058682 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.058885 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.058977 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.059183 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.059268 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.059483 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.059575 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.059798 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.059890 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.060099 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.060197 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.060401 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.060496 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.060718 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.060803 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.061020 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.061104 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.061345 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.061451 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.061666 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.061803 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.061967 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.062051 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.062267 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.062353 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.062581 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.062673 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.062876 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.062960 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.063176 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.063261 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.063489 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.063580 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.063791 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.063874 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.064092 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.064186 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.064393 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.064476 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.064689 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.064778 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.064988 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.065075 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.065310 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.065399 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.065614 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.065699 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.065913 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.066000 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.066210 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.066301 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.066523 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.066616 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.066840 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.066924 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.067141 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.067225 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.067443 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.067539 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.067746 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.067831 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.068060 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.068145 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:40:18.068441 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.069141 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.069306 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.069394 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.069644 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.069736 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.069956 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.070048 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.070286 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.070372 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.070614 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.070706 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.070929 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.071023 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.071239 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.071325 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.071555 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.071641 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.071876 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.071969 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.072184 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.072268 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.072560 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.072666 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.072799 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.072884 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.073112 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.073276 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.073453 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.073588 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.073781 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.073868 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.074094 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.074179 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.074406 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.074491 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.074721 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.074807 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.075029 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.075125 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.075343 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.075436 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.075664 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.075749 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.075979 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.076064 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.076285 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.076379 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.076622 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.076707 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.076962 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.077053 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.077295 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.077397 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.077620 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.077713 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.077937 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.078022 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.078248 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.078342 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.078556 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.078641 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.078863 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.078949 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.079199 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.079285 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.079509 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.079594 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.079817 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.079904 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.080132 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.080218 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.080442 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.080527 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.080758 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.080843 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.081069 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.081156 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.081404 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.081491 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.081715 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.081799 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.082022 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.082115 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.082330 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.082422 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.082658 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.082761 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.082969 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.083057 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.083289 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.083374 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.083598 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.083697 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.083907 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.083998 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.084250 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.084334 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.084557 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.084651 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.084864 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.084950 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.085172 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.085331 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.085494 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.085589 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.085798 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.085891 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.086100 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.086186 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.086407 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.086505 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.086709 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.086803 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.087027 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.087119 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.087352 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.087439 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.087657 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.087756 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.087984 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.088070 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.088287 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.088415 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.088595 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.088682 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.088902 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.088987 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.089229 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.089318 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.089535 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.089620 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.089845 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.089933 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.090154 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.090241 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.090456 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.090542 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.090777 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.090872 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.091084 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.091169 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.091385 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.091470 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.091707 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.091868 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.092007 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.092145 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.092312 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.092397 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.092620 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.092714 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.092927 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.093025 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.093258 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.093345 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.093571 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.093668 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.093880 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.093976 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.094199 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.094293 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.094508 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.094601 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.094813 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.094899 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.095147 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.095270 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.095473 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.095567 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.095770 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.095856 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.096088 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.096177 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.096426 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.096524 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.096723 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.096828 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.097021 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.097118 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.097350 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.097476 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.097656 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.097755 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.097955 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.098053 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.098254 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.098341 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.098561 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.098661 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.098858 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.098955 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.099156 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.099243 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.099457 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.099545 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.099786 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.099881 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.100084 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.100169 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.100401 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.100496 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.100709 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.100804 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.101009 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.101095 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.101334 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.101438 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.101642 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.101730 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.101983 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.102074 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.102291 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.102387 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.102624 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.102712 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.102958 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.103044 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.103277 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.103362 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.103598 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.103686 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.103913 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.104020 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.104223 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.104309 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.104531 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.104620 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.104840 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.104928 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.105150 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.105278 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.105480 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.105578 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.105800 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.105895 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.106108 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.106207 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.106427 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.106524 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.106734 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.106821 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.107052 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.107148 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.107362 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.107449 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.107689 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.107776 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.107988 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.108095 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.108300 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.108388 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.108641 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.108740 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.108966 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.109061 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.109301 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.109404 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.109624 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.109711 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.109933 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.110028 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.110245 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.110339 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.110554 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.110647 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.110865 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.110952 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.111170 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.111256 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.111482 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.111569 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.111796 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.112146 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.112368 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.112454 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.112686 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.112778 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.112991 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.113077 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.113332 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.113422 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.113643 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.113744 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.113966 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.114082 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.114271 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.114368 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.114580 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.114685 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.114906 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.115003 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.115745 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.115843 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.116068 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.116175 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.116386 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.116488 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.116704 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.116804 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.117015 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.117124 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.117346 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.117448 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.117659 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.117821 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.117971 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.118057 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.118253 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.118342 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.118562 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.118656 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.118874 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.118964 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.119185 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.119329 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.119473 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.119608 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.119759 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.119899 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.120073 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.120209 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.120379 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.120515 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.120682 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.120818 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.120985 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.121129 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.121315 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.121487 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.121637 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.121725 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.121946 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.122039 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.122261 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.122375 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.122579 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.122677 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.122878 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.122964 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.123180 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.123275 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.123499 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.123585 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.123806 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.123891 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.124109 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.124202 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.124409 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.124494 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.124712 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.124845 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.125051 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.125208 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.125383 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.125503 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.125726 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.125857 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.126055 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.126217 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.126307 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.126374 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.126597 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.126687 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.126932 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.127145 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.127237 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.127526 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.127622 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.127854 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.127968 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.128272 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.128409 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.128497 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.128564 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.128778 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.129016 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.129176 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.129413 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.129492 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.129728 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.129819 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.130036 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.130110 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.130346 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.130421 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.130654 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.130736 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.131513 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.131596 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.131823 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.131897 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.132130 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.132214 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.132439 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.132522 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.132752 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.133010 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.133094 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.133372 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.133709 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.133810 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.133957 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.134047 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.134268 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.134357 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.134584 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.134679 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.134930 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.135025 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.135246 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.135333 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.135568 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.135662 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.135884 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.136010 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.136190 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.136281 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.136493 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.136599 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.136799 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.136894 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.137099 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.137220 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.137425 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.137522 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.137730 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.137825 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.138103 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.138204 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.138335 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.138424 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.138636 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.138721 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.138944 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.139092 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.139238 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.139383 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.139519 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.139653 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.139821 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.139959 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.140125 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.140257 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.140435 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.140578 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.140743 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.140882 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.141019 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.141153 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.141321 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.141459 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.141652 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.141751 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.141960 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.142047 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.142264 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.142351 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.142563 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.142661 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.142865 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.142965 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.143203 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.143290 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.143509 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.143609 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.143841 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.143934 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.144167 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.144251 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.144476 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.144580 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.144793 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.144887 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.145095 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.145180 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.145426 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.145513 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.145731 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.145818 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.146034 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.146129 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.146335 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.146432 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.146663 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.146763 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.146968 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.147062 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.147269 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.147355 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.147579 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.147664 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.147884 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.147978 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.148188 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.148273 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.148494 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.148579 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.148793 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.148889 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.149098 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.149203 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.149421 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.149513 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.149728 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.149822 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.150034 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.150119 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.150337 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.150422 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.150638 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.150733 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.150940 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.151025 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.151243 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.151328 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.151544 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.151638 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.151849 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.151950 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.152153 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.152249 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.152456 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.152542 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.152756 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.152841 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.153057 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.153153 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.153379 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.153475 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.153684 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.153780 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.153987 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.154072 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.154287 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.154374 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.154602 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.154698 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.154904 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.155003 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.155206 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.155299 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.155506 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.155596 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.155809 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.155905 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.156106 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.156212 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.156406 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.156492 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.156711 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.156810 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.157022 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.157107 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.157356 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.157444 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.157660 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.157759 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.157966 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.158052 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.158264 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.158395 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.158567 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.158654 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.158869 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.158953 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.159170 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.159262 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.159470 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.159557 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.159771 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.159857 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.160069 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.160163 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.160368 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.160461 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.160670 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.160756 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.160984 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.161068 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.161308 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.161398 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.161611 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.161697 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.161914 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.162011 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.162242 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.162337 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.162579 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.162665 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.162883 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.162976 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.163212 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.163314 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.163522 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.163622 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.163833 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.163939 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.164146 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.164239 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.164452 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.164577 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.164760 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.164857 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.165066 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.165159 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.165390 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.165480 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.165705 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.165793 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.166015 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.166151 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.166321 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.166407 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.166620 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.166714 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.166923 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.167042 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.167252 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.167360 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.167551 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.167641 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.167860 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.167955 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.168179 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.168280 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.168488 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.168588 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.168801 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.168897 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.169102 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.169361 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.169456 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.169536 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.169730 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.169830 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.170035 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.170132 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.170346 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.170433 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.170655 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.170749 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.170965 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.171065 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.171275 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.171371 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.171583 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.171671 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.171891 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.171990 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.172200 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.172287 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.172504 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.172590 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.172809 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.172895 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.173115 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.173257 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.173439 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.173595 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.173762 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.173851 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.174070 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.174156 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.174371 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.174471 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.174678 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.174768 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.174981 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.175073 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.175284 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.175424 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.175585 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.175743 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.176027 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.176113 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.176338 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.176436 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.176650 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.176736 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.176956 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.177051 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.177285 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.177390 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.177598 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.178192 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.178433 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.178519 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.178820 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.178923 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.179125 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.179211 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.179454 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.179548 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.179770 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.179865 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.180082 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.180174 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.180391 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.180476 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.180706 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.180800 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.181011 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.181097 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.181343 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.181431 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.181661 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.181748 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.181963 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.182048 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.182267 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.182352 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.182570 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.182657 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.182891 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.182984 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.183194 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.183327 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.183514 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.183612 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.183907 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.183993 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.184223 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.184317 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.184526 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.184633 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.184940 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.185043 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.185273 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.185394 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.185587 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.185752 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.185908 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.185996 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.186218 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.186368 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.186538 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.186634 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.186840 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.186925 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.187153 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.187238 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.187461 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.187560 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.187774 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.187873 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.188091 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.188176 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.188394 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.188487 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.188705 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.188789 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.189006 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.189092 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.189347 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.189449 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.189670 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.189773 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.189983 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.190077 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.190312 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.190399 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.190696 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.190782 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.191030 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.191114 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.191341 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.191428 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.191651 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.191736 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.191961 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.192047 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.192266 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.192352 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.192570 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.192657 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.192878 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.192972 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.193180 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.193284 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.194042 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.194140 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.194362 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.194466 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.194666 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.194761 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.194978 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.195076 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.195285 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.195381 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.195589 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.195687 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.195912 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.196006 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.196182 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.196287 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.196502 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.196598 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.196804 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.196891 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.197123 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.197248 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.197465 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.197551 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.197772 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.197871 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.198087 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.198174 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.198393 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.198479 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.198698 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.198832 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.199006 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.199093 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.199310 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.199401 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.199612 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.199704 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.199915 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.200002 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.200251 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.200339 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.200557 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.200651 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.200875 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.200962 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.201210 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.201301 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.201533 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.201631 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.201843 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.201929 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.202172 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.202259 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.202487 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.202616 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.202807 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.202897 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.203117 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.203206 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.203427 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.203535 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.203734 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.203829 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.204034 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.204121 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.204336 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.204424 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.204640 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.204734 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.204940 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.205024 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.205266 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.205370 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.205570 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.205656 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.205873 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.205958 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.206170 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.206258 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.206472 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.206559 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.206774 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.206859 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.207092 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.207179 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.207393 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.207480 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.207697 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.207791 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.208004 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.208098 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.208303 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.208389 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.208604 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.208699 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.208903 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.209022 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.209302 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.209392 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.209619 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.209719 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.209946 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.210042 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.210264 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.210351 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.210581 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.210677 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.210895 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.210981 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.211208 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.211294 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.211522 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.211615 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.211832 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.211917 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.212146 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.212232 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.212457 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.212584 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.212773 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.212859 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.213078 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.213162 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.213416 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.213514 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.213733 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.213934 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.214032 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.214266 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.214547 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.214636 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.214874 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.214961 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.215185 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.215355 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.215493 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.215586 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.215803 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.215889 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.216113 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.216207 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.216420 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.216505 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.216729 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.216815 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.217038 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.217132 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.217369 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.217458 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.217678 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.217765 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.218004 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.218092 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.218322 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.218408 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.218644 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.218731 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.218958 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.219046 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.219278 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.219376 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.219585 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.219671 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.219898 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.219986 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.220209 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.220303 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.220545 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.220639 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.220858 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.220945 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.221161 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.221311 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.221492 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.221581 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.221803 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.221889 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.222117 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.222204 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.222427 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.222520 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.222739 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.222839 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.223047 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.223140 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.223360 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.223477 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.223664 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.223774 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.223970 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.224081 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.224280 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.224377 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.224610 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.224701 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.224935 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.225029 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.225271 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.225362 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.225591 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.225678 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.225905 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.226003 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.226215 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.226425 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.226511 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.226745 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.227025 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.227167 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.227339 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.227489 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.227675 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.227794 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.227996 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.228093 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.228312 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.228411 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.228626 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.228722 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.228940 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.229028 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.229275 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.229382 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.229580 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.229667 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.229950 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.230060 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.230189 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.230276 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.230497 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.230585 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.230802 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.230891 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.231124 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.231211 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.231435 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.231540 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.231741 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.231829 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.232058 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.232269 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.232366 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.232619 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.232881 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.232983 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.233243 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.233335 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.233561 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.233662 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.233883 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.233972 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.234202 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.234296 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.234516 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.234613 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.234822 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.234917 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.235128 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.235229 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.235436 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.235543 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.235737 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.235826 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.236042 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.236130 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.236349 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.236438 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.236662 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.236751 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.237232 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.237338 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.237544 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.237634 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.237851 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.237939 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.238154 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.238242 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.238459 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.238555 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.238761 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.238849 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.239069 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.239164 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.239373 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.239459 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.239676 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.239771 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.239995 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.240090 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.240798 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.240902 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.241101 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.241234 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.241427 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.241529 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.241732 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.241821 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.242034 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.242122 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.242343 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.242439 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.242645 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.242734 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.242956 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.243044 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.243254 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.243341 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.243563 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.243650 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.243903 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.243989 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.244206 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.244295 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.244507 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.244595 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.244814 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.244899 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.245116 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.245241 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.245540 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.245634 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.245754 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.245925 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.246064 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.246202 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.246383 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.246519 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.246691 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.246868 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.247000 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.247186 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.247342 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.247654 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.247741 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.248045 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.248180 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.248370 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.248510 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.248707 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.248828 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.249043 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.249160 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.249390 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.249512 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.249700 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.249818 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.250010 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.250106 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.250335 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.250435 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.250647 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.250744 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.250959 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.251047 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.251275 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.251363 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.251586 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.251683 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.251891 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.251978 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.252224 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.252320 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.252500 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.252603 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.252808 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.252896 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.253114 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.253239 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.253445 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.253535 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.253751 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.253838 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.254058 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.254152 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.254365 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.254454 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.254673 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.254760 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.254978 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.255065 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.255287 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.255375 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.255628 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.255755 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.256484 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.256592 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.256804 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.256939 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.257115 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.257233 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.257457 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.257555 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.257762 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.257848 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.258071 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.258157 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.258379 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.258475 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.258697 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.258791 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.259010 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.259103 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.259332 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.259422 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.259640 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.259726 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.259944 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.260314 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.260609 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.260705 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.260924 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.261020 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.261265 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.261357 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.261588 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.261677 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.261897 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.261985 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.262217 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.262317 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.262530 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.262617 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.262844 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.262940 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.263160 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.263266 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.263464 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.263568 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.263791 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.263881 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.264134 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.264303 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.264447 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.264586 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.264755 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.264892 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.265058 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.265244 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.265382 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.265521 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.265658 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.265837 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.266003 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.266139 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.266277 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.266415 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.266552 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.266694 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.266838 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.266985 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.267137 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.267276 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.267420 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.267563 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.267709 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.267846 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.268007 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.268143 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.268310 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.268462 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.268599 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.268740 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.268888 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.269034 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.269171 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.269359 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.269499 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.269636 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.269772 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.269916 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.270054 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.270200 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.270338 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.270473 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.270627 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.270787 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.270943 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.271100 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.271256 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.271403 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.271564 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.271711 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.271817 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.271930 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.272091 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.272237 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.272389 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.272570 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.272723 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.272910 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.273054 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.273301 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.273401 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.273582 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.273680 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.273897 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.273986 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.274222 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.274317 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.274536 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.274703 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.274861 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.274949 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.275185 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.275280 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.275495 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.275589 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.275801 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.275937 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.276132 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.276228 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.276441 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.276538 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.276750 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.276849 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.277056 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.277144 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.277387 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.277478 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.277694 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.277782 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.278001 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.278088 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.278322 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.278410 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.278644 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.278731 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.278948 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.279044 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.279266 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.279353 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.279582 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.279678 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.279902 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.280000 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.280210 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.280296 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.280517 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.280607 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.280844 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.280943 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.281148 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.281269 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.281481 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.281569 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.281789 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.281879 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.282096 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.282191 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.282403 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.282501 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.282718 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.282808 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.283024 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.283111 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.283329 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.283423 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.283643 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.283739 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.283955 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.284043 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.284277 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.284421 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.284601 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.284697 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.284905 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.285030 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.285245 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.285352 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.285570 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.285677 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.285920 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.286057 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.286224 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.286323 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.286564 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.286660 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.286892 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.286979 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.287731 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.287831 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.288044 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.288132 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.288348 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.288437 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:40:18.288590 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 08 20:40:18.288684 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 08 20:40:18.353381 ncdv-master-1 devstack@n-api.service[123986]: INFO dbcounter [None req-1776adea-1351-4507-a3d2-b0b66e1e467b None None] Registered counter for database nova_api Oct 08 20:40:18.353904 ncdv-master-1 devstack@n-api.service[123987]: INFO dbcounter [None req-52bd210b-53c6-4f38-9b97-1283311338fa None None] Registered counter for database nova_api Oct 08 20:40:18.373843 ncdv-master-1 devstack@n-api.service[123986]: DEBUG oslo_db.sqlalchemy.engines [None req-1776adea-1351-4507-a3d2-b0b66e1e467b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123986) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 08 20:40:18.376339 ncdv-master-1 devstack@n-api.service[123987]: DEBUG oslo_db.sqlalchemy.engines [None req-52bd210b-53c6-4f38-9b97-1283311338fa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123987) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 08 20:40:18.380475 ncdv-master-1 devstack@n-api.service[123986]: DEBUG dbcounter [-] [123986] Writer thread running {{(pid=123986) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 08 20:40:18.382893 ncdv-master-1 devstack@n-api.service[123987]: DEBUG dbcounter [-] [123987] Writer thread running {{(pid=123987) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 08 20:40:18.438257 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.context [None req-1776adea-1351-4507-a3d2-b0b66e1e467b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1a13ecad-3f87-496d-a2c5-ac44667fd176(cell1) {{(pid=123986) load_cells /opt/stack/nova/nova/context.py:464}} Oct 08 20:40:18.440390 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.context [None req-52bd210b-53c6-4f38-9b97-1283311338fa None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1a13ecad-3f87-496d-a2c5-ac44667fd176(cell1) {{(pid=123987) load_cells /opt/stack/nova/nova/context.py:464}} Oct 08 20:40:18.442096 ncdv-master-1 devstack@n-api.service[123986]: DEBUG oslo_concurrency.lockutils [None req-1776adea-1351-4507-a3d2-b0b66e1e467b None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:40:18.442564 ncdv-master-1 devstack@n-api.service[123986]: DEBUG oslo_concurrency.lockutils [None req-1776adea-1351-4507-a3d2-b0b66e1e467b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:40:18.444168 ncdv-master-1 devstack@n-api.service[123986]: DEBUG oslo_concurrency.lockutils [None req-1776adea-1351-4507-a3d2-b0b66e1e467b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:40:18.444267 ncdv-master-1 devstack@n-api.service[123987]: DEBUG oslo_concurrency.lockutils [None req-52bd210b-53c6-4f38-9b97-1283311338fa None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:40:18.444724 ncdv-master-1 devstack@n-api.service[123987]: DEBUG oslo_concurrency.lockutils [None req-52bd210b-53c6-4f38-9b97-1283311338fa None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:40:18.444889 ncdv-master-1 devstack@n-api.service[123986]: DEBUG oslo_concurrency.lockutils [None req-1776adea-1351-4507-a3d2-b0b66e1e467b None None] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:40:18.445369 ncdv-master-1 devstack@n-api.service[123986]: DEBUG oslo_concurrency.lockutils [None req-1776adea-1351-4507-a3d2-b0b66e1e467b None None] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:40:18.446314 ncdv-master-1 devstack@n-api.service[123987]: DEBUG oslo_concurrency.lockutils [None req-52bd210b-53c6-4f38-9b97-1283311338fa None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:40:18.447034 ncdv-master-1 devstack@n-api.service[123987]: DEBUG oslo_concurrency.lockutils [None req-52bd210b-53c6-4f38-9b97-1283311338fa None None] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:40:18.447330 ncdv-master-1 devstack@n-api.service[123986]: DEBUG oslo_concurrency.lockutils [None req-1776adea-1351-4507-a3d2-b0b66e1e467b None None] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:40:18.447488 ncdv-master-1 devstack@n-api.service[123987]: DEBUG oslo_concurrency.lockutils [None req-52bd210b-53c6-4f38-9b97-1283311338fa None None] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:40:18.449301 ncdv-master-1 devstack@n-api.service[123986]: INFO dbcounter [None req-1776adea-1351-4507-a3d2-b0b66e1e467b None None] Registered counter for database nova_cell0 Oct 08 20:40:18.449485 ncdv-master-1 devstack@n-api.service[123987]: DEBUG oslo_concurrency.lockutils [None req-52bd210b-53c6-4f38-9b97-1283311338fa None None] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:40:18.451443 ncdv-master-1 devstack@n-api.service[123987]: INFO dbcounter [None req-52bd210b-53c6-4f38-9b97-1283311338fa None None] Registered counter for database nova_cell0 Oct 08 20:40:18.453299 ncdv-master-1 devstack@n-api.service[123986]: INFO dbcounter [None req-1776adea-1351-4507-a3d2-b0b66e1e467b None None] Registered counter for database nova_cell1 Oct 08 20:40:18.455373 ncdv-master-1 devstack@n-api.service[123987]: INFO dbcounter [None req-52bd210b-53c6-4f38-9b97-1283311338fa None None] Registered counter for database nova_cell1 Oct 08 20:40:18.460286 ncdv-master-1 devstack@n-api.service[123986]: DEBUG oslo_db.sqlalchemy.engines [None req-1776adea-1351-4507-a3d2-b0b66e1e467b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123986) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 08 20:40:18.461721 ncdv-master-1 devstack@n-api.service[123986]: DEBUG oslo_db.sqlalchemy.engines [None req-1776adea-1351-4507-a3d2-b0b66e1e467b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123986) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 08 20:40:18.465689 ncdv-master-1 devstack@n-api.service[123987]: DEBUG oslo_db.sqlalchemy.engines [None req-52bd210b-53c6-4f38-9b97-1283311338fa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123987) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 08 20:40:18.466974 ncdv-master-1 devstack@n-api.service[123987]: DEBUG oslo_db.sqlalchemy.engines [None req-52bd210b-53c6-4f38-9b97-1283311338fa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123987) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 08 20:40:18.467705 ncdv-master-1 devstack@n-api.service[123986]: DEBUG dbcounter [-] [123986] Writer thread running {{(pid=123986) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 08 20:40:18.469873 ncdv-master-1 devstack@n-api.service[123987]: DEBUG dbcounter [-] [123987] Writer thread running {{(pid=123987) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 08 20:40:18.470304 ncdv-master-1 devstack@n-api.service[123986]: DEBUG dbcounter [-] [123986] Writer thread running {{(pid=123986) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 08 20:40:18.608035 ncdv-master-1 devstack@n-api.service[123987]: DEBUG dbcounter [-] [123987] Writer thread running {{(pid=123987) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 08 20:40:18.611070 ncdv-master-1 devstack@n-api.service[123986]: INFO dbcounter [None req-1776adea-1351-4507-a3d2-b0b66e1e467b None None] Registered counter for database nova_cell0 Oct 08 20:40:18.617731 ncdv-master-1 devstack@n-api.service[123987]: INFO dbcounter [None req-52bd210b-53c6-4f38-9b97-1283311338fa None None] Registered counter for database nova_cell0 Oct 08 20:40:18.618697 ncdv-master-1 devstack@n-api.service[123986]: DEBUG oslo_db.sqlalchemy.engines [None req-1776adea-1351-4507-a3d2-b0b66e1e467b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123986) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 08 20:40:18.623041 ncdv-master-1 devstack@n-api.service[123986]: DEBUG dbcounter [-] [123986] Writer thread running {{(pid=123986) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 08 20:40:18.626342 ncdv-master-1 devstack@n-api.service[123987]: DEBUG oslo_db.sqlalchemy.engines [None req-52bd210b-53c6-4f38-9b97-1283311338fa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123987) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 08 20:40:18.630712 ncdv-master-1 devstack@n-api.service[123987]: DEBUG dbcounter [-] [123987] Writer thread running {{(pid=123987) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 08 20:40:19.073896 ncdv-master-1 devstack@n-api.service[123986]: WARNING keystonemiddleware.auth_token [None req-1776adea-1351-4507-a3d2-b0b66e1e467b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 08 20:40:19.076420 ncdv-master-1 devstack@n-api.service[123987]: WARNING keystonemiddleware.auth_token [None req-52bd210b-53c6-4f38-9b97-1283311338fa None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 08 20:40:19.081166 ncdv-master-1 devstack@n-api.service[123986]: WARNING keystonemiddleware.auth_token [None req-1776adea-1351-4507-a3d2-b0b66e1e467b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 08 20:40:19.083679 ncdv-master-1 devstack@n-api.service[123987]: WARNING keystonemiddleware.auth_token [None req-52bd210b-53c6-4f38-9b97-1283311338fa None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 08 20:40:19.301496 ncdv-master-1 devstack@n-api.service[123986]: WARNING keystonemiddleware.auth_token [None req-1776adea-1351-4507-a3d2-b0b66e1e467b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 08 20:40:19.307164 ncdv-master-1 devstack@n-api.service[123987]: WARNING keystonemiddleware.auth_token [None req-52bd210b-53c6-4f38-9b97-1283311338fa None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 08 20:40:19.307998 ncdv-master-1 devstack@n-api.service[123986]: WARNING keystonemiddleware.auth_token [None req-1776adea-1351-4507-a3d2-b0b66e1e467b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 08 20:40:19.313078 ncdv-master-1 devstack@n-api.service[123987]: WARNING keystonemiddleware.auth_token [None req-52bd210b-53c6-4f38-9b97-1283311338fa None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 08 20:40:19.313252 ncdv-master-1 devstack@n-api.service[123986]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x560448a049c0 pid: 123986 (default app) Oct 08 20:40:19.315298 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi [None req-1776adea-1351-4507-a3d2-b0b66e1e467b None None] Calling method '>' {{(pid=123986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:40:19.316442 ncdv-master-1 devstack@n-api.service[123986]: INFO nova.api.openstack.requestlog [None req-1776adea-1351-4507-a3d2-b0b66e1e467b None None] 10.222.0.26 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001673 Oct 08 20:40:19.316848 ncdv-master-1 devstack@n-api.service[123986]: [pid: 123986|app: 0|req: 1/1] 10.222.0.26 () {50 vars in 788 bytes} [Sat Oct 8 20:40:19 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:40:19.318384 ncdv-master-1 devstack@n-api.service[123987]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x560448a049c0 pid: 123987 (default app) Oct 08 20:41:46.641018 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi [None req-1776adea-1351-4507-a3d2-b0b66e1e467b None None] Calling method '>' {{(pid=123986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:41:46.642316 ncdv-master-1 devstack@n-api.service[123986]: INFO nova.api.openstack.requestlog [None req-1776adea-1351-4507-a3d2-b0b66e1e467b None None] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001815 Oct 08 20:41:46.643022 ncdv-master-1 devstack@n-api.service[123986]: [pid: 123986|app: 0|req: 2/2] 10.222.0.26 () {54 vars in 931 bytes} [Sat Oct 8 20:41:46 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:41:46.655880 ncdv-master-1 devstack@n-api.service[123987]: DEBUG dbcounter [-] [123987] Writing DB stats nova_api:SELECT=3 {{(pid=123987) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:41:46.657335 ncdv-master-1 devstack@n-api.service[123987]: DEBUG dbcounter [-] [123987] Writing DB stats nova_cell0:SELECT=3 {{(pid=123987) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:41:46.658392 ncdv-master-1 devstack@n-api.service[123987]: DEBUG dbcounter [-] [123987] Writing DB stats nova_cell1:SELECT=3 {{(pid=123987) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:41:46.661527 ncdv-master-1 devstack@n-api.service[123987]: DEBUG dbcounter [-] [123987] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=123987) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:41:47.514696 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi [None req-e78ed6c7-e5cc-4609-8649-cd276fefea78 admin admin] Calling method '>' {{(pid=123987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:41:47.547231 ncdv-master-1 devstack@n-api.service[123987]: INFO nova.api.openstack.requestlog [None req-e78ed6c7-e5cc-4609-8649-cd276fefea78 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.896655 Oct 08 20:41:47.548084 ncdv-master-1 devstack@n-api.service[123987]: [pid: 123987|app: 0|req: 1/3] 10.222.0.26 () {60 vars in 1292 bytes} [Sat Oct 8 20:41:46 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:41:50.481393 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi [None req-1776adea-1351-4507-a3d2-b0b66e1e467b None None] Calling method '>' {{(pid=123986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:41:50.482384 ncdv-master-1 devstack@n-api.service[123986]: INFO nova.api.openstack.requestlog [None req-1776adea-1351-4507-a3d2-b0b66e1e467b None None] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Oct 08 20:41:50.482989 ncdv-master-1 devstack@n-api.service[123986]: [pid: 123986|app: 0|req: 3/4] 10.222.0.26 () {54 vars in 931 bytes} [Sat Oct 8 20:41:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:41:50.897617 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi [None req-6871de38-2130-4d1e-97ef-df0e115dad89 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "id": "c1", "swap": 0, "rxtx_factor": 1.0, "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 1, "vcpus": 1}} {{(pid=123987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:41:50.944894 ncdv-master-1 devstack@n-api.service[123987]: INFO nova.api.openstack.requestlog [None req-6871de38-2130-4d1e-97ef-df0e115dad89 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.455129 Oct 08 20:41:50.945936 ncdv-master-1 devstack@n-api.service[123987]: [pid: 123987|app: 0|req: 2/5] 10.222.0.26 () {64 vars in 1283 bytes} [Sat Oct 8 20:41:50 2022] POST /compute/v2.1/flavors => generated 407 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 08 20:41:50.961626 ncdv-master-1 devstack@n-api.service[123986]: DEBUG dbcounter [-] [123986] Writing DB stats nova_api:SELECT=3 {{(pid=123986) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:41:50.962462 ncdv-master-1 devstack@n-api.service[123986]: DEBUG dbcounter [-] [123986] Writing DB stats nova_cell1:SELECT=3 {{(pid=123986) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:41:50.963716 ncdv-master-1 devstack@n-api.service[123986]: DEBUG dbcounter [-] [123986] Writing DB stats nova_cell0:SELECT=3 {{(pid=123986) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:41:50.964787 ncdv-master-1 devstack@n-api.service[123986]: DEBUG dbcounter [-] [123986] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=123986) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:41:51.171581 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi [None req-c233c837-9b36-4922-bb17-d81747bd2a38 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=123986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:41:51.245618 ncdv-master-1 devstack@n-api.service[123986]: INFO nova.api.openstack.requestlog [None req-c233c837-9b36-4922-bb17-d81747bd2a38 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.289319 Oct 08 20:41:51.246634 ncdv-master-1 devstack@n-api.service[123986]: [pid: 123986|app: 0|req: 4/6] 10.222.0.26 () {64 vars in 1336 bytes} [Sat Oct 8 20:41:50 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 20:41:54.383433 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi [None req-6871de38-2130-4d1e-97ef-df0e115dad89 admin admin] Calling method '>' {{(pid=123987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:41:54.385074 ncdv-master-1 devstack@n-api.service[123987]: INFO nova.api.openstack.requestlog [None req-6871de38-2130-4d1e-97ef-df0e115dad89 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002118 Oct 08 20:41:54.385939 ncdv-master-1 devstack@n-api.service[123987]: [pid: 123987|app: 0|req: 3/7] 10.222.0.26 () {54 vars in 931 bytes} [Sat Oct 8 20:41:54 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:41:55.291085 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi [None req-e27d60f7-20e2-497d-928c-78359b17f603 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "ds512M", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 5, "vcpus": 1, "ram": 512, "id": "d1", "rxtx_factor": 1.0}} {{(pid=123986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:41:55.342387 ncdv-master-1 devstack@n-api.service[123986]: INFO nova.api.openstack.requestlog [None req-e27d60f7-20e2-497d-928c-78359b17f603 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.948533 Oct 08 20:41:55.350464 ncdv-master-1 devstack@n-api.service[123986]: [pid: 123986|app: 0|req: 5/8] 10.222.0.26 () {64 vars in 1283 bytes} [Sat Oct 8 20:41:54 2022] POST /compute/v2.1/flavors => generated 404 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 08 20:41:55.378786 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi [None req-4a891f98-d70b-492f-b38a-be1a003f82af admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=123987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:41:55.414560 ncdv-master-1 devstack@n-api.service[123987]: INFO nova.api.openstack.requestlog [None req-4a891f98-d70b-492f-b38a-be1a003f82af admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.062134 Oct 08 20:41:55.429880 ncdv-master-1 devstack@n-api.service[123987]: [pid: 123987|app: 0|req: 4/9] 10.222.0.26 () {64 vars in 1336 bytes} [Sat Oct 8 20:41:55 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:41:58.744700 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi [None req-e27d60f7-20e2-497d-928c-78359b17f603 admin admin] Calling method '>' {{(pid=123986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:41:58.745828 ncdv-master-1 devstack@n-api.service[123986]: INFO nova.api.openstack.requestlog [None req-e27d60f7-20e2-497d-928c-78359b17f603 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001651 Oct 08 20:41:58.746334 ncdv-master-1 devstack@n-api.service[123986]: [pid: 123986|app: 0|req: 6/10] 10.222.0.26 () {54 vars in 931 bytes} [Sat Oct 8 20:41:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:41:59.209975 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi [None req-ff6a4b82-1cb4-430c-a968-8a12f1c8f454 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "disk": 10, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d2", "os-flavor-access:is_public": true, "ram": 1024, "rxtx_factor": 1.0, "name": "ds1G"}} {{(pid=123987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:41:59.231987 ncdv-master-1 devstack@n-api.service[123987]: INFO nova.api.openstack.requestlog [None req-ff6a4b82-1cb4-430c-a968-8a12f1c8f454 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.478482 Oct 08 20:41:59.232887 ncdv-master-1 devstack@n-api.service[123987]: [pid: 123987|app: 0|req: 5/11] 10.222.0.26 () {64 vars in 1283 bytes} [Sat Oct 8 20:41:58 2022] POST /compute/v2.1/flavors => generated 404 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 08 20:41:59.244912 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi [None req-187641a3-d3b1-4e11-90f2-439463428f8e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=123986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:41:59.271148 ncdv-master-1 devstack@n-api.service[123986]: INFO nova.api.openstack.requestlog [None req-187641a3-d3b1-4e11-90f2-439463428f8e admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029845 Oct 08 20:41:59.272166 ncdv-master-1 devstack@n-api.service[123986]: [pid: 123986|app: 0|req: 7/12] 10.222.0.26 () {64 vars in 1336 bytes} [Sat Oct 8 20:41:59 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 20:42:02.341105 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi [None req-ff6a4b82-1cb4-430c-a968-8a12f1c8f454 admin admin] Calling method '>' {{(pid=123987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:42:02.342144 ncdv-master-1 devstack@n-api.service[123987]: INFO nova.api.openstack.requestlog [None req-ff6a4b82-1cb4-430c-a968-8a12f1c8f454 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001513 Oct 08 20:42:02.342544 ncdv-master-1 devstack@n-api.service[123987]: [pid: 123987|app: 0|req: 6/13] 10.222.0.26 () {54 vars in 931 bytes} [Sat Oct 8 20:42:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:42:02.759309 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi [None req-67edbdad-e93e-4d09-b08c-5cb0ca6f6d82 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "os-flavor-access:is_public": true, "id": "d3", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 2048, "disk": 10, "swap": 0, "vcpus": 2}} {{(pid=123986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:42:02.779591 ncdv-master-1 devstack@n-api.service[123986]: INFO nova.api.openstack.requestlog [None req-67edbdad-e93e-4d09-b08c-5cb0ca6f6d82 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.430895 Oct 08 20:42:02.780172 ncdv-master-1 devstack@n-api.service[123986]: [pid: 123986|app: 0|req: 8/14] 10.222.0.26 () {64 vars in 1283 bytes} [Sat Oct 8 20:42:02 2022] POST /compute/v2.1/flavors => generated 404 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 08 20:42:02.795784 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi [None req-5a3ae035-435d-4421-8242-79ac9793dd95 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=123987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:42:02.825350 ncdv-master-1 devstack@n-api.service[123987]: INFO nova.api.openstack.requestlog [None req-5a3ae035-435d-4421-8242-79ac9793dd95 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035597 Oct 08 20:42:02.825951 ncdv-master-1 devstack@n-api.service[123987]: [pid: 123987|app: 0|req: 7/15] 10.222.0.26 () {64 vars in 1336 bytes} [Sat Oct 8 20:42:02 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:42:05.789742 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi [None req-67edbdad-e93e-4d09-b08c-5cb0ca6f6d82 admin admin] Calling method '>' {{(pid=123986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:42:05.790966 ncdv-master-1 devstack@n-api.service[123986]: INFO nova.api.openstack.requestlog [None req-67edbdad-e93e-4d09-b08c-5cb0ca6f6d82 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001735 Oct 08 20:42:05.791645 ncdv-master-1 devstack@n-api.service[123986]: [pid: 123986|app: 0|req: 9/16] 10.222.0.26 () {54 vars in 931 bytes} [Sat Oct 8 20:42:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:42:06.246447 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi [None req-3a1e19a2-82eb-4810-aa6c-dd4e8079b68b admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "swap": 0, "rxtx_factor": 1.0, "disk": 20, "os-flavor-access:is_public": true, "vcpus": 4, "name": "ds4G", "id": "d4"}} {{(pid=123987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:42:06.267240 ncdv-master-1 devstack@n-api.service[123987]: INFO nova.api.openstack.requestlog [None req-3a1e19a2-82eb-4810-aa6c-dd4e8079b68b admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.469130 Oct 08 20:42:06.268126 ncdv-master-1 devstack@n-api.service[123987]: [pid: 123987|app: 0|req: 8/17] 10.222.0.26 () {64 vars in 1283 bytes} [Sat Oct 8 20:42:05 2022] POST /compute/v2.1/flavors => generated 404 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 08 20:42:06.280632 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi [None req-90dd9551-92b0-43a5-9fca-1d0adc6fda71 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=123986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:42:06.308736 ncdv-master-1 devstack@n-api.service[123986]: INFO nova.api.openstack.requestlog [None req-90dd9551-92b0-43a5-9fca-1d0adc6fda71 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031746 Oct 08 20:42:06.323808 ncdv-master-1 devstack@n-api.service[123986]: [pid: 123986|app: 0|req: 10/18] 10.222.0.26 () {64 vars in 1336 bytes} [Sat Oct 8 20:42:06 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:42:09.326553 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi [None req-3a1e19a2-82eb-4810-aa6c-dd4e8079b68b admin admin] Calling method '>' {{(pid=123987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:42:09.327629 ncdv-master-1 devstack@n-api.service[123987]: INFO nova.api.openstack.requestlog [None req-3a1e19a2-82eb-4810-aa6c-dd4e8079b68b admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 Oct 08 20:42:09.328017 ncdv-master-1 devstack@n-api.service[123987]: [pid: 123987|app: 0|req: 9/19] 10.222.0.26 () {54 vars in 931 bytes} [Sat Oct 8 20:42:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:42:09.806768 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi [None req-10ec9aba-217a-4e9f-ab27-409f1edcf094 admin admin] Calling method '>' {{(pid=123986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:42:09.831694 ncdv-master-1 devstack@n-api.service[123986]: INFO nova.api.openstack.requestlog [None req-10ec9aba-217a-4e9f-ab27-409f1edcf094 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.497407 Oct 08 20:42:09.832181 ncdv-master-1 devstack@n-api.service[123986]: [pid: 123986|app: 0|req: 11/20] 10.222.0.26 () {60 vars in 1292 bytes} [Sat Oct 8 20:42:09 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 08 20:42:13.187687 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi [None req-3a1e19a2-82eb-4810-aa6c-dd4e8079b68b admin admin] Calling method '>' {{(pid=123987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:42:13.188719 ncdv-master-1 devstack@n-api.service[123987]: INFO nova.api.openstack.requestlog [None req-3a1e19a2-82eb-4810-aa6c-dd4e8079b68b admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Oct 08 20:42:13.189128 ncdv-master-1 devstack@n-api.service[123987]: [pid: 123987|app: 0|req: 10/21] 10.222.0.26 () {54 vars in 931 bytes} [Sat Oct 8 20:42:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:42:13.664880 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi [None req-4ccbed54-5d4b-4996-b8a8-eaa2f4bf2706 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 1, "rxtx_factor": 1.0, "name": "m1.tiny", "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "1", "ram": 512, "os-flavor-access:is_public": true}} {{(pid=123986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:42:13.687345 ncdv-master-1 devstack@n-api.service[123986]: INFO nova.api.openstack.requestlog [None req-4ccbed54-5d4b-4996-b8a8-eaa2f4bf2706 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.492024 Oct 08 20:42:13.687893 ncdv-master-1 devstack@n-api.service[123986]: [pid: 123986|app: 0|req: 12/22] 10.222.0.26 () {64 vars in 1283 bytes} [Sat Oct 8 20:42:13 2022] POST /compute/v2.1/flavors => generated 402 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 08 20:42:13.700132 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi [None req-49bf1705-dbc2-4281-87d8-376b833f2f9a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=123987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:42:13.726845 ncdv-master-1 devstack@n-api.service[123987]: INFO nova.api.openstack.requestlog [None req-49bf1705-dbc2-4281-87d8-376b833f2f9a admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030349 Oct 08 20:42:13.727420 ncdv-master-1 devstack@n-api.service[123987]: [pid: 123987|app: 0|req: 11/23] 10.222.0.26 () {64 vars in 1333 bytes} [Sat Oct 8 20:42:13 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:42:16.848059 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi [None req-4ccbed54-5d4b-4996-b8a8-eaa2f4bf2706 admin admin] Calling method '>' {{(pid=123986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:42:16.849068 ncdv-master-1 devstack@n-api.service[123986]: INFO nova.api.openstack.requestlog [None req-4ccbed54-5d4b-4996-b8a8-eaa2f4bf2706 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Oct 08 20:42:16.849528 ncdv-master-1 devstack@n-api.service[123986]: [pid: 123986|app: 0|req: 13/24] 10.222.0.26 () {54 vars in 931 bytes} [Sat Oct 8 20:42:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:42:17.207164 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi [None req-2e70708b-be17-4bfa-aa2a-592a0860d541 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "2", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "m1.small", "disk": 20, "ram": 2048, "swap": 0, "vcpus": 1}} {{(pid=123987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:42:17.212848 ncdv-master-1 devstack@n-api.service[123987]: DEBUG dbcounter [-] [123987] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=6,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=123987) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:42:17.228149 ncdv-master-1 devstack@n-api.service[123987]: INFO nova.api.openstack.requestlog [None req-2e70708b-be17-4bfa-aa2a-592a0860d541 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.372709 Oct 08 20:42:17.228696 ncdv-master-1 devstack@n-api.service[123987]: [pid: 123987|app: 0|req: 12/25] 10.222.0.26 () {64 vars in 1283 bytes} [Sat Oct 8 20:42:16 2022] POST /compute/v2.1/flavors => generated 405 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 08 20:42:17.241609 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi [None req-4b1fc07e-f9e0-4917-b83a-919662370bfa admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=123986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:42:17.264477 ncdv-master-1 devstack@n-api.service[123986]: INFO nova.api.openstack.requestlog [None req-4b1fc07e-f9e0-4917-b83a-919662370bfa admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026463 Oct 08 20:42:17.265075 ncdv-master-1 devstack@n-api.service[123986]: [pid: 123986|app: 0|req: 14/26] 10.222.0.26 () {64 vars in 1333 bytes} [Sat Oct 8 20:42:17 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:42:20.187623 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi [None req-2e70708b-be17-4bfa-aa2a-592a0860d541 admin admin] Calling method '>' {{(pid=123987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:42:20.193392 ncdv-master-1 devstack@n-api.service[123987]: INFO nova.api.openstack.requestlog [None req-2e70708b-be17-4bfa-aa2a-592a0860d541 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.006691 Oct 08 20:42:20.194136 ncdv-master-1 devstack@n-api.service[123987]: [pid: 123987|app: 0|req: 13/27] 10.222.0.26 () {54 vars in 931 bytes} [Sat Oct 8 20:42:20 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:42:20.706589 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi [None req-1fe7eabc-7067-4cff-9f26-44069f326c86 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "rxtx_factor": 1.0, "id": "3", "name": "m1.medium", "disk": 40, "ram": 4096, "os-flavor-access:is_public": true}} {{(pid=123986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:42:20.738326 ncdv-master-1 devstack@n-api.service[123986]: INFO nova.api.openstack.requestlog [None req-1fe7eabc-7067-4cff-9f26-44069f326c86 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.537545 Oct 08 20:42:20.738904 ncdv-master-1 devstack@n-api.service[123986]: [pid: 123986|app: 0|req: 15/28] 10.222.0.26 () {64 vars in 1283 bytes} [Sat Oct 8 20:42:20 2022] POST /compute/v2.1/flavors => generated 406 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 08 20:42:20.750940 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi [None req-3e31eb9d-31b9-4ccc-9e45-7192f6fe6d84 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=123987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:42:20.776605 ncdv-master-1 devstack@n-api.service[123987]: INFO nova.api.openstack.requestlog [None req-3e31eb9d-31b9-4ccc-9e45-7192f6fe6d84 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029349 Oct 08 20:42:20.777213 ncdv-master-1 devstack@n-api.service[123987]: [pid: 123987|app: 0|req: 14/29] 10.222.0.26 () {64 vars in 1333 bytes} [Sat Oct 8 20:42:20 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:42:23.736131 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi [None req-1fe7eabc-7067-4cff-9f26-44069f326c86 admin admin] Calling method '>' {{(pid=123986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:42:23.737055 ncdv-master-1 devstack@n-api.service[123986]: INFO nova.api.openstack.requestlog [None req-1fe7eabc-7067-4cff-9f26-44069f326c86 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Oct 08 20:42:23.741507 ncdv-master-1 devstack@n-api.service[123986]: [pid: 123986|app: 0|req: 16/30] 10.222.0.26 () {54 vars in 931 bytes} [Sat Oct 8 20:42:23 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:42:24.250626 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi [None req-a39a34ae-90c0-4724-9944-89bed9bbf28b admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "disk": 80, "name": "m1.large", "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "ram": 8192, "id": "4"}} {{(pid=123987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:42:24.275226 ncdv-master-1 devstack@n-api.service[123987]: INFO nova.api.openstack.requestlog [None req-a39a34ae-90c0-4724-9944-89bed9bbf28b admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.531288 Oct 08 20:42:24.275886 ncdv-master-1 devstack@n-api.service[123987]: [pid: 123987|app: 0|req: 15/31] 10.222.0.26 () {64 vars in 1283 bytes} [Sat Oct 8 20:42:23 2022] POST /compute/v2.1/flavors => generated 405 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 08 20:42:24.290018 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi [None req-ad9301e8-433b-4fad-8548-63620bcd770c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=123986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:42:24.295246 ncdv-master-1 devstack@n-api.service[123986]: DEBUG dbcounter [-] [123986] Writing DB stats nova_api:SELECT=39,nova_api:SAVEPOINT=4,nova_api:INSERT=8,nova_api:RELEASE=4 {{(pid=123986) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:42:24.324578 ncdv-master-1 devstack@n-api.service[123986]: INFO nova.api.openstack.requestlog [None req-ad9301e8-433b-4fad-8548-63620bcd770c admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038476 Oct 08 20:42:24.325831 ncdv-master-1 devstack@n-api.service[123986]: [pid: 123986|app: 0|req: 17/32] 10.222.0.26 () {64 vars in 1333 bytes} [Sat Oct 8 20:42:24 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:42:27.271204 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi [None req-a39a34ae-90c0-4724-9944-89bed9bbf28b admin admin] Calling method '>' {{(pid=123987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:42:27.272422 ncdv-master-1 devstack@n-api.service[123987]: INFO nova.api.openstack.requestlog [None req-a39a34ae-90c0-4724-9944-89bed9bbf28b admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Oct 08 20:42:27.282361 ncdv-master-1 devstack@n-api.service[123987]: [pid: 123987|app: 0|req: 16/33] 10.222.0.26 () {54 vars in 931 bytes} [Sat Oct 8 20:42:27 2022] GET /compute/v2.1 => generated 388 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:42:27.776386 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi [None req-b39a822a-9d2c-41f0-b3b5-6f8c5df3e591 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 160, "ram": 16384, "vcpus": 8, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "m1.xlarge", "id": "5", "swap": 0}} {{(pid=123986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:42:27.798383 ncdv-master-1 devstack@n-api.service[123986]: INFO nova.api.openstack.requestlog [None req-b39a822a-9d2c-41f0-b3b5-6f8c5df3e591 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.517229 Oct 08 20:42:27.805445 ncdv-master-1 devstack@n-api.service[123986]: [pid: 123986|app: 0|req: 18/34] 10.222.0.26 () {64 vars in 1283 bytes} [Sat Oct 8 20:42:27 2022] POST /compute/v2.1/flavors => generated 408 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 08 20:42:27.811508 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi [None req-b686d6fc-ee18-465e-973a-8534e95de30b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=123987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:42:27.840458 ncdv-master-1 devstack@n-api.service[123987]: INFO nova.api.openstack.requestlog [None req-b686d6fc-ee18-465e-973a-8534e95de30b admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032710 Oct 08 20:42:27.841133 ncdv-master-1 devstack@n-api.service[123987]: [pid: 123987|app: 0|req: 17/35] 10.222.0.26 () {64 vars in 1333 bytes} [Sat Oct 8 20:42:27 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 20:42:46.346797 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi [None req-b39a822a-9d2c-41f0-b3b5-6f8c5df3e591 admin admin] Calling method '>' {{(pid=123986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:42:46.347812 ncdv-master-1 devstack@n-api.service[123986]: INFO nova.api.openstack.requestlog [None req-b39a822a-9d2c-41f0-b3b5-6f8c5df3e591 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Oct 08 20:42:46.348213 ncdv-master-1 devstack@n-api.service[123986]: [pid: 123986|app: 0|req: 19/36] 10.222.0.26 () {54 vars in 931 bytes} [Sat Oct 8 20:42:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:42:46.359476 ncdv-master-1 devstack@n-api.service[123987]: DEBUG dbcounter [-] [123987] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=17,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=123987) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:42:46.735197 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi [None req-49ee805d-2a33-4c41-b94a-5b71e6838369 admin admin] Calling method '>' {{(pid=123987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:42:46.752858 ncdv-master-1 devstack@n-api.service[123987]: INFO nova.api.openstack.requestlog [None req-49ee805d-2a33-4c41-b94a-5b71e6838369 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.398722 Oct 08 20:42:46.753413 ncdv-master-1 devstack@n-api.service[123987]: [pid: 123987|app: 0|req: 18/37] 10.222.0.26 () {60 vars in 1292 bytes} [Sat Oct 8 20:42:46 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 08 20:42:48.648301 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi [None req-b39a822a-9d2c-41f0-b3b5-6f8c5df3e591 admin admin] Calling method '>' {{(pid=123986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:42:48.649334 ncdv-master-1 devstack@n-api.service[123986]: INFO nova.api.openstack.requestlog [None req-b39a822a-9d2c-41f0-b3b5-6f8c5df3e591 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 Oct 08 20:42:48.649732 ncdv-master-1 devstack@n-api.service[123986]: [pid: 123986|app: 0|req: 20/38] 10.222.0.26 () {56 vars in 1074 bytes} [Sat Oct 8 20:42:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:42:49.217590 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi [None req-c2825b9d-6b2e-4870-b2b3-eb4faa3eb68a admin admin] Calling method '>' {{(pid=123987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:42:49.222885 ncdv-master-1 devstack@n-api.service[123987]: INFO nova.api.openstack.wsgi [None req-c2825b9d-6b2e-4870-b2b3-eb4faa3eb68a admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 08 20:42:49.233829 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi [None req-c2825b9d-6b2e-4870-b2b3-eb4faa3eb68a admin admin] Request method failure captured: Oct 08 20:42:49.233829 ncdv-master-1 devstack@n-api.service[123987]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 08 20:42:49.233829 ncdv-master-1 devstack@n-api.service[123987]: Accept: application/json Oct 08 20:42:49.233829 ncdv-master-1 devstack@n-api.service[123987]: Accept-Encoding: gzip, deflate Oct 08 20:42:49.233829 ncdv-master-1 devstack@n-api.service[123987]: Connection: keep-alive Oct 08 20:42:49.233829 ncdv-master-1 devstack@n-api.service[123987]: Content-Length: 0 Oct 08 20:42:49.233829 ncdv-master-1 devstack@n-api.service[123987]: Host: 10.222.0.26 Oct 08 20:42:49.233829 ncdv-master-1 devstack@n-api.service[123987]: Openstack-Api-Version: compute 2.92 Oct 08 20:42:49.233829 ncdv-master-1 devstack@n-api.service[123987]: Openstack-System-Scope: None Oct 08 20:42:49.233829 ncdv-master-1 devstack@n-api.service[123987]: User-Agent: python-novaclient Oct 08 20:42:49.233829 ncdv-master-1 devstack@n-api.service[123987]: X-Auth-Token: gAAAAABjQeDIFqukDnRt4djjFzQ7x53L5A12Ws2Yv1Pbi4Rt5ZXzbmQjhZgxQkN47E4AXAaxpQVSTsWgYHscLUsB0sLBm0f2Olcja7JHInZ0P2akgDNPRWFdTNyhNogEZYypEQFFzQT0hUmsytEEbQ5ve9yXyLuNZROKUOvLPFl2GBWLYfbcBOs Oct 08 20:42:49.233829 ncdv-master-1 devstack@n-api.service[123987]: X-Domain-Id: None Oct 08 20:42:49.233829 ncdv-master-1 devstack@n-api.service[123987]: X-Domain-Name: None Oct 08 20:42:49.233829 ncdv-master-1 devstack@n-api.service[123987]: X-Identity-Status: Confirmed Oct 08 20:42:49.233829 ncdv-master-1 devstack@n-api.service[123987]: X-Is-Admin-Project: True Oct 08 20:42:49.233829 ncdv-master-1 devstack@n-api.service[123987]: X-Openstack-Nova-Api-Version: 2.92 Oct 08 20:42:49.233829 ncdv-master-1 devstack@n-api.service[123987]: X-Project-Domain-Id: default Oct 08 20:42:49.233829 ncdv-master-1 devstack@n-api.service[123987]: X-Project-Domain-Name: Default Oct 08 20:42:49.233829 ncdv-master-1 devstack@n-api.service[123987]: X-Project-Id: 8cbdca763b15498ebcee722600237097 Oct 08 20:42:49.233829 ncdv-master-1 devstack@n-api.service[123987]: X-Project-Name: admin Oct 08 20:42:49.233829 ncdv-master-1 devstack@n-api.service[123987]: X-Role: reader,admin,member Oct 08 20:42:49.233829 ncdv-master-1 devstack@n-api.service[123987]: X-Roles: reader,admin,member Oct 08 20:42:49.235446 ncdv-master-1 devstack@n-api.service[123987]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8cbdca763b15498ebcee722600237097"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8cbdca763b15498ebcee722600237097"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8cbdca763b15498ebcee722600237097"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8cbdca763b15498ebcee722600237097"}]}] Oct 08 20:42:49.235446 ncdv-master-1 devstack@n-api.service[123987]: X-Tenant: admin Oct 08 20:42:49.235446 ncdv-master-1 devstack@n-api.service[123987]: X-Tenant-Id: 8cbdca763b15498ebcee722600237097 Oct 08 20:42:49.235446 ncdv-master-1 devstack@n-api.service[123987]: X-Tenant-Name: admin Oct 08 20:42:49.235446 ncdv-master-1 devstack@n-api.service[123987]: X-User: admin Oct 08 20:42:49.235446 ncdv-master-1 devstack@n-api.service[123987]: X-User-Domain-Id: default Oct 08 20:42:49.235446 ncdv-master-1 devstack@n-api.service[123987]: X-User-Domain-Name: Default Oct 08 20:42:49.235446 ncdv-master-1 devstack@n-api.service[123987]: X-User-Id: 1a6e50d0928e4f92987cd089e6138f36 Oct 08 20:42:49.235446 ncdv-master-1 devstack@n-api.service[123987]: X-User-Name: admin Oct 08 20:42:49.235446 ncdv-master-1 devstack@n-api.service[123987]: method: > Oct 08 20:42:49.235446 ncdv-master-1 devstack@n-api.service[123987]: exception: Flavor 42 could not be found. Oct 08 20:42:49.235446 ncdv-master-1 devstack@n-api.service[123987]: action_args: {'id': '42'} Oct 08 20:42:49.235446 ncdv-master-1 devstack@n-api.service[123987]: {{(pid=123987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:42:49.235446 ncdv-master-1 devstack@n-api.service[123987]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:42:49.236457 ncdv-master-1 devstack@n-api.service[123987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 08 20:42:49.236457 ncdv-master-1 devstack@n-api.service[123987]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 08 20:42:49.236457 ncdv-master-1 devstack@n-api.service[123987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 08 20:42:49.236457 ncdv-master-1 devstack@n-api.service[123987]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 08 20:42:49.236457 ncdv-master-1 devstack@n-api.service[123987]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 08 20:42:49.236457 ncdv-master-1 devstack@n-api.service[123987]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 08 20:42:49.236457 ncdv-master-1 devstack@n-api.service[123987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 08 20:42:49.236457 ncdv-master-1 devstack@n-api.service[123987]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 08 20:42:49.236457 ncdv-master-1 devstack@n-api.service[123987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 08 20:42:49.236457 ncdv-master-1 devstack@n-api.service[123987]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:42:49.236457 ncdv-master-1 devstack@n-api.service[123987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 08 20:42:49.236457 ncdv-master-1 devstack@n-api.service[123987]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 08 20:42:49.236457 ncdv-master-1 devstack@n-api.service[123987]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 08 20:42:49.236457 ncdv-master-1 devstack@n-api.service[123987]: ERROR nova.api.openstack.wsgi Oct 08 20:42:49.236457 ncdv-master-1 devstack@n-api.service[123987]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:42:49.236457 ncdv-master-1 devstack@n-api.service[123987]: ERROR nova.api.openstack.wsgi Oct 08 20:42:49.236457 ncdv-master-1 devstack@n-api.service[123987]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:42:49.236457 ncdv-master-1 devstack@n-api.service[123987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:42:49.236457 ncdv-master-1 devstack@n-api.service[123987]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:42:49.237713 ncdv-master-1 devstack@n-api.service[123987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:42:49.237713 ncdv-master-1 devstack@n-api.service[123987]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:42:49.237713 ncdv-master-1 devstack@n-api.service[123987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:42:49.237713 ncdv-master-1 devstack@n-api.service[123987]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:42:49.237713 ncdv-master-1 devstack@n-api.service[123987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 08 20:42:49.237713 ncdv-master-1 devstack@n-api.service[123987]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 08 20:42:49.237713 ncdv-master-1 devstack@n-api.service[123987]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 08 20:42:49.237713 ncdv-master-1 devstack@n-api.service[123987]: ERROR nova.api.openstack.wsgi Oct 08 20:42:49.237713 ncdv-master-1 devstack@n-api.service[123987]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:42:49.237713 ncdv-master-1 devstack@n-api.service[123987]: ERROR nova.api.openstack.wsgi Oct 08 20:42:49.237713 ncdv-master-1 devstack@n-api.service[123987]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:42:49.237713 ncdv-master-1 devstack@n-api.service[123987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:42:49.237713 ncdv-master-1 devstack@n-api.service[123987]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:42:49.237713 ncdv-master-1 devstack@n-api.service[123987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 20:42:49.237713 ncdv-master-1 devstack@n-api.service[123987]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 20:42:49.237713 ncdv-master-1 devstack@n-api.service[123987]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 08 20:42:49.237713 ncdv-master-1 devstack@n-api.service[123987]: ERROR nova.api.openstack.wsgi Oct 08 20:42:49.237713 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi [None req-c2825b9d-6b2e-4870-b2b3-eb4faa3eb68a admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=123987) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:42:49.238781 ncdv-master-1 devstack@n-api.service[123987]: INFO nova.api.openstack.requestlog [None req-c2825b9d-6b2e-4870-b2b3-eb4faa3eb68a admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.398699 Oct 08 20:42:49.238781 ncdv-master-1 devstack@n-api.service[123987]: [pid: 123987|app: 0|req: 19/39] 10.222.0.26 () {60 vars in 1190 bytes} [Sat Oct 8 20:42:48 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 400 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 08 20:42:49.244907 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi [None req-b3d96565-0a71-42c4-ae5f-c9b47d677105 admin admin] Calling method '>' {{(pid=123986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:42:49.249555 ncdv-master-1 devstack@n-api.service[123986]: DEBUG dbcounter [-] [123986] Writing DB stats nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:INSERT=2,nova_api:RELEASE=1 {{(pid=123986) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:42:49.269208 ncdv-master-1 devstack@n-api.service[123986]: INFO nova.api.openstack.requestlog [None req-b3d96565-0a71-42c4-ae5f-c9b47d677105 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027888 Oct 08 20:42:49.269751 ncdv-master-1 devstack@n-api.service[123986]: [pid: 123986|app: 0|req: 21/40] 10.222.0.26 () {60 vars in 1210 bytes} [Sat Oct 8 20:42:49 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 08 20:42:49.280205 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi [None req-562d76c8-1b48-4339-852b-a33ec20b6f5d admin admin] Calling method '>' {{(pid=123987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:42:49.304032 ncdv-master-1 devstack@n-api.service[123987]: INFO nova.api.openstack.requestlog [None req-562d76c8-1b48-4339-852b-a33ec20b6f5d admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.028206 Oct 08 20:42:49.304568 ncdv-master-1 devstack@n-api.service[123987]: [pid: 123987|app: 0|req: 20/41] 10.222.0.26 () {60 vars in 1210 bytes} [Sat Oct 8 20:42:49 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:42:49.314959 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi [None req-9300c906-15ea-4b80-b68c-381a90c37e5f admin admin] Calling method '>' {{(pid=123986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:42:49.320903 ncdv-master-1 devstack@n-api.service[123986]: INFO nova.api.openstack.wsgi [None req-9300c906-15ea-4b80-b68c-381a90c37e5f admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 08 20:42:49.324255 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi [None req-9300c906-15ea-4b80-b68c-381a90c37e5f admin admin] Request method failure captured: Oct 08 20:42:49.324255 ncdv-master-1 devstack@n-api.service[123986]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 08 20:42:49.324255 ncdv-master-1 devstack@n-api.service[123986]: Accept: application/json Oct 08 20:42:49.324255 ncdv-master-1 devstack@n-api.service[123986]: Accept-Encoding: gzip, deflate Oct 08 20:42:49.324255 ncdv-master-1 devstack@n-api.service[123986]: Connection: keep-alive Oct 08 20:42:49.324255 ncdv-master-1 devstack@n-api.service[123986]: Content-Length: 0 Oct 08 20:42:49.324255 ncdv-master-1 devstack@n-api.service[123986]: Host: 10.222.0.26 Oct 08 20:42:49.324255 ncdv-master-1 devstack@n-api.service[123986]: Openstack-Api-Version: compute 2.92 Oct 08 20:42:49.324255 ncdv-master-1 devstack@n-api.service[123986]: Openstack-System-Scope: None Oct 08 20:42:49.324255 ncdv-master-1 devstack@n-api.service[123986]: User-Agent: python-novaclient Oct 08 20:42:49.324255 ncdv-master-1 devstack@n-api.service[123986]: X-Auth-Token: gAAAAABjQeDIFqukDnRt4djjFzQ7x53L5A12Ws2Yv1Pbi4Rt5ZXzbmQjhZgxQkN47E4AXAaxpQVSTsWgYHscLUsB0sLBm0f2Olcja7JHInZ0P2akgDNPRWFdTNyhNogEZYypEQFFzQT0hUmsytEEbQ5ve9yXyLuNZROKUOvLPFl2GBWLYfbcBOs Oct 08 20:42:49.324255 ncdv-master-1 devstack@n-api.service[123986]: X-Domain-Id: None Oct 08 20:42:49.324255 ncdv-master-1 devstack@n-api.service[123986]: X-Domain-Name: None Oct 08 20:42:49.324255 ncdv-master-1 devstack@n-api.service[123986]: X-Identity-Status: Confirmed Oct 08 20:42:49.324255 ncdv-master-1 devstack@n-api.service[123986]: X-Is-Admin-Project: True Oct 08 20:42:49.324255 ncdv-master-1 devstack@n-api.service[123986]: X-Openstack-Nova-Api-Version: 2.92 Oct 08 20:42:49.324255 ncdv-master-1 devstack@n-api.service[123986]: X-Project-Domain-Id: default Oct 08 20:42:49.324255 ncdv-master-1 devstack@n-api.service[123986]: X-Project-Domain-Name: Default Oct 08 20:42:49.324255 ncdv-master-1 devstack@n-api.service[123986]: X-Project-Id: 8cbdca763b15498ebcee722600237097 Oct 08 20:42:49.324255 ncdv-master-1 devstack@n-api.service[123986]: X-Project-Name: admin Oct 08 20:42:49.324255 ncdv-master-1 devstack@n-api.service[123986]: X-Role: reader,admin,member Oct 08 20:42:49.324255 ncdv-master-1 devstack@n-api.service[123986]: X-Roles: reader,admin,member Oct 08 20:42:49.326373 ncdv-master-1 devstack@n-api.service[123986]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8cbdca763b15498ebcee722600237097"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8cbdca763b15498ebcee722600237097"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8cbdca763b15498ebcee722600237097"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8cbdca763b15498ebcee722600237097"}]}] Oct 08 20:42:49.326373 ncdv-master-1 devstack@n-api.service[123986]: X-Tenant: admin Oct 08 20:42:49.326373 ncdv-master-1 devstack@n-api.service[123986]: X-Tenant-Id: 8cbdca763b15498ebcee722600237097 Oct 08 20:42:49.326373 ncdv-master-1 devstack@n-api.service[123986]: X-Tenant-Name: admin Oct 08 20:42:49.326373 ncdv-master-1 devstack@n-api.service[123986]: X-User: admin Oct 08 20:42:49.326373 ncdv-master-1 devstack@n-api.service[123986]: X-User-Domain-Id: default Oct 08 20:42:49.326373 ncdv-master-1 devstack@n-api.service[123986]: X-User-Domain-Name: Default Oct 08 20:42:49.326373 ncdv-master-1 devstack@n-api.service[123986]: X-User-Id: 1a6e50d0928e4f92987cd089e6138f36 Oct 08 20:42:49.326373 ncdv-master-1 devstack@n-api.service[123986]: X-User-Name: admin Oct 08 20:42:49.326373 ncdv-master-1 devstack@n-api.service[123986]: method: > Oct 08 20:42:49.326373 ncdv-master-1 devstack@n-api.service[123986]: exception: Flavor 42 could not be found. Oct 08 20:42:49.326373 ncdv-master-1 devstack@n-api.service[123986]: action_args: {'id': '42'} Oct 08 20:42:49.326373 ncdv-master-1 devstack@n-api.service[123986]: {{(pid=123986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:42:49.326373 ncdv-master-1 devstack@n-api.service[123986]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:42:49.327235 ncdv-master-1 devstack@n-api.service[123986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 08 20:42:49.327235 ncdv-master-1 devstack@n-api.service[123986]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 08 20:42:49.327235 ncdv-master-1 devstack@n-api.service[123986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 08 20:42:49.327235 ncdv-master-1 devstack@n-api.service[123986]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 08 20:42:49.327235 ncdv-master-1 devstack@n-api.service[123986]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 08 20:42:49.327235 ncdv-master-1 devstack@n-api.service[123986]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 08 20:42:49.327235 ncdv-master-1 devstack@n-api.service[123986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 08 20:42:49.327235 ncdv-master-1 devstack@n-api.service[123986]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 08 20:42:49.327235 ncdv-master-1 devstack@n-api.service[123986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 08 20:42:49.327235 ncdv-master-1 devstack@n-api.service[123986]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:42:49.327235 ncdv-master-1 devstack@n-api.service[123986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 08 20:42:49.327235 ncdv-master-1 devstack@n-api.service[123986]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 08 20:42:49.327235 ncdv-master-1 devstack@n-api.service[123986]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 08 20:42:49.327235 ncdv-master-1 devstack@n-api.service[123986]: ERROR nova.api.openstack.wsgi Oct 08 20:42:49.327235 ncdv-master-1 devstack@n-api.service[123986]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:42:49.327235 ncdv-master-1 devstack@n-api.service[123986]: ERROR nova.api.openstack.wsgi Oct 08 20:42:49.327235 ncdv-master-1 devstack@n-api.service[123986]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:42:49.327235 ncdv-master-1 devstack@n-api.service[123986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:42:49.327235 ncdv-master-1 devstack@n-api.service[123986]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:42:49.328615 ncdv-master-1 devstack@n-api.service[123986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:42:49.328615 ncdv-master-1 devstack@n-api.service[123986]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:42:49.328615 ncdv-master-1 devstack@n-api.service[123986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:42:49.328615 ncdv-master-1 devstack@n-api.service[123986]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:42:49.328615 ncdv-master-1 devstack@n-api.service[123986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 08 20:42:49.328615 ncdv-master-1 devstack@n-api.service[123986]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 08 20:42:49.328615 ncdv-master-1 devstack@n-api.service[123986]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 08 20:42:49.328615 ncdv-master-1 devstack@n-api.service[123986]: ERROR nova.api.openstack.wsgi Oct 08 20:42:49.328615 ncdv-master-1 devstack@n-api.service[123986]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:42:49.328615 ncdv-master-1 devstack@n-api.service[123986]: ERROR nova.api.openstack.wsgi Oct 08 20:42:49.328615 ncdv-master-1 devstack@n-api.service[123986]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:42:49.328615 ncdv-master-1 devstack@n-api.service[123986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:42:49.328615 ncdv-master-1 devstack@n-api.service[123986]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:42:49.328615 ncdv-master-1 devstack@n-api.service[123986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 20:42:49.328615 ncdv-master-1 devstack@n-api.service[123986]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 20:42:49.328615 ncdv-master-1 devstack@n-api.service[123986]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 08 20:42:49.328615 ncdv-master-1 devstack@n-api.service[123986]: ERROR nova.api.openstack.wsgi Oct 08 20:42:49.328615 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi [None req-9300c906-15ea-4b80-b68c-381a90c37e5f admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=123986) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:42:49.329879 ncdv-master-1 devstack@n-api.service[123986]: INFO nova.api.openstack.requestlog [None req-9300c906-15ea-4b80-b68c-381a90c37e5f admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.015392 Oct 08 20:42:49.329879 ncdv-master-1 devstack@n-api.service[123986]: [pid: 123986|app: 0|req: 22/42] 10.222.0.26 () {60 vars in 1190 bytes} [Sat Oct 8 20:42:49 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 08 20:42:51.106876 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi [None req-562d76c8-1b48-4339-852b-a33ec20b6f5d admin admin] Calling method '>' {{(pid=123987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:42:51.108137 ncdv-master-1 devstack@n-api.service[123987]: INFO nova.api.openstack.requestlog [None req-562d76c8-1b48-4339-852b-a33ec20b6f5d admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001747 Oct 08 20:42:51.108545 ncdv-master-1 devstack@n-api.service[123987]: [pid: 123987|app: 0|req: 21/43] 10.222.0.26 () {56 vars in 1074 bytes} [Sat Oct 8 20:42:51 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:42:51.638696 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi [None req-f1add2b8-9f02-406d-99a8-6e3e1cdb3904 admin admin] Calling method '>' {{(pid=123986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:42:51.643613 ncdv-master-1 devstack@n-api.service[123986]: INFO nova.api.openstack.wsgi [None req-f1add2b8-9f02-406d-99a8-6e3e1cdb3904 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 08 20:42:51.645097 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi [None req-f1add2b8-9f02-406d-99a8-6e3e1cdb3904 admin admin] Request method failure captured: Oct 08 20:42:51.645097 ncdv-master-1 devstack@n-api.service[123986]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 08 20:42:51.645097 ncdv-master-1 devstack@n-api.service[123986]: Accept: application/json Oct 08 20:42:51.645097 ncdv-master-1 devstack@n-api.service[123986]: Accept-Encoding: gzip, deflate Oct 08 20:42:51.645097 ncdv-master-1 devstack@n-api.service[123986]: Connection: keep-alive Oct 08 20:42:51.645097 ncdv-master-1 devstack@n-api.service[123986]: Content-Length: 0 Oct 08 20:42:51.645097 ncdv-master-1 devstack@n-api.service[123986]: Host: 10.222.0.26 Oct 08 20:42:51.645097 ncdv-master-1 devstack@n-api.service[123986]: Openstack-Api-Version: compute 2.92 Oct 08 20:42:51.645097 ncdv-master-1 devstack@n-api.service[123986]: Openstack-System-Scope: None Oct 08 20:42:51.645097 ncdv-master-1 devstack@n-api.service[123986]: User-Agent: python-novaclient Oct 08 20:42:51.645097 ncdv-master-1 devstack@n-api.service[123986]: X-Auth-Token: gAAAAABjQeDLXtrNY9tUpz_s2MKpsceVp5GVjyYy2FkxsXbREToYx9ZTPer450tDNlcQ3iY0CbjKAzmgmFGs2SvUBkYIdySLpLNNb9VqRx4t3L_NL5-zWI7lTAQebQWI3qGYt47gLOlHWv6ZEXGXBGCoHy4TimxuNONvP3H2vmIMAwrv5gxVgU4 Oct 08 20:42:51.645097 ncdv-master-1 devstack@n-api.service[123986]: X-Domain-Id: None Oct 08 20:42:51.645097 ncdv-master-1 devstack@n-api.service[123986]: X-Domain-Name: None Oct 08 20:42:51.645097 ncdv-master-1 devstack@n-api.service[123986]: X-Identity-Status: Confirmed Oct 08 20:42:51.645097 ncdv-master-1 devstack@n-api.service[123986]: X-Is-Admin-Project: True Oct 08 20:42:51.645097 ncdv-master-1 devstack@n-api.service[123986]: X-Openstack-Nova-Api-Version: 2.92 Oct 08 20:42:51.645097 ncdv-master-1 devstack@n-api.service[123986]: X-Project-Domain-Id: default Oct 08 20:42:51.645097 ncdv-master-1 devstack@n-api.service[123986]: X-Project-Domain-Name: Default Oct 08 20:42:51.645097 ncdv-master-1 devstack@n-api.service[123986]: X-Project-Id: 8cbdca763b15498ebcee722600237097 Oct 08 20:42:51.645097 ncdv-master-1 devstack@n-api.service[123986]: X-Project-Name: admin Oct 08 20:42:51.645097 ncdv-master-1 devstack@n-api.service[123986]: X-Role: reader,admin,member Oct 08 20:42:51.645097 ncdv-master-1 devstack@n-api.service[123986]: X-Roles: reader,admin,member Oct 08 20:42:51.646635 ncdv-master-1 devstack@n-api.service[123986]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8cbdca763b15498ebcee722600237097"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8cbdca763b15498ebcee722600237097"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8cbdca763b15498ebcee722600237097"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8cbdca763b15498ebcee722600237097"}]}] Oct 08 20:42:51.646635 ncdv-master-1 devstack@n-api.service[123986]: X-Tenant: admin Oct 08 20:42:51.646635 ncdv-master-1 devstack@n-api.service[123986]: X-Tenant-Id: 8cbdca763b15498ebcee722600237097 Oct 08 20:42:51.646635 ncdv-master-1 devstack@n-api.service[123986]: X-Tenant-Name: admin Oct 08 20:42:51.646635 ncdv-master-1 devstack@n-api.service[123986]: X-User: admin Oct 08 20:42:51.646635 ncdv-master-1 devstack@n-api.service[123986]: X-User-Domain-Id: default Oct 08 20:42:51.646635 ncdv-master-1 devstack@n-api.service[123986]: X-User-Domain-Name: Default Oct 08 20:42:51.646635 ncdv-master-1 devstack@n-api.service[123986]: X-User-Id: 1a6e50d0928e4f92987cd089e6138f36 Oct 08 20:42:51.646635 ncdv-master-1 devstack@n-api.service[123986]: X-User-Name: admin Oct 08 20:42:51.646635 ncdv-master-1 devstack@n-api.service[123986]: method: > Oct 08 20:42:51.646635 ncdv-master-1 devstack@n-api.service[123986]: exception: Flavor 84 could not be found. Oct 08 20:42:51.646635 ncdv-master-1 devstack@n-api.service[123986]: action_args: {'id': '84'} Oct 08 20:42:51.646635 ncdv-master-1 devstack@n-api.service[123986]: {{(pid=123986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:42:51.646635 ncdv-master-1 devstack@n-api.service[123986]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:42:51.648341 ncdv-master-1 devstack@n-api.service[123986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 08 20:42:51.648341 ncdv-master-1 devstack@n-api.service[123986]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 08 20:42:51.648341 ncdv-master-1 devstack@n-api.service[123986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 08 20:42:51.648341 ncdv-master-1 devstack@n-api.service[123986]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 08 20:42:51.648341 ncdv-master-1 devstack@n-api.service[123986]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 08 20:42:51.648341 ncdv-master-1 devstack@n-api.service[123986]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 08 20:42:51.648341 ncdv-master-1 devstack@n-api.service[123986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 08 20:42:51.648341 ncdv-master-1 devstack@n-api.service[123986]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 08 20:42:51.648341 ncdv-master-1 devstack@n-api.service[123986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 08 20:42:51.648341 ncdv-master-1 devstack@n-api.service[123986]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:42:51.648341 ncdv-master-1 devstack@n-api.service[123986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 08 20:42:51.648341 ncdv-master-1 devstack@n-api.service[123986]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 08 20:42:51.648341 ncdv-master-1 devstack@n-api.service[123986]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 08 20:42:51.648341 ncdv-master-1 devstack@n-api.service[123986]: ERROR nova.api.openstack.wsgi Oct 08 20:42:51.648341 ncdv-master-1 devstack@n-api.service[123986]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:42:51.648341 ncdv-master-1 devstack@n-api.service[123986]: ERROR nova.api.openstack.wsgi Oct 08 20:42:51.648341 ncdv-master-1 devstack@n-api.service[123986]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:42:51.648341 ncdv-master-1 devstack@n-api.service[123986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:42:51.648341 ncdv-master-1 devstack@n-api.service[123986]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:42:51.649575 ncdv-master-1 devstack@n-api.service[123986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:42:51.649575 ncdv-master-1 devstack@n-api.service[123986]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:42:51.649575 ncdv-master-1 devstack@n-api.service[123986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:42:51.649575 ncdv-master-1 devstack@n-api.service[123986]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:42:51.649575 ncdv-master-1 devstack@n-api.service[123986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 08 20:42:51.649575 ncdv-master-1 devstack@n-api.service[123986]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 08 20:42:51.649575 ncdv-master-1 devstack@n-api.service[123986]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 08 20:42:51.649575 ncdv-master-1 devstack@n-api.service[123986]: ERROR nova.api.openstack.wsgi Oct 08 20:42:51.649575 ncdv-master-1 devstack@n-api.service[123986]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:42:51.649575 ncdv-master-1 devstack@n-api.service[123986]: ERROR nova.api.openstack.wsgi Oct 08 20:42:51.649575 ncdv-master-1 devstack@n-api.service[123986]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:42:51.649575 ncdv-master-1 devstack@n-api.service[123986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:42:51.649575 ncdv-master-1 devstack@n-api.service[123986]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:42:51.649575 ncdv-master-1 devstack@n-api.service[123986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 20:42:51.649575 ncdv-master-1 devstack@n-api.service[123986]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 20:42:51.649575 ncdv-master-1 devstack@n-api.service[123986]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 08 20:42:51.649575 ncdv-master-1 devstack@n-api.service[123986]: ERROR nova.api.openstack.wsgi Oct 08 20:42:51.649575 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi [None req-f1add2b8-9f02-406d-99a8-6e3e1cdb3904 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=123986) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:42:51.650584 ncdv-master-1 devstack@n-api.service[123986]: INFO nova.api.openstack.requestlog [None req-f1add2b8-9f02-406d-99a8-6e3e1cdb3904 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.391245 Oct 08 20:42:51.650584 ncdv-master-1 devstack@n-api.service[123986]: [pid: 123986|app: 0|req: 23/44] 10.222.0.26 () {60 vars in 1190 bytes} [Sat Oct 8 20:42:51 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 392 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 08 20:42:51.656109 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi [None req-21853b5c-97f8-4982-a061-43b6c7c5e17a admin admin] Calling method '>' {{(pid=123987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:42:51.671246 ncdv-master-1 devstack@n-api.service[123987]: INFO nova.api.openstack.requestlog [None req-21853b5c-97f8-4982-a061-43b6c7c5e17a admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018741 Oct 08 20:42:51.671760 ncdv-master-1 devstack@n-api.service[123987]: [pid: 123987|app: 0|req: 22/45] 10.222.0.26 () {60 vars in 1210 bytes} [Sat Oct 8 20:42:51 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:42:51.680978 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi [None req-fa481be4-ba06-402e-80dd-cb5707fc0dd1 admin admin] Calling method '>' {{(pid=123986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:42:51.698678 ncdv-master-1 devstack@n-api.service[123986]: INFO nova.api.openstack.requestlog [None req-fa481be4-ba06-402e-80dd-cb5707fc0dd1 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.021021 Oct 08 20:42:51.699214 ncdv-master-1 devstack@n-api.service[123986]: [pid: 123986|app: 0|req: 24/46] 10.222.0.26 () {60 vars in 1210 bytes} [Sat Oct 8 20:42:51 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:42:51.708694 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi [None req-a37c07a5-316d-444e-8f0a-3b743fd16bac admin admin] Calling method '>' {{(pid=123987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:42:51.713753 ncdv-master-1 devstack@n-api.service[123987]: INFO nova.api.openstack.wsgi [None req-a37c07a5-316d-444e-8f0a-3b743fd16bac admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 08 20:42:51.715241 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi [None req-a37c07a5-316d-444e-8f0a-3b743fd16bac admin admin] Request method failure captured: Oct 08 20:42:51.715241 ncdv-master-1 devstack@n-api.service[123987]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 08 20:42:51.715241 ncdv-master-1 devstack@n-api.service[123987]: Accept: application/json Oct 08 20:42:51.715241 ncdv-master-1 devstack@n-api.service[123987]: Accept-Encoding: gzip, deflate Oct 08 20:42:51.715241 ncdv-master-1 devstack@n-api.service[123987]: Connection: keep-alive Oct 08 20:42:51.715241 ncdv-master-1 devstack@n-api.service[123987]: Content-Length: 0 Oct 08 20:42:51.715241 ncdv-master-1 devstack@n-api.service[123987]: Host: 10.222.0.26 Oct 08 20:42:51.715241 ncdv-master-1 devstack@n-api.service[123987]: Openstack-Api-Version: compute 2.92 Oct 08 20:42:51.715241 ncdv-master-1 devstack@n-api.service[123987]: Openstack-System-Scope: None Oct 08 20:42:51.715241 ncdv-master-1 devstack@n-api.service[123987]: User-Agent: python-novaclient Oct 08 20:42:51.715241 ncdv-master-1 devstack@n-api.service[123987]: X-Auth-Token: gAAAAABjQeDLXtrNY9tUpz_s2MKpsceVp5GVjyYy2FkxsXbREToYx9ZTPer450tDNlcQ3iY0CbjKAzmgmFGs2SvUBkYIdySLpLNNb9VqRx4t3L_NL5-zWI7lTAQebQWI3qGYt47gLOlHWv6ZEXGXBGCoHy4TimxuNONvP3H2vmIMAwrv5gxVgU4 Oct 08 20:42:51.715241 ncdv-master-1 devstack@n-api.service[123987]: X-Domain-Id: None Oct 08 20:42:51.715241 ncdv-master-1 devstack@n-api.service[123987]: X-Domain-Name: None Oct 08 20:42:51.715241 ncdv-master-1 devstack@n-api.service[123987]: X-Identity-Status: Confirmed Oct 08 20:42:51.715241 ncdv-master-1 devstack@n-api.service[123987]: X-Is-Admin-Project: True Oct 08 20:42:51.715241 ncdv-master-1 devstack@n-api.service[123987]: X-Openstack-Nova-Api-Version: 2.92 Oct 08 20:42:51.715241 ncdv-master-1 devstack@n-api.service[123987]: X-Project-Domain-Id: default Oct 08 20:42:51.715241 ncdv-master-1 devstack@n-api.service[123987]: X-Project-Domain-Name: Default Oct 08 20:42:51.715241 ncdv-master-1 devstack@n-api.service[123987]: X-Project-Id: 8cbdca763b15498ebcee722600237097 Oct 08 20:42:51.715241 ncdv-master-1 devstack@n-api.service[123987]: X-Project-Name: admin Oct 08 20:42:51.715241 ncdv-master-1 devstack@n-api.service[123987]: X-Role: reader,admin,member Oct 08 20:42:51.715241 ncdv-master-1 devstack@n-api.service[123987]: X-Roles: reader,admin,member Oct 08 20:42:51.716841 ncdv-master-1 devstack@n-api.service[123987]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8cbdca763b15498ebcee722600237097"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8cbdca763b15498ebcee722600237097"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8cbdca763b15498ebcee722600237097"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8cbdca763b15498ebcee722600237097"}]}] Oct 08 20:42:51.716841 ncdv-master-1 devstack@n-api.service[123987]: X-Tenant: admin Oct 08 20:42:51.716841 ncdv-master-1 devstack@n-api.service[123987]: X-Tenant-Id: 8cbdca763b15498ebcee722600237097 Oct 08 20:42:51.716841 ncdv-master-1 devstack@n-api.service[123987]: X-Tenant-Name: admin Oct 08 20:42:51.716841 ncdv-master-1 devstack@n-api.service[123987]: X-User: admin Oct 08 20:42:51.716841 ncdv-master-1 devstack@n-api.service[123987]: X-User-Domain-Id: default Oct 08 20:42:51.716841 ncdv-master-1 devstack@n-api.service[123987]: X-User-Domain-Name: Default Oct 08 20:42:51.716841 ncdv-master-1 devstack@n-api.service[123987]: X-User-Id: 1a6e50d0928e4f92987cd089e6138f36 Oct 08 20:42:51.716841 ncdv-master-1 devstack@n-api.service[123987]: X-User-Name: admin Oct 08 20:42:51.716841 ncdv-master-1 devstack@n-api.service[123987]: method: > Oct 08 20:42:51.716841 ncdv-master-1 devstack@n-api.service[123987]: exception: Flavor 84 could not be found. Oct 08 20:42:51.716841 ncdv-master-1 devstack@n-api.service[123987]: action_args: {'id': '84'} Oct 08 20:42:51.716841 ncdv-master-1 devstack@n-api.service[123987]: {{(pid=123987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:42:51.716841 ncdv-master-1 devstack@n-api.service[123987]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:42:51.717667 ncdv-master-1 devstack@n-api.service[123987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 08 20:42:51.717667 ncdv-master-1 devstack@n-api.service[123987]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 08 20:42:51.717667 ncdv-master-1 devstack@n-api.service[123987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 08 20:42:51.717667 ncdv-master-1 devstack@n-api.service[123987]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 08 20:42:51.717667 ncdv-master-1 devstack@n-api.service[123987]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 08 20:42:51.717667 ncdv-master-1 devstack@n-api.service[123987]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 08 20:42:51.717667 ncdv-master-1 devstack@n-api.service[123987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 08 20:42:51.717667 ncdv-master-1 devstack@n-api.service[123987]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 08 20:42:51.717667 ncdv-master-1 devstack@n-api.service[123987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 08 20:42:51.717667 ncdv-master-1 devstack@n-api.service[123987]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:42:51.717667 ncdv-master-1 devstack@n-api.service[123987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 08 20:42:51.717667 ncdv-master-1 devstack@n-api.service[123987]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 08 20:42:51.717667 ncdv-master-1 devstack@n-api.service[123987]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 08 20:42:51.717667 ncdv-master-1 devstack@n-api.service[123987]: ERROR nova.api.openstack.wsgi Oct 08 20:42:51.717667 ncdv-master-1 devstack@n-api.service[123987]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:42:51.717667 ncdv-master-1 devstack@n-api.service[123987]: ERROR nova.api.openstack.wsgi Oct 08 20:42:51.717667 ncdv-master-1 devstack@n-api.service[123987]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:42:51.717667 ncdv-master-1 devstack@n-api.service[123987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:42:51.717667 ncdv-master-1 devstack@n-api.service[123987]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:42:51.718761 ncdv-master-1 devstack@n-api.service[123987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:42:51.718761 ncdv-master-1 devstack@n-api.service[123987]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:42:51.718761 ncdv-master-1 devstack@n-api.service[123987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:42:51.718761 ncdv-master-1 devstack@n-api.service[123987]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:42:51.718761 ncdv-master-1 devstack@n-api.service[123987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 08 20:42:51.718761 ncdv-master-1 devstack@n-api.service[123987]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 08 20:42:51.718761 ncdv-master-1 devstack@n-api.service[123987]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 08 20:42:51.718761 ncdv-master-1 devstack@n-api.service[123987]: ERROR nova.api.openstack.wsgi Oct 08 20:42:51.718761 ncdv-master-1 devstack@n-api.service[123987]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:42:51.718761 ncdv-master-1 devstack@n-api.service[123987]: ERROR nova.api.openstack.wsgi Oct 08 20:42:51.718761 ncdv-master-1 devstack@n-api.service[123987]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:42:51.718761 ncdv-master-1 devstack@n-api.service[123987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:42:51.718761 ncdv-master-1 devstack@n-api.service[123987]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:42:51.718761 ncdv-master-1 devstack@n-api.service[123987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 20:42:51.718761 ncdv-master-1 devstack@n-api.service[123987]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 20:42:51.718761 ncdv-master-1 devstack@n-api.service[123987]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 08 20:42:51.718761 ncdv-master-1 devstack@n-api.service[123987]: ERROR nova.api.openstack.wsgi Oct 08 20:42:51.718761 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi [None req-a37c07a5-316d-444e-8f0a-3b743fd16bac admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=123987) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:42:51.719814 ncdv-master-1 devstack@n-api.service[123987]: INFO nova.api.openstack.requestlog [None req-a37c07a5-316d-444e-8f0a-3b743fd16bac admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011490 Oct 08 20:42:51.719814 ncdv-master-1 devstack@n-api.service[123987]: [pid: 123987|app: 0|req: 23/47] 10.222.0.26 () {60 vars in 1190 bytes} [Sat Oct 8 20:42:51 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 08 20:42:53.488713 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi [None req-fa481be4-ba06-402e-80dd-cb5707fc0dd1 admin admin] Calling method '>' {{(pid=123986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:42:53.489756 ncdv-master-1 devstack@n-api.service[123986]: INFO nova.api.openstack.requestlog [None req-fa481be4-ba06-402e-80dd-cb5707fc0dd1 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Oct 08 20:42:53.490155 ncdv-master-1 devstack@n-api.service[123986]: [pid: 123986|app: 0|req: 25/48] 10.222.0.26 () {56 vars in 1074 bytes} [Sat Oct 8 20:42:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:42:54.020812 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi [None req-c9d5031e-5412-41f7-b8e8-9b1271604b65 admin admin] Calling method '>' {{(pid=123987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:42:54.026742 ncdv-master-1 devstack@n-api.service[123987]: INFO nova.api.openstack.wsgi [None req-c9d5031e-5412-41f7-b8e8-9b1271604b65 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 08 20:42:54.028345 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi [None req-c9d5031e-5412-41f7-b8e8-9b1271604b65 admin admin] Request method failure captured: Oct 08 20:42:54.028345 ncdv-master-1 devstack@n-api.service[123987]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 08 20:42:54.028345 ncdv-master-1 devstack@n-api.service[123987]: Accept: application/json Oct 08 20:42:54.028345 ncdv-master-1 devstack@n-api.service[123987]: Accept-Encoding: gzip, deflate Oct 08 20:42:54.028345 ncdv-master-1 devstack@n-api.service[123987]: Connection: keep-alive Oct 08 20:42:54.028345 ncdv-master-1 devstack@n-api.service[123987]: Content-Length: 0 Oct 08 20:42:54.028345 ncdv-master-1 devstack@n-api.service[123987]: Host: 10.222.0.26 Oct 08 20:42:54.028345 ncdv-master-1 devstack@n-api.service[123987]: Openstack-Api-Version: compute 2.92 Oct 08 20:42:54.028345 ncdv-master-1 devstack@n-api.service[123987]: Openstack-System-Scope: None Oct 08 20:42:54.028345 ncdv-master-1 devstack@n-api.service[123987]: User-Agent: python-novaclient Oct 08 20:42:54.028345 ncdv-master-1 devstack@n-api.service[123987]: X-Auth-Token: gAAAAABjQeDNQg9qXXf3CCDAe-W5aELltIFLdaLGJt7XMwbkeePH_ZK9Ip9VE0wT_lamDPI8QuYEdoyHfJeD0wulQgedwJwKMqyWqmt9Ur8ab6zkiVKxqFIJ6tJ57-wkOuFyaQ_S9x6hAs6IAJEKt9G8RTulF9RZfgE2wF9tRpZyu6JDiApB6Ew Oct 08 20:42:54.028345 ncdv-master-1 devstack@n-api.service[123987]: X-Domain-Id: None Oct 08 20:42:54.028345 ncdv-master-1 devstack@n-api.service[123987]: X-Domain-Name: None Oct 08 20:42:54.028345 ncdv-master-1 devstack@n-api.service[123987]: X-Identity-Status: Confirmed Oct 08 20:42:54.028345 ncdv-master-1 devstack@n-api.service[123987]: X-Is-Admin-Project: True Oct 08 20:42:54.028345 ncdv-master-1 devstack@n-api.service[123987]: X-Openstack-Nova-Api-Version: 2.92 Oct 08 20:42:54.028345 ncdv-master-1 devstack@n-api.service[123987]: X-Project-Domain-Id: default Oct 08 20:42:54.028345 ncdv-master-1 devstack@n-api.service[123987]: X-Project-Domain-Name: Default Oct 08 20:42:54.028345 ncdv-master-1 devstack@n-api.service[123987]: X-Project-Id: 8cbdca763b15498ebcee722600237097 Oct 08 20:42:54.028345 ncdv-master-1 devstack@n-api.service[123987]: X-Project-Name: admin Oct 08 20:42:54.028345 ncdv-master-1 devstack@n-api.service[123987]: X-Role: reader,admin,member Oct 08 20:42:54.028345 ncdv-master-1 devstack@n-api.service[123987]: X-Roles: reader,admin,member Oct 08 20:42:54.030623 ncdv-master-1 devstack@n-api.service[123987]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8cbdca763b15498ebcee722600237097"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8cbdca763b15498ebcee722600237097"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8cbdca763b15498ebcee722600237097"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8cbdca763b15498ebcee722600237097"}]}] Oct 08 20:42:54.030623 ncdv-master-1 devstack@n-api.service[123987]: X-Tenant: admin Oct 08 20:42:54.030623 ncdv-master-1 devstack@n-api.service[123987]: X-Tenant-Id: 8cbdca763b15498ebcee722600237097 Oct 08 20:42:54.030623 ncdv-master-1 devstack@n-api.service[123987]: X-Tenant-Name: admin Oct 08 20:42:54.030623 ncdv-master-1 devstack@n-api.service[123987]: X-User: admin Oct 08 20:42:54.030623 ncdv-master-1 devstack@n-api.service[123987]: X-User-Domain-Id: default Oct 08 20:42:54.030623 ncdv-master-1 devstack@n-api.service[123987]: X-User-Domain-Name: Default Oct 08 20:42:54.030623 ncdv-master-1 devstack@n-api.service[123987]: X-User-Id: 1a6e50d0928e4f92987cd089e6138f36 Oct 08 20:42:54.030623 ncdv-master-1 devstack@n-api.service[123987]: X-User-Name: admin Oct 08 20:42:54.030623 ncdv-master-1 devstack@n-api.service[123987]: method: > Oct 08 20:42:54.030623 ncdv-master-1 devstack@n-api.service[123987]: exception: Flavor 451 could not be found. Oct 08 20:42:54.030623 ncdv-master-1 devstack@n-api.service[123987]: action_args: {'id': '451'} Oct 08 20:42:54.030623 ncdv-master-1 devstack@n-api.service[123987]: {{(pid=123987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:42:54.030623 ncdv-master-1 devstack@n-api.service[123987]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:42:54.031621 ncdv-master-1 devstack@n-api.service[123987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 08 20:42:54.031621 ncdv-master-1 devstack@n-api.service[123987]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 08 20:42:54.031621 ncdv-master-1 devstack@n-api.service[123987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 08 20:42:54.031621 ncdv-master-1 devstack@n-api.service[123987]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 08 20:42:54.031621 ncdv-master-1 devstack@n-api.service[123987]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 08 20:42:54.031621 ncdv-master-1 devstack@n-api.service[123987]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 08 20:42:54.031621 ncdv-master-1 devstack@n-api.service[123987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 08 20:42:54.031621 ncdv-master-1 devstack@n-api.service[123987]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 08 20:42:54.031621 ncdv-master-1 devstack@n-api.service[123987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 08 20:42:54.031621 ncdv-master-1 devstack@n-api.service[123987]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:42:54.031621 ncdv-master-1 devstack@n-api.service[123987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 08 20:42:54.031621 ncdv-master-1 devstack@n-api.service[123987]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 08 20:42:54.031621 ncdv-master-1 devstack@n-api.service[123987]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 08 20:42:54.031621 ncdv-master-1 devstack@n-api.service[123987]: ERROR nova.api.openstack.wsgi Oct 08 20:42:54.031621 ncdv-master-1 devstack@n-api.service[123987]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:42:54.031621 ncdv-master-1 devstack@n-api.service[123987]: ERROR nova.api.openstack.wsgi Oct 08 20:42:54.031621 ncdv-master-1 devstack@n-api.service[123987]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:42:54.031621 ncdv-master-1 devstack@n-api.service[123987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:42:54.031621 ncdv-master-1 devstack@n-api.service[123987]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:42:54.033218 ncdv-master-1 devstack@n-api.service[123987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:42:54.033218 ncdv-master-1 devstack@n-api.service[123987]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:42:54.033218 ncdv-master-1 devstack@n-api.service[123987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:42:54.033218 ncdv-master-1 devstack@n-api.service[123987]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:42:54.033218 ncdv-master-1 devstack@n-api.service[123987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 08 20:42:54.033218 ncdv-master-1 devstack@n-api.service[123987]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 08 20:42:54.033218 ncdv-master-1 devstack@n-api.service[123987]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 08 20:42:54.033218 ncdv-master-1 devstack@n-api.service[123987]: ERROR nova.api.openstack.wsgi Oct 08 20:42:54.033218 ncdv-master-1 devstack@n-api.service[123987]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:42:54.033218 ncdv-master-1 devstack@n-api.service[123987]: ERROR nova.api.openstack.wsgi Oct 08 20:42:54.033218 ncdv-master-1 devstack@n-api.service[123987]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:42:54.033218 ncdv-master-1 devstack@n-api.service[123987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:42:54.033218 ncdv-master-1 devstack@n-api.service[123987]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:42:54.033218 ncdv-master-1 devstack@n-api.service[123987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 20:42:54.033218 ncdv-master-1 devstack@n-api.service[123987]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 20:42:54.033218 ncdv-master-1 devstack@n-api.service[123987]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 08 20:42:54.033218 ncdv-master-1 devstack@n-api.service[123987]: ERROR nova.api.openstack.wsgi Oct 08 20:42:54.033218 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi [None req-c9d5031e-5412-41f7-b8e8-9b1271604b65 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=123987) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:42:54.034530 ncdv-master-1 devstack@n-api.service[123987]: INFO nova.api.openstack.requestlog [None req-c9d5031e-5412-41f7-b8e8-9b1271604b65 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.393086 Oct 08 20:42:54.034530 ncdv-master-1 devstack@n-api.service[123987]: [pid: 123987|app: 0|req: 24/49] 10.222.0.26 () {60 vars in 1193 bytes} [Sat Oct 8 20:42:53 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 394 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 08 20:42:54.039922 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi [None req-0b0d9238-ba9f-4117-a990-e86910e5987a admin admin] Calling method '>' {{(pid=123986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:42:54.054717 ncdv-master-1 devstack@n-api.service[123986]: INFO nova.api.openstack.requestlog [None req-0b0d9238-ba9f-4117-a990-e86910e5987a admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018292 Oct 08 20:42:54.055241 ncdv-master-1 devstack@n-api.service[123986]: [pid: 123986|app: 0|req: 26/50] 10.222.0.26 () {60 vars in 1210 bytes} [Sat Oct 8 20:42:54 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:42:54.064450 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi [None req-ba0b5a42-46e1-422c-b866-126243c7071d admin admin] Calling method '>' {{(pid=123987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:42:54.079648 ncdv-master-1 devstack@n-api.service[123987]: INFO nova.api.openstack.requestlog [None req-ba0b5a42-46e1-422c-b866-126243c7071d admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018678 Oct 08 20:42:54.080195 ncdv-master-1 devstack@n-api.service[123987]: [pid: 123987|app: 0|req: 25/51] 10.222.0.26 () {60 vars in 1210 bytes} [Sat Oct 8 20:42:54 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 08 20:42:54.089174 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi [None req-1f6bdfe0-8d9d-4769-8807-e90059816c92 admin admin] Calling method '>' {{(pid=123986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:42:54.094759 ncdv-master-1 devstack@n-api.service[123986]: INFO nova.api.openstack.wsgi [None req-1f6bdfe0-8d9d-4769-8807-e90059816c92 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 08 20:42:54.096256 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi [None req-1f6bdfe0-8d9d-4769-8807-e90059816c92 admin admin] Request method failure captured: Oct 08 20:42:54.096256 ncdv-master-1 devstack@n-api.service[123986]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 08 20:42:54.096256 ncdv-master-1 devstack@n-api.service[123986]: Accept: application/json Oct 08 20:42:54.096256 ncdv-master-1 devstack@n-api.service[123986]: Accept-Encoding: gzip, deflate Oct 08 20:42:54.096256 ncdv-master-1 devstack@n-api.service[123986]: Connection: keep-alive Oct 08 20:42:54.096256 ncdv-master-1 devstack@n-api.service[123986]: Content-Length: 0 Oct 08 20:42:54.096256 ncdv-master-1 devstack@n-api.service[123986]: Host: 10.222.0.26 Oct 08 20:42:54.096256 ncdv-master-1 devstack@n-api.service[123986]: Openstack-Api-Version: compute 2.92 Oct 08 20:42:54.096256 ncdv-master-1 devstack@n-api.service[123986]: Openstack-System-Scope: None Oct 08 20:42:54.096256 ncdv-master-1 devstack@n-api.service[123986]: User-Agent: python-novaclient Oct 08 20:42:54.096256 ncdv-master-1 devstack@n-api.service[123986]: X-Auth-Token: gAAAAABjQeDNQg9qXXf3CCDAe-W5aELltIFLdaLGJt7XMwbkeePH_ZK9Ip9VE0wT_lamDPI8QuYEdoyHfJeD0wulQgedwJwKMqyWqmt9Ur8ab6zkiVKxqFIJ6tJ57-wkOuFyaQ_S9x6hAs6IAJEKt9G8RTulF9RZfgE2wF9tRpZyu6JDiApB6Ew Oct 08 20:42:54.096256 ncdv-master-1 devstack@n-api.service[123986]: X-Domain-Id: None Oct 08 20:42:54.096256 ncdv-master-1 devstack@n-api.service[123986]: X-Domain-Name: None Oct 08 20:42:54.096256 ncdv-master-1 devstack@n-api.service[123986]: X-Identity-Status: Confirmed Oct 08 20:42:54.096256 ncdv-master-1 devstack@n-api.service[123986]: X-Is-Admin-Project: True Oct 08 20:42:54.096256 ncdv-master-1 devstack@n-api.service[123986]: X-Openstack-Nova-Api-Version: 2.92 Oct 08 20:42:54.096256 ncdv-master-1 devstack@n-api.service[123986]: X-Project-Domain-Id: default Oct 08 20:42:54.096256 ncdv-master-1 devstack@n-api.service[123986]: X-Project-Domain-Name: Default Oct 08 20:42:54.096256 ncdv-master-1 devstack@n-api.service[123986]: X-Project-Id: 8cbdca763b15498ebcee722600237097 Oct 08 20:42:54.096256 ncdv-master-1 devstack@n-api.service[123986]: X-Project-Name: admin Oct 08 20:42:54.096256 ncdv-master-1 devstack@n-api.service[123986]: X-Role: reader,admin,member Oct 08 20:42:54.096256 ncdv-master-1 devstack@n-api.service[123986]: X-Roles: reader,admin,member Oct 08 20:42:54.097938 ncdv-master-1 devstack@n-api.service[123986]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8cbdca763b15498ebcee722600237097"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8cbdca763b15498ebcee722600237097"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8cbdca763b15498ebcee722600237097"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8cbdca763b15498ebcee722600237097"}]}] Oct 08 20:42:54.097938 ncdv-master-1 devstack@n-api.service[123986]: X-Tenant: admin Oct 08 20:42:54.097938 ncdv-master-1 devstack@n-api.service[123986]: X-Tenant-Id: 8cbdca763b15498ebcee722600237097 Oct 08 20:42:54.097938 ncdv-master-1 devstack@n-api.service[123986]: X-Tenant-Name: admin Oct 08 20:42:54.097938 ncdv-master-1 devstack@n-api.service[123986]: X-User: admin Oct 08 20:42:54.097938 ncdv-master-1 devstack@n-api.service[123986]: X-User-Domain-Id: default Oct 08 20:42:54.097938 ncdv-master-1 devstack@n-api.service[123986]: X-User-Domain-Name: Default Oct 08 20:42:54.097938 ncdv-master-1 devstack@n-api.service[123986]: X-User-Id: 1a6e50d0928e4f92987cd089e6138f36 Oct 08 20:42:54.097938 ncdv-master-1 devstack@n-api.service[123986]: X-User-Name: admin Oct 08 20:42:54.097938 ncdv-master-1 devstack@n-api.service[123986]: method: > Oct 08 20:42:54.097938 ncdv-master-1 devstack@n-api.service[123986]: exception: Flavor 451 could not be found. Oct 08 20:42:54.097938 ncdv-master-1 devstack@n-api.service[123986]: action_args: {'id': '451'} Oct 08 20:42:54.097938 ncdv-master-1 devstack@n-api.service[123986]: {{(pid=123986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:42:54.097938 ncdv-master-1 devstack@n-api.service[123986]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:42:54.099012 ncdv-master-1 devstack@n-api.service[123986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 08 20:42:54.099012 ncdv-master-1 devstack@n-api.service[123986]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 08 20:42:54.099012 ncdv-master-1 devstack@n-api.service[123986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 08 20:42:54.099012 ncdv-master-1 devstack@n-api.service[123986]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 08 20:42:54.099012 ncdv-master-1 devstack@n-api.service[123986]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 08 20:42:54.099012 ncdv-master-1 devstack@n-api.service[123986]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 08 20:42:54.099012 ncdv-master-1 devstack@n-api.service[123986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 08 20:42:54.099012 ncdv-master-1 devstack@n-api.service[123986]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 08 20:42:54.099012 ncdv-master-1 devstack@n-api.service[123986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 08 20:42:54.099012 ncdv-master-1 devstack@n-api.service[123986]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:42:54.099012 ncdv-master-1 devstack@n-api.service[123986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 08 20:42:54.099012 ncdv-master-1 devstack@n-api.service[123986]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 08 20:42:54.099012 ncdv-master-1 devstack@n-api.service[123986]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 08 20:42:54.099012 ncdv-master-1 devstack@n-api.service[123986]: ERROR nova.api.openstack.wsgi Oct 08 20:42:54.099012 ncdv-master-1 devstack@n-api.service[123986]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:42:54.099012 ncdv-master-1 devstack@n-api.service[123986]: ERROR nova.api.openstack.wsgi Oct 08 20:42:54.099012 ncdv-master-1 devstack@n-api.service[123986]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:42:54.099012 ncdv-master-1 devstack@n-api.service[123986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:42:54.099012 ncdv-master-1 devstack@n-api.service[123986]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:42:54.100489 ncdv-master-1 devstack@n-api.service[123986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:42:54.100489 ncdv-master-1 devstack@n-api.service[123986]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:42:54.100489 ncdv-master-1 devstack@n-api.service[123986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:42:54.100489 ncdv-master-1 devstack@n-api.service[123986]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:42:54.100489 ncdv-master-1 devstack@n-api.service[123986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 08 20:42:54.100489 ncdv-master-1 devstack@n-api.service[123986]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 08 20:42:54.100489 ncdv-master-1 devstack@n-api.service[123986]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 08 20:42:54.100489 ncdv-master-1 devstack@n-api.service[123986]: ERROR nova.api.openstack.wsgi Oct 08 20:42:54.100489 ncdv-master-1 devstack@n-api.service[123986]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:42:54.100489 ncdv-master-1 devstack@n-api.service[123986]: ERROR nova.api.openstack.wsgi Oct 08 20:42:54.100489 ncdv-master-1 devstack@n-api.service[123986]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:42:54.100489 ncdv-master-1 devstack@n-api.service[123986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:42:54.100489 ncdv-master-1 devstack@n-api.service[123986]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:42:54.100489 ncdv-master-1 devstack@n-api.service[123986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 20:42:54.100489 ncdv-master-1 devstack@n-api.service[123986]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 20:42:54.100489 ncdv-master-1 devstack@n-api.service[123986]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 08 20:42:54.100489 ncdv-master-1 devstack@n-api.service[123986]: ERROR nova.api.openstack.wsgi Oct 08 20:42:54.100489 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi [None req-1f6bdfe0-8d9d-4769-8807-e90059816c92 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=123986) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:42:54.101824 ncdv-master-1 devstack@n-api.service[123986]: INFO nova.api.openstack.requestlog [None req-1f6bdfe0-8d9d-4769-8807-e90059816c92 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011832 Oct 08 20:42:54.102194 ncdv-master-1 devstack@n-api.service[123986]: [pid: 123986|app: 0|req: 27/52] 10.222.0.26 () {60 vars in 1193 bytes} [Sat Oct 8 20:42:54 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 08 20:42:55.866341 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi [None req-ba0b5a42-46e1-422c-b866-126243c7071d admin admin] Calling method '>' {{(pid=123987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:42:55.867384 ncdv-master-1 devstack@n-api.service[123987]: INFO nova.api.openstack.requestlog [None req-ba0b5a42-46e1-422c-b866-126243c7071d admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001511 Oct 08 20:42:55.867779 ncdv-master-1 devstack@n-api.service[123987]: [pid: 123987|app: 0|req: 26/53] 10.222.0.26 () {56 vars in 1074 bytes} [Sat Oct 8 20:42:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:42:56.395689 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi [None req-0e85a74a-c273-4a59-8eaf-48eb569fb7cb admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=123986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:42:56.415864 ncdv-master-1 devstack@n-api.service[123986]: INFO nova.api.openstack.requestlog [None req-0e85a74a-c273-4a59-8eaf-48eb569fb7cb admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.404068 Oct 08 20:42:56.416395 ncdv-master-1 devstack@n-api.service[123986]: [pid: 123986|app: 0|req: 28/54] 10.222.0.26 () {64 vars in 1235 bytes} [Sat Oct 8 20:42:56 2022] POST /compute/v2.1/flavors => generated 404 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 08 20:42:58.184289 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi [None req-ba0b5a42-46e1-422c-b866-126243c7071d admin admin] Calling method '>' {{(pid=123987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:42:58.185827 ncdv-master-1 devstack@n-api.service[123987]: INFO nova.api.openstack.requestlog [None req-ba0b5a42-46e1-422c-b866-126243c7071d admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001951 Oct 08 20:42:58.186219 ncdv-master-1 devstack@n-api.service[123987]: [pid: 123987|app: 0|req: 27/55] 10.222.0.26 () {56 vars in 1074 bytes} [Sat Oct 8 20:42:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:42:58.720246 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi [None req-96511673-32f0-480f-a5f3-398a7adb0ede admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=123986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:42:58.739470 ncdv-master-1 devstack@n-api.service[123986]: INFO nova.api.openstack.requestlog [None req-96511673-32f0-480f-a5f3-398a7adb0ede admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.405832 Oct 08 20:42:58.740002 ncdv-master-1 devstack@n-api.service[123986]: [pid: 123986|app: 0|req: 29/56] 10.222.0.26 () {64 vars in 1235 bytes} [Sat Oct 8 20:42:58 2022] POST /compute/v2.1/flavors => generated 405 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 08 20:43:00.502574 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi [None req-ba0b5a42-46e1-422c-b866-126243c7071d admin admin] Calling method '>' {{(pid=123987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:43:00.503582 ncdv-master-1 devstack@n-api.service[123987]: INFO nova.api.openstack.requestlog [None req-ba0b5a42-46e1-422c-b866-126243c7071d admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 Oct 08 20:43:00.503980 ncdv-master-1 devstack@n-api.service[123987]: [pid: 123987|app: 0|req: 28/57] 10.222.0.26 () {56 vars in 1074 bytes} [Sat Oct 8 20:43:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:43:01.037112 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi [None req-2977c1b5-1065-4b0e-bde8-8aa8aa08d317 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=123986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:43:01.055608 ncdv-master-1 devstack@n-api.service[123986]: INFO nova.api.openstack.requestlog [None req-2977c1b5-1065-4b0e-bde8-8aa8aa08d317 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.404022 Oct 08 20:43:01.056145 ncdv-master-1 devstack@n-api.service[123986]: [pid: 123986|app: 0|req: 30/58] 10.222.0.26 () {64 vars in 1235 bytes} [Sat Oct 8 20:43:00 2022] POST /compute/v2.1/flavors => generated 407 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 08 20:43:02.823185 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi [None req-ba0b5a42-46e1-422c-b866-126243c7071d admin admin] Calling method '>' {{(pid=123987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:43:02.824189 ncdv-master-1 devstack@n-api.service[123987]: INFO nova.api.openstack.requestlog [None req-ba0b5a42-46e1-422c-b866-126243c7071d admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Oct 08 20:43:02.824581 ncdv-master-1 devstack@n-api.service[123987]: [pid: 123987|app: 0|req: 29/59] 10.222.0.26 () {56 vars in 1074 bytes} [Sat Oct 8 20:43:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:43:03.354846 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi [None req-12704a24-2a87-494d-89d0-7b7d4f5bf995 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=123986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:43:03.374684 ncdv-master-1 devstack@n-api.service[123986]: INFO nova.api.openstack.requestlog [None req-12704a24-2a87-494d-89d0-7b7d4f5bf995 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.403102 Oct 08 20:43:03.375150 ncdv-master-1 devstack@n-api.service[123986]: [pid: 123986|app: 0|req: 31/60] 10.222.0.26 () {64 vars in 1235 bytes} [Sat Oct 8 20:43:02 2022] POST /compute/v2.1/flavors => generated 409 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 08 20:43:05.146744 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi [None req-ba0b5a42-46e1-422c-b866-126243c7071d admin admin] Calling method '>' {{(pid=123987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:43:05.147748 ncdv-master-1 devstack@n-api.service[123987]: INFO nova.api.openstack.requestlog [None req-ba0b5a42-46e1-422c-b866-126243c7071d admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Oct 08 20:43:05.148150 ncdv-master-1 devstack@n-api.service[123987]: [pid: 123987|app: 0|req: 30/61] 10.222.0.26 () {56 vars in 1074 bytes} [Sat Oct 8 20:43:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:43:05.673962 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi [None req-5eaf0737-b643-4650-a9b7-6858ecb33810 admin admin] Calling method '>' {{(pid=123986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:43:05.693677 ncdv-master-1 devstack@n-api.service[123986]: INFO nova.api.openstack.requestlog [None req-5eaf0737-b643-4650-a9b7-6858ecb33810 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.400303 Oct 08 20:43:05.694207 ncdv-master-1 devstack@n-api.service[123986]: [pid: 123986|app: 0|req: 32/62] 10.222.0.26 () {60 vars in 1202 bytes} [Sat Oct 8 20:43:05 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:44:10.566402 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi [None req-ba0b5a42-46e1-422c-b866-126243c7071d admin admin] Calling method '>' {{(pid=123987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:44:10.567411 ncdv-master-1 devstack@n-api.service[123987]: INFO nova.api.openstack.requestlog [None req-ba0b5a42-46e1-422c-b866-126243c7071d admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Oct 08 20:44:10.567813 ncdv-master-1 devstack@n-api.service[123987]: [pid: 123987|app: 0|req: 31/63] 10.222.0.26 () {54 vars in 931 bytes} [Sat Oct 8 20:44:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:44:10.575099 ncdv-master-1 devstack@n-api.service[123986]: DEBUG dbcounter [-] [123986] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=123986) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:44:10.954951 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi [None req-a0a96bf6-b129-4b13-a00a-1bb2a80c48a3 admin admin] Calling method '>' {{(pid=123986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:44:10.976931 ncdv-master-1 devstack@n-api.service[123986]: INFO nova.api.openstack.requestlog [None req-a0a96bf6-b129-4b13-a00a-1bb2a80c48a3 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.403145 Oct 08 20:44:10.977507 ncdv-master-1 devstack@n-api.service[123986]: [pid: 123986|app: 0|req: 33/64] 10.222.0.26 () {60 vars in 1292 bytes} [Sat Oct 8 20:44:10 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 08 20:44:10.999177 ncdv-master-1 devstack@n-api.service[123987]: DEBUG dbcounter [-] [123987] Writing DB stats nova_api:SELECT=14 {{(pid=123987) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:44:11.003071 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi [None req-09cf203d-edfd-45a9-a7fc-4e1098767550 admin admin] Calling method '>' {{(pid=123987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:44:11.010447 ncdv-master-1 devstack@n-api.service[123987]: INFO nova.api.openstack.requestlog [None req-09cf203d-edfd-45a9-a7fc-4e1098767550 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012726 Oct 08 20:44:11.010957 ncdv-master-1 devstack@n-api.service[123987]: [pid: 123987|app: 0|req: 32/65] 10.222.0.26 () {60 vars in 1283 bytes} [Sat Oct 8 20:44:10 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 20:44:11.027322 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi [None req-779d822a-0723-4fdf-bc1a-1a997c16fae3 admin admin] Calling method '>' {{(pid=123986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:44:11.034834 ncdv-master-1 devstack@n-api.service[123986]: INFO nova.api.openstack.requestlog [None req-779d822a-0723-4fdf-bc1a-1a997c16fae3 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011170 Oct 08 20:44:11.035343 ncdv-master-1 devstack@n-api.service[123986]: [pid: 123986|app: 0|req: 34/66] 10.222.0.26 () {60 vars in 1286 bytes} [Sat Oct 8 20:44:11 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:44:11.046897 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi [None req-38d38362-37e1-43cf-870b-3eb01fbc1d49 admin admin] Calling method '>' {{(pid=123987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:44:11.053988 ncdv-master-1 devstack@n-api.service[123987]: INFO nova.api.openstack.requestlog [None req-38d38362-37e1-43cf-870b-3eb01fbc1d49 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010606 Oct 08 20:44:11.054485 ncdv-master-1 devstack@n-api.service[123987]: [pid: 123987|app: 0|req: 33/67] 10.222.0.26 () {60 vars in 1286 bytes} [Sat Oct 8 20:44:11 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 20:44:11.066076 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi [None req-16394559-5f74-47b6-9bef-742c943b974d admin admin] Calling method '>' {{(pid=123986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:44:11.072911 ncdv-master-1 devstack@n-api.service[123986]: INFO nova.api.openstack.requestlog [None req-16394559-5f74-47b6-9bef-742c943b974d admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010334 Oct 08 20:44:11.073469 ncdv-master-1 devstack@n-api.service[123986]: [pid: 123986|app: 0|req: 35/68] 10.222.0.26 () {60 vars in 1283 bytes} [Sat Oct 8 20:44:11 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 11 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:49:53.820579 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi [None req-38d38362-37e1-43cf-870b-3eb01fbc1d49 admin admin] Calling method '>' {{(pid=123987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:49:53.821636 ncdv-master-1 devstack@n-api.service[123987]: INFO nova.api.openstack.requestlog [None req-38d38362-37e1-43cf-870b-3eb01fbc1d49 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Oct 08 20:49:53.822027 ncdv-master-1 devstack@n-api.service[123987]: [pid: 123987|app: 0|req: 34/69] 10.222.0.26 () {56 vars in 1074 bytes} [Sat Oct 8 20:49:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:49:53.969521 ncdv-master-1 devstack@n-api.service[123986]: DEBUG dbcounter [-] [123986] Writing DB stats nova_api:SELECT=6 {{(pid=123986) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:49:54.109764 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi [None req-bd77188e-a9d0-4184-9ffe-f9185e98237b admin admin] Calling method '>' {{(pid=123986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:49:54.114380 ncdv-master-1 devstack@n-api.service[123986]: DEBUG oslo_concurrency.lockutils [None req-bd77188e-a9d0-4184-9ffe-f9185e98237b admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:49:54.114855 ncdv-master-1 devstack@n-api.service[123986]: DEBUG oslo_concurrency.lockutils [None req-bd77188e-a9d0-4184-9ffe-f9185e98237b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:49:54.115276 ncdv-master-1 devstack@n-api.service[123986]: DEBUG oslo_concurrency.lockutils [None req-bd77188e-a9d0-4184-9ffe-f9185e98237b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:49:54.115984 ncdv-master-1 devstack@n-api.service[123986]: DEBUG oslo_concurrency.lockutils [None req-bd77188e-a9d0-4184-9ffe-f9185e98237b admin admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:49:54.116424 ncdv-master-1 devstack@n-api.service[123986]: DEBUG oslo_concurrency.lockutils [None req-bd77188e-a9d0-4184-9ffe-f9185e98237b admin admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:49:54.116837 ncdv-master-1 devstack@n-api.service[123986]: DEBUG oslo_concurrency.lockutils [None req-bd77188e-a9d0-4184-9ffe-f9185e98237b admin admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:49:54.154434 ncdv-master-1 devstack@n-api.service[123986]: INFO nova.api.openstack.requestlog [None req-bd77188e-a9d0-4184-9ffe-f9185e98237b admin admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.92 time: 0.186679 Oct 08 20:49:54.154980 ncdv-master-1 devstack@n-api.service[123986]: [pid: 123986|app: 0|req: 36/70] 10.222.0.26 () {60 vars in 1193 bytes} [Sat Oct 8 20:49:53 2022] GET /compute/v2.1/os-services => generated 1242 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:49:55.781715 ncdv-master-1 devstack@n-api.service[123987]: DEBUG nova.api.openstack.wsgi [None req-38d38362-37e1-43cf-870b-3eb01fbc1d49 admin admin] Calling method '>' {{(pid=123987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:49:55.782730 ncdv-master-1 devstack@n-api.service[123987]: INFO nova.api.openstack.requestlog [None req-38d38362-37e1-43cf-870b-3eb01fbc1d49 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001524 Oct 08 20:49:55.783119 ncdv-master-1 devstack@n-api.service[123987]: [pid: 123987|app: 0|req: 35/71] 10.222.0.26 () {56 vars in 1074 bytes} [Sat Oct 8 20:49:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:49:55.982755 ncdv-master-1 devstack@n-api.service[123986]: DEBUG nova.api.openstack.wsgi [None req-8c5272d5-330b-4d10-8564-aed1d5af245d admin admin] Calling method '>' {{(pid=123986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:49:55.986968 ncdv-master-1 devstack@n-api.service[123986]: DEBUG oslo_concurrency.lockutils [None req-8c5272d5-330b-4d10-8564-aed1d5af245d admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:49:55.987442 ncdv-master-1 devstack@n-api.service[123986]: DEBUG oslo_concurrency.lockutils [None req-8c5272d5-330b-4d10-8564-aed1d5af245d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:49:55.987871 ncdv-master-1 devstack@n-api.service[123986]: DEBUG oslo_concurrency.lockutils [None req-8c5272d5-330b-4d10-8564-aed1d5af245d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:49:55.988569 ncdv-master-1 devstack@n-api.service[123986]: DEBUG oslo_concurrency.lockutils [None req-8c5272d5-330b-4d10-8564-aed1d5af245d admin admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:49:55.989007 ncdv-master-1 devstack@n-api.service[123986]: DEBUG oslo_concurrency.lockutils [None req-8c5272d5-330b-4d10-8564-aed1d5af245d admin admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:49:55.989443 ncdv-master-1 devstack@n-api.service[123986]: DEBUG oslo_concurrency.lockutils [None req-8c5272d5-330b-4d10-8564-aed1d5af245d admin admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:49:56.012005 ncdv-master-1 devstack@n-api.service[123986]: INFO nova.api.openstack.requestlog [None req-8c5272d5-330b-4d10-8564-aed1d5af245d admin admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.92 time: 0.079403 Oct 08 20:49:56.012484 ncdv-master-1 devstack@n-api.service[123986]: [pid: 123986|app: 0|req: 37/72] 10.222.0.26 () {60 vars in 1193 bytes} [Sat Oct 8 20:49:55 2022] GET /compute/v2.1/os-services => generated 1242 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:50:46.441001 ncdv-master-1 devstack@n-api.service[123985]: Sat Oct 8 20:50:46 2022 - graceful shutdown triggered... Oct 08 20:50:46.441571 ncdv-master-1 devstack@n-api.service[123986]: Gracefully killing worker 1 (pid: 123986)... Oct 08 20:50:46.441132 ncdv-master-1 systemd[1]: Stopping Devstack devstack@n-api.service... Oct 08 20:50:46.442417 ncdv-master-1 devstack@n-api.service[123987]: Gracefully killing worker 2 (pid: 123987)... Oct 08 20:50:46.574297 ncdv-master-1 devstack@n-api.service[123987]: DEBUG dbcounter [-] [123987] Writing DB stats nova_api:SELECT=4 {{(pid=123987) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:50:47.442132 ncdv-master-1 devstack@n-api.service[123985]: worker 1 buried after 1 seconds Oct 08 20:50:47.442132 ncdv-master-1 devstack@n-api.service[123985]: worker 2 buried after 1 seconds Oct 08 20:50:47.442132 ncdv-master-1 devstack@n-api.service[123985]: goodbye to uWSGI. Oct 08 20:50:47.443846 ncdv-master-1 systemd[1]: devstack@n-api.service: Succeeded. Oct 08 20:50:47.444434 ncdv-master-1 systemd[1]: Stopped Devstack devstack@n-api.service. Oct 08 20:50:47.447226 ncdv-master-1 systemd[1]: Starting Devstack devstack@n-api.service... Oct 08 20:50:47.500808 ncdv-master-1 devstack@n-api.service[140482]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 08 20:50:47.503668 ncdv-master-1 devstack@n-api.service[140482]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Oct 8 20:50:47 2022] *** Oct 08 20:50:47.503843 ncdv-master-1 devstack@n-api.service[140482]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 08 20:50:47.503975 ncdv-master-1 devstack@n-api.service[140482]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 08 20:50:47.504099 ncdv-master-1 devstack@n-api.service[140482]: nodename: ncdv-master-1 Oct 08 20:50:47.504210 ncdv-master-1 devstack@n-api.service[140482]: machine: x86_64 Oct 08 20:50:47.504318 ncdv-master-1 devstack@n-api.service[140482]: clock source: unix Oct 08 20:50:47.504463 ncdv-master-1 devstack@n-api.service[140482]: pcre jit disabled Oct 08 20:50:47.504624 ncdv-master-1 devstack@n-api.service[140482]: detected number of CPU cores: 4 Oct 08 20:50:47.504767 ncdv-master-1 devstack@n-api.service[140482]: current working directory: / Oct 08 20:50:47.504917 ncdv-master-1 devstack@n-api.service[140482]: detected binary path: /usr/bin/uwsgi-core Oct 08 20:50:47.505073 ncdv-master-1 devstack@n-api.service[140482]: your processes number limit is 47680 Oct 08 20:50:47.505271 ncdv-master-1 devstack@n-api.service[140482]: your memory page size is 4096 bytes Oct 08 20:50:47.505438 ncdv-master-1 devstack@n-api.service[140482]: detected max file descriptor number: 2048 Oct 08 20:50:47.505602 ncdv-master-1 devstack@n-api.service[140482]: lock engine: pthread robust mutexes Oct 08 20:50:47.505953 ncdv-master-1 devstack@n-api.service[140482]: thunder lock: enabled Oct 08 20:50:47.506349 ncdv-master-1 devstack@n-api.service[140482]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 08 20:50:47.506611 ncdv-master-1 devstack@n-api.service[140482]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 08 20:50:47.551812 ncdv-master-1 devstack@n-api.service[140482]: Python main interpreter initialized at 0x556c265009c0 Oct 08 20:50:47.551812 ncdv-master-1 devstack@n-api.service[140482]: python threads support enabled Oct 08 20:50:47.551812 ncdv-master-1 devstack@n-api.service[140482]: your server socket listen backlog is limited to 100 connections Oct 08 20:50:47.551812 ncdv-master-1 devstack@n-api.service[140482]: your mercy for graceful operations on workers is 90 seconds Oct 08 20:50:47.552236 ncdv-master-1 devstack@n-api.service[140482]: mapped 403077 bytes (393 KB) for 2 cores Oct 08 20:50:47.552236 ncdv-master-1 devstack@n-api.service[140482]: *** Operational MODE: preforking *** Oct 08 20:50:47.552473 ncdv-master-1 devstack@n-api.service[140482]: *** uWSGI is running in multiple interpreter mode *** Oct 08 20:50:47.552473 ncdv-master-1 devstack@n-api.service[140482]: spawned uWSGI master process (pid: 140482) Oct 08 20:50:47.552693 ncdv-master-1 systemd[1]: Started Devstack devstack@n-api.service. Oct 08 20:50:47.553763 ncdv-master-1 devstack@n-api.service[140482]: spawned uWSGI worker 1 (pid: 140491, cores: 1) Oct 08 20:50:47.554455 ncdv-master-1 devstack@n-api.service[140482]: spawned uWSGI worker 2 (pid: 140492, cores: 1) Oct 08 20:50:47.554713 ncdv-master-1 devstack@n-api.service[140482]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 08 20:50:48.885344 ncdv-master-1 devstack@n-api.service[140492]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 08 20:50:48.885969 ncdv-master-1 devstack@n-api.service[140491]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 08 20:50:49.644396 ncdv-master-1 devstack@n-api.service[140491]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 08 20:50:49.644396 ncdv-master-1 devstack@n-api.service[140491]: from cryptography.utils import int_from_bytes Oct 08 20:50:49.644676 ncdv-master-1 devstack@n-api.service[140491]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 08 20:50:49.644676 ncdv-master-1 devstack@n-api.service[140491]: from cryptography.utils import int_from_bytes Oct 08 20:50:49.644881 ncdv-master-1 devstack@n-api.service[140492]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 08 20:50:49.644881 ncdv-master-1 devstack@n-api.service[140492]: from cryptography.utils import int_from_bytes Oct 08 20:50:49.645250 ncdv-master-1 devstack@n-api.service[140492]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 08 20:50:49.645250 ncdv-master-1 devstack@n-api.service[140492]: from cryptography.utils import int_from_bytes Oct 08 20:50:52.118616 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 08 20:50:52.119221 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 08 20:50:52.119311 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 08 20:50:52.119311 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 08 20:50:52.119745 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 08 20:50:52.119820 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 08 20:50:52.119901 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 08 20:50:52.120261 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 08 20:50:52.120384 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 08 20:50:52.120508 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 08 20:50:52.120587 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.120789 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.120894 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.121101 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.121425 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.121528 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.121602 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.121791 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.121961 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.122143 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.122301 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.122402 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.122575 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.122764 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.122942 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.123114 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.123215 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.123378 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.123533 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.123690 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.123814 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.123999 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] console_host = ncdv-master-1 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.124109 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.124328 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.124514 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] console_host = ncdv-master-1 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.124668 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.124870 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.125023 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.125178 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.125906 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.126013 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.126096 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.126184 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.126263 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.126339 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.126409 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.126482 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.126610 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.126710 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.127132 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.127450 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.127767 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.128085 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.128233 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.128434 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.128556 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.128748 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.128855 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.129058 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.129690 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.129833 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.130049 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.130275 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.130459 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.130617 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.130846 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] host = ncdv-master-1 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.131175 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.131297 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.131497 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.131618 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.131818 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.131940 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.132246 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.132366 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.132560 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.132686 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.132886 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.132997 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] host = ncdv-master-1 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.133221 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.133353 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.133553 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.133672 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.133865 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.133983 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.134198 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.134392 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.134517 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.134716 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.134928 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.135166 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.135380 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.135594 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.135726 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.135954 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.136129 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.136281 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.136456 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.136620 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.136764 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.136913 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.137068 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.137266 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.137426 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.137426 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.137724 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.137874 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.138147 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.138376 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.138588 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.138757 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.138908 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.139058 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.139212 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.139360 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.139513 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.139657 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.139812 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.139974 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.140121 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.140274 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.140425 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.140575 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.140717 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.140911 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.141123 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.141123 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.141476 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.141629 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.141784 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.141933 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.142076 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.142076 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.142365 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.142515 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.142849 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.143012 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.143181 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.143335 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.143487 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.143640 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.143792 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.143936 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.144092 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.144242 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.144385 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.144527 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.144670 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.144819 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.144982 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.145135 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.145341 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.145487 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.145637 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.145787 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.145943 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.146086 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.146229 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.146379 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.146539 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.146696 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.146839 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.147009 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.147153 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.147294 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.147444 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.147444 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.147730 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.147878 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.148030 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.148179 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.148329 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.148488 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.148641 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.148801 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.148954 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.149099 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.149272 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.149433 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.149576 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.149719 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.149861 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.150013 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.150195 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.150359 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.150512 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.150656 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.150817 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.150967 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.151119 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.151313 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.151471 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.151615 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.151786 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.151932 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.152156 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.152303 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.152454 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.152616 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.153002 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.153164 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.153367 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.153514 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.153656 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.153798 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.153948 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.154101 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.154259 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.154404 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.154545 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.154687 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.154846 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.155007 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.155173 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.155324 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.155476 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.155626 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.155768 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.155923 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.156076 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.156225 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.156380 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.157058 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.157240 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.157415 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.157561 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.157844 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.158011 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.158185 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.158347 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.158493 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.158634 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.158783 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.158934 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.159117 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.159268 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.159411 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.159563 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.159732 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.159877 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.160048 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.160208 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.160366 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.160529 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.160684 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.160835 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.160977 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.161133 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.161328 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.161473 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.161615 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.161776 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.161920 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.162071 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.162220 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.162363 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.162517 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.162668 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.162821 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.163192 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.163353 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.163506 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.163656 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.163800 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.163953 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.164105 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.164256 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.164398 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.164540 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.164683 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.164835 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.164987 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.165130 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.165306 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.165451 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.165605 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.165762 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.165917 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.166061 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.166202 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.166353 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.166495 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.166647 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.166798 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.166942 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.167093 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.167236 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.167385 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.167543 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.167697 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.167840 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.168138 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.168294 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.168446 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.168648 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.168806 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.168958 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.169102 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.169808 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.169997 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.170145 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.170302 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.170459 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:50:52.170610 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.170764 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.170921 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.171066 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.171208 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.171208 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.171497 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.171648 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.171804 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.171954 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.172127 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.172898 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.173339 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.173508 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.173654 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.173814 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.173958 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.173958 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.174229 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.174229 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.174513 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.174663 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.174816 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.174816 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.175109 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.175254 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.175410 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.175562 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.175711 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.175711 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.175991 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.175991 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.176835 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.176994 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.177145 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.177331 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.177490 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.177634 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.177778 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.177920 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.178071 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.178228 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.178381 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.178533 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.178689 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.178689 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.178689 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.179119 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.179271 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.179271 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.179554 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.179697 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.179846 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.180075 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.180221 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.180365 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.180508 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.180650 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.180818 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.180965 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.181108 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.181986 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.182170 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.182327 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.182481 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.182627 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.182627 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.182919 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.183062 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.183062 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.183062 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.183062 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.183062 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.184100 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.184251 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.184415 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.184572 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.184717 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.184860 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.185002 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.185143 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.185326 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.185486 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.185630 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.185773 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.185922 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.186066 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.186227 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.186379 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.186522 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.186664 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.186814 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.186964 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.187120 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.187273 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.187273 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.187551 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.187551 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.187882 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.187882 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.188189 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.188325 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.188472 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.188624 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.188624 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.188917 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.189068 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.189264 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.189401 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.189541 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.189648 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.189742 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.189909 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.190124 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.190253 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.190431 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.190538 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.190831 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.190937 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.191146 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.191245 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.191466 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.191565 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.191778 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.191868 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.192108 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.192199 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.192427 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.192532 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.192746 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.192837 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.193078 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.193169 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.193418 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.193549 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.193735 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.193850 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.194047 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.194149 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.194359 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.194459 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.194670 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.194763 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.194977 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.195069 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.195293 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.195387 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.195600 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.195691 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.195909 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.196010 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.196219 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.196314 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.196530 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.196629 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.196839 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.196946 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.197155 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.197279 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.197491 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.197592 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.197801 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.197898 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.198114 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.198395 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.198486 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.198746 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.198849 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.199063 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.199171 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.199399 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.199573 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.199730 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.199832 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.200048 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.200148 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.200368 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.200461 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.200688 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.200791 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.201012 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.201103 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.201355 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.201459 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.201676 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.201780 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.201996 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.202087 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.202315 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.202414 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.202622 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.202721 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.202937 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.203027 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.203250 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.203340 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.203595 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.203717 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.203897 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.204008 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.204208 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.204308 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.204517 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.204609 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.204827 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.204918 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.205132 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.205263 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.205511 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.205613 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.205776 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.205913 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.206105 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.206242 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.206418 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.206576 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.206727 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.206897 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.207036 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.207218 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.207345 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.207535 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.207698 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.207855 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.208013 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.208201 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.208478 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.208618 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.208807 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.208958 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.209126 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.209289 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.209479 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.209574 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.209798 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.209906 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.210136 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.210301 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.210453 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.210546 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.210780 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.210871 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.211088 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.211189 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.211407 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.211508 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.211730 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.211829 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.212049 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.212156 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.212376 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.212476 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.212696 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.212789 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.213027 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.213122 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.213372 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.213704 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.214013 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.214147 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.214394 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.214535 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.214641 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.214853 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.214942 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.215178 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.215290 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.215542 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.215647 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.215871 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.215960 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.216182 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.216274 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.216504 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.216586 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.216817 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.216908 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.217128 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.217264 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.217465 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.217548 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.217784 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.217866 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.218161 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.218257 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.218456 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.218603 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.218753 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.218933 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.219606 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.219801 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.219899 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.220150 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.220254 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.220464 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.220571 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.220825 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.220907 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.221512 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.221635 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.221722 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.221869 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.221973 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.222055 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.222125 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.222398 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.222558 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.222734 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.222832 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.223072 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.223182 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.223400 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.223504 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.223723 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.223904 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.224157 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.224275 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.224366 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.224498 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.224662 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.224816 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.224991 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.225268 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.225385 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.225642 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.225742 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.225965 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.226145 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.226303 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.226458 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.226610 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.226759 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.226907 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.227054 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.227192 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.227374 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.227513 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.227684 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.227824 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.228002 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.228147 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.228381 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.228551 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.228711 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.228866 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.229014 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.229164 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.229307 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.229594 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.229685 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.229911 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.230002 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.230301 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.230413 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.230569 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.230661 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.230880 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.230968 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.231189 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.231290 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.231519 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.231611 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.231864 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.231962 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.232178 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.232275 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.232487 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.232584 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.232798 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.232888 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.233113 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.233239 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.233454 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.233564 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.233767 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.233874 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.234366 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.234483 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.234660 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.235373 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.235499 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.235600 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.235820 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.235912 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.236131 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.236280 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.236441 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.236534 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.236749 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.236844 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.237059 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.237161 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.237402 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.237496 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.237710 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.237810 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.238023 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.238116 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.238332 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.238438 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.238646 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.238748 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.238966 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.239065 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.239276 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.239368 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.239584 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.239684 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.239896 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.239989 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.240221 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.240320 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.240540 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.240657 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.240860 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.240960 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.241234 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.241462 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.241590 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.241806 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.241915 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.242127 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.242219 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.242450 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.242551 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.242803 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.242888 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.243117 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.243209 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.243426 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.243528 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.243743 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.243837 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.244057 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.244168 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.244366 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.244470 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.244679 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.244783 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.244987 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.245095 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.245320 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.245416 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.245634 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.245730 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.245945 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.246118 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.246260 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.246569 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.246892 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.247132 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.247231 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.247504 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.247702 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.247811 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.248031 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.248112 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.248372 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.248468 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.248687 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.248777 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.249001 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.249084 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.249347 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.249481 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.249678 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.249988 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.250136 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.250491 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.250698 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.250833 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.250995 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.251115 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.251233 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.251367 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.251481 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.251673 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.251783 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.251987 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.252081 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.252297 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.252390 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.252608 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.252708 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.252920 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.253011 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.253282 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.253401 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.253636 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.253740 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.253973 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.254103 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.254623 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.254743 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.254827 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.254900 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.254969 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.255047 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.255247 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.255382 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.255540 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.255640 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.255852 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.255955 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.256166 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.256257 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.256477 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.256569 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.256793 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.256902 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.257103 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.257218 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.257439 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.257545 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.257749 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.257843 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.258061 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.258160 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.258369 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.258466 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.258677 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.258769 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.258989 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.259079 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.259297 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.259394 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.259632 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.259741 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.259917 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.260016 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.260220 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.260311 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.260527 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.260616 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.260841 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.260932 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.261152 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.261329 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.261484 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.261584 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.261805 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.261911 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.262115 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.262298 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.262448 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.262604 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.262749 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.262903 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.263047 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.263209 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.263353 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.263495 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.263645 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.263793 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.263941 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.264090 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.264243 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.264392 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.264535 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.264682 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.264918 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.265071 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.265249 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.265341 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.265427 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.265544 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.265719 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.266384 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.266537 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.266728 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.266829 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.267064 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.267171 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.267378 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.267470 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.267695 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.267787 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.268012 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.268119 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.268330 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.268431 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.268645 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.268746 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.268957 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.269051 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.269292 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.269392 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.269669 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.269788 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.269912 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.270014 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.270218 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.270319 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.270541 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.270657 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.270879 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.270985 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.271139 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.271272 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.271454 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.271550 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.271764 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.271882 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.272074 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.272180 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.272389 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.272562 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.272718 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.272863 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.273006 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.273154 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.273327 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.273441 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.273651 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.273746 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.273964 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.274058 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.274302 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.274403 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.274624 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.274724 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.275013 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.275122 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.275258 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.275360 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.275574 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.275675 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.275881 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.275975 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.276198 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.276303 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.276514 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.276615 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.276829 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.276921 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.277136 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.277308 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.277467 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.277636 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.277840 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.277940 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.278174 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.278275 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.278568 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.278882 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.279149 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.279232 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.279529 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.279646 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.279875 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.279967 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.280141 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.280225 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.280453 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.280545 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.280791 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.280891 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.281108 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.281236 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.281436 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.281586 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.282296 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.282496 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.282612 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.282801 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.282898 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.283117 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.283200 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.283522 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.283604 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.283840 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.283930 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.284157 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.284240 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.284470 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.284551 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.284785 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.284999 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.285113 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.285367 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.285454 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.285541 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.285976 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.286089 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.286170 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.286298 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.286398 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.286612 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.286715 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.287036 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.287140 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.287359 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.287452 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.287673 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.287777 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.288005 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.288095 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.288337 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.288476 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.288661 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.288795 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.288993 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.289117 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.289448 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.289561 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.289767 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.289891 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.290088 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.290194 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.290413 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.290636 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.290772 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.290979 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.291231 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.291341 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.291437 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.291675 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.291990 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.292263 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.292374 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.292626 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.292732 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.292937 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.293038 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.293281 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.293392 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.293599 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.293692 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.293916 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.294017 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.294226 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.294369 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.294540 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.294875 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.295188 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.295280 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.295527 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.295846 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.296180 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.296287 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.296511 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.296626 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.296825 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.296969 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.297194 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.297380 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.297518 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.297730 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.297822 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.298077 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.298194 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.298423 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.298625 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.298777 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.298959 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.299091 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.299272 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.299418 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.299703 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.299807 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.300021 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.300132 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.300342 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.300447 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.300730 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.300823 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.301068 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.301213 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.301426 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.301540 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.301743 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.301844 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.302072 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.302173 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.324705 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.324985 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.325159 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.325399 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.325707 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.326034 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.326210 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.326354 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.326615 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.326762 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.326932 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.327089 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.327211 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.327348 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.327471 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.327625 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.327775 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.327875 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.327947 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.328024 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.328098 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.328098 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.328239 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.328306 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.328914 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.329206 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.329478 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.329629 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.329781 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.329928 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.330068 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.330212 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.330338 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.330437 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.330688 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.330827 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.330982 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.331152 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.331288 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.331542 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.331699 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.331836 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.331933 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.332135 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.332293 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.332442 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.332590 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.332736 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.332895 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.333030 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.333169 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.333328 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.333528 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.333826 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.334092 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.334320 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.334472 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.334735 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.334874 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.335017 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.335017 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.335450 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.335591 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.335822 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.336175 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.336457 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.336839 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.336983 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.337148 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.337272 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.337331 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.337331 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.337458 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.337527 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.337594 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.337660 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.337660 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.337791 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.337858 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.337925 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.337991 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.338065 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.338135 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.338203 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.338318 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.338422 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.338496 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.338569 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.338636 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.338636 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.338758 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.338843 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.338929 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.338929 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.339058 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.339058 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.339186 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.339255 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.339323 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.339389 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.339445 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.339445 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.339571 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.339643 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.339700 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.339700 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.339819 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.339819 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.339949 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.340016 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.340084 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.340150 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.340215 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.340294 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.340363 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.340426 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.340496 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.340625 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.340698 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.340755 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.340830 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.340900 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.340957 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.341024 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.341024 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.341024 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.341024 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.341024 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.341024 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.341024 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.341024 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.341630 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.341708 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.341780 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.341780 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.341905 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.341974 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.342051 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.342122 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.342122 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.342244 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.342311 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.342378 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.342454 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.342454 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.342578 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.342645 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.342711 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.342777 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.342777 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.342777 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.342777 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.343011 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.343079 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.343079 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.343079 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.343079 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.343079 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.343079 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.343417 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.343492 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.343492 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.343615 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.343683 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.343750 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.343816 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.343890 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.343960 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.344090 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.344640 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.344640 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.344934 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.345025 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.345097 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.345164 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.345249 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.345249 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.345396 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.345557 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.345664 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.345925 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.346311 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.346376 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.346443 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.346574 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.346681 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.347112 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.347304 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.347646 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.348023 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.348350 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.348670 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.348996 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.349347 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.349576 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.349700 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.349986 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.350108 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.350321 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.350584 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.350713 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.350935 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.351256 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.351576 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.351790 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.351908 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.352209 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.352327 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.352546 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.352889 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.353007 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.353237 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.353538 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.353664 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.353867 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.354059 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.354176 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.354557 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.354723 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.355043 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.355242 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.355382 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.355721 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.355847 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.356056 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.356217 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.356421 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.356678 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.356797 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.357010 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.357344 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.357466 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.357679 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.357854 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.357973 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.358263 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.358387 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.358563 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.358784 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.358902 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.359448 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.359568 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.359789 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.359981 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.360099 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.361273 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.361429 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.361429 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.361743 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.361859 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.361973 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.362086 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.362210 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.362210 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.362422 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.362535 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.362647 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.362758 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.362879 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.363116 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.363234 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.363503 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.363619 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.363814 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.364006 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.364125 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.364439 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.364555 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.364861 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.365016 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.365308 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.365428 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.365618 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.365743 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.365999 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.366144 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.366335 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.366552 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.366672 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.366937 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.367052 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.367313 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.367544 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.367662 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.367876 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.368033 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.368152 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.368458 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.368575 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.368819 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.369881 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.370007 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.370137 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.370253 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.370368 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.370481 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.370593 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.370706 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.370706 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.370928 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.371041 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.371041 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.371251 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.371365 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.371549 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.371748 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.371867 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.372105 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.372224 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.372471 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.372597 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.372779 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.373029 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.373174 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.373432 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.373568 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.373747 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.373897 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.374066 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.374203 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.374383 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.374529 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.374736 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.375057 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.375209 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.375625 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.375806 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.375970 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.376108 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.376298 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.376550 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.376756 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.376893 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.377033 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.377163 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.377432 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.377578 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.377719 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.377896 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.378032 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.378161 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.378289 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.378456 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.378694 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.378838 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.378969 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.379180 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.379484 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.379620 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.379795 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.379939 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.380140 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.380281 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.380412 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.380541 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.380691 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.380823 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.381007 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.381145 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.381336 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.381480 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.381647 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.381870 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.382009 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.382140 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.382270 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.382408 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.382568 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.382782 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.382921 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.383052 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.383182 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.383320 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.383511 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.383649 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.383836 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.383982 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.384157 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.384294 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.384480 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.384628 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.384796 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.384932 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.385117 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.385300 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.385647 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.385905 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.386044 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.386175 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.386313 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.386446 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.386665 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.386896 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.387037 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.387225 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.387360 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.387510 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.387712 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.387849 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.388052 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.388203 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.388380 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.388518 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.388772 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.394054 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.395225 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.395364 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.395502 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.395724 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.395924 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.396173 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.396313 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.396446 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.396580 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.396804 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.396804 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.397165 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.397338 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.397470 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.397602 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.397749 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.397967 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.398105 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.398250 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.398382 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.398513 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.398645 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.398793 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.399027 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.399164 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.399295 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.399426 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.399557 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.399763 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.399934 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.400111 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.400246 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.400376 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.400515 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.400647 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.400779 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.400909 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.401039 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.401177 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.401177 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.401464 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.401595 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.401734 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.401878 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.402010 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.402148 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.402280 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.402411 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.402542 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.402672 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.402804 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.402943 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.403075 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.403205 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.403335 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.403465 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.403614 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.403746 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.403878 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.404008 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.404231 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.404368 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.404507 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.404639 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.404770 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.404901 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.404901 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.405147 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.405312 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.405457 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.405588 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.405737 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.405979 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.406119 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.406428 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.406428 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.407381 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.407515 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.407515 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.407769 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.407901 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.408133 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.408272 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.408479 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.408611 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.408760 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.408893 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.409042 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.409319 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.409458 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.409589 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.409732 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.409864 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.410002 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.410146 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.410277 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.410407 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.410545 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.410677 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.410677 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.410922 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.411052 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.411191 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.411323 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.411453 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.411590 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.411723 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.411864 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.412004 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.412147 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.412280 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.412410 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.412541 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.412670 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.412809 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.412940 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.413070 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.413219 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.413358 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.413511 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.413643 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.413773 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.413903 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.414033 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.414164 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.414391 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.414531 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.414662 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.414792 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.414922 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.415053 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.415206 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.415338 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.415470 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.415600 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.415748 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.416101 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.416244 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.416393 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.416611 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.416748 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.416878 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.417018 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.417150 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.417494 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.417632 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.417765 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.417896 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.418038 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.418256 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.418394 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.418525 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.418667 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.418798 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.418938 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.419138 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.419331 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.419551 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.419689 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.419828 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.419828 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.420632 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.420778 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.420912 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.421043 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=140491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 08 20:50:52.421203 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.421203 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.421203 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.421203 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.421203 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.421203 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.421203 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:50:52.421203 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=140492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 08 20:50:52.487448 ncdv-master-1 devstack@n-api.service[140492]: INFO dbcounter [None req-e8f0956f-1953-4a89-8e28-9c3b847236d0 None None] Registered counter for database nova_api Oct 08 20:50:52.491938 ncdv-master-1 devstack@n-api.service[140491]: INFO dbcounter [None req-cf15e85c-b856-4224-a972-54ee5a17a359 None None] Registered counter for database nova_api Oct 08 20:50:52.508184 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_db.sqlalchemy.engines [None req-e8f0956f-1953-4a89-8e28-9c3b847236d0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=140492) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 08 20:50:52.513477 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_db.sqlalchemy.engines [None req-cf15e85c-b856-4224-a972-54ee5a17a359 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=140491) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 08 20:50:52.515705 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writer thread running {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 08 20:50:52.520953 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writer thread running {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 08 20:50:52.574101 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.context [None req-e8f0956f-1953-4a89-8e28-9c3b847236d0 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1a13ecad-3f87-496d-a2c5-ac44667fd176(cell1) {{(pid=140492) load_cells /opt/stack/nova/nova/context.py:464}} Oct 08 20:50:52.577941 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e8f0956f-1953-4a89-8e28-9c3b847236d0 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:50:52.578939 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e8f0956f-1953-4a89-8e28-9c3b847236d0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:50:52.579758 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.context [None req-cf15e85c-b856-4224-a972-54ee5a17a359 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1a13ecad-3f87-496d-a2c5-ac44667fd176(cell1) {{(pid=140491) load_cells /opt/stack/nova/nova/context.py:464}} Oct 08 20:50:52.580520 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e8f0956f-1953-4a89-8e28-9c3b847236d0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:50:52.581283 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e8f0956f-1953-4a89-8e28-9c3b847236d0 None None] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:50:52.581730 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e8f0956f-1953-4a89-8e28-9c3b847236d0 None None] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:50:52.583669 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cf15e85c-b856-4224-a972-54ee5a17a359 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:50:52.583765 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e8f0956f-1953-4a89-8e28-9c3b847236d0 None None] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:50:52.584152 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cf15e85c-b856-4224-a972-54ee5a17a359 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:50:52.585760 ncdv-master-1 devstack@n-api.service[140492]: INFO dbcounter [None req-e8f0956f-1953-4a89-8e28-9c3b847236d0 None None] Registered counter for database nova_cell0 Oct 08 20:50:52.585857 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cf15e85c-b856-4224-a972-54ee5a17a359 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:50:52.586524 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cf15e85c-b856-4224-a972-54ee5a17a359 None None] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:50:52.586975 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cf15e85c-b856-4224-a972-54ee5a17a359 None None] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:50:52.589080 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cf15e85c-b856-4224-a972-54ee5a17a359 None None] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:50:52.589939 ncdv-master-1 devstack@n-api.service[140492]: INFO dbcounter [None req-e8f0956f-1953-4a89-8e28-9c3b847236d0 None None] Registered counter for database nova_cell1 Oct 08 20:50:52.591195 ncdv-master-1 devstack@n-api.service[140491]: INFO dbcounter [None req-cf15e85c-b856-4224-a972-54ee5a17a359 None None] Registered counter for database nova_cell0 Oct 08 20:50:52.596096 ncdv-master-1 devstack@n-api.service[140491]: INFO dbcounter [None req-cf15e85c-b856-4224-a972-54ee5a17a359 None None] Registered counter for database nova_cell1 Oct 08 20:50:52.598083 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_db.sqlalchemy.engines [None req-e8f0956f-1953-4a89-8e28-9c3b847236d0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=140492) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 08 20:50:52.599475 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_db.sqlalchemy.engines [None req-e8f0956f-1953-4a89-8e28-9c3b847236d0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=140492) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 08 20:50:52.603156 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_db.sqlalchemy.engines [None req-cf15e85c-b856-4224-a972-54ee5a17a359 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=140491) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 08 20:50:52.604753 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_db.sqlalchemy.engines [None req-cf15e85c-b856-4224-a972-54ee5a17a359 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=140491) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 08 20:50:52.606126 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writer thread running {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 08 20:50:52.611337 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writer thread running {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 08 20:50:52.612660 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writer thread running {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 08 20:50:52.745011 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writer thread running {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 08 20:50:52.756034 ncdv-master-1 devstack@n-api.service[140492]: INFO dbcounter [None req-e8f0956f-1953-4a89-8e28-9c3b847236d0 None None] Registered counter for database nova_cell0 Oct 08 20:50:52.759789 ncdv-master-1 devstack@n-api.service[140491]: INFO dbcounter [None req-cf15e85c-b856-4224-a972-54ee5a17a359 None None] Registered counter for database nova_cell0 Oct 08 20:50:52.763336 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_db.sqlalchemy.engines [None req-e8f0956f-1953-4a89-8e28-9c3b847236d0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=140492) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 08 20:50:52.768594 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_db.sqlalchemy.engines [None req-cf15e85c-b856-4224-a972-54ee5a17a359 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=140491) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 08 20:50:52.770520 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writer thread running {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 08 20:50:52.773293 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writer thread running {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 08 20:50:53.209784 ncdv-master-1 devstack@n-api.service[140491]: WARNING keystonemiddleware.auth_token [None req-cf15e85c-b856-4224-a972-54ee5a17a359 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 08 20:50:53.210414 ncdv-master-1 devstack@n-api.service[140492]: WARNING keystonemiddleware.auth_token [None req-e8f0956f-1953-4a89-8e28-9c3b847236d0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 08 20:50:53.217449 ncdv-master-1 devstack@n-api.service[140491]: WARNING keystonemiddleware.auth_token [None req-cf15e85c-b856-4224-a972-54ee5a17a359 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 08 20:50:53.217756 ncdv-master-1 devstack@n-api.service[140492]: WARNING keystonemiddleware.auth_token [None req-e8f0956f-1953-4a89-8e28-9c3b847236d0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 08 20:50:53.448137 ncdv-master-1 devstack@n-api.service[140491]: WARNING keystonemiddleware.auth_token [None req-cf15e85c-b856-4224-a972-54ee5a17a359 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 08 20:50:53.451691 ncdv-master-1 devstack@n-api.service[140492]: WARNING keystonemiddleware.auth_token [None req-e8f0956f-1953-4a89-8e28-9c3b847236d0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 08 20:50:53.454422 ncdv-master-1 devstack@n-api.service[140491]: WARNING keystonemiddleware.auth_token [None req-cf15e85c-b856-4224-a972-54ee5a17a359 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 08 20:50:53.458028 ncdv-master-1 devstack@n-api.service[140492]: WARNING keystonemiddleware.auth_token [None req-e8f0956f-1953-4a89-8e28-9c3b847236d0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 08 20:50:53.459555 ncdv-master-1 devstack@n-api.service[140491]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x556c265009c0 pid: 140491 (default app) Oct 08 20:50:53.463457 ncdv-master-1 devstack@n-api.service[140492]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x556c265009c0 pid: 140492 (default app) Oct 08 20:51:34.444307 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:SELECT=3 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:51:34.447333 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=3 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:51:34.448365 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=3 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:51:34.449383 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=3 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:51:34.682404 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=3 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:51:34.683819 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=3 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:51:34.684715 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=3 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:51:34.685635 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=3 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:51:35.612353 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-2534f2cb-705e-4e7e-a656-c74d6a4bdee0 tempest-AggregatesAdminNegativeTestJSON-367865409 tempest-AggregatesAdminNegativeTestJSON-367865409-project-admin] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:51:35.617092 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2534f2cb-705e-4e7e-a656-c74d6a4bdee0 tempest-AggregatesAdminNegativeTestJSON-367865409 tempest-AggregatesAdminNegativeTestJSON-367865409-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:51:35.617612 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2534f2cb-705e-4e7e-a656-c74d6a4bdee0 tempest-AggregatesAdminNegativeTestJSON-367865409 tempest-AggregatesAdminNegativeTestJSON-367865409-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:51:35.618054 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2534f2cb-705e-4e7e-a656-c74d6a4bdee0 tempest-AggregatesAdminNegativeTestJSON-367865409 tempest-AggregatesAdminNegativeTestJSON-367865409-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:51:35.618789 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2534f2cb-705e-4e7e-a656-c74d6a4bdee0 tempest-AggregatesAdminNegativeTestJSON-367865409 tempest-AggregatesAdminNegativeTestJSON-367865409-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:51:35.619241 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2534f2cb-705e-4e7e-a656-c74d6a4bdee0 tempest-AggregatesAdminNegativeTestJSON-367865409 tempest-AggregatesAdminNegativeTestJSON-367865409-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:51:35.619662 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2534f2cb-705e-4e7e-a656-c74d6a4bdee0 tempest-AggregatesAdminNegativeTestJSON-367865409 tempest-AggregatesAdminNegativeTestJSON-367865409-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:51:35.661440 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-2534f2cb-705e-4e7e-a656-c74d6a4bdee0 tempest-AggregatesAdminNegativeTestJSON-367865409 tempest-AggregatesAdminNegativeTestJSON-367865409-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 1.228314 Oct 08 20:51:35.662026 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1/1] 10.222.0.26 () {58 vars in 1176 bytes} [Sat Oct 8 20:51:34 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 1231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:51:35.677731 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-35c390f8-416b-4d1b-95d0-7736b8310505 tempest-AggregatesAdminNegativeTestJSON-367865409 tempest-AggregatesAdminNegativeTestJSON-367865409-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1908677535"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:51:35.696819 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.objects.aggregate [None req-35c390f8-416b-4d1b-95d0-7736b8310505 tempest-AggregatesAdminNegativeTestJSON-367865409 tempest-AggregatesAdminNegativeTestJSON-367865409-project-admin] Generated uuid d7538f52-6c98-44ac-a439-f8558a4ca819 for aggregate {{(pid=140491) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 08 20:51:35.763452 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-35c390f8-416b-4d1b-95d0-7736b8310505 tempest-AggregatesAdminNegativeTestJSON-367865409 tempest-AggregatesAdminNegativeTestJSON-367865409-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.088661 Oct 08 20:51:35.764258 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2/2] 10.222.0.26 () {60 vars in 1164 bytes} [Sat Oct 8 20:51:35 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 08 20:51:35.776994 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-0594d8ef-f772-401e-a145-aed257187e6a tempest-AggregatesAdminNegativeTestJSON-367865409 tempest-AggregatesAdminNegativeTestJSON-367865409-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:51:35.794655 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0594d8ef-f772-401e-a145-aed257187e6a tempest-AggregatesAdminNegativeTestJSON-367865409 tempest-AggregatesAdminNegativeTestJSON-367865409-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:51:35.795370 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0594d8ef-f772-401e-a145-aed257187e6a tempest-AggregatesAdminNegativeTestJSON-367865409 tempest-AggregatesAdminNegativeTestJSON-367865409-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:51:35.795814 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0594d8ef-f772-401e-a145-aed257187e6a tempest-AggregatesAdminNegativeTestJSON-367865409 tempest-AggregatesAdminNegativeTestJSON-367865409-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:51:36.051683 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-1f9d9c16-4f58-4657-8efd-9296cb36ac7e tempest-AZAdminNegativeTestJSON-1837458390 tempest-AZAdminNegativeTestJSON-1837458390-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:51:36.053972 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-1f9d9c16-4f58-4657-8efd-9296cb36ac7e tempest-AZAdminNegativeTestJSON-1837458390 tempest-AZAdminNegativeTestJSON-1837458390-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': '456b3248db044f03b200cfb5cc09c905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f548b0b4c7465d9092382907f3f7b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:51:36.061967 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-1f9d9c16-4f58-4657-8efd-9296cb36ac7e tempest-AZAdminNegativeTestJSON-1837458390 tempest-AZAdminNegativeTestJSON-1837458390-project] Request method failure captured: Oct 08 20:51:36.061967 ncdv-master-1 devstack@n-api.service[140492]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Oct 08 20:51:36.061967 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 20:51:36.061967 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 20:51:36.061967 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 20:51:36.061967 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 20:51:36.061967 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 20:51:36.061967 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 20:51:36.061967 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 20:51:36.061967 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 20:51:36.061967 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeLUArhO-7TWom6fu7n-AABhJPo0q8gv7zK87J05J27crK4L_VfAOimxQ8jTVBSwgzzO9AKTJX0sqQnxoSm8_APQ34ggjQAWecZzvtgMtuiV5N8fzHMZ3UuqQgYbVQczLZGtuye6awpj0UshnhKKprLRczr13Bz_EKVfb3-RIebI1UQ Oct 08 20:51:36.061967 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 20:51:36.061967 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 20:51:36.061967 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 20:51:36.061967 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 20:51:36.061967 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 20:51:36.061967 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 20:51:36.061967 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 71f548b0b4c7465d9092382907f3f7b7 Oct 08 20:51:36.061967 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-AZAdminNegativeTestJSON-1837458390 Oct 08 20:51:36.061967 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 20:51:36.061967 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 20:51:36.063840 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/71f548b0b4c7465d9092382907f3f7b7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/71f548b0b4c7465d9092382907f3f7b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_71f548b0b4c7465d9092382907f3f7b7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/71f548b0b4c7465d9092382907f3f7b7"}]}] Oct 08 20:51:36.063840 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-AZAdminNegativeTestJSON-1837458390 Oct 08 20:51:36.063840 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 71f548b0b4c7465d9092382907f3f7b7 Oct 08 20:51:36.063840 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-1837458390 Oct 08 20:51:36.063840 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-AZAdminNegativeTestJSON-1837458390-project Oct 08 20:51:36.063840 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 20:51:36.063840 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 20:51:36.063840 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 456b3248db044f03b200cfb5cc09c905 Oct 08 20:51:36.063840 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-AZAdminNegativeTestJSON-1837458390-project Oct 08 20:51:36.063840 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 20:51:36.063840 ncdv-master-1 devstack@n-api.service[140492]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 08 20:51:36.063840 ncdv-master-1 devstack@n-api.service[140492]: action_args: {} Oct 08 20:51:36.064569 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:51:36.064569 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:51:36.064569 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:51:36.064569 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:51:36.064569 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:51:36.064569 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:51:36.064569 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:51:36.064569 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:51:36.064569 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Oct 08 20:51:36.064569 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Oct 08 20:51:36.064569 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 08 20:51:36.064569 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 08 20:51:36.064569 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 08 20:51:36.064569 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 08 20:51:36.064569 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 08 20:51:36.064569 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 08 20:51:36.064569 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 08 20:51:36.064569 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise self.value Oct 08 20:51:36.064569 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 08 20:51:36.065632 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 08 20:51:36.065632 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 08 20:51:36.065632 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 08 20:51:36.065632 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 08 20:51:36.065632 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 08 20:51:36.065632 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 08 20:51:36.065632 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:51:36.065632 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:51:36.065632 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:51:36.065632 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:51:36.065632 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:51:36.065632 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:51:36.065632 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 08 20:51:36.065632 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 08 20:51:36.065632 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 08 20:51:36.065632 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:51:36.067643 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-1f9d9c16-4f58-4657-8efd-9296cb36ac7e tempest-AZAdminNegativeTestJSON-1837458390 tempest-AZAdminNegativeTestJSON-1837458390-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:51:36.069255 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-1f9d9c16-4f58-4657-8efd-9296cb36ac7e tempest-AZAdminNegativeTestJSON-1837458390 tempest-AZAdminNegativeTestJSON-1837458390-project] 10.222.0.26 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 1.397846 Oct 08 20:51:36.070416 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1/3] 10.222.0.26 () {58 vars in 1185 bytes} [Sat Oct 8 20:51:34 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 1400 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 08 20:51:36.469497 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-7ef6c166-5177-4e66-a63b-8d826ad6cd75 tempest-FlavorMetadataValidation-1023268759 tempest-FlavorMetadataValidation-1023268759-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-1848024183", "id": 84633263, "os-flavor-access:is_public": "True"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:51:36.529770 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-7ef6c166-5177-4e66-a63b-8d826ad6cd75 tempest-FlavorMetadataValidation-1023268759 tempest-FlavorMetadataValidation-1023268759-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 465 microversion: 2.86 time: 0.457933 Oct 08 20:51:36.530329 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2/4] 10.222.0.26 () {62 vars in 1188 bytes} [Sat Oct 8 20:51:36 2022] POST /compute/v2.1/flavors => generated 465 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 08 20:51:36.878240 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-0594d8ef-f772-401e-a145-aed257187e6a tempest-AggregatesAdminNegativeTestJSON-367865409 tempest-AggregatesAdminNegativeTestJSON-367865409-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 242 microversion: 2.1 time: 1.105071 Oct 08 20:51:36.879184 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3/5] 10.222.0.26 () {60 vars in 1191 bytes} [Sat Oct 8 20:51:35 2022] POST /compute/v2.1/os-aggregates/1/action => generated 242 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 08 20:51:36.924431 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-588741ab-1a0d-4130-a2ab-11bd130b78ed tempest-AggregatesAdminTestJSON-1599742552 tempest-AggregatesAdminTestJSON-1599742552-project-admin] Calling method '.version_select at 0x7f1a8e3198b0>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:51:36.931115 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-588741ab-1a0d-4130-a2ab-11bd130b78ed tempest-AggregatesAdminTestJSON-1599742552 tempest-AggregatesAdminTestJSON-1599742552-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1a13ecad-3f87-496d-a2c5-ac44667fd176(cell1) {{(pid=140492) load_cells /opt/stack/nova/nova/compute/api.py:319}} Oct 08 20:51:36.931836 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-588741ab-1a0d-4130-a2ab-11bd130b78ed tempest-AggregatesAdminTestJSON-1599742552 tempest-AggregatesAdminTestJSON-1599742552-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:51:36.932490 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-588741ab-1a0d-4130-a2ab-11bd130b78ed tempest-AggregatesAdminTestJSON-1599742552 tempest-AggregatesAdminTestJSON-1599742552-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:51:36.932911 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-588741ab-1a0d-4130-a2ab-11bd130b78ed tempest-AggregatesAdminTestJSON-1599742552 tempest-AggregatesAdminTestJSON-1599742552-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:51:36.960605 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-588741ab-1a0d-4130-a2ab-11bd130b78ed tempest-AggregatesAdminTestJSON-1599742552 tempest-AggregatesAdminTestJSON-1599742552-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:51:36.961094 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-588741ab-1a0d-4130-a2ab-11bd130b78ed tempest-AggregatesAdminTestJSON-1599742552 tempest-AggregatesAdminTestJSON-1599742552-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:51:36.961562 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-588741ab-1a0d-4130-a2ab-11bd130b78ed tempest-AggregatesAdminTestJSON-1599742552 tempest-AggregatesAdminTestJSON-1599742552-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:51:36.976563 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-588741ab-1a0d-4130-a2ab-11bd130b78ed tempest-AggregatesAdminTestJSON-1599742552 tempest-AggregatesAdminTestJSON-1599742552-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:51:36.977089 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-588741ab-1a0d-4130-a2ab-11bd130b78ed tempest-AggregatesAdminTestJSON-1599742552 tempest-AggregatesAdminTestJSON-1599742552-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:51:36.977599 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-588741ab-1a0d-4130-a2ab-11bd130b78ed tempest-AggregatesAdminTestJSON-1599742552 tempest-AggregatesAdminTestJSON-1599742552-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:51:36.985169 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-588741ab-1a0d-4130-a2ab-11bd130b78ed tempest-AggregatesAdminTestJSON-1599742552 tempest-AggregatesAdminTestJSON-1599742552-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 0.453347 Oct 08 20:51:36.985865 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3/6] 10.222.0.26 () {58 vars in 1167 bytes} [Sat Oct 8 20:51:36 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:51:37.101943 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-8a536ab6-7ed5-417e-861a-702251f3da37 tempest-AggregatesAdminTestV241-206114750 tempest-AggregatesAdminTestV241-206114750-project-admin] Calling method '.version_select at 0x7f1a8d9f51f0>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:51:37.115554 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-8a536ab6-7ed5-417e-861a-702251f3da37 tempest-AggregatesAdminTestV241-206114750 tempest-AggregatesAdminTestV241-206114750-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1a13ecad-3f87-496d-a2c5-ac44667fd176(cell1) {{(pid=140491) load_cells /opt/stack/nova/nova/compute/api.py:319}} Oct 08 20:51:37.116637 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8a536ab6-7ed5-417e-861a-702251f3da37 tempest-AggregatesAdminTestV241-206114750 tempest-AggregatesAdminTestV241-206114750-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:51:37.117592 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8a536ab6-7ed5-417e-861a-702251f3da37 tempest-AggregatesAdminTestV241-206114750 tempest-AggregatesAdminTestV241-206114750-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:51:37.118658 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8a536ab6-7ed5-417e-861a-702251f3da37 tempest-AggregatesAdminTestV241-206114750 tempest-AggregatesAdminTestV241-206114750-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:51:37.145230 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8a536ab6-7ed5-417e-861a-702251f3da37 tempest-AggregatesAdminTestV241-206114750 tempest-AggregatesAdminTestV241-206114750-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:51:37.145877 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8a536ab6-7ed5-417e-861a-702251f3da37 tempest-AggregatesAdminTestV241-206114750 tempest-AggregatesAdminTestV241-206114750-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:51:37.147609 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8a536ab6-7ed5-417e-861a-702251f3da37 tempest-AggregatesAdminTestV241-206114750 tempest-AggregatesAdminTestV241-206114750-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:51:37.160678 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8a536ab6-7ed5-417e-861a-702251f3da37 tempest-AggregatesAdminTestV241-206114750 tempest-AggregatesAdminTestV241-206114750-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:51:37.161175 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8a536ab6-7ed5-417e-861a-702251f3da37 tempest-AggregatesAdminTestV241-206114750 tempest-AggregatesAdminTestV241-206114750-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:51:37.161824 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8a536ab6-7ed5-417e-861a-702251f3da37 tempest-AggregatesAdminTestV241-206114750 tempest-AggregatesAdminTestV241-206114750-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:51:37.168922 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-8a536ab6-7ed5-417e-861a-702251f3da37 tempest-AggregatesAdminTestV241-206114750 tempest-AggregatesAdminTestV241-206114750-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1423 microversion: 2.41 time: 0.288238 Oct 08 20:51:37.182729 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 4/7] 10.222.0.26 () {60 vars in 1208 bytes} [Sat Oct 8 20:51:36 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1423 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:51:37.187271 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-8f877246-4195-4807-b099-e7e5218d6ff6 tempest-FlavorMetadataValidation-1023268759 tempest-FlavorMetadataValidation-1023268759-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:51:37.228952 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-d5843ce8-e200-4633-bd82-b452a314cf6c tempest-HypervisorAdminNegativeUnderV252Test-531944581 tempest-HypervisorAdminNegativeUnderV252Test-531944581-project-admin] Calling method '.version_select at 0x7f1a8e268700>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:51:37.231056 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d5843ce8-e200-4633-bd82-b452a314cf6c tempest-HypervisorAdminNegativeUnderV252Test-531944581 tempest-HypervisorAdminNegativeUnderV252Test-531944581-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:51:37.231534 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d5843ce8-e200-4633-bd82-b452a314cf6c tempest-HypervisorAdminNegativeUnderV252Test-531944581 tempest-HypervisorAdminNegativeUnderV252Test-531944581-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:51:37.232018 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d5843ce8-e200-4633-bd82-b452a314cf6c tempest-HypervisorAdminNegativeUnderV252Test-531944581 tempest-HypervisorAdminNegativeUnderV252Test-531944581-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:51:37.263536 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d5843ce8-e200-4633-bd82-b452a314cf6c tempest-HypervisorAdminNegativeUnderV252Test-531944581 tempest-HypervisorAdminNegativeUnderV252Test-531944581-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:51:37.264052 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d5843ce8-e200-4633-bd82-b452a314cf6c tempest-HypervisorAdminNegativeUnderV252Test-531944581 tempest-HypervisorAdminNegativeUnderV252Test-531944581-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:51:37.264497 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d5843ce8-e200-4633-bd82-b452a314cf6c tempest-HypervisorAdminNegativeUnderV252Test-531944581 tempest-HypervisorAdminNegativeUnderV252Test-531944581-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:51:37.288162 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d5843ce8-e200-4633-bd82-b452a314cf6c tempest-HypervisorAdminNegativeUnderV252Test-531944581 tempest-HypervisorAdminNegativeUnderV252Test-531944581-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:51:37.289080 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d5843ce8-e200-4633-bd82-b452a314cf6c tempest-HypervisorAdminNegativeUnderV252Test-531944581 tempest-HypervisorAdminNegativeUnderV252Test-531944581-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:51:37.303633 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d5843ce8-e200-4633-bd82-b452a314cf6c tempest-HypervisorAdminNegativeUnderV252Test-531944581 tempest-HypervisorAdminNegativeUnderV252Test-531944581-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:51:37.314300 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-d5843ce8-e200-4633-bd82-b452a314cf6c tempest-HypervisorAdminNegativeUnderV252Test-531944581 tempest-HypervisorAdminNegativeUnderV252Test-531944581-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.327408 Oct 08 20:51:37.315394 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 4/8] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Oct 8 20:51:36 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:51:37.320415 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-38a25980-67d4-44c6-95ec-3a37fc205e5b tempest-AggregatesAdminNegativeTestJSON-367865409 tempest-AggregatesAdminNegativeTestJSON-367865409-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:51:37.359140 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-38a25980-67d4-44c6-95ec-3a37fc205e5b tempest-AggregatesAdminNegativeTestJSON-367865409 tempest-AggregatesAdminNegativeTestJSON-367865409-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:51:37.360050 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-38a25980-67d4-44c6-95ec-3a37fc205e5b tempest-AggregatesAdminNegativeTestJSON-367865409 tempest-AggregatesAdminNegativeTestJSON-367865409-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:51:37.360495 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-38a25980-67d4-44c6-95ec-3a37fc205e5b tempest-AggregatesAdminNegativeTestJSON-367865409 tempest-AggregatesAdminNegativeTestJSON-367865409-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:51:37.415302 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-38a25980-67d4-44c6-95ec-3a37fc205e5b tempest-AggregatesAdminNegativeTestJSON-367865409 tempest-AggregatesAdminNegativeTestJSON-367865409-project-admin] HTTP exception thrown: Aggregate 1 already has host nch2-master-1. Oct 08 20:51:37.442630 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-8f877246-4195-4807-b099-e7e5218d6ff6 tempest-FlavorMetadataValidation-1023268759 tempest-FlavorMetadataValidation-1023268759-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors/84633263/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.268518 Oct 08 20:51:37.443231 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 5/9] 10.222.0.26 () {62 vars in 1259 bytes} [Sat Oct 8 20:51:37 2022] POST /compute/v2.1/flavors/84633263/os-extra_specs => generated 62 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:51:37.492042 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-38a25980-67d4-44c6-95ec-3a37fc205e5b tempest-AggregatesAdminNegativeTestJSON-367865409 tempest-AggregatesAdminNegativeTestJSON-367865409-project-admin] Request method failure captured: Oct 08 20:51:37.492042 ncdv-master-1 devstack@n-api.service[140492]: request: POST /compute/v2.1/os-aggregates/1/action HTTP/1.1 Oct 08 20:51:37.492042 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 20:51:37.492042 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 20:51:37.492042 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 20:51:37.492042 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 39 Oct 08 20:51:37.492042 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 20:51:37.492042 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 20:51:37.492042 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 20:51:37.492042 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 20:51:37.492042 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeLWVhqRRveDbmIUhFeBnNUCcRp0ijW8GA3slsPD4DpNY4VIrC1Obpt3PlDfNSXK8aKkF6mMCXXMjLIABKZrpIUQZ9p2WyaQLz3ViLWkIGM6mg_h9EkodYvDQieQggfjENBh1o6B10L6dVsCn80FSMaMQdp8lU263-XrTG0rHVdTG1w Oct 08 20:51:37.492042 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 20:51:37.492042 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 20:51:37.492042 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 20:51:37.492042 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 20:51:37.492042 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 20:51:37.492042 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 20:51:37.492042 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: d7e38a3e604b4b0a82db824aa872aef3 Oct 08 20:51:37.492042 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-367865409 Oct 08 20:51:37.492042 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,admin,member Oct 08 20:51:37.492042 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,admin,member Oct 08 20:51:37.493456 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d7e38a3e604b4b0a82db824aa872aef3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d7e38a3e604b4b0a82db824aa872aef3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d7e38a3e604b4b0a82db824aa872aef3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d7e38a3e604b4b0a82db824aa872aef3"}]}] Oct 08 20:51:37.493456 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-367865409 Oct 08 20:51:37.493456 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: d7e38a3e604b4b0a82db824aa872aef3 Oct 08 20:51:37.493456 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-367865409 Oct 08 20:51:37.493456 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-AggregatesAdminNegativeTestJSON-367865409-project-admin Oct 08 20:51:37.493456 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 20:51:37.493456 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 20:51:37.493456 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 27df69ae40444039af536faf5d884284 Oct 08 20:51:37.493456 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-367865409-project-admin Oct 08 20:51:37.493456 ncdv-master-1 devstack@n-api.service[140492]: Oct 08 20:51:37.493456 ncdv-master-1 devstack@n-api.service[140492]: {"add_host": {"host": "nch2-master-1"}} Oct 08 20:51:37.493456 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 20:51:37.493456 ncdv-master-1 devstack@n-api.service[140492]: exception: Aggregate 1 already has host nch2-master-1. Oct 08 20:51:37.494337 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': '1', 'body': {'add_host': {'host': 'nch2-master-1'}}} Oct 08 20:51:37.494337 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:51:37.494337 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:51:37.494337 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 08 20:51:37.494337 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 08 20:51:37.494337 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 08 20:51:37.494337 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 08 20:51:37.494337 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 08 20:51:37.494337 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 08 20:51:37.494337 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 08 20:51:37.494337 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 08 20:51:37.494337 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 08 20:51:37.494337 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 08 20:51:37.494337 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 08 20:51:37.494337 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi result.read() Oct 08 20:51:37.494337 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 08 20:51:37.494337 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 08 20:51:37.494337 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 08 20:51:37.494337 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 08 20:51:37.495551 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 08 20:51:37.495551 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 08 20:51:37.495551 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 08 20:51:37.495551 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 08 20:51:37.495551 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'nch2-master-1-1' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Oct 08 20:51:37.495551 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:51:37.495551 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 08 20:51:37.495551 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:51:37.495551 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:51:37.495551 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Oct 08 20:51:37.495551 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Oct 08 20:51:37.495551 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 08 20:51:37.495551 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi session.flush() Oct 08 20:51:37.495551 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 08 20:51:37.495551 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 08 20:51:37.495551 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 08 20:51:37.495551 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 08 20:51:37.495551 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 08 20:51:37.495551 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 08 20:51:37.496745 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 08 20:51:37.496745 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception Oct 08 20:51:37.496745 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 08 20:51:37.496745 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 08 20:51:37.496745 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 08 20:51:37.496745 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 08 20:51:37.496745 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 08 20:51:37.496745 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 08 20:51:37.496745 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 08 20:51:37.496745 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 08 20:51:37.496745 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 08 20:51:37.496745 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 08 20:51:37.496745 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 08 20:51:37.496745 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 08 20:51:37.496745 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 08 20:51:37.496745 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 08 20:51:37.496745 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 08 20:51:37.496745 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 08 20:51:37.497961 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 08 20:51:37.497961 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 08 20:51:37.497961 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 08 20:51:37.497961 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 08 20:51:37.497961 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 08 20:51:37.497961 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception Oct 08 20:51:37.497961 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 08 20:51:37.497961 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 08 20:51:37.497961 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 08 20:51:37.497961 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 08 20:51:37.497961 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 08 20:51:37.497961 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 08 20:51:37.497961 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 08 20:51:37.497961 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 08 20:51:37.497961 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 08 20:51:37.497961 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 08 20:51:37.497961 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 08 20:51:37.497961 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi result.read() Oct 08 20:51:37.499094 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 08 20:51:37.499094 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 08 20:51:37.499094 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 08 20:51:37.499094 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 08 20:51:37.499094 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 08 20:51:37.499094 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 08 20:51:37.499094 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 08 20:51:37.499094 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 08 20:51:37.499094 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'nch2-master-1-1' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Oct 08 20:51:37.499094 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Oct 08 20:51:37.499094 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 8, 20, 51, 37, 398929), 'updated_at': None, 'host': 'nch2-master-1', 'aggregate_id': 1}] Oct 08 20:51:37.499094 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 08 20:51:37.499094 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:51:37.499094 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:51:37.499094 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:51:37.499094 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:51:37.499094 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Oct 08 20:51:37.500560 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Oct 08 20:51:37.500560 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 08 20:51:37.500560 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 08 20:51:37.500560 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 08 20:51:37.500560 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 08 20:51:37.500560 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 08 20:51:37.500560 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise self.value Oct 08 20:51:37.500560 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 08 20:51:37.500560 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 08 20:51:37.500560 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6641, in add_host_to_aggregate Oct 08 20:51:37.500560 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Oct 08 20:51:37.500560 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 08 20:51:37.500560 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 08 20:51:37.500560 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Oct 08 20:51:37.500560 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Oct 08 20:51:37.500560 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Oct 08 20:51:37.500560 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Oct 08 20:51:37.500560 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 1 already has host nch2-master-1. Oct 08 20:51:37.500560 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:51:37.500560 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:51:37.502046 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:51:37.502046 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:51:37.502046 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:51:37.502046 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:51:37.502046 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:51:37.502046 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:51:37.502046 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:51:37.502046 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:51:37.502046 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 20:51:37.502046 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 20:51:37.502046 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Oct 08 20:51:37.502046 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Oct 08 20:51:37.502046 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 1 already has host nch2-master-1. Oct 08 20:51:37.502046 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:51:37.502046 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:51:37.502046 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:51:37.502046 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:51:37.502046 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:51:37.502046 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:51:37.502046 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 20:51:37.502046 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 20:51:37.503262 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 1 already has host nch2-master-1. Oct 08 20:51:37.503262 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:51:37.506983 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-38a25980-67d4-44c6-95ec-3a37fc205e5b tempest-AggregatesAdminNegativeTestJSON-367865409 tempest-AggregatesAdminNegativeTestJSON-367865409-project-admin] Returning 409 to user: Aggregate 1 already has host nch2-master-1. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:51:37.506983 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-38a25980-67d4-44c6-95ec-3a37fc205e5b tempest-AggregatesAdminNegativeTestJSON-367865409 tempest-AggregatesAdminNegativeTestJSON-367865409-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates/1/action" status: 409 len: 95 microversion: 2.1 time: 0.189446 Oct 08 20:51:37.506983 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 5/10] 10.222.0.26 () {60 vars in 1191 bytes} [Sat Oct 8 20:51:37 2022] POST /compute/v2.1/os-aggregates/1/action => generated 95 bytes in 191 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Oct 08 20:51:37.511617 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-601ff38d-53df-408a-ab0c-953fd074df8a tempest-FlavorMetadataValidation-1023268759 tempest-FlavorMetadataValidation-1023268759-project-admin] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:51:37.542671 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-601ff38d-53df-408a-ab0c-953fd074df8a tempest-FlavorMetadataValidation-1023268759 tempest-FlavorMetadataValidation-1023268759-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/84633263" status: 202 len: 0 microversion: 2.86 time: 0.035012 Oct 08 20:51:37.543921 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 6/11] 10.222.0.26 () {60 vars in 1196 bytes} [Sat Oct 8 20:51:37 2022] DELETE /compute/v2.1/flavors/84633263 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 08 20:51:37.708553 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-56af066e-7caf-402a-a8b2-e37dc84c56e2 tempest-HypervisorAdminNegativeUnderV252Test-1360949025 tempest-HypervisorAdminNegativeUnderV252Test-1360949025-project] Calling method '.version_select at 0x7f1a8d9634c0>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:51:37.710411 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-56af066e-7caf-402a-a8b2-e37dc84c56e2 tempest-HypervisorAdminNegativeUnderV252Test-1360949025 tempest-HypervisorAdminNegativeUnderV252Test-1360949025-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': '2e4e944ad6104c7ebb9fbdccc45818ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47654280a88d4269a3289e9acf6d005b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:51:37.714957 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-56af066e-7caf-402a-a8b2-e37dc84c56e2 tempest-HypervisorAdminNegativeUnderV252Test-1360949025 tempest-HypervisorAdminNegativeUnderV252Test-1360949025-project] Request method failure captured: Oct 08 20:51:37.714957 ncdv-master-1 devstack@n-api.service[140491]: request: GET /compute/v2.1/os-hypervisors/nch2-master-1/search HTTP/1.1 Oct 08 20:51:37.714957 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 20:51:37.714957 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 20:51:37.714957 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 20:51:37.714957 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 20:51:37.714957 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 20:51:37.714957 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 20:51:37.714957 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 20:51:37.714957 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 20:51:37.714957 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeLVol-0toC3YSSLVS5dySO1dTu6S5ve57EII58TyjfD1kQhqE9D4eQmJ1T_8ulWBk5M6tPEsjP48piskAbpRZhXZiVdDHsZuzwlVWBMahllarj47FJYZLoANe-RWXpabVDMu7zyt5b1Ysg5CCPXuoKOeT4crs2pfcsZIN9bJhgiE0U Oct 08 20:51:37.714957 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 20:51:37.714957 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 20:51:37.714957 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 20:51:37.714957 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 20:51:37.714957 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 20:51:37.714957 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 20:51:37.714957 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 47654280a88d4269a3289e9acf6d005b Oct 08 20:51:37.714957 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1360949025 Oct 08 20:51:37.714957 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 20:51:37.714957 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 20:51:37.716256 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/47654280a88d4269a3289e9acf6d005b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/47654280a88d4269a3289e9acf6d005b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_47654280a88d4269a3289e9acf6d005b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/47654280a88d4269a3289e9acf6d005b"}]}] Oct 08 20:51:37.716256 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1360949025 Oct 08 20:51:37.716256 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 47654280a88d4269a3289e9acf6d005b Oct 08 20:51:37.716256 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1360949025 Oct 08 20:51:37.716256 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1360949025-project Oct 08 20:51:37.716256 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 20:51:37.716256 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 20:51:37.716256 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 2e4e944ad6104c7ebb9fbdccc45818ee Oct 08 20:51:37.716256 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1360949025-project Oct 08 20:51:37.716256 ncdv-master-1 devstack@n-api.service[140491]: method: Oct 08 20:51:37.716256 ncdv-master-1 devstack@n-api.service[140491]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 08 20:51:37.716256 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': 'nch2-master-1'} Oct 08 20:51:37.717170 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:51:37.717170 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:51:37.717170 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:51:37.717170 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:51:37.717170 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:51:37.717170 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:51:37.717170 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 08 20:51:37.717170 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 08 20:51:37.717170 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:51:37.717170 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:51:37.717170 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Oct 08 20:51:37.717170 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Oct 08 20:51:37.717170 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 08 20:51:37.717170 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 08 20:51:37.717170 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 08 20:51:37.717170 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 08 20:51:37.717170 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 08 20:51:37.717170 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 08 20:51:37.717170 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 08 20:51:37.718349 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise self.value Oct 08 20:51:37.718349 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 08 20:51:37.718349 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 08 20:51:37.718349 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 08 20:51:37.718349 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 08 20:51:37.718349 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 08 20:51:37.718349 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 08 20:51:37.718349 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 08 20:51:37.718349 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:51:37.718349 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:51:37.718349 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:51:37.718349 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:51:37.718349 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:51:37.718349 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:51:37.718349 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 08 20:51:37.718349 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 08 20:51:37.718349 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 08 20:51:37.718349 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:51:37.719457 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-56af066e-7caf-402a-a8b2-e37dc84c56e2 tempest-HypervisorAdminNegativeUnderV252Test-1360949025 tempest-HypervisorAdminNegativeUnderV252Test-1360949025-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:51:37.719457 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-56af066e-7caf-402a-a8b2-e37dc84c56e2 tempest-HypervisorAdminNegativeUnderV252Test-1360949025 tempest-HypervisorAdminNegativeUnderV252Test-1360949025-project] 10.222.0.26 "GET /compute/v2.1/os-hypervisors/nch2-master-1/search" status: 403 len: 117 microversion: 2.1 time: 0.271526 Oct 08 20:51:37.719457 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 6/12] 10.222.0.26 () {58 vars in 1209 bytes} [Sat Oct 8 20:51:37 2022] GET /compute/v2.1/os-hypervisors/nch2-master-1/search => generated 117 bytes in 273 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 08 20:51:37.723397 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-9a045848-11e4-430c-9eb1-0a779cc2819a tempest-AggregatesAdminNegativeTestJSON-367865409 tempest-AggregatesAdminNegativeTestJSON-367865409-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:51:37.735670 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9a045848-11e4-430c-9eb1-0a779cc2819a tempest-AggregatesAdminNegativeTestJSON-367865409 tempest-AggregatesAdminNegativeTestJSON-367865409-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:51:37.736164 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9a045848-11e4-430c-9eb1-0a779cc2819a tempest-AggregatesAdminNegativeTestJSON-367865409 tempest-AggregatesAdminNegativeTestJSON-367865409-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:51:37.736594 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9a045848-11e4-430c-9eb1-0a779cc2819a tempest-AggregatesAdminNegativeTestJSON-367865409 tempest-AggregatesAdminNegativeTestJSON-367865409-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:51:37.808884 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-a4c1ed41-b10c-447d-a620-687e4a91ea53 tempest-FlavorsAccessNegativeTestJSON-459130796 tempest-FlavorsAccessNegativeTestJSON-459130796-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1183838754", "id": 1259204769, "os-flavor-access:is_public": "False"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:51:37.836212 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-a4c1ed41-b10c-447d-a620-687e4a91ea53 tempest-FlavorsAccessNegativeTestJSON-459130796 tempest-FlavorsAccessNegativeTestJSON-459130796-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.290871 Oct 08 20:51:37.837592 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 7/13] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 20:51:37 2022] POST /compute/v2.1/flavors => generated 439 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:51:37.847719 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-68ca7e48-1205-4621-9329-bbe9c4e92f61 tempest-FlavorMetadataValidation-1023268759 tempest-FlavorMetadataValidation-1023268759-project-admin] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:51:37.877883 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-9a045848-11e4-430c-9eb1-0a779cc2819a tempest-AggregatesAdminNegativeTestJSON-367865409 tempest-AggregatesAdminNegativeTestJSON-367865409-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 227 microversion: 2.1 time: 0.159336 Oct 08 20:51:37.879477 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 7/14] 10.222.0.26 () {60 vars in 1191 bytes} [Sat Oct 8 20:51:37 2022] POST /compute/v2.1/os-aggregates/1/action => generated 227 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:51:37.883421 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-68ca7e48-1205-4621-9329-bbe9c4e92f61 tempest-FlavorMetadataValidation-1023268759 tempest-FlavorMetadataValidation-1023268759-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.86 time: 0.044382 Oct 08 20:51:37.884410 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 8/15] 10.222.0.26 () {60 vars in 1187 bytes} [Sat Oct 8 20:51:37 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:51:37.888972 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-be254fe6-4fbe-4b02-b8cb-9ee0b915d61e tempest-FlavorsAccessNegativeTestJSON-459130796 tempest-FlavorsAccessNegativeTestJSON-459130796-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "0eae5cc31fc7412292ec30a394e28863"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:51:37.891963 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-adcce94f-9216-4a61-a4ae-302e7f61785d tempest-HypervisorAdminNegativeUnderV252Test-531944581 tempest-HypervisorAdminNegativeUnderV252Test-531944581-project-admin] Calling method '.version_select at 0x7f1a8d9638b0>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:51:37.895423 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-adcce94f-9216-4a61-a4ae-302e7f61785d tempest-HypervisorAdminNegativeUnderV252Test-531944581 tempest-HypervisorAdminNegativeUnderV252Test-531944581-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:51:37.896099 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-adcce94f-9216-4a61-a4ae-302e7f61785d tempest-HypervisorAdminNegativeUnderV252Test-531944581 tempest-HypervisorAdminNegativeUnderV252Test-531944581-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:51:37.897036 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-adcce94f-9216-4a61-a4ae-302e7f61785d tempest-HypervisorAdminNegativeUnderV252Test-531944581 tempest-HypervisorAdminNegativeUnderV252Test-531944581-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:51:37.918953 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-adcce94f-9216-4a61-a4ae-302e7f61785d tempest-HypervisorAdminNegativeUnderV252Test-531944581 tempest-HypervisorAdminNegativeUnderV252Test-531944581-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 08 20:51:37.920911 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-adcce94f-9216-4a61-a4ae-302e7f61785d tempest-HypervisorAdminNegativeUnderV252Test-531944581 tempest-HypervisorAdminNegativeUnderV252Test-531944581-project-admin] Request method failure captured: Oct 08 20:51:37.920911 ncdv-master-1 devstack@n-api.service[140491]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Oct 08 20:51:37.920911 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 20:51:37.920911 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 20:51:37.920911 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 20:51:37.920911 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 20:51:37.920911 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 20:51:37.920911 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 20:51:37.920911 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 20:51:37.920911 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 20:51:37.920911 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeLYex16HSyDn_VNgisxYKVEmuyHGTCRCQmyll4Fthoo9ZPEKFtzNJ5o-VxVmWQuoORe9za_OEn-TsyFoy1nAWU6s-kv7hDbd4xoR7meWKavBxHXvQl8fm08ed4wdUeYn0HRnw767cifQ0ZVEY0ptaI9aJRmuxekAuIeIfyPiW3yiXM Oct 08 20:51:37.920911 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 20:51:37.920911 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 20:51:37.920911 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 20:51:37.920911 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 20:51:37.920911 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 20:51:37.920911 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 20:51:37.920911 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 7b1a2053ff2a4aecaabdb5995bb73eac Oct 08 20:51:37.920911 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-531944581 Oct 08 20:51:37.920911 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,admin,member Oct 08 20:51:37.920911 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,admin,member Oct 08 20:51:37.922870 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/7b1a2053ff2a4aecaabdb5995bb73eac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7b1a2053ff2a4aecaabdb5995bb73eac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_7b1a2053ff2a4aecaabdb5995bb73eac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7b1a2053ff2a4aecaabdb5995bb73eac"}]}] Oct 08 20:51:37.922870 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-531944581 Oct 08 20:51:37.922870 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 7b1a2053ff2a4aecaabdb5995bb73eac Oct 08 20:51:37.922870 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-531944581 Oct 08 20:51:37.922870 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-531944581-project-admin Oct 08 20:51:37.922870 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 20:51:37.922870 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 20:51:37.922870 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 8ca491afc0a64f31a14c46178f9210f2 Oct 08 20:51:37.922870 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-531944581-project-admin Oct 08 20:51:37.922870 ncdv-master-1 devstack@n-api.service[140491]: method: Oct 08 20:51:37.922870 ncdv-master-1 devstack@n-api.service[140491]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 08 20:51:37.922870 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': 'nonexistent_hypervisor_name'} Oct 08 20:51:37.923634 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:51:37.923634 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:51:37.923634 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:51:37.923634 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:51:37.923634 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:51:37.923634 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:51:37.923634 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 08 20:51:37.923634 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 08 20:51:37.923634 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:51:37.923634 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:51:37.923634 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Oct 08 20:51:37.923634 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Oct 08 20:51:37.923634 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Oct 08 20:51:37.923634 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 08 20:51:37.923634 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 08 20:51:37.923634 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:51:37.923634 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:51:37.923634 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:51:37.923634 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:51:37.923634 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:51:37.934379 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:51:37.934379 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 20:51:37.934379 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 20:51:37.934379 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 08 20:51:37.934379 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:51:37.935842 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-adcce94f-9216-4a61-a4ae-302e7f61785d tempest-HypervisorAdminNegativeUnderV252Test-531944581 tempest-HypervisorAdminNegativeUnderV252Test-531944581-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:51:37.938922 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-adcce94f-9216-4a61-a4ae-302e7f61785d tempest-HypervisorAdminNegativeUnderV252Test-531944581 tempest-HypervisorAdminNegativeUnderV252Test-531944581-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.056913 Oct 08 20:51:37.939509 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 8/16] 10.222.0.26 () {58 vars in 1251 bytes} [Sat Oct 8 20:51:37 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 20:51:37.951578 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-3d7536a9-bc5f-4141-8f69-3c47742e4575 tempest-AggregatesAdminNegativeTestJSON-367865409 tempest-AggregatesAdminNegativeTestJSON-367865409-project-admin] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:51:37.991294 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-3d7536a9-bc5f-4141-8f69-3c47742e4575 tempest-AggregatesAdminNegativeTestJSON-367865409 tempest-AggregatesAdminNegativeTestJSON-367865409-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.1 time: 0.050458 Oct 08 20:51:37.993697 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 9/17] 10.222.0.26 () {58 vars in 1152 bytes} [Sat Oct 8 20:51:37 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 08 20:51:38.001411 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-a4e312a8-34f2-48ee-ac54-8d96d6c88167 tempest-HypervisorAdminNegativeUnderV252Test-531944581 tempest-HypervisorAdminNegativeUnderV252Test-531944581-project-admin] Calling method '.version_select at 0x7f1a8d9634c0>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:51:38.004884 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a4e312a8-34f2-48ee-ac54-8d96d6c88167 tempest-HypervisorAdminNegativeUnderV252Test-531944581 tempest-HypervisorAdminNegativeUnderV252Test-531944581-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:51:38.006189 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a4e312a8-34f2-48ee-ac54-8d96d6c88167 tempest-HypervisorAdminNegativeUnderV252Test-531944581 tempest-HypervisorAdminNegativeUnderV252Test-531944581-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:51:38.006651 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a4e312a8-34f2-48ee-ac54-8d96d6c88167 tempest-HypervisorAdminNegativeUnderV252Test-531944581 tempest-HypervisorAdminNegativeUnderV252Test-531944581-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:51:38.027335 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a4e312a8-34f2-48ee-ac54-8d96d6c88167 tempest-HypervisorAdminNegativeUnderV252Test-531944581 tempest-HypervisorAdminNegativeUnderV252Test-531944581-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:51:38.027908 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a4e312a8-34f2-48ee-ac54-8d96d6c88167 tempest-HypervisorAdminNegativeUnderV252Test-531944581 tempest-HypervisorAdminNegativeUnderV252Test-531944581-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:51:38.028455 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a4e312a8-34f2-48ee-ac54-8d96d6c88167 tempest-HypervisorAdminNegativeUnderV252Test-531944581 tempest-HypervisorAdminNegativeUnderV252Test-531944581-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:51:38.040364 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a4e312a8-34f2-48ee-ac54-8d96d6c88167 tempest-HypervisorAdminNegativeUnderV252Test-531944581 tempest-HypervisorAdminNegativeUnderV252Test-531944581-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:51:38.041096 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a4e312a8-34f2-48ee-ac54-8d96d6c88167 tempest-HypervisorAdminNegativeUnderV252Test-531944581 tempest-HypervisorAdminNegativeUnderV252Test-531944581-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:51:38.041716 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a4e312a8-34f2-48ee-ac54-8d96d6c88167 tempest-HypervisorAdminNegativeUnderV252Test-531944581 tempest-HypervisorAdminNegativeUnderV252Test-531944581-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:51:38.056098 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-a4e312a8-34f2-48ee-ac54-8d96d6c88167 tempest-HypervisorAdminNegativeUnderV252Test-531944581 tempest-HypervisorAdminNegativeUnderV252Test-531944581-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.063416 Oct 08 20:51:38.056980 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 10/18] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Oct 8 20:51:37 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:51:38.066089 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-68afa5dd-8384-4b6e-989e-d3315dda11a0 tempest-AggregatesAdminNegativeTestJSON-367865409 tempest-AggregatesAdminNegativeTestJSON-367865409-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-379025281"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:51:38.069954 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.objects.aggregate [None req-68afa5dd-8384-4b6e-989e-d3315dda11a0 tempest-AggregatesAdminNegativeTestJSON-367865409 tempest-AggregatesAdminNegativeTestJSON-367865409-project-admin] Generated uuid fdf7a31b-fe85-4e93-b802-0a3189eb9785 for aggregate {{(pid=140491) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 08 20:51:38.096438 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-68afa5dd-8384-4b6e-989e-d3315dda11a0 tempest-AggregatesAdminNegativeTestJSON-367865409 tempest-AggregatesAdminNegativeTestJSON-367865409-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.033910 Oct 08 20:51:38.097653 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 11/19] 10.222.0.26 () {60 vars in 1164 bytes} [Sat Oct 8 20:51:38 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:51:38.102814 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-9a8f87f8-01db-41c3-8afd-03a9031f8a5c tempest-AggregatesAdminTestV241-206114750 tempest-AggregatesAdminTestV241-206114750-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-872026085"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:51:38.106647 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.objects.aggregate [None req-9a8f87f8-01db-41c3-8afd-03a9031f8a5c tempest-AggregatesAdminTestV241-206114750 tempest-AggregatesAdminTestV241-206114750-project-admin] Generated uuid 80e8b13b-428f-4e03-840e-0936b4348602 for aggregate {{(pid=140491) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 08 20:51:38.138639 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-9a8f87f8-01db-41c3-8afd-03a9031f8a5c tempest-AggregatesAdminTestV241-206114750 tempest-AggregatesAdminTestV241-206114750-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates" status: 200 len: 245 microversion: 2.41 time: 0.039630 Oct 08 20:51:38.139580 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 12/20] 10.222.0.26 () {62 vars in 1205 bytes} [Sat Oct 8 20:51:38 2022] POST /compute/v2.1/os-aggregates => generated 245 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 08 20:51:38.145544 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-e26900b5-158b-408a-bf9f-eddae83731a2 tempest-HypervisorAdminNegativeUnderV252Test-1360949025 tempest-HypervisorAdminNegativeUnderV252Test-1360949025-project] Calling method '.version_select at 0x7f1a8d8f4d30>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:51:38.148434 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-e26900b5-158b-408a-bf9f-eddae83731a2 tempest-HypervisorAdminNegativeUnderV252Test-1360949025 tempest-HypervisorAdminNegativeUnderV252Test-1360949025-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': '2e4e944ad6104c7ebb9fbdccc45818ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47654280a88d4269a3289e9acf6d005b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:51:38.150798 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-e26900b5-158b-408a-bf9f-eddae83731a2 tempest-HypervisorAdminNegativeUnderV252Test-1360949025 tempest-HypervisorAdminNegativeUnderV252Test-1360949025-project] Request method failure captured: Oct 08 20:51:38.150798 ncdv-master-1 devstack@n-api.service[140491]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Oct 08 20:51:38.150798 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 20:51:38.150798 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 20:51:38.150798 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 20:51:38.150798 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 20:51:38.150798 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 20:51:38.150798 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 20:51:38.150798 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 20:51:38.150798 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 20:51:38.150798 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeLVol-0toC3YSSLVS5dySO1dTu6S5ve57EII58TyjfD1kQhqE9D4eQmJ1T_8ulWBk5M6tPEsjP48piskAbpRZhXZiVdDHsZuzwlVWBMahllarj47FJYZLoANe-RWXpabVDMu7zyt5b1Ysg5CCPXuoKOeT4crs2pfcsZIN9bJhgiE0U Oct 08 20:51:38.150798 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 20:51:38.150798 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 20:51:38.150798 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 20:51:38.150798 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 20:51:38.150798 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 20:51:38.150798 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 20:51:38.150798 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 47654280a88d4269a3289e9acf6d005b Oct 08 20:51:38.150798 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1360949025 Oct 08 20:51:38.150798 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 20:51:38.150798 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 20:51:38.152141 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/47654280a88d4269a3289e9acf6d005b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/47654280a88d4269a3289e9acf6d005b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_47654280a88d4269a3289e9acf6d005b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/47654280a88d4269a3289e9acf6d005b"}]}] Oct 08 20:51:38.152141 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1360949025 Oct 08 20:51:38.152141 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 47654280a88d4269a3289e9acf6d005b Oct 08 20:51:38.152141 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1360949025 Oct 08 20:51:38.152141 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1360949025-project Oct 08 20:51:38.152141 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 20:51:38.152141 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 20:51:38.152141 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 2e4e944ad6104c7ebb9fbdccc45818ee Oct 08 20:51:38.152141 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1360949025-project Oct 08 20:51:38.152141 ncdv-master-1 devstack@n-api.service[140491]: method: Oct 08 20:51:38.152141 ncdv-master-1 devstack@n-api.service[140491]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 08 20:51:38.152141 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': '1'} Oct 08 20:51:38.152921 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:51:38.152921 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:51:38.152921 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:51:38.152921 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:51:38.152921 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:51:38.152921 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:51:38.152921 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 08 20:51:38.152921 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 08 20:51:38.152921 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:51:38.152921 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:51:38.152921 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Oct 08 20:51:38.152921 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Oct 08 20:51:38.152921 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 08 20:51:38.152921 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 08 20:51:38.152921 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 08 20:51:38.152921 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 08 20:51:38.152921 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 08 20:51:38.152921 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 08 20:51:38.152921 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 08 20:51:38.154181 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise self.value Oct 08 20:51:38.154181 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 08 20:51:38.154181 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 08 20:51:38.154181 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 08 20:51:38.154181 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 08 20:51:38.154181 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 08 20:51:38.154181 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 08 20:51:38.154181 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 08 20:51:38.154181 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:51:38.154181 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:51:38.154181 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:51:38.154181 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:51:38.154181 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:51:38.154181 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:51:38.154181 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 08 20:51:38.154181 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 08 20:51:38.154181 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 08 20:51:38.154181 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:51:38.157841 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-e26900b5-158b-408a-bf9f-eddae83731a2 tempest-HypervisorAdminNegativeUnderV252Test-1360949025 tempest-HypervisorAdminNegativeUnderV252Test-1360949025-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:51:38.159013 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-e26900b5-158b-408a-bf9f-eddae83731a2 tempest-HypervisorAdminNegativeUnderV252Test-1360949025 tempest-HypervisorAdminNegativeUnderV252Test-1360949025-project] 10.222.0.26 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.018285 Oct 08 20:51:38.159641 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 13/21] 10.222.0.26 () {58 vars in 1176 bytes} [Sat Oct 8 20:51:38 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 08 20:51:38.238607 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-be254fe6-4fbe-4b02-b8cb-9ee0b915d61e tempest-FlavorsAccessNegativeTestJSON-459130796 tempest-FlavorsAccessNegativeTestJSON-459130796-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors/1259204769/action" status: 200 len: 97 microversion: 2.1 time: 0.352755 Oct 08 20:51:38.241599 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 9/22] 10.222.0.26 () {60 vars in 1200 bytes} [Sat Oct 8 20:51:37 2022] POST /compute/v2.1/flavors/1259204769/action => generated 97 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 08 20:51:38.258297 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-2a4059e9-0a30-4659-83d7-42a547acad04 tempest-AggregatesAdminTestV241-206114750 tempest-AggregatesAdminTestV241-206114750-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-357560755"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:51:38.386438 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-2a4059e9-0a30-4659-83d7-42a547acad04 tempest-AggregatesAdminTestV241-206114750 tempest-AggregatesAdminTestV241-206114750-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-aggregates/3" status: 200 len: 298 microversion: 2.41 time: 0.145831 Oct 08 20:51:38.387522 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 10/23] 10.222.0.26 () {62 vars in 1210 bytes} [Sat Oct 8 20:51:38 2022] PUT /compute/v2.1/os-aggregates/3 => generated 298 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 08 20:51:38.394400 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-2bb7ec1b-c096-406d-97eb-8415cdca0b5c tempest-HypervisorAdminNegativeUnderV252Test-531944581 tempest-HypervisorAdminNegativeUnderV252Test-531944581-project-admin] Calling method '.version_select at 0x7f1a8e2ff5e0>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:51:38.396173 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2bb7ec1b-c096-406d-97eb-8415cdca0b5c tempest-HypervisorAdminNegativeUnderV252Test-531944581 tempest-HypervisorAdminNegativeUnderV252Test-531944581-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:51:38.396665 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2bb7ec1b-c096-406d-97eb-8415cdca0b5c tempest-HypervisorAdminNegativeUnderV252Test-531944581 tempest-HypervisorAdminNegativeUnderV252Test-531944581-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:51:38.397338 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2bb7ec1b-c096-406d-97eb-8415cdca0b5c tempest-HypervisorAdminNegativeUnderV252Test-531944581 tempest-HypervisorAdminNegativeUnderV252Test-531944581-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:51:38.411356 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-2bb7ec1b-c096-406d-97eb-8415cdca0b5c tempest-HypervisorAdminNegativeUnderV252Test-531944581 tempest-HypervisorAdminNegativeUnderV252Test-531944581-project-admin] HTTP exception thrown: No hypervisor matching '8f190dbe-74a4-44e5-9cb5-8dd7b71b6632' could be found. Oct 08 20:51:38.413023 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-2bb7ec1b-c096-406d-97eb-8415cdca0b5c tempest-HypervisorAdminNegativeUnderV252Test-531944581 tempest-HypervisorAdminNegativeUnderV252Test-531944581-project-admin] Request method failure captured: Oct 08 20:51:38.413023 ncdv-master-1 devstack@n-api.service[140492]: request: GET /compute/v2.1/os-hypervisors/8f190dbe-74a4-44e5-9cb5-8dd7b71b6632/servers HTTP/1.1 Oct 08 20:51:38.413023 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 20:51:38.413023 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 20:51:38.413023 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 20:51:38.413023 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 20:51:38.413023 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 20:51:38.413023 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 20:51:38.413023 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 20:51:38.413023 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 20:51:38.413023 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeLYex16HSyDn_VNgisxYKVEmuyHGTCRCQmyll4Fthoo9ZPEKFtzNJ5o-VxVmWQuoORe9za_OEn-TsyFoy1nAWU6s-kv7hDbd4xoR7meWKavBxHXvQl8fm08ed4wdUeYn0HRnw767cifQ0ZVEY0ptaI9aJRmuxekAuIeIfyPiW3yiXM Oct 08 20:51:38.413023 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 20:51:38.413023 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 20:51:38.413023 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 20:51:38.413023 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 20:51:38.413023 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 20:51:38.413023 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 20:51:38.413023 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 7b1a2053ff2a4aecaabdb5995bb73eac Oct 08 20:51:38.413023 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-531944581 Oct 08 20:51:38.413023 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,admin,member Oct 08 20:51:38.413023 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,admin,member Oct 08 20:51:38.414267 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/7b1a2053ff2a4aecaabdb5995bb73eac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7b1a2053ff2a4aecaabdb5995bb73eac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_7b1a2053ff2a4aecaabdb5995bb73eac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7b1a2053ff2a4aecaabdb5995bb73eac"}]}] Oct 08 20:51:38.414267 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-531944581 Oct 08 20:51:38.414267 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 7b1a2053ff2a4aecaabdb5995bb73eac Oct 08 20:51:38.414267 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-531944581 Oct 08 20:51:38.414267 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-531944581-project-admin Oct 08 20:51:38.414267 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 20:51:38.414267 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 20:51:38.414267 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 8ca491afc0a64f31a14c46178f9210f2 Oct 08 20:51:38.414267 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-531944581-project-admin Oct 08 20:51:38.414267 ncdv-master-1 devstack@n-api.service[140492]: method: Oct 08 20:51:38.414267 ncdv-master-1 devstack@n-api.service[140492]: exception: No hypervisor matching '8f190dbe-74a4-44e5-9cb5-8dd7b71b6632' could be found. Oct 08 20:51:38.414267 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': '8f190dbe-74a4-44e5-9cb5-8dd7b71b6632'} Oct 08 20:51:38.414949 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:51:38.414949 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:51:38.414949 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:51:38.414949 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:51:38.414949 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:51:38.414949 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:51:38.414949 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 08 20:51:38.414949 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 08 20:51:38.414949 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:51:38.414949 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:51:38.414949 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Oct 08 20:51:38.414949 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Oct 08 20:51:38.414949 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Oct 08 20:51:38.414949 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 08 20:51:38.414949 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching '8f190dbe-74a4-44e5-9cb5-8dd7b71b6632' could be found. Oct 08 20:51:38.414949 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:51:38.414949 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:51:38.414949 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:51:38.414949 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:51:38.416644 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:51:38.416644 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:51:38.416644 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 20:51:38.416644 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 20:51:38.416644 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching '8f190dbe-74a4-44e5-9cb5-8dd7b71b6632' could be found. Oct 08 20:51:38.416644 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:51:38.416644 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-2bb7ec1b-c096-406d-97eb-8415cdca0b5c tempest-HypervisorAdminNegativeUnderV252Test-531944581 tempest-HypervisorAdminNegativeUnderV252Test-531944581-project-admin] Returning 404 to user: No hypervisor matching '8f190dbe-74a4-44e5-9cb5-8dd7b71b6632' could be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:51:38.416644 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-2bb7ec1b-c096-406d-97eb-8415cdca0b5c tempest-HypervisorAdminNegativeUnderV252Test-531944581 tempest-HypervisorAdminNegativeUnderV252Test-531944581-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors/8f190dbe-74a4-44e5-9cb5-8dd7b71b6632/servers" status: 404 len: 123 microversion: 2.1 time: 0.025861 Oct 08 20:51:38.416644 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 11/24] 10.222.0.26 () {58 vars in 1281 bytes} [Sat Oct 8 20:51:38 2022] GET /compute/v2.1/os-hypervisors/8f190dbe-74a4-44e5-9cb5-8dd7b71b6632/servers => generated 123 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 20:51:38.420647 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-13c485b3-9b96-4a05-91cc-ef005de827f3 tempest-FlavorsAccessNegativeTestJSON-459130796 tempest-FlavorsAccessNegativeTestJSON-459130796-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "0eae5cc31fc7412292ec30a394e28863"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:51:38.447750 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-18ff3221-087a-47f2-b1c7-c0bbf544c80c tempest-AggregatesAdminNegativeTestJSON-113134079 tempest-AggregatesAdminNegativeTestJSON-113134079-project] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:51:38.451202 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-18ff3221-087a-47f2-b1c7-c0bbf544c80c tempest-AggregatesAdminNegativeTestJSON-113134079 tempest-AggregatesAdminNegativeTestJSON-113134079-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': '9fcee064c12e41079f451f88ab235dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00af80afb88c49e9b6eba209af379f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:51:38.453604 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-18ff3221-087a-47f2-b1c7-c0bbf544c80c tempest-AggregatesAdminNegativeTestJSON-113134079 tempest-AggregatesAdminNegativeTestJSON-113134079-project] Request method failure captured: Oct 08 20:51:38.453604 ncdv-master-1 devstack@n-api.service[140491]: request: POST /compute/v2.1/os-aggregates/2/action HTTP/1.1 Oct 08 20:51:38.453604 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 20:51:38.453604 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 20:51:38.453604 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 20:51:38.453604 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 39 Oct 08 20:51:38.453604 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 20:51:38.453604 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 20:51:38.453604 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 20:51:38.453604 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 20:51:38.453604 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeLUREvKeYo7wAJnL0QSDolnV1B5HA8V32JgA2fiX6-vMH6WsYDiB4nhQ-xmB7y1MNkFvlDER0YqifcNn-GMvFL3JCHHsMCvEaoWrzKvFN1F90AZ-As1gaYK1oEk4cPK3clBrOSdMfKaxB6GLfpwQuvk4RscKYx_Abd9f9p1tNKLL2k Oct 08 20:51:38.453604 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 20:51:38.453604 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 20:51:38.453604 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 20:51:38.453604 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 20:51:38.453604 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 20:51:38.453604 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 20:51:38.453604 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 00af80afb88c49e9b6eba209af379f30 Oct 08 20:51:38.453604 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-113134079 Oct 08 20:51:38.453604 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 20:51:38.453604 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 20:51:38.454690 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/00af80afb88c49e9b6eba209af379f30"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/00af80afb88c49e9b6eba209af379f30"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_00af80afb88c49e9b6eba209af379f30"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/00af80afb88c49e9b6eba209af379f30"}]}] Oct 08 20:51:38.454690 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-113134079 Oct 08 20:51:38.454690 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 00af80afb88c49e9b6eba209af379f30 Oct 08 20:51:38.454690 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-113134079 Oct 08 20:51:38.454690 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-AggregatesAdminNegativeTestJSON-113134079-project Oct 08 20:51:38.454690 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 20:51:38.454690 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 20:51:38.454690 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 9fcee064c12e41079f451f88ab235dde Oct 08 20:51:38.454690 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-113134079-project Oct 08 20:51:38.454690 ncdv-master-1 devstack@n-api.service[140491]: Oct 08 20:51:38.454690 ncdv-master-1 devstack@n-api.service[140491]: {"add_host": {"host": "nch2-master-1"}} Oct 08 20:51:38.454690 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 20:51:38.454690 ncdv-master-1 devstack@n-api.service[140491]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 08 20:51:38.455388 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': '2', 'body': {'add_host': {'host': 'nch2-master-1'}}} Oct 08 20:51:38.455388 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:51:38.455388 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:51:38.455388 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:51:38.455388 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:51:38.455388 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:51:38.455388 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:51:38.455388 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:51:38.455388 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:51:38.455388 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 20:51:38.455388 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 20:51:38.455388 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Oct 08 20:51:38.455388 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Oct 08 20:51:38.455388 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 08 20:51:38.455388 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 08 20:51:38.455388 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 08 20:51:38.455388 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 08 20:51:38.455388 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 08 20:51:38.455388 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 08 20:51:38.456314 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 08 20:51:38.456314 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise self.value Oct 08 20:51:38.456314 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 08 20:51:38.456314 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 08 20:51:38.456314 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 08 20:51:38.456314 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 08 20:51:38.456314 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 08 20:51:38.456314 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 08 20:51:38.456314 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 08 20:51:38.456314 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:51:38.456314 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:51:38.456314 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:51:38.456314 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:51:38.456314 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:51:38.456314 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:51:38.456314 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 08 20:51:38.456314 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 08 20:51:38.456314 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 08 20:51:38.456314 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:51:38.457336 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-18ff3221-087a-47f2-b1c7-c0bbf544c80c tempest-AggregatesAdminNegativeTestJSON-113134079 tempest-AggregatesAdminNegativeTestJSON-113134079-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:51:38.457336 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-18ff3221-087a-47f2-b1c7-c0bbf544c80c tempest-AggregatesAdminNegativeTestJSON-113134079 tempest-AggregatesAdminNegativeTestJSON-113134079-project] 10.222.0.26 "POST /compute/v2.1/os-aggregates/2/action" status: 403 len: 118 microversion: 2.1 time: 0.292883 Oct 08 20:51:38.457336 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 14/25] 10.222.0.26 () {60 vars in 1191 bytes} [Sat Oct 8 20:51:38 2022] POST /compute/v2.1/os-aggregates/2/action => generated 118 bytes in 295 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 08 20:51:38.463693 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c213239a-5bdf-4347-a59a-4e8e978893d9 tempest-AggregatesAdminTestV241-206114750 tempest-AggregatesAdminTestV241-206114750-project-admin] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:51:38.471320 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-c213239a-5bdf-4347-a59a-4e8e978893d9 tempest-AggregatesAdminTestV241-206114750 tempest-AggregatesAdminTestV241-206114750-project-admin] 10.222.0.26 "GET /compute/v2.1/os-aggregates/3" status: 200 len: 298 microversion: 2.41 time: 0.010974 Oct 08 20:51:38.471872 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 15/26] 10.222.0.26 () {60 vars in 1190 bytes} [Sat Oct 8 20:51:38 2022] GET /compute/v2.1/os-aggregates/3 => generated 298 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 08 20:51:38.491252 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-36d57163-2173-47a4-aa1e-a4ccda16aa82 tempest-AggregatesAdminNegativeTestJSON-367865409 tempest-AggregatesAdminNegativeTestJSON-367865409-project-admin] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:51:38.519896 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-36d57163-2173-47a4-aa1e-a4ccda16aa82 tempest-AggregatesAdminNegativeTestJSON-367865409 tempest-AggregatesAdminNegativeTestJSON-367865409-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.032656 Oct 08 20:51:38.519896 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 16/27] 10.222.0.26 () {58 vars in 1152 bytes} [Sat Oct 8 20:51:38 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 08 20:51:38.525092 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-1bfaa063-bfaf-4710-91a7-d11f4b944f15 tempest-AggregatesAdminTestV241-206114750 tempest-AggregatesAdminTestV241-206114750-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:51:38.536890 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1bfaa063-bfaf-4710-91a7-d11f4b944f15 tempest-AggregatesAdminTestV241-206114750 tempest-AggregatesAdminTestV241-206114750-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:51:38.537536 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1bfaa063-bfaf-4710-91a7-d11f4b944f15 tempest-AggregatesAdminTestV241-206114750 tempest-AggregatesAdminTestV241-206114750-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:51:38.538259 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1bfaa063-bfaf-4710-91a7-d11f4b944f15 tempest-AggregatesAdminTestV241-206114750 tempest-AggregatesAdminTestV241-206114750-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:51:38.663738 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-1bfaa063-bfaf-4710-91a7-d11f4b944f15 tempest-AggregatesAdminTestV241-206114750 tempest-AggregatesAdminTestV241-206114750-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 313 microversion: 2.41 time: 0.144181 Oct 08 20:51:38.664473 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 17/28] 10.222.0.26 () {62 vars in 1232 bytes} [Sat Oct 8 20:51:38 2022] POST /compute/v2.1/os-aggregates/3/action => generated 313 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 08 20:51:38.669028 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-dc12dd5d-b419-45a4-90e9-4fabe222868c tempest-AggregatesAdminNegativeTestJSON-367865409 tempest-AggregatesAdminNegativeTestJSON-367865409-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-815457971"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:51:38.673337 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.objects.aggregate [None req-dc12dd5d-b419-45a4-90e9-4fabe222868c tempest-AggregatesAdminNegativeTestJSON-367865409 tempest-AggregatesAdminNegativeTestJSON-367865409-project-admin] Generated uuid 5a5a4269-1062-4553-9bf7-8be516e82cb8 for aggregate {{(pid=140491) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 08 20:51:38.697341 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-dc12dd5d-b419-45a4-90e9-4fabe222868c tempest-AggregatesAdminNegativeTestJSON-367865409 tempest-AggregatesAdminNegativeTestJSON-367865409-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.031659 Oct 08 20:51:38.704773 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 18/29] 10.222.0.26 () {60 vars in 1164 bytes} [Sat Oct 8 20:51:38 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:51:38.704773 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-f6e79728-7f44-415a-8ada-56609577f30e tempest-AggregatesAdminTestV241-206114750 tempest-AggregatesAdminTestV241-206114750-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:51:38.715906 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f6e79728-7f44-415a-8ada-56609577f30e tempest-AggregatesAdminTestV241-206114750 tempest-AggregatesAdminTestV241-206114750-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:51:38.716401 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f6e79728-7f44-415a-8ada-56609577f30e tempest-AggregatesAdminTestV241-206114750 tempest-AggregatesAdminTestV241-206114750-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:51:38.716956 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f6e79728-7f44-415a-8ada-56609577f30e tempest-AggregatesAdminTestV241-206114750 tempest-AggregatesAdminTestV241-206114750-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:51:38.868817 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-f6e79728-7f44-415a-8ada-56609577f30e tempest-AggregatesAdminTestV241-206114750 tempest-AggregatesAdminTestV241-206114750-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 298 microversion: 2.41 time: 0.169127 Oct 08 20:51:38.870014 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 19/30] 10.222.0.26 () {62 vars in 1232 bytes} [Sat Oct 8 20:51:38 2022] POST /compute/v2.1/os-aggregates/3/action => generated 298 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 08 20:51:38.884216 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c19a40b4-3916-4ba6-931c-9f1ab3cfe556 tempest-AggregatesAdminNegativeTestJSON-367865409 tempest-AggregatesAdminNegativeTestJSON-367865409-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-1146411932"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:51:38.898079 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c19a40b4-3916-4ba6-931c-9f1ab3cfe556 tempest-AggregatesAdminNegativeTestJSON-367865409 tempest-AggregatesAdminNegativeTestJSON-367865409-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:51:38.898767 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c19a40b4-3916-4ba6-931c-9f1ab3cfe556 tempest-AggregatesAdminNegativeTestJSON-367865409 tempest-AggregatesAdminNegativeTestJSON-367865409-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:51:38.899450 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c19a40b4-3916-4ba6-931c-9f1ab3cfe556 tempest-AggregatesAdminNegativeTestJSON-367865409 tempest-AggregatesAdminNegativeTestJSON-367865409-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:51:38.910932 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c19a40b4-3916-4ba6-931c-9f1ab3cfe556 tempest-AggregatesAdminNegativeTestJSON-367865409 tempest-AggregatesAdminNegativeTestJSON-367865409-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:51:38.911621 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c19a40b4-3916-4ba6-931c-9f1ab3cfe556 tempest-AggregatesAdminNegativeTestJSON-367865409 tempest-AggregatesAdminNegativeTestJSON-367865409-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:51:38.912382 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c19a40b4-3916-4ba6-931c-9f1ab3cfe556 tempest-AggregatesAdminNegativeTestJSON-367865409 tempest-AggregatesAdminNegativeTestJSON-367865409-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:51:38.926531 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-c19a40b4-3916-4ba6-931c-9f1ab3cfe556 tempest-AggregatesAdminNegativeTestJSON-367865409 tempest-AggregatesAdminNegativeTestJSON-367865409-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-1146411932 could not be found. Oct 08 20:51:38.943127 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c19a40b4-3916-4ba6-931c-9f1ab3cfe556 tempest-AggregatesAdminNegativeTestJSON-367865409 tempest-AggregatesAdminNegativeTestJSON-367865409-project-admin] Request method failure captured: Oct 08 20:51:38.943127 ncdv-master-1 devstack@n-api.service[140491]: request: POST /compute/v2.1/os-aggregates/4/action HTTP/1.1 Oct 08 20:51:38.943127 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 20:51:38.943127 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 20:51:38.943127 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 20:51:38.943127 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 58 Oct 08 20:51:38.943127 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 20:51:38.943127 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 20:51:38.943127 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 20:51:38.943127 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 20:51:38.943127 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeLWVhqRRveDbmIUhFeBnNUCcRp0ijW8GA3slsPD4DpNY4VIrC1Obpt3PlDfNSXK8aKkF6mMCXXMjLIABKZrpIUQZ9p2WyaQLz3ViLWkIGM6mg_h9EkodYvDQieQggfjENBh1o6B10L6dVsCn80FSMaMQdp8lU263-XrTG0rHVdTG1w Oct 08 20:51:38.943127 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 20:51:38.943127 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 20:51:38.943127 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 20:51:38.943127 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 20:51:38.943127 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 20:51:38.943127 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 20:51:38.943127 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: d7e38a3e604b4b0a82db824aa872aef3 Oct 08 20:51:38.943127 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-367865409 Oct 08 20:51:38.943127 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,admin,member Oct 08 20:51:38.943127 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,admin,member Oct 08 20:51:38.944549 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d7e38a3e604b4b0a82db824aa872aef3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d7e38a3e604b4b0a82db824aa872aef3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d7e38a3e604b4b0a82db824aa872aef3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d7e38a3e604b4b0a82db824aa872aef3"}]}] Oct 08 20:51:38.944549 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-367865409 Oct 08 20:51:38.944549 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: d7e38a3e604b4b0a82db824aa872aef3 Oct 08 20:51:38.944549 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-367865409 Oct 08 20:51:38.944549 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-AggregatesAdminNegativeTestJSON-367865409-project-admin Oct 08 20:51:38.944549 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 20:51:38.944549 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 20:51:38.944549 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 27df69ae40444039af536faf5d884284 Oct 08 20:51:38.944549 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-367865409-project-admin Oct 08 20:51:38.944549 ncdv-master-1 devstack@n-api.service[140491]: Oct 08 20:51:38.944549 ncdv-master-1 devstack@n-api.service[140491]: {"add_host": {"host": "tempest-nonexist_host-1146411932"}} Oct 08 20:51:38.944549 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 20:51:38.944549 ncdv-master-1 devstack@n-api.service[140491]: exception: Compute host tempest-nonexist_host-1146411932 could not be found. Oct 08 20:51:38.945436 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': '4', 'body': {'add_host': {'host': 'tempest-nonexist_host-1146411932'}}} Oct 08 20:51:38.945436 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:51:38.945436 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:51:38.945436 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Oct 08 20:51:38.945436 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 08 20:51:38.945436 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 08 20:51:38.945436 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 08 20:51:38.945436 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 08 20:51:38.945436 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 08 20:51:38.945436 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 08 20:51:38.945436 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 08 20:51:38.945436 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 08 20:51:38.945436 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 08 20:51:38.945436 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-1146411932' is not mapped to any cell Oct 08 20:51:38.945436 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:51:38.945436 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:51:38.945436 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:51:38.945436 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:51:38.945436 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Oct 08 20:51:38.946615 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Oct 08 20:51:38.946615 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 08 20:51:38.946615 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 08 20:51:38.946615 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 08 20:51:38.946615 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:51:38.946615 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:51:38.946615 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:51:38.946615 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:51:38.946615 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Oct 08 20:51:38.946615 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Oct 08 20:51:38.946615 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 08 20:51:38.946615 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 08 20:51:38.946615 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 08 20:51:38.946615 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 08 20:51:38.946615 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 08 20:51:38.946615 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise self.value Oct 08 20:51:38.946615 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 08 20:51:38.946615 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 08 20:51:38.946615 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6621, in add_host_to_aggregate Oct 08 20:51:38.946615 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Oct 08 20:51:38.947806 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Oct 08 20:51:38.947806 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Oct 08 20:51:38.947806 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-1146411932 could not be found. Oct 08 20:51:38.947806 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:51:38.947806 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:51:38.947806 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:51:38.947806 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:51:38.947806 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:51:38.947806 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:51:38.947806 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:51:38.947806 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:51:38.947806 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:51:38.947806 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:51:38.947806 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 20:51:38.947806 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 20:51:38.947806 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Oct 08 20:51:38.947806 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 20:51:38.947806 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-1146411932 could not be found. Oct 08 20:51:38.947806 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:51:38.947806 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:51:38.947806 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:51:38.949147 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:51:38.949147 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:51:38.949147 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:51:38.949147 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 20:51:38.949147 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 20:51:38.949147 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-1146411932 could not be found. Oct 08 20:51:38.949147 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:51:38.949147 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c19a40b4-3916-4ba6-931c-9f1ab3cfe556 tempest-AggregatesAdminNegativeTestJSON-367865409 tempest-AggregatesAdminNegativeTestJSON-367865409-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-1146411932 could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:51:38.949147 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-c19a40b4-3916-4ba6-931c-9f1ab3cfe556 tempest-AggregatesAdminNegativeTestJSON-367865409 tempest-AggregatesAdminNegativeTestJSON-367865409-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates/4/action" status: 404 len: 111 microversion: 2.1 time: 0.077906 Oct 08 20:51:38.954816 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 20/31] 10.222.0.26 () {60 vars in 1191 bytes} [Sat Oct 8 20:51:38 2022] POST /compute/v2.1/os-aggregates/4/action => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 20:51:38.960303 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-dfb8a28c-fc57-4c7f-8c67-48d595ede411 tempest-AggregatesAdminTestV241-206114750 tempest-AggregatesAdminTestV241-206114750-project-admin] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:51:38.989558 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-dfb8a28c-fc57-4c7f-8c67-48d595ede411 tempest-AggregatesAdminTestV241-206114750 tempest-AggregatesAdminTestV241-206114750-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.41 time: 0.031970 Oct 08 20:51:38.995474 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 21/32] 10.222.0.26 () {60 vars in 1193 bytes} [Sat Oct 8 20:51:38 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:51:39.001037 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-13c485b3-9b96-4a05-91cc-ef005de827f3 tempest-FlavorsAccessNegativeTestJSON-459130796 tempest-FlavorsAccessNegativeTestJSON-459130796-project-admin] HTTP exception thrown: Flavor access already exists for flavor 16 and project 0eae5cc31fc7412292ec30a394e28863 combination. Oct 08 20:51:39.003990 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-9c7fa113-cb2a-477f-9993-ada28cebb31d tempest-AggregatesAdminNegativeTestJSON-367865409 tempest-AggregatesAdminNegativeTestJSON-367865409-project-admin] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:51:39.008337 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-13c485b3-9b96-4a05-91cc-ef005de827f3 tempest-FlavorsAccessNegativeTestJSON-459130796 tempest-FlavorsAccessNegativeTestJSON-459130796-project-admin] Request method failure captured: Oct 08 20:51:39.008337 ncdv-master-1 devstack@n-api.service[140492]: request: POST /compute/v2.1/flavors/1259204769/action HTTP/1.1 Oct 08 20:51:39.008337 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 20:51:39.008337 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 20:51:39.008337 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 20:51:39.008337 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 67 Oct 08 20:51:39.008337 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 20:51:39.008337 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 20:51:39.008337 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 20:51:39.008337 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 20:51:39.008337 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeLYdm2mn8FjsJOz8lf2BTMxDYH51lOZQ7fXdzkkyYZkc7J3KsW1kgbontCby0fL-MXJ3V5HTTbxk5vsFt9Gg2moDm3KtN3Anvxnly2_RUOXy-AmomZwXdcluRUzzJoCdOjq1ijlGEdcNA9mGB3IXoA-OA3FQp212Kls82kxFMfhAfc Oct 08 20:51:39.008337 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 20:51:39.008337 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 20:51:39.008337 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 20:51:39.008337 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 20:51:39.008337 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 20:51:39.008337 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 20:51:39.008337 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 82c66519e0dd4ef29876400cd42c0729 Oct 08 20:51:39.008337 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-459130796 Oct 08 20:51:39.008337 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,admin,member Oct 08 20:51:39.008337 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,admin,member Oct 08 20:51:39.009765 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/82c66519e0dd4ef29876400cd42c0729"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/82c66519e0dd4ef29876400cd42c0729"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_82c66519e0dd4ef29876400cd42c0729"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/82c66519e0dd4ef29876400cd42c0729"}]}] Oct 08 20:51:39.009765 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-459130796 Oct 08 20:51:39.009765 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 82c66519e0dd4ef29876400cd42c0729 Oct 08 20:51:39.009765 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-459130796 Oct 08 20:51:39.009765 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-FlavorsAccessNegativeTestJSON-459130796-project-admin Oct 08 20:51:39.009765 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 20:51:39.009765 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 20:51:39.009765 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 98f9c672a2164e76b458973a66b6203b Oct 08 20:51:39.009765 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-459130796-project-admin Oct 08 20:51:39.009765 ncdv-master-1 devstack@n-api.service[140492]: Oct 08 20:51:39.009765 ncdv-master-1 devstack@n-api.service[140492]: {"addTenantAccess": {"tenant": "0eae5cc31fc7412292ec30a394e28863"}} Oct 08 20:51:39.009765 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 20:51:39.010535 ncdv-master-1 devstack@n-api.service[140492]: exception: Flavor access already exists for flavor 16 and project 0eae5cc31fc7412292ec30a394e28863 combination. Oct 08 20:51:39.010535 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': '1259204769', 'body': {'addTenantAccess': {'tenant': '0eae5cc31fc7412292ec30a394e28863'}}} Oct 08 20:51:39.010535 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:51:39.010535 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:51:39.010535 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 08 20:51:39.010535 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 08 20:51:39.010535 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 08 20:51:39.010535 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 08 20:51:39.010535 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 08 20:51:39.010535 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 08 20:51:39.010535 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 08 20:51:39.010535 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 08 20:51:39.010535 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 08 20:51:39.010535 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 08 20:51:39.010535 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 08 20:51:39.010535 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi result.read() Oct 08 20:51:39.010535 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 08 20:51:39.010535 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 08 20:51:39.011614 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 08 20:51:39.011614 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 08 20:51:39.011614 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 08 20:51:39.011614 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 08 20:51:39.011614 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 08 20:51:39.011614 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 08 20:51:39.011614 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '16-0eae5cc31fc7412292ec30a394e28863' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Oct 08 20:51:39.011614 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:51:39.011614 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 08 20:51:39.011614 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:51:39.011614 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:51:39.011614 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Oct 08 20:51:39.011614 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi project.save(context.session) Oct 08 20:51:39.011614 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 08 20:51:39.011614 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi session.flush() Oct 08 20:51:39.011614 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 08 20:51:39.011614 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 08 20:51:39.011614 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 08 20:51:39.011614 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 08 20:51:39.012773 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 08 20:51:39.012773 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 08 20:51:39.012773 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 08 20:51:39.012773 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception Oct 08 20:51:39.012773 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 08 20:51:39.012773 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 08 20:51:39.012773 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 08 20:51:39.012773 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 08 20:51:39.012773 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 08 20:51:39.012773 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 08 20:51:39.012773 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 08 20:51:39.012773 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 08 20:51:39.012773 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 08 20:51:39.012773 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 08 20:51:39.012773 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 08 20:51:39.012773 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 08 20:51:39.012773 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 08 20:51:39.012773 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 08 20:51:39.014295 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 08 20:51:39.014295 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 08 20:51:39.014295 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 08 20:51:39.014295 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 08 20:51:39.014295 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 08 20:51:39.014295 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 08 20:51:39.014295 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 08 20:51:39.014295 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception Oct 08 20:51:39.014295 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 08 20:51:39.014295 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 08 20:51:39.014295 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 08 20:51:39.014295 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 08 20:51:39.014295 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 08 20:51:39.014295 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 08 20:51:39.014295 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 08 20:51:39.014295 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 08 20:51:39.014295 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 08 20:51:39.014295 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 08 20:51:39.016310 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 08 20:51:39.016310 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi result.read() Oct 08 20:51:39.016310 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 08 20:51:39.016310 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 08 20:51:39.016310 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 08 20:51:39.016310 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 08 20:51:39.016310 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 08 20:51:39.016310 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 08 20:51:39.016310 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 08 20:51:39.016310 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 08 20:51:39.016310 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '16-0eae5cc31fc7412292ec30a394e28863' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Oct 08 20:51:39.016310 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Oct 08 20:51:39.016310 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 8, 20, 51, 38, 992662), 'updated_at': None, 'flavor_id': 16, 'project_id': '0eae5cc31fc7412292ec30a394e28863'}] Oct 08 20:51:39.016310 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 08 20:51:39.016310 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:51:39.016310 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:51:39.016310 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:51:39.020809 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:51:39.020809 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Oct 08 20:51:39.020809 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Oct 08 20:51:39.020809 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 08 20:51:39.020809 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 08 20:51:39.020809 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Oct 08 20:51:39.020809 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Oct 08 20:51:39.020809 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Oct 08 20:51:39.020809 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Oct 08 20:51:39.020809 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Oct 08 20:51:39.020809 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Oct 08 20:51:39.020809 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 08 20:51:39.020809 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 08 20:51:39.020809 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Oct 08 20:51:39.020809 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Oct 08 20:51:39.020809 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 16 and project 0eae5cc31fc7412292ec30a394e28863 combination. Oct 08 20:51:39.020809 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:51:39.020809 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:51:39.020809 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:51:39.022315 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:51:39.022315 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:51:39.022315 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:51:39.022315 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:51:39.022315 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:51:39.022315 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:51:39.022315 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:51:39.022315 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 20:51:39.022315 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 20:51:39.022315 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Oct 08 20:51:39.022315 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Oct 08 20:51:39.022315 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 16 and project 0eae5cc31fc7412292ec30a394e28863 combination. Oct 08 20:51:39.022315 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:51:39.022315 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:51:39.022315 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:51:39.022315 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:51:39.022315 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:51:39.022315 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:51:39.022315 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 20:51:39.022315 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 20:51:39.023439 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 16 and project 0eae5cc31fc7412292ec30a394e28863 combination. Oct 08 20:51:39.023439 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:51:39.023439 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-13c485b3-9b96-4a05-91cc-ef005de827f3 tempest-FlavorsAccessNegativeTestJSON-459130796 tempest-FlavorsAccessNegativeTestJSON-459130796-project-admin] Returning 409 to user: Flavor access already exists for flavor 16 and project 0eae5cc31fc7412292ec30a394e28863 combination. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:51:39.023439 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-13c485b3-9b96-4a05-91cc-ef005de827f3 tempest-FlavorsAccessNegativeTestJSON-459130796 tempest-FlavorsAccessNegativeTestJSON-459130796-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors/1259204769/action" status: 409 len: 152 microversion: 2.1 time: 0.603654 Oct 08 20:51:39.023439 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 12/33] 10.222.0.26 () {60 vars in 1200 bytes} [Sat Oct 8 20:51:38 2022] POST /compute/v2.1/flavors/1259204769/action => generated 152 bytes in 605 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 08 20:51:39.037026 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-9c7fa113-cb2a-477f-9993-ada28cebb31d tempest-AggregatesAdminNegativeTestJSON-367865409 tempest-AggregatesAdminNegativeTestJSON-367865409-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.040433 Oct 08 20:51:39.041705 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 22/34] 10.222.0.26 () {58 vars in 1152 bytes} [Sat Oct 8 20:51:38 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 08 20:51:39.042907 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-53647cab-a00c-40b4-893f-fbbe6d162976 tempest-FlavorsAccessNegativeTestJSON-459130796 tempest-FlavorsAccessNegativeTestJSON-459130796-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "0eae5cc31fc7412292ec30a394e28863"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:51:39.048338 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-010514cc-f05c-49f1-b633-f1ba4fc83e39 tempest-AggregatesAdminNegativeTestJSON-367865409 tempest-AggregatesAdminNegativeTestJSON-367865409-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:51:39.060168 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-010514cc-f05c-49f1-b633-f1ba4fc83e39 tempest-AggregatesAdminNegativeTestJSON-367865409 tempest-AggregatesAdminNegativeTestJSON-367865409-project-admin] Request method failure captured: Oct 08 20:51:39.060168 ncdv-master-1 devstack@n-api.service[140491]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 08 20:51:39.060168 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 20:51:39.060168 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 20:51:39.060168 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 20:51:39.060168 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 283 Oct 08 20:51:39.060168 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 20:51:39.060168 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 20:51:39.060168 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 20:51:39.060168 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 20:51:39.060168 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeLWVhqRRveDbmIUhFeBnNUCcRp0ijW8GA3slsPD4DpNY4VIrC1Obpt3PlDfNSXK8aKkF6mMCXXMjLIABKZrpIUQZ9p2WyaQLz3ViLWkIGM6mg_h9EkodYvDQieQggfjENBh1o6B10L6dVsCn80FSMaMQdp8lU263-XrTG0rHVdTG1w Oct 08 20:51:39.060168 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 20:51:39.060168 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 20:51:39.060168 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 20:51:39.060168 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 20:51:39.060168 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 20:51:39.060168 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 20:51:39.060168 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: d7e38a3e604b4b0a82db824aa872aef3 Oct 08 20:51:39.060168 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-367865409 Oct 08 20:51:39.060168 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,admin,member Oct 08 20:51:39.060168 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,admin,member Oct 08 20:51:39.062898 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d7e38a3e604b4b0a82db824aa872aef3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d7e38a3e604b4b0a82db824aa872aef3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d7e38a3e604b4b0a82db824aa872aef3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d7e38a3e604b4b0a82db824aa872aef3"}]}] Oct 08 20:51:39.062898 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-367865409 Oct 08 20:51:39.062898 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: d7e38a3e604b4b0a82db824aa872aef3 Oct 08 20:51:39.062898 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-367865409 Oct 08 20:51:39.062898 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-AggregatesAdminNegativeTestJSON-367865409-project-admin Oct 08 20:51:39.062898 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 20:51:39.062898 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 20:51:39.062898 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 27df69ae40444039af536faf5d884284 Oct 08 20:51:39.062898 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-367865409-project-admin Oct 08 20:51:39.062898 ncdv-master-1 devstack@n-api.service[140491]: Oct 08 20:51:39.063565 ncdv-master-1 devstack@n-api.service[140491]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 08 20:51:39.063565 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 20:51:39.063565 ncdv-master-1 devstack@n-api.service[140491]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 08 20:51:39.063565 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 08 20:51:39.063565 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:51:39.063565 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:51:39.063565 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 08 20:51:39.063565 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 08 20:51:39.063565 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 08 20:51:39.063565 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise error Oct 08 20:51:39.064228 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 08 20:51:39.064228 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:51:39.064228 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Oct 08 20:51:39.064228 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 08 20:51:39.064228 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:51:39.064228 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Oct 08 20:51:39.064228 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 08 20:51:39.064228 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:51:39.064228 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:51:39.064228 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:51:39.064228 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:51:39.064228 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:51:39.064228 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:51:39.064228 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:51:39.064228 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:51:39.064228 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:51:39.064228 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:51:39.065330 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 20:51:39.065330 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 20:51:39.065330 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 08 20:51:39.065330 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 08 20:51:39.065330 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 08 20:51:39.065330 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 08 20:51:39.065330 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 08 20:51:39.065330 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 08 20:51:39.065330 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 08 20:51:39.065330 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:51:39.065330 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:51:39.065330 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:51:39.065330 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:51:39.065330 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:51:39.065330 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:51:39.066344 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 08 20:51:39.066344 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 08 20:51:39.066344 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 08 20:51:39.066344 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:51:39.066344 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-010514cc-f05c-49f1-b633-f1ba4fc83e39 tempest-AggregatesAdminNegativeTestJSON-367865409 tempest-AggregatesAdminNegativeTestJSON-367865409-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:51:39.066696 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-010514cc-f05c-49f1-b633-f1ba4fc83e39 tempest-AggregatesAdminNegativeTestJSON-367865409 tempest-AggregatesAdminNegativeTestJSON-367865409-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.021127 Oct 08 20:51:39.072788 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 23/35] 10.222.0.26 () {60 vars in 1165 bytes} [Sat Oct 8 20:51:39 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 08 20:51:39.080923 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-725c0193-50c8-46dd-882e-970d386b2307 tempest-AggregatesAdminTestJSON-1599742552 tempest-AggregatesAdminTestJSON-1599742552-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1392764660", "name": "tempest-test_aggregate-1314047745"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:51:39.133327 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.objects.aggregate [None req-725c0193-50c8-46dd-882e-970d386b2307 tempest-AggregatesAdminTestJSON-1599742552 tempest-AggregatesAdminTestJSON-1599742552-project-admin] Generated uuid 1ce1e005-a4c5-4073-a161-1afdec1fd3b6 for aggregate {{(pid=140491) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 08 20:51:39.138752 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=8,nova_api:SAVEPOINT=2,nova_api:RELEASE=2,nova_api:DELETE=10 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:51:39.181538 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-725c0193-50c8-46dd-882e-970d386b2307 tempest-AggregatesAdminTestJSON-1599742552 tempest-AggregatesAdminTestJSON-1599742552-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.107282 Oct 08 20:51:39.182153 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 24/36] 10.222.0.26 () {60 vars in 1165 bytes} [Sat Oct 8 20:51:39 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:51:39.188508 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-e5a0d200-4c76-4b4b-be47-f03b51c69ee4 tempest-AggregatesAdminNegativeTestJSON-367865409 tempest-AggregatesAdminNegativeTestJSON-367865409-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:51:39.192879 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-e5a0d200-4c76-4b4b-be47-f03b51c69ee4 tempest-AggregatesAdminNegativeTestJSON-367865409 tempest-AggregatesAdminNegativeTestJSON-367865409-project-admin] Request method failure captured: Oct 08 20:51:39.192879 ncdv-master-1 devstack@n-api.service[140491]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 08 20:51:39.192879 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 20:51:39.192879 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 20:51:39.192879 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 20:51:39.192879 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 27 Oct 08 20:51:39.192879 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 20:51:39.192879 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 20:51:39.192879 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 20:51:39.192879 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 20:51:39.192879 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeLWVhqRRveDbmIUhFeBnNUCcRp0ijW8GA3slsPD4DpNY4VIrC1Obpt3PlDfNSXK8aKkF6mMCXXMjLIABKZrpIUQZ9p2WyaQLz3ViLWkIGM6mg_h9EkodYvDQieQggfjENBh1o6B10L6dVsCn80FSMaMQdp8lU263-XrTG0rHVdTG1w Oct 08 20:51:39.192879 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 20:51:39.192879 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 20:51:39.192879 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 20:51:39.192879 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 20:51:39.192879 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 20:51:39.192879 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 20:51:39.192879 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: d7e38a3e604b4b0a82db824aa872aef3 Oct 08 20:51:39.192879 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-367865409 Oct 08 20:51:39.192879 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,admin,member Oct 08 20:51:39.192879 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,admin,member Oct 08 20:51:39.194450 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d7e38a3e604b4b0a82db824aa872aef3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d7e38a3e604b4b0a82db824aa872aef3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d7e38a3e604b4b0a82db824aa872aef3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d7e38a3e604b4b0a82db824aa872aef3"}]}] Oct 08 20:51:39.194450 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-367865409 Oct 08 20:51:39.194450 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: d7e38a3e604b4b0a82db824aa872aef3 Oct 08 20:51:39.194450 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-367865409 Oct 08 20:51:39.194450 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-AggregatesAdminNegativeTestJSON-367865409-project-admin Oct 08 20:51:39.194450 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 20:51:39.194450 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 20:51:39.194450 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 27df69ae40444039af536faf5d884284 Oct 08 20:51:39.194450 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-367865409-project-admin Oct 08 20:51:39.194450 ncdv-master-1 devstack@n-api.service[140491]: Oct 08 20:51:39.194450 ncdv-master-1 devstack@n-api.service[140491]: {"aggregate": {"name": ""}} Oct 08 20:51:39.194450 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 20:51:39.194450 ncdv-master-1 devstack@n-api.service[140491]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 08 20:51:39.195574 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'body': {'aggregate': {'name': ''}}} Oct 08 20:51:39.195574 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:51:39.195574 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:51:39.195574 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 08 20:51:39.195574 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 08 20:51:39.195574 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 08 20:51:39.195574 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise error Oct 08 20:51:39.195574 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 08 20:51:39.195574 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:51:39.195574 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Oct 08 20:51:39.195574 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 08 20:51:39.195574 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:51:39.195574 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Oct 08 20:51:39.195574 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi '' Oct 08 20:51:39.195574 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:51:39.195574 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:51:39.195574 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:51:39.195574 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:51:39.195574 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:51:39.195574 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:51:39.195574 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:51:39.195574 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:51:39.195574 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:51:39.197092 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:51:39.197092 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 20:51:39.197092 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 20:51:39.197092 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 08 20:51:39.197092 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 08 20:51:39.197092 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 08 20:51:39.197092 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 08 20:51:39.197092 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 08 20:51:39.197092 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 08 20:51:39.197092 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 08 20:51:39.197092 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:51:39.197092 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:51:39.197092 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:51:39.197092 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:51:39.197092 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:51:39.197092 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:51:39.197092 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 08 20:51:39.197092 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 08 20:51:39.197092 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 08 20:51:39.197092 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:51:39.199322 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-e5a0d200-4c76-4b4b-be47-f03b51c69ee4 tempest-AggregatesAdminNegativeTestJSON-367865409 tempest-AggregatesAdminNegativeTestJSON-367865409-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:51:39.199322 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-e5a0d200-4c76-4b4b-be47-f03b51c69ee4 tempest-AggregatesAdminNegativeTestJSON-367865409 tempest-AggregatesAdminNegativeTestJSON-367865409-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.010656 Oct 08 20:51:39.199322 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 25/37] 10.222.0.26 () {60 vars in 1164 bytes} [Sat Oct 8 20:51:39 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 08 20:51:39.201908 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-a0614f6c-6724-44f0-af0b-a9508896dddc tempest-AggregatesAdminTestJSON-1599742552 tempest-AggregatesAdminTestJSON-1599742552-project-admin] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:51:39.215541 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-a0614f6c-6724-44f0-af0b-a9508896dddc tempest-AggregatesAdminTestJSON-1599742552 tempest-AggregatesAdminTestJSON-1599742552-project-admin] 10.222.0.26 "GET /compute/v2.1/os-aggregates" status: 200 len: 303 microversion: 2.1 time: 0.018828 Oct 08 20:51:39.216186 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 26/38] 10.222.0.26 () {58 vars in 1143 bytes} [Sat Oct 8 20:51:39 2022] GET /compute/v2.1/os-aggregates => generated 303 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:51:39.221813 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-2036a334-5ae5-4463-9f5d-aadba42b4d72 tempest-AggregatesAdminNegativeTestJSON-113134079 tempest-AggregatesAdminNegativeTestJSON-113134079-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1411968150"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:51:39.225290 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-2036a334-5ae5-4463-9f5d-aadba42b4d72 tempest-AggregatesAdminNegativeTestJSON-113134079 tempest-AggregatesAdminNegativeTestJSON-113134079-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': '9fcee064c12e41079f451f88ab235dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00af80afb88c49e9b6eba209af379f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:51:39.227306 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-2036a334-5ae5-4463-9f5d-aadba42b4d72 tempest-AggregatesAdminNegativeTestJSON-113134079 tempest-AggregatesAdminNegativeTestJSON-113134079-project] Request method failure captured: Oct 08 20:51:39.227306 ncdv-master-1 devstack@n-api.service[140491]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 08 20:51:39.227306 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 20:51:39.227306 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 20:51:39.227306 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 20:51:39.227306 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 60 Oct 08 20:51:39.227306 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 20:51:39.227306 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 20:51:39.227306 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 20:51:39.227306 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 20:51:39.227306 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeLUREvKeYo7wAJnL0QSDolnV1B5HA8V32JgA2fiX6-vMH6WsYDiB4nhQ-xmB7y1MNkFvlDER0YqifcNn-GMvFL3JCHHsMCvEaoWrzKvFN1F90AZ-As1gaYK1oEk4cPK3clBrOSdMfKaxB6GLfpwQuvk4RscKYx_Abd9f9p1tNKLL2k Oct 08 20:51:39.227306 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 20:51:39.227306 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 20:51:39.227306 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 20:51:39.227306 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 20:51:39.227306 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 20:51:39.227306 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 20:51:39.227306 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 00af80afb88c49e9b6eba209af379f30 Oct 08 20:51:39.227306 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-113134079 Oct 08 20:51:39.227306 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 20:51:39.227306 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 20:51:39.228605 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/00af80afb88c49e9b6eba209af379f30"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/00af80afb88c49e9b6eba209af379f30"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_00af80afb88c49e9b6eba209af379f30"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/00af80afb88c49e9b6eba209af379f30"}]}] Oct 08 20:51:39.228605 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-113134079 Oct 08 20:51:39.228605 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 00af80afb88c49e9b6eba209af379f30 Oct 08 20:51:39.228605 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-113134079 Oct 08 20:51:39.228605 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-AggregatesAdminNegativeTestJSON-113134079-project Oct 08 20:51:39.228605 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 20:51:39.228605 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 20:51:39.228605 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 9fcee064c12e41079f451f88ab235dde Oct 08 20:51:39.228605 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-113134079-project Oct 08 20:51:39.228605 ncdv-master-1 devstack@n-api.service[140491]: Oct 08 20:51:39.228605 ncdv-master-1 devstack@n-api.service[140491]: {"aggregate": {"name": "tempest-test_aggregate-1411968150"}} Oct 08 20:51:39.228605 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 20:51:39.228605 ncdv-master-1 devstack@n-api.service[140491]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 08 20:51:39.229554 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1411968150'}}} Oct 08 20:51:39.229554 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:51:39.229554 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:51:39.229554 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:51:39.229554 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:51:39.229554 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:51:39.229554 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:51:39.229554 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:51:39.229554 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:51:39.229554 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 20:51:39.229554 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 20:51:39.229554 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 20:51:39.229554 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 20:51:39.229554 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Oct 08 20:51:39.229554 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Oct 08 20:51:39.229554 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 08 20:51:39.229554 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 08 20:51:39.229554 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 08 20:51:39.229554 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 08 20:51:39.230761 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 08 20:51:39.230761 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 08 20:51:39.230761 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 08 20:51:39.230761 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise self.value Oct 08 20:51:39.230761 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 08 20:51:39.230761 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 08 20:51:39.230761 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 08 20:51:39.230761 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 08 20:51:39.230761 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 08 20:51:39.230761 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 08 20:51:39.230761 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 08 20:51:39.230761 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:51:39.230761 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:51:39.230761 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:51:39.230761 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:51:39.230761 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:51:39.230761 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:51:39.230761 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 08 20:51:39.230761 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 08 20:51:39.230761 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 08 20:51:39.231761 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:51:39.231761 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-2036a334-5ae5-4463-9f5d-aadba42b4d72 tempest-AggregatesAdminNegativeTestJSON-113134079 tempest-AggregatesAdminNegativeTestJSON-113134079-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:51:39.231761 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-2036a334-5ae5-4463-9f5d-aadba42b4d72 tempest-AggregatesAdminNegativeTestJSON-113134079 tempest-AggregatesAdminNegativeTestJSON-113134079-project] 10.222.0.26 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.011336 Oct 08 20:51:39.231761 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 27/39] 10.222.0.26 () {60 vars in 1164 bytes} [Sat Oct 8 20:51:39 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 12 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 08 20:51:39.236652 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-7963ccb2-15f0-4a4f-a0b3-962f1e7b627f tempest-AggregatesAdminTestJSON-1599742552 tempest-AggregatesAdminTestJSON-1599742552-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:51:39.248956 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7963ccb2-15f0-4a4f-a0b3-962f1e7b627f tempest-AggregatesAdminTestJSON-1599742552 tempest-AggregatesAdminTestJSON-1599742552-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:51:39.249492 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7963ccb2-15f0-4a4f-a0b3-962f1e7b627f tempest-AggregatesAdminTestJSON-1599742552 tempest-AggregatesAdminTestJSON-1599742552-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:51:39.250678 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7963ccb2-15f0-4a4f-a0b3-962f1e7b627f tempest-AggregatesAdminTestJSON-1599742552 tempest-AggregatesAdminTestJSON-1599742552-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:51:39.427125 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-7963ccb2-15f0-4a4f-a0b3-962f1e7b627f tempest-AggregatesAdminTestJSON-1599742552 tempest-AggregatesAdminTestJSON-1599742552-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates/5/action" status: 200 len: 315 microversion: 2.1 time: 0.196853 Oct 08 20:51:39.428183 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 28/40] 10.222.0.26 () {60 vars in 1191 bytes} [Sat Oct 8 20:51:39 2022] POST /compute/v2.1/os-aggregates/5/action => generated 315 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:51:39.433334 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-9356f2c2-6270-4776-bfd9-a1c45cbcda55 tempest-AggregatesAdminNegativeTestJSON-367865409 tempest-AggregatesAdminNegativeTestJSON-367865409-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-514395777"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:51:39.437008 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.objects.aggregate [None req-9356f2c2-6270-4776-bfd9-a1c45cbcda55 tempest-AggregatesAdminNegativeTestJSON-367865409 tempest-AggregatesAdminNegativeTestJSON-367865409-project-admin] Generated uuid 72552d58-4928-4a1a-9671-4a76d4d6597e for aggregate {{(pid=140491) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 08 20:51:39.461735 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-9356f2c2-6270-4776-bfd9-a1c45cbcda55 tempest-AggregatesAdminNegativeTestJSON-367865409 tempest-AggregatesAdminNegativeTestJSON-367865409-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.031760 Oct 08 20:51:39.463388 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 29/41] 10.222.0.26 () {60 vars in 1164 bytes} [Sat Oct 8 20:51:39 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:51:39.475036 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-613f4ccc-e156-4ab6-a171-0dfd107e3522 tempest-AggregatesAdminNegativeTestJSON-367865409 tempest-AggregatesAdminNegativeTestJSON-367865409-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-514395777"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:51:39.478665 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.objects.aggregate [None req-613f4ccc-e156-4ab6-a171-0dfd107e3522 tempest-AggregatesAdminNegativeTestJSON-367865409 tempest-AggregatesAdminNegativeTestJSON-367865409-project-admin] Generated uuid 569c774a-70c3-4308-90bb-ca729eb2de67 for aggregate {{(pid=140491) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 08 20:51:39.490702 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-613f4ccc-e156-4ab6-a171-0dfd107e3522 tempest-AggregatesAdminNegativeTestJSON-367865409 tempest-AggregatesAdminNegativeTestJSON-367865409-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-514395777 already exists. Oct 08 20:51:39.493112 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-613f4ccc-e156-4ab6-a171-0dfd107e3522 tempest-AggregatesAdminNegativeTestJSON-367865409 tempest-AggregatesAdminNegativeTestJSON-367865409-project-admin] Request method failure captured: Oct 08 20:51:39.493112 ncdv-master-1 devstack@n-api.service[140491]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 08 20:51:39.493112 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 20:51:39.493112 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 20:51:39.493112 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 20:51:39.493112 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 59 Oct 08 20:51:39.493112 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 20:51:39.493112 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 20:51:39.493112 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 20:51:39.493112 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 20:51:39.493112 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeLWVhqRRveDbmIUhFeBnNUCcRp0ijW8GA3slsPD4DpNY4VIrC1Obpt3PlDfNSXK8aKkF6mMCXXMjLIABKZrpIUQZ9p2WyaQLz3ViLWkIGM6mg_h9EkodYvDQieQggfjENBh1o6B10L6dVsCn80FSMaMQdp8lU263-XrTG0rHVdTG1w Oct 08 20:51:39.493112 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 20:51:39.493112 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 20:51:39.493112 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 20:51:39.493112 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 20:51:39.493112 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 20:51:39.493112 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 20:51:39.493112 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: d7e38a3e604b4b0a82db824aa872aef3 Oct 08 20:51:39.493112 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-367865409 Oct 08 20:51:39.493112 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,admin,member Oct 08 20:51:39.493112 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,admin,member Oct 08 20:51:39.494369 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d7e38a3e604b4b0a82db824aa872aef3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d7e38a3e604b4b0a82db824aa872aef3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d7e38a3e604b4b0a82db824aa872aef3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d7e38a3e604b4b0a82db824aa872aef3"}]}] Oct 08 20:51:39.494369 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-367865409 Oct 08 20:51:39.494369 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: d7e38a3e604b4b0a82db824aa872aef3 Oct 08 20:51:39.494369 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-367865409 Oct 08 20:51:39.494369 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-AggregatesAdminNegativeTestJSON-367865409-project-admin Oct 08 20:51:39.494369 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 20:51:39.494369 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 20:51:39.494369 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 27df69ae40444039af536faf5d884284 Oct 08 20:51:39.494369 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-367865409-project-admin Oct 08 20:51:39.494369 ncdv-master-1 devstack@n-api.service[140491]: Oct 08 20:51:39.494369 ncdv-master-1 devstack@n-api.service[140491]: {"aggregate": {"name": "tempest-test_aggregate-514395777"}} Oct 08 20:51:39.494369 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 20:51:39.494369 ncdv-master-1 devstack@n-api.service[140491]: exception: Aggregate tempest-test_aggregate-514395777 already exists. Oct 08 20:51:39.495028 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-514395777'}}} Oct 08 20:51:39.495028 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:51:39.495028 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:51:39.495028 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Oct 08 20:51:39.495028 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Oct 08 20:51:39.495028 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 08 20:51:39.495028 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 08 20:51:39.495028 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 08 20:51:39.495028 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 08 20:51:39.495028 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 08 20:51:39.495028 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise self.value Oct 08 20:51:39.495028 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 08 20:51:39.495028 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 08 20:51:39.495028 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6458, in create_aggregate Oct 08 20:51:39.495028 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi aggregate.create() Oct 08 20:51:39.495028 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 08 20:51:39.495028 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 08 20:51:39.495028 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Oct 08 20:51:39.495028 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Oct 08 20:51:39.495949 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 08 20:51:39.495949 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 08 20:51:39.495949 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Oct 08 20:51:39.495949 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Oct 08 20:51:39.495949 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-514395777 already exists. Oct 08 20:51:39.495949 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:51:39.495949 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:51:39.495949 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:51:39.495949 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:51:39.495949 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:51:39.495949 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:51:39.495949 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:51:39.495949 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:51:39.495949 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:51:39.495949 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:51:39.495949 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 20:51:39.495949 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 20:51:39.495949 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 20:51:39.495949 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 20:51:39.495949 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Oct 08 20:51:39.496962 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Oct 08 20:51:39.496962 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-514395777 already exists. Oct 08 20:51:39.496962 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:51:39.496962 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:51:39.496962 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:51:39.496962 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:51:39.496962 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:51:39.496962 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:51:39.496962 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 20:51:39.496962 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 20:51:39.496962 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-514395777 already exists. Oct 08 20:51:39.496962 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:51:39.499377 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-613f4ccc-e156-4ab6-a171-0dfd107e3522 tempest-AggregatesAdminNegativeTestJSON-367865409 tempest-AggregatesAdminNegativeTestJSON-367865409-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-514395777 already exists. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:51:39.501116 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-613f4ccc-e156-4ab6-a171-0dfd107e3522 tempest-AggregatesAdminNegativeTestJSON-367865409 tempest-AggregatesAdminNegativeTestJSON-367865409-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates" status: 409 len: 110 microversion: 2.1 time: 0.030404 Oct 08 20:51:39.506154 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 30/42] 10.222.0.26 () {60 vars in 1164 bytes} [Sat Oct 8 20:51:39 2022] POST /compute/v2.1/os-aggregates => generated 110 bytes in 35 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 08 20:51:39.512424 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-640d2af2-cdce-48e7-8b0c-19668d03e22c tempest-AggregatesAdminNegativeTestJSON-367865409 tempest-AggregatesAdminNegativeTestJSON-367865409-project-admin] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:51:39.541435 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-640d2af2-cdce-48e7-8b0c-19668d03e22c tempest-AggregatesAdminNegativeTestJSON-367865409 tempest-AggregatesAdminNegativeTestJSON-367865409-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.033120 Oct 08 20:51:39.543771 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 31/43] 10.222.0.26 () {58 vars in 1152 bytes} [Sat Oct 8 20:51:39 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 08 20:51:39.554081 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-67e8745f-44da-4df8-90af-9af6dc5fad00 tempest-AggregatesAdminNegativeTestJSON-367865409 tempest-AggregatesAdminNegativeTestJSON-367865409-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-931465426"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:51:39.557753 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.objects.aggregate [None req-67e8745f-44da-4df8-90af-9af6dc5fad00 tempest-AggregatesAdminNegativeTestJSON-367865409 tempest-AggregatesAdminNegativeTestJSON-367865409-project-admin] Generated uuid a3736d7d-4215-437c-8b1e-bb7d0b702909 for aggregate {{(pid=140491) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 08 20:51:39.596679 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-67e8745f-44da-4df8-90af-9af6dc5fad00 tempest-AggregatesAdminNegativeTestJSON-367865409 tempest-AggregatesAdminNegativeTestJSON-367865409-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.046463 Oct 08 20:51:39.603720 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 32/44] 10.222.0.26 () {60 vars in 1164 bytes} [Sat Oct 8 20:51:39 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:51:39.613513 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-37a2a7fa-222b-4438-afda-229e241af01c tempest-AggregatesAdminNegativeTestJSON-113134079 tempest-AggregatesAdminNegativeTestJSON-113134079-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:51:39.615591 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-37a2a7fa-222b-4438-afda-229e241af01c tempest-AggregatesAdminNegativeTestJSON-113134079 tempest-AggregatesAdminNegativeTestJSON-113134079-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': '9fcee064c12e41079f451f88ab235dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00af80afb88c49e9b6eba209af379f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:51:39.617339 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-37a2a7fa-222b-4438-afda-229e241af01c tempest-AggregatesAdminNegativeTestJSON-113134079 tempest-AggregatesAdminNegativeTestJSON-113134079-project] Request method failure captured: Oct 08 20:51:39.617339 ncdv-master-1 devstack@n-api.service[140491]: request: DELETE /compute/v2.1/os-aggregates/7 HTTP/1.1 Oct 08 20:51:39.617339 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 20:51:39.617339 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 20:51:39.617339 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 20:51:39.617339 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 20:51:39.617339 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 20:51:39.617339 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 20:51:39.617339 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 20:51:39.617339 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 20:51:39.617339 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeLUREvKeYo7wAJnL0QSDolnV1B5HA8V32JgA2fiX6-vMH6WsYDiB4nhQ-xmB7y1MNkFvlDER0YqifcNn-GMvFL3JCHHsMCvEaoWrzKvFN1F90AZ-As1gaYK1oEk4cPK3clBrOSdMfKaxB6GLfpwQuvk4RscKYx_Abd9f9p1tNKLL2k Oct 08 20:51:39.617339 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 20:51:39.617339 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 20:51:39.617339 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 20:51:39.617339 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 20:51:39.617339 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 20:51:39.617339 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 20:51:39.617339 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 00af80afb88c49e9b6eba209af379f30 Oct 08 20:51:39.617339 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-113134079 Oct 08 20:51:39.617339 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 20:51:39.617339 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 20:51:39.618492 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/00af80afb88c49e9b6eba209af379f30"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/00af80afb88c49e9b6eba209af379f30"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_00af80afb88c49e9b6eba209af379f30"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/00af80afb88c49e9b6eba209af379f30"}]}] Oct 08 20:51:39.618492 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-113134079 Oct 08 20:51:39.618492 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 00af80afb88c49e9b6eba209af379f30 Oct 08 20:51:39.618492 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-113134079 Oct 08 20:51:39.618492 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-AggregatesAdminNegativeTestJSON-113134079-project Oct 08 20:51:39.618492 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 20:51:39.618492 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 20:51:39.618492 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 9fcee064c12e41079f451f88ab235dde Oct 08 20:51:39.618492 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-113134079-project Oct 08 20:51:39.618492 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 20:51:39.618492 ncdv-master-1 devstack@n-api.service[140491]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 08 20:51:39.618492 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': '7'} Oct 08 20:51:39.619093 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:51:39.619093 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:51:39.619093 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:51:39.619093 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:51:39.619093 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:51:39.619093 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:51:39.619093 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:51:39.619093 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:51:39.619093 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Oct 08 20:51:39.619093 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Oct 08 20:51:39.619093 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 08 20:51:39.619093 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 08 20:51:39.619093 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 08 20:51:39.619093 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 08 20:51:39.619093 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 08 20:51:39.619093 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 08 20:51:39.619093 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 08 20:51:39.619093 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise self.value Oct 08 20:51:39.619093 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 08 20:51:39.620020 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 08 20:51:39.620020 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 08 20:51:39.620020 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 08 20:51:39.620020 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 08 20:51:39.620020 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 08 20:51:39.620020 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 08 20:51:39.620020 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:51:39.620020 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:51:39.620020 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:51:39.620020 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:51:39.620020 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:51:39.620020 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:51:39.620020 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 08 20:51:39.620020 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 08 20:51:39.620020 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 08 20:51:39.620020 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:51:39.620020 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-37a2a7fa-222b-4438-afda-229e241af01c tempest-AggregatesAdminNegativeTestJSON-113134079 tempest-AggregatesAdminNegativeTestJSON-113134079-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:51:39.620873 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-37a2a7fa-222b-4438-afda-229e241af01c tempest-AggregatesAdminNegativeTestJSON-113134079 tempest-AggregatesAdminNegativeTestJSON-113134079-project] 10.222.0.26 "DELETE /compute/v2.1/os-aggregates/7" status: 403 len: 116 microversion: 2.1 time: 0.014384 Oct 08 20:51:39.623217 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 33/45] 10.222.0.26 () {58 vars in 1152 bytes} [Sat Oct 8 20:51:39 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 116 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 08 20:51:39.628171 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-a270e628-2d3d-4c30-87df-c0321713f238 tempest-AggregatesAdminNegativeTestJSON-367865409 tempest-AggregatesAdminNegativeTestJSON-367865409-project-admin] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:51:39.658800 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-a270e628-2d3d-4c30-87df-c0321713f238 tempest-AggregatesAdminNegativeTestJSON-367865409 tempest-AggregatesAdminNegativeTestJSON-367865409-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.034069 Oct 08 20:51:39.659523 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 34/46] 10.222.0.26 () {58 vars in 1152 bytes} [Sat Oct 8 20:51:39 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 08 20:51:39.668446 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-cecdf95e-a2d4-4214-b0c9-0ad3248dbe7f tempest-AggregatesAdminNegativeTestJSON-367865409 tempest-AggregatesAdminNegativeTestJSON-367865409-project-admin] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:51:39.681173 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-cecdf95e-a2d4-4214-b0c9-0ad3248dbe7f tempest-AggregatesAdminNegativeTestJSON-367865409 tempest-AggregatesAdminNegativeTestJSON-367865409-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Oct 08 20:51:39.683224 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-cecdf95e-a2d4-4214-b0c9-0ad3248dbe7f tempest-AggregatesAdminNegativeTestJSON-367865409 tempest-AggregatesAdminNegativeTestJSON-367865409-project-admin] Request method failure captured: Oct 08 20:51:39.683224 ncdv-master-1 devstack@n-api.service[140491]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Oct 08 20:51:39.683224 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 20:51:39.683224 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 20:51:39.683224 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 20:51:39.683224 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 20:51:39.683224 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 20:51:39.683224 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 20:51:39.683224 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 20:51:39.683224 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 20:51:39.683224 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeLWVhqRRveDbmIUhFeBnNUCcRp0ijW8GA3slsPD4DpNY4VIrC1Obpt3PlDfNSXK8aKkF6mMCXXMjLIABKZrpIUQZ9p2WyaQLz3ViLWkIGM6mg_h9EkodYvDQieQggfjENBh1o6B10L6dVsCn80FSMaMQdp8lU263-XrTG0rHVdTG1w Oct 08 20:51:39.683224 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 20:51:39.683224 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 20:51:39.683224 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 20:51:39.683224 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 20:51:39.683224 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 20:51:39.683224 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 20:51:39.683224 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: d7e38a3e604b4b0a82db824aa872aef3 Oct 08 20:51:39.683224 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-367865409 Oct 08 20:51:39.683224 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,admin,member Oct 08 20:51:39.683224 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,admin,member Oct 08 20:51:39.684394 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d7e38a3e604b4b0a82db824aa872aef3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d7e38a3e604b4b0a82db824aa872aef3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d7e38a3e604b4b0a82db824aa872aef3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d7e38a3e604b4b0a82db824aa872aef3"}]}] Oct 08 20:51:39.684394 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-367865409 Oct 08 20:51:39.684394 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: d7e38a3e604b4b0a82db824aa872aef3 Oct 08 20:51:39.684394 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-367865409 Oct 08 20:51:39.684394 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-AggregatesAdminNegativeTestJSON-367865409-project-admin Oct 08 20:51:39.684394 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 20:51:39.684394 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 20:51:39.684394 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 27df69ae40444039af536faf5d884284 Oct 08 20:51:39.684394 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-367865409-project-admin Oct 08 20:51:39.684394 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 20:51:39.684394 ncdv-master-1 devstack@n-api.service[140491]: exception: Aggregate -1 could not be found. Oct 08 20:51:39.684394 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': '-1'} Oct 08 20:51:39.685041 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:51:39.685041 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:51:39.685041 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 08 20:51:39.685041 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 08 20:51:39.685041 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 08 20:51:39.685041 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 08 20:51:39.685041 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 08 20:51:39.685041 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 08 20:51:39.685041 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 08 20:51:39.685041 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise self.value Oct 08 20:51:39.685041 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 08 20:51:39.685041 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 08 20:51:39.685041 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 08 20:51:39.685041 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 08 20:51:39.685041 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 08 20:51:39.685041 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 08 20:51:39.685041 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 08 20:51:39.685041 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 08 20:51:39.685041 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 08 20:51:39.685979 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 08 20:51:39.685979 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 08 20:51:39.685979 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 08 20:51:39.685979 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Oct 08 20:51:39.685979 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:51:39.685979 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:51:39.685979 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:51:39.685979 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:51:39.685979 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:51:39.685979 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:51:39.685979 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:51:39.685979 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:51:39.685979 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:51:39.685979 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:51:39.685979 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 08 20:51:39.685979 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 20:51:39.685979 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Oct 08 20:51:39.685979 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:51:39.685979 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:51:39.685979 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:51:39.685979 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:51:39.686984 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:51:39.686984 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:51:39.686984 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 20:51:39.686984 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 20:51:39.686984 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Oct 08 20:51:39.686984 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:51:39.686984 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-cecdf95e-a2d4-4214-b0c9-0ad3248dbe7f tempest-AggregatesAdminNegativeTestJSON-367865409 tempest-AggregatesAdminNegativeTestJSON-367865409-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:51:39.686984 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-cecdf95e-a2d4-4214-b0c9-0ad3248dbe7f tempest-AggregatesAdminNegativeTestJSON-367865409 tempest-AggregatesAdminNegativeTestJSON-367865409-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.020295 Oct 08 20:51:39.686984 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 35/47] 10.222.0.26 () {58 vars in 1155 bytes} [Sat Oct 8 20:51:39 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 08 20:51:39.697537 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-a89448e5-b944-412a-89fe-1626efc16973 tempest-AggregatesAdminNegativeTestJSON-367865409 tempest-AggregatesAdminNegativeTestJSON-367865409-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-357443026"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:51:39.701317 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.objects.aggregate [None req-a89448e5-b944-412a-89fe-1626efc16973 tempest-AggregatesAdminNegativeTestJSON-367865409 tempest-AggregatesAdminNegativeTestJSON-367865409-project-admin] Generated uuid 4868f7d8-54d1-4da7-ac5f-374bef3b0912 for aggregate {{(pid=140491) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 08 20:51:39.740271 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-a89448e5-b944-412a-89fe-1626efc16973 tempest-AggregatesAdminNegativeTestJSON-367865409 tempest-AggregatesAdminNegativeTestJSON-367865409-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.047364 Oct 08 20:51:39.741884 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 36/48] 10.222.0.26 () {60 vars in 1164 bytes} [Sat Oct 8 20:51:39 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 08 20:51:39.753826 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-8a47c18d-25aa-4481-81a9-5e871f2f6073 tempest-AggregatesAdminNegativeTestJSON-113134079 tempest-AggregatesAdminNegativeTestJSON-113134079-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:51:39.755785 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-8a47c18d-25aa-4481-81a9-5e871f2f6073 tempest-AggregatesAdminNegativeTestJSON-113134079 tempest-AggregatesAdminNegativeTestJSON-113134079-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': '9fcee064c12e41079f451f88ab235dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00af80afb88c49e9b6eba209af379f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:51:39.758104 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-8a47c18d-25aa-4481-81a9-5e871f2f6073 tempest-AggregatesAdminNegativeTestJSON-113134079 tempest-AggregatesAdminNegativeTestJSON-113134079-project] Request method failure captured: Oct 08 20:51:39.758104 ncdv-master-1 devstack@n-api.service[140491]: request: GET /compute/v2.1/os-aggregates/8 HTTP/1.1 Oct 08 20:51:39.758104 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 20:51:39.758104 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 20:51:39.758104 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 20:51:39.758104 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 20:51:39.758104 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 20:51:39.758104 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 20:51:39.758104 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 20:51:39.758104 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 20:51:39.758104 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeLUREvKeYo7wAJnL0QSDolnV1B5HA8V32JgA2fiX6-vMH6WsYDiB4nhQ-xmB7y1MNkFvlDER0YqifcNn-GMvFL3JCHHsMCvEaoWrzKvFN1F90AZ-As1gaYK1oEk4cPK3clBrOSdMfKaxB6GLfpwQuvk4RscKYx_Abd9f9p1tNKLL2k Oct 08 20:51:39.758104 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 20:51:39.758104 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 20:51:39.758104 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 20:51:39.758104 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 20:51:39.758104 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 20:51:39.758104 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 20:51:39.758104 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 00af80afb88c49e9b6eba209af379f30 Oct 08 20:51:39.758104 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-113134079 Oct 08 20:51:39.758104 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 20:51:39.758104 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 20:51:39.759220 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/00af80afb88c49e9b6eba209af379f30"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/00af80afb88c49e9b6eba209af379f30"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_00af80afb88c49e9b6eba209af379f30"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/00af80afb88c49e9b6eba209af379f30"}]}] Oct 08 20:51:39.759220 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-113134079 Oct 08 20:51:39.759220 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 00af80afb88c49e9b6eba209af379f30 Oct 08 20:51:39.759220 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-113134079 Oct 08 20:51:39.759220 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-AggregatesAdminNegativeTestJSON-113134079-project Oct 08 20:51:39.759220 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 20:51:39.759220 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 20:51:39.759220 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 9fcee064c12e41079f451f88ab235dde Oct 08 20:51:39.759220 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-113134079-project Oct 08 20:51:39.759220 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 20:51:39.759220 ncdv-master-1 devstack@n-api.service[140491]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 08 20:51:39.759220 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': '8'} Oct 08 20:51:39.759909 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:51:39.759909 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:51:39.759909 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:51:39.759909 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:51:39.759909 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:51:39.759909 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:51:39.759909 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:51:39.759909 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:51:39.759909 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Oct 08 20:51:39.759909 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Oct 08 20:51:39.759909 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 08 20:51:39.759909 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 08 20:51:39.759909 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 08 20:51:39.759909 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 08 20:51:39.759909 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 08 20:51:39.759909 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 08 20:51:39.759909 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 08 20:51:39.759909 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise self.value Oct 08 20:51:39.759909 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 08 20:51:39.760800 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 08 20:51:39.760800 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 08 20:51:39.760800 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 08 20:51:39.760800 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 08 20:51:39.760800 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 08 20:51:39.760800 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 08 20:51:39.760800 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:51:39.760800 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:51:39.760800 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:51:39.760800 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:51:39.760800 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:51:39.760800 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:51:39.760800 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 08 20:51:39.760800 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 08 20:51:39.760800 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 08 20:51:39.760800 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:51:39.760800 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-8a47c18d-25aa-4481-81a9-5e871f2f6073 tempest-AggregatesAdminNegativeTestJSON-113134079 tempest-AggregatesAdminNegativeTestJSON-113134079-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:51:39.761677 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-8a47c18d-25aa-4481-81a9-5e871f2f6073 tempest-AggregatesAdminNegativeTestJSON-113134079 tempest-AggregatesAdminNegativeTestJSON-113134079-project] 10.222.0.26 "GET /compute/v2.1/os-aggregates/8" status: 403 len: 114 microversion: 2.1 time: 0.010554 Oct 08 20:51:39.761677 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 37/49] 10.222.0.26 () {58 vars in 1149 bytes} [Sat Oct 8 20:51:39 2022] GET /compute/v2.1/os-aggregates/8 => generated 114 bytes in 12 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 08 20:51:39.770232 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-63671c7f-5263-4629-9a29-ec46e3a6dca7 tempest-AggregatesAdminNegativeTestJSON-367865409 tempest-AggregatesAdminNegativeTestJSON-367865409-project-admin] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:51:39.811866 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-63671c7f-5263-4629-9a29-ec46e3a6dca7 tempest-AggregatesAdminNegativeTestJSON-367865409 tempest-AggregatesAdminNegativeTestJSON-367865409-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.045387 Oct 08 20:51:39.813369 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 38/50] 10.222.0.26 () {58 vars in 1152 bytes} [Sat Oct 8 20:51:39 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 08 20:51:39.823252 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c9d53515-f15b-4dd8-8155-7cb0af41b966 tempest-AggregatesAdminNegativeTestJSON-367865409 tempest-AggregatesAdminNegativeTestJSON-367865409-project-admin] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:51:39.832425 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-c9d53515-f15b-4dd8-8155-7cb0af41b966 tempest-AggregatesAdminNegativeTestJSON-367865409 tempest-AggregatesAdminNegativeTestJSON-367865409-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Oct 08 20:51:39.834091 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c9d53515-f15b-4dd8-8155-7cb0af41b966 tempest-AggregatesAdminNegativeTestJSON-367865409 tempest-AggregatesAdminNegativeTestJSON-367865409-project-admin] Request method failure captured: Oct 08 20:51:39.834091 ncdv-master-1 devstack@n-api.service[140491]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Oct 08 20:51:39.834091 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 20:51:39.834091 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 20:51:39.834091 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 20:51:39.834091 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 20:51:39.834091 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 20:51:39.834091 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 20:51:39.834091 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 20:51:39.834091 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 20:51:39.834091 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeLWVhqRRveDbmIUhFeBnNUCcRp0ijW8GA3slsPD4DpNY4VIrC1Obpt3PlDfNSXK8aKkF6mMCXXMjLIABKZrpIUQZ9p2WyaQLz3ViLWkIGM6mg_h9EkodYvDQieQggfjENBh1o6B10L6dVsCn80FSMaMQdp8lU263-XrTG0rHVdTG1w Oct 08 20:51:39.834091 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 20:51:39.834091 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 20:51:39.834091 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 20:51:39.834091 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 20:51:39.834091 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 20:51:39.834091 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 20:51:39.834091 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: d7e38a3e604b4b0a82db824aa872aef3 Oct 08 20:51:39.834091 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-367865409 Oct 08 20:51:39.834091 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,admin,member Oct 08 20:51:39.834091 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,admin,member Oct 08 20:51:39.835421 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d7e38a3e604b4b0a82db824aa872aef3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d7e38a3e604b4b0a82db824aa872aef3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d7e38a3e604b4b0a82db824aa872aef3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d7e38a3e604b4b0a82db824aa872aef3"}]}] Oct 08 20:51:39.835421 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-367865409 Oct 08 20:51:39.835421 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: d7e38a3e604b4b0a82db824aa872aef3 Oct 08 20:51:39.835421 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-367865409 Oct 08 20:51:39.835421 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-AggregatesAdminNegativeTestJSON-367865409-project-admin Oct 08 20:51:39.835421 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 20:51:39.835421 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 20:51:39.835421 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 27df69ae40444039af536faf5d884284 Oct 08 20:51:39.835421 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-367865409-project-admin Oct 08 20:51:39.835421 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 20:51:39.835421 ncdv-master-1 devstack@n-api.service[140491]: exception: Aggregate -1 could not be found. Oct 08 20:51:39.835421 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': '-1'} Oct 08 20:51:39.836030 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:51:39.836030 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:51:39.836030 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 08 20:51:39.836030 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 08 20:51:39.836030 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 08 20:51:39.836030 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 08 20:51:39.836030 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 08 20:51:39.836030 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 08 20:51:39.836030 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 08 20:51:39.836030 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 08 20:51:39.836030 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 08 20:51:39.836030 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 08 20:51:39.836030 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 08 20:51:39.836030 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 08 20:51:39.836030 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Oct 08 20:51:39.836030 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:51:39.836030 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:51:39.836030 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:51:39.836030 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:51:39.836030 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:51:39.836987 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:51:39.836987 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:51:39.836987 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:51:39.836987 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:51:39.836987 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:51:39.836987 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 08 20:51:39.836987 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 20:51:39.836987 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Oct 08 20:51:39.836987 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:51:39.836987 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:51:39.836987 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:51:39.836987 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:51:39.836987 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:51:39.836987 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:51:39.836987 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 20:51:39.836987 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 20:51:39.836987 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Oct 08 20:51:39.836987 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:51:39.838419 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c9d53515-f15b-4dd8-8155-7cb0af41b966 tempest-AggregatesAdminNegativeTestJSON-367865409 tempest-AggregatesAdminNegativeTestJSON-367865409-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:51:39.839301 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-c9d53515-f15b-4dd8-8155-7cb0af41b966 tempest-AggregatesAdminNegativeTestJSON-367865409 tempest-AggregatesAdminNegativeTestJSON-367865409-project-admin] 10.222.0.26 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.020347 Oct 08 20:51:39.839862 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 39/51] 10.222.0.26 () {58 vars in 1152 bytes} [Sat Oct 8 20:51:39 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 08 20:51:39.849939 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-9d5af341-16db-4d60-9ede-a3828bf201ee tempest-AggregatesAdminNegativeTestJSON-113134079 tempest-AggregatesAdminNegativeTestJSON-113134079-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:51:39.851460 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-9d5af341-16db-4d60-9ede-a3828bf201ee tempest-AggregatesAdminNegativeTestJSON-113134079 tempest-AggregatesAdminNegativeTestJSON-113134079-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': '9fcee064c12e41079f451f88ab235dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00af80afb88c49e9b6eba209af379f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:51:39.852986 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-9d5af341-16db-4d60-9ede-a3828bf201ee tempest-AggregatesAdminNegativeTestJSON-113134079 tempest-AggregatesAdminNegativeTestJSON-113134079-project] Request method failure captured: Oct 08 20:51:39.852986 ncdv-master-1 devstack@n-api.service[140491]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Oct 08 20:51:39.852986 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 20:51:39.852986 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 20:51:39.852986 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 20:51:39.852986 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 20:51:39.852986 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 20:51:39.852986 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 20:51:39.852986 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 20:51:39.852986 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 20:51:39.852986 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeLUREvKeYo7wAJnL0QSDolnV1B5HA8V32JgA2fiX6-vMH6WsYDiB4nhQ-xmB7y1MNkFvlDER0YqifcNn-GMvFL3JCHHsMCvEaoWrzKvFN1F90AZ-As1gaYK1oEk4cPK3clBrOSdMfKaxB6GLfpwQuvk4RscKYx_Abd9f9p1tNKLL2k Oct 08 20:51:39.852986 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 20:51:39.852986 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 20:51:39.852986 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 20:51:39.852986 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 20:51:39.852986 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 20:51:39.852986 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 20:51:39.852986 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 00af80afb88c49e9b6eba209af379f30 Oct 08 20:51:39.852986 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-113134079 Oct 08 20:51:39.852986 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 20:51:39.852986 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 20:51:39.854113 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/00af80afb88c49e9b6eba209af379f30"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/00af80afb88c49e9b6eba209af379f30"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_00af80afb88c49e9b6eba209af379f30"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/00af80afb88c49e9b6eba209af379f30"}]}] Oct 08 20:51:39.854113 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-113134079 Oct 08 20:51:39.854113 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 00af80afb88c49e9b6eba209af379f30 Oct 08 20:51:39.854113 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-113134079 Oct 08 20:51:39.854113 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-AggregatesAdminNegativeTestJSON-113134079-project Oct 08 20:51:39.854113 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 20:51:39.854113 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 20:51:39.854113 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 9fcee064c12e41079f451f88ab235dde Oct 08 20:51:39.854113 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-113134079-project Oct 08 20:51:39.854113 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 20:51:39.854113 ncdv-master-1 devstack@n-api.service[140491]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 08 20:51:39.854113 ncdv-master-1 devstack@n-api.service[140491]: action_args: {} Oct 08 20:51:39.854700 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:51:39.854700 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:51:39.854700 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:51:39.854700 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:51:39.854700 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:51:39.854700 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:51:39.854700 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:51:39.854700 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:51:39.854700 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Oct 08 20:51:39.854700 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Oct 08 20:51:39.854700 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 08 20:51:39.854700 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 08 20:51:39.854700 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 08 20:51:39.854700 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 08 20:51:39.854700 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 08 20:51:39.854700 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 08 20:51:39.854700 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 08 20:51:39.854700 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise self.value Oct 08 20:51:39.854700 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 08 20:51:39.861381 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 08 20:51:39.861381 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 08 20:51:39.861381 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 08 20:51:39.861381 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 08 20:51:39.861381 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 08 20:51:39.861381 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 08 20:51:39.861381 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:51:39.861381 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:51:39.861381 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:51:39.861381 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:51:39.861381 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:51:39.861381 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:51:39.861381 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 08 20:51:39.861381 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 08 20:51:39.861381 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 08 20:51:39.861381 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:51:39.861381 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-9d5af341-16db-4d60-9ede-a3828bf201ee tempest-AggregatesAdminNegativeTestJSON-113134079 tempest-AggregatesAdminNegativeTestJSON-113134079-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:51:39.862338 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-9d5af341-16db-4d60-9ede-a3828bf201ee tempest-AggregatesAdminNegativeTestJSON-113134079 tempest-AggregatesAdminNegativeTestJSON-113134079-project] 10.222.0.26 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.008820 Oct 08 20:51:39.862338 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 40/52] 10.222.0.26 () {58 vars in 1143 bytes} [Sat Oct 8 20:51:39 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 10 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 08 20:51:39.882062 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-53647cab-a00c-40b4-893f-fbbe6d162976 tempest-FlavorsAccessNegativeTestJSON-459130796 tempest-FlavorsAccessNegativeTestJSON-459130796-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors/1259204769/action" status: 200 len: 21 microversion: 2.1 time: 0.853831 Oct 08 20:51:39.888433 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 13/53] 10.222.0.26 () {60 vars in 1200 bytes} [Sat Oct 8 20:51:39 2022] POST /compute/v2.1/flavors/1259204769/action => generated 21 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 08 20:51:39.894041 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-b6f86df7-20fb-4e23-9b65-f0e0e1d060fc tempest-FlavorsAccessNegativeTestJSON-459130796 tempest-FlavorsAccessNegativeTestJSON-459130796-project-admin] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:51:39.919576 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-b6f86df7-20fb-4e23-9b65-f0e0e1d060fc tempest-FlavorsAccessNegativeTestJSON-459130796 tempest-FlavorsAccessNegativeTestJSON-459130796-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/1259204769" status: 202 len: 0 microversion: 2.1 time: 0.030207 Oct 08 20:51:39.920291 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 41/54] 10.222.0.26 () {58 vars in 1161 bytes} [Sat Oct 8 20:51:39 2022] DELETE /compute/v2.1/flavors/1259204769 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 08 20:51:39.929350 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-54265519-49fd-4a22-bfdb-f10dc3ad068d tempest-FlavorsAccessNegativeTestJSON-459130796 tempest-FlavorsAccessNegativeTestJSON-459130796-project-admin] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:51:39.952543 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-54265519-49fd-4a22-bfdb-f10dc3ad068d tempest-FlavorsAccessNegativeTestJSON-459130796 tempest-FlavorsAccessNegativeTestJSON-459130796-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.027311 Oct 08 20:51:39.953512 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 14/55] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Oct 8 20:51:39 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:51:39.973168 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-d1790448-af53-4121-89ee-6bec59300dc9 tempest-FlavorsAccessNegativeTestJSON-459130796 tempest-FlavorsAccessNegativeTestJSON-459130796-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1372649155", "id": 12291232, "os-flavor-access:is_public": "True"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:51:39.992465 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-d1790448-af53-4121-89ee-6bec59300dc9 tempest-FlavorsAccessNegativeTestJSON-459130796 tempest-FlavorsAccessNegativeTestJSON-459130796-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 432 microversion: 2.1 time: 0.023103 Oct 08 20:51:40.000884 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 15/56] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 20:51:39 2022] POST /compute/v2.1/flavors => generated 432 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:51:40.005854 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-6d3d3b50-2528-4fae-94c0-aed975f7c988 tempest-FlavorsAccessNegativeTestJSON-459130796 tempest-FlavorsAccessNegativeTestJSON-459130796-project-admin] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:51:40.015560 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-6d3d3b50-2528-4fae-94c0-aed975f7c988 tempest-FlavorsAccessNegativeTestJSON-459130796 tempest-FlavorsAccessNegativeTestJSON-459130796-project-admin] HTTP exception thrown: Access list not available for public flavors. Oct 08 20:51:40.017267 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-6d3d3b50-2528-4fae-94c0-aed975f7c988 tempest-FlavorsAccessNegativeTestJSON-459130796 tempest-FlavorsAccessNegativeTestJSON-459130796-project-admin] Request method failure captured: Oct 08 20:51:40.017267 ncdv-master-1 devstack@n-api.service[140492]: request: GET /compute/v2.1/flavors/12291232/os-flavor-access HTTP/1.1 Oct 08 20:51:40.017267 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 20:51:40.017267 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 20:51:40.017267 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 20:51:40.017267 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 20:51:40.017267 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 20:51:40.017267 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 20:51:40.017267 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 20:51:40.017267 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 20:51:40.017267 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeLYdm2mn8FjsJOz8lf2BTMxDYH51lOZQ7fXdzkkyYZkc7J3KsW1kgbontCby0fL-MXJ3V5HTTbxk5vsFt9Gg2moDm3KtN3Anvxnly2_RUOXy-AmomZwXdcluRUzzJoCdOjq1ijlGEdcNA9mGB3IXoA-OA3FQp212Kls82kxFMfhAfc Oct 08 20:51:40.017267 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 20:51:40.017267 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 20:51:40.017267 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 20:51:40.017267 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 20:51:40.017267 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 20:51:40.017267 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 20:51:40.017267 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 82c66519e0dd4ef29876400cd42c0729 Oct 08 20:51:40.017267 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-459130796 Oct 08 20:51:40.017267 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,admin,member Oct 08 20:51:40.017267 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,admin,member Oct 08 20:51:40.018346 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/82c66519e0dd4ef29876400cd42c0729"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/82c66519e0dd4ef29876400cd42c0729"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_82c66519e0dd4ef29876400cd42c0729"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/82c66519e0dd4ef29876400cd42c0729"}]}] Oct 08 20:51:40.018346 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-459130796 Oct 08 20:51:40.018346 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 82c66519e0dd4ef29876400cd42c0729 Oct 08 20:51:40.018346 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-459130796 Oct 08 20:51:40.018346 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-FlavorsAccessNegativeTestJSON-459130796-project-admin Oct 08 20:51:40.018346 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 20:51:40.018346 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 20:51:40.018346 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 98f9c672a2164e76b458973a66b6203b Oct 08 20:51:40.018346 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-459130796-project-admin Oct 08 20:51:40.018346 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 20:51:40.018346 ncdv-master-1 devstack@n-api.service[140492]: exception: Access list not available for public flavors. Oct 08 20:51:40.018346 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'flavor_id': '12291232'} Oct 08 20:51:40.019057 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:51:40.019057 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:51:40.019057 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:51:40.019057 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:51:40.019057 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:51:40.019057 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:51:40.019057 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:51:40.019057 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:51:40.019057 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Oct 08 20:51:40.019057 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 08 20:51:40.019057 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Oct 08 20:51:40.019057 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:51:40.019057 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:51:40.019057 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:51:40.019057 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:51:40.019057 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:51:40.019057 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:51:40.019057 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 20:51:40.019057 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 20:51:40.019057 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Oct 08 20:51:40.019057 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:51:40.020087 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-6d3d3b50-2528-4fae-94c0-aed975f7c988 tempest-FlavorsAccessNegativeTestJSON-459130796 tempest-FlavorsAccessNegativeTestJSON-459130796-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:51:40.020087 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-6d3d3b50-2528-4fae-94c0-aed975f7c988 tempest-FlavorsAccessNegativeTestJSON-459130796 tempest-FlavorsAccessNegativeTestJSON-459130796-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/12291232/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.016796 Oct 08 20:51:40.020087 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 16/57] 10.222.0.26 () {58 vars in 1203 bytes} [Sat Oct 8 20:51:40 2022] GET /compute/v2.1/flavors/12291232/os-flavor-access => generated 91 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 08 20:51:40.028280 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-503f0575-3529-4fe0-886a-4be9b2e255a5 tempest-FlavorsAccessNegativeTestJSON-459130796 tempest-FlavorsAccessNegativeTestJSON-459130796-project-admin] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:51:40.054684 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-503f0575-3529-4fe0-886a-4be9b2e255a5 tempest-FlavorsAccessNegativeTestJSON-459130796 tempest-FlavorsAccessNegativeTestJSON-459130796-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/12291232" status: 202 len: 0 microversion: 2.1 time: 0.029865 Oct 08 20:51:40.055667 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 17/58] 10.222.0.26 () {58 vars in 1155 bytes} [Sat Oct 8 20:51:40 2022] DELETE /compute/v2.1/flavors/12291232 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 20:51:40.067588 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-7bc8fc67-15ea-425f-a2d8-1b7a956eb435 tempest-FlavorsAccessNegativeTestJSON-459130796 tempest-FlavorsAccessNegativeTestJSON-459130796-project-admin] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:51:40.093980 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-7bc8fc67-15ea-425f-a2d8-1b7a956eb435 tempest-FlavorsAccessNegativeTestJSON-459130796 tempest-FlavorsAccessNegativeTestJSON-459130796-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.032514 Oct 08 20:51:40.097344 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 18/59] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Oct 8 20:51:40 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:51:40.117881 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-74204e51-af6e-4915-9491-c18cb421db48 tempest-FlavorsAccessNegativeTestJSON-459130796 tempest-FlavorsAccessNegativeTestJSON-459130796-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-848740643", "id": 1986555538, "os-flavor-access:is_public": "False"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:51:40.141968 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-74204e51-af6e-4915-9491-c18cb421db48 tempest-FlavorsAccessNegativeTestJSON-459130796 tempest-FlavorsAccessNegativeTestJSON-459130796-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.029207 Oct 08 20:51:40.149761 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 19/60] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 20:51:40 2022] POST /compute/v2.1/flavors => generated 438 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:51:40.413315 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-63bbbb0f-5b4f-4049-b68c-a308ebd08f41 tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-2037193112", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "availability_zone": "tempest-test_az-1392764660"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:51:40.442455 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-63bbbb0f-5b4f-4049-b68c-a308ebd08f41 tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:51:40.443317 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-63bbbb0f-5b4f-4049-b68c-a308ebd08f41 tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:51:40.444108 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-63bbbb0f-5b4f-4049-b68c-a308ebd08f41 tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:51:40.444958 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-63bbbb0f-5b4f-4049-b68c-a308ebd08f41 tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:51:40.445548 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-63bbbb0f-5b4f-4049-b68c-a308ebd08f41 tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:51:40.446061 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-63bbbb0f-5b4f-4049-b68c-a308ebd08f41 tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:51:40.570636 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-71f4cf32-6749-40f5-9252-edb9f3225695 tempest-FlavorsV261TestJSON-926083080 tempest-FlavorsV261TestJSON-926083080-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-1581536557", "id": 1682103984, "os-flavor-access:is_public": "True"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:51:40.602366 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-71f4cf32-6749-40f5-9252-edb9f3225695 tempest-FlavorsV261TestJSON-926083080 tempest-FlavorsV261TestJSON-926083080-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 468 microversion: 2.61 time: 0.453513 Oct 08 20:51:40.602943 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 20/61] 10.222.0.26 () {62 vars in 1188 bytes} [Sat Oct 8 20:51:40 2022] POST /compute/v2.1/flavors => generated 468 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 08 20:51:41.014288 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-872500a1-b1fc-4c04-822c-f57b4c1fab7b tempest-FlavorsAccessNegativeTestJSON-1938712298 tempest-FlavorsAccessNegativeTestJSON-1938712298-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "0eae5cc31fc7412292ec30a394e28863"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:51:41.018202 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-872500a1-b1fc-4c04-822c-f57b4c1fab7b tempest-FlavorsAccessNegativeTestJSON-1938712298 tempest-FlavorsAccessNegativeTestJSON-1938712298-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': '61756ba79b6e4b7e96b93e16abcd0676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eae5cc31fc7412292ec30a394e28863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:51:41.019864 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-872500a1-b1fc-4c04-822c-f57b4c1fab7b tempest-FlavorsAccessNegativeTestJSON-1938712298 tempest-FlavorsAccessNegativeTestJSON-1938712298-project] Request method failure captured: Oct 08 20:51:41.019864 ncdv-master-1 devstack@n-api.service[140492]: request: POST /compute/v2.1/flavors/1986555538/action HTTP/1.1 Oct 08 20:51:41.019864 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 20:51:41.019864 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 20:51:41.019864 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 20:51:41.019864 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 67 Oct 08 20:51:41.019864 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 20:51:41.019864 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 20:51:41.019864 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 20:51:41.019864 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 20:51:41.019864 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeLVMSZE9FUv5rij91Inp3MQc8ZhG-7d51VD0nsqB0VTZOToYJGijyNb9T25idSZ7s_MaVunKRLPA7IW00-eUyp7VJfg985zbzOg2tKPZSTcG6CagWfUQZIF9njaUDDxSgh08TCS8xG4e4fZXnFS8iNC_ppvkI2oFWt-BXDXAHz-HFg Oct 08 20:51:41.019864 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 20:51:41.019864 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 20:51:41.019864 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 20:51:41.019864 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 20:51:41.019864 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 20:51:41.019864 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 20:51:41.019864 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 0eae5cc31fc7412292ec30a394e28863 Oct 08 20:51:41.019864 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1938712298 Oct 08 20:51:41.019864 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 20:51:41.019864 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 20:51:41.021046 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0eae5cc31fc7412292ec30a394e28863"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0eae5cc31fc7412292ec30a394e28863"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0eae5cc31fc7412292ec30a394e28863"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0eae5cc31fc7412292ec30a394e28863"}]}] Oct 08 20:51:41.021046 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1938712298 Oct 08 20:51:41.021046 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 0eae5cc31fc7412292ec30a394e28863 Oct 08 20:51:41.021046 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1938712298 Oct 08 20:51:41.021046 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-FlavorsAccessNegativeTestJSON-1938712298-project Oct 08 20:51:41.021046 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 20:51:41.021046 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 20:51:41.021046 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 61756ba79b6e4b7e96b93e16abcd0676 Oct 08 20:51:41.021046 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1938712298-project Oct 08 20:51:41.021046 ncdv-master-1 devstack@n-api.service[140492]: Oct 08 20:51:41.021046 ncdv-master-1 devstack@n-api.service[140492]: {"addTenantAccess": {"tenant": "0eae5cc31fc7412292ec30a394e28863"}} Oct 08 20:51:41.021046 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 20:51:41.021730 ncdv-master-1 devstack@n-api.service[140492]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 08 20:51:41.021730 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': '1986555538', 'body': {'addTenantAccess': {'tenant': '0eae5cc31fc7412292ec30a394e28863'}}} Oct 08 20:51:41.021730 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:51:41.021730 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:51:41.021730 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:51:41.021730 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:51:41.021730 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:51:41.021730 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:51:41.021730 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:51:41.021730 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:51:41.021730 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 20:51:41.021730 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 20:51:41.021730 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Oct 08 20:51:41.021730 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Oct 08 20:51:41.021730 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 08 20:51:41.021730 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 08 20:51:41.021730 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 08 20:51:41.021730 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 08 20:51:41.021730 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 08 20:51:41.022678 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 08 20:51:41.022678 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 08 20:51:41.022678 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise self.value Oct 08 20:51:41.022678 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 08 20:51:41.022678 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 08 20:51:41.022678 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 08 20:51:41.022678 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 08 20:51:41.022678 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 08 20:51:41.022678 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 08 20:51:41.022678 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 08 20:51:41.022678 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:51:41.022678 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:51:41.022678 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:51:41.022678 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:51:41.022678 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:51:41.022678 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:51:41.022678 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 08 20:51:41.022678 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 08 20:51:41.022678 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 08 20:51:41.022678 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:51:41.023668 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-872500a1-b1fc-4c04-822c-f57b4c1fab7b tempest-FlavorsAccessNegativeTestJSON-1938712298 tempest-FlavorsAccessNegativeTestJSON-1938712298-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:51:41.023668 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-872500a1-b1fc-4c04-822c-f57b4c1fab7b tempest-FlavorsAccessNegativeTestJSON-1938712298 tempest-FlavorsAccessNegativeTestJSON-1938712298-project] 10.222.0.26 "POST /compute/v2.1/flavors/1986555538/action" status: 403 len: 130 microversion: 2.1 time: 0.414594 Oct 08 20:51:41.025445 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 21/62] 10.222.0.26 () {60 vars in 1200 bytes} [Sat Oct 8 20:51:40 2022] POST /compute/v2.1/flavors/1986555538/action => generated 130 bytes in 421 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 08 20:51:41.462043 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-04506f77-4751-4050-a0b5-e2d54b3cc844 tempest-FlavorsV261TestJSON-553480562 tempest-FlavorsV261TestJSON-553480562-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:51:41.493340 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-04506f77-4751-4050-a0b5-e2d54b3cc844 tempest-FlavorsV261TestJSON-553480562 tempest-FlavorsV261TestJSON-553480562-project] 10.222.0.26 "GET /compute/v2.1/flavors/1682103984" status: 200 len: 468 microversion: 2.61 time: 0.462658 Oct 08 20:51:41.495019 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 22/63] 10.222.0.26 () {60 vars in 1199 bytes} [Sat Oct 8 20:51:41 2022] GET /compute/v2.1/flavors/1682103984 => generated 468 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 08 20:51:41.500547 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-b531e9a8-fd49-4a4f-9477-0b89c673176e tempest-FlavorsAccessNegativeTestJSON-459130796 tempest-FlavorsAccessNegativeTestJSON-459130796-project-admin] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:51:41.517163 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.network.neutron [None req-63bbbb0f-5b4f-4049-b68c-a308ebd08f41 tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] validate_networks() for None {{(pid=140491) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 20:51:41.520588 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-b531e9a8-fd49-4a4f-9477-0b89c673176e tempest-FlavorsAccessNegativeTestJSON-459130796 tempest-FlavorsAccessNegativeTestJSON-459130796-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/1986555538" status: 202 len: 0 microversion: 2.1 time: 0.024167 Oct 08 20:51:41.525039 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 23/64] 10.222.0.26 () {58 vars in 1161 bytes} [Sat Oct 8 20:51:41 2022] DELETE /compute/v2.1/flavors/1986555538 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 20:51:41.527998 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-16672fdd-9948-45e6-a7c4-64f748c4dd47 tempest-FlavorsV261TestJSON-926083080 tempest-FlavorsV261TestJSON-926083080-project-admin] Action: 'update', calling method: .version_select at 0x7f1a8e80b670>, body: {"flavor": {"description": "new"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:51:41.576492 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-16672fdd-9948-45e6-a7c4-64f748c4dd47 tempest-FlavorsV261TestJSON-926083080 tempest-FlavorsV261TestJSON-926083080-project-admin] 10.222.0.26 "PUT /compute/v2.1/flavors/1682103984" status: 200 len: 469 microversion: 2.61 time: 0.054053 Oct 08 20:51:41.577676 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 24/65] 10.222.0.26 () {62 vars in 1219 bytes} [Sat Oct 8 20:51:41 2022] PUT /compute/v2.1/flavors/1682103984 => generated 469 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 08 20:51:41.583294 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-c56eb87b-3d40-42e1-b740-c304d8e88c61 tempest-FlavorsAccessNegativeTestJSON-459130796 tempest-FlavorsAccessNegativeTestJSON-459130796-project-admin] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:51:41.608838 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-c56eb87b-3d40-42e1-b740-c304d8e88c61 tempest-FlavorsAccessNegativeTestJSON-459130796 tempest-FlavorsAccessNegativeTestJSON-459130796-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 5409 microversion: 2.1 time: 0.029134 Oct 08 20:51:41.609589 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 25/66] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Oct 8 20:51:41 2022] GET /compute/v2.1/flavors/detail => generated 5409 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:51:41.614504 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-2eb7b62a-c97e-43f5-825c-db7d16f7ed6f tempest-FlavorsV261TestJSON-553480562 tempest-FlavorsV261TestJSON-553480562-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:51:41.632460 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=8,nova_api:DELETE=10,nova_api:UPDATE=2 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:51:41.651454 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-2eb7b62a-c97e-43f5-825c-db7d16f7ed6f tempest-FlavorsV261TestJSON-553480562 tempest-FlavorsV261TestJSON-553480562-project] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 6250 microversion: 2.61 time: 0.040234 Oct 08 20:51:41.652481 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 26/67] 10.222.0.26 () {60 vars in 1187 bytes} [Sat Oct 8 20:51:41 2022] GET /compute/v2.1/flavors/detail => generated 6250 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:51:41.658567 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-f01b8bca-77bb-438e-839b-3a856223934d tempest-FlavorsAccessNegativeTestJSON-459130796 tempest-FlavorsAccessNegativeTestJSON-459130796-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-405818061", "id": 1150631720, "os-flavor-access:is_public": "False"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:51:41.681236 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-f01b8bca-77bb-438e-839b-3a856223934d tempest-FlavorsAccessNegativeTestJSON-459130796 tempest-FlavorsAccessNegativeTestJSON-459130796-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.027580 Oct 08 20:51:41.682379 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 27/68] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 20:51:41 2022] POST /compute/v2.1/flavors => generated 438 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:51:41.687849 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-ade3ca5d-a939-4c1e-aaa9-46c3203c1ebb tempest-FlavorsV261TestJSON-553480562 tempest-FlavorsV261TestJSON-553480562-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:51:41.710669 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-ade3ca5d-a939-4c1e-aaa9-46c3203c1ebb tempest-FlavorsV261TestJSON-553480562 tempest-FlavorsV261TestJSON-553480562-project] 10.222.0.26 "GET /compute/v2.1/flavors" status: 200 len: 3157 microversion: 2.61 time: 0.027052 Oct 08 20:51:41.711508 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 28/69] 10.222.0.26 () {60 vars in 1166 bytes} [Sat Oct 8 20:51:41 2022] GET /compute/v2.1/flavors => generated 3157 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:51:41.716497 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-9206012b-afe3-48b6-863f-332353095169 tempest-FlavorsAccessNegativeTestJSON-459130796 tempest-FlavorsAccessNegativeTestJSON-459130796-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "0eae5cc31fc7412292ec30a394e28863"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:51:41.955560 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-63bbbb0f-5b4f-4049-b68c-a308ebd08f41 tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Flavor limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 20:51:41.956871 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-63bbbb0f-5b4f-4049-b68c-a308ebd08f41 tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Image limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 20:51:41.957707 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-63bbbb0f-5b4f-4049-b68c-a308ebd08f41 tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Flavor pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 20:51:41.958872 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-63bbbb0f-5b4f-4049-b68c-a308ebd08f41 tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Image pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 20:51:41.959510 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-63bbbb0f-5b4f-4049-b68c-a308ebd08f41 tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 20:51:41.978607 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-63bbbb0f-5b4f-4049-b68c-a308ebd08f41 tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:51:41.979399 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-63bbbb0f-5b4f-4049-b68c-a308ebd08f41 tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:51:41.979978 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-63bbbb0f-5b4f-4049-b68c-a308ebd08f41 tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:51:41.981149 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-63bbbb0f-5b4f-4049-b68c-a308ebd08f41 tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:51:41.981941 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-63bbbb0f-5b4f-4049-b68c-a308ebd08f41 tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:51:41.982369 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-63bbbb0f-5b4f-4049-b68c-a308ebd08f41 tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:51:42.023623 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-63bbbb0f-5b4f-4049-b68c-a308ebd08f41 tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Getting quotas for project d024396aef784f3291630c426a828cf0. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 20:51:42.032685 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-63bbbb0f-5b4f-4049-b68c-a308ebd08f41 tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Getting quotas for user d8da7d5210cf42bda150d342ff207bbd and project d024396aef784f3291630c426a828cf0. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 20:51:42.049001 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-63bbbb0f-5b4f-4049-b68c-a308ebd08f41 tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Going to run 1 instances... {{(pid=140491) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 20:51:42.058362 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-63bbbb0f-5b4f-4049-b68c-a308ebd08f41 tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] [instance: bbff4ffb-395f-4eeb-a995-60c9c0f39f25] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c508bd7f-7db9-4b2c-af7c-be54a855c355',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140491) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 20:51:42.129506 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-63bbbb0f-5b4f-4049-b68c-a308ebd08f41 tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.170943 Oct 08 20:51:42.130541 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 42/70] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 20:51:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 2173 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 08 20:51:42.136807 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-53fd43de-9796-4523-a4c4-8d97189b48db tempest-FlavorsV261TestJSON-926083080 tempest-FlavorsV261TestJSON-926083080-project-admin] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:51:42.159951 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-53fd43de-9796-4523-a4c4-8d97189b48db tempest-FlavorsV261TestJSON-926083080 tempest-FlavorsV261TestJSON-926083080-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/1682103984" status: 202 len: 0 microversion: 2.61 time: 0.028013 Oct 08 20:51:42.163539 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 43/71] 10.222.0.26 () {60 vars in 1202 bytes} [Sat Oct 8 20:51:42 2022] DELETE /compute/v2.1/flavors/1682103984 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 08 20:51:42.172436 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-ce09b5a2-24d3-4483-acd1-32c0cac4c96b tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:51:42.173067 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-ce09b5a2-24d3-4483-acd1-32c0cac4c96b tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] [instance: bbff4ffb-395f-4eeb-a995-60c9c0f39f25] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:51:42.284673 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-9206012b-afe3-48b6-863f-332353095169 tempest-FlavorsAccessNegativeTestJSON-459130796 tempest-FlavorsAccessNegativeTestJSON-459130796-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors/1150631720/action" status: 200 len: 97 microversion: 2.1 time: 0.571888 Oct 08 20:51:42.286190 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 29/72] 10.222.0.26 () {60 vars in 1200 bytes} [Sat Oct 8 20:51:41 2022] POST /compute/v2.1/flavors/1150631720/action => generated 97 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 08 20:51:42.289249 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-ce09b5a2-24d3-4483-acd1-32c0cac4c96b tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8da7d5210cf42bda150d342ff207bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd024396aef784f3291630c426a828cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:51:42.291115 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-db1ed948-6884-43d4-864b-304711d057d3 tempest-FlavorsV261TestJSON-926083080 tempest-FlavorsV261TestJSON-926083080-project-admin] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:51:42.310976 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-ce09b5a2-24d3-4483-acd1-32c0cac4c96b tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] 10.222.0.26 "GET /compute/v2.1/servers/bbff4ffb-395f-4eeb-a995-60c9c0f39f25" status: 200 len: 1243 microversion: 2.1 time: 0.145891 Oct 08 20:51:42.315123 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-db1ed948-6884-43d4-864b-304711d057d3 tempest-FlavorsV261TestJSON-926083080 tempest-FlavorsV261TestJSON-926083080-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 5791 microversion: 2.61 time: 0.027871 Oct 08 20:51:42.315847 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 30/73] 10.222.0.26 () {60 vars in 1187 bytes} [Sat Oct 8 20:51:42 2022] GET /compute/v2.1/flavors/detail => generated 5791 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:51:42.324371 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e5e3ca22-8496-4ac8-bb12-cf6856e4314f tempest-FlavorsAccessNegativeTestJSON-1938712298 tempest-FlavorsAccessNegativeTestJSON-1938712298-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "0eae5cc31fc7412292ec30a394e28863"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:51:42.327475 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 44/74] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:51:42 2022] GET /compute/v2.1/servers/bbff4ffb-395f-4eeb-a995-60c9c0f39f25 => generated 1243 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:51:42.328353 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-e5e3ca22-8496-4ac8-bb12-cf6856e4314f tempest-FlavorsAccessNegativeTestJSON-1938712298 tempest-FlavorsAccessNegativeTestJSON-1938712298-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': '61756ba79b6e4b7e96b93e16abcd0676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eae5cc31fc7412292ec30a394e28863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:51:42.342180 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e5e3ca22-8496-4ac8-bb12-cf6856e4314f tempest-FlavorsAccessNegativeTestJSON-1938712298 tempest-FlavorsAccessNegativeTestJSON-1938712298-project] Request method failure captured: Oct 08 20:51:42.342180 ncdv-master-1 devstack@n-api.service[140492]: request: POST /compute/v2.1/flavors/1150631720/action HTTP/1.1 Oct 08 20:51:42.342180 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 20:51:42.342180 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 20:51:42.342180 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 20:51:42.342180 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 70 Oct 08 20:51:42.342180 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 20:51:42.342180 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 20:51:42.342180 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 20:51:42.342180 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 20:51:42.342180 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeLVMSZE9FUv5rij91Inp3MQc8ZhG-7d51VD0nsqB0VTZOToYJGijyNb9T25idSZ7s_MaVunKRLPA7IW00-eUyp7VJfg985zbzOg2tKPZSTcG6CagWfUQZIF9njaUDDxSgh08TCS8xG4e4fZXnFS8iNC_ppvkI2oFWt-BXDXAHz-HFg Oct 08 20:51:42.342180 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 20:51:42.342180 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 20:51:42.342180 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 20:51:42.342180 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 20:51:42.342180 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 20:51:42.342180 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 20:51:42.342180 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 0eae5cc31fc7412292ec30a394e28863 Oct 08 20:51:42.342180 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1938712298 Oct 08 20:51:42.342180 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 20:51:42.342180 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 20:51:42.343515 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0eae5cc31fc7412292ec30a394e28863"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0eae5cc31fc7412292ec30a394e28863"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0eae5cc31fc7412292ec30a394e28863"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0eae5cc31fc7412292ec30a394e28863"}]}] Oct 08 20:51:42.343515 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1938712298 Oct 08 20:51:42.343515 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 0eae5cc31fc7412292ec30a394e28863 Oct 08 20:51:42.343515 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1938712298 Oct 08 20:51:42.343515 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-FlavorsAccessNegativeTestJSON-1938712298-project Oct 08 20:51:42.343515 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 20:51:42.343515 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 20:51:42.343515 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 61756ba79b6e4b7e96b93e16abcd0676 Oct 08 20:51:42.343515 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1938712298-project Oct 08 20:51:42.343515 ncdv-master-1 devstack@n-api.service[140492]: Oct 08 20:51:42.343515 ncdv-master-1 devstack@n-api.service[140492]: {"removeTenantAccess": {"tenant": "0eae5cc31fc7412292ec30a394e28863"}} Oct 08 20:51:42.343515 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 20:51:42.344110 ncdv-master-1 devstack@n-api.service[140492]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 08 20:51:42.344110 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': '1150631720', 'body': {'removeTenantAccess': {'tenant': '0eae5cc31fc7412292ec30a394e28863'}}} Oct 08 20:51:42.344110 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:51:42.344110 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:51:42.344110 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:51:42.344110 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:51:42.344110 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:51:42.344110 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:51:42.344110 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:51:42.344110 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:51:42.344110 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 20:51:42.344110 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 20:51:42.344110 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Oct 08 20:51:42.344110 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi context.can( Oct 08 20:51:42.344110 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 08 20:51:42.344110 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 08 20:51:42.344110 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 08 20:51:42.344110 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 08 20:51:42.344110 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 08 20:51:42.344110 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 08 20:51:42.345072 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 08 20:51:42.345072 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise self.value Oct 08 20:51:42.345072 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 08 20:51:42.345072 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 08 20:51:42.345072 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 08 20:51:42.345072 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 08 20:51:42.345072 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 08 20:51:42.345072 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 08 20:51:42.345072 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 08 20:51:42.345072 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:51:42.345072 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:51:42.345072 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:51:42.345072 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:51:42.345072 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:51:42.345072 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:51:42.345072 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 08 20:51:42.345072 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 08 20:51:42.345072 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 08 20:51:42.345072 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:51:42.346818 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e5e3ca22-8496-4ac8-bb12-cf6856e4314f tempest-FlavorsAccessNegativeTestJSON-1938712298 tempest-FlavorsAccessNegativeTestJSON-1938712298-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:51:42.347657 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-e5e3ca22-8496-4ac8-bb12-cf6856e4314f tempest-FlavorsAccessNegativeTestJSON-1938712298 tempest-FlavorsAccessNegativeTestJSON-1938712298-project] 10.222.0.26 "POST /compute/v2.1/flavors/1150631720/action" status: 403 len: 133 microversion: 2.1 time: 0.030676 Oct 08 20:51:42.349917 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 31/75] 10.222.0.26 () {60 vars in 1200 bytes} [Sat Oct 8 20:51:42 2022] POST /compute/v2.1/flavors/1150631720/action => generated 133 bytes in 33 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 08 20:51:42.361385 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-4edc7abe-cc6b-4c34-8f59-7480fe22b115 tempest-FlavorsAccessNegativeTestJSON-459130796 tempest-FlavorsAccessNegativeTestJSON-459130796-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "0eae5cc31fc7412292ec30a394e28863"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:51:42.985679 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-4edc7abe-cc6b-4c34-8f59-7480fe22b115 tempest-FlavorsAccessNegativeTestJSON-459130796 tempest-FlavorsAccessNegativeTestJSON-459130796-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors/1150631720/action" status: 200 len: 21 microversion: 2.1 time: 0.630354 Oct 08 20:51:42.987082 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 45/76] 10.222.0.26 () {60 vars in 1200 bytes} [Sat Oct 8 20:51:42 2022] POST /compute/v2.1/flavors/1150631720/action => generated 21 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 08 20:51:42.997067 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-54334510-af22-4b07-a0a5-09d11a40c4ad tempest-FlavorsAccessNegativeTestJSON-459130796 tempest-FlavorsAccessNegativeTestJSON-459130796-project-admin] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:51:43.018571 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-54334510-af22-4b07-a0a5-09d11a40c4ad tempest-FlavorsAccessNegativeTestJSON-459130796 tempest-FlavorsAccessNegativeTestJSON-459130796-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/1150631720" status: 202 len: 0 microversion: 2.1 time: 0.024988 Oct 08 20:51:43.019461 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 32/77] 10.222.0.26 () {58 vars in 1161 bytes} [Sat Oct 8 20:51:42 2022] DELETE /compute/v2.1/flavors/1150631720 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 08 20:51:43.027830 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-4ca430b9-d2ca-47cb-a93e-73e1b8ac6876 tempest-FlavorsAccessNegativeTestJSON-459130796 tempest-FlavorsAccessNegativeTestJSON-459130796-project-admin] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:51:43.035256 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:INSERT=9,nova_api:SELECT=78,nova_api:DELETE=13 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:51:43.059652 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-4ca430b9-d2ca-47cb-a93e-73e1b8ac6876 tempest-FlavorsAccessNegativeTestJSON-459130796 tempest-FlavorsAccessNegativeTestJSON-459130796-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.035959 Oct 08 20:51:43.060499 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 46/78] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Oct 8 20:51:43 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 20:51:43.081481 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-3136bcfc-a4d5-4430-a554-555ca0cfab34 tempest-FlavorsAccessNegativeTestJSON-459130796 tempest-FlavorsAccessNegativeTestJSON-459130796-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-129772775", "id": 703268268, "os-flavor-access:is_public": "False"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:51:43.113338 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-3136bcfc-a4d5-4430-a554-555ca0cfab34 tempest-FlavorsAccessNegativeTestJSON-459130796 tempest-FlavorsAccessNegativeTestJSON-459130796-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.036093 Oct 08 20:51:43.114438 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 33/79] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 20:51:43 2022] POST /compute/v2.1/flavors => generated 435 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:51:43.127668 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-7f80346e-0216-4ac6-8f65-9ea1f26ed2b0 tempest-FlavorsAccessNegativeTestJSON-459130796 tempest-FlavorsAccessNegativeTestJSON-459130796-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "482fd4a7abb2475b90f6ce367fdf296d"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:51:43.336285 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-9649ec39-f8ac-458f-bd78-462dbcaa011d tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:51:43.337888 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-9649ec39-f8ac-458f-bd78-462dbcaa011d tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] [instance: bbff4ffb-395f-4eeb-a995-60c9c0f39f25] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:51:43.838634 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-7f80346e-0216-4ac6-8f65-9ea1f26ed2b0 tempest-FlavorsAccessNegativeTestJSON-459130796 tempest-FlavorsAccessNegativeTestJSON-459130796-project-admin] HTTP exception thrown: Flavor access not found for 21 / 482fd4a7abb2475b90f6ce367fdf296d combination. Oct 08 20:51:43.841722 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-7f80346e-0216-4ac6-8f65-9ea1f26ed2b0 tempest-FlavorsAccessNegativeTestJSON-459130796 tempest-FlavorsAccessNegativeTestJSON-459130796-project-admin] Request method failure captured: Oct 08 20:51:43.841722 ncdv-master-1 devstack@n-api.service[140491]: request: POST /compute/v2.1/flavors/703268268/action HTTP/1.1 Oct 08 20:51:43.841722 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 20:51:43.841722 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 20:51:43.841722 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 20:51:43.841722 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 70 Oct 08 20:51:43.841722 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 20:51:43.841722 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 20:51:43.841722 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 20:51:43.841722 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 20:51:43.841722 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeLYdm2mn8FjsJOz8lf2BTMxDYH51lOZQ7fXdzkkyYZkc7J3KsW1kgbontCby0fL-MXJ3V5HTTbxk5vsFt9Gg2moDm3KtN3Anvxnly2_RUOXy-AmomZwXdcluRUzzJoCdOjq1ijlGEdcNA9mGB3IXoA-OA3FQp212Kls82kxFMfhAfc Oct 08 20:51:43.841722 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 20:51:43.841722 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 20:51:43.841722 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 20:51:43.841722 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 20:51:43.841722 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 20:51:43.841722 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 20:51:43.841722 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 82c66519e0dd4ef29876400cd42c0729 Oct 08 20:51:43.841722 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-459130796 Oct 08 20:51:43.841722 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,admin,member Oct 08 20:51:43.841722 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,admin,member Oct 08 20:51:43.842860 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/82c66519e0dd4ef29876400cd42c0729"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/82c66519e0dd4ef29876400cd42c0729"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_82c66519e0dd4ef29876400cd42c0729"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/82c66519e0dd4ef29876400cd42c0729"}]}] Oct 08 20:51:43.842860 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-459130796 Oct 08 20:51:43.842860 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 82c66519e0dd4ef29876400cd42c0729 Oct 08 20:51:43.842860 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-459130796 Oct 08 20:51:43.842860 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-FlavorsAccessNegativeTestJSON-459130796-project-admin Oct 08 20:51:43.842860 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 20:51:43.842860 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 20:51:43.842860 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 98f9c672a2164e76b458973a66b6203b Oct 08 20:51:43.842860 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-459130796-project-admin Oct 08 20:51:43.842860 ncdv-master-1 devstack@n-api.service[140491]: Oct 08 20:51:43.842860 ncdv-master-1 devstack@n-api.service[140491]: {"removeTenantAccess": {"tenant": "482fd4a7abb2475b90f6ce367fdf296d"}} Oct 08 20:51:43.842860 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 20:51:43.843490 ncdv-master-1 devstack@n-api.service[140491]: exception: Flavor access not found for 21 / 482fd4a7abb2475b90f6ce367fdf296d combination. Oct 08 20:51:43.843490 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': '703268268', 'body': {'removeTenantAccess': {'tenant': '482fd4a7abb2475b90f6ce367fdf296d'}}} Oct 08 20:51:43.843490 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:51:43.843490 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:51:43.843490 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Oct 08 20:51:43.843490 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Oct 08 20:51:43.843490 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 08 20:51:43.843490 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 08 20:51:43.843490 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Oct 08 20:51:43.843490 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Oct 08 20:51:43.843490 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Oct 08 20:51:43.843490 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Oct 08 20:51:43.843490 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Oct 08 20:51:43.843490 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Oct 08 20:51:43.843490 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 08 20:51:43.843490 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 08 20:51:43.843490 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Oct 08 20:51:43.843490 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Oct 08 20:51:43.844700 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 21 / 482fd4a7abb2475b90f6ce367fdf296d combination. Oct 08 20:51:43.844700 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:51:43.844700 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:51:43.844700 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:51:43.844700 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:51:43.844700 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:51:43.844700 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:51:43.844700 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:51:43.844700 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:51:43.844700 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:51:43.844700 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:51:43.844700 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 20:51:43.844700 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 20:51:43.844700 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Oct 08 20:51:43.844700 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 08 20:51:43.844700 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 21 / 482fd4a7abb2475b90f6ce367fdf296d combination. Oct 08 20:51:43.844700 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:51:43.844700 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:51:43.844700 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:51:43.844700 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:51:43.846229 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:51:43.846229 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:51:43.846229 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 20:51:43.846229 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 20:51:43.846229 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 21 / 482fd4a7abb2475b90f6ce367fdf296d combination. Oct 08 20:51:43.846229 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:51:43.846229 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-7f80346e-0216-4ac6-8f65-9ea1f26ed2b0 tempest-FlavorsAccessNegativeTestJSON-459130796 tempest-FlavorsAccessNegativeTestJSON-459130796-project-admin] Returning 404 to user: Flavor access not found for 21 / 482fd4a7abb2475b90f6ce367fdf296d combination. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:51:43.846229 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-7f80346e-0216-4ac6-8f65-9ea1f26ed2b0 tempest-FlavorsAccessNegativeTestJSON-459130796 tempest-FlavorsAccessNegativeTestJSON-459130796-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors/703268268/action" status: 404 len: 124 microversion: 2.1 time: 0.720591 Oct 08 20:51:43.847288 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 47/80] 10.222.0.26 () {60 vars in 1197 bytes} [Sat Oct 8 20:51:43 2022] POST /compute/v2.1/flavors/703268268/action => generated 124 bytes in 725 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 20:51:44.243512 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-f3703419-4feb-41ea-91bd-aaa237711b59 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1731879586", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:51:44.311786 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.network.neutron [None req-f3703419-4feb-41ea-91bd-aaa237711b59 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] validate_networks() for None {{(pid=140491) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 20:51:44.563116 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-f3703419-4feb-41ea-91bd-aaa237711b59 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Flavor limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 20:51:44.563703 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-f3703419-4feb-41ea-91bd-aaa237711b59 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Image limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 20:51:44.564219 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-f3703419-4feb-41ea-91bd-aaa237711b59 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Flavor pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 20:51:44.565060 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-f3703419-4feb-41ea-91bd-aaa237711b59 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Image pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 20:51:44.565829 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-f3703419-4feb-41ea-91bd-aaa237711b59 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 20:51:44.578754 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f3703419-4feb-41ea-91bd-aaa237711b59 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:51:44.579252 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f3703419-4feb-41ea-91bd-aaa237711b59 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:51:44.579784 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f3703419-4feb-41ea-91bd-aaa237711b59 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:51:44.581541 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f3703419-4feb-41ea-91bd-aaa237711b59 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:51:44.582413 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f3703419-4feb-41ea-91bd-aaa237711b59 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:51:44.583294 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f3703419-4feb-41ea-91bd-aaa237711b59 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:51:44.734497 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-9649ec39-f8ac-458f-bd78-462dbcaa011d tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8da7d5210cf42bda150d342ff207bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd024396aef784f3291630c426a828cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:51:44.769074 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-9649ec39-f8ac-458f-bd78-462dbcaa011d tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] 10.222.0.26 "GET /compute/v2.1/servers/bbff4ffb-395f-4eeb-a995-60c9c0f39f25" status: 200 len: 1243 microversion: 2.1 time: 1.437912 Oct 08 20:51:44.771910 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 34/81] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:51:43 2022] GET /compute/v2.1/servers/bbff4ffb-395f-4eeb-a995-60c9c0f39f25 => generated 1243 bytes in 1442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:51:44.779062 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-05a6117d-9aea-4e33-a4eb-9e6ff63475ac tempest-FlavorsAccessNegativeTestJSON-459130796 tempest-FlavorsAccessNegativeTestJSON-459130796-project-admin] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:51:44.821675 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-05a6117d-9aea-4e33-a4eb-9e6ff63475ac tempest-FlavorsAccessNegativeTestJSON-459130796 tempest-FlavorsAccessNegativeTestJSON-459130796-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/703268268" status: 202 len: 0 microversion: 2.1 time: 0.048317 Oct 08 20:51:44.822265 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 35/82] 10.222.0.26 () {58 vars in 1158 bytes} [Sat Oct 8 20:51:44 2022] DELETE /compute/v2.1/flavors/703268268 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 20:51:44.835502 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-eb96ce26-1683-4cc5-bcc9-31176ea5b137 tempest-FlavorsAccessNegativeTestJSON-459130796 tempest-FlavorsAccessNegativeTestJSON-459130796-project-admin] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:51:44.873452 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-f3703419-4feb-41ea-91bd-aaa237711b59 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Getting quotas for project 18029da9b9854f3caf3debd9556f1f24. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 20:51:44.878133 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-eb96ce26-1683-4cc5-bcc9-31176ea5b137 tempest-FlavorsAccessNegativeTestJSON-459130796 tempest-FlavorsAccessNegativeTestJSON-459130796-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.051455 Oct 08 20:51:44.878908 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 36/83] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Oct 8 20:51:44 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:51:44.924674 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-f3703419-4feb-41ea-91bd-aaa237711b59 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Getting quotas for user c0eb2feb062947e78357b70e832e3edc and project 18029da9b9854f3caf3debd9556f1f24. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 20:51:44.954855 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-f3703419-4feb-41ea-91bd-aaa237711b59 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Going to run 1 instances... {{(pid=140491) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 20:51:44.960732 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-f3703419-4feb-41ea-91bd-aaa237711b59 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] [instance: 6611e099-c1f0-4fed-ba7b-0b096800946d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c508bd7f-7db9-4b2c-af7c-be54a855c355',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140491) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 20:51:45.063667 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-f3703419-4feb-41ea-91bd-aaa237711b59 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.214765 Oct 08 20:51:45.065899 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 48/84] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 20:51:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 1218 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 08 20:51:45.077218 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-fbac6bb1-8cac-464a-87c7-f74c57893c14 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:51:45.078067 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-fbac6bb1-8cac-464a-87c7-f74c57893c14 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] [instance: 6611e099-c1f0-4fed-ba7b-0b096800946d] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:51:45.164512 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-fbac6bb1-8cac-464a-87c7-f74c57893c14 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0eb2feb062947e78357b70e832e3edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18029da9b9854f3caf3debd9556f1f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:51:45.172250 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-fbac6bb1-8cac-464a-87c7-f74c57893c14 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] 10.222.0.26 "GET /compute/v2.1/servers/6611e099-c1f0-4fed-ba7b-0b096800946d" status: 200 len: 1220 microversion: 2.1 time: 0.098507 Oct 08 20:51:45.172821 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 37/85] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:51:45 2022] GET /compute/v2.1/servers/6611e099-c1f0-4fed-ba7b-0b096800946d => generated 1220 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:51:45.798247 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-3ff92f08-06da-4861-b69f-0c7e7122e7e0 tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:51:45.799769 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-3ff92f08-06da-4861-b69f-0c7e7122e7e0 tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] [instance: bbff4ffb-395f-4eeb-a995-60c9c0f39f25] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:51:45.815132 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3ff92f08-06da-4861-b69f-0c7e7122e7e0 tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:51:45.815875 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3ff92f08-06da-4861-b69f-0c7e7122e7e0 tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:51:45.816869 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3ff92f08-06da-4861-b69f-0c7e7122e7e0 tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:51:45.820011 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3ff92f08-06da-4861-b69f-0c7e7122e7e0 tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:51:45.821816 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3ff92f08-06da-4861-b69f-0c7e7122e7e0 tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:51:45.823986 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3ff92f08-06da-4861-b69f-0c7e7122e7e0 tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:51:46.098438 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-3ff92f08-06da-4861-b69f-0c7e7122e7e0 tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8da7d5210cf42bda150d342ff207bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd024396aef784f3291630c426a828cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:51:46.123175 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-3ff92f08-06da-4861-b69f-0c7e7122e7e0 tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] 10.222.0.26 "GET /compute/v2.1/servers/bbff4ffb-395f-4eeb-a995-60c9c0f39f25" status: 200 len: 1297 microversion: 2.1 time: 0.331604 Oct 08 20:51:46.126020 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 49/86] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:51:45 2022] GET /compute/v2.1/servers/bbff4ffb-395f-4eeb-a995-60c9c0f39f25 => generated 1297 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:51:46.203293 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-59e5b29e-7c9e-4f7b-9f8f-e48b9be8c3be tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:51:46.205969 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-59e5b29e-7c9e-4f7b-9f8f-e48b9be8c3be tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] [instance: 6611e099-c1f0-4fed-ba7b-0b096800946d] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:51:46.232572 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-59e5b29e-7c9e-4f7b-9f8f-e48b9be8c3be tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:51:46.233400 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-59e5b29e-7c9e-4f7b-9f8f-e48b9be8c3be tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:51:46.233876 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-59e5b29e-7c9e-4f7b-9f8f-e48b9be8c3be tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:51:46.235834 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-59e5b29e-7c9e-4f7b-9f8f-e48b9be8c3be tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:51:46.236605 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-59e5b29e-7c9e-4f7b-9f8f-e48b9be8c3be tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:51:46.237595 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-59e5b29e-7c9e-4f7b-9f8f-e48b9be8c3be tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:51:46.368655 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-59e5b29e-7c9e-4f7b-9f8f-e48b9be8c3be tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0eb2feb062947e78357b70e832e3edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18029da9b9854f3caf3debd9556f1f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:51:46.381606 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-59e5b29e-7c9e-4f7b-9f8f-e48b9be8c3be tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] 10.222.0.26 "GET /compute/v2.1/servers/6611e099-c1f0-4fed-ba7b-0b096800946d" status: 200 len: 1224 microversion: 2.1 time: 0.187517 Oct 08 20:51:46.385702 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 50/87] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:51:46 2022] GET /compute/v2.1/servers/6611e099-c1f0-4fed-ba7b-0b096800946d => generated 1224 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:51:46.922404 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-48e4432f-dff2-4768-9783-6e0526480aae tempest-HostsAdminTestJSON-169666208 tempest-HostsAdminTestJSON-169666208-project-admin] Calling method '.version_select at 0x7f1a8d630ee0>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:51:46.925637 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-d1916184-219d-4365-a61e-5cb62619e015 tempest-QuotasAdminNegativeTest-1295979369 tempest-QuotasAdminNegativeTest-1295979369-project-admin] Calling method '.version_select at 0x7f1a8d5e38b0>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:51:46.927676 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-48e4432f-dff2-4768-9783-6e0526480aae tempest-HostsAdminTestJSON-169666208 tempest-HostsAdminTestJSON-169666208-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:51:46.931820 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-48e4432f-dff2-4768-9783-6e0526480aae tempest-HostsAdminTestJSON-169666208 tempest-HostsAdminTestJSON-169666208-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:51:46.932933 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-48e4432f-dff2-4768-9783-6e0526480aae tempest-HostsAdminTestJSON-169666208 tempest-HostsAdminTestJSON-169666208-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:51:46.934085 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-48e4432f-dff2-4768-9783-6e0526480aae tempest-HostsAdminTestJSON-169666208 tempest-HostsAdminTestJSON-169666208-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:51:46.936002 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-48e4432f-dff2-4768-9783-6e0526480aae tempest-HostsAdminTestJSON-169666208 tempest-HostsAdminTestJSON-169666208-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:51:46.938354 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-48e4432f-dff2-4768-9783-6e0526480aae tempest-HostsAdminTestJSON-169666208 tempest-HostsAdminTestJSON-169666208-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:51:47.078558 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-48e4432f-dff2-4768-9783-6e0526480aae tempest-HostsAdminTestJSON-169666208 tempest-HostsAdminTestJSON-169666208-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hosts" status: 200 len: 401 microversion: 2.1 time: 1.000413 Oct 08 20:51:47.096323 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 38/88] 10.222.0.26 () {58 vars in 1128 bytes} [Sat Oct 8 20:51:46 2022] GET /compute/v2.1/os-hosts => generated 401 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:51:47.128097 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-b0288146-60ab-4fdb-a73f-270ad8be4109 tempest-HostsAdminTestJSON-169666208 tempest-HostsAdminTestJSON-169666208-project-admin] Calling method '.version_select at 0x7f1a8d641940>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:51:47.147057 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b0288146-60ab-4fdb-a73f-270ad8be4109 tempest-HostsAdminTestJSON-169666208 tempest-HostsAdminTestJSON-169666208-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:51:47.149254 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b0288146-60ab-4fdb-a73f-270ad8be4109 tempest-HostsAdminTestJSON-169666208 tempest-HostsAdminTestJSON-169666208-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:51:47.150142 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b0288146-60ab-4fdb-a73f-270ad8be4109 tempest-HostsAdminTestJSON-169666208 tempest-HostsAdminTestJSON-169666208-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:51:47.153329 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b0288146-60ab-4fdb-a73f-270ad8be4109 tempest-HostsAdminTestJSON-169666208 tempest-HostsAdminTestJSON-169666208-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:51:47.159796 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b0288146-60ab-4fdb-a73f-270ad8be4109 tempest-HostsAdminTestJSON-169666208 tempest-HostsAdminTestJSON-169666208-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:51:47.161627 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b0288146-60ab-4fdb-a73f-270ad8be4109 tempest-HostsAdminTestJSON-169666208 tempest-HostsAdminTestJSON-169666208-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:51:47.255041 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-b0288146-60ab-4fdb-a73f-270ad8be4109 tempest-HostsAdminTestJSON-169666208 tempest-HostsAdminTestJSON-169666208-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 401 microversion: 2.1 time: 0.156963 Oct 08 20:51:47.255906 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 39/89] 10.222.0.26 () {58 vars in 1139 bytes} [Sat Oct 8 20:51:47 2022] GET /compute/v2.1/os-hosts?zone= => generated 401 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:51:47.261342 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-51694003-052d-43d0-a792-582f38f96e1d tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:51:47.262240 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-51694003-052d-43d0-a792-582f38f96e1d tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] [instance: bbff4ffb-395f-4eeb-a995-60c9c0f39f25] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:51:47.271859 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-51694003-052d-43d0-a792-582f38f96e1d tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:51:47.272898 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-51694003-052d-43d0-a792-582f38f96e1d tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:51:47.274060 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-51694003-052d-43d0-a792-582f38f96e1d tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:51:47.275677 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-51694003-052d-43d0-a792-582f38f96e1d tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:51:47.276395 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-51694003-052d-43d0-a792-582f38f96e1d tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:51:47.277070 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-51694003-052d-43d0-a792-582f38f96e1d tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:51:48.128700 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-d1916184-219d-4365-a61e-5cb62619e015 tempest-QuotasAdminNegativeTest-1295979369 tempest-QuotasAdminNegativeTest-1295979369-project-admin] 10.222.0.26 "GET /compute/v2.1/os-quota-sets/00d9071ba2e34475baf046a4c42f9889" status: 200 len: 371 microversion: 2.1 time: 1.582653 Oct 08 20:51:48.132540 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 51/90] 10.222.0.26 () {58 vars in 1242 bytes} [Sat Oct 8 20:51:46 2022] GET /compute/v2.1/os-quota-sets/00d9071ba2e34475baf046a4c42f9889 => generated 371 bytes in 1589 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 08 20:51:48.156778 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-235f439a-0f79-452a-821b-44560abc0899 tempest-HostsAdminTestJSON-169666208 tempest-HostsAdminTestJSON-169666208-project-admin] Calling method '.version_select at 0x7f1a8d5ed5e0>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:51:48.168136 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-235f439a-0f79-452a-821b-44560abc0899 tempest-HostsAdminTestJSON-169666208 tempest-HostsAdminTestJSON-169666208-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:51:48.170441 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-235f439a-0f79-452a-821b-44560abc0899 tempest-HostsAdminTestJSON-169666208 tempest-HostsAdminTestJSON-169666208-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:51:48.172923 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-235f439a-0f79-452a-821b-44560abc0899 tempest-HostsAdminTestJSON-169666208 tempest-HostsAdminTestJSON-169666208-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:51:48.174962 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-235f439a-0f79-452a-821b-44560abc0899 tempest-HostsAdminTestJSON-169666208 tempest-HostsAdminTestJSON-169666208-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:51:48.176920 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-235f439a-0f79-452a-821b-44560abc0899 tempest-HostsAdminTestJSON-169666208 tempest-HostsAdminTestJSON-169666208-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:51:48.177979 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-235f439a-0f79-452a-821b-44560abc0899 tempest-HostsAdminTestJSON-169666208 tempest-HostsAdminTestJSON-169666208-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:51:48.266252 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-235f439a-0f79-452a-821b-44560abc0899 tempest-HostsAdminTestJSON-169666208 tempest-HostsAdminTestJSON-169666208-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.131155 Oct 08 20:51:48.269947 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 52/91] 10.222.0.26 () {58 vars in 1145 bytes} [Sat Oct 8 20:51:48 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 08 20:51:48.283424 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-55e69e36-ca6b-4935-aa97-8b9fb2a9335d tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:51:48.289063 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-55e69e36-ca6b-4935-aa97-8b9fb2a9335d tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] [instance: 6611e099-c1f0-4fed-ba7b-0b096800946d] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:51:48.303938 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-55e69e36-ca6b-4935-aa97-8b9fb2a9335d tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:51:48.307314 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-55e69e36-ca6b-4935-aa97-8b9fb2a9335d tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:51:48.308890 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-55e69e36-ca6b-4935-aa97-8b9fb2a9335d tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:51:48.311654 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-55e69e36-ca6b-4935-aa97-8b9fb2a9335d tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:51:48.313823 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-55e69e36-ca6b-4935-aa97-8b9fb2a9335d tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:51:48.314917 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-55e69e36-ca6b-4935-aa97-8b9fb2a9335d tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:51:48.476794 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-51694003-052d-43d0-a792-582f38f96e1d tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8da7d5210cf42bda150d342ff207bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd024396aef784f3291630c426a828cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:51:48.500291 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-51694003-052d-43d0-a792-582f38f96e1d tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] 10.222.0.26 "GET /compute/v2.1/servers/bbff4ffb-395f-4eeb-a995-60c9c0f39f25" status: 200 len: 1339 microversion: 2.1 time: 1.242482 Oct 08 20:51:48.503872 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 40/92] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:51:47 2022] GET /compute/v2.1/servers/bbff4ffb-395f-4eeb-a995-60c9c0f39f25 => generated 1339 bytes in 1247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:51:48.516439 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-79fe062d-e480-4756-aec4-a32a1ac0f9e0 tempest-QuotasAdminNegativeTest-1295979369 tempest-QuotasAdminNegativeTest-1295979369-project-admin] Action: 'update', calling method: .version_select at 0x7f1a8d5d79d0>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:51:48.531849 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-55e69e36-ca6b-4935-aa97-8b9fb2a9335d tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0eb2feb062947e78357b70e832e3edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18029da9b9854f3caf3debd9556f1f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:51:48.555308 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-55e69e36-ca6b-4935-aa97-8b9fb2a9335d tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] 10.222.0.26 "GET /compute/v2.1/servers/6611e099-c1f0-4fed-ba7b-0b096800946d" status: 200 len: 1278 microversion: 2.1 time: 0.278267 Oct 08 20:51:48.569663 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 53/93] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:51:48 2022] GET /compute/v2.1/servers/6611e099-c1f0-4fed-ba7b-0b096800946d => generated 1278 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:51:49.262381 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-0bb0fc23-aea7-45d6-aff5-f739bee62545 tempest-InstanceUsageAuditLogNegativeTestJSON-403882211 tempest-InstanceUsageAuditLogNegativeTestJSON-403882211-project-admin] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:51:49.267143 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-0bb0fc23-aea7-45d6-aff5-f739bee62545 tempest-InstanceUsageAuditLogNegativeTestJSON-403882211 tempest-InstanceUsageAuditLogNegativeTestJSON-403882211-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Oct 08 20:51:49.273515 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-0bb0fc23-aea7-45d6-aff5-f739bee62545 tempest-InstanceUsageAuditLogNegativeTestJSON-403882211 tempest-InstanceUsageAuditLogNegativeTestJSON-403882211-project-admin] Request method failure captured: Oct 08 20:51:49.273515 ncdv-master-1 devstack@n-api.service[140491]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Oct 08 20:51:49.273515 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 20:51:49.273515 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 20:51:49.273515 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 20:51:49.273515 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 20:51:49.273515 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 20:51:49.273515 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 20:51:49.273515 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 20:51:49.273515 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 20:51:49.273515 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeLk9wDX2FqWs-AwOkr3Wif3k35ITkvzqA-_aaKfJhLpb2IlhGOKOTpB9_GinF2XxqrMGiPiwPBUSvGidDpILo2xLpOAw4HFanbJhBnCAuk8MXQBSIaDjhlBmuwk4YvCUK4t-1BzGfIynYju_gpUIUlatQCTIVa8uFP44x-YSsDbRY0 Oct 08 20:51:49.273515 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 20:51:49.273515 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 20:51:49.273515 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 20:51:49.273515 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 20:51:49.273515 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 20:51:49.273515 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 20:51:49.273515 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: dce8bee46a4746e7a9e9eea8ee41f96f Oct 08 20:51:49.273515 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-403882211 Oct 08 20:51:49.273515 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,admin,member Oct 08 20:51:49.273515 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,admin,member Oct 08 20:51:49.274790 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/dce8bee46a4746e7a9e9eea8ee41f96f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/dce8bee46a4746e7a9e9eea8ee41f96f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_dce8bee46a4746e7a9e9eea8ee41f96f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/dce8bee46a4746e7a9e9eea8ee41f96f"}]}] Oct 08 20:51:49.274790 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-403882211 Oct 08 20:51:49.274790 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: dce8bee46a4746e7a9e9eea8ee41f96f Oct 08 20:51:49.274790 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-403882211 Oct 08 20:51:49.274790 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-403882211-project-admin Oct 08 20:51:49.274790 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 20:51:49.274790 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 20:51:49.274790 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 65fcc45a91984476a8164a59a1e2ddfa Oct 08 20:51:49.274790 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-403882211-project-admin Oct 08 20:51:49.274790 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 20:51:49.274790 ncdv-master-1 devstack@n-api.service[140491]: exception: Invalid timestamp for date invalid_time Oct 08 20:51:49.275418 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': 'invalid_time'} Oct 08 20:51:49.275418 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:51:49.275418 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:51:49.275418 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Oct 08 20:51:49.275418 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Oct 08 20:51:49.275418 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Oct 08 20:51:49.275418 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Oct 08 20:51:49.275418 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Oct 08 20:51:49.275418 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Oct 08 20:51:49.275418 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Oct 08 20:51:49.275418 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:51:49.275418 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:51:49.275418 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:51:49.275418 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:51:49.275418 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:51:49.275418 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:51:49.275418 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:51:49.275418 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:51:49.275418 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:51:49.275418 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:51:49.276463 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Oct 08 20:51:49.276463 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Oct 08 20:51:49.276463 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Oct 08 20:51:49.276463 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:51:49.276463 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:51:49.276463 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:51:49.276463 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:51:49.276463 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:51:49.276463 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:51:49.276463 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 20:51:49.276463 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 20:51:49.276463 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Oct 08 20:51:49.276463 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:51:49.279251 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-0bb0fc23-aea7-45d6-aff5-f739bee62545 tempest-InstanceUsageAuditLogNegativeTestJSON-403882211 tempest-InstanceUsageAuditLogNegativeTestJSON-403882211-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:51:49.280523 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-0bb0fc23-aea7-45d6-aff5-f739bee62545 tempest-InstanceUsageAuditLogNegativeTestJSON-403882211 tempest-InstanceUsageAuditLogNegativeTestJSON-403882211-project-admin] 10.222.0.26 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.596700 Oct 08 20:51:49.284178 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-79fe062d-e480-4756-aec4-a32a1ac0f9e0 tempest-QuotasAdminNegativeTest-1295979369 tempest-QuotasAdminNegativeTest-1295979369-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:51:49.284654 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 54/94] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Oct 8 20:51:48 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 601 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 08 20:51:49.285450 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-79fe062d-e480-4756-aec4-a32a1ac0f9e0 tempest-QuotasAdminNegativeTest-1295979369 tempest-QuotasAdminNegativeTest-1295979369-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:51:49.286487 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-79fe062d-e480-4756-aec4-a32a1ac0f9e0 tempest-QuotasAdminNegativeTest-1295979369 tempest-QuotasAdminNegativeTest-1295979369-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:51:49.287513 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-79fe062d-e480-4756-aec4-a32a1ac0f9e0 tempest-QuotasAdminNegativeTest-1295979369 tempest-QuotasAdminNegativeTest-1295979369-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:51:49.288229 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-79fe062d-e480-4756-aec4-a32a1ac0f9e0 tempest-QuotasAdminNegativeTest-1295979369 tempest-QuotasAdminNegativeTest-1295979369-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:51:49.295323 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-79fe062d-e480-4756-aec4-a32a1ac0f9e0 tempest-QuotasAdminNegativeTest-1295979369 tempest-QuotasAdminNegativeTest-1295979369-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:51:49.594163 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-82f033fe-853a-48a7-bf2e-5b4745ef7cbc tempest-InstanceUsageAuditLogNegativeTestJSON-514576882 tempest-InstanceUsageAuditLogNegativeTestJSON-514576882-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:51:49.597113 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-82f033fe-853a-48a7-bf2e-5b4745ef7cbc tempest-InstanceUsageAuditLogNegativeTestJSON-514576882 tempest-InstanceUsageAuditLogNegativeTestJSON-514576882-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': '741ac01d74dc40928be925f0c2468c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25e5719631704099bbe867f49e9cf46a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:51:49.614658 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-82f033fe-853a-48a7-bf2e-5b4745ef7cbc tempest-InstanceUsageAuditLogNegativeTestJSON-514576882 tempest-InstanceUsageAuditLogNegativeTestJSON-514576882-project] Request method failure captured: Oct 08 20:51:49.614658 ncdv-master-1 devstack@n-api.service[140491]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Oct 08 20:51:49.614658 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 20:51:49.614658 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 20:51:49.614658 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 20:51:49.614658 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 20:51:49.614658 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 20:51:49.614658 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 20:51:49.614658 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 20:51:49.614658 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 20:51:49.614658 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeLh59nFabJiBylVSmDXJ1joqoBFfxDUnioAISkPHt5ppxujJJAsPg8dATlG16xTUQ0uURWYEuSW3wGvHNHDWLtSkSHexV6AcSNXedb2WRuJBQesj3h4ksmpV5sUOutxJtGJNwVQ50n3HVON09jh0scxb69EQHl5hGa9C-HxyCe_k9I Oct 08 20:51:49.614658 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 20:51:49.614658 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 20:51:49.614658 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 20:51:49.614658 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 20:51:49.614658 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 20:51:49.614658 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 20:51:49.614658 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 25e5719631704099bbe867f49e9cf46a Oct 08 20:51:49.614658 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-514576882 Oct 08 20:51:49.614658 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 20:51:49.614658 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 20:51:49.616262 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/25e5719631704099bbe867f49e9cf46a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/25e5719631704099bbe867f49e9cf46a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_25e5719631704099bbe867f49e9cf46a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/25e5719631704099bbe867f49e9cf46a"}]}] Oct 08 20:51:49.616262 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-514576882 Oct 08 20:51:49.616262 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 25e5719631704099bbe867f49e9cf46a Oct 08 20:51:49.616262 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-514576882 Oct 08 20:51:49.616262 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-514576882-project Oct 08 20:51:49.616262 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 20:51:49.616262 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 20:51:49.616262 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 741ac01d74dc40928be925f0c2468c4b Oct 08 20:51:49.616262 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-514576882-project Oct 08 20:51:49.616262 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 20:51:49.616814 ncdv-master-1 devstack@n-api.service[140491]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 08 20:51:49.616814 ncdv-master-1 devstack@n-api.service[140491]: action_args: {} Oct 08 20:51:49.616814 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:51:49.616814 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:51:49.616814 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:51:49.616814 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:51:49.616814 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:51:49.616814 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:51:49.616814 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:51:49.616814 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:51:49.616814 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Oct 08 20:51:49.616814 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Oct 08 20:51:49.616814 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 08 20:51:49.616814 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 08 20:51:49.616814 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 08 20:51:49.616814 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 08 20:51:49.616814 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 08 20:51:49.616814 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 08 20:51:49.616814 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 08 20:51:49.616814 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise self.value Oct 08 20:51:49.617849 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 08 20:51:49.617849 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 08 20:51:49.617849 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 08 20:51:49.617849 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 08 20:51:49.617849 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 08 20:51:49.617849 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 08 20:51:49.617849 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 08 20:51:49.617849 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:51:49.617849 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:51:49.617849 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:51:49.617849 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:51:49.617849 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:51:49.617849 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:51:49.617849 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 08 20:51:49.617849 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 08 20:51:49.617849 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 08 20:51:49.617849 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:51:49.623034 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-82f033fe-853a-48a7-bf2e-5b4745ef7cbc tempest-InstanceUsageAuditLogNegativeTestJSON-514576882 tempest-InstanceUsageAuditLogNegativeTestJSON-514576882-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:51:49.632988 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-82f033fe-853a-48a7-bf2e-5b4745ef7cbc tempest-InstanceUsageAuditLogNegativeTestJSON-514576882 tempest-InstanceUsageAuditLogNegativeTestJSON-514576882-project] 10.222.0.26 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.342283 Oct 08 20:51:49.636712 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 55/95] 10.222.0.26 () {58 vars in 1185 bytes} [Sat Oct 8 20:51:49 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 348 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 08 20:51:49.658952 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-863e3ec2-85c7-4c2e-b07f-4f174f78c4dd tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:51:49.661934 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-863e3ec2-85c7-4c2e-b07f-4f174f78c4dd tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] [instance: bbff4ffb-395f-4eeb-a995-60c9c0f39f25] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:51:49.687050 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-863e3ec2-85c7-4c2e-b07f-4f174f78c4dd tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:51:49.695995 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-863e3ec2-85c7-4c2e-b07f-4f174f78c4dd tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:51:49.701139 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-863e3ec2-85c7-4c2e-b07f-4f174f78c4dd tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:51:49.704873 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-863e3ec2-85c7-4c2e-b07f-4f174f78c4dd tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:51:49.706903 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-863e3ec2-85c7-4c2e-b07f-4f174f78c4dd tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:51:49.709461 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-863e3ec2-85c7-4c2e-b07f-4f174f78c4dd tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:51:50.006335 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-79fe062d-e480-4756-aec4-a32a1ac0f9e0 tempest-QuotasAdminNegativeTest-1295979369 tempest-QuotasAdminNegativeTest-1295979369-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-quota-sets/00d9071ba2e34475baf046a4c42f9889" status: 200 len: 328 microversion: 2.1 time: 1.501076 Oct 08 20:51:50.021564 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 41/96] 10.222.0.26 () {60 vars in 1262 bytes} [Sat Oct 8 20:51:48 2022] PUT /compute/v2.1/os-quota-sets/00d9071ba2e34475baf046a4c42f9889 => generated 328 bytes in 1507 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:51:50.053653 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-987fe4de-45cb-4322-a543-4134e1016593 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:51:50.056513 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-987fe4de-45cb-4322-a543-4134e1016593 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] [instance: 6611e099-c1f0-4fed-ba7b-0b096800946d] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:51:50.077326 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-987fe4de-45cb-4322-a543-4134e1016593 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:51:50.083658 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-987fe4de-45cb-4322-a543-4134e1016593 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:51:50.085858 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-987fe4de-45cb-4322-a543-4134e1016593 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:51:50.092165 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-987fe4de-45cb-4322-a543-4134e1016593 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:51:50.093217 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-987fe4de-45cb-4322-a543-4134e1016593 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:51:50.094484 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-987fe4de-45cb-4322-a543-4134e1016593 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:51:50.204141 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-863e3ec2-85c7-4c2e-b07f-4f174f78c4dd tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8da7d5210cf42bda150d342ff207bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd024396aef784f3291630c426a828cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:51:50.215316 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-863e3ec2-85c7-4c2e-b07f-4f174f78c4dd tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] 10.222.0.26 "GET /compute/v2.1/servers/bbff4ffb-395f-4eeb-a995-60c9c0f39f25" status: 200 len: 1339 microversion: 2.1 time: 0.577164 Oct 08 20:51:50.219478 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 56/97] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:51:49 2022] GET /compute/v2.1/servers/bbff4ffb-395f-4eeb-a995-60c9c0f39f25 => generated 1339 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:51:50.230305 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-96f73aa7-7bf1-449d-82d3-ab31ded4954a tempest-InstanceUsageAuditLogNegativeTestJSON-514576882 tempest-InstanceUsageAuditLogNegativeTestJSON-514576882-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:51:50.236185 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-96f73aa7-7bf1-449d-82d3-ab31ded4954a tempest-InstanceUsageAuditLogNegativeTestJSON-514576882 tempest-InstanceUsageAuditLogNegativeTestJSON-514576882-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': '741ac01d74dc40928be925f0c2468c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25e5719631704099bbe867f49e9cf46a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:51:50.243857 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-96f73aa7-7bf1-449d-82d3-ab31ded4954a tempest-InstanceUsageAuditLogNegativeTestJSON-514576882 tempest-InstanceUsageAuditLogNegativeTestJSON-514576882-project] Request method failure captured: Oct 08 20:51:50.243857 ncdv-master-1 devstack@n-api.service[140491]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-10-08%2020:51:49 HTTP/1.1 Oct 08 20:51:50.243857 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 20:51:50.243857 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 20:51:50.243857 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 20:51:50.243857 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 20:51:50.243857 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 20:51:50.243857 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 20:51:50.243857 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 20:51:50.243857 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 20:51:50.243857 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeLh59nFabJiBylVSmDXJ1joqoBFfxDUnioAISkPHt5ppxujJJAsPg8dATlG16xTUQ0uURWYEuSW3wGvHNHDWLtSkSHexV6AcSNXedb2WRuJBQesj3h4ksmpV5sUOutxJtGJNwVQ50n3HVON09jh0scxb69EQHl5hGa9C-HxyCe_k9I Oct 08 20:51:50.243857 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 20:51:50.243857 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 20:51:50.243857 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 20:51:50.243857 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 20:51:50.243857 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 20:51:50.243857 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 20:51:50.243857 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 25e5719631704099bbe867f49e9cf46a Oct 08 20:51:50.243857 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-514576882 Oct 08 20:51:50.243857 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 20:51:50.243857 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 20:51:50.245428 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/25e5719631704099bbe867f49e9cf46a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/25e5719631704099bbe867f49e9cf46a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_25e5719631704099bbe867f49e9cf46a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/25e5719631704099bbe867f49e9cf46a"}]}] Oct 08 20:51:50.245428 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-514576882 Oct 08 20:51:50.245428 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 25e5719631704099bbe867f49e9cf46a Oct 08 20:51:50.245428 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-514576882 Oct 08 20:51:50.245428 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-514576882-project Oct 08 20:51:50.245428 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 20:51:50.245428 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 20:51:50.245428 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 741ac01d74dc40928be925f0c2468c4b Oct 08 20:51:50.245428 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-514576882-project Oct 08 20:51:50.245428 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 20:51:50.246071 ncdv-master-1 devstack@n-api.service[140491]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 08 20:51:50.246071 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': '2022-10-08 20:51:49'} Oct 08 20:51:50.246071 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:51:50.246071 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:51:50.246071 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:51:50.246071 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:51:50.246071 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:51:50.246071 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:51:50.246071 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:51:50.246071 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:51:50.246071 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Oct 08 20:51:50.246071 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Oct 08 20:51:50.246071 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 08 20:51:50.246071 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 08 20:51:50.246071 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 08 20:51:50.246071 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 08 20:51:50.246071 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 08 20:51:50.246071 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 08 20:51:50.246071 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 08 20:51:50.246071 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise self.value Oct 08 20:51:50.247389 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 08 20:51:50.247389 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 08 20:51:50.247389 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 08 20:51:50.247389 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 08 20:51:50.247389 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 08 20:51:50.247389 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 08 20:51:50.247389 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 08 20:51:50.247389 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:51:50.247389 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:51:50.247389 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:51:50.247389 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:51:50.247389 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:51:50.247389 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:51:50.247389 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 08 20:51:50.247389 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 08 20:51:50.247389 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 08 20:51:50.247389 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:51:50.248599 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-96f73aa7-7bf1-449d-82d3-ab31ded4954a tempest-InstanceUsageAuditLogNegativeTestJSON-514576882 tempest-InstanceUsageAuditLogNegativeTestJSON-514576882-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:51:50.248599 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-96f73aa7-7bf1-449d-82d3-ab31ded4954a tempest-InstanceUsageAuditLogNegativeTestJSON-514576882 tempest-InstanceUsageAuditLogNegativeTestJSON-514576882-project] 10.222.0.26 "GET /compute/v2.1/os-instance_usage_audit_log/2022-10-08 20:51:49" status: 403 len: 128 microversion: 2.1 time: 0.024894 Oct 08 20:51:50.259833 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 57/98] 10.222.0.26 () {58 vars in 1251 bytes} [Sat Oct 8 20:51:50 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-10-08%2020%3A51%3A49 => generated 128 bytes in 40 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 08 20:51:50.816671 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-05572c17-c58d-4677-bc2c-f1f5336efeb8 tempest-QuotasAdminNegativeTest-6339137 tempest-QuotasAdminNegativeTest-6339137-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1457487334", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:51:50.909923 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-987fe4de-45cb-4322-a543-4134e1016593 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0eb2feb062947e78357b70e832e3edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18029da9b9854f3caf3debd9556f1f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:51:50.925301 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-987fe4de-45cb-4322-a543-4134e1016593 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] 10.222.0.26 "GET /compute/v2.1/servers/6611e099-c1f0-4fed-ba7b-0b096800946d" status: 200 len: 1320 microversion: 2.1 time: 0.885777 Oct 08 20:51:50.938124 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 42/99] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:51:50 2022] GET /compute/v2.1/servers/6611e099-c1f0-4fed-ba7b-0b096800946d => generated 1320 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:51:51.891202 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-c07190e4-9c37-4241-ba52-60d2cdce368a req-6850fe53-a99d-46bc-94f0-768bea09d2dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbff4ffb-395f-4eeb-a995-60c9c0f39f25", "tag": "db211159-4f8e-47dc-b398-227f96a1444c"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:51:51.919939 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-c07190e4-9c37-4241-ba52-60d2cdce368a req-6850fe53-a99d-46bc-94f0-768bea09d2dc service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:51:51.920765 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-c07190e4-9c37-4241-ba52-60d2cdce368a req-6850fe53-a99d-46bc-94f0-768bea09d2dc service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:51:51.922056 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-c07190e4-9c37-4241-ba52-60d2cdce368a req-6850fe53-a99d-46bc-94f0-768bea09d2dc service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:51:51.944785 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-c07190e4-9c37-4241-ba52-60d2cdce368a req-6850fe53-a99d-46bc-94f0-768bea09d2dc service nova] Creating event network-changed:db211159-4f8e-47dc-b398-227f96a1444c for instance bbff4ffb-395f-4eeb-a995-60c9c0f39f25 on nch2-master-1 Oct 08 20:51:51.945653 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-c07190e4-9c37-4241-ba52-60d2cdce368a req-6850fe53-a99d-46bc-94f0-768bea09d2dc service nova] Acquiring lock "compute-rpcapi-router" {{(pid=140492) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 08 20:51:51.946225 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-c07190e4-9c37-4241-ba52-60d2cdce368a req-6850fe53-a99d-46bc-94f0-768bea09d2dc service nova] Acquired lock "compute-rpcapi-router" {{(pid=140492) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 08 20:51:51.947724 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bc802db2-4ead-4faf-adc4-51811161eac2 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:51:51.948370 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bc802db2-4ead-4faf-adc4-51811161eac2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:51:51.948963 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bc802db2-4ead-4faf-adc4-51811161eac2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:51:51.949887 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bc802db2-4ead-4faf-adc4-51811161eac2 None None] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:51:51.950511 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bc802db2-4ead-4faf-adc4-51811161eac2 None None] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:51:51.951273 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bc802db2-4ead-4faf-adc4-51811161eac2 None None] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:51:51.974017 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.compute.rpcapi [None req-bc802db2-4ead-4faf-adc4-51811161eac2 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 08 20:51:51.975184 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bc802db2-4ead-4faf-adc4-51811161eac2 None None] Releasing lock "compute-rpcapi-router" {{(pid=140492) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 08 20:51:52.007558 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-bc802db2-4ead-4faf-adc4-51811161eac2 None None] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.075604 Oct 08 20:51:52.010698 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 43/100] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:51:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:51:52.029145 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-06efe57e-f058-42f5-b669-734e4dad240c tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:51:52.030318 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-06efe57e-f058-42f5-b669-734e4dad240c tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] [instance: bbff4ffb-395f-4eeb-a995-60c9c0f39f25] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:51:52.040740 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-06efe57e-f058-42f5-b669-734e4dad240c tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:51:52.041538 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-06efe57e-f058-42f5-b669-734e4dad240c tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:51:52.042167 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-06efe57e-f058-42f5-b669-734e4dad240c tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:51:52.043486 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-06efe57e-f058-42f5-b669-734e4dad240c tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:51:52.045848 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-06efe57e-f058-42f5-b669-734e4dad240c tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:51:52.047086 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-06efe57e-f058-42f5-b669-734e4dad240c tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:51:52.768034 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-06efe57e-f058-42f5-b669-734e4dad240c tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8da7d5210cf42bda150d342ff207bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd024396aef784f3291630c426a828cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:51:52.777494 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-06efe57e-f058-42f5-b669-734e4dad240c tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] 10.222.0.26 "GET /compute/v2.1/servers/bbff4ffb-395f-4eeb-a995-60c9c0f39f25" status: 200 len: 1339 microversion: 2.1 time: 0.765318 Oct 08 20:51:52.795046 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 44/101] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:51:52 2022] GET /compute/v2.1/servers/bbff4ffb-395f-4eeb-a995-60c9c0f39f25 => generated 1339 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:51:52.810759 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-93ad1a0a-cb54-40de-bf5f-56c23aec9192 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:51:52.811620 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-93ad1a0a-cb54-40de-bf5f-56c23aec9192 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] [instance: 6611e099-c1f0-4fed-ba7b-0b096800946d] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:51:52.822006 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-93ad1a0a-cb54-40de-bf5f-56c23aec9192 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:51:52.838398 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-93ad1a0a-cb54-40de-bf5f-56c23aec9192 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:51:52.838714 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-93ad1a0a-cb54-40de-bf5f-56c23aec9192 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:51:52.839636 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-93ad1a0a-cb54-40de-bf5f-56c23aec9192 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:51:52.840606 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-93ad1a0a-cb54-40de-bf5f-56c23aec9192 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:51:52.840937 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-93ad1a0a-cb54-40de-bf5f-56c23aec9192 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:51:53.084207 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-93ad1a0a-cb54-40de-bf5f-56c23aec9192 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0eb2feb062947e78357b70e832e3edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18029da9b9854f3caf3debd9556f1f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:51:53.100405 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-93ad1a0a-cb54-40de-bf5f-56c23aec9192 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] 10.222.0.26 "GET /compute/v2.1/servers/6611e099-c1f0-4fed-ba7b-0b096800946d" status: 200 len: 1320 microversion: 2.1 time: 0.303448 Oct 08 20:51:53.104190 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 45/102] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:51:52 2022] GET /compute/v2.1/servers/6611e099-c1f0-4fed-ba7b-0b096800946d => generated 1320 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:51:53.764730 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-70d0113c-6d06-439f-b080-f19e4a889665 tempest-HypervisorAdminV253TestBase-1074841202 tempest-HypervisorAdminV253TestBase-1074841202-project-admin] Calling method '.version_select at 0x7f1a8d465dc0>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:51:53.771149 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-70d0113c-6d06-439f-b080-f19e4a889665 tempest-HypervisorAdminV253TestBase-1074841202 tempest-HypervisorAdminV253TestBase-1074841202-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:51:53.773067 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-70d0113c-6d06-439f-b080-f19e4a889665 tempest-HypervisorAdminV253TestBase-1074841202 tempest-HypervisorAdminV253TestBase-1074841202-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:51:53.774599 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-70d0113c-6d06-439f-b080-f19e4a889665 tempest-HypervisorAdminV253TestBase-1074841202 tempest-HypervisorAdminV253TestBase-1074841202-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:51:53.832320 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-70d0113c-6d06-439f-b080-f19e4a889665 tempest-HypervisorAdminV253TestBase-1074841202 tempest-HypervisorAdminV253TestBase-1074841202-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:51:53.832825 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-70d0113c-6d06-439f-b080-f19e4a889665 tempest-HypervisorAdminV253TestBase-1074841202 tempest-HypervisorAdminV253TestBase-1074841202-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:51:53.837850 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-70d0113c-6d06-439f-b080-f19e4a889665 tempest-HypervisorAdminV253TestBase-1074841202 tempest-HypervisorAdminV253TestBase-1074841202-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:51:53.915014 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-70d0113c-6d06-439f-b080-f19e4a889665 tempest-HypervisorAdminV253TestBase-1074841202 tempest-HypervisorAdminV253TestBase-1074841202-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:51:53.915754 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-70d0113c-6d06-439f-b080-f19e4a889665 tempest-HypervisorAdminV253TestBase-1074841202 tempest-HypervisorAdminV253TestBase-1074841202-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:51:53.916350 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-70d0113c-6d06-439f-b080-f19e4a889665 tempest-HypervisorAdminV253TestBase-1074841202 tempest-HypervisorAdminV253TestBase-1074841202-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:51:53.938337 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-70d0113c-6d06-439f-b080-f19e4a889665 tempest-HypervisorAdminV253TestBase-1074841202 tempest-HypervisorAdminV253TestBase-1074841202-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:51:53.939096 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-70d0113c-6d06-439f-b080-f19e4a889665 tempest-HypervisorAdminV253TestBase-1074841202 tempest-HypervisorAdminV253TestBase-1074841202-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:51:53.939691 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-70d0113c-6d06-439f-b080-f19e4a889665 tempest-HypervisorAdminV253TestBase-1074841202 tempest-HypervisorAdminV253TestBase-1074841202-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:51:54.000133 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-70d0113c-6d06-439f-b080-f19e4a889665 tempest-HypervisorAdminV253TestBase-1074841202 tempest-HypervisorAdminV253TestBase-1074841202-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:51:54.001510 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-70d0113c-6d06-439f-b080-f19e4a889665 tempest-HypervisorAdminV253TestBase-1074841202 tempest-HypervisorAdminV253TestBase-1074841202-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:51:54.002292 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-70d0113c-6d06-439f-b080-f19e4a889665 tempest-HypervisorAdminV253TestBase-1074841202 tempest-HypervisorAdminV253TestBase-1074841202-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:51:54.013355 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-70d0113c-6d06-439f-b080-f19e4a889665 tempest-HypervisorAdminV253TestBase-1074841202 tempest-HypervisorAdminV253TestBase-1074841202-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1757 microversion: 2.53 time: 0.897622 Oct 08 20:51:54.014640 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 46/103] 10.222.0.26 () {60 vars in 1243 bytes} [Sat Oct 8 20:51:53 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1757 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:51:54.024916 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-087e7dfa-7dbc-4599-ae35-1d2c9d67465a tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:51:54.025833 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-087e7dfa-7dbc-4599-ae35-1d2c9d67465a tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] [instance: bbff4ffb-395f-4eeb-a995-60c9c0f39f25] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:51:54.036951 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-087e7dfa-7dbc-4599-ae35-1d2c9d67465a tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:51:54.038123 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-087e7dfa-7dbc-4599-ae35-1d2c9d67465a tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:51:54.038826 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-087e7dfa-7dbc-4599-ae35-1d2c9d67465a tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:51:54.040262 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-087e7dfa-7dbc-4599-ae35-1d2c9d67465a tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:51:54.041304 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-087e7dfa-7dbc-4599-ae35-1d2c9d67465a tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:51:54.041942 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-087e7dfa-7dbc-4599-ae35-1d2c9d67465a tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:51:54.552148 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-087e7dfa-7dbc-4599-ae35-1d2c9d67465a tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8da7d5210cf42bda150d342ff207bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd024396aef784f3291630c426a828cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:51:54.561017 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-087e7dfa-7dbc-4599-ae35-1d2c9d67465a tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] 10.222.0.26 "GET /compute/v2.1/servers/bbff4ffb-395f-4eeb-a995-60c9c0f39f25" status: 200 len: 1339 microversion: 2.1 time: 0.544015 Oct 08 20:51:54.581143 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 47/104] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:51:54 2022] GET /compute/v2.1/servers/bbff4ffb-395f-4eeb-a995-60c9c0f39f25 => generated 1339 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:51:54.603463 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-a8afd413-805f-4f3d-a0bc-5ce6cf05919e tempest-HypervisorAdminV253TestBase-1074841202 tempest-HypervisorAdminV253TestBase-1074841202-project-admin] Calling method '.version_select at 0x7f1a8d515940>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:51:54.610415 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a8afd413-805f-4f3d-a0bc-5ce6cf05919e tempest-HypervisorAdminV253TestBase-1074841202 tempest-HypervisorAdminV253TestBase-1074841202-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:51:54.612502 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a8afd413-805f-4f3d-a0bc-5ce6cf05919e tempest-HypervisorAdminV253TestBase-1074841202 tempest-HypervisorAdminV253TestBase-1074841202-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:51:54.613263 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a8afd413-805f-4f3d-a0bc-5ce6cf05919e tempest-HypervisorAdminV253TestBase-1074841202 tempest-HypervisorAdminV253TestBase-1074841202-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:51:54.642586 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a8afd413-805f-4f3d-a0bc-5ce6cf05919e tempest-HypervisorAdminV253TestBase-1074841202 tempest-HypervisorAdminV253TestBase-1074841202-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:51:54.643561 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a8afd413-805f-4f3d-a0bc-5ce6cf05919e tempest-HypervisorAdminV253TestBase-1074841202 tempest-HypervisorAdminV253TestBase-1074841202-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:51:54.644273 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a8afd413-805f-4f3d-a0bc-5ce6cf05919e tempest-HypervisorAdminV253TestBase-1074841202 tempest-HypervisorAdminV253TestBase-1074841202-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:51:54.688653 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a8afd413-805f-4f3d-a0bc-5ce6cf05919e tempest-HypervisorAdminV253TestBase-1074841202 tempest-HypervisorAdminV253TestBase-1074841202-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:51:54.689622 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a8afd413-805f-4f3d-a0bc-5ce6cf05919e tempest-HypervisorAdminV253TestBase-1074841202 tempest-HypervisorAdminV253TestBase-1074841202-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:51:54.690299 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a8afd413-805f-4f3d-a0bc-5ce6cf05919e tempest-HypervisorAdminV253TestBase-1074841202 tempest-HypervisorAdminV253TestBase-1074841202-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:51:54.714620 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a8afd413-805f-4f3d-a0bc-5ce6cf05919e tempest-HypervisorAdminV253TestBase-1074841202 tempest-HypervisorAdminV253TestBase-1074841202-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:51:54.715497 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a8afd413-805f-4f3d-a0bc-5ce6cf05919e tempest-HypervisorAdminV253TestBase-1074841202 tempest-HypervisorAdminV253TestBase-1074841202-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:51:54.716254 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a8afd413-805f-4f3d-a0bc-5ce6cf05919e tempest-HypervisorAdminV253TestBase-1074841202 tempest-HypervisorAdminV253TestBase-1074841202-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:51:54.761502 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a8afd413-805f-4f3d-a0bc-5ce6cf05919e tempest-HypervisorAdminV253TestBase-1074841202 tempest-HypervisorAdminV253TestBase-1074841202-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:51:54.764095 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a8afd413-805f-4f3d-a0bc-5ce6cf05919e tempest-HypervisorAdminV253TestBase-1074841202 tempest-HypervisorAdminV253TestBase-1074841202-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:51:54.764964 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a8afd413-805f-4f3d-a0bc-5ce6cf05919e tempest-HypervisorAdminV253TestBase-1074841202 tempest-HypervisorAdminV253TestBase-1074841202-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:51:54.784556 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-a8afd413-805f-4f3d-a0bc-5ce6cf05919e tempest-HypervisorAdminV253TestBase-1074841202 tempest-HypervisorAdminV253TestBase-1074841202-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 449 microversion: 2.53 time: 0.201883 Oct 08 20:51:54.785910 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 48/105] 10.222.0.26 () {60 vars in 1222 bytes} [Sat Oct 8 20:51:54 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 449 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 08 20:51:54.790736 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-d54968d0-26d0-4f6a-8ce5-2ce4e6ebcddd tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:51:54.792051 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-d54968d0-26d0-4f6a-8ce5-2ce4e6ebcddd tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] [instance: 6611e099-c1f0-4fed-ba7b-0b096800946d] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:51:54.805556 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d54968d0-26d0-4f6a-8ce5-2ce4e6ebcddd tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:51:54.806317 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d54968d0-26d0-4f6a-8ce5-2ce4e6ebcddd tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:51:54.808630 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d54968d0-26d0-4f6a-8ce5-2ce4e6ebcddd tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:51:54.810466 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d54968d0-26d0-4f6a-8ce5-2ce4e6ebcddd tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:51:54.821903 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d54968d0-26d0-4f6a-8ce5-2ce4e6ebcddd tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:51:54.824528 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d54968d0-26d0-4f6a-8ce5-2ce4e6ebcddd tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:51:55.077172 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-d54968d0-26d0-4f6a-8ce5-2ce4e6ebcddd tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0eb2feb062947e78357b70e832e3edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18029da9b9854f3caf3debd9556f1f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:51:55.088166 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-d54968d0-26d0-4f6a-8ce5-2ce4e6ebcddd tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] 10.222.0.26 "GET /compute/v2.1/servers/6611e099-c1f0-4fed-ba7b-0b096800946d" status: 200 len: 1320 microversion: 2.1 time: 0.300983 Oct 08 20:51:55.088616 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 49/106] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:51:54 2022] GET /compute/v2.1/servers/6611e099-c1f0-4fed-ba7b-0b096800946d => generated 1320 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:51:55.509841 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-a830be01-13be-403f-98bf-7242e57f1aa4 req-d38176c2-96f6-400c-a779-e100e8b8177d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6611e099-c1f0-4fed-ba7b-0b096800946d", "tag": "e840762c-aa06-40ad-802b-ac87c05858c5"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:51:55.522869 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-a830be01-13be-403f-98bf-7242e57f1aa4 req-d38176c2-96f6-400c-a779-e100e8b8177d service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:51:55.526188 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-a830be01-13be-403f-98bf-7242e57f1aa4 req-d38176c2-96f6-400c-a779-e100e8b8177d service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:51:55.529252 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-a830be01-13be-403f-98bf-7242e57f1aa4 req-d38176c2-96f6-400c-a779-e100e8b8177d service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:51:55.552405 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-a830be01-13be-403f-98bf-7242e57f1aa4 req-d38176c2-96f6-400c-a779-e100e8b8177d service nova] Creating event network-changed:e840762c-aa06-40ad-802b-ac87c05858c5 for instance 6611e099-c1f0-4fed-ba7b-0b096800946d on nch1-master-1 Oct 08 20:51:55.571074 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-a830be01-13be-403f-98bf-7242e57f1aa4 req-d38176c2-96f6-400c-a779-e100e8b8177d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.479763 Oct 08 20:51:55.576091 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 50/107] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:51:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:51:55.590442 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-edba041d-9ff3-4031-bcc7-5310c9b9d7c6 tempest-HypervisorAdminV253TestBase-1074841202 tempest-HypervisorAdminV253TestBase-1074841202-project-admin] Calling method '.version_select at 0x7f1a8d49f3a0>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:51:55.595481 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-edba041d-9ff3-4031-bcc7-5310c9b9d7c6 tempest-HypervisorAdminV253TestBase-1074841202 tempest-HypervisorAdminV253TestBase-1074841202-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:51:55.598351 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-edba041d-9ff3-4031-bcc7-5310c9b9d7c6 tempest-HypervisorAdminV253TestBase-1074841202 tempest-HypervisorAdminV253TestBase-1074841202-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:51:55.600806 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-edba041d-9ff3-4031-bcc7-5310c9b9d7c6 tempest-HypervisorAdminV253TestBase-1074841202 tempest-HypervisorAdminV253TestBase-1074841202-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:51:55.634527 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-edba041d-9ff3-4031-bcc7-5310c9b9d7c6 tempest-HypervisorAdminV253TestBase-1074841202 tempest-HypervisorAdminV253TestBase-1074841202-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:51:55.635284 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-edba041d-9ff3-4031-bcc7-5310c9b9d7c6 tempest-HypervisorAdminV253TestBase-1074841202 tempest-HypervisorAdminV253TestBase-1074841202-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:51:55.635991 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-edba041d-9ff3-4031-bcc7-5310c9b9d7c6 tempest-HypervisorAdminV253TestBase-1074841202 tempest-HypervisorAdminV253TestBase-1074841202-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:51:55.675782 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-edba041d-9ff3-4031-bcc7-5310c9b9d7c6 tempest-HypervisorAdminV253TestBase-1074841202 tempest-HypervisorAdminV253TestBase-1074841202-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors/a41d0382-68d1-476d-8c0a-f7ab76a39bb6" status: 200 len: 792 microversion: 2.53 time: 0.097793 Oct 08 20:51:55.676651 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 51/108] 10.222.0.26 () {60 vars in 1298 bytes} [Sat Oct 8 20:51:55 2022] GET /compute/v2.1/os-hypervisors/a41d0382-68d1-476d-8c0a-f7ab76a39bb6 => generated 792 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 08 20:51:55.689826 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e225a085-744b-4a6f-aa39-3ff297f86702 tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:51:55.691041 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-e225a085-744b-4a6f-aa39-3ff297f86702 tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] [instance: bbff4ffb-395f-4eeb-a995-60c9c0f39f25] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:51:55.699213 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=4,nova_api:DELETE=6 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:51:55.701064 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e225a085-744b-4a6f-aa39-3ff297f86702 tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:51:55.701869 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e225a085-744b-4a6f-aa39-3ff297f86702 tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:51:55.702564 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e225a085-744b-4a6f-aa39-3ff297f86702 tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:51:55.703782 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e225a085-744b-4a6f-aa39-3ff297f86702 tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:51:55.704497 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e225a085-744b-4a6f-aa39-3ff297f86702 tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:51:55.705393 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e225a085-744b-4a6f-aa39-3ff297f86702 tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:51:55.736823 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=100 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:51:55.896405 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-e225a085-744b-4a6f-aa39-3ff297f86702 tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8da7d5210cf42bda150d342ff207bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd024396aef784f3291630c426a828cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:51:55.908854 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-e225a085-744b-4a6f-aa39-3ff297f86702 tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] 10.222.0.26 "GET /compute/v2.1/servers/bbff4ffb-395f-4eeb-a995-60c9c0f39f25" status: 200 len: 1339 microversion: 2.1 time: 0.230862 Oct 08 20:51:55.909501 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 52/109] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:51:55 2022] GET /compute/v2.1/servers/bbff4ffb-395f-4eeb-a995-60c9c0f39f25 => generated 1339 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:51:56.114178 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-2df23089-d4f9-43a2-8531-e4d35af65db8 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:51:56.115804 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-2df23089-d4f9-43a2-8531-e4d35af65db8 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] [instance: 6611e099-c1f0-4fed-ba7b-0b096800946d] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:51:56.129532 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2df23089-d4f9-43a2-8531-e4d35af65db8 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:51:56.135089 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2df23089-d4f9-43a2-8531-e4d35af65db8 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:51:56.135754 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2df23089-d4f9-43a2-8531-e4d35af65db8 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:51:56.136993 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2df23089-d4f9-43a2-8531-e4d35af65db8 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:51:56.137503 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2df23089-d4f9-43a2-8531-e4d35af65db8 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:51:56.137880 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2df23089-d4f9-43a2-8531-e4d35af65db8 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:51:56.473692 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-2df23089-d4f9-43a2-8531-e4d35af65db8 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0eb2feb062947e78357b70e832e3edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18029da9b9854f3caf3debd9556f1f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:51:56.502807 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-2df23089-d4f9-43a2-8531-e4d35af65db8 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] 10.222.0.26 "GET /compute/v2.1/servers/6611e099-c1f0-4fed-ba7b-0b096800946d" status: 200 len: 1320 microversion: 2.1 time: 0.393969 Oct 08 20:51:56.514350 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 53/110] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:51:56 2022] GET /compute/v2.1/servers/6611e099-c1f0-4fed-ba7b-0b096800946d => generated 1320 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 20:51:57.078473 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-a0503a22-30f7-44c8-86e1-d9410229c5fb tempest-FlavorsExtraSpecsNegativeTestJSON-753630458 tempest-FlavorsExtraSpecsNegativeTestJSON-753630458-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1640458907", "ram": 512, "vcpus": 1, "disk": 10, "id": 1077735903, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:51:57.129531 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-a0503a22-30f7-44c8-86e1-d9410229c5fb tempest-FlavorsExtraSpecsNegativeTestJSON-753630458 tempest-FlavorsExtraSpecsNegativeTestJSON-753630458-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.427323 Oct 08 20:51:57.137710 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 54/111] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 20:51:56 2022] POST /compute/v2.1/flavors => generated 416 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:51:57.154684 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-5886eb0d-f33e-4de2-ab0e-42fbda5fa3d5 tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:51:57.156111 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-5886eb0d-f33e-4de2-ab0e-42fbda5fa3d5 tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] [instance: bbff4ffb-395f-4eeb-a995-60c9c0f39f25] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:51:57.184591 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5886eb0d-f33e-4de2-ab0e-42fbda5fa3d5 tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:51:57.186510 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5886eb0d-f33e-4de2-ab0e-42fbda5fa3d5 tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:51:57.193896 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5886eb0d-f33e-4de2-ab0e-42fbda5fa3d5 tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:51:57.196375 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5886eb0d-f33e-4de2-ab0e-42fbda5fa3d5 tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:51:57.197133 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5886eb0d-f33e-4de2-ab0e-42fbda5fa3d5 tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:51:57.198471 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5886eb0d-f33e-4de2-ab0e-42fbda5fa3d5 tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:51:57.564955 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-5886eb0d-f33e-4de2-ab0e-42fbda5fa3d5 tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8da7d5210cf42bda150d342ff207bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd024396aef784f3291630c426a828cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:51:57.575531 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-5886eb0d-f33e-4de2-ab0e-42fbda5fa3d5 tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] 10.222.0.26 "GET /compute/v2.1/servers/bbff4ffb-395f-4eeb-a995-60c9c0f39f25" status: 200 len: 1339 microversion: 2.1 time: 0.436399 Oct 08 20:51:57.578477 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 55/112] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:51:57 2022] GET /compute/v2.1/servers/bbff4ffb-395f-4eeb-a995-60c9c0f39f25 => generated 1339 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:51:58.004590 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-0544bd62-9aa9-4c83-b241-029ad1664633 tempest-FlavorsExtraSpecsNegativeTestJSON-281855252 tempest-FlavorsExtraSpecsNegativeTestJSON-281855252-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:51:58.029456 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-0544bd62-9aa9-4c83-b241-029ad1664633 tempest-FlavorsExtraSpecsNegativeTestJSON-281855252 tempest-FlavorsExtraSpecsNegativeTestJSON-281855252-project] HTTP exception thrown: Flavor 1077735903 has no extra specs with key hw:cpu_thread_policy. Oct 08 20:51:58.043405 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-0544bd62-9aa9-4c83-b241-029ad1664633 tempest-FlavorsExtraSpecsNegativeTestJSON-281855252 tempest-FlavorsExtraSpecsNegativeTestJSON-281855252-project] Request method failure captured: Oct 08 20:51:58.043405 ncdv-master-1 devstack@n-api.service[140492]: request: GET /compute/v2.1/flavors/1077735903/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Oct 08 20:51:58.043405 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 20:51:58.043405 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 20:51:58.043405 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 20:51:58.043405 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 20:51:58.043405 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 20:51:58.043405 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 20:51:58.043405 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 20:51:58.043405 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 20:51:58.043405 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeLqMw1TnnuXUMuJ8sVx9Fqomd3_gGjRvFCud6br7POlW9c-7CWgH-dgFjADDKrN920I7Ds5rb_gQAfV6U6yMaDnpvc0ZdvewGH6qoWUy1RbFIjeNx40IcyUvCEPecvLTHHAmyoWjNemWCD2pgvOoEt_4al1u4hYMlmCki8q4O6tMQI Oct 08 20:51:58.043405 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 20:51:58.043405 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 20:51:58.043405 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 20:51:58.043405 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 20:51:58.043405 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 20:51:58.043405 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 20:51:58.043405 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 5729227bda88440095bc3b342df17f68 Oct 08 20:51:58.043405 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-281855252 Oct 08 20:51:58.043405 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 20:51:58.043405 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 20:51:58.045008 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5729227bda88440095bc3b342df17f68"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5729227bda88440095bc3b342df17f68"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5729227bda88440095bc3b342df17f68"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5729227bda88440095bc3b342df17f68"}]}] Oct 08 20:51:58.045008 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-281855252 Oct 08 20:51:58.045008 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 5729227bda88440095bc3b342df17f68 Oct 08 20:51:58.045008 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-281855252 Oct 08 20:51:58.045008 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-281855252-project Oct 08 20:51:58.045008 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 20:51:58.045008 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 20:51:58.045008 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 803391b94e344fb8893f6b5c2b399d9d Oct 08 20:51:58.045008 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-281855252-project Oct 08 20:51:58.045008 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 20:51:58.045008 ncdv-master-1 devstack@n-api.service[140492]: exception: Flavor 1077735903 has no extra specs with key hw:cpu_thread_policy. Oct 08 20:51:58.045882 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'flavor_id': '1077735903', 'id': 'hw:cpu_thread_policy'} Oct 08 20:51:58.045882 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:51:58.045882 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:51:58.045882 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Oct 08 20:51:58.045882 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Oct 08 20:51:58.045882 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Oct 08 20:51:58.045882 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:51:58.045882 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:51:58.045882 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:51:58.045882 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:51:58.045882 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:51:58.045882 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:51:58.045882 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:51:58.045882 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:51:58.045882 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:51:58.045882 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:51:58.045882 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Oct 08 20:51:58.045882 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 08 20:51:58.045882 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1077735903 has no extra specs with key hw:cpu_thread_policy. Oct 08 20:51:58.045882 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:51:58.045882 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:51:58.045882 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:51:58.047950 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:51:58.047950 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:51:58.047950 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:51:58.047950 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 20:51:58.047950 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 20:51:58.047950 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1077735903 has no extra specs with key hw:cpu_thread_policy. Oct 08 20:51:58.047950 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:51:58.050269 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-0544bd62-9aa9-4c83-b241-029ad1664633 tempest-FlavorsExtraSpecsNegativeTestJSON-281855252 tempest-FlavorsExtraSpecsNegativeTestJSON-281855252-project] Returning 404 to user: Flavor 1077735903 has no extra specs with key hw:cpu_thread_policy. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:51:58.051477 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-0544bd62-9aa9-4c83-b241-029ad1664633 tempest-FlavorsExtraSpecsNegativeTestJSON-281855252 tempest-FlavorsExtraSpecsNegativeTestJSON-281855252-project] 10.222.0.26 "GET /compute/v2.1/flavors/1077735903/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.470782 Oct 08 20:51:58.052210 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 56/113] 10.222.0.26 () {58 vars in 1266 bytes} [Sat Oct 8 20:51:57 2022] GET /compute/v2.1/flavors/1077735903/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 472 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 20:51:58.064479 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-dbec3384-b8aa-452e-8697-e527ead650ab tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:51:58.065837 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-dbec3384-b8aa-452e-8697-e527ead650ab tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] [instance: 6611e099-c1f0-4fed-ba7b-0b096800946d] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:51:58.074688 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dbec3384-b8aa-452e-8697-e527ead650ab tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:51:58.076030 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dbec3384-b8aa-452e-8697-e527ead650ab tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:51:58.076836 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dbec3384-b8aa-452e-8697-e527ead650ab tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:51:58.077932 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dbec3384-b8aa-452e-8697-e527ead650ab tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:51:58.078939 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dbec3384-b8aa-452e-8697-e527ead650ab tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:51:58.079962 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dbec3384-b8aa-452e-8697-e527ead650ab tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:51:58.112389 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=16 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:51:58.205276 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=12 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:51:58.349345 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-dbec3384-b8aa-452e-8697-e527ead650ab tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0eb2feb062947e78357b70e832e3edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18029da9b9854f3caf3debd9556f1f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:51:58.358205 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-dbec3384-b8aa-452e-8697-e527ead650ab tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] 10.222.0.26 "GET /compute/v2.1/servers/6611e099-c1f0-4fed-ba7b-0b096800946d" status: 200 len: 1320 microversion: 2.1 time: 0.299932 Oct 08 20:51:58.376703 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 57/114] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:51:58 2022] GET /compute/v2.1/servers/6611e099-c1f0-4fed-ba7b-0b096800946d => generated 1320 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:51:58.389794 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-1ef94a7c-50b3-4109-9763-ce74f55caacf tempest-FlavorsExtraSpecsNegativeTestJSON-281855252 tempest-FlavorsExtraSpecsNegativeTestJSON-281855252-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:51:58.398379 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-1ef94a7c-50b3-4109-9763-ce74f55caacf tempest-FlavorsExtraSpecsNegativeTestJSON-281855252 tempest-FlavorsExtraSpecsNegativeTestJSON-281855252-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': '803391b94e344fb8893f6b5c2b399d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5729227bda88440095bc3b342df17f68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:51:58.404150 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-1ef94a7c-50b3-4109-9763-ce74f55caacf tempest-FlavorsExtraSpecsNegativeTestJSON-281855252 tempest-FlavorsExtraSpecsNegativeTestJSON-281855252-project] Request method failure captured: Oct 08 20:51:58.404150 ncdv-master-1 devstack@n-api.service[140492]: request: POST /compute/v2.1/flavors/1077735903/os-extra_specs HTTP/1.1 Oct 08 20:51:58.404150 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 20:51:58.404150 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 20:51:58.404150 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 20:51:58.404150 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 66 Oct 08 20:51:58.404150 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 20:51:58.404150 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 20:51:58.404150 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 20:51:58.404150 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 20:51:58.404150 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeLqMw1TnnuXUMuJ8sVx9Fqomd3_gGjRvFCud6br7POlW9c-7CWgH-dgFjADDKrN920I7Ds5rb_gQAfV6U6yMaDnpvc0ZdvewGH6qoWUy1RbFIjeNx40IcyUvCEPecvLTHHAmyoWjNemWCD2pgvOoEt_4al1u4hYMlmCki8q4O6tMQI Oct 08 20:51:58.404150 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 20:51:58.404150 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 20:51:58.404150 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 20:51:58.404150 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 20:51:58.404150 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 20:51:58.404150 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 20:51:58.404150 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 5729227bda88440095bc3b342df17f68 Oct 08 20:51:58.404150 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-281855252 Oct 08 20:51:58.404150 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 20:51:58.404150 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 20:51:58.405674 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5729227bda88440095bc3b342df17f68"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5729227bda88440095bc3b342df17f68"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5729227bda88440095bc3b342df17f68"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5729227bda88440095bc3b342df17f68"}]}] Oct 08 20:51:58.405674 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-281855252 Oct 08 20:51:58.405674 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 5729227bda88440095bc3b342df17f68 Oct 08 20:51:58.405674 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-281855252 Oct 08 20:51:58.405674 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-281855252-project Oct 08 20:51:58.405674 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 20:51:58.405674 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 20:51:58.405674 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 803391b94e344fb8893f6b5c2b399d9d Oct 08 20:51:58.405674 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-281855252-project Oct 08 20:51:58.405674 ncdv-master-1 devstack@n-api.service[140492]: Oct 08 20:51:58.405674 ncdv-master-1 devstack@n-api.service[140492]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Oct 08 20:51:58.405674 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 20:51:58.407031 ncdv-master-1 devstack@n-api.service[140492]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 08 20:51:58.407031 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'flavor_id': '1077735903', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Oct 08 20:51:58.407031 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:51:58.407031 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:51:58.407031 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:51:58.407031 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:51:58.407031 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:51:58.407031 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:51:58.407031 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:51:58.407031 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:51:58.407031 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 20:51:58.407031 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 20:51:58.407031 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Oct 08 20:51:58.407031 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Oct 08 20:51:58.407031 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 08 20:51:58.407031 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 08 20:51:58.407031 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 08 20:51:58.407031 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 08 20:51:58.407031 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 08 20:51:58.408294 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 08 20:51:58.408294 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 08 20:51:58.408294 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise self.value Oct 08 20:51:58.408294 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 08 20:51:58.408294 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 08 20:51:58.408294 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 08 20:51:58.408294 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 08 20:51:58.408294 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 08 20:51:58.408294 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 08 20:51:58.408294 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 08 20:51:58.408294 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:51:58.408294 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:51:58.408294 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:51:58.408294 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:51:58.408294 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:51:58.408294 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:51:58.408294 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 08 20:51:58.408294 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 08 20:51:58.408294 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 08 20:51:58.408294 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:51:58.410677 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-1ef94a7c-50b3-4109-9763-ce74f55caacf tempest-FlavorsExtraSpecsNegativeTestJSON-281855252 tempest-FlavorsExtraSpecsNegativeTestJSON-281855252-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:51:58.421293 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-1ef94a7c-50b3-4109-9763-ce74f55caacf tempest-FlavorsExtraSpecsNegativeTestJSON-281855252 tempest-FlavorsExtraSpecsNegativeTestJSON-281855252-project] 10.222.0.26 "POST /compute/v2.1/flavors/1077735903/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.042996 Oct 08 20:51:58.427877 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 58/115] 10.222.0.26 () {60 vars in 1224 bytes} [Sat Oct 8 20:51:58 2022] POST /compute/v2.1/flavors/1077735903/os-extra_specs => generated 124 bytes in 50 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 08 20:51:58.433790 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-f8ceb6fb-d621-45d1-b2d2-4234143ec908 tempest-FlavorsExtraSpecsNegativeTestJSON-753630458 tempest-FlavorsExtraSpecsNegativeTestJSON-753630458-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:51:58.517568 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-f8ceb6fb-d621-45d1-b2d2-4234143ec908 tempest-FlavorsExtraSpecsNegativeTestJSON-753630458 tempest-FlavorsExtraSpecsNegativeTestJSON-753630458-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors/1077735903/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.088291 Oct 08 20:51:58.526796 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 59/116] 10.222.0.26 () {60 vars in 1224 bytes} [Sat Oct 8 20:51:58 2022] POST /compute/v2.1/flavors/1077735903/os-extra_specs => generated 66 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 08 20:51:58.541363 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-277a57ae-0099-4db2-b46b-9588eeaf20c0 tempest-FlavorsExtraSpecsNegativeTestJSON-281855252 tempest-FlavorsExtraSpecsNegativeTestJSON-281855252-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:51:58.543115 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-277a57ae-0099-4db2-b46b-9588eeaf20c0 tempest-FlavorsExtraSpecsNegativeTestJSON-281855252 tempest-FlavorsExtraSpecsNegativeTestJSON-281855252-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': '803391b94e344fb8893f6b5c2b399d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5729227bda88440095bc3b342df17f68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:51:58.545601 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-277a57ae-0099-4db2-b46b-9588eeaf20c0 tempest-FlavorsExtraSpecsNegativeTestJSON-281855252 tempest-FlavorsExtraSpecsNegativeTestJSON-281855252-project] Request method failure captured: Oct 08 20:51:58.545601 ncdv-master-1 devstack@n-api.service[140492]: request: DELETE /compute/v2.1/flavors/1077735903/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 08 20:51:58.545601 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 20:51:58.545601 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 20:51:58.545601 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 20:51:58.545601 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 20:51:58.545601 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 20:51:58.545601 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 20:51:58.545601 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 20:51:58.545601 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 20:51:58.545601 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeLqMw1TnnuXUMuJ8sVx9Fqomd3_gGjRvFCud6br7POlW9c-7CWgH-dgFjADDKrN920I7Ds5rb_gQAfV6U6yMaDnpvc0ZdvewGH6qoWUy1RbFIjeNx40IcyUvCEPecvLTHHAmyoWjNemWCD2pgvOoEt_4al1u4hYMlmCki8q4O6tMQI Oct 08 20:51:58.545601 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 20:51:58.545601 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 20:51:58.545601 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 20:51:58.545601 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 20:51:58.545601 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 20:51:58.545601 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 20:51:58.545601 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 5729227bda88440095bc3b342df17f68 Oct 08 20:51:58.545601 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-281855252 Oct 08 20:51:58.545601 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 20:51:58.545601 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 20:51:58.547478 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5729227bda88440095bc3b342df17f68"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5729227bda88440095bc3b342df17f68"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5729227bda88440095bc3b342df17f68"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5729227bda88440095bc3b342df17f68"}]}] Oct 08 20:51:58.547478 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-281855252 Oct 08 20:51:58.547478 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 5729227bda88440095bc3b342df17f68 Oct 08 20:51:58.547478 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-281855252 Oct 08 20:51:58.547478 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-281855252-project Oct 08 20:51:58.547478 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 20:51:58.547478 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 20:51:58.547478 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 803391b94e344fb8893f6b5c2b399d9d Oct 08 20:51:58.547478 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-281855252-project Oct 08 20:51:58.547478 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 20:51:58.547478 ncdv-master-1 devstack@n-api.service[140492]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 08 20:51:58.548093 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'flavor_id': '1077735903', 'id': 'hw:numa_nodes'} Oct 08 20:51:58.548093 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:51:58.548093 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:51:58.548093 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:51:58.548093 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:51:58.548093 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:51:58.548093 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:51:58.548093 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:51:58.548093 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:51:58.548093 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Oct 08 20:51:58.548093 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Oct 08 20:51:58.548093 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 08 20:51:58.548093 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 08 20:51:58.548093 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 08 20:51:58.548093 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 08 20:51:58.548093 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 08 20:51:58.548093 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 08 20:51:58.548093 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 08 20:51:58.548093 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise self.value Oct 08 20:51:58.548093 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 08 20:51:58.549175 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 08 20:51:58.549175 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 08 20:51:58.549175 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 08 20:51:58.549175 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 08 20:51:58.549175 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 08 20:51:58.549175 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 08 20:51:58.549175 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:51:58.549175 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:51:58.549175 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:51:58.549175 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:51:58.549175 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:51:58.549175 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:51:58.549175 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 08 20:51:58.549175 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 08 20:51:58.549175 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 08 20:51:58.549175 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:51:58.552027 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-277a57ae-0099-4db2-b46b-9588eeaf20c0 tempest-FlavorsExtraSpecsNegativeTestJSON-281855252 tempest-FlavorsExtraSpecsNegativeTestJSON-281855252-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:51:58.553258 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-277a57ae-0099-4db2-b46b-9588eeaf20c0 tempest-FlavorsExtraSpecsNegativeTestJSON-281855252 tempest-FlavorsExtraSpecsNegativeTestJSON-281855252-project] 10.222.0.26 "DELETE /compute/v2.1/flavors/1077735903/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.024627 Oct 08 20:51:58.564615 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 60/117] 10.222.0.26 () {58 vars in 1248 bytes} [Sat Oct 8 20:51:58 2022] DELETE /compute/v2.1/flavors/1077735903/os-extra_specs/hw:numa_nodes => generated 124 bytes in 31 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 08 20:51:58.579516 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-b01d214d-faf7-4ac2-b040-753690e76389 tempest-FlavorsExtraSpecsNegativeTestJSON-753630458 tempest-FlavorsExtraSpecsNegativeTestJSON-753630458-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:51:58.677670 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-b01d214d-faf7-4ac2-b040-753690e76389 tempest-FlavorsExtraSpecsNegativeTestJSON-753630458 tempest-FlavorsExtraSpecsNegativeTestJSON-753630458-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors/1077735903/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.111543 Oct 08 20:51:58.681634 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 61/118] 10.222.0.26 () {60 vars in 1224 bytes} [Sat Oct 8 20:51:58 2022] POST /compute/v2.1/flavors/1077735903/os-extra_specs => generated 66 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 08 20:51:58.687382 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-12fbb718-432a-4e2a-bbe6-9fa4a23bc3c5 tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:51:58.688320 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-12fbb718-432a-4e2a-bbe6-9fa4a23bc3c5 tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] [instance: bbff4ffb-395f-4eeb-a995-60c9c0f39f25] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:51:58.696440 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-12fbb718-432a-4e2a-bbe6-9fa4a23bc3c5 tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:51:58.697180 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-12fbb718-432a-4e2a-bbe6-9fa4a23bc3c5 tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:51:58.697868 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-12fbb718-432a-4e2a-bbe6-9fa4a23bc3c5 tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:51:58.698834 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-12fbb718-432a-4e2a-bbe6-9fa4a23bc3c5 tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:51:58.699534 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-12fbb718-432a-4e2a-bbe6-9fa4a23bc3c5 tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:51:58.700190 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-12fbb718-432a-4e2a-bbe6-9fa4a23bc3c5 tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:51:58.927570 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-12fbb718-432a-4e2a-bbe6-9fa4a23bc3c5 tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8da7d5210cf42bda150d342ff207bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd024396aef784f3291630c426a828cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:51:58.941699 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-12fbb718-432a-4e2a-bbe6-9fa4a23bc3c5 tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] 10.222.0.26 "GET /compute/v2.1/servers/bbff4ffb-395f-4eeb-a995-60c9c0f39f25" status: 200 len: 1339 microversion: 2.1 time: 0.257540 Oct 08 20:51:58.958872 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 62/119] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:51:58 2022] GET /compute/v2.1/servers/bbff4ffb-395f-4eeb-a995-60c9c0f39f25 => generated 1339 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:51:58.984493 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-5f957a2c-d758-4c2a-ab90-e933ec6e535a tempest-FlavorsExtraSpecsNegativeTestJSON-281855252 tempest-FlavorsExtraSpecsNegativeTestJSON-281855252-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:51:59.007860 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-5f957a2c-d758-4c2a-ab90-e933ec6e535a tempest-FlavorsExtraSpecsNegativeTestJSON-281855252 tempest-FlavorsExtraSpecsNegativeTestJSON-281855252-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': '803391b94e344fb8893f6b5c2b399d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5729227bda88440095bc3b342df17f68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:51:59.014300 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-5f957a2c-d758-4c2a-ab90-e933ec6e535a tempest-FlavorsExtraSpecsNegativeTestJSON-281855252 tempest-FlavorsExtraSpecsNegativeTestJSON-281855252-project] Request method failure captured: Oct 08 20:51:59.014300 ncdv-master-1 devstack@n-api.service[140492]: request: PUT /compute/v2.1/flavors/1077735903/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 08 20:51:59.014300 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 20:51:59.014300 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 20:51:59.014300 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 20:51:59.014300 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 22 Oct 08 20:51:59.014300 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 20:51:59.014300 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 20:51:59.014300 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 20:51:59.014300 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 20:51:59.014300 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeLqMw1TnnuXUMuJ8sVx9Fqomd3_gGjRvFCud6br7POlW9c-7CWgH-dgFjADDKrN920I7Ds5rb_gQAfV6U6yMaDnpvc0ZdvewGH6qoWUy1RbFIjeNx40IcyUvCEPecvLTHHAmyoWjNemWCD2pgvOoEt_4al1u4hYMlmCki8q4O6tMQI Oct 08 20:51:59.014300 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 20:51:59.014300 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 20:51:59.014300 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 20:51:59.014300 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 20:51:59.014300 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 20:51:59.014300 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 20:51:59.014300 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 5729227bda88440095bc3b342df17f68 Oct 08 20:51:59.014300 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-281855252 Oct 08 20:51:59.014300 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 20:51:59.014300 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 20:51:59.016398 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5729227bda88440095bc3b342df17f68"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5729227bda88440095bc3b342df17f68"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5729227bda88440095bc3b342df17f68"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5729227bda88440095bc3b342df17f68"}]}] Oct 08 20:51:59.016398 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-281855252 Oct 08 20:51:59.016398 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 5729227bda88440095bc3b342df17f68 Oct 08 20:51:59.016398 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-281855252 Oct 08 20:51:59.016398 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-281855252-project Oct 08 20:51:59.016398 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 20:51:59.016398 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 20:51:59.016398 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 803391b94e344fb8893f6b5c2b399d9d Oct 08 20:51:59.016398 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-281855252-project Oct 08 20:51:59.016398 ncdv-master-1 devstack@n-api.service[140492]: Oct 08 20:51:59.016398 ncdv-master-1 devstack@n-api.service[140492]: {"hw:numa_nodes": "1"} Oct 08 20:51:59.016398 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 20:51:59.016398 ncdv-master-1 devstack@n-api.service[140492]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 08 20:51:59.017323 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'flavor_id': '1077735903', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Oct 08 20:51:59.017323 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:51:59.017323 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:51:59.017323 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:51:59.017323 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:51:59.017323 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:51:59.017323 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:51:59.017323 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:51:59.017323 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:51:59.017323 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 20:51:59.017323 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 20:51:59.017323 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Oct 08 20:51:59.017323 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Oct 08 20:51:59.017323 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 08 20:51:59.017323 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 08 20:51:59.017323 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 08 20:51:59.017323 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 08 20:51:59.017323 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 08 20:51:59.017323 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 08 20:51:59.018947 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 08 20:51:59.018947 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise self.value Oct 08 20:51:59.018947 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 08 20:51:59.018947 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 08 20:51:59.018947 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 08 20:51:59.018947 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 08 20:51:59.018947 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 08 20:51:59.018947 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 08 20:51:59.018947 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 08 20:51:59.018947 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:51:59.018947 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:51:59.018947 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:51:59.018947 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:51:59.018947 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:51:59.018947 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:51:59.018947 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 08 20:51:59.018947 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 08 20:51:59.018947 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 08 20:51:59.018947 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:51:59.020090 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-5f957a2c-d758-4c2a-ab90-e933ec6e535a tempest-FlavorsExtraSpecsNegativeTestJSON-281855252 tempest-FlavorsExtraSpecsNegativeTestJSON-281855252-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:51:59.023047 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-5f957a2c-d758-4c2a-ab90-e933ec6e535a tempest-FlavorsExtraSpecsNegativeTestJSON-281855252 tempest-FlavorsExtraSpecsNegativeTestJSON-281855252-project] 10.222.0.26 "PUT /compute/v2.1/flavors/1077735903/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.061921 Oct 08 20:51:59.026156 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 63/120] 10.222.0.26 () {60 vars in 1265 bytes} [Sat Oct 8 20:51:58 2022] PUT /compute/v2.1/flavors/1077735903/os-extra_specs/hw:numa_nodes => generated 124 bytes in 67 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 08 20:51:59.039069 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-d7c45f88-7e63-4305-a9a7-c7b2af5f5fd0 tempest-FlavorsExtraSpecsNegativeTestJSON-753630458 tempest-FlavorsExtraSpecsNegativeTestJSON-753630458-project-admin] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:51:59.061944 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-d7c45f88-7e63-4305-a9a7-c7b2af5f5fd0 tempest-FlavorsExtraSpecsNegativeTestJSON-753630458 tempest-FlavorsExtraSpecsNegativeTestJSON-753630458-project-admin] HTTP exception thrown: Flavor 1077735903 has no extra specs with key hw:cpu_thread_policy. Oct 08 20:51:59.067612 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-d7c45f88-7e63-4305-a9a7-c7b2af5f5fd0 tempest-FlavorsExtraSpecsNegativeTestJSON-753630458 tempest-FlavorsExtraSpecsNegativeTestJSON-753630458-project-admin] Request method failure captured: Oct 08 20:51:59.067612 ncdv-master-1 devstack@n-api.service[140492]: request: DELETE /compute/v2.1/flavors/1077735903/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Oct 08 20:51:59.067612 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 20:51:59.067612 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 20:51:59.067612 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 20:51:59.067612 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 20:51:59.067612 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 20:51:59.067612 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 20:51:59.067612 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 20:51:59.067612 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 20:51:59.067612 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeLsw5FoQq3ml20vzblEBUx9KLXJFoBqqoNB3BRZO-53WlhGPZbCLMeX6mfI58Zo2m3fHLFxkt4DAoEOPpJuB2JeZYvCIV3g4rRgKfua2NHOA1w85MfPpnhC03r-_c-6kTLqWZChXLNiIhKeXlozMohqUWQIza26pz1lyNTFphNth3s Oct 08 20:51:59.067612 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 20:51:59.067612 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 20:51:59.067612 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 20:51:59.067612 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 20:51:59.067612 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 20:51:59.067612 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 20:51:59.067612 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 87abe2b078e54502bd626fa172df49d1 Oct 08 20:51:59.067612 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-753630458 Oct 08 20:51:59.067612 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,admin,member Oct 08 20:51:59.067612 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,admin,member Oct 08 20:51:59.068769 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/87abe2b078e54502bd626fa172df49d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/87abe2b078e54502bd626fa172df49d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_87abe2b078e54502bd626fa172df49d1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/87abe2b078e54502bd626fa172df49d1"}]}] Oct 08 20:51:59.068769 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-753630458 Oct 08 20:51:59.068769 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 87abe2b078e54502bd626fa172df49d1 Oct 08 20:51:59.068769 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-753630458 Oct 08 20:51:59.068769 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-753630458-project-admin Oct 08 20:51:59.068769 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 20:51:59.068769 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 20:51:59.068769 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 6bf7e17231934826bdcd3a35e551b416 Oct 08 20:51:59.068769 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-753630458-project-admin Oct 08 20:51:59.068769 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 20:51:59.068769 ncdv-master-1 devstack@n-api.service[140492]: exception: Flavor 1077735903 has no extra specs with key hw:cpu_thread_policy. Oct 08 20:51:59.069460 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'flavor_id': '1077735903', 'id': 'hw:cpu_thread_policy'} Oct 08 20:51:59.069460 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:51:59.069460 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:51:59.069460 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Oct 08 20:51:59.069460 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Oct 08 20:51:59.069460 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Oct 08 20:51:59.069460 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:51:59.069460 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:51:59.069460 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:51:59.069460 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:51:59.069460 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:51:59.069460 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:51:59.069460 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:51:59.069460 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:51:59.069460 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:51:59.069460 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:51:59.069460 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Oct 08 20:51:59.069460 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 08 20:51:59.069460 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1077735903 has no extra specs with key hw:cpu_thread_policy. Oct 08 20:51:59.069460 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:51:59.069460 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:51:59.069460 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:51:59.070571 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:51:59.070571 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:51:59.070571 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:51:59.070571 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 20:51:59.070571 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 20:51:59.070571 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1077735903 has no extra specs with key hw:cpu_thread_policy. Oct 08 20:51:59.070571 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:51:59.070571 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-d7c45f88-7e63-4305-a9a7-c7b2af5f5fd0 tempest-FlavorsExtraSpecsNegativeTestJSON-753630458 tempest-FlavorsExtraSpecsNegativeTestJSON-753630458-project-admin] Returning 404 to user: Flavor 1077735903 has no extra specs with key hw:cpu_thread_policy. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:51:59.070571 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-d7c45f88-7e63-4305-a9a7-c7b2af5f5fd0 tempest-FlavorsExtraSpecsNegativeTestJSON-753630458 tempest-FlavorsExtraSpecsNegativeTestJSON-753630458-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/1077735903/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.038557 Oct 08 20:51:59.071758 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 64/121] 10.222.0.26 () {58 vars in 1269 bytes} [Sat Oct 8 20:51:59 2022] DELETE /compute/v2.1/flavors/1077735903/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 20:51:59.079749 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-991d6208-7653-443a-a814-4cae8401b8e3 tempest-FlavorsExtraSpecsNegativeTestJSON-753630458 tempest-FlavorsExtraSpecsNegativeTestJSON-753630458-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:51:59.088552 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-991d6208-7653-443a-a814-4cae8401b8e3 tempest-FlavorsExtraSpecsNegativeTestJSON-753630458 tempest-FlavorsExtraSpecsNegativeTestJSON-753630458-project-admin] HTTP exception thrown: Request body and URI mismatch Oct 08 20:51:59.090282 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-991d6208-7653-443a-a814-4cae8401b8e3 tempest-FlavorsExtraSpecsNegativeTestJSON-753630458 tempest-FlavorsExtraSpecsNegativeTestJSON-753630458-project-admin] Request method failure captured: Oct 08 20:51:59.090282 ncdv-master-1 devstack@n-api.service[140492]: request: PUT /compute/v2.1/flavors/1077735903/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 08 20:51:59.090282 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 20:51:59.090282 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 20:51:59.090282 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 20:51:59.090282 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 27 Oct 08 20:51:59.090282 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 20:51:59.090282 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 20:51:59.090282 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 20:51:59.090282 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 20:51:59.090282 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeLsw5FoQq3ml20vzblEBUx9KLXJFoBqqoNB3BRZO-53WlhGPZbCLMeX6mfI58Zo2m3fHLFxkt4DAoEOPpJuB2JeZYvCIV3g4rRgKfua2NHOA1w85MfPpnhC03r-_c-6kTLqWZChXLNiIhKeXlozMohqUWQIza26pz1lyNTFphNth3s Oct 08 20:51:59.090282 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 20:51:59.090282 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 20:51:59.090282 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 20:51:59.090282 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 20:51:59.090282 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 20:51:59.090282 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 20:51:59.090282 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 87abe2b078e54502bd626fa172df49d1 Oct 08 20:51:59.090282 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-753630458 Oct 08 20:51:59.090282 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,admin,member Oct 08 20:51:59.090282 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,admin,member Oct 08 20:51:59.091697 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/87abe2b078e54502bd626fa172df49d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/87abe2b078e54502bd626fa172df49d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_87abe2b078e54502bd626fa172df49d1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/87abe2b078e54502bd626fa172df49d1"}]}] Oct 08 20:51:59.091697 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-753630458 Oct 08 20:51:59.091697 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 87abe2b078e54502bd626fa172df49d1 Oct 08 20:51:59.091697 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-753630458 Oct 08 20:51:59.091697 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-753630458-project-admin Oct 08 20:51:59.091697 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 20:51:59.091697 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 20:51:59.091697 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 6bf7e17231934826bdcd3a35e551b416 Oct 08 20:51:59.091697 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-753630458-project-admin Oct 08 20:51:59.091697 ncdv-master-1 devstack@n-api.service[140492]: Oct 08 20:51:59.091697 ncdv-master-1 devstack@n-api.service[140492]: {"hw:cpu_policy": "shared"} Oct 08 20:51:59.091697 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 20:51:59.091697 ncdv-master-1 devstack@n-api.service[140492]: exception: Request body and URI mismatch Oct 08 20:51:59.092571 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'flavor_id': '1077735903', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Oct 08 20:51:59.092571 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:51:59.092571 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:51:59.092571 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:51:59.092571 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:51:59.092571 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:51:59.092571 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:51:59.092571 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:51:59.092571 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:51:59.092571 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 20:51:59.092571 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 20:51:59.092571 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Oct 08 20:51:59.092571 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Oct 08 20:51:59.092571 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Oct 08 20:51:59.092571 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:51:59.092571 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:51:59.092571 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:51:59.092571 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:51:59.092571 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:51:59.092571 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:51:59.093963 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 20:51:59.093963 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 20:51:59.093963 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Oct 08 20:51:59.093963 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:51:59.093963 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-991d6208-7653-443a-a814-4cae8401b8e3 tempest-FlavorsExtraSpecsNegativeTestJSON-753630458 tempest-FlavorsExtraSpecsNegativeTestJSON-753630458-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:51:59.093963 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-991d6208-7653-443a-a814-4cae8401b8e3 tempest-FlavorsExtraSpecsNegativeTestJSON-753630458 tempest-FlavorsExtraSpecsNegativeTestJSON-753630458-project-admin] 10.222.0.26 "PUT /compute/v2.1/flavors/1077735903/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.016955 Oct 08 20:51:59.093963 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 65/122] 10.222.0.26 () {60 vars in 1265 bytes} [Sat Oct 8 20:51:59 2022] PUT /compute/v2.1/flavors/1077735903/os-extra_specs/hw:numa_nodes => generated 73 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Oct 08 20:51:59.103342 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-9bfa4f96-ccf0-411b-b14b-21060ad9a90c tempest-FlavorsExtraSpecsNegativeTestJSON-753630458 tempest-FlavorsExtraSpecsNegativeTestJSON-753630458-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:51:59.110763 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-9bfa4f96-ccf0-411b-b14b-21060ad9a90c tempest-FlavorsExtraSpecsNegativeTestJSON-753630458 tempest-FlavorsExtraSpecsNegativeTestJSON-753630458-project-admin] Request method failure captured: Oct 08 20:51:59.110763 ncdv-master-1 devstack@n-api.service[140492]: request: PUT /compute/v2.1/flavors/1077735903/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 08 20:51:59.110763 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 20:51:59.110763 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 20:51:59.110763 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 20:51:59.110763 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 49 Oct 08 20:51:59.110763 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 20:51:59.110763 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 20:51:59.110763 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 20:51:59.110763 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 20:51:59.110763 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeLsw5FoQq3ml20vzblEBUx9KLXJFoBqqoNB3BRZO-53WlhGPZbCLMeX6mfI58Zo2m3fHLFxkt4DAoEOPpJuB2JeZYvCIV3g4rRgKfua2NHOA1w85MfPpnhC03r-_c-6kTLqWZChXLNiIhKeXlozMohqUWQIza26pz1lyNTFphNth3s Oct 08 20:51:59.110763 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 20:51:59.110763 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 20:51:59.110763 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 20:51:59.110763 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 20:51:59.110763 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 20:51:59.110763 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 20:51:59.110763 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 87abe2b078e54502bd626fa172df49d1 Oct 08 20:51:59.110763 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-753630458 Oct 08 20:51:59.110763 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,admin,member Oct 08 20:51:59.110763 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,admin,member Oct 08 20:51:59.112365 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/87abe2b078e54502bd626fa172df49d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/87abe2b078e54502bd626fa172df49d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_87abe2b078e54502bd626fa172df49d1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/87abe2b078e54502bd626fa172df49d1"}]}] Oct 08 20:51:59.112365 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-753630458 Oct 08 20:51:59.112365 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 87abe2b078e54502bd626fa172df49d1 Oct 08 20:51:59.112365 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-753630458 Oct 08 20:51:59.112365 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-753630458-project-admin Oct 08 20:51:59.112365 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 20:51:59.112365 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 20:51:59.112365 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 6bf7e17231934826bdcd3a35e551b416 Oct 08 20:51:59.112365 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-753630458-project-admin Oct 08 20:51:59.112365 ncdv-master-1 devstack@n-api.service[140492]: Oct 08 20:51:59.112365 ncdv-master-1 devstack@n-api.service[140492]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Oct 08 20:51:59.112365 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 20:51:59.113019 ncdv-master-1 devstack@n-api.service[140492]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 08 20:51:59.113019 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'flavor_id': '1077735903', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Oct 08 20:51:59.113019 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:51:59.113019 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:51:59.113019 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 08 20:51:59.113019 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 08 20:51:59.113019 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 08 20:51:59.113019 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise error Oct 08 20:51:59.113019 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 08 20:51:59.113019 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:51:59.113019 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Oct 08 20:51:59.113019 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 08 20:51:59.113019 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Oct 08 20:51:59.113019 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Oct 08 20:51:59.113019 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 08 20:51:59.113019 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi 'type': ['string', Oct 08 20:51:59.113019 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi 'number']}}, Oct 08 20:51:59.113019 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 08 20:51:59.113019 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:51:59.113019 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi On instance: Oct 08 20:51:59.113019 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Oct 08 20:51:59.113019 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:51:59.114294 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:51:59.114294 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:51:59.114294 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:51:59.114294 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:51:59.114294 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:51:59.114294 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:51:59.114294 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:51:59.114294 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:51:59.114294 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:51:59.114294 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 08 20:51:59.114294 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 08 20:51:59.114294 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 08 20:51:59.114294 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 08 20:51:59.114294 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 08 20:51:59.114294 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 08 20:51:59.114294 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 08 20:51:59.114294 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:51:59.114294 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:51:59.114294 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:51:59.114294 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:51:59.115408 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:51:59.115408 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:51:59.115408 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 08 20:51:59.115408 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 08 20:51:59.115408 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 08 20:51:59.115408 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:51:59.115408 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-9bfa4f96-ccf0-411b-b14b-21060ad9a90c tempest-FlavorsExtraSpecsNegativeTestJSON-753630458 tempest-FlavorsExtraSpecsNegativeTestJSON-753630458-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:51:59.115408 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-9bfa4f96-ccf0-411b-b14b-21060ad9a90c tempest-FlavorsExtraSpecsNegativeTestJSON-753630458 tempest-FlavorsExtraSpecsNegativeTestJSON-753630458-project-admin] 10.222.0.26 "PUT /compute/v2.1/flavors/1077735903/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.014476 Oct 08 20:51:59.115408 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 66/123] 10.222.0.26 () {60 vars in 1265 bytes} [Sat Oct 8 20:51:59 2022] PUT /compute/v2.1/flavors/1077735903/os-extra_specs/hw:numa_nodes => generated 117 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 08 20:51:59.123567 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-f4351be1-7185-475f-91f5-761033dd8828 tempest-FlavorsExtraSpecsNegativeTestJSON-753630458 tempest-FlavorsExtraSpecsNegativeTestJSON-753630458-project-admin] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:51:59.169398 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-f4351be1-7185-475f-91f5-761033dd8828 tempest-FlavorsExtraSpecsNegativeTestJSON-753630458 tempest-FlavorsExtraSpecsNegativeTestJSON-753630458-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/1077735903" status: 202 len: 0 microversion: 2.1 time: 0.047505 Oct 08 20:51:59.174020 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 67/124] 10.222.0.26 () {58 vars in 1161 bytes} [Sat Oct 8 20:51:59 2022] DELETE /compute/v2.1/flavors/1077735903 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 20:51:59.178262 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.network.neutron [None req-05572c17-c58d-4677-bc2c-f1f5336efeb8 tempest-QuotasAdminNegativeTest-6339137 tempest-QuotasAdminNegativeTest-6339137-project] validate_networks() for None {{(pid=140491) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 20:51:59.188735 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-76cbd41e-42de-473d-900e-b9c99f567ab4 tempest-FlavorsExtraSpecsNegativeTestJSON-753630458 tempest-FlavorsExtraSpecsNegativeTestJSON-753630458-project-admin] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:51:59.255767 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-76cbd41e-42de-473d-900e-b9c99f567ab4 tempest-FlavorsExtraSpecsNegativeTestJSON-753630458 tempest-FlavorsExtraSpecsNegativeTestJSON-753630458-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.078181 Oct 08 20:51:59.259233 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 68/125] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Oct 8 20:51:59 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:51:59.384226 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-da285e33-d0b4-4259-a9a0-01bd85827ed4 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:51:59.384830 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-da285e33-d0b4-4259-a9a0-01bd85827ed4 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] [instance: 6611e099-c1f0-4fed-ba7b-0b096800946d] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:51:59.394108 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-da285e33-d0b4-4259-a9a0-01bd85827ed4 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:51:59.394608 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-da285e33-d0b4-4259-a9a0-01bd85827ed4 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:51:59.402718 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-da285e33-d0b4-4259-a9a0-01bd85827ed4 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:51:59.403491 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-da285e33-d0b4-4259-a9a0-01bd85827ed4 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:51:59.403966 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-da285e33-d0b4-4259-a9a0-01bd85827ed4 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:51:59.404393 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-da285e33-d0b4-4259-a9a0-01bd85827ed4 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:51:59.485813 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-05572c17-c58d-4677-bc2c-f1f5336efeb8 tempest-QuotasAdminNegativeTest-6339137 tempest-QuotasAdminNegativeTest-6339137-project] Flavor limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 20:51:59.488251 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-05572c17-c58d-4677-bc2c-f1f5336efeb8 tempest-QuotasAdminNegativeTest-6339137 tempest-QuotasAdminNegativeTest-6339137-project] Image limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 20:51:59.489014 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-05572c17-c58d-4677-bc2c-f1f5336efeb8 tempest-QuotasAdminNegativeTest-6339137 tempest-QuotasAdminNegativeTest-6339137-project] Flavor pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 20:51:59.489697 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-05572c17-c58d-4677-bc2c-f1f5336efeb8 tempest-QuotasAdminNegativeTest-6339137 tempest-QuotasAdminNegativeTest-6339137-project] Image pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 20:51:59.490786 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-05572c17-c58d-4677-bc2c-f1f5336efeb8 tempest-QuotasAdminNegativeTest-6339137 tempest-QuotasAdminNegativeTest-6339137-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 20:51:59.511389 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-05572c17-c58d-4677-bc2c-f1f5336efeb8 tempest-QuotasAdminNegativeTest-6339137 tempest-QuotasAdminNegativeTest-6339137-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:51:59.511879 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-05572c17-c58d-4677-bc2c-f1f5336efeb8 tempest-QuotasAdminNegativeTest-6339137 tempest-QuotasAdminNegativeTest-6339137-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:51:59.512482 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-05572c17-c58d-4677-bc2c-f1f5336efeb8 tempest-QuotasAdminNegativeTest-6339137 tempest-QuotasAdminNegativeTest-6339137-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:51:59.513435 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-05572c17-c58d-4677-bc2c-f1f5336efeb8 tempest-QuotasAdminNegativeTest-6339137 tempest-QuotasAdminNegativeTest-6339137-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:51:59.514060 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-05572c17-c58d-4677-bc2c-f1f5336efeb8 tempest-QuotasAdminNegativeTest-6339137 tempest-QuotasAdminNegativeTest-6339137-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:51:59.514501 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-05572c17-c58d-4677-bc2c-f1f5336efeb8 tempest-QuotasAdminNegativeTest-6339137 tempest-QuotasAdminNegativeTest-6339137-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:51:59.548776 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-05572c17-c58d-4677-bc2c-f1f5336efeb8 tempest-QuotasAdminNegativeTest-6339137 tempest-QuotasAdminNegativeTest-6339137-project] Getting quotas for project 00d9071ba2e34475baf046a4c42f9889. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 20:51:59.553964 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-05572c17-c58d-4677-bc2c-f1f5336efeb8 tempest-QuotasAdminNegativeTest-6339137 tempest-QuotasAdminNegativeTest-6339137-project] Getting quotas for user 572574747ca24cadb63e09288452bd25 and project 00d9071ba2e34475baf046a4c42f9889. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 20:51:59.573635 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.utils [None req-05572c17-c58d-4677-bc2c-f1f5336efeb8 tempest-QuotasAdminNegativeTest-6339137 tempest-QuotasAdminNegativeTest-6339137-project] cores quota exceeded for 00d9071ba2e34475baf046a4c42f9889, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=140491) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 08 20:51:59.575186 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-05572c17-c58d-4677-bc2c-f1f5336efeb8 tempest-QuotasAdminNegativeTest-6339137 tempest-QuotasAdminNegativeTest-6339137-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 08 20:51:59.581470 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-05572c17-c58d-4677-bc2c-f1f5336efeb8 tempest-QuotasAdminNegativeTest-6339137 tempest-QuotasAdminNegativeTest-6339137-project] Request method failure captured: Oct 08 20:51:59.581470 ncdv-master-1 devstack@n-api.service[140491]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 08 20:51:59.581470 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 20:51:59.581470 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 20:51:59.581470 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 20:51:59.581470 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 145 Oct 08 20:51:59.581470 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 20:51:59.581470 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 20:51:59.581470 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 20:51:59.581470 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 20:51:59.581470 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeLfV9Tk7aPmW9QeTiH2LxXAzyM8BCBMjnUlhbwl0rvpRDRBSOrkwoyXI_EIKpkZDUqXoZ7LVbfFySgAOZW2LTWH7bUDXwELaM0SNGQLDiLz78GDz4T6GWZfUflK9nIBHofFabEjI9ByIC0isVriImIgzllX1eFCns64S-AlHpg12KI Oct 08 20:51:59.581470 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 20:51:59.581470 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 20:51:59.581470 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 20:51:59.581470 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 20:51:59.581470 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 20:51:59.581470 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 20:51:59.581470 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 00d9071ba2e34475baf046a4c42f9889 Oct 08 20:51:59.581470 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-QuotasAdminNegativeTest-6339137 Oct 08 20:51:59.581470 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 20:51:59.581470 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 20:51:59.582957 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/00d9071ba2e34475baf046a4c42f9889"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/00d9071ba2e34475baf046a4c42f9889"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_00d9071ba2e34475baf046a4c42f9889"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/00d9071ba2e34475baf046a4c42f9889"}]}] Oct 08 20:51:59.582957 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-QuotasAdminNegativeTest-6339137 Oct 08 20:51:59.582957 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 00d9071ba2e34475baf046a4c42f9889 Oct 08 20:51:59.582957 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-6339137 Oct 08 20:51:59.582957 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-QuotasAdminNegativeTest-6339137-project Oct 08 20:51:59.582957 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 20:51:59.582957 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 20:51:59.582957 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 572574747ca24cadb63e09288452bd25 Oct 08 20:51:59.582957 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-QuotasAdminNegativeTest-6339137-project Oct 08 20:51:59.582957 ncdv-master-1 devstack@n-api.service[140491]: Oct 08 20:51:59.582957 ncdv-master-1 devstack@n-api.service[140491]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1457487334", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452"}} Oct 08 20:51:59.582957 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 20:51:59.583801 ncdv-master-1 devstack@n-api.service[140491]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 08 20:51:59.583801 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1457487334', 'imageRef': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'flavorRef': '452'}}} Oct 08 20:51:59.583801 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:51:59.583801 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:51:59.583801 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 08 20:51:59.583801 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 08 20:51:59.583801 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 08 20:51:59.583801 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 08 20:51:59.583801 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 08 20:51:59.583801 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc Oct 08 20:51:59.583801 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 08 20:51:59.583801 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 08 20:51:59.583801 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 08 20:51:59.583801 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 08 20:51:59.583801 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 08 20:51:59.583801 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 08 20:51:59.583801 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 08 20:51:59.583801 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 08 20:51:59.584993 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 08 20:51:59.584993 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 08 20:51:59.584993 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Oct 08 20:51:59.584993 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:51:59.584993 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:51:59.584993 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:51:59.584993 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:51:59.584993 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 08 20:51:59.584993 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 08 20:51:59.584993 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 08 20:51:59.584993 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 08 20:51:59.584993 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 08 20:51:59.584993 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 08 20:51:59.584993 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 08 20:51:59.584993 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 08 20:51:59.584993 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 08 20:51:59.584993 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 08 20:51:59.584993 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 08 20:51:59.584993 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:51:59.584993 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:51:59.584993 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:51:59.586672 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:51:59.586672 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:51:59.586672 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:51:59.586672 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:51:59.586672 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:51:59.586672 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:51:59.586672 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:51:59.586672 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 20:51:59.586672 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 20:51:59.586672 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 20:51:59.586672 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 20:51:59.586672 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 20:51:59.586672 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 20:51:59.586672 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 08 20:51:59.586672 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 08 20:51:59.586672 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 08 20:51:59.586672 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 08 20:51:59.586672 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:51:59.586672 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:51:59.586672 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:51:59.586672 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:51:59.589246 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:51:59.589246 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:51:59.589246 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 20:51:59.589246 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 20:51:59.589246 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 08 20:51:59.589246 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:51:59.589246 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-05572c17-c58d-4677-bc2c-f1f5336efeb8 tempest-QuotasAdminNegativeTest-6339137 tempest-QuotasAdminNegativeTest-6339137-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:51:59.589246 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-05572c17-c58d-4677-bc2c-f1f5336efeb8 tempest-QuotasAdminNegativeTest-6339137 tempest-QuotasAdminNegativeTest-6339137-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 9.327291 Oct 08 20:51:59.594975 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 58/126] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 20:51:50 2022] POST /compute/v2.1/servers => generated 111 bytes in 9334 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 08 20:51:59.654410 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-da285e33-d0b4-4259-a9a0-01bd85827ed4 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0eb2feb062947e78357b70e832e3edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18029da9b9854f3caf3debd9556f1f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:51:59.662498 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-da285e33-d0b4-4259-a9a0-01bd85827ed4 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] 10.222.0.26 "GET /compute/v2.1/servers/6611e099-c1f0-4fed-ba7b-0b096800946d" status: 200 len: 1320 microversion: 2.1 time: 0.282896 Oct 08 20:51:59.678052 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 69/127] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:51:59 2022] GET /compute/v2.1/servers/6611e099-c1f0-4fed-ba7b-0b096800946d => generated 1320 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 20:51:59.684569 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-b1430eb3-0755-44aa-8514-ca158ba18b35 tempest-QuotasAdminNegativeTest-1295979369 tempest-QuotasAdminNegativeTest-1295979369-project-admin] Action: 'update', calling method: .version_select at 0x7f1a8d49fa60>, body: {"quota_set": {"cores": 20}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:51:59.939470 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-600b1faa-ffb3-4b9f-a468-7cce148161df tempest-QuotaClassesAdmin257Test-992755966 tempest-QuotaClassesAdmin257Test-992755966-project-admin] Calling method '.version_select at 0x7f1a8d59aaf0>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:51:59.958871 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-600b1faa-ffb3-4b9f-a468-7cce148161df tempest-QuotaClassesAdmin257Test-992755966 tempest-QuotaClassesAdmin257Test-992755966-project-admin] 10.222.0.26 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.361967 Oct 08 20:51:59.960141 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 59/128] 10.222.0.26 () {60 vars in 1226 bytes} [Sat Oct 8 20:51:59 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 08 20:51:59.973954 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-3139a51c-88cb-4d1b-87f9-dbb18484080a tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:51:59.974985 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-3139a51c-88cb-4d1b-87f9-dbb18484080a tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] [instance: bbff4ffb-395f-4eeb-a995-60c9c0f39f25] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:51:59.985879 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3139a51c-88cb-4d1b-87f9-dbb18484080a tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:51:59.986544 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3139a51c-88cb-4d1b-87f9-dbb18484080a tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:51:59.987180 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3139a51c-88cb-4d1b-87f9-dbb18484080a tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:51:59.988106 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3139a51c-88cb-4d1b-87f9-dbb18484080a tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:51:59.988565 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3139a51c-88cb-4d1b-87f9-dbb18484080a tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:51:59.988992 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3139a51c-88cb-4d1b-87f9-dbb18484080a tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:51:59.990336 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=12 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:00.094346 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b1430eb3-0755-44aa-8514-ca158ba18b35 tempest-QuotasAdminNegativeTest-1295979369 tempest-QuotasAdminNegativeTest-1295979369-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:00.095398 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b1430eb3-0755-44aa-8514-ca158ba18b35 tempest-QuotasAdminNegativeTest-1295979369 tempest-QuotasAdminNegativeTest-1295979369-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:00.095838 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b1430eb3-0755-44aa-8514-ca158ba18b35 tempest-QuotasAdminNegativeTest-1295979369 tempest-QuotasAdminNegativeTest-1295979369-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:00.096730 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b1430eb3-0755-44aa-8514-ca158ba18b35 tempest-QuotasAdminNegativeTest-1295979369 tempest-QuotasAdminNegativeTest-1295979369-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:00.097229 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b1430eb3-0755-44aa-8514-ca158ba18b35 tempest-QuotasAdminNegativeTest-1295979369 tempest-QuotasAdminNegativeTest-1295979369-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:00.097643 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b1430eb3-0755-44aa-8514-ca158ba18b35 tempest-QuotasAdminNegativeTest-1295979369 tempest-QuotasAdminNegativeTest-1295979369-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:00.170515 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-b1430eb3-0755-44aa-8514-ca158ba18b35 tempest-QuotasAdminNegativeTest-1295979369 tempest-QuotasAdminNegativeTest-1295979369-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-quota-sets/00d9071ba2e34475baf046a4c42f9889" status: 200 len: 329 microversion: 2.1 time: 0.491122 Oct 08 20:52:00.180417 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 70/129] 10.222.0.26 () {60 vars in 1262 bytes} [Sat Oct 8 20:51:59 2022] PUT /compute/v2.1/os-quota-sets/00d9071ba2e34475baf046a4c42f9889 => generated 329 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:52:00.186867 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-6e88e09d-849c-4dc0-8016-f8745741699c tempest-QuotaClassesAdmin257Test-992755966 tempest-QuotaClassesAdmin257Test-992755966-project-admin] Action: 'update', calling method: .version_select at 0x7f1a8df87e50>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:52:00.327076 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-3139a51c-88cb-4d1b-87f9-dbb18484080a tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8da7d5210cf42bda150d342ff207bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd024396aef784f3291630c426a828cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:00.339218 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-3139a51c-88cb-4d1b-87f9-dbb18484080a tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] 10.222.0.26 "GET /compute/v2.1/servers/bbff4ffb-395f-4eeb-a995-60c9c0f39f25" status: 200 len: 1339 microversion: 2.1 time: 0.372540 Oct 08 20:52:00.359083 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 60/130] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:51:59 2022] GET /compute/v2.1/servers/bbff4ffb-395f-4eeb-a995-60c9c0f39f25 => generated 1339 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:52:00.364923 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-1ae7c3bf-746e-40b6-8414-56a4f4bc6a15 tempest-QuotasAdminNegativeTest-1295979369 tempest-QuotasAdminNegativeTest-1295979369-project-admin] Calling method '.version_select at 0x7f1a8d51ad30>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:00.439864 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=10,nova_api:SAVEPOINT=4,nova_api:RELEASE=4,nova_api:DELETE=3,nova_api:UPDATE=8 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:00.458013 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-6e88e09d-849c-4dc0-8016-f8745741699c tempest-QuotaClassesAdmin257Test-992755966 tempest-QuotaClassesAdmin257Test-992755966-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.273775 Oct 08 20:52:00.458013 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 71/131] 10.222.0.26 () {62 vars in 1247 bytes} [Sat Oct 8 20:52:00 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 08 20:52:00.472687 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-b7381fb3-0951-4e55-b991-b02f29562e64 tempest-QuotaClassesAdmin257Test-992755966 tempest-QuotaClassesAdmin257Test-992755966-project-admin] Calling method '.version_select at 0x7f1a8d453af0>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:00.484818 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-b7381fb3-0951-4e55-b991-b02f29562e64 tempest-QuotaClassesAdmin257Test-992755966 tempest-QuotaClassesAdmin257Test-992755966-project-admin] 10.222.0.26 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.016785 Oct 08 20:52:00.486210 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 72/132] 10.222.0.26 () {60 vars in 1226 bytes} [Sat Oct 8 20:52:00 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 08 20:52:00.496979 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-74eb8ca9-4c72-4238-a828-46a5b2d0c7e0 tempest-QuotaClassesAdmin257Test-992755966 tempest-QuotaClassesAdmin257Test-992755966-project-admin] Action: 'update', calling method: .version_select at 0x7f1a8d515ee0>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:52:00.566890 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-74eb8ca9-4c72-4238-a828-46a5b2d0c7e0 tempest-QuotaClassesAdmin257Test-992755966 tempest-QuotaClassesAdmin257Test-992755966-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.073436 Oct 08 20:52:00.567962 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 73/133] 10.222.0.26 () {62 vars in 1247 bytes} [Sat Oct 8 20:52:00 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 08 20:52:00.666364 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-1ae7c3bf-746e-40b6-8414-56a4f4bc6a15 tempest-QuotasAdminNegativeTest-1295979369 tempest-QuotasAdminNegativeTest-1295979369-project-admin] 10.222.0.26 "GET /compute/v2.1/os-quota-sets/00d9071ba2e34475baf046a4c42f9889" status: 200 len: 371 microversion: 2.1 time: 0.306051 Oct 08 20:52:00.666871 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 61/134] 10.222.0.26 () {58 vars in 1242 bytes} [Sat Oct 8 20:52:00 2022] GET /compute/v2.1/os-quota-sets/00d9071ba2e34475baf046a4c42f9889 => generated 371 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:52:00.679022 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-aaa6de73-58e6-43f8-b22e-30c3ee292a51 tempest-QuotasAdminNegativeTest-1295979369 tempest-QuotasAdminNegativeTest-1295979369-project-admin] Action: 'update', calling method: .version_select at 0x7f1a8d40e0d0>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:52:00.689583 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-77698430-c07b-4580-8357-5664124821c6 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:00.690196 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-77698430-c07b-4580-8357-5664124821c6 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] [instance: 6611e099-c1f0-4fed-ba7b-0b096800946d] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:52:00.696537 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-77698430-c07b-4580-8357-5664124821c6 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:00.697016 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-77698430-c07b-4580-8357-5664124821c6 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:00.697480 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-77698430-c07b-4580-8357-5664124821c6 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:00.698262 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-77698430-c07b-4580-8357-5664124821c6 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:00.698709 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-77698430-c07b-4580-8357-5664124821c6 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:00.699133 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-77698430-c07b-4580-8357-5664124821c6 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:00.847090 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-77698430-c07b-4580-8357-5664124821c6 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0eb2feb062947e78357b70e832e3edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18029da9b9854f3caf3debd9556f1f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:00.856641 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-77698430-c07b-4580-8357-5664124821c6 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] 10.222.0.26 "GET /compute/v2.1/servers/6611e099-c1f0-4fed-ba7b-0b096800946d" status: 200 len: 1320 microversion: 2.1 time: 0.170932 Oct 08 20:52:00.857264 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 62/135] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:52:00 2022] GET /compute/v2.1/servers/6611e099-c1f0-4fed-ba7b-0b096800946d => generated 1320 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 20:52:01.235702 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-aaa6de73-58e6-43f8-b22e-30c3ee292a51 tempest-QuotasAdminNegativeTest-1295979369 tempest-QuotasAdminNegativeTest-1295979369-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:01.236706 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-aaa6de73-58e6-43f8-b22e-30c3ee292a51 tempest-QuotasAdminNegativeTest-1295979369 tempest-QuotasAdminNegativeTest-1295979369-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:01.237406 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-aaa6de73-58e6-43f8-b22e-30c3ee292a51 tempest-QuotasAdminNegativeTest-1295979369 tempest-QuotasAdminNegativeTest-1295979369-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:01.238364 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-aaa6de73-58e6-43f8-b22e-30c3ee292a51 tempest-QuotasAdminNegativeTest-1295979369 tempest-QuotasAdminNegativeTest-1295979369-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:01.239085 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-aaa6de73-58e6-43f8-b22e-30c3ee292a51 tempest-QuotasAdminNegativeTest-1295979369 tempest-QuotasAdminNegativeTest-1295979369-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:01.240070 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-aaa6de73-58e6-43f8-b22e-30c3ee292a51 tempest-QuotasAdminNegativeTest-1295979369 tempest-QuotasAdminNegativeTest-1295979369-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:01.313547 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-aaa6de73-58e6-43f8-b22e-30c3ee292a51 tempest-QuotasAdminNegativeTest-1295979369 tempest-QuotasAdminNegativeTest-1295979369-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-quota-sets/00d9071ba2e34475baf046a4c42f9889" status: 200 len: 328 microversion: 2.1 time: 0.638409 Oct 08 20:52:01.314551 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 74/136] 10.222.0.26 () {60 vars in 1262 bytes} [Sat Oct 8 20:52:00 2022] PUT /compute/v2.1/os-quota-sets/00d9071ba2e34475baf046a4c42f9889 => generated 328 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:52:01.367604 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-0c7f22e1-51d8-4d3e-8ce0-0ee2a2e94aa6 tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:01.368235 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-0c7f22e1-51d8-4d3e-8ce0-0ee2a2e94aa6 tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] [instance: bbff4ffb-395f-4eeb-a995-60c9c0f39f25] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:52:01.375923 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0c7f22e1-51d8-4d3e-8ce0-0ee2a2e94aa6 tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:01.377493 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0c7f22e1-51d8-4d3e-8ce0-0ee2a2e94aa6 tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:01.378162 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0c7f22e1-51d8-4d3e-8ce0-0ee2a2e94aa6 tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:01.379087 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0c7f22e1-51d8-4d3e-8ce0-0ee2a2e94aa6 tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:01.379934 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0c7f22e1-51d8-4d3e-8ce0-0ee2a2e94aa6 tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:01.380619 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0c7f22e1-51d8-4d3e-8ce0-0ee2a2e94aa6 tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:01.538324 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-70d328ce-3b72-40f2-9b8d-9aa68af0003c tempest-QuotasAdminNegativeTest-6339137 tempest-QuotasAdminNegativeTest-6339137-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-278221456", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:52:01.554047 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-0c7f22e1-51d8-4d3e-8ce0-0ee2a2e94aa6 tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8da7d5210cf42bda150d342ff207bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd024396aef784f3291630c426a828cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:01.564195 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-0c7f22e1-51d8-4d3e-8ce0-0ee2a2e94aa6 tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] 10.222.0.26 "GET /compute/v2.1/servers/bbff4ffb-395f-4eeb-a995-60c9c0f39f25" status: 200 len: 1339 microversion: 2.1 time: 0.201739 Oct 08 20:52:01.585247 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 63/137] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:52:01 2022] GET /compute/v2.1/servers/bbff4ffb-395f-4eeb-a995-60c9c0f39f25 => generated 1339 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 20:52:01.643372 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.network.neutron [None req-70d328ce-3b72-40f2-9b8d-9aa68af0003c tempest-QuotasAdminNegativeTest-6339137 tempest-QuotasAdminNegativeTest-6339137-project] validate_networks() for None {{(pid=140492) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 20:52:01.880090 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-ddf4a9fe-022c-49ee-82e7-431f9667b279 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:01.880714 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-ddf4a9fe-022c-49ee-82e7-431f9667b279 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] [instance: 6611e099-c1f0-4fed-ba7b-0b096800946d] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:52:01.897727 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ddf4a9fe-022c-49ee-82e7-431f9667b279 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:01.898532 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ddf4a9fe-022c-49ee-82e7-431f9667b279 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:01.903896 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ddf4a9fe-022c-49ee-82e7-431f9667b279 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:01.904861 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ddf4a9fe-022c-49ee-82e7-431f9667b279 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:01.905538 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ddf4a9fe-022c-49ee-82e7-431f9667b279 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:01.907575 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ddf4a9fe-022c-49ee-82e7-431f9667b279 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:01.942051 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-70d328ce-3b72-40f2-9b8d-9aa68af0003c tempest-QuotasAdminNegativeTest-6339137 tempest-QuotasAdminNegativeTest-6339137-project] Flavor limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 20:52:01.942499 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-70d328ce-3b72-40f2-9b8d-9aa68af0003c tempest-QuotasAdminNegativeTest-6339137 tempest-QuotasAdminNegativeTest-6339137-project] Image limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 20:52:01.942991 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-70d328ce-3b72-40f2-9b8d-9aa68af0003c tempest-QuotasAdminNegativeTest-6339137 tempest-QuotasAdminNegativeTest-6339137-project] Flavor pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 20:52:01.943416 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-70d328ce-3b72-40f2-9b8d-9aa68af0003c tempest-QuotasAdminNegativeTest-6339137 tempest-QuotasAdminNegativeTest-6339137-project] Image pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 20:52:01.943839 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-70d328ce-3b72-40f2-9b8d-9aa68af0003c tempest-QuotasAdminNegativeTest-6339137 tempest-QuotasAdminNegativeTest-6339137-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 20:52:01.957515 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-70d328ce-3b72-40f2-9b8d-9aa68af0003c tempest-QuotasAdminNegativeTest-6339137 tempest-QuotasAdminNegativeTest-6339137-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:01.958013 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-70d328ce-3b72-40f2-9b8d-9aa68af0003c tempest-QuotasAdminNegativeTest-6339137 tempest-QuotasAdminNegativeTest-6339137-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:01.958901 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-70d328ce-3b72-40f2-9b8d-9aa68af0003c tempest-QuotasAdminNegativeTest-6339137 tempest-QuotasAdminNegativeTest-6339137-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:01.959576 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-70d328ce-3b72-40f2-9b8d-9aa68af0003c tempest-QuotasAdminNegativeTest-6339137 tempest-QuotasAdminNegativeTest-6339137-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:01.960051 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-70d328ce-3b72-40f2-9b8d-9aa68af0003c tempest-QuotasAdminNegativeTest-6339137 tempest-QuotasAdminNegativeTest-6339137-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:01.960487 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-70d328ce-3b72-40f2-9b8d-9aa68af0003c tempest-QuotasAdminNegativeTest-6339137 tempest-QuotasAdminNegativeTest-6339137-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:01.981899 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-70d328ce-3b72-40f2-9b8d-9aa68af0003c tempest-QuotasAdminNegativeTest-6339137 tempest-QuotasAdminNegativeTest-6339137-project] Getting quotas for project 00d9071ba2e34475baf046a4c42f9889. Resources: {'cores', 'instances', 'ram'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 20:52:01.988143 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-70d328ce-3b72-40f2-9b8d-9aa68af0003c tempest-QuotasAdminNegativeTest-6339137 tempest-QuotasAdminNegativeTest-6339137-project] Getting quotas for user 572574747ca24cadb63e09288452bd25 and project 00d9071ba2e34475baf046a4c42f9889. Resources: {'cores', 'instances', 'ram'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 20:52:02.016234 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.utils [None req-70d328ce-3b72-40f2-9b8d-9aa68af0003c tempest-QuotasAdminNegativeTest-6339137 tempest-QuotasAdminNegativeTest-6339137-project] instances quota exceeded for 00d9071ba2e34475baf046a4c42f9889, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=140492) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 08 20:52:02.017421 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-70d328ce-3b72-40f2-9b8d-9aa68af0003c tempest-QuotasAdminNegativeTest-6339137 tempest-QuotasAdminNegativeTest-6339137-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 08 20:52:02.021648 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-70d328ce-3b72-40f2-9b8d-9aa68af0003c tempest-QuotasAdminNegativeTest-6339137 tempest-QuotasAdminNegativeTest-6339137-project] Request method failure captured: Oct 08 20:52:02.021648 ncdv-master-1 devstack@n-api.service[140492]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 08 20:52:02.021648 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 20:52:02.021648 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 20:52:02.021648 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 20:52:02.021648 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 144 Oct 08 20:52:02.021648 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 20:52:02.021648 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 20:52:02.021648 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 20:52:02.021648 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 20:52:02.021648 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeLfV9Tk7aPmW9QeTiH2LxXAzyM8BCBMjnUlhbwl0rvpRDRBSOrkwoyXI_EIKpkZDUqXoZ7LVbfFySgAOZW2LTWH7bUDXwELaM0SNGQLDiLz78GDz4T6GWZfUflK9nIBHofFabEjI9ByIC0isVriImIgzllX1eFCns64S-AlHpg12KI Oct 08 20:52:02.021648 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 20:52:02.021648 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 20:52:02.021648 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 20:52:02.021648 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 20:52:02.021648 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 20:52:02.021648 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 20:52:02.021648 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 00d9071ba2e34475baf046a4c42f9889 Oct 08 20:52:02.021648 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-QuotasAdminNegativeTest-6339137 Oct 08 20:52:02.021648 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 20:52:02.021648 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 20:52:02.022827 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/00d9071ba2e34475baf046a4c42f9889"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/00d9071ba2e34475baf046a4c42f9889"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_00d9071ba2e34475baf046a4c42f9889"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/00d9071ba2e34475baf046a4c42f9889"}]}] Oct 08 20:52:02.022827 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-QuotasAdminNegativeTest-6339137 Oct 08 20:52:02.022827 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 00d9071ba2e34475baf046a4c42f9889 Oct 08 20:52:02.022827 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-6339137 Oct 08 20:52:02.022827 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-QuotasAdminNegativeTest-6339137-project Oct 08 20:52:02.022827 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 20:52:02.022827 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 20:52:02.022827 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 572574747ca24cadb63e09288452bd25 Oct 08 20:52:02.022827 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-QuotasAdminNegativeTest-6339137-project Oct 08 20:52:02.022827 ncdv-master-1 devstack@n-api.service[140492]: Oct 08 20:52:02.022827 ncdv-master-1 devstack@n-api.service[140492]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-278221456", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452"}} Oct 08 20:52:02.022827 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 20:52:02.023464 ncdv-master-1 devstack@n-api.service[140492]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 08 20:52:02.023464 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-278221456', 'imageRef': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'flavorRef': '452'}}} Oct 08 20:52:02.023464 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:52:02.023464 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:52:02.023464 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 08 20:52:02.023464 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 08 20:52:02.023464 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 08 20:52:02.023464 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 08 20:52:02.023464 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 08 20:52:02.023464 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc Oct 08 20:52:02.023464 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 08 20:52:02.023464 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 08 20:52:02.023464 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 08 20:52:02.023464 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 08 20:52:02.023464 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 08 20:52:02.023464 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 08 20:52:02.023464 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 08 20:52:02.023464 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 08 20:52:02.024372 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 08 20:52:02.024372 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 08 20:52:02.024372 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Oct 08 20:52:02.024372 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:52:02.024372 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:52:02.024372 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:52:02.024372 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:52:02.024372 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 08 20:52:02.024372 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 08 20:52:02.024372 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 08 20:52:02.024372 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 08 20:52:02.024372 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 08 20:52:02.024372 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 08 20:52:02.024372 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 08 20:52:02.024372 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 08 20:52:02.024372 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 08 20:52:02.024372 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 08 20:52:02.024372 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 08 20:52:02.024372 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:52:02.024372 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:52:02.024372 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:52:02.025556 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:52:02.025556 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:52:02.025556 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:52:02.025556 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:52:02.025556 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:52:02.025556 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:52:02.025556 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:52:02.025556 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 20:52:02.025556 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 20:52:02.025556 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 20:52:02.025556 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 20:52:02.025556 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 20:52:02.025556 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 20:52:02.025556 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 08 20:52:02.025556 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 08 20:52:02.025556 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 08 20:52:02.025556 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 08 20:52:02.025556 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:52:02.025556 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:52:02.025556 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:52:02.025556 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:52:02.026625 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:52:02.026625 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:52:02.026625 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 20:52:02.026625 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 20:52:02.026625 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 08 20:52:02.026625 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:52:02.028734 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-70d328ce-3b72-40f2-9b8d-9aa68af0003c tempest-QuotasAdminNegativeTest-6339137 tempest-QuotasAdminNegativeTest-6339137-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:52:02.029875 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-70d328ce-3b72-40f2-9b8d-9aa68af0003c tempest-QuotasAdminNegativeTest-6339137 tempest-QuotasAdminNegativeTest-6339137-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 0.500630 Oct 08 20:52:02.034751 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 75/138] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 20:52:01 2022] POST /compute/v2.1/servers => generated 119 bytes in 507 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 08 20:52:02.039655 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-446d1050-8fba-4cf8-89e1-e4d60e967f3e tempest-QuotasAdminNegativeTest-1295979369 tempest-QuotasAdminNegativeTest-1295979369-project-admin] Action: 'update', calling method: .version_select at 0x7f1a8d3e90d0>, body: {"quota_set": {"instances": 10}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:52:02.163440 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-ddf4a9fe-022c-49ee-82e7-431f9667b279 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0eb2feb062947e78357b70e832e3edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18029da9b9854f3caf3debd9556f1f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:02.175883 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-ddf4a9fe-022c-49ee-82e7-431f9667b279 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] 10.222.0.26 "GET /compute/v2.1/servers/6611e099-c1f0-4fed-ba7b-0b096800946d" status: 200 len: 1320 microversion: 2.1 time: 0.298975 Oct 08 20:52:02.177946 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 64/139] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:52:01 2022] GET /compute/v2.1/servers/6611e099-c1f0-4fed-ba7b-0b096800946d => generated 1320 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 20:52:02.334155 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-446d1050-8fba-4cf8-89e1-e4d60e967f3e tempest-QuotasAdminNegativeTest-1295979369 tempest-QuotasAdminNegativeTest-1295979369-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:02.334686 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-446d1050-8fba-4cf8-89e1-e4d60e967f3e tempest-QuotasAdminNegativeTest-1295979369 tempest-QuotasAdminNegativeTest-1295979369-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:02.335160 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-446d1050-8fba-4cf8-89e1-e4d60e967f3e tempest-QuotasAdminNegativeTest-1295979369 tempest-QuotasAdminNegativeTest-1295979369-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:02.338967 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-446d1050-8fba-4cf8-89e1-e4d60e967f3e tempest-QuotasAdminNegativeTest-1295979369 tempest-QuotasAdminNegativeTest-1295979369-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:02.345345 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-446d1050-8fba-4cf8-89e1-e4d60e967f3e tempest-QuotasAdminNegativeTest-1295979369 tempest-QuotasAdminNegativeTest-1295979369-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:02.346147 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-446d1050-8fba-4cf8-89e1-e4d60e967f3e tempest-QuotasAdminNegativeTest-1295979369 tempest-QuotasAdminNegativeTest-1295979369-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:02.403216 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-4720332a-683e-42f7-af0c-fed37e3ffbae tempest-KeyPairsV210TestJSON-774692896 tempest-KeyPairsV210TestJSON-774692896-project-admin] Action: 'create', calling method: .version_select at 0x7f1a8d59a040>, body: {"keypair": {"name": "tempest-keypair-803442243", "type": "ssh", "user_id": "c9d2c3e8b57644d49a214838baf2ac4c", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDBP9JrYnwzdd1tkOfK1sBHtG3W0myERqJTfFjpZ7TusBLCuWRkO/rcT731PRrFrV7EWx9oTlM8Jx4k+0DgGdKnNUIp/BYPOHsFeXbdUZ2fImYPmSYkb51VOiG15/r9rMA=="}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:52:02.420039 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-446d1050-8fba-4cf8-89e1-e4d60e967f3e tempest-QuotasAdminNegativeTest-1295979369 tempest-QuotasAdminNegativeTest-1295979369-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-quota-sets/00d9071ba2e34475baf046a4c42f9889" status: 200 len: 329 microversion: 2.1 time: 0.383699 Oct 08 20:52:02.429745 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-4720332a-683e-42f7-af0c-fed37e3ffbae tempest-KeyPairsV210TestJSON-774692896 tempest-KeyPairsV210TestJSON-774692896-project-admin] Getting quotas for project 494b1dc313b5471f9d074129b4657b5c. Resources: {'key_pairs'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 20:52:02.430435 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 76/140] 10.222.0.26 () {60 vars in 1262 bytes} [Sat Oct 8 20:52:02 2022] PUT /compute/v2.1/os-quota-sets/00d9071ba2e34475baf046a4c42f9889 => generated 329 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:52:02.433560 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-4720332a-683e-42f7-af0c-fed37e3ffbae tempest-KeyPairsV210TestJSON-774692896 tempest-KeyPairsV210TestJSON-774692896-project-admin] Getting quotas for user c717a1aeb72f4a3d85ea82f849e9dfe4 and project 494b1dc313b5471f9d074129b4657b5c. Resources: {'key_pairs'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 20:52:02.437761 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-3169cc91-4388-4f5f-8f7c-4d6d552dc50f tempest-QuotasAdminNegativeTest-1295979369 tempest-QuotasAdminNegativeTest-1295979369-project-admin] Calling method '.version_select at 0x7f1a8d32aca0>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:02.460623 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-4720332a-683e-42f7-af0c-fed37e3ffbae tempest-KeyPairsV210TestJSON-774692896 tempest-KeyPairsV210TestJSON-774692896-project-admin] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.10 time: 0.280478 Oct 08 20:52:02.461632 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 65/141] 10.222.0.26 () {62 vars in 1200 bytes} [Sat Oct 8 20:52:02 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 283 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 08 20:52:02.475023 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-cd766988-887e-44c9-af91-8eb9029a09cb tempest-KeyPairsV210TestJSON-774692896 tempest-KeyPairsV210TestJSON-774692896-project-admin] Action: 'create', calling method: .version_select at 0x7f1a8d59a820>, body: {"keypair": {"name": "tempest-keypair-192874865", "type": "ssh", "user_id": "c9d2c3e8b57644d49a214838baf2ac4c", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM7GdY85yZytGWnPb2vm0cDGOgRp6/NoACdjtH8YcWebAuTBhvbKOzhUKHIgZu4VsR58Hwim15DQI4HFTlMn3IdEhQYLA/yl2bvAlDbaUp84+YCUcN8fj0H2ltrFLnLGFw=="}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:52:02.494027 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-cd766988-887e-44c9-af91-8eb9029a09cb tempest-KeyPairsV210TestJSON-774692896 tempest-KeyPairsV210TestJSON-774692896-project-admin] Getting quotas for project 494b1dc313b5471f9d074129b4657b5c. Resources: {'key_pairs'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 20:52:02.500747 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-cd766988-887e-44c9-af91-8eb9029a09cb tempest-KeyPairsV210TestJSON-774692896 tempest-KeyPairsV210TestJSON-774692896-project-admin] Getting quotas for user c717a1aeb72f4a3d85ea82f849e9dfe4 and project 494b1dc313b5471f9d074129b4657b5c. Resources: {'key_pairs'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 20:52:02.529107 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-cd766988-887e-44c9-af91-8eb9029a09cb tempest-KeyPairsV210TestJSON-774692896 tempest-KeyPairsV210TestJSON-774692896-project-admin] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.10 time: 0.057944 Oct 08 20:52:02.530219 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 66/142] 10.222.0.26 () {62 vars in 1200 bytes} [Sat Oct 8 20:52:02 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 60 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Oct 08 20:52:02.540487 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-84d102b7-00a0-46fa-b2ca-703f93ac44f6 tempest-KeyPairsV210TestJSON-774692896 tempest-KeyPairsV210TestJSON-774692896-project-admin] Calling method '.version_select at 0x7f1a8d51aaf0>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:02.551528 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-84d102b7-00a0-46fa-b2ca-703f93ac44f6 tempest-KeyPairsV210TestJSON-774692896 tempest-KeyPairsV210TestJSON-774692896-project-admin] 10.222.0.26 "GET /compute/v2.1/os-keypairs/tempest-keypair-803442243?user_id=c9d2c3e8b57644d49a214838baf2ac4c" status: 200 len: 511 microversion: 2.10 time: 0.014612 Oct 08 20:52:02.552098 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 67/143] 10.222.0.26 () {60 vars in 1337 bytes} [Sat Oct 8 20:52:02 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-803442243?user_id=c9d2c3e8b57644d49a214838baf2ac4c => generated 511 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 08 20:52:02.566594 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c448b27c-80d8-469e-9831-d793f65df023 tempest-KeyPairsV210TestJSON-774692896 tempest-KeyPairsV210TestJSON-774692896-project-admin] Action: 'create', calling method: .version_select at 0x7f1a8d4b1af0>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-1178426283", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGxIAWh8FqwzfYtiEIDOA8OYkNKTvUPleR4CcoGdnKpMONQ+RSA6co4PN7mPN1nNrhZ6C/Uxipc1eDHPDnTAwH8HYKbAFanvrMz8D0NpkPj0dMD7yFgke+jFQNsX+e4hWw=="}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:52:02.581456 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-c448b27c-80d8-469e-9831-d793f65df023 tempest-KeyPairsV210TestJSON-774692896 tempest-KeyPairsV210TestJSON-774692896-project-admin] Getting quotas for project 494b1dc313b5471f9d074129b4657b5c. Resources: {'key_pairs'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 20:52:02.586516 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-c448b27c-80d8-469e-9831-d793f65df023 tempest-KeyPairsV210TestJSON-774692896 tempest-KeyPairsV210TestJSON-774692896-project-admin] Getting quotas for user c717a1aeb72f4a3d85ea82f849e9dfe4 and project 494b1dc313b5471f9d074129b4657b5c. Resources: {'key_pairs'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 20:52:02.602598 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=1,nova_api:INSERT=5 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:02.614506 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-c448b27c-80d8-469e-9831-d793f65df023 tempest-KeyPairsV210TestJSON-774692896 tempest-KeyPairsV210TestJSON-774692896-project-admin] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 422 microversion: 2.10 time: 0.052375 Oct 08 20:52:02.621311 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 68/144] 10.222.0.26 () {62 vars in 1200 bytes} [Sat Oct 8 20:52:02 2022] POST /compute/v2.1/os-keypairs => generated 422 bytes in 54 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Oct 08 20:52:02.621311 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-31adf98e-9fa3-4bfa-a1aa-a13ef823dec5 tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:02.621587 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-31adf98e-9fa3-4bfa-a1aa-a13ef823dec5 tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] [instance: bbff4ffb-395f-4eeb-a995-60c9c0f39f25] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:52:02.629053 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-31adf98e-9fa3-4bfa-a1aa-a13ef823dec5 tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:02.629641 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-31adf98e-9fa3-4bfa-a1aa-a13ef823dec5 tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:02.630156 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-31adf98e-9fa3-4bfa-a1aa-a13ef823dec5 tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:02.630875 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-31adf98e-9fa3-4bfa-a1aa-a13ef823dec5 tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:02.634942 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-31adf98e-9fa3-4bfa-a1aa-a13ef823dec5 tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:02.636072 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-31adf98e-9fa3-4bfa-a1aa-a13ef823dec5 tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:02.655119 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=100 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:02.704941 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-3169cc91-4388-4f5f-8f7c-4d6d552dc50f tempest-QuotasAdminNegativeTest-1295979369 tempest-QuotasAdminNegativeTest-1295979369-project-admin] 10.222.0.26 "GET /compute/v2.1/os-quota-sets/00d9071ba2e34475baf046a4c42f9889" status: 200 len: 371 microversion: 2.1 time: 0.272208 Oct 08 20:52:02.706017 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 77/145] 10.222.0.26 () {58 vars in 1242 bytes} [Sat Oct 8 20:52:02 2022] GET /compute/v2.1/os-quota-sets/00d9071ba2e34475baf046a4c42f9889 => generated 371 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:52:02.711924 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-4d661c1d-b548-4b65-ab76-3d00324f4ab3 tempest-KeyPairsV210TestJSON-774692896 tempest-KeyPairsV210TestJSON-774692896-project-admin] Calling method '.version_select at 0x7f1a8d32a280>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:02.718046 ncdv-master-1 devstack@n-api.service[140492]: WARNING oslo_db.sqlalchemy.utils [None req-4d661c1d-b548-4b65-ab76-3d00324f4ab3 tempest-KeyPairsV210TestJSON-774692896 tempest-KeyPairsV210TestJSON-774692896-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Oct 08 20:52:02.730270 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-4d661c1d-b548-4b65-ab76-3d00324f4ab3 tempest-KeyPairsV210TestJSON-774692896 tempest-KeyPairsV210TestJSON-774692896-project-admin] 10.222.0.26 "GET /compute/v2.1/os-keypairs?user_id=c9d2c3e8b57644d49a214838baf2ac4c" status: 200 len: 724 microversion: 2.10 time: 0.022416 Oct 08 20:52:02.731382 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 78/146] 10.222.0.26 () {60 vars in 1259 bytes} [Sat Oct 8 20:52:02 2022] GET /compute/v2.1/os-keypairs?user_id=c9d2c3e8b57644d49a214838baf2ac4c => generated 724 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 08 20:52:02.738237 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-c18ce948-4950-4283-b613-5b3236fbc367 tempest-QuotasAdminNegativeTest-1295979369 tempest-QuotasAdminNegativeTest-1295979369-project-admin] Action: 'update', calling method: .version_select at 0x7f1a8d515b80>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:52:02.846043 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-31adf98e-9fa3-4bfa-a1aa-a13ef823dec5 tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8da7d5210cf42bda150d342ff207bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd024396aef784f3291630c426a828cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:02.855746 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-31adf98e-9fa3-4bfa-a1aa-a13ef823dec5 tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] 10.222.0.26 "GET /compute/v2.1/servers/bbff4ffb-395f-4eeb-a995-60c9c0f39f25" status: 200 len: 1339 microversion: 2.1 time: 0.238760 Oct 08 20:52:02.856912 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 69/147] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:52:02 2022] GET /compute/v2.1/servers/bbff4ffb-395f-4eeb-a995-60c9c0f39f25 => generated 1339 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:52:02.863228 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-be757773-0874-48a0-a589-e3d87d891012 tempest-KeyPairsV210TestJSON-774692896 tempest-KeyPairsV210TestJSON-774692896-project-admin] Calling method '.version_select at 0x7f1a8d4a3040>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:02.887646 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-be757773-0874-48a0-a589-e3d87d891012 tempest-KeyPairsV210TestJSON-774692896 tempest-KeyPairsV210TestJSON-774692896-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1178426283" status: 204 len: 0 microversion: 2.10 time: 0.028709 Oct 08 20:52:02.893581 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 70/148] 10.222.0.26 () {60 vars in 1325 bytes} [Sat Oct 8 20:52:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1178426283 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 08 20:52:02.900635 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-eb1c6795-5f4f-4ba2-add8-a367b3868e80 tempest-KeyPairsV210TestJSON-774692896 tempest-KeyPairsV210TestJSON-774692896-project-admin] Calling method '.version_select at 0x7f1a8d51a790>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:02.927841 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-eb1c6795-5f4f-4ba2-add8-a367b3868e80 tempest-KeyPairsV210TestJSON-774692896 tempest-KeyPairsV210TestJSON-774692896-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-192874865?user_id=c9d2c3e8b57644d49a214838baf2ac4c" status: 204 len: 0 microversion: 2.10 time: 0.032286 Oct 08 20:52:02.932298 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 71/149] 10.222.0.26 () {60 vars in 1340 bytes} [Sat Oct 8 20:52:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-192874865?user_id=c9d2c3e8b57644d49a214838baf2ac4c => generated 0 bytes in 34 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 08 20:52:02.939944 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-7dbc05b0-0813-4e47-9877-f6abf1da6467 tempest-KeyPairsV210TestJSON-774692896 tempest-KeyPairsV210TestJSON-774692896-project-admin] Calling method '.version_select at 0x7f1a8d4be3a0>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:02.964349 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-7dbc05b0-0813-4e47-9877-f6abf1da6467 tempest-KeyPairsV210TestJSON-774692896 tempest-KeyPairsV210TestJSON-774692896-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-803442243?user_id=c9d2c3e8b57644d49a214838baf2ac4c" status: 204 len: 0 microversion: 2.10 time: 0.030361 Oct 08 20:52:02.970366 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 72/150] 10.222.0.26 () {60 vars in 1340 bytes} [Sat Oct 8 20:52:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-803442243?user_id=c9d2c3e8b57644d49a214838baf2ac4c => generated 0 bytes in 33 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 08 20:52:02.978150 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c18ce948-4950-4283-b613-5b3236fbc367 tempest-QuotasAdminNegativeTest-1295979369 tempest-QuotasAdminNegativeTest-1295979369-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:02.980283 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c18ce948-4950-4283-b613-5b3236fbc367 tempest-QuotasAdminNegativeTest-1295979369 tempest-QuotasAdminNegativeTest-1295979369-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:02.981303 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c18ce948-4950-4283-b613-5b3236fbc367 tempest-QuotasAdminNegativeTest-1295979369 tempest-QuotasAdminNegativeTest-1295979369-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:02.982036 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c18ce948-4950-4283-b613-5b3236fbc367 tempest-QuotasAdminNegativeTest-1295979369 tempest-QuotasAdminNegativeTest-1295979369-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:02.982494 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c18ce948-4950-4283-b613-5b3236fbc367 tempest-QuotasAdminNegativeTest-1295979369 tempest-QuotasAdminNegativeTest-1295979369-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:02.982932 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c18ce948-4950-4283-b613-5b3236fbc367 tempest-QuotasAdminNegativeTest-1295979369 tempest-QuotasAdminNegativeTest-1295979369-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:03.050814 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-c18ce948-4950-4283-b613-5b3236fbc367 tempest-QuotasAdminNegativeTest-1295979369 tempest-QuotasAdminNegativeTest-1295979369-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-quota-sets/00d9071ba2e34475baf046a4c42f9889" status: 200 len: 325 microversion: 2.1 time: 0.318151 Oct 08 20:52:03.051886 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 79/151] 10.222.0.26 () {60 vars in 1262 bytes} [Sat Oct 8 20:52:02 2022] PUT /compute/v2.1/os-quota-sets/00d9071ba2e34475baf046a4c42f9889 => generated 325 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:52:03.203316 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-83573da2-5cad-4b93-90b0-a2172a751174 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:03.203839 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-83573da2-5cad-4b93-90b0-a2172a751174 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] [instance: 6611e099-c1f0-4fed-ba7b-0b096800946d] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:52:03.209707 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-83573da2-5cad-4b93-90b0-a2172a751174 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:03.210199 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-83573da2-5cad-4b93-90b0-a2172a751174 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:03.210638 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-83573da2-5cad-4b93-90b0-a2172a751174 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:03.213225 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-83573da2-5cad-4b93-90b0-a2172a751174 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:03.213659 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-83573da2-5cad-4b93-90b0-a2172a751174 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:03.214097 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-83573da2-5cad-4b93-90b0-a2172a751174 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:03.238070 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-6a03c577-9ec0-455f-bbb3-04f14f979938 tempest-QuotasAdminNegativeTest-6339137 tempest-QuotasAdminNegativeTest-6339137-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1728770907", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:52:03.332187 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.network.neutron [None req-6a03c577-9ec0-455f-bbb3-04f14f979938 tempest-QuotasAdminNegativeTest-6339137 tempest-QuotasAdminNegativeTest-6339137-project] validate_networks() for None {{(pid=140492) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 20:52:03.455214 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-83573da2-5cad-4b93-90b0-a2172a751174 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0eb2feb062947e78357b70e832e3edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18029da9b9854f3caf3debd9556f1f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:03.465219 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-83573da2-5cad-4b93-90b0-a2172a751174 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] 10.222.0.26 "GET /compute/v2.1/servers/6611e099-c1f0-4fed-ba7b-0b096800946d" status: 200 len: 1320 microversion: 2.1 time: 0.266412 Oct 08 20:52:03.477551 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 73/152] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:52:03 2022] GET /compute/v2.1/servers/6611e099-c1f0-4fed-ba7b-0b096800946d => generated 1320 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:52:03.562893 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-6a03c577-9ec0-455f-bbb3-04f14f979938 tempest-QuotasAdminNegativeTest-6339137 tempest-QuotasAdminNegativeTest-6339137-project] Flavor limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 20:52:03.566575 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-6a03c577-9ec0-455f-bbb3-04f14f979938 tempest-QuotasAdminNegativeTest-6339137 tempest-QuotasAdminNegativeTest-6339137-project] Image limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 20:52:03.566575 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-6a03c577-9ec0-455f-bbb3-04f14f979938 tempest-QuotasAdminNegativeTest-6339137 tempest-QuotasAdminNegativeTest-6339137-project] Flavor pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 20:52:03.566575 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-6a03c577-9ec0-455f-bbb3-04f14f979938 tempest-QuotasAdminNegativeTest-6339137 tempest-QuotasAdminNegativeTest-6339137-project] Image pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 20:52:03.566575 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-6a03c577-9ec0-455f-bbb3-04f14f979938 tempest-QuotasAdminNegativeTest-6339137 tempest-QuotasAdminNegativeTest-6339137-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 20:52:03.577136 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6a03c577-9ec0-455f-bbb3-04f14f979938 tempest-QuotasAdminNegativeTest-6339137 tempest-QuotasAdminNegativeTest-6339137-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:03.577881 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6a03c577-9ec0-455f-bbb3-04f14f979938 tempest-QuotasAdminNegativeTest-6339137 tempest-QuotasAdminNegativeTest-6339137-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:03.578650 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6a03c577-9ec0-455f-bbb3-04f14f979938 tempest-QuotasAdminNegativeTest-6339137 tempest-QuotasAdminNegativeTest-6339137-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:03.579563 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6a03c577-9ec0-455f-bbb3-04f14f979938 tempest-QuotasAdminNegativeTest-6339137 tempest-QuotasAdminNegativeTest-6339137-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:03.580421 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6a03c577-9ec0-455f-bbb3-04f14f979938 tempest-QuotasAdminNegativeTest-6339137 tempest-QuotasAdminNegativeTest-6339137-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:03.581089 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6a03c577-9ec0-455f-bbb3-04f14f979938 tempest-QuotasAdminNegativeTest-6339137 tempest-QuotasAdminNegativeTest-6339137-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:03.607801 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-6a03c577-9ec0-455f-bbb3-04f14f979938 tempest-QuotasAdminNegativeTest-6339137 tempest-QuotasAdminNegativeTest-6339137-project] Getting quotas for project 00d9071ba2e34475baf046a4c42f9889. Resources: {'cores', 'instances', 'ram'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 20:52:03.619744 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-6a03c577-9ec0-455f-bbb3-04f14f979938 tempest-QuotasAdminNegativeTest-6339137 tempest-QuotasAdminNegativeTest-6339137-project] Getting quotas for user 572574747ca24cadb63e09288452bd25 and project 00d9071ba2e34475baf046a4c42f9889. Resources: {'cores', 'instances', 'ram'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 20:52:03.638806 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.utils [None req-6a03c577-9ec0-455f-bbb3-04f14f979938 tempest-QuotasAdminNegativeTest-6339137 tempest-QuotasAdminNegativeTest-6339137-project] ram quota exceeded for 00d9071ba2e34475baf046a4c42f9889, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=140492) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 08 20:52:03.639125 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-6a03c577-9ec0-455f-bbb3-04f14f979938 tempest-QuotasAdminNegativeTest-6339137 tempest-QuotasAdminNegativeTest-6339137-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 08 20:52:03.641156 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-6a03c577-9ec0-455f-bbb3-04f14f979938 tempest-QuotasAdminNegativeTest-6339137 tempest-QuotasAdminNegativeTest-6339137-project] Request method failure captured: Oct 08 20:52:03.641156 ncdv-master-1 devstack@n-api.service[140492]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 08 20:52:03.641156 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 20:52:03.641156 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 20:52:03.641156 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 20:52:03.641156 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 145 Oct 08 20:52:03.641156 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 20:52:03.641156 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 20:52:03.641156 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 20:52:03.641156 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 20:52:03.641156 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeLfV9Tk7aPmW9QeTiH2LxXAzyM8BCBMjnUlhbwl0rvpRDRBSOrkwoyXI_EIKpkZDUqXoZ7LVbfFySgAOZW2LTWH7bUDXwELaM0SNGQLDiLz78GDz4T6GWZfUflK9nIBHofFabEjI9ByIC0isVriImIgzllX1eFCns64S-AlHpg12KI Oct 08 20:52:03.641156 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 20:52:03.641156 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 20:52:03.641156 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 20:52:03.641156 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 20:52:03.641156 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 20:52:03.641156 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 20:52:03.641156 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 00d9071ba2e34475baf046a4c42f9889 Oct 08 20:52:03.641156 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-QuotasAdminNegativeTest-6339137 Oct 08 20:52:03.641156 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 20:52:03.641156 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 20:52:03.642368 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/00d9071ba2e34475baf046a4c42f9889"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/00d9071ba2e34475baf046a4c42f9889"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_00d9071ba2e34475baf046a4c42f9889"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/00d9071ba2e34475baf046a4c42f9889"}]}] Oct 08 20:52:03.642368 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-QuotasAdminNegativeTest-6339137 Oct 08 20:52:03.642368 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 00d9071ba2e34475baf046a4c42f9889 Oct 08 20:52:03.642368 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-6339137 Oct 08 20:52:03.642368 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-QuotasAdminNegativeTest-6339137-project Oct 08 20:52:03.642368 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 20:52:03.642368 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 20:52:03.642368 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 572574747ca24cadb63e09288452bd25 Oct 08 20:52:03.642368 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-QuotasAdminNegativeTest-6339137-project Oct 08 20:52:03.642368 ncdv-master-1 devstack@n-api.service[140492]: Oct 08 20:52:03.642368 ncdv-master-1 devstack@n-api.service[140492]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1728770907", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452"}} Oct 08 20:52:03.642368 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 20:52:03.643004 ncdv-master-1 devstack@n-api.service[140492]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 08 20:52:03.643004 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1728770907', 'imageRef': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'flavorRef': '452'}}} Oct 08 20:52:03.643004 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:52:03.643004 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:52:03.643004 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 08 20:52:03.643004 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 08 20:52:03.643004 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 08 20:52:03.643004 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 08 20:52:03.643004 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 08 20:52:03.643004 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc Oct 08 20:52:03.643004 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 08 20:52:03.643004 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 08 20:52:03.643004 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 08 20:52:03.643004 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 08 20:52:03.643004 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 08 20:52:03.643004 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 08 20:52:03.643004 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 08 20:52:03.643004 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 08 20:52:03.643924 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 08 20:52:03.643924 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 08 20:52:03.643924 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Oct 08 20:52:03.643924 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:52:03.643924 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:52:03.643924 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:52:03.643924 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:52:03.643924 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 08 20:52:03.643924 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 08 20:52:03.643924 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 08 20:52:03.643924 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 08 20:52:03.643924 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 08 20:52:03.643924 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 08 20:52:03.643924 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 08 20:52:03.643924 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 08 20:52:03.643924 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 08 20:52:03.643924 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 08 20:52:03.643924 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 08 20:52:03.643924 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:52:03.643924 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:52:03.643924 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:52:03.644995 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:52:03.644995 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:52:03.644995 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:52:03.644995 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:52:03.644995 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:52:03.644995 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:52:03.644995 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:52:03.644995 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 20:52:03.644995 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 20:52:03.644995 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 20:52:03.644995 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 20:52:03.644995 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 20:52:03.644995 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 20:52:03.644995 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 08 20:52:03.644995 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 08 20:52:03.644995 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 08 20:52:03.644995 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 08 20:52:03.644995 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:52:03.644995 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:52:03.644995 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:52:03.644995 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:52:03.647487 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:52:03.647487 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:52:03.647487 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 20:52:03.647487 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 20:52:03.647487 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 08 20:52:03.647487 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:52:03.647487 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-6a03c577-9ec0-455f-bbb3-04f14f979938 tempest-QuotasAdminNegativeTest-6339137 tempest-QuotasAdminNegativeTest-6339137-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:52:03.647487 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-6a03c577-9ec0-455f-bbb3-04f14f979938 tempest-QuotasAdminNegativeTest-6339137 tempest-QuotasAdminNegativeTest-6339137-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 0.408847 Oct 08 20:52:03.647487 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 80/153] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 20:52:03 2022] POST /compute/v2.1/servers => generated 110 bytes in 410 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 08 20:52:03.651696 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-f53b4cd0-9bdc-4de9-846d-a979ad3e2a62 tempest-QuotasAdminNegativeTest-1295979369 tempest-QuotasAdminNegativeTest-1295979369-project-admin] Action: 'update', calling method: .version_select at 0x7f1a8d4b1820>, body: {"quota_set": {"ram": 51200}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:52:04.021791 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f53b4cd0-9bdc-4de9-846d-a979ad3e2a62 tempest-QuotasAdminNegativeTest-1295979369 tempest-QuotasAdminNegativeTest-1295979369-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:04.022273 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f53b4cd0-9bdc-4de9-846d-a979ad3e2a62 tempest-QuotasAdminNegativeTest-1295979369 tempest-QuotasAdminNegativeTest-1295979369-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:04.022708 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f53b4cd0-9bdc-4de9-846d-a979ad3e2a62 tempest-QuotasAdminNegativeTest-1295979369 tempest-QuotasAdminNegativeTest-1295979369-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:04.023427 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f53b4cd0-9bdc-4de9-846d-a979ad3e2a62 tempest-QuotasAdminNegativeTest-1295979369 tempest-QuotasAdminNegativeTest-1295979369-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:04.023877 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f53b4cd0-9bdc-4de9-846d-a979ad3e2a62 tempest-QuotasAdminNegativeTest-1295979369 tempest-QuotasAdminNegativeTest-1295979369-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:04.024468 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f53b4cd0-9bdc-4de9-846d-a979ad3e2a62 tempest-QuotasAdminNegativeTest-1295979369 tempest-QuotasAdminNegativeTest-1295979369-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:04.052445 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-3fe1737b-dad1-4ee4-9824-66a7116b57f6 tempest-HypervisorAdminTestJSON-2091672454 tempest-HypervisorAdminTestJSON-2091672454-project-admin] Calling method '.version_select at 0x7f1a8d32a8b0>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:04.055523 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3fe1737b-dad1-4ee4-9824-66a7116b57f6 tempest-HypervisorAdminTestJSON-2091672454 tempest-HypervisorAdminTestJSON-2091672454-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:04.057341 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3fe1737b-dad1-4ee4-9824-66a7116b57f6 tempest-HypervisorAdminTestJSON-2091672454 tempest-HypervisorAdminTestJSON-2091672454-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:04.057459 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3fe1737b-dad1-4ee4-9824-66a7116b57f6 tempest-HypervisorAdminTestJSON-2091672454 tempest-HypervisorAdminTestJSON-2091672454-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:04.077044 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3fe1737b-dad1-4ee4-9824-66a7116b57f6 tempest-HypervisorAdminTestJSON-2091672454 tempest-HypervisorAdminTestJSON-2091672454-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:04.078237 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3fe1737b-dad1-4ee4-9824-66a7116b57f6 tempest-HypervisorAdminTestJSON-2091672454 tempest-HypervisorAdminTestJSON-2091672454-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:04.078762 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3fe1737b-dad1-4ee4-9824-66a7116b57f6 tempest-HypervisorAdminTestJSON-2091672454 tempest-HypervisorAdminTestJSON-2091672454-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:04.092273 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3fe1737b-dad1-4ee4-9824-66a7116b57f6 tempest-HypervisorAdminTestJSON-2091672454 tempest-HypervisorAdminTestJSON-2091672454-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:04.092844 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3fe1737b-dad1-4ee4-9824-66a7116b57f6 tempest-HypervisorAdminTestJSON-2091672454 tempest-HypervisorAdminTestJSON-2091672454-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:04.094245 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3fe1737b-dad1-4ee4-9824-66a7116b57f6 tempest-HypervisorAdminTestJSON-2091672454 tempest-HypervisorAdminTestJSON-2091672454-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:04.100827 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-3fe1737b-dad1-4ee4-9824-66a7116b57f6 tempest-HypervisorAdminTestJSON-2091672454 tempest-HypervisorAdminTestJSON-2091672454-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.327813 Oct 08 20:52:04.102422 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 81/154] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Oct 8 20:52:03 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:52:04.106683 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-4a470296-529d-44ae-8be0-733b275b348e tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:04.107735 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-4a470296-529d-44ae-8be0-733b275b348e tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] [instance: bbff4ffb-395f-4eeb-a995-60c9c0f39f25] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:52:04.109587 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=88,nova_api:UPDATE=8 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:04.109829 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-f53b4cd0-9bdc-4de9-846d-a979ad3e2a62 tempest-QuotasAdminNegativeTest-1295979369 tempest-QuotasAdminNegativeTest-1295979369-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-quota-sets/00d9071ba2e34475baf046a4c42f9889" status: 200 len: 329 microversion: 2.1 time: 0.461111 Oct 08 20:52:04.111328 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 74/155] 10.222.0.26 () {60 vars in 1262 bytes} [Sat Oct 8 20:52:03 2022] PUT /compute/v2.1/os-quota-sets/00d9071ba2e34475baf046a4c42f9889 => generated 329 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:52:04.117276 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4a470296-529d-44ae-8be0-733b275b348e tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:04.117443 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-839c5e36-97ae-4c98-b4a5-9c7194b1afa0 tempest-HypervisorAdminTestJSON-2091672454 tempest-HypervisorAdminTestJSON-2091672454-project-admin] Calling method '.version_select at 0x7f1a8d4b1940>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:04.118118 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4a470296-529d-44ae-8be0-733b275b348e tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:04.118740 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4a470296-529d-44ae-8be0-733b275b348e tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:04.119700 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4a470296-529d-44ae-8be0-733b275b348e tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:04.120252 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-839c5e36-97ae-4c98-b4a5-9c7194b1afa0 tempest-HypervisorAdminTestJSON-2091672454 tempest-HypervisorAdminTestJSON-2091672454-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:04.120627 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4a470296-529d-44ae-8be0-733b275b348e tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:04.121233 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-839c5e36-97ae-4c98-b4a5-9c7194b1afa0 tempest-HypervisorAdminTestJSON-2091672454 tempest-HypervisorAdminTestJSON-2091672454-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:04.121626 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-839c5e36-97ae-4c98-b4a5-9c7194b1afa0 tempest-HypervisorAdminTestJSON-2091672454 tempest-HypervisorAdminTestJSON-2091672454-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:04.121911 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4a470296-529d-44ae-8be0-733b275b348e tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:04.137055 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-839c5e36-97ae-4c98-b4a5-9c7194b1afa0 tempest-HypervisorAdminTestJSON-2091672454 tempest-HypervisorAdminTestJSON-2091672454-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:04.137618 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-839c5e36-97ae-4c98-b4a5-9c7194b1afa0 tempest-HypervisorAdminTestJSON-2091672454 tempest-HypervisorAdminTestJSON-2091672454-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:04.138029 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-839c5e36-97ae-4c98-b4a5-9c7194b1afa0 tempest-HypervisorAdminTestJSON-2091672454 tempest-HypervisorAdminTestJSON-2091672454-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:04.150335 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-839c5e36-97ae-4c98-b4a5-9c7194b1afa0 tempest-HypervisorAdminTestJSON-2091672454 tempest-HypervisorAdminTestJSON-2091672454-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:04.151796 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-839c5e36-97ae-4c98-b4a5-9c7194b1afa0 tempest-HypervisorAdminTestJSON-2091672454 tempest-HypervisorAdminTestJSON-2091672454-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:04.152321 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-839c5e36-97ae-4c98-b4a5-9c7194b1afa0 tempest-HypervisorAdminTestJSON-2091672454 tempest-HypervisorAdminTestJSON-2091672454-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:04.159501 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-839c5e36-97ae-4c98-b4a5-9c7194b1afa0 tempest-HypervisorAdminTestJSON-2091672454 tempest-HypervisorAdminTestJSON-2091672454-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1505 microversion: 2.1 time: 0.046250 Oct 08 20:52:04.171826 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 75/156] 10.222.0.26 () {58 vars in 1167 bytes} [Sat Oct 8 20:52:04 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1505 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:52:04.176762 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-247a0639-e39f-408d-86e1-59137be3e9d0 tempest-QuotasAdminNegativeTest-6339137 tempest-QuotasAdminNegativeTest-6339137-project] Action: 'update', calling method: .version_select at 0x7f1a8d4b1c10>, body: {"quota_set": {"ram": 0}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:52:04.181944 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-247a0639-e39f-408d-86e1-59137be3e9d0 tempest-QuotasAdminNegativeTest-6339137 tempest-QuotasAdminNegativeTest-6339137-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': '572574747ca24cadb63e09288452bd25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d9071ba2e34475baf046a4c42f9889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:04.183865 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-247a0639-e39f-408d-86e1-59137be3e9d0 tempest-QuotasAdminNegativeTest-6339137 tempest-QuotasAdminNegativeTest-6339137-project] Request method failure captured: Oct 08 20:52:04.183865 ncdv-master-1 devstack@n-api.service[140491]: request: PUT /compute/v2.1/os-quota-sets/00d9071ba2e34475baf046a4c42f9889 HTTP/1.1 Oct 08 20:52:04.183865 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 20:52:04.183865 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 20:52:04.183865 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 20:52:04.183865 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 25 Oct 08 20:52:04.183865 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 20:52:04.183865 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 20:52:04.183865 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 20:52:04.183865 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 20:52:04.183865 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeLfV9Tk7aPmW9QeTiH2LxXAzyM8BCBMjnUlhbwl0rvpRDRBSOrkwoyXI_EIKpkZDUqXoZ7LVbfFySgAOZW2LTWH7bUDXwELaM0SNGQLDiLz78GDz4T6GWZfUflK9nIBHofFabEjI9ByIC0isVriImIgzllX1eFCns64S-AlHpg12KI Oct 08 20:52:04.183865 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 20:52:04.183865 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 20:52:04.183865 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 20:52:04.183865 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 20:52:04.183865 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 20:52:04.183865 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 20:52:04.183865 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 00d9071ba2e34475baf046a4c42f9889 Oct 08 20:52:04.183865 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-QuotasAdminNegativeTest-6339137 Oct 08 20:52:04.183865 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 20:52:04.183865 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 20:52:04.185294 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/00d9071ba2e34475baf046a4c42f9889"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/00d9071ba2e34475baf046a4c42f9889"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_00d9071ba2e34475baf046a4c42f9889"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/00d9071ba2e34475baf046a4c42f9889"}]}] Oct 08 20:52:04.185294 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-QuotasAdminNegativeTest-6339137 Oct 08 20:52:04.185294 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 00d9071ba2e34475baf046a4c42f9889 Oct 08 20:52:04.185294 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-6339137 Oct 08 20:52:04.185294 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-QuotasAdminNegativeTest-6339137-project Oct 08 20:52:04.185294 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 20:52:04.185294 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 20:52:04.185294 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 572574747ca24cadb63e09288452bd25 Oct 08 20:52:04.185294 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-QuotasAdminNegativeTest-6339137-project Oct 08 20:52:04.185294 ncdv-master-1 devstack@n-api.service[140491]: Oct 08 20:52:04.185294 ncdv-master-1 devstack@n-api.service[140491]: {"quota_set": {"ram": 0}} Oct 08 20:52:04.185294 ncdv-master-1 devstack@n-api.service[140491]: method: Oct 08 20:52:04.185294 ncdv-master-1 devstack@n-api.service[140491]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 08 20:52:04.185294 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': '00d9071ba2e34475baf046a4c42f9889', 'body': {'quota_set': {'ram': 0}}} Oct 08 20:52:04.186116 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:52:04.186116 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:52:04.186116 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:52:04.186116 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:52:04.186116 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:52:04.186116 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:52:04.186116 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 08 20:52:04.186116 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 08 20:52:04.186116 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:52:04.186116 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:52:04.186116 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 20:52:04.186116 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 20:52:04.186116 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Oct 08 20:52:04.186116 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Oct 08 20:52:04.186116 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 08 20:52:04.186116 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 20:52:04.186116 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 08 20:52:04.186116 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 20:52:04.186116 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Oct 08 20:52:04.187187 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Oct 08 20:52:04.187187 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 08 20:52:04.187187 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 08 20:52:04.187187 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 08 20:52:04.187187 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 08 20:52:04.187187 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 08 20:52:04.187187 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 08 20:52:04.187187 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 08 20:52:04.187187 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise self.value Oct 08 20:52:04.187187 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 08 20:52:04.187187 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 08 20:52:04.187187 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 08 20:52:04.187187 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 08 20:52:04.187187 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 08 20:52:04.187187 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 08 20:52:04.187187 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 08 20:52:04.187187 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:52:04.187187 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:52:04.187187 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:52:04.187187 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:52:04.188558 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:52:04.188558 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:52:04.188558 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 08 20:52:04.188558 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 08 20:52:04.188558 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 08 20:52:04.188558 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:52:04.188558 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-247a0639-e39f-408d-86e1-59137be3e9d0 tempest-QuotasAdminNegativeTest-6339137 tempest-QuotasAdminNegativeTest-6339137-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:52:04.188558 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-247a0639-e39f-408d-86e1-59137be3e9d0 tempest-QuotasAdminNegativeTest-6339137 tempest-QuotasAdminNegativeTest-6339137-project] 10.222.0.26 "PUT /compute/v2.1/os-quota-sets/00d9071ba2e34475baf046a4c42f9889" status: 403 len: 116 microversion: 2.1 time: 0.012384 Oct 08 20:52:04.188558 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 76/157] 10.222.0.26 () {60 vars in 1262 bytes} [Sat Oct 8 20:52:04 2022] PUT /compute/v2.1/os-quota-sets/00d9071ba2e34475baf046a4c42f9889 => generated 116 bytes in 14 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 08 20:52:04.191181 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-b9b27ef7-31dd-4939-a1e9-82cbcda6cfc9 tempest-HypervisorAdminTestJSON-2091672454 tempest-HypervisorAdminTestJSON-2091672454-project-admin] Calling method '.version_select at 0x7f1a8d6b6f70>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:04.193447 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b9b27ef7-31dd-4939-a1e9-82cbcda6cfc9 tempest-HypervisorAdminTestJSON-2091672454 tempest-HypervisorAdminTestJSON-2091672454-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:04.196451 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b9b27ef7-31dd-4939-a1e9-82cbcda6cfc9 tempest-HypervisorAdminTestJSON-2091672454 tempest-HypervisorAdminTestJSON-2091672454-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:04.196451 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b9b27ef7-31dd-4939-a1e9-82cbcda6cfc9 tempest-HypervisorAdminTestJSON-2091672454 tempest-HypervisorAdminTestJSON-2091672454-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:04.208625 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b9b27ef7-31dd-4939-a1e9-82cbcda6cfc9 tempest-HypervisorAdminTestJSON-2091672454 tempest-HypervisorAdminTestJSON-2091672454-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:04.209109 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b9b27ef7-31dd-4939-a1e9-82cbcda6cfc9 tempest-HypervisorAdminTestJSON-2091672454 tempest-HypervisorAdminTestJSON-2091672454-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:04.209589 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b9b27ef7-31dd-4939-a1e9-82cbcda6cfc9 tempest-HypervisorAdminTestJSON-2091672454 tempest-HypervisorAdminTestJSON-2091672454-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:04.222314 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b9b27ef7-31dd-4939-a1e9-82cbcda6cfc9 tempest-HypervisorAdminTestJSON-2091672454 tempest-HypervisorAdminTestJSON-2091672454-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:04.222681 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b9b27ef7-31dd-4939-a1e9-82cbcda6cfc9 tempest-HypervisorAdminTestJSON-2091672454 tempest-HypervisorAdminTestJSON-2091672454-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:04.223122 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b9b27ef7-31dd-4939-a1e9-82cbcda6cfc9 tempest-HypervisorAdminTestJSON-2091672454 tempest-HypervisorAdminTestJSON-2091672454-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:04.229975 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-b9b27ef7-31dd-4939-a1e9-82cbcda6cfc9 tempest-HypervisorAdminTestJSON-2091672454 tempest-HypervisorAdminTestJSON-2091672454-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.042843 Oct 08 20:52:04.230561 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 77/158] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Oct 8 20:52:04 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:52:04.241118 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-6de3031d-0a02-48f4-982b-d265f5ff733e tempest-HypervisorAdminTestJSON-2091672454 tempest-HypervisorAdminTestJSON-2091672454-project-admin] Calling method '.version_select at 0x7f1a8d59aca0>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:04.242896 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6de3031d-0a02-48f4-982b-d265f5ff733e tempest-HypervisorAdminTestJSON-2091672454 tempest-HypervisorAdminTestJSON-2091672454-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:04.243379 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6de3031d-0a02-48f4-982b-d265f5ff733e tempest-HypervisorAdminTestJSON-2091672454 tempest-HypervisorAdminTestJSON-2091672454-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:04.243825 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6de3031d-0a02-48f4-982b-d265f5ff733e tempest-HypervisorAdminTestJSON-2091672454 tempest-HypervisorAdminTestJSON-2091672454-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:04.260642 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6de3031d-0a02-48f4-982b-d265f5ff733e tempest-HypervisorAdminTestJSON-2091672454 tempest-HypervisorAdminTestJSON-2091672454-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:04.261132 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6de3031d-0a02-48f4-982b-d265f5ff733e tempest-HypervisorAdminTestJSON-2091672454 tempest-HypervisorAdminTestJSON-2091672454-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:04.261614 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6de3031d-0a02-48f4-982b-d265f5ff733e tempest-HypervisorAdminTestJSON-2091672454 tempest-HypervisorAdminTestJSON-2091672454-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:04.268503 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-6de3031d-0a02-48f4-982b-d265f5ff733e tempest-HypervisorAdminTestJSON-2091672454 tempest-HypervisorAdminTestJSON-2091672454-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.030982 Oct 08 20:52:04.279852 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 78/159] 10.222.0.26 () {58 vars in 1152 bytes} [Sat Oct 8 20:52:04 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 08 20:52:04.286036 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-652e03e0-c4ab-434a-87f0-c268a465a073 tempest-HypervisorAdminTestJSON-2091672454 tempest-HypervisorAdminTestJSON-2091672454-project-admin] Calling method '.version_select at 0x7f1a8d51a430>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:04.288036 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-652e03e0-c4ab-434a-87f0-c268a465a073 tempest-HypervisorAdminTestJSON-2091672454 tempest-HypervisorAdminTestJSON-2091672454-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:04.288543 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-652e03e0-c4ab-434a-87f0-c268a465a073 tempest-HypervisorAdminTestJSON-2091672454 tempest-HypervisorAdminTestJSON-2091672454-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:04.289528 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-652e03e0-c4ab-434a-87f0-c268a465a073 tempest-HypervisorAdminTestJSON-2091672454 tempest-HypervisorAdminTestJSON-2091672454-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:04.314595 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-4a470296-529d-44ae-8be0-733b275b348e tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8da7d5210cf42bda150d342ff207bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd024396aef784f3291630c426a828cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:04.319851 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-652e03e0-c4ab-434a-87f0-c268a465a073 tempest-HypervisorAdminTestJSON-2091672454 tempest-HypervisorAdminTestJSON-2091672454-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.038442 Oct 08 20:52:04.321441 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 79/160] 10.222.0.26 () {58 vars in 1179 bytes} [Sat Oct 8 20:52:04 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 08 20:52:04.322541 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-4a470296-529d-44ae-8be0-733b275b348e tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] 10.222.0.26 "GET /compute/v2.1/servers/bbff4ffb-395f-4eeb-a995-60c9c0f39f25" status: 200 len: 1339 microversion: 2.1 time: 0.219325 Oct 08 20:52:04.323099 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 82/161] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:52:04 2022] GET /compute/v2.1/servers/bbff4ffb-395f-4eeb-a995-60c9c0f39f25 => generated 1339 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:52:04.345777 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-033d00e2-7d25-4be8-978c-0f8d6de7c76d tempest-HypervisorAdminTestJSON-2091672454 tempest-HypervisorAdminTestJSON-2091672454-project-admin] Calling method '.version_select at 0x7f1a8d51a700>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:04.347826 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-033d00e2-7d25-4be8-978c-0f8d6de7c76d tempest-HypervisorAdminTestJSON-2091672454 tempest-HypervisorAdminTestJSON-2091672454-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:04.348185 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-033d00e2-7d25-4be8-978c-0f8d6de7c76d tempest-HypervisorAdminTestJSON-2091672454 tempest-HypervisorAdminTestJSON-2091672454-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:04.348634 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-033d00e2-7d25-4be8-978c-0f8d6de7c76d tempest-HypervisorAdminTestJSON-2091672454 tempest-HypervisorAdminTestJSON-2091672454-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:04.363274 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-033d00e2-7d25-4be8-978c-0f8d6de7c76d tempest-HypervisorAdminTestJSON-2091672454 tempest-HypervisorAdminTestJSON-2091672454-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:04.363864 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-033d00e2-7d25-4be8-978c-0f8d6de7c76d tempest-HypervisorAdminTestJSON-2091672454 tempest-HypervisorAdminTestJSON-2091672454-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:04.364374 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-033d00e2-7d25-4be8-978c-0f8d6de7c76d tempest-HypervisorAdminTestJSON-2091672454 tempest-HypervisorAdminTestJSON-2091672454-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:04.377364 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-033d00e2-7d25-4be8-978c-0f8d6de7c76d tempest-HypervisorAdminTestJSON-2091672454 tempest-HypervisorAdminTestJSON-2091672454-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:04.377995 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-033d00e2-7d25-4be8-978c-0f8d6de7c76d tempest-HypervisorAdminTestJSON-2091672454 tempest-HypervisorAdminTestJSON-2091672454-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:04.378856 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-033d00e2-7d25-4be8-978c-0f8d6de7c76d tempest-HypervisorAdminTestJSON-2091672454 tempest-HypervisorAdminTestJSON-2091672454-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:04.385509 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-033d00e2-7d25-4be8-978c-0f8d6de7c76d tempest-HypervisorAdminTestJSON-2091672454 tempest-HypervisorAdminTestJSON-2091672454-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.047149 Oct 08 20:52:04.389534 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 80/162] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Oct 8 20:52:04 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:52:04.397943 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-fe4b8f45-a1c6-4d44-90d2-0e2a1f2aa869 tempest-HypervisorAdminTestJSON-2091672454 tempest-HypervisorAdminTestJSON-2091672454-project-admin] Calling method '.version_select at 0x7f1a8d337b80>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:04.400933 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fe4b8f45-a1c6-4d44-90d2-0e2a1f2aa869 tempest-HypervisorAdminTestJSON-2091672454 tempest-HypervisorAdminTestJSON-2091672454-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:04.401627 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fe4b8f45-a1c6-4d44-90d2-0e2a1f2aa869 tempest-HypervisorAdminTestJSON-2091672454 tempest-HypervisorAdminTestJSON-2091672454-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:04.402072 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fe4b8f45-a1c6-4d44-90d2-0e2a1f2aa869 tempest-HypervisorAdminTestJSON-2091672454 tempest-HypervisorAdminTestJSON-2091672454-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:04.422738 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fe4b8f45-a1c6-4d44-90d2-0e2a1f2aa869 tempest-HypervisorAdminTestJSON-2091672454 tempest-HypervisorAdminTestJSON-2091672454-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:04.423388 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fe4b8f45-a1c6-4d44-90d2-0e2a1f2aa869 tempest-HypervisorAdminTestJSON-2091672454 tempest-HypervisorAdminTestJSON-2091672454-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:04.423830 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fe4b8f45-a1c6-4d44-90d2-0e2a1f2aa869 tempest-HypervisorAdminTestJSON-2091672454 tempest-HypervisorAdminTestJSON-2091672454-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:04.430452 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-fe4b8f45-a1c6-4d44-90d2-0e2a1f2aa869 tempest-HypervisorAdminTestJSON-2091672454 tempest-HypervisorAdminTestJSON-2091672454-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.036614 Oct 08 20:52:04.431050 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 83/163] 10.222.0.26 () {58 vars in 1152 bytes} [Sat Oct 8 20:52:04 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:52:04.445698 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-5e92728c-dd9e-4b5d-8d8c-5e67e2eb80ee tempest-HypervisorAdminTestJSON-2091672454 tempest-HypervisorAdminTestJSON-2091672454-project-admin] Calling method '.version_select at 0x7f1a8d59ac10>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:04.447843 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5e92728c-dd9e-4b5d-8d8c-5e67e2eb80ee tempest-HypervisorAdminTestJSON-2091672454 tempest-HypervisorAdminTestJSON-2091672454-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:04.448439 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5e92728c-dd9e-4b5d-8d8c-5e67e2eb80ee tempest-HypervisorAdminTestJSON-2091672454 tempest-HypervisorAdminTestJSON-2091672454-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:04.449087 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5e92728c-dd9e-4b5d-8d8c-5e67e2eb80ee tempest-HypervisorAdminTestJSON-2091672454 tempest-HypervisorAdminTestJSON-2091672454-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:04.464205 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5e92728c-dd9e-4b5d-8d8c-5e67e2eb80ee tempest-HypervisorAdminTestJSON-2091672454 tempest-HypervisorAdminTestJSON-2091672454-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:04.465154 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5e92728c-dd9e-4b5d-8d8c-5e67e2eb80ee tempest-HypervisorAdminTestJSON-2091672454 tempest-HypervisorAdminTestJSON-2091672454-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:04.466179 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5e92728c-dd9e-4b5d-8d8c-5e67e2eb80ee tempest-HypervisorAdminTestJSON-2091672454 tempest-HypervisorAdminTestJSON-2091672454-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:04.474719 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-5e92728c-dd9e-4b5d-8d8c-5e67e2eb80ee tempest-HypervisorAdminTestJSON-2091672454 tempest-HypervisorAdminTestJSON-2091672454-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 758 microversion: 2.1 time: 0.033062 Oct 08 20:52:04.475514 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 81/164] 10.222.0.26 () {58 vars in 1152 bytes} [Sat Oct 8 20:52:04 2022] GET /compute/v2.1/os-hypervisors/2 => generated 758 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:52:04.495859 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-2895496f-c091-4056-8505-de00a173b19b tempest-HypervisorAdminTestJSON-2091672454 tempest-HypervisorAdminTestJSON-2091672454-project-admin] Calling method '.version_select at 0x7f1a8d5151f0>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:04.497737 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2895496f-c091-4056-8505-de00a173b19b tempest-HypervisorAdminTestJSON-2091672454 tempest-HypervisorAdminTestJSON-2091672454-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:04.498250 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2895496f-c091-4056-8505-de00a173b19b tempest-HypervisorAdminTestJSON-2091672454 tempest-HypervisorAdminTestJSON-2091672454-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:04.498691 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2895496f-c091-4056-8505-de00a173b19b tempest-HypervisorAdminTestJSON-2091672454 tempest-HypervisorAdminTestJSON-2091672454-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:04.502155 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-b8a9d73c-40e8-468f-ab7f-585239d69f90 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:04.502773 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-b8a9d73c-40e8-468f-ab7f-585239d69f90 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] [instance: 6611e099-c1f0-4fed-ba7b-0b096800946d] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:52:04.510154 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b8a9d73c-40e8-468f-ab7f-585239d69f90 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:04.510974 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b8a9d73c-40e8-468f-ab7f-585239d69f90 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:04.511757 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b8a9d73c-40e8-468f-ab7f-585239d69f90 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:04.512985 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b8a9d73c-40e8-468f-ab7f-585239d69f90 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:04.514234 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b8a9d73c-40e8-468f-ab7f-585239d69f90 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:04.515771 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b8a9d73c-40e8-468f-ab7f-585239d69f90 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:04.519650 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2895496f-c091-4056-8505-de00a173b19b tempest-HypervisorAdminTestJSON-2091672454 tempest-HypervisorAdminTestJSON-2091672454-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:04.520157 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2895496f-c091-4056-8505-de00a173b19b tempest-HypervisorAdminTestJSON-2091672454 tempest-HypervisorAdminTestJSON-2091672454-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:04.520599 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2895496f-c091-4056-8505-de00a173b19b tempest-HypervisorAdminTestJSON-2091672454 tempest-HypervisorAdminTestJSON-2091672454-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:04.537761 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2895496f-c091-4056-8505-de00a173b19b tempest-HypervisorAdminTestJSON-2091672454 tempest-HypervisorAdminTestJSON-2091672454-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:04.538253 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2895496f-c091-4056-8505-de00a173b19b tempest-HypervisorAdminTestJSON-2091672454 tempest-HypervisorAdminTestJSON-2091672454-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:04.538853 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2895496f-c091-4056-8505-de00a173b19b tempest-HypervisorAdminTestJSON-2091672454 tempest-HypervisorAdminTestJSON-2091672454-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:04.578107 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-2895496f-c091-4056-8505-de00a173b19b tempest-HypervisorAdminTestJSON-2091672454 tempest-HypervisorAdminTestJSON-2091672454-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 175 microversion: 2.1 time: 0.085897 Oct 08 20:52:04.578891 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 84/165] 10.222.0.26 () {58 vars in 1173 bytes} [Sat Oct 8 20:52:04 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 175 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:52:04.684284 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-b8a9d73c-40e8-468f-ab7f-585239d69f90 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0eb2feb062947e78357b70e832e3edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18029da9b9854f3caf3debd9556f1f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:04.692828 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-b8a9d73c-40e8-468f-ab7f-585239d69f90 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] 10.222.0.26 "GET /compute/v2.1/servers/6611e099-c1f0-4fed-ba7b-0b096800946d" status: 200 len: 1320 microversion: 2.1 time: 0.195855 Oct 08 20:52:04.709065 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 82/166] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:52:04 2022] GET /compute/v2.1/servers/6611e099-c1f0-4fed-ba7b-0b096800946d => generated 1320 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 20:52:05.349926 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-80e2a0cd-a184-4220-96ca-a2d124d5604e tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:05.350982 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-80e2a0cd-a184-4220-96ca-a2d124d5604e tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] [instance: bbff4ffb-395f-4eeb-a995-60c9c0f39f25] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:52:05.365969 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-80e2a0cd-a184-4220-96ca-a2d124d5604e tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:05.366448 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-80e2a0cd-a184-4220-96ca-a2d124d5604e tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:05.374308 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-80e2a0cd-a184-4220-96ca-a2d124d5604e tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:05.376751 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-80e2a0cd-a184-4220-96ca-a2d124d5604e tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:05.378970 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-80e2a0cd-a184-4220-96ca-a2d124d5604e tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:05.379660 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-80e2a0cd-a184-4220-96ca-a2d124d5604e tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:05.571542 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-80e2a0cd-a184-4220-96ca-a2d124d5604e tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8da7d5210cf42bda150d342ff207bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd024396aef784f3291630c426a828cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:05.579379 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-80e2a0cd-a184-4220-96ca-a2d124d5604e tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] 10.222.0.26 "GET /compute/v2.1/servers/bbff4ffb-395f-4eeb-a995-60c9c0f39f25" status: 200 len: 1339 microversion: 2.1 time: 0.233577 Oct 08 20:52:05.579954 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 85/167] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:52:05 2022] GET /compute/v2.1/servers/bbff4ffb-395f-4eeb-a995-60c9c0f39f25 => generated 1339 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 20:52:05.717879 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-71cc4036-882e-4ba6-b737-2e377283f8c2 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:05.718576 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-71cc4036-882e-4ba6-b737-2e377283f8c2 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] [instance: 6611e099-c1f0-4fed-ba7b-0b096800946d] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:52:05.726106 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-71cc4036-882e-4ba6-b737-2e377283f8c2 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:05.726605 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-71cc4036-882e-4ba6-b737-2e377283f8c2 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:05.727044 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-71cc4036-882e-4ba6-b737-2e377283f8c2 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:05.727756 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-71cc4036-882e-4ba6-b737-2e377283f8c2 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:05.728210 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-71cc4036-882e-4ba6-b737-2e377283f8c2 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:05.728642 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-71cc4036-882e-4ba6-b737-2e377283f8c2 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:05.898660 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-71cc4036-882e-4ba6-b737-2e377283f8c2 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0eb2feb062947e78357b70e832e3edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18029da9b9854f3caf3debd9556f1f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:05.914173 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-71cc4036-882e-4ba6-b737-2e377283f8c2 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] 10.222.0.26 "GET /compute/v2.1/servers/6611e099-c1f0-4fed-ba7b-0b096800946d" status: 200 len: 1320 microversion: 2.1 time: 0.199450 Oct 08 20:52:05.931933 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 83/168] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:52:05 2022] GET /compute/v2.1/servers/6611e099-c1f0-4fed-ba7b-0b096800946d => generated 1320 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:52:06.130065 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-57d727a0-20a7-4c83-bb63-f0279b3b23b7 req-63ab1aea-5b48-4a06-963e-6bb6535c2e80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbff4ffb-395f-4eeb-a995-60c9c0f39f25", "name": "network-vif-plugged", "status": "completed", "tag": "db211159-4f8e-47dc-b398-227f96a1444c"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:52:06.143488 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-57d727a0-20a7-4c83-bb63-f0279b3b23b7 req-63ab1aea-5b48-4a06-963e-6bb6535c2e80 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:06.144430 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-57d727a0-20a7-4c83-bb63-f0279b3b23b7 req-63ab1aea-5b48-4a06-963e-6bb6535c2e80 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:06.145060 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-57d727a0-20a7-4c83-bb63-f0279b3b23b7 req-63ab1aea-5b48-4a06-963e-6bb6535c2e80 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:06.158646 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-57d727a0-20a7-4c83-bb63-f0279b3b23b7 req-63ab1aea-5b48-4a06-963e-6bb6535c2e80 service nova] Creating event network-vif-plugged:db211159-4f8e-47dc-b398-227f96a1444c for instance bbff4ffb-395f-4eeb-a995-60c9c0f39f25 on nch2-master-1 Oct 08 20:52:06.164334 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-57d727a0-20a7-4c83-bb63-f0279b3b23b7 req-63ab1aea-5b48-4a06-963e-6bb6535c2e80 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.439153 Oct 08 20:52:06.165963 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 86/169] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:52:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 08 20:52:06.605728 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-03f035a6-9d4d-41f9-9161-73610b613306 tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:06.606574 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-03f035a6-9d4d-41f9-9161-73610b613306 tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] [instance: bbff4ffb-395f-4eeb-a995-60c9c0f39f25] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:52:06.621089 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-03f035a6-9d4d-41f9-9161-73610b613306 tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:06.622720 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-03f035a6-9d4d-41f9-9161-73610b613306 tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:06.623325 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-03f035a6-9d4d-41f9-9161-73610b613306 tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:06.624217 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-03f035a6-9d4d-41f9-9161-73610b613306 tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:06.625880 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-03f035a6-9d4d-41f9-9161-73610b613306 tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:06.628044 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-03f035a6-9d4d-41f9-9161-73610b613306 tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:06.819218 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-03f035a6-9d4d-41f9-9161-73610b613306 tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8da7d5210cf42bda150d342ff207bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd024396aef784f3291630c426a828cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:06.829320 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-03f035a6-9d4d-41f9-9161-73610b613306 tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] 10.222.0.26 "GET /compute/v2.1/servers/bbff4ffb-395f-4eeb-a995-60c9c0f39f25" status: 200 len: 1339 microversion: 2.1 time: 0.230325 Oct 08 20:52:06.830514 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 87/170] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:52:06 2022] GET /compute/v2.1/servers/bbff4ffb-395f-4eeb-a995-60c9c0f39f25 => generated 1339 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:52:06.895942 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-b068aab0-b869-40db-b9f9-bec3eea438eb tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] Calling method '.version_select at 0x7f1a8d4cd820>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:06.940373 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-47ec5e88-9ea0-4843-a7b3-341227cf8523 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:06.941072 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-47ec5e88-9ea0-4843-a7b3-341227cf8523 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] [instance: 6611e099-c1f0-4fed-ba7b-0b096800946d] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:52:06.948075 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-47ec5e88-9ea0-4843-a7b3-341227cf8523 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:06.948778 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-47ec5e88-9ea0-4843-a7b3-341227cf8523 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:06.949538 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-47ec5e88-9ea0-4843-a7b3-341227cf8523 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:06.951387 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-47ec5e88-9ea0-4843-a7b3-341227cf8523 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:06.951861 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-47ec5e88-9ea0-4843-a7b3-341227cf8523 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:06.952460 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-47ec5e88-9ea0-4843-a7b3-341227cf8523 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:07.111411 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-47ec5e88-9ea0-4843-a7b3-341227cf8523 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0eb2feb062947e78357b70e832e3edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18029da9b9854f3caf3debd9556f1f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:07.118959 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-47ec5e88-9ea0-4843-a7b3-341227cf8523 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] 10.222.0.26 "GET /compute/v2.1/servers/6611e099-c1f0-4fed-ba7b-0b096800946d" status: 200 len: 1320 microversion: 2.1 time: 0.183175 Oct 08 20:52:07.119792 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 88/171] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:52:06 2022] GET /compute/v2.1/servers/6611e099-c1f0-4fed-ba7b-0b096800946d => generated 1320 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 20:52:07.335363 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-b068aab0-b869-40db-b9f9-bec3eea438eb tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] 10.222.0.26 "GET /compute/v2.1/os-quota-sets/19bfa19b199e4458a43ca58c00e5df1a" status: 200 len: 371 microversion: 2.1 time: 0.963746 Oct 08 20:52:07.336117 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 84/172] 10.222.0.26 () {58 vars in 1242 bytes} [Sat Oct 8 20:52:06 2022] GET /compute/v2.1/os-quota-sets/19bfa19b199e4458a43ca58c00e5df1a => generated 371 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 08 20:52:07.348291 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-64aa48d6-ab56-4f8f-b37e-11d85c0806cb tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] Action: 'update', calling method: .version_select at 0x7f1a8d300af0>, body: {"quota_set": {"ram": "5120"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:52:07.646727 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-64aa48d6-ab56-4f8f-b37e-11d85c0806cb tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:07.647670 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-64aa48d6-ab56-4f8f-b37e-11d85c0806cb tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:07.647670 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-64aa48d6-ab56-4f8f-b37e-11d85c0806cb tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:07.648526 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-64aa48d6-ab56-4f8f-b37e-11d85c0806cb tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:07.649049 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-64aa48d6-ab56-4f8f-b37e-11d85c0806cb tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:07.649575 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-64aa48d6-ab56-4f8f-b37e-11d85c0806cb tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:07.705683 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-64aa48d6-ab56-4f8f-b37e-11d85c0806cb tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-quota-sets/19bfa19b199e4458a43ca58c00e5df1a" status: 200 len: 328 microversion: 2.1 time: 0.361115 Oct 08 20:52:07.707666 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 89/173] 10.222.0.26 () {60 vars in 1262 bytes} [Sat Oct 8 20:52:07 2022] PUT /compute/v2.1/os-quota-sets/19bfa19b199e4458a43ca58c00e5df1a => generated 328 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:52:07.723081 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-7d5c7b93-acce-405d-b116-9bf619ad2411 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:07.736736 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-7d5c7b93-acce-405d-b116-9bf619ad2411 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-quota-sets/19bfa19b199e4458a43ca58c00e5df1a" status: 202 len: 0 microversion: 2.1 time: 0.017257 Oct 08 20:52:07.737460 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 85/174] 10.222.0.26 () {58 vars in 1245 bytes} [Sat Oct 8 20:52:07 2022] DELETE /compute/v2.1/os-quota-sets/19bfa19b199e4458a43ca58c00e5df1a => generated 0 bytes in 19 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 08 20:52:07.748810 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-86019770-1317-498f-8fcb-e167c719f1df tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] Calling method '.version_select at 0x7f1a8d304b80>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:07.852594 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-18783c20-f793-4391-9079-24e6c4e8f33a tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:07.853653 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-18783c20-f793-4391-9079-24e6c4e8f33a tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] [instance: bbff4ffb-395f-4eeb-a995-60c9c0f39f25] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:52:07.863653 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-18783c20-f793-4391-9079-24e6c4e8f33a tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:07.864185 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-18783c20-f793-4391-9079-24e6c4e8f33a tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:07.864711 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-18783c20-f793-4391-9079-24e6c4e8f33a tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:07.865424 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-18783c20-f793-4391-9079-24e6c4e8f33a tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:07.865835 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-18783c20-f793-4391-9079-24e6c4e8f33a tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:07.866245 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-18783c20-f793-4391-9079-24e6c4e8f33a tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:08.026673 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-18783c20-f793-4391-9079-24e6c4e8f33a tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8da7d5210cf42bda150d342ff207bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd024396aef784f3291630c426a828cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:08.038388 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-18783c20-f793-4391-9079-24e6c4e8f33a tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] 10.222.0.26 "GET /compute/v2.1/servers/bbff4ffb-395f-4eeb-a995-60c9c0f39f25" status: 200 len: 1339 microversion: 2.1 time: 0.189876 Oct 08 20:52:08.039520 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 86/175] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:52:07 2022] GET /compute/v2.1/servers/bbff4ffb-395f-4eeb-a995-60c9c0f39f25 => generated 1339 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:52:08.143319 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-86019770-1317-498f-8fcb-e167c719f1df tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] 10.222.0.26 "GET /compute/v2.1/os-quota-sets/19bfa19b199e4458a43ca58c00e5df1a" status: 200 len: 371 microversion: 2.1 time: 0.401018 Oct 08 20:52:08.145070 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 90/176] 10.222.0.26 () {58 vars in 1242 bytes} [Sat Oct 8 20:52:07 2022] GET /compute/v2.1/os-quota-sets/19bfa19b199e4458a43ca58c00e5df1a => generated 371 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:52:08.146568 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-511bddfb-35ed-46f1-bad4-d729712ccee4 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:08.147256 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-511bddfb-35ed-46f1-bad4-d729712ccee4 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] [instance: 6611e099-c1f0-4fed-ba7b-0b096800946d] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:52:08.154336 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-511bddfb-35ed-46f1-bad4-d729712ccee4 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:08.154914 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-511bddfb-35ed-46f1-bad4-d729712ccee4 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:08.155527 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-511bddfb-35ed-46f1-bad4-d729712ccee4 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:08.156927 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-511bddfb-35ed-46f1-bad4-d729712ccee4 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:08.157573 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-511bddfb-35ed-46f1-bad4-d729712ccee4 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:08.158151 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-511bddfb-35ed-46f1-bad4-d729712ccee4 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:08.185704 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-26eae65c-e687-462c-9b96-2475a2575ad5 req-c4c2185d-edf2-4dd4-b33d-edb480384291 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6611e099-c1f0-4fed-ba7b-0b096800946d", "name": "network-vif-plugged", "status": "completed", "tag": "e840762c-aa06-40ad-802b-ac87c05858c5"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:52:08.199206 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-26eae65c-e687-462c-9b96-2475a2575ad5 req-c4c2185d-edf2-4dd4-b33d-edb480384291 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:08.199909 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-26eae65c-e687-462c-9b96-2475a2575ad5 req-c4c2185d-edf2-4dd4-b33d-edb480384291 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:08.200787 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-26eae65c-e687-462c-9b96-2475a2575ad5 req-c4c2185d-edf2-4dd4-b33d-edb480384291 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:08.224034 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-26eae65c-e687-462c-9b96-2475a2575ad5 req-c4c2185d-edf2-4dd4-b33d-edb480384291 service nova] Creating event network-vif-plugged:e840762c-aa06-40ad-802b-ac87c05858c5 for instance 6611e099-c1f0-4fed-ba7b-0b096800946d on nch1-master-1 Oct 08 20:52:08.229321 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-26eae65c-e687-462c-9b96-2475a2575ad5 req-c4c2185d-edf2-4dd4-b33d-edb480384291 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047304 Oct 08 20:52:08.230294 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 91/177] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:52:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 08 20:52:08.468782 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-511bddfb-35ed-46f1-bad4-d729712ccee4 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0eb2feb062947e78357b70e832e3edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18029da9b9854f3caf3debd9556f1f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:08.500462 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-511bddfb-35ed-46f1-bad4-d729712ccee4 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] 10.222.0.26 "GET /compute/v2.1/servers/6611e099-c1f0-4fed-ba7b-0b096800946d" status: 200 len: 1320 microversion: 2.1 time: 0.357135 Oct 08 20:52:08.501688 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 87/178] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:52:08 2022] GET /compute/v2.1/servers/6611e099-c1f0-4fed-ba7b-0b096800946d => generated 1320 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 20:52:08.558253 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-85d5f16d-d2aa-4923-b2d4-0fa6c58d4c6d tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] Calling method '.version_select at 0x7f1a8d300c10>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:08.991695 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-85d5f16d-d2aa-4923-b2d4-0fa6c58d4c6d tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] 10.222.0.26 "GET /compute/v2.1/os-quota-sets/fc20782544f24eb3a49a037ef01e1f8f/defaults" status: 200 len: 371 microversion: 2.1 time: 0.437574 Oct 08 20:52:08.992423 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 92/179] 10.222.0.26 () {58 vars in 1269 bytes} [Sat Oct 8 20:52:08 2022] GET /compute/v2.1/os-quota-sets/fc20782544f24eb3a49a037ef01e1f8f/defaults => generated 371 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:52:09.062087 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-74b40d09-2422-463e-b58c-7b7f3a751e57 tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:09.063369 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-74b40d09-2422-463e-b58c-7b7f3a751e57 tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] [instance: bbff4ffb-395f-4eeb-a995-60c9c0f39f25] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:52:09.070672 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-74b40d09-2422-463e-b58c-7b7f3a751e57 tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:09.070934 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-74b40d09-2422-463e-b58c-7b7f3a751e57 tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:09.071535 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-74b40d09-2422-463e-b58c-7b7f3a751e57 tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:09.072431 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-74b40d09-2422-463e-b58c-7b7f3a751e57 tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:09.072963 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-74b40d09-2422-463e-b58c-7b7f3a751e57 tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:09.073450 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-74b40d09-2422-463e-b58c-7b7f3a751e57 tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:09.091995 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-4fbefa80-7314-4b52-9214-26a4503920dc tempest-NetworksTest-1452580630 tempest-NetworksTest-1452580630-project-admin] Calling method '.version_select at 0x7f1a8d59ac10>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:09.239998 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-74b40d09-2422-463e-b58c-7b7f3a751e57 tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8da7d5210cf42bda150d342ff207bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd024396aef784f3291630c426a828cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:09.249303 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-74b40d09-2422-463e-b58c-7b7f3a751e57 tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] 10.222.0.26 "GET /compute/v2.1/servers/bbff4ffb-395f-4eeb-a995-60c9c0f39f25" status: 200 len: 1488 microversion: 2.1 time: 0.190583 Oct 08 20:52:09.250391 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 93/180] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:52:09 2022] GET /compute/v2.1/servers/bbff4ffb-395f-4eeb-a995-60c9c0f39f25 => generated 1488 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:52:09.274373 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-f7c7c5de-b857-4c6d-a4e9-d049f40ad96a tempest-AggregatesAdminTestJSON-1599742552 tempest-AggregatesAdminTestJSON-1599742552-project-admin] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:09.275143 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-f7c7c5de-b857-4c6d-a4e9-d049f40ad96a tempest-AggregatesAdminTestJSON-1599742552 tempest-AggregatesAdminTestJSON-1599742552-project-admin] [instance: bbff4ffb-395f-4eeb-a995-60c9c0f39f25] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:52:09.282890 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f7c7c5de-b857-4c6d-a4e9-d049f40ad96a tempest-AggregatesAdminTestJSON-1599742552 tempest-AggregatesAdminTestJSON-1599742552-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:09.283622 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f7c7c5de-b857-4c6d-a4e9-d049f40ad96a tempest-AggregatesAdminTestJSON-1599742552 tempest-AggregatesAdminTestJSON-1599742552-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:09.284242 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f7c7c5de-b857-4c6d-a4e9-d049f40ad96a tempest-AggregatesAdminTestJSON-1599742552 tempest-AggregatesAdminTestJSON-1599742552-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:09.285112 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f7c7c5de-b857-4c6d-a4e9-d049f40ad96a tempest-AggregatesAdminTestJSON-1599742552 tempest-AggregatesAdminTestJSON-1599742552-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:09.285740 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f7c7c5de-b857-4c6d-a4e9-d049f40ad96a tempest-AggregatesAdminTestJSON-1599742552 tempest-AggregatesAdminTestJSON-1599742552-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:09.286321 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f7c7c5de-b857-4c6d-a4e9-d049f40ad96a tempest-AggregatesAdminTestJSON-1599742552 tempest-AggregatesAdminTestJSON-1599742552-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:09.372621 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=100 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:09.510099 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-4fbefa80-7314-4b52-9214-26a4503920dc tempest-NetworksTest-1452580630 tempest-NetworksTest-1452580630-project-admin] 10.222.0.26 "GET /compute/v2.1/os-networks" status: 200 len: 1938 microversion: 2.1 time: 0.570617 Oct 08 20:52:09.513442 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 88/181] 10.222.0.26 () {58 vars in 1137 bytes} [Sat Oct 8 20:52:08 2022] GET /compute/v2.1/os-networks => generated 1938 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:52:09.519500 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-84d9106d-7b5c-460e-a14d-431864b27cb3 tempest-NetworksTest-1452580630 tempest-NetworksTest-1452580630-project-admin] Calling method '.version_select at 0x7f1a8d4a31f0>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:09.632506 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-84d9106d-7b5c-460e-a14d-431864b27cb3 tempest-NetworksTest-1452580630 tempest-NetworksTest-1452580630-project-admin] 10.222.0.26 "GET /compute/v2.1/os-networks/3c42c553-144c-41e7-a630-7c37a150f55f" status: 200 len: 652 microversion: 2.1 time: 0.117031 Oct 08 20:52:09.638107 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 89/182] 10.222.0.26 () {58 vars in 1248 bytes} [Sat Oct 8 20:52:09 2022] GET /compute/v2.1/os-networks/3c42c553-144c-41e7-a630-7c37a150f55f => generated 652 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:52:09.644856 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-1bcacd98-56ed-45e8-a798-f427e8620121 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:09.645903 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-1bcacd98-56ed-45e8-a798-f427e8620121 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] [instance: 6611e099-c1f0-4fed-ba7b-0b096800946d] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:52:09.655985 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1bcacd98-56ed-45e8-a798-f427e8620121 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:09.656591 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1bcacd98-56ed-45e8-a798-f427e8620121 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:09.657033 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1bcacd98-56ed-45e8-a798-f427e8620121 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:09.657770 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1bcacd98-56ed-45e8-a798-f427e8620121 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:09.658222 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1bcacd98-56ed-45e8-a798-f427e8620121 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:09.658787 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1bcacd98-56ed-45e8-a798-f427e8620121 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:09.676653 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-f7c7c5de-b857-4c6d-a4e9-d049f40ad96a tempest-AggregatesAdminTestJSON-1599742552 tempest-AggregatesAdminTestJSON-1599742552-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/bbff4ffb-395f-4eeb-a995-60c9c0f39f25" status: 200 len: 1639 microversion: 2.1 time: 0.400179 Oct 08 20:52:09.676653 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 94/183] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:52:09 2022] GET /compute/v2.1/servers/bbff4ffb-395f-4eeb-a995-60c9c0f39f25 => generated 1639 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:52:09.677679 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-02fa5703-cb8c-4b30-9d8f-e345a9d0276c tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] Action: 'update', calling method: .version_select at 0x7f1a8d49fa60>, body: {"quota_set": {"ram": "5120"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:52:09.804037 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-1bcacd98-56ed-45e8-a798-f427e8620121 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0eb2feb062947e78357b70e832e3edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18029da9b9854f3caf3debd9556f1f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:09.811623 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-1bcacd98-56ed-45e8-a798-f427e8620121 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] 10.222.0.26 "GET /compute/v2.1/servers/6611e099-c1f0-4fed-ba7b-0b096800946d" status: 200 len: 1320 microversion: 2.1 time: 0.172265 Oct 08 20:52:09.812291 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 90/184] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:52:09 2022] GET /compute/v2.1/servers/6611e099-c1f0-4fed-ba7b-0b096800946d => generated 1320 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:52:09.816528 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-708c417d-509b-4f18-8cd6-d4b7582bb3b2 tempest-NetworksTest-1452580630 tempest-NetworksTest-1452580630-project-admin] Calling method '.version_select at 0x7f1a8d59a940>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:09.879116 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-02fa5703-cb8c-4b30-9d8f-e345a9d0276c tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:09.879578 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-02fa5703-cb8c-4b30-9d8f-e345a9d0276c tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:09.880013 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-02fa5703-cb8c-4b30-9d8f-e345a9d0276c tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:09.880771 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-02fa5703-cb8c-4b30-9d8f-e345a9d0276c tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:09.881250 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-02fa5703-cb8c-4b30-9d8f-e345a9d0276c tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:09.881678 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-02fa5703-cb8c-4b30-9d8f-e345a9d0276c tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:09.920272 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-708c417d-509b-4f18-8cd6-d4b7582bb3b2 tempest-NetworksTest-1452580630 tempest-NetworksTest-1452580630-project-admin] 10.222.0.26 "GET /compute/v2.1/os-networks" status: 200 len: 1938 microversion: 2.1 time: 0.106939 Oct 08 20:52:09.921081 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 91/185] 10.222.0.26 () {58 vars in 1137 bytes} [Sat Oct 8 20:52:09 2022] GET /compute/v2.1/os-networks => generated 1938 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:52:09.935379 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-02fa5703-cb8c-4b30-9d8f-e345a9d0276c tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-quota-sets/f37ffeaad9bb496e85255e18cdd81a57" status: 200 len: 328 microversion: 2.1 time: 0.262673 Oct 08 20:52:09.936010 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 95/186] 10.222.0.26 () {60 vars in 1262 bytes} [Sat Oct 8 20:52:09 2022] PUT /compute/v2.1/os-quota-sets/f37ffeaad9bb496e85255e18cdd81a57 => generated 328 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:52:09.940526 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-33885771-2884-482f-8bdf-f3973980f401 tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:09.940956 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-33885771-2884-482f-8bdf-f3973980f401 tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] [instance: bbff4ffb-395f-4eeb-a995-60c9c0f39f25] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:52:09.947245 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-33885771-2884-482f-8bdf-f3973980f401 tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:09.947733 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-33885771-2884-482f-8bdf-f3973980f401 tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:09.948195 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-33885771-2884-482f-8bdf-f3973980f401 tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:09.948849 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-33885771-2884-482f-8bdf-f3973980f401 tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:09.949319 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-33885771-2884-482f-8bdf-f3973980f401 tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:09.949743 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-33885771-2884-482f-8bdf-f3973980f401 tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:09.983916 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-33885771-2884-482f-8bdf-f3973980f401 tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] [instance: bbff4ffb-395f-4eeb-a995-60c9c0f39f25] Going to try to terminate instance {{(pid=140492) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 20:52:10.034380 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-53b2fa2b-d16b-4e6e-8ea7-efa5829dc3eb tempest-SecurityGroupsTestAdminJSON-361783708 tempest-SecurityGroupsTestAdminJSON-361783708-project] Action: 'create', calling method: .version_select at 0x7f1a8d4a3e50>, body: {"security_group": {"name": "tempest-securitygroup-949868968", "description": "tempest-description-1600793498"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:52:10.121678 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-33885771-2884-482f-8bdf-f3973980f401 tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] 10.222.0.26 "DELETE /compute/v2.1/servers/bbff4ffb-395f-4eeb-a995-60c9c0f39f25" status: 204 len: 0 microversion: 2.1 time: 0.184341 Oct 08 20:52:10.122530 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 96/187] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 20:52:09 2022] DELETE /compute/v2.1/servers/bbff4ffb-395f-4eeb-a995-60c9c0f39f25 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 20:52:10.326690 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-53b2fa2b-d16b-4e6e-8ea7-efa5829dc3eb tempest-SecurityGroupsTestAdminJSON-361783708 tempest-SecurityGroupsTestAdminJSON-361783708-project] 10.222.0.26 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.404568 Oct 08 20:52:10.328197 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 92/188] 10.222.0.26 () {60 vars in 1180 bytes} [Sat Oct 8 20:52:09 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:52:10.341735 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-ce992829-a6c4-4a8f-b0b0-4b55cc5c234b tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] Calling method '.version_select at 0x7f1a8d4cda60>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:10.341957 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-a9effdd0-5d07-4ad0-a9f2-bf95ec3b8d20 tempest-HypervisorAdminUnderV252Test-1018927053 tempest-HypervisorAdminUnderV252Test-1018927053-project-admin] Calling method '.version_select at 0x7f1a8d483e50>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:10.351124 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a9effdd0-5d07-4ad0-a9f2-bf95ec3b8d20 tempest-HypervisorAdminUnderV252Test-1018927053 tempest-HypervisorAdminUnderV252Test-1018927053-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:10.351629 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a9effdd0-5d07-4ad0-a9f2-bf95ec3b8d20 tempest-HypervisorAdminUnderV252Test-1018927053 tempest-HypervisorAdminUnderV252Test-1018927053-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:10.352077 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a9effdd0-5d07-4ad0-a9f2-bf95ec3b8d20 tempest-HypervisorAdminUnderV252Test-1018927053 tempest-HypervisorAdminUnderV252Test-1018927053-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:10.372594 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a9effdd0-5d07-4ad0-a9f2-bf95ec3b8d20 tempest-HypervisorAdminUnderV252Test-1018927053 tempest-HypervisorAdminUnderV252Test-1018927053-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:10.373162 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a9effdd0-5d07-4ad0-a9f2-bf95ec3b8d20 tempest-HypervisorAdminUnderV252Test-1018927053 tempest-HypervisorAdminUnderV252Test-1018927053-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:10.373683 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a9effdd0-5d07-4ad0-a9f2-bf95ec3b8d20 tempest-HypervisorAdminUnderV252Test-1018927053 tempest-HypervisorAdminUnderV252Test-1018927053-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:10.386148 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a9effdd0-5d07-4ad0-a9f2-bf95ec3b8d20 tempest-HypervisorAdminUnderV252Test-1018927053 tempest-HypervisorAdminUnderV252Test-1018927053-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:10.387433 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a9effdd0-5d07-4ad0-a9f2-bf95ec3b8d20 tempest-HypervisorAdminUnderV252Test-1018927053 tempest-HypervisorAdminUnderV252Test-1018927053-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:10.387884 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a9effdd0-5d07-4ad0-a9f2-bf95ec3b8d20 tempest-HypervisorAdminUnderV252Test-1018927053 tempest-HypervisorAdminUnderV252Test-1018927053-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:10.410215 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-a9effdd0-5d07-4ad0-a9f2-bf95ec3b8d20 tempest-HypervisorAdminUnderV252Test-1018927053 tempest-HypervisorAdminUnderV252Test-1018927053-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.270991 Oct 08 20:52:10.411083 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 97/189] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Oct 8 20:52:10 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:52:10.420703 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-d72b7797-ba6a-45e5-ad62-74610252fef5 tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:10.421995 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-d72b7797-ba6a-45e5-ad62-74610252fef5 tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] [instance: bbff4ffb-395f-4eeb-a995-60c9c0f39f25] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:52:10.429429 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d72b7797-ba6a-45e5-ad62-74610252fef5 tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:10.430152 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d72b7797-ba6a-45e5-ad62-74610252fef5 tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:10.430742 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d72b7797-ba6a-45e5-ad62-74610252fef5 tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:10.431612 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d72b7797-ba6a-45e5-ad62-74610252fef5 tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:10.432253 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d72b7797-ba6a-45e5-ad62-74610252fef5 tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:10.432827 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d72b7797-ba6a-45e5-ad62-74610252fef5 tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:10.517077 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ce992829-a6c4-4a8f-b0b0-4b55cc5c234b tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:10.517625 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ce992829-a6c4-4a8f-b0b0-4b55cc5c234b tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:10.518066 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ce992829-a6c4-4a8f-b0b0-4b55cc5c234b tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:10.518806 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ce992829-a6c4-4a8f-b0b0-4b55cc5c234b tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:10.519268 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ce992829-a6c4-4a8f-b0b0-4b55cc5c234b tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:10.519701 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ce992829-a6c4-4a8f-b0b0-4b55cc5c234b tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:10.538825 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-ce992829-a6c4-4a8f-b0b0-4b55cc5c234b tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] 10.222.0.26 "GET /compute/v2.1/os-quota-sets/f37ffeaad9bb496e85255e18cdd81a57/detail" status: 200 len: 916 microversion: 2.1 time: 0.209450 Oct 08 20:52:10.539445 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 93/190] 10.222.0.26 () {58 vars in 1263 bytes} [Sat Oct 8 20:52:10 2022] GET /compute/v2.1/os-quota-sets/f37ffeaad9bb496e85255e18cdd81a57/detail => generated 916 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:52:10.543910 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-0f88f056-14c7-4462-8983-89c7eefc7817 tempest-SecurityGroupsTestAdminJSON-361783708 tempest-SecurityGroupsTestAdminJSON-361783708-project] Action: 'create', calling method: .version_select at 0x7f1a8d435310>, body: {"security_group": {"name": "tempest-securitygroup-169960990", "description": "tempest-description-1041304997"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:52:10.639908 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-d72b7797-ba6a-45e5-ad62-74610252fef5 tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8da7d5210cf42bda150d342ff207bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd024396aef784f3291630c426a828cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:10.658533 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-d72b7797-ba6a-45e5-ad62-74610252fef5 tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] 10.222.0.26 "GET /compute/v2.1/servers/bbff4ffb-395f-4eeb-a995-60c9c0f39f25" status: 200 len: 1494 microversion: 2.1 time: 0.245872 Oct 08 20:52:10.661659 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 98/191] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:52:10 2022] GET /compute/v2.1/servers/bbff4ffb-395f-4eeb-a995-60c9c0f39f25 => generated 1494 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:52:10.681572 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-8afc7691-1dd8-4dda-8d15-26e60703cdd9 tempest-HypervisorAdminUnderV252Test-1018927053 tempest-HypervisorAdminUnderV252Test-1018927053-project-admin] Calling method '.version_select at 0x7f1a8d300700>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:10.688059 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8afc7691-1dd8-4dda-8d15-26e60703cdd9 tempest-HypervisorAdminUnderV252Test-1018927053 tempest-HypervisorAdminUnderV252Test-1018927053-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:10.688759 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8afc7691-1dd8-4dda-8d15-26e60703cdd9 tempest-HypervisorAdminUnderV252Test-1018927053 tempest-HypervisorAdminUnderV252Test-1018927053-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:10.689913 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8afc7691-1dd8-4dda-8d15-26e60703cdd9 tempest-HypervisorAdminUnderV252Test-1018927053 tempest-HypervisorAdminUnderV252Test-1018927053-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:10.707708 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8afc7691-1dd8-4dda-8d15-26e60703cdd9 tempest-HypervisorAdminUnderV252Test-1018927053 tempest-HypervisorAdminUnderV252Test-1018927053-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:10.708217 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8afc7691-1dd8-4dda-8d15-26e60703cdd9 tempest-HypervisorAdminUnderV252Test-1018927053 tempest-HypervisorAdminUnderV252Test-1018927053-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:10.709163 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8afc7691-1dd8-4dda-8d15-26e60703cdd9 tempest-HypervisorAdminUnderV252Test-1018927053 tempest-HypervisorAdminUnderV252Test-1018927053-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:10.730854 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8afc7691-1dd8-4dda-8d15-26e60703cdd9 tempest-HypervisorAdminUnderV252Test-1018927053 tempest-HypervisorAdminUnderV252Test-1018927053-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:10.731685 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8afc7691-1dd8-4dda-8d15-26e60703cdd9 tempest-HypervisorAdminUnderV252Test-1018927053 tempest-HypervisorAdminUnderV252Test-1018927053-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:10.732162 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8afc7691-1dd8-4dda-8d15-26e60703cdd9 tempest-HypervisorAdminUnderV252Test-1018927053 tempest-HypervisorAdminUnderV252Test-1018927053-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:10.739967 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-8afc7691-1dd8-4dda-8d15-26e60703cdd9 tempest-HypervisorAdminUnderV252Test-1018927053 tempest-HypervisorAdminUnderV252Test-1018927053-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors/nch2-master-1/servers" status: 200 len: 196 microversion: 2.1 time: 0.076337 Oct 08 20:52:10.740591 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 99/192] 10.222.0.26 () {58 vars in 1212 bytes} [Sat Oct 8 20:52:10 2022] GET /compute/v2.1/os-hypervisors/nch2-master-1/servers => generated 196 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:52:10.744927 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-0f88f056-14c7-4462-8983-89c7eefc7817 tempest-SecurityGroupsTestAdminJSON-361783708 tempest-SecurityGroupsTestAdminJSON-361783708-project] 10.222.0.26 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.201608 Oct 08 20:52:10.750948 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 94/193] 10.222.0.26 () {60 vars in 1180 bytes} [Sat Oct 8 20:52:10 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:52:10.752460 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-fc0a009b-0fbe-46a3-ab76-ead872635df7 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] Action: 'update', calling method: .version_select at 0x7f1a8d353040>, body: {"quota_set": {"ram": "2048"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:52:10.755566 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-b5bf0825-a53e-404a-960a-3573476b33d0 tempest-HypervisorAdminUnderV252Test-1018927053 tempest-HypervisorAdminUnderV252Test-1018927053-project-admin] Calling method '.version_select at 0x7f1a8d4359d0>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:10.757445 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b5bf0825-a53e-404a-960a-3573476b33d0 tempest-HypervisorAdminUnderV252Test-1018927053 tempest-HypervisorAdminUnderV252Test-1018927053-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:10.758039 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b5bf0825-a53e-404a-960a-3573476b33d0 tempest-HypervisorAdminUnderV252Test-1018927053 tempest-HypervisorAdminUnderV252Test-1018927053-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:10.758622 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b5bf0825-a53e-404a-960a-3573476b33d0 tempest-HypervisorAdminUnderV252Test-1018927053 tempest-HypervisorAdminUnderV252Test-1018927053-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:10.774291 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b5bf0825-a53e-404a-960a-3573476b33d0 tempest-HypervisorAdminUnderV252Test-1018927053 tempest-HypervisorAdminUnderV252Test-1018927053-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:10.774814 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b5bf0825-a53e-404a-960a-3573476b33d0 tempest-HypervisorAdminUnderV252Test-1018927053 tempest-HypervisorAdminUnderV252Test-1018927053-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:10.775236 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b5bf0825-a53e-404a-960a-3573476b33d0 tempest-HypervisorAdminUnderV252Test-1018927053 tempest-HypervisorAdminUnderV252Test-1018927053-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:10.787430 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b5bf0825-a53e-404a-960a-3573476b33d0 tempest-HypervisorAdminUnderV252Test-1018927053 tempest-HypervisorAdminUnderV252Test-1018927053-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:10.787981 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b5bf0825-a53e-404a-960a-3573476b33d0 tempest-HypervisorAdminUnderV252Test-1018927053 tempest-HypervisorAdminUnderV252Test-1018927053-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:10.788431 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b5bf0825-a53e-404a-960a-3573476b33d0 tempest-HypervisorAdminUnderV252Test-1018927053 tempest-HypervisorAdminUnderV252Test-1018927053-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:10.795028 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-b5bf0825-a53e-404a-960a-3573476b33d0 tempest-HypervisorAdminUnderV252Test-1018927053 tempest-HypervisorAdminUnderV252Test-1018927053-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.043004 Oct 08 20:52:10.795607 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 95/194] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Oct 8 20:52:10 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:52:10.828005 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=93,nova_cell0:UPDATE=7 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:10.831159 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fc0a009b-0fbe-46a3-ab76-ead872635df7 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:10.831747 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fc0a009b-0fbe-46a3-ab76-ead872635df7 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:10.833104 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fc0a009b-0fbe-46a3-ab76-ead872635df7 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:10.834274 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fc0a009b-0fbe-46a3-ab76-ead872635df7 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:10.835348 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fc0a009b-0fbe-46a3-ab76-ead872635df7 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:10.835993 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fc0a009b-0fbe-46a3-ab76-ead872635df7 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:10.875502 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fc0a009b-0fbe-46a3-ab76-ead872635df7 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:10.876067 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fc0a009b-0fbe-46a3-ab76-ead872635df7 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:10.876634 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fc0a009b-0fbe-46a3-ab76-ead872635df7 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:10.877443 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fc0a009b-0fbe-46a3-ab76-ead872635df7 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:10.878006 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fc0a009b-0fbe-46a3-ab76-ead872635df7 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:10.878521 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fc0a009b-0fbe-46a3-ab76-ead872635df7 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:10.946813 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-73571dae-84be-47cf-9d93-5af02306b479 tempest-SecurityGroupsTestAdminJSON-1353376590 tempest-SecurityGroupsTestAdminJSON-1353376590-project-admin] Action: 'create', calling method: .version_select at 0x7f1a8d51ab80>, body: {"security_group": {"name": "tempest-securitygroup-1920792677", "description": "tempest-description-586868136"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:52:10.950825 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-fc0a009b-0fbe-46a3-ab76-ead872635df7 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-quota-sets/f37ffeaad9bb496e85255e18cdd81a57?user_id=c42077c05f1d4658a38021e39823f960" status: 200 len: 328 microversion: 2.1 time: 0.202193 Oct 08 20:52:10.951452 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 100/195] 10.222.0.26 () {60 vars in 1343 bytes} [Sat Oct 8 20:52:10 2022] PUT /compute/v2.1/os-quota-sets/f37ffeaad9bb496e85255e18cdd81a57?user_id=c42077c05f1d4658a38021e39823f960 => generated 328 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:52:10.956476 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-58cae146-998d-49e1-a86c-4f5c3b16ad81 tempest-HypervisorAdminUnderV252Test-1018927053 tempest-HypervisorAdminUnderV252Test-1018927053-project-admin] Calling method '.version_select at 0x7f1a8d2883a0>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:10.958202 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-58cae146-998d-49e1-a86c-4f5c3b16ad81 tempest-HypervisorAdminUnderV252Test-1018927053 tempest-HypervisorAdminUnderV252Test-1018927053-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:10.959255 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-58cae146-998d-49e1-a86c-4f5c3b16ad81 tempest-HypervisorAdminUnderV252Test-1018927053 tempest-HypervisorAdminUnderV252Test-1018927053-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:10.959794 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-58cae146-998d-49e1-a86c-4f5c3b16ad81 tempest-HypervisorAdminUnderV252Test-1018927053 tempest-HypervisorAdminUnderV252Test-1018927053-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:10.972324 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-58cae146-998d-49e1-a86c-4f5c3b16ad81 tempest-HypervisorAdminUnderV252Test-1018927053 tempest-HypervisorAdminUnderV252Test-1018927053-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:10.972894 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-58cae146-998d-49e1-a86c-4f5c3b16ad81 tempest-HypervisorAdminUnderV252Test-1018927053 tempest-HypervisorAdminUnderV252Test-1018927053-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:10.973452 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-58cae146-998d-49e1-a86c-4f5c3b16ad81 tempest-HypervisorAdminUnderV252Test-1018927053 tempest-HypervisorAdminUnderV252Test-1018927053-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:10.980071 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-58cae146-998d-49e1-a86c-4f5c3b16ad81 tempest-HypervisorAdminUnderV252Test-1018927053 tempest-HypervisorAdminUnderV252Test-1018927053-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors/nch2-master-1/search" status: 200 len: 104 microversion: 2.1 time: 0.027393 Oct 08 20:52:10.980735 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 101/196] 10.222.0.26 () {58 vars in 1209 bytes} [Sat Oct 8 20:52:10 2022] GET /compute/v2.1/os-hypervisors/nch2-master-1/search => generated 104 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:52:10.985526 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e1d4157d-77d7-4c1b-bd16-da7164b383c1 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:10.987422 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-e1d4157d-77d7-4c1b-bd16-da7164b383c1 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] [instance: 6611e099-c1f0-4fed-ba7b-0b096800946d] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:52:10.990855 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:10.994898 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e1d4157d-77d7-4c1b-bd16-da7164b383c1 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:10.995600 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e1d4157d-77d7-4c1b-bd16-da7164b383c1 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:10.996169 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e1d4157d-77d7-4c1b-bd16-da7164b383c1 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:10.997069 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e1d4157d-77d7-4c1b-bd16-da7164b383c1 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:10.997627 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e1d4157d-77d7-4c1b-bd16-da7164b383c1 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:10.998147 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e1d4157d-77d7-4c1b-bd16-da7164b383c1 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:11.164083 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-e1d4157d-77d7-4c1b-bd16-da7164b383c1 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0eb2feb062947e78357b70e832e3edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18029da9b9854f3caf3debd9556f1f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:11.173994 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-e1d4157d-77d7-4c1b-bd16-da7164b383c1 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] 10.222.0.26 "GET /compute/v2.1/servers/6611e099-c1f0-4fed-ba7b-0b096800946d" status: 200 len: 1470 microversion: 2.1 time: 0.192155 Oct 08 20:52:11.174563 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 102/197] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:52:10 2022] GET /compute/v2.1/servers/6611e099-c1f0-4fed-ba7b-0b096800946d => generated 1470 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:52:11.178867 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-3f62d2ad-95b1-40fb-b0b7-1590eadaf1b5 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] Calling method '.version_select at 0x7f1a8d3534c0>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:11.298763 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-73571dae-84be-47cf-9d93-5af02306b479 tempest-SecurityGroupsTestAdminJSON-1353376590 tempest-SecurityGroupsTestAdminJSON-1353376590-project-admin] 10.222.0.26 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.501078 Oct 08 20:52:11.299372 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 96/198] 10.222.0.26 () {60 vars in 1180 bytes} [Sat Oct 8 20:52:10 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:52:11.465713 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-3f62d2ad-95b1-40fb-b0b7-1590eadaf1b5 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] 10.222.0.26 "GET /compute/v2.1/os-quota-sets/f37ffeaad9bb496e85255e18cdd81a57?user_id=c42077c05f1d4658a38021e39823f960" status: 200 len: 370 microversion: 2.1 time: 0.290057 Oct 08 20:52:11.491490 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-016f3764-6154-4417-a20c-4bf75edef151 tempest-DeleteServersAdminTestJSON-2119063606 tempest-DeleteServersAdminTestJSON-2119063606-project-admin] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:11.491908 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-016f3764-6154-4417-a20c-4bf75edef151 tempest-DeleteServersAdminTestJSON-2119063606 tempest-DeleteServersAdminTestJSON-2119063606-project-admin] [instance: 6611e099-c1f0-4fed-ba7b-0b096800946d] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:52:11.496381 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 103/199] 10.222.0.26 () {58 vars in 1323 bytes} [Sat Oct 8 20:52:11 2022] GET /compute/v2.1/os-quota-sets/f37ffeaad9bb496e85255e18cdd81a57?user_id=c42077c05f1d4658a38021e39823f960 => generated 370 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:52:11.501303 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-016f3764-6154-4417-a20c-4bf75edef151 tempest-DeleteServersAdminTestJSON-2119063606 tempest-DeleteServersAdminTestJSON-2119063606-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:11.506138 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-536db01b-1f2b-4f54-8123-e4f45e392f2c tempest-SecurityGroupsTestAdminJSON-1353376590 tempest-SecurityGroupsTestAdminJSON-1353376590-project-admin] Action: 'create', calling method: .version_select at 0x7f1a8d216af0>, body: {"security_group": {"name": "tempest-securitygroup-219196124", "description": "tempest-description-1067035762"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:52:11.511025 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-016f3764-6154-4417-a20c-4bf75edef151 tempest-DeleteServersAdminTestJSON-2119063606 tempest-DeleteServersAdminTestJSON-2119063606-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:11.511534 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-016f3764-6154-4417-a20c-4bf75edef151 tempest-DeleteServersAdminTestJSON-2119063606 tempest-DeleteServersAdminTestJSON-2119063606-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:11.512250 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-016f3764-6154-4417-a20c-4bf75edef151 tempest-DeleteServersAdminTestJSON-2119063606 tempest-DeleteServersAdminTestJSON-2119063606-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:11.512721 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-016f3764-6154-4417-a20c-4bf75edef151 tempest-DeleteServersAdminTestJSON-2119063606 tempest-DeleteServersAdminTestJSON-2119063606-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:11.513152 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-016f3764-6154-4417-a20c-4bf75edef151 tempest-DeleteServersAdminTestJSON-2119063606 tempest-DeleteServersAdminTestJSON-2119063606-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:11.595887 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-016f3764-6154-4417-a20c-4bf75edef151 tempest-DeleteServersAdminTestJSON-2119063606 tempest-DeleteServersAdminTestJSON-2119063606-project-admin] [instance: 6611e099-c1f0-4fed-ba7b-0b096800946d] Going to try to terminate instance {{(pid=140491) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 20:52:11.724772 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-016f3764-6154-4417-a20c-4bf75edef151 tempest-DeleteServersAdminTestJSON-2119063606 tempest-DeleteServersAdminTestJSON-2119063606-project-admin] Acquiring lock "compute-rpcapi-router" {{(pid=140491) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 08 20:52:11.725644 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-016f3764-6154-4417-a20c-4bf75edef151 tempest-DeleteServersAdminTestJSON-2119063606 tempest-DeleteServersAdminTestJSON-2119063606-project-admin] Acquired lock "compute-rpcapi-router" {{(pid=140491) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 08 20:52:11.727286 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c8268771-99aa-4fb3-8017-a129a653c777 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:11.728036 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c8268771-99aa-4fb3-8017-a129a653c777 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:11.728969 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c8268771-99aa-4fb3-8017-a129a653c777 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:11.730193 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c8268771-99aa-4fb3-8017-a129a653c777 None None] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:11.731001 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c8268771-99aa-4fb3-8017-a129a653c777 None None] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:11.731644 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c8268771-99aa-4fb3-8017-a129a653c777 None None] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:11.746937 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.compute.rpcapi [None req-c8268771-99aa-4fb3-8017-a129a653c777 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 08 20:52:11.748105 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c8268771-99aa-4fb3-8017-a129a653c777 None None] Releasing lock "compute-rpcapi-router" {{(pid=140491) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 08 20:52:11.804121 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-c8268771-99aa-4fb3-8017-a129a653c777 None None] 10.222.0.26 "DELETE /compute/v2.1/servers/6611e099-c1f0-4fed-ba7b-0b096800946d" status: 204 len: 0 microversion: 2.1 time: 0.502451 Oct 08 20:52:11.805013 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 97/200] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 20:52:11 2022] DELETE /compute/v2.1/servers/6611e099-c1f0-4fed-ba7b-0b096800946d => generated 0 bytes in 505 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 20:52:11.810987 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-060af888-3d2e-4600-a70f-8436bbe44d22 tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:11.812636 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-060af888-3d2e-4600-a70f-8436bbe44d22 tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] [instance: bbff4ffb-395f-4eeb-a995-60c9c0f39f25] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:52:11.820497 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-060af888-3d2e-4600-a70f-8436bbe44d22 tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:11.821237 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-060af888-3d2e-4600-a70f-8436bbe44d22 tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:11.822312 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-060af888-3d2e-4600-a70f-8436bbe44d22 tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:11.823312 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-060af888-3d2e-4600-a70f-8436bbe44d22 tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:11.824416 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-060af888-3d2e-4600-a70f-8436bbe44d22 tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:11.824932 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-060af888-3d2e-4600-a70f-8436bbe44d22 tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:11.989881 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-060af888-3d2e-4600-a70f-8436bbe44d22 tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8da7d5210cf42bda150d342ff207bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd024396aef784f3291630c426a828cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:11.993580 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:11.998964 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-060af888-3d2e-4600-a70f-8436bbe44d22 tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] 10.222.0.26 "GET /compute/v2.1/servers/bbff4ffb-395f-4eeb-a995-60c9c0f39f25" status: 200 len: 1494 microversion: 2.1 time: 0.192398 Oct 08 20:52:12.000365 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 98/201] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:52:11 2022] GET /compute/v2.1/servers/bbff4ffb-395f-4eeb-a995-60c9c0f39f25 => generated 1494 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:52:12.004931 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-70caa222-7bbe-42b6-8077-ad373ed1f8b8 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:12.005615 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-70caa222-7bbe-42b6-8077-ad373ed1f8b8 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] [instance: 6611e099-c1f0-4fed-ba7b-0b096800946d] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:52:12.014761 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-70caa222-7bbe-42b6-8077-ad373ed1f8b8 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:12.015748 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-70caa222-7bbe-42b6-8077-ad373ed1f8b8 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:12.016190 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-70caa222-7bbe-42b6-8077-ad373ed1f8b8 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:12.016895 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-70caa222-7bbe-42b6-8077-ad373ed1f8b8 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:12.017377 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-70caa222-7bbe-42b6-8077-ad373ed1f8b8 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:12.017802 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-70caa222-7bbe-42b6-8077-ad373ed1f8b8 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:12.181476 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-70caa222-7bbe-42b6-8077-ad373ed1f8b8 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0eb2feb062947e78357b70e832e3edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18029da9b9854f3caf3debd9556f1f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:12.192938 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-70caa222-7bbe-42b6-8077-ad373ed1f8b8 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] 10.222.0.26 "GET /compute/v2.1/servers/6611e099-c1f0-4fed-ba7b-0b096800946d" status: 200 len: 1476 microversion: 2.1 time: 0.190792 Oct 08 20:52:12.205354 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 99/202] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:52:12 2022] GET /compute/v2.1/servers/6611e099-c1f0-4fed-ba7b-0b096800946d => generated 1476 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:52:12.213594 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-b4c4bf06-79f6-482b-b9a0-ce940dfec89f tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] Calling method '.version_select at 0x7f1a8d4a3b80>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:12.268225 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-536db01b-1f2b-4f54-8123-e4f45e392f2c tempest-SecurityGroupsTestAdminJSON-1353376590 tempest-SecurityGroupsTestAdminJSON-1353376590-project-admin] 10.222.0.26 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.768946 Oct 08 20:52:12.268782 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 104/203] 10.222.0.26 () {60 vars in 1180 bytes} [Sat Oct 8 20:52:11 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:52:12.290088 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-f92075c0-133b-4875-9eba-52836da27099 tempest-SecurityGroupsTestAdminJSON-1353376590 tempest-SecurityGroupsTestAdminJSON-1353376590-project-admin] Calling method '.version_select at 0x7f1a8d1adf70>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:12.627886 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-b4c4bf06-79f6-482b-b9a0-ce940dfec89f tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] 10.222.0.26 "GET /compute/v2.1/os-quota-sets/fc20782544f24eb3a49a037ef01e1f8f/defaults" status: 200 len: 371 microversion: 2.1 time: 0.431919 Oct 08 20:52:12.630665 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 100/204] 10.222.0.26 () {58 vars in 1269 bytes} [Sat Oct 8 20:52:12 2022] GET /compute/v2.1/os-quota-sets/fc20782544f24eb3a49a037ef01e1f8f/defaults => generated 371 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:52:12.652179 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-cc3725f3-4ad8-43f9-b368-59dddad11842 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] Action: 'update', calling method: .version_select at 0x7f1a8d4b1b80>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:52:13.062544 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cc3725f3-4ad8-43f9-b368-59dddad11842 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:13.063051 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cc3725f3-4ad8-43f9-b368-59dddad11842 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:13.063499 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cc3725f3-4ad8-43f9-b368-59dddad11842 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:13.064239 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cc3725f3-4ad8-43f9-b368-59dddad11842 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:13.064705 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cc3725f3-4ad8-43f9-b368-59dddad11842 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:13.065135 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cc3725f3-4ad8-43f9-b368-59dddad11842 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:13.120380 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=90,nova_api:DELETE=5,nova_api:UPDATE=2 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:13.398628 ncdv-master-1 devstack@n-api.service[140492]: DEBUG neutronclient.v2_0.client [None req-f92075c0-133b-4875-9eba-52836da27099 tempest-SecurityGroupsTestAdminJSON-1353376590 tempest-SecurityGroupsTestAdminJSON-1353376590-project-admin] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 7b3f2c81-8028-459e-bfbf-a21989db759b does not exist", "detail": ""}} {{(pid=140492) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 08 20:52:13.399988 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.network.security_group_api [None req-f92075c0-133b-4875-9eba-52836da27099 tempest-SecurityGroupsTestAdminJSON-1353376590 tempest-SecurityGroupsTestAdminJSON-1353376590-project-admin] Neutron security group 7b3f2c81-8028-459e-bfbf-a21989db759b not found {{(pid=140492) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 08 20:52:13.400857 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.compute.security_groups [None req-f92075c0-133b-4875-9eba-52836da27099 tempest-SecurityGroupsTestAdminJSON-1353376590 tempest-SecurityGroupsTestAdminJSON-1353376590-project-admin] Security Group ID 7b3f2c81-8028-459e-bfbf-a21989db759b does not exist {{(pid=140492) _format_security_group_rule /opt/stack/nova/nova/api/openstack/compute/security_groups.py:75}} Oct 08 20:52:13.428404 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-cc3725f3-4ad8-43f9-b368-59dddad11842 tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-quota-sets/fc20782544f24eb3a49a037ef01e1f8f" status: 200 len: 329 microversion: 2.1 time: 0.789472 Oct 08 20:52:13.429832 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 101/205] 10.222.0.26 () {60 vars in 1263 bytes} [Sat Oct 8 20:52:12 2022] PUT /compute/v2.1/os-quota-sets/fc20782544f24eb3a49a037ef01e1f8f => generated 329 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:52:13.437328 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-1fe67dfc-ba08-4e56-8826-08e45d4062f3 req-43211bd0-704f-46f0-b8a0-e1cbbbb67714 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbff4ffb-395f-4eeb-a995-60c9c0f39f25", "name": "network-vif-deleted", "tag": "db211159-4f8e-47dc-b398-227f96a1444c"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:52:13.461758 ncdv-master-1 devstack@n-api.service[140492]: DEBUG neutronclient.v2_0.client [None req-f92075c0-133b-4875-9eba-52836da27099 tempest-SecurityGroupsTestAdminJSON-1353376590 tempest-SecurityGroupsTestAdminJSON-1353376590-project-admin] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 7b3f2c81-8028-459e-bfbf-a21989db759b does not exist", "detail": ""}} {{(pid=140492) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 08 20:52:13.462437 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.network.security_group_api [None req-f92075c0-133b-4875-9eba-52836da27099 tempest-SecurityGroupsTestAdminJSON-1353376590 tempest-SecurityGroupsTestAdminJSON-1353376590-project-admin] Neutron security group 7b3f2c81-8028-459e-bfbf-a21989db759b not found {{(pid=140492) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 08 20:52:13.462990 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.compute.security_groups [None req-f92075c0-133b-4875-9eba-52836da27099 tempest-SecurityGroupsTestAdminJSON-1353376590 tempest-SecurityGroupsTestAdminJSON-1353376590-project-admin] Security Group ID 7b3f2c81-8028-459e-bfbf-a21989db759b does not exist {{(pid=140492) _format_security_group_rule /opt/stack/nova/nova/api/openstack/compute/security_groups.py:75}} Oct 08 20:52:13.474853 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-1fe67dfc-ba08-4e56-8826-08e45d4062f3 req-43211bd0-704f-46f0-b8a0-e1cbbbb67714 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:13.476045 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-1fe67dfc-ba08-4e56-8826-08e45d4062f3 req-43211bd0-704f-46f0-b8a0-e1cbbbb67714 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:13.476691 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-1fe67dfc-ba08-4e56-8826-08e45d4062f3 req-43211bd0-704f-46f0-b8a0-e1cbbbb67714 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:13.525997 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-1fe67dfc-ba08-4e56-8826-08e45d4062f3 req-43211bd0-704f-46f0-b8a0-e1cbbbb67714 service nova] Creating event network-vif-deleted:db211159-4f8e-47dc-b398-227f96a1444c for instance bbff4ffb-395f-4eeb-a995-60c9c0f39f25 on nch2-master-1 Oct 08 20:52:13.534680 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-1fe67dfc-ba08-4e56-8826-08e45d4062f3 req-43211bd0-704f-46f0-b8a0-e1cbbbb67714 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103366 Oct 08 20:52:13.535653 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 102/206] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:52:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:52:13.544307 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-dfcd1916-70d7-418a-868f-e1f277c58610 tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:13.545319 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-dfcd1916-70d7-418a-868f-e1f277c58610 tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] [instance: bbff4ffb-395f-4eeb-a995-60c9c0f39f25] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:52:13.555702 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dfcd1916-70d7-418a-868f-e1f277c58610 tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:13.556742 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dfcd1916-70d7-418a-868f-e1f277c58610 tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:13.557832 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dfcd1916-70d7-418a-868f-e1f277c58610 tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:13.559069 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dfcd1916-70d7-418a-868f-e1f277c58610 tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:13.560045 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dfcd1916-70d7-418a-868f-e1f277c58610 tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:13.561057 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dfcd1916-70d7-418a-868f-e1f277c58610 tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:13.580023 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-dfcd1916-70d7-418a-868f-e1f277c58610 tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] HTTP exception thrown: Instance bbff4ffb-395f-4eeb-a995-60c9c0f39f25 could not be found. Oct 08 20:52:13.583292 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-dfcd1916-70d7-418a-868f-e1f277c58610 tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Request method failure captured: Oct 08 20:52:13.583292 ncdv-master-1 devstack@n-api.service[140491]: request: GET /compute/v2.1/servers/bbff4ffb-395f-4eeb-a995-60c9c0f39f25 HTTP/1.1 Oct 08 20:52:13.583292 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 20:52:13.583292 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 20:52:13.583292 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 20:52:13.583292 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 20:52:13.583292 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 20:52:13.583292 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 20:52:13.583292 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 20:52:13.583292 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 20:52:13.583292 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeLVw8wpvZ-O55cbhjgMKZ9dsrUuNQHukJsCUNA8KTiUu29deiTIiRssDs5a9CfiraQDOvzgu1jTjSQWATDh2C_HpElt2Opau-1lJ83aJnS5IXYzMQp83K1mhlzg7lfqj5iARudP1EIO46PJu2l2HF-LTdU5CjWFlJIow9ZKqwTExAE Oct 08 20:52:13.583292 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 20:52:13.583292 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 20:52:13.583292 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 20:52:13.583292 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 20:52:13.583292 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 20:52:13.583292 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 20:52:13.583292 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: d024396aef784f3291630c426a828cf0 Oct 08 20:52:13.583292 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-AggregatesAdminTestJSON-225803517 Oct 08 20:52:13.583292 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 20:52:13.583292 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 20:52:13.584519 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d024396aef784f3291630c426a828cf0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d024396aef784f3291630c426a828cf0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d024396aef784f3291630c426a828cf0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d024396aef784f3291630c426a828cf0"}]}] Oct 08 20:52:13.584519 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-AggregatesAdminTestJSON-225803517 Oct 08 20:52:13.584519 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: d024396aef784f3291630c426a828cf0 Oct 08 20:52:13.584519 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-225803517 Oct 08 20:52:13.584519 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-AggregatesAdminTestJSON-225803517-project Oct 08 20:52:13.584519 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 20:52:13.584519 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 20:52:13.584519 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: d8da7d5210cf42bda150d342ff207bbd Oct 08 20:52:13.584519 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-AggregatesAdminTestJSON-225803517-project Oct 08 20:52:13.584519 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 20:52:13.584519 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance bbff4ffb-395f-4eeb-a995-60c9c0f39f25 could not be found. Oct 08 20:52:13.584519 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': 'bbff4ffb-395f-4eeb-a995-60c9c0f39f25'} Oct 08 20:52:13.585342 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:52:13.585342 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:52:13.585342 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 20:52:13.585342 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 20:52:13.585342 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 20:52:13.585342 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 20:52:13.585342 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 20:52:13.585342 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 20:52:13.585342 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 20:52:13.585342 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 20:52:13.585342 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbff4ffb-395f-4eeb-a995-60c9c0f39f25 could not be found. Oct 08 20:52:13.585342 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:52:13.585342 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:52:13.585342 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:52:13.585342 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:52:13.585342 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:52:13.585342 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:52:13.585342 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:52:13.585342 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:52:13.585342 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:52:13.586923 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:52:13.586923 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 20:52:13.586923 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 20:52:13.586923 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 20:52:13.586923 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 20:52:13.586923 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 20:52:13.586923 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 20:52:13.586923 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbff4ffb-395f-4eeb-a995-60c9c0f39f25 could not be found. Oct 08 20:52:13.586923 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:52:13.586923 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:52:13.586923 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:52:13.586923 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:52:13.586923 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:52:13.586923 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:52:13.586923 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 20:52:13.586923 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 20:52:13.586923 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbff4ffb-395f-4eeb-a995-60c9c0f39f25 could not be found. Oct 08 20:52:13.586923 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:52:13.589347 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-dfcd1916-70d7-418a-868f-e1f277c58610 tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Returning 404 to user: Instance bbff4ffb-395f-4eeb-a995-60c9c0f39f25 could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:52:13.590423 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-dfcd1916-70d7-418a-868f-e1f277c58610 tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] 10.222.0.26 "GET /compute/v2.1/servers/bbff4ffb-395f-4eeb-a995-60c9c0f39f25" status: 404 len: 111 microversion: 2.1 time: 0.053198 Oct 08 20:52:13.591478 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 103/207] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:52:13 2022] GET /compute/v2.1/servers/bbff4ffb-395f-4eeb-a995-60c9c0f39f25 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 20:52:13.599096 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-df7ac251-ea43-4e6a-a2ab-7b76af831c09 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:13.600053 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-df7ac251-ea43-4e6a-a2ab-7b76af831c09 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] [instance: 6611e099-c1f0-4fed-ba7b-0b096800946d] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:52:13.614592 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-df7ac251-ea43-4e6a-a2ab-7b76af831c09 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:13.615401 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-df7ac251-ea43-4e6a-a2ab-7b76af831c09 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:13.618277 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-df7ac251-ea43-4e6a-a2ab-7b76af831c09 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:13.619748 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-df7ac251-ea43-4e6a-a2ab-7b76af831c09 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:13.622461 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-df7ac251-ea43-4e6a-a2ab-7b76af831c09 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:13.623171 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-df7ac251-ea43-4e6a-a2ab-7b76af831c09 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:13.938362 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-df7ac251-ea43-4e6a-a2ab-7b76af831c09 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0eb2feb062947e78357b70e832e3edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18029da9b9854f3caf3debd9556f1f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:13.957091 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-df7ac251-ea43-4e6a-a2ab-7b76af831c09 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] 10.222.0.26 "GET /compute/v2.1/servers/6611e099-c1f0-4fed-ba7b-0b096800946d" status: 200 len: 1476 microversion: 2.1 time: 0.359789 Oct 08 20:52:13.974963 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 104/208] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:52:13 2022] GET /compute/v2.1/servers/6611e099-c1f0-4fed-ba7b-0b096800946d => generated 1476 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:52:13.982099 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-b995b457-ea3b-419c-9b33-a3b2af2d4f7f tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] Action: 'update', calling method: .version_select at 0x7f1a8d4169d0>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:52:14.045233 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-f92075c0-133b-4875-9eba-52836da27099 tempest-SecurityGroupsTestAdminJSON-1353376590 tempest-SecurityGroupsTestAdminJSON-1353376590-project-admin] 10.222.0.26 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 6487 microversion: 2.1 time: 1.767624 Oct 08 20:52:14.047106 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 105/209] 10.222.0.26 () {58 vars in 1191 bytes} [Sat Oct 8 20:52:12 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 6487 bytes in 1770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 20:52:14.051647 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-636f4a05-313f-4e99-a4cd-52ec2a3742fe tempest-AggregatesAdminTestJSON-1599742552 tempest-AggregatesAdminTestJSON-1599742552-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:52:14.070032 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-636f4a05-313f-4e99-a4cd-52ec2a3742fe tempest-AggregatesAdminTestJSON-1599742552 tempest-AggregatesAdminTestJSON-1599742552-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:14.073386 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-636f4a05-313f-4e99-a4cd-52ec2a3742fe tempest-AggregatesAdminTestJSON-1599742552 tempest-AggregatesAdminTestJSON-1599742552-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:14.075331 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-636f4a05-313f-4e99-a4cd-52ec2a3742fe tempest-AggregatesAdminTestJSON-1599742552 tempest-AggregatesAdminTestJSON-1599742552-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:14.352965 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b995b457-ea3b-419c-9b33-a3b2af2d4f7f tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:14.353909 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b995b457-ea3b-419c-9b33-a3b2af2d4f7f tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:14.354724 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b995b457-ea3b-419c-9b33-a3b2af2d4f7f tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:14.355921 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b995b457-ea3b-419c-9b33-a3b2af2d4f7f tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:14.357177 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b995b457-ea3b-419c-9b33-a3b2af2d4f7f tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:14.357943 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b995b457-ea3b-419c-9b33-a3b2af2d4f7f tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:14.658304 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=100 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:14.672134 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=27,nova_api:UPDATE=14 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:14.700031 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-b995b457-ea3b-419c-9b33-a3b2af2d4f7f tempest-QuotasAdminTestJSON-2023385814 tempest-QuotasAdminTestJSON-2023385814-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-quota-sets/fc20782544f24eb3a49a037ef01e1f8f" status: 200 len: 329 microversion: 2.1 time: 0.722586 Oct 08 20:52:14.700608 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 105/210] 10.222.0.26 () {60 vars in 1263 bytes} [Sat Oct 8 20:52:13 2022] PUT /compute/v2.1/os-quota-sets/fc20782544f24eb3a49a037ef01e1f8f => generated 329 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:52:14.724343 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-64b3af0f-63ea-4444-a9d1-e4b48d997f93 tempest-SecurityGroupsTestAdminJSON-361783708 tempest-SecurityGroupsTestAdminJSON-361783708-project] Calling method '.version_select at 0x7f1a8d330940>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:14.851833 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-636f4a05-313f-4e99-a4cd-52ec2a3742fe tempest-AggregatesAdminTestJSON-1599742552 tempest-AggregatesAdminTestJSON-1599742552-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates/5/action" status: 200 len: 300 microversion: 2.1 time: 0.801192 Oct 08 20:52:14.852420 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 106/211] 10.222.0.26 () {60 vars in 1191 bytes} [Sat Oct 8 20:52:14 2022] POST /compute/v2.1/os-aggregates/5/action => generated 300 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:52:14.863237 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-1e63837b-6a92-498f-af7a-855851d4168e req-d54b2603-30d8-4966-bb36-370b775d51b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6611e099-c1f0-4fed-ba7b-0b096800946d", "name": "network-vif-deleted", "tag": "e840762c-aa06-40ad-802b-ac87c05858c5"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:52:14.883209 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-1e63837b-6a92-498f-af7a-855851d4168e req-d54b2603-30d8-4966-bb36-370b775d51b7 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:14.884628 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-1e63837b-6a92-498f-af7a-855851d4168e req-d54b2603-30d8-4966-bb36-370b775d51b7 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:14.885092 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-1e63837b-6a92-498f-af7a-855851d4168e req-d54b2603-30d8-4966-bb36-370b775d51b7 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:14.906837 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-1e63837b-6a92-498f-af7a-855851d4168e req-d54b2603-30d8-4966-bb36-370b775d51b7 service nova] Creating event network-vif-deleted:e840762c-aa06-40ad-802b-ac87c05858c5 for instance 6611e099-c1f0-4fed-ba7b-0b096800946d on nch1-master-1 Oct 08 20:52:14.928362 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-1e63837b-6a92-498f-af7a-855851d4168e req-d54b2603-30d8-4966-bb36-370b775d51b7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074212 Oct 08 20:52:14.931467 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 107/212] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:52:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:52:14.941980 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-683f254f-37ee-4c2b-b19d-0f073277ed82 tempest-AggregatesAdminTestJSON-1599742552 tempest-AggregatesAdminTestJSON-1599742552-project-admin] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:14.975516 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-64b3af0f-63ea-4444-a9d1-e4b48d997f93 tempest-SecurityGroupsTestAdminJSON-361783708 tempest-SecurityGroupsTestAdminJSON-361783708-project] 10.222.0.26 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1111 microversion: 2.1 time: 0.264664 Oct 08 20:52:14.976649 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 106/213] 10.222.0.26 () {58 vars in 1191 bytes} [Sat Oct 8 20:52:14 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1111 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:52:14.986367 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-80546969-f5fe-4713-ba89-27030999008c tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:14.987649 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-80546969-f5fe-4713-ba89-27030999008c tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] [instance: 6611e099-c1f0-4fed-ba7b-0b096800946d] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:52:14.994666 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-80546969-f5fe-4713-ba89-27030999008c tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:14.995402 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-80546969-f5fe-4713-ba89-27030999008c tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:14.995854 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-80546969-f5fe-4713-ba89-27030999008c tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:14.996572 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-80546969-f5fe-4713-ba89-27030999008c tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:14.997242 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-80546969-f5fe-4713-ba89-27030999008c tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:14.997832 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-80546969-f5fe-4713-ba89-27030999008c tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:15.000788 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-683f254f-37ee-4c2b-b19d-0f073277ed82 tempest-AggregatesAdminTestJSON-1599742552 tempest-AggregatesAdminTestJSON-1599742552-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.066530 Oct 08 20:52:15.001712 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 108/214] 10.222.0.26 () {58 vars in 1152 bytes} [Sat Oct 8 20:52:14 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 08 20:52:15.006624 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-1bcad25e-a2ca-417f-b07c-3816fbb11c5a tempest-SecurityGroupsTestAdminJSON-1353376590 tempest-SecurityGroupsTestAdminJSON-1353376590-project-admin] Calling method '.version_select at 0x7f1a8d1ad4c0>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:15.020298 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-80546969-f5fe-4713-ba89-27030999008c tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] HTTP exception thrown: Instance 6611e099-c1f0-4fed-ba7b-0b096800946d could not be found. Oct 08 20:52:15.022301 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-80546969-f5fe-4713-ba89-27030999008c tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Request method failure captured: Oct 08 20:52:15.022301 ncdv-master-1 devstack@n-api.service[140491]: request: GET /compute/v2.1/servers/6611e099-c1f0-4fed-ba7b-0b096800946d HTTP/1.1 Oct 08 20:52:15.022301 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 20:52:15.022301 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 20:52:15.022301 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 20:52:15.022301 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 20:52:15.022301 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 20:52:15.022301 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 20:52:15.022301 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 20:52:15.022301 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 20:52:15.022301 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeLd0unx4H4zm5ydlZfB7yl3H_ct2Abk1aIr5-N5ApC0qVozlM98eKylBjK6CJEr54w2-JCYaqPAe9Igew1wbTL4pDf1jaTQih3wPvBIIdGIcXOQxpHK-t_RMUrbajWwzLh6FCYlyF7A2TJ605Rb1BV9Z9MY7Re28E-Jju-YwTNbhf8 Oct 08 20:52:15.022301 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 20:52:15.022301 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 20:52:15.022301 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 20:52:15.022301 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 20:52:15.022301 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 20:52:15.022301 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 20:52:15.022301 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 18029da9b9854f3caf3debd9556f1f24 Oct 08 20:52:15.022301 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-DeleteServersAdminTestJSON-802999185 Oct 08 20:52:15.022301 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 20:52:15.022301 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 20:52:15.023502 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/18029da9b9854f3caf3debd9556f1f24"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/18029da9b9854f3caf3debd9556f1f24"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_18029da9b9854f3caf3debd9556f1f24"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/18029da9b9854f3caf3debd9556f1f24"}]}] Oct 08 20:52:15.023502 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-DeleteServersAdminTestJSON-802999185 Oct 08 20:52:15.023502 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 18029da9b9854f3caf3debd9556f1f24 Oct 08 20:52:15.023502 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-802999185 Oct 08 20:52:15.023502 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-DeleteServersAdminTestJSON-802999185-project Oct 08 20:52:15.023502 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 20:52:15.023502 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 20:52:15.023502 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: c0eb2feb062947e78357b70e832e3edc Oct 08 20:52:15.023502 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-DeleteServersAdminTestJSON-802999185-project Oct 08 20:52:15.023502 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 20:52:15.023502 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance 6611e099-c1f0-4fed-ba7b-0b096800946d could not be found. Oct 08 20:52:15.023502 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': '6611e099-c1f0-4fed-ba7b-0b096800946d'} Oct 08 20:52:15.024173 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:52:15.024173 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:52:15.024173 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 20:52:15.024173 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 20:52:15.024173 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 20:52:15.024173 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 20:52:15.024173 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 20:52:15.024173 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 20:52:15.024173 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 20:52:15.024173 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 20:52:15.024173 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6611e099-c1f0-4fed-ba7b-0b096800946d could not be found. Oct 08 20:52:15.024173 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:52:15.024173 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:52:15.024173 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:52:15.024173 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:52:15.024173 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:52:15.024173 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:52:15.024173 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:52:15.024173 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:52:15.024173 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:52:15.025230 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:52:15.025230 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 20:52:15.025230 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 20:52:15.025230 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 20:52:15.025230 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 20:52:15.025230 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 20:52:15.025230 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 20:52:15.025230 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6611e099-c1f0-4fed-ba7b-0b096800946d could not be found. Oct 08 20:52:15.025230 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:52:15.025230 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:52:15.025230 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:52:15.025230 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:52:15.025230 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:52:15.025230 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:52:15.025230 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 20:52:15.025230 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 20:52:15.025230 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6611e099-c1f0-4fed-ba7b-0b096800946d could not be found. Oct 08 20:52:15.025230 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:52:15.027502 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-80546969-f5fe-4713-ba89-27030999008c tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Returning 404 to user: Instance 6611e099-c1f0-4fed-ba7b-0b096800946d could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:52:15.028810 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-80546969-f5fe-4713-ba89-27030999008c tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] 10.222.0.26 "GET /compute/v2.1/servers/6611e099-c1f0-4fed-ba7b-0b096800946d" status: 404 len: 111 microversion: 2.1 time: 0.048837 Oct 08 20:52:15.029905 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 107/215] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:52:14 2022] GET /compute/v2.1/servers/6611e099-c1f0-4fed-ba7b-0b096800946d => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 08 20:52:15.037820 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-bea2b812-2c8e-44ce-81d5-865fe435c8d9 tempest-AggregatesAdminTestJSON-1599742552 tempest-AggregatesAdminTestJSON-1599742552-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-186224187"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:52:15.042538 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.objects.aggregate [None req-bea2b812-2c8e-44ce-81d5-865fe435c8d9 tempest-AggregatesAdminTestJSON-1599742552 tempest-AggregatesAdminTestJSON-1599742552-project-admin] Generated uuid 0441750e-8119-4c09-a07e-4840f61e00f5 for aggregate {{(pid=140491) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 08 20:52:15.070501 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-bea2b812-2c8e-44ce-81d5-865fe435c8d9 tempest-AggregatesAdminTestJSON-1599742552 tempest-AggregatesAdminTestJSON-1599742552-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.039396 Oct 08 20:52:15.071156 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 108/216] 10.222.0.26 () {60 vars in 1164 bytes} [Sat Oct 8 20:52:15 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:52:15.086686 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-63fee225-5bbf-48fd-8eac-bdbf8caf9a3f tempest-AggregatesAdminTestJSON-1599742552 tempest-AggregatesAdminTestJSON-1599742552-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:52:15.102646 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-63fee225-5bbf-48fd-8eac-bdbf8caf9a3f tempest-AggregatesAdminTestJSON-1599742552 tempest-AggregatesAdminTestJSON-1599742552-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:15.103100 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-63fee225-5bbf-48fd-8eac-bdbf8caf9a3f tempest-AggregatesAdminTestJSON-1599742552 tempest-AggregatesAdminTestJSON-1599742552-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:15.103564 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-63fee225-5bbf-48fd-8eac-bdbf8caf9a3f tempest-AggregatesAdminTestJSON-1599742552 tempest-AggregatesAdminTestJSON-1599742552-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:15.223578 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-1bcad25e-a2ca-417f-b07c-3816fbb11c5a tempest-SecurityGroupsTestAdminJSON-1353376590 tempest-SecurityGroupsTestAdminJSON-1353376590-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/189f2ff1-b9ca-4b57-aef6-31b4527de21c" status: 202 len: 0 microversion: 2.1 time: 0.220698 Oct 08 20:52:15.224610 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 109/217] 10.222.0.26 () {58 vars in 1272 bytes} [Sat Oct 8 20:52:15 2022] DELETE /compute/v2.1/os-security-groups/189f2ff1-b9ca-4b57-aef6-31b4527de21c => generated 0 bytes in 222 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 20:52:15.232724 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-dec32c4b-d349-463f-9235-36ddcfa30ed6 tempest-SecurityGroupsTestAdminJSON-1353376590 tempest-SecurityGroupsTestAdminJSON-1353376590-project-admin] Calling method '.version_select at 0x7f1a8d1b5d30>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:15.284239 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-63fee225-5bbf-48fd-8eac-bdbf8caf9a3f tempest-AggregatesAdminTestJSON-1599742552 tempest-AggregatesAdminTestJSON-1599742552-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 241 microversion: 2.1 time: 0.204817 Oct 08 20:52:15.285026 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 109/218] 10.222.0.26 () {60 vars in 1191 bytes} [Sat Oct 8 20:52:15 2022] POST /compute/v2.1/os-aggregates/9/action => generated 241 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:52:15.298885 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-94e1a378-f3d0-4452-8903-bd1cb0c3765d tempest-AggregatesAdminTestJSON-1599742552 tempest-AggregatesAdminTestJSON-1599742552-project-admin] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:15.317770 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-94e1a378-f3d0-4452-8903-bd1cb0c3765d tempest-AggregatesAdminTestJSON-1599742552 tempest-AggregatesAdminTestJSON-1599742552-project-admin] 10.222.0.26 "GET /compute/v2.1/os-aggregates/9" status: 200 len: 241 microversion: 2.1 time: 0.024836 Oct 08 20:52:15.318348 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 110/219] 10.222.0.26 () {58 vars in 1149 bytes} [Sat Oct 8 20:52:15 2022] GET /compute/v2.1/os-aggregates/9 => generated 241 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:52:15.339486 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-baf1db19-46d3-443c-8f63-5ecf9cc1a2eb tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-8144488", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:52:15.409925 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.network.neutron [None req-baf1db19-46d3-443c-8f63-5ecf9cc1a2eb tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] validate_networks() for None {{(pid=140491) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 20:52:15.480162 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-dec32c4b-d349-463f-9235-36ddcfa30ed6 tempest-SecurityGroupsTestAdminJSON-1353376590 tempest-SecurityGroupsTestAdminJSON-1353376590-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/59ff5c96-2f63-484f-aede-6e745fc01570" status: 202 len: 0 microversion: 2.1 time: 0.251156 Oct 08 20:52:15.480813 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 110/220] 10.222.0.26 () {58 vars in 1272 bytes} [Sat Oct 8 20:52:15 2022] DELETE /compute/v2.1/os-security-groups/59ff5c96-2f63-484f-aede-6e745fc01570 => generated 0 bytes in 253 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 08 20:52:15.491552 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-92cbd957-c217-42e8-b274-95275ce404b1 tempest-AggregatesAdminTestJSON-1599742552 tempest-AggregatesAdminTestJSON-1599742552-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:52:15.519346 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-92cbd957-c217-42e8-b274-95275ce404b1 tempest-AggregatesAdminTestJSON-1599742552 tempest-AggregatesAdminTestJSON-1599742552-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:15.519842 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-92cbd957-c217-42e8-b274-95275ce404b1 tempest-AggregatesAdminTestJSON-1599742552 tempest-AggregatesAdminTestJSON-1599742552-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:15.520279 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-92cbd957-c217-42e8-b274-95275ce404b1 tempest-AggregatesAdminTestJSON-1599742552 tempest-AggregatesAdminTestJSON-1599742552-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:15.659214 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-92cbd957-c217-42e8-b274-95275ce404b1 tempest-AggregatesAdminTestJSON-1599742552 tempest-AggregatesAdminTestJSON-1599742552-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 226 microversion: 2.1 time: 0.173603 Oct 08 20:52:15.659908 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 111/221] 10.222.0.26 () {60 vars in 1191 bytes} [Sat Oct 8 20:52:15 2022] POST /compute/v2.1/os-aggregates/9/action => generated 226 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:52:15.664793 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-0bc56430-6791-4804-b7ad-3494ca5b4b40 tempest-SecurityGroupsTestAdminJSON-361783708 tempest-SecurityGroupsTestAdminJSON-361783708-project] Calling method '.version_select at 0x7f1a8d1b5b80>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:15.716097 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-baf1db19-46d3-443c-8f63-5ecf9cc1a2eb tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Flavor limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 20:52:15.716862 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-baf1db19-46d3-443c-8f63-5ecf9cc1a2eb tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Image limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 20:52:15.717001 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-baf1db19-46d3-443c-8f63-5ecf9cc1a2eb tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Flavor pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 20:52:15.717434 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-baf1db19-46d3-443c-8f63-5ecf9cc1a2eb tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Image pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 20:52:15.717845 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-baf1db19-46d3-443c-8f63-5ecf9cc1a2eb tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 20:52:15.728083 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-baf1db19-46d3-443c-8f63-5ecf9cc1a2eb tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:15.728762 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-baf1db19-46d3-443c-8f63-5ecf9cc1a2eb tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:15.729475 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-baf1db19-46d3-443c-8f63-5ecf9cc1a2eb tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:15.730296 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-baf1db19-46d3-443c-8f63-5ecf9cc1a2eb tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:15.731026 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-baf1db19-46d3-443c-8f63-5ecf9cc1a2eb tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:15.731712 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-baf1db19-46d3-443c-8f63-5ecf9cc1a2eb tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:15.751903 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-baf1db19-46d3-443c-8f63-5ecf9cc1a2eb tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Getting quotas for project 18029da9b9854f3caf3debd9556f1f24. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 20:52:15.757515 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-baf1db19-46d3-443c-8f63-5ecf9cc1a2eb tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Getting quotas for user c0eb2feb062947e78357b70e832e3edc and project 18029da9b9854f3caf3debd9556f1f24. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 20:52:15.776024 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-baf1db19-46d3-443c-8f63-5ecf9cc1a2eb tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Going to run 1 instances... {{(pid=140491) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 20:52:15.778700 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-baf1db19-46d3-443c-8f63-5ecf9cc1a2eb tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] [instance: 800ffcdf-e494-44df-97db-1c7fc74f97b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c508bd7f-7db9-4b2c-af7c-be54a855c355',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140491) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 20:52:15.875196 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-baf1db19-46d3-443c-8f63-5ecf9cc1a2eb tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.552946 Oct 08 20:52:15.875776 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 111/222] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 20:52:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 555 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 08 20:52:15.979459 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-0bc56430-6791-4804-b7ad-3494ca5b4b40 tempest-SecurityGroupsTestAdminJSON-361783708 tempest-SecurityGroupsTestAdminJSON-361783708-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/8c9f464c-1d9a-4228-86ee-9c5768ac16d2" status: 202 len: 0 microversion: 2.1 time: 0.317920 Oct 08 20:52:15.980557 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 112/223] 10.222.0.26 () {58 vars in 1272 bytes} [Sat Oct 8 20:52:15 2022] DELETE /compute/v2.1/os-security-groups/8c9f464c-1d9a-4228-86ee-9c5768ac16d2 => generated 0 bytes in 320 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 20:52:15.986261 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-3a1bb915-fd18-46f3-8782-73630999dbad tempest-AggregatesAdminTestJSON-1599742552 tempest-AggregatesAdminTestJSON-1599742552-project-admin] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:16.039184 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-3a1bb915-fd18-46f3-8782-73630999dbad tempest-AggregatesAdminTestJSON-1599742552 tempest-AggregatesAdminTestJSON-1599742552-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.057372 Oct 08 20:52:16.039875 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 113/224] 10.222.0.26 () {58 vars in 1152 bytes} [Sat Oct 8 20:52:15 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 08 20:52:16.051530 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-ab843e83-4029-43df-a3d0-249a1b32b056 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:16.052736 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-ab843e83-4029-43df-a3d0-249a1b32b056 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] [instance: 800ffcdf-e494-44df-97db-1c7fc74f97b6] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:52:16.130875 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-ab843e83-4029-43df-a3d0-249a1b32b056 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0eb2feb062947e78357b70e832e3edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18029da9b9854f3caf3debd9556f1f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:16.145392 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-ab843e83-4029-43df-a3d0-249a1b32b056 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] 10.222.0.26 "GET /compute/v2.1/servers/800ffcdf-e494-44df-97db-1c7fc74f97b6" status: 200 len: 1217 microversion: 2.1 time: 0.104257 Oct 08 20:52:16.149680 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 114/225] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:52:16 2022] GET /compute/v2.1/servers/800ffcdf-e494-44df-97db-1c7fc74f97b6 => generated 1217 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:52:16.161866 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-3f32dd88-d347-45cd-b2de-c4f641c86dac tempest-SecurityGroupsTestAdminJSON-361783708 tempest-SecurityGroupsTestAdminJSON-361783708-project] Calling method '.version_select at 0x7f1a8d3534c0>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:16.162737 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-d835f4d0-c569-438d-a40b-c183fdf68eb6 tempest-QuotasAdminTestV236-1267176834 tempest-QuotasAdminTestV236-1267176834-project-admin] Action: 'update', calling method: .version_select at 0x7f1a8d31d790>, body: {"quota_set": {"ram": "5120"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:52:16.268181 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d835f4d0-c569-438d-a40b-c183fdf68eb6 tempest-QuotasAdminTestV236-1267176834 tempest-QuotasAdminTestV236-1267176834-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:16.268670 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d835f4d0-c569-438d-a40b-c183fdf68eb6 tempest-QuotasAdminTestV236-1267176834 tempest-QuotasAdminTestV236-1267176834-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:16.269257 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d835f4d0-c569-438d-a40b-c183fdf68eb6 tempest-QuotasAdminTestV236-1267176834 tempest-QuotasAdminTestV236-1267176834-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:16.269871 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d835f4d0-c569-438d-a40b-c183fdf68eb6 tempest-QuotasAdminTestV236-1267176834 tempest-QuotasAdminTestV236-1267176834-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:16.271004 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d835f4d0-c569-438d-a40b-c183fdf68eb6 tempest-QuotasAdminTestV236-1267176834 tempest-QuotasAdminTestV236-1267176834-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:16.271339 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d835f4d0-c569-438d-a40b-c183fdf68eb6 tempest-QuotasAdminTestV236-1267176834 tempest-QuotasAdminTestV236-1267176834-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:16.369421 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-d835f4d0-c569-438d-a40b-c183fdf68eb6 tempest-QuotasAdminTestV236-1267176834 tempest-QuotasAdminTestV236-1267176834-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-quota-sets/2599b63499b549eb96e3a5bac0f83b91" status: 200 len: 240 microversion: 2.36 time: 0.492473 Oct 08 20:52:16.370909 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 112/226] 10.222.0.26 () {62 vars in 1303 bytes} [Sat Oct 8 20:52:15 2022] PUT /compute/v2.1/os-quota-sets/2599b63499b549eb96e3a5bac0f83b91 => generated 240 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 08 20:52:16.380773 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-09b68704-1d19-498e-8c4f-6f19aef88469 tempest-AggregatesAdminTestJSON-1599742552 tempest-AggregatesAdminTestJSON-1599742552-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-489207924"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:52:16.386133 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.objects.aggregate [None req-09b68704-1d19-498e-8c4f-6f19aef88469 tempest-AggregatesAdminTestJSON-1599742552 tempest-AggregatesAdminTestJSON-1599742552-project-admin] Generated uuid 76d4904e-2f4b-48f7-bb38-bcd265895ac1 for aggregate {{(pid=140491) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 08 20:52:16.414635 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-09b68704-1d19-498e-8c4f-6f19aef88469 tempest-AggregatesAdminTestJSON-1599742552 tempest-AggregatesAdminTestJSON-1599742552-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.042053 Oct 08 20:52:16.415733 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 113/227] 10.222.0.26 () {60 vars in 1164 bytes} [Sat Oct 8 20:52:16 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:52:16.471222 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-3f32dd88-d347-45cd-b2de-c4f641c86dac tempest-SecurityGroupsTestAdminJSON-361783708 tempest-SecurityGroupsTestAdminJSON-361783708-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/36a873a8-394d-4898-a460-ab0a32804160" status: 202 len: 0 microversion: 2.1 time: 0.320251 Oct 08 20:52:16.472637 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 115/228] 10.222.0.26 () {58 vars in 1272 bytes} [Sat Oct 8 20:52:16 2022] DELETE /compute/v2.1/os-security-groups/36a873a8-394d-4898-a460-ab0a32804160 => generated 0 bytes in 322 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 20:52:16.482723 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-c7140211-2767-45b9-9933-47b0b904c7c2 tempest-QuotasAdminTestV236-1267176834 tempest-QuotasAdminTestV236-1267176834-project-admin] Calling method '.version_select at 0x7f1a8d1263a0>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:16.647980 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-911d3cc2-840f-4fdc-9231-e7ad2e52266f tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-1394747071", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "networks": "none"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:52:16.751027 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-911d3cc2-840f-4fdc-9231-e7ad2e52266f tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Flavor limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 20:52:16.755054 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-911d3cc2-840f-4fdc-9231-e7ad2e52266f tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Image limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 20:52:16.756876 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-911d3cc2-840f-4fdc-9231-e7ad2e52266f tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Flavor pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 20:52:16.757416 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-911d3cc2-840f-4fdc-9231-e7ad2e52266f tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Image pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 20:52:16.758091 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-911d3cc2-840f-4fdc-9231-e7ad2e52266f tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 20:52:16.771631 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-911d3cc2-840f-4fdc-9231-e7ad2e52266f tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:16.772478 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-911d3cc2-840f-4fdc-9231-e7ad2e52266f tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:16.773846 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-911d3cc2-840f-4fdc-9231-e7ad2e52266f tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:16.774794 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-911d3cc2-840f-4fdc-9231-e7ad2e52266f tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:16.775692 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-911d3cc2-840f-4fdc-9231-e7ad2e52266f tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:16.776372 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-911d3cc2-840f-4fdc-9231-e7ad2e52266f tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:16.828215 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-911d3cc2-840f-4fdc-9231-e7ad2e52266f tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Getting quotas for project 16530e0f2f0a4d23918261c9e21f9784. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 20:52:16.834136 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-911d3cc2-840f-4fdc-9231-e7ad2e52266f tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Getting quotas for user 2cb78cce5f7c4c348045745f40b13129 and project 16530e0f2f0a4d23918261c9e21f9784. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 20:52:16.849223 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-911d3cc2-840f-4fdc-9231-e7ad2e52266f tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Going to run 1 instances... {{(pid=140491) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 20:52:16.851496 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-911d3cc2-840f-4fdc-9231-e7ad2e52266f tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] [instance: 1af12bcb-5e2a-4c15-8673-fa41701cb4c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c508bd7f-7db9-4b2c-af7c-be54a855c355',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140491) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 20:52:16.928256 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-911d3cc2-840f-4fdc-9231-e7ad2e52266f tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.511303 Oct 08 20:52:16.933781 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 114/229] 10.222.0.26 () {62 vars in 1188 bytes} [Sat Oct 8 20:52:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 516 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 08 20:52:16.945871 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-e723a25d-4e58-49d0-bb4a-05f778460403 tempest-AggregatesAdminTestJSON-1599742552 tempest-AggregatesAdminTestJSON-1599742552-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:52:16.958661 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e723a25d-4e58-49d0-bb4a-05f778460403 tempest-AggregatesAdminTestJSON-1599742552 tempest-AggregatesAdminTestJSON-1599742552-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:16.959160 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e723a25d-4e58-49d0-bb4a-05f778460403 tempest-AggregatesAdminTestJSON-1599742552 tempest-AggregatesAdminTestJSON-1599742552-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:16.959600 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e723a25d-4e58-49d0-bb4a-05f778460403 tempest-AggregatesAdminTestJSON-1599742552 tempest-AggregatesAdminTestJSON-1599742552-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:17.208438 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-e723a25d-4e58-49d0-bb4a-05f778460403 tempest-AggregatesAdminTestJSON-1599742552 tempest-AggregatesAdminTestJSON-1599742552-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 242 microversion: 2.1 time: 0.274724 Oct 08 20:52:17.210807 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 115/230] 10.222.0.26 () {60 vars in 1194 bytes} [Sat Oct 8 20:52:16 2022] POST /compute/v2.1/os-aggregates/10/action => generated 242 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:52:17.227238 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-45bcf8ba-6bd7-4817-9695-210f40a94410 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:52:17.231118 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-45bcf8ba-6bd7-4817-9695-210f40a94410 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] [instance: 1af12bcb-5e2a-4c15-8673-fa41701cb4c7] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:52:17.253348 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c7140211-2767-45b9-9933-47b0b904c7c2 tempest-QuotasAdminTestV236-1267176834 tempest-QuotasAdminTestV236-1267176834-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:17.253856 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c7140211-2767-45b9-9933-47b0b904c7c2 tempest-QuotasAdminTestV236-1267176834 tempest-QuotasAdminTestV236-1267176834-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:17.257007 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c7140211-2767-45b9-9933-47b0b904c7c2 tempest-QuotasAdminTestV236-1267176834 tempest-QuotasAdminTestV236-1267176834-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:17.260234 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c7140211-2767-45b9-9933-47b0b904c7c2 tempest-QuotasAdminTestV236-1267176834 tempest-QuotasAdminTestV236-1267176834-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:17.262013 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c7140211-2767-45b9-9933-47b0b904c7c2 tempest-QuotasAdminTestV236-1267176834 tempest-QuotasAdminTestV236-1267176834-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:17.262490 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c7140211-2767-45b9-9933-47b0b904c7c2 tempest-QuotasAdminTestV236-1267176834 tempest-QuotasAdminTestV236-1267176834-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:17.294092 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=30 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:17.327013 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-c7140211-2767-45b9-9933-47b0b904c7c2 tempest-QuotasAdminTestV236-1267176834 tempest-QuotasAdminTestV236-1267176834-project-admin] 10.222.0.26 "GET /compute/v2.1/os-quota-sets/2599b63499b549eb96e3a5bac0f83b91/detail" status: 200 len: 672 microversion: 2.36 time: 0.848046 Oct 08 20:52:17.328572 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 116/231] 10.222.0.26 () {60 vars in 1304 bytes} [Sat Oct 8 20:52:16 2022] GET /compute/v2.1/os-quota-sets/2599b63499b549eb96e3a5bac0f83b91/detail => generated 672 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 08 20:52:17.333528 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-545fd119-e3d2-48c1-a9e4-e3f44406e85f tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:17.334383 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-545fd119-e3d2-48c1-a9e4-e3f44406e85f tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] [instance: 800ffcdf-e494-44df-97db-1c7fc74f97b6] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:52:17.346225 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-545fd119-e3d2-48c1-a9e4-e3f44406e85f tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:17.346894 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-545fd119-e3d2-48c1-a9e4-e3f44406e85f tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:17.347380 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-545fd119-e3d2-48c1-a9e4-e3f44406e85f tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:17.348668 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-545fd119-e3d2-48c1-a9e4-e3f44406e85f tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:17.349407 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-545fd119-e3d2-48c1-a9e4-e3f44406e85f tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:17.350376 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-545fd119-e3d2-48c1-a9e4-e3f44406e85f tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:17.432054 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-45bcf8ba-6bd7-4817-9695-210f40a94410 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb78cce5f7c4c348045745f40b13129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16530e0f2f0a4d23918261c9e21f9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:17.443461 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-45bcf8ba-6bd7-4817-9695-210f40a94410 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cb78cce5f7c4c348045745f40b13129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16530e0f2f0a4d23918261c9e21f9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:17.448067 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-45bcf8ba-6bd7-4817-9695-210f40a94410 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cb78cce5f7c4c348045745f40b13129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16530e0f2f0a4d23918261c9e21f9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:17.455092 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-545fd119-e3d2-48c1-a9e4-e3f44406e85f tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0eb2feb062947e78357b70e832e3edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18029da9b9854f3caf3debd9556f1f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:17.469228 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-45bcf8ba-6bd7-4817-9695-210f40a94410 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] 10.222.0.26 "PUT /compute/v2.1/servers/1af12bcb-5e2a-4c15-8673-fa41701cb4c7" status: 200 len: 1359 microversion: 2.75 time: 0.255708 Oct 08 20:52:17.469567 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-545fd119-e3d2-48c1-a9e4-e3f44406e85f tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] 10.222.0.26 "GET /compute/v2.1/servers/800ffcdf-e494-44df-97db-1c7fc74f97b6" status: 200 len: 1269 microversion: 2.1 time: 0.139600 Oct 08 20:52:17.486264 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 116/232] 10.222.0.26 () {62 vars in 1297 bytes} [Sat Oct 8 20:52:17 2022] PUT /compute/v2.1/servers/1af12bcb-5e2a-4c15-8673-fa41701cb4c7 => generated 1359 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:52:17.486264 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-9d801611-7b5c-4de5-a1a5-8361f149a8a3 tempest-AggregatesAdminTestJSON-1599742552 tempest-AggregatesAdminTestJSON-1599742552-project-admin] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:17.501530 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 117/233] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:52:17 2022] GET /compute/v2.1/servers/800ffcdf-e494-44df-97db-1c7fc74f97b6 => generated 1269 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:52:17.501660 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-9d801611-7b5c-4de5-a1a5-8361f149a8a3 tempest-AggregatesAdminTestJSON-1599742552 tempest-AggregatesAdminTestJSON-1599742552-project-admin] 10.222.0.26 "GET /compute/v2.1/os-aggregates" status: 200 len: 245 microversion: 2.1 time: 0.026671 Oct 08 20:52:17.509660 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e7591485-dfd1-4cbe-93da-d19fd7f750c2 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:17.510867 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-e7591485-dfd1-4cbe-93da-d19fd7f750c2 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] [instance: 1af12bcb-5e2a-4c15-8673-fa41701cb4c7] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:52:17.523341 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 117/234] 10.222.0.26 () {58 vars in 1143 bytes} [Sat Oct 8 20:52:17 2022] GET /compute/v2.1/os-aggregates => generated 245 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:52:17.528422 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-acad8cb2-ade3-44ad-a7a5-a50ba2d4a29f tempest-AggregatesAdminTestJSON-1599742552 tempest-AggregatesAdminTestJSON-1599742552-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:52:17.553303 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-acad8cb2-ade3-44ad-a7a5-a50ba2d4a29f tempest-AggregatesAdminTestJSON-1599742552 tempest-AggregatesAdminTestJSON-1599742552-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:17.553809 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-acad8cb2-ade3-44ad-a7a5-a50ba2d4a29f tempest-AggregatesAdminTestJSON-1599742552 tempest-AggregatesAdminTestJSON-1599742552-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:17.554255 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-acad8cb2-ade3-44ad-a7a5-a50ba2d4a29f tempest-AggregatesAdminTestJSON-1599742552 tempest-AggregatesAdminTestJSON-1599742552-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:17.617304 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-e7591485-dfd1-4cbe-93da-d19fd7f750c2 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb78cce5f7c4c348045745f40b13129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16530e0f2f0a4d23918261c9e21f9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:17.634028 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-e7591485-dfd1-4cbe-93da-d19fd7f750c2 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cb78cce5f7c4c348045745f40b13129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16530e0f2f0a4d23918261c9e21f9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:17.635969 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-e7591485-dfd1-4cbe-93da-d19fd7f750c2 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cb78cce5f7c4c348045745f40b13129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16530e0f2f0a4d23918261c9e21f9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:17.648830 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-e7591485-dfd1-4cbe-93da-d19fd7f750c2 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] 10.222.0.26 "GET /compute/v2.1/servers/1af12bcb-5e2a-4c15-8673-fa41701cb4c7" status: 200 len: 1359 microversion: 2.75 time: 0.145583 Oct 08 20:52:17.649810 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 118/235] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:52:17 2022] GET /compute/v2.1/servers/1af12bcb-5e2a-4c15-8673-fa41701cb4c7 => generated 1359 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:52:17.743683 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-acad8cb2-ade3-44ad-a7a5-a50ba2d4a29f tempest-AggregatesAdminTestJSON-1599742552 tempest-AggregatesAdminTestJSON-1599742552-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 227 microversion: 2.1 time: 0.219158 Oct 08 20:52:17.747894 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 118/236] 10.222.0.26 () {60 vars in 1194 bytes} [Sat Oct 8 20:52:17 2022] POST /compute/v2.1/os-aggregates/10/action => generated 227 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:52:17.755966 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e71eee20-6011-4bcb-afe6-97587f14f8e6 tempest-AggregatesAdminTestJSON-1599742552 tempest-AggregatesAdminTestJSON-1599742552-project-admin] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:17.795759 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-e71eee20-6011-4bcb-afe6-97587f14f8e6 tempest-AggregatesAdminTestJSON-1599742552 tempest-AggregatesAdminTestJSON-1599742552-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.042154 Oct 08 20:52:17.797698 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 119/237] 10.222.0.26 () {58 vars in 1155 bytes} [Sat Oct 8 20:52:17 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 08 20:52:17.808394 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-86a96ee9-418d-4096-9d1e-41fb2ca65f68 tempest-AggregatesAdminTestJSON-1599742552 tempest-AggregatesAdminTestJSON-1599742552-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-253041151"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:52:17.813012 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.objects.aggregate [None req-86a96ee9-418d-4096-9d1e-41fb2ca65f68 tempest-AggregatesAdminTestJSON-1599742552 tempest-AggregatesAdminTestJSON-1599742552-project-admin] Generated uuid 134d57ab-0512-449f-8d0a-97d927f06952 for aggregate {{(pid=140491) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 08 20:52:17.822451 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=12,nova_api:DELETE=1 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:17.845662 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-86a96ee9-418d-4096-9d1e-41fb2ca65f68 tempest-AggregatesAdminTestJSON-1599742552 tempest-AggregatesAdminTestJSON-1599742552-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.041189 Oct 08 20:52:17.846930 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 119/238] 10.222.0.26 () {60 vars in 1164 bytes} [Sat Oct 8 20:52:17 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:52:17.864300 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-08865faa-1951-450d-a0da-77705c87fae0 tempest-AggregatesAdminTestJSON-1599742552 tempest-AggregatesAdminTestJSON-1599742552-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:52:17.882298 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-08865faa-1951-450d-a0da-77705c87fae0 tempest-AggregatesAdminTestJSON-1599742552 tempest-AggregatesAdminTestJSON-1599742552-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:17.882888 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-08865faa-1951-450d-a0da-77705c87fae0 tempest-AggregatesAdminTestJSON-1599742552 tempest-AggregatesAdminTestJSON-1599742552-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:17.883648 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-08865faa-1951-450d-a0da-77705c87fae0 tempest-AggregatesAdminTestJSON-1599742552 tempest-AggregatesAdminTestJSON-1599742552-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:17.957489 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-87960a17-a6ba-4510-a7dd-9a81ee24d707 tempest-QuotasAdminTestV236-1267176834 tempest-QuotasAdminTestV236-1267176834-project-admin] Action: 'update', calling method: .version_select at 0x7f1a8d330dc0>, body: {"quota_set": {"ram": "2048"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:52:18.066375 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-08865faa-1951-450d-a0da-77705c87fae0 tempest-AggregatesAdminTestJSON-1599742552 tempest-AggregatesAdminTestJSON-1599742552-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 242 microversion: 2.1 time: 0.211746 Oct 08 20:52:18.067292 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 120/239] 10.222.0.26 () {60 vars in 1194 bytes} [Sat Oct 8 20:52:17 2022] POST /compute/v2.1/os-aggregates/11/action => generated 242 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:52:18.083907 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-476a4118-ebf1-4d5e-8d36-6d0bc4144232 tempest-AggregatesAdminTestJSON-1599742552 tempest-AggregatesAdminTestJSON-1599742552-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:52:18.101825 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-476a4118-ebf1-4d5e-8d36-6d0bc4144232 tempest-AggregatesAdminTestJSON-1599742552 tempest-AggregatesAdminTestJSON-1599742552-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:18.102477 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-476a4118-ebf1-4d5e-8d36-6d0bc4144232 tempest-AggregatesAdminTestJSON-1599742552 tempest-AggregatesAdminTestJSON-1599742552-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:18.103100 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-476a4118-ebf1-4d5e-8d36-6d0bc4144232 tempest-AggregatesAdminTestJSON-1599742552 tempest-AggregatesAdminTestJSON-1599742552-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:18.299339 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-476a4118-ebf1-4d5e-8d36-6d0bc4144232 tempest-AggregatesAdminTestJSON-1599742552 tempest-AggregatesAdminTestJSON-1599742552-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 227 microversion: 2.1 time: 0.222931 Oct 08 20:52:18.303162 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 121/240] 10.222.0.26 () {60 vars in 1194 bytes} [Sat Oct 8 20:52:18 2022] POST /compute/v2.1/os-aggregates/11/action => generated 227 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:52:18.323977 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-2483e6f9-b7c2-4814-bf1d-594549d85aa5 tempest-AggregatesAdminTestJSON-1599742552 tempest-AggregatesAdminTestJSON-1599742552-project-admin] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:18.384326 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-2483e6f9-b7c2-4814-bf1d-594549d85aa5 tempest-AggregatesAdminTestJSON-1599742552 tempest-AggregatesAdminTestJSON-1599742552-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.074022 Oct 08 20:52:18.386204 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 122/241] 10.222.0.26 () {58 vars in 1155 bytes} [Sat Oct 8 20:52:18 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Oct 08 20:52:18.400217 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-5e042a20-9682-43da-9c57-501e4d986a4f tempest-AggregatesAdminTestJSON-1599742552 tempest-AggregatesAdminTestJSON-1599742552-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2036395108"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:52:18.403857 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.objects.aggregate [None req-5e042a20-9682-43da-9c57-501e4d986a4f tempest-AggregatesAdminTestJSON-1599742552 tempest-AggregatesAdminTestJSON-1599742552-project-admin] Generated uuid 2db16707-e210-4055-bfa1-99e8de0d5358 for aggregate {{(pid=140492) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 08 20:52:18.438938 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-5e042a20-9682-43da-9c57-501e4d986a4f tempest-AggregatesAdminTestJSON-1599742552 tempest-AggregatesAdminTestJSON-1599742552-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.042502 Oct 08 20:52:18.439830 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 123/242] 10.222.0.26 () {60 vars in 1164 bytes} [Sat Oct 8 20:52:18 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:52:18.445229 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-6ded8275-e3dd-4dea-bf77-58dec604286e tempest-HostsAdminTestJSON-169666208 tempest-HostsAdminTestJSON-169666208-project-admin] Calling method '.version_select at 0x7f1a8d1ad160>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:18.451514 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6ded8275-e3dd-4dea-bf77-58dec604286e tempest-HostsAdminTestJSON-169666208 tempest-HostsAdminTestJSON-169666208-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:18.452390 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6ded8275-e3dd-4dea-bf77-58dec604286e tempest-HostsAdminTestJSON-169666208 tempest-HostsAdminTestJSON-169666208-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:18.453623 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6ded8275-e3dd-4dea-bf77-58dec604286e tempest-HostsAdminTestJSON-169666208 tempest-HostsAdminTestJSON-169666208-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:18.454593 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6ded8275-e3dd-4dea-bf77-58dec604286e tempest-HostsAdminTestJSON-169666208 tempest-HostsAdminTestJSON-169666208-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:18.455535 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6ded8275-e3dd-4dea-bf77-58dec604286e tempest-HostsAdminTestJSON-169666208 tempest-HostsAdminTestJSON-169666208-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:18.456381 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6ded8275-e3dd-4dea-bf77-58dec604286e tempest-HostsAdminTestJSON-169666208 tempest-HostsAdminTestJSON-169666208-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:18.491989 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-6ded8275-e3dd-4dea-bf77-58dec604286e tempest-HostsAdminTestJSON-169666208 tempest-HostsAdminTestJSON-169666208-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hosts" status: 200 len: 379 microversion: 2.1 time: 0.050659 Oct 08 20:52:18.492602 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 124/243] 10.222.0.26 () {58 vars in 1128 bytes} [Sat Oct 8 20:52:18 2022] GET /compute/v2.1/os-hosts => generated 379 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:52:18.497667 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-1b0ff8e0-554f-4c0f-8924-4816732280dd tempest-AggregatesAdminTestJSON-1599742552 tempest-AggregatesAdminTestJSON-1599742552-project-admin] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:18.515561 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-87960a17-a6ba-4510-a7dd-9a81ee24d707 tempest-QuotasAdminTestV236-1267176834 tempest-QuotasAdminTestV236-1267176834-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:18.516054 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-87960a17-a6ba-4510-a7dd-9a81ee24d707 tempest-QuotasAdminTestV236-1267176834 tempest-QuotasAdminTestV236-1267176834-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:18.516662 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-87960a17-a6ba-4510-a7dd-9a81ee24d707 tempest-QuotasAdminTestV236-1267176834 tempest-QuotasAdminTestV236-1267176834-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:18.517599 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-87960a17-a6ba-4510-a7dd-9a81ee24d707 tempest-QuotasAdminTestV236-1267176834 tempest-QuotasAdminTestV236-1267176834-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:18.518314 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-87960a17-a6ba-4510-a7dd-9a81ee24d707 tempest-QuotasAdminTestV236-1267176834 tempest-QuotasAdminTestV236-1267176834-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:18.519971 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-87960a17-a6ba-4510-a7dd-9a81ee24d707 tempest-QuotasAdminTestV236-1267176834 tempest-QuotasAdminTestV236-1267176834-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:18.524735 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-1b0ff8e0-554f-4c0f-8924-4816732280dd tempest-AggregatesAdminTestJSON-1599742552 tempest-AggregatesAdminTestJSON-1599742552-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.030754 Oct 08 20:52:18.525595 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 125/244] 10.222.0.26 () {58 vars in 1155 bytes} [Sat Oct 8 20:52:18 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 08 20:52:18.531517 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-2d6d16e5-c74b-492a-a95e-e029a18d20bf tempest-HostsAdminTestJSON-169666208 tempest-HostsAdminTestJSON-169666208-project-admin] Calling method '.version_select at 0x7f1a8d1bdc10>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:18.535755 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2d6d16e5-c74b-492a-a95e-e029a18d20bf tempest-HostsAdminTestJSON-169666208 tempest-HostsAdminTestJSON-169666208-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:18.536465 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2d6d16e5-c74b-492a-a95e-e029a18d20bf tempest-HostsAdminTestJSON-169666208 tempest-HostsAdminTestJSON-169666208-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:18.537098 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2d6d16e5-c74b-492a-a95e-e029a18d20bf tempest-HostsAdminTestJSON-169666208 tempest-HostsAdminTestJSON-169666208-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:18.538598 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2d6d16e5-c74b-492a-a95e-e029a18d20bf tempest-HostsAdminTestJSON-169666208 tempest-HostsAdminTestJSON-169666208-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:18.539870 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2d6d16e5-c74b-492a-a95e-e029a18d20bf tempest-HostsAdminTestJSON-169666208 tempest-HostsAdminTestJSON-169666208-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:18.540605 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2d6d16e5-c74b-492a-a95e-e029a18d20bf tempest-HostsAdminTestJSON-169666208 tempest-HostsAdminTestJSON-169666208-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:18.572578 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-2d6d16e5-c74b-492a-a95e-e029a18d20bf tempest-HostsAdminTestJSON-169666208 tempest-HostsAdminTestJSON-169666208-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 239 microversion: 2.1 time: 0.045708 Oct 08 20:52:18.573742 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 126/245] 10.222.0.26 () {58 vars in 1155 bytes} [Sat Oct 8 20:52:18 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 239 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:52:18.580852 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-987d416e-0e39-442f-b03c-6c903f31d769 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:18.581802 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-987d416e-0e39-442f-b03c-6c903f31d769 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] [instance: 800ffcdf-e494-44df-97db-1c7fc74f97b6] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:52:18.589504 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-987d416e-0e39-442f-b03c-6c903f31d769 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:18.590269 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-987d416e-0e39-442f-b03c-6c903f31d769 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:18.590922 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-987d416e-0e39-442f-b03c-6c903f31d769 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:18.591862 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-987d416e-0e39-442f-b03c-6c903f31d769 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:18.591995 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-87960a17-a6ba-4510-a7dd-9a81ee24d707 tempest-QuotasAdminTestV236-1267176834 tempest-QuotasAdminTestV236-1267176834-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:18.592601 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-87960a17-a6ba-4510-a7dd-9a81ee24d707 tempest-QuotasAdminTestV236-1267176834 tempest-QuotasAdminTestV236-1267176834-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:18.592873 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-987d416e-0e39-442f-b03c-6c903f31d769 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:18.594304 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-987d416e-0e39-442f-b03c-6c903f31d769 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:18.594580 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-87960a17-a6ba-4510-a7dd-9a81ee24d707 tempest-QuotasAdminTestV236-1267176834 tempest-QuotasAdminTestV236-1267176834-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:18.595472 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-87960a17-a6ba-4510-a7dd-9a81ee24d707 tempest-QuotasAdminTestV236-1267176834 tempest-QuotasAdminTestV236-1267176834-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:18.596939 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-87960a17-a6ba-4510-a7dd-9a81ee24d707 tempest-QuotasAdminTestV236-1267176834 tempest-QuotasAdminTestV236-1267176834-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:18.597354 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-87960a17-a6ba-4510-a7dd-9a81ee24d707 tempest-QuotasAdminTestV236-1267176834 tempest-QuotasAdminTestV236-1267176834-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:18.669799 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-987d416e-0e39-442f-b03c-6c903f31d769 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0eb2feb062947e78357b70e832e3edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18029da9b9854f3caf3debd9556f1f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:18.681842 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-987d416e-0e39-442f-b03c-6c903f31d769 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] 10.222.0.26 "GET /compute/v2.1/servers/800ffcdf-e494-44df-97db-1c7fc74f97b6" status: 200 len: 1275 microversion: 2.1 time: 0.106409 Oct 08 20:52:18.697926 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 127/246] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:52:18 2022] GET /compute/v2.1/servers/800ffcdf-e494-44df-97db-1c7fc74f97b6 => generated 1275 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:52:18.703178 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-6d0dc580-69a7-4d97-b80a-da9176c4dfa1 tempest-AggregatesAdminTestJSON-1599742552 tempest-AggregatesAdminTestJSON-1599742552-project-admin] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:18.715387 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-6d0dc580-69a7-4d97-b80a-da9176c4dfa1 tempest-AggregatesAdminTestJSON-1599742552 tempest-AggregatesAdminTestJSON-1599742552-project-admin] HTTP exception thrown: Aggregate 12 could not be found. Oct 08 20:52:18.720233 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-6d0dc580-69a7-4d97-b80a-da9176c4dfa1 tempest-AggregatesAdminTestJSON-1599742552 tempest-AggregatesAdminTestJSON-1599742552-project-admin] Request method failure captured: Oct 08 20:52:18.720233 ncdv-master-1 devstack@n-api.service[140492]: request: GET /compute/v2.1/os-aggregates/12 HTTP/1.1 Oct 08 20:52:18.720233 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 20:52:18.720233 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 20:52:18.720233 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 20:52:18.720233 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 20:52:18.720233 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 20:52:18.720233 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 20:52:18.720233 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 20:52:18.720233 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 20:52:18.720233 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeLYd6tBrnIHKDRZ7oAZgZJgW2EEjGn-pAQkQTU0Sj7kChV7YWnUx33-nKpaX56W5LOrmLd1p5aTaF8xObB-YktYKWh3G0Qx3a3Zm6Ixu91FApm9VYUd8VBcXr70zseWNExw8PKklYHCCksdycWegKk2c3ZThz0OljOeaYQImJJjDGQ Oct 08 20:52:18.720233 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 20:52:18.720233 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 20:52:18.720233 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 20:52:18.720233 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 20:52:18.720233 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 20:52:18.720233 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 20:52:18.720233 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: bebdaec2d12147a1aabffeae21fb2db4 Oct 08 20:52:18.720233 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-AggregatesAdminTestJSON-1599742552 Oct 08 20:52:18.720233 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,admin,member Oct 08 20:52:18.720233 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,admin,member Oct 08 20:52:18.721429 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/bebdaec2d12147a1aabffeae21fb2db4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/bebdaec2d12147a1aabffeae21fb2db4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_bebdaec2d12147a1aabffeae21fb2db4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/bebdaec2d12147a1aabffeae21fb2db4"}]}] Oct 08 20:52:18.721429 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-AggregatesAdminTestJSON-1599742552 Oct 08 20:52:18.721429 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: bebdaec2d12147a1aabffeae21fb2db4 Oct 08 20:52:18.721429 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1599742552 Oct 08 20:52:18.721429 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-AggregatesAdminTestJSON-1599742552-project-admin Oct 08 20:52:18.721429 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 20:52:18.721429 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 20:52:18.721429 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 779254232db94232a7ff2bfa1104ef25 Oct 08 20:52:18.721429 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-AggregatesAdminTestJSON-1599742552-project-admin Oct 08 20:52:18.721429 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 20:52:18.721429 ncdv-master-1 devstack@n-api.service[140492]: exception: Aggregate 12 could not be found. Oct 08 20:52:18.721429 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': '12'} Oct 08 20:52:18.721429 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:52:18.722135 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:52:18.722135 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 08 20:52:18.722135 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 08 20:52:18.722135 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 08 20:52:18.722135 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 08 20:52:18.722135 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 08 20:52:18.722135 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 08 20:52:18.722135 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 08 20:52:18.722135 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 08 20:52:18.722135 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 08 20:52:18.722135 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 08 20:52:18.722135 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 08 20:52:18.722135 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 08 20:52:18.722135 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 12 could not be found. Oct 08 20:52:18.722135 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:52:18.722135 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:52:18.722135 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:52:18.722135 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:52:18.722135 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:52:18.723210 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:52:18.723210 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:52:18.723210 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:52:18.723210 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:52:18.723210 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:52:18.723210 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 08 20:52:18.723210 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 20:52:18.723210 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 12 could not be found. Oct 08 20:52:18.723210 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:52:18.723210 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:52:18.723210 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:52:18.723210 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:52:18.723210 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:52:18.723210 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:52:18.723210 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 20:52:18.723210 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 20:52:18.723210 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 12 could not be found. Oct 08 20:52:18.723210 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:52:18.726880 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-6d0dc580-69a7-4d97-b80a-da9176c4dfa1 tempest-AggregatesAdminTestJSON-1599742552 tempest-AggregatesAdminTestJSON-1599742552-project-admin] Returning 404 to user: Aggregate 12 could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:52:18.728019 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-6d0dc580-69a7-4d97-b80a-da9176c4dfa1 tempest-AggregatesAdminTestJSON-1599742552 tempest-AggregatesAdminTestJSON-1599742552-project-admin] 10.222.0.26 "GET /compute/v2.1/os-aggregates/12" status: 404 len: 78 microversion: 2.1 time: 0.028859 Oct 08 20:52:18.729203 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 128/247] 10.222.0.26 () {58 vars in 1152 bytes} [Sat Oct 8 20:52:18 2022] GET /compute/v2.1/os-aggregates/12 => generated 78 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 08 20:52:18.746239 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-87960a17-a6ba-4510-a7dd-9a81ee24d707 tempest-QuotasAdminTestV236-1267176834 tempest-QuotasAdminTestV236-1267176834-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-quota-sets/2599b63499b549eb96e3a5bac0f83b91?user_id=913dc107347c4ccbb378eb59ade56891" status: 200 len: 240 microversion: 2.36 time: 0.793068 Oct 08 20:52:18.749628 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-f943e5de-014c-459e-b118-fdd1a3b0cf79 tempest-HostsAdminTestJSON-169666208 tempest-HostsAdminTestJSON-169666208-project-admin] Calling method '.version_select at 0x7f1a8d126550>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:18.751475 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 120/248] 10.222.0.26 () {62 vars in 1384 bytes} [Sat Oct 8 20:52:17 2022] PUT /compute/v2.1/os-quota-sets/2599b63499b549eb96e3a5bac0f83b91?user_id=913dc107347c4ccbb378eb59ade56891 => generated 240 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 08 20:52:18.756237 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-afae1c08-67b1-4b6e-9e58-e1bfb94db796 tempest-AggregatesAdminNegativeTestJSON-367865409 tempest-AggregatesAdminNegativeTestJSON-367865409-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1643825344"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:52:18.760988 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f943e5de-014c-459e-b118-fdd1a3b0cf79 tempest-HostsAdminTestJSON-169666208 tempest-HostsAdminTestJSON-169666208-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:18.764338 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.objects.aggregate [None req-afae1c08-67b1-4b6e-9e58-e1bfb94db796 tempest-AggregatesAdminNegativeTestJSON-367865409 tempest-AggregatesAdminNegativeTestJSON-367865409-project-admin] Generated uuid 76b36c86-283c-414c-b197-b06862cf6592 for aggregate {{(pid=140491) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 08 20:52:18.765158 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f943e5de-014c-459e-b118-fdd1a3b0cf79 tempest-HostsAdminTestJSON-169666208 tempest-HostsAdminTestJSON-169666208-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:18.765628 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f943e5de-014c-459e-b118-fdd1a3b0cf79 tempest-HostsAdminTestJSON-169666208 tempest-HostsAdminTestJSON-169666208-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:18.766378 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f943e5de-014c-459e-b118-fdd1a3b0cf79 tempest-HostsAdminTestJSON-169666208 tempest-HostsAdminTestJSON-169666208-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:18.766829 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f943e5de-014c-459e-b118-fdd1a3b0cf79 tempest-HostsAdminTestJSON-169666208 tempest-HostsAdminTestJSON-169666208-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:18.768745 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f943e5de-014c-459e-b118-fdd1a3b0cf79 tempest-HostsAdminTestJSON-169666208 tempest-HostsAdminTestJSON-169666208-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:18.783202 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=85,nova_api:DELETE=13,nova_api:INSERT=2 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:18.800723 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-f943e5de-014c-459e-b118-fdd1a3b0cf79 tempest-HostsAdminTestJSON-169666208 tempest-HostsAdminTestJSON-169666208-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hosts" status: 200 len: 379 microversion: 2.1 time: 0.067328 Oct 08 20:52:18.801280 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-afae1c08-67b1-4b6e-9e58-e1bfb94db796 tempest-AggregatesAdminNegativeTestJSON-367865409 tempest-AggregatesAdminNegativeTestJSON-367865409-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.047116 Oct 08 20:52:18.801925 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 129/249] 10.222.0.26 () {58 vars in 1128 bytes} [Sat Oct 8 20:52:18 2022] GET /compute/v2.1/os-hosts => generated 379 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:52:18.802913 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 121/250] 10.222.0.26 () {60 vars in 1164 bytes} [Sat Oct 8 20:52:18 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:52:18.814327 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-24aa00f3-76a0-4ce7-8e88-9887c44a0d3f tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:18.815448 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-24aa00f3-76a0-4ce7-8e88-9887c44a0d3f tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] [instance: 1af12bcb-5e2a-4c15-8673-fa41701cb4c7] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:52:18.815848 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-2d0a6673-b7c7-4144-b80f-4a68d9883079 tempest-AggregatesAdminTestJSON-1599742552 tempest-AggregatesAdminTestJSON-1599742552-project-admin] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:18.831227 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-24aa00f3-76a0-4ce7-8e88-9887c44a0d3f tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:18.833282 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-2d0a6673-b7c7-4144-b80f-4a68d9883079 tempest-AggregatesAdminTestJSON-1599742552 tempest-AggregatesAdminTestJSON-1599742552-project-admin] HTTP exception thrown: Aggregate 12 could not be found. Oct 08 20:52:18.834018 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-24aa00f3-76a0-4ce7-8e88-9887c44a0d3f tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:18.834551 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-24aa00f3-76a0-4ce7-8e88-9887c44a0d3f tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:18.835586 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-24aa00f3-76a0-4ce7-8e88-9887c44a0d3f tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:18.835966 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-2d0a6673-b7c7-4144-b80f-4a68d9883079 tempest-AggregatesAdminTestJSON-1599742552 tempest-AggregatesAdminTestJSON-1599742552-project-admin] Request method failure captured: Oct 08 20:52:18.835966 ncdv-master-1 devstack@n-api.service[140491]: request: DELETE /compute/v2.1/os-aggregates/12 HTTP/1.1 Oct 08 20:52:18.835966 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 20:52:18.835966 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 20:52:18.835966 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 20:52:18.835966 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 20:52:18.835966 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 20:52:18.835966 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 20:52:18.835966 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 20:52:18.835966 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 20:52:18.835966 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeLYd6tBrnIHKDRZ7oAZgZJgW2EEjGn-pAQkQTU0Sj7kChV7YWnUx33-nKpaX56W5LOrmLd1p5aTaF8xObB-YktYKWh3G0Qx3a3Zm6Ixu91FApm9VYUd8VBcXr70zseWNExw8PKklYHCCksdycWegKk2c3ZThz0OljOeaYQImJJjDGQ Oct 08 20:52:18.835966 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 20:52:18.835966 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 20:52:18.835966 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 20:52:18.835966 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 20:52:18.835966 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 20:52:18.835966 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 20:52:18.835966 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: bebdaec2d12147a1aabffeae21fb2db4 Oct 08 20:52:18.835966 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-AggregatesAdminTestJSON-1599742552 Oct 08 20:52:18.835966 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,admin,member Oct 08 20:52:18.835966 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,admin,member Oct 08 20:52:18.837435 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/bebdaec2d12147a1aabffeae21fb2db4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/bebdaec2d12147a1aabffeae21fb2db4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_bebdaec2d12147a1aabffeae21fb2db4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/bebdaec2d12147a1aabffeae21fb2db4"}]}] Oct 08 20:52:18.837435 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-AggregatesAdminTestJSON-1599742552 Oct 08 20:52:18.837435 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: bebdaec2d12147a1aabffeae21fb2db4 Oct 08 20:52:18.837435 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1599742552 Oct 08 20:52:18.837435 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-AggregatesAdminTestJSON-1599742552-project-admin Oct 08 20:52:18.837435 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 20:52:18.837435 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 20:52:18.837435 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 779254232db94232a7ff2bfa1104ef25 Oct 08 20:52:18.837435 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-AggregatesAdminTestJSON-1599742552-project-admin Oct 08 20:52:18.837435 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 20:52:18.837435 ncdv-master-1 devstack@n-api.service[140491]: exception: Aggregate 12 could not be found. Oct 08 20:52:18.837435 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': '12'} Oct 08 20:52:18.837435 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:52:18.838314 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:52:18.838314 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 08 20:52:18.838314 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 08 20:52:18.838314 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 08 20:52:18.838314 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 08 20:52:18.838314 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 08 20:52:18.838314 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 08 20:52:18.838314 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 08 20:52:18.838314 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise self.value Oct 08 20:52:18.838314 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 08 20:52:18.838314 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 08 20:52:18.838314 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 08 20:52:18.838314 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 08 20:52:18.838314 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 08 20:52:18.838314 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 08 20:52:18.838314 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 08 20:52:18.838314 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 08 20:52:18.838314 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 08 20:52:18.838314 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 08 20:52:18.839438 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 08 20:52:18.839438 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 08 20:52:18.839438 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 12 could not be found. Oct 08 20:52:18.839438 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:52:18.839438 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:52:18.839438 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:52:18.839438 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:52:18.839438 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:52:18.839438 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:52:18.839438 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:52:18.839438 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:52:18.839438 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:52:18.839438 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:52:18.839438 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 08 20:52:18.839438 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 20:52:18.839438 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 12 could not be found. Oct 08 20:52:18.839438 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:52:18.839438 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:52:18.839438 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:52:18.839438 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:52:18.839438 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:52:18.842768 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:52:18.842768 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 20:52:18.842768 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 20:52:18.842768 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 12 could not be found. Oct 08 20:52:18.842768 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:52:18.844184 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-24aa00f3-76a0-4ce7-8e88-9887c44a0d3f tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:18.844184 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-24aa00f3-76a0-4ce7-8e88-9887c44a0d3f tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:18.846026 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-2d0a6673-b7c7-4144-b80f-4a68d9883079 tempest-AggregatesAdminTestJSON-1599742552 tempest-AggregatesAdminTestJSON-1599742552-project-admin] Returning 404 to user: Aggregate 12 could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:52:18.847117 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-2d0a6673-b7c7-4144-b80f-4a68d9883079 tempest-AggregatesAdminTestJSON-1599742552 tempest-AggregatesAdminTestJSON-1599742552-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-aggregates/12" status: 404 len: 78 microversion: 2.1 time: 0.036720 Oct 08 20:52:18.847957 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 122/251] 10.222.0.26 () {58 vars in 1155 bytes} [Sat Oct 8 20:52:18 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 78 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 08 20:52:18.860839 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-62627268-20a7-42ef-a2e3-d098d6ca6394 tempest-QuotasAdminTestV236-1267176834 tempest-QuotasAdminTestV236-1267176834-project-admin] Calling method '.version_select at 0x7f1a8d435310>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:19.015961 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-24aa00f3-76a0-4ce7-8e88-9887c44a0d3f tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb78cce5f7c4c348045745f40b13129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16530e0f2f0a4d23918261c9e21f9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:19.033080 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-24aa00f3-76a0-4ce7-8e88-9887c44a0d3f tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cb78cce5f7c4c348045745f40b13129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16530e0f2f0a4d23918261c9e21f9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:19.037526 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-24aa00f3-76a0-4ce7-8e88-9887c44a0d3f tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cb78cce5f7c4c348045745f40b13129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16530e0f2f0a4d23918261c9e21f9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:19.053072 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-24aa00f3-76a0-4ce7-8e88-9887c44a0d3f tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] 10.222.0.26 "GET /compute/v2.1/servers/1af12bcb-5e2a-4c15-8673-fa41701cb4c7" status: 200 len: 1419 microversion: 2.75 time: 0.249580 Oct 08 20:52:19.069348 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 130/252] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:52:18 2022] GET /compute/v2.1/servers/1af12bcb-5e2a-4c15-8673-fa41701cb4c7 => generated 1419 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:52:19.089178 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-2bbe0581-0b2f-42da-9bed-e21a1d94d6f5 tempest-HostsAdminTestJSON-169666208 tempest-HostsAdminTestJSON-169666208-project-admin] Calling method '.version_select at 0x7f1a8d2169d0>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:19.108076 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2bbe0581-0b2f-42da-9bed-e21a1d94d6f5 tempest-HostsAdminTestJSON-169666208 tempest-HostsAdminTestJSON-169666208-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:19.111290 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2bbe0581-0b2f-42da-9bed-e21a1d94d6f5 tempest-HostsAdminTestJSON-169666208 tempest-HostsAdminTestJSON-169666208-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:19.112427 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2bbe0581-0b2f-42da-9bed-e21a1d94d6f5 tempest-HostsAdminTestJSON-169666208 tempest-HostsAdminTestJSON-169666208-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:19.128697 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:19.149831 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2bbe0581-0b2f-42da-9bed-e21a1d94d6f5 tempest-HostsAdminTestJSON-169666208 tempest-HostsAdminTestJSON-169666208-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:19.154842 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2bbe0581-0b2f-42da-9bed-e21a1d94d6f5 tempest-HostsAdminTestJSON-169666208 tempest-HostsAdminTestJSON-169666208-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:19.155452 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2bbe0581-0b2f-42da-9bed-e21a1d94d6f5 tempest-HostsAdminTestJSON-169666208 tempest-HostsAdminTestJSON-169666208-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:19.204634 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-2bbe0581-0b2f-42da-9bed-e21a1d94d6f5 tempest-HostsAdminTestJSON-169666208 tempest-HostsAdminTestJSON-169666208-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hosts/nch2-master-1" status: 200 len: 467 microversion: 2.1 time: 0.134117 Oct 08 20:52:19.215994 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 131/253] 10.222.0.26 () {58 vars in 1170 bytes} [Sat Oct 8 20:52:19 2022] GET /compute/v2.1/os-hosts/nch2-master-1 => generated 467 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:52:19.227413 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-d43bddf7-3ec6-454d-9174-f52032ae4092 tempest-AggregatesAdminNegativeTestJSON-367865409 tempest-AggregatesAdminNegativeTestJSON-367865409-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:52:19.240878 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d43bddf7-3ec6-454d-9174-f52032ae4092 tempest-AggregatesAdminNegativeTestJSON-367865409 tempest-AggregatesAdminNegativeTestJSON-367865409-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:19.241418 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d43bddf7-3ec6-454d-9174-f52032ae4092 tempest-AggregatesAdminNegativeTestJSON-367865409 tempest-AggregatesAdminNegativeTestJSON-367865409-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:19.241958 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d43bddf7-3ec6-454d-9174-f52032ae4092 tempest-AggregatesAdminNegativeTestJSON-367865409 tempest-AggregatesAdminNegativeTestJSON-367865409-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:19.434929 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-62627268-20a7-42ef-a2e3-d098d6ca6394 tempest-QuotasAdminTestV236-1267176834 tempest-QuotasAdminTestV236-1267176834-project-admin] 10.222.0.26 "GET /compute/v2.1/os-quota-sets/2599b63499b549eb96e3a5bac0f83b91?user_id=913dc107347c4ccbb378eb59ade56891" status: 200 len: 282 microversion: 2.36 time: 0.580552 Oct 08 20:52:19.436366 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 123/254] 10.222.0.26 () {60 vars in 1364 bytes} [Sat Oct 8 20:52:18 2022] GET /compute/v2.1/os-quota-sets/2599b63499b549eb96e3a5bac0f83b91?user_id=913dc107347c4ccbb378eb59ade56891 => generated 282 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 08 20:52:19.441016 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-529787a4-db8a-488c-a944-fc8fa511498f tempest-AggregatesAdminTestJSON-1599742552 tempest-AggregatesAdminTestJSON-1599742552-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1125875415", "name": "tempest-test_aggregate-1018406722"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:52:19.444758 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.objects.aggregate [None req-529787a4-db8a-488c-a944-fc8fa511498f tempest-AggregatesAdminTestJSON-1599742552 tempest-AggregatesAdminTestJSON-1599742552-project-admin] Generated uuid 69ce8a83-9d52-405a-9f0f-e5cef0334f72 for aggregate {{(pid=140491) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 08 20:52:19.455684 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-d43bddf7-3ec6-454d-9174-f52032ae4092 tempest-AggregatesAdminNegativeTestJSON-367865409 tempest-AggregatesAdminNegativeTestJSON-367865409-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates/13/action" status: 200 len: 243 microversion: 2.1 time: 0.238424 Oct 08 20:52:19.456206 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 132/255] 10.222.0.26 () {60 vars in 1194 bytes} [Sat Oct 8 20:52:19 2022] POST /compute/v2.1/os-aggregates/13/action => generated 243 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:52:19.469085 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-c0956b34-cf3e-4b1e-beba-b780a7b98dea tempest-HostsAdminTestJSON-169666208 tempest-HostsAdminTestJSON-169666208-project-admin] Calling method '.version_select at 0x7f1a8d216af0>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:19.482511 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-529787a4-db8a-488c-a944-fc8fa511498f tempest-AggregatesAdminTestJSON-1599742552 tempest-AggregatesAdminTestJSON-1599742552-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates" status: 200 len: 223 microversion: 2.1 time: 0.043886 Oct 08 20:52:19.482511 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 124/256] 10.222.0.26 () {60 vars in 1165 bytes} [Sat Oct 8 20:52:19 2022] POST /compute/v2.1/os-aggregates => generated 223 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:52:19.498519 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-2d3310c2-98ba-4b0a-876d-dc966f28d0e6 tempest-AggregatesAdminNegativeTestJSON-113134079 tempest-AggregatesAdminNegativeTestJSON-113134079-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:52:19.502645 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-2d3310c2-98ba-4b0a-876d-dc966f28d0e6 tempest-AggregatesAdminNegativeTestJSON-113134079 tempest-AggregatesAdminNegativeTestJSON-113134079-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': '9fcee064c12e41079f451f88ab235dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00af80afb88c49e9b6eba209af379f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:19.504997 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-2d3310c2-98ba-4b0a-876d-dc966f28d0e6 tempest-AggregatesAdminNegativeTestJSON-113134079 tempest-AggregatesAdminNegativeTestJSON-113134079-project] Request method failure captured: Oct 08 20:52:19.504997 ncdv-master-1 devstack@n-api.service[140491]: request: POST /compute/v2.1/os-aggregates/13/action HTTP/1.1 Oct 08 20:52:19.504997 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 20:52:19.504997 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 20:52:19.504997 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 20:52:19.504997 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 42 Oct 08 20:52:19.504997 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 20:52:19.504997 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 20:52:19.504997 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 20:52:19.504997 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 20:52:19.504997 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeLUREvKeYo7wAJnL0QSDolnV1B5HA8V32JgA2fiX6-vMH6WsYDiB4nhQ-xmB7y1MNkFvlDER0YqifcNn-GMvFL3JCHHsMCvEaoWrzKvFN1F90AZ-As1gaYK1oEk4cPK3clBrOSdMfKaxB6GLfpwQuvk4RscKYx_Abd9f9p1tNKLL2k Oct 08 20:52:19.504997 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 20:52:19.504997 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 20:52:19.504997 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 20:52:19.504997 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 20:52:19.504997 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 20:52:19.504997 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 20:52:19.504997 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 00af80afb88c49e9b6eba209af379f30 Oct 08 20:52:19.504997 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-113134079 Oct 08 20:52:19.504997 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 20:52:19.504997 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 20:52:19.506433 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/00af80afb88c49e9b6eba209af379f30"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/00af80afb88c49e9b6eba209af379f30"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_00af80afb88c49e9b6eba209af379f30"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/00af80afb88c49e9b6eba209af379f30"}]}] Oct 08 20:52:19.506433 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-113134079 Oct 08 20:52:19.506433 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 00af80afb88c49e9b6eba209af379f30 Oct 08 20:52:19.506433 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-113134079 Oct 08 20:52:19.506433 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-AggregatesAdminNegativeTestJSON-113134079-project Oct 08 20:52:19.506433 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 20:52:19.506433 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 20:52:19.506433 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 9fcee064c12e41079f451f88ab235dde Oct 08 20:52:19.506433 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-113134079-project Oct 08 20:52:19.506433 ncdv-master-1 devstack@n-api.service[140491]: Oct 08 20:52:19.506433 ncdv-master-1 devstack@n-api.service[140491]: {"remove_host": {"host": "nch2-master-1"}} Oct 08 20:52:19.506433 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 20:52:19.506433 ncdv-master-1 devstack@n-api.service[140491]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 08 20:52:19.507384 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': '13', 'body': {'remove_host': {'host': 'nch2-master-1'}}} Oct 08 20:52:19.507384 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:52:19.507384 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:52:19.507384 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:52:19.507384 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:52:19.507384 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:52:19.507384 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:52:19.507384 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:52:19.507384 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:52:19.507384 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 20:52:19.507384 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 20:52:19.507384 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Oct 08 20:52:19.507384 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Oct 08 20:52:19.507384 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 08 20:52:19.507384 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 08 20:52:19.507384 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 08 20:52:19.507384 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 08 20:52:19.507384 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 08 20:52:19.507384 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 08 20:52:19.508563 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 08 20:52:19.508563 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise self.value Oct 08 20:52:19.508563 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 08 20:52:19.508563 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 08 20:52:19.508563 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 08 20:52:19.508563 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 08 20:52:19.508563 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 08 20:52:19.508563 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 08 20:52:19.508563 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 08 20:52:19.508563 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:52:19.508563 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:52:19.508563 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:52:19.508563 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:52:19.508563 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:52:19.508563 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:52:19.508563 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 08 20:52:19.508563 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 08 20:52:19.508563 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 08 20:52:19.508563 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:52:19.509882 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c0956b34-cf3e-4b1e-beba-b780a7b98dea tempest-HostsAdminTestJSON-169666208 tempest-HostsAdminTestJSON-169666208-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:19.509882 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c0956b34-cf3e-4b1e-beba-b780a7b98dea tempest-HostsAdminTestJSON-169666208 tempest-HostsAdminTestJSON-169666208-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:19.510057 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c0956b34-cf3e-4b1e-beba-b780a7b98dea tempest-HostsAdminTestJSON-169666208 tempest-HostsAdminTestJSON-169666208-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:19.511176 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-2d3310c2-98ba-4b0a-876d-dc966f28d0e6 tempest-AggregatesAdminNegativeTestJSON-113134079 tempest-AggregatesAdminNegativeTestJSON-113134079-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:52:19.512163 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-2d3310c2-98ba-4b0a-876d-dc966f28d0e6 tempest-AggregatesAdminNegativeTestJSON-113134079 tempest-AggregatesAdminNegativeTestJSON-113134079-project] 10.222.0.26 "POST /compute/v2.1/os-aggregates/13/action" status: 403 len: 121 microversion: 2.1 time: 0.021282 Oct 08 20:52:19.517573 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 125/257] 10.222.0.26 () {60 vars in 1194 bytes} [Sat Oct 8 20:52:19 2022] POST /compute/v2.1/os-aggregates/13/action => generated 121 bytes in 35 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 08 20:52:19.524832 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-ca977d1f-ff1f-4dbe-a26a-49381aefae27 tempest-AggregatesAdminTestJSON-1599742552 tempest-AggregatesAdminTestJSON-1599742552-project-admin] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:19.524957 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c0956b34-cf3e-4b1e-beba-b780a7b98dea tempest-HostsAdminTestJSON-169666208 tempest-HostsAdminTestJSON-169666208-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:19.525407 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c0956b34-cf3e-4b1e-beba-b780a7b98dea tempest-HostsAdminTestJSON-169666208 tempest-HostsAdminTestJSON-169666208-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:19.525850 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c0956b34-cf3e-4b1e-beba-b780a7b98dea tempest-HostsAdminTestJSON-169666208 tempest-HostsAdminTestJSON-169666208-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:19.549345 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-c0956b34-cf3e-4b1e-beba-b780a7b98dea tempest-HostsAdminTestJSON-169666208 tempest-HostsAdminTestJSON-169666208-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hosts/nch1-master-1" status: 200 len: 467 microversion: 2.1 time: 0.092071 Oct 08 20:52:19.550037 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 133/258] 10.222.0.26 () {58 vars in 1170 bytes} [Sat Oct 8 20:52:19 2022] GET /compute/v2.1/os-hosts/nch1-master-1 => generated 467 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:52:19.554785 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-ad790f2a-d991-4ce5-b699-9e08b7e292c2 tempest-AggregatesAdminNegativeTestJSON-367865409 tempest-AggregatesAdminNegativeTestJSON-367865409-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:52:19.567839 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ad790f2a-d991-4ce5-b699-9e08b7e292c2 tempest-AggregatesAdminNegativeTestJSON-367865409 tempest-AggregatesAdminNegativeTestJSON-367865409-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:19.568579 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ad790f2a-d991-4ce5-b699-9e08b7e292c2 tempest-AggregatesAdminNegativeTestJSON-367865409 tempest-AggregatesAdminNegativeTestJSON-367865409-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:19.569268 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ad790f2a-d991-4ce5-b699-9e08b7e292c2 tempest-AggregatesAdminNegativeTestJSON-367865409 tempest-AggregatesAdminNegativeTestJSON-367865409-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:19.570525 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-ca977d1f-ff1f-4dbe-a26a-49381aefae27 tempest-AggregatesAdminTestJSON-1599742552 tempest-AggregatesAdminTestJSON-1599742552-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.051134 Oct 08 20:52:19.574116 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 126/259] 10.222.0.26 () {58 vars in 1155 bytes} [Sat Oct 8 20:52:19 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 08 20:52:19.583217 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c2d195b6-0b72-4a14-b20b-87464ecd1590 tempest-AggregatesAdminTestJSON-1599742552 tempest-AggregatesAdminTestJSON-1599742552-project-admin] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:19.605939 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-c2d195b6-0b72-4a14-b20b-87464ecd1590 tempest-AggregatesAdminTestJSON-1599742552 tempest-AggregatesAdminTestJSON-1599742552-project-admin] HTTP exception thrown: Aggregate 14 could not be found. Oct 08 20:52:19.613897 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c2d195b6-0b72-4a14-b20b-87464ecd1590 tempest-AggregatesAdminTestJSON-1599742552 tempest-AggregatesAdminTestJSON-1599742552-project-admin] Request method failure captured: Oct 08 20:52:19.613897 ncdv-master-1 devstack@n-api.service[140491]: request: GET /compute/v2.1/os-aggregates/14 HTTP/1.1 Oct 08 20:52:19.613897 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 20:52:19.613897 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 20:52:19.613897 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 20:52:19.613897 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 20:52:19.613897 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 20:52:19.613897 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 20:52:19.613897 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 20:52:19.613897 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 20:52:19.613897 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeLYd6tBrnIHKDRZ7oAZgZJgW2EEjGn-pAQkQTU0Sj7kChV7YWnUx33-nKpaX56W5LOrmLd1p5aTaF8xObB-YktYKWh3G0Qx3a3Zm6Ixu91FApm9VYUd8VBcXr70zseWNExw8PKklYHCCksdycWegKk2c3ZThz0OljOeaYQImJJjDGQ Oct 08 20:52:19.613897 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 20:52:19.613897 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 20:52:19.613897 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 20:52:19.613897 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 20:52:19.613897 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 20:52:19.613897 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 20:52:19.613897 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: bebdaec2d12147a1aabffeae21fb2db4 Oct 08 20:52:19.613897 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-AggregatesAdminTestJSON-1599742552 Oct 08 20:52:19.613897 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,admin,member Oct 08 20:52:19.613897 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,admin,member Oct 08 20:52:19.615060 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/bebdaec2d12147a1aabffeae21fb2db4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/bebdaec2d12147a1aabffeae21fb2db4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_bebdaec2d12147a1aabffeae21fb2db4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/bebdaec2d12147a1aabffeae21fb2db4"}]}] Oct 08 20:52:19.615060 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-AggregatesAdminTestJSON-1599742552 Oct 08 20:52:19.615060 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: bebdaec2d12147a1aabffeae21fb2db4 Oct 08 20:52:19.615060 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1599742552 Oct 08 20:52:19.615060 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-AggregatesAdminTestJSON-1599742552-project-admin Oct 08 20:52:19.615060 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 20:52:19.615060 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 20:52:19.615060 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 779254232db94232a7ff2bfa1104ef25 Oct 08 20:52:19.615060 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-AggregatesAdminTestJSON-1599742552-project-admin Oct 08 20:52:19.615060 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 20:52:19.615060 ncdv-master-1 devstack@n-api.service[140491]: exception: Aggregate 14 could not be found. Oct 08 20:52:19.615060 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': '14'} Oct 08 20:52:19.615060 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:52:19.615750 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:52:19.615750 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 08 20:52:19.615750 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 08 20:52:19.615750 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 08 20:52:19.615750 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 08 20:52:19.615750 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 08 20:52:19.615750 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 08 20:52:19.615750 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 08 20:52:19.615750 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 08 20:52:19.615750 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 08 20:52:19.615750 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 08 20:52:19.615750 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 08 20:52:19.615750 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 08 20:52:19.615750 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 14 could not be found. Oct 08 20:52:19.615750 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:52:19.615750 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:52:19.615750 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:52:19.615750 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:52:19.615750 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:52:19.616713 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:52:19.616713 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:52:19.616713 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:52:19.616713 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:52:19.616713 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:52:19.616713 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 08 20:52:19.616713 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 20:52:19.616713 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 14 could not be found. Oct 08 20:52:19.616713 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:52:19.616713 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:52:19.616713 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:52:19.616713 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:52:19.616713 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:52:19.616713 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:52:19.616713 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 20:52:19.616713 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 20:52:19.616713 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 14 could not be found. Oct 08 20:52:19.616713 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:52:19.617667 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c2d195b6-0b72-4a14-b20b-87464ecd1590 tempest-AggregatesAdminTestJSON-1599742552 tempest-AggregatesAdminTestJSON-1599742552-project-admin] Returning 404 to user: Aggregate 14 could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:52:19.617667 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-c2d195b6-0b72-4a14-b20b-87464ecd1590 tempest-AggregatesAdminTestJSON-1599742552 tempest-AggregatesAdminTestJSON-1599742552-project-admin] 10.222.0.26 "GET /compute/v2.1/os-aggregates/14" status: 404 len: 78 microversion: 2.1 time: 0.039962 Oct 08 20:52:19.619964 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 127/260] 10.222.0.26 () {58 vars in 1152 bytes} [Sat Oct 8 20:52:19 2022] GET /compute/v2.1/os-aggregates/14 => generated 78 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 08 20:52:19.624949 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-e8ccf653-f0b1-4f00-88d0-a7a1448ccfc1 tempest-AggregatesAdminTestJSON-1599742552 tempest-AggregatesAdminTestJSON-1599742552-project-admin] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:19.637306 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-e8ccf653-f0b1-4f00-88d0-a7a1448ccfc1 tempest-AggregatesAdminTestJSON-1599742552 tempest-AggregatesAdminTestJSON-1599742552-project-admin] HTTP exception thrown: Aggregate 14 could not be found. Oct 08 20:52:19.639641 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-e8ccf653-f0b1-4f00-88d0-a7a1448ccfc1 tempest-AggregatesAdminTestJSON-1599742552 tempest-AggregatesAdminTestJSON-1599742552-project-admin] Request method failure captured: Oct 08 20:52:19.639641 ncdv-master-1 devstack@n-api.service[140491]: request: DELETE /compute/v2.1/os-aggregates/14 HTTP/1.1 Oct 08 20:52:19.639641 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 20:52:19.639641 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 20:52:19.639641 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 20:52:19.639641 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 20:52:19.639641 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 20:52:19.639641 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 20:52:19.639641 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 20:52:19.639641 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 20:52:19.639641 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeLYd6tBrnIHKDRZ7oAZgZJgW2EEjGn-pAQkQTU0Sj7kChV7YWnUx33-nKpaX56W5LOrmLd1p5aTaF8xObB-YktYKWh3G0Qx3a3Zm6Ixu91FApm9VYUd8VBcXr70zseWNExw8PKklYHCCksdycWegKk2c3ZThz0OljOeaYQImJJjDGQ Oct 08 20:52:19.639641 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 20:52:19.639641 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 20:52:19.639641 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 20:52:19.639641 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 20:52:19.639641 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 20:52:19.639641 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 20:52:19.639641 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: bebdaec2d12147a1aabffeae21fb2db4 Oct 08 20:52:19.639641 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-AggregatesAdminTestJSON-1599742552 Oct 08 20:52:19.639641 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,admin,member Oct 08 20:52:19.639641 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,admin,member Oct 08 20:52:19.641462 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/bebdaec2d12147a1aabffeae21fb2db4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/bebdaec2d12147a1aabffeae21fb2db4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_bebdaec2d12147a1aabffeae21fb2db4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/bebdaec2d12147a1aabffeae21fb2db4"}]}] Oct 08 20:52:19.641462 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-AggregatesAdminTestJSON-1599742552 Oct 08 20:52:19.641462 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: bebdaec2d12147a1aabffeae21fb2db4 Oct 08 20:52:19.641462 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1599742552 Oct 08 20:52:19.641462 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-AggregatesAdminTestJSON-1599742552-project-admin Oct 08 20:52:19.641462 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 20:52:19.641462 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 20:52:19.641462 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 779254232db94232a7ff2bfa1104ef25 Oct 08 20:52:19.641462 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-AggregatesAdminTestJSON-1599742552-project-admin Oct 08 20:52:19.641462 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 20:52:19.641462 ncdv-master-1 devstack@n-api.service[140491]: exception: Aggregate 14 could not be found. Oct 08 20:52:19.641462 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': '14'} Oct 08 20:52:19.641462 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:52:19.642145 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:52:19.642145 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 08 20:52:19.642145 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 08 20:52:19.642145 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 08 20:52:19.642145 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 08 20:52:19.642145 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 08 20:52:19.642145 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 08 20:52:19.642145 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 08 20:52:19.642145 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise self.value Oct 08 20:52:19.642145 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 08 20:52:19.642145 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 08 20:52:19.642145 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 08 20:52:19.642145 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 08 20:52:19.642145 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 08 20:52:19.642145 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 08 20:52:19.642145 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 08 20:52:19.642145 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 08 20:52:19.642145 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 08 20:52:19.642145 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 08 20:52:19.643118 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 08 20:52:19.643118 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 08 20:52:19.643118 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 14 could not be found. Oct 08 20:52:19.643118 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:52:19.643118 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:52:19.643118 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:52:19.643118 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:52:19.643118 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:52:19.643118 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:52:19.643118 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:52:19.643118 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:52:19.643118 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:52:19.643118 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:52:19.643118 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 08 20:52:19.643118 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 20:52:19.643118 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 14 could not be found. Oct 08 20:52:19.643118 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:52:19.643118 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:52:19.643118 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:52:19.643118 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:52:19.643118 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:52:19.645998 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:52:19.645998 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 20:52:19.645998 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 20:52:19.645998 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 14 could not be found. Oct 08 20:52:19.645998 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:52:19.648259 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-e8ccf653-f0b1-4f00-88d0-a7a1448ccfc1 tempest-AggregatesAdminTestJSON-1599742552 tempest-AggregatesAdminTestJSON-1599742552-project-admin] Returning 404 to user: Aggregate 14 could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:52:19.649326 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-e8ccf653-f0b1-4f00-88d0-a7a1448ccfc1 tempest-AggregatesAdminTestJSON-1599742552 tempest-AggregatesAdminTestJSON-1599742552-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-aggregates/14" status: 404 len: 78 microversion: 2.1 time: 0.028378 Oct 08 20:52:19.650188 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 128/261] 10.222.0.26 () {58 vars in 1155 bytes} [Sat Oct 8 20:52:19 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 78 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 08 20:52:19.664984 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-1ae2cb77-cece-409c-a682-933450cad327 tempest-AggregatesAdminTestJSON-1599742552 tempest-AggregatesAdminTestJSON-1599742552-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1879432580"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:52:19.670278 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.objects.aggregate [None req-1ae2cb77-cece-409c-a682-933450cad327 tempest-AggregatesAdminTestJSON-1599742552 tempest-AggregatesAdminTestJSON-1599742552-project-admin] Generated uuid 96646519-66c4-4ddd-a040-c37aedbd000f for aggregate {{(pid=140491) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 08 20:52:19.693934 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-1ae2cb77-cece-409c-a682-933450cad327 tempest-AggregatesAdminTestJSON-1599742552 tempest-AggregatesAdminTestJSON-1599742552-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.036978 Oct 08 20:52:19.694959 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 129/262] 10.222.0.26 () {60 vars in 1164 bytes} [Sat Oct 8 20:52:19 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:52:19.709386 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-3ed8e8a7-319b-4aeb-b332-7f747f600bf1 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:19.710573 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-3ed8e8a7-319b-4aeb-b332-7f747f600bf1 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] [instance: 800ffcdf-e494-44df-97db-1c7fc74f97b6] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:52:19.722203 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3ed8e8a7-319b-4aeb-b332-7f747f600bf1 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:19.722820 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3ed8e8a7-319b-4aeb-b332-7f747f600bf1 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:19.723461 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3ed8e8a7-319b-4aeb-b332-7f747f600bf1 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:19.739565 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3ed8e8a7-319b-4aeb-b332-7f747f600bf1 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:19.740732 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3ed8e8a7-319b-4aeb-b332-7f747f600bf1 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:19.741546 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3ed8e8a7-319b-4aeb-b332-7f747f600bf1 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:19.742280 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-ad790f2a-d991-4ce5-b699-9e08b7e292c2 tempest-AggregatesAdminNegativeTestJSON-367865409 tempest-AggregatesAdminNegativeTestJSON-367865409-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates/13/action" status: 200 len: 228 microversion: 2.1 time: 0.189347 Oct 08 20:52:19.745296 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 134/263] 10.222.0.26 () {60 vars in 1194 bytes} [Sat Oct 8 20:52:19 2022] POST /compute/v2.1/os-aggregates/13/action => generated 228 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:52:19.753253 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-f071eeff-c042-4853-888e-793a41745fd3 tempest-AggregatesAdminTestJSON-1599742552 tempest-AggregatesAdminTestJSON-1599742552-project-admin] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:19.764228 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-f071eeff-c042-4853-888e-793a41745fd3 tempest-AggregatesAdminTestJSON-1599742552 tempest-AggregatesAdminTestJSON-1599742552-project-admin] 10.222.0.26 "GET /compute/v2.1/os-aggregates/15" status: 200 len: 228 microversion: 2.1 time: 0.016340 Oct 08 20:52:19.766241 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 135/264] 10.222.0.26 () {58 vars in 1152 bytes} [Sat Oct 8 20:52:19 2022] GET /compute/v2.1/os-aggregates/15 => generated 228 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:52:19.775586 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-bb512b75-8697-4a0d-aa06-480f1a9996e3 tempest-AggregatesAdminNegativeTestJSON-367865409 tempest-AggregatesAdminNegativeTestJSON-367865409-project-admin] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:19.815682 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-bb512b75-8697-4a0d-aa06-480f1a9996e3 tempest-AggregatesAdminNegativeTestJSON-367865409 tempest-AggregatesAdminNegativeTestJSON-367865409-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.045945 Oct 08 20:52:19.817235 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 136/265] 10.222.0.26 () {58 vars in 1155 bytes} [Sat Oct 8 20:52:19 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 08 20:52:19.829299 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-13747735-16e3-485c-9b0f-8293acd2fba6 tempest-AggregatesAdminTestJSON-1599742552 tempest-AggregatesAdminTestJSON-1599742552-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:52:19.880835 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-13747735-16e3-485c-9b0f-8293acd2fba6 tempest-AggregatesAdminTestJSON-1599742552 tempest-AggregatesAdminTestJSON-1599742552-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates/15/action" status: 200 len: 266 microversion: 2.1 time: 0.061637 Oct 08 20:52:19.882137 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 137/266] 10.222.0.26 () {60 vars in 1194 bytes} [Sat Oct 8 20:52:19 2022] POST /compute/v2.1/os-aggregates/15/action => generated 266 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:52:19.888505 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e77ad41f-ca16-4673-a606-ebf08fb253c1 tempest-AggregatesAdminNegativeTestJSON-367865409 tempest-AggregatesAdminNegativeTestJSON-367865409-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1668074653"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:52:19.893177 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.objects.aggregate [None req-e77ad41f-ca16-4673-a606-ebf08fb253c1 tempest-AggregatesAdminNegativeTestJSON-367865409 tempest-AggregatesAdminNegativeTestJSON-367865409-project-admin] Generated uuid 32590e81-3991-465c-ad68-68c485eb0e37 for aggregate {{(pid=140492) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 08 20:52:19.923300 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-e77ad41f-ca16-4673-a606-ebf08fb253c1 tempest-AggregatesAdminNegativeTestJSON-367865409 tempest-AggregatesAdminNegativeTestJSON-367865409-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.039702 Oct 08 20:52:19.924775 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 138/267] 10.222.0.26 () {60 vars in 1164 bytes} [Sat Oct 8 20:52:19 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:52:19.931181 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-6b09a59c-fb66-42ab-9399-712fde3422df tempest-AggregatesAdminTestJSON-1599742552 tempest-AggregatesAdminTestJSON-1599742552-project-admin] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:19.941659 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-6b09a59c-fb66-42ab-9399-712fde3422df tempest-AggregatesAdminTestJSON-1599742552 tempest-AggregatesAdminTestJSON-1599742552-project-admin] 10.222.0.26 "GET /compute/v2.1/os-aggregates/15" status: 200 len: 242 microversion: 2.1 time: 0.015391 Oct 08 20:52:19.946194 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 139/268] 10.222.0.26 () {58 vars in 1152 bytes} [Sat Oct 8 20:52:19 2022] GET /compute/v2.1/os-aggregates/15 => generated 242 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:52:19.960122 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-0ba5f3de-0713-486e-8024-35786e5b759b tempest-AggregatesAdminNegativeTestJSON-367865409 tempest-AggregatesAdminNegativeTestJSON-367865409-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:52:19.982401 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0ba5f3de-0713-486e-8024-35786e5b759b tempest-AggregatesAdminNegativeTestJSON-367865409 tempest-AggregatesAdminNegativeTestJSON-367865409-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:19.983538 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0ba5f3de-0713-486e-8024-35786e5b759b tempest-AggregatesAdminNegativeTestJSON-367865409 tempest-AggregatesAdminNegativeTestJSON-367865409-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:19.984947 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0ba5f3de-0713-486e-8024-35786e5b759b tempest-AggregatesAdminNegativeTestJSON-367865409 tempest-AggregatesAdminNegativeTestJSON-367865409-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:19.985763 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-3ed8e8a7-319b-4aeb-b332-7f747f600bf1 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0eb2feb062947e78357b70e832e3edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18029da9b9854f3caf3debd9556f1f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:19.997052 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-3ed8e8a7-319b-4aeb-b332-7f747f600bf1 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] 10.222.0.26 "GET /compute/v2.1/servers/800ffcdf-e494-44df-97db-1c7fc74f97b6" status: 200 len: 1317 microversion: 2.1 time: 0.295823 Oct 08 20:52:19.998265 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0ba5f3de-0713-486e-8024-35786e5b759b tempest-AggregatesAdminNegativeTestJSON-367865409 tempest-AggregatesAdminNegativeTestJSON-367865409-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:19.999315 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0ba5f3de-0713-486e-8024-35786e5b759b tempest-AggregatesAdminNegativeTestJSON-367865409 tempest-AggregatesAdminNegativeTestJSON-367865409-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:20.000922 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 130/269] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:52:19 2022] GET /compute/v2.1/servers/800ffcdf-e494-44df-97db-1c7fc74f97b6 => generated 1317 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:52:20.009355 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0ba5f3de-0713-486e-8024-35786e5b759b tempest-AggregatesAdminNegativeTestJSON-367865409 tempest-AggregatesAdminNegativeTestJSON-367865409-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:20.018606 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.compute.aggregates [None req-0ba5f3de-0713-486e-8024-35786e5b759b tempest-AggregatesAdminNegativeTestJSON-367865409 tempest-AggregatesAdminNegativeTestJSON-367865409-project-admin] Failed to remove host nonexist_host from aggregate 16. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Oct 08 20:52:20.018606 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-0ba5f3de-0713-486e-8024-35786e5b759b tempest-AggregatesAdminNegativeTestJSON-367865409 tempest-AggregatesAdminNegativeTestJSON-367865409-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 16 Oct 08 20:52:20.018606 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-0ba5f3de-0713-486e-8024-35786e5b759b tempest-AggregatesAdminNegativeTestJSON-367865409 tempest-AggregatesAdminNegativeTestJSON-367865409-project-admin] Request method failure captured: Oct 08 20:52:20.018606 ncdv-master-1 devstack@n-api.service[140492]: request: POST /compute/v2.1/os-aggregates/16/action HTTP/1.1 Oct 08 20:52:20.018606 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 20:52:20.018606 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 20:52:20.018606 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 20:52:20.018606 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 42 Oct 08 20:52:20.018606 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 20:52:20.018606 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 20:52:20.018606 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 20:52:20.018606 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 20:52:20.018606 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeLWVhqRRveDbmIUhFeBnNUCcRp0ijW8GA3slsPD4DpNY4VIrC1Obpt3PlDfNSXK8aKkF6mMCXXMjLIABKZrpIUQZ9p2WyaQLz3ViLWkIGM6mg_h9EkodYvDQieQggfjENBh1o6B10L6dVsCn80FSMaMQdp8lU263-XrTG0rHVdTG1w Oct 08 20:52:20.018606 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 20:52:20.018606 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 20:52:20.018606 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 20:52:20.018606 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 20:52:20.018606 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 20:52:20.018606 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 20:52:20.018606 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: d7e38a3e604b4b0a82db824aa872aef3 Oct 08 20:52:20.018606 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-367865409 Oct 08 20:52:20.018606 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,admin,member Oct 08 20:52:20.018606 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,admin,member Oct 08 20:52:20.020346 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d7e38a3e604b4b0a82db824aa872aef3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d7e38a3e604b4b0a82db824aa872aef3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d7e38a3e604b4b0a82db824aa872aef3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d7e38a3e604b4b0a82db824aa872aef3"}]}] Oct 08 20:52:20.020346 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-367865409 Oct 08 20:52:20.020346 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: d7e38a3e604b4b0a82db824aa872aef3 Oct 08 20:52:20.020346 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-367865409 Oct 08 20:52:20.020346 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-AggregatesAdminNegativeTestJSON-367865409-project-admin Oct 08 20:52:20.020346 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 20:52:20.020346 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 20:52:20.020346 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 27df69ae40444039af536faf5d884284 Oct 08 20:52:20.020346 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-367865409-project-admin Oct 08 20:52:20.020346 ncdv-master-1 devstack@n-api.service[140492]: Oct 08 20:52:20.020346 ncdv-master-1 devstack@n-api.service[140492]: {"remove_host": {"host": "nonexist_host"}} Oct 08 20:52:20.020346 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 20:52:20.020346 ncdv-master-1 devstack@n-api.service[140492]: exception: Cannot remove host nonexist_host in aggregate 16 Oct 08 20:52:20.021048 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': '16', 'body': {'remove_host': {'host': 'nonexist_host'}}} Oct 08 20:52:20.021048 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:52:20.021048 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:52:20.021048 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Oct 08 20:52:20.021048 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 08 20:52:20.021048 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 08 20:52:20.021048 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 08 20:52:20.021048 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 08 20:52:20.021048 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 08 20:52:20.021048 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 08 20:52:20.021048 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 08 20:52:20.021048 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 08 20:52:20.021048 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 08 20:52:20.021048 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Oct 08 20:52:20.021048 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:52:20.021048 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:52:20.021048 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:52:20.021048 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:52:20.021048 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Oct 08 20:52:20.021048 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Oct 08 20:52:20.022137 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 08 20:52:20.022137 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 08 20:52:20.022137 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 08 20:52:20.022137 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:52:20.022137 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:52:20.022137 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:52:20.022137 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:52:20.022137 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Oct 08 20:52:20.022137 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Oct 08 20:52:20.022137 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 08 20:52:20.022137 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 08 20:52:20.022137 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 08 20:52:20.022137 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 08 20:52:20.022137 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 08 20:52:20.022137 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise self.value Oct 08 20:52:20.022137 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 08 20:52:20.022137 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 08 20:52:20.022137 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6683, in remove_host_from_aggregate Oct 08 20:52:20.022137 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Oct 08 20:52:20.022137 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Oct 08 20:52:20.023495 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Oct 08 20:52:20.023495 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Oct 08 20:52:20.023495 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:52:20.023495 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:52:20.023495 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:52:20.023495 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:52:20.023495 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:52:20.023495 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:52:20.023495 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:52:20.023495 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:52:20.023495 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:52:20.023495 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:52:20.023495 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 20:52:20.023495 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 20:52:20.023495 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Oct 08 20:52:20.023495 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 08 20:52:20.023495 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 16 Oct 08 20:52:20.023495 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:52:20.023495 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:52:20.023495 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:52:20.023495 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:52:20.025436 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:52:20.025436 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:52:20.025436 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 20:52:20.025436 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 20:52:20.025436 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 16 Oct 08 20:52:20.025436 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:52:20.025436 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-0ba5f3de-0713-486e-8024-35786e5b759b tempest-AggregatesAdminNegativeTestJSON-367865409 tempest-AggregatesAdminNegativeTestJSON-367865409-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 16 {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:52:20.025436 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-0ba5f3de-0713-486e-8024-35786e5b759b tempest-AggregatesAdminNegativeTestJSON-367865409 tempest-AggregatesAdminNegativeTestJSON-367865409-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates/16/action" status: 404 len: 94 microversion: 2.1 time: 0.063346 Oct 08 20:52:20.025436 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 140/270] 10.222.0.26 () {60 vars in 1194 bytes} [Sat Oct 8 20:52:19 2022] POST /compute/v2.1/os-aggregates/16/action => generated 94 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 08 20:52:20.027852 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-5da5aa1a-4285-461b-a0d9-8ade7c061933 tempest-AggregatesAdminNegativeTestJSON-367865409 tempest-AggregatesAdminNegativeTestJSON-367865409-project-admin] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:20.032750 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-dc80a70e-93ab-424e-8fb4-967870e3e0d1 tempest-AggregatesAdminTestJSON-1599742552 tempest-AggregatesAdminTestJSON-1599742552-project-admin] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:20.058503 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-5da5aa1a-4285-461b-a0d9-8ade7c061933 tempest-AggregatesAdminNegativeTestJSON-367865409 tempest-AggregatesAdminNegativeTestJSON-367865409-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.036474 Oct 08 20:52:20.066390 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 141/271] 10.222.0.26 () {58 vars in 1155 bytes} [Sat Oct 8 20:52:20 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Oct 08 20:52:20.076395 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-dc80a70e-93ab-424e-8fb4-967870e3e0d1 tempest-AggregatesAdminTestJSON-1599742552 tempest-AggregatesAdminTestJSON-1599742552-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.064280 Oct 08 20:52:20.077307 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 131/272] 10.222.0.26 () {58 vars in 1155 bytes} [Sat Oct 8 20:52:20 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 08 20:52:20.086753 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-3a76dc9f-73fb-4430-8bb6-0f403e2ab912 tempest-AggregatesAdminTestJSON-1599742552 tempest-AggregatesAdminTestJSON-1599742552-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-604728257", "availability_zone": "tempest-test_az-454521391"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:52:20.099631 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-e0fc8a9a-ca68-42a3-b208-dbb18defcb2f tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:20.103971 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-e0fc8a9a-ca68-42a3-b208-dbb18defcb2f tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] [instance: 1af12bcb-5e2a-4c15-8673-fa41701cb4c7] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:52:20.112131 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e0fc8a9a-ca68-42a3-b208-dbb18defcb2f tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:20.112901 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e0fc8a9a-ca68-42a3-b208-dbb18defcb2f tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:20.113640 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e0fc8a9a-ca68-42a3-b208-dbb18defcb2f tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:20.114999 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e0fc8a9a-ca68-42a3-b208-dbb18defcb2f tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:20.115955 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e0fc8a9a-ca68-42a3-b208-dbb18defcb2f tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:20.116297 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.objects.aggregate [None req-3a76dc9f-73fb-4430-8bb6-0f403e2ab912 tempest-AggregatesAdminTestJSON-1599742552 tempest-AggregatesAdminTestJSON-1599742552-project-admin] Generated uuid f8cb8f7c-12ad-43d7-bcda-efdfcf1b5a85 for aggregate {{(pid=140492) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 08 20:52:20.116768 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e0fc8a9a-ca68-42a3-b208-dbb18defcb2f tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:20.147408 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-3a76dc9f-73fb-4430-8bb6-0f403e2ab912 tempest-AggregatesAdminTestJSON-1599742552 tempest-AggregatesAdminTestJSON-1599742552-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.064412 Oct 08 20:52:20.148289 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 142/273] 10.222.0.26 () {60 vars in 1165 bytes} [Sat Oct 8 20:52:20 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:52:20.167728 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-121b0636-550a-4912-aff2-e8249e07be52 tempest-AggregatesAdminTestJSON-1599742552 tempest-AggregatesAdminTestJSON-1599742552-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-604728257_new", "availability_zone": "tempest-test_az-454521391_new"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:52:20.229668 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-121b0636-550a-4912-aff2-e8249e07be52 tempest-AggregatesAdminTestJSON-1599742552 tempest-AggregatesAdminTestJSON-1599742552-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:20.230466 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-121b0636-550a-4912-aff2-e8249e07be52 tempest-AggregatesAdminTestJSON-1599742552 tempest-AggregatesAdminTestJSON-1599742552-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:20.232087 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-121b0636-550a-4912-aff2-e8249e07be52 tempest-AggregatesAdminTestJSON-1599742552 tempest-AggregatesAdminTestJSON-1599742552-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:20.276908 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-121b0636-550a-4912-aff2-e8249e07be52 tempest-AggregatesAdminTestJSON-1599742552 tempest-AggregatesAdminTestJSON-1599742552-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-aggregates/17" status: 200 len: 334 microversion: 2.1 time: 0.120718 Oct 08 20:52:20.277870 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 143/274] 10.222.0.26 () {60 vars in 1173 bytes} [Sat Oct 8 20:52:20 2022] PUT /compute/v2.1/os-aggregates/17 => generated 334 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:52:20.295576 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-29c5a990-11c0-4a19-9122-2326b34f599f tempest-AggregatesAdminTestJSON-1599742552 tempest-AggregatesAdminTestJSON-1599742552-project-admin] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:20.298287 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-e0fc8a9a-ca68-42a3-b208-dbb18defcb2f tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb78cce5f7c4c348045745f40b13129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16530e0f2f0a4d23918261c9e21f9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:20.310836 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-e0fc8a9a-ca68-42a3-b208-dbb18defcb2f tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cb78cce5f7c4c348045745f40b13129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16530e0f2f0a4d23918261c9e21f9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:20.315230 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-e0fc8a9a-ca68-42a3-b208-dbb18defcb2f tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cb78cce5f7c4c348045745f40b13129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16530e0f2f0a4d23918261c9e21f9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:20.316011 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-29c5a990-11c0-4a19-9122-2326b34f599f tempest-AggregatesAdminTestJSON-1599742552 tempest-AggregatesAdminTestJSON-1599742552-project-admin] 10.222.0.26 "GET /compute/v2.1/os-aggregates" status: 200 len: 337 microversion: 2.1 time: 0.030320 Oct 08 20:52:20.317053 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 144/275] 10.222.0.26 () {58 vars in 1143 bytes} [Sat Oct 8 20:52:20 2022] GET /compute/v2.1/os-aggregates => generated 337 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:52:20.329448 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-eb4e8592-7abc-4fff-89a1-54e3c7e67a9e tempest-AggregatesAdminTestJSON-1599742552 tempest-AggregatesAdminTestJSON-1599742552-project-admin] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:20.333365 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-e0fc8a9a-ca68-42a3-b208-dbb18defcb2f tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] 10.222.0.26 "GET /compute/v2.1/servers/1af12bcb-5e2a-4c15-8673-fa41701cb4c7" status: 200 len: 1417 microversion: 2.75 time: 0.242653 Oct 08 20:52:20.339857 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 132/276] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:52:20 2022] GET /compute/v2.1/servers/1af12bcb-5e2a-4c15-8673-fa41701cb4c7 => generated 1417 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:52:20.363771 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-eb4e8592-7abc-4fff-89a1-54e3c7e67a9e tempest-AggregatesAdminTestJSON-1599742552 tempest-AggregatesAdminTestJSON-1599742552-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.038777 Oct 08 20:52:20.364362 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 145/277] 10.222.0.26 () {58 vars in 1155 bytes} [Sat Oct 8 20:52:20 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Oct 08 20:52:20.366395 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-a1148e47-4c72-4139-aa63-1f88b7dc4086 req-15196c8e-9b9f-4d41-863b-4fce76fba465 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "800ffcdf-e494-44df-97db-1c7fc74f97b6", "tag": "b9c44491-677f-4508-83a4-3fbde3696ff4"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:52:20.378081 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-a8e6756d-33f0-4a67-84b3-87d4b9421ddb tempest-AggregatesAdminTestJSON-1599742552 tempest-AggregatesAdminTestJSON-1599742552-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1623124077"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:52:20.381711 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.objects.aggregate [None req-a8e6756d-33f0-4a67-84b3-87d4b9421ddb tempest-AggregatesAdminTestJSON-1599742552 tempest-AggregatesAdminTestJSON-1599742552-project-admin] Generated uuid af0cfa9a-7fb5-427a-b736-10673f470ade for aggregate {{(pid=140492) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 08 20:52:20.383054 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-a1148e47-4c72-4139-aa63-1f88b7dc4086 req-15196c8e-9b9f-4d41-863b-4fce76fba465 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:20.383579 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-a1148e47-4c72-4139-aa63-1f88b7dc4086 req-15196c8e-9b9f-4d41-863b-4fce76fba465 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:20.386512 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-a1148e47-4c72-4139-aa63-1f88b7dc4086 req-15196c8e-9b9f-4d41-863b-4fce76fba465 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:20.409137 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-a1148e47-4c72-4139-aa63-1f88b7dc4086 req-15196c8e-9b9f-4d41-863b-4fce76fba465 service nova] Creating event network-changed:b9c44491-677f-4508-83a4-3fbde3696ff4 for instance 800ffcdf-e494-44df-97db-1c7fc74f97b6 on nch2-master-1 Oct 08 20:52:20.414577 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-a1148e47-4c72-4139-aa63-1f88b7dc4086 req-15196c8e-9b9f-4d41-863b-4fce76fba465 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051938 Oct 08 20:52:20.415507 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 133/278] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:52:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 08 20:52:20.415829 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-a8e6756d-33f0-4a67-84b3-87d4b9421ddb tempest-AggregatesAdminTestJSON-1599742552 tempest-AggregatesAdminTestJSON-1599742552-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.044778 Oct 08 20:52:20.416560 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 146/279] 10.222.0.26 () {60 vars in 1164 bytes} [Sat Oct 8 20:52:20 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:52:20.431924 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-0f7cde84-06c7-4031-a1e8-c72491e3a080 tempest-AggregatesAdminTestJSON-1599742552 tempest-AggregatesAdminTestJSON-1599742552-project-admin] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:20.442310 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-0f7cde84-06c7-4031-a1e8-c72491e3a080 tempest-AggregatesAdminTestJSON-1599742552 tempest-AggregatesAdminTestJSON-1599742552-project-admin] 10.222.0.26 "GET /compute/v2.1/os-aggregates" status: 200 len: 231 microversion: 2.1 time: 0.016411 Oct 08 20:52:20.443113 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 134/280] 10.222.0.26 () {58 vars in 1143 bytes} [Sat Oct 8 20:52:20 2022] GET /compute/v2.1/os-aggregates => generated 231 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:52:20.455164 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-bbd964e6-e217-4657-b9f0-e110d29c2bd3 tempest-AggregatesAdminTestJSON-1599742552 tempest-AggregatesAdminTestJSON-1599742552-project-admin] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:20.523656 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-bbd964e6-e217-4657-b9f0-e110d29c2bd3 tempest-AggregatesAdminTestJSON-1599742552 tempest-AggregatesAdminTestJSON-1599742552-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.072653 Oct 08 20:52:20.525270 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 147/281] 10.222.0.26 () {58 vars in 1155 bytes} [Sat Oct 8 20:52:20 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 08 20:52:20.535634 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-55b9c4b4-c80d-4250-9b43-04837c6a1949 tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:20.536287 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-55b9c4b4-c80d-4250-9b43-04837c6a1949 tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] [instance: bbff4ffb-395f-4eeb-a995-60c9c0f39f25] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:52:20.546783 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-55b9c4b4-c80d-4250-9b43-04837c6a1949 tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:20.547286 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-55b9c4b4-c80d-4250-9b43-04837c6a1949 tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:20.547734 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-55b9c4b4-c80d-4250-9b43-04837c6a1949 tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:20.550599 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-55b9c4b4-c80d-4250-9b43-04837c6a1949 tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:20.551101 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-55b9c4b4-c80d-4250-9b43-04837c6a1949 tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:20.551671 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-55b9c4b4-c80d-4250-9b43-04837c6a1949 tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:20.569120 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-55b9c4b4-c80d-4250-9b43-04837c6a1949 tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] HTTP exception thrown: Instance bbff4ffb-395f-4eeb-a995-60c9c0f39f25 could not be found. Oct 08 20:52:20.571608 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-55b9c4b4-c80d-4250-9b43-04837c6a1949 tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Request method failure captured: Oct 08 20:52:20.571608 ncdv-master-1 devstack@n-api.service[140491]: request: DELETE /compute/v2.1/servers/bbff4ffb-395f-4eeb-a995-60c9c0f39f25 HTTP/1.1 Oct 08 20:52:20.571608 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 20:52:20.571608 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 20:52:20.571608 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 20:52:20.571608 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 20:52:20.571608 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 20:52:20.571608 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 20:52:20.571608 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 20:52:20.571608 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 20:52:20.571608 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeLVw8wpvZ-O55cbhjgMKZ9dsrUuNQHukJsCUNA8KTiUu29deiTIiRssDs5a9CfiraQDOvzgu1jTjSQWATDh2C_HpElt2Opau-1lJ83aJnS5IXYzMQp83K1mhlzg7lfqj5iARudP1EIO46PJu2l2HF-LTdU5CjWFlJIow9ZKqwTExAE Oct 08 20:52:20.571608 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 20:52:20.571608 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 20:52:20.571608 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 20:52:20.571608 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 20:52:20.571608 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 20:52:20.571608 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 20:52:20.571608 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: d024396aef784f3291630c426a828cf0 Oct 08 20:52:20.571608 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-AggregatesAdminTestJSON-225803517 Oct 08 20:52:20.571608 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 20:52:20.571608 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 20:52:20.573016 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d024396aef784f3291630c426a828cf0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d024396aef784f3291630c426a828cf0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d024396aef784f3291630c426a828cf0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d024396aef784f3291630c426a828cf0"}]}] Oct 08 20:52:20.573016 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-AggregatesAdminTestJSON-225803517 Oct 08 20:52:20.573016 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: d024396aef784f3291630c426a828cf0 Oct 08 20:52:20.573016 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-225803517 Oct 08 20:52:20.573016 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-AggregatesAdminTestJSON-225803517-project Oct 08 20:52:20.573016 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 20:52:20.573016 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 20:52:20.573016 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: d8da7d5210cf42bda150d342ff207bbd Oct 08 20:52:20.573016 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-AggregatesAdminTestJSON-225803517-project Oct 08 20:52:20.573016 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 20:52:20.573016 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance bbff4ffb-395f-4eeb-a995-60c9c0f39f25 could not be found. Oct 08 20:52:20.573016 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': 'bbff4ffb-395f-4eeb-a995-60c9c0f39f25'} Oct 08 20:52:20.573718 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:52:20.573718 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:52:20.573718 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 20:52:20.573718 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 20:52:20.573718 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 20:52:20.573718 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 20:52:20.573718 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 20:52:20.573718 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 20:52:20.573718 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 20:52:20.573718 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 20:52:20.573718 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbff4ffb-395f-4eeb-a995-60c9c0f39f25 could not be found. Oct 08 20:52:20.573718 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:52:20.573718 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:52:20.573718 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:52:20.573718 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:52:20.573718 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:52:20.573718 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:52:20.573718 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:52:20.573718 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:52:20.573718 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:52:20.575157 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:52:20.575157 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 08 20:52:20.575157 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 08 20:52:20.575157 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 08 20:52:20.575157 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 08 20:52:20.575157 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 20:52:20.575157 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 20:52:20.575157 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 20:52:20.575157 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 20:52:20.575157 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbff4ffb-395f-4eeb-a995-60c9c0f39f25 could not be found. Oct 08 20:52:20.575157 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:52:20.575157 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:52:20.575157 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:52:20.575157 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:52:20.575157 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:52:20.575157 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:52:20.575157 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 20:52:20.575157 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 20:52:20.575157 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbff4ffb-395f-4eeb-a995-60c9c0f39f25 could not be found. Oct 08 20:52:20.575157 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:52:20.576197 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-55b9c4b4-c80d-4250-9b43-04837c6a1949 tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Returning 404 to user: Instance bbff4ffb-395f-4eeb-a995-60c9c0f39f25 could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:52:20.576197 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-55b9c4b4-c80d-4250-9b43-04837c6a1949 tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] 10.222.0.26 "DELETE /compute/v2.1/servers/bbff4ffb-395f-4eeb-a995-60c9c0f39f25" status: 404 len: 111 microversion: 2.1 time: 0.043098 Oct 08 20:52:20.576197 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 135/282] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 20:52:20 2022] DELETE /compute/v2.1/servers/bbff4ffb-395f-4eeb-a995-60c9c0f39f25 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 20:52:20.585535 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-b3d1a84d-2f01-43cf-a449-bdd237a2625c tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:20.586171 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-b3d1a84d-2f01-43cf-a449-bdd237a2625c tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] [instance: bbff4ffb-395f-4eeb-a995-60c9c0f39f25] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:52:20.594373 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b3d1a84d-2f01-43cf-a449-bdd237a2625c tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:20.595181 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b3d1a84d-2f01-43cf-a449-bdd237a2625c tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:20.597806 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b3d1a84d-2f01-43cf-a449-bdd237a2625c tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:20.599099 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b3d1a84d-2f01-43cf-a449-bdd237a2625c tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:20.601043 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b3d1a84d-2f01-43cf-a449-bdd237a2625c tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:20.601760 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b3d1a84d-2f01-43cf-a449-bdd237a2625c tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:20.618199 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-b3d1a84d-2f01-43cf-a449-bdd237a2625c tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] HTTP exception thrown: Instance bbff4ffb-395f-4eeb-a995-60c9c0f39f25 could not be found. Oct 08 20:52:20.621063 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-b3d1a84d-2f01-43cf-a449-bdd237a2625c tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Request method failure captured: Oct 08 20:52:20.621063 ncdv-master-1 devstack@n-api.service[140492]: request: GET /compute/v2.1/servers/bbff4ffb-395f-4eeb-a995-60c9c0f39f25 HTTP/1.1 Oct 08 20:52:20.621063 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 20:52:20.621063 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 20:52:20.621063 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 20:52:20.621063 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 20:52:20.621063 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 20:52:20.621063 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 20:52:20.621063 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 20:52:20.621063 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 20:52:20.621063 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeLVw8wpvZ-O55cbhjgMKZ9dsrUuNQHukJsCUNA8KTiUu29deiTIiRssDs5a9CfiraQDOvzgu1jTjSQWATDh2C_HpElt2Opau-1lJ83aJnS5IXYzMQp83K1mhlzg7lfqj5iARudP1EIO46PJu2l2HF-LTdU5CjWFlJIow9ZKqwTExAE Oct 08 20:52:20.621063 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 20:52:20.621063 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 20:52:20.621063 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 20:52:20.621063 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 20:52:20.621063 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 20:52:20.621063 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 20:52:20.621063 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: d024396aef784f3291630c426a828cf0 Oct 08 20:52:20.621063 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-AggregatesAdminTestJSON-225803517 Oct 08 20:52:20.621063 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 20:52:20.621063 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 20:52:20.622348 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d024396aef784f3291630c426a828cf0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d024396aef784f3291630c426a828cf0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d024396aef784f3291630c426a828cf0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d024396aef784f3291630c426a828cf0"}]}] Oct 08 20:52:20.622348 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-AggregatesAdminTestJSON-225803517 Oct 08 20:52:20.622348 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: d024396aef784f3291630c426a828cf0 Oct 08 20:52:20.622348 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-225803517 Oct 08 20:52:20.622348 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-AggregatesAdminTestJSON-225803517-project Oct 08 20:52:20.622348 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 20:52:20.622348 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 20:52:20.622348 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: d8da7d5210cf42bda150d342ff207bbd Oct 08 20:52:20.622348 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-AggregatesAdminTestJSON-225803517-project Oct 08 20:52:20.622348 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 20:52:20.622348 ncdv-master-1 devstack@n-api.service[140492]: exception: Instance bbff4ffb-395f-4eeb-a995-60c9c0f39f25 could not be found. Oct 08 20:52:20.622348 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': 'bbff4ffb-395f-4eeb-a995-60c9c0f39f25'} Oct 08 20:52:20.623005 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:52:20.623005 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:52:20.623005 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 20:52:20.623005 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 20:52:20.623005 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 20:52:20.623005 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 20:52:20.623005 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 20:52:20.623005 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 20:52:20.623005 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 20:52:20.623005 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 20:52:20.623005 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbff4ffb-395f-4eeb-a995-60c9c0f39f25 could not be found. Oct 08 20:52:20.623005 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:52:20.623005 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:52:20.623005 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:52:20.623005 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:52:20.623005 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:52:20.623005 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:52:20.623005 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:52:20.623005 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:52:20.623005 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:52:20.624055 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:52:20.624055 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 20:52:20.624055 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 20:52:20.624055 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 20:52:20.624055 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 20:52:20.624055 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 20:52:20.624055 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 20:52:20.624055 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbff4ffb-395f-4eeb-a995-60c9c0f39f25 could not be found. Oct 08 20:52:20.624055 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:52:20.624055 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:52:20.624055 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:52:20.624055 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:52:20.624055 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:52:20.624055 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:52:20.624055 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 20:52:20.624055 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 20:52:20.624055 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbff4ffb-395f-4eeb-a995-60c9c0f39f25 could not be found. Oct 08 20:52:20.624055 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:52:20.625094 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-b3d1a84d-2f01-43cf-a449-bdd237a2625c tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] Returning 404 to user: Instance bbff4ffb-395f-4eeb-a995-60c9c0f39f25 could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:52:20.625094 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-b3d1a84d-2f01-43cf-a449-bdd237a2625c tempest-AggregatesAdminTestJSON-225803517 tempest-AggregatesAdminTestJSON-225803517-project] 10.222.0.26 "GET /compute/v2.1/servers/bbff4ffb-395f-4eeb-a995-60c9c0f39f25" status: 404 len: 111 microversion: 2.1 time: 0.043967 Oct 08 20:52:20.625094 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 148/283] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:52:20 2022] GET /compute/v2.1/servers/bbff4ffb-395f-4eeb-a995-60c9c0f39f25 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 20:52:21.028747 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-4db2e708-53f9-4ab0-abe2-786e17f04e90 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:21.029764 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-4db2e708-53f9-4ab0-abe2-786e17f04e90 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] [instance: 800ffcdf-e494-44df-97db-1c7fc74f97b6] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:52:21.043480 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4db2e708-53f9-4ab0-abe2-786e17f04e90 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:21.044160 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4db2e708-53f9-4ab0-abe2-786e17f04e90 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:21.044902 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4db2e708-53f9-4ab0-abe2-786e17f04e90 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:21.046491 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4db2e708-53f9-4ab0-abe2-786e17f04e90 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:21.047108 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4db2e708-53f9-4ab0-abe2-786e17f04e90 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:21.047984 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4db2e708-53f9-4ab0-abe2-786e17f04e90 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:21.263046 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-4db2e708-53f9-4ab0-abe2-786e17f04e90 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0eb2feb062947e78357b70e832e3edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18029da9b9854f3caf3debd9556f1f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:21.274507 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-4db2e708-53f9-4ab0-abe2-786e17f04e90 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] 10.222.0.26 "GET /compute/v2.1/servers/800ffcdf-e494-44df-97db-1c7fc74f97b6" status: 200 len: 1317 microversion: 2.1 time: 0.251217 Oct 08 20:52:21.275302 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 136/284] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:52:21 2022] GET /compute/v2.1/servers/800ffcdf-e494-44df-97db-1c7fc74f97b6 => generated 1317 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 20:52:21.363581 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-73034728-7cc6-427d-a286-d352158315c0 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:21.364418 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-73034728-7cc6-427d-a286-d352158315c0 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] [instance: 1af12bcb-5e2a-4c15-8673-fa41701cb4c7] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:52:21.371003 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-73034728-7cc6-427d-a286-d352158315c0 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:21.371653 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-73034728-7cc6-427d-a286-d352158315c0 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:21.372449 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-73034728-7cc6-427d-a286-d352158315c0 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:21.373490 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-73034728-7cc6-427d-a286-d352158315c0 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:21.374296 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-73034728-7cc6-427d-a286-d352158315c0 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:21.375277 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-73034728-7cc6-427d-a286-d352158315c0 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:21.462329 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-73034728-7cc6-427d-a286-d352158315c0 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb78cce5f7c4c348045745f40b13129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16530e0f2f0a4d23918261c9e21f9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:21.474226 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-73034728-7cc6-427d-a286-d352158315c0 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cb78cce5f7c4c348045745f40b13129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16530e0f2f0a4d23918261c9e21f9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:21.475755 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-73034728-7cc6-427d-a286-d352158315c0 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cb78cce5f7c4c348045745f40b13129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16530e0f2f0a4d23918261c9e21f9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:21.481043 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-73034728-7cc6-427d-a286-d352158315c0 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] 10.222.0.26 "GET /compute/v2.1/servers/1af12bcb-5e2a-4c15-8673-fa41701cb4c7" status: 200 len: 1417 microversion: 2.75 time: 0.123084 Oct 08 20:52:21.494394 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 137/285] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:52:21 2022] GET /compute/v2.1/servers/1af12bcb-5e2a-4c15-8673-fa41701cb4c7 => generated 1417 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 08 20:52:21.915478 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-d83290b5-b946-4556-8739-2f768dc57710 tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-2083634709", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:52:22.034019 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.network.neutron [None req-d83290b5-b946-4556-8739-2f768dc57710 tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] validate_networks() for None {{(pid=140492) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 20:52:22.299559 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-aa2bec88-6572-4a91-bb56-ca8e5e789053 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:22.300293 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-aa2bec88-6572-4a91-bb56-ca8e5e789053 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] [instance: 800ffcdf-e494-44df-97db-1c7fc74f97b6] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:52:22.313344 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-aa2bec88-6572-4a91-bb56-ca8e5e789053 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:22.314951 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-aa2bec88-6572-4a91-bb56-ca8e5e789053 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:22.315613 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-aa2bec88-6572-4a91-bb56-ca8e5e789053 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:22.317521 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-aa2bec88-6572-4a91-bb56-ca8e5e789053 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:22.317996 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-aa2bec88-6572-4a91-bb56-ca8e5e789053 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:22.318432 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-aa2bec88-6572-4a91-bb56-ca8e5e789053 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:22.475148 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-d83290b5-b946-4556-8739-2f768dc57710 tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] Flavor limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 20:52:22.475774 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-d83290b5-b946-4556-8739-2f768dc57710 tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] Image limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 20:52:22.476398 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-d83290b5-b946-4556-8739-2f768dc57710 tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] Flavor pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 20:52:22.477090 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-d83290b5-b946-4556-8739-2f768dc57710 tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] Image pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 20:52:22.478238 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-d83290b5-b946-4556-8739-2f768dc57710 tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 20:52:22.512900 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d83290b5-b946-4556-8739-2f768dc57710 tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:22.513696 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d83290b5-b946-4556-8739-2f768dc57710 tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:22.514443 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d83290b5-b946-4556-8739-2f768dc57710 tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:22.515784 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d83290b5-b946-4556-8739-2f768dc57710 tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:22.517258 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d83290b5-b946-4556-8739-2f768dc57710 tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:22.517932 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d83290b5-b946-4556-8739-2f768dc57710 tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:22.547480 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-d83290b5-b946-4556-8739-2f768dc57710 tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] Getting quotas for project 4e5f13ede0474c1888ffb1f7168daf67. Resources: {'cores', 'instances', 'ram'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 20:52:22.551619 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=6,nova_api:DELETE=9,nova_api:UPDATE=2 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:22.555938 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-d83290b5-b946-4556-8739-2f768dc57710 tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] Getting quotas for user 037c74c1e22148c6ba7612cb03d8bd02 and project 4e5f13ede0474c1888ffb1f7168daf67. Resources: {'cores', 'instances', 'ram'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 20:52:22.573757 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-d83290b5-b946-4556-8739-2f768dc57710 tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] Going to run 1 instances... {{(pid=140492) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 20:52:22.577141 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-d83290b5-b946-4556-8739-2f768dc57710 tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] [instance: 88c3b2e3-7038-460b-9874-b120c573c2b7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c508bd7f-7db9-4b2c-af7c-be54a855c355',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140492) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 20:52:22.590965 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-aa2bec88-6572-4a91-bb56-ca8e5e789053 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0eb2feb062947e78357b70e832e3edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18029da9b9854f3caf3debd9556f1f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:22.602870 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-aa2bec88-6572-4a91-bb56-ca8e5e789053 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] 10.222.0.26 "GET /compute/v2.1/servers/800ffcdf-e494-44df-97db-1c7fc74f97b6" status: 200 len: 1317 microversion: 2.1 time: 0.308981 Oct 08 20:52:22.603888 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 138/286] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:52:22 2022] GET /compute/v2.1/servers/800ffcdf-e494-44df-97db-1c7fc74f97b6 => generated 1317 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:52:22.610736 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-a9e8e983-1abf-49fa-b34a-c9b5fc2ebfff tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:22.611438 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-a9e8e983-1abf-49fa-b34a-c9b5fc2ebfff tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] [instance: 1af12bcb-5e2a-4c15-8673-fa41701cb4c7] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:52:22.633239 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a9e8e983-1abf-49fa-b34a-c9b5fc2ebfff tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:22.634030 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a9e8e983-1abf-49fa-b34a-c9b5fc2ebfff tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:22.635006 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a9e8e983-1abf-49fa-b34a-c9b5fc2ebfff tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:22.637226 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a9e8e983-1abf-49fa-b34a-c9b5fc2ebfff tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:22.637931 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a9e8e983-1abf-49fa-b34a-c9b5fc2ebfff tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:22.638564 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a9e8e983-1abf-49fa-b34a-c9b5fc2ebfff tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:22.650194 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-d83290b5-b946-4556-8739-2f768dc57710 tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.329724 Oct 08 20:52:22.651870 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 149/287] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 20:52:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 1332 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 08 20:52:22.670422 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-8fe3fd24-8c04-4984-be58-0602ccd48915 tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:22.674271 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-8fe3fd24-8c04-4984-be58-0602ccd48915 tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] [instance: 88c3b2e3-7038-460b-9874-b120c573c2b7] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:52:22.748130 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-a9e8e983-1abf-49fa-b34a-c9b5fc2ebfff tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb78cce5f7c4c348045745f40b13129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16530e0f2f0a4d23918261c9e21f9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:22.757581 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-a9e8e983-1abf-49fa-b34a-c9b5fc2ebfff tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cb78cce5f7c4c348045745f40b13129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16530e0f2f0a4d23918261c9e21f9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:22.769220 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-a9e8e983-1abf-49fa-b34a-c9b5fc2ebfff tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cb78cce5f7c4c348045745f40b13129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16530e0f2f0a4d23918261c9e21f9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:22.775661 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-a9e8e983-1abf-49fa-b34a-c9b5fc2ebfff tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] 10.222.0.26 "GET /compute/v2.1/servers/1af12bcb-5e2a-4c15-8673-fa41701cb4c7" status: 200 len: 1438 microversion: 2.75 time: 0.170625 Oct 08 20:52:22.788258 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 139/288] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:52:22 2022] GET /compute/v2.1/servers/1af12bcb-5e2a-4c15-8673-fa41701cb4c7 => generated 1438 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:52:22.808226 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-1061fa9a-39ed-4f8b-8eb2-5ac3a6b6fcc3 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:52:22.809543 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-8fe3fd24-8c04-4984-be58-0602ccd48915 tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c74c1e22148c6ba7612cb03d8bd02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e5f13ede0474c1888ffb1f7168daf67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:22.811282 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-1061fa9a-39ed-4f8b-8eb2-5ac3a6b6fcc3 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] [instance: 1af12bcb-5e2a-4c15-8673-fa41701cb4c7] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:52:22.817905 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1061fa9a-39ed-4f8b-8eb2-5ac3a6b6fcc3 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:22.818514 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1061fa9a-39ed-4f8b-8eb2-5ac3a6b6fcc3 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:22.819060 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1061fa9a-39ed-4f8b-8eb2-5ac3a6b6fcc3 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:22.819875 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1061fa9a-39ed-4f8b-8eb2-5ac3a6b6fcc3 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:22.820540 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1061fa9a-39ed-4f8b-8eb2-5ac3a6b6fcc3 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:22.821091 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1061fa9a-39ed-4f8b-8eb2-5ac3a6b6fcc3 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:22.824907 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-8fe3fd24-8c04-4984-be58-0602ccd48915 tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] 10.222.0.26 "GET /compute/v2.1/servers/88c3b2e3-7038-460b-9874-b120c573c2b7" status: 200 len: 1223 microversion: 2.1 time: 0.161559 Oct 08 20:52:22.842437 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 150/289] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:52:22 2022] GET /compute/v2.1/servers/88c3b2e3-7038-460b-9874-b120c573c2b7 => generated 1223 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:52:22.964693 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-1061fa9a-39ed-4f8b-8eb2-5ac3a6b6fcc3 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Flavor limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 20:52:22.965730 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-1061fa9a-39ed-4f8b-8eb2-5ac3a6b6fcc3 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Image limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 20:52:22.966531 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-1061fa9a-39ed-4f8b-8eb2-5ac3a6b6fcc3 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Flavor pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 20:52:22.967548 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-1061fa9a-39ed-4f8b-8eb2-5ac3a6b6fcc3 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Image pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 20:52:22.968342 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-1061fa9a-39ed-4f8b-8eb2-5ac3a6b6fcc3 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 20:52:23.146224 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-1061fa9a-39ed-4f8b-8eb2-5ac3a6b6fcc3 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] [instance: 1af12bcb-5e2a-4c15-8673-fa41701cb4c7] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:52:23.152889 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1061fa9a-39ed-4f8b-8eb2-5ac3a6b6fcc3 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:23.153550 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1061fa9a-39ed-4f8b-8eb2-5ac3a6b6fcc3 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:23.154003 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1061fa9a-39ed-4f8b-8eb2-5ac3a6b6fcc3 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:23.154815 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1061fa9a-39ed-4f8b-8eb2-5ac3a6b6fcc3 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:23.155433 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1061fa9a-39ed-4f8b-8eb2-5ac3a6b6fcc3 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:23.156939 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1061fa9a-39ed-4f8b-8eb2-5ac3a6b6fcc3 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:23.163024 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:23.322923 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-1061fa9a-39ed-4f8b-8eb2-5ac3a6b6fcc3 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb78cce5f7c4c348045745f40b13129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16530e0f2f0a4d23918261c9e21f9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:23.350012 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-1061fa9a-39ed-4f8b-8eb2-5ac3a6b6fcc3 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cb78cce5f7c4c348045745f40b13129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16530e0f2f0a4d23918261c9e21f9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:23.356213 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-1061fa9a-39ed-4f8b-8eb2-5ac3a6b6fcc3 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cb78cce5f7c4c348045745f40b13129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16530e0f2f0a4d23918261c9e21f9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:23.378735 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-1061fa9a-39ed-4f8b-8eb2-5ac3a6b6fcc3 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] 10.222.0.26 "POST /compute/v2.1/servers/1af12bcb-5e2a-4c15-8673-fa41701cb4c7/action" status: 202 len: 1495 microversion: 2.75 time: 0.572863 Oct 08 20:52:23.381429 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 140/290] 10.222.0.26 () {62 vars in 1319 bytes} [Sat Oct 8 20:52:22 2022] POST /compute/v2.1/servers/1af12bcb-5e2a-4c15-8673-fa41701cb4c7/action => generated 1495 bytes in 578 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Oct 08 20:52:23.409902 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-c88964ba-ee16-48f0-83a1-d932feb2dbd3 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:23.410814 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-c88964ba-ee16-48f0-83a1-d932feb2dbd3 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] [instance: 1af12bcb-5e2a-4c15-8673-fa41701cb4c7] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:52:23.422740 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c88964ba-ee16-48f0-83a1-d932feb2dbd3 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:23.423243 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c88964ba-ee16-48f0-83a1-d932feb2dbd3 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:23.423687 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c88964ba-ee16-48f0-83a1-d932feb2dbd3 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:23.424394 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c88964ba-ee16-48f0-83a1-d932feb2dbd3 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:23.424855 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c88964ba-ee16-48f0-83a1-d932feb2dbd3 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:23.425297 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c88964ba-ee16-48f0-83a1-d932feb2dbd3 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:23.608786 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-c88964ba-ee16-48f0-83a1-d932feb2dbd3 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb78cce5f7c4c348045745f40b13129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16530e0f2f0a4d23918261c9e21f9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:23.625154 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-c88964ba-ee16-48f0-83a1-d932feb2dbd3 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cb78cce5f7c4c348045745f40b13129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16530e0f2f0a4d23918261c9e21f9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:23.627600 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-c88964ba-ee16-48f0-83a1-d932feb2dbd3 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cb78cce5f7c4c348045745f40b13129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16530e0f2f0a4d23918261c9e21f9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:23.629378 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-47229bb0-758f-40f1-8d08-9f974fa92f0a tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:23.630808 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-47229bb0-758f-40f1-8d08-9f974fa92f0a tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] [instance: 800ffcdf-e494-44df-97db-1c7fc74f97b6] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:52:23.640891 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-c88964ba-ee16-48f0-83a1-d932feb2dbd3 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] 10.222.0.26 "GET /compute/v2.1/servers/1af12bcb-5e2a-4c15-8673-fa41701cb4c7" status: 200 len: 1447 microversion: 2.75 time: 0.235299 Oct 08 20:52:23.650447 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 151/291] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:52:23 2022] GET /compute/v2.1/servers/1af12bcb-5e2a-4c15-8673-fa41701cb4c7 => generated 1447 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:52:23.672915 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-47229bb0-758f-40f1-8d08-9f974fa92f0a tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:23.677292 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-47229bb0-758f-40f1-8d08-9f974fa92f0a tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:23.683100 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-47229bb0-758f-40f1-8d08-9f974fa92f0a tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:23.685656 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-47229bb0-758f-40f1-8d08-9f974fa92f0a tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:23.686992 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-47229bb0-758f-40f1-8d08-9f974fa92f0a tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:23.689857 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-47229bb0-758f-40f1-8d08-9f974fa92f0a tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:23.860138 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-6aff1c3e-1d08-4be5-acae-2444faf52a71 tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:23.861011 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-6aff1c3e-1d08-4be5-acae-2444faf52a71 tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] [instance: 88c3b2e3-7038-460b-9874-b120c573c2b7] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:52:23.876191 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6aff1c3e-1d08-4be5-acae-2444faf52a71 tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:23.879049 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6aff1c3e-1d08-4be5-acae-2444faf52a71 tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:23.881057 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6aff1c3e-1d08-4be5-acae-2444faf52a71 tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:23.882082 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6aff1c3e-1d08-4be5-acae-2444faf52a71 tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:23.884771 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6aff1c3e-1d08-4be5-acae-2444faf52a71 tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:23.885446 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6aff1c3e-1d08-4be5-acae-2444faf52a71 tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:23.960465 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-47229bb0-758f-40f1-8d08-9f974fa92f0a tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0eb2feb062947e78357b70e832e3edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18029da9b9854f3caf3debd9556f1f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:23.971969 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-6aff1c3e-1d08-4be5-acae-2444faf52a71 tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c74c1e22148c6ba7612cb03d8bd02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e5f13ede0474c1888ffb1f7168daf67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:23.972542 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-47229bb0-758f-40f1-8d08-9f974fa92f0a tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] 10.222.0.26 "GET /compute/v2.1/servers/800ffcdf-e494-44df-97db-1c7fc74f97b6" status: 200 len: 1317 microversion: 2.1 time: 0.346622 Oct 08 20:52:23.973433 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 141/292] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:52:23 2022] GET /compute/v2.1/servers/800ffcdf-e494-44df-97db-1c7fc74f97b6 => generated 1317 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:52:23.998927 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-6aff1c3e-1d08-4be5-acae-2444faf52a71 tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] 10.222.0.26 "GET /compute/v2.1/servers/88c3b2e3-7038-460b-9874-b120c573c2b7" status: 200 len: 1219 microversion: 2.1 time: 0.149630 Oct 08 20:52:24.001795 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 152/293] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:52:23 2022] GET /compute/v2.1/servers/88c3b2e3-7038-460b-9874-b120c573c2b7 => generated 1219 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:52:24.641348 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-cfab5cc6-5d0e-4788-8a8b-831dc8bbc944 tempest-ServicesAdminTestJSON-240237836 tempest-ServicesAdminTestJSON-240237836-project-admin] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:24.646726 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cfab5cc6-5d0e-4788-8a8b-831dc8bbc944 tempest-ServicesAdminTestJSON-240237836 tempest-ServicesAdminTestJSON-240237836-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:24.647378 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cfab5cc6-5d0e-4788-8a8b-831dc8bbc944 tempest-ServicesAdminTestJSON-240237836 tempest-ServicesAdminTestJSON-240237836-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:24.647992 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cfab5cc6-5d0e-4788-8a8b-831dc8bbc944 tempest-ServicesAdminTestJSON-240237836 tempest-ServicesAdminTestJSON-240237836-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:24.648874 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cfab5cc6-5d0e-4788-8a8b-831dc8bbc944 tempest-ServicesAdminTestJSON-240237836 tempest-ServicesAdminTestJSON-240237836-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:24.653020 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cfab5cc6-5d0e-4788-8a8b-831dc8bbc944 tempest-ServicesAdminTestJSON-240237836 tempest-ServicesAdminTestJSON-240237836-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:24.653744 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cfab5cc6-5d0e-4788-8a8b-831dc8bbc944 tempest-ServicesAdminTestJSON-240237836 tempest-ServicesAdminTestJSON-240237836-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:24.673621 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=5,nova_api:DELETE=4 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:24.674942 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-d1160c84-8ae2-480e-b138-758c49f888b3 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:24.675583 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-d1160c84-8ae2-480e-b138-758c49f888b3 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] [instance: 1af12bcb-5e2a-4c15-8673-fa41701cb4c7] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:52:24.685666 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-cfab5cc6-5d0e-4788-8a8b-831dc8bbc944 tempest-ServicesAdminTestJSON-240237836 tempest-ServicesAdminTestJSON-240237836-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.394701 Oct 08 20:52:24.686254 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 142/294] 10.222.0.26 () {58 vars in 1137 bytes} [Sat Oct 8 20:52:24 2022] GET /compute/v2.1/os-services => generated 947 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:52:24.694593 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d1160c84-8ae2-480e-b138-758c49f888b3 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:24.695148 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d1160c84-8ae2-480e-b138-758c49f888b3 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:24.695785 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d1160c84-8ae2-480e-b138-758c49f888b3 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:24.696642 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d1160c84-8ae2-480e-b138-758c49f888b3 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:24.701250 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d1160c84-8ae2-480e-b138-758c49f888b3 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:24.701882 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d1160c84-8ae2-480e-b138-758c49f888b3 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:24.705943 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-f1f7a88e-d03a-4e42-938a-5a42117d8e0e tempest-ServicesAdminTestJSON-240237836 tempest-ServicesAdminTestJSON-240237836-project-admin] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:24.712250 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f1f7a88e-d03a-4e42-938a-5a42117d8e0e tempest-ServicesAdminTestJSON-240237836 tempest-ServicesAdminTestJSON-240237836-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:24.714197 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f1f7a88e-d03a-4e42-938a-5a42117d8e0e tempest-ServicesAdminTestJSON-240237836 tempest-ServicesAdminTestJSON-240237836-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:24.716103 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f1f7a88e-d03a-4e42-938a-5a42117d8e0e tempest-ServicesAdminTestJSON-240237836 tempest-ServicesAdminTestJSON-240237836-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:24.720223 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f1f7a88e-d03a-4e42-938a-5a42117d8e0e tempest-ServicesAdminTestJSON-240237836 tempest-ServicesAdminTestJSON-240237836-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:24.720703 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f1f7a88e-d03a-4e42-938a-5a42117d8e0e tempest-ServicesAdminTestJSON-240237836 tempest-ServicesAdminTestJSON-240237836-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:24.721140 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f1f7a88e-d03a-4e42-938a-5a42117d8e0e tempest-ServicesAdminTestJSON-240237836 tempest-ServicesAdminTestJSON-240237836-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:24.763189 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-f1f7a88e-d03a-4e42-938a-5a42117d8e0e tempest-ServicesAdminTestJSON-240237836 tempest-ServicesAdminTestJSON-240237836-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services?host=ncdv-master-1" status: 200 len: 581 microversion: 2.1 time: 0.064234 Oct 08 20:52:24.763803 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 143/295] 10.222.0.26 () {58 vars in 1174 bytes} [Sat Oct 8 20:52:24 2022] GET /compute/v2.1/os-services?host=ncdv-master-1 => generated 581 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:52:24.784629 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-754ed752-bb2a-4b19-b6ce-fcccf5a7dea8 tempest-ServicesAdminTestJSON-240237836 tempest-ServicesAdminTestJSON-240237836-project-admin] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:24.788688 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-754ed752-bb2a-4b19-b6ce-fcccf5a7dea8 tempest-ServicesAdminTestJSON-240237836 tempest-ServicesAdminTestJSON-240237836-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:24.789203 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-754ed752-bb2a-4b19-b6ce-fcccf5a7dea8 tempest-ServicesAdminTestJSON-240237836 tempest-ServicesAdminTestJSON-240237836-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:24.789653 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-754ed752-bb2a-4b19-b6ce-fcccf5a7dea8 tempest-ServicesAdminTestJSON-240237836 tempest-ServicesAdminTestJSON-240237836-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:24.790565 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-754ed752-bb2a-4b19-b6ce-fcccf5a7dea8 tempest-ServicesAdminTestJSON-240237836 tempest-ServicesAdminTestJSON-240237836-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:24.791027 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-754ed752-bb2a-4b19-b6ce-fcccf5a7dea8 tempest-ServicesAdminTestJSON-240237836 tempest-ServicesAdminTestJSON-240237836-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:24.791452 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-754ed752-bb2a-4b19-b6ce-fcccf5a7dea8 tempest-ServicesAdminTestJSON-240237836 tempest-ServicesAdminTestJSON-240237836-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:24.806810 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-d1160c84-8ae2-480e-b138-758c49f888b3 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb78cce5f7c4c348045745f40b13129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16530e0f2f0a4d23918261c9e21f9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:24.823499 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-754ed752-bb2a-4b19-b6ce-fcccf5a7dea8 tempest-ServicesAdminTestJSON-240237836 tempest-ServicesAdminTestJSON-240237836-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.044366 Oct 08 20:52:24.824591 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 144/296] 10.222.0.26 () {58 vars in 1176 bytes} [Sat Oct 8 20:52:24 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:52:24.825723 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-d1160c84-8ae2-480e-b138-758c49f888b3 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cb78cce5f7c4c348045745f40b13129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16530e0f2f0a4d23918261c9e21f9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:24.827577 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-d1160c84-8ae2-480e-b138-758c49f888b3 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cb78cce5f7c4c348045745f40b13129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16530e0f2f0a4d23918261c9e21f9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:24.840376 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-cf0c0718-5ab3-4f36-ab0e-b0505582666d tempest-ServicesAdminTestJSON-240237836 tempest-ServicesAdminTestJSON-240237836-project-admin] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:24.842354 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-d1160c84-8ae2-480e-b138-758c49f888b3 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] 10.222.0.26 "GET /compute/v2.1/servers/1af12bcb-5e2a-4c15-8673-fa41701cb4c7" status: 200 len: 1447 microversion: 2.75 time: 0.174102 Oct 08 20:52:24.845936 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cf0c0718-5ab3-4f36-ab0e-b0505582666d tempest-ServicesAdminTestJSON-240237836 tempest-ServicesAdminTestJSON-240237836-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:24.846808 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cf0c0718-5ab3-4f36-ab0e-b0505582666d tempest-ServicesAdminTestJSON-240237836 tempest-ServicesAdminTestJSON-240237836-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:24.847552 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cf0c0718-5ab3-4f36-ab0e-b0505582666d tempest-ServicesAdminTestJSON-240237836 tempest-ServicesAdminTestJSON-240237836-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:24.848756 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cf0c0718-5ab3-4f36-ab0e-b0505582666d tempest-ServicesAdminTestJSON-240237836 tempest-ServicesAdminTestJSON-240237836-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:24.849529 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cf0c0718-5ab3-4f36-ab0e-b0505582666d tempest-ServicesAdminTestJSON-240237836 tempest-ServicesAdminTestJSON-240237836-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:24.850168 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cf0c0718-5ab3-4f36-ab0e-b0505582666d tempest-ServicesAdminTestJSON-240237836 tempest-ServicesAdminTestJSON-240237836-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:24.862059 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 153/297] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:52:24 2022] GET /compute/v2.1/servers/1af12bcb-5e2a-4c15-8673-fa41701cb4c7 => generated 1447 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:52:24.885033 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-cf0c0718-5ab3-4f36-ab0e-b0505582666d tempest-ServicesAdminTestJSON-240237836 tempest-ServicesAdminTestJSON-240237836-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.051503 Oct 08 20:52:24.886234 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 145/298] 10.222.0.26 () {58 vars in 1137 bytes} [Sat Oct 8 20:52:24 2022] GET /compute/v2.1/os-services => generated 947 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:52:24.999778 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-57879741-baea-4960-983b-e12fcca920d2 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:25.000841 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-57879741-baea-4960-983b-e12fcca920d2 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] [instance: 800ffcdf-e494-44df-97db-1c7fc74f97b6] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:52:25.012290 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-57879741-baea-4960-983b-e12fcca920d2 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:25.016129 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-57879741-baea-4960-983b-e12fcca920d2 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:25.017802 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-57879741-baea-4960-983b-e12fcca920d2 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:25.018599 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-57879741-baea-4960-983b-e12fcca920d2 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:25.019023 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-57879741-baea-4960-983b-e12fcca920d2 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:25.019457 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-57879741-baea-4960-983b-e12fcca920d2 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:25.027403 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-f2769209-0573-4709-9ec4-86e2206bdea3 tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:25.028337 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-f2769209-0573-4709-9ec4-86e2206bdea3 tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] [instance: 88c3b2e3-7038-460b-9874-b120c573c2b7] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:52:25.037828 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f2769209-0573-4709-9ec4-86e2206bdea3 tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:25.038332 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f2769209-0573-4709-9ec4-86e2206bdea3 tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:25.038776 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f2769209-0573-4709-9ec4-86e2206bdea3 tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:25.039757 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f2769209-0573-4709-9ec4-86e2206bdea3 tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:25.039951 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f2769209-0573-4709-9ec4-86e2206bdea3 tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:25.040382 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f2769209-0573-4709-9ec4-86e2206bdea3 tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:25.147600 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-f2769209-0573-4709-9ec4-86e2206bdea3 tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c74c1e22148c6ba7612cb03d8bd02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e5f13ede0474c1888ffb1f7168daf67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:25.156292 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-f2769209-0573-4709-9ec4-86e2206bdea3 tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] 10.222.0.26 "GET /compute/v2.1/servers/88c3b2e3-7038-460b-9874-b120c573c2b7" status: 200 len: 1281 microversion: 2.1 time: 0.132266 Oct 08 20:52:25.158154 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 146/299] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:52:25 2022] GET /compute/v2.1/servers/88c3b2e3-7038-460b-9874-b120c573c2b7 => generated 1281 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 20:52:25.277808 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-57879741-baea-4960-983b-e12fcca920d2 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0eb2feb062947e78357b70e832e3edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18029da9b9854f3caf3debd9556f1f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:25.293992 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-57879741-baea-4960-983b-e12fcca920d2 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] 10.222.0.26 "GET /compute/v2.1/servers/800ffcdf-e494-44df-97db-1c7fc74f97b6" status: 200 len: 1317 microversion: 2.1 time: 0.299460 Oct 08 20:52:25.296019 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 154/300] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:52:24 2022] GET /compute/v2.1/servers/800ffcdf-e494-44df-97db-1c7fc74f97b6 => generated 1317 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:52:25.874152 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-0981f6e3-b3ec-406e-af1b-063fd5faf193 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:25.874984 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-0981f6e3-b3ec-406e-af1b-063fd5faf193 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] [instance: 1af12bcb-5e2a-4c15-8673-fa41701cb4c7] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:52:25.883845 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0981f6e3-b3ec-406e-af1b-063fd5faf193 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:25.887235 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0981f6e3-b3ec-406e-af1b-063fd5faf193 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:25.893587 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0981f6e3-b3ec-406e-af1b-063fd5faf193 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:25.894799 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0981f6e3-b3ec-406e-af1b-063fd5faf193 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:25.895500 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0981f6e3-b3ec-406e-af1b-063fd5faf193 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:25.895962 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0981f6e3-b3ec-406e-af1b-063fd5faf193 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:26.116914 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-0981f6e3-b3ec-406e-af1b-063fd5faf193 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb78cce5f7c4c348045745f40b13129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16530e0f2f0a4d23918261c9e21f9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:26.131146 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-0981f6e3-b3ec-406e-af1b-063fd5faf193 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cb78cce5f7c4c348045745f40b13129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16530e0f2f0a4d23918261c9e21f9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:26.132696 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-0981f6e3-b3ec-406e-af1b-063fd5faf193 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cb78cce5f7c4c348045745f40b13129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16530e0f2f0a4d23918261c9e21f9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:26.144309 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-0981f6e3-b3ec-406e-af1b-063fd5faf193 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] 10.222.0.26 "GET /compute/v2.1/servers/1af12bcb-5e2a-4c15-8673-fa41701cb4c7" status: 200 len: 1447 microversion: 2.75 time: 0.273939 Oct 08 20:52:26.148566 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 147/301] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:52:25 2022] GET /compute/v2.1/servers/1af12bcb-5e2a-4c15-8673-fa41701cb4c7 => generated 1447 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:52:26.181947 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-fd478b0d-55ea-478f-a63d-5224e8dfba84 tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:26.183761 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-fd478b0d-55ea-478f-a63d-5224e8dfba84 tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] [instance: 88c3b2e3-7038-460b-9874-b120c573c2b7] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:52:26.192555 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fd478b0d-55ea-478f-a63d-5224e8dfba84 tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:26.194304 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fd478b0d-55ea-478f-a63d-5224e8dfba84 tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:26.195697 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fd478b0d-55ea-478f-a63d-5224e8dfba84 tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:26.196664 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fd478b0d-55ea-478f-a63d-5224e8dfba84 tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:26.197900 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fd478b0d-55ea-478f-a63d-5224e8dfba84 tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:26.198691 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fd478b0d-55ea-478f-a63d-5224e8dfba84 tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:26.318685 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-e966eaeb-16eb-4f3a-98b0-0431697de6d3 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:26.319652 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-e966eaeb-16eb-4f3a-98b0-0431697de6d3 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] [instance: 800ffcdf-e494-44df-97db-1c7fc74f97b6] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:52:26.331354 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e966eaeb-16eb-4f3a-98b0-0431697de6d3 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:26.334005 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e966eaeb-16eb-4f3a-98b0-0431697de6d3 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:26.334891 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e966eaeb-16eb-4f3a-98b0-0431697de6d3 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:26.344017 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e966eaeb-16eb-4f3a-98b0-0431697de6d3 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:26.344757 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e966eaeb-16eb-4f3a-98b0-0431697de6d3 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:26.346148 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e966eaeb-16eb-4f3a-98b0-0431697de6d3 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:26.677136 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-e966eaeb-16eb-4f3a-98b0-0431697de6d3 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0eb2feb062947e78357b70e832e3edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18029da9b9854f3caf3debd9556f1f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:26.690868 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-e966eaeb-16eb-4f3a-98b0-0431697de6d3 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] 10.222.0.26 "GET /compute/v2.1/servers/800ffcdf-e494-44df-97db-1c7fc74f97b6" status: 200 len: 1317 microversion: 2.1 time: 0.376778 Oct 08 20:52:26.691948 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 148/302] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:52:26 2022] GET /compute/v2.1/servers/800ffcdf-e494-44df-97db-1c7fc74f97b6 => generated 1317 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:52:26.718015 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-fd478b0d-55ea-478f-a63d-5224e8dfba84 tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c74c1e22148c6ba7612cb03d8bd02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e5f13ede0474c1888ffb1f7168daf67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:26.732548 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-fd478b0d-55ea-478f-a63d-5224e8dfba84 tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] 10.222.0.26 "GET /compute/v2.1/servers/88c3b2e3-7038-460b-9874-b120c573c2b7" status: 200 len: 1323 microversion: 2.1 time: 0.553851 Oct 08 20:52:26.735955 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 155/303] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:52:26 2022] GET /compute/v2.1/servers/88c3b2e3-7038-460b-9874-b120c573c2b7 => generated 1323 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 20:52:26.903969 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-799837a6-9870-4375-8afc-64155a15afc5 req-1bbcd3f9-9723-4434-a032-bf4a782178d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88c3b2e3-7038-460b-9874-b120c573c2b7", "tag": "4060d040-c7f9-46d0-918f-a58cdd6bebf1"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:52:26.927584 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-799837a6-9870-4375-8afc-64155a15afc5 req-1bbcd3f9-9723-4434-a032-bf4a782178d4 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:26.929143 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-799837a6-9870-4375-8afc-64155a15afc5 req-1bbcd3f9-9723-4434-a032-bf4a782178d4 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:26.930782 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-799837a6-9870-4375-8afc-64155a15afc5 req-1bbcd3f9-9723-4434-a032-bf4a782178d4 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:26.961795 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-799837a6-9870-4375-8afc-64155a15afc5 req-1bbcd3f9-9723-4434-a032-bf4a782178d4 service nova] Creating event network-changed:4060d040-c7f9-46d0-918f-a58cdd6bebf1 for instance 88c3b2e3-7038-460b-9874-b120c573c2b7 on nch2-master-1 Oct 08 20:52:26.976134 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-799837a6-9870-4375-8afc-64155a15afc5 req-1bbcd3f9-9723-4434-a032-bf4a782178d4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074628 Oct 08 20:52:26.977123 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 149/304] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:52:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:52:27.174279 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-9e4aadc3-7f77-4004-a32f-50419d29262a tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:27.174970 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-9e4aadc3-7f77-4004-a32f-50419d29262a tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] [instance: 1af12bcb-5e2a-4c15-8673-fa41701cb4c7] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:52:27.198356 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9e4aadc3-7f77-4004-a32f-50419d29262a tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:27.200403 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9e4aadc3-7f77-4004-a32f-50419d29262a tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:27.201046 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9e4aadc3-7f77-4004-a32f-50419d29262a tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:27.211983 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9e4aadc3-7f77-4004-a32f-50419d29262a tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:27.213309 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9e4aadc3-7f77-4004-a32f-50419d29262a tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:27.213947 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9e4aadc3-7f77-4004-a32f-50419d29262a tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:27.341292 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-9e4aadc3-7f77-4004-a32f-50419d29262a tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb78cce5f7c4c348045745f40b13129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16530e0f2f0a4d23918261c9e21f9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:27.355933 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-9e4aadc3-7f77-4004-a32f-50419d29262a tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cb78cce5f7c4c348045745f40b13129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16530e0f2f0a4d23918261c9e21f9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:27.358023 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-9e4aadc3-7f77-4004-a32f-50419d29262a tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cb78cce5f7c4c348045745f40b13129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16530e0f2f0a4d23918261c9e21f9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:27.379659 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-9e4aadc3-7f77-4004-a32f-50419d29262a tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] 10.222.0.26 "GET /compute/v2.1/servers/1af12bcb-5e2a-4c15-8673-fa41701cb4c7" status: 200 len: 1447 microversion: 2.75 time: 0.208971 Oct 08 20:52:27.381343 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 156/305] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:52:27 2022] GET /compute/v2.1/servers/1af12bcb-5e2a-4c15-8673-fa41701cb4c7 => generated 1447 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:52:27.575829 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-17b6422b-0fcd-430d-8cb9-f05887942176 req-b24e870e-27c9-442b-af37-2754b9482a94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "800ffcdf-e494-44df-97db-1c7fc74f97b6", "name": "network-vif-plugged", "status": "completed", "tag": "b9c44491-677f-4508-83a4-3fbde3696ff4"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:52:27.595476 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-17b6422b-0fcd-430d-8cb9-f05887942176 req-b24e870e-27c9-442b-af37-2754b9482a94 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:27.599484 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-17b6422b-0fcd-430d-8cb9-f05887942176 req-b24e870e-27c9-442b-af37-2754b9482a94 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:27.599935 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-17b6422b-0fcd-430d-8cb9-f05887942176 req-b24e870e-27c9-442b-af37-2754b9482a94 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:27.622702 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-17b6422b-0fcd-430d-8cb9-f05887942176 req-b24e870e-27c9-442b-af37-2754b9482a94 service nova] Creating event network-vif-plugged:b9c44491-677f-4508-83a4-3fbde3696ff4 for instance 800ffcdf-e494-44df-97db-1c7fc74f97b6 on nch2-master-1 Oct 08 20:52:27.629352 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-17b6422b-0fcd-430d-8cb9-f05887942176 req-b24e870e-27c9-442b-af37-2754b9482a94 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059458 Oct 08 20:52:27.631992 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 157/306] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:52:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:52:27.719069 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-5fda1ee4-9a9b-4e14-baeb-54185740171c tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:27.720156 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-5fda1ee4-9a9b-4e14-baeb-54185740171c tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] [instance: 800ffcdf-e494-44df-97db-1c7fc74f97b6] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:52:27.732975 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5fda1ee4-9a9b-4e14-baeb-54185740171c tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:27.734364 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5fda1ee4-9a9b-4e14-baeb-54185740171c tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:27.737578 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5fda1ee4-9a9b-4e14-baeb-54185740171c tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:27.738637 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5fda1ee4-9a9b-4e14-baeb-54185740171c tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:27.739553 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5fda1ee4-9a9b-4e14-baeb-54185740171c tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:27.742422 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5fda1ee4-9a9b-4e14-baeb-54185740171c tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:27.808595 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-e069c638-1fd9-4cef-8c54-fe0f9866a95b tempest-AZAdminV2TestJSON-36486682 tempest-AZAdminV2TestJSON-36486682-project-admin] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:27.811003 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e069c638-1fd9-4cef-8c54-fe0f9866a95b tempest-AZAdminV2TestJSON-36486682 tempest-AZAdminV2TestJSON-36486682-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:27.811876 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e069c638-1fd9-4cef-8c54-fe0f9866a95b tempest-AZAdminV2TestJSON-36486682 tempest-AZAdminV2TestJSON-36486682-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:27.813215 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e069c638-1fd9-4cef-8c54-fe0f9866a95b tempest-AZAdminV2TestJSON-36486682 tempest-AZAdminV2TestJSON-36486682-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:27.814318 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e069c638-1fd9-4cef-8c54-fe0f9866a95b tempest-AZAdminV2TestJSON-36486682 tempest-AZAdminV2TestJSON-36486682-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:27.814994 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e069c638-1fd9-4cef-8c54-fe0f9866a95b tempest-AZAdminV2TestJSON-36486682 tempest-AZAdminV2TestJSON-36486682-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:27.815721 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e069c638-1fd9-4cef-8c54-fe0f9866a95b tempest-AZAdminV2TestJSON-36486682 tempest-AZAdminV2TestJSON-36486682-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:27.851566 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-e069c638-1fd9-4cef-8c54-fe0f9866a95b tempest-AZAdminV2TestJSON-36486682 tempest-AZAdminV2TestJSON-36486682-project-admin] 10.222.0.26 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.372106 Oct 08 20:52:27.852977 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 150/307] 10.222.0.26 () {58 vars in 1164 bytes} [Sat Oct 8 20:52:27 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 08 20:52:27.862412 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-82eec4f7-9cb9-4142-b01a-5ec9134e8c0a tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:27.863416 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-82eec4f7-9cb9-4142-b01a-5ec9134e8c0a tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] [instance: 88c3b2e3-7038-460b-9874-b120c573c2b7] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:52:27.872235 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-82eec4f7-9cb9-4142-b01a-5ec9134e8c0a tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:27.873481 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-82eec4f7-9cb9-4142-b01a-5ec9134e8c0a tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:27.875730 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-82eec4f7-9cb9-4142-b01a-5ec9134e8c0a tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:27.876991 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-82eec4f7-9cb9-4142-b01a-5ec9134e8c0a tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:27.877699 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-82eec4f7-9cb9-4142-b01a-5ec9134e8c0a tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:27.879219 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-82eec4f7-9cb9-4142-b01a-5ec9134e8c0a tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:28.069970 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-5fda1ee4-9a9b-4e14-baeb-54185740171c tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0eb2feb062947e78357b70e832e3edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18029da9b9854f3caf3debd9556f1f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:28.084568 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-5fda1ee4-9a9b-4e14-baeb-54185740171c tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] 10.222.0.26 "GET /compute/v2.1/servers/800ffcdf-e494-44df-97db-1c7fc74f97b6" status: 200 len: 1317 microversion: 2.1 time: 0.371217 Oct 08 20:52:28.085938 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 158/308] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:52:27 2022] GET /compute/v2.1/servers/800ffcdf-e494-44df-97db-1c7fc74f97b6 => generated 1317 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 20:52:28.092738 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-980e6104-8a18-4e51-97df-15df22346619 tempest-AZAdminV2TestJSON-36486682 tempest-AZAdminV2TestJSON-36486682-project-admin] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:28.095032 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-980e6104-8a18-4e51-97df-15df22346619 tempest-AZAdminV2TestJSON-36486682 tempest-AZAdminV2TestJSON-36486682-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:28.095741 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-980e6104-8a18-4e51-97df-15df22346619 tempest-AZAdminV2TestJSON-36486682 tempest-AZAdminV2TestJSON-36486682-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:28.096275 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-980e6104-8a18-4e51-97df-15df22346619 tempest-AZAdminV2TestJSON-36486682 tempest-AZAdminV2TestJSON-36486682-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:28.097089 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-980e6104-8a18-4e51-97df-15df22346619 tempest-AZAdminV2TestJSON-36486682 tempest-AZAdminV2TestJSON-36486682-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:28.097668 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-980e6104-8a18-4e51-97df-15df22346619 tempest-AZAdminV2TestJSON-36486682 tempest-AZAdminV2TestJSON-36486682-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:28.098163 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-980e6104-8a18-4e51-97df-15df22346619 tempest-AZAdminV2TestJSON-36486682 tempest-AZAdminV2TestJSON-36486682-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:28.099093 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-82eec4f7-9cb9-4142-b01a-5ec9134e8c0a tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c74c1e22148c6ba7612cb03d8bd02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e5f13ede0474c1888ffb1f7168daf67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:28.115561 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-82eec4f7-9cb9-4142-b01a-5ec9134e8c0a tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] 10.222.0.26 "GET /compute/v2.1/servers/88c3b2e3-7038-460b-9874-b120c573c2b7" status: 200 len: 1323 microversion: 2.1 time: 0.260693 Oct 08 20:52:28.131050 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 151/309] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:52:27 2022] GET /compute/v2.1/servers/88c3b2e3-7038-460b-9874-b120c573c2b7 => generated 1323 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:52:28.144262 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-980e6104-8a18-4e51-97df-15df22346619 tempest-AZAdminV2TestJSON-36486682 tempest-AZAdminV2TestJSON-36486682-project-admin] 10.222.0.26 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 613 microversion: 2.1 time: 0.055031 Oct 08 20:52:28.145368 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 159/310] 10.222.0.26 () {58 vars in 1185 bytes} [Sat Oct 8 20:52:28 2022] GET /compute/v2.1/os-availability-zone/detail => generated 613 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:52:28.415027 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-abf28e88-ddfb-4829-9540-a8bcde846798 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:28.415877 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-abf28e88-ddfb-4829-9540-a8bcde846798 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] [instance: 1af12bcb-5e2a-4c15-8673-fa41701cb4c7] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:52:28.426181 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-abf28e88-ddfb-4829-9540-a8bcde846798 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:28.427073 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-abf28e88-ddfb-4829-9540-a8bcde846798 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:28.428124 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-abf28e88-ddfb-4829-9540-a8bcde846798 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:28.429381 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-abf28e88-ddfb-4829-9540-a8bcde846798 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:28.431070 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-abf28e88-ddfb-4829-9540-a8bcde846798 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:28.431755 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-abf28e88-ddfb-4829-9540-a8bcde846798 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:28.441965 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-67171827-59e3-47b3-927a-814b2a1d3238 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-33577587", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:52:28.558710 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.network.neutron [None req-67171827-59e3-47b3-927a-814b2a1d3238 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] validate_networks() for None {{(pid=140491) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 20:52:28.601147 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-abf28e88-ddfb-4829-9540-a8bcde846798 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb78cce5f7c4c348045745f40b13129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16530e0f2f0a4d23918261c9e21f9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:28.613498 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-abf28e88-ddfb-4829-9540-a8bcde846798 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cb78cce5f7c4c348045745f40b13129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16530e0f2f0a4d23918261c9e21f9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:28.616153 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-abf28e88-ddfb-4829-9540-a8bcde846798 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cb78cce5f7c4c348045745f40b13129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16530e0f2f0a4d23918261c9e21f9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:28.623486 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-abf28e88-ddfb-4829-9540-a8bcde846798 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] 10.222.0.26 "GET /compute/v2.1/servers/1af12bcb-5e2a-4c15-8673-fa41701cb4c7" status: 200 len: 1447 microversion: 2.75 time: 0.214189 Oct 08 20:52:28.641911 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 160/311] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:52:28 2022] GET /compute/v2.1/servers/1af12bcb-5e2a-4c15-8673-fa41701cb4c7 => generated 1447 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 08 20:52:29.111701 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-57a18f28-2f7e-4bb0-bcf3-0d5577634e6d tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:29.112322 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-57a18f28-2f7e-4bb0-bcf3-0d5577634e6d tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] [instance: 800ffcdf-e494-44df-97db-1c7fc74f97b6] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:52:29.118872 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-57a18f28-2f7e-4bb0-bcf3-0d5577634e6d tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:29.119693 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-57a18f28-2f7e-4bb0-bcf3-0d5577634e6d tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:29.120382 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-57a18f28-2f7e-4bb0-bcf3-0d5577634e6d tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:29.121352 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-57a18f28-2f7e-4bb0-bcf3-0d5577634e6d tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:29.122146 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-57a18f28-2f7e-4bb0-bcf3-0d5577634e6d tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:29.122800 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-57a18f28-2f7e-4bb0-bcf3-0d5577634e6d tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:29.204547 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-67171827-59e3-47b3-927a-814b2a1d3238 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Flavor limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 20:52:29.205096 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-67171827-59e3-47b3-927a-814b2a1d3238 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Image limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 20:52:29.205719 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-67171827-59e3-47b3-927a-814b2a1d3238 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Flavor pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 20:52:29.206199 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-67171827-59e3-47b3-927a-814b2a1d3238 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Image pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 20:52:29.206701 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-67171827-59e3-47b3-927a-814b2a1d3238 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 20:52:29.216583 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-67171827-59e3-47b3-927a-814b2a1d3238 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:29.217485 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-67171827-59e3-47b3-927a-814b2a1d3238 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:29.218171 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-67171827-59e3-47b3-927a-814b2a1d3238 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:29.219138 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-67171827-59e3-47b3-927a-814b2a1d3238 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:29.219805 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-67171827-59e3-47b3-927a-814b2a1d3238 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:29.220809 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-67171827-59e3-47b3-927a-814b2a1d3238 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:29.235852 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=34 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:29.249050 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-67171827-59e3-47b3-927a-814b2a1d3238 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Getting quotas for project 6d702b3083bc4cf5ba6b6fc6f3c3147e. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 20:52:29.256740 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-67171827-59e3-47b3-927a-814b2a1d3238 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Getting quotas for user 360660f7bb4746c8b1397f4857f423f2 and project 6d702b3083bc4cf5ba6b6fc6f3c3147e. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 20:52:29.271350 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-67171827-59e3-47b3-927a-814b2a1d3238 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Going to run 1 instances... {{(pid=140491) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 20:52:29.274971 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-67171827-59e3-47b3-927a-814b2a1d3238 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] [instance: 0b4b7773-b59d-4956-b7e5-267d54541db6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c508bd7f-7db9-4b2c-af7c-be54a855c355',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140491) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 20:52:29.335231 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-67171827-59e3-47b3-927a-814b2a1d3238 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.202199 Oct 08 20:52:29.336259 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 152/312] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 20:52:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 1205 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 08 20:52:29.341240 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-1fa932d6-1133-4c90-b303-a17348c39e08 tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:29.342515 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-1fa932d6-1133-4c90-b303-a17348c39e08 tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] [instance: 88c3b2e3-7038-460b-9874-b120c573c2b7] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:52:29.349875 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1fa932d6-1133-4c90-b303-a17348c39e08 tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:29.350750 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1fa932d6-1133-4c90-b303-a17348c39e08 tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:29.351424 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1fa932d6-1133-4c90-b303-a17348c39e08 tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:29.352492 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1fa932d6-1133-4c90-b303-a17348c39e08 tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:29.353398 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1fa932d6-1133-4c90-b303-a17348c39e08 tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:29.354059 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1fa932d6-1133-4c90-b303-a17348c39e08 tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:29.531759 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-57a18f28-2f7e-4bb0-bcf3-0d5577634e6d tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0eb2feb062947e78357b70e832e3edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18029da9b9854f3caf3debd9556f1f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:29.547620 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-57a18f28-2f7e-4bb0-bcf3-0d5577634e6d tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] 10.222.0.26 "GET /compute/v2.1/servers/800ffcdf-e494-44df-97db-1c7fc74f97b6" status: 200 len: 1317 microversion: 2.1 time: 0.440633 Oct 08 20:52:29.548230 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 161/313] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:52:29 2022] GET /compute/v2.1/servers/800ffcdf-e494-44df-97db-1c7fc74f97b6 => generated 1317 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 20:52:29.569058 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-06f0a8a1-c08b-4d94-8b42-da1b62f588c6 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:29.569921 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-06f0a8a1-c08b-4d94-8b42-da1b62f588c6 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] [instance: 0b4b7773-b59d-4956-b7e5-267d54541db6] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:52:29.741998 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-1fa932d6-1133-4c90-b303-a17348c39e08 tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c74c1e22148c6ba7612cb03d8bd02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e5f13ede0474c1888ffb1f7168daf67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:29.753509 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-1fa932d6-1133-4c90-b303-a17348c39e08 tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] 10.222.0.26 "GET /compute/v2.1/servers/88c3b2e3-7038-460b-9874-b120c573c2b7" status: 200 len: 1323 microversion: 2.1 time: 0.415933 Oct 08 20:52:29.769606 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 153/314] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:52:29 2022] GET /compute/v2.1/servers/88c3b2e3-7038-460b-9874-b120c573c2b7 => generated 1323 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:52:29.781397 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-b6048072-9ae6-4f9f-b73a-1cdd5a4288f1 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:29.782541 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-b6048072-9ae6-4f9f-b73a-1cdd5a4288f1 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] [instance: 1af12bcb-5e2a-4c15-8673-fa41701cb4c7] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:52:29.799924 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b6048072-9ae6-4f9f-b73a-1cdd5a4288f1 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:29.800716 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b6048072-9ae6-4f9f-b73a-1cdd5a4288f1 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:29.801428 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b6048072-9ae6-4f9f-b73a-1cdd5a4288f1 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:29.806729 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b6048072-9ae6-4f9f-b73a-1cdd5a4288f1 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:29.807691 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b6048072-9ae6-4f9f-b73a-1cdd5a4288f1 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:29.808316 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b6048072-9ae6-4f9f-b73a-1cdd5a4288f1 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:30.217615 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-b6048072-9ae6-4f9f-b73a-1cdd5a4288f1 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb78cce5f7c4c348045745f40b13129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16530e0f2f0a4d23918261c9e21f9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:30.254654 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-b6048072-9ae6-4f9f-b73a-1cdd5a4288f1 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cb78cce5f7c4c348045745f40b13129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16530e0f2f0a4d23918261c9e21f9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:30.256364 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-b6048072-9ae6-4f9f-b73a-1cdd5a4288f1 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cb78cce5f7c4c348045745f40b13129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16530e0f2f0a4d23918261c9e21f9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:30.284645 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-06f0a8a1-c08b-4d94-8b42-da1b62f588c6 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '360660f7bb4746c8b1397f4857f423f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d702b3083bc4cf5ba6b6fc6f3c3147e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:30.303795 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-b6048072-9ae6-4f9f-b73a-1cdd5a4288f1 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] 10.222.0.26 "GET /compute/v2.1/servers/1af12bcb-5e2a-4c15-8673-fa41701cb4c7" status: 200 len: 1447 microversion: 2.75 time: 0.522550 Oct 08 20:52:30.305490 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-06f0a8a1-c08b-4d94-8b42-da1b62f588c6 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] 10.222.0.26 "GET /compute/v2.1/servers/0b4b7773-b59d-4956-b7e5-267d54541db6" status: 200 len: 1220 microversion: 2.1 time: 0.731058 Oct 08 20:52:30.307628 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 162/315] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:52:29 2022] GET /compute/v2.1/servers/0b4b7773-b59d-4956-b7e5-267d54541db6 => generated 1220 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:52:30.333712 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 154/316] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:52:29 2022] GET /compute/v2.1/servers/1af12bcb-5e2a-4c15-8673-fa41701cb4c7 => generated 1447 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:52:30.586971 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-9f874023-a339-4705-a508-dafe1efa3706 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:30.588802 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-9f874023-a339-4705-a508-dafe1efa3706 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] [instance: 800ffcdf-e494-44df-97db-1c7fc74f97b6] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:52:30.621717 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9f874023-a339-4705-a508-dafe1efa3706 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:30.622229 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9f874023-a339-4705-a508-dafe1efa3706 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:30.622684 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9f874023-a339-4705-a508-dafe1efa3706 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:30.623420 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9f874023-a339-4705-a508-dafe1efa3706 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:30.623904 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9f874023-a339-4705-a508-dafe1efa3706 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:30.624360 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9f874023-a339-4705-a508-dafe1efa3706 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:30.782879 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-15900880-6686-4ab7-b1a4-5cc43f057336 tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:30.783594 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-15900880-6686-4ab7-b1a4-5cc43f057336 tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] [instance: 88c3b2e3-7038-460b-9874-b120c573c2b7] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:52:30.800805 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-15900880-6686-4ab7-b1a4-5cc43f057336 tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:30.801334 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-15900880-6686-4ab7-b1a4-5cc43f057336 tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:30.801780 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-15900880-6686-4ab7-b1a4-5cc43f057336 tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:30.802499 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-15900880-6686-4ab7-b1a4-5cc43f057336 tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:30.802956 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-15900880-6686-4ab7-b1a4-5cc43f057336 tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:30.803381 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-15900880-6686-4ab7-b1a4-5cc43f057336 tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:31.300346 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-9f874023-a339-4705-a508-dafe1efa3706 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0eb2feb062947e78357b70e832e3edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18029da9b9854f3caf3debd9556f1f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:31.318296 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-9f874023-a339-4705-a508-dafe1efa3706 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] 10.222.0.26 "GET /compute/v2.1/servers/800ffcdf-e494-44df-97db-1c7fc74f97b6" status: 200 len: 1465 microversion: 2.1 time: 0.746598 Oct 08 20:52:31.323027 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 163/317] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:52:30 2022] GET /compute/v2.1/servers/800ffcdf-e494-44df-97db-1c7fc74f97b6 => generated 1465 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:52:31.338234 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-6ab356c2-b3fd-4591-a1a0-c22d17a77192 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:31.339567 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-6ab356c2-b3fd-4591-a1a0-c22d17a77192 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] [instance: 0b4b7773-b59d-4956-b7e5-267d54541db6] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:52:31.357287 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6ab356c2-b3fd-4591-a1a0-c22d17a77192 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:31.362273 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6ab356c2-b3fd-4591-a1a0-c22d17a77192 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:31.362985 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6ab356c2-b3fd-4591-a1a0-c22d17a77192 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:31.363983 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6ab356c2-b3fd-4591-a1a0-c22d17a77192 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:31.364658 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6ab356c2-b3fd-4591-a1a0-c22d17a77192 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:31.365347 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6ab356c2-b3fd-4591-a1a0-c22d17a77192 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:31.608506 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-15900880-6686-4ab7-b1a4-5cc43f057336 tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c74c1e22148c6ba7612cb03d8bd02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e5f13ede0474c1888ffb1f7168daf67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:31.618521 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-15900880-6686-4ab7-b1a4-5cc43f057336 tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] 10.222.0.26 "GET /compute/v2.1/servers/88c3b2e3-7038-460b-9874-b120c573c2b7" status: 200 len: 1323 microversion: 2.1 time: 0.842141 Oct 08 20:52:31.622511 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 155/318] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:52:30 2022] GET /compute/v2.1/servers/88c3b2e3-7038-460b-9874-b120c573c2b7 => generated 1323 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 20:52:31.630324 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-d7647b39-1a21-47d3-8bf6-4944d22e4e77 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:31.630849 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-d7647b39-1a21-47d3-8bf6-4944d22e4e77 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] [instance: 1af12bcb-5e2a-4c15-8673-fa41701cb4c7] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:52:31.646133 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-6ab356c2-b3fd-4591-a1a0-c22d17a77192 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '360660f7bb4746c8b1397f4857f423f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d702b3083bc4cf5ba6b6fc6f3c3147e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:31.651447 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d7647b39-1a21-47d3-8bf6-4944d22e4e77 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:31.651617 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d7647b39-1a21-47d3-8bf6-4944d22e4e77 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:31.652290 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d7647b39-1a21-47d3-8bf6-4944d22e4e77 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:31.653013 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d7647b39-1a21-47d3-8bf6-4944d22e4e77 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:31.657878 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d7647b39-1a21-47d3-8bf6-4944d22e4e77 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:31.658394 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d7647b39-1a21-47d3-8bf6-4944d22e4e77 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:31.660104 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-6ab356c2-b3fd-4591-a1a0-c22d17a77192 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] 10.222.0.26 "GET /compute/v2.1/servers/0b4b7773-b59d-4956-b7e5-267d54541db6" status: 200 len: 1272 microversion: 2.1 time: 0.332789 Oct 08 20:52:31.660706 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 164/319] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:52:31 2022] GET /compute/v2.1/servers/0b4b7773-b59d-4956-b7e5-267d54541db6 => generated 1272 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:52:31.694128 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-acbf6b5f-5ee5-48c2-b755-fe4595a0cabc tempest-DeleteServersAdminTestJSON-2119063606 tempest-DeleteServersAdminTestJSON-2119063606-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:52:31.698100 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-acbf6b5f-5ee5-48c2-b755-fe4595a0cabc tempest-DeleteServersAdminTestJSON-2119063606 tempest-DeleteServersAdminTestJSON-2119063606-project-admin] [instance: 800ffcdf-e494-44df-97db-1c7fc74f97b6] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:52:31.716650 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-acbf6b5f-5ee5-48c2-b755-fe4595a0cabc tempest-DeleteServersAdminTestJSON-2119063606 tempest-DeleteServersAdminTestJSON-2119063606-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:31.717162 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-acbf6b5f-5ee5-48c2-b755-fe4595a0cabc tempest-DeleteServersAdminTestJSON-2119063606 tempest-DeleteServersAdminTestJSON-2119063606-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:31.724468 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-acbf6b5f-5ee5-48c2-b755-fe4595a0cabc tempest-DeleteServersAdminTestJSON-2119063606 tempest-DeleteServersAdminTestJSON-2119063606-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:31.725954 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-acbf6b5f-5ee5-48c2-b755-fe4595a0cabc tempest-DeleteServersAdminTestJSON-2119063606 tempest-DeleteServersAdminTestJSON-2119063606-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:31.727583 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-acbf6b5f-5ee5-48c2-b755-fe4595a0cabc tempest-DeleteServersAdminTestJSON-2119063606 tempest-DeleteServersAdminTestJSON-2119063606-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:31.729042 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-acbf6b5f-5ee5-48c2-b755-fe4595a0cabc tempest-DeleteServersAdminTestJSON-2119063606 tempest-DeleteServersAdminTestJSON-2119063606-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:31.859631 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-d7647b39-1a21-47d3-8bf6-4944d22e4e77 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb78cce5f7c4c348045745f40b13129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16530e0f2f0a4d23918261c9e21f9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:31.866376 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=100 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:31.884879 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-d7647b39-1a21-47d3-8bf6-4944d22e4e77 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cb78cce5f7c4c348045745f40b13129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16530e0f2f0a4d23918261c9e21f9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:31.887125 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-d7647b39-1a21-47d3-8bf6-4944d22e4e77 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cb78cce5f7c4c348045745f40b13129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16530e0f2f0a4d23918261c9e21f9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:31.895339 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-d7647b39-1a21-47d3-8bf6-4944d22e4e77 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] 10.222.0.26 "GET /compute/v2.1/servers/1af12bcb-5e2a-4c15-8673-fa41701cb4c7" status: 200 len: 1447 microversion: 2.75 time: 0.271455 Oct 08 20:52:31.896607 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 156/320] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:52:31 2022] GET /compute/v2.1/servers/1af12bcb-5e2a-4c15-8673-fa41701cb4c7 => generated 1447 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:52:31.980597 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-acbf6b5f-5ee5-48c2-b755-fe4595a0cabc tempest-DeleteServersAdminTestJSON-2119063606 tempest-DeleteServersAdminTestJSON-2119063606-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/800ffcdf-e494-44df-97db-1c7fc74f97b6/action" status: 202 len: 0 microversion: 2.1 time: 0.292989 Oct 08 20:52:31.983483 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 165/321] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 20:52:31 2022] POST /compute/v2.1/servers/800ffcdf-e494-44df-97db-1c7fc74f97b6/action => generated 0 bytes in 322 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 20:52:31.993222 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-1c43911f-b9ed-48b2-900a-143cd4509f12 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:31.994186 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-1c43911f-b9ed-48b2-900a-143cd4509f12 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] [instance: 800ffcdf-e494-44df-97db-1c7fc74f97b6] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:52:32.003157 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1c43911f-b9ed-48b2-900a-143cd4509f12 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:32.003998 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1c43911f-b9ed-48b2-900a-143cd4509f12 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:32.004640 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1c43911f-b9ed-48b2-900a-143cd4509f12 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:32.005772 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1c43911f-b9ed-48b2-900a-143cd4509f12 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:32.006511 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1c43911f-b9ed-48b2-900a-143cd4509f12 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:32.007164 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1c43911f-b9ed-48b2-900a-143cd4509f12 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:32.072714 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1c43911f-b9ed-48b2-900a-143cd4509f12 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:32.073660 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1c43911f-b9ed-48b2-900a-143cd4509f12 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:32.075853 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1c43911f-b9ed-48b2-900a-143cd4509f12 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:32.077118 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.objects.instance [None req-1c43911f-b9ed-48b2-900a-143cd4509f12 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lazy-loading 'fault' on Instance uuid 800ffcdf-e494-44df-97db-1c7fc74f97b6 {{(pid=140491) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 20:52:32.439050 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-1c43911f-b9ed-48b2-900a-143cd4509f12 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0eb2feb062947e78357b70e832e3edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18029da9b9854f3caf3debd9556f1f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:32.481491 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-1c43911f-b9ed-48b2-900a-143cd4509f12 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] 10.222.0.26 "GET /compute/v2.1/servers/800ffcdf-e494-44df-97db-1c7fc74f97b6" status: 200 len: 1448 microversion: 2.1 time: 0.493145 Oct 08 20:52:32.487247 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 157/322] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:52:31 2022] GET /compute/v2.1/servers/800ffcdf-e494-44df-97db-1c7fc74f97b6 => generated 1448 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 20:52:32.513257 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-a477391f-cbdd-44be-9c0a-edb7723f7db4 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:32.513919 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-a477391f-cbdd-44be-9c0a-edb7723f7db4 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] [instance: 800ffcdf-e494-44df-97db-1c7fc74f97b6] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:52:32.528536 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a477391f-cbdd-44be-9c0a-edb7723f7db4 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:32.529046 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a477391f-cbdd-44be-9c0a-edb7723f7db4 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:32.529651 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a477391f-cbdd-44be-9c0a-edb7723f7db4 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:32.530373 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a477391f-cbdd-44be-9c0a-edb7723f7db4 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:32.530872 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a477391f-cbdd-44be-9c0a-edb7723f7db4 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:32.531302 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a477391f-cbdd-44be-9c0a-edb7723f7db4 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:32.621014 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-a477391f-cbdd-44be-9c0a-edb7723f7db4 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] [instance: 800ffcdf-e494-44df-97db-1c7fc74f97b6] Going to try to terminate instance {{(pid=140492) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 20:52:32.652242 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-22f4a52f-0f71-4567-958c-e77c4030360f tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:32.669526 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-22f4a52f-0f71-4567-958c-e77c4030360f tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] [instance: 88c3b2e3-7038-460b-9874-b120c573c2b7] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:52:32.699043 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-22f4a52f-0f71-4567-958c-e77c4030360f tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:32.700837 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-22f4a52f-0f71-4567-958c-e77c4030360f tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:32.705801 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-22f4a52f-0f71-4567-958c-e77c4030360f tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:32.707590 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-22f4a52f-0f71-4567-958c-e77c4030360f tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:32.708564 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-22f4a52f-0f71-4567-958c-e77c4030360f tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:32.709511 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-22f4a52f-0f71-4567-958c-e77c4030360f tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:32.812169 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-a477391f-cbdd-44be-9c0a-edb7723f7db4 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] 10.222.0.26 "DELETE /compute/v2.1/servers/800ffcdf-e494-44df-97db-1c7fc74f97b6" status: 204 len: 0 microversion: 2.1 time: 0.302719 Oct 08 20:52:32.816458 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 166/323] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 20:52:32 2022] DELETE /compute/v2.1/servers/800ffcdf-e494-44df-97db-1c7fc74f97b6 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 20:52:32.822890 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e581c55f-1ced-45e3-9fe3-b0e56079a04a tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:32.823601 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-e581c55f-1ced-45e3-9fe3-b0e56079a04a tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] [instance: 0b4b7773-b59d-4956-b7e5-267d54541db6] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:52:32.862695 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e581c55f-1ced-45e3-9fe3-b0e56079a04a tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:32.863206 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e581c55f-1ced-45e3-9fe3-b0e56079a04a tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:32.867937 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e581c55f-1ced-45e3-9fe3-b0e56079a04a tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:32.868893 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e581c55f-1ced-45e3-9fe3-b0e56079a04a tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:32.870570 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e581c55f-1ced-45e3-9fe3-b0e56079a04a tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:32.871171 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e581c55f-1ced-45e3-9fe3-b0e56079a04a tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:33.043934 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-e581c55f-1ced-45e3-9fe3-b0e56079a04a tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '360660f7bb4746c8b1397f4857f423f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d702b3083bc4cf5ba6b6fc6f3c3147e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:33.054113 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-e581c55f-1ced-45e3-9fe3-b0e56079a04a tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] 10.222.0.26 "GET /compute/v2.1/servers/0b4b7773-b59d-4956-b7e5-267d54541db6" status: 200 len: 1278 microversion: 2.1 time: 0.235770 Oct 08 20:52:33.054236 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 167/324] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:52:32 2022] GET /compute/v2.1/servers/0b4b7773-b59d-4956-b7e5-267d54541db6 => generated 1278 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:52:33.064502 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-344b7396-635e-46ee-9764-df9f8243734c tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:33.065960 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-344b7396-635e-46ee-9764-df9f8243734c tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] [instance: 800ffcdf-e494-44df-97db-1c7fc74f97b6] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:52:33.080881 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-344b7396-635e-46ee-9764-df9f8243734c tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:33.083151 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-344b7396-635e-46ee-9764-df9f8243734c tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:33.084941 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-344b7396-635e-46ee-9764-df9f8243734c tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:33.086868 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-344b7396-635e-46ee-9764-df9f8243734c tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:33.089413 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-344b7396-635e-46ee-9764-df9f8243734c tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:33.090109 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-344b7396-635e-46ee-9764-df9f8243734c tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:33.170997 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-344b7396-635e-46ee-9764-df9f8243734c tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:33.172907 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-344b7396-635e-46ee-9764-df9f8243734c tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:33.174473 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-344b7396-635e-46ee-9764-df9f8243734c tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:33.174981 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.objects.instance [None req-344b7396-635e-46ee-9764-df9f8243734c tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lazy-loading 'fault' on Instance uuid 800ffcdf-e494-44df-97db-1c7fc74f97b6 {{(pid=140492) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 20:52:33.564078 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-22f4a52f-0f71-4567-958c-e77c4030360f tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c74c1e22148c6ba7612cb03d8bd02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e5f13ede0474c1888ffb1f7168daf67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:33.570624 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-22f4a52f-0f71-4567-958c-e77c4030360f tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] 10.222.0.26 "GET /compute/v2.1/servers/88c3b2e3-7038-460b-9874-b120c573c2b7" status: 200 len: 1323 microversion: 2.1 time: 0.924193 Oct 08 20:52:33.571293 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 158/325] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:52:32 2022] GET /compute/v2.1/servers/88c3b2e3-7038-460b-9874-b120c573c2b7 => generated 1323 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:52:33.782849 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-344b7396-635e-46ee-9764-df9f8243734c tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0eb2feb062947e78357b70e832e3edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18029da9b9854f3caf3debd9556f1f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:33.804196 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-344b7396-635e-46ee-9764-df9f8243734c tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] 10.222.0.26 "GET /compute/v2.1/servers/800ffcdf-e494-44df-97db-1c7fc74f97b6" status: 200 len: 1454 microversion: 2.1 time: 0.748790 Oct 08 20:52:33.808133 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 168/326] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:52:33 2022] GET /compute/v2.1/servers/800ffcdf-e494-44df-97db-1c7fc74f97b6 => generated 1454 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:52:33.823751 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-1f7fbf42-7c84-44a9-a898-ba0cc51e27e9 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:33.824390 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-1f7fbf42-7c84-44a9-a898-ba0cc51e27e9 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] [instance: 1af12bcb-5e2a-4c15-8673-fa41701cb4c7] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:52:33.847310 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1f7fbf42-7c84-44a9-a898-ba0cc51e27e9 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:33.847827 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1f7fbf42-7c84-44a9-a898-ba0cc51e27e9 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:33.848274 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1f7fbf42-7c84-44a9-a898-ba0cc51e27e9 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:33.855495 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1f7fbf42-7c84-44a9-a898-ba0cc51e27e9 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:33.856500 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1f7fbf42-7c84-44a9-a898-ba0cc51e27e9 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:33.859835 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1f7fbf42-7c84-44a9-a898-ba0cc51e27e9 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:33.924939 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-0c217c59-5c01-4c4f-b241-675ec413d61c tempest-ServicesAdminNegativeV253TestJSON-434781972 tempest-ServicesAdminNegativeV253TestJSON-434781972-project-admin] Action: 'update', calling method: .version_select at 0x7f1a8d330e50>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:52:33.928918 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0c217c59-5c01-4c4f-b241-675ec413d61c tempest-ServicesAdminNegativeV253TestJSON-434781972 tempest-ServicesAdminNegativeV253TestJSON-434781972-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:33.929443 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0c217c59-5c01-4c4f-b241-675ec413d61c tempest-ServicesAdminNegativeV253TestJSON-434781972 tempest-ServicesAdminNegativeV253TestJSON-434781972-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:33.929889 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0c217c59-5c01-4c4f-b241-675ec413d61c tempest-ServicesAdminNegativeV253TestJSON-434781972 tempest-ServicesAdminNegativeV253TestJSON-434781972-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:33.948333 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0c217c59-5c01-4c4f-b241-675ec413d61c tempest-ServicesAdminNegativeV253TestJSON-434781972 tempest-ServicesAdminNegativeV253TestJSON-434781972-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:33.948824 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0c217c59-5c01-4c4f-b241-675ec413d61c tempest-ServicesAdminNegativeV253TestJSON-434781972 tempest-ServicesAdminNegativeV253TestJSON-434781972-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:33.949301 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0c217c59-5c01-4c4f-b241-675ec413d61c tempest-ServicesAdminNegativeV253TestJSON-434781972 tempest-ServicesAdminNegativeV253TestJSON-434781972-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:33.967619 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-0c217c59-5c01-4c4f-b241-675ec413d61c tempest-ServicesAdminNegativeV253TestJSON-434781972 tempest-ServicesAdminNegativeV253TestJSON-434781972-project-admin] HTTP exception thrown: Service 61370638-5ef0-4894-b7a5-a2283e1ea4e4 could not be found. Oct 08 20:52:33.970294 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-0c217c59-5c01-4c4f-b241-675ec413d61c tempest-ServicesAdminNegativeV253TestJSON-434781972 tempest-ServicesAdminNegativeV253TestJSON-434781972-project-admin] Request method failure captured: Oct 08 20:52:33.970294 ncdv-master-1 devstack@n-api.service[140491]: request: PUT /compute/v2.1/os-services/61370638-5ef0-4894-b7a5-a2283e1ea4e4 HTTP/1.1 Oct 08 20:52:33.970294 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 20:52:33.970294 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 20:52:33.970294 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 20:52:33.970294 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 56 Oct 08 20:52:33.970294 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 20:52:33.970294 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 20:52:33.970294 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 20:52:33.970294 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 20:52:33.970294 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeMQZQxd9eyIM4u-9iJoQz7k2YE5OpyUM6m_jpxpls_ENOXwSkvPz7FYUO89edj7Xs3B2aDoNj1STY7h4NZcDTG5KO4pCwikmXFbzTbLeVyvtvple2cTnrtSu5b9qYqmfgOwyoblbJMQ3JNqhPu2EhQxVbk1sqmkl4P846jyKvm7M2Q Oct 08 20:52:33.970294 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 20:52:33.970294 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 20:52:33.970294 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 20:52:33.970294 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 20:52:33.970294 ncdv-master-1 devstack@n-api.service[140491]: X-Openstack-Nova-Api-Version: 2.53 Oct 08 20:52:33.970294 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 20:52:33.970294 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 20:52:33.970294 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 38f22d5aa06c46dda6c04cc24a5b7e70 Oct 08 20:52:33.970294 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-434781972 Oct 08 20:52:33.970294 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,admin,member Oct 08 20:52:33.970294 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,admin,member Oct 08 20:52:33.971543 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/38f22d5aa06c46dda6c04cc24a5b7e70"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/38f22d5aa06c46dda6c04cc24a5b7e70"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_38f22d5aa06c46dda6c04cc24a5b7e70"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/38f22d5aa06c46dda6c04cc24a5b7e70"}]}] Oct 08 20:52:33.971543 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-434781972 Oct 08 20:52:33.971543 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 38f22d5aa06c46dda6c04cc24a5b7e70 Oct 08 20:52:33.971543 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-434781972 Oct 08 20:52:33.971543 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-ServicesAdminNegativeV253TestJSON-434781972-project-admin Oct 08 20:52:33.971543 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 20:52:33.971543 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 20:52:33.971543 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 3ee31a07d4ef4decb6b7655699f83707 Oct 08 20:52:33.971543 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-434781972-project-admin Oct 08 20:52:33.971543 ncdv-master-1 devstack@n-api.service[140491]: Oct 08 20:52:33.971543 ncdv-master-1 devstack@n-api.service[140491]: {"status": "disabled", "disabled_reason": "maintenance"} Oct 08 20:52:33.971543 ncdv-master-1 devstack@n-api.service[140491]: method: Oct 08 20:52:33.971543 ncdv-master-1 devstack@n-api.service[140491]: exception: Service 61370638-5ef0-4894-b7a5-a2283e1ea4e4 could not be found. Oct 08 20:52:33.972384 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': '61370638-5ef0-4894-b7a5-a2283e1ea4e4', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Oct 08 20:52:33.972384 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:52:33.972384 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:52:33.972384 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 08 20:52:33.972384 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 08 20:52:33.972384 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 08 20:52:33.972384 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 08 20:52:33.972384 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 08 20:52:33.972384 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:52:33.972384 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:52:33.972384 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:52:33.972384 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:52:33.972384 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 08 20:52:33.972384 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 08 20:52:33.972384 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 08 20:52:33.972384 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 08 20:52:33.972384 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 61370638-5ef0-4894-b7a5-a2283e1ea4e4 could not be found. Oct 08 20:52:33.972384 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:52:33.972384 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:52:33.972384 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:52:33.972384 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:52:33.973554 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:52:33.973554 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:52:33.973554 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:52:33.973554 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:52:33.973554 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 08 20:52:33.973554 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 08 20:52:33.973554 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:52:33.973554 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:52:33.973554 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 20:52:33.973554 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 20:52:33.973554 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 08 20:52:33.973554 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 08 20:52:33.973554 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 61370638-5ef0-4894-b7a5-a2283e1ea4e4 could not be found. Oct 08 20:52:33.973554 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:52:33.973554 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:52:33.973554 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:52:33.973554 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:52:33.973554 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:52:33.973554 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:52:33.973554 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 20:52:33.974685 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 20:52:33.974685 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 61370638-5ef0-4894-b7a5-a2283e1ea4e4 could not be found. Oct 08 20:52:33.974685 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:52:33.974685 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-0c217c59-5c01-4c4f-b241-675ec413d61c tempest-ServicesAdminNegativeV253TestJSON-434781972 tempest-ServicesAdminNegativeV253TestJSON-434781972-project-admin] Returning 404 to user: Service 61370638-5ef0-4894-b7a5-a2283e1ea4e4 could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:52:33.976744 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-0c217c59-5c01-4c4f-b241-675ec413d61c tempest-ServicesAdminNegativeV253TestJSON-434781972 tempest-ServicesAdminNegativeV253TestJSON-434781972-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-services/61370638-5ef0-4894-b7a5-a2283e1ea4e4" status: 404 len: 110 microversion: 2.53 time: 0.399613 Oct 08 20:52:33.981798 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 159/327] 10.222.0.26 () {62 vars in 1309 bytes} [Sat Oct 8 20:52:33 2022] PUT /compute/v2.1/os-services/61370638-5ef0-4894-b7a5-a2283e1ea4e4 => generated 110 bytes in 410 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 08 20:52:33.997172 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c8c62b21-9f57-4290-a83a-1b21fead7eaa tempest-ServicesAdminNegativeV253TestJSON-434781972 tempest-ServicesAdminNegativeV253TestJSON-434781972-project-admin] Action: 'update', calling method: .version_select at 0x7f1a8d22b310>, body: {"status": "disabled"} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:52:34.000926 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c8c62b21-9f57-4290-a83a-1b21fead7eaa tempest-ServicesAdminNegativeV253TestJSON-434781972 tempest-ServicesAdminNegativeV253TestJSON-434781972-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:34.001447 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c8c62b21-9f57-4290-a83a-1b21fead7eaa tempest-ServicesAdminNegativeV253TestJSON-434781972 tempest-ServicesAdminNegativeV253TestJSON-434781972-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:34.001891 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c8c62b21-9f57-4290-a83a-1b21fead7eaa tempest-ServicesAdminNegativeV253TestJSON-434781972 tempest-ServicesAdminNegativeV253TestJSON-434781972-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:34.018053 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c8c62b21-9f57-4290-a83a-1b21fead7eaa tempest-ServicesAdminNegativeV253TestJSON-434781972 tempest-ServicesAdminNegativeV253TestJSON-434781972-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:34.018543 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c8c62b21-9f57-4290-a83a-1b21fead7eaa tempest-ServicesAdminNegativeV253TestJSON-434781972 tempest-ServicesAdminNegativeV253TestJSON-434781972-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:34.018982 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c8c62b21-9f57-4290-a83a-1b21fead7eaa tempest-ServicesAdminNegativeV253TestJSON-434781972 tempest-ServicesAdminNegativeV253TestJSON-434781972-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:34.024984 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-c8c62b21-9f57-4290-a83a-1b21fead7eaa tempest-ServicesAdminNegativeV253TestJSON-434781972 tempest-ServicesAdminNegativeV253TestJSON-434781972-project-admin] HTTP exception thrown: Service 61370638-5ef0-4894-b7a5-a2283e1ea4e4 could not be found. Oct 08 20:52:34.026664 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c8c62b21-9f57-4290-a83a-1b21fead7eaa tempest-ServicesAdminNegativeV253TestJSON-434781972 tempest-ServicesAdminNegativeV253TestJSON-434781972-project-admin] Request method failure captured: Oct 08 20:52:34.026664 ncdv-master-1 devstack@n-api.service[140491]: request: PUT /compute/v2.1/os-services/61370638-5ef0-4894-b7a5-a2283e1ea4e4 HTTP/1.1 Oct 08 20:52:34.026664 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 20:52:34.026664 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 20:52:34.026664 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 20:52:34.026664 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 22 Oct 08 20:52:34.026664 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 20:52:34.026664 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 20:52:34.026664 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 20:52:34.026664 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 20:52:34.026664 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeMQZQxd9eyIM4u-9iJoQz7k2YE5OpyUM6m_jpxpls_ENOXwSkvPz7FYUO89edj7Xs3B2aDoNj1STY7h4NZcDTG5KO4pCwikmXFbzTbLeVyvtvple2cTnrtSu5b9qYqmfgOwyoblbJMQ3JNqhPu2EhQxVbk1sqmkl4P846jyKvm7M2Q Oct 08 20:52:34.026664 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 20:52:34.026664 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 20:52:34.026664 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 20:52:34.026664 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 20:52:34.026664 ncdv-master-1 devstack@n-api.service[140491]: X-Openstack-Nova-Api-Version: 2.53 Oct 08 20:52:34.026664 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 20:52:34.026664 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 20:52:34.026664 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 38f22d5aa06c46dda6c04cc24a5b7e70 Oct 08 20:52:34.026664 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-434781972 Oct 08 20:52:34.026664 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,admin,member Oct 08 20:52:34.026664 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,admin,member Oct 08 20:52:34.027858 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/38f22d5aa06c46dda6c04cc24a5b7e70"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/38f22d5aa06c46dda6c04cc24a5b7e70"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_38f22d5aa06c46dda6c04cc24a5b7e70"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/38f22d5aa06c46dda6c04cc24a5b7e70"}]}] Oct 08 20:52:34.027858 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-434781972 Oct 08 20:52:34.027858 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 38f22d5aa06c46dda6c04cc24a5b7e70 Oct 08 20:52:34.027858 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-434781972 Oct 08 20:52:34.027858 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-ServicesAdminNegativeV253TestJSON-434781972-project-admin Oct 08 20:52:34.027858 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 20:52:34.027858 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 20:52:34.027858 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 3ee31a07d4ef4decb6b7655699f83707 Oct 08 20:52:34.027858 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-434781972-project-admin Oct 08 20:52:34.027858 ncdv-master-1 devstack@n-api.service[140491]: Oct 08 20:52:34.027858 ncdv-master-1 devstack@n-api.service[140491]: {"status": "disabled"} Oct 08 20:52:34.027858 ncdv-master-1 devstack@n-api.service[140491]: method: Oct 08 20:52:34.027858 ncdv-master-1 devstack@n-api.service[140491]: exception: Service 61370638-5ef0-4894-b7a5-a2283e1ea4e4 could not be found. Oct 08 20:52:34.027858 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': '61370638-5ef0-4894-b7a5-a2283e1ea4e4', 'body': {'status': 'disabled'}} Oct 08 20:52:34.028617 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:52:34.028617 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:52:34.028617 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 08 20:52:34.028617 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 08 20:52:34.028617 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 08 20:52:34.028617 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 08 20:52:34.028617 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 08 20:52:34.028617 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:52:34.028617 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:52:34.028617 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:52:34.028617 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:52:34.028617 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 08 20:52:34.028617 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 08 20:52:34.028617 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 08 20:52:34.028617 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 08 20:52:34.028617 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 61370638-5ef0-4894-b7a5-a2283e1ea4e4 could not be found. Oct 08 20:52:34.028617 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:52:34.028617 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:52:34.028617 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:52:34.028617 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:52:34.028617 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:52:34.029698 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:52:34.029698 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:52:34.029698 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:52:34.029698 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 08 20:52:34.029698 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 08 20:52:34.029698 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:52:34.029698 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:52:34.029698 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 20:52:34.029698 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 20:52:34.029698 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 08 20:52:34.029698 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 08 20:52:34.029698 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 61370638-5ef0-4894-b7a5-a2283e1ea4e4 could not be found. Oct 08 20:52:34.029698 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:52:34.029698 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:52:34.029698 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:52:34.029698 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:52:34.029698 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:52:34.029698 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:52:34.029698 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 20:52:34.029698 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 20:52:34.032688 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 61370638-5ef0-4894-b7a5-a2283e1ea4e4 could not be found. Oct 08 20:52:34.032688 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:52:34.032688 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c8c62b21-9f57-4290-a83a-1b21fead7eaa tempest-ServicesAdminNegativeV253TestJSON-434781972 tempest-ServicesAdminNegativeV253TestJSON-434781972-project-admin] Returning 404 to user: Service 61370638-5ef0-4894-b7a5-a2283e1ea4e4 could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:52:34.032688 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-c8c62b21-9f57-4290-a83a-1b21fead7eaa tempest-ServicesAdminNegativeV253TestJSON-434781972 tempest-ServicesAdminNegativeV253TestJSON-434781972-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-services/61370638-5ef0-4894-b7a5-a2283e1ea4e4" status: 404 len: 110 microversion: 2.53 time: 0.045239 Oct 08 20:52:34.034282 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 160/328] 10.222.0.26 () {62 vars in 1309 bytes} [Sat Oct 8 20:52:33 2022] PUT /compute/v2.1/os-services/61370638-5ef0-4894-b7a5-a2283e1ea4e4 => generated 110 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 08 20:52:34.038617 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-505b0409-bd83-475c-a40f-5715321be108 tempest-ServicesAdminNegativeV253TestJSON-434781972 tempest-ServicesAdminNegativeV253TestJSON-434781972-project-admin] Action: 'update', calling method: .version_select at 0x7f1a8d416310>, body: {"status": "enabled"} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:52:34.042897 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-505b0409-bd83-475c-a40f-5715321be108 tempest-ServicesAdminNegativeV253TestJSON-434781972 tempest-ServicesAdminNegativeV253TestJSON-434781972-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:34.043391 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-505b0409-bd83-475c-a40f-5715321be108 tempest-ServicesAdminNegativeV253TestJSON-434781972 tempest-ServicesAdminNegativeV253TestJSON-434781972-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:34.043835 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-505b0409-bd83-475c-a40f-5715321be108 tempest-ServicesAdminNegativeV253TestJSON-434781972 tempest-ServicesAdminNegativeV253TestJSON-434781972-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:34.052337 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-505b0409-bd83-475c-a40f-5715321be108 tempest-ServicesAdminNegativeV253TestJSON-434781972 tempest-ServicesAdminNegativeV253TestJSON-434781972-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:34.052833 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-505b0409-bd83-475c-a40f-5715321be108 tempest-ServicesAdminNegativeV253TestJSON-434781972 tempest-ServicesAdminNegativeV253TestJSON-434781972-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:34.053322 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-505b0409-bd83-475c-a40f-5715321be108 tempest-ServicesAdminNegativeV253TestJSON-434781972 tempest-ServicesAdminNegativeV253TestJSON-434781972-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:34.058959 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-505b0409-bd83-475c-a40f-5715321be108 tempest-ServicesAdminNegativeV253TestJSON-434781972 tempest-ServicesAdminNegativeV253TestJSON-434781972-project-admin] HTTP exception thrown: Service 61370638-5ef0-4894-b7a5-a2283e1ea4e4 could not be found. Oct 08 20:52:34.060605 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-505b0409-bd83-475c-a40f-5715321be108 tempest-ServicesAdminNegativeV253TestJSON-434781972 tempest-ServicesAdminNegativeV253TestJSON-434781972-project-admin] Request method failure captured: Oct 08 20:52:34.060605 ncdv-master-1 devstack@n-api.service[140491]: request: PUT /compute/v2.1/os-services/61370638-5ef0-4894-b7a5-a2283e1ea4e4 HTTP/1.1 Oct 08 20:52:34.060605 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 20:52:34.060605 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 20:52:34.060605 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 20:52:34.060605 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 21 Oct 08 20:52:34.060605 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 20:52:34.060605 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 20:52:34.060605 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 20:52:34.060605 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 20:52:34.060605 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeMQZQxd9eyIM4u-9iJoQz7k2YE5OpyUM6m_jpxpls_ENOXwSkvPz7FYUO89edj7Xs3B2aDoNj1STY7h4NZcDTG5KO4pCwikmXFbzTbLeVyvtvple2cTnrtSu5b9qYqmfgOwyoblbJMQ3JNqhPu2EhQxVbk1sqmkl4P846jyKvm7M2Q Oct 08 20:52:34.060605 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 20:52:34.060605 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 20:52:34.060605 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 20:52:34.060605 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 20:52:34.060605 ncdv-master-1 devstack@n-api.service[140491]: X-Openstack-Nova-Api-Version: 2.53 Oct 08 20:52:34.060605 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 20:52:34.060605 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 20:52:34.060605 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 38f22d5aa06c46dda6c04cc24a5b7e70 Oct 08 20:52:34.060605 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-434781972 Oct 08 20:52:34.060605 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,admin,member Oct 08 20:52:34.060605 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,admin,member Oct 08 20:52:34.062389 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/38f22d5aa06c46dda6c04cc24a5b7e70"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/38f22d5aa06c46dda6c04cc24a5b7e70"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_38f22d5aa06c46dda6c04cc24a5b7e70"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/38f22d5aa06c46dda6c04cc24a5b7e70"}]}] Oct 08 20:52:34.062389 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-434781972 Oct 08 20:52:34.062389 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 38f22d5aa06c46dda6c04cc24a5b7e70 Oct 08 20:52:34.062389 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-434781972 Oct 08 20:52:34.062389 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-ServicesAdminNegativeV253TestJSON-434781972-project-admin Oct 08 20:52:34.062389 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 20:52:34.062389 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 20:52:34.062389 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 3ee31a07d4ef4decb6b7655699f83707 Oct 08 20:52:34.062389 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-434781972-project-admin Oct 08 20:52:34.062389 ncdv-master-1 devstack@n-api.service[140491]: Oct 08 20:52:34.062389 ncdv-master-1 devstack@n-api.service[140491]: {"status": "enabled"} Oct 08 20:52:34.062389 ncdv-master-1 devstack@n-api.service[140491]: method: Oct 08 20:52:34.062389 ncdv-master-1 devstack@n-api.service[140491]: exception: Service 61370638-5ef0-4894-b7a5-a2283e1ea4e4 could not be found. Oct 08 20:52:34.062389 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': '61370638-5ef0-4894-b7a5-a2283e1ea4e4', 'body': {'status': 'enabled'}} Oct 08 20:52:34.063110 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:52:34.063110 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:52:34.063110 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 08 20:52:34.063110 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 08 20:52:34.063110 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 08 20:52:34.063110 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 08 20:52:34.063110 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 08 20:52:34.063110 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:52:34.063110 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:52:34.063110 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:52:34.063110 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:52:34.063110 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 08 20:52:34.063110 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 08 20:52:34.063110 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 08 20:52:34.063110 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 08 20:52:34.063110 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 61370638-5ef0-4894-b7a5-a2283e1ea4e4 could not be found. Oct 08 20:52:34.063110 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:52:34.063110 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:52:34.063110 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:52:34.063110 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:52:34.063110 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:52:34.064160 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:52:34.064160 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:52:34.064160 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:52:34.064160 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 08 20:52:34.064160 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 08 20:52:34.064160 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:52:34.064160 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:52:34.064160 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 20:52:34.064160 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 20:52:34.064160 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 08 20:52:34.064160 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 08 20:52:34.064160 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 61370638-5ef0-4894-b7a5-a2283e1ea4e4 could not be found. Oct 08 20:52:34.064160 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:52:34.064160 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:52:34.064160 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:52:34.064160 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:52:34.064160 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:52:34.064160 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:52:34.064160 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 20:52:34.064160 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 20:52:34.066431 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 61370638-5ef0-4894-b7a5-a2283e1ea4e4 could not be found. Oct 08 20:52:34.066431 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:52:34.066431 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-505b0409-bd83-475c-a40f-5715321be108 tempest-ServicesAdminNegativeV253TestJSON-434781972 tempest-ServicesAdminNegativeV253TestJSON-434781972-project-admin] Returning 404 to user: Service 61370638-5ef0-4894-b7a5-a2283e1ea4e4 could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:52:34.066431 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-505b0409-bd83-475c-a40f-5715321be108 tempest-ServicesAdminNegativeV253TestJSON-434781972 tempest-ServicesAdminNegativeV253TestJSON-434781972-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-services/61370638-5ef0-4894-b7a5-a2283e1ea4e4" status: 404 len: 110 microversion: 2.53 time: 0.027420 Oct 08 20:52:34.067601 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 161/329] 10.222.0.26 () {62 vars in 1309 bytes} [Sat Oct 8 20:52:34 2022] PUT /compute/v2.1/os-services/61370638-5ef0-4894-b7a5-a2283e1ea4e4 => generated 110 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 08 20:52:34.072513 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-713a60f5-adaf-47d3-a1a1-35c3e1e57c0f tempest-ServicesAdminNegativeV253TestJSON-434781972 tempest-ServicesAdminNegativeV253TestJSON-434781972-project-admin] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:34.076086 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-713a60f5-adaf-47d3-a1a1-35c3e1e57c0f tempest-ServicesAdminNegativeV253TestJSON-434781972 tempest-ServicesAdminNegativeV253TestJSON-434781972-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:34.076575 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-713a60f5-adaf-47d3-a1a1-35c3e1e57c0f tempest-ServicesAdminNegativeV253TestJSON-434781972 tempest-ServicesAdminNegativeV253TestJSON-434781972-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:34.087916 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-713a60f5-adaf-47d3-a1a1-35c3e1e57c0f tempest-ServicesAdminNegativeV253TestJSON-434781972 tempest-ServicesAdminNegativeV253TestJSON-434781972-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:34.088857 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-713a60f5-adaf-47d3-a1a1-35c3e1e57c0f tempest-ServicesAdminNegativeV253TestJSON-434781972 tempest-ServicesAdminNegativeV253TestJSON-434781972-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:34.089388 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-713a60f5-adaf-47d3-a1a1-35c3e1e57c0f tempest-ServicesAdminNegativeV253TestJSON-434781972 tempest-ServicesAdminNegativeV253TestJSON-434781972-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:34.089822 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-713a60f5-adaf-47d3-a1a1-35c3e1e57c0f tempest-ServicesAdminNegativeV253TestJSON-434781972 tempest-ServicesAdminNegativeV253TestJSON-434781972-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:34.129171 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-713a60f5-adaf-47d3-a1a1-35c3e1e57c0f tempest-ServicesAdminNegativeV253TestJSON-434781972 tempest-ServicesAdminNegativeV253TestJSON-434781972-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.53 time: 0.060429 Oct 08 20:52:34.138360 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 162/330] 10.222.0.26 () {60 vars in 1178 bytes} [Sat Oct 8 20:52:34 2022] GET /compute/v2.1/os-services => generated 1242 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:52:34.143491 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-78704c07-9ce5-4302-a194-ffbe6dfece70 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:34.144339 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-78704c07-9ce5-4302-a194-ffbe6dfece70 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] [instance: 0b4b7773-b59d-4956-b7e5-267d54541db6] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:52:34.150934 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-78704c07-9ce5-4302-a194-ffbe6dfece70 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:34.151680 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-78704c07-9ce5-4302-a194-ffbe6dfece70 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:34.152296 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-78704c07-9ce5-4302-a194-ffbe6dfece70 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:34.153160 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-78704c07-9ce5-4302-a194-ffbe6dfece70 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:34.153785 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-78704c07-9ce5-4302-a194-ffbe6dfece70 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:34.154362 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-78704c07-9ce5-4302-a194-ffbe6dfece70 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:34.279976 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-1f7fbf42-7c84-44a9-a898-ba0cc51e27e9 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb78cce5f7c4c348045745f40b13129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16530e0f2f0a4d23918261c9e21f9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:34.289501 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-1f7fbf42-7c84-44a9-a898-ba0cc51e27e9 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cb78cce5f7c4c348045745f40b13129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16530e0f2f0a4d23918261c9e21f9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:34.295838 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-1f7fbf42-7c84-44a9-a898-ba0cc51e27e9 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cb78cce5f7c4c348045745f40b13129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16530e0f2f0a4d23918261c9e21f9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:34.311284 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-1f7fbf42-7c84-44a9-a898-ba0cc51e27e9 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] 10.222.0.26 "GET /compute/v2.1/servers/1af12bcb-5e2a-4c15-8673-fa41701cb4c7" status: 200 len: 1447 microversion: 2.75 time: 0.500580 Oct 08 20:52:34.312287 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 169/331] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:52:33 2022] GET /compute/v2.1/servers/1af12bcb-5e2a-4c15-8673-fa41701cb4c7 => generated 1447 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:52:34.316581 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-6454f636-7afd-4ee0-9d88-a44c3f040c95 tempest-ServicesAdminNegativeV253TestJSON-434781972 tempest-ServicesAdminNegativeV253TestJSON-434781972-project-admin] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:34.323257 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6454f636-7afd-4ee0-9d88-a44c3f040c95 tempest-ServicesAdminNegativeV253TestJSON-434781972 tempest-ServicesAdminNegativeV253TestJSON-434781972-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:34.324157 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6454f636-7afd-4ee0-9d88-a44c3f040c95 tempest-ServicesAdminNegativeV253TestJSON-434781972 tempest-ServicesAdminNegativeV253TestJSON-434781972-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:34.324718 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6454f636-7afd-4ee0-9d88-a44c3f040c95 tempest-ServicesAdminNegativeV253TestJSON-434781972 tempest-ServicesAdminNegativeV253TestJSON-434781972-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:34.325587 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6454f636-7afd-4ee0-9d88-a44c3f040c95 tempest-ServicesAdminNegativeV253TestJSON-434781972 tempest-ServicesAdminNegativeV253TestJSON-434781972-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:34.326146 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6454f636-7afd-4ee0-9d88-a44c3f040c95 tempest-ServicesAdminNegativeV253TestJSON-434781972 tempest-ServicesAdminNegativeV253TestJSON-434781972-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:34.326725 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6454f636-7afd-4ee0-9d88-a44c3f040c95 tempest-ServicesAdminNegativeV253TestJSON-434781972 tempest-ServicesAdminNegativeV253TestJSON-434781972-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:34.375005 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-78704c07-9ce5-4302-a194-ffbe6dfece70 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '360660f7bb4746c8b1397f4857f423f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d702b3083bc4cf5ba6b6fc6f3c3147e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:34.383925 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=100 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:34.398504 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-78704c07-9ce5-4302-a194-ffbe6dfece70 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] 10.222.0.26 "GET /compute/v2.1/servers/0b4b7773-b59d-4956-b7e5-267d54541db6" status: 200 len: 1278 microversion: 2.1 time: 0.258730 Oct 08 20:52:34.399480 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 163/332] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:52:34 2022] GET /compute/v2.1/servers/0b4b7773-b59d-4956-b7e5-267d54541db6 => generated 1278 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:52:34.404153 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-6454f636-7afd-4ee0-9d88-a44c3f040c95 tempest-ServicesAdminNegativeV253TestJSON-434781972 tempest-ServicesAdminNegativeV253TestJSON-434781972-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.53 time: 0.090901 Oct 08 20:52:34.416440 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 170/333] 10.222.0.26 () {60 vars in 1211 bytes} [Sat Oct 8 20:52:34 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1242 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:52:34.422716 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-89167bc0-90a6-406c-b4b5-540afa3219ca tempest-ServicesAdminNegativeV253TestJSON-434781972 tempest-ServicesAdminNegativeV253TestJSON-434781972-project-admin] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:34.426852 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-89167bc0-90a6-406c-b4b5-540afa3219ca tempest-ServicesAdminNegativeV253TestJSON-434781972 tempest-ServicesAdminNegativeV253TestJSON-434781972-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:34.432661 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-89167bc0-90a6-406c-b4b5-540afa3219ca tempest-ServicesAdminNegativeV253TestJSON-434781972 tempest-ServicesAdminNegativeV253TestJSON-434781972-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:34.433496 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-89167bc0-90a6-406c-b4b5-540afa3219ca tempest-ServicesAdminNegativeV253TestJSON-434781972 tempest-ServicesAdminNegativeV253TestJSON-434781972-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:34.434519 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-89167bc0-90a6-406c-b4b5-540afa3219ca tempest-ServicesAdminNegativeV253TestJSON-434781972 tempest-ServicesAdminNegativeV253TestJSON-434781972-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:34.435165 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-89167bc0-90a6-406c-b4b5-540afa3219ca tempest-ServicesAdminNegativeV253TestJSON-434781972 tempest-ServicesAdminNegativeV253TestJSON-434781972-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:34.435775 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-89167bc0-90a6-406c-b4b5-540afa3219ca tempest-ServicesAdminNegativeV253TestJSON-434781972 tempest-ServicesAdminNegativeV253TestJSON-434781972-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:34.522334 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-89167bc0-90a6-406c-b4b5-540afa3219ca tempest-ServicesAdminNegativeV253TestJSON-434781972 tempest-ServicesAdminNegativeV253TestJSON-434781972-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.53 time: 0.103864 Oct 08 20:52:34.524424 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 164/334] 10.222.0.26 () {60 vars in 1178 bytes} [Sat Oct 8 20:52:34 2022] GET /compute/v2.1/os-services => generated 1242 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:52:34.539380 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-8b1035ab-5240-4687-a950-0e1e2a387db3 tempest-ServicesAdminNegativeV253TestJSON-434781972 tempest-ServicesAdminNegativeV253TestJSON-434781972-project-admin] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:34.547333 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8b1035ab-5240-4687-a950-0e1e2a387db3 tempest-ServicesAdminNegativeV253TestJSON-434781972 tempest-ServicesAdminNegativeV253TestJSON-434781972-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:34.548900 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8b1035ab-5240-4687-a950-0e1e2a387db3 tempest-ServicesAdminNegativeV253TestJSON-434781972 tempest-ServicesAdminNegativeV253TestJSON-434781972-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:34.551399 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8b1035ab-5240-4687-a950-0e1e2a387db3 tempest-ServicesAdminNegativeV253TestJSON-434781972 tempest-ServicesAdminNegativeV253TestJSON-434781972-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:34.553122 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8b1035ab-5240-4687-a950-0e1e2a387db3 tempest-ServicesAdminNegativeV253TestJSON-434781972 tempest-ServicesAdminNegativeV253TestJSON-434781972-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:34.553824 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8b1035ab-5240-4687-a950-0e1e2a387db3 tempest-ServicesAdminNegativeV253TestJSON-434781972 tempest-ServicesAdminNegativeV253TestJSON-434781972-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:34.559971 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8b1035ab-5240-4687-a950-0e1e2a387db3 tempest-ServicesAdminNegativeV253TestJSON-434781972 tempest-ServicesAdminNegativeV253TestJSON-434781972-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:34.595359 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-9f69b73c-bee1-4605-822f-f873442781bf tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:34.596357 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-9f69b73c-bee1-4605-822f-f873442781bf tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] [instance: 88c3b2e3-7038-460b-9874-b120c573c2b7] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:52:34.609905 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9f69b73c-bee1-4605-822f-f873442781bf tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:34.612888 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9f69b73c-bee1-4605-822f-f873442781bf tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:34.614327 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9f69b73c-bee1-4605-822f-f873442781bf tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:34.616212 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9f69b73c-bee1-4605-822f-f873442781bf tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:34.618327 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9f69b73c-bee1-4605-822f-f873442781bf tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:34.620375 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9f69b73c-bee1-4605-822f-f873442781bf tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:34.637923 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-8b1035ab-5240-4687-a950-0e1e2a387db3 tempest-ServicesAdminNegativeV253TestJSON-434781972 tempest-ServicesAdminNegativeV253TestJSON-434781972-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services?host=ncdv-master-1&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.103343 Oct 08 20:52:34.648939 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 171/335] 10.222.0.26 () {60 vars in 1237 bytes} [Sat Oct 8 20:52:34 2022] GET /compute/v2.1/os-services?host=ncdv-master-1&binary=xxx => generated 16 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:52:34.654188 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-8bb07177-5eeb-4d22-abd0-7907111fb938 tempest-ServicesAdminNegativeV253TestJSON-434781972 tempest-ServicesAdminNegativeV253TestJSON-434781972-project-admin] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:34.660942 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8bb07177-5eeb-4d22-abd0-7907111fb938 tempest-ServicesAdminNegativeV253TestJSON-434781972 tempest-ServicesAdminNegativeV253TestJSON-434781972-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:34.661511 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8bb07177-5eeb-4d22-abd0-7907111fb938 tempest-ServicesAdminNegativeV253TestJSON-434781972 tempest-ServicesAdminNegativeV253TestJSON-434781972-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:34.662002 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8bb07177-5eeb-4d22-abd0-7907111fb938 tempest-ServicesAdminNegativeV253TestJSON-434781972 tempest-ServicesAdminNegativeV253TestJSON-434781972-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:34.663109 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8bb07177-5eeb-4d22-abd0-7907111fb938 tempest-ServicesAdminNegativeV253TestJSON-434781972 tempest-ServicesAdminNegativeV253TestJSON-434781972-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:34.663577 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8bb07177-5eeb-4d22-abd0-7907111fb938 tempest-ServicesAdminNegativeV253TestJSON-434781972 tempest-ServicesAdminNegativeV253TestJSON-434781972-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:34.664077 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8bb07177-5eeb-4d22-abd0-7907111fb938 tempest-ServicesAdminNegativeV253TestJSON-434781972 tempest-ServicesAdminNegativeV253TestJSON-434781972-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:34.692760 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-8bb07177-5eeb-4d22-abd0-7907111fb938 tempest-ServicesAdminNegativeV253TestJSON-434781972 tempest-ServicesAdminNegativeV253TestJSON-434781972-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.53 time: 0.042393 Oct 08 20:52:34.702042 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 172/336] 10.222.0.26 () {60 vars in 1178 bytes} [Sat Oct 8 20:52:34 2022] GET /compute/v2.1/os-services => generated 1242 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:52:34.707152 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-64942951-ed37-4475-88c5-34348941ba78 tempest-ServicesAdminNegativeV253TestJSON-434781972 tempest-ServicesAdminNegativeV253TestJSON-434781972-project-admin] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:34.712389 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-64942951-ed37-4475-88c5-34348941ba78 tempest-ServicesAdminNegativeV253TestJSON-434781972 tempest-ServicesAdminNegativeV253TestJSON-434781972-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:34.712993 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-64942951-ed37-4475-88c5-34348941ba78 tempest-ServicesAdminNegativeV253TestJSON-434781972 tempest-ServicesAdminNegativeV253TestJSON-434781972-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:34.713618 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-64942951-ed37-4475-88c5-34348941ba78 tempest-ServicesAdminNegativeV253TestJSON-434781972 tempest-ServicesAdminNegativeV253TestJSON-434781972-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:34.714423 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-64942951-ed37-4475-88c5-34348941ba78 tempest-ServicesAdminNegativeV253TestJSON-434781972 tempest-ServicesAdminNegativeV253TestJSON-434781972-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:34.715003 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-64942951-ed37-4475-88c5-34348941ba78 tempest-ServicesAdminNegativeV253TestJSON-434781972 tempest-ServicesAdminNegativeV253TestJSON-434781972-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:34.715523 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-64942951-ed37-4475-88c5-34348941ba78 tempest-ServicesAdminNegativeV253TestJSON-434781972 tempest-ServicesAdminNegativeV253TestJSON-434781972-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:34.743921 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-64942951-ed37-4475-88c5-34348941ba78 tempest-ServicesAdminNegativeV253TestJSON-434781972 tempest-ServicesAdminNegativeV253TestJSON-434781972-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.040384 Oct 08 20:52:34.753440 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 173/337] 10.222.0.26 () {60 vars in 1239 bytes} [Sat Oct 8 20:52:34 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:52:35.192423 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-9f69b73c-bee1-4605-822f-f873442781bf tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c74c1e22148c6ba7612cb03d8bd02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e5f13ede0474c1888ffb1f7168daf67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:35.201002 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-9f69b73c-bee1-4605-822f-f873442781bf tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] 10.222.0.26 "GET /compute/v2.1/servers/88c3b2e3-7038-460b-9874-b120c573c2b7" status: 200 len: 1323 microversion: 2.1 time: 0.610247 Oct 08 20:52:35.218971 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 165/338] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:52:34 2022] GET /compute/v2.1/servers/88c3b2e3-7038-460b-9874-b120c573c2b7 => generated 1323 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:52:35.223983 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c38bdefe-aae1-4ef2-844d-f51d8ad25967 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:35.224943 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-c38bdefe-aae1-4ef2-844d-f51d8ad25967 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] [instance: 800ffcdf-e494-44df-97db-1c7fc74f97b6] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:52:35.240221 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c38bdefe-aae1-4ef2-844d-f51d8ad25967 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:35.241121 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c38bdefe-aae1-4ef2-844d-f51d8ad25967 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:35.241829 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c38bdefe-aae1-4ef2-844d-f51d8ad25967 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:35.242771 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c38bdefe-aae1-4ef2-844d-f51d8ad25967 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:35.249364 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c38bdefe-aae1-4ef2-844d-f51d8ad25967 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:35.250132 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c38bdefe-aae1-4ef2-844d-f51d8ad25967 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:35.253792 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-70eec224-ab0a-4d30-bb88-a62f93f68dc5 tempest-ServicesAdminNegativeV253TestJSON-84412101 tempest-ServicesAdminNegativeV253TestJSON-84412101-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:35.261635 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-70eec224-ab0a-4d30-bb88-a62f93f68dc5 tempest-ServicesAdminNegativeV253TestJSON-84412101 tempest-ServicesAdminNegativeV253TestJSON-84412101-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '3c1e311c770940b3a9f1270370d08920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd906d4ba6e8d4b44b75e12ad5d5cae54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:35.268591 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-70eec224-ab0a-4d30-bb88-a62f93f68dc5 tempest-ServicesAdminNegativeV253TestJSON-84412101 tempest-ServicesAdminNegativeV253TestJSON-84412101-project] Request method failure captured: Oct 08 20:52:35.268591 ncdv-master-1 devstack@n-api.service[140492]: request: GET /compute/v2.1/os-services HTTP/1.1 Oct 08 20:52:35.268591 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 20:52:35.268591 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 20:52:35.268591 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 20:52:35.268591 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 20:52:35.268591 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 20:52:35.268591 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 20:52:35.268591 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 20:52:35.268591 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 20:52:35.268591 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeMP2c9aer0fPbTTOfE4eSk-p6j5ptqsYgjXYJByTBseJVLTeqiN7f3tuvS4CTAEeXAfFHZQRX0snxGbTKMrCF2B8igGzZQSwdd57rm1ZOoBbeKmtn3pYCxWhvVpQmboAKgreROH_ptyDCXm-uHpVzOrehV7KEmV8ynZukjm7uxGn3A Oct 08 20:52:35.268591 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 20:52:35.268591 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 20:52:35.268591 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 20:52:35.268591 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 20:52:35.268591 ncdv-master-1 devstack@n-api.service[140492]: X-Openstack-Nova-Api-Version: 2.53 Oct 08 20:52:35.268591 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 20:52:35.268591 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 20:52:35.268591 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: d906d4ba6e8d4b44b75e12ad5d5cae54 Oct 08 20:52:35.268591 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-84412101 Oct 08 20:52:35.268591 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 20:52:35.268591 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 20:52:35.269991 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d906d4ba6e8d4b44b75e12ad5d5cae54"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d906d4ba6e8d4b44b75e12ad5d5cae54"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d906d4ba6e8d4b44b75e12ad5d5cae54"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d906d4ba6e8d4b44b75e12ad5d5cae54"}]}] Oct 08 20:52:35.269991 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-84412101 Oct 08 20:52:35.269991 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: d906d4ba6e8d4b44b75e12ad5d5cae54 Oct 08 20:52:35.269991 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-84412101 Oct 08 20:52:35.269991 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-ServicesAdminNegativeV253TestJSON-84412101-project Oct 08 20:52:35.269991 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 20:52:35.269991 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 20:52:35.269991 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 3c1e311c770940b3a9f1270370d08920 Oct 08 20:52:35.269991 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-84412101-project Oct 08 20:52:35.269991 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 20:52:35.269991 ncdv-master-1 devstack@n-api.service[140492]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 08 20:52:35.269991 ncdv-master-1 devstack@n-api.service[140492]: action_args: {} Oct 08 20:52:35.270667 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:52:35.270667 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:52:35.270667 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:52:35.270667 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:52:35.270667 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:52:35.270667 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:52:35.270667 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 08 20:52:35.270667 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 20:52:35.270667 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 08 20:52:35.270667 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 20:52:35.270667 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:52:35.270667 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:52:35.270667 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Oct 08 20:52:35.270667 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Oct 08 20:52:35.270667 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 08 20:52:35.270667 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 08 20:52:35.270667 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 08 20:52:35.270667 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 08 20:52:35.270667 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 08 20:52:35.271685 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 08 20:52:35.271685 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 08 20:52:35.271685 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise self.value Oct 08 20:52:35.271685 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 08 20:52:35.271685 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 08 20:52:35.271685 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 08 20:52:35.271685 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 08 20:52:35.271685 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 08 20:52:35.271685 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 08 20:52:35.271685 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 08 20:52:35.271685 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:52:35.271685 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:52:35.271685 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:52:35.271685 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:52:35.271685 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:52:35.271685 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:52:35.271685 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 08 20:52:35.271685 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 08 20:52:35.271685 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 08 20:52:35.271685 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:52:35.272761 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-70eec224-ab0a-4d30-bb88-a62f93f68dc5 tempest-ServicesAdminNegativeV253TestJSON-84412101 tempest-ServicesAdminNegativeV253TestJSON-84412101-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:52:35.272761 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-70eec224-ab0a-4d30-bb88-a62f93f68dc5 tempest-ServicesAdminNegativeV253TestJSON-84412101 tempest-ServicesAdminNegativeV253TestJSON-84412101-project] 10.222.0.26 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.517752 Oct 08 20:52:35.282774 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 174/339] 10.222.0.26 () {60 vars in 1178 bytes} [Sat Oct 8 20:52:34 2022] GET /compute/v2.1/os-services => generated 112 bytes in 527 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Oct 08 20:52:35.330747 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c38bdefe-aae1-4ef2-844d-f51d8ad25967 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:35.333797 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c38bdefe-aae1-4ef2-844d-f51d8ad25967 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:35.336354 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c38bdefe-aae1-4ef2-844d-f51d8ad25967 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:35.337134 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.objects.instance [None req-c38bdefe-aae1-4ef2-844d-f51d8ad25967 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lazy-loading 'fault' on Instance uuid 800ffcdf-e494-44df-97db-1c7fc74f97b6 {{(pid=140491) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 20:52:35.513294 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-6f401b25-cd1c-4a2a-ac96-451bec64b044 tempest-FlavorsAccessTestJSON-1274362498 tempest-FlavorsAccessTestJSON-1274362498-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-834921004", "id": 752515501, "os-flavor-access:is_public": "False"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:52:35.553053 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-6f401b25-cd1c-4a2a-ac96-451bec64b044 tempest-FlavorsAccessTestJSON-1274362498 tempest-FlavorsAccessTestJSON-1274362498-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.269102 Oct 08 20:52:35.554828 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 175/340] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 20:52:35 2022] POST /compute/v2.1/flavors => generated 427 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:52:35.570963 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-022fd6dc-e389-4fb4-bb90-0e39cfef0f4b tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:35.572777 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-022fd6dc-e389-4fb4-bb90-0e39cfef0f4b tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] [instance: 1af12bcb-5e2a-4c15-8673-fa41701cb4c7] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:52:35.585970 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-022fd6dc-e389-4fb4-bb90-0e39cfef0f4b tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:35.588739 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-022fd6dc-e389-4fb4-bb90-0e39cfef0f4b tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:35.592363 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-022fd6dc-e389-4fb4-bb90-0e39cfef0f4b tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:35.595294 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-022fd6dc-e389-4fb4-bb90-0e39cfef0f4b tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:35.597374 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-022fd6dc-e389-4fb4-bb90-0e39cfef0f4b tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:35.598179 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-022fd6dc-e389-4fb4-bb90-0e39cfef0f4b tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:35.759438 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-022fd6dc-e389-4fb4-bb90-0e39cfef0f4b tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb78cce5f7c4c348045745f40b13129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16530e0f2f0a4d23918261c9e21f9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:35.773112 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-022fd6dc-e389-4fb4-bb90-0e39cfef0f4b tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cb78cce5f7c4c348045745f40b13129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16530e0f2f0a4d23918261c9e21f9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:35.777112 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-022fd6dc-e389-4fb4-bb90-0e39cfef0f4b tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cb78cce5f7c4c348045745f40b13129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16530e0f2f0a4d23918261c9e21f9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:35.787637 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-022fd6dc-e389-4fb4-bb90-0e39cfef0f4b tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] 10.222.0.26 "GET /compute/v2.1/servers/1af12bcb-5e2a-4c15-8673-fa41701cb4c7" status: 200 len: 1447 microversion: 2.75 time: 0.231231 Oct 08 20:52:35.788149 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 176/341] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:52:35 2022] GET /compute/v2.1/servers/1af12bcb-5e2a-4c15-8673-fa41701cb4c7 => generated 1447 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:52:35.802784 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-08b23e18-2187-46a9-9b34-51535c8e5a25 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:35.803287 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-08b23e18-2187-46a9-9b34-51535c8e5a25 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] [instance: 0b4b7773-b59d-4956-b7e5-267d54541db6] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:52:35.820369 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-08b23e18-2187-46a9-9b34-51535c8e5a25 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:35.820864 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-08b23e18-2187-46a9-9b34-51535c8e5a25 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:35.821336 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-08b23e18-2187-46a9-9b34-51535c8e5a25 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:35.822064 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-08b23e18-2187-46a9-9b34-51535c8e5a25 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:35.826592 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-08b23e18-2187-46a9-9b34-51535c8e5a25 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:35.827360 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-08b23e18-2187-46a9-9b34-51535c8e5a25 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:35.972651 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-08b23e18-2187-46a9-9b34-51535c8e5a25 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '360660f7bb4746c8b1397f4857f423f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d702b3083bc4cf5ba6b6fc6f3c3147e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:35.981664 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-08b23e18-2187-46a9-9b34-51535c8e5a25 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] 10.222.0.26 "GET /compute/v2.1/servers/0b4b7773-b59d-4956-b7e5-267d54541db6" status: 200 len: 1278 microversion: 2.1 time: 0.189617 Oct 08 20:52:36.007906 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 177/342] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:52:35 2022] GET /compute/v2.1/servers/0b4b7773-b59d-4956-b7e5-267d54541db6 => generated 1278 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:52:36.022361 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-20d3cf58-a033-49b8-9243-f4f3fd9cb73d tempest-FlavorsAccessTestJSON-1274362498 tempest-FlavorsAccessTestJSON-1274362498-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "adaca3c55bdc4997af5fe503befd19e5"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:52:36.287616 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-c38bdefe-aae1-4ef2-844d-f51d8ad25967 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0eb2feb062947e78357b70e832e3edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18029da9b9854f3caf3debd9556f1f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:36.300335 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-c38bdefe-aae1-4ef2-844d-f51d8ad25967 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] 10.222.0.26 "GET /compute/v2.1/servers/800ffcdf-e494-44df-97db-1c7fc74f97b6" status: 200 len: 1454 microversion: 2.1 time: 1.080191 Oct 08 20:52:36.304854 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 166/343] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:52:35 2022] GET /compute/v2.1/servers/800ffcdf-e494-44df-97db-1c7fc74f97b6 => generated 1454 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:52:36.338005 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-75a83df2-da03-4360-94f2-68b8e7b427e2 req-034cee54-d8f3-4127-81a1-015a0ca4f110 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "800ffcdf-e494-44df-97db-1c7fc74f97b6", "name": "network-vif-deleted", "tag": "b9c44491-677f-4508-83a4-3fbde3696ff4"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:52:36.371858 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-75a83df2-da03-4360-94f2-68b8e7b427e2 req-034cee54-d8f3-4127-81a1-015a0ca4f110 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:36.377211 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-75a83df2-da03-4360-94f2-68b8e7b427e2 req-034cee54-d8f3-4127-81a1-015a0ca4f110 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:36.377987 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-75a83df2-da03-4360-94f2-68b8e7b427e2 req-034cee54-d8f3-4127-81a1-015a0ca4f110 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:36.431172 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-75a83df2-da03-4360-94f2-68b8e7b427e2 req-034cee54-d8f3-4127-81a1-015a0ca4f110 service nova] Creating event network-vif-deleted:b9c44491-677f-4508-83a4-3fbde3696ff4 for instance 800ffcdf-e494-44df-97db-1c7fc74f97b6 on nch2-master-1 Oct 08 20:52:36.447461 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-75a83df2-da03-4360-94f2-68b8e7b427e2 req-034cee54-d8f3-4127-81a1-015a0ca4f110 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138242 Oct 08 20:52:36.448091 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 167/344] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:52:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:52:36.463324 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-4def455b-a213-4f6c-b9a5-68e4f187d7c8 req-d31167f0-09dd-45b3-8186-469927abe27c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88c3b2e3-7038-460b-9874-b120c573c2b7", "name": "network-vif-plugged", "status": "completed", "tag": "4060d040-c7f9-46d0-918f-a58cdd6bebf1"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:52:36.488704 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-4def455b-a213-4f6c-b9a5-68e4f187d7c8 req-d31167f0-09dd-45b3-8186-469927abe27c service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:36.489452 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-4def455b-a213-4f6c-b9a5-68e4f187d7c8 req-d31167f0-09dd-45b3-8186-469927abe27c service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:36.490112 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-4def455b-a213-4f6c-b9a5-68e4f187d7c8 req-d31167f0-09dd-45b3-8186-469927abe27c service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:36.493016 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:36.525162 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-4def455b-a213-4f6c-b9a5-68e4f187d7c8 req-d31167f0-09dd-45b3-8186-469927abe27c service nova] Creating event network-vif-plugged:4060d040-c7f9-46d0-918f-a58cdd6bebf1 for instance 88c3b2e3-7038-460b-9874-b120c573c2b7 on nch2-master-1 Oct 08 20:52:36.530046 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-20d3cf58-a033-49b8-9243-f4f3fd9cb73d tempest-FlavorsAccessTestJSON-1274362498 tempest-FlavorsAccessTestJSON-1274362498-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors/752515501/action" status: 200 len: 96 microversion: 2.1 time: 0.519799 Oct 08 20:52:36.535838 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 178/345] 10.222.0.26 () {60 vars in 1197 bytes} [Sat Oct 8 20:52:36 2022] POST /compute/v2.1/flavors/752515501/action => generated 96 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 08 20:52:36.540997 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-6ab31622-fa29-412c-9634-1e142a6b4447 tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:36.544366 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-4def455b-a213-4f6c-b9a5-68e4f187d7c8 req-d31167f0-09dd-45b3-8186-469927abe27c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090810 Oct 08 20:52:36.552755 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 168/346] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:52:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:52:36.555927 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-6ab31622-fa29-412c-9634-1e142a6b4447 tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] [instance: 88c3b2e3-7038-460b-9874-b120c573c2b7] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:52:36.564729 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6ab31622-fa29-412c-9634-1e142a6b4447 tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:36.566210 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6ab31622-fa29-412c-9634-1e142a6b4447 tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:36.566878 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6ab31622-fa29-412c-9634-1e142a6b4447 tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:36.567853 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6ab31622-fa29-412c-9634-1e142a6b4447 tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:36.568529 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6ab31622-fa29-412c-9634-1e142a6b4447 tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:36.569159 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6ab31622-fa29-412c-9634-1e142a6b4447 tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:36.781027 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-e80bf363-d753-4589-a1ec-2e66edd3496e tempest-FlavorsAccessTestJSON-1261953451 tempest-FlavorsAccessTestJSON-1261953451-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:36.900988 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-e80bf363-d753-4589-a1ec-2e66edd3496e tempest-FlavorsAccessTestJSON-1261953451 tempest-FlavorsAccessTestJSON-1261953451-project] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 5408 microversion: 2.1 time: 0.330880 Oct 08 20:52:36.907582 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 169/347] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Oct 8 20:52:36 2022] GET /compute/v2.1/flavors/detail => generated 5408 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:52:36.919691 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-8e4c3d98-9255-49e9-bc57-073df5ec5250 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:36.934331 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-8e4c3d98-9255-49e9-bc57-073df5ec5250 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] [instance: 1af12bcb-5e2a-4c15-8673-fa41701cb4c7] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:52:36.955571 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8e4c3d98-9255-49e9-bc57-073df5ec5250 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:36.956068 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8e4c3d98-9255-49e9-bc57-073df5ec5250 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:36.956508 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8e4c3d98-9255-49e9-bc57-073df5ec5250 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:36.969159 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8e4c3d98-9255-49e9-bc57-073df5ec5250 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:36.970088 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8e4c3d98-9255-49e9-bc57-073df5ec5250 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:36.973100 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8e4c3d98-9255-49e9-bc57-073df5ec5250 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:37.144842 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-8e4c3d98-9255-49e9-bc57-073df5ec5250 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb78cce5f7c4c348045745f40b13129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16530e0f2f0a4d23918261c9e21f9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:37.154826 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-8e4c3d98-9255-49e9-bc57-073df5ec5250 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cb78cce5f7c4c348045745f40b13129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16530e0f2f0a4d23918261c9e21f9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:37.156358 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-8e4c3d98-9255-49e9-bc57-073df5ec5250 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cb78cce5f7c4c348045745f40b13129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16530e0f2f0a4d23918261c9e21f9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:37.179633 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-8e4c3d98-9255-49e9-bc57-073df5ec5250 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] 10.222.0.26 "GET /compute/v2.1/servers/1af12bcb-5e2a-4c15-8673-fa41701cb4c7" status: 200 len: 1447 microversion: 2.75 time: 0.267724 Oct 08 20:52:37.180236 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 170/348] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:52:36 2022] GET /compute/v2.1/servers/1af12bcb-5e2a-4c15-8673-fa41701cb4c7 => generated 1447 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:52:37.192959 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-d5072331-af3f-4ee0-b21e-63c55eee548b tempest-FlavorsAccessTestJSON-1274362498 tempest-FlavorsAccessTestJSON-1274362498-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "adaca3c55bdc4997af5fe503befd19e5"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:52:37.328714 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-d5072331-af3f-4ee0-b21e-63c55eee548b tempest-FlavorsAccessTestJSON-1274362498 tempest-FlavorsAccessTestJSON-1274362498-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors/752515501/action" status: 200 len: 21 microversion: 2.1 time: 0.147038 Oct 08 20:52:37.329399 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 171/349] 10.222.0.26 () {60 vars in 1197 bytes} [Sat Oct 8 20:52:37 2022] POST /compute/v2.1/flavors/752515501/action => generated 21 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 08 20:52:37.346179 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-4e6701fd-1134-4eb9-90cb-8691bd066684 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:37.349749 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-4e6701fd-1134-4eb9-90cb-8691bd066684 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] [instance: 0b4b7773-b59d-4956-b7e5-267d54541db6] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:52:37.368793 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4e6701fd-1134-4eb9-90cb-8691bd066684 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:37.375195 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4e6701fd-1134-4eb9-90cb-8691bd066684 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:37.376113 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4e6701fd-1134-4eb9-90cb-8691bd066684 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:37.377038 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4e6701fd-1134-4eb9-90cb-8691bd066684 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:37.378600 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4e6701fd-1134-4eb9-90cb-8691bd066684 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:37.382287 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4e6701fd-1134-4eb9-90cb-8691bd066684 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:37.451012 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-6ab31622-fa29-412c-9634-1e142a6b4447 tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c74c1e22148c6ba7612cb03d8bd02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e5f13ede0474c1888ffb1f7168daf67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:37.461826 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-6ab31622-fa29-412c-9634-1e142a6b4447 tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] 10.222.0.26 "GET /compute/v2.1/servers/88c3b2e3-7038-460b-9874-b120c573c2b7" status: 200 len: 1323 microversion: 2.1 time: 0.924322 Oct 08 20:52:37.463197 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 179/350] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:52:36 2022] GET /compute/v2.1/servers/88c3b2e3-7038-460b-9874-b120c573c2b7 => generated 1323 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:52:37.479579 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-506153cd-94a6-4454-8bd2-7fe5383062db tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:37.480513 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-506153cd-94a6-4454-8bd2-7fe5383062db tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] [instance: 800ffcdf-e494-44df-97db-1c7fc74f97b6] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:52:37.490822 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-506153cd-94a6-4454-8bd2-7fe5383062db tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:37.491851 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-506153cd-94a6-4454-8bd2-7fe5383062db tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:37.492886 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-506153cd-94a6-4454-8bd2-7fe5383062db tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:37.493541 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-506153cd-94a6-4454-8bd2-7fe5383062db tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:37.495038 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-506153cd-94a6-4454-8bd2-7fe5383062db tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:37.495642 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-506153cd-94a6-4454-8bd2-7fe5383062db tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:37.521411 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-506153cd-94a6-4454-8bd2-7fe5383062db tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] HTTP exception thrown: Instance 800ffcdf-e494-44df-97db-1c7fc74f97b6 could not be found. Oct 08 20:52:37.523603 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-506153cd-94a6-4454-8bd2-7fe5383062db tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Request method failure captured: Oct 08 20:52:37.523603 ncdv-master-1 devstack@n-api.service[140492]: request: GET /compute/v2.1/servers/800ffcdf-e494-44df-97db-1c7fc74f97b6 HTTP/1.1 Oct 08 20:52:37.523603 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 20:52:37.523603 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 20:52:37.523603 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 20:52:37.523603 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 20:52:37.523603 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 20:52:37.523603 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 20:52:37.523603 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 20:52:37.523603 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 20:52:37.523603 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeLd0unx4H4zm5ydlZfB7yl3H_ct2Abk1aIr5-N5ApC0qVozlM98eKylBjK6CJEr54w2-JCYaqPAe9Igew1wbTL4pDf1jaTQih3wPvBIIdGIcXOQxpHK-t_RMUrbajWwzLh6FCYlyF7A2TJ605Rb1BV9Z9MY7Re28E-Jju-YwTNbhf8 Oct 08 20:52:37.523603 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 20:52:37.523603 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 20:52:37.523603 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 20:52:37.523603 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 20:52:37.523603 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 20:52:37.523603 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 20:52:37.523603 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 18029da9b9854f3caf3debd9556f1f24 Oct 08 20:52:37.523603 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-DeleteServersAdminTestJSON-802999185 Oct 08 20:52:37.523603 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 20:52:37.523603 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 20:52:37.525343 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/18029da9b9854f3caf3debd9556f1f24"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/18029da9b9854f3caf3debd9556f1f24"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_18029da9b9854f3caf3debd9556f1f24"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/18029da9b9854f3caf3debd9556f1f24"}]}] Oct 08 20:52:37.525343 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-DeleteServersAdminTestJSON-802999185 Oct 08 20:52:37.525343 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 18029da9b9854f3caf3debd9556f1f24 Oct 08 20:52:37.525343 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-802999185 Oct 08 20:52:37.525343 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-DeleteServersAdminTestJSON-802999185-project Oct 08 20:52:37.525343 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 20:52:37.525343 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 20:52:37.525343 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: c0eb2feb062947e78357b70e832e3edc Oct 08 20:52:37.525343 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-DeleteServersAdminTestJSON-802999185-project Oct 08 20:52:37.525343 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 20:52:37.525343 ncdv-master-1 devstack@n-api.service[140492]: exception: Instance 800ffcdf-e494-44df-97db-1c7fc74f97b6 could not be found. Oct 08 20:52:37.525343 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': '800ffcdf-e494-44df-97db-1c7fc74f97b6'} Oct 08 20:52:37.526183 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:52:37.526183 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:52:37.526183 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 20:52:37.526183 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 20:52:37.526183 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 20:52:37.526183 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 20:52:37.526183 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 20:52:37.526183 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 20:52:37.526183 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 20:52:37.526183 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 20:52:37.526183 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 800ffcdf-e494-44df-97db-1c7fc74f97b6 could not be found. Oct 08 20:52:37.526183 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:52:37.526183 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:52:37.526183 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:52:37.526183 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:52:37.526183 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:52:37.526183 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:52:37.526183 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:52:37.526183 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:52:37.526183 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:52:37.527679 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:52:37.527679 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 20:52:37.527679 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 20:52:37.527679 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 20:52:37.527679 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 20:52:37.527679 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 20:52:37.527679 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 20:52:37.527679 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 800ffcdf-e494-44df-97db-1c7fc74f97b6 could not be found. Oct 08 20:52:37.527679 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:52:37.527679 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:52:37.527679 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:52:37.527679 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:52:37.527679 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:52:37.527679 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:52:37.527679 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 20:52:37.527679 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 20:52:37.527679 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 800ffcdf-e494-44df-97db-1c7fc74f97b6 could not be found. Oct 08 20:52:37.527679 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:52:37.529987 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-506153cd-94a6-4454-8bd2-7fe5383062db tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Returning 404 to user: Instance 800ffcdf-e494-44df-97db-1c7fc74f97b6 could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:52:37.531299 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-506153cd-94a6-4454-8bd2-7fe5383062db tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] 10.222.0.26 "GET /compute/v2.1/servers/800ffcdf-e494-44df-97db-1c7fc74f97b6" status: 404 len: 111 microversion: 2.1 time: 0.066674 Oct 08 20:52:37.532373 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 180/351] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:52:37 2022] GET /compute/v2.1/servers/800ffcdf-e494-44df-97db-1c7fc74f97b6 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 20:52:37.537402 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-0080cb72-6424-4fa4-96e8-e5bd27d5967d tempest-FlavorsAccessTestJSON-1261953451 tempest-FlavorsAccessTestJSON-1261953451-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:37.568539 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-0080cb72-6424-4fa4-96e8-e5bd27d5967d tempest-FlavorsAccessTestJSON-1261953451 tempest-FlavorsAccessTestJSON-1261953451-project] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.034639 Oct 08 20:52:37.569548 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 181/352] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Oct 8 20:52:37 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:52:37.588014 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-504e4eeb-556e-447d-8302-9ef918b98e95 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:37.588934 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-504e4eeb-556e-447d-8302-9ef918b98e95 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] [instance: 800ffcdf-e494-44df-97db-1c7fc74f97b6] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:52:37.596547 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-504e4eeb-556e-447d-8302-9ef918b98e95 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:37.597707 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-504e4eeb-556e-447d-8302-9ef918b98e95 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:37.598405 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-504e4eeb-556e-447d-8302-9ef918b98e95 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:37.599363 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-504e4eeb-556e-447d-8302-9ef918b98e95 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:37.600791 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-504e4eeb-556e-447d-8302-9ef918b98e95 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:37.602670 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-504e4eeb-556e-447d-8302-9ef918b98e95 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:37.623562 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-504e4eeb-556e-447d-8302-9ef918b98e95 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] HTTP exception thrown: Instance 800ffcdf-e494-44df-97db-1c7fc74f97b6 could not be found. Oct 08 20:52:37.626353 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-504e4eeb-556e-447d-8302-9ef918b98e95 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Request method failure captured: Oct 08 20:52:37.626353 ncdv-master-1 devstack@n-api.service[140492]: request: DELETE /compute/v2.1/servers/800ffcdf-e494-44df-97db-1c7fc74f97b6 HTTP/1.1 Oct 08 20:52:37.626353 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 20:52:37.626353 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 20:52:37.626353 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 20:52:37.626353 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 20:52:37.626353 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 20:52:37.626353 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 20:52:37.626353 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 20:52:37.626353 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 20:52:37.626353 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeLd0unx4H4zm5ydlZfB7yl3H_ct2Abk1aIr5-N5ApC0qVozlM98eKylBjK6CJEr54w2-JCYaqPAe9Igew1wbTL4pDf1jaTQih3wPvBIIdGIcXOQxpHK-t_RMUrbajWwzLh6FCYlyF7A2TJ605Rb1BV9Z9MY7Re28E-Jju-YwTNbhf8 Oct 08 20:52:37.626353 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 20:52:37.626353 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 20:52:37.626353 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 20:52:37.626353 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 20:52:37.626353 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 20:52:37.626353 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 20:52:37.626353 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 18029da9b9854f3caf3debd9556f1f24 Oct 08 20:52:37.626353 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-DeleteServersAdminTestJSON-802999185 Oct 08 20:52:37.626353 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 20:52:37.626353 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 20:52:37.627539 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/18029da9b9854f3caf3debd9556f1f24"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/18029da9b9854f3caf3debd9556f1f24"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_18029da9b9854f3caf3debd9556f1f24"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/18029da9b9854f3caf3debd9556f1f24"}]}] Oct 08 20:52:37.627539 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-DeleteServersAdminTestJSON-802999185 Oct 08 20:52:37.627539 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 18029da9b9854f3caf3debd9556f1f24 Oct 08 20:52:37.627539 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-802999185 Oct 08 20:52:37.627539 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-DeleteServersAdminTestJSON-802999185-project Oct 08 20:52:37.627539 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 20:52:37.627539 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 20:52:37.627539 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: c0eb2feb062947e78357b70e832e3edc Oct 08 20:52:37.627539 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-DeleteServersAdminTestJSON-802999185-project Oct 08 20:52:37.627539 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 20:52:37.627539 ncdv-master-1 devstack@n-api.service[140492]: exception: Instance 800ffcdf-e494-44df-97db-1c7fc74f97b6 could not be found. Oct 08 20:52:37.627539 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': '800ffcdf-e494-44df-97db-1c7fc74f97b6'} Oct 08 20:52:37.628210 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:52:37.628210 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:52:37.628210 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 20:52:37.628210 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 20:52:37.628210 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 20:52:37.628210 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 20:52:37.628210 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 20:52:37.628210 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 20:52:37.628210 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 20:52:37.628210 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 20:52:37.628210 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 800ffcdf-e494-44df-97db-1c7fc74f97b6 could not be found. Oct 08 20:52:37.628210 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:52:37.628210 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:52:37.628210 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:52:37.628210 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:52:37.628210 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:52:37.628210 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:52:37.628210 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:52:37.628210 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:52:37.628210 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:52:37.629261 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:52:37.629261 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 08 20:52:37.629261 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 08 20:52:37.629261 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 08 20:52:37.629261 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 08 20:52:37.629261 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 20:52:37.629261 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 20:52:37.629261 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 20:52:37.629261 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 20:52:37.629261 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 800ffcdf-e494-44df-97db-1c7fc74f97b6 could not be found. Oct 08 20:52:37.629261 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:52:37.629261 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:52:37.629261 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:52:37.629261 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:52:37.629261 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:52:37.629261 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:52:37.629261 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 20:52:37.629261 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 20:52:37.629261 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 800ffcdf-e494-44df-97db-1c7fc74f97b6 could not be found. Oct 08 20:52:37.629261 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:52:37.632547 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-504e4eeb-556e-447d-8302-9ef918b98e95 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Returning 404 to user: Instance 800ffcdf-e494-44df-97db-1c7fc74f97b6 could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:52:37.633563 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-504e4eeb-556e-447d-8302-9ef918b98e95 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] 10.222.0.26 "DELETE /compute/v2.1/servers/800ffcdf-e494-44df-97db-1c7fc74f97b6" status: 404 len: 111 microversion: 2.1 time: 0.050682 Oct 08 20:52:37.634144 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 182/353] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 20:52:37 2022] DELETE /compute/v2.1/servers/800ffcdf-e494-44df-97db-1c7fc74f97b6 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 20:52:37.640109 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-4d2e4035-5d50-4ac2-be26-78c35e000b15 tempest-FlavorsAccessTestJSON-1274362498 tempest-FlavorsAccessTestJSON-1274362498-project-admin] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:37.665603 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-4d2e4035-5d50-4ac2-be26-78c35e000b15 tempest-FlavorsAccessTestJSON-1274362498 tempest-FlavorsAccessTestJSON-1274362498-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/752515501" status: 202 len: 0 microversion: 2.1 time: 0.029431 Oct 08 20:52:37.667059 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 183/354] 10.222.0.26 () {58 vars in 1158 bytes} [Sat Oct 8 20:52:37 2022] DELETE /compute/v2.1/flavors/752515501 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 20:52:37.674327 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-d1340bd8-68c7-4cdf-9e6c-3ef94b3cc96d tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:37.675173 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-d1340bd8-68c7-4cdf-9e6c-3ef94b3cc96d tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] [instance: 800ffcdf-e494-44df-97db-1c7fc74f97b6] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:52:37.682872 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d1340bd8-68c7-4cdf-9e6c-3ef94b3cc96d tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:37.683730 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d1340bd8-68c7-4cdf-9e6c-3ef94b3cc96d tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:37.684433 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d1340bd8-68c7-4cdf-9e6c-3ef94b3cc96d tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:37.685401 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d1340bd8-68c7-4cdf-9e6c-3ef94b3cc96d tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:37.686060 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d1340bd8-68c7-4cdf-9e6c-3ef94b3cc96d tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:37.686750 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d1340bd8-68c7-4cdf-9e6c-3ef94b3cc96d tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:37.705909 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-d1340bd8-68c7-4cdf-9e6c-3ef94b3cc96d tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] HTTP exception thrown: Instance 800ffcdf-e494-44df-97db-1c7fc74f97b6 could not be found. Oct 08 20:52:37.708465 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-d1340bd8-68c7-4cdf-9e6c-3ef94b3cc96d tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Request method failure captured: Oct 08 20:52:37.708465 ncdv-master-1 devstack@n-api.service[140492]: request: GET /compute/v2.1/servers/800ffcdf-e494-44df-97db-1c7fc74f97b6 HTTP/1.1 Oct 08 20:52:37.708465 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 20:52:37.708465 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 20:52:37.708465 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 20:52:37.708465 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 20:52:37.708465 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 20:52:37.708465 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 20:52:37.708465 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 20:52:37.708465 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 20:52:37.708465 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeLd0unx4H4zm5ydlZfB7yl3H_ct2Abk1aIr5-N5ApC0qVozlM98eKylBjK6CJEr54w2-JCYaqPAe9Igew1wbTL4pDf1jaTQih3wPvBIIdGIcXOQxpHK-t_RMUrbajWwzLh6FCYlyF7A2TJ605Rb1BV9Z9MY7Re28E-Jju-YwTNbhf8 Oct 08 20:52:37.708465 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 20:52:37.708465 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 20:52:37.708465 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 20:52:37.708465 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 20:52:37.708465 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 20:52:37.708465 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 20:52:37.708465 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 18029da9b9854f3caf3debd9556f1f24 Oct 08 20:52:37.708465 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-DeleteServersAdminTestJSON-802999185 Oct 08 20:52:37.708465 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 20:52:37.708465 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 20:52:37.709761 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/18029da9b9854f3caf3debd9556f1f24"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/18029da9b9854f3caf3debd9556f1f24"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_18029da9b9854f3caf3debd9556f1f24"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/18029da9b9854f3caf3debd9556f1f24"}]}] Oct 08 20:52:37.709761 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-DeleteServersAdminTestJSON-802999185 Oct 08 20:52:37.709761 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 18029da9b9854f3caf3debd9556f1f24 Oct 08 20:52:37.709761 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-802999185 Oct 08 20:52:37.709761 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-DeleteServersAdminTestJSON-802999185-project Oct 08 20:52:37.709761 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 20:52:37.709761 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 20:52:37.709761 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: c0eb2feb062947e78357b70e832e3edc Oct 08 20:52:37.709761 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-DeleteServersAdminTestJSON-802999185-project Oct 08 20:52:37.709761 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 20:52:37.709761 ncdv-master-1 devstack@n-api.service[140492]: exception: Instance 800ffcdf-e494-44df-97db-1c7fc74f97b6 could not be found. Oct 08 20:52:37.709761 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': '800ffcdf-e494-44df-97db-1c7fc74f97b6'} Oct 08 20:52:37.710844 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:52:37.710844 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:52:37.710844 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 20:52:37.710844 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 20:52:37.710844 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 20:52:37.710844 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 20:52:37.710844 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 20:52:37.710844 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 20:52:37.710844 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 20:52:37.710844 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 20:52:37.710844 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 800ffcdf-e494-44df-97db-1c7fc74f97b6 could not be found. Oct 08 20:52:37.710844 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:52:37.710844 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:52:37.710844 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:52:37.710844 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:52:37.710844 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:52:37.710844 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:52:37.710844 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:52:37.710844 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:52:37.710844 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:52:37.711873 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:52:37.711873 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 20:52:37.711873 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 20:52:37.711873 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 20:52:37.711873 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 20:52:37.711873 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 20:52:37.711873 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 20:52:37.711873 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 800ffcdf-e494-44df-97db-1c7fc74f97b6 could not be found. Oct 08 20:52:37.711873 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:52:37.711873 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:52:37.711873 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:52:37.711873 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:52:37.711873 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:52:37.711873 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:52:37.711873 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 20:52:37.711873 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 20:52:37.711873 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 800ffcdf-e494-44df-97db-1c7fc74f97b6 could not be found. Oct 08 20:52:37.711873 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:52:37.716101 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-d1340bd8-68c7-4cdf-9e6c-3ef94b3cc96d tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Returning 404 to user: Instance 800ffcdf-e494-44df-97db-1c7fc74f97b6 could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:52:37.718408 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-d1340bd8-68c7-4cdf-9e6c-3ef94b3cc96d tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] 10.222.0.26 "GET /compute/v2.1/servers/800ffcdf-e494-44df-97db-1c7fc74f97b6" status: 404 len: 111 microversion: 2.1 time: 0.049809 Oct 08 20:52:37.719573 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 184/355] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:52:37 2022] GET /compute/v2.1/servers/800ffcdf-e494-44df-97db-1c7fc74f97b6 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 20:52:37.726158 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-c19c8e83-eb78-4cbb-a5b8-d8496c77bc86 tempest-FlavorsAccessTestJSON-1274362498 tempest-FlavorsAccessTestJSON-1274362498-project-admin] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:37.756045 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-c19c8e83-eb78-4cbb-a5b8-d8496c77bc86 tempest-FlavorsAccessTestJSON-1274362498 tempest-FlavorsAccessTestJSON-1274362498-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.034234 Oct 08 20:52:37.757340 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 185/356] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Oct 8 20:52:37 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:52:37.776990 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-88fa0545-cf3f-40d8-aa2f-33857e1688c9 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:37.778062 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-88fa0545-cf3f-40d8-aa2f-33857e1688c9 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] [instance: 6611e099-c1f0-4fed-ba7b-0b096800946d] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:52:37.791135 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-88fa0545-cf3f-40d8-aa2f-33857e1688c9 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:37.791973 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-88fa0545-cf3f-40d8-aa2f-33857e1688c9 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:37.792705 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-88fa0545-cf3f-40d8-aa2f-33857e1688c9 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:37.794717 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-88fa0545-cf3f-40d8-aa2f-33857e1688c9 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:37.795621 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-88fa0545-cf3f-40d8-aa2f-33857e1688c9 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:37.797228 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-88fa0545-cf3f-40d8-aa2f-33857e1688c9 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:37.819400 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-88fa0545-cf3f-40d8-aa2f-33857e1688c9 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] HTTP exception thrown: Instance 6611e099-c1f0-4fed-ba7b-0b096800946d could not be found. Oct 08 20:52:37.821217 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-88fa0545-cf3f-40d8-aa2f-33857e1688c9 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Request method failure captured: Oct 08 20:52:37.821217 ncdv-master-1 devstack@n-api.service[140492]: request: DELETE /compute/v2.1/servers/6611e099-c1f0-4fed-ba7b-0b096800946d HTTP/1.1 Oct 08 20:52:37.821217 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 20:52:37.821217 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 20:52:37.821217 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 20:52:37.821217 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 20:52:37.821217 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 20:52:37.821217 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 20:52:37.821217 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 20:52:37.821217 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 20:52:37.821217 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeLd0unx4H4zm5ydlZfB7yl3H_ct2Abk1aIr5-N5ApC0qVozlM98eKylBjK6CJEr54w2-JCYaqPAe9Igew1wbTL4pDf1jaTQih3wPvBIIdGIcXOQxpHK-t_RMUrbajWwzLh6FCYlyF7A2TJ605Rb1BV9Z9MY7Re28E-Jju-YwTNbhf8 Oct 08 20:52:37.821217 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 20:52:37.821217 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 20:52:37.821217 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 20:52:37.821217 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 20:52:37.821217 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 20:52:37.821217 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 20:52:37.821217 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 18029da9b9854f3caf3debd9556f1f24 Oct 08 20:52:37.821217 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-DeleteServersAdminTestJSON-802999185 Oct 08 20:52:37.821217 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 20:52:37.821217 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 20:52:37.822478 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/18029da9b9854f3caf3debd9556f1f24"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/18029da9b9854f3caf3debd9556f1f24"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_18029da9b9854f3caf3debd9556f1f24"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/18029da9b9854f3caf3debd9556f1f24"}]}] Oct 08 20:52:37.822478 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-DeleteServersAdminTestJSON-802999185 Oct 08 20:52:37.822478 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 18029da9b9854f3caf3debd9556f1f24 Oct 08 20:52:37.822478 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-802999185 Oct 08 20:52:37.822478 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-DeleteServersAdminTestJSON-802999185-project Oct 08 20:52:37.822478 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 20:52:37.822478 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 20:52:37.822478 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: c0eb2feb062947e78357b70e832e3edc Oct 08 20:52:37.822478 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-DeleteServersAdminTestJSON-802999185-project Oct 08 20:52:37.822478 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 20:52:37.822478 ncdv-master-1 devstack@n-api.service[140492]: exception: Instance 6611e099-c1f0-4fed-ba7b-0b096800946d could not be found. Oct 08 20:52:37.822478 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': '6611e099-c1f0-4fed-ba7b-0b096800946d'} Oct 08 20:52:37.823138 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:52:37.823138 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:52:37.823138 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 20:52:37.823138 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 20:52:37.823138 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 20:52:37.823138 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 20:52:37.823138 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 20:52:37.823138 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 20:52:37.823138 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 20:52:37.823138 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 20:52:37.823138 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6611e099-c1f0-4fed-ba7b-0b096800946d could not be found. Oct 08 20:52:37.823138 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:52:37.823138 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:52:37.823138 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:52:37.823138 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:52:37.823138 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:52:37.823138 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:52:37.823138 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:52:37.823138 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:52:37.823138 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:52:37.824414 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:52:37.824414 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 08 20:52:37.824414 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 08 20:52:37.824414 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 08 20:52:37.824414 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 08 20:52:37.824414 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 20:52:37.824414 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 20:52:37.824414 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 20:52:37.824414 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 20:52:37.824414 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6611e099-c1f0-4fed-ba7b-0b096800946d could not be found. Oct 08 20:52:37.824414 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:52:37.824414 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:52:37.824414 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:52:37.824414 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:52:37.824414 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:52:37.824414 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:52:37.824414 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 20:52:37.824414 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 20:52:37.824414 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6611e099-c1f0-4fed-ba7b-0b096800946d could not be found. Oct 08 20:52:37.824414 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:52:37.826852 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-88fa0545-cf3f-40d8-aa2f-33857e1688c9 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Returning 404 to user: Instance 6611e099-c1f0-4fed-ba7b-0b096800946d could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:52:37.837843 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-88fa0545-cf3f-40d8-aa2f-33857e1688c9 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] 10.222.0.26 "DELETE /compute/v2.1/servers/6611e099-c1f0-4fed-ba7b-0b096800946d" status: 404 len: 111 microversion: 2.1 time: 0.075114 Oct 08 20:52:37.838684 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 186/357] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 20:52:37 2022] DELETE /compute/v2.1/servers/6611e099-c1f0-4fed-ba7b-0b096800946d => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 20:52:37.845153 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-f25ff12c-6fa0-47e3-9ec7-6ce39a06c4c9 tempest-FlavorsAccessTestJSON-1274362498 tempest-FlavorsAccessTestJSON-1274362498-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1961404939", "id": 377137436, "os-flavor-access:is_public": "False"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:52:37.884409 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-f25ff12c-6fa0-47e3-9ec7-6ce39a06c4c9 tempest-FlavorsAccessTestJSON-1274362498 tempest-FlavorsAccessTestJSON-1274362498-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 428 microversion: 2.1 time: 0.044792 Oct 08 20:52:37.885256 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 187/358] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 20:52:37 2022] POST /compute/v2.1/flavors => generated 428 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:52:37.896623 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-5615d335-9e93-49eb-bf5f-7d117e9a7903 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:37.897378 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-5615d335-9e93-49eb-bf5f-7d117e9a7903 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] [instance: 6611e099-c1f0-4fed-ba7b-0b096800946d] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:52:37.922716 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5615d335-9e93-49eb-bf5f-7d117e9a7903 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:37.923758 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5615d335-9e93-49eb-bf5f-7d117e9a7903 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:37.924541 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5615d335-9e93-49eb-bf5f-7d117e9a7903 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:37.925987 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5615d335-9e93-49eb-bf5f-7d117e9a7903 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:37.926568 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5615d335-9e93-49eb-bf5f-7d117e9a7903 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:37.927180 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5615d335-9e93-49eb-bf5f-7d117e9a7903 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:37.950153 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-5615d335-9e93-49eb-bf5f-7d117e9a7903 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] HTTP exception thrown: Instance 6611e099-c1f0-4fed-ba7b-0b096800946d could not be found. Oct 08 20:52:37.958153 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-5615d335-9e93-49eb-bf5f-7d117e9a7903 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Request method failure captured: Oct 08 20:52:37.958153 ncdv-master-1 devstack@n-api.service[140492]: request: GET /compute/v2.1/servers/6611e099-c1f0-4fed-ba7b-0b096800946d HTTP/1.1 Oct 08 20:52:37.958153 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 20:52:37.958153 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 20:52:37.958153 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 20:52:37.958153 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 20:52:37.958153 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 20:52:37.958153 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 20:52:37.958153 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 20:52:37.958153 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 20:52:37.958153 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeLd0unx4H4zm5ydlZfB7yl3H_ct2Abk1aIr5-N5ApC0qVozlM98eKylBjK6CJEr54w2-JCYaqPAe9Igew1wbTL4pDf1jaTQih3wPvBIIdGIcXOQxpHK-t_RMUrbajWwzLh6FCYlyF7A2TJ605Rb1BV9Z9MY7Re28E-Jju-YwTNbhf8 Oct 08 20:52:37.958153 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 20:52:37.958153 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 20:52:37.958153 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 20:52:37.958153 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 20:52:37.958153 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 20:52:37.958153 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 20:52:37.958153 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 18029da9b9854f3caf3debd9556f1f24 Oct 08 20:52:37.958153 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-DeleteServersAdminTestJSON-802999185 Oct 08 20:52:37.958153 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 20:52:37.958153 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 20:52:37.959635 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/18029da9b9854f3caf3debd9556f1f24"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/18029da9b9854f3caf3debd9556f1f24"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_18029da9b9854f3caf3debd9556f1f24"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/18029da9b9854f3caf3debd9556f1f24"}]}] Oct 08 20:52:37.959635 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-DeleteServersAdminTestJSON-802999185 Oct 08 20:52:37.959635 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 18029da9b9854f3caf3debd9556f1f24 Oct 08 20:52:37.959635 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-802999185 Oct 08 20:52:37.959635 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-DeleteServersAdminTestJSON-802999185-project Oct 08 20:52:37.959635 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 20:52:37.959635 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 20:52:37.959635 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: c0eb2feb062947e78357b70e832e3edc Oct 08 20:52:37.959635 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-DeleteServersAdminTestJSON-802999185-project Oct 08 20:52:37.959635 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 20:52:37.959635 ncdv-master-1 devstack@n-api.service[140492]: exception: Instance 6611e099-c1f0-4fed-ba7b-0b096800946d could not be found. Oct 08 20:52:37.959635 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': '6611e099-c1f0-4fed-ba7b-0b096800946d'} Oct 08 20:52:37.960406 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:52:37.960406 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:52:37.960406 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 20:52:37.960406 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 20:52:37.960406 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 20:52:37.960406 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 20:52:37.960406 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 20:52:37.960406 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 20:52:37.960406 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 20:52:37.960406 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 20:52:37.960406 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6611e099-c1f0-4fed-ba7b-0b096800946d could not be found. Oct 08 20:52:37.960406 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:52:37.960406 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:52:37.960406 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:52:37.960406 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:52:37.960406 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:52:37.960406 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:52:37.960406 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:52:37.960406 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:52:37.960406 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:52:37.961493 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:52:37.961493 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 20:52:37.961493 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 20:52:37.961493 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 20:52:37.961493 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 20:52:37.961493 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 20:52:37.961493 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 20:52:37.961493 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6611e099-c1f0-4fed-ba7b-0b096800946d could not be found. Oct 08 20:52:37.961493 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:52:37.961493 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:52:37.961493 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:52:37.961493 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:52:37.961493 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:52:37.961493 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:52:37.961493 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 20:52:37.961493 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 20:52:37.961493 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6611e099-c1f0-4fed-ba7b-0b096800946d could not be found. Oct 08 20:52:37.961493 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:52:37.970527 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-5615d335-9e93-49eb-bf5f-7d117e9a7903 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] Returning 404 to user: Instance 6611e099-c1f0-4fed-ba7b-0b096800946d could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:52:37.972658 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-5615d335-9e93-49eb-bf5f-7d117e9a7903 tempest-DeleteServersAdminTestJSON-802999185 tempest-DeleteServersAdminTestJSON-802999185-project] 10.222.0.26 "GET /compute/v2.1/servers/6611e099-c1f0-4fed-ba7b-0b096800946d" status: 404 len: 111 microversion: 2.1 time: 0.080747 Oct 08 20:52:37.983296 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 188/359] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:52:37 2022] GET /compute/v2.1/servers/6611e099-c1f0-4fed-ba7b-0b096800946d => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 20:52:37.990495 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-a17d4325-785c-4562-8740-8f63a67276f0 tempest-FlavorsAccessTestJSON-1274362498 tempest-FlavorsAccessTestJSON-1274362498-project-admin] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:38.049771 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-a17d4325-785c-4562-8740-8f63a67276f0 tempest-FlavorsAccessTestJSON-1274362498 tempest-FlavorsAccessTestJSON-1274362498-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/377137436/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.064554 Oct 08 20:52:38.050369 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 189/360] 10.222.0.26 () {58 vars in 1206 bytes} [Sat Oct 8 20:52:37 2022] GET /compute/v2.1/flavors/377137436/os-flavor-access => generated 21 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 08 20:52:38.071034 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-a285e2eb-e8b5-4bb4-8aa9-de952bec79b7 tempest-FlavorsAccessTestJSON-1274362498 tempest-FlavorsAccessTestJSON-1274362498-project-admin] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:38.149072 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-a285e2eb-e8b5-4bb4-8aa9-de952bec79b7 tempest-FlavorsAccessTestJSON-1274362498 tempest-FlavorsAccessTestJSON-1274362498-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/377137436" status: 202 len: 0 microversion: 2.1 time: 0.091809 Oct 08 20:52:38.165213 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 190/361] 10.222.0.26 () {58 vars in 1158 bytes} [Sat Oct 8 20:52:38 2022] DELETE /compute/v2.1/flavors/377137436 => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 20:52:38.182541 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-d4b7855e-55c6-4ab8-8f07-4ebb8262c15c tempest-FlavorsAccessTestJSON-1274362498 tempest-FlavorsAccessTestJSON-1274362498-project-admin] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:38.237615 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-d4b7855e-55c6-4ab8-8f07-4ebb8262c15c tempest-FlavorsAccessTestJSON-1274362498 tempest-FlavorsAccessTestJSON-1274362498-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.070404 Oct 08 20:52:38.243569 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 191/362] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Oct 8 20:52:38 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:52:38.260078 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-794fbc26-e802-41c0-bac9-52974e69dc43 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:38.261664 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-794fbc26-e802-41c0-bac9-52974e69dc43 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] [instance: 1af12bcb-5e2a-4c15-8673-fa41701cb4c7] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:52:38.299640 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-794fbc26-e802-41c0-bac9-52974e69dc43 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:38.300155 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-794fbc26-e802-41c0-bac9-52974e69dc43 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:38.303135 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-794fbc26-e802-41c0-bac9-52974e69dc43 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:38.305776 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-794fbc26-e802-41c0-bac9-52974e69dc43 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:38.305904 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-794fbc26-e802-41c0-bac9-52974e69dc43 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:38.309603 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-794fbc26-e802-41c0-bac9-52974e69dc43 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:38.742872 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-4e6701fd-1134-4eb9-90cb-8691bd066684 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '360660f7bb4746c8b1397f4857f423f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d702b3083bc4cf5ba6b6fc6f3c3147e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:38.764182 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-4e6701fd-1134-4eb9-90cb-8691bd066684 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] 10.222.0.26 "GET /compute/v2.1/servers/0b4b7773-b59d-4956-b7e5-267d54541db6" status: 200 len: 1320 microversion: 2.1 time: 1.428596 Oct 08 20:52:38.767962 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 172/363] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:52:37 2022] GET /compute/v2.1/servers/0b4b7773-b59d-4956-b7e5-267d54541db6 => generated 1320 bytes in 1438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:52:38.786667 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-4b309317-97d4-40de-bfb0-63ee08467b20 tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:38.787463 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-4b309317-97d4-40de-bfb0-63ee08467b20 tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] [instance: 88c3b2e3-7038-460b-9874-b120c573c2b7] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:52:38.796466 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:38.804818 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4b309317-97d4-40de-bfb0-63ee08467b20 tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:38.808221 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4b309317-97d4-40de-bfb0-63ee08467b20 tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:38.808221 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4b309317-97d4-40de-bfb0-63ee08467b20 tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:38.808221 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4b309317-97d4-40de-bfb0-63ee08467b20 tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:38.808645 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4b309317-97d4-40de-bfb0-63ee08467b20 tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:38.808978 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4b309317-97d4-40de-bfb0-63ee08467b20 tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:39.182998 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-794fbc26-e802-41c0-bac9-52974e69dc43 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb78cce5f7c4c348045745f40b13129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16530e0f2f0a4d23918261c9e21f9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:39.195733 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-794fbc26-e802-41c0-bac9-52974e69dc43 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cb78cce5f7c4c348045745f40b13129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16530e0f2f0a4d23918261c9e21f9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:39.197663 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-794fbc26-e802-41c0-bac9-52974e69dc43 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cb78cce5f7c4c348045745f40b13129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16530e0f2f0a4d23918261c9e21f9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:39.204978 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-794fbc26-e802-41c0-bac9-52974e69dc43 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] 10.222.0.26 "GET /compute/v2.1/servers/1af12bcb-5e2a-4c15-8673-fa41701cb4c7" status: 200 len: 1447 microversion: 2.75 time: 0.960240 Oct 08 20:52:39.206199 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 192/364] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:52:38 2022] GET /compute/v2.1/servers/1af12bcb-5e2a-4c15-8673-fa41701cb4c7 => generated 1447 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:52:39.265479 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=46 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:39.501047 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-4b309317-97d4-40de-bfb0-63ee08467b20 tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c74c1e22148c6ba7612cb03d8bd02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e5f13ede0474c1888ffb1f7168daf67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:39.520797 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-4b309317-97d4-40de-bfb0-63ee08467b20 tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] 10.222.0.26 "GET /compute/v2.1/servers/88c3b2e3-7038-460b-9874-b120c573c2b7" status: 200 len: 1472 microversion: 2.1 time: 0.744228 Oct 08 20:52:39.522353 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 173/365] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:52:38 2022] GET /compute/v2.1/servers/88c3b2e3-7038-460b-9874-b120c573c2b7 => generated 1472 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:52:39.547281 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-7676b628-53e6-489a-b987-645e8f55f7bd tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:39.548127 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-7676b628-53e6-489a-b987-645e8f55f7bd tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] [instance: 88c3b2e3-7038-460b-9874-b120c573c2b7] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:52:39.561942 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7676b628-53e6-489a-b987-645e8f55f7bd tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:39.562689 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7676b628-53e6-489a-b987-645e8f55f7bd tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:39.563306 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7676b628-53e6-489a-b987-645e8f55f7bd tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:39.564286 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7676b628-53e6-489a-b987-645e8f55f7bd tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:39.567917 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7676b628-53e6-489a-b987-645e8f55f7bd tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:39.568633 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7676b628-53e6-489a-b987-645e8f55f7bd tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:39.634696 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-7676b628-53e6-489a-b987-645e8f55f7bd tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': '037c74c1e22148c6ba7612cb03d8bd02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e5f13ede0474c1888ffb1f7168daf67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:39.646600 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-7676b628-53e6-489a-b987-645e8f55f7bd tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] Request method failure captured: Oct 08 20:52:39.646600 ncdv-master-1 devstack@n-api.service[140492]: request: GET /compute/v2.1/servers/88c3b2e3-7038-460b-9874-b120c573c2b7/diagnostics HTTP/1.1 Oct 08 20:52:39.646600 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 20:52:39.646600 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 20:52:39.646600 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 20:52:39.646600 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 20:52:39.646600 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 20:52:39.646600 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 20:52:39.646600 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 20:52:39.646600 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 20:52:39.646600 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeMCIn5k3LAFXuHByQ7uL8meS5OnRo2ZzD1oMZ6IiXFqKaFGd1eci8t-3xXZSxg69LoSjamGSpEfBhaeNAQi56pvT3VJSsSLNU6x2vKYZKAtZ1xneyWXg-gPxxuandDT03RQkHbkitXB7f0YOzwysK7lkHnde1_UyMe4h3rEI6Iluus Oct 08 20:52:39.646600 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 20:52:39.646600 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 20:52:39.646600 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 20:52:39.646600 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 20:52:39.646600 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 20:52:39.646600 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 20:52:39.646600 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 4e5f13ede0474c1888ffb1f7168daf67 Oct 08 20:52:39.646600 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-2069280375 Oct 08 20:52:39.646600 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 20:52:39.646600 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 20:52:39.647801 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/4e5f13ede0474c1888ffb1f7168daf67"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4e5f13ede0474c1888ffb1f7168daf67"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_4e5f13ede0474c1888ffb1f7168daf67"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4e5f13ede0474c1888ffb1f7168daf67"}]}] Oct 08 20:52:39.647801 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-2069280375 Oct 08 20:52:39.647801 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 4e5f13ede0474c1888ffb1f7168daf67 Oct 08 20:52:39.647801 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-2069280375 Oct 08 20:52:39.647801 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-ServerDiagnosticsNegativeTest-2069280375-project Oct 08 20:52:39.647801 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 20:52:39.647801 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 20:52:39.647801 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 037c74c1e22148c6ba7612cb03d8bd02 Oct 08 20:52:39.647801 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-2069280375-project Oct 08 20:52:39.647801 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 20:52:39.647801 ncdv-master-1 devstack@n-api.service[140492]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 08 20:52:39.648419 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'server_id': '88c3b2e3-7038-460b-9874-b120c573c2b7'} Oct 08 20:52:39.648419 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:52:39.648419 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:52:39.648419 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:52:39.648419 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:52:39.648419 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:52:39.648419 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:52:39.648419 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:52:39.648419 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:52:39.648419 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Oct 08 20:52:39.648419 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Oct 08 20:52:39.648419 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 08 20:52:39.648419 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 08 20:52:39.648419 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 08 20:52:39.648419 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 08 20:52:39.648419 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 08 20:52:39.648419 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 08 20:52:39.648419 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 08 20:52:39.648419 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise self.value Oct 08 20:52:39.648419 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 08 20:52:39.649545 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 08 20:52:39.649545 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 08 20:52:39.649545 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 08 20:52:39.649545 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 08 20:52:39.649545 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 08 20:52:39.649545 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 08 20:52:39.649545 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:52:39.649545 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:52:39.649545 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:52:39.649545 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:52:39.649545 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:52:39.649545 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:52:39.649545 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 08 20:52:39.649545 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 08 20:52:39.649545 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 08 20:52:39.649545 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:52:39.654027 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-7676b628-53e6-489a-b987-645e8f55f7bd tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:52:39.655177 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-7676b628-53e6-489a-b987-645e8f55f7bd tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] 10.222.0.26 "GET /compute/v2.1/servers/88c3b2e3-7038-460b-9874-b120c573c2b7/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.112762 Oct 08 20:52:39.659018 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 193/366] 10.222.0.26 () {58 vars in 1272 bytes} [Sat Oct 8 20:52:39 2022] GET /compute/v2.1/servers/88c3b2e3-7038-460b-9874-b120c573c2b7/diagnostics => generated 117 bytes in 118 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 08 20:52:39.668198 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-b7a34cd8-68fa-4d5f-b69d-87f283310bc1 tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:39.668963 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-b7a34cd8-68fa-4d5f-b69d-87f283310bc1 tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] [instance: 88c3b2e3-7038-460b-9874-b120c573c2b7] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:52:39.676695 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b7a34cd8-68fa-4d5f-b69d-87f283310bc1 tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:39.677479 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b7a34cd8-68fa-4d5f-b69d-87f283310bc1 tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:39.678170 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b7a34cd8-68fa-4d5f-b69d-87f283310bc1 tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:39.679115 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b7a34cd8-68fa-4d5f-b69d-87f283310bc1 tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:39.679814 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b7a34cd8-68fa-4d5f-b69d-87f283310bc1 tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:39.680515 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b7a34cd8-68fa-4d5f-b69d-87f283310bc1 tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:39.712612 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-b7a34cd8-68fa-4d5f-b69d-87f283310bc1 tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] [instance: 88c3b2e3-7038-460b-9874-b120c573c2b7] Going to try to terminate instance {{(pid=140491) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 20:52:39.791881 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-f2de7a42-d929-4667-a5de-6326022db40d tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:39.792922 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-f2de7a42-d929-4667-a5de-6326022db40d tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] [instance: 0b4b7773-b59d-4956-b7e5-267d54541db6] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:52:39.810305 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f2de7a42-d929-4667-a5de-6326022db40d tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:39.813118 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f2de7a42-d929-4667-a5de-6326022db40d tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:39.813876 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f2de7a42-d929-4667-a5de-6326022db40d tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:39.816951 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f2de7a42-d929-4667-a5de-6326022db40d tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:39.818475 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f2de7a42-d929-4667-a5de-6326022db40d tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:39.819003 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f2de7a42-d929-4667-a5de-6326022db40d tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:39.915082 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-b7a34cd8-68fa-4d5f-b69d-87f283310bc1 tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] 10.222.0.26 "DELETE /compute/v2.1/servers/88c3b2e3-7038-460b-9874-b120c573c2b7" status: 204 len: 0 microversion: 2.1 time: 0.252206 Oct 08 20:52:39.917798 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 174/367] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 20:52:39 2022] DELETE /compute/v2.1/servers/88c3b2e3-7038-460b-9874-b120c573c2b7 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 20:52:39.942069 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-04a0b16f-9fcb-4c25-bc64-234fab10ed78 tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:39.944036 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-04a0b16f-9fcb-4c25-bc64-234fab10ed78 tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] [instance: 88c3b2e3-7038-460b-9874-b120c573c2b7] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:52:39.962956 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-04a0b16f-9fcb-4c25-bc64-234fab10ed78 tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:39.963730 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-04a0b16f-9fcb-4c25-bc64-234fab10ed78 tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:39.964316 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-04a0b16f-9fcb-4c25-bc64-234fab10ed78 tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:39.965226 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-04a0b16f-9fcb-4c25-bc64-234fab10ed78 tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:39.965827 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-04a0b16f-9fcb-4c25-bc64-234fab10ed78 tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:39.966407 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-04a0b16f-9fcb-4c25-bc64-234fab10ed78 tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:40.270068 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-f2de7a42-d929-4667-a5de-6326022db40d tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '360660f7bb4746c8b1397f4857f423f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d702b3083bc4cf5ba6b6fc6f3c3147e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:40.274182 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:40.291643 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=30 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:40.299343 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-f2de7a42-d929-4667-a5de-6326022db40d tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] 10.222.0.26 "GET /compute/v2.1/servers/0b4b7773-b59d-4956-b7e5-267d54541db6" status: 200 len: 1320 microversion: 2.1 time: 0.512587 Oct 08 20:52:40.301330 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 194/368] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:52:39 2022] GET /compute/v2.1/servers/0b4b7773-b59d-4956-b7e5-267d54541db6 => generated 1320 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:52:40.308457 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-020eceef-ce15-4715-9f7a-c9dc00e9e6dd req-98c99d7e-05c8-4a0f-ad0a-34a0c3810bed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b4b7773-b59d-4956-b7e5-267d54541db6", "tag": "38d934fc-c54f-41b1-a9d1-b8c83e8395a1"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:52:40.321747 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-020eceef-ce15-4715-9f7a-c9dc00e9e6dd req-98c99d7e-05c8-4a0f-ad0a-34a0c3810bed service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:40.322762 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-020eceef-ce15-4715-9f7a-c9dc00e9e6dd req-98c99d7e-05c8-4a0f-ad0a-34a0c3810bed service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:40.323513 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-020eceef-ce15-4715-9f7a-c9dc00e9e6dd req-98c99d7e-05c8-4a0f-ad0a-34a0c3810bed service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:40.351564 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-020eceef-ce15-4715-9f7a-c9dc00e9e6dd req-98c99d7e-05c8-4a0f-ad0a-34a0c3810bed service nova] Creating event network-changed:38d934fc-c54f-41b1-a9d1-b8c83e8395a1 for instance 0b4b7773-b59d-4956-b7e5-267d54541db6 on nch1-master-1 Oct 08 20:52:40.357488 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-020eceef-ce15-4715-9f7a-c9dc00e9e6dd req-98c99d7e-05c8-4a0f-ad0a-34a0c3810bed service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053423 Oct 08 20:52:40.358307 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 195/369] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:52:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:52:40.378754 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-90ee8268-a3f3-487c-bf23-a5c37a1c1522 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:40.379796 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-90ee8268-a3f3-487c-bf23-a5c37a1c1522 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] [instance: 1af12bcb-5e2a-4c15-8673-fa41701cb4c7] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:52:40.384948 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-04a0b16f-9fcb-4c25-bc64-234fab10ed78 tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c74c1e22148c6ba7612cb03d8bd02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e5f13ede0474c1888ffb1f7168daf67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:40.395645 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-90ee8268-a3f3-487c-bf23-a5c37a1c1522 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:40.396158 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-90ee8268-a3f3-487c-bf23-a5c37a1c1522 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:40.396607 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-90ee8268-a3f3-487c-bf23-a5c37a1c1522 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:40.397631 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-90ee8268-a3f3-487c-bf23-a5c37a1c1522 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:40.398110 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-90ee8268-a3f3-487c-bf23-a5c37a1c1522 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:40.398554 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-90ee8268-a3f3-487c-bf23-a5c37a1c1522 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:40.399230 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-04a0b16f-9fcb-4c25-bc64-234fab10ed78 tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] 10.222.0.26 "GET /compute/v2.1/servers/88c3b2e3-7038-460b-9874-b120c573c2b7" status: 200 len: 1478 microversion: 2.1 time: 0.472078 Oct 08 20:52:40.422508 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 175/370] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:52:39 2022] GET /compute/v2.1/servers/88c3b2e3-7038-460b-9874-b120c573c2b7 => generated 1478 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:52:40.567904 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-90ee8268-a3f3-487c-bf23-a5c37a1c1522 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb78cce5f7c4c348045745f40b13129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16530e0f2f0a4d23918261c9e21f9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:40.584023 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-90ee8268-a3f3-487c-bf23-a5c37a1c1522 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cb78cce5f7c4c348045745f40b13129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16530e0f2f0a4d23918261c9e21f9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:40.587381 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-90ee8268-a3f3-487c-bf23-a5c37a1c1522 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cb78cce5f7c4c348045745f40b13129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16530e0f2f0a4d23918261c9e21f9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:40.596382 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-90ee8268-a3f3-487c-bf23-a5c37a1c1522 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] 10.222.0.26 "GET /compute/v2.1/servers/1af12bcb-5e2a-4c15-8673-fa41701cb4c7" status: 200 len: 1447 microversion: 2.75 time: 0.231907 Oct 08 20:52:40.597591 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 196/371] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:52:40 2022] GET /compute/v2.1/servers/1af12bcb-5e2a-4c15-8673-fa41701cb4c7 => generated 1447 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:52:41.325330 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-96cdd18f-c5a3-49b0-8344-973f818e87fd tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:41.327045 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-96cdd18f-c5a3-49b0-8344-973f818e87fd tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] [instance: 0b4b7773-b59d-4956-b7e5-267d54541db6] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:52:41.339803 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-96cdd18f-c5a3-49b0-8344-973f818e87fd tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:41.340639 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-96cdd18f-c5a3-49b0-8344-973f818e87fd tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:41.341376 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-96cdd18f-c5a3-49b0-8344-973f818e87fd tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:41.344680 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-96cdd18f-c5a3-49b0-8344-973f818e87fd tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:41.345620 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-96cdd18f-c5a3-49b0-8344-973f818e87fd tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:41.346432 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-96cdd18f-c5a3-49b0-8344-973f818e87fd tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:41.429910 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-96043754-0c32-4af7-a8be-22b10cc35e32 tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:41.434225 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-96043754-0c32-4af7-a8be-22b10cc35e32 tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] [instance: 88c3b2e3-7038-460b-9874-b120c573c2b7] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:52:41.443560 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-96043754-0c32-4af7-a8be-22b10cc35e32 tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:41.444387 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-96043754-0c32-4af7-a8be-22b10cc35e32 tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:41.445013 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-96043754-0c32-4af7-a8be-22b10cc35e32 tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:41.445970 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-96043754-0c32-4af7-a8be-22b10cc35e32 tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:41.446572 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-96043754-0c32-4af7-a8be-22b10cc35e32 tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:41.447663 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-96043754-0c32-4af7-a8be-22b10cc35e32 tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:41.737042 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-96cdd18f-c5a3-49b0-8344-973f818e87fd tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '360660f7bb4746c8b1397f4857f423f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d702b3083bc4cf5ba6b6fc6f3c3147e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:41.752639 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-96cdd18f-c5a3-49b0-8344-973f818e87fd tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] 10.222.0.26 "GET /compute/v2.1/servers/0b4b7773-b59d-4956-b7e5-267d54541db6" status: 200 len: 1320 microversion: 2.1 time: 0.432394 Oct 08 20:52:41.754208 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 176/372] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:52:41 2022] GET /compute/v2.1/servers/0b4b7773-b59d-4956-b7e5-267d54541db6 => generated 1320 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:52:41.762250 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-8d51dcfd-4692-4471-afc3-f7e9f57eb423 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:41.765446 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-8d51dcfd-4692-4471-afc3-f7e9f57eb423 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] [instance: 1af12bcb-5e2a-4c15-8673-fa41701cb4c7] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:52:41.774678 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8d51dcfd-4692-4471-afc3-f7e9f57eb423 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:41.775526 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8d51dcfd-4692-4471-afc3-f7e9f57eb423 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:41.776276 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8d51dcfd-4692-4471-afc3-f7e9f57eb423 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:41.778354 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8d51dcfd-4692-4471-afc3-f7e9f57eb423 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:41.779137 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8d51dcfd-4692-4471-afc3-f7e9f57eb423 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:41.780047 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8d51dcfd-4692-4471-afc3-f7e9f57eb423 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:41.987980 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-8d51dcfd-4692-4471-afc3-f7e9f57eb423 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb78cce5f7c4c348045745f40b13129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16530e0f2f0a4d23918261c9e21f9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:42.007939 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-8d51dcfd-4692-4471-afc3-f7e9f57eb423 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cb78cce5f7c4c348045745f40b13129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16530e0f2f0a4d23918261c9e21f9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:42.013620 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-8d51dcfd-4692-4471-afc3-f7e9f57eb423 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cb78cce5f7c4c348045745f40b13129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16530e0f2f0a4d23918261c9e21f9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:42.027569 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-96043754-0c32-4af7-a8be-22b10cc35e32 tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c74c1e22148c6ba7612cb03d8bd02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e5f13ede0474c1888ffb1f7168daf67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:42.040696 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-96043754-0c32-4af7-a8be-22b10cc35e32 tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] 10.222.0.26 "GET /compute/v2.1/servers/88c3b2e3-7038-460b-9874-b120c573c2b7" status: 200 len: 1478 microversion: 2.1 time: 0.617455 Oct 08 20:52:42.043180 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-8d51dcfd-4692-4471-afc3-f7e9f57eb423 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] 10.222.0.26 "GET /compute/v2.1/servers/1af12bcb-5e2a-4c15-8673-fa41701cb4c7" status: 200 len: 1447 microversion: 2.75 time: 0.287289 Oct 08 20:52:42.044577 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 177/373] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:52:41 2022] GET /compute/v2.1/servers/1af12bcb-5e2a-4c15-8673-fa41701cb4c7 => generated 1447 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:52:42.045342 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 197/374] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:52:41 2022] GET /compute/v2.1/servers/88c3b2e3-7038-460b-9874-b120c573c2b7 => generated 1478 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 20:52:42.787699 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-34c7ca1d-69f3-4bf4-bdd5-5cb162566750 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:42.792369 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-34c7ca1d-69f3-4bf4-bdd5-5cb162566750 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] [instance: 0b4b7773-b59d-4956-b7e5-267d54541db6] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:52:42.831133 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-34c7ca1d-69f3-4bf4-bdd5-5cb162566750 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:42.833027 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-34c7ca1d-69f3-4bf4-bdd5-5cb162566750 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:42.835336 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-34c7ca1d-69f3-4bf4-bdd5-5cb162566750 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:42.837715 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-34c7ca1d-69f3-4bf4-bdd5-5cb162566750 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:42.838923 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-34c7ca1d-69f3-4bf4-bdd5-5cb162566750 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:42.844990 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-34c7ca1d-69f3-4bf4-bdd5-5cb162566750 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:42.909059 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-8a65cf71-7819-408f-a97c-eb20bd68f509 req-b38b55a9-e11a-45e8-b047-06d8070d1940 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88c3b2e3-7038-460b-9874-b120c573c2b7", "name": "network-vif-deleted", "tag": "4060d040-c7f9-46d0-918f-a58cdd6bebf1"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:52:42.967655 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-8a65cf71-7819-408f-a97c-eb20bd68f509 req-b38b55a9-e11a-45e8-b047-06d8070d1940 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:42.969750 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-8a65cf71-7819-408f-a97c-eb20bd68f509 req-b38b55a9-e11a-45e8-b047-06d8070d1940 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:42.983519 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-8a65cf71-7819-408f-a97c-eb20bd68f509 req-b38b55a9-e11a-45e8-b047-06d8070d1940 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:43.058425 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-8a65cf71-7819-408f-a97c-eb20bd68f509 req-b38b55a9-e11a-45e8-b047-06d8070d1940 service nova] Creating event network-vif-deleted:4060d040-c7f9-46d0-918f-a58cdd6bebf1 for instance 88c3b2e3-7038-460b-9874-b120c573c2b7 on nch2-master-1 Oct 08 20:52:43.081278 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-8a65cf71-7819-408f-a97c-eb20bd68f509 req-b38b55a9-e11a-45e8-b047-06d8070d1940 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.180229 Oct 08 20:52:43.083615 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 178/375] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:52:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:52:43.100082 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-f798d2ac-7917-4af2-ac8c-ebb01d027e3d tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:43.102946 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-f798d2ac-7917-4af2-ac8c-ebb01d027e3d tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] [instance: 88c3b2e3-7038-460b-9874-b120c573c2b7] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:52:43.119919 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f798d2ac-7917-4af2-ac8c-ebb01d027e3d tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:43.121917 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f798d2ac-7917-4af2-ac8c-ebb01d027e3d tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:43.123703 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f798d2ac-7917-4af2-ac8c-ebb01d027e3d tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:43.126880 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f798d2ac-7917-4af2-ac8c-ebb01d027e3d tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:43.129339 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f798d2ac-7917-4af2-ac8c-ebb01d027e3d tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:43.130538 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f798d2ac-7917-4af2-ac8c-ebb01d027e3d tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:43.250186 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f798d2ac-7917-4af2-ac8c-ebb01d027e3d tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:43.251475 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f798d2ac-7917-4af2-ac8c-ebb01d027e3d tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:43.252076 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f798d2ac-7917-4af2-ac8c-ebb01d027e3d tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:43.252686 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.objects.instance [None req-f798d2ac-7917-4af2-ac8c-ebb01d027e3d tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] Lazy-loading 'fault' on Instance uuid 88c3b2e3-7038-460b-9874-b120c573c2b7 {{(pid=140491) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 20:52:43.458257 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-f798d2ac-7917-4af2-ac8c-ebb01d027e3d tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c74c1e22148c6ba7612cb03d8bd02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e5f13ede0474c1888ffb1f7168daf67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:43.475039 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-f798d2ac-7917-4af2-ac8c-ebb01d027e3d tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] 10.222.0.26 "GET /compute/v2.1/servers/88c3b2e3-7038-460b-9874-b120c573c2b7" status: 200 len: 1313 microversion: 2.1 time: 0.383352 Oct 08 20:52:43.477416 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 179/376] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:52:43 2022] GET /compute/v2.1/servers/88c3b2e3-7038-460b-9874-b120c573c2b7 => generated 1313 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:52:43.489021 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-a13615ca-6388-4b18-8da1-43dda625a669 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:43.490410 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-a13615ca-6388-4b18-8da1-43dda625a669 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] [instance: 1af12bcb-5e2a-4c15-8673-fa41701cb4c7] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:52:43.529708 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a13615ca-6388-4b18-8da1-43dda625a669 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:43.533654 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a13615ca-6388-4b18-8da1-43dda625a669 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:43.535368 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a13615ca-6388-4b18-8da1-43dda625a669 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:43.540551 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a13615ca-6388-4b18-8da1-43dda625a669 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:43.541091 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a13615ca-6388-4b18-8da1-43dda625a669 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:43.541720 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a13615ca-6388-4b18-8da1-43dda625a669 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:43.587752 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-34c7ca1d-69f3-4bf4-bdd5-5cb162566750 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '360660f7bb4746c8b1397f4857f423f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d702b3083bc4cf5ba6b6fc6f3c3147e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:43.612357 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-34c7ca1d-69f3-4bf4-bdd5-5cb162566750 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] 10.222.0.26 "GET /compute/v2.1/servers/0b4b7773-b59d-4956-b7e5-267d54541db6" status: 200 len: 1320 microversion: 2.1 time: 0.833434 Oct 08 20:52:43.631764 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 198/377] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:52:42 2022] GET /compute/v2.1/servers/0b4b7773-b59d-4956-b7e5-267d54541db6 => generated 1320 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:52:43.834149 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-a13615ca-6388-4b18-8da1-43dda625a669 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb78cce5f7c4c348045745f40b13129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16530e0f2f0a4d23918261c9e21f9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:43.852055 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-a13615ca-6388-4b18-8da1-43dda625a669 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cb78cce5f7c4c348045745f40b13129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16530e0f2f0a4d23918261c9e21f9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:43.854038 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-a13615ca-6388-4b18-8da1-43dda625a669 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cb78cce5f7c4c348045745f40b13129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16530e0f2f0a4d23918261c9e21f9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:43.869216 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-a13615ca-6388-4b18-8da1-43dda625a669 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] 10.222.0.26 "GET /compute/v2.1/servers/1af12bcb-5e2a-4c15-8673-fa41701cb4c7" status: 200 len: 1447 microversion: 2.75 time: 0.386602 Oct 08 20:52:43.871920 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 180/378] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:52:43 2022] GET /compute/v2.1/servers/1af12bcb-5e2a-4c15-8673-fa41701cb4c7 => generated 1447 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:52:44.501109 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-2e6895b5-dada-4f61-8ea9-f081bd4cd047 tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:44.502737 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-2e6895b5-dada-4f61-8ea9-f081bd4cd047 tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] [instance: 88c3b2e3-7038-460b-9874-b120c573c2b7] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:52:44.520732 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=11 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:44.526839 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2e6895b5-dada-4f61-8ea9-f081bd4cd047 tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:44.528246 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2e6895b5-dada-4f61-8ea9-f081bd4cd047 tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:44.531262 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2e6895b5-dada-4f61-8ea9-f081bd4cd047 tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:44.532869 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2e6895b5-dada-4f61-8ea9-f081bd4cd047 tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:44.535263 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2e6895b5-dada-4f61-8ea9-f081bd4cd047 tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:44.535712 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2e6895b5-dada-4f61-8ea9-f081bd4cd047 tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:44.582826 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-2e6895b5-dada-4f61-8ea9-f081bd4cd047 tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] HTTP exception thrown: Instance 88c3b2e3-7038-460b-9874-b120c573c2b7 could not be found. Oct 08 20:52:44.584107 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-2e6895b5-dada-4f61-8ea9-f081bd4cd047 tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] Request method failure captured: Oct 08 20:52:44.584107 ncdv-master-1 devstack@n-api.service[140491]: request: GET /compute/v2.1/servers/88c3b2e3-7038-460b-9874-b120c573c2b7 HTTP/1.1 Oct 08 20:52:44.584107 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 20:52:44.584107 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 20:52:44.584107 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 20:52:44.584107 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 20:52:44.584107 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 20:52:44.584107 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 20:52:44.584107 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 20:52:44.584107 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 20:52:44.584107 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeMCIn5k3LAFXuHByQ7uL8meS5OnRo2ZzD1oMZ6IiXFqKaFGd1eci8t-3xXZSxg69LoSjamGSpEfBhaeNAQi56pvT3VJSsSLNU6x2vKYZKAtZ1xneyWXg-gPxxuandDT03RQkHbkitXB7f0YOzwysK7lkHnde1_UyMe4h3rEI6Iluus Oct 08 20:52:44.584107 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 20:52:44.584107 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 20:52:44.584107 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 20:52:44.584107 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 20:52:44.584107 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 20:52:44.584107 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 20:52:44.584107 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 4e5f13ede0474c1888ffb1f7168daf67 Oct 08 20:52:44.584107 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-2069280375 Oct 08 20:52:44.584107 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 20:52:44.584107 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 20:52:44.585603 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/4e5f13ede0474c1888ffb1f7168daf67"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4e5f13ede0474c1888ffb1f7168daf67"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_4e5f13ede0474c1888ffb1f7168daf67"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4e5f13ede0474c1888ffb1f7168daf67"}]}] Oct 08 20:52:44.585603 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-2069280375 Oct 08 20:52:44.585603 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 4e5f13ede0474c1888ffb1f7168daf67 Oct 08 20:52:44.585603 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-2069280375 Oct 08 20:52:44.585603 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-ServerDiagnosticsNegativeTest-2069280375-project Oct 08 20:52:44.585603 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 20:52:44.585603 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 20:52:44.585603 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 037c74c1e22148c6ba7612cb03d8bd02 Oct 08 20:52:44.585603 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-2069280375-project Oct 08 20:52:44.585603 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 20:52:44.585603 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance 88c3b2e3-7038-460b-9874-b120c573c2b7 could not be found. Oct 08 20:52:44.585603 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': '88c3b2e3-7038-460b-9874-b120c573c2b7'} Oct 08 20:52:44.586417 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:52:44.586417 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:52:44.586417 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 20:52:44.586417 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 20:52:44.586417 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 20:52:44.586417 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 20:52:44.586417 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 20:52:44.586417 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 20:52:44.586417 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 20:52:44.586417 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 20:52:44.586417 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88c3b2e3-7038-460b-9874-b120c573c2b7 could not be found. Oct 08 20:52:44.586417 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:52:44.586417 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:52:44.586417 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:52:44.586417 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:52:44.586417 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:52:44.586417 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:52:44.586417 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:52:44.586417 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:52:44.586417 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:52:44.587690 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:52:44.587690 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 20:52:44.587690 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 20:52:44.587690 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 20:52:44.587690 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 20:52:44.587690 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 20:52:44.587690 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 20:52:44.587690 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88c3b2e3-7038-460b-9874-b120c573c2b7 could not be found. Oct 08 20:52:44.587690 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:52:44.587690 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:52:44.587690 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:52:44.587690 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:52:44.587690 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:52:44.587690 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:52:44.587690 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 20:52:44.587690 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 20:52:44.587690 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88c3b2e3-7038-460b-9874-b120c573c2b7 could not be found. Oct 08 20:52:44.587690 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:52:44.590589 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-2e6895b5-dada-4f61-8ea9-f081bd4cd047 tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] Returning 404 to user: Instance 88c3b2e3-7038-460b-9874-b120c573c2b7 could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:52:44.594654 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-2e6895b5-dada-4f61-8ea9-f081bd4cd047 tempest-ServerDiagnosticsNegativeTest-2069280375 tempest-ServerDiagnosticsNegativeTest-2069280375-project] 10.222.0.26 "GET /compute/v2.1/servers/88c3b2e3-7038-460b-9874-b120c573c2b7" status: 404 len: 111 microversion: 2.1 time: 0.096839 Oct 08 20:52:44.595431 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 181/379] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:52:44 2022] GET /compute/v2.1/servers/88c3b2e3-7038-460b-9874-b120c573c2b7 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 20:52:44.650759 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-e100ec05-3fec-4b41-bfe4-5cc047905718 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:44.651665 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-e100ec05-3fec-4b41-bfe4-5cc047905718 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] [instance: 0b4b7773-b59d-4956-b7e5-267d54541db6] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:52:44.665884 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e100ec05-3fec-4b41-bfe4-5cc047905718 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:44.666588 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e100ec05-3fec-4b41-bfe4-5cc047905718 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:44.667236 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e100ec05-3fec-4b41-bfe4-5cc047905718 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:44.668760 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e100ec05-3fec-4b41-bfe4-5cc047905718 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:44.669419 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e100ec05-3fec-4b41-bfe4-5cc047905718 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:44.670009 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e100ec05-3fec-4b41-bfe4-5cc047905718 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:44.727070 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=21 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:44.984016 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-e100ec05-3fec-4b41-bfe4-5cc047905718 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '360660f7bb4746c8b1397f4857f423f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d702b3083bc4cf5ba6b6fc6f3c3147e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:45.000137 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-e100ec05-3fec-4b41-bfe4-5cc047905718 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] 10.222.0.26 "GET /compute/v2.1/servers/0b4b7773-b59d-4956-b7e5-267d54541db6" status: 200 len: 1320 microversion: 2.1 time: 0.346376 Oct 08 20:52:45.004224 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 182/380] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:52:44 2022] GET /compute/v2.1/servers/0b4b7773-b59d-4956-b7e5-267d54541db6 => generated 1320 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 20:52:45.020014 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-f5061105-03e0-4364-8244-ed851ec2309b tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:45.021083 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-f5061105-03e0-4364-8244-ed851ec2309b tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] [instance: 1af12bcb-5e2a-4c15-8673-fa41701cb4c7] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:52:45.034386 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-1c912cb5-ff2c-4a83-b082-60c58d2db3ff tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-1480188303", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:52:45.055968 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f5061105-03e0-4364-8244-ed851ec2309b tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:45.056904 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f5061105-03e0-4364-8244-ed851ec2309b tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:45.057623 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f5061105-03e0-4364-8244-ed851ec2309b tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:45.058596 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f5061105-03e0-4364-8244-ed851ec2309b tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:45.065540 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f5061105-03e0-4364-8244-ed851ec2309b tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:45.066320 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f5061105-03e0-4364-8244-ed851ec2309b tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:45.132119 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.network.neutron [None req-1c912cb5-ff2c-4a83-b082-60c58d2db3ff tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] validate_networks() for None {{(pid=140492) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 20:52:45.144003 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:45.260707 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-f5061105-03e0-4364-8244-ed851ec2309b tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb78cce5f7c4c348045745f40b13129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16530e0f2f0a4d23918261c9e21f9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:45.276770 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-f5061105-03e0-4364-8244-ed851ec2309b tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cb78cce5f7c4c348045745f40b13129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16530e0f2f0a4d23918261c9e21f9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:45.279323 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-f5061105-03e0-4364-8244-ed851ec2309b tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cb78cce5f7c4c348045745f40b13129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16530e0f2f0a4d23918261c9e21f9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:45.296492 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-f5061105-03e0-4364-8244-ed851ec2309b tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] 10.222.0.26 "GET /compute/v2.1/servers/1af12bcb-5e2a-4c15-8673-fa41701cb4c7" status: 200 len: 1447 microversion: 2.75 time: 0.290920 Oct 08 20:52:45.297356 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 183/381] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:52:45 2022] GET /compute/v2.1/servers/1af12bcb-5e2a-4c15-8673-fa41701cb4c7 => generated 1447 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:52:46.027374 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c5473138-8ff6-4075-9a6a-6b5dce510fc1 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:46.028350 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-c5473138-8ff6-4075-9a6a-6b5dce510fc1 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] [instance: 0b4b7773-b59d-4956-b7e5-267d54541db6] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:52:46.045945 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c5473138-8ff6-4075-9a6a-6b5dce510fc1 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:46.047079 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c5473138-8ff6-4075-9a6a-6b5dce510fc1 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:46.047535 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c5473138-8ff6-4075-9a6a-6b5dce510fc1 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:46.048277 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c5473138-8ff6-4075-9a6a-6b5dce510fc1 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:46.048745 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c5473138-8ff6-4075-9a6a-6b5dce510fc1 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:46.049181 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c5473138-8ff6-4075-9a6a-6b5dce510fc1 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:46.363067 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-c5473138-8ff6-4075-9a6a-6b5dce510fc1 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '360660f7bb4746c8b1397f4857f423f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d702b3083bc4cf5ba6b6fc6f3c3147e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:46.377147 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-c5473138-8ff6-4075-9a6a-6b5dce510fc1 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] 10.222.0.26 "GET /compute/v2.1/servers/0b4b7773-b59d-4956-b7e5-267d54541db6" status: 200 len: 1320 microversion: 2.1 time: 0.356750 Oct 08 20:52:46.390956 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 184/382] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:52:46 2022] GET /compute/v2.1/servers/0b4b7773-b59d-4956-b7e5-267d54541db6 => generated 1320 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 20:52:46.403442 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-6f685dae-e179-4914-815a-c2775510fcce tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:46.404257 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-6f685dae-e179-4914-815a-c2775510fcce tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] [instance: 1af12bcb-5e2a-4c15-8673-fa41701cb4c7] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:52:46.415954 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6f685dae-e179-4914-815a-c2775510fcce tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:46.416448 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6f685dae-e179-4914-815a-c2775510fcce tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:46.416870 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6f685dae-e179-4914-815a-c2775510fcce tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:46.417659 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6f685dae-e179-4914-815a-c2775510fcce tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:46.422861 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6f685dae-e179-4914-815a-c2775510fcce tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:46.424121 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6f685dae-e179-4914-815a-c2775510fcce tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:46.682275 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-6f685dae-e179-4914-815a-c2775510fcce tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb78cce5f7c4c348045745f40b13129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16530e0f2f0a4d23918261c9e21f9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:46.699630 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-6f685dae-e179-4914-815a-c2775510fcce tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cb78cce5f7c4c348045745f40b13129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16530e0f2f0a4d23918261c9e21f9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:46.702636 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-6f685dae-e179-4914-815a-c2775510fcce tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cb78cce5f7c4c348045745f40b13129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16530e0f2f0a4d23918261c9e21f9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:46.728729 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-6f685dae-e179-4914-815a-c2775510fcce tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] 10.222.0.26 "GET /compute/v2.1/servers/1af12bcb-5e2a-4c15-8673-fa41701cb4c7" status: 200 len: 1447 microversion: 2.75 time: 0.336531 Oct 08 20:52:46.729363 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 185/383] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:52:46 2022] GET /compute/v2.1/servers/1af12bcb-5e2a-4c15-8673-fa41701cb4c7 => generated 1447 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:52:46.751871 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-1c912cb5-ff2c-4a83-b082-60c58d2db3ff tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Flavor limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 20:52:46.753125 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-1c912cb5-ff2c-4a83-b082-60c58d2db3ff tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Image limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 20:52:46.753777 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-1c912cb5-ff2c-4a83-b082-60c58d2db3ff tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Flavor pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 20:52:46.754305 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-1c912cb5-ff2c-4a83-b082-60c58d2db3ff tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Image pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 20:52:46.756361 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-1c912cb5-ff2c-4a83-b082-60c58d2db3ff tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 20:52:46.793334 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1c912cb5-ff2c-4a83-b082-60c58d2db3ff tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:46.795762 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1c912cb5-ff2c-4a83-b082-60c58d2db3ff tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:46.799971 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1c912cb5-ff2c-4a83-b082-60c58d2db3ff tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:46.802307 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1c912cb5-ff2c-4a83-b082-60c58d2db3ff tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:46.804464 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1c912cb5-ff2c-4a83-b082-60c58d2db3ff tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:46.805544 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1c912cb5-ff2c-4a83-b082-60c58d2db3ff tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:46.865865 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-1c912cb5-ff2c-4a83-b082-60c58d2db3ff tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Getting quotas for project 1d547f95cc6043b0bb9b6a94b2e354a5. Resources: {'cores', 'instances', 'ram'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 20:52:46.881098 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-1c912cb5-ff2c-4a83-b082-60c58d2db3ff tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Getting quotas for user bd637d2fa21649a1b00f27e7d86f3003 and project 1d547f95cc6043b0bb9b6a94b2e354a5. Resources: {'cores', 'instances', 'ram'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 20:52:46.928750 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-1c912cb5-ff2c-4a83-b082-60c58d2db3ff tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Going to run 1 instances... {{(pid=140492) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 20:52:46.931329 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-1c912cb5-ff2c-4a83-b082-60c58d2db3ff tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] [instance: 8216e713-dfa1-4625-b8ea-5869cf617f4f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c508bd7f-7db9-4b2c-af7c-be54a855c355',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140492) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 20:52:47.035538 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-534b75ec-ee33-478f-a670-36d8a7a56a87 tempest-FlavorsAdminTestJSON-546925656 tempest-FlavorsAdminTestJSON-546925656-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-689274210", "id": 393966733, "os-flavor-access:is_public": "True"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:52:47.058757 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-1c912cb5-ff2c-4a83-b082-60c58d2db3ff tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.646947 Oct 08 20:52:47.060164 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 199/384] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 20:52:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 2649 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 08 20:52:47.072054 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-0b60d154-0601-48fb-be6c-bb8eec593182 tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:47.072969 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-0b60d154-0601-48fb-be6c-bb8eec593182 tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] [instance: 8216e713-dfa1-4625-b8ea-5869cf617f4f] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:52:47.089513 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-534b75ec-ee33-478f-a670-36d8a7a56a87 tempest-FlavorsAdminTestJSON-546925656 tempest-FlavorsAdminTestJSON-546925656-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 426 microversion: 2.1 time: 0.352143 Oct 08 20:52:47.090121 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 186/385] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 20:52:46 2022] POST /compute/v2.1/flavors => generated 426 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:52:47.102859 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-b2fbec09-f738-4beb-b210-2a27cc507947 tempest-FlavorsAdminTestJSON-546925656 tempest-FlavorsAdminTestJSON-546925656-project-admin] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:47.157542 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-b2fbec09-f738-4beb-b210-2a27cc507947 tempest-FlavorsAdminTestJSON-546925656 tempest-FlavorsAdminTestJSON-546925656-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/393966733" status: 202 len: 0 microversion: 2.1 time: 0.058210 Oct 08 20:52:47.158142 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 187/386] 10.222.0.26 () {58 vars in 1158 bytes} [Sat Oct 8 20:52:47 2022] DELETE /compute/v2.1/flavors/393966733 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 08 20:52:47.166852 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-47b2126c-94cf-4563-b8b9-a55199d25ee7 tempest-FlavorsAdminTestJSON-546925656 tempest-FlavorsAdminTestJSON-546925656-project-admin] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:47.210150 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-47b2126c-94cf-4563-b8b9-a55199d25ee7 tempest-FlavorsAdminTestJSON-546925656 tempest-FlavorsAdminTestJSON-546925656-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.046767 Oct 08 20:52:47.210754 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 188/387] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Oct 8 20:52:47 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 20:52:47.227315 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-0b60d154-0601-48fb-be6c-bb8eec593182 tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd637d2fa21649a1b00f27e7d86f3003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d547f95cc6043b0bb9b6a94b2e354a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:47.232957 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-bb426113-5bf7-4385-a0e5-43a72eb98e65 tempest-FlavorsAdminTestJSON-546925656 tempest-FlavorsAdminTestJSON-546925656-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-427062734", "id": 1563047796, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:52:47.237595 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-0b60d154-0601-48fb-be6c-bb8eec593182 tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] 10.222.0.26 "GET /compute/v2.1/servers/8216e713-dfa1-4625-b8ea-5869cf617f4f" status: 200 len: 1214 microversion: 2.1 time: 0.169587 Oct 08 20:52:47.241157 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 200/388] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:52:47 2022] GET /compute/v2.1/servers/8216e713-dfa1-4625-b8ea-5869cf617f4f => generated 1214 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 20:52:47.297674 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-bb426113-5bf7-4385-a0e5-43a72eb98e65 tempest-FlavorsAdminTestJSON-546925656 tempest-FlavorsAdminTestJSON-546925656-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.069853 Oct 08 20:52:47.298280 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 189/389] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 20:52:47 2022] POST /compute/v2.1/flavors => generated 416 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 08 20:52:47.311825 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-ba49b294-c91e-4c3c-bdcc-1c7d469e6c90 tempest-FlavorsAdminTestJSON-546925656 tempest-FlavorsAdminTestJSON-546925656-project-admin] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:47.369417 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-ba49b294-c91e-4c3c-bdcc-1c7d469e6c90 tempest-FlavorsAdminTestJSON-546925656 tempest-FlavorsAdminTestJSON-546925656-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 5397 microversion: 2.1 time: 0.062112 Oct 08 20:52:47.370341 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 201/390] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Oct 8 20:52:47 2022] GET /compute/v2.1/flavors/detail => generated 5397 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:52:47.390365 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-8201aaf3-38e0-4ef1-a086-5c52839836ca tempest-FlavorsAdminTestJSON-546925656 tempest-FlavorsAdminTestJSON-546925656-project-admin] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:47.404397 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-953dfe35-7305-4984-9dec-5eafa23537b8 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:47.405958 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-953dfe35-7305-4984-9dec-5eafa23537b8 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] [instance: 0b4b7773-b59d-4956-b7e5-267d54541db6] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:52:47.422800 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-953dfe35-7305-4984-9dec-5eafa23537b8 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:47.426292 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-953dfe35-7305-4984-9dec-5eafa23537b8 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:47.426763 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-953dfe35-7305-4984-9dec-5eafa23537b8 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:47.432649 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-953dfe35-7305-4984-9dec-5eafa23537b8 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:47.433165 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-953dfe35-7305-4984-9dec-5eafa23537b8 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:47.433677 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-953dfe35-7305-4984-9dec-5eafa23537b8 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:47.457381 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-8201aaf3-38e0-4ef1-a086-5c52839836ca tempest-FlavorsAdminTestJSON-546925656 tempest-FlavorsAdminTestJSON-546925656-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/1563047796" status: 202 len: 0 microversion: 2.1 time: 0.071176 Oct 08 20:52:47.459116 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 190/391] 10.222.0.26 () {58 vars in 1161 bytes} [Sat Oct 8 20:52:47 2022] DELETE /compute/v2.1/flavors/1563047796 => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 20:52:47.481736 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-506c94ad-b672-42cf-80ed-f698ddb61728 tempest-FlavorsAdminTestJSON-546925656 tempest-FlavorsAdminTestJSON-546925656-project-admin] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:47.531933 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-506c94ad-b672-42cf-80ed-f698ddb61728 tempest-FlavorsAdminTestJSON-546925656 tempest-FlavorsAdminTestJSON-546925656-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.065409 Oct 08 20:52:47.532978 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 191/392] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Oct 8 20:52:47 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:52:47.554872 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-9df1018e-94c3-47f4-b802-97615f792c03 tempest-FlavorsAdminTestJSON-546925656 tempest-FlavorsAdminTestJSON-546925656-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1184449757", "id": 219123973, "os-flavor-access:is_public": "True"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:52:47.587874 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-9df1018e-94c3-47f4-b802-97615f792c03 tempest-FlavorsAdminTestJSON-546925656 tempest-FlavorsAdminTestJSON-546925656-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 426 microversion: 2.1 time: 0.038476 Oct 08 20:52:47.589243 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 192/393] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 20:52:47 2022] POST /compute/v2.1/flavors => generated 426 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 08 20:52:47.609733 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-f4c4e434-48c5-4369-b205-77f6749841ce tempest-FlavorsAdminTestJSON-546925656 tempest-FlavorsAdminTestJSON-546925656-project-admin] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:47.645327 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-f4c4e434-48c5-4369-b205-77f6749841ce tempest-FlavorsAdminTestJSON-546925656 tempest-FlavorsAdminTestJSON-546925656-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/219123973" status: 202 len: 0 microversion: 2.1 time: 0.047378 Oct 08 20:52:47.647855 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 193/394] 10.222.0.26 () {58 vars in 1158 bytes} [Sat Oct 8 20:52:47 2022] DELETE /compute/v2.1/flavors/219123973 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 20:52:47.657017 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-dc6f4f55-b1a3-4e5a-a477-da41c0972be0 tempest-FlavorsAdminTestJSON-546925656 tempest-FlavorsAdminTestJSON-546925656-project-admin] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:47.691417 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-dc6f4f55-b1a3-4e5a-a477-da41c0972be0 tempest-FlavorsAdminTestJSON-546925656 tempest-FlavorsAdminTestJSON-546925656-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.039514 Oct 08 20:52:47.693081 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 194/395] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Oct 8 20:52:47 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:52:47.721554 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-dcc89abc-f4a5-4014-a093-e257eb49ba52 tempest-FlavorsAdminTestJSON-546925656 tempest-FlavorsAdminTestJSON-546925656-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-882817435", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:52:47.759726 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-dcc89abc-f4a5-4014-a093-e257eb49ba52 tempest-FlavorsAdminTestJSON-546925656 tempest-FlavorsAdminTestJSON-546925656-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.045285 Oct 08 20:52:47.765381 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 195/396] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 20:52:47 2022] POST /compute/v2.1/flavors => generated 506 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:52:47.774324 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-3fa7af13-2307-474d-9978-295058280344 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:47.778802 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-3fa7af13-2307-474d-9978-295058280344 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] [instance: 1af12bcb-5e2a-4c15-8673-fa41701cb4c7] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:52:47.795803 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3fa7af13-2307-474d-9978-295058280344 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:47.797650 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3fa7af13-2307-474d-9978-295058280344 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:47.799308 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3fa7af13-2307-474d-9978-295058280344 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:47.800361 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3fa7af13-2307-474d-9978-295058280344 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:47.800983 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3fa7af13-2307-474d-9978-295058280344 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:47.802331 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3fa7af13-2307-474d-9978-295058280344 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:47.965268 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-3fa7af13-2307-474d-9978-295058280344 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb78cce5f7c4c348045745f40b13129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16530e0f2f0a4d23918261c9e21f9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:47.995660 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-3fa7af13-2307-474d-9978-295058280344 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cb78cce5f7c4c348045745f40b13129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16530e0f2f0a4d23918261c9e21f9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:48.003550 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-3fa7af13-2307-474d-9978-295058280344 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cb78cce5f7c4c348045745f40b13129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16530e0f2f0a4d23918261c9e21f9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:48.022091 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-3fa7af13-2307-474d-9978-295058280344 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] 10.222.0.26 "GET /compute/v2.1/servers/1af12bcb-5e2a-4c15-8673-fa41701cb4c7" status: 200 len: 1447 microversion: 2.75 time: 0.253590 Oct 08 20:52:48.033331 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 196/397] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:52:47 2022] GET /compute/v2.1/servers/1af12bcb-5e2a-4c15-8673-fa41701cb4c7 => generated 1447 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:52:48.034236 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-a291cbbe-2b4d-467a-ab2d-81ec70945fce tempest-FlavorsAdminTestJSON-546925656 tempest-FlavorsAdminTestJSON-546925656-project-admin] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:48.083201 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-a291cbbe-2b4d-467a-ab2d-81ec70945fce tempest-FlavorsAdminTestJSON-546925656 tempest-FlavorsAdminTestJSON-546925656-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/e67f5119-ac15-4e4d-b40b-cd9692283d68" status: 202 len: 0 microversion: 2.1 time: 0.055668 Oct 08 20:52:48.087283 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 197/398] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 20:52:48 2022] DELETE /compute/v2.1/flavors/e67f5119-ac15-4e4d-b40b-cd9692283d68 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 20:52:48.100890 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-953dfe35-7305-4984-9dec-5eafa23537b8 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '360660f7bb4746c8b1397f4857f423f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d702b3083bc4cf5ba6b6fc6f3c3147e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:48.123329 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-953dfe35-7305-4984-9dec-5eafa23537b8 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] 10.222.0.26 "GET /compute/v2.1/servers/0b4b7773-b59d-4956-b7e5-267d54541db6" status: 200 len: 1320 microversion: 2.1 time: 0.724168 Oct 08 20:52:48.131078 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 202/399] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:52:47 2022] GET /compute/v2.1/servers/0b4b7773-b59d-4956-b7e5-267d54541db6 => generated 1320 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:52:48.137327 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-8c56f006-2809-4d7a-bca2-5908a3db4454 tempest-FlavorsAdminTestJSON-546925656 tempest-FlavorsAdminTestJSON-546925656-project-admin] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:48.186996 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-8c56f006-2809-4d7a-bca2-5908a3db4454 tempest-FlavorsAdminTestJSON-546925656 tempest-FlavorsAdminTestJSON-546925656-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.054461 Oct 08 20:52:48.201979 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 203/400] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Oct 8 20:52:48 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:52:48.208455 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-2174bc05-b474-44d7-9213-f9490077e513 tempest-FlavorsAdminTestJSON-546925656 tempest-FlavorsAdminTestJSON-546925656-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-482743362", "id": "1ee53e19-1afe-4ccd-9225-ff351b02655a", "os-flavor-access:is_public": "True"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:52:48.234946 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-2174bc05-b474-44d7-9213-f9490077e513 tempest-FlavorsAdminTestJSON-546925656 tempest-FlavorsAdminTestJSON-546925656-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.031475 Oct 08 20:52:48.244591 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 204/401] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 20:52:48 2022] POST /compute/v2.1/flavors => generated 506 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:52:48.250225 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-9a63225f-9aa7-4082-a027-ae701ec9ad52 tempest-FlavorsAdminTestJSON-546925656 tempest-FlavorsAdminTestJSON-546925656-project-admin] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:48.271874 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-9a63225f-9aa7-4082-a027-ae701ec9ad52 tempest-FlavorsAdminTestJSON-546925656 tempest-FlavorsAdminTestJSON-546925656-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/1ee53e19-1afe-4ccd-9225-ff351b02655a" status: 202 len: 0 microversion: 2.1 time: 0.025615 Oct 08 20:52:48.273050 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 205/402] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 20:52:48 2022] DELETE /compute/v2.1/flavors/1ee53e19-1afe-4ccd-9225-ff351b02655a => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 20:52:48.285363 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-57aa44eb-5665-4a5c-adef-78f5b3875fa6 tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:48.286589 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-57aa44eb-5665-4a5c-adef-78f5b3875fa6 tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] [instance: 8216e713-dfa1-4625-b8ea-5869cf617f4f] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:52:48.298817 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=6,nova_api:DELETE=9 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:48.301433 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-57aa44eb-5665-4a5c-adef-78f5b3875fa6 tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:48.302237 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-57aa44eb-5665-4a5c-adef-78f5b3875fa6 tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:48.302962 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-57aa44eb-5665-4a5c-adef-78f5b3875fa6 tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:48.304112 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-57aa44eb-5665-4a5c-adef-78f5b3875fa6 tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:48.304791 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-57aa44eb-5665-4a5c-adef-78f5b3875fa6 tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:48.306196 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-57aa44eb-5665-4a5c-adef-78f5b3875fa6 tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:48.460013 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-57aa44eb-5665-4a5c-adef-78f5b3875fa6 tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd637d2fa21649a1b00f27e7d86f3003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d547f95cc6043b0bb9b6a94b2e354a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:48.468542 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-57aa44eb-5665-4a5c-adef-78f5b3875fa6 tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] 10.222.0.26 "GET /compute/v2.1/servers/8216e713-dfa1-4625-b8ea-5869cf617f4f" status: 200 len: 1218 microversion: 2.1 time: 0.193614 Oct 08 20:52:48.494825 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 206/403] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:52:48 2022] GET /compute/v2.1/servers/8216e713-dfa1-4625-b8ea-5869cf617f4f => generated 1218 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:52:48.506865 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-d571fa66-97f7-4163-bffb-05bf6d84db33 tempest-FlavorsAdminTestJSON-546925656 tempest-FlavorsAdminTestJSON-546925656-project-admin] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:48.585685 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-d571fa66-97f7-4163-bffb-05bf6d84db33 tempest-FlavorsAdminTestJSON-546925656 tempest-FlavorsAdminTestJSON-546925656-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.088892 Oct 08 20:52:48.604434 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 207/404] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Oct 8 20:52:48 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:52:48.614702 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-7e5cea71-ad1d-43af-862c-e2db268285d8 tempest-FlavorsAdminTestJSON-546925656 tempest-FlavorsAdminTestJSON-546925656-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-676798623", "id": 365342619, "os-flavor-access:is_public": "True"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:52:48.656619 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-64c937a0-f5c9-4a3c-a9e4-c2ff41724e64 tempest-HypervisorAdminV228Test-2075827341 tempest-HypervisorAdminV228Test-2075827341-project-admin] Calling method '.version_select at 0x7f1a8d1a85e0>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:48.658510 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-64c937a0-f5c9-4a3c-a9e4-c2ff41724e64 tempest-HypervisorAdminV228Test-2075827341 tempest-HypervisorAdminV228Test-2075827341-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:48.659010 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-64c937a0-f5c9-4a3c-a9e4-c2ff41724e64 tempest-HypervisorAdminV228Test-2075827341 tempest-HypervisorAdminV228Test-2075827341-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:48.659463 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-64c937a0-f5c9-4a3c-a9e4-c2ff41724e64 tempest-HypervisorAdminV228Test-2075827341 tempest-HypervisorAdminV228Test-2075827341-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:48.667454 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-7e5cea71-ad1d-43af-862c-e2db268285d8 tempest-FlavorsAdminTestJSON-546925656 tempest-FlavorsAdminTestJSON-546925656-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 410 microversion: 2.1 time: 0.062306 Oct 08 20:52:48.672911 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 208/405] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 20:52:48 2022] POST /compute/v2.1/flavors => generated 410 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:52:48.690249 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-92a04142-b1fc-4262-b201-bda321d79eac tempest-FlavorsAdminTestJSON-546925656 tempest-FlavorsAdminTestJSON-546925656-project-admin] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:48.719764 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-64c937a0-f5c9-4a3c-a9e4-c2ff41724e64 tempest-HypervisorAdminV228Test-2075827341 tempest-HypervisorAdminV228Test-2075827341-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:48.722856 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-64c937a0-f5c9-4a3c-a9e4-c2ff41724e64 tempest-HypervisorAdminV228Test-2075827341 tempest-HypervisorAdminV228Test-2075827341-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:48.723353 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-64c937a0-f5c9-4a3c-a9e4-c2ff41724e64 tempest-HypervisorAdminV228Test-2075827341 tempest-HypervisorAdminV228Test-2075827341-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:48.727676 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-92a04142-b1fc-4262-b201-bda321d79eac tempest-FlavorsAdminTestJSON-546925656 tempest-FlavorsAdminTestJSON-546925656-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/365342619" status: 200 len: 410 microversion: 2.1 time: 0.047728 Oct 08 20:52:48.733934 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 209/406] 10.222.0.26 () {58 vars in 1155 bytes} [Sat Oct 8 20:52:48 2022] GET /compute/v2.1/flavors/365342619 => generated 410 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 08 20:52:48.753444 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-64c937a0-f5c9-4a3c-a9e4-c2ff41724e64 tempest-HypervisorAdminV228Test-2075827341 tempest-HypervisorAdminV228Test-2075827341-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:48.758616 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-64c937a0-f5c9-4a3c-a9e4-c2ff41724e64 tempest-HypervisorAdminV228Test-2075827341 tempest-HypervisorAdminV228Test-2075827341-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:48.758706 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-64c937a0-f5c9-4a3c-a9e4-c2ff41724e64 tempest-HypervisorAdminV228Test-2075827341 tempest-HypervisorAdminV228Test-2075827341-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:48.769885 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-64c937a0-f5c9-4a3c-a9e4-c2ff41724e64 tempest-HypervisorAdminV228Test-2075827341 tempest-HypervisorAdminV228Test-2075827341-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.28 time: 0.683930 Oct 08 20:52:48.773968 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 198/407] 10.222.0.26 () {60 vars in 1187 bytes} [Sat Oct 8 20:52:48 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 08 20:52:48.785107 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-785f28f9-a363-409a-9020-1a84b1a99c29 tempest-HypervisorAdminV228Test-2075827341 tempest-HypervisorAdminV228Test-2075827341-project-admin] Calling method '.version_select at 0x7f1a8d1a8700>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:48.787247 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-785f28f9-a363-409a-9020-1a84b1a99c29 tempest-HypervisorAdminV228Test-2075827341 tempest-HypervisorAdminV228Test-2075827341-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:48.787812 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-785f28f9-a363-409a-9020-1a84b1a99c29 tempest-HypervisorAdminV228Test-2075827341 tempest-HypervisorAdminV228Test-2075827341-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:48.788750 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-785f28f9-a363-409a-9020-1a84b1a99c29 tempest-HypervisorAdminV228Test-2075827341 tempest-HypervisorAdminV228Test-2075827341-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:48.801319 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=1,nova_api:INSERT=4,nova_api:DELETE=12 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:48.810726 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-785f28f9-a363-409a-9020-1a84b1a99c29 tempest-HypervisorAdminV228Test-2075827341 tempest-HypervisorAdminV228Test-2075827341-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:48.812259 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-785f28f9-a363-409a-9020-1a84b1a99c29 tempest-HypervisorAdminV228Test-2075827341 tempest-HypervisorAdminV228Test-2075827341-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:48.812259 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-785f28f9-a363-409a-9020-1a84b1a99c29 tempest-HypervisorAdminV228Test-2075827341 tempest-HypervisorAdminV228Test-2075827341-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:48.821587 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-785f28f9-a363-409a-9020-1a84b1a99c29 tempest-HypervisorAdminV228Test-2075827341 tempest-HypervisorAdminV228Test-2075827341-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 718 microversion: 2.28 time: 0.040455 Oct 08 20:52:48.825226 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 199/408] 10.222.0.26 () {60 vars in 1193 bytes} [Sat Oct 8 20:52:48 2022] GET /compute/v2.1/os-hypervisors/1 => generated 718 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 08 20:52:49.044184 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-83919b62-64f9-4949-94a4-ee1ea94fe3df tempest-FlavorsAdminTestJSON-674085175 tempest-FlavorsAdminTestJSON-674085175-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:49.056438 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-2c1e8449-c0a8-402c-aae0-da64e671d473 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:49.057094 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-2c1e8449-c0a8-402c-aae0-da64e671d473 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] [instance: 1af12bcb-5e2a-4c15-8673-fa41701cb4c7] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:52:49.071880 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-83919b62-64f9-4949-94a4-ee1ea94fe3df tempest-FlavorsAdminTestJSON-674085175 tempest-FlavorsAdminTestJSON-674085175-project] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 5391 microversion: 2.1 time: 0.327231 Oct 08 20:52:49.074126 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 210/409] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Oct 8 20:52:48 2022] GET /compute/v2.1/flavors/detail => generated 5391 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 20:52:49.078424 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2c1e8449-c0a8-402c-aae0-da64e671d473 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:49.079016 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2c1e8449-c0a8-402c-aae0-da64e671d473 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:49.079490 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2c1e8449-c0a8-402c-aae0-da64e671d473 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:49.080236 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2c1e8449-c0a8-402c-aae0-da64e671d473 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:49.084667 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2c1e8449-c0a8-402c-aae0-da64e671d473 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:49.085262 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2c1e8449-c0a8-402c-aae0-da64e671d473 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:49.111256 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-d70fa9e2-996b-4d2c-be00-ca4cfbf6aa29 tempest-FlavorsAdminTestJSON-546925656 tempest-FlavorsAdminTestJSON-546925656-project-admin] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:49.178469 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-d70fa9e2-996b-4d2c-be00-ca4cfbf6aa29 tempest-FlavorsAdminTestJSON-546925656 tempest-FlavorsAdminTestJSON-546925656-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/365342619" status: 202 len: 0 microversion: 2.1 time: 0.087167 Oct 08 20:52:49.179444 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 211/410] 10.222.0.26 () {58 vars in 1158 bytes} [Sat Oct 8 20:52:49 2022] DELETE /compute/v2.1/flavors/365342619 => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 20:52:49.194099 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-efe3c9e2-1515-460a-a886-fb82ff139067 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:49.208367 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-efe3c9e2-1515-460a-a886-fb82ff139067 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] [instance: 0b4b7773-b59d-4956-b7e5-267d54541db6] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:52:49.239166 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-efe3c9e2-1515-460a-a886-fb82ff139067 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:49.241992 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-efe3c9e2-1515-460a-a886-fb82ff139067 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:49.244859 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-efe3c9e2-1515-460a-a886-fb82ff139067 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:49.247604 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-efe3c9e2-1515-460a-a886-fb82ff139067 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:49.252292 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-efe3c9e2-1515-460a-a886-fb82ff139067 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:49.254084 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-efe3c9e2-1515-460a-a886-fb82ff139067 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:49.368068 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-2c1e8449-c0a8-402c-aae0-da64e671d473 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb78cce5f7c4c348045745f40b13129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16530e0f2f0a4d23918261c9e21f9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:49.385090 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-2c1e8449-c0a8-402c-aae0-da64e671d473 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cb78cce5f7c4c348045745f40b13129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16530e0f2f0a4d23918261c9e21f9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:49.391359 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-2c1e8449-c0a8-402c-aae0-da64e671d473 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cb78cce5f7c4c348045745f40b13129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16530e0f2f0a4d23918261c9e21f9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:49.400972 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-2c1e8449-c0a8-402c-aae0-da64e671d473 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] 10.222.0.26 "GET /compute/v2.1/servers/1af12bcb-5e2a-4c15-8673-fa41701cb4c7" status: 200 len: 1447 microversion: 2.75 time: 0.352149 Oct 08 20:52:49.402749 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 200/411] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:52:49 2022] GET /compute/v2.1/servers/1af12bcb-5e2a-4c15-8673-fa41701cb4c7 => generated 1447 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:52:49.407432 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c8d06d64-f505-4ae2-ba67-67e0c561cb9a tempest-FlavorsAdminTestJSON-546925656 tempest-FlavorsAdminTestJSON-546925656-project-admin] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:49.467110 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-c8d06d64-f505-4ae2-ba67-67e0c561cb9a tempest-FlavorsAdminTestJSON-546925656 tempest-FlavorsAdminTestJSON-546925656-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.061772 Oct 08 20:52:49.467788 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 201/412] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Oct 8 20:52:49 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:52:49.509981 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-e5886385-84c0-4fa7-8e9f-d9e77cfa3313 tempest-FlavorsAdminTestJSON-546925656 tempest-FlavorsAdminTestJSON-546925656-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1762813961", "id": 1019707613, "os-flavor-access:is_public": "False"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:52:49.571572 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-e5886385-84c0-4fa7-8e9f-d9e77cfa3313 tempest-FlavorsAdminTestJSON-546925656 tempest-FlavorsAdminTestJSON-546925656-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.078717 Oct 08 20:52:49.572271 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 202/413] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 20:52:49 2022] POST /compute/v2.1/flavors => generated 430 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:52:49.607087 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-2b5c7ef1-aac0-4ae3-80d1-a5759e38c856 tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:49.608085 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-2b5c7ef1-aac0-4ae3-80d1-a5759e38c856 tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] [instance: 8216e713-dfa1-4625-b8ea-5869cf617f4f] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:52:49.648727 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2b5c7ef1-aac0-4ae3-80d1-a5759e38c856 tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:49.649743 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2b5c7ef1-aac0-4ae3-80d1-a5759e38c856 tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:49.650216 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2b5c7ef1-aac0-4ae3-80d1-a5759e38c856 tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:49.652775 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2b5c7ef1-aac0-4ae3-80d1-a5759e38c856 tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:49.654835 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2b5c7ef1-aac0-4ae3-80d1-a5759e38c856 tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:49.655355 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2b5c7ef1-aac0-4ae3-80d1-a5759e38c856 tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:49.920694 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-2b5c7ef1-aac0-4ae3-80d1-a5759e38c856 tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd637d2fa21649a1b00f27e7d86f3003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d547f95cc6043b0bb9b6a94b2e354a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:49.932303 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-2b5c7ef1-aac0-4ae3-80d1-a5759e38c856 tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] 10.222.0.26 "GET /compute/v2.1/servers/8216e713-dfa1-4625-b8ea-5869cf617f4f" status: 200 len: 1272 microversion: 2.1 time: 0.358586 Oct 08 20:52:49.955431 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 203/414] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:52:49 2022] GET /compute/v2.1/servers/8216e713-dfa1-4625-b8ea-5869cf617f4f => generated 1272 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:52:49.971527 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-a8591cd9-ed7a-4691-bf67-3d3a7dce4ee6 tempest-FlavorsAdminTestJSON-674085175 tempest-FlavorsAdminTestJSON-674085175-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "1019707613"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:52:49.993170 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-a8591cd9-ed7a-4691-bf67-3d3a7dce4ee6 tempest-FlavorsAdminTestJSON-674085175 tempest-FlavorsAdminTestJSON-674085175-project] HTTP exception thrown: Flavor 1019707613 could not be found. Oct 08 20:52:49.996488 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-a8591cd9-ed7a-4691-bf67-3d3a7dce4ee6 tempest-FlavorsAdminTestJSON-674085175 tempest-FlavorsAdminTestJSON-674085175-project] Request method failure captured: Oct 08 20:52:49.996488 ncdv-master-1 devstack@n-api.service[140491]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 08 20:52:49.996488 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 20:52:49.996488 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 20:52:49.996488 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 20:52:49.996488 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 107 Oct 08 20:52:49.996488 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 20:52:49.996488 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 20:52:49.996488 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 20:52:49.996488 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 20:52:49.996488 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeMdlODqz1HOq0N1VGPg7beZsRpuw6Z9I32Ky87F77_DsC5LgZ_qVu51ueOHxsh_k9RuD5JmRRWG5c9LxxTLu4mLFxS-QJcO3yB3WWu5JftEjSDYi4USMsIALCo_vWWOEH-F3XxaoTYtX-AC1DRCouJn_AB4cmsqiS2laapqeUMYMOo Oct 08 20:52:49.996488 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 20:52:49.996488 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 20:52:49.996488 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 20:52:49.996488 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 20:52:49.996488 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 20:52:49.996488 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 20:52:49.996488 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 876d1525decf4f9ebb4096e1b6ac374b Oct 08 20:52:49.996488 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-FlavorsAdminTestJSON-674085175 Oct 08 20:52:49.996488 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 20:52:49.996488 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 20:52:49.997978 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/876d1525decf4f9ebb4096e1b6ac374b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/876d1525decf4f9ebb4096e1b6ac374b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_876d1525decf4f9ebb4096e1b6ac374b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/876d1525decf4f9ebb4096e1b6ac374b"}]}] Oct 08 20:52:49.997978 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-FlavorsAdminTestJSON-674085175 Oct 08 20:52:49.997978 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 876d1525decf4f9ebb4096e1b6ac374b Oct 08 20:52:49.997978 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-674085175 Oct 08 20:52:49.997978 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-FlavorsAdminTestJSON-674085175-project Oct 08 20:52:49.997978 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 20:52:49.997978 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 20:52:49.997978 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 801e079246714e2fadfcac464db3cac5 Oct 08 20:52:49.997978 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-FlavorsAdminTestJSON-674085175-project Oct 08 20:52:49.997978 ncdv-master-1 devstack@n-api.service[140491]: Oct 08 20:52:49.997978 ncdv-master-1 devstack@n-api.service[140491]: {"server": {"name": "test", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "1019707613"}} Oct 08 20:52:49.997978 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 20:52:49.997978 ncdv-master-1 devstack@n-api.service[140491]: exception: Flavor 1019707613 could not be found. Oct 08 20:52:49.998715 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'body': {'server': {'name': 'test', 'imageRef': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'flavorRef': '1019707613'}}} Oct 08 20:52:49.998715 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:52:49.998715 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:52:49.998715 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Oct 08 20:52:49.998715 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Oct 08 20:52:49.998715 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 08 20:52:49.998715 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 08 20:52:49.998715 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 08 20:52:49.998715 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 08 20:52:49.998715 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 08 20:52:49.998715 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 08 20:52:49.998715 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 08 20:52:49.998715 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:52:49.998715 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 08 20:52:49.998715 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 08 20:52:49.998715 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 1019707613 could not be found. Oct 08 20:52:49.998715 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:52:49.998715 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:52:49.998715 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:52:49.998715 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:52:49.999871 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:52:49.999871 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:52:49.999871 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:52:49.999871 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:52:49.999871 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:52:49.999871 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:52:49.999871 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 20:52:49.999871 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 20:52:49.999871 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 20:52:49.999871 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 20:52:49.999871 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 20:52:49.999871 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 20:52:49.999871 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 08 20:52:49.999871 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 08 20:52:49.999871 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 08 20:52:49.999871 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 1019707613 could not be found. Oct 08 20:52:49.999871 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:52:49.999871 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:52:49.999871 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:52:49.999871 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:52:49.999871 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:52:50.000961 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:52:50.000961 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 20:52:50.000961 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 20:52:50.000961 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1019707613 could not be found. Oct 08 20:52:50.000961 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:52:50.000961 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-a8591cd9-ed7a-4691-bf67-3d3a7dce4ee6 tempest-FlavorsAdminTestJSON-674085175 tempest-FlavorsAdminTestJSON-674085175-project] Returning 400 to user: Flavor 1019707613 could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:52:50.000961 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-a8591cd9-ed7a-4691-bf67-3d3a7dce4ee6 tempest-FlavorsAdminTestJSON-674085175 tempest-FlavorsAdminTestJSON-674085175-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 400 len: 81 microversion: 2.1 time: 0.040952 Oct 08 20:52:50.002385 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 204/415] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 20:52:49 2022] POST /compute/v2.1/servers => generated 81 bytes in 46 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 08 20:52:50.009502 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-4b9ce491-f09c-4786-b1f6-01f6429499e3 tempest-FlavorsAdminTestJSON-546925656 tempest-FlavorsAdminTestJSON-546925656-project-admin] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:50.029176 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-4b9ce491-f09c-4786-b1f6-01f6429499e3 tempest-FlavorsAdminTestJSON-546925656 tempest-FlavorsAdminTestJSON-546925656-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/1019707613" status: 202 len: 0 microversion: 2.1 time: 0.025463 Oct 08 20:52:50.033777 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 205/416] 10.222.0.26 () {58 vars in 1161 bytes} [Sat Oct 8 20:52:50 2022] DELETE /compute/v2.1/flavors/1019707613 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 08 20:52:50.038899 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-5b73cba4-61f7-42a4-9695-045d90df464f tempest-FlavorsAdminTestJSON-546925656 tempest-FlavorsAdminTestJSON-546925656-project-admin] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:50.059410 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-5b73cba4-61f7-42a4-9695-045d90df464f tempest-FlavorsAdminTestJSON-546925656 tempest-FlavorsAdminTestJSON-546925656-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024375 Oct 08 20:52:50.060337 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 206/417] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Oct 8 20:52:50 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:52:50.082987 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c7f5ca6f-467d-49e6-b528-948b795baee6 tempest-FlavorsAdminTestJSON-546925656 tempest-FlavorsAdminTestJSON-546925656-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-566306605", "id": 58944660, "os-flavor-access:is_public": "False"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:52:50.120103 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-c7f5ca6f-467d-49e6-b528-948b795baee6 tempest-FlavorsAdminTestJSON-546925656 tempest-FlavorsAdminTestJSON-546925656-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.1 time: 0.041112 Oct 08 20:52:50.120738 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 207/418] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 20:52:50 2022] POST /compute/v2.1/flavors => generated 408 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:52:50.135049 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-efead489-043c-42ac-af5d-d45d91c69c92 tempest-FlavorsAdminTestJSON-546925656 tempest-FlavorsAdminTestJSON-546925656-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1890793608", "id": 1768854414, "os-flavor-access:is_public": "True"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:52:50.161911 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-efead489-043c-42ac-af5d-d45d91c69c92 tempest-FlavorsAdminTestJSON-546925656 tempest-FlavorsAdminTestJSON-546925656-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.030559 Oct 08 20:52:50.163848 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 208/419] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 20:52:50 2022] POST /compute/v2.1/flavors => generated 414 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 08 20:52:50.183026 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-8087ef8d-63c2-49f6-8bfb-fd63342f3586 tempest-FlavorsAdminTestJSON-546925656 tempest-FlavorsAdminTestJSON-546925656-project-admin] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:50.225066 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-8087ef8d-63c2-49f6-8bfb-fd63342f3586 tempest-FlavorsAdminTestJSON-546925656 tempest-FlavorsAdminTestJSON-546925656-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 411 microversion: 2.1 time: 0.051225 Oct 08 20:52:50.226545 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 209/420] 10.222.0.26 () {58 vars in 1169 bytes} [Sat Oct 8 20:52:50 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 411 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:52:50.238870 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-efe3c9e2-1515-460a-a886-fb82ff139067 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '360660f7bb4746c8b1397f4857f423f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d702b3083bc4cf5ba6b6fc6f3c3147e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:50.251204 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-efe3c9e2-1515-460a-a886-fb82ff139067 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] 10.222.0.26 "GET /compute/v2.1/servers/0b4b7773-b59d-4956-b7e5-267d54541db6" status: 200 len: 1320 microversion: 2.1 time: 1.070241 Oct 08 20:52:50.255486 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 212/421] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:52:49 2022] GET /compute/v2.1/servers/0b4b7773-b59d-4956-b7e5-267d54541db6 => generated 1320 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:52:50.256343 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-0567e053-9b5d-4aa2-9170-7a83a06ab351 tempest-FlavorsAdminTestJSON-546925656 tempest-FlavorsAdminTestJSON-546925656-project-admin] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:50.270047 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-0567e053-9b5d-4aa2-9170-7a83a06ab351 tempest-FlavorsAdminTestJSON-546925656 tempest-FlavorsAdminTestJSON-546925656-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 411 microversion: 2.1 time: 0.022789 Oct 08 20:52:50.271123 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 210/422] 10.222.0.26 () {58 vars in 1177 bytes} [Sat Oct 8 20:52:50 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 411 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:52:50.285497 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-8f32d0ab-fadc-433b-9863-9057a220a9dc tempest-FlavorsAdminTestJSON-546925656 tempest-FlavorsAdminTestJSON-546925656-project-admin] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:50.309934 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-8f32d0ab-fadc-433b-9863-9057a220a9dc tempest-FlavorsAdminTestJSON-546925656 tempest-FlavorsAdminTestJSON-546925656-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 411 microversion: 2.1 time: 0.027970 Oct 08 20:52:50.312594 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 213/423] 10.222.0.26 () {58 vars in 1171 bytes} [Sat Oct 8 20:52:50 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 411 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:52:50.326919 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-12195746-1dde-4b7c-830f-1e10499bd21d tempest-FlavorsAdminTestJSON-546925656 tempest-FlavorsAdminTestJSON-546925656-project-admin] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:50.364397 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-12195746-1dde-4b7c-830f-1e10499bd21d tempest-FlavorsAdminTestJSON-546925656 tempest-FlavorsAdminTestJSON-546925656-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 411 microversion: 2.1 time: 0.040273 Oct 08 20:52:50.379380 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e2b8ee2c-0fcf-4338-87f2-11d86a5345f6 tempest-FlavorsAdminTestJSON-546925656 tempest-FlavorsAdminTestJSON-546925656-project-admin] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:50.385739 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 211/424] 10.222.0.26 () {58 vars in 1169 bytes} [Sat Oct 8 20:52:50 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 411 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:52:50.435234 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-f826f920-1f30-4e78-8e7e-1cd7a320efe9 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:50.437831 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-f826f920-1f30-4e78-8e7e-1cd7a320efe9 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] [instance: 1af12bcb-5e2a-4c15-8673-fa41701cb4c7] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:52:50.450702 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f826f920-1f30-4e78-8e7e-1cd7a320efe9 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:50.451436 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f826f920-1f30-4e78-8e7e-1cd7a320efe9 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:50.452767 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f826f920-1f30-4e78-8e7e-1cd7a320efe9 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:50.454258 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f826f920-1f30-4e78-8e7e-1cd7a320efe9 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:50.454671 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-e2b8ee2c-0fcf-4338-87f2-11d86a5345f6 tempest-FlavorsAdminTestJSON-546925656 tempest-FlavorsAdminTestJSON-546925656-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 5395 microversion: 2.1 time: 0.078155 Oct 08 20:52:50.455594 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f826f920-1f30-4e78-8e7e-1cd7a320efe9 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:50.471267 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f826f920-1f30-4e78-8e7e-1cd7a320efe9 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:50.471922 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 214/425] 10.222.0.26 () {58 vars in 1169 bytes} [Sat Oct 8 20:52:50 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 5395 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:52:50.489230 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-0d47b66c-51de-4757-b6c1-4b54cd8fe536 tempest-FlavorsAdminTestJSON-546925656 tempest-FlavorsAdminTestJSON-546925656-project-admin] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:50.551632 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-0d47b66c-51de-4757-b6c1-4b54cd8fe536 tempest-FlavorsAdminTestJSON-546925656 tempest-FlavorsAdminTestJSON-546925656-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 5395 microversion: 2.1 time: 0.073901 Oct 08 20:52:50.562874 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 215/426] 10.222.0.26 () {58 vars in 1175 bytes} [Sat Oct 8 20:52:50 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 5395 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:52:50.575277 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-d10326da-7716-4b3b-8495-166730beeb05 tempest-FlavorsAdminTestJSON-546925656 tempest-FlavorsAdminTestJSON-546925656-project-admin] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:50.617551 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-d10326da-7716-4b3b-8495-166730beeb05 tempest-FlavorsAdminTestJSON-546925656 tempest-FlavorsAdminTestJSON-546925656-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 5395 microversion: 2.1 time: 0.046361 Oct 08 20:52:50.636241 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 216/427] 10.222.0.26 () {58 vars in 1173 bytes} [Sat Oct 8 20:52:50 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 5395 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:52:50.642062 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-f826f920-1f30-4e78-8e7e-1cd7a320efe9 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb78cce5f7c4c348045745f40b13129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16530e0f2f0a4d23918261c9e21f9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:50.652105 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-56909743-3d2d-46dd-aac8-4d84d4baa42f tempest-FlavorsAdminTestJSON-546925656 tempest-FlavorsAdminTestJSON-546925656-project-admin] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:50.659369 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-f826f920-1f30-4e78-8e7e-1cd7a320efe9 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cb78cce5f7c4c348045745f40b13129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16530e0f2f0a4d23918261c9e21f9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:50.663745 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-f826f920-1f30-4e78-8e7e-1cd7a320efe9 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cb78cce5f7c4c348045745f40b13129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16530e0f2f0a4d23918261c9e21f9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:50.679564 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-f826f920-1f30-4e78-8e7e-1cd7a320efe9 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] 10.222.0.26 "GET /compute/v2.1/servers/1af12bcb-5e2a-4c15-8673-fa41701cb4c7" status: 200 len: 1447 microversion: 2.75 time: 0.248303 Oct 08 20:52:50.700370 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-56909743-3d2d-46dd-aac8-4d84d4baa42f tempest-FlavorsAdminTestJSON-546925656 tempest-FlavorsAdminTestJSON-546925656-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 5395 microversion: 2.1 time: 0.062456 Oct 08 20:52:50.703588 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 212/428] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:52:50 2022] GET /compute/v2.1/servers/1af12bcb-5e2a-4c15-8673-fa41701cb4c7 => generated 1447 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:52:50.717012 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 217/429] 10.222.0.26 () {58 vars in 1169 bytes} [Sat Oct 8 20:52:50 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 5395 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:52:50.735663 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-9b8f26f3-80c2-4554-b916-6892ac7b4dbe tempest-FlavorsAdminTestJSON-546925656 tempest-FlavorsAdminTestJSON-546925656-project-admin] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:50.791060 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-9b8f26f3-80c2-4554-b916-6892ac7b4dbe tempest-FlavorsAdminTestJSON-546925656 tempest-FlavorsAdminTestJSON-546925656-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/1768854414" status: 202 len: 0 microversion: 2.1 time: 0.065875 Oct 08 20:52:50.794409 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 213/430] 10.222.0.26 () {58 vars in 1161 bytes} [Sat Oct 8 20:52:50 2022] DELETE /compute/v2.1/flavors/1768854414 => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 20:52:50.803099 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-b43a4d02-81fc-4c6c-ac18-36886caaba46 tempest-FlavorsAdminTestJSON-546925656 tempest-FlavorsAdminTestJSON-546925656-project-admin] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:50.850314 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-b43a4d02-81fc-4c6c-ac18-36886caaba46 tempest-FlavorsAdminTestJSON-546925656 tempest-FlavorsAdminTestJSON-546925656-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.050879 Oct 08 20:52:50.868864 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 218/431] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Oct 8 20:52:50 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:52:50.871457 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-f2f803c6-637f-4193-875a-fd15b42397d4 tempest-FlavorsAdminTestJSON-546925656 tempest-FlavorsAdminTestJSON-546925656-project-admin] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:50.922197 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-f2f803c6-637f-4193-875a-fd15b42397d4 tempest-FlavorsAdminTestJSON-546925656 tempest-FlavorsAdminTestJSON-546925656-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/58944660" status: 202 len: 0 microversion: 2.1 time: 0.054040 Oct 08 20:52:50.923514 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 214/432] 10.222.0.26 () {58 vars in 1155 bytes} [Sat Oct 8 20:52:50 2022] DELETE /compute/v2.1/flavors/58944660 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 20:52:50.932495 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-a3d7277a-b16c-49d8-9238-55f8a4178d64 tempest-FlavorsAdminTestJSON-546925656 tempest-FlavorsAdminTestJSON-546925656-project-admin] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:50.958722 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-554cd83b-c828-4581-a451-ffd470121f04 tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:50.959254 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-554cd83b-c828-4581-a451-ffd470121f04 tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] [instance: 8216e713-dfa1-4625-b8ea-5869cf617f4f] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:52:50.976329 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-554cd83b-c828-4581-a451-ffd470121f04 tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:50.977001 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-554cd83b-c828-4581-a451-ffd470121f04 tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:50.977483 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-554cd83b-c828-4581-a451-ffd470121f04 tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:50.978232 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-554cd83b-c828-4581-a451-ffd470121f04 tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:50.980886 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-554cd83b-c828-4581-a451-ffd470121f04 tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:50.981405 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-554cd83b-c828-4581-a451-ffd470121f04 tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:50.985754 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-a3d7277a-b16c-49d8-9238-55f8a4178d64 tempest-FlavorsAdminTestJSON-546925656 tempest-FlavorsAdminTestJSON-546925656-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.046712 Oct 08 20:52:50.987181 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 219/433] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Oct 8 20:52:50 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:52:51.007700 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-d881b3dc-42f4-4f81-bb75-8959b9adba73 tempest-FlavorsAdminTestJSON-546925656 tempest-FlavorsAdminTestJSON-546925656-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1271598297", "id": 1469845713, "os-flavor-access:is_public": "False"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:52:51.056217 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-d881b3dc-42f4-4f81-bb75-8959b9adba73 tempest-FlavorsAdminTestJSON-546925656 tempest-FlavorsAdminTestJSON-546925656-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.052341 Oct 08 20:52:51.058116 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 220/434] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 20:52:51 2022] POST /compute/v2.1/flavors => generated 415 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:52:51.071076 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-7ff246f6-d09d-41ef-b859-8f05d8332547 tempest-FlavorsAdminTestJSON-546925656 tempest-FlavorsAdminTestJSON-546925656-project-admin] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:51.226730 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-554cd83b-c828-4581-a451-ffd470121f04 tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd637d2fa21649a1b00f27e7d86f3003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d547f95cc6043b0bb9b6a94b2e354a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:51.237033 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-7ff246f6-d09d-41ef-b859-8f05d8332547 tempest-FlavorsAdminTestJSON-546925656 tempest-FlavorsAdminTestJSON-546925656-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.170364 Oct 08 20:52:51.238999 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 221/435] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Oct 8 20:52:51 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:52:51.241877 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-554cd83b-c828-4581-a451-ffd470121f04 tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] 10.222.0.26 "GET /compute/v2.1/servers/8216e713-dfa1-4625-b8ea-5869cf617f4f" status: 200 len: 1272 microversion: 2.1 time: 0.286135 Oct 08 20:52:51.252062 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 215/436] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:52:50 2022] GET /compute/v2.1/servers/8216e713-dfa1-4625-b8ea-5869cf617f4f => generated 1272 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:52:51.261811 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-046c32bb-1148-4300-b976-330186f08e2f tempest-FlavorsAdminTestJSON-674085175 tempest-FlavorsAdminTestJSON-674085175-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:51.276367 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-3a79f589-760d-4db9-b7f9-80b98f0def68 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:51.277411 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-3a79f589-760d-4db9-b7f9-80b98f0def68 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] [instance: 0b4b7773-b59d-4956-b7e5-267d54541db6] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:52:51.301058 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3a79f589-760d-4db9-b7f9-80b98f0def68 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:51.305568 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3a79f589-760d-4db9-b7f9-80b98f0def68 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:51.306365 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3a79f589-760d-4db9-b7f9-80b98f0def68 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:51.307372 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3a79f589-760d-4db9-b7f9-80b98f0def68 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:51.308085 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3a79f589-760d-4db9-b7f9-80b98f0def68 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:51.308731 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3a79f589-760d-4db9-b7f9-80b98f0def68 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:51.365124 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-046c32bb-1148-4300-b976-330186f08e2f tempest-FlavorsAdminTestJSON-674085175 tempest-FlavorsAdminTestJSON-674085175-project] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.111533 Oct 08 20:52:51.374028 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 222/437] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Oct 8 20:52:51 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:52:51.389374 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-b8effa8c-fd9f-404d-b32a-eafc51c79115 tempest-FlavorsAdminTestJSON-546925656 tempest-FlavorsAdminTestJSON-546925656-project-admin] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:51.441801 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-b8effa8c-fd9f-404d-b32a-eafc51c79115 tempest-FlavorsAdminTestJSON-546925656 tempest-FlavorsAdminTestJSON-546925656-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/1469845713" status: 202 len: 0 microversion: 2.1 time: 0.055994 Oct 08 20:52:51.442815 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 223/438] 10.222.0.26 () {58 vars in 1161 bytes} [Sat Oct 8 20:52:51 2022] DELETE /compute/v2.1/flavors/1469845713 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 08 20:52:51.453431 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-0e3d6793-fd39-4d48-ab4b-d63354120397 tempest-FlavorsAdminTestJSON-546925656 tempest-FlavorsAdminTestJSON-546925656-project-admin] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:51.524021 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-0e3d6793-fd39-4d48-ab4b-d63354120397 tempest-FlavorsAdminTestJSON-546925656 tempest-FlavorsAdminTestJSON-546925656-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.074865 Oct 08 20:52:51.545682 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 224/439] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Oct 8 20:52:51 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:52:51.555624 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-66a798db-7736-43d1-80a4-a9fa8ee8128d tempest-FlavorsAdminTestJSON-546925656 tempest-FlavorsAdminTestJSON-546925656-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1309042543", "id": 1723239278, "os-flavor-access:is_public": "True"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:52:51.605679 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-66a798db-7736-43d1-80a4-a9fa8ee8128d tempest-FlavorsAdminTestJSON-546925656 tempest-FlavorsAdminTestJSON-546925656-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.055731 Oct 08 20:52:51.606339 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 225/440] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 20:52:51 2022] POST /compute/v2.1/flavors => generated 414 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:52:51.628452 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-fe692a2e-cac1-4ee1-be57-f709d9019d66 tempest-FlavorsAdminTestJSON-674085175 tempest-FlavorsAdminTestJSON-674085175-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:51.669886 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-fe692a2e-cac1-4ee1-be57-f709d9019d66 tempest-FlavorsAdminTestJSON-674085175 tempest-FlavorsAdminTestJSON-674085175-project] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 5395 microversion: 2.1 time: 0.046490 Oct 08 20:52:51.670572 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 226/441] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Oct 8 20:52:51 2022] GET /compute/v2.1/flavors/detail => generated 5395 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:52:51.705131 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-1d25a73b-aad6-4f83-ac87-34b342ec5b3b tempest-FlavorsAdminTestJSON-546925656 tempest-FlavorsAdminTestJSON-546925656-project-admin] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:51.737999 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-1d25a73b-aad6-4f83-ac87-34b342ec5b3b tempest-FlavorsAdminTestJSON-546925656 tempest-FlavorsAdminTestJSON-546925656-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/1723239278" status: 202 len: 0 microversion: 2.1 time: 0.038766 Oct 08 20:52:51.742814 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 227/442] 10.222.0.26 () {58 vars in 1161 bytes} [Sat Oct 8 20:52:51 2022] DELETE /compute/v2.1/flavors/1723239278 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 20:52:51.749945 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-41c85521-73d4-41eb-81e3-30c49180e416 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:51.750579 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-41c85521-73d4-41eb-81e3-30c49180e416 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] [instance: 1af12bcb-5e2a-4c15-8673-fa41701cb4c7] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:52:51.774786 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-41c85521-73d4-41eb-81e3-30c49180e416 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:51.778271 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-41c85521-73d4-41eb-81e3-30c49180e416 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:51.783530 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-41c85521-73d4-41eb-81e3-30c49180e416 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:51.785547 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-41c85521-73d4-41eb-81e3-30c49180e416 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:51.786041 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-41c85521-73d4-41eb-81e3-30c49180e416 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:51.788217 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-41c85521-73d4-41eb-81e3-30c49180e416 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:52.020131 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-41c85521-73d4-41eb-81e3-30c49180e416 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb78cce5f7c4c348045745f40b13129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16530e0f2f0a4d23918261c9e21f9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:52.034683 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-41c85521-73d4-41eb-81e3-30c49180e416 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cb78cce5f7c4c348045745f40b13129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16530e0f2f0a4d23918261c9e21f9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:52.036338 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-41c85521-73d4-41eb-81e3-30c49180e416 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cb78cce5f7c4c348045745f40b13129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16530e0f2f0a4d23918261c9e21f9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:52.052797 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-41c85521-73d4-41eb-81e3-30c49180e416 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] 10.222.0.26 "GET /compute/v2.1/servers/1af12bcb-5e2a-4c15-8673-fa41701cb4c7" status: 200 len: 1453 microversion: 2.75 time: 0.308797 Oct 08 20:52:52.053609 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 228/443] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:52:51 2022] GET /compute/v2.1/servers/1af12bcb-5e2a-4c15-8673-fa41701cb4c7 => generated 1453 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:52:52.061104 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-780087aa-6f68-4d44-a408-84d9618f0b89 tempest-FlavorsAdminTestJSON-546925656 tempest-FlavorsAdminTestJSON-546925656-project-admin] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:52.126982 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-780087aa-6f68-4d44-a408-84d9618f0b89 tempest-FlavorsAdminTestJSON-546925656 tempest-FlavorsAdminTestJSON-546925656-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.072445 Oct 08 20:52:52.135387 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 229/444] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Oct 8 20:52:52 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:52:52.271011 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-fb7b73cd-9be5-47fc-aa30-05a6cdec60ca tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:52.271659 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-fb7b73cd-9be5-47fc-aa30-05a6cdec60ca tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] [instance: 8216e713-dfa1-4625-b8ea-5869cf617f4f] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:52:52.287588 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fb7b73cd-9be5-47fc-aa30-05a6cdec60ca tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:52.289040 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fb7b73cd-9be5-47fc-aa30-05a6cdec60ca tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:52.291699 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fb7b73cd-9be5-47fc-aa30-05a6cdec60ca tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:52.292520 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fb7b73cd-9be5-47fc-aa30-05a6cdec60ca tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:52.296641 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fb7b73cd-9be5-47fc-aa30-05a6cdec60ca tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:52.301549 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fb7b73cd-9be5-47fc-aa30-05a6cdec60ca tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:52.512909 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-3a79f589-760d-4db9-b7f9-80b98f0def68 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '360660f7bb4746c8b1397f4857f423f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d702b3083bc4cf5ba6b6fc6f3c3147e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:52.526010 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-3a79f589-760d-4db9-b7f9-80b98f0def68 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] 10.222.0.26 "GET /compute/v2.1/servers/0b4b7773-b59d-4956-b7e5-267d54541db6" status: 200 len: 1320 microversion: 2.1 time: 1.253432 Oct 08 20:52:52.527964 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 216/445] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:52:51 2022] GET /compute/v2.1/servers/0b4b7773-b59d-4956-b7e5-267d54541db6 => generated 1320 bytes in 1256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:52:52.896614 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-b092cd4c-03fb-435f-863d-7f2f0f64c02c req-a45023bb-e00f-4170-8f4f-6f1bf0ba7661 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b4b7773-b59d-4956-b7e5-267d54541db6", "name": "network-vif-plugged", "status": "completed", "tag": "38d934fc-c54f-41b1-a9d1-b8c83e8395a1"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:52:52.925740 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-b092cd4c-03fb-435f-863d-7f2f0f64c02c req-a45023bb-e00f-4170-8f4f-6f1bf0ba7661 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:52.926517 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-b092cd4c-03fb-435f-863d-7f2f0f64c02c req-a45023bb-e00f-4170-8f4f-6f1bf0ba7661 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:52.926713 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-b092cd4c-03fb-435f-863d-7f2f0f64c02c req-a45023bb-e00f-4170-8f4f-6f1bf0ba7661 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:52.987446 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-b092cd4c-03fb-435f-863d-7f2f0f64c02c req-a45023bb-e00f-4170-8f4f-6f1bf0ba7661 service nova] Creating event network-vif-plugged:38d934fc-c54f-41b1-a9d1-b8c83e8395a1 for instance 0b4b7773-b59d-4956-b7e5-267d54541db6 on nch1-master-1 Oct 08 20:52:53.008678 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-b092cd4c-03fb-435f-863d-7f2f0f64c02c req-a45023bb-e00f-4170-8f4f-6f1bf0ba7661 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113938 Oct 08 20:52:53.010290 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 217/446] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:52:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 08 20:52:53.020417 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-fb7b73cd-9be5-47fc-aa30-05a6cdec60ca tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd637d2fa21649a1b00f27e7d86f3003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d547f95cc6043b0bb9b6a94b2e354a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:53.044229 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-fb7b73cd-9be5-47fc-aa30-05a6cdec60ca tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] 10.222.0.26 "GET /compute/v2.1/servers/8216e713-dfa1-4625-b8ea-5869cf617f4f" status: 200 len: 1314 microversion: 2.1 time: 0.778038 Oct 08 20:52:53.045163 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 230/447] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:52:52 2022] GET /compute/v2.1/servers/8216e713-dfa1-4625-b8ea-5869cf617f4f => generated 1314 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:52:53.088958 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-ec2d1e2d-4fc6-4954-9678-3d9dd5d73eef tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:53.090410 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-ec2d1e2d-4fc6-4954-9678-3d9dd5d73eef tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] [instance: 1af12bcb-5e2a-4c15-8673-fa41701cb4c7] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:52:53.107908 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ec2d1e2d-4fc6-4954-9678-3d9dd5d73eef tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:53.112249 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ec2d1e2d-4fc6-4954-9678-3d9dd5d73eef tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:53.113041 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ec2d1e2d-4fc6-4954-9678-3d9dd5d73eef tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:53.114696 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ec2d1e2d-4fc6-4954-9678-3d9dd5d73eef tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:53.116214 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ec2d1e2d-4fc6-4954-9678-3d9dd5d73eef tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:53.117077 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ec2d1e2d-4fc6-4954-9678-3d9dd5d73eef tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:53.475454 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-ec2d1e2d-4fc6-4954-9678-3d9dd5d73eef tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb78cce5f7c4c348045745f40b13129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16530e0f2f0a4d23918261c9e21f9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:53.491906 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-ec2d1e2d-4fc6-4954-9678-3d9dd5d73eef tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cb78cce5f7c4c348045745f40b13129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16530e0f2f0a4d23918261c9e21f9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:53.496924 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-ec2d1e2d-4fc6-4954-9678-3d9dd5d73eef tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cb78cce5f7c4c348045745f40b13129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16530e0f2f0a4d23918261c9e21f9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:53.507526 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-ec2d1e2d-4fc6-4954-9678-3d9dd5d73eef tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] 10.222.0.26 "GET /compute/v2.1/servers/1af12bcb-5e2a-4c15-8673-fa41701cb4c7" status: 200 len: 1453 microversion: 2.75 time: 0.426437 Oct 08 20:52:53.512114 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 218/448] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:52:53 2022] GET /compute/v2.1/servers/1af12bcb-5e2a-4c15-8673-fa41701cb4c7 => generated 1453 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:52:53.550707 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-4e253d5e-ada8-478c-8fe4-072f299f925f tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:53.551406 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-4e253d5e-ada8-478c-8fe4-072f299f925f tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] [instance: 0b4b7773-b59d-4956-b7e5-267d54541db6] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:52:53.562415 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4e253d5e-ada8-478c-8fe4-072f299f925f tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:53.563032 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4e253d5e-ada8-478c-8fe4-072f299f925f tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:53.563519 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4e253d5e-ada8-478c-8fe4-072f299f925f tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:53.581350 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4e253d5e-ada8-478c-8fe4-072f299f925f tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:53.581350 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4e253d5e-ada8-478c-8fe4-072f299f925f tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:53.581880 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4e253d5e-ada8-478c-8fe4-072f299f925f tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:54.073374 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-b0b8c6e7-5efe-487c-b793-b032d4c17296 tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:54.074521 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-b0b8c6e7-5efe-487c-b793-b032d4c17296 tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] [instance: 8216e713-dfa1-4625-b8ea-5869cf617f4f] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:52:54.088235 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b0b8c6e7-5efe-487c-b793-b032d4c17296 tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:54.088943 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b0b8c6e7-5efe-487c-b793-b032d4c17296 tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:54.093853 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b0b8c6e7-5efe-487c-b793-b032d4c17296 tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:54.094855 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b0b8c6e7-5efe-487c-b793-b032d4c17296 tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:54.095489 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b0b8c6e7-5efe-487c-b793-b032d4c17296 tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:54.096155 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b0b8c6e7-5efe-487c-b793-b032d4c17296 tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:54.488914 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-b0b8c6e7-5efe-487c-b793-b032d4c17296 tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd637d2fa21649a1b00f27e7d86f3003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d547f95cc6043b0bb9b6a94b2e354a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:54.505147 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-b0b8c6e7-5efe-487c-b793-b032d4c17296 tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] 10.222.0.26 "GET /compute/v2.1/servers/8216e713-dfa1-4625-b8ea-5869cf617f4f" status: 200 len: 1314 microversion: 2.1 time: 0.437299 Oct 08 20:52:54.506051 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 219/449] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:52:54 2022] GET /compute/v2.1/servers/8216e713-dfa1-4625-b8ea-5869cf617f4f => generated 1314 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:52:54.511294 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-4e253d5e-ada8-478c-8fe4-072f299f925f tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '360660f7bb4746c8b1397f4857f423f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d702b3083bc4cf5ba6b6fc6f3c3147e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:54.543498 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-4e253d5e-ada8-478c-8fe4-072f299f925f tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] 10.222.0.26 "GET /compute/v2.1/servers/0b4b7773-b59d-4956-b7e5-267d54541db6" status: 200 len: 1320 microversion: 2.1 time: 0.992238 Oct 08 20:52:54.544934 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 231/450] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:52:53 2022] GET /compute/v2.1/servers/0b4b7773-b59d-4956-b7e5-267d54541db6 => generated 1320 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 20:52:54.563488 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-c71ee921-f1ce-442f-9c73-7c9049a2ff3d tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:54.564833 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-c71ee921-f1ce-442f-9c73-7c9049a2ff3d tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] [instance: 1af12bcb-5e2a-4c15-8673-fa41701cb4c7] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:52:54.571701 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c71ee921-f1ce-442f-9c73-7c9049a2ff3d tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:54.572808 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c71ee921-f1ce-442f-9c73-7c9049a2ff3d tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:54.573604 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c71ee921-f1ce-442f-9c73-7c9049a2ff3d tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:54.574611 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c71ee921-f1ce-442f-9c73-7c9049a2ff3d tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:54.575282 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c71ee921-f1ce-442f-9c73-7c9049a2ff3d tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:54.575914 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c71ee921-f1ce-442f-9c73-7c9049a2ff3d tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:54.727749 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-c71ee921-f1ce-442f-9c73-7c9049a2ff3d tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb78cce5f7c4c348045745f40b13129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16530e0f2f0a4d23918261c9e21f9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:54.738016 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-c71ee921-f1ce-442f-9c73-7c9049a2ff3d tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cb78cce5f7c4c348045745f40b13129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16530e0f2f0a4d23918261c9e21f9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:54.739532 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-c71ee921-f1ce-442f-9c73-7c9049a2ff3d tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cb78cce5f7c4c348045745f40b13129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16530e0f2f0a4d23918261c9e21f9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:54.755376 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-c71ee921-f1ce-442f-9c73-7c9049a2ff3d tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] 10.222.0.26 "GET /compute/v2.1/servers/1af12bcb-5e2a-4c15-8673-fa41701cb4c7" status: 200 len: 1438 microversion: 2.75 time: 0.204146 Oct 08 20:52:54.755969 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 232/451] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:52:54 2022] GET /compute/v2.1/servers/1af12bcb-5e2a-4c15-8673-fa41701cb4c7 => generated 1438 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:52:54.971944 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-891a4d71-2f03-4c1f-b1d9-a5faa488f1ab tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-928363921", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:52:55.089045 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.network.neutron [None req-891a4d71-2f03-4c1f-b1d9-a5faa488f1ab tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] validate_networks() for None {{(pid=140491) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 20:52:55.091663 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-92cca232-ad59-4591-a492-d7ff3aaac580 tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:52:55.095670 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-92cca232-ad59-4591-a492-d7ff3aaac580 tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] [instance: 1af12bcb-5e2a-4c15-8673-fa41701cb4c7] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:52:55.118463 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-92cca232-ad59-4591-a492-d7ff3aaac580 tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:55.121558 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-92cca232-ad59-4591-a492-d7ff3aaac580 tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:55.122425 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-92cca232-ad59-4591-a492-d7ff3aaac580 tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:55.123779 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-92cca232-ad59-4591-a492-d7ff3aaac580 tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:55.127016 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-92cca232-ad59-4591-a492-d7ff3aaac580 tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:55.130365 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-92cca232-ad59-4591-a492-d7ff3aaac580 tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:55.343529 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-92cca232-ad59-4591-a492-d7ff3aaac580 tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Flavor limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 20:52:55.344378 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-92cca232-ad59-4591-a492-d7ff3aaac580 tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Image limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 20:52:55.345409 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-92cca232-ad59-4591-a492-d7ff3aaac580 tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Flavor pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 20:52:55.349037 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-92cca232-ad59-4591-a492-d7ff3aaac580 tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Image pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 20:52:55.349868 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-92cca232-ad59-4591-a492-d7ff3aaac580 tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 20:52:55.513581 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-92cca232-ad59-4591-a492-d7ff3aaac580 tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] [instance: 1af12bcb-5e2a-4c15-8673-fa41701cb4c7] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:52:55.536711 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-92cca232-ad59-4591-a492-d7ff3aaac580 tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:55.537268 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-92cca232-ad59-4591-a492-d7ff3aaac580 tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:55.537725 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-92cca232-ad59-4591-a492-d7ff3aaac580 tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:55.542183 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-92cca232-ad59-4591-a492-d7ff3aaac580 tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:55.542948 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-92cca232-ad59-4591-a492-d7ff3aaac580 tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:55.543555 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-92cca232-ad59-4591-a492-d7ff3aaac580 tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:55.919013 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.objects.instance [None req-92cca232-ad59-4591-a492-d7ff3aaac580 tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Lazy-loading 'services' on Instance uuid 1af12bcb-5e2a-4c15-8673-fa41701cb4c7 {{(pid=140492) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 20:52:56.075162 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-92cca232-ad59-4591-a492-d7ff3aaac580 tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/1af12bcb-5e2a-4c15-8673-fa41701cb4c7/action" status: 202 len: 1942 microversion: 2.75 time: 1.294981 Oct 08 20:52:56.089211 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 233/452] 10.222.0.26 () {62 vars in 1319 bytes} [Sat Oct 8 20:52:54 2022] POST /compute/v2.1/servers/1af12bcb-5e2a-4c15-8673-fa41701cb4c7/action => generated 1942 bytes in 1298 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 08 20:52:56.528609 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-2ec8af7a-226e-4600-8530-a02866dfeef3 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:56.531171 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-891a4d71-2f03-4c1f-b1d9-a5faa488f1ab tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Flavor limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 20:52:56.531853 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-891a4d71-2f03-4c1f-b1d9-a5faa488f1ab tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Image limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 20:52:56.532419 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-891a4d71-2f03-4c1f-b1d9-a5faa488f1ab tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Flavor pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 20:52:56.532905 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-891a4d71-2f03-4c1f-b1d9-a5faa488f1ab tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Image pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 20:52:56.533419 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-891a4d71-2f03-4c1f-b1d9-a5faa488f1ab tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 20:52:56.543600 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-2ec8af7a-226e-4600-8530-a02866dfeef3 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] 10.222.0.26 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.464259 Oct 08 20:52:56.544311 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 234/453] 10.222.0.26 () {58 vars in 1137 bytes} [Sat Oct 8 20:52:56 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:52:56.563899 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-bc4ee7d0-a649-421f-826b-9349e43f2230 tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:56.564806 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-bc4ee7d0-a649-421f-826b-9349e43f2230 tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] [instance: 8216e713-dfa1-4625-b8ea-5869cf617f4f] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:52:56.570025 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-891a4d71-2f03-4c1f-b1d9-a5faa488f1ab tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:56.572679 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-891a4d71-2f03-4c1f-b1d9-a5faa488f1ab tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:56.574861 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-891a4d71-2f03-4c1f-b1d9-a5faa488f1ab tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:56.580377 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-891a4d71-2f03-4c1f-b1d9-a5faa488f1ab tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:56.581260 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-891a4d71-2f03-4c1f-b1d9-a5faa488f1ab tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:56.584498 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-891a4d71-2f03-4c1f-b1d9-a5faa488f1ab tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:56.588545 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bc4ee7d0-a649-421f-826b-9349e43f2230 tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:56.593659 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bc4ee7d0-a649-421f-826b-9349e43f2230 tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:56.594484 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bc4ee7d0-a649-421f-826b-9349e43f2230 tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:56.597335 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bc4ee7d0-a649-421f-826b-9349e43f2230 tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:56.598020 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bc4ee7d0-a649-421f-826b-9349e43f2230 tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:56.599346 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bc4ee7d0-a649-421f-826b-9349e43f2230 tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:56.677508 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-891a4d71-2f03-4c1f-b1d9-a5faa488f1ab tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Getting quotas for project 8c92fe04ab8248399d0acb932f82d607. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 20:52:56.690165 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-891a4d71-2f03-4c1f-b1d9-a5faa488f1ab tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Getting quotas for user 5ef659f5a1a24c439528a7675bdd70f8 and project 8c92fe04ab8248399d0acb932f82d607. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 20:52:56.730469 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-891a4d71-2f03-4c1f-b1d9-a5faa488f1ab tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Going to run 1 instances... {{(pid=140491) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 20:52:56.746163 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-891a4d71-2f03-4c1f-b1d9-a5faa488f1ab tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] [instance: 73fd15ea-e4bd-4310-93bb-147b0a5e27ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c508bd7f-7db9-4b2c-af7c-be54a855c355',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140491) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 20:52:56.838194 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=2 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:56.897885 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-891a4d71-2f03-4c1f-b1d9-a5faa488f1ab tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.390423 Oct 08 20:52:56.920307 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 220/454] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 20:52:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 2413 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 08 20:52:56.926472 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-38175ace-796e-4031-94f4-3ada564df316 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:56.927359 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-38175ace-796e-4031-94f4-3ada564df316 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] [instance: 0b4b7773-b59d-4956-b7e5-267d54541db6] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:52:56.956416 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-38175ace-796e-4031-94f4-3ada564df316 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:56.959375 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-38175ace-796e-4031-94f4-3ada564df316 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:56.961457 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-38175ace-796e-4031-94f4-3ada564df316 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:56.968116 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-38175ace-796e-4031-94f4-3ada564df316 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:56.969068 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-38175ace-796e-4031-94f4-3ada564df316 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:56.972545 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-38175ace-796e-4031-94f4-3ada564df316 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:57.232591 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=8 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:57.263592 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-bc4ee7d0-a649-421f-826b-9349e43f2230 tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd637d2fa21649a1b00f27e7d86f3003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d547f95cc6043b0bb9b6a94b2e354a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:57.274134 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-bc4ee7d0-a649-421f-826b-9349e43f2230 tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] 10.222.0.26 "GET /compute/v2.1/servers/8216e713-dfa1-4625-b8ea-5869cf617f4f" status: 200 len: 1314 microversion: 2.1 time: 0.720354 Oct 08 20:52:57.288424 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 235/455] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:52:56 2022] GET /compute/v2.1/servers/8216e713-dfa1-4625-b8ea-5869cf617f4f => generated 1314 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:52:57.307683 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-476a86b7-4ac8-461e-bd75-66d0043d0bd3 req-6a402340-66b4-4c16-9bda-1bf7d31a04b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8216e713-dfa1-4625-b8ea-5869cf617f4f", "tag": "9fcb2769-f8e8-45e3-808c-aebaba6c6fdc"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:52:57.350867 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-476a86b7-4ac8-461e-bd75-66d0043d0bd3 req-6a402340-66b4-4c16-9bda-1bf7d31a04b1 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:57.354353 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-476a86b7-4ac8-461e-bd75-66d0043d0bd3 req-6a402340-66b4-4c16-9bda-1bf7d31a04b1 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:57.362229 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-476a86b7-4ac8-461e-bd75-66d0043d0bd3 req-6a402340-66b4-4c16-9bda-1bf7d31a04b1 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:57.390604 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-476a86b7-4ac8-461e-bd75-66d0043d0bd3 req-6a402340-66b4-4c16-9bda-1bf7d31a04b1 service nova] Creating event network-changed:9fcb2769-f8e8-45e3-808c-aebaba6c6fdc for instance 8216e713-dfa1-4625-b8ea-5869cf617f4f on nch2-master-1 Oct 08 20:52:57.402264 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-476a86b7-4ac8-461e-bd75-66d0043d0bd3 req-6a402340-66b4-4c16-9bda-1bf7d31a04b1 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109437 Oct 08 20:52:57.405959 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 236/456] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:52:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:52:57.423498 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-9de44975-e391-446b-b48f-9d5bcc47f9fa tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:57.428213 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-9de44975-e391-446b-b48f-9d5bcc47f9fa tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] [instance: 1af12bcb-5e2a-4c15-8673-fa41701cb4c7] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:52:57.443923 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9de44975-e391-446b-b48f-9d5bcc47f9fa tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:57.446568 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9de44975-e391-446b-b48f-9d5bcc47f9fa tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:57.447167 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9de44975-e391-446b-b48f-9d5bcc47f9fa tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:57.448020 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9de44975-e391-446b-b48f-9d5bcc47f9fa tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:57.450284 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9de44975-e391-446b-b48f-9d5bcc47f9fa tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:57.450835 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9de44975-e391-446b-b48f-9d5bcc47f9fa tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:57.659270 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:57.662117 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.objects.instance [None req-9de44975-e391-446b-b48f-9d5bcc47f9fa tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Lazy-loading 'services' on Instance uuid 1af12bcb-5e2a-4c15-8673-fa41701cb4c7 {{(pid=140492) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 20:52:57.722298 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-9de44975-e391-446b-b48f-9d5bcc47f9fa tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/1af12bcb-5e2a-4c15-8673-fa41701cb4c7" status: 200 len: 1929 microversion: 2.75 time: 0.314260 Oct 08 20:52:57.725495 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 237/457] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:52:57 2022] GET /compute/v2.1/servers/1af12bcb-5e2a-4c15-8673-fa41701cb4c7 => generated 1929 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:52:57.789993 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-38175ace-796e-4031-94f4-3ada564df316 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '360660f7bb4746c8b1397f4857f423f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d702b3083bc4cf5ba6b6fc6f3c3147e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:57.800553 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-38175ace-796e-4031-94f4-3ada564df316 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] 10.222.0.26 "GET /compute/v2.1/servers/0b4b7773-b59d-4956-b7e5-267d54541db6" status: 200 len: 1470 microversion: 2.1 time: 0.878083 Oct 08 20:52:57.805089 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 221/458] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:52:56 2022] GET /compute/v2.1/servers/0b4b7773-b59d-4956-b7e5-267d54541db6 => generated 1470 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:52:57.821113 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-63f94c33-c697-4276-946f-7724927e039e tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-798357875", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:52:57.947038 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.network.neutron [None req-63f94c33-c697-4276-946f-7724927e039e tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] validate_networks() for None {{(pid=140491) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 20:52:58.580149 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-63f94c33-c697-4276-946f-7724927e039e tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Flavor limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 20:52:58.581975 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-63f94c33-c697-4276-946f-7724927e039e tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Image limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 20:52:58.582868 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-63f94c33-c697-4276-946f-7724927e039e tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Flavor pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 20:52:58.583523 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-63f94c33-c697-4276-946f-7724927e039e tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Image pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 20:52:58.584257 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-63f94c33-c697-4276-946f-7724927e039e tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 20:52:58.601729 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-63f94c33-c697-4276-946f-7724927e039e tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:58.603446 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-63f94c33-c697-4276-946f-7724927e039e tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:58.603969 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-63f94c33-c697-4276-946f-7724927e039e tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:58.605706 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-63f94c33-c697-4276-946f-7724927e039e tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:58.607267 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-63f94c33-c697-4276-946f-7724927e039e tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:58.610011 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-63f94c33-c697-4276-946f-7724927e039e tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:58.649485 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-63f94c33-c697-4276-946f-7724927e039e tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Getting quotas for project 8c92fe04ab8248399d0acb932f82d607. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 20:52:58.653598 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-36f1db24-a57d-4506-a406-1573d67df9f7 tempest-ServersWithSpecificFlavorTestJSON-750818918 tempest-ServersWithSpecificFlavorTestJSON-750818918-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-405255075", "id": 1225441597, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:52:58.657522 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-63f94c33-c697-4276-946f-7724927e039e tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Getting quotas for user 5ef659f5a1a24c439528a7675bdd70f8 and project 8c92fe04ab8248399d0acb932f82d607. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 20:52:58.687175 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-63f94c33-c697-4276-946f-7724927e039e tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Going to run 1 instances... {{(pid=140491) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 20:52:58.687175 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-63f94c33-c697-4276-946f-7724927e039e tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] [instance: 5c864780-3998-4a09-95d4-e000a02af71e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c508bd7f-7db9-4b2c-af7c-be54a855c355',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140491) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 20:52:58.693548 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=4,nova_api:DELETE=9 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:58.700399 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=7,nova_api:DELETE=9 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:58.706777 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-36f1db24-a57d-4506-a406-1573d67df9f7 tempest-ServersWithSpecificFlavorTestJSON-750818918 tempest-ServersWithSpecificFlavorTestJSON-750818918-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 424 microversion: 2.1 time: 0.979359 Oct 08 20:52:58.707400 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 238/459] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 20:52:57 2022] POST /compute/v2.1/flavors => generated 424 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:52:58.781671 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-63f94c33-c697-4276-946f-7724927e039e tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.966640 Oct 08 20:52:58.790277 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 222/460] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 20:52:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 984 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 08 20:52:58.802322 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-06e3cb23-411c-4ce0-9071-781709fefe70 tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:58.804427 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-06e3cb23-411c-4ce0-9071-781709fefe70 tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] [instance: 8216e713-dfa1-4625-b8ea-5869cf617f4f] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:52:58.820707 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-06e3cb23-411c-4ce0-9071-781709fefe70 tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:58.822500 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-06e3cb23-411c-4ce0-9071-781709fefe70 tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:58.824344 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-06e3cb23-411c-4ce0-9071-781709fefe70 tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:58.825484 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-06e3cb23-411c-4ce0-9071-781709fefe70 tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:58.827805 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-06e3cb23-411c-4ce0-9071-781709fefe70 tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:58.829168 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-06e3cb23-411c-4ce0-9071-781709fefe70 tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:59.292486 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-06e3cb23-411c-4ce0-9071-781709fefe70 tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd637d2fa21649a1b00f27e7d86f3003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d547f95cc6043b0bb9b6a94b2e354a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:59.328885 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-06e3cb23-411c-4ce0-9071-781709fefe70 tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] 10.222.0.26 "GET /compute/v2.1/servers/8216e713-dfa1-4625-b8ea-5869cf617f4f" status: 200 len: 1314 microversion: 2.1 time: 0.537377 Oct 08 20:52:59.334485 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 223/461] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:52:58 2022] GET /compute/v2.1/servers/8216e713-dfa1-4625-b8ea-5869cf617f4f => generated 1314 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:52:59.336238 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-756493df-a8e0-4850-8930-f84561e03027 tempest-ServersAdminNegativeTestJSON-1595191754 tempest-ServersAdminNegativeTestJSON-1595191754-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:52:59.336816 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-756493df-a8e0-4850-8930-f84561e03027 tempest-ServersAdminNegativeTestJSON-1595191754 tempest-ServersAdminNegativeTestJSON-1595191754-project-admin] [instance: 2472eefe-06cf-4240-aebe-cc350a2ddac1] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:52:59.344016 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-298152d3-03d9-42ba-845d-ef6066822e25 tempest-ServersWithSpecificFlavorTestJSON-750818918 tempest-ServersWithSpecificFlavorTestJSON-750818918-project-admin] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:59.344928 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-756493df-a8e0-4850-8930-f84561e03027 tempest-ServersAdminNegativeTestJSON-1595191754 tempest-ServersAdminNegativeTestJSON-1595191754-project-admin] HTTP exception thrown: Instance 2472eefe-06cf-4240-aebe-cc350a2ddac1 could not be found. Oct 08 20:52:59.351706 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-756493df-a8e0-4850-8930-f84561e03027 tempest-ServersAdminNegativeTestJSON-1595191754 tempest-ServersAdminNegativeTestJSON-1595191754-project-admin] Request method failure captured: Oct 08 20:52:59.351706 ncdv-master-1 devstack@n-api.service[140492]: request: POST /compute/v2.1/servers/2472eefe-06cf-4240-aebe-cc350a2ddac1/action HTTP/1.1 Oct 08 20:52:59.351706 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 20:52:59.351706 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 20:52:59.351706 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 20:52:59.351706 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 15 Oct 08 20:52:59.351706 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 20:52:59.351706 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 20:52:59.351706 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 20:52:59.351706 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 20:52:59.351706 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeML0OHMVFDPindfvjl4I6rk9bvD4uNY-qx_e5Rq6p0kk9YN3i1BuSpXj1tea77clsra7Z3LUUNPby9eYNjQ_b4MElZyhDzQyr1I4EuLhrKcEKBbjYBO1N9QwHGLBhqktGpjYn_GmHb8nFn603Dm2x_LMsuCWob8JqXOUS2wYKWYhNQ Oct 08 20:52:59.351706 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 20:52:59.351706 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 20:52:59.351706 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 20:52:59.351706 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 20:52:59.351706 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 20:52:59.351706 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 20:52:59.351706 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: dac5ccb4d1b74021ac5625851f88c009 Oct 08 20:52:59.351706 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1595191754 Oct 08 20:52:59.351706 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,admin,member Oct 08 20:52:59.351706 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,admin,member Oct 08 20:52:59.353027 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/dac5ccb4d1b74021ac5625851f88c009"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/dac5ccb4d1b74021ac5625851f88c009"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_dac5ccb4d1b74021ac5625851f88c009"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/dac5ccb4d1b74021ac5625851f88c009"}]}] Oct 08 20:52:59.353027 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1595191754 Oct 08 20:52:59.353027 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: dac5ccb4d1b74021ac5625851f88c009 Oct 08 20:52:59.353027 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1595191754 Oct 08 20:52:59.353027 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-ServersAdminNegativeTestJSON-1595191754-project-admin Oct 08 20:52:59.353027 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 20:52:59.353027 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 20:52:59.353027 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 4b1b7b27c9b04fb897ebe2669d10c479 Oct 08 20:52:59.353027 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1595191754-project-admin Oct 08 20:52:59.353027 ncdv-master-1 devstack@n-api.service[140492]: Oct 08 20:52:59.353027 ncdv-master-1 devstack@n-api.service[140492]: {"migrate": {}} Oct 08 20:52:59.353027 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 20:52:59.353027 ncdv-master-1 devstack@n-api.service[140492]: exception: Instance 2472eefe-06cf-4240-aebe-cc350a2ddac1 could not be found. Oct 08 20:52:59.354247 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': '2472eefe-06cf-4240-aebe-cc350a2ddac1', 'body': {'migrate': {}}} Oct 08 20:52:59.354247 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:52:59.354247 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:52:59.354247 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 20:52:59.354247 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 20:52:59.354247 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 20:52:59.354247 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 20:52:59.354247 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 08 20:52:59.354247 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 08 20:52:59.354247 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2472eefe-06cf-4240-aebe-cc350a2ddac1 could not be found. Oct 08 20:52:59.354247 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:52:59.354247 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:52:59.354247 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:52:59.354247 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:52:59.354247 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:52:59.354247 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:52:59.354247 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:52:59.354247 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:52:59.354247 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:52:59.354247 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:52:59.355676 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 20:52:59.355676 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 20:52:59.355676 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Oct 08 20:52:59.355676 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Oct 08 20:52:59.355676 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 20:52:59.355676 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 20:52:59.355676 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2472eefe-06cf-4240-aebe-cc350a2ddac1 could not be found. Oct 08 20:52:59.355676 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:52:59.355676 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:52:59.355676 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:52:59.355676 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:52:59.355676 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:52:59.355676 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:52:59.355676 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 20:52:59.355676 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 20:52:59.355676 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2472eefe-06cf-4240-aebe-cc350a2ddac1 could not be found. Oct 08 20:52:59.355676 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:52:59.356672 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-756493df-a8e0-4850-8930-f84561e03027 tempest-ServersAdminNegativeTestJSON-1595191754 tempest-ServersAdminNegativeTestJSON-1595191754-project-admin] Returning 404 to user: Instance 2472eefe-06cf-4240-aebe-cc350a2ddac1 could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:52:59.356672 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-756493df-a8e0-4850-8930-f84561e03027 tempest-ServersAdminNegativeTestJSON-1595191754 tempest-ServersAdminNegativeTestJSON-1595191754-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/2472eefe-06cf-4240-aebe-cc350a2ddac1/action" status: 404 len: 111 microversion: 2.1 time: 0.642436 Oct 08 20:52:59.360610 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-298152d3-03d9-42ba-845d-ef6066822e25 tempest-ServersWithSpecificFlavorTestJSON-750818918 tempest-ServersWithSpecificFlavorTestJSON-750818918-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.024647 Oct 08 20:52:59.361857 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 224/462] 10.222.0.26 () {58 vars in 1182 bytes} [Sat Oct 8 20:52:59 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 08 20:52:59.366854 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-15084b4e-2f58-4953-9bfa-7d2d5318eff3 tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:59.368278 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-15084b4e-2f58-4953-9bfa-7d2d5318eff3 tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] [instance: 1af12bcb-5e2a-4c15-8673-fa41701cb4c7] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:52:59.371588 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 239/463] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 20:52:58 2022] POST /compute/v2.1/servers/2472eefe-06cf-4240-aebe-cc350a2ddac1/action => generated 111 bytes in 661 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 20:52:59.380848 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-5565a98e-fc60-4a9e-bdf9-d8810c62b78b tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:52:59.383062 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-5565a98e-fc60-4a9e-bdf9-d8810c62b78b tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] [instance: 5c864780-3998-4a09-95d4-e000a02af71e] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:52:59.385016 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-15084b4e-2f58-4953-9bfa-7d2d5318eff3 tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:59.385760 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-15084b4e-2f58-4953-9bfa-7d2d5318eff3 tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:59.386317 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-15084b4e-2f58-4953-9bfa-7d2d5318eff3 tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:59.387229 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-15084b4e-2f58-4953-9bfa-7d2d5318eff3 tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:52:59.388173 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-15084b4e-2f58-4953-9bfa-7d2d5318eff3 tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:52:59.389152 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-15084b4e-2f58-4953-9bfa-7d2d5318eff3 tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:52:59.707412 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.objects.instance [None req-15084b4e-2f58-4953-9bfa-7d2d5318eff3 tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Lazy-loading 'services' on Instance uuid 1af12bcb-5e2a-4c15-8673-fa41701cb4c7 {{(pid=140491) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 20:52:59.832279 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-5565a98e-fc60-4a9e-bdf9-d8810c62b78b tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef659f5a1a24c439528a7675bdd70f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c92fe04ab8248399d0acb932f82d607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:52:59.836356 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-15084b4e-2f58-4953-9bfa-7d2d5318eff3 tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/1af12bcb-5e2a-4c15-8673-fa41701cb4c7" status: 200 len: 1929 microversion: 2.75 time: 0.472965 Oct 08 20:52:59.836968 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 225/464] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:52:59 2022] GET /compute/v2.1/servers/1af12bcb-5e2a-4c15-8673-fa41701cb4c7 => generated 1929 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:52:59.844429 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-5565a98e-fc60-4a9e-bdf9-d8810c62b78b tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] 10.222.0.26 "GET /compute/v2.1/servers/5c864780-3998-4a09-95d4-e000a02af71e" status: 200 len: 1213 microversion: 2.1 time: 0.471290 Oct 08 20:52:59.845107 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 240/465] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:52:59 2022] GET /compute/v2.1/servers/5c864780-3998-4a09-95d4-e000a02af71e => generated 1213 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:52:59.881056 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-112dcb1b-a45d-488a-85e6-cd14cb2b0b6c tempest-ServersWithSpecificFlavorTestJSON-750818918 tempest-ServersWithSpecificFlavorTestJSON-750818918-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-2029723605", "id": 172903658, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:52:59.963751 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-112dcb1b-a45d-488a-85e6-cd14cb2b0b6c tempest-ServersWithSpecificFlavorTestJSON-750818918 tempest-ServersWithSpecificFlavorTestJSON-750818918-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 422 microversion: 2.1 time: 0.116282 Oct 08 20:52:59.974259 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 241/466] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 20:52:59 2022] POST /compute/v2.1/flavors => generated 422 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:52:59.994212 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-cb18b29d-b552-4a03-902f-ea6f311d2ed8 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-749529197", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:53:00.119717 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.network.neutron [None req-cb18b29d-b552-4a03-902f-ea6f311d2ed8 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] validate_networks() for None {{(pid=140492) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 20:53:00.515637 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-a23ab992-3c3e-4a4f-9beb-9a3adab708a2 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-765386798", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "networks": [{"uuid": "2de46f56-45d8-40d9-8d29-d806b680f627"}]}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:53:00.629274 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.network.neutron [None req-a23ab992-3c3e-4a4f-9beb-9a3adab708a2 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] validate_networks() for [('2de46f56-45d8-40d9-8d29-d806b680f627', None, None, None, None, None)] {{(pid=140491) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 20:53:00.733509 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-cb18b29d-b552-4a03-902f-ea6f311d2ed8 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Flavor limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 20:53:00.734243 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-cb18b29d-b552-4a03-902f-ea6f311d2ed8 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Image limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 20:53:00.735024 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-cb18b29d-b552-4a03-902f-ea6f311d2ed8 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Flavor pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 20:53:00.735601 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-cb18b29d-b552-4a03-902f-ea6f311d2ed8 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Image pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 20:53:00.736556 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-cb18b29d-b552-4a03-902f-ea6f311d2ed8 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 20:53:00.754824 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cb18b29d-b552-4a03-902f-ea6f311d2ed8 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:00.755229 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cb18b29d-b552-4a03-902f-ea6f311d2ed8 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:00.757270 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cb18b29d-b552-4a03-902f-ea6f311d2ed8 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:00.762010 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cb18b29d-b552-4a03-902f-ea6f311d2ed8 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:00.762761 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cb18b29d-b552-4a03-902f-ea6f311d2ed8 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:00.765634 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cb18b29d-b552-4a03-902f-ea6f311d2ed8 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:00.792610 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-cb18b29d-b552-4a03-902f-ea6f311d2ed8 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Getting quotas for project 6d702b3083bc4cf5ba6b6fc6f3c3147e. Resources: {'cores', 'instances', 'ram'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 20:53:00.799225 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-cb18b29d-b552-4a03-902f-ea6f311d2ed8 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Getting quotas for user 360660f7bb4746c8b1397f4857f423f2 and project 6d702b3083bc4cf5ba6b6fc6f3c3147e. Resources: {'cores', 'instances', 'ram'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 20:53:00.819255 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-cb18b29d-b552-4a03-902f-ea6f311d2ed8 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Going to run 1 instances... {{(pid=140492) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 20:53:00.822269 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-cb18b29d-b552-4a03-902f-ea6f311d2ed8 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] [instance: 6de2ea26-e774-47b5-8506-b3ebbc2d1712] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c508bd7f-7db9-4b2c-af7c-be54a855c355',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140492) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 20:53:00.896185 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-cb18b29d-b552-4a03-902f-ea6f311d2ed8 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.927682 Oct 08 20:53:00.899946 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 242/467] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 20:52:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 932 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 08 20:53:00.909995 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-53c9afb9-cd33-4a00-9563-00a1d71a42ff tempest-ServersWithSpecificFlavorTestJSON-750818918 tempest-ServersWithSpecificFlavorTestJSON-750818918-project-admin] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:00.933134 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-53c9afb9-cd33-4a00-9563-00a1d71a42ff tempest-ServersWithSpecificFlavorTestJSON-750818918 tempest-ServersWithSpecificFlavorTestJSON-750818918-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.030995 Oct 08 20:53:00.934015 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 243/468] 10.222.0.26 () {58 vars in 1182 bytes} [Sat Oct 8 20:53:00 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 08 20:53:01.276850 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-019ef244-7384-4cf3-a97e-b2ee6c776ae3 tempest-HypervisorAdminNegativeTestJSON-969913999 tempest-HypervisorAdminNegativeTestJSON-969913999-project] Calling method '.version_select at 0x7f1a8cf908b0>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:01.279049 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-019ef244-7384-4cf3-a97e-b2ee6c776ae3 tempest-HypervisorAdminNegativeTestJSON-969913999 tempest-HypervisorAdminNegativeTestJSON-969913999-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': 'e69b3444633b4feb8c23c06e86f20929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae60f71bc734a5d8d37eaba4078fc19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:53:01.282346 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-019ef244-7384-4cf3-a97e-b2ee6c776ae3 tempest-HypervisorAdminNegativeTestJSON-969913999 tempest-HypervisorAdminNegativeTestJSON-969913999-project] Request method failure captured: Oct 08 20:53:01.282346 ncdv-master-1 devstack@n-api.service[140492]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Oct 08 20:53:01.282346 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 20:53:01.282346 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 20:53:01.282346 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 20:53:01.282346 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 20:53:01.282346 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 20:53:01.282346 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 20:53:01.282346 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 20:53:01.282346 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 20:53:01.282346 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeMpYBFbZ3I2kobdlGQavYTDD0nLipZIhLb97sW76ZP6ztniwetGYPv21YpXcm4-uD_iHTAXc-FwhGC8lh4pKgK_HfTu73tEfaThDODxLcM_VyveFORZLEXSnRZ6WQV72PBA3y8HfFgcPbq1PsEHPfypM_oXsi8fYmBPWU01fkrLsos Oct 08 20:53:01.282346 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 20:53:01.282346 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 20:53:01.282346 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 20:53:01.282346 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 20:53:01.282346 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 20:53:01.282346 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 20:53:01.282346 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 8ae60f71bc734a5d8d37eaba4078fc19 Oct 08 20:53:01.282346 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-969913999 Oct 08 20:53:01.282346 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 20:53:01.282346 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 20:53:01.283949 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8ae60f71bc734a5d8d37eaba4078fc19"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8ae60f71bc734a5d8d37eaba4078fc19"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8ae60f71bc734a5d8d37eaba4078fc19"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8ae60f71bc734a5d8d37eaba4078fc19"}]}] Oct 08 20:53:01.283949 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-969913999 Oct 08 20:53:01.283949 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 8ae60f71bc734a5d8d37eaba4078fc19 Oct 08 20:53:01.283949 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-969913999 Oct 08 20:53:01.283949 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-HypervisorAdminNegativeTestJSON-969913999-project Oct 08 20:53:01.283949 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 20:53:01.283949 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 20:53:01.283949 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: e69b3444633b4feb8c23c06e86f20929 Oct 08 20:53:01.283949 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-969913999-project Oct 08 20:53:01.283949 ncdv-master-1 devstack@n-api.service[140492]: method: Oct 08 20:53:01.283949 ncdv-master-1 devstack@n-api.service[140492]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 08 20:53:01.283949 ncdv-master-1 devstack@n-api.service[140492]: action_args: {} Oct 08 20:53:01.283949 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:53:01.285232 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:53:01.285232 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:53:01.285232 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:53:01.285232 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:53:01.285232 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:53:01.285232 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 08 20:53:01.285232 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 08 20:53:01.285232 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:53:01.285232 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:53:01.285232 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Oct 08 20:53:01.285232 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return self._detail(req) Oct 08 20:53:01.285232 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Oct 08 20:53:01.285232 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Oct 08 20:53:01.285232 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 08 20:53:01.285232 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 08 20:53:01.285232 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 08 20:53:01.285232 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 08 20:53:01.285232 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 08 20:53:01.285232 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 08 20:53:01.286393 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 08 20:53:01.286393 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise self.value Oct 08 20:53:01.286393 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 08 20:53:01.286393 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 08 20:53:01.286393 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 08 20:53:01.286393 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 08 20:53:01.286393 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 08 20:53:01.286393 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 08 20:53:01.286393 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 08 20:53:01.286393 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:53:01.286393 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:53:01.286393 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:53:01.286393 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:53:01.286393 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:53:01.286393 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:53:01.286393 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 08 20:53:01.286393 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 08 20:53:01.286393 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 08 20:53:01.286393 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:53:01.288821 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-019ef244-7384-4cf3-a97e-b2ee6c776ae3 tempest-HypervisorAdminNegativeTestJSON-969913999 tempest-HypervisorAdminNegativeTestJSON-969913999-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:53:01.289926 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-019ef244-7384-4cf3-a97e-b2ee6c776ae3 tempest-HypervisorAdminNegativeTestJSON-969913999 tempest-HypervisorAdminNegativeTestJSON-969913999-project] 10.222.0.26 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.353640 Oct 08 20:53:01.291045 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 244/469] 10.222.0.26 () {58 vars in 1167 bytes} [Sat Oct 8 20:53:00 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 356 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 08 20:53:01.296581 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-49785a81-d3cf-4249-97e8-d2344c7b7809 tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:01.297560 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-49785a81-d3cf-4249-97e8-d2344c7b7809 tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] [instance: 8216e713-dfa1-4625-b8ea-5869cf617f4f] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:53:01.304523 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-49785a81-d3cf-4249-97e8-d2344c7b7809 tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:01.305494 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-49785a81-d3cf-4249-97e8-d2344c7b7809 tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:01.306156 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-49785a81-d3cf-4249-97e8-d2344c7b7809 tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:01.307088 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-49785a81-d3cf-4249-97e8-d2344c7b7809 tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:01.308030 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-49785a81-d3cf-4249-97e8-d2344c7b7809 tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:01.308676 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-49785a81-d3cf-4249-97e8-d2344c7b7809 tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:01.882823 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-49785a81-d3cf-4249-97e8-d2344c7b7809 tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd637d2fa21649a1b00f27e7d86f3003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d547f95cc6043b0bb9b6a94b2e354a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:53:01.891845 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-49785a81-d3cf-4249-97e8-d2344c7b7809 tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] 10.222.0.26 "GET /compute/v2.1/servers/8216e713-dfa1-4625-b8ea-5869cf617f4f" status: 200 len: 1314 microversion: 2.1 time: 0.599432 Oct 08 20:53:01.892425 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 245/470] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:53:01 2022] GET /compute/v2.1/servers/8216e713-dfa1-4625-b8ea-5869cf617f4f => generated 1314 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:53:01.913899 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-cfc08302-5462-4307-864a-6a4230c18f07 tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:01.915486 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-cfc08302-5462-4307-864a-6a4230c18f07 tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] [instance: 1af12bcb-5e2a-4c15-8673-fa41701cb4c7] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:53:01.928464 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cfc08302-5462-4307-864a-6a4230c18f07 tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:01.932753 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cfc08302-5462-4307-864a-6a4230c18f07 tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:01.933440 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cfc08302-5462-4307-864a-6a4230c18f07 tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:01.934476 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cfc08302-5462-4307-864a-6a4230c18f07 tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:01.935152 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cfc08302-5462-4307-864a-6a4230c18f07 tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:01.935921 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cfc08302-5462-4307-864a-6a4230c18f07 tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:02.006061 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-a23ab992-3c3e-4a4f-9beb-9a3adab708a2 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Flavor limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 20:53:02.008022 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-a23ab992-3c3e-4a4f-9beb-9a3adab708a2 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Image limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 20:53:02.008530 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-a23ab992-3c3e-4a4f-9beb-9a3adab708a2 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Flavor pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 20:53:02.008945 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-a23ab992-3c3e-4a4f-9beb-9a3adab708a2 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Image pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 20:53:02.009848 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-a23ab992-3c3e-4a4f-9beb-9a3adab708a2 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 20:53:02.028589 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a23ab992-3c3e-4a4f-9beb-9a3adab708a2 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:02.029501 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a23ab992-3c3e-4a4f-9beb-9a3adab708a2 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:02.030741 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a23ab992-3c3e-4a4f-9beb-9a3adab708a2 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:02.031774 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a23ab992-3c3e-4a4f-9beb-9a3adab708a2 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:02.032463 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a23ab992-3c3e-4a4f-9beb-9a3adab708a2 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:02.035096 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a23ab992-3c3e-4a4f-9beb-9a3adab708a2 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:02.045577 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=100 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:53:02.064541 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-a23ab992-3c3e-4a4f-9beb-9a3adab708a2 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Getting quotas for project 6ecc2dd2407b4819874bed09cb27959a. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 20:53:02.070925 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-a23ab992-3c3e-4a4f-9beb-9a3adab708a2 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Getting quotas for user 474ca64d1b1d4e30916b517645aba882 and project 6ecc2dd2407b4819874bed09cb27959a. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 20:53:02.094943 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-a23ab992-3c3e-4a4f-9beb-9a3adab708a2 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Going to run 1 instances... {{(pid=140491) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 20:53:02.099110 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-a23ab992-3c3e-4a4f-9beb-9a3adab708a2 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] [instance: 279361ef-2171-49e1-9f33-eadbf5dc0313] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c508bd7f-7db9-4b2c-af7c-be54a855c355',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140491) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 20:53:02.175027 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-a23ab992-3c3e-4a4f-9beb-9a3adab708a2 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.333704 Oct 08 20:53:02.176709 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 226/471] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 20:52:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 2339 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 08 20:53:02.182738 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-fb605885-8730-4588-8b68-26f87a8f69d7 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:02.183690 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-fb605885-8730-4588-8b68-26f87a8f69d7 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] [instance: 5c864780-3998-4a09-95d4-e000a02af71e] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:53:02.193482 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fb605885-8730-4588-8b68-26f87a8f69d7 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:02.194038 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fb605885-8730-4588-8b68-26f87a8f69d7 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:02.194518 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fb605885-8730-4588-8b68-26f87a8f69d7 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:02.195238 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fb605885-8730-4588-8b68-26f87a8f69d7 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:02.195710 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fb605885-8730-4588-8b68-26f87a8f69d7 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:02.196146 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fb605885-8730-4588-8b68-26f87a8f69d7 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:02.280528 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-fb605885-8730-4588-8b68-26f87a8f69d7 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef659f5a1a24c439528a7675bdd70f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c92fe04ab8248399d0acb932f82d607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:53:02.293250 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-fb605885-8730-4588-8b68-26f87a8f69d7 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] 10.222.0.26 "GET /compute/v2.1/servers/5c864780-3998-4a09-95d4-e000a02af71e" status: 200 len: 1271 microversion: 2.1 time: 0.114931 Oct 08 20:53:02.293788 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 227/472] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:53:02 2022] GET /compute/v2.1/servers/5c864780-3998-4a09-95d4-e000a02af71e => generated 1271 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:53:02.322554 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.objects.instance [None req-cfc08302-5462-4307-864a-6a4230c18f07 tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Lazy-loading 'services' on Instance uuid 1af12bcb-5e2a-4c15-8673-fa41701cb4c7 {{(pid=140492) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 20:53:02.329727 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-1c9acf73-3bbb-49d9-85cf-b99627d547e1 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:02.330350 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-1c9acf73-3bbb-49d9-85cf-b99627d547e1 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] [instance: 6de2ea26-e774-47b5-8506-b3ebbc2d1712] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:53:02.354433 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1c9acf73-3bbb-49d9-85cf-b99627d547e1 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:02.354945 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1c9acf73-3bbb-49d9-85cf-b99627d547e1 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:02.359915 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1c9acf73-3bbb-49d9-85cf-b99627d547e1 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:02.360895 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1c9acf73-3bbb-49d9-85cf-b99627d547e1 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:02.361889 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1c9acf73-3bbb-49d9-85cf-b99627d547e1 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:02.362538 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1c9acf73-3bbb-49d9-85cf-b99627d547e1 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:02.375409 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-cfc08302-5462-4307-864a-6a4230c18f07 tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/1af12bcb-5e2a-4c15-8673-fa41701cb4c7" status: 200 len: 1929 microversion: 2.75 time: 0.481859 Oct 08 20:53:02.389597 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 246/473] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:53:01 2022] GET /compute/v2.1/servers/1af12bcb-5e2a-4c15-8673-fa41701cb4c7 => generated 1929 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:53:02.400112 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-def32e66-6b00-475d-a84b-5daa0bd5e5f0 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Action: 'create', calling method: .version_select at 0x7f1a8cf68310>, body: {"keypair": {"name": "tempest-keypair-220477781", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCmVcs0QGSg45rZj3TwpfrIb1AwGWXW7+od92Oy4viGIx/PYWC+sQRpMIcWCLcDXN64WOClnHt7aZ5lqD7ln6zmakx67pO+BJdsOdGvWL80lOAnJjqEl8iGh2Bz2BCvBSA=="}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:53:02.471337 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-def32e66-6b00-475d-a84b-5daa0bd5e5f0 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Getting quotas for project 3f2441394d754f499e27f6f35d5b3afa. Resources: {'key_pairs'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 20:53:02.508520 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-def32e66-6b00-475d-a84b-5daa0bd5e5f0 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Getting quotas for user 98936da9b5d94165b386d2d0893ac142 and project 3f2441394d754f499e27f6f35d5b3afa. Resources: {'key_pairs'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 20:53:02.543808 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-1c9acf73-3bbb-49d9-85cf-b99627d547e1 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '360660f7bb4746c8b1397f4857f423f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d702b3083bc4cf5ba6b6fc6f3c3147e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:53:02.575047 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-1c9acf73-3bbb-49d9-85cf-b99627d547e1 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] 10.222.0.26 "GET /compute/v2.1/servers/6de2ea26-e774-47b5-8506-b3ebbc2d1712" status: 200 len: 1273 microversion: 2.1 time: 0.255436 Oct 08 20:53:02.579937 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 228/474] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:53:02 2022] GET /compute/v2.1/servers/6de2ea26-e774-47b5-8506-b3ebbc2d1712 => generated 1273 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:53:02.589506 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-fb077a54-821a-4c8a-936d-5f275ea3748b tempest-HypervisorAdminNegativeTestJSON-969913999 tempest-HypervisorAdminNegativeTestJSON-969913999-project] Calling method '.version_select at 0x7f1a8d31d9d0>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:02.591936 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-fb077a54-821a-4c8a-936d-5f275ea3748b tempest-HypervisorAdminNegativeTestJSON-969913999 tempest-HypervisorAdminNegativeTestJSON-969913999-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': 'e69b3444633b4feb8c23c06e86f20929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae60f71bc734a5d8d37eaba4078fc19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:53:02.595598 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-fb077a54-821a-4c8a-936d-5f275ea3748b tempest-HypervisorAdminNegativeTestJSON-969913999 tempest-HypervisorAdminNegativeTestJSON-969913999-project] Request method failure captured: Oct 08 20:53:02.595598 ncdv-master-1 devstack@n-api.service[140491]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Oct 08 20:53:02.595598 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 20:53:02.595598 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 20:53:02.595598 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 20:53:02.595598 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 20:53:02.595598 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 20:53:02.595598 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 20:53:02.595598 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 20:53:02.595598 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 20:53:02.595598 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeMpYBFbZ3I2kobdlGQavYTDD0nLipZIhLb97sW76ZP6ztniwetGYPv21YpXcm4-uD_iHTAXc-FwhGC8lh4pKgK_HfTu73tEfaThDODxLcM_VyveFORZLEXSnRZ6WQV72PBA3y8HfFgcPbq1PsEHPfypM_oXsi8fYmBPWU01fkrLsos Oct 08 20:53:02.595598 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 20:53:02.595598 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 20:53:02.595598 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 20:53:02.595598 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 20:53:02.595598 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 20:53:02.595598 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 20:53:02.595598 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 8ae60f71bc734a5d8d37eaba4078fc19 Oct 08 20:53:02.595598 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-969913999 Oct 08 20:53:02.595598 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 20:53:02.595598 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 20:53:02.597085 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8ae60f71bc734a5d8d37eaba4078fc19"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8ae60f71bc734a5d8d37eaba4078fc19"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8ae60f71bc734a5d8d37eaba4078fc19"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8ae60f71bc734a5d8d37eaba4078fc19"}]}] Oct 08 20:53:02.597085 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-969913999 Oct 08 20:53:02.597085 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 8ae60f71bc734a5d8d37eaba4078fc19 Oct 08 20:53:02.597085 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-969913999 Oct 08 20:53:02.597085 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-HypervisorAdminNegativeTestJSON-969913999-project Oct 08 20:53:02.597085 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 20:53:02.597085 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 20:53:02.597085 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: e69b3444633b4feb8c23c06e86f20929 Oct 08 20:53:02.597085 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-969913999-project Oct 08 20:53:02.597085 ncdv-master-1 devstack@n-api.service[140491]: method: Oct 08 20:53:02.597085 ncdv-master-1 devstack@n-api.service[140491]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 08 20:53:02.597085 ncdv-master-1 devstack@n-api.service[140491]: action_args: {} Oct 08 20:53:02.597085 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:53:02.598083 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:53:02.598083 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:53:02.598083 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:53:02.598083 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:53:02.598083 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:53:02.598083 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 08 20:53:02.598083 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 08 20:53:02.598083 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:53:02.598083 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:53:02.598083 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Oct 08 20:53:02.598083 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return self._index(req) Oct 08 20:53:02.598083 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Oct 08 20:53:02.598083 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Oct 08 20:53:02.598083 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 08 20:53:02.598083 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 08 20:53:02.598083 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 08 20:53:02.598083 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 08 20:53:02.598083 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 08 20:53:02.598083 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 08 20:53:02.599364 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 08 20:53:02.599364 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise self.value Oct 08 20:53:02.599364 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 08 20:53:02.599364 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 08 20:53:02.599364 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 08 20:53:02.599364 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 08 20:53:02.599364 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 08 20:53:02.599364 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 08 20:53:02.599364 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 08 20:53:02.599364 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:53:02.599364 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:53:02.599364 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:53:02.599364 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:53:02.599364 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:53:02.599364 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:53:02.599364 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 08 20:53:02.599364 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 08 20:53:02.599364 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 08 20:53:02.599364 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:53:02.609018 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-def32e66-6b00-475d-a84b-5daa0bd5e5f0 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.208679 Oct 08 20:53:02.609018 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 247/475] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Oct 8 20:53:02 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:53:02.612298 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-fb077a54-821a-4c8a-936d-5f275ea3748b tempest-HypervisorAdminNegativeTestJSON-969913999 tempest-HypervisorAdminNegativeTestJSON-969913999-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:53:02.613527 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-fb077a54-821a-4c8a-936d-5f275ea3748b tempest-HypervisorAdminNegativeTestJSON-969913999 tempest-HypervisorAdminNegativeTestJSON-969913999-project] 10.222.0.26 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.031150 Oct 08 20:53:02.614666 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 229/476] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Oct 8 20:53:02 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 34 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 08 20:53:02.628661 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-1fb51364-31cf-4f07-9c61-cd11c3fb7b74 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:02.629595 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-1fb51364-31cf-4f07-9c61-cd11c3fb7b74 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] [instance: 279361ef-2171-49e1-9f33-eadbf5dc0313] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:53:02.796896 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-1fb51364-31cf-4f07-9c61-cd11c3fb7b74 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474ca64d1b1d4e30916b517645aba882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecc2dd2407b4819874bed09cb27959a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:53:02.811165 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-1fb51364-31cf-4f07-9c61-cd11c3fb7b74 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] 10.222.0.26 "GET /compute/v2.1/servers/279361ef-2171-49e1-9f33-eadbf5dc0313" status: 200 len: 1210 microversion: 2.1 time: 0.195033 Oct 08 20:53:02.814446 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 230/477] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:53:02 2022] GET /compute/v2.1/servers/279361ef-2171-49e1-9f33-eadbf5dc0313 => generated 1210 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:53:02.856685 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-8f6225f6-21c7-482d-bee1-c30ff7162930 tempest-HypervisorAdminNegativeTestJSON-969913999 tempest-HypervisorAdminNegativeTestJSON-969913999-project] Calling method '.version_select at 0x7f1a8d155550>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:02.869543 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-8f6225f6-21c7-482d-bee1-c30ff7162930 tempest-HypervisorAdminNegativeTestJSON-969913999 tempest-HypervisorAdminNegativeTestJSON-969913999-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': 'e69b3444633b4feb8c23c06e86f20929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae60f71bc734a5d8d37eaba4078fc19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:53:02.881576 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-8f6225f6-21c7-482d-bee1-c30ff7162930 tempest-HypervisorAdminNegativeTestJSON-969913999 tempest-HypervisorAdminNegativeTestJSON-969913999-project] Request method failure captured: Oct 08 20:53:02.881576 ncdv-master-1 devstack@n-api.service[140491]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Oct 08 20:53:02.881576 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 20:53:02.881576 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 20:53:02.881576 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 20:53:02.881576 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 20:53:02.881576 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 20:53:02.881576 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 20:53:02.881576 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 20:53:02.881576 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 20:53:02.881576 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeMpYBFbZ3I2kobdlGQavYTDD0nLipZIhLb97sW76ZP6ztniwetGYPv21YpXcm4-uD_iHTAXc-FwhGC8lh4pKgK_HfTu73tEfaThDODxLcM_VyveFORZLEXSnRZ6WQV72PBA3y8HfFgcPbq1PsEHPfypM_oXsi8fYmBPWU01fkrLsos Oct 08 20:53:02.881576 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 20:53:02.881576 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 20:53:02.881576 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 20:53:02.881576 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 20:53:02.881576 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 20:53:02.881576 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 20:53:02.881576 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 8ae60f71bc734a5d8d37eaba4078fc19 Oct 08 20:53:02.881576 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-969913999 Oct 08 20:53:02.881576 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 20:53:02.881576 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 20:53:02.883252 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8ae60f71bc734a5d8d37eaba4078fc19"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8ae60f71bc734a5d8d37eaba4078fc19"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8ae60f71bc734a5d8d37eaba4078fc19"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8ae60f71bc734a5d8d37eaba4078fc19"}]}] Oct 08 20:53:02.883252 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-969913999 Oct 08 20:53:02.883252 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 8ae60f71bc734a5d8d37eaba4078fc19 Oct 08 20:53:02.883252 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-969913999 Oct 08 20:53:02.883252 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-HypervisorAdminNegativeTestJSON-969913999-project Oct 08 20:53:02.883252 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 20:53:02.883252 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 20:53:02.883252 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: e69b3444633b4feb8c23c06e86f20929 Oct 08 20:53:02.883252 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-969913999-project Oct 08 20:53:02.883252 ncdv-master-1 devstack@n-api.service[140491]: method: Oct 08 20:53:02.883252 ncdv-master-1 devstack@n-api.service[140491]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 08 20:53:02.883252 ncdv-master-1 devstack@n-api.service[140491]: action_args: {} Oct 08 20:53:02.883252 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:53:02.884156 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:53:02.884156 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:53:02.884156 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:53:02.884156 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:53:02.884156 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:53:02.884156 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 08 20:53:02.884156 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 08 20:53:02.884156 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:53:02.884156 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:53:02.884156 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Oct 08 20:53:02.884156 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Oct 08 20:53:02.884156 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 08 20:53:02.884156 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 08 20:53:02.884156 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 08 20:53:02.884156 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 08 20:53:02.884156 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 08 20:53:02.884156 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 08 20:53:02.884156 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 08 20:53:02.884156 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise self.value Oct 08 20:53:02.888483 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 08 20:53:02.888483 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 08 20:53:02.888483 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 08 20:53:02.888483 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 08 20:53:02.888483 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 08 20:53:02.888483 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 08 20:53:02.888483 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 08 20:53:02.888483 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:53:02.888483 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:53:02.888483 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:53:02.888483 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:53:02.888483 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:53:02.888483 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:53:02.888483 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 08 20:53:02.888483 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 08 20:53:02.888483 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 08 20:53:02.888483 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:53:02.892489 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-8f6225f6-21c7-482d-bee1-c30ff7162930 tempest-HypervisorAdminNegativeTestJSON-969913999 tempest-HypervisorAdminNegativeTestJSON-969913999-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:53:02.898112 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-8f6225f6-21c7-482d-bee1-c30ff7162930 tempest-HypervisorAdminNegativeTestJSON-969913999 tempest-HypervisorAdminNegativeTestJSON-969913999-project] 10.222.0.26 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.082324 Oct 08 20:53:02.902854 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 231/478] 10.222.0.26 () {58 vars in 1179 bytes} [Sat Oct 8 20:53:02 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 88 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 08 20:53:03.088871 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-7f140689-a1ab-44e6-8755-0f4eb0968c92 tempest-FlavorsExtraSpecsTestJSON-610693945 tempest-FlavorsExtraSpecsTestJSON-610693945-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1021125699", "ram": 512, "vcpus": 1, "disk": 10, "id": 221179339, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:53:03.136326 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-7f140689-a1ab-44e6-8755-0f4eb0968c92 tempest-FlavorsExtraSpecsTestJSON-610693945 tempest-FlavorsExtraSpecsTestJSON-610693945-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.535152 Oct 08 20:53:03.137096 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 248/479] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 20:53:02 2022] POST /compute/v2.1/flavors => generated 413 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:53:03.145433 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-f10d5b07-eece-435c-8f1d-80d58559b7e7 tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:03.146081 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-f10d5b07-eece-435c-8f1d-80d58559b7e7 tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] [instance: 8216e713-dfa1-4625-b8ea-5869cf617f4f] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:53:03.160814 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f10d5b07-eece-435c-8f1d-80d58559b7e7 tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:03.161345 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f10d5b07-eece-435c-8f1d-80d58559b7e7 tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:03.161802 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f10d5b07-eece-435c-8f1d-80d58559b7e7 tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:03.162544 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f10d5b07-eece-435c-8f1d-80d58559b7e7 tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:03.167380 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f10d5b07-eece-435c-8f1d-80d58559b7e7 tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:03.168018 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f10d5b07-eece-435c-8f1d-80d58559b7e7 tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:03.362455 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-b2127bcf-6f08-4629-8c5f-796b9adc5119 tempest-HypervisorAdminNegativeTestJSON-100808664 tempest-HypervisorAdminNegativeTestJSON-100808664-project-admin] Calling method '.version_select at 0x7f1a8d22b310>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:03.366875 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b2127bcf-6f08-4629-8c5f-796b9adc5119 tempest-HypervisorAdminNegativeTestJSON-100808664 tempest-HypervisorAdminNegativeTestJSON-100808664-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:03.372406 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b2127bcf-6f08-4629-8c5f-796b9adc5119 tempest-HypervisorAdminNegativeTestJSON-100808664 tempest-HypervisorAdminNegativeTestJSON-100808664-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:03.373458 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b2127bcf-6f08-4629-8c5f-796b9adc5119 tempest-HypervisorAdminNegativeTestJSON-100808664 tempest-HypervisorAdminNegativeTestJSON-100808664-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:03.419180 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b2127bcf-6f08-4629-8c5f-796b9adc5119 tempest-HypervisorAdminNegativeTestJSON-100808664 tempest-HypervisorAdminNegativeTestJSON-100808664-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:03.420266 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b2127bcf-6f08-4629-8c5f-796b9adc5119 tempest-HypervisorAdminNegativeTestJSON-100808664 tempest-HypervisorAdminNegativeTestJSON-100808664-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:03.423223 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b2127bcf-6f08-4629-8c5f-796b9adc5119 tempest-HypervisorAdminNegativeTestJSON-100808664 tempest-HypervisorAdminNegativeTestJSON-100808664-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:03.452189 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b2127bcf-6f08-4629-8c5f-796b9adc5119 tempest-HypervisorAdminNegativeTestJSON-100808664 tempest-HypervisorAdminNegativeTestJSON-100808664-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:03.452692 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b2127bcf-6f08-4629-8c5f-796b9adc5119 tempest-HypervisorAdminNegativeTestJSON-100808664 tempest-HypervisorAdminNegativeTestJSON-100808664-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:03.453134 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b2127bcf-6f08-4629-8c5f-796b9adc5119 tempest-HypervisorAdminNegativeTestJSON-100808664 tempest-HypervisorAdminNegativeTestJSON-100808664-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:03.471556 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-b2127bcf-6f08-4629-8c5f-796b9adc5119 tempest-HypervisorAdminNegativeTestJSON-100808664 tempest-HypervisorAdminNegativeTestJSON-100808664-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.559726 Oct 08 20:53:03.472153 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 232/480] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Oct 8 20:53:02 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:53:03.498159 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-86850ced-0c7a-4ad0-8091-8c6dd18807d0 tempest-FlavorsExtraSpecsTestJSON-610693945 tempest-FlavorsExtraSpecsTestJSON-610693945-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:53:03.534503 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-86850ced-0c7a-4ad0-8091-8c6dd18807d0 tempest-FlavorsExtraSpecsTestJSON-610693945 tempest-FlavorsExtraSpecsTestJSON-610693945-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors/221179339/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.039665 Oct 08 20:53:03.535703 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 233/481] 10.222.0.26 () {60 vars in 1221 bytes} [Sat Oct 8 20:53:03 2022] POST /compute/v2.1/flavors/221179339/os-extra_specs => generated 66 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 08 20:53:03.545742 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-5eccf40b-2439-4c79-bd92-e3cc9cc2023d tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:03.548491 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-5eccf40b-2439-4c79-bd92-e3cc9cc2023d tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] [instance: 5c864780-3998-4a09-95d4-e000a02af71e] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:53:03.580828 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5eccf40b-2439-4c79-bd92-e3cc9cc2023d tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:03.582986 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5eccf40b-2439-4c79-bd92-e3cc9cc2023d tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:03.583461 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5eccf40b-2439-4c79-bd92-e3cc9cc2023d tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:03.584234 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5eccf40b-2439-4c79-bd92-e3cc9cc2023d tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:03.584707 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5eccf40b-2439-4c79-bd92-e3cc9cc2023d tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:03.585954 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5eccf40b-2439-4c79-bd92-e3cc9cc2023d tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:03.680641 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-f10d5b07-eece-435c-8f1d-80d58559b7e7 tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd637d2fa21649a1b00f27e7d86f3003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d547f95cc6043b0bb9b6a94b2e354a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:53:03.690875 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-f10d5b07-eece-435c-8f1d-80d58559b7e7 tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] 10.222.0.26 "GET /compute/v2.1/servers/8216e713-dfa1-4625-b8ea-5869cf617f4f" status: 200 len: 1314 microversion: 2.1 time: 0.552549 Oct 08 20:53:03.695806 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 249/482] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:53:03 2022] GET /compute/v2.1/servers/8216e713-dfa1-4625-b8ea-5869cf617f4f => generated 1314 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:53:03.709556 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-f58e0ffb-6f35-4f45-b69e-ebe13266bd8d tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:03.710422 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-f58e0ffb-6f35-4f45-b69e-ebe13266bd8d tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] [instance: 1af12bcb-5e2a-4c15-8673-fa41701cb4c7] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:53:03.725597 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f58e0ffb-6f35-4f45-b69e-ebe13266bd8d tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:03.726210 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f58e0ffb-6f35-4f45-b69e-ebe13266bd8d tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:03.732584 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f58e0ffb-6f35-4f45-b69e-ebe13266bd8d tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:03.732977 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-5eccf40b-2439-4c79-bd92-e3cc9cc2023d tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef659f5a1a24c439528a7675bdd70f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c92fe04ab8248399d0acb932f82d607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:53:03.734181 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f58e0ffb-6f35-4f45-b69e-ebe13266bd8d tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:03.734769 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f58e0ffb-6f35-4f45-b69e-ebe13266bd8d tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:03.735320 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f58e0ffb-6f35-4f45-b69e-ebe13266bd8d tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:03.750902 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-5eccf40b-2439-4c79-bd92-e3cc9cc2023d tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] 10.222.0.26 "GET /compute/v2.1/servers/5c864780-3998-4a09-95d4-e000a02af71e" status: 200 len: 1271 microversion: 2.1 time: 0.211266 Oct 08 20:53:03.766045 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 234/483] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:53:03 2022] GET /compute/v2.1/servers/5c864780-3998-4a09-95d4-e000a02af71e => generated 1271 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:53:03.766045 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-5ddcb664-76b2-4001-a4e9-86123bb5405e tempest-HypervisorAdminNegativeTestJSON-969913999 tempest-HypervisorAdminNegativeTestJSON-969913999-project] Calling method '.version_select at 0x7f1a8d155280>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:03.778899 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-5ddcb664-76b2-4001-a4e9-86123bb5405e tempest-HypervisorAdminNegativeTestJSON-969913999 tempest-HypervisorAdminNegativeTestJSON-969913999-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': 'e69b3444633b4feb8c23c06e86f20929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae60f71bc734a5d8d37eaba4078fc19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:53:03.785912 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-5ddcb664-76b2-4001-a4e9-86123bb5405e tempest-HypervisorAdminNegativeTestJSON-969913999 tempest-HypervisorAdminNegativeTestJSON-969913999-project] Request method failure captured: Oct 08 20:53:03.785912 ncdv-master-1 devstack@n-api.service[140491]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Oct 08 20:53:03.785912 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 20:53:03.785912 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 20:53:03.785912 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 20:53:03.785912 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 20:53:03.785912 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 20:53:03.785912 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 20:53:03.785912 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 20:53:03.785912 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 20:53:03.785912 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeMpYBFbZ3I2kobdlGQavYTDD0nLipZIhLb97sW76ZP6ztniwetGYPv21YpXcm4-uD_iHTAXc-FwhGC8lh4pKgK_HfTu73tEfaThDODxLcM_VyveFORZLEXSnRZ6WQV72PBA3y8HfFgcPbq1PsEHPfypM_oXsi8fYmBPWU01fkrLsos Oct 08 20:53:03.785912 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 20:53:03.785912 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 20:53:03.785912 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 20:53:03.785912 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 20:53:03.785912 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 20:53:03.785912 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 20:53:03.785912 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 8ae60f71bc734a5d8d37eaba4078fc19 Oct 08 20:53:03.785912 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-969913999 Oct 08 20:53:03.785912 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 20:53:03.785912 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 20:53:03.789173 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8ae60f71bc734a5d8d37eaba4078fc19"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8ae60f71bc734a5d8d37eaba4078fc19"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8ae60f71bc734a5d8d37eaba4078fc19"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8ae60f71bc734a5d8d37eaba4078fc19"}]}] Oct 08 20:53:03.789173 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-969913999 Oct 08 20:53:03.789173 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 8ae60f71bc734a5d8d37eaba4078fc19 Oct 08 20:53:03.789173 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-969913999 Oct 08 20:53:03.789173 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-HypervisorAdminNegativeTestJSON-969913999-project Oct 08 20:53:03.789173 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 20:53:03.789173 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 20:53:03.789173 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: e69b3444633b4feb8c23c06e86f20929 Oct 08 20:53:03.789173 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-969913999-project Oct 08 20:53:03.789173 ncdv-master-1 devstack@n-api.service[140491]: method: Oct 08 20:53:03.789173 ncdv-master-1 devstack@n-api.service[140491]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 08 20:53:03.789173 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': '1'} Oct 08 20:53:03.789173 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:53:03.797467 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:53:03.797467 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:53:03.797467 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:53:03.797467 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:53:03.797467 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:53:03.797467 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 08 20:53:03.797467 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 08 20:53:03.797467 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:53:03.797467 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:53:03.797467 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Oct 08 20:53:03.797467 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Oct 08 20:53:03.797467 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 08 20:53:03.797467 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 08 20:53:03.797467 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 08 20:53:03.797467 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 08 20:53:03.797467 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 08 20:53:03.797467 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 08 20:53:03.797467 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 08 20:53:03.797467 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise self.value Oct 08 20:53:03.798883 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 08 20:53:03.798883 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 08 20:53:03.798883 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 08 20:53:03.798883 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 08 20:53:03.798883 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 08 20:53:03.798883 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 08 20:53:03.798883 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 08 20:53:03.798883 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:53:03.798883 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:53:03.798883 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:53:03.798883 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:53:03.798883 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:53:03.798883 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:53:03.798883 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 08 20:53:03.798883 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 08 20:53:03.798883 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 08 20:53:03.798883 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:53:03.818163 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-5ddcb664-76b2-4001-a4e9-86123bb5405e tempest-HypervisorAdminNegativeTestJSON-969913999 tempest-HypervisorAdminNegativeTestJSON-969913999-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:53:03.820699 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-5ddcb664-76b2-4001-a4e9-86123bb5405e tempest-HypervisorAdminNegativeTestJSON-969913999 tempest-HypervisorAdminNegativeTestJSON-969913999-project] 10.222.0.26 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.066116 Oct 08 20:53:03.825079 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 235/484] 10.222.0.26 () {58 vars in 1173 bytes} [Sat Oct 8 20:53:03 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 71 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 08 20:53:04.026141 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.objects.instance [None req-f58e0ffb-6f35-4f45-b69e-ebe13266bd8d tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Lazy-loading 'services' on Instance uuid 1af12bcb-5e2a-4c15-8673-fa41701cb4c7 {{(pid=140492) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 20:53:04.071461 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c44471db-6395-4db8-9c14-9b599a140ce7 tempest-FlavorsExtraSpecsTestJSON-1665562341 tempest-FlavorsExtraSpecsTestJSON-1665562341-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:04.091332 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-f58e0ffb-6f35-4f45-b69e-ebe13266bd8d tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/1af12bcb-5e2a-4c15-8673-fa41701cb4c7" status: 200 len: 1929 microversion: 2.75 time: 0.392816 Oct 08 20:53:04.093444 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 250/485] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:53:03 2022] GET /compute/v2.1/servers/1af12bcb-5e2a-4c15-8673-fa41701cb4c7 => generated 1929 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:53:04.098257 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-567feb98-fe80-493f-8325-94cc4e410727 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:04.099162 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-567feb98-fe80-493f-8325-94cc4e410727 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] [instance: 6de2ea26-e774-47b5-8506-b3ebbc2d1712] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:53:04.105877 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-567feb98-fe80-493f-8325-94cc4e410727 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:04.106582 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-567feb98-fe80-493f-8325-94cc4e410727 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:04.107194 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-567feb98-fe80-493f-8325-94cc4e410727 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:04.108091 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-567feb98-fe80-493f-8325-94cc4e410727 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:04.114249 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-567feb98-fe80-493f-8325-94cc4e410727 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:04.115107 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-567feb98-fe80-493f-8325-94cc4e410727 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:04.116235 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-c44471db-6395-4db8-9c14-9b599a140ce7 tempest-FlavorsExtraSpecsTestJSON-1665562341 tempest-FlavorsExtraSpecsTestJSON-1665562341-project] 10.222.0.26 "GET /compute/v2.1/flavors/221179339/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.264822 Oct 08 20:53:04.117995 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 236/486] 10.222.0.26 () {58 vars in 1200 bytes} [Sat Oct 8 20:53:03 2022] GET /compute/v2.1/flavors/221179339/os-extra_specs => generated 66 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 08 20:53:04.135001 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-6f47c0df-b693-41c8-ad50-cda75f0c64c0 req-478c51e4-2df8-41a2-aea7-d873cb6333bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8216e713-dfa1-4625-b8ea-5869cf617f4f", "name": "network-vif-plugged", "status": "completed", "tag": "9fcb2769-f8e8-45e3-808c-aebaba6c6fdc"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:53:04.168779 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-6f47c0df-b693-41c8-ad50-cda75f0c64c0 req-478c51e4-2df8-41a2-aea7-d873cb6333bf service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:04.169922 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-6f47c0df-b693-41c8-ad50-cda75f0c64c0 req-478c51e4-2df8-41a2-aea7-d873cb6333bf service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:04.170774 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-6f47c0df-b693-41c8-ad50-cda75f0c64c0 req-478c51e4-2df8-41a2-aea7-d873cb6333bf service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:04.194292 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-6f47c0df-b693-41c8-ad50-cda75f0c64c0 req-478c51e4-2df8-41a2-aea7-d873cb6333bf service nova] Creating event network-vif-plugged:9fcb2769-f8e8-45e3-808c-aebaba6c6fdc for instance 8216e713-dfa1-4625-b8ea-5869cf617f4f on nch2-master-1 Oct 08 20:53:04.204889 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-6f47c0df-b693-41c8-ad50-cda75f0c64c0 req-478c51e4-2df8-41a2-aea7-d873cb6333bf service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085439 Oct 08 20:53:04.210367 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 237/487] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:53:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:53:04.217059 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-fcd9d3b2-d302-4d20-be04-c4d9d3e77cb8 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:04.218486 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-fcd9d3b2-d302-4d20-be04-c4d9d3e77cb8 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] [instance: 279361ef-2171-49e1-9f33-eadbf5dc0313] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:53:04.227047 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fcd9d3b2-d302-4d20-be04-c4d9d3e77cb8 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:04.227820 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fcd9d3b2-d302-4d20-be04-c4d9d3e77cb8 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:04.231971 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fcd9d3b2-d302-4d20-be04-c4d9d3e77cb8 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:04.233044 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fcd9d3b2-d302-4d20-be04-c4d9d3e77cb8 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:04.234474 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fcd9d3b2-d302-4d20-be04-c4d9d3e77cb8 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:04.237346 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fcd9d3b2-d302-4d20-be04-c4d9d3e77cb8 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:04.421262 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-567feb98-fe80-493f-8325-94cc4e410727 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '360660f7bb4746c8b1397f4857f423f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d702b3083bc4cf5ba6b6fc6f3c3147e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:53:04.440918 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-567feb98-fe80-493f-8325-94cc4e410727 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] 10.222.0.26 "GET /compute/v2.1/servers/6de2ea26-e774-47b5-8506-b3ebbc2d1712" status: 200 len: 1279 microversion: 2.1 time: 0.346140 Oct 08 20:53:04.442174 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 251/488] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:53:04 2022] GET /compute/v2.1/servers/6de2ea26-e774-47b5-8506-b3ebbc2d1712 => generated 1279 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:53:04.448465 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-2a576ca6-2bfb-4b37-998f-0ff774bd9322 tempest-HypervisorAdminNegativeTestJSON-100808664 tempest-HypervisorAdminNegativeTestJSON-100808664-project-admin] Calling method '.version_select at 0x7f1a8d0c2dc0>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:04.451603 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-2a576ca6-2bfb-4b37-998f-0ff774bd9322 tempest-HypervisorAdminNegativeTestJSON-100808664 tempest-HypervisorAdminNegativeTestJSON-100808664-project-admin] HTTP exception thrown: Hypervisor with ID 'c7c7c6bf-20e1-4198-9743-4204e927c67d' could not be found. Oct 08 20:53:04.465589 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-2a576ca6-2bfb-4b37-998f-0ff774bd9322 tempest-HypervisorAdminNegativeTestJSON-100808664 tempest-HypervisorAdminNegativeTestJSON-100808664-project-admin] Request method failure captured: Oct 08 20:53:04.465589 ncdv-master-1 devstack@n-api.service[140492]: request: GET /compute/v2.1/os-hypervisors/c7c7c6bf-20e1-4198-9743-4204e927c67d/uptime HTTP/1.1 Oct 08 20:53:04.465589 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 20:53:04.465589 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 20:53:04.465589 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 20:53:04.465589 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 20:53:04.465589 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 20:53:04.465589 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 20:53:04.465589 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 20:53:04.465589 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 20:53:04.465589 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeMsCTmibnfnliGxJxkE-BPICyY45SRSk6f3CkdWjzmW1FW6o8kK1zWdmoWPG0NdJ94j6tCw-ep_kyzdL8-izGMZa_6jZk84CD5NUjvP5U9LuAjna4xso4Q8hgYmkVKB2BEdUCoMWjOyVowoSjO4exRAJ6xjOun66KqSq9z0ozOgHVA Oct 08 20:53:04.465589 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 20:53:04.465589 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 20:53:04.465589 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 20:53:04.465589 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 20:53:04.465589 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 20:53:04.465589 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 20:53:04.465589 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 5c949a6d8b88422381df2d64a4d41fe3 Oct 08 20:53:04.465589 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-100808664 Oct 08 20:53:04.465589 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,admin,member Oct 08 20:53:04.465589 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,admin,member Oct 08 20:53:04.467147 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5c949a6d8b88422381df2d64a4d41fe3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5c949a6d8b88422381df2d64a4d41fe3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5c949a6d8b88422381df2d64a4d41fe3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5c949a6d8b88422381df2d64a4d41fe3"}]}] Oct 08 20:53:04.467147 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-100808664 Oct 08 20:53:04.467147 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 5c949a6d8b88422381df2d64a4d41fe3 Oct 08 20:53:04.467147 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-100808664 Oct 08 20:53:04.467147 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-HypervisorAdminNegativeTestJSON-100808664-project-admin Oct 08 20:53:04.467147 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 20:53:04.467147 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 20:53:04.467147 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 7dbc0efe76b3478380bde3a2c217da73 Oct 08 20:53:04.467147 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-100808664-project-admin Oct 08 20:53:04.467147 ncdv-master-1 devstack@n-api.service[140492]: method: Oct 08 20:53:04.467147 ncdv-master-1 devstack@n-api.service[140492]: exception: Hypervisor with ID 'c7c7c6bf-20e1-4198-9743-4204e927c67d' could not be found. Oct 08 20:53:04.467147 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': 'c7c7c6bf-20e1-4198-9743-4204e927c67d'} Oct 08 20:53:04.468637 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:53:04.468637 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:53:04.468637 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Oct 08 20:53:04.468637 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi value = int(str(value)) Oct 08 20:53:04.468637 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: 'c7c7c6bf-20e1-4198-9743-4204e927c67d' Oct 08 20:53:04.468637 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:53:04.468637 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:53:04.468637 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:53:04.468637 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:53:04.468637 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Oct 08 20:53:04.468637 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Oct 08 20:53:04.468637 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Oct 08 20:53:04.468637 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Oct 08 20:53:04.468637 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Oct 08 20:53:04.468637 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:53:04.468637 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:53:04.468637 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:53:04.468637 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:53:04.468637 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Oct 08 20:53:04.468637 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Oct 08 20:53:04.468637 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Oct 08 20:53:04.468637 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Oct 08 20:53:04.470502 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Oct 08 20:53:04.470502 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:53:04.470502 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:53:04.470502 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:53:04.470502 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:53:04.470502 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:53:04.470502 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:53:04.470502 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:53:04.470502 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:53:04.470502 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 08 20:53:04.470502 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 08 20:53:04.470502 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:53:04.470502 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:53:04.470502 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Oct 08 20:53:04.470502 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Oct 08 20:53:04.470502 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Oct 08 20:53:04.470502 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 08 20:53:04.470502 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID 'c7c7c6bf-20e1-4198-9743-4204e927c67d' could not be found. Oct 08 20:53:04.470502 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:53:04.470502 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:53:04.470502 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:53:04.472974 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:53:04.472974 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:53:04.472974 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:53:04.472974 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 20:53:04.472974 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 20:53:04.472974 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID 'c7c7c6bf-20e1-4198-9743-4204e927c67d' could not be found. Oct 08 20:53:04.472974 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:53:04.472974 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-2a576ca6-2bfb-4b37-998f-0ff774bd9322 tempest-HypervisorAdminNegativeTestJSON-100808664 tempest-HypervisorAdminNegativeTestJSON-100808664-project-admin] Returning 404 to user: Hypervisor with ID 'c7c7c6bf-20e1-4198-9743-4204e927c67d' could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:53:04.474832 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-2a576ca6-2bfb-4b37-998f-0ff774bd9322 tempest-HypervisorAdminNegativeTestJSON-100808664 tempest-HypervisorAdminNegativeTestJSON-100808664-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors/c7c7c6bf-20e1-4198-9743-4204e927c67d/uptime" status: 404 len: 123 microversion: 2.1 time: 0.030343 Oct 08 20:53:04.477130 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 252/489] 10.222.0.26 () {58 vars in 1278 bytes} [Sat Oct 8 20:53:04 2022] GET /compute/v2.1/os-hypervisors/c7c7c6bf-20e1-4198-9743-4204e927c67d/uptime => generated 123 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 20:53:04.488162 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-3de505ba-b02f-485f-819c-ca70a7db78d1 tempest-FlavorsExtraSpecsTestJSON-610693945 tempest-FlavorsExtraSpecsTestJSON-610693945-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:53:04.519130 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-3de505ba-b02f-485f-819c-ca70a7db78d1 tempest-FlavorsExtraSpecsTestJSON-610693945 tempest-FlavorsExtraSpecsTestJSON-610693945-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors/221179339/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.040439 Oct 08 20:53:04.520378 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 253/490] 10.222.0.26 () {60 vars in 1221 bytes} [Sat Oct 8 20:53:04 2022] POST /compute/v2.1/flavors/221179339/os-extra_specs => generated 66 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 08 20:53:04.527086 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-83858c3e-72ae-4edb-9119-76a7e6fcf72f tempest-HypervisorAdminNegativeTestJSON-100808664 tempest-HypervisorAdminNegativeTestJSON-100808664-project-admin] Calling method '.version_select at 0x7f1a8cf90160>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:04.529478 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-83858c3e-72ae-4edb-9119-76a7e6fcf72f tempest-HypervisorAdminNegativeTestJSON-100808664 tempest-HypervisorAdminNegativeTestJSON-100808664-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:04.530183 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-83858c3e-72ae-4edb-9119-76a7e6fcf72f tempest-HypervisorAdminNegativeTestJSON-100808664 tempest-HypervisorAdminNegativeTestJSON-100808664-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:04.531429 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-83858c3e-72ae-4edb-9119-76a7e6fcf72f tempest-HypervisorAdminNegativeTestJSON-100808664 tempest-HypervisorAdminNegativeTestJSON-100808664-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:04.559544 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-83858c3e-72ae-4edb-9119-76a7e6fcf72f tempest-HypervisorAdminNegativeTestJSON-100808664 tempest-HypervisorAdminNegativeTestJSON-100808664-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:04.560342 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-83858c3e-72ae-4edb-9119-76a7e6fcf72f tempest-HypervisorAdminNegativeTestJSON-100808664 tempest-HypervisorAdminNegativeTestJSON-100808664-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:04.561596 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-83858c3e-72ae-4edb-9119-76a7e6fcf72f tempest-HypervisorAdminNegativeTestJSON-100808664 tempest-HypervisorAdminNegativeTestJSON-100808664-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:04.576786 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-83858c3e-72ae-4edb-9119-76a7e6fcf72f tempest-HypervisorAdminNegativeTestJSON-100808664 tempest-HypervisorAdminNegativeTestJSON-100808664-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:04.578599 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-83858c3e-72ae-4edb-9119-76a7e6fcf72f tempest-HypervisorAdminNegativeTestJSON-100808664 tempest-HypervisorAdminNegativeTestJSON-100808664-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:04.579062 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-83858c3e-72ae-4edb-9119-76a7e6fcf72f tempest-HypervisorAdminNegativeTestJSON-100808664 tempest-HypervisorAdminNegativeTestJSON-100808664-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:04.586535 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-83858c3e-72ae-4edb-9119-76a7e6fcf72f tempest-HypervisorAdminNegativeTestJSON-100808664 tempest-HypervisorAdminNegativeTestJSON-100808664-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.064553 Oct 08 20:53:04.587299 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 254/491] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Oct 8 20:53:04 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:53:04.599156 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-88a1456b-469e-45c2-ac45-7164eea67dae tempest-FlavorsExtraSpecsTestJSON-1665562341 tempest-FlavorsExtraSpecsTestJSON-1665562341-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:04.608974 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-88a1456b-469e-45c2-ac45-7164eea67dae tempest-FlavorsExtraSpecsTestJSON-1665562341 tempest-FlavorsExtraSpecsTestJSON-1665562341-project] 10.222.0.26 "GET /compute/v2.1/flavors/221179339/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.014077 Oct 08 20:53:04.609907 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 255/492] 10.222.0.26 () {58 vars in 1242 bytes} [Sat Oct 8 20:53:04 2022] GET /compute/v2.1/flavors/221179339/os-extra_specs/hw:numa_nodes => generated 22 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 08 20:53:04.616541 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-9289b29c-9e4d-4ad2-9426-bff980e6ae0d tempest-HypervisorAdminNegativeTestJSON-969913999 tempest-HypervisorAdminNegativeTestJSON-969913999-project] Calling method '.version_select at 0x7f1a8cf164c0>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:04.618658 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-9289b29c-9e4d-4ad2-9426-bff980e6ae0d tempest-HypervisorAdminNegativeTestJSON-969913999 tempest-HypervisorAdminNegativeTestJSON-969913999-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': 'e69b3444633b4feb8c23c06e86f20929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae60f71bc734a5d8d37eaba4078fc19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:53:04.620615 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-9289b29c-9e4d-4ad2-9426-bff980e6ae0d tempest-HypervisorAdminNegativeTestJSON-969913999 tempest-HypervisorAdminNegativeTestJSON-969913999-project] Request method failure captured: Oct 08 20:53:04.620615 ncdv-master-1 devstack@n-api.service[140492]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Oct 08 20:53:04.620615 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 20:53:04.620615 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 20:53:04.620615 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 20:53:04.620615 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 20:53:04.620615 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 20:53:04.620615 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 20:53:04.620615 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 20:53:04.620615 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 20:53:04.620615 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeMpYBFbZ3I2kobdlGQavYTDD0nLipZIhLb97sW76ZP6ztniwetGYPv21YpXcm4-uD_iHTAXc-FwhGC8lh4pKgK_HfTu73tEfaThDODxLcM_VyveFORZLEXSnRZ6WQV72PBA3y8HfFgcPbq1PsEHPfypM_oXsi8fYmBPWU01fkrLsos Oct 08 20:53:04.620615 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 20:53:04.620615 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 20:53:04.620615 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 20:53:04.620615 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 20:53:04.620615 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 20:53:04.620615 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 20:53:04.620615 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 8ae60f71bc734a5d8d37eaba4078fc19 Oct 08 20:53:04.620615 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-969913999 Oct 08 20:53:04.620615 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 20:53:04.620615 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 20:53:04.622314 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8ae60f71bc734a5d8d37eaba4078fc19"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8ae60f71bc734a5d8d37eaba4078fc19"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8ae60f71bc734a5d8d37eaba4078fc19"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8ae60f71bc734a5d8d37eaba4078fc19"}]}] Oct 08 20:53:04.622314 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-969913999 Oct 08 20:53:04.622314 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 8ae60f71bc734a5d8d37eaba4078fc19 Oct 08 20:53:04.622314 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-969913999 Oct 08 20:53:04.622314 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-HypervisorAdminNegativeTestJSON-969913999-project Oct 08 20:53:04.622314 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 20:53:04.622314 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 20:53:04.622314 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: e69b3444633b4feb8c23c06e86f20929 Oct 08 20:53:04.622314 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-969913999-project Oct 08 20:53:04.622314 ncdv-master-1 devstack@n-api.service[140492]: method: Oct 08 20:53:04.622314 ncdv-master-1 devstack@n-api.service[140492]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 08 20:53:04.622314 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': '1'} Oct 08 20:53:04.622314 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:53:04.623095 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:53:04.623095 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:53:04.623095 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:53:04.623095 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:53:04.623095 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:53:04.623095 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 08 20:53:04.623095 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 08 20:53:04.623095 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:53:04.623095 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:53:04.623095 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Oct 08 20:53:04.623095 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 08 20:53:04.623095 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Oct 08 20:53:04.623095 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Oct 08 20:53:04.623095 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 08 20:53:04.623095 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 08 20:53:04.623095 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 08 20:53:04.623095 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 08 20:53:04.623095 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 08 20:53:04.623095 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 08 20:53:04.624230 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 08 20:53:04.624230 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise self.value Oct 08 20:53:04.624230 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 08 20:53:04.624230 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 08 20:53:04.624230 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 08 20:53:04.624230 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 08 20:53:04.624230 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 08 20:53:04.624230 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 08 20:53:04.624230 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 08 20:53:04.624230 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:53:04.624230 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:53:04.624230 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:53:04.624230 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:53:04.624230 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:53:04.624230 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:53:04.624230 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 08 20:53:04.624230 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 08 20:53:04.624230 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 08 20:53:04.624230 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:53:04.627306 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-9289b29c-9e4d-4ad2-9426-bff980e6ae0d tempest-HypervisorAdminNegativeTestJSON-969913999 tempest-HypervisorAdminNegativeTestJSON-969913999-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:53:04.628450 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-9289b29c-9e4d-4ad2-9426-bff980e6ae0d tempest-HypervisorAdminNegativeTestJSON-969913999 tempest-HypervisorAdminNegativeTestJSON-969913999-project] 10.222.0.26 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.017557 Oct 08 20:53:04.634174 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 256/493] 10.222.0.26 () {58 vars in 1152 bytes} [Sat Oct 8 20:53:04 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 24 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 08 20:53:04.640342 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-a8fece6a-c58f-4dba-8f73-ddb4a4761f72 tempest-FlavorsExtraSpecsTestJSON-610693945 tempest-FlavorsExtraSpecsTestJSON-610693945-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:53:04.670412 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-a8fece6a-c58f-4dba-8f73-ddb4a4761f72 tempest-FlavorsExtraSpecsTestJSON-610693945 tempest-FlavorsExtraSpecsTestJSON-610693945-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors/221179339/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.034791 Oct 08 20:53:04.671573 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 257/494] 10.222.0.26 () {60 vars in 1221 bytes} [Sat Oct 8 20:53:04 2022] POST /compute/v2.1/flavors/221179339/os-extra_specs => generated 66 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 08 20:53:04.676553 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-7f599492-aa73-4a12-91ea-453a9cd2759a tempest-HypervisorAdminNegativeTestJSON-100808664 tempest-HypervisorAdminNegativeTestJSON-100808664-project-admin] Calling method '.version_select at 0x7f1a8cf16430>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:04.678561 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-7f599492-aa73-4a12-91ea-453a9cd2759a tempest-HypervisorAdminNegativeTestJSON-100808664 tempest-HypervisorAdminNegativeTestJSON-100808664-project-admin] HTTP exception thrown: Hypervisor with ID 'a6261f38-5f79-4b3a-be93-5fb6ec9c208d' could not be found. Oct 08 20:53:04.680348 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-7f599492-aa73-4a12-91ea-453a9cd2759a tempest-HypervisorAdminNegativeTestJSON-100808664 tempest-HypervisorAdminNegativeTestJSON-100808664-project-admin] Request method failure captured: Oct 08 20:53:04.680348 ncdv-master-1 devstack@n-api.service[140492]: request: GET /compute/v2.1/os-hypervisors/a6261f38-5f79-4b3a-be93-5fb6ec9c208d HTTP/1.1 Oct 08 20:53:04.680348 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 20:53:04.680348 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 20:53:04.680348 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 20:53:04.680348 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 20:53:04.680348 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 20:53:04.680348 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 20:53:04.680348 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 20:53:04.680348 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 20:53:04.680348 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeMsCTmibnfnliGxJxkE-BPICyY45SRSk6f3CkdWjzmW1FW6o8kK1zWdmoWPG0NdJ94j6tCw-ep_kyzdL8-izGMZa_6jZk84CD5NUjvP5U9LuAjna4xso4Q8hgYmkVKB2BEdUCoMWjOyVowoSjO4exRAJ6xjOun66KqSq9z0ozOgHVA Oct 08 20:53:04.680348 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 20:53:04.680348 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 20:53:04.680348 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 20:53:04.680348 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 20:53:04.680348 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 20:53:04.680348 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 20:53:04.680348 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 5c949a6d8b88422381df2d64a4d41fe3 Oct 08 20:53:04.680348 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-100808664 Oct 08 20:53:04.680348 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,admin,member Oct 08 20:53:04.680348 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,admin,member Oct 08 20:53:04.681575 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5c949a6d8b88422381df2d64a4d41fe3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5c949a6d8b88422381df2d64a4d41fe3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5c949a6d8b88422381df2d64a4d41fe3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5c949a6d8b88422381df2d64a4d41fe3"}]}] Oct 08 20:53:04.681575 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-100808664 Oct 08 20:53:04.681575 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 5c949a6d8b88422381df2d64a4d41fe3 Oct 08 20:53:04.681575 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-100808664 Oct 08 20:53:04.681575 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-HypervisorAdminNegativeTestJSON-100808664-project-admin Oct 08 20:53:04.681575 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 20:53:04.681575 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 20:53:04.681575 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 7dbc0efe76b3478380bde3a2c217da73 Oct 08 20:53:04.681575 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-100808664-project-admin Oct 08 20:53:04.681575 ncdv-master-1 devstack@n-api.service[140492]: method: Oct 08 20:53:04.681575 ncdv-master-1 devstack@n-api.service[140492]: exception: Hypervisor with ID 'a6261f38-5f79-4b3a-be93-5fb6ec9c208d' could not be found. Oct 08 20:53:04.681575 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': 'a6261f38-5f79-4b3a-be93-5fb6ec9c208d'} Oct 08 20:53:04.682239 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:53:04.682239 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:53:04.682239 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Oct 08 20:53:04.682239 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi value = int(str(value)) Oct 08 20:53:04.682239 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: 'a6261f38-5f79-4b3a-be93-5fb6ec9c208d' Oct 08 20:53:04.682239 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:53:04.682239 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:53:04.682239 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:53:04.682239 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:53:04.682239 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Oct 08 20:53:04.682239 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Oct 08 20:53:04.682239 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Oct 08 20:53:04.682239 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Oct 08 20:53:04.682239 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Oct 08 20:53:04.682239 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:53:04.682239 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:53:04.682239 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:53:04.682239 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:53:04.682239 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Oct 08 20:53:04.682239 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Oct 08 20:53:04.682239 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Oct 08 20:53:04.682239 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Oct 08 20:53:04.688406 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Oct 08 20:53:04.688406 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:53:04.688406 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:53:04.688406 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:53:04.688406 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:53:04.688406 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:53:04.688406 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:53:04.688406 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:53:04.688406 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:53:04.688406 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 08 20:53:04.688406 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 08 20:53:04.688406 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:53:04.688406 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:53:04.688406 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Oct 08 20:53:04.688406 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 08 20:53:04.688406 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Oct 08 20:53:04.688406 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Oct 08 20:53:04.688406 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Oct 08 20:53:04.688406 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 08 20:53:04.688406 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID 'a6261f38-5f79-4b3a-be93-5fb6ec9c208d' could not be found. Oct 08 20:53:04.690189 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:53:04.690189 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:53:04.690189 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:53:04.690189 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:53:04.690189 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:53:04.690189 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:53:04.690189 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 20:53:04.690189 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 20:53:04.690189 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID 'a6261f38-5f79-4b3a-be93-5fb6ec9c208d' could not be found. Oct 08 20:53:04.690189 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:53:04.690189 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-7f599492-aa73-4a12-91ea-453a9cd2759a tempest-HypervisorAdminNegativeTestJSON-100808664 tempest-HypervisorAdminNegativeTestJSON-100808664-project-admin] Returning 404 to user: Hypervisor with ID 'a6261f38-5f79-4b3a-be93-5fb6ec9c208d' could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:53:04.690189 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-7f599492-aa73-4a12-91ea-453a9cd2759a tempest-HypervisorAdminNegativeTestJSON-100808664 tempest-HypervisorAdminNegativeTestJSON-100808664-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors/a6261f38-5f79-4b3a-be93-5fb6ec9c208d" status: 404 len: 123 microversion: 2.1 time: 0.008937 Oct 08 20:53:04.690189 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 258/495] 10.222.0.26 () {58 vars in 1257 bytes} [Sat Oct 8 20:53:04 2022] GET /compute/v2.1/os-hypervisors/a6261f38-5f79-4b3a-be93-5fb6ec9c208d => generated 123 bytes in 10 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 20:53:04.691109 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-d3f59138-0dd2-4c54-9bf7-b50dbc1102f3 tempest-FlavorsExtraSpecsTestJSON-610693945 tempest-FlavorsExtraSpecsTestJSON-610693945-project-admin] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:04.700067 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-d3f59138-0dd2-4c54-9bf7-b50dbc1102f3 tempest-FlavorsExtraSpecsTestJSON-610693945 tempest-FlavorsExtraSpecsTestJSON-610693945-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/221179339/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.016253 Oct 08 20:53:04.700983 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 259/496] 10.222.0.26 () {58 vars in 1200 bytes} [Sat Oct 8 20:53:04 2022] GET /compute/v2.1/flavors/221179339/os-extra_specs => generated 66 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 08 20:53:04.710365 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-f1bb2e7a-51a7-4620-b8c8-9487d7468a8e tempest-FlavorsExtraSpecsTestJSON-610693945 tempest-FlavorsExtraSpecsTestJSON-610693945-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:53:04.751152 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-f1bb2e7a-51a7-4620-b8c8-9487d7468a8e tempest-FlavorsExtraSpecsTestJSON-610693945 tempest-FlavorsExtraSpecsTestJSON-610693945-project-admin] 10.222.0.26 "PUT /compute/v2.1/flavors/221179339/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.044538 Oct 08 20:53:04.752109 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 260/497] 10.222.0.26 () {60 vars in 1262 bytes} [Sat Oct 8 20:53:04 2022] PUT /compute/v2.1/flavors/221179339/os-extra_specs/hw:numa_nodes => generated 22 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 08 20:53:04.758956 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-4390fd10-e622-4075-b015-3a8aa58a0349 tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:04.759596 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-4390fd10-e622-4075-b015-3a8aa58a0349 tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] [instance: 8216e713-dfa1-4625-b8ea-5869cf617f4f] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:53:04.766087 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4390fd10-e622-4075-b015-3a8aa58a0349 tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:04.766586 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4390fd10-e622-4075-b015-3a8aa58a0349 tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:04.767038 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4390fd10-e622-4075-b015-3a8aa58a0349 tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:04.767767 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4390fd10-e622-4075-b015-3a8aa58a0349 tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:04.768232 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4390fd10-e622-4075-b015-3a8aa58a0349 tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:04.769172 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4390fd10-e622-4075-b015-3a8aa58a0349 tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:04.797807 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-fcd9d3b2-d302-4d20-be04-c4d9d3e77cb8 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474ca64d1b1d4e30916b517645aba882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecc2dd2407b4819874bed09cb27959a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:53:04.811577 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-fcd9d3b2-d302-4d20-be04-c4d9d3e77cb8 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] 10.222.0.26 "GET /compute/v2.1/servers/279361ef-2171-49e1-9f33-eadbf5dc0313" status: 200 len: 1270 microversion: 2.1 time: 0.599167 Oct 08 20:53:04.815907 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 238/498] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:53:04 2022] GET /compute/v2.1/servers/279361ef-2171-49e1-9f33-eadbf5dc0313 => generated 1270 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:53:04.826540 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-32c4d0c8-edb6-4736-b5b0-a54532968972 tempest-FlavorsExtraSpecsTestJSON-610693945 tempest-FlavorsExtraSpecsTestJSON-610693945-project-admin] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:04.840450 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-32c4d0c8-edb6-4736-b5b0-a54532968972 tempest-FlavorsExtraSpecsTestJSON-610693945 tempest-FlavorsExtraSpecsTestJSON-610693945-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/221179339/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.023082 Oct 08 20:53:04.841478 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 239/499] 10.222.0.26 () {58 vars in 1200 bytes} [Sat Oct 8 20:53:04 2022] GET /compute/v2.1/flavors/221179339/os-extra_specs => generated 66 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 08 20:53:04.855613 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-5da36766-f003-4a63-a00f-a997c97251e5 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:04.856564 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-5da36766-f003-4a63-a00f-a997c97251e5 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] [instance: 5c864780-3998-4a09-95d4-e000a02af71e] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:53:04.872547 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5da36766-f003-4a63-a00f-a997c97251e5 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:04.873353 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5da36766-f003-4a63-a00f-a997c97251e5 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:04.874057 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5da36766-f003-4a63-a00f-a997c97251e5 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:04.876506 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5da36766-f003-4a63-a00f-a997c97251e5 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:04.877157 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5da36766-f003-4a63-a00f-a997c97251e5 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:04.882109 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5da36766-f003-4a63-a00f-a997c97251e5 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:04.951008 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-4390fd10-e622-4075-b015-3a8aa58a0349 tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd637d2fa21649a1b00f27e7d86f3003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d547f95cc6043b0bb9b6a94b2e354a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:53:04.966996 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-4390fd10-e622-4075-b015-3a8aa58a0349 tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] 10.222.0.26 "GET /compute/v2.1/servers/8216e713-dfa1-4625-b8ea-5869cf617f4f" status: 200 len: 1314 microversion: 2.1 time: 0.213495 Oct 08 20:53:04.968109 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 261/500] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:53:04 2022] GET /compute/v2.1/servers/8216e713-dfa1-4625-b8ea-5869cf617f4f => generated 1314 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:53:04.982667 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-6c7928d6-8f2d-4bb7-a531-0f1d816d904c tempest-FlavorsExtraSpecsTestJSON-610693945 tempest-FlavorsExtraSpecsTestJSON-610693945-project-admin] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:04.987987 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=6,nova_api:SAVEPOINT=6,nova_api:RELEASE=6,nova_api:UPDATE=1 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:53:05.027494 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-6c7928d6-8f2d-4bb7-a531-0f1d816d904c tempest-FlavorsExtraSpecsTestJSON-610693945 tempest-FlavorsExtraSpecsTestJSON-610693945-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/221179339/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.058238 Oct 08 20:53:05.029306 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 262/501] 10.222.0.26 () {58 vars in 1245 bytes} [Sat Oct 8 20:53:04 2022] DELETE /compute/v2.1/flavors/221179339/os-extra_specs/hw:numa_nodes => generated 0 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 08 20:53:05.039707 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-73c78e7c-30da-4b88-9466-84b5111db2ca tempest-FlavorsExtraSpecsTestJSON-610693945 tempest-FlavorsExtraSpecsTestJSON-610693945-project-admin] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:05.066333 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-73c78e7c-30da-4b88-9466-84b5111db2ca tempest-FlavorsExtraSpecsTestJSON-610693945 tempest-FlavorsExtraSpecsTestJSON-610693945-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/221179339/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.032246 Oct 08 20:53:05.066718 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 263/502] 10.222.0.26 () {58 vars in 1245 bytes} [Sat Oct 8 20:53:05 2022] DELETE /compute/v2.1/flavors/221179339/os-extra_specs/hw:cpu_policy => generated 0 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Oct 08 20:53:05.080492 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-446df1fc-9f3a-4c69-af3e-d78a16d3a5c3 tempest-FlavorsExtraSpecsTestJSON-610693945 tempest-FlavorsExtraSpecsTestJSON-610693945-project-admin] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:05.089362 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-446df1fc-9f3a-4c69-af3e-d78a16d3a5c3 tempest-FlavorsExtraSpecsTestJSON-610693945 tempest-FlavorsExtraSpecsTestJSON-610693945-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/221179339/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.018220 Oct 08 20:53:05.093363 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 264/503] 10.222.0.26 () {58 vars in 1200 bytes} [Sat Oct 8 20:53:05 2022] GET /compute/v2.1/flavors/221179339/os-extra_specs => generated 19 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 08 20:53:05.101153 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-22a084b9-a865-4519-a469-c313a11baddf tempest-FlavorsExtraSpecsTestJSON-610693945 tempest-FlavorsExtraSpecsTestJSON-610693945-project-admin] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:05.125134 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-22a084b9-a865-4519-a469-c313a11baddf tempest-FlavorsExtraSpecsTestJSON-610693945 tempest-FlavorsExtraSpecsTestJSON-610693945-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/221179339" status: 202 len: 0 microversion: 2.1 time: 0.027765 Oct 08 20:53:05.126130 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 265/504] 10.222.0.26 () {58 vars in 1158 bytes} [Sat Oct 8 20:53:05 2022] DELETE /compute/v2.1/flavors/221179339 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 08 20:53:05.133772 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-d1f203e6-3b45-4b89-899e-ef63c48b74cc tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:05.134851 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-d1f203e6-3b45-4b89-899e-ef63c48b74cc tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] [instance: 1af12bcb-5e2a-4c15-8673-fa41701cb4c7] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:53:05.143347 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d1f203e6-3b45-4b89-899e-ef63c48b74cc tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:05.143845 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d1f203e6-3b45-4b89-899e-ef63c48b74cc tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:05.144300 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d1f203e6-3b45-4b89-899e-ef63c48b74cc tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:05.145019 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d1f203e6-3b45-4b89-899e-ef63c48b74cc tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:05.145784 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d1f203e6-3b45-4b89-899e-ef63c48b74cc tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:05.146420 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d1f203e6-3b45-4b89-899e-ef63c48b74cc tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:05.250726 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.objects.instance [None req-d1f203e6-3b45-4b89-899e-ef63c48b74cc tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Lazy-loading 'services' on Instance uuid 1af12bcb-5e2a-4c15-8673-fa41701cb4c7 {{(pid=140492) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 20:53:05.272328 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-d1f203e6-3b45-4b89-899e-ef63c48b74cc tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/1af12bcb-5e2a-4c15-8673-fa41701cb4c7" status: 200 len: 1929 microversion: 2.75 time: 0.144369 Oct 08 20:53:05.273123 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 266/505] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:53:05 2022] GET /compute/v2.1/servers/1af12bcb-5e2a-4c15-8673-fa41701cb4c7 => generated 1929 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:53:05.279877 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-9e87cc8b-60b3-49b5-9055-b1f66880665f tempest-FlavorsExtraSpecsTestJSON-610693945 tempest-FlavorsExtraSpecsTestJSON-610693945-project-admin] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:05.304205 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-9e87cc8b-60b3-49b5-9055-b1f66880665f tempest-FlavorsExtraSpecsTestJSON-610693945 tempest-FlavorsExtraSpecsTestJSON-610693945-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.028934 Oct 08 20:53:05.306087 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 267/506] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Oct 8 20:53:05 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:53:05.337385 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-5da36766-f003-4a63-a00f-a997c97251e5 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef659f5a1a24c439528a7675bdd70f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c92fe04ab8248399d0acb932f82d607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:53:05.348042 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-5da36766-f003-4a63-a00f-a997c97251e5 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] 10.222.0.26 "GET /compute/v2.1/servers/5c864780-3998-4a09-95d4-e000a02af71e" status: 200 len: 1313 microversion: 2.1 time: 0.504282 Oct 08 20:53:05.349441 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 240/507] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:53:04 2022] GET /compute/v2.1/servers/5c864780-3998-4a09-95d4-e000a02af71e => generated 1313 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:53:05.476890 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-b222e253-9bdb-4c1e-8151-18d63777decc tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:05.480077 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-b222e253-9bdb-4c1e-8151-18d63777decc tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] [instance: 6de2ea26-e774-47b5-8506-b3ebbc2d1712] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:53:05.523479 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b222e253-9bdb-4c1e-8151-18d63777decc tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:05.527365 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b222e253-9bdb-4c1e-8151-18d63777decc tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:05.529595 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b222e253-9bdb-4c1e-8151-18d63777decc tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:05.534332 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b222e253-9bdb-4c1e-8151-18d63777decc tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:05.534885 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b222e253-9bdb-4c1e-8151-18d63777decc tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:05.537360 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b222e253-9bdb-4c1e-8151-18d63777decc tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:05.843883 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-8abc0442-10ed-4ac2-b69a-3316cb20cecd tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:05.844645 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-8abc0442-10ed-4ac2-b69a-3316cb20cecd tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] [instance: 279361ef-2171-49e1-9f33-eadbf5dc0313] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:53:05.855113 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8abc0442-10ed-4ac2-b69a-3316cb20cecd tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:05.855333 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8abc0442-10ed-4ac2-b69a-3316cb20cecd tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:05.865030 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8abc0442-10ed-4ac2-b69a-3316cb20cecd tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:05.866315 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8abc0442-10ed-4ac2-b69a-3316cb20cecd tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:05.867554 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8abc0442-10ed-4ac2-b69a-3316cb20cecd tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:05.868644 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8abc0442-10ed-4ac2-b69a-3316cb20cecd tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:05.981456 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-b222e253-9bdb-4c1e-8151-18d63777decc tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '360660f7bb4746c8b1397f4857f423f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d702b3083bc4cf5ba6b6fc6f3c3147e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:53:06.002026 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-b222e253-9bdb-4c1e-8151-18d63777decc tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] 10.222.0.26 "GET /compute/v2.1/servers/6de2ea26-e774-47b5-8506-b3ebbc2d1712" status: 200 len: 1321 microversion: 2.1 time: 0.541098 Oct 08 20:53:06.003026 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 268/508] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:53:05 2022] GET /compute/v2.1/servers/6de2ea26-e774-47b5-8506-b3ebbc2d1712 => generated 1321 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:53:06.009855 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-7fe488be-eb9c-4e3d-b485-43fb542617c8 tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:06.010686 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-7fe488be-eb9c-4e3d-b485-43fb542617c8 tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] [instance: 8216e713-dfa1-4625-b8ea-5869cf617f4f] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:53:06.020515 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7fe488be-eb9c-4e3d-b485-43fb542617c8 tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:06.021223 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7fe488be-eb9c-4e3d-b485-43fb542617c8 tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:06.022852 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7fe488be-eb9c-4e3d-b485-43fb542617c8 tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:06.024037 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7fe488be-eb9c-4e3d-b485-43fb542617c8 tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:06.024825 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7fe488be-eb9c-4e3d-b485-43fb542617c8 tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:06.026335 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7fe488be-eb9c-4e3d-b485-43fb542617c8 tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:06.102908 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-8abc0442-10ed-4ac2-b69a-3316cb20cecd tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474ca64d1b1d4e30916b517645aba882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecc2dd2407b4819874bed09cb27959a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:53:06.124921 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-8abc0442-10ed-4ac2-b69a-3316cb20cecd tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] 10.222.0.26 "GET /compute/v2.1/servers/279361ef-2171-49e1-9f33-eadbf5dc0313" status: 200 len: 1268 microversion: 2.1 time: 0.287266 Oct 08 20:53:06.126226 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 241/509] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:53:05 2022] GET /compute/v2.1/servers/279361ef-2171-49e1-9f33-eadbf5dc0313 => generated 1268 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 20:53:06.305042 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-db886e5c-93b9-40fb-9201-b1acc2d92040 tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:06.305698 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-db886e5c-93b9-40fb-9201-b1acc2d92040 tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] [instance: 1af12bcb-5e2a-4c15-8673-fa41701cb4c7] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:53:06.313848 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-db886e5c-93b9-40fb-9201-b1acc2d92040 tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:06.314647 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-db886e5c-93b9-40fb-9201-b1acc2d92040 tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:06.315107 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-db886e5c-93b9-40fb-9201-b1acc2d92040 tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:06.315836 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-db886e5c-93b9-40fb-9201-b1acc2d92040 tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:06.316463 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-db886e5c-93b9-40fb-9201-b1acc2d92040 tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:06.316891 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-db886e5c-93b9-40fb-9201-b1acc2d92040 tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:06.428545 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.objects.instance [None req-db886e5c-93b9-40fb-9201-b1acc2d92040 tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Lazy-loading 'services' on Instance uuid 1af12bcb-5e2a-4c15-8673-fa41701cb4c7 {{(pid=140491) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 20:53:06.452705 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-db886e5c-93b9-40fb-9201-b1acc2d92040 tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/1af12bcb-5e2a-4c15-8673-fa41701cb4c7" status: 200 len: 1929 microversion: 2.75 time: 0.153752 Oct 08 20:53:06.453580 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 242/510] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:53:06 2022] GET /compute/v2.1/servers/1af12bcb-5e2a-4c15-8673-fa41701cb4c7 => generated 1929 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:53:06.462138 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-a85762bf-7474-4fdb-ae9c-196415472511 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:06.463018 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-a85762bf-7474-4fdb-ae9c-196415472511 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] [instance: 5c864780-3998-4a09-95d4-e000a02af71e] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:53:06.465338 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-7fe488be-eb9c-4e3d-b485-43fb542617c8 tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd637d2fa21649a1b00f27e7d86f3003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d547f95cc6043b0bb9b6a94b2e354a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:53:06.482293 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-7fe488be-eb9c-4e3d-b485-43fb542617c8 tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] 10.222.0.26 "GET /compute/v2.1/servers/8216e713-dfa1-4625-b8ea-5869cf617f4f" status: 200 len: 1314 microversion: 2.1 time: 0.477800 Oct 08 20:53:06.482886 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 269/511] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:53:06 2022] GET /compute/v2.1/servers/8216e713-dfa1-4625-b8ea-5869cf617f4f => generated 1314 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:53:06.484795 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a85762bf-7474-4fdb-ae9c-196415472511 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:06.485654 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a85762bf-7474-4fdb-ae9c-196415472511 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:06.487878 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a85762bf-7474-4fdb-ae9c-196415472511 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:06.490365 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a85762bf-7474-4fdb-ae9c-196415472511 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:06.491049 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a85762bf-7474-4fdb-ae9c-196415472511 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:06.492580 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a85762bf-7474-4fdb-ae9c-196415472511 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:06.818492 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-a85762bf-7474-4fdb-ae9c-196415472511 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef659f5a1a24c439528a7675bdd70f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c92fe04ab8248399d0acb932f82d607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:53:06.827315 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-a85762bf-7474-4fdb-ae9c-196415472511 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] 10.222.0.26 "GET /compute/v2.1/servers/5c864780-3998-4a09-95d4-e000a02af71e" status: 200 len: 1313 microversion: 2.1 time: 0.372390 Oct 08 20:53:06.831152 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 243/512] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:53:06 2022] GET /compute/v2.1/servers/5c864780-3998-4a09-95d4-e000a02af71e => generated 1313 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:53:07.039516 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-9f7caa64-fb28-4f58-8e8e-01a72566d43f tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:07.040349 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-9f7caa64-fb28-4f58-8e8e-01a72566d43f tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] [instance: 6de2ea26-e774-47b5-8506-b3ebbc2d1712] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:53:07.051786 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9f7caa64-fb28-4f58-8e8e-01a72566d43f tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:07.052693 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9f7caa64-fb28-4f58-8e8e-01a72566d43f tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:07.053485 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9f7caa64-fb28-4f58-8e8e-01a72566d43f tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:07.056170 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9f7caa64-fb28-4f58-8e8e-01a72566d43f tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:07.056860 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9f7caa64-fb28-4f58-8e8e-01a72566d43f tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:07.058183 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9f7caa64-fb28-4f58-8e8e-01a72566d43f tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:07.150486 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-464098f0-7172-4f14-abac-d96b8a87d021 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:07.152339 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-464098f0-7172-4f14-abac-d96b8a87d021 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] [instance: 279361ef-2171-49e1-9f33-eadbf5dc0313] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:53:07.162286 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-464098f0-7172-4f14-abac-d96b8a87d021 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:07.163805 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-464098f0-7172-4f14-abac-d96b8a87d021 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:07.164492 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-464098f0-7172-4f14-abac-d96b8a87d021 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:07.165435 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-464098f0-7172-4f14-abac-d96b8a87d021 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:07.166087 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-464098f0-7172-4f14-abac-d96b8a87d021 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:07.166817 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-464098f0-7172-4f14-abac-d96b8a87d021 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:07.637430 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-464098f0-7172-4f14-abac-d96b8a87d021 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474ca64d1b1d4e30916b517645aba882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecc2dd2407b4819874bed09cb27959a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:53:07.651268 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-464098f0-7172-4f14-abac-d96b8a87d021 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] 10.222.0.26 "GET /compute/v2.1/servers/279361ef-2171-49e1-9f33-eadbf5dc0313" status: 200 len: 1310 microversion: 2.1 time: 0.506869 Oct 08 20:53:07.652233 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 244/513] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:53:07 2022] GET /compute/v2.1/servers/279361ef-2171-49e1-9f33-eadbf5dc0313 => generated 1310 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 20:53:07.679560 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-bebfc684-1ae3-4e2e-b806-4c356fa21456 tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:07.680700 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-bebfc684-1ae3-4e2e-b806-4c356fa21456 tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] [instance: 1af12bcb-5e2a-4c15-8673-fa41701cb4c7] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:53:07.693049 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-9f7caa64-fb28-4f58-8e8e-01a72566d43f tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '360660f7bb4746c8b1397f4857f423f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d702b3083bc4cf5ba6b6fc6f3c3147e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:53:07.694028 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bebfc684-1ae3-4e2e-b806-4c356fa21456 tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:07.697385 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bebfc684-1ae3-4e2e-b806-4c356fa21456 tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:07.698295 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bebfc684-1ae3-4e2e-b806-4c356fa21456 tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:07.700544 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bebfc684-1ae3-4e2e-b806-4c356fa21456 tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:07.701229 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bebfc684-1ae3-4e2e-b806-4c356fa21456 tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:07.702762 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bebfc684-1ae3-4e2e-b806-4c356fa21456 tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:07.722045 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-9f7caa64-fb28-4f58-8e8e-01a72566d43f tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] 10.222.0.26 "GET /compute/v2.1/servers/6de2ea26-e774-47b5-8506-b3ebbc2d1712" status: 200 len: 1321 microversion: 2.1 time: 0.688380 Oct 08 20:53:07.723257 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 270/514] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:53:07 2022] GET /compute/v2.1/servers/6de2ea26-e774-47b5-8506-b3ebbc2d1712 => generated 1321 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:53:07.738120 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-65631e52-0624-43c9-9396-c37ae21acdb7 req-a5ea6914-5eda-4ebe-9237-1f204effbdd3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73fd15ea-e4bd-4310-93bb-147b0a5e27ef", "tag": "27f3cc41-9f72-499b-bae1-fb66f8f24df7"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:53:07.753729 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-65631e52-0624-43c9-9396-c37ae21acdb7 req-a5ea6914-5eda-4ebe-9237-1f204effbdd3 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:07.761766 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-65631e52-0624-43c9-9396-c37ae21acdb7 req-a5ea6914-5eda-4ebe-9237-1f204effbdd3 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:07.762438 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-65631e52-0624-43c9-9396-c37ae21acdb7 req-a5ea6914-5eda-4ebe-9237-1f204effbdd3 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:07.783179 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-65631e52-0624-43c9-9396-c37ae21acdb7 req-a5ea6914-5eda-4ebe-9237-1f204effbdd3 service nova] Creating event network-changed:27f3cc41-9f72-499b-bae1-fb66f8f24df7 for instance 73fd15ea-e4bd-4310-93bb-147b0a5e27ef on nch2-master-1 Oct 08 20:53:07.792193 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-65631e52-0624-43c9-9396-c37ae21acdb7 req-a5ea6914-5eda-4ebe-9237-1f204effbdd3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066398 Oct 08 20:53:07.792824 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 271/515] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:53:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:53:07.808153 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-3cc4691f-7716-42e3-8046-aafa3c188e79 tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:07.809126 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-3cc4691f-7716-42e3-8046-aafa3c188e79 tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] [instance: 8216e713-dfa1-4625-b8ea-5869cf617f4f] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:53:07.819132 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3cc4691f-7716-42e3-8046-aafa3c188e79 tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:07.819955 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3cc4691f-7716-42e3-8046-aafa3c188e79 tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:07.820736 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3cc4691f-7716-42e3-8046-aafa3c188e79 tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:07.823404 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3cc4691f-7716-42e3-8046-aafa3c188e79 tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:07.824551 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3cc4691f-7716-42e3-8046-aafa3c188e79 tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:07.827641 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3cc4691f-7716-42e3-8046-aafa3c188e79 tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:07.932232 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.objects.instance [None req-bebfc684-1ae3-4e2e-b806-4c356fa21456 tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Lazy-loading 'services' on Instance uuid 1af12bcb-5e2a-4c15-8673-fa41701cb4c7 {{(pid=140491) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 20:53:07.973564 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-bebfc684-1ae3-4e2e-b806-4c356fa21456 tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/1af12bcb-5e2a-4c15-8673-fa41701cb4c7" status: 200 len: 1929 microversion: 2.75 time: 0.320068 Oct 08 20:53:07.974882 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 245/516] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:53:07 2022] GET /compute/v2.1/servers/1af12bcb-5e2a-4c15-8673-fa41701cb4c7 => generated 1929 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:53:08.002849 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-f4d00448-cbe8-4736-a235-2e4dc17ad727 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:08.004177 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-f4d00448-cbe8-4736-a235-2e4dc17ad727 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] [instance: 5c864780-3998-4a09-95d4-e000a02af71e] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:53:08.013425 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f4d00448-cbe8-4736-a235-2e4dc17ad727 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:08.016330 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f4d00448-cbe8-4736-a235-2e4dc17ad727 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:08.016891 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f4d00448-cbe8-4736-a235-2e4dc17ad727 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:08.017695 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f4d00448-cbe8-4736-a235-2e4dc17ad727 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:08.019038 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f4d00448-cbe8-4736-a235-2e4dc17ad727 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:08.019962 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f4d00448-cbe8-4736-a235-2e4dc17ad727 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:08.315825 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-3cc4691f-7716-42e3-8046-aafa3c188e79 tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd637d2fa21649a1b00f27e7d86f3003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d547f95cc6043b0bb9b6a94b2e354a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:53:08.331716 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-3cc4691f-7716-42e3-8046-aafa3c188e79 tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] 10.222.0.26 "GET /compute/v2.1/servers/8216e713-dfa1-4625-b8ea-5869cf617f4f" status: 200 len: 1464 microversion: 2.1 time: 0.534505 Oct 08 20:53:08.332706 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 272/517] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:53:07 2022] GET /compute/v2.1/servers/8216e713-dfa1-4625-b8ea-5869cf617f4f => generated 1464 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:53:08.586362 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-f4d00448-cbe8-4736-a235-2e4dc17ad727 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef659f5a1a24c439528a7675bdd70f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c92fe04ab8248399d0acb932f82d607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:53:08.596671 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-f4d00448-cbe8-4736-a235-2e4dc17ad727 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] 10.222.0.26 "GET /compute/v2.1/servers/5c864780-3998-4a09-95d4-e000a02af71e" status: 200 len: 1313 microversion: 2.1 time: 0.605904 Oct 08 20:53:08.597762 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 246/518] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:53:07 2022] GET /compute/v2.1/servers/5c864780-3998-4a09-95d4-e000a02af71e => generated 1313 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:53:08.612243 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-615d0198-6ce5-4ea7-a5bf-a49dc3aa7466 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1648172432", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "172903658", "adminPass": "***", "networks": [{"uuid": "ec0135a9-c543-49eb-bf82-1b3cd38a718e"}], "security_groups": [{"name": "tempest-securitygroup--1541716159"}], "key_name": "tempest-keypair-220477781", "user_data": "}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:53:08.808433 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-a490a76a-e51c-4730-a4b5-b39c930262e8 tempest-TenantUsagesTestJSON-1250321069 tempest-TenantUsagesTestJSON-1250321069-project-admin] Calling method '.version_select at 0x7f1a8cf901f0>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:08.840884 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a490a76a-e51c-4730-a4b5-b39c930262e8 tempest-TenantUsagesTestJSON-1250321069 tempest-TenantUsagesTestJSON-1250321069-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:08.841779 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a490a76a-e51c-4730-a4b5-b39c930262e8 tempest-TenantUsagesTestJSON-1250321069 tempest-TenantUsagesTestJSON-1250321069-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:08.842195 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a490a76a-e51c-4730-a4b5-b39c930262e8 tempest-TenantUsagesTestJSON-1250321069 tempest-TenantUsagesTestJSON-1250321069-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:08.873717 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a490a76a-e51c-4730-a4b5-b39c930262e8 tempest-TenantUsagesTestJSON-1250321069 tempest-TenantUsagesTestJSON-1250321069-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:08.874877 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a490a76a-e51c-4730-a4b5-b39c930262e8 tempest-TenantUsagesTestJSON-1250321069 tempest-TenantUsagesTestJSON-1250321069-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:08.875345 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a490a76a-e51c-4730-a4b5-b39c930262e8 tempest-TenantUsagesTestJSON-1250321069 tempest-TenantUsagesTestJSON-1250321069-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:08.894961 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.network.neutron [None req-615d0198-6ce5-4ea7-a5bf-a49dc3aa7466 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] validate_networks() for [('ec0135a9-c543-49eb-bf82-1b3cd38a718e', None, None, None, None, None)] {{(pid=140491) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 20:53:08.914266 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-a490a76a-e51c-4730-a4b5-b39c930262e8 tempest-TenantUsagesTestJSON-1250321069 tempest-TenantUsagesTestJSON-1250321069-project-admin] 10.222.0.26 "GET /compute/v2.1/os-simple-tenant-usage/1d547f95cc6043b0bb9b6a94b2e354a5?start=2022-10-07T20%3A53%3A08.349820&end=2022-10-09T20%3A53%3A08.349820" status: 200 len: 695 microversion: 2.1 time: 0.558876 Oct 08 20:53:08.915071 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 273/519] 10.222.0.26 () {58 vars in 1412 bytes} [Sat Oct 8 20:53:08 2022] GET /compute/v2.1/os-simple-tenant-usage/1d547f95cc6043b0bb9b6a94b2e354a5?start=2022-10-07T20%3A53%3A08.349820&end=2022-10-09T20%3A53%3A08.349820 => generated 695 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:53:08.932121 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-c33bbaab-e1c8-4f73-9b32-1abf3c5267b0 req-0f8c4627-1570-4b35-b21d-f2c06f8769a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "279361ef-2171-49e1-9f33-eadbf5dc0313", "tag": "331433c9-6d41-4903-b1f6-3eedf2e2ae2d"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:53:08.944556 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-c33bbaab-e1c8-4f73-9b32-1abf3c5267b0 req-0f8c4627-1570-4b35-b21d-f2c06f8769a5 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:08.945142 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-c33bbaab-e1c8-4f73-9b32-1abf3c5267b0 req-0f8c4627-1570-4b35-b21d-f2c06f8769a5 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:08.945686 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-c33bbaab-e1c8-4f73-9b32-1abf3c5267b0 req-0f8c4627-1570-4b35-b21d-f2c06f8769a5 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:08.958186 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-c33bbaab-e1c8-4f73-9b32-1abf3c5267b0 req-0f8c4627-1570-4b35-b21d-f2c06f8769a5 service nova] Creating event network-changed:331433c9-6d41-4903-b1f6-3eedf2e2ae2d for instance 279361ef-2171-49e1-9f33-eadbf5dc0313 on nch2-master-1 Oct 08 20:53:08.964132 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-c33bbaab-e1c8-4f73-9b32-1abf3c5267b0 req-0f8c4627-1570-4b35-b21d-f2c06f8769a5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035668 Oct 08 20:53:08.964924 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 274/520] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:53:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:53:08.971757 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-4b93606f-db96-43d9-86dc-d372c280b6fa tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:08.972553 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-4b93606f-db96-43d9-86dc-d372c280b6fa tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] [instance: 279361ef-2171-49e1-9f33-eadbf5dc0313] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:53:08.979711 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4b93606f-db96-43d9-86dc-d372c280b6fa tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:08.980753 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4b93606f-db96-43d9-86dc-d372c280b6fa tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:08.981234 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4b93606f-db96-43d9-86dc-d372c280b6fa tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:08.982409 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4b93606f-db96-43d9-86dc-d372c280b6fa tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:08.984713 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4b93606f-db96-43d9-86dc-d372c280b6fa tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:08.986757 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4b93606f-db96-43d9-86dc-d372c280b6fa tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:09.178996 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-4b93606f-db96-43d9-86dc-d372c280b6fa tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474ca64d1b1d4e30916b517645aba882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecc2dd2407b4819874bed09cb27959a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:53:09.190677 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-4b93606f-db96-43d9-86dc-d372c280b6fa tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] 10.222.0.26 "GET /compute/v2.1/servers/279361ef-2171-49e1-9f33-eadbf5dc0313" status: 200 len: 1310 microversion: 2.1 time: 0.224362 Oct 08 20:53:09.206467 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 275/521] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:53:08 2022] GET /compute/v2.1/servers/279361ef-2171-49e1-9f33-eadbf5dc0313 => generated 1310 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:53:09.215826 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-bfce12e5-3ce3-4f81-b9d5-c76238ead85d tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:09.217209 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-bfce12e5-3ce3-4f81-b9d5-c76238ead85d tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] [instance: 6de2ea26-e774-47b5-8506-b3ebbc2d1712] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:53:09.224313 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bfce12e5-3ce3-4f81-b9d5-c76238ead85d tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:09.225225 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bfce12e5-3ce3-4f81-b9d5-c76238ead85d tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:09.226131 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bfce12e5-3ce3-4f81-b9d5-c76238ead85d tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:09.227482 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bfce12e5-3ce3-4f81-b9d5-c76238ead85d tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:09.228126 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bfce12e5-3ce3-4f81-b9d5-c76238ead85d tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:09.228739 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bfce12e5-3ce3-4f81-b9d5-c76238ead85d tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:09.411035 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-bfce12e5-3ce3-4f81-b9d5-c76238ead85d tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '360660f7bb4746c8b1397f4857f423f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d702b3083bc4cf5ba6b6fc6f3c3147e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:53:09.414547 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=100 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:53:09.419533 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-bfce12e5-3ce3-4f81-b9d5-c76238ead85d tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] 10.222.0.26 "GET /compute/v2.1/servers/6de2ea26-e774-47b5-8506-b3ebbc2d1712" status: 200 len: 1321 microversion: 2.1 time: 0.211711 Oct 08 20:53:09.420048 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 276/522] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:53:09 2022] GET /compute/v2.1/servers/6de2ea26-e774-47b5-8506-b3ebbc2d1712 => generated 1321 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:53:09.429214 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-b69f9445-619a-4365-b049-bb7057e65595 tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Calling method '.version_select at 0x7f1a8cf90160>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:09.444156 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b69f9445-619a-4365-b049-bb7057e65595 tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:09.444710 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b69f9445-619a-4365-b049-bb7057e65595 tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:09.445420 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b69f9445-619a-4365-b049-bb7057e65595 tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:09.457644 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b69f9445-619a-4365-b049-bb7057e65595 tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:09.458518 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b69f9445-619a-4365-b049-bb7057e65595 tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:09.459076 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b69f9445-619a-4365-b049-bb7057e65595 tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:09.485782 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-b69f9445-619a-4365-b049-bb7057e65595 tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] 10.222.0.26 "GET /compute/v2.1/os-simple-tenant-usage/1d547f95cc6043b0bb9b6a94b2e354a5?start=2022-10-07T20%3A53%3A08.349820&end=2022-10-09T20%3A53%3A08.349820" status: 200 len: 695 microversion: 2.1 time: 0.060946 Oct 08 20:53:09.487018 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 277/523] 10.222.0.26 () {58 vars in 1412 bytes} [Sat Oct 8 20:53:09 2022] GET /compute/v2.1/os-simple-tenant-usage/1d547f95cc6043b0bb9b6a94b2e354a5?start=2022-10-07T20%3A53%3A08.349820&end=2022-10-09T20%3A53%3A08.349820 => generated 695 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:53:09.493908 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-27095ff9-0ffe-42d5-b478-807907da2ef8 tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:09.494729 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-27095ff9-0ffe-42d5-b478-807907da2ef8 tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] [instance: 1af12bcb-5e2a-4c15-8673-fa41701cb4c7] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:53:09.510542 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-27095ff9-0ffe-42d5-b478-807907da2ef8 tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:09.511039 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-27095ff9-0ffe-42d5-b478-807907da2ef8 tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:09.511476 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-27095ff9-0ffe-42d5-b478-807907da2ef8 tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:09.512185 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-27095ff9-0ffe-42d5-b478-807907da2ef8 tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:09.512873 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-27095ff9-0ffe-42d5-b478-807907da2ef8 tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:09.513069 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-27095ff9-0ffe-42d5-b478-807907da2ef8 tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:09.662625 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.objects.instance [None req-27095ff9-0ffe-42d5-b478-807907da2ef8 tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Lazy-loading 'services' on Instance uuid 1af12bcb-5e2a-4c15-8673-fa41701cb4c7 {{(pid=140492) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 20:53:09.697722 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-27095ff9-0ffe-42d5-b478-807907da2ef8 tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/1af12bcb-5e2a-4c15-8673-fa41701cb4c7" status: 200 len: 1929 microversion: 2.75 time: 0.209281 Oct 08 20:53:09.709591 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 278/524] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:53:09 2022] GET /compute/v2.1/servers/1af12bcb-5e2a-4c15-8673-fa41701cb4c7 => generated 1929 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:53:09.716358 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-7efcfd93-d0b0-40b2-affc-03ecde06d347 tempest-TenantUsagesTestJSON-1250321069 tempest-TenantUsagesTestJSON-1250321069-project-admin] Calling method '.version_select at 0x7f1a8cdef3a0>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:09.734272 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7efcfd93-d0b0-40b2-affc-03ecde06d347 tempest-TenantUsagesTestJSON-1250321069 tempest-TenantUsagesTestJSON-1250321069-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:09.734934 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7efcfd93-d0b0-40b2-affc-03ecde06d347 tempest-TenantUsagesTestJSON-1250321069 tempest-TenantUsagesTestJSON-1250321069-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:09.735527 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7efcfd93-d0b0-40b2-affc-03ecde06d347 tempest-TenantUsagesTestJSON-1250321069 tempest-TenantUsagesTestJSON-1250321069-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:09.752922 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-615d0198-6ce5-4ea7-a5bf-a49dc3aa7466 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Flavor limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 20:53:09.754705 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-615d0198-6ce5-4ea7-a5bf-a49dc3aa7466 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Image limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 20:53:09.755205 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-615d0198-6ce5-4ea7-a5bf-a49dc3aa7466 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Flavor pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 20:53:09.755627 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-615d0198-6ce5-4ea7-a5bf-a49dc3aa7466 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Image pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 20:53:09.756048 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-615d0198-6ce5-4ea7-a5bf-a49dc3aa7466 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 20:53:09.773953 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-615d0198-6ce5-4ea7-a5bf-a49dc3aa7466 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:09.774446 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-615d0198-6ce5-4ea7-a5bf-a49dc3aa7466 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:09.774889 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-615d0198-6ce5-4ea7-a5bf-a49dc3aa7466 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:09.775632 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-615d0198-6ce5-4ea7-a5bf-a49dc3aa7466 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:09.775985 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7efcfd93-d0b0-40b2-affc-03ecde06d347 tempest-TenantUsagesTestJSON-1250321069 tempest-TenantUsagesTestJSON-1250321069-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:09.776119 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-615d0198-6ce5-4ea7-a5bf-a49dc3aa7466 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:09.776503 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-615d0198-6ce5-4ea7-a5bf-a49dc3aa7466 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:09.777167 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7efcfd93-d0b0-40b2-affc-03ecde06d347 tempest-TenantUsagesTestJSON-1250321069 tempest-TenantUsagesTestJSON-1250321069-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:09.777812 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7efcfd93-d0b0-40b2-affc-03ecde06d347 tempest-TenantUsagesTestJSON-1250321069 tempest-TenantUsagesTestJSON-1250321069-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:09.818733 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-615d0198-6ce5-4ea7-a5bf-a49dc3aa7466 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Getting quotas for project 3f2441394d754f499e27f6f35d5b3afa. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 20:53:09.833561 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-615d0198-6ce5-4ea7-a5bf-a49dc3aa7466 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Getting quotas for user 98936da9b5d94165b386d2d0893ac142 and project 3f2441394d754f499e27f6f35d5b3afa. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 20:53:09.844909 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-7efcfd93-d0b0-40b2-affc-03ecde06d347 tempest-TenantUsagesTestJSON-1250321069 tempest-TenantUsagesTestJSON-1250321069-project-admin] 10.222.0.26 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-07T20%3A53%3A08.349820&end=2022-10-09T20%3A53%3A08.349820&detailed=1" status: 200 len: 4582 microversion: 2.1 time: 0.131957 Oct 08 20:53:09.846423 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 279/525] 10.222.0.26 () {58 vars in 1335 bytes} [Sat Oct 8 20:53:09 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-07T20%3A53%3A08.349820&end=2022-10-09T20%3A53%3A08.349820&detailed=1 => generated 4582 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:53:09.859131 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-615d0198-6ce5-4ea7-a5bf-a49dc3aa7466 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Going to run 1 instances... {{(pid=140491) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 20:53:09.860384 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-615d0198-6ce5-4ea7-a5bf-a49dc3aa7466 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] [instance: 99d20873-ce34-47a4-bbe6-5b42e406a360] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c508bd7f-7db9-4b2c-af7c-be54a855c355',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140491) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 20:53:09.871173 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-c2d63885-6462-4e95-a6ff-96f3818856ca tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:09.871760 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-c2d63885-6462-4e95-a6ff-96f3818856ca tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] [instance: 5c864780-3998-4a09-95d4-e000a02af71e] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:53:09.916396 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c2d63885-6462-4e95-a6ff-96f3818856ca tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:09.916933 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c2d63885-6462-4e95-a6ff-96f3818856ca tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:09.918536 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c2d63885-6462-4e95-a6ff-96f3818856ca tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:09.922972 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c2d63885-6462-4e95-a6ff-96f3818856ca tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:09.923637 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c2d63885-6462-4e95-a6ff-96f3818856ca tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:09.924899 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c2d63885-6462-4e95-a6ff-96f3818856ca tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:09.966888 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-615d0198-6ce5-4ea7-a5bf-a49dc3aa7466 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.366034 Oct 08 20:53:09.989911 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 247/526] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 20:53:08 2022] POST /compute/v2.1/servers => generated 402 bytes in 1390 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 08 20:53:10.000259 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-7d1c87e1-339e-4413-84ee-421d7edc307c tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:10.000776 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-7d1c87e1-339e-4413-84ee-421d7edc307c tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] [instance: 8216e713-dfa1-4625-b8ea-5869cf617f4f] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:53:10.016519 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7d1c87e1-339e-4413-84ee-421d7edc307c tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:10.018077 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7d1c87e1-339e-4413-84ee-421d7edc307c tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:10.018525 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7d1c87e1-339e-4413-84ee-421d7edc307c tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:10.019250 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7d1c87e1-339e-4413-84ee-421d7edc307c tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:10.019713 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7d1c87e1-339e-4413-84ee-421d7edc307c tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:10.022581 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7d1c87e1-339e-4413-84ee-421d7edc307c tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:10.110873 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-7d1c87e1-339e-4413-84ee-421d7edc307c tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] [instance: 8216e713-dfa1-4625-b8ea-5869cf617f4f] Going to try to terminate instance {{(pid=140491) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 20:53:10.244011 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:INSERT=10,nova_api:SELECT=86,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:53:10.278128 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-7d1c87e1-339e-4413-84ee-421d7edc307c tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] 10.222.0.26 "DELETE /compute/v2.1/servers/8216e713-dfa1-4625-b8ea-5869cf617f4f" status: 204 len: 0 microversion: 2.1 time: 0.285404 Oct 08 20:53:10.283057 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 248/527] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 20:53:09 2022] DELETE /compute/v2.1/servers/8216e713-dfa1-4625-b8ea-5869cf617f4f => generated 0 bytes in 289 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 20:53:10.289305 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-85fbe7c8-0987-491e-b58a-719730e8aa5b req-89ca65b2-74be-49f5-af6a-c2f19fa8f404 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c864780-3998-4a09-95d4-e000a02af71e", "tag": "74d30b45-d23b-46ee-9285-24066d68f449"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:53:10.303352 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-85fbe7c8-0987-491e-b58a-719730e8aa5b req-89ca65b2-74be-49f5-af6a-c2f19fa8f404 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:10.304137 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-85fbe7c8-0987-491e-b58a-719730e8aa5b req-89ca65b2-74be-49f5-af6a-c2f19fa8f404 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:10.304777 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-85fbe7c8-0987-491e-b58a-719730e8aa5b req-89ca65b2-74be-49f5-af6a-c2f19fa8f404 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:10.322778 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-85fbe7c8-0987-491e-b58a-719730e8aa5b req-89ca65b2-74be-49f5-af6a-c2f19fa8f404 service nova] Creating event network-changed:74d30b45-d23b-46ee-9285-24066d68f449 for instance 5c864780-3998-4a09-95d4-e000a02af71e on nch2-master-1 Oct 08 20:53:10.329373 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-85fbe7c8-0987-491e-b58a-719730e8aa5b req-89ca65b2-74be-49f5-af6a-c2f19fa8f404 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043679 Oct 08 20:53:10.330551 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 249/528] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:53:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:53:10.336226 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-80205179-2d4e-41ea-ac48-c6d4714a27e8 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:10.337559 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-80205179-2d4e-41ea-ac48-c6d4714a27e8 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] [instance: 99d20873-ce34-47a4-bbe6-5b42e406a360] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:53:10.403264 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-80205179-2d4e-41ea-ac48-c6d4714a27e8 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98936da9b5d94165b386d2d0893ac142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2441394d754f499e27f6f35d5b3afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:53:10.410806 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-80205179-2d4e-41ea-ac48-c6d4714a27e8 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] 10.222.0.26 "GET /compute/v2.1/servers/99d20873-ce34-47a4-bbe6-5b42e406a360" status: 200 len: 1262 microversion: 2.1 time: 0.078700 Oct 08 20:53:10.412457 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 250/529] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:53:10 2022] GET /compute/v2.1/servers/99d20873-ce34-47a4-bbe6-5b42e406a360 => generated 1262 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:53:10.417732 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-1e02ed3e-e279-417f-a1e6-c2b6c1faf2c2 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:10.418636 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-1e02ed3e-e279-417f-a1e6-c2b6c1faf2c2 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] [instance: 279361ef-2171-49e1-9f33-eadbf5dc0313] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:53:10.426895 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1e02ed3e-e279-417f-a1e6-c2b6c1faf2c2 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:10.427666 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1e02ed3e-e279-417f-a1e6-c2b6c1faf2c2 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:10.428476 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1e02ed3e-e279-417f-a1e6-c2b6c1faf2c2 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:10.429732 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1e02ed3e-e279-417f-a1e6-c2b6c1faf2c2 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:10.430159 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1e02ed3e-e279-417f-a1e6-c2b6c1faf2c2 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:10.430611 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1e02ed3e-e279-417f-a1e6-c2b6c1faf2c2 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:10.438913 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:53:10.621761 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-1e02ed3e-e279-417f-a1e6-c2b6c1faf2c2 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474ca64d1b1d4e30916b517645aba882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecc2dd2407b4819874bed09cb27959a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:53:10.630911 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-1e02ed3e-e279-417f-a1e6-c2b6c1faf2c2 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] 10.222.0.26 "GET /compute/v2.1/servers/279361ef-2171-49e1-9f33-eadbf5dc0313" status: 200 len: 1310 microversion: 2.1 time: 0.217103 Oct 08 20:53:10.631915 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 251/530] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:53:10 2022] GET /compute/v2.1/servers/279361ef-2171-49e1-9f33-eadbf5dc0313 => generated 1310 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:53:10.636773 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-88a20c21-7328-41b0-962a-8a5c2504500a tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:10.637489 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-88a20c21-7328-41b0-962a-8a5c2504500a tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] [instance: 8216e713-dfa1-4625-b8ea-5869cf617f4f] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:53:10.643844 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-88a20c21-7328-41b0-962a-8a5c2504500a tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:10.644602 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-88a20c21-7328-41b0-962a-8a5c2504500a tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:10.645370 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-88a20c21-7328-41b0-962a-8a5c2504500a tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:10.646319 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-88a20c21-7328-41b0-962a-8a5c2504500a tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:10.646990 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-88a20c21-7328-41b0-962a-8a5c2504500a tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:10.647637 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-88a20c21-7328-41b0-962a-8a5c2504500a tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:10.710192 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-c2d63885-6462-4e95-a6ff-96f3818856ca tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef659f5a1a24c439528a7675bdd70f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c92fe04ab8248399d0acb932f82d607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:53:10.722223 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-c2d63885-6462-4e95-a6ff-96f3818856ca tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] 10.222.0.26 "GET /compute/v2.1/servers/5c864780-3998-4a09-95d4-e000a02af71e" status: 200 len: 1313 microversion: 2.1 time: 0.870973 Oct 08 20:53:10.725544 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 280/531] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:53:09 2022] GET /compute/v2.1/servers/5c864780-3998-4a09-95d4-e000a02af71e => generated 1313 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:53:10.734058 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-688dd284-c50a-4e9f-99b3-48197c09aaf8 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:10.734949 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-688dd284-c50a-4e9f-99b3-48197c09aaf8 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] [instance: 6de2ea26-e774-47b5-8506-b3ebbc2d1712] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:53:10.758611 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-688dd284-c50a-4e9f-99b3-48197c09aaf8 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:10.761834 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-688dd284-c50a-4e9f-99b3-48197c09aaf8 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:10.762583 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-688dd284-c50a-4e9f-99b3-48197c09aaf8 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:10.763585 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-688dd284-c50a-4e9f-99b3-48197c09aaf8 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:10.775860 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-688dd284-c50a-4e9f-99b3-48197c09aaf8 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:10.777909 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-688dd284-c50a-4e9f-99b3-48197c09aaf8 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:10.839182 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-88a20c21-7328-41b0-962a-8a5c2504500a tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd637d2fa21649a1b00f27e7d86f3003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d547f95cc6043b0bb9b6a94b2e354a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:53:10.848106 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-88a20c21-7328-41b0-962a-8a5c2504500a tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] 10.222.0.26 "GET /compute/v2.1/servers/8216e713-dfa1-4625-b8ea-5869cf617f4f" status: 200 len: 1470 microversion: 2.1 time: 0.214892 Oct 08 20:53:10.849039 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 252/532] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:53:10 2022] GET /compute/v2.1/servers/8216e713-dfa1-4625-b8ea-5869cf617f4f => generated 1470 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:53:10.854197 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-9121cf60-55e2-495e-a189-84b59876f184 tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:10.855081 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-9121cf60-55e2-495e-a189-84b59876f184 tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] [instance: 1af12bcb-5e2a-4c15-8673-fa41701cb4c7] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:53:10.870362 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9121cf60-55e2-495e-a189-84b59876f184 tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:10.870855 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9121cf60-55e2-495e-a189-84b59876f184 tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:10.871469 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9121cf60-55e2-495e-a189-84b59876f184 tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:10.872195 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9121cf60-55e2-495e-a189-84b59876f184 tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:10.872660 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9121cf60-55e2-495e-a189-84b59876f184 tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:10.873119 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9121cf60-55e2-495e-a189-84b59876f184 tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:10.954486 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.objects.instance [None req-9121cf60-55e2-495e-a189-84b59876f184 tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Lazy-loading 'services' on Instance uuid 1af12bcb-5e2a-4c15-8673-fa41701cb4c7 {{(pid=140491) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 20:53:10.972486 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-9121cf60-55e2-495e-a189-84b59876f184 tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/1af12bcb-5e2a-4c15-8673-fa41701cb4c7" status: 200 len: 1929 microversion: 2.75 time: 0.121813 Oct 08 20:53:10.973103 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 253/533] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:53:10 2022] GET /compute/v2.1/servers/1af12bcb-5e2a-4c15-8673-fa41701cb4c7 => generated 1929 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:53:10.995150 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-89534c2c-228d-4b33-81af-4537a2e2fd58 req-749b2234-2219-4499-b30a-1b60ae30791a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6de2ea26-e774-47b5-8506-b3ebbc2d1712", "tag": "e7201ad3-9c78-422c-ab85-5ab7a68b8b12"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:53:11.006238 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-89534c2c-228d-4b33-81af-4537a2e2fd58 req-749b2234-2219-4499-b30a-1b60ae30791a service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:11.006724 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-89534c2c-228d-4b33-81af-4537a2e2fd58 req-749b2234-2219-4499-b30a-1b60ae30791a service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:11.007789 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-89534c2c-228d-4b33-81af-4537a2e2fd58 req-749b2234-2219-4499-b30a-1b60ae30791a service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:11.020725 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-89534c2c-228d-4b33-81af-4537a2e2fd58 req-749b2234-2219-4499-b30a-1b60ae30791a service nova] Creating event network-changed:e7201ad3-9c78-422c-ab85-5ab7a68b8b12 for instance 6de2ea26-e774-47b5-8506-b3ebbc2d1712 on nch1-master-1 Oct 08 20:53:11.022966 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-688dd284-c50a-4e9f-99b3-48197c09aaf8 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '360660f7bb4746c8b1397f4857f423f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d702b3083bc4cf5ba6b6fc6f3c3147e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:53:11.026681 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-89534c2c-228d-4b33-81af-4537a2e2fd58 req-749b2234-2219-4499-b30a-1b60ae30791a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035762 Oct 08 20:53:11.029759 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 254/534] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:53:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:53:11.032471 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-688dd284-c50a-4e9f-99b3-48197c09aaf8 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] 10.222.0.26 "GET /compute/v2.1/servers/6de2ea26-e774-47b5-8506-b3ebbc2d1712" status: 200 len: 1321 microversion: 2.1 time: 0.305315 Oct 08 20:53:11.033255 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 281/535] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:53:10 2022] GET /compute/v2.1/servers/6de2ea26-e774-47b5-8506-b3ebbc2d1712 => generated 1321 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:53:11.289495 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-a4f610b4-4ff1-48c6-840c-ae1e455bfc27 tempest-FlavorsV255TestJSON-1296077506 tempest-FlavorsV255TestJSON-1296077506-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-1651752282", "id": 652928106, "os-flavor-access:is_public": "True"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:53:11.313140 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-a4f610b4-4ff1-48c6-840c-ae1e455bfc27 tempest-FlavorsV255TestJSON-1296077506 tempest-FlavorsV255TestJSON-1296077506-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 446 microversion: 2.55 time: 0.223460 Oct 08 20:53:11.315140 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 255/536] 10.222.0.26 () {62 vars in 1188 bytes} [Sat Oct 8 20:53:11 2022] POST /compute/v2.1/flavors => generated 446 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 08 20:53:11.437084 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-a278d07c-4102-47ac-9227-3978645aa1c4 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:11.438492 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-a278d07c-4102-47ac-9227-3978645aa1c4 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] [instance: 99d20873-ce34-47a4-bbe6-5b42e406a360] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:53:11.451090 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a278d07c-4102-47ac-9227-3978645aa1c4 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:11.451654 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a278d07c-4102-47ac-9227-3978645aa1c4 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:11.452648 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a278d07c-4102-47ac-9227-3978645aa1c4 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:11.456623 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a278d07c-4102-47ac-9227-3978645aa1c4 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:11.457137 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a278d07c-4102-47ac-9227-3978645aa1c4 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:11.459586 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a278d07c-4102-47ac-9227-3978645aa1c4 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:11.497324 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-c3b2f336-ba47-4367-8497-4077d3b6deb3 tempest-FlavorsV255TestJSON-704015741 tempest-FlavorsV255TestJSON-704015741-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:11.521606 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-c3b2f336-ba47-4367-8497-4077d3b6deb3 tempest-FlavorsV255TestJSON-704015741 tempest-FlavorsV255TestJSON-704015741-project] 10.222.0.26 "GET /compute/v2.1/flavors/652928106" status: 200 len: 446 microversion: 2.55 time: 0.197338 Oct 08 20:53:11.526183 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 282/537] 10.222.0.26 () {60 vars in 1196 bytes} [Sat Oct 8 20:53:11 2022] GET /compute/v2.1/flavors/652928106 => generated 446 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 08 20:53:11.545127 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-6452864e-aa1b-4481-b1fc-97e108ad9ebf tempest-FlavorsV255TestJSON-1296077506 tempest-FlavorsV255TestJSON-1296077506-project-admin] Action: 'update', calling method: , body: {"flavor": {"description": "new"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:53:11.606931 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-6452864e-aa1b-4481-b1fc-97e108ad9ebf tempest-FlavorsV255TestJSON-1296077506 tempest-FlavorsV255TestJSON-1296077506-project-admin] 10.222.0.26 "PUT /compute/v2.1/flavors/652928106" status: 200 len: 447 microversion: 2.55 time: 0.070622 Oct 08 20:53:11.617695 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 283/538] 10.222.0.26 () {62 vars in 1216 bytes} [Sat Oct 8 20:53:11 2022] PUT /compute/v2.1/flavors/652928106 => generated 447 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 08 20:53:11.623202 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-c91b4bd8-01d2-4959-829e-fa8558de7ed9 tempest-FlavorsV255TestJSON-704015741 tempest-FlavorsV255TestJSON-704015741-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:11.659388 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-a278d07c-4102-47ac-9227-3978645aa1c4 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98936da9b5d94165b386d2d0893ac142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2441394d754f499e27f6f35d5b3afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:53:11.670034 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-c91b4bd8-01d2-4959-829e-fa8558de7ed9 tempest-FlavorsV255TestJSON-704015741 tempest-FlavorsV255TestJSON-704015741-project] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 6590 microversion: 2.55 time: 0.051021 Oct 08 20:53:11.670542 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-a278d07c-4102-47ac-9227-3978645aa1c4 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] 10.222.0.26 "GET /compute/v2.1/servers/99d20873-ce34-47a4-bbe6-5b42e406a360" status: 200 len: 1314 microversion: 2.1 time: 0.238130 Oct 08 20:53:11.677433 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 284/539] 10.222.0.26 () {60 vars in 1187 bytes} [Sat Oct 8 20:53:11 2022] GET /compute/v2.1/flavors/detail => generated 6590 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:53:11.678142 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 256/540] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:53:11 2022] GET /compute/v2.1/servers/99d20873-ce34-47a4-bbe6-5b42e406a360 => generated 1314 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 20:53:11.687318 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-7d8fbe19-63e5-448b-99b6-1830c453443a tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:11.687939 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-7d8fbe19-63e5-448b-99b6-1830c453443a tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] [instance: 279361ef-2171-49e1-9f33-eadbf5dc0313] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:53:11.696184 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-1d61351a-2af2-428b-ba1d-f7b9afa317b8 tempest-FlavorsV255TestJSON-704015741 tempest-FlavorsV255TestJSON-704015741-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:11.699485 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7d8fbe19-63e5-448b-99b6-1830c453443a tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:11.699981 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7d8fbe19-63e5-448b-99b6-1830c453443a tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:11.700429 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7d8fbe19-63e5-448b-99b6-1830c453443a tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:11.701158 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7d8fbe19-63e5-448b-99b6-1830c453443a tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:11.701647 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7d8fbe19-63e5-448b-99b6-1830c453443a tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:11.702134 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7d8fbe19-63e5-448b-99b6-1830c453443a tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:11.733072 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-1d61351a-2af2-428b-ba1d-f7b9afa317b8 tempest-FlavorsV255TestJSON-704015741 tempest-FlavorsV255TestJSON-704015741-project] 10.222.0.26 "GET /compute/v2.1/flavors" status: 200 len: 3680 microversion: 2.55 time: 0.040900 Oct 08 20:53:11.735056 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 257/541] 10.222.0.26 () {60 vars in 1166 bytes} [Sat Oct 8 20:53:11 2022] GET /compute/v2.1/flavors => generated 3680 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:53:11.752068 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-54a51f55-dcac-48fa-9fbc-be2c2d115a8a tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:11.753134 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-54a51f55-dcac-48fa-9fbc-be2c2d115a8a tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] [instance: 5c864780-3998-4a09-95d4-e000a02af71e] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:53:11.760535 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-54a51f55-dcac-48fa-9fbc-be2c2d115a8a tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:11.761731 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-54a51f55-dcac-48fa-9fbc-be2c2d115a8a tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:11.762410 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-54a51f55-dcac-48fa-9fbc-be2c2d115a8a tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:11.763526 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-54a51f55-dcac-48fa-9fbc-be2c2d115a8a tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:11.764439 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-54a51f55-dcac-48fa-9fbc-be2c2d115a8a tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:11.765245 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-54a51f55-dcac-48fa-9fbc-be2c2d115a8a tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:11.987868 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-54a51f55-dcac-48fa-9fbc-be2c2d115a8a tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef659f5a1a24c439528a7675bdd70f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c92fe04ab8248399d0acb932f82d607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:53:12.000289 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-54a51f55-dcac-48fa-9fbc-be2c2d115a8a tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] 10.222.0.26 "GET /compute/v2.1/servers/5c864780-3998-4a09-95d4-e000a02af71e" status: 200 len: 1313 microversion: 2.1 time: 0.252112 Oct 08 20:53:12.001195 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 258/542] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:53:11 2022] GET /compute/v2.1/servers/5c864780-3998-4a09-95d4-e000a02af71e => generated 1313 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 20:53:12.007300 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-e53340f2-1943-44d1-acf5-cdb60049be05 tempest-FlavorsV255TestJSON-1296077506 tempest-FlavorsV255TestJSON-1296077506-project-admin] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:12.021409 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-7d8fbe19-63e5-448b-99b6-1830c453443a tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474ca64d1b1d4e30916b517645aba882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecc2dd2407b4819874bed09cb27959a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:53:12.034733 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-e53340f2-1943-44d1-acf5-cdb60049be05 tempest-FlavorsV255TestJSON-1296077506 tempest-FlavorsV255TestJSON-1296077506-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/652928106" status: 202 len: 0 microversion: 2.55 time: 0.032327 Oct 08 20:53:12.035378 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-7d8fbe19-63e5-448b-99b6-1830c453443a tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] 10.222.0.26 "GET /compute/v2.1/servers/279361ef-2171-49e1-9f33-eadbf5dc0313" status: 200 len: 1310 microversion: 2.1 time: 0.362663 Oct 08 20:53:12.035925 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 259/543] 10.222.0.26 () {60 vars in 1199 bytes} [Sat Oct 8 20:53:12 2022] DELETE /compute/v2.1/flavors/652928106 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 08 20:53:12.036165 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 285/544] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:53:11 2022] GET /compute/v2.1/servers/279361ef-2171-49e1-9f33-eadbf5dc0313 => generated 1310 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:53:12.053498 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-6ac4ef3e-72a2-4f15-84f0-882bdf839e95 tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:12.054259 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-6ac4ef3e-72a2-4f15-84f0-882bdf839e95 tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] [instance: 1af12bcb-5e2a-4c15-8673-fa41701cb4c7] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:53:12.059773 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-b9796b17-4033-4730-8179-e630927d6a62 tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:12.060447 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-b9796b17-4033-4730-8179-e630927d6a62 tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] [instance: 8216e713-dfa1-4625-b8ea-5869cf617f4f] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:53:12.063114 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6ac4ef3e-72a2-4f15-84f0-882bdf839e95 tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:12.065654 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6ac4ef3e-72a2-4f15-84f0-882bdf839e95 tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:12.066287 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6ac4ef3e-72a2-4f15-84f0-882bdf839e95 tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:12.067022 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b9796b17-4033-4730-8179-e630927d6a62 tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:12.067172 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6ac4ef3e-72a2-4f15-84f0-882bdf839e95 tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:12.067498 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6ac4ef3e-72a2-4f15-84f0-882bdf839e95 tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:12.067946 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6ac4ef3e-72a2-4f15-84f0-882bdf839e95 tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:12.068344 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b9796b17-4033-4730-8179-e630927d6a62 tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:12.068951 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b9796b17-4033-4730-8179-e630927d6a62 tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:12.071408 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b9796b17-4033-4730-8179-e630927d6a62 tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:12.072063 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b9796b17-4033-4730-8179-e630927d6a62 tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:12.072520 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b9796b17-4033-4730-8179-e630927d6a62 tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:12.257938 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.objects.instance [None req-6ac4ef3e-72a2-4f15-84f0-882bdf839e95 tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Lazy-loading 'services' on Instance uuid 1af12bcb-5e2a-4c15-8673-fa41701cb4c7 {{(pid=140492) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 20:53:12.288708 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-6ac4ef3e-72a2-4f15-84f0-882bdf839e95 tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/1af12bcb-5e2a-4c15-8673-fa41701cb4c7" status: 200 len: 1929 microversion: 2.75 time: 0.251698 Oct 08 20:53:12.307282 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 286/545] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:53:12 2022] GET /compute/v2.1/servers/1af12bcb-5e2a-4c15-8673-fa41701cb4c7 => generated 1929 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:53:12.317927 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-2fb45b84-1bcb-440c-be87-fc9b408a3bcd tempest-FlavorsV255TestJSON-1296077506 tempest-FlavorsV255TestJSON-1296077506-project-admin] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:12.346158 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-2fb45b84-1bcb-440c-be87-fc9b408a3bcd tempest-FlavorsV255TestJSON-1296077506 tempest-FlavorsV255TestJSON-1296077506-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 6153 microversion: 2.55 time: 0.037137 Oct 08 20:53:12.347639 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 287/546] 10.222.0.26 () {60 vars in 1187 bytes} [Sat Oct 8 20:53:12 2022] GET /compute/v2.1/flavors/detail => generated 6153 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:53:12.353178 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-fbcaabc4-1e9d-401e-92ee-0d22574ec538 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:12.354041 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-fbcaabc4-1e9d-401e-92ee-0d22574ec538 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] [instance: 6de2ea26-e774-47b5-8506-b3ebbc2d1712] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:53:12.370192 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fbcaabc4-1e9d-401e-92ee-0d22574ec538 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:12.370909 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fbcaabc4-1e9d-401e-92ee-0d22574ec538 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:12.372134 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fbcaabc4-1e9d-401e-92ee-0d22574ec538 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:12.373121 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fbcaabc4-1e9d-401e-92ee-0d22574ec538 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:12.374536 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fbcaabc4-1e9d-401e-92ee-0d22574ec538 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:12.376622 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fbcaabc4-1e9d-401e-92ee-0d22574ec538 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:12.389278 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-b9796b17-4033-4730-8179-e630927d6a62 tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd637d2fa21649a1b00f27e7d86f3003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d547f95cc6043b0bb9b6a94b2e354a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:53:12.401167 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-b9796b17-4033-4730-8179-e630927d6a62 tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] 10.222.0.26 "GET /compute/v2.1/servers/8216e713-dfa1-4625-b8ea-5869cf617f4f" status: 200 len: 1470 microversion: 2.1 time: 0.351477 Oct 08 20:53:12.406233 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 260/547] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:53:12 2022] GET /compute/v2.1/servers/8216e713-dfa1-4625-b8ea-5869cf617f4f => generated 1470 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:53:12.528497 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=12 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:53:12.682214 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-fbcaabc4-1e9d-401e-92ee-0d22574ec538 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '360660f7bb4746c8b1397f4857f423f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d702b3083bc4cf5ba6b6fc6f3c3147e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:53:12.696289 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-f1247cf9-17d0-493e-9bcd-528e36c563b4 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:12.697684 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-f1247cf9-17d0-493e-9bcd-528e36c563b4 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] [instance: 99d20873-ce34-47a4-bbe6-5b42e406a360] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:53:12.702915 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-fbcaabc4-1e9d-401e-92ee-0d22574ec538 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] 10.222.0.26 "GET /compute/v2.1/servers/6de2ea26-e774-47b5-8506-b3ebbc2d1712" status: 200 len: 1321 microversion: 2.1 time: 0.352996 Oct 08 20:53:12.712600 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f1247cf9-17d0-493e-9bcd-528e36c563b4 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:12.713648 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 288/548] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:53:12 2022] GET /compute/v2.1/servers/6de2ea26-e774-47b5-8506-b3ebbc2d1712 => generated 1321 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:53:12.714648 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f1247cf9-17d0-493e-9bcd-528e36c563b4 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:12.715320 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f1247cf9-17d0-493e-9bcd-528e36c563b4 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:12.716893 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f1247cf9-17d0-493e-9bcd-528e36c563b4 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:12.718517 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f1247cf9-17d0-493e-9bcd-528e36c563b4 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:12.719176 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f1247cf9-17d0-493e-9bcd-528e36c563b4 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:12.854849 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-f1247cf9-17d0-493e-9bcd-528e36c563b4 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98936da9b5d94165b386d2d0893ac142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2441394d754f499e27f6f35d5b3afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:53:12.881004 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-f1247cf9-17d0-493e-9bcd-528e36c563b4 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] 10.222.0.26 "GET /compute/v2.1/servers/99d20873-ce34-47a4-bbe6-5b42e406a360" status: 200 len: 1320 microversion: 2.1 time: 0.187479 Oct 08 20:53:12.884184 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 261/549] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:53:12 2022] GET /compute/v2.1/servers/99d20873-ce34-47a4-bbe6-5b42e406a360 => generated 1320 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 20:53:13.023527 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-10039b46-1777-4d71-858e-58163eba9244 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:13.024135 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-10039b46-1777-4d71-858e-58163eba9244 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] [instance: 5c864780-3998-4a09-95d4-e000a02af71e] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:53:13.034568 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-10039b46-1777-4d71-858e-58163eba9244 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:13.035778 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-10039b46-1777-4d71-858e-58163eba9244 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:13.036347 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-10039b46-1777-4d71-858e-58163eba9244 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:13.037495 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-10039b46-1777-4d71-858e-58163eba9244 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:13.037973 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-10039b46-1777-4d71-858e-58163eba9244 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:13.038408 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-10039b46-1777-4d71-858e-58163eba9244 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:13.065710 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-4e8a642e-0d8e-4a82-8d87-02e149484d7a tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:13.066935 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-4e8a642e-0d8e-4a82-8d87-02e149484d7a tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] [instance: 279361ef-2171-49e1-9f33-eadbf5dc0313] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:53:13.073567 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4e8a642e-0d8e-4a82-8d87-02e149484d7a tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:13.074314 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4e8a642e-0d8e-4a82-8d87-02e149484d7a tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:13.074962 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4e8a642e-0d8e-4a82-8d87-02e149484d7a tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:13.075701 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4e8a642e-0d8e-4a82-8d87-02e149484d7a tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:13.076168 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4e8a642e-0d8e-4a82-8d87-02e149484d7a tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:13.076599 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4e8a642e-0d8e-4a82-8d87-02e149484d7a tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:13.677895 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-10039b46-1777-4d71-858e-58163eba9244 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef659f5a1a24c439528a7675bdd70f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c92fe04ab8248399d0acb932f82d607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:53:13.687670 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-10039b46-1777-4d71-858e-58163eba9244 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] 10.222.0.26 "GET /compute/v2.1/servers/5c864780-3998-4a09-95d4-e000a02af71e" status: 200 len: 1313 microversion: 2.1 time: 0.667947 Oct 08 20:53:13.693250 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 289/550] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:53:13 2022] GET /compute/v2.1/servers/5c864780-3998-4a09-95d4-e000a02af71e => generated 1313 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:53:13.700321 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-d5e82bb6-d3af-4548-b36c-f835938e0efb tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:13.703314 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-d5e82bb6-d3af-4548-b36c-f835938e0efb tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] [instance: 1af12bcb-5e2a-4c15-8673-fa41701cb4c7] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:53:13.718178 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d5e82bb6-d3af-4548-b36c-f835938e0efb tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:13.718687 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d5e82bb6-d3af-4548-b36c-f835938e0efb tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:13.719131 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d5e82bb6-d3af-4548-b36c-f835938e0efb tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:13.719857 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d5e82bb6-d3af-4548-b36c-f835938e0efb tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:13.720322 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d5e82bb6-d3af-4548-b36c-f835938e0efb tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:13.720748 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d5e82bb6-d3af-4548-b36c-f835938e0efb tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:13.818093 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-4e8a642e-0d8e-4a82-8d87-02e149484d7a tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474ca64d1b1d4e30916b517645aba882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecc2dd2407b4819874bed09cb27959a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:53:13.825983 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-4e8a642e-0d8e-4a82-8d87-02e149484d7a tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] 10.222.0.26 "GET /compute/v2.1/servers/279361ef-2171-49e1-9f33-eadbf5dc0313" status: 200 len: 1310 microversion: 2.1 time: 0.764069 Oct 08 20:53:13.826579 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 262/551] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:53:13 2022] GET /compute/v2.1/servers/279361ef-2171-49e1-9f33-eadbf5dc0313 => generated 1310 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:53:13.837865 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-4c1a274a-5f99-44ce-95fa-f81fe0ad5dfa tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:13.851678 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-4c1a274a-5f99-44ce-95fa-f81fe0ad5dfa tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] [instance: 8216e713-dfa1-4625-b8ea-5869cf617f4f] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:53:13.859877 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4c1a274a-5f99-44ce-95fa-f81fe0ad5dfa tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:13.860640 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4c1a274a-5f99-44ce-95fa-f81fe0ad5dfa tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:13.861547 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4c1a274a-5f99-44ce-95fa-f81fe0ad5dfa tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:13.862434 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4c1a274a-5f99-44ce-95fa-f81fe0ad5dfa tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:13.863055 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4c1a274a-5f99-44ce-95fa-f81fe0ad5dfa tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:13.863640 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4c1a274a-5f99-44ce-95fa-f81fe0ad5dfa tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:14.114582 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.objects.instance [None req-d5e82bb6-d3af-4548-b36c-f835938e0efb tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Lazy-loading 'services' on Instance uuid 1af12bcb-5e2a-4c15-8673-fa41701cb4c7 {{(pid=140492) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 20:53:14.157588 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-d5e82bb6-d3af-4548-b36c-f835938e0efb tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/1af12bcb-5e2a-4c15-8673-fa41701cb4c7" status: 200 len: 1929 microversion: 2.75 time: 0.462823 Oct 08 20:53:14.158177 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 290/552] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:53:13 2022] GET /compute/v2.1/servers/1af12bcb-5e2a-4c15-8673-fa41701cb4c7 => generated 1929 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:53:14.172420 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-6f26650e-d82e-49e0-90ac-b6986297df17 req-ecc2c9e5-2dde-4b08-9a5c-6a673061fb08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73fd15ea-e4bd-4310-93bb-147b0a5e27ef", "name": "network-vif-plugged", "status": "completed", "tag": "27f3cc41-9f72-499b-bae1-fb66f8f24df7"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:53:14.195984 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-6f26650e-d82e-49e0-90ac-b6986297df17 req-ecc2c9e5-2dde-4b08-9a5c-6a673061fb08 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:14.196470 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-6f26650e-d82e-49e0-90ac-b6986297df17 req-ecc2c9e5-2dde-4b08-9a5c-6a673061fb08 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:14.196900 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-6f26650e-d82e-49e0-90ac-b6986297df17 req-ecc2c9e5-2dde-4b08-9a5c-6a673061fb08 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:14.218870 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-6f26650e-d82e-49e0-90ac-b6986297df17 req-ecc2c9e5-2dde-4b08-9a5c-6a673061fb08 service nova] Creating event network-vif-plugged:27f3cc41-9f72-499b-bae1-fb66f8f24df7 for instance 73fd15ea-e4bd-4310-93bb-147b0a5e27ef on nch2-master-1 Oct 08 20:53:14.235920 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-6f26650e-d82e-49e0-90ac-b6986297df17 req-ecc2c9e5-2dde-4b08-9a5c-6a673061fb08 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073332 Oct 08 20:53:14.237088 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 291/553] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:53:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:53:14.253110 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-5e664d21-9d39-4994-832e-83dd103a6b51 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:14.254716 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-5e664d21-9d39-4994-832e-83dd103a6b51 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] [instance: 6de2ea26-e774-47b5-8506-b3ebbc2d1712] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:53:14.267023 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5e664d21-9d39-4994-832e-83dd103a6b51 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:14.267811 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5e664d21-9d39-4994-832e-83dd103a6b51 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:14.268420 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5e664d21-9d39-4994-832e-83dd103a6b51 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:14.269380 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5e664d21-9d39-4994-832e-83dd103a6b51 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:14.270171 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5e664d21-9d39-4994-832e-83dd103a6b51 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:14.270922 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5e664d21-9d39-4994-832e-83dd103a6b51 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:14.685350 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-4c1a274a-5f99-44ce-95fa-f81fe0ad5dfa tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd637d2fa21649a1b00f27e7d86f3003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d547f95cc6043b0bb9b6a94b2e354a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:53:14.696168 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-4c1a274a-5f99-44ce-95fa-f81fe0ad5dfa tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] 10.222.0.26 "GET /compute/v2.1/servers/8216e713-dfa1-4625-b8ea-5869cf617f4f" status: 200 len: 1470 microversion: 2.1 time: 0.868304 Oct 08 20:53:14.697386 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 263/554] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:53:13 2022] GET /compute/v2.1/servers/8216e713-dfa1-4625-b8ea-5869cf617f4f => generated 1470 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:53:14.702216 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-9c5a51bd-0965-4957-baf9-f27f3aa2d761 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:14.703081 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-9c5a51bd-0965-4957-baf9-f27f3aa2d761 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] [instance: 99d20873-ce34-47a4-bbe6-5b42e406a360] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:53:14.714450 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9c5a51bd-0965-4957-baf9-f27f3aa2d761 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:14.714956 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9c5a51bd-0965-4957-baf9-f27f3aa2d761 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:14.715400 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9c5a51bd-0965-4957-baf9-f27f3aa2d761 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:14.716118 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9c5a51bd-0965-4957-baf9-f27f3aa2d761 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:14.716579 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9c5a51bd-0965-4957-baf9-f27f3aa2d761 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:14.717009 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9c5a51bd-0965-4957-baf9-f27f3aa2d761 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:14.748500 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-5e664d21-9d39-4994-832e-83dd103a6b51 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '360660f7bb4746c8b1397f4857f423f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d702b3083bc4cf5ba6b6fc6f3c3147e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:53:14.767286 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-5e664d21-9d39-4994-832e-83dd103a6b51 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] 10.222.0.26 "GET /compute/v2.1/servers/6de2ea26-e774-47b5-8506-b3ebbc2d1712" status: 200 len: 1321 microversion: 2.1 time: 0.528505 Oct 08 20:53:14.774896 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 292/555] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:53:14 2022] GET /compute/v2.1/servers/6de2ea26-e774-47b5-8506-b3ebbc2d1712 => generated 1321 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:53:14.779913 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-b7900342-007d-43bb-9d7d-126fceb5a84a tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:14.781064 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-b7900342-007d-43bb-9d7d-126fceb5a84a tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] [instance: 5c864780-3998-4a09-95d4-e000a02af71e] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:53:14.808069 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b7900342-007d-43bb-9d7d-126fceb5a84a tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:14.808575 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b7900342-007d-43bb-9d7d-126fceb5a84a tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:14.809019 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b7900342-007d-43bb-9d7d-126fceb5a84a tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:14.809766 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b7900342-007d-43bb-9d7d-126fceb5a84a tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:14.810227 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b7900342-007d-43bb-9d7d-126fceb5a84a tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:14.810656 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b7900342-007d-43bb-9d7d-126fceb5a84a tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:15.044408 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-b7900342-007d-43bb-9d7d-126fceb5a84a tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef659f5a1a24c439528a7675bdd70f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c92fe04ab8248399d0acb932f82d607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:53:15.056057 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-b7900342-007d-43bb-9d7d-126fceb5a84a tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] 10.222.0.26 "GET /compute/v2.1/servers/5c864780-3998-4a09-95d4-e000a02af71e" status: 200 len: 1313 microversion: 2.1 time: 0.279743 Oct 08 20:53:15.057150 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 293/556] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:53:14 2022] GET /compute/v2.1/servers/5c864780-3998-4a09-95d4-e000a02af71e => generated 1313 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:53:15.072266 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-d6064fec-064a-4317-9211-49eb4aec55e8 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:15.072266 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-d6064fec-064a-4317-9211-49eb4aec55e8 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] [instance: 279361ef-2171-49e1-9f33-eadbf5dc0313] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:53:15.072266 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d6064fec-064a-4317-9211-49eb4aec55e8 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:15.072266 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d6064fec-064a-4317-9211-49eb4aec55e8 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:15.072596 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d6064fec-064a-4317-9211-49eb4aec55e8 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:15.073104 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d6064fec-064a-4317-9211-49eb4aec55e8 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:15.073605 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d6064fec-064a-4317-9211-49eb4aec55e8 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:15.074048 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d6064fec-064a-4317-9211-49eb4aec55e8 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:15.282020 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-d6064fec-064a-4317-9211-49eb4aec55e8 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474ca64d1b1d4e30916b517645aba882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecc2dd2407b4819874bed09cb27959a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:53:15.292909 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-d6064fec-064a-4317-9211-49eb4aec55e8 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] 10.222.0.26 "GET /compute/v2.1/servers/279361ef-2171-49e1-9f33-eadbf5dc0313" status: 200 len: 1310 microversion: 2.1 time: 0.234541 Oct 08 20:53:15.293567 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 294/557] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:53:15 2022] GET /compute/v2.1/servers/279361ef-2171-49e1-9f33-eadbf5dc0313 => generated 1310 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:53:15.305081 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-0368ae60-e02d-4b8f-bddd-44a74ab0b3e6 tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:15.305755 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-0368ae60-e02d-4b8f-bddd-44a74ab0b3e6 tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] [instance: 1af12bcb-5e2a-4c15-8673-fa41701cb4c7] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:53:15.316446 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0368ae60-e02d-4b8f-bddd-44a74ab0b3e6 tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:15.316964 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0368ae60-e02d-4b8f-bddd-44a74ab0b3e6 tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:15.317442 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0368ae60-e02d-4b8f-bddd-44a74ab0b3e6 tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:15.321406 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0368ae60-e02d-4b8f-bddd-44a74ab0b3e6 tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:15.321907 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0368ae60-e02d-4b8f-bddd-44a74ab0b3e6 tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:15.322355 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0368ae60-e02d-4b8f-bddd-44a74ab0b3e6 tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:15.464485 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.objects.instance [None req-0368ae60-e02d-4b8f-bddd-44a74ab0b3e6 tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Lazy-loading 'services' on Instance uuid 1af12bcb-5e2a-4c15-8673-fa41701cb4c7 {{(pid=140492) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 20:53:15.519696 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-0368ae60-e02d-4b8f-bddd-44a74ab0b3e6 tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/1af12bcb-5e2a-4c15-8673-fa41701cb4c7" status: 200 len: 1929 microversion: 2.75 time: 0.218933 Oct 08 20:53:15.533727 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 295/558] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:53:15 2022] GET /compute/v2.1/servers/1af12bcb-5e2a-4c15-8673-fa41701cb4c7 => generated 1929 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:53:15.624467 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-9c5a51bd-0965-4957-baf9-f27f3aa2d761 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98936da9b5d94165b386d2d0893ac142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2441394d754f499e27f6f35d5b3afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:53:15.638697 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-9c5a51bd-0965-4957-baf9-f27f3aa2d761 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] 10.222.0.26 "GET /compute/v2.1/servers/99d20873-ce34-47a4-bbe6-5b42e406a360" status: 200 len: 1388 microversion: 2.1 time: 0.935791 Oct 08 20:53:15.654166 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 264/559] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:53:14 2022] GET /compute/v2.1/servers/99d20873-ce34-47a4-bbe6-5b42e406a360 => generated 1388 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:53:15.721383 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-4cf74fb9-73dc-4e44-80fc-b81a6d27396f tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:15.722303 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-4cf74fb9-73dc-4e44-80fc-b81a6d27396f tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] [instance: 8216e713-dfa1-4625-b8ea-5869cf617f4f] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:53:15.725786 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=92,nova_api:SAVEPOINT=1,nova_api:RELEASE=1,nova_api:DELETE=5,nova_api:UPDATE=1 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:53:15.735594 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4cf74fb9-73dc-4e44-80fc-b81a6d27396f tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:15.740203 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4cf74fb9-73dc-4e44-80fc-b81a6d27396f tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:15.741050 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4cf74fb9-73dc-4e44-80fc-b81a6d27396f tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:15.742020 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4cf74fb9-73dc-4e44-80fc-b81a6d27396f tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:15.742684 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4cf74fb9-73dc-4e44-80fc-b81a6d27396f tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:15.743304 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4cf74fb9-73dc-4e44-80fc-b81a6d27396f tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:15.781728 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-bfa8c129-0b69-49a1-a328-3ad1ebd58916 req-f7d013ab-1a70-428a-8d3a-4b691e1ff103 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8216e713-dfa1-4625-b8ea-5869cf617f4f", "name": "network-vif-deleted", "tag": "9fcb2769-f8e8-45e3-808c-aebaba6c6fdc"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:53:15.805387 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-bfa8c129-0b69-49a1-a328-3ad1ebd58916 req-f7d013ab-1a70-428a-8d3a-4b691e1ff103 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:15.805967 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-bfa8c129-0b69-49a1-a328-3ad1ebd58916 req-f7d013ab-1a70-428a-8d3a-4b691e1ff103 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:15.806424 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-bfa8c129-0b69-49a1-a328-3ad1ebd58916 req-f7d013ab-1a70-428a-8d3a-4b691e1ff103 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:15.833602 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-bfa8c129-0b69-49a1-a328-3ad1ebd58916 req-f7d013ab-1a70-428a-8d3a-4b691e1ff103 service nova] Creating event network-vif-deleted:9fcb2769-f8e8-45e3-808c-aebaba6c6fdc for instance 8216e713-dfa1-4625-b8ea-5869cf617f4f on nch2-master-1 Oct 08 20:53:15.849125 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-bfa8c129-0b69-49a1-a328-3ad1ebd58916 req-f7d013ab-1a70-428a-8d3a-4b691e1ff103 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071798 Oct 08 20:53:15.850274 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 265/560] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:53:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:53:15.863963 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-d6614c47-7d7d-4da1-8a47-060700795b4f tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:15.864867 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-d6614c47-7d7d-4da1-8a47-060700795b4f tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] [instance: 6de2ea26-e774-47b5-8506-b3ebbc2d1712] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:53:15.879260 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d6614c47-7d7d-4da1-8a47-060700795b4f tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:15.881678 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d6614c47-7d7d-4da1-8a47-060700795b4f tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:15.882087 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d6614c47-7d7d-4da1-8a47-060700795b4f tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:15.884354 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d6614c47-7d7d-4da1-8a47-060700795b4f tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:15.885408 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d6614c47-7d7d-4da1-8a47-060700795b4f tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:15.887363 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d6614c47-7d7d-4da1-8a47-060700795b4f tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:15.976337 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-4cf74fb9-73dc-4e44-80fc-b81a6d27396f tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd637d2fa21649a1b00f27e7d86f3003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d547f95cc6043b0bb9b6a94b2e354a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:53:15.985939 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-4cf74fb9-73dc-4e44-80fc-b81a6d27396f tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] 10.222.0.26 "GET /compute/v2.1/servers/8216e713-dfa1-4625-b8ea-5869cf617f4f" status: 200 len: 1428 microversion: 2.1 time: 0.269928 Oct 08 20:53:16.008851 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 296/561] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:53:15 2022] GET /compute/v2.1/servers/8216e713-dfa1-4625-b8ea-5869cf617f4f => generated 1428 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 20:53:16.083138 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e137d08d-6b34-4ba5-93cd-094863372f5e tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:16.083790 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-e137d08d-6b34-4ba5-93cd-094863372f5e tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] [instance: 5c864780-3998-4a09-95d4-e000a02af71e] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:53:16.093042 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e137d08d-6b34-4ba5-93cd-094863372f5e tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:16.094005 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e137d08d-6b34-4ba5-93cd-094863372f5e tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:16.094807 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e137d08d-6b34-4ba5-93cd-094863372f5e tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:16.096314 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e137d08d-6b34-4ba5-93cd-094863372f5e tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:16.097072 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e137d08d-6b34-4ba5-93cd-094863372f5e tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:16.097834 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e137d08d-6b34-4ba5-93cd-094863372f5e tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:16.548304 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-e137d08d-6b34-4ba5-93cd-094863372f5e tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef659f5a1a24c439528a7675bdd70f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c92fe04ab8248399d0acb932f82d607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:53:16.562650 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-e137d08d-6b34-4ba5-93cd-094863372f5e tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] 10.222.0.26 "GET /compute/v2.1/servers/5c864780-3998-4a09-95d4-e000a02af71e" status: 200 len: 1313 microversion: 2.1 time: 0.485990 Oct 08 20:53:16.580150 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 297/562] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:53:16 2022] GET /compute/v2.1/servers/5c864780-3998-4a09-95d4-e000a02af71e => generated 1313 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:53:16.594557 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-591b6f0e-6dac-4e3b-b650-70e94448f9b5 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:16.596852 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-591b6f0e-6dac-4e3b-b650-70e94448f9b5 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] [instance: 279361ef-2171-49e1-9f33-eadbf5dc0313] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:53:16.613678 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-591b6f0e-6dac-4e3b-b650-70e94448f9b5 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:16.616794 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-591b6f0e-6dac-4e3b-b650-70e94448f9b5 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:16.617481 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-591b6f0e-6dac-4e3b-b650-70e94448f9b5 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:16.619970 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-591b6f0e-6dac-4e3b-b650-70e94448f9b5 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:16.622305 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-591b6f0e-6dac-4e3b-b650-70e94448f9b5 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:16.623322 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-591b6f0e-6dac-4e3b-b650-70e94448f9b5 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:16.633993 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=100 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:53:16.745157 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-d6614c47-7d7d-4da1-8a47-060700795b4f tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '360660f7bb4746c8b1397f4857f423f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d702b3083bc4cf5ba6b6fc6f3c3147e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:53:16.753932 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-d6614c47-7d7d-4da1-8a47-060700795b4f tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] 10.222.0.26 "GET /compute/v2.1/servers/6de2ea26-e774-47b5-8506-b3ebbc2d1712" status: 200 len: 1321 microversion: 2.1 time: 0.902432 Oct 08 20:53:16.763407 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 266/563] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:53:15 2022] GET /compute/v2.1/servers/6de2ea26-e774-47b5-8506-b3ebbc2d1712 => generated 1321 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:53:16.775849 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-a807c8b6-d744-4fa6-b4c4-c1198c34a7a4 req-5c30f7cf-9581-4af2-bc26-257e7c4d19f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6de2ea26-e774-47b5-8506-b3ebbc2d1712", "name": "network-vif-plugged", "status": "completed", "tag": "e7201ad3-9c78-422c-ab85-5ab7a68b8b12"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:53:16.802472 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-a807c8b6-d744-4fa6-b4c4-c1198c34a7a4 req-5c30f7cf-9581-4af2-bc26-257e7c4d19f1 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:16.803093 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-a807c8b6-d744-4fa6-b4c4-c1198c34a7a4 req-5c30f7cf-9581-4af2-bc26-257e7c4d19f1 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:16.803474 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-a807c8b6-d744-4fa6-b4c4-c1198c34a7a4 req-5c30f7cf-9581-4af2-bc26-257e7c4d19f1 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:16.816944 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-a807c8b6-d744-4fa6-b4c4-c1198c34a7a4 req-5c30f7cf-9581-4af2-bc26-257e7c4d19f1 service nova] Creating event network-vif-plugged:e7201ad3-9c78-422c-ab85-5ab7a68b8b12 for instance 6de2ea26-e774-47b5-8506-b3ebbc2d1712 on nch1-master-1 Oct 08 20:53:16.822765 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-a807c8b6-d744-4fa6-b4c4-c1198c34a7a4 req-5c30f7cf-9581-4af2-bc26-257e7c4d19f1 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056281 Oct 08 20:53:16.824006 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 267/564] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:53:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:53:16.831904 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-5a0d9670-2cff-4ae9-9465-3654fdb8e75d tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:16.833118 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-5a0d9670-2cff-4ae9-9465-3654fdb8e75d tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] [instance: 1af12bcb-5e2a-4c15-8673-fa41701cb4c7] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:53:16.840700 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5a0d9670-2cff-4ae9-9465-3654fdb8e75d tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:16.841585 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5a0d9670-2cff-4ae9-9465-3654fdb8e75d tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:16.842253 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5a0d9670-2cff-4ae9-9465-3654fdb8e75d tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:16.843381 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5a0d9670-2cff-4ae9-9465-3654fdb8e75d tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:16.844048 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5a0d9670-2cff-4ae9-9465-3654fdb8e75d tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:16.844694 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5a0d9670-2cff-4ae9-9465-3654fdb8e75d tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:16.957538 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.objects.instance [None req-5a0d9670-2cff-4ae9-9465-3654fdb8e75d tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Lazy-loading 'services' on Instance uuid 1af12bcb-5e2a-4c15-8673-fa41701cb4c7 {{(pid=140491) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 20:53:16.989611 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-5a0d9670-2cff-4ae9-9465-3654fdb8e75d tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/1af12bcb-5e2a-4c15-8673-fa41701cb4c7" status: 200 len: 1929 microversion: 2.75 time: 0.163389 Oct 08 20:53:16.991229 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 268/565] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:53:16 2022] GET /compute/v2.1/servers/1af12bcb-5e2a-4c15-8673-fa41701cb4c7 => generated 1929 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:53:16.999309 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-282484f6-34d9-4a95-85bf-bb71aa6a99eb tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:17.000225 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-282484f6-34d9-4a95-85bf-bb71aa6a99eb tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] [instance: 99d20873-ce34-47a4-bbe6-5b42e406a360] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:53:17.009268 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-282484f6-34d9-4a95-85bf-bb71aa6a99eb tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:17.010065 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-282484f6-34d9-4a95-85bf-bb71aa6a99eb tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:17.010784 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-282484f6-34d9-4a95-85bf-bb71aa6a99eb tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:17.012038 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-282484f6-34d9-4a95-85bf-bb71aa6a99eb tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:17.012679 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-282484f6-34d9-4a95-85bf-bb71aa6a99eb tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:17.013446 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-282484f6-34d9-4a95-85bf-bb71aa6a99eb tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:17.179740 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-591b6f0e-6dac-4e3b-b650-70e94448f9b5 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474ca64d1b1d4e30916b517645aba882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecc2dd2407b4819874bed09cb27959a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:53:17.192581 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-591b6f0e-6dac-4e3b-b650-70e94448f9b5 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] 10.222.0.26 "GET /compute/v2.1/servers/279361ef-2171-49e1-9f33-eadbf5dc0313" status: 200 len: 1310 microversion: 2.1 time: 0.610990 Oct 08 20:53:17.198939 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 298/566] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:53:16 2022] GET /compute/v2.1/servers/279361ef-2171-49e1-9f33-eadbf5dc0313 => generated 1310 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:53:17.212928 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-b09e9209-5614-4ce0-a5dd-1879ec6cf601 tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:17.213976 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-b09e9209-5614-4ce0-a5dd-1879ec6cf601 tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] [instance: 8216e713-dfa1-4625-b8ea-5869cf617f4f] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:53:17.226116 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b09e9209-5614-4ce0-a5dd-1879ec6cf601 tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:17.229633 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b09e9209-5614-4ce0-a5dd-1879ec6cf601 tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:17.230338 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b09e9209-5614-4ce0-a5dd-1879ec6cf601 tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:17.234703 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b09e9209-5614-4ce0-a5dd-1879ec6cf601 tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:17.236053 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b09e9209-5614-4ce0-a5dd-1879ec6cf601 tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:17.237491 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b09e9209-5614-4ce0-a5dd-1879ec6cf601 tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:17.271601 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-b09e9209-5614-4ce0-a5dd-1879ec6cf601 tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] HTTP exception thrown: Instance 8216e713-dfa1-4625-b8ea-5869cf617f4f could not be found. Oct 08 20:53:17.276601 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-b09e9209-5614-4ce0-a5dd-1879ec6cf601 tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Request method failure captured: Oct 08 20:53:17.276601 ncdv-master-1 devstack@n-api.service[140492]: request: GET /compute/v2.1/servers/8216e713-dfa1-4625-b8ea-5869cf617f4f HTTP/1.1 Oct 08 20:53:17.276601 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 20:53:17.276601 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 20:53:17.276601 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 20:53:17.276601 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 20:53:17.276601 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 20:53:17.276601 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 20:53:17.276601 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 20:53:17.276601 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 20:53:17.276601 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeMaapp8PsMtYAfY1K20K8a0PXe57541hpe-VgjcB0jLGzK_vpKgz2VqupbJ448VQtEGbfwTNBXdnCUcv5-cYyuA1QbQWibWSzYcUkbCqQdJ9YbuNcw1p1Wx1nYdHjfGsWt8nP2nE_yZ3CQOz_9IIvPyhY0mYzmDCJF7XiVG6rnqy-0 Oct 08 20:53:17.276601 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 20:53:17.276601 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 20:53:17.276601 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 20:53:17.276601 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 20:53:17.276601 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 20:53:17.276601 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 20:53:17.276601 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 1d547f95cc6043b0bb9b6a94b2e354a5 Oct 08 20:53:17.276601 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-TenantUsagesTestJSON-2138552679 Oct 08 20:53:17.276601 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 20:53:17.276601 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 20:53:17.277974 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1d547f95cc6043b0bb9b6a94b2e354a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1d547f95cc6043b0bb9b6a94b2e354a5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1d547f95cc6043b0bb9b6a94b2e354a5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1d547f95cc6043b0bb9b6a94b2e354a5"}]}] Oct 08 20:53:17.277974 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-TenantUsagesTestJSON-2138552679 Oct 08 20:53:17.277974 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 1d547f95cc6043b0bb9b6a94b2e354a5 Oct 08 20:53:17.277974 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-TenantUsagesTestJSON-2138552679 Oct 08 20:53:17.277974 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-TenantUsagesTestJSON-2138552679-project Oct 08 20:53:17.277974 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 20:53:17.277974 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 20:53:17.277974 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: bd637d2fa21649a1b00f27e7d86f3003 Oct 08 20:53:17.277974 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-TenantUsagesTestJSON-2138552679-project Oct 08 20:53:17.277974 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 20:53:17.277974 ncdv-master-1 devstack@n-api.service[140492]: exception: Instance 8216e713-dfa1-4625-b8ea-5869cf617f4f could not be found. Oct 08 20:53:17.277974 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': '8216e713-dfa1-4625-b8ea-5869cf617f4f'} Oct 08 20:53:17.278685 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:53:17.278685 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:53:17.278685 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 20:53:17.278685 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 20:53:17.278685 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 20:53:17.278685 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 20:53:17.278685 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 20:53:17.278685 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 20:53:17.278685 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 20:53:17.278685 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 20:53:17.278685 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8216e713-dfa1-4625-b8ea-5869cf617f4f could not be found. Oct 08 20:53:17.278685 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:53:17.278685 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:53:17.278685 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:53:17.278685 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:53:17.278685 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:53:17.278685 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:53:17.278685 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:53:17.278685 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:53:17.278685 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:53:17.279924 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:53:17.279924 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 20:53:17.279924 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 20:53:17.279924 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 20:53:17.279924 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 20:53:17.279924 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 20:53:17.279924 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 20:53:17.279924 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8216e713-dfa1-4625-b8ea-5869cf617f4f could not be found. Oct 08 20:53:17.279924 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:53:17.279924 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:53:17.279924 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:53:17.279924 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:53:17.279924 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:53:17.279924 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:53:17.279924 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 20:53:17.279924 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 20:53:17.279924 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8216e713-dfa1-4625-b8ea-5869cf617f4f could not be found. Oct 08 20:53:17.279924 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:53:17.283659 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-b09e9209-5614-4ce0-a5dd-1879ec6cf601 tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] Returning 404 to user: Instance 8216e713-dfa1-4625-b8ea-5869cf617f4f could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:53:17.285808 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-b09e9209-5614-4ce0-a5dd-1879ec6cf601 tempest-TenantUsagesTestJSON-2138552679 tempest-TenantUsagesTestJSON-2138552679-project] 10.222.0.26 "GET /compute/v2.1/servers/8216e713-dfa1-4625-b8ea-5869cf617f4f" status: 404 len: 111 microversion: 2.1 time: 0.085840 Oct 08 20:53:17.288775 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 299/567] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:53:17 2022] GET /compute/v2.1/servers/8216e713-dfa1-4625-b8ea-5869cf617f4f => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 20:53:17.365549 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-282484f6-34d9-4a95-85bf-bb71aa6a99eb tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98936da9b5d94165b386d2d0893ac142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2441394d754f499e27f6f35d5b3afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:53:17.374384 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-282484f6-34d9-4a95-85bf-bb71aa6a99eb tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] 10.222.0.26 "GET /compute/v2.1/servers/99d20873-ce34-47a4-bbe6-5b42e406a360" status: 200 len: 1388 microversion: 2.1 time: 0.380084 Oct 08 20:53:17.382176 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 269/568] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:53:16 2022] GET /compute/v2.1/servers/99d20873-ce34-47a4-bbe6-5b42e406a360 => generated 1388 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:53:17.596832 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-82ee1009-4a33-4799-bc1c-cf40ff63b949 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:17.597488 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-82ee1009-4a33-4799-bc1c-cf40ff63b949 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] [instance: 5c864780-3998-4a09-95d4-e000a02af71e] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:53:17.629017 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-82ee1009-4a33-4799-bc1c-cf40ff63b949 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:17.629587 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-82ee1009-4a33-4799-bc1c-cf40ff63b949 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:17.630029 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-82ee1009-4a33-4799-bc1c-cf40ff63b949 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:17.630744 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-82ee1009-4a33-4799-bc1c-cf40ff63b949 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:17.631210 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-82ee1009-4a33-4799-bc1c-cf40ff63b949 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:17.631646 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-82ee1009-4a33-4799-bc1c-cf40ff63b949 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:17.786885 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-b5956d26-a299-450b-a5e4-a25bf0ca1447 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:17.788355 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-b5956d26-a299-450b-a5e4-a25bf0ca1447 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] [instance: 6de2ea26-e774-47b5-8506-b3ebbc2d1712] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:53:17.798915 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b5956d26-a299-450b-a5e4-a25bf0ca1447 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:17.801663 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b5956d26-a299-450b-a5e4-a25bf0ca1447 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:17.802155 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b5956d26-a299-450b-a5e4-a25bf0ca1447 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:17.819144 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b5956d26-a299-450b-a5e4-a25bf0ca1447 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:17.820594 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b5956d26-a299-450b-a5e4-a25bf0ca1447 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:17.821248 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b5956d26-a299-450b-a5e4-a25bf0ca1447 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:18.318028 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-b5956d26-a299-450b-a5e4-a25bf0ca1447 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '360660f7bb4746c8b1397f4857f423f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d702b3083bc4cf5ba6b6fc6f3c3147e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:53:18.336084 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-b5956d26-a299-450b-a5e4-a25bf0ca1447 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] 10.222.0.26 "GET /compute/v2.1/servers/6de2ea26-e774-47b5-8506-b3ebbc2d1712" status: 200 len: 1321 microversion: 2.1 time: 0.553525 Oct 08 20:53:18.336700 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 270/569] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:53:17 2022] GET /compute/v2.1/servers/6de2ea26-e774-47b5-8506-b3ebbc2d1712 => generated 1321 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:53:18.350381 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-e14eb863-8435-48f1-a6b7-fc609c0acb83 req-adef09de-02fc-4509-a502-9eca8c26cb5a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99d20873-ce34-47a4-bbe6-5b42e406a360", "tag": "79841dd5-37cd-46cf-878f-6cb318265fee"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:53:18.391711 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-e14eb863-8435-48f1-a6b7-fc609c0acb83 req-adef09de-02fc-4509-a502-9eca8c26cb5a service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:18.393349 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-e14eb863-8435-48f1-a6b7-fc609c0acb83 req-adef09de-02fc-4509-a502-9eca8c26cb5a service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:18.394396 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-e14eb863-8435-48f1-a6b7-fc609c0acb83 req-adef09de-02fc-4509-a502-9eca8c26cb5a service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:18.422180 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-e14eb863-8435-48f1-a6b7-fc609c0acb83 req-adef09de-02fc-4509-a502-9eca8c26cb5a service nova] Creating event network-changed:79841dd5-37cd-46cf-878f-6cb318265fee for instance 99d20873-ce34-47a4-bbe6-5b42e406a360 on nch1-master-1 Oct 08 20:53:18.423266 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-82ee1009-4a33-4799-bc1c-cf40ff63b949 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef659f5a1a24c439528a7675bdd70f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c92fe04ab8248399d0acb932f82d607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:53:18.430485 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-e14eb863-8435-48f1-a6b7-fc609c0acb83 req-adef09de-02fc-4509-a502-9eca8c26cb5a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092185 Oct 08 20:53:18.431584 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 271/570] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:53:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:53:18.434441 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-82ee1009-4a33-4799-bc1c-cf40ff63b949 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] 10.222.0.26 "GET /compute/v2.1/servers/5c864780-3998-4a09-95d4-e000a02af71e" status: 200 len: 1313 microversion: 2.1 time: 0.844880 Oct 08 20:53:18.436192 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 300/571] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:53:17 2022] GET /compute/v2.1/servers/5c864780-3998-4a09-95d4-e000a02af71e => generated 1313 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:53:18.437512 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-f7554771-4106-41d0-a660-aba503178eb7 tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:18.438374 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-f7554771-4106-41d0-a660-aba503178eb7 tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] [instance: 1af12bcb-5e2a-4c15-8673-fa41701cb4c7] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:53:18.443893 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-cb902ded-b776-4a64-baa2-1715ae2f3962 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:18.444520 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-cb902ded-b776-4a64-baa2-1715ae2f3962 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] [instance: 279361ef-2171-49e1-9f33-eadbf5dc0313] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:53:18.449841 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f7554771-4106-41d0-a660-aba503178eb7 tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:18.450688 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f7554771-4106-41d0-a660-aba503178eb7 tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:18.451625 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f7554771-4106-41d0-a660-aba503178eb7 tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:18.453635 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f7554771-4106-41d0-a660-aba503178eb7 tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:18.456041 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f7554771-4106-41d0-a660-aba503178eb7 tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:18.456689 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f7554771-4106-41d0-a660-aba503178eb7 tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:18.469248 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cb902ded-b776-4a64-baa2-1715ae2f3962 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:18.469728 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cb902ded-b776-4a64-baa2-1715ae2f3962 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:18.470383 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cb902ded-b776-4a64-baa2-1715ae2f3962 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:18.471279 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cb902ded-b776-4a64-baa2-1715ae2f3962 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:18.473220 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cb902ded-b776-4a64-baa2-1715ae2f3962 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:18.473835 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cb902ded-b776-4a64-baa2-1715ae2f3962 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:18.620819 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=100 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:53:18.636046 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.objects.instance [None req-f7554771-4106-41d0-a660-aba503178eb7 tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Lazy-loading 'services' on Instance uuid 1af12bcb-5e2a-4c15-8673-fa41701cb4c7 {{(pid=140491) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 20:53:18.675370 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-f7554771-4106-41d0-a660-aba503178eb7 tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/1af12bcb-5e2a-4c15-8673-fa41701cb4c7" status: 200 len: 1929 microversion: 2.75 time: 0.242140 Oct 08 20:53:18.676172 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 272/572] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:53:18 2022] GET /compute/v2.1/servers/1af12bcb-5e2a-4c15-8673-fa41701cb4c7 => generated 1929 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:53:18.711296 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-7a590aab-239c-44a0-a3d2-fd581fbf266d tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:18.712732 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-7a590aab-239c-44a0-a3d2-fd581fbf266d tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] [instance: 99d20873-ce34-47a4-bbe6-5b42e406a360] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:53:18.722611 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7a590aab-239c-44a0-a3d2-fd581fbf266d tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:18.724150 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7a590aab-239c-44a0-a3d2-fd581fbf266d tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:18.725430 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7a590aab-239c-44a0-a3d2-fd581fbf266d tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:18.726509 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7a590aab-239c-44a0-a3d2-fd581fbf266d tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:18.727809 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7a590aab-239c-44a0-a3d2-fd581fbf266d tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:18.728476 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7a590aab-239c-44a0-a3d2-fd581fbf266d tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:19.050920 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-7a590aab-239c-44a0-a3d2-fd581fbf266d tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98936da9b5d94165b386d2d0893ac142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2441394d754f499e27f6f35d5b3afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:53:19.052106 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-cb902ded-b776-4a64-baa2-1715ae2f3962 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474ca64d1b1d4e30916b517645aba882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecc2dd2407b4819874bed09cb27959a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:53:19.070269 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-7a590aab-239c-44a0-a3d2-fd581fbf266d tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] 10.222.0.26 "GET /compute/v2.1/servers/99d20873-ce34-47a4-bbe6-5b42e406a360" status: 200 len: 1388 microversion: 2.1 time: 0.365859 Oct 08 20:53:19.072878 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 273/573] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:53:18 2022] GET /compute/v2.1/servers/99d20873-ce34-47a4-bbe6-5b42e406a360 => generated 1388 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:53:19.078861 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-cb902ded-b776-4a64-baa2-1715ae2f3962 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] 10.222.0.26 "GET /compute/v2.1/servers/279361ef-2171-49e1-9f33-eadbf5dc0313" status: 200 len: 1310 microversion: 2.1 time: 0.632751 Oct 08 20:53:19.079801 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 301/574] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:53:18 2022] GET /compute/v2.1/servers/279361ef-2171-49e1-9f33-eadbf5dc0313 => generated 1310 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:53:19.379706 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-045f4f42-8368-41fe-8a2f-4d340764cc36 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:19.380679 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-045f4f42-8368-41fe-8a2f-4d340764cc36 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] [instance: 6de2ea26-e774-47b5-8506-b3ebbc2d1712] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:53:19.403911 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-045f4f42-8368-41fe-8a2f-4d340764cc36 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:19.405628 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-045f4f42-8368-41fe-8a2f-4d340764cc36 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:19.407453 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-045f4f42-8368-41fe-8a2f-4d340764cc36 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:19.408510 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-045f4f42-8368-41fe-8a2f-4d340764cc36 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:19.408991 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-045f4f42-8368-41fe-8a2f-4d340764cc36 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:19.409461 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-045f4f42-8368-41fe-8a2f-4d340764cc36 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:19.465884 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-dde53c78-ef9c-47b7-8654-5863b6686fcf tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:19.466510 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-dde53c78-ef9c-47b7-8654-5863b6686fcf tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] [instance: 5c864780-3998-4a09-95d4-e000a02af71e] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:53:19.482514 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dde53c78-ef9c-47b7-8654-5863b6686fcf tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:19.496554 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dde53c78-ef9c-47b7-8654-5863b6686fcf tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:19.498492 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dde53c78-ef9c-47b7-8654-5863b6686fcf tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:19.500438 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dde53c78-ef9c-47b7-8654-5863b6686fcf tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:19.500954 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dde53c78-ef9c-47b7-8654-5863b6686fcf tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:19.505075 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dde53c78-ef9c-47b7-8654-5863b6686fcf tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:19.803040 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=8 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:53:19.816727 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=8 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:53:20.048750 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-dde53c78-ef9c-47b7-8654-5863b6686fcf tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef659f5a1a24c439528a7675bdd70f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c92fe04ab8248399d0acb932f82d607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:53:20.058351 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-dde53c78-ef9c-47b7-8654-5863b6686fcf tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] 10.222.0.26 "GET /compute/v2.1/servers/5c864780-3998-4a09-95d4-e000a02af71e" status: 200 len: 1313 microversion: 2.1 time: 0.600675 Oct 08 20:53:20.070302 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 302/575] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:53:19 2022] GET /compute/v2.1/servers/5c864780-3998-4a09-95d4-e000a02af71e => generated 1313 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 20:53:20.093214 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-045f4f42-8368-41fe-8a2f-4d340764cc36 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '360660f7bb4746c8b1397f4857f423f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d702b3083bc4cf5ba6b6fc6f3c3147e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:53:20.104223 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-e65ddaf5-f424-408f-a2ce-ddddb12a27b3 req-3b6b6953-7c27-45c2-b492-e0a9e222e630 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "279361ef-2171-49e1-9f33-eadbf5dc0313", "name": "network-vif-plugged", "status": "completed", "tag": "331433c9-6d41-4903-b1f6-3eedf2e2ae2d"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:53:20.125643 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-045f4f42-8368-41fe-8a2f-4d340764cc36 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] 10.222.0.26 "GET /compute/v2.1/servers/6de2ea26-e774-47b5-8506-b3ebbc2d1712" status: 200 len: 1471 microversion: 2.1 time: 0.767024 Oct 08 20:53:20.128479 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 274/576] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:53:19 2022] GET /compute/v2.1/servers/6de2ea26-e774-47b5-8506-b3ebbc2d1712 => generated 1471 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:53:20.136820 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-e65ddaf5-f424-408f-a2ce-ddddb12a27b3 req-3b6b6953-7c27-45c2-b492-e0a9e222e630 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:20.144328 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-e65ddaf5-f424-408f-a2ce-ddddb12a27b3 req-3b6b6953-7c27-45c2-b492-e0a9e222e630 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:20.146175 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-e65ddaf5-f424-408f-a2ce-ddddb12a27b3 req-3b6b6953-7c27-45c2-b492-e0a9e222e630 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:20.147909 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-664c0a5f-4903-4964-9e07-827012c9ec86 tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:20.148542 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-664c0a5f-4903-4964-9e07-827012c9ec86 tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] [instance: 1af12bcb-5e2a-4c15-8673-fa41701cb4c7] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:53:20.161927 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-664c0a5f-4903-4964-9e07-827012c9ec86 tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:20.162839 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-664c0a5f-4903-4964-9e07-827012c9ec86 tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:20.164940 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-664c0a5f-4903-4964-9e07-827012c9ec86 tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:20.165899 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-664c0a5f-4903-4964-9e07-827012c9ec86 tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:20.172279 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-664c0a5f-4903-4964-9e07-827012c9ec86 tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:20.173014 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-664c0a5f-4903-4964-9e07-827012c9ec86 tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:20.176431 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-e65ddaf5-f424-408f-a2ce-ddddb12a27b3 req-3b6b6953-7c27-45c2-b492-e0a9e222e630 service nova] Creating event network-vif-plugged:331433c9-6d41-4903-b1f6-3eedf2e2ae2d for instance 279361ef-2171-49e1-9f33-eadbf5dc0313 on nch2-master-1 Oct 08 20:53:20.187807 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-e65ddaf5-f424-408f-a2ce-ddddb12a27b3 req-3b6b6953-7c27-45c2-b492-e0a9e222e630 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115914 Oct 08 20:53:20.200338 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 303/577] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:53:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:53:20.204725 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-e65ddaf5-f424-408f-a2ce-ddddb12a27b3 req-3b6b6953-7c27-45c2-b492-e0a9e222e630 service nova] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:20.225130 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-e65ddaf5-f424-408f-a2ce-ddddb12a27b3 req-3b6b6953-7c27-45c2-b492-e0a9e222e630 service nova] 10.222.0.26 "GET /compute//" status: 200 len: 377 microversion: - time: 0.006042 Oct 08 20:53:20.228439 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 304/578] 10.222.0.26 () {56 vars in 886 bytes} [Sat Oct 8 20:53:20 2022] GET /compute/ => generated 377 bytes in 27 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 08 20:53:20.242126 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-47d1a3ee-78df-496d-9987-dcf6d71764c6 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:20.247231 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-47d1a3ee-78df-496d-9987-dcf6d71764c6 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] [instance: 99d20873-ce34-47a4-bbe6-5b42e406a360] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:53:20.270935 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-47d1a3ee-78df-496d-9987-dcf6d71764c6 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:20.272232 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-47d1a3ee-78df-496d-9987-dcf6d71764c6 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:20.275517 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-47d1a3ee-78df-496d-9987-dcf6d71764c6 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:20.276406 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-47d1a3ee-78df-496d-9987-dcf6d71764c6 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:20.277290 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-47d1a3ee-78df-496d-9987-dcf6d71764c6 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:20.277947 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-47d1a3ee-78df-496d-9987-dcf6d71764c6 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:20.410823 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=28 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:53:20.468677 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.objects.instance [None req-664c0a5f-4903-4964-9e07-827012c9ec86 tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Lazy-loading 'services' on Instance uuid 1af12bcb-5e2a-4c15-8673-fa41701cb4c7 {{(pid=140491) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 20:53:20.472371 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-47d1a3ee-78df-496d-9987-dcf6d71764c6 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98936da9b5d94165b386d2d0893ac142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2441394d754f499e27f6f35d5b3afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:53:20.495177 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-47d1a3ee-78df-496d-9987-dcf6d71764c6 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] 10.222.0.26 "GET /compute/v2.1/servers/99d20873-ce34-47a4-bbe6-5b42e406a360" status: 200 len: 1388 microversion: 2.1 time: 0.257509 Oct 08 20:53:20.496567 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 305/579] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:53:20 2022] GET /compute/v2.1/servers/99d20873-ce34-47a4-bbe6-5b42e406a360 => generated 1388 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:53:20.515463 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-664c0a5f-4903-4964-9e07-827012c9ec86 tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/1af12bcb-5e2a-4c15-8673-fa41701cb4c7" status: 200 len: 1929 microversion: 2.75 time: 0.385333 Oct 08 20:53:20.516207 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 275/580] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:53:20 2022] GET /compute/v2.1/servers/1af12bcb-5e2a-4c15-8673-fa41701cb4c7 => generated 1929 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:53:20.522694 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-7c6fd466-14ac-40c8-952c-ee8056e40b07 tempest-ServersAdminNegativeTestJSON-1595191754 tempest-ServersAdminNegativeTestJSON-1595191754-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:53:20.526604 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-7c6fd466-14ac-40c8-952c-ee8056e40b07 tempest-ServersAdminNegativeTestJSON-1595191754 tempest-ServersAdminNegativeTestJSON-1595191754-project-admin] [instance: 6de2ea26-e774-47b5-8506-b3ebbc2d1712] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:53:20.531148 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-28c07275-500a-43f3-ab76-b266cab223bd tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:20.532264 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-28c07275-500a-43f3-ab76-b266cab223bd tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] [instance: 279361ef-2171-49e1-9f33-eadbf5dc0313] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:53:20.538558 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7c6fd466-14ac-40c8-952c-ee8056e40b07 tempest-ServersAdminNegativeTestJSON-1595191754 tempest-ServersAdminNegativeTestJSON-1595191754-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:20.543959 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7c6fd466-14ac-40c8-952c-ee8056e40b07 tempest-ServersAdminNegativeTestJSON-1595191754 tempest-ServersAdminNegativeTestJSON-1595191754-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:20.544569 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7c6fd466-14ac-40c8-952c-ee8056e40b07 tempest-ServersAdminNegativeTestJSON-1595191754 tempest-ServersAdminNegativeTestJSON-1595191754-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:20.545586 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7c6fd466-14ac-40c8-952c-ee8056e40b07 tempest-ServersAdminNegativeTestJSON-1595191754 tempest-ServersAdminNegativeTestJSON-1595191754-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:20.546867 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7c6fd466-14ac-40c8-952c-ee8056e40b07 tempest-ServersAdminNegativeTestJSON-1595191754 tempest-ServersAdminNegativeTestJSON-1595191754-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:20.549710 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7c6fd466-14ac-40c8-952c-ee8056e40b07 tempest-ServersAdminNegativeTestJSON-1595191754 tempest-ServersAdminNegativeTestJSON-1595191754-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:20.550647 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-28c07275-500a-43f3-ab76-b266cab223bd tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:20.551770 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-28c07275-500a-43f3-ab76-b266cab223bd tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:20.553075 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-28c07275-500a-43f3-ab76-b266cab223bd tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:20.554083 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-28c07275-500a-43f3-ab76-b266cab223bd tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:20.554779 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-28c07275-500a-43f3-ab76-b266cab223bd tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:20.555540 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-28c07275-500a-43f3-ab76-b266cab223bd tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:20.603367 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.objects.instance [None req-7c6fd466-14ac-40c8-952c-ee8056e40b07 tempest-ServersAdminNegativeTestJSON-1595191754 tempest-ServersAdminNegativeTestJSON-1595191754-project-admin] Lazy-loading 'flavor' on Instance uuid 6de2ea26-e774-47b5-8506-b3ebbc2d1712 {{(pid=140491) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 20:53:20.823651 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-28c07275-500a-43f3-ab76-b266cab223bd tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474ca64d1b1d4e30916b517645aba882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecc2dd2407b4819874bed09cb27959a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:53:20.833169 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-28c07275-500a-43f3-ab76-b266cab223bd tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] 10.222.0.26 "GET /compute/v2.1/servers/279361ef-2171-49e1-9f33-eadbf5dc0313" status: 200 len: 1310 microversion: 2.1 time: 0.321306 Oct 08 20:53:20.833773 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 306/581] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:53:20 2022] GET /compute/v2.1/servers/279361ef-2171-49e1-9f33-eadbf5dc0313 => generated 1310 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:53:20.864120 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-7c6fd466-14ac-40c8-952c-ee8056e40b07 tempest-ServersAdminNegativeTestJSON-1595191754 tempest-ServersAdminNegativeTestJSON-1595191754-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/6de2ea26-e774-47b5-8506-b3ebbc2d1712/action" status: 202 len: 0 microversion: 2.1 time: 0.346376 Oct 08 20:53:20.865990 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 276/582] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 20:53:20 2022] POST /compute/v2.1/servers/6de2ea26-e774-47b5-8506-b3ebbc2d1712/action => generated 0 bytes in 349 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 20:53:20.876410 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-74b3cb6d-842a-4159-8093-f39616df2212 tempest-ServersAdminNegativeTestJSON-1595191754 tempest-ServersAdminNegativeTestJSON-1595191754-project-admin] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:20.877317 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-74b3cb6d-842a-4159-8093-f39616df2212 tempest-ServersAdminNegativeTestJSON-1595191754 tempest-ServersAdminNegativeTestJSON-1595191754-project-admin] [instance: 6de2ea26-e774-47b5-8506-b3ebbc2d1712] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:53:20.884682 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-74b3cb6d-842a-4159-8093-f39616df2212 tempest-ServersAdminNegativeTestJSON-1595191754 tempest-ServersAdminNegativeTestJSON-1595191754-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:20.889716 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-74b3cb6d-842a-4159-8093-f39616df2212 tempest-ServersAdminNegativeTestJSON-1595191754 tempest-ServersAdminNegativeTestJSON-1595191754-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:20.890419 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-74b3cb6d-842a-4159-8093-f39616df2212 tempest-ServersAdminNegativeTestJSON-1595191754 tempest-ServersAdminNegativeTestJSON-1595191754-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:20.892674 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-74b3cb6d-842a-4159-8093-f39616df2212 tempest-ServersAdminNegativeTestJSON-1595191754 tempest-ServersAdminNegativeTestJSON-1595191754-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:20.897536 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-74b3cb6d-842a-4159-8093-f39616df2212 tempest-ServersAdminNegativeTestJSON-1595191754 tempest-ServersAdminNegativeTestJSON-1595191754-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:20.898411 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-74b3cb6d-842a-4159-8093-f39616df2212 tempest-ServersAdminNegativeTestJSON-1595191754 tempest-ServersAdminNegativeTestJSON-1595191754-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:21.087750 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-5c8bb5c4-f2c4-44a0-b4da-422fcb9e0c41 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:21.088668 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-5c8bb5c4-f2c4-44a0-b4da-422fcb9e0c41 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] [instance: 5c864780-3998-4a09-95d4-e000a02af71e] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:53:21.104369 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5c8bb5c4-f2c4-44a0-b4da-422fcb9e0c41 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:21.105245 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5c8bb5c4-f2c4-44a0-b4da-422fcb9e0c41 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:21.105245 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5c8bb5c4-f2c4-44a0-b4da-422fcb9e0c41 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:21.106470 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5c8bb5c4-f2c4-44a0-b4da-422fcb9e0c41 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:21.109657 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5c8bb5c4-f2c4-44a0-b4da-422fcb9e0c41 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:21.110040 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5c8bb5c4-f2c4-44a0-b4da-422fcb9e0c41 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:21.588172 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-5c8bb5c4-f2c4-44a0-b4da-422fcb9e0c41 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef659f5a1a24c439528a7675bdd70f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c92fe04ab8248399d0acb932f82d607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:53:21.600204 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-5c8bb5c4-f2c4-44a0-b4da-422fcb9e0c41 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] 10.222.0.26 "GET /compute/v2.1/servers/5c864780-3998-4a09-95d4-e000a02af71e" status: 200 len: 1313 microversion: 2.1 time: 0.518297 Oct 08 20:53:21.606205 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 277/583] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:53:21 2022] GET /compute/v2.1/servers/5c864780-3998-4a09-95d4-e000a02af71e => generated 1313 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:53:21.615907 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-845b0998-0ab0-4d0c-89fb-fcb112842bcd tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:21.616752 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-845b0998-0ab0-4d0c-89fb-fcb112842bcd tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] [instance: 99d20873-ce34-47a4-bbe6-5b42e406a360] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:53:21.625753 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-74b3cb6d-842a-4159-8093-f39616df2212 tempest-ServersAdminNegativeTestJSON-1595191754 tempest-ServersAdminNegativeTestJSON-1595191754-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/6de2ea26-e774-47b5-8506-b3ebbc2d1712" status: 200 len: 1630 microversion: 2.1 time: 0.754558 Oct 08 20:53:21.626519 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 307/584] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:53:20 2022] GET /compute/v2.1/servers/6de2ea26-e774-47b5-8506-b3ebbc2d1712 => generated 1630 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:53:21.629861 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-845b0998-0ab0-4d0c-89fb-fcb112842bcd tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:21.641834 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-845b0998-0ab0-4d0c-89fb-fcb112842bcd tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:21.642272 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-685b5aee-f014-4315-a3eb-8336302d36b5 tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:21.642882 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-845b0998-0ab0-4d0c-89fb-fcb112842bcd tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:21.643014 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-685b5aee-f014-4315-a3eb-8336302d36b5 tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] [instance: 1af12bcb-5e2a-4c15-8673-fa41701cb4c7] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:53:21.643959 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-845b0998-0ab0-4d0c-89fb-fcb112842bcd tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:21.644632 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-845b0998-0ab0-4d0c-89fb-fcb112842bcd tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:21.645322 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-845b0998-0ab0-4d0c-89fb-fcb112842bcd tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:21.650866 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-685b5aee-f014-4315-a3eb-8336302d36b5 tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:21.652625 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-685b5aee-f014-4315-a3eb-8336302d36b5 tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:21.653822 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-685b5aee-f014-4315-a3eb-8336302d36b5 tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:21.656218 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-685b5aee-f014-4315-a3eb-8336302d36b5 tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:21.658134 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-685b5aee-f014-4315-a3eb-8336302d36b5 tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:21.660384 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-685b5aee-f014-4315-a3eb-8336302d36b5 tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:21.769849 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.objects.instance [None req-685b5aee-f014-4315-a3eb-8336302d36b5 tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Lazy-loading 'services' on Instance uuid 1af12bcb-5e2a-4c15-8673-fa41701cb4c7 {{(pid=140492) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 20:53:21.800623 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-685b5aee-f014-4315-a3eb-8336302d36b5 tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/1af12bcb-5e2a-4c15-8673-fa41701cb4c7" status: 200 len: 1929 microversion: 2.75 time: 0.171975 Oct 08 20:53:21.802449 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 308/585] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:53:21 2022] GET /compute/v2.1/servers/1af12bcb-5e2a-4c15-8673-fa41701cb4c7 => generated 1929 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:53:21.965701 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-845b0998-0ab0-4d0c-89fb-fcb112842bcd tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98936da9b5d94165b386d2d0893ac142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2441394d754f499e27f6f35d5b3afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:53:21.979602 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-845b0998-0ab0-4d0c-89fb-fcb112842bcd tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] 10.222.0.26 "GET /compute/v2.1/servers/99d20873-ce34-47a4-bbe6-5b42e406a360" status: 200 len: 1388 microversion: 2.1 time: 0.371128 Oct 08 20:53:21.980548 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 278/586] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:53:21 2022] GET /compute/v2.1/servers/99d20873-ce34-47a4-bbe6-5b42e406a360 => generated 1388 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:53:21.990431 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-795047c6-6b26-4a3f-9710-51bf266c5a84 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:21.991157 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-795047c6-6b26-4a3f-9710-51bf266c5a84 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] [instance: 279361ef-2171-49e1-9f33-eadbf5dc0313] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:53:21.999091 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-795047c6-6b26-4a3f-9710-51bf266c5a84 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:21.999894 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-795047c6-6b26-4a3f-9710-51bf266c5a84 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:22.000558 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-795047c6-6b26-4a3f-9710-51bf266c5a84 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:22.001579 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-795047c6-6b26-4a3f-9710-51bf266c5a84 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:22.002441 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-795047c6-6b26-4a3f-9710-51bf266c5a84 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:22.003107 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-795047c6-6b26-4a3f-9710-51bf266c5a84 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:22.012118 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-b0a11865-d732-48db-811f-6d02b3e26abb tempest-FlavorsV2TestJSON-393200261 tempest-FlavorsV2TestJSON-393200261-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:22.028493 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-b0a11865-d732-48db-811f-6d02b3e26abb tempest-FlavorsV2TestJSON-393200261 tempest-FlavorsV2TestJSON-393200261-project] 10.222.0.26 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.222535 Oct 08 20:53:22.032861 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 309/587] 10.222.0.26 () {58 vars in 1137 bytes} [Sat Oct 8 20:53:21 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:53:22.046848 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-92e86598-3ac0-41a8-872a-0e2533d8ba0b tempest-FlavorsV2TestJSON-393200261 tempest-FlavorsV2TestJSON-393200261-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:22.123819 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-92e86598-3ac0-41a8-872a-0e2533d8ba0b tempest-FlavorsV2TestJSON-393200261 tempest-FlavorsV2TestJSON-393200261-project] 10.222.0.26 "GET /compute/v2.1/flavors" status: 200 len: 3078 microversion: 2.1 time: 0.080798 Oct 08 20:53:22.129273 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 310/588] 10.222.0.26 () {58 vars in 1125 bytes} [Sat Oct 8 20:53:22 2022] GET /compute/v2.1/flavors => generated 3078 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:53:22.144026 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-b14364e1-3c86-4f1c-801e-fbee76fa67b8 tempest-FlavorsV2TestJSON-393200261 tempest-FlavorsV2TestJSON-393200261-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:22.157349 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-b14364e1-3c86-4f1c-801e-fbee76fa67b8 tempest-FlavorsV2TestJSON-393200261 tempest-FlavorsV2TestJSON-393200261-project] 10.222.0.26 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.018467 Oct 08 20:53:22.158610 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 311/589] 10.222.0.26 () {58 vars in 1137 bytes} [Sat Oct 8 20:53:22 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:53:22.176961 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-cfdee119-1c74-44c1-b3e7-c8d7af80872a tempest-FlavorsV2TestJSON-393200261 tempest-FlavorsV2TestJSON-393200261-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:22.188250 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-cfdee119-1c74-44c1-b3e7-c8d7af80872a tempest-FlavorsV2TestJSON-393200261 tempest-FlavorsV2TestJSON-393200261-project] 10.222.0.26 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.017766 Oct 08 20:53:22.198057 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 312/590] 10.222.0.26 () {58 vars in 1137 bytes} [Sat Oct 8 20:53:22 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 08 20:53:22.206738 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-456e645c-a578-4424-89b6-e95edad59678 tempest-FlavorsV2TestJSON-393200261 tempest-FlavorsV2TestJSON-393200261-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:22.241556 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-456e645c-a578-4424-89b6-e95edad59678 tempest-FlavorsV2TestJSON-393200261 tempest-FlavorsV2TestJSON-393200261-project] 10.222.0.26 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.041157 Oct 08 20:53:22.254060 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 313/591] 10.222.0.26 () {58 vars in 1165 bytes} [Sat Oct 8 20:53:22 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:53:22.262987 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-24a35113-cc1d-4a5f-b63f-0b699f9a1b72 req-b156caae-352c-449b-a56f-26a1957f19db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c864780-3998-4a09-95d4-e000a02af71e", "name": "network-vif-plugged", "status": "completed", "tag": "74d30b45-d23b-46ee-9285-24066d68f449"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:53:22.275744 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-24a35113-cc1d-4a5f-b63f-0b699f9a1b72 req-b156caae-352c-449b-a56f-26a1957f19db service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:22.276220 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-24a35113-cc1d-4a5f-b63f-0b699f9a1b72 req-b156caae-352c-449b-a56f-26a1957f19db service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:22.276694 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-24a35113-cc1d-4a5f-b63f-0b699f9a1b72 req-b156caae-352c-449b-a56f-26a1957f19db service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:22.293880 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-24a35113-cc1d-4a5f-b63f-0b699f9a1b72 req-b156caae-352c-449b-a56f-26a1957f19db service nova] Creating event network-vif-plugged:74d30b45-d23b-46ee-9285-24066d68f449 for instance 5c864780-3998-4a09-95d4-e000a02af71e on nch2-master-1 Oct 08 20:53:22.301029 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-24a35113-cc1d-4a5f-b63f-0b699f9a1b72 req-b156caae-352c-449b-a56f-26a1957f19db service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044809 Oct 08 20:53:22.302949 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 314/592] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:53:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:53:22.309047 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-555f78d9-5a8f-4447-af71-cc66404698b0 tempest-FlavorsV2TestJSON-393200261 tempest-FlavorsV2TestJSON-393200261-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:22.320019 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-555f78d9-5a8f-4447-af71-cc66404698b0 tempest-FlavorsV2TestJSON-393200261 tempest-FlavorsV2TestJSON-393200261-project] 10.222.0.26 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.014395 Oct 08 20:53:22.328925 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 315/593] 10.222.0.26 () {58 vars in 1137 bytes} [Sat Oct 8 20:53:22 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:53:22.334609 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-7df607b5-1be7-4379-aa56-79153aae43f9 tempest-FlavorsV2TestJSON-393200261 tempest-FlavorsV2TestJSON-393200261-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:22.366433 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-7df607b5-1be7-4379-aa56-79153aae43f9 tempest-FlavorsV2TestJSON-393200261 tempest-FlavorsV2TestJSON-393200261-project] 10.222.0.26 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.035767 Oct 08 20:53:22.369529 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 316/594] 10.222.0.26 () {58 vars in 1169 bytes} [Sat Oct 8 20:53:22 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:53:22.370192 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-795047c6-6b26-4a3f-9710-51bf266c5a84 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474ca64d1b1d4e30916b517645aba882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecc2dd2407b4819874bed09cb27959a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:53:22.383143 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-795047c6-6b26-4a3f-9710-51bf266c5a84 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] 10.222.0.26 "GET /compute/v2.1/servers/279361ef-2171-49e1-9f33-eadbf5dc0313" status: 200 len: 1310 microversion: 2.1 time: 0.401288 Oct 08 20:53:22.384824 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e661db2b-a36b-4d98-a949-e1f47f374d38 tempest-FlavorsV2TestJSON-393200261 tempest-FlavorsV2TestJSON-393200261-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:22.386905 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 279/595] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:53:21 2022] GET /compute/v2.1/servers/279361ef-2171-49e1-9f33-eadbf5dc0313 => generated 1310 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:53:22.402058 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-e661db2b-a36b-4d98-a949-e1f47f374d38 tempest-FlavorsV2TestJSON-393200261 tempest-FlavorsV2TestJSON-393200261-project] 10.222.0.26 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.021508 Oct 08 20:53:22.402835 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 317/596] 10.222.0.26 () {58 vars in 1161 bytes} [Sat Oct 8 20:53:22 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:53:22.417981 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-cdfe5bf1-70df-4b9a-b71c-d7626935b23c tempest-FlavorsV2TestJSON-393200261 tempest-FlavorsV2TestJSON-393200261-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:22.438093 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-cdfe5bf1-70df-4b9a-b71c-d7626935b23c tempest-FlavorsV2TestJSON-393200261 tempest-FlavorsV2TestJSON-393200261-project] 10.222.0.26 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.023756 Oct 08 20:53:22.439071 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 280/597] 10.222.0.26 () {58 vars in 1137 bytes} [Sat Oct 8 20:53:22 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:53:22.451608 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-6096921d-c76c-433a-80b3-4d13d1c1b4a0 tempest-FlavorsV2TestJSON-393200261 tempest-FlavorsV2TestJSON-393200261-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:22.506311 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-6096921d-c76c-433a-80b3-4d13d1c1b4a0 tempest-FlavorsV2TestJSON-393200261 tempest-FlavorsV2TestJSON-393200261-project] 10.222.0.26 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.058127 Oct 08 20:53:22.507421 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 318/598] 10.222.0.26 () {58 vars in 1167 bytes} [Sat Oct 8 20:53:22 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:53:22.527775 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-580be3b2-92d5-4653-a29e-c5c0e1a4b7b1 tempest-FlavorsV2TestJSON-393200261 tempest-FlavorsV2TestJSON-393200261-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:22.541046 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-580be3b2-92d5-4653-a29e-c5c0e1a4b7b1 tempest-FlavorsV2TestJSON-393200261 tempest-FlavorsV2TestJSON-393200261-project] 10.222.0.26 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.019153 Oct 08 20:53:22.569661 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-bacaebdb-fcd2-4d27-ab2f-a23a0bc52140 tempest-FlavorsV2TestJSON-393200261 tempest-FlavorsV2TestJSON-393200261-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:22.573300 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 281/599] 10.222.0.26 () {58 vars in 1137 bytes} [Sat Oct 8 20:53:22 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:53:22.593268 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-bacaebdb-fcd2-4d27-ab2f-a23a0bc52140 tempest-FlavorsV2TestJSON-393200261 tempest-FlavorsV2TestJSON-393200261-project] 10.222.0.26 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.031139 Oct 08 20:53:22.594202 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 319/600] 10.222.0.26 () {58 vars in 1144 bytes} [Sat Oct 8 20:53:22 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:53:22.609853 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-0dba295c-f672-4765-9502-fcce6abec897 tempest-FlavorsV2TestJSON-393200261 tempest-FlavorsV2TestJSON-393200261-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:22.624787 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-0dba295c-f672-4765-9502-fcce6abec897 tempest-FlavorsV2TestJSON-393200261 tempest-FlavorsV2TestJSON-393200261-project] 10.222.0.26 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.018947 Oct 08 20:53:22.626070 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 282/601] 10.222.0.26 () {58 vars in 1137 bytes} [Sat Oct 8 20:53:22 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:53:22.634333 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-bcb5de15-ead7-4daf-89fb-4ab0852b29ac tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:22.635782 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-bcb5de15-ead7-4daf-89fb-4ab0852b29ac tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] [instance: 5c864780-3998-4a09-95d4-e000a02af71e] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:53:22.654865 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bcb5de15-ead7-4daf-89fb-4ab0852b29ac tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:22.655649 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bcb5de15-ead7-4daf-89fb-4ab0852b29ac tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:22.656242 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bcb5de15-ead7-4daf-89fb-4ab0852b29ac tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:22.657145 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bcb5de15-ead7-4daf-89fb-4ab0852b29ac tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:22.657564 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-d08c2db9-7461-4437-9815-f03d785ad6d9 tempest-FlavorsV2TestJSON-393200261 tempest-FlavorsV2TestJSON-393200261-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:22.657946 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bcb5de15-ead7-4daf-89fb-4ab0852b29ac tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:22.658535 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bcb5de15-ead7-4daf-89fb-4ab0852b29ac tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:22.722794 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-d08c2db9-7461-4437-9815-f03d785ad6d9 tempest-FlavorsV2TestJSON-393200261 tempest-FlavorsV2TestJSON-393200261-project] 10.222.0.26 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.085254 Oct 08 20:53:22.724084 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 283/602] 10.222.0.26 () {58 vars in 1148 bytes} [Sat Oct 8 20:53:22 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:53:22.733811 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-fb3480b1-cd3e-4ef2-a716-72dd793a063e tempest-ServersAdminNegativeTestJSON-1595191754 tempest-ServersAdminNegativeTestJSON-1595191754-project-admin] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:22.734654 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-fb3480b1-cd3e-4ef2-a716-72dd793a063e tempest-ServersAdminNegativeTestJSON-1595191754 tempest-ServersAdminNegativeTestJSON-1595191754-project-admin] [instance: 6de2ea26-e774-47b5-8506-b3ebbc2d1712] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:53:22.741628 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fb3480b1-cd3e-4ef2-a716-72dd793a063e tempest-ServersAdminNegativeTestJSON-1595191754 tempest-ServersAdminNegativeTestJSON-1595191754-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:22.742367 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fb3480b1-cd3e-4ef2-a716-72dd793a063e tempest-ServersAdminNegativeTestJSON-1595191754 tempest-ServersAdminNegativeTestJSON-1595191754-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:22.742997 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fb3480b1-cd3e-4ef2-a716-72dd793a063e tempest-ServersAdminNegativeTestJSON-1595191754 tempest-ServersAdminNegativeTestJSON-1595191754-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:22.743875 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fb3480b1-cd3e-4ef2-a716-72dd793a063e tempest-ServersAdminNegativeTestJSON-1595191754 tempest-ServersAdminNegativeTestJSON-1595191754-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:22.744533 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fb3480b1-cd3e-4ef2-a716-72dd793a063e tempest-ServersAdminNegativeTestJSON-1595191754 tempest-ServersAdminNegativeTestJSON-1595191754-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:22.745154 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fb3480b1-cd3e-4ef2-a716-72dd793a063e tempest-ServersAdminNegativeTestJSON-1595191754 tempest-ServersAdminNegativeTestJSON-1595191754-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:22.969059 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-bcb5de15-ead7-4daf-89fb-4ab0852b29ac tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef659f5a1a24c439528a7675bdd70f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c92fe04ab8248399d0acb932f82d607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:53:22.980663 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-bcb5de15-ead7-4daf-89fb-4ab0852b29ac tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] 10.222.0.26 "GET /compute/v2.1/servers/5c864780-3998-4a09-95d4-e000a02af71e" status: 200 len: 1313 microversion: 2.1 time: 0.354757 Oct 08 20:53:22.985569 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 320/603] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:53:22 2022] GET /compute/v2.1/servers/5c864780-3998-4a09-95d4-e000a02af71e => generated 1313 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:53:22.992803 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-5dd903e3-2b94-4f8c-9cb1-08dca933a45a tempest-FlavorsV2TestJSON-393200261 tempest-FlavorsV2TestJSON-393200261-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:23.008780 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-5dd903e3-2b94-4f8c-9cb1-08dca933a45a tempest-FlavorsV2TestJSON-393200261 tempest-FlavorsV2TestJSON-393200261-project] 10.222.0.26 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.020136 Oct 08 20:53:23.010762 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 321/604] 10.222.0.26 () {58 vars in 1140 bytes} [Sat Oct 8 20:53:22 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:53:23.016663 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-107310cc-3cb6-4a1c-a2db-21ff334789ad tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:23.017880 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-107310cc-3cb6-4a1c-a2db-21ff334789ad tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] [instance: 1af12bcb-5e2a-4c15-8673-fa41701cb4c7] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:53:23.028374 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-107310cc-3cb6-4a1c-a2db-21ff334789ad tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:23.029454 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-107310cc-3cb6-4a1c-a2db-21ff334789ad tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:23.031119 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-107310cc-3cb6-4a1c-a2db-21ff334789ad tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:23.032550 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-107310cc-3cb6-4a1c-a2db-21ff334789ad tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:23.033510 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-107310cc-3cb6-4a1c-a2db-21ff334789ad tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:23.034339 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-107310cc-3cb6-4a1c-a2db-21ff334789ad tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:23.190246 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.objects.instance [None req-107310cc-3cb6-4a1c-a2db-21ff334789ad tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Lazy-loading 'services' on Instance uuid 1af12bcb-5e2a-4c15-8673-fa41701cb4c7 {{(pid=140492) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 20:53:23.215268 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-107310cc-3cb6-4a1c-a2db-21ff334789ad tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/1af12bcb-5e2a-4c15-8673-fa41701cb4c7" status: 200 len: 1929 microversion: 2.75 time: 0.202101 Oct 08 20:53:23.215902 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 322/605] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:53:23 2022] GET /compute/v2.1/servers/1af12bcb-5e2a-4c15-8673-fa41701cb4c7 => generated 1929 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:53:23.221862 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e030f43d-9425-4747-ae6c-350a8f905eca tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:23.222413 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-e030f43d-9425-4747-ae6c-350a8f905eca tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] [instance: 99d20873-ce34-47a4-bbe6-5b42e406a360] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:53:23.229557 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e030f43d-9425-4747-ae6c-350a8f905eca tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:23.229985 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e030f43d-9425-4747-ae6c-350a8f905eca tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:23.230431 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e030f43d-9425-4747-ae6c-350a8f905eca tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:23.231143 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e030f43d-9425-4747-ae6c-350a8f905eca tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:23.231606 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e030f43d-9425-4747-ae6c-350a8f905eca tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:23.232038 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e030f43d-9425-4747-ae6c-350a8f905eca tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:23.379778 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-fb3480b1-cd3e-4ef2-a716-72dd793a063e tempest-ServersAdminNegativeTestJSON-1595191754 tempest-ServersAdminNegativeTestJSON-1595191754-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/6de2ea26-e774-47b5-8506-b3ebbc2d1712" status: 200 len: 1613 microversion: 2.1 time: 0.654350 Oct 08 20:53:23.380397 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 284/606] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:53:22 2022] GET /compute/v2.1/servers/6de2ea26-e774-47b5-8506-b3ebbc2d1712 => generated 1613 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:53:23.397254 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-1cb3897a-f1ae-419e-bb81-e6a04b64b9e5 tempest-FlavorsV2TestJSON-393200261 tempest-FlavorsV2TestJSON-393200261-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:23.416163 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-1cb3897a-f1ae-419e-bb81-e6a04b64b9e5 tempest-FlavorsV2TestJSON-393200261 tempest-FlavorsV2TestJSON-393200261-project] 10.222.0.26 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.034701 Oct 08 20:53:23.416792 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 285/607] 10.222.0.26 () {58 vars in 1137 bytes} [Sat Oct 8 20:53:23 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:53:23.432651 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-005e287f-b82b-4ce7-929c-93bf45ce96c6 tempest-ServersAdminNegativeTestJSON-1595191754 tempest-ServersAdminNegativeTestJSON-1595191754-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:53:23.433273 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-005e287f-b82b-4ce7-929c-93bf45ce96c6 tempest-ServersAdminNegativeTestJSON-1595191754 tempest-ServersAdminNegativeTestJSON-1595191754-project-admin] [instance: 6de2ea26-e774-47b5-8506-b3ebbc2d1712] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:53:23.456109 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-005e287f-b82b-4ce7-929c-93bf45ce96c6 tempest-ServersAdminNegativeTestJSON-1595191754 tempest-ServersAdminNegativeTestJSON-1595191754-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:23.456959 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-005e287f-b82b-4ce7-929c-93bf45ce96c6 tempest-ServersAdminNegativeTestJSON-1595191754 tempest-ServersAdminNegativeTestJSON-1595191754-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:23.457085 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-005e287f-b82b-4ce7-929c-93bf45ce96c6 tempest-ServersAdminNegativeTestJSON-1595191754 tempest-ServersAdminNegativeTestJSON-1595191754-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:23.462942 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-005e287f-b82b-4ce7-929c-93bf45ce96c6 tempest-ServersAdminNegativeTestJSON-1595191754 tempest-ServersAdminNegativeTestJSON-1595191754-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:23.463696 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-005e287f-b82b-4ce7-929c-93bf45ce96c6 tempest-ServersAdminNegativeTestJSON-1595191754 tempest-ServersAdminNegativeTestJSON-1595191754-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:23.464906 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-005e287f-b82b-4ce7-929c-93bf45ce96c6 tempest-ServersAdminNegativeTestJSON-1595191754 tempest-ServersAdminNegativeTestJSON-1595191754-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:23.467846 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-e030f43d-9425-4747-ae6c-350a8f905eca tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98936da9b5d94165b386d2d0893ac142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2441394d754f499e27f6f35d5b3afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:53:23.493535 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-e030f43d-9425-4747-ae6c-350a8f905eca tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] 10.222.0.26 "GET /compute/v2.1/servers/99d20873-ce34-47a4-bbe6-5b42e406a360" status: 200 len: 1388 microversion: 2.1 time: 0.267778 Oct 08 20:53:23.505376 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 323/608] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:53:23 2022] GET /compute/v2.1/servers/99d20873-ce34-47a4-bbe6-5b42e406a360 => generated 1388 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:53:23.515113 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-f9cafc3c-e57b-4d07-8f86-489cfa73468e tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:23.515739 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-f9cafc3c-e57b-4d07-8f86-489cfa73468e tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] [instance: 279361ef-2171-49e1-9f33-eadbf5dc0313] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:53:23.521874 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f9cafc3c-e57b-4d07-8f86-489cfa73468e tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:23.522377 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f9cafc3c-e57b-4d07-8f86-489cfa73468e tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:23.522820 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f9cafc3c-e57b-4d07-8f86-489cfa73468e tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:23.523539 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f9cafc3c-e57b-4d07-8f86-489cfa73468e tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:23.523998 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f9cafc3c-e57b-4d07-8f86-489cfa73468e tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:23.524433 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f9cafc3c-e57b-4d07-8f86-489cfa73468e tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:23.641759 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-005e287f-b82b-4ce7-929c-93bf45ce96c6 tempest-ServersAdminNegativeTestJSON-1595191754 tempest-ServersAdminNegativeTestJSON-1595191754-project-admin] HTTP exception thrown: Cannot 'migrate' instance 6de2ea26-e774-47b5-8506-b3ebbc2d1712 while it is in vm_state suspended Oct 08 20:53:23.647021 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-005e287f-b82b-4ce7-929c-93bf45ce96c6 tempest-ServersAdminNegativeTestJSON-1595191754 tempest-ServersAdminNegativeTestJSON-1595191754-project-admin] Request method failure captured: Oct 08 20:53:23.647021 ncdv-master-1 devstack@n-api.service[140491]: request: POST /compute/v2.1/servers/6de2ea26-e774-47b5-8506-b3ebbc2d1712/action HTTP/1.1 Oct 08 20:53:23.647021 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 20:53:23.647021 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 20:53:23.647021 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 20:53:23.647021 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 15 Oct 08 20:53:23.647021 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 20:53:23.647021 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 20:53:23.647021 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 20:53:23.647021 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 20:53:23.647021 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeML0OHMVFDPindfvjl4I6rk9bvD4uNY-qx_e5Rq6p0kk9YN3i1BuSpXj1tea77clsra7Z3LUUNPby9eYNjQ_b4MElZyhDzQyr1I4EuLhrKcEKBbjYBO1N9QwHGLBhqktGpjYn_GmHb8nFn603Dm2x_LMsuCWob8JqXOUS2wYKWYhNQ Oct 08 20:53:23.647021 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 20:53:23.647021 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 20:53:23.647021 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 20:53:23.647021 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 20:53:23.647021 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 20:53:23.647021 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 20:53:23.647021 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: dac5ccb4d1b74021ac5625851f88c009 Oct 08 20:53:23.647021 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1595191754 Oct 08 20:53:23.647021 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,admin,member Oct 08 20:53:23.647021 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,admin,member Oct 08 20:53:23.648684 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/dac5ccb4d1b74021ac5625851f88c009"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/dac5ccb4d1b74021ac5625851f88c009"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_dac5ccb4d1b74021ac5625851f88c009"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/dac5ccb4d1b74021ac5625851f88c009"}]}] Oct 08 20:53:23.648684 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1595191754 Oct 08 20:53:23.648684 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: dac5ccb4d1b74021ac5625851f88c009 Oct 08 20:53:23.648684 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1595191754 Oct 08 20:53:23.648684 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-ServersAdminNegativeTestJSON-1595191754-project-admin Oct 08 20:53:23.648684 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 20:53:23.648684 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 20:53:23.648684 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 4b1b7b27c9b04fb897ebe2669d10c479 Oct 08 20:53:23.648684 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1595191754-project-admin Oct 08 20:53:23.648684 ncdv-master-1 devstack@n-api.service[140491]: Oct 08 20:53:23.648684 ncdv-master-1 devstack@n-api.service[140491]: {"migrate": {}} Oct 08 20:53:23.648684 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 20:53:23.648684 ncdv-master-1 devstack@n-api.service[140491]: exception: Cannot 'migrate' instance 6de2ea26-e774-47b5-8506-b3ebbc2d1712 while it is in vm_state suspended Oct 08 20:53:23.649976 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': '6de2ea26-e774-47b5-8506-b3ebbc2d1712', 'body': {'migrate': {}}} Oct 08 20:53:23.649976 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:53:23.649976 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:53:23.649976 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Oct 08 20:53:23.649976 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Oct 08 20:53:23.649976 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 08 20:53:23.649976 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 08 20:53:23.649976 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 08 20:53:23.649976 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 08 20:53:23.649976 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 08 20:53:23.649976 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 08 20:53:23.649976 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 08 20:53:23.649976 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 08 20:53:23.649976 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 08 20:53:23.649976 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 08 20:53:23.649976 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 6de2ea26-e774-47b5-8506-b3ebbc2d1712 in vm_state suspended. Cannot resize while the instance is in this state. Oct 08 20:53:23.649976 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:53:23.649976 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:53:23.649976 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:53:23.649976 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:53:23.652525 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:53:23.652525 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:53:23.652525 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:53:23.652525 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:53:23.652525 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:53:23.652525 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:53:23.652525 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 20:53:23.652525 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 20:53:23.652525 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Oct 08 20:53:23.652525 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 08 20:53:23.652525 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 08 20:53:23.652525 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 08 20:53:23.652525 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance 6de2ea26-e774-47b5-8506-b3ebbc2d1712 while it is in vm_state suspended Oct 08 20:53:23.652525 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:53:23.652525 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:53:23.652525 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:53:23.652525 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:53:23.652525 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:53:23.652525 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:53:23.655073 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 20:53:23.655073 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 20:53:23.655073 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance 6de2ea26-e774-47b5-8506-b3ebbc2d1712 while it is in vm_state suspended Oct 08 20:53:23.655073 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:53:23.658234 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-005e287f-b82b-4ce7-929c-93bf45ce96c6 tempest-ServersAdminNegativeTestJSON-1595191754 tempest-ServersAdminNegativeTestJSON-1595191754-project-admin] Returning 409 to user: Cannot 'migrate' instance 6de2ea26-e774-47b5-8506-b3ebbc2d1712 while it is in vm_state suspended {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:53:23.660721 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-005e287f-b82b-4ce7-929c-93bf45ce96c6 tempest-ServersAdminNegativeTestJSON-1595191754 tempest-ServersAdminNegativeTestJSON-1595191754-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/6de2ea26-e774-47b5-8506-b3ebbc2d1712/action" status: 409 len: 148 microversion: 2.1 time: 0.241603 Oct 08 20:53:23.668524 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 286/609] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 20:53:23 2022] POST /compute/v2.1/servers/6de2ea26-e774-47b5-8506-b3ebbc2d1712/action => generated 148 bytes in 251 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 08 20:53:23.688499 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-39aaaa50-a016-49cf-9c22-664c8dac5bd7 tempest-FlavorsV2TestJSON-393200261 tempest-FlavorsV2TestJSON-393200261-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:23.759980 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=1,nova_api:DELETE=3 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:53:23.766211 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-39aaaa50-a016-49cf-9c22-664c8dac5bd7 tempest-FlavorsV2TestJSON-393200261 tempest-FlavorsV2TestJSON-393200261-project] 10.222.0.26 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.094157 Oct 08 20:53:23.767839 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 287/610] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Oct 8 20:53:23 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:53:23.782940 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-1dc39b13-8960-4b13-a81d-03946d510e50 tempest-ServersAdminNegativeTestJSON-1595191754 tempest-ServersAdminNegativeTestJSON-1595191754-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:53:23.787461 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-1dc39b13-8960-4b13-a81d-03946d510e50 tempest-ServersAdminNegativeTestJSON-1595191754 tempest-ServersAdminNegativeTestJSON-1595191754-project-admin] Request method failure captured: Oct 08 20:53:23.787461 ncdv-master-1 devstack@n-api.service[140491]: request: POST /compute/v2.1/servers/0b4b7773-b59d-4956-b7e5-267d54541db6/action HTTP/1.1 Oct 08 20:53:23.787461 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 20:53:23.787461 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 20:53:23.787461 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 20:53:23.787461 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 39 Oct 08 20:53:23.787461 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 20:53:23.787461 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 20:53:23.787461 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 20:53:23.787461 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 20:53:23.787461 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeML0OHMVFDPindfvjl4I6rk9bvD4uNY-qx_e5Rq6p0kk9YN3i1BuSpXj1tea77clsra7Z3LUUNPby9eYNjQ_b4MElZyhDzQyr1I4EuLhrKcEKBbjYBO1N9QwHGLBhqktGpjYn_GmHb8nFn603Dm2x_LMsuCWob8JqXOUS2wYKWYhNQ Oct 08 20:53:23.787461 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 20:53:23.787461 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 20:53:23.787461 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 20:53:23.787461 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 20:53:23.787461 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 20:53:23.787461 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 20:53:23.787461 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: dac5ccb4d1b74021ac5625851f88c009 Oct 08 20:53:23.787461 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1595191754 Oct 08 20:53:23.787461 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,admin,member Oct 08 20:53:23.787461 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,admin,member Oct 08 20:53:23.788857 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/dac5ccb4d1b74021ac5625851f88c009"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/dac5ccb4d1b74021ac5625851f88c009"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_dac5ccb4d1b74021ac5625851f88c009"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/dac5ccb4d1b74021ac5625851f88c009"}]}] Oct 08 20:53:23.788857 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1595191754 Oct 08 20:53:23.788857 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: dac5ccb4d1b74021ac5625851f88c009 Oct 08 20:53:23.788857 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1595191754 Oct 08 20:53:23.788857 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-ServersAdminNegativeTestJSON-1595191754-project-admin Oct 08 20:53:23.788857 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 20:53:23.788857 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 20:53:23.788857 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 4b1b7b27c9b04fb897ebe2669d10c479 Oct 08 20:53:23.788857 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1595191754-project-admin Oct 08 20:53:23.788857 ncdv-master-1 devstack@n-api.service[140491]: Oct 08 20:53:23.788857 ncdv-master-1 devstack@n-api.service[140491]: {"os-resetState": {"state": "invalid"}} Oct 08 20:53:23.788857 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 20:53:23.789609 ncdv-master-1 devstack@n-api.service[140491]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 08 20:53:23.789609 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': '0b4b7773-b59d-4956-b7e5-267d54541db6', 'body': {'os-resetState': {'state': 'invalid'}}} Oct 08 20:53:23.789609 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:53:23.789609 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:53:23.789609 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 08 20:53:23.789609 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 08 20:53:23.789609 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 08 20:53:23.789609 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise error Oct 08 20:53:23.789609 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Oct 08 20:53:23.789609 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:53:23.789609 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Oct 08 20:53:23.789609 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Oct 08 20:53:23.789609 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:53:23.789609 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Oct 08 20:53:23.789609 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi 'invalid' Oct 08 20:53:23.789609 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:53:23.789609 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:53:23.789609 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:53:23.789609 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:53:23.789609 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:53:23.789609 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:53:23.789609 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:53:23.790941 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:53:23.790941 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:53:23.790941 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:53:23.790941 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 08 20:53:23.790941 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 08 20:53:23.790941 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 08 20:53:23.790941 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 08 20:53:23.790941 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 08 20:53:23.790941 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 08 20:53:23.790941 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 08 20:53:23.790941 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:53:23.790941 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:53:23.790941 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:53:23.790941 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:53:23.790941 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:53:23.790941 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:53:23.790941 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 08 20:53:23.790941 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 08 20:53:23.790941 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 08 20:53:23.792035 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:53:23.794488 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-1dc39b13-8960-4b13-a81d-03946d510e50 tempest-ServersAdminNegativeTestJSON-1595191754 tempest-ServersAdminNegativeTestJSON-1595191754-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:53:23.796396 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-1dc39b13-8960-4b13-a81d-03946d510e50 tempest-ServersAdminNegativeTestJSON-1595191754 tempest-ServersAdminNegativeTestJSON-1595191754-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/0b4b7773-b59d-4956-b7e5-267d54541db6/action" status: 400 len: 144 microversion: 2.1 time: 0.026900 Oct 08 20:53:23.798668 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 288/611] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 20:53:23 2022] POST /compute/v2.1/servers/0b4b7773-b59d-4956-b7e5-267d54541db6/action => generated 144 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 08 20:53:23.806837 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-2bee9a5a-d73d-4c01-bc4e-1aeb8f812dae tempest-FlavorsV2TestJSON-393200261 tempest-FlavorsV2TestJSON-393200261-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:23.836197 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-2bee9a5a-d73d-4c01-bc4e-1aeb8f812dae tempest-FlavorsV2TestJSON-393200261 tempest-FlavorsV2TestJSON-393200261-project] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.036106 Oct 08 20:53:23.837522 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 289/612] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Oct 8 20:53:23 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:53:23.842105 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-f9cafc3c-e57b-4d07-8f86-489cfa73468e tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474ca64d1b1d4e30916b517645aba882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecc2dd2407b4819874bed09cb27959a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:53:23.856111 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-f9cafc3c-e57b-4d07-8f86-489cfa73468e tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] 10.222.0.26 "GET /compute/v2.1/servers/279361ef-2171-49e1-9f33-eadbf5dc0313" status: 200 len: 1494 microversion: 2.1 time: 0.349452 Oct 08 20:53:23.858642 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 324/613] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:53:23 2022] GET /compute/v2.1/servers/279361ef-2171-49e1-9f33-eadbf5dc0313 => generated 1494 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:53:23.863918 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-ddb79335-0886-4725-97cd-5f8a28797aa2 tempest-ServersAdminNegativeTestJSON-1595191754 tempest-ServersAdminNegativeTestJSON-1595191754-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:53:23.866506 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-ddb79335-0886-4725-97cd-5f8a28797aa2 tempest-ServersAdminNegativeTestJSON-1595191754 tempest-ServersAdminNegativeTestJSON-1595191754-project-admin] Request method failure captured: Oct 08 20:53:23.866506 ncdv-master-1 devstack@n-api.service[140491]: request: POST /compute/v2.1/servers/0b4b7773-b59d-4956-b7e5-267d54541db6/action HTTP/1.1 Oct 08 20:53:23.866506 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 20:53:23.866506 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 20:53:23.866506 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 20:53:23.866506 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 31 Oct 08 20:53:23.866506 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 20:53:23.866506 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 20:53:23.866506 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 20:53:23.866506 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 20:53:23.866506 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeML0OHMVFDPindfvjl4I6rk9bvD4uNY-qx_e5Rq6p0kk9YN3i1BuSpXj1tea77clsra7Z3LUUNPby9eYNjQ_b4MElZyhDzQyr1I4EuLhrKcEKBbjYBO1N9QwHGLBhqktGpjYn_GmHb8nFn603Dm2x_LMsuCWob8JqXOUS2wYKWYhNQ Oct 08 20:53:23.866506 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 20:53:23.866506 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 20:53:23.866506 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 20:53:23.866506 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 20:53:23.866506 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 20:53:23.866506 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 20:53:23.866506 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: dac5ccb4d1b74021ac5625851f88c009 Oct 08 20:53:23.866506 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1595191754 Oct 08 20:53:23.866506 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,admin,member Oct 08 20:53:23.866506 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,admin,member Oct 08 20:53:23.867748 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/dac5ccb4d1b74021ac5625851f88c009"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/dac5ccb4d1b74021ac5625851f88c009"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_dac5ccb4d1b74021ac5625851f88c009"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/dac5ccb4d1b74021ac5625851f88c009"}]}] Oct 08 20:53:23.867748 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1595191754 Oct 08 20:53:23.867748 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: dac5ccb4d1b74021ac5625851f88c009 Oct 08 20:53:23.867748 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1595191754 Oct 08 20:53:23.867748 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-ServersAdminNegativeTestJSON-1595191754-project-admin Oct 08 20:53:23.867748 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 20:53:23.867748 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 20:53:23.867748 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 4b1b7b27c9b04fb897ebe2669d10c479 Oct 08 20:53:23.867748 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1595191754-project-admin Oct 08 20:53:23.867748 ncdv-master-1 devstack@n-api.service[140491]: Oct 08 20:53:23.867748 ncdv-master-1 devstack@n-api.service[140491]: {"os-resetState": {"state": 1}} Oct 08 20:53:23.867748 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 20:53:23.867748 ncdv-master-1 devstack@n-api.service[140491]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 08 20:53:23.868486 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': '0b4b7773-b59d-4956-b7e5-267d54541db6', 'body': {'os-resetState': {'state': 1}}} Oct 08 20:53:23.868486 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:53:23.868486 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:53:23.868486 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 08 20:53:23.868486 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 08 20:53:23.868486 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 08 20:53:23.868486 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise error Oct 08 20:53:23.868486 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Oct 08 20:53:23.868486 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:53:23.868486 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Oct 08 20:53:23.868486 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Oct 08 20:53:23.868486 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:53:23.868486 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Oct 08 20:53:23.868486 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi 1 Oct 08 20:53:23.868486 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:53:23.868486 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:53:23.868486 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:53:23.868486 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:53:23.868486 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:53:23.868486 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:53:23.868486 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:53:23.868486 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:53:23.869753 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:53:23.869753 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:53:23.869753 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 08 20:53:23.869753 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 08 20:53:23.869753 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 08 20:53:23.869753 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 08 20:53:23.869753 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 08 20:53:23.869753 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 08 20:53:23.869753 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 08 20:53:23.869753 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:53:23.869753 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:53:23.869753 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:53:23.869753 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:53:23.869753 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:53:23.869753 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:53:23.869753 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 08 20:53:23.869753 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 08 20:53:23.869753 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 08 20:53:23.869753 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:53:23.870819 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-ddb79335-0886-4725-97cd-5f8a28797aa2 tempest-ServersAdminNegativeTestJSON-1595191754 tempest-ServersAdminNegativeTestJSON-1595191754-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:53:23.870819 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-ddb79335-0886-4725-97cd-5f8a28797aa2 tempest-ServersAdminNegativeTestJSON-1595191754 tempest-ServersAdminNegativeTestJSON-1595191754-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/0b4b7773-b59d-4956-b7e5-267d54541db6/action" status: 400 len: 120 microversion: 2.1 time: 0.030299 Oct 08 20:53:23.882053 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 290/614] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 20:53:23 2022] POST /compute/v2.1/servers/0b4b7773-b59d-4956-b7e5-267d54541db6/action => generated 120 bytes in 43 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 08 20:53:23.888136 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-b52a76d7-39f7-46cf-80e0-84a79efe286e tempest-FlavorsV2TestJSON-393200261 tempest-FlavorsV2TestJSON-393200261-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:23.890380 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-d89b271a-fab4-41da-a47f-05d84c5ec17c tempest-ServersAdminNegativeTestJSON-1595191754 tempest-ServersAdminNegativeTestJSON-1595191754-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:53:23.893629 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-d89b271a-fab4-41da-a47f-05d84c5ec17c tempest-ServersAdminNegativeTestJSON-1595191754 tempest-ServersAdminNegativeTestJSON-1595191754-project-admin] Failed to fetch instance by id 999 {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 08 20:53:23.894259 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-d89b271a-fab4-41da-a47f-05d84c5ec17c tempest-ServersAdminNegativeTestJSON-1595191754 tempest-ServersAdminNegativeTestJSON-1595191754-project-admin] HTTP exception thrown: Instance 999 could not be found. Oct 08 20:53:23.896287 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-d89b271a-fab4-41da-a47f-05d84c5ec17c tempest-ServersAdminNegativeTestJSON-1595191754 tempest-ServersAdminNegativeTestJSON-1595191754-project-admin] Request method failure captured: Oct 08 20:53:23.896287 ncdv-master-1 devstack@n-api.service[140491]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Oct 08 20:53:23.896287 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 20:53:23.896287 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 20:53:23.896287 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 20:53:23.896287 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 37 Oct 08 20:53:23.896287 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 20:53:23.896287 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 20:53:23.896287 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 20:53:23.896287 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 20:53:23.896287 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeML0OHMVFDPindfvjl4I6rk9bvD4uNY-qx_e5Rq6p0kk9YN3i1BuSpXj1tea77clsra7Z3LUUNPby9eYNjQ_b4MElZyhDzQyr1I4EuLhrKcEKBbjYBO1N9QwHGLBhqktGpjYn_GmHb8nFn603Dm2x_LMsuCWob8JqXOUS2wYKWYhNQ Oct 08 20:53:23.896287 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 20:53:23.896287 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 20:53:23.896287 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 20:53:23.896287 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 20:53:23.896287 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 20:53:23.896287 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 20:53:23.896287 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: dac5ccb4d1b74021ac5625851f88c009 Oct 08 20:53:23.896287 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1595191754 Oct 08 20:53:23.896287 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,admin,member Oct 08 20:53:23.896287 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,admin,member Oct 08 20:53:23.897857 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/dac5ccb4d1b74021ac5625851f88c009"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/dac5ccb4d1b74021ac5625851f88c009"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_dac5ccb4d1b74021ac5625851f88c009"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/dac5ccb4d1b74021ac5625851f88c009"}]}] Oct 08 20:53:23.897857 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1595191754 Oct 08 20:53:23.897857 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: dac5ccb4d1b74021ac5625851f88c009 Oct 08 20:53:23.897857 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1595191754 Oct 08 20:53:23.897857 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-ServersAdminNegativeTestJSON-1595191754-project-admin Oct 08 20:53:23.897857 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 20:53:23.897857 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 20:53:23.897857 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 4b1b7b27c9b04fb897ebe2669d10c479 Oct 08 20:53:23.897857 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1595191754-project-admin Oct 08 20:53:23.897857 ncdv-master-1 devstack@n-api.service[140491]: Oct 08 20:53:23.897857 ncdv-master-1 devstack@n-api.service[140491]: {"os-resetState": {"state": "error"}} Oct 08 20:53:23.897857 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 20:53:23.897857 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance 999 could not be found. Oct 08 20:53:23.898650 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Oct 08 20:53:23.898650 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:53:23.898650 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:53:23.898650 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 20:53:23.898650 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 20:53:23.898650 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 08 20:53:23.898650 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 08 20:53:23.898650 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Oct 08 20:53:23.898650 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:53:23.898650 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:53:23.898650 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:53:23.898650 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:53:23.898650 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:53:23.898650 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:53:23.898650 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:53:23.898650 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:53:23.898650 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:53:23.898650 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:53:23.898650 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 20:53:23.898650 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 20:53:23.898650 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Oct 08 20:53:23.899870 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 08 20:53:23.899870 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 20:53:23.899870 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 20:53:23.899870 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Oct 08 20:53:23.899870 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:53:23.899870 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:53:23.899870 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:53:23.899870 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:53:23.899870 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:53:23.899870 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:53:23.899870 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 20:53:23.899870 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 20:53:23.899870 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Oct 08 20:53:23.899870 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:53:23.899870 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-d89b271a-fab4-41da-a47f-05d84c5ec17c tempest-ServersAdminNegativeTestJSON-1595191754 tempest-ServersAdminNegativeTestJSON-1595191754-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:53:23.899870 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-d89b271a-fab4-41da-a47f-05d84c5ec17c tempest-ServersAdminNegativeTestJSON-1595191754 tempest-ServersAdminNegativeTestJSON-1595191754-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.013939 Oct 08 20:53:23.907275 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 291/615] 10.222.0.26 () {60 vars in 1179 bytes} [Sat Oct 8 20:53:23 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 08 20:53:23.909877 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-b52a76d7-39f7-46cf-80e0-84a79efe286e tempest-FlavorsV2TestJSON-393200261 tempest-FlavorsV2TestJSON-393200261-project] 10.222.0.26 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.033533 Oct 08 20:53:23.918281 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 325/616] 10.222.0.26 () {58 vars in 1137 bytes} [Sat Oct 8 20:53:23 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:53:23.918281 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e29e5cbc-4293-48a8-8b52-2d850cd61bdd tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:23.918281 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-e29e5cbc-4293-48a8-8b52-2d850cd61bdd tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] [instance: 6de2ea26-e774-47b5-8506-b3ebbc2d1712] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:53:23.933535 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e29e5cbc-4293-48a8-8b52-2d850cd61bdd tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:23.937179 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e29e5cbc-4293-48a8-8b52-2d850cd61bdd tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:23.937874 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e29e5cbc-4293-48a8-8b52-2d850cd61bdd tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:23.938924 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e29e5cbc-4293-48a8-8b52-2d850cd61bdd tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:23.939567 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e29e5cbc-4293-48a8-8b52-2d850cd61bdd tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:23.940252 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e29e5cbc-4293-48a8-8b52-2d850cd61bdd tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:23.992628 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-e29e5cbc-4293-48a8-8b52-2d850cd61bdd tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] [instance: 6de2ea26-e774-47b5-8506-b3ebbc2d1712] Going to try to terminate instance {{(pid=140492) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 20:53:24.176729 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-e29e5cbc-4293-48a8-8b52-2d850cd61bdd tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] 10.222.0.26 "DELETE /compute/v2.1/servers/6de2ea26-e774-47b5-8506-b3ebbc2d1712" status: 204 len: 0 microversion: 2.1 time: 0.263991 Oct 08 20:53:24.179458 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 326/617] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 20:53:23 2022] DELETE /compute/v2.1/servers/6de2ea26-e774-47b5-8506-b3ebbc2d1712 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 20:53:24.191115 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-b712cd22-dd65-4239-9971-ef909dfcf36d tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:24.192119 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-b712cd22-dd65-4239-9971-ef909dfcf36d tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] [instance: 5c864780-3998-4a09-95d4-e000a02af71e] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:53:24.201159 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b712cd22-dd65-4239-9971-ef909dfcf36d tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:24.203470 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b712cd22-dd65-4239-9971-ef909dfcf36d tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:24.204269 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b712cd22-dd65-4239-9971-ef909dfcf36d tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:24.205164 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b712cd22-dd65-4239-9971-ef909dfcf36d tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:24.206300 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b712cd22-dd65-4239-9971-ef909dfcf36d tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:24.206915 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b712cd22-dd65-4239-9971-ef909dfcf36d tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:24.239742 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:53:24.526240 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-9944c339-9381-4564-91ed-d31feaa15725 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:24.526894 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-9944c339-9381-4564-91ed-d31feaa15725 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] [instance: 279361ef-2171-49e1-9f33-eadbf5dc0313] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:53:24.542693 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9944c339-9381-4564-91ed-d31feaa15725 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:24.543191 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9944c339-9381-4564-91ed-d31feaa15725 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:24.546284 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9944c339-9381-4564-91ed-d31feaa15725 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:24.547189 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9944c339-9381-4564-91ed-d31feaa15725 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:24.550766 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9944c339-9381-4564-91ed-d31feaa15725 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:24.551376 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9944c339-9381-4564-91ed-d31feaa15725 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:24.755744 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-b712cd22-dd65-4239-9971-ef909dfcf36d tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef659f5a1a24c439528a7675bdd70f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c92fe04ab8248399d0acb932f82d607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:53:24.769826 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-b712cd22-dd65-4239-9971-ef909dfcf36d tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] 10.222.0.26 "GET /compute/v2.1/servers/5c864780-3998-4a09-95d4-e000a02af71e" status: 200 len: 1463 microversion: 2.1 time: 0.587760 Oct 08 20:53:24.772378 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 327/618] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:53:24 2022] GET /compute/v2.1/servers/5c864780-3998-4a09-95d4-e000a02af71e => generated 1463 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:53:24.782809 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-78260109-7391-414c-a7b5-39470fbe86b9 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:24.784029 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-78260109-7391-414c-a7b5-39470fbe86b9 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] [instance: 6de2ea26-e774-47b5-8506-b3ebbc2d1712] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:53:24.821224 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-78260109-7391-414c-a7b5-39470fbe86b9 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:24.821752 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-78260109-7391-414c-a7b5-39470fbe86b9 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:24.822197 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-78260109-7391-414c-a7b5-39470fbe86b9 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:24.824665 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-78260109-7391-414c-a7b5-39470fbe86b9 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:24.825309 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-78260109-7391-414c-a7b5-39470fbe86b9 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:24.825784 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-78260109-7391-414c-a7b5-39470fbe86b9 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:25.236867 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-9944c339-9381-4564-91ed-d31feaa15725 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/279361ef-2171-49e1-9f33-eadbf5dc0313" status: 200 len: 1645 microversion: 2.1 time: 1.326609 Oct 08 20:53:25.238656 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 292/619] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:53:23 2022] GET /compute/v2.1/servers/279361ef-2171-49e1-9f33-eadbf5dc0313 => generated 1645 bytes in 1331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:53:25.245564 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-e8a200e0-6c9d-4a3d-9b39-bd9c74decccb tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:25.246817 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-e8a200e0-6c9d-4a3d-9b39-bd9c74decccb tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] [instance: 1af12bcb-5e2a-4c15-8673-fa41701cb4c7] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:53:25.279486 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e8a200e0-6c9d-4a3d-9b39-bd9c74decccb tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:25.282842 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e8a200e0-6c9d-4a3d-9b39-bd9c74decccb tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:25.283621 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e8a200e0-6c9d-4a3d-9b39-bd9c74decccb tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:25.285519 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e8a200e0-6c9d-4a3d-9b39-bd9c74decccb tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:25.286498 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e8a200e0-6c9d-4a3d-9b39-bd9c74decccb tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:25.287432 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e8a200e0-6c9d-4a3d-9b39-bd9c74decccb tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:25.450121 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-78260109-7391-414c-a7b5-39470fbe86b9 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '360660f7bb4746c8b1397f4857f423f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d702b3083bc4cf5ba6b6fc6f3c3147e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:53:25.466502 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-78260109-7391-414c-a7b5-39470fbe86b9 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] 10.222.0.26 "GET /compute/v2.1/servers/6de2ea26-e774-47b5-8506-b3ebbc2d1712" status: 200 len: 1468 microversion: 2.1 time: 0.690310 Oct 08 20:53:25.467946 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 328/620] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:53:24 2022] GET /compute/v2.1/servers/6de2ea26-e774-47b5-8506-b3ebbc2d1712 => generated 1468 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:53:25.486702 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-7e7d23b9-967a-424a-84d8-0296e0337daa tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:25.493572 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-7e7d23b9-967a-424a-84d8-0296e0337daa tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] [instance: 99d20873-ce34-47a4-bbe6-5b42e406a360] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:53:25.500325 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.objects.instance [None req-e8a200e0-6c9d-4a3d-9b39-bd9c74decccb tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Lazy-loading 'services' on Instance uuid 1af12bcb-5e2a-4c15-8673-fa41701cb4c7 {{(pid=140491) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 20:53:25.502849 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7e7d23b9-967a-424a-84d8-0296e0337daa tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:25.504573 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7e7d23b9-967a-424a-84d8-0296e0337daa tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:25.505307 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7e7d23b9-967a-424a-84d8-0296e0337daa tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:25.506309 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7e7d23b9-967a-424a-84d8-0296e0337daa tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:25.506996 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7e7d23b9-967a-424a-84d8-0296e0337daa tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:25.507637 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7e7d23b9-967a-424a-84d8-0296e0337daa tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:25.538356 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-e8a200e0-6c9d-4a3d-9b39-bd9c74decccb tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/1af12bcb-5e2a-4c15-8673-fa41701cb4c7" status: 200 len: 1929 microversion: 2.75 time: 0.298045 Oct 08 20:53:25.538895 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 293/621] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:53:25 2022] GET /compute/v2.1/servers/1af12bcb-5e2a-4c15-8673-fa41701cb4c7 => generated 1929 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:53:25.551433 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-68f0ebd2-4336-4290-ab3a-1dc6c3d8d247 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:25.553676 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-68f0ebd2-4336-4290-ab3a-1dc6c3d8d247 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] [instance: 73fd15ea-e4bd-4310-93bb-147b0a5e27ef] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:53:25.571523 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-68f0ebd2-4336-4290-ab3a-1dc6c3d8d247 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:25.572309 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-68f0ebd2-4336-4290-ab3a-1dc6c3d8d247 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:25.572962 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-68f0ebd2-4336-4290-ab3a-1dc6c3d8d247 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:25.574204 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-68f0ebd2-4336-4290-ab3a-1dc6c3d8d247 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:25.574882 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-68f0ebd2-4336-4290-ab3a-1dc6c3d8d247 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:25.575521 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-68f0ebd2-4336-4290-ab3a-1dc6c3d8d247 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:25.806054 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-7e7d23b9-967a-424a-84d8-0296e0337daa tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98936da9b5d94165b386d2d0893ac142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2441394d754f499e27f6f35d5b3afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:53:25.819748 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-7e7d23b9-967a-424a-84d8-0296e0337daa tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] 10.222.0.26 "GET /compute/v2.1/servers/99d20873-ce34-47a4-bbe6-5b42e406a360" status: 200 len: 1388 microversion: 2.1 time: 0.350398 Oct 08 20:53:25.820349 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 329/622] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:53:25 2022] GET /compute/v2.1/servers/99d20873-ce34-47a4-bbe6-5b42e406a360 => generated 1388 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:53:25.843876 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-b8fc2321-fe06-4c00-b640-ae31cb0a4dc3 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:25.844516 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-b8fc2321-fe06-4c00-b640-ae31cb0a4dc3 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] [instance: 279361ef-2171-49e1-9f33-eadbf5dc0313] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:53:25.860821 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b8fc2321-fe06-4c00-b640-ae31cb0a4dc3 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:25.862025 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b8fc2321-fe06-4c00-b640-ae31cb0a4dc3 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:25.869155 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b8fc2321-fe06-4c00-b640-ae31cb0a4dc3 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:25.870250 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b8fc2321-fe06-4c00-b640-ae31cb0a4dc3 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:25.875454 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b8fc2321-fe06-4c00-b640-ae31cb0a4dc3 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:25.875909 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b8fc2321-fe06-4c00-b640-ae31cb0a4dc3 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:26.168072 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-68f0ebd2-4336-4290-ab3a-1dc6c3d8d247 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef659f5a1a24c439528a7675bdd70f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c92fe04ab8248399d0acb932f82d607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:53:26.178390 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-68f0ebd2-4336-4290-ab3a-1dc6c3d8d247 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] 10.222.0.26 "GET /compute/v2.1/servers/73fd15ea-e4bd-4310-93bb-147b0a5e27ef" status: 200 len: 1462 microversion: 2.1 time: 0.638507 Oct 08 20:53:26.185525 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 294/623] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:53:25 2022] GET /compute/v2.1/servers/73fd15ea-e4bd-4310-93bb-147b0a5e27ef => generated 1462 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:53:26.195846 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-14d50c58-4786-451f-84f5-9efd3d68a5d6 req-48dacc51-ce44-4119-aad8-3981dd29a406 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99d20873-ce34-47a4-bbe6-5b42e406a360", "name": "network-vif-plugged", "status": "completed", "tag": "79841dd5-37cd-46cf-878f-6cb318265fee"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:53:26.222089 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-14d50c58-4786-451f-84f5-9efd3d68a5d6 req-48dacc51-ce44-4119-aad8-3981dd29a406 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:26.222574 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-14d50c58-4786-451f-84f5-9efd3d68a5d6 req-48dacc51-ce44-4119-aad8-3981dd29a406 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:26.223015 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-14d50c58-4786-451f-84f5-9efd3d68a5d6 req-48dacc51-ce44-4119-aad8-3981dd29a406 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:26.271250 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-14d50c58-4786-451f-84f5-9efd3d68a5d6 req-48dacc51-ce44-4119-aad8-3981dd29a406 service nova] Creating event network-vif-plugged:79841dd5-37cd-46cf-878f-6cb318265fee for instance 99d20873-ce34-47a4-bbe6-5b42e406a360 on nch1-master-1 Oct 08 20:53:26.288190 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-14d50c58-4786-451f-84f5-9efd3d68a5d6 req-48dacc51-ce44-4119-aad8-3981dd29a406 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100754 Oct 08 20:53:26.289056 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 295/624] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:53:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:53:26.297936 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-b8fc2321-fe06-4c00-b640-ae31cb0a4dc3 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/279361ef-2171-49e1-9f33-eadbf5dc0313" status: 200 len: 1645 microversion: 2.1 time: 0.461478 Oct 08 20:53:26.298790 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 330/625] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:53:25 2022] GET /compute/v2.1/servers/279361ef-2171-49e1-9f33-eadbf5dc0313 => generated 1645 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:53:26.337173 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-49a220ee-4585-49d1-acff-3da8c24be923 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:26.349594 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-49a220ee-4585-49d1-acff-3da8c24be923 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:26.350102 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-49a220ee-4585-49d1-acff-3da8c24be923 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:26.350563 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-49a220ee-4585-49d1-acff-3da8c24be923 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:26.351322 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-49a220ee-4585-49d1-acff-3da8c24be923 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:26.351791 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-49a220ee-4585-49d1-acff-3da8c24be923 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:26.355276 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-49a220ee-4585-49d1-acff-3da8c24be923 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:26.434522 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-49a220ee-4585-49d1-acff-3da8c24be923 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.113312 Oct 08 20:53:26.435742 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 296/626] 10.222.0.26 () {58 vars in 1176 bytes} [Sat Oct 8 20:53:26 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:53:26.450927 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-77ac828e-d8f5-492f-9815-53d4d37e4bad tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:53:26.462314 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-77ac828e-d8f5-492f-9815-53d4d37e4bad tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] [instance: 279361ef-2171-49e1-9f33-eadbf5dc0313] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:53:26.462927 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-1599b23d-40c9-453f-9e51-42f76ddef659 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-939741722", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "73fd15ea-e4bd-4310-93bb-147b0a5e27ef"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:53:26.478392 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-77ac828e-d8f5-492f-9815-53d4d37e4bad tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:26.481130 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-77ac828e-d8f5-492f-9815-53d4d37e4bad tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:26.488094 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-77ac828e-d8f5-492f-9815-53d4d37e4bad tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:26.489731 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-77ac828e-d8f5-492f-9815-53d4d37e4bad tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:26.490385 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-77ac828e-d8f5-492f-9815-53d4d37e4bad tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:26.491338 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-77ac828e-d8f5-492f-9815-53d4d37e4bad tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:26.599491 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.network.neutron [None req-1599b23d-40c9-453f-9e51-42f76ddef659 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] validate_networks() for None {{(pid=140491) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 20:53:27.027418 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-1599b23d-40c9-453f-9e51-42f76ddef659 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Flavor limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 20:53:27.027924 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-1599b23d-40c9-453f-9e51-42f76ddef659 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Image limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 20:53:27.028507 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-1599b23d-40c9-453f-9e51-42f76ddef659 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Flavor pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 20:53:27.029020 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-1599b23d-40c9-453f-9e51-42f76ddef659 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Image pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 20:53:27.029575 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-1599b23d-40c9-453f-9e51-42f76ddef659 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 20:53:27.046266 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1599b23d-40c9-453f-9e51-42f76ddef659 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:27.047416 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1599b23d-40c9-453f-9e51-42f76ddef659 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:27.050054 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1599b23d-40c9-453f-9e51-42f76ddef659 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:27.051060 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1599b23d-40c9-453f-9e51-42f76ddef659 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:27.051755 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1599b23d-40c9-453f-9e51-42f76ddef659 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:27.053715 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1599b23d-40c9-453f-9e51-42f76ddef659 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:27.092925 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-1599b23d-40c9-453f-9e51-42f76ddef659 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Getting quotas for project 8c92fe04ab8248399d0acb932f82d607. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 20:53:27.115812 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-1599b23d-40c9-453f-9e51-42f76ddef659 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Getting quotas for user 5ef659f5a1a24c439528a7675bdd70f8 and project 8c92fe04ab8248399d0acb932f82d607. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 20:53:27.150514 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-1599b23d-40c9-453f-9e51-42f76ddef659 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Going to run 1 instances... {{(pid=140491) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 20:53:27.153276 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-1599b23d-40c9-453f-9e51-42f76ddef659 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] [instance: 7e70d7bd-0c39-4320-916f-f99c05ec2806] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c508bd7f-7db9-4b2c-af7c-be54a855c355',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140491) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 20:53:27.272623 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-1599b23d-40c9-453f-9e51-42f76ddef659 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.820203 Oct 08 20:53:27.286861 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 297/627] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 20:53:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 828 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 08 20:53:27.291981 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-2b8f2161-fed8-4dea-a1b0-93e964522e47 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:27.293970 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-2b8f2161-fed8-4dea-a1b0-93e964522e47 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] [instance: 6de2ea26-e774-47b5-8506-b3ebbc2d1712] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:53:27.309860 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2b8f2161-fed8-4dea-a1b0-93e964522e47 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:27.310061 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.objects.instance [None req-77ac828e-d8f5-492f-9815-53d4d37e4bad tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Lazy-loading 'flavor' on Instance uuid 279361ef-2171-49e1-9f33-eadbf5dc0313 {{(pid=140492) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 20:53:27.310665 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2b8f2161-fed8-4dea-a1b0-93e964522e47 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:27.312064 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2b8f2161-fed8-4dea-a1b0-93e964522e47 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:27.314522 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2b8f2161-fed8-4dea-a1b0-93e964522e47 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:27.315098 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2b8f2161-fed8-4dea-a1b0-93e964522e47 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:27.316840 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2b8f2161-fed8-4dea-a1b0-93e964522e47 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:27.456692 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-2b8f2161-fed8-4dea-a1b0-93e964522e47 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '360660f7bb4746c8b1397f4857f423f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d702b3083bc4cf5ba6b6fc6f3c3147e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:53:27.469674 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-2b8f2161-fed8-4dea-a1b0-93e964522e47 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] 10.222.0.26 "GET /compute/v2.1/servers/6de2ea26-e774-47b5-8506-b3ebbc2d1712" status: 200 len: 1426 microversion: 2.1 time: 0.183520 Oct 08 20:53:27.477767 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-77ac828e-d8f5-492f-9815-53d4d37e4bad tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] [instance: 279361ef-2171-49e1-9f33-eadbf5dc0313] Going to try to live migrate instance to nch1-master-1 {{(pid=140492) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 08 20:53:27.488845 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 298/628] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:53:27 2022] GET /compute/v2.1/servers/6de2ea26-e774-47b5-8506-b3ebbc2d1712 => generated 1426 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:53:27.494565 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-f2e7842d-4eaf-44f7-93bb-2b4fc1aa1171 tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:27.495659 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-f2e7842d-4eaf-44f7-93bb-2b4fc1aa1171 tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] [instance: 1af12bcb-5e2a-4c15-8673-fa41701cb4c7] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:53:27.504366 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f2e7842d-4eaf-44f7-93bb-2b4fc1aa1171 tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:27.505438 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f2e7842d-4eaf-44f7-93bb-2b4fc1aa1171 tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:27.506106 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f2e7842d-4eaf-44f7-93bb-2b4fc1aa1171 tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:27.507958 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f2e7842d-4eaf-44f7-93bb-2b4fc1aa1171 tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:27.508638 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f2e7842d-4eaf-44f7-93bb-2b4fc1aa1171 tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:27.509354 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f2e7842d-4eaf-44f7-93bb-2b4fc1aa1171 tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:27.513847 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:53:27.777887 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.objects.instance [None req-f2e7842d-4eaf-44f7-93bb-2b4fc1aa1171 tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Lazy-loading 'services' on Instance uuid 1af12bcb-5e2a-4c15-8673-fa41701cb4c7 {{(pid=140491) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 20:53:27.816158 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-f2e7842d-4eaf-44f7-93bb-2b4fc1aa1171 tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/1af12bcb-5e2a-4c15-8673-fa41701cb4c7" status: 200 len: 1929 microversion: 2.75 time: 0.325320 Oct 08 20:53:27.825219 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 299/629] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:53:27 2022] GET /compute/v2.1/servers/1af12bcb-5e2a-4c15-8673-fa41701cb4c7 => generated 1929 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:53:27.837127 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-581a04f7-6474-41cd-8065-41b6304182bf tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:27.845411 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-581a04f7-6474-41cd-8065-41b6304182bf tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] [instance: 99d20873-ce34-47a4-bbe6-5b42e406a360] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:53:27.869491 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-581a04f7-6474-41cd-8065-41b6304182bf tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:27.870574 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-581a04f7-6474-41cd-8065-41b6304182bf tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:27.871269 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-581a04f7-6474-41cd-8065-41b6304182bf tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:27.873381 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-581a04f7-6474-41cd-8065-41b6304182bf tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:27.874772 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-581a04f7-6474-41cd-8065-41b6304182bf tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:27.875684 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-581a04f7-6474-41cd-8065-41b6304182bf tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:28.305323 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-581a04f7-6474-41cd-8065-41b6304182bf tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98936da9b5d94165b386d2d0893ac142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2441394d754f499e27f6f35d5b3afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:53:28.320503 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-581a04f7-6474-41cd-8065-41b6304182bf tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] 10.222.0.26 "GET /compute/v2.1/servers/99d20873-ce34-47a4-bbe6-5b42e406a360" status: 200 len: 1388 microversion: 2.1 time: 0.488740 Oct 08 20:53:28.322191 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 300/630] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:53:27 2022] GET /compute/v2.1/servers/99d20873-ce34-47a4-bbe6-5b42e406a360 => generated 1388 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:53:28.820612 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-89245f7e-3962-474f-804e-e8b649cb8fe4 tempest-InstanceUsageAuditLogTestJSON-1117678865 tempest-InstanceUsageAuditLogTestJSON-1117678865-project-admin] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:28.883149 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-89245f7e-3962-474f-804e-e8b649cb8fe4 tempest-InstanceUsageAuditLogTestJSON-1117678865 tempest-InstanceUsageAuditLogTestJSON-1117678865-project-admin] 10.222.0.26 "GET /compute/v2.1/os-instance_usage_audit_log/2022-10-08 20:53:27" status: 200 len: 318 microversion: 2.1 time: 0.550093 Oct 08 20:53:28.892463 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 301/631] 10.222.0.26 () {58 vars in 1251 bytes} [Sat Oct 8 20:53:28 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-10-08%2020%3A53%3A27 => generated 318 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:53:28.927893 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-a2690ee4-4835-4d6d-a81b-c9de75809689 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:28.953928 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-a2690ee4-4835-4d6d-a81b-c9de75809689 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] [instance: 7e70d7bd-0c39-4320-916f-f99c05ec2806] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:53:28.978959 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a2690ee4-4835-4d6d-a81b-c9de75809689 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:28.984158 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a2690ee4-4835-4d6d-a81b-c9de75809689 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:28.985271 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a2690ee4-4835-4d6d-a81b-c9de75809689 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:28.990680 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a2690ee4-4835-4d6d-a81b-c9de75809689 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:28.992178 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a2690ee4-4835-4d6d-a81b-c9de75809689 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:28.993841 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a2690ee4-4835-4d6d-a81b-c9de75809689 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:29.251165 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-a2690ee4-4835-4d6d-a81b-c9de75809689 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef659f5a1a24c439528a7675bdd70f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c92fe04ab8248399d0acb932f82d607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:53:29.268566 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-a2690ee4-4835-4d6d-a81b-c9de75809689 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] 10.222.0.26 "GET /compute/v2.1/servers/7e70d7bd-0c39-4320-916f-f99c05ec2806" status: 200 len: 1265 microversion: 2.1 time: 0.373019 Oct 08 20:53:29.269969 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 302/632] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:53:28 2022] GET /compute/v2.1/servers/7e70d7bd-0c39-4320-916f-f99c05ec2806 => generated 1265 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:53:29.283319 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-138da567-ae03-4cfe-8e87-8d410aca2e6f req-29e07f7b-6eb5-4e38-8de2-3a86b3e68f6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6de2ea26-e774-47b5-8506-b3ebbc2d1712", "name": "network-vif-deleted", "tag": "e7201ad3-9c78-422c-ab85-5ab7a68b8b12"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:53:29.322639 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-138da567-ae03-4cfe-8e87-8d410aca2e6f req-29e07f7b-6eb5-4e38-8de2-3a86b3e68f6d service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:29.325511 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-138da567-ae03-4cfe-8e87-8d410aca2e6f req-29e07f7b-6eb5-4e38-8de2-3a86b3e68f6d service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:29.326113 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-138da567-ae03-4cfe-8e87-8d410aca2e6f req-29e07f7b-6eb5-4e38-8de2-3a86b3e68f6d service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:29.350813 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-138da567-ae03-4cfe-8e87-8d410aca2e6f req-29e07f7b-6eb5-4e38-8de2-3a86b3e68f6d service nova] Creating event network-vif-deleted:e7201ad3-9c78-422c-ab85-5ab7a68b8b12 for instance 6de2ea26-e774-47b5-8506-b3ebbc2d1712 on nch1-master-1 Oct 08 20:53:29.356658 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-138da567-ae03-4cfe-8e87-8d410aca2e6f req-29e07f7b-6eb5-4e38-8de2-3a86b3e68f6d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080104 Oct 08 20:53:29.358890 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 303/633] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:53:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:53:29.364438 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-9855b36d-2dc9-4076-853e-06ecafc81136 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:29.365478 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-9855b36d-2dc9-4076-853e-06ecafc81136 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] [instance: 6de2ea26-e774-47b5-8506-b3ebbc2d1712] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:53:29.372906 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9855b36d-2dc9-4076-853e-06ecafc81136 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:29.373719 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9855b36d-2dc9-4076-853e-06ecafc81136 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:29.374837 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9855b36d-2dc9-4076-853e-06ecafc81136 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:29.375723 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9855b36d-2dc9-4076-853e-06ecafc81136 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:29.376636 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9855b36d-2dc9-4076-853e-06ecafc81136 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:29.377303 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9855b36d-2dc9-4076-853e-06ecafc81136 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:29.415745 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9855b36d-2dc9-4076-853e-06ecafc81136 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:29.416573 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9855b36d-2dc9-4076-853e-06ecafc81136 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:29.417461 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9855b36d-2dc9-4076-853e-06ecafc81136 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:29.418131 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.objects.instance [None req-9855b36d-2dc9-4076-853e-06ecafc81136 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Lazy-loading 'fault' on Instance uuid 6de2ea26-e774-47b5-8506-b3ebbc2d1712 {{(pid=140491) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 20:53:29.514149 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-9855b36d-2dc9-4076-853e-06ecafc81136 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '360660f7bb4746c8b1397f4857f423f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d702b3083bc4cf5ba6b6fc6f3c3147e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:53:29.529484 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-9855b36d-2dc9-4076-853e-06ecafc81136 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] 10.222.0.26 "GET /compute/v2.1/servers/6de2ea26-e774-47b5-8506-b3ebbc2d1712" status: 200 len: 1311 microversion: 2.1 time: 0.169138 Oct 08 20:53:29.530868 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 304/634] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:53:29 2022] GET /compute/v2.1/servers/6de2ea26-e774-47b5-8506-b3ebbc2d1712 => generated 1311 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:53:29.541597 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c16ed389-928e-4756-9de9-34e4b24b83fc tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:29.544443 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-c16ed389-928e-4756-9de9-34e4b24b83fc tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] [instance: 1af12bcb-5e2a-4c15-8673-fa41701cb4c7] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:53:29.567369 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c16ed389-928e-4756-9de9-34e4b24b83fc tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:29.569852 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c16ed389-928e-4756-9de9-34e4b24b83fc tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:29.570474 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c16ed389-928e-4756-9de9-34e4b24b83fc tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:29.571364 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c16ed389-928e-4756-9de9-34e4b24b83fc tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:29.572837 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c16ed389-928e-4756-9de9-34e4b24b83fc tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:29.575797 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c16ed389-928e-4756-9de9-34e4b24b83fc tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:29.781344 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.objects.instance [None req-c16ed389-928e-4756-9de9-34e4b24b83fc tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Lazy-loading 'services' on Instance uuid 1af12bcb-5e2a-4c15-8673-fa41701cb4c7 {{(pid=140491) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 20:53:29.839013 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-c16ed389-928e-4756-9de9-34e4b24b83fc tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/1af12bcb-5e2a-4c15-8673-fa41701cb4c7" status: 200 len: 1935 microversion: 2.75 time: 0.307037 Oct 08 20:53:29.839675 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 305/635] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:53:29 2022] GET /compute/v2.1/servers/1af12bcb-5e2a-4c15-8673-fa41701cb4c7 => generated 1935 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:53:29.881936 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-fa7421ee-016f-4b1e-9ae9-7382440cb998 tempest-InstanceUsageAuditLogTestJSON-1117678865 tempest-InstanceUsageAuditLogTestJSON-1117678865-project-admin] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:29.909940 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-fa7421ee-016f-4b1e-9ae9-7382440cb998 tempest-InstanceUsageAuditLogTestJSON-1117678865 tempest-InstanceUsageAuditLogTestJSON-1117678865-project-admin] 10.222.0.26 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.036427 Oct 08 20:53:29.924164 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 306/636] 10.222.0.26 () {58 vars in 1185 bytes} [Sat Oct 8 20:53:29 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:53:29.937105 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-b3ea512b-ecb5-4995-9bda-ef4a5f287010 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:29.941454 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-b3ea512b-ecb5-4995-9bda-ef4a5f287010 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] [instance: 99d20873-ce34-47a4-bbe6-5b42e406a360] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:53:29.956370 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b3ea512b-ecb5-4995-9bda-ef4a5f287010 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:29.960954 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b3ea512b-ecb5-4995-9bda-ef4a5f287010 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:29.963205 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b3ea512b-ecb5-4995-9bda-ef4a5f287010 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:29.969389 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b3ea512b-ecb5-4995-9bda-ef4a5f287010 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:29.969900 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b3ea512b-ecb5-4995-9bda-ef4a5f287010 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:29.970359 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b3ea512b-ecb5-4995-9bda-ef4a5f287010 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:30.635424 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-b3ea512b-ecb5-4995-9bda-ef4a5f287010 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98936da9b5d94165b386d2d0893ac142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2441394d754f499e27f6f35d5b3afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:53:30.646482 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-b3ea512b-ecb5-4995-9bda-ef4a5f287010 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] 10.222.0.26 "GET /compute/v2.1/servers/99d20873-ce34-47a4-bbe6-5b42e406a360" status: 200 len: 1588 microversion: 2.1 time: 0.716585 Oct 08 20:53:30.651957 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 307/637] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:53:29 2022] GET /compute/v2.1/servers/99d20873-ce34-47a4-bbe6-5b42e406a360 => generated 1588 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:53:30.672303 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-fea78ec8-d0d9-40b4-a024-09724043f5b9 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:30.673118 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-fea78ec8-d0d9-40b4-a024-09724043f5b9 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] [instance: 7e70d7bd-0c39-4320-916f-f99c05ec2806] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:53:30.689494 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fea78ec8-d0d9-40b4-a024-09724043f5b9 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:30.690038 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fea78ec8-d0d9-40b4-a024-09724043f5b9 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:30.690487 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fea78ec8-d0d9-40b4-a024-09724043f5b9 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:30.691257 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fea78ec8-d0d9-40b4-a024-09724043f5b9 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:30.691727 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fea78ec8-d0d9-40b4-a024-09724043f5b9 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:30.692164 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fea78ec8-d0d9-40b4-a024-09724043f5b9 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:31.044710 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-fea78ec8-d0d9-40b4-a024-09724043f5b9 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef659f5a1a24c439528a7675bdd70f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c92fe04ab8248399d0acb932f82d607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:53:31.054452 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-fea78ec8-d0d9-40b4-a024-09724043f5b9 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] 10.222.0.26 "GET /compute/v2.1/servers/7e70d7bd-0c39-4320-916f-f99c05ec2806" status: 200 len: 1271 microversion: 2.1 time: 0.400801 Oct 08 20:53:31.078273 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 308/638] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:53:30 2022] GET /compute/v2.1/servers/7e70d7bd-0c39-4320-916f-f99c05ec2806 => generated 1271 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:53:31.095413 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-4fb6d79f-8bbc-4431-90c5-5596d6c5285d tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:31.100674 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-4fb6d79f-8bbc-4431-90c5-5596d6c5285d tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] [instance: 6de2ea26-e774-47b5-8506-b3ebbc2d1712] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:53:31.116427 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4fb6d79f-8bbc-4431-90c5-5596d6c5285d tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:31.123514 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4fb6d79f-8bbc-4431-90c5-5596d6c5285d tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:31.125475 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4fb6d79f-8bbc-4431-90c5-5596d6c5285d tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:31.126514 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4fb6d79f-8bbc-4431-90c5-5596d6c5285d tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:31.129497 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4fb6d79f-8bbc-4431-90c5-5596d6c5285d tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:31.133073 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4fb6d79f-8bbc-4431-90c5-5596d6c5285d tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:31.171384 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-4fb6d79f-8bbc-4431-90c5-5596d6c5285d tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] HTTP exception thrown: Instance 6de2ea26-e774-47b5-8506-b3ebbc2d1712 could not be found. Oct 08 20:53:31.176337 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-4fb6d79f-8bbc-4431-90c5-5596d6c5285d tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Request method failure captured: Oct 08 20:53:31.176337 ncdv-master-1 devstack@n-api.service[140491]: request: GET /compute/v2.1/servers/6de2ea26-e774-47b5-8506-b3ebbc2d1712 HTTP/1.1 Oct 08 20:53:31.176337 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 20:53:31.176337 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 20:53:31.176337 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 20:53:31.176337 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 20:53:31.176337 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 20:53:31.176337 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 20:53:31.176337 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 20:53:31.176337 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 20:53:31.176337 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeMK1D3aTGt9CH6VVzuHHoG7zcE8EsNDXQ8zhbwoGToq8ULQPi2YkRjBRi2EjS_8q1UEPg2Y6cQ7EA0-knrnzL9kuDK1fnGTNm7ohoVx8CH_liYM0aJ-433mFsVprRbhkW97wEY-VO5I_zA0VASJjJzOocWcX9acN_SDiBO2oGP9MIc Oct 08 20:53:31.176337 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 20:53:31.176337 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 20:53:31.176337 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 20:53:31.176337 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 20:53:31.176337 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 20:53:31.176337 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 20:53:31.176337 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 6d702b3083bc4cf5ba6b6fc6f3c3147e Oct 08 20:53:31.176337 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-795115539 Oct 08 20:53:31.176337 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 20:53:31.176337 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 20:53:31.177758 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6d702b3083bc4cf5ba6b6fc6f3c3147e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6d702b3083bc4cf5ba6b6fc6f3c3147e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6d702b3083bc4cf5ba6b6fc6f3c3147e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6d702b3083bc4cf5ba6b6fc6f3c3147e"}]}] Oct 08 20:53:31.177758 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-ServersAdminNegativeTestJSON-795115539 Oct 08 20:53:31.177758 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 6d702b3083bc4cf5ba6b6fc6f3c3147e Oct 08 20:53:31.177758 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-795115539 Oct 08 20:53:31.177758 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-ServersAdminNegativeTestJSON-795115539-project Oct 08 20:53:31.177758 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 20:53:31.177758 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 20:53:31.177758 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 360660f7bb4746c8b1397f4857f423f2 Oct 08 20:53:31.177758 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-ServersAdminNegativeTestJSON-795115539-project Oct 08 20:53:31.177758 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 20:53:31.177758 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance 6de2ea26-e774-47b5-8506-b3ebbc2d1712 could not be found. Oct 08 20:53:31.177758 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': '6de2ea26-e774-47b5-8506-b3ebbc2d1712'} Oct 08 20:53:31.178539 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:53:31.178539 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:53:31.178539 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 20:53:31.178539 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 20:53:31.178539 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 20:53:31.178539 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 20:53:31.178539 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 20:53:31.178539 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 20:53:31.178539 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 20:53:31.178539 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 20:53:31.178539 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6de2ea26-e774-47b5-8506-b3ebbc2d1712 could not be found. Oct 08 20:53:31.178539 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:53:31.178539 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:53:31.178539 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:53:31.178539 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:53:31.178539 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:53:31.178539 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:53:31.178539 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:53:31.178539 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:53:31.178539 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:53:31.179742 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:53:31.179742 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 20:53:31.179742 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 20:53:31.179742 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 20:53:31.179742 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 20:53:31.179742 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 20:53:31.179742 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 20:53:31.179742 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6de2ea26-e774-47b5-8506-b3ebbc2d1712 could not be found. Oct 08 20:53:31.179742 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:53:31.179742 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:53:31.179742 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:53:31.179742 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:53:31.179742 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:53:31.179742 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:53:31.179742 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 20:53:31.179742 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 20:53:31.179742 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6de2ea26-e774-47b5-8506-b3ebbc2d1712 could not be found. Oct 08 20:53:31.179742 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:53:31.186795 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-4fb6d79f-8bbc-4431-90c5-5596d6c5285d tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Returning 404 to user: Instance 6de2ea26-e774-47b5-8506-b3ebbc2d1712 could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:53:31.190814 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-4fb6d79f-8bbc-4431-90c5-5596d6c5285d tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] 10.222.0.26 "GET /compute/v2.1/servers/6de2ea26-e774-47b5-8506-b3ebbc2d1712" status: 404 len: 111 microversion: 2.1 time: 0.110816 Oct 08 20:53:31.191677 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 309/639] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:53:31 2022] GET /compute/v2.1/servers/6de2ea26-e774-47b5-8506-b3ebbc2d1712 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 20:53:31.202676 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-9569ec86-9d66-4a3e-bd11-f0670791877b tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:31.206878 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-9569ec86-9d66-4a3e-bd11-f0670791877b tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] [instance: 99d20873-ce34-47a4-bbe6-5b42e406a360] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:53:31.237817 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9569ec86-9d66-4a3e-bd11-f0670791877b tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:31.239811 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9569ec86-9d66-4a3e-bd11-f0670791877b tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:31.246137 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9569ec86-9d66-4a3e-bd11-f0670791877b tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:31.247863 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9569ec86-9d66-4a3e-bd11-f0670791877b tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:31.250259 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9569ec86-9d66-4a3e-bd11-f0670791877b tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:31.254295 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9569ec86-9d66-4a3e-bd11-f0670791877b tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:31.532928 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-9569ec86-9d66-4a3e-bd11-f0670791877b tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] 10.222.0.26 "GET /compute/v2.1/servers/99d20873-ce34-47a4-bbe6-5b42e406a360/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.339033 Oct 08 20:53:31.533758 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 310/640] 10.222.0.26 () {58 vars in 1275 bytes} [Sat Oct 8 20:53:31 2022] GET /compute/v2.1/servers/99d20873-ce34-47a4-bbe6-5b42e406a360/os-interface => generated 285 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:53:31.538312 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-ec7f9243-3487-4f7e-803e-fdb4a6bfb86e tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:31.539030 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-ec7f9243-3487-4f7e-803e-fdb4a6bfb86e tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] [instance: 1af12bcb-5e2a-4c15-8673-fa41701cb4c7] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:53:31.547754 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ec7f9243-3487-4f7e-803e-fdb4a6bfb86e tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:31.548618 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ec7f9243-3487-4f7e-803e-fdb4a6bfb86e tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:31.549506 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ec7f9243-3487-4f7e-803e-fdb4a6bfb86e tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:31.551036 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ec7f9243-3487-4f7e-803e-fdb4a6bfb86e tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:31.551785 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ec7f9243-3487-4f7e-803e-fdb4a6bfb86e tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:31.552440 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ec7f9243-3487-4f7e-803e-fdb4a6bfb86e tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:31.717943 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.objects.instance [None req-ec7f9243-3487-4f7e-803e-fdb4a6bfb86e tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] Lazy-loading 'services' on Instance uuid 1af12bcb-5e2a-4c15-8673-fa41701cb4c7 {{(pid=140491) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 20:53:31.754693 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-ec7f9243-3487-4f7e-803e-fdb4a6bfb86e tempest-ServersAdmin275Test-762532598 tempest-ServersAdmin275Test-762532598-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/1af12bcb-5e2a-4c15-8673-fa41701cb4c7" status: 200 len: 1920 microversion: 2.75 time: 0.219728 Oct 08 20:53:31.756182 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 311/641] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:53:31 2022] GET /compute/v2.1/servers/1af12bcb-5e2a-4c15-8673-fa41701cb4c7 => generated 1920 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:53:31.761150 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-b94e5f88-3c63-40f9-9b74-da32ad9891fc tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:31.761970 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-b94e5f88-3c63-40f9-9b74-da32ad9891fc tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] [instance: 0b4b7773-b59d-4956-b7e5-267d54541db6] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:53:31.769154 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b94e5f88-3c63-40f9-9b74-da32ad9891fc tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:31.769994 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b94e5f88-3c63-40f9-9b74-da32ad9891fc tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:31.770729 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b94e5f88-3c63-40f9-9b74-da32ad9891fc tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:31.771668 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b94e5f88-3c63-40f9-9b74-da32ad9891fc tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:31.772425 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b94e5f88-3c63-40f9-9b74-da32ad9891fc tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:31.773404 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b94e5f88-3c63-40f9-9b74-da32ad9891fc tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:31.816460 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-b94e5f88-3c63-40f9-9b74-da32ad9891fc tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] [instance: 0b4b7773-b59d-4956-b7e5-267d54541db6] Going to try to terminate instance {{(pid=140491) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 20:53:32.003759 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-b94e5f88-3c63-40f9-9b74-da32ad9891fc tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] 10.222.0.26 "DELETE /compute/v2.1/servers/0b4b7773-b59d-4956-b7e5-267d54541db6" status: 204 len: 0 microversion: 2.1 time: 0.245953 Oct 08 20:53:32.008156 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 312/642] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 20:53:31 2022] DELETE /compute/v2.1/servers/0b4b7773-b59d-4956-b7e5-267d54541db6 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 20:53:32.127411 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-de7326ec-27df-4374-91f5-79ad5ca21352 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-851436431", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "networks": [{"uuid": "a9c0a282-71aa-4609-90f6-4683ed1165e3"}]}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:53:32.220430 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.network.neutron [None req-de7326ec-27df-4374-91f5-79ad5ca21352 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] validate_networks() for [('a9c0a282-71aa-4609-90f6-4683ed1165e3', None, None, None, None, None)] {{(pid=140491) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 20:53:32.568838 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-77ac828e-d8f5-492f-9815-53d4d37e4bad tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/279361ef-2171-49e1-9f33-eadbf5dc0313/action" status: 202 len: 0 microversion: 2.1 time: 6.123774 Oct 08 20:53:32.570660 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 331/643] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 20:53:26 2022] POST /compute/v2.1/servers/279361ef-2171-49e1-9f33-eadbf5dc0313/action => generated 0 bytes in 6126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 20:53:32.583373 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-9f1b1a7b-fe19-48c0-a676-a2c98a58549b tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:32.584517 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-9f1b1a7b-fe19-48c0-a676-a2c98a58549b tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] [instance: 1af12bcb-5e2a-4c15-8673-fa41701cb4c7] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:53:32.605617 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9f1b1a7b-fe19-48c0-a676-a2c98a58549b tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:32.610231 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9f1b1a7b-fe19-48c0-a676-a2c98a58549b tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:32.611987 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9f1b1a7b-fe19-48c0-a676-a2c98a58549b tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:32.614983 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9f1b1a7b-fe19-48c0-a676-a2c98a58549b tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:32.615649 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9f1b1a7b-fe19-48c0-a676-a2c98a58549b tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:32.618011 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9f1b1a7b-fe19-48c0-a676-a2c98a58549b tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:32.757168 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-9f1b1a7b-fe19-48c0-a676-a2c98a58549b tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] [instance: 1af12bcb-5e2a-4c15-8673-fa41701cb4c7] Going to try to terminate instance {{(pid=140492) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 20:53:33.026645 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-9f1b1a7b-fe19-48c0-a676-a2c98a58549b tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] 10.222.0.26 "DELETE /compute/v2.1/servers/1af12bcb-5e2a-4c15-8673-fa41701cb4c7" status: 204 len: 0 microversion: 2.75 time: 0.452643 Oct 08 20:53:33.027773 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 332/644] 10.222.0.26 () {60 vars in 1280 bytes} [Sat Oct 8 20:53:32 2022] DELETE /compute/v2.1/servers/1af12bcb-5e2a-4c15-8673-fa41701cb4c7 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 08 20:53:33.052828 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-b66f55f5-3f8e-4829-a6b5-4000d4cae099 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:33.057133 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-b66f55f5-3f8e-4829-a6b5-4000d4cae099 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] [instance: 0b4b7773-b59d-4956-b7e5-267d54541db6] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:53:33.104194 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b66f55f5-3f8e-4829-a6b5-4000d4cae099 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:33.108846 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b66f55f5-3f8e-4829-a6b5-4000d4cae099 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:33.114692 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b66f55f5-3f8e-4829-a6b5-4000d4cae099 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:33.116699 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b66f55f5-3f8e-4829-a6b5-4000d4cae099 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:33.118281 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b66f55f5-3f8e-4829-a6b5-4000d4cae099 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:33.119795 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b66f55f5-3f8e-4829-a6b5-4000d4cae099 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:33.648260 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-b66f55f5-3f8e-4829-a6b5-4000d4cae099 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '360660f7bb4746c8b1397f4857f423f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d702b3083bc4cf5ba6b6fc6f3c3147e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:53:33.670318 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-b66f55f5-3f8e-4829-a6b5-4000d4cae099 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] 10.222.0.26 "GET /compute/v2.1/servers/0b4b7773-b59d-4956-b7e5-267d54541db6" status: 200 len: 1476 microversion: 2.1 time: 0.639777 Oct 08 20:53:33.697947 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 333/645] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:53:33 2022] GET /compute/v2.1/servers/0b4b7773-b59d-4956-b7e5-267d54541db6 => generated 1476 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:53:33.707211 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-2cc911a9-afd9-4212-ba0d-46035aed217d tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:33.708264 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-2cc911a9-afd9-4212-ba0d-46035aed217d tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] [instance: 7e70d7bd-0c39-4320-916f-f99c05ec2806] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:53:33.718636 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2cc911a9-afd9-4212-ba0d-46035aed217d tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:33.719954 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2cc911a9-afd9-4212-ba0d-46035aed217d tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:33.720635 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2cc911a9-afd9-4212-ba0d-46035aed217d tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:33.721668 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2cc911a9-afd9-4212-ba0d-46035aed217d tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:33.722402 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2cc911a9-afd9-4212-ba0d-46035aed217d tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:33.723073 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2cc911a9-afd9-4212-ba0d-46035aed217d tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:34.221075 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-2cc911a9-afd9-4212-ba0d-46035aed217d tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef659f5a1a24c439528a7675bdd70f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c92fe04ab8248399d0acb932f82d607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:53:34.239779 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-2cc911a9-afd9-4212-ba0d-46035aed217d tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] 10.222.0.26 "GET /compute/v2.1/servers/7e70d7bd-0c39-4320-916f-f99c05ec2806" status: 200 len: 1313 microversion: 2.1 time: 0.540251 Oct 08 20:53:34.240595 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 334/646] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:53:33 2022] GET /compute/v2.1/servers/7e70d7bd-0c39-4320-916f-f99c05ec2806 => generated 1313 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:53:34.263202 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-23aff364-bc7a-4594-803f-575445fa9ecb tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:34.265043 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-23aff364-bc7a-4594-803f-575445fa9ecb tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] [instance: 279361ef-2171-49e1-9f33-eadbf5dc0313] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:53:34.272721 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-23aff364-bc7a-4594-803f-575445fa9ecb tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:34.273685 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-23aff364-bc7a-4594-803f-575445fa9ecb tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:34.274370 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-23aff364-bc7a-4594-803f-575445fa9ecb tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:34.275267 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-23aff364-bc7a-4594-803f-575445fa9ecb tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:34.275958 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-23aff364-bc7a-4594-803f-575445fa9ecb tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:34.276552 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-23aff364-bc7a-4594-803f-575445fa9ecb tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:34.581603 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-23aff364-bc7a-4594-803f-575445fa9ecb tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474ca64d1b1d4e30916b517645aba882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecc2dd2407b4819874bed09cb27959a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:53:34.594800 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-23aff364-bc7a-4594-803f-575445fa9ecb tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] 10.222.0.26 "GET /compute/v2.1/servers/279361ef-2171-49e1-9f33-eadbf5dc0313" status: 200 len: 1504 microversion: 2.1 time: 0.339070 Oct 08 20:53:34.597995 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 335/647] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:53:34 2022] GET /compute/v2.1/servers/279361ef-2171-49e1-9f33-eadbf5dc0313 => generated 1504 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:53:34.604888 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-64c63f2c-0b38-47f5-8e1b-ff17bfa203e5 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:34.606036 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-64c63f2c-0b38-47f5-8e1b-ff17bfa203e5 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] [instance: 1af12bcb-5e2a-4c15-8673-fa41701cb4c7] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:53:34.620150 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-64c63f2c-0b38-47f5-8e1b-ff17bfa203e5 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:34.621165 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-64c63f2c-0b38-47f5-8e1b-ff17bfa203e5 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:34.622153 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-64c63f2c-0b38-47f5-8e1b-ff17bfa203e5 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:34.624591 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-64c63f2c-0b38-47f5-8e1b-ff17bfa203e5 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:34.625315 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-64c63f2c-0b38-47f5-8e1b-ff17bfa203e5 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:34.625973 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-64c63f2c-0b38-47f5-8e1b-ff17bfa203e5 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:34.791667 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-64c63f2c-0b38-47f5-8e1b-ff17bfa203e5 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb78cce5f7c4c348045745f40b13129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16530e0f2f0a4d23918261c9e21f9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:53:34.808968 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-de7326ec-27df-4374-91f5-79ad5ca21352 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Flavor limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 20:53:34.811194 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-de7326ec-27df-4374-91f5-79ad5ca21352 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Image limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 20:53:34.813924 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-64c63f2c-0b38-47f5-8e1b-ff17bfa203e5 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cb78cce5f7c4c348045745f40b13129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16530e0f2f0a4d23918261c9e21f9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:53:34.814585 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-de7326ec-27df-4374-91f5-79ad5ca21352 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Flavor pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 20:53:34.815382 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-de7326ec-27df-4374-91f5-79ad5ca21352 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Image pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 20:53:34.815664 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-64c63f2c-0b38-47f5-8e1b-ff17bfa203e5 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cb78cce5f7c4c348045745f40b13129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16530e0f2f0a4d23918261c9e21f9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:53:34.819355 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-de7326ec-27df-4374-91f5-79ad5ca21352 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 20:53:34.827970 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:53:34.829663 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-64c63f2c-0b38-47f5-8e1b-ff17bfa203e5 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] 10.222.0.26 "GET /compute/v2.1/servers/1af12bcb-5e2a-4c15-8673-fa41701cb4c7" status: 200 len: 1444 microversion: 2.75 time: 0.229985 Oct 08 20:53:34.830311 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 336/648] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:53:34 2022] GET /compute/v2.1/servers/1af12bcb-5e2a-4c15-8673-fa41701cb4c7 => generated 1444 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:53:34.835412 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-de7326ec-27df-4374-91f5-79ad5ca21352 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:34.836051 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-de7326ec-27df-4374-91f5-79ad5ca21352 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:34.836587 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-de7326ec-27df-4374-91f5-79ad5ca21352 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:34.837460 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-de7326ec-27df-4374-91f5-79ad5ca21352 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:34.838085 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-de7326ec-27df-4374-91f5-79ad5ca21352 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:34.838599 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-de7326ec-27df-4374-91f5-79ad5ca21352 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:34.846739 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-330892fa-4416-4b41-8934-71b6fdd59c8a tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:34.847367 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-330892fa-4416-4b41-8934-71b6fdd59c8a tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] [instance: 0b4b7773-b59d-4956-b7e5-267d54541db6] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:53:34.858633 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-330892fa-4416-4b41-8934-71b6fdd59c8a tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:34.859170 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-330892fa-4416-4b41-8934-71b6fdd59c8a tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:34.864097 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-330892fa-4416-4b41-8934-71b6fdd59c8a tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:34.865118 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-330892fa-4416-4b41-8934-71b6fdd59c8a tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:34.867654 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-330892fa-4416-4b41-8934-71b6fdd59c8a tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:34.868489 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-330892fa-4416-4b41-8934-71b6fdd59c8a tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:34.870869 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-de7326ec-27df-4374-91f5-79ad5ca21352 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Getting quotas for project ac5c7906a4714a1887cb823e1c3a6056. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 20:53:34.887480 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-de7326ec-27df-4374-91f5-79ad5ca21352 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Getting quotas for user d54b1c5c00544be4b60132d09817c8d6 and project ac5c7906a4714a1887cb823e1c3a6056. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 20:53:34.940261 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-de7326ec-27df-4374-91f5-79ad5ca21352 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Going to run 1 instances... {{(pid=140491) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 20:53:34.943661 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-de7326ec-27df-4374-91f5-79ad5ca21352 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] [instance: 139f7ae3-b380-4114-a566-6d496d4957f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c508bd7f-7db9-4b2c-af7c-be54a855c355',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140491) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 20:53:35.107258 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-de7326ec-27df-4374-91f5-79ad5ca21352 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 3.097473 Oct 08 20:53:35.114005 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 313/649] 10.222.0.26 () {62 vars in 1188 bytes} [Sat Oct 8 20:53:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 3105 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 08 20:53:35.135520 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-52b44fd1-7866-40d2-a788-53207aec919f tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:35.137980 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-52b44fd1-7866-40d2-a788-53207aec919f tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] [instance: 139f7ae3-b380-4114-a566-6d496d4957f4] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:53:35.404131 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-330892fa-4416-4b41-8934-71b6fdd59c8a tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '360660f7bb4746c8b1397f4857f423f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d702b3083bc4cf5ba6b6fc6f3c3147e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:53:35.421826 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-330892fa-4416-4b41-8934-71b6fdd59c8a tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] 10.222.0.26 "GET /compute/v2.1/servers/0b4b7773-b59d-4956-b7e5-267d54541db6" status: 200 len: 1476 microversion: 2.1 time: 0.582251 Oct 08 20:53:35.422802 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 337/650] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:53:34 2022] GET /compute/v2.1/servers/0b4b7773-b59d-4956-b7e5-267d54541db6 => generated 1476 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:53:35.432478 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-caef27cb-f69f-4fe3-a8d0-e1409780ed51 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:35.432980 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-caef27cb-f69f-4fe3-a8d0-e1409780ed51 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] [instance: 7e70d7bd-0c39-4320-916f-f99c05ec2806] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:53:35.441350 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-caef27cb-f69f-4fe3-a8d0-e1409780ed51 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:35.444855 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-caef27cb-f69f-4fe3-a8d0-e1409780ed51 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:35.446035 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-caef27cb-f69f-4fe3-a8d0-e1409780ed51 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:35.449846 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-caef27cb-f69f-4fe3-a8d0-e1409780ed51 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:35.450415 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-caef27cb-f69f-4fe3-a8d0-e1409780ed51 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:35.455208 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-caef27cb-f69f-4fe3-a8d0-e1409780ed51 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:35.708405 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-52b44fd1-7866-40d2-a788-53207aec919f tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:53:35.721360 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-52b44fd1-7866-40d2-a788-53207aec919f tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:53:35.726380 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-52b44fd1-7866-40d2-a788-53207aec919f tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:53:35.727733 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-52b44fd1-7866-40d2-a788-53207aec919f tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] 10.222.0.26 "GET /compute/v2.1/servers/139f7ae3-b380-4114-a566-6d496d4957f4" status: 200 len: 1261 microversion: 2.25 time: 0.608540 Oct 08 20:53:35.730797 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 314/651] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:53:35 2022] GET /compute/v2.1/servers/139f7ae3-b380-4114-a566-6d496d4957f4 => generated 1261 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:53:35.740104 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-b2e0c1de-4a4a-41ab-9a32-0b6bb58e6fac tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:35.741576 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-b2e0c1de-4a4a-41ab-9a32-0b6bb58e6fac tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] [instance: 279361ef-2171-49e1-9f33-eadbf5dc0313] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:53:35.764779 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b2e0c1de-4a4a-41ab-9a32-0b6bb58e6fac tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:35.765770 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b2e0c1de-4a4a-41ab-9a32-0b6bb58e6fac tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:35.768520 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b2e0c1de-4a4a-41ab-9a32-0b6bb58e6fac tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:35.771856 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b2e0c1de-4a4a-41ab-9a32-0b6bb58e6fac tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:35.772595 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b2e0c1de-4a4a-41ab-9a32-0b6bb58e6fac tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:35.773726 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b2e0c1de-4a4a-41ab-9a32-0b6bb58e6fac tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:36.383914 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-caef27cb-f69f-4fe3-a8d0-e1409780ed51 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef659f5a1a24c439528a7675bdd70f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c92fe04ab8248399d0acb932f82d607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:53:36.398538 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-caef27cb-f69f-4fe3-a8d0-e1409780ed51 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] 10.222.0.26 "GET /compute/v2.1/servers/7e70d7bd-0c39-4320-916f-f99c05ec2806" status: 200 len: 1313 microversion: 2.1 time: 0.971353 Oct 08 20:53:36.399283 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 338/652] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:53:35 2022] GET /compute/v2.1/servers/7e70d7bd-0c39-4320-916f-f99c05ec2806 => generated 1313 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:53:36.413073 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-eaf035d3-f7f0-4a4e-aa0e-f793ee9106e0 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:36.416020 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-eaf035d3-f7f0-4a4e-aa0e-f793ee9106e0 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] [instance: 1af12bcb-5e2a-4c15-8673-fa41701cb4c7] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:53:36.435035 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-eaf035d3-f7f0-4a4e-aa0e-f793ee9106e0 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:36.435742 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-eaf035d3-f7f0-4a4e-aa0e-f793ee9106e0 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:36.440572 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-eaf035d3-f7f0-4a4e-aa0e-f793ee9106e0 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:36.445341 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-eaf035d3-f7f0-4a4e-aa0e-f793ee9106e0 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:36.445887 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-eaf035d3-f7f0-4a4e-aa0e-f793ee9106e0 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:36.446507 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-eaf035d3-f7f0-4a4e-aa0e-f793ee9106e0 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:36.578848 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-eaf035d3-f7f0-4a4e-aa0e-f793ee9106e0 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:36.583446 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-eaf035d3-f7f0-4a4e-aa0e-f793ee9106e0 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:36.584650 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-eaf035d3-f7f0-4a4e-aa0e-f793ee9106e0 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:36.585476 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.objects.instance [None req-eaf035d3-f7f0-4a4e-aa0e-f793ee9106e0 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Lazy-loading 'fault' on Instance uuid 1af12bcb-5e2a-4c15-8673-fa41701cb4c7 {{(pid=140492) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 20:53:36.714320 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-b2e0c1de-4a4a-41ab-9a32-0b6bb58e6fac tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474ca64d1b1d4e30916b517645aba882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecc2dd2407b4819874bed09cb27959a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:53:36.744653 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-b2e0c1de-4a4a-41ab-9a32-0b6bb58e6fac tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] 10.222.0.26 "GET /compute/v2.1/servers/279361ef-2171-49e1-9f33-eadbf5dc0313" status: 200 len: 1504 microversion: 2.1 time: 1.012395 Oct 08 20:53:36.765305 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 315/653] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:53:35 2022] GET /compute/v2.1/servers/279361ef-2171-49e1-9f33-eadbf5dc0313 => generated 1504 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:53:36.777302 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-7a521ac8-8960-4107-88f9-abe713b2d1a1 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:36.780418 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-7a521ac8-8960-4107-88f9-abe713b2d1a1 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] [instance: 0b4b7773-b59d-4956-b7e5-267d54541db6] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:53:36.803325 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7a521ac8-8960-4107-88f9-abe713b2d1a1 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:36.803749 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7a521ac8-8960-4107-88f9-abe713b2d1a1 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:36.804255 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7a521ac8-8960-4107-88f9-abe713b2d1a1 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:36.805011 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7a521ac8-8960-4107-88f9-abe713b2d1a1 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:36.812348 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7a521ac8-8960-4107-88f9-abe713b2d1a1 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:36.812975 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7a521ac8-8960-4107-88f9-abe713b2d1a1 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:37.114513 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-7a521ac8-8960-4107-88f9-abe713b2d1a1 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '360660f7bb4746c8b1397f4857f423f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d702b3083bc4cf5ba6b6fc6f3c3147e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:53:37.129003 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-7a521ac8-8960-4107-88f9-abe713b2d1a1 tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] 10.222.0.26 "GET /compute/v2.1/servers/0b4b7773-b59d-4956-b7e5-267d54541db6" status: 200 len: 1434 microversion: 2.1 time: 0.375127 Oct 08 20:53:37.132197 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 316/654] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:53:36 2022] GET /compute/v2.1/servers/0b4b7773-b59d-4956-b7e5-267d54541db6 => generated 1434 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:53:37.153775 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-7b778f44-d87b-44b2-b108-fe2a23fe2e80 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:37.155481 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-7b778f44-d87b-44b2-b108-fe2a23fe2e80 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] [instance: 99d20873-ce34-47a4-bbe6-5b42e406a360] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:53:37.169271 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7b778f44-d87b-44b2-b108-fe2a23fe2e80 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:37.170526 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7b778f44-d87b-44b2-b108-fe2a23fe2e80 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:37.171732 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7b778f44-d87b-44b2-b108-fe2a23fe2e80 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:37.172709 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7b778f44-d87b-44b2-b108-fe2a23fe2e80 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:37.175161 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7b778f44-d87b-44b2-b108-fe2a23fe2e80 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:37.175686 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7b778f44-d87b-44b2-b108-fe2a23fe2e80 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:37.360386 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-eaf035d3-f7f0-4a4e-aa0e-f793ee9106e0 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb78cce5f7c4c348045745f40b13129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16530e0f2f0a4d23918261c9e21f9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:53:37.376971 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-eaf035d3-f7f0-4a4e-aa0e-f793ee9106e0 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cb78cce5f7c4c348045745f40b13129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16530e0f2f0a4d23918261c9e21f9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:53:37.380281 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-eaf035d3-f7f0-4a4e-aa0e-f793ee9106e0 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cb78cce5f7c4c348045745f40b13129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16530e0f2f0a4d23918261c9e21f9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:53:37.403310 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-eaf035d3-f7f0-4a4e-aa0e-f793ee9106e0 tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] 10.222.0.26 "GET /compute/v2.1/servers/1af12bcb-5e2a-4c15-8673-fa41701cb4c7" status: 200 len: 1449 microversion: 2.75 time: 1.001312 Oct 08 20:53:37.407925 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 339/655] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:53:36 2022] GET /compute/v2.1/servers/1af12bcb-5e2a-4c15-8673-fa41701cb4c7 => generated 1449 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:53:37.430975 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-607442da-7051-478c-8e4c-883458619df7 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:37.432378 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-607442da-7051-478c-8e4c-883458619df7 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] [instance: 139f7ae3-b380-4114-a566-6d496d4957f4] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:53:37.443952 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-607442da-7051-478c-8e4c-883458619df7 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:37.444448 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-607442da-7051-478c-8e4c-883458619df7 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:37.444895 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-607442da-7051-478c-8e4c-883458619df7 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:37.450789 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-607442da-7051-478c-8e4c-883458619df7 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:37.451332 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-607442da-7051-478c-8e4c-883458619df7 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:37.452313 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-607442da-7051-478c-8e4c-883458619df7 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:37.456888 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:53:37.921086 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-7b778f44-d87b-44b2-b108-fe2a23fe2e80 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98936da9b5d94165b386d2d0893ac142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2441394d754f499e27f6f35d5b3afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:53:37.946503 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-7b778f44-d87b-44b2-b108-fe2a23fe2e80 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] 10.222.0.26 "GET /compute/v2.1/servers/99d20873-ce34-47a4-bbe6-5b42e406a360" status: 200 len: 1588 microversion: 2.1 time: 0.812013 Oct 08 20:53:37.950063 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 317/656] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:53:37 2022] GET /compute/v2.1/servers/99d20873-ce34-47a4-bbe6-5b42e406a360 => generated 1588 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:53:37.966291 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-a24b0ed2-95d0-4f5d-af34-80003a606edd req-1f46b2f3-078b-4be2-9bf0-12846d2d599a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99d20873-ce34-47a4-bbe6-5b42e406a360", "tag": "79841dd5-37cd-46cf-878f-6cb318265fee"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:53:37.982731 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:53:38.003368 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-a24b0ed2-95d0-4f5d-af34-80003a606edd req-1f46b2f3-078b-4be2-9bf0-12846d2d599a service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:38.004406 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-a24b0ed2-95d0-4f5d-af34-80003a606edd req-1f46b2f3-078b-4be2-9bf0-12846d2d599a service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:38.006171 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-a24b0ed2-95d0-4f5d-af34-80003a606edd req-1f46b2f3-078b-4be2-9bf0-12846d2d599a service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:38.023683 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:53:38.057485 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-a24b0ed2-95d0-4f5d-af34-80003a606edd req-1f46b2f3-078b-4be2-9bf0-12846d2d599a service nova] Creating event network-changed:79841dd5-37cd-46cf-878f-6cb318265fee for instance 99d20873-ce34-47a4-bbe6-5b42e406a360 on nch1-master-1 Oct 08 20:53:38.073411 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-a24b0ed2-95d0-4f5d-af34-80003a606edd req-1f46b2f3-078b-4be2-9bf0-12846d2d599a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119941 Oct 08 20:53:38.075911 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 318/657] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:53:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:53:38.091167 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-41207926-c1c8-420c-a05c-676dab1e9194 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:38.094722 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-41207926-c1c8-420c-a05c-676dab1e9194 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] [instance: 7e70d7bd-0c39-4320-916f-f99c05ec2806] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:53:38.115787 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-41207926-c1c8-420c-a05c-676dab1e9194 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:38.116295 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-41207926-c1c8-420c-a05c-676dab1e9194 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:38.116740 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-41207926-c1c8-420c-a05c-676dab1e9194 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:38.123345 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-41207926-c1c8-420c-a05c-676dab1e9194 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:38.126996 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-41207926-c1c8-420c-a05c-676dab1e9194 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:38.128622 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-41207926-c1c8-420c-a05c-676dab1e9194 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:38.385950 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-607442da-7051-478c-8e4c-883458619df7 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:53:38.405974 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-607442da-7051-478c-8e4c-883458619df7 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:53:38.408996 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-607442da-7051-478c-8e4c-883458619df7 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:53:38.410474 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-607442da-7051-478c-8e4c-883458619df7 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] 10.222.0.26 "GET /compute/v2.1/servers/139f7ae3-b380-4114-a566-6d496d4957f4" status: 200 len: 1313 microversion: 2.25 time: 1.001394 Oct 08 20:53:38.411333 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 340/658] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:53:37 2022] GET /compute/v2.1/servers/139f7ae3-b380-4114-a566-6d496d4957f4 => generated 1313 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:53:38.429356 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-4648cb32-9051-4ed2-be39-ebefd0c5b388 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:38.430355 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-4648cb32-9051-4ed2-be39-ebefd0c5b388 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] [instance: 279361ef-2171-49e1-9f33-eadbf5dc0313] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:53:38.451312 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4648cb32-9051-4ed2-be39-ebefd0c5b388 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:38.453680 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4648cb32-9051-4ed2-be39-ebefd0c5b388 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:38.454981 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4648cb32-9051-4ed2-be39-ebefd0c5b388 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:38.460180 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4648cb32-9051-4ed2-be39-ebefd0c5b388 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:38.461215 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4648cb32-9051-4ed2-be39-ebefd0c5b388 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:38.465437 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4648cb32-9051-4ed2-be39-ebefd0c5b388 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:39.218293 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-4648cb32-9051-4ed2-be39-ebefd0c5b388 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474ca64d1b1d4e30916b517645aba882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecc2dd2407b4819874bed09cb27959a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:53:39.234317 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-4648cb32-9051-4ed2-be39-ebefd0c5b388 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] 10.222.0.26 "GET /compute/v2.1/servers/279361ef-2171-49e1-9f33-eadbf5dc0313" status: 200 len: 1504 microversion: 2.1 time: 0.819765 Oct 08 20:53:39.273891 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 341/659] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:53:38 2022] GET /compute/v2.1/servers/279361ef-2171-49e1-9f33-eadbf5dc0313 => generated 1504 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:53:39.279994 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-185b7186-4ff4-4310-a285-fa2ea8f7228e tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:39.282009 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-185b7186-4ff4-4310-a285-fa2ea8f7228e tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] [instance: 0b4b7773-b59d-4956-b7e5-267d54541db6] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:53:39.299279 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-185b7186-4ff4-4310-a285-fa2ea8f7228e tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:39.300071 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-185b7186-4ff4-4310-a285-fa2ea8f7228e tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:39.300692 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-185b7186-4ff4-4310-a285-fa2ea8f7228e tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:39.301665 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-185b7186-4ff4-4310-a285-fa2ea8f7228e tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:39.302289 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-185b7186-4ff4-4310-a285-fa2ea8f7228e tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:39.302873 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-185b7186-4ff4-4310-a285-fa2ea8f7228e tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:39.320192 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-185b7186-4ff4-4310-a285-fa2ea8f7228e tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] HTTP exception thrown: Instance 0b4b7773-b59d-4956-b7e5-267d54541db6 could not be found. Oct 08 20:53:39.322288 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-185b7186-4ff4-4310-a285-fa2ea8f7228e tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Request method failure captured: Oct 08 20:53:39.322288 ncdv-master-1 devstack@n-api.service[140492]: request: GET /compute/v2.1/servers/0b4b7773-b59d-4956-b7e5-267d54541db6 HTTP/1.1 Oct 08 20:53:39.322288 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 20:53:39.322288 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 20:53:39.322288 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 20:53:39.322288 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 20:53:39.322288 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 20:53:39.322288 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 20:53:39.322288 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 20:53:39.322288 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 20:53:39.322288 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeMK1D3aTGt9CH6VVzuHHoG7zcE8EsNDXQ8zhbwoGToq8ULQPi2YkRjBRi2EjS_8q1UEPg2Y6cQ7EA0-knrnzL9kuDK1fnGTNm7ohoVx8CH_liYM0aJ-433mFsVprRbhkW97wEY-VO5I_zA0VASJjJzOocWcX9acN_SDiBO2oGP9MIc Oct 08 20:53:39.322288 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 20:53:39.322288 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 20:53:39.322288 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 20:53:39.322288 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 20:53:39.322288 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 20:53:39.322288 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 20:53:39.322288 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 6d702b3083bc4cf5ba6b6fc6f3c3147e Oct 08 20:53:39.322288 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-795115539 Oct 08 20:53:39.322288 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 20:53:39.322288 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 20:53:39.323910 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6d702b3083bc4cf5ba6b6fc6f3c3147e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6d702b3083bc4cf5ba6b6fc6f3c3147e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6d702b3083bc4cf5ba6b6fc6f3c3147e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6d702b3083bc4cf5ba6b6fc6f3c3147e"}]}] Oct 08 20:53:39.323910 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-ServersAdminNegativeTestJSON-795115539 Oct 08 20:53:39.323910 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 6d702b3083bc4cf5ba6b6fc6f3c3147e Oct 08 20:53:39.323910 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-795115539 Oct 08 20:53:39.323910 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-ServersAdminNegativeTestJSON-795115539-project Oct 08 20:53:39.323910 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 20:53:39.323910 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 20:53:39.323910 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 360660f7bb4746c8b1397f4857f423f2 Oct 08 20:53:39.323910 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-ServersAdminNegativeTestJSON-795115539-project Oct 08 20:53:39.323910 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 20:53:39.323910 ncdv-master-1 devstack@n-api.service[140492]: exception: Instance 0b4b7773-b59d-4956-b7e5-267d54541db6 could not be found. Oct 08 20:53:39.323910 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': '0b4b7773-b59d-4956-b7e5-267d54541db6'} Oct 08 20:53:39.324804 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:53:39.324804 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:53:39.324804 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 20:53:39.324804 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 20:53:39.324804 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 20:53:39.324804 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 20:53:39.324804 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 20:53:39.324804 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 20:53:39.324804 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 20:53:39.324804 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 20:53:39.324804 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b4b7773-b59d-4956-b7e5-267d54541db6 could not be found. Oct 08 20:53:39.324804 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:53:39.324804 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:53:39.324804 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:53:39.324804 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:53:39.324804 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:53:39.324804 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:53:39.324804 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:53:39.324804 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:53:39.324804 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:53:39.326277 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:53:39.326277 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 20:53:39.326277 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 20:53:39.326277 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 20:53:39.326277 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 20:53:39.326277 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 20:53:39.326277 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 20:53:39.326277 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b4b7773-b59d-4956-b7e5-267d54541db6 could not be found. Oct 08 20:53:39.326277 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:53:39.326277 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:53:39.326277 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:53:39.326277 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:53:39.326277 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:53:39.326277 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:53:39.326277 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 20:53:39.326277 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 20:53:39.326277 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b4b7773-b59d-4956-b7e5-267d54541db6 could not be found. Oct 08 20:53:39.326277 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:53:39.329223 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-185b7186-4ff4-4310-a285-fa2ea8f7228e tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] Returning 404 to user: Instance 0b4b7773-b59d-4956-b7e5-267d54541db6 could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:53:39.330281 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-185b7186-4ff4-4310-a285-fa2ea8f7228e tempest-ServersAdminNegativeTestJSON-795115539 tempest-ServersAdminNegativeTestJSON-795115539-project] 10.222.0.26 "GET /compute/v2.1/servers/0b4b7773-b59d-4956-b7e5-267d54541db6" status: 404 len: 111 microversion: 2.1 time: 0.055279 Oct 08 20:53:39.331039 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 342/660] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:53:39 2022] GET /compute/v2.1/servers/0b4b7773-b59d-4956-b7e5-267d54541db6 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 20:53:39.337726 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-93a3c3c0-b0f3-467f-911e-62f38494ca6c tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:39.338870 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-93a3c3c0-b0f3-467f-911e-62f38494ca6c tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] [instance: 1af12bcb-5e2a-4c15-8673-fa41701cb4c7] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:53:39.345551 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-93a3c3c0-b0f3-467f-911e-62f38494ca6c tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:39.346307 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-93a3c3c0-b0f3-467f-911e-62f38494ca6c tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:39.348892 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-93a3c3c0-b0f3-467f-911e-62f38494ca6c tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:39.350032 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-93a3c3c0-b0f3-467f-911e-62f38494ca6c tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:39.350667 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-93a3c3c0-b0f3-467f-911e-62f38494ca6c tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:39.351257 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-93a3c3c0-b0f3-467f-911e-62f38494ca6c tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:39.385001 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-93a3c3c0-b0f3-467f-911e-62f38494ca6c tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] HTTP exception thrown: Instance 1af12bcb-5e2a-4c15-8673-fa41701cb4c7 could not be found. Oct 08 20:53:39.386684 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-93a3c3c0-b0f3-467f-911e-62f38494ca6c tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Request method failure captured: Oct 08 20:53:39.386684 ncdv-master-1 devstack@n-api.service[140492]: request: GET /compute/v2.1/servers/1af12bcb-5e2a-4c15-8673-fa41701cb4c7 HTTP/1.1 Oct 08 20:53:39.386684 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 20:53:39.386684 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 20:53:39.386684 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 20:53:39.386684 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 20:53:39.386684 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 20:53:39.386684 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 20:53:39.386684 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 20:53:39.386684 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 20:53:39.386684 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeL-Z_LiUrF5BSNG_rpWloFB7unt-2mXV_lM34afGGN636j8qZQpl3ahyp0uAFV9QBzMwSnZQZJmdUSC9xvbxo3Y3_5aAyZQR9JDTs6acxFbXn1D0r8FWSpAXuHF9yE9o15K2MEFvS4I6ZI2BRlnXkmeHk_DAr7I1_fCPqQ-1RMOb4g Oct 08 20:53:39.386684 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 20:53:39.386684 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 20:53:39.386684 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 20:53:39.386684 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 20:53:39.386684 ncdv-master-1 devstack@n-api.service[140492]: X-Openstack-Nova-Api-Version: 2.75 Oct 08 20:53:39.386684 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 20:53:39.386684 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 20:53:39.386684 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 16530e0f2f0a4d23918261c9e21f9784 Oct 08 20:53:39.386684 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-ServersAdmin275Test-242774711 Oct 08 20:53:39.386684 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 20:53:39.386684 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 20:53:39.388054 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/16530e0f2f0a4d23918261c9e21f9784"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/16530e0f2f0a4d23918261c9e21f9784"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_16530e0f2f0a4d23918261c9e21f9784"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/16530e0f2f0a4d23918261c9e21f9784"}]}] Oct 08 20:53:39.388054 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-ServersAdmin275Test-242774711 Oct 08 20:53:39.388054 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 16530e0f2f0a4d23918261c9e21f9784 Oct 08 20:53:39.388054 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-ServersAdmin275Test-242774711 Oct 08 20:53:39.388054 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-ServersAdmin275Test-242774711-project Oct 08 20:53:39.388054 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 20:53:39.388054 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 20:53:39.388054 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 2cb78cce5f7c4c348045745f40b13129 Oct 08 20:53:39.388054 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-ServersAdmin275Test-242774711-project Oct 08 20:53:39.388054 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 20:53:39.388054 ncdv-master-1 devstack@n-api.service[140492]: exception: Instance 1af12bcb-5e2a-4c15-8673-fa41701cb4c7 could not be found. Oct 08 20:53:39.388054 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': '1af12bcb-5e2a-4c15-8673-fa41701cb4c7'} Oct 08 20:53:39.388937 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:53:39.388937 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:53:39.388937 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 20:53:39.388937 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 20:53:39.388937 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 20:53:39.388937 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 20:53:39.388937 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 20:53:39.388937 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 20:53:39.388937 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 20:53:39.388937 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 20:53:39.388937 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1af12bcb-5e2a-4c15-8673-fa41701cb4c7 could not be found. Oct 08 20:53:39.388937 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:53:39.388937 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:53:39.388937 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:53:39.388937 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:53:39.388937 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:53:39.388937 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:53:39.388937 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:53:39.388937 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:53:39.388937 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:53:39.390772 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:53:39.390772 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 20:53:39.390772 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 20:53:39.390772 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 20:53:39.390772 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 20:53:39.390772 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 20:53:39.390772 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 20:53:39.390772 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1af12bcb-5e2a-4c15-8673-fa41701cb4c7 could not be found. Oct 08 20:53:39.390772 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:53:39.390772 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:53:39.390772 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:53:39.390772 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:53:39.390772 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:53:39.390772 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:53:39.390772 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 20:53:39.390772 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 20:53:39.390772 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1af12bcb-5e2a-4c15-8673-fa41701cb4c7 could not be found. Oct 08 20:53:39.390772 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:53:39.394016 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-93a3c3c0-b0f3-467f-911e-62f38494ca6c tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] Returning 404 to user: Instance 1af12bcb-5e2a-4c15-8673-fa41701cb4c7 could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:53:39.395371 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-93a3c3c0-b0f3-467f-911e-62f38494ca6c tempest-ServersAdmin275Test-242774711 tempest-ServersAdmin275Test-242774711-project] 10.222.0.26 "GET /compute/v2.1/servers/1af12bcb-5e2a-4c15-8673-fa41701cb4c7" status: 404 len: 111 microversion: 2.75 time: 0.062430 Oct 08 20:53:39.396578 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 343/661] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:53:39 2022] GET /compute/v2.1/servers/1af12bcb-5e2a-4c15-8673-fa41701cb4c7 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 08 20:53:39.437509 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-bb114260-16a4-452e-a5fb-ae4efe3d24a1 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:39.439028 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-bb114260-16a4-452e-a5fb-ae4efe3d24a1 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] [instance: 139f7ae3-b380-4114-a566-6d496d4957f4] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:53:39.477553 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bb114260-16a4-452e-a5fb-ae4efe3d24a1 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:39.481127 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bb114260-16a4-452e-a5fb-ae4efe3d24a1 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:39.488083 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bb114260-16a4-452e-a5fb-ae4efe3d24a1 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:39.489264 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bb114260-16a4-452e-a5fb-ae4efe3d24a1 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:39.494270 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bb114260-16a4-452e-a5fb-ae4efe3d24a1 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:39.499516 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bb114260-16a4-452e-a5fb-ae4efe3d24a1 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:39.502436 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-41207926-c1c8-420c-a05c-676dab1e9194 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef659f5a1a24c439528a7675bdd70f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c92fe04ab8248399d0acb932f82d607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:53:39.517233 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-41207926-c1c8-420c-a05c-676dab1e9194 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] 10.222.0.26 "GET /compute/v2.1/servers/7e70d7bd-0c39-4320-916f-f99c05ec2806" status: 200 len: 1313 microversion: 2.1 time: 1.439030 Oct 08 20:53:39.527896 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 319/662] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:53:38 2022] GET /compute/v2.1/servers/7e70d7bd-0c39-4320-916f-f99c05ec2806 => generated 1313 bytes in 1451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:53:40.197462 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-02a25235-c586-4fbd-b145-a6a16fc62ae2 req-e371d78e-0371-44b2-8935-c9a166e3dfc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b4b7773-b59d-4956-b7e5-267d54541db6", "name": "network-vif-deleted", "tag": "38d934fc-c54f-41b1-a9d1-b8c83e8395a1"}, {"name": "network-changed", "server_uuid": "7e70d7bd-0c39-4320-916f-f99c05ec2806", "tag": "b4ba81f5-23a1-4960-a30e-7b870430ccad"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:53:40.218339 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-02a25235-c586-4fbd-b145-a6a16fc62ae2 req-e371d78e-0371-44b2-8935-c9a166e3dfc2 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:40.218826 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-02a25235-c586-4fbd-b145-a6a16fc62ae2 req-e371d78e-0371-44b2-8935-c9a166e3dfc2 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:40.224159 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-02a25235-c586-4fbd-b145-a6a16fc62ae2 req-e371d78e-0371-44b2-8935-c9a166e3dfc2 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:40.250495 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-02a25235-c586-4fbd-b145-a6a16fc62ae2 req-e371d78e-0371-44b2-8935-c9a166e3dfc2 service nova] Creating event network-vif-deleted:38d934fc-c54f-41b1-a9d1-b8c83e8395a1 for instance 0b4b7773-b59d-4956-b7e5-267d54541db6 on nch1-master-1 Oct 08 20:53:40.251376 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-02a25235-c586-4fbd-b145-a6a16fc62ae2 req-e371d78e-0371-44b2-8935-c9a166e3dfc2 service nova] Creating event network-changed:b4ba81f5-23a1-4960-a30e-7b870430ccad for instance 7e70d7bd-0c39-4320-916f-f99c05ec2806 on nch2-master-1 Oct 08 20:53:40.273994 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-02a25235-c586-4fbd-b145-a6a16fc62ae2 req-e371d78e-0371-44b2-8935-c9a166e3dfc2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.087651 Oct 08 20:53:40.277542 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 320/663] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:53:40 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:53:40.280770 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-bb114260-16a4-452e-a5fb-ae4efe3d24a1 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:53:40.287804 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-f67600c6-537e-41f7-90bc-6e15f61577c6 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:40.293794 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-f67600c6-537e-41f7-90bc-6e15f61577c6 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] [instance: 279361ef-2171-49e1-9f33-eadbf5dc0313] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:53:40.308372 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f67600c6-537e-41f7-90bc-6e15f61577c6 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:40.310325 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f67600c6-537e-41f7-90bc-6e15f61577c6 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:40.312637 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f67600c6-537e-41f7-90bc-6e15f61577c6 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:40.313988 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f67600c6-537e-41f7-90bc-6e15f61577c6 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:40.315083 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-bb114260-16a4-452e-a5fb-ae4efe3d24a1 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:53:40.315931 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f67600c6-537e-41f7-90bc-6e15f61577c6 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:40.317871 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f67600c6-537e-41f7-90bc-6e15f61577c6 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:40.329287 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-bb114260-16a4-452e-a5fb-ae4efe3d24a1 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:53:40.330753 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-bb114260-16a4-452e-a5fb-ae4efe3d24a1 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] 10.222.0.26 "GET /compute/v2.1/servers/139f7ae3-b380-4114-a566-6d496d4957f4" status: 200 len: 1319 microversion: 2.25 time: 0.898463 Oct 08 20:53:40.338851 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 344/664] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:53:39 2022] GET /compute/v2.1/servers/139f7ae3-b380-4114-a566-6d496d4957f4 => generated 1319 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:53:40.553226 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-582be9fc-14dd-4963-8c7b-e2ba744a6986 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:40.554676 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-582be9fc-14dd-4963-8c7b-e2ba744a6986 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] [instance: 7e70d7bd-0c39-4320-916f-f99c05ec2806] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:53:40.571895 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-582be9fc-14dd-4963-8c7b-e2ba744a6986 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:40.573560 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-582be9fc-14dd-4963-8c7b-e2ba744a6986 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:40.575233 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-582be9fc-14dd-4963-8c7b-e2ba744a6986 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:40.578082 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-582be9fc-14dd-4963-8c7b-e2ba744a6986 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:40.578786 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-582be9fc-14dd-4963-8c7b-e2ba744a6986 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:40.579421 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-582be9fc-14dd-4963-8c7b-e2ba744a6986 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:41.145561 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-582be9fc-14dd-4963-8c7b-e2ba744a6986 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef659f5a1a24c439528a7675bdd70f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c92fe04ab8248399d0acb932f82d607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:53:41.157361 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-582be9fc-14dd-4963-8c7b-e2ba744a6986 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] 10.222.0.26 "GET /compute/v2.1/servers/7e70d7bd-0c39-4320-916f-f99c05ec2806" status: 200 len: 1313 microversion: 2.1 time: 0.606496 Oct 08 20:53:41.158030 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 345/665] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:53:40 2022] GET /compute/v2.1/servers/7e70d7bd-0c39-4320-916f-f99c05ec2806 => generated 1313 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 20:53:41.173507 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-131f141b-8b61-4702-9a0b-842bf7e0ea1a req-9f167783-259c-4836-b912-68e9d8534be0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "279361ef-2171-49e1-9f33-eadbf5dc0313", "name": "network-vif-unplugged", "status": "completed", "tag": "331433c9-6d41-4903-b1f6-3eedf2e2ae2d"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:53:41.189756 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-131f141b-8b61-4702-9a0b-842bf7e0ea1a req-9f167783-259c-4836-b912-68e9d8534be0 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:41.190245 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-131f141b-8b61-4702-9a0b-842bf7e0ea1a req-9f167783-259c-4836-b912-68e9d8534be0 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:41.190689 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-131f141b-8b61-4702-9a0b-842bf7e0ea1a req-9f167783-259c-4836-b912-68e9d8534be0 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:41.224056 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-131f141b-8b61-4702-9a0b-842bf7e0ea1a req-9f167783-259c-4836-b912-68e9d8534be0 service nova] Creating event network-vif-unplugged:331433c9-6d41-4903-b1f6-3eedf2e2ae2d for instance 279361ef-2171-49e1-9f33-eadbf5dc0313 on nch2-master-1 Oct 08 20:53:41.233447 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-131f141b-8b61-4702-9a0b-842bf7e0ea1a req-9f167783-259c-4836-b912-68e9d8534be0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.073196 Oct 08 20:53:41.237238 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 346/666] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:53:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:53:41.370463 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-6303d7fe-a9fc-499c-abb9-f46829f5f174 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:41.371189 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-6303d7fe-a9fc-499c-abb9-f46829f5f174 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] [instance: 139f7ae3-b380-4114-a566-6d496d4957f4] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:53:41.379183 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6303d7fe-a9fc-499c-abb9-f46829f5f174 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:41.379713 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6303d7fe-a9fc-499c-abb9-f46829f5f174 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:41.380175 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6303d7fe-a9fc-499c-abb9-f46829f5f174 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:41.380931 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6303d7fe-a9fc-499c-abb9-f46829f5f174 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:41.381447 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6303d7fe-a9fc-499c-abb9-f46829f5f174 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:41.381894 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6303d7fe-a9fc-499c-abb9-f46829f5f174 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:41.824831 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-f67600c6-537e-41f7-90bc-6e15f61577c6 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474ca64d1b1d4e30916b517645aba882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecc2dd2407b4819874bed09cb27959a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:53:41.843042 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-f67600c6-537e-41f7-90bc-6e15f61577c6 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] 10.222.0.26 "GET /compute/v2.1/servers/279361ef-2171-49e1-9f33-eadbf5dc0313" status: 200 len: 1504 microversion: 2.1 time: 1.558820 Oct 08 20:53:41.844922 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 321/667] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:53:40 2022] GET /compute/v2.1/servers/279361ef-2171-49e1-9f33-eadbf5dc0313 => generated 1504 bytes in 1563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:53:42.187354 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-49385d47-0720-445a-b039-f322bc46cd93 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:42.189048 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-49385d47-0720-445a-b039-f322bc46cd93 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] [instance: 7e70d7bd-0c39-4320-916f-f99c05ec2806] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:53:42.205727 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-49385d47-0720-445a-b039-f322bc46cd93 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:42.206453 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-49385d47-0720-445a-b039-f322bc46cd93 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:42.208149 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-49385d47-0720-445a-b039-f322bc46cd93 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:42.210604 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-49385d47-0720-445a-b039-f322bc46cd93 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:42.211479 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-49385d47-0720-445a-b039-f322bc46cd93 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:42.212331 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-49385d47-0720-445a-b039-f322bc46cd93 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:42.277000 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-6303d7fe-a9fc-499c-abb9-f46829f5f174 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:53:42.289466 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-6303d7fe-a9fc-499c-abb9-f46829f5f174 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:53:42.291616 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-6303d7fe-a9fc-499c-abb9-f46829f5f174 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:53:42.295011 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-6303d7fe-a9fc-499c-abb9-f46829f5f174 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] 10.222.0.26 "GET /compute/v2.1/servers/139f7ae3-b380-4114-a566-6d496d4957f4" status: 200 len: 1361 microversion: 2.25 time: 0.929158 Oct 08 20:53:42.298662 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 347/668] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:53:41 2022] GET /compute/v2.1/servers/139f7ae3-b380-4114-a566-6d496d4957f4 => generated 1361 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 08 20:53:42.658546 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-49385d47-0720-445a-b039-f322bc46cd93 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef659f5a1a24c439528a7675bdd70f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c92fe04ab8248399d0acb932f82d607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:53:42.669389 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-49385d47-0720-445a-b039-f322bc46cd93 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] 10.222.0.26 "GET /compute/v2.1/servers/7e70d7bd-0c39-4320-916f-f99c05ec2806" status: 200 len: 1313 microversion: 2.1 time: 0.488669 Oct 08 20:53:42.670143 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 322/669] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:53:42 2022] GET /compute/v2.1/servers/7e70d7bd-0c39-4320-916f-f99c05ec2806 => generated 1313 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:53:42.871888 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-16f2672b-e3a3-4d2d-a6b9-cac40cdabb7d tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:42.873397 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-16f2672b-e3a3-4d2d-a6b9-cac40cdabb7d tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] [instance: 279361ef-2171-49e1-9f33-eadbf5dc0313] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:53:42.886612 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-16f2672b-e3a3-4d2d-a6b9-cac40cdabb7d tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:42.895264 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-16f2672b-e3a3-4d2d-a6b9-cac40cdabb7d tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:42.900562 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-16f2672b-e3a3-4d2d-a6b9-cac40cdabb7d tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:42.910842 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-16f2672b-e3a3-4d2d-a6b9-cac40cdabb7d tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:42.913685 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-16f2672b-e3a3-4d2d-a6b9-cac40cdabb7d tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:42.914389 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-16f2672b-e3a3-4d2d-a6b9-cac40cdabb7d tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:43.122086 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-62a07f7b-63c1-4d00-b317-e313b9e98ba4 tempest-FloatingIPDetailsTestJSON-117414399 tempest-FloatingIPDetailsTestJSON-117414399-project] Action: 'create', calling method: .version_select at 0x7f1a8d353310>, body: {"pool": null} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:53:43.372898 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-16f2672b-e3a3-4d2d-a6b9-cac40cdabb7d tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474ca64d1b1d4e30916b517645aba882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecc2dd2407b4819874bed09cb27959a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:53:43.390822 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-16f2672b-e3a3-4d2d-a6b9-cac40cdabb7d tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] 10.222.0.26 "GET /compute/v2.1/servers/279361ef-2171-49e1-9f33-eadbf5dc0313" status: 200 len: 1504 microversion: 2.1 time: 0.522565 Oct 08 20:53:43.392676 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 323/670] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:53:42 2022] GET /compute/v2.1/servers/279361ef-2171-49e1-9f33-eadbf5dc0313 => generated 1504 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 20:53:43.400805 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-d8996352-afa1-4086-9eb6-4673740a3022 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:43.401665 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-d8996352-afa1-4086-9eb6-4673740a3022 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] [instance: 139f7ae3-b380-4114-a566-6d496d4957f4] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:53:43.411130 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d8996352-afa1-4086-9eb6-4673740a3022 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:43.412209 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d8996352-afa1-4086-9eb6-4673740a3022 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:43.414191 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d8996352-afa1-4086-9eb6-4673740a3022 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:43.417052 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d8996352-afa1-4086-9eb6-4673740a3022 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:43.418043 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d8996352-afa1-4086-9eb6-4673740a3022 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:43.419257 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d8996352-afa1-4086-9eb6-4673740a3022 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:44.159467 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-d8996352-afa1-4086-9eb6-4673740a3022 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:53:44.176317 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-d8996352-afa1-4086-9eb6-4673740a3022 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:53:44.178670 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-d8996352-afa1-4086-9eb6-4673740a3022 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:53:44.180412 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-d8996352-afa1-4086-9eb6-4673740a3022 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] 10.222.0.26 "GET /compute/v2.1/servers/139f7ae3-b380-4114-a566-6d496d4957f4" status: 200 len: 1361 microversion: 2.25 time: 0.785583 Oct 08 20:53:44.181495 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 324/671] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:53:43 2022] GET /compute/v2.1/servers/139f7ae3-b380-4114-a566-6d496d4957f4 => generated 1361 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:53:44.202323 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-c25bdb88-a6c7-4b8e-ac8a-4e60eb34c0c7 req-dd5968af-b0dc-4d4e-97d2-c1140e429d71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "279361ef-2171-49e1-9f33-eadbf5dc0313", "tag": "331433c9-6d41-4903-b1f6-3eedf2e2ae2d"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:53:44.222519 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-c25bdb88-a6c7-4b8e-ac8a-4e60eb34c0c7 req-dd5968af-b0dc-4d4e-97d2-c1140e429d71 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:44.223012 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-c25bdb88-a6c7-4b8e-ac8a-4e60eb34c0c7 req-dd5968af-b0dc-4d4e-97d2-c1140e429d71 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:44.227070 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-c25bdb88-a6c7-4b8e-ac8a-4e60eb34c0c7 req-dd5968af-b0dc-4d4e-97d2-c1140e429d71 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:44.262295 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-c25bdb88-a6c7-4b8e-ac8a-4e60eb34c0c7 req-dd5968af-b0dc-4d4e-97d2-c1140e429d71 service nova] Creating event network-changed:331433c9-6d41-4903-b1f6-3eedf2e2ae2d for instance 279361ef-2171-49e1-9f33-eadbf5dc0313 on nch2-master-1 Oct 08 20:53:44.276582 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-c25bdb88-a6c7-4b8e-ac8a-4e60eb34c0c7 req-dd5968af-b0dc-4d4e-97d2-c1140e429d71 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093118 Oct 08 20:53:44.282759 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 325/672] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:53:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:53:44.293790 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-2826a0c9-2787-4f7d-aa0c-d3d5c02ea308 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:44.294514 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-2826a0c9-2787-4f7d-aa0c-d3d5c02ea308 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] [instance: 7e70d7bd-0c39-4320-916f-f99c05ec2806] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:53:44.310899 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2826a0c9-2787-4f7d-aa0c-d3d5c02ea308 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:44.313214 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2826a0c9-2787-4f7d-aa0c-d3d5c02ea308 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:44.313718 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2826a0c9-2787-4f7d-aa0c-d3d5c02ea308 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:44.314461 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2826a0c9-2787-4f7d-aa0c-d3d5c02ea308 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:44.314946 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2826a0c9-2787-4f7d-aa0c-d3d5c02ea308 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:44.317765 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2826a0c9-2787-4f7d-aa0c-d3d5c02ea308 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:44.852386 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=6 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:53:45.713771 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=22 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:53:45.958061 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-2826a0c9-2787-4f7d-aa0c-d3d5c02ea308 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef659f5a1a24c439528a7675bdd70f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c92fe04ab8248399d0acb932f82d607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:53:45.991383 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-2826a0c9-2787-4f7d-aa0c-d3d5c02ea308 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] 10.222.0.26 "GET /compute/v2.1/servers/7e70d7bd-0c39-4320-916f-f99c05ec2806" status: 200 len: 1313 microversion: 2.1 time: 1.705644 Oct 08 20:53:45.993576 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 326/673] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:53:44 2022] GET /compute/v2.1/servers/7e70d7bd-0c39-4320-916f-f99c05ec2806 => generated 1313 bytes in 1710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:53:46.008079 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-b1e953a7-b47d-413a-8b50-0e219481cf73 req-b039c726-21e6-42b8-8c98-6d1c7f617259 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "139f7ae3-b380-4114-a566-6d496d4957f4", "tag": "34b7dd73-89eb-4b12-ac78-40ef20772247"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:53:46.038804 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-b1e953a7-b47d-413a-8b50-0e219481cf73 req-b039c726-21e6-42b8-8c98-6d1c7f617259 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:46.041577 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-b1e953a7-b47d-413a-8b50-0e219481cf73 req-b039c726-21e6-42b8-8c98-6d1c7f617259 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:46.042338 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-b1e953a7-b47d-413a-8b50-0e219481cf73 req-b039c726-21e6-42b8-8c98-6d1c7f617259 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:46.093217 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-b1e953a7-b47d-413a-8b50-0e219481cf73 req-b039c726-21e6-42b8-8c98-6d1c7f617259 service nova] Creating event network-changed:34b7dd73-89eb-4b12-ac78-40ef20772247 for instance 139f7ae3-b380-4114-a566-6d496d4957f4 on nch1-master-1 Oct 08 20:53:46.111337 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-b1e953a7-b47d-413a-8b50-0e219481cf73 req-b039c726-21e6-42b8-8c98-6d1c7f617259 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112844 Oct 08 20:53:46.117413 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 327/674] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:53:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:53:46.136229 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-20b9e914-e653-4d9c-afa3-bf2e1bd4650e tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:46.136855 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-20b9e914-e653-4d9c-afa3-bf2e1bd4650e tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] [instance: 279361ef-2171-49e1-9f33-eadbf5dc0313] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:53:46.152581 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-20b9e914-e653-4d9c-afa3-bf2e1bd4650e tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:46.153420 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-20b9e914-e653-4d9c-afa3-bf2e1bd4650e tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:46.154046 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-20b9e914-e653-4d9c-afa3-bf2e1bd4650e tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:46.155823 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-20b9e914-e653-4d9c-afa3-bf2e1bd4650e tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:46.156446 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-20b9e914-e653-4d9c-afa3-bf2e1bd4650e tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:46.157015 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-20b9e914-e653-4d9c-afa3-bf2e1bd4650e tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:46.714192 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-20b9e914-e653-4d9c-afa3-bf2e1bd4650e tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474ca64d1b1d4e30916b517645aba882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecc2dd2407b4819874bed09cb27959a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:53:46.724915 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-20b9e914-e653-4d9c-afa3-bf2e1bd4650e tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] 10.222.0.26 "GET /compute/v2.1/servers/279361ef-2171-49e1-9f33-eadbf5dc0313" status: 200 len: 1504 microversion: 2.1 time: 0.604644 Oct 08 20:53:46.728384 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 328/675] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:53:46 2022] GET /compute/v2.1/servers/279361ef-2171-49e1-9f33-eadbf5dc0313 => generated 1504 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:53:46.735672 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-8cd8fb01-0efa-4f6c-9f07-bd47f50e56eb tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:46.738843 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-8cd8fb01-0efa-4f6c-9f07-bd47f50e56eb tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] [instance: 139f7ae3-b380-4114-a566-6d496d4957f4] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:53:46.754033 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8cd8fb01-0efa-4f6c-9f07-bd47f50e56eb tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:46.757796 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8cd8fb01-0efa-4f6c-9f07-bd47f50e56eb tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:46.758465 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8cd8fb01-0efa-4f6c-9f07-bd47f50e56eb tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:46.759365 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8cd8fb01-0efa-4f6c-9f07-bd47f50e56eb tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:46.759989 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8cd8fb01-0efa-4f6c-9f07-bd47f50e56eb tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:46.762829 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8cd8fb01-0efa-4f6c-9f07-bd47f50e56eb tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:46.958484 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-62a07f7b-63c1-4d00-b317-e313b9e98ba4 tempest-FloatingIPDetailsTestJSON-117414399 tempest-FloatingIPDetailsTestJSON-117414399-project] 10.222.0.26 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.356535 Oct 08 20:53:46.960168 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 348/676] 10.222.0.26 () {60 vars in 1170 bytes} [Sat Oct 8 20:53:42 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4359 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:53:46.983612 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-8cd8fb01-0efa-4f6c-9f07-bd47f50e56eb tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:53:46.995946 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-8cd8fb01-0efa-4f6c-9f07-bd47f50e56eb tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:53:46.997529 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-8cd8fb01-0efa-4f6c-9f07-bd47f50e56eb tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:53:46.998866 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-8cd8fb01-0efa-4f6c-9f07-bd47f50e56eb tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] 10.222.0.26 "GET /compute/v2.1/servers/139f7ae3-b380-4114-a566-6d496d4957f4" status: 200 len: 1361 microversion: 2.25 time: 0.269167 Oct 08 20:53:47.000144 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 329/677] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:53:46 2022] GET /compute/v2.1/servers/139f7ae3-b380-4114-a566-6d496d4957f4 => generated 1361 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:53:47.005349 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-982c6855-d41e-470c-9393-3eef95a11162 tempest-FloatingIPDetailsTestJSON-117414399 tempest-FloatingIPDetailsTestJSON-117414399-project] Action: 'create', calling method: .version_select at 0x7f1a8d1550d0>, body: {"pool": null} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:53:47.317656 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-d2adf816-44a0-4800-b8b8-a80e204ca825 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-UnshelveToHostMultiNodesTest-server-2100370508", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "networks": "none"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:53:47.422819 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-d2adf816-44a0-4800-b8b8-a80e204ca825 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Flavor limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 20:53:47.423406 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-d2adf816-44a0-4800-b8b8-a80e204ca825 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Image limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 20:53:47.423941 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-d2adf816-44a0-4800-b8b8-a80e204ca825 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Flavor pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 20:53:47.424264 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-d2adf816-44a0-4800-b8b8-a80e204ca825 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Image pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 20:53:47.424691 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-d2adf816-44a0-4800-b8b8-a80e204ca825 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 20:53:47.472172 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d2adf816-44a0-4800-b8b8-a80e204ca825 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:47.473984 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d2adf816-44a0-4800-b8b8-a80e204ca825 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:47.475463 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d2adf816-44a0-4800-b8b8-a80e204ca825 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:47.477853 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d2adf816-44a0-4800-b8b8-a80e204ca825 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:47.490899 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d2adf816-44a0-4800-b8b8-a80e204ca825 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:47.491593 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d2adf816-44a0-4800-b8b8-a80e204ca825 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:47.564395 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-d2adf816-44a0-4800-b8b8-a80e204ca825 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Getting quotas for project 65a10eeae3da4b9a979b8c1167039014. Resources: {'cores', 'instances', 'ram'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 20:53:47.580142 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-d2adf816-44a0-4800-b8b8-a80e204ca825 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Getting quotas for user 2f72559f9cbb4544af3008e574d554ee and project 65a10eeae3da4b9a979b8c1167039014. Resources: {'cores', 'instances', 'ram'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 20:53:47.614484 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-d2adf816-44a0-4800-b8b8-a80e204ca825 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Going to run 1 instances... {{(pid=140492) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 20:53:47.619557 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-d2adf816-44a0-4800-b8b8-a80e204ca825 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] [instance: 92e31b92-0af1-4da6-bc87-23978f1aedf5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c508bd7f-7db9-4b2c-af7c-be54a855c355',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140492) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 20:53:47.740592 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-d2adf816-44a0-4800-b8b8-a80e204ca825 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.91 time: 0.779077 Oct 08 20:53:47.760586 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 349/678] 10.222.0.26 () {62 vars in 1188 bytes} [Sat Oct 8 20:53:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 799 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 08 20:53:47.786117 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-1d37b431-a4ec-4af3-862a-fd733348c0ff tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:47.786804 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-1d37b431-a4ec-4af3-862a-fd733348c0ff tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] [instance: 7e70d7bd-0c39-4320-916f-f99c05ec2806] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:53:47.805437 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1d37b431-a4ec-4af3-862a-fd733348c0ff tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:47.807479 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1d37b431-a4ec-4af3-862a-fd733348c0ff tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:47.810380 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1d37b431-a4ec-4af3-862a-fd733348c0ff tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:47.814134 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1d37b431-a4ec-4af3-862a-fd733348c0ff tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:47.814993 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1d37b431-a4ec-4af3-862a-fd733348c0ff tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:47.815660 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1d37b431-a4ec-4af3-862a-fd733348c0ff tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:48.861290 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-1d37b431-a4ec-4af3-862a-fd733348c0ff tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef659f5a1a24c439528a7675bdd70f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c92fe04ab8248399d0acb932f82d607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:53:48.880240 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-1d37b431-a4ec-4af3-862a-fd733348c0ff tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] 10.222.0.26 "GET /compute/v2.1/servers/7e70d7bd-0c39-4320-916f-f99c05ec2806" status: 200 len: 1313 microversion: 2.1 time: 1.117985 Oct 08 20:53:48.885901 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 350/679] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:53:47 2022] GET /compute/v2.1/servers/7e70d7bd-0c39-4320-916f-f99c05ec2806 => generated 1313 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:53:48.895442 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-4daed34b-98d3-4ae0-90e8-63dd95e47590 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:48.897221 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-4daed34b-98d3-4ae0-90e8-63dd95e47590 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] [instance: 92e31b92-0af1-4da6-bc87-23978f1aedf5] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:53:48.909929 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4daed34b-98d3-4ae0-90e8-63dd95e47590 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:48.910732 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4daed34b-98d3-4ae0-90e8-63dd95e47590 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:48.911394 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4daed34b-98d3-4ae0-90e8-63dd95e47590 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:48.912402 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4daed34b-98d3-4ae0-90e8-63dd95e47590 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:48.913067 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4daed34b-98d3-4ae0-90e8-63dd95e47590 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:48.921819 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4daed34b-98d3-4ae0-90e8-63dd95e47590 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:49.133598 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-4daed34b-98d3-4ae0-90e8-63dd95e47590 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:53:49.173550 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-4daed34b-98d3-4ae0-90e8-63dd95e47590 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:53:49.181544 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-4daed34b-98d3-4ae0-90e8-63dd95e47590 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:53:49.205357 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-4daed34b-98d3-4ae0-90e8-63dd95e47590 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] 10.222.0.26 "GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5" status: 200 len: 1450 microversion: 2.91 time: 0.317726 Oct 08 20:53:49.208393 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 351/680] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:53:48 2022] GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5 => generated 1450 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:53:49.214854 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-f71757e4-0786-49e5-b72a-077415fadf7e tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:49.215483 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-f71757e4-0786-49e5-b72a-077415fadf7e tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] [instance: 279361ef-2171-49e1-9f33-eadbf5dc0313] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:53:49.222437 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f71757e4-0786-49e5-b72a-077415fadf7e tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:49.222937 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f71757e4-0786-49e5-b72a-077415fadf7e tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:49.223536 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f71757e4-0786-49e5-b72a-077415fadf7e tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:49.225073 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f71757e4-0786-49e5-b72a-077415fadf7e tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:49.225726 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f71757e4-0786-49e5-b72a-077415fadf7e tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:49.226180 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f71757e4-0786-49e5-b72a-077415fadf7e tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:49.672649 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-f71757e4-0786-49e5-b72a-077415fadf7e tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474ca64d1b1d4e30916b517645aba882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecc2dd2407b4819874bed09cb27959a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:53:49.715121 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-f71757e4-0786-49e5-b72a-077415fadf7e tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] 10.222.0.26 "GET /compute/v2.1/servers/279361ef-2171-49e1-9f33-eadbf5dc0313" status: 200 len: 1504 microversion: 2.1 time: 0.495100 Oct 08 20:53:49.718116 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 352/681] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:53:49 2022] GET /compute/v2.1/servers/279361ef-2171-49e1-9f33-eadbf5dc0313 => generated 1504 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:53:49.776796 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-0b78edc2-8df7-43f8-bdc2-0e1f2e2c47b9 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:49.777448 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-0b78edc2-8df7-43f8-bdc2-0e1f2e2c47b9 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] [instance: 139f7ae3-b380-4114-a566-6d496d4957f4] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:53:49.815202 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0b78edc2-8df7-43f8-bdc2-0e1f2e2c47b9 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:49.816337 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0b78edc2-8df7-43f8-bdc2-0e1f2e2c47b9 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:49.819906 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0b78edc2-8df7-43f8-bdc2-0e1f2e2c47b9 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:49.821037 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0b78edc2-8df7-43f8-bdc2-0e1f2e2c47b9 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:49.821786 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0b78edc2-8df7-43f8-bdc2-0e1f2e2c47b9 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:49.822447 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0b78edc2-8df7-43f8-bdc2-0e1f2e2c47b9 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:50.349910 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-0b78edc2-8df7-43f8-bdc2-0e1f2e2c47b9 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:53:50.363797 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-0b78edc2-8df7-43f8-bdc2-0e1f2e2c47b9 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:53:50.373209 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-0b78edc2-8df7-43f8-bdc2-0e1f2e2c47b9 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:53:50.375156 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-0b78edc2-8df7-43f8-bdc2-0e1f2e2c47b9 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] 10.222.0.26 "GET /compute/v2.1/servers/139f7ae3-b380-4114-a566-6d496d4957f4" status: 200 len: 1361 microversion: 2.25 time: 0.655409 Oct 08 20:53:50.376198 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 353/682] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:53:49 2022] GET /compute/v2.1/servers/139f7ae3-b380-4114-a566-6d496d4957f4 => generated 1361 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:53:50.381900 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-37d87500-550d-4e6f-a17e-faad599e09df tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:50.394213 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-37d87500-550d-4e6f-a17e-faad599e09df tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] [instance: 7e70d7bd-0c39-4320-916f-f99c05ec2806] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:53:50.400810 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-37d87500-550d-4e6f-a17e-faad599e09df tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:50.401348 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-37d87500-550d-4e6f-a17e-faad599e09df tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:50.401796 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-37d87500-550d-4e6f-a17e-faad599e09df tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:50.402513 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-37d87500-550d-4e6f-a17e-faad599e09df tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:50.402971 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-37d87500-550d-4e6f-a17e-faad599e09df tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:50.405234 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-37d87500-550d-4e6f-a17e-faad599e09df tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:50.976421 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-982c6855-d41e-470c-9393-3eef95a11162 tempest-FloatingIPDetailsTestJSON-117414399 tempest-FloatingIPDetailsTestJSON-117414399-project] 10.222.0.26 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 3.974971 Oct 08 20:53:50.978307 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 330/683] 10.222.0.26 () {60 vars in 1170 bytes} [Sat Oct 8 20:53:47 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 3977 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:53:50.985582 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-dfde7caa-52b2-4440-8051-517bc7e51c5a req-a63df370-4453-4664-b381-fbb1b6c39509 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e70d7bd-0c39-4320-916f-f99c05ec2806", "name": "network-vif-plugged", "status": "completed", "tag": "b4ba81f5-23a1-4960-a30e-7b870430ccad"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:53:50.998069 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-dfde7caa-52b2-4440-8051-517bc7e51c5a req-a63df370-4453-4664-b381-fbb1b6c39509 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:51.000163 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-dfde7caa-52b2-4440-8051-517bc7e51c5a req-a63df370-4453-4664-b381-fbb1b6c39509 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:51.001124 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-dfde7caa-52b2-4440-8051-517bc7e51c5a req-a63df370-4453-4664-b381-fbb1b6c39509 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:51.018328 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-dfde7caa-52b2-4440-8051-517bc7e51c5a req-a63df370-4453-4664-b381-fbb1b6c39509 service nova] Creating event network-vif-plugged:b4ba81f5-23a1-4960-a30e-7b870430ccad for instance 7e70d7bd-0c39-4320-916f-f99c05ec2806 on nch2-master-1 Oct 08 20:53:51.024114 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-dfde7caa-52b2-4440-8051-517bc7e51c5a req-a63df370-4453-4664-b381-fbb1b6c39509 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043941 Oct 08 20:53:51.028985 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-37d87500-550d-4e6f-a17e-faad599e09df tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef659f5a1a24c439528a7675bdd70f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c92fe04ab8248399d0acb932f82d607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:53:51.037772 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 331/684] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:53:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:53:51.039915 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-37d87500-550d-4e6f-a17e-faad599e09df tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] 10.222.0.26 "GET /compute/v2.1/servers/7e70d7bd-0c39-4320-916f-f99c05ec2806" status: 200 len: 1313 microversion: 2.1 time: 0.659496 Oct 08 20:53:51.044542 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-aeaabfb3-42ad-4f30-85b6-f443f8ef9aec tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:51.045982 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 354/685] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:53:50 2022] GET /compute/v2.1/servers/7e70d7bd-0c39-4320-916f-f99c05ec2806 => generated 1313 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:53:51.057566 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-aeaabfb3-42ad-4f30-85b6-f443f8ef9aec tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] [instance: 92e31b92-0af1-4da6-bc87-23978f1aedf5] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:53:51.060310 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e8bca74f-251d-43cb-9d94-b72813af2902 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:51.062008 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-e8bca74f-251d-43cb-9d94-b72813af2902 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] [instance: 279361ef-2171-49e1-9f33-eadbf5dc0313] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:53:51.069065 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-aeaabfb3-42ad-4f30-85b6-f443f8ef9aec tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:51.073354 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-aeaabfb3-42ad-4f30-85b6-f443f8ef9aec tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:51.074420 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-aeaabfb3-42ad-4f30-85b6-f443f8ef9aec tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:51.075914 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e8bca74f-251d-43cb-9d94-b72813af2902 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:51.076972 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-aeaabfb3-42ad-4f30-85b6-f443f8ef9aec tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:51.077702 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-aeaabfb3-42ad-4f30-85b6-f443f8ef9aec tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:51.078465 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e8bca74f-251d-43cb-9d94-b72813af2902 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:51.079145 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-aeaabfb3-42ad-4f30-85b6-f443f8ef9aec tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:51.079825 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e8bca74f-251d-43cb-9d94-b72813af2902 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:51.101512 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e8bca74f-251d-43cb-9d94-b72813af2902 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:51.102069 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e8bca74f-251d-43cb-9d94-b72813af2902 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:51.102531 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e8bca74f-251d-43cb-9d94-b72813af2902 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:51.194309 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-aeaabfb3-42ad-4f30-85b6-f443f8ef9aec tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:53:51.203241 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-aeaabfb3-42ad-4f30-85b6-f443f8ef9aec tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:53:51.204713 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-aeaabfb3-42ad-4f30-85b6-f443f8ef9aec tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:53:51.210984 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-aeaabfb3-42ad-4f30-85b6-f443f8ef9aec tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] 10.222.0.26 "GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5" status: 200 len: 1512 microversion: 2.91 time: 0.171808 Oct 08 20:53:51.234871 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 332/686] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:53:51 2022] GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5 => generated 1512 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:53:51.244469 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-0f0f2a6f-44a1-41e1-96a1-43fe782071cd tempest-FloatingIPDetailsTestJSON-117414399 tempest-FloatingIPDetailsTestJSON-117414399-project] Action: 'create', calling method: .version_select at 0x7f1a8d2c5820>, body: {"pool": null} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:53:51.600009 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-e8bca74f-251d-43cb-9d94-b72813af2902 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474ca64d1b1d4e30916b517645aba882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecc2dd2407b4819874bed09cb27959a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:53:51.615285 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-e8bca74f-251d-43cb-9d94-b72813af2902 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] 10.222.0.26 "GET /compute/v2.1/servers/279361ef-2171-49e1-9f33-eadbf5dc0313" status: 200 len: 1504 microversion: 2.1 time: 0.567845 Oct 08 20:53:51.616737 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 355/687] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:53:51 2022] GET /compute/v2.1/servers/279361ef-2171-49e1-9f33-eadbf5dc0313 => generated 1504 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:53:51.626809 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-c4df572f-0bff-4ac6-97a5-060d0a07073b tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:51.627669 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-c4df572f-0bff-4ac6-97a5-060d0a07073b tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] [instance: 139f7ae3-b380-4114-a566-6d496d4957f4] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:53:51.645958 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c4df572f-0bff-4ac6-97a5-060d0a07073b tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:51.646502 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c4df572f-0bff-4ac6-97a5-060d0a07073b tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:51.646955 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c4df572f-0bff-4ac6-97a5-060d0a07073b tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:51.647688 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c4df572f-0bff-4ac6-97a5-060d0a07073b tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:51.648158 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c4df572f-0bff-4ac6-97a5-060d0a07073b tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:51.648590 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c4df572f-0bff-4ac6-97a5-060d0a07073b tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:52.022851 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-c4df572f-0bff-4ac6-97a5-060d0a07073b tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:53:52.037402 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-c4df572f-0bff-4ac6-97a5-060d0a07073b tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:53:52.039124 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-c4df572f-0bff-4ac6-97a5-060d0a07073b tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:53:52.041465 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-c4df572f-0bff-4ac6-97a5-060d0a07073b tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] 10.222.0.26 "GET /compute/v2.1/servers/139f7ae3-b380-4114-a566-6d496d4957f4" status: 200 len: 1361 microversion: 2.25 time: 0.423519 Oct 08 20:53:52.042262 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 356/688] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:53:51 2022] GET /compute/v2.1/servers/139f7ae3-b380-4114-a566-6d496d4957f4 => generated 1361 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:53:52.075085 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-44f7959f-69b3-49ee-af20-8185f3d16812 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:52.076034 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-44f7959f-69b3-49ee-af20-8185f3d16812 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] [instance: 7e70d7bd-0c39-4320-916f-f99c05ec2806] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:53:52.084966 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-44f7959f-69b3-49ee-af20-8185f3d16812 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:52.085812 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-44f7959f-69b3-49ee-af20-8185f3d16812 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:52.086426 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-44f7959f-69b3-49ee-af20-8185f3d16812 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:52.087332 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-44f7959f-69b3-49ee-af20-8185f3d16812 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:52.087990 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-44f7959f-69b3-49ee-af20-8185f3d16812 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:52.089029 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-44f7959f-69b3-49ee-af20-8185f3d16812 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:52.432366 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-44f7959f-69b3-49ee-af20-8185f3d16812 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef659f5a1a24c439528a7675bdd70f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c92fe04ab8248399d0acb932f82d607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:53:52.447756 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-44f7959f-69b3-49ee-af20-8185f3d16812 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] 10.222.0.26 "GET /compute/v2.1/servers/7e70d7bd-0c39-4320-916f-f99c05ec2806" status: 200 len: 1313 microversion: 2.1 time: 0.377409 Oct 08 20:53:52.457559 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 357/689] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:53:52 2022] GET /compute/v2.1/servers/7e70d7bd-0c39-4320-916f-f99c05ec2806 => generated 1313 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:53:52.478165 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-87f2348d-52c6-4c62-8b61-f6383b4aa4af tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:52.482172 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-87f2348d-52c6-4c62-8b61-f6383b4aa4af tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] [instance: 92e31b92-0af1-4da6-bc87-23978f1aedf5] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:53:52.510868 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-87f2348d-52c6-4c62-8b61-f6383b4aa4af tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:52.511643 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-87f2348d-52c6-4c62-8b61-f6383b4aa4af tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:52.513799 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-87f2348d-52c6-4c62-8b61-f6383b4aa4af tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:52.515450 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-87f2348d-52c6-4c62-8b61-f6383b4aa4af tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:52.516522 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-87f2348d-52c6-4c62-8b61-f6383b4aa4af tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:52.517976 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-87f2348d-52c6-4c62-8b61-f6383b4aa4af tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:52.914153 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-87f2348d-52c6-4c62-8b61-f6383b4aa4af tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:53:52.937222 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-87f2348d-52c6-4c62-8b61-f6383b4aa4af tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:53:52.939192 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-87f2348d-52c6-4c62-8b61-f6383b4aa4af tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:53:52.962835 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-87f2348d-52c6-4c62-8b61-f6383b4aa4af tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] 10.222.0.26 "GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5" status: 200 len: 1512 microversion: 2.91 time: 0.502274 Oct 08 20:53:52.964441 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 358/690] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:53:52 2022] GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5 => generated 1512 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:53:52.990740 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-7f9ba0d0-97e1-4f5b-bc35-07deab88b5ca tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:52.993242 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-7f9ba0d0-97e1-4f5b-bc35-07deab88b5ca tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] [instance: 279361ef-2171-49e1-9f33-eadbf5dc0313] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:53:53.016496 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7f9ba0d0-97e1-4f5b-bc35-07deab88b5ca tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:53.021929 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7f9ba0d0-97e1-4f5b-bc35-07deab88b5ca tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:53.022752 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7f9ba0d0-97e1-4f5b-bc35-07deab88b5ca tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:53.025557 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7f9ba0d0-97e1-4f5b-bc35-07deab88b5ca tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:53.027088 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7f9ba0d0-97e1-4f5b-bc35-07deab88b5ca tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:53.029490 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7f9ba0d0-97e1-4f5b-bc35-07deab88b5ca tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:53.346362 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-7f9ba0d0-97e1-4f5b-bc35-07deab88b5ca tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474ca64d1b1d4e30916b517645aba882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecc2dd2407b4819874bed09cb27959a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:53:53.367897 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-7f9ba0d0-97e1-4f5b-bc35-07deab88b5ca tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] 10.222.0.26 "GET /compute/v2.1/servers/279361ef-2171-49e1-9f33-eadbf5dc0313" status: 200 len: 1504 microversion: 2.1 time: 0.400423 Oct 08 20:53:53.370756 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 359/691] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:53:52 2022] GET /compute/v2.1/servers/279361ef-2171-49e1-9f33-eadbf5dc0313 => generated 1504 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:53:53.386595 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-36552a62-6f52-437b-84bb-7502d94e68d6 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:53.416132 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-36552a62-6f52-437b-84bb-7502d94e68d6 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] [instance: 139f7ae3-b380-4114-a566-6d496d4957f4] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:53:53.428807 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-36552a62-6f52-437b-84bb-7502d94e68d6 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:53.429685 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-36552a62-6f52-437b-84bb-7502d94e68d6 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:53.430432 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-36552a62-6f52-437b-84bb-7502d94e68d6 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:53.432422 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-36552a62-6f52-437b-84bb-7502d94e68d6 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:53.434219 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-36552a62-6f52-437b-84bb-7502d94e68d6 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:53.434863 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-36552a62-6f52-437b-84bb-7502d94e68d6 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:53.491395 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=100 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:53:53.802399 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-36552a62-6f52-437b-84bb-7502d94e68d6 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:53:53.813968 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-36552a62-6f52-437b-84bb-7502d94e68d6 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:53:53.816234 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-36552a62-6f52-437b-84bb-7502d94e68d6 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:53:53.817994 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-36552a62-6f52-437b-84bb-7502d94e68d6 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] 10.222.0.26 "GET /compute/v2.1/servers/139f7ae3-b380-4114-a566-6d496d4957f4" status: 200 len: 1361 microversion: 2.25 time: 0.445932 Oct 08 20:53:53.819146 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 360/692] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:53:53 2022] GET /compute/v2.1/servers/139f7ae3-b380-4114-a566-6d496d4957f4 => generated 1361 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:53:53.825674 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-001ca51b-ce54-4a13-8a8e-3b14e9905702 req-b1ff1d46-4c1e-45be-8e9f-b73193f88627 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "139f7ae3-b380-4114-a566-6d496d4957f4", "name": "network-vif-plugged", "status": "completed", "tag": "34b7dd73-89eb-4b12-ac78-40ef20772247"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:53:53.838522 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-001ca51b-ce54-4a13-8a8e-3b14e9905702 req-b1ff1d46-4c1e-45be-8e9f-b73193f88627 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:53.839233 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-001ca51b-ce54-4a13-8a8e-3b14e9905702 req-b1ff1d46-4c1e-45be-8e9f-b73193f88627 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:53.839989 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-001ca51b-ce54-4a13-8a8e-3b14e9905702 req-b1ff1d46-4c1e-45be-8e9f-b73193f88627 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:53.859288 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-001ca51b-ce54-4a13-8a8e-3b14e9905702 req-b1ff1d46-4c1e-45be-8e9f-b73193f88627 service nova] Creating event network-vif-plugged:34b7dd73-89eb-4b12-ac78-40ef20772247 for instance 139f7ae3-b380-4114-a566-6d496d4957f4 on nch1-master-1 Oct 08 20:53:53.866279 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-001ca51b-ce54-4a13-8a8e-3b14e9905702 req-b1ff1d46-4c1e-45be-8e9f-b73193f88627 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045623 Oct 08 20:53:53.867890 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 361/693] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:53:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:53:53.874357 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-ff7cea9a-56ed-46a1-af75-6a48e60f30be tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:53.875396 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-ff7cea9a-56ed-46a1-af75-6a48e60f30be tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] [instance: 7e70d7bd-0c39-4320-916f-f99c05ec2806] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:53:53.884497 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ff7cea9a-56ed-46a1-af75-6a48e60f30be tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:53.885444 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ff7cea9a-56ed-46a1-af75-6a48e60f30be tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:53.886354 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ff7cea9a-56ed-46a1-af75-6a48e60f30be tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:53.887489 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ff7cea9a-56ed-46a1-af75-6a48e60f30be tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:53.888249 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ff7cea9a-56ed-46a1-af75-6a48e60f30be tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:53.889374 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ff7cea9a-56ed-46a1-af75-6a48e60f30be tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:54.090573 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-0f0f2a6f-44a1-41e1-96a1-43fe782071cd tempest-FloatingIPDetailsTestJSON-117414399 tempest-FloatingIPDetailsTestJSON-117414399-project] 10.222.0.26 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.854062 Oct 08 20:53:54.091182 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 333/694] 10.222.0.26 () {60 vars in 1170 bytes} [Sat Oct 8 20:53:51 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2855 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:53:54.096182 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-4f07cbb6-7f03-4f05-922b-0da103e73523 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:54.096800 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-4f07cbb6-7f03-4f05-922b-0da103e73523 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] [instance: 92e31b92-0af1-4da6-bc87-23978f1aedf5] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:53:54.109943 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4f07cbb6-7f03-4f05-922b-0da103e73523 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:54.110741 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4f07cbb6-7f03-4f05-922b-0da103e73523 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:54.111443 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4f07cbb6-7f03-4f05-922b-0da103e73523 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:54.112839 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4f07cbb6-7f03-4f05-922b-0da103e73523 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:54.113853 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4f07cbb6-7f03-4f05-922b-0da103e73523 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:54.114494 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4f07cbb6-7f03-4f05-922b-0da103e73523 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:54.200651 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-4f07cbb6-7f03-4f05-922b-0da103e73523 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:53:54.210734 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-4f07cbb6-7f03-4f05-922b-0da103e73523 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:53:54.212160 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-4f07cbb6-7f03-4f05-922b-0da103e73523 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:53:54.219500 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-4f07cbb6-7f03-4f05-922b-0da103e73523 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] 10.222.0.26 "GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5" status: 200 len: 1533 microversion: 2.91 time: 0.126955 Oct 08 20:53:54.220485 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 334/695] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:53:54 2022] GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5 => generated 1533 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:53:54.225505 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-63af96b3-c221-4ec1-84f5-e862c435741b tempest-FloatingIPDetailsTestJSON-117414399 tempest-FloatingIPDetailsTestJSON-117414399-project] Action: 'create', calling method: .version_select at 0x7f1a8d164940>, body: {"pool": null} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:53:54.582505 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-ff7cea9a-56ed-46a1-af75-6a48e60f30be tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef659f5a1a24c439528a7675bdd70f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c92fe04ab8248399d0acb932f82d607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:53:54.592894 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-ff7cea9a-56ed-46a1-af75-6a48e60f30be tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] 10.222.0.26 "GET /compute/v2.1/servers/7e70d7bd-0c39-4320-916f-f99c05ec2806" status: 200 len: 1463 microversion: 2.1 time: 0.722946 Oct 08 20:53:54.598556 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 362/696] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:53:53 2022] GET /compute/v2.1/servers/7e70d7bd-0c39-4320-916f-f99c05ec2806 => generated 1463 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:53:55.048829 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-4fab967b-6c22-449b-8315-95794a06506d tempest-UnshelveToHostMultiNodesTest-675009540 tempest-UnshelveToHostMultiNodesTest-675009540-project-admin] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:55.050253 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-4fab967b-6c22-449b-8315-95794a06506d tempest-UnshelveToHostMultiNodesTest-675009540 tempest-UnshelveToHostMultiNodesTest-675009540-project-admin] [instance: 92e31b92-0af1-4da6-bc87-23978f1aedf5] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:53:55.069461 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4fab967b-6c22-449b-8315-95794a06506d tempest-UnshelveToHostMultiNodesTest-675009540 tempest-UnshelveToHostMultiNodesTest-675009540-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:55.070758 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4fab967b-6c22-449b-8315-95794a06506d tempest-UnshelveToHostMultiNodesTest-675009540 tempest-UnshelveToHostMultiNodesTest-675009540-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:55.071226 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4fab967b-6c22-449b-8315-95794a06506d tempest-UnshelveToHostMultiNodesTest-675009540 tempest-UnshelveToHostMultiNodesTest-675009540-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:55.075621 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4fab967b-6c22-449b-8315-95794a06506d tempest-UnshelveToHostMultiNodesTest-675009540 tempest-UnshelveToHostMultiNodesTest-675009540-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:55.079346 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4fab967b-6c22-449b-8315-95794a06506d tempest-UnshelveToHostMultiNodesTest-675009540 tempest-UnshelveToHostMultiNodesTest-675009540-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:55.079905 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4fab967b-6c22-449b-8315-95794a06506d tempest-UnshelveToHostMultiNodesTest-675009540 tempest-UnshelveToHostMultiNodesTest-675009540-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:55.299124 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.objects.instance [None req-4fab967b-6c22-449b-8315-95794a06506d tempest-UnshelveToHostMultiNodesTest-675009540 tempest-UnshelveToHostMultiNodesTest-675009540-project-admin] Lazy-loading 'services' on Instance uuid 92e31b92-0af1-4da6-bc87-23978f1aedf5 {{(pid=140492) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 20:53:55.345644 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-4fab967b-6c22-449b-8315-95794a06506d tempest-UnshelveToHostMultiNodesTest-675009540 tempest-UnshelveToHostMultiNodesTest-675009540-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5" status: 200 len: 1938 microversion: 2.91 time: 0.745657 Oct 08 20:53:55.346954 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 363/697] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:53:54 2022] GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5 => generated 1938 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:53:55.357698 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-012194af-c55b-4278-ad75-08dcf3d9bdb8 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:55.359056 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-012194af-c55b-4278-ad75-08dcf3d9bdb8 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] [instance: 279361ef-2171-49e1-9f33-eadbf5dc0313] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:53:55.365589 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-012194af-c55b-4278-ad75-08dcf3d9bdb8 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:55.366339 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-012194af-c55b-4278-ad75-08dcf3d9bdb8 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:55.367011 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-012194af-c55b-4278-ad75-08dcf3d9bdb8 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:55.368000 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-012194af-c55b-4278-ad75-08dcf3d9bdb8 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:55.368677 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-012194af-c55b-4278-ad75-08dcf3d9bdb8 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:55.369303 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-012194af-c55b-4278-ad75-08dcf3d9bdb8 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:55.668996 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-012194af-c55b-4278-ad75-08dcf3d9bdb8 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474ca64d1b1d4e30916b517645aba882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecc2dd2407b4819874bed09cb27959a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:53:55.693865 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-012194af-c55b-4278-ad75-08dcf3d9bdb8 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] 10.222.0.26 "GET /compute/v2.1/servers/279361ef-2171-49e1-9f33-eadbf5dc0313" status: 200 len: 1494 microversion: 2.1 time: 0.345604 Oct 08 20:53:55.697996 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 364/698] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:53:55 2022] GET /compute/v2.1/servers/279361ef-2171-49e1-9f33-eadbf5dc0313 => generated 1494 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:53:55.919424 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-06fe0177-3276-4c3b-bfd2-29ac39e00a85 tempest-ServersAdminTestJSON-1467382604 tempest-ServersAdminTestJSON-1467382604-project-admin] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:55.925785 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-06fe0177-3276-4c3b-bfd2-29ac39e00a85 tempest-ServersAdminTestJSON-1467382604 tempest-ServersAdminTestJSON-1467382604-project-admin] Searching by: {'deleted': False, 'project_id': 'c03273e2eef34c34b49e692cbc851d3f'} {{(pid=140492) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 08 20:53:55.932571 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-06fe0177-3276-4c3b-bfd2-29ac39e00a85 tempest-ServersAdminTestJSON-1467382604 tempest-ServersAdminTestJSON-1467382604-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:55.935117 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-06fe0177-3276-4c3b-bfd2-29ac39e00a85 tempest-ServersAdminTestJSON-1467382604 tempest-ServersAdminTestJSON-1467382604-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:55.936804 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-06fe0177-3276-4c3b-bfd2-29ac39e00a85 tempest-ServersAdminTestJSON-1467382604 tempest-ServersAdminTestJSON-1467382604-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:55.938321 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-06fe0177-3276-4c3b-bfd2-29ac39e00a85 tempest-ServersAdminTestJSON-1467382604 tempest-ServersAdminTestJSON-1467382604-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:55.939361 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-06fe0177-3276-4c3b-bfd2-29ac39e00a85 tempest-ServersAdminTestJSON-1467382604 tempest-ServersAdminTestJSON-1467382604-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:55.940443 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-06fe0177-3276-4c3b-bfd2-29ac39e00a85 tempest-ServersAdminTestJSON-1467382604 tempest-ServersAdminTestJSON-1467382604-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:56.140305 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-06fe0177-3276-4c3b-bfd2-29ac39e00a85 tempest-ServersAdminTestJSON-1467382604 tempest-ServersAdminTestJSON-1467382604-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.423048 Oct 08 20:53:56.141429 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 365/699] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Oct 8 20:53:55 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 08 20:53:56.157848 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-1589ff88-5363-44a2-ab1a-6f4d4814eb0b tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:56.159949 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-1589ff88-5363-44a2-ab1a-6f4d4814eb0b tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] [instance: 139f7ae3-b380-4114-a566-6d496d4957f4] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:53:56.169941 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1589ff88-5363-44a2-ab1a-6f4d4814eb0b tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:56.171336 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1589ff88-5363-44a2-ab1a-6f4d4814eb0b tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:56.172861 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1589ff88-5363-44a2-ab1a-6f4d4814eb0b tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:56.174604 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1589ff88-5363-44a2-ab1a-6f4d4814eb0b tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:56.174604 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1589ff88-5363-44a2-ab1a-6f4d4814eb0b tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:56.174841 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1589ff88-5363-44a2-ab1a-6f4d4814eb0b tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:56.588388 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-1589ff88-5363-44a2-ab1a-6f4d4814eb0b tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:53:56.604347 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-1589ff88-5363-44a2-ab1a-6f4d4814eb0b tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:53:56.604347 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-1589ff88-5363-44a2-ab1a-6f4d4814eb0b tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:53:56.604609 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-1589ff88-5363-44a2-ab1a-6f4d4814eb0b tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] 10.222.0.26 "GET /compute/v2.1/servers/139f7ae3-b380-4114-a566-6d496d4957f4" status: 200 len: 1558 microversion: 2.25 time: 0.461917 Oct 08 20:53:56.604976 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 366/700] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:53:56 2022] GET /compute/v2.1/servers/139f7ae3-b380-4114-a566-6d496d4957f4 => generated 1558 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:53:56.610668 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-af5f78a7-2b32-4b5c-91c3-09d4640f0544 tempest-UnshelveToHostMultiNodesTest-675009540 tempest-UnshelveToHostMultiNodesTest-675009540-project-admin] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:56.611294 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-af5f78a7-2b32-4b5c-91c3-09d4640f0544 tempest-UnshelveToHostMultiNodesTest-675009540 tempest-UnshelveToHostMultiNodesTest-675009540-project-admin] [instance: 92e31b92-0af1-4da6-bc87-23978f1aedf5] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:53:56.626716 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-af5f78a7-2b32-4b5c-91c3-09d4640f0544 tempest-UnshelveToHostMultiNodesTest-675009540 tempest-UnshelveToHostMultiNodesTest-675009540-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:56.627512 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-af5f78a7-2b32-4b5c-91c3-09d4640f0544 tempest-UnshelveToHostMultiNodesTest-675009540 tempest-UnshelveToHostMultiNodesTest-675009540-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:56.627963 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-af5f78a7-2b32-4b5c-91c3-09d4640f0544 tempest-UnshelveToHostMultiNodesTest-675009540 tempest-UnshelveToHostMultiNodesTest-675009540-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:56.629380 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-af5f78a7-2b32-4b5c-91c3-09d4640f0544 tempest-UnshelveToHostMultiNodesTest-675009540 tempest-UnshelveToHostMultiNodesTest-675009540-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:56.637161 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-af5f78a7-2b32-4b5c-91c3-09d4640f0544 tempest-UnshelveToHostMultiNodesTest-675009540 tempest-UnshelveToHostMultiNodesTest-675009540-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:56.637950 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-af5f78a7-2b32-4b5c-91c3-09d4640f0544 tempest-UnshelveToHostMultiNodesTest-675009540 tempest-UnshelveToHostMultiNodesTest-675009540-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:56.788506 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.objects.instance [None req-af5f78a7-2b32-4b5c-91c3-09d4640f0544 tempest-UnshelveToHostMultiNodesTest-675009540 tempest-UnshelveToHostMultiNodesTest-675009540-project-admin] Lazy-loading 'services' on Instance uuid 92e31b92-0af1-4da6-bc87-23978f1aedf5 {{(pid=140492) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 20:53:56.818965 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-af5f78a7-2b32-4b5c-91c3-09d4640f0544 tempest-UnshelveToHostMultiNodesTest-675009540 tempest-UnshelveToHostMultiNodesTest-675009540-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5" status: 200 len: 1938 microversion: 2.91 time: 0.211316 Oct 08 20:53:56.821577 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 367/701] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:53:56 2022] GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5 => generated 1938 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:53:56.833637 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-ae60ff7b-0ad0-4807-9c1a-a2042f8d4c31 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Calling method '.version_select at 0x7f1a8cf680d0>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:56.838247 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ae60ff7b-0ad0-4807-9c1a-a2042f8d4c31 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:56.838904 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ae60ff7b-0ad0-4807-9c1a-a2042f8d4c31 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:56.839526 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ae60ff7b-0ad0-4807-9c1a-a2042f8d4c31 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:56.866197 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-ae60ff7b-0ad0-4807-9c1a-a2042f8d4c31 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] 10.222.0.26 "GET /compute/v2.1/os-migrations" status: 200 len: 400 microversion: 2.1 time: 0.041012 Oct 08 20:53:56.867528 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 368/702] 10.222.0.26 () {58 vars in 1143 bytes} [Sat Oct 8 20:53:56 2022] GET /compute/v2.1/os-migrations => generated 400 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:53:56.872989 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-4090092a-bd3b-48d3-9132-07bb483a7900 tempest-ServersAdminTestJSON-1467382604 tempest-ServersAdminTestJSON-1467382604-project-admin] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:56.880763 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-4090092a-bd3b-48d3-9132-07bb483a7900 tempest-ServersAdminTestJSON-1467382604 tempest-ServersAdminTestJSON-1467382604-project-admin] Searching by: {'deleted': False} {{(pid=140492) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 08 20:53:56.887790 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4090092a-bd3b-48d3-9132-07bb483a7900 tempest-ServersAdminTestJSON-1467382604 tempest-ServersAdminTestJSON-1467382604-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:56.888494 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4090092a-bd3b-48d3-9132-07bb483a7900 tempest-ServersAdminTestJSON-1467382604 tempest-ServersAdminTestJSON-1467382604-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:56.889137 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4090092a-bd3b-48d3-9132-07bb483a7900 tempest-ServersAdminTestJSON-1467382604 tempest-ServersAdminTestJSON-1467382604-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:56.890130 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4090092a-bd3b-48d3-9132-07bb483a7900 tempest-ServersAdminTestJSON-1467382604 tempest-ServersAdminTestJSON-1467382604-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:56.890878 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4090092a-bd3b-48d3-9132-07bb483a7900 tempest-ServersAdminTestJSON-1467382604 tempest-ServersAdminTestJSON-1467382604-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:56.891466 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4090092a-bd3b-48d3-9132-07bb483a7900 tempest-ServersAdminTestJSON-1467382604 tempest-ServersAdminTestJSON-1467382604-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:57.122618 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.multi_cell_list [None req-4090092a-bd3b-48d3-9132-07bb483a7900 tempest-ServersAdminTestJSON-1467382604 tempest-ServersAdminTestJSON-1467382604-project-admin] Listed batch of 7 results from cell out of 1000 limit. Returned 7 total so far. {{(pid=140492) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 08 20:53:57.418899 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4090092a-bd3b-48d3-9132-07bb483a7900 tempest-ServersAdminTestJSON-1467382604 tempest-ServersAdminTestJSON-1467382604-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:57.423807 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4090092a-bd3b-48d3-9132-07bb483a7900 tempest-ServersAdminTestJSON-1467382604 tempest-ServersAdminTestJSON-1467382604-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:57.424398 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4090092a-bd3b-48d3-9132-07bb483a7900 tempest-ServersAdminTestJSON-1467382604 tempest-ServersAdminTestJSON-1467382604-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:57.718401 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-63af96b3-c221-4ec1-84f5-e862c435741b tempest-FloatingIPDetailsTestJSON-117414399 tempest-FloatingIPDetailsTestJSON-117414399-project] 10.222.0.26 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.496650 Oct 08 20:53:57.719006 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 335/703] 10.222.0.26 () {60 vars in 1170 bytes} [Sat Oct 8 20:53:54 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3498 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:53:57.997886 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-9e823e13-7e05-4c15-916a-91a1e4504541 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:57.998618 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-9e823e13-7e05-4c15-916a-91a1e4504541 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] [instance: 139f7ae3-b380-4114-a566-6d496d4957f4] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:53:58.010124 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9e823e13-7e05-4c15-916a-91a1e4504541 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:58.016188 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9e823e13-7e05-4c15-916a-91a1e4504541 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:58.016969 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9e823e13-7e05-4c15-916a-91a1e4504541 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:58.017852 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9e823e13-7e05-4c15-916a-91a1e4504541 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:58.018301 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9e823e13-7e05-4c15-916a-91a1e4504541 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:58.018712 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9e823e13-7e05-4c15-916a-91a1e4504541 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:58.332055 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-4090092a-bd3b-48d3-9132-07bb483a7900 tempest-ServersAdminTestJSON-1467382604 tempest-ServersAdminTestJSON-1467382604-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 11410 microversion: 2.1 time: 1.462886 Oct 08 20:53:58.332492 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 369/704] 10.222.0.26 () {58 vars in 1171 bytes} [Sat Oct 8 20:53:56 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 11410 bytes in 1464 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 08 20:53:58.364389 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-655117db-ba82-4068-b5ea-34d317599f9f tempest-UnshelveToHostMultiNodesTest-675009540 tempest-UnshelveToHostMultiNodesTest-675009540-project-admin] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:58.376110 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-655117db-ba82-4068-b5ea-34d317599f9f tempest-UnshelveToHostMultiNodesTest-675009540 tempest-UnshelveToHostMultiNodesTest-675009540-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:58.376500 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.objects.instance [None req-9e823e13-7e05-4c15-916a-91a1e4504541 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Lazy-loading 'services' on Instance uuid 139f7ae3-b380-4114-a566-6d496d4957f4 {{(pid=140491) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 20:53:58.379546 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-655117db-ba82-4068-b5ea-34d317599f9f tempest-UnshelveToHostMultiNodesTest-675009540 tempest-UnshelveToHostMultiNodesTest-675009540-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:58.380235 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-655117db-ba82-4068-b5ea-34d317599f9f tempest-UnshelveToHostMultiNodesTest-675009540 tempest-UnshelveToHostMultiNodesTest-675009540-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:58.383469 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-655117db-ba82-4068-b5ea-34d317599f9f tempest-UnshelveToHostMultiNodesTest-675009540 tempest-UnshelveToHostMultiNodesTest-675009540-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:58.384165 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-655117db-ba82-4068-b5ea-34d317599f9f tempest-UnshelveToHostMultiNodesTest-675009540 tempest-UnshelveToHostMultiNodesTest-675009540-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:58.384776 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-655117db-ba82-4068-b5ea-34d317599f9f tempest-UnshelveToHostMultiNodesTest-675009540 tempest-UnshelveToHostMultiNodesTest-675009540-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:58.428729 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-9e823e13-7e05-4c15-916a-91a1e4504541 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/139f7ae3-b380-4114-a566-6d496d4957f4" status: 200 len: 2050 microversion: 2.25 time: 0.708474 Oct 08 20:53:58.430051 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 336/705] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:53:57 2022] GET /compute/v2.1/servers/139f7ae3-b380-4114-a566-6d496d4957f4 => generated 2050 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:53:58.440856 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-56396ca8-fb5d-47f6-8c01-7c6c3137db80 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:58.441780 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-56396ca8-fb5d-47f6-8c01-7c6c3137db80 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] [instance: 279361ef-2171-49e1-9f33-eadbf5dc0313] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:53:58.448397 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-56396ca8-fb5d-47f6-8c01-7c6c3137db80 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:58.449329 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-56396ca8-fb5d-47f6-8c01-7c6c3137db80 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:58.452523 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-56396ca8-fb5d-47f6-8c01-7c6c3137db80 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:58.453604 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-56396ca8-fb5d-47f6-8c01-7c6c3137db80 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:58.454269 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-56396ca8-fb5d-47f6-8c01-7c6c3137db80 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:58.454882 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-56396ca8-fb5d-47f6-8c01-7c6c3137db80 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:58.467199 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-655117db-ba82-4068-b5ea-34d317599f9f tempest-UnshelveToHostMultiNodesTest-675009540 tempest-UnshelveToHostMultiNodesTest-675009540-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 498 microversion: 2.91 time: 0.120597 Oct 08 20:53:58.468238 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 370/706] 10.222.0.26 () {60 vars in 1217 bytes} [Sat Oct 8 20:53:58 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 498 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 08 20:53:58.483861 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-8510576d-08d3-433e-8ff3-9008bf2212fc tempest-FloatingIPDetailsTestJSON-117414399 tempest-FloatingIPDetailsTestJSON-117414399-project] Calling method '.version_select at 0x7f1a8d2b81f0>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:58.845241 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-8510576d-08d3-433e-8ff3-9008bf2212fc tempest-FloatingIPDetailsTestJSON-117414399 tempest-FloatingIPDetailsTestJSON-117414399-project] 10.222.0.26 "GET /compute/v2.1/os-floating-ips/16a490d7-9b7d-4c47-8acf-25179c6d0da3" status: 200 len: 142 microversion: 2.1 time: 0.374773 Oct 08 20:53:58.846033 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 371/707] 10.222.0.26 () {58 vars in 1260 bytes} [Sat Oct 8 20:53:58 2022] GET /compute/v2.1/os-floating-ips/16a490d7-9b7d-4c47-8acf-25179c6d0da3 => generated 142 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:53:58.851595 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-d26e43e2-269e-4ec7-ab80-a0541cc021a1 tempest-ServersAdminTestJSON-1467382604 tempest-ServersAdminTestJSON-1467382604-project-admin] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:58.858374 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-d26e43e2-269e-4ec7-ab80-a0541cc021a1 tempest-ServersAdminTestJSON-1467382604 tempest-ServersAdminTestJSON-1467382604-project-admin] Searching by: {'deleted': False, 'project_id': 'c03273e2eef34c34b49e692cbc851d3f'} {{(pid=140492) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 08 20:53:58.859074 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-56396ca8-fb5d-47f6-8c01-7c6c3137db80 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/279361ef-2171-49e1-9f33-eadbf5dc0313" status: 200 len: 1645 microversion: 2.1 time: 0.425489 Oct 08 20:53:58.860105 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 337/708] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:53:58 2022] GET /compute/v2.1/servers/279361ef-2171-49e1-9f33-eadbf5dc0313 => generated 1645 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:53:58.867844 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-208614f4-6418-4db5-8886-a70164dfad87 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:53:58.868394 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-208614f4-6418-4db5-8886-a70164dfad87 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] [instance: 139f7ae3-b380-4114-a566-6d496d4957f4] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:53:58.871833 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d26e43e2-269e-4ec7-ab80-a0541cc021a1 tempest-ServersAdminTestJSON-1467382604 tempest-ServersAdminTestJSON-1467382604-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:58.872494 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d26e43e2-269e-4ec7-ab80-a0541cc021a1 tempest-ServersAdminTestJSON-1467382604 tempest-ServersAdminTestJSON-1467382604-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:58.873463 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d26e43e2-269e-4ec7-ab80-a0541cc021a1 tempest-ServersAdminTestJSON-1467382604 tempest-ServersAdminTestJSON-1467382604-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:58.874391 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d26e43e2-269e-4ec7-ab80-a0541cc021a1 tempest-ServersAdminTestJSON-1467382604 tempest-ServersAdminTestJSON-1467382604-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:58.875102 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d26e43e2-269e-4ec7-ab80-a0541cc021a1 tempest-ServersAdminTestJSON-1467382604 tempest-ServersAdminTestJSON-1467382604-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:58.875606 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-208614f4-6418-4db5-8886-a70164dfad87 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:58.875962 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d26e43e2-269e-4ec7-ab80-a0541cc021a1 tempest-ServersAdminTestJSON-1467382604 tempest-ServersAdminTestJSON-1467382604-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:58.877016 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-208614f4-6418-4db5-8886-a70164dfad87 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:58.877523 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-208614f4-6418-4db5-8886-a70164dfad87 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:58.878235 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-208614f4-6418-4db5-8886-a70164dfad87 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:58.878695 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-208614f4-6418-4db5-8886-a70164dfad87 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:58.879120 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-208614f4-6418-4db5-8886-a70164dfad87 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:58.914287 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:53:58.919247 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-d26e43e2-269e-4ec7-ab80-a0541cc021a1 tempest-ServersAdminTestJSON-1467382604 tempest-ServersAdminTestJSON-1467382604-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/detail?tenant_id=8c92fe04ab8248399d0acb932f82d607" status: 200 len: 15 microversion: 2.1 time: 0.071934 Oct 08 20:53:58.929795 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 372/709] 10.222.0.26 () {58 vars in 1231 bytes} [Sat Oct 8 20:53:58 2022] GET /compute/v2.1/servers/detail?tenant_id=8c92fe04ab8248399d0acb932f82d607 => generated 15 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 08 20:53:58.945388 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-c166ad56-a919-46c7-a95a-6a800b1d53fb tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:53:58.945997 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-c166ad56-a919-46c7-a95a-6a800b1d53fb tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] [instance: 92e31b92-0af1-4da6-bc87-23978f1aedf5] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:53:58.954161 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c166ad56-a919-46c7-a95a-6a800b1d53fb tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:58.954657 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c166ad56-a919-46c7-a95a-6a800b1d53fb tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:58.955102 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c166ad56-a919-46c7-a95a-6a800b1d53fb tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:58.955817 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c166ad56-a919-46c7-a95a-6a800b1d53fb tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:53:58.956274 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c166ad56-a919-46c7-a95a-6a800b1d53fb tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:53:58.956851 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c166ad56-a919-46c7-a95a-6a800b1d53fb tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:53:58.994065 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.objects.instance [None req-c166ad56-a919-46c7-a95a-6a800b1d53fb tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lazy-loading 'flavor' on Instance uuid 92e31b92-0af1-4da6-bc87-23978f1aedf5 {{(pid=140492) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 20:53:59.151162 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.objects.instance [None req-208614f4-6418-4db5-8886-a70164dfad87 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Lazy-loading 'services' on Instance uuid 139f7ae3-b380-4114-a566-6d496d4957f4 {{(pid=140491) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 20:53:59.174648 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-208614f4-6418-4db5-8886-a70164dfad87 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/139f7ae3-b380-4114-a566-6d496d4957f4" status: 200 len: 2050 microversion: 2.25 time: 0.312839 Oct 08 20:53:59.191015 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 338/710] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:53:58 2022] GET /compute/v2.1/servers/139f7ae3-b380-4114-a566-6d496d4957f4 => generated 2050 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:53:59.296709 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-21bec010-4745-4bf1-a9bb-2f20ff6fec8d tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-522396352", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "networks": [{"uuid": "9e485e42-b5e7-4f67-83fe-804b46975f2d"}]}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:53:59.378190 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.network.neutron [None req-21bec010-4745-4bf1-a9bb-2f20ff6fec8d tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] validate_networks() for [('9e485e42-b5e7-4f67-83fe-804b46975f2d', None, None, None, None, None)] {{(pid=140491) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 20:53:59.382662 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-c166ad56-a919-46c7-a95a-6a800b1d53fb tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] 10.222.0.26 "POST /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5/action" status: 202 len: 0 microversion: 2.91 time: 0.451538 Oct 08 20:53:59.384231 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 373/711] 10.222.0.26 () {62 vars in 1319 bytes} [Sat Oct 8 20:53:58 2022] POST /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5/action => generated 0 bytes in 454 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 08 20:53:59.393123 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-926be24b-c0ad-4230-b010-f58653d9cde7 tempest-FloatingIPDetailsTestJSON-117414399 tempest-FloatingIPDetailsTestJSON-117414399-project] Calling method '.version_select at 0x7f1a8cd7d700>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:00.252141 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-21bec010-4745-4bf1-a9bb-2f20ff6fec8d tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] Flavor limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 20:54:00.253394 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-21bec010-4745-4bf1-a9bb-2f20ff6fec8d tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] Image limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 20:54:00.253851 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-21bec010-4745-4bf1-a9bb-2f20ff6fec8d tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] Flavor pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 20:54:00.254449 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-21bec010-4745-4bf1-a9bb-2f20ff6fec8d tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] Image pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 20:54:00.255320 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-21bec010-4745-4bf1-a9bb-2f20ff6fec8d tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 20:54:00.270681 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-21bec010-4745-4bf1-a9bb-2f20ff6fec8d tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:00.271758 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-21bec010-4745-4bf1-a9bb-2f20ff6fec8d tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:00.272506 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-21bec010-4745-4bf1-a9bb-2f20ff6fec8d tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:00.273670 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-21bec010-4745-4bf1-a9bb-2f20ff6fec8d tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:00.274627 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-21bec010-4745-4bf1-a9bb-2f20ff6fec8d tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:00.275552 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-21bec010-4745-4bf1-a9bb-2f20ff6fec8d tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:00.300210 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-21bec010-4745-4bf1-a9bb-2f20ff6fec8d tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] Getting quotas for project 6a09d8f87c174336a1d216e396adfd33. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 20:54:00.305747 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-21bec010-4745-4bf1-a9bb-2f20ff6fec8d tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] Getting quotas for user 68e264d0c2b54a5f8d1bd197b84a104a and project 6a09d8f87c174336a1d216e396adfd33. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 20:54:00.325060 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-21bec010-4745-4bf1-a9bb-2f20ff6fec8d tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] Going to run 1 instances... {{(pid=140491) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 20:54:00.328066 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-21bec010-4745-4bf1-a9bb-2f20ff6fec8d tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] [instance: aadc9a05-66e2-45bb-8c2d-6755184a8e9c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c508bd7f-7db9-4b2c-af7c-be54a855c355',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140491) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 20:54:00.405671 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-21bec010-4745-4bf1-a9bb-2f20ff6fec8d tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.212729 Oct 08 20:54:00.408545 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 339/712] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 20:53:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 1216 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 08 20:54:00.420968 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-e6fff0a2-f532-40c9-abf6-dfd4d266c14a tempest-ServersAdminTestJSON-1467382604 tempest-ServersAdminTestJSON-1467382604-project-admin] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:00.429101 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-e6fff0a2-f532-40c9-abf6-dfd4d266c14a tempest-ServersAdminTestJSON-1467382604 tempest-ServersAdminTestJSON-1467382604-project-admin] Searching by: {'tenant_id': '8c92fe04ab8248399d0acb932f82d607', 'deleted': False} {{(pid=140491) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 08 20:54:00.460555 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e6fff0a2-f532-40c9-abf6-dfd4d266c14a tempest-ServersAdminTestJSON-1467382604 tempest-ServersAdminTestJSON-1467382604-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:00.461470 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e6fff0a2-f532-40c9-abf6-dfd4d266c14a tempest-ServersAdminTestJSON-1467382604 tempest-ServersAdminTestJSON-1467382604-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:00.462076 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e6fff0a2-f532-40c9-abf6-dfd4d266c14a tempest-ServersAdminTestJSON-1467382604 tempest-ServersAdminTestJSON-1467382604-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:00.462982 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e6fff0a2-f532-40c9-abf6-dfd4d266c14a tempest-ServersAdminTestJSON-1467382604 tempest-ServersAdminTestJSON-1467382604-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:00.463611 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e6fff0a2-f532-40c9-abf6-dfd4d266c14a tempest-ServersAdminTestJSON-1467382604 tempest-ServersAdminTestJSON-1467382604-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:00.464664 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e6fff0a2-f532-40c9-abf6-dfd4d266c14a tempest-ServersAdminTestJSON-1467382604 tempest-ServersAdminTestJSON-1467382604-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:00.592997 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.multi_cell_list [None req-e6fff0a2-f532-40c9-abf6-dfd4d266c14a tempest-ServersAdminTestJSON-1467382604 tempest-ServersAdminTestJSON-1467382604-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=140491) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 08 20:54:00.790953 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=100 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:54:00.812192 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e6fff0a2-f532-40c9-abf6-dfd4d266c14a tempest-ServersAdminTestJSON-1467382604 tempest-ServersAdminTestJSON-1467382604-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:00.812953 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e6fff0a2-f532-40c9-abf6-dfd4d266c14a tempest-ServersAdminTestJSON-1467382604 tempest-ServersAdminTestJSON-1467382604-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:00.813586 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e6fff0a2-f532-40c9-abf6-dfd4d266c14a tempest-ServersAdminTestJSON-1467382604 tempest-ServersAdminTestJSON-1467382604-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:00.836567 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-926be24b-c0ad-4230-b010-f58653d9cde7 tempest-FloatingIPDetailsTestJSON-117414399 tempest-FloatingIPDetailsTestJSON-117414399-project] 10.222.0.26 "DELETE /compute/v2.1/os-floating-ips/16a490d7-9b7d-4c47-8acf-25179c6d0da3" status: 202 len: 0 microversion: 2.1 time: 1.450358 Oct 08 20:54:00.841072 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 374/713] 10.222.0.26 () {58 vars in 1263 bytes} [Sat Oct 8 20:53:59 2022] DELETE /compute/v2.1/os-floating-ips/16a490d7-9b7d-4c47-8acf-25179c6d0da3 => generated 0 bytes in 1456 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 20:54:00.847966 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-7c1e5878-ff53-4daf-8864-865b14780fe2 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-2130798588", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "networks": [{"uuid": "2de46f56-45d8-40d9-8d29-d806b680f627"}]}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:54:00.940328 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.network.neutron [None req-7c1e5878-ff53-4daf-8864-865b14780fe2 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] validate_networks() for [('2de46f56-45d8-40d9-8d29-d806b680f627', None, None, None, None, None)] {{(pid=140492) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 20:54:01.032892 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-e6fff0a2-f532-40c9-abf6-dfd4d266c14a tempest-ServersAdminTestJSON-1467382604 tempest-ServersAdminTestJSON-1467382604-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=8c92fe04ab8248399d0acb932f82d607" status: 200 len: 4824 microversion: 2.1 time: 0.623029 Oct 08 20:54:01.033516 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 340/714] 10.222.0.26 () {58 vars in 1257 bytes} [Sat Oct 8 20:54:00 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=8c92fe04ab8248399d0acb932f82d607 => generated 4824 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:54:01.039721 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-92fc4a99-f01e-4f53-a011-0dd3d0d88cb7 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:01.044557 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-92fc4a99-f01e-4f53-a011-0dd3d0d88cb7 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:01.045090 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-92fc4a99-f01e-4f53-a011-0dd3d0d88cb7 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:01.047514 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-92fc4a99-f01e-4f53-a011-0dd3d0d88cb7 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:01.050520 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-92fc4a99-f01e-4f53-a011-0dd3d0d88cb7 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:01.054888 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-92fc4a99-f01e-4f53-a011-0dd3d0d88cb7 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:01.054888 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-92fc4a99-f01e-4f53-a011-0dd3d0d88cb7 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:01.103414 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-92fc4a99-f01e-4f53-a011-0dd3d0d88cb7 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.068586 Oct 08 20:54:01.104346 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 341/715] 10.222.0.26 () {60 vars in 1217 bytes} [Sat Oct 8 20:54:01 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 08 20:54:01.109780 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-9c29f419-de8f-4649-aea4-6bf828bbe5c4 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:01.110389 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-9c29f419-de8f-4649-aea4-6bf828bbe5c4 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] [instance: 92e31b92-0af1-4da6-bc87-23978f1aedf5] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:01.117063 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9c29f419-de8f-4649-aea4-6bf828bbe5c4 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:01.117892 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9c29f419-de8f-4649-aea4-6bf828bbe5c4 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:01.118718 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9c29f419-de8f-4649-aea4-6bf828bbe5c4 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:01.119486 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9c29f419-de8f-4649-aea4-6bf828bbe5c4 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:01.119948 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9c29f419-de8f-4649-aea4-6bf828bbe5c4 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:01.120379 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9c29f419-de8f-4649-aea4-6bf828bbe5c4 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:01.243328 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-9c29f419-de8f-4649-aea4-6bf828bbe5c4 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:01.257989 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-9c29f419-de8f-4649-aea4-6bf828bbe5c4 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:01.265539 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-9c29f419-de8f-4649-aea4-6bf828bbe5c4 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:01.271766 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-9c29f419-de8f-4649-aea4-6bf828bbe5c4 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] 10.222.0.26 "GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5" status: 200 len: 1539 microversion: 2.91 time: 0.166247 Oct 08 20:54:01.276053 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 342/716] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:54:01 2022] GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5 => generated 1539 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:54:01.286878 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-b70c878f-af36-4c4d-9121-8e5608d5a71d tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:01.290226 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-b70c878f-af36-4c4d-9121-8e5608d5a71d tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] [instance: aadc9a05-66e2-45bb-8c2d-6755184a8e9c] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:01.302905 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b70c878f-af36-4c4d-9121-8e5608d5a71d tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:01.303698 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b70c878f-af36-4c4d-9121-8e5608d5a71d tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:01.304148 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b70c878f-af36-4c4d-9121-8e5608d5a71d tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:01.305044 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b70c878f-af36-4c4d-9121-8e5608d5a71d tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:01.305648 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b70c878f-af36-4c4d-9121-8e5608d5a71d tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:01.307004 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b70c878f-af36-4c4d-9121-8e5608d5a71d tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:01.383838 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-b70c878f-af36-4c4d-9121-8e5608d5a71d tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68e264d0c2b54a5f8d1bd197b84a104a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a09d8f87c174336a1d216e396adfd33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:01.397305 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-b70c878f-af36-4c4d-9121-8e5608d5a71d tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] 10.222.0.26 "GET /compute/v2.1/servers/aadc9a05-66e2-45bb-8c2d-6755184a8e9c" status: 200 len: 1211 microversion: 2.1 time: 0.119852 Oct 08 20:54:01.397908 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 343/717] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:54:01 2022] GET /compute/v2.1/servers/aadc9a05-66e2-45bb-8c2d-6755184a8e9c => generated 1211 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:54:01.416698 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c33e1dcd-7e5b-4f16-a402-63aa05c9f187 tempest-FloatingIPDetailsTestJSON-117414399 tempest-FloatingIPDetailsTestJSON-117414399-project] Calling method '.version_select at 0x7f1a8d416dc0>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:01.789164 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-c33e1dcd-7e5b-4f16-a402-63aa05c9f187 tempest-FloatingIPDetailsTestJSON-117414399 tempest-FloatingIPDetailsTestJSON-117414399-project] 10.222.0.26 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.389262 Oct 08 20:54:01.793885 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 344/718] 10.222.0.26 () {58 vars in 1164 bytes} [Sat Oct 8 20:54:01 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 08 20:54:01.794900 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-e15290cd-8b8e-45a7-b210-4a39ebcc8a4c tempest-ServersAdminTestJSON-1467382604 tempest-ServersAdminTestJSON-1467382604-project-admin] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:01.808973 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-e15290cd-8b8e-45a7-b210-4a39ebcc8a4c tempest-ServersAdminTestJSON-1467382604 tempest-ServersAdminTestJSON-1467382604-project-admin] Searching by: {'tenant_id': 'c03273e2eef34c34b49e692cbc851d3f', 'deleted': False} {{(pid=140491) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 08 20:54:01.818871 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e15290cd-8b8e-45a7-b210-4a39ebcc8a4c tempest-ServersAdminTestJSON-1467382604 tempest-ServersAdminTestJSON-1467382604-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:01.820804 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e15290cd-8b8e-45a7-b210-4a39ebcc8a4c tempest-ServersAdminTestJSON-1467382604 tempest-ServersAdminTestJSON-1467382604-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:01.821607 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e15290cd-8b8e-45a7-b210-4a39ebcc8a4c tempest-ServersAdminTestJSON-1467382604 tempest-ServersAdminTestJSON-1467382604-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:01.823054 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e15290cd-8b8e-45a7-b210-4a39ebcc8a4c tempest-ServersAdminTestJSON-1467382604 tempest-ServersAdminTestJSON-1467382604-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:01.823670 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e15290cd-8b8e-45a7-b210-4a39ebcc8a4c tempest-ServersAdminTestJSON-1467382604 tempest-ServersAdminTestJSON-1467382604-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:01.824443 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e15290cd-8b8e-45a7-b210-4a39ebcc8a4c tempest-ServersAdminTestJSON-1467382604 tempest-ServersAdminTestJSON-1467382604-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:01.865095 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-e15290cd-8b8e-45a7-b210-4a39ebcc8a4c tempest-ServersAdminTestJSON-1467382604 tempest-ServersAdminTestJSON-1467382604-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=c03273e2eef34c34b49e692cbc851d3f" status: 200 len: 15 microversion: 2.1 time: 0.073686 Oct 08 20:54:01.866079 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 345/719] 10.222.0.26 () {58 vars in 1257 bytes} [Sat Oct 8 20:54:01 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=c03273e2eef34c34b49e692cbc851d3f => generated 15 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 08 20:54:01.882167 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-6740db51-eb19-4728-ba52-66f47bb382c7 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": "auto"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:54:01.886407 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-6740db51-eb19-4728-ba52-66f47bb382c7 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] [instance: 139f7ae3-b380-4114-a566-6d496d4957f4] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:01.893957 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6740db51-eb19-4728-ba52-66f47bb382c7 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:01.894751 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6740db51-eb19-4728-ba52-66f47bb382c7 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:01.895353 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6740db51-eb19-4728-ba52-66f47bb382c7 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:01.896247 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6740db51-eb19-4728-ba52-66f47bb382c7 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:01.896990 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6740db51-eb19-4728-ba52-66f47bb382c7 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:01.897620 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6740db51-eb19-4728-ba52-66f47bb382c7 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:01.922613 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-7c1e5878-ff53-4daf-8864-865b14780fe2 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Flavor limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 20:54:01.923881 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-7c1e5878-ff53-4daf-8864-865b14780fe2 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Image limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 20:54:01.924532 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-7c1e5878-ff53-4daf-8864-865b14780fe2 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Flavor pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 20:54:01.924946 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-7c1e5878-ff53-4daf-8864-865b14780fe2 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Image pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 20:54:01.925400 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-7c1e5878-ff53-4daf-8864-865b14780fe2 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 20:54:01.937299 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7c1e5878-ff53-4daf-8864-865b14780fe2 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:01.938615 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7c1e5878-ff53-4daf-8864-865b14780fe2 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:01.939266 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7c1e5878-ff53-4daf-8864-865b14780fe2 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:01.946386 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7c1e5878-ff53-4daf-8864-865b14780fe2 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:01.948338 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7c1e5878-ff53-4daf-8864-865b14780fe2 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:01.951888 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7c1e5878-ff53-4daf-8864-865b14780fe2 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:02.008403 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.objects.instance [None req-6740db51-eb19-4728-ba52-66f47bb382c7 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Lazy-loading 'flavor' on Instance uuid 139f7ae3-b380-4114-a566-6d496d4957f4 {{(pid=140491) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 20:54:02.029306 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-7c1e5878-ff53-4daf-8864-865b14780fe2 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Getting quotas for project 6ecc2dd2407b4819874bed09cb27959a. Resources: {'cores', 'instances', 'ram'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 20:54:02.032427 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-6740db51-eb19-4728-ba52-66f47bb382c7 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] [instance: 139f7ae3-b380-4114-a566-6d496d4957f4] Going to try to live migrate instance to nch2-master-1 {{(pid=140491) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 08 20:54:02.049467 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-7c1e5878-ff53-4daf-8864-865b14780fe2 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Getting quotas for user 474ca64d1b1d4e30916b517645aba882 and project 6ecc2dd2407b4819874bed09cb27959a. Resources: {'cores', 'instances', 'ram'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 20:54:02.079398 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-7c1e5878-ff53-4daf-8864-865b14780fe2 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Going to run 1 instances... {{(pid=140492) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 20:54:02.090330 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-7c1e5878-ff53-4daf-8864-865b14780fe2 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] [instance: a80fbf87-8203-4e6c-bee7-fe781bfccff1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c508bd7f-7db9-4b2c-af7c-be54a855c355',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140492) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 20:54:02.241823 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-7c1e5878-ff53-4daf-8864-865b14780fe2 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.395896 Oct 08 20:54:02.242968 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 375/720] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 20:54:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1401 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 08 20:54:02.255099 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-5ac8e994-4bab-43c4-bbd7-e740b5429844 tempest-FloatingIPDetailsTestJSON-117414399 tempest-FloatingIPDetailsTestJSON-117414399-project] Calling method '.version_select at 0x7f1a8cacf280>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:02.931048 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-5ac8e994-4bab-43c4-bbd7-e740b5429844 tempest-FloatingIPDetailsTestJSON-117414399 tempest-FloatingIPDetailsTestJSON-117414399-project] 10.222.0.26 "GET /compute/v2.1/os-floating-ips" status: 200 len: 397 microversion: 2.1 time: 0.686711 Oct 08 20:54:02.932605 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 376/721] 10.222.0.26 () {58 vars in 1149 bytes} [Sat Oct 8 20:54:02 2022] GET /compute/v2.1/os-floating-ips => generated 397 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:54:02.941616 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-eb52bb90-3ec9-46cc-ba8c-67c7f8ea3759 tempest-ServersAdminTestJSON-1467382604 tempest-ServersAdminTestJSON-1467382604-project-admin] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:02.955790 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-eb52bb90-3ec9-46cc-ba8c-67c7f8ea3759 tempest-ServersAdminTestJSON-1467382604 tempest-ServersAdminTestJSON-1467382604-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.020002 Oct 08 20:54:02.963246 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 377/722] 10.222.0.26 () {58 vars in 1189 bytes} [Sat Oct 8 20:54:02 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 08 20:54:02.976905 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-d0139849-57bb-41ae-9ace-3d3135a76c4e tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:02.982622 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-d0139849-57bb-41ae-9ace-3d3135a76c4e tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] [instance: a80fbf87-8203-4e6c-bee7-fe781bfccff1] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:03.111846 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-d0139849-57bb-41ae-9ace-3d3135a76c4e tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474ca64d1b1d4e30916b517645aba882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecc2dd2407b4819874bed09cb27959a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:03.126618 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-d0139849-57bb-41ae-9ace-3d3135a76c4e tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] 10.222.0.26 "GET /compute/v2.1/servers/a80fbf87-8203-4e6c-bee7-fe781bfccff1" status: 200 len: 1211 microversion: 2.1 time: 0.161666 Oct 08 20:54:03.127451 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 378/723] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:54:02 2022] GET /compute/v2.1/servers/a80fbf87-8203-4e6c-bee7-fe781bfccff1 => generated 1211 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:54:03.145683 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-be2e77d4-2709-47d0-a5ef-6c2f9997292c tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:03.146630 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-be2e77d4-2709-47d0-a5ef-6c2f9997292c tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] [instance: 92e31b92-0af1-4da6-bc87-23978f1aedf5] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:03.166357 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-be2e77d4-2709-47d0-a5ef-6c2f9997292c tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:03.169111 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-be2e77d4-2709-47d0-a5ef-6c2f9997292c tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:03.169842 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-be2e77d4-2709-47d0-a5ef-6c2f9997292c tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:03.172497 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-be2e77d4-2709-47d0-a5ef-6c2f9997292c tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:03.174707 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-be2e77d4-2709-47d0-a5ef-6c2f9997292c tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:03.175390 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-be2e77d4-2709-47d0-a5ef-6c2f9997292c tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:03.313310 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-be2e77d4-2709-47d0-a5ef-6c2f9997292c tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:03.331636 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-be2e77d4-2709-47d0-a5ef-6c2f9997292c tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:03.362701 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-be2e77d4-2709-47d0-a5ef-6c2f9997292c tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:03.376541 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-be2e77d4-2709-47d0-a5ef-6c2f9997292c tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] 10.222.0.26 "GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5" status: 200 len: 1539 microversion: 2.91 time: 0.243609 Oct 08 20:54:03.378380 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 379/724] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:54:03 2022] GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5 => generated 1539 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:54:03.410797 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-f2cfb5d8-2f8a-486b-aff4-c2a798fc1a87 tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:03.413537 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-f2cfb5d8-2f8a-486b-aff4-c2a798fc1a87 tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] [instance: aadc9a05-66e2-45bb-8c2d-6755184a8e9c] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:03.435679 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f2cfb5d8-2f8a-486b-aff4-c2a798fc1a87 tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:03.436227 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f2cfb5d8-2f8a-486b-aff4-c2a798fc1a87 tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:03.436673 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f2cfb5d8-2f8a-486b-aff4-c2a798fc1a87 tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:03.437436 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f2cfb5d8-2f8a-486b-aff4-c2a798fc1a87 tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:03.437890 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f2cfb5d8-2f8a-486b-aff4-c2a798fc1a87 tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:03.442604 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f2cfb5d8-2f8a-486b-aff4-c2a798fc1a87 tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:04.262275 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-f2cfb5d8-2f8a-486b-aff4-c2a798fc1a87 tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68e264d0c2b54a5f8d1bd197b84a104a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a09d8f87c174336a1d216e396adfd33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:04.272003 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-f2cfb5d8-2f8a-486b-aff4-c2a798fc1a87 tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] 10.222.0.26 "GET /compute/v2.1/servers/aadc9a05-66e2-45bb-8c2d-6755184a8e9c" status: 200 len: 1315 microversion: 2.1 time: 0.890563 Oct 08 20:54:04.272623 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 380/725] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:54:03 2022] GET /compute/v2.1/servers/aadc9a05-66e2-45bb-8c2d-6755184a8e9c => generated 1315 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:54:04.293075 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-112f5fcf-167e-4581-88ea-f40073e5c42b tempest-FloatingIPDetailsTestJSON-117414399 tempest-FloatingIPDetailsTestJSON-117414399-project] Calling method '.version_select at 0x7f1a8ca7fc10>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:05.889170 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-6740db51-eb19-4728-ba52-66f47bb382c7 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/139f7ae3-b380-4114-a566-6d496d4957f4/action" status: 202 len: 0 microversion: 2.25 time: 4.021810 Oct 08 20:54:05.893216 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 346/726] 10.222.0.26 () {62 vars in 1319 bytes} [Sat Oct 8 20:54:01 2022] POST /compute/v2.1/servers/139f7ae3-b380-4114-a566-6d496d4957f4/action => generated 0 bytes in 4026 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 08 20:54:05.899878 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-6e9152b4-be36-4ec9-b020-83c3339f6341 tempest-ServersAdminTestJSON-1467382604 tempest-ServersAdminTestJSON-1467382604-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:54:05.902214 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-6e9152b4-be36-4ec9-b020-83c3339f6341 tempest-ServersAdminTestJSON-1467382604 tempest-ServersAdminTestJSON-1467382604-project-admin] [instance: 73fd15ea-e4bd-4310-93bb-147b0a5e27ef] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:05.935669 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6e9152b4-be36-4ec9-b020-83c3339f6341 tempest-ServersAdminTestJSON-1467382604 tempest-ServersAdminTestJSON-1467382604-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:05.936232 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6e9152b4-be36-4ec9-b020-83c3339f6341 tempest-ServersAdminTestJSON-1467382604 tempest-ServersAdminTestJSON-1467382604-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:05.955713 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6e9152b4-be36-4ec9-b020-83c3339f6341 tempest-ServersAdminTestJSON-1467382604 tempest-ServersAdminTestJSON-1467382604-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:05.959417 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6e9152b4-be36-4ec9-b020-83c3339f6341 tempest-ServersAdminTestJSON-1467382604 tempest-ServersAdminTestJSON-1467382604-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:05.960381 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6e9152b4-be36-4ec9-b020-83c3339f6341 tempest-ServersAdminTestJSON-1467382604 tempest-ServersAdminTestJSON-1467382604-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:05.960996 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6e9152b4-be36-4ec9-b020-83c3339f6341 tempest-ServersAdminTestJSON-1467382604 tempest-ServersAdminTestJSON-1467382604-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:06.149151 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-6e9152b4-be36-4ec9-b020-83c3339f6341 tempest-ServersAdminTestJSON-1467382604 tempest-ServersAdminTestJSON-1467382604-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/73fd15ea-e4bd-4310-93bb-147b0a5e27ef/action" status: 202 len: 0 microversion: 2.1 time: 0.254381 Oct 08 20:54:06.151036 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 347/727] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 20:54:05 2022] POST /compute/v2.1/servers/73fd15ea-e4bd-4310-93bb-147b0a5e27ef/action => generated 0 bytes in 257 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 20:54:06.158716 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-af8baef8-65bd-4eb0-862b-8230f9f1ee0b tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:06.159895 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-af8baef8-65bd-4eb0-862b-8230f9f1ee0b tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] [instance: a80fbf87-8203-4e6c-bee7-fe781bfccff1] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:06.167328 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-af8baef8-65bd-4eb0-862b-8230f9f1ee0b tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:06.168094 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-af8baef8-65bd-4eb0-862b-8230f9f1ee0b tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:06.168696 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-af8baef8-65bd-4eb0-862b-8230f9f1ee0b tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:06.169876 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-af8baef8-65bd-4eb0-862b-8230f9f1ee0b tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:06.171101 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-af8baef8-65bd-4eb0-862b-8230f9f1ee0b tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:06.171860 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-af8baef8-65bd-4eb0-862b-8230f9f1ee0b tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:06.424259 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-af8baef8-65bd-4eb0-862b-8230f9f1ee0b tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474ca64d1b1d4e30916b517645aba882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecc2dd2407b4819874bed09cb27959a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:06.448475 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-af8baef8-65bd-4eb0-862b-8230f9f1ee0b tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] 10.222.0.26 "GET /compute/v2.1/servers/a80fbf87-8203-4e6c-bee7-fe781bfccff1" status: 200 len: 1311 microversion: 2.1 time: 0.292325 Oct 08 20:54:06.453833 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 348/728] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:54:06 2022] GET /compute/v2.1/servers/a80fbf87-8203-4e6c-bee7-fe781bfccff1 => generated 1311 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:54:06.463779 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-112f5fcf-167e-4581-88ea-f40073e5c42b tempest-FloatingIPDetailsTestJSON-117414399 tempest-FloatingIPDetailsTestJSON-117414399-project] 10.222.0.26 "DELETE /compute/v2.1/os-floating-ips/c41be419-8fed-4b4b-a172-f0a4eef78cf8" status: 202 len: 0 microversion: 2.1 time: 2.174601 Oct 08 20:54:06.464368 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 381/729] 10.222.0.26 () {58 vars in 1263 bytes} [Sat Oct 8 20:54:04 2022] DELETE /compute/v2.1/os-floating-ips/c41be419-8fed-4b4b-a172-f0a4eef78cf8 => generated 0 bytes in 2191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 20:54:06.468958 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-0563ae3d-80b2-4477-9c01-6d2ebdcca308 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:06.470047 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-0563ae3d-80b2-4477-9c01-6d2ebdcca308 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] [instance: 92e31b92-0af1-4da6-bc87-23978f1aedf5] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:06.470309 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-42cf2055-4b86-4a9d-a32c-3845852fd6ef req-53e6e949-1899-4df4-ba0f-d1097e3103b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aadc9a05-66e2-45bb-8c2d-6755184a8e9c", "tag": "30b8f676-1366-40cd-880f-839ba9c67d35"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:54:06.502014 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0563ae3d-80b2-4477-9c01-6d2ebdcca308 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:06.502635 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0563ae3d-80b2-4477-9c01-6d2ebdcca308 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:06.503160 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0563ae3d-80b2-4477-9c01-6d2ebdcca308 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:06.503690 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-42cf2055-4b86-4a9d-a32c-3845852fd6ef req-53e6e949-1899-4df4-ba0f-d1097e3103b9 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:06.504072 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0563ae3d-80b2-4477-9c01-6d2ebdcca308 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:06.504283 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-42cf2055-4b86-4a9d-a32c-3845852fd6ef req-53e6e949-1899-4df4-ba0f-d1097e3103b9 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:06.504721 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0563ae3d-80b2-4477-9c01-6d2ebdcca308 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:06.504858 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-42cf2055-4b86-4a9d-a32c-3845852fd6ef req-53e6e949-1899-4df4-ba0f-d1097e3103b9 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:06.505362 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0563ae3d-80b2-4477-9c01-6d2ebdcca308 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:06.528172 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-42cf2055-4b86-4a9d-a32c-3845852fd6ef req-53e6e949-1899-4df4-ba0f-d1097e3103b9 service nova] Creating event network-changed:30b8f676-1366-40cd-880f-839ba9c67d35 for instance aadc9a05-66e2-45bb-8c2d-6755184a8e9c on nch2-master-1 Oct 08 20:54:06.546669 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-42cf2055-4b86-4a9d-a32c-3845852fd6ef req-53e6e949-1899-4df4-ba0f-d1097e3103b9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081042 Oct 08 20:54:06.549163 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 382/730] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:54:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:54:06.562879 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-b5490ee3-8793-4214-a389-e07b78a74762 tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:06.563598 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-b5490ee3-8793-4214-a389-e07b78a74762 tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] [instance: aadc9a05-66e2-45bb-8c2d-6755184a8e9c] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:06.578450 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b5490ee3-8793-4214-a389-e07b78a74762 tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:06.579109 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b5490ee3-8793-4214-a389-e07b78a74762 tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:06.579674 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b5490ee3-8793-4214-a389-e07b78a74762 tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:06.580927 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b5490ee3-8793-4214-a389-e07b78a74762 tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:06.581537 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b5490ee3-8793-4214-a389-e07b78a74762 tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:06.582224 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b5490ee3-8793-4214-a389-e07b78a74762 tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:06.603888 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-0563ae3d-80b2-4477-9c01-6d2ebdcca308 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:06.619266 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-0563ae3d-80b2-4477-9c01-6d2ebdcca308 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:06.620747 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-0563ae3d-80b2-4477-9c01-6d2ebdcca308 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:06.639092 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-0563ae3d-80b2-4477-9c01-6d2ebdcca308 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] 10.222.0.26 "GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5" status: 200 len: 1539 microversion: 2.91 time: 0.183115 Oct 08 20:54:06.640519 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 349/731] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:54:06 2022] GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5 => generated 1539 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:54:06.645349 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-7fc6d0eb-39cc-4ef2-934a-0b96420e13bb tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:06.646515 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-7fc6d0eb-39cc-4ef2-934a-0b96420e13bb tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] [instance: 139f7ae3-b380-4114-a566-6d496d4957f4] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:06.652599 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7fc6d0eb-39cc-4ef2-934a-0b96420e13bb tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:06.653797 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7fc6d0eb-39cc-4ef2-934a-0b96420e13bb tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:06.654331 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7fc6d0eb-39cc-4ef2-934a-0b96420e13bb tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:06.655566 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7fc6d0eb-39cc-4ef2-934a-0b96420e13bb tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:06.656583 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7fc6d0eb-39cc-4ef2-934a-0b96420e13bb tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:06.657020 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7fc6d0eb-39cc-4ef2-934a-0b96420e13bb tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:06.882851 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-b5490ee3-8793-4214-a389-e07b78a74762 tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68e264d0c2b54a5f8d1bd197b84a104a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a09d8f87c174336a1d216e396adfd33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:06.891759 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-b5490ee3-8793-4214-a389-e07b78a74762 tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] 10.222.0.26 "GET /compute/v2.1/servers/aadc9a05-66e2-45bb-8c2d-6755184a8e9c" status: 200 len: 1315 microversion: 2.1 time: 0.341317 Oct 08 20:54:06.892356 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 383/732] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:54:06 2022] GET /compute/v2.1/servers/aadc9a05-66e2-45bb-8c2d-6755184a8e9c => generated 1315 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:54:06.899756 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-f3c8b10e-57c7-45d0-9b78-63245356acab tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:06.910704 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-f3c8b10e-57c7-45d0-9b78-63245356acab tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5ef659f5a1a24c439528a7675bdd70f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c92fe04ab8248399d0acb932f82d607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:06.916944 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-f3c8b10e-57c7-45d0-9b78-63245356acab tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': '8c92fe04ab8248399d0acb932f82d607'} {{(pid=140492) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 08 20:54:06.926782 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f3c8b10e-57c7-45d0-9b78-63245356acab tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:06.929465 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f3c8b10e-57c7-45d0-9b78-63245356acab tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:06.930156 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f3c8b10e-57c7-45d0-9b78-63245356acab tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:06.931128 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f3c8b10e-57c7-45d0-9b78-63245356acab tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:06.932009 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f3c8b10e-57c7-45d0-9b78-63245356acab tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:06.932600 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f3c8b10e-57c7-45d0-9b78-63245356acab tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:07.024859 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-7fc6d0eb-39cc-4ef2-934a-0b96420e13bb tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:07.038760 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-7fc6d0eb-39cc-4ef2-934a-0b96420e13bb tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:07.040839 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-7fc6d0eb-39cc-4ef2-934a-0b96420e13bb tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:07.047271 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-7fc6d0eb-39cc-4ef2-934a-0b96420e13bb tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] 10.222.0.26 "GET /compute/v2.1/servers/139f7ae3-b380-4114-a566-6d496d4957f4" status: 200 len: 1568 microversion: 2.25 time: 0.404938 Oct 08 20:54:07.048080 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 350/733] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:54:06 2022] GET /compute/v2.1/servers/139f7ae3-b380-4114-a566-6d496d4957f4 => generated 1568 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:54:07.055514 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-04342cd9-e6d4-4c58-86c7-16a82857cbe3 tempest-FloatingIPDetailsTestJSON-117414399 tempest-FloatingIPDetailsTestJSON-117414399-project] Calling method '.version_select at 0x7f1a8cdbc790>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:07.059550 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.multi_cell_list [None req-f3c8b10e-57c7-45d0-9b78-63245356acab tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=140492) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 08 20:54:07.072970 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:54:07.178380 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-f3c8b10e-57c7-45d0-9b78-63245356acab tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] 10.222.0.26 "GET /compute/v2.1/servers?status=error" status: 200 len: 338 microversion: 2.1 time: 0.282133 Oct 08 20:54:07.185406 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 384/734] 10.222.0.26 () {58 vars in 1150 bytes} [Sat Oct 8 20:54:06 2022] GET /compute/v2.1/servers?status=error => generated 338 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:54:07.194248 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-31106346-012e-455c-8f94-9ef20b698756 tempest-ServersAdminTestJSON-1467382604 tempest-ServersAdminTestJSON-1467382604-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:54:07.196911 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-31106346-012e-455c-8f94-9ef20b698756 tempest-ServersAdminTestJSON-1467382604 tempest-ServersAdminTestJSON-1467382604-project-admin] [instance: 73fd15ea-e4bd-4310-93bb-147b0a5e27ef] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:07.204380 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-31106346-012e-455c-8f94-9ef20b698756 tempest-ServersAdminTestJSON-1467382604 tempest-ServersAdminTestJSON-1467382604-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:07.205058 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-31106346-012e-455c-8f94-9ef20b698756 tempest-ServersAdminTestJSON-1467382604 tempest-ServersAdminTestJSON-1467382604-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:07.205682 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-31106346-012e-455c-8f94-9ef20b698756 tempest-ServersAdminTestJSON-1467382604 tempest-ServersAdminTestJSON-1467382604-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:07.206717 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-31106346-012e-455c-8f94-9ef20b698756 tempest-ServersAdminTestJSON-1467382604 tempest-ServersAdminTestJSON-1467382604-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:07.207328 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-31106346-012e-455c-8f94-9ef20b698756 tempest-ServersAdminTestJSON-1467382604 tempest-ServersAdminTestJSON-1467382604-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:07.208388 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-31106346-012e-455c-8f94-9ef20b698756 tempest-ServersAdminTestJSON-1467382604 tempest-ServersAdminTestJSON-1467382604-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:07.312113 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-31106346-012e-455c-8f94-9ef20b698756 tempest-ServersAdminTestJSON-1467382604 tempest-ServersAdminTestJSON-1467382604-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/73fd15ea-e4bd-4310-93bb-147b0a5e27ef/action" status: 202 len: 0 microversion: 2.1 time: 0.121476 Oct 08 20:54:07.316314 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 385/735] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 20:54:07 2022] POST /compute/v2.1/servers/73fd15ea-e4bd-4310-93bb-147b0a5e27ef/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 20:54:07.321882 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-94227348-2fb5-4bab-a54f-927f5f05d47c tempest-ServersAdminTestJSON-1467382604 tempest-ServersAdminTestJSON-1467382604-project-admin] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:07.322859 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-94227348-2fb5-4bab-a54f-927f5f05d47c tempest-ServersAdminTestJSON-1467382604 tempest-ServersAdminTestJSON-1467382604-project-admin] [instance: 73fd15ea-e4bd-4310-93bb-147b0a5e27ef] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:07.330403 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-94227348-2fb5-4bab-a54f-927f5f05d47c tempest-ServersAdminTestJSON-1467382604 tempest-ServersAdminTestJSON-1467382604-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:07.331149 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-94227348-2fb5-4bab-a54f-927f5f05d47c tempest-ServersAdminTestJSON-1467382604 tempest-ServersAdminTestJSON-1467382604-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:07.332003 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-94227348-2fb5-4bab-a54f-927f5f05d47c tempest-ServersAdminTestJSON-1467382604 tempest-ServersAdminTestJSON-1467382604-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:07.332531 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-94227348-2fb5-4bab-a54f-927f5f05d47c tempest-ServersAdminTestJSON-1467382604 tempest-ServersAdminTestJSON-1467382604-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:07.333142 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-94227348-2fb5-4bab-a54f-927f5f05d47c tempest-ServersAdminTestJSON-1467382604 tempest-ServersAdminTestJSON-1467382604-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:07.333912 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-94227348-2fb5-4bab-a54f-927f5f05d47c tempest-ServersAdminTestJSON-1467382604 tempest-ServersAdminTestJSON-1467382604-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:07.638632 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-94227348-2fb5-4bab-a54f-927f5f05d47c tempest-ServersAdminTestJSON-1467382604 tempest-ServersAdminTestJSON-1467382604-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/73fd15ea-e4bd-4310-93bb-147b0a5e27ef" status: 200 len: 1613 microversion: 2.1 time: 0.320380 Oct 08 20:54:07.641134 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 386/736] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:54:07 2022] GET /compute/v2.1/servers/73fd15ea-e4bd-4310-93bb-147b0a5e27ef => generated 1613 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:54:07.646136 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-c3430af9-b11f-4c63-bdc8-17d2bb797bb5 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:07.646955 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-c3430af9-b11f-4c63-bdc8-17d2bb797bb5 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] [instance: a80fbf87-8203-4e6c-bee7-fe781bfccff1] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:07.655395 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c3430af9-b11f-4c63-bdc8-17d2bb797bb5 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:07.656142 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c3430af9-b11f-4c63-bdc8-17d2bb797bb5 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:07.656770 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c3430af9-b11f-4c63-bdc8-17d2bb797bb5 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:07.657842 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c3430af9-b11f-4c63-bdc8-17d2bb797bb5 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:07.658524 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c3430af9-b11f-4c63-bdc8-17d2bb797bb5 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:07.659116 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c3430af9-b11f-4c63-bdc8-17d2bb797bb5 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:08.056901 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-c3430af9-b11f-4c63-bdc8-17d2bb797bb5 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474ca64d1b1d4e30916b517645aba882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecc2dd2407b4819874bed09cb27959a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:08.065528 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-c3430af9-b11f-4c63-bdc8-17d2bb797bb5 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] 10.222.0.26 "GET /compute/v2.1/servers/a80fbf87-8203-4e6c-bee7-fe781bfccff1" status: 200 len: 1311 microversion: 2.1 time: 0.423115 Oct 08 20:54:08.077764 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 387/737] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:54:07 2022] GET /compute/v2.1/servers/a80fbf87-8203-4e6c-bee7-fe781bfccff1 => generated 1311 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:54:08.087977 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-f1eac4ae-4d2a-43a2-8685-506cdc3ae75f tempest-ServersAdminTestJSON-1467382604 tempest-ServersAdminTestJSON-1467382604-project-admin] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:08.089067 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-f1eac4ae-4d2a-43a2-8685-506cdc3ae75f tempest-ServersAdminTestJSON-1467382604 tempest-ServersAdminTestJSON-1467382604-project-admin] [instance: 73fd15ea-e4bd-4310-93bb-147b0a5e27ef] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:08.096682 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f1eac4ae-4d2a-43a2-8685-506cdc3ae75f tempest-ServersAdminTestJSON-1467382604 tempest-ServersAdminTestJSON-1467382604-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:08.097213 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f1eac4ae-4d2a-43a2-8685-506cdc3ae75f tempest-ServersAdminTestJSON-1467382604 tempest-ServersAdminTestJSON-1467382604-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:08.097672 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f1eac4ae-4d2a-43a2-8685-506cdc3ae75f tempest-ServersAdminTestJSON-1467382604 tempest-ServersAdminTestJSON-1467382604-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:08.098382 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f1eac4ae-4d2a-43a2-8685-506cdc3ae75f tempest-ServersAdminTestJSON-1467382604 tempest-ServersAdminTestJSON-1467382604-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:08.098839 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f1eac4ae-4d2a-43a2-8685-506cdc3ae75f tempest-ServersAdminTestJSON-1467382604 tempest-ServersAdminTestJSON-1467382604-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:08.099265 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f1eac4ae-4d2a-43a2-8685-506cdc3ae75f tempest-ServersAdminTestJSON-1467382604 tempest-ServersAdminTestJSON-1467382604-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:08.491833 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-f1eac4ae-4d2a-43a2-8685-506cdc3ae75f tempest-ServersAdminTestJSON-1467382604 tempest-ServersAdminTestJSON-1467382604-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/73fd15ea-e4bd-4310-93bb-147b0a5e27ef" status: 200 len: 1613 microversion: 2.1 time: 0.410891 Oct 08 20:54:08.494326 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 388/738] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:54:08 2022] GET /compute/v2.1/servers/73fd15ea-e4bd-4310-93bb-147b0a5e27ef => generated 1613 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:54:08.503055 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-0b9e8098-6349-4740-8348-e694ee322df1 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:08.504080 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-0b9e8098-6349-4740-8348-e694ee322df1 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] [instance: 92e31b92-0af1-4da6-bc87-23978f1aedf5] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:08.515312 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0b9e8098-6349-4740-8348-e694ee322df1 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:08.516270 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0b9e8098-6349-4740-8348-e694ee322df1 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:08.516724 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0b9e8098-6349-4740-8348-e694ee322df1 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:08.517818 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0b9e8098-6349-4740-8348-e694ee322df1 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:08.518449 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0b9e8098-6349-4740-8348-e694ee322df1 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:08.519045 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0b9e8098-6349-4740-8348-e694ee322df1 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:08.731050 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-0b9e8098-6349-4740-8348-e694ee322df1 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:08.742132 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-0b9e8098-6349-4740-8348-e694ee322df1 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:08.746424 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-0b9e8098-6349-4740-8348-e694ee322df1 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:08.760824 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-0b9e8098-6349-4740-8348-e694ee322df1 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] 10.222.0.26 "GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5" status: 200 len: 1539 microversion: 2.91 time: 0.264623 Oct 08 20:54:08.761702 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 389/739] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:54:08 2022] GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5 => generated 1539 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:54:08.788724 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-0de49bce-b132-461c-a0ea-eec94a7022d5 tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:08.789806 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-0de49bce-b132-461c-a0ea-eec94a7022d5 tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] [instance: aadc9a05-66e2-45bb-8c2d-6755184a8e9c] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:08.798245 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0de49bce-b132-461c-a0ea-eec94a7022d5 tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:08.798980 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0de49bce-b132-461c-a0ea-eec94a7022d5 tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:08.799597 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0de49bce-b132-461c-a0ea-eec94a7022d5 tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:08.800579 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0de49bce-b132-461c-a0ea-eec94a7022d5 tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:08.801509 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0de49bce-b132-461c-a0ea-eec94a7022d5 tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:08.802091 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0de49bce-b132-461c-a0ea-eec94a7022d5 tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:09.124985 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-0de49bce-b132-461c-a0ea-eec94a7022d5 tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68e264d0c2b54a5f8d1bd197b84a104a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a09d8f87c174336a1d216e396adfd33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:09.136697 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-0de49bce-b132-461c-a0ea-eec94a7022d5 tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] 10.222.0.26 "GET /compute/v2.1/servers/aadc9a05-66e2-45bb-8c2d-6755184a8e9c" status: 200 len: 1315 microversion: 2.1 time: 0.374033 Oct 08 20:54:09.138346 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 390/740] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:54:08 2022] GET /compute/v2.1/servers/aadc9a05-66e2-45bb-8c2d-6755184a8e9c => generated 1315 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:54:09.143882 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-36826208-c1b7-4060-9952-7e2c51f4ec8a tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:09.149752 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-36826208-c1b7-4060-9952-7e2c51f4ec8a tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] [instance: 139f7ae3-b380-4114-a566-6d496d4957f4] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:09.168446 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-36826208-c1b7-4060-9952-7e2c51f4ec8a tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:09.169120 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-36826208-c1b7-4060-9952-7e2c51f4ec8a tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:09.172978 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-36826208-c1b7-4060-9952-7e2c51f4ec8a tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:09.173906 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-36826208-c1b7-4060-9952-7e2c51f4ec8a tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:09.175246 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-36826208-c1b7-4060-9952-7e2c51f4ec8a tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:09.176447 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-36826208-c1b7-4060-9952-7e2c51f4ec8a tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:09.355477 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-04342cd9-e6d4-4c58-86c7-16a82857cbe3 tempest-FloatingIPDetailsTestJSON-117414399 tempest-FloatingIPDetailsTestJSON-117414399-project] 10.222.0.26 "DELETE /compute/v2.1/os-floating-ips/4e423923-e9a6-42c9-9dc4-f3379ac408a8" status: 202 len: 0 microversion: 2.1 time: 2.306124 Oct 08 20:54:09.359829 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 351/741] 10.222.0.26 () {58 vars in 1263 bytes} [Sat Oct 8 20:54:07 2022] DELETE /compute/v2.1/os-floating-ips/4e423923-e9a6-42c9-9dc4-f3379ac408a8 => generated 0 bytes in 2308 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 20:54:09.362339 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-91ce0539-d7d6-4925-a1ca-2a82560579a2 tempest-ServersAdminTestJSON-1467382604 tempest-ServersAdminTestJSON-1467382604-project-admin] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:09.374572 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-91ce0539-d7d6-4925-a1ca-2a82560579a2 tempest-ServersAdminTestJSON-1467382604 tempest-ServersAdminTestJSON-1467382604-project-admin] Searching by: {'host': 'nch2-master-1', 'deleted': False} {{(pid=140491) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 08 20:54:09.386926 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=3 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:54:09.396071 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-91ce0539-d7d6-4925-a1ca-2a82560579a2 tempest-ServersAdminTestJSON-1467382604 tempest-ServersAdminTestJSON-1467382604-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:09.396951 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-91ce0539-d7d6-4925-a1ca-2a82560579a2 tempest-ServersAdminTestJSON-1467382604 tempest-ServersAdminTestJSON-1467382604-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:09.397770 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-91ce0539-d7d6-4925-a1ca-2a82560579a2 tempest-ServersAdminTestJSON-1467382604 tempest-ServersAdminTestJSON-1467382604-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:09.398709 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-91ce0539-d7d6-4925-a1ca-2a82560579a2 tempest-ServersAdminTestJSON-1467382604 tempest-ServersAdminTestJSON-1467382604-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:09.399179 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-91ce0539-d7d6-4925-a1ca-2a82560579a2 tempest-ServersAdminTestJSON-1467382604 tempest-ServersAdminTestJSON-1467382604-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:09.399622 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-91ce0539-d7d6-4925-a1ca-2a82560579a2 tempest-ServersAdminTestJSON-1467382604 tempest-ServersAdminTestJSON-1467382604-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:09.413990 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-36826208-c1b7-4060-9952-7e2c51f4ec8a tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:09.427808 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-36826208-c1b7-4060-9952-7e2c51f4ec8a tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:09.429299 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-36826208-c1b7-4060-9952-7e2c51f4ec8a tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:09.432861 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-36826208-c1b7-4060-9952-7e2c51f4ec8a tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] 10.222.0.26 "GET /compute/v2.1/servers/139f7ae3-b380-4114-a566-6d496d4957f4" status: 200 len: 1568 microversion: 2.25 time: 0.292643 Oct 08 20:54:09.448706 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 391/742] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:54:09 2022] GET /compute/v2.1/servers/139f7ae3-b380-4114-a566-6d496d4957f4 => generated 1568 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:54:09.448706 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-c2e7bfa5-3e6f-4729-b5b9-676f5be40e0d req-1324604a-834c-4e4a-a57b-b89ec3c4c536 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a80fbf87-8203-4e6c-bee7-fe781bfccff1", "tag": "01d74faf-31a5-494a-9dba-c900226fd0a9"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:54:09.458186 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-c2e7bfa5-3e6f-4729-b5b9-676f5be40e0d req-1324604a-834c-4e4a-a57b-b89ec3c4c536 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:09.458880 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-c2e7bfa5-3e6f-4729-b5b9-676f5be40e0d req-1324604a-834c-4e4a-a57b-b89ec3c4c536 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:09.459121 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-c2e7bfa5-3e6f-4729-b5b9-676f5be40e0d req-1324604a-834c-4e4a-a57b-b89ec3c4c536 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:09.482022 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-c2e7bfa5-3e6f-4729-b5b9-676f5be40e0d req-1324604a-834c-4e4a-a57b-b89ec3c4c536 service nova] Creating event network-changed:01d74faf-31a5-494a-9dba-c900226fd0a9 for instance a80fbf87-8203-4e6c-bee7-fe781bfccff1 on nch2-master-1 Oct 08 20:54:09.501384 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-c2e7bfa5-3e6f-4729-b5b9-676f5be40e0d req-1324604a-834c-4e4a-a57b-b89ec3c4c536 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061697 Oct 08 20:54:09.502016 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 392/743] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:54:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:54:09.510430 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-6f8cc7ec-fd73-4477-b3c0-487275646dec req-6a716ed1-be49-4984-b2c4-7e253e16567e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "139f7ae3-b380-4114-a566-6d496d4957f4", "name": "network-vif-unplugged", "status": "completed", "tag": "34b7dd73-89eb-4b12-ac78-40ef20772247"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:54:09.532051 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-6f8cc7ec-fd73-4477-b3c0-487275646dec req-6a716ed1-be49-4984-b2c4-7e253e16567e service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:09.532559 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-6f8cc7ec-fd73-4477-b3c0-487275646dec req-6a716ed1-be49-4984-b2c4-7e253e16567e service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:09.533024 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-6f8cc7ec-fd73-4477-b3c0-487275646dec req-6a716ed1-be49-4984-b2c4-7e253e16567e service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:09.563740 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-6f8cc7ec-fd73-4477-b3c0-487275646dec req-6a716ed1-be49-4984-b2c4-7e253e16567e service nova] Creating event network-vif-unplugged:34b7dd73-89eb-4b12-ac78-40ef20772247 for instance 139f7ae3-b380-4114-a566-6d496d4957f4 on nch1-master-1 Oct 08 20:54:09.573686 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-6f8cc7ec-fd73-4477-b3c0-487275646dec req-6a716ed1-be49-4984-b2c4-7e253e16567e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.070213 Oct 08 20:54:09.574305 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 393/744] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:54:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:54:09.579590 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-ef2729e7-7e4e-4c64-9fb0-928a8904f5c9 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:09.582652 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-ef2729e7-7e4e-4c64-9fb0-928a8904f5c9 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] [instance: a80fbf87-8203-4e6c-bee7-fe781bfccff1] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:09.589211 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.multi_cell_list [None req-91ce0539-d7d6-4925-a1ca-2a82560579a2 tempest-ServersAdminTestJSON-1467382604 tempest-ServersAdminTestJSON-1467382604-project-admin] Listed batch of 5 results from cell out of 1000 limit. Returned 5 total so far. {{(pid=140491) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 08 20:54:09.589869 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ef2729e7-7e4e-4c64-9fb0-928a8904f5c9 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:09.590553 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ef2729e7-7e4e-4c64-9fb0-928a8904f5c9 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:09.591172 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ef2729e7-7e4e-4c64-9fb0-928a8904f5c9 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:09.592606 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ef2729e7-7e4e-4c64-9fb0-928a8904f5c9 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:09.593321 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ef2729e7-7e4e-4c64-9fb0-928a8904f5c9 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:09.594282 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ef2729e7-7e4e-4c64-9fb0-928a8904f5c9 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:09.687377 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-91ce0539-d7d6-4925-a1ca-2a82560579a2 tempest-ServersAdminTestJSON-1467382604 tempest-ServersAdminTestJSON-1467382604-project-admin] 10.222.0.26 "GET /compute/v2.1/servers?host=nch2-master-1&all_tenants=1" status: 200 len: 1638 microversion: 2.1 time: 0.329711 Oct 08 20:54:09.688493 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 352/745] 10.222.0.26 () {58 vars in 1190 bytes} [Sat Oct 8 20:54:09 2022] GET /compute/v2.1/servers?host=nch2-master-1&all_tenants=1 => generated 1638 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:54:09.707607 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-fb275680-cdc9-44c0-b699-e6b65debe46a tempest-FloatingIPDetailsTestJSON-117414399 tempest-FloatingIPDetailsTestJSON-117414399-project] Calling method '.version_select at 0x7f1a8d572b80>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:09.825465 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-ef2729e7-7e4e-4c64-9fb0-928a8904f5c9 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474ca64d1b1d4e30916b517645aba882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecc2dd2407b4819874bed09cb27959a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:09.835262 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-ef2729e7-7e4e-4c64-9fb0-928a8904f5c9 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] 10.222.0.26 "GET /compute/v2.1/servers/a80fbf87-8203-4e6c-bee7-fe781bfccff1" status: 200 len: 1311 microversion: 2.1 time: 0.259509 Oct 08 20:54:09.850217 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 394/746] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:54:09 2022] GET /compute/v2.1/servers/a80fbf87-8203-4e6c-bee7-fe781bfccff1 => generated 1311 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:54:09.850217 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-8aecfdad-c0d6-4993-8a0b-abeff4125b4d tempest-ServersAdminTestJSON-1467382604 tempest-ServersAdminTestJSON-1467382604-project-admin] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:09.850217 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-8aecfdad-c0d6-4993-8a0b-abeff4125b4d tempest-ServersAdminTestJSON-1467382604 tempest-ServersAdminTestJSON-1467382604-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=140492) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 08 20:54:09.859579 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8aecfdad-c0d6-4993-8a0b-abeff4125b4d tempest-ServersAdminTestJSON-1467382604 tempest-ServersAdminTestJSON-1467382604-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:09.860206 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8aecfdad-c0d6-4993-8a0b-abeff4125b4d tempest-ServersAdminTestJSON-1467382604 tempest-ServersAdminTestJSON-1467382604-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:09.860777 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8aecfdad-c0d6-4993-8a0b-abeff4125b4d tempest-ServersAdminTestJSON-1467382604 tempest-ServersAdminTestJSON-1467382604-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:09.861698 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8aecfdad-c0d6-4993-8a0b-abeff4125b4d tempest-ServersAdminTestJSON-1467382604 tempest-ServersAdminTestJSON-1467382604-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:09.862547 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8aecfdad-c0d6-4993-8a0b-abeff4125b4d tempest-ServersAdminTestJSON-1467382604 tempest-ServersAdminTestJSON-1467382604-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:09.863086 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8aecfdad-c0d6-4993-8a0b-abeff4125b4d tempest-ServersAdminTestJSON-1467382604 tempest-ServersAdminTestJSON-1467382604-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:09.892740 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=15 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:54:09.951234 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-8aecfdad-c0d6-4993-8a0b-abeff4125b4d tempest-ServersAdminTestJSON-1467382604 tempest-ServersAdminTestJSON-1467382604-project-admin] 10.222.0.26 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.112808 Oct 08 20:54:09.952730 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 395/747] 10.222.0.26 () {58 vars in 1196 bytes} [Sat Oct 8 20:54:09 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 08 20:54:09.957454 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-3d766e9b-0680-419c-8c58-bf852b25c9d0 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:09.959410 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-3d766e9b-0680-419c-8c58-bf852b25c9d0 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] [instance: 92e31b92-0af1-4da6-bc87-23978f1aedf5] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:09.965705 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3d766e9b-0680-419c-8c58-bf852b25c9d0 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:09.966299 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3d766e9b-0680-419c-8c58-bf852b25c9d0 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:09.966883 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3d766e9b-0680-419c-8c58-bf852b25c9d0 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:09.968400 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3d766e9b-0680-419c-8c58-bf852b25c9d0 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:09.968947 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3d766e9b-0680-419c-8c58-bf852b25c9d0 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:09.969480 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3d766e9b-0680-419c-8c58-bf852b25c9d0 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:10.042025 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-3d766e9b-0680-419c-8c58-bf852b25c9d0 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:10.051178 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-3d766e9b-0680-419c-8c58-bf852b25c9d0 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:10.052934 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-3d766e9b-0680-419c-8c58-bf852b25c9d0 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:10.059929 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-3d766e9b-0680-419c-8c58-bf852b25c9d0 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] 10.222.0.26 "GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5" status: 200 len: 1539 microversion: 2.91 time: 0.106077 Oct 08 20:54:10.061031 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 396/748] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:54:09 2022] GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5 => generated 1539 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:54:10.065965 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-a5b7b67b-dfd3-45e8-a015-2cb47e57de3b tempest-ServersAdminTestJSON-1467382604 tempest-ServersAdminTestJSON-1467382604-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:54:10.068640 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-a5b7b67b-dfd3-45e8-a015-2cb47e57de3b tempest-ServersAdminTestJSON-1467382604 tempest-ServersAdminTestJSON-1467382604-project-admin] [instance: 73fd15ea-e4bd-4310-93bb-147b0a5e27ef] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:10.075848 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a5b7b67b-dfd3-45e8-a015-2cb47e57de3b tempest-ServersAdminTestJSON-1467382604 tempest-ServersAdminTestJSON-1467382604-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:10.077134 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a5b7b67b-dfd3-45e8-a015-2cb47e57de3b tempest-ServersAdminTestJSON-1467382604 tempest-ServersAdminTestJSON-1467382604-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:10.077843 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a5b7b67b-dfd3-45e8-a015-2cb47e57de3b tempest-ServersAdminTestJSON-1467382604 tempest-ServersAdminTestJSON-1467382604-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:10.078780 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a5b7b67b-dfd3-45e8-a015-2cb47e57de3b tempest-ServersAdminTestJSON-1467382604 tempest-ServersAdminTestJSON-1467382604-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:10.079456 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a5b7b67b-dfd3-45e8-a015-2cb47e57de3b tempest-ServersAdminTestJSON-1467382604 tempest-ServersAdminTestJSON-1467382604-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:10.080113 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a5b7b67b-dfd3-45e8-a015-2cb47e57de3b tempest-ServersAdminTestJSON-1467382604 tempest-ServersAdminTestJSON-1467382604-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:10.185518 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-a5b7b67b-dfd3-45e8-a015-2cb47e57de3b tempest-ServersAdminTestJSON-1467382604 tempest-ServersAdminTestJSON-1467382604-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/73fd15ea-e4bd-4310-93bb-147b0a5e27ef/action" status: 202 len: 0 microversion: 2.1 time: 0.118847 Oct 08 20:54:10.187027 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 397/749] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 20:54:10 2022] POST /compute/v2.1/servers/73fd15ea-e4bd-4310-93bb-147b0a5e27ef/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 20:54:10.200521 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-04410dd3-32e8-4528-a516-f83264007315 tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:10.203116 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-04410dd3-32e8-4528-a516-f83264007315 tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] [instance: aadc9a05-66e2-45bb-8c2d-6755184a8e9c] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:10.211818 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-04410dd3-32e8-4528-a516-f83264007315 tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:10.214350 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-04410dd3-32e8-4528-a516-f83264007315 tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:10.214806 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-04410dd3-32e8-4528-a516-f83264007315 tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:10.216419 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-04410dd3-32e8-4528-a516-f83264007315 tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:10.217671 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-04410dd3-32e8-4528-a516-f83264007315 tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:10.218271 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-04410dd3-32e8-4528-a516-f83264007315 tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:10.458174 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-04410dd3-32e8-4528-a516-f83264007315 tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68e264d0c2b54a5f8d1bd197b84a104a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a09d8f87c174336a1d216e396adfd33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:10.470406 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-04410dd3-32e8-4528-a516-f83264007315 tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] 10.222.0.26 "GET /compute/v2.1/servers/aadc9a05-66e2-45bb-8c2d-6755184a8e9c" status: 200 len: 1315 microversion: 2.1 time: 0.281977 Oct 08 20:54:10.485223 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 398/750] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:54:10 2022] GET /compute/v2.1/servers/aadc9a05-66e2-45bb-8c2d-6755184a8e9c => generated 1315 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:54:10.496333 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-aca29c57-d5c1-4061-9202-8202c058f9f1 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:54:10.503258 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-aca29c57-d5c1-4061-9202-8202c058f9f1 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] [instance: 73fd15ea-e4bd-4310-93bb-147b0a5e27ef] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:10.518597 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-aca29c57-d5c1-4061-9202-8202c058f9f1 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:10.520686 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-aca29c57-d5c1-4061-9202-8202c058f9f1 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:10.521372 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-aca29c57-d5c1-4061-9202-8202c058f9f1 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:10.522237 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-aca29c57-d5c1-4061-9202-8202c058f9f1 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:10.522822 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-aca29c57-d5c1-4061-9202-8202c058f9f1 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:10.532780 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-aca29c57-d5c1-4061-9202-8202c058f9f1 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:10.680855 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:54:10.697681 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-aca29c57-d5c1-4061-9202-8202c058f9f1 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Flavor limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 20:54:10.698572 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-aca29c57-d5c1-4061-9202-8202c058f9f1 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Image limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 20:54:10.699070 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-aca29c57-d5c1-4061-9202-8202c058f9f1 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Flavor pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 20:54:10.699544 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-aca29c57-d5c1-4061-9202-8202c058f9f1 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Image pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 20:54:10.699978 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-aca29c57-d5c1-4061-9202-8202c058f9f1 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 20:54:10.804108 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=8 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:54:10.820368 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-aca29c57-d5c1-4061-9202-8202c058f9f1 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] [instance: 73fd15ea-e4bd-4310-93bb-147b0a5e27ef] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:10.830765 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-aca29c57-d5c1-4061-9202-8202c058f9f1 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:10.831947 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-aca29c57-d5c1-4061-9202-8202c058f9f1 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:10.832551 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-aca29c57-d5c1-4061-9202-8202c058f9f1 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:10.833569 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-aca29c57-d5c1-4061-9202-8202c058f9f1 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:10.834356 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-aca29c57-d5c1-4061-9202-8202c058f9f1 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:10.834999 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-aca29c57-d5c1-4061-9202-8202c058f9f1 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:10.880922 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-aca29c57-d5c1-4061-9202-8202c058f9f1 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] 10.222.0.26 "POST /compute/v2.1/servers/73fd15ea-e4bd-4310-93bb-147b0a5e27ef/action" status: 202 len: 1066 microversion: 2.1 time: 0.406760 Oct 08 20:54:10.896903 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 399/751] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 20:54:10 2022] POST /compute/v2.1/servers/73fd15ea-e4bd-4310-93bb-147b0a5e27ef/action => generated 1066 bytes in 425 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 08 20:54:10.903917 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-343f95b6-1e62-4552-b670-7501ed095624 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:10.904128 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-343f95b6-1e62-4552-b670-7501ed095624 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] [instance: 139f7ae3-b380-4114-a566-6d496d4957f4] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:10.939221 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-343f95b6-1e62-4552-b670-7501ed095624 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:10.939758 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-343f95b6-1e62-4552-b670-7501ed095624 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:10.943941 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-343f95b6-1e62-4552-b670-7501ed095624 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:10.944763 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-343f95b6-1e62-4552-b670-7501ed095624 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:10.945279 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-343f95b6-1e62-4552-b670-7501ed095624 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:10.945733 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-343f95b6-1e62-4552-b670-7501ed095624 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:11.365382 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-343f95b6-1e62-4552-b670-7501ed095624 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:11.374706 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-343f95b6-1e62-4552-b670-7501ed095624 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:11.376175 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-343f95b6-1e62-4552-b670-7501ed095624 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:11.380372 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-343f95b6-1e62-4552-b670-7501ed095624 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] 10.222.0.26 "GET /compute/v2.1/servers/139f7ae3-b380-4114-a566-6d496d4957f4" status: 200 len: 1568 microversion: 2.25 time: 0.482214 Oct 08 20:54:11.381207 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 400/752] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:54:10 2022] GET /compute/v2.1/servers/139f7ae3-b380-4114-a566-6d496d4957f4 => generated 1568 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:54:11.393327 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-f83541fa-3722-41a7-b1c7-827c8b421800 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:11.393963 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-f83541fa-3722-41a7-b1c7-827c8b421800 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] [instance: a80fbf87-8203-4e6c-bee7-fe781bfccff1] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:11.405361 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f83541fa-3722-41a7-b1c7-827c8b421800 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:11.405873 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f83541fa-3722-41a7-b1c7-827c8b421800 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:11.406324 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f83541fa-3722-41a7-b1c7-827c8b421800 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:11.407055 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f83541fa-3722-41a7-b1c7-827c8b421800 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:11.407522 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f83541fa-3722-41a7-b1c7-827c8b421800 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:11.408015 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f83541fa-3722-41a7-b1c7-827c8b421800 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:11.671978 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-fb275680-cdc9-44c0-b699-e6b65debe46a tempest-FloatingIPDetailsTestJSON-117414399 tempest-FloatingIPDetailsTestJSON-117414399-project] 10.222.0.26 "DELETE /compute/v2.1/os-floating-ips/e112060b-fb54-4ca6-8afe-96a7c7e1ba76" status: 202 len: 0 microversion: 2.1 time: 1.982186 Oct 08 20:54:11.676451 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 353/753] 10.222.0.26 () {58 vars in 1263 bytes} [Sat Oct 8 20:54:09 2022] DELETE /compute/v2.1/os-floating-ips/e112060b-fb54-4ca6-8afe-96a7c7e1ba76 => generated 0 bytes in 1984 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 20:54:11.677868 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-029da9c9-924e-4828-9b0e-f916e829e53f tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:11.679216 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-029da9c9-924e-4828-9b0e-f916e829e53f tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] [instance: 73fd15ea-e4bd-4310-93bb-147b0a5e27ef] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:11.693704 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-029da9c9-924e-4828-9b0e-f916e829e53f tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:11.696056 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-029da9c9-924e-4828-9b0e-f916e829e53f tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:11.696961 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-029da9c9-924e-4828-9b0e-f916e829e53f tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:11.699265 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-029da9c9-924e-4828-9b0e-f916e829e53f tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:11.699769 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-029da9c9-924e-4828-9b0e-f916e829e53f tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:11.700609 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-029da9c9-924e-4828-9b0e-f916e829e53f tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:11.718933 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-f83541fa-3722-41a7-b1c7-827c8b421800 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474ca64d1b1d4e30916b517645aba882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecc2dd2407b4819874bed09cb27959a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:11.729653 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-f83541fa-3722-41a7-b1c7-827c8b421800 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] 10.222.0.26 "GET /compute/v2.1/servers/a80fbf87-8203-4e6c-bee7-fe781bfccff1" status: 200 len: 1311 microversion: 2.1 time: 0.347388 Oct 08 20:54:11.730587 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 401/754] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:54:11 2022] GET /compute/v2.1/servers/a80fbf87-8203-4e6c-bee7-fe781bfccff1 => generated 1311 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:54:11.738201 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-99163b4c-5789-4a2b-9d5f-d9b77380a87e tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:11.739877 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-99163b4c-5789-4a2b-9d5f-d9b77380a87e tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] [instance: 92e31b92-0af1-4da6-bc87-23978f1aedf5] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:11.746114 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-99163b4c-5789-4a2b-9d5f-d9b77380a87e tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:11.746633 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-99163b4c-5789-4a2b-9d5f-d9b77380a87e tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:11.747852 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-99163b4c-5789-4a2b-9d5f-d9b77380a87e tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:11.748875 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-99163b4c-5789-4a2b-9d5f-d9b77380a87e tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:11.750097 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-99163b4c-5789-4a2b-9d5f-d9b77380a87e tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:11.750697 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-99163b4c-5789-4a2b-9d5f-d9b77380a87e tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:11.865510 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-99163b4c-5789-4a2b-9d5f-d9b77380a87e tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:11.885298 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-99163b4c-5789-4a2b-9d5f-d9b77380a87e tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:11.887186 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-99163b4c-5789-4a2b-9d5f-d9b77380a87e tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:11.893938 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-99163b4c-5789-4a2b-9d5f-d9b77380a87e tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] 10.222.0.26 "GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5" status: 200 len: 1539 microversion: 2.91 time: 0.162332 Oct 08 20:54:11.905488 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 402/755] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:54:11 2022] GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5 => generated 1539 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:54:11.915792 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-c70a30d7-336f-42dc-b3fc-f566d8dffc76 tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:11.915792 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-c70a30d7-336f-42dc-b3fc-f566d8dffc76 tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] [instance: aadc9a05-66e2-45bb-8c2d-6755184a8e9c] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:11.918969 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c70a30d7-336f-42dc-b3fc-f566d8dffc76 tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:11.919737 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c70a30d7-336f-42dc-b3fc-f566d8dffc76 tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:11.920454 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c70a30d7-336f-42dc-b3fc-f566d8dffc76 tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:11.921428 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c70a30d7-336f-42dc-b3fc-f566d8dffc76 tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:11.922133 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c70a30d7-336f-42dc-b3fc-f566d8dffc76 tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:11.922786 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c70a30d7-336f-42dc-b3fc-f566d8dffc76 tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:11.981856 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-029da9c9-924e-4828-9b0e-f916e829e53f tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef659f5a1a24c439528a7675bdd70f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c92fe04ab8248399d0acb932f82d607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:11.991801 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-029da9c9-924e-4828-9b0e-f916e829e53f tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] 10.222.0.26 "GET /compute/v2.1/servers/73fd15ea-e4bd-4310-93bb-147b0a5e27ef" status: 200 len: 1470 microversion: 2.1 time: 0.317522 Oct 08 20:54:11.993154 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 354/756] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:54:11 2022] GET /compute/v2.1/servers/73fd15ea-e4bd-4310-93bb-147b0a5e27ef => generated 1470 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:54:12.011647 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-5f1891ce-623c-4382-a3b9-730618ae50ff req-da76904f-3f32-4eb6-8a44-2617f8044dfa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "139f7ae3-b380-4114-a566-6d496d4957f4", "tag": "34b7dd73-89eb-4b12-ac78-40ef20772247"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:54:12.023092 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-5f1891ce-623c-4382-a3b9-730618ae50ff req-da76904f-3f32-4eb6-8a44-2617f8044dfa service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:12.024061 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-5f1891ce-623c-4382-a3b9-730618ae50ff req-da76904f-3f32-4eb6-8a44-2617f8044dfa service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:12.025410 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-5f1891ce-623c-4382-a3b9-730618ae50ff req-da76904f-3f32-4eb6-8a44-2617f8044dfa service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:12.039905 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-5f1891ce-623c-4382-a3b9-730618ae50ff req-da76904f-3f32-4eb6-8a44-2617f8044dfa service nova] Creating event network-changed:34b7dd73-89eb-4b12-ac78-40ef20772247 for instance 139f7ae3-b380-4114-a566-6d496d4957f4 on nch1-master-1 Oct 08 20:54:12.048222 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-5f1891ce-623c-4382-a3b9-730618ae50ff req-da76904f-3f32-4eb6-8a44-2617f8044dfa service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052968 Oct 08 20:54:12.048840 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 355/757] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:54:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:54:12.055744 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-36182832-bf33-4bbc-a56f-9efd849ee1b1 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:12.056591 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-36182832-bf33-4bbc-a56f-9efd849ee1b1 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] [instance: 99d20873-ce34-47a4-bbe6-5b42e406a360] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:12.067360 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-36182832-bf33-4bbc-a56f-9efd849ee1b1 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:12.068569 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-36182832-bf33-4bbc-a56f-9efd849ee1b1 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:12.069373 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-36182832-bf33-4bbc-a56f-9efd849ee1b1 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:12.070828 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-36182832-bf33-4bbc-a56f-9efd849ee1b1 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:12.071747 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-36182832-bf33-4bbc-a56f-9efd849ee1b1 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:12.073370 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-36182832-bf33-4bbc-a56f-9efd849ee1b1 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:12.105569 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-36182832-bf33-4bbc-a56f-9efd849ee1b1 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] [instance: 99d20873-ce34-47a4-bbe6-5b42e406a360] Going to try to terminate instance {{(pid=140491) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 20:54:12.169818 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=5,nova_cell1:INSERT=2 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:54:12.221070 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-36182832-bf33-4bbc-a56f-9efd849ee1b1 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] 10.222.0.26 "DELETE /compute/v2.1/servers/99d20873-ce34-47a4-bbe6-5b42e406a360" status: 204 len: 0 microversion: 2.1 time: 0.170332 Oct 08 20:54:12.234369 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 356/758] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 20:54:12 2022] DELETE /compute/v2.1/servers/99d20873-ce34-47a4-bbe6-5b42e406a360 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 20:54:12.393860 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-b50d18ae-70c2-4fe3-95fc-9a551877a6f4 req-a79422f2-79e7-4e7c-a721-f2208be5c3a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aadc9a05-66e2-45bb-8c2d-6755184a8e9c", "name": "network-vif-plugged", "status": "completed", "tag": "30b8f676-1366-40cd-880f-839ba9c67d35"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:54:12.419373 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-b50d18ae-70c2-4fe3-95fc-9a551877a6f4 req-a79422f2-79e7-4e7c-a721-f2208be5c3a6 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:12.422448 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-b50d18ae-70c2-4fe3-95fc-9a551877a6f4 req-a79422f2-79e7-4e7c-a721-f2208be5c3a6 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:12.422939 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-b50d18ae-70c2-4fe3-95fc-9a551877a6f4 req-a79422f2-79e7-4e7c-a721-f2208be5c3a6 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:12.452562 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-b50d18ae-70c2-4fe3-95fc-9a551877a6f4 req-a79422f2-79e7-4e7c-a721-f2208be5c3a6 service nova] Creating event network-vif-plugged:30b8f676-1366-40cd-880f-839ba9c67d35 for instance aadc9a05-66e2-45bb-8c2d-6755184a8e9c on nch2-master-1 Oct 08 20:54:12.457999 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-b50d18ae-70c2-4fe3-95fc-9a551877a6f4 req-a79422f2-79e7-4e7c-a721-f2208be5c3a6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070959 Oct 08 20:54:12.458977 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 357/759] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:54:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:54:12.464022 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-6b646026-5cad-46d0-82b9-90c2fe71ed6b tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:12.464736 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-6b646026-5cad-46d0-82b9-90c2fe71ed6b tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] [instance: 139f7ae3-b380-4114-a566-6d496d4957f4] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:12.486939 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6b646026-5cad-46d0-82b9-90c2fe71ed6b tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:12.488799 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6b646026-5cad-46d0-82b9-90c2fe71ed6b tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:12.489288 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6b646026-5cad-46d0-82b9-90c2fe71ed6b tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:12.492355 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6b646026-5cad-46d0-82b9-90c2fe71ed6b tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:12.492864 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6b646026-5cad-46d0-82b9-90c2fe71ed6b tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:12.495414 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6b646026-5cad-46d0-82b9-90c2fe71ed6b tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:12.541154 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-c70a30d7-336f-42dc-b3fc-f566d8dffc76 tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68e264d0c2b54a5f8d1bd197b84a104a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a09d8f87c174336a1d216e396adfd33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:12.554415 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-c70a30d7-336f-42dc-b3fc-f566d8dffc76 tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] 10.222.0.26 "GET /compute/v2.1/servers/aadc9a05-66e2-45bb-8c2d-6755184a8e9c" status: 200 len: 1315 microversion: 2.1 time: 0.647745 Oct 08 20:54:12.555519 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 403/760] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:54:11 2022] GET /compute/v2.1/servers/aadc9a05-66e2-45bb-8c2d-6755184a8e9c => generated 1315 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:54:12.562907 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-7e0c6aa5-ba7f-4197-aac8-e14647a7fc81 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1187049189", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "1225441597", "adminPass": "***", "networks": [{"uuid": "ec0135a9-c543-49eb-bf82-1b3cd38a718e"}], "security_groups": [{"name": "tempest-securitygroup--1541716159"}], "key_name": "tempest-keypair-220477781", "user_data": "}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:54:12.828411 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.network.neutron [None req-7e0c6aa5-ba7f-4197-aac8-e14647a7fc81 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] validate_networks() for [('ec0135a9-c543-49eb-bf82-1b3cd38a718e', None, None, None, None, None)] {{(pid=140492) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 20:54:12.961727 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-6b646026-5cad-46d0-82b9-90c2fe71ed6b tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:12.971529 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-6b646026-5cad-46d0-82b9-90c2fe71ed6b tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:12.973153 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-6b646026-5cad-46d0-82b9-90c2fe71ed6b tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:12.974796 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-6b646026-5cad-46d0-82b9-90c2fe71ed6b tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] 10.222.0.26 "GET /compute/v2.1/servers/139f7ae3-b380-4114-a566-6d496d4957f4" status: 200 len: 1568 microversion: 2.25 time: 0.514513 Oct 08 20:54:12.975096 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 358/761] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:54:12 2022] GET /compute/v2.1/servers/139f7ae3-b380-4114-a566-6d496d4957f4 => generated 1568 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:54:12.979902 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-6f3c86d3-b9b8-4e35-8eb1-7cf0e477ce63 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:12.980745 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-6f3c86d3-b9b8-4e35-8eb1-7cf0e477ce63 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] [instance: a80fbf87-8203-4e6c-bee7-fe781bfccff1] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:12.994803 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6f3c86d3-b9b8-4e35-8eb1-7cf0e477ce63 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:12.995434 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6f3c86d3-b9b8-4e35-8eb1-7cf0e477ce63 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:12.995831 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6f3c86d3-b9b8-4e35-8eb1-7cf0e477ce63 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:12.996597 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6f3c86d3-b9b8-4e35-8eb1-7cf0e477ce63 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:12.997081 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6f3c86d3-b9b8-4e35-8eb1-7cf0e477ce63 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:12.997591 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6f3c86d3-b9b8-4e35-8eb1-7cf0e477ce63 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:13.119703 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=16 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:54:13.188894 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-6f3c86d3-b9b8-4e35-8eb1-7cf0e477ce63 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474ca64d1b1d4e30916b517645aba882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecc2dd2407b4819874bed09cb27959a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:13.199427 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-6f3c86d3-b9b8-4e35-8eb1-7cf0e477ce63 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] 10.222.0.26 "GET /compute/v2.1/servers/a80fbf87-8203-4e6c-bee7-fe781bfccff1" status: 200 len: 1311 microversion: 2.1 time: 0.222970 Oct 08 20:54:13.200284 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 359/762] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:54:12 2022] GET /compute/v2.1/servers/a80fbf87-8203-4e6c-bee7-fe781bfccff1 => generated 1311 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:54:13.208509 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-9991ba36-81e4-42af-a5ff-4847a3f5250e tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:13.209284 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-9991ba36-81e4-42af-a5ff-4847a3f5250e tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] [instance: 92e31b92-0af1-4da6-bc87-23978f1aedf5] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:13.216395 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9991ba36-81e4-42af-a5ff-4847a3f5250e tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:13.217753 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9991ba36-81e4-42af-a5ff-4847a3f5250e tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:13.218420 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9991ba36-81e4-42af-a5ff-4847a3f5250e tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:13.219372 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9991ba36-81e4-42af-a5ff-4847a3f5250e tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:13.220193 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9991ba36-81e4-42af-a5ff-4847a3f5250e tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:13.220696 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9991ba36-81e4-42af-a5ff-4847a3f5250e tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:13.312552 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-9991ba36-81e4-42af-a5ff-4847a3f5250e tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:13.321699 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-9991ba36-81e4-42af-a5ff-4847a3f5250e tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:13.323441 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-9991ba36-81e4-42af-a5ff-4847a3f5250e tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:13.329757 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-9991ba36-81e4-42af-a5ff-4847a3f5250e tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] 10.222.0.26 "GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5" status: 200 len: 1539 microversion: 2.91 time: 0.128277 Oct 08 20:54:13.330658 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 360/763] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:54:13 2022] GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5 => generated 1539 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:54:13.338997 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-ac908a3a-e082-4e94-ba3f-665681d81e7a tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:13.339619 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-ac908a3a-e082-4e94-ba3f-665681d81e7a tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] [instance: 73fd15ea-e4bd-4310-93bb-147b0a5e27ef] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:13.346187 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ac908a3a-e082-4e94-ba3f-665681d81e7a tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:13.346719 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ac908a3a-e082-4e94-ba3f-665681d81e7a tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:13.347385 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ac908a3a-e082-4e94-ba3f-665681d81e7a tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:13.348181 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ac908a3a-e082-4e94-ba3f-665681d81e7a tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:13.348964 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ac908a3a-e082-4e94-ba3f-665681d81e7a tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:13.349556 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ac908a3a-e082-4e94-ba3f-665681d81e7a tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:13.512165 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-7e0c6aa5-ba7f-4197-aac8-e14647a7fc81 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Flavor limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 20:54:13.512675 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-7e0c6aa5-ba7f-4197-aac8-e14647a7fc81 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Image limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 20:54:13.513297 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-7e0c6aa5-ba7f-4197-aac8-e14647a7fc81 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Flavor pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 20:54:13.513825 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-7e0c6aa5-ba7f-4197-aac8-e14647a7fc81 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Image pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 20:54:13.514340 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-7e0c6aa5-ba7f-4197-aac8-e14647a7fc81 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 20:54:13.525389 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7e0c6aa5-ba7f-4197-aac8-e14647a7fc81 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:13.526122 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7e0c6aa5-ba7f-4197-aac8-e14647a7fc81 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:13.527060 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7e0c6aa5-ba7f-4197-aac8-e14647a7fc81 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:13.537508 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7e0c6aa5-ba7f-4197-aac8-e14647a7fc81 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:13.538615 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7e0c6aa5-ba7f-4197-aac8-e14647a7fc81 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:13.539306 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7e0c6aa5-ba7f-4197-aac8-e14647a7fc81 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:13.561954 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-7e0c6aa5-ba7f-4197-aac8-e14647a7fc81 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Getting quotas for project 3f2441394d754f499e27f6f35d5b3afa. Resources: {'cores', 'instances', 'ram'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 20:54:13.567906 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-7e0c6aa5-ba7f-4197-aac8-e14647a7fc81 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Getting quotas for user 98936da9b5d94165b386d2d0893ac142 and project 3f2441394d754f499e27f6f35d5b3afa. Resources: {'cores', 'instances', 'ram'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 20:54:13.582681 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-7e0c6aa5-ba7f-4197-aac8-e14647a7fc81 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Going to run 1 instances... {{(pid=140492) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 20:54:13.585328 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-7e0c6aa5-ba7f-4197-aac8-e14647a7fc81 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] [instance: 84eba001-0fa3-4fb7-b74e-0bb54c527ac7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c508bd7f-7db9-4b2c-af7c-be54a855c355',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=140492) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 20:54:13.626800 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:54:13.652294 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-7e0c6aa5-ba7f-4197-aac8-e14647a7fc81 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.095195 Oct 08 20:54:13.653414 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 404/764] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 20:54:12 2022] POST /compute/v2.1/servers => generated 402 bytes in 1097 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 08 20:54:13.658899 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-96d65631-c257-4773-aaf1-8a9bad2aac24 tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:13.660210 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-96d65631-c257-4773-aaf1-8a9bad2aac24 tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] [instance: aadc9a05-66e2-45bb-8c2d-6755184a8e9c] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:13.667899 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-96d65631-c257-4773-aaf1-8a9bad2aac24 tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:13.668639 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-96d65631-c257-4773-aaf1-8a9bad2aac24 tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:13.669179 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-96d65631-c257-4773-aaf1-8a9bad2aac24 tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:13.670688 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-96d65631-c257-4773-aaf1-8a9bad2aac24 tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:13.671320 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-96d65631-c257-4773-aaf1-8a9bad2aac24 tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:13.671917 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-96d65631-c257-4773-aaf1-8a9bad2aac24 tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:13.695718 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-ac908a3a-e082-4e94-ba3f-665681d81e7a tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef659f5a1a24c439528a7675bdd70f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c92fe04ab8248399d0acb932f82d607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:13.710683 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-ac908a3a-e082-4e94-ba3f-665681d81e7a tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] 10.222.0.26 "GET /compute/v2.1/servers/73fd15ea-e4bd-4310-93bb-147b0a5e27ef" status: 200 len: 1470 microversion: 2.1 time: 0.378278 Oct 08 20:54:13.722623 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 361/765] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:54:13 2022] GET /compute/v2.1/servers/73fd15ea-e4bd-4310-93bb-147b0a5e27ef => generated 1470 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:54:13.731299 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-82d18dfd-4912-4464-9b5a-c203e103f646 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:13.731921 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-82d18dfd-4912-4464-9b5a-c203e103f646 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] [instance: 84eba001-0fa3-4fb7-b74e-0bb54c527ac7] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:13.887103 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-82d18dfd-4912-4464-9b5a-c203e103f646 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98936da9b5d94165b386d2d0893ac142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2441394d754f499e27f6f35d5b3afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:13.897170 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-82d18dfd-4912-4464-9b5a-c203e103f646 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] 10.222.0.26 "GET /compute/v2.1/servers/84eba001-0fa3-4fb7-b74e-0bb54c527ac7" status: 200 len: 1264 microversion: 2.1 time: 0.173198 Oct 08 20:54:13.898969 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 362/766] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:54:13 2022] GET /compute/v2.1/servers/84eba001-0fa3-4fb7-b74e-0bb54c527ac7 => generated 1264 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:54:14.005014 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-01776e57-a375-4f7a-993a-9caa63251fa8 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:14.006741 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-01776e57-a375-4f7a-993a-9caa63251fa8 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] [instance: 139f7ae3-b380-4114-a566-6d496d4957f4] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:14.010088 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-96d65631-c257-4773-aaf1-8a9bad2aac24 tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68e264d0c2b54a5f8d1bd197b84a104a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a09d8f87c174336a1d216e396adfd33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:14.017889 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-01776e57-a375-4f7a-993a-9caa63251fa8 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:14.018419 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-01776e57-a375-4f7a-993a-9caa63251fa8 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:14.018864 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-01776e57-a375-4f7a-993a-9caa63251fa8 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:14.019578 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-01776e57-a375-4f7a-993a-9caa63251fa8 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:14.020043 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-01776e57-a375-4f7a-993a-9caa63251fa8 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:14.020472 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-01776e57-a375-4f7a-993a-9caa63251fa8 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:14.024236 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-96d65631-c257-4773-aaf1-8a9bad2aac24 tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] 10.222.0.26 "GET /compute/v2.1/servers/aadc9a05-66e2-45bb-8c2d-6755184a8e9c" status: 200 len: 1315 microversion: 2.1 time: 0.369612 Oct 08 20:54:14.039014 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 405/767] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:54:13 2022] GET /compute/v2.1/servers/aadc9a05-66e2-45bb-8c2d-6755184a8e9c => generated 1315 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:54:14.224776 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-4283b8bb-1eb6-4967-9892-f53436de6d0c tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:14.226768 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-4283b8bb-1eb6-4967-9892-f53436de6d0c tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] [instance: a80fbf87-8203-4e6c-bee7-fe781bfccff1] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:14.240532 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4283b8bb-1eb6-4967-9892-f53436de6d0c tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:14.242745 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4283b8bb-1eb6-4967-9892-f53436de6d0c tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:14.243645 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4283b8bb-1eb6-4967-9892-f53436de6d0c tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:14.244910 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4283b8bb-1eb6-4967-9892-f53436de6d0c tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:14.245935 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4283b8bb-1eb6-4967-9892-f53436de6d0c tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:14.247094 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4283b8bb-1eb6-4967-9892-f53436de6d0c tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:14.572691 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-4283b8bb-1eb6-4967-9892-f53436de6d0c tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474ca64d1b1d4e30916b517645aba882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecc2dd2407b4819874bed09cb27959a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:14.588808 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-4283b8bb-1eb6-4967-9892-f53436de6d0c tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] 10.222.0.26 "GET /compute/v2.1/servers/a80fbf87-8203-4e6c-bee7-fe781bfccff1" status: 200 len: 1311 microversion: 2.1 time: 0.369082 Oct 08 20:54:14.590382 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 406/768] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:54:14 2022] GET /compute/v2.1/servers/a80fbf87-8203-4e6c-bee7-fe781bfccff1 => generated 1311 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 20:54:14.596936 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-a4559d12-1f17-4e1c-bb98-9efb44a37c40 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:14.597908 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-a4559d12-1f17-4e1c-bb98-9efb44a37c40 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] [instance: 92e31b92-0af1-4da6-bc87-23978f1aedf5] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:14.605352 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a4559d12-1f17-4e1c-bb98-9efb44a37c40 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:14.606201 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a4559d12-1f17-4e1c-bb98-9efb44a37c40 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:14.606909 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a4559d12-1f17-4e1c-bb98-9efb44a37c40 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:14.607961 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a4559d12-1f17-4e1c-bb98-9efb44a37c40 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:14.608714 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a4559d12-1f17-4e1c-bb98-9efb44a37c40 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:14.609405 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a4559d12-1f17-4e1c-bb98-9efb44a37c40 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:14.699491 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-01776e57-a375-4f7a-993a-9caa63251fa8 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:14.699886 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-a4559d12-1f17-4e1c-bb98-9efb44a37c40 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:14.708981 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-01776e57-a375-4f7a-993a-9caa63251fa8 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:14.710553 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-01776e57-a375-4f7a-993a-9caa63251fa8 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:14.711803 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-01776e57-a375-4f7a-993a-9caa63251fa8 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] 10.222.0.26 "GET /compute/v2.1/servers/139f7ae3-b380-4114-a566-6d496d4957f4" status: 200 len: 1568 microversion: 2.25 time: 0.715581 Oct 08 20:54:14.712404 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 363/769] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:54:13 2022] GET /compute/v2.1/servers/139f7ae3-b380-4114-a566-6d496d4957f4 => generated 1568 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:54:14.723699 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-a4559d12-1f17-4e1c-bb98-9efb44a37c40 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:14.723699 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-a4559d12-1f17-4e1c-bb98-9efb44a37c40 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:14.728218 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-a4559d12-1f17-4e1c-bb98-9efb44a37c40 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] 10.222.0.26 "GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5" status: 200 len: 1539 microversion: 2.91 time: 0.136190 Oct 08 20:54:14.728807 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 407/770] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:54:14 2022] GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5 => generated 1539 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:54:14.730495 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-336c4582-4057-4ab1-bba3-30b6f1da490a req-debe05c1-aa3f-4c5d-a89d-952a5b41bada service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a80fbf87-8203-4e6c-bee7-fe781bfccff1", "name": "network-vif-plugged", "status": "completed", "tag": "01d74faf-31a5-494a-9dba-c900226fd0a9"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:54:14.747765 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-765623cd-6ebe-4d1e-b857-69859d4cbeb7 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:14.748611 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-765623cd-6ebe-4d1e-b857-69859d4cbeb7 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] [instance: 73fd15ea-e4bd-4310-93bb-147b0a5e27ef] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:14.752683 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-336c4582-4057-4ab1-bba3-30b6f1da490a req-debe05c1-aa3f-4c5d-a89d-952a5b41bada service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:14.756699 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-336c4582-4057-4ab1-bba3-30b6f1da490a req-debe05c1-aa3f-4c5d-a89d-952a5b41bada service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:14.758265 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-765623cd-6ebe-4d1e-b857-69859d4cbeb7 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:14.758679 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-336c4582-4057-4ab1-bba3-30b6f1da490a req-debe05c1-aa3f-4c5d-a89d-952a5b41bada service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:14.762172 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-765623cd-6ebe-4d1e-b857-69859d4cbeb7 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:14.763033 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-765623cd-6ebe-4d1e-b857-69859d4cbeb7 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:14.764571 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-765623cd-6ebe-4d1e-b857-69859d4cbeb7 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:14.766915 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-765623cd-6ebe-4d1e-b857-69859d4cbeb7 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:14.767941 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-765623cd-6ebe-4d1e-b857-69859d4cbeb7 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:14.785075 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-336c4582-4057-4ab1-bba3-30b6f1da490a req-debe05c1-aa3f-4c5d-a89d-952a5b41bada service nova] Creating event network-vif-plugged:01d74faf-31a5-494a-9dba-c900226fd0a9 for instance a80fbf87-8203-4e6c-bee7-fe781bfccff1 on nch2-master-1 Oct 08 20:54:14.803999 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-336c4582-4057-4ab1-bba3-30b6f1da490a req-debe05c1-aa3f-4c5d-a89d-952a5b41bada service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089913 Oct 08 20:54:14.805667 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 364/771] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:54:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:54:14.923301 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-1e9e9d4c-a308-4b38-bbce-bc490241cbeb tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:14.924120 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-1e9e9d4c-a308-4b38-bbce-bc490241cbeb tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] [instance: 84eba001-0fa3-4fb7-b74e-0bb54c527ac7] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:14.939368 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1e9e9d4c-a308-4b38-bbce-bc490241cbeb tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:14.940140 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1e9e9d4c-a308-4b38-bbce-bc490241cbeb tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:14.941947 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1e9e9d4c-a308-4b38-bbce-bc490241cbeb tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:14.943603 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1e9e9d4c-a308-4b38-bbce-bc490241cbeb tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:14.949309 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1e9e9d4c-a308-4b38-bbce-bc490241cbeb tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:14.950067 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1e9e9d4c-a308-4b38-bbce-bc490241cbeb tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:15.106351 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-1e9e9d4c-a308-4b38-bbce-bc490241cbeb tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98936da9b5d94165b386d2d0893ac142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2441394d754f499e27f6f35d5b3afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:15.123552 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-1e9e9d4c-a308-4b38-bbce-bc490241cbeb tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] 10.222.0.26 "GET /compute/v2.1/servers/84eba001-0fa3-4fb7-b74e-0bb54c527ac7" status: 200 len: 1316 microversion: 2.1 time: 0.205451 Oct 08 20:54:15.133464 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 365/772] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:54:14 2022] GET /compute/v2.1/servers/84eba001-0fa3-4fb7-b74e-0bb54c527ac7 => generated 1316 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 20:54:15.138512 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-faeadf0d-a036-475e-b4b2-72cef239af6b tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:15.139647 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-faeadf0d-a036-475e-b4b2-72cef239af6b tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] [instance: aadc9a05-66e2-45bb-8c2d-6755184a8e9c] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:15.146513 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-faeadf0d-a036-475e-b4b2-72cef239af6b tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:15.147337 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-faeadf0d-a036-475e-b4b2-72cef239af6b tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:15.147996 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-faeadf0d-a036-475e-b4b2-72cef239af6b tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:15.149755 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-faeadf0d-a036-475e-b4b2-72cef239af6b tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:15.151344 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-faeadf0d-a036-475e-b4b2-72cef239af6b tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:15.152021 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-faeadf0d-a036-475e-b4b2-72cef239af6b tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:15.550338 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-faeadf0d-a036-475e-b4b2-72cef239af6b tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68e264d0c2b54a5f8d1bd197b84a104a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a09d8f87c174336a1d216e396adfd33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:15.560657 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-765623cd-6ebe-4d1e-b857-69859d4cbeb7 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef659f5a1a24c439528a7675bdd70f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c92fe04ab8248399d0acb932f82d607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:15.563557 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-faeadf0d-a036-475e-b4b2-72cef239af6b tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] 10.222.0.26 "GET /compute/v2.1/servers/aadc9a05-66e2-45bb-8c2d-6755184a8e9c" status: 200 len: 1504 microversion: 2.1 time: 0.428718 Oct 08 20:54:15.564149 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 366/773] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:54:15 2022] GET /compute/v2.1/servers/aadc9a05-66e2-45bb-8c2d-6755184a8e9c => generated 1504 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:54:15.571298 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-765623cd-6ebe-4d1e-b857-69859d4cbeb7 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] 10.222.0.26 "GET /compute/v2.1/servers/73fd15ea-e4bd-4310-93bb-147b0a5e27ef" status: 200 len: 1470 microversion: 2.1 time: 0.828817 Oct 08 20:54:15.571870 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 408/774] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:54:14 2022] GET /compute/v2.1/servers/73fd15ea-e4bd-4310-93bb-147b0a5e27ef => generated 1470 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 20:54:15.589181 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-cc42d777-a948-4314-a238-15bbe634e212 tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:15.590006 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-cc42d777-a948-4314-a238-15bbe634e212 tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] [instance: aadc9a05-66e2-45bb-8c2d-6755184a8e9c] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:15.597087 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cc42d777-a948-4314-a238-15bbe634e212 tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:15.603710 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cc42d777-a948-4314-a238-15bbe634e212 tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:15.604531 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cc42d777-a948-4314-a238-15bbe634e212 tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:15.605547 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cc42d777-a948-4314-a238-15bbe634e212 tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:15.606257 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cc42d777-a948-4314-a238-15bbe634e212 tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:15.606901 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cc42d777-a948-4314-a238-15bbe634e212 tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:15.619532 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-f13f916a-2b0d-4311-bcd2-b8cbd9341e0d tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:15.620419 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-f13f916a-2b0d-4311-bcd2-b8cbd9341e0d tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] [instance: a80fbf87-8203-4e6c-bee7-fe781bfccff1] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:15.629864 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f13f916a-2b0d-4311-bcd2-b8cbd9341e0d tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:15.630811 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f13f916a-2b0d-4311-bcd2-b8cbd9341e0d tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:15.631416 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f13f916a-2b0d-4311-bcd2-b8cbd9341e0d tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:15.633158 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f13f916a-2b0d-4311-bcd2-b8cbd9341e0d tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:15.634487 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f13f916a-2b0d-4311-bcd2-b8cbd9341e0d tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:15.635074 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f13f916a-2b0d-4311-bcd2-b8cbd9341e0d tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:15.654320 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-cc42d777-a948-4314-a238-15bbe634e212 tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] [instance: aadc9a05-66e2-45bb-8c2d-6755184a8e9c] Going to try to terminate instance {{(pid=140491) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 20:54:15.819887 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-cc42d777-a948-4314-a238-15bbe634e212 tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] 10.222.0.26 "DELETE /compute/v2.1/servers/aadc9a05-66e2-45bb-8c2d-6755184a8e9c" status: 204 len: 0 microversion: 2.1 time: 0.233324 Oct 08 20:54:15.824131 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 367/775] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 20:54:15 2022] DELETE /compute/v2.1/servers/aadc9a05-66e2-45bb-8c2d-6755184a8e9c => generated 0 bytes in 236 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 20:54:15.850254 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-4b1df7a7-b9f4-47e5-8521-81e8dfe9dddd tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:15.851018 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-4b1df7a7-b9f4-47e5-8521-81e8dfe9dddd tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] [instance: 139f7ae3-b380-4114-a566-6d496d4957f4] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:15.862444 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4b1df7a7-b9f4-47e5-8521-81e8dfe9dddd tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:15.863176 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4b1df7a7-b9f4-47e5-8521-81e8dfe9dddd tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:15.864322 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4b1df7a7-b9f4-47e5-8521-81e8dfe9dddd tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:15.865395 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4b1df7a7-b9f4-47e5-8521-81e8dfe9dddd tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:15.866051 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4b1df7a7-b9f4-47e5-8521-81e8dfe9dddd tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:15.866636 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4b1df7a7-b9f4-47e5-8521-81e8dfe9dddd tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:15.993392 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-f13f916a-2b0d-4311-bcd2-b8cbd9341e0d tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474ca64d1b1d4e30916b517645aba882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecc2dd2407b4819874bed09cb27959a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:16.003859 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-f13f916a-2b0d-4311-bcd2-b8cbd9341e0d tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] 10.222.0.26 "GET /compute/v2.1/servers/a80fbf87-8203-4e6c-bee7-fe781bfccff1" status: 200 len: 1311 microversion: 2.1 time: 0.388838 Oct 08 20:54:16.004766 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 409/776] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:54:15 2022] GET /compute/v2.1/servers/a80fbf87-8203-4e6c-bee7-fe781bfccff1 => generated 1311 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:54:16.010830 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-622dd46c-d700-4d3a-9299-1c762d5b7f16 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:16.011494 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-622dd46c-d700-4d3a-9299-1c762d5b7f16 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] [instance: 92e31b92-0af1-4da6-bc87-23978f1aedf5] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:16.019248 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-622dd46c-d700-4d3a-9299-1c762d5b7f16 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:16.019942 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-622dd46c-d700-4d3a-9299-1c762d5b7f16 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:16.020545 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-622dd46c-d700-4d3a-9299-1c762d5b7f16 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:16.021470 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-622dd46c-d700-4d3a-9299-1c762d5b7f16 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:16.022102 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-622dd46c-d700-4d3a-9299-1c762d5b7f16 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:16.022540 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-622dd46c-d700-4d3a-9299-1c762d5b7f16 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:16.143909 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-622dd46c-d700-4d3a-9299-1c762d5b7f16 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:16.157021 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-622dd46c-d700-4d3a-9299-1c762d5b7f16 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:16.160183 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-622dd46c-d700-4d3a-9299-1c762d5b7f16 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:16.169336 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-622dd46c-d700-4d3a-9299-1c762d5b7f16 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] 10.222.0.26 "GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5" status: 200 len: 1539 microversion: 2.91 time: 0.163157 Oct 08 20:54:16.170416 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 410/777] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:54:16 2022] GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5 => generated 1539 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:54:16.178784 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-1ec52299-568f-47c0-91dc-18eafb4b5280 tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:16.179753 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-1ec52299-568f-47c0-91dc-18eafb4b5280 tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] [instance: aadc9a05-66e2-45bb-8c2d-6755184a8e9c] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:16.194619 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1ec52299-568f-47c0-91dc-18eafb4b5280 tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:16.195457 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1ec52299-568f-47c0-91dc-18eafb4b5280 tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:16.196395 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1ec52299-568f-47c0-91dc-18eafb4b5280 tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:16.198073 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1ec52299-568f-47c0-91dc-18eafb4b5280 tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:16.199392 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1ec52299-568f-47c0-91dc-18eafb4b5280 tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:16.200467 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1ec52299-568f-47c0-91dc-18eafb4b5280 tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:16.305751 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-4b1df7a7-b9f4-47e5-8521-81e8dfe9dddd tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:16.337330 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-4b1df7a7-b9f4-47e5-8521-81e8dfe9dddd tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:16.339255 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-4b1df7a7-b9f4-47e5-8521-81e8dfe9dddd tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:16.340807 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-4b1df7a7-b9f4-47e5-8521-81e8dfe9dddd tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] 10.222.0.26 "GET /compute/v2.1/servers/139f7ae3-b380-4114-a566-6d496d4957f4" status: 200 len: 1568 microversion: 2.25 time: 0.514399 Oct 08 20:54:16.341737 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 368/778] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:54:15 2022] GET /compute/v2.1/servers/139f7ae3-b380-4114-a566-6d496d4957f4 => generated 1568 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:54:16.367003 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-dc031cd8-39ea-4f9b-a6e9-358f3e5ec941 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:16.368453 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-dc031cd8-39ea-4f9b-a6e9-358f3e5ec941 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] [instance: 84eba001-0fa3-4fb7-b74e-0bb54c527ac7] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:16.377395 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dc031cd8-39ea-4f9b-a6e9-358f3e5ec941 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:16.378499 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dc031cd8-39ea-4f9b-a6e9-358f3e5ec941 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:16.380252 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dc031cd8-39ea-4f9b-a6e9-358f3e5ec941 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:16.381308 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dc031cd8-39ea-4f9b-a6e9-358f3e5ec941 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:16.382853 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dc031cd8-39ea-4f9b-a6e9-358f3e5ec941 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:16.383505 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dc031cd8-39ea-4f9b-a6e9-358f3e5ec941 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:16.526051 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-1ec52299-568f-47c0-91dc-18eafb4b5280 tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68e264d0c2b54a5f8d1bd197b84a104a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a09d8f87c174336a1d216e396adfd33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:16.552979 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-1ec52299-568f-47c0-91dc-18eafb4b5280 tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] 10.222.0.26 "GET /compute/v2.1/servers/aadc9a05-66e2-45bb-8c2d-6755184a8e9c" status: 200 len: 1510 microversion: 2.1 time: 0.379580 Oct 08 20:54:16.553784 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 411/779] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:54:16 2022] GET /compute/v2.1/servers/aadc9a05-66e2-45bb-8c2d-6755184a8e9c => generated 1510 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:54:16.597381 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-87b53270-6338-4f41-858e-5b415c79e2c0 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:16.598053 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-87b53270-6338-4f41-858e-5b415c79e2c0 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] [instance: 73fd15ea-e4bd-4310-93bb-147b0a5e27ef] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:16.609835 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-87b53270-6338-4f41-858e-5b415c79e2c0 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:16.610366 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-87b53270-6338-4f41-858e-5b415c79e2c0 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:16.613860 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-87b53270-6338-4f41-858e-5b415c79e2c0 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:16.614425 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-87b53270-6338-4f41-858e-5b415c79e2c0 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:16.615075 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-87b53270-6338-4f41-858e-5b415c79e2c0 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:16.615526 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-87b53270-6338-4f41-858e-5b415c79e2c0 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:16.630578 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-dc031cd8-39ea-4f9b-a6e9-358f3e5ec941 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98936da9b5d94165b386d2d0893ac142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2441394d754f499e27f6f35d5b3afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:16.660564 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-dc031cd8-39ea-4f9b-a6e9-358f3e5ec941 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] 10.222.0.26 "GET /compute/v2.1/servers/84eba001-0fa3-4fb7-b74e-0bb54c527ac7" status: 200 len: 1324 microversion: 2.1 time: 0.301067 Oct 08 20:54:16.661310 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 369/780] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:54:16 2022] GET /compute/v2.1/servers/84eba001-0fa3-4fb7-b74e-0bb54c527ac7 => generated 1324 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:54:16.720213 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-977edc1a-4cf0-40b4-8ff2-f3d44d145605 req-33e30bbf-e66e-4eaa-8544-9d5f2763b69a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99d20873-ce34-47a4-bbe6-5b42e406a360", "name": "network-vif-deleted", "tag": "79841dd5-37cd-46cf-878f-6cb318265fee"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:54:16.781733 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-977edc1a-4cf0-40b4-8ff2-f3d44d145605 req-33e30bbf-e66e-4eaa-8544-9d5f2763b69a service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:16.786365 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-977edc1a-4cf0-40b4-8ff2-f3d44d145605 req-33e30bbf-e66e-4eaa-8544-9d5f2763b69a service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:16.786834 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-977edc1a-4cf0-40b4-8ff2-f3d44d145605 req-33e30bbf-e66e-4eaa-8544-9d5f2763b69a service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:16.834465 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-977edc1a-4cf0-40b4-8ff2-f3d44d145605 req-33e30bbf-e66e-4eaa-8544-9d5f2763b69a service nova] Creating event network-vif-deleted:79841dd5-37cd-46cf-878f-6cb318265fee for instance 99d20873-ce34-47a4-bbe6-5b42e406a360 on nch1-master-1 Oct 08 20:54:16.851790 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-977edc1a-4cf0-40b4-8ff2-f3d44d145605 req-33e30bbf-e66e-4eaa-8544-9d5f2763b69a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133448 Oct 08 20:54:16.852552 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 370/781] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:54:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 08 20:54:17.030489 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-540a6de4-9905-495f-ba30-4ec7f2ea61a7 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:17.031985 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-540a6de4-9905-495f-ba30-4ec7f2ea61a7 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] [instance: a80fbf87-8203-4e6c-bee7-fe781bfccff1] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:17.049563 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-540a6de4-9905-495f-ba30-4ec7f2ea61a7 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:17.050740 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-540a6de4-9905-495f-ba30-4ec7f2ea61a7 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:17.053784 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-540a6de4-9905-495f-ba30-4ec7f2ea61a7 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:17.057341 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-540a6de4-9905-495f-ba30-4ec7f2ea61a7 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:17.060028 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-540a6de4-9905-495f-ba30-4ec7f2ea61a7 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:17.070417 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-540a6de4-9905-495f-ba30-4ec7f2ea61a7 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:17.143027 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-87b53270-6338-4f41-858e-5b415c79e2c0 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef659f5a1a24c439528a7675bdd70f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c92fe04ab8248399d0acb932f82d607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:17.153399 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-87b53270-6338-4f41-858e-5b415c79e2c0 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] 10.222.0.26 "GET /compute/v2.1/servers/73fd15ea-e4bd-4310-93bb-147b0a5e27ef" status: 200 len: 1470 microversion: 2.1 time: 0.561782 Oct 08 20:54:17.169569 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 412/782] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:54:16 2022] GET /compute/v2.1/servers/73fd15ea-e4bd-4310-93bb-147b0a5e27ef => generated 1470 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 20:54:17.200105 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-3018696e-204a-401a-b348-b280bc55e42e tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:17.200978 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-3018696e-204a-401a-b348-b280bc55e42e tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] [instance: 92e31b92-0af1-4da6-bc87-23978f1aedf5] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:17.212179 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3018696e-204a-401a-b348-b280bc55e42e tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:17.212813 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3018696e-204a-401a-b348-b280bc55e42e tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:17.213314 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3018696e-204a-401a-b348-b280bc55e42e tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:17.214036 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3018696e-204a-401a-b348-b280bc55e42e tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:17.216673 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3018696e-204a-401a-b348-b280bc55e42e tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:17.218815 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3018696e-204a-401a-b348-b280bc55e42e tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:17.346756 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-540a6de4-9905-495f-ba30-4ec7f2ea61a7 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474ca64d1b1d4e30916b517645aba882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecc2dd2407b4819874bed09cb27959a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:17.356246 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-540a6de4-9905-495f-ba30-4ec7f2ea61a7 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] 10.222.0.26 "GET /compute/v2.1/servers/a80fbf87-8203-4e6c-bee7-fe781bfccff1" status: 200 len: 1311 microversion: 2.1 time: 0.331332 Oct 08 20:54:17.370100 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 371/783] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:54:17 2022] GET /compute/v2.1/servers/a80fbf87-8203-4e6c-bee7-fe781bfccff1 => generated 1311 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:54:17.376313 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-3018696e-204a-401a-b348-b280bc55e42e tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:17.384595 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-53647e68-6ebb-4050-9115-ab0d44558e50 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:17.385525 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-53647e68-6ebb-4050-9115-ab0d44558e50 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] [instance: 139f7ae3-b380-4114-a566-6d496d4957f4] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:17.387459 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-3018696e-204a-401a-b348-b280bc55e42e tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:17.390516 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-3018696e-204a-401a-b348-b280bc55e42e tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:17.396519 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-53647e68-6ebb-4050-9115-ab0d44558e50 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:17.397032 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-53647e68-6ebb-4050-9115-ab0d44558e50 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:17.397419 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-3018696e-204a-401a-b348-b280bc55e42e tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] 10.222.0.26 "GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5" status: 200 len: 1539 microversion: 2.91 time: 0.200846 Oct 08 20:54:17.398573 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 413/784] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:54:17 2022] GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5 => generated 1539 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 08 20:54:17.400050 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-53647e68-6ebb-4050-9115-ab0d44558e50 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:17.401597 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-53647e68-6ebb-4050-9115-ab0d44558e50 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:17.402084 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-53647e68-6ebb-4050-9115-ab0d44558e50 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:17.402523 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-53647e68-6ebb-4050-9115-ab0d44558e50 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:17.579346 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-78e7abac-fb26-46d6-88ec-2ec530cc9f7a tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:17.579978 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-78e7abac-fb26-46d6-88ec-2ec530cc9f7a tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] [instance: aadc9a05-66e2-45bb-8c2d-6755184a8e9c] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:17.589386 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-78e7abac-fb26-46d6-88ec-2ec530cc9f7a tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:17.591867 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-78e7abac-fb26-46d6-88ec-2ec530cc9f7a tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:17.593225 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-78e7abac-fb26-46d6-88ec-2ec530cc9f7a tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:17.598049 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-78e7abac-fb26-46d6-88ec-2ec530cc9f7a tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:17.598697 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-78e7abac-fb26-46d6-88ec-2ec530cc9f7a tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:17.599158 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-78e7abac-fb26-46d6-88ec-2ec530cc9f7a tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:17.659918 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-53647e68-6ebb-4050-9115-ab0d44558e50 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:17.669158 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-53647e68-6ebb-4050-9115-ab0d44558e50 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:17.674384 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-53647e68-6ebb-4050-9115-ab0d44558e50 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:17.675748 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-53647e68-6ebb-4050-9115-ab0d44558e50 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] 10.222.0.26 "GET /compute/v2.1/servers/139f7ae3-b380-4114-a566-6d496d4957f4" status: 200 len: 1568 microversion: 2.25 time: 0.302218 Oct 08 20:54:17.676523 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 372/785] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:54:17 2022] GET /compute/v2.1/servers/139f7ae3-b380-4114-a566-6d496d4957f4 => generated 1568 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:54:17.704746 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-a287520f-4bac-40aa-8625-abf81843c95b tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:17.705684 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-a287520f-4bac-40aa-8625-abf81843c95b tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] [instance: 84eba001-0fa3-4fb7-b74e-0bb54c527ac7] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:17.712412 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a287520f-4bac-40aa-8625-abf81843c95b tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:17.713138 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a287520f-4bac-40aa-8625-abf81843c95b tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:17.713793 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a287520f-4bac-40aa-8625-abf81843c95b tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:17.714679 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a287520f-4bac-40aa-8625-abf81843c95b tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:17.715843 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a287520f-4bac-40aa-8625-abf81843c95b tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:17.716447 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a287520f-4bac-40aa-8625-abf81843c95b tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:17.963606 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-a287520f-4bac-40aa-8625-abf81843c95b tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98936da9b5d94165b386d2d0893ac142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2441394d754f499e27f6f35d5b3afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:17.990540 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-a287520f-4bac-40aa-8625-abf81843c95b tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] 10.222.0.26 "GET /compute/v2.1/servers/84eba001-0fa3-4fb7-b74e-0bb54c527ac7" status: 200 len: 1324 microversion: 2.1 time: 0.302028 Oct 08 20:54:17.998187 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 373/786] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:54:17 2022] GET /compute/v2.1/servers/84eba001-0fa3-4fb7-b74e-0bb54c527ac7 => generated 1324 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:54:18.178809 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-45d00012-9447-4109-a467-af3590860b91 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:18.179428 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-45d00012-9447-4109-a467-af3590860b91 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] [instance: 73fd15ea-e4bd-4310-93bb-147b0a5e27ef] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:18.207274 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-45d00012-9447-4109-a467-af3590860b91 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:18.208319 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-45d00012-9447-4109-a467-af3590860b91 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:18.209000 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-45d00012-9447-4109-a467-af3590860b91 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:18.212615 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-45d00012-9447-4109-a467-af3590860b91 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:18.214542 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-45d00012-9447-4109-a467-af3590860b91 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:18.216046 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-45d00012-9447-4109-a467-af3590860b91 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:18.271410 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:54:18.285024 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-78e7abac-fb26-46d6-88ec-2ec530cc9f7a tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68e264d0c2b54a5f8d1bd197b84a104a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a09d8f87c174336a1d216e396adfd33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:18.295378 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-78e7abac-fb26-46d6-88ec-2ec530cc9f7a tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] 10.222.0.26 "GET /compute/v2.1/servers/aadc9a05-66e2-45bb-8c2d-6755184a8e9c" status: 200 len: 1510 microversion: 2.1 time: 0.720512 Oct 08 20:54:18.297334 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 414/787] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:54:17 2022] GET /compute/v2.1/servers/aadc9a05-66e2-45bb-8c2d-6755184a8e9c => generated 1510 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:54:18.381541 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-1b547e69-f8bf-4bb6-b842-9421a1f6f301 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:18.382486 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-1b547e69-f8bf-4bb6-b842-9421a1f6f301 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] [instance: a80fbf87-8203-4e6c-bee7-fe781bfccff1] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:18.391829 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1b547e69-f8bf-4bb6-b842-9421a1f6f301 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:18.394399 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1b547e69-f8bf-4bb6-b842-9421a1f6f301 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:18.395445 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1b547e69-f8bf-4bb6-b842-9421a1f6f301 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:18.399752 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1b547e69-f8bf-4bb6-b842-9421a1f6f301 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:18.400771 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1b547e69-f8bf-4bb6-b842-9421a1f6f301 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:18.401467 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1b547e69-f8bf-4bb6-b842-9421a1f6f301 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:18.417466 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:54:18.453092 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-45d00012-9447-4109-a467-af3590860b91 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef659f5a1a24c439528a7675bdd70f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c92fe04ab8248399d0acb932f82d607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:18.467000 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-45d00012-9447-4109-a467-af3590860b91 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] 10.222.0.26 "GET /compute/v2.1/servers/73fd15ea-e4bd-4310-93bb-147b0a5e27ef" status: 200 len: 1470 microversion: 2.1 time: 0.292168 Oct 08 20:54:18.468289 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 374/788] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:54:18 2022] GET /compute/v2.1/servers/73fd15ea-e4bd-4310-93bb-147b0a5e27ef => generated 1470 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:54:18.477360 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-e2e37810-e576-4cae-a9dc-8a5d5f19748a tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:18.481977 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-e2e37810-e576-4cae-a9dc-8a5d5f19748a tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] [instance: 92e31b92-0af1-4da6-bc87-23978f1aedf5] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:18.515278 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e2e37810-e576-4cae-a9dc-8a5d5f19748a tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:18.517325 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e2e37810-e576-4cae-a9dc-8a5d5f19748a tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:18.518975 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e2e37810-e576-4cae-a9dc-8a5d5f19748a tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:18.521425 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e2e37810-e576-4cae-a9dc-8a5d5f19748a tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:18.525169 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e2e37810-e576-4cae-a9dc-8a5d5f19748a tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:18.525923 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e2e37810-e576-4cae-a9dc-8a5d5f19748a tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:18.664146 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-e2e37810-e576-4cae-a9dc-8a5d5f19748a tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:18.675785 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-e2e37810-e576-4cae-a9dc-8a5d5f19748a tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:18.680124 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-e2e37810-e576-4cae-a9dc-8a5d5f19748a tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:18.690482 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-e2e37810-e576-4cae-a9dc-8a5d5f19748a tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] 10.222.0.26 "GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5" status: 200 len: 1539 microversion: 2.91 time: 0.219690 Oct 08 20:54:18.692267 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 375/789] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:54:18 2022] GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5 => generated 1539 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:54:18.711294 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c972c9ed-b0f4-436b-9c25-829e42cdc262 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:18.712490 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-c972c9ed-b0f4-436b-9c25-829e42cdc262 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] [instance: 139f7ae3-b380-4114-a566-6d496d4957f4] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:18.722549 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c972c9ed-b0f4-436b-9c25-829e42cdc262 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:18.723307 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c972c9ed-b0f4-436b-9c25-829e42cdc262 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:18.723918 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c972c9ed-b0f4-436b-9c25-829e42cdc262 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:18.724980 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c972c9ed-b0f4-436b-9c25-829e42cdc262 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:18.741636 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c972c9ed-b0f4-436b-9c25-829e42cdc262 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:18.742222 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c972c9ed-b0f4-436b-9c25-829e42cdc262 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:19.242967 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-1b547e69-f8bf-4bb6-b842-9421a1f6f301 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474ca64d1b1d4e30916b517645aba882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecc2dd2407b4819874bed09cb27959a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:19.252869 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-1b547e69-f8bf-4bb6-b842-9421a1f6f301 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] 10.222.0.26 "GET /compute/v2.1/servers/a80fbf87-8203-4e6c-bee7-fe781bfccff1" status: 200 len: 1495 microversion: 2.1 time: 0.875068 Oct 08 20:54:19.254162 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 415/790] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:54:18 2022] GET /compute/v2.1/servers/a80fbf87-8203-4e6c-bee7-fe781bfccff1 => generated 1495 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 20:54:19.259010 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-9b104b0c-e0f9-436a-8838-61f644857150 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:19.259762 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-9b104b0c-e0f9-436a-8838-61f644857150 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] [instance: 84eba001-0fa3-4fb7-b74e-0bb54c527ac7] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:19.267067 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9b104b0c-e0f9-436a-8838-61f644857150 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:19.267808 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9b104b0c-e0f9-436a-8838-61f644857150 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:19.268495 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9b104b0c-e0f9-436a-8838-61f644857150 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:19.269462 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9b104b0c-e0f9-436a-8838-61f644857150 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:19.270144 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9b104b0c-e0f9-436a-8838-61f644857150 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:19.270790 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9b104b0c-e0f9-436a-8838-61f644857150 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:19.304709 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-c972c9ed-b0f4-436b-9c25-829e42cdc262 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:19.323854 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-c972c9ed-b0f4-436b-9c25-829e42cdc262 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:19.325341 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-c972c9ed-b0f4-436b-9c25-829e42cdc262 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:19.327575 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-c972c9ed-b0f4-436b-9c25-829e42cdc262 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] 10.222.0.26 "GET /compute/v2.1/servers/139f7ae3-b380-4114-a566-6d496d4957f4" status: 200 len: 1568 microversion: 2.25 time: 0.622859 Oct 08 20:54:19.328342 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 376/791] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:54:18 2022] GET /compute/v2.1/servers/139f7ae3-b380-4114-a566-6d496d4957f4 => generated 1568 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:54:19.334077 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-08dee49d-705c-4313-b5e6-ceaf25da8c1a tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:19.334954 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-08dee49d-705c-4313-b5e6-ceaf25da8c1a tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] [instance: a80fbf87-8203-4e6c-bee7-fe781bfccff1] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:19.345712 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-08dee49d-705c-4313-b5e6-ceaf25da8c1a tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:19.346672 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-08dee49d-705c-4313-b5e6-ceaf25da8c1a tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:19.347303 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-08dee49d-705c-4313-b5e6-ceaf25da8c1a tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:19.348165 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-08dee49d-705c-4313-b5e6-ceaf25da8c1a tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:19.348709 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-08dee49d-705c-4313-b5e6-ceaf25da8c1a tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:19.349236 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-08dee49d-705c-4313-b5e6-ceaf25da8c1a tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:19.449301 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=10 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:54:19.490399 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-9b104b0c-e0f9-436a-8838-61f644857150 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98936da9b5d94165b386d2d0893ac142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2441394d754f499e27f6f35d5b3afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:19.507185 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-9b104b0c-e0f9-436a-8838-61f644857150 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] 10.222.0.26 "GET /compute/v2.1/servers/84eba001-0fa3-4fb7-b74e-0bb54c527ac7" status: 200 len: 1322 microversion: 2.1 time: 0.251325 Oct 08 20:54:19.526380 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 416/792] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:54:19 2022] GET /compute/v2.1/servers/84eba001-0fa3-4fb7-b74e-0bb54c527ac7 => generated 1322 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:54:19.538205 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-86363f7c-e388-4a24-868a-e36e963eb40f tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:19.538824 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-86363f7c-e388-4a24-868a-e36e963eb40f tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] [instance: aadc9a05-66e2-45bb-8c2d-6755184a8e9c] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:19.548302 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-86363f7c-e388-4a24-868a-e36e963eb40f tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:19.549618 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-86363f7c-e388-4a24-868a-e36e963eb40f tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:19.550082 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-86363f7c-e388-4a24-868a-e36e963eb40f tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:19.550921 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-86363f7c-e388-4a24-868a-e36e963eb40f tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:19.551401 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-86363f7c-e388-4a24-868a-e36e963eb40f tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:19.551905 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-86363f7c-e388-4a24-868a-e36e963eb40f tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:19.621565 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-08dee49d-705c-4313-b5e6-ceaf25da8c1a tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/a80fbf87-8203-4e6c-bee7-fe781bfccff1" status: 200 len: 1646 microversion: 2.1 time: 0.291648 Oct 08 20:54:19.622153 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 377/793] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:54:19 2022] GET /compute/v2.1/servers/a80fbf87-8203-4e6c-bee7-fe781bfccff1 => generated 1646 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:54:19.644543 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-55985d12-d35b-43ea-8854-b73f713971b4 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:19.645172 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-55985d12-d35b-43ea-8854-b73f713971b4 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] [instance: 73fd15ea-e4bd-4310-93bb-147b0a5e27ef] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:19.651589 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-55985d12-d35b-43ea-8854-b73f713971b4 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:19.652095 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-55985d12-d35b-43ea-8854-b73f713971b4 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:19.652667 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-55985d12-d35b-43ea-8854-b73f713971b4 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:19.653671 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-55985d12-d35b-43ea-8854-b73f713971b4 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:19.653904 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-55985d12-d35b-43ea-8854-b73f713971b4 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:19.654435 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-55985d12-d35b-43ea-8854-b73f713971b4 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:19.987502 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-55985d12-d35b-43ea-8854-b73f713971b4 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef659f5a1a24c439528a7675bdd70f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c92fe04ab8248399d0acb932f82d607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:20.002748 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-55985d12-d35b-43ea-8854-b73f713971b4 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] 10.222.0.26 "GET /compute/v2.1/servers/73fd15ea-e4bd-4310-93bb-147b0a5e27ef" status: 200 len: 1470 microversion: 2.1 time: 0.364343 Oct 08 20:54:20.004365 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 378/794] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:54:19 2022] GET /compute/v2.1/servers/73fd15ea-e4bd-4310-93bb-147b0a5e27ef => generated 1470 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:54:20.016030 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-3f151a15-5830-405e-bb13-8124bf378a17 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:20.017554 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-3f151a15-5830-405e-bb13-8124bf378a17 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] [instance: a80fbf87-8203-4e6c-bee7-fe781bfccff1] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:20.026169 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3f151a15-5830-405e-bb13-8124bf378a17 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:20.027271 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3f151a15-5830-405e-bb13-8124bf378a17 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:20.027969 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3f151a15-5830-405e-bb13-8124bf378a17 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:20.029045 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3f151a15-5830-405e-bb13-8124bf378a17 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:20.029922 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3f151a15-5830-405e-bb13-8124bf378a17 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:20.031017 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3f151a15-5830-405e-bb13-8124bf378a17 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:20.166527 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-86363f7c-e388-4a24-868a-e36e963eb40f tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68e264d0c2b54a5f8d1bd197b84a104a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a09d8f87c174336a1d216e396adfd33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:20.192309 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-86363f7c-e388-4a24-868a-e36e963eb40f tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] 10.222.0.26 "GET /compute/v2.1/servers/aadc9a05-66e2-45bb-8c2d-6755184a8e9c" status: 200 len: 1510 microversion: 2.1 time: 0.661765 Oct 08 20:54:20.193625 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 417/795] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:54:19 2022] GET /compute/v2.1/servers/aadc9a05-66e2-45bb-8c2d-6755184a8e9c => generated 1510 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:54:20.200959 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e819ac00-ca4e-44fe-8f90-b4b0bc0b2bfe tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:20.204666 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-e819ac00-ca4e-44fe-8f90-b4b0bc0b2bfe tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] [instance: 92e31b92-0af1-4da6-bc87-23978f1aedf5] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:20.220625 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e819ac00-ca4e-44fe-8f90-b4b0bc0b2bfe tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:20.222200 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e819ac00-ca4e-44fe-8f90-b4b0bc0b2bfe tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:20.222200 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e819ac00-ca4e-44fe-8f90-b4b0bc0b2bfe tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:20.222710 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e819ac00-ca4e-44fe-8f90-b4b0bc0b2bfe tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:20.223289 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e819ac00-ca4e-44fe-8f90-b4b0bc0b2bfe tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:20.229966 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e819ac00-ca4e-44fe-8f90-b4b0bc0b2bfe tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:20.306082 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-3f151a15-5830-405e-bb13-8124bf378a17 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/a80fbf87-8203-4e6c-bee7-fe781bfccff1" status: 200 len: 1646 microversion: 2.1 time: 0.299997 Oct 08 20:54:20.318716 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 379/796] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:54:20 2022] GET /compute/v2.1/servers/a80fbf87-8203-4e6c-bee7-fe781bfccff1 => generated 1646 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:54:20.328766 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-fb367c1a-e442-4b85-9456-b2043bca0be2 req-60996058-e667-4d95-834b-30181d4729c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aadc9a05-66e2-45bb-8c2d-6755184a8e9c", "name": "network-vif-deleted", "tag": "30b8f676-1366-40cd-880f-839ba9c67d35"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:54:20.344819 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-fb367c1a-e442-4b85-9456-b2043bca0be2 req-60996058-e667-4d95-834b-30181d4729c3 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:20.345391 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-fb367c1a-e442-4b85-9456-b2043bca0be2 req-60996058-e667-4d95-834b-30181d4729c3 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:20.346203 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-fb367c1a-e442-4b85-9456-b2043bca0be2 req-60996058-e667-4d95-834b-30181d4729c3 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:20.383136 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-fb367c1a-e442-4b85-9456-b2043bca0be2 req-60996058-e667-4d95-834b-30181d4729c3 service nova] Creating event network-vif-deleted:30b8f676-1366-40cd-880f-839ba9c67d35 for instance aadc9a05-66e2-45bb-8c2d-6755184a8e9c on nch2-master-1 Oct 08 20:54:20.392427 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-fb367c1a-e442-4b85-9456-b2043bca0be2 req-60996058-e667-4d95-834b-30181d4729c3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072022 Oct 08 20:54:20.393266 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 380/797] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:54:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:54:20.407863 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-bf5d4254-1531-4346-9f0f-6759dee4b93c tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:20.419173 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bf5d4254-1531-4346-9f0f-6759dee4b93c tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:20.420817 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bf5d4254-1531-4346-9f0f-6759dee4b93c tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:20.423861 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bf5d4254-1531-4346-9f0f-6759dee4b93c tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:20.425358 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bf5d4254-1531-4346-9f0f-6759dee4b93c tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:20.428032 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bf5d4254-1531-4346-9f0f-6759dee4b93c tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:20.430460 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bf5d4254-1531-4346-9f0f-6759dee4b93c tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:20.461494 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-bf5d4254-1531-4346-9f0f-6759dee4b93c tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.066845 Oct 08 20:54:20.462755 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 381/798] 10.222.0.26 () {58 vars in 1176 bytes} [Sat Oct 8 20:54:20 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:54:20.468061 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-49b7185b-6fe0-409f-89ee-c68450dad08f tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:20.469050 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-49b7185b-6fe0-409f-89ee-c68450dad08f tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] [instance: 139f7ae3-b380-4114-a566-6d496d4957f4] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:20.482494 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-49b7185b-6fe0-409f-89ee-c68450dad08f tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:20.483623 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-49b7185b-6fe0-409f-89ee-c68450dad08f tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:20.484474 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-49b7185b-6fe0-409f-89ee-c68450dad08f tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:20.488538 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-49b7185b-6fe0-409f-89ee-c68450dad08f tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:20.489437 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-49b7185b-6fe0-409f-89ee-c68450dad08f tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:20.489898 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-49b7185b-6fe0-409f-89ee-c68450dad08f tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:20.524851 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-e819ac00-ca4e-44fe-8f90-b4b0bc0b2bfe tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:20.543198 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-e819ac00-ca4e-44fe-8f90-b4b0bc0b2bfe tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:20.554250 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-e819ac00-ca4e-44fe-8f90-b4b0bc0b2bfe tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:20.571964 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-e819ac00-ca4e-44fe-8f90-b4b0bc0b2bfe tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] 10.222.0.26 "GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5" status: 200 len: 1539 microversion: 2.91 time: 0.370914 Oct 08 20:54:20.589654 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 418/799] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:54:20 2022] GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5 => generated 1539 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:54:20.601720 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-d2861ec1-c2d0-45f9-9865-bacf029111fe tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:54:20.601720 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-d2861ec1-c2d0-45f9-9865-bacf029111fe tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] [instance: a80fbf87-8203-4e6c-bee7-fe781bfccff1] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:20.625578 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d2861ec1-c2d0-45f9-9865-bacf029111fe tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:20.626406 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d2861ec1-c2d0-45f9-9865-bacf029111fe tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:20.627236 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d2861ec1-c2d0-45f9-9865-bacf029111fe tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:20.629439 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d2861ec1-c2d0-45f9-9865-bacf029111fe tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:20.631173 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d2861ec1-c2d0-45f9-9865-bacf029111fe tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:20.633104 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d2861ec1-c2d0-45f9-9865-bacf029111fe tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:20.746432 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-d2861ec1-c2d0-45f9-9865-bacf029111fe tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/a80fbf87-8203-4e6c-bee7-fe781bfccff1/action" status: 202 len: 0 microversion: 2.1 time: 0.159572 Oct 08 20:54:20.747732 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 419/800] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 20:54:20 2022] POST /compute/v2.1/servers/a80fbf87-8203-4e6c-bee7-fe781bfccff1/action => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 20:54:20.753473 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-6d6864b4-7f42-4eda-acb5-48dd41eeca50 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:20.754521 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-6d6864b4-7f42-4eda-acb5-48dd41eeca50 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] [instance: 84eba001-0fa3-4fb7-b74e-0bb54c527ac7] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:20.762079 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6d6864b4-7f42-4eda-acb5-48dd41eeca50 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:20.763217 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6d6864b4-7f42-4eda-acb5-48dd41eeca50 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:20.764146 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6d6864b4-7f42-4eda-acb5-48dd41eeca50 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:20.765418 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6d6864b4-7f42-4eda-acb5-48dd41eeca50 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:20.766102 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6d6864b4-7f42-4eda-acb5-48dd41eeca50 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:20.766809 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6d6864b4-7f42-4eda-acb5-48dd41eeca50 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:20.989612 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-49b7185b-6fe0-409f-89ee-c68450dad08f tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:21.011270 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-49b7185b-6fe0-409f-89ee-c68450dad08f tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:21.013286 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-49b7185b-6fe0-409f-89ee-c68450dad08f tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:21.015471 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-49b7185b-6fe0-409f-89ee-c68450dad08f tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] 10.222.0.26 "GET /compute/v2.1/servers/139f7ae3-b380-4114-a566-6d496d4957f4" status: 200 len: 1558 microversion: 2.25 time: 0.551510 Oct 08 20:54:21.016743 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 382/801] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:54:20 2022] GET /compute/v2.1/servers/139f7ae3-b380-4114-a566-6d496d4957f4 => generated 1558 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:54:21.021717 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-3070eb7e-7c96-4b61-884a-d7cd6dd2a6f3 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:21.022553 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-3070eb7e-7c96-4b61-884a-d7cd6dd2a6f3 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] [instance: a80fbf87-8203-4e6c-bee7-fe781bfccff1] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:21.030294 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3070eb7e-7c96-4b61-884a-d7cd6dd2a6f3 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:21.031039 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3070eb7e-7c96-4b61-884a-d7cd6dd2a6f3 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:21.031779 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3070eb7e-7c96-4b61-884a-d7cd6dd2a6f3 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:21.032674 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3070eb7e-7c96-4b61-884a-d7cd6dd2a6f3 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:21.033347 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3070eb7e-7c96-4b61-884a-d7cd6dd2a6f3 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:21.034369 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3070eb7e-7c96-4b61-884a-d7cd6dd2a6f3 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:21.182527 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-6d6864b4-7f42-4eda-acb5-48dd41eeca50 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98936da9b5d94165b386d2d0893ac142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2441394d754f499e27f6f35d5b3afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:21.196601 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-6d6864b4-7f42-4eda-acb5-48dd41eeca50 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] 10.222.0.26 "GET /compute/v2.1/servers/84eba001-0fa3-4fb7-b74e-0bb54c527ac7" status: 200 len: 1390 microversion: 2.1 time: 0.447323 Oct 08 20:54:21.197225 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 420/802] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:54:20 2022] GET /compute/v2.1/servers/84eba001-0fa3-4fb7-b74e-0bb54c527ac7 => generated 1390 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:54:21.210050 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-4178360d-baf6-4e6d-9bb9-a39efe030d30 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:21.219306 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-4178360d-baf6-4e6d-9bb9-a39efe030d30 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] [instance: 73fd15ea-e4bd-4310-93bb-147b0a5e27ef] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:21.227496 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4178360d-baf6-4e6d-9bb9-a39efe030d30 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:21.228083 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4178360d-baf6-4e6d-9bb9-a39efe030d30 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:21.228766 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4178360d-baf6-4e6d-9bb9-a39efe030d30 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:21.229578 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4178360d-baf6-4e6d-9bb9-a39efe030d30 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:21.230188 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4178360d-baf6-4e6d-9bb9-a39efe030d30 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:21.230857 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4178360d-baf6-4e6d-9bb9-a39efe030d30 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:21.471906 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-3070eb7e-7c96-4b61-884a-d7cd6dd2a6f3 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/a80fbf87-8203-4e6c-bee7-fe781bfccff1" status: 200 len: 1651 microversion: 2.1 time: 0.453570 Oct 08 20:54:21.480162 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 383/803] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:54:21 2022] GET /compute/v2.1/servers/a80fbf87-8203-4e6c-bee7-fe781bfccff1 => generated 1651 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:54:21.499204 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-8f4e4b46-4fc4-4f74-8263-ee1eaf7ed4b5 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Calling method '.version_select at 0x7f1a8d164670>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:21.503357 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8f4e4b46-4fc4-4f74-8263-ee1eaf7ed4b5 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:21.504642 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8f4e4b46-4fc4-4f74-8263-ee1eaf7ed4b5 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:21.505355 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8f4e4b46-4fc4-4f74-8263-ee1eaf7ed4b5 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:21.543815 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-4178360d-baf6-4e6d-9bb9-a39efe030d30 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef659f5a1a24c439528a7675bdd70f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c92fe04ab8248399d0acb932f82d607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:21.558599 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-4178360d-baf6-4e6d-9bb9-a39efe030d30 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] 10.222.0.26 "GET /compute/v2.1/servers/73fd15ea-e4bd-4310-93bb-147b0a5e27ef" status: 200 len: 1470 microversion: 2.1 time: 0.352154 Oct 08 20:54:21.559556 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 421/804] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:54:21 2022] GET /compute/v2.1/servers/73fd15ea-e4bd-4310-93bb-147b0a5e27ef => generated 1470 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:54:21.565126 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-d753e6b9-8786-49e1-8eb1-c82dda08b446 tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:21.569931 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-d753e6b9-8786-49e1-8eb1-c82dda08b446 tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] [instance: aadc9a05-66e2-45bb-8c2d-6755184a8e9c] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:21.572731 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-8f4e4b46-4fc4-4f74-8263-ee1eaf7ed4b5 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] 10.222.0.26 "GET /compute/v2.1/os-migrations" status: 200 len: 1100 microversion: 2.25 time: 0.088631 Oct 08 20:54:21.574057 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 384/805] 10.222.0.26 () {60 vars in 1184 bytes} [Sat Oct 8 20:54:21 2022] GET /compute/v2.1/os-migrations => generated 1100 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:54:21.596797 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d753e6b9-8786-49e1-8eb1-c82dda08b446 tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:21.597763 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d753e6b9-8786-49e1-8eb1-c82dda08b446 tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:21.602131 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d753e6b9-8786-49e1-8eb1-c82dda08b446 tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:21.603319 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d753e6b9-8786-49e1-8eb1-c82dda08b446 tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:21.603966 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d753e6b9-8786-49e1-8eb1-c82dda08b446 tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:21.604905 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d753e6b9-8786-49e1-8eb1-c82dda08b446 tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:21.608968 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-7467b11a-3355-4912-96cb-ce611fcca482 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:21.610625 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-7467b11a-3355-4912-96cb-ce611fcca482 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] [instance: 139f7ae3-b380-4114-a566-6d496d4957f4] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:21.626458 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7467b11a-3355-4912-96cb-ce611fcca482 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:21.626974 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7467b11a-3355-4912-96cb-ce611fcca482 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:21.629070 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7467b11a-3355-4912-96cb-ce611fcca482 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:21.631413 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7467b11a-3355-4912-96cb-ce611fcca482 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:21.633128 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7467b11a-3355-4912-96cb-ce611fcca482 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:21.638352 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7467b11a-3355-4912-96cb-ce611fcca482 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:21.639505 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-d753e6b9-8786-49e1-8eb1-c82dda08b446 tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] HTTP exception thrown: Instance aadc9a05-66e2-45bb-8c2d-6755184a8e9c could not be found. Oct 08 20:54:21.641200 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-d753e6b9-8786-49e1-8eb1-c82dda08b446 tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] Request method failure captured: Oct 08 20:54:21.641200 ncdv-master-1 devstack@n-api.service[140492]: request: GET /compute/v2.1/servers/aadc9a05-66e2-45bb-8c2d-6755184a8e9c HTTP/1.1 Oct 08 20:54:21.641200 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 20:54:21.641200 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 20:54:21.641200 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 20:54:21.641200 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 20:54:21.641200 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 20:54:21.641200 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 20:54:21.641200 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 20:54:21.641200 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 20:54:21.641200 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeNmgNx1Wt9rUYNfSw1qTb_Q5AP8cJMW0v_WLXBuHPHnetQHtlHYIvTY66th9sb986EPc_Hev4qnd8Fcx5uQmXFARIwj9cqXzWwX1i2fOp5BoWUx08thXb5ksywZnd6G-RvOKsfe8kk5KVhjEBCriZvwaatzUOkRb3FETcJ9XTjLo2M Oct 08 20:54:21.641200 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 20:54:21.641200 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 20:54:21.641200 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 20:54:21.641200 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 20:54:21.641200 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 20:54:21.641200 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 20:54:21.641200 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 6a09d8f87c174336a1d216e396adfd33 Oct 08 20:54:21.641200 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-ImagesNegativeTestJSON-247453097 Oct 08 20:54:21.641200 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 20:54:21.641200 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 20:54:21.642668 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6a09d8f87c174336a1d216e396adfd33"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6a09d8f87c174336a1d216e396adfd33"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6a09d8f87c174336a1d216e396adfd33"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6a09d8f87c174336a1d216e396adfd33"}]}] Oct 08 20:54:21.642668 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-ImagesNegativeTestJSON-247453097 Oct 08 20:54:21.642668 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 6a09d8f87c174336a1d216e396adfd33 Oct 08 20:54:21.642668 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-247453097 Oct 08 20:54:21.642668 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-ImagesNegativeTestJSON-247453097-project Oct 08 20:54:21.642668 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 20:54:21.642668 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 20:54:21.642668 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 68e264d0c2b54a5f8d1bd197b84a104a Oct 08 20:54:21.642668 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-ImagesNegativeTestJSON-247453097-project Oct 08 20:54:21.642668 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 20:54:21.642668 ncdv-master-1 devstack@n-api.service[140492]: exception: Instance aadc9a05-66e2-45bb-8c2d-6755184a8e9c could not be found. Oct 08 20:54:21.642668 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': 'aadc9a05-66e2-45bb-8c2d-6755184a8e9c'} Oct 08 20:54:21.643384 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:54:21.643384 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:54:21.643384 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 20:54:21.643384 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 20:54:21.643384 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 20:54:21.643384 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 20:54:21.643384 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 20:54:21.643384 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 20:54:21.643384 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 20:54:21.643384 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 20:54:21.643384 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aadc9a05-66e2-45bb-8c2d-6755184a8e9c could not be found. Oct 08 20:54:21.643384 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:54:21.643384 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:54:21.643384 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:54:21.643384 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:54:21.643384 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:54:21.643384 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:54:21.643384 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:54:21.643384 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:54:21.643384 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:54:21.644602 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:54:21.644602 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 20:54:21.644602 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 20:54:21.644602 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 20:54:21.644602 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 20:54:21.644602 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 20:54:21.644602 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 20:54:21.644602 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aadc9a05-66e2-45bb-8c2d-6755184a8e9c could not be found. Oct 08 20:54:21.644602 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:54:21.644602 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:54:21.644602 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:54:21.644602 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:54:21.644602 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:54:21.644602 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:54:21.644602 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 20:54:21.644602 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 20:54:21.644602 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aadc9a05-66e2-45bb-8c2d-6755184a8e9c could not be found. Oct 08 20:54:21.644602 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:54:21.645767 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-d753e6b9-8786-49e1-8eb1-c82dda08b446 tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] Returning 404 to user: Instance aadc9a05-66e2-45bb-8c2d-6755184a8e9c could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:54:21.645767 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-d753e6b9-8786-49e1-8eb1-c82dda08b446 tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] 10.222.0.26 "GET /compute/v2.1/servers/aadc9a05-66e2-45bb-8c2d-6755184a8e9c" status: 404 len: 111 microversion: 2.1 time: 0.084049 Oct 08 20:54:21.647442 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 422/806] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:54:21 2022] GET /compute/v2.1/servers/aadc9a05-66e2-45bb-8c2d-6755184a8e9c => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 20:54:21.658028 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-afd10c5b-0a45-432f-8740-6bbda6ccb911 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:21.658662 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-afd10c5b-0a45-432f-8740-6bbda6ccb911 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] [instance: 92e31b92-0af1-4da6-bc87-23978f1aedf5] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:21.672884 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-afd10c5b-0a45-432f-8740-6bbda6ccb911 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:21.673332 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-afd10c5b-0a45-432f-8740-6bbda6ccb911 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:21.673782 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-afd10c5b-0a45-432f-8740-6bbda6ccb911 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:21.674513 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-afd10c5b-0a45-432f-8740-6bbda6ccb911 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:21.674978 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-afd10c5b-0a45-432f-8740-6bbda6ccb911 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:21.675409 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-afd10c5b-0a45-432f-8740-6bbda6ccb911 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:21.875228 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-afd10c5b-0a45-432f-8740-6bbda6ccb911 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:21.908947 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-afd10c5b-0a45-432f-8740-6bbda6ccb911 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:21.912538 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-afd10c5b-0a45-432f-8740-6bbda6ccb911 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:21.923258 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-afd10c5b-0a45-432f-8740-6bbda6ccb911 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] 10.222.0.26 "GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5" status: 200 len: 1539 microversion: 2.91 time: 0.274096 Oct 08 20:54:21.924672 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 423/807] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:54:21 2022] GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5 => generated 1539 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:54:21.930632 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-eaabd7fc-15a1-4852-b03e-080ef7cc7e4e tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1323485355", "metadata": {"image_type": "test"}}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:54:21.933538 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-eaabd7fc-15a1-4852-b03e-080ef7cc7e4e tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] [instance: aadc9a05-66e2-45bb-8c2d-6755184a8e9c] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:21.943241 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-eaabd7fc-15a1-4852-b03e-080ef7cc7e4e tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:21.944243 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-eaabd7fc-15a1-4852-b03e-080ef7cc7e4e tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:21.944861 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-eaabd7fc-15a1-4852-b03e-080ef7cc7e4e tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:21.946808 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-eaabd7fc-15a1-4852-b03e-080ef7cc7e4e tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:21.947425 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-eaabd7fc-15a1-4852-b03e-080ef7cc7e4e tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:21.948031 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-eaabd7fc-15a1-4852-b03e-080ef7cc7e4e tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:21.970854 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-eaabd7fc-15a1-4852-b03e-080ef7cc7e4e tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] HTTP exception thrown: Instance aadc9a05-66e2-45bb-8c2d-6755184a8e9c could not be found. Oct 08 20:54:21.974633 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-eaabd7fc-15a1-4852-b03e-080ef7cc7e4e tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] Request method failure captured: Oct 08 20:54:21.974633 ncdv-master-1 devstack@n-api.service[140492]: request: POST /compute/v2.1/servers/aadc9a05-66e2-45bb-8c2d-6755184a8e9c/action HTTP/1.1 Oct 08 20:54:21.974633 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 20:54:21.974633 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 20:54:21.974633 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 20:54:21.974633 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 112 Oct 08 20:54:21.974633 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 20:54:21.974633 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 20:54:21.974633 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 20:54:21.974633 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 20:54:21.974633 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeNmgNx1Wt9rUYNfSw1qTb_Q5AP8cJMW0v_WLXBuHPHnetQHtlHYIvTY66th9sb986EPc_Hev4qnd8Fcx5uQmXFARIwj9cqXzWwX1i2fOp5BoWUx08thXb5ksywZnd6G-RvOKsfe8kk5KVhjEBCriZvwaatzUOkRb3FETcJ9XTjLo2M Oct 08 20:54:21.974633 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 20:54:21.974633 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 20:54:21.974633 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 20:54:21.974633 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 20:54:21.974633 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 20:54:21.974633 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 20:54:21.974633 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 6a09d8f87c174336a1d216e396adfd33 Oct 08 20:54:21.974633 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-ImagesNegativeTestJSON-247453097 Oct 08 20:54:21.974633 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 20:54:21.974633 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 20:54:21.976164 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6a09d8f87c174336a1d216e396adfd33"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6a09d8f87c174336a1d216e396adfd33"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6a09d8f87c174336a1d216e396adfd33"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6a09d8f87c174336a1d216e396adfd33"}]}] Oct 08 20:54:21.976164 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-ImagesNegativeTestJSON-247453097 Oct 08 20:54:21.976164 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 6a09d8f87c174336a1d216e396adfd33 Oct 08 20:54:21.976164 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-247453097 Oct 08 20:54:21.976164 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-ImagesNegativeTestJSON-247453097-project Oct 08 20:54:21.976164 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 20:54:21.976164 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 20:54:21.976164 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 68e264d0c2b54a5f8d1bd197b84a104a Oct 08 20:54:21.976164 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-ImagesNegativeTestJSON-247453097-project Oct 08 20:54:21.976164 ncdv-master-1 devstack@n-api.service[140492]: Oct 08 20:54:21.976164 ncdv-master-1 devstack@n-api.service[140492]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1323485355", "metadata": {"image_type": "test"}}} Oct 08 20:54:21.976164 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 20:54:21.976997 ncdv-master-1 devstack@n-api.service[140492]: exception: Instance aadc9a05-66e2-45bb-8c2d-6755184a8e9c could not be found. Oct 08 20:54:21.976997 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': 'aadc9a05-66e2-45bb-8c2d-6755184a8e9c', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1323485355', 'metadata': {'image_type': 'test'}}}} Oct 08 20:54:21.976997 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:54:21.976997 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:54:21.976997 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 20:54:21.976997 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 20:54:21.976997 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 20:54:21.976997 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 20:54:21.976997 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 20:54:21.976997 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 20:54:21.976997 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 20:54:21.976997 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 20:54:21.976997 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aadc9a05-66e2-45bb-8c2d-6755184a8e9c could not be found. Oct 08 20:54:21.976997 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:54:21.976997 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:54:21.976997 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:54:21.976997 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:54:21.976997 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:54:21.976997 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:54:21.978542 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:54:21.978542 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:54:21.978542 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:54:21.978542 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:54:21.978542 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 20:54:21.978542 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 20:54:21.978542 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 20:54:21.978542 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 20:54:21.978542 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 08 20:54:21.978542 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 08 20:54:21.978542 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 20:54:21.978542 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 20:54:21.978542 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 20:54:21.978542 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 20:54:21.978542 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aadc9a05-66e2-45bb-8c2d-6755184a8e9c could not be found. Oct 08 20:54:21.978542 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:54:21.978542 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:54:21.978542 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:54:21.978542 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:54:21.978542 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:54:21.979912 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:54:21.979912 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 20:54:21.979912 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 20:54:21.979912 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aadc9a05-66e2-45bb-8c2d-6755184a8e9c could not be found. Oct 08 20:54:21.979912 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:54:21.982117 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-eaabd7fc-15a1-4852-b03e-080ef7cc7e4e tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] Returning 404 to user: Instance aadc9a05-66e2-45bb-8c2d-6755184a8e9c could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:54:21.983675 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-eaabd7fc-15a1-4852-b03e-080ef7cc7e4e tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] 10.222.0.26 "POST /compute/v2.1/servers/aadc9a05-66e2-45bb-8c2d-6755184a8e9c/action" status: 404 len: 111 microversion: 2.1 time: 0.057445 Oct 08 20:54:21.983933 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.objects.instance [None req-7467b11a-3355-4912-96cb-ce611fcca482 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Lazy-loading 'services' on Instance uuid 139f7ae3-b380-4114-a566-6d496d4957f4 {{(pid=140491) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 20:54:21.984903 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 424/808] 10.222.0.26 () {60 vars in 1279 bytes} [Sat Oct 8 20:54:21 2022] POST /compute/v2.1/servers/aadc9a05-66e2-45bb-8c2d-6755184a8e9c/action => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 20:54:22.000072 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-2094b7e2-b012-41f1-a784-c9fd5d0cbf43 tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1561663725", "metadata": {"image_type": "test"}}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:54:22.016857 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-2094b7e2-b012-41f1-a784-c9fd5d0cbf43 tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] Failed to fetch instance by id tempest-invalid-1809096864 {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 08 20:54:22.017446 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-2094b7e2-b012-41f1-a784-c9fd5d0cbf43 tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] HTTP exception thrown: Instance tempest-invalid-1809096864 could not be found. Oct 08 20:54:22.018052 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-7467b11a-3355-4912-96cb-ce611fcca482 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/139f7ae3-b380-4114-a566-6d496d4957f4" status: 200 len: 2050 microversion: 2.25 time: 0.429638 Oct 08 20:54:22.019005 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-2094b7e2-b012-41f1-a784-c9fd5d0cbf43 tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] Request method failure captured: Oct 08 20:54:22.019005 ncdv-master-1 devstack@n-api.service[140492]: request: POST /compute/v2.1/servers/tempest-invalid-1809096864/action HTTP/1.1 Oct 08 20:54:22.019005 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 20:54:22.019005 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 20:54:22.019005 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 20:54:22.019005 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 112 Oct 08 20:54:22.019005 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 20:54:22.019005 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 20:54:22.019005 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 20:54:22.019005 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 20:54:22.019005 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeNmgNx1Wt9rUYNfSw1qTb_Q5AP8cJMW0v_WLXBuHPHnetQHtlHYIvTY66th9sb986EPc_Hev4qnd8Fcx5uQmXFARIwj9cqXzWwX1i2fOp5BoWUx08thXb5ksywZnd6G-RvOKsfe8kk5KVhjEBCriZvwaatzUOkRb3FETcJ9XTjLo2M Oct 08 20:54:22.019005 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 20:54:22.019005 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 20:54:22.019005 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 20:54:22.019005 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 20:54:22.019005 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 20:54:22.019005 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 20:54:22.019005 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 6a09d8f87c174336a1d216e396adfd33 Oct 08 20:54:22.019005 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-ImagesNegativeTestJSON-247453097 Oct 08 20:54:22.019005 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 20:54:22.019005 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 20:54:22.020503 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6a09d8f87c174336a1d216e396adfd33"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6a09d8f87c174336a1d216e396adfd33"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6a09d8f87c174336a1d216e396adfd33"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6a09d8f87c174336a1d216e396adfd33"}]}] Oct 08 20:54:22.020503 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-ImagesNegativeTestJSON-247453097 Oct 08 20:54:22.020503 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 6a09d8f87c174336a1d216e396adfd33 Oct 08 20:54:22.020503 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-247453097 Oct 08 20:54:22.020503 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-ImagesNegativeTestJSON-247453097-project Oct 08 20:54:22.020503 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 20:54:22.020503 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 20:54:22.020503 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 68e264d0c2b54a5f8d1bd197b84a104a Oct 08 20:54:22.020503 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-ImagesNegativeTestJSON-247453097-project Oct 08 20:54:22.020503 ncdv-master-1 devstack@n-api.service[140492]: Oct 08 20:54:22.020503 ncdv-master-1 devstack@n-api.service[140492]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1561663725", "metadata": {"image_type": "test"}}} Oct 08 20:54:22.020503 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 20:54:22.020503 ncdv-master-1 devstack@n-api.service[140492]: exception: Instance tempest-invalid-1809096864 could not be found. Oct 08 20:54:22.021453 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': 'tempest-invalid-1809096864', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1561663725', 'metadata': {'image_type': 'test'}}}} Oct 08 20:54:22.021453 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:54:22.021453 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:54:22.021453 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 20:54:22.021453 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 20:54:22.021453 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 08 20:54:22.021453 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 08 20:54:22.021453 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-1809096864 could not be found. Oct 08 20:54:22.021453 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:54:22.021453 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:54:22.021453 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:54:22.021453 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:54:22.021453 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:54:22.021453 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:54:22.021453 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:54:22.021453 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:54:22.021453 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:54:22.021453 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:54:22.021453 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 20:54:22.021453 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 20:54:22.022657 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 20:54:22.022657 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 20:54:22.022657 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 08 20:54:22.022657 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 08 20:54:22.022657 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 20:54:22.022657 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 20:54:22.022657 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 20:54:22.022657 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 20:54:22.022657 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-1809096864 could not be found. Oct 08 20:54:22.022657 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:54:22.022657 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:54:22.022657 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:54:22.022657 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:54:22.022657 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:54:22.022657 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:54:22.022657 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 20:54:22.022657 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 20:54:22.022657 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-1809096864 could not be found. Oct 08 20:54:22.022657 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:54:22.023737 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-2094b7e2-b012-41f1-a784-c9fd5d0cbf43 tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] Returning 404 to user: Instance tempest-invalid-1809096864 could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:54:22.024981 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 385/809] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:54:21 2022] GET /compute/v2.1/servers/139f7ae3-b380-4114-a566-6d496d4957f4 => generated 2050 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 08 20:54:22.031715 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-2094b7e2-b012-41f1-a784-c9fd5d0cbf43 tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] 10.222.0.26 "POST /compute/v2.1/servers/tempest-invalid-1809096864/action" status: 404 len: 101 microversion: 2.1 time: 0.030616 Oct 08 20:54:22.036906 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 425/810] 10.222.0.26 () {60 vars in 1249 bytes} [Sat Oct 8 20:54:21 2022] POST /compute/v2.1/servers/tempest-invalid-1809096864/action => generated 101 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 20:54:22.056967 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-9078d404-adba-4e42-a2a6-f0647ac114bf tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-634739401"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:54:22.065024 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-9078d404-adba-4e42-a2a6-f0647ac114bf tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 08 20:54:22.065945 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-9078d404-adba-4e42-a2a6-f0647ac114bf tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 08 20:54:22.069926 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-9078d404-adba-4e42-a2a6-f0647ac114bf tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] Request method failure captured: Oct 08 20:54:22.069926 ncdv-master-1 devstack@n-api.service[140491]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Oct 08 20:54:22.069926 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 20:54:22.069926 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 20:54:22.069926 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 20:54:22.069926 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 56 Oct 08 20:54:22.069926 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 20:54:22.069926 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 20:54:22.069926 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 20:54:22.069926 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 20:54:22.069926 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeNmgNx1Wt9rUYNfSw1qTb_Q5AP8cJMW0v_WLXBuHPHnetQHtlHYIvTY66th9sb986EPc_Hev4qnd8Fcx5uQmXFARIwj9cqXzWwX1i2fOp5BoWUx08thXb5ksywZnd6G-RvOKsfe8kk5KVhjEBCriZvwaatzUOkRb3FETcJ9XTjLo2M Oct 08 20:54:22.069926 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 20:54:22.069926 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 20:54:22.069926 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 20:54:22.069926 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 20:54:22.069926 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 20:54:22.069926 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 20:54:22.069926 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 6a09d8f87c174336a1d216e396adfd33 Oct 08 20:54:22.069926 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-ImagesNegativeTestJSON-247453097 Oct 08 20:54:22.069926 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 20:54:22.069926 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 20:54:22.071261 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6a09d8f87c174336a1d216e396adfd33"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6a09d8f87c174336a1d216e396adfd33"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6a09d8f87c174336a1d216e396adfd33"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6a09d8f87c174336a1d216e396adfd33"}]}] Oct 08 20:54:22.071261 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-ImagesNegativeTestJSON-247453097 Oct 08 20:54:22.071261 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 6a09d8f87c174336a1d216e396adfd33 Oct 08 20:54:22.071261 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-247453097 Oct 08 20:54:22.071261 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-ImagesNegativeTestJSON-247453097-project Oct 08 20:54:22.071261 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 20:54:22.071261 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 20:54:22.071261 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 68e264d0c2b54a5f8d1bd197b84a104a Oct 08 20:54:22.071261 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-ImagesNegativeTestJSON-247453097-project Oct 08 20:54:22.071261 ncdv-master-1 devstack@n-api.service[140491]: Oct 08 20:54:22.071261 ncdv-master-1 devstack@n-api.service[140491]: {"createImage": {"name": "tempest-test-snap-634739401"}} Oct 08 20:54:22.071261 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 20:54:22.071261 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 08 20:54:22.072004 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-634739401'}}} Oct 08 20:54:22.072004 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:54:22.072004 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:54:22.072004 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 20:54:22.072004 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 20:54:22.072004 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 08 20:54:22.072004 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 08 20:54:22.072004 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 08 20:54:22.072004 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:54:22.072004 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:54:22.072004 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:54:22.072004 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:54:22.072004 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:54:22.072004 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:54:22.072004 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:54:22.072004 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:54:22.072004 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:54:22.072004 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:54:22.072004 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 20:54:22.072004 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 20:54:22.073154 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 20:54:22.073154 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 20:54:22.073154 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 08 20:54:22.073154 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 08 20:54:22.073154 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 20:54:22.073154 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 20:54:22.073154 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 20:54:22.073154 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 20:54:22.073154 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 08 20:54:22.073154 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:54:22.073154 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:54:22.073154 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:54:22.073154 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:54:22.073154 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:54:22.073154 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:54:22.073154 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 20:54:22.073154 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 20:54:22.073154 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 08 20:54:22.073154 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:54:22.075208 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-9078d404-adba-4e42-a2a6-f0647ac114bf tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:54:22.077543 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-9078d404-adba-4e42-a2a6-f0647ac114bf tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] 10.222.0.26 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.029996 Oct 08 20:54:22.084852 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 386/811] 10.222.0.26 () {60 vars in 1275 bytes} [Sat Oct 8 20:54:22 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 20:54:22.089509 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-09f48107-128c-4ac8-8864-bb8d7958730b tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-402758154"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:54:22.091959 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-09f48107-128c-4ac8-8864-bb8d7958730b tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 08 20:54:22.092500 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-09f48107-128c-4ac8-8864-bb8d7958730b tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 08 20:54:22.094290 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-09f48107-128c-4ac8-8864-bb8d7958730b tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] Request method failure captured: Oct 08 20:54:22.094290 ncdv-master-1 devstack@n-api.service[140492]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Oct 08 20:54:22.094290 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 20:54:22.094290 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 20:54:22.094290 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 20:54:22.094290 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 56 Oct 08 20:54:22.094290 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 20:54:22.094290 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 20:54:22.094290 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 20:54:22.094290 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 20:54:22.094290 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeNmgNx1Wt9rUYNfSw1qTb_Q5AP8cJMW0v_WLXBuHPHnetQHtlHYIvTY66th9sb986EPc_Hev4qnd8Fcx5uQmXFARIwj9cqXzWwX1i2fOp5BoWUx08thXb5ksywZnd6G-RvOKsfe8kk5KVhjEBCriZvwaatzUOkRb3FETcJ9XTjLo2M Oct 08 20:54:22.094290 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 20:54:22.094290 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 20:54:22.094290 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 20:54:22.094290 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 20:54:22.094290 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 20:54:22.094290 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 20:54:22.094290 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 6a09d8f87c174336a1d216e396adfd33 Oct 08 20:54:22.094290 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-ImagesNegativeTestJSON-247453097 Oct 08 20:54:22.094290 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 20:54:22.094290 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 20:54:22.096007 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6a09d8f87c174336a1d216e396adfd33"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6a09d8f87c174336a1d216e396adfd33"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6a09d8f87c174336a1d216e396adfd33"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6a09d8f87c174336a1d216e396adfd33"}]}] Oct 08 20:54:22.096007 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-ImagesNegativeTestJSON-247453097 Oct 08 20:54:22.096007 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 6a09d8f87c174336a1d216e396adfd33 Oct 08 20:54:22.096007 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-247453097 Oct 08 20:54:22.096007 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-ImagesNegativeTestJSON-247453097-project Oct 08 20:54:22.096007 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 20:54:22.096007 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 20:54:22.096007 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 68e264d0c2b54a5f8d1bd197b84a104a Oct 08 20:54:22.096007 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-ImagesNegativeTestJSON-247453097-project Oct 08 20:54:22.096007 ncdv-master-1 devstack@n-api.service[140492]: Oct 08 20:54:22.096007 ncdv-master-1 devstack@n-api.service[140492]: {"createImage": {"name": "tempest-test-snap-402758154"}} Oct 08 20:54:22.096007 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 20:54:22.096007 ncdv-master-1 devstack@n-api.service[140492]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 08 20:54:22.096878 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-402758154'}}} Oct 08 20:54:22.096878 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:54:22.096878 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:54:22.096878 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 20:54:22.096878 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 20:54:22.096878 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 08 20:54:22.096878 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 08 20:54:22.096878 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 08 20:54:22.096878 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:54:22.096878 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:54:22.096878 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:54:22.096878 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:54:22.096878 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:54:22.096878 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:54:22.096878 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:54:22.096878 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:54:22.096878 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:54:22.096878 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:54:22.096878 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 20:54:22.096878 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 20:54:22.098106 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 20:54:22.098106 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 20:54:22.098106 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 08 20:54:22.098106 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 08 20:54:22.098106 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 20:54:22.098106 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 20:54:22.098106 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 20:54:22.098106 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 20:54:22.098106 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 08 20:54:22.098106 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:54:22.098106 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:54:22.098106 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:54:22.098106 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:54:22.098106 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:54:22.098106 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:54:22.098106 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 20:54:22.098106 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 20:54:22.098106 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 08 20:54:22.098106 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:54:22.102827 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-09f48107-128c-4ac8-8864-bb8d7958730b tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:54:22.103967 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-09f48107-128c-4ac8-8864-bb8d7958730b tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] 10.222.0.26 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.018399 Oct 08 20:54:22.108430 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 426/812] 10.222.0.26 () {60 vars in 1281 bytes} [Sat Oct 8 20:54:22 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 20:54:22.115808 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-3a07fda0-7bf4-4952-bf1b-b7e4691bfd05 tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:22.116305 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-3a07fda0-7bf4-4952-bf1b-b7e4691bfd05 tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] [instance: aadc9a05-66e2-45bb-8c2d-6755184a8e9c] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:22.133883 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3a07fda0-7bf4-4952-bf1b-b7e4691bfd05 tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:22.135926 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3a07fda0-7bf4-4952-bf1b-b7e4691bfd05 tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:22.143633 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3a07fda0-7bf4-4952-bf1b-b7e4691bfd05 tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:22.143633 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3a07fda0-7bf4-4952-bf1b-b7e4691bfd05 tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:22.143633 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3a07fda0-7bf4-4952-bf1b-b7e4691bfd05 tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:22.143633 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3a07fda0-7bf4-4952-bf1b-b7e4691bfd05 tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:22.184450 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-3a07fda0-7bf4-4952-bf1b-b7e4691bfd05 tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] HTTP exception thrown: Instance aadc9a05-66e2-45bb-8c2d-6755184a8e9c could not be found. Oct 08 20:54:22.191431 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-3a07fda0-7bf4-4952-bf1b-b7e4691bfd05 tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] Request method failure captured: Oct 08 20:54:22.191431 ncdv-master-1 devstack@n-api.service[140491]: request: DELETE /compute/v2.1/servers/aadc9a05-66e2-45bb-8c2d-6755184a8e9c HTTP/1.1 Oct 08 20:54:22.191431 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 20:54:22.191431 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 20:54:22.191431 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 20:54:22.191431 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 20:54:22.191431 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 20:54:22.191431 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 20:54:22.191431 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 20:54:22.191431 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 20:54:22.191431 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeNmgNx1Wt9rUYNfSw1qTb_Q5AP8cJMW0v_WLXBuHPHnetQHtlHYIvTY66th9sb986EPc_Hev4qnd8Fcx5uQmXFARIwj9cqXzWwX1i2fOp5BoWUx08thXb5ksywZnd6G-RvOKsfe8kk5KVhjEBCriZvwaatzUOkRb3FETcJ9XTjLo2M Oct 08 20:54:22.191431 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 20:54:22.191431 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 20:54:22.191431 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 20:54:22.191431 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 20:54:22.191431 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 20:54:22.191431 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 20:54:22.191431 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 6a09d8f87c174336a1d216e396adfd33 Oct 08 20:54:22.191431 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-ImagesNegativeTestJSON-247453097 Oct 08 20:54:22.191431 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 20:54:22.191431 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 20:54:22.194051 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6a09d8f87c174336a1d216e396adfd33"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6a09d8f87c174336a1d216e396adfd33"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6a09d8f87c174336a1d216e396adfd33"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6a09d8f87c174336a1d216e396adfd33"}]}] Oct 08 20:54:22.194051 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-ImagesNegativeTestJSON-247453097 Oct 08 20:54:22.194051 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 6a09d8f87c174336a1d216e396adfd33 Oct 08 20:54:22.194051 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-247453097 Oct 08 20:54:22.194051 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-ImagesNegativeTestJSON-247453097-project Oct 08 20:54:22.194051 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 20:54:22.194051 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 20:54:22.194051 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 68e264d0c2b54a5f8d1bd197b84a104a Oct 08 20:54:22.194051 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-ImagesNegativeTestJSON-247453097-project Oct 08 20:54:22.194051 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 20:54:22.194051 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance aadc9a05-66e2-45bb-8c2d-6755184a8e9c could not be found. Oct 08 20:54:22.194051 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': 'aadc9a05-66e2-45bb-8c2d-6755184a8e9c'} Oct 08 20:54:22.196065 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:54:22.196065 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:54:22.196065 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 20:54:22.196065 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 20:54:22.196065 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 20:54:22.196065 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 20:54:22.196065 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 20:54:22.196065 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 20:54:22.196065 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 20:54:22.196065 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 20:54:22.196065 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aadc9a05-66e2-45bb-8c2d-6755184a8e9c could not be found. Oct 08 20:54:22.196065 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:54:22.196065 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:54:22.196065 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:54:22.196065 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:54:22.196065 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:54:22.196065 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:54:22.196065 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:54:22.196065 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:54:22.196065 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:54:22.199866 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:54:22.199866 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 08 20:54:22.199866 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 08 20:54:22.199866 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 08 20:54:22.199866 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 08 20:54:22.199866 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 20:54:22.199866 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 20:54:22.199866 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 20:54:22.199866 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 20:54:22.199866 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aadc9a05-66e2-45bb-8c2d-6755184a8e9c could not be found. Oct 08 20:54:22.199866 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:54:22.199866 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:54:22.199866 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:54:22.199866 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:54:22.199866 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:54:22.199866 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:54:22.199866 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 20:54:22.199866 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 20:54:22.199866 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aadc9a05-66e2-45bb-8c2d-6755184a8e9c could not be found. Oct 08 20:54:22.199866 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:54:22.207480 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-3a07fda0-7bf4-4952-bf1b-b7e4691bfd05 tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] Returning 404 to user: Instance aadc9a05-66e2-45bb-8c2d-6755184a8e9c could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:54:22.208575 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-3a07fda0-7bf4-4952-bf1b-b7e4691bfd05 tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] 10.222.0.26 "DELETE /compute/v2.1/servers/aadc9a05-66e2-45bb-8c2d-6755184a8e9c" status: 404 len: 111 microversion: 2.1 time: 0.097931 Oct 08 20:54:22.209671 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 387/813] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 20:54:22 2022] DELETE /compute/v2.1/servers/aadc9a05-66e2-45bb-8c2d-6755184a8e9c => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 20:54:22.222031 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-361e2a02-c7fb-4664-99df-3ce7954c9088 tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:22.227285 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-705b9a8d-48d6-4ff4-bd33-0f08d01d0334 req-2c610cdc-4c9e-49af-a793-f8e180a3ea79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84eba001-0fa3-4fb7-b74e-0bb54c527ac7", "tag": "80190695-6264-463b-85c7-626419e89ee2"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:54:22.227662 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-361e2a02-c7fb-4664-99df-3ce7954c9088 tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] [instance: aadc9a05-66e2-45bb-8c2d-6755184a8e9c] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:22.234934 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-361e2a02-c7fb-4664-99df-3ce7954c9088 tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:22.235518 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-361e2a02-c7fb-4664-99df-3ce7954c9088 tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:22.236167 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-361e2a02-c7fb-4664-99df-3ce7954c9088 tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:22.238056 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-361e2a02-c7fb-4664-99df-3ce7954c9088 tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:22.238776 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-361e2a02-c7fb-4664-99df-3ce7954c9088 tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:22.240279 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-361e2a02-c7fb-4664-99df-3ce7954c9088 tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:22.250737 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-705b9a8d-48d6-4ff4-bd33-0f08d01d0334 req-2c610cdc-4c9e-49af-a793-f8e180a3ea79 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:22.251284 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-705b9a8d-48d6-4ff4-bd33-0f08d01d0334 req-2c610cdc-4c9e-49af-a793-f8e180a3ea79 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:22.251735 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-705b9a8d-48d6-4ff4-bd33-0f08d01d0334 req-2c610cdc-4c9e-49af-a793-f8e180a3ea79 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:22.258810 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-361e2a02-c7fb-4664-99df-3ce7954c9088 tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] HTTP exception thrown: Instance aadc9a05-66e2-45bb-8c2d-6755184a8e9c could not be found. Oct 08 20:54:22.260829 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-361e2a02-c7fb-4664-99df-3ce7954c9088 tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] Request method failure captured: Oct 08 20:54:22.260829 ncdv-master-1 devstack@n-api.service[140491]: request: GET /compute/v2.1/servers/aadc9a05-66e2-45bb-8c2d-6755184a8e9c HTTP/1.1 Oct 08 20:54:22.260829 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 20:54:22.260829 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 20:54:22.260829 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 20:54:22.260829 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 20:54:22.260829 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 20:54:22.260829 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 20:54:22.260829 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 20:54:22.260829 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 20:54:22.260829 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeNmgNx1Wt9rUYNfSw1qTb_Q5AP8cJMW0v_WLXBuHPHnetQHtlHYIvTY66th9sb986EPc_Hev4qnd8Fcx5uQmXFARIwj9cqXzWwX1i2fOp5BoWUx08thXb5ksywZnd6G-RvOKsfe8kk5KVhjEBCriZvwaatzUOkRb3FETcJ9XTjLo2M Oct 08 20:54:22.260829 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 20:54:22.260829 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 20:54:22.260829 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 20:54:22.260829 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 20:54:22.260829 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 20:54:22.260829 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 20:54:22.260829 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 6a09d8f87c174336a1d216e396adfd33 Oct 08 20:54:22.260829 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-ImagesNegativeTestJSON-247453097 Oct 08 20:54:22.260829 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 20:54:22.260829 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 20:54:22.262120 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6a09d8f87c174336a1d216e396adfd33"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6a09d8f87c174336a1d216e396adfd33"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6a09d8f87c174336a1d216e396adfd33"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6a09d8f87c174336a1d216e396adfd33"}]}] Oct 08 20:54:22.262120 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-ImagesNegativeTestJSON-247453097 Oct 08 20:54:22.262120 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 6a09d8f87c174336a1d216e396adfd33 Oct 08 20:54:22.262120 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-247453097 Oct 08 20:54:22.262120 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-ImagesNegativeTestJSON-247453097-project Oct 08 20:54:22.262120 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 20:54:22.262120 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 20:54:22.262120 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 68e264d0c2b54a5f8d1bd197b84a104a Oct 08 20:54:22.262120 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-ImagesNegativeTestJSON-247453097-project Oct 08 20:54:22.262120 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 20:54:22.262120 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance aadc9a05-66e2-45bb-8c2d-6755184a8e9c could not be found. Oct 08 20:54:22.262120 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': 'aadc9a05-66e2-45bb-8c2d-6755184a8e9c'} Oct 08 20:54:22.262812 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:54:22.262812 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:54:22.262812 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 20:54:22.262812 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 20:54:22.262812 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 20:54:22.262812 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 20:54:22.262812 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 20:54:22.262812 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 20:54:22.262812 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 20:54:22.262812 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 20:54:22.262812 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aadc9a05-66e2-45bb-8c2d-6755184a8e9c could not be found. Oct 08 20:54:22.262812 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:54:22.262812 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:54:22.262812 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:54:22.262812 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:54:22.262812 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:54:22.262812 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:54:22.262812 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:54:22.262812 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:54:22.262812 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:54:22.264608 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:54:22.264608 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 20:54:22.264608 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 20:54:22.264608 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 20:54:22.264608 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 20:54:22.264608 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 20:54:22.264608 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 20:54:22.264608 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aadc9a05-66e2-45bb-8c2d-6755184a8e9c could not be found. Oct 08 20:54:22.264608 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:54:22.264608 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:54:22.264608 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:54:22.264608 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:54:22.264608 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:54:22.264608 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:54:22.264608 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 20:54:22.264608 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 20:54:22.264608 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aadc9a05-66e2-45bb-8c2d-6755184a8e9c could not be found. Oct 08 20:54:22.264608 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:54:22.266885 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-361e2a02-c7fb-4664-99df-3ce7954c9088 tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] Returning 404 to user: Instance aadc9a05-66e2-45bb-8c2d-6755184a8e9c could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:54:22.269042 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-361e2a02-c7fb-4664-99df-3ce7954c9088 tempest-ImagesNegativeTestJSON-247453097 tempest-ImagesNegativeTestJSON-247453097-project] 10.222.0.26 "GET /compute/v2.1/servers/aadc9a05-66e2-45bb-8c2d-6755184a8e9c" status: 404 len: 111 microversion: 2.1 time: 0.053139 Oct 08 20:54:22.270430 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 388/814] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:54:22 2022] GET /compute/v2.1/servers/aadc9a05-66e2-45bb-8c2d-6755184a8e9c => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 20:54:22.280612 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-5b7e3911-0bcd-4adb-98ef-c6daec0ce3e0 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:22.280839 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-705b9a8d-48d6-4ff4-bd33-0f08d01d0334 req-2c610cdc-4c9e-49af-a793-f8e180a3ea79 service nova] Creating event network-changed:80190695-6264-463b-85c7-626419e89ee2 for instance 84eba001-0fa3-4fb7-b74e-0bb54c527ac7 on nch2-master-1 Oct 08 20:54:22.283944 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-5b7e3911-0bcd-4adb-98ef-c6daec0ce3e0 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] [instance: 84eba001-0fa3-4fb7-b74e-0bb54c527ac7] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:22.291138 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-705b9a8d-48d6-4ff4-bd33-0f08d01d0334 req-2c610cdc-4c9e-49af-a793-f8e180a3ea79 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083788 Oct 08 20:54:22.293512 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 427/815] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:54:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 08 20:54:22.297386 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5b7e3911-0bcd-4adb-98ef-c6daec0ce3e0 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:22.297889 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5b7e3911-0bcd-4adb-98ef-c6daec0ce3e0 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:22.298472 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5b7e3911-0bcd-4adb-98ef-c6daec0ce3e0 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:22.298832 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-4f92def9-f7d7-48c6-84eb-ae9a2b28e1e4 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1678662050", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "networks": [{"uuid": "a9c0a282-71aa-4609-90f6-4683ed1165e3"}]}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:54:22.299184 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5b7e3911-0bcd-4adb-98ef-c6daec0ce3e0 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:22.299815 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5b7e3911-0bcd-4adb-98ef-c6daec0ce3e0 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:22.300407 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5b7e3911-0bcd-4adb-98ef-c6daec0ce3e0 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:22.396516 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.network.neutron [None req-4f92def9-f7d7-48c6-84eb-ae9a2b28e1e4 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] validate_networks() for [('a9c0a282-71aa-4609-90f6-4683ed1165e3', None, None, None, None, None)] {{(pid=140492) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 20:54:22.621353 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-5b7e3911-0bcd-4adb-98ef-c6daec0ce3e0 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98936da9b5d94165b386d2d0893ac142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2441394d754f499e27f6f35d5b3afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:22.649710 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-5b7e3911-0bcd-4adb-98ef-c6daec0ce3e0 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] 10.222.0.26 "GET /compute/v2.1/servers/84eba001-0fa3-4fb7-b74e-0bb54c527ac7" status: 200 len: 1390 microversion: 2.1 time: 0.376582 Oct 08 20:54:22.668959 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 389/816] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:54:22 2022] GET /compute/v2.1/servers/84eba001-0fa3-4fb7-b74e-0bb54c527ac7 => generated 1390 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:54:22.677768 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-d07a5348-3400-46d1-a06d-d1c797b90ef3 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:22.678391 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-d07a5348-3400-46d1-a06d-d1c797b90ef3 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] [instance: a80fbf87-8203-4e6c-bee7-fe781bfccff1] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:22.689005 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d07a5348-3400-46d1-a06d-d1c797b90ef3 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:22.689532 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d07a5348-3400-46d1-a06d-d1c797b90ef3 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:22.689977 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d07a5348-3400-46d1-a06d-d1c797b90ef3 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:22.690670 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d07a5348-3400-46d1-a06d-d1c797b90ef3 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:22.691135 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d07a5348-3400-46d1-a06d-d1c797b90ef3 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:22.691561 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d07a5348-3400-46d1-a06d-d1c797b90ef3 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:22.987622 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-d07a5348-3400-46d1-a06d-d1c797b90ef3 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/a80fbf87-8203-4e6c-bee7-fe781bfccff1" status: 200 len: 1631 microversion: 2.1 time: 0.317171 Oct 08 20:54:22.988386 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 390/817] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:54:22 2022] GET /compute/v2.1/servers/a80fbf87-8203-4e6c-bee7-fe781bfccff1 => generated 1631 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:54:22.993619 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-ff03bd4c-882d-4081-8b08-32b12e8bba50 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:22.994533 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-ff03bd4c-882d-4081-8b08-32b12e8bba50 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] [instance: 73fd15ea-e4bd-4310-93bb-147b0a5e27ef] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:23.001247 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ff03bd4c-882d-4081-8b08-32b12e8bba50 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:23.002096 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ff03bd4c-882d-4081-8b08-32b12e8bba50 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:23.002760 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ff03bd4c-882d-4081-8b08-32b12e8bba50 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:23.003731 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ff03bd4c-882d-4081-8b08-32b12e8bba50 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:23.004412 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ff03bd4c-882d-4081-8b08-32b12e8bba50 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:23.005315 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ff03bd4c-882d-4081-8b08-32b12e8bba50 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:23.188559 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-ff03bd4c-882d-4081-8b08-32b12e8bba50 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef659f5a1a24c439528a7675bdd70f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c92fe04ab8248399d0acb932f82d607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:23.200826 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-ff03bd4c-882d-4081-8b08-32b12e8bba50 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] 10.222.0.26 "GET /compute/v2.1/servers/73fd15ea-e4bd-4310-93bb-147b0a5e27ef" status: 200 len: 1470 microversion: 2.1 time: 0.210418 Oct 08 20:54:23.213358 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 391/818] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:54:22 2022] GET /compute/v2.1/servers/73fd15ea-e4bd-4310-93bb-147b0a5e27ef => generated 1470 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:54:23.504370 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-9b1ccd1a-693d-4bc0-82cb-c1b72cf4cd0d tempest-ImagesDeleteNegativeTestJSON-1074779224 tempest-ImagesDeleteNegativeTestJSON-1074779224-project] 10.222.0.26 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.301354 Oct 08 20:54:23.509908 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 392/819] 10.222.0.26 () {58 vars in 1128 bytes} [Sat Oct 8 20:54:23 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 08 20:54:23.520178 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-4326bc90-82b4-4e5a-aee3-73296a6aae07 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:23.521224 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-4326bc90-82b4-4e5a-aee3-73296a6aae07 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] [instance: 92e31b92-0af1-4da6-bc87-23978f1aedf5] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:23.529898 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4326bc90-82b4-4e5a-aee3-73296a6aae07 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:23.531081 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4326bc90-82b4-4e5a-aee3-73296a6aae07 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:23.531524 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4326bc90-82b4-4e5a-aee3-73296a6aae07 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:23.532525 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4326bc90-82b4-4e5a-aee3-73296a6aae07 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:23.533134 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4326bc90-82b4-4e5a-aee3-73296a6aae07 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:23.533734 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4326bc90-82b4-4e5a-aee3-73296a6aae07 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:23.551814 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=3 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:54:23.557071 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-4f92def9-f7d7-48c6-84eb-ae9a2b28e1e4 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Flavor limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 20:54:23.557583 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-4f92def9-f7d7-48c6-84eb-ae9a2b28e1e4 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Image limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 20:54:23.558345 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-4f92def9-f7d7-48c6-84eb-ae9a2b28e1e4 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Flavor pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 20:54:23.558868 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-4f92def9-f7d7-48c6-84eb-ae9a2b28e1e4 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Image pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 20:54:23.559408 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-4f92def9-f7d7-48c6-84eb-ae9a2b28e1e4 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 20:54:23.570023 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4f92def9-f7d7-48c6-84eb-ae9a2b28e1e4 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:23.571169 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4f92def9-f7d7-48c6-84eb-ae9a2b28e1e4 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:23.571833 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4f92def9-f7d7-48c6-84eb-ae9a2b28e1e4 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:23.573710 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4f92def9-f7d7-48c6-84eb-ae9a2b28e1e4 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:23.574441 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4f92def9-f7d7-48c6-84eb-ae9a2b28e1e4 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:23.575165 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4f92def9-f7d7-48c6-84eb-ae9a2b28e1e4 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:23.598386 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-4f92def9-f7d7-48c6-84eb-ae9a2b28e1e4 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Getting quotas for project ac5c7906a4714a1887cb823e1c3a6056. Resources: {'cores', 'instances', 'ram'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 20:54:23.603903 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-4f92def9-f7d7-48c6-84eb-ae9a2b28e1e4 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Getting quotas for user d54b1c5c00544be4b60132d09817c8d6 and project ac5c7906a4714a1887cb823e1c3a6056. Resources: {'cores', 'instances', 'ram'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 20:54:23.620845 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-4f92def9-f7d7-48c6-84eb-ae9a2b28e1e4 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Going to run 1 instances... {{(pid=140492) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 20:54:23.624688 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-4f92def9-f7d7-48c6-84eb-ae9a2b28e1e4 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] [instance: f04fdc43-98fc-4bfc-a0f6-6efb9d2ee5bc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c508bd7f-7db9-4b2c-af7c-be54a855c355',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140492) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 20:54:23.630566 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-4326bc90-82b4-4e5a-aee3-73296a6aae07 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:23.639898 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-4326bc90-82b4-4e5a-aee3-73296a6aae07 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:23.641434 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-4326bc90-82b4-4e5a-aee3-73296a6aae07 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:23.648404 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-4326bc90-82b4-4e5a-aee3-73296a6aae07 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] 10.222.0.26 "GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5" status: 200 len: 1539 microversion: 2.91 time: 0.137205 Oct 08 20:54:23.649570 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 393/820] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:54:23 2022] GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5 => generated 1539 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:54:23.656023 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-f80f9854-5ccf-4deb-8524-282efaae7f40 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:54:23.659877 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-f80f9854-5ccf-4deb-8524-282efaae7f40 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] [instance: a80fbf87-8203-4e6c-bee7-fe781bfccff1] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:23.674148 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f80f9854-5ccf-4deb-8524-282efaae7f40 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:23.674983 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f80f9854-5ccf-4deb-8524-282efaae7f40 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:23.675983 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f80f9854-5ccf-4deb-8524-282efaae7f40 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:23.677162 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f80f9854-5ccf-4deb-8524-282efaae7f40 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:23.678052 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f80f9854-5ccf-4deb-8524-282efaae7f40 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:23.678903 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f80f9854-5ccf-4deb-8524-282efaae7f40 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:23.703187 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-4f92def9-f7d7-48c6-84eb-ae9a2b28e1e4 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.408394 Oct 08 20:54:23.704157 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 428/821] 10.222.0.26 () {62 vars in 1188 bytes} [Sat Oct 8 20:54:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 1410 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 08 20:54:23.709031 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-0c7ec339-6341-4f4a-90dc-94fc72e0c537 tempest-ImagesDeleteNegativeTestJSON-1074779224 tempest-ImagesDeleteNegativeTestJSON-1074779224-project] Calling method '.version_select at 0x7f1a8c93f820>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:23.709529 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.objects.instance [None req-f80f9854-5ccf-4deb-8524-282efaae7f40 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Lazy-loading 'flavor' on Instance uuid a80fbf87-8203-4e6c-bee7-fe781bfccff1 {{(pid=140491) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 20:54:23.726522 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-f80f9854-5ccf-4deb-8524-282efaae7f40 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] [instance: a80fbf87-8203-4e6c-bee7-fe781bfccff1] Going to try to live migrate instance to nch1-master-1 {{(pid=140491) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 08 20:54:23.741512 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:54:23.775280 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-0c7ec339-6341-4f4a-90dc-94fc72e0c537 tempest-ImagesDeleteNegativeTestJSON-1074779224 tempest-ImagesDeleteNegativeTestJSON-1074779224-project] HTTP exception thrown: Image not found. Oct 08 20:54:23.784319 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-0c7ec339-6341-4f4a-90dc-94fc72e0c537 tempest-ImagesDeleteNegativeTestJSON-1074779224 tempest-ImagesDeleteNegativeTestJSON-1074779224-project] Request method failure captured: Oct 08 20:54:23.784319 ncdv-master-1 devstack@n-api.service[140492]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Oct 08 20:54:23.784319 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 20:54:23.784319 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 20:54:23.784319 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 20:54:23.784319 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 20:54:23.784319 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 20:54:23.784319 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 20:54:23.784319 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 20:54:23.784319 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 20:54:23.784319 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeN-2mwody2CMejaVGI_nnWsVkYB82nUH4xNDlT5Y5bMbrkQpaooTQe51Elpy71erQ3pi71NGmyUeRSemcujSEfRcvkpGUP07-PIVgYvOZn8oBDNcev-kPUfy97SMvzsVjNSBJ9dppT_2oOb2O5o5zlFGPgiJqYoS8OfXiLFBUmP67A Oct 08 20:54:23.784319 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 20:54:23.784319 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 20:54:23.784319 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 20:54:23.784319 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 20:54:23.784319 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 20:54:23.784319 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 20:54:23.784319 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: de62b954fc67442cb9b0e2ea6e37414f Oct 08 20:54:23.784319 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1074779224 Oct 08 20:54:23.784319 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 20:54:23.784319 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 20:54:23.785990 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/de62b954fc67442cb9b0e2ea6e37414f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/de62b954fc67442cb9b0e2ea6e37414f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_de62b954fc67442cb9b0e2ea6e37414f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/de62b954fc67442cb9b0e2ea6e37414f"}]}] Oct 08 20:54:23.785990 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1074779224 Oct 08 20:54:23.785990 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: de62b954fc67442cb9b0e2ea6e37414f Oct 08 20:54:23.785990 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1074779224 Oct 08 20:54:23.785990 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-ImagesDeleteNegativeTestJSON-1074779224-project Oct 08 20:54:23.785990 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 20:54:23.785990 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 20:54:23.785990 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: f82f5f91550d44f599d4aa33c34864dc Oct 08 20:54:23.785990 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1074779224-project Oct 08 20:54:23.785990 ncdv-master-1 devstack@n-api.service[140492]: method: Oct 08 20:54:23.785990 ncdv-master-1 devstack@n-api.service[140492]: exception: Image not found. Oct 08 20:54:23.785990 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': '-1'} Oct 08 20:54:23.785990 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:54:23.785990 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:54:23.787092 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 08 20:54:23.787092 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 08 20:54:23.787092 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 08 20:54:23.787092 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 08 20:54:23.787092 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 08 20:54:23.787092 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 08 20:54:23.787092 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 08 20:54:23.787092 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 08 20:54:23.787092 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 08 20:54:23.787092 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 08 20:54:23.787092 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 08 20:54:23.787092 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 08 20:54:23.787092 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 08 20:54:23.787092 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 08 20:54:23.787092 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Oct 08 20:54:23.787092 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:54:23.787092 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:54:23.787092 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:54:23.787092 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:54:23.789026 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 08 20:54:23.789026 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 08 20:54:23.789026 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 08 20:54:23.789026 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 08 20:54:23.789026 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 08 20:54:23.789026 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 08 20:54:23.789026 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Oct 08 20:54:23.789026 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:54:23.789026 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:54:23.789026 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:54:23.789026 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:54:23.789026 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:54:23.789026 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:54:23.789026 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:54:23.789026 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:54:23.789026 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 08 20:54:23.789026 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 08 20:54:23.789026 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:54:23.789026 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:54:23.789026 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 08 20:54:23.790671 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 08 20:54:23.790671 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 08 20:54:23.790671 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:54:23.790671 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:54:23.790671 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:54:23.790671 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:54:23.790671 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:54:23.790671 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:54:23.790671 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 20:54:23.790671 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 20:54:23.790671 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 08 20:54:23.790671 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:54:23.792979 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:54:23.793228 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-0c7ec339-6341-4f4a-90dc-94fc72e0c537 tempest-ImagesDeleteNegativeTestJSON-1074779224 tempest-ImagesDeleteNegativeTestJSON-1074779224-project] Returning 404 to user: Image not found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:54:23.794707 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-0c7ec339-6341-4f4a-90dc-94fc72e0c537 tempest-ImagesDeleteNegativeTestJSON-1074779224 tempest-ImagesDeleteNegativeTestJSON-1074779224-project] 10.222.0.26 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.089494 Oct 08 20:54:23.796660 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 429/822] 10.222.0.26 () {58 vars in 1134 bytes} [Sat Oct 8 20:54:23 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 08 20:54:23.811303 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-b4de8355-60ec-4b19-a1b1-b53784689b37 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:23.812878 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-b4de8355-60ec-4b19-a1b1-b53784689b37 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] [instance: 84eba001-0fa3-4fb7-b74e-0bb54c527ac7] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:23.828520 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b4de8355-60ec-4b19-a1b1-b53784689b37 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:23.831440 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b4de8355-60ec-4b19-a1b1-b53784689b37 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:23.832058 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b4de8355-60ec-4b19-a1b1-b53784689b37 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:23.832970 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b4de8355-60ec-4b19-a1b1-b53784689b37 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:23.835174 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b4de8355-60ec-4b19-a1b1-b53784689b37 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:23.835625 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b4de8355-60ec-4b19-a1b1-b53784689b37 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:23.892070 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=2 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:54:24.102639 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-b4de8355-60ec-4b19-a1b1-b53784689b37 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98936da9b5d94165b386d2d0893ac142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2441394d754f499e27f6f35d5b3afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:24.117972 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-b4de8355-60ec-4b19-a1b1-b53784689b37 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] 10.222.0.26 "GET /compute/v2.1/servers/84eba001-0fa3-4fb7-b74e-0bb54c527ac7" status: 200 len: 1390 microversion: 2.1 time: 0.319174 Oct 08 20:54:24.119705 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 430/823] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:54:23 2022] GET /compute/v2.1/servers/84eba001-0fa3-4fb7-b74e-0bb54c527ac7 => generated 1390 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:54:24.128575 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-7393de8a-81a0-405f-b366-c06f3ce3874e tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:24.129518 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-7393de8a-81a0-405f-b366-c06f3ce3874e tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] [instance: f04fdc43-98fc-4bfc-a0f6-6efb9d2ee5bc] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:24.237824 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-7393de8a-81a0-405f-b366-c06f3ce3874e tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:24.245532 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-7393de8a-81a0-405f-b366-c06f3ce3874e tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:24.246998 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-7393de8a-81a0-405f-b366-c06f3ce3874e tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:24.249895 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-7393de8a-81a0-405f-b366-c06f3ce3874e tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] 10.222.0.26 "GET /compute/v2.1/servers/f04fdc43-98fc-4bfc-a0f6-6efb9d2ee5bc" status: 200 len: 1262 microversion: 2.25 time: 0.128912 Oct 08 20:54:24.258674 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 431/824] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:54:24 2022] GET /compute/v2.1/servers/f04fdc43-98fc-4bfc-a0f6-6efb9d2ee5bc => generated 1262 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:54:24.266279 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-27115ed1-b0e5-4c31-afc7-72cd4f287e16 tempest-ImagesDeleteNegativeTestJSON-1074779224 tempest-ImagesDeleteNegativeTestJSON-1074779224-project] Calling method '.version_select at 0x7f1a8c8210d0>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:24.301084 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-27115ed1-b0e5-4c31-afc7-72cd4f287e16 tempest-ImagesDeleteNegativeTestJSON-1074779224 tempest-ImagesDeleteNegativeTestJSON-1074779224-project] HTTP exception thrown: Image not found. Oct 08 20:54:24.303083 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-27115ed1-b0e5-4c31-afc7-72cd4f287e16 tempest-ImagesDeleteNegativeTestJSON-1074779224 tempest-ImagesDeleteNegativeTestJSON-1074779224-project] Request method failure captured: Oct 08 20:54:24.303083 ncdv-master-1 devstack@n-api.service[140492]: request: DELETE /compute/v2.1/images/875bc48d-1d56-4cfe-ad58-cabbfa885a2j HTTP/1.1 Oct 08 20:54:24.303083 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 20:54:24.303083 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 20:54:24.303083 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 20:54:24.303083 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 20:54:24.303083 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 20:54:24.303083 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 20:54:24.303083 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 20:54:24.303083 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 20:54:24.303083 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeN-2mwody2CMejaVGI_nnWsVkYB82nUH4xNDlT5Y5bMbrkQpaooTQe51Elpy71erQ3pi71NGmyUeRSemcujSEfRcvkpGUP07-PIVgYvOZn8oBDNcev-kPUfy97SMvzsVjNSBJ9dppT_2oOb2O5o5zlFGPgiJqYoS8OfXiLFBUmP67A Oct 08 20:54:24.303083 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 20:54:24.303083 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 20:54:24.303083 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 20:54:24.303083 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 20:54:24.303083 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 20:54:24.303083 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 20:54:24.303083 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: de62b954fc67442cb9b0e2ea6e37414f Oct 08 20:54:24.303083 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1074779224 Oct 08 20:54:24.303083 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 20:54:24.303083 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 20:54:24.304367 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/de62b954fc67442cb9b0e2ea6e37414f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/de62b954fc67442cb9b0e2ea6e37414f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_de62b954fc67442cb9b0e2ea6e37414f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/de62b954fc67442cb9b0e2ea6e37414f"}]}] Oct 08 20:54:24.304367 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1074779224 Oct 08 20:54:24.304367 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: de62b954fc67442cb9b0e2ea6e37414f Oct 08 20:54:24.304367 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1074779224 Oct 08 20:54:24.304367 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-ImagesDeleteNegativeTestJSON-1074779224-project Oct 08 20:54:24.304367 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 20:54:24.304367 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 20:54:24.304367 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: f82f5f91550d44f599d4aa33c34864dc Oct 08 20:54:24.304367 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1074779224-project Oct 08 20:54:24.304367 ncdv-master-1 devstack@n-api.service[140492]: method: Oct 08 20:54:24.304367 ncdv-master-1 devstack@n-api.service[140492]: exception: Image not found. Oct 08 20:54:24.304367 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': '875bc48d-1d56-4cfe-ad58-cabbfa885a2j'} Oct 08 20:54:24.304367 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:54:24.305121 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:54:24.305121 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 08 20:54:24.305121 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 08 20:54:24.305121 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 08 20:54:24.305121 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 08 20:54:24.305121 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 08 20:54:24.305121 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 08 20:54:24.305121 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 08 20:54:24.305121 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 08 20:54:24.305121 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 08 20:54:24.305121 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 08 20:54:24.305121 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 08 20:54:24.305121 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 08 20:54:24.305121 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 08 20:54:24.305121 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 08 20:54:24.305121 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 875bc48d-1d56-4cfe-ad58-cabbfa885a2j to delete Oct 08 20:54:24.305121 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:54:24.305121 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:54:24.305121 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:54:24.306299 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:54:24.306299 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 08 20:54:24.306299 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 08 20:54:24.306299 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 08 20:54:24.306299 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 08 20:54:24.306299 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 08 20:54:24.306299 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 08 20:54:24.306299 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 875bc48d-1d56-4cfe-ad58-cabbfa885a2j could not be found. Oct 08 20:54:24.306299 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:54:24.306299 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:54:24.306299 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:54:24.306299 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:54:24.306299 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:54:24.306299 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:54:24.306299 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:54:24.306299 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:54:24.306299 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 08 20:54:24.306299 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 08 20:54:24.306299 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:54:24.306299 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:54:24.308432 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 08 20:54:24.308432 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 08 20:54:24.308432 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 08 20:54:24.308432 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:54:24.308432 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:54:24.308432 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:54:24.308432 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:54:24.308432 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:54:24.308432 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:54:24.308432 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 20:54:24.308432 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 20:54:24.308432 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 08 20:54:24.308432 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:54:24.308432 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-27115ed1-b0e5-4c31-afc7-72cd4f287e16 tempest-ImagesDeleteNegativeTestJSON-1074779224 tempest-ImagesDeleteNegativeTestJSON-1074779224-project] Returning 404 to user: Image not found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:54:24.308432 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-27115ed1-b0e5-4c31-afc7-72cd4f287e16 tempest-ImagesDeleteNegativeTestJSON-1074779224 tempest-ImagesDeleteNegativeTestJSON-1074779224-project] 10.222.0.26 "DELETE /compute/v2.1/images/875bc48d-1d56-4cfe-ad58-cabbfa885a2j" status: 404 len: 62 microversion: 2.1 time: 0.046054 Oct 08 20:54:24.309446 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 432/825] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:54:24 2022] DELETE /compute/v2.1/images/875bc48d-1d56-4cfe-ad58-cabbfa885a2j => generated 62 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 08 20:54:24.345737 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-00a8341d-f33c-4c7a-a555-fd5910ac5f70 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:24.346404 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-00a8341d-f33c-4c7a-a555-fd5910ac5f70 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] [instance: 73fd15ea-e4bd-4310-93bb-147b0a5e27ef] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:24.368403 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-00a8341d-f33c-4c7a-a555-fd5910ac5f70 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:24.370232 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-00a8341d-f33c-4c7a-a555-fd5910ac5f70 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:24.370706 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-00a8341d-f33c-4c7a-a555-fd5910ac5f70 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:24.371471 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-00a8341d-f33c-4c7a-a555-fd5910ac5f70 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:24.384241 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-00a8341d-f33c-4c7a-a555-fd5910ac5f70 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:24.386225 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-00a8341d-f33c-4c7a-a555-fd5910ac5f70 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:24.743406 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-00a8341d-f33c-4c7a-a555-fd5910ac5f70 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef659f5a1a24c439528a7675bdd70f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c92fe04ab8248399d0acb932f82d607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:24.759222 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-00a8341d-f33c-4c7a-a555-fd5910ac5f70 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] 10.222.0.26 "GET /compute/v2.1/servers/73fd15ea-e4bd-4310-93bb-147b0a5e27ef" status: 200 len: 1470 microversion: 2.1 time: 0.432874 Oct 08 20:54:24.759702 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 433/826] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:54:24 2022] GET /compute/v2.1/servers/73fd15ea-e4bd-4310-93bb-147b0a5e27ef => generated 1470 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:54:24.771315 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-eb03c5ab-9756-47df-9eac-f2e3d30d6811 tempest-ImagesDeleteNegativeTestJSON-1074779224 tempest-ImagesDeleteNegativeTestJSON-1074779224-project] Calling method '.version_select at 0x7f1a8c8ea5e0>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:24.800001 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-eb03c5ab-9756-47df-9eac-f2e3d30d6811 tempest-ImagesDeleteNegativeTestJSON-1074779224 tempest-ImagesDeleteNegativeTestJSON-1074779224-project] HTTP exception thrown: Image not found. Oct 08 20:54:24.805775 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-eb03c5ab-9756-47df-9eac-f2e3d30d6811 tempest-ImagesDeleteNegativeTestJSON-1074779224 tempest-ImagesDeleteNegativeTestJSON-1074779224-project] Request method failure captured: Oct 08 20:54:24.805775 ncdv-master-1 devstack@n-api.service[140492]: request: DELETE /compute/v2.1/images/24e20a0c-6aa2-47d4-a920-a487f6b505471 HTTP/1.1 Oct 08 20:54:24.805775 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 20:54:24.805775 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 20:54:24.805775 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 20:54:24.805775 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 20:54:24.805775 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 20:54:24.805775 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 20:54:24.805775 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 20:54:24.805775 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 20:54:24.805775 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeN-2mwody2CMejaVGI_nnWsVkYB82nUH4xNDlT5Y5bMbrkQpaooTQe51Elpy71erQ3pi71NGmyUeRSemcujSEfRcvkpGUP07-PIVgYvOZn8oBDNcev-kPUfy97SMvzsVjNSBJ9dppT_2oOb2O5o5zlFGPgiJqYoS8OfXiLFBUmP67A Oct 08 20:54:24.805775 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 20:54:24.805775 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 20:54:24.805775 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 20:54:24.805775 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 20:54:24.805775 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 20:54:24.805775 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 20:54:24.805775 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: de62b954fc67442cb9b0e2ea6e37414f Oct 08 20:54:24.805775 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1074779224 Oct 08 20:54:24.805775 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 20:54:24.805775 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 20:54:24.807198 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/de62b954fc67442cb9b0e2ea6e37414f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/de62b954fc67442cb9b0e2ea6e37414f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_de62b954fc67442cb9b0e2ea6e37414f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/de62b954fc67442cb9b0e2ea6e37414f"}]}] Oct 08 20:54:24.807198 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1074779224 Oct 08 20:54:24.807198 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: de62b954fc67442cb9b0e2ea6e37414f Oct 08 20:54:24.807198 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1074779224 Oct 08 20:54:24.807198 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-ImagesDeleteNegativeTestJSON-1074779224-project Oct 08 20:54:24.807198 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 20:54:24.807198 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 20:54:24.807198 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: f82f5f91550d44f599d4aa33c34864dc Oct 08 20:54:24.807198 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1074779224-project Oct 08 20:54:24.807198 ncdv-master-1 devstack@n-api.service[140492]: method: Oct 08 20:54:24.807198 ncdv-master-1 devstack@n-api.service[140492]: exception: Image not found. Oct 08 20:54:24.807198 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': '24e20a0c-6aa2-47d4-a920-a487f6b505471'} Oct 08 20:54:24.807198 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:54:24.807987 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:54:24.807987 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 08 20:54:24.807987 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 08 20:54:24.807987 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 08 20:54:24.807987 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 08 20:54:24.807987 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 08 20:54:24.807987 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 08 20:54:24.807987 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 08 20:54:24.807987 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 08 20:54:24.807987 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 08 20:54:24.807987 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 08 20:54:24.807987 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 08 20:54:24.807987 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 08 20:54:24.807987 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 08 20:54:24.807987 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 08 20:54:24.807987 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 24e20a0c-6aa2-47d4-a920-a487f6b505471 to delete Oct 08 20:54:24.807987 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:54:24.807987 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:54:24.807987 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:54:24.809083 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:54:24.809083 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 08 20:54:24.809083 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 08 20:54:24.809083 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 08 20:54:24.809083 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 08 20:54:24.809083 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 08 20:54:24.809083 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 08 20:54:24.809083 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 24e20a0c-6aa2-47d4-a920-a487f6b505471 could not be found. Oct 08 20:54:24.809083 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:54:24.809083 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:54:24.809083 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:54:24.809083 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:54:24.809083 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:54:24.809083 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:54:24.809083 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:54:24.809083 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:54:24.809083 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 08 20:54:24.809083 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 08 20:54:24.809083 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:54:24.809083 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:54:24.813304 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 08 20:54:24.813304 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 08 20:54:24.813304 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 08 20:54:24.813304 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:54:24.813304 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:54:24.813304 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:54:24.813304 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:54:24.813304 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:54:24.813304 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:54:24.813304 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 20:54:24.813304 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 20:54:24.813304 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 08 20:54:24.813304 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:54:24.813304 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-eb03c5ab-9756-47df-9eac-f2e3d30d6811 tempest-ImagesDeleteNegativeTestJSON-1074779224 tempest-ImagesDeleteNegativeTestJSON-1074779224-project] Returning 404 to user: Image not found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:54:24.813304 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-eb03c5ab-9756-47df-9eac-f2e3d30d6811 tempest-ImagesDeleteNegativeTestJSON-1074779224 tempest-ImagesDeleteNegativeTestJSON-1074779224-project] 10.222.0.26 "DELETE /compute/v2.1/images/24e20a0c-6aa2-47d4-a920-a487f6b505471" status: 404 len: 62 microversion: 2.1 time: 0.051017 Oct 08 20:54:24.819728 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 434/827] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 20:54:24 2022] DELETE /compute/v2.1/images/24e20a0c-6aa2-47d4-a920-a487f6b505471 => generated 62 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 08 20:54:24.828867 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-3568f5b5-d422-415c-b820-ca8f061eb355 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:24.829540 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-3568f5b5-d422-415c-b820-ca8f061eb355 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] [instance: 92e31b92-0af1-4da6-bc87-23978f1aedf5] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:24.849432 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3568f5b5-d422-415c-b820-ca8f061eb355 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:24.851220 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3568f5b5-d422-415c-b820-ca8f061eb355 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:24.851689 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3568f5b5-d422-415c-b820-ca8f061eb355 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:24.853633 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3568f5b5-d422-415c-b820-ca8f061eb355 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:24.854124 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3568f5b5-d422-415c-b820-ca8f061eb355 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:24.854570 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3568f5b5-d422-415c-b820-ca8f061eb355 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:24.981265 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-3568f5b5-d422-415c-b820-ca8f061eb355 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:24.998341 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-3568f5b5-d422-415c-b820-ca8f061eb355 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:25.004387 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-3568f5b5-d422-415c-b820-ca8f061eb355 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:25.022435 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-3568f5b5-d422-415c-b820-ca8f061eb355 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] 10.222.0.26 "GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5" status: 200 len: 1539 microversion: 2.91 time: 0.205063 Oct 08 20:54:25.024308 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 435/828] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:54:24 2022] GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5 => generated 1539 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:54:25.039690 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-957c5cf4-9d20-4230-a290-7f15dabceec4 tempest-ImagesDeleteNegativeTestJSON-1074779224 tempest-ImagesDeleteNegativeTestJSON-1074779224-project] Calling method '.version_select at 0x7f1a8c8b8c10>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:25.072919 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-957c5cf4-9d20-4230-a290-7f15dabceec4 tempest-ImagesDeleteNegativeTestJSON-1074779224 tempest-ImagesDeleteNegativeTestJSON-1074779224-project] HTTP exception thrown: Image not found. Oct 08 20:54:25.075786 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-957c5cf4-9d20-4230-a290-7f15dabceec4 tempest-ImagesDeleteNegativeTestJSON-1074779224 tempest-ImagesDeleteNegativeTestJSON-1074779224-project] Request method failure captured: Oct 08 20:54:25.075786 ncdv-master-1 devstack@n-api.service[140492]: request: DELETE /compute/v2.1/images/tempest-invalid-2093664858 HTTP/1.1 Oct 08 20:54:25.075786 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 20:54:25.075786 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 20:54:25.075786 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 20:54:25.075786 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 20:54:25.075786 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 20:54:25.075786 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 20:54:25.075786 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 20:54:25.075786 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 20:54:25.075786 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeN-2mwody2CMejaVGI_nnWsVkYB82nUH4xNDlT5Y5bMbrkQpaooTQe51Elpy71erQ3pi71NGmyUeRSemcujSEfRcvkpGUP07-PIVgYvOZn8oBDNcev-kPUfy97SMvzsVjNSBJ9dppT_2oOb2O5o5zlFGPgiJqYoS8OfXiLFBUmP67A Oct 08 20:54:25.075786 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 20:54:25.075786 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 20:54:25.075786 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 20:54:25.075786 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 20:54:25.075786 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 20:54:25.075786 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 20:54:25.075786 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: de62b954fc67442cb9b0e2ea6e37414f Oct 08 20:54:25.075786 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1074779224 Oct 08 20:54:25.075786 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 20:54:25.075786 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 20:54:25.077835 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/de62b954fc67442cb9b0e2ea6e37414f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/de62b954fc67442cb9b0e2ea6e37414f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_de62b954fc67442cb9b0e2ea6e37414f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/de62b954fc67442cb9b0e2ea6e37414f"}]}] Oct 08 20:54:25.077835 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1074779224 Oct 08 20:54:25.077835 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: de62b954fc67442cb9b0e2ea6e37414f Oct 08 20:54:25.077835 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1074779224 Oct 08 20:54:25.077835 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-ImagesDeleteNegativeTestJSON-1074779224-project Oct 08 20:54:25.077835 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 20:54:25.077835 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 20:54:25.077835 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: f82f5f91550d44f599d4aa33c34864dc Oct 08 20:54:25.077835 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1074779224-project Oct 08 20:54:25.077835 ncdv-master-1 devstack@n-api.service[140492]: method: Oct 08 20:54:25.077835 ncdv-master-1 devstack@n-api.service[140492]: exception: Image not found. Oct 08 20:54:25.077835 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': 'tempest-invalid-2093664858'} Oct 08 20:54:25.077835 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:54:25.078654 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:54:25.078654 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 08 20:54:25.078654 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 08 20:54:25.078654 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 08 20:54:25.078654 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 08 20:54:25.078654 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 08 20:54:25.078654 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 08 20:54:25.078654 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 08 20:54:25.078654 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 08 20:54:25.078654 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 08 20:54:25.078654 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 08 20:54:25.078654 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 08 20:54:25.078654 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 08 20:54:25.078654 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 08 20:54:25.078654 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 08 20:54:25.078654 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-2093664858 to delete Oct 08 20:54:25.078654 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:54:25.078654 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:54:25.078654 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:54:25.079772 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:54:25.079772 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 08 20:54:25.079772 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 08 20:54:25.079772 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 08 20:54:25.079772 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 08 20:54:25.079772 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 08 20:54:25.079772 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 08 20:54:25.079772 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-2093664858 could not be found. Oct 08 20:54:25.079772 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:54:25.079772 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:54:25.079772 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:54:25.079772 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:54:25.079772 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:54:25.079772 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:54:25.079772 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:54:25.079772 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:54:25.079772 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 08 20:54:25.079772 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 08 20:54:25.079772 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:54:25.079772 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:54:25.080877 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 08 20:54:25.080877 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 08 20:54:25.080877 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 08 20:54:25.080877 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:54:25.080877 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:54:25.080877 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:54:25.080877 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:54:25.080877 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:54:25.080877 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:54:25.080877 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 20:54:25.080877 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 20:54:25.080877 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 08 20:54:25.080877 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:54:25.084695 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-957c5cf4-9d20-4230-a290-7f15dabceec4 tempest-ImagesDeleteNegativeTestJSON-1074779224 tempest-ImagesDeleteNegativeTestJSON-1074779224-project] Returning 404 to user: Image not found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:54:25.086369 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-957c5cf4-9d20-4230-a290-7f15dabceec4 tempest-ImagesDeleteNegativeTestJSON-1074779224 tempest-ImagesDeleteNegativeTestJSON-1074779224-project] 10.222.0.26 "DELETE /compute/v2.1/images/tempest-invalid-2093664858" status: 404 len: 62 microversion: 2.1 time: 0.059251 Oct 08 20:54:25.087580 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 436/829] 10.222.0.26 () {58 vars in 1206 bytes} [Sat Oct 8 20:54:25 2022] DELETE /compute/v2.1/images/tempest-invalid-2093664858 => generated 62 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 08 20:54:25.098921 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-421e9aaa-45e7-46c2-8fd2-97297c933351 tempest-ImagesDeleteNegativeTestJSON-1074779224 tempest-ImagesDeleteNegativeTestJSON-1074779224-project] Calling method '.version_select at 0x7f1a8c895e50>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:25.137477 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-421e9aaa-45e7-46c2-8fd2-97297c933351 tempest-ImagesDeleteNegativeTestJSON-1074779224 tempest-ImagesDeleteNegativeTestJSON-1074779224-project] HTTP exception thrown: Image not found. Oct 08 20:54:25.140151 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-421e9aaa-45e7-46c2-8fd2-97297c933351 tempest-ImagesDeleteNegativeTestJSON-1074779224 tempest-ImagesDeleteNegativeTestJSON-1074779224-project] Request method failure captured: Oct 08 20:54:25.140151 ncdv-master-1 devstack@n-api.service[140492]: request: DELETE /compute/v2.1/images/519bf44c-fd6c-4c5d-951d-d123f5a9c79a HTTP/1.1 Oct 08 20:54:25.140151 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 20:54:25.140151 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 20:54:25.140151 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 20:54:25.140151 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 20:54:25.140151 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 20:54:25.140151 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 20:54:25.140151 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 20:54:25.140151 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 20:54:25.140151 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeN-2mwody2CMejaVGI_nnWsVkYB82nUH4xNDlT5Y5bMbrkQpaooTQe51Elpy71erQ3pi71NGmyUeRSemcujSEfRcvkpGUP07-PIVgYvOZn8oBDNcev-kPUfy97SMvzsVjNSBJ9dppT_2oOb2O5o5zlFGPgiJqYoS8OfXiLFBUmP67A Oct 08 20:54:25.140151 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 20:54:25.140151 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 20:54:25.140151 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 20:54:25.140151 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 20:54:25.140151 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 20:54:25.140151 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 20:54:25.140151 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: de62b954fc67442cb9b0e2ea6e37414f Oct 08 20:54:25.140151 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1074779224 Oct 08 20:54:25.140151 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 20:54:25.140151 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 20:54:25.141856 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/de62b954fc67442cb9b0e2ea6e37414f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/de62b954fc67442cb9b0e2ea6e37414f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_de62b954fc67442cb9b0e2ea6e37414f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/de62b954fc67442cb9b0e2ea6e37414f"}]}] Oct 08 20:54:25.141856 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1074779224 Oct 08 20:54:25.141856 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: de62b954fc67442cb9b0e2ea6e37414f Oct 08 20:54:25.141856 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1074779224 Oct 08 20:54:25.141856 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-ImagesDeleteNegativeTestJSON-1074779224-project Oct 08 20:54:25.141856 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 20:54:25.141856 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 20:54:25.141856 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: f82f5f91550d44f599d4aa33c34864dc Oct 08 20:54:25.141856 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1074779224-project Oct 08 20:54:25.141856 ncdv-master-1 devstack@n-api.service[140492]: method: Oct 08 20:54:25.141856 ncdv-master-1 devstack@n-api.service[140492]: exception: Image not found. Oct 08 20:54:25.141856 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': '519bf44c-fd6c-4c5d-951d-d123f5a9c79a'} Oct 08 20:54:25.141856 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:54:25.142607 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:54:25.142607 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 08 20:54:25.142607 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 08 20:54:25.142607 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 08 20:54:25.142607 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 08 20:54:25.142607 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 08 20:54:25.142607 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 08 20:54:25.142607 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 08 20:54:25.142607 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 08 20:54:25.142607 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 08 20:54:25.142607 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 08 20:54:25.142607 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 08 20:54:25.142607 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 08 20:54:25.142607 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 08 20:54:25.142607 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 08 20:54:25.142607 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 519bf44c-fd6c-4c5d-951d-d123f5a9c79a to delete Oct 08 20:54:25.142607 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:54:25.142607 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:54:25.142607 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:54:25.146040 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:54:25.146040 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 08 20:54:25.146040 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 08 20:54:25.146040 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 08 20:54:25.146040 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 08 20:54:25.146040 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 08 20:54:25.146040 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 08 20:54:25.146040 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 519bf44c-fd6c-4c5d-951d-d123f5a9c79a could not be found. Oct 08 20:54:25.146040 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:54:25.146040 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:54:25.146040 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:54:25.146040 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:54:25.146040 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:54:25.146040 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:54:25.146040 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:54:25.146040 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:54:25.146040 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 08 20:54:25.146040 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 08 20:54:25.146040 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:54:25.146040 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:54:25.149340 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 08 20:54:25.149340 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 08 20:54:25.149340 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 08 20:54:25.149340 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:54:25.149340 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:54:25.149340 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:54:25.149340 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:54:25.149340 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:54:25.149340 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:54:25.149340 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 20:54:25.149340 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 20:54:25.149340 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 08 20:54:25.149340 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:54:25.149340 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-421e9aaa-45e7-46c2-8fd2-97297c933351 tempest-ImagesDeleteNegativeTestJSON-1074779224 tempest-ImagesDeleteNegativeTestJSON-1074779224-project] Returning 404 to user: Image not found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:54:25.149340 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-421e9aaa-45e7-46c2-8fd2-97297c933351 tempest-ImagesDeleteNegativeTestJSON-1074779224 tempest-ImagesDeleteNegativeTestJSON-1074779224-project] 10.222.0.26 "DELETE /compute/v2.1/images/519bf44c-fd6c-4c5d-951d-d123f5a9c79a" status: 404 len: 62 microversion: 2.1 time: 0.053679 Oct 08 20:54:25.157547 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 437/830] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:54:25 2022] DELETE /compute/v2.1/images/519bf44c-fd6c-4c5d-951d-d123f5a9c79a => generated 62 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 08 20:54:25.167340 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-c5e032f5-9acb-4c7f-a550-1ce9447977ef tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:25.168452 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-c5e032f5-9acb-4c7f-a550-1ce9447977ef tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] [instance: 84eba001-0fa3-4fb7-b74e-0bb54c527ac7] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:25.178021 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c5e032f5-9acb-4c7f-a550-1ce9447977ef tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:25.178909 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c5e032f5-9acb-4c7f-a550-1ce9447977ef tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:25.179836 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c5e032f5-9acb-4c7f-a550-1ce9447977ef tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:25.180837 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c5e032f5-9acb-4c7f-a550-1ce9447977ef tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:25.182443 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c5e032f5-9acb-4c7f-a550-1ce9447977ef tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:25.183248 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c5e032f5-9acb-4c7f-a550-1ce9447977ef tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:25.714840 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-c5e032f5-9acb-4c7f-a550-1ce9447977ef tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98936da9b5d94165b386d2d0893ac142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2441394d754f499e27f6f35d5b3afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:25.724664 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-c5e032f5-9acb-4c7f-a550-1ce9447977ef tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] 10.222.0.26 "GET /compute/v2.1/servers/84eba001-0fa3-4fb7-b74e-0bb54c527ac7" status: 200 len: 1390 microversion: 2.1 time: 0.565538 Oct 08 20:54:25.729480 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 438/831] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:54:25 2022] GET /compute/v2.1/servers/84eba001-0fa3-4fb7-b74e-0bb54c527ac7 => generated 1390 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:54:25.734582 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-184390ec-fc9b-44f7-8e68-937db79c4f8d tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:25.738066 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-184390ec-fc9b-44f7-8e68-937db79c4f8d tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] [instance: f04fdc43-98fc-4bfc-a0f6-6efb9d2ee5bc] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:25.749436 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-184390ec-fc9b-44f7-8e68-937db79c4f8d tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:25.750774 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-184390ec-fc9b-44f7-8e68-937db79c4f8d tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:25.751458 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-184390ec-fc9b-44f7-8e68-937db79c4f8d tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:25.752361 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-184390ec-fc9b-44f7-8e68-937db79c4f8d tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:25.752920 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-184390ec-fc9b-44f7-8e68-937db79c4f8d tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:25.753571 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-184390ec-fc9b-44f7-8e68-937db79c4f8d tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:25.883172 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-184390ec-fc9b-44f7-8e68-937db79c4f8d tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:25.895192 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-184390ec-fc9b-44f7-8e68-937db79c4f8d tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:25.896696 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-184390ec-fc9b-44f7-8e68-937db79c4f8d tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:25.897883 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-184390ec-fc9b-44f7-8e68-937db79c4f8d tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] 10.222.0.26 "GET /compute/v2.1/servers/f04fdc43-98fc-4bfc-a0f6-6efb9d2ee5bc" status: 200 len: 1314 microversion: 2.25 time: 0.167087 Oct 08 20:54:25.913944 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 439/832] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:54:25 2022] GET /compute/v2.1/servers/f04fdc43-98fc-4bfc-a0f6-6efb9d2ee5bc => generated 1314 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:54:25.937743 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-03419279-8410-4ecf-9f42-9276c7b59eb8 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:25.938635 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-03419279-8410-4ecf-9f42-9276c7b59eb8 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] [instance: 73fd15ea-e4bd-4310-93bb-147b0a5e27ef] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:25.945542 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-03419279-8410-4ecf-9f42-9276c7b59eb8 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:25.946297 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-03419279-8410-4ecf-9f42-9276c7b59eb8 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:25.947249 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-03419279-8410-4ecf-9f42-9276c7b59eb8 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:25.948193 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-03419279-8410-4ecf-9f42-9276c7b59eb8 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:25.949277 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-03419279-8410-4ecf-9f42-9276c7b59eb8 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:25.950061 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-03419279-8410-4ecf-9f42-9276c7b59eb8 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:26.355048 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-03419279-8410-4ecf-9f42-9276c7b59eb8 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef659f5a1a24c439528a7675bdd70f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c92fe04ab8248399d0acb932f82d607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:26.365623 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-03419279-8410-4ecf-9f42-9276c7b59eb8 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] 10.222.0.26 "GET /compute/v2.1/servers/73fd15ea-e4bd-4310-93bb-147b0a5e27ef" status: 200 len: 1470 microversion: 2.1 time: 0.450447 Oct 08 20:54:26.366218 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 440/833] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:54:25 2022] GET /compute/v2.1/servers/73fd15ea-e4bd-4310-93bb-147b0a5e27ef => generated 1470 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:54:26.377648 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-99db7984-662b-4fa0-a4ed-f8bcc897f3a1 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:26.378557 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-99db7984-662b-4fa0-a4ed-f8bcc897f3a1 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] [instance: 92e31b92-0af1-4da6-bc87-23978f1aedf5] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:26.402631 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-99db7984-662b-4fa0-a4ed-f8bcc897f3a1 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:26.403537 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-99db7984-662b-4fa0-a4ed-f8bcc897f3a1 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:26.403646 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-99db7984-662b-4fa0-a4ed-f8bcc897f3a1 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:26.404344 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-99db7984-662b-4fa0-a4ed-f8bcc897f3a1 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:26.404996 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-99db7984-662b-4fa0-a4ed-f8bcc897f3a1 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:26.410663 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-99db7984-662b-4fa0-a4ed-f8bcc897f3a1 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:26.440752 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-f80f9854-5ccf-4deb-8524-282efaae7f40 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/a80fbf87-8203-4e6c-bee7-fe781bfccff1/action" status: 202 len: 0 microversion: 2.1 time: 2.789748 Oct 08 20:54:26.442185 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 394/834] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 20:54:23 2022] POST /compute/v2.1/servers/a80fbf87-8203-4e6c-bee7-fe781bfccff1/action => generated 0 bytes in 2792 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 20:54:26.459401 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:54:26.539770 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-99db7984-662b-4fa0-a4ed-f8bcc897f3a1 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:26.549881 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-99db7984-662b-4fa0-a4ed-f8bcc897f3a1 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:26.551346 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-99db7984-662b-4fa0-a4ed-f8bcc897f3a1 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:26.557044 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-99db7984-662b-4fa0-a4ed-f8bcc897f3a1 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] 10.222.0.26 "GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5" status: 200 len: 1560 microversion: 2.91 time: 0.189686 Oct 08 20:54:26.557851 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 441/835] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:54:26 2022] GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5 => generated 1560 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:54:26.562653 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-6ed99b1d-c7d8-4434-bb27-634e5efdc6b4 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:26.563561 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-6ed99b1d-c7d8-4434-bb27-634e5efdc6b4 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] [instance: a80fbf87-8203-4e6c-bee7-fe781bfccff1] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:26.570007 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6ed99b1d-c7d8-4434-bb27-634e5efdc6b4 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:26.570755 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6ed99b1d-c7d8-4434-bb27-634e5efdc6b4 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:26.571436 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6ed99b1d-c7d8-4434-bb27-634e5efdc6b4 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:26.572511 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6ed99b1d-c7d8-4434-bb27-634e5efdc6b4 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:26.573323 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6ed99b1d-c7d8-4434-bb27-634e5efdc6b4 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:26.573979 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6ed99b1d-c7d8-4434-bb27-634e5efdc6b4 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:26.647139 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-4780c3bc-71ea-443b-b986-ee0387b7867f tempest-QuotaClassesAdminTestJSON-1797310934 tempest-QuotaClassesAdminTestJSON-1797310934-project-admin] Calling method '.version_select at 0x7f1a8cc1d040>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:26.667320 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-4780c3bc-71ea-443b-b986-ee0387b7867f tempest-QuotaClassesAdminTestJSON-1797310934 tempest-QuotaClassesAdminTestJSON-1797310934-project-admin] 10.222.0.26 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.223735 Oct 08 20:54:26.668982 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 395/836] 10.222.0.26 () {58 vars in 1185 bytes} [Sat Oct 8 20:54:26 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:54:26.683664 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-4297e268-7c9b-4535-a18a-8787e73e5ef8 tempest-QuotaClassesAdminTestJSON-1797310934 tempest-QuotaClassesAdminTestJSON-1797310934-project-admin] Action: 'update', calling method: .version_select at 0x7f1a8cc1d3a0>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:54:27.125069 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-6ed99b1d-c7d8-4434-bb27-634e5efdc6b4 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474ca64d1b1d4e30916b517645aba882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecc2dd2407b4819874bed09cb27959a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:27.134030 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-6ed99b1d-c7d8-4434-bb27-634e5efdc6b4 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] 10.222.0.26 "GET /compute/v2.1/servers/a80fbf87-8203-4e6c-bee7-fe781bfccff1" status: 200 len: 1505 microversion: 2.1 time: 0.574838 Oct 08 20:54:27.136274 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-4297e268-7c9b-4535-a18a-8787e73e5ef8 tempest-QuotaClassesAdminTestJSON-1797310934 tempest-QuotaClassesAdminTestJSON-1797310934-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.458303 Oct 08 20:54:27.139512 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 396/837] 10.222.0.26 () {60 vars in 1206 bytes} [Sat Oct 8 20:54:26 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:54:27.155436 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 442/838] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:54:26 2022] GET /compute/v2.1/servers/a80fbf87-8203-4e6c-bee7-fe781bfccff1 => generated 1505 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:54:27.155436 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-898cbf63-0799-4966-896b-9f6788b4bebf tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:27.155436 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-898cbf63-0799-4966-896b-9f6788b4bebf tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] [instance: f04fdc43-98fc-4bfc-a0f6-6efb9d2ee5bc] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:27.159731 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-4bfec2b9-09fe-4a2c-87e8-169b6687bc73 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:27.160367 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-4bfec2b9-09fe-4a2c-87e8-169b6687bc73 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] [instance: 84eba001-0fa3-4fb7-b74e-0bb54c527ac7] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:27.160544 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-898cbf63-0799-4966-896b-9f6788b4bebf tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:27.161041 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-898cbf63-0799-4966-896b-9f6788b4bebf tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:27.161514 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-898cbf63-0799-4966-896b-9f6788b4bebf tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:27.162243 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-898cbf63-0799-4966-896b-9f6788b4bebf tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:27.162709 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-898cbf63-0799-4966-896b-9f6788b4bebf tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:27.163141 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-898cbf63-0799-4966-896b-9f6788b4bebf tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:27.176201 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4bfec2b9-09fe-4a2c-87e8-169b6687bc73 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:27.176705 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4bfec2b9-09fe-4a2c-87e8-169b6687bc73 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:27.177326 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4bfec2b9-09fe-4a2c-87e8-169b6687bc73 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:27.178070 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4bfec2b9-09fe-4a2c-87e8-169b6687bc73 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:27.178533 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4bfec2b9-09fe-4a2c-87e8-169b6687bc73 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:27.178961 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4bfec2b9-09fe-4a2c-87e8-169b6687bc73 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:27.330879 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-898cbf63-0799-4966-896b-9f6788b4bebf tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:27.348442 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-898cbf63-0799-4966-896b-9f6788b4bebf tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:27.350512 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-898cbf63-0799-4966-896b-9f6788b4bebf tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:27.352875 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-898cbf63-0799-4966-896b-9f6788b4bebf tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] 10.222.0.26 "GET /compute/v2.1/servers/f04fdc43-98fc-4bfc-a0f6-6efb9d2ee5bc" status: 200 len: 1320 microversion: 2.25 time: 0.210911 Oct 08 20:54:27.371473 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 443/839] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:54:27 2022] GET /compute/v2.1/servers/f04fdc43-98fc-4bfc-a0f6-6efb9d2ee5bc => generated 1320 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:54:27.381529 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-033e7c9e-a2e1-4f24-8393-448f672743af tempest-QuotaClassesAdminTestJSON-1797310934 tempest-QuotaClassesAdminTestJSON-1797310934-project-admin] Calling method '.version_select at 0x7f1a8c90f040>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:27.397413 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-033e7c9e-a2e1-4f24-8393-448f672743af tempest-QuotaClassesAdminTestJSON-1797310934 tempest-QuotaClassesAdminTestJSON-1797310934-project-admin] 10.222.0.26 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.024318 Oct 08 20:54:27.398389 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 444/840] 10.222.0.26 () {58 vars in 1185 bytes} [Sat Oct 8 20:54:27 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:54:27.405951 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-577645f7-0f1e-40ff-9b97-fe9d995c8603 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:27.406924 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-577645f7-0f1e-40ff-9b97-fe9d995c8603 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] [instance: 73fd15ea-e4bd-4310-93bb-147b0a5e27ef] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:27.414754 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-577645f7-0f1e-40ff-9b97-fe9d995c8603 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:27.415495 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-577645f7-0f1e-40ff-9b97-fe9d995c8603 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:27.416293 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-577645f7-0f1e-40ff-9b97-fe9d995c8603 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:27.417311 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-577645f7-0f1e-40ff-9b97-fe9d995c8603 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:27.418092 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-577645f7-0f1e-40ff-9b97-fe9d995c8603 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:27.418978 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-577645f7-0f1e-40ff-9b97-fe9d995c8603 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:27.852351 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-4bfec2b9-09fe-4a2c-87e8-169b6687bc73 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98936da9b5d94165b386d2d0893ac142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2441394d754f499e27f6f35d5b3afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:27.872195 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-4bfec2b9-09fe-4a2c-87e8-169b6687bc73 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] 10.222.0.26 "GET /compute/v2.1/servers/84eba001-0fa3-4fb7-b74e-0bb54c527ac7" status: 200 len: 1390 microversion: 2.1 time: 0.731565 Oct 08 20:54:27.897347 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 397/841] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:54:27 2022] GET /compute/v2.1/servers/84eba001-0fa3-4fb7-b74e-0bb54c527ac7 => generated 1390 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:54:27.911029 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-04fd3d33-e28b-4807-8711-6d9e5993285a tempest-QuotaClassesAdminTestJSON-1797310934 tempest-QuotaClassesAdminTestJSON-1797310934-project-admin] Action: 'update', calling method: .version_select at 0x7f1a8cc45940>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:54:28.068395 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-577645f7-0f1e-40ff-9b97-fe9d995c8603 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef659f5a1a24c439528a7675bdd70f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c92fe04ab8248399d0acb932f82d607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:28.087763 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-577645f7-0f1e-40ff-9b97-fe9d995c8603 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] 10.222.0.26 "GET /compute/v2.1/servers/73fd15ea-e4bd-4310-93bb-147b0a5e27ef" status: 200 len: 1470 microversion: 2.1 time: 0.687906 Oct 08 20:54:28.089317 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 445/842] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:54:27 2022] GET /compute/v2.1/servers/73fd15ea-e4bd-4310-93bb-147b0a5e27ef => generated 1470 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:54:28.110113 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-fd719ada-384a-4ef4-8b1d-11bd486084f8 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:28.112702 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-fd719ada-384a-4ef4-8b1d-11bd486084f8 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] [instance: 92e31b92-0af1-4da6-bc87-23978f1aedf5] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:28.138301 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:54:28.146769 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fd719ada-384a-4ef4-8b1d-11bd486084f8 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:28.147638 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fd719ada-384a-4ef4-8b1d-11bd486084f8 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:28.148529 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fd719ada-384a-4ef4-8b1d-11bd486084f8 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:28.151399 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fd719ada-384a-4ef4-8b1d-11bd486084f8 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:28.153299 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fd719ada-384a-4ef4-8b1d-11bd486084f8 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:28.153965 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fd719ada-384a-4ef4-8b1d-11bd486084f8 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:28.192211 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-04fd3d33-e28b-4807-8711-6d9e5993285a tempest-QuotaClassesAdminTestJSON-1797310934 tempest-QuotaClassesAdminTestJSON-1797310934-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.293619 Oct 08 20:54:28.198736 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 398/843] 10.222.0.26 () {60 vars in 1206 bytes} [Sat Oct 8 20:54:27 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:54:28.222974 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-6da9bdfd-e780-43ac-afd9-05be18647871 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:28.227589 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-6da9bdfd-e780-43ac-afd9-05be18647871 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] [instance: a80fbf87-8203-4e6c-bee7-fe781bfccff1] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:28.249517 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6da9bdfd-e780-43ac-afd9-05be18647871 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:28.254518 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6da9bdfd-e780-43ac-afd9-05be18647871 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:28.255072 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6da9bdfd-e780-43ac-afd9-05be18647871 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:28.257698 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6da9bdfd-e780-43ac-afd9-05be18647871 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:28.258422 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6da9bdfd-e780-43ac-afd9-05be18647871 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:28.265903 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6da9bdfd-e780-43ac-afd9-05be18647871 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:28.382635 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-fd719ada-384a-4ef4-8b1d-11bd486084f8 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:28.392449 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-fd719ada-384a-4ef4-8b1d-11bd486084f8 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:28.393948 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-fd719ada-384a-4ef4-8b1d-11bd486084f8 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:28.413404 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-fd719ada-384a-4ef4-8b1d-11bd486084f8 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] 10.222.0.26 "GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5" status: 200 len: 1555 microversion: 2.91 time: 0.322673 Oct 08 20:54:28.414003 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 446/844] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:54:28 2022] GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5 => generated 1555 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:54:28.430706 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-9b5f820d-faea-4d3a-9498-0307fd7af230 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:28.431332 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-9b5f820d-faea-4d3a-9498-0307fd7af230 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] [instance: f04fdc43-98fc-4bfc-a0f6-6efb9d2ee5bc] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:28.463006 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9b5f820d-faea-4d3a-9498-0307fd7af230 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:28.463524 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9b5f820d-faea-4d3a-9498-0307fd7af230 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:28.463985 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9b5f820d-faea-4d3a-9498-0307fd7af230 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:28.464720 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9b5f820d-faea-4d3a-9498-0307fd7af230 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:28.469496 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9b5f820d-faea-4d3a-9498-0307fd7af230 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:28.469953 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9b5f820d-faea-4d3a-9498-0307fd7af230 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:28.779996 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-6da9bdfd-e780-43ac-afd9-05be18647871 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474ca64d1b1d4e30916b517645aba882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecc2dd2407b4819874bed09cb27959a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:28.792591 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-6da9bdfd-e780-43ac-afd9-05be18647871 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] 10.222.0.26 "GET /compute/v2.1/servers/a80fbf87-8203-4e6c-bee7-fe781bfccff1" status: 200 len: 1505 microversion: 2.1 time: 0.580356 Oct 08 20:54:28.807134 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 399/845] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:54:28 2022] GET /compute/v2.1/servers/a80fbf87-8203-4e6c-bee7-fe781bfccff1 => generated 1505 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:54:28.846954 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-2dd6733f-e7f0-4a59-a22a-99d98497249e req-10dc5ac6-bef7-48b8-9a69-5164e71a96d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84eba001-0fa3-4fb7-b74e-0bb54c527ac7", "name": "network-vif-plugged", "status": "completed", "tag": "80190695-6264-463b-85c7-626419e89ee2"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:54:28.878577 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-2dd6733f-e7f0-4a59-a22a-99d98497249e req-10dc5ac6-bef7-48b8-9a69-5164e71a96d6 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:28.880430 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-2dd6733f-e7f0-4a59-a22a-99d98497249e req-10dc5ac6-bef7-48b8-9a69-5164e71a96d6 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:28.886750 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-2dd6733f-e7f0-4a59-a22a-99d98497249e req-10dc5ac6-bef7-48b8-9a69-5164e71a96d6 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:28.937767 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-2dd6733f-e7f0-4a59-a22a-99d98497249e req-10dc5ac6-bef7-48b8-9a69-5164e71a96d6 service nova] Creating event network-vif-plugged:80190695-6264-463b-85c7-626419e89ee2 for instance 84eba001-0fa3-4fb7-b74e-0bb54c527ac7 on nch2-master-1 Oct 08 20:54:28.957704 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-2dd6733f-e7f0-4a59-a22a-99d98497249e req-10dc5ac6-bef7-48b8-9a69-5164e71a96d6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.148031 Oct 08 20:54:28.965159 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 400/846] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:54:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:54:29.002073 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-3f7147db-1255-4b9c-b46d-3cf77a01cd90 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:29.003214 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-3f7147db-1255-4b9c-b46d-3cf77a01cd90 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] [instance: 84eba001-0fa3-4fb7-b74e-0bb54c527ac7] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:29.026019 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3f7147db-1255-4b9c-b46d-3cf77a01cd90 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:29.026957 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3f7147db-1255-4b9c-b46d-3cf77a01cd90 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:29.035755 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3f7147db-1255-4b9c-b46d-3cf77a01cd90 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:29.036900 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3f7147db-1255-4b9c-b46d-3cf77a01cd90 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:29.039285 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3f7147db-1255-4b9c-b46d-3cf77a01cd90 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:29.043080 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3f7147db-1255-4b9c-b46d-3cf77a01cd90 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:29.126548 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-9b5f820d-faea-4d3a-9498-0307fd7af230 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:29.143616 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-9b5f820d-faea-4d3a-9498-0307fd7af230 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:29.146044 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-9b5f820d-faea-4d3a-9498-0307fd7af230 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:29.147363 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-9b5f820d-faea-4d3a-9498-0307fd7af230 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] 10.222.0.26 "GET /compute/v2.1/servers/f04fdc43-98fc-4bfc-a0f6-6efb9d2ee5bc" status: 200 len: 1362 microversion: 2.25 time: 0.720552 Oct 08 20:54:29.148774 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 447/847] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:54:28 2022] GET /compute/v2.1/servers/f04fdc43-98fc-4bfc-a0f6-6efb9d2ee5bc => generated 1362 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:54:29.161287 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-6f120810-6b16-4b3f-a4ee-d4d107b6037d tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:29.162202 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-6f120810-6b16-4b3f-a4ee-d4d107b6037d tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] [instance: 73fd15ea-e4bd-4310-93bb-147b0a5e27ef] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:29.176426 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6f120810-6b16-4b3f-a4ee-d4d107b6037d tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:29.178907 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6f120810-6b16-4b3f-a4ee-d4d107b6037d tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:29.181415 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6f120810-6b16-4b3f-a4ee-d4d107b6037d tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:29.184983 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6f120810-6b16-4b3f-a4ee-d4d107b6037d tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:29.186272 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6f120810-6b16-4b3f-a4ee-d4d107b6037d tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:29.187263 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6f120810-6b16-4b3f-a4ee-d4d107b6037d tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:29.667145 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-3f7147db-1255-4b9c-b46d-3cf77a01cd90 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98936da9b5d94165b386d2d0893ac142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2441394d754f499e27f6f35d5b3afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:29.682027 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-3f7147db-1255-4b9c-b46d-3cf77a01cd90 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] 10.222.0.26 "GET /compute/v2.1/servers/84eba001-0fa3-4fb7-b74e-0bb54c527ac7" status: 200 len: 1390 microversion: 2.1 time: 0.705662 Oct 08 20:54:29.682795 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 401/848] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:54:28 2022] GET /compute/v2.1/servers/84eba001-0fa3-4fb7-b74e-0bb54c527ac7 => generated 1390 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:54:29.702830 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-6f120810-6b16-4b3f-a4ee-d4d107b6037d tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef659f5a1a24c439528a7675bdd70f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c92fe04ab8248399d0acb932f82d607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:29.706090 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-f1a8a125-e6b5-4ea6-8f89-284a7af49af8 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:29.709503 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-f1a8a125-e6b5-4ea6-8f89-284a7af49af8 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] [instance: 92e31b92-0af1-4da6-bc87-23978f1aedf5] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:29.712843 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-6f120810-6b16-4b3f-a4ee-d4d107b6037d tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] 10.222.0.26 "GET /compute/v2.1/servers/73fd15ea-e4bd-4310-93bb-147b0a5e27ef" status: 200 len: 1476 microversion: 2.1 time: 0.556910 Oct 08 20:54:29.713685 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 448/849] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:54:29 2022] GET /compute/v2.1/servers/73fd15ea-e4bd-4310-93bb-147b0a5e27ef => generated 1476 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:54:29.730493 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f1a8a125-e6b5-4ea6-8f89-284a7af49af8 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:29.730493 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f1a8a125-e6b5-4ea6-8f89-284a7af49af8 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:29.730493 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f1a8a125-e6b5-4ea6-8f89-284a7af49af8 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:29.730493 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f1a8a125-e6b5-4ea6-8f89-284a7af49af8 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:29.730888 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f1a8a125-e6b5-4ea6-8f89-284a7af49af8 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:29.733903 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f1a8a125-e6b5-4ea6-8f89-284a7af49af8 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:29.836781 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-eb1bf318-b410-4bf3-b2b9-95ed69faf39a tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:29.838408 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-eb1bf318-b410-4bf3-b2b9-95ed69faf39a tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] [instance: a80fbf87-8203-4e6c-bee7-fe781bfccff1] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:29.855463 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-eb1bf318-b410-4bf3-b2b9-95ed69faf39a tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:29.856254 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-eb1bf318-b410-4bf3-b2b9-95ed69faf39a tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:29.859955 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-eb1bf318-b410-4bf3-b2b9-95ed69faf39a tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:29.861138 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-eb1bf318-b410-4bf3-b2b9-95ed69faf39a tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:29.864042 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-eb1bf318-b410-4bf3-b2b9-95ed69faf39a tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:29.865514 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-eb1bf318-b410-4bf3-b2b9-95ed69faf39a tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:30.006537 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-f1a8a125-e6b5-4ea6-8f89-284a7af49af8 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:30.020868 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-f1a8a125-e6b5-4ea6-8f89-284a7af49af8 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:30.022688 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-f1a8a125-e6b5-4ea6-8f89-284a7af49af8 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:30.040952 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-f1a8a125-e6b5-4ea6-8f89-284a7af49af8 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] 10.222.0.26 "GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5" status: 200 len: 1555 microversion: 2.91 time: 0.356895 Oct 08 20:54:30.041693 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 402/850] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:54:29 2022] GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5 => generated 1555 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:54:30.104240 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-eb1bf318-b410-4bf3-b2b9-95ed69faf39a tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474ca64d1b1d4e30916b517645aba882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecc2dd2407b4819874bed09cb27959a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:30.115434 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-eb1bf318-b410-4bf3-b2b9-95ed69faf39a tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] 10.222.0.26 "GET /compute/v2.1/servers/a80fbf87-8203-4e6c-bee7-fe781bfccff1" status: 200 len: 1505 microversion: 2.1 time: 0.283034 Oct 08 20:54:30.125012 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 449/851] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:54:29 2022] GET /compute/v2.1/servers/a80fbf87-8203-4e6c-bee7-fe781bfccff1 => generated 1505 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:54:30.180525 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-9f6e9ce5-acf7-45b4-8da5-8dd6211ebbb9 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:30.181232 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-9f6e9ce5-acf7-45b4-8da5-8dd6211ebbb9 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] [instance: f04fdc43-98fc-4bfc-a0f6-6efb9d2ee5bc] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:30.192273 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9f6e9ce5-acf7-45b4-8da5-8dd6211ebbb9 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:30.192777 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9f6e9ce5-acf7-45b4-8da5-8dd6211ebbb9 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:30.198873 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9f6e9ce5-acf7-45b4-8da5-8dd6211ebbb9 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:30.204967 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9f6e9ce5-acf7-45b4-8da5-8dd6211ebbb9 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:30.205987 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9f6e9ce5-acf7-45b4-8da5-8dd6211ebbb9 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:30.206573 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9f6e9ce5-acf7-45b4-8da5-8dd6211ebbb9 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:30.332974 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-e071b361-a95b-4f68-bead-07140ca18d2b req-9ac68722-0923-4755-9095-ae2b06da3978 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f04fdc43-98fc-4bfc-a0f6-6efb9d2ee5bc", "tag": "84bc0e3e-26ae-44e6-9044-9b319506b2ff"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:54:30.356674 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-e071b361-a95b-4f68-bead-07140ca18d2b req-9ac68722-0923-4755-9095-ae2b06da3978 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:30.358566 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-e071b361-a95b-4f68-bead-07140ca18d2b req-9ac68722-0923-4755-9095-ae2b06da3978 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:30.359233 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-e071b361-a95b-4f68-bead-07140ca18d2b req-9ac68722-0923-4755-9095-ae2b06da3978 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:30.373379 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-e071b361-a95b-4f68-bead-07140ca18d2b req-9ac68722-0923-4755-9095-ae2b06da3978 service nova] Creating event network-changed:84bc0e3e-26ae-44e6-9044-9b319506b2ff for instance f04fdc43-98fc-4bfc-a0f6-6efb9d2ee5bc on nch1-master-1 Oct 08 20:54:30.381607 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-e071b361-a95b-4f68-bead-07140ca18d2b req-9ac68722-0923-4755-9095-ae2b06da3978 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055021 Oct 08 20:54:30.382936 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 450/852] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:54:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:54:30.439091 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=2 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:54:30.706402 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-7957e9ac-1d7c-47d9-a755-a5c474d9571c tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:30.707421 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-7957e9ac-1d7c-47d9-a755-a5c474d9571c tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] [instance: 84eba001-0fa3-4fb7-b74e-0bb54c527ac7] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:30.721515 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7957e9ac-1d7c-47d9-a755-a5c474d9571c tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:30.725968 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7957e9ac-1d7c-47d9-a755-a5c474d9571c tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:30.726673 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7957e9ac-1d7c-47d9-a755-a5c474d9571c tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:30.727625 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7957e9ac-1d7c-47d9-a755-a5c474d9571c tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:30.728322 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7957e9ac-1d7c-47d9-a755-a5c474d9571c tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:30.728941 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7957e9ac-1d7c-47d9-a755-a5c474d9571c tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:31.052277 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-9f6e9ce5-acf7-45b4-8da5-8dd6211ebbb9 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:31.069247 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-9f6e9ce5-acf7-45b4-8da5-8dd6211ebbb9 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:31.070642 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-9f6e9ce5-acf7-45b4-8da5-8dd6211ebbb9 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:31.077637 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-9f6e9ce5-acf7-45b4-8da5-8dd6211ebbb9 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] 10.222.0.26 "GET /compute/v2.1/servers/f04fdc43-98fc-4bfc-a0f6-6efb9d2ee5bc" status: 200 len: 1362 microversion: 2.25 time: 0.897969 Oct 08 20:54:31.081123 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 403/853] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:54:30 2022] GET /compute/v2.1/servers/f04fdc43-98fc-4bfc-a0f6-6efb9d2ee5bc => generated 1362 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:54:31.111056 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-11108697-1868-4e70-8abf-985093e0bfe4 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:31.113230 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-11108697-1868-4e70-8abf-985093e0bfe4 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] [instance: 73fd15ea-e4bd-4310-93bb-147b0a5e27ef] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:31.128905 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-11108697-1868-4e70-8abf-985093e0bfe4 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:31.132054 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-11108697-1868-4e70-8abf-985093e0bfe4 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:31.134179 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-11108697-1868-4e70-8abf-985093e0bfe4 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:31.134858 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-11108697-1868-4e70-8abf-985093e0bfe4 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:31.142238 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-11108697-1868-4e70-8abf-985093e0bfe4 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:31.143845 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-11108697-1868-4e70-8abf-985093e0bfe4 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:31.160290 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-7957e9ac-1d7c-47d9-a755-a5c474d9571c tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98936da9b5d94165b386d2d0893ac142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2441394d754f499e27f6f35d5b3afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:31.170433 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-7957e9ac-1d7c-47d9-a755-a5c474d9571c tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] 10.222.0.26 "GET /compute/v2.1/servers/84eba001-0fa3-4fb7-b74e-0bb54c527ac7" status: 200 len: 1390 microversion: 2.1 time: 0.468975 Oct 08 20:54:31.171036 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 451/854] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:54:30 2022] GET /compute/v2.1/servers/84eba001-0fa3-4fb7-b74e-0bb54c527ac7 => generated 1390 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:54:31.192146 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-746bd584-7fcc-43a0-9832-e2cfb04a86ae tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Calling method '.version_select at 0x7f1a8c93f040>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:31.348863 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-746bd584-7fcc-43a0-9832-e2cfb04a86ae tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] 10.222.0.26 "GET /compute/v2.1/images/dbb82e24-3155-4938-aa76-47f9aec9b18e" status: 200 len: 662 microversion: 2.1 time: 0.176692 Oct 08 20:54:31.349859 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 452/855] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:54:31 2022] GET /compute/v2.1/images/dbb82e24-3155-4938-aa76-47f9aec9b18e => generated 662 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:54:31.354458 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-ec108ec7-9da4-40c5-812d-20d8a3b8d6fb tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:31.355072 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-ec108ec7-9da4-40c5-812d-20d8a3b8d6fb tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] [instance: 92e31b92-0af1-4da6-bc87-23978f1aedf5] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:31.386174 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ec108ec7-9da4-40c5-812d-20d8a3b8d6fb tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:31.386686 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ec108ec7-9da4-40c5-812d-20d8a3b8d6fb tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:31.387147 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ec108ec7-9da4-40c5-812d-20d8a3b8d6fb tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:31.387878 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ec108ec7-9da4-40c5-812d-20d8a3b8d6fb tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:31.397999 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ec108ec7-9da4-40c5-812d-20d8a3b8d6fb tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:31.398741 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ec108ec7-9da4-40c5-812d-20d8a3b8d6fb tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:31.572557 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-ec108ec7-9da4-40c5-812d-20d8a3b8d6fb tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:31.592731 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-ec108ec7-9da4-40c5-812d-20d8a3b8d6fb tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:31.601070 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-ec108ec7-9da4-40c5-812d-20d8a3b8d6fb tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:31.626150 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-ec108ec7-9da4-40c5-812d-20d8a3b8d6fb tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] 10.222.0.26 "GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5" status: 200 len: 1555 microversion: 2.91 time: 0.274365 Oct 08 20:54:31.629503 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 453/856] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:54:31 2022] GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5 => generated 1555 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:54:31.640274 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-2f994c22-76db-4c52-b892-f1dadc3d8844 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:31.644549 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-2f994c22-76db-4c52-b892-f1dadc3d8844 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] [instance: a80fbf87-8203-4e6c-bee7-fe781bfccff1] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:31.670409 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2f994c22-76db-4c52-b892-f1dadc3d8844 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:31.672829 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2f994c22-76db-4c52-b892-f1dadc3d8844 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:31.675849 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2f994c22-76db-4c52-b892-f1dadc3d8844 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:31.677564 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2f994c22-76db-4c52-b892-f1dadc3d8844 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:31.679016 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2f994c22-76db-4c52-b892-f1dadc3d8844 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:31.682094 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2f994c22-76db-4c52-b892-f1dadc3d8844 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:31.924427 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-11108697-1868-4e70-8abf-985093e0bfe4 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef659f5a1a24c439528a7675bdd70f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c92fe04ab8248399d0acb932f82d607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:31.937669 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-11108697-1868-4e70-8abf-985093e0bfe4 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] 10.222.0.26 "GET /compute/v2.1/servers/73fd15ea-e4bd-4310-93bb-147b0a5e27ef" status: 200 len: 1462 microversion: 2.1 time: 0.852444 Oct 08 20:54:31.938420 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 404/857] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:54:31 2022] GET /compute/v2.1/servers/73fd15ea-e4bd-4310-93bb-147b0a5e27ef => generated 1462 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:54:31.953856 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-cb2945d6-ac11-412f-a13d-7d47271b5c92 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Calling method '.version_select at 0x7f1a8cdbc160>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:31.972780 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-2f994c22-76db-4c52-b892-f1dadc3d8844 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474ca64d1b1d4e30916b517645aba882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecc2dd2407b4819874bed09cb27959a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:31.985777 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-2f994c22-76db-4c52-b892-f1dadc3d8844 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] 10.222.0.26 "GET /compute/v2.1/servers/a80fbf87-8203-4e6c-bee7-fe781bfccff1" status: 200 len: 1505 microversion: 2.1 time: 0.353493 Oct 08 20:54:31.988527 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 454/858] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:54:31 2022] GET /compute/v2.1/servers/a80fbf87-8203-4e6c-bee7-fe781bfccff1 => generated 1505 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:54:31.997150 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-8233b773-33ce-4361-a2b3-e1f8394e9328 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:32.003020 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-8233b773-33ce-4361-a2b3-e1f8394e9328 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] [instance: 73fd15ea-e4bd-4310-93bb-147b0a5e27ef] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:32.027394 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8233b773-33ce-4361-a2b3-e1f8394e9328 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:32.029160 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8233b773-33ce-4361-a2b3-e1f8394e9328 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:32.030618 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8233b773-33ce-4361-a2b3-e1f8394e9328 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:32.031561 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8233b773-33ce-4361-a2b3-e1f8394e9328 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:32.032649 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8233b773-33ce-4361-a2b3-e1f8394e9328 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:32.034033 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-cb2945d6-ac11-412f-a13d-7d47271b5c92 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] 10.222.0.26 "GET /compute/v2.1/images/dbb82e24-3155-4938-aa76-47f9aec9b18e" status: 200 len: 662 microversion: 2.1 time: 0.091935 Oct 08 20:54:32.034232 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8233b773-33ce-4361-a2b3-e1f8394e9328 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:32.041317 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 405/859] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:54:31 2022] GET /compute/v2.1/images/dbb82e24-3155-4938-aa76-47f9aec9b18e => generated 662 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:54:32.103851 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-7ad1eb53-cb5d-4132-bc6f-e0285841c4c1 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:32.111827 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-7ad1eb53-cb5d-4132-bc6f-e0285841c4c1 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] [instance: f04fdc43-98fc-4bfc-a0f6-6efb9d2ee5bc] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:32.122903 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7ad1eb53-cb5d-4132-bc6f-e0285841c4c1 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:32.136132 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7ad1eb53-cb5d-4132-bc6f-e0285841c4c1 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:32.136988 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7ad1eb53-cb5d-4132-bc6f-e0285841c4c1 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:32.138077 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7ad1eb53-cb5d-4132-bc6f-e0285841c4c1 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:32.140838 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7ad1eb53-cb5d-4132-bc6f-e0285841c4c1 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:32.141585 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7ad1eb53-cb5d-4132-bc6f-e0285841c4c1 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:32.634265 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-7ad1eb53-cb5d-4132-bc6f-e0285841c4c1 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:32.643436 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-7ad1eb53-cb5d-4132-bc6f-e0285841c4c1 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:32.649470 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-7ad1eb53-cb5d-4132-bc6f-e0285841c4c1 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:32.653829 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-7ad1eb53-cb5d-4132-bc6f-e0285841c4c1 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] 10.222.0.26 "GET /compute/v2.1/servers/f04fdc43-98fc-4bfc-a0f6-6efb9d2ee5bc" status: 200 len: 1362 microversion: 2.25 time: 0.552685 Oct 08 20:54:32.669535 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 406/860] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:54:32 2022] GET /compute/v2.1/servers/f04fdc43-98fc-4bfc-a0f6-6efb9d2ee5bc => generated 1362 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:54:32.681106 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-8df23e2b-98f9-4d56-9fa3-5be15e3972e5 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:32.682003 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-8df23e2b-98f9-4d56-9fa3-5be15e3972e5 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] [instance: 84eba001-0fa3-4fb7-b74e-0bb54c527ac7] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:32.692087 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-8233b773-33ce-4361-a2b3-e1f8394e9328 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef659f5a1a24c439528a7675bdd70f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c92fe04ab8248399d0acb932f82d607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:32.704196 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8df23e2b-98f9-4d56-9fa3-5be15e3972e5 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:32.705067 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8df23e2b-98f9-4d56-9fa3-5be15e3972e5 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:32.705799 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8df23e2b-98f9-4d56-9fa3-5be15e3972e5 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:32.706171 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-8233b773-33ce-4361-a2b3-e1f8394e9328 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] 10.222.0.26 "GET /compute/v2.1/servers/73fd15ea-e4bd-4310-93bb-147b0a5e27ef" status: 200 len: 1462 microversion: 2.1 time: 0.710041 Oct 08 20:54:32.707755 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 455/861] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:54:31 2022] GET /compute/v2.1/servers/73fd15ea-e4bd-4310-93bb-147b0a5e27ef => generated 1462 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:54:32.708170 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8df23e2b-98f9-4d56-9fa3-5be15e3972e5 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:32.710184 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8df23e2b-98f9-4d56-9fa3-5be15e3972e5 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:32.710931 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8df23e2b-98f9-4d56-9fa3-5be15e3972e5 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:32.725170 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-428806cb-28ba-4cda-9cc2-a1d2dfe21257 req-4d6070c4-fcf3-477d-8ab6-c388e274a0e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73fd15ea-e4bd-4310-93bb-147b0a5e27ef", "name": "network-vif-unplugged", "status": "completed", "tag": "27f3cc41-9f72-499b-bae1-fb66f8f24df7"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:54:32.751491 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-428806cb-28ba-4cda-9cc2-a1d2dfe21257 req-4d6070c4-fcf3-477d-8ab6-c388e274a0e4 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:32.752267 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-428806cb-28ba-4cda-9cc2-a1d2dfe21257 req-4d6070c4-fcf3-477d-8ab6-c388e274a0e4 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:32.752875 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-428806cb-28ba-4cda-9cc2-a1d2dfe21257 req-4d6070c4-fcf3-477d-8ab6-c388e274a0e4 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:32.781076 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-428806cb-28ba-4cda-9cc2-a1d2dfe21257 req-4d6070c4-fcf3-477d-8ab6-c388e274a0e4 service nova] Creating event network-vif-unplugged:27f3cc41-9f72-499b-bae1-fb66f8f24df7 for instance 73fd15ea-e4bd-4310-93bb-147b0a5e27ef on nch2-master-1 Oct 08 20:54:32.792389 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-428806cb-28ba-4cda-9cc2-a1d2dfe21257 req-4d6070c4-fcf3-477d-8ab6-c388e274a0e4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.082648 Oct 08 20:54:32.793746 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 456/862] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:54:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:54:32.802006 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e52f04d6-bd51-4a2c-8146-c749594dadb7 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:32.803101 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-e52f04d6-bd51-4a2c-8146-c749594dadb7 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] [instance: 92e31b92-0af1-4da6-bc87-23978f1aedf5] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:32.810259 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e52f04d6-bd51-4a2c-8146-c749594dadb7 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:32.811715 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e52f04d6-bd51-4a2c-8146-c749594dadb7 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:32.812454 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e52f04d6-bd51-4a2c-8146-c749594dadb7 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:32.813543 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e52f04d6-bd51-4a2c-8146-c749594dadb7 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:32.814226 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e52f04d6-bd51-4a2c-8146-c749594dadb7 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:32.814972 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e52f04d6-bd51-4a2c-8146-c749594dadb7 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:33.017341 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-e52f04d6-bd51-4a2c-8146-c749594dadb7 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:33.042436 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-e52f04d6-bd51-4a2c-8146-c749594dadb7 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:33.044552 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-e52f04d6-bd51-4a2c-8146-c749594dadb7 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:33.055961 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-e52f04d6-bd51-4a2c-8146-c749594dadb7 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] 10.222.0.26 "GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5" status: 200 len: 1555 microversion: 2.91 time: 0.260764 Oct 08 20:54:33.074619 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 457/863] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:54:32 2022] GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5 => generated 1555 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:54:33.108204 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-4a9bbabb-4e9b-4047-a4f1-7663f8d82c08 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:54:33.111384 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-4a9bbabb-4e9b-4047-a4f1-7663f8d82c08 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] [instance: 73fd15ea-e4bd-4310-93bb-147b0a5e27ef] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:33.126555 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4a9bbabb-4e9b-4047-a4f1-7663f8d82c08 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:33.128565 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4a9bbabb-4e9b-4047-a4f1-7663f8d82c08 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:33.138335 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4a9bbabb-4e9b-4047-a4f1-7663f8d82c08 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:33.139878 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4a9bbabb-4e9b-4047-a4f1-7663f8d82c08 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:33.140780 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4a9bbabb-4e9b-4047-a4f1-7663f8d82c08 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:33.141506 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4a9bbabb-4e9b-4047-a4f1-7663f8d82c08 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:33.400531 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-8df23e2b-98f9-4d56-9fa3-5be15e3972e5 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98936da9b5d94165b386d2d0893ac142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2441394d754f499e27f6f35d5b3afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:33.409989 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-8df23e2b-98f9-4d56-9fa3-5be15e3972e5 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] 10.222.0.26 "GET /compute/v2.1/servers/84eba001-0fa3-4fb7-b74e-0bb54c527ac7" status: 200 len: 1589 microversion: 2.1 time: 0.738744 Oct 08 20:54:33.416554 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 407/864] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:54:32 2022] GET /compute/v2.1/servers/84eba001-0fa3-4fb7-b74e-0bb54c527ac7 => generated 1589 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:54:33.432848 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-392a1825-72d8-4e71-aafe-5c4d935880f8 req-c773bd44-d906-4a21-92ed-d3856b7a027a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a80fbf87-8203-4e6c-bee7-fe781bfccff1", "name": "network-vif-unplugged", "status": "completed", "tag": "01d74faf-31a5-494a-9dba-c900226fd0a9"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:54:33.458880 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-392a1825-72d8-4e71-aafe-5c4d935880f8 req-c773bd44-d906-4a21-92ed-d3856b7a027a service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:33.459881 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-392a1825-72d8-4e71-aafe-5c4d935880f8 req-c773bd44-d906-4a21-92ed-d3856b7a027a service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:33.464709 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-392a1825-72d8-4e71-aafe-5c4d935880f8 req-c773bd44-d906-4a21-92ed-d3856b7a027a service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:33.495854 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-392a1825-72d8-4e71-aafe-5c4d935880f8 req-c773bd44-d906-4a21-92ed-d3856b7a027a service nova] Creating event network-vif-unplugged:01d74faf-31a5-494a-9dba-c900226fd0a9 for instance a80fbf87-8203-4e6c-bee7-fe781bfccff1 on nch2-master-1 Oct 08 20:54:33.502170 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-392a1825-72d8-4e71-aafe-5c4d935880f8 req-c773bd44-d906-4a21-92ed-d3856b7a027a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.083959 Oct 08 20:54:33.506840 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 408/865] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:54:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:54:33.542645 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-ef968369-5278-4bb7-9fc4-45b84b0a866a tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:33.543365 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-ef968369-5278-4bb7-9fc4-45b84b0a866a tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] [instance: a80fbf87-8203-4e6c-bee7-fe781bfccff1] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:33.554703 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=24,nova_api:INSERT=7 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:54:33.579347 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ef968369-5278-4bb7-9fc4-45b84b0a866a tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:33.586193 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ef968369-5278-4bb7-9fc4-45b84b0a866a tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:33.587285 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ef968369-5278-4bb7-9fc4-45b84b0a866a tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:33.587539 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=2 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:54:33.590920 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ef968369-5278-4bb7-9fc4-45b84b0a866a tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:33.591595 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ef968369-5278-4bb7-9fc4-45b84b0a866a tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:33.594372 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ef968369-5278-4bb7-9fc4-45b84b0a866a tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:34.075491 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-ef968369-5278-4bb7-9fc4-45b84b0a866a tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474ca64d1b1d4e30916b517645aba882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecc2dd2407b4819874bed09cb27959a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:34.090536 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-ef968369-5278-4bb7-9fc4-45b84b0a866a tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] 10.222.0.26 "GET /compute/v2.1/servers/a80fbf87-8203-4e6c-bee7-fe781bfccff1" status: 200 len: 1505 microversion: 2.1 time: 0.569200 Oct 08 20:54:34.095867 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 409/866] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:54:33 2022] GET /compute/v2.1/servers/a80fbf87-8203-4e6c-bee7-fe781bfccff1 => generated 1505 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:54:34.102936 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c9aeb312-6ab2-4da9-b06c-93c26e6c9461 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:34.117720 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-c9aeb312-6ab2-4da9-b06c-93c26e6c9461 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] [instance: 84eba001-0fa3-4fb7-b74e-0bb54c527ac7] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:34.135362 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c9aeb312-6ab2-4da9-b06c-93c26e6c9461 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:34.136109 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c9aeb312-6ab2-4da9-b06c-93c26e6c9461 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:34.136733 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c9aeb312-6ab2-4da9-b06c-93c26e6c9461 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:34.137819 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c9aeb312-6ab2-4da9-b06c-93c26e6c9461 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:34.138426 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c9aeb312-6ab2-4da9-b06c-93c26e6c9461 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:34.142679 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c9aeb312-6ab2-4da9-b06c-93c26e6c9461 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:34.282311 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-c9aeb312-6ab2-4da9-b06c-93c26e6c9461 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] 10.222.0.26 "GET /compute/v2.1/servers/84eba001-0fa3-4fb7-b74e-0bb54c527ac7/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.185338 Oct 08 20:54:34.282932 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 410/867] 10.222.0.26 () {58 vars in 1275 bytes} [Sat Oct 8 20:54:34 2022] GET /compute/v2.1/servers/84eba001-0fa3-4fb7-b74e-0bb54c527ac7/os-interface => generated 284 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:54:34.288093 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-3de9959c-1df5-476f-8dd5-3dc7ff53826d tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:34.288710 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-3de9959c-1df5-476f-8dd5-3dc7ff53826d tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] [instance: f04fdc43-98fc-4bfc-a0f6-6efb9d2ee5bc] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:34.300933 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-4a9bbabb-4e9b-4047-a4f1-7663f8d82c08 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Flavor limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 20:54:34.301779 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3de9959c-1df5-476f-8dd5-3dc7ff53826d tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:34.302290 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3de9959c-1df5-476f-8dd5-3dc7ff53826d tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:34.302559 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-4a9bbabb-4e9b-4047-a4f1-7663f8d82c08 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Image limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 20:54:34.302742 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3de9959c-1df5-476f-8dd5-3dc7ff53826d tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:34.303378 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-4a9bbabb-4e9b-4047-a4f1-7663f8d82c08 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Flavor pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 20:54:34.303517 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3de9959c-1df5-476f-8dd5-3dc7ff53826d tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:34.303916 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3de9959c-1df5-476f-8dd5-3dc7ff53826d tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:34.304351 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3de9959c-1df5-476f-8dd5-3dc7ff53826d tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:34.305020 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-4a9bbabb-4e9b-4047-a4f1-7663f8d82c08 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Image pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 20:54:34.308192 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-4a9bbabb-4e9b-4047-a4f1-7663f8d82c08 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 20:54:34.512442 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-4a9bbabb-4e9b-4047-a4f1-7663f8d82c08 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] [instance: 73fd15ea-e4bd-4310-93bb-147b0a5e27ef] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:34.536288 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4a9bbabb-4e9b-4047-a4f1-7663f8d82c08 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:34.537853 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4a9bbabb-4e9b-4047-a4f1-7663f8d82c08 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:34.543534 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4a9bbabb-4e9b-4047-a4f1-7663f8d82c08 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:34.550067 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4a9bbabb-4e9b-4047-a4f1-7663f8d82c08 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:34.550822 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4a9bbabb-4e9b-4047-a4f1-7663f8d82c08 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:34.552534 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4a9bbabb-4e9b-4047-a4f1-7663f8d82c08 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:34.629352 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-4a9bbabb-4e9b-4047-a4f1-7663f8d82c08 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] 10.222.0.26 "POST /compute/v2.1/servers/73fd15ea-e4bd-4310-93bb-147b0a5e27ef/action" status: 202 len: 1066 microversion: 2.1 time: 1.553018 Oct 08 20:54:34.632955 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 458/868] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 20:54:33 2022] POST /compute/v2.1/servers/73fd15ea-e4bd-4310-93bb-147b0a5e27ef/action => generated 1066 bytes in 1557 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 08 20:54:34.647776 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-6221987f-4d7b-4349-975f-f5ada805220e tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:34.648392 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-6221987f-4d7b-4349-975f-f5ada805220e tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] [instance: 92e31b92-0af1-4da6-bc87-23978f1aedf5] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:34.664921 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6221987f-4d7b-4349-975f-f5ada805220e tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:34.665360 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6221987f-4d7b-4349-975f-f5ada805220e tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:34.667931 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6221987f-4d7b-4349-975f-f5ada805220e tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:34.668678 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6221987f-4d7b-4349-975f-f5ada805220e tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:34.669154 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6221987f-4d7b-4349-975f-f5ada805220e tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:34.669615 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6221987f-4d7b-4349-975f-f5ada805220e tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:34.771170 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-3de9959c-1df5-476f-8dd5-3dc7ff53826d tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:34.775972 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:54:34.776172 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-3de9959c-1df5-476f-8dd5-3dc7ff53826d tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:34.776172 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-3de9959c-1df5-476f-8dd5-3dc7ff53826d tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:34.776172 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-3de9959c-1df5-476f-8dd5-3dc7ff53826d tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] 10.222.0.26 "GET /compute/v2.1/servers/f04fdc43-98fc-4bfc-a0f6-6efb9d2ee5bc" status: 200 len: 1362 microversion: 2.25 time: 0.489288 Oct 08 20:54:34.776445 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 411/869] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:54:34 2022] GET /compute/v2.1/servers/f04fdc43-98fc-4bfc-a0f6-6efb9d2ee5bc => generated 1362 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:54:34.779481 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-daa698dc-9433-45a0-9ab0-38ad4f1f4a18 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Calling method '.version_select at 0x7f1a8cc1d040>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:34.890296 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-6221987f-4d7b-4349-975f-f5ada805220e tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:34.910365 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-6221987f-4d7b-4349-975f-f5ada805220e tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:34.912463 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-daa698dc-9433-45a0-9ab0-38ad4f1f4a18 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] 10.222.0.26 "GET /compute/v2.1/images/fcb8f618-1dbf-45d9-bdbc-46894bba4893" status: 200 len: 661 microversion: 2.1 time: 0.137032 Oct 08 20:54:34.913356 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 412/870] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:54:34 2022] GET /compute/v2.1/images/fcb8f618-1dbf-45d9-bdbc-46894bba4893 => generated 661 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:54:34.918243 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-0ffe2715-a7d4-4030-b661-8dedf56906fd tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:34.921874 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-0ffe2715-a7d4-4030-b661-8dedf56906fd tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] [instance: 73fd15ea-e4bd-4310-93bb-147b0a5e27ef] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:34.925946 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-6221987f-4d7b-4349-975f-f5ada805220e tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:34.938792 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0ffe2715-a7d4-4030-b661-8dedf56906fd tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:34.944318 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-6221987f-4d7b-4349-975f-f5ada805220e tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] 10.222.0.26 "GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5" status: 200 len: 1555 microversion: 2.91 time: 0.305751 Oct 08 20:54:34.944830 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0ffe2715-a7d4-4030-b661-8dedf56906fd tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:34.945638 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0ffe2715-a7d4-4030-b661-8dedf56906fd tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:34.947215 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0ffe2715-a7d4-4030-b661-8dedf56906fd tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:34.949231 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0ffe2715-a7d4-4030-b661-8dedf56906fd tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:34.949911 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0ffe2715-a7d4-4030-b661-8dedf56906fd tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:34.958001 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 459/871] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:54:34 2022] GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5 => generated 1555 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:54:34.973311 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-32fc60d9-d4af-4868-a648-a0bcda2d1256 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Calling method '.version_select at 0x7f1a8c8328b0>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:35.056388 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-32fc60d9-d4af-4868-a648-a0bcda2d1256 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] 10.222.0.26 "GET /compute/v2.1/images/fcb8f618-1dbf-45d9-bdbc-46894bba4893" status: 200 len: 661 microversion: 2.1 time: 0.097210 Oct 08 20:54:35.057244 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 460/872] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:54:34 2022] GET /compute/v2.1/images/fcb8f618-1dbf-45d9-bdbc-46894bba4893 => generated 661 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:54:35.119730 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-7638980f-dfaa-4ff0-89c3-0b6e1e41006d tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:35.120357 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-7638980f-dfaa-4ff0-89c3-0b6e1e41006d tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] [instance: a80fbf87-8203-4e6c-bee7-fe781bfccff1] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:35.130243 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7638980f-dfaa-4ff0-89c3-0b6e1e41006d tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:35.132108 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7638980f-dfaa-4ff0-89c3-0b6e1e41006d tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:35.132727 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7638980f-dfaa-4ff0-89c3-0b6e1e41006d tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:35.135443 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7638980f-dfaa-4ff0-89c3-0b6e1e41006d tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:35.138140 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7638980f-dfaa-4ff0-89c3-0b6e1e41006d tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:35.140743 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7638980f-dfaa-4ff0-89c3-0b6e1e41006d tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:35.314034 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-0ffe2715-a7d4-4030-b661-8dedf56906fd tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef659f5a1a24c439528a7675bdd70f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c92fe04ab8248399d0acb932f82d607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:35.324711 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-0ffe2715-a7d4-4030-b661-8dedf56906fd tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] 10.222.0.26 "GET /compute/v2.1/servers/73fd15ea-e4bd-4310-93bb-147b0a5e27ef" status: 200 len: 1471 microversion: 2.1 time: 0.410092 Oct 08 20:54:35.339889 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 413/873] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:54:34 2022] GET /compute/v2.1/servers/73fd15ea-e4bd-4310-93bb-147b0a5e27ef => generated 1471 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:54:35.450109 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-7638980f-dfaa-4ff0-89c3-0b6e1e41006d tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474ca64d1b1d4e30916b517645aba882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecc2dd2407b4819874bed09cb27959a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:35.459734 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-7638980f-dfaa-4ff0-89c3-0b6e1e41006d tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] 10.222.0.26 "GET /compute/v2.1/servers/a80fbf87-8203-4e6c-bee7-fe781bfccff1" status: 200 len: 1505 microversion: 2.1 time: 0.344540 Oct 08 20:54:35.477550 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 461/874] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:54:35 2022] GET /compute/v2.1/servers/a80fbf87-8203-4e6c-bee7-fe781bfccff1 => generated 1505 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:54:35.549640 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-3d678d66-5fa5-481f-87e2-ad4cfb9e8129 req-c8826e95-dc4b-4e32-b9ee-a7ca8f857862 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a80fbf87-8203-4e6c-bee7-fe781bfccff1", "tag": "01d74faf-31a5-494a-9dba-c900226fd0a9"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:54:35.564463 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-3d678d66-5fa5-481f-87e2-ad4cfb9e8129 req-c8826e95-dc4b-4e32-b9ee-a7ca8f857862 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:35.569771 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-3d678d66-5fa5-481f-87e2-ad4cfb9e8129 req-c8826e95-dc4b-4e32-b9ee-a7ca8f857862 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:35.570732 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-3d678d66-5fa5-481f-87e2-ad4cfb9e8129 req-c8826e95-dc4b-4e32-b9ee-a7ca8f857862 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:35.589869 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-3d678d66-5fa5-481f-87e2-ad4cfb9e8129 req-c8826e95-dc4b-4e32-b9ee-a7ca8f857862 service nova] Creating event network-changed:01d74faf-31a5-494a-9dba-c900226fd0a9 for instance a80fbf87-8203-4e6c-bee7-fe781bfccff1 on nch2-master-1 Oct 08 20:54:35.595769 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-3d678d66-5fa5-481f-87e2-ad4cfb9e8129 req-c8826e95-dc4b-4e32-b9ee-a7ca8f857862 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050915 Oct 08 20:54:35.597609 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 462/875] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:54:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 08 20:54:35.819508 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-0c9cb988-93ed-4271-a55d-8c8305c31d64 tempest-FlavorsV2NegativeTest-1140272662 tempest-FlavorsV2NegativeTest-1140272662-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:35.832351 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-0c9cb988-93ed-4271-a55d-8c8305c31d64 tempest-FlavorsV2NegativeTest-1140272662 tempest-FlavorsV2NegativeTest-1140272662-project] 10.222.0.26 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.491255 Oct 08 20:54:35.838180 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 414/876] 10.222.0.26 () {58 vars in 1137 bytes} [Sat Oct 8 20:54:35 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:54:35.843664 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-932ca964-9aee-4382-ac6b-ff79d6f4111d tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:35.860235 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-932ca964-9aee-4382-ac6b-ff79d6f4111d tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] [instance: f04fdc43-98fc-4bfc-a0f6-6efb9d2ee5bc] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:35.887337 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-37d91d9a-3319-4061-b140-778c35732ce8 tempest-KeyPairsNegativeTestJSON-1356788530 tempest-KeyPairsNegativeTestJSON-1356788530-project] Action: 'create', calling method: .version_select at 0x7f1a8c8438b0>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDPtbz5oHPUdsd7KJv+CjY0b6LF0BSzr9yaClCRFXco6DDeyGPsFdmn1GLr0jQRCa9LiqB/rIWtN0Ddea7ez90kK5p5fDTfPovBpUdD2UB3kp73Pvya+lmtMLRDjqJZqpg=="}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:54:35.888990 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-932ca964-9aee-4382-ac6b-ff79d6f4111d tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:35.898690 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-932ca964-9aee-4382-ac6b-ff79d6f4111d tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:35.900249 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-37d91d9a-3319-4061-b140-778c35732ce8 tempest-KeyPairsNegativeTestJSON-1356788530 tempest-KeyPairsNegativeTestJSON-1356788530-project] Request method failure captured: Oct 08 20:54:35.900249 ncdv-master-1 devstack@n-api.service[140492]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 08 20:54:35.900249 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 20:54:35.900249 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 20:54:35.900249 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 20:54:35.900249 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 257 Oct 08 20:54:35.900249 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 20:54:35.900249 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 20:54:35.900249 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 20:54:35.900249 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 20:54:35.900249 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeOLqfKYk8k9aFqgCs_66NyY_V8hl2ei378qAtRiQt3pvdRTO1ONE8ZBP1_OJo7yoIxEbk8MQGMiv8G3PTcwEVW0pM7g75wkqPPcYBTYxTBBDOQMl1oE_6L1RairjVGKT8QH5xuUVsxl3nVcHAYqvm98voQd6UnvE4BRsHMXW85Tcb8 Oct 08 20:54:35.900249 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 20:54:35.900249 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 20:54:35.900249 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 20:54:35.900249 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 20:54:35.900249 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 20:54:35.900249 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 20:54:35.900249 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 1c784548feb8459fa303989fe3fbc9f2 Oct 08 20:54:35.900249 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1356788530 Oct 08 20:54:35.900249 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 20:54:35.900249 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 20:54:35.901854 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1c784548feb8459fa303989fe3fbc9f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1c784548feb8459fa303989fe3fbc9f2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1c784548feb8459fa303989fe3fbc9f2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1c784548feb8459fa303989fe3fbc9f2"}]}] Oct 08 20:54:35.901854 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1356788530 Oct 08 20:54:35.901854 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 1c784548feb8459fa303989fe3fbc9f2 Oct 08 20:54:35.901854 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1356788530 Oct 08 20:54:35.901854 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-KeyPairsNegativeTestJSON-1356788530-project Oct 08 20:54:35.901854 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 20:54:35.901854 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 20:54:35.901854 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 294063d975784298b250340c0a820c24 Oct 08 20:54:35.901854 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1356788530-project Oct 08 20:54:35.901854 ncdv-master-1 devstack@n-api.service[140492]: Oct 08 20:54:35.901854 ncdv-master-1 devstack@n-api.service[140492]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDPtbz5oHPUdsd7KJv+CjY0b6LF0BSzr9yaClCRFXco6DDeyGPsFdmn1GLr0jQRCa9LiqB/rIWtN0Ddea7ez90kK5p5fDTfPovBpUdD2UB3kp73Pvya+lmtMLRDjqJZqpg=="}} Oct 08 20:54:35.902739 ncdv-master-1 devstack@n-api.service[140492]: method: Oct 08 20:54:35.902739 ncdv-master-1 devstack@n-api.service[140492]: exception: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 08 20:54:35.902739 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDPtbz5oHPUdsd7KJv+CjY0b6LF0BSzr9yaClCRFXco6DDeyGPsFdmn1GLr0jQRCa9LiqB/rIWtN0Ddea7ez90kK5p5fDTfPovBpUdD2UB3kp73Pvya+lmtMLRDjqJZqpg=='}}} Oct 08 20:54:35.902739 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:54:35.902739 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:54:35.902739 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 08 20:54:35.902739 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 08 20:54:35.902739 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 161, in _validate_keypair_name_20 Oct 08 20:54:35.902739 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return _validate_keypair_name(keypair_name, safe_chars) Oct 08 20:54:35.902739 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 175, in _validate_keypair_name Oct 08 20:54:35.902739 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InvalidName(reason=reason) Oct 08 20:54:35.902739 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InvalidName: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 08 20:54:35.902739 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:54:35.902739 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 08 20:54:35.902739 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:54:35.902739 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:54:35.902739 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 08 20:54:35.903913 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 08 20:54:35.903913 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 08 20:54:35.903913 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise error Oct 08 20:54:35.903913 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'key_/.\\@:' is not a 'keypair_name_20' Oct 08 20:54:35.903913 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:54:35.903913 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['keypair']['properties']['name']['allOf'][1]: Oct 08 20:54:35.903913 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi {'format': 'keypair_name_20', Oct 08 20:54:35.903913 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi 'maxLength': 255, Oct 08 20:54:35.903913 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi 'minLength': 1, Oct 08 20:54:35.903913 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 08 20:54:35.903913 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:54:35.903913 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi On instance['keypair']['name']: Oct 08 20:54:35.903913 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi 'key_/.\\@:' Oct 08 20:54:35.903913 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:54:35.903913 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:54:35.903913 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:54:35.903913 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:54:35.903913 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:54:35.903913 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:54:35.903913 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:54:35.903913 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:54:35.903913 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 08 20:54:35.903913 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 08 20:54:35.905585 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:54:35.905585 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:54:35.905585 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 20:54:35.905585 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 20:54:35.905585 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 08 20:54:35.905585 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 08 20:54:35.905585 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 08 20:54:35.905585 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 08 20:54:35.905585 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 08 20:54:35.905585 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 08 20:54:35.905585 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 08 20:54:35.905585 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:54:35.905585 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:54:35.905585 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:54:35.905585 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:54:35.905585 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:54:35.905585 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:54:35.905585 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 08 20:54:35.905585 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 08 20:54:35.906745 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 08 20:54:35.906745 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:54:35.906745 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-37d91d9a-3319-4061-b140-778c35732ce8 tempest-KeyPairsNegativeTestJSON-1356788530 tempest-KeyPairsNegativeTestJSON-1356788530-project] Returning 400 to user: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:54:35.906745 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-37d91d9a-3319-4061-b140-778c35732ce8 tempest-KeyPairsNegativeTestJSON-1356788530 tempest-KeyPairsNegativeTestJSON-1356788530-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 400 len: 193 microversion: 2.1 time: 0.302801 Oct 08 20:54:35.906745 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 463/877] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Oct 8 20:54:35 2022] POST /compute/v2.1/os-keypairs => generated 193 bytes in 304 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 08 20:54:35.909752 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-932ca964-9aee-4382-ac6b-ff79d6f4111d tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:35.911190 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-932ca964-9aee-4382-ac6b-ff79d6f4111d tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:35.911880 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-932ca964-9aee-4382-ac6b-ff79d6f4111d tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:35.912536 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-932ca964-9aee-4382-ac6b-ff79d6f4111d tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:35.914381 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-cb608834-4788-4c6d-a521-1908ef80a82d tempest-KeyPairsNegativeTestJSON-1356788530 tempest-KeyPairsNegativeTestJSON-1356788530-project] Action: 'create', calling method: .version_select at 0x7f1a8c8958b0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1538479085", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:54:35.953646 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-cb608834-4788-4c6d-a521-1908ef80a82d tempest-KeyPairsNegativeTestJSON-1356788530 tempest-KeyPairsNegativeTestJSON-1356788530-project] Getting quotas for project 1c784548feb8459fa303989fe3fbc9f2. Resources: {'key_pairs'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 20:54:35.970358 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-cb608834-4788-4c6d-a521-1908ef80a82d tempest-KeyPairsNegativeTestJSON-1356788530 tempest-KeyPairsNegativeTestJSON-1356788530-project] Getting quotas for user 294063d975784298b250340c0a820c24 and project 1c784548feb8459fa303989fe3fbc9f2. Resources: {'key_pairs'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 20:54:36.012601 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-cb608834-4788-4c6d-a521-1908ef80a82d tempest-KeyPairsNegativeTestJSON-1356788530 tempest-KeyPairsNegativeTestJSON-1356788530-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 08 20:54:36.022218 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-cb608834-4788-4c6d-a521-1908ef80a82d tempest-KeyPairsNegativeTestJSON-1356788530 tempest-KeyPairsNegativeTestJSON-1356788530-project] Request method failure captured: Oct 08 20:54:36.022218 ncdv-master-1 devstack@n-api.service[140492]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 08 20:54:36.022218 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 20:54:36.022218 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 20:54:36.022218 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 20:54:36.022218 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 2167 Oct 08 20:54:36.022218 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 20:54:36.022218 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 20:54:36.022218 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 20:54:36.022218 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 20:54:36.022218 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeOLqfKYk8k9aFqgCs_66NyY_V8hl2ei378qAtRiQt3pvdRTO1ONE8ZBP1_OJo7yoIxEbk8MQGMiv8G3PTcwEVW0pM7g75wkqPPcYBTYxTBBDOQMl1oE_6L1RairjVGKT8QH5xuUVsxl3nVcHAYqvm98voQd6UnvE4BRsHMXW85Tcb8 Oct 08 20:54:36.022218 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 20:54:36.022218 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 20:54:36.022218 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 20:54:36.022218 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 20:54:36.022218 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 20:54:36.022218 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 20:54:36.022218 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 1c784548feb8459fa303989fe3fbc9f2 Oct 08 20:54:36.022218 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1356788530 Oct 08 20:54:36.022218 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 20:54:36.022218 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 20:54:36.022218 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1c784548feb8459fa303989fe3fbc9f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1c784548feb8459fa303989fe3fbc9f2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1c784548feb8459fa303989fe3fbc9f2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1c784548feb8459fa303989fe3fbc9f2"}]}] Oct 08 20:54:36.022218 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1356788530 Oct 08 20:54:36.022218 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 1c784548feb8459fa303989fe3fbc9f2 Oct 08 20:54:36.022218 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1356788530 Oct 08 20:54:36.022218 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-KeyPairsNegativeTestJSON-1356788530-project Oct 08 20:54:36.022218 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 20:54:36.022218 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 20:54:36.022218 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 294063d975784298b250340c0a820c24 Oct 08 20:54:36.022218 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1356788530-project Oct 08 20:54:36.022218 ncdv-master-1 devstack@n-api.service[140492]: Oct 08 20:54:36.022218 ncdv-master-1 devstack@n-api.service[140492]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1538479085", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Oct 08 20:54:36.022218 ncdv-master-1 devstack@n-api.service[140492]: method: Oct 08 20:54:36.022218 ncdv-master-1 devstack@n-api.service[140492]: exception: Keypair data is invalid: failed to generate fingerprint Oct 08 20:54:36.024607 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1538479085', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Oct 08 20:54:36.024607 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:54:36.024607 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:54:36.024607 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 08 20:54:36.024607 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 08 20:54:36.024607 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Oct 08 20:54:36.024607 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Oct 08 20:54:36.024607 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Oct 08 20:54:36.024607 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:54:36.024607 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:54:36.024607 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:54:36.024607 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:54:36.024607 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 08 20:54:36.024607 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 08 20:54:36.024607 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 08 20:54:36.024607 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 08 20:54:36.024607 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 08 20:54:36.024607 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 08 20:54:36.024607 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 08 20:54:36.024607 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise self.value Oct 08 20:54:36.024607 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 08 20:54:36.024607 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 08 20:54:36.024607 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 08 20:54:36.024607 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 08 20:54:36.024607 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 08 20:54:36.024607 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 08 20:54:36.024607 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 08 20:54:36.024607 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 08 20:54:36.024607 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 08 20:54:36.024607 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:54:36.024607 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:54:36.024607 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:54:36.024607 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:54:36.024607 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:54:36.024607 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:54:36.024607 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:54:36.024607 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:54:36.024607 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 08 20:54:36.024607 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 08 20:54:36.024607 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:54:36.024607 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:54:36.027551 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 20:54:36.027551 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 20:54:36.027551 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 20:54:36.027551 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 20:54:36.027551 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 08 20:54:36.027551 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 08 20:54:36.027551 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 08 20:54:36.027551 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 08 20:54:36.027551 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 08 20:54:36.027551 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:54:36.027551 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:54:36.027551 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:54:36.027551 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:54:36.027551 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:54:36.027551 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:54:36.027551 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 20:54:36.027551 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 20:54:36.027551 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 08 20:54:36.027551 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:54:36.027551 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-cb608834-4788-4c6d-a521-1908ef80a82d tempest-KeyPairsNegativeTestJSON-1356788530 tempest-KeyPairsNegativeTestJSON-1356788530-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:54:36.027551 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-cb608834-4788-4c6d-a521-1908ef80a82d tempest-KeyPairsNegativeTestJSON-1356788530 tempest-KeyPairsNegativeTestJSON-1356788530-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.113854 Oct 08 20:54:36.027551 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 464/878] 10.222.0.26 () {60 vars in 1160 bytes} [Sat Oct 8 20:54:35 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 116 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 08 20:54:36.038209 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-b7c4d069-4f95-4748-a3f2-d882914ab5dc tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:36.040361 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-b7c4d069-4f95-4748-a3f2-d882914ab5dc tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] [instance: 92e31b92-0af1-4da6-bc87-23978f1aedf5] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:36.056498 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b7c4d069-4f95-4748-a3f2-d882914ab5dc tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:36.057018 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b7c4d069-4f95-4748-a3f2-d882914ab5dc tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:36.060478 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b7c4d069-4f95-4748-a3f2-d882914ab5dc tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:36.062040 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b7c4d069-4f95-4748-a3f2-d882914ab5dc tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:36.064718 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b7c4d069-4f95-4748-a3f2-d882914ab5dc tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:36.065180 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b7c4d069-4f95-4748-a3f2-d882914ab5dc tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:36.223474 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-b7c4d069-4f95-4748-a3f2-d882914ab5dc tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:36.240063 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-b7c4d069-4f95-4748-a3f2-d882914ab5dc tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:36.242247 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-b7c4d069-4f95-4748-a3f2-d882914ab5dc tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:36.259354 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-b7c4d069-4f95-4748-a3f2-d882914ab5dc tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] 10.222.0.26 "GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5" status: 200 len: 1555 microversion: 2.91 time: 0.231263 Oct 08 20:54:36.261902 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 465/879] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:54:36 2022] GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5 => generated 1555 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:54:36.273006 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-48a46fec-ea08-443a-a5f0-91bcecde2e58 tempest-KeyPairsNegativeTestJSON-1356788530 tempest-KeyPairsNegativeTestJSON-1356788530-project] Action: 'create', calling method: .version_select at 0x7f1a8c94b430>, body: {"keypair": {"name": "tempest-keypair-755205364", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBWJZh4LQzNuNtkgphv371Y8XmZCCtUruISXPQCAJTrBDMQVZTwKThsA2d4WlWRoCin0vv/7/TEvDBw5VegJCfvRaDTlePP8nzAdNJPlJiqOlkW/OldW2XoliOxvx/gIeQ=="}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:54:36.319629 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-48a46fec-ea08-443a-a5f0-91bcecde2e58 tempest-KeyPairsNegativeTestJSON-1356788530 tempest-KeyPairsNegativeTestJSON-1356788530-project] Getting quotas for project 1c784548feb8459fa303989fe3fbc9f2. Resources: {'key_pairs'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 20:54:36.331412 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-48a46fec-ea08-443a-a5f0-91bcecde2e58 tempest-KeyPairsNegativeTestJSON-1356788530 tempest-KeyPairsNegativeTestJSON-1356788530-project] Getting quotas for user 294063d975784298b250340c0a820c24 and project 1c784548feb8459fa303989fe3fbc9f2. Resources: {'key_pairs'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 20:54:36.400905 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-48a46fec-ea08-443a-a5f0-91bcecde2e58 tempest-KeyPairsNegativeTestJSON-1356788530 tempest-KeyPairsNegativeTestJSON-1356788530-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.137146 Oct 08 20:54:36.406317 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 466/880] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Oct 8 20:54:36 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:54:36.415326 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-2344525b-0328-41cf-a359-f72a2c5844ff req-2d5b8b7a-ccff-49c9-9e8b-b83dcd344e96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73fd15ea-e4bd-4310-93bb-147b0a5e27ef", "name": "network-vif-plugged", "status": "completed", "tag": "27f3cc41-9f72-499b-bae1-fb66f8f24df7"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:54:36.467529 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-2344525b-0328-41cf-a359-f72a2c5844ff req-2d5b8b7a-ccff-49c9-9e8b-b83dcd344e96 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:36.471026 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-2344525b-0328-41cf-a359-f72a2c5844ff req-2d5b8b7a-ccff-49c9-9e8b-b83dcd344e96 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:36.474299 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-2344525b-0328-41cf-a359-f72a2c5844ff req-2d5b8b7a-ccff-49c9-9e8b-b83dcd344e96 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:36.502385 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-932ca964-9aee-4382-ac6b-ff79d6f4111d tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:36.516793 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-932ca964-9aee-4382-ac6b-ff79d6f4111d tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:36.517037 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-2344525b-0328-41cf-a359-f72a2c5844ff req-2d5b8b7a-ccff-49c9-9e8b-b83dcd344e96 service nova] Creating event network-vif-plugged:27f3cc41-9f72-499b-bae1-fb66f8f24df7 for instance 73fd15ea-e4bd-4310-93bb-147b0a5e27ef on nch2-master-1 Oct 08 20:54:36.522557 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-932ca964-9aee-4382-ac6b-ff79d6f4111d tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:36.524345 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-932ca964-9aee-4382-ac6b-ff79d6f4111d tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] 10.222.0.26 "GET /compute/v2.1/servers/f04fdc43-98fc-4bfc-a0f6-6efb9d2ee5bc" status: 200 len: 1362 microversion: 2.25 time: 0.684709 Oct 08 20:54:36.537650 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-2344525b-0328-41cf-a359-f72a2c5844ff req-2d5b8b7a-ccff-49c9-9e8b-b83dcd344e96 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127640 Oct 08 20:54:36.537650 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 467/881] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:54:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:54:36.556733 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 415/882] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:54:35 2022] GET /compute/v2.1/servers/f04fdc43-98fc-4bfc-a0f6-6efb9d2ee5bc => generated 1362 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:54:36.560351 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-0b692de7-d0c5-40cd-a50b-575c94718b3c tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:36.561082 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-0b692de7-d0c5-40cd-a50b-575c94718b3c tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] [instance: 73fd15ea-e4bd-4310-93bb-147b0a5e27ef] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:36.565338 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-25d2e854-fdc7-47c0-9c5f-5fd6291e4561 tempest-KeyPairsNegativeTestJSON-1356788530 tempest-KeyPairsNegativeTestJSON-1356788530-project] Action: 'create', calling method: .version_select at 0x7f1a8cc45700>, body: {"keypair": {"name": "tempest-keypair-755205364", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBXb/EELTCMdWYOvPpr1iogpEK5fdOWXUIESS39ISYRKohxQlas2Os+SyoHJbsFZFhHCjfMlTJ8qQl7T/4bdzagBkBMRdF2hsCie/oYuVWtz+tSjQGHwi4k+QCn6w2ZQLQ=="}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:54:36.580786 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0b692de7-d0c5-40cd-a50b-575c94718b3c tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:36.589532 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0b692de7-d0c5-40cd-a50b-575c94718b3c tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:36.590095 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0b692de7-d0c5-40cd-a50b-575c94718b3c tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:36.593141 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0b692de7-d0c5-40cd-a50b-575c94718b3c tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:36.595033 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0b692de7-d0c5-40cd-a50b-575c94718b3c tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:36.596816 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0b692de7-d0c5-40cd-a50b-575c94718b3c tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:36.606902 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-25d2e854-fdc7-47c0-9c5f-5fd6291e4561 tempest-KeyPairsNegativeTestJSON-1356788530 tempest-KeyPairsNegativeTestJSON-1356788530-project] Getting quotas for project 1c784548feb8459fa303989fe3fbc9f2. Resources: {'key_pairs'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 20:54:36.617455 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-25d2e854-fdc7-47c0-9c5f-5fd6291e4561 tempest-KeyPairsNegativeTestJSON-1356788530 tempest-KeyPairsNegativeTestJSON-1356788530-project] Getting quotas for user 294063d975784298b250340c0a820c24 and project 1c784548feb8459fa303989fe3fbc9f2. Resources: {'key_pairs'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 20:54:36.656699 ncdv-master-1 devstack@n-api.service[140491]: ERROR oslo.messaging._drivers.impl_rabbit [None req-25d2e854-fdc7-47c0-9c5f-5fd6291e4561 tempest-KeyPairsNegativeTestJSON-1356788530 tempest-KeyPairsNegativeTestJSON-1356788530-project] [62e384ad-183d-418e-844f-07a4fef96c5b] AMQP server on 10.222.0.26:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 08 20:54:36.861100 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-0b692de7-d0c5-40cd-a50b-575c94718b3c tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef659f5a1a24c439528a7675bdd70f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c92fe04ab8248399d0acb932f82d607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:36.872819 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-0b692de7-d0c5-40cd-a50b-575c94718b3c tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] 10.222.0.26 "GET /compute/v2.1/servers/73fd15ea-e4bd-4310-93bb-147b0a5e27ef" status: 200 len: 1471 microversion: 2.1 time: 0.335105 Oct 08 20:54:36.874051 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 468/883] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:54:36 2022] GET /compute/v2.1/servers/73fd15ea-e4bd-4310-93bb-147b0a5e27ef => generated 1471 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:54:36.880691 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-8a634522-8ae0-4783-b4d0-488048cc3d16 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:36.885880 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-8a634522-8ae0-4783-b4d0-488048cc3d16 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] [instance: a80fbf87-8203-4e6c-bee7-fe781bfccff1] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:36.904794 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8a634522-8ae0-4783-b4d0-488048cc3d16 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:36.905333 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8a634522-8ae0-4783-b4d0-488048cc3d16 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:36.905786 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8a634522-8ae0-4783-b4d0-488048cc3d16 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:36.906508 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8a634522-8ae0-4783-b4d0-488048cc3d16 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:36.907158 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8a634522-8ae0-4783-b4d0-488048cc3d16 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:36.907753 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8a634522-8ae0-4783-b4d0-488048cc3d16 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:37.160808 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-8a634522-8ae0-4783-b4d0-488048cc3d16 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474ca64d1b1d4e30916b517645aba882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecc2dd2407b4819874bed09cb27959a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:37.169527 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-8a634522-8ae0-4783-b4d0-488048cc3d16 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] 10.222.0.26 "GET /compute/v2.1/servers/a80fbf87-8203-4e6c-bee7-fe781bfccff1" status: 200 len: 1505 microversion: 2.1 time: 0.292273 Oct 08 20:54:37.170437 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 469/884] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:54:36 2022] GET /compute/v2.1/servers/a80fbf87-8203-4e6c-bee7-fe781bfccff1 => generated 1505 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:54:37.175722 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-dacab7fa-e6eb-4955-a688-f07e3a885564 tempest-FlavorsV2NegativeTest-1140272662 tempest-FlavorsV2NegativeTest-1140272662-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-644437704", "imageRef": "ca53354d-ec03-4c7d-a4b0-338f85ee61b7", "flavorRef": "452"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:54:37.431503 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.network.neutron [None req-dacab7fa-e6eb-4955-a688-f07e3a885564 tempest-FlavorsV2NegativeTest-1140272662 tempest-FlavorsV2NegativeTest-1140272662-project] validate_networks() for None {{(pid=140492) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 20:54:37.664166 ncdv-master-1 devstack@n-api.service[140491]: INFO oslo.messaging._drivers.impl_rabbit [None req-25d2e854-fdc7-47c0-9c5f-5fd6291e4561 tempest-KeyPairsNegativeTestJSON-1356788530 tempest-KeyPairsNegativeTestJSON-1356788530-project] [62e384ad-183d-418e-844f-07a4fef96c5b] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 38580. Oct 08 20:54:37.687744 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-dacab7fa-e6eb-4955-a688-f07e3a885564 tempest-FlavorsV2NegativeTest-1140272662 tempest-FlavorsV2NegativeTest-1140272662-project] HTTP exception thrown: Flavor's memory is too small for requested image. Oct 08 20:54:37.690278 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-dacab7fa-e6eb-4955-a688-f07e3a885564 tempest-FlavorsV2NegativeTest-1140272662 tempest-FlavorsV2NegativeTest-1140272662-project] Request method failure captured: Oct 08 20:54:37.690278 ncdv-master-1 devstack@n-api.service[140492]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 08 20:54:37.690278 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 20:54:37.690278 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 20:54:37.690278 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 20:54:37.690278 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 142 Oct 08 20:54:37.690278 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 20:54:37.690278 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 20:54:37.690278 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 20:54:37.690278 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 20:54:37.690278 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeOK5g-6ypjpatHJ3uIzn3WfPJIlh_LO1yMQZyg1_X5qi-wFXDFuzOsVlWo2-71vVx7K1DpOmF8m-YELr225EC33GGHjYu0y86lED1SgmW2R3xlN4R7o17ycdfikQsukbrgfkiPc-2mvj7uG_phfFJmAorvs1oFMR8qRQW31lOdmADo Oct 08 20:54:37.690278 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 20:54:37.690278 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 20:54:37.690278 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 20:54:37.690278 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 20:54:37.690278 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 20:54:37.690278 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 20:54:37.690278 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 6001cf381fcd472da6e006e7bce01644 Oct 08 20:54:37.690278 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-FlavorsV2NegativeTest-1140272662 Oct 08 20:54:37.690278 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 20:54:37.690278 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 20:54:37.690278 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6001cf381fcd472da6e006e7bce01644"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6001cf381fcd472da6e006e7bce01644"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6001cf381fcd472da6e006e7bce01644"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6001cf381fcd472da6e006e7bce01644"}]}] Oct 08 20:54:37.690278 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-FlavorsV2NegativeTest-1140272662 Oct 08 20:54:37.690278 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 6001cf381fcd472da6e006e7bce01644 Oct 08 20:54:37.690278 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-1140272662 Oct 08 20:54:37.690278 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-FlavorsV2NegativeTest-1140272662-project Oct 08 20:54:37.690278 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 20:54:37.690278 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 20:54:37.690278 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: ec419187582e4ab1bde6ccc15119d12e Oct 08 20:54:37.690278 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-FlavorsV2NegativeTest-1140272662-project Oct 08 20:54:37.690278 ncdv-master-1 devstack@n-api.service[140492]: Oct 08 20:54:37.690278 ncdv-master-1 devstack@n-api.service[140492]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-644437704", "imageRef": "ca53354d-ec03-4c7d-a4b0-338f85ee61b7", "flavorRef": "452"}} Oct 08 20:54:37.690278 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 20:54:37.690278 ncdv-master-1 devstack@n-api.service[140492]: exception: Flavor's memory is too small for requested image. Oct 08 20:54:37.690278 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-644437704', 'imageRef': 'ca53354d-ec03-4c7d-a4b0-338f85ee61b7', 'flavorRef': '452'}}} Oct 08 20:54:37.690278 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:54:37.690278 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:54:37.690278 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 08 20:54:37.690278 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 08 20:54:37.690278 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 08 20:54:37.690278 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 08 20:54:37.690278 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Oct 08 20:54:37.690278 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Oct 08 20:54:37.690278 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1019, in _checks_for_create_and_rebuild Oct 08 20:54:37.690278 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Oct 08 20:54:37.690278 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 683, in _validate_flavor_image Oct 08 20:54:37.690278 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Oct 08 20:54:37.690278 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 751, in _validate_flavor_image_nostatus Oct 08 20:54:37.690278 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Oct 08 20:54:37.690278 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Oct 08 20:54:37.690278 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:54:37.690278 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:54:37.690278 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:54:37.690278 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:54:37.690278 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:54:37.690278 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:54:37.690278 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:54:37.690278 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:54:37.690278 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:54:37.690278 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:54:37.690278 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 20:54:37.690278 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 20:54:37.690278 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 20:54:37.690278 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 20:54:37.694391 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 20:54:37.694391 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 20:54:37.694391 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 08 20:54:37.694391 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Oct 08 20:54:37.694391 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 08 20:54:37.694391 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Oct 08 20:54:37.694391 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:54:37.694391 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:54:37.694391 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:54:37.694391 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:54:37.694391 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:54:37.694391 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:54:37.694391 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 20:54:37.694391 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 20:54:37.694391 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Oct 08 20:54:37.694391 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:54:37.699014 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-dacab7fa-e6eb-4955-a688-f07e3a885564 tempest-FlavorsV2NegativeTest-1140272662 tempest-FlavorsV2NegativeTest-1140272662-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:54:37.699897 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-dacab7fa-e6eb-4955-a688-f07e3a885564 tempest-FlavorsV2NegativeTest-1140272662 tempest-FlavorsV2NegativeTest-1140272662-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 0.528382 Oct 08 20:54:37.700657 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 470/885] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 20:54:37 2022] POST /compute/v2.1/servers => generated 93 bytes in 529 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 08 20:54:37.729625 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-25d2e854-fdc7-47c0-9c5f-5fd6291e4561 tempest-KeyPairsNegativeTestJSON-1356788530 tempest-KeyPairsNegativeTestJSON-1356788530-project] HTTP exception thrown: Key pair 'tempest-keypair-755205364' already exists. Oct 08 20:54:37.738940 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-fd443d4c-9704-4c08-94a0-8d1f4ae1b117 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:37.739642 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-fd443d4c-9704-4c08-94a0-8d1f4ae1b117 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] [instance: 84eba001-0fa3-4fb7-b74e-0bb54c527ac7] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:37.756373 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fd443d4c-9704-4c08-94a0-8d1f4ae1b117 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:37.757421 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fd443d4c-9704-4c08-94a0-8d1f4ae1b117 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:37.757421 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fd443d4c-9704-4c08-94a0-8d1f4ae1b117 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:37.760408 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fd443d4c-9704-4c08-94a0-8d1f4ae1b117 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:37.760897 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fd443d4c-9704-4c08-94a0-8d1f4ae1b117 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:37.762493 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fd443d4c-9704-4c08-94a0-8d1f4ae1b117 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:37.766938 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-25d2e854-fdc7-47c0-9c5f-5fd6291e4561 tempest-KeyPairsNegativeTestJSON-1356788530 tempest-KeyPairsNegativeTestJSON-1356788530-project] Request method failure captured: Oct 08 20:54:37.766938 ncdv-master-1 devstack@n-api.service[140491]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 08 20:54:37.766938 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 20:54:37.766938 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 20:54:37.766938 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 20:54:37.766938 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 272 Oct 08 20:54:37.766938 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 20:54:37.766938 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 20:54:37.766938 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 20:54:37.766938 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 20:54:37.766938 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeOLqfKYk8k9aFqgCs_66NyY_V8hl2ei378qAtRiQt3pvdRTO1ONE8ZBP1_OJo7yoIxEbk8MQGMiv8G3PTcwEVW0pM7g75wkqPPcYBTYxTBBDOQMl1oE_6L1RairjVGKT8QH5xuUVsxl3nVcHAYqvm98voQd6UnvE4BRsHMXW85Tcb8 Oct 08 20:54:37.766938 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 20:54:37.766938 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 20:54:37.766938 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 20:54:37.766938 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 20:54:37.766938 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 20:54:37.766938 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 20:54:37.766938 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 1c784548feb8459fa303989fe3fbc9f2 Oct 08 20:54:37.766938 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1356788530 Oct 08 20:54:37.766938 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 20:54:37.766938 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 20:54:37.766938 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1c784548feb8459fa303989fe3fbc9f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1c784548feb8459fa303989fe3fbc9f2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1c784548feb8459fa303989fe3fbc9f2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1c784548feb8459fa303989fe3fbc9f2"}]}] Oct 08 20:54:37.766938 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1356788530 Oct 08 20:54:37.766938 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 1c784548feb8459fa303989fe3fbc9f2 Oct 08 20:54:37.766938 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1356788530 Oct 08 20:54:37.766938 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-KeyPairsNegativeTestJSON-1356788530-project Oct 08 20:54:37.766938 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 20:54:37.766938 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 20:54:37.766938 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 294063d975784298b250340c0a820c24 Oct 08 20:54:37.766938 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1356788530-project Oct 08 20:54:37.766938 ncdv-master-1 devstack@n-api.service[140491]: Oct 08 20:54:37.766938 ncdv-master-1 devstack@n-api.service[140491]: {"keypair": {"name": "tempest-keypair-755205364", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBXb/EELTCMdWYOvPpr1iogpEK5fdOWXUIESS39ISYRKohxQlas2Os+SyoHJbsFZFhHCjfMlTJ8qQl7T/4bdzagBkBMRdF2hsCie/oYuVWtz+tSjQGHwi4k+QCn6w2ZQLQ=="}} Oct 08 20:54:37.766938 ncdv-master-1 devstack@n-api.service[140491]: method: Oct 08 20:54:37.766938 ncdv-master-1 devstack@n-api.service[140491]: exception: Key pair 'tempest-keypair-755205364' already exists. Oct 08 20:54:37.766938 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-755205364', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBXb/EELTCMdWYOvPpr1iogpEK5fdOWXUIESS39ISYRKohxQlas2Os+SyoHJbsFZFhHCjfMlTJ8qQl7T/4bdzagBkBMRdF2hsCie/oYuVWtz+tSjQGHwi4k+QCn6w2ZQLQ=='}}} Oct 08 20:54:37.766938 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:54:37.766938 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:54:37.766938 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 08 20:54:37.766938 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 08 20:54:37.766938 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 08 20:54:37.766938 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 08 20:54:37.766938 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 08 20:54:37.766938 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 08 20:54:37.766938 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 08 20:54:37.766938 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 08 20:54:37.766938 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 08 20:54:37.766938 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 08 20:54:37.766938 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 08 20:54:37.766938 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi result.read() Oct 08 20:54:37.766938 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 08 20:54:37.766938 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 08 20:54:37.766938 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 08 20:54:37.766938 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 08 20:54:37.766938 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 08 20:54:37.766938 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 08 20:54:37.766938 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 08 20:54:37.766938 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 08 20:54:37.766938 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '294063d975784298b250340c0a820c24-tempest-keypair-755205364' for key 'key_pairs.uniq_key_pairs0user_id0name'") Oct 08 20:54:37.766938 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:54:37.770767 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 08 20:54:37.770767 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:54:37.770767 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:54:37.770767 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Oct 08 20:54:37.770767 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi kp.save(context.session) Oct 08 20:54:37.770767 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 08 20:54:37.770767 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi session.flush() Oct 08 20:54:37.770767 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 08 20:54:37.770767 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 08 20:54:37.770767 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 08 20:54:37.770767 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 08 20:54:37.770767 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 08 20:54:37.770767 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 08 20:54:37.770767 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 08 20:54:37.770767 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception Oct 08 20:54:37.770767 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 08 20:54:37.770767 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 08 20:54:37.770767 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 08 20:54:37.770767 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 08 20:54:37.770767 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 08 20:54:37.770767 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 08 20:54:37.770767 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 08 20:54:37.770767 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 08 20:54:37.770767 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 08 20:54:37.770767 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 08 20:54:37.770767 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 08 20:54:37.770767 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 08 20:54:37.770767 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 08 20:54:37.770767 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 08 20:54:37.770767 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 08 20:54:37.770767 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 08 20:54:37.770767 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 08 20:54:37.770767 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 08 20:54:37.770767 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 08 20:54:37.770767 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 08 20:54:37.770767 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 08 20:54:37.770767 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception Oct 08 20:54:37.770767 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 08 20:54:37.770767 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 08 20:54:37.770767 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 08 20:54:37.770767 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 08 20:54:37.770767 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 08 20:54:37.770767 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 08 20:54:37.770767 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 08 20:54:37.770767 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 08 20:54:37.770767 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 08 20:54:37.770767 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 08 20:54:37.770767 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 08 20:54:37.770767 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi result.read() Oct 08 20:54:37.770767 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 08 20:54:37.770767 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 08 20:54:37.770767 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 08 20:54:37.770767 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 08 20:54:37.770767 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 08 20:54:37.770767 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 08 20:54:37.770767 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 08 20:54:37.775341 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 08 20:54:37.775341 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '294063d975784298b250340c0a820c24-tempest-keypair-755205364' for key 'key_pairs.uniq_key_pairs0user_id0name'") Oct 08 20:54:37.775341 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Oct 08 20:54:37.775341 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 8, 20, 54, 37, 677684), 'updated_at': None, 'name': 'tempest-keypair-755205364', 'user_id': '294063d975784298b250340c0a820c24', 'fingerprint': '34:53:67:b7:2b:6c:6d:2e:e0:ee:dc:5a:16:a6:76:51', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBXb/EELTCMdWYOvPpr1iogpEK5fdOWXUIESS39ISYRKohxQlas2Os+SyoHJbsFZFhHCjfMlTJ8qQl7T/4bdzagBkBMRdF2hsCie/oYuVWtz+tSjQGHwi4k+QCn6w2ZQLQ==', 'type': 'ssh'}] Oct 08 20:54:37.775341 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 08 20:54:37.775341 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:54:37.775341 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:54:37.775341 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:54:37.775341 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:54:37.775341 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 08 20:54:37.775341 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 08 20:54:37.775341 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 08 20:54:37.775341 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 08 20:54:37.775341 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 08 20:54:37.775341 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 08 20:54:37.775341 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 08 20:54:37.775341 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise self.value Oct 08 20:54:37.775341 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 08 20:54:37.775341 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 08 20:54:37.775341 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6777, in import_key_pair Oct 08 20:54:37.775341 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi keypair.create() Oct 08 20:54:37.775341 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 08 20:54:37.775341 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 08 20:54:37.775341 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Oct 08 20:54:37.775341 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi self._create() Oct 08 20:54:37.775341 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Oct 08 20:54:37.775341 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Oct 08 20:54:37.775341 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Oct 08 20:54:37.775341 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Oct 08 20:54:37.775341 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 08 20:54:37.775341 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 08 20:54:37.775341 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Oct 08 20:54:37.775341 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Oct 08 20:54:37.775341 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-755205364' already exists. Oct 08 20:54:37.775341 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:54:37.775341 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:54:37.775341 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:54:37.775341 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:54:37.775341 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:54:37.775341 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:54:37.775341 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:54:37.775341 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:54:37.775341 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 08 20:54:37.775341 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 08 20:54:37.775341 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:54:37.775341 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:54:37.775341 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 20:54:37.775341 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 20:54:37.775341 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 20:54:37.775341 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 20:54:37.775341 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 08 20:54:37.775341 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 08 20:54:37.775341 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 132, in _create Oct 08 20:54:37.775341 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Oct 08 20:54:37.775341 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-755205364' already exists. Oct 08 20:54:37.782790 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:54:37.782790 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:54:37.782790 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:54:37.782790 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:54:37.782790 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:54:37.782790 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:54:37.782790 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 20:54:37.782790 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 20:54:37.782790 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-755205364' already exists. Oct 08 20:54:37.782790 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:54:37.784147 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-25d2e854-fdc7-47c0-9c5f-5fd6291e4561 tempest-KeyPairsNegativeTestJSON-1356788530 tempest-KeyPairsNegativeTestJSON-1356788530-project] Returning 409 to user: Key pair 'tempest-keypair-755205364' already exists. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:54:37.785142 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-25d2e854-fdc7-47c0-9c5f-5fd6291e4561 tempest-KeyPairsNegativeTestJSON-1356788530 tempest-KeyPairsNegativeTestJSON-1356788530-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 409 len: 104 microversion: 2.1 time: 1.227969 Oct 08 20:54:37.786379 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 416/886] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Oct 8 20:54:36 2022] POST /compute/v2.1/os-keypairs => generated 104 bytes in 1230 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 08 20:54:37.794701 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-bc7650a8-3ae2-43ec-a541-0d5f2b8fa980 req-80bad153-a382-44a0-870c-6bf6ecac9810 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84eba001-0fa3-4fb7-b74e-0bb54c527ac7", "tag": "80190695-6264-463b-85c7-626419e89ee2"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:54:37.810255 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-bc7650a8-3ae2-43ec-a541-0d5f2b8fa980 req-80bad153-a382-44a0-870c-6bf6ecac9810 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:37.810998 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-bc7650a8-3ae2-43ec-a541-0d5f2b8fa980 req-80bad153-a382-44a0-870c-6bf6ecac9810 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:37.811594 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-bc7650a8-3ae2-43ec-a541-0d5f2b8fa980 req-80bad153-a382-44a0-870c-6bf6ecac9810 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:37.839218 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-bc7650a8-3ae2-43ec-a541-0d5f2b8fa980 req-80bad153-a382-44a0-870c-6bf6ecac9810 service nova] Creating event network-changed:80190695-6264-463b-85c7-626419e89ee2 for instance 84eba001-0fa3-4fb7-b74e-0bb54c527ac7 on nch2-master-1 Oct 08 20:54:37.850376 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-bc7650a8-3ae2-43ec-a541-0d5f2b8fa980 req-80bad153-a382-44a0-870c-6bf6ecac9810 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061342 Oct 08 20:54:37.851739 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 417/887] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:54:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:54:37.867531 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-db4d1b79-0396-4e19-aa17-51168d136b39 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:37.869950 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-db4d1b79-0396-4e19-aa17-51168d136b39 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] [instance: 92e31b92-0af1-4da6-bc87-23978f1aedf5] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:37.889815 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-db4d1b79-0396-4e19-aa17-51168d136b39 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:37.890437 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-db4d1b79-0396-4e19-aa17-51168d136b39 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:37.891051 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-db4d1b79-0396-4e19-aa17-51168d136b39 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:37.891909 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-db4d1b79-0396-4e19-aa17-51168d136b39 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:37.893752 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-db4d1b79-0396-4e19-aa17-51168d136b39 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:37.893752 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-db4d1b79-0396-4e19-aa17-51168d136b39 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:38.084237 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-db4d1b79-0396-4e19-aa17-51168d136b39 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:38.100677 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-db4d1b79-0396-4e19-aa17-51168d136b39 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:38.103566 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-db4d1b79-0396-4e19-aa17-51168d136b39 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:38.123928 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-db4d1b79-0396-4e19-aa17-51168d136b39 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] 10.222.0.26 "GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5" status: 200 len: 1555 microversion: 2.91 time: 0.270517 Oct 08 20:54:38.124865 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 418/888] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:54:37 2022] GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5 => generated 1555 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:54:38.158375 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-b4e05f8f-e3a5-4fd7-9cc2-44f770a1a2fe tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Calling method '.version_select at 0x7f1a8cc37280>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:38.208571 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-fd443d4c-9704-4c08-94a0-8d1f4ae1b117 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98936da9b5d94165b386d2d0893ac142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2441394d754f499e27f6f35d5b3afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:38.217960 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-fd443d4c-9704-4c08-94a0-8d1f4ae1b117 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] 10.222.0.26 "GET /compute/v2.1/servers/84eba001-0fa3-4fb7-b74e-0bb54c527ac7" status: 200 len: 1589 microversion: 2.1 time: 0.502537 Oct 08 20:54:38.221666 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 471/889] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:54:37 2022] GET /compute/v2.1/servers/84eba001-0fa3-4fb7-b74e-0bb54c527ac7 => generated 1589 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:54:38.230741 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-bd4cf4e3-37f0-44a5-b0a0-b087a1e13c0a tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:38.234041 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-bd4cf4e3-37f0-44a5-b0a0-b087a1e13c0a tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] [instance: f04fdc43-98fc-4bfc-a0f6-6efb9d2ee5bc] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:38.245950 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bd4cf4e3-37f0-44a5-b0a0-b087a1e13c0a tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:38.250120 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bd4cf4e3-37f0-44a5-b0a0-b087a1e13c0a tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:38.250753 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bd4cf4e3-37f0-44a5-b0a0-b087a1e13c0a tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:38.255115 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bd4cf4e3-37f0-44a5-b0a0-b087a1e13c0a tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:38.255911 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bd4cf4e3-37f0-44a5-b0a0-b087a1e13c0a tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:38.256533 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bd4cf4e3-37f0-44a5-b0a0-b087a1e13c0a tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:38.336292 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-b4e05f8f-e3a5-4fd7-9cc2-44f770a1a2fe tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] 10.222.0.26 "GET /compute/v2.1/images/32cf58a9-c0a6-4bd8-a2e3-6f135fa2a033" status: 200 len: 662 microversion: 2.1 time: 0.196427 Oct 08 20:54:38.336895 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 419/890] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:54:38 2022] GET /compute/v2.1/images/32cf58a9-c0a6-4bd8-a2e3-6f135fa2a033 => generated 662 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:54:38.362406 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-1682913f-20c7-4d1a-bf68-8c92d1506be3 tempest-KeyPairsNegativeTestJSON-1356788530 tempest-KeyPairsNegativeTestJSON-1356788530-project] Calling method '.version_select at 0x7f1a8cc3b670>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:38.421768 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-1682913f-20c7-4d1a-bf68-8c92d1506be3 tempest-KeyPairsNegativeTestJSON-1356788530 tempest-KeyPairsNegativeTestJSON-1356788530-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-755205364" status: 202 len: 0 microversion: 2.1 time: 0.071999 Oct 08 20:54:38.422538 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 420/891] 10.222.0.26 () {58 vars in 1218 bytes} [Sat Oct 8 20:54:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-755205364 => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 20:54:38.436498 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-aff6fcce-4cbb-4319-b2c4-594335a1d404 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:38.437460 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-aff6fcce-4cbb-4319-b2c4-594335a1d404 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] [instance: 73fd15ea-e4bd-4310-93bb-147b0a5e27ef] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:38.455527 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-aff6fcce-4cbb-4319-b2c4-594335a1d404 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:38.456815 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-aff6fcce-4cbb-4319-b2c4-594335a1d404 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:38.461071 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-aff6fcce-4cbb-4319-b2c4-594335a1d404 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:38.462393 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-aff6fcce-4cbb-4319-b2c4-594335a1d404 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:38.463217 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-aff6fcce-4cbb-4319-b2c4-594335a1d404 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:38.464495 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-aff6fcce-4cbb-4319-b2c4-594335a1d404 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:38.567119 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-bd4cf4e3-37f0-44a5-b0a0-b087a1e13c0a tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:38.576650 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-bd4cf4e3-37f0-44a5-b0a0-b087a1e13c0a tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:38.584132 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-bd4cf4e3-37f0-44a5-b0a0-b087a1e13c0a tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:38.591587 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-bd4cf4e3-37f0-44a5-b0a0-b087a1e13c0a tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] 10.222.0.26 "GET /compute/v2.1/servers/f04fdc43-98fc-4bfc-a0f6-6efb9d2ee5bc" status: 200 len: 1362 microversion: 2.25 time: 0.364558 Oct 08 20:54:38.601888 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 472/892] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:54:38 2022] GET /compute/v2.1/servers/f04fdc43-98fc-4bfc-a0f6-6efb9d2ee5bc => generated 1362 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:54:38.630835 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-628c66d2-bdf0-44fd-bdc4-ea08b4f60abf tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:38.631862 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-628c66d2-bdf0-44fd-bdc4-ea08b4f60abf tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] [instance: a80fbf87-8203-4e6c-bee7-fe781bfccff1] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:38.674149 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-628c66d2-bdf0-44fd-bdc4-ea08b4f60abf tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:38.675154 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-628c66d2-bdf0-44fd-bdc4-ea08b4f60abf tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:38.676437 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-628c66d2-bdf0-44fd-bdc4-ea08b4f60abf tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:38.683063 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-628c66d2-bdf0-44fd-bdc4-ea08b4f60abf tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:38.683824 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-628c66d2-bdf0-44fd-bdc4-ea08b4f60abf tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:38.684496 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-628c66d2-bdf0-44fd-bdc4-ea08b4f60abf tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:39.016144 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-628c66d2-bdf0-44fd-bdc4-ea08b4f60abf tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474ca64d1b1d4e30916b517645aba882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecc2dd2407b4819874bed09cb27959a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:39.030222 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-628c66d2-bdf0-44fd-bdc4-ea08b4f60abf tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] 10.222.0.26 "GET /compute/v2.1/servers/a80fbf87-8203-4e6c-bee7-fe781bfccff1" status: 200 len: 1505 microversion: 2.1 time: 0.426715 Oct 08 20:54:39.031128 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 473/893] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:54:38 2022] GET /compute/v2.1/servers/a80fbf87-8203-4e6c-bee7-fe781bfccff1 => generated 1505 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:54:39.043290 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-d4decbf1-49d2-49db-a92e-b2e1edfeb464 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Calling method '.version_select at 0x7f1a8df87f70>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:39.130725 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-d4decbf1-49d2-49db-a92e-b2e1edfeb464 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] 10.222.0.26 "GET /compute/v2.1/images/32cf58a9-c0a6-4bd8-a2e3-6f135fa2a033" status: 200 len: 662 microversion: 2.1 time: 0.098453 Oct 08 20:54:39.131562 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 474/894] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:54:39 2022] GET /compute/v2.1/images/32cf58a9-c0a6-4bd8-a2e3-6f135fa2a033 => generated 662 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:54:39.143464 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-c75311bb-51e7-4c13-94c0-297b7c689c58 tempest-KeyPairsNegativeTestJSON-1356788530 tempest-KeyPairsNegativeTestJSON-1356788530-project] Action: 'create', calling method: .version_select at 0x7f1a8c8431f0>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPbE3c/JE7RHUvGIPhj+TBHFSVtcKnlA5ZY0X4K7bCCQYKYasrpHu16Wpna5osX0W97bbTxXlGtFZb4SOIC3n/oYyaeTvz+PaGWrAJrMt7UMwAKwcoBJucWlFnWZK+VhxQ=="}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:54:39.150008 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-c75311bb-51e7-4c13-94c0-297b7c689c58 tempest-KeyPairsNegativeTestJSON-1356788530 tempest-KeyPairsNegativeTestJSON-1356788530-project] Request method failure captured: Oct 08 20:54:39.150008 ncdv-master-1 devstack@n-api.service[140492]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 08 20:54:39.150008 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 20:54:39.150008 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 20:54:39.150008 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 20:54:39.150008 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 247 Oct 08 20:54:39.150008 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 20:54:39.150008 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 20:54:39.150008 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 20:54:39.150008 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 20:54:39.150008 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeOLqfKYk8k9aFqgCs_66NyY_V8hl2ei378qAtRiQt3pvdRTO1ONE8ZBP1_OJo7yoIxEbk8MQGMiv8G3PTcwEVW0pM7g75wkqPPcYBTYxTBBDOQMl1oE_6L1RairjVGKT8QH5xuUVsxl3nVcHAYqvm98voQd6UnvE4BRsHMXW85Tcb8 Oct 08 20:54:39.150008 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 20:54:39.150008 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 20:54:39.150008 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 20:54:39.150008 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 20:54:39.150008 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 20:54:39.150008 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 20:54:39.150008 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 1c784548feb8459fa303989fe3fbc9f2 Oct 08 20:54:39.150008 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1356788530 Oct 08 20:54:39.150008 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 20:54:39.150008 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 20:54:39.150008 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1c784548feb8459fa303989fe3fbc9f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1c784548feb8459fa303989fe3fbc9f2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1c784548feb8459fa303989fe3fbc9f2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1c784548feb8459fa303989fe3fbc9f2"}]}] Oct 08 20:54:39.150008 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1356788530 Oct 08 20:54:39.150008 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 1c784548feb8459fa303989fe3fbc9f2 Oct 08 20:54:39.150008 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1356788530 Oct 08 20:54:39.150008 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-KeyPairsNegativeTestJSON-1356788530-project Oct 08 20:54:39.150008 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 20:54:39.150008 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 20:54:39.150008 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 294063d975784298b250340c0a820c24 Oct 08 20:54:39.150008 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1356788530-project Oct 08 20:54:39.150008 ncdv-master-1 devstack@n-api.service[140492]: Oct 08 20:54:39.150008 ncdv-master-1 devstack@n-api.service[140492]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPbE3c/JE7RHUvGIPhj+TBHFSVtcKnlA5ZY0X4K7bCCQYKYasrpHu16Wpna5osX0W97bbTxXlGtFZb4SOIC3n/oYyaeTvz+PaGWrAJrMt7UMwAKwcoBJucWlFnWZK+VhxQ=="}} Oct 08 20:54:39.150008 ncdv-master-1 devstack@n-api.service[140492]: method: Oct 08 20:54:39.150008 ncdv-master-1 devstack@n-api.service[140492]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 08 20:54:39.150008 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPbE3c/JE7RHUvGIPhj+TBHFSVtcKnlA5ZY0X4K7bCCQYKYasrpHu16Wpna5osX0W97bbTxXlGtFZb4SOIC3n/oYyaeTvz+PaGWrAJrMt7UMwAKwcoBJucWlFnWZK+VhxQ=='}}} Oct 08 20:54:39.150008 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:54:39.150008 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:54:39.150008 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 08 20:54:39.150008 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 08 20:54:39.150008 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 08 20:54:39.150008 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise error Oct 08 20:54:39.150008 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 08 20:54:39.150008 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:54:39.150008 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Oct 08 20:54:39.150008 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 08 20:54:39.150008 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:54:39.150008 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi On instance['keypair']: Oct 08 20:54:39.150008 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi '' Oct 08 20:54:39.150008 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:54:39.150008 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:54:39.150008 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:54:39.150008 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:54:39.150008 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:54:39.150008 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:54:39.150008 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:54:39.150008 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:54:39.150008 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 08 20:54:39.150008 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 08 20:54:39.150008 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:54:39.150008 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:54:39.150008 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 20:54:39.150008 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 20:54:39.150008 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 08 20:54:39.150008 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 08 20:54:39.155359 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 08 20:54:39.155359 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 08 20:54:39.155359 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 08 20:54:39.155359 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 08 20:54:39.155359 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 08 20:54:39.155359 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:54:39.155359 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:54:39.155359 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:54:39.155359 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:54:39.155359 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:54:39.155359 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:54:39.155359 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 08 20:54:39.155359 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 08 20:54:39.155359 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 08 20:54:39.155359 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:54:39.166438 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-c75311bb-51e7-4c13-94c0-297b7c689c58 tempest-KeyPairsNegativeTestJSON-1356788530 tempest-KeyPairsNegativeTestJSON-1356788530-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:54:39.167576 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-c75311bb-51e7-4c13-94c0-297b7c689c58 tempest-KeyPairsNegativeTestJSON-1356788530 tempest-KeyPairsNegativeTestJSON-1356788530-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.034957 Oct 08 20:54:39.171113 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 475/895] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Oct 8 20:54:39 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 39 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 08 20:54:39.184355 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-42c1dd69-beca-48af-b131-91f381bff9a0 req-a659663f-487a-4ff1-bc8f-9da15be12f8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f04fdc43-98fc-4bfc-a0f6-6efb9d2ee5bc", "name": "network-vif-plugged", "status": "completed", "tag": "84bc0e3e-26ae-44e6-9044-9b319506b2ff"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:54:39.197793 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-aff6fcce-4cbb-4319-b2c4-594335a1d404 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef659f5a1a24c439528a7675bdd70f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c92fe04ab8248399d0acb932f82d607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:39.211627 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-42c1dd69-beca-48af-b131-91f381bff9a0 req-a659663f-487a-4ff1-bc8f-9da15be12f8e service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:39.213113 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-42c1dd69-beca-48af-b131-91f381bff9a0 req-a659663f-487a-4ff1-bc8f-9da15be12f8e service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:39.214126 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-aff6fcce-4cbb-4319-b2c4-594335a1d404 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] 10.222.0.26 "GET /compute/v2.1/servers/73fd15ea-e4bd-4310-93bb-147b0a5e27ef" status: 200 len: 1471 microversion: 2.1 time: 0.787227 Oct 08 20:54:39.214543 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-42c1dd69-beca-48af-b131-91f381bff9a0 req-a659663f-487a-4ff1-bc8f-9da15be12f8e service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:39.217699 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 421/896] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:54:38 2022] GET /compute/v2.1/servers/73fd15ea-e4bd-4310-93bb-147b0a5e27ef => generated 1471 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:54:39.229781 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-1036db76-f32c-4c39-9a34-33a63394915d tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:39.231425 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-1036db76-f32c-4c39-9a34-33a63394915d tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] [instance: 92e31b92-0af1-4da6-bc87-23978f1aedf5] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:39.251035 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1036db76-f32c-4c39-9a34-33a63394915d tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:39.251467 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-42c1dd69-beca-48af-b131-91f381bff9a0 req-a659663f-487a-4ff1-bc8f-9da15be12f8e service nova] Creating event network-vif-plugged:84bc0e3e-26ae-44e6-9044-9b319506b2ff for instance f04fdc43-98fc-4bfc-a0f6-6efb9d2ee5bc on nch1-master-1 Oct 08 20:54:39.252186 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1036db76-f32c-4c39-9a34-33a63394915d tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:39.253725 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1036db76-f32c-4c39-9a34-33a63394915d tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:39.256483 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1036db76-f32c-4c39-9a34-33a63394915d tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:39.257676 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1036db76-f32c-4c39-9a34-33a63394915d tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:39.259642 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1036db76-f32c-4c39-9a34-33a63394915d tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:39.269959 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-42c1dd69-beca-48af-b131-91f381bff9a0 req-a659663f-487a-4ff1-bc8f-9da15be12f8e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091372 Oct 08 20:54:39.271582 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 476/897] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:54:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:54:39.287176 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-92f9a524-b17b-4912-ab1c-6a05aa525e92 tempest-KeyPairsNegativeTestJSON-1356788530 tempest-KeyPairsNegativeTestJSON-1356788530-project] Action: 'create', calling method: .version_select at 0x7f1a8c843430>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1269950873", "public_key": " "}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:54:39.305091 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:54:39.335049 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-92f9a524-b17b-4912-ab1c-6a05aa525e92 tempest-KeyPairsNegativeTestJSON-1356788530 tempest-KeyPairsNegativeTestJSON-1356788530-project] Getting quotas for project 1c784548feb8459fa303989fe3fbc9f2. Resources: {'key_pairs'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 20:54:39.346632 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-92f9a524-b17b-4912-ab1c-6a05aa525e92 tempest-KeyPairsNegativeTestJSON-1356788530 tempest-KeyPairsNegativeTestJSON-1356788530-project] Getting quotas for user 294063d975784298b250340c0a820c24 and project 1c784548feb8459fa303989fe3fbc9f2. Resources: {'key_pairs'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 20:54:39.368482 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-1036db76-f32c-4c39-9a34-33a63394915d tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:39.382007 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-1036db76-f32c-4c39-9a34-33a63394915d tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:39.387632 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-1036db76-f32c-4c39-9a34-33a63394915d tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:39.390758 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-92f9a524-b17b-4912-ab1c-6a05aa525e92 tempest-KeyPairsNegativeTestJSON-1356788530 tempest-KeyPairsNegativeTestJSON-1356788530-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 08 20:54:39.397971 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-92f9a524-b17b-4912-ab1c-6a05aa525e92 tempest-KeyPairsNegativeTestJSON-1356788530 tempest-KeyPairsNegativeTestJSON-1356788530-project] Request method failure captured: Oct 08 20:54:39.397971 ncdv-master-1 devstack@n-api.service[140492]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 08 20:54:39.397971 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 20:54:39.397971 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 20:54:39.397971 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 20:54:39.397971 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 95 Oct 08 20:54:39.397971 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 20:54:39.397971 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 20:54:39.397971 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 20:54:39.397971 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 20:54:39.397971 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeOLqfKYk8k9aFqgCs_66NyY_V8hl2ei378qAtRiQt3pvdRTO1ONE8ZBP1_OJo7yoIxEbk8MQGMiv8G3PTcwEVW0pM7g75wkqPPcYBTYxTBBDOQMl1oE_6L1RairjVGKT8QH5xuUVsxl3nVcHAYqvm98voQd6UnvE4BRsHMXW85Tcb8 Oct 08 20:54:39.397971 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 20:54:39.397971 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 20:54:39.397971 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 20:54:39.397971 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 20:54:39.397971 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 20:54:39.397971 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 20:54:39.397971 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 1c784548feb8459fa303989fe3fbc9f2 Oct 08 20:54:39.397971 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1356788530 Oct 08 20:54:39.397971 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 20:54:39.397971 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 20:54:39.397971 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1c784548feb8459fa303989fe3fbc9f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1c784548feb8459fa303989fe3fbc9f2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1c784548feb8459fa303989fe3fbc9f2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1c784548feb8459fa303989fe3fbc9f2"}]}] Oct 08 20:54:39.397971 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1356788530 Oct 08 20:54:39.397971 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 1c784548feb8459fa303989fe3fbc9f2 Oct 08 20:54:39.397971 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1356788530 Oct 08 20:54:39.397971 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-KeyPairsNegativeTestJSON-1356788530-project Oct 08 20:54:39.397971 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 20:54:39.397971 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 20:54:39.397971 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 294063d975784298b250340c0a820c24 Oct 08 20:54:39.397971 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1356788530-project Oct 08 20:54:39.397971 ncdv-master-1 devstack@n-api.service[140492]: Oct 08 20:54:39.397971 ncdv-master-1 devstack@n-api.service[140492]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1269950873", "public_key": " "}} Oct 08 20:54:39.397971 ncdv-master-1 devstack@n-api.service[140492]: method: Oct 08 20:54:39.397971 ncdv-master-1 devstack@n-api.service[140492]: exception: Keypair data is invalid: failed to generate fingerprint Oct 08 20:54:39.397971 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1269950873', 'public_key': ' '}}} Oct 08 20:54:39.397971 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:54:39.397971 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:54:39.397971 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 08 20:54:39.397971 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 08 20:54:39.397971 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Oct 08 20:54:39.397971 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Oct 08 20:54:39.397971 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Oct 08 20:54:39.397971 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:54:39.397971 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:54:39.397971 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:54:39.397971 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:54:39.397971 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 08 20:54:39.397971 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 08 20:54:39.397971 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 08 20:54:39.397971 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 08 20:54:39.397971 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 08 20:54:39.397971 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 08 20:54:39.397971 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 08 20:54:39.397971 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise self.value Oct 08 20:54:39.397971 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 08 20:54:39.397971 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 08 20:54:39.397971 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 08 20:54:39.397971 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 08 20:54:39.397971 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 08 20:54:39.397971 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 08 20:54:39.397971 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 08 20:54:39.397971 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 08 20:54:39.397971 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 08 20:54:39.397971 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:54:39.397971 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:54:39.397971 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:54:39.402183 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:54:39.402183 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:54:39.402183 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:54:39.402183 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:54:39.402183 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:54:39.402183 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 08 20:54:39.402183 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 08 20:54:39.402183 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:54:39.402183 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:54:39.402183 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 20:54:39.402183 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 20:54:39.402183 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 20:54:39.402183 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 20:54:39.402183 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 08 20:54:39.402183 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 08 20:54:39.402183 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 08 20:54:39.402183 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 08 20:54:39.402183 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 08 20:54:39.402183 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:54:39.402183 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:54:39.402183 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:54:39.402183 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:54:39.402183 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:54:39.402183 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:54:39.402183 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 20:54:39.402183 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 20:54:39.402183 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 08 20:54:39.402183 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:54:39.402183 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-92f9a524-b17b-4912-ab1c-6a05aa525e92 tempest-KeyPairsNegativeTestJSON-1356788530 tempest-KeyPairsNegativeTestJSON-1356788530-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:54:39.402183 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-92f9a524-b17b-4912-ab1c-6a05aa525e92 tempest-KeyPairsNegativeTestJSON-1356788530 tempest-KeyPairsNegativeTestJSON-1356788530-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.127627 Oct 08 20:54:39.409289 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 477/898] 10.222.0.26 () {60 vars in 1158 bytes} [Sat Oct 8 20:54:39 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 137 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 08 20:54:39.415145 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-1036db76-f32c-4c39-9a34-33a63394915d tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] 10.222.0.26 "GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5" status: 200 len: 1555 microversion: 2.91 time: 0.195843 Oct 08 20:54:39.415983 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 422/899] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:54:39 2022] GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5 => generated 1555 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:54:39.417225 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-36d69aff-bbd9-43b9-82e6-0bb17e790317 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-736293180", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:54:39.433077 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-e0ccf403-8d71-4e24-83ca-631f963d5bb7 tempest-KeyPairsNegativeTestJSON-1356788530 tempest-KeyPairsNegativeTestJSON-1356788530-project] Action: 'create', calling method: .version_select at 0x7f1a8cc3b8b0>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD8zyFRYVRbNwfwFOr3CiWgX0tLlwpOiHeAN9QcErBD1Jqgytsxb2CLqIzZgiDbqDZnKkEjzt5JsFal7fzu8eVzL0slzUPRM8hLy7Fexgor+J7wfgesNL7SPGDjfIobxVw=="}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:54:39.437685 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-e0ccf403-8d71-4e24-83ca-631f963d5bb7 tempest-KeyPairsNegativeTestJSON-1356788530 tempest-KeyPairsNegativeTestJSON-1356788530-project] Request method failure captured: Oct 08 20:54:39.437685 ncdv-master-1 devstack@n-api.service[140491]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 08 20:54:39.437685 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 20:54:39.437685 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 20:54:39.437685 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 20:54:39.437685 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 507 Oct 08 20:54:39.437685 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 20:54:39.437685 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 20:54:39.437685 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 20:54:39.437685 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 20:54:39.437685 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeOLqfKYk8k9aFqgCs_66NyY_V8hl2ei378qAtRiQt3pvdRTO1ONE8ZBP1_OJo7yoIxEbk8MQGMiv8G3PTcwEVW0pM7g75wkqPPcYBTYxTBBDOQMl1oE_6L1RairjVGKT8QH5xuUVsxl3nVcHAYqvm98voQd6UnvE4BRsHMXW85Tcb8 Oct 08 20:54:39.437685 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 20:54:39.437685 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 20:54:39.437685 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 20:54:39.437685 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 20:54:39.437685 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 20:54:39.437685 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 20:54:39.437685 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 1c784548feb8459fa303989fe3fbc9f2 Oct 08 20:54:39.437685 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1356788530 Oct 08 20:54:39.437685 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 20:54:39.437685 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 20:54:39.437685 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1c784548feb8459fa303989fe3fbc9f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1c784548feb8459fa303989fe3fbc9f2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1c784548feb8459fa303989fe3fbc9f2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1c784548feb8459fa303989fe3fbc9f2"}]}] Oct 08 20:54:39.437685 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1356788530 Oct 08 20:54:39.437685 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 1c784548feb8459fa303989fe3fbc9f2 Oct 08 20:54:39.437685 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1356788530 Oct 08 20:54:39.437685 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-KeyPairsNegativeTestJSON-1356788530-project Oct 08 20:54:39.437685 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 20:54:39.437685 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 20:54:39.437685 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 294063d975784298b250340c0a820c24 Oct 08 20:54:39.437685 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1356788530-project Oct 08 20:54:39.437685 ncdv-master-1 devstack@n-api.service[140491]: Oct 08 20:54:39.437685 ncdv-master-1 devstack@n-api.service[140491]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD8zyFRYVRbNwfwFOr3CiWgX0tLlwpOiHeAN9QcErBD1Jqgytsxb2CLqIzZgiDbqDZnKkEjzt5JsFal7fzu8eVzL0slzUPRM8hLy7Fexgor+J7wfgesNL7SPGDjfIobxVw=="}} Oct 08 20:54:39.437685 ncdv-master-1 devstack@n-api.service[140491]: method: Oct 08 20:54:39.437685 ncdv-master-1 devstack@n-api.service[140491]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 08 20:54:39.437685 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD8zyFRYVRbNwfwFOr3CiWgX0tLlwpOiHeAN9QcErBD1Jqgytsxb2CLqIzZgiDbqDZnKkEjzt5JsFal7fzu8eVzL0slzUPRM8hLy7Fexgor+J7wfgesNL7SPGDjfIobxVw=='}}} Oct 08 20:54:39.437685 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:54:39.437685 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:54:39.437685 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 08 20:54:39.437685 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 08 20:54:39.437685 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 08 20:54:39.437685 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise error Oct 08 20:54:39.437685 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 08 20:54:39.437685 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:54:39.437685 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Oct 08 20:54:39.437685 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 08 20:54:39.437685 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:54:39.437685 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi On instance['keypair']: Oct 08 20:54:39.437685 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Oct 08 20:54:39.440884 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:54:39.440884 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:54:39.440884 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:54:39.440884 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:54:39.440884 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:54:39.440884 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:54:39.440884 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:54:39.440884 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:54:39.440884 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 08 20:54:39.440884 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 08 20:54:39.440884 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:54:39.440884 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:54:39.440884 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 20:54:39.440884 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 20:54:39.440884 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 08 20:54:39.440884 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 08 20:54:39.440884 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 08 20:54:39.440884 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 08 20:54:39.440884 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 08 20:54:39.440884 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 08 20:54:39.440884 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 08 20:54:39.440884 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:54:39.440884 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:54:39.440884 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:54:39.440884 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:54:39.440884 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:54:39.440884 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:54:39.440884 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 08 20:54:39.440884 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 08 20:54:39.440884 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 08 20:54:39.440884 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:54:39.454407 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-e0ccf403-8d71-4e24-83ca-631f963d5bb7 tempest-KeyPairsNegativeTestJSON-1356788530 tempest-KeyPairsNegativeTestJSON-1356788530-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:54:39.455582 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-e0ccf403-8d71-4e24-83ca-631f963d5bb7 tempest-KeyPairsNegativeTestJSON-1356788530 tempest-KeyPairsNegativeTestJSON-1356788530-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.033330 Oct 08 20:54:39.456654 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 423/900] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Oct 8 20:54:39 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 08 20:54:39.466136 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-d766a6cf-4e46-493e-ad5d-4372340782c1 tempest-KeyPairsNegativeTestJSON-1356788530 tempest-KeyPairsNegativeTestJSON-1356788530-project] Action: 'create', calling method: .version_select at 0x7f1a8ca9a8b0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-199117429", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:54:39.549879 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-d766a6cf-4e46-493e-ad5d-4372340782c1 tempest-KeyPairsNegativeTestJSON-1356788530 tempest-KeyPairsNegativeTestJSON-1356788530-project] Getting quotas for project 1c784548feb8459fa303989fe3fbc9f2. Resources: {'key_pairs'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 20:54:39.553781 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.network.neutron [None req-36d69aff-bbd9-43b9-82e6-0bb17e790317 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] validate_networks() for None {{(pid=140492) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 20:54:39.563684 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-d766a6cf-4e46-493e-ad5d-4372340782c1 tempest-KeyPairsNegativeTestJSON-1356788530 tempest-KeyPairsNegativeTestJSON-1356788530-project] Getting quotas for user 294063d975784298b250340c0a820c24 and project 1c784548feb8459fa303989fe3fbc9f2. Resources: {'key_pairs'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 20:54:39.595901 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-d766a6cf-4e46-493e-ad5d-4372340782c1 tempest-KeyPairsNegativeTestJSON-1356788530 tempest-KeyPairsNegativeTestJSON-1356788530-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 08 20:54:39.598763 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-d766a6cf-4e46-493e-ad5d-4372340782c1 tempest-KeyPairsNegativeTestJSON-1356788530 tempest-KeyPairsNegativeTestJSON-1356788530-project] Request method failure captured: Oct 08 20:54:39.598763 ncdv-master-1 devstack@n-api.service[140491]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 08 20:54:39.598763 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 20:54:39.598763 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 20:54:39.598763 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 20:54:39.598763 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 117 Oct 08 20:54:39.598763 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 20:54:39.598763 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 20:54:39.598763 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 20:54:39.598763 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 20:54:39.598763 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeOLqfKYk8k9aFqgCs_66NyY_V8hl2ei378qAtRiQt3pvdRTO1ONE8ZBP1_OJo7yoIxEbk8MQGMiv8G3PTcwEVW0pM7g75wkqPPcYBTYxTBBDOQMl1oE_6L1RairjVGKT8QH5xuUVsxl3nVcHAYqvm98voQd6UnvE4BRsHMXW85Tcb8 Oct 08 20:54:39.598763 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 20:54:39.598763 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 20:54:39.598763 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 20:54:39.598763 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 20:54:39.598763 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 20:54:39.598763 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 20:54:39.598763 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 1c784548feb8459fa303989fe3fbc9f2 Oct 08 20:54:39.598763 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1356788530 Oct 08 20:54:39.598763 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 20:54:39.598763 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 20:54:39.598763 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1c784548feb8459fa303989fe3fbc9f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1c784548feb8459fa303989fe3fbc9f2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1c784548feb8459fa303989fe3fbc9f2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1c784548feb8459fa303989fe3fbc9f2"}]}] Oct 08 20:54:39.598763 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1356788530 Oct 08 20:54:39.598763 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 1c784548feb8459fa303989fe3fbc9f2 Oct 08 20:54:39.598763 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1356788530 Oct 08 20:54:39.598763 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-KeyPairsNegativeTestJSON-1356788530-project Oct 08 20:54:39.598763 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 20:54:39.598763 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 20:54:39.598763 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 294063d975784298b250340c0a820c24 Oct 08 20:54:39.598763 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1356788530-project Oct 08 20:54:39.598763 ncdv-master-1 devstack@n-api.service[140491]: Oct 08 20:54:39.598763 ncdv-master-1 devstack@n-api.service[140491]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-199117429", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Oct 08 20:54:39.598763 ncdv-master-1 devstack@n-api.service[140491]: method: Oct 08 20:54:39.598763 ncdv-master-1 devstack@n-api.service[140491]: exception: Keypair data is invalid: failed to generate fingerprint Oct 08 20:54:39.598763 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-199117429', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Oct 08 20:54:39.598763 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:54:39.598763 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:54:39.598763 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 08 20:54:39.598763 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 08 20:54:39.598763 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Oct 08 20:54:39.598763 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Oct 08 20:54:39.598763 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Oct 08 20:54:39.598763 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Oct 08 20:54:39.598763 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Oct 08 20:54:39.598763 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Oct 08 20:54:39.598763 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Oct 08 20:54:39.598763 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:54:39.598763 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:54:39.598763 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:54:39.598763 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:54:39.598763 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 08 20:54:39.598763 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 08 20:54:39.598763 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 08 20:54:39.598763 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 08 20:54:39.598763 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 08 20:54:39.598763 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 08 20:54:39.598763 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 08 20:54:39.598763 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise self.value Oct 08 20:54:39.598763 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 08 20:54:39.598763 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 08 20:54:39.598763 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 08 20:54:39.598763 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 08 20:54:39.598763 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 08 20:54:39.598763 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 08 20:54:39.602673 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 08 20:54:39.602673 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 08 20:54:39.602673 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 08 20:54:39.602673 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:54:39.602673 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:54:39.602673 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:54:39.602673 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:54:39.602673 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:54:39.602673 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:54:39.602673 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:54:39.602673 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:54:39.602673 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 08 20:54:39.602673 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 08 20:54:39.602673 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:54:39.602673 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:54:39.602673 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 20:54:39.602673 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 20:54:39.602673 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 20:54:39.602673 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 20:54:39.602673 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 08 20:54:39.602673 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 08 20:54:39.602673 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 08 20:54:39.602673 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 08 20:54:39.602673 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 08 20:54:39.602673 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:54:39.602673 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:54:39.602673 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:54:39.602673 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:54:39.602673 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:54:39.602673 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:54:39.602673 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 20:54:39.602673 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 20:54:39.602673 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 08 20:54:39.602673 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:54:39.609819 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-d766a6cf-4e46-493e-ad5d-4372340782c1 tempest-KeyPairsNegativeTestJSON-1356788530 tempest-KeyPairsNegativeTestJSON-1356788530-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:54:39.612911 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-d766a6cf-4e46-493e-ad5d-4372340782c1 tempest-KeyPairsNegativeTestJSON-1356788530 tempest-KeyPairsNegativeTestJSON-1356788530-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.151074 Oct 08 20:54:39.614115 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 424/901] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Oct 8 20:54:39 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 153 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Oct 08 20:54:39.628692 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-dc4c7e28-8a56-4892-8f0c-294d611d8707 tempest-KeyPairsNegativeTestJSON-1356788530 tempest-KeyPairsNegativeTestJSON-1356788530-project] Calling method '.version_select at 0x7f1a8cc1dee0>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:39.665245 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-dc4c7e28-8a56-4892-8f0c-294d611d8707 tempest-KeyPairsNegativeTestJSON-1356788530 tempest-KeyPairsNegativeTestJSON-1356788530-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-939797427 not found for user 294063d975784298b250340c0a820c24 Oct 08 20:54:39.671803 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-dc4c7e28-8a56-4892-8f0c-294d611d8707 tempest-KeyPairsNegativeTestJSON-1356788530 tempest-KeyPairsNegativeTestJSON-1356788530-project] Request method failure captured: Oct 08 20:54:39.671803 ncdv-master-1 devstack@n-api.service[140491]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-939797427 HTTP/1.1 Oct 08 20:54:39.671803 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 20:54:39.671803 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 20:54:39.671803 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 20:54:39.671803 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 20:54:39.671803 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 20:54:39.671803 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 20:54:39.671803 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 20:54:39.671803 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 20:54:39.671803 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeOLqfKYk8k9aFqgCs_66NyY_V8hl2ei378qAtRiQt3pvdRTO1ONE8ZBP1_OJo7yoIxEbk8MQGMiv8G3PTcwEVW0pM7g75wkqPPcYBTYxTBBDOQMl1oE_6L1RairjVGKT8QH5xuUVsxl3nVcHAYqvm98voQd6UnvE4BRsHMXW85Tcb8 Oct 08 20:54:39.671803 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 20:54:39.671803 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 20:54:39.671803 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 20:54:39.671803 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 20:54:39.671803 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 20:54:39.671803 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 20:54:39.671803 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 1c784548feb8459fa303989fe3fbc9f2 Oct 08 20:54:39.671803 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1356788530 Oct 08 20:54:39.671803 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 20:54:39.671803 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 20:54:39.671803 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1c784548feb8459fa303989fe3fbc9f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1c784548feb8459fa303989fe3fbc9f2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1c784548feb8459fa303989fe3fbc9f2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1c784548feb8459fa303989fe3fbc9f2"}]}] Oct 08 20:54:39.671803 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1356788530 Oct 08 20:54:39.671803 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 1c784548feb8459fa303989fe3fbc9f2 Oct 08 20:54:39.671803 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1356788530 Oct 08 20:54:39.671803 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-KeyPairsNegativeTestJSON-1356788530-project Oct 08 20:54:39.671803 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 20:54:39.671803 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 20:54:39.671803 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 294063d975784298b250340c0a820c24 Oct 08 20:54:39.671803 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1356788530-project Oct 08 20:54:39.671803 ncdv-master-1 devstack@n-api.service[140491]: method: Oct 08 20:54:39.671803 ncdv-master-1 devstack@n-api.service[140491]: exception: Keypair tempest-keypair-non-existent-939797427 not found for user 294063d975784298b250340c0a820c24 Oct 08 20:54:39.671803 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': 'tempest-keypair-non-existent-939797427'} Oct 08 20:54:39.671803 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:54:39.671803 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:54:39.671803 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 170, in _delete Oct 08 20:54:39.671803 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Oct 08 20:54:39.671803 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 08 20:54:39.671803 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 08 20:54:39.671803 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 08 20:54:39.671803 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 08 20:54:39.671803 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 08 20:54:39.671803 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise self.value Oct 08 20:54:39.671803 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 08 20:54:39.671803 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 08 20:54:39.671803 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6861, in delete_key_pair Oct 08 20:54:39.671803 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Oct 08 20:54:39.671803 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6882, in get_key_pair Oct 08 20:54:39.671803 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Oct 08 20:54:39.671803 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 08 20:54:39.671803 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 08 20:54:39.671803 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Oct 08 20:54:39.671803 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Oct 08 20:54:39.671803 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Oct 08 20:54:39.671803 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Oct 08 20:54:39.671803 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 08 20:54:39.671803 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 08 20:54:39.671803 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Oct 08 20:54:39.671803 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Oct 08 20:54:39.671803 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-939797427 not found for user 294063d975784298b250340c0a820c24 Oct 08 20:54:39.671803 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:54:39.671803 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:54:39.676051 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:54:39.676051 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:54:39.676051 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:54:39.676051 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:54:39.676051 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:54:39.676051 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:54:39.676051 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 08 20:54:39.676051 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 08 20:54:39.676051 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 08 20:54:39.676051 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 20:54:39.676051 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:54:39.676051 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:54:39.676051 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 143, in delete Oct 08 20:54:39.676051 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi self._delete(req, id) Oct 08 20:54:39.676051 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 172, in _delete Oct 08 20:54:39.676051 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Oct 08 20:54:39.676051 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-939797427 not found for user 294063d975784298b250340c0a820c24 Oct 08 20:54:39.676051 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:54:39.676051 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:54:39.676051 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:54:39.676051 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:54:39.676051 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:54:39.676051 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:54:39.676051 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 20:54:39.676051 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 20:54:39.676051 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-939797427 not found for user 294063d975784298b250340c0a820c24 Oct 08 20:54:39.676051 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:54:39.676051 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-dc4c7e28-8a56-4892-8f0c-294d611d8707 tempest-KeyPairsNegativeTestJSON-1356788530 tempest-KeyPairsNegativeTestJSON-1356788530-project] Returning 404 to user: Keypair tempest-keypair-non-existent-939797427 not found for user 294063d975784298b250340c0a820c24 {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:54:39.676051 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-dc4c7e28-8a56-4892-8f0c-294d611d8707 tempest-KeyPairsNegativeTestJSON-1356788530 tempest-KeyPairsNegativeTestJSON-1356788530-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-939797427" status: 404 len: 144 microversion: 2.1 time: 0.053816 Oct 08 20:54:39.679827 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 425/902] 10.222.0.26 () {58 vars in 1257 bytes} [Sat Oct 8 20:54:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-939797427 => generated 144 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 20:54:39.708316 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-66a89fe7-cbc9-479c-aa2c-48031a7c360e tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:39.709741 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-66a89fe7-cbc9-479c-aa2c-48031a7c360e tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] [instance: f04fdc43-98fc-4bfc-a0f6-6efb9d2ee5bc] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:39.724903 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-66a89fe7-cbc9-479c-aa2c-48031a7c360e tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:39.725558 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-66a89fe7-cbc9-479c-aa2c-48031a7c360e tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:39.725899 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-66a89fe7-cbc9-479c-aa2c-48031a7c360e tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:39.726639 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-66a89fe7-cbc9-479c-aa2c-48031a7c360e tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:39.727104 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-66a89fe7-cbc9-479c-aa2c-48031a7c360e tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:39.727543 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-66a89fe7-cbc9-479c-aa2c-48031a7c360e tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:39.982928 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-36d69aff-bbd9-43b9-82e6-0bb17e790317 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Flavor limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 20:54:39.984177 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-36d69aff-bbd9-43b9-82e6-0bb17e790317 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Image limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 20:54:39.986538 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-36d69aff-bbd9-43b9-82e6-0bb17e790317 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Flavor pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 20:54:39.987501 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-36d69aff-bbd9-43b9-82e6-0bb17e790317 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Image pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 20:54:39.989329 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-36d69aff-bbd9-43b9-82e6-0bb17e790317 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 20:54:40.003333 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-36d69aff-bbd9-43b9-82e6-0bb17e790317 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:40.004163 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-36d69aff-bbd9-43b9-82e6-0bb17e790317 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:40.004869 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-36d69aff-bbd9-43b9-82e6-0bb17e790317 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:40.005871 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-36d69aff-bbd9-43b9-82e6-0bb17e790317 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:40.006533 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-36d69aff-bbd9-43b9-82e6-0bb17e790317 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:40.007461 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-36d69aff-bbd9-43b9-82e6-0bb17e790317 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:40.030529 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-66a89fe7-cbc9-479c-aa2c-48031a7c360e tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:40.030884 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-36d69aff-bbd9-43b9-82e6-0bb17e790317 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Getting quotas for project bcb3706a1680419384f4fe9660e87732. Resources: {'cores', 'instances', 'ram'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 20:54:40.038593 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:54:40.040961 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-36d69aff-bbd9-43b9-82e6-0bb17e790317 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Getting quotas for user 6bce55d7f67347aaaa4c2a687bdff183 and project bcb3706a1680419384f4fe9660e87732. Resources: {'cores', 'instances', 'ram'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 20:54:40.041840 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-66a89fe7-cbc9-479c-aa2c-48031a7c360e tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:40.043927 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-66a89fe7-cbc9-479c-aa2c-48031a7c360e tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:40.045113 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-66a89fe7-cbc9-479c-aa2c-48031a7c360e tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] 10.222.0.26 "GET /compute/v2.1/servers/f04fdc43-98fc-4bfc-a0f6-6efb9d2ee5bc" status: 200 len: 1362 microversion: 2.25 time: 0.364504 Oct 08 20:54:40.046136 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 426/903] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:54:39 2022] GET /compute/v2.1/servers/f04fdc43-98fc-4bfc-a0f6-6efb9d2ee5bc => generated 1362 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:54:40.066514 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-0a66e61e-2e11-425a-96ca-4ea05074f849 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:40.067561 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-0a66e61e-2e11-425a-96ca-4ea05074f849 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] [instance: a80fbf87-8203-4e6c-bee7-fe781bfccff1] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:40.077368 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-36d69aff-bbd9-43b9-82e6-0bb17e790317 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Going to run 1 instances... {{(pid=140492) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 20:54:40.080892 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0a66e61e-2e11-425a-96ca-4ea05074f849 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:40.081312 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-36d69aff-bbd9-43b9-82e6-0bb17e790317 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] [instance: 24300a5e-164c-4d97-9a1f-b52359c1c0d6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c508bd7f-7db9-4b2c-af7c-be54a855c355',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140492) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 20:54:40.081464 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0a66e61e-2e11-425a-96ca-4ea05074f849 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:40.085090 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0a66e61e-2e11-425a-96ca-4ea05074f849 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:40.087609 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0a66e61e-2e11-425a-96ca-4ea05074f849 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:40.088367 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0a66e61e-2e11-425a-96ca-4ea05074f849 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:40.090630 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0a66e61e-2e11-425a-96ca-4ea05074f849 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:40.167399 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-36d69aff-bbd9-43b9-82e6-0bb17e790317 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.753872 Oct 08 20:54:40.168498 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 478/904] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 20:54:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 756 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 08 20:54:40.284292 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-8e2ce655-8ac5-4fec-84c6-9ffcc6a705a2 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:40.298224 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-8e2ce655-8ac5-4fec-84c6-9ffcc6a705a2 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] [instance: 73fd15ea-e4bd-4310-93bb-147b0a5e27ef] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:40.312231 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8e2ce655-8ac5-4fec-84c6-9ffcc6a705a2 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:40.312746 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8e2ce655-8ac5-4fec-84c6-9ffcc6a705a2 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:40.313215 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8e2ce655-8ac5-4fec-84c6-9ffcc6a705a2 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:40.326950 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8e2ce655-8ac5-4fec-84c6-9ffcc6a705a2 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:40.333977 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8e2ce655-8ac5-4fec-84c6-9ffcc6a705a2 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:40.334851 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8e2ce655-8ac5-4fec-84c6-9ffcc6a705a2 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:40.858570 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-8e2ce655-8ac5-4fec-84c6-9ffcc6a705a2 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef659f5a1a24c439528a7675bdd70f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c92fe04ab8248399d0acb932f82d607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:40.869037 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-0a66e61e-2e11-425a-96ca-4ea05074f849 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474ca64d1b1d4e30916b517645aba882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecc2dd2407b4819874bed09cb27959a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:40.877038 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-8e2ce655-8ac5-4fec-84c6-9ffcc6a705a2 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] 10.222.0.26 "GET /compute/v2.1/servers/73fd15ea-e4bd-4310-93bb-147b0a5e27ef" status: 200 len: 1471 microversion: 2.1 time: 0.617987 Oct 08 20:54:40.883205 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-0a66e61e-2e11-425a-96ca-4ea05074f849 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] 10.222.0.26 "GET /compute/v2.1/servers/a80fbf87-8203-4e6c-bee7-fe781bfccff1" status: 200 len: 1505 microversion: 2.1 time: 0.823446 Oct 08 20:54:40.886312 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 427/905] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:54:40 2022] GET /compute/v2.1/servers/a80fbf87-8203-4e6c-bee7-fe781bfccff1 => generated 1505 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:54:40.893782 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-3da1c22d-0281-4889-86cc-9dd59dcfc1e3 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:40.895751 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 479/906] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:54:40 2022] GET /compute/v2.1/servers/73fd15ea-e4bd-4310-93bb-147b0a5e27ef => generated 1471 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:54:40.907780 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-0453da21-a4ee-425e-878e-46593baea0df tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-561982827", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:54:40.908849 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-3da1c22d-0281-4889-86cc-9dd59dcfc1e3 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] [instance: 92e31b92-0af1-4da6-bc87-23978f1aedf5] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:40.922812 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3da1c22d-0281-4889-86cc-9dd59dcfc1e3 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:40.929128 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3da1c22d-0281-4889-86cc-9dd59dcfc1e3 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:40.931526 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3da1c22d-0281-4889-86cc-9dd59dcfc1e3 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:40.934794 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3da1c22d-0281-4889-86cc-9dd59dcfc1e3 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:40.938092 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3da1c22d-0281-4889-86cc-9dd59dcfc1e3 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:40.939979 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3da1c22d-0281-4889-86cc-9dd59dcfc1e3 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:41.046979 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.network.neutron [None req-0453da21-a4ee-425e-878e-46593baea0df tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] validate_networks() for None {{(pid=140492) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 20:54:41.109149 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-3da1c22d-0281-4889-86cc-9dd59dcfc1e3 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:41.149447 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-3da1c22d-0281-4889-86cc-9dd59dcfc1e3 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:41.155014 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-3da1c22d-0281-4889-86cc-9dd59dcfc1e3 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:41.196041 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-3da1c22d-0281-4889-86cc-9dd59dcfc1e3 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] 10.222.0.26 "GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5" status: 200 len: 1555 microversion: 2.91 time: 0.305869 Oct 08 20:54:41.203652 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 428/907] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:54:40 2022] GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5 => generated 1555 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:54:41.227153 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-3982dad9-2274-40c0-a9df-c3a1fae2d3a8 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:41.227783 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-3982dad9-2274-40c0-a9df-c3a1fae2d3a8 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] [instance: f04fdc43-98fc-4bfc-a0f6-6efb9d2ee5bc] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:41.260764 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3982dad9-2274-40c0-a9df-c3a1fae2d3a8 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:41.261151 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3982dad9-2274-40c0-a9df-c3a1fae2d3a8 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:41.264850 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3982dad9-2274-40c0-a9df-c3a1fae2d3a8 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:41.268830 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3982dad9-2274-40c0-a9df-c3a1fae2d3a8 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:41.269561 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3982dad9-2274-40c0-a9df-c3a1fae2d3a8 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:41.269998 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3982dad9-2274-40c0-a9df-c3a1fae2d3a8 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:41.553882 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-0453da21-a4ee-425e-878e-46593baea0df tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Flavor limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 20:54:41.554311 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-0453da21-a4ee-425e-878e-46593baea0df tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Image limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 20:54:41.554792 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-0453da21-a4ee-425e-878e-46593baea0df tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Flavor pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 20:54:41.555206 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-0453da21-a4ee-425e-878e-46593baea0df tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Image pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 20:54:41.556801 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-0453da21-a4ee-425e-878e-46593baea0df tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 20:54:41.572575 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0453da21-a4ee-425e-878e-46593baea0df tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:41.573064 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0453da21-a4ee-425e-878e-46593baea0df tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:41.574384 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0453da21-a4ee-425e-878e-46593baea0df tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:41.576432 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0453da21-a4ee-425e-878e-46593baea0df tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:41.579918 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0453da21-a4ee-425e-878e-46593baea0df tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:41.582705 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0453da21-a4ee-425e-878e-46593baea0df tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:41.612233 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-0453da21-a4ee-425e-878e-46593baea0df tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Getting quotas for project bcb3706a1680419384f4fe9660e87732. Resources: {'cores', 'instances', 'ram'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 20:54:41.619919 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-0453da21-a4ee-425e-878e-46593baea0df tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Getting quotas for user 6bce55d7f67347aaaa4c2a687bdff183 and project bcb3706a1680419384f4fe9660e87732. Resources: {'cores', 'instances', 'ram'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 20:54:41.636047 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-0453da21-a4ee-425e-878e-46593baea0df tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Going to run 1 instances... {{(pid=140492) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 20:54:41.639648 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-0453da21-a4ee-425e-878e-46593baea0df tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] [instance: 0cbc3ac5-5690-4f4e-a9d1-ea0de18060b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c508bd7f-7db9-4b2c-af7c-be54a855c355',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140492) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 20:54:41.767920 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-0453da21-a4ee-425e-878e-46593baea0df tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.870903 Oct 08 20:54:41.772370 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 480/908] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 20:54:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 876 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 08 20:54:41.783632 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-7cdaf4fb-864f-4187-b2cb-8603f7bec69f tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:41.785554 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-7cdaf4fb-864f-4187-b2cb-8603f7bec69f tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] [instance: 0cbc3ac5-5690-4f4e-a9d1-ea0de18060b1] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:41.915583 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-7cdaf4fb-864f-4187-b2cb-8603f7bec69f tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bce55d7f67347aaaa4c2a687bdff183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb3706a1680419384f4fe9660e87732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:41.929338 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-7cdaf4fb-864f-4187-b2cb-8603f7bec69f tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] 10.222.0.26 "GET /compute/v2.1/servers/0cbc3ac5-5690-4f4e-a9d1-ea0de18060b1" status: 200 len: 1217 microversion: 2.1 time: 0.152600 Oct 08 20:54:41.937296 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 481/909] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:54:41 2022] GET /compute/v2.1/servers/0cbc3ac5-5690-4f4e-a9d1-ea0de18060b1 => generated 1217 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 20:54:41.952221 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-1c30873c-b1a5-43de-b293-dd169437c0ad tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:41.955810 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-1c30873c-b1a5-43de-b293-dd169437c0ad tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] [instance: 73fd15ea-e4bd-4310-93bb-147b0a5e27ef] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:41.984614 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-3982dad9-2274-40c0-a9df-c3a1fae2d3a8 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:41.986619 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1c30873c-b1a5-43de-b293-dd169437c0ad tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:41.987152 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1c30873c-b1a5-43de-b293-dd169437c0ad tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:41.987854 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1c30873c-b1a5-43de-b293-dd169437c0ad tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:41.988630 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1c30873c-b1a5-43de-b293-dd169437c0ad tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:41.998930 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1c30873c-b1a5-43de-b293-dd169437c0ad tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:41.999755 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1c30873c-b1a5-43de-b293-dd169437c0ad tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:42.000025 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-3982dad9-2274-40c0-a9df-c3a1fae2d3a8 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:42.002130 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-3982dad9-2274-40c0-a9df-c3a1fae2d3a8 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:42.003475 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-3982dad9-2274-40c0-a9df-c3a1fae2d3a8 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] 10.222.0.26 "GET /compute/v2.1/servers/f04fdc43-98fc-4bfc-a0f6-6efb9d2ee5bc" status: 200 len: 1362 microversion: 2.25 time: 0.792150 Oct 08 20:54:42.017535 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 429/910] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:54:41 2022] GET /compute/v2.1/servers/f04fdc43-98fc-4bfc-a0f6-6efb9d2ee5bc => generated 1362 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:54:42.027341 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-40f2f0bb-98a5-4e10-8f54-f333d2fba263 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:42.028247 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-40f2f0bb-98a5-4e10-8f54-f333d2fba263 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] [instance: a80fbf87-8203-4e6c-bee7-fe781bfccff1] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:42.035337 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-40f2f0bb-98a5-4e10-8f54-f333d2fba263 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:42.036391 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-40f2f0bb-98a5-4e10-8f54-f333d2fba263 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:42.037796 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-40f2f0bb-98a5-4e10-8f54-f333d2fba263 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:42.038732 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-40f2f0bb-98a5-4e10-8f54-f333d2fba263 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:42.039619 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-40f2f0bb-98a5-4e10-8f54-f333d2fba263 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:42.040324 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-40f2f0bb-98a5-4e10-8f54-f333d2fba263 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:42.307167 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-40f2f0bb-98a5-4e10-8f54-f333d2fba263 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474ca64d1b1d4e30916b517645aba882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecc2dd2407b4819874bed09cb27959a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:42.365437 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-1c30873c-b1a5-43de-b293-dd169437c0ad tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef659f5a1a24c439528a7675bdd70f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c92fe04ab8248399d0acb932f82d607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:42.377093 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-1c30873c-b1a5-43de-b293-dd169437c0ad tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] 10.222.0.26 "GET /compute/v2.1/servers/73fd15ea-e4bd-4310-93bb-147b0a5e27ef" status: 200 len: 1471 microversion: 2.1 time: 0.438413 Oct 08 20:54:42.393121 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 482/911] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:54:41 2022] GET /compute/v2.1/servers/73fd15ea-e4bd-4310-93bb-147b0a5e27ef => generated 1471 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:54:42.394283 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-40f2f0bb-98a5-4e10-8f54-f333d2fba263 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] 10.222.0.26 "GET /compute/v2.1/servers/a80fbf87-8203-4e6c-bee7-fe781bfccff1" status: 200 len: 1505 microversion: 2.1 time: 0.368344 Oct 08 20:54:42.394384 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-504c030b-7414-4c5c-a80f-d061c9b2d80e tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:42.394384 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-504c030b-7414-4c5c-a80f-d061c9b2d80e tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] [instance: 92e31b92-0af1-4da6-bc87-23978f1aedf5] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:42.407723 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 430/912] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:54:42 2022] GET /compute/v2.1/servers/a80fbf87-8203-4e6c-bee7-fe781bfccff1 => generated 1505 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:54:42.413557 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-504c030b-7414-4c5c-a80f-d061c9b2d80e tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:42.414967 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-504c030b-7414-4c5c-a80f-d061c9b2d80e tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:42.416225 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-504c030b-7414-4c5c-a80f-d061c9b2d80e tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:42.417467 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-504c030b-7414-4c5c-a80f-d061c9b2d80e tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:42.419066 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-504c030b-7414-4c5c-a80f-d061c9b2d80e tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:42.420765 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-504c030b-7414-4c5c-a80f-d061c9b2d80e tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:42.711939 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-504c030b-7414-4c5c-a80f-d061c9b2d80e tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:42.724456 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-504c030b-7414-4c5c-a80f-d061c9b2d80e tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:42.729907 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-504c030b-7414-4c5c-a80f-d061c9b2d80e tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:42.761620 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-504c030b-7414-4c5c-a80f-d061c9b2d80e tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] 10.222.0.26 "GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5" status: 200 len: 1555 microversion: 2.91 time: 0.379474 Oct 08 20:54:42.766333 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 483/913] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:54:42 2022] GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5 => generated 1555 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:54:42.958930 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-070dd140-b5c3-432e-baa5-29c306e10f76 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:42.959655 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-070dd140-b5c3-432e-baa5-29c306e10f76 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] [instance: 0cbc3ac5-5690-4f4e-a9d1-ea0de18060b1] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:42.972373 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-070dd140-b5c3-432e-baa5-29c306e10f76 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:42.976273 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-070dd140-b5c3-432e-baa5-29c306e10f76 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:42.976990 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-070dd140-b5c3-432e-baa5-29c306e10f76 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:42.977912 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-070dd140-b5c3-432e-baa5-29c306e10f76 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:42.978639 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-070dd140-b5c3-432e-baa5-29c306e10f76 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:42.979280 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-070dd140-b5c3-432e-baa5-29c306e10f76 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:43.032476 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-4f936a09-6082-4926-a36a-e7e7d19eb121 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:43.032930 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-4f936a09-6082-4926-a36a-e7e7d19eb121 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] [instance: f04fdc43-98fc-4bfc-a0f6-6efb9d2ee5bc] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:43.049045 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4f936a09-6082-4926-a36a-e7e7d19eb121 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:43.053217 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4f936a09-6082-4926-a36a-e7e7d19eb121 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:43.053914 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4f936a09-6082-4926-a36a-e7e7d19eb121 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:43.056663 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4f936a09-6082-4926-a36a-e7e7d19eb121 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:43.058057 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4f936a09-6082-4926-a36a-e7e7d19eb121 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:43.060858 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4f936a09-6082-4926-a36a-e7e7d19eb121 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:43.171361 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-070dd140-b5c3-432e-baa5-29c306e10f76 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bce55d7f67347aaaa4c2a687bdff183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb3706a1680419384f4fe9660e87732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:43.183364 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-070dd140-b5c3-432e-baa5-29c306e10f76 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] 10.222.0.26 "GET /compute/v2.1/servers/0cbc3ac5-5690-4f4e-a9d1-ea0de18060b1" status: 200 len: 1213 microversion: 2.1 time: 0.228448 Oct 08 20:54:43.184081 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 431/914] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:54:42 2022] GET /compute/v2.1/servers/0cbc3ac5-5690-4f4e-a9d1-ea0de18060b1 => generated 1213 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:54:43.329509 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-4f936a09-6082-4926-a36a-e7e7d19eb121 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:43.348495 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-4f936a09-6082-4926-a36a-e7e7d19eb121 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:43.350619 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-4f936a09-6082-4926-a36a-e7e7d19eb121 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:43.354436 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-4f936a09-6082-4926-a36a-e7e7d19eb121 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] 10.222.0.26 "GET /compute/v2.1/servers/f04fdc43-98fc-4bfc-a0f6-6efb9d2ee5bc" status: 200 len: 1558 microversion: 2.25 time: 0.326458 Oct 08 20:54:43.356573 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 484/915] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:54:43 2022] GET /compute/v2.1/servers/f04fdc43-98fc-4bfc-a0f6-6efb9d2ee5bc => generated 1558 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:54:43.388329 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-07ead580-21c3-451b-b6e9-3b3a85cf2ead tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:43.388986 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-07ead580-21c3-451b-b6e9-3b3a85cf2ead tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] [instance: f04fdc43-98fc-4bfc-a0f6-6efb9d2ee5bc] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:43.407480 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-c7690a08-c240-4e96-8801-ac59e557412b tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:43.409740 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-c7690a08-c240-4e96-8801-ac59e557412b tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] [instance: 73fd15ea-e4bd-4310-93bb-147b0a5e27ef] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:43.423064 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-07ead580-21c3-451b-b6e9-3b3a85cf2ead tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:43.423954 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-07ead580-21c3-451b-b6e9-3b3a85cf2ead tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:43.424622 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-07ead580-21c3-451b-b6e9-3b3a85cf2ead tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:43.427262 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c7690a08-c240-4e96-8801-ac59e557412b tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:43.428249 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-07ead580-21c3-451b-b6e9-3b3a85cf2ead tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:43.428908 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-07ead580-21c3-451b-b6e9-3b3a85cf2ead tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:43.430222 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-07ead580-21c3-451b-b6e9-3b3a85cf2ead tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:43.431985 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c7690a08-c240-4e96-8801-ac59e557412b tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:43.433668 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c7690a08-c240-4e96-8801-ac59e557412b tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:43.439022 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c7690a08-c240-4e96-8801-ac59e557412b tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:43.440261 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c7690a08-c240-4e96-8801-ac59e557412b tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:43.440786 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c7690a08-c240-4e96-8801-ac59e557412b tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:43.739480 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-c7690a08-c240-4e96-8801-ac59e557412b tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef659f5a1a24c439528a7675bdd70f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c92fe04ab8248399d0acb932f82d607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:43.769056 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-c7690a08-c240-4e96-8801-ac59e557412b tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] 10.222.0.26 "GET /compute/v2.1/servers/73fd15ea-e4bd-4310-93bb-147b0a5e27ef" status: 200 len: 1471 microversion: 2.1 time: 0.360623 Oct 08 20:54:43.770320 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 485/916] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:54:43 2022] GET /compute/v2.1/servers/73fd15ea-e4bd-4310-93bb-147b0a5e27ef => generated 1471 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 20:54:43.782216 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-ef8b8328-4f0f-47f9-a691-09b8a0f311d0 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:43.785247 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-ef8b8328-4f0f-47f9-a691-09b8a0f311d0 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] [instance: a80fbf87-8203-4e6c-bee7-fe781bfccff1] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:43.796107 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ef8b8328-4f0f-47f9-a691-09b8a0f311d0 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:43.797526 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ef8b8328-4f0f-47f9-a691-09b8a0f311d0 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:43.798163 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ef8b8328-4f0f-47f9-a691-09b8a0f311d0 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:43.799082 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ef8b8328-4f0f-47f9-a691-09b8a0f311d0 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:43.799720 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ef8b8328-4f0f-47f9-a691-09b8a0f311d0 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:43.800394 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ef8b8328-4f0f-47f9-a691-09b8a0f311d0 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:43.947520 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.objects.instance [None req-07ead580-21c3-451b-b6e9-3b3a85cf2ead tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Lazy-loading 'services' on Instance uuid f04fdc43-98fc-4bfc-a0f6-6efb9d2ee5bc {{(pid=140491) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 20:54:43.978899 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-07ead580-21c3-451b-b6e9-3b3a85cf2ead tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/f04fdc43-98fc-4bfc-a0f6-6efb9d2ee5bc" status: 200 len: 2051 microversion: 2.25 time: 0.592475 Oct 08 20:54:43.979793 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 432/917] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:54:43 2022] GET /compute/v2.1/servers/f04fdc43-98fc-4bfc-a0f6-6efb9d2ee5bc => generated 2051 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:54:44.142736 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-ef8b8328-4f0f-47f9-a691-09b8a0f311d0 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474ca64d1b1d4e30916b517645aba882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecc2dd2407b4819874bed09cb27959a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:44.151682 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-ef8b8328-4f0f-47f9-a691-09b8a0f311d0 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] 10.222.0.26 "GET /compute/v2.1/servers/a80fbf87-8203-4e6c-bee7-fe781bfccff1" status: 200 len: 1480 microversion: 2.1 time: 0.379506 Oct 08 20:54:44.156799 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 486/918] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:54:43 2022] GET /compute/v2.1/servers/a80fbf87-8203-4e6c-bee7-fe781bfccff1 => generated 1480 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:54:44.170596 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-3ca98063-d9ca-4684-bb7f-a279c8013c13 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:44.184517 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-3ca98063-d9ca-4684-bb7f-a279c8013c13 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] [instance: 92e31b92-0af1-4da6-bc87-23978f1aedf5] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:44.222162 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3ca98063-d9ca-4684-bb7f-a279c8013c13 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:44.223714 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3ca98063-d9ca-4684-bb7f-a279c8013c13 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:44.227116 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3ca98063-d9ca-4684-bb7f-a279c8013c13 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:44.228137 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3ca98063-d9ca-4684-bb7f-a279c8013c13 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:44.229334 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3ca98063-d9ca-4684-bb7f-a279c8013c13 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:44.238835 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3ca98063-d9ca-4684-bb7f-a279c8013c13 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:44.428942 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-a52b8500-ee06-4962-9715-ffdbde1332c7 tempest-AbsoluteLimitsTestJSON-1304729602 tempest-AbsoluteLimitsTestJSON-1304729602-project] Calling method '.version_select at 0x7f1a8ca3bd30>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:44.449491 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-3ca98063-d9ca-4684-bb7f-a279c8013c13 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:44.450361 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a52b8500-ee06-4962-9715-ffdbde1332c7 tempest-AbsoluteLimitsTestJSON-1304729602 tempest-AbsoluteLimitsTestJSON-1304729602-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:44.451238 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a52b8500-ee06-4962-9715-ffdbde1332c7 tempest-AbsoluteLimitsTestJSON-1304729602 tempest-AbsoluteLimitsTestJSON-1304729602-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:44.452395 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a52b8500-ee06-4962-9715-ffdbde1332c7 tempest-AbsoluteLimitsTestJSON-1304729602 tempest-AbsoluteLimitsTestJSON-1304729602-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:44.454518 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a52b8500-ee06-4962-9715-ffdbde1332c7 tempest-AbsoluteLimitsTestJSON-1304729602 tempest-AbsoluteLimitsTestJSON-1304729602-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:44.455210 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a52b8500-ee06-4962-9715-ffdbde1332c7 tempest-AbsoluteLimitsTestJSON-1304729602 tempest-AbsoluteLimitsTestJSON-1304729602-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:44.455888 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a52b8500-ee06-4962-9715-ffdbde1332c7 tempest-AbsoluteLimitsTestJSON-1304729602 tempest-AbsoluteLimitsTestJSON-1304729602-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:44.463287 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-3ca98063-d9ca-4684-bb7f-a279c8013c13 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:44.465045 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-3ca98063-d9ca-4684-bb7f-a279c8013c13 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:44.475983 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-3ca98063-d9ca-4684-bb7f-a279c8013c13 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] 10.222.0.26 "GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5" status: 200 len: 1555 microversion: 2.91 time: 0.309720 Oct 08 20:54:44.489972 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 487/919] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:54:44 2022] GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5 => generated 1555 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:54:44.505852 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-a52b8500-ee06-4962-9715-ffdbde1332c7 tempest-AbsoluteLimitsTestJSON-1304729602 tempest-AbsoluteLimitsTestJSON-1304729602-project] 10.222.0.26 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.495464 Oct 08 20:54:44.506979 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 433/920] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 20:54:43 2022] GET /compute/v2.1/limits => generated 511 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:54:44.515947 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-d5ec3664-1daf-4eaf-9953-818f35bce677 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Calling method '.version_select at 0x7f1a8cc3b160>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:44.522574 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d5ec3664-1daf-4eaf-9953-818f35bce677 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:44.527255 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-c52e9353-4451-4058-80db-1998936a4b16 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:44.527885 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-c52e9353-4451-4058-80db-1998936a4b16 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] [instance: f04fdc43-98fc-4bfc-a0f6-6efb9d2ee5bc] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:44.528430 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d5ec3664-1daf-4eaf-9953-818f35bce677 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:44.535832 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d5ec3664-1daf-4eaf-9953-818f35bce677 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:44.552333 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-d5ec3664-1daf-4eaf-9953-818f35bce677 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] 10.222.0.26 "GET /compute/v2.1/os-migrations" status: 200 len: 1166 microversion: 2.1 time: 0.043610 Oct 08 20:54:44.553979 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 434/921] 10.222.0.26 () {58 vars in 1143 bytes} [Sat Oct 8 20:54:44 2022] GET /compute/v2.1/os-migrations => generated 1166 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:54:44.560214 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-8f3b9ccd-b24f-4ddb-bfe7-2359c5ca4f40 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:44.561320 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c52e9353-4451-4058-80db-1998936a4b16 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:44.561593 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-8f3b9ccd-b24f-4ddb-bfe7-2359c5ca4f40 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] [instance: 0cbc3ac5-5690-4f4e-a9d1-ea0de18060b1] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:44.561836 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c52e9353-4451-4058-80db-1998936a4b16 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:44.562292 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c52e9353-4451-4058-80db-1998936a4b16 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:44.563027 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c52e9353-4451-4058-80db-1998936a4b16 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:44.563472 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c52e9353-4451-4058-80db-1998936a4b16 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:44.563919 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c52e9353-4451-4058-80db-1998936a4b16 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:44.588270 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8f3b9ccd-b24f-4ddb-bfe7-2359c5ca4f40 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:44.591055 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8f3b9ccd-b24f-4ddb-bfe7-2359c5ca4f40 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:44.592655 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8f3b9ccd-b24f-4ddb-bfe7-2359c5ca4f40 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:44.594922 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8f3b9ccd-b24f-4ddb-bfe7-2359c5ca4f40 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:44.595963 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8f3b9ccd-b24f-4ddb-bfe7-2359c5ca4f40 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:44.597485 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8f3b9ccd-b24f-4ddb-bfe7-2359c5ca4f40 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:44.622872 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=100 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:54:44.795536 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-8f3b9ccd-b24f-4ddb-bfe7-2359c5ca4f40 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bce55d7f67347aaaa4c2a687bdff183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb3706a1680419384f4fe9660e87732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:44.810312 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-8f3b9ccd-b24f-4ddb-bfe7-2359c5ca4f40 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] 10.222.0.26 "GET /compute/v2.1/servers/0cbc3ac5-5690-4f4e-a9d1-ea0de18060b1" status: 200 len: 1275 microversion: 2.1 time: 0.251919 Oct 08 20:54:44.811608 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 435/922] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:54:44 2022] GET /compute/v2.1/servers/0cbc3ac5-5690-4f4e-a9d1-ea0de18060b1 => generated 1275 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:54:44.832751 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-23b2d41f-0d87-4318-8e8a-ecb2991851ba tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:44.834255 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-23b2d41f-0d87-4318-8e8a-ecb2991851ba tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] [instance: a80fbf87-8203-4e6c-bee7-fe781bfccff1] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:44.846813 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-23b2d41f-0d87-4318-8e8a-ecb2991851ba tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:44.849622 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-23b2d41f-0d87-4318-8e8a-ecb2991851ba tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:44.852127 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-23b2d41f-0d87-4318-8e8a-ecb2991851ba tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:44.855937 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-23b2d41f-0d87-4318-8e8a-ecb2991851ba tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:44.857148 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-23b2d41f-0d87-4318-8e8a-ecb2991851ba tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:44.859551 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-23b2d41f-0d87-4318-8e8a-ecb2991851ba tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:45.272249 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-23b2d41f-0d87-4318-8e8a-ecb2991851ba tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/a80fbf87-8203-4e6c-bee7-fe781bfccff1" status: 200 len: 1631 microversion: 2.1 time: 0.457737 Oct 08 20:54:45.274810 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 436/923] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:54:44 2022] GET /compute/v2.1/servers/a80fbf87-8203-4e6c-bee7-fe781bfccff1 => generated 1631 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:54:45.283025 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.objects.instance [None req-c52e9353-4451-4058-80db-1998936a4b16 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Lazy-loading 'services' on Instance uuid f04fdc43-98fc-4bfc-a0f6-6efb9d2ee5bc {{(pid=140492) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 20:54:45.290348 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-0ab1b9a9-3a6d-4625-afd3-5bca603e8349 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:45.291680 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-0ab1b9a9-3a6d-4625-afd3-5bca603e8349 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] [instance: 73fd15ea-e4bd-4310-93bb-147b0a5e27ef] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:45.305936 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0ab1b9a9-3a6d-4625-afd3-5bca603e8349 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:45.308183 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-c52e9353-4451-4058-80db-1998936a4b16 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/f04fdc43-98fc-4bfc-a0f6-6efb9d2ee5bc" status: 200 len: 2051 microversion: 2.25 time: 0.805650 Oct 08 20:54:45.309143 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0ab1b9a9-3a6d-4625-afd3-5bca603e8349 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:45.309310 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 488/924] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:54:44 2022] GET /compute/v2.1/servers/f04fdc43-98fc-4bfc-a0f6-6efb9d2ee5bc => generated 2051 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:54:45.311954 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0ab1b9a9-3a6d-4625-afd3-5bca603e8349 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:45.312878 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0ab1b9a9-3a6d-4625-afd3-5bca603e8349 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:45.313468 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0ab1b9a9-3a6d-4625-afd3-5bca603e8349 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:45.320059 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0ab1b9a9-3a6d-4625-afd3-5bca603e8349 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:45.326807 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-155e28aa-0570-43b6-bafb-7c550c7da518 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Action: 'create', calling method: .version_select at 0x7f1a8c8ea4c0>, body: {"keypair": {"name": "tempest-keypair-16026981", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLijKl4OegjF2hLwSRHIJZ0ntJz05rUl6GB3SQCTRIloCXKOnvgDugos0ON+HHkE48RTcuVTW0V9onOav4jLlsJtK0u9ABtuIp74NCohCbb0sUgGOfBHgWJ1OXqRQgvjtw=="}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:54:45.395364 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=43 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:54:45.408744 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-155e28aa-0570-43b6-bafb-7c550c7da518 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Getting quotas for project 6ecc2dd2407b4819874bed09cb27959a. Resources: {'key_pairs'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 20:54:45.431208 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-155e28aa-0570-43b6-bafb-7c550c7da518 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Getting quotas for user 474ca64d1b1d4e30916b517645aba882 and project 6ecc2dd2407b4819874bed09cb27959a. Resources: {'key_pairs'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 20:54:45.490071 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-155e28aa-0570-43b6-bafb-7c550c7da518 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.167539 Oct 08 20:54:45.491487 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 489/925] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Oct 8 20:54:45 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:54:45.509843 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-ba36523a-adc0-4ba5-b013-2d8b37f96de8 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:45.518883 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ba36523a-adc0-4ba5-b013-2d8b37f96de8 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:45.521795 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ba36523a-adc0-4ba5-b013-2d8b37f96de8 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:45.522305 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ba36523a-adc0-4ba5-b013-2d8b37f96de8 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:45.523087 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ba36523a-adc0-4ba5-b013-2d8b37f96de8 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:45.523567 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ba36523a-adc0-4ba5-b013-2d8b37f96de8 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:45.524009 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ba36523a-adc0-4ba5-b013-2d8b37f96de8 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:45.585254 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-ba36523a-adc0-4ba5-b013-2d8b37f96de8 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.085879 Oct 08 20:54:45.586454 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 490/926] 10.222.0.26 () {60 vars in 1217 bytes} [Sat Oct 8 20:54:45 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 08 20:54:45.593335 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-c83e4a1f-35ed-4ec3-9dd7-bfeeea12c6b3 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:45.594194 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-c83e4a1f-35ed-4ec3-9dd7-bfeeea12c6b3 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] [instance: 92e31b92-0af1-4da6-bc87-23978f1aedf5] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:45.600722 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c83e4a1f-35ed-4ec3-9dd7-bfeeea12c6b3 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:45.601464 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c83e4a1f-35ed-4ec3-9dd7-bfeeea12c6b3 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:45.602107 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c83e4a1f-35ed-4ec3-9dd7-bfeeea12c6b3 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:45.603190 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c83e4a1f-35ed-4ec3-9dd7-bfeeea12c6b3 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:45.603819 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c83e4a1f-35ed-4ec3-9dd7-bfeeea12c6b3 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:45.604412 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c83e4a1f-35ed-4ec3-9dd7-bfeeea12c6b3 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:46.171252 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-c83e4a1f-35ed-4ec3-9dd7-bfeeea12c6b3 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:46.204977 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-c83e4a1f-35ed-4ec3-9dd7-bfeeea12c6b3 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:46.212313 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-c83e4a1f-35ed-4ec3-9dd7-bfeeea12c6b3 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:46.232787 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-c83e4a1f-35ed-4ec3-9dd7-bfeeea12c6b3 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] 10.222.0.26 "GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5" status: 200 len: 1555 microversion: 2.91 time: 0.642579 Oct 08 20:54:46.242465 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 491/927] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:54:45 2022] GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5 => generated 1555 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:54:46.249645 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-6f312f98-f917-4427-ad4d-e084ddd94606 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:54:46.250212 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-6f312f98-f917-4427-ad4d-e084ddd94606 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] [instance: f04fdc43-98fc-4bfc-a0f6-6efb9d2ee5bc] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:46.261850 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-0ab1b9a9-3a6d-4625-afd3-5bca603e8349 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef659f5a1a24c439528a7675bdd70f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c92fe04ab8248399d0acb932f82d607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:46.269827 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6f312f98-f917-4427-ad4d-e084ddd94606 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:46.271275 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6f312f98-f917-4427-ad4d-e084ddd94606 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:46.271938 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6f312f98-f917-4427-ad4d-e084ddd94606 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:46.272745 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6f312f98-f917-4427-ad4d-e084ddd94606 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:46.273245 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6f312f98-f917-4427-ad4d-e084ddd94606 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:46.273602 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-0ab1b9a9-3a6d-4625-afd3-5bca603e8349 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] 10.222.0.26 "GET /compute/v2.1/servers/73fd15ea-e4bd-4310-93bb-147b0a5e27ef" status: 200 len: 1471 microversion: 2.1 time: 0.996783 Oct 08 20:54:46.274173 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6f312f98-f917-4427-ad4d-e084ddd94606 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:46.285377 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 437/928] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:54:45 2022] GET /compute/v2.1/servers/73fd15ea-e4bd-4310-93bb-147b0a5e27ef => generated 1471 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:54:46.295508 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-1fae5bb6-2b0b-497f-a878-74f0e640882b tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:46.301284 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-1fae5bb6-2b0b-497f-a878-74f0e640882b tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] [instance: 0cbc3ac5-5690-4f4e-a9d1-ea0de18060b1] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:46.321549 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1fae5bb6-2b0b-497f-a878-74f0e640882b tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:46.325018 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1fae5bb6-2b0b-497f-a878-74f0e640882b tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:46.325603 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1fae5bb6-2b0b-497f-a878-74f0e640882b tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:46.327655 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1fae5bb6-2b0b-497f-a878-74f0e640882b tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:46.329689 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1fae5bb6-2b0b-497f-a878-74f0e640882b tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:46.330432 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1fae5bb6-2b0b-497f-a878-74f0e640882b tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:46.399340 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-6f312f98-f917-4427-ad4d-e084ddd94606 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/f04fdc43-98fc-4bfc-a0f6-6efb9d2ee5bc/action" status: 202 len: 0 microversion: 2.25 time: 0.154921 Oct 08 20:54:46.403803 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 492/929] 10.222.0.26 () {62 vars in 1319 bytes} [Sat Oct 8 20:54:46 2022] POST /compute/v2.1/servers/f04fdc43-98fc-4bfc-a0f6-6efb9d2ee5bc/action => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 08 20:54:46.418954 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-8763e1df-58cb-4997-9e73-734cd8e80d60 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:46.426891 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-8763e1df-58cb-4997-9e73-734cd8e80d60 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] [instance: f04fdc43-98fc-4bfc-a0f6-6efb9d2ee5bc] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:46.439276 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8763e1df-58cb-4997-9e73-734cd8e80d60 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:46.441783 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8763e1df-58cb-4997-9e73-734cd8e80d60 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:46.442487 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8763e1df-58cb-4997-9e73-734cd8e80d60 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:46.448682 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8763e1df-58cb-4997-9e73-734cd8e80d60 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:46.449606 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8763e1df-58cb-4997-9e73-734cd8e80d60 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:46.450270 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8763e1df-58cb-4997-9e73-734cd8e80d60 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:46.522657 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-1fae5bb6-2b0b-497f-a878-74f0e640882b tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bce55d7f67347aaaa4c2a687bdff183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb3706a1680419384f4fe9660e87732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:46.535433 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-1fae5bb6-2b0b-497f-a878-74f0e640882b tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] 10.222.0.26 "GET /compute/v2.1/servers/0cbc3ac5-5690-4f4e-a9d1-ea0de18060b1" status: 200 len: 1275 microversion: 2.1 time: 0.247705 Oct 08 20:54:46.536336 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 438/930] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:54:46 2022] GET /compute/v2.1/servers/0cbc3ac5-5690-4f4e-a9d1-ea0de18060b1 => generated 1275 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:54:46.816359 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.objects.instance [None req-8763e1df-58cb-4997-9e73-734cd8e80d60 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Lazy-loading 'services' on Instance uuid f04fdc43-98fc-4bfc-a0f6-6efb9d2ee5bc {{(pid=140492) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 20:54:46.854628 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-8763e1df-58cb-4997-9e73-734cd8e80d60 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/f04fdc43-98fc-4bfc-a0f6-6efb9d2ee5bc" status: 200 len: 2056 microversion: 2.25 time: 0.449185 Oct 08 20:54:46.872300 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 493/931] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:54:46 2022] GET /compute/v2.1/servers/f04fdc43-98fc-4bfc-a0f6-6efb9d2ee5bc => generated 2056 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:54:47.271040 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-e236de2a-ce29-4012-bcc5-d149da704458 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:47.272251 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-e236de2a-ce29-4012-bcc5-d149da704458 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] [instance: 92e31b92-0af1-4da6-bc87-23978f1aedf5] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:47.293372 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e236de2a-ce29-4012-bcc5-d149da704458 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:47.294406 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e236de2a-ce29-4012-bcc5-d149da704458 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:47.296484 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e236de2a-ce29-4012-bcc5-d149da704458 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:47.297535 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e236de2a-ce29-4012-bcc5-d149da704458 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:47.301810 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-bb2fd8d9-a05e-473e-9d4e-fbf3b0a63f31 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:47.302480 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e236de2a-ce29-4012-bcc5-d149da704458 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:47.302946 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e236de2a-ce29-4012-bcc5-d149da704458 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:47.303233 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-bb2fd8d9-a05e-473e-9d4e-fbf3b0a63f31 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] [instance: 73fd15ea-e4bd-4310-93bb-147b0a5e27ef] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:47.350191 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bb2fd8d9-a05e-473e-9d4e-fbf3b0a63f31 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:47.354135 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bb2fd8d9-a05e-473e-9d4e-fbf3b0a63f31 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:47.361553 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bb2fd8d9-a05e-473e-9d4e-fbf3b0a63f31 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:47.363121 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bb2fd8d9-a05e-473e-9d4e-fbf3b0a63f31 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:47.364216 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bb2fd8d9-a05e-473e-9d4e-fbf3b0a63f31 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:47.364892 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bb2fd8d9-a05e-473e-9d4e-fbf3b0a63f31 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:48.071892 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-e236de2a-ce29-4012-bcc5-d149da704458 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:48.079368 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-bb2fd8d9-a05e-473e-9d4e-fbf3b0a63f31 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef659f5a1a24c439528a7675bdd70f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c92fe04ab8248399d0acb932f82d607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:48.086471 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-e236de2a-ce29-4012-bcc5-d149da704458 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:48.091955 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-e236de2a-ce29-4012-bcc5-d149da704458 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:48.092542 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-bb2fd8d9-a05e-473e-9d4e-fbf3b0a63f31 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] 10.222.0.26 "GET /compute/v2.1/servers/73fd15ea-e4bd-4310-93bb-147b0a5e27ef" status: 200 len: 1471 microversion: 2.1 time: 0.793866 Oct 08 20:54:48.098168 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 494/932] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:54:47 2022] GET /compute/v2.1/servers/73fd15ea-e4bd-4310-93bb-147b0a5e27ef => generated 1471 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:54:48.105420 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-419d6c87-5eac-446c-958f-4cea5cc77ef5 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:48.115539 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-419d6c87-5eac-446c-958f-4cea5cc77ef5 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] [instance: 0cbc3ac5-5690-4f4e-a9d1-ea0de18060b1] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:48.118428 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-e236de2a-ce29-4012-bcc5-d149da704458 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] 10.222.0.26 "GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5" status: 200 len: 1555 microversion: 2.91 time: 0.851503 Oct 08 20:54:48.119702 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 439/933] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:54:47 2022] GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5 => generated 1555 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:54:48.133813 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-419d6c87-5eac-446c-958f-4cea5cc77ef5 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:48.134600 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-419d6c87-5eac-446c-958f-4cea5cc77ef5 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:48.135214 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-419d6c87-5eac-446c-958f-4cea5cc77ef5 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:48.136563 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-419d6c87-5eac-446c-958f-4cea5cc77ef5 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:48.137224 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-419d6c87-5eac-446c-958f-4cea5cc77ef5 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:48.139772 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-419d6c87-5eac-446c-958f-4cea5cc77ef5 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:48.145923 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-3ee949ba-e027-447d-ba31-8cc5665621f4 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:48.149802 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-3ee949ba-e027-447d-ba31-8cc5665621f4 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] [instance: f04fdc43-98fc-4bfc-a0f6-6efb9d2ee5bc] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:48.179545 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3ee949ba-e027-447d-ba31-8cc5665621f4 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:48.184536 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3ee949ba-e027-447d-ba31-8cc5665621f4 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:48.187584 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3ee949ba-e027-447d-ba31-8cc5665621f4 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:48.189940 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3ee949ba-e027-447d-ba31-8cc5665621f4 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:48.194673 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3ee949ba-e027-447d-ba31-8cc5665621f4 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:48.199535 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3ee949ba-e027-447d-ba31-8cc5665621f4 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:48.578269 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-419d6c87-5eac-446c-958f-4cea5cc77ef5 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bce55d7f67347aaaa4c2a687bdff183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb3706a1680419384f4fe9660e87732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:48.589037 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-419d6c87-5eac-446c-958f-4cea5cc77ef5 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] 10.222.0.26 "GET /compute/v2.1/servers/0cbc3ac5-5690-4f4e-a9d1-ea0de18060b1" status: 200 len: 1317 microversion: 2.1 time: 0.489272 Oct 08 20:54:48.593468 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 495/934] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:54:48 2022] GET /compute/v2.1/servers/0cbc3ac5-5690-4f4e-a9d1-ea0de18060b1 => generated 1317 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:54:48.802304 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-77c319ae-4f12-4f06-8af5-b91969159f13 req-61b67a34-648e-4301-8099-2a6b12e8c0d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24300a5e-164c-4d97-9a1f-b52359c1c0d6", "tag": "2fe7c081-3e45-4535-9c6e-1d2e86219410"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:54:48.813822 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-77c319ae-4f12-4f06-8af5-b91969159f13 req-61b67a34-648e-4301-8099-2a6b12e8c0d8 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:48.814613 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-77c319ae-4f12-4f06-8af5-b91969159f13 req-61b67a34-648e-4301-8099-2a6b12e8c0d8 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:48.815300 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-77c319ae-4f12-4f06-8af5-b91969159f13 req-61b67a34-648e-4301-8099-2a6b12e8c0d8 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:48.831655 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-77c319ae-4f12-4f06-8af5-b91969159f13 req-61b67a34-648e-4301-8099-2a6b12e8c0d8 service nova] Creating event network-changed:2fe7c081-3e45-4535-9c6e-1d2e86219410 for instance 24300a5e-164c-4d97-9a1f-b52359c1c0d6 on nch1-master-1 Oct 08 20:54:48.840053 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-77c319ae-4f12-4f06-8af5-b91969159f13 req-61b67a34-648e-4301-8099-2a6b12e8c0d8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042413 Oct 08 20:54:48.841394 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 496/935] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:54:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:54:49.126654 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-5c1f4631-a23b-48cf-bb80-12b4f3ceccb6 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:49.127369 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-5c1f4631-a23b-48cf-bb80-12b4f3ceccb6 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] [instance: 73fd15ea-e4bd-4310-93bb-147b0a5e27ef] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:49.141755 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5c1f4631-a23b-48cf-bb80-12b4f3ceccb6 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:49.142284 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5c1f4631-a23b-48cf-bb80-12b4f3ceccb6 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:49.142808 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5c1f4631-a23b-48cf-bb80-12b4f3ceccb6 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:49.143539 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5c1f4631-a23b-48cf-bb80-12b4f3ceccb6 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:49.144004 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5c1f4631-a23b-48cf-bb80-12b4f3ceccb6 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:49.145743 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5c1f4631-a23b-48cf-bb80-12b4f3ceccb6 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:49.497477 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.objects.instance [None req-3ee949ba-e027-447d-ba31-8cc5665621f4 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Lazy-loading 'services' on Instance uuid f04fdc43-98fc-4bfc-a0f6-6efb9d2ee5bc {{(pid=140491) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 20:54:49.547081 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-3ee949ba-e027-447d-ba31-8cc5665621f4 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/f04fdc43-98fc-4bfc-a0f6-6efb9d2ee5bc" status: 200 len: 2036 microversion: 2.25 time: 1.417379 Oct 08 20:54:49.548271 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-5c1f4631-a23b-48cf-bb80-12b4f3ceccb6 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef659f5a1a24c439528a7675bdd70f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c92fe04ab8248399d0acb932f82d607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:49.548441 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 440/936] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:54:48 2022] GET /compute/v2.1/servers/f04fdc43-98fc-4bfc-a0f6-6efb9d2ee5bc => generated 2036 bytes in 1428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:54:49.562942 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-5c1f4631-a23b-48cf-bb80-12b4f3ceccb6 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] 10.222.0.26 "GET /compute/v2.1/servers/73fd15ea-e4bd-4310-93bb-147b0a5e27ef" status: 200 len: 1471 microversion: 2.1 time: 0.440934 Oct 08 20:54:49.565304 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 497/937] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:54:49 2022] GET /compute/v2.1/servers/73fd15ea-e4bd-4310-93bb-147b0a5e27ef => generated 1471 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:54:49.581005 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-3736961a-3425-45ee-b387-361a3a3338d2 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": "auto"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:54:49.582106 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-91558244-f1c5-42f4-b926-76bb3893aa28 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:49.583794 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-3736961a-3425-45ee-b387-361a3a3338d2 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] [instance: f04fdc43-98fc-4bfc-a0f6-6efb9d2ee5bc] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:49.586123 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-91558244-f1c5-42f4-b926-76bb3893aa28 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] [instance: 92e31b92-0af1-4da6-bc87-23978f1aedf5] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:49.593779 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-91558244-f1c5-42f4-b926-76bb3893aa28 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:49.594598 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-91558244-f1c5-42f4-b926-76bb3893aa28 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:49.595253 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-91558244-f1c5-42f4-b926-76bb3893aa28 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:49.596253 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-91558244-f1c5-42f4-b926-76bb3893aa28 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:49.596386 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3736961a-3425-45ee-b387-361a3a3338d2 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:49.596889 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3736961a-3425-45ee-b387-361a3a3338d2 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:49.597309 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-91558244-f1c5-42f4-b926-76bb3893aa28 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:49.597427 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3736961a-3425-45ee-b387-361a3a3338d2 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:49.598148 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3736961a-3425-45ee-b387-361a3a3338d2 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:49.598617 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3736961a-3425-45ee-b387-361a3a3338d2 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:49.598939 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-91558244-f1c5-42f4-b926-76bb3893aa28 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:49.599065 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3736961a-3425-45ee-b387-361a3a3338d2 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:49.653044 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.objects.instance [None req-3736961a-3425-45ee-b387-361a3a3338d2 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Lazy-loading 'flavor' on Instance uuid f04fdc43-98fc-4bfc-a0f6-6efb9d2ee5bc {{(pid=140492) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 20:54:49.684281 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-3736961a-3425-45ee-b387-361a3a3338d2 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] [instance: f04fdc43-98fc-4bfc-a0f6-6efb9d2ee5bc] Going to try to live migrate instance to nch2-master-1 {{(pid=140492) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 08 20:54:49.742919 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-91558244-f1c5-42f4-b926-76bb3893aa28 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:49.754702 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-91558244-f1c5-42f4-b926-76bb3893aa28 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:49.759842 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-91558244-f1c5-42f4-b926-76bb3893aa28 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:49.774926 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-91558244-f1c5-42f4-b926-76bb3893aa28 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] 10.222.0.26 "GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5" status: 200 len: 1555 microversion: 2.91 time: 0.222251 Oct 08 20:54:49.775964 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 441/938] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:54:49 2022] GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5 => generated 1555 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:54:49.789588 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-5a8d35c3-c0db-4b1e-a0df-4ec4a45b2b74 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:49.790657 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-5a8d35c3-c0db-4b1e-a0df-4ec4a45b2b74 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] [instance: 0cbc3ac5-5690-4f4e-a9d1-ea0de18060b1] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:49.798415 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5a8d35c3-c0db-4b1e-a0df-4ec4a45b2b74 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:49.799124 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5a8d35c3-c0db-4b1e-a0df-4ec4a45b2b74 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:49.800432 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5a8d35c3-c0db-4b1e-a0df-4ec4a45b2b74 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:49.801139 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5a8d35c3-c0db-4b1e-a0df-4ec4a45b2b74 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:49.801627 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5a8d35c3-c0db-4b1e-a0df-4ec4a45b2b74 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:49.802055 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5a8d35c3-c0db-4b1e-a0df-4ec4a45b2b74 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:49.847876 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=100 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:54:50.447498 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-5a8d35c3-c0db-4b1e-a0df-4ec4a45b2b74 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bce55d7f67347aaaa4c2a687bdff183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb3706a1680419384f4fe9660e87732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:50.462987 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-5a8d35c3-c0db-4b1e-a0df-4ec4a45b2b74 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] 10.222.0.26 "GET /compute/v2.1/servers/0cbc3ac5-5690-4f4e-a9d1-ea0de18060b1" status: 200 len: 1317 microversion: 2.1 time: 0.685816 Oct 08 20:54:50.465180 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 442/939] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:54:49 2022] GET /compute/v2.1/servers/0cbc3ac5-5690-4f4e-a9d1-ea0de18060b1 => generated 1317 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:54:50.595212 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-7b8ea318-a709-4e4f-a64a-49f61f34d7da tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:50.596519 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-7b8ea318-a709-4e4f-a64a-49f61f34d7da tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] [instance: 73fd15ea-e4bd-4310-93bb-147b0a5e27ef] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:50.605730 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7b8ea318-a709-4e4f-a64a-49f61f34d7da tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:50.606800 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7b8ea318-a709-4e4f-a64a-49f61f34d7da tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:50.608046 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7b8ea318-a709-4e4f-a64a-49f61f34d7da tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:50.609984 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7b8ea318-a709-4e4f-a64a-49f61f34d7da tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:50.610610 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7b8ea318-a709-4e4f-a64a-49f61f34d7da tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:50.611231 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7b8ea318-a709-4e4f-a64a-49f61f34d7da tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:51.007141 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-7b8ea318-a709-4e4f-a64a-49f61f34d7da tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef659f5a1a24c439528a7675bdd70f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c92fe04ab8248399d0acb932f82d607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:51.022753 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-7b8ea318-a709-4e4f-a64a-49f61f34d7da tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] 10.222.0.26 "GET /compute/v2.1/servers/73fd15ea-e4bd-4310-93bb-147b0a5e27ef" status: 200 len: 1471 microversion: 2.1 time: 0.432959 Oct 08 20:54:51.025139 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 443/940] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:54:50 2022] GET /compute/v2.1/servers/73fd15ea-e4bd-4310-93bb-147b0a5e27ef => generated 1471 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 20:54:51.030791 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-4b9785eb-e4ba-40b8-b4a6-c2359710f278 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:51.031999 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-4b9785eb-e4ba-40b8-b4a6-c2359710f278 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] [instance: 92e31b92-0af1-4da6-bc87-23978f1aedf5] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:51.040571 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4b9785eb-e4ba-40b8-b4a6-c2359710f278 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:51.041350 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4b9785eb-e4ba-40b8-b4a6-c2359710f278 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:51.044243 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4b9785eb-e4ba-40b8-b4a6-c2359710f278 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:51.047061 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4b9785eb-e4ba-40b8-b4a6-c2359710f278 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:51.047775 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4b9785eb-e4ba-40b8-b4a6-c2359710f278 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:51.049621 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4b9785eb-e4ba-40b8-b4a6-c2359710f278 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:51.289319 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-4b9785eb-e4ba-40b8-b4a6-c2359710f278 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:51.306696 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-4b9785eb-e4ba-40b8-b4a6-c2359710f278 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:51.308664 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-4b9785eb-e4ba-40b8-b4a6-c2359710f278 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:51.321468 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-4b9785eb-e4ba-40b8-b4a6-c2359710f278 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] 10.222.0.26 "GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5" status: 200 len: 1555 microversion: 2.91 time: 0.294936 Oct 08 20:54:51.322310 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 444/941] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:54:51 2022] GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5 => generated 1555 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:54:51.487014 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-875600f8-45a7-44d0-ae82-c23795d316c1 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:51.488101 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-875600f8-45a7-44d0-ae82-c23795d316c1 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] [instance: 0cbc3ac5-5690-4f4e-a9d1-ea0de18060b1] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:51.491748 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:54:51.503395 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-875600f8-45a7-44d0-ae82-c23795d316c1 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:51.504375 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-875600f8-45a7-44d0-ae82-c23795d316c1 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:51.505052 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-875600f8-45a7-44d0-ae82-c23795d316c1 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:51.506033 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-875600f8-45a7-44d0-ae82-c23795d316c1 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:51.506677 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-875600f8-45a7-44d0-ae82-c23795d316c1 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:51.507277 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-875600f8-45a7-44d0-ae82-c23795d316c1 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:52.484683 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-875600f8-45a7-44d0-ae82-c23795d316c1 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bce55d7f67347aaaa4c2a687bdff183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb3706a1680419384f4fe9660e87732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:52.497795 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-875600f8-45a7-44d0-ae82-c23795d316c1 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] 10.222.0.26 "GET /compute/v2.1/servers/0cbc3ac5-5690-4f4e-a9d1-ea0de18060b1" status: 200 len: 1317 microversion: 2.1 time: 1.015050 Oct 08 20:54:52.513706 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 445/942] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:54:51 2022] GET /compute/v2.1/servers/0cbc3ac5-5690-4f4e-a9d1-ea0de18060b1 => generated 1317 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:54:52.523733 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-03a4f714-5e97-4622-9ef2-755c92d267c6 req-cd4998f9-ee71-4614-a386-0172997d7173 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0cbc3ac5-5690-4f4e-a9d1-ea0de18060b1", "tag": "20694e26-0b3a-4a5f-9806-aa0485a844f5"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:54:52.564938 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-03a4f714-5e97-4622-9ef2-755c92d267c6 req-cd4998f9-ee71-4614-a386-0172997d7173 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:52.566175 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-03a4f714-5e97-4622-9ef2-755c92d267c6 req-cd4998f9-ee71-4614-a386-0172997d7173 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:52.567604 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-03a4f714-5e97-4622-9ef2-755c92d267c6 req-cd4998f9-ee71-4614-a386-0172997d7173 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:52.603800 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-03a4f714-5e97-4622-9ef2-755c92d267c6 req-cd4998f9-ee71-4614-a386-0172997d7173 service nova] Creating event network-changed:20694e26-0b3a-4a5f-9806-aa0485a844f5 for instance 0cbc3ac5-5690-4f4e-a9d1-ea0de18060b1 on nch1-master-1 Oct 08 20:54:52.622235 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-03a4f714-5e97-4622-9ef2-755c92d267c6 req-cd4998f9-ee71-4614-a386-0172997d7173 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104257 Oct 08 20:54:52.626758 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 446/943] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:54:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:54:52.644644 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-67ff330c-ebc0-4eea-b5ad-83f1923d9459 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:52.645666 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-67ff330c-ebc0-4eea-b5ad-83f1923d9459 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] [instance: 73fd15ea-e4bd-4310-93bb-147b0a5e27ef] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:52.662013 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-67ff330c-ebc0-4eea-b5ad-83f1923d9459 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:52.663549 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-67ff330c-ebc0-4eea-b5ad-83f1923d9459 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:52.664914 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-67ff330c-ebc0-4eea-b5ad-83f1923d9459 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:52.668910 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-67ff330c-ebc0-4eea-b5ad-83f1923d9459 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:52.669632 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-67ff330c-ebc0-4eea-b5ad-83f1923d9459 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:52.670919 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-67ff330c-ebc0-4eea-b5ad-83f1923d9459 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:52.962854 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-67ff330c-ebc0-4eea-b5ad-83f1923d9459 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef659f5a1a24c439528a7675bdd70f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c92fe04ab8248399d0acb932f82d607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:52.972064 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-67ff330c-ebc0-4eea-b5ad-83f1923d9459 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] 10.222.0.26 "GET /compute/v2.1/servers/73fd15ea-e4bd-4310-93bb-147b0a5e27ef" status: 200 len: 1471 microversion: 2.1 time: 0.342530 Oct 08 20:54:52.972568 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 447/944] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:54:52 2022] GET /compute/v2.1/servers/73fd15ea-e4bd-4310-93bb-147b0a5e27ef => generated 1471 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:54:52.989342 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-ebb0f6d4-22db-41c7-8826-cab4796e5e58 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:52.990271 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-ebb0f6d4-22db-41c7-8826-cab4796e5e58 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] [instance: 92e31b92-0af1-4da6-bc87-23978f1aedf5] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:53.002673 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ebb0f6d4-22db-41c7-8826-cab4796e5e58 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:53.003176 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ebb0f6d4-22db-41c7-8826-cab4796e5e58 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:53.003849 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ebb0f6d4-22db-41c7-8826-cab4796e5e58 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:53.005043 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ebb0f6d4-22db-41c7-8826-cab4796e5e58 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:53.005729 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ebb0f6d4-22db-41c7-8826-cab4796e5e58 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:53.006239 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ebb0f6d4-22db-41c7-8826-cab4796e5e58 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:53.079537 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-3736961a-3425-45ee-b387-361a3a3338d2 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/f04fdc43-98fc-4bfc-a0f6-6efb9d2ee5bc/action" status: 202 len: 0 microversion: 2.25 time: 3.508145 Oct 08 20:54:53.080164 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 498/945] 10.222.0.26 () {62 vars in 1319 bytes} [Sat Oct 8 20:54:49 2022] POST /compute/v2.1/servers/f04fdc43-98fc-4bfc-a0f6-6efb9d2ee5bc/action => generated 0 bytes in 3510 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 08 20:54:53.088955 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-5eb3e2a5-3b33-4aa2-8c4d-cd7b0a673067 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:53.090078 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-5eb3e2a5-3b33-4aa2-8c4d-cd7b0a673067 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] [instance: f04fdc43-98fc-4bfc-a0f6-6efb9d2ee5bc] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:53.103580 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5eb3e2a5-3b33-4aa2-8c4d-cd7b0a673067 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:53.104386 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5eb3e2a5-3b33-4aa2-8c4d-cd7b0a673067 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:53.104990 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5eb3e2a5-3b33-4aa2-8c4d-cd7b0a673067 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:53.105919 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5eb3e2a5-3b33-4aa2-8c4d-cd7b0a673067 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:53.106545 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5eb3e2a5-3b33-4aa2-8c4d-cd7b0a673067 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:53.107129 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5eb3e2a5-3b33-4aa2-8c4d-cd7b0a673067 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:53.150425 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-ebb0f6d4-22db-41c7-8826-cab4796e5e58 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:53.170678 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-ebb0f6d4-22db-41c7-8826-cab4796e5e58 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:53.172997 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-ebb0f6d4-22db-41c7-8826-cab4796e5e58 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:53.185180 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-ebb0f6d4-22db-41c7-8826-cab4796e5e58 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] 10.222.0.26 "GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5" status: 200 len: 1537 microversion: 2.91 time: 0.206165 Oct 08 20:54:53.186605 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 448/946] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:54:52 2022] GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5 => generated 1537 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:54:53.207862 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-f7ee4973-a178-405c-9263-8c0dffed7bfd tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1325415368", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "networks": [{"uuid": "2de46f56-45d8-40d9-8d29-d806b680f627"}], "security_groups": [{"name": "tempest-securitygroup--1053219263"}], "key_name": "tempest-keypair-16026981", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:54:53.390262 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.network.neutron [None req-f7ee4973-a178-405c-9263-8c0dffed7bfd tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] validate_networks() for [('2de46f56-45d8-40d9-8d29-d806b680f627', None, None, None, None, None)] {{(pid=140491) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 20:54:53.397354 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-5eb3e2a5-3b33-4aa2-8c4d-cd7b0a673067 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:53.410282 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-5eb3e2a5-3b33-4aa2-8c4d-cd7b0a673067 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:53.412293 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-5eb3e2a5-3b33-4aa2-8c4d-cd7b0a673067 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:53.413802 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-5eb3e2a5-3b33-4aa2-8c4d-cd7b0a673067 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] 10.222.0.26 "GET /compute/v2.1/servers/f04fdc43-98fc-4bfc-a0f6-6efb9d2ee5bc" status: 200 len: 1568 microversion: 2.25 time: 0.329449 Oct 08 20:54:53.416731 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 499/947] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:54:53 2022] GET /compute/v2.1/servers/f04fdc43-98fc-4bfc-a0f6-6efb9d2ee5bc => generated 1568 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 08 20:54:53.521933 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-3527f5e9-1482-4a75-b4da-1a6d6e9faed6 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:53.522544 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-3527f5e9-1482-4a75-b4da-1a6d6e9faed6 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] [instance: 0cbc3ac5-5690-4f4e-a9d1-ea0de18060b1] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:53.534423 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3527f5e9-1482-4a75-b4da-1a6d6e9faed6 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:53.535197 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3527f5e9-1482-4a75-b4da-1a6d6e9faed6 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:53.535799 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3527f5e9-1482-4a75-b4da-1a6d6e9faed6 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:53.536708 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3527f5e9-1482-4a75-b4da-1a6d6e9faed6 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:53.537353 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3527f5e9-1482-4a75-b4da-1a6d6e9faed6 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:53.541588 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3527f5e9-1482-4a75-b4da-1a6d6e9faed6 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:54.027188 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-3527f5e9-1482-4a75-b4da-1a6d6e9faed6 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bce55d7f67347aaaa4c2a687bdff183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb3706a1680419384f4fe9660e87732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:54.041998 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-3527f5e9-1482-4a75-b4da-1a6d6e9faed6 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] 10.222.0.26 "GET /compute/v2.1/servers/0cbc3ac5-5690-4f4e-a9d1-ea0de18060b1" status: 200 len: 1317 microversion: 2.1 time: 0.519005 Oct 08 20:54:54.044310 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 500/948] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:54:53 2022] GET /compute/v2.1/servers/0cbc3ac5-5690-4f4e-a9d1-ea0de18060b1 => generated 1317 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 20:54:54.063764 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-533d0834-f1e6-4443-ad7e-108cca11ae9a tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:54.064812 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-533d0834-f1e6-4443-ad7e-108cca11ae9a tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] [instance: 73fd15ea-e4bd-4310-93bb-147b0a5e27ef] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:54.078043 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-533d0834-f1e6-4443-ad7e-108cca11ae9a tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:54.084022 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-533d0834-f1e6-4443-ad7e-108cca11ae9a tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:54.085465 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-533d0834-f1e6-4443-ad7e-108cca11ae9a tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:54.086592 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-533d0834-f1e6-4443-ad7e-108cca11ae9a tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:54.087270 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-533d0834-f1e6-4443-ad7e-108cca11ae9a tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:54.087944 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-533d0834-f1e6-4443-ad7e-108cca11ae9a tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:54.447090 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=37,nova_cell0:UPDATE=7 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:54:54.486095 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=2 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:54:54.606539 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-533d0834-f1e6-4443-ad7e-108cca11ae9a tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef659f5a1a24c439528a7675bdd70f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c92fe04ab8248399d0acb932f82d607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:54.627458 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-533d0834-f1e6-4443-ad7e-108cca11ae9a tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] 10.222.0.26 "GET /compute/v2.1/servers/73fd15ea-e4bd-4310-93bb-147b0a5e27ef" status: 200 len: 1471 microversion: 2.1 time: 0.580984 Oct 08 20:54:54.630150 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 501/949] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:54:54 2022] GET /compute/v2.1/servers/73fd15ea-e4bd-4310-93bb-147b0a5e27ef => generated 1471 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:54:54.650304 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-96199dad-ef8b-4b61-be9f-0bf6d4efda10 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:54.657910 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-96199dad-ef8b-4b61-be9f-0bf6d4efda10 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] [instance: 92e31b92-0af1-4da6-bc87-23978f1aedf5] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:54.676055 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-96199dad-ef8b-4b61-be9f-0bf6d4efda10 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:54.677132 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-96199dad-ef8b-4b61-be9f-0bf6d4efda10 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:54.677891 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-96199dad-ef8b-4b61-be9f-0bf6d4efda10 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:54.679209 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-96199dad-ef8b-4b61-be9f-0bf6d4efda10 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:54.679947 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-96199dad-ef8b-4b61-be9f-0bf6d4efda10 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:54.680610 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-96199dad-ef8b-4b61-be9f-0bf6d4efda10 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:54.763028 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-f7ee4973-a178-405c-9263-8c0dffed7bfd tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Flavor limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 20:54:54.764152 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-f7ee4973-a178-405c-9263-8c0dffed7bfd tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Image limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 20:54:54.773699 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-f7ee4973-a178-405c-9263-8c0dffed7bfd tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Flavor pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 20:54:54.774151 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-f7ee4973-a178-405c-9263-8c0dffed7bfd tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Image pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 20:54:54.774586 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-f7ee4973-a178-405c-9263-8c0dffed7bfd tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 20:54:54.808913 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f7ee4973-a178-405c-9263-8c0dffed7bfd tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:54.813964 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f7ee4973-a178-405c-9263-8c0dffed7bfd tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:54.814682 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f7ee4973-a178-405c-9263-8c0dffed7bfd tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:54.817427 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f7ee4973-a178-405c-9263-8c0dffed7bfd tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:54.818851 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f7ee4973-a178-405c-9263-8c0dffed7bfd tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:54.820390 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f7ee4973-a178-405c-9263-8c0dffed7bfd tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:54.870183 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-96199dad-ef8b-4b61-be9f-0bf6d4efda10 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:54.889367 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-96199dad-ef8b-4b61-be9f-0bf6d4efda10 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:54.898875 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-96199dad-ef8b-4b61-be9f-0bf6d4efda10 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:54.918392 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-f7ee4973-a178-405c-9263-8c0dffed7bfd tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Getting quotas for project 6ecc2dd2407b4819874bed09cb27959a. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 20:54:54.923766 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-96199dad-ef8b-4b61-be9f-0bf6d4efda10 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] 10.222.0.26 "GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5" status: 200 len: 1540 microversion: 2.91 time: 0.289702 Oct 08 20:54:54.929423 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 502/950] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:54:54 2022] GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5 => generated 1540 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:54:54.948350 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-32782655-8be7-4433-9faa-9d1a0e7c857d tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:54.948944 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-f7ee4973-a178-405c-9263-8c0dffed7bfd tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Getting quotas for user 474ca64d1b1d4e30916b517645aba882 and project 6ecc2dd2407b4819874bed09cb27959a. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 20:54:54.950664 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-32782655-8be7-4433-9faa-9d1a0e7c857d tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] [instance: f04fdc43-98fc-4bfc-a0f6-6efb9d2ee5bc] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:54.977508 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-32782655-8be7-4433-9faa-9d1a0e7c857d tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:54.984297 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-32782655-8be7-4433-9faa-9d1a0e7c857d tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:54.984774 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-32782655-8be7-4433-9faa-9d1a0e7c857d tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:54.990641 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-32782655-8be7-4433-9faa-9d1a0e7c857d tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:54.991198 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-32782655-8be7-4433-9faa-9d1a0e7c857d tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:54.991656 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-32782655-8be7-4433-9faa-9d1a0e7c857d tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:55.035560 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-f7ee4973-a178-405c-9263-8c0dffed7bfd tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Going to run 1 instances... {{(pid=140491) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 20:54:55.053026 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-f7ee4973-a178-405c-9263-8c0dffed7bfd tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] [instance: e338d559-3f7c-4cc8-95c6-face79e11ca2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c508bd7f-7db9-4b2c-af7c-be54a855c355',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140491) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 20:54:55.144130 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-f7ee4973-a178-405c-9263-8c0dffed7bfd tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.940962 Oct 08 20:54:55.146463 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 449/951] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 20:54:53 2022] POST /compute/v2.1/servers => generated 406 bytes in 1945 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 08 20:54:55.152624 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-9877ac79-198c-4266-96c3-e50786f112cd tempest-UnshelveToHostMultiNodesTest-675009540 tempest-UnshelveToHostMultiNodesTest-675009540-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "nch1-master-1"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:54:55.155749 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-9877ac79-198c-4266-96c3-e50786f112cd tempest-UnshelveToHostMultiNodesTest-675009540 tempest-UnshelveToHostMultiNodesTest-675009540-project-admin] [instance: 92e31b92-0af1-4da6-bc87-23978f1aedf5] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:55.165333 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9877ac79-198c-4266-96c3-e50786f112cd tempest-UnshelveToHostMultiNodesTest-675009540 tempest-UnshelveToHostMultiNodesTest-675009540-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:55.166147 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9877ac79-198c-4266-96c3-e50786f112cd tempest-UnshelveToHostMultiNodesTest-675009540 tempest-UnshelveToHostMultiNodesTest-675009540-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:55.166758 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9877ac79-198c-4266-96c3-e50786f112cd tempest-UnshelveToHostMultiNodesTest-675009540 tempest-UnshelveToHostMultiNodesTest-675009540-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:55.168473 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9877ac79-198c-4266-96c3-e50786f112cd tempest-UnshelveToHostMultiNodesTest-675009540 tempest-UnshelveToHostMultiNodesTest-675009540-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:55.169134 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9877ac79-198c-4266-96c3-e50786f112cd tempest-UnshelveToHostMultiNodesTest-675009540 tempest-UnshelveToHostMultiNodesTest-675009540-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:55.170458 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9877ac79-198c-4266-96c3-e50786f112cd tempest-UnshelveToHostMultiNodesTest-675009540 tempest-UnshelveToHostMultiNodesTest-675009540-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:55.301720 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-9877ac79-198c-4266-96c3-e50786f112cd tempest-UnshelveToHostMultiNodesTest-675009540 tempest-UnshelveToHostMultiNodesTest-675009540-project-admin] [instance: 92e31b92-0af1-4da6-bc87-23978f1aedf5] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "nch1-master-1". {{(pid=140491) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 08 20:54:55.449035 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=3 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:54:55.466722 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-9877ac79-198c-4266-96c3-e50786f112cd tempest-UnshelveToHostMultiNodesTest-675009540 tempest-UnshelveToHostMultiNodesTest-675009540-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5/action" status: 202 len: 0 microversion: 2.91 time: 0.318829 Oct 08 20:54:55.470404 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 450/952] 10.222.0.26 () {62 vars in 1319 bytes} [Sat Oct 8 20:54:55 2022] POST /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5/action => generated 0 bytes in 323 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 08 20:54:55.484724 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-d8f52e24-984e-4755-b290-310b6d75f3ef tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:55.497426 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-d8f52e24-984e-4755-b290-310b6d75f3ef tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] [instance: 0cbc3ac5-5690-4f4e-a9d1-ea0de18060b1] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:55.514875 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d8f52e24-984e-4755-b290-310b6d75f3ef tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:55.515517 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d8f52e24-984e-4755-b290-310b6d75f3ef tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:55.515803 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d8f52e24-984e-4755-b290-310b6d75f3ef tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:55.516536 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d8f52e24-984e-4755-b290-310b6d75f3ef tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:55.517000 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d8f52e24-984e-4755-b290-310b6d75f3ef tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:55.517500 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d8f52e24-984e-4755-b290-310b6d75f3ef tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:55.554954 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=6 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:54:55.622091 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-32782655-8be7-4433-9faa-9d1a0e7c857d tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:55.629797 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:54:55.645977 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-32782655-8be7-4433-9faa-9d1a0e7c857d tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:55.649557 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-32782655-8be7-4433-9faa-9d1a0e7c857d tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:55.656738 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-32782655-8be7-4433-9faa-9d1a0e7c857d tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] 10.222.0.26 "GET /compute/v2.1/servers/f04fdc43-98fc-4bfc-a0f6-6efb9d2ee5bc" status: 200 len: 1568 microversion: 2.25 time: 0.724605 Oct 08 20:54:55.657602 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 503/953] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:54:54 2022] GET /compute/v2.1/servers/f04fdc43-98fc-4bfc-a0f6-6efb9d2ee5bc => generated 1568 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:54:55.664757 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e596c494-fb90-4e17-9c5d-e8098b8ac1cb tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:55.675934 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-e596c494-fb90-4e17-9c5d-e8098b8ac1cb tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] [instance: e338d559-3f7c-4cc8-95c6-face79e11ca2] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:55.707764 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:54:55.812317 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-e596c494-fb90-4e17-9c5d-e8098b8ac1cb tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474ca64d1b1d4e30916b517645aba882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecc2dd2407b4819874bed09cb27959a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:55.820530 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-e596c494-fb90-4e17-9c5d-e8098b8ac1cb tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] 10.222.0.26 "GET /compute/v2.1/servers/e338d559-3f7c-4cc8-95c6-face79e11ca2" status: 200 len: 1233 microversion: 2.1 time: 0.158586 Oct 08 20:54:55.832908 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 504/954] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:54:55 2022] GET /compute/v2.1/servers/e338d559-3f7c-4cc8-95c6-face79e11ca2 => generated 1233 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:54:55.838731 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-c8bc35cf-16ac-4d7f-95d4-dc015fc4cb06 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:55.839555 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-c8bc35cf-16ac-4d7f-95d4-dc015fc4cb06 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] [instance: 92e31b92-0af1-4da6-bc87-23978f1aedf5] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:55.850435 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c8bc35cf-16ac-4d7f-95d4-dc015fc4cb06 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:55.851128 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c8bc35cf-16ac-4d7f-95d4-dc015fc4cb06 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:55.852988 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c8bc35cf-16ac-4d7f-95d4-dc015fc4cb06 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:55.853965 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c8bc35cf-16ac-4d7f-95d4-dc015fc4cb06 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:55.856942 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c8bc35cf-16ac-4d7f-95d4-dc015fc4cb06 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:55.858183 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c8bc35cf-16ac-4d7f-95d4-dc015fc4cb06 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:55.931248 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-d8f52e24-984e-4755-b290-310b6d75f3ef tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bce55d7f67347aaaa4c2a687bdff183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb3706a1680419384f4fe9660e87732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:55.943183 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-d8f52e24-984e-4755-b290-310b6d75f3ef tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] 10.222.0.26 "GET /compute/v2.1/servers/0cbc3ac5-5690-4f4e-a9d1-ea0de18060b1" status: 200 len: 1317 microversion: 2.1 time: 0.470550 Oct 08 20:54:55.944586 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 451/955] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:54:55 2022] GET /compute/v2.1/servers/0cbc3ac5-5690-4f4e-a9d1-ea0de18060b1 => generated 1317 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:54:55.957402 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-05b74af6-44d9-4178-9285-87a04d2598cf tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:55.957402 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-05b74af6-44d9-4178-9285-87a04d2598cf tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] [instance: 73fd15ea-e4bd-4310-93bb-147b0a5e27ef] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:55.977491 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-05b74af6-44d9-4178-9285-87a04d2598cf tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:55.978302 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-05b74af6-44d9-4178-9285-87a04d2598cf tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:55.979299 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-05b74af6-44d9-4178-9285-87a04d2598cf tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:55.981477 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-05b74af6-44d9-4178-9285-87a04d2598cf tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:55.983508 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-05b74af6-44d9-4178-9285-87a04d2598cf tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:55.984270 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-05b74af6-44d9-4178-9285-87a04d2598cf tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:56.598103 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-05b74af6-44d9-4178-9285-87a04d2598cf tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef659f5a1a24c439528a7675bdd70f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c92fe04ab8248399d0acb932f82d607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:56.614916 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-05b74af6-44d9-4178-9285-87a04d2598cf tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] 10.222.0.26 "GET /compute/v2.1/servers/73fd15ea-e4bd-4310-93bb-147b0a5e27ef" status: 200 len: 1471 microversion: 2.1 time: 0.664993 Oct 08 20:54:56.617372 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 452/956] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:54:55 2022] GET /compute/v2.1/servers/73fd15ea-e4bd-4310-93bb-147b0a5e27ef => generated 1471 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:54:56.686859 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-791fa588-0ecf-49c4-846a-3d2b95f80476 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:56.687850 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-791fa588-0ecf-49c4-846a-3d2b95f80476 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] [instance: f04fdc43-98fc-4bfc-a0f6-6efb9d2ee5bc] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:56.702018 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-791fa588-0ecf-49c4-846a-3d2b95f80476 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:56.702638 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-791fa588-0ecf-49c4-846a-3d2b95f80476 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:56.704755 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-791fa588-0ecf-49c4-846a-3d2b95f80476 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:56.706962 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-791fa588-0ecf-49c4-846a-3d2b95f80476 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:56.708453 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-791fa588-0ecf-49c4-846a-3d2b95f80476 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:56.711631 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-791fa588-0ecf-49c4-846a-3d2b95f80476 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:56.862681 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-c8bc35cf-16ac-4d7f-95d4-dc015fc4cb06 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:56.895215 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-c8bc35cf-16ac-4d7f-95d4-dc015fc4cb06 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:56.896763 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-c8bc35cf-16ac-4d7f-95d4-dc015fc4cb06 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:56.922052 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-c8bc35cf-16ac-4d7f-95d4-dc015fc4cb06 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] 10.222.0.26 "GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5" status: 200 len: 1488 microversion: 2.91 time: 1.087503 Oct 08 20:54:56.927866 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 505/957] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:54:55 2022] GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5 => generated 1488 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:54:56.944906 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-121e96d5-7bfa-4aba-8ee7-0c2c36b7bc99 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:56.945572 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-121e96d5-7bfa-4aba-8ee7-0c2c36b7bc99 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] [instance: e338d559-3f7c-4cc8-95c6-face79e11ca2] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:56.969288 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-121e96d5-7bfa-4aba-8ee7-0c2c36b7bc99 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:56.969801 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-121e96d5-7bfa-4aba-8ee7-0c2c36b7bc99 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:56.975549 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-121e96d5-7bfa-4aba-8ee7-0c2c36b7bc99 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:56.976412 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-121e96d5-7bfa-4aba-8ee7-0c2c36b7bc99 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:56.976923 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-121e96d5-7bfa-4aba-8ee7-0c2c36b7bc99 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:56.977413 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-121e96d5-7bfa-4aba-8ee7-0c2c36b7bc99 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:57.261282 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-791fa588-0ecf-49c4-846a-3d2b95f80476 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:57.276566 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-791fa588-0ecf-49c4-846a-3d2b95f80476 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:57.278520 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-791fa588-0ecf-49c4-846a-3d2b95f80476 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:57.280903 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-791fa588-0ecf-49c4-846a-3d2b95f80476 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] 10.222.0.26 "GET /compute/v2.1/servers/f04fdc43-98fc-4bfc-a0f6-6efb9d2ee5bc" status: 200 len: 1568 microversion: 2.25 time: 0.598474 Oct 08 20:54:57.282270 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 453/958] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:54:56 2022] GET /compute/v2.1/servers/f04fdc43-98fc-4bfc-a0f6-6efb9d2ee5bc => generated 1568 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 08 20:54:57.287340 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-e26036ba-8561-4e76-a5d6-970c5a2f5058 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:57.288243 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-e26036ba-8561-4e76-a5d6-970c5a2f5058 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] [instance: 0cbc3ac5-5690-4f4e-a9d1-ea0de18060b1] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:57.298340 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e26036ba-8561-4e76-a5d6-970c5a2f5058 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:57.299205 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e26036ba-8561-4e76-a5d6-970c5a2f5058 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:57.306849 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e26036ba-8561-4e76-a5d6-970c5a2f5058 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:57.308197 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e26036ba-8561-4e76-a5d6-970c5a2f5058 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:57.308972 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e26036ba-8561-4e76-a5d6-970c5a2f5058 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:57.309738 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e26036ba-8561-4e76-a5d6-970c5a2f5058 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:57.314221 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-121e96d5-7bfa-4aba-8ee7-0c2c36b7bc99 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474ca64d1b1d4e30916b517645aba882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecc2dd2407b4819874bed09cb27959a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:57.325339 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-121e96d5-7bfa-4aba-8ee7-0c2c36b7bc99 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] 10.222.0.26 "GET /compute/v2.1/servers/e338d559-3f7c-4cc8-95c6-face79e11ca2" status: 200 len: 1285 microversion: 2.1 time: 0.395576 Oct 08 20:54:57.341091 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 506/959] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:54:56 2022] GET /compute/v2.1/servers/e338d559-3f7c-4cc8-95c6-face79e11ca2 => generated 1285 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:54:57.644710 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-0c25d210-93b0-41eb-9887-32bdc95f4f1f tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:57.645699 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-0c25d210-93b0-41eb-9887-32bdc95f4f1f tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] [instance: 73fd15ea-e4bd-4310-93bb-147b0a5e27ef] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:57.658581 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0c25d210-93b0-41eb-9887-32bdc95f4f1f tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:57.659386 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0c25d210-93b0-41eb-9887-32bdc95f4f1f tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:57.660287 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0c25d210-93b0-41eb-9887-32bdc95f4f1f tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:57.662618 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0c25d210-93b0-41eb-9887-32bdc95f4f1f tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:57.663422 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0c25d210-93b0-41eb-9887-32bdc95f4f1f tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:57.664385 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0c25d210-93b0-41eb-9887-32bdc95f4f1f tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:57.870942 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-e26036ba-8561-4e76-a5d6-970c5a2f5058 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bce55d7f67347aaaa4c2a687bdff183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb3706a1680419384f4fe9660e87732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:57.882911 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-e26036ba-8561-4e76-a5d6-970c5a2f5058 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] 10.222.0.26 "GET /compute/v2.1/servers/0cbc3ac5-5690-4f4e-a9d1-ea0de18060b1" status: 200 len: 1317 microversion: 2.1 time: 0.599245 Oct 08 20:54:57.898744 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 454/960] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:54:57 2022] GET /compute/v2.1/servers/0cbc3ac5-5690-4f4e-a9d1-ea0de18060b1 => generated 1317 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:54:57.955404 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-f089640f-3871-41af-979b-fb1938213ecd tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:57.956790 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-f089640f-3871-41af-979b-fb1938213ecd tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] [instance: 92e31b92-0af1-4da6-bc87-23978f1aedf5] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:57.973602 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f089640f-3871-41af-979b-fb1938213ecd tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:57.974724 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f089640f-3871-41af-979b-fb1938213ecd tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:57.977213 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f089640f-3871-41af-979b-fb1938213ecd tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:57.978194 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f089640f-3871-41af-979b-fb1938213ecd tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:57.979895 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f089640f-3871-41af-979b-fb1938213ecd tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:57.983830 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f089640f-3871-41af-979b-fb1938213ecd tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:58.122433 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-f089640f-3871-41af-979b-fb1938213ecd tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:58.132230 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-f089640f-3871-41af-979b-fb1938213ecd tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:58.134226 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-f089640f-3871-41af-979b-fb1938213ecd tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:58.140972 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-f089640f-3871-41af-979b-fb1938213ecd tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] 10.222.0.26 "GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5" status: 200 len: 1546 microversion: 2.91 time: 0.190515 Oct 08 20:54:58.162395 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 455/961] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:54:57 2022] GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5 => generated 1546 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 08 20:54:58.223654 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-0c25d210-93b0-41eb-9887-32bdc95f4f1f tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef659f5a1a24c439528a7675bdd70f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c92fe04ab8248399d0acb932f82d607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:58.233889 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-0c25d210-93b0-41eb-9887-32bdc95f4f1f tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] 10.222.0.26 "GET /compute/v2.1/servers/73fd15ea-e4bd-4310-93bb-147b0a5e27ef" status: 200 len: 1471 microversion: 2.1 time: 0.593065 Oct 08 20:54:58.255308 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 507/962] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:54:57 2022] GET /compute/v2.1/servers/73fd15ea-e4bd-4310-93bb-147b0a5e27ef => generated 1471 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 20:54:58.316513 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-6fc843ce-8911-41d2-8a5d-3bb9b65d9837 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:58.317443 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-6fc843ce-8911-41d2-8a5d-3bb9b65d9837 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] [instance: f04fdc43-98fc-4bfc-a0f6-6efb9d2ee5bc] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:58.323992 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6fc843ce-8911-41d2-8a5d-3bb9b65d9837 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:58.332549 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6fc843ce-8911-41d2-8a5d-3bb9b65d9837 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:58.333052 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6fc843ce-8911-41d2-8a5d-3bb9b65d9837 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:58.334750 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6fc843ce-8911-41d2-8a5d-3bb9b65d9837 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:58.335444 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6fc843ce-8911-41d2-8a5d-3bb9b65d9837 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:58.336065 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6fc843ce-8911-41d2-8a5d-3bb9b65d9837 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:58.347974 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-7e32216c-194c-40d2-a33b-800000a50470 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:58.348605 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-7e32216c-194c-40d2-a33b-800000a50470 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] [instance: e338d559-3f7c-4cc8-95c6-face79e11ca2] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:58.356293 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7e32216c-194c-40d2-a33b-800000a50470 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:58.356936 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7e32216c-194c-40d2-a33b-800000a50470 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:58.357791 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7e32216c-194c-40d2-a33b-800000a50470 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:58.358529 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7e32216c-194c-40d2-a33b-800000a50470 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:58.359062 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7e32216c-194c-40d2-a33b-800000a50470 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:58.359453 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7e32216c-194c-40d2-a33b-800000a50470 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:58.663061 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-7e32216c-194c-40d2-a33b-800000a50470 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474ca64d1b1d4e30916b517645aba882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecc2dd2407b4819874bed09cb27959a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:58.677957 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-7e32216c-194c-40d2-a33b-800000a50470 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] 10.222.0.26 "GET /compute/v2.1/servers/e338d559-3f7c-4cc8-95c6-face79e11ca2" status: 200 len: 1291 microversion: 2.1 time: 0.333313 Oct 08 20:54:58.679142 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 508/963] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:54:58 2022] GET /compute/v2.1/servers/e338d559-3f7c-4cc8-95c6-face79e11ca2 => generated 1291 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:54:58.688035 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-ce56601b-3efa-4aba-9568-2eecf4256578 req-72ce2550-edb3-41ba-9a2b-9e5309a96f99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f04fdc43-98fc-4bfc-a0f6-6efb9d2ee5bc", "name": "network-vif-unplugged", "status": "completed", "tag": "84bc0e3e-26ae-44e6-9044-9b319506b2ff"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:54:58.714217 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-ce56601b-3efa-4aba-9568-2eecf4256578 req-72ce2550-edb3-41ba-9a2b-9e5309a96f99 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:58.714724 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-ce56601b-3efa-4aba-9568-2eecf4256578 req-72ce2550-edb3-41ba-9a2b-9e5309a96f99 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:58.715176 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-ce56601b-3efa-4aba-9568-2eecf4256578 req-72ce2550-edb3-41ba-9a2b-9e5309a96f99 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:58.746405 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-ce56601b-3efa-4aba-9568-2eecf4256578 req-72ce2550-edb3-41ba-9a2b-9e5309a96f99 service nova] Creating event network-vif-unplugged:84bc0e3e-26ae-44e6-9044-9b319506b2ff for instance f04fdc43-98fc-4bfc-a0f6-6efb9d2ee5bc on nch1-master-1 Oct 08 20:54:58.760783 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-ce56601b-3efa-4aba-9568-2eecf4256578 req-72ce2550-edb3-41ba-9a2b-9e5309a96f99 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.080458 Oct 08 20:54:58.767979 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 509/964] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:54:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:54:58.773858 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-42d3e9f0-26a7-4b33-8477-0b08bf40929e req-31527da7-ba13-42aa-9454-c27be9a9aabb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24300a5e-164c-4d97-9a1f-b52359c1c0d6", "name": "network-vif-plugged", "status": "completed", "tag": "2fe7c081-3e45-4535-9c6e-1d2e86219410"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:54:58.802137 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-42d3e9f0-26a7-4b33-8477-0b08bf40929e req-31527da7-ba13-42aa-9454-c27be9a9aabb service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:58.802883 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-42d3e9f0-26a7-4b33-8477-0b08bf40929e req-31527da7-ba13-42aa-9454-c27be9a9aabb service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:58.803750 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-42d3e9f0-26a7-4b33-8477-0b08bf40929e req-31527da7-ba13-42aa-9454-c27be9a9aabb service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:58.827666 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-42d3e9f0-26a7-4b33-8477-0b08bf40929e req-31527da7-ba13-42aa-9454-c27be9a9aabb service nova] Creating event network-vif-plugged:2fe7c081-3e45-4535-9c6e-1d2e86219410 for instance 24300a5e-164c-4d97-9a1f-b52359c1c0d6 on nch1-master-1 Oct 08 20:54:58.845833 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-42d3e9f0-26a7-4b33-8477-0b08bf40929e req-31527da7-ba13-42aa-9454-c27be9a9aabb service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076241 Oct 08 20:54:58.847024 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 510/965] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:54:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:54:58.906533 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-b824e6c1-9ef1-4e4e-b014-af7895c19228 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:58.907829 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-b824e6c1-9ef1-4e4e-b014-af7895c19228 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] [instance: 0cbc3ac5-5690-4f4e-a9d1-ea0de18060b1] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:58.918968 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b824e6c1-9ef1-4e4e-b014-af7895c19228 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:58.924952 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b824e6c1-9ef1-4e4e-b014-af7895c19228 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:58.934634 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b824e6c1-9ef1-4e4e-b014-af7895c19228 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:58.940949 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b824e6c1-9ef1-4e4e-b014-af7895c19228 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:58.959251 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b824e6c1-9ef1-4e4e-b014-af7895c19228 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:58.960456 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b824e6c1-9ef1-4e4e-b014-af7895c19228 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:59.320355 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-6fc843ce-8911-41d2-8a5d-3bb9b65d9837 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:59.334164 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-6fc843ce-8911-41d2-8a5d-3bb9b65d9837 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:59.336508 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-6fc843ce-8911-41d2-8a5d-3bb9b65d9837 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:59.338566 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-6fc843ce-8911-41d2-8a5d-3bb9b65d9837 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] 10.222.0.26 "GET /compute/v2.1/servers/f04fdc43-98fc-4bfc-a0f6-6efb9d2ee5bc" status: 200 len: 1568 microversion: 2.25 time: 1.028551 Oct 08 20:54:59.339907 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 456/966] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:54:58 2022] GET /compute/v2.1/servers/f04fdc43-98fc-4bfc-a0f6-6efb9d2ee5bc => generated 1568 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:54:59.345806 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-3e0865c4-e316-44af-99d0-b79379d23cff tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:59.346753 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-3e0865c4-e316-44af-99d0-b79379d23cff tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] [instance: 92e31b92-0af1-4da6-bc87-23978f1aedf5] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:59.354252 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3e0865c4-e316-44af-99d0-b79379d23cff tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:59.355598 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3e0865c4-e316-44af-99d0-b79379d23cff tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:59.356274 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3e0865c4-e316-44af-99d0-b79379d23cff tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:59.357927 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3e0865c4-e316-44af-99d0-b79379d23cff tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:59.358631 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3e0865c4-e316-44af-99d0-b79379d23cff tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:59.359276 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3e0865c4-e316-44af-99d0-b79379d23cff tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:59.548159 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-3e0865c4-e316-44af-99d0-b79379d23cff tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:59.567324 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-3e0865c4-e316-44af-99d0-b79379d23cff tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:59.569114 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-3e0865c4-e316-44af-99d0-b79379d23cff tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:59.576926 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-3e0865c4-e316-44af-99d0-b79379d23cff tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] 10.222.0.26 "GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5" status: 200 len: 1546 microversion: 2.91 time: 0.234975 Oct 08 20:54:59.578401 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 457/967] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:54:59 2022] GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5 => generated 1546 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:54:59.584521 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-5593ec9c-cc36-4009-bad1-bdb641fec914 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:59.585542 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-5593ec9c-cc36-4009-bad1-bdb641fec914 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] [instance: 73fd15ea-e4bd-4310-93bb-147b0a5e27ef] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:59.593021 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5593ec9c-cc36-4009-bad1-bdb641fec914 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:59.594476 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5593ec9c-cc36-4009-bad1-bdb641fec914 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:59.595156 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5593ec9c-cc36-4009-bad1-bdb641fec914 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:59.596132 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5593ec9c-cc36-4009-bad1-bdb641fec914 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:59.596848 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5593ec9c-cc36-4009-bad1-bdb641fec914 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:59.597536 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5593ec9c-cc36-4009-bad1-bdb641fec914 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:59.786856 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-b824e6c1-9ef1-4e4e-b014-af7895c19228 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bce55d7f67347aaaa4c2a687bdff183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb3706a1680419384f4fe9660e87732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:59.796911 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-b824e6c1-9ef1-4e4e-b014-af7895c19228 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] 10.222.0.26 "GET /compute/v2.1/servers/0cbc3ac5-5690-4f4e-a9d1-ea0de18060b1" status: 200 len: 1317 microversion: 2.1 time: 0.894647 Oct 08 20:54:59.802734 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 511/968] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:54:58 2022] GET /compute/v2.1/servers/0cbc3ac5-5690-4f4e-a9d1-ea0de18060b1 => generated 1317 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 20:54:59.807511 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-2f0260b7-d842-40a7-acdd-0a70b3d78235 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:54:59.808135 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-2f0260b7-d842-40a7-acdd-0a70b3d78235 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] [instance: e338d559-3f7c-4cc8-95c6-face79e11ca2] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:54:59.831073 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2f0260b7-d842-40a7-acdd-0a70b3d78235 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:59.831589 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2f0260b7-d842-40a7-acdd-0a70b3d78235 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:59.832038 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2f0260b7-d842-40a7-acdd-0a70b3d78235 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:59.832760 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2f0260b7-d842-40a7-acdd-0a70b3d78235 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:54:59.833249 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2f0260b7-d842-40a7-acdd-0a70b3d78235 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:54:59.833689 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2f0260b7-d842-40a7-acdd-0a70b3d78235 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:54:59.937268 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-5593ec9c-cc36-4009-bad1-bdb641fec914 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef659f5a1a24c439528a7675bdd70f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c92fe04ab8248399d0acb932f82d607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:54:59.945676 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-5593ec9c-cc36-4009-bad1-bdb641fec914 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] 10.222.0.26 "GET /compute/v2.1/servers/73fd15ea-e4bd-4310-93bb-147b0a5e27ef" status: 200 len: 1471 microversion: 2.1 time: 0.365959 Oct 08 20:54:59.948608 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 458/969] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:54:59 2022] GET /compute/v2.1/servers/73fd15ea-e4bd-4310-93bb-147b0a5e27ef => generated 1471 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:55:00.373957 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c62566dc-c6d8-42c6-ae2a-2beb44a9cc0c tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:00.374697 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-c62566dc-c6d8-42c6-ae2a-2beb44a9cc0c tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] [instance: f04fdc43-98fc-4bfc-a0f6-6efb9d2ee5bc] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:55:00.389117 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c62566dc-c6d8-42c6-ae2a-2beb44a9cc0c tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:00.397281 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c62566dc-c6d8-42c6-ae2a-2beb44a9cc0c tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:00.398046 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c62566dc-c6d8-42c6-ae2a-2beb44a9cc0c tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:00.402453 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c62566dc-c6d8-42c6-ae2a-2beb44a9cc0c tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:00.403137 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c62566dc-c6d8-42c6-ae2a-2beb44a9cc0c tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:00.403751 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c62566dc-c6d8-42c6-ae2a-2beb44a9cc0c tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:00.409441 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:55:01.007525 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-c62566dc-c6d8-42c6-ae2a-2beb44a9cc0c tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:01.019439 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-c62566dc-c6d8-42c6-ae2a-2beb44a9cc0c tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:01.033427 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-c62566dc-c6d8-42c6-ae2a-2beb44a9cc0c tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:01.038097 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-c62566dc-c6d8-42c6-ae2a-2beb44a9cc0c tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] 10.222.0.26 "GET /compute/v2.1/servers/f04fdc43-98fc-4bfc-a0f6-6efb9d2ee5bc" status: 200 len: 1568 microversion: 2.25 time: 0.669824 Oct 08 20:55:01.040733 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 459/970] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:55:00 2022] GET /compute/v2.1/servers/f04fdc43-98fc-4bfc-a0f6-6efb9d2ee5bc => generated 1568 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 08 20:55:01.063808 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-99128610-505c-4005-9154-4f08db6cd294 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:01.064819 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-99128610-505c-4005-9154-4f08db6cd294 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] [instance: 92e31b92-0af1-4da6-bc87-23978f1aedf5] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:55:01.075731 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-99128610-505c-4005-9154-4f08db6cd294 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:01.081735 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-99128610-505c-4005-9154-4f08db6cd294 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:01.082472 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-99128610-505c-4005-9154-4f08db6cd294 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:01.083434 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-99128610-505c-4005-9154-4f08db6cd294 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:01.084085 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-99128610-505c-4005-9154-4f08db6cd294 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:01.084727 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-99128610-505c-4005-9154-4f08db6cd294 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:01.235966 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-99128610-505c-4005-9154-4f08db6cd294 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:01.255566 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-99128610-505c-4005-9154-4f08db6cd294 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:01.263685 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-99128610-505c-4005-9154-4f08db6cd294 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:01.281790 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-99128610-505c-4005-9154-4f08db6cd294 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] 10.222.0.26 "GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5" status: 200 len: 1546 microversion: 2.91 time: 0.238203 Oct 08 20:55:01.285925 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 460/971] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:55:01 2022] GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5 => generated 1546 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:55:01.291842 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-7f1f952a-fbc4-44da-976a-2c9377075366 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:01.293213 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-7f1f952a-fbc4-44da-976a-2c9377075366 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] [instance: 0cbc3ac5-5690-4f4e-a9d1-ea0de18060b1] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:55:01.308740 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7f1f952a-fbc4-44da-976a-2c9377075366 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:01.312063 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7f1f952a-fbc4-44da-976a-2c9377075366 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:01.313575 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7f1f952a-fbc4-44da-976a-2c9377075366 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:01.314590 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7f1f952a-fbc4-44da-976a-2c9377075366 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:01.315265 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7f1f952a-fbc4-44da-976a-2c9377075366 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:01.338441 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7f1f952a-fbc4-44da-976a-2c9377075366 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:01.517851 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-2f0260b7-d842-40a7-acdd-0a70b3d78235 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474ca64d1b1d4e30916b517645aba882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecc2dd2407b4819874bed09cb27959a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:01.529956 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-2f0260b7-d842-40a7-acdd-0a70b3d78235 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] 10.222.0.26 "GET /compute/v2.1/servers/e338d559-3f7c-4cc8-95c6-face79e11ca2" status: 200 len: 1359 microversion: 2.1 time: 1.723289 Oct 08 20:55:01.541881 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 512/972] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:54:59 2022] GET /compute/v2.1/servers/e338d559-3f7c-4cc8-95c6-face79e11ca2 => generated 1359 bytes in 1729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:55:01.550081 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-802d7f1d-b8fd-417a-9436-8008f3421167 req-6033eaf1-839c-4c05-a972-b993833aa18e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cbc3ac5-5690-4f4e-a9d1-ea0de18060b1", "name": "network-vif-plugged", "status": "completed", "tag": "20694e26-0b3a-4a5f-9806-aa0485a844f5"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:55:01.581565 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-802d7f1d-b8fd-417a-9436-8008f3421167 req-6033eaf1-839c-4c05-a972-b993833aa18e service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:01.582762 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-802d7f1d-b8fd-417a-9436-8008f3421167 req-6033eaf1-839c-4c05-a972-b993833aa18e service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:01.583924 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-802d7f1d-b8fd-417a-9436-8008f3421167 req-6033eaf1-839c-4c05-a972-b993833aa18e service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:01.626855 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-802d7f1d-b8fd-417a-9436-8008f3421167 req-6033eaf1-839c-4c05-a972-b993833aa18e service nova] Creating event network-vif-plugged:20694e26-0b3a-4a5f-9806-aa0485a844f5 for instance 0cbc3ac5-5690-4f4e-a9d1-ea0de18060b1 on nch1-master-1 Oct 08 20:55:01.626855 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-802d7f1d-b8fd-417a-9436-8008f3421167 req-6033eaf1-839c-4c05-a972-b993833aa18e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091075 Oct 08 20:55:01.652821 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 513/973] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:55:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:55:01.676824 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e78e8d71-a501-406f-bb60-8c41fa69f440 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:01.682970 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-e78e8d71-a501-406f-bb60-8c41fa69f440 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] [instance: 73fd15ea-e4bd-4310-93bb-147b0a5e27ef] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:55:01.723605 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e78e8d71-a501-406f-bb60-8c41fa69f440 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:01.724758 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e78e8d71-a501-406f-bb60-8c41fa69f440 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:01.730792 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e78e8d71-a501-406f-bb60-8c41fa69f440 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:01.734002 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e78e8d71-a501-406f-bb60-8c41fa69f440 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:01.739142 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e78e8d71-a501-406f-bb60-8c41fa69f440 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:01.740383 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e78e8d71-a501-406f-bb60-8c41fa69f440 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:01.957899 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-7f1f952a-fbc4-44da-976a-2c9377075366 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bce55d7f67347aaaa4c2a687bdff183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb3706a1680419384f4fe9660e87732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:01.975347 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-7f1f952a-fbc4-44da-976a-2c9377075366 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] 10.222.0.26 "GET /compute/v2.1/servers/0cbc3ac5-5690-4f4e-a9d1-ea0de18060b1" status: 200 len: 1317 microversion: 2.1 time: 0.688008 Oct 08 20:55:01.975947 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 461/974] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:55:01 2022] GET /compute/v2.1/servers/0cbc3ac5-5690-4f4e-a9d1-ea0de18060b1 => generated 1317 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:55:02.004316 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-ff143edd-156c-40fa-8da7-c36cf1b2196a req-b1304580-0f44-4a67-941a-ca3517002825 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f04fdc43-98fc-4bfc-a0f6-6efb9d2ee5bc", "tag": "84bc0e3e-26ae-44e6-9044-9b319506b2ff"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:55:02.025525 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-ff143edd-156c-40fa-8da7-c36cf1b2196a req-b1304580-0f44-4a67-941a-ca3517002825 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:02.028333 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-ff143edd-156c-40fa-8da7-c36cf1b2196a req-b1304580-0f44-4a67-941a-ca3517002825 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:02.029847 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-ff143edd-156c-40fa-8da7-c36cf1b2196a req-b1304580-0f44-4a67-941a-ca3517002825 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:02.060881 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-ff143edd-156c-40fa-8da7-c36cf1b2196a req-b1304580-0f44-4a67-941a-ca3517002825 service nova] Creating event network-changed:84bc0e3e-26ae-44e6-9044-9b319506b2ff for instance f04fdc43-98fc-4bfc-a0f6-6efb9d2ee5bc on nch1-master-1 Oct 08 20:55:02.078668 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-ff143edd-156c-40fa-8da7-c36cf1b2196a req-b1304580-0f44-4a67-941a-ca3517002825 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097761 Oct 08 20:55:02.085675 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 462/975] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:55:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:55:02.239539 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-e78e8d71-a501-406f-bb60-8c41fa69f440 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef659f5a1a24c439528a7675bdd70f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c92fe04ab8248399d0acb932f82d607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:02.250489 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-e78e8d71-a501-406f-bb60-8c41fa69f440 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] 10.222.0.26 "GET /compute/v2.1/servers/73fd15ea-e4bd-4310-93bb-147b0a5e27ef" status: 200 len: 1471 microversion: 2.1 time: 0.594569 Oct 08 20:55:02.251157 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 514/976] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:55:01 2022] GET /compute/v2.1/servers/73fd15ea-e4bd-4310-93bb-147b0a5e27ef => generated 1471 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:55:02.265639 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-32d15320-f82f-4d2a-a429-a5770120ad5d tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:02.266472 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-32d15320-f82f-4d2a-a429-a5770120ad5d tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] [instance: f04fdc43-98fc-4bfc-a0f6-6efb9d2ee5bc] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:55:02.286842 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-32d15320-f82f-4d2a-a429-a5770120ad5d tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:02.293949 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-32d15320-f82f-4d2a-a429-a5770120ad5d tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:02.299067 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-32d15320-f82f-4d2a-a429-a5770120ad5d tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:02.300011 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-32d15320-f82f-4d2a-a429-a5770120ad5d tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:02.301373 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-32d15320-f82f-4d2a-a429-a5770120ad5d tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:02.302189 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-32d15320-f82f-4d2a-a429-a5770120ad5d tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:02.447518 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-4afde5bd-2dc7-4c3f-aaca-68aca7cfdd05 tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] Action: 'create', calling method: .version_select at 0x7f1a8c9e9e50>, body: {"keypair": {"name": "tempest-keypair-2083264648", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLeRu1FxEAjA2cGGyj4dOf/CLN6qZOXczAbmQoMiAfHATlXLFf9ry6EzMis5NX1ezf7Nrb1X3i1l3MG1YXthfS88S9ltNpRlN2x0uyncDomNiuNg8JmEghsEgmHZzL4wBw=="}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:55:02.488776 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-4afde5bd-2dc7-4c3f-aaca-68aca7cfdd05 tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] Getting quotas for project 4e277ebf9cbf4cb0b6be14efbec504bf. Resources: {'key_pairs'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 20:55:02.505090 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-4afde5bd-2dc7-4c3f-aaca-68aca7cfdd05 tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] Getting quotas for user f6cf9c6c133947f3aecee3a913a32328 and project 4e277ebf9cbf4cb0b6be14efbec504bf. Resources: {'key_pairs'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 20:55:02.567774 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-4afde5bd-2dc7-4c3f-aaca-68aca7cfdd05 tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.477931 Oct 08 20:55:02.570295 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 463/977] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Oct 8 20:55:02 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:55:02.587463 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-c8639a21-8a69-4424-abed-930e3864f988 req-3c54ec51-83cd-4fac-99fa-d2b2cc1f2a3b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e338d559-3f7c-4cc8-95c6-face79e11ca2", "tag": "c9d2434a-d900-4b35-afb9-1bca1da86155"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:55:02.599238 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-c8639a21-8a69-4424-abed-930e3864f988 req-3c54ec51-83cd-4fac-99fa-d2b2cc1f2a3b service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:02.600226 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-c8639a21-8a69-4424-abed-930e3864f988 req-3c54ec51-83cd-4fac-99fa-d2b2cc1f2a3b service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:02.601301 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-c8639a21-8a69-4424-abed-930e3864f988 req-3c54ec51-83cd-4fac-99fa-d2b2cc1f2a3b service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:02.617417 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-c8639a21-8a69-4424-abed-930e3864f988 req-3c54ec51-83cd-4fac-99fa-d2b2cc1f2a3b service nova] Creating event network-changed:c9d2434a-d900-4b35-afb9-1bca1da86155 for instance e338d559-3f7c-4cc8-95c6-face79e11ca2 on nch2-master-1 Oct 08 20:55:02.625833 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-c8639a21-8a69-4424-abed-930e3864f988 req-3c54ec51-83cd-4fac-99fa-d2b2cc1f2a3b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054143 Oct 08 20:55:02.627317 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 464/978] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:55:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:55:02.647701 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-98e6b997-48c3-4993-ae9a-b2c7437385a5 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:02.650404 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-98e6b997-48c3-4993-ae9a-b2c7437385a5 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] [instance: 92e31b92-0af1-4da6-bc87-23978f1aedf5] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:55:02.660931 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-98e6b997-48c3-4993-ae9a-b2c7437385a5 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:02.662165 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-98e6b997-48c3-4993-ae9a-b2c7437385a5 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:02.662962 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-98e6b997-48c3-4993-ae9a-b2c7437385a5 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:02.664046 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-98e6b997-48c3-4993-ae9a-b2c7437385a5 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:02.664754 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-98e6b997-48c3-4993-ae9a-b2c7437385a5 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:02.665625 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-98e6b997-48c3-4993-ae9a-b2c7437385a5 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:02.813767 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-98e6b997-48c3-4993-ae9a-b2c7437385a5 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:02.833374 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-98e6b997-48c3-4993-ae9a-b2c7437385a5 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:02.839275 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-98e6b997-48c3-4993-ae9a-b2c7437385a5 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:02.850794 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-98e6b997-48c3-4993-ae9a-b2c7437385a5 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] 10.222.0.26 "GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5" status: 200 len: 1546 microversion: 2.91 time: 0.221650 Oct 08 20:55:02.857556 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 465/979] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:55:02 2022] GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5 => generated 1546 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:55:02.861785 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-32d15320-f82f-4d2a-a429-a5770120ad5d tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:02.871454 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-32d15320-f82f-4d2a-a429-a5770120ad5d tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:02.875422 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-fbcbfe37-8bef-4d5a-b420-9eb3d2ae2108 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:02.876059 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-fbcbfe37-8bef-4d5a-b420-9eb3d2ae2108 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] [instance: e338d559-3f7c-4cc8-95c6-face79e11ca2] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:55:02.877326 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-32d15320-f82f-4d2a-a429-a5770120ad5d tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:02.878543 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-32d15320-f82f-4d2a-a429-a5770120ad5d tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] 10.222.0.26 "GET /compute/v2.1/servers/f04fdc43-98fc-4bfc-a0f6-6efb9d2ee5bc" status: 200 len: 1568 microversion: 2.25 time: 0.625372 Oct 08 20:55:02.891346 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 515/980] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:55:02 2022] GET /compute/v2.1/servers/f04fdc43-98fc-4bfc-a0f6-6efb9d2ee5bc => generated 1568 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:55:02.899040 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fbcbfe37-8bef-4d5a-b420-9eb3d2ae2108 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:02.901601 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fbcbfe37-8bef-4d5a-b420-9eb3d2ae2108 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:02.904996 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fbcbfe37-8bef-4d5a-b420-9eb3d2ae2108 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:02.910448 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fbcbfe37-8bef-4d5a-b420-9eb3d2ae2108 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:02.911374 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fbcbfe37-8bef-4d5a-b420-9eb3d2ae2108 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:02.913059 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fbcbfe37-8bef-4d5a-b420-9eb3d2ae2108 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:03.000881 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-5a7e8010-d691-4216-83fa-00183cf6875f tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:03.001672 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-5a7e8010-d691-4216-83fa-00183cf6875f tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] [instance: 0cbc3ac5-5690-4f4e-a9d1-ea0de18060b1] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:55:03.011087 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5a7e8010-d691-4216-83fa-00183cf6875f tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:03.018357 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5a7e8010-d691-4216-83fa-00183cf6875f tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:03.019160 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5a7e8010-d691-4216-83fa-00183cf6875f tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:03.020016 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5a7e8010-d691-4216-83fa-00183cf6875f tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:03.020573 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5a7e8010-d691-4216-83fa-00183cf6875f tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:03.021078 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5a7e8010-d691-4216-83fa-00183cf6875f tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:03.281845 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-fbcbfe37-8bef-4d5a-b420-9eb3d2ae2108 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474ca64d1b1d4e30916b517645aba882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecc2dd2407b4819874bed09cb27959a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:03.291426 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-fbcbfe37-8bef-4d5a-b420-9eb3d2ae2108 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] 10.222.0.26 "GET /compute/v2.1/servers/e338d559-3f7c-4cc8-95c6-face79e11ca2" status: 200 len: 1359 microversion: 2.1 time: 0.432283 Oct 08 20:55:03.292844 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 466/981] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:55:02 2022] GET /compute/v2.1/servers/e338d559-3f7c-4cc8-95c6-face79e11ca2 => generated 1359 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:55:03.298316 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-2a988266-4eed-4523-bfd1-9cf6d69eb821 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:03.298938 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-2a988266-4eed-4523-bfd1-9cf6d69eb821 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] [instance: 73fd15ea-e4bd-4310-93bb-147b0a5e27ef] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:55:03.321683 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2a988266-4eed-4523-bfd1-9cf6d69eb821 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:03.322843 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2a988266-4eed-4523-bfd1-9cf6d69eb821 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:03.324111 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2a988266-4eed-4523-bfd1-9cf6d69eb821 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:03.324111 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2a988266-4eed-4523-bfd1-9cf6d69eb821 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:03.324493 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2a988266-4eed-4523-bfd1-9cf6d69eb821 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:03.325032 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2a988266-4eed-4523-bfd1-9cf6d69eb821 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:03.768980 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-5a7e8010-d691-4216-83fa-00183cf6875f tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bce55d7f67347aaaa4c2a687bdff183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb3706a1680419384f4fe9660e87732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:03.780888 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-5a7e8010-d691-4216-83fa-00183cf6875f tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] 10.222.0.26 "GET /compute/v2.1/servers/0cbc3ac5-5690-4f4e-a9d1-ea0de18060b1" status: 200 len: 1317 microversion: 2.1 time: 0.784507 Oct 08 20:55:03.783768 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 516/982] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:55:02 2022] GET /compute/v2.1/servers/0cbc3ac5-5690-4f4e-a9d1-ea0de18060b1 => generated 1317 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 20:55:03.836057 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-2a988266-4eed-4523-bfd1-9cf6d69eb821 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef659f5a1a24c439528a7675bdd70f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c92fe04ab8248399d0acb932f82d607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:03.847219 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-2a988266-4eed-4523-bfd1-9cf6d69eb821 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] 10.222.0.26 "GET /compute/v2.1/servers/73fd15ea-e4bd-4310-93bb-147b0a5e27ef" status: 200 len: 1477 microversion: 2.1 time: 0.553090 Oct 08 20:55:03.850241 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 467/983] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:55:03 2022] GET /compute/v2.1/servers/73fd15ea-e4bd-4310-93bb-147b0a5e27ef => generated 1477 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:55:03.888132 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-63b6c415-f48c-44e2-967c-5519059fd78c tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:03.890020 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-63b6c415-f48c-44e2-967c-5519059fd78c tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] [instance: 92e31b92-0af1-4da6-bc87-23978f1aedf5] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:55:03.899547 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-63b6c415-f48c-44e2-967c-5519059fd78c tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:03.900649 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-63b6c415-f48c-44e2-967c-5519059fd78c tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:03.901371 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-63b6c415-f48c-44e2-967c-5519059fd78c tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:03.902986 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-63b6c415-f48c-44e2-967c-5519059fd78c tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:03.903683 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-63b6c415-f48c-44e2-967c-5519059fd78c tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:03.904250 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-63b6c415-f48c-44e2-967c-5519059fd78c tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:03.932021 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-9c7805c0-6f11-4b50-bdac-633c39a20f47 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:03.933805 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-9c7805c0-6f11-4b50-bdac-633c39a20f47 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] [instance: f04fdc43-98fc-4bfc-a0f6-6efb9d2ee5bc] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:55:03.949100 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9c7805c0-6f11-4b50-bdac-633c39a20f47 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:03.954725 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9c7805c0-6f11-4b50-bdac-633c39a20f47 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:03.956073 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9c7805c0-6f11-4b50-bdac-633c39a20f47 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:03.959108 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9c7805c0-6f11-4b50-bdac-633c39a20f47 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:03.961961 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9c7805c0-6f11-4b50-bdac-633c39a20f47 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:03.962794 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9c7805c0-6f11-4b50-bdac-633c39a20f47 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:04.085724 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-63b6c415-f48c-44e2-967c-5519059fd78c tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:04.111559 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-63b6c415-f48c-44e2-967c-5519059fd78c tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:04.121349 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-63b6c415-f48c-44e2-967c-5519059fd78c tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:04.143008 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-63b6c415-f48c-44e2-967c-5519059fd78c tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] 10.222.0.26 "GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5" status: 200 len: 1546 microversion: 2.91 time: 0.255623 Oct 08 20:55:04.153310 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 517/984] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:55:03 2022] GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5 => generated 1546 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:55:04.279493 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-9c7805c0-6f11-4b50-bdac-633c39a20f47 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:04.287425 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-9c7805c0-6f11-4b50-bdac-633c39a20f47 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:04.293005 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-9c7805c0-6f11-4b50-bdac-633c39a20f47 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:04.295892 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-9c7805c0-6f11-4b50-bdac-633c39a20f47 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] 10.222.0.26 "GET /compute/v2.1/servers/f04fdc43-98fc-4bfc-a0f6-6efb9d2ee5bc" status: 200 len: 1568 microversion: 2.25 time: 0.366380 Oct 08 20:55:04.296712 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 468/985] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:55:03 2022] GET /compute/v2.1/servers/f04fdc43-98fc-4bfc-a0f6-6efb9d2ee5bc => generated 1568 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:55:04.320768 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-5a6a96af-9c6e-46af-b51b-b19f9b812bf4 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:04.321417 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-5a6a96af-9c6e-46af-b51b-b19f9b812bf4 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] [instance: e338d559-3f7c-4cc8-95c6-face79e11ca2] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:55:04.334729 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5a6a96af-9c6e-46af-b51b-b19f9b812bf4 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:04.335232 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5a6a96af-9c6e-46af-b51b-b19f9b812bf4 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:04.336983 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5a6a96af-9c6e-46af-b51b-b19f9b812bf4 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:04.339610 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5a6a96af-9c6e-46af-b51b-b19f9b812bf4 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:04.340530 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5a6a96af-9c6e-46af-b51b-b19f9b812bf4 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:04.342054 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5a6a96af-9c6e-46af-b51b-b19f9b812bf4 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:04.608212 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-5a6a96af-9c6e-46af-b51b-b19f9b812bf4 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474ca64d1b1d4e30916b517645aba882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecc2dd2407b4819874bed09cb27959a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:04.630170 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-5a6a96af-9c6e-46af-b51b-b19f9b812bf4 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] 10.222.0.26 "GET /compute/v2.1/servers/e338d559-3f7c-4cc8-95c6-face79e11ca2" status: 200 len: 1359 microversion: 2.1 time: 0.313529 Oct 08 20:55:04.631967 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 518/986] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:55:04 2022] GET /compute/v2.1/servers/e338d559-3f7c-4cc8-95c6-face79e11ca2 => generated 1359 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:55:04.809118 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-be502915-c0fa-4f84-801e-29475cae2652 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:04.810828 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-be502915-c0fa-4f84-801e-29475cae2652 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] [instance: 0cbc3ac5-5690-4f4e-a9d1-ea0de18060b1] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:55:04.817993 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-be502915-c0fa-4f84-801e-29475cae2652 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:04.818800 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-be502915-c0fa-4f84-801e-29475cae2652 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:04.819567 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-be502915-c0fa-4f84-801e-29475cae2652 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:04.820592 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-be502915-c0fa-4f84-801e-29475cae2652 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:04.821217 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-be502915-c0fa-4f84-801e-29475cae2652 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:04.821823 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-be502915-c0fa-4f84-801e-29475cae2652 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:04.883801 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=2 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:55:04.885692 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-8b130a9c-d5a5-4ac1-8d78-3f9c1bd2c850 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:04.888258 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-8b130a9c-d5a5-4ac1-8d78-3f9c1bd2c850 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] [instance: 73fd15ea-e4bd-4310-93bb-147b0a5e27ef] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:55:04.915760 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8b130a9c-d5a5-4ac1-8d78-3f9c1bd2c850 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:04.921168 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8b130a9c-d5a5-4ac1-8d78-3f9c1bd2c850 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:04.923883 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8b130a9c-d5a5-4ac1-8d78-3f9c1bd2c850 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:04.924869 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8b130a9c-d5a5-4ac1-8d78-3f9c1bd2c850 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:04.931300 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8b130a9c-d5a5-4ac1-8d78-3f9c1bd2c850 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:04.939802 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8b130a9c-d5a5-4ac1-8d78-3f9c1bd2c850 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:05.330792 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-8b130a9c-d5a5-4ac1-8d78-3f9c1bd2c850 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef659f5a1a24c439528a7675bdd70f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c92fe04ab8248399d0acb932f82d607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:05.356174 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-8b130a9c-d5a5-4ac1-8d78-3f9c1bd2c850 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] 10.222.0.26 "GET /compute/v2.1/servers/73fd15ea-e4bd-4310-93bb-147b0a5e27ef" status: 200 len: 1477 microversion: 2.1 time: 0.479923 Oct 08 20:55:05.358036 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 519/987] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:55:04 2022] GET /compute/v2.1/servers/73fd15ea-e4bd-4310-93bb-147b0a5e27ef => generated 1477 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:55:05.378858 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-410813bd-cd21-4896-977d-0669aed3abc5 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:05.380034 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-410813bd-cd21-4896-977d-0669aed3abc5 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] [instance: 92e31b92-0af1-4da6-bc87-23978f1aedf5] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:55:05.429379 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-410813bd-cd21-4896-977d-0669aed3abc5 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:05.429379 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-410813bd-cd21-4896-977d-0669aed3abc5 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:05.432940 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-410813bd-cd21-4896-977d-0669aed3abc5 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:05.433813 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-410813bd-cd21-4896-977d-0669aed3abc5 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:05.434314 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-410813bd-cd21-4896-977d-0669aed3abc5 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:05.436839 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-410813bd-cd21-4896-977d-0669aed3abc5 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:05.819875 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=2 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:55:05.859100 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-be502915-c0fa-4f84-801e-29475cae2652 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bce55d7f67347aaaa4c2a687bdff183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb3706a1680419384f4fe9660e87732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:05.881579 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-be502915-c0fa-4f84-801e-29475cae2652 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] 10.222.0.26 "GET /compute/v2.1/servers/0cbc3ac5-5690-4f4e-a9d1-ea0de18060b1" status: 200 len: 1317 microversion: 2.1 time: 1.079463 Oct 08 20:55:05.883052 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 469/988] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:55:04 2022] GET /compute/v2.1/servers/0cbc3ac5-5690-4f4e-a9d1-ea0de18060b1 => generated 1317 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:55:05.967924 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-b5ac9fce-ec63-4585-beb0-30402bee8312 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:05.973433 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-b5ac9fce-ec63-4585-beb0-30402bee8312 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] [instance: f04fdc43-98fc-4bfc-a0f6-6efb9d2ee5bc] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:55:06.011567 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b5ac9fce-ec63-4585-beb0-30402bee8312 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:06.012080 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b5ac9fce-ec63-4585-beb0-30402bee8312 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:06.012791 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b5ac9fce-ec63-4585-beb0-30402bee8312 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:06.014180 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b5ac9fce-ec63-4585-beb0-30402bee8312 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:06.020205 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b5ac9fce-ec63-4585-beb0-30402bee8312 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:06.053975 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b5ac9fce-ec63-4585-beb0-30402bee8312 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.033s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:06.054235 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-410813bd-cd21-4896-977d-0669aed3abc5 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:06.074423 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-410813bd-cd21-4896-977d-0669aed3abc5 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:06.097573 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-410813bd-cd21-4896-977d-0669aed3abc5 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:06.130438 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-410813bd-cd21-4896-977d-0669aed3abc5 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] 10.222.0.26 "GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5" status: 200 len: 1546 microversion: 2.91 time: 0.770328 Oct 08 20:55:06.195324 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 520/989] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:55:05 2022] GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5 => generated 1546 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:55:06.215118 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e6d5cf63-6eb3-47cd-8ed0-3ac672d85a99 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:06.223681 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-e6d5cf63-6eb3-47cd-8ed0-3ac672d85a99 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] [instance: e338d559-3f7c-4cc8-95c6-face79e11ca2] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:55:06.264559 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e6d5cf63-6eb3-47cd-8ed0-3ac672d85a99 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:06.270257 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e6d5cf63-6eb3-47cd-8ed0-3ac672d85a99 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:06.282293 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e6d5cf63-6eb3-47cd-8ed0-3ac672d85a99 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:06.291500 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e6d5cf63-6eb3-47cd-8ed0-3ac672d85a99 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:06.292170 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e6d5cf63-6eb3-47cd-8ed0-3ac672d85a99 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:06.298311 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e6d5cf63-6eb3-47cd-8ed0-3ac672d85a99 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:07.204565 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-e6d5cf63-6eb3-47cd-8ed0-3ac672d85a99 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474ca64d1b1d4e30916b517645aba882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecc2dd2407b4819874bed09cb27959a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:07.219002 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-e6d5cf63-6eb3-47cd-8ed0-3ac672d85a99 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] 10.222.0.26 "GET /compute/v2.1/servers/e338d559-3f7c-4cc8-95c6-face79e11ca2" status: 200 len: 1359 microversion: 2.1 time: 1.022091 Oct 08 20:55:07.241790 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 521/990] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:55:06 2022] GET /compute/v2.1/servers/e338d559-3f7c-4cc8-95c6-face79e11ca2 => generated 1359 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:55:07.256016 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e14c47ae-ee2b-444d-9800-553efa3c1bb5 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:07.257087 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-e14c47ae-ee2b-444d-9800-553efa3c1bb5 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] [instance: 73fd15ea-e4bd-4310-93bb-147b0a5e27ef] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:55:07.270358 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e14c47ae-ee2b-444d-9800-553efa3c1bb5 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:07.271260 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e14c47ae-ee2b-444d-9800-553efa3c1bb5 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:07.273818 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e14c47ae-ee2b-444d-9800-553efa3c1bb5 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:07.274999 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e14c47ae-ee2b-444d-9800-553efa3c1bb5 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:07.282578 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e14c47ae-ee2b-444d-9800-553efa3c1bb5 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:07.283641 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e14c47ae-ee2b-444d-9800-553efa3c1bb5 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:07.616125 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-e14c47ae-ee2b-444d-9800-553efa3c1bb5 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef659f5a1a24c439528a7675bdd70f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c92fe04ab8248399d0acb932f82d607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:07.624620 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-e14c47ae-ee2b-444d-9800-553efa3c1bb5 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] 10.222.0.26 "GET /compute/v2.1/servers/73fd15ea-e4bd-4310-93bb-147b0a5e27ef" status: 200 len: 1462 microversion: 2.1 time: 0.381219 Oct 08 20:55:07.647533 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 522/991] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:55:07 2022] GET /compute/v2.1/servers/73fd15ea-e4bd-4310-93bb-147b0a5e27ef => generated 1462 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:55:07.662699 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-66660c3d-0b98-46ec-9c79-a7680ad5c33c tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:07.666864 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-66660c3d-0b98-46ec-9c79-a7680ad5c33c tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] [instance: 0cbc3ac5-5690-4f4e-a9d1-ea0de18060b1] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:55:07.686101 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-66660c3d-0b98-46ec-9c79-a7680ad5c33c tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:07.687536 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-66660c3d-0b98-46ec-9c79-a7680ad5c33c tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:07.688203 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-66660c3d-0b98-46ec-9c79-a7680ad5c33c tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:07.690300 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-66660c3d-0b98-46ec-9c79-a7680ad5c33c tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:07.693899 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-66660c3d-0b98-46ec-9c79-a7680ad5c33c tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:07.694746 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-66660c3d-0b98-46ec-9c79-a7680ad5c33c tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:07.738021 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-b5ac9fce-ec63-4585-beb0-30402bee8312 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:07.753098 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-b5ac9fce-ec63-4585-beb0-30402bee8312 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:07.778711 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-b5ac9fce-ec63-4585-beb0-30402bee8312 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:07.780705 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-b5ac9fce-ec63-4585-beb0-30402bee8312 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] 10.222.0.26 "GET /compute/v2.1/servers/f04fdc43-98fc-4bfc-a0f6-6efb9d2ee5bc" status: 200 len: 1568 microversion: 2.25 time: 1.894567 Oct 08 20:55:07.795264 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 470/992] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:55:05 2022] GET /compute/v2.1/servers/f04fdc43-98fc-4bfc-a0f6-6efb9d2ee5bc => generated 1568 bytes in 1911 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:55:07.803723 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=100 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:55:07.813846 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-e050fe5f-347d-4638-bb7d-389745db917c tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:07.814873 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-e050fe5f-347d-4638-bb7d-389745db917c tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] [instance: 92e31b92-0af1-4da6-bc87-23978f1aedf5] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:55:07.845215 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e050fe5f-347d-4638-bb7d-389745db917c tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:07.847912 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e050fe5f-347d-4638-bb7d-389745db917c tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:07.851204 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e050fe5f-347d-4638-bb7d-389745db917c tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:07.858660 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e050fe5f-347d-4638-bb7d-389745db917c tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:07.859301 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e050fe5f-347d-4638-bb7d-389745db917c tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:07.860028 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e050fe5f-347d-4638-bb7d-389745db917c tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:08.079407 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-e050fe5f-347d-4638-bb7d-389745db917c tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:08.089408 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-e050fe5f-347d-4638-bb7d-389745db917c tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:08.092432 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-e050fe5f-347d-4638-bb7d-389745db917c tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:08.106734 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-e050fe5f-347d-4638-bb7d-389745db917c tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] 10.222.0.26 "GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5" status: 200 len: 1546 microversion: 2.91 time: 0.307652 Oct 08 20:55:08.107869 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 471/993] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:55:07 2022] GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5 => generated 1546 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:55:08.125477 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-5ce7ad42-3bf4-4798-8adf-c5983e529108 req-7e7d38e1-e11c-47a5-bdc9-4a422a44ed58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73fd15ea-e4bd-4310-93bb-147b0a5e27ef", "name": "network-vif-unplugged", "status": "completed", "tag": "27f3cc41-9f72-499b-bae1-fb66f8f24df7"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:55:08.139637 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-5ce7ad42-3bf4-4798-8adf-c5983e529108 req-7e7d38e1-e11c-47a5-bdc9-4a422a44ed58 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:08.156523 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-5ce7ad42-3bf4-4798-8adf-c5983e529108 req-7e7d38e1-e11c-47a5-bdc9-4a422a44ed58 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:08.157823 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-5ce7ad42-3bf4-4798-8adf-c5983e529108 req-7e7d38e1-e11c-47a5-bdc9-4a422a44ed58 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:08.189970 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-5ce7ad42-3bf4-4798-8adf-c5983e529108 req-7e7d38e1-e11c-47a5-bdc9-4a422a44ed58 service nova] Creating event network-vif-unplugged:27f3cc41-9f72-499b-bae1-fb66f8f24df7 for instance 73fd15ea-e4bd-4310-93bb-147b0a5e27ef on nch2-master-1 Oct 08 20:55:08.206811 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-5ce7ad42-3bf4-4798-8adf-c5983e529108 req-7e7d38e1-e11c-47a5-bdc9-4a422a44ed58 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.095999 Oct 08 20:55:08.215105 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 472/994] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:55:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:55:08.223825 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-54d20a39-31fa-4354-8ca9-bf8c9520ac6f tempest-ServersAdminTestJSON-1467382604 tempest-ServersAdminTestJSON-1467382604-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:55:08.226160 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-54d20a39-31fa-4354-8ca9-bf8c9520ac6f tempest-ServersAdminTestJSON-1467382604 tempest-ServersAdminTestJSON-1467382604-project-admin] [instance: 73fd15ea-e4bd-4310-93bb-147b0a5e27ef] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:55:08.251520 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-54d20a39-31fa-4354-8ca9-bf8c9520ac6f tempest-ServersAdminTestJSON-1467382604 tempest-ServersAdminTestJSON-1467382604-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:08.254852 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-54d20a39-31fa-4354-8ca9-bf8c9520ac6f tempest-ServersAdminTestJSON-1467382604 tempest-ServersAdminTestJSON-1467382604-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:08.255941 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-54d20a39-31fa-4354-8ca9-bf8c9520ac6f tempest-ServersAdminTestJSON-1467382604 tempest-ServersAdminTestJSON-1467382604-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:08.258590 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-54d20a39-31fa-4354-8ca9-bf8c9520ac6f tempest-ServersAdminTestJSON-1467382604 tempest-ServersAdminTestJSON-1467382604-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:08.259562 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-54d20a39-31fa-4354-8ca9-bf8c9520ac6f tempest-ServersAdminTestJSON-1467382604 tempest-ServersAdminTestJSON-1467382604-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:08.260230 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-54d20a39-31fa-4354-8ca9-bf8c9520ac6f tempest-ServersAdminTestJSON-1467382604 tempest-ServersAdminTestJSON-1467382604-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:08.379898 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-54d20a39-31fa-4354-8ca9-bf8c9520ac6f tempest-ServersAdminTestJSON-1467382604 tempest-ServersAdminTestJSON-1467382604-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/73fd15ea-e4bd-4310-93bb-147b0a5e27ef/action" status: 202 len: 0 microversion: 2.1 time: 0.163033 Oct 08 20:55:08.382811 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 473/995] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 20:55:08 2022] POST /compute/v2.1/servers/73fd15ea-e4bd-4310-93bb-147b0a5e27ef/action => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 20:55:08.402407 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-ff1ff778-8806-4e58-bf9f-2b2c164adc4e tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:08.404264 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-ff1ff778-8806-4e58-bf9f-2b2c164adc4e tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] [instance: e338d559-3f7c-4cc8-95c6-face79e11ca2] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:55:08.420211 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:55:08.424066 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ff1ff778-8806-4e58-bf9f-2b2c164adc4e tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:08.425783 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ff1ff778-8806-4e58-bf9f-2b2c164adc4e tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:08.426385 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ff1ff778-8806-4e58-bf9f-2b2c164adc4e tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:08.428042 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ff1ff778-8806-4e58-bf9f-2b2c164adc4e tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:08.430095 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ff1ff778-8806-4e58-bf9f-2b2c164adc4e tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:08.431511 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ff1ff778-8806-4e58-bf9f-2b2c164adc4e tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:08.710159 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-66660c3d-0b98-46ec-9c79-a7680ad5c33c tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bce55d7f67347aaaa4c2a687bdff183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb3706a1680419384f4fe9660e87732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:08.719592 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-66660c3d-0b98-46ec-9c79-a7680ad5c33c tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] 10.222.0.26 "GET /compute/v2.1/servers/0cbc3ac5-5690-4f4e-a9d1-ea0de18060b1" status: 200 len: 1467 microversion: 2.1 time: 1.070472 Oct 08 20:55:08.720186 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 523/996] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:55:07 2022] GET /compute/v2.1/servers/0cbc3ac5-5690-4f4e-a9d1-ea0de18060b1 => generated 1467 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:55:08.748637 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-6258064d-c4c8-4210-8f9e-8deba5eef77b tempest-ServersAdminTestJSON-1467382604 tempest-ServersAdminTestJSON-1467382604-project-admin] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:08.749981 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-6258064d-c4c8-4210-8f9e-8deba5eef77b tempest-ServersAdminTestJSON-1467382604 tempest-ServersAdminTestJSON-1467382604-project-admin] [instance: 73fd15ea-e4bd-4310-93bb-147b0a5e27ef] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:55:08.785086 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6258064d-c4c8-4210-8f9e-8deba5eef77b tempest-ServersAdminTestJSON-1467382604 tempest-ServersAdminTestJSON-1467382604-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:08.802423 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6258064d-c4c8-4210-8f9e-8deba5eef77b tempest-ServersAdminTestJSON-1467382604 tempest-ServersAdminTestJSON-1467382604-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:08.806626 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6258064d-c4c8-4210-8f9e-8deba5eef77b tempest-ServersAdminTestJSON-1467382604 tempest-ServersAdminTestJSON-1467382604-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:08.810005 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6258064d-c4c8-4210-8f9e-8deba5eef77b tempest-ServersAdminTestJSON-1467382604 tempest-ServersAdminTestJSON-1467382604-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:08.810560 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6258064d-c4c8-4210-8f9e-8deba5eef77b tempest-ServersAdminTestJSON-1467382604 tempest-ServersAdminTestJSON-1467382604-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:08.815086 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6258064d-c4c8-4210-8f9e-8deba5eef77b tempest-ServersAdminTestJSON-1467382604 tempest-ServersAdminTestJSON-1467382604-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:08.933920 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6258064d-c4c8-4210-8f9e-8deba5eef77b tempest-ServersAdminTestJSON-1467382604 tempest-ServersAdminTestJSON-1467382604-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:08.937552 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6258064d-c4c8-4210-8f9e-8deba5eef77b tempest-ServersAdminTestJSON-1467382604 tempest-ServersAdminTestJSON-1467382604-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:08.938006 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6258064d-c4c8-4210-8f9e-8deba5eef77b tempest-ServersAdminTestJSON-1467382604 tempest-ServersAdminTestJSON-1467382604-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:08.938703 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.objects.instance [None req-6258064d-c4c8-4210-8f9e-8deba5eef77b tempest-ServersAdminTestJSON-1467382604 tempest-ServersAdminTestJSON-1467382604-project-admin] Lazy-loading 'fault' on Instance uuid 73fd15ea-e4bd-4310-93bb-147b0a5e27ef {{(pid=140492) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 20:55:09.112952 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-ff1ff778-8806-4e58-bf9f-2b2c164adc4e tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474ca64d1b1d4e30916b517645aba882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecc2dd2407b4819874bed09cb27959a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:09.121952 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-ff1ff778-8806-4e58-bf9f-2b2c164adc4e tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] 10.222.0.26 "GET /compute/v2.1/servers/e338d559-3f7c-4cc8-95c6-face79e11ca2" status: 200 len: 1359 microversion: 2.1 time: 0.736829 Oct 08 20:55:09.139118 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 474/997] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:55:08 2022] GET /compute/v2.1/servers/e338d559-3f7c-4cc8-95c6-face79e11ca2 => generated 1359 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:55:09.143680 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-86b38e2c-4ef0-4ac3-8ccc-3583a64f51d6 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:09.143928 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-86b38e2c-4ef0-4ac3-8ccc-3583a64f51d6 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] [instance: 24300a5e-164c-4d97-9a1f-b52359c1c0d6] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:55:09.164107 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-86b38e2c-4ef0-4ac3-8ccc-3583a64f51d6 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:09.164631 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-86b38e2c-4ef0-4ac3-8ccc-3583a64f51d6 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:09.165070 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-86b38e2c-4ef0-4ac3-8ccc-3583a64f51d6 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:09.165813 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-86b38e2c-4ef0-4ac3-8ccc-3583a64f51d6 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:09.166270 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-86b38e2c-4ef0-4ac3-8ccc-3583a64f51d6 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:09.166700 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-86b38e2c-4ef0-4ac3-8ccc-3583a64f51d6 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:09.434827 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-86b38e2c-4ef0-4ac3-8ccc-3583a64f51d6 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bce55d7f67347aaaa4c2a687bdff183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb3706a1680419384f4fe9660e87732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:09.463674 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-86b38e2c-4ef0-4ac3-8ccc-3583a64f51d6 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] 10.222.0.26 "GET /compute/v2.1/servers/24300a5e-164c-4d97-9a1f-b52359c1c0d6" status: 200 len: 1466 microversion: 2.1 time: 0.325625 Oct 08 20:55:09.480685 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 475/998] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:55:09 2022] GET /compute/v2.1/servers/24300a5e-164c-4d97-9a1f-b52359c1c0d6 => generated 1466 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:55:09.480685 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-5b3aca62-542a-4868-82e9-5f3e228d1103 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:09.481174 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-5b3aca62-542a-4868-82e9-5f3e228d1103 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] [instance: f04fdc43-98fc-4bfc-a0f6-6efb9d2ee5bc] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:55:09.506354 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5b3aca62-542a-4868-82e9-5f3e228d1103 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:09.506912 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5b3aca62-542a-4868-82e9-5f3e228d1103 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:09.507330 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5b3aca62-542a-4868-82e9-5f3e228d1103 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:09.513206 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5b3aca62-542a-4868-82e9-5f3e228d1103 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:09.514467 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5b3aca62-542a-4868-82e9-5f3e228d1103 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:09.514919 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5b3aca62-542a-4868-82e9-5f3e228d1103 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:09.886010 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-6258064d-c4c8-4210-8f9e-8deba5eef77b tempest-ServersAdminTestJSON-1467382604 tempest-ServersAdminTestJSON-1467382604-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/73fd15ea-e4bd-4310-93bb-147b0a5e27ef" status: 200 len: 1596 microversion: 2.1 time: 1.156549 Oct 08 20:55:09.894595 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-5b3aca62-542a-4868-82e9-5f3e228d1103 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:09.901710 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 524/999] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:55:08 2022] GET /compute/v2.1/servers/73fd15ea-e4bd-4310-93bb-147b0a5e27ef => generated 1596 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:55:09.910116 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-5b3aca62-542a-4868-82e9-5f3e228d1103 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:09.911512 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-bc71d411-394b-419c-8faa-cb7f9378d7e4 tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-944717038", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "a03c8773-fd6c-4031-b9bd-6880e0599f48"}], "security_groups": [{"name": "tempest-securitygroup--1508346277"}], "key_name": "tempest-keypair-2083264648", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:55:09.914960 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-5b3aca62-542a-4868-82e9-5f3e228d1103 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:09.919868 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-5b3aca62-542a-4868-82e9-5f3e228d1103 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] 10.222.0.26 "GET /compute/v2.1/servers/f04fdc43-98fc-4bfc-a0f6-6efb9d2ee5bc" status: 200 len: 1568 microversion: 2.25 time: 0.447568 Oct 08 20:55:09.933598 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 476/1000] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:55:09 2022] GET /compute/v2.1/servers/f04fdc43-98fc-4bfc-a0f6-6efb9d2ee5bc => generated 1568 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:55:09.962169 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-30179524-e8a6-47d5-a349-b40f986ad2c1 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:09.964460 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-30179524-e8a6-47d5-a349-b40f986ad2c1 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] [instance: 92e31b92-0af1-4da6-bc87-23978f1aedf5] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:55:09.980800 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-30179524-e8a6-47d5-a349-b40f986ad2c1 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:09.981345 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-30179524-e8a6-47d5-a349-b40f986ad2c1 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:09.981797 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-30179524-e8a6-47d5-a349-b40f986ad2c1 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:09.990904 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-30179524-e8a6-47d5-a349-b40f986ad2c1 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:09.992632 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-30179524-e8a6-47d5-a349-b40f986ad2c1 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:09.995815 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-30179524-e8a6-47d5-a349-b40f986ad2c1 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:10.048673 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:55:10.174003 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-30179524-e8a6-47d5-a349-b40f986ad2c1 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:10.189173 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-30179524-e8a6-47d5-a349-b40f986ad2c1 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:10.192845 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-30179524-e8a6-47d5-a349-b40f986ad2c1 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:10.212071 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-30179524-e8a6-47d5-a349-b40f986ad2c1 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] 10.222.0.26 "GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5" status: 200 len: 1546 microversion: 2.91 time: 0.274567 Oct 08 20:55:10.231573 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 477/1001] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:55:09 2022] GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5 => generated 1546 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:55:10.243187 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-45bea19f-d503-4cd4-8a5e-071296429c4a tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1489437849"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:55:10.246112 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-45bea19f-d503-4cd4-8a5e-071296429c4a tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] [instance: 24300a5e-164c-4d97-9a1f-b52359c1c0d6] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:55:10.255125 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-45bea19f-d503-4cd4-8a5e-071296429c4a tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:10.255897 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-45bea19f-d503-4cd4-8a5e-071296429c4a tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:10.256348 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-45bea19f-d503-4cd4-8a5e-071296429c4a tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:10.257605 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-45bea19f-d503-4cd4-8a5e-071296429c4a tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:10.257605 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-45bea19f-d503-4cd4-8a5e-071296429c4a tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:10.264794 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-45bea19f-d503-4cd4-8a5e-071296429c4a tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:10.290291 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.network.neutron [None req-bc71d411-394b-419c-8faa-cb7f9378d7e4 tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] validate_networks() for [('a03c8773-fd6c-4031-b9bd-6880e0599f48', None, None, None, None, None)] {{(pid=140492) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 20:55:10.720080 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-45bea19f-d503-4cd4-8a5e-071296429c4a tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] 10.222.0.26 "POST /compute/v2.1/servers/24300a5e-164c-4d97-9a1f-b52359c1c0d6/action" status: 202 len: 0 microversion: 2.1 time: 0.483269 Oct 08 20:55:10.721501 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 478/1002] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 20:55:10 2022] POST /compute/v2.1/servers/24300a5e-164c-4d97-9a1f-b52359c1c0d6/action => generated 0 bytes in 489 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 08 20:55:10.752546 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-66200af1-fa43-4a87-b066-91f3e6049555 tempest-ServersAdminTestJSON-1467382604 tempest-ServersAdminTestJSON-1467382604-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:55:10.773325 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-66200af1-fa43-4a87-b066-91f3e6049555 tempest-ServersAdminTestJSON-1467382604 tempest-ServersAdminTestJSON-1467382604-project-admin] [instance: 73fd15ea-e4bd-4310-93bb-147b0a5e27ef] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:55:10.805021 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-66200af1-fa43-4a87-b066-91f3e6049555 tempest-ServersAdminTestJSON-1467382604 tempest-ServersAdminTestJSON-1467382604-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:10.806589 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-66200af1-fa43-4a87-b066-91f3e6049555 tempest-ServersAdminTestJSON-1467382604 tempest-ServersAdminTestJSON-1467382604-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:10.807048 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-66200af1-fa43-4a87-b066-91f3e6049555 tempest-ServersAdminTestJSON-1467382604 tempest-ServersAdminTestJSON-1467382604-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:10.816549 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-66200af1-fa43-4a87-b066-91f3e6049555 tempest-ServersAdminTestJSON-1467382604 tempest-ServersAdminTestJSON-1467382604-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:10.819586 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-66200af1-fa43-4a87-b066-91f3e6049555 tempest-ServersAdminTestJSON-1467382604 tempest-ServersAdminTestJSON-1467382604-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:10.821558 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-66200af1-fa43-4a87-b066-91f3e6049555 tempest-ServersAdminTestJSON-1467382604 tempest-ServersAdminTestJSON-1467382604-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:11.071582 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-66200af1-fa43-4a87-b066-91f3e6049555 tempest-ServersAdminTestJSON-1467382604 tempest-ServersAdminTestJSON-1467382604-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/73fd15ea-e4bd-4310-93bb-147b0a5e27ef/action" status: 202 len: 0 microversion: 2.1 time: 0.345766 Oct 08 20:55:11.075522 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 479/1003] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 20:55:10 2022] POST /compute/v2.1/servers/73fd15ea-e4bd-4310-93bb-147b0a5e27ef/action => generated 0 bytes in 353 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 20:55:11.081005 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-4effb668-98c2-4734-9b93-b3bad83f2ddd tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:11.081671 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-4effb668-98c2-4734-9b93-b3bad83f2ddd tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] [instance: e338d559-3f7c-4cc8-95c6-face79e11ca2] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:55:11.107763 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4effb668-98c2-4734-9b93-b3bad83f2ddd tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:11.108262 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4effb668-98c2-4734-9b93-b3bad83f2ddd tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:11.108729 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4effb668-98c2-4734-9b93-b3bad83f2ddd tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:11.109503 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4effb668-98c2-4734-9b93-b3bad83f2ddd tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:11.109966 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4effb668-98c2-4734-9b93-b3bad83f2ddd tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:11.110435 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4effb668-98c2-4734-9b93-b3bad83f2ddd tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:11.485672 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-4effb668-98c2-4734-9b93-b3bad83f2ddd tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474ca64d1b1d4e30916b517645aba882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecc2dd2407b4819874bed09cb27959a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:11.501326 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-4effb668-98c2-4734-9b93-b3bad83f2ddd tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] 10.222.0.26 "GET /compute/v2.1/servers/e338d559-3f7c-4cc8-95c6-face79e11ca2" status: 200 len: 1359 microversion: 2.1 time: 0.424005 Oct 08 20:55:11.506863 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 480/1004] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:55:11 2022] GET /compute/v2.1/servers/e338d559-3f7c-4cc8-95c6-face79e11ca2 => generated 1359 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:55:11.529723 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-a4ae0001-b44f-4b53-81fb-c6d94ce4ab4b tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Calling method '.version_select at 0x7f1a8c9e64c0>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:11.640711 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-a4ae0001-b44f-4b53-81fb-c6d94ce4ab4b tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] 10.222.0.26 "GET /compute/v2.1/images/e7e4c6ad-e228-45f1-9998-e20dbf8acb00" status: 200 len: 1455 microversion: 2.1 time: 0.130535 Oct 08 20:55:11.654600 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 481/1005] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:55:11 2022] GET /compute/v2.1/images/e7e4c6ad-e228-45f1-9998-e20dbf8acb00 => generated 1455 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:55:11.659249 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-3d8e24a7-34cc-4d08-8d74-99c5a281765b tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:11.659888 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-3d8e24a7-34cc-4d08-8d74-99c5a281765b tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] [instance: f04fdc43-98fc-4bfc-a0f6-6efb9d2ee5bc] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:55:11.672138 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3d8e24a7-34cc-4d08-8d74-99c5a281765b tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:11.672639 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3d8e24a7-34cc-4d08-8d74-99c5a281765b tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:11.673080 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3d8e24a7-34cc-4d08-8d74-99c5a281765b tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:11.673972 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3d8e24a7-34cc-4d08-8d74-99c5a281765b tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:11.674467 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3d8e24a7-34cc-4d08-8d74-99c5a281765b tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:11.674962 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3d8e24a7-34cc-4d08-8d74-99c5a281765b tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:12.253459 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-3d8e24a7-34cc-4d08-8d74-99c5a281765b tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:12.276496 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-3d8e24a7-34cc-4d08-8d74-99c5a281765b tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:12.282570 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-3d8e24a7-34cc-4d08-8d74-99c5a281765b tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:12.284722 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-3d8e24a7-34cc-4d08-8d74-99c5a281765b tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] 10.222.0.26 "GET /compute/v2.1/servers/f04fdc43-98fc-4bfc-a0f6-6efb9d2ee5bc" status: 200 len: 1568 microversion: 2.25 time: 0.629437 Oct 08 20:55:12.302990 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 482/1006] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:55:11 2022] GET /compute/v2.1/servers/f04fdc43-98fc-4bfc-a0f6-6efb9d2ee5bc => generated 1568 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:55:12.312976 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-6355e149-aa42-4c48-9b0d-15ba7fc4d25a tempest-ServersAdminTestJSON-1467382604 tempest-ServersAdminTestJSON-1467382604-project-admin] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:12.313776 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-6355e149-aa42-4c48-9b0d-15ba7fc4d25a tempest-ServersAdminTestJSON-1467382604 tempest-ServersAdminTestJSON-1467382604-project-admin] [instance: 73fd15ea-e4bd-4310-93bb-147b0a5e27ef] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:55:12.323200 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6355e149-aa42-4c48-9b0d-15ba7fc4d25a tempest-ServersAdminTestJSON-1467382604 tempest-ServersAdminTestJSON-1467382604-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:12.324121 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6355e149-aa42-4c48-9b0d-15ba7fc4d25a tempest-ServersAdminTestJSON-1467382604 tempest-ServersAdminTestJSON-1467382604-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:12.324792 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6355e149-aa42-4c48-9b0d-15ba7fc4d25a tempest-ServersAdminTestJSON-1467382604 tempest-ServersAdminTestJSON-1467382604-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:12.327391 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6355e149-aa42-4c48-9b0d-15ba7fc4d25a tempest-ServersAdminTestJSON-1467382604 tempest-ServersAdminTestJSON-1467382604-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:12.340570 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6355e149-aa42-4c48-9b0d-15ba7fc4d25a tempest-ServersAdminTestJSON-1467382604 tempest-ServersAdminTestJSON-1467382604-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:12.340570 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6355e149-aa42-4c48-9b0d-15ba7fc4d25a tempest-ServersAdminTestJSON-1467382604 tempest-ServersAdminTestJSON-1467382604-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:12.502690 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-bc71d411-394b-419c-8faa-cb7f9378d7e4 tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] Getting quotas for project 4e277ebf9cbf4cb0b6be14efbec504bf. Resources: dict_keys(['metadata_items']) {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 20:55:12.515411 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-bc71d411-394b-419c-8faa-cb7f9378d7e4 tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] Getting quotas for user f6cf9c6c133947f3aecee3a913a32328 and project 4e277ebf9cbf4cb0b6be14efbec504bf. Resources: dict_keys(['metadata_items']) {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 20:55:12.527573 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=10 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:55:12.539618 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-bc71d411-394b-419c-8faa-cb7f9378d7e4 tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] Flavor limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 20:55:12.540416 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-bc71d411-394b-419c-8faa-cb7f9378d7e4 tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] Image limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 20:55:12.541120 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-bc71d411-394b-419c-8faa-cb7f9378d7e4 tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] Flavor pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 20:55:12.541783 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-bc71d411-394b-419c-8faa-cb7f9378d7e4 tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] Image pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 20:55:12.542411 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-bc71d411-394b-419c-8faa-cb7f9378d7e4 tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 20:55:12.542626 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-6355e149-aa42-4c48-9b0d-15ba7fc4d25a tempest-ServersAdminTestJSON-1467382604 tempest-ServersAdminTestJSON-1467382604-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/73fd15ea-e4bd-4310-93bb-147b0a5e27ef" status: 200 len: 1613 microversion: 2.1 time: 0.238361 Oct 08 20:55:12.543737 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 483/1007] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:55:12 2022] GET /compute/v2.1/servers/73fd15ea-e4bd-4310-93bb-147b0a5e27ef => generated 1613 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:55:12.549330 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-8cee43c8-cb2c-423e-82ad-3a0e31da8d7d tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:12.550127 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-8cee43c8-cb2c-423e-82ad-3a0e31da8d7d tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] [instance: 92e31b92-0af1-4da6-bc87-23978f1aedf5] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:55:12.557399 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8cee43c8-cb2c-423e-82ad-3a0e31da8d7d tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:12.558127 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8cee43c8-cb2c-423e-82ad-3a0e31da8d7d tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:12.558736 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8cee43c8-cb2c-423e-82ad-3a0e31da8d7d tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:12.560819 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8cee43c8-cb2c-423e-82ad-3a0e31da8d7d tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:12.561738 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8cee43c8-cb2c-423e-82ad-3a0e31da8d7d tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:12.562583 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8cee43c8-cb2c-423e-82ad-3a0e31da8d7d tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:12.579440 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bc71d411-394b-419c-8faa-cb7f9378d7e4 tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:12.583184 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bc71d411-394b-419c-8faa-cb7f9378d7e4 tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:12.583747 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bc71d411-394b-419c-8faa-cb7f9378d7e4 tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:12.584794 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bc71d411-394b-419c-8faa-cb7f9378d7e4 tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:12.585541 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bc71d411-394b-419c-8faa-cb7f9378d7e4 tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:12.586189 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bc71d411-394b-419c-8faa-cb7f9378d7e4 tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:12.609609 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-bc71d411-394b-419c-8faa-cb7f9378d7e4 tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] Getting quotas for project 4e277ebf9cbf4cb0b6be14efbec504bf. Resources: {'cores', 'instances', 'ram'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 20:55:12.628029 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-bc71d411-394b-419c-8faa-cb7f9378d7e4 tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] Getting quotas for user f6cf9c6c133947f3aecee3a913a32328 and project 4e277ebf9cbf4cb0b6be14efbec504bf. Resources: {'cores', 'instances', 'ram'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 20:55:12.651286 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-bc71d411-394b-419c-8faa-cb7f9378d7e4 tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] Going to run 1 instances... {{(pid=140492) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 20:55:12.674099 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-bc71d411-394b-419c-8faa-cb7f9378d7e4 tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] [instance: 8b29aacb-435d-4c6c-bbe7-3d5c6e1c622e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c508bd7f-7db9-4b2c-af7c-be54a855c355',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140492) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 20:55:12.797670 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-bc71d411-394b-419c-8faa-cb7f9378d7e4 tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 2.894615 Oct 08 20:55:12.802247 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 525/1008] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 20:55:09 2022] POST /compute/v2.1/servers => generated 407 bytes in 2900 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 08 20:55:12.813160 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-00d14cc6-bd84-4bc8-bebb-9e0f72423f22 req-da19a0d6-cac8-4274-8838-0a1c1c0ef778 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73fd15ea-e4bd-4310-93bb-147b0a5e27ef", "name": "network-vif-plugged", "status": "completed", "tag": "27f3cc41-9f72-499b-bae1-fb66f8f24df7"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:55:12.828700 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-8cee43c8-cb2c-423e-82ad-3a0e31da8d7d tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:12.845016 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-00d14cc6-bd84-4bc8-bebb-9e0f72423f22 req-da19a0d6-cac8-4274-8838-0a1c1c0ef778 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:12.847313 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-8cee43c8-cb2c-423e-82ad-3a0e31da8d7d tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:12.848701 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-00d14cc6-bd84-4bc8-bebb-9e0f72423f22 req-da19a0d6-cac8-4274-8838-0a1c1c0ef778 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:12.849423 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-00d14cc6-bd84-4bc8-bebb-9e0f72423f22 req-da19a0d6-cac8-4274-8838-0a1c1c0ef778 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:12.868455 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-8cee43c8-cb2c-423e-82ad-3a0e31da8d7d tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:12.891083 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-8cee43c8-cb2c-423e-82ad-3a0e31da8d7d tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] 10.222.0.26 "GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5" status: 200 len: 1546 microversion: 2.91 time: 0.345988 Oct 08 20:55:12.895090 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 484/1009] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:55:12 2022] GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5 => generated 1546 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:55:12.898663 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-00d14cc6-bd84-4bc8-bebb-9e0f72423f22 req-da19a0d6-cac8-4274-8838-0a1c1c0ef778 service nova] Creating event network-vif-plugged:27f3cc41-9f72-499b-bae1-fb66f8f24df7 for instance 73fd15ea-e4bd-4310-93bb-147b0a5e27ef on nch2-master-1 Oct 08 20:55:12.906783 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-10081df5-d7be-4a57-93d6-6ebb9f1eced7 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:12.909687 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-10081df5-d7be-4a57-93d6-6ebb9f1eced7 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] [instance: 84eba001-0fa3-4fb7-b74e-0bb54c527ac7] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:55:12.911595 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-00d14cc6-bd84-4bc8-bebb-9e0f72423f22 req-da19a0d6-cac8-4274-8838-0a1c1c0ef778 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107691 Oct 08 20:55:12.916614 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 526/1010] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:55:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:55:12.929985 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-02b196a8-1a9f-483f-ae3a-831dda2f3b56 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:12.943818 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-02b196a8-1a9f-483f-ae3a-831dda2f3b56 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] [instance: e338d559-3f7c-4cc8-95c6-face79e11ca2] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:55:12.960208 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-02b196a8-1a9f-483f-ae3a-831dda2f3b56 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:12.972792 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-02b196a8-1a9f-483f-ae3a-831dda2f3b56 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:12.974667 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-02b196a8-1a9f-483f-ae3a-831dda2f3b56 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:12.977551 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-02b196a8-1a9f-483f-ae3a-831dda2f3b56 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:12.982662 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-02b196a8-1a9f-483f-ae3a-831dda2f3b56 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:12.983349 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-02b196a8-1a9f-483f-ae3a-831dda2f3b56 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:12.987449 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-10081df5-d7be-4a57-93d6-6ebb9f1eced7 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:12.994818 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-10081df5-d7be-4a57-93d6-6ebb9f1eced7 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:12.997014 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-10081df5-d7be-4a57-93d6-6ebb9f1eced7 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:12.998171 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-10081df5-d7be-4a57-93d6-6ebb9f1eced7 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:12.998668 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-10081df5-d7be-4a57-93d6-6ebb9f1eced7 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:12.999111 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-10081df5-d7be-4a57-93d6-6ebb9f1eced7 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:13.065057 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-10081df5-d7be-4a57-93d6-6ebb9f1eced7 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] [instance: 84eba001-0fa3-4fb7-b74e-0bb54c527ac7] Going to try to terminate instance {{(pid=140491) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 20:55:13.229261 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-10081df5-d7be-4a57-93d6-6ebb9f1eced7 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] 10.222.0.26 "DELETE /compute/v2.1/servers/84eba001-0fa3-4fb7-b74e-0bb54c527ac7" status: 204 len: 0 microversion: 2.1 time: 0.332585 Oct 08 20:55:13.234180 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 485/1011] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 20:55:12 2022] DELETE /compute/v2.1/servers/84eba001-0fa3-4fb7-b74e-0bb54c527ac7 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 20:55:13.240131 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c27e290a-8de8-4b96-bc41-6bd4563427ea tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:13.241095 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-c27e290a-8de8-4b96-bc41-6bd4563427ea tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] [instance: 7e70d7bd-0c39-4320-916f-f99c05ec2806] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:55:13.257892 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c27e290a-8de8-4b96-bc41-6bd4563427ea tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:13.258736 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c27e290a-8de8-4b96-bc41-6bd4563427ea tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:13.259570 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c27e290a-8de8-4b96-bc41-6bd4563427ea tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:13.260914 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c27e290a-8de8-4b96-bc41-6bd4563427ea tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:13.261699 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c27e290a-8de8-4b96-bc41-6bd4563427ea tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:13.262473 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c27e290a-8de8-4b96-bc41-6bd4563427ea tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:13.330777 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-c27e290a-8de8-4b96-bc41-6bd4563427ea tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] [instance: 7e70d7bd-0c39-4320-916f-f99c05ec2806] Going to try to terminate instance {{(pid=140491) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 20:55:13.443301 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-02b196a8-1a9f-483f-ae3a-831dda2f3b56 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474ca64d1b1d4e30916b517645aba882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecc2dd2407b4819874bed09cb27959a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:13.462310 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-02b196a8-1a9f-483f-ae3a-831dda2f3b56 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] 10.222.0.26 "GET /compute/v2.1/servers/e338d559-3f7c-4cc8-95c6-face79e11ca2" status: 200 len: 1359 microversion: 2.1 time: 0.539917 Oct 08 20:55:13.463652 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 527/1012] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:55:12 2022] GET /compute/v2.1/servers/e338d559-3f7c-4cc8-95c6-face79e11ca2 => generated 1359 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:55:13.484245 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-ed61d514-52ce-44e6-9764-fe4e111d357b tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Calling method '.version_select at 0x7f1a8c7e2ca0>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:13.563474 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-c27e290a-8de8-4b96-bc41-6bd4563427ea tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] 10.222.0.26 "DELETE /compute/v2.1/servers/7e70d7bd-0c39-4320-916f-f99c05ec2806" status: 204 len: 0 microversion: 2.1 time: 0.331351 Oct 08 20:55:13.569254 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 486/1013] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 20:55:13 2022] DELETE /compute/v2.1/servers/7e70d7bd-0c39-4320-916f-f99c05ec2806 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 20:55:13.579328 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-88561889-4254-49fa-b009-375d49fcd5ce tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:13.580291 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-88561889-4254-49fa-b009-375d49fcd5ce tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] [instance: 8b29aacb-435d-4c6c-bbe7-3d5c6e1c622e] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:55:13.581328 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-ed61d514-52ce-44e6-9764-fe4e111d357b tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] 10.222.0.26 "GET /compute/v2.1/images/e7e4c6ad-e228-45f1-9998-e20dbf8acb00" status: 200 len: 1455 microversion: 2.1 time: 0.115757 Oct 08 20:55:13.583071 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 528/1014] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:55:13 2022] GET /compute/v2.1/images/e7e4c6ad-e228-45f1-9998-e20dbf8acb00 => generated 1455 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:55:13.589286 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-b5c87afe-0f98-4235-b378-04f9098ca76f tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:13.590197 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-b5c87afe-0f98-4235-b378-04f9098ca76f tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] [instance: 84eba001-0fa3-4fb7-b74e-0bb54c527ac7] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:55:13.598636 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b5c87afe-0f98-4235-b378-04f9098ca76f tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:13.599843 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b5c87afe-0f98-4235-b378-04f9098ca76f tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:13.600552 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b5c87afe-0f98-4235-b378-04f9098ca76f tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:13.601589 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b5c87afe-0f98-4235-b378-04f9098ca76f tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:13.602515 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b5c87afe-0f98-4235-b378-04f9098ca76f tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:13.603585 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b5c87afe-0f98-4235-b378-04f9098ca76f tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:13.709089 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-88561889-4254-49fa-b009-375d49fcd5ce tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6cf9c6c133947f3aecee3a913a32328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e277ebf9cbf4cb0b6be14efbec504bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:13.717982 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-88561889-4254-49fa-b009-375d49fcd5ce tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] 10.222.0.26 "GET /compute/v2.1/servers/8b29aacb-435d-4c6c-bbe7-3d5c6e1c622e" status: 200 len: 1269 microversion: 2.1 time: 0.148641 Oct 08 20:55:13.718984 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 487/1015] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:55:13 2022] GET /compute/v2.1/servers/8b29aacb-435d-4c6c-bbe7-3d5c6e1c622e => generated 1269 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:55:13.725678 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-bc43759a-f220-4ed1-9944-3ef751c01351 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:13.726907 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-bc43759a-f220-4ed1-9944-3ef751c01351 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] [instance: f04fdc43-98fc-4bfc-a0f6-6efb9d2ee5bc] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:55:13.736658 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bc43759a-f220-4ed1-9944-3ef751c01351 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:13.738895 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bc43759a-f220-4ed1-9944-3ef751c01351 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:13.740607 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bc43759a-f220-4ed1-9944-3ef751c01351 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:13.741997 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bc43759a-f220-4ed1-9944-3ef751c01351 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:13.742769 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bc43759a-f220-4ed1-9944-3ef751c01351 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:13.743639 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bc43759a-f220-4ed1-9944-3ef751c01351 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:13.916887 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-b5c87afe-0f98-4235-b378-04f9098ca76f tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98936da9b5d94165b386d2d0893ac142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2441394d754f499e27f6f35d5b3afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:13.943944 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-b5c87afe-0f98-4235-b378-04f9098ca76f tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] 10.222.0.26 "GET /compute/v2.1/servers/84eba001-0fa3-4fb7-b74e-0bb54c527ac7" status: 200 len: 1714 microversion: 2.1 time: 0.359108 Oct 08 20:55:13.946621 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 529/1016] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:55:13 2022] GET /compute/v2.1/servers/84eba001-0fa3-4fb7-b74e-0bb54c527ac7 => generated 1714 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:55:13.952421 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-ae10dab8-7d47-4d9c-9820-0e4a103e3d78 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:13.953052 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-ae10dab8-7d47-4d9c-9820-0e4a103e3d78 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] [instance: 7e70d7bd-0c39-4320-916f-f99c05ec2806] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:55:13.970684 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ae10dab8-7d47-4d9c-9820-0e4a103e3d78 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:13.972988 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ae10dab8-7d47-4d9c-9820-0e4a103e3d78 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:13.973465 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ae10dab8-7d47-4d9c-9820-0e4a103e3d78 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:13.974219 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ae10dab8-7d47-4d9c-9820-0e4a103e3d78 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:13.974711 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ae10dab8-7d47-4d9c-9820-0e4a103e3d78 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:13.975143 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ae10dab8-7d47-4d9c-9820-0e4a103e3d78 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:14.004827 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-bc43759a-f220-4ed1-9944-3ef751c01351 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:14.015732 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-bc43759a-f220-4ed1-9944-3ef751c01351 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:14.020780 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-bc43759a-f220-4ed1-9944-3ef751c01351 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:14.023179 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-bc43759a-f220-4ed1-9944-3ef751c01351 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] 10.222.0.26 "GET /compute/v2.1/servers/f04fdc43-98fc-4bfc-a0f6-6efb9d2ee5bc" status: 200 len: 1543 microversion: 2.25 time: 0.302653 Oct 08 20:55:14.025494 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 488/1017] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:55:13 2022] GET /compute/v2.1/servers/f04fdc43-98fc-4bfc-a0f6-6efb9d2ee5bc => generated 1543 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:55:14.049498 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-896da00a-2aff-42d6-85db-2622fadceb31 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:14.050217 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-896da00a-2aff-42d6-85db-2622fadceb31 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] [instance: 92e31b92-0af1-4da6-bc87-23978f1aedf5] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:55:14.059292 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-896da00a-2aff-42d6-85db-2622fadceb31 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:14.059850 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-896da00a-2aff-42d6-85db-2622fadceb31 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:14.060363 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-896da00a-2aff-42d6-85db-2622fadceb31 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:14.062108 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-896da00a-2aff-42d6-85db-2622fadceb31 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:14.063421 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-896da00a-2aff-42d6-85db-2622fadceb31 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:14.064171 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-896da00a-2aff-42d6-85db-2622fadceb31 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:14.163114 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-896da00a-2aff-42d6-85db-2622fadceb31 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:14.169579 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:55:14.175748 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-ae10dab8-7d47-4d9c-9820-0e4a103e3d78 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef659f5a1a24c439528a7675bdd70f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c92fe04ab8248399d0acb932f82d607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:14.180539 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-896da00a-2aff-42d6-85db-2622fadceb31 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:14.182319 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-896da00a-2aff-42d6-85db-2622fadceb31 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:14.186234 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-ae10dab8-7d47-4d9c-9820-0e4a103e3d78 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] 10.222.0.26 "GET /compute/v2.1/servers/7e70d7bd-0c39-4320-916f-f99c05ec2806" status: 200 len: 1469 microversion: 2.1 time: 0.237736 Oct 08 20:55:14.187297 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 530/1018] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:55:13 2022] GET /compute/v2.1/servers/7e70d7bd-0c39-4320-916f-f99c05ec2806 => generated 1469 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:55:14.190218 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-896da00a-2aff-42d6-85db-2622fadceb31 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] 10.222.0.26 "GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5" status: 200 len: 1546 microversion: 2.91 time: 0.158354 Oct 08 20:55:14.191211 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 489/1019] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:55:14 2022] GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5 => generated 1546 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:55:14.198869 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-03cd7aac-5cc7-464b-890c-1110638fef2c tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Calling method '.version_select at 0x7f1a8c7aa3a0>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:14.205318 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-03cd7aac-5cc7-464b-890c-1110638fef2c tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:14.206706 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-03cd7aac-5cc7-464b-890c-1110638fef2c tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:14.207927 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-03cd7aac-5cc7-464b-890c-1110638fef2c tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:14.221103 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-03cd7aac-5cc7-464b-890c-1110638fef2c tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] 10.222.0.26 "GET /compute/v2.1/os-migrations" status: 200 len: 1940 microversion: 2.25 time: 0.032546 Oct 08 20:55:14.222001 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 531/1020] 10.222.0.26 () {60 vars in 1184 bytes} [Sat Oct 8 20:55:14 2022] GET /compute/v2.1/os-migrations => generated 1940 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:55:14.238771 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-013ee881-5102-42ff-a6a1-60b7a72802f3 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:14.239557 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-013ee881-5102-42ff-a6a1-60b7a72802f3 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] [instance: f04fdc43-98fc-4bfc-a0f6-6efb9d2ee5bc] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:55:14.246372 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-013ee881-5102-42ff-a6a1-60b7a72802f3 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:14.247018 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-013ee881-5102-42ff-a6a1-60b7a72802f3 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:14.248142 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-013ee881-5102-42ff-a6a1-60b7a72802f3 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:14.248969 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-013ee881-5102-42ff-a6a1-60b7a72802f3 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:14.249573 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-013ee881-5102-42ff-a6a1-60b7a72802f3 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:14.250239 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-013ee881-5102-42ff-a6a1-60b7a72802f3 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:14.401891 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.objects.instance [None req-013ee881-5102-42ff-a6a1-60b7a72802f3 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Lazy-loading 'services' on Instance uuid f04fdc43-98fc-4bfc-a0f6-6efb9d2ee5bc {{(pid=140491) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 20:55:14.420149 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-013ee881-5102-42ff-a6a1-60b7a72802f3 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/f04fdc43-98fc-4bfc-a0f6-6efb9d2ee5bc" status: 200 len: 2036 microversion: 2.25 time: 0.186609 Oct 08 20:55:14.421451 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 490/1021] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:55:14 2022] GET /compute/v2.1/servers/f04fdc43-98fc-4bfc-a0f6-6efb9d2ee5bc => generated 2036 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:55:14.454446 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-73b27263-8fb9-4a68-889c-a224526e5903 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Action: 'create', calling method: .version_select at 0x7f1a8c7c68b0>, body: {"keypair": {"name": "tempest-keypair-1878385195", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHKh8YRmcuDTVEqlIiNuLtjjKIGWU7dPyRHQ6zBKesb4IK1MZNgqx3RJpbHNV38v4sGAxr4vzrcFDDhNJp7K9c4SlANBrlEszSOEt3Wt7wXoVPJ5sGG2dz53MK9OYoSPkQ=="}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:55:14.473806 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-73b27263-8fb9-4a68-889c-a224526e5903 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Getting quotas for project ac5c7906a4714a1887cb823e1c3a6056. Resources: {'key_pairs'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 20:55:14.480136 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-73b27263-8fb9-4a68-889c-a224526e5903 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Getting quotas for user d54b1c5c00544be4b60132d09817c8d6 and project ac5c7906a4714a1887cb823e1c3a6056. Resources: {'key_pairs'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 20:55:14.488992 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-1dc6474a-9bbc-4b35-aba0-b547608470b2 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:14.489638 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-1dc6474a-9bbc-4b35-aba0-b547608470b2 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] [instance: e338d559-3f7c-4cc8-95c6-face79e11ca2] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:55:14.497470 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1dc6474a-9bbc-4b35-aba0-b547608470b2 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:14.498617 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1dc6474a-9bbc-4b35-aba0-b547608470b2 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:14.499421 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1dc6474a-9bbc-4b35-aba0-b547608470b2 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:14.499823 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1dc6474a-9bbc-4b35-aba0-b547608470b2 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:14.500287 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1dc6474a-9bbc-4b35-aba0-b547608470b2 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:14.500725 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1dc6474a-9bbc-4b35-aba0-b547608470b2 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:14.519831 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-73b27263-8fb9-4a68-889c-a224526e5903 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.25 time: 0.070784 Oct 08 20:55:14.520888 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 532/1022] 10.222.0.26 () {62 vars in 1200 bytes} [Sat Oct 8 20:55:14 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 73 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 08 20:55:14.598935 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-b69376b7-709c-4814-9726-1c38271f270e tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Calling method '.version_select at 0x7f1a8c7c6a60>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:14.661826 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-b69376b7-709c-4814-9726-1c38271f270e tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] 10.222.0.26 "GET /compute/v2.1/images/e7e4c6ad-e228-45f1-9998-e20dbf8acb00" status: 200 len: 1455 microversion: 2.1 time: 0.067015 Oct 08 20:55:14.662853 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 533/1023] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:55:14 2022] GET /compute/v2.1/images/e7e4c6ad-e228-45f1-9998-e20dbf8acb00 => generated 1455 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 20:55:14.709783 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-1dc6474a-9bbc-4b35-aba0-b547608470b2 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474ca64d1b1d4e30916b517645aba882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecc2dd2407b4819874bed09cb27959a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:14.718196 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-1dc6474a-9bbc-4b35-aba0-b547608470b2 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] 10.222.0.26 "GET /compute/v2.1/servers/e338d559-3f7c-4cc8-95c6-face79e11ca2" status: 200 len: 1359 microversion: 2.1 time: 0.233474 Oct 08 20:55:14.722066 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 491/1024] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:55:14 2022] GET /compute/v2.1/servers/e338d559-3f7c-4cc8-95c6-face79e11ca2 => generated 1359 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 20:55:14.743866 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-19a734db-4a62-4e8f-bd17-ccfa8be6260c tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:14.744496 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-19a734db-4a62-4e8f-bd17-ccfa8be6260c tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] [instance: 8b29aacb-435d-4c6c-bbe7-3d5c6e1c622e] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:55:14.753076 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-19a734db-4a62-4e8f-bd17-ccfa8be6260c tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:14.753573 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-19a734db-4a62-4e8f-bd17-ccfa8be6260c tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:14.754098 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-19a734db-4a62-4e8f-bd17-ccfa8be6260c tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:14.754739 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-19a734db-4a62-4e8f-bd17-ccfa8be6260c tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:14.755201 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-19a734db-4a62-4e8f-bd17-ccfa8be6260c tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:14.755632 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-19a734db-4a62-4e8f-bd17-ccfa8be6260c tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:14.897796 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-19a734db-4a62-4e8f-bd17-ccfa8be6260c tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6cf9c6c133947f3aecee3a913a32328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e277ebf9cbf4cb0b6be14efbec504bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:14.911702 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-19a734db-4a62-4e8f-bd17-ccfa8be6260c tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] 10.222.0.26 "GET /compute/v2.1/servers/8b29aacb-435d-4c6c-bbe7-3d5c6e1c622e" status: 200 len: 1273 microversion: 2.1 time: 0.171602 Oct 08 20:55:14.921227 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 534/1025] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:55:14 2022] GET /compute/v2.1/servers/8b29aacb-435d-4c6c-bbe7-3d5c6e1c622e => generated 1273 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:55:14.970606 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-706814a6-b9dc-4a26-a4fc-793711ee4ebe tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:14.971089 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-706814a6-b9dc-4a26-a4fc-793711ee4ebe tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] [instance: 84eba001-0fa3-4fb7-b74e-0bb54c527ac7] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:55:14.977816 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-706814a6-b9dc-4a26-a4fc-793711ee4ebe tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:14.978545 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-706814a6-b9dc-4a26-a4fc-793711ee4ebe tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:14.979630 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-706814a6-b9dc-4a26-a4fc-793711ee4ebe tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:14.980704 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-706814a6-b9dc-4a26-a4fc-793711ee4ebe tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:14.981402 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-706814a6-b9dc-4a26-a4fc-793711ee4ebe tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:14.982272 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-706814a6-b9dc-4a26-a4fc-793711ee4ebe tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:15.196340 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-706814a6-b9dc-4a26-a4fc-793711ee4ebe tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98936da9b5d94165b386d2d0893ac142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2441394d754f499e27f6f35d5b3afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:15.210209 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-88b22c54-8803-4de9-9132-0ce509b80f9a tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:15.210656 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-706814a6-b9dc-4a26-a4fc-793711ee4ebe tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] 10.222.0.26 "GET /compute/v2.1/servers/84eba001-0fa3-4fb7-b74e-0bb54c527ac7" status: 200 len: 1714 microversion: 2.1 time: 0.244438 Oct 08 20:55:15.210897 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-88b22c54-8803-4de9-9132-0ce509b80f9a tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] [instance: 7e70d7bd-0c39-4320-916f-f99c05ec2806] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:55:15.212371 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 492/1026] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:55:14 2022] GET /compute/v2.1/servers/84eba001-0fa3-4fb7-b74e-0bb54c527ac7 => generated 1714 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:55:15.224163 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-1aedfcbd-0799-419a-9035-aeace2894b80 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:15.226309 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-1aedfcbd-0799-419a-9035-aeace2894b80 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] [instance: 92e31b92-0af1-4da6-bc87-23978f1aedf5] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:55:15.240454 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-88b22c54-8803-4de9-9132-0ce509b80f9a tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:15.241037 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-88b22c54-8803-4de9-9132-0ce509b80f9a tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:15.241588 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-88b22c54-8803-4de9-9132-0ce509b80f9a tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:15.242367 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-88b22c54-8803-4de9-9132-0ce509b80f9a tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:15.242843 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-88b22c54-8803-4de9-9132-0ce509b80f9a tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:15.245097 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1aedfcbd-0799-419a-9035-aeace2894b80 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:15.245842 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1aedfcbd-0799-419a-9035-aeace2894b80 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:15.246678 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1aedfcbd-0799-419a-9035-aeace2894b80 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:15.248889 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1aedfcbd-0799-419a-9035-aeace2894b80 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:15.249478 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1aedfcbd-0799-419a-9035-aeace2894b80 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:15.249984 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1aedfcbd-0799-419a-9035-aeace2894b80 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:15.255081 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-88b22c54-8803-4de9-9132-0ce509b80f9a tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:15.365897 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-1aedfcbd-0799-419a-9035-aeace2894b80 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:15.383207 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-1aedfcbd-0799-419a-9035-aeace2894b80 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:15.389429 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-1aedfcbd-0799-419a-9035-aeace2894b80 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:15.404639 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-1aedfcbd-0799-419a-9035-aeace2894b80 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] 10.222.0.26 "GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5" status: 200 len: 1546 microversion: 2.91 time: 0.188561 Oct 08 20:55:15.407407 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 493/1027] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:55:15 2022] GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5 => generated 1546 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 08 20:55:15.414550 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-812c378c-81e1-4c21-be65-0682ed1a5a8e req-d250176a-5abe-41c1-9902-8918141275ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e338d559-3f7c-4cc8-95c6-face79e11ca2", "name": "network-vif-plugged", "status": "completed", "tag": "c9d2434a-d900-4b35-afb9-1bca1da86155"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:55:15.432869 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-812c378c-81e1-4c21-be65-0682ed1a5a8e req-d250176a-5abe-41c1-9902-8918141275ee service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:15.433692 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-812c378c-81e1-4c21-be65-0682ed1a5a8e req-d250176a-5abe-41c1-9902-8918141275ee service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:15.437052 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-812c378c-81e1-4c21-be65-0682ed1a5a8e req-d250176a-5abe-41c1-9902-8918141275ee service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:15.440894 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-88b22c54-8803-4de9-9132-0ce509b80f9a tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef659f5a1a24c439528a7675bdd70f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c92fe04ab8248399d0acb932f82d607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:15.452505 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-88b22c54-8803-4de9-9132-0ce509b80f9a tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] 10.222.0.26 "GET /compute/v2.1/servers/7e70d7bd-0c39-4320-916f-f99c05ec2806" status: 200 len: 1469 microversion: 2.1 time: 0.245934 Oct 08 20:55:15.453578 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 535/1028] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:55:15 2022] GET /compute/v2.1/servers/7e70d7bd-0c39-4320-916f-f99c05ec2806 => generated 1469 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 20:55:15.475379 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-812c378c-81e1-4c21-be65-0682ed1a5a8e req-d250176a-5abe-41c1-9902-8918141275ee service nova] Creating event network-vif-plugged:c9d2434a-d900-4b35-afb9-1bca1da86155 for instance e338d559-3f7c-4cc8-95c6-face79e11ca2 on nch2-master-1 Oct 08 20:55:15.481160 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-812c378c-81e1-4c21-be65-0682ed1a5a8e req-d250176a-5abe-41c1-9902-8918141275ee service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072163 Oct 08 20:55:15.481957 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 494/1029] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:55:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:55:15.678243 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-bc57ca7e-e4a5-4bc8-a01f-6fe6dce1397c tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Calling method '.version_select at 0x7f1a8c7c6af0>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:15.745960 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-bc57ca7e-e4a5-4bc8-a01f-6fe6dce1397c tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] 10.222.0.26 "GET /compute/v2.1/images/e7e4c6ad-e228-45f1-9998-e20dbf8acb00" status: 200 len: 1455 microversion: 2.1 time: 0.071505 Oct 08 20:55:15.746949 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-2dd86a58-29be-436a-8803-2e2289ed0a4e tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:15.748238 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 536/1030] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:55:15 2022] GET /compute/v2.1/images/e7e4c6ad-e228-45f1-9998-e20dbf8acb00 => generated 1455 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:55:15.757553 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-2dd86a58-29be-436a-8803-2e2289ed0a4e tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] [instance: e338d559-3f7c-4cc8-95c6-face79e11ca2] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:55:15.783495 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2dd86a58-29be-436a-8803-2e2289ed0a4e tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:15.784100 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2dd86a58-29be-436a-8803-2e2289ed0a4e tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:15.785621 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2dd86a58-29be-436a-8803-2e2289ed0a4e tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:15.786679 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2dd86a58-29be-436a-8803-2e2289ed0a4e tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:15.787321 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2dd86a58-29be-436a-8803-2e2289ed0a4e tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:15.787966 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2dd86a58-29be-436a-8803-2e2289ed0a4e tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:15.935643 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-7a1f6b4a-cdbc-44c0-a7b3-906a43fb91a5 tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:15.936467 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-7a1f6b4a-cdbc-44c0-a7b3-906a43fb91a5 tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] [instance: 8b29aacb-435d-4c6c-bbe7-3d5c6e1c622e] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:55:15.940231 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:55:15.959927 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7a1f6b4a-cdbc-44c0-a7b3-906a43fb91a5 tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:15.960496 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7a1f6b4a-cdbc-44c0-a7b3-906a43fb91a5 tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:15.960959 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7a1f6b4a-cdbc-44c0-a7b3-906a43fb91a5 tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:15.970280 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7a1f6b4a-cdbc-44c0-a7b3-906a43fb91a5 tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:15.970831 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7a1f6b4a-cdbc-44c0-a7b3-906a43fb91a5 tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:15.971291 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7a1f6b4a-cdbc-44c0-a7b3-906a43fb91a5 tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:16.181647 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-7a1f6b4a-cdbc-44c0-a7b3-906a43fb91a5 tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6cf9c6c133947f3aecee3a913a32328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e277ebf9cbf4cb0b6be14efbec504bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:16.190024 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-7a1f6b4a-cdbc-44c0-a7b3-906a43fb91a5 tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] 10.222.0.26 "GET /compute/v2.1/servers/8b29aacb-435d-4c6c-bbe7-3d5c6e1c622e" status: 200 len: 1321 microversion: 2.1 time: 0.258235 Oct 08 20:55:16.193518 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 537/1031] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:55:15 2022] GET /compute/v2.1/servers/8b29aacb-435d-4c6c-bbe7-3d5c6e1c622e => generated 1321 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 20:55:16.236552 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-5f7d88e7-165d-4403-8209-3822d9d0e8ec tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:16.237213 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-5f7d88e7-165d-4403-8209-3822d9d0e8ec tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] [instance: 84eba001-0fa3-4fb7-b74e-0bb54c527ac7] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:55:16.252856 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5f7d88e7-165d-4403-8209-3822d9d0e8ec tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:16.253415 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5f7d88e7-165d-4403-8209-3822d9d0e8ec tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:16.256828 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5f7d88e7-165d-4403-8209-3822d9d0e8ec tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:16.263052 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5f7d88e7-165d-4403-8209-3822d9d0e8ec tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:16.264379 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5f7d88e7-165d-4403-8209-3822d9d0e8ec tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:16.264856 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5f7d88e7-165d-4403-8209-3822d9d0e8ec tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:16.861041 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-2dd86a58-29be-436a-8803-2e2289ed0a4e tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474ca64d1b1d4e30916b517645aba882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecc2dd2407b4819874bed09cb27959a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:16.882500 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-2dd86a58-29be-436a-8803-2e2289ed0a4e tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] 10.222.0.26 "GET /compute/v2.1/servers/e338d559-3f7c-4cc8-95c6-face79e11ca2" status: 200 len: 1359 microversion: 2.1 time: 1.140410 Oct 08 20:55:16.886432 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 495/1032] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:55:15 2022] GET /compute/v2.1/servers/e338d559-3f7c-4cc8-95c6-face79e11ca2 => generated 1359 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:55:16.921960 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-374cb6aa-55b0-4810-adfd-1a7db27ec8a0 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:16.922606 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-374cb6aa-55b0-4810-adfd-1a7db27ec8a0 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] [instance: 92e31b92-0af1-4da6-bc87-23978f1aedf5] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:55:16.961940 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-374cb6aa-55b0-4810-adfd-1a7db27ec8a0 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:16.964331 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-374cb6aa-55b0-4810-adfd-1a7db27ec8a0 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:16.966851 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-374cb6aa-55b0-4810-adfd-1a7db27ec8a0 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:16.967927 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-374cb6aa-55b0-4810-adfd-1a7db27ec8a0 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:16.968578 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-374cb6aa-55b0-4810-adfd-1a7db27ec8a0 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:16.969221 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-374cb6aa-55b0-4810-adfd-1a7db27ec8a0 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:17.180414 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-374cb6aa-55b0-4810-adfd-1a7db27ec8a0 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:17.196364 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-374cb6aa-55b0-4810-adfd-1a7db27ec8a0 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:17.204782 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-374cb6aa-55b0-4810-adfd-1a7db27ec8a0 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:17.215566 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-374cb6aa-55b0-4810-adfd-1a7db27ec8a0 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] 10.222.0.26 "GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5" status: 200 len: 1546 microversion: 2.91 time: 0.327659 Oct 08 20:55:17.249757 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 496/1033] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:55:16 2022] GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5 => generated 1546 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:55:17.262677 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-2eb5cf2e-49db-4cac-a38d-1673e35cfb9c tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:17.264167 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-2eb5cf2e-49db-4cac-a38d-1673e35cfb9c tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] [instance: 7e70d7bd-0c39-4320-916f-f99c05ec2806] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:55:17.287859 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2eb5cf2e-49db-4cac-a38d-1673e35cfb9c tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:17.293975 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2eb5cf2e-49db-4cac-a38d-1673e35cfb9c tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:17.294736 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2eb5cf2e-49db-4cac-a38d-1673e35cfb9c tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:17.295665 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2eb5cf2e-49db-4cac-a38d-1673e35cfb9c tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:17.296301 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2eb5cf2e-49db-4cac-a38d-1673e35cfb9c tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:17.303078 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2eb5cf2e-49db-4cac-a38d-1673e35cfb9c tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:17.397837 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-5f7d88e7-165d-4403-8209-3822d9d0e8ec tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98936da9b5d94165b386d2d0893ac142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2441394d754f499e27f6f35d5b3afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:17.407254 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-5f7d88e7-165d-4403-8209-3822d9d0e8ec tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] 10.222.0.26 "GET /compute/v2.1/servers/84eba001-0fa3-4fb7-b74e-0bb54c527ac7" status: 200 len: 1714 microversion: 2.1 time: 1.176332 Oct 08 20:55:17.415363 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 538/1034] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:55:16 2022] GET /compute/v2.1/servers/84eba001-0fa3-4fb7-b74e-0bb54c527ac7 => generated 1714 bytes in 1185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:55:17.422292 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-78fc4dee-ba6d-4d82-987f-0d468e424be9 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Calling method '.version_select at 0x7f1a8c7c60d0>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:18.342458 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-2eb5cf2e-49db-4cac-a38d-1673e35cfb9c tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef659f5a1a24c439528a7675bdd70f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c92fe04ab8248399d0acb932f82d607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:18.352830 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-2eb5cf2e-49db-4cac-a38d-1673e35cfb9c tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] 10.222.0.26 "GET /compute/v2.1/servers/7e70d7bd-0c39-4320-916f-f99c05ec2806" status: 200 len: 1469 microversion: 2.1 time: 1.101651 Oct 08 20:55:18.358845 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 497/1035] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:55:17 2022] GET /compute/v2.1/servers/7e70d7bd-0c39-4320-916f-f99c05ec2806 => generated 1469 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:55:18.372011 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-a00324aa-7204-436e-97ac-0d750d8c65c7 tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:18.374269 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-a00324aa-7204-436e-97ac-0d750d8c65c7 tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] [instance: 8b29aacb-435d-4c6c-bbe7-3d5c6e1c622e] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:55:18.397163 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a00324aa-7204-436e-97ac-0d750d8c65c7 tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:18.401047 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a00324aa-7204-436e-97ac-0d750d8c65c7 tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:18.402235 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a00324aa-7204-436e-97ac-0d750d8c65c7 tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:18.403647 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a00324aa-7204-436e-97ac-0d750d8c65c7 tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:18.405806 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a00324aa-7204-436e-97ac-0d750d8c65c7 tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:18.406439 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a00324aa-7204-436e-97ac-0d750d8c65c7 tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:18.682030 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-a00324aa-7204-436e-97ac-0d750d8c65c7 tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6cf9c6c133947f3aecee3a913a32328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e277ebf9cbf4cb0b6be14efbec504bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:18.696747 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-a00324aa-7204-436e-97ac-0d750d8c65c7 tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] 10.222.0.26 "GET /compute/v2.1/servers/8b29aacb-435d-4c6c-bbe7-3d5c6e1c622e" status: 200 len: 1327 microversion: 2.1 time: 0.332247 Oct 08 20:55:18.718195 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 498/1036] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:55:18 2022] GET /compute/v2.1/servers/8b29aacb-435d-4c6c-bbe7-3d5c6e1c622e => generated 1327 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:55:18.730781 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-e04f8e38-d712-4462-82fd-f19b0a91ceb0 req-7d8addb6-736d-485d-ba32-90c2262b1a95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24300a5e-164c-4d97-9a1f-b52359c1c0d6", "name": "network-vif-plugged", "status": "completed", "tag": "2fe7c081-3e45-4535-9c6e-1d2e86219410"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:55:18.796326 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-e04f8e38-d712-4462-82fd-f19b0a91ceb0 req-7d8addb6-736d-485d-ba32-90c2262b1a95 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:18.797242 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-e04f8e38-d712-4462-82fd-f19b0a91ceb0 req-7d8addb6-736d-485d-ba32-90c2262b1a95 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:18.797377 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-e04f8e38-d712-4462-82fd-f19b0a91ceb0 req-7d8addb6-736d-485d-ba32-90c2262b1a95 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:18.845715 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-e04f8e38-d712-4462-82fd-f19b0a91ceb0 req-7d8addb6-736d-485d-ba32-90c2262b1a95 service nova] Creating event network-vif-plugged:2fe7c081-3e45-4535-9c6e-1d2e86219410 for instance 24300a5e-164c-4d97-9a1f-b52359c1c0d6 on nch1-master-1 Oct 08 20:55:18.855467 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-e04f8e38-d712-4462-82fd-f19b0a91ceb0 req-7d8addb6-736d-485d-ba32-90c2262b1a95 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132814 Oct 08 20:55:18.856624 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 499/1037] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:55:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:55:18.864814 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-f094ebd4-4190-44e0-abdc-5ffcc39563a7 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:18.866510 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-f094ebd4-4190-44e0-abdc-5ffcc39563a7 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] [instance: e338d559-3f7c-4cc8-95c6-face79e11ca2] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:55:18.881807 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f094ebd4-4190-44e0-abdc-5ffcc39563a7 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:18.886984 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f094ebd4-4190-44e0-abdc-5ffcc39563a7 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:18.887815 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f094ebd4-4190-44e0-abdc-5ffcc39563a7 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:18.889632 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f094ebd4-4190-44e0-abdc-5ffcc39563a7 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:18.890329 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f094ebd4-4190-44e0-abdc-5ffcc39563a7 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:18.891054 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f094ebd4-4190-44e0-abdc-5ffcc39563a7 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:20.383493 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-f094ebd4-4190-44e0-abdc-5ffcc39563a7 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474ca64d1b1d4e30916b517645aba882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecc2dd2407b4819874bed09cb27959a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:20.419625 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-f094ebd4-4190-44e0-abdc-5ffcc39563a7 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] 10.222.0.26 "GET /compute/v2.1/servers/e338d559-3f7c-4cc8-95c6-face79e11ca2" status: 200 len: 1543 microversion: 2.1 time: 1.559639 Oct 08 20:55:20.442822 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 500/1038] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:55:18 2022] GET /compute/v2.1/servers/e338d559-3f7c-4cc8-95c6-face79e11ca2 => generated 1543 bytes in 1585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:55:20.449791 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-89888463-914d-4a77-aa3b-906cf764e29d req-43d632c2-6f3d-4568-9bea-a6b86c2bba15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e70d7bd-0c39-4320-916f-f99c05ec2806", "name": "network-vif-deleted", "tag": "b4ba81f5-23a1-4960-a30e-7b870430ccad"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:55:20.466704 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-89888463-914d-4a77-aa3b-906cf764e29d req-43d632c2-6f3d-4568-9bea-a6b86c2bba15 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:20.467594 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-89888463-914d-4a77-aa3b-906cf764e29d req-43d632c2-6f3d-4568-9bea-a6b86c2bba15 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:20.468391 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-89888463-914d-4a77-aa3b-906cf764e29d req-43d632c2-6f3d-4568-9bea-a6b86c2bba15 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:20.486373 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-89888463-914d-4a77-aa3b-906cf764e29d req-43d632c2-6f3d-4568-9bea-a6b86c2bba15 service nova] Creating event network-vif-deleted:b4ba81f5-23a1-4960-a30e-7b870430ccad for instance 7e70d7bd-0c39-4320-916f-f99c05ec2806 on nch2-master-1 Oct 08 20:55:20.504596 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-89888463-914d-4a77-aa3b-906cf764e29d req-43d632c2-6f3d-4568-9bea-a6b86c2bba15 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047206 Oct 08 20:55:20.508106 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 501/1039] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:55:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:55:20.525817 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-a524da14-b2d1-4926-845e-d3c57c5b28bb tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:20.535739 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-a524da14-b2d1-4926-845e-d3c57c5b28bb tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] [instance: 92e31b92-0af1-4da6-bc87-23978f1aedf5] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:55:20.547919 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a524da14-b2d1-4926-845e-d3c57c5b28bb tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:20.552904 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a524da14-b2d1-4926-845e-d3c57c5b28bb tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:20.555273 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a524da14-b2d1-4926-845e-d3c57c5b28bb tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:20.559100 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a524da14-b2d1-4926-845e-d3c57c5b28bb tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:20.560948 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a524da14-b2d1-4926-845e-d3c57c5b28bb tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:20.561906 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a524da14-b2d1-4926-845e-d3c57c5b28bb tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:20.744573 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-a524da14-b2d1-4926-845e-d3c57c5b28bb tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:20.760595 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-a524da14-b2d1-4926-845e-d3c57c5b28bb tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:20.772780 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-a524da14-b2d1-4926-845e-d3c57c5b28bb tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:20.811852 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-a524da14-b2d1-4926-845e-d3c57c5b28bb tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] 10.222.0.26 "GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5" status: 200 len: 1546 microversion: 2.91 time: 0.294067 Oct 08 20:55:20.812566 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 502/1040] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:55:20 2022] GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5 => generated 1546 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:55:20.846481 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-10a5e135-9255-4bf3-9ead-d0c48d5bff40 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:20.847144 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-10a5e135-9255-4bf3-9ead-d0c48d5bff40 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] [instance: 84eba001-0fa3-4fb7-b74e-0bb54c527ac7] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:55:20.869743 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-10a5e135-9255-4bf3-9ead-d0c48d5bff40 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:20.872302 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-10a5e135-9255-4bf3-9ead-d0c48d5bff40 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:20.874265 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-10a5e135-9255-4bf3-9ead-d0c48d5bff40 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:20.876289 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-10a5e135-9255-4bf3-9ead-d0c48d5bff40 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:20.877412 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-10a5e135-9255-4bf3-9ead-d0c48d5bff40 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:20.880130 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-10a5e135-9255-4bf3-9ead-d0c48d5bff40 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:21.142210 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-10a5e135-9255-4bf3-9ead-d0c48d5bff40 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98936da9b5d94165b386d2d0893ac142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2441394d754f499e27f6f35d5b3afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:21.156583 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-10a5e135-9255-4bf3-9ead-d0c48d5bff40 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] 10.222.0.26 "GET /compute/v2.1/servers/84eba001-0fa3-4fb7-b74e-0bb54c527ac7" status: 200 len: 1349 microversion: 2.1 time: 0.342992 Oct 08 20:55:21.162359 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 503/1041] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:55:20 2022] GET /compute/v2.1/servers/84eba001-0fa3-4fb7-b74e-0bb54c527ac7 => generated 1349 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:55:21.170772 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-58a47dc8-847d-4f11-8c32-624f24f94648 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:21.171708 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-58a47dc8-847d-4f11-8c32-624f24f94648 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] [instance: 7e70d7bd-0c39-4320-916f-f99c05ec2806] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:55:21.188538 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-58a47dc8-847d-4f11-8c32-624f24f94648 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:21.189918 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-58a47dc8-847d-4f11-8c32-624f24f94648 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:21.193089 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-58a47dc8-847d-4f11-8c32-624f24f94648 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:21.194277 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-58a47dc8-847d-4f11-8c32-624f24f94648 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:21.196587 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-58a47dc8-847d-4f11-8c32-624f24f94648 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:21.198594 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-58a47dc8-847d-4f11-8c32-624f24f94648 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:21.266512 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-58a47dc8-847d-4f11-8c32-624f24f94648 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] HTTP exception thrown: Instance 7e70d7bd-0c39-4320-916f-f99c05ec2806 could not be found. Oct 08 20:55:21.274258 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-58a47dc8-847d-4f11-8c32-624f24f94648 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Request method failure captured: Oct 08 20:55:21.274258 ncdv-master-1 devstack@n-api.service[140491]: request: GET /compute/v2.1/servers/7e70d7bd-0c39-4320-916f-f99c05ec2806 HTTP/1.1 Oct 08 20:55:21.274258 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 20:55:21.274258 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 20:55:21.274258 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 20:55:21.274258 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 20:55:21.274258 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 20:55:21.274258 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 20:55:21.274258 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 20:55:21.274258 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 20:55:21.274258 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeMkMNEyrQg7LwXap23MVpWLk08k2XXa9AhhNdDm_bF8My40HcX5l0HeSUCvRieavRf1weJ6dMtuMQLwqaU4APNmYN6MQxJxQHNM0803_f0HSjFTMyWD2vVxd_RSK9X61rs2mpvuyoMUTeom0NYxzJF3WrYO7bBQKfgnboDedNPTU3Q Oct 08 20:55:21.274258 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 20:55:21.274258 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 20:55:21.274258 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 20:55:21.274258 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 20:55:21.274258 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 20:55:21.274258 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 20:55:21.274258 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 8c92fe04ab8248399d0acb932f82d607 Oct 08 20:55:21.274258 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-ServersAdminTestJSON-78545731 Oct 08 20:55:21.274258 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 20:55:21.274258 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 20:55:21.274258 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8c92fe04ab8248399d0acb932f82d607"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8c92fe04ab8248399d0acb932f82d607"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8c92fe04ab8248399d0acb932f82d607"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8c92fe04ab8248399d0acb932f82d607"}]}] Oct 08 20:55:21.274258 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-ServersAdminTestJSON-78545731 Oct 08 20:55:21.274258 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 8c92fe04ab8248399d0acb932f82d607 Oct 08 20:55:21.274258 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-ServersAdminTestJSON-78545731 Oct 08 20:55:21.274258 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-ServersAdminTestJSON-78545731-project Oct 08 20:55:21.274258 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 20:55:21.274258 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 20:55:21.274258 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 5ef659f5a1a24c439528a7675bdd70f8 Oct 08 20:55:21.274258 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-ServersAdminTestJSON-78545731-project Oct 08 20:55:21.274258 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 20:55:21.274258 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance 7e70d7bd-0c39-4320-916f-f99c05ec2806 could not be found. Oct 08 20:55:21.274258 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': '7e70d7bd-0c39-4320-916f-f99c05ec2806'} Oct 08 20:55:21.274258 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:55:21.274258 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:55:21.274258 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 20:55:21.274258 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 20:55:21.274258 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 20:55:21.274258 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 20:55:21.274258 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 20:55:21.274258 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 20:55:21.274258 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 20:55:21.274258 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 20:55:21.274258 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e70d7bd-0c39-4320-916f-f99c05ec2806 could not be found. Oct 08 20:55:21.274258 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:55:21.274258 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:55:21.274258 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:55:21.274258 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:55:21.274258 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:55:21.274258 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:55:21.274258 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:55:21.274258 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:55:21.274258 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:55:21.274258 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:55:21.274258 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 20:55:21.274258 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 20:55:21.274258 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 20:55:21.274258 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 20:55:21.274258 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 20:55:21.274258 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 20:55:21.274258 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e70d7bd-0c39-4320-916f-f99c05ec2806 could not be found. Oct 08 20:55:21.274258 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:55:21.274258 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:55:21.274258 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:55:21.280923 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:55:21.280923 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:55:21.280923 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:55:21.280923 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 20:55:21.280923 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 20:55:21.280923 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e70d7bd-0c39-4320-916f-f99c05ec2806 could not be found. Oct 08 20:55:21.280923 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:55:21.283660 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-58a47dc8-847d-4f11-8c32-624f24f94648 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Returning 404 to user: Instance 7e70d7bd-0c39-4320-916f-f99c05ec2806 could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:55:21.287670 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-58a47dc8-847d-4f11-8c32-624f24f94648 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] 10.222.0.26 "GET /compute/v2.1/servers/7e70d7bd-0c39-4320-916f-f99c05ec2806" status: 404 len: 111 microversion: 2.1 time: 0.120437 Oct 08 20:55:21.289137 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 504/1042] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:55:21 2022] GET /compute/v2.1/servers/7e70d7bd-0c39-4320-916f-f99c05ec2806 => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 20:55:21.307672 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-7cb7adbd-3861-4a2b-8973-c08f642fabfd tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:21.309032 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-7cb7adbd-3861-4a2b-8973-c08f642fabfd tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] [instance: 8b29aacb-435d-4c6c-bbe7-3d5c6e1c622e] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:55:21.322602 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7cb7adbd-3861-4a2b-8973-c08f642fabfd tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:21.323257 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7cb7adbd-3861-4a2b-8973-c08f642fabfd tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:21.323836 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7cb7adbd-3861-4a2b-8973-c08f642fabfd tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:21.331598 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7cb7adbd-3861-4a2b-8973-c08f642fabfd tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:21.334843 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7cb7adbd-3861-4a2b-8973-c08f642fabfd tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:21.337505 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7cb7adbd-3861-4a2b-8973-c08f642fabfd tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:21.866946 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-7cb7adbd-3861-4a2b-8973-c08f642fabfd tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6cf9c6c133947f3aecee3a913a32328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e277ebf9cbf4cb0b6be14efbec504bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:21.877331 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-7cb7adbd-3861-4a2b-8973-c08f642fabfd tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] 10.222.0.26 "GET /compute/v2.1/servers/8b29aacb-435d-4c6c-bbe7-3d5c6e1c622e" status: 200 len: 1395 microversion: 2.1 time: 0.583554 Oct 08 20:55:21.885631 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 505/1043] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:55:21 2022] GET /compute/v2.1/servers/8b29aacb-435d-4c6c-bbe7-3d5c6e1c622e => generated 1395 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:55:21.894816 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-4425248d-5b0c-4be6-be37-d4b4507faf12 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1278174380", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "networks": [{"uuid": "a9c0a282-71aa-4609-90f6-4683ed1165e3"}], "security_groups": [{"name": "tempest-securitygroup--1941630344"}], "key_name": "tempest-keypair-1878385195", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:55:22.595929 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=2 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:55:23.718268 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=2 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:55:24.495736 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=14 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:55:26.241977 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=2 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:55:27.405876 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=58 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:55:30.849327 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-78fc4dee-ba6d-4d82-987f-0d468e424be9 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] 10.222.0.26 "GET /compute/v2.1/images/e7e4c6ad-e228-45f1-9998-e20dbf8acb00" status: 200 len: 1464 microversion: 2.1 time: 13.432563 Oct 08 20:55:30.852224 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 539/1044] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:55:17 2022] GET /compute/v2.1/images/e7e4c6ad-e228-45f1-9998-e20dbf8acb00 => generated 1464 bytes in 13436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:55:30.864801 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-baea033a-0934-4e3f-9a76-a63f3755d6a6 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:30.865391 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-baea033a-0934-4e3f-9a76-a63f3755d6a6 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] [instance: e338d559-3f7c-4cc8-95c6-face79e11ca2] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:55:30.887325 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-baea033a-0934-4e3f-9a76-a63f3755d6a6 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:30.889319 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-baea033a-0934-4e3f-9a76-a63f3755d6a6 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:30.891124 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-baea033a-0934-4e3f-9a76-a63f3755d6a6 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:30.892171 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-baea033a-0934-4e3f-9a76-a63f3755d6a6 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:30.892888 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-baea033a-0934-4e3f-9a76-a63f3755d6a6 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:30.893686 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-baea033a-0934-4e3f-9a76-a63f3755d6a6 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:30.918265 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.network.neutron [None req-4425248d-5b0c-4be6-be37-d4b4507faf12 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] validate_networks() for [('a9c0a282-71aa-4609-90f6-4683ed1165e3', None, None, None, None, None)] {{(pid=140491) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 20:55:31.006985 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-baea033a-0934-4e3f-9a76-a63f3755d6a6 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] 10.222.0.26 "GET /compute/v2.1/servers/e338d559-3f7c-4cc8-95c6-face79e11ca2/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.146209 Oct 08 20:55:31.007591 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 540/1045] 10.222.0.26 () {58 vars in 1275 bytes} [Sat Oct 8 20:55:30 2022] GET /compute/v2.1/servers/e338d559-3f7c-4cc8-95c6-face79e11ca2/os-interface => generated 285 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:55:31.012386 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-cd1fa2ae-dff7-4872-b512-1f6432101511 req-73ae4e60-d6dd-48e8-9783-b8ca974658af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84eba001-0fa3-4fb7-b74e-0bb54c527ac7", "name": "network-vif-deleted", "tag": "80190695-6264-463b-85c7-626419e89ee2"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:55:31.025002 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-cd1fa2ae-dff7-4872-b512-1f6432101511 req-73ae4e60-d6dd-48e8-9783-b8ca974658af service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:31.025699 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-cd1fa2ae-dff7-4872-b512-1f6432101511 req-73ae4e60-d6dd-48e8-9783-b8ca974658af service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:31.026662 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-cd1fa2ae-dff7-4872-b512-1f6432101511 req-73ae4e60-d6dd-48e8-9783-b8ca974658af service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:31.042941 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-cd1fa2ae-dff7-4872-b512-1f6432101511 req-73ae4e60-d6dd-48e8-9783-b8ca974658af service nova] Creating event network-vif-deleted:80190695-6264-463b-85c7-626419e89ee2 for instance 84eba001-0fa3-4fb7-b74e-0bb54c527ac7 on nch2-master-1 Oct 08 20:55:31.049562 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-cd1fa2ae-dff7-4872-b512-1f6432101511 req-73ae4e60-d6dd-48e8-9783-b8ca974658af service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040448 Oct 08 20:55:31.050766 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 541/1046] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:55:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:55:31.056438 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-79a3d8fb-086a-4664-8c1e-7c3a5251654c tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:31.057152 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-79a3d8fb-086a-4664-8c1e-7c3a5251654c tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] [instance: 5c864780-3998-4a09-95d4-e000a02af71e] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:55:31.067069 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-79a3d8fb-086a-4664-8c1e-7c3a5251654c tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:31.067839 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-79a3d8fb-086a-4664-8c1e-7c3a5251654c tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:31.068464 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-79a3d8fb-086a-4664-8c1e-7c3a5251654c tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:31.069674 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-79a3d8fb-086a-4664-8c1e-7c3a5251654c tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:31.070308 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-79a3d8fb-086a-4664-8c1e-7c3a5251654c tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:31.070890 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-79a3d8fb-086a-4664-8c1e-7c3a5251654c tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:31.110422 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-79a3d8fb-086a-4664-8c1e-7c3a5251654c tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] [instance: 5c864780-3998-4a09-95d4-e000a02af71e] Going to try to terminate instance {{(pid=140492) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 20:55:31.252671 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-79a3d8fb-086a-4664-8c1e-7c3a5251654c tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] 10.222.0.26 "DELETE /compute/v2.1/servers/5c864780-3998-4a09-95d4-e000a02af71e" status: 204 len: 0 microversion: 2.1 time: 0.199937 Oct 08 20:55:31.256312 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 542/1047] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 20:55:31 2022] DELETE /compute/v2.1/servers/5c864780-3998-4a09-95d4-e000a02af71e => generated 0 bytes in 202 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 20:55:31.271325 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-48e37b11-0604-4c9e-87c1-1c0a9f0d3c6f tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:31.275720 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-48e37b11-0604-4c9e-87c1-1c0a9f0d3c6f tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] [instance: 92e31b92-0af1-4da6-bc87-23978f1aedf5] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:55:31.288900 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-48e37b11-0604-4c9e-87c1-1c0a9f0d3c6f tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:31.289428 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-48e37b11-0604-4c9e-87c1-1c0a9f0d3c6f tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:31.289873 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-48e37b11-0604-4c9e-87c1-1c0a9f0d3c6f tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:31.290593 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-48e37b11-0604-4c9e-87c1-1c0a9f0d3c6f tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:31.291053 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-48e37b11-0604-4c9e-87c1-1c0a9f0d3c6f tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:31.291479 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-48e37b11-0604-4c9e-87c1-1c0a9f0d3c6f tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:31.399485 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-48e37b11-0604-4c9e-87c1-1c0a9f0d3c6f tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:31.409791 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-48e37b11-0604-4c9e-87c1-1c0a9f0d3c6f tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:31.411632 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-48e37b11-0604-4c9e-87c1-1c0a9f0d3c6f tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:31.418026 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-48e37b11-0604-4c9e-87c1-1c0a9f0d3c6f tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] 10.222.0.26 "GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5" status: 200 len: 1533 microversion: 2.91 time: 0.161860 Oct 08 20:55:31.418625 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 543/1048] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:55:31 2022] GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5 => generated 1533 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:55:31.423788 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-341784ee-1ec0-4af0-aaaf-97b0c02779b1 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:31.424959 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-341784ee-1ec0-4af0-aaaf-97b0c02779b1 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] [instance: 84eba001-0fa3-4fb7-b74e-0bb54c527ac7] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:55:31.431629 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-341784ee-1ec0-4af0-aaaf-97b0c02779b1 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:31.432305 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-341784ee-1ec0-4af0-aaaf-97b0c02779b1 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:31.433934 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-341784ee-1ec0-4af0-aaaf-97b0c02779b1 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:31.434930 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-341784ee-1ec0-4af0-aaaf-97b0c02779b1 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:31.435915 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-341784ee-1ec0-4af0-aaaf-97b0c02779b1 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:31.436488 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-341784ee-1ec0-4af0-aaaf-97b0c02779b1 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:31.438353 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-4425248d-5b0c-4be6-be37-d4b4507faf12 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Flavor limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 20:55:31.438889 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-4425248d-5b0c-4be6-be37-d4b4507faf12 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Image limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 20:55:31.439461 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-4425248d-5b0c-4be6-be37-d4b4507faf12 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Flavor pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 20:55:31.440195 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-4425248d-5b0c-4be6-be37-d4b4507faf12 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Image pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 20:55:31.441179 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-4425248d-5b0c-4be6-be37-d4b4507faf12 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 20:55:31.452914 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-341784ee-1ec0-4af0-aaaf-97b0c02779b1 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] HTTP exception thrown: Instance 84eba001-0fa3-4fb7-b74e-0bb54c527ac7 could not be found. Oct 08 20:55:31.453151 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4425248d-5b0c-4be6-be37-d4b4507faf12 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:31.453914 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4425248d-5b0c-4be6-be37-d4b4507faf12 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:31.454578 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4425248d-5b0c-4be6-be37-d4b4507faf12 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:31.454944 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-341784ee-1ec0-4af0-aaaf-97b0c02779b1 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Request method failure captured: Oct 08 20:55:31.454944 ncdv-master-1 devstack@n-api.service[140492]: request: GET /compute/v2.1/servers/84eba001-0fa3-4fb7-b74e-0bb54c527ac7 HTTP/1.1 Oct 08 20:55:31.454944 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 20:55:31.454944 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 20:55:31.454944 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 20:55:31.454944 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 20:55:31.454944 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 20:55:31.454944 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 20:55:31.454944 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 20:55:31.454944 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 20:55:31.454944 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeMXkQ9S732V3cpLCisxVJQe-q2toVhIajNzC-zq33tauXDirGNTesY0Wf-LRNH444EBjhzYQ7kl4MmsCFiS_cCEelCALMv3KhbtqPjh5uz7XrsvX-cAmAqlvWahlaNJdqn0xoKpA6vR8HUTGcOyatsNfTsoVbF5ByL0RZGe4ZLvS_4 Oct 08 20:55:31.454944 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 20:55:31.454944 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 20:55:31.454944 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 20:55:31.454944 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 20:55:31.454944 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 20:55:31.454944 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 20:55:31.454944 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 3f2441394d754f499e27f6f35d5b3afa Oct 08 20:55:31.454944 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1665027500 Oct 08 20:55:31.454944 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 20:55:31.454944 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 20:55:31.454944 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3f2441394d754f499e27f6f35d5b3afa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3f2441394d754f499e27f6f35d5b3afa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3f2441394d754f499e27f6f35d5b3afa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3f2441394d754f499e27f6f35d5b3afa"}]}] Oct 08 20:55:31.454944 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1665027500 Oct 08 20:55:31.454944 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 3f2441394d754f499e27f6f35d5b3afa Oct 08 20:55:31.454944 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1665027500 Oct 08 20:55:31.454944 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1665027500-project Oct 08 20:55:31.454944 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 20:55:31.454944 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 20:55:31.454944 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 98936da9b5d94165b386d2d0893ac142 Oct 08 20:55:31.454944 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1665027500-project Oct 08 20:55:31.454944 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 20:55:31.454944 ncdv-master-1 devstack@n-api.service[140492]: exception: Instance 84eba001-0fa3-4fb7-b74e-0bb54c527ac7 could not be found. Oct 08 20:55:31.454944 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': '84eba001-0fa3-4fb7-b74e-0bb54c527ac7'} Oct 08 20:55:31.454944 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:55:31.454944 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:55:31.454944 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 20:55:31.454944 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 20:55:31.454944 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 20:55:31.454944 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 20:55:31.454944 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 20:55:31.454944 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 20:55:31.454944 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 20:55:31.454944 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 20:55:31.454944 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84eba001-0fa3-4fb7-b74e-0bb54c527ac7 could not be found. Oct 08 20:55:31.454944 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:55:31.454944 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:55:31.454944 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:55:31.454944 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:55:31.454944 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:55:31.454944 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:55:31.454944 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:55:31.454944 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:55:31.454944 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:55:31.454944 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:55:31.454944 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 20:55:31.454944 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 20:55:31.454944 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 20:55:31.454944 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 20:55:31.454944 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 20:55:31.454944 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 20:55:31.454944 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84eba001-0fa3-4fb7-b74e-0bb54c527ac7 could not be found. Oct 08 20:55:31.454944 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:55:31.460863 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:55:31.460863 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:55:31.460863 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:55:31.460863 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:55:31.460863 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:55:31.460863 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 20:55:31.460863 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 20:55:31.460863 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84eba001-0fa3-4fb7-b74e-0bb54c527ac7 could not be found. Oct 08 20:55:31.460863 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:55:31.460863 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-341784ee-1ec0-4af0-aaaf-97b0c02779b1 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Returning 404 to user: Instance 84eba001-0fa3-4fb7-b74e-0bb54c527ac7 could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:55:31.460863 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-341784ee-1ec0-4af0-aaaf-97b0c02779b1 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] 10.222.0.26 "GET /compute/v2.1/servers/84eba001-0fa3-4fb7-b74e-0bb54c527ac7" status: 404 len: 111 microversion: 2.1 time: 0.036985 Oct 08 20:55:31.460863 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 544/1049] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:55:31 2022] GET /compute/v2.1/servers/84eba001-0fa3-4fb7-b74e-0bb54c527ac7 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 20:55:31.463811 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4425248d-5b0c-4be6-be37-d4b4507faf12 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:31.464524 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4425248d-5b0c-4be6-be37-d4b4507faf12 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:31.464907 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-748f677c-4b48-4cea-b634-4c9ea293a6aa tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:31.465438 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4425248d-5b0c-4be6-be37-d4b4507faf12 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:31.466694 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-748f677c-4b48-4cea-b634-4c9ea293a6aa tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] [instance: 8b29aacb-435d-4c6c-bbe7-3d5c6e1c622e] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:55:31.483086 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-748f677c-4b48-4cea-b634-4c9ea293a6aa tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:31.483604 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-748f677c-4b48-4cea-b634-4c9ea293a6aa tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:31.484064 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-748f677c-4b48-4cea-b634-4c9ea293a6aa tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:31.484786 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-748f677c-4b48-4cea-b634-4c9ea293a6aa tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:31.485452 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-748f677c-4b48-4cea-b634-4c9ea293a6aa tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:31.486036 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-748f677c-4b48-4cea-b634-4c9ea293a6aa tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:31.489221 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-4425248d-5b0c-4be6-be37-d4b4507faf12 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Getting quotas for project ac5c7906a4714a1887cb823e1c3a6056. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 20:55:31.495617 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-4425248d-5b0c-4be6-be37-d4b4507faf12 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Getting quotas for user d54b1c5c00544be4b60132d09817c8d6 and project ac5c7906a4714a1887cb823e1c3a6056. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 20:55:31.509908 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:55:31.511681 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-4425248d-5b0c-4be6-be37-d4b4507faf12 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Going to run 1 instances... {{(pid=140491) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 20:55:31.514691 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-4425248d-5b0c-4be6-be37-d4b4507faf12 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] [instance: 57016fcf-2d2c-488c-9af6-0530ebc199f6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c508bd7f-7db9-4b2c-af7c-be54a855c355',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140491) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 20:55:31.572412 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-4425248d-5b0c-4be6-be37-d4b4507faf12 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.25 time: 9.684928 Oct 08 20:55:31.573077 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 506/1050] 10.222.0.26 () {62 vars in 1188 bytes} [Sat Oct 8 20:55:21 2022] POST /compute/v2.1/servers => generated 406 bytes in 9687 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 08 20:55:31.583553 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-34fb42ec-456e-4086-a70a-fea9131f2b71 req-cda3a408-290f-49f5-bb5a-80c2d542a5f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b29aacb-435d-4c6c-bbe7-3d5c6e1c622e", "name": "network-vif-plugged", "status": "completed", "tag": "d89da5d3-0c81-4f3c-902a-ac5dee64ec3a"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:55:31.597162 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-34fb42ec-456e-4086-a70a-fea9131f2b71 req-cda3a408-290f-49f5-bb5a-80c2d542a5f9 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:31.597689 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-34fb42ec-456e-4086-a70a-fea9131f2b71 req-cda3a408-290f-49f5-bb5a-80c2d542a5f9 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:31.598126 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-34fb42ec-456e-4086-a70a-fea9131f2b71 req-cda3a408-290f-49f5-bb5a-80c2d542a5f9 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:31.613858 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-34fb42ec-456e-4086-a70a-fea9131f2b71 req-cda3a408-290f-49f5-bb5a-80c2d542a5f9 service nova] Creating event network-vif-plugged:d89da5d3-0c81-4f3c-902a-ac5dee64ec3a for instance 8b29aacb-435d-4c6c-bbe7-3d5c6e1c622e on nch2-master-1 Oct 08 20:55:31.619524 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-34fb42ec-456e-4086-a70a-fea9131f2b71 req-cda3a408-290f-49f5-bb5a-80c2d542a5f9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043785 Oct 08 20:55:31.620139 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 507/1051] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:55:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:55:31.628027 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c3a5a187-1815-4409-b32f-bcb240c48053 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Calling method '.version_select at 0x7f1a8c97b3a0>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:31.684289 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-c3a5a187-1815-4409-b32f-bcb240c48053 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] 10.222.0.26 "GET /compute/v2.1/images/e7e4c6ad-e228-45f1-9998-e20dbf8acb00" status: 200 len: 1464 microversion: 2.1 time: 0.062514 Oct 08 20:55:31.689778 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 508/1052] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:55:31 2022] GET /compute/v2.1/images/e7e4c6ad-e228-45f1-9998-e20dbf8acb00 => generated 1464 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:55:31.700527 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-d9808d89-f1f9-4a24-b827-22109245dcd0 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:31.702780 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-d9808d89-f1f9-4a24-b827-22109245dcd0 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] [instance: 5c864780-3998-4a09-95d4-e000a02af71e] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:55:31.721339 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d9808d89-f1f9-4a24-b827-22109245dcd0 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:31.722881 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d9808d89-f1f9-4a24-b827-22109245dcd0 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:31.724071 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d9808d89-f1f9-4a24-b827-22109245dcd0 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:31.725862 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d9808d89-f1f9-4a24-b827-22109245dcd0 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:31.726741 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d9808d89-f1f9-4a24-b827-22109245dcd0 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:31.727187 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d9808d89-f1f9-4a24-b827-22109245dcd0 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:31.903908 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-d9808d89-f1f9-4a24-b827-22109245dcd0 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef659f5a1a24c439528a7675bdd70f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c92fe04ab8248399d0acb932f82d607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:31.905796 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-748f677c-4b48-4cea-b634-4c9ea293a6aa tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6cf9c6c133947f3aecee3a913a32328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e277ebf9cbf4cb0b6be14efbec504bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:31.915725 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-d9808d89-f1f9-4a24-b827-22109245dcd0 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] 10.222.0.26 "GET /compute/v2.1/servers/5c864780-3998-4a09-95d4-e000a02af71e" status: 200 len: 1469 microversion: 2.1 time: 0.224521 Oct 08 20:55:31.916965 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 509/1053] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:55:31 2022] GET /compute/v2.1/servers/5c864780-3998-4a09-95d4-e000a02af71e => generated 1469 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:55:31.936577 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-5dff1153-e6ac-44db-af87-7e4c9eae957d tempest-UnshelveToHostMultiNodesTest-675009540 tempest-UnshelveToHostMultiNodesTest-675009540-project-admin] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:31.937272 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-748f677c-4b48-4cea-b634-4c9ea293a6aa tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] 10.222.0.26 "GET /compute/v2.1/servers/8b29aacb-435d-4c6c-bbe7-3d5c6e1c622e" status: 200 len: 1395 microversion: 2.1 time: 0.476951 Oct 08 20:55:31.938179 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 545/1054] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:55:31 2022] GET /compute/v2.1/servers/8b29aacb-435d-4c6c-bbe7-3d5c6e1c622e => generated 1395 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:55:31.939666 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-5dff1153-e6ac-44db-af87-7e4c9eae957d tempest-UnshelveToHostMultiNodesTest-675009540 tempest-UnshelveToHostMultiNodesTest-675009540-project-admin] [instance: 92e31b92-0af1-4da6-bc87-23978f1aedf5] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:55:31.944833 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-25ee3cd8-92b2-4d99-aeac-0db3c2c123b3 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:31.947400 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5dff1153-e6ac-44db-af87-7e4c9eae957d tempest-UnshelveToHostMultiNodesTest-675009540 tempest-UnshelveToHostMultiNodesTest-675009540-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:31.947755 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-25ee3cd8-92b2-4d99-aeac-0db3c2c123b3 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] [instance: 99d20873-ce34-47a4-bbe6-5b42e406a360] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:55:31.948532 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5dff1153-e6ac-44db-af87-7e4c9eae957d tempest-UnshelveToHostMultiNodesTest-675009540 tempest-UnshelveToHostMultiNodesTest-675009540-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:31.949282 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5dff1153-e6ac-44db-af87-7e4c9eae957d tempest-UnshelveToHostMultiNodesTest-675009540 tempest-UnshelveToHostMultiNodesTest-675009540-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:31.950230 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5dff1153-e6ac-44db-af87-7e4c9eae957d tempest-UnshelveToHostMultiNodesTest-675009540 tempest-UnshelveToHostMultiNodesTest-675009540-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:31.951250 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5dff1153-e6ac-44db-af87-7e4c9eae957d tempest-UnshelveToHostMultiNodesTest-675009540 tempest-UnshelveToHostMultiNodesTest-675009540-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:31.951906 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5dff1153-e6ac-44db-af87-7e4c9eae957d tempest-UnshelveToHostMultiNodesTest-675009540 tempest-UnshelveToHostMultiNodesTest-675009540-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:31.963871 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-25ee3cd8-92b2-4d99-aeac-0db3c2c123b3 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:31.964388 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-25ee3cd8-92b2-4d99-aeac-0db3c2c123b3 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:31.964845 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-25ee3cd8-92b2-4d99-aeac-0db3c2c123b3 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:31.966798 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-25ee3cd8-92b2-4d99-aeac-0db3c2c123b3 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:31.967795 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-25ee3cd8-92b2-4d99-aeac-0db3c2c123b3 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:31.968541 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-25ee3cd8-92b2-4d99-aeac-0db3c2c123b3 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:31.999286 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-25ee3cd8-92b2-4d99-aeac-0db3c2c123b3 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] HTTP exception thrown: Instance 99d20873-ce34-47a4-bbe6-5b42e406a360 could not be found. Oct 08 20:55:32.001158 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-25ee3cd8-92b2-4d99-aeac-0db3c2c123b3 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Request method failure captured: Oct 08 20:55:32.001158 ncdv-master-1 devstack@n-api.service[140492]: request: DELETE /compute/v2.1/servers/99d20873-ce34-47a4-bbe6-5b42e406a360 HTTP/1.1 Oct 08 20:55:32.001158 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 20:55:32.001158 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 20:55:32.001158 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 20:55:32.001158 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 20:55:32.001158 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 20:55:32.001158 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 20:55:32.001158 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 20:55:32.001158 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 20:55:32.001158 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeMXkQ9S732V3cpLCisxVJQe-q2toVhIajNzC-zq33tauXDirGNTesY0Wf-LRNH444EBjhzYQ7kl4MmsCFiS_cCEelCALMv3KhbtqPjh5uz7XrsvX-cAmAqlvWahlaNJdqn0xoKpA6vR8HUTGcOyatsNfTsoVbF5ByL0RZGe4ZLvS_4 Oct 08 20:55:32.001158 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 20:55:32.001158 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 20:55:32.001158 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 20:55:32.001158 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 20:55:32.001158 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 20:55:32.001158 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 20:55:32.001158 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 3f2441394d754f499e27f6f35d5b3afa Oct 08 20:55:32.001158 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1665027500 Oct 08 20:55:32.001158 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 20:55:32.001158 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 20:55:32.001158 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3f2441394d754f499e27f6f35d5b3afa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3f2441394d754f499e27f6f35d5b3afa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3f2441394d754f499e27f6f35d5b3afa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3f2441394d754f499e27f6f35d5b3afa"}]}] Oct 08 20:55:32.001158 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1665027500 Oct 08 20:55:32.001158 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 3f2441394d754f499e27f6f35d5b3afa Oct 08 20:55:32.001158 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1665027500 Oct 08 20:55:32.001158 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1665027500-project Oct 08 20:55:32.001158 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 20:55:32.001158 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 20:55:32.001158 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 98936da9b5d94165b386d2d0893ac142 Oct 08 20:55:32.001158 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1665027500-project Oct 08 20:55:32.001158 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 20:55:32.001158 ncdv-master-1 devstack@n-api.service[140492]: exception: Instance 99d20873-ce34-47a4-bbe6-5b42e406a360 could not be found. Oct 08 20:55:32.001158 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': '99d20873-ce34-47a4-bbe6-5b42e406a360'} Oct 08 20:55:32.001158 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:55:32.001158 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:55:32.001158 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 20:55:32.001158 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 20:55:32.001158 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 20:55:32.001158 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 20:55:32.001158 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 20:55:32.001158 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 20:55:32.001158 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 20:55:32.001158 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 20:55:32.001158 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99d20873-ce34-47a4-bbe6-5b42e406a360 could not be found. Oct 08 20:55:32.001158 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:55:32.001158 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:55:32.001158 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:55:32.001158 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:55:32.001158 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:55:32.001158 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:55:32.001158 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:55:32.001158 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:55:32.001158 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:55:32.001158 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:55:32.001158 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 08 20:55:32.001158 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 08 20:55:32.001158 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 08 20:55:32.001158 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 08 20:55:32.001158 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 20:55:32.001158 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 20:55:32.001158 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 20:55:32.001158 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 20:55:32.006166 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99d20873-ce34-47a4-bbe6-5b42e406a360 could not be found. Oct 08 20:55:32.006166 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:55:32.006166 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:55:32.006166 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:55:32.006166 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:55:32.006166 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:55:32.006166 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:55:32.006166 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 20:55:32.006166 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 20:55:32.006166 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99d20873-ce34-47a4-bbe6-5b42e406a360 could not be found. Oct 08 20:55:32.006166 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:55:32.008550 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-25ee3cd8-92b2-4d99-aeac-0db3c2c123b3 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Returning 404 to user: Instance 99d20873-ce34-47a4-bbe6-5b42e406a360 could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:55:32.009618 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-25ee3cd8-92b2-4d99-aeac-0db3c2c123b3 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] 10.222.0.26 "DELETE /compute/v2.1/servers/99d20873-ce34-47a4-bbe6-5b42e406a360" status: 404 len: 111 microversion: 2.1 time: 0.070264 Oct 08 20:55:32.010362 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 546/1055] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 20:55:31 2022] DELETE /compute/v2.1/servers/99d20873-ce34-47a4-bbe6-5b42e406a360 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 20:55:32.015620 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-11f87dd2-5efa-4570-821d-4dbb9495acd5 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:32.016438 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-11f87dd2-5efa-4570-821d-4dbb9495acd5 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] [instance: 57016fcf-2d2c-488c-9af6-0530ebc199f6] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:55:32.058613 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.objects.instance [None req-5dff1153-e6ac-44db-af87-7e4c9eae957d tempest-UnshelveToHostMultiNodesTest-675009540 tempest-UnshelveToHostMultiNodesTest-675009540-project-admin] Lazy-loading 'services' on Instance uuid 92e31b92-0af1-4da6-bc87-23978f1aedf5 {{(pid=140491) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 20:55:32.064938 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=100 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:55:32.085753 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-5dff1153-e6ac-44db-af87-7e4c9eae957d tempest-UnshelveToHostMultiNodesTest-675009540 tempest-UnshelveToHostMultiNodesTest-675009540-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5" status: 200 len: 1938 microversion: 2.91 time: 0.167390 Oct 08 20:55:32.087491 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 510/1056] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:55:31 2022] GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5 => generated 1938 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:55:32.094391 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-37792961-2730-4805-bd14-944ab0fa2b69 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:32.095580 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-37792961-2730-4805-bd14-944ab0fa2b69 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] [instance: 24300a5e-164c-4d97-9a1f-b52359c1c0d6] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:55:32.103596 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-37792961-2730-4805-bd14-944ab0fa2b69 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:32.104548 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-37792961-2730-4805-bd14-944ab0fa2b69 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:32.105294 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-37792961-2730-4805-bd14-944ab0fa2b69 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:32.106949 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-37792961-2730-4805-bd14-944ab0fa2b69 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:32.108034 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-37792961-2730-4805-bd14-944ab0fa2b69 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:32.109740 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-37792961-2730-4805-bd14-944ab0fa2b69 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:32.120582 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-11f87dd2-5efa-4570-821d-4dbb9495acd5 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:32.139777 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-11f87dd2-5efa-4570-821d-4dbb9495acd5 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:32.141421 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-11f87dd2-5efa-4570-821d-4dbb9495acd5 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:32.147195 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-11f87dd2-5efa-4570-821d-4dbb9495acd5 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] 10.222.0.26 "GET /compute/v2.1/servers/57016fcf-2d2c-488c-9af6-0530ebc199f6" status: 200 len: 1286 microversion: 2.25 time: 0.135524 Oct 08 20:55:32.148525 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 547/1057] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:55:32 2022] GET /compute/v2.1/servers/57016fcf-2d2c-488c-9af6-0530ebc199f6 => generated 1286 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:55:32.159094 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-78ae3763-65f0-4a3d-8a47-9ebc8d29cbe9 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:32.161968 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-78ae3763-65f0-4a3d-8a47-9ebc8d29cbe9 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] [instance: 99d20873-ce34-47a4-bbe6-5b42e406a360] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:55:32.177690 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-78ae3763-65f0-4a3d-8a47-9ebc8d29cbe9 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:32.178258 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-78ae3763-65f0-4a3d-8a47-9ebc8d29cbe9 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:32.179844 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-78ae3763-65f0-4a3d-8a47-9ebc8d29cbe9 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:32.182047 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-78ae3763-65f0-4a3d-8a47-9ebc8d29cbe9 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:32.182536 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-78ae3763-65f0-4a3d-8a47-9ebc8d29cbe9 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:32.182977 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-78ae3763-65f0-4a3d-8a47-9ebc8d29cbe9 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:32.215413 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-78ae3763-65f0-4a3d-8a47-9ebc8d29cbe9 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] HTTP exception thrown: Instance 99d20873-ce34-47a4-bbe6-5b42e406a360 could not be found. Oct 08 20:55:32.217463 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-78ae3763-65f0-4a3d-8a47-9ebc8d29cbe9 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Request method failure captured: Oct 08 20:55:32.217463 ncdv-master-1 devstack@n-api.service[140492]: request: GET /compute/v2.1/servers/99d20873-ce34-47a4-bbe6-5b42e406a360 HTTP/1.1 Oct 08 20:55:32.217463 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 20:55:32.217463 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 20:55:32.217463 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 20:55:32.217463 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 20:55:32.217463 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 20:55:32.217463 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 20:55:32.217463 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 20:55:32.217463 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 20:55:32.217463 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeMXkQ9S732V3cpLCisxVJQe-q2toVhIajNzC-zq33tauXDirGNTesY0Wf-LRNH444EBjhzYQ7kl4MmsCFiS_cCEelCALMv3KhbtqPjh5uz7XrsvX-cAmAqlvWahlaNJdqn0xoKpA6vR8HUTGcOyatsNfTsoVbF5ByL0RZGe4ZLvS_4 Oct 08 20:55:32.217463 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 20:55:32.217463 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 20:55:32.217463 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 20:55:32.217463 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 20:55:32.217463 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 20:55:32.217463 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 20:55:32.217463 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 3f2441394d754f499e27f6f35d5b3afa Oct 08 20:55:32.217463 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1665027500 Oct 08 20:55:32.217463 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 20:55:32.217463 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 20:55:32.217463 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3f2441394d754f499e27f6f35d5b3afa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3f2441394d754f499e27f6f35d5b3afa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3f2441394d754f499e27f6f35d5b3afa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3f2441394d754f499e27f6f35d5b3afa"}]}] Oct 08 20:55:32.217463 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1665027500 Oct 08 20:55:32.217463 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 3f2441394d754f499e27f6f35d5b3afa Oct 08 20:55:32.217463 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1665027500 Oct 08 20:55:32.217463 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1665027500-project Oct 08 20:55:32.217463 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 20:55:32.217463 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 20:55:32.217463 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 98936da9b5d94165b386d2d0893ac142 Oct 08 20:55:32.217463 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1665027500-project Oct 08 20:55:32.217463 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 20:55:32.217463 ncdv-master-1 devstack@n-api.service[140492]: exception: Instance 99d20873-ce34-47a4-bbe6-5b42e406a360 could not be found. Oct 08 20:55:32.217463 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': '99d20873-ce34-47a4-bbe6-5b42e406a360'} Oct 08 20:55:32.217463 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:55:32.217463 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:55:32.217463 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 20:55:32.217463 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 20:55:32.217463 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 20:55:32.217463 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 20:55:32.217463 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 20:55:32.217463 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 20:55:32.217463 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 20:55:32.217463 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 20:55:32.217463 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99d20873-ce34-47a4-bbe6-5b42e406a360 could not be found. Oct 08 20:55:32.217463 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:55:32.217463 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:55:32.217463 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:55:32.217463 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:55:32.217463 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:55:32.217463 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:55:32.217463 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:55:32.217463 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:55:32.217463 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:55:32.217463 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:55:32.217463 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 20:55:32.217463 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 20:55:32.217463 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 20:55:32.217463 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 20:55:32.217463 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 20:55:32.217463 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 20:55:32.217463 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99d20873-ce34-47a4-bbe6-5b42e406a360 could not be found. Oct 08 20:55:32.217463 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:55:32.233078 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:55:32.233078 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:55:32.233078 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:55:32.233078 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:55:32.233078 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:55:32.233078 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 20:55:32.233078 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 20:55:32.233078 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99d20873-ce34-47a4-bbe6-5b42e406a360 could not be found. Oct 08 20:55:32.233078 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:55:32.237548 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-78ae3763-65f0-4a3d-8a47-9ebc8d29cbe9 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Returning 404 to user: Instance 99d20873-ce34-47a4-bbe6-5b42e406a360 could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:55:32.240088 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-78ae3763-65f0-4a3d-8a47-9ebc8d29cbe9 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] 10.222.0.26 "GET /compute/v2.1/servers/99d20873-ce34-47a4-bbe6-5b42e406a360" status: 404 len: 111 microversion: 2.1 time: 0.090342 Oct 08 20:55:32.241140 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 548/1058] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:55:32 2022] GET /compute/v2.1/servers/99d20873-ce34-47a4-bbe6-5b42e406a360 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 20:55:32.246044 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-06ef1b29-7bef-45c4-87a7-faf10c65ce44 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:55:32.246767 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-06ef1b29-7bef-45c4-87a7-faf10c65ce44 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] [instance: 92e31b92-0af1-4da6-bc87-23978f1aedf5] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:55:32.255082 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-06ef1b29-7bef-45c4-87a7-faf10c65ce44 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:32.255896 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-06ef1b29-7bef-45c4-87a7-faf10c65ce44 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:32.256512 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-06ef1b29-7bef-45c4-87a7-faf10c65ce44 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:32.257436 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-06ef1b29-7bef-45c4-87a7-faf10c65ce44 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:32.258051 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-06ef1b29-7bef-45c4-87a7-faf10c65ce44 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:32.258636 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-06ef1b29-7bef-45c4-87a7-faf10c65ce44 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:32.313920 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-37792961-2730-4805-bd14-944ab0fa2b69 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bce55d7f67347aaaa4c2a687bdff183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb3706a1680419384f4fe9660e87732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:32.319802 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.objects.instance [None req-06ef1b29-7bef-45c4-87a7-faf10c65ce44 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lazy-loading 'flavor' on Instance uuid 92e31b92-0af1-4da6-bc87-23978f1aedf5 {{(pid=140492) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 20:55:32.333255 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-37792961-2730-4805-bd14-944ab0fa2b69 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] 10.222.0.26 "GET /compute/v2.1/servers/24300a5e-164c-4d97-9a1f-b52359c1c0d6" status: 200 len: 1466 microversion: 2.1 time: 0.243566 Oct 08 20:55:32.335251 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 511/1059] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:55:32 2022] GET /compute/v2.1/servers/24300a5e-164c-4d97-9a1f-b52359c1c0d6 => generated 1466 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:55:32.344546 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-82dc3d07-a78f-4ec0-84a9-ff26c5f5172d tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Calling method '.version_select at 0x7f1a8cc458b0>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:32.374088 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-82dc3d07-a78f-4ec0-84a9-ff26c5f5172d tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-220477781" status: 202 len: 0 microversion: 2.1 time: 0.036902 Oct 08 20:55:32.375178 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 512/1060] 10.222.0.26 () {58 vars in 1218 bytes} [Sat Oct 8 20:55:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-220477781 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 20:55:32.400016 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-7518b363-fc47-4261-8b37-2e4de5172310 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1129687147"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:55:32.403361 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-7518b363-fc47-4261-8b37-2e4de5172310 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] [instance: 0cbc3ac5-5690-4f4e-a9d1-ea0de18060b1] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:55:32.412403 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7518b363-fc47-4261-8b37-2e4de5172310 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:32.414125 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7518b363-fc47-4261-8b37-2e4de5172310 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:32.414781 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7518b363-fc47-4261-8b37-2e4de5172310 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:32.415889 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7518b363-fc47-4261-8b37-2e4de5172310 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:32.416549 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7518b363-fc47-4261-8b37-2e4de5172310 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:32.417175 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7518b363-fc47-4261-8b37-2e4de5172310 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:32.714126 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-06ef1b29-7bef-45c4-87a7-faf10c65ce44 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] 10.222.0.26 "POST /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5/action" status: 202 len: 0 microversion: 2.91 time: 0.471523 Oct 08 20:55:32.714807 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 549/1061] 10.222.0.26 () {62 vars in 1319 bytes} [Sat Oct 8 20:55:32 2022] POST /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5/action => generated 0 bytes in 473 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 08 20:55:32.725911 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-1941e24e-abaf-45f9-8a38-a171ba3885d5 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:32.726633 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-1941e24e-abaf-45f9-8a38-a171ba3885d5 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] [instance: 92e31b92-0af1-4da6-bc87-23978f1aedf5] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:55:32.764080 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1941e24e-abaf-45f9-8a38-a171ba3885d5 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:32.764599 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1941e24e-abaf-45f9-8a38-a171ba3885d5 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:32.765051 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1941e24e-abaf-45f9-8a38-a171ba3885d5 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:32.773770 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1941e24e-abaf-45f9-8a38-a171ba3885d5 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:32.775088 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1941e24e-abaf-45f9-8a38-a171ba3885d5 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:32.775559 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1941e24e-abaf-45f9-8a38-a171ba3885d5 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:32.826485 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-7518b363-fc47-4261-8b37-2e4de5172310 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] 10.222.0.26 "POST /compute/v2.1/servers/0cbc3ac5-5690-4f4e-a9d1-ea0de18060b1/action" status: 202 len: 0 microversion: 2.1 time: 0.447750 Oct 08 20:55:32.828122 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 513/1062] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 20:55:32 2022] POST /compute/v2.1/servers/0cbc3ac5-5690-4f4e-a9d1-ea0de18060b1/action => generated 0 bytes in 452 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 08 20:55:32.844085 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-9a734eea-c1c5-4d30-8226-2dcdd10be8fc tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Calling method '.version_select at 0x7f1a8ca13dc0>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:32.916343 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-9a734eea-c1c5-4d30-8226-2dcdd10be8fc tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] 10.222.0.26 "GET /compute/v2.1/images/c9c4114b-60e7-4da5-980a-ac303ed9462a" status: 200 len: 1455 microversion: 2.1 time: 0.081444 Oct 08 20:55:32.917544 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 514/1063] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:55:32 2022] GET /compute/v2.1/images/c9c4114b-60e7-4da5-980a-ac303ed9462a => generated 1455 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:55:32.923676 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-712d6fd7-f3b0-437f-a2f3-217bafe5f980 req-05b0e144-2916-47ae-820c-86e13e695281 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e338d559-3f7c-4cc8-95c6-face79e11ca2", "tag": "c9d2434a-d900-4b35-afb9-1bca1da86155"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:55:32.939990 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-712d6fd7-f3b0-437f-a2f3-217bafe5f980 req-05b0e144-2916-47ae-820c-86e13e695281 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:32.941295 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-712d6fd7-f3b0-437f-a2f3-217bafe5f980 req-05b0e144-2916-47ae-820c-86e13e695281 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:32.941916 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-712d6fd7-f3b0-437f-a2f3-217bafe5f980 req-05b0e144-2916-47ae-820c-86e13e695281 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:32.974248 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-712d6fd7-f3b0-437f-a2f3-217bafe5f980 req-05b0e144-2916-47ae-820c-86e13e695281 service nova] Creating event network-changed:c9d2434a-d900-4b35-afb9-1bca1da86155 for instance e338d559-3f7c-4cc8-95c6-face79e11ca2 on nch2-master-1 Oct 08 20:55:32.987980 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-712d6fd7-f3b0-437f-a2f3-217bafe5f980 req-05b0e144-2916-47ae-820c-86e13e695281 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065960 Oct 08 20:55:32.990061 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 515/1064] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:55:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:55:33.005961 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-f8b6c3b1-ebcc-42a6-ae07-4460e74cec92 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:33.007064 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-f8b6c3b1-ebcc-42a6-ae07-4460e74cec92 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] [instance: 5c864780-3998-4a09-95d4-e000a02af71e] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:55:33.015268 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f8b6c3b1-ebcc-42a6-ae07-4460e74cec92 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:33.016406 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f8b6c3b1-ebcc-42a6-ae07-4460e74cec92 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:33.017012 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f8b6c3b1-ebcc-42a6-ae07-4460e74cec92 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:33.018749 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-1941e24e-abaf-45f9-8a38-a171ba3885d5 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:33.019513 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f8b6c3b1-ebcc-42a6-ae07-4460e74cec92 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:33.020145 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f8b6c3b1-ebcc-42a6-ae07-4460e74cec92 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:33.020886 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f8b6c3b1-ebcc-42a6-ae07-4460e74cec92 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:33.040326 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-1941e24e-abaf-45f9-8a38-a171ba3885d5 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:33.051303 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-1941e24e-abaf-45f9-8a38-a171ba3885d5 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:33.068733 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-1941e24e-abaf-45f9-8a38-a171ba3885d5 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] 10.222.0.26 "GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5" status: 200 len: 1539 microversion: 2.91 time: 0.348968 Oct 08 20:55:33.069809 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 550/1065] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:55:32 2022] GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5 => generated 1539 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:55:33.076044 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-fcbd232f-317c-4ce8-98af-b280142fbea5 tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:33.076831 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-fcbd232f-317c-4ce8-98af-b280142fbea5 tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] [instance: 8b29aacb-435d-4c6c-bbe7-3d5c6e1c622e] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:55:33.083572 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fcbd232f-317c-4ce8-98af-b280142fbea5 tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:33.084512 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fcbd232f-317c-4ce8-98af-b280142fbea5 tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:33.085126 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fcbd232f-317c-4ce8-98af-b280142fbea5 tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:33.086035 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fcbd232f-317c-4ce8-98af-b280142fbea5 tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:33.086650 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fcbd232f-317c-4ce8-98af-b280142fbea5 tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:33.087234 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fcbd232f-317c-4ce8-98af-b280142fbea5 tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:33.369660 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-fcbd232f-317c-4ce8-98af-b280142fbea5 tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6cf9c6c133947f3aecee3a913a32328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e277ebf9cbf4cb0b6be14efbec504bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:33.379241 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-fcbd232f-317c-4ce8-98af-b280142fbea5 tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] 10.222.0.26 "GET /compute/v2.1/servers/8b29aacb-435d-4c6c-bbe7-3d5c6e1c622e" status: 200 len: 1395 microversion: 2.1 time: 0.307515 Oct 08 20:55:33.400409 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 551/1066] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:55:33 2022] GET /compute/v2.1/servers/8b29aacb-435d-4c6c-bbe7-3d5c6e1c622e => generated 1395 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:55:33.413286 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-075ff506-e0f0-4776-afe7-853047ca4562 req-4dd05805-3e64-4498-9230-065049850ffb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b29aacb-435d-4c6c-bbe7-3d5c6e1c622e", "tag": "d89da5d3-0c81-4f3c-902a-ac5dee64ec3a"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:55:33.422891 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-f8b6c3b1-ebcc-42a6-ae07-4460e74cec92 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef659f5a1a24c439528a7675bdd70f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c92fe04ab8248399d0acb932f82d607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:33.434007 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-f8b6c3b1-ebcc-42a6-ae07-4460e74cec92 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] 10.222.0.26 "GET /compute/v2.1/servers/5c864780-3998-4a09-95d4-e000a02af71e" status: 200 len: 1469 microversion: 2.1 time: 0.440018 Oct 08 20:55:33.437515 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 516/1067] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:55:32 2022] GET /compute/v2.1/servers/5c864780-3998-4a09-95d4-e000a02af71e => generated 1469 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:55:33.440857 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-075ff506-e0f0-4776-afe7-853047ca4562 req-4dd05805-3e64-4498-9230-065049850ffb service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:33.441394 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-075ff506-e0f0-4776-afe7-853047ca4562 req-4dd05805-3e64-4498-9230-065049850ffb service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:33.441840 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-075ff506-e0f0-4776-afe7-853047ca4562 req-4dd05805-3e64-4498-9230-065049850ffb service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:33.445949 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-10e4a3f8-f6cf-4f4c-bf75-b029a7ecb1f5 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:33.451267 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-10e4a3f8-f6cf-4f4c-bf75-b029a7ecb1f5 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] [instance: 57016fcf-2d2c-488c-9af6-0530ebc199f6] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:55:33.464080 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-10e4a3f8-f6cf-4f4c-bf75-b029a7ecb1f5 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:33.465784 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-10e4a3f8-f6cf-4f4c-bf75-b029a7ecb1f5 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:33.466460 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-10e4a3f8-f6cf-4f4c-bf75-b029a7ecb1f5 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:33.472276 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-075ff506-e0f0-4776-afe7-853047ca4562 req-4dd05805-3e64-4498-9230-065049850ffb service nova] Creating event network-changed:d89da5d3-0c81-4f3c-902a-ac5dee64ec3a for instance 8b29aacb-435d-4c6c-bbe7-3d5c6e1c622e on nch2-master-1 Oct 08 20:55:33.476542 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-10e4a3f8-f6cf-4f4c-bf75-b029a7ecb1f5 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:33.477044 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-10e4a3f8-f6cf-4f4c-bf75-b029a7ecb1f5 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:33.477530 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-10e4a3f8-f6cf-4f4c-bf75-b029a7ecb1f5 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:33.503265 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-075ff506-e0f0-4776-afe7-853047ca4562 req-4dd05805-3e64-4498-9230-065049850ffb service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099842 Oct 08 20:55:33.505396 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 552/1068] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:55:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:55:33.598900 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-10e4a3f8-f6cf-4f4c-bf75-b029a7ecb1f5 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:33.610458 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-10e4a3f8-f6cf-4f4c-bf75-b029a7ecb1f5 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:33.612201 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-10e4a3f8-f6cf-4f4c-bf75-b029a7ecb1f5 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:33.614273 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-10e4a3f8-f6cf-4f4c-bf75-b029a7ecb1f5 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] 10.222.0.26 "GET /compute/v2.1/servers/57016fcf-2d2c-488c-9af6-0530ebc199f6" status: 200 len: 1338 microversion: 2.25 time: 0.174889 Oct 08 20:55:33.615609 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 517/1069] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:55:33 2022] GET /compute/v2.1/servers/57016fcf-2d2c-488c-9af6-0530ebc199f6 => generated 1338 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:55:33.932999 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-210c6a14-aefa-42c1-8a52-81ed78bc2f13 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Calling method '.version_select at 0x7f1a8c8ea3a0>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:34.024360 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-210c6a14-aefa-42c1-8a52-81ed78bc2f13 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] 10.222.0.26 "GET /compute/v2.1/images/c9c4114b-60e7-4da5-980a-ac303ed9462a" status: 200 len: 1455 microversion: 2.1 time: 0.095410 Oct 08 20:55:34.033369 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 553/1070] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:55:33 2022] GET /compute/v2.1/images/c9c4114b-60e7-4da5-980a-ac303ed9462a => generated 1455 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:55:34.103201 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-32bdcb77-ec4d-4f04-b120-4abffb6d1379 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:34.107311 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-32bdcb77-ec4d-4f04-b120-4abffb6d1379 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] [instance: 92e31b92-0af1-4da6-bc87-23978f1aedf5] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:55:34.144333 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-32bdcb77-ec4d-4f04-b120-4abffb6d1379 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:34.149701 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-32bdcb77-ec4d-4f04-b120-4abffb6d1379 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:34.159314 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-32bdcb77-ec4d-4f04-b120-4abffb6d1379 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:34.168711 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-32bdcb77-ec4d-4f04-b120-4abffb6d1379 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:34.169858 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-32bdcb77-ec4d-4f04-b120-4abffb6d1379 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:34.170548 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-32bdcb77-ec4d-4f04-b120-4abffb6d1379 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:34.309904 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-32bdcb77-ec4d-4f04-b120-4abffb6d1379 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:34.324081 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-32bdcb77-ec4d-4f04-b120-4abffb6d1379 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:34.326602 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-32bdcb77-ec4d-4f04-b120-4abffb6d1379 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:34.340542 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-32bdcb77-ec4d-4f04-b120-4abffb6d1379 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] 10.222.0.26 "GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5" status: 200 len: 1539 microversion: 2.91 time: 0.242433 Oct 08 20:55:34.344278 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 518/1071] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:55:34 2022] GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5 => generated 1539 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:55:34.410851 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-259453b4-1943-4347-a1de-d7b0327702ec tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:34.411513 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-259453b4-1943-4347-a1de-d7b0327702ec tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] [instance: 8b29aacb-435d-4c6c-bbe7-3d5c6e1c622e] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:55:34.424732 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-259453b4-1943-4347-a1de-d7b0327702ec tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:34.427353 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-259453b4-1943-4347-a1de-d7b0327702ec tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:34.428237 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-259453b4-1943-4347-a1de-d7b0327702ec tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:34.429545 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-259453b4-1943-4347-a1de-d7b0327702ec tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:34.431238 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-259453b4-1943-4347-a1de-d7b0327702ec tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:34.431689 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-259453b4-1943-4347-a1de-d7b0327702ec tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:34.438844 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-e89aa91d-20df-4c13-8717-dccb085628ab tempest-ServersWithSpecificFlavorTestJSON-750818918 tempest-ServersWithSpecificFlavorTestJSON-750818918-project-admin] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:34.520236 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-e89aa91d-20df-4c13-8717-dccb085628ab tempest-ServersWithSpecificFlavorTestJSON-750818918 tempest-ServersWithSpecificFlavorTestJSON-750818918-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/172903658" status: 202 len: 0 microversion: 2.1 time: 0.086263 Oct 08 20:55:34.524305 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 519/1072] 10.222.0.26 () {58 vars in 1158 bytes} [Sat Oct 8 20:55:34 2022] DELETE /compute/v2.1/flavors/172903658 => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 20:55:34.534222 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-ec763a48-3a83-4670-bf05-d18ac88fd3de tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:34.551698 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-ec763a48-3a83-4670-bf05-d18ac88fd3de tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] [instance: 5c864780-3998-4a09-95d4-e000a02af71e] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:55:34.580751 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ec763a48-3a83-4670-bf05-d18ac88fd3de tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:34.581275 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ec763a48-3a83-4670-bf05-d18ac88fd3de tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:34.581719 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ec763a48-3a83-4670-bf05-d18ac88fd3de tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:34.582429 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ec763a48-3a83-4670-bf05-d18ac88fd3de tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:34.590048 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ec763a48-3a83-4670-bf05-d18ac88fd3de tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:34.590508 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ec763a48-3a83-4670-bf05-d18ac88fd3de tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:34.662024 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ec763a48-3a83-4670-bf05-d18ac88fd3de tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:34.662697 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ec763a48-3a83-4670-bf05-d18ac88fd3de tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:34.663289 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ec763a48-3a83-4670-bf05-d18ac88fd3de tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:34.663952 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.objects.instance [None req-ec763a48-3a83-4670-bf05-d18ac88fd3de tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lazy-loading 'fault' on Instance uuid 5c864780-3998-4a09-95d4-e000a02af71e {{(pid=140491) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 20:55:34.758119 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-ec763a48-3a83-4670-bf05-d18ac88fd3de tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef659f5a1a24c439528a7675bdd70f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c92fe04ab8248399d0acb932f82d607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:34.769254 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-ec763a48-3a83-4670-bf05-d18ac88fd3de tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] 10.222.0.26 "GET /compute/v2.1/servers/5c864780-3998-4a09-95d4-e000a02af71e" status: 200 len: 1303 microversion: 2.1 time: 0.243779 Oct 08 20:55:34.770066 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 520/1073] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:55:34 2022] GET /compute/v2.1/servers/5c864780-3998-4a09-95d4-e000a02af71e => generated 1303 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:55:34.784973 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-9621d178-7635-4269-8aaf-0f705819c6f1 tempest-ServersWithSpecificFlavorTestJSON-750818918 tempest-ServersWithSpecificFlavorTestJSON-750818918-project-admin] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:34.838729 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-9621d178-7635-4269-8aaf-0f705819c6f1 tempest-ServersWithSpecificFlavorTestJSON-750818918 tempest-ServersWithSpecificFlavorTestJSON-750818918-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 5405 microversion: 2.1 time: 0.063725 Oct 08 20:55:34.853379 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 521/1074] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Oct 8 20:55:34 2022] GET /compute/v2.1/flavors/detail => generated 5405 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:55:34.871814 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-11c852da-9654-4d3e-993a-09f356c081c0 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:34.873294 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-11c852da-9654-4d3e-993a-09f356c081c0 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] [instance: 57016fcf-2d2c-488c-9af6-0530ebc199f6] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:55:34.879659 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-11c852da-9654-4d3e-993a-09f356c081c0 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:34.880341 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-11c852da-9654-4d3e-993a-09f356c081c0 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:34.880895 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-11c852da-9654-4d3e-993a-09f356c081c0 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:34.881751 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-11c852da-9654-4d3e-993a-09f356c081c0 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:34.882342 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-11c852da-9654-4d3e-993a-09f356c081c0 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:34.882881 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-11c852da-9654-4d3e-993a-09f356c081c0 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:34.994203 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-11c852da-9654-4d3e-993a-09f356c081c0 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:34.997295 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-259453b4-1943-4347-a1de-d7b0327702ec tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6cf9c6c133947f3aecee3a913a32328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e277ebf9cbf4cb0b6be14efbec504bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:35.005987 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-259453b4-1943-4347-a1de-d7b0327702ec tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] 10.222.0.26 "GET /compute/v2.1/servers/8b29aacb-435d-4c6c-bbe7-3d5c6e1c622e" status: 200 len: 1576 microversion: 2.1 time: 0.600053 Oct 08 20:55:35.006819 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-11c852da-9654-4d3e-993a-09f356c081c0 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:35.008884 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-11c852da-9654-4d3e-993a-09f356c081c0 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:35.010635 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-11c852da-9654-4d3e-993a-09f356c081c0 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] 10.222.0.26 "GET /compute/v2.1/servers/57016fcf-2d2c-488c-9af6-0530ebc199f6" status: 200 len: 1344 microversion: 2.25 time: 0.156075 Oct 08 20:55:35.012105 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 522/1075] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:55:34 2022] GET /compute/v2.1/servers/57016fcf-2d2c-488c-9af6-0530ebc199f6 => generated 1344 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:55:35.018235 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c51f3faa-a73c-48c5-a0b5-224f3b2c7d77 tempest-ServersWithSpecificFlavorTestJSON-750818918 tempest-ServersWithSpecificFlavorTestJSON-750818918-project-admin] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:35.022716 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 554/1076] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:55:34 2022] GET /compute/v2.1/servers/8b29aacb-435d-4c6c-bbe7-3d5c6e1c622e => generated 1576 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:55:35.038586 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-c51f3faa-a73c-48c5-a0b5-224f3b2c7d77 tempest-ServersWithSpecificFlavorTestJSON-750818918 tempest-ServersWithSpecificFlavorTestJSON-750818918-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/1225441597" status: 202 len: 0 microversion: 2.1 time: 0.024897 Oct 08 20:55:35.039516 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 523/1077] 10.222.0.26 () {58 vars in 1161 bytes} [Sat Oct 8 20:55:35 2022] DELETE /compute/v2.1/flavors/1225441597 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 20:55:35.048511 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-d493626f-1419-4480-b766-d22c7458efbf tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Calling method '.version_select at 0x7f1a8c83a0d0>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:35.051655 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-7ddd31d4-7dd9-41bf-af8e-c66d280a3663 tempest-ServersWithSpecificFlavorTestJSON-750818918 tempest-ServersWithSpecificFlavorTestJSON-750818918-project-admin] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:35.078825 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-7ddd31d4-7dd9-41bf-af8e-c66d280a3663 tempest-ServersWithSpecificFlavorTestJSON-750818918 tempest-ServersWithSpecificFlavorTestJSON-750818918-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.031784 Oct 08 20:55:35.079562 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 524/1078] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Oct 8 20:55:35 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:55:35.087248 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-47c46769-efbb-4fd7-9427-cf3ac3e64633 tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:35.088137 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-47c46769-efbb-4fd7-9427-cf3ac3e64633 tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] [instance: 8b29aacb-435d-4c6c-bbe7-3d5c6e1c622e] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:55:35.110221 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-47c46769-efbb-4fd7-9427-cf3ac3e64633 tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:35.110820 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-d493626f-1419-4480-b766-d22c7458efbf tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] 10.222.0.26 "GET /compute/v2.1/images/c9c4114b-60e7-4da5-980a-ac303ed9462a" status: 200 len: 1455 microversion: 2.1 time: 0.066790 Oct 08 20:55:35.110921 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-47c46769-efbb-4fd7-9427-cf3ac3e64633 tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:35.111264 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-47c46769-efbb-4fd7-9427-cf3ac3e64633 tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:35.111641 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 555/1079] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:55:35 2022] GET /compute/v2.1/images/c9c4114b-60e7-4da5-980a-ac303ed9462a => generated 1455 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:55:35.116730 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-7bd63a29-fdc0-4f95-95ce-08ab1a2c33f2 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:35.118059 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-7bd63a29-fdc0-4f95-95ce-08ab1a2c33f2 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] [instance: 84eba001-0fa3-4fb7-b74e-0bb54c527ac7] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:55:35.119522 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-47c46769-efbb-4fd7-9427-cf3ac3e64633 tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:35.120107 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-47c46769-efbb-4fd7-9427-cf3ac3e64633 tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:35.121451 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-47c46769-efbb-4fd7-9427-cf3ac3e64633 tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:35.126078 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7bd63a29-fdc0-4f95-95ce-08ab1a2c33f2 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:35.126769 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7bd63a29-fdc0-4f95-95ce-08ab1a2c33f2 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:35.127557 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7bd63a29-fdc0-4f95-95ce-08ab1a2c33f2 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:35.128665 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7bd63a29-fdc0-4f95-95ce-08ab1a2c33f2 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:35.129455 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7bd63a29-fdc0-4f95-95ce-08ab1a2c33f2 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:35.130046 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7bd63a29-fdc0-4f95-95ce-08ab1a2c33f2 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:35.145890 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-7bd63a29-fdc0-4f95-95ce-08ab1a2c33f2 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] HTTP exception thrown: Instance 84eba001-0fa3-4fb7-b74e-0bb54c527ac7 could not be found. Oct 08 20:55:35.147793 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-7bd63a29-fdc0-4f95-95ce-08ab1a2c33f2 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Request method failure captured: Oct 08 20:55:35.147793 ncdv-master-1 devstack@n-api.service[140492]: request: DELETE /compute/v2.1/servers/84eba001-0fa3-4fb7-b74e-0bb54c527ac7 HTTP/1.1 Oct 08 20:55:35.147793 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 20:55:35.147793 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 20:55:35.147793 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 20:55:35.147793 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 20:55:35.147793 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 20:55:35.147793 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 20:55:35.147793 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 20:55:35.147793 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 20:55:35.147793 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeMXkQ9S732V3cpLCisxVJQe-q2toVhIajNzC-zq33tauXDirGNTesY0Wf-LRNH444EBjhzYQ7kl4MmsCFiS_cCEelCALMv3KhbtqPjh5uz7XrsvX-cAmAqlvWahlaNJdqn0xoKpA6vR8HUTGcOyatsNfTsoVbF5ByL0RZGe4ZLvS_4 Oct 08 20:55:35.147793 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 20:55:35.147793 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 20:55:35.147793 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 20:55:35.147793 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 20:55:35.147793 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 20:55:35.147793 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 20:55:35.147793 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 3f2441394d754f499e27f6f35d5b3afa Oct 08 20:55:35.147793 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1665027500 Oct 08 20:55:35.147793 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 20:55:35.147793 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 20:55:35.147793 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3f2441394d754f499e27f6f35d5b3afa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3f2441394d754f499e27f6f35d5b3afa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3f2441394d754f499e27f6f35d5b3afa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3f2441394d754f499e27f6f35d5b3afa"}]}] Oct 08 20:55:35.147793 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1665027500 Oct 08 20:55:35.147793 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 3f2441394d754f499e27f6f35d5b3afa Oct 08 20:55:35.147793 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1665027500 Oct 08 20:55:35.147793 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1665027500-project Oct 08 20:55:35.147793 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 20:55:35.147793 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 20:55:35.147793 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 98936da9b5d94165b386d2d0893ac142 Oct 08 20:55:35.147793 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1665027500-project Oct 08 20:55:35.147793 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 20:55:35.147793 ncdv-master-1 devstack@n-api.service[140492]: exception: Instance 84eba001-0fa3-4fb7-b74e-0bb54c527ac7 could not be found. Oct 08 20:55:35.147793 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': '84eba001-0fa3-4fb7-b74e-0bb54c527ac7'} Oct 08 20:55:35.147793 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:55:35.147793 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:55:35.147793 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 20:55:35.147793 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 20:55:35.147793 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 20:55:35.147793 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 20:55:35.147793 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 20:55:35.147793 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 20:55:35.147793 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 20:55:35.147793 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 20:55:35.147793 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84eba001-0fa3-4fb7-b74e-0bb54c527ac7 could not be found. Oct 08 20:55:35.147793 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:55:35.147793 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:55:35.147793 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:55:35.147793 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:55:35.147793 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:55:35.147793 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:55:35.147793 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:55:35.147793 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:55:35.147793 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:55:35.147793 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:55:35.147793 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 08 20:55:35.147793 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 08 20:55:35.147793 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 08 20:55:35.147793 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 08 20:55:35.147793 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 20:55:35.147793 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 20:55:35.147793 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 20:55:35.147793 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 20:55:35.152096 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84eba001-0fa3-4fb7-b74e-0bb54c527ac7 could not be found. Oct 08 20:55:35.152096 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:55:35.152096 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:55:35.152096 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:55:35.152096 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:55:35.152096 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:55:35.152096 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:55:35.152096 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 20:55:35.152096 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 20:55:35.152096 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84eba001-0fa3-4fb7-b74e-0bb54c527ac7 could not be found. Oct 08 20:55:35.152096 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:55:35.154735 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-7bd63a29-fdc0-4f95-95ce-08ab1a2c33f2 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Returning 404 to user: Instance 84eba001-0fa3-4fb7-b74e-0bb54c527ac7 could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:55:35.155890 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-7bd63a29-fdc0-4f95-95ce-08ab1a2c33f2 tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] 10.222.0.26 "DELETE /compute/v2.1/servers/84eba001-0fa3-4fb7-b74e-0bb54c527ac7" status: 404 len: 111 microversion: 2.1 time: 0.043214 Oct 08 20:55:35.156635 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 556/1080] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 20:55:35 2022] DELETE /compute/v2.1/servers/84eba001-0fa3-4fb7-b74e-0bb54c527ac7 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 20:55:35.166605 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-ad3d0496-35b5-4f80-a95e-3f6602168cfa tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:35.167243 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-ad3d0496-35b5-4f80-a95e-3f6602168cfa tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] [instance: 84eba001-0fa3-4fb7-b74e-0bb54c527ac7] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:55:35.175744 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ad3d0496-35b5-4f80-a95e-3f6602168cfa tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:35.175744 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ad3d0496-35b5-4f80-a95e-3f6602168cfa tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:35.175744 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ad3d0496-35b5-4f80-a95e-3f6602168cfa tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:35.176506 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ad3d0496-35b5-4f80-a95e-3f6602168cfa tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:35.176983 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ad3d0496-35b5-4f80-a95e-3f6602168cfa tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:35.177460 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ad3d0496-35b5-4f80-a95e-3f6602168cfa tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:35.193738 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-ad3d0496-35b5-4f80-a95e-3f6602168cfa tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] HTTP exception thrown: Instance 84eba001-0fa3-4fb7-b74e-0bb54c527ac7 could not be found. Oct 08 20:55:35.195295 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-ad3d0496-35b5-4f80-a95e-3f6602168cfa tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Request method failure captured: Oct 08 20:55:35.195295 ncdv-master-1 devstack@n-api.service[140492]: request: GET /compute/v2.1/servers/84eba001-0fa3-4fb7-b74e-0bb54c527ac7 HTTP/1.1 Oct 08 20:55:35.195295 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 20:55:35.195295 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 20:55:35.195295 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 20:55:35.195295 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 20:55:35.195295 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 20:55:35.195295 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 20:55:35.195295 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 20:55:35.195295 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 20:55:35.195295 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeMXkQ9S732V3cpLCisxVJQe-q2toVhIajNzC-zq33tauXDirGNTesY0Wf-LRNH444EBjhzYQ7kl4MmsCFiS_cCEelCALMv3KhbtqPjh5uz7XrsvX-cAmAqlvWahlaNJdqn0xoKpA6vR8HUTGcOyatsNfTsoVbF5ByL0RZGe4ZLvS_4 Oct 08 20:55:35.195295 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 20:55:35.195295 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 20:55:35.195295 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 20:55:35.195295 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 20:55:35.195295 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 20:55:35.195295 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 20:55:35.195295 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 3f2441394d754f499e27f6f35d5b3afa Oct 08 20:55:35.195295 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1665027500 Oct 08 20:55:35.195295 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 20:55:35.195295 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 20:55:35.195295 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3f2441394d754f499e27f6f35d5b3afa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3f2441394d754f499e27f6f35d5b3afa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3f2441394d754f499e27f6f35d5b3afa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3f2441394d754f499e27f6f35d5b3afa"}]}] Oct 08 20:55:35.195295 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1665027500 Oct 08 20:55:35.195295 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 3f2441394d754f499e27f6f35d5b3afa Oct 08 20:55:35.195295 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1665027500 Oct 08 20:55:35.195295 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1665027500-project Oct 08 20:55:35.195295 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 20:55:35.195295 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 20:55:35.195295 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 98936da9b5d94165b386d2d0893ac142 Oct 08 20:55:35.195295 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1665027500-project Oct 08 20:55:35.195295 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 20:55:35.195295 ncdv-master-1 devstack@n-api.service[140492]: exception: Instance 84eba001-0fa3-4fb7-b74e-0bb54c527ac7 could not be found. Oct 08 20:55:35.195295 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': '84eba001-0fa3-4fb7-b74e-0bb54c527ac7'} Oct 08 20:55:35.195295 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:55:35.195295 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:55:35.195295 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 20:55:35.195295 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 20:55:35.195295 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 20:55:35.195295 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 20:55:35.195295 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 20:55:35.195295 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 20:55:35.195295 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 20:55:35.195295 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 20:55:35.195295 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84eba001-0fa3-4fb7-b74e-0bb54c527ac7 could not be found. Oct 08 20:55:35.195295 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:55:35.195295 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:55:35.195295 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:55:35.195295 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:55:35.195295 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:55:35.195295 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:55:35.195295 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:55:35.195295 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:55:35.195295 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:55:35.195295 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:55:35.195295 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 20:55:35.195295 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 20:55:35.195295 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 20:55:35.195295 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 20:55:35.195295 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 20:55:35.195295 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 20:55:35.195295 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84eba001-0fa3-4fb7-b74e-0bb54c527ac7 could not be found. Oct 08 20:55:35.195295 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:55:35.199003 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:55:35.199003 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:55:35.199003 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:55:35.199003 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:55:35.199003 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:55:35.199003 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 20:55:35.199003 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 20:55:35.199003 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84eba001-0fa3-4fb7-b74e-0bb54c527ac7 could not be found. Oct 08 20:55:35.199003 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:55:35.199003 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-ad3d0496-35b5-4f80-a95e-3f6602168cfa tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Returning 404 to user: Instance 84eba001-0fa3-4fb7-b74e-0bb54c527ac7 could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:55:35.199003 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-ad3d0496-35b5-4f80-a95e-3f6602168cfa tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] 10.222.0.26 "GET /compute/v2.1/servers/84eba001-0fa3-4fb7-b74e-0bb54c527ac7" status: 404 len: 111 microversion: 2.1 time: 0.034955 Oct 08 20:55:35.201915 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 557/1081] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:55:35 2022] GET /compute/v2.1/servers/84eba001-0fa3-4fb7-b74e-0bb54c527ac7 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 20:55:35.207021 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-afff6c26-7212-42d8-bd4d-b7cfa4fd91db tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:35.207737 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-afff6c26-7212-42d8-bd4d-b7cfa4fd91db tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] [instance: 99d20873-ce34-47a4-bbe6-5b42e406a360] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:55:35.224205 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-afff6c26-7212-42d8-bd4d-b7cfa4fd91db tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:35.224723 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-afff6c26-7212-42d8-bd4d-b7cfa4fd91db tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:35.225226 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-afff6c26-7212-42d8-bd4d-b7cfa4fd91db tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:35.225937 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-afff6c26-7212-42d8-bd4d-b7cfa4fd91db tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:35.229245 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-afff6c26-7212-42d8-bd4d-b7cfa4fd91db tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:35.229708 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-afff6c26-7212-42d8-bd4d-b7cfa4fd91db tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:35.254115 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-afff6c26-7212-42d8-bd4d-b7cfa4fd91db tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] HTTP exception thrown: Instance 99d20873-ce34-47a4-bbe6-5b42e406a360 could not be found. Oct 08 20:55:35.255960 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-afff6c26-7212-42d8-bd4d-b7cfa4fd91db tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Request method failure captured: Oct 08 20:55:35.255960 ncdv-master-1 devstack@n-api.service[140492]: request: DELETE /compute/v2.1/servers/99d20873-ce34-47a4-bbe6-5b42e406a360 HTTP/1.1 Oct 08 20:55:35.255960 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 20:55:35.255960 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 20:55:35.255960 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 20:55:35.255960 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 20:55:35.255960 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 20:55:35.255960 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 20:55:35.255960 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 20:55:35.255960 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 20:55:35.255960 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeMXkQ9S732V3cpLCisxVJQe-q2toVhIajNzC-zq33tauXDirGNTesY0Wf-LRNH444EBjhzYQ7kl4MmsCFiS_cCEelCALMv3KhbtqPjh5uz7XrsvX-cAmAqlvWahlaNJdqn0xoKpA6vR8HUTGcOyatsNfTsoVbF5ByL0RZGe4ZLvS_4 Oct 08 20:55:35.255960 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 20:55:35.255960 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 20:55:35.255960 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 20:55:35.255960 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 20:55:35.255960 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 20:55:35.255960 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 20:55:35.255960 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 3f2441394d754f499e27f6f35d5b3afa Oct 08 20:55:35.255960 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1665027500 Oct 08 20:55:35.255960 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 20:55:35.255960 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 20:55:35.255960 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3f2441394d754f499e27f6f35d5b3afa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3f2441394d754f499e27f6f35d5b3afa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3f2441394d754f499e27f6f35d5b3afa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3f2441394d754f499e27f6f35d5b3afa"}]}] Oct 08 20:55:35.255960 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1665027500 Oct 08 20:55:35.255960 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 3f2441394d754f499e27f6f35d5b3afa Oct 08 20:55:35.255960 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1665027500 Oct 08 20:55:35.255960 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1665027500-project Oct 08 20:55:35.255960 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 20:55:35.255960 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 20:55:35.255960 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 98936da9b5d94165b386d2d0893ac142 Oct 08 20:55:35.255960 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1665027500-project Oct 08 20:55:35.255960 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 20:55:35.255960 ncdv-master-1 devstack@n-api.service[140492]: exception: Instance 99d20873-ce34-47a4-bbe6-5b42e406a360 could not be found. Oct 08 20:55:35.255960 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': '99d20873-ce34-47a4-bbe6-5b42e406a360'} Oct 08 20:55:35.255960 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:55:35.255960 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:55:35.255960 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 20:55:35.255960 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 20:55:35.255960 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 20:55:35.255960 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 20:55:35.255960 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 20:55:35.255960 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 20:55:35.255960 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 20:55:35.255960 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 20:55:35.255960 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99d20873-ce34-47a4-bbe6-5b42e406a360 could not be found. Oct 08 20:55:35.255960 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:55:35.255960 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:55:35.255960 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:55:35.255960 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:55:35.255960 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:55:35.255960 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:55:35.255960 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:55:35.255960 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:55:35.255960 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:55:35.255960 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:55:35.255960 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 08 20:55:35.255960 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 08 20:55:35.255960 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 08 20:55:35.255960 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 08 20:55:35.255960 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 20:55:35.255960 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 20:55:35.255960 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 20:55:35.255960 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 20:55:35.259798 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99d20873-ce34-47a4-bbe6-5b42e406a360 could not be found. Oct 08 20:55:35.259798 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:55:35.259798 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:55:35.259798 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:55:35.259798 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:55:35.259798 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:55:35.259798 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:55:35.259798 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 20:55:35.259798 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 20:55:35.259798 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99d20873-ce34-47a4-bbe6-5b42e406a360 could not be found. Oct 08 20:55:35.259798 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:55:35.261930 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-afff6c26-7212-42d8-bd4d-b7cfa4fd91db tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Returning 404 to user: Instance 99d20873-ce34-47a4-bbe6-5b42e406a360 could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:55:35.264630 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-afff6c26-7212-42d8-bd4d-b7cfa4fd91db tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] 10.222.0.26 "DELETE /compute/v2.1/servers/99d20873-ce34-47a4-bbe6-5b42e406a360" status: 404 len: 111 microversion: 2.1 time: 0.061465 Oct 08 20:55:35.272031 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-47c46769-efbb-4fd7-9427-cf3ac3e64633 tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] 10.222.0.26 "GET /compute/v2.1/servers/8b29aacb-435d-4c6c-bbe7-3d5c6e1c622e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.188516 Oct 08 20:55:35.277063 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 558/1082] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 20:55:35 2022] DELETE /compute/v2.1/servers/99d20873-ce34-47a4-bbe6-5b42e406a360 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 20:55:35.281531 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 525/1083] 10.222.0.26 () {58 vars in 1275 bytes} [Sat Oct 8 20:55:35 2022] GET /compute/v2.1/servers/8b29aacb-435d-4c6c-bbe7-3d5c6e1c622e/os-interface => generated 285 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:55:35.284479 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-14c4261e-021c-4e6d-9f9d-da9e9234a8df tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:35.285397 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-14c4261e-021c-4e6d-9f9d-da9e9234a8df tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] [instance: 99d20873-ce34-47a4-bbe6-5b42e406a360] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:55:35.298895 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-14c4261e-021c-4e6d-9f9d-da9e9234a8df tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:35.299778 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-14c4261e-021c-4e6d-9f9d-da9e9234a8df tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:35.300491 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-14c4261e-021c-4e6d-9f9d-da9e9234a8df tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:35.304130 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-14c4261e-021c-4e6d-9f9d-da9e9234a8df tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:35.304856 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-14c4261e-021c-4e6d-9f9d-da9e9234a8df tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:35.305581 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-14c4261e-021c-4e6d-9f9d-da9e9234a8df tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:35.342696 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-14c4261e-021c-4e6d-9f9d-da9e9234a8df tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] HTTP exception thrown: Instance 99d20873-ce34-47a4-bbe6-5b42e406a360 could not be found. Oct 08 20:55:35.345869 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-14c4261e-021c-4e6d-9f9d-da9e9234a8df tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Request method failure captured: Oct 08 20:55:35.345869 ncdv-master-1 devstack@n-api.service[140492]: request: GET /compute/v2.1/servers/99d20873-ce34-47a4-bbe6-5b42e406a360 HTTP/1.1 Oct 08 20:55:35.345869 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 20:55:35.345869 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 20:55:35.345869 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 20:55:35.345869 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 20:55:35.345869 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 20:55:35.345869 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 20:55:35.345869 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 20:55:35.345869 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 20:55:35.345869 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeMXkQ9S732V3cpLCisxVJQe-q2toVhIajNzC-zq33tauXDirGNTesY0Wf-LRNH444EBjhzYQ7kl4MmsCFiS_cCEelCALMv3KhbtqPjh5uz7XrsvX-cAmAqlvWahlaNJdqn0xoKpA6vR8HUTGcOyatsNfTsoVbF5ByL0RZGe4ZLvS_4 Oct 08 20:55:35.345869 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 20:55:35.345869 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 20:55:35.345869 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 20:55:35.345869 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 20:55:35.345869 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 20:55:35.345869 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 20:55:35.345869 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 3f2441394d754f499e27f6f35d5b3afa Oct 08 20:55:35.345869 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1665027500 Oct 08 20:55:35.345869 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 20:55:35.345869 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 20:55:35.345869 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3f2441394d754f499e27f6f35d5b3afa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3f2441394d754f499e27f6f35d5b3afa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3f2441394d754f499e27f6f35d5b3afa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3f2441394d754f499e27f6f35d5b3afa"}]}] Oct 08 20:55:35.345869 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1665027500 Oct 08 20:55:35.345869 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 3f2441394d754f499e27f6f35d5b3afa Oct 08 20:55:35.345869 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1665027500 Oct 08 20:55:35.345869 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1665027500-project Oct 08 20:55:35.345869 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 20:55:35.345869 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 20:55:35.345869 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 98936da9b5d94165b386d2d0893ac142 Oct 08 20:55:35.345869 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1665027500-project Oct 08 20:55:35.345869 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 20:55:35.345869 ncdv-master-1 devstack@n-api.service[140492]: exception: Instance 99d20873-ce34-47a4-bbe6-5b42e406a360 could not be found. Oct 08 20:55:35.345869 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': '99d20873-ce34-47a4-bbe6-5b42e406a360'} Oct 08 20:55:35.345869 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:55:35.345869 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:55:35.345869 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 20:55:35.345869 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 20:55:35.345869 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 20:55:35.345869 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 20:55:35.345869 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 20:55:35.345869 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 20:55:35.345869 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 20:55:35.345869 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 20:55:35.345869 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99d20873-ce34-47a4-bbe6-5b42e406a360 could not be found. Oct 08 20:55:35.345869 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:55:35.345869 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:55:35.345869 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:55:35.345869 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:55:35.345869 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:55:35.345869 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:55:35.345869 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:55:35.345869 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:55:35.345869 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:55:35.345869 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:55:35.345869 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 20:55:35.345869 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 20:55:35.345869 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 20:55:35.345869 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 20:55:35.345869 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 20:55:35.345869 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 20:55:35.345869 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99d20873-ce34-47a4-bbe6-5b42e406a360 could not be found. Oct 08 20:55:35.345869 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:55:35.350917 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:55:35.350917 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:55:35.350917 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:55:35.350917 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:55:35.350917 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:55:35.350917 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 20:55:35.350917 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 20:55:35.350917 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99d20873-ce34-47a4-bbe6-5b42e406a360 could not be found. Oct 08 20:55:35.350917 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:55:35.352755 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-14c4261e-021c-4e6d-9f9d-da9e9234a8df tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] Returning 404 to user: Instance 99d20873-ce34-47a4-bbe6-5b42e406a360 could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:55:35.353819 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-14c4261e-021c-4e6d-9f9d-da9e9234a8df tempest-ServersWithSpecificFlavorTestJSON-1665027500 tempest-ServersWithSpecificFlavorTestJSON-1665027500-project] 10.222.0.26 "GET /compute/v2.1/servers/99d20873-ce34-47a4-bbe6-5b42e406a360" status: 404 len: 111 microversion: 2.1 time: 0.075308 Oct 08 20:55:35.359062 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 559/1084] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:55:35 2022] GET /compute/v2.1/servers/99d20873-ce34-47a4-bbe6-5b42e406a360 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 20:55:35.372063 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-08911a47-bf45-4bf4-aa49-02abaf243ac6 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:35.373761 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-08911a47-bf45-4bf4-aa49-02abaf243ac6 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] [instance: 92e31b92-0af1-4da6-bc87-23978f1aedf5] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:55:35.385171 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-08911a47-bf45-4bf4-aa49-02abaf243ac6 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:35.386071 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-08911a47-bf45-4bf4-aa49-02abaf243ac6 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:35.386418 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-08911a47-bf45-4bf4-aa49-02abaf243ac6 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:35.387155 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-08911a47-bf45-4bf4-aa49-02abaf243ac6 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:35.387684 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-08911a47-bf45-4bf4-aa49-02abaf243ac6 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:35.393386 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-08911a47-bf45-4bf4-aa49-02abaf243ac6 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:35.720115 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-93a2fbee-9843-41e6-bf60-74e2e811b8eb req-92dcfd49-008f-48f0-9e3b-028c7711e2eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c864780-3998-4a09-95d4-e000a02af71e", "name": "network-vif-deleted", "tag": "74d30b45-d23b-46ee-9285-24066d68f449"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:55:35.731143 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-93a2fbee-9843-41e6-bf60-74e2e811b8eb req-92dcfd49-008f-48f0-9e3b-028c7711e2eb service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:35.732087 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-93a2fbee-9843-41e6-bf60-74e2e811b8eb req-92dcfd49-008f-48f0-9e3b-028c7711e2eb service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:35.732754 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-93a2fbee-9843-41e6-bf60-74e2e811b8eb req-92dcfd49-008f-48f0-9e3b-028c7711e2eb service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:35.745007 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-93a2fbee-9843-41e6-bf60-74e2e811b8eb req-92dcfd49-008f-48f0-9e3b-028c7711e2eb service nova] Creating event network-vif-deleted:74d30b45-d23b-46ee-9285-24066d68f449 for instance 5c864780-3998-4a09-95d4-e000a02af71e on nch2-master-1 Oct 08 20:55:35.750519 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-93a2fbee-9843-41e6-bf60-74e2e811b8eb req-92dcfd49-008f-48f0-9e3b-028c7711e2eb service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034668 Oct 08 20:55:35.751722 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 560/1085] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:55:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:55:35.795451 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-aadd823f-8e03-42f0-a8f6-ec88490cd91b tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:35.796569 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-aadd823f-8e03-42f0-a8f6-ec88490cd91b tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] [instance: 5c864780-3998-4a09-95d4-e000a02af71e] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:55:35.805052 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-aadd823f-8e03-42f0-a8f6-ec88490cd91b tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:35.806006 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-aadd823f-8e03-42f0-a8f6-ec88490cd91b tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:35.806671 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-aadd823f-8e03-42f0-a8f6-ec88490cd91b tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:35.807656 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-aadd823f-8e03-42f0-a8f6-ec88490cd91b tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:35.808493 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-aadd823f-8e03-42f0-a8f6-ec88490cd91b tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:35.809218 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-aadd823f-8e03-42f0-a8f6-ec88490cd91b tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:35.822285 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-08911a47-bf45-4bf4-aa49-02abaf243ac6 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:35.826120 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-aadd823f-8e03-42f0-a8f6-ec88490cd91b tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] HTTP exception thrown: Instance 5c864780-3998-4a09-95d4-e000a02af71e could not be found. Oct 08 20:55:35.828205 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-aadd823f-8e03-42f0-a8f6-ec88490cd91b tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Request method failure captured: Oct 08 20:55:35.828205 ncdv-master-1 devstack@n-api.service[140492]: request: GET /compute/v2.1/servers/5c864780-3998-4a09-95d4-e000a02af71e HTTP/1.1 Oct 08 20:55:35.828205 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 20:55:35.828205 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 20:55:35.828205 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 20:55:35.828205 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 20:55:35.828205 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 20:55:35.828205 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 20:55:35.828205 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 20:55:35.828205 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 20:55:35.828205 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeMkMNEyrQg7LwXap23MVpWLk08k2XXa9AhhNdDm_bF8My40HcX5l0HeSUCvRieavRf1weJ6dMtuMQLwqaU4APNmYN6MQxJxQHNM0803_f0HSjFTMyWD2vVxd_RSK9X61rs2mpvuyoMUTeom0NYxzJF3WrYO7bBQKfgnboDedNPTU3Q Oct 08 20:55:35.828205 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 20:55:35.828205 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 20:55:35.828205 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 20:55:35.828205 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 20:55:35.828205 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 20:55:35.828205 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 20:55:35.828205 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 8c92fe04ab8248399d0acb932f82d607 Oct 08 20:55:35.828205 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-ServersAdminTestJSON-78545731 Oct 08 20:55:35.828205 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 20:55:35.828205 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 20:55:35.828205 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8c92fe04ab8248399d0acb932f82d607"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8c92fe04ab8248399d0acb932f82d607"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8c92fe04ab8248399d0acb932f82d607"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8c92fe04ab8248399d0acb932f82d607"}]}] Oct 08 20:55:35.828205 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-ServersAdminTestJSON-78545731 Oct 08 20:55:35.828205 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 8c92fe04ab8248399d0acb932f82d607 Oct 08 20:55:35.828205 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-ServersAdminTestJSON-78545731 Oct 08 20:55:35.828205 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-ServersAdminTestJSON-78545731-project Oct 08 20:55:35.828205 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 20:55:35.828205 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 20:55:35.828205 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 5ef659f5a1a24c439528a7675bdd70f8 Oct 08 20:55:35.828205 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-ServersAdminTestJSON-78545731-project Oct 08 20:55:35.828205 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 20:55:35.828205 ncdv-master-1 devstack@n-api.service[140492]: exception: Instance 5c864780-3998-4a09-95d4-e000a02af71e could not be found. Oct 08 20:55:35.828205 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': '5c864780-3998-4a09-95d4-e000a02af71e'} Oct 08 20:55:35.828205 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:55:35.828205 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:55:35.828205 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 20:55:35.828205 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 20:55:35.828205 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 20:55:35.828205 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 20:55:35.828205 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 20:55:35.828205 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 20:55:35.828205 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 20:55:35.828205 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 20:55:35.828205 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c864780-3998-4a09-95d4-e000a02af71e could not be found. Oct 08 20:55:35.828205 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:55:35.828205 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:55:35.828205 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:55:35.828205 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:55:35.828205 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:55:35.828205 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:55:35.828205 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:55:35.828205 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:55:35.828205 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:55:35.828205 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:55:35.828205 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 20:55:35.828205 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 20:55:35.828205 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 20:55:35.828205 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 20:55:35.828205 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 20:55:35.828205 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 20:55:35.828205 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c864780-3998-4a09-95d4-e000a02af71e could not be found. Oct 08 20:55:35.828205 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:55:35.828205 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:55:35.828205 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:55:35.832577 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:55:35.832577 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:55:35.832577 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:55:35.832577 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 20:55:35.832577 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 20:55:35.832577 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c864780-3998-4a09-95d4-e000a02af71e could not be found. Oct 08 20:55:35.832577 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:55:35.834685 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-aadd823f-8e03-42f0-a8f6-ec88490cd91b tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Returning 404 to user: Instance 5c864780-3998-4a09-95d4-e000a02af71e could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:55:35.835819 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-aadd823f-8e03-42f0-a8f6-ec88490cd91b tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] 10.222.0.26 "GET /compute/v2.1/servers/5c864780-3998-4a09-95d4-e000a02af71e" status: 404 len: 111 microversion: 2.1 time: 0.045238 Oct 08 20:55:35.839489 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-08911a47-bf45-4bf4-aa49-02abaf243ac6 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:35.839489 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-08911a47-bf45-4bf4-aa49-02abaf243ac6 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:35.840276 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 561/1086] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:55:35 2022] GET /compute/v2.1/servers/5c864780-3998-4a09-95d4-e000a02af71e => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 20:55:35.846108 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-f038a724-622a-4ca3-8155-63598c9b7898 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:35.846957 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-f038a724-622a-4ca3-8155-63598c9b7898 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] [instance: 73fd15ea-e4bd-4310-93bb-147b0a5e27ef] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:55:35.853749 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f038a724-622a-4ca3-8155-63598c9b7898 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:35.854713 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f038a724-622a-4ca3-8155-63598c9b7898 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:35.855400 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f038a724-622a-4ca3-8155-63598c9b7898 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:35.856380 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f038a724-622a-4ca3-8155-63598c9b7898 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:35.857751 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f038a724-622a-4ca3-8155-63598c9b7898 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:35.858632 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f038a724-622a-4ca3-8155-63598c9b7898 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:35.859125 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-08911a47-bf45-4bf4-aa49-02abaf243ac6 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] 10.222.0.26 "GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5" status: 200 len: 1539 microversion: 2.91 time: 0.490961 Oct 08 20:55:35.860054 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 526/1087] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:55:35 2022] GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5 => generated 1539 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:55:35.913121 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-f038a724-622a-4ca3-8155-63598c9b7898 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] [instance: 73fd15ea-e4bd-4310-93bb-147b0a5e27ef] Going to try to terminate instance {{(pid=140492) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 20:55:35.968488 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:55:36.038955 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-d8c04a04-b867-45b2-88a6-e173e22a6ebe tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:36.040336 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-d8c04a04-b867-45b2-88a6-e173e22a6ebe tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] [instance: 57016fcf-2d2c-488c-9af6-0530ebc199f6] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:55:36.042951 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-f038a724-622a-4ca3-8155-63598c9b7898 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] 10.222.0.26 "DELETE /compute/v2.1/servers/73fd15ea-e4bd-4310-93bb-147b0a5e27ef" status: 204 len: 0 microversion: 2.1 time: 0.201027 Oct 08 20:55:36.043653 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 562/1088] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 20:55:35 2022] DELETE /compute/v2.1/servers/73fd15ea-e4bd-4310-93bb-147b0a5e27ef => generated 0 bytes in 203 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 20:55:36.054239 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-1b8fea78-4549-407f-b7d8-125c9e1763f2 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:36.054884 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d8c04a04-b867-45b2-88a6-e173e22a6ebe tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:36.054884 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d8c04a04-b867-45b2-88a6-e173e22a6ebe tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:36.055226 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d8c04a04-b867-45b2-88a6-e173e22a6ebe tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:36.055712 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-1b8fea78-4549-407f-b7d8-125c9e1763f2 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] [instance: 73fd15ea-e4bd-4310-93bb-147b0a5e27ef] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:55:36.056017 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d8c04a04-b867-45b2-88a6-e173e22a6ebe tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:36.056534 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d8c04a04-b867-45b2-88a6-e173e22a6ebe tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:36.057133 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d8c04a04-b867-45b2-88a6-e173e22a6ebe tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:36.063547 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1b8fea78-4549-407f-b7d8-125c9e1763f2 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:36.064072 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1b8fea78-4549-407f-b7d8-125c9e1763f2 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:36.064526 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1b8fea78-4549-407f-b7d8-125c9e1763f2 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:36.065320 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1b8fea78-4549-407f-b7d8-125c9e1763f2 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:36.065805 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1b8fea78-4549-407f-b7d8-125c9e1763f2 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:36.066251 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1b8fea78-4549-407f-b7d8-125c9e1763f2 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:36.175638 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-d8c04a04-b867-45b2-88a6-e173e22a6ebe tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:36.189716 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-d8c04a04-b867-45b2-88a6-e173e22a6ebe tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:36.199683 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-d8c04a04-b867-45b2-88a6-e173e22a6ebe tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:36.201912 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-d8c04a04-b867-45b2-88a6-e173e22a6ebe tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] 10.222.0.26 "GET /compute/v2.1/servers/57016fcf-2d2c-488c-9af6-0530ebc199f6" status: 200 len: 1344 microversion: 2.25 time: 0.169082 Oct 08 20:55:36.202783 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 527/1089] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:55:36 2022] GET /compute/v2.1/servers/57016fcf-2d2c-488c-9af6-0530ebc199f6 => generated 1344 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:55:36.224017 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c1348c20-c022-4ffe-887c-da2365279146 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Calling method '.version_select at 0x7f1a8c97bf70>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:36.284275 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-c1348c20-c022-4ffe-887c-da2365279146 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] 10.222.0.26 "GET /compute/v2.1/images/c9c4114b-60e7-4da5-980a-ac303ed9462a" status: 200 len: 1455 microversion: 2.1 time: 0.072066 Oct 08 20:55:36.285550 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 528/1090] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:55:36 2022] GET /compute/v2.1/images/c9c4114b-60e7-4da5-980a-ac303ed9462a => generated 1455 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:55:36.360068 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-1b8fea78-4549-407f-b7d8-125c9e1763f2 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef659f5a1a24c439528a7675bdd70f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c92fe04ab8248399d0acb932f82d607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:36.370085 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-1b8fea78-4549-407f-b7d8-125c9e1763f2 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] 10.222.0.26 "GET /compute/v2.1/servers/73fd15ea-e4bd-4310-93bb-147b0a5e27ef" status: 200 len: 1468 microversion: 2.1 time: 0.320221 Oct 08 20:55:36.371229 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 563/1091] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:55:36 2022] GET /compute/v2.1/servers/73fd15ea-e4bd-4310-93bb-147b0a5e27ef => generated 1468 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 20:55:36.561441 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-3e8ad9eb-df01-43e4-9853-8da1db5c5373 req-a83a9e1e-b74f-4044-b5e2-a08aa1194356 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24300a5e-164c-4d97-9a1f-b52359c1c0d6", "name": "network-vif-unplugged", "status": "completed", "tag": "2fe7c081-3e45-4535-9c6e-1d2e86219410"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:55:36.586704 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-3e8ad9eb-df01-43e4-9853-8da1db5c5373 req-a83a9e1e-b74f-4044-b5e2-a08aa1194356 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:36.587420 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-3e8ad9eb-df01-43e4-9853-8da1db5c5373 req-a83a9e1e-b74f-4044-b5e2-a08aa1194356 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:36.588062 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-3e8ad9eb-df01-43e4-9853-8da1db5c5373 req-a83a9e1e-b74f-4044-b5e2-a08aa1194356 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:36.608940 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-3e8ad9eb-df01-43e4-9853-8da1db5c5373 req-a83a9e1e-b74f-4044-b5e2-a08aa1194356 service nova] Creating event network-vif-unplugged:2fe7c081-3e45-4535-9c6e-1d2e86219410 for instance 24300a5e-164c-4d97-9a1f-b52359c1c0d6 on nch1-master-1 Oct 08 20:55:36.617826 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-3e8ad9eb-df01-43e4-9853-8da1db5c5373 req-a83a9e1e-b74f-4044-b5e2-a08aa1194356 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.061297 Oct 08 20:55:36.619325 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 529/1092] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:55:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 08 20:55:36.891664 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-171a50a7-c475-45a8-bb43-0486f880468d tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:36.892471 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-171a50a7-c475-45a8-bb43-0486f880468d tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] [instance: 92e31b92-0af1-4da6-bc87-23978f1aedf5] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:55:36.900271 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-171a50a7-c475-45a8-bb43-0486f880468d tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:36.901655 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-171a50a7-c475-45a8-bb43-0486f880468d tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:36.902294 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-171a50a7-c475-45a8-bb43-0486f880468d tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:36.903180 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-171a50a7-c475-45a8-bb43-0486f880468d tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:36.904365 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-171a50a7-c475-45a8-bb43-0486f880468d tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:36.905627 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-171a50a7-c475-45a8-bb43-0486f880468d tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:37.032178 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-171a50a7-c475-45a8-bb43-0486f880468d tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:37.044920 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-171a50a7-c475-45a8-bb43-0486f880468d tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:37.046816 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-171a50a7-c475-45a8-bb43-0486f880468d tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:37.055215 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-171a50a7-c475-45a8-bb43-0486f880468d tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] 10.222.0.26 "GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5" status: 200 len: 1539 microversion: 2.91 time: 0.168008 Oct 08 20:55:37.070377 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 564/1093] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:55:36 2022] GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5 => generated 1539 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:55:37.231453 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-bb734660-4117-4cd5-aa6f-d970d97af30b tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:37.233348 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-bb734660-4117-4cd5-aa6f-d970d97af30b tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] [instance: 57016fcf-2d2c-488c-9af6-0530ebc199f6] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:55:37.243859 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-b5b58e91-9a42-4d89-b67f-e4491be040d0 tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:37.245368 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-b5b58e91-9a42-4d89-b67f-e4491be040d0 tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] [instance: 8b29aacb-435d-4c6c-bbe7-3d5c6e1c622e] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:55:37.259010 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b5b58e91-9a42-4d89-b67f-e4491be040d0 tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:37.260864 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b5b58e91-9a42-4d89-b67f-e4491be040d0 tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:37.261792 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bb734660-4117-4cd5-aa6f-d970d97af30b tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:37.262419 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b5b58e91-9a42-4d89-b67f-e4491be040d0 tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:37.263337 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b5b58e91-9a42-4d89-b67f-e4491be040d0 tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:37.263981 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bb734660-4117-4cd5-aa6f-d970d97af30b tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:37.265021 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bb734660-4117-4cd5-aa6f-d970d97af30b tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:37.265833 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b5b58e91-9a42-4d89-b67f-e4491be040d0 tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:37.267249 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bb734660-4117-4cd5-aa6f-d970d97af30b tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:37.267935 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b5b58e91-9a42-4d89-b67f-e4491be040d0 tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:37.271506 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bb734660-4117-4cd5-aa6f-d970d97af30b tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:37.272458 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bb734660-4117-4cd5-aa6f-d970d97af30b tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:37.552098 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-bb734660-4117-4cd5-aa6f-d970d97af30b tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:37.561097 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-bb734660-4117-4cd5-aa6f-d970d97af30b tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:37.568233 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-bb734660-4117-4cd5-aa6f-d970d97af30b tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:37.572942 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-bb734660-4117-4cd5-aa6f-d970d97af30b tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] 10.222.0.26 "GET /compute/v2.1/servers/57016fcf-2d2c-488c-9af6-0530ebc199f6" status: 200 len: 1412 microversion: 2.25 time: 0.343155 Oct 08 20:55:37.573912 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 530/1094] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:55:37 2022] GET /compute/v2.1/servers/57016fcf-2d2c-488c-9af6-0530ebc199f6 => generated 1412 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 08 20:55:37.579920 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-58625b6d-3f82-4b0c-9d07-9fb7ecff48a6 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Calling method '.version_select at 0x7f1a8c9ae310>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:37.604094 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-b5b58e91-9a42-4d89-b67f-e4491be040d0 tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6cf9c6c133947f3aecee3a913a32328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e277ebf9cbf4cb0b6be14efbec504bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:37.615574 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-b5b58e91-9a42-4d89-b67f-e4491be040d0 tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] 10.222.0.26 "GET /compute/v2.1/servers/8b29aacb-435d-4c6c-bbe7-3d5c6e1c622e" status: 200 len: 1576 microversion: 2.1 time: 0.376456 Oct 08 20:55:37.628236 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 565/1095] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:55:37 2022] GET /compute/v2.1/servers/8b29aacb-435d-4c6c-bbe7-3d5c6e1c622e => generated 1576 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:55:37.633135 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-7b3d9189-7614-445d-9b9a-18e6565b4030 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:37.634101 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-7b3d9189-7614-445d-9b9a-18e6565b4030 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] [instance: 73fd15ea-e4bd-4310-93bb-147b0a5e27ef] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:55:37.646005 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7b3d9189-7614-445d-9b9a-18e6565b4030 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:37.647076 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7b3d9189-7614-445d-9b9a-18e6565b4030 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:37.647648 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7b3d9189-7614-445d-9b9a-18e6565b4030 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:37.648483 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7b3d9189-7614-445d-9b9a-18e6565b4030 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:37.648950 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7b3d9189-7614-445d-9b9a-18e6565b4030 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:37.650628 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7b3d9189-7614-445d-9b9a-18e6565b4030 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:37.656733 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-58625b6d-3f82-4b0c-9d07-9fb7ecff48a6 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] 10.222.0.26 "GET /compute/v2.1/images/c9c4114b-60e7-4da5-980a-ac303ed9462a" status: 200 len: 1455 microversion: 2.1 time: 0.081236 Oct 08 20:55:37.657447 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 531/1096] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:55:37 2022] GET /compute/v2.1/images/c9c4114b-60e7-4da5-980a-ac303ed9462a => generated 1455 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:55:37.802507 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-e1b3ae89-0afe-4e2a-b900-fbbfc092bcb0 req-dc754c83-1114-445a-8ffb-7cfbc13d64ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b29aacb-435d-4c6c-bbe7-3d5c6e1c622e", "tag": "d89da5d3-0c81-4f3c-902a-ac5dee64ec3a"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:55:37.831648 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-e1b3ae89-0afe-4e2a-b900-fbbfc092bcb0 req-dc754c83-1114-445a-8ffb-7cfbc13d64ef service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:37.833120 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-e1b3ae89-0afe-4e2a-b900-fbbfc092bcb0 req-dc754c83-1114-445a-8ffb-7cfbc13d64ef service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:37.833602 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-e1b3ae89-0afe-4e2a-b900-fbbfc092bcb0 req-dc754c83-1114-445a-8ffb-7cfbc13d64ef service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:37.872083 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-e1b3ae89-0afe-4e2a-b900-fbbfc092bcb0 req-dc754c83-1114-445a-8ffb-7cfbc13d64ef service nova] Creating event network-changed:d89da5d3-0c81-4f3c-902a-ac5dee64ec3a for instance 8b29aacb-435d-4c6c-bbe7-3d5c6e1c622e on nch2-master-1 Oct 08 20:55:37.892701 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-e1b3ae89-0afe-4e2a-b900-fbbfc092bcb0 req-dc754c83-1114-445a-8ffb-7cfbc13d64ef service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095588 Oct 08 20:55:37.905043 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 532/1097] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:55:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 08 20:55:38.087251 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-dea1cbe1-0c5e-4b85-ad81-d56e774e6b08 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:38.087955 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-dea1cbe1-0c5e-4b85-ad81-d56e774e6b08 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] [instance: 92e31b92-0af1-4da6-bc87-23978f1aedf5] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:55:38.096300 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dea1cbe1-0c5e-4b85-ad81-d56e774e6b08 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:38.101949 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dea1cbe1-0c5e-4b85-ad81-d56e774e6b08 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:38.102487 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dea1cbe1-0c5e-4b85-ad81-d56e774e6b08 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:38.103242 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dea1cbe1-0c5e-4b85-ad81-d56e774e6b08 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:38.103763 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dea1cbe1-0c5e-4b85-ad81-d56e774e6b08 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:38.104146 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dea1cbe1-0c5e-4b85-ad81-d56e774e6b08 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:38.339865 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-dea1cbe1-0c5e-4b85-ad81-d56e774e6b08 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:38.349882 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-dea1cbe1-0c5e-4b85-ad81-d56e774e6b08 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:38.357149 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-dea1cbe1-0c5e-4b85-ad81-d56e774e6b08 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:38.370562 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-dea1cbe1-0c5e-4b85-ad81-d56e774e6b08 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] 10.222.0.26 "GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5" status: 200 len: 1539 microversion: 2.91 time: 0.288702 Oct 08 20:55:38.373519 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 533/1098] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:55:38 2022] GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5 => generated 1539 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 08 20:55:38.559133 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-7b3d9189-7614-445d-9b9a-18e6565b4030 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef659f5a1a24c439528a7675bdd70f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c92fe04ab8248399d0acb932f82d607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:38.570928 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-7b3d9189-7614-445d-9b9a-18e6565b4030 tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] 10.222.0.26 "GET /compute/v2.1/servers/73fd15ea-e4bd-4310-93bb-147b0a5e27ef" status: 200 len: 1468 microversion: 2.1 time: 0.941235 Oct 08 20:55:38.571517 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 566/1099] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:55:37 2022] GET /compute/v2.1/servers/73fd15ea-e4bd-4310-93bb-147b0a5e27ef => generated 1468 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:55:38.602985 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-58adb7d1-012b-4622-a3f8-df4cdd8f0a85 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:38.603620 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-58adb7d1-012b-4622-a3f8-df4cdd8f0a85 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] [instance: 57016fcf-2d2c-488c-9af6-0530ebc199f6] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:55:38.634497 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-58adb7d1-012b-4622-a3f8-df4cdd8f0a85 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:38.635004 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-58adb7d1-012b-4622-a3f8-df4cdd8f0a85 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:38.642502 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-58adb7d1-012b-4622-a3f8-df4cdd8f0a85 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:38.645388 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-58adb7d1-012b-4622-a3f8-df4cdd8f0a85 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:38.650287 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-58adb7d1-012b-4622-a3f8-df4cdd8f0a85 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:38.651661 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-58adb7d1-012b-4622-a3f8-df4cdd8f0a85 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:38.671694 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-8c211183-f657-4853-8256-3d772c0b6b7f req-fe27aa76-6a91-44ed-9165-8ec7376d7148 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cbc3ac5-5690-4f4e-a9d1-ea0de18060b1", "name": "network-vif-plugged", "status": "completed", "tag": "20694e26-0b3a-4a5f-9806-aa0485a844f5"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:55:38.701965 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-8c211183-f657-4853-8256-3d772c0b6b7f req-fe27aa76-6a91-44ed-9165-8ec7376d7148 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:38.702655 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-8c211183-f657-4853-8256-3d772c0b6b7f req-fe27aa76-6a91-44ed-9165-8ec7376d7148 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:38.703773 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-8c211183-f657-4853-8256-3d772c0b6b7f req-fe27aa76-6a91-44ed-9165-8ec7376d7148 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:38.783683 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-8c211183-f657-4853-8256-3d772c0b6b7f req-fe27aa76-6a91-44ed-9165-8ec7376d7148 service nova] Creating event network-vif-plugged:20694e26-0b3a-4a5f-9806-aa0485a844f5 for instance 0cbc3ac5-5690-4f4e-a9d1-ea0de18060b1 on nch1-master-1 Oct 08 20:55:38.801163 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-8c211183-f657-4853-8256-3d772c0b6b7f req-fe27aa76-6a91-44ed-9165-8ec7376d7148 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134251 Oct 08 20:55:38.807337 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 567/1100] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:55:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:55:38.831421 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-841680ae-48a4-4c24-a2db-720de1e3d840 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Calling method '.version_select at 0x7f1a8c7c70d0>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:38.990980 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-841680ae-48a4-4c24-a2db-720de1e3d840 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] 10.222.0.26 "GET /compute/v2.1/images/c9c4114b-60e7-4da5-980a-ac303ed9462a" status: 200 len: 1455 microversion: 2.1 time: 0.176854 Oct 08 20:55:38.991694 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 568/1101] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:55:38 2022] GET /compute/v2.1/images/c9c4114b-60e7-4da5-980a-ac303ed9462a => generated 1455 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:55:39.178950 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-58adb7d1-012b-4622-a3f8-df4cdd8f0a85 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:39.186537 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-58adb7d1-012b-4622-a3f8-df4cdd8f0a85 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:39.197281 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-58adb7d1-012b-4622-a3f8-df4cdd8f0a85 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:39.198665 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-58adb7d1-012b-4622-a3f8-df4cdd8f0a85 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] 10.222.0.26 "GET /compute/v2.1/servers/57016fcf-2d2c-488c-9af6-0530ebc199f6" status: 200 len: 1412 microversion: 2.25 time: 0.600760 Oct 08 20:55:39.199243 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 534/1102] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:55:38 2022] GET /compute/v2.1/servers/57016fcf-2d2c-488c-9af6-0530ebc199f6 => generated 1412 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:55:39.401878 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-0ac657e5-7688-4bbc-ac1a-3e3ac865670b tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:39.402775 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-0ac657e5-7688-4bbc-ac1a-3e3ac865670b tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] [instance: 92e31b92-0af1-4da6-bc87-23978f1aedf5] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:55:39.416870 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0ac657e5-7688-4bbc-ac1a-3e3ac865670b tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:39.417652 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0ac657e5-7688-4bbc-ac1a-3e3ac865670b tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:39.422408 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0ac657e5-7688-4bbc-ac1a-3e3ac865670b tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:39.423439 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0ac657e5-7688-4bbc-ac1a-3e3ac865670b tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:39.437776 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0ac657e5-7688-4bbc-ac1a-3e3ac865670b tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:39.438418 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0ac657e5-7688-4bbc-ac1a-3e3ac865670b tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:39.599035 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-dbb65c92-5d48-4683-83d1-b29556600abf tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:39.600311 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-dbb65c92-5d48-4683-83d1-b29556600abf tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] [instance: 73fd15ea-e4bd-4310-93bb-147b0a5e27ef] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:55:39.618338 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dbb65c92-5d48-4683-83d1-b29556600abf tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:39.620990 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dbb65c92-5d48-4683-83d1-b29556600abf tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:39.624036 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dbb65c92-5d48-4683-83d1-b29556600abf tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:39.625070 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dbb65c92-5d48-4683-83d1-b29556600abf tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:39.627048 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dbb65c92-5d48-4683-83d1-b29556600abf tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:39.628876 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dbb65c92-5d48-4683-83d1-b29556600abf tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:39.661655 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-dbb65c92-5d48-4683-83d1-b29556600abf tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] HTTP exception thrown: Instance 73fd15ea-e4bd-4310-93bb-147b0a5e27ef could not be found. Oct 08 20:55:39.666619 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-dbb65c92-5d48-4683-83d1-b29556600abf tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Request method failure captured: Oct 08 20:55:39.666619 ncdv-master-1 devstack@n-api.service[140491]: request: GET /compute/v2.1/servers/73fd15ea-e4bd-4310-93bb-147b0a5e27ef HTTP/1.1 Oct 08 20:55:39.666619 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 20:55:39.666619 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 20:55:39.666619 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 20:55:39.666619 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 20:55:39.666619 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 20:55:39.666619 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 20:55:39.666619 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 20:55:39.666619 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 20:55:39.666619 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeMkMNEyrQg7LwXap23MVpWLk08k2XXa9AhhNdDm_bF8My40HcX5l0HeSUCvRieavRf1weJ6dMtuMQLwqaU4APNmYN6MQxJxQHNM0803_f0HSjFTMyWD2vVxd_RSK9X61rs2mpvuyoMUTeom0NYxzJF3WrYO7bBQKfgnboDedNPTU3Q Oct 08 20:55:39.666619 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 20:55:39.666619 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 20:55:39.666619 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 20:55:39.666619 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 20:55:39.666619 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 20:55:39.666619 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 20:55:39.666619 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 8c92fe04ab8248399d0acb932f82d607 Oct 08 20:55:39.666619 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-ServersAdminTestJSON-78545731 Oct 08 20:55:39.666619 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 20:55:39.666619 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 20:55:39.666619 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8c92fe04ab8248399d0acb932f82d607"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8c92fe04ab8248399d0acb932f82d607"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8c92fe04ab8248399d0acb932f82d607"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8c92fe04ab8248399d0acb932f82d607"}]}] Oct 08 20:55:39.666619 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-ServersAdminTestJSON-78545731 Oct 08 20:55:39.666619 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 8c92fe04ab8248399d0acb932f82d607 Oct 08 20:55:39.666619 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-ServersAdminTestJSON-78545731 Oct 08 20:55:39.666619 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-ServersAdminTestJSON-78545731-project Oct 08 20:55:39.666619 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 20:55:39.666619 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 20:55:39.666619 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 5ef659f5a1a24c439528a7675bdd70f8 Oct 08 20:55:39.666619 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-ServersAdminTestJSON-78545731-project Oct 08 20:55:39.666619 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 20:55:39.666619 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance 73fd15ea-e4bd-4310-93bb-147b0a5e27ef could not be found. Oct 08 20:55:39.666619 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': '73fd15ea-e4bd-4310-93bb-147b0a5e27ef'} Oct 08 20:55:39.666619 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:55:39.666619 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:55:39.666619 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 20:55:39.666619 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 20:55:39.666619 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 20:55:39.666619 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 20:55:39.666619 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 20:55:39.666619 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 20:55:39.666619 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 20:55:39.666619 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 20:55:39.666619 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73fd15ea-e4bd-4310-93bb-147b0a5e27ef could not be found. Oct 08 20:55:39.666619 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:55:39.666619 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:55:39.666619 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:55:39.666619 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:55:39.666619 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:55:39.666619 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:55:39.666619 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:55:39.666619 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:55:39.666619 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:55:39.666619 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:55:39.666619 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 20:55:39.666619 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 20:55:39.666619 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 20:55:39.666619 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 20:55:39.666619 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 20:55:39.666619 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 20:55:39.666619 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73fd15ea-e4bd-4310-93bb-147b0a5e27ef could not be found. Oct 08 20:55:39.666619 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:55:39.666619 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:55:39.666619 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:55:39.672042 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:55:39.672042 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:55:39.672042 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:55:39.672042 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 20:55:39.672042 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 20:55:39.672042 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73fd15ea-e4bd-4310-93bb-147b0a5e27ef could not be found. Oct 08 20:55:39.672042 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:55:39.673750 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-dbb65c92-5d48-4683-83d1-b29556600abf tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] Returning 404 to user: Instance 73fd15ea-e4bd-4310-93bb-147b0a5e27ef could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:55:39.675652 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-dbb65c92-5d48-4683-83d1-b29556600abf tempest-ServersAdminTestJSON-78545731 tempest-ServersAdminTestJSON-78545731-project] 10.222.0.26 "GET /compute/v2.1/servers/73fd15ea-e4bd-4310-93bb-147b0a5e27ef" status: 404 len: 111 microversion: 2.1 time: 0.080870 Oct 08 20:55:39.679875 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 535/1103] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:55:39 2022] GET /compute/v2.1/servers/73fd15ea-e4bd-4310-93bb-147b0a5e27ef => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 20:55:39.699503 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-068cead3-6c00-4073-bf46-1fe40acbfe5b req-ab3077d3-5bba-4112-ae8d-f883f59f76f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57016fcf-2d2c-488c-9af6-0530ebc199f6", "tag": "574497fa-1919-4a57-bca6-30aeb414e335"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:55:39.716000 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-068cead3-6c00-4073-bf46-1fe40acbfe5b req-ab3077d3-5bba-4112-ae8d-f883f59f76f7 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:39.719785 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-068cead3-6c00-4073-bf46-1fe40acbfe5b req-ab3077d3-5bba-4112-ae8d-f883f59f76f7 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:39.720529 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-068cead3-6c00-4073-bf46-1fe40acbfe5b req-ab3077d3-5bba-4112-ae8d-f883f59f76f7 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:39.747654 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-068cead3-6c00-4073-bf46-1fe40acbfe5b req-ab3077d3-5bba-4112-ae8d-f883f59f76f7 service nova] Creating event network-changed:574497fa-1919-4a57-bca6-30aeb414e335 for instance 57016fcf-2d2c-488c-9af6-0530ebc199f6 on nch1-master-1 Oct 08 20:55:39.759504 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-068cead3-6c00-4073-bf46-1fe40acbfe5b req-ab3077d3-5bba-4112-ae8d-f883f59f76f7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062337 Oct 08 20:55:39.763159 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 536/1104] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:55:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 08 20:55:39.833532 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-0ac657e5-7688-4bbc-ac1a-3e3ac865670b tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:39.846970 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-0ac657e5-7688-4bbc-ac1a-3e3ac865670b tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:39.848674 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-0ac657e5-7688-4bbc-ac1a-3e3ac865670b tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:39.861345 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-0ac657e5-7688-4bbc-ac1a-3e3ac865670b tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] 10.222.0.26 "GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5" status: 200 len: 1539 microversion: 2.91 time: 0.463814 Oct 08 20:55:39.862340 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 569/1105] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:55:39 2022] GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5 => generated 1539 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:55:40.008278 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-ba2d9f08-a02b-40dc-87a4-29a40eac5150 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Calling method '.version_select at 0x7f1a8c9e63a0>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:40.085712 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-ba2d9f08-a02b-40dc-87a4-29a40eac5150 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] 10.222.0.26 "GET /compute/v2.1/images/c9c4114b-60e7-4da5-980a-ac303ed9462a" status: 200 len: 1455 microversion: 2.1 time: 0.081919 Oct 08 20:55:40.097807 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 537/1106] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:55:40 2022] GET /compute/v2.1/images/c9c4114b-60e7-4da5-980a-ac303ed9462a => generated 1455 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:55:40.225357 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-a75142e0-50c7-453a-bc5d-50c766ba660b tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:40.226362 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-a75142e0-50c7-453a-bc5d-50c766ba660b tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] [instance: 57016fcf-2d2c-488c-9af6-0530ebc199f6] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:55:40.236486 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a75142e0-50c7-453a-bc5d-50c766ba660b tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:40.237340 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a75142e0-50c7-453a-bc5d-50c766ba660b tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:40.238013 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a75142e0-50c7-453a-bc5d-50c766ba660b tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:40.239227 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a75142e0-50c7-453a-bc5d-50c766ba660b tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:40.241766 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a75142e0-50c7-453a-bc5d-50c766ba660b tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:40.242498 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a75142e0-50c7-453a-bc5d-50c766ba660b tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:40.282932 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-0d29dc79-bdd0-48f5-9d4b-4d5d23d602c3 req-a9175fb9-315b-4ef2-9c29-470d0456a7bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73fd15ea-e4bd-4310-93bb-147b0a5e27ef", "name": "network-vif-deleted", "tag": "27f3cc41-9f72-499b-bae1-fb66f8f24df7"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:55:40.314675 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-0d29dc79-bdd0-48f5-9d4b-4d5d23d602c3 req-a9175fb9-315b-4ef2-9c29-470d0456a7bb service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:40.315476 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-0d29dc79-bdd0-48f5-9d4b-4d5d23d602c3 req-a9175fb9-315b-4ef2-9c29-470d0456a7bb service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:40.316272 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-0d29dc79-bdd0-48f5-9d4b-4d5d23d602c3 req-a9175fb9-315b-4ef2-9c29-470d0456a7bb service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:40.336311 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-0d29dc79-bdd0-48f5-9d4b-4d5d23d602c3 req-a9175fb9-315b-4ef2-9c29-470d0456a7bb service nova] Creating event network-vif-deleted:27f3cc41-9f72-499b-bae1-fb66f8f24df7 for instance 73fd15ea-e4bd-4310-93bb-147b0a5e27ef on nch2-master-1 Oct 08 20:55:40.351810 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-0d29dc79-bdd0-48f5-9d4b-4d5d23d602c3 req-a9175fb9-315b-4ef2-9c29-470d0456a7bb service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073297 Oct 08 20:55:40.357362 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 538/1107] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:55:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 08 20:55:40.896447 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c9b4bad9-1a83-4d04-9b16-17be4817f7d0 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:40.897008 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-c9b4bad9-1a83-4d04-9b16-17be4817f7d0 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] [instance: 92e31b92-0af1-4da6-bc87-23978f1aedf5] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:55:40.912080 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c9b4bad9-1a83-4d04-9b16-17be4817f7d0 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:40.912588 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c9b4bad9-1a83-4d04-9b16-17be4817f7d0 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:40.913032 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c9b4bad9-1a83-4d04-9b16-17be4817f7d0 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:40.913815 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c9b4bad9-1a83-4d04-9b16-17be4817f7d0 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:40.918655 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c9b4bad9-1a83-4d04-9b16-17be4817f7d0 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:40.920144 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c9b4bad9-1a83-4d04-9b16-17be4817f7d0 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:40.933431 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:55:41.031172 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-c9b4bad9-1a83-4d04-9b16-17be4817f7d0 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:41.045053 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-c9b4bad9-1a83-4d04-9b16-17be4817f7d0 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:41.050148 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-c9b4bad9-1a83-4d04-9b16-17be4817f7d0 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:41.070809 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-c9b4bad9-1a83-4d04-9b16-17be4817f7d0 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] 10.222.0.26 "GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5" status: 200 len: 1539 microversion: 2.91 time: 0.179307 Oct 08 20:55:41.071994 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 539/1108] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:55:40 2022] GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5 => generated 1539 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:55:41.104360 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-48b40856-7be0-4f3c-89e6-ead3c6c4068f tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Calling method '.version_select at 0x7f1a8c988820>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:41.188129 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-48b40856-7be0-4f3c-89e6-ead3c6c4068f tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] 10.222.0.26 "GET /compute/v2.1/images/c9c4114b-60e7-4da5-980a-ac303ed9462a" status: 200 len: 1455 microversion: 2.1 time: 0.088414 Oct 08 20:55:41.189032 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 540/1109] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:55:41 2022] GET /compute/v2.1/images/c9c4114b-60e7-4da5-980a-ac303ed9462a => generated 1455 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:55:41.418858 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-a75142e0-50c7-453a-bc5d-50c766ba660b tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:41.428629 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-a75142e0-50c7-453a-bc5d-50c766ba660b tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:41.439289 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-a75142e0-50c7-453a-bc5d-50c766ba660b tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:41.440738 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-a75142e0-50c7-453a-bc5d-50c766ba660b tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] 10.222.0.26 "GET /compute/v2.1/servers/57016fcf-2d2c-488c-9af6-0530ebc199f6" status: 200 len: 1412 microversion: 2.25 time: 1.219294 Oct 08 20:55:41.441974 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 570/1110] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:55:40 2022] GET /compute/v2.1/servers/57016fcf-2d2c-488c-9af6-0530ebc199f6 => generated 1412 bytes in 1221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 08 20:55:42.104778 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=2 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:55:42.105575 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=6 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:55:42.111947 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-ffa4dff8-0f0d-4df5-9c2f-b6500b65529c tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:42.113615 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-ffa4dff8-0f0d-4df5-9c2f-b6500b65529c tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] [instance: 92e31b92-0af1-4da6-bc87-23978f1aedf5] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:55:42.124857 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ffa4dff8-0f0d-4df5-9c2f-b6500b65529c tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:42.125790 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ffa4dff8-0f0d-4df5-9c2f-b6500b65529c tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:42.126750 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ffa4dff8-0f0d-4df5-9c2f-b6500b65529c tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:42.127766 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ffa4dff8-0f0d-4df5-9c2f-b6500b65529c tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:42.128503 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ffa4dff8-0f0d-4df5-9c2f-b6500b65529c tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:42.129151 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ffa4dff8-0f0d-4df5-9c2f-b6500b65529c tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:42.204225 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-3b309e46-3ac0-4ef9-ab31-b3d0007cf3bc tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Calling method '.version_select at 0x7f1a8c7c7670>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:42.218478 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=2 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:55:42.279892 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-3b309e46-3ac0-4ef9-ab31-b3d0007cf3bc tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] 10.222.0.26 "GET /compute/v2.1/images/c9c4114b-60e7-4da5-980a-ac303ed9462a" status: 200 len: 1455 microversion: 2.1 time: 0.079651 Oct 08 20:55:42.306003 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 571/1111] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:55:42 2022] GET /compute/v2.1/images/c9c4114b-60e7-4da5-980a-ac303ed9462a => generated 1455 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 20:55:42.415160 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-ffa4dff8-0f0d-4df5-9c2f-b6500b65529c tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:42.428802 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-ffa4dff8-0f0d-4df5-9c2f-b6500b65529c tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:42.433346 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-ffa4dff8-0f0d-4df5-9c2f-b6500b65529c tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:42.444062 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-ffa4dff8-0f0d-4df5-9c2f-b6500b65529c tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] 10.222.0.26 "GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5" status: 200 len: 1539 microversion: 2.91 time: 0.339884 Oct 08 20:55:42.449278 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 541/1112] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:55:42 2022] GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5 => generated 1539 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:55:42.473174 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-2e963076-2ced-46f3-a810-9296078734f9 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:42.493345 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-2e963076-2ced-46f3-a810-9296078734f9 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] [instance: 57016fcf-2d2c-488c-9af6-0530ebc199f6] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:55:42.501952 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2e963076-2ced-46f3-a810-9296078734f9 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:42.502905 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2e963076-2ced-46f3-a810-9296078734f9 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:42.503533 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2e963076-2ced-46f3-a810-9296078734f9 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:42.504425 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2e963076-2ced-46f3-a810-9296078734f9 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:42.505044 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2e963076-2ced-46f3-a810-9296078734f9 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:42.506180 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2e963076-2ced-46f3-a810-9296078734f9 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:43.324700 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-f77142e2-06c9-485d-a5cf-4dbd28eee16f tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Calling method '.version_select at 0x7f1a8c9d05e0>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:43.355035 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-2e963076-2ced-46f3-a810-9296078734f9 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:43.385674 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-2e963076-2ced-46f3-a810-9296078734f9 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:43.392643 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-2e963076-2ced-46f3-a810-9296078734f9 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:43.402574 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-2e963076-2ced-46f3-a810-9296078734f9 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] 10.222.0.26 "GET /compute/v2.1/servers/57016fcf-2d2c-488c-9af6-0530ebc199f6" status: 200 len: 1412 microversion: 2.25 time: 0.935178 Oct 08 20:55:43.406475 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 572/1113] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:55:42 2022] GET /compute/v2.1/servers/57016fcf-2d2c-488c-9af6-0530ebc199f6 => generated 1412 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:55:43.476107 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-ec0795eb-863e-4c5a-812c-d863ffd4d1b4 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:43.477602 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-ec0795eb-863e-4c5a-812c-d863ffd4d1b4 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] [instance: 92e31b92-0af1-4da6-bc87-23978f1aedf5] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:55:43.498669 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ec0795eb-863e-4c5a-812c-d863ffd4d1b4 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:43.499398 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ec0795eb-863e-4c5a-812c-d863ffd4d1b4 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:43.500040 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ec0795eb-863e-4c5a-812c-d863ffd4d1b4 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:43.500995 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ec0795eb-863e-4c5a-812c-d863ffd4d1b4 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:43.501715 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ec0795eb-863e-4c5a-812c-d863ffd4d1b4 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:43.502355 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ec0795eb-863e-4c5a-812c-d863ffd4d1b4 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:43.530336 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-f77142e2-06c9-485d-a5cf-4dbd28eee16f tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] 10.222.0.26 "GET /compute/v2.1/images/c9c4114b-60e7-4da5-980a-ac303ed9462a" status: 200 len: 1455 microversion: 2.1 time: 0.213124 Oct 08 20:55:43.537429 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 542/1114] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:55:43 2022] GET /compute/v2.1/images/c9c4114b-60e7-4da5-980a-ac303ed9462a => generated 1455 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:55:43.685201 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-ec0795eb-863e-4c5a-812c-d863ffd4d1b4 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:43.695916 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-ec0795eb-863e-4c5a-812c-d863ffd4d1b4 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:43.704167 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-ec0795eb-863e-4c5a-812c-d863ffd4d1b4 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:43.720055 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-ec0795eb-863e-4c5a-812c-d863ffd4d1b4 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] 10.222.0.26 "GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5" status: 200 len: 1539 microversion: 2.91 time: 0.247799 Oct 08 20:55:43.744570 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 573/1115] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:55:43 2022] GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5 => generated 1539 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 08 20:55:44.433109 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-116c2f30-4af2-4a3d-85c6-d6ea06bf048f tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:44.433926 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-116c2f30-4af2-4a3d-85c6-d6ea06bf048f tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] [instance: 57016fcf-2d2c-488c-9af6-0530ebc199f6] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:55:44.456145 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-116c2f30-4af2-4a3d-85c6-d6ea06bf048f tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:44.456990 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-116c2f30-4af2-4a3d-85c6-d6ea06bf048f tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:44.460590 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-116c2f30-4af2-4a3d-85c6-d6ea06bf048f tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:44.468024 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-116c2f30-4af2-4a3d-85c6-d6ea06bf048f tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:44.468789 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-116c2f30-4af2-4a3d-85c6-d6ea06bf048f tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:44.472289 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-116c2f30-4af2-4a3d-85c6-d6ea06bf048f tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:44.550725 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-2616b0a4-1b1b-4150-ab52-b0c0aa22f1f3 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Calling method '.version_select at 0x7f1a8c8430d0>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:44.634139 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-2616b0a4-1b1b-4150-ab52-b0c0aa22f1f3 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] 10.222.0.26 "GET /compute/v2.1/images/c9c4114b-60e7-4da5-980a-ac303ed9462a" status: 200 len: 1455 microversion: 2.1 time: 0.088706 Oct 08 20:55:44.634996 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 574/1116] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:55:44 2022] GET /compute/v2.1/images/c9c4114b-60e7-4da5-980a-ac303ed9462a => generated 1455 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:55:44.751086 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-12100930-24df-4008-8dce-e5c682a6dc81 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:44.751729 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-12100930-24df-4008-8dce-e5c682a6dc81 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] [instance: 92e31b92-0af1-4da6-bc87-23978f1aedf5] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:55:44.772275 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-12100930-24df-4008-8dce-e5c682a6dc81 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:44.772803 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-12100930-24df-4008-8dce-e5c682a6dc81 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:44.773290 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-12100930-24df-4008-8dce-e5c682a6dc81 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:44.787582 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-12100930-24df-4008-8dce-e5c682a6dc81 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:44.788216 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-12100930-24df-4008-8dce-e5c682a6dc81 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:44.788755 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-12100930-24df-4008-8dce-e5c682a6dc81 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:44.888208 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-116c2f30-4af2-4a3d-85c6-d6ea06bf048f tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:44.901287 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-116c2f30-4af2-4a3d-85c6-d6ea06bf048f tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:44.904749 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-116c2f30-4af2-4a3d-85c6-d6ea06bf048f tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:44.912797 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-116c2f30-4af2-4a3d-85c6-d6ea06bf048f tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] 10.222.0.26 "GET /compute/v2.1/servers/57016fcf-2d2c-488c-9af6-0530ebc199f6" status: 200 len: 1412 microversion: 2.25 time: 0.481986 Oct 08 20:55:44.914080 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 543/1117] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:55:44 2022] GET /compute/v2.1/servers/57016fcf-2d2c-488c-9af6-0530ebc199f6 => generated 1412 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:55:44.987970 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-12100930-24df-4008-8dce-e5c682a6dc81 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:45.001513 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-12100930-24df-4008-8dce-e5c682a6dc81 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:45.006891 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-12100930-24df-4008-8dce-e5c682a6dc81 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:45.028782 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-12100930-24df-4008-8dce-e5c682a6dc81 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] 10.222.0.26 "GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5" status: 200 len: 1539 microversion: 2.91 time: 0.281800 Oct 08 20:55:45.030572 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 575/1118] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:55:44 2022] GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5 => generated 1539 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 08 20:55:45.651540 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-be061701-fe6f-45ab-b3cb-8454f4d72a1e tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Calling method '.version_select at 0x7f1a8c7aaa60>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:45.706994 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c64abd11-5e17-4ee5-97ae-90178ae8a4e6 tempest-ServicesAdminNegativeTestJSON-136868449 tempest-ServicesAdminNegativeTestJSON-136868449-project-admin] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:45.717687 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c64abd11-5e17-4ee5-97ae-90178ae8a4e6 tempest-ServicesAdminNegativeTestJSON-136868449 tempest-ServicesAdminNegativeTestJSON-136868449-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:45.718512 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c64abd11-5e17-4ee5-97ae-90178ae8a4e6 tempest-ServicesAdminNegativeTestJSON-136868449 tempest-ServicesAdminNegativeTestJSON-136868449-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:45.720069 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-be061701-fe6f-45ab-b3cb-8454f4d72a1e tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] 10.222.0.26 "GET /compute/v2.1/images/c9c4114b-60e7-4da5-980a-ac303ed9462a" status: 200 len: 1455 microversion: 2.1 time: 0.073066 Oct 08 20:55:45.720454 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c64abd11-5e17-4ee5-97ae-90178ae8a4e6 tempest-ServicesAdminNegativeTestJSON-136868449 tempest-ServicesAdminNegativeTestJSON-136868449-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:45.720652 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 576/1119] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:55:45 2022] GET /compute/v2.1/images/c9c4114b-60e7-4da5-980a-ac303ed9462a => generated 1455 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:55:45.729422 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c64abd11-5e17-4ee5-97ae-90178ae8a4e6 tempest-ServicesAdminNegativeTestJSON-136868449 tempest-ServicesAdminNegativeTestJSON-136868449-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:45.731065 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c64abd11-5e17-4ee5-97ae-90178ae8a4e6 tempest-ServicesAdminNegativeTestJSON-136868449 tempest-ServicesAdminNegativeTestJSON-136868449-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:45.736384 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c64abd11-5e17-4ee5-97ae-90178ae8a4e6 tempest-ServicesAdminNegativeTestJSON-136868449 tempest-ServicesAdminNegativeTestJSON-136868449-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:45.816470 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-c64abd11-5e17-4ee5-97ae-90178ae8a4e6 tempest-ServicesAdminNegativeTestJSON-136868449 tempest-ServicesAdminNegativeTestJSON-136868449-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.396204 Oct 08 20:55:45.817702 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 544/1120] 10.222.0.26 () {58 vars in 1137 bytes} [Sat Oct 8 20:55:45 2022] GET /compute/v2.1/os-services => generated 947 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:55:45.832641 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-c8bdaf6e-1126-47bc-a816-f67aa8fafa11 tempest-ServicesAdminNegativeTestJSON-136868449 tempest-ServicesAdminNegativeTestJSON-136868449-project-admin] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:45.836772 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c8bdaf6e-1126-47bc-a816-f67aa8fafa11 tempest-ServicesAdminNegativeTestJSON-136868449 tempest-ServicesAdminNegativeTestJSON-136868449-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:45.837735 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c8bdaf6e-1126-47bc-a816-f67aa8fafa11 tempest-ServicesAdminNegativeTestJSON-136868449 tempest-ServicesAdminNegativeTestJSON-136868449-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:45.844895 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c8bdaf6e-1126-47bc-a816-f67aa8fafa11 tempest-ServicesAdminNegativeTestJSON-136868449 tempest-ServicesAdminNegativeTestJSON-136868449-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:45.845852 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c8bdaf6e-1126-47bc-a816-f67aa8fafa11 tempest-ServicesAdminNegativeTestJSON-136868449 tempest-ServicesAdminNegativeTestJSON-136868449-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:45.846336 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c8bdaf6e-1126-47bc-a816-f67aa8fafa11 tempest-ServicesAdminNegativeTestJSON-136868449 tempest-ServicesAdminNegativeTestJSON-136868449-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:45.846780 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c8bdaf6e-1126-47bc-a816-f67aa8fafa11 tempest-ServicesAdminNegativeTestJSON-136868449 tempest-ServicesAdminNegativeTestJSON-136868449-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:45.889682 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-c8bdaf6e-1126-47bc-a816-f67aa8fafa11 tempest-ServicesAdminNegativeTestJSON-136868449 tempest-ServicesAdminNegativeTestJSON-136868449-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.062425 Oct 08 20:55:45.890382 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 577/1121] 10.222.0.26 () {58 vars in 1170 bytes} [Sat Oct 8 20:55:45 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 947 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:55:45.909233 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-3a81ca49-d653-49eb-b20e-dda211dfdbfa tempest-ServicesAdminNegativeTestJSON-136868449 tempest-ServicesAdminNegativeTestJSON-136868449-project-admin] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:45.913288 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3a81ca49-d653-49eb-b20e-dda211dfdbfa tempest-ServicesAdminNegativeTestJSON-136868449 tempest-ServicesAdminNegativeTestJSON-136868449-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:45.914056 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3a81ca49-d653-49eb-b20e-dda211dfdbfa tempest-ServicesAdminNegativeTestJSON-136868449 tempest-ServicesAdminNegativeTestJSON-136868449-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:45.914761 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3a81ca49-d653-49eb-b20e-dda211dfdbfa tempest-ServicesAdminNegativeTestJSON-136868449 tempest-ServicesAdminNegativeTestJSON-136868449-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:45.915723 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3a81ca49-d653-49eb-b20e-dda211dfdbfa tempest-ServicesAdminNegativeTestJSON-136868449 tempest-ServicesAdminNegativeTestJSON-136868449-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:45.916352 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3a81ca49-d653-49eb-b20e-dda211dfdbfa tempest-ServicesAdminNegativeTestJSON-136868449 tempest-ServicesAdminNegativeTestJSON-136868449-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:45.916954 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3a81ca49-d653-49eb-b20e-dda211dfdbfa tempest-ServicesAdminNegativeTestJSON-136868449 tempest-ServicesAdminNegativeTestJSON-136868449-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:45.941591 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-5b478105-a847-4d78-8558-1c14d8edf60b tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:45.942526 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-5b478105-a847-4d78-8558-1c14d8edf60b tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] [instance: 57016fcf-2d2c-488c-9af6-0530ebc199f6] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:55:45.964712 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5b478105-a847-4d78-8558-1c14d8edf60b tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:45.968681 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5b478105-a847-4d78-8558-1c14d8edf60b tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:45.969287 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5b478105-a847-4d78-8558-1c14d8edf60b tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:45.970151 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5b478105-a847-4d78-8558-1c14d8edf60b tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:45.970907 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5b478105-a847-4d78-8558-1c14d8edf60b tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:45.971444 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5b478105-a847-4d78-8558-1c14d8edf60b tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:45.986055 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-3a81ca49-d653-49eb-b20e-dda211dfdbfa tempest-ServicesAdminNegativeTestJSON-136868449 tempest-ServicesAdminNegativeTestJSON-136868449-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.080510 Oct 08 20:55:45.987016 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 545/1122] 10.222.0.26 () {58 vars in 1137 bytes} [Sat Oct 8 20:55:45 2022] GET /compute/v2.1/os-services => generated 947 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 08 20:55:46.001843 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-41674f85-d637-4e1e-bdbc-73539ec059f8 tempest-ServicesAdminNegativeTestJSON-136868449 tempest-ServicesAdminNegativeTestJSON-136868449-project-admin] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:46.006671 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-41674f85-d637-4e1e-bdbc-73539ec059f8 tempest-ServicesAdminNegativeTestJSON-136868449 tempest-ServicesAdminNegativeTestJSON-136868449-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:46.007585 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-41674f85-d637-4e1e-bdbc-73539ec059f8 tempest-ServicesAdminNegativeTestJSON-136868449 tempest-ServicesAdminNegativeTestJSON-136868449-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:46.008219 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-41674f85-d637-4e1e-bdbc-73539ec059f8 tempest-ServicesAdminNegativeTestJSON-136868449 tempest-ServicesAdminNegativeTestJSON-136868449-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:46.010144 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-41674f85-d637-4e1e-bdbc-73539ec059f8 tempest-ServicesAdminNegativeTestJSON-136868449 tempest-ServicesAdminNegativeTestJSON-136868449-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:46.010631 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-41674f85-d637-4e1e-bdbc-73539ec059f8 tempest-ServicesAdminNegativeTestJSON-136868449 tempest-ServicesAdminNegativeTestJSON-136868449-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:46.011093 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-41674f85-d637-4e1e-bdbc-73539ec059f8 tempest-ServicesAdminNegativeTestJSON-136868449 tempest-ServicesAdminNegativeTestJSON-136868449-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:46.024651 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=3,nova_api:DELETE=7 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:55:46.040907 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-41674f85-d637-4e1e-bdbc-73539ec059f8 tempest-ServicesAdminNegativeTestJSON-136868449 tempest-ServicesAdminNegativeTestJSON-136868449-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services?host=ncdv-master-1&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.044339 Oct 08 20:55:46.050241 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 546/1123] 10.222.0.26 () {58 vars in 1196 bytes} [Sat Oct 8 20:55:45 2022] GET /compute/v2.1/os-services?host=ncdv-master-1&binary=xxx => generated 16 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 08 20:55:46.056067 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-4228b35a-0948-4ccb-95fd-a82331369794 tempest-ServicesAdminNegativeTestJSON-136868449 tempest-ServicesAdminNegativeTestJSON-136868449-project-admin] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:46.059931 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4228b35a-0948-4ccb-95fd-a82331369794 tempest-ServicesAdminNegativeTestJSON-136868449 tempest-ServicesAdminNegativeTestJSON-136868449-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:46.061571 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4228b35a-0948-4ccb-95fd-a82331369794 tempest-ServicesAdminNegativeTestJSON-136868449 tempest-ServicesAdminNegativeTestJSON-136868449-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:46.062056 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4228b35a-0948-4ccb-95fd-a82331369794 tempest-ServicesAdminNegativeTestJSON-136868449 tempest-ServicesAdminNegativeTestJSON-136868449-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:46.062829 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4228b35a-0948-4ccb-95fd-a82331369794 tempest-ServicesAdminNegativeTestJSON-136868449 tempest-ServicesAdminNegativeTestJSON-136868449-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:46.063293 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4228b35a-0948-4ccb-95fd-a82331369794 tempest-ServicesAdminNegativeTestJSON-136868449 tempest-ServicesAdminNegativeTestJSON-136868449-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:46.063879 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4228b35a-0948-4ccb-95fd-a82331369794 tempest-ServicesAdminNegativeTestJSON-136868449 tempest-ServicesAdminNegativeTestJSON-136868449-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:46.133444 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-4228b35a-0948-4ccb-95fd-a82331369794 tempest-ServicesAdminNegativeTestJSON-136868449 tempest-ServicesAdminNegativeTestJSON-136868449-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.081770 Oct 08 20:55:46.134324 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 547/1124] 10.222.0.26 () {58 vars in 1137 bytes} [Sat Oct 8 20:55:46 2022] GET /compute/v2.1/os-services => generated 947 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:55:46.147713 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-ea24b767-6017-4577-a07a-09e43beb747e tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:46.148603 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-ea24b767-6017-4577-a07a-09e43beb747e tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] [instance: 92e31b92-0af1-4da6-bc87-23978f1aedf5] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:55:46.161414 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-5b478105-a847-4d78-8558-1c14d8edf60b tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:46.161889 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ea24b767-6017-4577-a07a-09e43beb747e tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:46.162622 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ea24b767-6017-4577-a07a-09e43beb747e tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:46.163253 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ea24b767-6017-4577-a07a-09e43beb747e tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:46.164145 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ea24b767-6017-4577-a07a-09e43beb747e tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:46.165351 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ea24b767-6017-4577-a07a-09e43beb747e tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:46.165979 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ea24b767-6017-4577-a07a-09e43beb747e tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:46.174270 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-5b478105-a847-4d78-8558-1c14d8edf60b tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:46.177147 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-5b478105-a847-4d78-8558-1c14d8edf60b tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:46.179858 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-5b478105-a847-4d78-8558-1c14d8edf60b tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] 10.222.0.26 "GET /compute/v2.1/servers/57016fcf-2d2c-488c-9af6-0530ebc199f6" status: 200 len: 1412 microversion: 2.25 time: 0.242087 Oct 08 20:55:46.181030 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 578/1125] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:55:45 2022] GET /compute/v2.1/servers/57016fcf-2d2c-488c-9af6-0530ebc199f6 => generated 1412 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 08 20:55:46.185745 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-0011ea45-bf25-45af-a462-491196ab9a60 tempest-ServicesAdminNegativeTestJSON-136868449 tempest-ServicesAdminNegativeTestJSON-136868449-project-admin] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:46.190146 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0011ea45-bf25-45af-a462-491196ab9a60 tempest-ServicesAdminNegativeTestJSON-136868449 tempest-ServicesAdminNegativeTestJSON-136868449-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:46.190933 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0011ea45-bf25-45af-a462-491196ab9a60 tempest-ServicesAdminNegativeTestJSON-136868449 tempest-ServicesAdminNegativeTestJSON-136868449-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:46.191610 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0011ea45-bf25-45af-a462-491196ab9a60 tempest-ServicesAdminNegativeTestJSON-136868449 tempest-ServicesAdminNegativeTestJSON-136868449-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:46.192773 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0011ea45-bf25-45af-a462-491196ab9a60 tempest-ServicesAdminNegativeTestJSON-136868449 tempest-ServicesAdminNegativeTestJSON-136868449-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:46.193500 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0011ea45-bf25-45af-a462-491196ab9a60 tempest-ServicesAdminNegativeTestJSON-136868449 tempest-ServicesAdminNegativeTestJSON-136868449-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:46.195177 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0011ea45-bf25-45af-a462-491196ab9a60 tempest-ServicesAdminNegativeTestJSON-136868449 tempest-ServicesAdminNegativeTestJSON-136868449-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:46.229689 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-0011ea45-bf25-45af-a462-491196ab9a60 tempest-ServicesAdminNegativeTestJSON-136868449 tempest-ServicesAdminNegativeTestJSON-136868449-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.047318 Oct 08 20:55:46.231102 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 579/1126] 10.222.0.26 () {58 vars in 1198 bytes} [Sat Oct 8 20:55:46 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 08 20:55:46.398648 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-ab03c0ad-273e-4522-836f-5aad255fe408 tempest-ServicesAdminNegativeTestJSON-1983264882 tempest-ServicesAdminNegativeTestJSON-1983264882-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:46.401480 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-ea24b767-6017-4577-a07a-09e43beb747e tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:46.404903 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-ab03c0ad-273e-4522-836f-5aad255fe408 tempest-ServicesAdminNegativeTestJSON-1983264882 tempest-ServicesAdminNegativeTestJSON-1983264882-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '44cf341eb3c04d57902c24a67e8a95d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae26877c42a41b2914951b495c1268b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:46.407427 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-ab03c0ad-273e-4522-836f-5aad255fe408 tempest-ServicesAdminNegativeTestJSON-1983264882 tempest-ServicesAdminNegativeTestJSON-1983264882-project] Request method failure captured: Oct 08 20:55:46.407427 ncdv-master-1 devstack@n-api.service[140492]: request: GET /compute/v2.1/os-services HTTP/1.1 Oct 08 20:55:46.407427 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 20:55:46.407427 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 20:55:46.407427 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 20:55:46.407427 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 20:55:46.407427 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 20:55:46.407427 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 20:55:46.407427 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 20:55:46.407427 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 20:55:46.407427 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQePQJeUE_x3QHoeFS-Z3KX6n5D1aRM8Z8BffbgxvFBmT-QQw3HmJIdPuAMrHHDM3qf_qVqmDsjVUPVCITEh8W2xrQJ_STlnOWexJjrVZGssRjOa0mpNNVEn27i27rhwDHmP1NBiwZkKyjrcWoTIyfZbLCipKv-3HBWkfQNTTBxvnUA4 Oct 08 20:55:46.407427 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 20:55:46.407427 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 20:55:46.407427 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 20:55:46.407427 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 20:55:46.407427 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 20:55:46.407427 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 20:55:46.407427 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 2ae26877c42a41b2914951b495c1268b Oct 08 20:55:46.407427 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-1983264882 Oct 08 20:55:46.407427 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 20:55:46.407427 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 20:55:46.407427 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/2ae26877c42a41b2914951b495c1268b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2ae26877c42a41b2914951b495c1268b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_2ae26877c42a41b2914951b495c1268b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2ae26877c42a41b2914951b495c1268b"}]}] Oct 08 20:55:46.407427 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-1983264882 Oct 08 20:55:46.407427 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 2ae26877c42a41b2914951b495c1268b Oct 08 20:55:46.407427 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-1983264882 Oct 08 20:55:46.407427 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-ServicesAdminNegativeTestJSON-1983264882-project Oct 08 20:55:46.407427 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 20:55:46.407427 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 20:55:46.407427 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 44cf341eb3c04d57902c24a67e8a95d2 Oct 08 20:55:46.407427 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-1983264882-project Oct 08 20:55:46.407427 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 20:55:46.407427 ncdv-master-1 devstack@n-api.service[140492]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 08 20:55:46.407427 ncdv-master-1 devstack@n-api.service[140492]: action_args: {} Oct 08 20:55:46.407427 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:55:46.407427 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:55:46.407427 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:55:46.407427 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:55:46.407427 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:55:46.407427 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:55:46.407427 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 08 20:55:46.407427 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 20:55:46.407427 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 08 20:55:46.407427 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 20:55:46.407427 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:55:46.407427 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:55:46.407427 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Oct 08 20:55:46.407427 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Oct 08 20:55:46.407427 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 08 20:55:46.407427 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 08 20:55:46.407427 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 08 20:55:46.407427 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 08 20:55:46.407427 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 08 20:55:46.407427 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 08 20:55:46.407427 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 08 20:55:46.407427 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise self.value Oct 08 20:55:46.407427 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 08 20:55:46.407427 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 08 20:55:46.407427 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 08 20:55:46.407427 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 08 20:55:46.407427 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 08 20:55:46.407427 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 08 20:55:46.407427 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 08 20:55:46.407427 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:55:46.411874 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:55:46.411874 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:55:46.411874 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:55:46.411874 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:55:46.411874 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:55:46.411874 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 08 20:55:46.411874 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 08 20:55:46.411874 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 08 20:55:46.411874 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:55:46.414191 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-ab03c0ad-273e-4522-836f-5aad255fe408 tempest-ServicesAdminNegativeTestJSON-1983264882 tempest-ServicesAdminNegativeTestJSON-1983264882-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:55:46.415395 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-ab03c0ad-273e-4522-836f-5aad255fe408 tempest-ServicesAdminNegativeTestJSON-1983264882 tempest-ServicesAdminNegativeTestJSON-1983264882-project] 10.222.0.26 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.173064 Oct 08 20:55:46.415523 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-ea24b767-6017-4577-a07a-09e43beb747e tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:46.418415 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-ea24b767-6017-4577-a07a-09e43beb747e tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:46.423943 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 580/1127] 10.222.0.26 () {58 vars in 1137 bytes} [Sat Oct 8 20:55:46 2022] GET /compute/v2.1/os-services => generated 112 bytes in 175 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 08 20:55:46.441045 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-ea24b767-6017-4577-a07a-09e43beb747e tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] 10.222.0.26 "GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5" status: 200 len: 1539 microversion: 2.91 time: 0.305461 Oct 08 20:55:46.455672 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 548/1128] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:55:46 2022] GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5 => generated 1539 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:55:46.664211 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-8d4d8258-1ae2-42f7-867a-4155f7d8c2d0 req-8ba94752-cc4d-49a3-805a-fe520e01e4fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57016fcf-2d2c-488c-9af6-0530ebc199f6", "name": "network-vif-plugged", "status": "completed", "tag": "574497fa-1919-4a57-bca6-30aeb414e335"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:55:46.680867 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:55:46.683901 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-8d4d8258-1ae2-42f7-867a-4155f7d8c2d0 req-8ba94752-cc4d-49a3-805a-fe520e01e4fd service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:46.685785 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-8d4d8258-1ae2-42f7-867a-4155f7d8c2d0 req-8ba94752-cc4d-49a3-805a-fe520e01e4fd service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:46.686515 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-8d4d8258-1ae2-42f7-867a-4155f7d8c2d0 req-8ba94752-cc4d-49a3-805a-fe520e01e4fd service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:46.703243 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-8d4d8258-1ae2-42f7-867a-4155f7d8c2d0 req-8ba94752-cc4d-49a3-805a-fe520e01e4fd service nova] Creating event network-vif-plugged:574497fa-1919-4a57-bca6-30aeb414e335 for instance 57016fcf-2d2c-488c-9af6-0530ebc199f6 on nch1-master-1 Oct 08 20:55:46.711972 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-8d4d8258-1ae2-42f7-867a-4155f7d8c2d0 req-8ba94752-cc4d-49a3-805a-fe520e01e4fd service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050251 Oct 08 20:55:46.713202 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 581/1129] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:55:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 08 20:55:46.739398 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-9f5fdde1-be68-499d-a7f8-dc90318c4ad2 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Calling method '.version_select at 0x7f1a8c928820>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:46.837350 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-9f5fdde1-be68-499d-a7f8-dc90318c4ad2 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] 10.222.0.26 "GET /compute/v2.1/images/c9c4114b-60e7-4da5-980a-ac303ed9462a" status: 200 len: 1455 microversion: 2.1 time: 0.105046 Oct 08 20:55:46.838610 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 549/1130] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:55:46 2022] GET /compute/v2.1/images/c9c4114b-60e7-4da5-980a-ac303ed9462a => generated 1455 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:55:47.207498 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e9415b27-5677-4994-91df-7fbe737fde54 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:47.208470 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-e9415b27-5677-4994-91df-7fbe737fde54 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] [instance: 57016fcf-2d2c-488c-9af6-0530ebc199f6] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:55:47.231572 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e9415b27-5677-4994-91df-7fbe737fde54 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:47.233778 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e9415b27-5677-4994-91df-7fbe737fde54 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:47.234259 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e9415b27-5677-4994-91df-7fbe737fde54 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:47.237056 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e9415b27-5677-4994-91df-7fbe737fde54 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:47.237615 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e9415b27-5677-4994-91df-7fbe737fde54 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:47.238062 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e9415b27-5677-4994-91df-7fbe737fde54 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:47.465426 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-e9415b27-5677-4994-91df-7fbe737fde54 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:47.474795 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-0fe46621-0bcb-4b54-9f05-ab679b6a79b1 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:47.475591 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-0fe46621-0bcb-4b54-9f05-ab679b6a79b1 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] [instance: 92e31b92-0af1-4da6-bc87-23978f1aedf5] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:55:47.487678 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0fe46621-0bcb-4b54-9f05-ab679b6a79b1 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:47.490714 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-e9415b27-5677-4994-91df-7fbe737fde54 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:47.491855 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0fe46621-0bcb-4b54-9f05-ab679b6a79b1 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:47.492558 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-e9415b27-5677-4994-91df-7fbe737fde54 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:47.493472 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0fe46621-0bcb-4b54-9f05-ab679b6a79b1 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:47.495269 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-e9415b27-5677-4994-91df-7fbe737fde54 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] 10.222.0.26 "GET /compute/v2.1/servers/57016fcf-2d2c-488c-9af6-0530ebc199f6" status: 200 len: 1412 microversion: 2.25 time: 0.290735 Oct 08 20:55:47.495388 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0fe46621-0bcb-4b54-9f05-ab679b6a79b1 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:47.495487 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 582/1131] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:55:47 2022] GET /compute/v2.1/servers/57016fcf-2d2c-488c-9af6-0530ebc199f6 => generated 1412 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:55:47.497534 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0fe46621-0bcb-4b54-9f05-ab679b6a79b1 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:47.498158 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0fe46621-0bcb-4b54-9f05-ab679b6a79b1 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:47.854158 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-7747321b-cb3c-4f8c-8910-ff0349ebe0c3 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Calling method '.version_select at 0x7f1a8c7f8b80>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:47.952811 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-0fe46621-0bcb-4b54-9f05-ab679b6a79b1 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:47.969870 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-0fe46621-0bcb-4b54-9f05-ab679b6a79b1 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:47.972826 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-7747321b-cb3c-4f8c-8910-ff0349ebe0c3 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] 10.222.0.26 "GET /compute/v2.1/images/c9c4114b-60e7-4da5-980a-ac303ed9462a" status: 200 len: 1455 microversion: 2.1 time: 0.122855 Oct 08 20:55:47.973604 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 583/1132] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:55:47 2022] GET /compute/v2.1/images/c9c4114b-60e7-4da5-980a-ac303ed9462a => generated 1455 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 20:55:47.974481 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-0fe46621-0bcb-4b54-9f05-ab679b6a79b1 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:47.987832 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-0fe46621-0bcb-4b54-9f05-ab679b6a79b1 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] 10.222.0.26 "GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5" status: 200 len: 1539 microversion: 2.91 time: 0.517918 Oct 08 20:55:47.990230 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 550/1133] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:55:47 2022] GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5 => generated 1539 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 08 20:55:48.527999 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-9aea6858-27db-4fd6-9c05-8dfd2670cc70 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:48.529890 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-9aea6858-27db-4fd6-9c05-8dfd2670cc70 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] [instance: 57016fcf-2d2c-488c-9af6-0530ebc199f6] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:55:48.544896 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9aea6858-27db-4fd6-9c05-8dfd2670cc70 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:48.547080 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9aea6858-27db-4fd6-9c05-8dfd2670cc70 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:48.547944 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9aea6858-27db-4fd6-9c05-8dfd2670cc70 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:48.548981 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9aea6858-27db-4fd6-9c05-8dfd2670cc70 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:48.549701 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9aea6858-27db-4fd6-9c05-8dfd2670cc70 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:48.557725 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9aea6858-27db-4fd6-9c05-8dfd2670cc70 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:48.995709 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-b4c750a5-0d10-4768-b4a8-ff3301a06e97 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Calling method '.version_select at 0x7f1a8c9d0700>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:49.112893 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-b4c750a5-0d10-4768-b4a8-ff3301a06e97 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] 10.222.0.26 "GET /compute/v2.1/images/c9c4114b-60e7-4da5-980a-ac303ed9462a" status: 200 len: 1455 microversion: 2.1 time: 0.126522 Oct 08 20:55:49.121918 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 551/1134] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:55:48 2022] GET /compute/v2.1/images/c9c4114b-60e7-4da5-980a-ac303ed9462a => generated 1455 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 20:55:49.137405 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-de0dde71-306b-4d2c-a9d3-2671408957f6 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:49.139259 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-de0dde71-306b-4d2c-a9d3-2671408957f6 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] [instance: 92e31b92-0af1-4da6-bc87-23978f1aedf5] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:55:49.183215 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-de0dde71-306b-4d2c-a9d3-2671408957f6 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:49.184448 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-de0dde71-306b-4d2c-a9d3-2671408957f6 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:49.185725 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-de0dde71-306b-4d2c-a9d3-2671408957f6 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:49.188251 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-de0dde71-306b-4d2c-a9d3-2671408957f6 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:49.189309 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-de0dde71-306b-4d2c-a9d3-2671408957f6 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:49.190744 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-de0dde71-306b-4d2c-a9d3-2671408957f6 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:49.265823 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-9aea6858-27db-4fd6-9c05-8dfd2670cc70 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:49.285432 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-9aea6858-27db-4fd6-9c05-8dfd2670cc70 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:49.292818 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-9aea6858-27db-4fd6-9c05-8dfd2670cc70 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:49.301851 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-9aea6858-27db-4fd6-9c05-8dfd2670cc70 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] 10.222.0.26 "GET /compute/v2.1/servers/57016fcf-2d2c-488c-9af6-0530ebc199f6" status: 200 len: 1608 microversion: 2.25 time: 0.778729 Oct 08 20:55:49.313289 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 584/1135] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:55:48 2022] GET /compute/v2.1/servers/57016fcf-2d2c-488c-9af6-0530ebc199f6 => generated 1608 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:55:49.335078 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-d69ea2bb-6cc3-4af1-9f05-6c1eec098835 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:49.335609 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-d69ea2bb-6cc3-4af1-9f05-6c1eec098835 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] [instance: 57016fcf-2d2c-488c-9af6-0530ebc199f6] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:55:49.346580 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d69ea2bb-6cc3-4af1-9f05-6c1eec098835 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:49.347060 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d69ea2bb-6cc3-4af1-9f05-6c1eec098835 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:49.350554 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d69ea2bb-6cc3-4af1-9f05-6c1eec098835 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:49.353924 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d69ea2bb-6cc3-4af1-9f05-6c1eec098835 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:49.355092 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d69ea2bb-6cc3-4af1-9f05-6c1eec098835 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:49.355718 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d69ea2bb-6cc3-4af1-9f05-6c1eec098835 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:49.446190 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-de0dde71-306b-4d2c-a9d3-2671408957f6 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:49.493409 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-de0dde71-306b-4d2c-a9d3-2671408957f6 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:49.495159 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-de0dde71-306b-4d2c-a9d3-2671408957f6 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:49.516574 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-de0dde71-306b-4d2c-a9d3-2671408957f6 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] 10.222.0.26 "GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5" status: 200 len: 1539 microversion: 2.91 time: 0.392014 Oct 08 20:55:49.526059 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 552/1136] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:55:49 2022] GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5 => generated 1539 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:55:49.628141 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-d69ea2bb-6cc3-4af1-9f05-6c1eec098835 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] 10.222.0.26 "GET /compute/v2.1/servers/57016fcf-2d2c-488c-9af6-0530ebc199f6/os-interface" status: 200 len: 284 microversion: 2.25 time: 0.298843 Oct 08 20:55:49.629524 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 585/1137] 10.222.0.26 () {60 vars in 1316 bytes} [Sat Oct 8 20:55:49 2022] GET /compute/v2.1/servers/57016fcf-2d2c-488c-9af6-0530ebc199f6/os-interface => generated 284 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 08 20:55:50.130779 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-cd619089-5cad-4070-ba47-19625d34fde5 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Calling method '.version_select at 0x7f1a8c9881f0>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:50.252430 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-cd619089-5cad-4070-ba47-19625d34fde5 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] 10.222.0.26 "GET /compute/v2.1/images/c9c4114b-60e7-4da5-980a-ac303ed9462a" status: 200 len: 1455 microversion: 2.1 time: 0.125618 Oct 08 20:55:50.252994 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 553/1138] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:55:50 2022] GET /compute/v2.1/images/c9c4114b-60e7-4da5-980a-ac303ed9462a => generated 1455 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:55:50.573109 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-063d804d-6400-4ac6-b1e2-13771f814139 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:50.574329 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-063d804d-6400-4ac6-b1e2-13771f814139 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] [instance: 92e31b92-0af1-4da6-bc87-23978f1aedf5] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:55:50.642280 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-063d804d-6400-4ac6-b1e2-13771f814139 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:50.644394 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-063d804d-6400-4ac6-b1e2-13771f814139 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:50.645049 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-063d804d-6400-4ac6-b1e2-13771f814139 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:50.648992 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-063d804d-6400-4ac6-b1e2-13771f814139 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:50.649680 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-063d804d-6400-4ac6-b1e2-13771f814139 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:50.650314 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-063d804d-6400-4ac6-b1e2-13771f814139 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:50.810998 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-063d804d-6400-4ac6-b1e2-13771f814139 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:50.833162 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-063d804d-6400-4ac6-b1e2-13771f814139 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:50.838517 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-063d804d-6400-4ac6-b1e2-13771f814139 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:50.853173 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-063d804d-6400-4ac6-b1e2-13771f814139 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] 10.222.0.26 "GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5" status: 200 len: 1539 microversion: 2.91 time: 0.290095 Oct 08 20:55:50.880330 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 586/1139] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:55:50 2022] GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5 => generated 1539 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:55:51.276271 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-45078daf-c14a-407b-9aae-7016d3343e03 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Calling method '.version_select at 0x7f1a8c9d0700>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:51.396626 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-45078daf-c14a-407b-9aae-7016d3343e03 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] 10.222.0.26 "GET /compute/v2.1/images/c9c4114b-60e7-4da5-980a-ac303ed9462a" status: 200 len: 1455 microversion: 2.1 time: 0.124548 Oct 08 20:55:51.414133 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 554/1140] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:55:51 2022] GET /compute/v2.1/images/c9c4114b-60e7-4da5-980a-ac303ed9462a => generated 1455 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:55:51.889865 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-8c8ff342-4e4a-4dda-adf0-51adcdc66d31 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:51.891590 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-8c8ff342-4e4a-4dda-adf0-51adcdc66d31 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] [instance: 92e31b92-0af1-4da6-bc87-23978f1aedf5] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:55:51.917085 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8c8ff342-4e4a-4dda-adf0-51adcdc66d31 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:51.917494 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8c8ff342-4e4a-4dda-adf0-51adcdc66d31 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:51.917984 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8c8ff342-4e4a-4dda-adf0-51adcdc66d31 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:51.931861 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8c8ff342-4e4a-4dda-adf0-51adcdc66d31 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:51.932407 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8c8ff342-4e4a-4dda-adf0-51adcdc66d31 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:51.936602 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8c8ff342-4e4a-4dda-adf0-51adcdc66d31 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:52.036463 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:55:52.177014 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-8c8ff342-4e4a-4dda-adf0-51adcdc66d31 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:52.218370 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-8c8ff342-4e4a-4dda-adf0-51adcdc66d31 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:52.221138 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-8c8ff342-4e4a-4dda-adf0-51adcdc66d31 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:52.252155 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-8c8ff342-4e4a-4dda-adf0-51adcdc66d31 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] 10.222.0.26 "GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5" status: 200 len: 1539 microversion: 2.91 time: 0.367947 Oct 08 20:55:52.257264 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 587/1141] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:55:51 2022] GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5 => generated 1539 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:55:52.314499 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-ed65fdde-e6d8-4a68-889d-28aad8f63d7c req-86f2dc25-4bd4-481a-a702-c7849cc7e303 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57016fcf-2d2c-488c-9af6-0530ebc199f6", "tag": "574497fa-1919-4a57-bca6-30aeb414e335"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:55:52.328368 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-ed65fdde-e6d8-4a68-889d-28aad8f63d7c req-86f2dc25-4bd4-481a-a702-c7849cc7e303 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:52.329135 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-ed65fdde-e6d8-4a68-889d-28aad8f63d7c req-86f2dc25-4bd4-481a-a702-c7849cc7e303 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:52.330178 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-ed65fdde-e6d8-4a68-889d-28aad8f63d7c req-86f2dc25-4bd4-481a-a702-c7849cc7e303 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:52.346377 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-ed65fdde-e6d8-4a68-889d-28aad8f63d7c req-86f2dc25-4bd4-481a-a702-c7849cc7e303 service nova] Creating event network-changed:574497fa-1919-4a57-bca6-30aeb414e335 for instance 57016fcf-2d2c-488c-9af6-0530ebc199f6 on nch1-master-1 Oct 08 20:55:52.353901 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-ed65fdde-e6d8-4a68-889d-28aad8f63d7c req-86f2dc25-4bd4-481a-a702-c7849cc7e303 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043744 Oct 08 20:55:52.355766 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 588/1142] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:55:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:55:52.416009 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-d0b294ab-42e1-449f-a3b9-d67854443356 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Calling method '.version_select at 0x7f1a8c9611f0>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:52.551686 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-d0b294ab-42e1-449f-a3b9-d67854443356 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] 10.222.0.26 "GET /compute/v2.1/images/c9c4114b-60e7-4da5-980a-ac303ed9462a" status: 200 len: 1455 microversion: 2.1 time: 0.140437 Oct 08 20:55:52.553038 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 589/1143] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:55:52 2022] GET /compute/v2.1/images/c9c4114b-60e7-4da5-980a-ac303ed9462a => generated 1455 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 20:55:52.577551 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-b0192297-568e-43b2-8b51-63da5aef97a5 tempest-ListImageFiltersNegativeTestJSON-1687483150 tempest-ListImageFiltersNegativeTestJSON-1687483150-project] Calling method '.version_select at 0x7f1a8c988a60>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:52.641572 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-b0192297-568e-43b2-8b51-63da5aef97a5 tempest-ListImageFiltersNegativeTestJSON-1687483150 tempest-ListImageFiltersNegativeTestJSON-1687483150-project] HTTP exception thrown: Image not found. Oct 08 20:55:52.675701 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-b0192297-568e-43b2-8b51-63da5aef97a5 tempest-ListImageFiltersNegativeTestJSON-1687483150 tempest-ListImageFiltersNegativeTestJSON-1687483150-project] Request method failure captured: Oct 08 20:55:52.675701 ncdv-master-1 devstack@n-api.service[140491]: request: GET /compute/v2.1/images/0fc27e40-190f-4a39-84e6-f7f5ce3a2b30 HTTP/1.1 Oct 08 20:55:52.675701 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 20:55:52.675701 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 20:55:52.675701 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 20:55:52.675701 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 20:55:52.675701 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 20:55:52.675701 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 20:55:52.675701 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 20:55:52.675701 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 20:55:52.675701 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQePX4E9HB0X83RNZyBRcisDiXJy34E13RNVJGJu4j6Quie-kQCGVQzTDLqlwjg1yq5_PjNmuobROjJHD0k07JTxDh7jhtP-gdhY01Cxcb2mR_RsfOWWuFCyLDhN8_2lQIUVcfI9ufSU6Z_VI_CBJQ-3o2VzCgXWMmGWaWSrhPRYaz8Y Oct 08 20:55:52.675701 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 20:55:52.675701 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 20:55:52.675701 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 20:55:52.675701 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 20:55:52.675701 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 20:55:52.675701 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 20:55:52.675701 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 1874c43f0ba44061baef5745d0c36f1b Oct 08 20:55:52.675701 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-1687483150 Oct 08 20:55:52.675701 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 20:55:52.675701 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 20:55:52.675701 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1874c43f0ba44061baef5745d0c36f1b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1874c43f0ba44061baef5745d0c36f1b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1874c43f0ba44061baef5745d0c36f1b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1874c43f0ba44061baef5745d0c36f1b"}]}] Oct 08 20:55:52.675701 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-1687483150 Oct 08 20:55:52.675701 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 1874c43f0ba44061baef5745d0c36f1b Oct 08 20:55:52.675701 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-1687483150 Oct 08 20:55:52.675701 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-ListImageFiltersNegativeTestJSON-1687483150-project Oct 08 20:55:52.675701 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 20:55:52.675701 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 20:55:52.675701 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 5802e80dc756411a80f70b229f0f4876 Oct 08 20:55:52.675701 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-1687483150-project Oct 08 20:55:52.675701 ncdv-master-1 devstack@n-api.service[140491]: method: Oct 08 20:55:52.675701 ncdv-master-1 devstack@n-api.service[140491]: exception: Image not found. Oct 08 20:55:52.675701 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': '0fc27e40-190f-4a39-84e6-f7f5ce3a2b30'} Oct 08 20:55:52.675701 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:55:52.675701 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:55:52.675701 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 08 20:55:52.675701 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 08 20:55:52.675701 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 08 20:55:52.675701 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 08 20:55:52.675701 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 08 20:55:52.675701 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 08 20:55:52.675701 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 08 20:55:52.675701 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 08 20:55:52.675701 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 08 20:55:52.675701 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 08 20:55:52.675701 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 08 20:55:52.675701 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 08 20:55:52.675701 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 08 20:55:52.675701 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 08 20:55:52.675701 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 08 20:55:52.675701 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 08 20:55:52.675701 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 0fc27e40-190f-4a39-84e6-f7f5ce3a2b30 Oct 08 20:55:52.675701 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:55:52.675701 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:55:52.675701 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:55:52.675701 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:55:52.675701 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 08 20:55:52.675701 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 08 20:55:52.675701 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 08 20:55:52.675701 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 08 20:55:52.675701 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 08 20:55:52.675701 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 08 20:55:52.675701 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 08 20:55:52.680829 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 08 20:55:52.680829 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 08 20:55:52.680829 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 08 20:55:52.680829 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 08 20:55:52.680829 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 08 20:55:52.680829 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 08 20:55:52.680829 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 08 20:55:52.680829 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 08 20:55:52.680829 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 08 20:55:52.680829 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 08 20:55:52.680829 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 08 20:55:52.680829 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 08 20:55:52.680829 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 08 20:55:52.680829 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 08 20:55:52.680829 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 08 20:55:52.680829 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 08 20:55:52.680829 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 08 20:55:52.680829 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 0fc27e40-190f-4a39-84e6-f7f5ce3a2b30 could not be found. Oct 08 20:55:52.680829 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:55:52.680829 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:55:52.680829 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:55:52.680829 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:55:52.680829 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:55:52.680829 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:55:52.680829 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:55:52.680829 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:55:52.680829 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 08 20:55:52.680829 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 08 20:55:52.680829 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:55:52.680829 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:55:52.680829 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 08 20:55:52.680829 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 08 20:55:52.680829 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 08 20:55:52.680829 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:55:52.680829 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:55:52.680829 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:55:52.680829 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:55:52.680829 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:55:52.680829 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:55:52.680829 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 20:55:52.680829 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 20:55:52.680829 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 08 20:55:52.680829 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:55:52.680829 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-b0192297-568e-43b2-8b51-63da5aef97a5 tempest-ListImageFiltersNegativeTestJSON-1687483150 tempest-ListImageFiltersNegativeTestJSON-1687483150-project] Returning 404 to user: Image not found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:55:52.680829 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-b0192297-568e-43b2-8b51-63da5aef97a5 tempest-ListImageFiltersNegativeTestJSON-1687483150 tempest-ListImageFiltersNegativeTestJSON-1687483150-project] 10.222.0.26 "GET /compute/v2.1/images/0fc27e40-190f-4a39-84e6-f7f5ce3a2b30" status: 404 len: 62 microversion: 2.1 time: 0.528823 Oct 08 20:55:52.680829 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 555/1144] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:55:52 2022] GET /compute/v2.1/images/0fc27e40-190f-4a39-84e6-f7f5ce3a2b30 => generated 62 bytes in 534 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 08 20:55:53.298399 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-c47285e2-6289-4e27-b850-147266092098 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:53.299497 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-c47285e2-6289-4e27-b850-147266092098 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] [instance: 92e31b92-0af1-4da6-bc87-23978f1aedf5] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:55:53.329719 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c47285e2-6289-4e27-b850-147266092098 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:53.331657 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c47285e2-6289-4e27-b850-147266092098 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:53.333846 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c47285e2-6289-4e27-b850-147266092098 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:53.335880 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c47285e2-6289-4e27-b850-147266092098 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:53.339986 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c47285e2-6289-4e27-b850-147266092098 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:53.342852 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c47285e2-6289-4e27-b850-147266092098 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:53.570192 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-7a241f59-c45e-41a8-93b1-a06cdedfd9db tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Calling method '.version_select at 0x7f1a8c9ae3a0>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:53.694896 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-7a241f59-c45e-41a8-93b1-a06cdedfd9db tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] 10.222.0.26 "GET /compute/v2.1/images/c9c4114b-60e7-4da5-980a-ac303ed9462a" status: 200 len: 1455 microversion: 2.1 time: 0.129655 Oct 08 20:55:53.699768 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 556/1145] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:55:53 2022] GET /compute/v2.1/images/c9c4114b-60e7-4da5-980a-ac303ed9462a => generated 1455 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 20:55:53.909129 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-c47285e2-6289-4e27-b850-147266092098 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:53.923667 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-c47285e2-6289-4e27-b850-147266092098 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:53.937791 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-c47285e2-6289-4e27-b850-147266092098 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:53.955743 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-c47285e2-6289-4e27-b850-147266092098 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] 10.222.0.26 "GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5" status: 200 len: 1560 microversion: 2.91 time: 0.663755 Oct 08 20:55:53.960519 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 590/1146] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:55:53 2022] GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5 => generated 1560 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:55:54.713109 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-8fe72147-efdf-44f5-986b-febec133bfda tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Calling method '.version_select at 0x7f1a8c9289d0>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:54.774754 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-8fe72147-efdf-44f5-986b-febec133bfda tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] 10.222.0.26 "GET /compute/v2.1/images/c9c4114b-60e7-4da5-980a-ac303ed9462a" status: 200 len: 1455 microversion: 2.1 time: 0.061971 Oct 08 20:55:54.776192 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 557/1147] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:55:54 2022] GET /compute/v2.1/images/c9c4114b-60e7-4da5-980a-ac303ed9462a => generated 1455 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:55:54.992849 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-71b37fdc-57f4-43e7-a7cd-c1c6a7efdf1b tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:54.993522 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-71b37fdc-57f4-43e7-a7cd-c1c6a7efdf1b tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] [instance: 92e31b92-0af1-4da6-bc87-23978f1aedf5] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:55:55.010740 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-71b37fdc-57f4-43e7-a7cd-c1c6a7efdf1b tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:55.011253 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-71b37fdc-57f4-43e7-a7cd-c1c6a7efdf1b tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:55.011704 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-71b37fdc-57f4-43e7-a7cd-c1c6a7efdf1b tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:55.022484 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-71b37fdc-57f4-43e7-a7cd-c1c6a7efdf1b tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:55.023189 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-71b37fdc-57f4-43e7-a7cd-c1c6a7efdf1b tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:55.023424 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-71b37fdc-57f4-43e7-a7cd-c1c6a7efdf1b tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:55.155675 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-71b37fdc-57f4-43e7-a7cd-c1c6a7efdf1b tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:55.173943 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-71b37fdc-57f4-43e7-a7cd-c1c6a7efdf1b tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:55.175464 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-71b37fdc-57f4-43e7-a7cd-c1c6a7efdf1b tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:55.187655 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-71b37fdc-57f4-43e7-a7cd-c1c6a7efdf1b tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] 10.222.0.26 "GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5" status: 200 len: 1560 microversion: 2.91 time: 0.199469 Oct 08 20:55:55.189379 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 591/1148] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:55:54 2022] GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5 => generated 1560 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:55:55.792777 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-439a4e6a-2283-408d-a3a0-c9e78000557d tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Calling method '.version_select at 0x7f1a8c9aeee0>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:56.107214 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=8 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:55:56.224507 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-50964079-c62d-4fed-996e-bd1e1587bf93 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:56.225068 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-50964079-c62d-4fed-996e-bd1e1587bf93 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] [instance: 92e31b92-0af1-4da6-bc87-23978f1aedf5] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:55:56.227901 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=4 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:55:56.233940 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-50964079-c62d-4fed-996e-bd1e1587bf93 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:56.234655 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-50964079-c62d-4fed-996e-bd1e1587bf93 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:56.235777 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-50964079-c62d-4fed-996e-bd1e1587bf93 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:56.236906 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-50964079-c62d-4fed-996e-bd1e1587bf93 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:56.237986 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-50964079-c62d-4fed-996e-bd1e1587bf93 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:56.238624 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-50964079-c62d-4fed-996e-bd1e1587bf93 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:56.331085 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-50964079-c62d-4fed-996e-bd1e1587bf93 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:56.345151 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-50964079-c62d-4fed-996e-bd1e1587bf93 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:56.346756 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-50964079-c62d-4fed-996e-bd1e1587bf93 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:56.352780 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-50964079-c62d-4fed-996e-bd1e1587bf93 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] 10.222.0.26 "GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5" status: 200 len: 1555 microversion: 2.91 time: 0.132231 Oct 08 20:55:56.366466 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 592/1149] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:55:56 2022] GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5 => generated 1555 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 08 20:55:57.154824 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-683a157f-c665-443f-ab17-29b58436ba31 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:57.156137 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-683a157f-c665-443f-ab17-29b58436ba31 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] [instance: e338d559-3f7c-4cc8-95c6-face79e11ca2] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:55:57.201629 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-683a157f-c665-443f-ab17-29b58436ba31 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:57.207894 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-683a157f-c665-443f-ab17-29b58436ba31 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:57.214292 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-683a157f-c665-443f-ab17-29b58436ba31 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:57.217614 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-683a157f-c665-443f-ab17-29b58436ba31 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:57.221974 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-683a157f-c665-443f-ab17-29b58436ba31 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:57.223426 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-683a157f-c665-443f-ab17-29b58436ba31 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:57.695967 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-683a157f-c665-443f-ab17-29b58436ba31 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/e338d559-3f7c-4cc8-95c6-face79e11ca2" status: 200 len: 1813 microversion: 2.1 time: 0.552266 Oct 08 20:55:57.702491 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 593/1150] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:55:57 2022] GET /compute/v2.1/servers/e338d559-3f7c-4cc8-95c6-face79e11ca2 => generated 1813 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 20:55:57.721624 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-71919192-a726-4c26-ab76-698664242477 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:57.722930 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-71919192-a726-4c26-ab76-698664242477 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] [instance: 92e31b92-0af1-4da6-bc87-23978f1aedf5] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:55:57.731261 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-71919192-a726-4c26-ab76-698664242477 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:57.736002 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-71919192-a726-4c26-ab76-698664242477 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:57.738128 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-71919192-a726-4c26-ab76-698664242477 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:57.739328 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-71919192-a726-4c26-ab76-698664242477 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:57.743151 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-71919192-a726-4c26-ab76-698664242477 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:57.743779 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-71919192-a726-4c26-ab76-698664242477 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:57.971533 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-71919192-a726-4c26-ab76-698664242477 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:57.989622 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-71919192-a726-4c26-ab76-698664242477 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:57.996415 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-71919192-a726-4c26-ab76-698664242477 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:58.011044 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-71919192-a726-4c26-ab76-698664242477 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] 10.222.0.26 "GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5" status: 200 len: 1555 microversion: 2.91 time: 0.300949 Oct 08 20:55:58.014822 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 594/1151] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:55:57 2022] GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5 => generated 1555 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:55:58.021876 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-5cc070be-1a65-4047-989e-dcf6e432558a tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:58.035416 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5cc070be-1a65-4047-989e-dcf6e432558a tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:58.041882 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5cc070be-1a65-4047-989e-dcf6e432558a tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:58.042594 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5cc070be-1a65-4047-989e-dcf6e432558a tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:58.043987 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5cc070be-1a65-4047-989e-dcf6e432558a tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:58.044632 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5cc070be-1a65-4047-989e-dcf6e432558a tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:58.045270 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5cc070be-1a65-4047-989e-dcf6e432558a tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:58.099298 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-5cc070be-1a65-4047-989e-dcf6e432558a tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.083204 Oct 08 20:55:58.108338 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 595/1152] 10.222.0.26 () {58 vars in 1176 bytes} [Sat Oct 8 20:55:58 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:55:58.808127 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-a3a9717e-c7a2-4003-a7d5-78838521aa2f tempest-HostsAdminNegativeTestJSON-1838421184 tempest-HostsAdminNegativeTestJSON-1838421184-project-admin] Calling method '.version_select at 0x7f1a8c7c73a0>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:58.846357 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a3a9717e-c7a2-4003-a7d5-78838521aa2f tempest-HostsAdminNegativeTestJSON-1838421184 tempest-HostsAdminNegativeTestJSON-1838421184-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:58.846357 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a3a9717e-c7a2-4003-a7d5-78838521aa2f tempest-HostsAdminNegativeTestJSON-1838421184 tempest-HostsAdminNegativeTestJSON-1838421184-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:58.846357 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a3a9717e-c7a2-4003-a7d5-78838521aa2f tempest-HostsAdminNegativeTestJSON-1838421184 tempest-HostsAdminNegativeTestJSON-1838421184-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:58.846357 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a3a9717e-c7a2-4003-a7d5-78838521aa2f tempest-HostsAdminNegativeTestJSON-1838421184 tempest-HostsAdminNegativeTestJSON-1838421184-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:58.846357 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a3a9717e-c7a2-4003-a7d5-78838521aa2f tempest-HostsAdminNegativeTestJSON-1838421184 tempest-HostsAdminNegativeTestJSON-1838421184-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:58.846357 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a3a9717e-c7a2-4003-a7d5-78838521aa2f tempest-HostsAdminNegativeTestJSON-1838421184 tempest-HostsAdminNegativeTestJSON-1838421184-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:58.852103 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-a3a9717e-c7a2-4003-a7d5-78838521aa2f tempest-HostsAdminNegativeTestJSON-1838421184 tempest-HostsAdminNegativeTestJSON-1838421184-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hosts" status: 200 len: 379 microversion: 2.1 time: 0.503864 Oct 08 20:55:58.852800 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 596/1153] 10.222.0.26 () {58 vars in 1128 bytes} [Sat Oct 8 20:55:58 2022] GET /compute/v2.1/os-hosts => generated 379 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:55:59.218510 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-b181d5f8-7e0e-4f60-a9ae-631fd30e361d tempest-HostsAdminNegativeTestJSON-1470877698 tempest-HostsAdminNegativeTestJSON-1470877698-project] Calling method '.version_select at 0x7f1a8cacf9d0>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:59.223137 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-b181d5f8-7e0e-4f60-a9ae-631fd30e361d tempest-HostsAdminNegativeTestJSON-1470877698 tempest-HostsAdminNegativeTestJSON-1470877698-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': '0842c774f38f47d096bc1c3691691751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fd0249867ab4ad6b1e9a0388c9e25be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:59.238866 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-b181d5f8-7e0e-4f60-a9ae-631fd30e361d tempest-HostsAdminNegativeTestJSON-1470877698 tempest-HostsAdminNegativeTestJSON-1470877698-project] Request method failure captured: Oct 08 20:55:59.238866 ncdv-master-1 devstack@n-api.service[140492]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Oct 08 20:55:59.238866 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 20:55:59.238866 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 20:55:59.238866 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 20:55:59.238866 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 20:55:59.238866 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 20:55:59.238866 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 20:55:59.238866 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 20:55:59.238866 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 20:55:59.238866 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQePdiVRaFxferXkBOBc7fT19oU4sV-gQv-uEQJShhMq38Sm15KDEZ6Swk9k4BZo3hGiYCrXK0iSS7J17dvxD7QbE2riPLH8RC4qgEvDlUekIQKhbUD3JhMyVCmsV6s92772R5L3KGDCUFGVFI4Xf4cYbaMiiKhhTAnuRBepmGW_H-X4 Oct 08 20:55:59.238866 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 20:55:59.238866 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 20:55:59.238866 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 20:55:59.238866 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 20:55:59.238866 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 20:55:59.238866 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 20:55:59.238866 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 1fd0249867ab4ad6b1e9a0388c9e25be Oct 08 20:55:59.238866 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1470877698 Oct 08 20:55:59.238866 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 20:55:59.238866 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 20:55:59.238866 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1fd0249867ab4ad6b1e9a0388c9e25be"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1fd0249867ab4ad6b1e9a0388c9e25be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1fd0249867ab4ad6b1e9a0388c9e25be"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1fd0249867ab4ad6b1e9a0388c9e25be"}]}] Oct 08 20:55:59.238866 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1470877698 Oct 08 20:55:59.238866 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 1fd0249867ab4ad6b1e9a0388c9e25be Oct 08 20:55:59.238866 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1470877698 Oct 08 20:55:59.238866 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-HostsAdminNegativeTestJSON-1470877698-project Oct 08 20:55:59.238866 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 20:55:59.238866 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 20:55:59.238866 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 0842c774f38f47d096bc1c3691691751 Oct 08 20:55:59.238866 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1470877698-project Oct 08 20:55:59.238866 ncdv-master-1 devstack@n-api.service[140492]: method: Oct 08 20:55:59.238866 ncdv-master-1 devstack@n-api.service[140492]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 08 20:55:59.238866 ncdv-master-1 devstack@n-api.service[140492]: action_args: {} Oct 08 20:55:59.238866 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:55:59.238866 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:55:59.238866 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:55:59.238866 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:55:59.238866 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:55:59.238866 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:55:59.238866 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 08 20:55:59.238866 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 08 20:55:59.238866 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 08 20:55:59.238866 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 20:55:59.238866 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:55:59.238866 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:55:59.238866 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Oct 08 20:55:59.238866 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Oct 08 20:55:59.238866 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 08 20:55:59.238866 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 08 20:55:59.238866 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 08 20:55:59.238866 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 08 20:55:59.238866 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 08 20:55:59.238866 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 08 20:55:59.238866 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 08 20:55:59.238866 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise self.value Oct 08 20:55:59.238866 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 08 20:55:59.238866 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 08 20:55:59.238866 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 08 20:55:59.238866 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 08 20:55:59.238866 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 08 20:55:59.238866 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 08 20:55:59.238866 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 08 20:55:59.238866 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:55:59.238866 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:55:59.238866 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:55:59.244800 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:55:59.244800 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:55:59.244800 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:55:59.244800 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 08 20:55:59.244800 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 08 20:55:59.244800 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 08 20:55:59.244800 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:55:59.244800 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-b181d5f8-7e0e-4f60-a9ae-631fd30e361d tempest-HostsAdminNegativeTestJSON-1470877698 tempest-HostsAdminNegativeTestJSON-1470877698-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:55:59.248265 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-b181d5f8-7e0e-4f60-a9ae-631fd30e361d tempest-HostsAdminNegativeTestJSON-1470877698 tempest-HostsAdminNegativeTestJSON-1470877698-project] 10.222.0.26 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.375563 Oct 08 20:55:59.250756 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 597/1154] 10.222.0.26 () {58 vars in 1128 bytes} [Sat Oct 8 20:55:58 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 387 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 08 20:55:59.279420 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-1daccbd2-3348-464c-8f2f-9f53f65d47c8 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:59.282002 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-1daccbd2-3348-464c-8f2f-9f53f65d47c8 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] [instance: 92e31b92-0af1-4da6-bc87-23978f1aedf5] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:55:59.298414 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1daccbd2-3348-464c-8f2f-9f53f65d47c8 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:59.299483 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1daccbd2-3348-464c-8f2f-9f53f65d47c8 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:59.300170 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1daccbd2-3348-464c-8f2f-9f53f65d47c8 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:59.302171 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1daccbd2-3348-464c-8f2f-9f53f65d47c8 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:55:59.302889 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1daccbd2-3348-464c-8f2f-9f53f65d47c8 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:55:59.303637 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1daccbd2-3348-464c-8f2f-9f53f65d47c8 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:55:59.451545 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=42 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:55:59.513641 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:SELECT=19 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:55:59.539638 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-1daccbd2-3348-464c-8f2f-9f53f65d47c8 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:59.549145 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-1daccbd2-3348-464c-8f2f-9f53f65d47c8 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:59.550628 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-1daccbd2-3348-464c-8f2f-9f53f65d47c8 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:59.574656 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-1daccbd2-3348-464c-8f2f-9f53f65d47c8 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] 10.222.0.26 "GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5" status: 200 len: 1555 microversion: 2.91 time: 0.322594 Oct 08 20:55:59.582953 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 598/1155] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:55:59 2022] GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5 => generated 1555 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:55:59.590141 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-766342a2-05b1-4631-8ffd-d8a34e4523d4 tempest-HostsAdminNegativeTestJSON-1470877698 tempest-HostsAdminNegativeTestJSON-1470877698-project] Calling method '.version_select at 0x7f1a8ca95ca0>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:59.606082 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-766342a2-05b1-4631-8ffd-d8a34e4523d4 tempest-HostsAdminNegativeTestJSON-1470877698 tempest-HostsAdminNegativeTestJSON-1470877698-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': '0842c774f38f47d096bc1c3691691751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fd0249867ab4ad6b1e9a0388c9e25be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:59.608044 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-766342a2-05b1-4631-8ffd-d8a34e4523d4 tempest-HostsAdminNegativeTestJSON-1470877698 tempest-HostsAdminNegativeTestJSON-1470877698-project] Request method failure captured: Oct 08 20:55:59.608044 ncdv-master-1 devstack@n-api.service[140492]: request: GET /compute/v2.1/os-hosts/ncdv-master-1/reboot HTTP/1.1 Oct 08 20:55:59.608044 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 20:55:59.608044 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 20:55:59.608044 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 20:55:59.608044 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 20:55:59.608044 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 20:55:59.608044 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 20:55:59.608044 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 20:55:59.608044 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 20:55:59.608044 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQePdiVRaFxferXkBOBc7fT19oU4sV-gQv-uEQJShhMq38Sm15KDEZ6Swk9k4BZo3hGiYCrXK0iSS7J17dvxD7QbE2riPLH8RC4qgEvDlUekIQKhbUD3JhMyVCmsV6s92772R5L3KGDCUFGVFI4Xf4cYbaMiiKhhTAnuRBepmGW_H-X4 Oct 08 20:55:59.608044 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 20:55:59.608044 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 20:55:59.608044 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 20:55:59.608044 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 20:55:59.608044 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 20:55:59.608044 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 20:55:59.608044 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 1fd0249867ab4ad6b1e9a0388c9e25be Oct 08 20:55:59.608044 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1470877698 Oct 08 20:55:59.608044 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 20:55:59.608044 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 20:55:59.608044 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1fd0249867ab4ad6b1e9a0388c9e25be"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1fd0249867ab4ad6b1e9a0388c9e25be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1fd0249867ab4ad6b1e9a0388c9e25be"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1fd0249867ab4ad6b1e9a0388c9e25be"}]}] Oct 08 20:55:59.608044 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1470877698 Oct 08 20:55:59.608044 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 1fd0249867ab4ad6b1e9a0388c9e25be Oct 08 20:55:59.608044 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1470877698 Oct 08 20:55:59.608044 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-HostsAdminNegativeTestJSON-1470877698-project Oct 08 20:55:59.608044 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 20:55:59.608044 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 20:55:59.608044 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 0842c774f38f47d096bc1c3691691751 Oct 08 20:55:59.608044 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1470877698-project Oct 08 20:55:59.608044 ncdv-master-1 devstack@n-api.service[140492]: method: Oct 08 20:55:59.608044 ncdv-master-1 devstack@n-api.service[140492]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 08 20:55:59.608044 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': 'ncdv-master-1'} Oct 08 20:55:59.608044 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:55:59.608044 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:55:59.608044 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:55:59.608044 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:55:59.608044 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:55:59.608044 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:55:59.608044 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 08 20:55:59.608044 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 08 20:55:59.608044 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:55:59.608044 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:55:59.608044 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Oct 08 20:55:59.608044 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Oct 08 20:55:59.608044 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 08 20:55:59.608044 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 08 20:55:59.608044 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 08 20:55:59.608044 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 08 20:55:59.608044 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 08 20:55:59.608044 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 08 20:55:59.608044 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 08 20:55:59.608044 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise self.value Oct 08 20:55:59.608044 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 08 20:55:59.608044 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 08 20:55:59.608044 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 08 20:55:59.608044 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 08 20:55:59.608044 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 08 20:55:59.608044 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 08 20:55:59.608044 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 08 20:55:59.608044 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:55:59.608044 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:55:59.608044 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:55:59.608044 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:55:59.611971 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:55:59.611971 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:55:59.611971 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 08 20:55:59.611971 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 08 20:55:59.611971 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 08 20:55:59.611971 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:55:59.619034 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-766342a2-05b1-4631-8ffd-d8a34e4523d4 tempest-HostsAdminNegativeTestJSON-1470877698 tempest-HostsAdminNegativeTestJSON-1470877698-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:55:59.620246 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-766342a2-05b1-4631-8ffd-d8a34e4523d4 tempest-HostsAdminNegativeTestJSON-1470877698 tempest-HostsAdminNegativeTestJSON-1470877698-project] 10.222.0.26 "GET /compute/v2.1/os-hosts/ncdv-master-1/reboot" status: 403 len: 111 microversion: 2.1 time: 0.034233 Oct 08 20:55:59.621408 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 599/1156] 10.222.0.26 () {58 vars in 1191 bytes} [Sat Oct 8 20:55:59 2022] GET /compute/v2.1/os-hosts/ncdv-master-1/reboot => generated 111 bytes in 36 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 08 20:55:59.630166 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-014b2e55-050f-4345-93ef-294e58d9de61 tempest-HostsAdminNegativeTestJSON-1838421184 tempest-HostsAdminNegativeTestJSON-1838421184-project-admin] Calling method '.version_select at 0x7f1a8c8eaaf0>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:59.669322 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-014b2e55-050f-4345-93ef-294e58d9de61 tempest-HostsAdminNegativeTestJSON-1838421184 tempest-HostsAdminNegativeTestJSON-1838421184-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 08 20:55:59.671098 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-014b2e55-050f-4345-93ef-294e58d9de61 tempest-HostsAdminNegativeTestJSON-1838421184 tempest-HostsAdminNegativeTestJSON-1838421184-project-admin] Request method failure captured: Oct 08 20:55:59.671098 ncdv-master-1 devstack@n-api.service[140492]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Oct 08 20:55:59.671098 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 20:55:59.671098 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 20:55:59.671098 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 20:55:59.671098 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 20:55:59.671098 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 20:55:59.671098 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 20:55:59.671098 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 20:55:59.671098 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 20:55:59.671098 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQePe-r1sbbgkZCtTvCWRxlMifVXYgZjpBZlclXVD0Webm3YxfkXqanLXXnIAb1wFJJBQ3Y3IPO0bFme0CwfPcFjILoB-z4GD9Cr23fg0lxnYdOKTB4sozcUSvFtUWWUeH59WsmOla3nOaL8R5s3aKv11dFxrPcuI5YS7casgTs1F3J4 Oct 08 20:55:59.671098 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 20:55:59.671098 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 20:55:59.671098 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 20:55:59.671098 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 20:55:59.671098 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 20:55:59.671098 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 20:55:59.671098 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: e22f10ad8b4140c0a1ebd06c8a14899b Oct 08 20:55:59.671098 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1838421184 Oct 08 20:55:59.671098 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,admin,member Oct 08 20:55:59.671098 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,admin,member Oct 08 20:55:59.671098 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/e22f10ad8b4140c0a1ebd06c8a14899b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e22f10ad8b4140c0a1ebd06c8a14899b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_e22f10ad8b4140c0a1ebd06c8a14899b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e22f10ad8b4140c0a1ebd06c8a14899b"}]}] Oct 08 20:55:59.671098 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1838421184 Oct 08 20:55:59.671098 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: e22f10ad8b4140c0a1ebd06c8a14899b Oct 08 20:55:59.671098 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1838421184 Oct 08 20:55:59.671098 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-HostsAdminNegativeTestJSON-1838421184-project-admin Oct 08 20:55:59.671098 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 20:55:59.671098 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 20:55:59.671098 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: fce8e310cf0247be8e319b6823a64f6c Oct 08 20:55:59.671098 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1838421184-project-admin Oct 08 20:55:59.671098 ncdv-master-1 devstack@n-api.service[140492]: method: Oct 08 20:55:59.671098 ncdv-master-1 devstack@n-api.service[140492]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 08 20:55:59.671098 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': 'nonexistent_hostname'} Oct 08 20:55:59.671098 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:55:59.671098 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:55:59.671098 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 08 20:55:59.671098 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 08 20:55:59.671098 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 08 20:55:59.671098 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 08 20:55:59.671098 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 08 20:55:59.671098 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 08 20:55:59.671098 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 08 20:55:59.671098 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise self.value Oct 08 20:55:59.671098 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 08 20:55:59.671098 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 08 20:55:59.671098 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 08 20:55:59.671098 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 08 20:55:59.671098 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 08 20:55:59.671098 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 08 20:55:59.671098 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 08 20:55:59.671098 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 08 20:55:59.671098 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 08 20:55:59.671098 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 08 20:55:59.671098 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 08 20:55:59.671098 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 08 20:55:59.671098 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 08 20:55:59.671098 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:55:59.671098 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:55:59.671098 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:55:59.671098 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:55:59.671098 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:55:59.671098 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:55:59.671098 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:55:59.675703 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:55:59.675703 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 08 20:55:59.675703 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 08 20:55:59.675703 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:55:59.675703 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:55:59.675703 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Oct 08 20:55:59.675703 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Oct 08 20:55:59.675703 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 08 20:55:59.675703 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 08 20:55:59.675703 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 08 20:55:59.675703 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:55:59.675703 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:55:59.675703 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:55:59.675703 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:55:59.675703 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:55:59.675703 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:55:59.675703 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 20:55:59.675703 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 20:55:59.675703 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 08 20:55:59.675703 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:55:59.675703 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-014b2e55-050f-4345-93ef-294e58d9de61 tempest-HostsAdminNegativeTestJSON-1838421184 tempest-HostsAdminNegativeTestJSON-1838421184-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:55:59.675703 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-014b2e55-050f-4345-93ef-294e58d9de61 tempest-HostsAdminNegativeTestJSON-1838421184 tempest-HostsAdminNegativeTestJSON-1838421184-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.046024 Oct 08 20:55:59.681395 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 600/1157] 10.222.0.26 () {58 vars in 1212 bytes} [Sat Oct 8 20:55:59 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 08 20:55:59.698396 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e76c3e73-cb23-42d9-9889-054c19a46868 tempest-HostsAdminNegativeTestJSON-1470877698 tempest-HostsAdminNegativeTestJSON-1470877698-project] Calling method '.version_select at 0x7f1a8c8ea790>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:59.701902 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-e76c3e73-cb23-42d9-9889-054c19a46868 tempest-HostsAdminNegativeTestJSON-1470877698 tempest-HostsAdminNegativeTestJSON-1470877698-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': '0842c774f38f47d096bc1c3691691751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fd0249867ab4ad6b1e9a0388c9e25be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:59.710726 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e76c3e73-cb23-42d9-9889-054c19a46868 tempest-HostsAdminNegativeTestJSON-1470877698 tempest-HostsAdminNegativeTestJSON-1470877698-project] Request method failure captured: Oct 08 20:55:59.710726 ncdv-master-1 devstack@n-api.service[140492]: request: GET /compute/v2.1/os-hosts/ncdv-master-1 HTTP/1.1 Oct 08 20:55:59.710726 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 20:55:59.710726 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 20:55:59.710726 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 20:55:59.710726 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 20:55:59.710726 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 20:55:59.710726 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 20:55:59.710726 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 20:55:59.710726 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 20:55:59.710726 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQePdiVRaFxferXkBOBc7fT19oU4sV-gQv-uEQJShhMq38Sm15KDEZ6Swk9k4BZo3hGiYCrXK0iSS7J17dvxD7QbE2riPLH8RC4qgEvDlUekIQKhbUD3JhMyVCmsV6s92772R5L3KGDCUFGVFI4Xf4cYbaMiiKhhTAnuRBepmGW_H-X4 Oct 08 20:55:59.710726 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 20:55:59.710726 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 20:55:59.710726 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 20:55:59.710726 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 20:55:59.710726 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 20:55:59.710726 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 20:55:59.710726 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 1fd0249867ab4ad6b1e9a0388c9e25be Oct 08 20:55:59.710726 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1470877698 Oct 08 20:55:59.710726 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 20:55:59.710726 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 20:55:59.710726 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1fd0249867ab4ad6b1e9a0388c9e25be"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1fd0249867ab4ad6b1e9a0388c9e25be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1fd0249867ab4ad6b1e9a0388c9e25be"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1fd0249867ab4ad6b1e9a0388c9e25be"}]}] Oct 08 20:55:59.710726 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1470877698 Oct 08 20:55:59.710726 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 1fd0249867ab4ad6b1e9a0388c9e25be Oct 08 20:55:59.710726 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1470877698 Oct 08 20:55:59.710726 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-HostsAdminNegativeTestJSON-1470877698-project Oct 08 20:55:59.710726 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 20:55:59.710726 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 20:55:59.710726 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 0842c774f38f47d096bc1c3691691751 Oct 08 20:55:59.710726 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1470877698-project Oct 08 20:55:59.710726 ncdv-master-1 devstack@n-api.service[140492]: method: Oct 08 20:55:59.710726 ncdv-master-1 devstack@n-api.service[140492]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 08 20:55:59.710726 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': 'ncdv-master-1'} Oct 08 20:55:59.710726 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:55:59.710726 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:55:59.710726 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:55:59.710726 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:55:59.710726 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:55:59.710726 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:55:59.710726 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 08 20:55:59.710726 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 08 20:55:59.710726 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:55:59.710726 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:55:59.710726 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Oct 08 20:55:59.710726 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Oct 08 20:55:59.710726 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 08 20:55:59.710726 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 08 20:55:59.710726 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 08 20:55:59.710726 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 08 20:55:59.710726 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 08 20:55:59.710726 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 08 20:55:59.710726 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 08 20:55:59.710726 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise self.value Oct 08 20:55:59.710726 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 08 20:55:59.710726 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 08 20:55:59.710726 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 08 20:55:59.710726 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 08 20:55:59.710726 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 08 20:55:59.710726 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 08 20:55:59.710726 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 08 20:55:59.710726 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:55:59.710726 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:55:59.710726 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:55:59.710726 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:55:59.714941 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:55:59.714941 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:55:59.714941 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 08 20:55:59.714941 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 08 20:55:59.714941 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 08 20:55:59.714941 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:55:59.718184 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e76c3e73-cb23-42d9-9889-054c19a46868 tempest-HostsAdminNegativeTestJSON-1470877698 tempest-HostsAdminNegativeTestJSON-1470877698-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:55:59.722371 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-e76c3e73-cb23-42d9-9889-054c19a46868 tempest-HostsAdminNegativeTestJSON-1470877698 tempest-HostsAdminNegativeTestJSON-1470877698-project] 10.222.0.26 "GET /compute/v2.1/os-hosts/ncdv-master-1" status: 403 len: 109 microversion: 2.1 time: 0.037866 Oct 08 20:55:59.725300 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 601/1158] 10.222.0.26 () {58 vars in 1170 bytes} [Sat Oct 8 20:55:59 2022] GET /compute/v2.1/os-hosts/ncdv-master-1 => generated 109 bytes in 43 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 08 20:55:59.757031 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-f718a1b9-0e00-4a9c-a02b-24c55712d55d tempest-HostsAdminNegativeTestJSON-1838421184 tempest-HostsAdminNegativeTestJSON-1838421184-project-admin] Calling method '.version_select at 0x7f1a8c907280>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:59.777495 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-f718a1b9-0e00-4a9c-a02b-24c55712d55d tempest-HostsAdminNegativeTestJSON-1838421184 tempest-HostsAdminNegativeTestJSON-1838421184-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 08 20:55:59.779738 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-f718a1b9-0e00-4a9c-a02b-24c55712d55d tempest-HostsAdminNegativeTestJSON-1838421184 tempest-HostsAdminNegativeTestJSON-1838421184-project-admin] Request method failure captured: Oct 08 20:55:59.779738 ncdv-master-1 devstack@n-api.service[140492]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Oct 08 20:55:59.779738 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 20:55:59.779738 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 20:55:59.779738 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 20:55:59.779738 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 20:55:59.779738 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 20:55:59.779738 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 20:55:59.779738 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 20:55:59.779738 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 20:55:59.779738 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQePe-r1sbbgkZCtTvCWRxlMifVXYgZjpBZlclXVD0Webm3YxfkXqanLXXnIAb1wFJJBQ3Y3IPO0bFme0CwfPcFjILoB-z4GD9Cr23fg0lxnYdOKTB4sozcUSvFtUWWUeH59WsmOla3nOaL8R5s3aKv11dFxrPcuI5YS7casgTs1F3J4 Oct 08 20:55:59.779738 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 20:55:59.779738 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 20:55:59.779738 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 20:55:59.779738 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 20:55:59.779738 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 20:55:59.779738 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 20:55:59.779738 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: e22f10ad8b4140c0a1ebd06c8a14899b Oct 08 20:55:59.779738 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1838421184 Oct 08 20:55:59.779738 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,admin,member Oct 08 20:55:59.779738 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,admin,member Oct 08 20:55:59.779738 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/e22f10ad8b4140c0a1ebd06c8a14899b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e22f10ad8b4140c0a1ebd06c8a14899b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_e22f10ad8b4140c0a1ebd06c8a14899b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e22f10ad8b4140c0a1ebd06c8a14899b"}]}] Oct 08 20:55:59.779738 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1838421184 Oct 08 20:55:59.779738 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: e22f10ad8b4140c0a1ebd06c8a14899b Oct 08 20:55:59.779738 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1838421184 Oct 08 20:55:59.779738 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-HostsAdminNegativeTestJSON-1838421184-project-admin Oct 08 20:55:59.779738 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 20:55:59.779738 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 20:55:59.779738 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: fce8e310cf0247be8e319b6823a64f6c Oct 08 20:55:59.779738 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1838421184-project-admin Oct 08 20:55:59.779738 ncdv-master-1 devstack@n-api.service[140492]: method: Oct 08 20:55:59.779738 ncdv-master-1 devstack@n-api.service[140492]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 08 20:55:59.779738 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': 'nonexistent_hostname'} Oct 08 20:55:59.779738 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:55:59.779738 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:55:59.779738 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Oct 08 20:55:59.779738 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 08 20:55:59.779738 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 08 20:55:59.779738 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 08 20:55:59.779738 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 08 20:55:59.779738 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 08 20:55:59.779738 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 08 20:55:59.779738 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 08 20:55:59.779738 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 08 20:55:59.779738 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 08 20:55:59.779738 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 08 20:55:59.779738 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:55:59.779738 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:55:59.779738 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:55:59.779738 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:55:59.779738 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:55:59.779738 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:55:59.779738 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:55:59.779738 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:55:59.779738 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 08 20:55:59.779738 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 08 20:55:59.779738 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:55:59.779738 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:55:59.779738 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Oct 08 20:55:59.779738 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 08 20:55:59.779738 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 08 20:55:59.779738 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:55:59.779738 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:55:59.779738 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:55:59.785697 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:55:59.785697 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:55:59.785697 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:55:59.785697 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 20:55:59.785697 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 20:55:59.785697 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 08 20:55:59.785697 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:55:59.785697 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-f718a1b9-0e00-4a9c-a02b-24c55712d55d tempest-HostsAdminNegativeTestJSON-1838421184 tempest-HostsAdminNegativeTestJSON-1838421184-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:55:59.785697 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-f718a1b9-0e00-4a9c-a02b-24c55712d55d tempest-HostsAdminNegativeTestJSON-1838421184 tempest-HostsAdminNegativeTestJSON-1838421184-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.049460 Oct 08 20:55:59.787869 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 602/1159] 10.222.0.26 () {58 vars in 1191 bytes} [Sat Oct 8 20:55:59 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 08 20:55:59.798223 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-4989ac18-4255-4617-895d-964e5799eca5 tempest-HostsAdminNegativeTestJSON-1470877698 tempest-HostsAdminNegativeTestJSON-1470877698-project] Calling method '.version_select at 0x7f1a8cacf280>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:59.800942 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-4989ac18-4255-4617-895d-964e5799eca5 tempest-HostsAdminNegativeTestJSON-1470877698 tempest-HostsAdminNegativeTestJSON-1470877698-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': '0842c774f38f47d096bc1c3691691751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fd0249867ab4ad6b1e9a0388c9e25be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:59.803206 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-4989ac18-4255-4617-895d-964e5799eca5 tempest-HostsAdminNegativeTestJSON-1470877698 tempest-HostsAdminNegativeTestJSON-1470877698-project] Request method failure captured: Oct 08 20:55:59.803206 ncdv-master-1 devstack@n-api.service[140492]: request: GET /compute/v2.1/os-hosts/ncdv-master-1/shutdown HTTP/1.1 Oct 08 20:55:59.803206 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 20:55:59.803206 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 20:55:59.803206 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 20:55:59.803206 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 20:55:59.803206 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 20:55:59.803206 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 20:55:59.803206 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 20:55:59.803206 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 20:55:59.803206 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQePdiVRaFxferXkBOBc7fT19oU4sV-gQv-uEQJShhMq38Sm15KDEZ6Swk9k4BZo3hGiYCrXK0iSS7J17dvxD7QbE2riPLH8RC4qgEvDlUekIQKhbUD3JhMyVCmsV6s92772R5L3KGDCUFGVFI4Xf4cYbaMiiKhhTAnuRBepmGW_H-X4 Oct 08 20:55:59.803206 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 20:55:59.803206 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 20:55:59.803206 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 20:55:59.803206 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 20:55:59.803206 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 20:55:59.803206 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 20:55:59.803206 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 1fd0249867ab4ad6b1e9a0388c9e25be Oct 08 20:55:59.803206 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1470877698 Oct 08 20:55:59.803206 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 20:55:59.803206 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 20:55:59.803206 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1fd0249867ab4ad6b1e9a0388c9e25be"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1fd0249867ab4ad6b1e9a0388c9e25be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1fd0249867ab4ad6b1e9a0388c9e25be"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1fd0249867ab4ad6b1e9a0388c9e25be"}]}] Oct 08 20:55:59.803206 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1470877698 Oct 08 20:55:59.803206 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 1fd0249867ab4ad6b1e9a0388c9e25be Oct 08 20:55:59.803206 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1470877698 Oct 08 20:55:59.803206 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-HostsAdminNegativeTestJSON-1470877698-project Oct 08 20:55:59.803206 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 20:55:59.803206 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 20:55:59.803206 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 0842c774f38f47d096bc1c3691691751 Oct 08 20:55:59.803206 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1470877698-project Oct 08 20:55:59.803206 ncdv-master-1 devstack@n-api.service[140492]: method: Oct 08 20:55:59.803206 ncdv-master-1 devstack@n-api.service[140492]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 08 20:55:59.803206 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': 'ncdv-master-1'} Oct 08 20:55:59.803206 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:55:59.803206 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:55:59.803206 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:55:59.803206 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:55:59.803206 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:55:59.803206 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:55:59.803206 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 08 20:55:59.803206 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 08 20:55:59.803206 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:55:59.803206 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:55:59.803206 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Oct 08 20:55:59.803206 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Oct 08 20:55:59.803206 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 08 20:55:59.803206 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 08 20:55:59.803206 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 08 20:55:59.803206 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 08 20:55:59.803206 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 08 20:55:59.803206 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 08 20:55:59.803206 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 08 20:55:59.803206 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise self.value Oct 08 20:55:59.803206 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 08 20:55:59.803206 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 08 20:55:59.803206 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 08 20:55:59.803206 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 08 20:55:59.803206 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 08 20:55:59.803206 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 08 20:55:59.803206 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 08 20:55:59.803206 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:55:59.803206 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:55:59.803206 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:55:59.803206 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:55:59.807892 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:55:59.807892 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:55:59.807892 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 08 20:55:59.807892 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 08 20:55:59.807892 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 08 20:55:59.807892 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:55:59.807892 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-4989ac18-4255-4617-895d-964e5799eca5 tempest-HostsAdminNegativeTestJSON-1470877698 tempest-HostsAdminNegativeTestJSON-1470877698-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:55:59.807892 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-4989ac18-4255-4617-895d-964e5799eca5 tempest-HostsAdminNegativeTestJSON-1470877698 tempest-HostsAdminNegativeTestJSON-1470877698-project] 10.222.0.26 "GET /compute/v2.1/os-hosts/ncdv-master-1/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.015600 Oct 08 20:55:59.807892 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 603/1160] 10.222.0.26 () {58 vars in 1197 bytes} [Sat Oct 8 20:55:59 2022] GET /compute/v2.1/os-hosts/ncdv-master-1/shutdown => generated 113 bytes in 17 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 08 20:55:59.820462 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-009cb7fa-d5ae-41f0-90a0-2e26008c7303 tempest-HostsAdminNegativeTestJSON-1838421184 tempest-HostsAdminNegativeTestJSON-1838421184-project-admin] Calling method '.version_select at 0x7f1a8cacf280>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:59.835201 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-009cb7fa-d5ae-41f0-90a0-2e26008c7303 tempest-HostsAdminNegativeTestJSON-1838421184 tempest-HostsAdminNegativeTestJSON-1838421184-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 08 20:55:59.837038 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-009cb7fa-d5ae-41f0-90a0-2e26008c7303 tempest-HostsAdminNegativeTestJSON-1838421184 tempest-HostsAdminNegativeTestJSON-1838421184-project-admin] Request method failure captured: Oct 08 20:55:59.837038 ncdv-master-1 devstack@n-api.service[140492]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Oct 08 20:55:59.837038 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 20:55:59.837038 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 20:55:59.837038 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 20:55:59.837038 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 20:55:59.837038 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 20:55:59.837038 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 20:55:59.837038 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 20:55:59.837038 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 20:55:59.837038 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQePe-r1sbbgkZCtTvCWRxlMifVXYgZjpBZlclXVD0Webm3YxfkXqanLXXnIAb1wFJJBQ3Y3IPO0bFme0CwfPcFjILoB-z4GD9Cr23fg0lxnYdOKTB4sozcUSvFtUWWUeH59WsmOla3nOaL8R5s3aKv11dFxrPcuI5YS7casgTs1F3J4 Oct 08 20:55:59.837038 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 20:55:59.837038 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 20:55:59.837038 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 20:55:59.837038 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 20:55:59.837038 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 20:55:59.837038 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 20:55:59.837038 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: e22f10ad8b4140c0a1ebd06c8a14899b Oct 08 20:55:59.837038 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1838421184 Oct 08 20:55:59.837038 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,admin,member Oct 08 20:55:59.837038 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,admin,member Oct 08 20:55:59.837038 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/e22f10ad8b4140c0a1ebd06c8a14899b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e22f10ad8b4140c0a1ebd06c8a14899b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_e22f10ad8b4140c0a1ebd06c8a14899b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e22f10ad8b4140c0a1ebd06c8a14899b"}]}] Oct 08 20:55:59.837038 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1838421184 Oct 08 20:55:59.837038 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: e22f10ad8b4140c0a1ebd06c8a14899b Oct 08 20:55:59.837038 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1838421184 Oct 08 20:55:59.837038 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-HostsAdminNegativeTestJSON-1838421184-project-admin Oct 08 20:55:59.837038 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 20:55:59.837038 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 20:55:59.837038 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: fce8e310cf0247be8e319b6823a64f6c Oct 08 20:55:59.837038 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1838421184-project-admin Oct 08 20:55:59.837038 ncdv-master-1 devstack@n-api.service[140492]: method: Oct 08 20:55:59.837038 ncdv-master-1 devstack@n-api.service[140492]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 08 20:55:59.837038 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': 'nonexistent_hostname'} Oct 08 20:55:59.837038 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:55:59.837038 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:55:59.837038 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 08 20:55:59.837038 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 08 20:55:59.837038 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 08 20:55:59.837038 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 08 20:55:59.837038 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 08 20:55:59.837038 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 08 20:55:59.837038 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 08 20:55:59.837038 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise self.value Oct 08 20:55:59.837038 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 08 20:55:59.837038 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 08 20:55:59.837038 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 08 20:55:59.837038 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 08 20:55:59.837038 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 08 20:55:59.837038 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 08 20:55:59.837038 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 08 20:55:59.837038 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 08 20:55:59.837038 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 08 20:55:59.837038 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 08 20:55:59.837038 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 08 20:55:59.837038 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 08 20:55:59.837038 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 08 20:55:59.837038 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:55:59.837038 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:55:59.837038 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:55:59.837038 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:55:59.837038 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:55:59.837038 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:55:59.837038 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:55:59.841518 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:55:59.841518 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 08 20:55:59.841518 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 08 20:55:59.841518 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:55:59.841518 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:55:59.841518 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Oct 08 20:55:59.841518 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Oct 08 20:55:59.841518 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 08 20:55:59.841518 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 08 20:55:59.841518 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 08 20:55:59.841518 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:55:59.841518 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:55:59.841518 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:55:59.841518 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:55:59.841518 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:55:59.841518 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:55:59.841518 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 20:55:59.841518 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 20:55:59.841518 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 08 20:55:59.841518 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:55:59.841518 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-009cb7fa-d5ae-41f0-90a0-2e26008c7303 tempest-HostsAdminNegativeTestJSON-1838421184 tempest-HostsAdminNegativeTestJSON-1838421184-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:55:59.841518 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-009cb7fa-d5ae-41f0-90a0-2e26008c7303 tempest-HostsAdminNegativeTestJSON-1838421184 tempest-HostsAdminNegativeTestJSON-1838421184-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.024313 Oct 08 20:55:59.844711 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 604/1161] 10.222.0.26 () {58 vars in 1218 bytes} [Sat Oct 8 20:55:59 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 08 20:55:59.849831 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-cc306763-1e4e-4bf9-8784-7884f3056a74 tempest-HostsAdminNegativeTestJSON-1470877698 tempest-HostsAdminNegativeTestJSON-1470877698-project] Calling method '.version_select at 0x7f1a8c907280>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:59.851683 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-cc306763-1e4e-4bf9-8784-7884f3056a74 tempest-HostsAdminNegativeTestJSON-1470877698 tempest-HostsAdminNegativeTestJSON-1470877698-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': '0842c774f38f47d096bc1c3691691751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fd0249867ab4ad6b1e9a0388c9e25be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:59.853369 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-cc306763-1e4e-4bf9-8784-7884f3056a74 tempest-HostsAdminNegativeTestJSON-1470877698 tempest-HostsAdminNegativeTestJSON-1470877698-project] Request method failure captured: Oct 08 20:55:59.853369 ncdv-master-1 devstack@n-api.service[140492]: request: GET /compute/v2.1/os-hosts/ncdv-master-1/startup HTTP/1.1 Oct 08 20:55:59.853369 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 20:55:59.853369 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 20:55:59.853369 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 20:55:59.853369 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 20:55:59.853369 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 20:55:59.853369 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 20:55:59.853369 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 20:55:59.853369 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 20:55:59.853369 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQePdiVRaFxferXkBOBc7fT19oU4sV-gQv-uEQJShhMq38Sm15KDEZ6Swk9k4BZo3hGiYCrXK0iSS7J17dvxD7QbE2riPLH8RC4qgEvDlUekIQKhbUD3JhMyVCmsV6s92772R5L3KGDCUFGVFI4Xf4cYbaMiiKhhTAnuRBepmGW_H-X4 Oct 08 20:55:59.853369 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 20:55:59.853369 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 20:55:59.853369 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 20:55:59.853369 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 20:55:59.853369 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 20:55:59.853369 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 20:55:59.853369 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 1fd0249867ab4ad6b1e9a0388c9e25be Oct 08 20:55:59.853369 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1470877698 Oct 08 20:55:59.853369 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 20:55:59.853369 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 20:55:59.853369 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1fd0249867ab4ad6b1e9a0388c9e25be"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1fd0249867ab4ad6b1e9a0388c9e25be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1fd0249867ab4ad6b1e9a0388c9e25be"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1fd0249867ab4ad6b1e9a0388c9e25be"}]}] Oct 08 20:55:59.853369 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1470877698 Oct 08 20:55:59.853369 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 1fd0249867ab4ad6b1e9a0388c9e25be Oct 08 20:55:59.853369 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1470877698 Oct 08 20:55:59.853369 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-HostsAdminNegativeTestJSON-1470877698-project Oct 08 20:55:59.853369 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 20:55:59.853369 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 20:55:59.853369 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 0842c774f38f47d096bc1c3691691751 Oct 08 20:55:59.853369 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1470877698-project Oct 08 20:55:59.853369 ncdv-master-1 devstack@n-api.service[140492]: method: Oct 08 20:55:59.853369 ncdv-master-1 devstack@n-api.service[140492]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 08 20:55:59.853369 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': 'ncdv-master-1'} Oct 08 20:55:59.853369 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:55:59.853369 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:55:59.853369 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:55:59.853369 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:55:59.853369 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:55:59.853369 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:55:59.853369 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 08 20:55:59.853369 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 08 20:55:59.853369 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:55:59.853369 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:55:59.853369 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Oct 08 20:55:59.853369 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Oct 08 20:55:59.853369 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 08 20:55:59.853369 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 08 20:55:59.853369 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 08 20:55:59.853369 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 08 20:55:59.853369 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 08 20:55:59.853369 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 08 20:55:59.853369 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 08 20:55:59.853369 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise self.value Oct 08 20:55:59.853369 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 08 20:55:59.853369 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 08 20:55:59.853369 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 08 20:55:59.853369 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 08 20:55:59.853369 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 08 20:55:59.853369 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 08 20:55:59.853369 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 08 20:55:59.853369 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:55:59.853369 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:55:59.853369 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:55:59.853369 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:55:59.857850 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:55:59.857850 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:55:59.857850 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 08 20:55:59.857850 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 08 20:55:59.857850 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 08 20:55:59.857850 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:55:59.857850 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-cc306763-1e4e-4bf9-8784-7884f3056a74 tempest-HostsAdminNegativeTestJSON-1470877698 tempest-HostsAdminNegativeTestJSON-1470877698-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:55:59.857850 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-cc306763-1e4e-4bf9-8784-7884f3056a74 tempest-HostsAdminNegativeTestJSON-1470877698 tempest-HostsAdminNegativeTestJSON-1470877698-project] 10.222.0.26 "GET /compute/v2.1/os-hosts/ncdv-master-1/startup" status: 403 len: 110 microversion: 2.1 time: 0.010377 Oct 08 20:55:59.861571 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 605/1162] 10.222.0.26 () {58 vars in 1194 bytes} [Sat Oct 8 20:55:59 2022] GET /compute/v2.1/os-hosts/ncdv-master-1/startup => generated 110 bytes in 16 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 08 20:55:59.867866 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-ec431222-2a62-451b-bfd0-2cc648a38b47 tempest-HostsAdminNegativeTestJSON-1838421184 tempest-HostsAdminNegativeTestJSON-1838421184-project-admin] Calling method '.version_select at 0x7f1a8c8ea670>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:55:59.879190 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-ec431222-2a62-451b-bfd0-2cc648a38b47 tempest-HostsAdminNegativeTestJSON-1838421184 tempest-HostsAdminNegativeTestJSON-1838421184-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 08 20:55:59.880997 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-ec431222-2a62-451b-bfd0-2cc648a38b47 tempest-HostsAdminNegativeTestJSON-1838421184 tempest-HostsAdminNegativeTestJSON-1838421184-project-admin] Request method failure captured: Oct 08 20:55:59.880997 ncdv-master-1 devstack@n-api.service[140492]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Oct 08 20:55:59.880997 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 20:55:59.880997 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 20:55:59.880997 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 20:55:59.880997 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 20:55:59.880997 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 20:55:59.880997 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 20:55:59.880997 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 20:55:59.880997 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 20:55:59.880997 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQePe-r1sbbgkZCtTvCWRxlMifVXYgZjpBZlclXVD0Webm3YxfkXqanLXXnIAb1wFJJBQ3Y3IPO0bFme0CwfPcFjILoB-z4GD9Cr23fg0lxnYdOKTB4sozcUSvFtUWWUeH59WsmOla3nOaL8R5s3aKv11dFxrPcuI5YS7casgTs1F3J4 Oct 08 20:55:59.880997 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 20:55:59.880997 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 20:55:59.880997 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 20:55:59.880997 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 20:55:59.880997 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 20:55:59.880997 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 20:55:59.880997 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: e22f10ad8b4140c0a1ebd06c8a14899b Oct 08 20:55:59.880997 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1838421184 Oct 08 20:55:59.880997 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,admin,member Oct 08 20:55:59.880997 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,admin,member Oct 08 20:55:59.880997 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/e22f10ad8b4140c0a1ebd06c8a14899b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e22f10ad8b4140c0a1ebd06c8a14899b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_e22f10ad8b4140c0a1ebd06c8a14899b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e22f10ad8b4140c0a1ebd06c8a14899b"}]}] Oct 08 20:55:59.880997 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1838421184 Oct 08 20:55:59.880997 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: e22f10ad8b4140c0a1ebd06c8a14899b Oct 08 20:55:59.880997 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1838421184 Oct 08 20:55:59.880997 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-HostsAdminNegativeTestJSON-1838421184-project-admin Oct 08 20:55:59.880997 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 20:55:59.880997 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 20:55:59.880997 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: fce8e310cf0247be8e319b6823a64f6c Oct 08 20:55:59.880997 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1838421184-project-admin Oct 08 20:55:59.880997 ncdv-master-1 devstack@n-api.service[140492]: method: Oct 08 20:55:59.880997 ncdv-master-1 devstack@n-api.service[140492]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 08 20:55:59.880997 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': 'nonexistent_hostname'} Oct 08 20:55:59.880997 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:55:59.880997 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:55:59.880997 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 08 20:55:59.880997 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 08 20:55:59.880997 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 08 20:55:59.880997 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 08 20:55:59.880997 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 08 20:55:59.880997 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 08 20:55:59.880997 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 08 20:55:59.880997 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise self.value Oct 08 20:55:59.880997 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 08 20:55:59.880997 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 08 20:55:59.880997 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 08 20:55:59.880997 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 08 20:55:59.880997 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 08 20:55:59.880997 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 08 20:55:59.880997 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 08 20:55:59.880997 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 08 20:55:59.880997 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 08 20:55:59.880997 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 08 20:55:59.880997 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 08 20:55:59.880997 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 08 20:55:59.880997 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 08 20:55:59.880997 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:55:59.880997 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:55:59.880997 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:55:59.880997 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:55:59.880997 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:55:59.880997 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:55:59.880997 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:55:59.884984 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:55:59.884984 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 08 20:55:59.884984 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 08 20:55:59.884984 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:55:59.884984 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:55:59.884984 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Oct 08 20:55:59.884984 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Oct 08 20:55:59.884984 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 08 20:55:59.884984 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 08 20:55:59.884984 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 08 20:55:59.884984 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:55:59.884984 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:55:59.884984 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:55:59.884984 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:55:59.884984 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:55:59.884984 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:55:59.884984 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 20:55:59.884984 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 20:55:59.884984 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 08 20:55:59.884984 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:55:59.884984 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-ec431222-2a62-451b-bfd0-2cc648a38b47 tempest-HostsAdminNegativeTestJSON-1838421184 tempest-HostsAdminNegativeTestJSON-1838421184-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:55:59.884984 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-ec431222-2a62-451b-bfd0-2cc648a38b47 tempest-HostsAdminNegativeTestJSON-1838421184 tempest-HostsAdminNegativeTestJSON-1838421184-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.019888 Oct 08 20:55:59.889396 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 606/1163] 10.222.0.26 () {58 vars in 1215 bytes} [Sat Oct 8 20:55:59 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 08 20:55:59.898202 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-2dafef32-b156-4e96-97d6-aad07572e91c tempest-HostsAdminNegativeTestJSON-1838421184 tempest-HostsAdminNegativeTestJSON-1838421184-project-admin] Action: 'update', calling method: .version_select at 0x7f1a8c907040>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:55:59.906555 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-2dafef32-b156-4e96-97d6-aad07572e91c tempest-HostsAdminNegativeTestJSON-1838421184 tempest-HostsAdminNegativeTestJSON-1838421184-project-admin] Request method failure captured: Oct 08 20:55:59.906555 ncdv-master-1 devstack@n-api.service[140492]: request: PUT /compute/v2.1/os-hosts/ncdv-master-1 HTTP/1.1 Oct 08 20:55:59.906555 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 20:55:59.906555 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 20:55:59.906555 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 20:55:59.906555 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 51 Oct 08 20:55:59.906555 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 20:55:59.906555 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 20:55:59.906555 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 20:55:59.906555 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 20:55:59.906555 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQePe-r1sbbgkZCtTvCWRxlMifVXYgZjpBZlclXVD0Webm3YxfkXqanLXXnIAb1wFJJBQ3Y3IPO0bFme0CwfPcFjILoB-z4GD9Cr23fg0lxnYdOKTB4sozcUSvFtUWWUeH59WsmOla3nOaL8R5s3aKv11dFxrPcuI5YS7casgTs1F3J4 Oct 08 20:55:59.906555 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 20:55:59.906555 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 20:55:59.906555 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 20:55:59.906555 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 20:55:59.906555 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 20:55:59.906555 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 20:55:59.906555 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: e22f10ad8b4140c0a1ebd06c8a14899b Oct 08 20:55:59.906555 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1838421184 Oct 08 20:55:59.906555 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,admin,member Oct 08 20:55:59.906555 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,admin,member Oct 08 20:55:59.906555 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/e22f10ad8b4140c0a1ebd06c8a14899b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e22f10ad8b4140c0a1ebd06c8a14899b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_e22f10ad8b4140c0a1ebd06c8a14899b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e22f10ad8b4140c0a1ebd06c8a14899b"}]}] Oct 08 20:55:59.906555 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1838421184 Oct 08 20:55:59.906555 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: e22f10ad8b4140c0a1ebd06c8a14899b Oct 08 20:55:59.906555 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1838421184 Oct 08 20:55:59.906555 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-HostsAdminNegativeTestJSON-1838421184-project-admin Oct 08 20:55:59.906555 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 20:55:59.906555 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 20:55:59.906555 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: fce8e310cf0247be8e319b6823a64f6c Oct 08 20:55:59.906555 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1838421184-project-admin Oct 08 20:55:59.906555 ncdv-master-1 devstack@n-api.service[140492]: Oct 08 20:55:59.906555 ncdv-master-1 devstack@n-api.service[140492]: {"status": "enable", "maintenance_mode": "invalid"} Oct 08 20:55:59.906555 ncdv-master-1 devstack@n-api.service[140492]: method: Oct 08 20:55:59.906555 ncdv-master-1 devstack@n-api.service[140492]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 08 20:55:59.906555 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': 'ncdv-master-1', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Oct 08 20:55:59.906555 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:55:59.906555 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:55:59.906555 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 08 20:55:59.906555 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 08 20:55:59.906555 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 08 20:55:59.906555 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise error Oct 08 20:55:59.906555 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 08 20:55:59.906555 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:55:59.906555 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Oct 08 20:55:59.906555 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 08 20:55:59.906555 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi 'disable', Oct 08 20:55:59.906555 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi 'Enable', Oct 08 20:55:59.906555 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi 'Disable', Oct 08 20:55:59.906555 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 08 20:55:59.906555 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 08 20:55:59.906555 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 08 20:55:59.906555 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:55:59.906555 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi On instance: Oct 08 20:55:59.906555 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi 'invalid' Oct 08 20:55:59.906555 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:55:59.906555 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:55:59.906555 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:55:59.906555 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:55:59.906555 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:55:59.906555 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:55:59.906555 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:55:59.906555 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:55:59.906555 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 08 20:55:59.906555 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 08 20:55:59.906555 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:55:59.906555 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:55:59.906555 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 08 20:55:59.906555 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 08 20:55:59.912133 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 08 20:55:59.912133 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 08 20:55:59.912133 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 08 20:55:59.912133 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 08 20:55:59.912133 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 08 20:55:59.912133 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:55:59.912133 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:55:59.912133 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:55:59.912133 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:55:59.912133 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:55:59.912133 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:55:59.912133 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 08 20:55:59.912133 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 08 20:55:59.912133 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 08 20:55:59.912133 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:55:59.912133 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-2dafef32-b156-4e96-97d6-aad07572e91c tempest-HostsAdminNegativeTestJSON-1838421184 tempest-HostsAdminNegativeTestJSON-1838421184-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:55:59.912133 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-2dafef32-b156-4e96-97d6-aad07572e91c tempest-HostsAdminNegativeTestJSON-1838421184 tempest-HostsAdminNegativeTestJSON-1838421184-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-hosts/ncdv-master-1" status: 400 len: 199 microversion: 2.1 time: 0.018137 Oct 08 20:55:59.916429 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 607/1164] 10.222.0.26 () {60 vars in 1190 bytes} [Sat Oct 8 20:55:59 2022] PUT /compute/v2.1/os-hosts/ncdv-master-1 => generated 199 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 08 20:55:59.925491 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-d4a27457-278c-4f84-91fb-c39c8476b8be tempest-HostsAdminNegativeTestJSON-1838421184 tempest-HostsAdminNegativeTestJSON-1838421184-project-admin] Action: 'update', calling method: .version_select at 0x7f1a8c9618b0>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:55:59.932961 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-d4a27457-278c-4f84-91fb-c39c8476b8be tempest-HostsAdminNegativeTestJSON-1838421184 tempest-HostsAdminNegativeTestJSON-1838421184-project-admin] Request method failure captured: Oct 08 20:55:59.932961 ncdv-master-1 devstack@n-api.service[140492]: request: PUT /compute/v2.1/os-hosts/ncdv-master-1 HTTP/1.1 Oct 08 20:55:59.932961 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 20:55:59.932961 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 20:55:59.932961 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 20:55:59.932961 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 51 Oct 08 20:55:59.932961 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 20:55:59.932961 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 20:55:59.932961 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 20:55:59.932961 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 20:55:59.932961 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQePe-r1sbbgkZCtTvCWRxlMifVXYgZjpBZlclXVD0Webm3YxfkXqanLXXnIAb1wFJJBQ3Y3IPO0bFme0CwfPcFjILoB-z4GD9Cr23fg0lxnYdOKTB4sozcUSvFtUWWUeH59WsmOla3nOaL8R5s3aKv11dFxrPcuI5YS7casgTs1F3J4 Oct 08 20:55:59.932961 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 20:55:59.932961 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 20:55:59.932961 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 20:55:59.932961 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 20:55:59.932961 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 20:55:59.932961 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 20:55:59.932961 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: e22f10ad8b4140c0a1ebd06c8a14899b Oct 08 20:55:59.932961 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1838421184 Oct 08 20:55:59.932961 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,admin,member Oct 08 20:55:59.932961 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,admin,member Oct 08 20:55:59.932961 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/e22f10ad8b4140c0a1ebd06c8a14899b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e22f10ad8b4140c0a1ebd06c8a14899b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_e22f10ad8b4140c0a1ebd06c8a14899b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e22f10ad8b4140c0a1ebd06c8a14899b"}]}] Oct 08 20:55:59.932961 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1838421184 Oct 08 20:55:59.932961 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: e22f10ad8b4140c0a1ebd06c8a14899b Oct 08 20:55:59.932961 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1838421184 Oct 08 20:55:59.932961 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-HostsAdminNegativeTestJSON-1838421184-project-admin Oct 08 20:55:59.932961 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 20:55:59.932961 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 20:55:59.932961 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: fce8e310cf0247be8e319b6823a64f6c Oct 08 20:55:59.932961 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1838421184-project-admin Oct 08 20:55:59.932961 ncdv-master-1 devstack@n-api.service[140492]: Oct 08 20:55:59.932961 ncdv-master-1 devstack@n-api.service[140492]: {"status": "invalid", "maintenance_mode": "enable"} Oct 08 20:55:59.932961 ncdv-master-1 devstack@n-api.service[140492]: method: Oct 08 20:55:59.932961 ncdv-master-1 devstack@n-api.service[140492]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 08 20:55:59.932961 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': 'ncdv-master-1', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Oct 08 20:55:59.932961 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:55:59.932961 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:55:59.932961 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 08 20:55:59.932961 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 08 20:55:59.932961 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 08 20:55:59.932961 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise error Oct 08 20:55:59.932961 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 08 20:55:59.932961 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:55:59.932961 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Oct 08 20:55:59.932961 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 08 20:55:59.932961 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi 'disable', Oct 08 20:55:59.932961 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi 'Enable', Oct 08 20:55:59.932961 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi 'Disable', Oct 08 20:55:59.932961 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 08 20:55:59.932961 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 08 20:55:59.932961 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 08 20:55:59.932961 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:55:59.932961 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi On instance: Oct 08 20:55:59.932961 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi 'invalid' Oct 08 20:55:59.932961 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:55:59.932961 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:55:59.932961 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:55:59.932961 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:55:59.932961 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:55:59.932961 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:55:59.932961 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:55:59.932961 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:55:59.932961 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 08 20:55:59.932961 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 08 20:55:59.932961 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:55:59.932961 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:55:59.932961 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 08 20:55:59.932961 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 08 20:55:59.937512 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 08 20:55:59.937512 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 08 20:55:59.937512 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 08 20:55:59.937512 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 08 20:55:59.937512 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 08 20:55:59.937512 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:55:59.937512 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:55:59.937512 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:55:59.937512 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:55:59.937512 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:55:59.937512 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:55:59.937512 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 08 20:55:59.937512 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 08 20:55:59.937512 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 08 20:55:59.937512 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:55:59.937512 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-d4a27457-278c-4f84-91fb-c39c8476b8be tempest-HostsAdminNegativeTestJSON-1838421184 tempest-HostsAdminNegativeTestJSON-1838421184-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:55:59.937512 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-d4a27457-278c-4f84-91fb-c39c8476b8be tempest-HostsAdminNegativeTestJSON-1838421184 tempest-HostsAdminNegativeTestJSON-1838421184-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-hosts/ncdv-master-1" status: 400 len: 189 microversion: 2.1 time: 0.014313 Oct 08 20:55:59.943840 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 608/1165] 10.222.0.26 () {60 vars in 1190 bytes} [Sat Oct 8 20:55:59 2022] PUT /compute/v2.1/os-hosts/ncdv-master-1 => generated 189 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 08 20:55:59.948741 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-4c067b31-136b-4c1b-aaaa-7fba59be411e tempest-HostsAdminNegativeTestJSON-1470877698 tempest-HostsAdminNegativeTestJSON-1470877698-project] Action: 'update', calling method: .version_select at 0x7f1a8cacf4c0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:55:59.967524 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-4c067b31-136b-4c1b-aaaa-7fba59be411e tempest-HostsAdminNegativeTestJSON-1470877698 tempest-HostsAdminNegativeTestJSON-1470877698-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': '0842c774f38f47d096bc1c3691691751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fd0249867ab4ad6b1e9a0388c9e25be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:55:59.969502 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-4c067b31-136b-4c1b-aaaa-7fba59be411e tempest-HostsAdminNegativeTestJSON-1470877698 tempest-HostsAdminNegativeTestJSON-1470877698-project] Request method failure captured: Oct 08 20:55:59.969502 ncdv-master-1 devstack@n-api.service[140492]: request: PUT /compute/v2.1/os-hosts/ncdv-master-1 HTTP/1.1 Oct 08 20:55:59.969502 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 20:55:59.969502 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 20:55:59.969502 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 20:55:59.969502 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 50 Oct 08 20:55:59.969502 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 20:55:59.969502 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 20:55:59.969502 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 20:55:59.969502 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 20:55:59.969502 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQePdiVRaFxferXkBOBc7fT19oU4sV-gQv-uEQJShhMq38Sm15KDEZ6Swk9k4BZo3hGiYCrXK0iSS7J17dvxD7QbE2riPLH8RC4qgEvDlUekIQKhbUD3JhMyVCmsV6s92772R5L3KGDCUFGVFI4Xf4cYbaMiiKhhTAnuRBepmGW_H-X4 Oct 08 20:55:59.969502 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 20:55:59.969502 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 20:55:59.969502 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 20:55:59.969502 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 20:55:59.969502 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 20:55:59.969502 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 20:55:59.969502 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 1fd0249867ab4ad6b1e9a0388c9e25be Oct 08 20:55:59.969502 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1470877698 Oct 08 20:55:59.969502 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 20:55:59.969502 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 20:55:59.969502 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1fd0249867ab4ad6b1e9a0388c9e25be"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1fd0249867ab4ad6b1e9a0388c9e25be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1fd0249867ab4ad6b1e9a0388c9e25be"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1fd0249867ab4ad6b1e9a0388c9e25be"}]}] Oct 08 20:55:59.969502 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1470877698 Oct 08 20:55:59.969502 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 1fd0249867ab4ad6b1e9a0388c9e25be Oct 08 20:55:59.969502 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1470877698 Oct 08 20:55:59.969502 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-HostsAdminNegativeTestJSON-1470877698-project Oct 08 20:55:59.969502 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 20:55:59.969502 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 20:55:59.969502 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 0842c774f38f47d096bc1c3691691751 Oct 08 20:55:59.969502 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1470877698-project Oct 08 20:55:59.969502 ncdv-master-1 devstack@n-api.service[140492]: Oct 08 20:55:59.969502 ncdv-master-1 devstack@n-api.service[140492]: {"status": "enable", "maintenance_mode": "enable"} Oct 08 20:55:59.969502 ncdv-master-1 devstack@n-api.service[140492]: method: Oct 08 20:55:59.969502 ncdv-master-1 devstack@n-api.service[140492]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 08 20:55:59.969502 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': 'ncdv-master-1', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Oct 08 20:55:59.969502 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:55:59.969502 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:55:59.969502 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:55:59.969502 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:55:59.969502 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:55:59.969502 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:55:59.969502 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 08 20:55:59.969502 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 08 20:55:59.969502 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:55:59.969502 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:55:59.969502 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 20:55:59.969502 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 20:55:59.969502 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Oct 08 20:55:59.969502 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Oct 08 20:55:59.969502 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 08 20:55:59.969502 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 08 20:55:59.969502 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 08 20:55:59.969502 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 08 20:55:59.969502 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 08 20:55:59.969502 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 08 20:55:59.969502 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 08 20:55:59.969502 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise self.value Oct 08 20:55:59.969502 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 08 20:55:59.969502 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 08 20:55:59.969502 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 08 20:55:59.969502 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 08 20:55:59.969502 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 08 20:55:59.969502 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 08 20:55:59.969502 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 08 20:55:59.969502 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:55:59.976956 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:55:59.976956 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:55:59.976956 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:55:59.976956 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:55:59.976956 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:55:59.976956 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 08 20:55:59.976956 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 08 20:55:59.976956 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 08 20:55:59.976956 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:55:59.976956 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-4c067b31-136b-4c1b-aaaa-7fba59be411e tempest-HostsAdminNegativeTestJSON-1470877698 tempest-HostsAdminNegativeTestJSON-1470877698-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:55:59.976956 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-4c067b31-136b-4c1b-aaaa-7fba59be411e tempest-HostsAdminNegativeTestJSON-1470877698 tempest-HostsAdminNegativeTestJSON-1470877698-project] 10.222.0.26 "PUT /compute/v2.1/os-hosts/ncdv-master-1" status: 403 len: 111 microversion: 2.1 time: 0.026085 Oct 08 20:55:59.978242 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 609/1166] 10.222.0.26 () {60 vars in 1190 bytes} [Sat Oct 8 20:55:59 2022] PUT /compute/v2.1/os-hosts/ncdv-master-1 => generated 111 bytes in 34 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 08 20:55:59.985849 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-bce75b7e-44b1-43d1-92a3-dd3986fe6bf8 tempest-HostsAdminNegativeTestJSON-1838421184 tempest-HostsAdminNegativeTestJSON-1838421184-project-admin] Action: 'update', calling method: .version_select at 0x7f1a8c8ea820>, body: {"status": null, "maintenance_mode": null} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:55:59.997558 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-bce75b7e-44b1-43d1-92a3-dd3986fe6bf8 tempest-HostsAdminNegativeTestJSON-1838421184 tempest-HostsAdminNegativeTestJSON-1838421184-project-admin] Request method failure captured: Oct 08 20:55:59.997558 ncdv-master-1 devstack@n-api.service[140492]: request: PUT /compute/v2.1/os-hosts/ncdv-master-1 HTTP/1.1 Oct 08 20:55:59.997558 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 20:55:59.997558 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 20:55:59.997558 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 20:55:59.997558 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 42 Oct 08 20:55:59.997558 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 20:55:59.997558 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 20:55:59.997558 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 20:55:59.997558 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 20:55:59.997558 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQePe-r1sbbgkZCtTvCWRxlMifVXYgZjpBZlclXVD0Webm3YxfkXqanLXXnIAb1wFJJBQ3Y3IPO0bFme0CwfPcFjILoB-z4GD9Cr23fg0lxnYdOKTB4sozcUSvFtUWWUeH59WsmOla3nOaL8R5s3aKv11dFxrPcuI5YS7casgTs1F3J4 Oct 08 20:55:59.997558 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 20:55:59.997558 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 20:55:59.997558 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 20:55:59.997558 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 20:55:59.997558 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 20:55:59.997558 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 20:55:59.997558 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: e22f10ad8b4140c0a1ebd06c8a14899b Oct 08 20:55:59.997558 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1838421184 Oct 08 20:55:59.997558 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,admin,member Oct 08 20:55:59.997558 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,admin,member Oct 08 20:55:59.997558 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/e22f10ad8b4140c0a1ebd06c8a14899b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e22f10ad8b4140c0a1ebd06c8a14899b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_e22f10ad8b4140c0a1ebd06c8a14899b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e22f10ad8b4140c0a1ebd06c8a14899b"}]}] Oct 08 20:55:59.997558 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1838421184 Oct 08 20:55:59.997558 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: e22f10ad8b4140c0a1ebd06c8a14899b Oct 08 20:55:59.997558 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1838421184 Oct 08 20:55:59.997558 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-HostsAdminNegativeTestJSON-1838421184-project-admin Oct 08 20:55:59.997558 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 20:55:59.997558 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 20:55:59.997558 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: fce8e310cf0247be8e319b6823a64f6c Oct 08 20:55:59.997558 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1838421184-project-admin Oct 08 20:55:59.997558 ncdv-master-1 devstack@n-api.service[140492]: Oct 08 20:55:59.997558 ncdv-master-1 devstack@n-api.service[140492]: {"status": null, "maintenance_mode": null} Oct 08 20:55:59.997558 ncdv-master-1 devstack@n-api.service[140492]: method: Oct 08 20:55:59.997558 ncdv-master-1 devstack@n-api.service[140492]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 08 20:55:59.997558 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': 'ncdv-master-1', 'body': {'status': None, 'maintenance_mode': None}} Oct 08 20:55:59.997558 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:55:59.997558 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:55:59.997558 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 08 20:55:59.997558 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 08 20:55:59.997558 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 08 20:55:59.997558 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise error Oct 08 20:55:59.997558 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Oct 08 20:55:59.997558 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:55:59.997558 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Oct 08 20:55:59.997558 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 08 20:55:59.997558 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi 'disable', Oct 08 20:55:59.997558 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi 'Enable', Oct 08 20:55:59.997558 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi 'Disable', Oct 08 20:55:59.997558 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 08 20:55:59.997558 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 08 20:55:59.997558 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 08 20:55:59.997558 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:55:59.997558 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi On instance: Oct 08 20:55:59.997558 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi None Oct 08 20:55:59.997558 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:55:59.997558 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:55:59.997558 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:55:59.997558 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:55:59.997558 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:55:59.997558 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:55:59.997558 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:55:59.997558 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:55:59.997558 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 08 20:55:59.997558 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 08 20:55:59.997558 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:55:59.997558 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:55:59.997558 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 08 20:55:59.997558 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 08 20:55:59.997558 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 08 20:55:59.997558 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 08 20:56:00.003235 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 08 20:56:00.003235 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 08 20:56:00.003235 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 08 20:56:00.003235 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:56:00.003235 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:56:00.003235 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:56:00.003235 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:56:00.003235 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:56:00.003235 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:56:00.003235 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 08 20:56:00.003235 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 08 20:56:00.003235 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 08 20:56:00.003235 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:56:00.003235 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-bce75b7e-44b1-43d1-92a3-dd3986fe6bf8 tempest-HostsAdminNegativeTestJSON-1838421184 tempest-HostsAdminNegativeTestJSON-1838421184-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:56:00.003235 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-bce75b7e-44b1-43d1-92a3-dd3986fe6bf8 tempest-HostsAdminNegativeTestJSON-1838421184 tempest-HostsAdminNegativeTestJSON-1838421184-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-hosts/ncdv-master-1" status: 400 len: 127 microversion: 2.1 time: 0.020303 Oct 08 20:56:00.006828 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 610/1167] 10.222.0.26 () {60 vars in 1190 bytes} [Sat Oct 8 20:55:59 2022] PUT /compute/v2.1/os-hosts/ncdv-master-1 => generated 127 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 08 20:56:00.019434 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-8225a3ac-5b18-4aee-94ad-8d1c4a36acc8 tempest-HostsAdminNegativeTestJSON-1838421184 tempest-HostsAdminNegativeTestJSON-1838421184-project-admin] Action: 'update', calling method: .version_select at 0x7f1a8c8431f0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:56:00.025288 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.hosts [None req-8225a3ac-5b18-4aee-94ad-8d1c4a36acc8 tempest-HostsAdminNegativeTestJSON-1838421184 tempest-HostsAdminNegativeTestJSON-1838421184-project-admin] Enabling host nonexistent_hostname. Oct 08 20:56:00.046057 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-8225a3ac-5b18-4aee-94ad-8d1c4a36acc8 tempest-HostsAdminNegativeTestJSON-1838421184 tempest-HostsAdminNegativeTestJSON-1838421184-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 08 20:56:00.052734 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-8225a3ac-5b18-4aee-94ad-8d1c4a36acc8 tempest-HostsAdminNegativeTestJSON-1838421184 tempest-HostsAdminNegativeTestJSON-1838421184-project-admin] Request method failure captured: Oct 08 20:56:00.052734 ncdv-master-1 devstack@n-api.service[140492]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Oct 08 20:56:00.052734 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 20:56:00.052734 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 20:56:00.052734 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 20:56:00.052734 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 50 Oct 08 20:56:00.052734 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 20:56:00.052734 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 20:56:00.052734 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 20:56:00.052734 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 20:56:00.052734 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQePe-r1sbbgkZCtTvCWRxlMifVXYgZjpBZlclXVD0Webm3YxfkXqanLXXnIAb1wFJJBQ3Y3IPO0bFme0CwfPcFjILoB-z4GD9Cr23fg0lxnYdOKTB4sozcUSvFtUWWUeH59WsmOla3nOaL8R5s3aKv11dFxrPcuI5YS7casgTs1F3J4 Oct 08 20:56:00.052734 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 20:56:00.052734 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 20:56:00.052734 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 20:56:00.052734 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 20:56:00.052734 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 20:56:00.052734 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 20:56:00.052734 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: e22f10ad8b4140c0a1ebd06c8a14899b Oct 08 20:56:00.052734 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1838421184 Oct 08 20:56:00.052734 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,admin,member Oct 08 20:56:00.052734 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,admin,member Oct 08 20:56:00.052734 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/e22f10ad8b4140c0a1ebd06c8a14899b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e22f10ad8b4140c0a1ebd06c8a14899b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_e22f10ad8b4140c0a1ebd06c8a14899b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e22f10ad8b4140c0a1ebd06c8a14899b"}]}] Oct 08 20:56:00.052734 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1838421184 Oct 08 20:56:00.052734 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: e22f10ad8b4140c0a1ebd06c8a14899b Oct 08 20:56:00.052734 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1838421184 Oct 08 20:56:00.052734 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-HostsAdminNegativeTestJSON-1838421184-project-admin Oct 08 20:56:00.052734 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 20:56:00.052734 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 20:56:00.052734 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: fce8e310cf0247be8e319b6823a64f6c Oct 08 20:56:00.052734 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1838421184-project-admin Oct 08 20:56:00.052734 ncdv-master-1 devstack@n-api.service[140492]: Oct 08 20:56:00.052734 ncdv-master-1 devstack@n-api.service[140492]: {"status": "enable", "maintenance_mode": "enable"} Oct 08 20:56:00.052734 ncdv-master-1 devstack@n-api.service[140492]: method: Oct 08 20:56:00.052734 ncdv-master-1 devstack@n-api.service[140492]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 08 20:56:00.052734 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Oct 08 20:56:00.052734 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:56:00.052734 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:56:00.052734 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Oct 08 20:56:00.052734 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Oct 08 20:56:00.052734 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 08 20:56:00.052734 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 08 20:56:00.052734 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 08 20:56:00.052734 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 08 20:56:00.052734 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 08 20:56:00.052734 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise self.value Oct 08 20:56:00.052734 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 08 20:56:00.052734 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 08 20:56:00.052734 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 08 20:56:00.052734 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 08 20:56:00.052734 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 08 20:56:00.052734 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 08 20:56:00.052734 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 08 20:56:00.052734 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 08 20:56:00.052734 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 08 20:56:00.052734 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 08 20:56:00.052734 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 08 20:56:00.052734 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 08 20:56:00.052734 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 08 20:56:00.052734 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:56:00.052734 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:56:00.052734 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:56:00.052734 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:56:00.052734 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:56:00.052734 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:56:00.056975 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:56:00.056975 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:56:00.056975 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 08 20:56:00.056975 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 08 20:56:00.056975 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:56:00.056975 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:56:00.056975 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 20:56:00.056975 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 20:56:00.056975 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Oct 08 20:56:00.056975 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Oct 08 20:56:00.056975 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Oct 08 20:56:00.056975 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 08 20:56:00.056975 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 08 20:56:00.056975 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:56:00.056975 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:56:00.056975 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:56:00.056975 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:56:00.056975 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:56:00.056975 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:56:00.056975 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 20:56:00.056975 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 20:56:00.056975 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 08 20:56:00.056975 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:56:00.056975 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-8225a3ac-5b18-4aee-94ad-8d1c4a36acc8 tempest-HostsAdminNegativeTestJSON-1838421184 tempest-HostsAdminNegativeTestJSON-1838421184-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:56:00.056975 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-8225a3ac-5b18-4aee-94ad-8d1c4a36acc8 tempest-HostsAdminNegativeTestJSON-1838421184 tempest-HostsAdminNegativeTestJSON-1838421184-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.048987 Oct 08 20:56:00.059704 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 611/1168] 10.222.0.26 () {60 vars in 1211 bytes} [Sat Oct 8 20:56:00 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 08 20:56:00.609950 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-92dfaa35-6fdc-4eb2-8b26-4c6c88e97b1b tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:00.612893 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-92dfaa35-6fdc-4eb2-8b26-4c6c88e97b1b tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] [instance: 92e31b92-0af1-4da6-bc87-23978f1aedf5] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:56:00.637087 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-92dfaa35-6fdc-4eb2-8b26-4c6c88e97b1b tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:00.641374 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-92dfaa35-6fdc-4eb2-8b26-4c6c88e97b1b tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:00.641890 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-92dfaa35-6fdc-4eb2-8b26-4c6c88e97b1b tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:00.646176 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-92dfaa35-6fdc-4eb2-8b26-4c6c88e97b1b tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:00.649390 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-92dfaa35-6fdc-4eb2-8b26-4c6c88e97b1b tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:00.654255 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-92dfaa35-6fdc-4eb2-8b26-4c6c88e97b1b tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:00.810418 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-439a4e6a-2283-408d-a3a0-c9e78000557d tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] 10.222.0.26 "GET /compute/v2.1/images/c9c4114b-60e7-4da5-980a-ac303ed9462a" status: 200 len: 1464 microversion: 2.1 time: 5.022121 Oct 08 20:56:00.820520 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 558/1169] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:55:55 2022] GET /compute/v2.1/images/c9c4114b-60e7-4da5-980a-ac303ed9462a => generated 1464 bytes in 5033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:56:00.831645 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-aa94a6d2-1749-419d-bc08-70d18778518c tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7646db34-383d-4fbe-a722-be3019ae4a2f", "device": "/dev/xvdb"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:56:00.839628 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-aa94a6d2-1749-419d-bc08-70d18778518c tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] [instance: e338d559-3f7c-4cc8-95c6-face79e11ca2] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:56:00.885392 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-aa94a6d2-1749-419d-bc08-70d18778518c tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:00.888168 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-aa94a6d2-1749-419d-bc08-70d18778518c tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:00.888766 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-aa94a6d2-1749-419d-bc08-70d18778518c tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:00.890170 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-aa94a6d2-1749-419d-bc08-70d18778518c tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:00.890770 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-aa94a6d2-1749-419d-bc08-70d18778518c tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:00.891411 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-aa94a6d2-1749-419d-bc08-70d18778518c tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:01.069345 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-92dfaa35-6fdc-4eb2-8b26-4c6c88e97b1b tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:01.086051 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-92dfaa35-6fdc-4eb2-8b26-4c6c88e97b1b tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:01.089351 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-92dfaa35-6fdc-4eb2-8b26-4c6c88e97b1b tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:01.130090 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-92dfaa35-6fdc-4eb2-8b26-4c6c88e97b1b tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] 10.222.0.26 "GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5" status: 200 len: 1555 microversion: 2.91 time: 0.524282 Oct 08 20:56:01.145883 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 612/1170] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:56:00 2022] GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5 => generated 1555 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 08 20:56:01.161347 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-7a1157cb-341e-4885-b794-20c24ca2919b tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Calling method '.version_select at 0x7f1a8c8435e0>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:01.225984 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-7a1157cb-341e-4885-b794-20c24ca2919b tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] 10.222.0.26 "GET /compute/v2.1/images/c9c4114b-60e7-4da5-980a-ac303ed9462a" status: 200 len: 1464 microversion: 2.1 time: 0.078984 Oct 08 20:56:01.226815 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 613/1171] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:56:01 2022] GET /compute/v2.1/images/c9c4114b-60e7-4da5-980a-ac303ed9462a => generated 1464 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:56:01.244235 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-18391108-f96a-4257-972d-d16c470137fc tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:01.245099 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-18391108-f96a-4257-972d-d16c470137fc tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] [instance: 0cbc3ac5-5690-4f4e-a9d1-ea0de18060b1] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:56:01.254182 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-18391108-f96a-4257-972d-d16c470137fc tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:01.255019 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-18391108-f96a-4257-972d-d16c470137fc tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:01.255661 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-18391108-f96a-4257-972d-d16c470137fc tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:01.256609 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-18391108-f96a-4257-972d-d16c470137fc tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:01.257425 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-18391108-f96a-4257-972d-d16c470137fc tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:01.258385 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-18391108-f96a-4257-972d-d16c470137fc tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:01.816171 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-aa94a6d2-1749-419d-bc08-70d18778518c tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] 10.222.0.26 "POST /compute/v2.1/servers/e338d559-3f7c-4cc8-95c6-face79e11ca2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.980483 Oct 08 20:56:01.821280 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 559/1172] 10.222.0.26 () {60 vars in 1323 bytes} [Sat Oct 8 20:56:00 2022] POST /compute/v2.1/servers/e338d559-3f7c-4cc8-95c6-face79e11ca2/os-volume_attachments => generated 194 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:56:01.860575 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-18391108-f96a-4257-972d-d16c470137fc tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bce55d7f67347aaaa4c2a687bdff183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb3706a1680419384f4fe9660e87732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:01.873878 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-18391108-f96a-4257-972d-d16c470137fc tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] 10.222.0.26 "GET /compute/v2.1/servers/0cbc3ac5-5690-4f4e-a9d1-ea0de18060b1" status: 200 len: 1467 microversion: 2.1 time: 0.632396 Oct 08 20:56:01.877746 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 614/1173] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:56:01 2022] GET /compute/v2.1/servers/0cbc3ac5-5690-4f4e-a9d1-ea0de18060b1 => generated 1467 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:56:01.902793 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c878376d-1772-42aa-9bfe-681710fe219f tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1457799272"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:56:01.906061 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-c878376d-1772-42aa-9bfe-681710fe219f tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] [instance: 24300a5e-164c-4d97-9a1f-b52359c1c0d6] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:56:01.923574 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c878376d-1772-42aa-9bfe-681710fe219f tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:01.924390 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c878376d-1772-42aa-9bfe-681710fe219f tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:01.925052 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c878376d-1772-42aa-9bfe-681710fe219f tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:01.926036 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c878376d-1772-42aa-9bfe-681710fe219f tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:01.926760 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c878376d-1772-42aa-9bfe-681710fe219f tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:01.927404 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c878376d-1772-42aa-9bfe-681710fe219f tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:02.168020 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-638ecb93-d7c5-4828-8720-a58bf4c0e7af tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:02.168765 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-638ecb93-d7c5-4828-8720-a58bf4c0e7af tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] [instance: 92e31b92-0af1-4da6-bc87-23978f1aedf5] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:56:02.184046 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-638ecb93-d7c5-4828-8720-a58bf4c0e7af tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:02.188003 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-638ecb93-d7c5-4828-8720-a58bf4c0e7af tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:02.188660 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-638ecb93-d7c5-4828-8720-a58bf4c0e7af tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:02.190329 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-638ecb93-d7c5-4828-8720-a58bf4c0e7af tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:02.190973 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-638ecb93-d7c5-4828-8720-a58bf4c0e7af tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:02.191606 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-638ecb93-d7c5-4828-8720-a58bf4c0e7af tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:02.325214 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-c878376d-1772-42aa-9bfe-681710fe219f tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] 10.222.0.26 "POST /compute/v2.1/servers/24300a5e-164c-4d97-9a1f-b52359c1c0d6/action" status: 202 len: 0 microversion: 2.1 time: 0.427806 Oct 08 20:56:02.326663 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 560/1174] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 20:56:01 2022] POST /compute/v2.1/servers/24300a5e-164c-4d97-9a1f-b52359c1c0d6/action => generated 0 bytes in 430 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 08 20:56:02.345123 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-fb53045a-0b76-4088-a2a4-ccf5d00d265f tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Calling method '.version_select at 0x7f1a8c870280>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:02.458654 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-638ecb93-d7c5-4828-8720-a58bf4c0e7af tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:02.477043 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-638ecb93-d7c5-4828-8720-a58bf4c0e7af tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:02.481865 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-638ecb93-d7c5-4828-8720-a58bf4c0e7af tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:02.483283 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-fb53045a-0b76-4088-a2a4-ccf5d00d265f tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] 10.222.0.26 "GET /compute/v2.1/images/2cee37af-3fa7-4730-97e9-ef19fe423ca1" status: 200 len: 1455 microversion: 2.1 time: 0.141776 Oct 08 20:56:02.493541 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 561/1175] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:56:02 2022] GET /compute/v2.1/images/2cee37af-3fa7-4730-97e9-ef19fe423ca1 => generated 1455 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:56:02.507694 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-638ecb93-d7c5-4828-8720-a58bf4c0e7af tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] 10.222.0.26 "GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5" status: 200 len: 1555 microversion: 2.91 time: 0.342514 Oct 08 20:56:02.513083 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 615/1176] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:56:02 2022] GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5 => generated 1555 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 08 20:56:03.502454 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-682e52cb-eb31-4f81-ae28-675246dd98b8 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Calling method '.version_select at 0x7f1a8c85da60>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:03.540611 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-df4b674b-e2c5-43bf-9f7e-d5945db614d7 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:03.541902 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-df4b674b-e2c5-43bf-9f7e-d5945db614d7 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] [instance: 92e31b92-0af1-4da6-bc87-23978f1aedf5] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:56:03.566817 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-df4b674b-e2c5-43bf-9f7e-d5945db614d7 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:03.569572 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-df4b674b-e2c5-43bf-9f7e-d5945db614d7 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:03.570213 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-df4b674b-e2c5-43bf-9f7e-d5945db614d7 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:03.582235 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-df4b674b-e2c5-43bf-9f7e-d5945db614d7 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:03.582924 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-df4b674b-e2c5-43bf-9f7e-d5945db614d7 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:03.584695 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-df4b674b-e2c5-43bf-9f7e-d5945db614d7 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:03.599727 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-682e52cb-eb31-4f81-ae28-675246dd98b8 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] 10.222.0.26 "GET /compute/v2.1/images/2cee37af-3fa7-4730-97e9-ef19fe423ca1" status: 200 len: 1455 microversion: 2.1 time: 0.103145 Oct 08 20:56:03.608234 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 562/1177] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:56:03 2022] GET /compute/v2.1/images/2cee37af-3fa7-4730-97e9-ef19fe423ca1 => generated 1455 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:56:03.960524 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-df4b674b-e2c5-43bf-9f7e-d5945db614d7 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:03.975507 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-df4b674b-e2c5-43bf-9f7e-d5945db614d7 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:03.983954 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-df4b674b-e2c5-43bf-9f7e-d5945db614d7 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:04.006895 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-df4b674b-e2c5-43bf-9f7e-d5945db614d7 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] 10.222.0.26 "GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5" status: 200 len: 1555 microversion: 2.91 time: 0.469991 Oct 08 20:56:04.013732 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 616/1178] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:56:03 2022] GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5 => generated 1555 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 08 20:56:04.616803 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c08eff86-1566-48e3-a48d-2a1e7a01443a tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Calling method '.version_select at 0x7f1a8c870dc0>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:04.641237 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-03346b4b-0ae5-44df-8356-127778774e61 req-a02a50a0-022c-4bb4-a880-3d935a6077f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cbc3ac5-5690-4f4e-a9d1-ea0de18060b1", "name": "network-vif-unplugged", "status": "completed", "tag": "20694e26-0b3a-4a5f-9806-aa0485a844f5"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:56:04.680529 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-03346b4b-0ae5-44df-8356-127778774e61 req-a02a50a0-022c-4bb4-a880-3d935a6077f6 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:04.689395 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-03346b4b-0ae5-44df-8356-127778774e61 req-a02a50a0-022c-4bb4-a880-3d935a6077f6 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:04.689890 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-03346b4b-0ae5-44df-8356-127778774e61 req-a02a50a0-022c-4bb4-a880-3d935a6077f6 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:04.694393 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-c08eff86-1566-48e3-a48d-2a1e7a01443a tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] 10.222.0.26 "GET /compute/v2.1/images/2cee37af-3fa7-4730-97e9-ef19fe423ca1" status: 200 len: 1455 microversion: 2.1 time: 0.081820 Oct 08 20:56:04.700913 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 563/1179] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:56:04 2022] GET /compute/v2.1/images/2cee37af-3fa7-4730-97e9-ef19fe423ca1 => generated 1455 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:56:04.726841 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-03346b4b-0ae5-44df-8356-127778774e61 req-a02a50a0-022c-4bb4-a880-3d935a6077f6 service nova] Creating event network-vif-unplugged:20694e26-0b3a-4a5f-9806-aa0485a844f5 for instance 0cbc3ac5-5690-4f4e-a9d1-ea0de18060b1 on nch1-master-1 Oct 08 20:56:04.742630 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-03346b4b-0ae5-44df-8356-127778774e61 req-a02a50a0-022c-4bb4-a880-3d935a6077f6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.106104 Oct 08 20:56:04.745884 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 617/1180] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:56:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 08 20:56:05.046138 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-188ce68a-4b27-4a61-a984-6e68fc02f0e5 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:05.047836 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-188ce68a-4b27-4a61-a984-6e68fc02f0e5 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] [instance: 92e31b92-0af1-4da6-bc87-23978f1aedf5] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:56:05.068893 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-188ce68a-4b27-4a61-a984-6e68fc02f0e5 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:05.073862 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-188ce68a-4b27-4a61-a984-6e68fc02f0e5 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:05.079123 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-188ce68a-4b27-4a61-a984-6e68fc02f0e5 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:05.081331 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-188ce68a-4b27-4a61-a984-6e68fc02f0e5 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:05.084053 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-188ce68a-4b27-4a61-a984-6e68fc02f0e5 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:05.086417 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-188ce68a-4b27-4a61-a984-6e68fc02f0e5 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:05.277743 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-188ce68a-4b27-4a61-a984-6e68fc02f0e5 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:05.299854 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-188ce68a-4b27-4a61-a984-6e68fc02f0e5 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:05.302484 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-188ce68a-4b27-4a61-a984-6e68fc02f0e5 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:05.315225 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-188ce68a-4b27-4a61-a984-6e68fc02f0e5 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] 10.222.0.26 "GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5" status: 200 len: 1555 microversion: 2.91 time: 0.276189 Oct 08 20:56:05.315841 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 564/1181] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:56:05 2022] GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5 => generated 1555 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:56:05.735465 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-d2ebcc4b-28f0-4ec2-9321-25d1b2cf3d7b tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Calling method '.version_select at 0x7f1a8c792040>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:05.869214 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-d2ebcc4b-28f0-4ec2-9321-25d1b2cf3d7b tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] 10.222.0.26 "GET /compute/v2.1/images/2cee37af-3fa7-4730-97e9-ef19fe423ca1" status: 200 len: 1455 microversion: 2.1 time: 0.156861 Oct 08 20:56:05.885298 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 618/1182] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:56:05 2022] GET /compute/v2.1/images/2cee37af-3fa7-4730-97e9-ef19fe423ca1 => generated 1455 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:56:06.347788 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-106e42fc-f05a-4f35-a645-b5f7086a48c8 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:06.348397 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-106e42fc-f05a-4f35-a645-b5f7086a48c8 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] [instance: 92e31b92-0af1-4da6-bc87-23978f1aedf5] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:56:06.359958 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-106e42fc-f05a-4f35-a645-b5f7086a48c8 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:06.360717 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-106e42fc-f05a-4f35-a645-b5f7086a48c8 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:06.361397 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-106e42fc-f05a-4f35-a645-b5f7086a48c8 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:06.362280 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-106e42fc-f05a-4f35-a645-b5f7086a48c8 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:06.362902 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-106e42fc-f05a-4f35-a645-b5f7086a48c8 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:06.363745 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-106e42fc-f05a-4f35-a645-b5f7086a48c8 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:06.619591 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-106e42fc-f05a-4f35-a645-b5f7086a48c8 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:06.634440 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-106e42fc-f05a-4f35-a645-b5f7086a48c8 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:06.641786 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-106e42fc-f05a-4f35-a645-b5f7086a48c8 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:06.655400 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-106e42fc-f05a-4f35-a645-b5f7086a48c8 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] 10.222.0.26 "GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5" status: 200 len: 1555 microversion: 2.91 time: 0.311318 Oct 08 20:56:06.677648 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 565/1183] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:56:06 2022] GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5 => generated 1555 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:56:06.884858 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-29b42b76-5f27-4011-a924-8500156fcf59 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Calling method '.version_select at 0x7f1a8ca959d0>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:06.992105 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-29b42b76-5f27-4011-a924-8500156fcf59 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] 10.222.0.26 "GET /compute/v2.1/images/2cee37af-3fa7-4730-97e9-ef19fe423ca1" status: 200 len: 1455 microversion: 2.1 time: 0.111932 Oct 08 20:56:06.993313 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 619/1184] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:56:06 2022] GET /compute/v2.1/images/2cee37af-3fa7-4730-97e9-ef19fe423ca1 => generated 1455 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:56:07.562317 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-12fa48d4-a49d-4299-8ffc-3368089d48be tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Action: 'create', calling method: .version_select at 0x7f1a8c870e50>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-43007255", "description": "tempest-description-1489408814"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:56:07.689815 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-d41d59b3-b17f-479f-91b0-0368ecee4275 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-125057735", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:56:08.020251 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-12fa48d4-a49d-4299-8ffc-3368089d48be tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] 10.222.0.26 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.739327 Oct 08 20:56:08.021206 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 566/1185] 10.222.0.26 () {60 vars in 1180 bytes} [Sat Oct 8 20:56:07 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:56:08.027326 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-251d6392-f730-425d-902d-3c0b96023663 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:08.030692 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-251d6392-f730-425d-902d-3c0b96023663 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] [instance: 92e31b92-0af1-4da6-bc87-23978f1aedf5] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:56:08.049034 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-251d6392-f730-425d-902d-3c0b96023663 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:08.049571 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-251d6392-f730-425d-902d-3c0b96023663 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:08.050031 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-251d6392-f730-425d-902d-3c0b96023663 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:08.060986 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-251d6392-f730-425d-902d-3c0b96023663 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:08.061642 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-251d6392-f730-425d-902d-3c0b96023663 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:08.063421 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-251d6392-f730-425d-902d-3c0b96023663 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:08.226833 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-251d6392-f730-425d-902d-3c0b96023663 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:08.238930 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-251d6392-f730-425d-902d-3c0b96023663 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:08.242710 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-251d6392-f730-425d-902d-3c0b96023663 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:08.253678 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-251d6392-f730-425d-902d-3c0b96023663 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] 10.222.0.26 "GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5" status: 200 len: 1555 microversion: 2.91 time: 0.231172 Oct 08 20:56:08.256729 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 567/1186] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:56:08 2022] GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5 => generated 1555 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:56:08.261543 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-b492ced6-8d26-413d-9184-383d9dd35872 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:08.273159 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-b492ced6-8d26-413d-9184-383d9dd35872 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] [instance: e338d559-3f7c-4cc8-95c6-face79e11ca2] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:56:08.280476 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b492ced6-8d26-413d-9184-383d9dd35872 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:08.282706 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b492ced6-8d26-413d-9184-383d9dd35872 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:08.285258 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b492ced6-8d26-413d-9184-383d9dd35872 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:08.287222 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b492ced6-8d26-413d-9184-383d9dd35872 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:08.289507 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b492ced6-8d26-413d-9184-383d9dd35872 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:08.291148 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b492ced6-8d26-413d-9184-383d9dd35872 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:08.535097 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-b492ced6-8d26-413d-9184-383d9dd35872 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/e338d559-3f7c-4cc8-95c6-face79e11ca2" status: 200 len: 1859 microversion: 2.1 time: 0.276951 Oct 08 20:56:08.537003 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 568/1187] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:56:08 2022] GET /compute/v2.1/servers/e338d559-3f7c-4cc8-95c6-face79e11ca2 => generated 1859 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:56:08.543967 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-f65162a0-d2d2-41e7-9499-a67a1e5495fe tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Calling method '.version_select at 0x7f1a8c839ee0>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:08.832646 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=4 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:56:14.707970 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=70 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:56:15.946421 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.network.neutron [None req-d41d59b3-b17f-479f-91b0-0368ecee4275 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] validate_networks() for None {{(pid=140492) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 20:56:16.053263 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-f65162a0-d2d2-41e7-9499-a67a1e5495fe tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] 10.222.0.26 "GET /compute/v2.1/images/2cee37af-3fa7-4730-97e9-ef19fe423ca1" status: 200 len: 1455 microversion: 2.1 time: 7.493297 Oct 08 20:56:16.054310 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 569/1188] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:56:08 2022] GET /compute/v2.1/images/2cee37af-3fa7-4730-97e9-ef19fe423ca1 => generated 1455 bytes in 7516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:56:16.069136 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-56e91718-1408-4c95-9140-da9d27a9201f tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Action: 'create', calling method: .version_select at 0x7f1a8c870820>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1924482026", "description": "tempest-description-699061663"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:56:16.301695 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-d41d59b3-b17f-479f-91b0-0368ecee4275 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Flavor limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 20:56:16.302140 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-d41d59b3-b17f-479f-91b0-0368ecee4275 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Image limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 20:56:16.303084 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-d41d59b3-b17f-479f-91b0-0368ecee4275 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Flavor pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 20:56:16.303586 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-d41d59b3-b17f-479f-91b0-0368ecee4275 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Image pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 20:56:16.304023 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-d41d59b3-b17f-479f-91b0-0368ecee4275 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 20:56:16.320565 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d41d59b3-b17f-479f-91b0-0368ecee4275 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:16.321374 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d41d59b3-b17f-479f-91b0-0368ecee4275 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:16.322054 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d41d59b3-b17f-479f-91b0-0368ecee4275 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:16.323055 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d41d59b3-b17f-479f-91b0-0368ecee4275 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:16.323622 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d41d59b3-b17f-479f-91b0-0368ecee4275 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:16.324785 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d41d59b3-b17f-479f-91b0-0368ecee4275 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:16.358097 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-d41d59b3-b17f-479f-91b0-0368ecee4275 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Getting quotas for project d7550f7ad9dc45ba9c9bfb0a5a11a774. Resources: {'cores', 'instances', 'ram'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 20:56:16.365045 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-d41d59b3-b17f-479f-91b0-0368ecee4275 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Getting quotas for user 05f0f7a60257437eaa8702b664916979 and project d7550f7ad9dc45ba9c9bfb0a5a11a774. Resources: {'cores', 'instances', 'ram'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 20:56:16.382405 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-d41d59b3-b17f-479f-91b0-0368ecee4275 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Going to run 1 instances... {{(pid=140492) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 20:56:16.385548 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-d41d59b3-b17f-479f-91b0-0368ecee4275 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] [instance: 7f720341-f7ad-4365-8aeb-0aad8afb46b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c508bd7f-7db9-4b2c-af7c-be54a855c355',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140492) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 20:56:16.395205 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-56e91718-1408-4c95-9140-da9d27a9201f tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] 10.222.0.26 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.339731 Oct 08 20:56:16.396589 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 570/1189] 10.222.0.26 () {60 vars in 1180 bytes} [Sat Oct 8 20:56:16 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:56:16.404855 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-0d545a33-08df-438b-8e60-2b40df12f7c9 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:56:16.411607 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-0d545a33-08df-438b-8e60-2b40df12f7c9 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] [instance: e338d559-3f7c-4cc8-95c6-face79e11ca2] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:56:16.448956 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0d545a33-08df-438b-8e60-2b40df12f7c9 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:16.449402 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-d41d59b3-b17f-479f-91b0-0368ecee4275 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 9.100509 Oct 08 20:56:16.450718 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 620/1190] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 20:56:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 9103 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 08 20:56:16.455176 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0d545a33-08df-438b-8e60-2b40df12f7c9 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:16.455907 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0d545a33-08df-438b-8e60-2b40df12f7c9 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:16.457209 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-6165eb7b-bc5a-4336-809a-65c33b5ed34d tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:16.458220 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-6165eb7b-bc5a-4336-809a-65c33b5ed34d tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] [instance: 92e31b92-0af1-4da6-bc87-23978f1aedf5] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:56:16.458827 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0d545a33-08df-438b-8e60-2b40df12f7c9 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:16.460407 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0d545a33-08df-438b-8e60-2b40df12f7c9 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:16.461590 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0d545a33-08df-438b-8e60-2b40df12f7c9 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:16.466744 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6165eb7b-bc5a-4336-809a-65c33b5ed34d tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:16.467457 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6165eb7b-bc5a-4336-809a-65c33b5ed34d tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:16.468112 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6165eb7b-bc5a-4336-809a-65c33b5ed34d tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:16.469019 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6165eb7b-bc5a-4336-809a-65c33b5ed34d tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:16.469751 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6165eb7b-bc5a-4336-809a-65c33b5ed34d tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:16.470409 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6165eb7b-bc5a-4336-809a-65c33b5ed34d tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:16.533725 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.objects.instance [None req-0d545a33-08df-438b-8e60-2b40df12f7c9 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Lazy-loading 'flavor' on Instance uuid e338d559-3f7c-4cc8-95c6-face79e11ca2 {{(pid=140491) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 20:56:16.551529 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-0d545a33-08df-438b-8e60-2b40df12f7c9 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] [instance: e338d559-3f7c-4cc8-95c6-face79e11ca2] Going to try to live migrate instance to nch1-master-1 {{(pid=140491) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 08 20:56:16.592523 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-6165eb7b-bc5a-4336-809a-65c33b5ed34d tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:16.618396 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-6165eb7b-bc5a-4336-809a-65c33b5ed34d tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:16.626454 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-6165eb7b-bc5a-4336-809a-65c33b5ed34d tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:16.641753 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-6165eb7b-bc5a-4336-809a-65c33b5ed34d tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] 10.222.0.26 "GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5" status: 200 len: 1555 microversion: 2.91 time: 0.189457 Oct 08 20:56:16.643291 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 621/1191] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:56:16 2022] GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5 => generated 1555 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:56:16.672140 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-1f5d1854-7606-43d4-9c54-eaabfcc9fec5 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Action: 'create', calling method: .version_select at 0x7f1a8ca76670>, body: {"keypair": {"name": "tempest-keypair-528451165", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDO1POxG9IOIVUFT6z5MGTNhdF49Q+nw/nlhft0gAT6qBbj0gbf1jqX8MsdoVugf7MN7L05SuW9AjDf1ifbmTdONNCT9ewG/OMdzHwFQHWSYDk5/oatccnM/2re0o4ogTw=="}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:56:16.727707 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=3 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:56:16.755138 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-1f5d1854-7606-43d4-9c54-eaabfcc9fec5 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Getting quotas for project ec51fae793a147d88e5d956352f18b92. Resources: {'key_pairs'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 20:56:16.763812 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-1f5d1854-7606-43d4-9c54-eaabfcc9fec5 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Getting quotas for user bc0c5c9593754f1cb98f9689b29606a2 and project ec51fae793a147d88e5d956352f18b92. Resources: {'key_pairs'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 20:56:16.805652 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-1f5d1854-7606-43d4-9c54-eaabfcc9fec5 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.42 time: 0.141716 Oct 08 20:56:16.806939 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 622/1192] 10.222.0.26 () {62 vars in 1200 bytes} [Sat Oct 8 20:56:16 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 144 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 08 20:56:16.814407 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-e8b107b3-c5e8-40e1-9917-474bd7c80af7 req-dd5306ff-3d86-4288-9507-68dfb1f1c5b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24300a5e-164c-4d97-9a1f-b52359c1c0d6", "name": "network-vif-plugged", "status": "completed", "tag": "2fe7c081-3e45-4535-9c6e-1d2e86219410"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:56:16.834469 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-e8b107b3-c5e8-40e1-9917-474bd7c80af7 req-dd5306ff-3d86-4288-9507-68dfb1f1c5b1 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:16.835471 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-e8b107b3-c5e8-40e1-9917-474bd7c80af7 req-dd5306ff-3d86-4288-9507-68dfb1f1c5b1 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:16.836116 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-e8b107b3-c5e8-40e1-9917-474bd7c80af7 req-dd5306ff-3d86-4288-9507-68dfb1f1c5b1 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:16.851505 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-e8b107b3-c5e8-40e1-9917-474bd7c80af7 req-dd5306ff-3d86-4288-9507-68dfb1f1c5b1 service nova] Creating event network-vif-plugged:2fe7c081-3e45-4535-9c6e-1d2e86219410 for instance 24300a5e-164c-4d97-9a1f-b52359c1c0d6 on nch1-master-1 Oct 08 20:56:16.862155 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-e8b107b3-c5e8-40e1-9917-474bd7c80af7 req-dd5306ff-3d86-4288-9507-68dfb1f1c5b1 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053382 Oct 08 20:56:16.864387 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 623/1193] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:56:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:56:16.870651 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-4a75ab06-c23c-4274-8f46-ee37b3661667 tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:16.881126 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-4a75ab06-c23c-4274-8f46-ee37b3661667 tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f6cf9c6c133947f3aecee3a913a32328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e277ebf9cbf4cb0b6be14efbec504bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:16.882293 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-4a75ab06-c23c-4274-8f46-ee37b3661667 tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] Searching by: {'deleted': False, 'project_id': '4e277ebf9cbf4cb0b6be14efbec504bf'} {{(pid=140492) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 08 20:56:16.894236 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4a75ab06-c23c-4274-8f46-ee37b3661667 tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:16.895204 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4a75ab06-c23c-4274-8f46-ee37b3661667 tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:16.895942 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4a75ab06-c23c-4274-8f46-ee37b3661667 tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:16.896960 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4a75ab06-c23c-4274-8f46-ee37b3661667 tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:16.898117 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4a75ab06-c23c-4274-8f46-ee37b3661667 tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:16.899104 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4a75ab06-c23c-4274-8f46-ee37b3661667 tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:17.038253 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.multi_cell_list [None req-4a75ab06-c23c-4274-8f46-ee37b3661667 tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=140492) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 08 20:56:17.130427 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-4a75ab06-c23c-4274-8f46-ee37b3661667 tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] 10.222.0.26 "GET /compute/v2.1/servers" status: 200 len: 333 microversion: 2.1 time: 0.264507 Oct 08 20:56:17.131315 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 624/1194] 10.222.0.26 () {58 vars in 1125 bytes} [Sat Oct 8 20:56:16 2022] GET /compute/v2.1/servers => generated 333 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:56:17.141151 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-18fad771-5849-4c59-bad5-b8fc26ab7829 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:17.142256 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-18fad771-5849-4c59-bad5-b8fc26ab7829 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] [instance: 7f720341-f7ad-4365-8aeb-0aad8afb46b6] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:56:17.310854 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-18fad771-5849-4c59-bad5-b8fc26ab7829 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05f0f7a60257437eaa8702b664916979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7550f7ad9dc45ba9c9bfb0a5a11a774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:17.336369 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-18fad771-5849-4c59-bad5-b8fc26ab7829 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] 10.222.0.26 "GET /compute/v2.1/servers/7f720341-f7ad-4365-8aeb-0aad8afb46b6" status: 200 len: 1218 microversion: 2.1 time: 0.191333 Oct 08 20:56:17.338186 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 625/1195] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:56:17 2022] GET /compute/v2.1/servers/7f720341-f7ad-4365-8aeb-0aad8afb46b6 => generated 1218 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:56:17.353112 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-08822f8d-9346-4044-8d38-dbf9590ab7f6 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-945698587", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "networks": [{"uuid": "9fdcecee-d5a8-47c6-bd1b-3fe31d36b4f7"}]}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:56:17.515172 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.network.neutron [None req-08822f8d-9346-4044-8d38-dbf9590ab7f6 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] validate_networks() for [('9fdcecee-d5a8-47c6-bd1b-3fe31d36b4f7', None, None, None, None, None)] {{(pid=140492) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 20:56:18.097755 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-08822f8d-9346-4044-8d38-dbf9590ab7f6 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Flavor limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 20:56:18.101564 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-08822f8d-9346-4044-8d38-dbf9590ab7f6 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Image limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 20:56:18.103035 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-08822f8d-9346-4044-8d38-dbf9590ab7f6 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Flavor pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 20:56:18.103708 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-08822f8d-9346-4044-8d38-dbf9590ab7f6 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Image pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 20:56:18.104406 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-08822f8d-9346-4044-8d38-dbf9590ab7f6 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 20:56:18.128778 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-08822f8d-9346-4044-8d38-dbf9590ab7f6 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:18.129788 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-08822f8d-9346-4044-8d38-dbf9590ab7f6 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:18.130394 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-08822f8d-9346-4044-8d38-dbf9590ab7f6 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:18.131360 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-08822f8d-9346-4044-8d38-dbf9590ab7f6 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:18.132011 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-08822f8d-9346-4044-8d38-dbf9590ab7f6 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:18.132854 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-08822f8d-9346-4044-8d38-dbf9590ab7f6 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:18.154041 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-08822f8d-9346-4044-8d38-dbf9590ab7f6 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Getting quotas for project 1be94d02ab5244f98337fb9b90e74746. Resources: {'cores', 'instances', 'ram'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 20:56:18.160744 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-08822f8d-9346-4044-8d38-dbf9590ab7f6 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Getting quotas for user 5ac1323815364df4a3a4d4dbbb9d70dd and project 1be94d02ab5244f98337fb9b90e74746. Resources: {'cores', 'instances', 'ram'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 20:56:18.177817 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-08822f8d-9346-4044-8d38-dbf9590ab7f6 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Going to run 1 instances... {{(pid=140492) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 20:56:18.181862 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-08822f8d-9346-4044-8d38-dbf9590ab7f6 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] [instance: b5452da7-7cb6-493b-a5d1-4c60ed1e342c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c508bd7f-7db9-4b2c-af7c-be54a855c355',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140492) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 20:56:18.257091 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-08822f8d-9346-4044-8d38-dbf9590ab7f6 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.911157 Oct 08 20:56:18.258457 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 626/1196] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 20:56:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 920 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 08 20:56:18.264049 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e57a7638-1c5b-419c-9b3c-8e78b8bca982 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Calling method '.version_select at 0x7f1a8cacfca0>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:18.375501 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-e57a7638-1c5b-419c-9b3c-8e78b8bca982 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] 10.222.0.26 "GET /compute/v2.1/images/2cee37af-3fa7-4730-97e9-ef19fe423ca1" status: 200 len: 1455 microversion: 2.1 time: 0.111058 Oct 08 20:56:18.377717 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 627/1197] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:56:18 2022] GET /compute/v2.1/images/2cee37af-3fa7-4730-97e9-ef19fe423ca1 => generated 1455 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:56:18.475526 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-eb078f30-fa09-48df-af56-8677468a5dc2 tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:18.537103 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-eb078f30-fa09-48df-af56-8677468a5dc2 tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f6cf9c6c133947f3aecee3a913a32328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e277ebf9cbf4cb0b6be14efbec504bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:18.539058 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-eb078f30-fa09-48df-af56-8677468a5dc2 tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] Searching by: {'deleted': False, 'project_id': '4e277ebf9cbf4cb0b6be14efbec504bf'} {{(pid=140492) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 08 20:56:18.616453 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-eb078f30-fa09-48df-af56-8677468a5dc2 tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:18.616948 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-eb078f30-fa09-48df-af56-8677468a5dc2 tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:18.617463 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-eb078f30-fa09-48df-af56-8677468a5dc2 tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:18.635353 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-eb078f30-fa09-48df-af56-8677468a5dc2 tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:18.636194 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-eb078f30-fa09-48df-af56-8677468a5dc2 tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:18.637179 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-eb078f30-fa09-48df-af56-8677468a5dc2 tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:18.698000 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.multi_cell_list [None req-eb078f30-fa09-48df-af56-8677468a5dc2 tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=140492) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 08 20:56:18.872290 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-eb078f30-fa09-48df-af56-8677468a5dc2 tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6cf9c6c133947f3aecee3a913a32328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e277ebf9cbf4cb0b6be14efbec504bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:18.883750 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-eb078f30-fa09-48df-af56-8677468a5dc2 tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:18.884586 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-eb078f30-fa09-48df-af56-8677468a5dc2 tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:18.885375 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-eb078f30-fa09-48df-af56-8677468a5dc2 tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:19.135514 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-eb078f30-fa09-48df-af56-8677468a5dc2 tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] 10.222.0.26 "GET /compute/v2.1/servers/detail" status: 200 len: 1698 microversion: 2.1 time: 0.731487 Oct 08 20:56:19.137658 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 628/1198] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Oct 8 20:56:18 2022] GET /compute/v2.1/servers/detail => generated 1698 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:56:19.144800 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-ec7620a9-3e02-465c-883f-0bcd78069d5f tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:19.146772 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-ec7620a9-3e02-465c-883f-0bcd78069d5f tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] [instance: 92e31b92-0af1-4da6-bc87-23978f1aedf5] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:56:19.156998 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ec7620a9-3e02-465c-883f-0bcd78069d5f tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:19.158016 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ec7620a9-3e02-465c-883f-0bcd78069d5f tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:19.158541 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ec7620a9-3e02-465c-883f-0bcd78069d5f tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:19.168639 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ec7620a9-3e02-465c-883f-0bcd78069d5f tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:19.169437 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ec7620a9-3e02-465c-883f-0bcd78069d5f tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:19.169913 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ec7620a9-3e02-465c-883f-0bcd78069d5f tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:19.339875 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-ec7620a9-3e02-465c-883f-0bcd78069d5f tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:19.353518 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-ec7620a9-3e02-465c-883f-0bcd78069d5f tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:19.354999 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-ec7620a9-3e02-465c-883f-0bcd78069d5f tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:19.362510 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-ec7620a9-3e02-465c-883f-0bcd78069d5f tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] 10.222.0.26 "GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5" status: 200 len: 1480 microversion: 2.91 time: 0.223495 Oct 08 20:56:19.363357 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 629/1199] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:56:19 2022] GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5 => generated 1480 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:56:19.367882 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-a9d5fa93-b3bd-4f33-b061-18647c46fcd7 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:19.368502 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-a9d5fa93-b3bd-4f33-b061-18647c46fcd7 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] [instance: b5452da7-7cb6-493b-a5d1-4c60ed1e342c] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:56:19.398314 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a9d5fa93-b3bd-4f33-b061-18647c46fcd7 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:19.398836 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a9d5fa93-b3bd-4f33-b061-18647c46fcd7 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:19.399289 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a9d5fa93-b3bd-4f33-b061-18647c46fcd7 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:19.400023 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a9d5fa93-b3bd-4f33-b061-18647c46fcd7 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:19.400492 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a9d5fa93-b3bd-4f33-b061-18647c46fcd7 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:19.400928 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a9d5fa93-b3bd-4f33-b061-18647c46fcd7 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:19.537714 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-a9d5fa93-b3bd-4f33-b061-18647c46fcd7 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac1323815364df4a3a4d4dbbb9d70dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be94d02ab5244f98337fb9b90e74746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:19.562237 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-a9d5fa93-b3bd-4f33-b061-18647c46fcd7 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] 10.222.0.26 "GET /compute/v2.1/servers/b5452da7-7cb6-493b-a5d1-4c60ed1e342c" status: 200 len: 1211 microversion: 2.1 time: 0.197780 Oct 08 20:56:19.566181 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 630/1200] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:56:19 2022] GET /compute/v2.1/servers/b5452da7-7cb6-493b-a5d1-4c60ed1e342c => generated 1211 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:56:19.575460 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-c533cc3a-4c8b-4a8f-80bd-c21d48f75ca1 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:19.576124 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-c533cc3a-4c8b-4a8f-80bd-c21d48f75ca1 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] [instance: 7f720341-f7ad-4365-8aeb-0aad8afb46b6] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:56:19.591901 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c533cc3a-4c8b-4a8f-80bd-c21d48f75ca1 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:19.592551 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c533cc3a-4c8b-4a8f-80bd-c21d48f75ca1 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:19.593049 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c533cc3a-4c8b-4a8f-80bd-c21d48f75ca1 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:19.593862 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c533cc3a-4c8b-4a8f-80bd-c21d48f75ca1 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:19.594471 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c533cc3a-4c8b-4a8f-80bd-c21d48f75ca1 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:19.594917 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c533cc3a-4c8b-4a8f-80bd-c21d48f75ca1 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:19.682648 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-c533cc3a-4c8b-4a8f-80bd-c21d48f75ca1 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05f0f7a60257437eaa8702b664916979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7550f7ad9dc45ba9c9bfb0a5a11a774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:19.693584 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-c533cc3a-4c8b-4a8f-80bd-c21d48f75ca1 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] 10.222.0.26 "GET /compute/v2.1/servers/7f720341-f7ad-4365-8aeb-0aad8afb46b6" status: 200 len: 1270 microversion: 2.1 time: 0.126309 Oct 08 20:56:19.694967 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 631/1201] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:56:19 2022] GET /compute/v2.1/servers/7f720341-f7ad-4365-8aeb-0aad8afb46b6 => generated 1270 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:56:19.701664 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-4150120f-bd91-4391-8da6-9ab3972d6a91 tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:19.712518 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-4150120f-bd91-4391-8da6-9ab3972d6a91 tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] 10.222.0.26 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.016268 Oct 08 20:56:19.716418 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 632/1202] 10.222.0.26 () {58 vars in 1137 bytes} [Sat Oct 8 20:56:19 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:56:19.721503 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-48cacffe-38a1-4d59-9a9f-361e4b046d54 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1887460577", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "0a0864bc-a341-492a-af0c-3d954ca20032"}, {"port": "6a371950-2184-421b-a72d-4525c4232631", "tag": "port-1"}, {"port": "3083c386-8718-4dfc-8fe3-11330119883c", "tag": "port-2"}, {"uuid": "b3b3c98c-ba5b-4a2f-af8f-567b937a21c3", "tag": "net-1"}, {"uuid": "b3b3c98c-ba5b-4a2f-af8f-567b937a21c3"}, {"uuid": "57cadbdc-9816-466a-a38d-900ef4f6845d", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "57cadbdc-9816-466a-a38d-900ef4f6845d", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "b4f8dd99-28cb-4d51-a8bd-a9fed1cd3f21", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "a9750f5d-e3dd-4b3e-a92f-9e65fda40303", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "e89fe668-7e03-49ec-be17-8fa1cabeff3c", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--446169637"}], "key_name": "tempest-keypair-528451165", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:56:19.872708 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-0d545a33-08df-438b-8e60-2b40df12f7c9 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/e338d559-3f7c-4cc8-95c6-face79e11ca2/action" status: 202 len: 0 microversion: 2.1 time: 3.474684 Oct 08 20:56:19.873686 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 571/1203] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 20:56:16 2022] POST /compute/v2.1/servers/e338d559-3f7c-4cc8-95c6-face79e11ca2/action => generated 0 bytes in 3476 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 20:56:19.878687 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-44064333-26f6-4103-adf9-b223935303e5 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Calling method '.version_select at 0x7f1a8c84f0d0>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:19.900358 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.network.neutron [None req-48cacffe-38a1-4d59-9a9f-361e4b046d54 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] validate_networks() for [('0a0864bc-a341-492a-af0c-3d954ca20032', None, None, None, None, None), (None, None, '6a371950-2184-421b-a72d-4525c4232631', None, None, None), (None, None, '3083c386-8718-4dfc-8fe3-11330119883c', None, None, None), ('b3b3c98c-ba5b-4a2f-af8f-567b937a21c3', None, None, None, None, None), ('b3b3c98c-ba5b-4a2f-af8f-567b937a21c3', None, None, None, None, None), ('57cadbdc-9816-466a-a38d-900ef4f6845d', '10.2.2.100', None, None, None, None), ('57cadbdc-9816-466a-a38d-900ef4f6845d', '10.2.2.200', None, None, None, None)] {{(pid=140492) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 20:56:19.939198 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-44064333-26f6-4103-adf9-b223935303e5 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] 10.222.0.26 "GET /compute/v2.1/images/2cee37af-3fa7-4730-97e9-ef19fe423ca1" status: 200 len: 1455 microversion: 2.1 time: 0.064148 Oct 08 20:56:19.940521 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 572/1204] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:56:19 2022] GET /compute/v2.1/images/2cee37af-3fa7-4730-97e9-ef19fe423ca1 => generated 1455 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:56:19.945391 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-e3b0f720-0424-4237-9860-7de97cf8d3db tempest-UnshelveToHostMultiNodesTest-675009540 tempest-UnshelveToHostMultiNodesTest-675009540-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "nch2-master-1"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:56:19.948011 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-e3b0f720-0424-4237-9860-7de97cf8d3db tempest-UnshelveToHostMultiNodesTest-675009540 tempest-UnshelveToHostMultiNodesTest-675009540-project-admin] [instance: 92e31b92-0af1-4da6-bc87-23978f1aedf5] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:56:19.955718 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e3b0f720-0424-4237-9860-7de97cf8d3db tempest-UnshelveToHostMultiNodesTest-675009540 tempest-UnshelveToHostMultiNodesTest-675009540-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:19.956564 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e3b0f720-0424-4237-9860-7de97cf8d3db tempest-UnshelveToHostMultiNodesTest-675009540 tempest-UnshelveToHostMultiNodesTest-675009540-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:19.957877 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e3b0f720-0424-4237-9860-7de97cf8d3db tempest-UnshelveToHostMultiNodesTest-675009540 tempest-UnshelveToHostMultiNodesTest-675009540-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:19.958921 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e3b0f720-0424-4237-9860-7de97cf8d3db tempest-UnshelveToHostMultiNodesTest-675009540 tempest-UnshelveToHostMultiNodesTest-675009540-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:19.960181 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e3b0f720-0424-4237-9860-7de97cf8d3db tempest-UnshelveToHostMultiNodesTest-675009540 tempest-UnshelveToHostMultiNodesTest-675009540-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:19.960850 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e3b0f720-0424-4237-9860-7de97cf8d3db tempest-UnshelveToHostMultiNodesTest-675009540 tempest-UnshelveToHostMultiNodesTest-675009540-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:20.004794 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-e3b0f720-0424-4237-9860-7de97cf8d3db tempest-UnshelveToHostMultiNodesTest-675009540 tempest-UnshelveToHostMultiNodesTest-675009540-project-admin] [instance: 92e31b92-0af1-4da6-bc87-23978f1aedf5] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "nch2-master-1". {{(pid=140491) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 08 20:56:20.090804 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-e3b0f720-0424-4237-9860-7de97cf8d3db tempest-UnshelveToHostMultiNodesTest-675009540 tempest-UnshelveToHostMultiNodesTest-675009540-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5/action" status: 202 len: 0 microversion: 2.91 time: 0.148721 Oct 08 20:56:20.092361 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 573/1205] 10.222.0.26 () {62 vars in 1319 bytes} [Sat Oct 8 20:56:19 2022] POST /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5/action => generated 0 bytes in 151 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 08 20:56:20.102632 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-71a011ae-8a4a-48cd-9ea6-1d2614a3817e tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:20.103441 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-71a011ae-8a4a-48cd-9ea6-1d2614a3817e tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] [instance: e338d559-3f7c-4cc8-95c6-face79e11ca2] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:56:20.112590 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-71a011ae-8a4a-48cd-9ea6-1d2614a3817e tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:20.113692 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-71a011ae-8a4a-48cd-9ea6-1d2614a3817e tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:20.114377 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-71a011ae-8a4a-48cd-9ea6-1d2614a3817e tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:20.115377 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-71a011ae-8a4a-48cd-9ea6-1d2614a3817e tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:20.116042 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-71a011ae-8a4a-48cd-9ea6-1d2614a3817e tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:20.116840 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-71a011ae-8a4a-48cd-9ea6-1d2614a3817e tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:20.303135 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-71a011ae-8a4a-48cd-9ea6-1d2614a3817e tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474ca64d1b1d4e30916b517645aba882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecc2dd2407b4819874bed09cb27959a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:20.316830 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-71a011ae-8a4a-48cd-9ea6-1d2614a3817e tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] 10.222.0.26 "GET /compute/v2.1/servers/e338d559-3f7c-4cc8-95c6-face79e11ca2" status: 200 len: 1718 microversion: 2.1 time: 0.219459 Oct 08 20:56:20.317986 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 574/1206] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:56:20 2022] GET /compute/v2.1/servers/e338d559-3f7c-4cc8-95c6-face79e11ca2 => generated 1718 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:56:20.324175 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-6a790fde-b234-4187-9c49-0d8c30d39c85 tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:20.324929 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-6a790fde-b234-4187-9c49-0d8c30d39c85 tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] [instance: 8b29aacb-435d-4c6c-bbe7-3d5c6e1c622e] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:56:20.333607 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6a790fde-b234-4187-9c49-0d8c30d39c85 tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:20.334302 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6a790fde-b234-4187-9c49-0d8c30d39c85 tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:20.335181 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6a790fde-b234-4187-9c49-0d8c30d39c85 tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:20.336567 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6a790fde-b234-4187-9c49-0d8c30d39c85 tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:20.337252 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6a790fde-b234-4187-9c49-0d8c30d39c85 tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:20.337944 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6a790fde-b234-4187-9c49-0d8c30d39c85 tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:20.374766 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-6a790fde-b234-4187-9c49-0d8c30d39c85 tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] [instance: 8b29aacb-435d-4c6c-bbe7-3d5c6e1c622e] Going to try to terminate instance {{(pid=140491) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 20:56:20.439205 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:56:20.511718 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-6a790fde-b234-4187-9c49-0d8c30d39c85 tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] 10.222.0.26 "DELETE /compute/v2.1/servers/8b29aacb-435d-4c6c-bbe7-3d5c6e1c622e" status: 204 len: 0 microversion: 2.1 time: 0.191253 Oct 08 20:56:20.514417 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 575/1207] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 20:56:20 2022] DELETE /compute/v2.1/servers/8b29aacb-435d-4c6c-bbe7-3d5c6e1c622e => generated 0 bytes in 196 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 20:56:20.520667 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-d069824a-443f-4ebf-ab07-6ae1f0472974 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:20.521599 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-d069824a-443f-4ebf-ab07-6ae1f0472974 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] [instance: 92e31b92-0af1-4da6-bc87-23978f1aedf5] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:56:20.529492 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d069824a-443f-4ebf-ab07-6ae1f0472974 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:20.530077 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d069824a-443f-4ebf-ab07-6ae1f0472974 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:20.530591 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d069824a-443f-4ebf-ab07-6ae1f0472974 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:20.531374 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d069824a-443f-4ebf-ab07-6ae1f0472974 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:20.532132 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d069824a-443f-4ebf-ab07-6ae1f0472974 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:20.533134 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d069824a-443f-4ebf-ab07-6ae1f0472974 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:20.656673 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-d069824a-443f-4ebf-ab07-6ae1f0472974 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:20.676192 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-d069824a-443f-4ebf-ab07-6ae1f0472974 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:20.683816 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-d069824a-443f-4ebf-ab07-6ae1f0472974 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:20.705292 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-d069824a-443f-4ebf-ab07-6ae1f0472974 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] 10.222.0.26 "GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5" status: 200 len: 1488 microversion: 2.91 time: 0.187858 Oct 08 20:56:20.708564 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 576/1208] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:56:20 2022] GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5 => generated 1488 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:56:20.739804 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-6fe94bc6-f768-4352-aac3-f9a249c98323 tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:20.740301 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-6fe94bc6-f768-4352-aac3-f9a249c98323 tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] [instance: 8b29aacb-435d-4c6c-bbe7-3d5c6e1c622e] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:56:20.758441 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6fe94bc6-f768-4352-aac3-f9a249c98323 tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:20.758958 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6fe94bc6-f768-4352-aac3-f9a249c98323 tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:20.760419 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6fe94bc6-f768-4352-aac3-f9a249c98323 tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:20.760419 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6fe94bc6-f768-4352-aac3-f9a249c98323 tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:20.760626 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6fe94bc6-f768-4352-aac3-f9a249c98323 tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:20.763339 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6fe94bc6-f768-4352-aac3-f9a249c98323 tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:21.100634 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-6fe94bc6-f768-4352-aac3-f9a249c98323 tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6cf9c6c133947f3aecee3a913a32328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e277ebf9cbf4cb0b6be14efbec504bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:21.125751 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-6fe94bc6-f768-4352-aac3-f9a249c98323 tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] 10.222.0.26 "GET /compute/v2.1/servers/8b29aacb-435d-4c6c-bbe7-3d5c6e1c622e" status: 200 len: 1701 microversion: 2.1 time: 0.392982 Oct 08 20:56:21.126257 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 577/1209] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:56:20 2022] GET /compute/v2.1/servers/8b29aacb-435d-4c6c-bbe7-3d5c6e1c622e => generated 1701 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:56:21.141659 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-e59d7f35-cdb7-45fc-b3af-ee5efae956ef tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:21.144708 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-e59d7f35-cdb7-45fc-b3af-ee5efae956ef tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] [instance: b5452da7-7cb6-493b-a5d1-4c60ed1e342c] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:56:21.155848 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e59d7f35-cdb7-45fc-b3af-ee5efae956ef tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:21.156350 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e59d7f35-cdb7-45fc-b3af-ee5efae956ef tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:21.161074 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e59d7f35-cdb7-45fc-b3af-ee5efae956ef tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:21.161922 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e59d7f35-cdb7-45fc-b3af-ee5efae956ef tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:21.162428 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e59d7f35-cdb7-45fc-b3af-ee5efae956ef tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:21.162881 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e59d7f35-cdb7-45fc-b3af-ee5efae956ef tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:21.296819 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-e59d7f35-cdb7-45fc-b3af-ee5efae956ef tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac1323815364df4a3a4d4dbbb9d70dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be94d02ab5244f98337fb9b90e74746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:21.308859 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-e59d7f35-cdb7-45fc-b3af-ee5efae956ef tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] 10.222.0.26 "GET /compute/v2.1/servers/b5452da7-7cb6-493b-a5d1-4c60ed1e342c" status: 200 len: 1273 microversion: 2.1 time: 0.180900 Oct 08 20:56:21.314688 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 578/1210] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:56:21 2022] GET /compute/v2.1/servers/b5452da7-7cb6-493b-a5d1-4c60ed1e342c => generated 1273 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:56:21.323051 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-ed9d7dfd-51f5-431f-873d-5984394d5b13 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:21.323854 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-ed9d7dfd-51f5-431f-873d-5984394d5b13 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] [instance: 7f720341-f7ad-4365-8aeb-0aad8afb46b6] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:56:21.336491 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ed9d7dfd-51f5-431f-873d-5984394d5b13 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:21.337906 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ed9d7dfd-51f5-431f-873d-5984394d5b13 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:21.338677 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ed9d7dfd-51f5-431f-873d-5984394d5b13 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:21.339648 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ed9d7dfd-51f5-431f-873d-5984394d5b13 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:21.340280 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ed9d7dfd-51f5-431f-873d-5984394d5b13 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:21.340908 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ed9d7dfd-51f5-431f-873d-5984394d5b13 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:21.534095 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-ed9d7dfd-51f5-431f-873d-5984394d5b13 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05f0f7a60257437eaa8702b664916979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7550f7ad9dc45ba9c9bfb0a5a11a774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:21.543683 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-ed9d7dfd-51f5-431f-873d-5984394d5b13 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] 10.222.0.26 "GET /compute/v2.1/servers/7f720341-f7ad-4365-8aeb-0aad8afb46b6" status: 200 len: 1276 microversion: 2.1 time: 0.227786 Oct 08 20:56:21.544726 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 579/1211] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:56:21 2022] GET /compute/v2.1/servers/7f720341-f7ad-4365-8aeb-0aad8afb46b6 => generated 1276 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:56:21.551621 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-6294d8fe-3a3f-4579-b587-cc4c6facd86e tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Calling method '.version_select at 0x7f1a8c931040>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:21.602973 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-6294d8fe-3a3f-4579-b587-cc4c6facd86e tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] 10.222.0.26 "GET /compute/v2.1/images/2cee37af-3fa7-4730-97e9-ef19fe423ca1" status: 200 len: 1455 microversion: 2.1 time: 0.056910 Oct 08 20:56:21.615842 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 580/1212] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:56:21 2022] GET /compute/v2.1/images/2cee37af-3fa7-4730-97e9-ef19fe423ca1 => generated 1455 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:56:21.621692 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-ae90377c-d473-4a4c-b44f-4c91bda3782f tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:21.622627 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-ae90377c-d473-4a4c-b44f-4c91bda3782f tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] [instance: e338d559-3f7c-4cc8-95c6-face79e11ca2] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:56:21.629599 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ae90377c-d473-4a4c-b44f-4c91bda3782f tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:21.630196 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ae90377c-d473-4a4c-b44f-4c91bda3782f tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:21.630713 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ae90377c-d473-4a4c-b44f-4c91bda3782f tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:21.631499 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ae90377c-d473-4a4c-b44f-4c91bda3782f tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:21.632040 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ae90377c-d473-4a4c-b44f-4c91bda3782f tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:21.632560 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ae90377c-d473-4a4c-b44f-4c91bda3782f tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:22.063327 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-ae90377c-d473-4a4c-b44f-4c91bda3782f tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474ca64d1b1d4e30916b517645aba882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecc2dd2407b4819874bed09cb27959a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:22.076067 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-ae90377c-d473-4a4c-b44f-4c91bda3782f tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] 10.222.0.26 "GET /compute/v2.1/servers/e338d559-3f7c-4cc8-95c6-face79e11ca2" status: 200 len: 1718 microversion: 2.1 time: 0.458664 Oct 08 20:56:22.097448 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 581/1213] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:56:21 2022] GET /compute/v2.1/servers/e338d559-3f7c-4cc8-95c6-face79e11ca2 => generated 1718 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:56:22.106012 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-04eb466e-5dda-4b2f-be2d-1f39f8f560b0 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:22.106629 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-04eb466e-5dda-4b2f-be2d-1f39f8f560b0 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] [instance: 92e31b92-0af1-4da6-bc87-23978f1aedf5] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:56:22.121778 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-04eb466e-5dda-4b2f-be2d-1f39f8f560b0 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:22.133944 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-04eb466e-5dda-4b2f-be2d-1f39f8f560b0 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:22.134433 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-04eb466e-5dda-4b2f-be2d-1f39f8f560b0 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:22.135200 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-04eb466e-5dda-4b2f-be2d-1f39f8f560b0 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:22.135667 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-04eb466e-5dda-4b2f-be2d-1f39f8f560b0 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:22.136726 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-04eb466e-5dda-4b2f-be2d-1f39f8f560b0 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:22.276130 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-04eb466e-5dda-4b2f-be2d-1f39f8f560b0 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:22.308390 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-04eb466e-5dda-4b2f-be2d-1f39f8f560b0 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:22.317374 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-04eb466e-5dda-4b2f-be2d-1f39f8f560b0 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:22.333435 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-04eb466e-5dda-4b2f-be2d-1f39f8f560b0 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] 10.222.0.26 "GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5" status: 200 len: 1546 microversion: 2.91 time: 0.234319 Oct 08 20:56:22.345244 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 582/1214] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:56:22 2022] GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5 => generated 1546 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:56:22.345244 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-4d5eeed5-bf31-422e-9d3d-d3a75a6ae6e8 tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:22.345244 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-4d5eeed5-bf31-422e-9d3d-d3a75a6ae6e8 tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] [instance: 8b29aacb-435d-4c6c-bbe7-3d5c6e1c622e] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:56:22.356301 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4d5eeed5-bf31-422e-9d3d-d3a75a6ae6e8 tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:22.356301 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4d5eeed5-bf31-422e-9d3d-d3a75a6ae6e8 tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:22.356301 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4d5eeed5-bf31-422e-9d3d-d3a75a6ae6e8 tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:22.356301 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4d5eeed5-bf31-422e-9d3d-d3a75a6ae6e8 tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:22.356301 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4d5eeed5-bf31-422e-9d3d-d3a75a6ae6e8 tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:22.356301 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4d5eeed5-bf31-422e-9d3d-d3a75a6ae6e8 tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:23.444982 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-4d5eeed5-bf31-422e-9d3d-d3a75a6ae6e8 tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6cf9c6c133947f3aecee3a913a32328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e277ebf9cbf4cb0b6be14efbec504bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:23.459238 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-4d5eeed5-bf31-422e-9d3d-d3a75a6ae6e8 tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] 10.222.0.26 "GET /compute/v2.1/servers/8b29aacb-435d-4c6c-bbe7-3d5c6e1c622e" status: 200 len: 1701 microversion: 2.1 time: 1.122914 Oct 08 20:56:23.460196 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 583/1215] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:56:22 2022] GET /compute/v2.1/servers/8b29aacb-435d-4c6c-bbe7-3d5c6e1c622e => generated 1701 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:56:23.471807 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-fee438e9-f1e6-4347-b181-917e1a32260d tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:23.472598 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-fee438e9-f1e6-4347-b181-917e1a32260d tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] [instance: b5452da7-7cb6-493b-a5d1-4c60ed1e342c] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:56:23.489354 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fee438e9-f1e6-4347-b181-917e1a32260d tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:23.489986 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fee438e9-f1e6-4347-b181-917e1a32260d tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:23.490547 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fee438e9-f1e6-4347-b181-917e1a32260d tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:23.492899 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fee438e9-f1e6-4347-b181-917e1a32260d tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:23.493518 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fee438e9-f1e6-4347-b181-917e1a32260d tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:23.495995 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fee438e9-f1e6-4347-b181-917e1a32260d tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:24.061333 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-fee438e9-f1e6-4347-b181-917e1a32260d tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac1323815364df4a3a4d4dbbb9d70dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be94d02ab5244f98337fb9b90e74746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:24.070825 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-fee438e9-f1e6-4347-b181-917e1a32260d tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] 10.222.0.26 "GET /compute/v2.1/servers/b5452da7-7cb6-493b-a5d1-4c60ed1e342c" status: 200 len: 1315 microversion: 2.1 time: 0.609276 Oct 08 20:56:24.093757 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 584/1216] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:56:23 2022] GET /compute/v2.1/servers/b5452da7-7cb6-493b-a5d1-4c60ed1e342c => generated 1315 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:56:24.107637 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-1490c38c-fb71-4b31-bdc8-c8d11d6308ca tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:24.108568 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-1490c38c-fb71-4b31-bdc8-c8d11d6308ca tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] [instance: 7f720341-f7ad-4365-8aeb-0aad8afb46b6] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:56:24.125818 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1490c38c-fb71-4b31-bdc8-c8d11d6308ca tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:24.127513 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1490c38c-fb71-4b31-bdc8-c8d11d6308ca tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:24.127513 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1490c38c-fb71-4b31-bdc8-c8d11d6308ca tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:24.133110 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1490c38c-fb71-4b31-bdc8-c8d11d6308ca tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:24.134305 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1490c38c-fb71-4b31-bdc8-c8d11d6308ca tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:24.134837 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1490c38c-fb71-4b31-bdc8-c8d11d6308ca tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:24.666363 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-1490c38c-fb71-4b31-bdc8-c8d11d6308ca tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05f0f7a60257437eaa8702b664916979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7550f7ad9dc45ba9c9bfb0a5a11a774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:24.676282 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-1490c38c-fb71-4b31-bdc8-c8d11d6308ca tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] 10.222.0.26 "GET /compute/v2.1/servers/7f720341-f7ad-4365-8aeb-0aad8afb46b6" status: 200 len: 1318 microversion: 2.1 time: 0.581078 Oct 08 20:56:24.700045 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 585/1217] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:56:24 2022] GET /compute/v2.1/servers/7f720341-f7ad-4365-8aeb-0aad8afb46b6 => generated 1318 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:56:24.705249 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-a81f6099-65c2-477c-aa7b-5c13e5954e47 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Calling method '.version_select at 0x7f1a8c85d280>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:25.710530 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-a81f6099-65c2-477c-aa7b-5c13e5954e47 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] 10.222.0.26 "GET /compute/v2.1/images/2cee37af-3fa7-4730-97e9-ef19fe423ca1" status: 200 len: 1464 microversion: 2.1 time: 1.009006 Oct 08 20:56:25.711121 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 586/1218] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:56:24 2022] GET /compute/v2.1/images/2cee37af-3fa7-4730-97e9-ef19fe423ca1 => generated 1464 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:56:25.731600 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-727320f3-d03f-4c9f-a8ec-e1a25ec3be86 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:25.733677 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-727320f3-d03f-4c9f-a8ec-e1a25ec3be86 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] [instance: e338d559-3f7c-4cc8-95c6-face79e11ca2] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:56:25.753603 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-727320f3-d03f-4c9f-a8ec-e1a25ec3be86 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:25.758096 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-727320f3-d03f-4c9f-a8ec-e1a25ec3be86 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:25.758838 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-727320f3-d03f-4c9f-a8ec-e1a25ec3be86 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:25.759821 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-727320f3-d03f-4c9f-a8ec-e1a25ec3be86 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:25.763247 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-727320f3-d03f-4c9f-a8ec-e1a25ec3be86 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:25.763933 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-727320f3-d03f-4c9f-a8ec-e1a25ec3be86 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:26.514632 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-727320f3-d03f-4c9f-a8ec-e1a25ec3be86 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474ca64d1b1d4e30916b517645aba882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecc2dd2407b4819874bed09cb27959a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:26.535023 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-727320f3-d03f-4c9f-a8ec-e1a25ec3be86 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] 10.222.0.26 "GET /compute/v2.1/servers/e338d559-3f7c-4cc8-95c6-face79e11ca2" status: 200 len: 1718 microversion: 2.1 time: 0.822611 Oct 08 20:56:26.536791 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 587/1219] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:56:25 2022] GET /compute/v2.1/servers/e338d559-3f7c-4cc8-95c6-face79e11ca2 => generated 1718 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:56:26.550475 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-3d4b9a22-7aa3-4cfe-8bd3-35fe54eaedaf tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:26.553158 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-3d4b9a22-7aa3-4cfe-8bd3-35fe54eaedaf tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] [instance: 92e31b92-0af1-4da6-bc87-23978f1aedf5] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:56:26.570280 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3d4b9a22-7aa3-4cfe-8bd3-35fe54eaedaf tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:26.572085 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3d4b9a22-7aa3-4cfe-8bd3-35fe54eaedaf tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:26.575222 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3d4b9a22-7aa3-4cfe-8bd3-35fe54eaedaf tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:26.576622 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3d4b9a22-7aa3-4cfe-8bd3-35fe54eaedaf tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:26.577660 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3d4b9a22-7aa3-4cfe-8bd3-35fe54eaedaf tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:26.579961 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3d4b9a22-7aa3-4cfe-8bd3-35fe54eaedaf tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:26.856103 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-3d4b9a22-7aa3-4cfe-8bd3-35fe54eaedaf tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:26.874037 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-3d4b9a22-7aa3-4cfe-8bd3-35fe54eaedaf tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:26.882926 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-3d4b9a22-7aa3-4cfe-8bd3-35fe54eaedaf tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:26.903462 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-3d4b9a22-7aa3-4cfe-8bd3-35fe54eaedaf tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] 10.222.0.26 "GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5" status: 200 len: 1546 microversion: 2.91 time: 0.365127 Oct 08 20:56:26.928257 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 588/1220] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:56:26 2022] GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5 => generated 1546 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:56:26.946581 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-9cf0a944-94f2-41e3-b91e-220ebc7f94a5 tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:26.947206 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-9cf0a944-94f2-41e3-b91e-220ebc7f94a5 tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] [instance: 8b29aacb-435d-4c6c-bbe7-3d5c6e1c622e] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:56:26.973668 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9cf0a944-94f2-41e3-b91e-220ebc7f94a5 tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:26.977720 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9cf0a944-94f2-41e3-b91e-220ebc7f94a5 tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:26.980907 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9cf0a944-94f2-41e3-b91e-220ebc7f94a5 tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:26.983329 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9cf0a944-94f2-41e3-b91e-220ebc7f94a5 tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:26.984074 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9cf0a944-94f2-41e3-b91e-220ebc7f94a5 tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:26.985377 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9cf0a944-94f2-41e3-b91e-220ebc7f94a5 tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:27.034430 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-9cf0a944-94f2-41e3-b91e-220ebc7f94a5 tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] HTTP exception thrown: Instance 8b29aacb-435d-4c6c-bbe7-3d5c6e1c622e could not be found. Oct 08 20:56:27.039429 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-9cf0a944-94f2-41e3-b91e-220ebc7f94a5 tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] Request method failure captured: Oct 08 20:56:27.039429 ncdv-master-1 devstack@n-api.service[140491]: request: GET /compute/v2.1/servers/8b29aacb-435d-4c6c-bbe7-3d5c6e1c622e HTTP/1.1 Oct 08 20:56:27.039429 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 20:56:27.039429 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 20:56:27.039429 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 20:56:27.039429 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 20:56:27.039429 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 20:56:27.039429 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 20:56:27.039429 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 20:56:27.039429 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 20:56:27.039429 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeOld7SRzfhvply0JI7WG3FSAqmMOCs3lW9Zq5jDxmL2GZyRS1wlxmRKWi6QR_w2A18q7CpVRuVeUPTAqt3MRHDp1SfRSEgMtFpOovn1MhjRolERBhu69DxDeWAuSQvUUItZ4VEFnSudlfGLxPIyhTpVI0FcvxqLb1hP3alMJSWeNyw Oct 08 20:56:27.039429 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 20:56:27.039429 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 20:56:27.039429 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 20:56:27.039429 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 20:56:27.039429 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 20:56:27.039429 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 20:56:27.039429 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 4e277ebf9cbf4cb0b6be14efbec504bf Oct 08 20:56:27.039429 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-ServersTestJSON-2095915534 Oct 08 20:56:27.039429 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 20:56:27.039429 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 20:56:27.039429 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/4e277ebf9cbf4cb0b6be14efbec504bf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4e277ebf9cbf4cb0b6be14efbec504bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_4e277ebf9cbf4cb0b6be14efbec504bf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4e277ebf9cbf4cb0b6be14efbec504bf"}]}] Oct 08 20:56:27.039429 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-ServersTestJSON-2095915534 Oct 08 20:56:27.039429 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 4e277ebf9cbf4cb0b6be14efbec504bf Oct 08 20:56:27.039429 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-ServersTestJSON-2095915534 Oct 08 20:56:27.039429 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-ServersTestJSON-2095915534-project Oct 08 20:56:27.039429 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 20:56:27.039429 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 20:56:27.039429 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: f6cf9c6c133947f3aecee3a913a32328 Oct 08 20:56:27.039429 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-ServersTestJSON-2095915534-project Oct 08 20:56:27.039429 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 20:56:27.039429 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance 8b29aacb-435d-4c6c-bbe7-3d5c6e1c622e could not be found. Oct 08 20:56:27.039429 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': '8b29aacb-435d-4c6c-bbe7-3d5c6e1c622e'} Oct 08 20:56:27.039429 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:56:27.039429 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:56:27.039429 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 20:56:27.039429 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 20:56:27.039429 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 20:56:27.039429 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 20:56:27.039429 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 20:56:27.039429 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 20:56:27.039429 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 20:56:27.039429 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 20:56:27.039429 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b29aacb-435d-4c6c-bbe7-3d5c6e1c622e could not be found. Oct 08 20:56:27.039429 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:56:27.039429 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:56:27.039429 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:56:27.039429 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:56:27.039429 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:56:27.039429 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:56:27.039429 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:56:27.039429 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:56:27.039429 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:56:27.039429 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:56:27.039429 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 20:56:27.039429 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 20:56:27.039429 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 20:56:27.039429 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 20:56:27.039429 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 20:56:27.039429 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 20:56:27.039429 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b29aacb-435d-4c6c-bbe7-3d5c6e1c622e could not be found. Oct 08 20:56:27.039429 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:56:27.039429 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:56:27.039429 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:56:27.044372 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:56:27.044372 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:56:27.044372 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:56:27.044372 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 20:56:27.044372 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 20:56:27.044372 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b29aacb-435d-4c6c-bbe7-3d5c6e1c622e could not be found. Oct 08 20:56:27.044372 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:56:27.046429 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-9cf0a944-94f2-41e3-b91e-220ebc7f94a5 tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] Returning 404 to user: Instance 8b29aacb-435d-4c6c-bbe7-3d5c6e1c622e could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:56:27.048996 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-9cf0a944-94f2-41e3-b91e-220ebc7f94a5 tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] 10.222.0.26 "GET /compute/v2.1/servers/8b29aacb-435d-4c6c-bbe7-3d5c6e1c622e" status: 404 len: 111 microversion: 2.1 time: 0.118638 Oct 08 20:56:27.051829 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 589/1221] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:56:26 2022] GET /compute/v2.1/servers/8b29aacb-435d-4c6c-bbe7-3d5c6e1c622e => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 20:56:27.068190 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c83b9412-ba8a-4c51-9e12-c522b99dbdd9 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:27.069899 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-c83b9412-ba8a-4c51-9e12-c522b99dbdd9 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] [instance: b5452da7-7cb6-493b-a5d1-4c60ed1e342c] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:56:27.077112 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c83b9412-ba8a-4c51-9e12-c522b99dbdd9 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:27.078501 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c83b9412-ba8a-4c51-9e12-c522b99dbdd9 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:27.079127 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c83b9412-ba8a-4c51-9e12-c522b99dbdd9 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:27.080025 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c83b9412-ba8a-4c51-9e12-c522b99dbdd9 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:27.080630 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c83b9412-ba8a-4c51-9e12-c522b99dbdd9 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:27.081252 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c83b9412-ba8a-4c51-9e12-c522b99dbdd9 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:27.266391 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-48cacffe-38a1-4d59-9a9f-361e4b046d54 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Flavor limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 20:56:27.266875 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-48cacffe-38a1-4d59-9a9f-361e4b046d54 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Image limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 20:56:27.267375 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-48cacffe-38a1-4d59-9a9f-361e4b046d54 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Flavor pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 20:56:27.267803 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-48cacffe-38a1-4d59-9a9f-361e4b046d54 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Image pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 20:56:27.268226 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-48cacffe-38a1-4d59-9a9f-361e4b046d54 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 20:56:27.288196 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-48cacffe-38a1-4d59-9a9f-361e4b046d54 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:27.288731 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-48cacffe-38a1-4d59-9a9f-361e4b046d54 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:27.309539 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-48cacffe-38a1-4d59-9a9f-361e4b046d54 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:27.316268 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-48cacffe-38a1-4d59-9a9f-361e4b046d54 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:27.317028 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-48cacffe-38a1-4d59-9a9f-361e4b046d54 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:27.317691 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-48cacffe-38a1-4d59-9a9f-361e4b046d54 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:27.376908 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-48cacffe-38a1-4d59-9a9f-361e4b046d54 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Getting quotas for project ec51fae793a147d88e5d956352f18b92. Resources: {'cores', 'instances', 'ram'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 20:56:27.393475 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-48cacffe-38a1-4d59-9a9f-361e4b046d54 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Getting quotas for user bc0c5c9593754f1cb98f9689b29606a2 and project ec51fae793a147d88e5d956352f18b92. Resources: {'cores', 'instances', 'ram'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 20:56:27.472098 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-c83b9412-ba8a-4c51-9e12-c522b99dbdd9 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac1323815364df4a3a4d4dbbb9d70dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be94d02ab5244f98337fb9b90e74746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:27.498709 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-c83b9412-ba8a-4c51-9e12-c522b99dbdd9 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] 10.222.0.26 "GET /compute/v2.1/servers/b5452da7-7cb6-493b-a5d1-4c60ed1e342c" status: 200 len: 1315 microversion: 2.1 time: 0.445440 Oct 08 20:56:27.499471 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 590/1222] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:56:27 2022] GET /compute/v2.1/servers/b5452da7-7cb6-493b-a5d1-4c60ed1e342c => generated 1315 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:56:27.542976 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-d74f0da7-bfac-4df4-8908-6d92c3d1b525 req-fd80df1d-3605-4367-b6dc-1c9446fa21b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b29aacb-435d-4c6c-bbe7-3d5c6e1c622e", "name": "network-vif-deleted", "tag": "d89da5d3-0c81-4f3c-902a-ac5dee64ec3a"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:56:27.583900 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-d74f0da7-bfac-4df4-8908-6d92c3d1b525 req-fd80df1d-3605-4367-b6dc-1c9446fa21b9 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:27.591783 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-d74f0da7-bfac-4df4-8908-6d92c3d1b525 req-fd80df1d-3605-4367-b6dc-1c9446fa21b9 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:27.592922 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-d74f0da7-bfac-4df4-8908-6d92c3d1b525 req-fd80df1d-3605-4367-b6dc-1c9446fa21b9 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:27.632514 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-d74f0da7-bfac-4df4-8908-6d92c3d1b525 req-fd80df1d-3605-4367-b6dc-1c9446fa21b9 service nova] Creating event network-vif-deleted:d89da5d3-0c81-4f3c-902a-ac5dee64ec3a for instance 8b29aacb-435d-4c6c-bbe7-3d5c6e1c622e on nch2-master-1 Oct 08 20:56:27.674256 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-d74f0da7-bfac-4df4-8908-6d92c3d1b525 req-fd80df1d-3605-4367-b6dc-1c9446fa21b9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142678 Oct 08 20:56:27.674787 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 591/1223] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:56:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:56:27.690175 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-fed6a5b8-b2d1-4dcf-affe-6bd4549df05d tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:27.690891 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-fed6a5b8-b2d1-4dcf-affe-6bd4549df05d tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] [instance: 7f720341-f7ad-4365-8aeb-0aad8afb46b6] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:56:27.707575 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fed6a5b8-b2d1-4dcf-affe-6bd4549df05d tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:27.708109 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fed6a5b8-b2d1-4dcf-affe-6bd4549df05d tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:27.708563 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fed6a5b8-b2d1-4dcf-affe-6bd4549df05d tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:27.711420 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fed6a5b8-b2d1-4dcf-affe-6bd4549df05d tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:27.711912 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fed6a5b8-b2d1-4dcf-affe-6bd4549df05d tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:27.712379 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fed6a5b8-b2d1-4dcf-affe-6bd4549df05d tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:27.845785 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-48cacffe-38a1-4d59-9a9f-361e4b046d54 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Going to run 1 instances... {{(pid=140492) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 20:56:27.848484 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-48cacffe-38a1-4d59-9a9f-361e4b046d54 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] [instance: ceced78a-58d9-4175-b4fe-0d085be62c94] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='b4f8dd99-28cb-4d51-a8bd-a9fed1cd3f21',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='a9750f5d-e3dd-4b3e-a92f-9e65fda40303',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e89fe668-7e03-49ec-be17-8fa1cabeff3c',volume_size=None,volume_type=None)] {{(pid=140492) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 20:56:28.064203 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-fed6a5b8-b2d1-4dcf-affe-6bd4549df05d tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05f0f7a60257437eaa8702b664916979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7550f7ad9dc45ba9c9bfb0a5a11a774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:28.075351 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-fed6a5b8-b2d1-4dcf-affe-6bd4549df05d tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] 10.222.0.26 "GET /compute/v2.1/servers/7f720341-f7ad-4365-8aeb-0aad8afb46b6" status: 200 len: 1318 microversion: 2.1 time: 0.395972 Oct 08 20:56:28.089113 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 592/1224] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:56:27 2022] GET /compute/v2.1/servers/7f720341-f7ad-4365-8aeb-0aad8afb46b6 => generated 1318 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:56:28.089113 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-0865c286-52a6-410a-87f7-6f107fed48c3 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Calling method '.version_select at 0x7f1a8c8d8d30>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:28.159457 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-0865c286-52a6-410a-87f7-6f107fed48c3 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] 10.222.0.26 "GET /compute/v2.1/images/2cee37af-3fa7-4730-97e9-ef19fe423ca1" status: 200 len: 1464 microversion: 2.1 time: 0.081913 Oct 08 20:56:28.159945 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 593/1225] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:56:28 2022] GET /compute/v2.1/images/2cee37af-3fa7-4730-97e9-ef19fe423ca1 => generated 1464 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:56:28.172678 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-da1f6194-3be7-41d7-b137-7c9f62250e06 tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] Calling method '.version_select at 0x7f1a8c8011f0>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:28.202272 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-da1f6194-3be7-41d7-b137-7c9f62250e06 tempest-ServersTestJSON-2095915534 tempest-ServersTestJSON-2095915534-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2083264648" status: 202 len: 0 microversion: 2.1 time: 0.040568 Oct 08 20:56:28.203708 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 594/1226] 10.222.0.26 () {58 vars in 1221 bytes} [Sat Oct 8 20:56:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2083264648 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 20:56:28.212515 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-fe004fdd-218b-4a2d-bcd2-2ab75670df7b tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:28.213874 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-fe004fdd-218b-4a2d-bcd2-2ab75670df7b tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] [instance: e338d559-3f7c-4cc8-95c6-face79e11ca2] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:56:28.227974 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fe004fdd-218b-4a2d-bcd2-2ab75670df7b tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:28.228850 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fe004fdd-218b-4a2d-bcd2-2ab75670df7b tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:28.230217 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fe004fdd-218b-4a2d-bcd2-2ab75670df7b tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:28.232328 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fe004fdd-218b-4a2d-bcd2-2ab75670df7b tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:28.233849 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fe004fdd-218b-4a2d-bcd2-2ab75670df7b tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:28.234926 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fe004fdd-218b-4a2d-bcd2-2ab75670df7b tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:28.478645 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-fe004fdd-218b-4a2d-bcd2-2ab75670df7b tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474ca64d1b1d4e30916b517645aba882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecc2dd2407b4819874bed09cb27959a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:28.490412 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-fe004fdd-218b-4a2d-bcd2-2ab75670df7b tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] 10.222.0.26 "GET /compute/v2.1/servers/e338d559-3f7c-4cc8-95c6-face79e11ca2" status: 200 len: 1718 microversion: 2.1 time: 0.285188 Oct 08 20:56:28.492427 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 595/1227] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:56:28 2022] GET /compute/v2.1/servers/e338d559-3f7c-4cc8-95c6-face79e11ca2 => generated 1718 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:56:28.517093 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-026b23a1-52ac-4cb8-8c77-8c5baa98e75c tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:28.518291 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-026b23a1-52ac-4cb8-8c77-8c5baa98e75c tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] [instance: 57016fcf-2d2c-488c-9af6-0530ebc199f6] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:56:28.527799 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-026b23a1-52ac-4cb8-8c77-8c5baa98e75c tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:28.528478 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-026b23a1-52ac-4cb8-8c77-8c5baa98e75c tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:28.528920 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-026b23a1-52ac-4cb8-8c77-8c5baa98e75c tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:28.530153 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-026b23a1-52ac-4cb8-8c77-8c5baa98e75c tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:28.548373 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-026b23a1-52ac-4cb8-8c77-8c5baa98e75c tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:28.549247 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-026b23a1-52ac-4cb8-8c77-8c5baa98e75c tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:28.590638 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-48cacffe-38a1-4d59-9a9f-361e4b046d54 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.42 time: 8.872882 Oct 08 20:56:28.603868 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 633/1228] 10.222.0.26 () {62 vars in 1189 bytes} [Sat Oct 8 20:56:19 2022] POST /compute/v2.1/servers => generated 405 bytes in 8887 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 08 20:56:28.626526 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-76012700-2f76-402d-b586-cbd6cbc139f9 req-2a4dab9d-5bcf-4a79-bb33-8ccba22bd83f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5452da7-7cb6-493b-a5d1-4c60ed1e342c", "tag": "93e84696-aa00-46c7-8d5d-36171a311b21"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:56:28.662766 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-76012700-2f76-402d-b586-cbd6cbc139f9 req-2a4dab9d-5bcf-4a79-bb33-8ccba22bd83f service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:28.663552 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-76012700-2f76-402d-b586-cbd6cbc139f9 req-2a4dab9d-5bcf-4a79-bb33-8ccba22bd83f service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:28.664170 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-76012700-2f76-402d-b586-cbd6cbc139f9 req-2a4dab9d-5bcf-4a79-bb33-8ccba22bd83f service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:28.679668 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-76012700-2f76-402d-b586-cbd6cbc139f9 req-2a4dab9d-5bcf-4a79-bb33-8ccba22bd83f service nova] Creating event network-changed:93e84696-aa00-46c7-8d5d-36171a311b21 for instance b5452da7-7cb6-493b-a5d1-4c60ed1e342c on nch2-master-1 Oct 08 20:56:28.687600 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-76012700-2f76-402d-b586-cbd6cbc139f9 req-2a4dab9d-5bcf-4a79-bb33-8ccba22bd83f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081134 Oct 08 20:56:28.688969 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 634/1229] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:56:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:56:28.694716 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-498077af-0d3d-4584-bd1c-2f8865632aa4 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:28.695843 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-498077af-0d3d-4584-bd1c-2f8865632aa4 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] [instance: 92e31b92-0af1-4da6-bc87-23978f1aedf5] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:56:28.704165 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-498077af-0d3d-4584-bd1c-2f8865632aa4 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:28.704786 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-498077af-0d3d-4584-bd1c-2f8865632aa4 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:28.705129 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-498077af-0d3d-4584-bd1c-2f8865632aa4 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:28.705889 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-498077af-0d3d-4584-bd1c-2f8865632aa4 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:28.706366 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-498077af-0d3d-4584-bd1c-2f8865632aa4 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:28.707189 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-498077af-0d3d-4584-bd1c-2f8865632aa4 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:28.807145 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:56:28.816603 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.objects.instance [None req-026b23a1-52ac-4cb8-8c77-8c5baa98e75c tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Lazy-loading 'services' on Instance uuid 57016fcf-2d2c-488c-9af6-0530ebc199f6 {{(pid=140491) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 20:56:28.844507 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-026b23a1-52ac-4cb8-8c77-8c5baa98e75c tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/57016fcf-2d2c-488c-9af6-0530ebc199f6" status: 200 len: 2345 microversion: 2.25 time: 0.350988 Oct 08 20:56:28.857546 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 596/1230] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:56:28 2022] GET /compute/v2.1/servers/57016fcf-2d2c-488c-9af6-0530ebc199f6 => generated 2345 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:56:28.862641 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-3487bbf8-fe3e-4e2f-b4a8-e15e08d21913 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:28.863285 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-3487bbf8-fe3e-4e2f-b4a8-e15e08d21913 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] [instance: 24300a5e-164c-4d97-9a1f-b52359c1c0d6] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:56:28.879095 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3487bbf8-fe3e-4e2f-b4a8-e15e08d21913 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:28.879605 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3487bbf8-fe3e-4e2f-b4a8-e15e08d21913 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:28.880050 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3487bbf8-fe3e-4e2f-b4a8-e15e08d21913 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:28.880778 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3487bbf8-fe3e-4e2f-b4a8-e15e08d21913 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:28.881256 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3487bbf8-fe3e-4e2f-b4a8-e15e08d21913 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:28.881683 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3487bbf8-fe3e-4e2f-b4a8-e15e08d21913 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:28.991589 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-498077af-0d3d-4584-bd1c-2f8865632aa4 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:29.009542 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-498077af-0d3d-4584-bd1c-2f8865632aa4 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:29.014883 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-498077af-0d3d-4584-bd1c-2f8865632aa4 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:29.030711 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-498077af-0d3d-4584-bd1c-2f8865632aa4 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] 10.222.0.26 "GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5" status: 200 len: 1546 microversion: 2.91 time: 0.340312 Oct 08 20:56:29.035492 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 635/1231] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:56:28 2022] GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5 => generated 1546 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:56:29.050251 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-74fa77ea-3cf8-499b-a266-7e187077a533 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:29.051117 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-74fa77ea-3cf8-499b-a266-7e187077a533 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] [instance: b5452da7-7cb6-493b-a5d1-4c60ed1e342c] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:56:29.070611 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-74fa77ea-3cf8-499b-a266-7e187077a533 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:29.071999 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-74fa77ea-3cf8-499b-a266-7e187077a533 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:29.074700 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-74fa77ea-3cf8-499b-a266-7e187077a533 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:29.077643 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-74fa77ea-3cf8-499b-a266-7e187077a533 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:29.079719 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-74fa77ea-3cf8-499b-a266-7e187077a533 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:29.080993 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-74fa77ea-3cf8-499b-a266-7e187077a533 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:29.254881 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-3487bbf8-fe3e-4e2f-b4a8-e15e08d21913 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bce55d7f67347aaaa4c2a687bdff183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb3706a1680419384f4fe9660e87732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:29.269115 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-3487bbf8-fe3e-4e2f-b4a8-e15e08d21913 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] 10.222.0.26 "GET /compute/v2.1/servers/24300a5e-164c-4d97-9a1f-b52359c1c0d6" status: 200 len: 1466 microversion: 2.1 time: 0.410383 Oct 08 20:56:29.269884 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 597/1232] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:56:28 2022] GET /compute/v2.1/servers/24300a5e-164c-4d97-9a1f-b52359c1c0d6 => generated 1466 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:56:29.284097 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-d2e21325-3481-4fb4-ad88-c3ec8c978d98 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:29.285104 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-d2e21325-3481-4fb4-ad88-c3ec8c978d98 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] [instance: ceced78a-58d9-4175-b4fe-0d085be62c94] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:56:29.378533 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-d2e21325-3481-4fb4-ad88-c3ec8c978d98 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:29.391074 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-d2e21325-3481-4fb4-ad88-c3ec8c978d98 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:29.393148 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-d2e21325-3481-4fb4-ad88-c3ec8c978d98 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:29.394948 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-d2e21325-3481-4fb4-ad88-c3ec8c978d98 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] 10.222.0.26 "GET /compute/v2.1/servers/ceced78a-58d9-4175-b4fe-0d085be62c94" status: 200 len: 1285 microversion: 2.42 time: 0.123689 Oct 08 20:56:29.410420 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 598/1233] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:56:29 2022] GET /compute/v2.1/servers/ceced78a-58d9-4175-b4fe-0d085be62c94 => generated 1285 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:56:29.422003 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-a39e3724-90ad-4d5c-a9b0-a29d9304c230 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:29.425965 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a39e3724-90ad-4d5c-a9b0-a29d9304c230 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:29.426441 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a39e3724-90ad-4d5c-a9b0-a29d9304c230 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:29.426938 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a39e3724-90ad-4d5c-a9b0-a29d9304c230 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:29.427746 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a39e3724-90ad-4d5c-a9b0-a29d9304c230 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:29.428274 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a39e3724-90ad-4d5c-a9b0-a29d9304c230 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:29.428903 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a39e3724-90ad-4d5c-a9b0-a29d9304c230 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:29.460023 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-74fa77ea-3cf8-499b-a266-7e187077a533 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac1323815364df4a3a4d4dbbb9d70dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be94d02ab5244f98337fb9b90e74746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:29.474382 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-a39e3724-90ad-4d5c-a9b0-a29d9304c230 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.062635 Oct 08 20:56:29.487996 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 599/1234] 10.222.0.26 () {60 vars in 1217 bytes} [Sat Oct 8 20:56:29 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 08 20:56:29.505500 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-74fa77ea-3cf8-499b-a266-7e187077a533 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] 10.222.0.26 "GET /compute/v2.1/servers/b5452da7-7cb6-493b-a5d1-4c60ed1e342c" status: 200 len: 1315 microversion: 2.1 time: 0.467983 Oct 08 20:56:29.505976 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-d3bb6267-d2f6-44d8-8903-2f813f91d087 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:29.506617 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-d3bb6267-d2f6-44d8-8903-2f813f91d087 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] [instance: 7f720341-f7ad-4365-8aeb-0aad8afb46b6] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:56:29.506909 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 636/1235] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:56:29 2022] GET /compute/v2.1/servers/b5452da7-7cb6-493b-a5d1-4c60ed1e342c => generated 1315 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:56:29.513701 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-a72b08a6-650d-4155-a0ef-3b604d306946 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Calling method '.version_select at 0x7f1a8c961700>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:29.531117 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:56:29.536390 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d3bb6267-d2f6-44d8-8903-2f813f91d087 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:29.536835 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d3bb6267-d2f6-44d8-8903-2f813f91d087 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:29.543324 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d3bb6267-d2f6-44d8-8903-2f813f91d087 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:29.546652 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d3bb6267-d2f6-44d8-8903-2f813f91d087 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:29.547158 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d3bb6267-d2f6-44d8-8903-2f813f91d087 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:29.548138 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d3bb6267-d2f6-44d8-8903-2f813f91d087 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:29.793255 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-a72b08a6-650d-4155-a0ef-3b604d306946 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] 10.222.0.26 "GET /compute/v2.1/images?changes-since=2022-10-08T20%3A54%3A35Z" status: 200 len: 1904 microversion: 2.1 time: 0.280003 Oct 08 20:56:29.794147 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 637/1236] 10.222.0.26 () {58 vars in 1199 bytes} [Sat Oct 8 20:56:29 2022] GET /compute/v2.1/images?changes-since=2022-10-08T20%3A54%3A35Z => generated 1904 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:56:29.808032 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-b7f5c14f-fdd9-4ff7-a371-4891fc427acc tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:29.814042 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-b7f5c14f-fdd9-4ff7-a371-4891fc427acc tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] [instance: e338d559-3f7c-4cc8-95c6-face79e11ca2] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:56:29.832506 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b7f5c14f-fdd9-4ff7-a371-4891fc427acc tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:29.841271 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b7f5c14f-fdd9-4ff7-a371-4891fc427acc tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:29.841955 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b7f5c14f-fdd9-4ff7-a371-4891fc427acc tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:29.842887 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b7f5c14f-fdd9-4ff7-a371-4891fc427acc tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:29.845410 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b7f5c14f-fdd9-4ff7-a371-4891fc427acc tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:29.846057 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b7f5c14f-fdd9-4ff7-a371-4891fc427acc tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:30.021939 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-d3bb6267-d2f6-44d8-8903-2f813f91d087 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05f0f7a60257437eaa8702b664916979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7550f7ad9dc45ba9c9bfb0a5a11a774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:30.034413 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-d3bb6267-d2f6-44d8-8903-2f813f91d087 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] 10.222.0.26 "GET /compute/v2.1/servers/7f720341-f7ad-4365-8aeb-0aad8afb46b6" status: 200 len: 1318 microversion: 2.1 time: 0.553533 Oct 08 20:56:30.035243 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 600/1237] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:56:29 2022] GET /compute/v2.1/servers/7f720341-f7ad-4365-8aeb-0aad8afb46b6 => generated 1318 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:56:30.044135 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-9555e3c1-263e-4ad8-8d6c-e0602b3c4e16 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Calling method '.version_select at 0x7f1a8c847310>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:30.239319 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-9555e3c1-263e-4ad8-8d6c-e0602b3c4e16 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] 10.222.0.26 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-2087431163" status: 200 len: 485 microversion: 2.1 time: 0.202754 Oct 08 20:56:30.240231 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 601/1238] 10.222.0.26 () {58 vars in 1231 bytes} [Sat Oct 8 20:56:30 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-2087431163 => generated 485 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:56:30.247647 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-adc37ff6-c625-4ca3-bb49-88a4316b5a77 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:30.248919 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-adc37ff6-c625-4ca3-bb49-88a4316b5a77 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] [instance: 92e31b92-0af1-4da6-bc87-23978f1aedf5] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:56:30.257595 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-adc37ff6-c625-4ca3-bb49-88a4316b5a77 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:30.259693 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-adc37ff6-c625-4ca3-bb49-88a4316b5a77 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:30.261382 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-adc37ff6-c625-4ca3-bb49-88a4316b5a77 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:30.262493 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-adc37ff6-c625-4ca3-bb49-88a4316b5a77 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:30.263412 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-adc37ff6-c625-4ca3-bb49-88a4316b5a77 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:30.264360 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-adc37ff6-c625-4ca3-bb49-88a4316b5a77 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:30.426054 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-adc37ff6-c625-4ca3-bb49-88a4316b5a77 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:30.437110 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-adc37ff6-c625-4ca3-bb49-88a4316b5a77 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:30.438876 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-adc37ff6-c625-4ca3-bb49-88a4316b5a77 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:30.445340 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-adc37ff6-c625-4ca3-bb49-88a4316b5a77 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] 10.222.0.26 "GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5" status: 200 len: 1546 microversion: 2.91 time: 0.203663 Oct 08 20:56:30.446657 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 602/1239] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:56:30 2022] GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5 => generated 1546 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:56:30.452357 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-cf92a3e2-3d78-4285-9509-998390397b1f tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Calling method '.version_select at 0x7f1a8c8011f0>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:30.624554 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-b7f5c14f-fdd9-4ff7-a371-4891fc427acc tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474ca64d1b1d4e30916b517645aba882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecc2dd2407b4819874bed09cb27959a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:30.637513 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-b7f5c14f-fdd9-4ff7-a371-4891fc427acc tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] 10.222.0.26 "GET /compute/v2.1/servers/e338d559-3f7c-4cc8-95c6-face79e11ca2" status: 200 len: 1718 microversion: 2.1 time: 0.839033 Oct 08 20:56:30.638103 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 638/1240] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:56:29 2022] GET /compute/v2.1/servers/e338d559-3f7c-4cc8-95c6-face79e11ca2 => generated 1718 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:56:30.642913 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-89338f83-1cfc-4e75-96e0-523f155354ba tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:30.646068 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-89338f83-1cfc-4e75-96e0-523f155354ba tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] [instance: ceced78a-58d9-4175-b4fe-0d085be62c94] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:56:30.654347 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-89338f83-1cfc-4e75-96e0-523f155354ba tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:30.655122 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-89338f83-1cfc-4e75-96e0-523f155354ba tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:30.657823 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-89338f83-1cfc-4e75-96e0-523f155354ba tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:30.662135 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-89338f83-1cfc-4e75-96e0-523f155354ba tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:30.662970 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-89338f83-1cfc-4e75-96e0-523f155354ba tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:30.670349 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-89338f83-1cfc-4e75-96e0-523f155354ba tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:30.712574 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-cf92a3e2-3d78-4285-9509-998390397b1f tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] 10.222.0.26 "GET /compute/v2.1/images?server=24300a5e-164c-4d97-9a1f-b52359c1c0d6" status: 200 len: 958 microversion: 2.1 time: 0.264334 Oct 08 20:56:30.726665 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 603/1241] 10.222.0.26 () {58 vars in 1209 bytes} [Sat Oct 8 20:56:30 2022] GET /compute/v2.1/images?server=24300a5e-164c-4d97-9a1f-b52359c1c0d6 => generated 958 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:56:30.738512 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-e5194851-671f-4288-a012-c188fc3f8b7e tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:30.741682 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-e5194851-671f-4288-a012-c188fc3f8b7e tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] [instance: b5452da7-7cb6-493b-a5d1-4c60ed1e342c] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:56:30.767028 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e5194851-671f-4288-a012-c188fc3f8b7e tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:30.767028 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e5194851-671f-4288-a012-c188fc3f8b7e tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:30.767028 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e5194851-671f-4288-a012-c188fc3f8b7e tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:30.767028 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e5194851-671f-4288-a012-c188fc3f8b7e tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:30.767028 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e5194851-671f-4288-a012-c188fc3f8b7e tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:30.767028 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e5194851-671f-4288-a012-c188fc3f8b7e tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:30.941967 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-89338f83-1cfc-4e75-96e0-523f155354ba tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:30.952738 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-89338f83-1cfc-4e75-96e0-523f155354ba tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:30.954255 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-89338f83-1cfc-4e75-96e0-523f155354ba tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:30.955680 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-89338f83-1cfc-4e75-96e0-523f155354ba tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] 10.222.0.26 "GET /compute/v2.1/servers/ceced78a-58d9-4175-b4fe-0d085be62c94" status: 200 len: 1519 microversion: 2.42 time: 0.316329 Oct 08 20:56:30.956965 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 639/1242] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:56:30 2022] GET /compute/v2.1/servers/ceced78a-58d9-4175-b4fe-0d085be62c94 => generated 1519 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:56:30.968893 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-42cca095-c933-441d-b3c4-8fc0d8a74465 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Calling method '.version_select at 0x7f1a914b39d0>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:31.028154 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-42cca095-c933-441d-b3c4-8fc0d8a74465 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] 10.222.0.26 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.26%2Fcompute%2Fv2.1%2Fservers%2F0cbc3ac5-5690-4f4e-a9d1-ea0de18060b1" status: 200 len: 485 microversion: 2.1 time: 0.069929 Oct 08 20:56:31.028855 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 640/1243] 10.222.0.26 () {58 vars in 1317 bytes} [Sat Oct 8 20:56:30 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.26%2Fcompute%2Fv2.1%2Fservers%2F0cbc3ac5-5690-4f4e-a9d1-ea0de18060b1 => generated 485 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:56:31.034875 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-de39a112-1822-49c1-b2c7-a0d8eb689380 req-1a9a7568-516b-4346-9ffb-b8a1d2e61ff8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f720341-f7ad-4365-8aeb-0aad8afb46b6", "tag": "2b088aa4-bf3c-4570-9a9c-462b7126b498"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:56:31.047636 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-de39a112-1822-49c1-b2c7-a0d8eb689380 req-1a9a7568-516b-4346-9ffb-b8a1d2e61ff8 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:31.048275 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-de39a112-1822-49c1-b2c7-a0d8eb689380 req-1a9a7568-516b-4346-9ffb-b8a1d2e61ff8 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:31.048759 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-de39a112-1822-49c1-b2c7-a0d8eb689380 req-1a9a7568-516b-4346-9ffb-b8a1d2e61ff8 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:31.061666 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-de39a112-1822-49c1-b2c7-a0d8eb689380 req-1a9a7568-516b-4346-9ffb-b8a1d2e61ff8 service nova] Creating event network-changed:2b088aa4-bf3c-4570-9a9c-462b7126b498 for instance 7f720341-f7ad-4365-8aeb-0aad8afb46b6 on nch1-master-1 Oct 08 20:56:31.066682 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-de39a112-1822-49c1-b2c7-a0d8eb689380 req-1a9a7568-516b-4346-9ffb-b8a1d2e61ff8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035406 Oct 08 20:56:31.067304 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 641/1244] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:56:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:56:31.075054 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-f2f74187-485b-449d-854d-1f1496c35c62 req-d5613321-6021-4360-a757-3d04fb5798c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24300a5e-164c-4d97-9a1f-b52359c1c0d6", "name": "network-vif-unplugged", "status": "completed", "tag": "2fe7c081-3e45-4535-9c6e-1d2e86219410"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:56:31.085331 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-f2f74187-485b-449d-854d-1f1496c35c62 req-d5613321-6021-4360-a757-3d04fb5798c5 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:31.086168 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-f2f74187-485b-449d-854d-1f1496c35c62 req-d5613321-6021-4360-a757-3d04fb5798c5 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:31.086618 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-f2f74187-485b-449d-854d-1f1496c35c62 req-d5613321-6021-4360-a757-3d04fb5798c5 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:31.099387 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-f2f74187-485b-449d-854d-1f1496c35c62 req-d5613321-6021-4360-a757-3d04fb5798c5 service nova] Creating event network-vif-unplugged:2fe7c081-3e45-4535-9c6e-1d2e86219410 for instance 24300a5e-164c-4d97-9a1f-b52359c1c0d6 on nch1-master-1 Oct 08 20:56:31.104556 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-f2f74187-485b-449d-854d-1f1496c35c62 req-d5613321-6021-4360-a757-3d04fb5798c5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035561 Oct 08 20:56:31.105169 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 642/1245] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:56:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:56:31.111904 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-f28d68d5-53f8-4784-8be3-d2a92c14e40d tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Calling method '.version_select at 0x7f1a8cd640d0>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:31.144010 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-e5194851-671f-4288-a012-c188fc3f8b7e tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac1323815364df4a3a4d4dbbb9d70dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be94d02ab5244f98337fb9b90e74746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:31.153996 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-e5194851-671f-4288-a012-c188fc3f8b7e tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] 10.222.0.26 "GET /compute/v2.1/servers/b5452da7-7cb6-493b-a5d1-4c60ed1e342c" status: 200 len: 1315 microversion: 2.1 time: 0.425891 Oct 08 20:56:31.169049 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 604/1246] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:56:30 2022] GET /compute/v2.1/servers/b5452da7-7cb6-493b-a5d1-4c60ed1e342c => generated 1315 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:56:31.172496 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-f28d68d5-53f8-4784-8be3-d2a92c14e40d tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] 10.222.0.26 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.26%2Fcompute%2Fservers%2F0cbc3ac5-5690-4f4e-a9d1-ea0de18060b1" status: 200 len: 485 microversion: 2.1 time: 0.064721 Oct 08 20:56:31.173086 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 643/1247] 10.222.0.26 () {58 vars in 1303 bytes} [Sat Oct 8 20:56:31 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.26%2Fcompute%2Fservers%2F0cbc3ac5-5690-4f4e-a9d1-ea0de18060b1 => generated 485 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:56:31.174670 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-1d4f7233-5b15-413d-929c-13a349d0403a tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:31.175488 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-1d4f7233-5b15-413d-929c-13a349d0403a tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] [instance: 7f720341-f7ad-4365-8aeb-0aad8afb46b6] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:56:31.182397 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1d4f7233-5b15-413d-929c-13a349d0403a tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:31.183479 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1d4f7233-5b15-413d-929c-13a349d0403a tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:31.184301 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1d4f7233-5b15-413d-929c-13a349d0403a tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:31.185490 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1d4f7233-5b15-413d-929c-13a349d0403a tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:31.186438 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1d4f7233-5b15-413d-929c-13a349d0403a tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:31.187098 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1d4f7233-5b15-413d-929c-13a349d0403a tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:31.188549 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-b606f0f3-f441-46b6-ade7-74e61e87c28b tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Calling method '.version_select at 0x7f1a914b38b0>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:31.314887 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-b606f0f3-f441-46b6-ade7-74e61e87c28b tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] 10.222.0.26 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3282 microversion: 2.1 time: 0.132600 Oct 08 20:56:31.315401 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 644/1248] 10.222.0.26 () {58 vars in 1149 bytes} [Sat Oct 8 20:56:31 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3282 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:56:31.320785 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-cf219e7e-3f95-43dd-b15d-265bfe4492a8 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b0c11645-2e47-4de8-8a67-b49a20d9fe3e", "device": "/dev/xvdb"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:56:31.324926 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-cf219e7e-3f95-43dd-b15d-265bfe4492a8 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] [instance: 57016fcf-2d2c-488c-9af6-0530ebc199f6] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:56:31.331567 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cf219e7e-3f95-43dd-b15d-265bfe4492a8 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:31.332066 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cf219e7e-3f95-43dd-b15d-265bfe4492a8 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:31.332512 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cf219e7e-3f95-43dd-b15d-265bfe4492a8 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:31.333258 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cf219e7e-3f95-43dd-b15d-265bfe4492a8 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:31.333723 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cf219e7e-3f95-43dd-b15d-265bfe4492a8 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:31.334338 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cf219e7e-3f95-43dd-b15d-265bfe4492a8 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:31.650607 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-1d4f7233-5b15-413d-929c-13a349d0403a tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05f0f7a60257437eaa8702b664916979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7550f7ad9dc45ba9c9bfb0a5a11a774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:31.676783 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-1d4f7233-5b15-413d-929c-13a349d0403a tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] 10.222.0.26 "GET /compute/v2.1/servers/7f720341-f7ad-4365-8aeb-0aad8afb46b6" status: 200 len: 1318 microversion: 2.1 time: 0.505406 Oct 08 20:56:31.677765 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 605/1249] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:56:31 2022] GET /compute/v2.1/servers/7f720341-f7ad-4365-8aeb-0aad8afb46b6 => generated 1318 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:56:31.688903 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-9125e9c1-4a1b-48a2-91b0-e6fa3cd2512f tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Calling method '.version_select at 0x7f1a8c839700>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:31.778507 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-9125e9c1-4a1b-48a2-91b0-e6fa3cd2512f tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] 10.222.0.26 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1431 microversion: 2.1 time: 0.093246 Oct 08 20:56:31.779376 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 606/1250] 10.222.0.26 () {58 vars in 1149 bytes} [Sat Oct 8 20:56:31 2022] GET /compute/v2.1/images?type=snapshot => generated 1431 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:56:31.794150 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-65883597-928f-4bc4-a11f-b9f46292cd9f req-ec86d488-c634-42f4-a71b-12304197b154 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e338d559-3f7c-4cc8-95c6-face79e11ca2", "name": "network-vif-unplugged", "status": "completed", "tag": "c9d2434a-d900-4b35-afb9-1bca1da86155"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:56:31.810241 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-65883597-928f-4bc4-a11f-b9f46292cd9f req-ec86d488-c634-42f4-a71b-12304197b154 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:31.810830 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-65883597-928f-4bc4-a11f-b9f46292cd9f req-ec86d488-c634-42f4-a71b-12304197b154 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:31.811899 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-65883597-928f-4bc4-a11f-b9f46292cd9f req-ec86d488-c634-42f4-a71b-12304197b154 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:31.831433 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-65883597-928f-4bc4-a11f-b9f46292cd9f req-ec86d488-c634-42f4-a71b-12304197b154 service nova] Creating event network-vif-unplugged:c9d2434a-d900-4b35-afb9-1bca1da86155 for instance e338d559-3f7c-4cc8-95c6-face79e11ca2 on nch2-master-1 Oct 08 20:56:31.839434 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-65883597-928f-4bc4-a11f-b9f46292cd9f req-ec86d488-c634-42f4-a71b-12304197b154 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.058632 Oct 08 20:56:31.840701 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 607/1251] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:56:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:56:31.847370 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-0e97e440-976c-48db-945d-7d367beb7d73 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:31.848704 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-0e97e440-976c-48db-945d-7d367beb7d73 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] [instance: 92e31b92-0af1-4da6-bc87-23978f1aedf5] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:56:31.860795 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0e97e440-976c-48db-945d-7d367beb7d73 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:31.861873 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0e97e440-976c-48db-945d-7d367beb7d73 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:31.863850 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0e97e440-976c-48db-945d-7d367beb7d73 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:31.864720 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0e97e440-976c-48db-945d-7d367beb7d73 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:31.865407 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0e97e440-976c-48db-945d-7d367beb7d73 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:31.865954 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0e97e440-976c-48db-945d-7d367beb7d73 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:32.357959 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-cf219e7e-3f95-43dd-b15d-265bfe4492a8 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] 10.222.0.26 "POST /compute/v2.1/servers/57016fcf-2d2c-488c-9af6-0530ebc199f6/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 1.040867 Oct 08 20:56:32.375744 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 645/1252] 10.222.0.26 () {62 vars in 1364 bytes} [Sat Oct 8 20:56:31 2022] POST /compute/v2.1/servers/57016fcf-2d2c-488c-9af6-0530ebc199f6/os-volume_attachments => generated 194 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 08 20:56:32.415605 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-3d2e31c1-b079-4082-9f89-d0090e2a76b0 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:32.429852 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-3d2e31c1-b079-4082-9f89-d0090e2a76b0 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] [instance: e338d559-3f7c-4cc8-95c6-face79e11ca2] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:56:32.479633 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3d2e31c1-b079-4082-9f89-d0090e2a76b0 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:32.480144 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3d2e31c1-b079-4082-9f89-d0090e2a76b0 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:32.480590 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3d2e31c1-b079-4082-9f89-d0090e2a76b0 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:32.481344 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3d2e31c1-b079-4082-9f89-d0090e2a76b0 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:32.481807 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3d2e31c1-b079-4082-9f89-d0090e2a76b0 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:32.509229 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-0e97e440-976c-48db-945d-7d367beb7d73 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:32.524070 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3d2e31c1-b079-4082-9f89-d0090e2a76b0 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:32.527803 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-0e97e440-976c-48db-945d-7d367beb7d73 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:32.534257 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-0e97e440-976c-48db-945d-7d367beb7d73 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:32.549963 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-0e97e440-976c-48db-945d-7d367beb7d73 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] 10.222.0.26 "GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5" status: 200 len: 1546 microversion: 2.91 time: 0.706800 Oct 08 20:56:32.559289 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 608/1253] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:56:31 2022] GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5 => generated 1546 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:56:32.585099 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-eb442928-e678-4fdf-9243-07fddc0039d1 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Calling method '.version_select at 0x7f1a8c84f3a0>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:32.832967 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-eb442928-e678-4fdf-9243-07fddc0039d1 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] 10.222.0.26 "GET /compute/v2.1/images?limit=1" status: 200 len: 622 microversion: 2.1 time: 0.272703 Oct 08 20:56:32.833913 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 609/1254] 10.222.0.26 () {58 vars in 1137 bytes} [Sat Oct 8 20:56:32 2022] GET /compute/v2.1/images?limit=1 => generated 622 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:56:32.845943 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-6159866d-1229-4c7c-aa5a-5469fa0923e3 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:32.854643 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-6159866d-1229-4c7c-aa5a-5469fa0923e3 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] [instance: ceced78a-58d9-4175-b4fe-0d085be62c94] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:56:32.876782 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6159866d-1229-4c7c-aa5a-5469fa0923e3 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:32.877386 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6159866d-1229-4c7c-aa5a-5469fa0923e3 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:32.877927 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6159866d-1229-4c7c-aa5a-5469fa0923e3 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:32.878743 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6159866d-1229-4c7c-aa5a-5469fa0923e3 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:32.881135 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6159866d-1229-4c7c-aa5a-5469fa0923e3 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:32.881693 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6159866d-1229-4c7c-aa5a-5469fa0923e3 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:33.354481 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-6159866d-1229-4c7c-aa5a-5469fa0923e3 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:33.373047 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-6159866d-1229-4c7c-aa5a-5469fa0923e3 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:33.377304 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-6159866d-1229-4c7c-aa5a-5469fa0923e3 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:33.382775 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-6159866d-1229-4c7c-aa5a-5469fa0923e3 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] 10.222.0.26 "GET /compute/v2.1/servers/ceced78a-58d9-4175-b4fe-0d085be62c94" status: 200 len: 1519 microversion: 2.42 time: 0.547261 Oct 08 20:56:33.385985 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 610/1255] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:56:32 2022] GET /compute/v2.1/servers/ceced78a-58d9-4175-b4fe-0d085be62c94 => generated 1519 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:56:33.396974 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-66427b66-66b6-4a0f-9d82-e8b358b0d2b9 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:33.400578 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-66427b66-66b6-4a0f-9d82-e8b358b0d2b9 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] [instance: b5452da7-7cb6-493b-a5d1-4c60ed1e342c] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:56:33.412823 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-3d2e31c1-b079-4082-9f89-d0090e2a76b0 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474ca64d1b1d4e30916b517645aba882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecc2dd2407b4819874bed09cb27959a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:33.417294 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:56:33.419425 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-66427b66-66b6-4a0f-9d82-e8b358b0d2b9 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:33.422665 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-66427b66-66b6-4a0f-9d82-e8b358b0d2b9 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:33.423337 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-66427b66-66b6-4a0f-9d82-e8b358b0d2b9 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:33.428794 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-66427b66-66b6-4a0f-9d82-e8b358b0d2b9 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:33.429486 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-66427b66-66b6-4a0f-9d82-e8b358b0d2b9 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:33.431127 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-66427b66-66b6-4a0f-9d82-e8b358b0d2b9 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:33.435509 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-3d2e31c1-b079-4082-9f89-d0090e2a76b0 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] 10.222.0.26 "GET /compute/v2.1/servers/e338d559-3f7c-4cc8-95c6-face79e11ca2" status: 200 len: 1718 microversion: 2.1 time: 1.052469 Oct 08 20:56:33.453240 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 646/1256] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:56:32 2022] GET /compute/v2.1/servers/e338d559-3f7c-4cc8-95c6-face79e11ca2 => generated 1718 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:56:33.461438 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-828bfdca-15a3-4802-8984-6f152864ba1b tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:33.464277 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-828bfdca-15a3-4802-8984-6f152864ba1b tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] [instance: 7f720341-f7ad-4365-8aeb-0aad8afb46b6] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:56:33.480309 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-828bfdca-15a3-4802-8984-6f152864ba1b tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:33.485767 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-828bfdca-15a3-4802-8984-6f152864ba1b tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:33.486654 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-828bfdca-15a3-4802-8984-6f152864ba1b tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:33.488158 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-828bfdca-15a3-4802-8984-6f152864ba1b tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:33.493893 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-828bfdca-15a3-4802-8984-6f152864ba1b tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:33.494668 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-828bfdca-15a3-4802-8984-6f152864ba1b tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:33.899309 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-828bfdca-15a3-4802-8984-6f152864ba1b tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05f0f7a60257437eaa8702b664916979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7550f7ad9dc45ba9c9bfb0a5a11a774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:33.912863 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-828bfdca-15a3-4802-8984-6f152864ba1b tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] 10.222.0.26 "GET /compute/v2.1/servers/7f720341-f7ad-4365-8aeb-0aad8afb46b6" status: 200 len: 1318 microversion: 2.1 time: 0.458188 Oct 08 20:56:33.916338 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 647/1257] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:56:33 2022] GET /compute/v2.1/servers/7f720341-f7ad-4365-8aeb-0aad8afb46b6 => generated 1318 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:56:33.926764 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-b4a86eb8-14be-47db-ab16-e596d56dabc5 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Calling method '.version_select at 0x7f1a9146ec10>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:34.077781 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-66427b66-66b6-4a0f-9d82-e8b358b0d2b9 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac1323815364df4a3a4d4dbbb9d70dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be94d02ab5244f98337fb9b90e74746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:34.091490 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-66427b66-66b6-4a0f-9d82-e8b358b0d2b9 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] 10.222.0.26 "GET /compute/v2.1/servers/b5452da7-7cb6-493b-a5d1-4c60ed1e342c" status: 200 len: 1315 microversion: 2.1 time: 0.702805 Oct 08 20:56:34.101887 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 611/1258] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:56:33 2022] GET /compute/v2.1/servers/b5452da7-7cb6-493b-a5d1-4c60ed1e342c => generated 1315 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:56:34.116923 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-bd60960c-092e-46b1-8e17-6acb2e7723c3 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:34.117572 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-bd60960c-092e-46b1-8e17-6acb2e7723c3 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] [instance: 92e31b92-0af1-4da6-bc87-23978f1aedf5] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:56:34.134770 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bd60960c-092e-46b1-8e17-6acb2e7723c3 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:34.137732 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bd60960c-092e-46b1-8e17-6acb2e7723c3 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:34.138398 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bd60960c-092e-46b1-8e17-6acb2e7723c3 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:34.140533 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bd60960c-092e-46b1-8e17-6acb2e7723c3 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:34.142521 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bd60960c-092e-46b1-8e17-6acb2e7723c3 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:34.154150 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bd60960c-092e-46b1-8e17-6acb2e7723c3 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:34.190598 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-b4a86eb8-14be-47db-ab16-e596d56dabc5 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] 10.222.0.26 "GET /compute/v2.1/images/detail?changes-since=2022-10-08T20%3A54%3A29Z" status: 200 len: 6335 microversion: 2.1 time: 0.269903 Oct 08 20:56:34.203590 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 648/1259] 10.222.0.26 () {58 vars in 1220 bytes} [Sat Oct 8 20:56:33 2022] GET /compute/v2.1/images/detail?changes-since=2022-10-08T20%3A54%3A29Z => generated 6335 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:56:34.214249 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-0e345cf2-be5f-4cd5-ac48-ca0d8825fff9 req-90d3ac4e-1db0-4f7f-8b6a-5a798399d9c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e338d559-3f7c-4cc8-95c6-face79e11ca2", "tag": "c9d2434a-d900-4b35-afb9-1bca1da86155"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:56:34.256213 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-0e345cf2-be5f-4cd5-ac48-ca0d8825fff9 req-90d3ac4e-1db0-4f7f-8b6a-5a798399d9c3 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:34.266101 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-0e345cf2-be5f-4cd5-ac48-ca0d8825fff9 req-90d3ac4e-1db0-4f7f-8b6a-5a798399d9c3 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:34.266984 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-0e345cf2-be5f-4cd5-ac48-ca0d8825fff9 req-90d3ac4e-1db0-4f7f-8b6a-5a798399d9c3 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:34.307742 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-0e345cf2-be5f-4cd5-ac48-ca0d8825fff9 req-90d3ac4e-1db0-4f7f-8b6a-5a798399d9c3 service nova] Creating event network-changed:c9d2434a-d900-4b35-afb9-1bca1da86155 for instance e338d559-3f7c-4cc8-95c6-face79e11ca2 on nch2-master-1 Oct 08 20:56:34.317368 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-0e345cf2-be5f-4cd5-ac48-ca0d8825fff9 req-90d3ac4e-1db0-4f7f-8b6a-5a798399d9c3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112042 Oct 08 20:56:34.318622 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 649/1260] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:56:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:56:34.329638 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-b491116a-bc40-4b9d-9534-bba75b58ceb5 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Calling method '.version_select at 0x7f1a914b35e0>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:34.441975 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-b491116a-bc40-4b9d-9534-bba75b58ceb5 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] 10.222.0.26 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-2087431163" status: 200 len: 665 microversion: 2.1 time: 0.121272 Oct 08 20:56:34.445768 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 650/1261] 10.222.0.26 () {58 vars in 1252 bytes} [Sat Oct 8 20:56:34 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-2087431163 => generated 665 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:56:34.472181 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-c8f2b35a-dfe2-4611-9914-ab83d60179b8 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:34.477370 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-c8f2b35a-dfe2-4611-9914-ab83d60179b8 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] [instance: ceced78a-58d9-4175-b4fe-0d085be62c94] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:56:34.503527 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c8f2b35a-dfe2-4611-9914-ab83d60179b8 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:34.504570 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c8f2b35a-dfe2-4611-9914-ab83d60179b8 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:34.505802 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c8f2b35a-dfe2-4611-9914-ab83d60179b8 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:34.507331 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c8f2b35a-dfe2-4611-9914-ab83d60179b8 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:34.509683 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c8f2b35a-dfe2-4611-9914-ab83d60179b8 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:34.510968 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c8f2b35a-dfe2-4611-9914-ab83d60179b8 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:34.557842 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-bd60960c-092e-46b1-8e17-6acb2e7723c3 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:34.581433 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-bd60960c-092e-46b1-8e17-6acb2e7723c3 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:34.583405 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-bd60960c-092e-46b1-8e17-6acb2e7723c3 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:34.614328 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-bd60960c-092e-46b1-8e17-6acb2e7723c3 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] 10.222.0.26 "GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5" status: 200 len: 1546 microversion: 2.91 time: 0.502990 Oct 08 20:56:34.616350 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 612/1262] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:56:34 2022] GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5 => generated 1546 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:56:34.630358 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-95502997-c806-485f-8e0b-309e68754b9d tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:34.631368 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-95502997-c806-485f-8e0b-309e68754b9d tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] [instance: e338d559-3f7c-4cc8-95c6-face79e11ca2] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:56:34.646783 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-95502997-c806-485f-8e0b-309e68754b9d tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:34.647639 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-95502997-c806-485f-8e0b-309e68754b9d tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:34.651675 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-c8f2b35a-dfe2-4611-9914-ab83d60179b8 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:34.659949 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-95502997-c806-485f-8e0b-309e68754b9d tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:34.660797 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-95502997-c806-485f-8e0b-309e68754b9d tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:34.664947 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-c8f2b35a-dfe2-4611-9914-ab83d60179b8 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:34.665445 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-95502997-c806-485f-8e0b-309e68754b9d tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:34.665984 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-95502997-c806-485f-8e0b-309e68754b9d tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:34.671319 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-c8f2b35a-dfe2-4611-9914-ab83d60179b8 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:34.674528 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-c8f2b35a-dfe2-4611-9914-ab83d60179b8 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] 10.222.0.26 "GET /compute/v2.1/servers/ceced78a-58d9-4175-b4fe-0d085be62c94" status: 200 len: 1575 microversion: 2.42 time: 0.212840 Oct 08 20:56:34.687120 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 651/1263] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:56:34 2022] GET /compute/v2.1/servers/ceced78a-58d9-4175-b4fe-0d085be62c94 => generated 1575 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:56:34.705308 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-5b933584-f6b2-474b-8219-48cafd048444 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Calling method '.version_select at 0x7f1a9146e4c0>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:34.822014 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-5b933584-f6b2-474b-8219-48cafd048444 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] 10.222.0.26 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.26%2Fcompute%2Fv2.1%2Fservers%2F0cbc3ac5-5690-4f4e-a9d1-ea0de18060b1" status: 200 len: 1467 microversion: 2.1 time: 0.134402 Oct 08 20:56:34.823316 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 652/1264] 10.222.0.26 () {58 vars in 1338 bytes} [Sat Oct 8 20:56:34 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.26%2Fcompute%2Fv2.1%2Fservers%2F0cbc3ac5-5690-4f4e-a9d1-ea0de18060b1 => generated 1467 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:56:34.840635 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-bdce2c66-b6c0-45ea-9267-c674369b2b48 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Calling method '.version_select at 0x7f1a914e29d0>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:34.925881 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-bdce2c66-b6c0-45ea-9267-c674369b2b48 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] 10.222.0.26 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.26%2Fcompute%2Fservers%2F0cbc3ac5-5690-4f4e-a9d1-ea0de18060b1" status: 200 len: 1467 microversion: 2.1 time: 0.090985 Oct 08 20:56:34.926465 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 653/1265] 10.222.0.26 () {58 vars in 1324 bytes} [Sat Oct 8 20:56:34 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.26%2Fcompute%2Fservers%2F0cbc3ac5-5690-4f4e-a9d1-ea0de18060b1 => generated 1467 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 20:56:34.950193 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-4df9c7eb-64ce-475b-bd0c-d4c1f3d748d3 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:34.950900 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-4df9c7eb-64ce-475b-bd0c-d4c1f3d748d3 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] [instance: 7f720341-f7ad-4365-8aeb-0aad8afb46b6] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:56:34.965600 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4df9c7eb-64ce-475b-bd0c-d4c1f3d748d3 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:34.966063 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4df9c7eb-64ce-475b-bd0c-d4c1f3d748d3 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:34.966532 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4df9c7eb-64ce-475b-bd0c-d4c1f3d748d3 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:34.976832 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4df9c7eb-64ce-475b-bd0c-d4c1f3d748d3 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:34.977437 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4df9c7eb-64ce-475b-bd0c-d4c1f3d748d3 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:34.977894 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4df9c7eb-64ce-475b-bd0c-d4c1f3d748d3 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:35.149986 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-95502997-c806-485f-8e0b-309e68754b9d tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474ca64d1b1d4e30916b517645aba882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecc2dd2407b4819874bed09cb27959a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:35.160203 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-95502997-c806-485f-8e0b-309e68754b9d tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] 10.222.0.26 "GET /compute/v2.1/servers/e338d559-3f7c-4cc8-95c6-face79e11ca2" status: 200 len: 1718 microversion: 2.1 time: 0.542380 Oct 08 20:56:35.168367 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 613/1266] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:56:34 2022] GET /compute/v2.1/servers/e338d559-3f7c-4cc8-95c6-face79e11ca2 => generated 1718 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:56:35.173349 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-221bfa7e-8ce4-49a8-9c9a-6d7e9dd2a2c3 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Calling method '.version_select at 0x7f1a8c931a60>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:35.204315 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-4df9c7eb-64ce-475b-bd0c-d4c1f3d748d3 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05f0f7a60257437eaa8702b664916979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7550f7ad9dc45ba9c9bfb0a5a11a774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:35.214070 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-4df9c7eb-64ce-475b-bd0c-d4c1f3d748d3 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] 10.222.0.26 "GET /compute/v2.1/servers/7f720341-f7ad-4365-8aeb-0aad8afb46b6" status: 200 len: 1318 microversion: 2.1 time: 0.278764 Oct 08 20:56:35.238054 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 654/1267] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:56:34 2022] GET /compute/v2.1/servers/7f720341-f7ad-4365-8aeb-0aad8afb46b6 => generated 1318 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:56:35.245298 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-39fdf318-4b23-4d32-a89d-4d601561780b tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:35.246179 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-39fdf318-4b23-4d32-a89d-4d601561780b tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] [instance: b5452da7-7cb6-493b-a5d1-4c60ed1e342c] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:56:35.257494 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-39fdf318-4b23-4d32-a89d-4d601561780b tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:35.263946 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-39fdf318-4b23-4d32-a89d-4d601561780b tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:35.264625 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-39fdf318-4b23-4d32-a89d-4d601561780b tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:35.265589 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-39fdf318-4b23-4d32-a89d-4d601561780b tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:35.266218 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-39fdf318-4b23-4d32-a89d-4d601561780b tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:35.266834 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-39fdf318-4b23-4d32-a89d-4d601561780b tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:35.419417 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-221bfa7e-8ce4-49a8-9c9a-6d7e9dd2a2c3 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] 10.222.0.26 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7110 microversion: 2.1 time: 0.249652 Oct 08 20:56:35.426774 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 614/1268] 10.222.0.26 () {58 vars in 1170 bytes} [Sat Oct 8 20:56:35 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7110 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:56:35.455034 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-ddefce94-0b3a-41b1-b235-22fbc611242a tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Calling method '.version_select at 0x7f1a8c9a2dc0>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:35.547532 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-39fdf318-4b23-4d32-a89d-4d601561780b tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac1323815364df4a3a4d4dbbb9d70dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be94d02ab5244f98337fb9b90e74746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:35.556081 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-39fdf318-4b23-4d32-a89d-4d601561780b tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] 10.222.0.26 "GET /compute/v2.1/servers/b5452da7-7cb6-493b-a5d1-4c60ed1e342c" status: 200 len: 1315 microversion: 2.1 time: 0.316581 Oct 08 20:56:35.562165 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 655/1269] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:56:35 2022] GET /compute/v2.1/servers/b5452da7-7cb6-493b-a5d1-4c60ed1e342c => generated 1315 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:56:35.612385 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-ddefce94-0b3a-41b1-b235-22fbc611242a tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] 10.222.0.26 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4377 microversion: 2.1 time: 0.160858 Oct 08 20:56:35.617836 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 615/1270] 10.222.0.26 () {58 vars in 1170 bytes} [Sat Oct 8 20:56:35 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4377 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:56:35.644285 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-cc8b3025-27b2-47b4-b7bc-c85b00ea2a6b tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:35.645105 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-cc8b3025-27b2-47b4-b7bc-c85b00ea2a6b tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] [instance: 92e31b92-0af1-4da6-bc87-23978f1aedf5] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:56:35.647272 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-a71d97ca-c746-4c4a-8329-3b4040e8fb51 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Calling method '.version_select at 0x7f1a914b3160>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:35.671683 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cc8b3025-27b2-47b4-b7bc-c85b00ea2a6b tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:35.672375 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cc8b3025-27b2-47b4-b7bc-c85b00ea2a6b tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:35.676990 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cc8b3025-27b2-47b4-b7bc-c85b00ea2a6b tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:35.677946 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cc8b3025-27b2-47b4-b7bc-c85b00ea2a6b tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:35.678522 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cc8b3025-27b2-47b4-b7bc-c85b00ea2a6b tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:35.679095 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cc8b3025-27b2-47b4-b7bc-c85b00ea2a6b tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:35.727282 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-a71d97ca-c746-4c4a-8329-3b4040e8fb51 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] 10.222.0.26 "GET /compute/v2.1/images/c508bd7f-7db9-4b2c-af7c-be54a855c355" status: 200 len: 784 microversion: 2.1 time: 0.096762 Oct 08 20:56:35.729309 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 656/1271] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:56:35 2022] GET /compute/v2.1/images/c508bd7f-7db9-4b2c-af7c-be54a855c355 => generated 784 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:56:35.756483 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e3375434-a72c-480e-bf2d-54bd9208d9fb tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:35.757092 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-e3375434-a72c-480e-bf2d-54bd9208d9fb tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] [instance: ceced78a-58d9-4175-b4fe-0d085be62c94] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:56:35.768386 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e3375434-a72c-480e-bf2d-54bd9208d9fb tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:35.771171 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e3375434-a72c-480e-bf2d-54bd9208d9fb tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:35.771686 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e3375434-a72c-480e-bf2d-54bd9208d9fb tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:35.772423 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e3375434-a72c-480e-bf2d-54bd9208d9fb tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:35.776588 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e3375434-a72c-480e-bf2d-54bd9208d9fb tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:35.777119 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e3375434-a72c-480e-bf2d-54bd9208d9fb tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:35.907244 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-e3375434-a72c-480e-bf2d-54bd9208d9fb tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:35.921488 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-e3375434-a72c-480e-bf2d-54bd9208d9fb tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:35.922947 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-e3375434-a72c-480e-bf2d-54bd9208d9fb tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:35.924109 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-e3375434-a72c-480e-bf2d-54bd9208d9fb tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] 10.222.0.26 "GET /compute/v2.1/servers/ceced78a-58d9-4175-b4fe-0d085be62c94" status: 200 len: 1583 microversion: 2.42 time: 0.193848 Oct 08 20:56:35.957083 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 657/1272] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:56:35 2022] GET /compute/v2.1/servers/ceced78a-58d9-4175-b4fe-0d085be62c94 => generated 1583 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:56:35.962186 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-691492f5-6ec7-4f60-9d38-194e49450f0c tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Calling method '.version_select at 0x7f1a914b3310>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:35.979328 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-cc8b3025-27b2-47b4-b7bc-c85b00ea2a6b tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:35.992635 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-cc8b3025-27b2-47b4-b7bc-c85b00ea2a6b tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:36.008137 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-cc8b3025-27b2-47b4-b7bc-c85b00ea2a6b tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:36.026720 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-cc8b3025-27b2-47b4-b7bc-c85b00ea2a6b tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] 10.222.0.26 "GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5" status: 200 len: 1546 microversion: 2.91 time: 0.386237 Oct 08 20:56:36.042182 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 616/1273] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:56:35 2022] GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5 => generated 1546 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:56:36.087277 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-691492f5-6ec7-4f60-9d38-194e49450f0c tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] 10.222.0.26 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1611 microversion: 2.1 time: 0.128957 Oct 08 20:56:36.090163 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 658/1274] 10.222.0.26 () {58 vars in 1158 bytes} [Sat Oct 8 20:56:35 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1611 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:56:36.105654 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-3f10648b-867e-406b-aee3-fac0ebfcbf47 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Calling method '.version_select at 0x7f1a8c801a60>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:36.201367 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-b069bcb3-3b48-4ae3-a494-5a3783d00ebe tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:36.202151 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-b069bcb3-3b48-4ae3-a494-5a3783d00ebe tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] [instance: e338d559-3f7c-4cc8-95c6-face79e11ca2] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:56:36.225109 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b069bcb3-3b48-4ae3-a494-5a3783d00ebe tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:36.227460 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b069bcb3-3b48-4ae3-a494-5a3783d00ebe tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:36.228218 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b069bcb3-3b48-4ae3-a494-5a3783d00ebe tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:36.231202 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b069bcb3-3b48-4ae3-a494-5a3783d00ebe tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:36.234226 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b069bcb3-3b48-4ae3-a494-5a3783d00ebe tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:36.236711 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b069bcb3-3b48-4ae3-a494-5a3783d00ebe tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:37.023849 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-3f10648b-867e-406b-aee3-fac0ebfcbf47 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] 10.222.0.26 "DELETE /compute/v2.1/images/2cee37af-3fa7-4730-97e9-ef19fe423ca1" status: 204 len: 0 microversion: 2.1 time: 0.922793 Oct 08 20:56:37.028214 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 617/1275] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:56:36 2022] DELETE /compute/v2.1/images/2cee37af-3fa7-4730-97e9-ef19fe423ca1 => generated 0 bytes in 925 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 20:56:37.044072 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-e87eaceb-2480-41ed-98e3-47ee983eacb8 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:37.046118 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-e87eaceb-2480-41ed-98e3-47ee983eacb8 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] [instance: 7f720341-f7ad-4365-8aeb-0aad8afb46b6] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:56:37.074396 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e87eaceb-2480-41ed-98e3-47ee983eacb8 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:37.077791 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e87eaceb-2480-41ed-98e3-47ee983eacb8 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:37.086423 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e87eaceb-2480-41ed-98e3-47ee983eacb8 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:37.087521 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e87eaceb-2480-41ed-98e3-47ee983eacb8 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:37.088768 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e87eaceb-2480-41ed-98e3-47ee983eacb8 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:37.089425 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e87eaceb-2480-41ed-98e3-47ee983eacb8 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:37.259021 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-b069bcb3-3b48-4ae3-a494-5a3783d00ebe tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474ca64d1b1d4e30916b517645aba882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecc2dd2407b4819874bed09cb27959a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:37.278911 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-b069bcb3-3b48-4ae3-a494-5a3783d00ebe tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] 10.222.0.26 "GET /compute/v2.1/servers/e338d559-3f7c-4cc8-95c6-face79e11ca2" status: 200 len: 1718 microversion: 2.1 time: 1.087984 Oct 08 20:56:37.293480 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 659/1276] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:56:36 2022] GET /compute/v2.1/servers/e338d559-3f7c-4cc8-95c6-face79e11ca2 => generated 1718 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 20:56:37.299948 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-0923d97a-a5d7-44c1-b86b-207076385a27 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:37.300582 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-0923d97a-a5d7-44c1-b86b-207076385a27 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] [instance: b5452da7-7cb6-493b-a5d1-4c60ed1e342c] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:56:37.307125 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:56:37.309816 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0923d97a-a5d7-44c1-b86b-207076385a27 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:37.310543 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0923d97a-a5d7-44c1-b86b-207076385a27 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:37.311193 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0923d97a-a5d7-44c1-b86b-207076385a27 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:37.312168 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0923d97a-a5d7-44c1-b86b-207076385a27 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:37.313328 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0923d97a-a5d7-44c1-b86b-207076385a27 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:37.318070 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0923d97a-a5d7-44c1-b86b-207076385a27 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:37.350557 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=10 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:56:37.410360 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-e87eaceb-2480-41ed-98e3-47ee983eacb8 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05f0f7a60257437eaa8702b664916979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7550f7ad9dc45ba9c9bfb0a5a11a774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:37.417784 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=26 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:56:37.424272 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-e87eaceb-2480-41ed-98e3-47ee983eacb8 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] 10.222.0.26 "GET /compute/v2.1/servers/7f720341-f7ad-4365-8aeb-0aad8afb46b6" status: 200 len: 1318 microversion: 2.1 time: 0.397354 Oct 08 20:56:37.434384 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 618/1277] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:56:37 2022] GET /compute/v2.1/servers/7f720341-f7ad-4365-8aeb-0aad8afb46b6 => generated 1318 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:56:37.439525 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-27e59f96-cd42-4fb8-81ae-91caacb67861 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:37.440325 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-27e59f96-cd42-4fb8-81ae-91caacb67861 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] [instance: ceced78a-58d9-4175-b4fe-0d085be62c94] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:56:37.454608 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-27e59f96-cd42-4fb8-81ae-91caacb67861 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:37.455898 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-27e59f96-cd42-4fb8-81ae-91caacb67861 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:37.458939 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-27e59f96-cd42-4fb8-81ae-91caacb67861 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:37.459860 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-27e59f96-cd42-4fb8-81ae-91caacb67861 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:37.462759 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-27e59f96-cd42-4fb8-81ae-91caacb67861 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:37.464364 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-27e59f96-cd42-4fb8-81ae-91caacb67861 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:37.569580 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-27e59f96-cd42-4fb8-81ae-91caacb67861 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:37.579914 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-27e59f96-cd42-4fb8-81ae-91caacb67861 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:37.582110 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-27e59f96-cd42-4fb8-81ae-91caacb67861 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:37.583286 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-27e59f96-cd42-4fb8-81ae-91caacb67861 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] 10.222.0.26 "GET /compute/v2.1/servers/ceced78a-58d9-4175-b4fe-0d085be62c94" status: 200 len: 1593 microversion: 2.42 time: 0.147660 Oct 08 20:56:37.583863 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 619/1278] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:56:37 2022] GET /compute/v2.1/servers/ceced78a-58d9-4175-b4fe-0d085be62c94 => generated 1593 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:56:37.601397 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-4036e005-908a-43dd-bcff-62dedcba1ef5 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Calling method '.version_select at 0x7f1a8c7d55e0>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:37.671196 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-0923d97a-a5d7-44c1-b86b-207076385a27 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac1323815364df4a3a4d4dbbb9d70dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be94d02ab5244f98337fb9b90e74746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:37.679443 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-0923d97a-a5d7-44c1-b86b-207076385a27 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] 10.222.0.26 "GET /compute/v2.1/servers/b5452da7-7cb6-493b-a5d1-4c60ed1e342c" status: 200 len: 1315 microversion: 2.1 time: 0.384776 Oct 08 20:56:37.680017 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 660/1279] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:56:37 2022] GET /compute/v2.1/servers/b5452da7-7cb6-493b-a5d1-4c60ed1e342c => generated 1315 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:56:37.685021 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-8f149a6a-6b06-485e-8d81-e866e94b4156 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:37.685664 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-8f149a6a-6b06-485e-8d81-e866e94b4156 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] [instance: 92e31b92-0af1-4da6-bc87-23978f1aedf5] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:56:37.695496 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8f149a6a-6b06-485e-8d81-e866e94b4156 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:37.696012 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8f149a6a-6b06-485e-8d81-e866e94b4156 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:37.696460 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8f149a6a-6b06-485e-8d81-e866e94b4156 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:37.697212 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8f149a6a-6b06-485e-8d81-e866e94b4156 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:37.697722 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8f149a6a-6b06-485e-8d81-e866e94b4156 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:37.698248 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8f149a6a-6b06-485e-8d81-e866e94b4156 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:37.829604 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-8f149a6a-6b06-485e-8d81-e866e94b4156 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:37.845689 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-8f149a6a-6b06-485e-8d81-e866e94b4156 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:37.847220 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-8f149a6a-6b06-485e-8d81-e866e94b4156 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:37.852841 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-8f149a6a-6b06-485e-8d81-e866e94b4156 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] 10.222.0.26 "GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5" status: 200 len: 1546 microversion: 2.91 time: 0.171693 Oct 08 20:56:37.863747 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 661/1280] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:56:37 2022] GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5 => generated 1546 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:56:37.863747 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-3a756ceb-1eeb-47a3-a202-d8b0e349073c tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:37.863747 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-3a756ceb-1eeb-47a3-a202-d8b0e349073c tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] [instance: 57016fcf-2d2c-488c-9af6-0530ebc199f6] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:56:37.867512 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3a756ceb-1eeb-47a3-a202-d8b0e349073c tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:37.868124 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3a756ceb-1eeb-47a3-a202-d8b0e349073c tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:37.868678 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3a756ceb-1eeb-47a3-a202-d8b0e349073c tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:37.870758 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3a756ceb-1eeb-47a3-a202-d8b0e349073c tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:37.871432 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3a756ceb-1eeb-47a3-a202-d8b0e349073c tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:37.872098 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3a756ceb-1eeb-47a3-a202-d8b0e349073c tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:38.231122 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.objects.instance [None req-3a756ceb-1eeb-47a3-a202-d8b0e349073c tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Lazy-loading 'services' on Instance uuid 57016fcf-2d2c-488c-9af6-0530ebc199f6 {{(pid=140492) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 20:56:38.258439 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-3a756ceb-1eeb-47a3-a202-d8b0e349073c tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/57016fcf-2d2c-488c-9af6-0530ebc199f6" status: 200 len: 2423 microversion: 2.25 time: 0.402476 Oct 08 20:56:38.261017 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 662/1281] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:56:37 2022] GET /compute/v2.1/servers/57016fcf-2d2c-488c-9af6-0530ebc199f6 => generated 2423 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:56:38.267335 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-51b81e33-329c-4394-aa4a-2ac7868a853c req-c8eb699e-a13e-455e-aae9-1290cd16d4cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5452da7-7cb6-493b-a5d1-4c60ed1e342c", "name": "network-vif-plugged", "status": "completed", "tag": "93e84696-aa00-46c7-8d5d-36171a311b21"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:56:38.281471 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-4036e005-908a-43dd-bcff-62dedcba1ef5 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] 10.222.0.26 "DELETE /compute/v2.1/images/c9c4114b-60e7-4da5-980a-ac303ed9462a" status: 204 len: 0 microversion: 2.1 time: 0.693015 Oct 08 20:56:38.282574 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 620/1282] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:56:37 2022] DELETE /compute/v2.1/images/c9c4114b-60e7-4da5-980a-ac303ed9462a => generated 0 bytes in 696 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 20:56:38.289511 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-d362ca16-4f3f-4ff2-80be-11295ea93923 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": "auto"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:56:38.294292 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-d362ca16-4f3f-4ff2-80be-11295ea93923 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] [instance: 57016fcf-2d2c-488c-9af6-0530ebc199f6] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:56:38.294701 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-51b81e33-329c-4394-aa4a-2ac7868a853c req-c8eb699e-a13e-455e-aae9-1290cd16d4cf service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:38.295375 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-51b81e33-329c-4394-aa4a-2ac7868a853c req-c8eb699e-a13e-455e-aae9-1290cd16d4cf service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:38.296189 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-51b81e33-329c-4394-aa4a-2ac7868a853c req-c8eb699e-a13e-455e-aae9-1290cd16d4cf service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:38.317863 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d362ca16-4f3f-4ff2-80be-11295ea93923 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:38.323876 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-51b81e33-329c-4394-aa4a-2ac7868a853c req-c8eb699e-a13e-455e-aae9-1290cd16d4cf service nova] Creating event network-vif-plugged:93e84696-aa00-46c7-8d5d-36171a311b21 for instance b5452da7-7cb6-493b-a5d1-4c60ed1e342c on nch2-master-1 Oct 08 20:56:38.324002 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d362ca16-4f3f-4ff2-80be-11295ea93923 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:38.324399 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d362ca16-4f3f-4ff2-80be-11295ea93923 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:38.325172 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d362ca16-4f3f-4ff2-80be-11295ea93923 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:38.325673 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d362ca16-4f3f-4ff2-80be-11295ea93923 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:38.326170 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d362ca16-4f3f-4ff2-80be-11295ea93923 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:38.338071 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-51b81e33-329c-4394-aa4a-2ac7868a853c req-c8eb699e-a13e-455e-aae9-1290cd16d4cf service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074959 Oct 08 20:56:38.341578 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 663/1283] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:56:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:56:38.353356 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-44804197-617a-4a70-9112-9390c8100b61 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Calling method '.version_select at 0x7f1a9147bee0>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:38.404195 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.objects.instance [None req-d362ca16-4f3f-4ff2-80be-11295ea93923 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Lazy-loading 'flavor' on Instance uuid 57016fcf-2d2c-488c-9af6-0530ebc199f6 {{(pid=140491) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 20:56:38.427569 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-d362ca16-4f3f-4ff2-80be-11295ea93923 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] [instance: 57016fcf-2d2c-488c-9af6-0530ebc199f6] Going to try to live migrate instance to nch2-master-1 {{(pid=140491) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 08 20:56:38.521513 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:56:39.066896 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-44804197-617a-4a70-9112-9390c8100b61 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] 10.222.0.26 "DELETE /compute/v2.1/images/e7e4c6ad-e228-45f1-9998-e20dbf8acb00" status: 204 len: 0 microversion: 2.1 time: 0.722519 Oct 08 20:56:39.068158 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 664/1284] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:56:38 2022] DELETE /compute/v2.1/images/e7e4c6ad-e228-45f1-9998-e20dbf8acb00 => generated 0 bytes in 725 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 20:56:39.074231 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-736e458a-47af-4d7d-9999-4cb598022b6d tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:39.075260 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-736e458a-47af-4d7d-9999-4cb598022b6d tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] [instance: e338d559-3f7c-4cc8-95c6-face79e11ca2] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:56:39.082794 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-736e458a-47af-4d7d-9999-4cb598022b6d tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:39.083886 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-736e458a-47af-4d7d-9999-4cb598022b6d tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:39.084635 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-736e458a-47af-4d7d-9999-4cb598022b6d tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:39.085595 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-736e458a-47af-4d7d-9999-4cb598022b6d tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:39.086264 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-736e458a-47af-4d7d-9999-4cb598022b6d tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:39.086897 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-736e458a-47af-4d7d-9999-4cb598022b6d tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:39.385046 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=2 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:56:39.421854 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-736e458a-47af-4d7d-9999-4cb598022b6d tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474ca64d1b1d4e30916b517645aba882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecc2dd2407b4819874bed09cb27959a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:39.433500 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-736e458a-47af-4d7d-9999-4cb598022b6d tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] 10.222.0.26 "GET /compute/v2.1/servers/e338d559-3f7c-4cc8-95c6-face79e11ca2" status: 200 len: 1718 microversion: 2.1 time: 0.363858 Oct 08 20:56:39.434688 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 665/1285] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:56:39 2022] GET /compute/v2.1/servers/e338d559-3f7c-4cc8-95c6-face79e11ca2 => generated 1718 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:56:39.440498 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-30652cf8-b10b-49be-a2b2-d68b33843312 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:39.441906 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-30652cf8-b10b-49be-a2b2-d68b33843312 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] [instance: 7f720341-f7ad-4365-8aeb-0aad8afb46b6] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:56:39.448759 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=2 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:56:39.451878 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-30652cf8-b10b-49be-a2b2-d68b33843312 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:39.453080 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-30652cf8-b10b-49be-a2b2-d68b33843312 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:39.455145 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-30652cf8-b10b-49be-a2b2-d68b33843312 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:39.456147 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-30652cf8-b10b-49be-a2b2-d68b33843312 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:39.458793 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-30652cf8-b10b-49be-a2b2-d68b33843312 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:39.459983 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-30652cf8-b10b-49be-a2b2-d68b33843312 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:39.702230 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-30652cf8-b10b-49be-a2b2-d68b33843312 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05f0f7a60257437eaa8702b664916979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7550f7ad9dc45ba9c9bfb0a5a11a774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:39.715426 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-30652cf8-b10b-49be-a2b2-d68b33843312 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] 10.222.0.26 "GET /compute/v2.1/servers/7f720341-f7ad-4365-8aeb-0aad8afb46b6" status: 200 len: 1318 microversion: 2.1 time: 0.274901 Oct 08 20:56:39.717632 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 666/1286] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:56:39 2022] GET /compute/v2.1/servers/7f720341-f7ad-4365-8aeb-0aad8afb46b6 => generated 1318 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:56:39.724668 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-3135344d-a7a0-4135-baaa-5982623ddec9 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:39.726130 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-3135344d-a7a0-4135-baaa-5982623ddec9 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] [instance: ceced78a-58d9-4175-b4fe-0d085be62c94] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:56:39.733939 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3135344d-a7a0-4135-baaa-5982623ddec9 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:39.734936 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3135344d-a7a0-4135-baaa-5982623ddec9 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:39.735566 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3135344d-a7a0-4135-baaa-5982623ddec9 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:39.736749 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3135344d-a7a0-4135-baaa-5982623ddec9 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:39.737664 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3135344d-a7a0-4135-baaa-5982623ddec9 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:39.738280 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3135344d-a7a0-4135-baaa-5982623ddec9 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:40.006517 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-3135344d-a7a0-4135-baaa-5982623ddec9 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:40.018858 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-3135344d-a7a0-4135-baaa-5982623ddec9 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:40.020318 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-3135344d-a7a0-4135-baaa-5982623ddec9 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:40.022404 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-3135344d-a7a0-4135-baaa-5982623ddec9 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] 10.222.0.26 "GET /compute/v2.1/servers/ceced78a-58d9-4175-b4fe-0d085be62c94" status: 200 len: 1660 microversion: 2.42 time: 0.302856 Oct 08 20:56:40.030043 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 667/1287] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:56:39 2022] GET /compute/v2.1/servers/ceced78a-58d9-4175-b4fe-0d085be62c94 => generated 1660 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:56:40.040689 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-fc7f4e50-e4e8-4a57-ba48-06d441b36d64 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:40.043611 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-fc7f4e50-e4e8-4a57-ba48-06d441b36d64 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] [instance: b5452da7-7cb6-493b-a5d1-4c60ed1e342c] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:56:40.054693 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fc7f4e50-e4e8-4a57-ba48-06d441b36d64 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:40.055782 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fc7f4e50-e4e8-4a57-ba48-06d441b36d64 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:40.057403 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fc7f4e50-e4e8-4a57-ba48-06d441b36d64 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:40.058385 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fc7f4e50-e4e8-4a57-ba48-06d441b36d64 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:40.060221 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fc7f4e50-e4e8-4a57-ba48-06d441b36d64 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:40.061030 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fc7f4e50-e4e8-4a57-ba48-06d441b36d64 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:40.393772 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-fc7f4e50-e4e8-4a57-ba48-06d441b36d64 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac1323815364df4a3a4d4dbbb9d70dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be94d02ab5244f98337fb9b90e74746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:40.421752 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-fc7f4e50-e4e8-4a57-ba48-06d441b36d64 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] 10.222.0.26 "GET /compute/v2.1/servers/b5452da7-7cb6-493b-a5d1-4c60ed1e342c" status: 200 len: 1315 microversion: 2.1 time: 0.385775 Oct 08 20:56:40.422749 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 668/1288] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:56:40 2022] GET /compute/v2.1/servers/b5452da7-7cb6-493b-a5d1-4c60ed1e342c => generated 1315 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:56:40.439925 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-a9003030-502d-41ed-97dc-063e43e812a6 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:40.442829 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-a9003030-502d-41ed-97dc-063e43e812a6 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] [instance: 92e31b92-0af1-4da6-bc87-23978f1aedf5] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:56:40.467590 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a9003030-502d-41ed-97dc-063e43e812a6 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:40.468589 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a9003030-502d-41ed-97dc-063e43e812a6 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:40.469040 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a9003030-502d-41ed-97dc-063e43e812a6 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:40.470692 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a9003030-502d-41ed-97dc-063e43e812a6 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:40.471166 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a9003030-502d-41ed-97dc-063e43e812a6 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:40.473872 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a9003030-502d-41ed-97dc-063e43e812a6 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:40.638622 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-a9003030-502d-41ed-97dc-063e43e812a6 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:40.648953 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-a9003030-502d-41ed-97dc-063e43e812a6 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:40.656057 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-a9003030-502d-41ed-97dc-063e43e812a6 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:40.681285 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-a9003030-502d-41ed-97dc-063e43e812a6 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] 10.222.0.26 "GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5" status: 200 len: 1546 microversion: 2.91 time: 0.254165 Oct 08 20:56:40.689216 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 669/1289] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:56:40 2022] GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5 => generated 1546 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:56:40.699107 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-7ce8e2b2-bded-4b64-a1f1-6f17225c09b1 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:40.699619 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-7ce8e2b2-bded-4b64-a1f1-6f17225c09b1 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] [instance: 0cbc3ac5-5690-4f4e-a9d1-ea0de18060b1] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:56:40.720187 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7ce8e2b2-bded-4b64-a1f1-6f17225c09b1 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:40.720689 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7ce8e2b2-bded-4b64-a1f1-6f17225c09b1 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:40.728006 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7ce8e2b2-bded-4b64-a1f1-6f17225c09b1 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:40.732879 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7ce8e2b2-bded-4b64-a1f1-6f17225c09b1 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:40.734463 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7ce8e2b2-bded-4b64-a1f1-6f17225c09b1 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:40.734937 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7ce8e2b2-bded-4b64-a1f1-6f17225c09b1 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:40.776609 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-7ce8e2b2-bded-4b64-a1f1-6f17225c09b1 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] [instance: 0cbc3ac5-5690-4f4e-a9d1-ea0de18060b1] Going to try to terminate instance {{(pid=140492) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 20:56:40.816838 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=100 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:56:40.957075 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-7ce8e2b2-bded-4b64-a1f1-6f17225c09b1 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] 10.222.0.26 "DELETE /compute/v2.1/servers/0cbc3ac5-5690-4f4e-a9d1-ea0de18060b1" status: 204 len: 0 microversion: 2.1 time: 0.265661 Oct 08 20:56:40.961782 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 670/1290] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 20:56:40 2022] DELETE /compute/v2.1/servers/0cbc3ac5-5690-4f4e-a9d1-ea0de18060b1 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 20:56:40.985025 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-257c1711-d465-418e-be86-d2a41f21be9a req-bf0b2be2-8a6f-4b0b-87b3-4fc3b170b556 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f720341-f7ad-4365-8aeb-0aad8afb46b6", "name": "network-vif-plugged", "status": "completed", "tag": "2b088aa4-bf3c-4570-9a9c-462b7126b498"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:56:41.018601 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-257c1711-d465-418e-be86-d2a41f21be9a req-bf0b2be2-8a6f-4b0b-87b3-4fc3b170b556 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:41.019136 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-257c1711-d465-418e-be86-d2a41f21be9a req-bf0b2be2-8a6f-4b0b-87b3-4fc3b170b556 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:41.019621 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-257c1711-d465-418e-be86-d2a41f21be9a req-bf0b2be2-8a6f-4b0b-87b3-4fc3b170b556 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:41.067884 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-d362ca16-4f3f-4ff2-80be-11295ea93923 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/57016fcf-2d2c-488c-9af6-0530ebc199f6/action" status: 202 len: 0 microversion: 2.25 time: 2.783859 Oct 08 20:56:41.068807 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 621/1291] 10.222.0.26 () {62 vars in 1319 bytes} [Sat Oct 8 20:56:38 2022] POST /compute/v2.1/servers/57016fcf-2d2c-488c-9af6-0530ebc199f6/action => generated 0 bytes in 2786 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 08 20:56:41.073161 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-257c1711-d465-418e-be86-d2a41f21be9a req-bf0b2be2-8a6f-4b0b-87b3-4fc3b170b556 service nova] Creating event network-vif-plugged:2b088aa4-bf3c-4570-9a9c-462b7126b498 for instance 7f720341-f7ad-4365-8aeb-0aad8afb46b6 on nch1-master-1 Oct 08 20:56:41.074342 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-64f443b6-f00a-4eae-afd5-270313030722 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:41.075012 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-64f443b6-f00a-4eae-afd5-270313030722 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] [instance: e338d559-3f7c-4cc8-95c6-face79e11ca2] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:56:41.086064 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-257c1711-d465-418e-be86-d2a41f21be9a req-bf0b2be2-8a6f-4b0b-87b3-4fc3b170b556 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125370 Oct 08 20:56:41.088735 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 671/1292] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:56:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:56:41.097627 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-4c51342f-48f8-46e2-bb1c-8e4ec4cbf362 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:41.098916 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-4c51342f-48f8-46e2-bb1c-8e4ec4cbf362 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] [instance: 7f720341-f7ad-4365-8aeb-0aad8afb46b6] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:56:41.107469 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4c51342f-48f8-46e2-bb1c-8e4ec4cbf362 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:41.108263 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4c51342f-48f8-46e2-bb1c-8e4ec4cbf362 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:41.109073 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4c51342f-48f8-46e2-bb1c-8e4ec4cbf362 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:41.110202 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4c51342f-48f8-46e2-bb1c-8e4ec4cbf362 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:41.110983 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4c51342f-48f8-46e2-bb1c-8e4ec4cbf362 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:41.111702 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4c51342f-48f8-46e2-bb1c-8e4ec4cbf362 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:41.420915 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-64f443b6-f00a-4eae-afd5-270313030722 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:41.421738 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-64f443b6-f00a-4eae-afd5-270313030722 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:41.424200 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-4c51342f-48f8-46e2-bb1c-8e4ec4cbf362 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05f0f7a60257437eaa8702b664916979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7550f7ad9dc45ba9c9bfb0a5a11a774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:41.428937 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-64f443b6-f00a-4eae-afd5-270313030722 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:41.430264 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-64f443b6-f00a-4eae-afd5-270313030722 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:41.431106 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-64f443b6-f00a-4eae-afd5-270313030722 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:41.432333 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-64f443b6-f00a-4eae-afd5-270313030722 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:41.435123 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-4c51342f-48f8-46e2-bb1c-8e4ec4cbf362 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] 10.222.0.26 "GET /compute/v2.1/servers/7f720341-f7ad-4365-8aeb-0aad8afb46b6" status: 200 len: 1318 microversion: 2.1 time: 0.344604 Oct 08 20:56:41.436220 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 672/1293] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:56:41 2022] GET /compute/v2.1/servers/7f720341-f7ad-4365-8aeb-0aad8afb46b6 => generated 1318 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:56:41.450733 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-50bedce9-3a4e-493d-bccc-be0a5d1d90b5 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:41.451738 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-50bedce9-3a4e-493d-bccc-be0a5d1d90b5 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] [instance: 0cbc3ac5-5690-4f4e-a9d1-ea0de18060b1] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:56:41.458571 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-50bedce9-3a4e-493d-bccc-be0a5d1d90b5 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:41.459325 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-50bedce9-3a4e-493d-bccc-be0a5d1d90b5 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:41.459935 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-50bedce9-3a4e-493d-bccc-be0a5d1d90b5 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:41.460823 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-50bedce9-3a4e-493d-bccc-be0a5d1d90b5 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:41.461500 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-50bedce9-3a4e-493d-bccc-be0a5d1d90b5 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:41.462088 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-50bedce9-3a4e-493d-bccc-be0a5d1d90b5 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:41.691879 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-50bedce9-3a4e-493d-bccc-be0a5d1d90b5 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bce55d7f67347aaaa4c2a687bdff183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb3706a1680419384f4fe9660e87732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:41.703423 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-50bedce9-3a4e-493d-bccc-be0a5d1d90b5 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] 10.222.0.26 "GET /compute/v2.1/servers/0cbc3ac5-5690-4f4e-a9d1-ea0de18060b1" status: 200 len: 1473 microversion: 2.1 time: 0.258274 Oct 08 20:56:41.704464 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 673/1294] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:56:41 2022] GET /compute/v2.1/servers/0cbc3ac5-5690-4f4e-a9d1-ea0de18060b1 => generated 1473 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:56:41.709816 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-3a4ca073-1beb-4f68-9ea3-a3624eef183a tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:41.710953 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-3a4ca073-1beb-4f68-9ea3-a3624eef183a tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] [instance: ceced78a-58d9-4175-b4fe-0d085be62c94] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:56:41.720079 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3a4ca073-1beb-4f68-9ea3-a3624eef183a tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:41.720599 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3a4ca073-1beb-4f68-9ea3-a3624eef183a tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:41.721052 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3a4ca073-1beb-4f68-9ea3-a3624eef183a tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:41.721814 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3a4ca073-1beb-4f68-9ea3-a3624eef183a tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:41.722300 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3a4ca073-1beb-4f68-9ea3-a3624eef183a tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:41.722767 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3a4ca073-1beb-4f68-9ea3-a3624eef183a tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:42.055239 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-3a4ca073-1beb-4f68-9ea3-a3624eef183a tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:42.069269 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-3a4ca073-1beb-4f68-9ea3-a3624eef183a tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:42.073823 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-3a4ca073-1beb-4f68-9ea3-a3624eef183a tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:42.077208 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-3a4ca073-1beb-4f68-9ea3-a3624eef183a tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] 10.222.0.26 "GET /compute/v2.1/servers/ceced78a-58d9-4175-b4fe-0d085be62c94" status: 200 len: 1706 microversion: 2.42 time: 0.371743 Oct 08 20:56:42.079783 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 674/1295] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:56:41 2022] GET /compute/v2.1/servers/ceced78a-58d9-4175-b4fe-0d085be62c94 => generated 1706 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:56:42.086878 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-f044e815-74c3-4615-b5f4-5c4f337723d8 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:42.087720 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-f044e815-74c3-4615-b5f4-5c4f337723d8 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] [instance: 57016fcf-2d2c-488c-9af6-0530ebc199f6] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:56:42.096547 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f044e815-74c3-4615-b5f4-5c4f337723d8 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:42.097302 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f044e815-74c3-4615-b5f4-5c4f337723d8 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:42.097932 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f044e815-74c3-4615-b5f4-5c4f337723d8 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:42.098819 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f044e815-74c3-4615-b5f4-5c4f337723d8 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:42.101613 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f044e815-74c3-4615-b5f4-5c4f337723d8 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:42.112027 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f044e815-74c3-4615-b5f4-5c4f337723d8 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:42.311349 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-f044e815-74c3-4615-b5f4-5c4f337723d8 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:42.323210 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-f044e815-74c3-4615-b5f4-5c4f337723d8 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:42.324817 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-f044e815-74c3-4615-b5f4-5c4f337723d8 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:42.326522 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-f044e815-74c3-4615-b5f4-5c4f337723d8 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] 10.222.0.26 "GET /compute/v2.1/servers/57016fcf-2d2c-488c-9af6-0530ebc199f6" status: 200 len: 1814 microversion: 2.25 time: 0.244546 Oct 08 20:56:42.327370 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 675/1296] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:56:42 2022] GET /compute/v2.1/servers/57016fcf-2d2c-488c-9af6-0530ebc199f6 => generated 1814 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:56:42.333668 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-61acd8de-6499-4f29-a978-97a9db5b40cc tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:42.334568 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-61acd8de-6499-4f29-a978-97a9db5b40cc tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] [instance: b5452da7-7cb6-493b-a5d1-4c60ed1e342c] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:56:42.340871 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-61acd8de-6499-4f29-a978-97a9db5b40cc tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:42.341644 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-61acd8de-6499-4f29-a978-97a9db5b40cc tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:42.342335 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-61acd8de-6499-4f29-a978-97a9db5b40cc tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:42.343501 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-61acd8de-6499-4f29-a978-97a9db5b40cc tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:42.344177 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-61acd8de-6499-4f29-a978-97a9db5b40cc tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:42.344837 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-61acd8de-6499-4f29-a978-97a9db5b40cc tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:42.484678 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-64f443b6-f00a-4eae-afd5-270313030722 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474ca64d1b1d4e30916b517645aba882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecc2dd2407b4819874bed09cb27959a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:42.495463 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-64f443b6-f00a-4eae-afd5-270313030722 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] 10.222.0.26 "GET /compute/v2.1/servers/e338d559-3f7c-4cc8-95c6-face79e11ca2" status: 200 len: 1718 microversion: 2.1 time: 1.425378 Oct 08 20:56:42.500816 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 622/1297] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:56:41 2022] GET /compute/v2.1/servers/e338d559-3f7c-4cc8-95c6-face79e11ca2 => generated 1718 bytes in 1431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:56:42.506147 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-414af6b8-4d74-4dfd-a1ef-f888a6b84def tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:42.506943 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-414af6b8-4d74-4dfd-a1ef-f888a6b84def tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] [instance: 92e31b92-0af1-4da6-bc87-23978f1aedf5] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:56:42.513496 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-414af6b8-4d74-4dfd-a1ef-f888a6b84def tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:42.514197 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-414af6b8-4d74-4dfd-a1ef-f888a6b84def tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:42.514851 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-414af6b8-4d74-4dfd-a1ef-f888a6b84def tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:42.515770 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-414af6b8-4d74-4dfd-a1ef-f888a6b84def tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:42.516397 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-414af6b8-4d74-4dfd-a1ef-f888a6b84def tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:42.517030 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-414af6b8-4d74-4dfd-a1ef-f888a6b84def tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:42.738092 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-414af6b8-4d74-4dfd-a1ef-f888a6b84def tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:42.752191 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-414af6b8-4d74-4dfd-a1ef-f888a6b84def tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:42.756665 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-414af6b8-4d74-4dfd-a1ef-f888a6b84def tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:42.768145 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-414af6b8-4d74-4dfd-a1ef-f888a6b84def tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] 10.222.0.26 "GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5" status: 200 len: 1533 microversion: 2.91 time: 0.265920 Oct 08 20:56:42.777598 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 623/1298] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:56:42 2022] GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5 => generated 1533 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:56:42.781509 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-61acd8de-6499-4f29-a978-97a9db5b40cc tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac1323815364df4a3a4d4dbbb9d70dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be94d02ab5244f98337fb9b90e74746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:42.783519 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-43446ad8-65fc-4f69-9c01-ce0afeb38cd3 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:42.784356 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-43446ad8-65fc-4f69-9c01-ce0afeb38cd3 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] [instance: 7f720341-f7ad-4365-8aeb-0aad8afb46b6] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:56:42.794622 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-61acd8de-6499-4f29-a978-97a9db5b40cc tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] 10.222.0.26 "GET /compute/v2.1/servers/b5452da7-7cb6-493b-a5d1-4c60ed1e342c" status: 200 len: 1504 microversion: 2.1 time: 0.465876 Oct 08 20:56:42.796920 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-43446ad8-65fc-4f69-9c01-ce0afeb38cd3 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:42.797251 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 676/1299] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:56:42 2022] GET /compute/v2.1/servers/b5452da7-7cb6-493b-a5d1-4c60ed1e342c => generated 1504 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:56:42.799572 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-43446ad8-65fc-4f69-9c01-ce0afeb38cd3 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:42.800257 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-43446ad8-65fc-4f69-9c01-ce0afeb38cd3 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:42.809267 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-43446ad8-65fc-4f69-9c01-ce0afeb38cd3 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:42.810177 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-43446ad8-65fc-4f69-9c01-ce0afeb38cd3 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:42.811081 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-43446ad8-65fc-4f69-9c01-ce0afeb38cd3 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:42.823041 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-ba6a651c-4f79-48ce-9228-39fe5a5a025d tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:42.825071 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-ba6a651c-4f79-48ce-9228-39fe5a5a025d tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] [instance: 0cbc3ac5-5690-4f4e-a9d1-ea0de18060b1] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:56:42.840279 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ba6a651c-4f79-48ce-9228-39fe5a5a025d tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:42.841008 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ba6a651c-4f79-48ce-9228-39fe5a5a025d tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:42.849778 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ba6a651c-4f79-48ce-9228-39fe5a5a025d tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:42.853133 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ba6a651c-4f79-48ce-9228-39fe5a5a025d tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:42.856825 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ba6a651c-4f79-48ce-9228-39fe5a5a025d tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:42.857529 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ba6a651c-4f79-48ce-9228-39fe5a5a025d tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:43.165837 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-ba6a651c-4f79-48ce-9228-39fe5a5a025d tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bce55d7f67347aaaa4c2a687bdff183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb3706a1680419384f4fe9660e87732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:43.177709 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-ba6a651c-4f79-48ce-9228-39fe5a5a025d tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] 10.222.0.26 "GET /compute/v2.1/servers/0cbc3ac5-5690-4f4e-a9d1-ea0de18060b1" status: 200 len: 1473 microversion: 2.1 time: 0.379239 Oct 08 20:56:43.196397 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 677/1300] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:56:42 2022] GET /compute/v2.1/servers/0cbc3ac5-5690-4f4e-a9d1-ea0de18060b1 => generated 1473 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:56:43.202250 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-eb0e5386-f6d3-4931-8939-88ab7c72b68d tempest-UnshelveToHostMultiNodesTest-675009540 tempest-UnshelveToHostMultiNodesTest-675009540-project-admin] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:43.203104 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-eb0e5386-f6d3-4931-8939-88ab7c72b68d tempest-UnshelveToHostMultiNodesTest-675009540 tempest-UnshelveToHostMultiNodesTest-675009540-project-admin] [instance: 92e31b92-0af1-4da6-bc87-23978f1aedf5] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:56:43.210454 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-eb0e5386-f6d3-4931-8939-88ab7c72b68d tempest-UnshelveToHostMultiNodesTest-675009540 tempest-UnshelveToHostMultiNodesTest-675009540-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:43.211253 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-eb0e5386-f6d3-4931-8939-88ab7c72b68d tempest-UnshelveToHostMultiNodesTest-675009540 tempest-UnshelveToHostMultiNodesTest-675009540-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:43.211863 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-eb0e5386-f6d3-4931-8939-88ab7c72b68d tempest-UnshelveToHostMultiNodesTest-675009540 tempest-UnshelveToHostMultiNodesTest-675009540-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:43.213855 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-eb0e5386-f6d3-4931-8939-88ab7c72b68d tempest-UnshelveToHostMultiNodesTest-675009540 tempest-UnshelveToHostMultiNodesTest-675009540-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:43.214786 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-eb0e5386-f6d3-4931-8939-88ab7c72b68d tempest-UnshelveToHostMultiNodesTest-675009540 tempest-UnshelveToHostMultiNodesTest-675009540-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:43.215392 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-eb0e5386-f6d3-4931-8939-88ab7c72b68d tempest-UnshelveToHostMultiNodesTest-675009540 tempest-UnshelveToHostMultiNodesTest-675009540-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:43.268067 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-43446ad8-65fc-4f69-9c01-ce0afeb38cd3 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05f0f7a60257437eaa8702b664916979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7550f7ad9dc45ba9c9bfb0a5a11a774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:43.277817 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-43446ad8-65fc-4f69-9c01-ce0afeb38cd3 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] 10.222.0.26 "GET /compute/v2.1/servers/7f720341-f7ad-4365-8aeb-0aad8afb46b6" status: 200 len: 1318 microversion: 2.1 time: 0.498761 Oct 08 20:56:43.292500 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 624/1301] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:56:42 2022] GET /compute/v2.1/servers/7f720341-f7ad-4365-8aeb-0aad8afb46b6 => generated 1318 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:56:43.301175 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-9ada14ff-4c38-413d-8f5b-b6654292eeb2 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-43007255"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:56:43.302465 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-9ada14ff-4c38-413d-8f5b-b6654292eeb2 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] [instance: b5452da7-7cb6-493b-a5d1-4c60ed1e342c] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:56:43.309494 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9ada14ff-4c38-413d-8f5b-b6654292eeb2 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:43.310406 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9ada14ff-4c38-413d-8f5b-b6654292eeb2 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:43.311119 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9ada14ff-4c38-413d-8f5b-b6654292eeb2 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:43.312421 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9ada14ff-4c38-413d-8f5b-b6654292eeb2 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:43.313351 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9ada14ff-4c38-413d-8f5b-b6654292eeb2 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:43.313957 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9ada14ff-4c38-413d-8f5b-b6654292eeb2 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:43.382624 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.objects.instance [None req-eb0e5386-f6d3-4931-8939-88ab7c72b68d tempest-UnshelveToHostMultiNodesTest-675009540 tempest-UnshelveToHostMultiNodesTest-675009540-project-admin] Lazy-loading 'services' on Instance uuid 92e31b92-0af1-4da6-bc87-23978f1aedf5 {{(pid=140492) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 20:56:43.410252 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-eb0e5386-f6d3-4931-8939-88ab7c72b68d tempest-UnshelveToHostMultiNodesTest-675009540 tempest-UnshelveToHostMultiNodesTest-675009540-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5" status: 200 len: 1938 microversion: 2.91 time: 0.211552 Oct 08 20:56:43.412033 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 678/1302] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:56:43 2022] GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5 => generated 1938 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:56:43.418403 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-cb93ec89-02da-4b97-8aa9-70bceb6a851f tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:43.419845 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-cb93ec89-02da-4b97-8aa9-70bceb6a851f tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] [instance: ceced78a-58d9-4175-b4fe-0d085be62c94] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:56:43.427754 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cb93ec89-02da-4b97-8aa9-70bceb6a851f tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:43.428787 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cb93ec89-02da-4b97-8aa9-70bceb6a851f tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:43.429936 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cb93ec89-02da-4b97-8aa9-70bceb6a851f tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:43.431154 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cb93ec89-02da-4b97-8aa9-70bceb6a851f tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:43.432490 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cb93ec89-02da-4b97-8aa9-70bceb6a851f tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:43.433337 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cb93ec89-02da-4b97-8aa9-70bceb6a851f tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:43.760737 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.network.security_group_api [None req-9ada14ff-4c38-413d-8f5b-b6654292eeb2 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Adding security group 37af8e43-9b01-4360-b8ce-fe640f13d95d to port 93e84696-aa00-46c7-8d5d-36171a311b21 Oct 08 20:56:44.058106 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-cb93ec89-02da-4b97-8aa9-70bceb6a851f tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:44.078091 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-cb93ec89-02da-4b97-8aa9-70bceb6a851f tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:44.080379 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-cb93ec89-02da-4b97-8aa9-70bceb6a851f tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:44.082984 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-cb93ec89-02da-4b97-8aa9-70bceb6a851f tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] 10.222.0.26 "GET /compute/v2.1/servers/ceced78a-58d9-4175-b4fe-0d085be62c94" status: 200 len: 1740 microversion: 2.42 time: 0.669551 Oct 08 20:56:44.084868 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 679/1303] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:56:43 2022] GET /compute/v2.1/servers/ceced78a-58d9-4175-b4fe-0d085be62c94 => generated 1740 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:56:44.091591 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-d61b5050-22f3-4a18-88a9-373a1921e0f0 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:44.092589 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-d61b5050-22f3-4a18-88a9-373a1921e0f0 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] [instance: 57016fcf-2d2c-488c-9af6-0530ebc199f6] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:56:44.099967 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d61b5050-22f3-4a18-88a9-373a1921e0f0 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:44.100876 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d61b5050-22f3-4a18-88a9-373a1921e0f0 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:44.101955 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d61b5050-22f3-4a18-88a9-373a1921e0f0 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:44.104137 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d61b5050-22f3-4a18-88a9-373a1921e0f0 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:44.104833 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d61b5050-22f3-4a18-88a9-373a1921e0f0 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:44.105299 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d61b5050-22f3-4a18-88a9-373a1921e0f0 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:44.444748 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-d61b5050-22f3-4a18-88a9-373a1921e0f0 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:44.465429 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-d61b5050-22f3-4a18-88a9-373a1921e0f0 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:44.469848 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-d61b5050-22f3-4a18-88a9-373a1921e0f0 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:44.472164 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-d61b5050-22f3-4a18-88a9-373a1921e0f0 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] 10.222.0.26 "GET /compute/v2.1/servers/57016fcf-2d2c-488c-9af6-0530ebc199f6" status: 200 len: 1814 microversion: 2.25 time: 0.385528 Oct 08 20:56:44.494419 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 680/1304] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:56:44 2022] GET /compute/v2.1/servers/57016fcf-2d2c-488c-9af6-0530ebc199f6 => generated 1814 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:56:44.499185 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-b3d0d786-60a3-4e5f-b540-2fe336e5e6e9 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:44.499703 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-b3d0d786-60a3-4e5f-b540-2fe336e5e6e9 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] [instance: 92e31b92-0af1-4da6-bc87-23978f1aedf5] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:56:44.509138 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b3d0d786-60a3-4e5f-b540-2fe336e5e6e9 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:44.509737 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b3d0d786-60a3-4e5f-b540-2fe336e5e6e9 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:44.510254 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b3d0d786-60a3-4e5f-b540-2fe336e5e6e9 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:44.511121 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b3d0d786-60a3-4e5f-b540-2fe336e5e6e9 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:44.511591 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b3d0d786-60a3-4e5f-b540-2fe336e5e6e9 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:44.512058 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b3d0d786-60a3-4e5f-b540-2fe336e5e6e9 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:44.545599 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-b3d0d786-60a3-4e5f-b540-2fe336e5e6e9 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] [instance: 92e31b92-0af1-4da6-bc87-23978f1aedf5] Going to try to terminate instance {{(pid=140492) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 20:56:44.674763 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-b3d0d786-60a3-4e5f-b540-2fe336e5e6e9 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] 10.222.0.26 "DELETE /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5" status: 204 len: 0 microversion: 2.91 time: 0.184276 Oct 08 20:56:44.682152 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 681/1305] 10.222.0.26 () {60 vars in 1280 bytes} [Sat Oct 8 20:56:44 2022] DELETE /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 08 20:56:44.689749 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-2a4df026-643e-41bb-9c90-2db3b1b008bd tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:44.691287 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-2a4df026-643e-41bb-9c90-2db3b1b008bd tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] [instance: e338d559-3f7c-4cc8-95c6-face79e11ca2] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:56:44.700491 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2a4df026-643e-41bb-9c90-2db3b1b008bd tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:44.701464 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2a4df026-643e-41bb-9c90-2db3b1b008bd tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:44.702149 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2a4df026-643e-41bb-9c90-2db3b1b008bd tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:44.703834 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2a4df026-643e-41bb-9c90-2db3b1b008bd tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:44.704490 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2a4df026-643e-41bb-9c90-2db3b1b008bd tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:44.705092 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2a4df026-643e-41bb-9c90-2db3b1b008bd tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:44.926047 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-9ada14ff-4c38-413d-8f5b-b6654292eeb2 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] 10.222.0.26 "POST /compute/v2.1/servers/b5452da7-7cb6-493b-a5d1-4c60ed1e342c/action" status: 202 len: 0 microversion: 2.1 time: 1.631965 Oct 08 20:56:44.931313 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 625/1306] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 20:56:43 2022] POST /compute/v2.1/servers/b5452da7-7cb6-493b-a5d1-4c60ed1e342c/action => generated 0 bytes in 1638 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 20:56:44.944550 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-3e3ece7f-0551-405e-8e25-b66c147bb76e tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:44.947571 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-3e3ece7f-0551-405e-8e25-b66c147bb76e tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] [instance: 0cbc3ac5-5690-4f4e-a9d1-ea0de18060b1] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:56:44.979334 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3e3ece7f-0551-405e-8e25-b66c147bb76e tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:44.980766 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3e3ece7f-0551-405e-8e25-b66c147bb76e tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:44.982808 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3e3ece7f-0551-405e-8e25-b66c147bb76e tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:44.988000 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3e3ece7f-0551-405e-8e25-b66c147bb76e tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:44.990360 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3e3ece7f-0551-405e-8e25-b66c147bb76e tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:44.991510 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3e3ece7f-0551-405e-8e25-b66c147bb76e tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:45.169726 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3e3ece7f-0551-405e-8e25-b66c147bb76e tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:45.170533 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3e3ece7f-0551-405e-8e25-b66c147bb76e tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:45.172755 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3e3ece7f-0551-405e-8e25-b66c147bb76e tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:45.174532 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.objects.instance [None req-3e3ece7f-0551-405e-8e25-b66c147bb76e tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Lazy-loading 'fault' on Instance uuid 0cbc3ac5-5690-4f4e-a9d1-ea0de18060b1 {{(pid=140491) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 20:56:45.305252 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-2a4df026-643e-41bb-9c90-2db3b1b008bd tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474ca64d1b1d4e30916b517645aba882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecc2dd2407b4819874bed09cb27959a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:45.323955 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-2a4df026-643e-41bb-9c90-2db3b1b008bd tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] 10.222.0.26 "GET /compute/v2.1/servers/e338d559-3f7c-4cc8-95c6-face79e11ca2" status: 200 len: 1718 microversion: 2.1 time: 0.639872 Oct 08 20:56:45.326364 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 682/1307] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:56:44 2022] GET /compute/v2.1/servers/e338d559-3f7c-4cc8-95c6-face79e11ca2 => generated 1718 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:56:45.346213 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-42a7cc63-c4b5-4fd3-9b3d-9e3a7ae8a9e0 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:45.347256 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-42a7cc63-c4b5-4fd3-9b3d-9e3a7ae8a9e0 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] [instance: 7f720341-f7ad-4365-8aeb-0aad8afb46b6] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:56:45.376913 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-42a7cc63-c4b5-4fd3-9b3d-9e3a7ae8a9e0 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:45.379942 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-42a7cc63-c4b5-4fd3-9b3d-9e3a7ae8a9e0 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:45.383206 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-42a7cc63-c4b5-4fd3-9b3d-9e3a7ae8a9e0 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:45.385134 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-42a7cc63-c4b5-4fd3-9b3d-9e3a7ae8a9e0 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:45.388907 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-42a7cc63-c4b5-4fd3-9b3d-9e3a7ae8a9e0 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:45.391135 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-42a7cc63-c4b5-4fd3-9b3d-9e3a7ae8a9e0 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:45.607241 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-3e3ece7f-0551-405e-8e25-b66c147bb76e tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bce55d7f67347aaaa4c2a687bdff183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb3706a1680419384f4fe9660e87732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:45.620117 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-3e3ece7f-0551-405e-8e25-b66c147bb76e tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] 10.222.0.26 "GET /compute/v2.1/servers/0cbc3ac5-5690-4f4e-a9d1-ea0de18060b1" status: 200 len: 1307 microversion: 2.1 time: 0.687519 Oct 08 20:56:45.621933 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 626/1308] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:56:44 2022] GET /compute/v2.1/servers/0cbc3ac5-5690-4f4e-a9d1-ea0de18060b1 => generated 1307 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:56:45.642047 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-a8cfbb2e-8dd4-4720-bc08-d36c41c0e513 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:45.642900 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-a8cfbb2e-8dd4-4720-bc08-d36c41c0e513 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] [instance: 92e31b92-0af1-4da6-bc87-23978f1aedf5] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:56:45.649250 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a8cfbb2e-8dd4-4720-bc08-d36c41c0e513 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:45.650489 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a8cfbb2e-8dd4-4720-bc08-d36c41c0e513 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:45.651109 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a8cfbb2e-8dd4-4720-bc08-d36c41c0e513 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:45.651986 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a8cfbb2e-8dd4-4720-bc08-d36c41c0e513 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:45.652605 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a8cfbb2e-8dd4-4720-bc08-d36c41c0e513 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:45.655095 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a8cfbb2e-8dd4-4720-bc08-d36c41c0e513 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:45.738467 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-42a7cc63-c4b5-4fd3-9b3d-9e3a7ae8a9e0 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05f0f7a60257437eaa8702b664916979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7550f7ad9dc45ba9c9bfb0a5a11a774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:45.748831 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-42a7cc63-c4b5-4fd3-9b3d-9e3a7ae8a9e0 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] 10.222.0.26 "GET /compute/v2.1/servers/7f720341-f7ad-4365-8aeb-0aad8afb46b6" status: 200 len: 1468 microversion: 2.1 time: 0.420287 Oct 08 20:56:45.750059 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 683/1309] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:56:45 2022] GET /compute/v2.1/servers/7f720341-f7ad-4365-8aeb-0aad8afb46b6 => generated 1468 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:56:45.766025 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-a013e3ab-2c68-4328-a621-c9cb19f7f309 req-6bafacf1-ac6e-4c4b-909a-a8d980144335 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cbc3ac5-5690-4f4e-a9d1-ea0de18060b1", "name": "network-vif-deleted", "tag": "20694e26-0b3a-4a5f-9806-aa0485a844f5"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:56:45.786044 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-a013e3ab-2c68-4328-a621-c9cb19f7f309 req-6bafacf1-ac6e-4c4b-909a-a8d980144335 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:45.786643 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-a013e3ab-2c68-4328-a621-c9cb19f7f309 req-6bafacf1-ac6e-4c4b-909a-a8d980144335 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:45.787150 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-a013e3ab-2c68-4328-a621-c9cb19f7f309 req-6bafacf1-ac6e-4c4b-909a-a8d980144335 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:45.799955 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-a8cfbb2e-8dd4-4720-bc08-d36c41c0e513 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:45.813881 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-a8cfbb2e-8dd4-4720-bc08-d36c41c0e513 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:45.816274 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-a8cfbb2e-8dd4-4720-bc08-d36c41c0e513 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:45.820282 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-a013e3ab-2c68-4328-a621-c9cb19f7f309 req-6bafacf1-ac6e-4c4b-909a-a8d980144335 service nova] Creating event network-vif-deleted:20694e26-0b3a-4a5f-9806-aa0485a844f5 for instance 0cbc3ac5-5690-4f4e-a9d1-ea0de18060b1 on nch1-master-1 Oct 08 20:56:45.829826 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-a8cfbb2e-8dd4-4720-bc08-d36c41c0e513 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] 10.222.0.26 "GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5" status: 200 len: 1539 microversion: 2.91 time: 0.204982 Oct 08 20:56:45.832369 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-a013e3ab-2c68-4328-a621-c9cb19f7f309 req-6bafacf1-ac6e-4c4b-909a-a8d980144335 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080907 Oct 08 20:56:45.833554 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 684/1310] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:56:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:56:45.835052 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 627/1311] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:56:45 2022] GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5 => generated 1539 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:56:45.851105 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-ec9f3d83-b366-42fa-b481-c856affcefea tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1924482026"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:56:45.851105 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-ec9f3d83-b366-42fa-b481-c856affcefea tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] [instance: b5452da7-7cb6-493b-a5d1-4c60ed1e342c] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:56:45.856132 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ec9f3d83-b366-42fa-b481-c856affcefea tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:45.863620 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ec9f3d83-b366-42fa-b481-c856affcefea tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:45.863620 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ec9f3d83-b366-42fa-b481-c856affcefea tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:45.863620 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ec9f3d83-b366-42fa-b481-c856affcefea tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:45.863620 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ec9f3d83-b366-42fa-b481-c856affcefea tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:45.863620 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ec9f3d83-b366-42fa-b481-c856affcefea tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:45.891854 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-8ee28843-77c1-4ef4-b369-77c30bfc2462 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:45.897364 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-8ee28843-77c1-4ef4-b369-77c30bfc2462 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] [instance: ceced78a-58d9-4175-b4fe-0d085be62c94] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:56:45.917776 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8ee28843-77c1-4ef4-b369-77c30bfc2462 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:45.918283 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8ee28843-77c1-4ef4-b369-77c30bfc2462 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:45.918730 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8ee28843-77c1-4ef4-b369-77c30bfc2462 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:45.919544 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8ee28843-77c1-4ef4-b369-77c30bfc2462 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:45.920061 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8ee28843-77c1-4ef4-b369-77c30bfc2462 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:45.920427 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8ee28843-77c1-4ef4-b369-77c30bfc2462 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:46.228989 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.network.security_group_api [None req-ec9f3d83-b366-42fa-b481-c856affcefea tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Adding security group 20dcc67a-ffa8-498f-accf-c202efca60e5 to port 93e84696-aa00-46c7-8d5d-36171a311b21 Oct 08 20:56:46.454423 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-8ee28843-77c1-4ef4-b369-77c30bfc2462 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:46.465142 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-8ee28843-77c1-4ef4-b369-77c30bfc2462 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:46.466966 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-8ee28843-77c1-4ef4-b369-77c30bfc2462 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:46.468499 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-8ee28843-77c1-4ef4-b369-77c30bfc2462 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] 10.222.0.26 "GET /compute/v2.1/servers/ceced78a-58d9-4175-b4fe-0d085be62c94" status: 200 len: 1786 microversion: 2.42 time: 0.598923 Oct 08 20:56:46.469783 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 628/1312] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:56:45 2022] GET /compute/v2.1/servers/ceced78a-58d9-4175-b4fe-0d085be62c94 => generated 1786 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:56:46.474633 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-bc390cf7-5a10-4306-97c5-cd142cae844d tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:46.475806 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-bc390cf7-5a10-4306-97c5-cd142cae844d tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] [instance: 57016fcf-2d2c-488c-9af6-0530ebc199f6] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:56:46.497907 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bc390cf7-5a10-4306-97c5-cd142cae844d tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:46.498694 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bc390cf7-5a10-4306-97c5-cd142cae844d tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:46.499357 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bc390cf7-5a10-4306-97c5-cd142cae844d tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:46.500560 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bc390cf7-5a10-4306-97c5-cd142cae844d tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:46.501325 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bc390cf7-5a10-4306-97c5-cd142cae844d tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:46.502025 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bc390cf7-5a10-4306-97c5-cd142cae844d tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:46.792662 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-bc390cf7-5a10-4306-97c5-cd142cae844d tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:46.810393 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-bc390cf7-5a10-4306-97c5-cd142cae844d tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:46.812466 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-bc390cf7-5a10-4306-97c5-cd142cae844d tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:46.820257 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-bc390cf7-5a10-4306-97c5-cd142cae844d tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] 10.222.0.26 "GET /compute/v2.1/servers/57016fcf-2d2c-488c-9af6-0530ebc199f6" status: 200 len: 1814 microversion: 2.25 time: 0.349196 Oct 08 20:56:46.821444 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 629/1313] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:56:46 2022] GET /compute/v2.1/servers/57016fcf-2d2c-488c-9af6-0530ebc199f6 => generated 1814 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:56:47.093482 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-85d4958a-36c3-4de4-963d-1780e6df1367 tempest-LiveMigrationNegativeTest-1227766755 tempest-LiveMigrationNegativeTest-1227766755-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-1285307328", "block_migration": true, "disk_over_commit": false}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:56:47.096058 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-85d4958a-36c3-4de4-963d-1780e6df1367 tempest-LiveMigrationNegativeTest-1227766755 tempest-LiveMigrationNegativeTest-1227766755-project-admin] [instance: 7f720341-f7ad-4365-8aeb-0aad8afb46b6] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:56:47.116652 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-85d4958a-36c3-4de4-963d-1780e6df1367 tempest-LiveMigrationNegativeTest-1227766755 tempest-LiveMigrationNegativeTest-1227766755-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:47.117683 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-85d4958a-36c3-4de4-963d-1780e6df1367 tempest-LiveMigrationNegativeTest-1227766755 tempest-LiveMigrationNegativeTest-1227766755-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:47.118477 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-85d4958a-36c3-4de4-963d-1780e6df1367 tempest-LiveMigrationNegativeTest-1227766755 tempest-LiveMigrationNegativeTest-1227766755-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:47.119707 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-85d4958a-36c3-4de4-963d-1780e6df1367 tempest-LiveMigrationNegativeTest-1227766755 tempest-LiveMigrationNegativeTest-1227766755-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:47.120586 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-85d4958a-36c3-4de4-963d-1780e6df1367 tempest-LiveMigrationNegativeTest-1227766755 tempest-LiveMigrationNegativeTest-1227766755-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:47.121315 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-85d4958a-36c3-4de4-963d-1780e6df1367 tempest-LiveMigrationNegativeTest-1227766755 tempest-LiveMigrationNegativeTest-1227766755-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:47.175115 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.objects.instance [None req-85d4958a-36c3-4de4-963d-1780e6df1367 tempest-LiveMigrationNegativeTest-1227766755 tempest-LiveMigrationNegativeTest-1227766755-project-admin] Lazy-loading 'flavor' on Instance uuid 7f720341-f7ad-4365-8aeb-0aad8afb46b6 {{(pid=140491) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 20:56:47.195765 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-85d4958a-36c3-4de4-963d-1780e6df1367 tempest-LiveMigrationNegativeTest-1227766755 tempest-LiveMigrationNegativeTest-1227766755-project-admin] [instance: 7f720341-f7ad-4365-8aeb-0aad8afb46b6] Going to try to live migrate instance to tempest-host-1285307328 {{(pid=140491) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 08 20:56:47.205504 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-ec9f3d83-b366-42fa-b481-c856affcefea tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] 10.222.0.26 "POST /compute/v2.1/servers/b5452da7-7cb6-493b-a5d1-4c60ed1e342c/action" status: 202 len: 0 microversion: 2.1 time: 1.370006 Oct 08 20:56:47.207292 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 685/1314] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 20:56:45 2022] POST /compute/v2.1/servers/b5452da7-7cb6-493b-a5d1-4c60ed1e342c/action => generated 0 bytes in 1373 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 20:56:47.216989 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-85d4958a-36c3-4de4-963d-1780e6df1367 tempest-LiveMigrationNegativeTest-1227766755 tempest-LiveMigrationNegativeTest-1227766755-project-admin] HTTP exception thrown: Compute host tempest-host-1285307328 could not be found. Oct 08 20:56:47.227336 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-ad715547-b7bc-4e95-93cb-755b5b10798e tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:47.229661 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-ad715547-b7bc-4e95-93cb-755b5b10798e tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] [instance: e338d559-3f7c-4cc8-95c6-face79e11ca2] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:56:47.231159 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-85d4958a-36c3-4de4-963d-1780e6df1367 tempest-LiveMigrationNegativeTest-1227766755 tempest-LiveMigrationNegativeTest-1227766755-project-admin] Request method failure captured: Oct 08 20:56:47.231159 ncdv-master-1 devstack@n-api.service[140491]: request: POST /compute/v2.1/servers/7f720341-f7ad-4365-8aeb-0aad8afb46b6/action HTTP/1.1 Oct 08 20:56:47.231159 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 20:56:47.231159 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 20:56:47.231159 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 20:56:47.231159 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 107 Oct 08 20:56:47.231159 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 20:56:47.231159 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 20:56:47.231159 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 20:56:47.231159 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 20:56:47.231159 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQePmhn8XB40pNH6H2qTxPWEGN3b1iEsUXIwhpz9ZzD4jGIH4TC7Hc_mE-JDu0YBA9sjMFnw_x7PHo09XhXOeFZ2d7fFdTFLBZQuP_3vKWsFGWU1pxYSNIx5pVpM7rTQV1zaqBsPUYxYiQG7_bqdw7Onw2mRJsAY4Jg8rwZvDBQ15FnE Oct 08 20:56:47.231159 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 20:56:47.231159 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 20:56:47.231159 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 20:56:47.231159 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 20:56:47.231159 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 20:56:47.231159 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 20:56:47.231159 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 4a1046f826864ce2aeafe7c6fa76d27d Oct 08 20:56:47.231159 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-LiveMigrationNegativeTest-1227766755 Oct 08 20:56:47.231159 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,admin,member Oct 08 20:56:47.231159 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,admin,member Oct 08 20:56:47.231159 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/4a1046f826864ce2aeafe7c6fa76d27d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4a1046f826864ce2aeafe7c6fa76d27d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_4a1046f826864ce2aeafe7c6fa76d27d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4a1046f826864ce2aeafe7c6fa76d27d"}]}] Oct 08 20:56:47.231159 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-LiveMigrationNegativeTest-1227766755 Oct 08 20:56:47.231159 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 4a1046f826864ce2aeafe7c6fa76d27d Oct 08 20:56:47.231159 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1227766755 Oct 08 20:56:47.231159 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-LiveMigrationNegativeTest-1227766755-project-admin Oct 08 20:56:47.231159 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 20:56:47.231159 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 20:56:47.231159 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 3d7dcc4a842b44ad916158a902ee0878 Oct 08 20:56:47.231159 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-LiveMigrationNegativeTest-1227766755-project-admin Oct 08 20:56:47.231159 ncdv-master-1 devstack@n-api.service[140491]: Oct 08 20:56:47.231159 ncdv-master-1 devstack@n-api.service[140491]: {"os-migrateLive": {"host": "tempest-host-1285307328", "block_migration": true, "disk_over_commit": false}} Oct 08 20:56:47.231159 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 20:56:47.231159 ncdv-master-1 devstack@n-api.service[140491]: exception: Compute host tempest-host-1285307328 could not be found. Oct 08 20:56:47.231159 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': '7f720341-f7ad-4365-8aeb-0aad8afb46b6', 'body': {'os-migrateLive': {'host': 'tempest-host-1285307328', 'block_migration': True, 'disk_over_commit': False}}} Oct 08 20:56:47.231159 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:56:47.231159 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:56:47.231159 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Oct 08 20:56:47.231159 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Oct 08 20:56:47.231159 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 08 20:56:47.231159 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 08 20:56:47.231159 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 08 20:56:47.231159 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 08 20:56:47.231159 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 08 20:56:47.231159 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 08 20:56:47.231159 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 08 20:56:47.231159 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 08 20:56:47.231159 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 08 20:56:47.231159 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 08 20:56:47.231159 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 08 20:56:47.231159 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 08 20:56:47.231159 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 08 20:56:47.231159 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 08 20:56:47.231159 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 08 20:56:47.231159 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 08 20:56:47.231159 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5488, in live_migrate Oct 08 20:56:47.231159 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Oct 08 20:56:47.231159 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 08 20:56:47.231159 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 08 20:56:47.231159 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Oct 08 20:56:47.231159 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Oct 08 20:56:47.239020 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Oct 08 20:56:47.239020 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:56:47.239020 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Oct 08 20:56:47.239020 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Oct 08 20:56:47.239020 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Oct 08 20:56:47.239020 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Oct 08 20:56:47.239020 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Oct 08 20:56:47.239020 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Oct 08 20:56:47.239020 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-1285307328 could not be found. Oct 08 20:56:47.239020 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:56:47.239020 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:56:47.239020 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:56:47.239020 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:56:47.239020 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:56:47.239020 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:56:47.239020 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:56:47.239020 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:56:47.239020 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:56:47.239020 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:56:47.239020 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 20:56:47.239020 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 20:56:47.239020 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 20:56:47.239020 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 20:56:47.239020 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 20:56:47.239020 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 20:56:47.239020 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 08 20:56:47.239020 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Oct 08 20:56:47.239020 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 08 20:56:47.239020 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-1285307328 could not be found. Oct 08 20:56:47.239020 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:56:47.239020 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:56:47.239020 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:56:47.239020 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:56:47.239020 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:56:47.239020 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:56:47.239020 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 20:56:47.239020 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 20:56:47.239020 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-1285307328 could not be found. Oct 08 20:56:47.239020 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:56:47.239020 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-85d4958a-36c3-4de4-963d-1780e6df1367 tempest-LiveMigrationNegativeTest-1227766755 tempest-LiveMigrationNegativeTest-1227766755-project-admin] Returning 400 to user: Compute host tempest-host-1285307328 could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:56:47.239020 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-85d4958a-36c3-4de4-963d-1780e6df1367 tempest-LiveMigrationNegativeTest-1227766755 tempest-LiveMigrationNegativeTest-1227766755-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/7f720341-f7ad-4365-8aeb-0aad8afb46b6/action" status: 400 len: 100 microversion: 2.1 time: 0.409670 Oct 08 20:56:47.239020 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 630/1315] 10.222.0.26 () {60 vars in 1279 bytes} [Sat Oct 8 20:56:46 2022] POST /compute/v2.1/servers/7f720341-f7ad-4365-8aeb-0aad8afb46b6/action => generated 100 bytes in 412 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 08 20:56:47.245602 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-9d421b0f-c8d8-42f5-9174-fb7f92fbbb20 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:47.248959 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-9d421b0f-c8d8-42f5-9174-fb7f92fbbb20 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] [instance: 0cbc3ac5-5690-4f4e-a9d1-ea0de18060b1] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:56:47.259817 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ad715547-b7bc-4e95-93cb-755b5b10798e tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:47.261808 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ad715547-b7bc-4e95-93cb-755b5b10798e tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:47.263757 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9d421b0f-c8d8-42f5-9174-fb7f92fbbb20 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:47.264239 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ad715547-b7bc-4e95-93cb-755b5b10798e tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:47.264367 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9d421b0f-c8d8-42f5-9174-fb7f92fbbb20 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:47.266198 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ad715547-b7bc-4e95-93cb-755b5b10798e tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:47.267167 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9d421b0f-c8d8-42f5-9174-fb7f92fbbb20 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:47.267952 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9d421b0f-c8d8-42f5-9174-fb7f92fbbb20 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:47.268074 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ad715547-b7bc-4e95-93cb-755b5b10798e tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:47.268761 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9d421b0f-c8d8-42f5-9174-fb7f92fbbb20 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:47.269053 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ad715547-b7bc-4e95-93cb-755b5b10798e tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:47.270586 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9d421b0f-c8d8-42f5-9174-fb7f92fbbb20 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:47.275351 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:56:47.331346 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-9d421b0f-c8d8-42f5-9174-fb7f92fbbb20 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] HTTP exception thrown: Instance 0cbc3ac5-5690-4f4e-a9d1-ea0de18060b1 could not be found. Oct 08 20:56:47.337631 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-9d421b0f-c8d8-42f5-9174-fb7f92fbbb20 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Request method failure captured: Oct 08 20:56:47.337631 ncdv-master-1 devstack@n-api.service[140491]: request: GET /compute/v2.1/servers/0cbc3ac5-5690-4f4e-a9d1-ea0de18060b1 HTTP/1.1 Oct 08 20:56:47.337631 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 20:56:47.337631 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 20:56:47.337631 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 20:56:47.337631 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 20:56:47.337631 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 20:56:47.337631 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 20:56:47.337631 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 20:56:47.337631 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 20:56:47.337631 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeOEGx-Pj-9s8HrUcHFxZIIsXDAIQqr6YF8VD0acWNU1cphsCWIN9bZw-INXpDdIArY__DjFeHC-nd4MPtsMxu0tx-LKyWXGwvbNtrPKoC8pyMamiUfIOjmeREIepbgTqBWNoe2EBY7e812jzZjPuVQRPdHx3JZtjJXNnZjEeEE279U Oct 08 20:56:47.337631 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 20:56:47.337631 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 20:56:47.337631 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 20:56:47.337631 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 20:56:47.337631 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 20:56:47.337631 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 20:56:47.337631 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: bcb3706a1680419384f4fe9660e87732 Oct 08 20:56:47.337631 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-ListImageFiltersTestJSON-2058078722 Oct 08 20:56:47.337631 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 20:56:47.337631 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 20:56:47.337631 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/bcb3706a1680419384f4fe9660e87732"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/bcb3706a1680419384f4fe9660e87732"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_bcb3706a1680419384f4fe9660e87732"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/bcb3706a1680419384f4fe9660e87732"}]}] Oct 08 20:56:47.337631 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-ListImageFiltersTestJSON-2058078722 Oct 08 20:56:47.337631 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: bcb3706a1680419384f4fe9660e87732 Oct 08 20:56:47.337631 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-2058078722 Oct 08 20:56:47.337631 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-ListImageFiltersTestJSON-2058078722-project Oct 08 20:56:47.337631 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 20:56:47.337631 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 20:56:47.337631 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 6bce55d7f67347aaaa4c2a687bdff183 Oct 08 20:56:47.337631 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-ListImageFiltersTestJSON-2058078722-project Oct 08 20:56:47.337631 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 20:56:47.337631 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance 0cbc3ac5-5690-4f4e-a9d1-ea0de18060b1 could not be found. Oct 08 20:56:47.337631 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': '0cbc3ac5-5690-4f4e-a9d1-ea0de18060b1'} Oct 08 20:56:47.337631 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:56:47.337631 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:56:47.337631 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 20:56:47.337631 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 20:56:47.337631 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 20:56:47.337631 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 20:56:47.337631 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 20:56:47.337631 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 20:56:47.337631 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 20:56:47.337631 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 20:56:47.337631 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0cbc3ac5-5690-4f4e-a9d1-ea0de18060b1 could not be found. Oct 08 20:56:47.337631 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:56:47.337631 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:56:47.337631 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:56:47.337631 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:56:47.337631 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:56:47.337631 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:56:47.337631 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:56:47.337631 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:56:47.337631 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:56:47.337631 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:56:47.337631 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 20:56:47.337631 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 20:56:47.337631 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 20:56:47.337631 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 20:56:47.337631 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 20:56:47.337631 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 20:56:47.337631 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0cbc3ac5-5690-4f4e-a9d1-ea0de18060b1 could not be found. Oct 08 20:56:47.337631 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:56:47.337631 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:56:47.337631 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:56:47.342679 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:56:47.342679 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:56:47.342679 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:56:47.342679 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 20:56:47.342679 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 20:56:47.342679 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0cbc3ac5-5690-4f4e-a9d1-ea0de18060b1 could not be found. Oct 08 20:56:47.342679 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:56:47.342679 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-9d421b0f-c8d8-42f5-9174-fb7f92fbbb20 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Returning 404 to user: Instance 0cbc3ac5-5690-4f4e-a9d1-ea0de18060b1 could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:56:47.342679 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-9d421b0f-c8d8-42f5-9174-fb7f92fbbb20 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] 10.222.0.26 "GET /compute/v2.1/servers/0cbc3ac5-5690-4f4e-a9d1-ea0de18060b1" status: 404 len: 111 microversion: 2.1 time: 0.104037 Oct 08 20:56:47.347566 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 631/1316] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:56:47 2022] GET /compute/v2.1/servers/0cbc3ac5-5690-4f4e-a9d1-ea0de18060b1 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 20:56:47.353155 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-5e277593-8bc9-40e7-8545-a80e715ac9e3 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:47.357916 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-5e277593-8bc9-40e7-8545-a80e715ac9e3 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] [instance: 92e31b92-0af1-4da6-bc87-23978f1aedf5] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:56:47.381856 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5e277593-8bc9-40e7-8545-a80e715ac9e3 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:47.384923 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5e277593-8bc9-40e7-8545-a80e715ac9e3 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:47.385467 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5e277593-8bc9-40e7-8545-a80e715ac9e3 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:47.387399 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5e277593-8bc9-40e7-8545-a80e715ac9e3 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:47.387893 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5e277593-8bc9-40e7-8545-a80e715ac9e3 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:47.390144 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5e277593-8bc9-40e7-8545-a80e715ac9e3 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:47.511143 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5e277593-8bc9-40e7-8545-a80e715ac9e3 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:47.511787 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5e277593-8bc9-40e7-8545-a80e715ac9e3 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:47.512390 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5e277593-8bc9-40e7-8545-a80e715ac9e3 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:47.512866 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.objects.instance [None req-5e277593-8bc9-40e7-8545-a80e715ac9e3 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lazy-loading 'fault' on Instance uuid 92e31b92-0af1-4da6-bc87-23978f1aedf5 {{(pid=140491) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 20:56:47.614662 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-ad715547-b7bc-4e95-93cb-755b5b10798e tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474ca64d1b1d4e30916b517645aba882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecc2dd2407b4819874bed09cb27959a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:47.629748 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-ad715547-b7bc-4e95-93cb-755b5b10798e tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] 10.222.0.26 "GET /compute/v2.1/servers/e338d559-3f7c-4cc8-95c6-face79e11ca2" status: 200 len: 1708 microversion: 2.1 time: 0.415236 Oct 08 20:56:47.631052 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 686/1317] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:56:47 2022] GET /compute/v2.1/servers/e338d559-3f7c-4cc8-95c6-face79e11ca2 => generated 1708 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:56:47.639010 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-d7040102-603b-49bd-b46d-a0a9e091c4ad tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:47.639866 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-d7040102-603b-49bd-b46d-a0a9e091c4ad tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] [instance: b5452da7-7cb6-493b-a5d1-4c60ed1e342c] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:56:47.648154 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d7040102-603b-49bd-b46d-a0a9e091c4ad tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:47.649025 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d7040102-603b-49bd-b46d-a0a9e091c4ad tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:47.652040 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d7040102-603b-49bd-b46d-a0a9e091c4ad tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:47.652040 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d7040102-603b-49bd-b46d-a0a9e091c4ad tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:47.652040 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d7040102-603b-49bd-b46d-a0a9e091c4ad tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:47.671339 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d7040102-603b-49bd-b46d-a0a9e091c4ad tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:47.889153 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-5e277593-8bc9-40e7-8545-a80e715ac9e3 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:47.899158 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-5e277593-8bc9-40e7-8545-a80e715ac9e3 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:47.901220 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-5e277593-8bc9-40e7-8545-a80e715ac9e3 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f72559f9cbb4544af3008e574d554ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a10eeae3da4b9a979b8c1167039014', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:47.911099 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-5e277593-8bc9-40e7-8545-a80e715ac9e3 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] 10.222.0.26 "GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5" status: 200 len: 1544 microversion: 2.91 time: 0.562286 Oct 08 20:56:47.913768 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 632/1318] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:56:47 2022] GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5 => generated 1544 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:56:47.939395 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-e0641e16-aa5c-43e4-a41f-f00d41c7a179 req-39b167f9-325a-44a5-897f-f39d9cd65ac2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5452da7-7cb6-493b-a5d1-4c60ed1e342c", "tag": "93e84696-aa00-46c7-8d5d-36171a311b21"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:56:47.950108 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-e0641e16-aa5c-43e4-a41f-f00d41c7a179 req-39b167f9-325a-44a5-897f-f39d9cd65ac2 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:47.950911 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-e0641e16-aa5c-43e4-a41f-f00d41c7a179 req-39b167f9-325a-44a5-897f-f39d9cd65ac2 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:47.951415 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-e0641e16-aa5c-43e4-a41f-f00d41c7a179 req-39b167f9-325a-44a5-897f-f39d9cd65ac2 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:47.968940 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-e0641e16-aa5c-43e4-a41f-f00d41c7a179 req-39b167f9-325a-44a5-897f-f39d9cd65ac2 service nova] Creating event network-changed:93e84696-aa00-46c7-8d5d-36171a311b21 for instance b5452da7-7cb6-493b-a5d1-4c60ed1e342c on nch2-master-1 Oct 08 20:56:47.975074 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-e0641e16-aa5c-43e4-a41f-f00d41c7a179 req-39b167f9-325a-44a5-897f-f39d9cd65ac2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059805 Oct 08 20:56:47.976803 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 633/1319] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:56:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:56:47.985553 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-d03babcf-975d-46dc-96ca-bf66ce57744f tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:47.986793 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-d03babcf-975d-46dc-96ca-bf66ce57744f tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] [instance: 7f720341-f7ad-4365-8aeb-0aad8afb46b6] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:56:47.991421 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-d7040102-603b-49bd-b46d-a0a9e091c4ad tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] 10.222.0.26 "GET /compute/v2.1/servers/b5452da7-7cb6-493b-a5d1-4c60ed1e342c/os-security-groups" status: 200 len: 1156 microversion: 2.1 time: 0.358792 Oct 08 20:56:47.992238 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 687/1320] 10.222.0.26 () {58 vars in 1293 bytes} [Sat Oct 8 20:56:47 2022] GET /compute/v2.1/servers/b5452da7-7cb6-493b-a5d1-4c60ed1e342c/os-security-groups => generated 1156 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:56:48.000501 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-79121363-d9b9-4d88-8a2e-1a9d4f7c6029 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:48.004756 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-79121363-d9b9-4d88-8a2e-1a9d4f7c6029 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] [instance: 24300a5e-164c-4d97-9a1f-b52359c1c0d6] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:56:48.016245 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d03babcf-975d-46dc-96ca-bf66ce57744f tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:48.018661 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d03babcf-975d-46dc-96ca-bf66ce57744f tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:48.019436 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-79121363-d9b9-4d88-8a2e-1a9d4f7c6029 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:48.020110 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d03babcf-975d-46dc-96ca-bf66ce57744f tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:48.020847 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d03babcf-975d-46dc-96ca-bf66ce57744f tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:48.021335 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d03babcf-975d-46dc-96ca-bf66ce57744f tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:48.021756 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d03babcf-975d-46dc-96ca-bf66ce57744f tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:48.022446 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-79121363-d9b9-4d88-8a2e-1a9d4f7c6029 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:48.022888 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-79121363-d9b9-4d88-8a2e-1a9d4f7c6029 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:48.023608 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-79121363-d9b9-4d88-8a2e-1a9d4f7c6029 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:48.024083 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-79121363-d9b9-4d88-8a2e-1a9d4f7c6029 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:48.024491 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-79121363-d9b9-4d88-8a2e-1a9d4f7c6029 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:48.097442 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-79121363-d9b9-4d88-8a2e-1a9d4f7c6029 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] [instance: 24300a5e-164c-4d97-9a1f-b52359c1c0d6] Going to try to terminate instance {{(pid=140492) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 20:56:48.295111 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-79121363-d9b9-4d88-8a2e-1a9d4f7c6029 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] 10.222.0.26 "DELETE /compute/v2.1/servers/24300a5e-164c-4d97-9a1f-b52359c1c0d6" status: 204 len: 0 microversion: 2.1 time: 0.301237 Oct 08 20:56:48.300768 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 688/1321] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 20:56:47 2022] DELETE /compute/v2.1/servers/24300a5e-164c-4d97-9a1f-b52359c1c0d6 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 20:56:48.309714 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-90abbb2e-6853-4b5b-8908-5ff5884a670e tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:48.310438 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-90abbb2e-6853-4b5b-8908-5ff5884a670e tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] [instance: ceced78a-58d9-4175-b4fe-0d085be62c94] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:56:48.332524 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-90abbb2e-6853-4b5b-8908-5ff5884a670e tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:48.333047 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-90abbb2e-6853-4b5b-8908-5ff5884a670e tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:48.334842 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-90abbb2e-6853-4b5b-8908-5ff5884a670e tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:48.335608 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-90abbb2e-6853-4b5b-8908-5ff5884a670e tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:48.336097 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-90abbb2e-6853-4b5b-8908-5ff5884a670e tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:48.336522 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-90abbb2e-6853-4b5b-8908-5ff5884a670e tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:48.367406 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-d03babcf-975d-46dc-96ca-bf66ce57744f tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05f0f7a60257437eaa8702b664916979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7550f7ad9dc45ba9c9bfb0a5a11a774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:48.376973 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-d03babcf-975d-46dc-96ca-bf66ce57744f tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] 10.222.0.26 "GET /compute/v2.1/servers/7f720341-f7ad-4365-8aeb-0aad8afb46b6" status: 200 len: 1468 microversion: 2.1 time: 0.397599 Oct 08 20:56:48.381731 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 634/1322] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:56:47 2022] GET /compute/v2.1/servers/7f720341-f7ad-4365-8aeb-0aad8afb46b6 => generated 1468 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:56:48.406815 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-3e463dc7-fa49-4739-8ad5-4c500e35456c tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Calling method '.version_select at 0x7f1a8c8d81f0>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:48.421104 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3e463dc7-fa49-4739-8ad5-4c500e35456c tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:48.423573 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3e463dc7-fa49-4739-8ad5-4c500e35456c tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:48.424932 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3e463dc7-fa49-4739-8ad5-4c500e35456c tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:48.456980 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-3e463dc7-fa49-4739-8ad5-4c500e35456c tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] 10.222.0.26 "GET /compute/v2.1/os-migrations" status: 200 len: 2318 microversion: 2.1 time: 0.072737 Oct 08 20:56:48.459296 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 635/1323] 10.222.0.26 () {58 vars in 1143 bytes} [Sat Oct 8 20:56:48 2022] GET /compute/v2.1/os-migrations => generated 2318 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:56:48.507326 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-f4ca7c27-9f54-4750-9384-2bef9a588686 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:48.508148 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-f4ca7c27-9f54-4750-9384-2bef9a588686 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] [instance: 57016fcf-2d2c-488c-9af6-0530ebc199f6] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:56:48.523092 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f4ca7c27-9f54-4750-9384-2bef9a588686 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:48.526952 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f4ca7c27-9f54-4750-9384-2bef9a588686 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:48.527855 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f4ca7c27-9f54-4750-9384-2bef9a588686 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:48.528875 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f4ca7c27-9f54-4750-9384-2bef9a588686 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:48.529614 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f4ca7c27-9f54-4750-9384-2bef9a588686 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:48.532705 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f4ca7c27-9f54-4750-9384-2bef9a588686 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:48.777888 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-90abbb2e-6853-4b5b-8908-5ff5884a670e tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:48.792560 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-90abbb2e-6853-4b5b-8908-5ff5884a670e tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:48.794839 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-90abbb2e-6853-4b5b-8908-5ff5884a670e tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:48.796217 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-90abbb2e-6853-4b5b-8908-5ff5884a670e tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] 10.222.0.26 "GET /compute/v2.1/servers/ceced78a-58d9-4175-b4fe-0d085be62c94" status: 200 len: 1832 microversion: 2.42 time: 0.497028 Oct 08 20:56:48.811034 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 689/1324] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:56:48 2022] GET /compute/v2.1/servers/ceced78a-58d9-4175-b4fe-0d085be62c94 => generated 1832 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:56:48.824116 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-9a1d744b-30fb-4ae2-9b48-4d5aa3ceb14b tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Action: 'create', calling method: .version_select at 0x7f1a913f4a60>, body: {"security_group": {"name": " tempest-securitygroup -383303969 ", "description": "tempest-description-234437835"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:56:48.942878 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-f4ca7c27-9f54-4750-9384-2bef9a588686 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:48.970473 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-f4ca7c27-9f54-4750-9384-2bef9a588686 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:48.977074 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-f4ca7c27-9f54-4750-9384-2bef9a588686 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:48.979507 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-f4ca7c27-9f54-4750-9384-2bef9a588686 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] 10.222.0.26 "GET /compute/v2.1/servers/57016fcf-2d2c-488c-9af6-0530ebc199f6" status: 200 len: 1814 microversion: 2.25 time: 0.514956 Oct 08 20:56:48.992919 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 636/1325] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:56:48 2022] GET /compute/v2.1/servers/57016fcf-2d2c-488c-9af6-0530ebc199f6 => generated 1814 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:56:49.005355 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-250539d6-0c3b-47eb-9a98-47f3148298b5 req-615f4c50-6f2b-4a57-bf45-a367aed44ad9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5452da7-7cb6-493b-a5d1-4c60ed1e342c", "tag": "93e84696-aa00-46c7-8d5d-36171a311b21"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:56:49.041395 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-250539d6-0c3b-47eb-9a98-47f3148298b5 req-615f4c50-6f2b-4a57-bf45-a367aed44ad9 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:49.044914 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-250539d6-0c3b-47eb-9a98-47f3148298b5 req-615f4c50-6f2b-4a57-bf45-a367aed44ad9 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:49.045566 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-250539d6-0c3b-47eb-9a98-47f3148298b5 req-615f4c50-6f2b-4a57-bf45-a367aed44ad9 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:49.088181 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-250539d6-0c3b-47eb-9a98-47f3148298b5 req-615f4c50-6f2b-4a57-bf45-a367aed44ad9 service nova] Creating event network-changed:93e84696-aa00-46c7-8d5d-36171a311b21 for instance b5452da7-7cb6-493b-a5d1-4c60ed1e342c on nch2-master-1 Oct 08 20:56:49.097790 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-250539d6-0c3b-47eb-9a98-47f3148298b5 req-615f4c50-6f2b-4a57-bf45-a367aed44ad9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101921 Oct 08 20:56:49.098856 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 637/1326] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:56:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:56:49.114224 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-5ad4da7a-a3f4-4923-abf5-138cbe5aace4 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:49.117027 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-5ad4da7a-a3f4-4923-abf5-138cbe5aace4 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] [instance: 24300a5e-164c-4d97-9a1f-b52359c1c0d6] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:56:49.126265 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5ad4da7a-a3f4-4923-abf5-138cbe5aace4 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:49.126788 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5ad4da7a-a3f4-4923-abf5-138cbe5aace4 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:49.127237 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5ad4da7a-a3f4-4923-abf5-138cbe5aace4 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:49.127970 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5ad4da7a-a3f4-4923-abf5-138cbe5aace4 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:49.128527 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5ad4da7a-a3f4-4923-abf5-138cbe5aace4 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:49.128978 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5ad4da7a-a3f4-4923-abf5-138cbe5aace4 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:49.514167 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-5ad4da7a-a3f4-4923-abf5-138cbe5aace4 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bce55d7f67347aaaa4c2a687bdff183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb3706a1680419384f4fe9660e87732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:49.528506 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-5ad4da7a-a3f4-4923-abf5-138cbe5aace4 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] 10.222.0.26 "GET /compute/v2.1/servers/24300a5e-164c-4d97-9a1f-b52359c1c0d6" status: 200 len: 1472 microversion: 2.1 time: 0.427918 Oct 08 20:56:49.541445 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 638/1327] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:56:49 2022] GET /compute/v2.1/servers/24300a5e-164c-4d97-9a1f-b52359c1c0d6 => generated 1472 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:56:49.566824 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-864b8212-130b-4ca1-aee7-583ecf15a85b tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:49.568801 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-864b8212-130b-4ca1-aee7-583ecf15a85b tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] [instance: e338d559-3f7c-4cc8-95c6-face79e11ca2] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:56:49.581096 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-864b8212-130b-4ca1-aee7-583ecf15a85b tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:49.583020 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-864b8212-130b-4ca1-aee7-583ecf15a85b tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:49.584254 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-864b8212-130b-4ca1-aee7-583ecf15a85b tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:49.585732 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-864b8212-130b-4ca1-aee7-583ecf15a85b tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:49.586725 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-864b8212-130b-4ca1-aee7-583ecf15a85b tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:49.588579 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-864b8212-130b-4ca1-aee7-583ecf15a85b tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:49.841274 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-9a1d744b-30fb-4ae2-9b48-4d5aa3ceb14b tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] 10.222.0.26 "POST /compute/v2.1/os-security-groups" status: 200 len: 222 microversion: 2.1 time: 1.028445 Oct 08 20:56:49.844672 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 690/1328] 10.222.0.26 () {60 vars in 1180 bytes} [Sat Oct 8 20:56:48 2022] POST /compute/v2.1/os-security-groups => generated 222 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:56:49.850519 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-79334acf-1d9f-4b82-b50f-0d6c49938268 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1009602076", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:56:49.959184 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.network.neutron [None req-79334acf-1d9f-4b82-b50f-0d6c49938268 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] validate_networks() for None {{(pid=140492) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 20:56:50.016441 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-864b8212-130b-4ca1-aee7-583ecf15a85b tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/e338d559-3f7c-4cc8-95c6-face79e11ca2" status: 200 len: 1859 microversion: 2.1 time: 0.473731 Oct 08 20:56:50.018089 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 639/1329] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:56:49 2022] GET /compute/v2.1/servers/e338d559-3f7c-4cc8-95c6-face79e11ca2 => generated 1859 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:56:50.023275 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-9a0f2db0-ff68-4d38-9643-8c3ad7cd53f6 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:50.024082 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-9a0f2db0-ff68-4d38-9643-8c3ad7cd53f6 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] [instance: 92e31b92-0af1-4da6-bc87-23978f1aedf5] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:56:50.030999 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9a0f2db0-ff68-4d38-9643-8c3ad7cd53f6 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:50.031676 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9a0f2db0-ff68-4d38-9643-8c3ad7cd53f6 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:50.032311 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9a0f2db0-ff68-4d38-9643-8c3ad7cd53f6 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:50.033296 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9a0f2db0-ff68-4d38-9643-8c3ad7cd53f6 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:50.033916 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9a0f2db0-ff68-4d38-9643-8c3ad7cd53f6 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:50.034519 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9a0f2db0-ff68-4d38-9643-8c3ad7cd53f6 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:50.039845 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:56:50.052114 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-9a0f2db0-ff68-4d38-9643-8c3ad7cd53f6 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] HTTP exception thrown: Instance 92e31b92-0af1-4da6-bc87-23978f1aedf5 could not be found. Oct 08 20:56:50.054296 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-9a0f2db0-ff68-4d38-9643-8c3ad7cd53f6 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Request method failure captured: Oct 08 20:56:50.054296 ncdv-master-1 devstack@n-api.service[140491]: request: GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5 HTTP/1.1 Oct 08 20:56:50.054296 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 20:56:50.054296 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 20:56:50.054296 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 20:56:50.054296 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 20:56:50.054296 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 20:56:50.054296 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 20:56:50.054296 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 20:56:50.054296 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 20:56:50.054296 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeNYyCjxtNIRThZ8im1PkTDl12vxMpzuuW37Mg_3maHNb7usQdItZHbsxfJwLRuKaUl-EI_WrGtVnesmC6082NA5vASHLP81HNjhYSM3on4kZ1KqelX_b1wj0IAXs9JOYb3lPnzC74SMOu5eJUm8CqWaZj9U4taMsswW0UfH5aBpeI8 Oct 08 20:56:50.054296 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 20:56:50.054296 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 20:56:50.054296 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 20:56:50.054296 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 20:56:50.054296 ncdv-master-1 devstack@n-api.service[140491]: X-Openstack-Nova-Api-Version: 2.91 Oct 08 20:56:50.054296 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 20:56:50.054296 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 20:56:50.054296 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 65a10eeae3da4b9a979b8c1167039014 Oct 08 20:56:50.054296 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-UnshelveToHostMultiNodesTest-1437507591 Oct 08 20:56:50.054296 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 20:56:50.054296 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 20:56:50.054296 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/65a10eeae3da4b9a979b8c1167039014"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/65a10eeae3da4b9a979b8c1167039014"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_65a10eeae3da4b9a979b8c1167039014"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/65a10eeae3da4b9a979b8c1167039014"}]}] Oct 08 20:56:50.054296 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-UnshelveToHostMultiNodesTest-1437507591 Oct 08 20:56:50.054296 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 65a10eeae3da4b9a979b8c1167039014 Oct 08 20:56:50.054296 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-UnshelveToHostMultiNodesTest-1437507591 Oct 08 20:56:50.054296 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-UnshelveToHostMultiNodesTest-1437507591-project Oct 08 20:56:50.054296 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 20:56:50.054296 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 20:56:50.054296 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 2f72559f9cbb4544af3008e574d554ee Oct 08 20:56:50.054296 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-UnshelveToHostMultiNodesTest-1437507591-project Oct 08 20:56:50.054296 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 20:56:50.054296 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance 92e31b92-0af1-4da6-bc87-23978f1aedf5 could not be found. Oct 08 20:56:50.054296 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': '92e31b92-0af1-4da6-bc87-23978f1aedf5'} Oct 08 20:56:50.054296 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:56:50.054296 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:56:50.054296 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 20:56:50.054296 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 20:56:50.054296 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 20:56:50.054296 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 20:56:50.054296 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 20:56:50.054296 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 20:56:50.054296 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 20:56:50.054296 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 20:56:50.054296 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92e31b92-0af1-4da6-bc87-23978f1aedf5 could not be found. Oct 08 20:56:50.054296 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:56:50.054296 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:56:50.054296 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:56:50.054296 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:56:50.054296 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:56:50.054296 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:56:50.054296 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:56:50.054296 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:56:50.054296 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:56:50.054296 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:56:50.054296 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 20:56:50.054296 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 20:56:50.054296 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 20:56:50.054296 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 20:56:50.054296 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 20:56:50.054296 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 20:56:50.054296 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92e31b92-0af1-4da6-bc87-23978f1aedf5 could not be found. Oct 08 20:56:50.054296 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:56:50.059653 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:56:50.059653 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:56:50.059653 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:56:50.059653 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:56:50.059653 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:56:50.059653 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 20:56:50.059653 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 20:56:50.059653 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92e31b92-0af1-4da6-bc87-23978f1aedf5 could not be found. Oct 08 20:56:50.059653 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:56:50.061670 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-9a0f2db0-ff68-4d38-9643-8c3ad7cd53f6 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] Returning 404 to user: Instance 92e31b92-0af1-4da6-bc87-23978f1aedf5 could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:56:50.062711 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-9a0f2db0-ff68-4d38-9643-8c3ad7cd53f6 tempest-UnshelveToHostMultiNodesTest-1437507591 tempest-UnshelveToHostMultiNodesTest-1437507591-project] 10.222.0.26 "GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5" status: 404 len: 111 microversion: 2.91 time: 0.043364 Oct 08 20:56:50.067024 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 640/1330] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:56:50 2022] GET /compute/v2.1/servers/92e31b92-0af1-4da6-bc87-23978f1aedf5 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 08 20:56:50.073752 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-648c73aa-5845-463c-8924-4364d023f3bf tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:50.074563 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-648c73aa-5845-463c-8924-4364d023f3bf tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] [instance: ceced78a-58d9-4175-b4fe-0d085be62c94] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:56:50.082031 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-648c73aa-5845-463c-8924-4364d023f3bf tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:50.082906 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-648c73aa-5845-463c-8924-4364d023f3bf tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:50.083572 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-648c73aa-5845-463c-8924-4364d023f3bf tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:50.084604 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-648c73aa-5845-463c-8924-4364d023f3bf tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:50.085423 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-648c73aa-5845-463c-8924-4364d023f3bf tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:50.086160 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-648c73aa-5845-463c-8924-4364d023f3bf tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:50.611974 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-79334acf-1d9f-4b82-b50f-0d6c49938268 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Flavor limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 20:56:50.612640 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-79334acf-1d9f-4b82-b50f-0d6c49938268 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Image limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 20:56:50.613135 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-79334acf-1d9f-4b82-b50f-0d6c49938268 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Flavor pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 20:56:50.613571 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-79334acf-1d9f-4b82-b50f-0d6c49938268 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Image pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 20:56:50.613989 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-79334acf-1d9f-4b82-b50f-0d6c49938268 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 20:56:50.631876 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-79334acf-1d9f-4b82-b50f-0d6c49938268 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:50.632089 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-79334acf-1d9f-4b82-b50f-0d6c49938268 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:50.634894 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-79334acf-1d9f-4b82-b50f-0d6c49938268 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:50.635700 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-79334acf-1d9f-4b82-b50f-0d6c49938268 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:50.638302 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-79334acf-1d9f-4b82-b50f-0d6c49938268 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:50.638760 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-79334acf-1d9f-4b82-b50f-0d6c49938268 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:50.650325 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-648c73aa-5845-463c-8924-4364d023f3bf tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:50.664322 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-648c73aa-5845-463c-8924-4364d023f3bf tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:50.669912 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-648c73aa-5845-463c-8924-4364d023f3bf tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:50.672684 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-648c73aa-5845-463c-8924-4364d023f3bf tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] 10.222.0.26 "GET /compute/v2.1/servers/ceced78a-58d9-4175-b4fe-0d085be62c94" status: 200 len: 1832 microversion: 2.42 time: 0.603755 Oct 08 20:56:50.677208 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 641/1331] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:56:50 2022] GET /compute/v2.1/servers/ceced78a-58d9-4175-b4fe-0d085be62c94 => generated 1832 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:56:50.685541 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-b150ec43-d417-41ca-ad36-e35b9f734e1a tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Calling method '.version_select at 0x7f1a8c9d0940>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:50.686300 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-79334acf-1d9f-4b82-b50f-0d6c49938268 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Getting quotas for project d7550f7ad9dc45ba9c9bfb0a5a11a774. Resources: {'cores', 'instances', 'ram'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 20:56:50.701506 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-79334acf-1d9f-4b82-b50f-0d6c49938268 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Getting quotas for user 05f0f7a60257437eaa8702b664916979 and project d7550f7ad9dc45ba9c9bfb0a5a11a774. Resources: {'cores', 'instances', 'ram'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 20:56:50.724877 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-79334acf-1d9f-4b82-b50f-0d6c49938268 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Going to run 1 instances... {{(pid=140492) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 20:56:50.727505 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-79334acf-1d9f-4b82-b50f-0d6c49938268 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] [instance: c2250e42-ea12-4161-8558-cba54fd9b4a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c508bd7f-7db9-4b2c-af7c-be54a855c355',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140492) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 20:56:50.808129 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-79334acf-1d9f-4b82-b50f-0d6c49938268 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.961992 Oct 08 20:56:50.812862 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 691/1332] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 20:56:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 967 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 08 20:56:50.822610 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-431ce7c4-5fc7-437f-a2d3-76b67da4b1c8 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:50.823999 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-431ce7c4-5fc7-437f-a2d3-76b67da4b1c8 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] [instance: 57016fcf-2d2c-488c-9af6-0530ebc199f6] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:56:50.833742 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-431ce7c4-5fc7-437f-a2d3-76b67da4b1c8 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:50.834796 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-431ce7c4-5fc7-437f-a2d3-76b67da4b1c8 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:50.836124 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-431ce7c4-5fc7-437f-a2d3-76b67da4b1c8 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:50.837739 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-431ce7c4-5fc7-437f-a2d3-76b67da4b1c8 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:50.838597 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-431ce7c4-5fc7-437f-a2d3-76b67da4b1c8 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:50.839581 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-431ce7c4-5fc7-437f-a2d3-76b67da4b1c8 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:50.924354 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-b150ec43-d417-41ca-ad36-e35b9f734e1a tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] 10.222.0.26 "GET /compute/v2.1/os-security-groups/6e6daaa3-cbc3-4322-ab19-f19963e4cc06" status: 200 len: 222 microversion: 2.1 time: 0.245827 Oct 08 20:56:50.926286 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 642/1333] 10.222.0.26 () {58 vars in 1269 bytes} [Sat Oct 8 20:56:50 2022] GET /compute/v2.1/os-security-groups/6e6daaa3-cbc3-4322-ab19-f19963e4cc06 => generated 222 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:56:50.930848 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-8822308c-27fa-4f1c-b1aa-d5892f0fbca5 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:50.932350 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-8822308c-27fa-4f1c-b1aa-d5892f0fbca5 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] [instance: e338d559-3f7c-4cc8-95c6-face79e11ca2] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:56:50.940222 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8822308c-27fa-4f1c-b1aa-d5892f0fbca5 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:50.940944 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8822308c-27fa-4f1c-b1aa-d5892f0fbca5 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:50.942324 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8822308c-27fa-4f1c-b1aa-d5892f0fbca5 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:50.943214 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8822308c-27fa-4f1c-b1aa-d5892f0fbca5 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:50.943933 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8822308c-27fa-4f1c-b1aa-d5892f0fbca5 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:50.944521 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8822308c-27fa-4f1c-b1aa-d5892f0fbca5 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:51.414127 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-8822308c-27fa-4f1c-b1aa-d5892f0fbca5 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/e338d559-3f7c-4cc8-95c6-face79e11ca2" status: 200 len: 1859 microversion: 2.1 time: 0.486294 Oct 08 20:56:51.421077 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 643/1334] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:56:50 2022] GET /compute/v2.1/servers/e338d559-3f7c-4cc8-95c6-face79e11ca2 => generated 1859 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:56:51.426720 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-48223fc1-be3d-4886-9c0b-daf7d680f759 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:51.435016 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-48223fc1-be3d-4886-9c0b-daf7d680f759 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] [instance: 24300a5e-164c-4d97-9a1f-b52359c1c0d6] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:56:51.443775 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-48223fc1-be3d-4886-9c0b-daf7d680f759 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:51.444277 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-48223fc1-be3d-4886-9c0b-daf7d680f759 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:51.445077 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-48223fc1-be3d-4886-9c0b-daf7d680f759 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:51.462263 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-48223fc1-be3d-4886-9c0b-daf7d680f759 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:51.462766 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-48223fc1-be3d-4886-9c0b-daf7d680f759 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:51.463214 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-48223fc1-be3d-4886-9c0b-daf7d680f759 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:51.706483 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-431ce7c4-5fc7-437f-a2d3-76b67da4b1c8 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:51.727060 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-431ce7c4-5fc7-437f-a2d3-76b67da4b1c8 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:51.729894 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-431ce7c4-5fc7-437f-a2d3-76b67da4b1c8 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:51.731152 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-431ce7c4-5fc7-437f-a2d3-76b67da4b1c8 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] 10.222.0.26 "GET /compute/v2.1/servers/57016fcf-2d2c-488c-9af6-0530ebc199f6" status: 200 len: 1814 microversion: 2.25 time: 0.912753 Oct 08 20:56:51.753392 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 692/1335] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:56:50 2022] GET /compute/v2.1/servers/57016fcf-2d2c-488c-9af6-0530ebc199f6 => generated 1814 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:56:51.766020 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e70891e4-7e68-4193-800e-cf84a693d339 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:51.767944 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-e70891e4-7e68-4193-800e-cf84a693d339 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] [instance: c2250e42-ea12-4161-8558-cba54fd9b4a8] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:56:51.776223 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:56:51.778708 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e70891e4-7e68-4193-800e-cf84a693d339 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:51.779413 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e70891e4-7e68-4193-800e-cf84a693d339 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:51.780085 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e70891e4-7e68-4193-800e-cf84a693d339 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:51.781525 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e70891e4-7e68-4193-800e-cf84a693d339 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:51.782154 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e70891e4-7e68-4193-800e-cf84a693d339 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:51.783372 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e70891e4-7e68-4193-800e-cf84a693d339 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:51.940379 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-e70891e4-7e68-4193-800e-cf84a693d339 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05f0f7a60257437eaa8702b664916979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7550f7ad9dc45ba9c9bfb0a5a11a774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:51.968916 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-e70891e4-7e68-4193-800e-cf84a693d339 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] 10.222.0.26 "GET /compute/v2.1/servers/c2250e42-ea12-4161-8558-cba54fd9b4a8" status: 200 len: 1223 microversion: 2.1 time: 0.212417 Oct 08 20:56:51.980651 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 693/1336] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:56:51 2022] GET /compute/v2.1/servers/c2250e42-ea12-4161-8558-cba54fd9b4a8 => generated 1223 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:56:51.993748 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-48223fc1-be3d-4886-9c0b-daf7d680f759 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bce55d7f67347aaaa4c2a687bdff183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb3706a1680419384f4fe9660e87732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:52.006125 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-ef32d8e1-9b4b-472b-bc7b-7ad0686818c2 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Calling method '.version_select at 0x7f1a91406f70>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:52.018421 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-48223fc1-be3d-4886-9c0b-daf7d680f759 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] 10.222.0.26 "GET /compute/v2.1/servers/24300a5e-164c-4d97-9a1f-b52359c1c0d6" status: 200 len: 1430 microversion: 2.1 time: 0.595501 Oct 08 20:56:52.019189 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 644/1337] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:56:51 2022] GET /compute/v2.1/servers/24300a5e-164c-4d97-9a1f-b52359c1c0d6 => generated 1430 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:56:52.041905 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-656bbae7-3a63-4e04-8912-742329ae1509 req-7774ffd8-61c1-45b9-b867-d0ec4515fe45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ceced78a-58d9-4175-b4fe-0d085be62c94", "tag": "5dd9a8e9-ad33-45d4-9c64-b8e4e48e3190"}, {"server_uuid": "57016fcf-2d2c-488c-9af6-0530ebc199f6", "name": "network-vif-unplugged", "status": "completed", "tag": "574497fa-1919-4a57-bca6-30aeb414e335"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:56:52.055335 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-656bbae7-3a63-4e04-8912-742329ae1509 req-7774ffd8-61c1-45b9-b867-d0ec4515fe45 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:52.055903 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-656bbae7-3a63-4e04-8912-742329ae1509 req-7774ffd8-61c1-45b9-b867-d0ec4515fe45 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:52.056397 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-656bbae7-3a63-4e04-8912-742329ae1509 req-7774ffd8-61c1-45b9-b867-d0ec4515fe45 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:52.097725 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-656bbae7-3a63-4e04-8912-742329ae1509 req-7774ffd8-61c1-45b9-b867-d0ec4515fe45 service nova] Creating event network-changed:5dd9a8e9-ad33-45d4-9c64-b8e4e48e3190 for instance ceced78a-58d9-4175-b4fe-0d085be62c94 on nch2-master-1 Oct 08 20:56:52.098942 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-656bbae7-3a63-4e04-8912-742329ae1509 req-7774ffd8-61c1-45b9-b867-d0ec4515fe45 service nova] Creating event network-vif-unplugged:574497fa-1919-4a57-bca6-30aeb414e335 for instance 57016fcf-2d2c-488c-9af6-0530ebc199f6 on nch1-master-1 Oct 08 20:56:52.128465 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-656bbae7-3a63-4e04-8912-742329ae1509 req-7774ffd8-61c1-45b9-b867-d0ec4515fe45 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.104313 Oct 08 20:56:52.133223 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 645/1338] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:56:52 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:56:52.156198 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-12f9bd93-ede7-42c8-8e8a-208509369235 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:52.157046 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-12f9bd93-ede7-42c8-8e8a-208509369235 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] [instance: e338d559-3f7c-4cc8-95c6-face79e11ca2] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:56:52.166497 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-12f9bd93-ede7-42c8-8e8a-208509369235 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:52.168011 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-12f9bd93-ede7-42c8-8e8a-208509369235 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:52.168479 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-12f9bd93-ede7-42c8-8e8a-208509369235 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:52.169648 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-12f9bd93-ede7-42c8-8e8a-208509369235 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:52.197777 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-12f9bd93-ede7-42c8-8e8a-208509369235 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:52.200295 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-12f9bd93-ede7-42c8-8e8a-208509369235 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.030s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:52.556571 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.objects.instance [None req-12f9bd93-ede7-42c8-8e8a-208509369235 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lazy-loading 'services' on Instance uuid e338d559-3f7c-4cc8-95c6-face79e11ca2 {{(pid=140491) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 20:56:52.929448 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-12f9bd93-ede7-42c8-8e8a-208509369235 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] 10.222.0.26 "DELETE /compute/v2.1/servers/e338d559-3f7c-4cc8-95c6-face79e11ca2/os-volume_attachments/7646db34-383d-4fbe-a722-be3019ae4a2f" status: 202 len: 0 microversion: 2.1 time: 0.792156 Oct 08 20:56:52.930056 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 646/1339] 10.222.0.26 () {58 vars in 1416 bytes} [Sat Oct 8 20:56:52 2022] DELETE /compute/v2.1/servers/e338d559-3f7c-4cc8-95c6-face79e11ca2/os-volume_attachments/7646db34-383d-4fbe-a722-be3019ae4a2f => generated 0 bytes in 796 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 20:56:52.941972 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-b1a2256c-98ff-4884-95bf-7e999f03f163 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:52.943582 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-b1a2256c-98ff-4884-95bf-7e999f03f163 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] [instance: ceced78a-58d9-4175-b4fe-0d085be62c94] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:56:52.967687 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b1a2256c-98ff-4884-95bf-7e999f03f163 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:52.968199 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b1a2256c-98ff-4884-95bf-7e999f03f163 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:52.971404 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b1a2256c-98ff-4884-95bf-7e999f03f163 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:52.978715 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b1a2256c-98ff-4884-95bf-7e999f03f163 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:52.980800 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b1a2256c-98ff-4884-95bf-7e999f03f163 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:52.981469 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b1a2256c-98ff-4884-95bf-7e999f03f163 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:53.331938 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-b1a2256c-98ff-4884-95bf-7e999f03f163 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:53.343991 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-b1a2256c-98ff-4884-95bf-7e999f03f163 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:53.345706 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-b1a2256c-98ff-4884-95bf-7e999f03f163 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:53.346997 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-b1a2256c-98ff-4884-95bf-7e999f03f163 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] 10.222.0.26 "GET /compute/v2.1/servers/ceced78a-58d9-4175-b4fe-0d085be62c94" status: 200 len: 1853 microversion: 2.42 time: 0.415633 Oct 08 20:56:53.348281 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 647/1340] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:56:52 2022] GET /compute/v2.1/servers/ceced78a-58d9-4175-b4fe-0d085be62c94 => generated 1853 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:56:53.353781 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-e580084c-22e9-4a91-b418-158b11a14836 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:53.354552 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-e580084c-22e9-4a91-b418-158b11a14836 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] [instance: 57016fcf-2d2c-488c-9af6-0530ebc199f6] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:56:53.362077 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e580084c-22e9-4a91-b418-158b11a14836 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:53.363205 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e580084c-22e9-4a91-b418-158b11a14836 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:53.363889 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e580084c-22e9-4a91-b418-158b11a14836 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:53.365390 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e580084c-22e9-4a91-b418-158b11a14836 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:53.366108 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e580084c-22e9-4a91-b418-158b11a14836 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:53.367242 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e580084c-22e9-4a91-b418-158b11a14836 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:53.647319 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-e580084c-22e9-4a91-b418-158b11a14836 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:53.658501 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-e580084c-22e9-4a91-b418-158b11a14836 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:53.660866 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-e580084c-22e9-4a91-b418-158b11a14836 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:53.662114 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-e580084c-22e9-4a91-b418-158b11a14836 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] 10.222.0.26 "GET /compute/v2.1/servers/57016fcf-2d2c-488c-9af6-0530ebc199f6" status: 200 len: 1814 microversion: 2.25 time: 0.312550 Oct 08 20:56:53.662689 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 648/1341] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:56:53 2022] GET /compute/v2.1/servers/57016fcf-2d2c-488c-9af6-0530ebc199f6 => generated 1814 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:56:53.667974 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-e9489975-a5c6-43ba-9507-942289c7889a tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:53.670297 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-e9489975-a5c6-43ba-9507-942289c7889a tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] [instance: e338d559-3f7c-4cc8-95c6-face79e11ca2] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:56:53.677574 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e9489975-a5c6-43ba-9507-942289c7889a tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:53.678364 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e9489975-a5c6-43ba-9507-942289c7889a tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:53.678980 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e9489975-a5c6-43ba-9507-942289c7889a tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:53.679865 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e9489975-a5c6-43ba-9507-942289c7889a tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:53.680509 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e9489975-a5c6-43ba-9507-942289c7889a tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:53.681545 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e9489975-a5c6-43ba-9507-942289c7889a tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:53.720392 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-e9489975-a5c6-43ba-9507-942289c7889a tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] 10.222.0.26 "GET /compute/v2.1/servers/e338d559-3f7c-4cc8-95c6-face79e11ca2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056170 Oct 08 20:56:53.725320 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 649/1342] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Oct 8 20:56:53 2022] GET /compute/v2.1/servers/e338d559-3f7c-4cc8-95c6-face79e11ca2/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:56:53.727648 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-9d2d2fa9-a291-48ad-b9fb-e0f0baa413d2 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:53.727960 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-9d2d2fa9-a291-48ad-b9fb-e0f0baa413d2 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] [instance: c2250e42-ea12-4161-8558-cba54fd9b4a8] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:56:53.734261 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:SELECT=100 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:56:53.736629 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9d2d2fa9-a291-48ad-b9fb-e0f0baa413d2 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:53.737124 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9d2d2fa9-a291-48ad-b9fb-e0f0baa413d2 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:53.737613 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9d2d2fa9-a291-48ad-b9fb-e0f0baa413d2 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:53.738601 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9d2d2fa9-a291-48ad-b9fb-e0f0baa413d2 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:53.739485 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9d2d2fa9-a291-48ad-b9fb-e0f0baa413d2 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:53.739881 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9d2d2fa9-a291-48ad-b9fb-e0f0baa413d2 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:53.830498 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-9d2d2fa9-a291-48ad-b9fb-e0f0baa413d2 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05f0f7a60257437eaa8702b664916979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7550f7ad9dc45ba9c9bfb0a5a11a774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:53.841399 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-9d2d2fa9-a291-48ad-b9fb-e0f0baa413d2 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] 10.222.0.26 "GET /compute/v2.1/servers/c2250e42-ea12-4161-8558-cba54fd9b4a8" status: 200 len: 1277 microversion: 2.1 time: 0.119062 Oct 08 20:56:53.842347 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 650/1343] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:56:53 2022] GET /compute/v2.1/servers/c2250e42-ea12-4161-8558-cba54fd9b4a8 => generated 1277 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:56:53.847442 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-a674df8a-c694-4d9f-bd86-40be0ed46216 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:53.848027 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-a674df8a-c694-4d9f-bd86-40be0ed46216 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] [instance: 24300a5e-164c-4d97-9a1f-b52359c1c0d6] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:56:53.858220 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a674df8a-c694-4d9f-bd86-40be0ed46216 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:53.858737 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a674df8a-c694-4d9f-bd86-40be0ed46216 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:53.859401 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a674df8a-c694-4d9f-bd86-40be0ed46216 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:53.860294 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a674df8a-c694-4d9f-bd86-40be0ed46216 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:53.862916 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a674df8a-c694-4d9f-bd86-40be0ed46216 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:53.862916 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a674df8a-c694-4d9f-bd86-40be0ed46216 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:53.889542 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-a674df8a-c694-4d9f-bd86-40be0ed46216 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] HTTP exception thrown: Instance 24300a5e-164c-4d97-9a1f-b52359c1c0d6 could not be found. Oct 08 20:56:53.891405 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-a674df8a-c694-4d9f-bd86-40be0ed46216 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Request method failure captured: Oct 08 20:56:53.891405 ncdv-master-1 devstack@n-api.service[140491]: request: GET /compute/v2.1/servers/24300a5e-164c-4d97-9a1f-b52359c1c0d6 HTTP/1.1 Oct 08 20:56:53.891405 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 20:56:53.891405 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 20:56:53.891405 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 20:56:53.891405 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 20:56:53.891405 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 20:56:53.891405 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 20:56:53.891405 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 20:56:53.891405 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 20:56:53.891405 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeOEGx-Pj-9s8HrUcHFxZIIsXDAIQqr6YF8VD0acWNU1cphsCWIN9bZw-INXpDdIArY__DjFeHC-nd4MPtsMxu0tx-LKyWXGwvbNtrPKoC8pyMamiUfIOjmeREIepbgTqBWNoe2EBY7e812jzZjPuVQRPdHx3JZtjJXNnZjEeEE279U Oct 08 20:56:53.891405 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 20:56:53.891405 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 20:56:53.891405 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 20:56:53.891405 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 20:56:53.891405 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 20:56:53.891405 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 20:56:53.891405 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: bcb3706a1680419384f4fe9660e87732 Oct 08 20:56:53.891405 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-ListImageFiltersTestJSON-2058078722 Oct 08 20:56:53.891405 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 20:56:53.891405 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 20:56:53.891405 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/bcb3706a1680419384f4fe9660e87732"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/bcb3706a1680419384f4fe9660e87732"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_bcb3706a1680419384f4fe9660e87732"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/bcb3706a1680419384f4fe9660e87732"}]}] Oct 08 20:56:53.891405 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-ListImageFiltersTestJSON-2058078722 Oct 08 20:56:53.891405 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: bcb3706a1680419384f4fe9660e87732 Oct 08 20:56:53.891405 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-2058078722 Oct 08 20:56:53.891405 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-ListImageFiltersTestJSON-2058078722-project Oct 08 20:56:53.891405 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 20:56:53.891405 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 20:56:53.891405 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 6bce55d7f67347aaaa4c2a687bdff183 Oct 08 20:56:53.891405 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-ListImageFiltersTestJSON-2058078722-project Oct 08 20:56:53.891405 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 20:56:53.891405 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance 24300a5e-164c-4d97-9a1f-b52359c1c0d6 could not be found. Oct 08 20:56:53.891405 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': '24300a5e-164c-4d97-9a1f-b52359c1c0d6'} Oct 08 20:56:53.891405 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:56:53.891405 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:56:53.891405 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 20:56:53.891405 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 20:56:53.891405 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 20:56:53.891405 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 20:56:53.891405 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 20:56:53.891405 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 20:56:53.891405 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 20:56:53.891405 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 20:56:53.891405 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24300a5e-164c-4d97-9a1f-b52359c1c0d6 could not be found. Oct 08 20:56:53.891405 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:56:53.891405 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:56:53.891405 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:56:53.891405 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:56:53.891405 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:56:53.891405 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:56:53.891405 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:56:53.891405 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:56:53.891405 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:56:53.891405 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:56:53.891405 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 20:56:53.891405 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 20:56:53.891405 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 20:56:53.891405 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 20:56:53.891405 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 20:56:53.891405 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 20:56:53.891405 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24300a5e-164c-4d97-9a1f-b52359c1c0d6 could not be found. Oct 08 20:56:53.891405 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:56:53.891405 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:56:53.891405 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:56:53.896107 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:56:53.896107 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:56:53.896107 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:56:53.896107 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 20:56:53.896107 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 20:56:53.896107 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24300a5e-164c-4d97-9a1f-b52359c1c0d6 could not be found. Oct 08 20:56:53.896107 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:56:53.898336 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-a674df8a-c694-4d9f-bd86-40be0ed46216 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Returning 404 to user: Instance 24300a5e-164c-4d97-9a1f-b52359c1c0d6 could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:56:53.900385 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-a674df8a-c694-4d9f-bd86-40be0ed46216 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] 10.222.0.26 "GET /compute/v2.1/servers/24300a5e-164c-4d97-9a1f-b52359c1c0d6" status: 404 len: 111 microversion: 2.1 time: 0.057019 Oct 08 20:56:53.900966 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 651/1344] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:56:53 2022] GET /compute/v2.1/servers/24300a5e-164c-4d97-9a1f-b52359c1c0d6 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 20:56:53.908622 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-ef32d8e1-9b4b-472b-bc7b-7ad0686818c2 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/6e6daaa3-cbc3-4322-ab19-f19963e4cc06" status: 202 len: 0 microversion: 2.1 time: 1.922063 Oct 08 20:56:53.910311 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 694/1345] 10.222.0.26 () {58 vars in 1272 bytes} [Sat Oct 8 20:56:51 2022] DELETE /compute/v2.1/os-security-groups/6e6daaa3-cbc3-4322-ab19-f19963e4cc06 => generated 0 bytes in 1929 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 20:56:53.915984 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-71b9a0bb-4e28-4342-8a80-e8052f1726fd tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Calling method '.version_select at 0x7f1a8ca13670>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:53.927141 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-6aa70c0c-180c-48cd-8c7c-fa1a19697f98 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Calling method '.version_select at 0x7f1a91406b80>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:54.056111 ncdv-master-1 devstack@n-api.service[140492]: DEBUG neutronclient.v2_0.client [None req-6aa70c0c-180c-48cd-8c7c-fa1a19697f98 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 6e6daaa3-cbc3-4322-ab19-f19963e4cc06 does not exist", "detail": ""}} {{(pid=140492) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 08 20:56:54.058626 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.network.security_group_api [None req-6aa70c0c-180c-48cd-8c7c-fa1a19697f98 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Neutron security group 6e6daaa3-cbc3-4322-ab19-f19963e4cc06 not found {{(pid=140492) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 08 20:56:54.059121 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-6aa70c0c-180c-48cd-8c7c-fa1a19697f98 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] HTTP exception thrown: Security group 6e6daaa3-cbc3-4322-ab19-f19963e4cc06 does not exist Oct 08 20:56:54.059121 ncdv-master-1 devstack@n-api.service[140492]: Neutron server returns request_ids: ['req-93fd5207-15ae-4f4d-ab1e-745a3a0aa721'] Oct 08 20:56:54.096548 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-6aa70c0c-180c-48cd-8c7c-fa1a19697f98 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Request method failure captured: Oct 08 20:56:54.096548 ncdv-master-1 devstack@n-api.service[140492]: request: GET /compute/v2.1/os-security-groups/6e6daaa3-cbc3-4322-ab19-f19963e4cc06 HTTP/1.1 Oct 08 20:56:54.096548 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 20:56:54.096548 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 20:56:54.096548 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 20:56:54.096548 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 20:56:54.096548 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 20:56:54.096548 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 20:56:54.096548 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 20:56:54.096548 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 20:56:54.096548 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQePneH9r8wc6qFHuuUfUiwj20bfGS3ReCozGKtofTKF_Bibv-TeYrNnDr89OwEeHkYGW8sVcZZerG8KfPs5hnyFWI91x_kPrSGVuiWEZNP0tyGW3_Xh9-fgTNjxnIFiLidb-EHCBZb3EEyAGFqy03GkbophorT5sYui55pNleytp26U Oct 08 20:56:54.096548 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 20:56:54.096548 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 20:56:54.096548 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 20:56:54.096548 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 20:56:54.096548 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 20:56:54.096548 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 20:56:54.096548 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 1be94d02ab5244f98337fb9b90e74746 Oct 08 20:56:54.096548 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-SecurityGroupsTestJSON-1416879597 Oct 08 20:56:54.096548 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 20:56:54.096548 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 20:56:54.096548 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1be94d02ab5244f98337fb9b90e74746"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1be94d02ab5244f98337fb9b90e74746"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1be94d02ab5244f98337fb9b90e74746"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1be94d02ab5244f98337fb9b90e74746"}]}] Oct 08 20:56:54.096548 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-SecurityGroupsTestJSON-1416879597 Oct 08 20:56:54.096548 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 1be94d02ab5244f98337fb9b90e74746 Oct 08 20:56:54.096548 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1416879597 Oct 08 20:56:54.096548 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-SecurityGroupsTestJSON-1416879597-project Oct 08 20:56:54.096548 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 20:56:54.096548 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 20:56:54.096548 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 5ac1323815364df4a3a4d4dbbb9d70dd Oct 08 20:56:54.096548 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-SecurityGroupsTestJSON-1416879597-project Oct 08 20:56:54.096548 ncdv-master-1 devstack@n-api.service[140492]: method: Oct 08 20:56:54.096548 ncdv-master-1 devstack@n-api.service[140492]: exception: Security group 6e6daaa3-cbc3-4322-ab19-f19963e4cc06 does not exist Oct 08 20:56:54.096548 ncdv-master-1 devstack@n-api.service[140492]: Neutron server returns request_ids: ['req-93fd5207-15ae-4f4d-ab1e-745a3a0aa721'] Oct 08 20:56:54.096548 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': '6e6daaa3-cbc3-4322-ab19-f19963e4cc06'} Oct 08 20:56:54.096548 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:56:54.096548 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:56:54.096548 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 08 20:56:54.096548 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 08 20:56:54.096548 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 08 20:56:54.096548 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 08 20:56:54.096548 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 08 20:56:54.096548 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 08 20:56:54.096548 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 08 20:56:54.096548 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 08 20:56:54.096548 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 08 20:56:54.096548 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 08 20:56:54.096548 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 08 20:56:54.096548 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 08 20:56:54.096548 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 08 20:56:54.096548 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 08 20:56:54.096548 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 08 20:56:54.096548 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 08 20:56:54.096548 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 08 20:56:54.096548 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 08 20:56:54.096548 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 08 20:56:54.096548 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 08 20:56:54.096548 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 08 20:56:54.096548 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 08 20:56:54.096548 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 08 20:56:54.096548 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 08 20:56:54.096548 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 6e6daaa3-cbc3-4322-ab19-f19963e4cc06 does not exist Oct 08 20:56:54.104839 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-93fd5207-15ae-4f4d-ab1e-745a3a0aa721'] Oct 08 20:56:54.104839 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:56:54.104839 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:56:54.104839 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:56:54.104839 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:56:54.104839 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 08 20:56:54.104839 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 08 20:56:54.104839 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 08 20:56:54.104839 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 08 20:56:54.104839 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 6e6daaa3-cbc3-4322-ab19-f19963e4cc06 does not exist Oct 08 20:56:54.104839 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-93fd5207-15ae-4f4d-ab1e-745a3a0aa721'] Oct 08 20:56:54.104839 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:56:54.104839 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:56:54.104839 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:56:54.104839 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:56:54.104839 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:56:54.104839 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:56:54.104839 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:56:54.104839 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:56:54.104839 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 08 20:56:54.104839 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 08 20:56:54.104839 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:56:54.104839 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:56:54.104839 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 08 20:56:54.104839 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 08 20:56:54.104839 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 6e6daaa3-cbc3-4322-ab19-f19963e4cc06 does not exist Oct 08 20:56:54.104839 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-93fd5207-15ae-4f4d-ab1e-745a3a0aa721'] Oct 08 20:56:54.104839 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:56:54.104839 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:56:54.104839 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:56:54.104839 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:56:54.104839 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:56:54.104839 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:56:54.104839 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 20:56:54.104839 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 20:56:54.104839 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 6e6daaa3-cbc3-4322-ab19-f19963e4cc06 does not exist Oct 08 20:56:54.104839 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-93fd5207-15ae-4f4d-ab1e-745a3a0aa721'] Oct 08 20:56:54.104839 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:56:54.116873 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-6aa70c0c-180c-48cd-8c7c-fa1a19697f98 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Returning 404 to user: Security group 6e6daaa3-cbc3-4322-ab19-f19963e4cc06 does not exist Oct 08 20:56:54.116873 ncdv-master-1 devstack@n-api.service[140492]: Neutron server returns request_ids: ['req-93fd5207-15ae-4f4d-ab1e-745a3a0aa721'] {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:56:54.116873 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-6aa70c0c-180c-48cd-8c7c-fa1a19697f98 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] 10.222.0.26 "GET /compute/v2.1/os-security-groups/6e6daaa3-cbc3-4322-ab19-f19963e4cc06" status: 404 len: 194 microversion: 2.1 time: 0.196317 Oct 08 20:56:54.116873 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 695/1346] 10.222.0.26 () {58 vars in 1269 bytes} [Sat Oct 8 20:56:53 2022] GET /compute/v2.1/os-security-groups/6e6daaa3-cbc3-4322-ab19-f19963e4cc06 => generated 194 bytes in 198 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 08 20:56:54.122579 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-9f022478-978e-47d1-b82f-1efe36b1f210 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Action: 'create', calling method: .version_select at 0x7f1a913a29d0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2056298732", "description": "tempest-description-859989746"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:56:54.797707 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-71b9a0bb-4e28-4342-8a80-e8052f1726fd tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] 10.222.0.26 "DELETE /compute/v2.1/images/32cf58a9-c0a6-4bd8-a2e3-6f135fa2a033" status: 204 len: 0 microversion: 2.1 time: 0.892439 Oct 08 20:56:54.798801 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 652/1347] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:56:53 2022] DELETE /compute/v2.1/images/32cf58a9-c0a6-4bd8-a2e3-6f135fa2a033 => generated 0 bytes in 894 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 20:56:54.803968 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-d081417f-8d56-4823-b53a-aa585eaf2066 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:54.804907 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-d081417f-8d56-4823-b53a-aa585eaf2066 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] [instance: ceced78a-58d9-4175-b4fe-0d085be62c94] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:56:54.813836 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d081417f-8d56-4823-b53a-aa585eaf2066 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:54.814420 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d081417f-8d56-4823-b53a-aa585eaf2066 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:54.814928 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d081417f-8d56-4823-b53a-aa585eaf2066 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:54.815708 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d081417f-8d56-4823-b53a-aa585eaf2066 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:54.816234 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d081417f-8d56-4823-b53a-aa585eaf2066 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:54.816752 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d081417f-8d56-4823-b53a-aa585eaf2066 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:54.952460 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-9f022478-978e-47d1-b82f-1efe36b1f210 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] 10.222.0.26 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.834503 Oct 08 20:56:54.953092 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 696/1348] 10.222.0.26 () {60 vars in 1180 bytes} [Sat Oct 8 20:56:54 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:56:54.965835 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-f1e20b9f-b323-4ead-91a6-e532cdd8b199 req-91a9f1c4-6765-4d3d-ad40-a2414df2fcef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24300a5e-164c-4d97-9a1f-b52359c1c0d6", "name": "network-vif-deleted", "tag": "2fe7c081-3e45-4535-9c6e-1d2e86219410"}, {"name": "network-changed", "server_uuid": "57016fcf-2d2c-488c-9af6-0530ebc199f6", "tag": "574497fa-1919-4a57-bca6-30aeb414e335"}, {"name": "network-changed", "server_uuid": "ceced78a-58d9-4175-b4fe-0d085be62c94", "tag": "6a371950-2184-421b-a72d-4525c4232631"}, {"name": "network-changed", "server_uuid": "ceced78a-58d9-4175-b4fe-0d085be62c94", "tag": "3083c386-8718-4dfc-8fe3-11330119883c"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:56:54.983565 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-f1e20b9f-b323-4ead-91a6-e532cdd8b199 req-91a9f1c4-6765-4d3d-ad40-a2414df2fcef service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:54.984011 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-f1e20b9f-b323-4ead-91a6-e532cdd8b199 req-91a9f1c4-6765-4d3d-ad40-a2414df2fcef service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:54.984457 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-f1e20b9f-b323-4ead-91a6-e532cdd8b199 req-91a9f1c4-6765-4d3d-ad40-a2414df2fcef service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:55.012405 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-f1e20b9f-b323-4ead-91a6-e532cdd8b199 req-91a9f1c4-6765-4d3d-ad40-a2414df2fcef service nova] Creating event network-vif-deleted:2fe7c081-3e45-4535-9c6e-1d2e86219410 for instance 24300a5e-164c-4d97-9a1f-b52359c1c0d6 on nch1-master-1 Oct 08 20:56:55.014289 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-f1e20b9f-b323-4ead-91a6-e532cdd8b199 req-91a9f1c4-6765-4d3d-ad40-a2414df2fcef service nova] Creating event network-changed:574497fa-1919-4a57-bca6-30aeb414e335 for instance 57016fcf-2d2c-488c-9af6-0530ebc199f6 on nch1-master-1 Oct 08 20:56:55.015047 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-f1e20b9f-b323-4ead-91a6-e532cdd8b199 req-91a9f1c4-6765-4d3d-ad40-a2414df2fcef service nova] Creating event network-changed:6a371950-2184-421b-a72d-4525c4232631 for instance ceced78a-58d9-4175-b4fe-0d085be62c94 on nch2-master-1 Oct 08 20:56:55.015822 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-f1e20b9f-b323-4ead-91a6-e532cdd8b199 req-91a9f1c4-6765-4d3d-ad40-a2414df2fcef service nova] Creating event network-changed:3083c386-8718-4dfc-8fe3-11330119883c for instance ceced78a-58d9-4175-b4fe-0d085be62c94 on nch2-master-1 Oct 08 20:56:55.035000 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-f1e20b9f-b323-4ead-91a6-e532cdd8b199 req-91a9f1c4-6765-4d3d-ad40-a2414df2fcef service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 684 microversion: 2.1 time: 0.080016 Oct 08 20:56:55.057156 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 697/1349] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:56:54 2022] POST /compute/v2.1/os-server-external-events => generated 684 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:56:55.072491 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-d9099c77-d78b-4ea3-bc62-9f4c14957ed5 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:55.073608 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-d9099c77-d78b-4ea3-bc62-9f4c14957ed5 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] [instance: 57016fcf-2d2c-488c-9af6-0530ebc199f6] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:56:55.080720 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d9099c77-d78b-4ea3-bc62-9f4c14957ed5 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:55.082387 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d9099c77-d78b-4ea3-bc62-9f4c14957ed5 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:55.083011 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d9099c77-d78b-4ea3-bc62-9f4c14957ed5 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:55.084495 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d9099c77-d78b-4ea3-bc62-9f4c14957ed5 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:55.085134 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d9099c77-d78b-4ea3-bc62-9f4c14957ed5 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:55.085839 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d9099c77-d78b-4ea3-bc62-9f4c14957ed5 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:55.136435 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-d081417f-8d56-4823-b53a-aa585eaf2066 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:55.149391 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-d081417f-8d56-4823-b53a-aa585eaf2066 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:55.151107 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-d081417f-8d56-4823-b53a-aa585eaf2066 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:55.152451 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-d081417f-8d56-4823-b53a-aa585eaf2066 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] 10.222.0.26 "GET /compute/v2.1/servers/ceced78a-58d9-4175-b4fe-0d085be62c94" status: 200 len: 1874 microversion: 2.42 time: 0.352501 Oct 08 20:56:55.153165 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 653/1350] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:56:54 2022] GET /compute/v2.1/servers/ceced78a-58d9-4175-b4fe-0d085be62c94 => generated 1874 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:56:55.158380 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-207fc6e1-f80e-48eb-b1f4-3fd63ac18c88 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:55.160839 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-207fc6e1-f80e-48eb-b1f4-3fd63ac18c88 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] [instance: e338d559-3f7c-4cc8-95c6-face79e11ca2] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:56:55.168618 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-207fc6e1-f80e-48eb-b1f4-3fd63ac18c88 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:55.169535 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-207fc6e1-f80e-48eb-b1f4-3fd63ac18c88 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:55.170308 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-207fc6e1-f80e-48eb-b1f4-3fd63ac18c88 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:55.171174 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-207fc6e1-f80e-48eb-b1f4-3fd63ac18c88 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:55.171784 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-207fc6e1-f80e-48eb-b1f4-3fd63ac18c88 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:55.172369 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-207fc6e1-f80e-48eb-b1f4-3fd63ac18c88 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:55.230226 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-207fc6e1-f80e-48eb-b1f4-3fd63ac18c88 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] 10.222.0.26 "GET /compute/v2.1/servers/e338d559-3f7c-4cc8-95c6-face79e11ca2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.075794 Oct 08 20:56:55.237769 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 654/1351] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Oct 8 20:56:55 2022] GET /compute/v2.1/servers/e338d559-3f7c-4cc8-95c6-face79e11ca2/os-volume_attachments => generated 25 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 08 20:56:55.242625 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-1b7ab4f6-7a5b-4142-8f37-40956c3889ab tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Calling method '.version_select at 0x7f1a8ca9a940>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:55.751610 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-d9099c77-d78b-4ea3-bc62-9f4c14957ed5 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:55.763279 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-d9099c77-d78b-4ea3-bc62-9f4c14957ed5 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:55.765230 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-d9099c77-d78b-4ea3-bc62-9f4c14957ed5 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:55.769730 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-1b7ab4f6-7a5b-4142-8f37-40956c3889ab tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] 10.222.0.26 "DELETE /compute/v2.1/images/fcb8f618-1dbf-45d9-bdbc-46894bba4893" status: 204 len: 0 microversion: 2.1 time: 0.530714 Oct 08 20:56:55.773618 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 655/1352] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:56:55 2022] DELETE /compute/v2.1/images/fcb8f618-1dbf-45d9-bdbc-46894bba4893 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 20:56:55.779581 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-e698834e-79c9-43ea-9de2-b3eea085e6c4 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:55.780603 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-e698834e-79c9-43ea-9de2-b3eea085e6c4 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] [instance: c2250e42-ea12-4161-8558-cba54fd9b4a8] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:56:55.780953 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-d9099c77-d78b-4ea3-bc62-9f4c14957ed5 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] 10.222.0.26 "GET /compute/v2.1/servers/57016fcf-2d2c-488c-9af6-0530ebc199f6" status: 200 len: 1814 microversion: 2.25 time: 0.703276 Oct 08 20:56:55.784298 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 698/1353] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:56:55 2022] GET /compute/v2.1/servers/57016fcf-2d2c-488c-9af6-0530ebc199f6 => generated 1814 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:56:55.791561 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-b64e97ea-d26b-49d0-ab5e-5795d7e94cb3 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Action: 'create', calling method: .version_select at 0x7f1a913343a0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1847955156", "description": "tempest-description-479340535"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:56:55.801549 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e698834e-79c9-43ea-9de2-b3eea085e6c4 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:55.802729 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e698834e-79c9-43ea-9de2-b3eea085e6c4 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:55.803425 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e698834e-79c9-43ea-9de2-b3eea085e6c4 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:55.804509 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e698834e-79c9-43ea-9de2-b3eea085e6c4 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:55.805180 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e698834e-79c9-43ea-9de2-b3eea085e6c4 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:55.806520 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e698834e-79c9-43ea-9de2-b3eea085e6c4 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:55.916519 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-e698834e-79c9-43ea-9de2-b3eea085e6c4 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05f0f7a60257437eaa8702b664916979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7550f7ad9dc45ba9c9bfb0a5a11a774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:55.927805 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-e698834e-79c9-43ea-9de2-b3eea085e6c4 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] 10.222.0.26 "GET /compute/v2.1/servers/c2250e42-ea12-4161-8558-cba54fd9b4a8" status: 200 len: 1277 microversion: 2.1 time: 0.152152 Oct 08 20:56:55.928810 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 656/1354] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:56:55 2022] GET /compute/v2.1/servers/c2250e42-ea12-4161-8558-cba54fd9b4a8 => generated 1277 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:56:55.938526 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-7d21178b-9ae0-49b9-83f9-543685e23999 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] Calling method '.version_select at 0x7f1a8ca13310>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:56.416547 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-7d21178b-9ae0-49b9-83f9-543685e23999 tempest-ListImageFiltersTestJSON-2058078722 tempest-ListImageFiltersTestJSON-2058078722-project] 10.222.0.26 "DELETE /compute/v2.1/images/dbb82e24-3155-4938-aa76-47f9aec9b18e" status: 204 len: 0 microversion: 2.1 time: 0.486310 Oct 08 20:56:56.421002 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 657/1355] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:56:55 2022] DELETE /compute/v2.1/images/dbb82e24-3155-4938-aa76-47f9aec9b18e => generated 0 bytes in 488 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 20:56:56.423902 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-6c8608a3-1508-4e80-871b-84a76dc7f378 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:56.432138 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-6c8608a3-1508-4e80-871b-84a76dc7f378 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] [instance: ceced78a-58d9-4175-b4fe-0d085be62c94] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:56:56.443252 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6c8608a3-1508-4e80-871b-84a76dc7f378 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:56.443763 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6c8608a3-1508-4e80-871b-84a76dc7f378 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:56.444219 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6c8608a3-1508-4e80-871b-84a76dc7f378 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:56.451217 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6c8608a3-1508-4e80-871b-84a76dc7f378 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:56.451774 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6c8608a3-1508-4e80-871b-84a76dc7f378 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:56.453880 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6c8608a3-1508-4e80-871b-84a76dc7f378 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:56.992780 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-b64e97ea-d26b-49d0-ab5e-5795d7e94cb3 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] 10.222.0.26 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 1.204841 Oct 08 20:56:56.994834 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 699/1356] 10.222.0.26 () {60 vars in 1180 bytes} [Sat Oct 8 20:56:55 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 1210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:56:57.002132 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-530fc4d6-4b9d-4f92-ab27-62bec326a1ad tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:57.003614 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-530fc4d6-4b9d-4f92-ab27-62bec326a1ad tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] [instance: 57016fcf-2d2c-488c-9af6-0530ebc199f6] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:56:57.021473 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-530fc4d6-4b9d-4f92-ab27-62bec326a1ad tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:57.022762 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-530fc4d6-4b9d-4f92-ab27-62bec326a1ad tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:57.023818 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-530fc4d6-4b9d-4f92-ab27-62bec326a1ad tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:57.026384 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-530fc4d6-4b9d-4f92-ab27-62bec326a1ad tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:57.030703 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-530fc4d6-4b9d-4f92-ab27-62bec326a1ad tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:57.032051 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-530fc4d6-4b9d-4f92-ab27-62bec326a1ad tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:57.244084 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-6c8608a3-1508-4e80-871b-84a76dc7f378 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:57.267591 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-6c8608a3-1508-4e80-871b-84a76dc7f378 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:57.271544 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-6c8608a3-1508-4e80-871b-84a76dc7f378 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:57.276744 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-6c8608a3-1508-4e80-871b-84a76dc7f378 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] 10.222.0.26 "GET /compute/v2.1/servers/ceced78a-58d9-4175-b4fe-0d085be62c94" status: 200 len: 1874 microversion: 2.42 time: 0.856269 Oct 08 20:56:57.277381 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 658/1357] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:56:56 2022] GET /compute/v2.1/servers/ceced78a-58d9-4175-b4fe-0d085be62c94 => generated 1874 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:56:57.292494 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-0011bba3-58db-42be-b46e-86edeb43aaec tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:57.293067 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-0011bba3-58db-42be-b46e-86edeb43aaec tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] [instance: c2250e42-ea12-4161-8558-cba54fd9b4a8] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:56:57.309378 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0011bba3-58db-42be-b46e-86edeb43aaec tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:57.309996 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0011bba3-58db-42be-b46e-86edeb43aaec tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:57.312267 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0011bba3-58db-42be-b46e-86edeb43aaec tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:57.315300 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0011bba3-58db-42be-b46e-86edeb43aaec tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:57.315895 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0011bba3-58db-42be-b46e-86edeb43aaec tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:57.316599 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0011bba3-58db-42be-b46e-86edeb43aaec tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:57.598625 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-0011bba3-58db-42be-b46e-86edeb43aaec tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05f0f7a60257437eaa8702b664916979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7550f7ad9dc45ba9c9bfb0a5a11a774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:57.608750 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-0011bba3-58db-42be-b46e-86edeb43aaec tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] 10.222.0.26 "GET /compute/v2.1/servers/c2250e42-ea12-4161-8558-cba54fd9b4a8" status: 200 len: 1319 microversion: 2.1 time: 0.327795 Oct 08 20:56:57.618414 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 659/1358] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:56:57 2022] GET /compute/v2.1/servers/c2250e42-ea12-4161-8558-cba54fd9b4a8 => generated 1319 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:56:57.618414 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-cca0a6e5-5076-40a7-8ca8-8e76504e0ef3 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Action: 'create', calling method: .version_select at 0x7f1a8c9e93a0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-458015550", "description": "tempest-description-441599713"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:56:57.728496 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-530fc4d6-4b9d-4f92-ab27-62bec326a1ad tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:57.747551 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-530fc4d6-4b9d-4f92-ab27-62bec326a1ad tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:57.752464 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-530fc4d6-4b9d-4f92-ab27-62bec326a1ad tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:57.754135 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-530fc4d6-4b9d-4f92-ab27-62bec326a1ad tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] 10.222.0.26 "GET /compute/v2.1/servers/57016fcf-2d2c-488c-9af6-0530ebc199f6" status: 200 len: 1814 microversion: 2.25 time: 0.756513 Oct 08 20:56:57.755312 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 700/1359] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:56:56 2022] GET /compute/v2.1/servers/57016fcf-2d2c-488c-9af6-0530ebc199f6 => generated 1814 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:56:58.025804 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-b52fe936-3935-4a3c-81bf-507b4e2ace3d req-d1b3862e-b1bf-4b8e-80d0-2922da1b864e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ceced78a-58d9-4175-b4fe-0d085be62c94", "tag": "91fedb87-f0c8-47ba-8994-fc3b2f3d3d1f"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:56:58.043096 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-b52fe936-3935-4a3c-81bf-507b4e2ace3d req-d1b3862e-b1bf-4b8e-80d0-2922da1b864e service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:58.044007 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-b52fe936-3935-4a3c-81bf-507b4e2ace3d req-d1b3862e-b1bf-4b8e-80d0-2922da1b864e service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:58.044664 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-b52fe936-3935-4a3c-81bf-507b4e2ace3d req-d1b3862e-b1bf-4b8e-80d0-2922da1b864e service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:58.060499 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-b52fe936-3935-4a3c-81bf-507b4e2ace3d req-d1b3862e-b1bf-4b8e-80d0-2922da1b864e service nova] Creating event network-changed:91fedb87-f0c8-47ba-8994-fc3b2f3d3d1f for instance ceced78a-58d9-4175-b4fe-0d085be62c94 on nch2-master-1 Oct 08 20:56:58.070329 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-b52fe936-3935-4a3c-81bf-507b4e2ace3d req-d1b3862e-b1bf-4b8e-80d0-2922da1b864e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.304056 Oct 08 20:56:58.074264 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 701/1360] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:56:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:56:58.238908 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-cca0a6e5-5076-40a7-8ca8-8e76504e0ef3 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] 10.222.0.26 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.626803 Oct 08 20:56:58.239199 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-0cefb6f7-e78c-42d9-b42b-376e9269f70d tempest-ServerGroup264TestJSON-1474094565 tempest-ServerGroup264TestJSON-1474094565-project] Action: 'create', calling method: .version_select at 0x7f1a9145faf0>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:56:58.240104 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 660/1361] 10.222.0.26 () {60 vars in 1180 bytes} [Sat Oct 8 20:56:57 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:56:58.252696 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-be6889c5-0c4b-4ae8-ac7e-5e3864258260 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Calling method '.version_select at 0x7f1a8c988b80>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:58.288877 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-0cefb6f7-e78c-42d9-b42b-376e9269f70d tempest-ServerGroup264TestJSON-1474094565 tempest-ServerGroup264TestJSON-1474094565-project] Getting quotas for project 1e6beec34e0e4af180cd798eb7ef4ad0. Resources: {'server_groups'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 20:56:58.302070 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-0cefb6f7-e78c-42d9-b42b-376e9269f70d tempest-ServerGroup264TestJSON-1474094565 tempest-ServerGroup264TestJSON-1474094565-project] Getting quotas for user 56649c9113d84e6390d58d84ab089380 and project 1e6beec34e0e4af180cd798eb7ef4ad0. Resources: {'server_groups'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 20:56:58.400575 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-0cefb6f7-e78c-42d9-b42b-376e9269f70d tempest-ServerGroup264TestJSON-1474094565 tempest-ServerGroup264TestJSON-1474094565-project] Getting quotas for project 1e6beec34e0e4af180cd798eb7ef4ad0. Resources: {'server_groups'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 20:56:58.406478 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-0cefb6f7-e78c-42d9-b42b-376e9269f70d tempest-ServerGroup264TestJSON-1474094565 tempest-ServerGroup264TestJSON-1474094565-project] Getting quotas for user 56649c9113d84e6390d58d84ab089380 and project 1e6beec34e0e4af180cd798eb7ef4ad0. Resources: {'server_groups'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 20:56:58.422036 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-0cefb6f7-e78c-42d9-b42b-376e9269f70d tempest-ServerGroup264TestJSON-1474094565 tempest-ServerGroup264TestJSON-1474094565-project] 10.222.0.26 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.345537 Oct 08 20:56:58.422943 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 702/1362] 10.222.0.26 () {62 vars in 1214 bytes} [Sat Oct 8 20:56:58 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 08 20:56:58.433580 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-ed6c68d8-a5ab-478e-ac11-ed3b17459079 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:58.434340 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-ed6c68d8-a5ab-478e-ac11-ed3b17459079 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] [instance: ceced78a-58d9-4175-b4fe-0d085be62c94] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:56:58.450231 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ed6c68d8-a5ab-478e-ac11-ed3b17459079 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:58.450800 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ed6c68d8-a5ab-478e-ac11-ed3b17459079 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:58.451603 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ed6c68d8-a5ab-478e-ac11-ed3b17459079 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:58.456371 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ed6c68d8-a5ab-478e-ac11-ed3b17459079 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:58.456886 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ed6c68d8-a5ab-478e-ac11-ed3b17459079 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:58.457376 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ed6c68d8-a5ab-478e-ac11-ed3b17459079 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:59.051612 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-be6889c5-0c4b-4ae8-ac7e-5e3864258260 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] 10.222.0.26 "GET /compute/v2.1/os-security-groups" status: 200 len: 1830 microversion: 2.1 time: 0.803053 Oct 08 20:56:59.064293 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 661/1363] 10.222.0.26 () {58 vars in 1158 bytes} [Sat Oct 8 20:56:58 2022] GET /compute/v2.1/os-security-groups => generated 1830 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:56:59.079576 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-a1f82c0f-49ef-4085-acef-40596d40e832 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-839805477", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "2de46f56-45d8-40d9-8d29-d806b680f627"}], "block_device_mapping_v2": [{"uuid": "a8994233-8420-4f40-b8b2-5054eebfce14", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:56:59.206130 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-ed6c68d8-a5ab-478e-ac11-ed3b17459079 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:59.225746 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.network.neutron [None req-a1f82c0f-49ef-4085-acef-40596d40e832 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] validate_networks() for [('2de46f56-45d8-40d9-8d29-d806b680f627', None, None, None, None, None)] {{(pid=140491) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 20:56:59.251858 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-ed6c68d8-a5ab-478e-ac11-ed3b17459079 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:59.254928 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-ed6c68d8-a5ab-478e-ac11-ed3b17459079 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:56:59.256969 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-ed6c68d8-a5ab-478e-ac11-ed3b17459079 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] 10.222.0.26 "GET /compute/v2.1/servers/ceced78a-58d9-4175-b4fe-0d085be62c94" status: 200 len: 1874 microversion: 2.42 time: 0.832898 Oct 08 20:56:59.259343 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 703/1364] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:56:58 2022] GET /compute/v2.1/servers/ceced78a-58d9-4175-b4fe-0d085be62c94 => generated 1874 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:56:59.268056 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-f1c0f619-a97a-4661-b79c-f8ccd79bbecb tempest-ServerGroup264TestJSON-1474094565 tempest-ServerGroup264TestJSON-1474094565-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:59.296443 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-f1c0f619-a97a-4661-b79c-f8ccd79bbecb tempest-ServerGroup264TestJSON-1474094565 tempest-ServerGroup264TestJSON-1474094565-project] 10.222.0.26 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.035750 Oct 08 20:56:59.297498 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 704/1365] 10.222.0.26 () {60 vars in 1193 bytes} [Sat Oct 8 20:56:59 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 08 20:56:59.309441 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-3fa4c8f1-dd6a-453a-b4ff-3510867a5bea tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:56:59.310364 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-3fa4c8f1-dd6a-453a-b4ff-3510867a5bea tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] [instance: c2250e42-ea12-4161-8558-cba54fd9b4a8] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:56:59.322070 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3fa4c8f1-dd6a-453a-b4ff-3510867a5bea tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:59.322661 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3fa4c8f1-dd6a-453a-b4ff-3510867a5bea tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:59.323089 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3fa4c8f1-dd6a-453a-b4ff-3510867a5bea tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:59.323852 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3fa4c8f1-dd6a-453a-b4ff-3510867a5bea tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:56:59.324314 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3fa4c8f1-dd6a-453a-b4ff-3510867a5bea tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:56:59.324758 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3fa4c8f1-dd6a-453a-b4ff-3510867a5bea tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:56:59.543285 ncdv-master-1 devstack@n-api.service[140491]: Exception ignored in: . at 0x7f1a8c9e9820> Oct 08 20:56:59.543285 ncdv-master-1 devstack@n-api.service[140491]: Traceback (most recent call last): Oct 08 20:56:59.543285 ncdv-master-1 devstack@n-api.service[140491]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 488, in Oct 08 20:56:59.552139 ncdv-master-1 devstack@n-api.service[140491]: and _finalize_fairy(None, rec, pool, ref, echo, True), Oct 08 20:56:59.552139 ncdv-master-1 devstack@n-api.service[140491]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 774, in _finalize_fairy Oct 08 20:56:59.553015 ncdv-master-1 devstack@n-api.service[140491]: connection_record.checkin() Oct 08 20:56:59.553434 ncdv-master-1 devstack@n-api.service[140491]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 521, in checkin Oct 08 20:56:59.553565 ncdv-master-1 devstack@n-api.service[140491]: pool.dispatch.checkin(connection, self) Oct 08 20:56:59.553565 ncdv-master-1 devstack@n-api.service[140491]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/event/attr.py", line 343, in __call__ Oct 08 20:56:59.559043 ncdv-master-1 devstack@n-api.service[140491]: fn(*args, **kw) Oct 08 20:56:59.559043 ncdv-master-1 devstack@n-api.service[140491]: File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py", line 51, in _thread_yield Oct 08 20:56:59.567294 ncdv-master-1 devstack@n-api.service[140491]: time.sleep(0) Oct 08 20:56:59.567502 ncdv-master-1 devstack@n-api.service[140491]: File "/usr/local/lib/python3.8/dist-packages/eventlet/greenthread.py", line 33, in sleep Oct 08 20:56:59.570507 ncdv-master-1 devstack@n-api.service[140491]: assert hub.greenlet is not current, 'do not call blocking functions from the mainloop' Oct 08 20:56:59.571304 ncdv-master-1 devstack@n-api.service[140491]: AssertionError: do not call blocking functions from the mainloop Oct 08 20:57:00.143285 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-3fa4c8f1-dd6a-453a-b4ff-3510867a5bea tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05f0f7a60257437eaa8702b664916979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7550f7ad9dc45ba9c9bfb0a5a11a774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:00.156419 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-3fa4c8f1-dd6a-453a-b4ff-3510867a5bea tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] 10.222.0.26 "GET /compute/v2.1/servers/c2250e42-ea12-4161-8558-cba54fd9b4a8" status: 200 len: 1319 microversion: 2.1 time: 0.857672 Oct 08 20:57:00.158482 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 705/1366] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:56:59 2022] GET /compute/v2.1/servers/c2250e42-ea12-4161-8558-cba54fd9b4a8 => generated 1319 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:57:00.162455 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-517709ef-85aa-40c3-90fa-b9368e4f90a7 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:00.163083 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-517709ef-85aa-40c3-90fa-b9368e4f90a7 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] [instance: 57016fcf-2d2c-488c-9af6-0530ebc199f6] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:00.183080 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-517709ef-85aa-40c3-90fa-b9368e4f90a7 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:00.185889 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-517709ef-85aa-40c3-90fa-b9368e4f90a7 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:00.186354 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-517709ef-85aa-40c3-90fa-b9368e4f90a7 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:00.187174 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-517709ef-85aa-40c3-90fa-b9368e4f90a7 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:00.187652 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-517709ef-85aa-40c3-90fa-b9368e4f90a7 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:00.188093 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-517709ef-85aa-40c3-90fa-b9368e4f90a7 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:00.458093 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-a1f82c0f-49ef-4085-acef-40596d40e832 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Flavor limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 20:57:00.458733 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-a1f82c0f-49ef-4085-acef-40596d40e832 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Image limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 20:57:00.459740 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-a1f82c0f-49ef-4085-acef-40596d40e832 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Flavor pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 20:57:00.460469 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-a1f82c0f-49ef-4085-acef-40596d40e832 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Image pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 20:57:00.461106 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-a1f82c0f-49ef-4085-acef-40596d40e832 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 20:57:00.473787 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a1f82c0f-49ef-4085-acef-40596d40e832 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:00.474449 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a1f82c0f-49ef-4085-acef-40596d40e832 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:00.475044 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a1f82c0f-49ef-4085-acef-40596d40e832 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:00.475985 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a1f82c0f-49ef-4085-acef-40596d40e832 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:00.476596 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a1f82c0f-49ef-4085-acef-40596d40e832 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:00.477729 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a1f82c0f-49ef-4085-acef-40596d40e832 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:00.507640 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-a1f82c0f-49ef-4085-acef-40596d40e832 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Getting quotas for project 6ecc2dd2407b4819874bed09cb27959a. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 20:57:00.515619 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-a1f82c0f-49ef-4085-acef-40596d40e832 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Getting quotas for user 474ca64d1b1d4e30916b517645aba882 and project 6ecc2dd2407b4819874bed09cb27959a. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 20:57:00.593301 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-a1f82c0f-49ef-4085-acef-40596d40e832 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Going to run 1 instances... {{(pid=140491) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 20:57:00.595425 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-a1f82c0f-49ef-4085-acef-40596d40e832 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] [instance: e2d1c93f-8392-4f67-a29e-05164828f9d8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a8994233-8420-4f40-b8b2-5054eebfce14',volume_size=None,volume_type=None)] {{(pid=140491) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 20:57:00.657972 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=2 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:57:00.829617 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-a1f82c0f-49ef-4085-acef-40596d40e832 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.764087 Oct 08 20:57:00.830881 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 662/1367] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 20:56:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 1766 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 08 20:57:00.835962 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-9b2a449a-eecb-4dbf-a515-4e1b4fb9b5bb tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Calling method '.version_select at 0x7f1a8c7d5ee0>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:00.978687 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-517709ef-85aa-40c3-90fa-b9368e4f90a7 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:00.989487 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-517709ef-85aa-40c3-90fa-b9368e4f90a7 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:00.991356 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-517709ef-85aa-40c3-90fa-b9368e4f90a7 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:00.992769 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-517709ef-85aa-40c3-90fa-b9368e4f90a7 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] 10.222.0.26 "GET /compute/v2.1/servers/57016fcf-2d2c-488c-9af6-0530ebc199f6" status: 200 len: 1814 microversion: 2.25 time: 0.834135 Oct 08 20:57:00.993567 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 706/1368] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:57:00 2022] GET /compute/v2.1/servers/57016fcf-2d2c-488c-9af6-0530ebc199f6 => generated 1814 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:57:00.998837 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-0e9f6654-117c-49d4-85ce-9f0ba2c5cf01 tempest-ServerGroup264TestJSON-1474094565 tempest-ServerGroup264TestJSON-1474094565-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:01.017690 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-0e9f6654-117c-49d4-85ce-9f0ba2c5cf01 tempest-ServerGroup264TestJSON-1474094565 tempest-ServerGroup264TestJSON-1474094565-project] 10.222.0.26 "GET /compute/v2.1/os-server-groups/83024525-1b6b-43a7-9b14-6f00ae12c228" status: 200 len: 235 microversion: 2.64 time: 0.022278 Oct 08 20:57:01.018923 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 707/1369] 10.222.0.26 () {60 vars in 1304 bytes} [Sat Oct 8 20:57:00 2022] GET /compute/v2.1/os-server-groups/83024525-1b6b-43a7-9b14-6f00ae12c228 => generated 235 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 08 20:57:01.228516 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-6a678827-86de-4e13-b643-a9e02dcb7600 tempest-KeyPairsV2TestJSON-1686182842 tempest-KeyPairsV2TestJSON-1686182842-project] Action: 'create', calling method: .version_select at 0x7f1a91334dc0>, body: {"keypair": {"name": "tempest-keypair-816394809", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJSsLtrHSKtETnv8UZbxt/lqu8TVxDsFnMI9a0TIE1htM2D7HilgLuxgNLMrvYz7e1hBVMgFhOFIxUAaTVbtZyp/rFldEySMH3rPQumgLsB2mDFwMhLrDXG7cvkl/uFToA=="}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:57:01.253230 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-6a678827-86de-4e13-b643-a9e02dcb7600 tempest-KeyPairsV2TestJSON-1686182842 tempest-KeyPairsV2TestJSON-1686182842-project] Getting quotas for project 14d8376dc21744b6b8592e7373367b74. Resources: {'key_pairs'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 20:57:01.260704 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-6a678827-86de-4e13-b643-a9e02dcb7600 tempest-KeyPairsV2TestJSON-1686182842 tempest-KeyPairsV2TestJSON-1686182842-project] Getting quotas for user 6e30edb713e5441ea615922db8ba8c9c and project 14d8376dc21744b6b8592e7373367b74. Resources: {'key_pairs'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 20:57:01.291677 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-6a678827-86de-4e13-b643-a9e02dcb7600 tempest-KeyPairsV2TestJSON-1686182842 tempest-KeyPairsV2TestJSON-1686182842-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.271315 Oct 08 20:57:01.292586 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 708/1370] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Oct 8 20:57:01 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:57:01.297937 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-a433c13a-c0af-4a0e-bb30-aa05e3f46fb9 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:01.298865 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-a433c13a-c0af-4a0e-bb30-aa05e3f46fb9 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] [instance: ceced78a-58d9-4175-b4fe-0d085be62c94] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:01.307004 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a433c13a-c0af-4a0e-bb30-aa05e3f46fb9 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:01.307799 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a433c13a-c0af-4a0e-bb30-aa05e3f46fb9 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:01.308462 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a433c13a-c0af-4a0e-bb30-aa05e3f46fb9 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:01.309421 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a433c13a-c0af-4a0e-bb30-aa05e3f46fb9 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:01.309918 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a433c13a-c0af-4a0e-bb30-aa05e3f46fb9 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:01.310442 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a433c13a-c0af-4a0e-bb30-aa05e3f46fb9 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:01.517964 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-9b2a449a-eecb-4dbf-a515-4e1b4fb9b5bb tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/edb6bc31-d59b-459a-827c-f8f8818ce070" status: 202 len: 0 microversion: 2.1 time: 0.685596 Oct 08 20:57:01.520298 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 663/1371] 10.222.0.26 () {58 vars in 1272 bytes} [Sat Oct 8 20:57:00 2022] DELETE /compute/v2.1/os-security-groups/edb6bc31-d59b-459a-827c-f8f8818ce070 => generated 0 bytes in 688 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 20:57:01.555607 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-f97e1532-50e5-49b8-9e41-3fcecf92aa4a req-4c29623b-78f1-46d5-987b-66e79f7f37a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ceced78a-58d9-4175-b4fe-0d085be62c94", "tag": "aa2712c9-7942-46c1-ba5f-b344a76ff083"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:57:01.575033 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-f97e1532-50e5-49b8-9e41-3fcecf92aa4a req-4c29623b-78f1-46d5-987b-66e79f7f37a5 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:01.575904 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-f97e1532-50e5-49b8-9e41-3fcecf92aa4a req-4c29623b-78f1-46d5-987b-66e79f7f37a5 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:01.576584 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-f97e1532-50e5-49b8-9e41-3fcecf92aa4a req-4c29623b-78f1-46d5-987b-66e79f7f37a5 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:01.593086 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-f97e1532-50e5-49b8-9e41-3fcecf92aa4a req-4c29623b-78f1-46d5-987b-66e79f7f37a5 service nova] Creating event network-changed:aa2712c9-7942-46c1-ba5f-b344a76ff083 for instance ceced78a-58d9-4175-b4fe-0d085be62c94 on nch2-master-1 Oct 08 20:57:01.599221 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-f97e1532-50e5-49b8-9e41-3fcecf92aa4a req-4c29623b-78f1-46d5-987b-66e79f7f37a5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073919 Oct 08 20:57:01.600900 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 664/1372] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:57:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:57:01.700793 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-e5d10fae-8bcf-4f70-9fb4-f7b7bc2bc6e6 req-722f09a1-9fbd-463b-b117-734233b49a35 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2250e42-ea12-4161-8558-cba54fd9b4a8", "tag": "f4fea469-74e9-4150-8b0e-63b451dd80ed"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:57:01.717928 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-e5d10fae-8bcf-4f70-9fb4-f7b7bc2bc6e6 req-722f09a1-9fbd-463b-b117-734233b49a35 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:01.719732 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-e5d10fae-8bcf-4f70-9fb4-f7b7bc2bc6e6 req-722f09a1-9fbd-463b-b117-734233b49a35 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:01.720576 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-e5d10fae-8bcf-4f70-9fb4-f7b7bc2bc6e6 req-722f09a1-9fbd-463b-b117-734233b49a35 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:01.739257 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-e5d10fae-8bcf-4f70-9fb4-f7b7bc2bc6e6 req-722f09a1-9fbd-463b-b117-734233b49a35 service nova] Creating event network-changed:f4fea469-74e9-4150-8b0e-63b451dd80ed for instance c2250e42-ea12-4161-8558-cba54fd9b4a8 on nch2-master-1 Oct 08 20:57:01.744203 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-e5d10fae-8bcf-4f70-9fb4-f7b7bc2bc6e6 req-722f09a1-9fbd-463b-b117-734233b49a35 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.141712 Oct 08 20:57:01.744937 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 665/1373] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:57:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:57:01.750488 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-1888cc0c-7bef-4f7d-90bb-a0d72894c62a tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:01.751499 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-1888cc0c-7bef-4f7d-90bb-a0d72894c62a tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] [instance: e2d1c93f-8392-4f67-a29e-05164828f9d8] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:01.757697 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-a433c13a-c0af-4a0e-bb30-aa05e3f46fb9 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:01.761106 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1888cc0c-7bef-4f7d-90bb-a0d72894c62a tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:01.761979 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1888cc0c-7bef-4f7d-90bb-a0d72894c62a tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:01.762747 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1888cc0c-7bef-4f7d-90bb-a0d72894c62a tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:01.763685 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1888cc0c-7bef-4f7d-90bb-a0d72894c62a tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:01.764358 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1888cc0c-7bef-4f7d-90bb-a0d72894c62a tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:01.765030 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1888cc0c-7bef-4f7d-90bb-a0d72894c62a tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:01.779137 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-a433c13a-c0af-4a0e-bb30-aa05e3f46fb9 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:01.786493 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-a433c13a-c0af-4a0e-bb30-aa05e3f46fb9 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:01.787751 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-a433c13a-c0af-4a0e-bb30-aa05e3f46fb9 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] 10.222.0.26 "GET /compute/v2.1/servers/ceced78a-58d9-4175-b4fe-0d085be62c94" status: 200 len: 1874 microversion: 2.42 time: 0.493782 Oct 08 20:57:01.793150 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 709/1374] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:57:01 2022] GET /compute/v2.1/servers/ceced78a-58d9-4175-b4fe-0d085be62c94 => generated 1874 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:57:01.806560 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-1c6ba2e4-ef42-492f-8ff6-4e674988fb0e tempest-ServerGroup264TestJSON-1474094565 tempest-ServerGroup264TestJSON-1474094565-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:01.897568 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-1c6ba2e4-ef42-492f-8ff6-4e674988fb0e tempest-ServerGroup264TestJSON-1474094565 tempest-ServerGroup264TestJSON-1474094565-project] 10.222.0.26 "DELETE /compute/v2.1/os-server-groups/83024525-1b6b-43a7-9b14-6f00ae12c228" status: 204 len: 0 microversion: 2.64 time: 0.086235 Oct 08 20:57:01.898576 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 710/1375] 10.222.0.26 () {60 vars in 1307 bytes} [Sat Oct 8 20:57:01 2022] DELETE /compute/v2.1/os-server-groups/83024525-1b6b-43a7-9b14-6f00ae12c228 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 08 20:57:01.917500 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-5b9f0ddb-c372-4ca6-808a-f38197af7d9a tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:01.918312 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-5b9f0ddb-c372-4ca6-808a-f38197af7d9a tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] [instance: c2250e42-ea12-4161-8558-cba54fd9b4a8] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:01.925075 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5b9f0ddb-c372-4ca6-808a-f38197af7d9a tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:01.926426 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5b9f0ddb-c372-4ca6-808a-f38197af7d9a tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:01.927047 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5b9f0ddb-c372-4ca6-808a-f38197af7d9a tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:01.928071 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5b9f0ddb-c372-4ca6-808a-f38197af7d9a tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:01.928708 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5b9f0ddb-c372-4ca6-808a-f38197af7d9a tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:01.929381 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5b9f0ddb-c372-4ca6-808a-f38197af7d9a tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:02.013615 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-1888cc0c-7bef-4f7d-90bb-a0d72894c62a tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474ca64d1b1d4e30916b517645aba882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecc2dd2407b4819874bed09cb27959a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:02.028354 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-1888cc0c-7bef-4f7d-90bb-a0d72894c62a tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d1c93f-8392-4f67-a29e-05164828f9d8" status: 200 len: 1094 microversion: 2.1 time: 0.281949 Oct 08 20:57:02.032723 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 666/1376] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:57:01 2022] GET /compute/v2.1/servers/e2d1c93f-8392-4f67-a29e-05164828f9d8 => generated 1094 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:57:02.047530 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-4ecd9290-356b-489c-8bdd-3142d6e39603 tempest-KeyPairsV2TestJSON-1686182842 tempest-KeyPairsV2TestJSON-1686182842-project] Calling method '.version_select at 0x7f1a8c9e93a0>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:02.062939 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-4ecd9290-356b-489c-8bdd-3142d6e39603 tempest-KeyPairsV2TestJSON-1686182842 tempest-KeyPairsV2TestJSON-1686182842-project] 10.222.0.26 "GET /compute/v2.1/os-keypairs/tempest-keypair-816394809" status: 200 len: 497 microversion: 2.1 time: 0.028815 Oct 08 20:57:02.064160 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 667/1377] 10.222.0.26 () {58 vars in 1215 bytes} [Sat Oct 8 20:57:02 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-816394809 => generated 497 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:57:02.080180 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-cdf89f74-8872-4cee-9fac-48c2dc5ae68f tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Calling method '.version_select at 0x7f1a8ca3b0d0>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:02.138792 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-5b9f0ddb-c372-4ca6-808a-f38197af7d9a tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05f0f7a60257437eaa8702b664916979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7550f7ad9dc45ba9c9bfb0a5a11a774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:02.149630 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-5b9f0ddb-c372-4ca6-808a-f38197af7d9a tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] 10.222.0.26 "GET /compute/v2.1/servers/c2250e42-ea12-4161-8558-cba54fd9b4a8" status: 200 len: 1319 microversion: 2.1 time: 0.242241 Oct 08 20:57:02.165914 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 711/1378] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:57:01 2022] GET /compute/v2.1/servers/c2250e42-ea12-4161-8558-cba54fd9b4a8 => generated 1319 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:57:02.170808 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-6a476746-580a-4388-9e54-b7f119ff8501 tempest-ServerGroup264TestJSON-1474094565 tempest-ServerGroup264TestJSON-1474094565-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:02.177283 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-6a476746-580a-4388-9e54-b7f119ff8501 tempest-ServerGroup264TestJSON-1474094565 tempest-ServerGroup264TestJSON-1474094565-project] HTTP exception thrown: Instance group 83024525-1b6b-43a7-9b14-6f00ae12c228 could not be found. Oct 08 20:57:02.181011 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-6a476746-580a-4388-9e54-b7f119ff8501 tempest-ServerGroup264TestJSON-1474094565 tempest-ServerGroup264TestJSON-1474094565-project] Request method failure captured: Oct 08 20:57:02.181011 ncdv-master-1 devstack@n-api.service[140492]: request: DELETE /compute/v2.1/os-server-groups/83024525-1b6b-43a7-9b14-6f00ae12c228 HTTP/1.1 Oct 08 20:57:02.181011 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 20:57:02.181011 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 20:57:02.181011 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 20:57:02.181011 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 20:57:02.181011 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 20:57:02.181011 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 20:57:02.181011 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 20:57:02.181011 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 20:57:02.181011 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeQZZCgQ-f9MP73mR22hOmk6VwCKKJA97gF1QIM-phuklEGRoA-8HNQ28HZvehRl_AVjC9UQ1KANUBeJ9frp5XiqItqi5pzZA_RuBEiAuh9fiL8vlAh0peo6uDb-0_vqWHUvfRep7OT6_hn3oyCnEVPAHrjgLoWpkQ146tVk2HE-1mU Oct 08 20:57:02.181011 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 20:57:02.181011 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 20:57:02.181011 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 20:57:02.181011 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 20:57:02.181011 ncdv-master-1 devstack@n-api.service[140492]: X-Openstack-Nova-Api-Version: 2.64 Oct 08 20:57:02.181011 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 20:57:02.181011 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 20:57:02.181011 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 1e6beec34e0e4af180cd798eb7ef4ad0 Oct 08 20:57:02.181011 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-ServerGroup264TestJSON-1474094565 Oct 08 20:57:02.181011 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 20:57:02.181011 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 20:57:02.181011 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1e6beec34e0e4af180cd798eb7ef4ad0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1e6beec34e0e4af180cd798eb7ef4ad0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1e6beec34e0e4af180cd798eb7ef4ad0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1e6beec34e0e4af180cd798eb7ef4ad0"}]}] Oct 08 20:57:02.181011 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-ServerGroup264TestJSON-1474094565 Oct 08 20:57:02.181011 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 1e6beec34e0e4af180cd798eb7ef4ad0 Oct 08 20:57:02.181011 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-ServerGroup264TestJSON-1474094565 Oct 08 20:57:02.181011 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-ServerGroup264TestJSON-1474094565-project Oct 08 20:57:02.181011 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 20:57:02.181011 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 20:57:02.181011 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 56649c9113d84e6390d58d84ab089380 Oct 08 20:57:02.181011 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-ServerGroup264TestJSON-1474094565-project Oct 08 20:57:02.181011 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 20:57:02.181011 ncdv-master-1 devstack@n-api.service[140492]: exception: Instance group 83024525-1b6b-43a7-9b14-6f00ae12c228 could not be found. Oct 08 20:57:02.181011 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': '83024525-1b6b-43a7-9b14-6f00ae12c228'} Oct 08 20:57:02.181011 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:57:02.181011 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:57:02.181011 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 08 20:57:02.181011 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 08 20:57:02.181011 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 08 20:57:02.181011 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 08 20:57:02.181011 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 08 20:57:02.181011 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 08 20:57:02.181011 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 08 20:57:02.181011 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 08 20:57:02.181011 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 08 20:57:02.181011 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 08 20:57:02.181011 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 83024525-1b6b-43a7-9b14-6f00ae12c228 could not be found. Oct 08 20:57:02.181011 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:57:02.181011 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:57:02.181011 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:57:02.181011 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:57:02.181011 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:57:02.181011 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:57:02.181011 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:57:02.181011 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:57:02.181011 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:57:02.181011 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:57:02.181011 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 08 20:57:02.181011 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 08 20:57:02.181011 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 83024525-1b6b-43a7-9b14-6f00ae12c228 could not be found. Oct 08 20:57:02.181011 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:57:02.181011 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:57:02.181011 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:57:02.181011 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:57:02.185067 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:57:02.185067 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:57:02.185067 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 20:57:02.185067 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 20:57:02.185067 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 83024525-1b6b-43a7-9b14-6f00ae12c228 could not be found. Oct 08 20:57:02.185067 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:57:02.187245 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-6a476746-580a-4388-9e54-b7f119ff8501 tempest-ServerGroup264TestJSON-1474094565 tempest-ServerGroup264TestJSON-1474094565-project] Returning 404 to user: Instance group 83024525-1b6b-43a7-9b14-6f00ae12c228 could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:57:02.188115 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-6a476746-580a-4388-9e54-b7f119ff8501 tempest-ServerGroup264TestJSON-1474094565 tempest-ServerGroup264TestJSON-1474094565-project] 10.222.0.26 "DELETE /compute/v2.1/os-server-groups/83024525-1b6b-43a7-9b14-6f00ae12c228" status: 404 len: 117 microversion: 2.64 time: 0.021157 Oct 08 20:57:02.188679 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 712/1379] 10.222.0.26 () {60 vars in 1307 bytes} [Sat Oct 8 20:57:02 2022] DELETE /compute/v2.1/os-server-groups/83024525-1b6b-43a7-9b14-6f00ae12c228 => generated 117 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 08 20:57:02.193964 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-43479049-34c0-4227-9030-c901b7799c76 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:02.195461 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-43479049-34c0-4227-9030-c901b7799c76 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] [instance: 57016fcf-2d2c-488c-9af6-0530ebc199f6] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:02.199225 ncdv-master-1 devstack@n-api.service[140491]: DEBUG neutronclient.v2_0.client [None req-cdf89f74-8872-4cee-9fac-48c2dc5ae68f tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group edb6bc31-d59b-459a-827c-f8f8818ce070 does not exist", "detail": ""}} {{(pid=140491) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 08 20:57:02.200329 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.network.security_group_api [None req-cdf89f74-8872-4cee-9fac-48c2dc5ae68f tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Neutron security group edb6bc31-d59b-459a-827c-f8f8818ce070 not found {{(pid=140491) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 08 20:57:02.201074 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-cdf89f74-8872-4cee-9fac-48c2dc5ae68f tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] HTTP exception thrown: Security group edb6bc31-d59b-459a-827c-f8f8818ce070 does not exist Oct 08 20:57:02.201074 ncdv-master-1 devstack@n-api.service[140491]: Neutron server returns request_ids: ['req-880a160c-7176-44ec-b1c6-75901b9eae30'] Oct 08 20:57:02.205015 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-43479049-34c0-4227-9030-c901b7799c76 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:02.205657 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-43479049-34c0-4227-9030-c901b7799c76 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:02.206344 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-43479049-34c0-4227-9030-c901b7799c76 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:02.207551 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-43479049-34c0-4227-9030-c901b7799c76 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:02.208665 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-43479049-34c0-4227-9030-c901b7799c76 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:02.209571 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-43479049-34c0-4227-9030-c901b7799c76 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:02.212735 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-cdf89f74-8872-4cee-9fac-48c2dc5ae68f tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Request method failure captured: Oct 08 20:57:02.212735 ncdv-master-1 devstack@n-api.service[140491]: request: GET /compute/v2.1/os-security-groups/edb6bc31-d59b-459a-827c-f8f8818ce070 HTTP/1.1 Oct 08 20:57:02.212735 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 20:57:02.212735 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 20:57:02.212735 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 20:57:02.212735 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 20:57:02.212735 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 20:57:02.212735 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 20:57:02.212735 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 20:57:02.212735 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 20:57:02.212735 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQePneH9r8wc6qFHuuUfUiwj20bfGS3ReCozGKtofTKF_Bibv-TeYrNnDr89OwEeHkYGW8sVcZZerG8KfPs5hnyFWI91x_kPrSGVuiWEZNP0tyGW3_Xh9-fgTNjxnIFiLidb-EHCBZb3EEyAGFqy03GkbophorT5sYui55pNleytp26U Oct 08 20:57:02.212735 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 20:57:02.212735 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 20:57:02.212735 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 20:57:02.212735 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 20:57:02.212735 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 20:57:02.212735 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 20:57:02.212735 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 1be94d02ab5244f98337fb9b90e74746 Oct 08 20:57:02.212735 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-SecurityGroupsTestJSON-1416879597 Oct 08 20:57:02.212735 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 20:57:02.212735 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 20:57:02.212735 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1be94d02ab5244f98337fb9b90e74746"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1be94d02ab5244f98337fb9b90e74746"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1be94d02ab5244f98337fb9b90e74746"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1be94d02ab5244f98337fb9b90e74746"}]}] Oct 08 20:57:02.212735 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-SecurityGroupsTestJSON-1416879597 Oct 08 20:57:02.212735 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 1be94d02ab5244f98337fb9b90e74746 Oct 08 20:57:02.212735 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1416879597 Oct 08 20:57:02.212735 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-SecurityGroupsTestJSON-1416879597-project Oct 08 20:57:02.212735 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 20:57:02.212735 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 20:57:02.212735 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 5ac1323815364df4a3a4d4dbbb9d70dd Oct 08 20:57:02.212735 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-SecurityGroupsTestJSON-1416879597-project Oct 08 20:57:02.212735 ncdv-master-1 devstack@n-api.service[140491]: method: Oct 08 20:57:02.212735 ncdv-master-1 devstack@n-api.service[140491]: exception: Security group edb6bc31-d59b-459a-827c-f8f8818ce070 does not exist Oct 08 20:57:02.212735 ncdv-master-1 devstack@n-api.service[140491]: Neutron server returns request_ids: ['req-880a160c-7176-44ec-b1c6-75901b9eae30'] Oct 08 20:57:02.212735 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': 'edb6bc31-d59b-459a-827c-f8f8818ce070'} Oct 08 20:57:02.212735 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:57:02.212735 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:57:02.212735 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 08 20:57:02.212735 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 08 20:57:02.212735 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 08 20:57:02.212735 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 08 20:57:02.212735 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 08 20:57:02.212735 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 08 20:57:02.212735 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 08 20:57:02.212735 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 08 20:57:02.212735 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 08 20:57:02.212735 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 08 20:57:02.212735 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 08 20:57:02.212735 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 08 20:57:02.212735 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 08 20:57:02.212735 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 08 20:57:02.212735 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 08 20:57:02.212735 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 08 20:57:02.212735 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 08 20:57:02.212735 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 08 20:57:02.212735 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 08 20:57:02.212735 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 08 20:57:02.212735 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 08 20:57:02.212735 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 08 20:57:02.212735 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 08 20:57:02.212735 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 08 20:57:02.212735 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group edb6bc31-d59b-459a-827c-f8f8818ce070 does not exist Oct 08 20:57:02.216756 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-880a160c-7176-44ec-b1c6-75901b9eae30'] Oct 08 20:57:02.216756 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:57:02.216756 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:57:02.216756 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:57:02.216756 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:57:02.216756 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 08 20:57:02.216756 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 08 20:57:02.216756 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 08 20:57:02.216756 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 08 20:57:02.216756 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group edb6bc31-d59b-459a-827c-f8f8818ce070 does not exist Oct 08 20:57:02.216756 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-880a160c-7176-44ec-b1c6-75901b9eae30'] Oct 08 20:57:02.216756 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:57:02.216756 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:57:02.216756 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:57:02.216756 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:57:02.216756 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:57:02.216756 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:57:02.216756 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:57:02.216756 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:57:02.216756 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 08 20:57:02.216756 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 08 20:57:02.216756 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:57:02.216756 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:57:02.216756 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 08 20:57:02.216756 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 08 20:57:02.216756 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group edb6bc31-d59b-459a-827c-f8f8818ce070 does not exist Oct 08 20:57:02.216756 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-880a160c-7176-44ec-b1c6-75901b9eae30'] Oct 08 20:57:02.216756 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:57:02.216756 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:57:02.216756 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:57:02.216756 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:57:02.216756 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:57:02.216756 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:57:02.216756 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 20:57:02.216756 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 20:57:02.216756 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group edb6bc31-d59b-459a-827c-f8f8818ce070 does not exist Oct 08 20:57:02.216756 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-880a160c-7176-44ec-b1c6-75901b9eae30'] Oct 08 20:57:02.216756 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:57:02.216756 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-cdf89f74-8872-4cee-9fac-48c2dc5ae68f tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Returning 404 to user: Security group edb6bc31-d59b-459a-827c-f8f8818ce070 does not exist Oct 08 20:57:02.216756 ncdv-master-1 devstack@n-api.service[140491]: Neutron server returns request_ids: ['req-880a160c-7176-44ec-b1c6-75901b9eae30'] {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:57:02.221410 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-cdf89f74-8872-4cee-9fac-48c2dc5ae68f tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] 10.222.0.26 "GET /compute/v2.1/os-security-groups/edb6bc31-d59b-459a-827c-f8f8818ce070" status: 404 len: 194 microversion: 2.1 time: 0.151269 Oct 08 20:57:02.221410 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 668/1380] 10.222.0.26 () {58 vars in 1269 bytes} [Sat Oct 8 20:57:02 2022] GET /compute/v2.1/os-security-groups/edb6bc31-d59b-459a-827c-f8f8818ce070 => generated 194 bytes in 156 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 20:57:02.229656 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-cd76fad4-2585-4cd3-a97d-b937920ff4f7 tempest-KeyPairsV2TestJSON-1686182842 tempest-KeyPairsV2TestJSON-1686182842-project] Calling method '.version_select at 0x7f1a8cc82310>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:02.278188 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-cd76fad4-2585-4cd3-a97d-b937920ff4f7 tempest-KeyPairsV2TestJSON-1686182842 tempest-KeyPairsV2TestJSON-1686182842-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-816394809" status: 202 len: 0 microversion: 2.1 time: 0.054541 Oct 08 20:57:02.279678 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 669/1381] 10.222.0.26 () {58 vars in 1218 bytes} [Sat Oct 8 20:57:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-816394809 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 20:57:02.285291 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-228f20fd-9207-4ddd-82eb-3f7185bae800 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Calling method '.version_select at 0x7f1a8ca13af0>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:02.544605 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-43479049-34c0-4227-9030-c901b7799c76 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:02.556593 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-43479049-34c0-4227-9030-c901b7799c76 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:02.560756 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-43479049-34c0-4227-9030-c901b7799c76 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:02.562893 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-43479049-34c0-4227-9030-c901b7799c76 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] 10.222.0.26 "GET /compute/v2.1/servers/57016fcf-2d2c-488c-9af6-0530ebc199f6" status: 200 len: 1814 microversion: 2.25 time: 0.373019 Oct 08 20:57:02.568085 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 713/1382] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:57:02 2022] GET /compute/v2.1/servers/57016fcf-2d2c-488c-9af6-0530ebc199f6 => generated 1814 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:57:02.573589 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-af0ce89d-84e7-428a-8744-03d3ea4c42e2 tempest-KeyPairsV2TestJSON-1686182842 tempest-KeyPairsV2TestJSON-1686182842-project] Action: 'create', calling method: .version_select at 0x7f1a8caf4040>, body: {"keypair": {"name": "tempest-keypair-2000827393", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM03V51XIdV9oMrqG+G5POJDTuzIT2lXSsvZH7Jcvgvni+JkdlIPhUhm6DXmAHvIkKVxxQAh2uAAosh00sJilNeL2IwgBoeufc+MmBNembIljXxQbgSw2LnbbEC7GacbCw=="}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:57:02.637800 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-af0ce89d-84e7-428a-8744-03d3ea4c42e2 tempest-KeyPairsV2TestJSON-1686182842 tempest-KeyPairsV2TestJSON-1686182842-project] Getting quotas for project 14d8376dc21744b6b8592e7373367b74. Resources: {'key_pairs'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 20:57:02.645752 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-af0ce89d-84e7-428a-8744-03d3ea4c42e2 tempest-KeyPairsV2TestJSON-1686182842 tempest-KeyPairsV2TestJSON-1686182842-project] Getting quotas for user 6e30edb713e5441ea615922db8ba8c9c and project 14d8376dc21744b6b8592e7373367b74. Resources: {'key_pairs'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 20:57:02.687594 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-af0ce89d-84e7-428a-8744-03d3ea4c42e2 tempest-KeyPairsV2TestJSON-1686182842 tempest-KeyPairsV2TestJSON-1686182842-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.118036 Oct 08 20:57:02.688696 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 714/1383] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Oct 8 20:57:02 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:57:02.699846 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-8e746446-43bf-45b4-917e-663731951c2f tempest-KeyPairsV2TestJSON-1686182842 tempest-KeyPairsV2TestJSON-1686182842-project] Calling method '.version_select at 0x7f1a9133d820>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:02.739795 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-8e746446-43bf-45b4-917e-663731951c2f tempest-KeyPairsV2TestJSON-1686182842 tempest-KeyPairsV2TestJSON-1686182842-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2000827393" status: 202 len: 0 microversion: 2.1 time: 0.044326 Oct 08 20:57:02.741966 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 715/1384] 10.222.0.26 () {58 vars in 1221 bytes} [Sat Oct 8 20:57:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2000827393 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 20:57:02.759468 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-2abce18b-21cc-44f4-a15d-87226d33194f tempest-KeyPairsV2TestJSON-1686182842 tempest-KeyPairsV2TestJSON-1686182842-project] Action: 'create', calling method: .version_select at 0x7f1a91312700>, body: {"keypair": {"name": "tempest-keypair-1826461039", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:57:02.788723 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-2abce18b-21cc-44f4-a15d-87226d33194f tempest-KeyPairsV2TestJSON-1686182842 tempest-KeyPairsV2TestJSON-1686182842-project] Getting quotas for project 14d8376dc21744b6b8592e7373367b74. Resources: {'key_pairs'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 20:57:02.799230 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-2abce18b-21cc-44f4-a15d-87226d33194f tempest-KeyPairsV2TestJSON-1686182842 tempest-KeyPairsV2TestJSON-1686182842-project] Getting quotas for user 6e30edb713e5441ea615922db8ba8c9c and project 14d8376dc21744b6b8592e7373367b74. Resources: {'key_pairs'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 20:57:02.817408 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=4,nova_api:DELETE=4 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:57:02.835322 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-2abce18b-21cc-44f4-a15d-87226d33194f tempest-KeyPairsV2TestJSON-1686182842 tempest-KeyPairsV2TestJSON-1686182842-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 574 microversion: 2.1 time: 0.083581 Oct 08 20:57:02.844173 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 716/1385] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Oct 8 20:57:02 2022] POST /compute/v2.1/os-keypairs => generated 574 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:57:02.850683 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-54621620-be44-43a8-accb-3b773cbf5a1f tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:02.851313 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-54621620-be44-43a8-accb-3b773cbf5a1f tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] [instance: ceced78a-58d9-4175-b4fe-0d085be62c94] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:02.861179 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-54621620-be44-43a8-accb-3b773cbf5a1f tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:02.862127 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-54621620-be44-43a8-accb-3b773cbf5a1f tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:02.862772 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-54621620-be44-43a8-accb-3b773cbf5a1f tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:02.863680 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-54621620-be44-43a8-accb-3b773cbf5a1f tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:02.864326 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-54621620-be44-43a8-accb-3b773cbf5a1f tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:02.864768 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-54621620-be44-43a8-accb-3b773cbf5a1f tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:02.904130 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:57:03.553938 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-228f20fd-9207-4ddd-82eb-3f7185bae800 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/f3eac078-74a5-4995-a964-efc4f5793217" status: 202 len: 0 microversion: 2.1 time: 1.272760 Oct 08 20:57:03.556516 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 670/1386] 10.222.0.26 () {58 vars in 1272 bytes} [Sat Oct 8 20:57:02 2022] DELETE /compute/v2.1/os-security-groups/f3eac078-74a5-4995-a964-efc4f5793217 => generated 0 bytes in 1276 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 20:57:03.564395 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-ac7b7929-81ca-402b-9b6e-a5b2c4ea61d9 tempest-KeyPairsV2TestJSON-1686182842 tempest-KeyPairsV2TestJSON-1686182842-project] Calling method '.version_select at 0x7f1a8c9e6790>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:03.599113 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-54621620-be44-43a8-accb-3b773cbf5a1f tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:03.600213 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-ac7b7929-81ca-402b-9b6e-a5b2c4ea61d9 tempest-KeyPairsV2TestJSON-1686182842 tempest-KeyPairsV2TestJSON-1686182842-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1826461039" status: 202 len: 0 microversion: 2.1 time: 0.041599 Oct 08 20:57:03.603077 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 671/1387] 10.222.0.26 () {58 vars in 1221 bytes} [Sat Oct 8 20:57:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1826461039 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 20:57:03.617038 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-4afeaed0-0c42-462d-8076-0ad32c00b854 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:03.617742 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-4afeaed0-0c42-462d-8076-0ad32c00b854 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] [instance: e2d1c93f-8392-4f67-a29e-05164828f9d8] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:03.618279 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-54621620-be44-43a8-accb-3b773cbf5a1f tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:03.628837 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4afeaed0-0c42-462d-8076-0ad32c00b854 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:03.629737 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4afeaed0-0c42-462d-8076-0ad32c00b854 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:03.630184 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-54621620-be44-43a8-accb-3b773cbf5a1f tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:03.631397 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4afeaed0-0c42-462d-8076-0ad32c00b854 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:03.631879 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-54621620-be44-43a8-accb-3b773cbf5a1f tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] 10.222.0.26 "GET /compute/v2.1/servers/ceced78a-58d9-4175-b4fe-0d085be62c94" status: 200 len: 1874 microversion: 2.42 time: 0.785462 Oct 08 20:57:03.632454 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 717/1388] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:57:02 2022] GET /compute/v2.1/servers/ceced78a-58d9-4175-b4fe-0d085be62c94 => generated 1874 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:57:03.637239 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-4d18e870-754c-4286-a998-94c8538b3399 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:03.641395 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4afeaed0-0c42-462d-8076-0ad32c00b854 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:03.642611 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4afeaed0-0c42-462d-8076-0ad32c00b854 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:03.643725 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4afeaed0-0c42-462d-8076-0ad32c00b854 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:03.643845 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-4d18e870-754c-4286-a998-94c8538b3399 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] [instance: c2250e42-ea12-4161-8558-cba54fd9b4a8] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:03.654495 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4d18e870-754c-4286-a998-94c8538b3399 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:03.655007 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4d18e870-754c-4286-a998-94c8538b3399 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:03.655569 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4d18e870-754c-4286-a998-94c8538b3399 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:03.656292 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4d18e870-754c-4286-a998-94c8538b3399 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:03.656773 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4d18e870-754c-4286-a998-94c8538b3399 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:03.657236 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4d18e870-754c-4286-a998-94c8538b3399 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:03.715457 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:57:03.869295 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-4afeaed0-0c42-462d-8076-0ad32c00b854 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474ca64d1b1d4e30916b517645aba882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecc2dd2407b4819874bed09cb27959a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:03.882123 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-4afeaed0-0c42-462d-8076-0ad32c00b854 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d1c93f-8392-4f67-a29e-05164828f9d8" status: 200 len: 1168 microversion: 2.1 time: 0.276429 Oct 08 20:57:03.883388 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 672/1389] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:57:03 2022] GET /compute/v2.1/servers/e2d1c93f-8392-4f67-a29e-05164828f9d8 => generated 1168 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:57:03.890173 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-27226a88-6fa3-4678-9682-78fedf271ccc tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Calling method '.version_select at 0x7f1a8c9d0f70>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:03.985632 ncdv-master-1 devstack@n-api.service[140491]: DEBUG neutronclient.v2_0.client [None req-27226a88-6fa3-4678-9682-78fedf271ccc tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group f3eac078-74a5-4995-a964-efc4f5793217 does not exist", "detail": ""}} {{(pid=140491) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 08 20:57:03.987388 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.network.security_group_api [None req-27226a88-6fa3-4678-9682-78fedf271ccc tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Neutron security group f3eac078-74a5-4995-a964-efc4f5793217 not found {{(pid=140491) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 08 20:57:03.988143 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-27226a88-6fa3-4678-9682-78fedf271ccc tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] HTTP exception thrown: Security group f3eac078-74a5-4995-a964-efc4f5793217 does not exist Oct 08 20:57:03.988143 ncdv-master-1 devstack@n-api.service[140491]: Neutron server returns request_ids: ['req-7d0c393f-65a4-4afd-a601-9634eac50d3a'] Oct 08 20:57:03.990517 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-27226a88-6fa3-4678-9682-78fedf271ccc tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Request method failure captured: Oct 08 20:57:03.990517 ncdv-master-1 devstack@n-api.service[140491]: request: GET /compute/v2.1/os-security-groups/f3eac078-74a5-4995-a964-efc4f5793217 HTTP/1.1 Oct 08 20:57:03.990517 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 20:57:03.990517 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 20:57:03.990517 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 20:57:03.990517 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 20:57:03.990517 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 20:57:03.990517 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 20:57:03.990517 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 20:57:03.990517 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 20:57:03.990517 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQePneH9r8wc6qFHuuUfUiwj20bfGS3ReCozGKtofTKF_Bibv-TeYrNnDr89OwEeHkYGW8sVcZZerG8KfPs5hnyFWI91x_kPrSGVuiWEZNP0tyGW3_Xh9-fgTNjxnIFiLidb-EHCBZb3EEyAGFqy03GkbophorT5sYui55pNleytp26U Oct 08 20:57:03.990517 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 20:57:03.990517 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 20:57:03.990517 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 20:57:03.990517 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 20:57:03.990517 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 20:57:03.990517 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 20:57:03.990517 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 1be94d02ab5244f98337fb9b90e74746 Oct 08 20:57:03.990517 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-SecurityGroupsTestJSON-1416879597 Oct 08 20:57:03.990517 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 20:57:03.990517 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 20:57:03.990517 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1be94d02ab5244f98337fb9b90e74746"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1be94d02ab5244f98337fb9b90e74746"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1be94d02ab5244f98337fb9b90e74746"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1be94d02ab5244f98337fb9b90e74746"}]}] Oct 08 20:57:03.990517 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-SecurityGroupsTestJSON-1416879597 Oct 08 20:57:03.990517 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 1be94d02ab5244f98337fb9b90e74746 Oct 08 20:57:03.990517 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1416879597 Oct 08 20:57:03.990517 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-SecurityGroupsTestJSON-1416879597-project Oct 08 20:57:03.990517 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 20:57:03.990517 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 20:57:03.990517 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 5ac1323815364df4a3a4d4dbbb9d70dd Oct 08 20:57:03.990517 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-SecurityGroupsTestJSON-1416879597-project Oct 08 20:57:03.990517 ncdv-master-1 devstack@n-api.service[140491]: method: Oct 08 20:57:03.990517 ncdv-master-1 devstack@n-api.service[140491]: exception: Security group f3eac078-74a5-4995-a964-efc4f5793217 does not exist Oct 08 20:57:03.990517 ncdv-master-1 devstack@n-api.service[140491]: Neutron server returns request_ids: ['req-7d0c393f-65a4-4afd-a601-9634eac50d3a'] Oct 08 20:57:03.990517 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': 'f3eac078-74a5-4995-a964-efc4f5793217'} Oct 08 20:57:03.990517 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:57:03.990517 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:57:03.990517 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 08 20:57:03.990517 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 08 20:57:03.990517 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 08 20:57:03.990517 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 08 20:57:03.990517 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 08 20:57:03.990517 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 08 20:57:03.990517 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 08 20:57:03.990517 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 08 20:57:03.990517 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 08 20:57:03.990517 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 08 20:57:03.990517 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 08 20:57:03.990517 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 08 20:57:03.990517 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 08 20:57:03.990517 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 08 20:57:03.990517 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 08 20:57:03.990517 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 08 20:57:03.990517 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 08 20:57:03.990517 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 08 20:57:03.990517 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 08 20:57:03.990517 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 08 20:57:03.990517 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 08 20:57:03.990517 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 08 20:57:03.990517 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 08 20:57:03.990517 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 08 20:57:03.990517 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group f3eac078-74a5-4995-a964-efc4f5793217 does not exist Oct 08 20:57:03.994492 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7d0c393f-65a4-4afd-a601-9634eac50d3a'] Oct 08 20:57:03.994492 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:57:03.994492 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:57:03.994492 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:57:03.994492 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:57:03.994492 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 08 20:57:03.994492 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 08 20:57:03.994492 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 08 20:57:03.994492 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 08 20:57:03.994492 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group f3eac078-74a5-4995-a964-efc4f5793217 does not exist Oct 08 20:57:03.994492 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7d0c393f-65a4-4afd-a601-9634eac50d3a'] Oct 08 20:57:03.994492 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:57:03.994492 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:57:03.994492 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:57:03.994492 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:57:03.994492 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:57:03.994492 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:57:03.994492 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:57:03.994492 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:57:03.994492 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 08 20:57:03.994492 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 08 20:57:03.994492 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:57:03.994492 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:57:03.994492 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 08 20:57:03.994492 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 08 20:57:03.994492 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group f3eac078-74a5-4995-a964-efc4f5793217 does not exist Oct 08 20:57:03.994492 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7d0c393f-65a4-4afd-a601-9634eac50d3a'] Oct 08 20:57:03.994492 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:57:03.994492 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:57:03.994492 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:57:03.994492 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:57:03.994492 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:57:03.994492 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:57:03.994492 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 20:57:03.994492 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 20:57:03.994492 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group f3eac078-74a5-4995-a964-efc4f5793217 does not exist Oct 08 20:57:03.994492 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7d0c393f-65a4-4afd-a601-9634eac50d3a'] Oct 08 20:57:03.994492 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:57:03.999867 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-27226a88-6fa3-4678-9682-78fedf271ccc tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Returning 404 to user: Security group f3eac078-74a5-4995-a964-efc4f5793217 does not exist Oct 08 20:57:03.999867 ncdv-master-1 devstack@n-api.service[140491]: Neutron server returns request_ids: ['req-7d0c393f-65a4-4afd-a601-9634eac50d3a'] {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:57:04.001448 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-27226a88-6fa3-4678-9682-78fedf271ccc tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] 10.222.0.26 "GET /compute/v2.1/os-security-groups/f3eac078-74a5-4995-a964-efc4f5793217" status: 404 len: 194 microversion: 2.1 time: 0.116617 Oct 08 20:57:04.002489 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 673/1390] 10.222.0.26 () {58 vars in 1269 bytes} [Sat Oct 8 20:57:03 2022] GET /compute/v2.1/os-security-groups/f3eac078-74a5-4995-a964-efc4f5793217 => generated 194 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 20:57:04.015671 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-44876bf6-dd23-426f-84e9-e1317186d565 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:04.018145 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-44876bf6-dd23-426f-84e9-e1317186d565 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] [instance: 57016fcf-2d2c-488c-9af6-0530ebc199f6] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:04.041452 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-44876bf6-dd23-426f-84e9-e1317186d565 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:04.042425 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-44876bf6-dd23-426f-84e9-e1317186d565 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:04.044059 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-44876bf6-dd23-426f-84e9-e1317186d565 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:04.046623 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-44876bf6-dd23-426f-84e9-e1317186d565 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:04.047406 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-44876bf6-dd23-426f-84e9-e1317186d565 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:04.048681 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-44876bf6-dd23-426f-84e9-e1317186d565 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:04.189385 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-4d18e870-754c-4286-a998-94c8538b3399 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05f0f7a60257437eaa8702b664916979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7550f7ad9dc45ba9c9bfb0a5a11a774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:04.202240 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-4d18e870-754c-4286-a998-94c8538b3399 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] 10.222.0.26 "GET /compute/v2.1/servers/c2250e42-ea12-4161-8558-cba54fd9b4a8" status: 200 len: 1319 microversion: 2.1 time: 0.568573 Oct 08 20:57:04.207008 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 718/1391] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:57:03 2022] GET /compute/v2.1/servers/c2250e42-ea12-4161-8558-cba54fd9b4a8 => generated 1319 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:57:04.212632 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-5485c310-ffd8-46ec-95e8-aa10a12f5b4c tempest-KeyPairsV2TestJSON-1686182842 tempest-KeyPairsV2TestJSON-1686182842-project] Action: 'create', calling method: .version_select at 0x7f1a913fc040>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1192584086", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP/zJnv8RRM4vaiULT5WYffqY+DO/uzcm3DiLv/oEfHW/5usUvBvPYKrJfTObQxcuuWJ8ZWynb7zAm8oaH5J9HpFyR9Q4QY9JzLWErGN3kJtpueLnKPR5CeeVdchsPrm2A=="}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:57:04.263928 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-5485c310-ffd8-46ec-95e8-aa10a12f5b4c tempest-KeyPairsV2TestJSON-1686182842 tempest-KeyPairsV2TestJSON-1686182842-project] Getting quotas for project 14d8376dc21744b6b8592e7373367b74. Resources: {'key_pairs'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 20:57:04.271558 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-5485c310-ffd8-46ec-95e8-aa10a12f5b4c tempest-KeyPairsV2TestJSON-1686182842 tempest-KeyPairsV2TestJSON-1686182842-project] Getting quotas for user 6e30edb713e5441ea615922db8ba8c9c and project 14d8376dc21744b6b8592e7373367b74. Resources: {'key_pairs'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 20:57:04.302357 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-5485c310-ffd8-46ec-95e8-aa10a12f5b4c tempest-KeyPairsV2TestJSON-1686182842 tempest-KeyPairsV2TestJSON-1686182842-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.093287 Oct 08 20:57:04.319706 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 719/1392] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Oct 8 20:57:04 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:57:04.337720 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-5abed9b6-8b74-48e7-9d21-c55224938456 req-958319f3-dd95-4924-adb2-a46e1dce461b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ceced78a-58d9-4175-b4fe-0d085be62c94", "tag": "b0a57839-341e-4831-b37b-2d1a263887b4"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:57:04.351398 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-5abed9b6-8b74-48e7-9d21-c55224938456 req-958319f3-dd95-4924-adb2-a46e1dce461b service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:04.352159 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-5abed9b6-8b74-48e7-9d21-c55224938456 req-958319f3-dd95-4924-adb2-a46e1dce461b service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:04.352865 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-5abed9b6-8b74-48e7-9d21-c55224938456 req-958319f3-dd95-4924-adb2-a46e1dce461b service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:04.368501 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-5abed9b6-8b74-48e7-9d21-c55224938456 req-958319f3-dd95-4924-adb2-a46e1dce461b service nova] Creating event network-changed:b0a57839-341e-4831-b37b-2d1a263887b4 for instance ceced78a-58d9-4175-b4fe-0d085be62c94 on nch2-master-1 Oct 08 20:57:04.376082 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-5abed9b6-8b74-48e7-9d21-c55224938456 req-958319f3-dd95-4924-adb2-a46e1dce461b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052888 Oct 08 20:57:04.378228 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 720/1393] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:57:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:57:04.389983 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-b2c1e955-894e-4b26-9e6a-1a1e4a10dca5 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Calling method '.version_select at 0x7f1a91327ee0>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:05.054437 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-b2c1e955-894e-4b26-9e6a-1a1e4a10dca5 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/1c40ec60-bc42-4b10-b1ba-cf2aeffdedae" status: 202 len: 0 microversion: 2.1 time: 0.674515 Oct 08 20:57:05.056407 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 721/1394] 10.222.0.26 () {58 vars in 1272 bytes} [Sat Oct 8 20:57:04 2022] DELETE /compute/v2.1/os-security-groups/1c40ec60-bc42-4b10-b1ba-cf2aeffdedae => generated 0 bytes in 677 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 20:57:05.065456 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-8ac5d778-133a-4591-8e2c-e60637628a98 tempest-KeyPairsV2TestJSON-1686182842 tempest-KeyPairsV2TestJSON-1686182842-project] Action: 'create', calling method: .version_select at 0x7f1a9131a0d0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-489911074", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJe+4rjzA0JbOnIzAqNkfw/+LD6o80EQFJx3Ti02pWLJQChcG5dUQave5enj9vW+ArmHUcM6uCSa9xJX8PF1x51PQuwSQZ0uM/UC4hdqBYDZ497pGBL/ugM2EPXF9SWBrA=="}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:57:05.094063 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-8ac5d778-133a-4591-8e2c-e60637628a98 tempest-KeyPairsV2TestJSON-1686182842 tempest-KeyPairsV2TestJSON-1686182842-project] Getting quotas for project 14d8376dc21744b6b8592e7373367b74. Resources: {'key_pairs'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 20:57:05.104877 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-8ac5d778-133a-4591-8e2c-e60637628a98 tempest-KeyPairsV2TestJSON-1686182842 tempest-KeyPairsV2TestJSON-1686182842-project] Getting quotas for user 6e30edb713e5441ea615922db8ba8c9c and project 14d8376dc21744b6b8592e7373367b74. Resources: {'key_pairs'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 20:57:05.143288 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-44876bf6-dd23-426f-84e9-e1317186d565 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:05.145091 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-8ac5d778-133a-4591-8e2c-e60637628a98 tempest-KeyPairsV2TestJSON-1686182842 tempest-KeyPairsV2TestJSON-1686182842-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.087200 Oct 08 20:57:05.146123 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 722/1395] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Oct 8 20:57:05 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:57:05.161772 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-44876bf6-dd23-426f-84e9-e1317186d565 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:05.162400 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-5d4c01cf-0520-4030-8853-ae9fb6cd3fc4 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:05.163545 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-5d4c01cf-0520-4030-8853-ae9fb6cd3fc4 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] [instance: ceced78a-58d9-4175-b4fe-0d085be62c94] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:05.167049 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-44876bf6-dd23-426f-84e9-e1317186d565 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:05.171336 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-44876bf6-dd23-426f-84e9-e1317186d565 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] 10.222.0.26 "GET /compute/v2.1/servers/57016fcf-2d2c-488c-9af6-0530ebc199f6" status: 200 len: 1804 microversion: 2.25 time: 1.165364 Oct 08 20:57:05.184611 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5d4c01cf-0520-4030-8853-ae9fb6cd3fc4 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:05.186843 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5d4c01cf-0520-4030-8853-ae9fb6cd3fc4 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:05.187452 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 674/1396] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:57:04 2022] GET /compute/v2.1/servers/57016fcf-2d2c-488c-9af6-0530ebc199f6 => generated 1804 bytes in 1183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:57:05.187941 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5d4c01cf-0520-4030-8853-ae9fb6cd3fc4 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:05.189123 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5d4c01cf-0520-4030-8853-ae9fb6cd3fc4 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:05.189978 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5d4c01cf-0520-4030-8853-ae9fb6cd3fc4 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:05.192765 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5d4c01cf-0520-4030-8853-ae9fb6cd3fc4 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:05.197512 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-26e0ab9b-c807-452f-8774-5d5876dabf30 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:05.198538 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-26e0ab9b-c807-452f-8774-5d5876dabf30 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] [instance: e2d1c93f-8392-4f67-a29e-05164828f9d8] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:05.218483 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-26e0ab9b-c807-452f-8774-5d5876dabf30 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:05.233933 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-26e0ab9b-c807-452f-8774-5d5876dabf30 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:05.243195 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-26e0ab9b-c807-452f-8774-5d5876dabf30 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:05.248288 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-26e0ab9b-c807-452f-8774-5d5876dabf30 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:05.248787 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-26e0ab9b-c807-452f-8774-5d5876dabf30 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:05.251123 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-26e0ab9b-c807-452f-8774-5d5876dabf30 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:05.499843 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-26e0ab9b-c807-452f-8774-5d5876dabf30 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474ca64d1b1d4e30916b517645aba882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecc2dd2407b4819874bed09cb27959a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:05.524890 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-26e0ab9b-c807-452f-8774-5d5876dabf30 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d1c93f-8392-4f67-a29e-05164828f9d8" status: 200 len: 1156 microversion: 2.1 time: 0.336056 Oct 08 20:57:05.538955 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 675/1397] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:57:05 2022] GET /compute/v2.1/servers/e2d1c93f-8392-4f67-a29e-05164828f9d8 => generated 1156 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:57:05.551368 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-67946bbe-b700-4fff-9385-2b1b58a5f619 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Calling method '.version_select at 0x7f1a8c9e9c10>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:05.646924 ncdv-master-1 devstack@n-api.service[140491]: DEBUG neutronclient.v2_0.client [None req-67946bbe-b700-4fff-9385-2b1b58a5f619 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 1c40ec60-bc42-4b10-b1ba-cf2aeffdedae does not exist", "detail": ""}} {{(pid=140491) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 08 20:57:05.648389 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.network.security_group_api [None req-67946bbe-b700-4fff-9385-2b1b58a5f619 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Neutron security group 1c40ec60-bc42-4b10-b1ba-cf2aeffdedae not found {{(pid=140491) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 08 20:57:05.648389 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-67946bbe-b700-4fff-9385-2b1b58a5f619 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] HTTP exception thrown: Security group 1c40ec60-bc42-4b10-b1ba-cf2aeffdedae does not exist Oct 08 20:57:05.648389 ncdv-master-1 devstack@n-api.service[140491]: Neutron server returns request_ids: ['req-6026126b-25ab-491f-97b5-2a634a64b252'] Oct 08 20:57:05.651724 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-67946bbe-b700-4fff-9385-2b1b58a5f619 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Request method failure captured: Oct 08 20:57:05.651724 ncdv-master-1 devstack@n-api.service[140491]: request: GET /compute/v2.1/os-security-groups/1c40ec60-bc42-4b10-b1ba-cf2aeffdedae HTTP/1.1 Oct 08 20:57:05.651724 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 20:57:05.651724 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 20:57:05.651724 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 20:57:05.651724 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 20:57:05.651724 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 20:57:05.651724 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 20:57:05.651724 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 20:57:05.651724 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 20:57:05.651724 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQePneH9r8wc6qFHuuUfUiwj20bfGS3ReCozGKtofTKF_Bibv-TeYrNnDr89OwEeHkYGW8sVcZZerG8KfPs5hnyFWI91x_kPrSGVuiWEZNP0tyGW3_Xh9-fgTNjxnIFiLidb-EHCBZb3EEyAGFqy03GkbophorT5sYui55pNleytp26U Oct 08 20:57:05.651724 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 20:57:05.651724 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 20:57:05.651724 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 20:57:05.651724 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 20:57:05.651724 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 20:57:05.651724 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 20:57:05.651724 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 1be94d02ab5244f98337fb9b90e74746 Oct 08 20:57:05.651724 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-SecurityGroupsTestJSON-1416879597 Oct 08 20:57:05.651724 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 20:57:05.651724 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 20:57:05.651724 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1be94d02ab5244f98337fb9b90e74746"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1be94d02ab5244f98337fb9b90e74746"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1be94d02ab5244f98337fb9b90e74746"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1be94d02ab5244f98337fb9b90e74746"}]}] Oct 08 20:57:05.651724 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-SecurityGroupsTestJSON-1416879597 Oct 08 20:57:05.651724 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 1be94d02ab5244f98337fb9b90e74746 Oct 08 20:57:05.651724 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1416879597 Oct 08 20:57:05.651724 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-SecurityGroupsTestJSON-1416879597-project Oct 08 20:57:05.651724 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 20:57:05.651724 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 20:57:05.651724 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 5ac1323815364df4a3a4d4dbbb9d70dd Oct 08 20:57:05.651724 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-SecurityGroupsTestJSON-1416879597-project Oct 08 20:57:05.651724 ncdv-master-1 devstack@n-api.service[140491]: method: Oct 08 20:57:05.651724 ncdv-master-1 devstack@n-api.service[140491]: exception: Security group 1c40ec60-bc42-4b10-b1ba-cf2aeffdedae does not exist Oct 08 20:57:05.651724 ncdv-master-1 devstack@n-api.service[140491]: Neutron server returns request_ids: ['req-6026126b-25ab-491f-97b5-2a634a64b252'] Oct 08 20:57:05.651724 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': '1c40ec60-bc42-4b10-b1ba-cf2aeffdedae'} Oct 08 20:57:05.651724 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:57:05.651724 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:57:05.651724 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 08 20:57:05.651724 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 08 20:57:05.651724 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 08 20:57:05.651724 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 08 20:57:05.651724 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 08 20:57:05.651724 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 08 20:57:05.651724 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 08 20:57:05.651724 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 08 20:57:05.651724 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 08 20:57:05.651724 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 08 20:57:05.651724 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 08 20:57:05.651724 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 08 20:57:05.651724 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 08 20:57:05.651724 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 08 20:57:05.651724 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 08 20:57:05.651724 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 08 20:57:05.651724 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 08 20:57:05.651724 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 08 20:57:05.651724 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 08 20:57:05.651724 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 08 20:57:05.651724 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 08 20:57:05.651724 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 08 20:57:05.651724 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 08 20:57:05.651724 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 08 20:57:05.651724 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 1c40ec60-bc42-4b10-b1ba-cf2aeffdedae does not exist Oct 08 20:57:05.655746 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6026126b-25ab-491f-97b5-2a634a64b252'] Oct 08 20:57:05.655746 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:57:05.655746 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:57:05.655746 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:57:05.655746 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:57:05.655746 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 08 20:57:05.655746 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 08 20:57:05.655746 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 08 20:57:05.655746 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 08 20:57:05.655746 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 1c40ec60-bc42-4b10-b1ba-cf2aeffdedae does not exist Oct 08 20:57:05.655746 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6026126b-25ab-491f-97b5-2a634a64b252'] Oct 08 20:57:05.655746 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:57:05.655746 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:57:05.655746 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:57:05.655746 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:57:05.655746 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:57:05.655746 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:57:05.655746 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:57:05.655746 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:57:05.655746 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 08 20:57:05.655746 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 08 20:57:05.655746 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:57:05.655746 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:57:05.655746 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 08 20:57:05.655746 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 08 20:57:05.655746 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 1c40ec60-bc42-4b10-b1ba-cf2aeffdedae does not exist Oct 08 20:57:05.655746 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6026126b-25ab-491f-97b5-2a634a64b252'] Oct 08 20:57:05.655746 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:57:05.655746 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:57:05.655746 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:57:05.655746 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:57:05.655746 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:57:05.655746 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:57:05.655746 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 20:57:05.655746 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 20:57:05.655746 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 1c40ec60-bc42-4b10-b1ba-cf2aeffdedae does not exist Oct 08 20:57:05.655746 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6026126b-25ab-491f-97b5-2a634a64b252'] Oct 08 20:57:05.655746 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:57:05.655746 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-67946bbe-b700-4fff-9385-2b1b58a5f619 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Returning 404 to user: Security group 1c40ec60-bc42-4b10-b1ba-cf2aeffdedae does not exist Oct 08 20:57:05.655746 ncdv-master-1 devstack@n-api.service[140491]: Neutron server returns request_ids: ['req-6026126b-25ab-491f-97b5-2a634a64b252'] {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:57:05.664977 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-67946bbe-b700-4fff-9385-2b1b58a5f619 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] 10.222.0.26 "GET /compute/v2.1/os-security-groups/1c40ec60-bc42-4b10-b1ba-cf2aeffdedae" status: 404 len: 194 microversion: 2.1 time: 0.113573 Oct 08 20:57:05.664977 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 676/1398] 10.222.0.26 () {58 vars in 1269 bytes} [Sat Oct 8 20:57:05 2022] GET /compute/v2.1/os-security-groups/1c40ec60-bc42-4b10-b1ba-cf2aeffdedae => generated 194 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 20:57:05.668665 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-bc00d558-df2b-4de9-9ad6-db622873f589 tempest-KeyPairsV2TestJSON-1686182842 tempest-KeyPairsV2TestJSON-1686182842-project] Action: 'create', calling method: .version_select at 0x7f1a8ca3bdc0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-80812961", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHtC1Srq/jO0vkheNxKve2PzIvv3RprtnbJflU8RpOztS1u1J/SluqVFZIu6vo6r4CtY3E2pNFn4G+VAh8gGHhvdfRNAIFR8DMk1wr8DBgC5JDHC6RtXnhHgre3NFjkarQ=="}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:57:05.688900 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-bc00d558-df2b-4de9-9ad6-db622873f589 tempest-KeyPairsV2TestJSON-1686182842 tempest-KeyPairsV2TestJSON-1686182842-project] Getting quotas for project 14d8376dc21744b6b8592e7373367b74. Resources: {'key_pairs'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 20:57:05.698443 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-bc00d558-df2b-4de9-9ad6-db622873f589 tempest-KeyPairsV2TestJSON-1686182842 tempest-KeyPairsV2TestJSON-1686182842-project] Getting quotas for user 6e30edb713e5441ea615922db8ba8c9c and project 14d8376dc21744b6b8592e7373367b74. Resources: {'key_pairs'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 20:57:05.763196 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-bc00d558-df2b-4de9-9ad6-db622873f589 tempest-KeyPairsV2TestJSON-1686182842 tempest-KeyPairsV2TestJSON-1686182842-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.099537 Oct 08 20:57:05.763958 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 677/1399] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Oct 8 20:57:05 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:57:05.772236 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-031d8166-410b-4c69-aaf0-a11e51f930f7 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Calling method '.version_select at 0x7f1a8c7b0820>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:05.777299 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-031d8166-410b-4c69-aaf0-a11e51f930f7 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:05.777889 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-031d8166-410b-4c69-aaf0-a11e51f930f7 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:05.778596 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-031d8166-410b-4c69-aaf0-a11e51f930f7 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:05.792830 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-031d8166-410b-4c69-aaf0-a11e51f930f7 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] 10.222.0.26 "GET /compute/v2.1/os-migrations" status: 200 len: 2536 microversion: 2.25 time: 0.027342 Oct 08 20:57:05.793877 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 678/1400] 10.222.0.26 () {60 vars in 1184 bytes} [Sat Oct 8 20:57:05 2022] GET /compute/v2.1/os-migrations => generated 2536 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:57:05.803098 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-ef934f3d-c1a8-4c8f-8b38-a365bd341a6e tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:05.804084 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-ef934f3d-c1a8-4c8f-8b38-a365bd341a6e tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] [instance: c2250e42-ea12-4161-8558-cba54fd9b4a8] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:05.812600 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ef934f3d-c1a8-4c8f-8b38-a365bd341a6e tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:05.813752 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ef934f3d-c1a8-4c8f-8b38-a365bd341a6e tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:05.814454 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ef934f3d-c1a8-4c8f-8b38-a365bd341a6e tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:05.815450 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ef934f3d-c1a8-4c8f-8b38-a365bd341a6e tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:05.816161 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ef934f3d-c1a8-4c8f-8b38-a365bd341a6e tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:05.816819 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ef934f3d-c1a8-4c8f-8b38-a365bd341a6e tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:06.071204 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-5d4c01cf-0520-4030-8853-ae9fb6cd3fc4 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:06.088048 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-5d4c01cf-0520-4030-8853-ae9fb6cd3fc4 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:06.090656 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-5d4c01cf-0520-4030-8853-ae9fb6cd3fc4 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:06.092042 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-5d4c01cf-0520-4030-8853-ae9fb6cd3fc4 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] 10.222.0.26 "GET /compute/v2.1/servers/ceced78a-58d9-4175-b4fe-0d085be62c94" status: 200 len: 1874 microversion: 2.42 time: 0.935253 Oct 08 20:57:06.093170 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 723/1401] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:57:05 2022] GET /compute/v2.1/servers/ceced78a-58d9-4175-b4fe-0d085be62c94 => generated 1874 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:57:06.099355 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-2514127e-68b8-4a01-a335-75f7e054e2d4 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Calling method '.version_select at 0x7f1a91312700>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:06.190906 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-ef934f3d-c1a8-4c8f-8b38-a365bd341a6e tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05f0f7a60257437eaa8702b664916979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7550f7ad9dc45ba9c9bfb0a5a11a774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:06.202264 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-ef934f3d-c1a8-4c8f-8b38-a365bd341a6e tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] 10.222.0.26 "GET /compute/v2.1/servers/c2250e42-ea12-4161-8558-cba54fd9b4a8" status: 200 len: 1319 microversion: 2.1 time: 0.406118 Oct 08 20:57:06.203046 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 679/1402] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:57:05 2022] GET /compute/v2.1/servers/c2250e42-ea12-4161-8558-cba54fd9b4a8 => generated 1319 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:57:06.216569 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-cf65da23-792a-4a17-877c-990a424392b9 tempest-KeyPairsV2TestJSON-1686182842 tempest-KeyPairsV2TestJSON-1686182842-project] Calling method '.version_select at 0x7f1a8cd84ee0>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:06.229544 ncdv-master-1 devstack@n-api.service[140491]: WARNING oslo_db.sqlalchemy.utils [None req-cf65da23-792a-4a17-877c-990a424392b9 tempest-KeyPairsV2TestJSON-1686182842 tempest-KeyPairsV2TestJSON-1686182842-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 08 20:57:06.236803 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-cf65da23-792a-4a17-877c-990a424392b9 tempest-KeyPairsV2TestJSON-1686182842 tempest-KeyPairsV2TestJSON-1686182842-project] 10.222.0.26 "GET /compute/v2.1/os-keypairs" status: 200 len: 1091 microversion: 2.1 time: 0.032467 Oct 08 20:57:06.243890 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 680/1403] 10.222.0.26 () {58 vars in 1137 bytes} [Sat Oct 8 20:57:06 2022] GET /compute/v2.1/os-keypairs => generated 1091 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:57:06.243890 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-f14d04af-494f-48b6-a1a7-4185b9c3a880 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:06.243890 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-f14d04af-494f-48b6-a1a7-4185b9c3a880 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] [instance: 57016fcf-2d2c-488c-9af6-0530ebc199f6] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:06.250441 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f14d04af-494f-48b6-a1a7-4185b9c3a880 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:06.250936 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f14d04af-494f-48b6-a1a7-4185b9c3a880 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:06.251378 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f14d04af-494f-48b6-a1a7-4185b9c3a880 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:06.252507 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f14d04af-494f-48b6-a1a7-4185b9c3a880 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:06.252824 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f14d04af-494f-48b6-a1a7-4185b9c3a880 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:06.253283 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f14d04af-494f-48b6-a1a7-4185b9c3a880 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:06.560036 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-2514127e-68b8-4a01-a335-75f7e054e2d4 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] 10.222.0.26 "GET /compute/v2.1/os-security-groups" status: 200 len: 1156 microversion: 2.1 time: 0.465326 Oct 08 20:57:06.561543 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 724/1404] 10.222.0.26 () {58 vars in 1158 bytes} [Sat Oct 8 20:57:06 2022] GET /compute/v2.1/os-security-groups => generated 1156 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:57:06.567059 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-adaa5640-32dc-4227-88d0-e4eecb330da2 tempest-KeyPairsV2TestJSON-1686182842 tempest-KeyPairsV2TestJSON-1686182842-project] Calling method '.version_select at 0x7f1a914653a0>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:06.594322 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-adaa5640-32dc-4227-88d0-e4eecb330da2 tempest-KeyPairsV2TestJSON-1686182842 tempest-KeyPairsV2TestJSON-1686182842-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-80812961" status: 202 len: 0 microversion: 2.1 time: 0.031194 Oct 08 20:57:06.595808 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 725/1405] 10.222.0.26 () {58 vars in 1272 bytes} [Sat Oct 8 20:57:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-80812961 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 20:57:06.602310 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-a98e7b74-b38c-49a0-878d-488608a41d52 req-7f863305-1489-407c-b8ab-cf8f3706ef79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ceced78a-58d9-4175-b4fe-0d085be62c94", "tag": "f16f4042-95b4-4dfa-afa7-41b0147a6cf2"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:57:06.620461 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-a98e7b74-b38c-49a0-878d-488608a41d52 req-7f863305-1489-407c-b8ab-cf8f3706ef79 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:06.621631 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-a98e7b74-b38c-49a0-878d-488608a41d52 req-7f863305-1489-407c-b8ab-cf8f3706ef79 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:06.622322 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-a98e7b74-b38c-49a0-878d-488608a41d52 req-7f863305-1489-407c-b8ab-cf8f3706ef79 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:06.640010 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-a98e7b74-b38c-49a0-878d-488608a41d52 req-7f863305-1489-407c-b8ab-cf8f3706ef79 service nova] Creating event network-changed:f16f4042-95b4-4dfa-afa7-41b0147a6cf2 for instance ceced78a-58d9-4175-b4fe-0d085be62c94 on nch2-master-1 Oct 08 20:57:06.648250 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-a98e7b74-b38c-49a0-878d-488608a41d52 req-7f863305-1489-407c-b8ab-cf8f3706ef79 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050199 Oct 08 20:57:06.649490 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 726/1406] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:57:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:57:06.658870 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e54ca2de-17e3-47c4-909e-25453f19702f tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:06.659829 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-e54ca2de-17e3-47c4-909e-25453f19702f tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] [instance: e2d1c93f-8392-4f67-a29e-05164828f9d8] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:06.668821 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e54ca2de-17e3-47c4-909e-25453f19702f tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:06.669612 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e54ca2de-17e3-47c4-909e-25453f19702f tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:06.670242 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e54ca2de-17e3-47c4-909e-25453f19702f tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:06.671377 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e54ca2de-17e3-47c4-909e-25453f19702f tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:06.672009 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e54ca2de-17e3-47c4-909e-25453f19702f tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:06.672446 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e54ca2de-17e3-47c4-909e-25453f19702f tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:06.725156 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.objects.instance [None req-f14d04af-494f-48b6-a1a7-4185b9c3a880 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Lazy-loading 'services' on Instance uuid 57016fcf-2d2c-488c-9af6-0530ebc199f6 {{(pid=140491) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 20:57:06.741080 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-f14d04af-494f-48b6-a1a7-4185b9c3a880 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/57016fcf-2d2c-488c-9af6-0530ebc199f6" status: 200 len: 2423 microversion: 2.25 time: 0.502183 Oct 08 20:57:06.746330 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 681/1407] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:57:06 2022] GET /compute/v2.1/servers/57016fcf-2d2c-488c-9af6-0530ebc199f6 => generated 2423 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:57:06.751459 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-fdea4c38-b768-45ee-aee6-6743b2f105d0 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Action: 'create', calling method: .version_select at 0x7f1a8cc82af0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-85711288", "description": "tempest-description-442850699"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:57:06.863945 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-e54ca2de-17e3-47c4-909e-25453f19702f tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474ca64d1b1d4e30916b517645aba882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecc2dd2407b4819874bed09cb27959a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:06.873672 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-e54ca2de-17e3-47c4-909e-25453f19702f tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d1c93f-8392-4f67-a29e-05164828f9d8" status: 200 len: 1198 microversion: 2.1 time: 0.221845 Oct 08 20:57:06.874254 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 727/1408] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:57:06 2022] GET /compute/v2.1/servers/e2d1c93f-8392-4f67-a29e-05164828f9d8 => generated 1198 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:57:06.879585 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-349c2e88-f24f-486c-b1fc-b6aa6e0632bf tempest-KeyPairsV2TestJSON-1686182842 tempest-KeyPairsV2TestJSON-1686182842-project] Calling method '.version_select at 0x7f1a913514c0>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:06.902745 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-349c2e88-f24f-486c-b1fc-b6aa6e0632bf tempest-KeyPairsV2TestJSON-1686182842 tempest-KeyPairsV2TestJSON-1686182842-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-489911074" status: 202 len: 0 microversion: 2.1 time: 0.027143 Oct 08 20:57:06.903692 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 728/1409] 10.222.0.26 () {58 vars in 1275 bytes} [Sat Oct 8 20:57:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-489911074 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 20:57:06.909069 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-c2a2c48e-65cd-46aa-9bc1-622002829562 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:06.909908 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-c2a2c48e-65cd-46aa-9bc1-622002829562 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] [instance: 57016fcf-2d2c-488c-9af6-0530ebc199f6] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:06.916681 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c2a2c48e-65cd-46aa-9bc1-622002829562 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:06.917174 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c2a2c48e-65cd-46aa-9bc1-622002829562 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:06.917655 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c2a2c48e-65cd-46aa-9bc1-622002829562 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:06.918361 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c2a2c48e-65cd-46aa-9bc1-622002829562 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:06.918823 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c2a2c48e-65cd-46aa-9bc1-622002829562 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:06.919282 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c2a2c48e-65cd-46aa-9bc1-622002829562 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:07.062461 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.objects.instance [None req-c2a2c48e-65cd-46aa-9bc1-622002829562 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Lazy-loading 'services' on Instance uuid 57016fcf-2d2c-488c-9af6-0530ebc199f6 {{(pid=140492) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 20:57:07.079724 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-c2a2c48e-65cd-46aa-9bc1-622002829562 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/57016fcf-2d2c-488c-9af6-0530ebc199f6" status: 200 len: 2423 microversion: 2.25 time: 0.174580 Oct 08 20:57:07.080572 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 729/1410] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:57:06 2022] GET /compute/v2.1/servers/57016fcf-2d2c-488c-9af6-0530ebc199f6 => generated 2423 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:57:07.085513 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-140d056c-bd11-46e8-aedd-fa11343c4869 tempest-KeyPairsV2TestJSON-1686182842 tempest-KeyPairsV2TestJSON-1686182842-project] Calling method '.version_select at 0x7f1a91465310>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:07.110068 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-140d056c-bd11-46e8-aedd-fa11343c4869 tempest-KeyPairsV2TestJSON-1686182842 tempest-KeyPairsV2TestJSON-1686182842-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1192584086" status: 202 len: 0 microversion: 2.1 time: 0.027923 Oct 08 20:57:07.111969 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 730/1411] 10.222.0.26 () {58 vars in 1278 bytes} [Sat Oct 8 20:57:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1192584086 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 20:57:07.124902 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-4108fa7c-1a40-4f03-b189-0c6b7eda5432 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:07.125926 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-4108fa7c-1a40-4f03-b189-0c6b7eda5432 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] [instance: ceced78a-58d9-4175-b4fe-0d085be62c94] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:07.135286 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4108fa7c-1a40-4f03-b189-0c6b7eda5432 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:07.136193 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4108fa7c-1a40-4f03-b189-0c6b7eda5432 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:07.136876 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4108fa7c-1a40-4f03-b189-0c6b7eda5432 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:07.137981 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4108fa7c-1a40-4f03-b189-0c6b7eda5432 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:07.138674 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4108fa7c-1a40-4f03-b189-0c6b7eda5432 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:07.139387 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4108fa7c-1a40-4f03-b189-0c6b7eda5432 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:07.369640 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-4108fa7c-1a40-4f03-b189-0c6b7eda5432 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:07.379208 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-4108fa7c-1a40-4f03-b189-0c6b7eda5432 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:07.381767 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-4108fa7c-1a40-4f03-b189-0c6b7eda5432 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:07.383201 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-4108fa7c-1a40-4f03-b189-0c6b7eda5432 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] 10.222.0.26 "GET /compute/v2.1/servers/ceced78a-58d9-4175-b4fe-0d085be62c94" status: 200 len: 1874 microversion: 2.42 time: 0.263828 Oct 08 20:57:07.384281 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 731/1412] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:57:07 2022] GET /compute/v2.1/servers/ceced78a-58d9-4175-b4fe-0d085be62c94 => generated 1874 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:57:07.389663 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-f522afc5-a7fc-42a5-b94e-2cc1b571b82a tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:07.390572 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-f522afc5-a7fc-42a5-b94e-2cc1b571b82a tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] [instance: 57016fcf-2d2c-488c-9af6-0530ebc199f6] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:07.399066 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f522afc5-a7fc-42a5-b94e-2cc1b571b82a tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:07.402159 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f522afc5-a7fc-42a5-b94e-2cc1b571b82a tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:07.402891 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f522afc5-a7fc-42a5-b94e-2cc1b571b82a tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:07.403893 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f522afc5-a7fc-42a5-b94e-2cc1b571b82a tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:07.405048 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f522afc5-a7fc-42a5-b94e-2cc1b571b82a tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:07.409058 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f522afc5-a7fc-42a5-b94e-2cc1b571b82a tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:07.592865 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.objects.instance [None req-f522afc5-a7fc-42a5-b94e-2cc1b571b82a tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lazy-loading 'services' on Instance uuid 57016fcf-2d2c-488c-9af6-0530ebc199f6 {{(pid=140492) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 20:57:07.740604 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-f522afc5-a7fc-42a5-b94e-2cc1b571b82a tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] 10.222.0.26 "DELETE /compute/v2.1/servers/57016fcf-2d2c-488c-9af6-0530ebc199f6/os-volume_attachments/b0c11645-2e47-4de8-8a67-b49a20d9fe3e" status: 202 len: 0 microversion: 2.25 time: 0.353661 Oct 08 20:57:07.745988 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 732/1413] 10.222.0.26 () {60 vars in 1457 bytes} [Sat Oct 8 20:57:07 2022] DELETE /compute/v2.1/servers/57016fcf-2d2c-488c-9af6-0530ebc199f6/os-volume_attachments/b0c11645-2e47-4de8-8a67-b49a20d9fe3e => generated 0 bytes in 361 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 08 20:57:07.755332 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-dc47a994-d74c-42dd-a95d-368ad16cec64 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:07.757322 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-dc47a994-d74c-42dd-a95d-368ad16cec64 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] [instance: c2250e42-ea12-4161-8558-cba54fd9b4a8] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:07.768958 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dc47a994-d74c-42dd-a95d-368ad16cec64 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:07.771332 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dc47a994-d74c-42dd-a95d-368ad16cec64 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:07.771332 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dc47a994-d74c-42dd-a95d-368ad16cec64 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:07.771866 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dc47a994-d74c-42dd-a95d-368ad16cec64 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:07.773056 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dc47a994-d74c-42dd-a95d-368ad16cec64 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:07.785750 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dc47a994-d74c-42dd-a95d-368ad16cec64 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:08.062313 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-dc47a994-d74c-42dd-a95d-368ad16cec64 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05f0f7a60257437eaa8702b664916979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7550f7ad9dc45ba9c9bfb0a5a11a774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:08.072776 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-dc47a994-d74c-42dd-a95d-368ad16cec64 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] 10.222.0.26 "GET /compute/v2.1/servers/c2250e42-ea12-4161-8558-cba54fd9b4a8" status: 200 len: 1319 microversion: 2.1 time: 0.324671 Oct 08 20:57:08.085210 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 733/1414] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:57:07 2022] GET /compute/v2.1/servers/c2250e42-ea12-4161-8558-cba54fd9b4a8 => generated 1319 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:57:08.085210 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-4faaddf9-00ba-49f4-acc6-eef527d3561b tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:08.085210 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-4faaddf9-00ba-49f4-acc6-eef527d3561b tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] [instance: 57016fcf-2d2c-488c-9af6-0530ebc199f6] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:08.088110 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4faaddf9-00ba-49f4-acc6-eef527d3561b tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:08.088397 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4faaddf9-00ba-49f4-acc6-eef527d3561b tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:08.091903 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4faaddf9-00ba-49f4-acc6-eef527d3561b tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:08.091903 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4faaddf9-00ba-49f4-acc6-eef527d3561b tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:08.091903 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4faaddf9-00ba-49f4-acc6-eef527d3561b tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:08.091903 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4faaddf9-00ba-49f4-acc6-eef527d3561b tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:08.128664 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-4faaddf9-00ba-49f4-acc6-eef527d3561b tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] 10.222.0.26 "GET /compute/v2.1/servers/57016fcf-2d2c-488c-9af6-0530ebc199f6/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.053810 Oct 08 20:57:08.133856 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 734/1415] 10.222.0.26 () {60 vars in 1343 bytes} [Sat Oct 8 20:57:08 2022] GET /compute/v2.1/servers/57016fcf-2d2c-488c-9af6-0530ebc199f6/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 08 20:57:08.305641 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-fdea4c38-b768-45ee-aee6-6743b2f105d0 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] 10.222.0.26 "POST /compute/v2.1/os-security-groups" status: 200 len: 241 microversion: 2.1 time: 1.557794 Oct 08 20:57:08.306189 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-cf3b8bbe-10fb-4501-b576-87c1a3f8531e req-3bab2125-bba0-42d9-8266-4f150827ff0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2250e42-ea12-4161-8558-cba54fd9b4a8", "name": "network-vif-plugged", "status": "completed", "tag": "f4fea469-74e9-4150-8b0e-63b451dd80ed"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:57:08.307608 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 682/1416] 10.222.0.26 () {60 vars in 1180 bytes} [Sat Oct 8 20:57:06 2022] POST /compute/v2.1/os-security-groups => generated 241 bytes in 1560 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:57:08.313511 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-a75fdf4d-5167-44d1-81ca-4c873b33c2d1 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:08.314210 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-a75fdf4d-5167-44d1-81ca-4c873b33c2d1 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] [instance: e2d1c93f-8392-4f67-a29e-05164828f9d8] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:08.327052 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-cf3b8bbe-10fb-4501-b576-87c1a3f8531e req-3bab2125-bba0-42d9-8266-4f150827ff0f service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:08.330241 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-cf3b8bbe-10fb-4501-b576-87c1a3f8531e req-3bab2125-bba0-42d9-8266-4f150827ff0f service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:08.331052 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-cf3b8bbe-10fb-4501-b576-87c1a3f8531e req-3bab2125-bba0-42d9-8266-4f150827ff0f service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:08.360594 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a75fdf4d-5167-44d1-81ca-4c873b33c2d1 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:08.361884 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-cf3b8bbe-10fb-4501-b576-87c1a3f8531e req-3bab2125-bba0-42d9-8266-4f150827ff0f service nova] Creating event network-vif-plugged:f4fea469-74e9-4150-8b0e-63b451dd80ed for instance c2250e42-ea12-4161-8558-cba54fd9b4a8 on nch2-master-1 Oct 08 20:57:08.362282 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a75fdf4d-5167-44d1-81ca-4c873b33c2d1 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:08.364388 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a75fdf4d-5167-44d1-81ca-4c873b33c2d1 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:08.366603 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a75fdf4d-5167-44d1-81ca-4c873b33c2d1 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:08.368170 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a75fdf4d-5167-44d1-81ca-4c873b33c2d1 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:08.370488 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-cf3b8bbe-10fb-4501-b576-87c1a3f8531e req-3bab2125-bba0-42d9-8266-4f150827ff0f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.239988 Oct 08 20:57:08.370934 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a75fdf4d-5167-44d1-81ca-4c873b33c2d1 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:08.371804 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 735/1417] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:57:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:57:08.400923 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-30b4d7eb-e8c8-4ec0-b0b7-e57c033be73f tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Action: 'create', calling method: .version_select at 0x7f1a91334af0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1509904025", "description": "tempest-description-861214142"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:57:08.760403 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-30b4d7eb-e8c8-4ec0-b0b7-e57c033be73f tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] 10.222.0.26 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.387080 Oct 08 20:57:08.761015 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 736/1418] 10.222.0.26 () {60 vars in 1180 bytes} [Sat Oct 8 20:57:08 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:57:08.780746 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-cbd7228e-0498-4f7b-9d4c-615ebb54d662 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:08.782098 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-cbd7228e-0498-4f7b-9d4c-615ebb54d662 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] [instance: ceced78a-58d9-4175-b4fe-0d085be62c94] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:08.789575 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cbd7228e-0498-4f7b-9d4c-615ebb54d662 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:08.790303 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cbd7228e-0498-4f7b-9d4c-615ebb54d662 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:08.791724 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cbd7228e-0498-4f7b-9d4c-615ebb54d662 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:08.792641 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cbd7228e-0498-4f7b-9d4c-615ebb54d662 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:08.793506 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cbd7228e-0498-4f7b-9d4c-615ebb54d662 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:08.794156 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cbd7228e-0498-4f7b-9d4c-615ebb54d662 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:09.018600 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-a75fdf4d-5167-44d1-81ca-4c873b33c2d1 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474ca64d1b1d4e30916b517645aba882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecc2dd2407b4819874bed09cb27959a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:09.034461 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-a75fdf4d-5167-44d1-81ca-4c873b33c2d1 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d1c93f-8392-4f67-a29e-05164828f9d8" status: 200 len: 1198 microversion: 2.1 time: 0.725548 Oct 08 20:57:09.036928 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 683/1419] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:57:08 2022] GET /compute/v2.1/servers/e2d1c93f-8392-4f67-a29e-05164828f9d8 => generated 1198 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:57:09.059883 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-b794222a-40a1-422f-8528-2904cc76ffa2 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1348353032", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "networks": [{"uuid": "9fdcecee-d5a8-47c6-bd1b-3fe31d36b4f7"}]}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:57:09.073358 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-cbd7228e-0498-4f7b-9d4c-615ebb54d662 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:09.082951 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-cbd7228e-0498-4f7b-9d4c-615ebb54d662 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:09.084427 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-cbd7228e-0498-4f7b-9d4c-615ebb54d662 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:09.085968 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-cbd7228e-0498-4f7b-9d4c-615ebb54d662 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] 10.222.0.26 "GET /compute/v2.1/servers/ceced78a-58d9-4175-b4fe-0d085be62c94" status: 200 len: 1874 microversion: 2.42 time: 0.309353 Oct 08 20:57:09.097728 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 737/1420] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:57:08 2022] GET /compute/v2.1/servers/ceced78a-58d9-4175-b4fe-0d085be62c94 => generated 1874 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:57:09.119510 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-7e104bad-9d37-4ac8-967a-eb51e9b59f7c tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:09.120140 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-7e104bad-9d37-4ac8-967a-eb51e9b59f7c tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] [instance: c2250e42-ea12-4161-8558-cba54fd9b4a8] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:09.127602 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7e104bad-9d37-4ac8-967a-eb51e9b59f7c tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:09.128110 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7e104bad-9d37-4ac8-967a-eb51e9b59f7c tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:09.128567 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7e104bad-9d37-4ac8-967a-eb51e9b59f7c tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:09.129331 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7e104bad-9d37-4ac8-967a-eb51e9b59f7c tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:09.129806 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7e104bad-9d37-4ac8-967a-eb51e9b59f7c tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:09.130245 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7e104bad-9d37-4ac8-967a-eb51e9b59f7c tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:09.132055 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.network.neutron [None req-b794222a-40a1-422f-8528-2904cc76ffa2 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] validate_networks() for [('9fdcecee-d5a8-47c6-bd1b-3fe31d36b4f7', None, None, None, None, None)] {{(pid=140491) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 20:57:09.415650 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-7e104bad-9d37-4ac8-967a-eb51e9b59f7c tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05f0f7a60257437eaa8702b664916979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7550f7ad9dc45ba9c9bfb0a5a11a774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:09.437307 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-7e104bad-9d37-4ac8-967a-eb51e9b59f7c tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] 10.222.0.26 "GET /compute/v2.1/servers/c2250e42-ea12-4161-8558-cba54fd9b4a8" status: 200 len: 1319 microversion: 2.1 time: 0.338425 Oct 08 20:57:09.438508 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 738/1421] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:57:09 2022] GET /compute/v2.1/servers/c2250e42-ea12-4161-8558-cba54fd9b4a8 => generated 1319 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:57:09.443926 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e0418634-5f2a-4203-ae08-a867d18d7489 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:09.447612 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-e0418634-5f2a-4203-ae08-a867d18d7489 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] [instance: 57016fcf-2d2c-488c-9af6-0530ebc199f6] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:09.454961 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e0418634-5f2a-4203-ae08-a867d18d7489 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:09.455702 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e0418634-5f2a-4203-ae08-a867d18d7489 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:09.456383 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e0418634-5f2a-4203-ae08-a867d18d7489 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:09.457444 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e0418634-5f2a-4203-ae08-a867d18d7489 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:09.458102 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e0418634-5f2a-4203-ae08-a867d18d7489 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:09.458729 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e0418634-5f2a-4203-ae08-a867d18d7489 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:09.495950 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-e0418634-5f2a-4203-ae08-a867d18d7489 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] 10.222.0.26 "GET /compute/v2.1/servers/57016fcf-2d2c-488c-9af6-0530ebc199f6/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.056075 Oct 08 20:57:09.496546 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 739/1422] 10.222.0.26 () {60 vars in 1343 bytes} [Sat Oct 8 20:57:09 2022] GET /compute/v2.1/servers/57016fcf-2d2c-488c-9af6-0530ebc199f6/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:57:09.638671 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-aa6927a3-8133-48c7-b9be-da078f2d4447 req-f34eb1ec-7c21-42e7-8b90-0eadfdfcc474 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2d1c93f-8392-4f67-a29e-05164828f9d8", "tag": "1efef783-bf7f-44d9-bb48-aa0b771e72b2"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:57:09.671856 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-aa6927a3-8133-48c7-b9be-da078f2d4447 req-f34eb1ec-7c21-42e7-8b90-0eadfdfcc474 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:09.672404 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-aa6927a3-8133-48c7-b9be-da078f2d4447 req-f34eb1ec-7c21-42e7-8b90-0eadfdfcc474 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:09.672854 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-aa6927a3-8133-48c7-b9be-da078f2d4447 req-f34eb1ec-7c21-42e7-8b90-0eadfdfcc474 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:09.689344 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-aa6927a3-8133-48c7-b9be-da078f2d4447 req-f34eb1ec-7c21-42e7-8b90-0eadfdfcc474 service nova] Creating event network-changed:1efef783-bf7f-44d9-bb48-aa0b771e72b2 for instance e2d1c93f-8392-4f67-a29e-05164828f9d8 on nch1-master-1 Oct 08 20:57:09.697023 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-aa6927a3-8133-48c7-b9be-da078f2d4447 req-f34eb1ec-7c21-42e7-8b90-0eadfdfcc474 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060514 Oct 08 20:57:09.697635 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 740/1423] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:57:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 08 20:57:10.061821 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-c4622e3b-e595-4a90-9490-614df0087537 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:10.062785 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-c4622e3b-e595-4a90-9490-614df0087537 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] [instance: e2d1c93f-8392-4f67-a29e-05164828f9d8] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:10.071922 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c4622e3b-e595-4a90-9490-614df0087537 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:10.072558 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c4622e3b-e595-4a90-9490-614df0087537 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:10.073354 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c4622e3b-e595-4a90-9490-614df0087537 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:10.074769 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c4622e3b-e595-4a90-9490-614df0087537 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:10.075399 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c4622e3b-e595-4a90-9490-614df0087537 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:10.075969 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c4622e3b-e595-4a90-9490-614df0087537 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:10.489109 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-c4622e3b-e595-4a90-9490-614df0087537 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474ca64d1b1d4e30916b517645aba882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecc2dd2407b4819874bed09cb27959a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:10.494290 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=2 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:57:10.515544 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-c4622e3b-e595-4a90-9490-614df0087537 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d1c93f-8392-4f67-a29e-05164828f9d8" status: 200 len: 1198 microversion: 2.1 time: 0.459149 Oct 08 20:57:10.518152 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 741/1424] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:57:10 2022] GET /compute/v2.1/servers/e2d1c93f-8392-4f67-a29e-05164828f9d8 => generated 1198 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:57:10.527181 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e6bf16b0-ae4f-4ab9-a099-2e2ab29dca50 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:10.529441 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-e6bf16b0-ae4f-4ab9-a099-2e2ab29dca50 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] [instance: ceced78a-58d9-4175-b4fe-0d085be62c94] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:10.542628 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e6bf16b0-ae4f-4ab9-a099-2e2ab29dca50 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:10.545169 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e6bf16b0-ae4f-4ab9-a099-2e2ab29dca50 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:10.547494 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e6bf16b0-ae4f-4ab9-a099-2e2ab29dca50 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:10.548527 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e6bf16b0-ae4f-4ab9-a099-2e2ab29dca50 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:10.550642 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e6bf16b0-ae4f-4ab9-a099-2e2ab29dca50 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:10.551276 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e6bf16b0-ae4f-4ab9-a099-2e2ab29dca50 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:11.069990 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-b794222a-40a1-422f-8528-2904cc76ffa2 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Flavor limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 20:57:11.070653 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-b794222a-40a1-422f-8528-2904cc76ffa2 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Image limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 20:57:11.071130 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-b794222a-40a1-422f-8528-2904cc76ffa2 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Flavor pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 20:57:11.071716 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-b794222a-40a1-422f-8528-2904cc76ffa2 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Image pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 20:57:11.072300 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-b794222a-40a1-422f-8528-2904cc76ffa2 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 20:57:11.091550 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b794222a-40a1-422f-8528-2904cc76ffa2 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:11.093244 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b794222a-40a1-422f-8528-2904cc76ffa2 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:11.094613 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b794222a-40a1-422f-8528-2904cc76ffa2 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:11.095574 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b794222a-40a1-422f-8528-2904cc76ffa2 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:11.096492 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b794222a-40a1-422f-8528-2904cc76ffa2 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:11.097319 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b794222a-40a1-422f-8528-2904cc76ffa2 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:11.126254 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-b794222a-40a1-422f-8528-2904cc76ffa2 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Getting quotas for project 1be94d02ab5244f98337fb9b90e74746. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 20:57:11.143827 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-b794222a-40a1-422f-8528-2904cc76ffa2 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Getting quotas for user 5ac1323815364df4a3a4d4dbbb9d70dd and project 1be94d02ab5244f98337fb9b90e74746. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 20:57:11.163042 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-b794222a-40a1-422f-8528-2904cc76ffa2 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Going to run 1 instances... {{(pid=140491) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 20:57:11.166114 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-b794222a-40a1-422f-8528-2904cc76ffa2 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] [instance: 24d7af5b-10ba-4df7-a95d-bcd0b2104f37] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c508bd7f-7db9-4b2c-af7c-be54a855c355',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140491) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 20:57:11.248746 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-b794222a-40a1-422f-8528-2904cc76ffa2 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.205152 Oct 08 20:57:11.257247 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 684/1425] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 20:57:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 2215 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 08 20:57:11.268537 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-a409dcf4-05d4-4479-8239-04a8d0160159 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:11.270561 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-a409dcf4-05d4-4479-8239-04a8d0160159 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] [instance: c2250e42-ea12-4161-8558-cba54fd9b4a8] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:11.282304 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a409dcf4-05d4-4479-8239-04a8d0160159 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:11.283316 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a409dcf4-05d4-4479-8239-04a8d0160159 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:11.285300 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a409dcf4-05d4-4479-8239-04a8d0160159 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:11.286422 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a409dcf4-05d4-4479-8239-04a8d0160159 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:11.287400 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a409dcf4-05d4-4479-8239-04a8d0160159 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:11.288088 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a409dcf4-05d4-4479-8239-04a8d0160159 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:11.400957 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-e6bf16b0-ae4f-4ab9-a099-2e2ab29dca50 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:11.416077 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-e6bf16b0-ae4f-4ab9-a099-2e2ab29dca50 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:11.423345 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-e6bf16b0-ae4f-4ab9-a099-2e2ab29dca50 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:11.425119 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-e6bf16b0-ae4f-4ab9-a099-2e2ab29dca50 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] 10.222.0.26 "GET /compute/v2.1/servers/ceced78a-58d9-4175-b4fe-0d085be62c94" status: 200 len: 1874 microversion: 2.42 time: 0.905990 Oct 08 20:57:11.459851 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 742/1426] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:57:10 2022] GET /compute/v2.1/servers/ceced78a-58d9-4175-b4fe-0d085be62c94 => generated 1874 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:57:11.470847 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-b55326b8-3f2d-480c-b101-716cce46465a tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:11.471798 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-b55326b8-3f2d-480c-b101-716cce46465a tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] [instance: 24d7af5b-10ba-4df7-a95d-bcd0b2104f37] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:11.674305 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-b55326b8-3f2d-480c-b101-716cce46465a tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac1323815364df4a3a4d4dbbb9d70dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be94d02ab5244f98337fb9b90e74746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:11.685845 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-b55326b8-3f2d-480c-b101-716cce46465a tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] 10.222.0.26 "GET /compute/v2.1/servers/24d7af5b-10ba-4df7-a95d-bcd0b2104f37" status: 200 len: 1216 microversion: 2.1 time: 0.222811 Oct 08 20:57:11.686645 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 743/1427] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:57:11 2022] GET /compute/v2.1/servers/24d7af5b-10ba-4df7-a95d-bcd0b2104f37 => generated 1216 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:57:11.715691 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-13a977c7-7074-4201-9b59-69dc390e784a tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:11.717810 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-13a977c7-7074-4201-9b59-69dc390e784a tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] [instance: e2d1c93f-8392-4f67-a29e-05164828f9d8] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:11.751080 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-13a977c7-7074-4201-9b59-69dc390e784a tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:11.751648 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-13a977c7-7074-4201-9b59-69dc390e784a tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:11.752299 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-13a977c7-7074-4201-9b59-69dc390e784a tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:11.753652 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-13a977c7-7074-4201-9b59-69dc390e784a tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:11.755159 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-13a977c7-7074-4201-9b59-69dc390e784a tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:11.755823 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-13a977c7-7074-4201-9b59-69dc390e784a tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:12.236090 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-a409dcf4-05d4-4479-8239-04a8d0160159 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05f0f7a60257437eaa8702b664916979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7550f7ad9dc45ba9c9bfb0a5a11a774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:12.257001 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-a409dcf4-05d4-4479-8239-04a8d0160159 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] 10.222.0.26 "GET /compute/v2.1/servers/c2250e42-ea12-4161-8558-cba54fd9b4a8" status: 200 len: 1469 microversion: 2.1 time: 0.988483 Oct 08 20:57:12.257677 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 685/1428] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:57:11 2022] GET /compute/v2.1/servers/c2250e42-ea12-4161-8558-cba54fd9b4a8 => generated 1469 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:57:12.285126 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-d2212088-afaa-47cc-ac48-b7030eb5b5fa tempest-LiveMigrationNegativeTest-1227766755 tempest-LiveMigrationNegativeTest-1227766755-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:57:12.286070 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-d2212088-afaa-47cc-ac48-b7030eb5b5fa tempest-LiveMigrationNegativeTest-1227766755 tempest-LiveMigrationNegativeTest-1227766755-project-admin] [instance: c2250e42-ea12-4161-8558-cba54fd9b4a8] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:12.293943 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d2212088-afaa-47cc-ac48-b7030eb5b5fa tempest-LiveMigrationNegativeTest-1227766755 tempest-LiveMigrationNegativeTest-1227766755-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:12.302603 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d2212088-afaa-47cc-ac48-b7030eb5b5fa tempest-LiveMigrationNegativeTest-1227766755 tempest-LiveMigrationNegativeTest-1227766755-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:12.303315 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d2212088-afaa-47cc-ac48-b7030eb5b5fa tempest-LiveMigrationNegativeTest-1227766755 tempest-LiveMigrationNegativeTest-1227766755-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:12.305856 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d2212088-afaa-47cc-ac48-b7030eb5b5fa tempest-LiveMigrationNegativeTest-1227766755 tempest-LiveMigrationNegativeTest-1227766755-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:12.308967 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d2212088-afaa-47cc-ac48-b7030eb5b5fa tempest-LiveMigrationNegativeTest-1227766755 tempest-LiveMigrationNegativeTest-1227766755-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:12.313748 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d2212088-afaa-47cc-ac48-b7030eb5b5fa tempest-LiveMigrationNegativeTest-1227766755 tempest-LiveMigrationNegativeTest-1227766755-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:12.372043 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.objects.instance [None req-d2212088-afaa-47cc-ac48-b7030eb5b5fa tempest-LiveMigrationNegativeTest-1227766755 tempest-LiveMigrationNegativeTest-1227766755-project-admin] Lazy-loading 'flavor' on Instance uuid c2250e42-ea12-4161-8558-cba54fd9b4a8 {{(pid=140491) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 20:57:12.534388 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-d2212088-afaa-47cc-ac48-b7030eb5b5fa tempest-LiveMigrationNegativeTest-1227766755 tempest-LiveMigrationNegativeTest-1227766755-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/c2250e42-ea12-4161-8558-cba54fd9b4a8/action" status: 202 len: 0 microversion: 2.1 time: 0.252857 Oct 08 20:57:12.536010 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 686/1429] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 20:57:12 2022] POST /compute/v2.1/servers/c2250e42-ea12-4161-8558-cba54fd9b4a8/action => generated 0 bytes in 255 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 08 20:57:12.543798 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-20fdc90e-a90e-4045-8127-6ce534952927 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:12.544894 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-20fdc90e-a90e-4045-8127-6ce534952927 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] [instance: ceced78a-58d9-4175-b4fe-0d085be62c94] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:12.553212 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-20fdc90e-a90e-4045-8127-6ce534952927 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:12.553812 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-20fdc90e-a90e-4045-8127-6ce534952927 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:12.554290 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-20fdc90e-a90e-4045-8127-6ce534952927 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:12.555635 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-20fdc90e-a90e-4045-8127-6ce534952927 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:12.558142 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-20fdc90e-a90e-4045-8127-6ce534952927 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:12.558711 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-20fdc90e-a90e-4045-8127-6ce534952927 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:12.828826 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-13a977c7-7074-4201-9b59-69dc390e784a tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474ca64d1b1d4e30916b517645aba882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecc2dd2407b4819874bed09cb27959a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:12.833228 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:57:12.846627 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-13a977c7-7074-4201-9b59-69dc390e784a tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d1c93f-8392-4f67-a29e-05164828f9d8" status: 200 len: 1198 microversion: 2.1 time: 1.157253 Oct 08 20:57:12.849689 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 744/1430] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:57:11 2022] GET /compute/v2.1/servers/e2d1c93f-8392-4f67-a29e-05164828f9d8 => generated 1198 bytes in 1161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:57:12.864537 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-1ab29d91-0afe-407d-8bb3-acf198ba6f0d tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:12.873670 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-1ab29d91-0afe-407d-8bb3-acf198ba6f0d tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] [instance: c2250e42-ea12-4161-8558-cba54fd9b4a8] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:12.887889 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1ab29d91-0afe-407d-8bb3-acf198ba6f0d tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:12.888132 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1ab29d91-0afe-407d-8bb3-acf198ba6f0d tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:12.888834 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1ab29d91-0afe-407d-8bb3-acf198ba6f0d tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:12.891535 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1ab29d91-0afe-407d-8bb3-acf198ba6f0d tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:12.894430 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1ab29d91-0afe-407d-8bb3-acf198ba6f0d tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:12.895119 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1ab29d91-0afe-407d-8bb3-acf198ba6f0d tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:13.506387 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-1ab29d91-0afe-407d-8bb3-acf198ba6f0d tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05f0f7a60257437eaa8702b664916979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7550f7ad9dc45ba9c9bfb0a5a11a774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:13.520161 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-1ab29d91-0afe-407d-8bb3-acf198ba6f0d tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] 10.222.0.26 "GET /compute/v2.1/servers/c2250e42-ea12-4161-8558-cba54fd9b4a8" status: 200 len: 1477 microversion: 2.1 time: 0.669374 Oct 08 20:57:13.521376 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 745/1431] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:57:12 2022] GET /compute/v2.1/servers/c2250e42-ea12-4161-8558-cba54fd9b4a8 => generated 1477 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:57:13.526881 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-f5659365-43af-47f4-a526-fe719cc29413 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:13.528419 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-f5659365-43af-47f4-a526-fe719cc29413 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] [instance: 24d7af5b-10ba-4df7-a95d-bcd0b2104f37] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:13.534811 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f5659365-43af-47f4-a526-fe719cc29413 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:13.535515 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f5659365-43af-47f4-a526-fe719cc29413 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:13.536117 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f5659365-43af-47f4-a526-fe719cc29413 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:13.537016 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f5659365-43af-47f4-a526-fe719cc29413 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:13.537787 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f5659365-43af-47f4-a526-fe719cc29413 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:13.538620 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f5659365-43af-47f4-a526-fe719cc29413 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:13.586838 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-20fdc90e-a90e-4045-8127-6ce534952927 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:13.604986 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-20fdc90e-a90e-4045-8127-6ce534952927 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:13.606577 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-20fdc90e-a90e-4045-8127-6ce534952927 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:13.612602 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-20fdc90e-a90e-4045-8127-6ce534952927 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] 10.222.0.26 "GET /compute/v2.1/servers/ceced78a-58d9-4175-b4fe-0d085be62c94" status: 200 len: 1874 microversion: 2.42 time: 1.070434 Oct 08 20:57:13.625456 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 687/1432] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:57:12 2022] GET /compute/v2.1/servers/ceced78a-58d9-4175-b4fe-0d085be62c94 => generated 1874 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:57:13.646403 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-d6fdc9c9-3f64-4b1a-a937-bc7a8459c0e4 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1230851528", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "a9c0a282-71aa-4609-90f6-4683ed1165e3"}], "block_device_mapping_v2": [{"uuid": "d78a1072-8e08-4aab-83e0-93be77a2a9bb", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:57:13.680211 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-f5659365-43af-47f4-a526-fe719cc29413 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac1323815364df4a3a4d4dbbb9d70dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be94d02ab5244f98337fb9b90e74746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:13.691859 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-f5659365-43af-47f4-a526-fe719cc29413 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] 10.222.0.26 "GET /compute/v2.1/servers/24d7af5b-10ba-4df7-a95d-bcd0b2104f37" status: 200 len: 1268 microversion: 2.1 time: 0.169021 Oct 08 20:57:13.692747 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 746/1433] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:57:13 2022] GET /compute/v2.1/servers/24d7af5b-10ba-4df7-a95d-bcd0b2104f37 => generated 1268 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:57:13.770103 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.network.neutron [None req-d6fdc9c9-3f64-4b1a-a937-bc7a8459c0e4 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] validate_networks() for [('a9c0a282-71aa-4609-90f6-4683ed1165e3', None, None, None, None, None)] {{(pid=140491) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 20:57:13.874802 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-b9fe23db-e185-4d4a-b716-eb6c6a7c68f9 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:13.875410 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-b9fe23db-e185-4d4a-b716-eb6c6a7c68f9 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] [instance: e2d1c93f-8392-4f67-a29e-05164828f9d8] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:13.882998 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b9fe23db-e185-4d4a-b716-eb6c6a7c68f9 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:13.883512 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b9fe23db-e185-4d4a-b716-eb6c6a7c68f9 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:13.883964 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b9fe23db-e185-4d4a-b716-eb6c6a7c68f9 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:13.884693 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b9fe23db-e185-4d4a-b716-eb6c6a7c68f9 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:13.885156 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b9fe23db-e185-4d4a-b716-eb6c6a7c68f9 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:13.891878 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b9fe23db-e185-4d4a-b716-eb6c6a7c68f9 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:14.299685 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-b9fe23db-e185-4d4a-b716-eb6c6a7c68f9 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474ca64d1b1d4e30916b517645aba882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecc2dd2407b4819874bed09cb27959a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:14.311094 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-b9fe23db-e185-4d4a-b716-eb6c6a7c68f9 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d1c93f-8392-4f67-a29e-05164828f9d8" status: 200 len: 1198 microversion: 2.1 time: 0.440040 Oct 08 20:57:14.326943 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 747/1434] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:57:13 2022] GET /compute/v2.1/servers/e2d1c93f-8392-4f67-a29e-05164828f9d8 => generated 1198 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:57:14.547101 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-dcd74799-f9fa-42fd-8917-d4b7632f23a1 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:14.547743 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-dcd74799-f9fa-42fd-8917-d4b7632f23a1 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] [instance: c2250e42-ea12-4161-8558-cba54fd9b4a8] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:14.564186 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dcd74799-f9fa-42fd-8917-d4b7632f23a1 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:14.565589 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dcd74799-f9fa-42fd-8917-d4b7632f23a1 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:14.567761 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dcd74799-f9fa-42fd-8917-d4b7632f23a1 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:14.568687 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dcd74799-f9fa-42fd-8917-d4b7632f23a1 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:14.572278 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dcd74799-f9fa-42fd-8917-d4b7632f23a1 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:14.573941 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dcd74799-f9fa-42fd-8917-d4b7632f23a1 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:14.990816 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-dcd74799-f9fa-42fd-8917-d4b7632f23a1 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05f0f7a60257437eaa8702b664916979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7550f7ad9dc45ba9c9bfb0a5a11a774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:15.015163 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-dcd74799-f9fa-42fd-8917-d4b7632f23a1 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] 10.222.0.26 "GET /compute/v2.1/servers/c2250e42-ea12-4161-8558-cba54fd9b4a8" status: 200 len: 1460 microversion: 2.1 time: 0.471335 Oct 08 20:57:15.016020 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 748/1435] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:57:14 2022] GET /compute/v2.1/servers/c2250e42-ea12-4161-8558-cba54fd9b4a8 => generated 1460 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:57:15.028620 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-8185cf78-37de-418f-a6b4-b14225656d36 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:15.029284 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-8185cf78-37de-418f-a6b4-b14225656d36 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] [instance: ceced78a-58d9-4175-b4fe-0d085be62c94] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:15.042740 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8185cf78-37de-418f-a6b4-b14225656d36 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:15.043454 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8185cf78-37de-418f-a6b4-b14225656d36 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:15.044348 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8185cf78-37de-418f-a6b4-b14225656d36 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:15.045396 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8185cf78-37de-418f-a6b4-b14225656d36 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:15.046087 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8185cf78-37de-418f-a6b4-b14225656d36 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:15.047584 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8185cf78-37de-418f-a6b4-b14225656d36 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:15.407326 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-d6fdc9c9-3f64-4b1a-a937-bc7a8459c0e4 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Flavor limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 20:57:15.407786 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-d6fdc9c9-3f64-4b1a-a937-bc7a8459c0e4 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Image limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 20:57:15.408373 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-d6fdc9c9-3f64-4b1a-a937-bc7a8459c0e4 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Flavor pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 20:57:15.409395 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-d6fdc9c9-3f64-4b1a-a937-bc7a8459c0e4 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Image pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 20:57:15.410081 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-d6fdc9c9-3f64-4b1a-a937-bc7a8459c0e4 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 20:57:15.436222 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d6fdc9c9-3f64-4b1a-a937-bc7a8459c0e4 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:15.437391 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d6fdc9c9-3f64-4b1a-a937-bc7a8459c0e4 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:15.438215 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d6fdc9c9-3f64-4b1a-a937-bc7a8459c0e4 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:15.439230 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d6fdc9c9-3f64-4b1a-a937-bc7a8459c0e4 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:15.440487 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d6fdc9c9-3f64-4b1a-a937-bc7a8459c0e4 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:15.441154 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d6fdc9c9-3f64-4b1a-a937-bc7a8459c0e4 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:15.463427 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-d6fdc9c9-3f64-4b1a-a937-bc7a8459c0e4 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Getting quotas for project ac5c7906a4714a1887cb823e1c3a6056. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 20:57:15.469430 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=7,nova_api:DELETE=2 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:57:15.471833 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-d6fdc9c9-3f64-4b1a-a937-bc7a8459c0e4 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Getting quotas for user d54b1c5c00544be4b60132d09817c8d6 and project ac5c7906a4714a1887cb823e1c3a6056. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 20:57:15.498595 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-8185cf78-37de-418f-a6b4-b14225656d36 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:15.515387 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-8185cf78-37de-418f-a6b4-b14225656d36 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:15.516846 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-8185cf78-37de-418f-a6b4-b14225656d36 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:15.518047 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-8185cf78-37de-418f-a6b4-b14225656d36 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] 10.222.0.26 "GET /compute/v2.1/servers/ceced78a-58d9-4175-b4fe-0d085be62c94" status: 200 len: 1874 microversion: 2.42 time: 0.499751 Oct 08 20:57:15.518620 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 749/1436] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:57:15 2022] GET /compute/v2.1/servers/ceced78a-58d9-4175-b4fe-0d085be62c94 => generated 1874 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:57:15.533039 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-cc0fa612-3793-4feb-ae02-421667321c04 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:15.533702 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-cc0fa612-3793-4feb-ae02-421667321c04 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] [instance: 24d7af5b-10ba-4df7-a95d-bcd0b2104f37] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:15.542933 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cc0fa612-3793-4feb-ae02-421667321c04 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:15.543444 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cc0fa612-3793-4feb-ae02-421667321c04 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:15.543894 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cc0fa612-3793-4feb-ae02-421667321c04 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:15.544616 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cc0fa612-3793-4feb-ae02-421667321c04 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:15.545078 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cc0fa612-3793-4feb-ae02-421667321c04 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:15.545543 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cc0fa612-3793-4feb-ae02-421667321c04 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:15.553981 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-d6fdc9c9-3f64-4b1a-a937-bc7a8459c0e4 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Going to run 1 instances... {{(pid=140491) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 20:57:15.556735 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-d6fdc9c9-3f64-4b1a-a937-bc7a8459c0e4 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] [instance: 74bdac1c-9b70-46f7-b671-9752894d8980] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d78a1072-8e08-4aab-83e0-93be77a2a9bb',volume_size=None,volume_type=None)] {{(pid=140491) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 20:57:15.687775 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-cc0fa612-3793-4feb-ae02-421667321c04 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac1323815364df4a3a4d4dbbb9d70dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be94d02ab5244f98337fb9b90e74746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:15.697078 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-cc0fa612-3793-4feb-ae02-421667321c04 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] 10.222.0.26 "GET /compute/v2.1/servers/24d7af5b-10ba-4df7-a95d-bcd0b2104f37" status: 200 len: 1274 microversion: 2.1 time: 0.177306 Oct 08 20:57:15.710351 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 750/1437] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:57:15 2022] GET /compute/v2.1/servers/24d7af5b-10ba-4df7-a95d-bcd0b2104f37 => generated 1274 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:57:15.727061 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-fb2bc95e-07ee-481a-86bd-789b7be3e527 tempest-LiveMigrationNegativeTest-1227766755 tempest-LiveMigrationNegativeTest-1227766755-project-admin] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:15.727772 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-fb2bc95e-07ee-481a-86bd-789b7be3e527 tempest-LiveMigrationNegativeTest-1227766755 tempest-LiveMigrationNegativeTest-1227766755-project-admin] [instance: c2250e42-ea12-4161-8558-cba54fd9b4a8] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:15.734460 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fb2bc95e-07ee-481a-86bd-789b7be3e527 tempest-LiveMigrationNegativeTest-1227766755 tempest-LiveMigrationNegativeTest-1227766755-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:15.734958 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fb2bc95e-07ee-481a-86bd-789b7be3e527 tempest-LiveMigrationNegativeTest-1227766755 tempest-LiveMigrationNegativeTest-1227766755-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:15.735654 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fb2bc95e-07ee-481a-86bd-789b7be3e527 tempest-LiveMigrationNegativeTest-1227766755 tempest-LiveMigrationNegativeTest-1227766755-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:15.736368 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fb2bc95e-07ee-481a-86bd-789b7be3e527 tempest-LiveMigrationNegativeTest-1227766755 tempest-LiveMigrationNegativeTest-1227766755-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:15.736828 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fb2bc95e-07ee-481a-86bd-789b7be3e527 tempest-LiveMigrationNegativeTest-1227766755 tempest-LiveMigrationNegativeTest-1227766755-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:15.737281 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fb2bc95e-07ee-481a-86bd-789b7be3e527 tempest-LiveMigrationNegativeTest-1227766755 tempest-LiveMigrationNegativeTest-1227766755-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:15.749895 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-d6fdc9c9-3f64-4b1a-a937-bc7a8459c0e4 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 2.123189 Oct 08 20:57:15.750853 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 688/1438] 10.222.0.26 () {62 vars in 1188 bytes} [Sat Oct 8 20:57:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 2125 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 08 20:57:15.996069 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-77084b3a-6174-4694-828c-7d682ad6f3be tempest-FloatingIPDetailsNegativeTestJSON-1564630085 tempest-FloatingIPDetailsNegativeTestJSON-1564630085-project] Calling method '.version_select at 0x7f1a8ca32ee0>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:16.066637 ncdv-master-1 devstack@n-api.service[140491]: DEBUG neutronclient.v2_0.client [None req-77084b3a-6174-4694-828c-7d682ad6f3be tempest-FloatingIPDetailsNegativeTestJSON-1564630085 tempest-FloatingIPDetailsNegativeTestJSON-1564630085-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP b0c88ac4-a16f-47a0-b4cb-0d7af748b2d0 could not be found", "detail": ""}} {{(pid=140491) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 08 20:57:16.067615 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-77084b3a-6174-4694-828c-7d682ad6f3be tempest-FloatingIPDetailsNegativeTestJSON-1564630085 tempest-FloatingIPDetailsNegativeTestJSON-1564630085-project] HTTP exception thrown: Floating IP not found for ID b0c88ac4-a16f-47a0-b4cb-0d7af748b2d0 Oct 08 20:57:16.078622 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-77084b3a-6174-4694-828c-7d682ad6f3be tempest-FloatingIPDetailsNegativeTestJSON-1564630085 tempest-FloatingIPDetailsNegativeTestJSON-1564630085-project] Request method failure captured: Oct 08 20:57:16.078622 ncdv-master-1 devstack@n-api.service[140491]: request: GET /compute/v2.1/os-floating-ips/b0c88ac4-a16f-47a0-b4cb-0d7af748b2d0 HTTP/1.1 Oct 08 20:57:16.078622 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 20:57:16.078622 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 20:57:16.078622 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 20:57:16.078622 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 20:57:16.078622 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 20:57:16.078622 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 20:57:16.078622 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 20:57:16.078622 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 20:57:16.078622 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeQr5lovj6b7LYHkCegdLZ9ADze1JPQwES5puUNegRhCianJPYLdAYGzwdVIHB_9koUX1y8-4y3PSY9YXNKc6g7zQnPQD1LDAL9m4BIJxAH6GIqsAEFaFJuHZWy9DVG0XbRBrdok47QEwqEa-MoLuvOSb0vr7pj8JXh4lHGPe1wCy7A Oct 08 20:57:16.078622 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 20:57:16.078622 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 20:57:16.078622 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 20:57:16.078622 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 20:57:16.078622 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 20:57:16.078622 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 20:57:16.078622 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 06d641c6b7084a95b2964aeec2be6b77 Oct 08 20:57:16.078622 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-1564630085 Oct 08 20:57:16.078622 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 20:57:16.078622 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 20:57:16.078622 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/06d641c6b7084a95b2964aeec2be6b77"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/06d641c6b7084a95b2964aeec2be6b77"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_06d641c6b7084a95b2964aeec2be6b77"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/06d641c6b7084a95b2964aeec2be6b77"}]}] Oct 08 20:57:16.078622 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-1564630085 Oct 08 20:57:16.078622 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 06d641c6b7084a95b2964aeec2be6b77 Oct 08 20:57:16.078622 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-1564630085 Oct 08 20:57:16.078622 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-1564630085-project Oct 08 20:57:16.078622 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 20:57:16.078622 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 20:57:16.078622 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: fbaa704ca5484cd1970ab5e781685536 Oct 08 20:57:16.078622 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-1564630085-project Oct 08 20:57:16.078622 ncdv-master-1 devstack@n-api.service[140491]: method: Oct 08 20:57:16.078622 ncdv-master-1 devstack@n-api.service[140491]: exception: Floating IP not found for ID b0c88ac4-a16f-47a0-b4cb-0d7af748b2d0 Oct 08 20:57:16.078622 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': 'b0c88ac4-a16f-47a0-b4cb-0d7af748b2d0'} Oct 08 20:57:16.078622 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:57:16.078622 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:57:16.078622 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 08 20:57:16.078622 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 08 20:57:16.078622 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 08 20:57:16.078622 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 08 20:57:16.078622 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 08 20:57:16.078622 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 08 20:57:16.078622 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 08 20:57:16.078622 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 08 20:57:16.078622 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 08 20:57:16.078622 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 08 20:57:16.078622 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 08 20:57:16.078622 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 08 20:57:16.078622 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 08 20:57:16.078622 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 08 20:57:16.078622 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 08 20:57:16.078622 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 08 20:57:16.078622 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 08 20:57:16.078622 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 08 20:57:16.078622 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 08 20:57:16.078622 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 08 20:57:16.078622 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 08 20:57:16.078622 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 08 20:57:16.078622 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 08 20:57:16.078622 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 08 20:57:16.078622 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP b0c88ac4-a16f-47a0-b4cb-0d7af748b2d0 could not be found Oct 08 20:57:16.086873 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e98970b0-ed7e-473b-8339-8e96bfc1df2e'] Oct 08 20:57:16.086873 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:57:16.086873 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:57:16.086873 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:57:16.086873 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:57:16.086873 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Oct 08 20:57:16.086873 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 08 20:57:16.086873 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 08 20:57:16.086873 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 08 20:57:16.086873 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID b0c88ac4-a16f-47a0-b4cb-0d7af748b2d0. Oct 08 20:57:16.086873 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:57:16.086873 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:57:16.086873 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:57:16.086873 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:57:16.086873 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:57:16.086873 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:57:16.086873 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:57:16.086873 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:57:16.086873 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 08 20:57:16.086873 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 08 20:57:16.086873 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:57:16.086873 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:57:16.086873 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Oct 08 20:57:16.086873 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 08 20:57:16.086873 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID b0c88ac4-a16f-47a0-b4cb-0d7af748b2d0 Oct 08 20:57:16.086873 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:57:16.086873 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:57:16.086873 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:57:16.086873 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:57:16.086873 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:57:16.086873 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:57:16.086873 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 20:57:16.086873 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 20:57:16.086873 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID b0c88ac4-a16f-47a0-b4cb-0d7af748b2d0 Oct 08 20:57:16.086873 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:57:16.096976 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-77084b3a-6174-4694-828c-7d682ad6f3be tempest-FloatingIPDetailsNegativeTestJSON-1564630085 tempest-FloatingIPDetailsNegativeTestJSON-1564630085-project] Returning 404 to user: Floating IP not found for ID b0c88ac4-a16f-47a0-b4cb-0d7af748b2d0 {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:57:16.098948 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-77084b3a-6174-4694-828c-7d682ad6f3be tempest-FloatingIPDetailsNegativeTestJSON-1564630085 tempest-FloatingIPDetailsNegativeTestJSON-1564630085-project] 10.222.0.26 "GET /compute/v2.1/os-floating-ips/b0c88ac4-a16f-47a0-b4cb-0d7af748b2d0" status: 404 len: 111 microversion: 2.1 time: 0.345980 Oct 08 20:57:16.101329 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 689/1439] 10.222.0.26 () {58 vars in 1260 bytes} [Sat Oct 8 20:57:15 2022] GET /compute/v2.1/os-floating-ips/b0c88ac4-a16f-47a0-b4cb-0d7af748b2d0 => generated 111 bytes in 349 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 20:57:16.112649 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-1eabbdae-658b-41f8-9c27-f44e8cb2efc9 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:16.115989 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-1eabbdae-658b-41f8-9c27-f44e8cb2efc9 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] [instance: e2d1c93f-8392-4f67-a29e-05164828f9d8] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:16.125686 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1eabbdae-658b-41f8-9c27-f44e8cb2efc9 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:16.126681 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1eabbdae-658b-41f8-9c27-f44e8cb2efc9 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:16.129324 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1eabbdae-658b-41f8-9c27-f44e8cb2efc9 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:16.132901 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1eabbdae-658b-41f8-9c27-f44e8cb2efc9 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:16.133582 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1eabbdae-658b-41f8-9c27-f44e8cb2efc9 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:16.134775 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1eabbdae-658b-41f8-9c27-f44e8cb2efc9 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:16.954115 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-fb2bc95e-07ee-481a-86bd-789b7be3e527 tempest-LiveMigrationNegativeTest-1227766755 tempest-LiveMigrationNegativeTest-1227766755-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/c2250e42-ea12-4161-8558-cba54fd9b4a8" status: 200 len: 1611 microversion: 2.1 time: 1.241981 Oct 08 20:57:16.957911 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 751/1440] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:57:15 2022] GET /compute/v2.1/servers/c2250e42-ea12-4161-8558-cba54fd9b4a8 => generated 1611 bytes in 1247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:57:16.969093 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-562397a9-8370-4757-a371-3655c975030a tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:16.971678 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-562397a9-8370-4757-a371-3655c975030a tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] [instance: 74bdac1c-9b70-46f7-b671-9752894d8980] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:16.989027 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-562397a9-8370-4757-a371-3655c975030a tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:16.989586 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-562397a9-8370-4757-a371-3655c975030a tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:16.990032 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-562397a9-8370-4757-a371-3655c975030a tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:16.994279 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-562397a9-8370-4757-a371-3655c975030a tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:16.994950 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-562397a9-8370-4757-a371-3655c975030a tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:16.998476 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-562397a9-8370-4757-a371-3655c975030a tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:17.388202 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-562397a9-8370-4757-a371-3655c975030a tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:17.400029 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-562397a9-8370-4757-a371-3655c975030a tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:17.403229 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-562397a9-8370-4757-a371-3655c975030a tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:17.405918 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-562397a9-8370-4757-a371-3655c975030a tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] 10.222.0.26 "GET /compute/v2.1/servers/74bdac1c-9b70-46f7-b671-9752894d8980" status: 200 len: 1177 microversion: 2.25 time: 0.446791 Oct 08 20:57:17.409486 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 752/1441] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:57:16 2022] GET /compute/v2.1/servers/74bdac1c-9b70-46f7-b671-9752894d8980 => generated 1177 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:57:17.422381 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-ed09bce2-141c-4ce6-9a97-3d703e73207d tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:17.425141 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-ed09bce2-141c-4ce6-9a97-3d703e73207d tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] [instance: ceced78a-58d9-4175-b4fe-0d085be62c94] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:17.449633 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ed09bce2-141c-4ce6-9a97-3d703e73207d tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:17.450135 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ed09bce2-141c-4ce6-9a97-3d703e73207d tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:17.450584 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ed09bce2-141c-4ce6-9a97-3d703e73207d tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:17.451304 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ed09bce2-141c-4ce6-9a97-3d703e73207d tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:17.451764 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ed09bce2-141c-4ce6-9a97-3d703e73207d tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:17.452191 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ed09bce2-141c-4ce6-9a97-3d703e73207d tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:17.543741 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-1eabbdae-658b-41f8-9c27-f44e8cb2efc9 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474ca64d1b1d4e30916b517645aba882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecc2dd2407b4819874bed09cb27959a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:17.558373 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-1eabbdae-658b-41f8-9c27-f44e8cb2efc9 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d1c93f-8392-4f67-a29e-05164828f9d8" status: 200 len: 1198 microversion: 2.1 time: 1.455429 Oct 08 20:57:17.558954 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 690/1442] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:57:16 2022] GET /compute/v2.1/servers/e2d1c93f-8392-4f67-a29e-05164828f9d8 => generated 1198 bytes in 1457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:57:17.573975 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-4ef92a46-9d6d-44f9-8984-f6aeb5635f05 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:17.574595 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-4ef92a46-9d6d-44f9-8984-f6aeb5635f05 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] [instance: 24d7af5b-10ba-4df7-a95d-bcd0b2104f37] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:17.590625 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4ef92a46-9d6d-44f9-8984-f6aeb5635f05 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:17.592492 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4ef92a46-9d6d-44f9-8984-f6aeb5635f05 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:17.595927 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4ef92a46-9d6d-44f9-8984-f6aeb5635f05 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:17.597471 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4ef92a46-9d6d-44f9-8984-f6aeb5635f05 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:17.599599 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4ef92a46-9d6d-44f9-8984-f6aeb5635f05 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:17.600214 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4ef92a46-9d6d-44f9-8984-f6aeb5635f05 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:17.890616 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-4ef92a46-9d6d-44f9-8984-f6aeb5635f05 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac1323815364df4a3a4d4dbbb9d70dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be94d02ab5244f98337fb9b90e74746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:17.910877 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-4ef92a46-9d6d-44f9-8984-f6aeb5635f05 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] 10.222.0.26 "GET /compute/v2.1/servers/24d7af5b-10ba-4df7-a95d-bcd0b2104f37" status: 200 len: 1274 microversion: 2.1 time: 0.350817 Oct 08 20:57:17.912532 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 691/1443] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:57:17 2022] GET /compute/v2.1/servers/24d7af5b-10ba-4df7-a95d-bcd0b2104f37 => generated 1274 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:57:17.921892 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-043764d2-84bc-4bc1-8d29-a5e39bd25ddf tempest-LiveMigrationNegativeTest-1227766755 tempest-LiveMigrationNegativeTest-1227766755-project-admin] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:17.939749 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-043764d2-84bc-4bc1-8d29-a5e39bd25ddf tempest-LiveMigrationNegativeTest-1227766755 tempest-LiveMigrationNegativeTest-1227766755-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:17.940155 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-043764d2-84bc-4bc1-8d29-a5e39bd25ddf tempest-LiveMigrationNegativeTest-1227766755 tempest-LiveMigrationNegativeTest-1227766755-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:17.940609 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-043764d2-84bc-4bc1-8d29-a5e39bd25ddf tempest-LiveMigrationNegativeTest-1227766755 tempest-LiveMigrationNegativeTest-1227766755-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:17.941402 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-043764d2-84bc-4bc1-8d29-a5e39bd25ddf tempest-LiveMigrationNegativeTest-1227766755 tempest-LiveMigrationNegativeTest-1227766755-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:17.941872 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-043764d2-84bc-4bc1-8d29-a5e39bd25ddf tempest-LiveMigrationNegativeTest-1227766755 tempest-LiveMigrationNegativeTest-1227766755-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:17.942304 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-043764d2-84bc-4bc1-8d29-a5e39bd25ddf tempest-LiveMigrationNegativeTest-1227766755 tempest-LiveMigrationNegativeTest-1227766755-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:17.971267 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-043764d2-84bc-4bc1-8d29-a5e39bd25ddf tempest-LiveMigrationNegativeTest-1227766755 tempest-LiveMigrationNegativeTest-1227766755-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.057440 Oct 08 20:57:17.972689 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 692/1444] 10.222.0.26 () {58 vars in 1176 bytes} [Sat Oct 8 20:57:17 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:57:17.995368 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-d9a04541-4333-46f1-9db0-a3645b5e8180 tempest-LiveMigrationNegativeTest-1227766755 tempest-LiveMigrationNegativeTest-1227766755-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:57:18.005682 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-d9a04541-4333-46f1-9db0-a3645b5e8180 tempest-LiveMigrationNegativeTest-1227766755 tempest-LiveMigrationNegativeTest-1227766755-project-admin] [instance: c2250e42-ea12-4161-8558-cba54fd9b4a8] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:18.014979 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d9a04541-4333-46f1-9db0-a3645b5e8180 tempest-LiveMigrationNegativeTest-1227766755 tempest-LiveMigrationNegativeTest-1227766755-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:18.015654 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d9a04541-4333-46f1-9db0-a3645b5e8180 tempest-LiveMigrationNegativeTest-1227766755 tempest-LiveMigrationNegativeTest-1227766755-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:18.016365 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d9a04541-4333-46f1-9db0-a3645b5e8180 tempest-LiveMigrationNegativeTest-1227766755 tempest-LiveMigrationNegativeTest-1227766755-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:18.017336 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d9a04541-4333-46f1-9db0-a3645b5e8180 tempest-LiveMigrationNegativeTest-1227766755 tempest-LiveMigrationNegativeTest-1227766755-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:18.034507 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d9a04541-4333-46f1-9db0-a3645b5e8180 tempest-LiveMigrationNegativeTest-1227766755 tempest-LiveMigrationNegativeTest-1227766755-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:18.037886 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d9a04541-4333-46f1-9db0-a3645b5e8180 tempest-LiveMigrationNegativeTest-1227766755 tempest-LiveMigrationNegativeTest-1227766755-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:18.085180 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.objects.instance [None req-d9a04541-4333-46f1-9db0-a3645b5e8180 tempest-LiveMigrationNegativeTest-1227766755 tempest-LiveMigrationNegativeTest-1227766755-project-admin] Lazy-loading 'flavor' on Instance uuid c2250e42-ea12-4161-8558-cba54fd9b4a8 {{(pid=140491) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 20:57:18.102702 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-d9a04541-4333-46f1-9db0-a3645b5e8180 tempest-LiveMigrationNegativeTest-1227766755 tempest-LiveMigrationNegativeTest-1227766755-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance c2250e42-ea12-4161-8558-cba54fd9b4a8 while it is in vm_state suspended Oct 08 20:57:18.105610 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-d9a04541-4333-46f1-9db0-a3645b5e8180 tempest-LiveMigrationNegativeTest-1227766755 tempest-LiveMigrationNegativeTest-1227766755-project-admin] Request method failure captured: Oct 08 20:57:18.105610 ncdv-master-1 devstack@n-api.service[140491]: request: POST /compute/v2.1/servers/c2250e42-ea12-4161-8558-cba54fd9b4a8/action HTTP/1.1 Oct 08 20:57:18.105610 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 20:57:18.105610 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 20:57:18.105610 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 20:57:18.105610 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 97 Oct 08 20:57:18.105610 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 20:57:18.105610 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 20:57:18.105610 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 20:57:18.105610 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 20:57:18.105610 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQePmhn8XB40pNH6H2qTxPWEGN3b1iEsUXIwhpz9ZzD4jGIH4TC7Hc_mE-JDu0YBA9sjMFnw_x7PHo09XhXOeFZ2d7fFdTFLBZQuP_3vKWsFGWU1pxYSNIx5pVpM7rTQV1zaqBsPUYxYiQG7_bqdw7Onw2mRJsAY4Jg8rwZvDBQ15FnE Oct 08 20:57:18.105610 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 20:57:18.105610 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 20:57:18.105610 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 20:57:18.105610 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 20:57:18.105610 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 20:57:18.105610 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 20:57:18.105610 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 4a1046f826864ce2aeafe7c6fa76d27d Oct 08 20:57:18.105610 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-LiveMigrationNegativeTest-1227766755 Oct 08 20:57:18.105610 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,admin,member Oct 08 20:57:18.105610 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,admin,member Oct 08 20:57:18.105610 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/4a1046f826864ce2aeafe7c6fa76d27d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4a1046f826864ce2aeafe7c6fa76d27d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_4a1046f826864ce2aeafe7c6fa76d27d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4a1046f826864ce2aeafe7c6fa76d27d"}]}] Oct 08 20:57:18.105610 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-LiveMigrationNegativeTest-1227766755 Oct 08 20:57:18.105610 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 4a1046f826864ce2aeafe7c6fa76d27d Oct 08 20:57:18.105610 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1227766755 Oct 08 20:57:18.105610 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-LiveMigrationNegativeTest-1227766755-project-admin Oct 08 20:57:18.105610 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 20:57:18.105610 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 20:57:18.105610 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 3d7dcc4a842b44ad916158a902ee0878 Oct 08 20:57:18.105610 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-LiveMigrationNegativeTest-1227766755-project-admin Oct 08 20:57:18.105610 ncdv-master-1 devstack@n-api.service[140491]: Oct 08 20:57:18.105610 ncdv-master-1 devstack@n-api.service[140491]: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": true, "disk_over_commit": false}} Oct 08 20:57:18.105610 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 20:57:18.105610 ncdv-master-1 devstack@n-api.service[140491]: exception: Cannot 'os-migrateLive' instance c2250e42-ea12-4161-8558-cba54fd9b4a8 while it is in vm_state suspended Oct 08 20:57:18.105610 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': 'c2250e42-ea12-4161-8558-cba54fd9b4a8', 'body': {'os-migrateLive': {'host': 'nch1-master-1', 'block_migration': True, 'disk_over_commit': False}}} Oct 08 20:57:18.105610 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:57:18.105610 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:57:18.105610 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Oct 08 20:57:18.105610 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Oct 08 20:57:18.105610 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 08 20:57:18.105610 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 08 20:57:18.105610 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 08 20:57:18.105610 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 08 20:57:18.105610 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 08 20:57:18.105610 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 08 20:57:18.105610 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 08 20:57:18.105610 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 08 20:57:18.105610 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 08 20:57:18.105610 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 08 20:57:18.105610 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 08 20:57:18.105610 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 08 20:57:18.105610 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 08 20:57:18.105610 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 08 20:57:18.105610 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 08 20:57:18.105610 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 08 20:57:18.105610 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance c2250e42-ea12-4161-8558-cba54fd9b4a8 in vm_state suspended. Cannot live_migrate while the instance is in this state. Oct 08 20:57:18.105610 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:57:18.105610 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:57:18.105610 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:57:18.105610 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:57:18.105610 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:57:18.110813 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:57:18.110813 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:57:18.110813 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:57:18.110813 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:57:18.110813 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:57:18.110813 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 20:57:18.110813 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 20:57:18.110813 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 20:57:18.110813 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 20:57:18.110813 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 20:57:18.110813 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 20:57:18.110813 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 08 20:57:18.110813 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Oct 08 20:57:18.110813 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 08 20:57:18.110813 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 08 20:57:18.110813 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 08 20:57:18.110813 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance c2250e42-ea12-4161-8558-cba54fd9b4a8 while it is in vm_state suspended Oct 08 20:57:18.110813 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:57:18.110813 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:57:18.110813 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:57:18.110813 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:57:18.110813 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:57:18.110813 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:57:18.110813 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 20:57:18.110813 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 20:57:18.110813 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance c2250e42-ea12-4161-8558-cba54fd9b4a8 while it is in vm_state suspended Oct 08 20:57:18.110813 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:57:18.115586 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-d9a04541-4333-46f1-9db0-a3645b5e8180 tempest-LiveMigrationNegativeTest-1227766755 tempest-LiveMigrationNegativeTest-1227766755-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance c2250e42-ea12-4161-8558-cba54fd9b4a8 while it is in vm_state suspended {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:57:18.116677 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-d9a04541-4333-46f1-9db0-a3645b5e8180 tempest-LiveMigrationNegativeTest-1227766755 tempest-LiveMigrationNegativeTest-1227766755-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/c2250e42-ea12-4161-8558-cba54fd9b4a8/action" status: 409 len: 155 microversion: 2.1 time: 0.134224 Oct 08 20:57:18.135815 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 693/1445] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 20:57:17 2022] POST /compute/v2.1/servers/c2250e42-ea12-4161-8558-cba54fd9b4a8/action => generated 155 bytes in 154 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 08 20:57:18.146229 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-e92259d9-8c6a-489e-9070-007d2e51fc09 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:18.147609 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-e92259d9-8c6a-489e-9070-007d2e51fc09 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] [instance: c2250e42-ea12-4161-8558-cba54fd9b4a8] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:18.161466 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e92259d9-8c6a-489e-9070-007d2e51fc09 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:18.162591 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e92259d9-8c6a-489e-9070-007d2e51fc09 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:18.163289 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e92259d9-8c6a-489e-9070-007d2e51fc09 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:18.165381 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e92259d9-8c6a-489e-9070-007d2e51fc09 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:18.166093 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e92259d9-8c6a-489e-9070-007d2e51fc09 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:18.166741 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e92259d9-8c6a-489e-9070-007d2e51fc09 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:18.238174 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-e92259d9-8c6a-489e-9070-007d2e51fc09 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] [instance: c2250e42-ea12-4161-8558-cba54fd9b4a8] Going to try to terminate instance {{(pid=140491) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 20:57:18.332937 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-ed09bce2-141c-4ce6-9a97-3d703e73207d tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:18.346211 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:57:18.417903 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-ed09bce2-141c-4ce6-9a97-3d703e73207d tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:18.433673 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-ed09bce2-141c-4ce6-9a97-3d703e73207d tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:18.440318 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-ed09bce2-141c-4ce6-9a97-3d703e73207d tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] 10.222.0.26 "GET /compute/v2.1/servers/ceced78a-58d9-4175-b4fe-0d085be62c94" status: 200 len: 1874 microversion: 2.42 time: 1.024199 Oct 08 20:57:18.443861 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 753/1446] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:57:17 2022] GET /compute/v2.1/servers/ceced78a-58d9-4175-b4fe-0d085be62c94 => generated 1874 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:57:18.456838 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-e92259d9-8c6a-489e-9070-007d2e51fc09 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] 10.222.0.26 "DELETE /compute/v2.1/servers/c2250e42-ea12-4161-8558-cba54fd9b4a8" status: 204 len: 0 microversion: 2.1 time: 0.318871 Oct 08 20:57:18.458119 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 694/1447] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 20:57:18 2022] DELETE /compute/v2.1/servers/c2250e42-ea12-4161-8558-cba54fd9b4a8 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 20:57:18.466373 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-2c96fd5e-ad16-4289-bebb-f0f560c810f0 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:18.467299 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-9b3e0672-b7ad-4c95-8a0d-eb3b9b7913a4 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:18.468211 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-2c96fd5e-ad16-4289-bebb-f0f560c810f0 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] [instance: c2250e42-ea12-4161-8558-cba54fd9b4a8] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:18.469159 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-9b3e0672-b7ad-4c95-8a0d-eb3b9b7913a4 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] [instance: 74bdac1c-9b70-46f7-b671-9752894d8980] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:18.480399 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:DELETE=3 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:57:18.488237 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9b3e0672-b7ad-4c95-8a0d-eb3b9b7913a4 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:18.488940 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2c96fd5e-ad16-4289-bebb-f0f560c810f0 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:18.489557 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9b3e0672-b7ad-4c95-8a0d-eb3b9b7913a4 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:18.489774 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2c96fd5e-ad16-4289-bebb-f0f560c810f0 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:18.490325 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2c96fd5e-ad16-4289-bebb-f0f560c810f0 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:18.490581 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9b3e0672-b7ad-4c95-8a0d-eb3b9b7913a4 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:18.491265 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2c96fd5e-ad16-4289-bebb-f0f560c810f0 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:18.492607 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2c96fd5e-ad16-4289-bebb-f0f560c810f0 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:18.494902 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2c96fd5e-ad16-4289-bebb-f0f560c810f0 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:18.499287 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9b3e0672-b7ad-4c95-8a0d-eb3b9b7913a4 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:18.499876 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9b3e0672-b7ad-4c95-8a0d-eb3b9b7913a4 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:18.500333 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9b3e0672-b7ad-4c95-8a0d-eb3b9b7913a4 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:18.692898 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-9b3e0672-b7ad-4c95-8a0d-eb3b9b7913a4 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:18.706360 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-9b3e0672-b7ad-4c95-8a0d-eb3b9b7913a4 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:18.708120 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-9b3e0672-b7ad-4c95-8a0d-eb3b9b7913a4 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:18.714734 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-9b3e0672-b7ad-4c95-8a0d-eb3b9b7913a4 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] 10.222.0.26 "GET /compute/v2.1/servers/74bdac1c-9b70-46f7-b671-9752894d8980" status: 200 len: 1251 microversion: 2.25 time: 0.266031 Oct 08 20:57:18.715589 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 754/1448] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:57:18 2022] GET /compute/v2.1/servers/74bdac1c-9b70-46f7-b671-9752894d8980 => generated 1251 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:57:18.724033 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-fda388a7-b63d-4131-aad7-f36469bfdfed tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:18.724886 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-fda388a7-b63d-4131-aad7-f36469bfdfed tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] [instance: e2d1c93f-8392-4f67-a29e-05164828f9d8] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:18.748410 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fda388a7-b63d-4131-aad7-f36469bfdfed tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:18.749120 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fda388a7-b63d-4131-aad7-f36469bfdfed tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:18.749523 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fda388a7-b63d-4131-aad7-f36469bfdfed tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:18.750261 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fda388a7-b63d-4131-aad7-f36469bfdfed tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:18.750724 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fda388a7-b63d-4131-aad7-f36469bfdfed tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:18.751156 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fda388a7-b63d-4131-aad7-f36469bfdfed tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:19.215633 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-2c96fd5e-ad16-4289-bebb-f0f560c810f0 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05f0f7a60257437eaa8702b664916979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7550f7ad9dc45ba9c9bfb0a5a11a774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:19.231552 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-2c96fd5e-ad16-4289-bebb-f0f560c810f0 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] 10.222.0.26 "GET /compute/v2.1/servers/c2250e42-ea12-4161-8558-cba54fd9b4a8" status: 200 len: 1466 microversion: 2.1 time: 0.767072 Oct 08 20:57:19.232938 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 695/1449] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:57:18 2022] GET /compute/v2.1/servers/c2250e42-ea12-4161-8558-cba54fd9b4a8 => generated 1466 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:57:19.244497 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-9654e61e-836f-4e4e-a51c-0ae854ebcbfa tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:19.245474 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-9654e61e-836f-4e4e-a51c-0ae854ebcbfa tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] [instance: 24d7af5b-10ba-4df7-a95d-bcd0b2104f37] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:19.263083 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9654e61e-836f-4e4e-a51c-0ae854ebcbfa tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:19.268038 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9654e61e-836f-4e4e-a51c-0ae854ebcbfa tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:19.268494 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9654e61e-836f-4e4e-a51c-0ae854ebcbfa tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:19.269285 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9654e61e-836f-4e4e-a51c-0ae854ebcbfa tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:19.269774 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9654e61e-836f-4e4e-a51c-0ae854ebcbfa tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:19.278123 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9654e61e-836f-4e4e-a51c-0ae854ebcbfa tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:19.593682 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-fda388a7-b63d-4131-aad7-f36469bfdfed tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474ca64d1b1d4e30916b517645aba882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecc2dd2407b4819874bed09cb27959a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:19.607079 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-fda388a7-b63d-4131-aad7-f36469bfdfed tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d1c93f-8392-4f67-a29e-05164828f9d8" status: 200 len: 1198 microversion: 2.1 time: 0.890188 Oct 08 20:57:19.621844 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 755/1450] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:57:18 2022] GET /compute/v2.1/servers/e2d1c93f-8392-4f67-a29e-05164828f9d8 => generated 1198 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:57:19.637042 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-dbb4c1bd-e103-4b6f-9efa-2dc96f87a222 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:19.637821 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-dbb4c1bd-e103-4b6f-9efa-2dc96f87a222 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] [instance: ceced78a-58d9-4175-b4fe-0d085be62c94] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:19.645581 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dbb4c1bd-e103-4b6f-9efa-2dc96f87a222 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:19.646403 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dbb4c1bd-e103-4b6f-9efa-2dc96f87a222 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:19.646952 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dbb4c1bd-e103-4b6f-9efa-2dc96f87a222 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:19.648554 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dbb4c1bd-e103-4b6f-9efa-2dc96f87a222 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:19.649293 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dbb4c1bd-e103-4b6f-9efa-2dc96f87a222 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:19.649951 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dbb4c1bd-e103-4b6f-9efa-2dc96f87a222 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:19.752871 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-9654e61e-836f-4e4e-a51c-0ae854ebcbfa tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac1323815364df4a3a4d4dbbb9d70dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be94d02ab5244f98337fb9b90e74746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:19.762592 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-9654e61e-836f-4e4e-a51c-0ae854ebcbfa tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] 10.222.0.26 "GET /compute/v2.1/servers/24d7af5b-10ba-4df7-a95d-bcd0b2104f37" status: 200 len: 1316 microversion: 2.1 time: 0.524801 Oct 08 20:57:19.768326 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 696/1451] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:57:19 2022] GET /compute/v2.1/servers/24d7af5b-10ba-4df7-a95d-bcd0b2104f37 => generated 1316 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:57:19.774794 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-3bd41ac0-913f-415d-a47b-80686bec7b5c tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:19.775725 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-3bd41ac0-913f-415d-a47b-80686bec7b5c tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] [instance: 74bdac1c-9b70-46f7-b671-9752894d8980] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:19.791373 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3bd41ac0-913f-415d-a47b-80686bec7b5c tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:19.797982 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3bd41ac0-913f-415d-a47b-80686bec7b5c tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:19.798991 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3bd41ac0-913f-415d-a47b-80686bec7b5c tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:19.800700 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3bd41ac0-913f-415d-a47b-80686bec7b5c tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:19.802598 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3bd41ac0-913f-415d-a47b-80686bec7b5c tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:19.803293 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3bd41ac0-913f-415d-a47b-80686bec7b5c tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:20.379356 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-dbb4c1bd-e103-4b6f-9efa-2dc96f87a222 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:20.390495 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-3bd41ac0-913f-415d-a47b-80686bec7b5c tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:20.396901 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-dbb4c1bd-e103-4b6f-9efa-2dc96f87a222 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:20.401950 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-dbb4c1bd-e103-4b6f-9efa-2dc96f87a222 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:20.403235 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-3bd41ac0-913f-415d-a47b-80686bec7b5c tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:20.405827 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-dbb4c1bd-e103-4b6f-9efa-2dc96f87a222 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] 10.222.0.26 "GET /compute/v2.1/servers/ceced78a-58d9-4175-b4fe-0d085be62c94" status: 200 len: 1874 microversion: 2.42 time: 0.780365 Oct 08 20:57:20.406589 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 756/1452] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:57:19 2022] GET /compute/v2.1/servers/ceced78a-58d9-4175-b4fe-0d085be62c94 => generated 1874 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:57:20.407784 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-3bd41ac0-913f-415d-a47b-80686bec7b5c tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:20.410547 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-3bd41ac0-913f-415d-a47b-80686bec7b5c tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] 10.222.0.26 "GET /compute/v2.1/servers/74bdac1c-9b70-46f7-b671-9752894d8980" status: 200 len: 1251 microversion: 2.25 time: 0.639376 Oct 08 20:57:20.411522 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 697/1453] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:57:19 2022] GET /compute/v2.1/servers/74bdac1c-9b70-46f7-b671-9752894d8980 => generated 1251 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:57:20.431197 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-35295a3e-ebaf-4f29-b50c-c7813d3d0cd6 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:20.431197 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-35295a3e-ebaf-4f29-b50c-c7813d3d0cd6 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] [instance: c2250e42-ea12-4161-8558-cba54fd9b4a8] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:20.438779 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-35295a3e-ebaf-4f29-b50c-c7813d3d0cd6 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:20.439289 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-35295a3e-ebaf-4f29-b50c-c7813d3d0cd6 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:20.439735 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-35295a3e-ebaf-4f29-b50c-c7813d3d0cd6 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:20.440453 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-35295a3e-ebaf-4f29-b50c-c7813d3d0cd6 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:20.440914 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-35295a3e-ebaf-4f29-b50c-c7813d3d0cd6 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:20.445520 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-35295a3e-ebaf-4f29-b50c-c7813d3d0cd6 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:20.631557 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-1ab29242-ffc9-437e-9f0d-3c7e7cd122fa tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:20.633887 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-1ab29242-ffc9-437e-9f0d-3c7e7cd122fa tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] [instance: e2d1c93f-8392-4f67-a29e-05164828f9d8] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:20.653609 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1ab29242-ffc9-437e-9f0d-3c7e7cd122fa tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:20.655520 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1ab29242-ffc9-437e-9f0d-3c7e7cd122fa tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:20.657280 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1ab29242-ffc9-437e-9f0d-3c7e7cd122fa tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:20.658982 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1ab29242-ffc9-437e-9f0d-3c7e7cd122fa tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:20.661587 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1ab29242-ffc9-437e-9f0d-3c7e7cd122fa tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:20.662135 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1ab29242-ffc9-437e-9f0d-3c7e7cd122fa tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:21.089204 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-35295a3e-ebaf-4f29-b50c-c7813d3d0cd6 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05f0f7a60257437eaa8702b664916979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7550f7ad9dc45ba9c9bfb0a5a11a774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:21.103088 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-35295a3e-ebaf-4f29-b50c-c7813d3d0cd6 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] 10.222.0.26 "GET /compute/v2.1/servers/c2250e42-ea12-4161-8558-cba54fd9b4a8" status: 200 len: 1466 microversion: 2.1 time: 0.694715 Oct 08 20:57:21.113820 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 757/1454] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:57:20 2022] GET /compute/v2.1/servers/c2250e42-ea12-4161-8558-cba54fd9b4a8 => generated 1466 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:57:21.121530 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-64ee5f16-20c5-4671-85f3-dfe55482b437 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:21.122329 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-64ee5f16-20c5-4671-85f3-dfe55482b437 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] [instance: 24d7af5b-10ba-4df7-a95d-bcd0b2104f37] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:21.138735 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-64ee5f16-20c5-4671-85f3-dfe55482b437 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:21.139444 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-64ee5f16-20c5-4671-85f3-dfe55482b437 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:21.140027 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-64ee5f16-20c5-4671-85f3-dfe55482b437 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:21.141073 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-64ee5f16-20c5-4671-85f3-dfe55482b437 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:21.141718 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-64ee5f16-20c5-4671-85f3-dfe55482b437 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:21.142475 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-64ee5f16-20c5-4671-85f3-dfe55482b437 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:21.680134 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=36 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:57:21.827951 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-64ee5f16-20c5-4671-85f3-dfe55482b437 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac1323815364df4a3a4d4dbbb9d70dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be94d02ab5244f98337fb9b90e74746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:21.858855 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-64ee5f16-20c5-4671-85f3-dfe55482b437 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] 10.222.0.26 "GET /compute/v2.1/servers/24d7af5b-10ba-4df7-a95d-bcd0b2104f37" status: 200 len: 1316 microversion: 2.1 time: 0.741005 Oct 08 20:57:21.862999 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 758/1455] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:57:21 2022] GET /compute/v2.1/servers/24d7af5b-10ba-4df7-a95d-bcd0b2104f37 => generated 1316 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:57:21.869592 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-45fd193d-5e28-4e2b-9c23-758062a74598 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:21.870250 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-45fd193d-5e28-4e2b-9c23-758062a74598 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] [instance: ceced78a-58d9-4175-b4fe-0d085be62c94] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:21.899426 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-45fd193d-5e28-4e2b-9c23-758062a74598 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:21.900306 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-45fd193d-5e28-4e2b-9c23-758062a74598 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:21.900986 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-45fd193d-5e28-4e2b-9c23-758062a74598 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:21.903287 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-45fd193d-5e28-4e2b-9c23-758062a74598 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:21.904008 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-45fd193d-5e28-4e2b-9c23-758062a74598 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:21.904739 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-45fd193d-5e28-4e2b-9c23-758062a74598 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:22.158548 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-1ab29242-ffc9-437e-9f0d-3c7e7cd122fa tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474ca64d1b1d4e30916b517645aba882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecc2dd2407b4819874bed09cb27959a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:22.174043 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-1ab29242-ffc9-437e-9f0d-3c7e7cd122fa tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d1c93f-8392-4f67-a29e-05164828f9d8" status: 200 len: 1198 microversion: 2.1 time: 1.547416 Oct 08 20:57:22.174647 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 698/1456] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:57:20 2022] GET /compute/v2.1/servers/e2d1c93f-8392-4f67-a29e-05164828f9d8 => generated 1198 bytes in 1549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 20:57:22.180188 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-8f9ee615-993a-4708-ad01-fda4f2ff0c7b tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:22.180809 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-8f9ee615-993a-4708-ad01-fda4f2ff0c7b tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] [instance: 74bdac1c-9b70-46f7-b671-9752894d8980] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:22.198997 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8f9ee615-993a-4708-ad01-fda4f2ff0c7b tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:22.199518 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8f9ee615-993a-4708-ad01-fda4f2ff0c7b tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:22.200169 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8f9ee615-993a-4708-ad01-fda4f2ff0c7b tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:22.201368 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8f9ee615-993a-4708-ad01-fda4f2ff0c7b tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:22.202013 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8f9ee615-993a-4708-ad01-fda4f2ff0c7b tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:22.202456 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8f9ee615-993a-4708-ad01-fda4f2ff0c7b tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:22.531002 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-45fd193d-5e28-4e2b-9c23-758062a74598 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:22.543222 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-45fd193d-5e28-4e2b-9c23-758062a74598 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:22.546327 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-45fd193d-5e28-4e2b-9c23-758062a74598 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:22.548127 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-45fd193d-5e28-4e2b-9c23-758062a74598 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] 10.222.0.26 "GET /compute/v2.1/servers/ceced78a-58d9-4175-b4fe-0d085be62c94" status: 200 len: 1874 microversion: 2.42 time: 0.683935 Oct 08 20:57:22.549507 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 759/1457] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:57:21 2022] GET /compute/v2.1/servers/ceced78a-58d9-4175-b4fe-0d085be62c94 => generated 1874 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:57:22.572439 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-f9da9190-ecb1-405c-8084-0567cae9042f req-d6e987ca-9931-413e-a9fb-d45b01aaff6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2d1c93f-8392-4f67-a29e-05164828f9d8", "name": "network-vif-plugged", "status": "completed", "tag": "1efef783-bf7f-44d9-bb48-aa0b771e72b2"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:57:22.598948 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-f9da9190-ecb1-405c-8084-0567cae9042f req-d6e987ca-9931-413e-a9fb-d45b01aaff6c service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:22.599674 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-f9da9190-ecb1-405c-8084-0567cae9042f req-d6e987ca-9931-413e-a9fb-d45b01aaff6c service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:22.601933 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-f9da9190-ecb1-405c-8084-0567cae9042f req-d6e987ca-9931-413e-a9fb-d45b01aaff6c service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:22.619390 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-f9da9190-ecb1-405c-8084-0567cae9042f req-d6e987ca-9931-413e-a9fb-d45b01aaff6c service nova] Creating event network-vif-plugged:1efef783-bf7f-44d9-bb48-aa0b771e72b2 for instance e2d1c93f-8392-4f67-a29e-05164828f9d8 on nch1-master-1 Oct 08 20:57:22.627584 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-f9da9190-ecb1-405c-8084-0567cae9042f req-d6e987ca-9931-413e-a9fb-d45b01aaff6c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072446 Oct 08 20:57:22.628482 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 760/1458] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:57:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:57:22.636183 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-226196df-08ab-4083-918e-1ec8b3bbb2b6 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:22.637213 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-226196df-08ab-4083-918e-1ec8b3bbb2b6 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] [instance: c2250e42-ea12-4161-8558-cba54fd9b4a8] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:22.673311 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-226196df-08ab-4083-918e-1ec8b3bbb2b6 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:22.674229 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-226196df-08ab-4083-918e-1ec8b3bbb2b6 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:22.674970 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-226196df-08ab-4083-918e-1ec8b3bbb2b6 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:22.676096 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-226196df-08ab-4083-918e-1ec8b3bbb2b6 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:22.676936 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-226196df-08ab-4083-918e-1ec8b3bbb2b6 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:22.677671 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-226196df-08ab-4083-918e-1ec8b3bbb2b6 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:22.853056 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-8f9ee615-993a-4708-ad01-fda4f2ff0c7b tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:22.883357 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-8f9ee615-993a-4708-ad01-fda4f2ff0c7b tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:22.886503 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-8f9ee615-993a-4708-ad01-fda4f2ff0c7b tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:22.899068 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-8f9ee615-993a-4708-ad01-fda4f2ff0c7b tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] 10.222.0.26 "GET /compute/v2.1/servers/74bdac1c-9b70-46f7-b671-9752894d8980" status: 200 len: 1281 microversion: 2.25 time: 0.720172 Oct 08 20:57:22.900319 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 699/1459] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:57:22 2022] GET /compute/v2.1/servers/74bdac1c-9b70-46f7-b671-9752894d8980 => generated 1281 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:57:22.924254 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-155ddcac-a89e-4147-b980-38ccc2165cae tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:22.928762 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-155ddcac-a89e-4147-b980-38ccc2165cae tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] [instance: 24d7af5b-10ba-4df7-a95d-bcd0b2104f37] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:22.973706 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-155ddcac-a89e-4147-b980-38ccc2165cae tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:22.974616 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-155ddcac-a89e-4147-b980-38ccc2165cae tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:22.976113 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-155ddcac-a89e-4147-b980-38ccc2165cae tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:22.977959 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-155ddcac-a89e-4147-b980-38ccc2165cae tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:22.981709 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-155ddcac-a89e-4147-b980-38ccc2165cae tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:22.983526 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-155ddcac-a89e-4147-b980-38ccc2165cae tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:23.564485 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-155ddcac-a89e-4147-b980-38ccc2165cae tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac1323815364df4a3a4d4dbbb9d70dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be94d02ab5244f98337fb9b90e74746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:23.579737 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-155ddcac-a89e-4147-b980-38ccc2165cae tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] 10.222.0.26 "GET /compute/v2.1/servers/24d7af5b-10ba-4df7-a95d-bcd0b2104f37" status: 200 len: 1316 microversion: 2.1 time: 0.675521 Oct 08 20:57:23.580874 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 700/1460] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:57:22 2022] GET /compute/v2.1/servers/24d7af5b-10ba-4df7-a95d-bcd0b2104f37 => generated 1316 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:57:23.590481 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-8078d5cd-c085-49e9-9d10-3bdd20b78cd2 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:23.591451 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-8078d5cd-c085-49e9-9d10-3bdd20b78cd2 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] [instance: e2d1c93f-8392-4f67-a29e-05164828f9d8] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:23.600142 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8078d5cd-c085-49e9-9d10-3bdd20b78cd2 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:23.600934 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8078d5cd-c085-49e9-9d10-3bdd20b78cd2 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:23.601496 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8078d5cd-c085-49e9-9d10-3bdd20b78cd2 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:23.602360 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8078d5cd-c085-49e9-9d10-3bdd20b78cd2 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:23.603044 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8078d5cd-c085-49e9-9d10-3bdd20b78cd2 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:23.603775 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8078d5cd-c085-49e9-9d10-3bdd20b78cd2 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:23.744159 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-226196df-08ab-4083-918e-1ec8b3bbb2b6 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05f0f7a60257437eaa8702b664916979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7550f7ad9dc45ba9c9bfb0a5a11a774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:23.756312 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-226196df-08ab-4083-918e-1ec8b3bbb2b6 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] 10.222.0.26 "GET /compute/v2.1/servers/c2250e42-ea12-4161-8558-cba54fd9b4a8" status: 200 len: 1466 microversion: 2.1 time: 1.126320 Oct 08 20:57:23.759767 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 761/1461] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:57:22 2022] GET /compute/v2.1/servers/c2250e42-ea12-4161-8558-cba54fd9b4a8 => generated 1466 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:57:23.766970 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-65ec100f-5de4-4737-815e-16ce399a861d tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:23.769116 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-65ec100f-5de4-4737-815e-16ce399a861d tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] [instance: ceced78a-58d9-4175-b4fe-0d085be62c94] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:23.781554 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-65ec100f-5de4-4737-815e-16ce399a861d tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:23.791897 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-65ec100f-5de4-4737-815e-16ce399a861d tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:23.793337 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-65ec100f-5de4-4737-815e-16ce399a861d tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:23.796206 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-65ec100f-5de4-4737-815e-16ce399a861d tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:23.796993 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-65ec100f-5de4-4737-815e-16ce399a861d tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:23.797787 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-65ec100f-5de4-4737-815e-16ce399a861d tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:23.808560 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=100 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:57:23.966262 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-8078d5cd-c085-49e9-9d10-3bdd20b78cd2 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474ca64d1b1d4e30916b517645aba882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecc2dd2407b4819874bed09cb27959a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:23.982787 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-8078d5cd-c085-49e9-9d10-3bdd20b78cd2 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d1c93f-8392-4f67-a29e-05164828f9d8" status: 200 len: 1198 microversion: 2.1 time: 0.400506 Oct 08 20:57:23.983394 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 701/1462] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:57:23 2022] GET /compute/v2.1/servers/e2d1c93f-8392-4f67-a29e-05164828f9d8 => generated 1198 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:57:23.996781 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-7dd75fe5-497f-4ebf-9470-1844c4e1ff1c req-cf911a9e-a186-407f-addc-97cff08a4045 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2250e42-ea12-4161-8558-cba54fd9b4a8", "name": "network-vif-deleted", "tag": "f4fea469-74e9-4150-8b0e-63b451dd80ed"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:57:24.019289 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-7dd75fe5-497f-4ebf-9470-1844c4e1ff1c req-cf911a9e-a186-407f-addc-97cff08a4045 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:24.020312 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-7dd75fe5-497f-4ebf-9470-1844c4e1ff1c req-cf911a9e-a186-407f-addc-97cff08a4045 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:24.021015 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-7dd75fe5-497f-4ebf-9470-1844c4e1ff1c req-cf911a9e-a186-407f-addc-97cff08a4045 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:24.068979 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-7dd75fe5-497f-4ebf-9470-1844c4e1ff1c req-cf911a9e-a186-407f-addc-97cff08a4045 service nova] Creating event network-vif-deleted:f4fea469-74e9-4150-8b0e-63b451dd80ed for instance c2250e42-ea12-4161-8558-cba54fd9b4a8 on nch2-master-1 Oct 08 20:57:24.076490 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-7dd75fe5-497f-4ebf-9470-1844c4e1ff1c req-cf911a9e-a186-407f-addc-97cff08a4045 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085198 Oct 08 20:57:24.077962 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 702/1463] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:57:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:57:24.097819 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-bbe1e3c8-289c-4858-ba50-3dcb48a766fb tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:24.099008 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-bbe1e3c8-289c-4858-ba50-3dcb48a766fb tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] [instance: 74bdac1c-9b70-46f7-b671-9752894d8980] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:24.108363 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bbe1e3c8-289c-4858-ba50-3dcb48a766fb tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:24.109352 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bbe1e3c8-289c-4858-ba50-3dcb48a766fb tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:24.110329 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bbe1e3c8-289c-4858-ba50-3dcb48a766fb tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:24.114608 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bbe1e3c8-289c-4858-ba50-3dcb48a766fb tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:24.115882 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bbe1e3c8-289c-4858-ba50-3dcb48a766fb tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:24.118337 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bbe1e3c8-289c-4858-ba50-3dcb48a766fb tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:24.479100 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-65ec100f-5de4-4737-815e-16ce399a861d tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:24.522623 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-65ec100f-5de4-4737-815e-16ce399a861d tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:24.524142 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-65ec100f-5de4-4737-815e-16ce399a861d tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:24.536656 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-65ec100f-5de4-4737-815e-16ce399a861d tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] 10.222.0.26 "GET /compute/v2.1/servers/ceced78a-58d9-4175-b4fe-0d085be62c94" status: 200 len: 1874 microversion: 2.42 time: 0.773309 Oct 08 20:57:24.542997 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 762/1464] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:57:23 2022] GET /compute/v2.1/servers/ceced78a-58d9-4175-b4fe-0d085be62c94 => generated 1874 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:57:24.605497 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-aea4cb02-f87f-43a1-88a6-f7c6183e3fd3 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:24.606653 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-aea4cb02-f87f-43a1-88a6-f7c6183e3fd3 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] [instance: 24d7af5b-10ba-4df7-a95d-bcd0b2104f37] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:24.637353 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-aea4cb02-f87f-43a1-88a6-f7c6183e3fd3 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:24.640272 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-aea4cb02-f87f-43a1-88a6-f7c6183e3fd3 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:24.640755 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-aea4cb02-f87f-43a1-88a6-f7c6183e3fd3 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:24.641545 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-aea4cb02-f87f-43a1-88a6-f7c6183e3fd3 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:24.644173 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-aea4cb02-f87f-43a1-88a6-f7c6183e3fd3 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:24.644689 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-aea4cb02-f87f-43a1-88a6-f7c6183e3fd3 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:24.852782 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-bbe1e3c8-289c-4858-ba50-3dcb48a766fb tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:24.915596 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-bbe1e3c8-289c-4858-ba50-3dcb48a766fb tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:24.923413 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-bbe1e3c8-289c-4858-ba50-3dcb48a766fb tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:24.930759 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-bbe1e3c8-289c-4858-ba50-3dcb48a766fb tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] 10.222.0.26 "GET /compute/v2.1/servers/74bdac1c-9b70-46f7-b671-9752894d8980" status: 200 len: 1281 microversion: 2.25 time: 0.847342 Oct 08 20:57:24.934286 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 703/1465] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:57:24 2022] GET /compute/v2.1/servers/74bdac1c-9b70-46f7-b671-9752894d8980 => generated 1281 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:57:24.950727 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-cea05263-f6a9-4040-b4f0-5d1617ded829 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:24.958550 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-cea05263-f6a9-4040-b4f0-5d1617ded829 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] [instance: c2250e42-ea12-4161-8558-cba54fd9b4a8] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:24.984156 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cea05263-f6a9-4040-b4f0-5d1617ded829 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:24.987064 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cea05263-f6a9-4040-b4f0-5d1617ded829 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:24.989045 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cea05263-f6a9-4040-b4f0-5d1617ded829 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:24.992600 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cea05263-f6a9-4040-b4f0-5d1617ded829 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:25.003651 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cea05263-f6a9-4040-b4f0-5d1617ded829 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:25.008976 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cea05263-f6a9-4040-b4f0-5d1617ded829 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:25.106483 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cea05263-f6a9-4040-b4f0-5d1617ded829 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:25.108302 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cea05263-f6a9-4040-b4f0-5d1617ded829 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:25.109057 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cea05263-f6a9-4040-b4f0-5d1617ded829 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:25.112399 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.objects.instance [None req-cea05263-f6a9-4040-b4f0-5d1617ded829 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lazy-loading 'fault' on Instance uuid c2250e42-ea12-4161-8558-cba54fd9b4a8 {{(pid=140491) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 20:57:25.235863 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-aea4cb02-f87f-43a1-88a6-f7c6183e3fd3 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac1323815364df4a3a4d4dbbb9d70dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be94d02ab5244f98337fb9b90e74746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:25.244262 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-aea4cb02-f87f-43a1-88a6-f7c6183e3fd3 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] 10.222.0.26 "GET /compute/v2.1/servers/24d7af5b-10ba-4df7-a95d-bcd0b2104f37" status: 200 len: 1316 microversion: 2.1 time: 0.644280 Oct 08 20:57:25.245829 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 763/1466] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:57:24 2022] GET /compute/v2.1/servers/24d7af5b-10ba-4df7-a95d-bcd0b2104f37 => generated 1316 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:57:25.250639 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-cb5a99f3-d2f9-43bc-92b2-4603bbba7a5e tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:25.251472 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-cb5a99f3-d2f9-43bc-92b2-4603bbba7a5e tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] [instance: e2d1c93f-8392-4f67-a29e-05164828f9d8] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:25.257794 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cb5a99f3-d2f9-43bc-92b2-4603bbba7a5e tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:25.258528 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cb5a99f3-d2f9-43bc-92b2-4603bbba7a5e tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:25.259203 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cb5a99f3-d2f9-43bc-92b2-4603bbba7a5e tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:25.261221 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cb5a99f3-d2f9-43bc-92b2-4603bbba7a5e tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:25.288955 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cb5a99f3-d2f9-43bc-92b2-4603bbba7a5e tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.028s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:25.299041 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cb5a99f3-d2f9-43bc-92b2-4603bbba7a5e tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:25.492031 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=22 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:57:25.699291 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-cb5a99f3-d2f9-43bc-92b2-4603bbba7a5e tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474ca64d1b1d4e30916b517645aba882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecc2dd2407b4819874bed09cb27959a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:25.711471 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-cb5a99f3-d2f9-43bc-92b2-4603bbba7a5e tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d1c93f-8392-4f67-a29e-05164828f9d8" status: 200 len: 1382 microversion: 2.1 time: 0.463872 Oct 08 20:57:25.712835 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 764/1467] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:57:25 2022] GET /compute/v2.1/servers/e2d1c93f-8392-4f67-a29e-05164828f9d8 => generated 1382 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:57:25.727517 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-eabcd7f7-fe1a-46b6-a71c-a8b5094c019f req-be2a879b-fdfd-428c-9d91-2a2d73b41de7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74bdac1c-9b70-46f7-b671-9752894d8980", "tag": "6bec4ac2-ff67-4158-be6a-9cd282b10d00"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:57:25.763824 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-eabcd7f7-fe1a-46b6-a71c-a8b5094c019f req-be2a879b-fdfd-428c-9d91-2a2d73b41de7 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:25.764668 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-eabcd7f7-fe1a-46b6-a71c-a8b5094c019f req-be2a879b-fdfd-428c-9d91-2a2d73b41de7 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:25.765368 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-eabcd7f7-fe1a-46b6-a71c-a8b5094c019f req-be2a879b-fdfd-428c-9d91-2a2d73b41de7 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:25.785146 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-cea05263-f6a9-4040-b4f0-5d1617ded829 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05f0f7a60257437eaa8702b664916979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7550f7ad9dc45ba9c9bfb0a5a11a774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:25.795012 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-cea05263-f6a9-4040-b4f0-5d1617ded829 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] 10.222.0.26 "GET /compute/v2.1/servers/c2250e42-ea12-4161-8558-cba54fd9b4a8" status: 200 len: 1309 microversion: 2.1 time: 0.859522 Oct 08 20:57:25.795694 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-eabcd7f7-fe1a-46b6-a71c-a8b5094c019f req-be2a879b-fdfd-428c-9d91-2a2d73b41de7 service nova] Creating event network-changed:6bec4ac2-ff67-4158-be6a-9cd282b10d00 for instance 74bdac1c-9b70-46f7-b671-9752894d8980 on nch2-master-1 Oct 08 20:57:25.800431 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 704/1468] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:57:24 2022] GET /compute/v2.1/servers/c2250e42-ea12-4161-8558-cba54fd9b4a8 => generated 1309 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:57:25.803228 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-eabcd7f7-fe1a-46b6-a71c-a8b5094c019f req-be2a879b-fdfd-428c-9d91-2a2d73b41de7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087674 Oct 08 20:57:25.805585 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 765/1469] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:57:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:57:25.811290 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-ec2443f8-8dfc-45da-85e8-86d13041647d tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:25.812546 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-ec2443f8-8dfc-45da-85e8-86d13041647d tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] [instance: ceced78a-58d9-4175-b4fe-0d085be62c94] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:25.822380 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ec2443f8-8dfc-45da-85e8-86d13041647d tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:25.824385 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ec2443f8-8dfc-45da-85e8-86d13041647d tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:25.826658 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ec2443f8-8dfc-45da-85e8-86d13041647d tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:25.830660 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ec2443f8-8dfc-45da-85e8-86d13041647d tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:25.831752 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ec2443f8-8dfc-45da-85e8-86d13041647d tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:25.833885 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ec2443f8-8dfc-45da-85e8-86d13041647d tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:26.006405 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-a0f6eabd-1357-4186-8ea3-6f8bd821780d tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Action: 'create', calling method: .version_select at 0x7f1a8d4b1550>, body: {"keypair": {"name": "tempest-keypair-729921336", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCc33zxcrpIxrMQprIPcWpypxugzkLkm7TGXbFsIlxebgs/i/RMDqjm3r2vxxVrsAFTzdLWI6a/QN06BOVOJJSQd8+mCNawHtnpjymjiy1O8/JvWsqp7wBLZYyONmcMapw=="}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:57:26.025957 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-a0f6eabd-1357-4186-8ea3-6f8bd821780d tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Getting quotas for project 5cdaf5b9230f4e09949a39a5cbe72011. Resources: {'key_pairs'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 20:57:26.032439 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-a0f6eabd-1357-4186-8ea3-6f8bd821780d tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Getting quotas for user 5d9facf5ea0743cb821cec1b40f6b609 and project 5cdaf5b9230f4e09949a39a5cbe72011. Resources: {'key_pairs'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 20:57:26.066663 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-a0f6eabd-1357-4186-8ea3-6f8bd821780d tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.264076 Oct 08 20:57:26.075234 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 705/1470] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Oct 8 20:57:25 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:57:26.081469 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-a0a7425c-daae-4390-94d6-0639199dee49 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:26.083280 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-a0a7425c-daae-4390-94d6-0639199dee49 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] [instance: e2d1c93f-8392-4f67-a29e-05164828f9d8] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:26.093162 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a0a7425c-daae-4390-94d6-0639199dee49 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:26.093958 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a0a7425c-daae-4390-94d6-0639199dee49 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:26.094662 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a0a7425c-daae-4390-94d6-0639199dee49 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:26.095506 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a0a7425c-daae-4390-94d6-0639199dee49 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:26.096284 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a0a7425c-daae-4390-94d6-0639199dee49 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:26.096845 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a0a7425c-daae-4390-94d6-0639199dee49 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:26.306510 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-ec2443f8-8dfc-45da-85e8-86d13041647d tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:26.317252 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-ec2443f8-8dfc-45da-85e8-86d13041647d tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:26.320165 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-ec2443f8-8dfc-45da-85e8-86d13041647d tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:26.321589 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-ec2443f8-8dfc-45da-85e8-86d13041647d tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] 10.222.0.26 "GET /compute/v2.1/servers/ceced78a-58d9-4175-b4fe-0d085be62c94" status: 200 len: 1874 microversion: 2.42 time: 0.514647 Oct 08 20:57:26.334394 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 766/1471] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:57:25 2022] GET /compute/v2.1/servers/ceced78a-58d9-4175-b4fe-0d085be62c94 => generated 1874 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:57:26.337287 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-a0a7425c-daae-4390-94d6-0639199dee49 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/e2d1c93f-8392-4f67-a29e-05164828f9d8" status: 200 len: 1533 microversion: 2.1 time: 0.260234 Oct 08 20:57:26.341776 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 706/1472] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:57:26 2022] GET /compute/v2.1/servers/e2d1c93f-8392-4f67-a29e-05164828f9d8 => generated 1533 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:57:26.346104 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-4c88d6b7-eadc-4490-afb4-f098967b3c8d tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:26.346948 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-4c88d6b7-eadc-4490-afb4-f098967b3c8d tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] [instance: 74bdac1c-9b70-46f7-b671-9752894d8980] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:26.351184 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-64547123-0880-40c4-b93f-e1124e890110 req-c48b7de2-4655-4ec1-afef-df4fa1d6d38b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24d7af5b-10ba-4df7-a95d-bcd0b2104f37", "tag": "fd61dc22-1328-45bc-8a61-27b2a295a029"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:57:26.353668 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4c88d6b7-eadc-4490-afb4-f098967b3c8d tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:26.354338 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4c88d6b7-eadc-4490-afb4-f098967b3c8d tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:26.354980 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4c88d6b7-eadc-4490-afb4-f098967b3c8d tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:26.355862 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4c88d6b7-eadc-4490-afb4-f098967b3c8d tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:26.356485 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4c88d6b7-eadc-4490-afb4-f098967b3c8d tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:26.357086 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4c88d6b7-eadc-4490-afb4-f098967b3c8d tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:26.380126 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-64547123-0880-40c4-b93f-e1124e890110 req-c48b7de2-4655-4ec1-afef-df4fa1d6d38b service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:26.385271 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-64547123-0880-40c4-b93f-e1124e890110 req-c48b7de2-4655-4ec1-afef-df4fa1d6d38b service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:26.385492 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-64547123-0880-40c4-b93f-e1124e890110 req-c48b7de2-4655-4ec1-afef-df4fa1d6d38b service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:26.400850 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-64547123-0880-40c4-b93f-e1124e890110 req-c48b7de2-4655-4ec1-afef-df4fa1d6d38b service nova] Creating event network-changed:fd61dc22-1328-45bc-8a61-27b2a295a029 for instance 24d7af5b-10ba-4df7-a95d-bcd0b2104f37 on nch1-master-1 Oct 08 20:57:26.407581 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-64547123-0880-40c4-b93f-e1124e890110 req-c48b7de2-4655-4ec1-afef-df4fa1d6d38b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063543 Oct 08 20:57:26.409476 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 707/1473] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:57:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:57:26.419385 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-93024f86-969b-48aa-83f1-e01c1867c5fa tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:26.421022 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-93024f86-969b-48aa-83f1-e01c1867c5fa tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] [instance: 24d7af5b-10ba-4df7-a95d-bcd0b2104f37] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:26.433635 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-93024f86-969b-48aa-83f1-e01c1867c5fa tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:26.435144 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-93024f86-969b-48aa-83f1-e01c1867c5fa tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:26.436422 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-93024f86-969b-48aa-83f1-e01c1867c5fa tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:26.441014 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-93024f86-969b-48aa-83f1-e01c1867c5fa tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:26.442372 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-93024f86-969b-48aa-83f1-e01c1867c5fa tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:26.443710 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-93024f86-969b-48aa-83f1-e01c1867c5fa tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:26.734527 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-4c88d6b7-eadc-4490-afb4-f098967b3c8d tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:26.763476 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-4c88d6b7-eadc-4490-afb4-f098967b3c8d tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:26.768912 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-4c88d6b7-eadc-4490-afb4-f098967b3c8d tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:26.771103 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-4c88d6b7-eadc-4490-afb4-f098967b3c8d tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] 10.222.0.26 "GET /compute/v2.1/servers/74bdac1c-9b70-46f7-b671-9752894d8980" status: 200 len: 1281 microversion: 2.25 time: 0.435426 Oct 08 20:57:26.771699 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 767/1474] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:57:26 2022] GET /compute/v2.1/servers/74bdac1c-9b70-46f7-b671-9752894d8980 => generated 1281 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:57:26.784283 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-71096689-980a-4fa2-a5ac-5b6728a759bf tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:26.784283 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-71096689-980a-4fa2-a5ac-5b6728a759bf tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] [instance: e2d1c93f-8392-4f67-a29e-05164828f9d8] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:26.792560 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-71096689-980a-4fa2-a5ac-5b6728a759bf tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:26.803612 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-71096689-980a-4fa2-a5ac-5b6728a759bf tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:26.806151 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-71096689-980a-4fa2-a5ac-5b6728a759bf tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:26.806971 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-71096689-980a-4fa2-a5ac-5b6728a759bf tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:26.807461 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-71096689-980a-4fa2-a5ac-5b6728a759bf tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:26.807911 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-71096689-980a-4fa2-a5ac-5b6728a759bf tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:26.919635 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-93024f86-969b-48aa-83f1-e01c1867c5fa tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac1323815364df4a3a4d4dbbb9d70dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be94d02ab5244f98337fb9b90e74746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:26.933715 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-93024f86-969b-48aa-83f1-e01c1867c5fa tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] 10.222.0.26 "GET /compute/v2.1/servers/24d7af5b-10ba-4df7-a95d-bcd0b2104f37" status: 200 len: 1316 microversion: 2.1 time: 0.521666 Oct 08 20:57:26.934377 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 708/1475] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:57:26 2022] GET /compute/v2.1/servers/24d7af5b-10ba-4df7-a95d-bcd0b2104f37 => generated 1316 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:57:26.962848 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-59b36fa1-35b9-4014-a407-936ccbc50204 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:26.963233 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-59b36fa1-35b9-4014-a407-936ccbc50204 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] [instance: c2250e42-ea12-4161-8558-cba54fd9b4a8] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:26.970726 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-59b36fa1-35b9-4014-a407-936ccbc50204 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:26.971297 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-59b36fa1-35b9-4014-a407-936ccbc50204 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:26.971746 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-59b36fa1-35b9-4014-a407-936ccbc50204 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:26.972526 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-59b36fa1-35b9-4014-a407-936ccbc50204 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:26.972994 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-59b36fa1-35b9-4014-a407-936ccbc50204 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:26.973490 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-59b36fa1-35b9-4014-a407-936ccbc50204 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:27.017837 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-59b36fa1-35b9-4014-a407-936ccbc50204 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] HTTP exception thrown: Instance c2250e42-ea12-4161-8558-cba54fd9b4a8 could not be found. Oct 08 20:57:27.019745 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-59b36fa1-35b9-4014-a407-936ccbc50204 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Request method failure captured: Oct 08 20:57:27.019745 ncdv-master-1 devstack@n-api.service[140491]: request: GET /compute/v2.1/servers/c2250e42-ea12-4161-8558-cba54fd9b4a8 HTTP/1.1 Oct 08 20:57:27.019745 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 20:57:27.019745 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 20:57:27.019745 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 20:57:27.019745 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 20:57:27.019745 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 20:57:27.019745 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 20:57:27.019745 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 20:57:27.019745 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 20:57:27.019745 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQePl59-CwHKmgYk_Bq3YcgeSk0CI1yw_ya8PcQMsx71VbNnDNsniK4QUc6suoZkp_m36gXaQWrRHb-01_GThnl2EohRaw4s0BIJivh_UZOmqrJPZUsYraNnif2FsyxyuK8fMSjVa7JoXAEn9C7tLEWoAkWeOcaxNBos5OVcwZzmiCww Oct 08 20:57:27.019745 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 20:57:27.019745 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 20:57:27.019745 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 20:57:27.019745 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 20:57:27.019745 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 20:57:27.019745 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 20:57:27.019745 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: d7550f7ad9dc45ba9c9bfb0a5a11a774 Oct 08 20:57:27.019745 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-LiveMigrationNegativeTest-1404531554 Oct 08 20:57:27.019745 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 20:57:27.019745 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 20:57:27.019745 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d7550f7ad9dc45ba9c9bfb0a5a11a774"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d7550f7ad9dc45ba9c9bfb0a5a11a774"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d7550f7ad9dc45ba9c9bfb0a5a11a774"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d7550f7ad9dc45ba9c9bfb0a5a11a774"}]}] Oct 08 20:57:27.019745 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-LiveMigrationNegativeTest-1404531554 Oct 08 20:57:27.019745 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: d7550f7ad9dc45ba9c9bfb0a5a11a774 Oct 08 20:57:27.019745 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1404531554 Oct 08 20:57:27.019745 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-LiveMigrationNegativeTest-1404531554-project Oct 08 20:57:27.019745 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 20:57:27.019745 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 20:57:27.019745 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 05f0f7a60257437eaa8702b664916979 Oct 08 20:57:27.019745 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-LiveMigrationNegativeTest-1404531554-project Oct 08 20:57:27.019745 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 20:57:27.019745 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance c2250e42-ea12-4161-8558-cba54fd9b4a8 could not be found. Oct 08 20:57:27.019745 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': 'c2250e42-ea12-4161-8558-cba54fd9b4a8'} Oct 08 20:57:27.019745 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:57:27.019745 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:57:27.019745 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 20:57:27.019745 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 20:57:27.019745 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 20:57:27.019745 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 20:57:27.019745 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 20:57:27.019745 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 20:57:27.019745 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 20:57:27.019745 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 20:57:27.019745 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2250e42-ea12-4161-8558-cba54fd9b4a8 could not be found. Oct 08 20:57:27.019745 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:57:27.019745 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:57:27.019745 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:57:27.019745 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:57:27.019745 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:57:27.019745 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:57:27.019745 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:57:27.019745 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:57:27.019745 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:57:27.019745 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:57:27.019745 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 20:57:27.019745 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 20:57:27.019745 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 20:57:27.019745 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 20:57:27.019745 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 20:57:27.019745 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 20:57:27.019745 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2250e42-ea12-4161-8558-cba54fd9b4a8 could not be found. Oct 08 20:57:27.019745 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:57:27.019745 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:57:27.019745 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:57:27.025217 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:57:27.025217 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:57:27.025217 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:57:27.025217 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 20:57:27.025217 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 20:57:27.025217 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2250e42-ea12-4161-8558-cba54fd9b4a8 could not be found. Oct 08 20:57:27.025217 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:57:27.025217 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-59b36fa1-35b9-4014-a407-936ccbc50204 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Returning 404 to user: Instance c2250e42-ea12-4161-8558-cba54fd9b4a8 could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:57:27.025217 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-59b36fa1-35b9-4014-a407-936ccbc50204 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] 10.222.0.26 "GET /compute/v2.1/servers/c2250e42-ea12-4161-8558-cba54fd9b4a8" status: 404 len: 111 microversion: 2.1 time: 0.083847 Oct 08 20:57:27.025217 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 709/1476] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:57:26 2022] GET /compute/v2.1/servers/c2250e42-ea12-4161-8558-cba54fd9b4a8 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 20:57:27.031989 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-718cee9d-595a-43fa-b3f1-dcb66824d8b2 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:27.032709 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-718cee9d-595a-43fa-b3f1-dcb66824d8b2 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] [instance: 7f720341-f7ad-4365-8aeb-0aad8afb46b6] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:27.045283 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-718cee9d-595a-43fa-b3f1-dcb66824d8b2 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:27.045857 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-718cee9d-595a-43fa-b3f1-dcb66824d8b2 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:27.046416 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-718cee9d-595a-43fa-b3f1-dcb66824d8b2 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:27.047264 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-718cee9d-595a-43fa-b3f1-dcb66824d8b2 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:27.047830 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-718cee9d-595a-43fa-b3f1-dcb66824d8b2 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:27.048564 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-718cee9d-595a-43fa-b3f1-dcb66824d8b2 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:27.091791 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-718cee9d-595a-43fa-b3f1-dcb66824d8b2 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] [instance: 7f720341-f7ad-4365-8aeb-0aad8afb46b6] Going to try to terminate instance {{(pid=140491) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 20:57:27.198118 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-718cee9d-595a-43fa-b3f1-dcb66824d8b2 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] 10.222.0.26 "DELETE /compute/v2.1/servers/7f720341-f7ad-4365-8aeb-0aad8afb46b6" status: 204 len: 0 microversion: 2.1 time: 0.169670 Oct 08 20:57:27.202282 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 710/1477] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 20:57:27 2022] DELETE /compute/v2.1/servers/7f720341-f7ad-4365-8aeb-0aad8afb46b6 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 20:57:27.208748 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-761ac0e5-2cee-488b-a830-e1a7fbed80b2 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:27.209520 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-761ac0e5-2cee-488b-a830-e1a7fbed80b2 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] [instance: 7f720341-f7ad-4365-8aeb-0aad8afb46b6] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:27.216552 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-761ac0e5-2cee-488b-a830-e1a7fbed80b2 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:27.217577 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-761ac0e5-2cee-488b-a830-e1a7fbed80b2 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:27.218185 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-761ac0e5-2cee-488b-a830-e1a7fbed80b2 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:27.219070 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-761ac0e5-2cee-488b-a830-e1a7fbed80b2 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:27.219694 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-761ac0e5-2cee-488b-a830-e1a7fbed80b2 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:27.220289 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-761ac0e5-2cee-488b-a830-e1a7fbed80b2 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:27.246640 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:57:27.598267 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-761ac0e5-2cee-488b-a830-e1a7fbed80b2 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05f0f7a60257437eaa8702b664916979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7550f7ad9dc45ba9c9bfb0a5a11a774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:27.614251 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-761ac0e5-2cee-488b-a830-e1a7fbed80b2 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] 10.222.0.26 "GET /compute/v2.1/servers/7f720341-f7ad-4365-8aeb-0aad8afb46b6" status: 200 len: 1474 microversion: 2.1 time: 0.410538 Oct 08 20:57:27.618355 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 711/1478] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:57:27 2022] GET /compute/v2.1/servers/7f720341-f7ad-4365-8aeb-0aad8afb46b6 => generated 1474 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:57:27.622709 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-71096689-980a-4fa2-a5ac-5b6728a759bf tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/e2d1c93f-8392-4f67-a29e-05164828f9d8" status: 200 len: 1533 microversion: 2.1 time: 0.849315 Oct 08 20:57:27.623626 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 768/1479] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:57:26 2022] GET /compute/v2.1/servers/e2d1c93f-8392-4f67-a29e-05164828f9d8 => generated 1533 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:57:27.629075 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-96826f19-28ab-454e-95b2-324599e69309 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:27.629735 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-96826f19-28ab-454e-95b2-324599e69309 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] [instance: ceced78a-58d9-4175-b4fe-0d085be62c94] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:27.640103 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-96826f19-28ab-454e-95b2-324599e69309 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:27.640941 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-96826f19-28ab-454e-95b2-324599e69309 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:27.641882 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-96826f19-28ab-454e-95b2-324599e69309 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:27.643525 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-96826f19-28ab-454e-95b2-324599e69309 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:27.644400 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-96826f19-28ab-454e-95b2-324599e69309 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:27.644935 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-96826f19-28ab-454e-95b2-324599e69309 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:27.656042 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-9068b795-67d3-41e2-a3d2-8722e53a60f7 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:27.660205 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9068b795-67d3-41e2-a3d2-8722e53a60f7 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:27.666382 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9068b795-67d3-41e2-a3d2-8722e53a60f7 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:27.667155 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9068b795-67d3-41e2-a3d2-8722e53a60f7 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:27.668296 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9068b795-67d3-41e2-a3d2-8722e53a60f7 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:27.669074 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9068b795-67d3-41e2-a3d2-8722e53a60f7 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:27.669745 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9068b795-67d3-41e2-a3d2-8722e53a60f7 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:27.719419 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-9068b795-67d3-41e2-a3d2-8722e53a60f7 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.075059 Oct 08 20:57:27.720167 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 769/1480] 10.222.0.26 () {58 vars in 1176 bytes} [Sat Oct 8 20:57:27 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 08 20:57:27.738576 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-22236678-434b-45bb-acf2-5f0fa3b3e593 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": false, "disk_over_commit": false}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:57:27.742187 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-22236678-434b-45bb-acf2-5f0fa3b3e593 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] [instance: e2d1c93f-8392-4f67-a29e-05164828f9d8] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:27.752131 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-22236678-434b-45bb-acf2-5f0fa3b3e593 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:27.752648 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-22236678-434b-45bb-acf2-5f0fa3b3e593 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:27.753101 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-22236678-434b-45bb-acf2-5f0fa3b3e593 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:27.754023 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-22236678-434b-45bb-acf2-5f0fa3b3e593 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:27.754492 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-22236678-434b-45bb-acf2-5f0fa3b3e593 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:27.754930 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-22236678-434b-45bb-acf2-5f0fa3b3e593 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:27.818936 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.objects.instance [None req-22236678-434b-45bb-acf2-5f0fa3b3e593 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Lazy-loading 'flavor' on Instance uuid e2d1c93f-8392-4f67-a29e-05164828f9d8 {{(pid=140492) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 20:57:27.842029 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-22236678-434b-45bb-acf2-5f0fa3b3e593 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] [instance: e2d1c93f-8392-4f67-a29e-05164828f9d8] Going to try to live migrate instance to nch2-master-1 {{(pid=140492) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 08 20:57:27.953087 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=6 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:57:28.215453 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-96826f19-28ab-454e-95b2-324599e69309 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:28.234323 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-96826f19-28ab-454e-95b2-324599e69309 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:28.243572 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-96826f19-28ab-454e-95b2-324599e69309 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:28.245148 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-96826f19-28ab-454e-95b2-324599e69309 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] 10.222.0.26 "GET /compute/v2.1/servers/ceced78a-58d9-4175-b4fe-0d085be62c94" status: 200 len: 1874 microversion: 2.42 time: 0.625816 Oct 08 20:57:28.247091 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 712/1481] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:57:27 2022] GET /compute/v2.1/servers/ceced78a-58d9-4175-b4fe-0d085be62c94 => generated 1874 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:57:28.257002 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-34974c08-fb40-47e4-a21c-8dd8c1541d0d tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:28.260943 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-34974c08-fb40-47e4-a21c-8dd8c1541d0d tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] [instance: 74bdac1c-9b70-46f7-b671-9752894d8980] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:28.278508 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-34974c08-fb40-47e4-a21c-8dd8c1541d0d tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:28.280867 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-34974c08-fb40-47e4-a21c-8dd8c1541d0d tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:28.281598 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-34974c08-fb40-47e4-a21c-8dd8c1541d0d tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:28.284404 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-34974c08-fb40-47e4-a21c-8dd8c1541d0d tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:28.287201 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-34974c08-fb40-47e4-a21c-8dd8c1541d0d tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:28.290018 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-34974c08-fb40-47e4-a21c-8dd8c1541d0d tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:28.996028 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-34974c08-fb40-47e4-a21c-8dd8c1541d0d tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:29.005820 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-34974c08-fb40-47e4-a21c-8dd8c1541d0d tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:29.007868 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-34974c08-fb40-47e4-a21c-8dd8c1541d0d tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:29.009424 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-34974c08-fb40-47e4-a21c-8dd8c1541d0d tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] 10.222.0.26 "GET /compute/v2.1/servers/74bdac1c-9b70-46f7-b671-9752894d8980" status: 200 len: 1281 microversion: 2.25 time: 0.760623 Oct 08 20:57:29.018431 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 713/1482] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:57:28 2022] GET /compute/v2.1/servers/74bdac1c-9b70-46f7-b671-9752894d8980 => generated 1281 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:57:29.031577 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-34c88c8a-04b3-48cb-83c9-67f4ea89bff0 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:29.032483 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-34c88c8a-04b3-48cb-83c9-67f4ea89bff0 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] [instance: 24d7af5b-10ba-4df7-a95d-bcd0b2104f37] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:29.040648 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-34c88c8a-04b3-48cb-83c9-67f4ea89bff0 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:29.041815 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-34c88c8a-04b3-48cb-83c9-67f4ea89bff0 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:29.042496 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-34c88c8a-04b3-48cb-83c9-67f4ea89bff0 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:29.043479 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-34c88c8a-04b3-48cb-83c9-67f4ea89bff0 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:29.044225 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-34c88c8a-04b3-48cb-83c9-67f4ea89bff0 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:29.045468 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-34c88c8a-04b3-48cb-83c9-67f4ea89bff0 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:29.675365 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-34c88c8a-04b3-48cb-83c9-67f4ea89bff0 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac1323815364df4a3a4d4dbbb9d70dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be94d02ab5244f98337fb9b90e74746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:29.730007 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-34c88c8a-04b3-48cb-83c9-67f4ea89bff0 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] 10.222.0.26 "GET /compute/v2.1/servers/24d7af5b-10ba-4df7-a95d-bcd0b2104f37" status: 200 len: 1316 microversion: 2.1 time: 0.704884 Oct 08 20:57:29.733076 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 714/1483] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:57:29 2022] GET /compute/v2.1/servers/24d7af5b-10ba-4df7-a95d-bcd0b2104f37 => generated 1316 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:57:29.746370 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-2a403721-2921-43e5-8ead-234390ef2cec tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:29.748140 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-2a403721-2921-43e5-8ead-234390ef2cec tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] [instance: 7f720341-f7ad-4365-8aeb-0aad8afb46b6] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:29.774296 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2a403721-2921-43e5-8ead-234390ef2cec tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:29.775172 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2a403721-2921-43e5-8ead-234390ef2cec tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:29.775867 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2a403721-2921-43e5-8ead-234390ef2cec tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:29.777018 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2a403721-2921-43e5-8ead-234390ef2cec tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:29.778129 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2a403721-2921-43e5-8ead-234390ef2cec tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:29.778831 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2a403721-2921-43e5-8ead-234390ef2cec tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:30.555407 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-2a403721-2921-43e5-8ead-234390ef2cec tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05f0f7a60257437eaa8702b664916979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7550f7ad9dc45ba9c9bfb0a5a11a774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:30.571581 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-2a403721-2921-43e5-8ead-234390ef2cec tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] 10.222.0.26 "GET /compute/v2.1/servers/7f720341-f7ad-4365-8aeb-0aad8afb46b6" status: 200 len: 1474 microversion: 2.1 time: 0.833416 Oct 08 20:57:30.572719 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 715/1484] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:57:29 2022] GET /compute/v2.1/servers/7f720341-f7ad-4365-8aeb-0aad8afb46b6 => generated 1474 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:57:30.589789 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-95b9d8d0-480e-4712-a8b5-df38a9261d31 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:30.590749 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-95b9d8d0-480e-4712-a8b5-df38a9261d31 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] [instance: ceced78a-58d9-4175-b4fe-0d085be62c94] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:30.597379 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-95b9d8d0-480e-4712-a8b5-df38a9261d31 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:30.598144 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-95b9d8d0-480e-4712-a8b5-df38a9261d31 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:30.598589 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-95b9d8d0-480e-4712-a8b5-df38a9261d31 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:30.599427 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-95b9d8d0-480e-4712-a8b5-df38a9261d31 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:30.600049 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-95b9d8d0-480e-4712-a8b5-df38a9261d31 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:30.601035 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-95b9d8d0-480e-4712-a8b5-df38a9261d31 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:30.770494 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-22236678-434b-45bb-acf2-5f0fa3b3e593 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/e2d1c93f-8392-4f67-a29e-05164828f9d8/action" status: 202 len: 0 microversion: 2.1 time: 3.041332 Oct 08 20:57:30.771256 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 770/1485] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 20:57:27 2022] POST /compute/v2.1/servers/e2d1c93f-8392-4f67-a29e-05164828f9d8/action => generated 0 bytes in 3043 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 20:57:30.791487 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-2091f52c-806d-44b9-b160-2bee23f30001 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:30.792402 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-2091f52c-806d-44b9-b160-2bee23f30001 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] [instance: 74bdac1c-9b70-46f7-b671-9752894d8980] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:30.822068 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2091f52c-806d-44b9-b160-2bee23f30001 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:30.825520 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2091f52c-806d-44b9-b160-2bee23f30001 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:30.829428 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2091f52c-806d-44b9-b160-2bee23f30001 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:30.830823 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2091f52c-806d-44b9-b160-2bee23f30001 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:30.831542 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2091f52c-806d-44b9-b160-2bee23f30001 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:30.833581 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2091f52c-806d-44b9-b160-2bee23f30001 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:31.211428 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-2091f52c-806d-44b9-b160-2bee23f30001 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:31.229120 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-2091f52c-806d-44b9-b160-2bee23f30001 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:31.231250 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-2091f52c-806d-44b9-b160-2bee23f30001 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:31.232606 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-2091f52c-806d-44b9-b160-2bee23f30001 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] 10.222.0.26 "GET /compute/v2.1/servers/74bdac1c-9b70-46f7-b671-9752894d8980" status: 200 len: 1281 microversion: 2.25 time: 0.459632 Oct 08 20:57:31.233165 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 771/1486] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:57:30 2022] GET /compute/v2.1/servers/74bdac1c-9b70-46f7-b671-9752894d8980 => generated 1281 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:57:31.250208 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-8116f5c2-46db-44e5-ab18-b101bd7bb746 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:31.250832 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-8116f5c2-46db-44e5-ab18-b101bd7bb746 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] [instance: 24d7af5b-10ba-4df7-a95d-bcd0b2104f37] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:31.257776 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8116f5c2-46db-44e5-ab18-b101bd7bb746 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:31.258509 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8116f5c2-46db-44e5-ab18-b101bd7bb746 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:31.259157 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8116f5c2-46db-44e5-ab18-b101bd7bb746 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:31.260390 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8116f5c2-46db-44e5-ab18-b101bd7bb746 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:31.260858 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8116f5c2-46db-44e5-ab18-b101bd7bb746 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:31.261490 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8116f5c2-46db-44e5-ab18-b101bd7bb746 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:31.597464 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-95b9d8d0-480e-4712-a8b5-df38a9261d31 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:31.609358 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-95b9d8d0-480e-4712-a8b5-df38a9261d31 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:31.620808 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-95b9d8d0-480e-4712-a8b5-df38a9261d31 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:31.622517 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-95b9d8d0-480e-4712-a8b5-df38a9261d31 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] 10.222.0.26 "GET /compute/v2.1/servers/ceced78a-58d9-4175-b4fe-0d085be62c94" status: 200 len: 1874 microversion: 2.42 time: 1.048193 Oct 08 20:57:31.637720 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 716/1487] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:57:30 2022] GET /compute/v2.1/servers/ceced78a-58d9-4175-b4fe-0d085be62c94 => generated 1874 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:57:31.656103 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-a984af7c-6c19-47d9-9e31-d9e24022e64c tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:31.663909 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-a984af7c-6c19-47d9-9e31-d9e24022e64c tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] [instance: e2d1c93f-8392-4f67-a29e-05164828f9d8] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:31.670436 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a984af7c-6c19-47d9-9e31-d9e24022e64c tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:31.670811 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-8116f5c2-46db-44e5-ab18-b101bd7bb746 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac1323815364df4a3a4d4dbbb9d70dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be94d02ab5244f98337fb9b90e74746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:31.676313 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a984af7c-6c19-47d9-9e31-d9e24022e64c tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:31.677046 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a984af7c-6c19-47d9-9e31-d9e24022e64c tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:31.678286 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a984af7c-6c19-47d9-9e31-d9e24022e64c tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:31.679106 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a984af7c-6c19-47d9-9e31-d9e24022e64c tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:31.679767 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a984af7c-6c19-47d9-9e31-d9e24022e64c tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:31.684612 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-8116f5c2-46db-44e5-ab18-b101bd7bb746 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] 10.222.0.26 "GET /compute/v2.1/servers/24d7af5b-10ba-4df7-a95d-bcd0b2104f37" status: 200 len: 1316 microversion: 2.1 time: 0.450116 Oct 08 20:57:31.686559 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 772/1488] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:57:31 2022] GET /compute/v2.1/servers/24d7af5b-10ba-4df7-a95d-bcd0b2104f37 => generated 1316 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:57:31.699092 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-ac089040-b4a7-413f-8fad-44d1284c9363 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:31.717862 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-ac089040-b4a7-413f-8fad-44d1284c9363 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] [instance: 7f720341-f7ad-4365-8aeb-0aad8afb46b6] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:31.741275 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ac089040-b4a7-413f-8fad-44d1284c9363 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:31.742445 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ac089040-b4a7-413f-8fad-44d1284c9363 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:31.744931 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ac089040-b4a7-413f-8fad-44d1284c9363 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:31.746741 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ac089040-b4a7-413f-8fad-44d1284c9363 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:31.747376 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ac089040-b4a7-413f-8fad-44d1284c9363 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:31.748051 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ac089040-b4a7-413f-8fad-44d1284c9363 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:32.010583 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-a984af7c-6c19-47d9-9e31-d9e24022e64c tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474ca64d1b1d4e30916b517645aba882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecc2dd2407b4819874bed09cb27959a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:32.022661 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-a984af7c-6c19-47d9-9e31-d9e24022e64c tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d1c93f-8392-4f67-a29e-05164828f9d8" status: 200 len: 1392 microversion: 2.1 time: 0.383368 Oct 08 20:57:32.025981 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 717/1489] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:57:31 2022] GET /compute/v2.1/servers/e2d1c93f-8392-4f67-a29e-05164828f9d8 => generated 1392 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:57:32.051209 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-6ddad537-706b-4ac4-84ed-e5a6e153f6e7 req-254a4efb-26c4-4bc4-a07b-85613f97a7ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f720341-f7ad-4365-8aeb-0aad8afb46b6", "name": "network-vif-deleted", "tag": "2b088aa4-bf3c-4570-9a9c-462b7126b498"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:57:32.098119 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-6ddad537-706b-4ac4-84ed-e5a6e153f6e7 req-254a4efb-26c4-4bc4-a07b-85613f97a7ca service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:32.098849 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-6ddad537-706b-4ac4-84ed-e5a6e153f6e7 req-254a4efb-26c4-4bc4-a07b-85613f97a7ca service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:32.099304 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-6ddad537-706b-4ac4-84ed-e5a6e153f6e7 req-254a4efb-26c4-4bc4-a07b-85613f97a7ca service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:32.134836 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-6ddad537-706b-4ac4-84ed-e5a6e153f6e7 req-254a4efb-26c4-4bc4-a07b-85613f97a7ca service nova] Creating event network-vif-deleted:2b088aa4-bf3c-4570-9a9c-462b7126b498 for instance 7f720341-f7ad-4365-8aeb-0aad8afb46b6 on nch1-master-1 Oct 08 20:57:32.150933 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-ac089040-b4a7-413f-8fad-44d1284c9363 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05f0f7a60257437eaa8702b664916979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7550f7ad9dc45ba9c9bfb0a5a11a774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:32.155824 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-6ddad537-706b-4ac4-84ed-e5a6e153f6e7 req-254a4efb-26c4-4bc4-a07b-85613f97a7ca service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127574 Oct 08 20:57:32.157292 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 718/1490] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:57:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:57:32.168384 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-ac089040-b4a7-413f-8fad-44d1284c9363 tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] 10.222.0.26 "GET /compute/v2.1/servers/7f720341-f7ad-4365-8aeb-0aad8afb46b6" status: 200 len: 1432 microversion: 2.1 time: 0.475633 Oct 08 20:57:32.170819 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-eed4e1d7-b847-4ffa-a07a-6f53e26b2336 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-1006918187", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "f1a2476a-9eef-4a40-be11-57a6b79039e5"}], "security_groups": [{"name": "tempest-securitygroup--1088215528"}], "key_name": "tempest-keypair-729921336", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:57:32.172222 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 773/1491] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:57:31 2022] GET /compute/v2.1/servers/7f720341-f7ad-4365-8aeb-0aad8afb46b6 => generated 1432 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:57:32.288567 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-6011cb7d-358f-41de-b1c6-d4a37553b0c7 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:32.289253 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-6011cb7d-358f-41de-b1c6-d4a37553b0c7 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] [instance: 74bdac1c-9b70-46f7-b671-9752894d8980] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:32.306238 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6011cb7d-358f-41de-b1c6-d4a37553b0c7 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:32.307554 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6011cb7d-358f-41de-b1c6-d4a37553b0c7 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:32.308302 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6011cb7d-358f-41de-b1c6-d4a37553b0c7 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:32.322233 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6011cb7d-358f-41de-b1c6-d4a37553b0c7 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:32.323122 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6011cb7d-358f-41de-b1c6-d4a37553b0c7 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:32.323804 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6011cb7d-358f-41de-b1c6-d4a37553b0c7 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:32.437956 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.network.neutron [None req-eed4e1d7-b847-4ffa-a07a-6f53e26b2336 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] validate_networks() for [('f1a2476a-9eef-4a40-be11-57a6b79039e5', None, None, None, None, None)] {{(pid=140491) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 20:57:33.321653 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-6011cb7d-358f-41de-b1c6-d4a37553b0c7 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:33.337108 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-6011cb7d-358f-41de-b1c6-d4a37553b0c7 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:33.338222 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-6011cb7d-358f-41de-b1c6-d4a37553b0c7 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:33.339380 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-6011cb7d-358f-41de-b1c6-d4a37553b0c7 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] 10.222.0.26 "GET /compute/v2.1/servers/74bdac1c-9b70-46f7-b671-9752894d8980" status: 200 len: 1281 microversion: 2.25 time: 1.075157 Oct 08 20:57:33.344373 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 774/1492] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:57:32 2022] GET /compute/v2.1/servers/74bdac1c-9b70-46f7-b671-9752894d8980 => generated 1281 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:57:33.419888 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-eed4e1d7-b847-4ffa-a07a-6f53e26b2336 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Getting quotas for project 5cdaf5b9230f4e09949a39a5cbe72011. Resources: dict_keys(['metadata_items']) {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 20:57:33.422402 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:UPDATE=2 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:57:33.429441 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-eed4e1d7-b847-4ffa-a07a-6f53e26b2336 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Getting quotas for user 5d9facf5ea0743cb821cec1b40f6b609 and project 5cdaf5b9230f4e09949a39a5cbe72011. Resources: dict_keys(['metadata_items']) {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 20:57:33.461063 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-eed4e1d7-b847-4ffa-a07a-6f53e26b2336 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Flavor limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 20:57:33.461513 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-eed4e1d7-b847-4ffa-a07a-6f53e26b2336 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Image limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 20:57:33.462128 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-eed4e1d7-b847-4ffa-a07a-6f53e26b2336 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Flavor pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 20:57:33.462548 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-eed4e1d7-b847-4ffa-a07a-6f53e26b2336 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Image pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 20:57:33.465776 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-eed4e1d7-b847-4ffa-a07a-6f53e26b2336 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 20:57:33.489475 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-eed4e1d7-b847-4ffa-a07a-6f53e26b2336 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:33.498146 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-eed4e1d7-b847-4ffa-a07a-6f53e26b2336 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:33.498689 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-eed4e1d7-b847-4ffa-a07a-6f53e26b2336 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:33.499520 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-eed4e1d7-b847-4ffa-a07a-6f53e26b2336 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:33.499999 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-eed4e1d7-b847-4ffa-a07a-6f53e26b2336 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:33.500432 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-eed4e1d7-b847-4ffa-a07a-6f53e26b2336 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:33.547735 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-eed4e1d7-b847-4ffa-a07a-6f53e26b2336 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Getting quotas for project 5cdaf5b9230f4e09949a39a5cbe72011. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 20:57:33.562822 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-eed4e1d7-b847-4ffa-a07a-6f53e26b2336 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Getting quotas for user 5d9facf5ea0743cb821cec1b40f6b609 and project 5cdaf5b9230f4e09949a39a5cbe72011. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 20:57:33.577825 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-eed4e1d7-b847-4ffa-a07a-6f53e26b2336 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Going to run 1 instances... {{(pid=140491) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 20:57:33.580634 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-eed4e1d7-b847-4ffa-a07a-6f53e26b2336 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] [instance: 0568d34c-9aa0-452f-b5c5-b3fc19ebbf15] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c508bd7f-7db9-4b2c-af7c-be54a855c355',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140491) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 20:57:33.594195 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-b837ef4e-b8d4-4017-bf56-be42eb329d7c tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-1721406428", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:57:33.670481 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-eed4e1d7-b847-4ffa-a07a-6f53e26b2336 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.511656 Oct 08 20:57:33.671751 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 719/1493] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 20:57:32 2022] POST /compute/v2.1/servers => generated 409 bytes in 1514 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 08 20:57:33.705114 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.network.neutron [None req-b837ef4e-b8d4-4017-bf56-be42eb329d7c tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] validate_networks() for None {{(pid=140492) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 20:57:33.799712 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-a5361091-c2a3-4a96-a3a3-29dd25bfff71 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-711287801", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:57:33.912251 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.network.neutron [None req-a5361091-c2a3-4a96-a3a3-29dd25bfff71 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] validate_networks() for [('9a7c4906-c385-42bd-b7c0-9941e033f637', None, None, None, None, None)] {{(pid=140491) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 20:57:34.151500 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-b837ef4e-b8d4-4017-bf56-be42eb329d7c tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Flavor limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 20:57:34.152148 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-b837ef4e-b8d4-4017-bf56-be42eb329d7c tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Image limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 20:57:34.152828 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-b837ef4e-b8d4-4017-bf56-be42eb329d7c tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Flavor pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 20:57:34.153518 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-b837ef4e-b8d4-4017-bf56-be42eb329d7c tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Image pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 20:57:34.154198 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-b837ef4e-b8d4-4017-bf56-be42eb329d7c tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 20:57:34.165899 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b837ef4e-b8d4-4017-bf56-be42eb329d7c tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:34.166728 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b837ef4e-b8d4-4017-bf56-be42eb329d7c tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:34.167421 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b837ef4e-b8d4-4017-bf56-be42eb329d7c tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:34.168233 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b837ef4e-b8d4-4017-bf56-be42eb329d7c tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:34.168761 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b837ef4e-b8d4-4017-bf56-be42eb329d7c tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:34.169317 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b837ef4e-b8d4-4017-bf56-be42eb329d7c tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:34.194408 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-b837ef4e-b8d4-4017-bf56-be42eb329d7c tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Getting quotas for project d24a29bd6efb40609e31fbb6dba839e8. Resources: {'cores', 'instances', 'ram'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 20:57:34.200977 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-b837ef4e-b8d4-4017-bf56-be42eb329d7c tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Getting quotas for user 322606d4cb0f45d3ac2eceab4999d45b and project d24a29bd6efb40609e31fbb6dba839e8. Resources: {'cores', 'instances', 'ram'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 20:57:34.214978 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-b837ef4e-b8d4-4017-bf56-be42eb329d7c tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Going to run 1 instances... {{(pid=140492) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 20:57:34.217741 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-b837ef4e-b8d4-4017-bf56-be42eb329d7c tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] [instance: 19327d3e-de51-432b-b594-cb9a1bfe2f49] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c508bd7f-7db9-4b2c-af7c-be54a855c355',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140492) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 20:57:34.273427 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-b837ef4e-b8d4-4017-bf56-be42eb329d7c tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.931670 Oct 08 20:57:34.274926 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 775/1494] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 20:57:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 934 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 08 20:57:34.280125 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-07d7188c-817a-4d7c-9e12-086ae332f4fa tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:34.281082 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-07d7188c-817a-4d7c-9e12-086ae332f4fa tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] [instance: ceced78a-58d9-4175-b4fe-0d085be62c94] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:34.291581 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-07d7188c-817a-4d7c-9e12-086ae332f4fa tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:34.292193 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-07d7188c-817a-4d7c-9e12-086ae332f4fa tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:34.292741 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-07d7188c-817a-4d7c-9e12-086ae332f4fa tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:34.293660 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-07d7188c-817a-4d7c-9e12-086ae332f4fa tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:34.294230 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-07d7188c-817a-4d7c-9e12-086ae332f4fa tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:34.294912 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-07d7188c-817a-4d7c-9e12-086ae332f4fa tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:34.589842 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-07d7188c-817a-4d7c-9e12-086ae332f4fa tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:34.599928 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-07d7188c-817a-4d7c-9e12-086ae332f4fa tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:34.601987 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-07d7188c-817a-4d7c-9e12-086ae332f4fa tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:34.603204 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-07d7188c-817a-4d7c-9e12-086ae332f4fa tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] 10.222.0.26 "GET /compute/v2.1/servers/ceced78a-58d9-4175-b4fe-0d085be62c94" status: 200 len: 1874 microversion: 2.42 time: 0.327020 Oct 08 20:57:34.603728 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 776/1495] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:57:34 2022] GET /compute/v2.1/servers/ceced78a-58d9-4175-b4fe-0d085be62c94 => generated 1874 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:57:34.608630 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-b0bad969-3e44-46fa-99c1-69ce6acec3af tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:34.610196 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-b0bad969-3e44-46fa-99c1-69ce6acec3af tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] [instance: 24d7af5b-10ba-4df7-a95d-bcd0b2104f37] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:34.616574 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b0bad969-3e44-46fa-99c1-69ce6acec3af tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:34.617298 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b0bad969-3e44-46fa-99c1-69ce6acec3af tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:34.617913 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b0bad969-3e44-46fa-99c1-69ce6acec3af tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:34.618770 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b0bad969-3e44-46fa-99c1-69ce6acec3af tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:34.619722 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b0bad969-3e44-46fa-99c1-69ce6acec3af tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:34.620496 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b0bad969-3e44-46fa-99c1-69ce6acec3af tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:34.715735 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-a5361091-c2a3-4a96-a3a3-29dd25bfff71 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Flavor limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 20:57:34.716262 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-a5361091-c2a3-4a96-a3a3-29dd25bfff71 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Image limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 20:57:34.716950 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-a5361091-c2a3-4a96-a3a3-29dd25bfff71 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Flavor pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 20:57:34.717798 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-a5361091-c2a3-4a96-a3a3-29dd25bfff71 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Image pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 20:57:34.718705 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-a5361091-c2a3-4a96-a3a3-29dd25bfff71 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 20:57:34.749789 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a5361091-c2a3-4a96-a3a3-29dd25bfff71 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:34.750379 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a5361091-c2a3-4a96-a3a3-29dd25bfff71 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:34.752111 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a5361091-c2a3-4a96-a3a3-29dd25bfff71 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:34.761811 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a5361091-c2a3-4a96-a3a3-29dd25bfff71 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:34.762510 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a5361091-c2a3-4a96-a3a3-29dd25bfff71 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:34.762814 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a5361091-c2a3-4a96-a3a3-29dd25bfff71 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:34.810476 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-a5361091-c2a3-4a96-a3a3-29dd25bfff71 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Getting quotas for project 6c97b3b7fa484f97bdf40224f7cc34d4. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 20:57:34.818289 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-a5361091-c2a3-4a96-a3a3-29dd25bfff71 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Getting quotas for user 01ec70849cfa44368a91df8b3410aba8 and project 6c97b3b7fa484f97bdf40224f7cc34d4. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 20:57:34.832129 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-a5361091-c2a3-4a96-a3a3-29dd25bfff71 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Going to run 1 instances... {{(pid=140491) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 20:57:34.834577 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-a5361091-c2a3-4a96-a3a3-29dd25bfff71 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] [instance: e5389d1b-b9f3-491a-898c-be611599d73a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c508bd7f-7db9-4b2c-af7c-be54a855c355',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140491) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 20:57:34.837244 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-b0bad969-3e44-46fa-99c1-69ce6acec3af tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac1323815364df4a3a4d4dbbb9d70dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be94d02ab5244f98337fb9b90e74746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:34.845543 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-b0bad969-3e44-46fa-99c1-69ce6acec3af tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] 10.222.0.26 "GET /compute/v2.1/servers/24d7af5b-10ba-4df7-a95d-bcd0b2104f37" status: 200 len: 1316 microversion: 2.1 time: 0.240505 Oct 08 20:57:34.847296 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 777/1496] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:57:34 2022] GET /compute/v2.1/servers/24d7af5b-10ba-4df7-a95d-bcd0b2104f37 => generated 1316 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:57:34.854337 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-2d4e366e-8d99-4163-a664-0461d1692381 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:34.855146 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-2d4e366e-8d99-4163-a664-0461d1692381 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] [instance: e2d1c93f-8392-4f67-a29e-05164828f9d8] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:34.864891 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2d4e366e-8d99-4163-a664-0461d1692381 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:34.866110 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2d4e366e-8d99-4163-a664-0461d1692381 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:34.866798 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2d4e366e-8d99-4163-a664-0461d1692381 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:34.868566 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2d4e366e-8d99-4163-a664-0461d1692381 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:34.868861 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2d4e366e-8d99-4163-a664-0461d1692381 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:34.869844 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2d4e366e-8d99-4163-a664-0461d1692381 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:34.906426 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-a5361091-c2a3-4a96-a3a3-29dd25bfff71 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.229585 Oct 08 20:57:34.910090 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 720/1497] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 20:57:33 2022] POST /compute/v2.1/servers => generated 383 bytes in 1237 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 08 20:57:34.927247 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-e57c43b8-bcd6-4734-adb4-cca02582b88c tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:34.929115 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-e57c43b8-bcd6-4734-adb4-cca02582b88c tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] [instance: 7f720341-f7ad-4365-8aeb-0aad8afb46b6] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:34.946300 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e57c43b8-bcd6-4734-adb4-cca02582b88c tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:34.949468 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e57c43b8-bcd6-4734-adb4-cca02582b88c tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:34.950128 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e57c43b8-bcd6-4734-adb4-cca02582b88c tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:34.953137 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e57c43b8-bcd6-4734-adb4-cca02582b88c tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:34.955676 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e57c43b8-bcd6-4734-adb4-cca02582b88c tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:34.956381 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e57c43b8-bcd6-4734-adb4-cca02582b88c tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:34.990380 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-e57c43b8-bcd6-4734-adb4-cca02582b88c tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] HTTP exception thrown: Instance 7f720341-f7ad-4365-8aeb-0aad8afb46b6 could not be found. Oct 08 20:57:34.994870 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-e57c43b8-bcd6-4734-adb4-cca02582b88c tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Request method failure captured: Oct 08 20:57:34.994870 ncdv-master-1 devstack@n-api.service[140491]: request: GET /compute/v2.1/servers/7f720341-f7ad-4365-8aeb-0aad8afb46b6 HTTP/1.1 Oct 08 20:57:34.994870 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 20:57:34.994870 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 20:57:34.994870 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 20:57:34.994870 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 20:57:34.994870 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 20:57:34.994870 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 20:57:34.994870 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 20:57:34.994870 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 20:57:34.994870 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQePl59-CwHKmgYk_Bq3YcgeSk0CI1yw_ya8PcQMsx71VbNnDNsniK4QUc6suoZkp_m36gXaQWrRHb-01_GThnl2EohRaw4s0BIJivh_UZOmqrJPZUsYraNnif2FsyxyuK8fMSjVa7JoXAEn9C7tLEWoAkWeOcaxNBos5OVcwZzmiCww Oct 08 20:57:34.994870 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 20:57:34.994870 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 20:57:34.994870 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 20:57:34.994870 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 20:57:34.994870 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 20:57:34.994870 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 20:57:34.994870 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: d7550f7ad9dc45ba9c9bfb0a5a11a774 Oct 08 20:57:34.994870 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-LiveMigrationNegativeTest-1404531554 Oct 08 20:57:34.994870 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 20:57:34.994870 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 20:57:34.994870 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d7550f7ad9dc45ba9c9bfb0a5a11a774"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d7550f7ad9dc45ba9c9bfb0a5a11a774"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d7550f7ad9dc45ba9c9bfb0a5a11a774"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d7550f7ad9dc45ba9c9bfb0a5a11a774"}]}] Oct 08 20:57:34.994870 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-LiveMigrationNegativeTest-1404531554 Oct 08 20:57:34.994870 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: d7550f7ad9dc45ba9c9bfb0a5a11a774 Oct 08 20:57:34.994870 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1404531554 Oct 08 20:57:34.994870 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-LiveMigrationNegativeTest-1404531554-project Oct 08 20:57:34.994870 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 20:57:34.994870 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 20:57:34.994870 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 05f0f7a60257437eaa8702b664916979 Oct 08 20:57:34.994870 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-LiveMigrationNegativeTest-1404531554-project Oct 08 20:57:34.994870 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 20:57:34.994870 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance 7f720341-f7ad-4365-8aeb-0aad8afb46b6 could not be found. Oct 08 20:57:34.994870 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': '7f720341-f7ad-4365-8aeb-0aad8afb46b6'} Oct 08 20:57:34.994870 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:57:34.994870 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:57:34.994870 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 20:57:34.994870 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 20:57:34.994870 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 20:57:34.994870 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 20:57:34.994870 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 20:57:34.994870 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 20:57:34.994870 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 20:57:34.994870 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 20:57:34.994870 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f720341-f7ad-4365-8aeb-0aad8afb46b6 could not be found. Oct 08 20:57:34.994870 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:57:34.994870 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:57:34.994870 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:57:34.994870 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:57:34.994870 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:57:34.994870 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:57:34.994870 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:57:34.994870 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:57:34.994870 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:57:34.994870 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:57:34.994870 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 20:57:34.994870 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 20:57:34.994870 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 20:57:34.994870 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 20:57:34.994870 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 20:57:34.994870 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 20:57:34.994870 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f720341-f7ad-4365-8aeb-0aad8afb46b6 could not be found. Oct 08 20:57:34.994870 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:57:34.994870 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:57:34.994870 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:57:34.999924 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:57:34.999924 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:57:34.999924 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:57:34.999924 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 20:57:34.999924 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 20:57:34.999924 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f720341-f7ad-4365-8aeb-0aad8afb46b6 could not be found. Oct 08 20:57:34.999924 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:57:35.003025 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-e57c43b8-bcd6-4734-adb4-cca02582b88c tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] Returning 404 to user: Instance 7f720341-f7ad-4365-8aeb-0aad8afb46b6 could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:57:35.007848 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-e57c43b8-bcd6-4734-adb4-cca02582b88c tempest-LiveMigrationNegativeTest-1404531554 tempest-LiveMigrationNegativeTest-1404531554-project] 10.222.0.26 "GET /compute/v2.1/servers/7f720341-f7ad-4365-8aeb-0aad8afb46b6" status: 404 len: 111 microversion: 2.1 time: 0.092533 Oct 08 20:57:35.008612 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 721/1498] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:57:34 2022] GET /compute/v2.1/servers/7f720341-f7ad-4365-8aeb-0aad8afb46b6 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 20:57:35.027643 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-a6876d7e-f7d0-4f60-9a0e-2c61cab24424 req-d281b50a-2ff6-4a87-9f87-bc5a3bce4dc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24d7af5b-10ba-4df7-a95d-bcd0b2104f37", "name": "network-vif-plugged", "status": "completed", "tag": "fd61dc22-1328-45bc-8a61-27b2a295a029"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:57:35.068117 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-a6876d7e-f7d0-4f60-9a0e-2c61cab24424 req-d281b50a-2ff6-4a87-9f87-bc5a3bce4dc0 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:35.072619 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-a6876d7e-f7d0-4f60-9a0e-2c61cab24424 req-d281b50a-2ff6-4a87-9f87-bc5a3bce4dc0 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:35.073874 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-a6876d7e-f7d0-4f60-9a0e-2c61cab24424 req-d281b50a-2ff6-4a87-9f87-bc5a3bce4dc0 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:35.121828 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-a6876d7e-f7d0-4f60-9a0e-2c61cab24424 req-d281b50a-2ff6-4a87-9f87-bc5a3bce4dc0 service nova] Creating event network-vif-plugged:fd61dc22-1328-45bc-8a61-27b2a295a029 for instance 24d7af5b-10ba-4df7-a95d-bcd0b2104f37 on nch1-master-1 Oct 08 20:57:35.138325 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-a6876d7e-f7d0-4f60-9a0e-2c61cab24424 req-d281b50a-2ff6-4a87-9f87-bc5a3bce4dc0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127092 Oct 08 20:57:35.140639 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 722/1499] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:57:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:57:35.153854 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-3f1485b8-58ef-4bc4-867e-d31adc1f8fe7 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:35.156749 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-3f1485b8-58ef-4bc4-867e-d31adc1f8fe7 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] [instance: 0568d34c-9aa0-452f-b5c5-b3fc19ebbf15] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:35.176694 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3f1485b8-58ef-4bc4-867e-d31adc1f8fe7 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:35.179464 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3f1485b8-58ef-4bc4-867e-d31adc1f8fe7 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:35.180247 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3f1485b8-58ef-4bc4-867e-d31adc1f8fe7 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:35.181106 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-2d4e366e-8d99-4163-a664-0461d1692381 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474ca64d1b1d4e30916b517645aba882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecc2dd2407b4819874bed09cb27959a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:35.182995 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3f1485b8-58ef-4bc4-867e-d31adc1f8fe7 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:35.184826 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3f1485b8-58ef-4bc4-867e-d31adc1f8fe7 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:35.186533 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3f1485b8-58ef-4bc4-867e-d31adc1f8fe7 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:35.187906 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:57:35.215188 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-2d4e366e-8d99-4163-a664-0461d1692381 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d1c93f-8392-4f67-a29e-05164828f9d8" status: 200 len: 1392 microversion: 2.1 time: 0.366476 Oct 08 20:57:35.215771 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 778/1500] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:57:34 2022] GET /compute/v2.1/servers/e2d1c93f-8392-4f67-a29e-05164828f9d8 => generated 1392 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:57:35.244826 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e25a8126-1257-45b1-9952-26379d5b6b17 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:35.246328 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-e25a8126-1257-45b1-9952-26379d5b6b17 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] [instance: 19327d3e-de51-432b-b594-cb9a1bfe2f49] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:35.258031 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e25a8126-1257-45b1-9952-26379d5b6b17 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:35.259612 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e25a8126-1257-45b1-9952-26379d5b6b17 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:35.260295 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e25a8126-1257-45b1-9952-26379d5b6b17 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:35.261491 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e25a8126-1257-45b1-9952-26379d5b6b17 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:35.262444 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e25a8126-1257-45b1-9952-26379d5b6b17 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:35.263695 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e25a8126-1257-45b1-9952-26379d5b6b17 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:35.369738 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-e25a8126-1257-45b1-9952-26379d5b6b17 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322606d4cb0f45d3ac2eceab4999d45b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24a29bd6efb40609e31fbb6dba839e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:35.380374 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-e25a8126-1257-45b1-9952-26379d5b6b17 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] 10.222.0.26 "GET /compute/v2.1/servers/19327d3e-de51-432b-b594-cb9a1bfe2f49" status: 200 len: 1221 microversion: 2.1 time: 0.142406 Oct 08 20:57:35.382531 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 779/1501] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:57:35 2022] GET /compute/v2.1/servers/19327d3e-de51-432b-b594-cb9a1bfe2f49 => generated 1221 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:57:35.387960 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-bb8db156-4aff-432a-a67c-20a36060ab97 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:35.388875 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-bb8db156-4aff-432a-a67c-20a36060ab97 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] [instance: 74bdac1c-9b70-46f7-b671-9752894d8980] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:35.407872 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bb8db156-4aff-432a-a67c-20a36060ab97 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:35.410082 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bb8db156-4aff-432a-a67c-20a36060ab97 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:35.416802 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bb8db156-4aff-432a-a67c-20a36060ab97 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:35.417992 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bb8db156-4aff-432a-a67c-20a36060ab97 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:35.420786 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bb8db156-4aff-432a-a67c-20a36060ab97 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:35.424481 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bb8db156-4aff-432a-a67c-20a36060ab97 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:35.607844 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-3f1485b8-58ef-4bc4-867e-d31adc1f8fe7 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9facf5ea0743cb821cec1b40f6b609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdaf5b9230f4e09949a39a5cbe72011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:35.622271 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-3f1485b8-58ef-4bc4-867e-d31adc1f8fe7 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] 10.222.0.26 "GET /compute/v2.1/servers/0568d34c-9aa0-452f-b5c5-b3fc19ebbf15" status: 200 len: 1329 microversion: 2.1 time: 0.479427 Oct 08 20:57:35.627495 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 723/1502] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:57:35 2022] GET /compute/v2.1/servers/0568d34c-9aa0-452f-b5c5-b3fc19ebbf15 => generated 1329 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:57:35.641424 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-6910d4b4-d3ca-41d1-8ece-94175372f586 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:35.643550 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-6910d4b4-d3ca-41d1-8ece-94175372f586 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] [instance: e5389d1b-b9f3-491a-898c-be611599d73a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:35.752114 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-6910d4b4-d3ca-41d1-8ece-94175372f586 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01ec70849cfa44368a91df8b3410aba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c97b3b7fa484f97bdf40224f7cc34d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:35.765761 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-6910d4b4-d3ca-41d1-8ece-94175372f586 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] 10.222.0.26 "GET /compute/v2.1/servers/e5389d1b-b9f3-491a-898c-be611599d73a" status: 200 len: 1222 microversion: 2.1 time: 0.135394 Oct 08 20:57:35.768304 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 724/1503] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:57:35 2022] GET /compute/v2.1/servers/e5389d1b-b9f3-491a-898c-be611599d73a => generated 1222 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:57:35.777588 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-4d4f9586-994b-4ed0-b4c8-6b77f375255b tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:35.780534 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-4d4f9586-994b-4ed0-b4c8-6b77f375255b tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] [instance: ceced78a-58d9-4175-b4fe-0d085be62c94] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:35.799763 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4d4f9586-994b-4ed0-b4c8-6b77f375255b tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:35.803904 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4d4f9586-994b-4ed0-b4c8-6b77f375255b tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:35.805930 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4d4f9586-994b-4ed0-b4c8-6b77f375255b tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:35.807569 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4d4f9586-994b-4ed0-b4c8-6b77f375255b tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:35.809583 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4d4f9586-994b-4ed0-b4c8-6b77f375255b tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:35.810926 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4d4f9586-994b-4ed0-b4c8-6b77f375255b tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:35.905107 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-bb8db156-4aff-432a-a67c-20a36060ab97 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:35.918137 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-bb8db156-4aff-432a-a67c-20a36060ab97 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:35.922363 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-bb8db156-4aff-432a-a67c-20a36060ab97 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:35.925146 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-bb8db156-4aff-432a-a67c-20a36060ab97 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] 10.222.0.26 "GET /compute/v2.1/servers/74bdac1c-9b70-46f7-b671-9752894d8980" status: 200 len: 1281 microversion: 2.25 time: 0.541266 Oct 08 20:57:35.926616 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 780/1504] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:57:35 2022] GET /compute/v2.1/servers/74bdac1c-9b70-46f7-b671-9752894d8980 => generated 1281 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:57:35.933215 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-150845c7-7d95-4529-b498-9c2a9109fb44 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:35.939284 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-150845c7-7d95-4529-b498-9c2a9109fb44 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] [instance: 24d7af5b-10ba-4df7-a95d-bcd0b2104f37] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:35.954120 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-150845c7-7d95-4529-b498-9c2a9109fb44 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:35.954364 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-150845c7-7d95-4529-b498-9c2a9109fb44 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:35.954680 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-150845c7-7d95-4529-b498-9c2a9109fb44 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:35.955425 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-150845c7-7d95-4529-b498-9c2a9109fb44 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:35.955912 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-150845c7-7d95-4529-b498-9c2a9109fb44 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:35.956351 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-150845c7-7d95-4529-b498-9c2a9109fb44 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:36.248324 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-150845c7-7d95-4529-b498-9c2a9109fb44 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac1323815364df4a3a4d4dbbb9d70dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be94d02ab5244f98337fb9b90e74746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:36.263226 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-150845c7-7d95-4529-b498-9c2a9109fb44 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] 10.222.0.26 "GET /compute/v2.1/servers/24d7af5b-10ba-4df7-a95d-bcd0b2104f37" status: 200 len: 1316 microversion: 2.1 time: 0.331385 Oct 08 20:57:36.264612 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 781/1505] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:57:35 2022] GET /compute/v2.1/servers/24d7af5b-10ba-4df7-a95d-bcd0b2104f37 => generated 1316 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:57:36.273345 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-ff264787-89a7-411b-8eea-4446a8c8c5e8 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:36.277394 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-ff264787-89a7-411b-8eea-4446a8c8c5e8 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] [instance: e2d1c93f-8392-4f67-a29e-05164828f9d8] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:36.291421 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ff264787-89a7-411b-8eea-4446a8c8c5e8 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:36.294417 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ff264787-89a7-411b-8eea-4446a8c8c5e8 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:36.296348 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ff264787-89a7-411b-8eea-4446a8c8c5e8 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:36.297513 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ff264787-89a7-411b-8eea-4446a8c8c5e8 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:36.299548 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ff264787-89a7-411b-8eea-4446a8c8c5e8 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:36.300225 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ff264787-89a7-411b-8eea-4446a8c8c5e8 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:36.383576 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-4d4f9586-994b-4ed0-b4c8-6b77f375255b tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:36.396435 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-4d4f9586-994b-4ed0-b4c8-6b77f375255b tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:36.398474 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-4d4f9586-994b-4ed0-b4c8-6b77f375255b tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:36.400002 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-4d4f9586-994b-4ed0-b4c8-6b77f375255b tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] 10.222.0.26 "GET /compute/v2.1/servers/ceced78a-58d9-4175-b4fe-0d085be62c94" status: 200 len: 1874 microversion: 2.42 time: 0.630240 Oct 08 20:57:36.401291 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 725/1506] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:57:35 2022] GET /compute/v2.1/servers/ceced78a-58d9-4175-b4fe-0d085be62c94 => generated 1874 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:57:36.439365 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-141e7811-ae17-4df7-9e21-45ab722fd51d tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:36.443489 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-141e7811-ae17-4df7-9e21-45ab722fd51d tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] [instance: 19327d3e-de51-432b-b594-cb9a1bfe2f49] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:36.472620 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-141e7811-ae17-4df7-9e21-45ab722fd51d tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:36.475734 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-141e7811-ae17-4df7-9e21-45ab722fd51d tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:36.477780 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-141e7811-ae17-4df7-9e21-45ab722fd51d tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:36.478822 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-141e7811-ae17-4df7-9e21-45ab722fd51d tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:36.483420 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-141e7811-ae17-4df7-9e21-45ab722fd51d tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:36.484127 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-141e7811-ae17-4df7-9e21-45ab722fd51d tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:36.613838 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-141e7811-ae17-4df7-9e21-45ab722fd51d tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322606d4cb0f45d3ac2eceab4999d45b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24a29bd6efb40609e31fbb6dba839e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:36.642875 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-141e7811-ae17-4df7-9e21-45ab722fd51d tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] 10.222.0.26 "GET /compute/v2.1/servers/19327d3e-de51-432b-b594-cb9a1bfe2f49" status: 200 len: 1269 microversion: 2.1 time: 0.218762 Oct 08 20:57:36.660227 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 726/1507] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:57:36 2022] GET /compute/v2.1/servers/19327d3e-de51-432b-b594-cb9a1bfe2f49 => generated 1269 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 20:57:36.672605 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-bcbfb7da-af3d-48ae-9baf-28969d1f6441 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:36.674071 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-bcbfb7da-af3d-48ae-9baf-28969d1f6441 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] [instance: 0568d34c-9aa0-452f-b5c5-b3fc19ebbf15] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:36.685101 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bcbfb7da-af3d-48ae-9baf-28969d1f6441 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:36.686450 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bcbfb7da-af3d-48ae-9baf-28969d1f6441 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:36.687338 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bcbfb7da-af3d-48ae-9baf-28969d1f6441 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:36.688564 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bcbfb7da-af3d-48ae-9baf-28969d1f6441 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:36.689869 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bcbfb7da-af3d-48ae-9baf-28969d1f6441 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:36.690650 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bcbfb7da-af3d-48ae-9baf-28969d1f6441 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:36.713441 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-ff264787-89a7-411b-8eea-4446a8c8c5e8 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474ca64d1b1d4e30916b517645aba882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecc2dd2407b4819874bed09cb27959a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:36.722425 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-ff264787-89a7-411b-8eea-4446a8c8c5e8 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d1c93f-8392-4f67-a29e-05164828f9d8" status: 200 len: 1392 microversion: 2.1 time: 0.456431 Oct 08 20:57:36.728379 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 782/1508] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:57:36 2022] GET /compute/v2.1/servers/e2d1c93f-8392-4f67-a29e-05164828f9d8 => generated 1392 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:57:36.792341 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-0659dc0e-fbab-44a3-94b2-e50ae95724de tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:36.793548 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-0659dc0e-fbab-44a3-94b2-e50ae95724de tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] [instance: e5389d1b-b9f3-491a-898c-be611599d73a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:36.808928 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0659dc0e-fbab-44a3-94b2-e50ae95724de tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:36.811687 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0659dc0e-fbab-44a3-94b2-e50ae95724de tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:36.815796 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-bcbfb7da-af3d-48ae-9baf-28969d1f6441 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9facf5ea0743cb821cec1b40f6b609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdaf5b9230f4e09949a39a5cbe72011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:36.816340 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0659dc0e-fbab-44a3-94b2-e50ae95724de tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:36.818363 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0659dc0e-fbab-44a3-94b2-e50ae95724de tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:36.820696 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0659dc0e-fbab-44a3-94b2-e50ae95724de tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:36.822021 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0659dc0e-fbab-44a3-94b2-e50ae95724de tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:36.832056 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-bcbfb7da-af3d-48ae-9baf-28969d1f6441 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] 10.222.0.26 "GET /compute/v2.1/servers/0568d34c-9aa0-452f-b5c5-b3fc19ebbf15" status: 200 len: 1337 microversion: 2.1 time: 0.169244 Oct 08 20:57:36.835138 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 727/1509] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:57:36 2022] GET /compute/v2.1/servers/0568d34c-9aa0-452f-b5c5-b3fc19ebbf15 => generated 1337 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:57:36.956684 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-8f5b56bf-68b9-4b75-bf8b-28af0ba38b79 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:36.957345 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-8f5b56bf-68b9-4b75-bf8b-28af0ba38b79 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] [instance: 74bdac1c-9b70-46f7-b671-9752894d8980] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:36.983067 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8f5b56bf-68b9-4b75-bf8b-28af0ba38b79 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:36.984797 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8f5b56bf-68b9-4b75-bf8b-28af0ba38b79 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:36.987980 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8f5b56bf-68b9-4b75-bf8b-28af0ba38b79 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:36.993396 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8f5b56bf-68b9-4b75-bf8b-28af0ba38b79 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:36.996317 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8f5b56bf-68b9-4b75-bf8b-28af0ba38b79 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:36.996789 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8f5b56bf-68b9-4b75-bf8b-28af0ba38b79 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:37.074121 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-0659dc0e-fbab-44a3-94b2-e50ae95724de tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01ec70849cfa44368a91df8b3410aba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c97b3b7fa484f97bdf40224f7cc34d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:37.089114 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-0659dc0e-fbab-44a3-94b2-e50ae95724de tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] 10.222.0.26 "GET /compute/v2.1/servers/e5389d1b-b9f3-491a-898c-be611599d73a" status: 200 len: 1274 microversion: 2.1 time: 0.302350 Oct 08 20:57:37.122007 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 783/1510] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:57:36 2022] GET /compute/v2.1/servers/e5389d1b-b9f3-491a-898c-be611599d73a => generated 1274 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 20:57:37.300908 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-3fa2b6f0-a42a-4f98-9e0e-4e7b313bd13a tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:37.301834 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-3fa2b6f0-a42a-4f98-9e0e-4e7b313bd13a tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] [instance: 24d7af5b-10ba-4df7-a95d-bcd0b2104f37] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:37.351071 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3fa2b6f0-a42a-4f98-9e0e-4e7b313bd13a tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:37.357881 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3fa2b6f0-a42a-4f98-9e0e-4e7b313bd13a tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:37.360842 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3fa2b6f0-a42a-4f98-9e0e-4e7b313bd13a tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:37.363469 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3fa2b6f0-a42a-4f98-9e0e-4e7b313bd13a tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:37.368066 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3fa2b6f0-a42a-4f98-9e0e-4e7b313bd13a tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:37.370742 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3fa2b6f0-a42a-4f98-9e0e-4e7b313bd13a tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:37.650985 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-8f5b56bf-68b9-4b75-bf8b-28af0ba38b79 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:37.666856 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-8f5b56bf-68b9-4b75-bf8b-28af0ba38b79 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:37.668372 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-8f5b56bf-68b9-4b75-bf8b-28af0ba38b79 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:37.672974 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-8f5b56bf-68b9-4b75-bf8b-28af0ba38b79 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] 10.222.0.26 "GET /compute/v2.1/servers/74bdac1c-9b70-46f7-b671-9752894d8980" status: 200 len: 1281 microversion: 2.25 time: 0.722315 Oct 08 20:57:37.674735 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 728/1511] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:57:36 2022] GET /compute/v2.1/servers/74bdac1c-9b70-46f7-b671-9752894d8980 => generated 1281 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:57:37.681878 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-72ffc4cc-e980-4ea6-883b-caa970f07587 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:37.682504 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-72ffc4cc-e980-4ea6-883b-caa970f07587 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] [instance: ceced78a-58d9-4175-b4fe-0d085be62c94] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:37.716315 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-72ffc4cc-e980-4ea6-883b-caa970f07587 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:37.718238 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-72ffc4cc-e980-4ea6-883b-caa970f07587 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:37.718869 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-72ffc4cc-e980-4ea6-883b-caa970f07587 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:37.721956 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-72ffc4cc-e980-4ea6-883b-caa970f07587 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:37.722745 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-72ffc4cc-e980-4ea6-883b-caa970f07587 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:37.723371 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-72ffc4cc-e980-4ea6-883b-caa970f07587 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:37.845373 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-3fa2b6f0-a42a-4f98-9e0e-4e7b313bd13a tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac1323815364df4a3a4d4dbbb9d70dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be94d02ab5244f98337fb9b90e74746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:37.857217 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-3fa2b6f0-a42a-4f98-9e0e-4e7b313bd13a tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] 10.222.0.26 "GET /compute/v2.1/servers/24d7af5b-10ba-4df7-a95d-bcd0b2104f37" status: 200 len: 1504 microversion: 2.1 time: 0.566405 Oct 08 20:57:37.858119 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 784/1512] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:57:37 2022] GET /compute/v2.1/servers/24d7af5b-10ba-4df7-a95d-bcd0b2104f37 => generated 1504 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:57:37.868209 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-04f72ada-36f6-4f3e-9d05-bc9f56c86fc3 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:37.875470 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-04f72ada-36f6-4f3e-9d05-bc9f56c86fc3 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] [instance: 19327d3e-de51-432b-b594-cb9a1bfe2f49] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:37.886900 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-04f72ada-36f6-4f3e-9d05-bc9f56c86fc3 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:37.887771 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-04f72ada-36f6-4f3e-9d05-bc9f56c86fc3 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:37.896838 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-04f72ada-36f6-4f3e-9d05-bc9f56c86fc3 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:37.898616 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-04f72ada-36f6-4f3e-9d05-bc9f56c86fc3 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:37.899417 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-04f72ada-36f6-4f3e-9d05-bc9f56c86fc3 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:37.900072 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-04f72ada-36f6-4f3e-9d05-bc9f56c86fc3 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:38.048938 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-04f72ada-36f6-4f3e-9d05-bc9f56c86fc3 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322606d4cb0f45d3ac2eceab4999d45b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24a29bd6efb40609e31fbb6dba839e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:38.063558 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-04f72ada-36f6-4f3e-9d05-bc9f56c86fc3 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] 10.222.0.26 "GET /compute/v2.1/servers/19327d3e-de51-432b-b594-cb9a1bfe2f49" status: 200 len: 1269 microversion: 2.1 time: 0.203488 Oct 08 20:57:38.064819 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 785/1513] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:57:37 2022] GET /compute/v2.1/servers/19327d3e-de51-432b-b594-cb9a1bfe2f49 => generated 1269 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:57:38.082344 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-aec096e1-d089-499f-9465-c8b52f81cfec tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:38.083777 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-aec096e1-d089-499f-9465-c8b52f81cfec tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] [instance: e2d1c93f-8392-4f67-a29e-05164828f9d8] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:38.093704 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-aec096e1-d089-499f-9465-c8b52f81cfec tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:38.094531 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-aec096e1-d089-499f-9465-c8b52f81cfec tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:38.095780 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-aec096e1-d089-499f-9465-c8b52f81cfec tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:38.098242 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-aec096e1-d089-499f-9465-c8b52f81cfec tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:38.099015 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-aec096e1-d089-499f-9465-c8b52f81cfec tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:38.100612 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-aec096e1-d089-499f-9465-c8b52f81cfec tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:38.140594 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-72ffc4cc-e980-4ea6-883b-caa970f07587 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:38.167024 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-72ffc4cc-e980-4ea6-883b-caa970f07587 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:38.170488 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-72ffc4cc-e980-4ea6-883b-caa970f07587 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:38.174302 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-72ffc4cc-e980-4ea6-883b-caa970f07587 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] 10.222.0.26 "GET /compute/v2.1/servers/ceced78a-58d9-4175-b4fe-0d085be62c94" status: 200 len: 1874 microversion: 2.42 time: 0.496160 Oct 08 20:57:38.178443 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 729/1514] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:57:37 2022] GET /compute/v2.1/servers/ceced78a-58d9-4175-b4fe-0d085be62c94 => generated 1874 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:57:38.192322 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-61ff65d5-c0fa-4ec5-8731-07aa68d42180 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:38.195823 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-61ff65d5-c0fa-4ec5-8731-07aa68d42180 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] [instance: 0568d34c-9aa0-452f-b5c5-b3fc19ebbf15] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:38.221120 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-61ff65d5-c0fa-4ec5-8731-07aa68d42180 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:38.231098 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-61ff65d5-c0fa-4ec5-8731-07aa68d42180 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:38.233742 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-61ff65d5-c0fa-4ec5-8731-07aa68d42180 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:38.237873 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-61ff65d5-c0fa-4ec5-8731-07aa68d42180 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:38.238672 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-61ff65d5-c0fa-4ec5-8731-07aa68d42180 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:38.243504 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-61ff65d5-c0fa-4ec5-8731-07aa68d42180 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:38.376329 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-aec096e1-d089-499f-9465-c8b52f81cfec tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474ca64d1b1d4e30916b517645aba882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecc2dd2407b4819874bed09cb27959a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:38.391644 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-aec096e1-d089-499f-9465-c8b52f81cfec tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d1c93f-8392-4f67-a29e-05164828f9d8" status: 200 len: 1392 microversion: 2.1 time: 0.325454 Oct 08 20:57:38.402904 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 786/1515] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:57:38 2022] GET /compute/v2.1/servers/e2d1c93f-8392-4f67-a29e-05164828f9d8 => generated 1392 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:57:38.419872 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-a82702cd-42a3-4113-bce3-abb9fc3c829c tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-85711288"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:57:38.420495 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-a82702cd-42a3-4113-bce3-abb9fc3c829c tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] [instance: 24d7af5b-10ba-4df7-a95d-bcd0b2104f37] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:38.436064 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a82702cd-42a3-4113-bce3-abb9fc3c829c tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:38.443667 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a82702cd-42a3-4113-bce3-abb9fc3c829c tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:38.444292 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a82702cd-42a3-4113-bce3-abb9fc3c829c tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:38.445408 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a82702cd-42a3-4113-bce3-abb9fc3c829c tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:38.448998 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a82702cd-42a3-4113-bce3-abb9fc3c829c tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:38.450127 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a82702cd-42a3-4113-bce3-abb9fc3c829c tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:38.456316 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-61ff65d5-c0fa-4ec5-8731-07aa68d42180 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9facf5ea0743cb821cec1b40f6b609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdaf5b9230f4e09949a39a5cbe72011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:38.476893 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-61ff65d5-c0fa-4ec5-8731-07aa68d42180 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] 10.222.0.26 "GET /compute/v2.1/servers/0568d34c-9aa0-452f-b5c5-b3fc19ebbf15" status: 200 len: 1335 microversion: 2.1 time: 0.290931 Oct 08 20:57:38.495366 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 730/1516] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:57:38 2022] GET /compute/v2.1/servers/0568d34c-9aa0-452f-b5c5-b3fc19ebbf15 => generated 1335 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:57:38.511959 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-7e6613bd-63d1-400c-9573-39a36c8d969c tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:38.512578 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-7e6613bd-63d1-400c-9573-39a36c8d969c tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] [instance: e5389d1b-b9f3-491a-898c-be611599d73a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:38.533009 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7e6613bd-63d1-400c-9573-39a36c8d969c tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:38.533930 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7e6613bd-63d1-400c-9573-39a36c8d969c tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:38.536256 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7e6613bd-63d1-400c-9573-39a36c8d969c tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:38.538643 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7e6613bd-63d1-400c-9573-39a36c8d969c tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:38.540315 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7e6613bd-63d1-400c-9573-39a36c8d969c tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:38.541750 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7e6613bd-63d1-400c-9573-39a36c8d969c tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:38.738936 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-7e6613bd-63d1-400c-9573-39a36c8d969c tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01ec70849cfa44368a91df8b3410aba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c97b3b7fa484f97bdf40224f7cc34d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:38.762795 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-7e6613bd-63d1-400c-9573-39a36c8d969c tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] 10.222.0.26 "GET /compute/v2.1/servers/e5389d1b-b9f3-491a-898c-be611599d73a" status: 200 len: 1280 microversion: 2.1 time: 0.261314 Oct 08 20:57:38.764069 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 731/1517] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:57:38 2022] GET /compute/v2.1/servers/e5389d1b-b9f3-491a-898c-be611599d73a => generated 1280 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:57:38.773223 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-48f83f73-bfec-4b1e-8638-5881fdf725d8 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:38.776055 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-48f83f73-bfec-4b1e-8638-5881fdf725d8 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] [instance: 74bdac1c-9b70-46f7-b671-9752894d8980] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:38.790120 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-48f83f73-bfec-4b1e-8638-5881fdf725d8 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:38.796490 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-48f83f73-bfec-4b1e-8638-5881fdf725d8 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:38.801923 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-48f83f73-bfec-4b1e-8638-5881fdf725d8 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:38.803989 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-48f83f73-bfec-4b1e-8638-5881fdf725d8 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:38.804900 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-48f83f73-bfec-4b1e-8638-5881fdf725d8 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:38.807755 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-48f83f73-bfec-4b1e-8638-5881fdf725d8 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:38.862867 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=100 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:57:38.916799 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.network.security_group_api [None req-a82702cd-42a3-4113-bce3-abb9fc3c829c tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Adding security group ed69df86-546b-4b92-802e-2ad5cb3327d6 to port fd61dc22-1328-45bc-8a61-27b2a295a029 Oct 08 20:57:39.594030 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-48f83f73-bfec-4b1e-8638-5881fdf725d8 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:39.605090 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-48f83f73-bfec-4b1e-8638-5881fdf725d8 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:39.612125 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-48f83f73-bfec-4b1e-8638-5881fdf725d8 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:39.613772 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-48f83f73-bfec-4b1e-8638-5881fdf725d8 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] 10.222.0.26 "GET /compute/v2.1/servers/74bdac1c-9b70-46f7-b671-9752894d8980" status: 200 len: 1281 microversion: 2.25 time: 0.848376 Oct 08 20:57:39.615009 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 732/1518] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:57:38 2022] GET /compute/v2.1/servers/74bdac1c-9b70-46f7-b671-9752894d8980 => generated 1281 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:57:39.621537 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-fe46720e-ef1b-4609-8e33-3678d634cfc2 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:39.622412 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-fe46720e-ef1b-4609-8e33-3678d634cfc2 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] [instance: 19327d3e-de51-432b-b594-cb9a1bfe2f49] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:39.629727 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fe46720e-ef1b-4609-8e33-3678d634cfc2 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:39.630469 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fe46720e-ef1b-4609-8e33-3678d634cfc2 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:39.631406 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fe46720e-ef1b-4609-8e33-3678d634cfc2 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:39.632359 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fe46720e-ef1b-4609-8e33-3678d634cfc2 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:39.638597 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fe46720e-ef1b-4609-8e33-3678d634cfc2 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:39.639444 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fe46720e-ef1b-4609-8e33-3678d634cfc2 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:39.665801 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-a82702cd-42a3-4113-bce3-abb9fc3c829c tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] 10.222.0.26 "POST /compute/v2.1/servers/24d7af5b-10ba-4df7-a95d-bcd0b2104f37/action" status: 202 len: 0 microversion: 2.1 time: 1.261191 Oct 08 20:57:39.666424 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 787/1519] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 20:57:38 2022] POST /compute/v2.1/servers/24d7af5b-10ba-4df7-a95d-bcd0b2104f37/action => generated 0 bytes in 1263 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 20:57:39.671720 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-89008847-8e1e-4dc8-be10-7ee9b4563374 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:39.673178 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-89008847-8e1e-4dc8-be10-7ee9b4563374 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] [instance: ceced78a-58d9-4175-b4fe-0d085be62c94] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:39.681966 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-89008847-8e1e-4dc8-be10-7ee9b4563374 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:39.682771 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-89008847-8e1e-4dc8-be10-7ee9b4563374 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:39.683413 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-89008847-8e1e-4dc8-be10-7ee9b4563374 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:39.684326 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-89008847-8e1e-4dc8-be10-7ee9b4563374 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:39.684966 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-89008847-8e1e-4dc8-be10-7ee9b4563374 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:39.686338 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-89008847-8e1e-4dc8-be10-7ee9b4563374 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:39.975668 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-fe46720e-ef1b-4609-8e33-3678d634cfc2 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322606d4cb0f45d3ac2eceab4999d45b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24a29bd6efb40609e31fbb6dba839e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:39.994502 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-fe46720e-ef1b-4609-8e33-3678d634cfc2 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] 10.222.0.26 "GET /compute/v2.1/servers/19327d3e-de51-432b-b594-cb9a1bfe2f49" status: 200 len: 1275 microversion: 2.1 time: 0.370254 Oct 08 20:57:39.995221 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 733/1520] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:57:39 2022] GET /compute/v2.1/servers/19327d3e-de51-432b-b594-cb9a1bfe2f49 => generated 1275 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:57:40.012487 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-f66995e9-8367-48d9-b50d-f8a40abe93ba tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:40.013265 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-f66995e9-8367-48d9-b50d-f8a40abe93ba tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] [instance: e2d1c93f-8392-4f67-a29e-05164828f9d8] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:40.037893 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f66995e9-8367-48d9-b50d-f8a40abe93ba tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:40.047629 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f66995e9-8367-48d9-b50d-f8a40abe93ba tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:40.048091 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f66995e9-8367-48d9-b50d-f8a40abe93ba tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:40.048856 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f66995e9-8367-48d9-b50d-f8a40abe93ba tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:40.049352 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f66995e9-8367-48d9-b50d-f8a40abe93ba tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:40.049787 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f66995e9-8367-48d9-b50d-f8a40abe93ba tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:40.268546 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-89008847-8e1e-4dc8-be10-7ee9b4563374 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:40.278699 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-89008847-8e1e-4dc8-be10-7ee9b4563374 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:40.280174 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-89008847-8e1e-4dc8-be10-7ee9b4563374 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:40.281424 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-89008847-8e1e-4dc8-be10-7ee9b4563374 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] 10.222.0.26 "GET /compute/v2.1/servers/ceced78a-58d9-4175-b4fe-0d085be62c94" status: 200 len: 1874 microversion: 2.42 time: 0.613739 Oct 08 20:57:40.282004 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 788/1521] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:57:39 2022] GET /compute/v2.1/servers/ceced78a-58d9-4175-b4fe-0d085be62c94 => generated 1874 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:57:40.294764 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-399b0611-342c-4c8d-9bfb-14cd8654d980 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:40.295397 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-399b0611-342c-4c8d-9bfb-14cd8654d980 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] [instance: 0568d34c-9aa0-452f-b5c5-b3fc19ebbf15] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:40.313247 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-399b0611-342c-4c8d-9bfb-14cd8654d980 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:40.316731 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-399b0611-342c-4c8d-9bfb-14cd8654d980 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:40.317472 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-399b0611-342c-4c8d-9bfb-14cd8654d980 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:40.320806 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-399b0611-342c-4c8d-9bfb-14cd8654d980 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:40.321530 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-399b0611-342c-4c8d-9bfb-14cd8654d980 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:40.322178 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-399b0611-342c-4c8d-9bfb-14cd8654d980 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:40.568383 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-399b0611-342c-4c8d-9bfb-14cd8654d980 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9facf5ea0743cb821cec1b40f6b609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdaf5b9230f4e09949a39a5cbe72011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:40.582751 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-399b0611-342c-4c8d-9bfb-14cd8654d980 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] 10.222.0.26 "GET /compute/v2.1/servers/0568d34c-9aa0-452f-b5c5-b3fc19ebbf15" status: 200 len: 1403 microversion: 2.1 time: 0.299648 Oct 08 20:57:40.585571 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 789/1522] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:57:40 2022] GET /compute/v2.1/servers/0568d34c-9aa0-452f-b5c5-b3fc19ebbf15 => generated 1403 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:57:40.592838 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-65321b4b-e53b-4995-bc0a-1710fc517a9b tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Calling method '.version_select at 0x7f1a8c214790>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:40.932595 ncdv-master-1 devstack@n-api.service[140492]: DEBUG neutronclient.v2_0.client [None req-65321b4b-e53b-4995-bc0a-1710fc517a9b tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group ed69df86-546b-4b92-802e-2ad5cb3327d6 in use.", "detail": ""}} {{(pid=140492) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 08 20:57:40.934640 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-65321b4b-e53b-4995-bc0a-1710fc517a9b tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] HTTP exception thrown: Security Group ed69df86-546b-4b92-802e-2ad5cb3327d6 in use. Oct 08 20:57:40.934640 ncdv-master-1 devstack@n-api.service[140492]: Neutron server returns request_ids: ['req-5ae7b4c0-4b22-4a37-9a71-dde08e5234d7'] Oct 08 20:57:40.937883 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-65321b4b-e53b-4995-bc0a-1710fc517a9b tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Request method failure captured: Oct 08 20:57:40.937883 ncdv-master-1 devstack@n-api.service[140492]: request: DELETE /compute/v2.1/os-security-groups/ed69df86-546b-4b92-802e-2ad5cb3327d6 HTTP/1.1 Oct 08 20:57:40.937883 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 20:57:40.937883 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 20:57:40.937883 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 20:57:40.937883 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 20:57:40.937883 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 20:57:40.937883 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 20:57:40.937883 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 20:57:40.937883 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 20:57:40.937883 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQePneH9r8wc6qFHuuUfUiwj20bfGS3ReCozGKtofTKF_Bibv-TeYrNnDr89OwEeHkYGW8sVcZZerG8KfPs5hnyFWI91x_kPrSGVuiWEZNP0tyGW3_Xh9-fgTNjxnIFiLidb-EHCBZb3EEyAGFqy03GkbophorT5sYui55pNleytp26U Oct 08 20:57:40.937883 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 20:57:40.937883 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 20:57:40.937883 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 20:57:40.937883 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 20:57:40.937883 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 20:57:40.937883 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 20:57:40.937883 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 1be94d02ab5244f98337fb9b90e74746 Oct 08 20:57:40.937883 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-SecurityGroupsTestJSON-1416879597 Oct 08 20:57:40.937883 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 20:57:40.937883 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 20:57:40.937883 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1be94d02ab5244f98337fb9b90e74746"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1be94d02ab5244f98337fb9b90e74746"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1be94d02ab5244f98337fb9b90e74746"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1be94d02ab5244f98337fb9b90e74746"}]}] Oct 08 20:57:40.937883 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-SecurityGroupsTestJSON-1416879597 Oct 08 20:57:40.937883 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 1be94d02ab5244f98337fb9b90e74746 Oct 08 20:57:40.937883 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1416879597 Oct 08 20:57:40.937883 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-SecurityGroupsTestJSON-1416879597-project Oct 08 20:57:40.937883 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 20:57:40.937883 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 20:57:40.937883 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 5ac1323815364df4a3a4d4dbbb9d70dd Oct 08 20:57:40.937883 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-SecurityGroupsTestJSON-1416879597-project Oct 08 20:57:40.937883 ncdv-master-1 devstack@n-api.service[140492]: method: Oct 08 20:57:40.937883 ncdv-master-1 devstack@n-api.service[140492]: exception: Security Group ed69df86-546b-4b92-802e-2ad5cb3327d6 in use. Oct 08 20:57:40.937883 ncdv-master-1 devstack@n-api.service[140492]: Neutron server returns request_ids: ['req-5ae7b4c0-4b22-4a37-9a71-dde08e5234d7'] Oct 08 20:57:40.937883 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': 'ed69df86-546b-4b92-802e-2ad5cb3327d6'} Oct 08 20:57:40.937883 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:57:40.937883 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:57:40.937883 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 08 20:57:40.937883 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 08 20:57:40.937883 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 08 20:57:40.937883 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 08 20:57:40.937883 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 08 20:57:40.937883 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 08 20:57:40.937883 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 08 20:57:40.937883 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 08 20:57:40.937883 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 08 20:57:40.937883 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 08 20:57:40.937883 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 08 20:57:40.937883 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 08 20:57:40.937883 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 08 20:57:40.937883 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 08 20:57:40.937883 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 08 20:57:40.937883 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 08 20:57:40.937883 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 08 20:57:40.937883 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 08 20:57:40.937883 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 08 20:57:40.937883 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 08 20:57:40.937883 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 08 20:57:40.937883 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 08 20:57:40.937883 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 08 20:57:40.937883 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 08 20:57:40.937883 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group ed69df86-546b-4b92-802e-2ad5cb3327d6 in use. Oct 08 20:57:40.944081 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5ae7b4c0-4b22-4a37-9a71-dde08e5234d7'] Oct 08 20:57:40.944081 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:57:40.944081 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:57:40.944081 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:57:40.944081 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:57:40.944081 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 08 20:57:40.944081 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 08 20:57:40.944081 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 08 20:57:40.944081 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 08 20:57:40.944081 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group ed69df86-546b-4b92-802e-2ad5cb3327d6 in use. Oct 08 20:57:40.944081 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5ae7b4c0-4b22-4a37-9a71-dde08e5234d7'] Oct 08 20:57:40.944081 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:57:40.944081 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:57:40.944081 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:57:40.944081 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:57:40.944081 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:57:40.944081 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:57:40.944081 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:57:40.944081 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:57:40.944081 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 08 20:57:40.944081 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 08 20:57:40.944081 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:57:40.944081 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:57:40.944081 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 08 20:57:40.944081 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 08 20:57:40.944081 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group ed69df86-546b-4b92-802e-2ad5cb3327d6 in use. Oct 08 20:57:40.944081 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5ae7b4c0-4b22-4a37-9a71-dde08e5234d7'] Oct 08 20:57:40.944081 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:57:40.944081 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:57:40.944081 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:57:40.944081 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:57:40.944081 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:57:40.944081 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:57:40.944081 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 20:57:40.944081 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 20:57:40.944081 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group ed69df86-546b-4b92-802e-2ad5cb3327d6 in use. Oct 08 20:57:40.944081 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5ae7b4c0-4b22-4a37-9a71-dde08e5234d7'] Oct 08 20:57:40.944081 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:57:40.944081 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-65321b4b-e53b-4995-bc0a-1710fc517a9b tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Returning 400 to user: Security Group ed69df86-546b-4b92-802e-2ad5cb3327d6 in use. Oct 08 20:57:40.944081 ncdv-master-1 devstack@n-api.service[140492]: Neutron server returns request_ids: ['req-5ae7b4c0-4b22-4a37-9a71-dde08e5234d7'] {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:57:40.944081 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-65321b4b-e53b-4995-bc0a-1710fc517a9b tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/ed69df86-546b-4b92-802e-2ad5cb3327d6" status: 400 len: 185 microversion: 2.1 time: 0.352596 Oct 08 20:57:40.947444 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 790/1523] 10.222.0.26 () {58 vars in 1272 bytes} [Sat Oct 8 20:57:40 2022] DELETE /compute/v2.1/os-security-groups/ed69df86-546b-4b92-802e-2ad5cb3327d6 => generated 185 bytes in 359 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 08 20:57:40.950560 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-2e87a751-9594-48c2-ba76-4ec55d590869 req-e6aef8a4-6eb2-4236-8682-3467aad148da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24d7af5b-10ba-4df7-a95d-bcd0b2104f37", "tag": "fd61dc22-1328-45bc-8a61-27b2a295a029"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:57:40.980229 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-2e87a751-9594-48c2-ba76-4ec55d590869 req-e6aef8a4-6eb2-4236-8682-3467aad148da service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:40.980748 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-2e87a751-9594-48c2-ba76-4ec55d590869 req-e6aef8a4-6eb2-4236-8682-3467aad148da service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:40.981231 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-2e87a751-9594-48c2-ba76-4ec55d590869 req-e6aef8a4-6eb2-4236-8682-3467aad148da service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:41.001123 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-2e87a751-9594-48c2-ba76-4ec55d590869 req-e6aef8a4-6eb2-4236-8682-3467aad148da service nova] Creating event network-changed:fd61dc22-1328-45bc-8a61-27b2a295a029 for instance 24d7af5b-10ba-4df7-a95d-bcd0b2104f37 on nch1-master-1 Oct 08 20:57:41.006970 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-2e87a751-9594-48c2-ba76-4ec55d590869 req-e6aef8a4-6eb2-4236-8682-3467aad148da service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059810 Oct 08 20:57:41.014895 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 791/1524] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:57:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:57:41.021895 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-eae8935d-f984-459a-8bbe-e178dfc8f589 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:41.022844 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-eae8935d-f984-459a-8bbe-e178dfc8f589 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] [instance: e5389d1b-b9f3-491a-898c-be611599d73a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:41.029538 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-eae8935d-f984-459a-8bbe-e178dfc8f589 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:41.030258 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-eae8935d-f984-459a-8bbe-e178dfc8f589 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:41.030882 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-eae8935d-f984-459a-8bbe-e178dfc8f589 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:41.031816 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-eae8935d-f984-459a-8bbe-e178dfc8f589 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:41.032456 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-eae8935d-f984-459a-8bbe-e178dfc8f589 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:41.033065 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-eae8935d-f984-459a-8bbe-e178dfc8f589 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:41.162743 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-f66995e9-8367-48d9-b50d-f8a40abe93ba tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474ca64d1b1d4e30916b517645aba882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecc2dd2407b4819874bed09cb27959a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:41.173076 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-f66995e9-8367-48d9-b50d-f8a40abe93ba tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d1c93f-8392-4f67-a29e-05164828f9d8" status: 200 len: 1382 microversion: 2.1 time: 1.172204 Oct 08 20:57:41.174143 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 734/1525] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:57:39 2022] GET /compute/v2.1/servers/e2d1c93f-8392-4f67-a29e-05164828f9d8 => generated 1382 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:57:41.182480 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-f151e810-c2f9-46cc-b38b-c46c990e6239 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:41.183368 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-f151e810-c2f9-46cc-b38b-c46c990e6239 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] [instance: 74bdac1c-9b70-46f7-b671-9752894d8980] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:41.191413 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f151e810-c2f9-46cc-b38b-c46c990e6239 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:41.192184 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f151e810-c2f9-46cc-b38b-c46c990e6239 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:41.193045 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f151e810-c2f9-46cc-b38b-c46c990e6239 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:41.194745 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f151e810-c2f9-46cc-b38b-c46c990e6239 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:41.195459 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f151e810-c2f9-46cc-b38b-c46c990e6239 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:41.196143 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f151e810-c2f9-46cc-b38b-c46c990e6239 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:41.343310 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-eae8935d-f984-459a-8bbe-e178dfc8f589 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01ec70849cfa44368a91df8b3410aba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c97b3b7fa484f97bdf40224f7cc34d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:41.351562 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-eae8935d-f984-459a-8bbe-e178dfc8f589 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] 10.222.0.26 "GET /compute/v2.1/servers/e5389d1b-b9f3-491a-898c-be611599d73a" status: 200 len: 1322 microversion: 2.1 time: 0.334330 Oct 08 20:57:41.352151 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 792/1526] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:57:41 2022] GET /compute/v2.1/servers/e5389d1b-b9f3-491a-898c-be611599d73a => generated 1322 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:57:41.363010 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-935c9d7f-dde6-470a-bb36-a0af021d491c tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:57:41.367323 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-935c9d7f-dde6-470a-bb36-a0af021d491c tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] [instance: 24d7af5b-10ba-4df7-a95d-bcd0b2104f37] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:41.378110 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-935c9d7f-dde6-470a-bb36-a0af021d491c tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:41.378827 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-935c9d7f-dde6-470a-bb36-a0af021d491c tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:41.379914 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-935c9d7f-dde6-470a-bb36-a0af021d491c tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:41.382425 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-935c9d7f-dde6-470a-bb36-a0af021d491c tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:41.382914 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-935c9d7f-dde6-470a-bb36-a0af021d491c tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:41.383520 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-935c9d7f-dde6-470a-bb36-a0af021d491c tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:41.511311 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-935c9d7f-dde6-470a-bb36-a0af021d491c tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] 10.222.0.26 "POST /compute/v2.1/servers/24d7af5b-10ba-4df7-a95d-bcd0b2104f37/action" status: 202 len: 0 microversion: 2.1 time: 0.153549 Oct 08 20:57:41.512312 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 793/1527] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 20:57:41 2022] POST /compute/v2.1/servers/24d7af5b-10ba-4df7-a95d-bcd0b2104f37/action => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 20:57:41.518182 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-20b86c2b-47e2-44cb-8019-bed31f70dfe0 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:41.519847 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-20b86c2b-47e2-44cb-8019-bed31f70dfe0 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] [instance: 19327d3e-de51-432b-b594-cb9a1bfe2f49] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:41.527867 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-20b86c2b-47e2-44cb-8019-bed31f70dfe0 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:41.528368 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-20b86c2b-47e2-44cb-8019-bed31f70dfe0 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:41.528820 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-20b86c2b-47e2-44cb-8019-bed31f70dfe0 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:41.529705 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-20b86c2b-47e2-44cb-8019-bed31f70dfe0 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:41.530408 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-20b86c2b-47e2-44cb-8019-bed31f70dfe0 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:41.530853 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-20b86c2b-47e2-44cb-8019-bed31f70dfe0 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:41.674834 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-20b86c2b-47e2-44cb-8019-bed31f70dfe0 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322606d4cb0f45d3ac2eceab4999d45b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24a29bd6efb40609e31fbb6dba839e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:41.684374 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-20b86c2b-47e2-44cb-8019-bed31f70dfe0 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] 10.222.0.26 "GET /compute/v2.1/servers/19327d3e-de51-432b-b594-cb9a1bfe2f49" status: 200 len: 1275 microversion: 2.1 time: 0.170178 Oct 08 20:57:41.685107 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 794/1528] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:57:41 2022] GET /compute/v2.1/servers/19327d3e-de51-432b-b594-cb9a1bfe2f49 => generated 1275 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:57:41.711933 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-f151e810-c2f9-46cc-b38b-c46c990e6239 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:41.722572 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-f151e810-c2f9-46cc-b38b-c46c990e6239 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:41.725522 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-f151e810-c2f9-46cc-b38b-c46c990e6239 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:41.727830 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-f151e810-c2f9-46cc-b38b-c46c990e6239 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] 10.222.0.26 "GET /compute/v2.1/servers/74bdac1c-9b70-46f7-b671-9752894d8980" status: 200 len: 1281 microversion: 2.25 time: 0.552313 Oct 08 20:57:41.729062 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 735/1529] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:57:41 2022] GET /compute/v2.1/servers/74bdac1c-9b70-46f7-b671-9752894d8980 => generated 1281 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:57:41.735379 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-af28c096-9bc7-46a2-bba7-a9ff734690b1 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Calling method '.version_select at 0x7f1a8c686e50>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:41.740674 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-af28c096-9bc7-46a2-bba7-a9ff734690b1 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:41.741443 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-af28c096-9bc7-46a2-bba7-a9ff734690b1 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:41.742682 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-af28c096-9bc7-46a2-bba7-a9ff734690b1 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:41.756755 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-af28c096-9bc7-46a2-bba7-a9ff734690b1 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] 10.222.0.26 "GET /compute/v2.1/os-migrations" status: 200 len: 2701 microversion: 2.1 time: 0.026311 Oct 08 20:57:41.757779 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 736/1530] 10.222.0.26 () {58 vars in 1143 bytes} [Sat Oct 8 20:57:41 2022] GET /compute/v2.1/os-migrations => generated 2701 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:57:41.767186 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-927995c1-5abe-4f1d-9765-7a6b35161646 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:41.768493 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-927995c1-5abe-4f1d-9765-7a6b35161646 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] [instance: ceced78a-58d9-4175-b4fe-0d085be62c94] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:41.777598 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-927995c1-5abe-4f1d-9765-7a6b35161646 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:41.778856 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-927995c1-5abe-4f1d-9765-7a6b35161646 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:41.780310 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-927995c1-5abe-4f1d-9765-7a6b35161646 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:41.781422 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-927995c1-5abe-4f1d-9765-7a6b35161646 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:41.782456 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-927995c1-5abe-4f1d-9765-7a6b35161646 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:41.783049 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-927995c1-5abe-4f1d-9765-7a6b35161646 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:41.842386 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-4d6abdb7-ec1f-4c53-9eb8-dc98ee285578 tempest-QuotasAdminTestV257-1699810385 tempest-QuotasAdminTestV257-1699810385-project-admin] Action: 'update', calling method: .version_select at 0x7f1a8c15fd30>, body: {"quota_set": {"ram": "5120"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:57:41.914934 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4d6abdb7-ec1f-4c53-9eb8-dc98ee285578 tempest-QuotasAdminTestV257-1699810385 tempest-QuotasAdminTestV257-1699810385-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:41.915685 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4d6abdb7-ec1f-4c53-9eb8-dc98ee285578 tempest-QuotasAdminTestV257-1699810385 tempest-QuotasAdminTestV257-1699810385-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:41.916359 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4d6abdb7-ec1f-4c53-9eb8-dc98ee285578 tempest-QuotasAdminTestV257-1699810385 tempest-QuotasAdminTestV257-1699810385-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:41.917367 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4d6abdb7-ec1f-4c53-9eb8-dc98ee285578 tempest-QuotasAdminTestV257-1699810385 tempest-QuotasAdminTestV257-1699810385-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:41.918511 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4d6abdb7-ec1f-4c53-9eb8-dc98ee285578 tempest-QuotasAdminTestV257-1699810385 tempest-QuotasAdminTestV257-1699810385-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:41.919144 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4d6abdb7-ec1f-4c53-9eb8-dc98ee285578 tempest-QuotasAdminTestV257-1699810385 tempest-QuotasAdminTestV257-1699810385-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:41.936028 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:57:41.982065 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-4d6abdb7-ec1f-4c53-9eb8-dc98ee285578 tempest-QuotasAdminTestV257-1699810385 tempest-QuotasAdminTestV257-1699810385-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-quota-sets/c5a6c10b0c084c5bafadf90a0b8667f4" status: 200 len: 148 microversion: 2.57 time: 0.295382 Oct 08 20:57:41.983378 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 795/1531] 10.222.0.26 () {62 vars in 1303 bytes} [Sat Oct 8 20:57:41 2022] PUT /compute/v2.1/os-quota-sets/c5a6c10b0c084c5bafadf90a0b8667f4 => generated 148 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 08 20:57:41.989643 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-9455c24e-9587-4e1f-a23d-eb1d07dc8968 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:41.991044 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-9455c24e-9587-4e1f-a23d-eb1d07dc8968 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] [instance: 24d7af5b-10ba-4df7-a95d-bcd0b2104f37] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:41.998026 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9455c24e-9587-4e1f-a23d-eb1d07dc8968 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:41.998593 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9455c24e-9587-4e1f-a23d-eb1d07dc8968 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:41.999134 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9455c24e-9587-4e1f-a23d-eb1d07dc8968 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:41.999900 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9455c24e-9587-4e1f-a23d-eb1d07dc8968 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:42.000570 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9455c24e-9587-4e1f-a23d-eb1d07dc8968 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:42.001224 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9455c24e-9587-4e1f-a23d-eb1d07dc8968 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:42.277372 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-9455c24e-9587-4e1f-a23d-eb1d07dc8968 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac1323815364df4a3a4d4dbbb9d70dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be94d02ab5244f98337fb9b90e74746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:42.289661 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-9455c24e-9587-4e1f-a23d-eb1d07dc8968 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] 10.222.0.26 "GET /compute/v2.1/servers/24d7af5b-10ba-4df7-a95d-bcd0b2104f37" status: 200 len: 1573 microversion: 2.1 time: 0.304665 Oct 08 20:57:42.301213 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 796/1532] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:57:41 2022] GET /compute/v2.1/servers/24d7af5b-10ba-4df7-a95d-bcd0b2104f37 => generated 1573 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:57:42.301213 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-6a98edc9-8939-4ebb-a0ae-a75b2f73b134 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:42.301213 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-6a98edc9-8939-4ebb-a0ae-a75b2f73b134 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] [instance: 0568d34c-9aa0-452f-b5c5-b3fc19ebbf15] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:42.304955 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6a98edc9-8939-4ebb-a0ae-a75b2f73b134 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:42.309482 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6a98edc9-8939-4ebb-a0ae-a75b2f73b134 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:42.309482 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6a98edc9-8939-4ebb-a0ae-a75b2f73b134 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:42.309482 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6a98edc9-8939-4ebb-a0ae-a75b2f73b134 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:42.309482 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6a98edc9-8939-4ebb-a0ae-a75b2f73b134 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:42.309482 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6a98edc9-8939-4ebb-a0ae-a75b2f73b134 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:42.314056 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:57:42.338405 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-927995c1-5abe-4f1d-9765-7a6b35161646 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:42.361485 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-927995c1-5abe-4f1d-9765-7a6b35161646 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:42.363501 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-927995c1-5abe-4f1d-9765-7a6b35161646 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:42.364745 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-927995c1-5abe-4f1d-9765-7a6b35161646 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] 10.222.0.26 "GET /compute/v2.1/servers/ceced78a-58d9-4175-b4fe-0d085be62c94" status: 200 len: 1874 microversion: 2.42 time: 0.605196 Oct 08 20:57:42.365950 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 737/1533] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:57:41 2022] GET /compute/v2.1/servers/ceced78a-58d9-4175-b4fe-0d085be62c94 => generated 1874 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:57:42.381038 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-1d71aea7-a9c1-4dca-a8e0-aa5b9fb4c169 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:42.381987 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-1d71aea7-a9c1-4dca-a8e0-aa5b9fb4c169 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] [instance: e2d1c93f-8392-4f67-a29e-05164828f9d8] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:42.396757 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1d71aea7-a9c1-4dca-a8e0-aa5b9fb4c169 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:42.397300 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1d71aea7-a9c1-4dca-a8e0-aa5b9fb4c169 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:42.397752 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1d71aea7-a9c1-4dca-a8e0-aa5b9fb4c169 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:42.398472 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1d71aea7-a9c1-4dca-a8e0-aa5b9fb4c169 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:42.399127 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1d71aea7-a9c1-4dca-a8e0-aa5b9fb4c169 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:42.400302 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1d71aea7-a9c1-4dca-a8e0-aa5b9fb4c169 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:42.584645 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-6a98edc9-8939-4ebb-a0ae-a75b2f73b134 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9facf5ea0743cb821cec1b40f6b609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdaf5b9230f4e09949a39a5cbe72011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:42.597888 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-6a98edc9-8939-4ebb-a0ae-a75b2f73b134 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] 10.222.0.26 "GET /compute/v2.1/servers/0568d34c-9aa0-452f-b5c5-b3fc19ebbf15" status: 200 len: 1403 microversion: 2.1 time: 0.306089 Oct 08 20:57:42.599380 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 797/1534] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:57:42 2022] GET /compute/v2.1/servers/0568d34c-9aa0-452f-b5c5-b3fc19ebbf15 => generated 1403 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:57:42.607065 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-45265894-7fce-43bf-aa92-6751133d5c11 tempest-QuotasAdminTestV257-1699810385 tempest-QuotasAdminTestV257-1699810385-project-admin] Calling method '.version_select at 0x7f1a8c214280>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:42.687171 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-45265894-7fce-43bf-aa92-6751133d5c11 tempest-QuotasAdminTestV257-1699810385 tempest-QuotasAdminTestV257-1699810385-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:42.687674 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-45265894-7fce-43bf-aa92-6751133d5c11 tempest-QuotasAdminTestV257-1699810385 tempest-QuotasAdminTestV257-1699810385-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:42.688134 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-45265894-7fce-43bf-aa92-6751133d5c11 tempest-QuotasAdminTestV257-1699810385 tempest-QuotasAdminTestV257-1699810385-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:42.689221 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-45265894-7fce-43bf-aa92-6751133d5c11 tempest-QuotasAdminTestV257-1699810385 tempest-QuotasAdminTestV257-1699810385-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:42.689884 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-45265894-7fce-43bf-aa92-6751133d5c11 tempest-QuotasAdminTestV257-1699810385 tempest-QuotasAdminTestV257-1699810385-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:42.690325 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-45265894-7fce-43bf-aa92-6751133d5c11 tempest-QuotasAdminTestV257-1699810385 tempest-QuotasAdminTestV257-1699810385-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:42.715364 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-45265894-7fce-43bf-aa92-6751133d5c11 tempest-QuotasAdminTestV257-1699810385 tempest-QuotasAdminTestV257-1699810385-project-admin] 10.222.0.26 "GET /compute/v2.1/os-quota-sets/c5a6c10b0c084c5bafadf90a0b8667f4/detail" status: 200 len: 463 microversion: 2.57 time: 0.114073 Oct 08 20:57:42.721640 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 798/1535] 10.222.0.26 () {60 vars in 1304 bytes} [Sat Oct 8 20:57:42 2022] GET /compute/v2.1/os-quota-sets/c5a6c10b0c084c5bafadf90a0b8667f4/detail => generated 463 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 08 20:57:42.727363 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-2b0244d5-5720-4dcc-b33f-7596511925f4 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:42.728885 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-2b0244d5-5720-4dcc-b33f-7596511925f4 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] [instance: e5389d1b-b9f3-491a-898c-be611599d73a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:42.736527 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2b0244d5-5720-4dcc-b33f-7596511925f4 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:42.737731 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2b0244d5-5720-4dcc-b33f-7596511925f4 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:42.738357 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2b0244d5-5720-4dcc-b33f-7596511925f4 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:42.740409 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2b0244d5-5720-4dcc-b33f-7596511925f4 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:42.741065 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2b0244d5-5720-4dcc-b33f-7596511925f4 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:42.741760 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2b0244d5-5720-4dcc-b33f-7596511925f4 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:42.757953 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-1d71aea7-a9c1-4dca-a8e0-aa5b9fb4c169 tempest-LiveMigrationTest-245808024 tempest-LiveMigrationTest-245808024-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/e2d1c93f-8392-4f67-a29e-05164828f9d8" status: 200 len: 1533 microversion: 2.1 time: 0.390658 Oct 08 20:57:42.758497 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 738/1536] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:57:42 2022] GET /compute/v2.1/servers/e2d1c93f-8392-4f67-a29e-05164828f9d8 => generated 1533 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:57:42.789350 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-bdfbbd16-a34c-4019-b909-e577a7d4fa27 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:42.790095 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-bdfbbd16-a34c-4019-b909-e577a7d4fa27 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] [instance: 19327d3e-de51-432b-b594-cb9a1bfe2f49] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:42.796952 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bdfbbd16-a34c-4019-b909-e577a7d4fa27 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:42.809364 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bdfbbd16-a34c-4019-b909-e577a7d4fa27 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:42.809828 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bdfbbd16-a34c-4019-b909-e577a7d4fa27 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:42.810618 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bdfbbd16-a34c-4019-b909-e577a7d4fa27 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:42.811091 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bdfbbd16-a34c-4019-b909-e577a7d4fa27 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:42.811728 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bdfbbd16-a34c-4019-b909-e577a7d4fa27 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:43.038068 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-2b0244d5-5720-4dcc-b33f-7596511925f4 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01ec70849cfa44368a91df8b3410aba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c97b3b7fa484f97bdf40224f7cc34d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:43.046390 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-2b0244d5-5720-4dcc-b33f-7596511925f4 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] 10.222.0.26 "GET /compute/v2.1/servers/e5389d1b-b9f3-491a-898c-be611599d73a" status: 200 len: 1322 microversion: 2.1 time: 0.323591 Oct 08 20:57:43.047782 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 799/1537] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:57:42 2022] GET /compute/v2.1/servers/e5389d1b-b9f3-491a-898c-be611599d73a => generated 1322 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:57:43.052801 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-ba4ec56d-78c9-4c0b-8112-18a81adb83f7 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:43.053698 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-ba4ec56d-78c9-4c0b-8112-18a81adb83f7 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] [instance: 74bdac1c-9b70-46f7-b671-9752894d8980] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:43.060089 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ba4ec56d-78c9-4c0b-8112-18a81adb83f7 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:43.060809 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ba4ec56d-78c9-4c0b-8112-18a81adb83f7 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:43.061487 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ba4ec56d-78c9-4c0b-8112-18a81adb83f7 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:43.062391 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ba4ec56d-78c9-4c0b-8112-18a81adb83f7 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:43.062893 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ba4ec56d-78c9-4c0b-8112-18a81adb83f7 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:43.063338 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ba4ec56d-78c9-4c0b-8112-18a81adb83f7 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:43.237000 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-ba4ec56d-78c9-4c0b-8112-18a81adb83f7 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:43.250804 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-ba4ec56d-78c9-4c0b-8112-18a81adb83f7 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:43.252526 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-ba4ec56d-78c9-4c0b-8112-18a81adb83f7 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:43.256054 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-ba4ec56d-78c9-4c0b-8112-18a81adb83f7 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] 10.222.0.26 "GET /compute/v2.1/servers/74bdac1c-9b70-46f7-b671-9752894d8980" status: 200 len: 1281 microversion: 2.25 time: 0.206056 Oct 08 20:57:43.256665 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 800/1538] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:57:43 2022] GET /compute/v2.1/servers/74bdac1c-9b70-46f7-b671-9752894d8980 => generated 1281 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:57:43.261798 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-91e54ea6-fc1f-4936-8a45-516c01122475 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:43.262625 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-91e54ea6-fc1f-4936-8a45-516c01122475 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] [instance: e2d1c93f-8392-4f67-a29e-05164828f9d8] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:43.268358 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-91e54ea6-fc1f-4936-8a45-516c01122475 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:43.268855 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-91e54ea6-fc1f-4936-8a45-516c01122475 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:43.278958 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-bdfbbd16-a34c-4019-b909-e577a7d4fa27 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322606d4cb0f45d3ac2eceab4999d45b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24a29bd6efb40609e31fbb6dba839e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:43.291096 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-91e54ea6-fc1f-4936-8a45-516c01122475 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:43.292007 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-91e54ea6-fc1f-4936-8a45-516c01122475 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:43.292505 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-91e54ea6-fc1f-4936-8a45-516c01122475 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:43.292959 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-91e54ea6-fc1f-4936-8a45-516c01122475 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:43.299833 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-bdfbbd16-a34c-4019-b909-e577a7d4fa27 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] 10.222.0.26 "GET /compute/v2.1/servers/19327d3e-de51-432b-b594-cb9a1bfe2f49" status: 200 len: 1317 microversion: 2.1 time: 0.540221 Oct 08 20:57:43.301375 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 739/1539] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:57:42 2022] GET /compute/v2.1/servers/19327d3e-de51-432b-b594-cb9a1bfe2f49 => generated 1317 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:57:43.320251 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-e416b252-454a-4a46-ac59-6550556b415d tempest-QuotasAdminTestV257-1699810385 tempest-QuotasAdminTestV257-1699810385-project-admin] Action: 'update', calling method: .version_select at 0x7f1a8ca13160>, body: {"quota_set": {"ram": "2048"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:57:43.322708 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-91e54ea6-fc1f-4936-8a45-516c01122475 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] [instance: e2d1c93f-8392-4f67-a29e-05164828f9d8] Going to try to terminate instance {{(pid=140492) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 20:57:43.494658 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-91e54ea6-fc1f-4936-8a45-516c01122475 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] 10.222.0.26 "DELETE /compute/v2.1/servers/e2d1c93f-8392-4f67-a29e-05164828f9d8" status: 204 len: 0 microversion: 2.1 time: 0.236129 Oct 08 20:57:43.504970 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 801/1540] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 20:57:43 2022] DELETE /compute/v2.1/servers/e2d1c93f-8392-4f67-a29e-05164828f9d8 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 20:57:43.509920 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e416b252-454a-4a46-ac59-6550556b415d tempest-QuotasAdminTestV257-1699810385 tempest-QuotasAdminTestV257-1699810385-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:43.513524 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e416b252-454a-4a46-ac59-6550556b415d tempest-QuotasAdminTestV257-1699810385 tempest-QuotasAdminTestV257-1699810385-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:43.513834 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-a4e3272b-2053-4427-a52a-afdef6f9e5a0 req-b65bf9b0-41da-4b7e-a133-7912881d8129 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0568d34c-9aa0-452f-b5c5-b3fc19ebbf15", "tag": "9856b2f7-707c-4f16-a64b-c8cc9a82cceb"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:57:43.514642 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e416b252-454a-4a46-ac59-6550556b415d tempest-QuotasAdminTestV257-1699810385 tempest-QuotasAdminTestV257-1699810385-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:43.520846 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e416b252-454a-4a46-ac59-6550556b415d tempest-QuotasAdminTestV257-1699810385 tempest-QuotasAdminTestV257-1699810385-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:43.522696 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e416b252-454a-4a46-ac59-6550556b415d tempest-QuotasAdminTestV257-1699810385 tempest-QuotasAdminTestV257-1699810385-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:43.525097 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e416b252-454a-4a46-ac59-6550556b415d tempest-QuotasAdminTestV257-1699810385 tempest-QuotasAdminTestV257-1699810385-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:43.528545 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-a4e3272b-2053-4427-a52a-afdef6f9e5a0 req-b65bf9b0-41da-4b7e-a133-7912881d8129 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:43.529171 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-a4e3272b-2053-4427-a52a-afdef6f9e5a0 req-b65bf9b0-41da-4b7e-a133-7912881d8129 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:43.529686 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-a4e3272b-2053-4427-a52a-afdef6f9e5a0 req-b65bf9b0-41da-4b7e-a133-7912881d8129 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:43.546240 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-a4e3272b-2053-4427-a52a-afdef6f9e5a0 req-b65bf9b0-41da-4b7e-a133-7912881d8129 service nova] Creating event network-changed:9856b2f7-707c-4f16-a64b-c8cc9a82cceb for instance 0568d34c-9aa0-452f-b5c5-b3fc19ebbf15 on nch1-master-1 Oct 08 20:57:43.553059 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-a4e3272b-2053-4427-a52a-afdef6f9e5a0 req-b65bf9b0-41da-4b7e-a133-7912881d8129 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045935 Oct 08 20:57:43.554073 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 802/1541] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:57:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:57:43.559869 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-1e416696-00b9-47c6-a78d-3233653cd9c7 req-3453349e-943e-40c3-b6e0-bf073da5329b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5389d1b-b9f3-491a-898c-be611599d73a", "tag": "d911c0da-f663-4272-afa4-3646c36b9e29"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:57:43.570636 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-1e416696-00b9-47c6-a78d-3233653cd9c7 req-3453349e-943e-40c3-b6e0-bf073da5329b service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:43.571705 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-1e416696-00b9-47c6-a78d-3233653cd9c7 req-3453349e-943e-40c3-b6e0-bf073da5329b service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:43.571853 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-1e416696-00b9-47c6-a78d-3233653cd9c7 req-3453349e-943e-40c3-b6e0-bf073da5329b service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:43.581545 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e416b252-454a-4a46-ac59-6550556b415d tempest-QuotasAdminTestV257-1699810385 tempest-QuotasAdminTestV257-1699810385-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:43.582104 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e416b252-454a-4a46-ac59-6550556b415d tempest-QuotasAdminTestV257-1699810385 tempest-QuotasAdminTestV257-1699810385-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:43.582544 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e416b252-454a-4a46-ac59-6550556b415d tempest-QuotasAdminTestV257-1699810385 tempest-QuotasAdminTestV257-1699810385-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:43.583281 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e416b252-454a-4a46-ac59-6550556b415d tempest-QuotasAdminTestV257-1699810385 tempest-QuotasAdminTestV257-1699810385-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:43.584563 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e416b252-454a-4a46-ac59-6550556b415d tempest-QuotasAdminTestV257-1699810385 tempest-QuotasAdminTestV257-1699810385-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:43.585174 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e416b252-454a-4a46-ac59-6550556b415d tempest-QuotasAdminTestV257-1699810385 tempest-QuotasAdminTestV257-1699810385-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:43.606091 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-1e416696-00b9-47c6-a78d-3233653cd9c7 req-3453349e-943e-40c3-b6e0-bf073da5329b service nova] Creating event network-changed:d911c0da-f663-4272-afa4-3646c36b9e29 for instance e5389d1b-b9f3-491a-898c-be611599d73a on nch2-master-1 Oct 08 20:57:43.625049 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-1e416696-00b9-47c6-a78d-3233653cd9c7 req-3453349e-943e-40c3-b6e0-bf073da5329b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065811 Oct 08 20:57:43.625049 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 803/1542] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:57:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:57:43.647214 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-42ca76db-170b-4b33-a79e-22bd29986dbd req-73ec7a97-54c6-4398-8657-fb57d90f9cdf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ceced78a-58d9-4175-b4fe-0d085be62c94", "name": "network-vif-plugged", "status": "completed", "tag": "6a371950-2184-421b-a72d-4525c4232631"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:57:43.658660 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-e416b252-454a-4a46-ac59-6550556b415d tempest-QuotasAdminTestV257-1699810385 tempest-QuotasAdminTestV257-1699810385-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-quota-sets/c5a6c10b0c084c5bafadf90a0b8667f4?user_id=d1a8a7b2445349d88f5ee3d8fbb27029" status: 200 len: 148 microversion: 2.57 time: 0.355281 Oct 08 20:57:43.659876 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 740/1543] 10.222.0.26 () {62 vars in 1384 bytes} [Sat Oct 8 20:57:43 2022] PUT /compute/v2.1/os-quota-sets/c5a6c10b0c084c5bafadf90a0b8667f4?user_id=d1a8a7b2445349d88f5ee3d8fbb27029 => generated 148 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 08 20:57:43.663097 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-42ca76db-170b-4b33-a79e-22bd29986dbd req-73ec7a97-54c6-4398-8657-fb57d90f9cdf service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:43.663591 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-42ca76db-170b-4b33-a79e-22bd29986dbd req-73ec7a97-54c6-4398-8657-fb57d90f9cdf service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:43.664032 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-42ca76db-170b-4b33-a79e-22bd29986dbd req-73ec7a97-54c6-4398-8657-fb57d90f9cdf service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:43.665989 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-bc2cd445-44b8-4f3e-87fc-9b09952ea573 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:43.666800 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-bc2cd445-44b8-4f3e-87fc-9b09952ea573 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] [instance: 24d7af5b-10ba-4df7-a95d-bcd0b2104f37] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:43.673503 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bc2cd445-44b8-4f3e-87fc-9b09952ea573 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:43.674276 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bc2cd445-44b8-4f3e-87fc-9b09952ea573 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:43.674889 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bc2cd445-44b8-4f3e-87fc-9b09952ea573 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:43.675790 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bc2cd445-44b8-4f3e-87fc-9b09952ea573 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:43.676418 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bc2cd445-44b8-4f3e-87fc-9b09952ea573 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:43.677014 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bc2cd445-44b8-4f3e-87fc-9b09952ea573 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:43.690660 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-42ca76db-170b-4b33-a79e-22bd29986dbd req-73ec7a97-54c6-4398-8657-fb57d90f9cdf service nova] Creating event network-vif-plugged:6a371950-2184-421b-a72d-4525c4232631 for instance ceced78a-58d9-4175-b4fe-0d085be62c94 on nch2-master-1 Oct 08 20:57:43.699744 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-42ca76db-170b-4b33-a79e-22bd29986dbd req-73ec7a97-54c6-4398-8657-fb57d90f9cdf service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075732 Oct 08 20:57:43.701615 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 804/1544] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:57:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:57:43.714177 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-0b0fe48f-774f-4ed7-b1d3-41642c4c3709 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:43.715150 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-0b0fe48f-774f-4ed7-b1d3-41642c4c3709 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] [instance: ceced78a-58d9-4175-b4fe-0d085be62c94] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:43.722422 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0b0fe48f-774f-4ed7-b1d3-41642c4c3709 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:43.723095 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0b0fe48f-774f-4ed7-b1d3-41642c4c3709 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:43.723641 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0b0fe48f-774f-4ed7-b1d3-41642c4c3709 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:43.725265 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0b0fe48f-774f-4ed7-b1d3-41642c4c3709 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:43.725843 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0b0fe48f-774f-4ed7-b1d3-41642c4c3709 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:43.726384 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0b0fe48f-774f-4ed7-b1d3-41642c4c3709 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:44.101728 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-bc2cd445-44b8-4f3e-87fc-9b09952ea573 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac1323815364df4a3a4d4dbbb9d70dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be94d02ab5244f98337fb9b90e74746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:44.116348 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-bc2cd445-44b8-4f3e-87fc-9b09952ea573 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] 10.222.0.26 "GET /compute/v2.1/servers/24d7af5b-10ba-4df7-a95d-bcd0b2104f37" status: 200 len: 1578 microversion: 2.1 time: 0.453974 Oct 08 20:57:44.118048 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 741/1545] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:57:43 2022] GET /compute/v2.1/servers/24d7af5b-10ba-4df7-a95d-bcd0b2104f37 => generated 1578 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:57:44.140512 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-705059b5-cf46-4067-8e64-e6484ec68f68 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:44.141618 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-705059b5-cf46-4067-8e64-e6484ec68f68 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] [instance: e2d1c93f-8392-4f67-a29e-05164828f9d8] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:44.150333 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:57:44.153734 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-705059b5-cf46-4067-8e64-e6484ec68f68 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:44.155510 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-705059b5-cf46-4067-8e64-e6484ec68f68 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:44.156717 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-705059b5-cf46-4067-8e64-e6484ec68f68 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:44.158061 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-705059b5-cf46-4067-8e64-e6484ec68f68 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:44.158804 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-705059b5-cf46-4067-8e64-e6484ec68f68 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:44.159446 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-705059b5-cf46-4067-8e64-e6484ec68f68 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:44.262199 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-0b0fe48f-774f-4ed7-b1d3-41642c4c3709 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:44.273644 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-0b0fe48f-774f-4ed7-b1d3-41642c4c3709 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:44.275270 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-0b0fe48f-774f-4ed7-b1d3-41642c4c3709 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:44.276514 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-0b0fe48f-774f-4ed7-b1d3-41642c4c3709 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] 10.222.0.26 "GET /compute/v2.1/servers/ceced78a-58d9-4175-b4fe-0d085be62c94" status: 200 len: 1874 microversion: 2.42 time: 0.572718 Oct 08 20:57:44.278454 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 805/1546] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:57:43 2022] GET /compute/v2.1/servers/ceced78a-58d9-4175-b4fe-0d085be62c94 => generated 1874 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:57:44.283295 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-c0122fb7-82f3-4744-abe7-3ee8dea6c55d tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:44.284269 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-c0122fb7-82f3-4744-abe7-3ee8dea6c55d tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] [instance: 0568d34c-9aa0-452f-b5c5-b3fc19ebbf15] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:44.290778 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c0122fb7-82f3-4744-abe7-3ee8dea6c55d tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:44.292077 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c0122fb7-82f3-4744-abe7-3ee8dea6c55d tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:44.292077 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c0122fb7-82f3-4744-abe7-3ee8dea6c55d tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:44.292780 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c0122fb7-82f3-4744-abe7-3ee8dea6c55d tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:44.293365 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c0122fb7-82f3-4744-abe7-3ee8dea6c55d tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:44.294017 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c0122fb7-82f3-4744-abe7-3ee8dea6c55d tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:44.450141 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-c0122fb7-82f3-4744-abe7-3ee8dea6c55d tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9facf5ea0743cb821cec1b40f6b609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdaf5b9230f4e09949a39a5cbe72011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:44.460811 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-c0122fb7-82f3-4744-abe7-3ee8dea6c55d tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] 10.222.0.26 "GET /compute/v2.1/servers/0568d34c-9aa0-452f-b5c5-b3fc19ebbf15" status: 200 len: 1403 microversion: 2.1 time: 0.182059 Oct 08 20:57:44.461911 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 806/1547] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:57:44 2022] GET /compute/v2.1/servers/0568d34c-9aa0-452f-b5c5-b3fc19ebbf15 => generated 1403 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:57:44.481652 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-74850a16-e848-4d3f-a366-f730aa98c9dd tempest-QuotasAdminTestV257-1699810385 tempest-QuotasAdminTestV257-1699810385-project-admin] Calling method '.version_select at 0x7f1a8c20f790>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:44.578134 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-74850a16-e848-4d3f-a366-f730aa98c9dd tempest-QuotasAdminTestV257-1699810385 tempest-QuotasAdminTestV257-1699810385-project-admin] 10.222.0.26 "GET /compute/v2.1/os-quota-sets/c5a6c10b0c084c5bafadf90a0b8667f4?user_id=d1a8a7b2445349d88f5ee3d8fbb27029" status: 200 len: 190 microversion: 2.57 time: 0.108442 Oct 08 20:57:44.578474 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 807/1548] 10.222.0.26 () {60 vars in 1364 bytes} [Sat Oct 8 20:57:44 2022] GET /compute/v2.1/os-quota-sets/c5a6c10b0c084c5bafadf90a0b8667f4?user_id=d1a8a7b2445349d88f5ee3d8fbb27029 => generated 190 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 08 20:57:44.598073 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-41b7c9d8-cb22-4547-847c-d8bbfb60c42e tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:44.599007 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-41b7c9d8-cb22-4547-847c-d8bbfb60c42e tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] [instance: e5389d1b-b9f3-491a-898c-be611599d73a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:44.608769 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-41b7c9d8-cb22-4547-847c-d8bbfb60c42e tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:44.609519 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-41b7c9d8-cb22-4547-847c-d8bbfb60c42e tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:44.610240 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-41b7c9d8-cb22-4547-847c-d8bbfb60c42e tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:44.611176 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-41b7c9d8-cb22-4547-847c-d8bbfb60c42e tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:44.612365 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-41b7c9d8-cb22-4547-847c-d8bbfb60c42e tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:44.613385 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-41b7c9d8-cb22-4547-847c-d8bbfb60c42e tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:44.725900 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-705059b5-cf46-4067-8e64-e6484ec68f68 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474ca64d1b1d4e30916b517645aba882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecc2dd2407b4819874bed09cb27959a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:44.748367 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-705059b5-cf46-4067-8e64-e6484ec68f68 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d1c93f-8392-4f67-a29e-05164828f9d8" status: 200 len: 1388 microversion: 2.1 time: 0.628906 Oct 08 20:57:44.761308 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 742/1549] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:57:44 2022] GET /compute/v2.1/servers/e2d1c93f-8392-4f67-a29e-05164828f9d8 => generated 1388 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:57:44.767091 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-12f47c0c-38ac-4078-8bd9-96e8a1a83180 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:44.767091 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-12f47c0c-38ac-4078-8bd9-96e8a1a83180 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] [instance: 74bdac1c-9b70-46f7-b671-9752894d8980] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:44.780525 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-12f47c0c-38ac-4078-8bd9-96e8a1a83180 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:44.781043 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-12f47c0c-38ac-4078-8bd9-96e8a1a83180 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:44.781520 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-12f47c0c-38ac-4078-8bd9-96e8a1a83180 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:44.786321 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-12f47c0c-38ac-4078-8bd9-96e8a1a83180 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:44.787018 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-12f47c0c-38ac-4078-8bd9-96e8a1a83180 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:44.788660 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-12f47c0c-38ac-4078-8bd9-96e8a1a83180 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:44.886086 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-41b7c9d8-cb22-4547-847c-d8bbfb60c42e tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01ec70849cfa44368a91df8b3410aba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c97b3b7fa484f97bdf40224f7cc34d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:44.894835 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-41b7c9d8-cb22-4547-847c-d8bbfb60c42e tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] 10.222.0.26 "GET /compute/v2.1/servers/e5389d1b-b9f3-491a-898c-be611599d73a" status: 200 len: 1322 microversion: 2.1 time: 0.315313 Oct 08 20:57:44.896660 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 808/1550] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:57:44 2022] GET /compute/v2.1/servers/e5389d1b-b9f3-491a-898c-be611599d73a => generated 1322 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:57:44.902012 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-8023be6d-f0d0-4f02-80f0-39c304c52910 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:44.902910 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-8023be6d-f0d0-4f02-80f0-39c304c52910 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] [instance: 19327d3e-de51-432b-b594-cb9a1bfe2f49] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:44.909957 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8023be6d-f0d0-4f02-80f0-39c304c52910 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:44.910813 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8023be6d-f0d0-4f02-80f0-39c304c52910 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:44.911256 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8023be6d-f0d0-4f02-80f0-39c304c52910 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:44.913239 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8023be6d-f0d0-4f02-80f0-39c304c52910 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:44.914398 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8023be6d-f0d0-4f02-80f0-39c304c52910 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:44.915532 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8023be6d-f0d0-4f02-80f0-39c304c52910 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:45.137365 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-8023be6d-f0d0-4f02-80f0-39c304c52910 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322606d4cb0f45d3ac2eceab4999d45b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24a29bd6efb40609e31fbb6dba839e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:45.150305 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-8023be6d-f0d0-4f02-80f0-39c304c52910 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] 10.222.0.26 "GET /compute/v2.1/servers/19327d3e-de51-432b-b594-cb9a1bfe2f49" status: 200 len: 1317 microversion: 2.1 time: 0.251713 Oct 08 20:57:45.166599 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 809/1551] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:57:44 2022] GET /compute/v2.1/servers/19327d3e-de51-432b-b594-cb9a1bfe2f49 => generated 1317 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:57:45.174282 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-9ce4f580-a5a8-48d4-8dba-b7950c21ced0 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:45.175774 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-9ce4f580-a5a8-48d4-8dba-b7950c21ced0 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] [instance: 24d7af5b-10ba-4df7-a95d-bcd0b2104f37] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:45.183888 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9ce4f580-a5a8-48d4-8dba-b7950c21ced0 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:45.184390 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9ce4f580-a5a8-48d4-8dba-b7950c21ced0 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:45.184849 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9ce4f580-a5a8-48d4-8dba-b7950c21ced0 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:45.186774 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9ce4f580-a5a8-48d4-8dba-b7950c21ced0 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:45.187255 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9ce4f580-a5a8-48d4-8dba-b7950c21ced0 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:45.188612 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9ce4f580-a5a8-48d4-8dba-b7950c21ced0 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:45.336705 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-12f47c0c-38ac-4078-8bd9-96e8a1a83180 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:45.348222 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-12f47c0c-38ac-4078-8bd9-96e8a1a83180 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:45.354687 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-12f47c0c-38ac-4078-8bd9-96e8a1a83180 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:45.356306 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-12f47c0c-38ac-4078-8bd9-96e8a1a83180 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] 10.222.0.26 "GET /compute/v2.1/servers/74bdac1c-9b70-46f7-b671-9752894d8980" status: 200 len: 1281 microversion: 2.25 time: 0.603835 Oct 08 20:57:45.362015 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 743/1552] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:57:44 2022] GET /compute/v2.1/servers/74bdac1c-9b70-46f7-b671-9752894d8980 => generated 1281 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:57:45.367653 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-1add8cbe-acbc-47cf-a171-a43fbab91270 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:45.373131 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-1add8cbe-acbc-47cf-a171-a43fbab91270 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] [instance: ceced78a-58d9-4175-b4fe-0d085be62c94] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:45.387361 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1add8cbe-acbc-47cf-a171-a43fbab91270 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:45.388148 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1add8cbe-acbc-47cf-a171-a43fbab91270 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:45.388587 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1add8cbe-acbc-47cf-a171-a43fbab91270 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:45.389706 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1add8cbe-acbc-47cf-a171-a43fbab91270 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:45.393146 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1add8cbe-acbc-47cf-a171-a43fbab91270 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:45.393906 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1add8cbe-acbc-47cf-a171-a43fbab91270 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:45.644625 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-9ce4f580-a5a8-48d4-8dba-b7950c21ced0 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac1323815364df4a3a4d4dbbb9d70dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be94d02ab5244f98337fb9b90e74746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:45.655114 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-9ce4f580-a5a8-48d4-8dba-b7950c21ced0 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] 10.222.0.26 "GET /compute/v2.1/servers/24d7af5b-10ba-4df7-a95d-bcd0b2104f37" status: 200 len: 1571 microversion: 2.1 time: 0.487492 Oct 08 20:57:45.677223 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 810/1553] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:57:45 2022] GET /compute/v2.1/servers/24d7af5b-10ba-4df7-a95d-bcd0b2104f37 => generated 1571 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:57:45.683210 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-1155012a-30c7-4d59-911b-fdc417a0673c tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:45.683849 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-1155012a-30c7-4d59-911b-fdc417a0673c tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] [instance: 0568d34c-9aa0-452f-b5c5-b3fc19ebbf15] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:45.695365 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1155012a-30c7-4d59-911b-fdc417a0673c tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:45.695896 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1155012a-30c7-4d59-911b-fdc417a0673c tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:45.697624 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1155012a-30c7-4d59-911b-fdc417a0673c tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:45.698615 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1155012a-30c7-4d59-911b-fdc417a0673c tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:45.699292 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1155012a-30c7-4d59-911b-fdc417a0673c tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:45.699901 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1155012a-30c7-4d59-911b-fdc417a0673c tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:45.700034 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-1add8cbe-acbc-47cf-a171-a43fbab91270 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:45.718973 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-1add8cbe-acbc-47cf-a171-a43fbab91270 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:45.723162 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-1add8cbe-acbc-47cf-a171-a43fbab91270 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:45.729540 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-1add8cbe-acbc-47cf-a171-a43fbab91270 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] 10.222.0.26 "GET /compute/v2.1/servers/ceced78a-58d9-4175-b4fe-0d085be62c94" status: 200 len: 1874 microversion: 2.42 time: 0.366033 Oct 08 20:57:45.730448 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 744/1554] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:57:45 2022] GET /compute/v2.1/servers/ceced78a-58d9-4175-b4fe-0d085be62c94 => generated 1874 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:57:45.737098 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-e8e9f9e0-f126-468f-802d-d1fb48782622 req-bc0cbd82-8a07-487c-b677-12ef4ae82cb0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19327d3e-de51-432b-b594-cb9a1bfe2f49", "tag": "6fbec29d-5924-4cc1-9f8d-c5ac27cbc284"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:57:45.762525 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-e8e9f9e0-f126-468f-802d-d1fb48782622 req-bc0cbd82-8a07-487c-b677-12ef4ae82cb0 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:45.763021 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-e8e9f9e0-f126-468f-802d-d1fb48782622 req-bc0cbd82-8a07-487c-b677-12ef4ae82cb0 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:45.763460 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-e8e9f9e0-f126-468f-802d-d1fb48782622 req-bc0cbd82-8a07-487c-b677-12ef4ae82cb0 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:45.776060 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-e8e9f9e0-f126-468f-802d-d1fb48782622 req-bc0cbd82-8a07-487c-b677-12ef4ae82cb0 service nova] Creating event network-changed:6fbec29d-5924-4cc1-9f8d-c5ac27cbc284 for instance 19327d3e-de51-432b-b594-cb9a1bfe2f49 on nch1-master-1 Oct 08 20:57:45.781391 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-e8e9f9e0-f126-468f-802d-d1fb48782622 req-bc0cbd82-8a07-487c-b677-12ef4ae82cb0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049579 Oct 08 20:57:45.782360 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 745/1555] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:57:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:57:45.788218 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-69c15c59-9646-4178-8d36-0cb7ee398a26 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1509904025"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:57:45.788857 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-69c15c59-9646-4178-8d36-0cb7ee398a26 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] [instance: 24d7af5b-10ba-4df7-a95d-bcd0b2104f37] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:45.796005 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-69c15c59-9646-4178-8d36-0cb7ee398a26 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:45.796500 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-69c15c59-9646-4178-8d36-0cb7ee398a26 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:45.797124 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-69c15c59-9646-4178-8d36-0cb7ee398a26 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:45.798549 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-69c15c59-9646-4178-8d36-0cb7ee398a26 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:45.799411 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-69c15c59-9646-4178-8d36-0cb7ee398a26 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:45.800089 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-69c15c59-9646-4178-8d36-0cb7ee398a26 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:45.938472 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-1155012a-30c7-4d59-911b-fdc417a0673c tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9facf5ea0743cb821cec1b40f6b609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdaf5b9230f4e09949a39a5cbe72011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:45.951044 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-1155012a-30c7-4d59-911b-fdc417a0673c tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] 10.222.0.26 "GET /compute/v2.1/servers/0568d34c-9aa0-452f-b5c5-b3fc19ebbf15" status: 200 len: 1403 microversion: 2.1 time: 0.285822 Oct 08 20:57:45.966468 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 811/1556] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:57:45 2022] GET /compute/v2.1/servers/0568d34c-9aa0-452f-b5c5-b3fc19ebbf15 => generated 1403 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:57:45.974995 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-8010b61c-d3fc-47a9-adca-ef5dbc3fbb06 req-6a6f20c8-3a36-455c-9a96-c425c66aa1a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ceced78a-58d9-4175-b4fe-0d085be62c94", "name": "network-vif-plugged", "status": "completed", "tag": "f16f4042-95b4-4dfa-afa7-41b0147a6cf2"}, {"server_uuid": "74bdac1c-9b70-46f7-b671-9752894d8980", "name": "network-vif-plugged", "status": "completed", "tag": "6bec4ac2-ff67-4158-be6a-9cd282b10d00"}, {"server_uuid": "ceced78a-58d9-4175-b4fe-0d085be62c94", "name": "network-vif-plugged", "status": "completed", "tag": "5dd9a8e9-ad33-45d4-9c64-b8e4e48e3190"}, {"server_uuid": "ceced78a-58d9-4175-b4fe-0d085be62c94", "name": "network-vif-plugged", "status": "completed", "tag": "3083c386-8718-4dfc-8fe3-11330119883c"}, {"server_uuid": "ceced78a-58d9-4175-b4fe-0d085be62c94", "name": "network-vif-plugged", "status": "completed", "tag": "aa2712c9-7942-46c1-ba5f-b344a76ff083"}, {"server_uuid": "ceced78a-58d9-4175-b4fe-0d085be62c94", "name": "network-vif-plugged", "status": "completed", "tag": "b0a57839-341e-4831-b37b-2d1a263887b4"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:57:45.988109 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-8010b61c-d3fc-47a9-adca-ef5dbc3fbb06 req-6a6f20c8-3a36-455c-9a96-c425c66aa1a6 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:45.988599 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-8010b61c-d3fc-47a9-adca-ef5dbc3fbb06 req-6a6f20c8-3a36-455c-9a96-c425c66aa1a6 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:45.989276 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-8010b61c-d3fc-47a9-adca-ef5dbc3fbb06 req-6a6f20c8-3a36-455c-9a96-c425c66aa1a6 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:46.007065 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-8010b61c-d3fc-47a9-adca-ef5dbc3fbb06 req-6a6f20c8-3a36-455c-9a96-c425c66aa1a6 service nova] Creating event network-vif-plugged:f16f4042-95b4-4dfa-afa7-41b0147a6cf2 for instance ceced78a-58d9-4175-b4fe-0d085be62c94 on nch2-master-1 Oct 08 20:57:46.007988 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-8010b61c-d3fc-47a9-adca-ef5dbc3fbb06 req-6a6f20c8-3a36-455c-9a96-c425c66aa1a6 service nova] Creating event network-vif-plugged:6bec4ac2-ff67-4158-be6a-9cd282b10d00 for instance 74bdac1c-9b70-46f7-b671-9752894d8980 on nch2-master-1 Oct 08 20:57:46.008767 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-8010b61c-d3fc-47a9-adca-ef5dbc3fbb06 req-6a6f20c8-3a36-455c-9a96-c425c66aa1a6 service nova] Creating event network-vif-plugged:5dd9a8e9-ad33-45d4-9c64-b8e4e48e3190 for instance ceced78a-58d9-4175-b4fe-0d085be62c94 on nch2-master-1 Oct 08 20:57:46.009566 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-8010b61c-d3fc-47a9-adca-ef5dbc3fbb06 req-6a6f20c8-3a36-455c-9a96-c425c66aa1a6 service nova] Creating event network-vif-plugged:3083c386-8718-4dfc-8fe3-11330119883c for instance ceced78a-58d9-4175-b4fe-0d085be62c94 on nch2-master-1 Oct 08 20:57:46.010332 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-8010b61c-d3fc-47a9-adca-ef5dbc3fbb06 req-6a6f20c8-3a36-455c-9a96-c425c66aa1a6 service nova] Creating event network-vif-plugged:aa2712c9-7942-46c1-ba5f-b344a76ff083 for instance ceced78a-58d9-4175-b4fe-0d085be62c94 on nch2-master-1 Oct 08 20:57:46.011432 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-8010b61c-d3fc-47a9-adca-ef5dbc3fbb06 req-6a6f20c8-3a36-455c-9a96-c425c66aa1a6 service nova] Creating event network-vif-plugged:b0a57839-341e-4831-b37b-2d1a263887b4 for instance ceced78a-58d9-4175-b4fe-0d085be62c94 on nch2-master-1 Oct 08 20:57:46.022353 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-8010b61c-d3fc-47a9-adca-ef5dbc3fbb06 req-6a6f20c8-3a36-455c-9a96-c425c66aa1a6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1038 microversion: 2.1 time: 0.052798 Oct 08 20:57:46.023376 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 812/1557] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:57:45 2022] POST /compute/v2.1/os-server-external-events => generated 1038 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:57:46.033978 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-f265f48b-8402-4d5e-80c1-f994ab26bf99 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:46.036242 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-f265f48b-8402-4d5e-80c1-f994ab26bf99 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] [instance: e2d1c93f-8392-4f67-a29e-05164828f9d8] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:46.045988 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f265f48b-8402-4d5e-80c1-f994ab26bf99 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:46.048228 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f265f48b-8402-4d5e-80c1-f994ab26bf99 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:46.048818 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f265f48b-8402-4d5e-80c1-f994ab26bf99 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:46.049731 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f265f48b-8402-4d5e-80c1-f994ab26bf99 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:46.051016 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f265f48b-8402-4d5e-80c1-f994ab26bf99 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:46.051734 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f265f48b-8402-4d5e-80c1-f994ab26bf99 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:46.091047 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.network.security_group_api [None req-69c15c59-9646-4178-8d36-0cb7ee398a26 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Adding security group 2df41a21-06a2-472b-a351-effdc7320dda to port fd61dc22-1328-45bc-8a61-27b2a295a029 Oct 08 20:57:46.166287 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-f265f48b-8402-4d5e-80c1-f994ab26bf99 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474ca64d1b1d4e30916b517645aba882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecc2dd2407b4819874bed09cb27959a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:46.177141 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-f265f48b-8402-4d5e-80c1-f994ab26bf99 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d1c93f-8392-4f67-a29e-05164828f9d8" status: 200 len: 1346 microversion: 2.1 time: 0.150876 Oct 08 20:57:46.181855 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 813/1558] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:57:46 2022] GET /compute/v2.1/servers/e2d1c93f-8392-4f67-a29e-05164828f9d8 => generated 1346 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:57:46.187021 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-88fee983-f8a6-443c-97a6-86a759d71a49 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:46.196517 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-88fee983-f8a6-443c-97a6-86a759d71a49 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] [instance: e5389d1b-b9f3-491a-898c-be611599d73a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:46.211265 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-88fee983-f8a6-443c-97a6-86a759d71a49 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:46.211779 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-88fee983-f8a6-443c-97a6-86a759d71a49 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:46.212226 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-88fee983-f8a6-443c-97a6-86a759d71a49 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:46.212961 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-88fee983-f8a6-443c-97a6-86a759d71a49 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:46.213469 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-88fee983-f8a6-443c-97a6-86a759d71a49 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:46.219287 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-88fee983-f8a6-443c-97a6-86a759d71a49 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:46.563593 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-88fee983-f8a6-443c-97a6-86a759d71a49 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01ec70849cfa44368a91df8b3410aba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c97b3b7fa484f97bdf40224f7cc34d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:46.577120 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-88fee983-f8a6-443c-97a6-86a759d71a49 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] 10.222.0.26 "GET /compute/v2.1/servers/e5389d1b-b9f3-491a-898c-be611599d73a" status: 200 len: 1322 microversion: 2.1 time: 0.392588 Oct 08 20:57:46.578174 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 814/1559] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:57:46 2022] GET /compute/v2.1/servers/e5389d1b-b9f3-491a-898c-be611599d73a => generated 1322 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:57:46.585892 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e8991cd6-fbab-4fc9-9452-b08d0297184d tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:46.586977 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-e8991cd6-fbab-4fc9-9452-b08d0297184d tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] [instance: 19327d3e-de51-432b-b594-cb9a1bfe2f49] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:46.593692 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e8991cd6-fbab-4fc9-9452-b08d0297184d tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:46.594447 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e8991cd6-fbab-4fc9-9452-b08d0297184d tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:46.595154 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e8991cd6-fbab-4fc9-9452-b08d0297184d tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:46.596101 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e8991cd6-fbab-4fc9-9452-b08d0297184d tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:46.596817 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e8991cd6-fbab-4fc9-9452-b08d0297184d tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:46.597430 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e8991cd6-fbab-4fc9-9452-b08d0297184d tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:46.958485 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-e8991cd6-fbab-4fc9-9452-b08d0297184d tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322606d4cb0f45d3ac2eceab4999d45b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24a29bd6efb40609e31fbb6dba839e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:46.971035 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-e8991cd6-fbab-4fc9-9452-b08d0297184d tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] 10.222.0.26 "GET /compute/v2.1/servers/19327d3e-de51-432b-b594-cb9a1bfe2f49" status: 200 len: 1317 microversion: 2.1 time: 0.390482 Oct 08 20:57:46.973651 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 815/1560] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:57:46 2022] GET /compute/v2.1/servers/19327d3e-de51-432b-b594-cb9a1bfe2f49 => generated 1317 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:57:46.996921 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-1e38b398-a6b4-4548-9e98-a89be6ef8971 req-83b27a3f-074c-4cc1-8d40-95703127c7a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2d1c93f-8392-4f67-a29e-05164828f9d8", "name": "network-vif-deleted", "tag": "1efef783-bf7f-44d9-bb48-aa0b771e72b2"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:57:47.013303 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-1e38b398-a6b4-4548-9e98-a89be6ef8971 req-83b27a3f-074c-4cc1-8d40-95703127c7a0 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:47.014149 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-1e38b398-a6b4-4548-9e98-a89be6ef8971 req-83b27a3f-074c-4cc1-8d40-95703127c7a0 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:47.015037 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-1e38b398-a6b4-4548-9e98-a89be6ef8971 req-83b27a3f-074c-4cc1-8d40-95703127c7a0 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:47.016940 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-69c15c59-9646-4178-8d36-0cb7ee398a26 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] 10.222.0.26 "POST /compute/v2.1/servers/24d7af5b-10ba-4df7-a95d-bcd0b2104f37/action" status: 202 len: 0 microversion: 2.1 time: 1.233335 Oct 08 20:57:47.018787 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 746/1561] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 20:57:45 2022] POST /compute/v2.1/servers/24d7af5b-10ba-4df7-a95d-bcd0b2104f37/action => generated 0 bytes in 1236 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 20:57:47.025915 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-96a51122-7a91-40bd-8eba-68e9d1490853 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:47.026766 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-96a51122-7a91-40bd-8eba-68e9d1490853 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] [instance: 74bdac1c-9b70-46f7-b671-9752894d8980] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:47.035118 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-1e38b398-a6b4-4548-9e98-a89be6ef8971 req-83b27a3f-074c-4cc1-8d40-95703127c7a0 service nova] Creating event network-vif-deleted:1efef783-bf7f-44d9-bb48-aa0b771e72b2 for instance e2d1c93f-8392-4f67-a29e-05164828f9d8 on nch1-master-1 Oct 08 20:57:47.039466 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-96a51122-7a91-40bd-8eba-68e9d1490853 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:47.040125 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-96a51122-7a91-40bd-8eba-68e9d1490853 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:47.041049 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-96a51122-7a91-40bd-8eba-68e9d1490853 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:47.043553 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-1e38b398-a6b4-4548-9e98-a89be6ef8971 req-83b27a3f-074c-4cc1-8d40-95703127c7a0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065386 Oct 08 20:57:47.044305 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 816/1562] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:57:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:57:47.044650 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-96a51122-7a91-40bd-8eba-68e9d1490853 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:47.048505 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-96a51122-7a91-40bd-8eba-68e9d1490853 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:47.049544 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-96a51122-7a91-40bd-8eba-68e9d1490853 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:47.055525 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-f17d0157-4f9b-4b25-9e52-f27b420cb2a1 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:47.056649 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-f17d0157-4f9b-4b25-9e52-f27b420cb2a1 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] [instance: ceced78a-58d9-4175-b4fe-0d085be62c94] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:47.063453 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f17d0157-4f9b-4b25-9e52-f27b420cb2a1 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:47.063946 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f17d0157-4f9b-4b25-9e52-f27b420cb2a1 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:47.064454 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f17d0157-4f9b-4b25-9e52-f27b420cb2a1 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:47.065172 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f17d0157-4f9b-4b25-9e52-f27b420cb2a1 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:47.065706 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f17d0157-4f9b-4b25-9e52-f27b420cb2a1 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:47.066136 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f17d0157-4f9b-4b25-9e52-f27b420cb2a1 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:47.084269 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:57:47.298477 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-96a51122-7a91-40bd-8eba-68e9d1490853 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:47.310597 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-96a51122-7a91-40bd-8eba-68e9d1490853 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:47.312376 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-96a51122-7a91-40bd-8eba-68e9d1490853 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:47.313966 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-96a51122-7a91-40bd-8eba-68e9d1490853 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] 10.222.0.26 "GET /compute/v2.1/servers/74bdac1c-9b70-46f7-b671-9752894d8980" status: 200 len: 1281 microversion: 2.25 time: 0.293762 Oct 08 20:57:47.314629 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 747/1563] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:57:47 2022] GET /compute/v2.1/servers/74bdac1c-9b70-46f7-b671-9752894d8980 => generated 1281 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:57:47.321943 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-ef7599bc-be8b-4983-98ae-fc6137499b1f tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:47.323581 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-ef7599bc-be8b-4983-98ae-fc6137499b1f tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] [instance: 0568d34c-9aa0-452f-b5c5-b3fc19ebbf15] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:47.333143 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ef7599bc-be8b-4983-98ae-fc6137499b1f tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:47.334031 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ef7599bc-be8b-4983-98ae-fc6137499b1f tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:47.334484 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ef7599bc-be8b-4983-98ae-fc6137499b1f tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:47.335868 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ef7599bc-be8b-4983-98ae-fc6137499b1f tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:47.336599 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ef7599bc-be8b-4983-98ae-fc6137499b1f tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:47.337307 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ef7599bc-be8b-4983-98ae-fc6137499b1f tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:47.348693 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-f17d0157-4f9b-4b25-9e52-f27b420cb2a1 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:47.364493 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-f17d0157-4f9b-4b25-9e52-f27b420cb2a1 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:47.371960 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-f17d0157-4f9b-4b25-9e52-f27b420cb2a1 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:47.372646 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-f17d0157-4f9b-4b25-9e52-f27b420cb2a1 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] 10.222.0.26 "GET /compute/v2.1/servers/ceced78a-58d9-4175-b4fe-0d085be62c94" status: 200 len: 1874 microversion: 2.42 time: 0.323186 Oct 08 20:57:47.372947 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 817/1564] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:57:47 2022] GET /compute/v2.1/servers/ceced78a-58d9-4175-b4fe-0d085be62c94 => generated 1874 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:57:47.377680 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-b89deb8b-1508-43f0-99a9-986a2860f3b5 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Calling method '.version_select at 0x7f1a8c156af0>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:47.527890 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-ef7599bc-be8b-4983-98ae-fc6137499b1f tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9facf5ea0743cb821cec1b40f6b609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdaf5b9230f4e09949a39a5cbe72011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:47.538077 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-ef7599bc-be8b-4983-98ae-fc6137499b1f tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] 10.222.0.26 "GET /compute/v2.1/servers/0568d34c-9aa0-452f-b5c5-b3fc19ebbf15" status: 200 len: 1403 microversion: 2.1 time: 0.222208 Oct 08 20:57:47.538671 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 748/1565] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:57:47 2022] GET /compute/v2.1/servers/0568d34c-9aa0-452f-b5c5-b3fc19ebbf15 => generated 1403 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:57:47.549375 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-e3656cd6-e6ec-4c58-a4e5-329d011d8b9d tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:47.550230 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-e3656cd6-e6ec-4c58-a4e5-329d011d8b9d tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] [instance: e2d1c93f-8392-4f67-a29e-05164828f9d8] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:47.558891 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e3656cd6-e6ec-4c58-a4e5-329d011d8b9d tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:47.559835 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e3656cd6-e6ec-4c58-a4e5-329d011d8b9d tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:47.560507 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e3656cd6-e6ec-4c58-a4e5-329d011d8b9d tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:47.561602 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e3656cd6-e6ec-4c58-a4e5-329d011d8b9d tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:47.562228 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e3656cd6-e6ec-4c58-a4e5-329d011d8b9d tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:47.562826 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e3656cd6-e6ec-4c58-a4e5-329d011d8b9d tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:47.576832 ncdv-master-1 devstack@n-api.service[140492]: DEBUG neutronclient.v2_0.client [None req-b89deb8b-1508-43f0-99a9-986a2860f3b5 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 2df41a21-06a2-472b-a351-effdc7320dda in use.", "detail": ""}} {{(pid=140492) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 08 20:57:47.577863 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-b89deb8b-1508-43f0-99a9-986a2860f3b5 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] HTTP exception thrown: Security Group 2df41a21-06a2-472b-a351-effdc7320dda in use. Oct 08 20:57:47.577863 ncdv-master-1 devstack@n-api.service[140492]: Neutron server returns request_ids: ['req-d0257c08-3828-4291-b047-424b2c701903'] Oct 08 20:57:47.580137 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-b89deb8b-1508-43f0-99a9-986a2860f3b5 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Request method failure captured: Oct 08 20:57:47.580137 ncdv-master-1 devstack@n-api.service[140492]: request: DELETE /compute/v2.1/os-security-groups/2df41a21-06a2-472b-a351-effdc7320dda HTTP/1.1 Oct 08 20:57:47.580137 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 20:57:47.580137 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 20:57:47.580137 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 20:57:47.580137 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 20:57:47.580137 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 20:57:47.580137 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 20:57:47.580137 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 20:57:47.580137 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 20:57:47.580137 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQePneH9r8wc6qFHuuUfUiwj20bfGS3ReCozGKtofTKF_Bibv-TeYrNnDr89OwEeHkYGW8sVcZZerG8KfPs5hnyFWI91x_kPrSGVuiWEZNP0tyGW3_Xh9-fgTNjxnIFiLidb-EHCBZb3EEyAGFqy03GkbophorT5sYui55pNleytp26U Oct 08 20:57:47.580137 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 20:57:47.580137 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 20:57:47.580137 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 20:57:47.580137 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 20:57:47.580137 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 20:57:47.580137 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 20:57:47.580137 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 1be94d02ab5244f98337fb9b90e74746 Oct 08 20:57:47.580137 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-SecurityGroupsTestJSON-1416879597 Oct 08 20:57:47.580137 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 20:57:47.580137 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 20:57:47.580137 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1be94d02ab5244f98337fb9b90e74746"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1be94d02ab5244f98337fb9b90e74746"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1be94d02ab5244f98337fb9b90e74746"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1be94d02ab5244f98337fb9b90e74746"}]}] Oct 08 20:57:47.580137 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-SecurityGroupsTestJSON-1416879597 Oct 08 20:57:47.580137 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 1be94d02ab5244f98337fb9b90e74746 Oct 08 20:57:47.580137 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1416879597 Oct 08 20:57:47.580137 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-SecurityGroupsTestJSON-1416879597-project Oct 08 20:57:47.580137 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 20:57:47.580137 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 20:57:47.580137 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 5ac1323815364df4a3a4d4dbbb9d70dd Oct 08 20:57:47.580137 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-SecurityGroupsTestJSON-1416879597-project Oct 08 20:57:47.580137 ncdv-master-1 devstack@n-api.service[140492]: method: Oct 08 20:57:47.580137 ncdv-master-1 devstack@n-api.service[140492]: exception: Security Group 2df41a21-06a2-472b-a351-effdc7320dda in use. Oct 08 20:57:47.580137 ncdv-master-1 devstack@n-api.service[140492]: Neutron server returns request_ids: ['req-d0257c08-3828-4291-b047-424b2c701903'] Oct 08 20:57:47.580137 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': '2df41a21-06a2-472b-a351-effdc7320dda'} Oct 08 20:57:47.580137 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:57:47.580137 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:57:47.580137 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 08 20:57:47.580137 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 08 20:57:47.580137 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 08 20:57:47.580137 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 08 20:57:47.580137 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 08 20:57:47.580137 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 08 20:57:47.580137 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 08 20:57:47.580137 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 08 20:57:47.580137 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 08 20:57:47.580137 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 08 20:57:47.580137 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 08 20:57:47.580137 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 08 20:57:47.580137 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 08 20:57:47.580137 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 08 20:57:47.580137 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 08 20:57:47.580137 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 08 20:57:47.580137 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 08 20:57:47.580137 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 08 20:57:47.580137 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 08 20:57:47.580137 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 08 20:57:47.580137 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 08 20:57:47.580137 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 08 20:57:47.580137 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 08 20:57:47.580137 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 08 20:57:47.580137 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 2df41a21-06a2-472b-a351-effdc7320dda in use. Oct 08 20:57:47.585408 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d0257c08-3828-4291-b047-424b2c701903'] Oct 08 20:57:47.585408 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:57:47.585408 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:57:47.585408 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:57:47.585408 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:57:47.585408 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 08 20:57:47.585408 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 08 20:57:47.585408 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 08 20:57:47.585408 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 08 20:57:47.585408 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 2df41a21-06a2-472b-a351-effdc7320dda in use. Oct 08 20:57:47.585408 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d0257c08-3828-4291-b047-424b2c701903'] Oct 08 20:57:47.585408 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:57:47.585408 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:57:47.585408 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:57:47.585408 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:57:47.585408 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:57:47.585408 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:57:47.585408 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:57:47.585408 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:57:47.585408 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 08 20:57:47.585408 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 08 20:57:47.585408 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:57:47.585408 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:57:47.585408 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 08 20:57:47.585408 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 08 20:57:47.585408 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 2df41a21-06a2-472b-a351-effdc7320dda in use. Oct 08 20:57:47.585408 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d0257c08-3828-4291-b047-424b2c701903'] Oct 08 20:57:47.585408 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:57:47.585408 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:57:47.585408 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:57:47.585408 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:57:47.585408 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:57:47.585408 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:57:47.585408 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 20:57:47.585408 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 20:57:47.585408 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 2df41a21-06a2-472b-a351-effdc7320dda in use. Oct 08 20:57:47.585408 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d0257c08-3828-4291-b047-424b2c701903'] Oct 08 20:57:47.585408 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:57:47.589674 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-b89deb8b-1508-43f0-99a9-986a2860f3b5 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Returning 400 to user: Security Group 2df41a21-06a2-472b-a351-effdc7320dda in use. Oct 08 20:57:47.589674 ncdv-master-1 devstack@n-api.service[140492]: Neutron server returns request_ids: ['req-d0257c08-3828-4291-b047-424b2c701903'] {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:57:47.590265 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-b89deb8b-1508-43f0-99a9-986a2860f3b5 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/2df41a21-06a2-472b-a351-effdc7320dda" status: 400 len: 185 microversion: 2.1 time: 0.215928 Oct 08 20:57:47.591026 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 818/1566] 10.222.0.26 () {58 vars in 1272 bytes} [Sat Oct 8 20:57:47 2022] DELETE /compute/v2.1/os-security-groups/2df41a21-06a2-472b-a351-effdc7320dda => generated 185 bytes in 218 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 08 20:57:47.600652 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-fea3f52a-3a98-40ef-b7bd-848160035d5f tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:47.602042 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-fea3f52a-3a98-40ef-b7bd-848160035d5f tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] [instance: 24d7af5b-10ba-4df7-a95d-bcd0b2104f37] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:47.612626 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fea3f52a-3a98-40ef-b7bd-848160035d5f tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:47.614167 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fea3f52a-3a98-40ef-b7bd-848160035d5f tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:47.614876 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fea3f52a-3a98-40ef-b7bd-848160035d5f tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:47.615886 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fea3f52a-3a98-40ef-b7bd-848160035d5f tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:47.616948 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fea3f52a-3a98-40ef-b7bd-848160035d5f tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:47.617695 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fea3f52a-3a98-40ef-b7bd-848160035d5f tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:47.625097 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e3656cd6-e6ec-4c58-a4e5-329d011d8b9d tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:47.626126 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e3656cd6-e6ec-4c58-a4e5-329d011d8b9d tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:47.626643 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e3656cd6-e6ec-4c58-a4e5-329d011d8b9d tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:47.627164 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.objects.instance [None req-e3656cd6-e6ec-4c58-a4e5-329d011d8b9d tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lazy-loading 'fault' on Instance uuid e2d1c93f-8392-4f67-a29e-05164828f9d8 {{(pid=140491) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 20:57:47.694463 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-fea3f52a-3a98-40ef-b7bd-848160035d5f tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] [instance: 24d7af5b-10ba-4df7-a95d-bcd0b2104f37] Going to try to terminate instance {{(pid=140492) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 20:57:47.752816 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-e3656cd6-e6ec-4c58-a4e5-329d011d8b9d tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474ca64d1b1d4e30916b517645aba882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecc2dd2407b4819874bed09cb27959a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:47.774650 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-e3656cd6-e6ec-4c58-a4e5-329d011d8b9d tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d1c93f-8392-4f67-a29e-05164828f9d8" status: 200 len: 1294 microversion: 2.1 time: 0.231271 Oct 08 20:57:47.777521 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 749/1567] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:57:47 2022] GET /compute/v2.1/servers/e2d1c93f-8392-4f67-a29e-05164828f9d8 => generated 1294 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:57:47.784351 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-08fe5220-80c0-4dfc-a5c7-035e5e9a10d7 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:47.785753 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-08fe5220-80c0-4dfc-a5c7-035e5e9a10d7 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] [instance: e5389d1b-b9f3-491a-898c-be611599d73a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:47.803742 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-08fe5220-80c0-4dfc-a5c7-035e5e9a10d7 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:47.804866 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-08fe5220-80c0-4dfc-a5c7-035e5e9a10d7 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:47.806014 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-08fe5220-80c0-4dfc-a5c7-035e5e9a10d7 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:47.806985 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-08fe5220-80c0-4dfc-a5c7-035e5e9a10d7 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:47.808301 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-08fe5220-80c0-4dfc-a5c7-035e5e9a10d7 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:47.808979 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-08fe5220-80c0-4dfc-a5c7-035e5e9a10d7 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:47.909389 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-fea3f52a-3a98-40ef-b7bd-848160035d5f tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] 10.222.0.26 "DELETE /compute/v2.1/servers/24d7af5b-10ba-4df7-a95d-bcd0b2104f37" status: 204 len: 0 microversion: 2.1 time: 0.313380 Oct 08 20:57:47.910299 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 819/1568] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 20:57:47 2022] DELETE /compute/v2.1/servers/24d7af5b-10ba-4df7-a95d-bcd0b2104f37 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 20:57:47.921147 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-64756f9c-656a-42e0-8d45-6eb1c9c4b0ab req-66924275-07bc-4b5a-9a0b-af7fe054d066 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24d7af5b-10ba-4df7-a95d-bcd0b2104f37", "tag": "fd61dc22-1328-45bc-8a61-27b2a295a029"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:57:47.947434 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-64756f9c-656a-42e0-8d45-6eb1c9c4b0ab req-66924275-07bc-4b5a-9a0b-af7fe054d066 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:47.951491 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-64756f9c-656a-42e0-8d45-6eb1c9c4b0ab req-66924275-07bc-4b5a-9a0b-af7fe054d066 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:47.952253 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-64756f9c-656a-42e0-8d45-6eb1c9c4b0ab req-66924275-07bc-4b5a-9a0b-af7fe054d066 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:47.969100 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-64756f9c-656a-42e0-8d45-6eb1c9c4b0ab req-66924275-07bc-4b5a-9a0b-af7fe054d066 service nova] Creating event network-changed:fd61dc22-1328-45bc-8a61-27b2a295a029 for instance 24d7af5b-10ba-4df7-a95d-bcd0b2104f37 on nch1-master-1 Oct 08 20:57:47.986873 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-64756f9c-656a-42e0-8d45-6eb1c9c4b0ab req-66924275-07bc-4b5a-9a0b-af7fe054d066 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064563 Oct 08 20:57:47.988894 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 820/1569] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:57:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:57:47.995413 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-a604f9bf-94e1-46cf-bbc0-ec456b5352bb tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:47.996392 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-a604f9bf-94e1-46cf-bbc0-ec456b5352bb tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] [instance: 24d7af5b-10ba-4df7-a95d-bcd0b2104f37] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:48.006945 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a604f9bf-94e1-46cf-bbc0-ec456b5352bb tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:48.008356 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a604f9bf-94e1-46cf-bbc0-ec456b5352bb tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:48.009085 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a604f9bf-94e1-46cf-bbc0-ec456b5352bb tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:48.010293 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a604f9bf-94e1-46cf-bbc0-ec456b5352bb tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:48.011144 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a604f9bf-94e1-46cf-bbc0-ec456b5352bb tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:48.011968 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a604f9bf-94e1-46cf-bbc0-ec456b5352bb tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:48.189072 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-08fe5220-80c0-4dfc-a5c7-035e5e9a10d7 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01ec70849cfa44368a91df8b3410aba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c97b3b7fa484f97bdf40224f7cc34d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:48.192697 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=100 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:57:48.207904 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-08fe5220-80c0-4dfc-a5c7-035e5e9a10d7 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] 10.222.0.26 "GET /compute/v2.1/servers/e5389d1b-b9f3-491a-898c-be611599d73a" status: 200 len: 1322 microversion: 2.1 time: 0.427979 Oct 08 20:57:48.223748 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 750/1570] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:57:47 2022] GET /compute/v2.1/servers/e5389d1b-b9f3-491a-898c-be611599d73a => generated 1322 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:57:48.223748 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-9f247e2a-b55a-4cc5-9f3c-be796b51448d tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:48.223748 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-9f247e2a-b55a-4cc5-9f3c-be796b51448d tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] [instance: 19327d3e-de51-432b-b594-cb9a1bfe2f49] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:48.223748 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9f247e2a-b55a-4cc5-9f3c-be796b51448d tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:48.223748 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9f247e2a-b55a-4cc5-9f3c-be796b51448d tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:48.223748 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9f247e2a-b55a-4cc5-9f3c-be796b51448d tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:48.225033 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9f247e2a-b55a-4cc5-9f3c-be796b51448d tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:48.225368 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9f247e2a-b55a-4cc5-9f3c-be796b51448d tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:48.225816 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9f247e2a-b55a-4cc5-9f3c-be796b51448d tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:48.300087 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-a604f9bf-94e1-46cf-bbc0-ec456b5352bb tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac1323815364df4a3a4d4dbbb9d70dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be94d02ab5244f98337fb9b90e74746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:48.311703 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-a604f9bf-94e1-46cf-bbc0-ec456b5352bb tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] 10.222.0.26 "GET /compute/v2.1/servers/24d7af5b-10ba-4df7-a95d-bcd0b2104f37" status: 200 len: 1646 microversion: 2.1 time: 0.321259 Oct 08 20:57:48.325418 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 821/1571] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:57:47 2022] GET /compute/v2.1/servers/24d7af5b-10ba-4df7-a95d-bcd0b2104f37 => generated 1646 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:57:48.325418 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-2f77ed1f-a3a9-452e-bdc0-74cf317c3580 req-e13fec5f-0a21-4d4e-87ab-099792fe7c1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ceced78a-58d9-4175-b4fe-0d085be62c94", "name": "network-vif-plugged", "status": "completed", "tag": "91fedb87-f0c8-47ba-8994-fc3b2f3d3d1f"}, {"server_uuid": "e5389d1b-b9f3-491a-898c-be611599d73a", "name": "network-vif-plugged", "status": "completed", "tag": "d911c0da-f663-4272-afa4-3646c36b9e29"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:57:48.328422 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-2f77ed1f-a3a9-452e-bdc0-74cf317c3580 req-e13fec5f-0a21-4d4e-87ab-099792fe7c1e service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:48.329025 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-2f77ed1f-a3a9-452e-bdc0-74cf317c3580 req-e13fec5f-0a21-4d4e-87ab-099792fe7c1e service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:48.329506 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-2f77ed1f-a3a9-452e-bdc0-74cf317c3580 req-e13fec5f-0a21-4d4e-87ab-099792fe7c1e service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:48.347958 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-2f77ed1f-a3a9-452e-bdc0-74cf317c3580 req-e13fec5f-0a21-4d4e-87ab-099792fe7c1e service nova] Creating event network-vif-plugged:91fedb87-f0c8-47ba-8994-fc3b2f3d3d1f for instance ceced78a-58d9-4175-b4fe-0d085be62c94 on nch2-master-1 Oct 08 20:57:48.348887 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-2f77ed1f-a3a9-452e-bdc0-74cf317c3580 req-e13fec5f-0a21-4d4e-87ab-099792fe7c1e service nova] Creating event network-vif-plugged:d911c0da-f663-4272-afa4-3646c36b9e29 for instance e5389d1b-b9f3-491a-898c-be611599d73a on nch2-master-1 Oct 08 20:57:48.359026 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-2f77ed1f-a3a9-452e-bdc0-74cf317c3580 req-e13fec5f-0a21-4d4e-87ab-099792fe7c1e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.044459 Oct 08 20:57:48.360546 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 822/1572] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:57:48 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:57:48.366630 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-f8181ddd-71b2-41f6-b8fb-0ff5832ebd23 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:48.367081 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-f8181ddd-71b2-41f6-b8fb-0ff5832ebd23 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] [instance: 74bdac1c-9b70-46f7-b671-9752894d8980] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:48.386185 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-9f247e2a-b55a-4cc5-9f3c-be796b51448d tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322606d4cb0f45d3ac2eceab4999d45b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24a29bd6efb40609e31fbb6dba839e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:48.387160 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f8181ddd-71b2-41f6-b8fb-0ff5832ebd23 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:48.388187 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f8181ddd-71b2-41f6-b8fb-0ff5832ebd23 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:48.388718 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f8181ddd-71b2-41f6-b8fb-0ff5832ebd23 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:48.389653 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f8181ddd-71b2-41f6-b8fb-0ff5832ebd23 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:48.389926 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f8181ddd-71b2-41f6-b8fb-0ff5832ebd23 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:48.393472 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f8181ddd-71b2-41f6-b8fb-0ff5832ebd23 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:48.404203 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-9f247e2a-b55a-4cc5-9f3c-be796b51448d tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] 10.222.0.26 "GET /compute/v2.1/servers/19327d3e-de51-432b-b594-cb9a1bfe2f49" status: 200 len: 1317 microversion: 2.1 time: 0.193890 Oct 08 20:57:48.409071 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 751/1573] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:57:48 2022] GET /compute/v2.1/servers/19327d3e-de51-432b-b594-cb9a1bfe2f49 => generated 1317 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:57:48.415370 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-0e534c28-a923-4c98-b5f0-af8ad45c925d tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:48.422056 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-0e534c28-a923-4c98-b5f0-af8ad45c925d tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] [instance: ceced78a-58d9-4175-b4fe-0d085be62c94] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:48.431248 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0e534c28-a923-4c98-b5f0-af8ad45c925d tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:48.439472 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0e534c28-a923-4c98-b5f0-af8ad45c925d tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:48.439959 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0e534c28-a923-4c98-b5f0-af8ad45c925d tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:48.440722 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0e534c28-a923-4c98-b5f0-af8ad45c925d tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:48.441346 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0e534c28-a923-4c98-b5f0-af8ad45c925d tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:48.441998 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0e534c28-a923-4c98-b5f0-af8ad45c925d tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:48.618164 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-f8181ddd-71b2-41f6-b8fb-0ff5832ebd23 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:48.630276 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-f8181ddd-71b2-41f6-b8fb-0ff5832ebd23 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:48.631762 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-f8181ddd-71b2-41f6-b8fb-0ff5832ebd23 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:48.632940 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-f8181ddd-71b2-41f6-b8fb-0ff5832ebd23 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] 10.222.0.26 "GET /compute/v2.1/servers/74bdac1c-9b70-46f7-b671-9752894d8980" status: 200 len: 1478 microversion: 2.25 time: 0.271165 Oct 08 20:57:48.636550 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 823/1574] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:57:48 2022] GET /compute/v2.1/servers/74bdac1c-9b70-46f7-b671-9752894d8980 => generated 1478 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:57:48.649518 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-8131f4aa-e108-4f4b-a1ae-5843d19adbf1 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:48.650326 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-8131f4aa-e108-4f4b-a1ae-5843d19adbf1 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] [instance: 0568d34c-9aa0-452f-b5c5-b3fc19ebbf15] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:48.660874 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8131f4aa-e108-4f4b-a1ae-5843d19adbf1 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:48.662082 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8131f4aa-e108-4f4b-a1ae-5843d19adbf1 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:48.662664 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8131f4aa-e108-4f4b-a1ae-5843d19adbf1 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:48.663555 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8131f4aa-e108-4f4b-a1ae-5843d19adbf1 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:48.664451 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8131f4aa-e108-4f4b-a1ae-5843d19adbf1 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:48.664451 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8131f4aa-e108-4f4b-a1ae-5843d19adbf1 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:48.731377 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-0e534c28-a923-4c98-b5f0-af8ad45c925d tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:48.752190 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-0e534c28-a923-4c98-b5f0-af8ad45c925d tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:48.753673 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-0e534c28-a923-4c98-b5f0-af8ad45c925d tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:48.754851 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-0e534c28-a923-4c98-b5f0-af8ad45c925d tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] 10.222.0.26 "GET /compute/v2.1/servers/ceced78a-58d9-4175-b4fe-0d085be62c94" status: 200 len: 1874 microversion: 2.42 time: 0.344585 Oct 08 20:57:48.761207 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 752/1575] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:57:48 2022] GET /compute/v2.1/servers/ceced78a-58d9-4175-b4fe-0d085be62c94 => generated 1874 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:57:48.765643 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-2aeebc3a-ad27-4ed1-9e2d-eefb16a70c71 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:48.766430 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-2aeebc3a-ad27-4ed1-9e2d-eefb16a70c71 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] [instance: 74bdac1c-9b70-46f7-b671-9752894d8980] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:48.773761 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2aeebc3a-ad27-4ed1-9e2d-eefb16a70c71 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:48.774257 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2aeebc3a-ad27-4ed1-9e2d-eefb16a70c71 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:48.774699 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2aeebc3a-ad27-4ed1-9e2d-eefb16a70c71 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:48.775402 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2aeebc3a-ad27-4ed1-9e2d-eefb16a70c71 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:48.775859 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2aeebc3a-ad27-4ed1-9e2d-eefb16a70c71 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:48.776290 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2aeebc3a-ad27-4ed1-9e2d-eefb16a70c71 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:48.820462 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-8131f4aa-e108-4f4b-a1ae-5843d19adbf1 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9facf5ea0743cb821cec1b40f6b609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdaf5b9230f4e09949a39a5cbe72011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:48.828588 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-8131f4aa-e108-4f4b-a1ae-5843d19adbf1 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] 10.222.0.26 "GET /compute/v2.1/servers/0568d34c-9aa0-452f-b5c5-b3fc19ebbf15" status: 200 len: 1403 microversion: 2.1 time: 0.190997 Oct 08 20:57:48.829176 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 824/1576] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:57:48 2022] GET /compute/v2.1/servers/0568d34c-9aa0-452f-b5c5-b3fc19ebbf15 => generated 1403 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:57:48.834114 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-29f4e9ea-8ec5-42c0-be2b-86b1cc842bd5 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:48.834718 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-29f4e9ea-8ec5-42c0-be2b-86b1cc842bd5 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] [instance: e2d1c93f-8392-4f67-a29e-05164828f9d8] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:48.840589 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-29f4e9ea-8ec5-42c0-be2b-86b1cc842bd5 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:48.841318 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-29f4e9ea-8ec5-42c0-be2b-86b1cc842bd5 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:48.841951 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-29f4e9ea-8ec5-42c0-be2b-86b1cc842bd5 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:48.843309 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-29f4e9ea-8ec5-42c0-be2b-86b1cc842bd5 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:48.843943 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-29f4e9ea-8ec5-42c0-be2b-86b1cc842bd5 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:48.844379 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-29f4e9ea-8ec5-42c0-be2b-86b1cc842bd5 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:48.880382 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-29f4e9ea-8ec5-42c0-be2b-86b1cc842bd5 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:48.880876 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-29f4e9ea-8ec5-42c0-be2b-86b1cc842bd5 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:48.881390 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-29f4e9ea-8ec5-42c0-be2b-86b1cc842bd5 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:48.881849 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.objects.instance [None req-29f4e9ea-8ec5-42c0-be2b-86b1cc842bd5 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lazy-loading 'fault' on Instance uuid e2d1c93f-8392-4f67-a29e-05164828f9d8 {{(pid=140492) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 20:57:48.917156 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.objects.instance [None req-2aeebc3a-ad27-4ed1-9e2d-eefb16a70c71 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Lazy-loading 'services' on Instance uuid 74bdac1c-9b70-46f7-b671-9752894d8980 {{(pid=140491) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 20:57:48.931020 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-2aeebc3a-ad27-4ed1-9e2d-eefb16a70c71 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/74bdac1c-9b70-46f7-b671-9752894d8980" status: 200 len: 1971 microversion: 2.25 time: 0.168693 Oct 08 20:57:48.931615 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 753/1577] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:57:48 2022] GET /compute/v2.1/servers/74bdac1c-9b70-46f7-b671-9752894d8980 => generated 1971 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:57:48.946128 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-29f4e9ea-8ec5-42c0-be2b-86b1cc842bd5 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474ca64d1b1d4e30916b517645aba882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecc2dd2407b4819874bed09cb27959a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:48.956104 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-29f4e9ea-8ec5-42c0-be2b-86b1cc842bd5 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d1c93f-8392-4f67-a29e-05164828f9d8" status: 200 len: 1294 microversion: 2.1 time: 0.125835 Oct 08 20:57:48.957040 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 825/1578] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:57:48 2022] GET /compute/v2.1/servers/e2d1c93f-8392-4f67-a29e-05164828f9d8 => generated 1294 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:57:48.961857 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-13696c97-6dfb-42dc-854f-12f933421f74 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:48.962494 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-13696c97-6dfb-42dc-854f-12f933421f74 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] [instance: 74bdac1c-9b70-46f7-b671-9752894d8980] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:48.968607 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-13696c97-6dfb-42dc-854f-12f933421f74 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:48.969089 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-13696c97-6dfb-42dc-854f-12f933421f74 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:48.969606 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-13696c97-6dfb-42dc-854f-12f933421f74 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:48.970306 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-13696c97-6dfb-42dc-854f-12f933421f74 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:48.970943 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-13696c97-6dfb-42dc-854f-12f933421f74 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:48.971373 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-13696c97-6dfb-42dc-854f-12f933421f74 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:49.104431 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.objects.instance [None req-13696c97-6dfb-42dc-854f-12f933421f74 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Lazy-loading 'services' on Instance uuid 74bdac1c-9b70-46f7-b671-9752894d8980 {{(pid=140491) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 20:57:49.121597 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-13696c97-6dfb-42dc-854f-12f933421f74 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/74bdac1c-9b70-46f7-b671-9752894d8980" status: 200 len: 1971 microversion: 2.25 time: 0.166426 Oct 08 20:57:49.121597 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 754/1579] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:57:48 2022] GET /compute/v2.1/servers/74bdac1c-9b70-46f7-b671-9752894d8980 => generated 1971 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 08 20:57:49.144723 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-153c1e69-67aa-4424-b74e-6e6080e099ba tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:49.149223 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-153c1e69-67aa-4424-b74e-6e6080e099ba tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:49.149720 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-153c1e69-67aa-4424-b74e-6e6080e099ba tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:49.150169 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-153c1e69-67aa-4424-b74e-6e6080e099ba tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:49.150913 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-153c1e69-67aa-4424-b74e-6e6080e099ba tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:49.151373 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-153c1e69-67aa-4424-b74e-6e6080e099ba tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:49.151808 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-153c1e69-67aa-4424-b74e-6e6080e099ba tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:49.176952 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-153c1e69-67aa-4424-b74e-6e6080e099ba tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.036024 Oct 08 20:57:49.177949 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 826/1580] 10.222.0.26 () {60 vars in 1217 bytes} [Sat Oct 8 20:57:49 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 08 20:57:49.190005 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-2dc23d17-9344-4195-8ea3-8f9a7ce96e16 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": "auto"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:57:49.192525 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-2dc23d17-9344-4195-8ea3-8f9a7ce96e16 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] [instance: 74bdac1c-9b70-46f7-b671-9752894d8980] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:49.199072 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2dc23d17-9344-4195-8ea3-8f9a7ce96e16 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:49.199563 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2dc23d17-9344-4195-8ea3-8f9a7ce96e16 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:49.200007 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2dc23d17-9344-4195-8ea3-8f9a7ce96e16 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:49.200717 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2dc23d17-9344-4195-8ea3-8f9a7ce96e16 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:49.201216 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2dc23d17-9344-4195-8ea3-8f9a7ce96e16 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:49.201679 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2dc23d17-9344-4195-8ea3-8f9a7ce96e16 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:49.228083 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.objects.instance [None req-2dc23d17-9344-4195-8ea3-8f9a7ce96e16 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Lazy-loading 'flavor' on Instance uuid 74bdac1c-9b70-46f7-b671-9752894d8980 {{(pid=140491) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 20:57:49.232072 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-4cc66dac-4dca-4f30-9093-d438dd17c506 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:49.233094 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-4cc66dac-4dca-4f30-9093-d438dd17c506 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] [instance: e5389d1b-b9f3-491a-898c-be611599d73a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:49.241624 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4cc66dac-4dca-4f30-9093-d438dd17c506 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:49.242020 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-2dc23d17-9344-4195-8ea3-8f9a7ce96e16 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] [instance: 74bdac1c-9b70-46f7-b671-9752894d8980] Going to try to live migrate instance to nch1-master-1 {{(pid=140491) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 08 20:57:49.242180 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4cc66dac-4dca-4f30-9093-d438dd17c506 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:49.242895 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4cc66dac-4dca-4f30-9093-d438dd17c506 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:49.243726 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4cc66dac-4dca-4f30-9093-d438dd17c506 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:49.244344 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4cc66dac-4dca-4f30-9093-d438dd17c506 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:49.244876 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4cc66dac-4dca-4f30-9093-d438dd17c506 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:49.494426 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-4cc66dac-4dca-4f30-9093-d438dd17c506 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01ec70849cfa44368a91df8b3410aba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c97b3b7fa484f97bdf40224f7cc34d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:49.510861 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-4cc66dac-4dca-4f30-9093-d438dd17c506 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] 10.222.0.26 "GET /compute/v2.1/servers/e5389d1b-b9f3-491a-898c-be611599d73a" status: 200 len: 1322 microversion: 2.1 time: 0.283684 Oct 08 20:57:49.511799 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 827/1581] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:57:49 2022] GET /compute/v2.1/servers/e5389d1b-b9f3-491a-898c-be611599d73a => generated 1322 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:57:49.529325 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-276eede4-cd84-4ab6-a8d4-1cf4d1d8ad95 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:49.529958 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-276eede4-cd84-4ab6-a8d4-1cf4d1d8ad95 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] [instance: 24d7af5b-10ba-4df7-a95d-bcd0b2104f37] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:49.537404 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-276eede4-cd84-4ab6-a8d4-1cf4d1d8ad95 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:49.537914 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-276eede4-cd84-4ab6-a8d4-1cf4d1d8ad95 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:49.541109 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-276eede4-cd84-4ab6-a8d4-1cf4d1d8ad95 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:49.543749 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-276eede4-cd84-4ab6-a8d4-1cf4d1d8ad95 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:49.544259 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-276eede4-cd84-4ab6-a8d4-1cf4d1d8ad95 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:49.544685 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-276eede4-cd84-4ab6-a8d4-1cf4d1d8ad95 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:49.785204 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-276eede4-cd84-4ab6-a8d4-1cf4d1d8ad95 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac1323815364df4a3a4d4dbbb9d70dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be94d02ab5244f98337fb9b90e74746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:49.797178 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-276eede4-cd84-4ab6-a8d4-1cf4d1d8ad95 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] 10.222.0.26 "GET /compute/v2.1/servers/24d7af5b-10ba-4df7-a95d-bcd0b2104f37" status: 200 len: 1646 microversion: 2.1 time: 0.284316 Oct 08 20:57:49.803283 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 828/1582] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:57:49 2022] GET /compute/v2.1/servers/24d7af5b-10ba-4df7-a95d-bcd0b2104f37 => generated 1646 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:57:49.824414 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-7c5e537c-1bef-4e7f-948c-d295f7ac4aaa tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:49.827153 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-7c5e537c-1bef-4e7f-948c-d295f7ac4aaa tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] [instance: 19327d3e-de51-432b-b594-cb9a1bfe2f49] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:49.839056 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=1,nova_api:UPDATE=2 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:57:49.854886 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7c5e537c-1bef-4e7f-948c-d295f7ac4aaa tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:49.855743 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7c5e537c-1bef-4e7f-948c-d295f7ac4aaa tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:49.858593 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7c5e537c-1bef-4e7f-948c-d295f7ac4aaa tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:49.861528 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7c5e537c-1bef-4e7f-948c-d295f7ac4aaa tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:49.862219 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7c5e537c-1bef-4e7f-948c-d295f7ac4aaa tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:49.863042 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7c5e537c-1bef-4e7f-948c-d295f7ac4aaa tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:50.313617 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-7c5e537c-1bef-4e7f-948c-d295f7ac4aaa tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322606d4cb0f45d3ac2eceab4999d45b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24a29bd6efb40609e31fbb6dba839e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:50.327535 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-7c5e537c-1bef-4e7f-948c-d295f7ac4aaa tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] 10.222.0.26 "GET /compute/v2.1/servers/19327d3e-de51-432b-b594-cb9a1bfe2f49" status: 200 len: 1317 microversion: 2.1 time: 0.520237 Oct 08 20:57:50.331086 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 829/1583] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:57:49 2022] GET /compute/v2.1/servers/19327d3e-de51-432b-b594-cb9a1bfe2f49 => generated 1317 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:57:50.336474 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-a193eea9-2e32-458f-8225-8f5621645013 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:50.337098 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-a193eea9-2e32-458f-8225-8f5621645013 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] [instance: ceced78a-58d9-4175-b4fe-0d085be62c94] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:50.345051 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a193eea9-2e32-458f-8225-8f5621645013 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:50.345599 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a193eea9-2e32-458f-8225-8f5621645013 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:50.346043 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a193eea9-2e32-458f-8225-8f5621645013 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:50.350850 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a193eea9-2e32-458f-8225-8f5621645013 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:50.353650 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a193eea9-2e32-458f-8225-8f5621645013 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:50.356855 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a193eea9-2e32-458f-8225-8f5621645013 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:50.850880 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-a193eea9-2e32-458f-8225-8f5621645013 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:50.862343 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-a193eea9-2e32-458f-8225-8f5621645013 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:50.864077 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-a193eea9-2e32-458f-8225-8f5621645013 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:50.865806 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-a193eea9-2e32-458f-8225-8f5621645013 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] 10.222.0.26 "GET /compute/v2.1/servers/ceced78a-58d9-4175-b4fe-0d085be62c94" status: 200 len: 1874 microversion: 2.42 time: 0.533882 Oct 08 20:57:50.866375 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 830/1584] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:57:50 2022] GET /compute/v2.1/servers/ceced78a-58d9-4175-b4fe-0d085be62c94 => generated 1874 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:57:50.871460 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-db01ad86-88bf-480c-a607-a3194a6ec9a3 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:50.872192 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-db01ad86-88bf-480c-a607-a3194a6ec9a3 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] [instance: 0568d34c-9aa0-452f-b5c5-b3fc19ebbf15] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:50.878905 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-db01ad86-88bf-480c-a607-a3194a6ec9a3 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:50.879747 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-db01ad86-88bf-480c-a607-a3194a6ec9a3 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:50.880254 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-db01ad86-88bf-480c-a607-a3194a6ec9a3 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:50.881229 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-db01ad86-88bf-480c-a607-a3194a6ec9a3 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:50.881897 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-db01ad86-88bf-480c-a607-a3194a6ec9a3 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:50.882629 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-db01ad86-88bf-480c-a607-a3194a6ec9a3 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:51.226123 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-db01ad86-88bf-480c-a607-a3194a6ec9a3 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9facf5ea0743cb821cec1b40f6b609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdaf5b9230f4e09949a39a5cbe72011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:51.239337 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-db01ad86-88bf-480c-a607-a3194a6ec9a3 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] 10.222.0.26 "GET /compute/v2.1/servers/0568d34c-9aa0-452f-b5c5-b3fc19ebbf15" status: 200 len: 1403 microversion: 2.1 time: 0.371306 Oct 08 20:57:51.240889 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 831/1585] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:57:50 2022] GET /compute/v2.1/servers/0568d34c-9aa0-452f-b5c5-b3fc19ebbf15 => generated 1403 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:57:51.248111 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-cb3782f8-62e3-40fc-8a46-522c8ae85803 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:51.249353 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-cb3782f8-62e3-40fc-8a46-522c8ae85803 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] [instance: e2d1c93f-8392-4f67-a29e-05164828f9d8] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:51.256398 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cb3782f8-62e3-40fc-8a46-522c8ae85803 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:51.257269 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cb3782f8-62e3-40fc-8a46-522c8ae85803 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:51.257946 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cb3782f8-62e3-40fc-8a46-522c8ae85803 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:51.258909 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cb3782f8-62e3-40fc-8a46-522c8ae85803 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:51.259914 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cb3782f8-62e3-40fc-8a46-522c8ae85803 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:51.260652 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cb3782f8-62e3-40fc-8a46-522c8ae85803 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:51.294456 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-cb3782f8-62e3-40fc-8a46-522c8ae85803 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] HTTP exception thrown: Instance e2d1c93f-8392-4f67-a29e-05164828f9d8 could not be found. Oct 08 20:57:51.297599 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-cb3782f8-62e3-40fc-8a46-522c8ae85803 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Request method failure captured: Oct 08 20:57:51.297599 ncdv-master-1 devstack@n-api.service[140492]: request: GET /compute/v2.1/servers/e2d1c93f-8392-4f67-a29e-05164828f9d8 HTTP/1.1 Oct 08 20:57:51.297599 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 20:57:51.297599 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 20:57:51.297599 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 20:57:51.297599 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 20:57:51.297599 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 20:57:51.297599 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 20:57:51.297599 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 20:57:51.297599 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 20:57:51.297599 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeMXC9JeN9Mlk5jzCgs-_cPtRtdIPAXhmbadFJaShbL5RJJyNFLD60Grhe8NzKLmyv9j_DFRSKoTNMw2TlfcMFQd60Gx2njCIaEqOyEM-mQSbVpxdhzzTuSuygraSUzGQKPLwQlBymj0axQFAl4TsB_9ApQq2i8hMTqwWvlfGcMSM0g Oct 08 20:57:51.297599 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 20:57:51.297599 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 20:57:51.297599 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 20:57:51.297599 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 20:57:51.297599 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 20:57:51.297599 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 20:57:51.297599 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 6ecc2dd2407b4819874bed09cb27959a Oct 08 20:57:51.297599 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-LiveMigrationTest-739175934 Oct 08 20:57:51.297599 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 20:57:51.297599 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 20:57:51.297599 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6ecc2dd2407b4819874bed09cb27959a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6ecc2dd2407b4819874bed09cb27959a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6ecc2dd2407b4819874bed09cb27959a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6ecc2dd2407b4819874bed09cb27959a"}]}] Oct 08 20:57:51.297599 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-LiveMigrationTest-739175934 Oct 08 20:57:51.297599 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 6ecc2dd2407b4819874bed09cb27959a Oct 08 20:57:51.297599 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-LiveMigrationTest-739175934 Oct 08 20:57:51.297599 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-LiveMigrationTest-739175934-project Oct 08 20:57:51.297599 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 20:57:51.297599 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 20:57:51.297599 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 474ca64d1b1d4e30916b517645aba882 Oct 08 20:57:51.297599 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-LiveMigrationTest-739175934-project Oct 08 20:57:51.297599 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 20:57:51.297599 ncdv-master-1 devstack@n-api.service[140492]: exception: Instance e2d1c93f-8392-4f67-a29e-05164828f9d8 could not be found. Oct 08 20:57:51.297599 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': 'e2d1c93f-8392-4f67-a29e-05164828f9d8'} Oct 08 20:57:51.297599 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:57:51.297599 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:57:51.297599 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 20:57:51.297599 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 20:57:51.297599 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 20:57:51.297599 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 20:57:51.297599 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 20:57:51.297599 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 20:57:51.297599 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 20:57:51.297599 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 20:57:51.297599 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2d1c93f-8392-4f67-a29e-05164828f9d8 could not be found. Oct 08 20:57:51.297599 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:57:51.297599 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:57:51.297599 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:57:51.297599 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:57:51.297599 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:57:51.297599 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:57:51.297599 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:57:51.297599 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:57:51.297599 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:57:51.297599 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:57:51.297599 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 20:57:51.297599 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 20:57:51.297599 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 20:57:51.297599 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 20:57:51.297599 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 20:57:51.297599 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 20:57:51.297599 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2d1c93f-8392-4f67-a29e-05164828f9d8 could not be found. Oct 08 20:57:51.297599 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:57:51.297599 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:57:51.297599 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:57:51.302203 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:57:51.302203 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:57:51.302203 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:57:51.302203 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 20:57:51.302203 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 20:57:51.302203 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2d1c93f-8392-4f67-a29e-05164828f9d8 could not be found. Oct 08 20:57:51.302203 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:57:51.319291 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-cb3782f8-62e3-40fc-8a46-522c8ae85803 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Returning 404 to user: Instance e2d1c93f-8392-4f67-a29e-05164828f9d8 could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:57:51.320210 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-cb3782f8-62e3-40fc-8a46-522c8ae85803 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d1c93f-8392-4f67-a29e-05164828f9d8" status: 404 len: 111 microversion: 2.1 time: 0.077771 Oct 08 20:57:51.321239 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 832/1586] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:57:51 2022] GET /compute/v2.1/servers/e2d1c93f-8392-4f67-a29e-05164828f9d8 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 20:57:51.328519 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-01dc95b0-dcbe-4253-8c6f-a5c935052949 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:51.329674 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-01dc95b0-dcbe-4253-8c6f-a5c935052949 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] [instance: e5389d1b-b9f3-491a-898c-be611599d73a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:51.339593 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-01dc95b0-dcbe-4253-8c6f-a5c935052949 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:51.340715 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-01dc95b0-dcbe-4253-8c6f-a5c935052949 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:51.341403 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-01dc95b0-dcbe-4253-8c6f-a5c935052949 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:51.342317 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-01dc95b0-dcbe-4253-8c6f-a5c935052949 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:51.343000 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-01dc95b0-dcbe-4253-8c6f-a5c935052949 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:51.343595 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-01dc95b0-dcbe-4253-8c6f-a5c935052949 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:51.455385 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-2dc23d17-9344-4195-8ea3-8f9a7ce96e16 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/74bdac1c-9b70-46f7-b671-9752894d8980/action" status: 202 len: 0 microversion: 2.25 time: 2.269104 Oct 08 20:57:51.456776 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 755/1587] 10.222.0.26 () {62 vars in 1319 bytes} [Sat Oct 8 20:57:49 2022] POST /compute/v2.1/servers/74bdac1c-9b70-46f7-b671-9752894d8980/action => generated 0 bytes in 2271 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 08 20:57:51.462260 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-64ee5591-f892-4e36-94b8-b1997ae2b178 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:51.463184 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-64ee5591-f892-4e36-94b8-b1997ae2b178 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] [instance: 24d7af5b-10ba-4df7-a95d-bcd0b2104f37] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:51.480719 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-64ee5591-f892-4e36-94b8-b1997ae2b178 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:51.481167 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-64ee5591-f892-4e36-94b8-b1997ae2b178 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:51.481942 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-64ee5591-f892-4e36-94b8-b1997ae2b178 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:51.482879 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-64ee5591-f892-4e36-94b8-b1997ae2b178 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:51.488885 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-64ee5591-f892-4e36-94b8-b1997ae2b178 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:51.489513 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-64ee5591-f892-4e36-94b8-b1997ae2b178 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:51.592382 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-64ee5591-f892-4e36-94b8-b1997ae2b178 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:51.595902 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-64ee5591-f892-4e36-94b8-b1997ae2b178 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:51.601933 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-64ee5591-f892-4e36-94b8-b1997ae2b178 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:51.602738 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.objects.instance [None req-64ee5591-f892-4e36-94b8-b1997ae2b178 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lazy-loading 'fault' on Instance uuid 24d7af5b-10ba-4df7-a95d-bcd0b2104f37 {{(pid=140491) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 20:57:51.754530 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-01dc95b0-dcbe-4253-8c6f-a5c935052949 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01ec70849cfa44368a91df8b3410aba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c97b3b7fa484f97bdf40224f7cc34d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:51.772630 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-01dc95b0-dcbe-4253-8c6f-a5c935052949 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] 10.222.0.26 "GET /compute/v2.1/servers/e5389d1b-b9f3-491a-898c-be611599d73a" status: 200 len: 1518 microversion: 2.1 time: 0.449399 Oct 08 20:57:51.778102 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 833/1588] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:57:51 2022] GET /compute/v2.1/servers/e5389d1b-b9f3-491a-898c-be611599d73a => generated 1518 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:57:51.797053 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-64ee5591-f892-4e36-94b8-b1997ae2b178 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac1323815364df4a3a4d4dbbb9d70dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be94d02ab5244f98337fb9b90e74746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:51.804855 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-bee8e36f-e67e-4989-b9b5-8c0d0fdba2fb req-cfc3a611-b3c8-4f87-a58d-2a9fa5f0a57a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24d7af5b-10ba-4df7-a95d-bcd0b2104f37", "name": "network-vif-deleted", "tag": "fd61dc22-1328-45bc-8a61-27b2a295a029"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:57:51.814842 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-64ee5591-f892-4e36-94b8-b1997ae2b178 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] 10.222.0.26 "GET /compute/v2.1/servers/24d7af5b-10ba-4df7-a95d-bcd0b2104f37" status: 200 len: 1306 microversion: 2.1 time: 0.356444 Oct 08 20:57:51.815451 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 756/1589] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:57:51 2022] GET /compute/v2.1/servers/24d7af5b-10ba-4df7-a95d-bcd0b2104f37 => generated 1306 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:57:51.819340 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-bee8e36f-e67e-4989-b9b5-8c0d0fdba2fb req-cfc3a611-b3c8-4f87-a58d-2a9fa5f0a57a service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:51.820128 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-bee8e36f-e67e-4989-b9b5-8c0d0fdba2fb req-cfc3a611-b3c8-4f87-a58d-2a9fa5f0a57a service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:51.820882 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-bee8e36f-e67e-4989-b9b5-8c0d0fdba2fb req-cfc3a611-b3c8-4f87-a58d-2a9fa5f0a57a service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:51.824028 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-2edde774-d9c6-4c39-b96f-42bee1ac5c4c tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:51.824674 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-2edde774-d9c6-4c39-b96f-42bee1ac5c4c tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] [instance: 19327d3e-de51-432b-b594-cb9a1bfe2f49] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:51.839870 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2edde774-d9c6-4c39-b96f-42bee1ac5c4c tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:51.840646 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2edde774-d9c6-4c39-b96f-42bee1ac5c4c tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:51.840799 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2edde774-d9c6-4c39-b96f-42bee1ac5c4c tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:51.841510 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2edde774-d9c6-4c39-b96f-42bee1ac5c4c tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:51.842007 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2edde774-d9c6-4c39-b96f-42bee1ac5c4c tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:51.842393 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2edde774-d9c6-4c39-b96f-42bee1ac5c4c tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:51.864190 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-bee8e36f-e67e-4989-b9b5-8c0d0fdba2fb req-cfc3a611-b3c8-4f87-a58d-2a9fa5f0a57a service nova] Creating event network-vif-deleted:fd61dc22-1328-45bc-8a61-27b2a295a029 for instance 24d7af5b-10ba-4df7-a95d-bcd0b2104f37 on nch1-master-1 Oct 08 20:57:51.870681 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-bee8e36f-e67e-4989-b9b5-8c0d0fdba2fb req-cfc3a611-b3c8-4f87-a58d-2a9fa5f0a57a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074988 Oct 08 20:57:51.872313 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 834/1590] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:57:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:57:51.894348 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-95451e23-f6c6-410d-9c73-63e053f1ba31 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:51.897890 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-95451e23-f6c6-410d-9c73-63e053f1ba31 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] [instance: 74bdac1c-9b70-46f7-b671-9752894d8980] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:51.908349 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-95451e23-f6c6-410d-9c73-63e053f1ba31 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:51.909271 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-95451e23-f6c6-410d-9c73-63e053f1ba31 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:51.909953 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-95451e23-f6c6-410d-9c73-63e053f1ba31 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:51.910998 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-95451e23-f6c6-410d-9c73-63e053f1ba31 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:51.912554 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-95451e23-f6c6-410d-9c73-63e053f1ba31 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:51.913473 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-95451e23-f6c6-410d-9c73-63e053f1ba31 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:52.102900 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-2edde774-d9c6-4c39-b96f-42bee1ac5c4c tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322606d4cb0f45d3ac2eceab4999d45b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24a29bd6efb40609e31fbb6dba839e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:52.113163 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-95451e23-f6c6-410d-9c73-63e053f1ba31 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:52.126372 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-95451e23-f6c6-410d-9c73-63e053f1ba31 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:52.131073 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-95451e23-f6c6-410d-9c73-63e053f1ba31 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:52.134324 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-95451e23-f6c6-410d-9c73-63e053f1ba31 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] 10.222.0.26 "GET /compute/v2.1/servers/74bdac1c-9b70-46f7-b671-9752894d8980" status: 200 len: 1488 microversion: 2.25 time: 0.260615 Oct 08 20:57:52.135734 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-2edde774-d9c6-4c39-b96f-42bee1ac5c4c tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] 10.222.0.26 "GET /compute/v2.1/servers/19327d3e-de51-432b-b594-cb9a1bfe2f49" status: 200 len: 1317 microversion: 2.1 time: 0.319216 Oct 08 20:57:52.136554 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 835/1591] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:57:51 2022] GET /compute/v2.1/servers/74bdac1c-9b70-46f7-b671-9752894d8980 => generated 1488 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:57:52.136894 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 757/1592] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:57:51 2022] GET /compute/v2.1/servers/19327d3e-de51-432b-b594-cb9a1bfe2f49 => generated 1317 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:57:52.141855 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-14ca401c-8165-4e1b-883b-7b4bba2de552 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:52.142953 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-14ca401c-8165-4e1b-883b-7b4bba2de552 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] [instance: ceced78a-58d9-4175-b4fe-0d085be62c94] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:52.149349 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-14ca401c-8165-4e1b-883b-7b4bba2de552 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:52.149540 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-a84c0527-dcb0-4da1-a870-f699ae3bd7c2 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:57:52.150897 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-14ca401c-8165-4e1b-883b-7b4bba2de552 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:52.151521 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-14ca401c-8165-4e1b-883b-7b4bba2de552 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:52.152846 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-14ca401c-8165-4e1b-883b-7b4bba2de552 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:52.153605 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-14ca401c-8165-4e1b-883b-7b4bba2de552 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:52.154230 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-14ca401c-8165-4e1b-883b-7b4bba2de552 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:52.155267 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-a84c0527-dcb0-4da1-a870-f699ae3bd7c2 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] [instance: e5389d1b-b9f3-491a-898c-be611599d73a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:52.172066 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a84c0527-dcb0-4da1-a870-f699ae3bd7c2 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:52.172692 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a84c0527-dcb0-4da1-a870-f699ae3bd7c2 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:52.173164 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a84c0527-dcb0-4da1-a870-f699ae3bd7c2 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:52.174061 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a84c0527-dcb0-4da1-a870-f699ae3bd7c2 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:52.174552 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a84c0527-dcb0-4da1-a870-f699ae3bd7c2 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:52.180781 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a84c0527-dcb0-4da1-a870-f699ae3bd7c2 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:52.210533 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:57:52.266041 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.objects.instance [None req-a84c0527-dcb0-4da1-a870-f699ae3bd7c2 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lazy-loading 'flavor' on Instance uuid e5389d1b-b9f3-491a-898c-be611599d73a {{(pid=140492) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 20:57:52.415771 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-a84c0527-dcb0-4da1-a870-f699ae3bd7c2 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] 10.222.0.26 "POST /compute/v2.1/servers/e5389d1b-b9f3-491a-898c-be611599d73a/action" status: 200 len: 32 microversion: 2.1 time: 0.274062 Oct 08 20:57:52.419497 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 836/1593] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 20:57:52 2022] POST /compute/v2.1/servers/e5389d1b-b9f3-491a-898c-be611599d73a/action => generated 32 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 08 20:57:52.428884 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-fd5229cd-cbb7-40a7-a975-9ead71e81021 req-fa443116-196d-447b-b3f6-cd950db17b5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0568d34c-9aa0-452f-b5c5-b3fc19ebbf15", "name": "network-vif-plugged", "status": "completed", "tag": "9856b2f7-707c-4f16-a64b-c8cc9a82cceb"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:57:52.455168 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-fd5229cd-cbb7-40a7-a975-9ead71e81021 req-fa443116-196d-447b-b3f6-cd950db17b5b service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:52.455656 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-fd5229cd-cbb7-40a7-a975-9ead71e81021 req-fa443116-196d-447b-b3f6-cd950db17b5b service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:52.456170 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-fd5229cd-cbb7-40a7-a975-9ead71e81021 req-fa443116-196d-447b-b3f6-cd950db17b5b service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:52.501790 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-fd5229cd-cbb7-40a7-a975-9ead71e81021 req-fa443116-196d-447b-b3f6-cd950db17b5b service nova] Creating event network-vif-plugged:9856b2f7-707c-4f16-a64b-c8cc9a82cceb for instance 0568d34c-9aa0-452f-b5c5-b3fc19ebbf15 on nch1-master-1 Oct 08 20:57:52.509254 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-fd5229cd-cbb7-40a7-a975-9ead71e81021 req-fa443116-196d-447b-b3f6-cd950db17b5b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088253 Oct 08 20:57:52.511296 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 837/1594] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:57:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:57:52.518747 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-04301a27-530a-4dd5-b8dc-15d40d45c998 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:52.519641 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-04301a27-530a-4dd5-b8dc-15d40d45c998 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] [instance: 0568d34c-9aa0-452f-b5c5-b3fc19ebbf15] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:52.528054 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-04301a27-530a-4dd5-b8dc-15d40d45c998 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:52.528912 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-04301a27-530a-4dd5-b8dc-15d40d45c998 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:52.529564 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-04301a27-530a-4dd5-b8dc-15d40d45c998 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:52.530512 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-04301a27-530a-4dd5-b8dc-15d40d45c998 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:52.531141 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-04301a27-530a-4dd5-b8dc-15d40d45c998 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:52.531740 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-04301a27-530a-4dd5-b8dc-15d40d45c998 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:52.680192 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-14ca401c-8165-4e1b-883b-7b4bba2de552 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:52.705204 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-14ca401c-8165-4e1b-883b-7b4bba2de552 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:52.707366 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-14ca401c-8165-4e1b-883b-7b4bba2de552 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:52.711461 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-14ca401c-8165-4e1b-883b-7b4bba2de552 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] 10.222.0.26 "GET /compute/v2.1/servers/ceced78a-58d9-4175-b4fe-0d085be62c94" status: 200 len: 2831 microversion: 2.42 time: 0.573361 Oct 08 20:57:52.745218 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 758/1595] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:57:52 2022] GET /compute/v2.1/servers/ceced78a-58d9-4175-b4fe-0d085be62c94 => generated 2831 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:57:52.745218 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-53e8b770-022a-48d7-81ff-35ba19050255 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:52.745218 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-53e8b770-022a-48d7-81ff-35ba19050255 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] [instance: e5389d1b-b9f3-491a-898c-be611599d73a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:52.751317 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-53e8b770-022a-48d7-81ff-35ba19050255 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:52.751317 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-53e8b770-022a-48d7-81ff-35ba19050255 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:52.751575 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-53e8b770-022a-48d7-81ff-35ba19050255 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:52.752206 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-53e8b770-022a-48d7-81ff-35ba19050255 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:52.753314 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-53e8b770-022a-48d7-81ff-35ba19050255 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:52.754338 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-53e8b770-022a-48d7-81ff-35ba19050255 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:52.855445 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-04301a27-530a-4dd5-b8dc-15d40d45c998 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9facf5ea0743cb821cec1b40f6b609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdaf5b9230f4e09949a39a5cbe72011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:52.863845 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-04301a27-530a-4dd5-b8dc-15d40d45c998 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] 10.222.0.26 "GET /compute/v2.1/servers/0568d34c-9aa0-452f-b5c5-b3fc19ebbf15" status: 200 len: 1403 microversion: 2.1 time: 0.350218 Oct 08 20:57:52.864481 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 838/1596] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:57:52 2022] GET /compute/v2.1/servers/0568d34c-9aa0-452f-b5c5-b3fc19ebbf15 => generated 1403 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:57:52.871466 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-96261ccf-0803-4af5-a982-97c873785054 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:52.872596 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-96261ccf-0803-4af5-a982-97c873785054 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] [instance: e338d559-3f7c-4cc8-95c6-face79e11ca2] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:52.880253 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-96261ccf-0803-4af5-a982-97c873785054 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:52.880953 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-96261ccf-0803-4af5-a982-97c873785054 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:52.881584 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-96261ccf-0803-4af5-a982-97c873785054 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:52.882457 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-96261ccf-0803-4af5-a982-97c873785054 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:52.883079 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-96261ccf-0803-4af5-a982-97c873785054 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:52.883691 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-96261ccf-0803-4af5-a982-97c873785054 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:52.910551 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-96261ccf-0803-4af5-a982-97c873785054 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] [instance: e338d559-3f7c-4cc8-95c6-face79e11ca2] Going to try to terminate instance {{(pid=140492) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 20:57:53.011546 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-96261ccf-0803-4af5-a982-97c873785054 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] 10.222.0.26 "DELETE /compute/v2.1/servers/e338d559-3f7c-4cc8-95c6-face79e11ca2" status: 204 len: 0 microversion: 2.1 time: 0.145288 Oct 08 20:57:53.012468 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 839/1597] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 20:57:52 2022] DELETE /compute/v2.1/servers/e338d559-3f7c-4cc8-95c6-face79e11ca2 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 20:57:53.019097 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-bc836f99-c181-4e11-b237-2f2cb97955c7 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:53.019691 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-bc836f99-c181-4e11-b237-2f2cb97955c7 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] [instance: ceced78a-58d9-4175-b4fe-0d085be62c94] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:53.035055 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-53e8b770-022a-48d7-81ff-35ba19050255 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01ec70849cfa44368a91df8b3410aba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c97b3b7fa484f97bdf40224f7cc34d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:53.041625 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bc836f99-c181-4e11-b237-2f2cb97955c7 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:53.042388 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bc836f99-c181-4e11-b237-2f2cb97955c7 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:53.045497 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bc836f99-c181-4e11-b237-2f2cb97955c7 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:53.046569 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bc836f99-c181-4e11-b237-2f2cb97955c7 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:53.047043 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bc836f99-c181-4e11-b237-2f2cb97955c7 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:53.047485 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bc836f99-c181-4e11-b237-2f2cb97955c7 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:53.048088 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-53e8b770-022a-48d7-81ff-35ba19050255 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] 10.222.0.26 "GET /compute/v2.1/servers/e5389d1b-b9f3-491a-898c-be611599d73a" status: 200 len: 1524 microversion: 2.1 time: 0.311424 Oct 08 20:57:53.048830 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 759/1598] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:57:52 2022] GET /compute/v2.1/servers/e5389d1b-b9f3-491a-898c-be611599d73a => generated 1524 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:57:53.061046 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-113538c5-fca9-4b09-9475-03d83b4b50db tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:53.062101 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-113538c5-fca9-4b09-9475-03d83b4b50db tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] [instance: 24d7af5b-10ba-4df7-a95d-bcd0b2104f37] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:53.073894 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-113538c5-fca9-4b09-9475-03d83b4b50db tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:53.074643 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-113538c5-fca9-4b09-9475-03d83b4b50db tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:53.075260 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-113538c5-fca9-4b09-9475-03d83b4b50db tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:53.076169 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-113538c5-fca9-4b09-9475-03d83b4b50db tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:53.076825 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-113538c5-fca9-4b09-9475-03d83b4b50db tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:53.077442 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-113538c5-fca9-4b09-9475-03d83b4b50db tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:53.093120 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-113538c5-fca9-4b09-9475-03d83b4b50db tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] HTTP exception thrown: Instance 24d7af5b-10ba-4df7-a95d-bcd0b2104f37 could not be found. Oct 08 20:57:53.095051 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-113538c5-fca9-4b09-9475-03d83b4b50db tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Request method failure captured: Oct 08 20:57:53.095051 ncdv-master-1 devstack@n-api.service[140491]: request: GET /compute/v2.1/servers/24d7af5b-10ba-4df7-a95d-bcd0b2104f37 HTTP/1.1 Oct 08 20:57:53.095051 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 20:57:53.095051 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 20:57:53.095051 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 20:57:53.095051 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 20:57:53.095051 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 20:57:53.095051 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 20:57:53.095051 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 20:57:53.095051 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 20:57:53.095051 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQePneH9r8wc6qFHuuUfUiwj20bfGS3ReCozGKtofTKF_Bibv-TeYrNnDr89OwEeHkYGW8sVcZZerG8KfPs5hnyFWI91x_kPrSGVuiWEZNP0tyGW3_Xh9-fgTNjxnIFiLidb-EHCBZb3EEyAGFqy03GkbophorT5sYui55pNleytp26U Oct 08 20:57:53.095051 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 20:57:53.095051 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 20:57:53.095051 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 20:57:53.095051 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 20:57:53.095051 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 20:57:53.095051 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 20:57:53.095051 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 1be94d02ab5244f98337fb9b90e74746 Oct 08 20:57:53.095051 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-SecurityGroupsTestJSON-1416879597 Oct 08 20:57:53.095051 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 20:57:53.095051 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 20:57:53.095051 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1be94d02ab5244f98337fb9b90e74746"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1be94d02ab5244f98337fb9b90e74746"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1be94d02ab5244f98337fb9b90e74746"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1be94d02ab5244f98337fb9b90e74746"}]}] Oct 08 20:57:53.095051 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-SecurityGroupsTestJSON-1416879597 Oct 08 20:57:53.095051 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 1be94d02ab5244f98337fb9b90e74746 Oct 08 20:57:53.095051 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1416879597 Oct 08 20:57:53.095051 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-SecurityGroupsTestJSON-1416879597-project Oct 08 20:57:53.095051 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 20:57:53.095051 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 20:57:53.095051 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 5ac1323815364df4a3a4d4dbbb9d70dd Oct 08 20:57:53.095051 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-SecurityGroupsTestJSON-1416879597-project Oct 08 20:57:53.095051 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 20:57:53.095051 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance 24d7af5b-10ba-4df7-a95d-bcd0b2104f37 could not be found. Oct 08 20:57:53.095051 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': '24d7af5b-10ba-4df7-a95d-bcd0b2104f37'} Oct 08 20:57:53.095051 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:57:53.095051 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:57:53.095051 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 20:57:53.095051 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 20:57:53.095051 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 20:57:53.095051 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 20:57:53.095051 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 20:57:53.095051 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 20:57:53.095051 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 20:57:53.095051 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 20:57:53.095051 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24d7af5b-10ba-4df7-a95d-bcd0b2104f37 could not be found. Oct 08 20:57:53.095051 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:57:53.095051 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:57:53.095051 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:57:53.095051 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:57:53.095051 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:57:53.095051 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:57:53.095051 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:57:53.095051 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:57:53.095051 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:57:53.095051 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:57:53.095051 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 20:57:53.095051 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 20:57:53.095051 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 20:57:53.095051 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 20:57:53.095051 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 20:57:53.095051 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 20:57:53.095051 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24d7af5b-10ba-4df7-a95d-bcd0b2104f37 could not be found. Oct 08 20:57:53.095051 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:57:53.095051 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:57:53.095051 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:57:53.101044 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:57:53.101044 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:57:53.101044 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:57:53.101044 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 20:57:53.101044 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 20:57:53.101044 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24d7af5b-10ba-4df7-a95d-bcd0b2104f37 could not be found. Oct 08 20:57:53.101044 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:57:53.103468 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-113538c5-fca9-4b09-9475-03d83b4b50db tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Returning 404 to user: Instance 24d7af5b-10ba-4df7-a95d-bcd0b2104f37 could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:57:53.104609 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-113538c5-fca9-4b09-9475-03d83b4b50db tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] 10.222.0.26 "GET /compute/v2.1/servers/24d7af5b-10ba-4df7-a95d-bcd0b2104f37" status: 404 len: 111 microversion: 2.1 time: 0.054863 Oct 08 20:57:53.105784 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 760/1599] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:57:53 2022] GET /compute/v2.1/servers/24d7af5b-10ba-4df7-a95d-bcd0b2104f37 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 20:57:53.112340 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-312f74ec-85b8-4b4a-8e82-4e1ff7c612ad tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:53.113318 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-312f74ec-85b8-4b4a-8e82-4e1ff7c612ad tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] [instance: e338d559-3f7c-4cc8-95c6-face79e11ca2] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:53.121147 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-312f74ec-85b8-4b4a-8e82-4e1ff7c612ad tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:53.121999 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-312f74ec-85b8-4b4a-8e82-4e1ff7c612ad tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:53.122843 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-312f74ec-85b8-4b4a-8e82-4e1ff7c612ad tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:53.123789 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-312f74ec-85b8-4b4a-8e82-4e1ff7c612ad tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:53.124479 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-312f74ec-85b8-4b4a-8e82-4e1ff7c612ad tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:53.125402 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-312f74ec-85b8-4b4a-8e82-4e1ff7c612ad tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:53.209855 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-bc836f99-c181-4e11-b237-2f2cb97955c7 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] 10.222.0.26 "GET /compute/v2.1/servers/ceced78a-58d9-4175-b4fe-0d085be62c94/os-interface" status: 200 len: 1831 microversion: 2.42 time: 0.195902 Oct 08 20:57:53.220546 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 840/1600] 10.222.0.26 () {60 vars in 1316 bytes} [Sat Oct 8 20:57:53 2022] GET /compute/v2.1/servers/ceced78a-58d9-4175-b4fe-0d085be62c94/os-interface => generated 1831 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:57:53.227459 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-19581977-0863-43e0-8ddf-a6970dc0ba90 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Calling method '.version_select at 0x7f1a913f4e50>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:53.371182 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-312f74ec-85b8-4b4a-8e82-4e1ff7c612ad tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474ca64d1b1d4e30916b517645aba882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecc2dd2407b4819874bed09cb27959a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:53.383912 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-312f74ec-85b8-4b4a-8e82-4e1ff7c612ad tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] 10.222.0.26 "GET /compute/v2.1/servers/e338d559-3f7c-4cc8-95c6-face79e11ca2" status: 200 len: 1668 microversion: 2.1 time: 0.276854 Oct 08 20:57:53.387782 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 761/1601] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:57:53 2022] GET /compute/v2.1/servers/e338d559-3f7c-4cc8-95c6-face79e11ca2 => generated 1668 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:57:53.394794 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-ff7dd8eb-4d38-41e6-9ec2-02449041fd0f tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:53.396343 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-ff7dd8eb-4d38-41e6-9ec2-02449041fd0f tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] [instance: 74bdac1c-9b70-46f7-b671-9752894d8980] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:53.415374 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ff7dd8eb-4d38-41e6-9ec2-02449041fd0f tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:53.416772 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ff7dd8eb-4d38-41e6-9ec2-02449041fd0f tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:53.417266 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ff7dd8eb-4d38-41e6-9ec2-02449041fd0f tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:53.418031 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ff7dd8eb-4d38-41e6-9ec2-02449041fd0f tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:53.418500 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ff7dd8eb-4d38-41e6-9ec2-02449041fd0f tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:53.418937 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ff7dd8eb-4d38-41e6-9ec2-02449041fd0f tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:53.595557 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=9 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:57:53.607857 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-ff7dd8eb-4d38-41e6-9ec2-02449041fd0f tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:53.617574 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-ff7dd8eb-4d38-41e6-9ec2-02449041fd0f tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:53.619613 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-ff7dd8eb-4d38-41e6-9ec2-02449041fd0f tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:53.621016 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-ff7dd8eb-4d38-41e6-9ec2-02449041fd0f tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] 10.222.0.26 "GET /compute/v2.1/servers/74bdac1c-9b70-46f7-b671-9752894d8980" status: 200 len: 1488 microversion: 2.25 time: 0.232060 Oct 08 20:57:53.621783 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 762/1602] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:57:53 2022] GET /compute/v2.1/servers/74bdac1c-9b70-46f7-b671-9752894d8980 => generated 1488 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:57:53.626444 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-8876e372-a106-4db7-9031-84c68ef4d7d1 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:53.627263 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-8876e372-a106-4db7-9031-84c68ef4d7d1 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] [instance: 19327d3e-de51-432b-b594-cb9a1bfe2f49] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:53.635819 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8876e372-a106-4db7-9031-84c68ef4d7d1 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:53.636805 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8876e372-a106-4db7-9031-84c68ef4d7d1 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:53.637531 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8876e372-a106-4db7-9031-84c68ef4d7d1 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:53.638666 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8876e372-a106-4db7-9031-84c68ef4d7d1 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:53.639464 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8876e372-a106-4db7-9031-84c68ef4d7d1 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:53.640196 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8876e372-a106-4db7-9031-84c68ef4d7d1 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:53.662742 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=34 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:57:53.803896 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-8876e372-a106-4db7-9031-84c68ef4d7d1 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322606d4cb0f45d3ac2eceab4999d45b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24a29bd6efb40609e31fbb6dba839e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:53.813635 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-8876e372-a106-4db7-9031-84c68ef4d7d1 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] 10.222.0.26 "GET /compute/v2.1/servers/19327d3e-de51-432b-b594-cb9a1bfe2f49" status: 200 len: 1317 microversion: 2.1 time: 0.190487 Oct 08 20:57:53.815002 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 763/1603] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:57:53 2022] GET /compute/v2.1/servers/19327d3e-de51-432b-b594-cb9a1bfe2f49 => generated 1317 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:57:53.898322 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-fd3faa40-6bbc-4e8a-b30a-a9bac7f4441a tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:53.899243 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-fd3faa40-6bbc-4e8a-b30a-a9bac7f4441a tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] [instance: 0568d34c-9aa0-452f-b5c5-b3fc19ebbf15] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:53.907266 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fd3faa40-6bbc-4e8a-b30a-a9bac7f4441a tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:53.909144 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fd3faa40-6bbc-4e8a-b30a-a9bac7f4441a tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:53.909812 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fd3faa40-6bbc-4e8a-b30a-a9bac7f4441a tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:53.911333 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fd3faa40-6bbc-4e8a-b30a-a9bac7f4441a tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:53.912895 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fd3faa40-6bbc-4e8a-b30a-a9bac7f4441a tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:53.914043 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fd3faa40-6bbc-4e8a-b30a-a9bac7f4441a tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:54.085472 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-fd3faa40-6bbc-4e8a-b30a-a9bac7f4441a tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9facf5ea0743cb821cec1b40f6b609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdaf5b9230f4e09949a39a5cbe72011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:54.098239 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-fd3faa40-6bbc-4e8a-b30a-a9bac7f4441a tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] 10.222.0.26 "GET /compute/v2.1/servers/0568d34c-9aa0-452f-b5c5-b3fc19ebbf15" status: 200 len: 1403 microversion: 2.1 time: 0.210865 Oct 08 20:57:54.100972 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 764/1604] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:57:53 2022] GET /compute/v2.1/servers/0568d34c-9aa0-452f-b5c5-b3fc19ebbf15 => generated 1403 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 20:57:54.111581 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-7c3dd2db-f097-4722-b9da-a9a487942c23 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:54.113427 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-7c3dd2db-f097-4722-b9da-a9a487942c23 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] [instance: e5389d1b-b9f3-491a-898c-be611599d73a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:54.126277 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7c3dd2db-f097-4722-b9da-a9a487942c23 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:54.126789 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7c3dd2db-f097-4722-b9da-a9a487942c23 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:54.127238 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7c3dd2db-f097-4722-b9da-a9a487942c23 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:54.127972 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7c3dd2db-f097-4722-b9da-a9a487942c23 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:54.128441 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7c3dd2db-f097-4722-b9da-a9a487942c23 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:54.132544 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7c3dd2db-f097-4722-b9da-a9a487942c23 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:54.143373 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:57:54.231978 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-19581977-0863-43e0-8ddf-a6970dc0ba90 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/ed69df86-546b-4b92-802e-2ad5cb3327d6" status: 202 len: 0 microversion: 2.1 time: 1.009348 Oct 08 20:57:54.238733 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 841/1605] 10.222.0.26 () {58 vars in 1272 bytes} [Sat Oct 8 20:57:53 2022] DELETE /compute/v2.1/os-security-groups/ed69df86-546b-4b92-802e-2ad5cb3327d6 => generated 0 bytes in 1017 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 20:57:54.255641 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-5def05ce-bc6e-4924-aa30-9ea8bfe52412 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Calling method '.version_select at 0x7f1a8caf4f70>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:54.376733 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-7c3dd2db-f097-4722-b9da-a9a487942c23 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01ec70849cfa44368a91df8b3410aba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c97b3b7fa484f97bdf40224f7cc34d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:54.385625 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-7c3dd2db-f097-4722-b9da-a9a487942c23 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] 10.222.0.26 "GET /compute/v2.1/servers/e5389d1b-b9f3-491a-898c-be611599d73a" status: 200 len: 1524 microversion: 2.1 time: 0.283337 Oct 08 20:57:54.389541 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 765/1606] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:57:54 2022] GET /compute/v2.1/servers/e5389d1b-b9f3-491a-898c-be611599d73a => generated 1524 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:57:54.550761 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-e8dfa071-8684-4c33-b5c6-0d52d18e15e7 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1351387272", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:57:54.569029 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=20 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:57:54.610645 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.network.neutron [None req-e8dfa071-8684-4c33-b5c6-0d52d18e15e7 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] validate_networks() for None {{(pid=140491) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 20:57:54.834339 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-e8dfa071-8684-4c33-b5c6-0d52d18e15e7 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Flavor limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 20:57:54.835170 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-e8dfa071-8684-4c33-b5c6-0d52d18e15e7 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Image limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 20:57:54.836274 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-e8dfa071-8684-4c33-b5c6-0d52d18e15e7 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Flavor pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 20:57:54.836762 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-e8dfa071-8684-4c33-b5c6-0d52d18e15e7 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Image pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 20:57:54.837119 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-e8dfa071-8684-4c33-b5c6-0d52d18e15e7 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 20:57:54.848156 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e8dfa071-8684-4c33-b5c6-0d52d18e15e7 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:54.849352 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e8dfa071-8684-4c33-b5c6-0d52d18e15e7 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:54.849896 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e8dfa071-8684-4c33-b5c6-0d52d18e15e7 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:54.850788 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e8dfa071-8684-4c33-b5c6-0d52d18e15e7 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:54.851302 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e8dfa071-8684-4c33-b5c6-0d52d18e15e7 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:54.851791 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e8dfa071-8684-4c33-b5c6-0d52d18e15e7 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:54.872079 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-e8dfa071-8684-4c33-b5c6-0d52d18e15e7 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Getting quotas for project 8472b054404c46a99b81aba34d6b9f40. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 20:57:54.878458 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-e8dfa071-8684-4c33-b5c6-0d52d18e15e7 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Getting quotas for user 67ddc3cd3c374bacbe5bf5e0877380e2 and project 8472b054404c46a99b81aba34d6b9f40. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 20:57:54.893486 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-e8dfa071-8684-4c33-b5c6-0d52d18e15e7 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Going to run 1 instances... {{(pid=140491) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 20:57:54.896653 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-e8dfa071-8684-4c33-b5c6-0d52d18e15e7 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] [instance: 8ceaf7df-4795-4969-be16-a2a1b94a3fa6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c508bd7f-7db9-4b2c-af7c-be54a855c355',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140491) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 20:57:54.933544 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-5def05ce-bc6e-4924-aa30-9ea8bfe52412 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/2df41a21-06a2-472b-a351-effdc7320dda" status: 202 len: 0 microversion: 2.1 time: 0.682808 Oct 08 20:57:54.934459 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 842/1607] 10.222.0.26 () {58 vars in 1272 bytes} [Sat Oct 8 20:57:54 2022] DELETE /compute/v2.1/os-security-groups/2df41a21-06a2-472b-a351-effdc7320dda => generated 0 bytes in 693 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 20:57:54.947827 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-c4bcbec3-3470-49f6-9df4-82e33c331ca2 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:54.948724 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-c4bcbec3-3470-49f6-9df4-82e33c331ca2 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] [instance: e338d559-3f7c-4cc8-95c6-face79e11ca2] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:54.957747 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c4bcbec3-3470-49f6-9df4-82e33c331ca2 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:54.959324 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c4bcbec3-3470-49f6-9df4-82e33c331ca2 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:54.960915 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c4bcbec3-3470-49f6-9df4-82e33c331ca2 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:54.962014 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c4bcbec3-3470-49f6-9df4-82e33c331ca2 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:54.962571 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c4bcbec3-3470-49f6-9df4-82e33c331ca2 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:54.963239 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c4bcbec3-3470-49f6-9df4-82e33c331ca2 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:54.965319 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-e8dfa071-8684-4c33-b5c6-0d52d18e15e7 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.574379 Oct 08 20:57:54.970312 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 766/1608] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 20:57:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 580 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 08 20:57:54.980013 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-a517791c-8ba6-439a-9a86-7535ccafeb03 req-8e8917a4-66cd-4e3c-bd67-b8170f7d1c20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19327d3e-de51-432b-b594-cb9a1bfe2f49", "name": "network-vif-plugged", "status": "completed", "tag": "6fbec29d-5924-4cc1-9f8d-c5ac27cbc284"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:57:55.015442 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-a517791c-8ba6-439a-9a86-7535ccafeb03 req-8e8917a4-66cd-4e3c-bd67-b8170f7d1c20 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:55.016356 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-a517791c-8ba6-439a-9a86-7535ccafeb03 req-8e8917a4-66cd-4e3c-bd67-b8170f7d1c20 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:55.016992 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-a517791c-8ba6-439a-9a86-7535ccafeb03 req-8e8917a4-66cd-4e3c-bd67-b8170f7d1c20 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:55.041719 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-a517791c-8ba6-439a-9a86-7535ccafeb03 req-8e8917a4-66cd-4e3c-bd67-b8170f7d1c20 service nova] Creating event network-vif-plugged:6fbec29d-5924-4cc1-9f8d-c5ac27cbc284 for instance 19327d3e-de51-432b-b594-cb9a1bfe2f49 on nch1-master-1 Oct 08 20:57:55.049988 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-a517791c-8ba6-439a-9a86-7535ccafeb03 req-8e8917a4-66cd-4e3c-bd67-b8170f7d1c20 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078157 Oct 08 20:57:55.056285 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 767/1609] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:57:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:57:55.063259 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-05dc6d4b-f8a4-4439-9610-ef25dbf6308d tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:55.064396 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-05dc6d4b-f8a4-4439-9610-ef25dbf6308d tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] [instance: 74bdac1c-9b70-46f7-b671-9752894d8980] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:55.080207 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-05dc6d4b-f8a4-4439-9610-ef25dbf6308d tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:55.081110 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-05dc6d4b-f8a4-4439-9610-ef25dbf6308d tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:55.081836 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-05dc6d4b-f8a4-4439-9610-ef25dbf6308d tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:55.082772 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-05dc6d4b-f8a4-4439-9610-ef25dbf6308d tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:55.083884 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-05dc6d4b-f8a4-4439-9610-ef25dbf6308d tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:55.084560 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-05dc6d4b-f8a4-4439-9610-ef25dbf6308d tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:55.353446 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-c4bcbec3-3470-49f6-9df4-82e33c331ca2 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474ca64d1b1d4e30916b517645aba882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecc2dd2407b4819874bed09cb27959a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:55.367773 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-c4bcbec3-3470-49f6-9df4-82e33c331ca2 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] 10.222.0.26 "GET /compute/v2.1/servers/e338d559-3f7c-4cc8-95c6-face79e11ca2" status: 200 len: 1668 microversion: 2.1 time: 0.431890 Oct 08 20:57:55.381440 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 843/1610] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:57:54 2022] GET /compute/v2.1/servers/e338d559-3f7c-4cc8-95c6-face79e11ca2 => generated 1668 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:57:55.390744 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-199f48f1-4d79-46dc-a257-7b28879f5294 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:55.391537 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-199f48f1-4d79-46dc-a257-7b28879f5294 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] [instance: 19327d3e-de51-432b-b594-cb9a1bfe2f49] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:55.399054 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-199f48f1-4d79-46dc-a257-7b28879f5294 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:55.399785 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-199f48f1-4d79-46dc-a257-7b28879f5294 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:55.400501 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-199f48f1-4d79-46dc-a257-7b28879f5294 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:55.401511 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-199f48f1-4d79-46dc-a257-7b28879f5294 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:55.402199 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-199f48f1-4d79-46dc-a257-7b28879f5294 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:55.402858 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-199f48f1-4d79-46dc-a257-7b28879f5294 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:55.655487 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-05dc6d4b-f8a4-4439-9610-ef25dbf6308d tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:55.667631 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-05dc6d4b-f8a4-4439-9610-ef25dbf6308d tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:55.669952 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-05dc6d4b-f8a4-4439-9610-ef25dbf6308d tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:55.671450 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-05dc6d4b-f8a4-4439-9610-ef25dbf6308d tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] 10.222.0.26 "GET /compute/v2.1/servers/74bdac1c-9b70-46f7-b671-9752894d8980" status: 200 len: 1488 microversion: 2.25 time: 0.613639 Oct 08 20:57:55.672308 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 768/1611] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:57:55 2022] GET /compute/v2.1/servers/74bdac1c-9b70-46f7-b671-9752894d8980 => generated 1488 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:57:55.698740 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-17e81f9a-d4ae-475a-9e2c-5f17c58be92d tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Action: 'create', calling method: .version_select at 0x7f1a8c61d670>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1049645480", "description": "tempest-description-583399086"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:57:55.756767 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-199f48f1-4d79-46dc-a257-7b28879f5294 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322606d4cb0f45d3ac2eceab4999d45b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24a29bd6efb40609e31fbb6dba839e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:55.767762 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-199f48f1-4d79-46dc-a257-7b28879f5294 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] 10.222.0.26 "GET /compute/v2.1/servers/19327d3e-de51-432b-b594-cb9a1bfe2f49" status: 200 len: 1317 microversion: 2.1 time: 0.384821 Oct 08 20:57:55.768627 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 844/1612] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:57:55 2022] GET /compute/v2.1/servers/19327d3e-de51-432b-b594-cb9a1bfe2f49 => generated 1317 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:57:55.775258 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-00df9901-0205-4d47-b378-56eb7d993e78 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:55.776490 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-00df9901-0205-4d47-b378-56eb7d993e78 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] [instance: 8ceaf7df-4795-4969-be16-a2a1b94a3fa6] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:55.800349 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-00df9901-0205-4d47-b378-56eb7d993e78 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:55.801417 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-00df9901-0205-4d47-b378-56eb7d993e78 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:55.802992 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-00df9901-0205-4d47-b378-56eb7d993e78 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:55.803997 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-00df9901-0205-4d47-b378-56eb7d993e78 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:55.804810 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-00df9901-0205-4d47-b378-56eb7d993e78 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:55.805460 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-00df9901-0205-4d47-b378-56eb7d993e78 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:55.898107 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-17e81f9a-d4ae-475a-9e2c-5f17c58be92d tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] 10.222.0.26 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.204024 Oct 08 20:57:55.899732 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 769/1613] 10.222.0.26 () {60 vars in 1180 bytes} [Sat Oct 8 20:57:55 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:57:55.907035 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-148fefb5-6518-454a-86cd-02a0a1df0d1e tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:55.907610 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-148fefb5-6518-454a-86cd-02a0a1df0d1e tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] [instance: 0568d34c-9aa0-452f-b5c5-b3fc19ebbf15] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:55.915461 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-148fefb5-6518-454a-86cd-02a0a1df0d1e tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:55.915958 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-148fefb5-6518-454a-86cd-02a0a1df0d1e tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:55.916475 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-148fefb5-6518-454a-86cd-02a0a1df0d1e tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:55.917219 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-148fefb5-6518-454a-86cd-02a0a1df0d1e tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:55.917671 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-148fefb5-6518-454a-86cd-02a0a1df0d1e tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:55.918094 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-148fefb5-6518-454a-86cd-02a0a1df0d1e tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:55.921916 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-00df9901-0205-4d47-b378-56eb7d993e78 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ddc3cd3c374bacbe5bf5e0877380e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8472b054404c46a99b81aba34d6b9f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:55.933839 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-00df9901-0205-4d47-b378-56eb7d993e78 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] 10.222.0.26 "GET /compute/v2.1/servers/8ceaf7df-4795-4969-be16-a2a1b94a3fa6" status: 200 len: 1213 microversion: 2.1 time: 0.162824 Oct 08 20:57:55.936106 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 845/1614] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:57:55 2022] GET /compute/v2.1/servers/8ceaf7df-4795-4969-be16-a2a1b94a3fa6 => generated 1213 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:57:55.943434 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-d846e2bc-ca19-42d7-8205-3c29742a91b1 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:55.946122 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-d846e2bc-ca19-42d7-8205-3c29742a91b1 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] [instance: e5389d1b-b9f3-491a-898c-be611599d73a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:55.952844 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d846e2bc-ca19-42d7-8205-3c29742a91b1 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:55.953641 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d846e2bc-ca19-42d7-8205-3c29742a91b1 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:55.954568 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d846e2bc-ca19-42d7-8205-3c29742a91b1 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:55.956155 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d846e2bc-ca19-42d7-8205-3c29742a91b1 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:55.956903 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d846e2bc-ca19-42d7-8205-3c29742a91b1 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:55.957635 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d846e2bc-ca19-42d7-8205-3c29742a91b1 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:56.164090 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-148fefb5-6518-454a-86cd-02a0a1df0d1e tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9facf5ea0743cb821cec1b40f6b609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdaf5b9230f4e09949a39a5cbe72011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:56.178919 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-148fefb5-6518-454a-86cd-02a0a1df0d1e tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] 10.222.0.26 "GET /compute/v2.1/servers/0568d34c-9aa0-452f-b5c5-b3fc19ebbf15" status: 200 len: 1589 microversion: 2.1 time: 0.276079 Oct 08 20:57:56.189541 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 770/1615] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:57:55 2022] GET /compute/v2.1/servers/0568d34c-9aa0-452f-b5c5-b3fc19ebbf15 => generated 1589 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:57:56.204014 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-2c72ebe5-8b06-45a4-b199-b4f364073a89 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Action: 'update', calling method: .version_select at 0x7f1a8c931160>, body: {"security_group": {"name": "tempest-sg-hth-2111186073", "description": "tempest-description-hth-149546618"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:57:56.296324 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-d846e2bc-ca19-42d7-8205-3c29742a91b1 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01ec70849cfa44368a91df8b3410aba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c97b3b7fa484f97bdf40224f7cc34d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:56.315232 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-d846e2bc-ca19-42d7-8205-3c29742a91b1 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] 10.222.0.26 "GET /compute/v2.1/servers/e5389d1b-b9f3-491a-898c-be611599d73a" status: 200 len: 1524 microversion: 2.1 time: 0.376095 Oct 08 20:57:56.316094 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 846/1616] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:57:55 2022] GET /compute/v2.1/servers/e5389d1b-b9f3-491a-898c-be611599d73a => generated 1524 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:57:56.323048 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-f1c190f1-1ddb-4afe-8243-fa3ede752bb1 req-5005c971-acdc-4b0e-af2a-6240ddd52916 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ceced78a-58d9-4175-b4fe-0d085be62c94", "tag": "5dd9a8e9-ad33-45d4-9c64-b8e4e48e3190"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:57:56.347995 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-f1c190f1-1ddb-4afe-8243-fa3ede752bb1 req-5005c971-acdc-4b0e-af2a-6240ddd52916 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:56.348510 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-f1c190f1-1ddb-4afe-8243-fa3ede752bb1 req-5005c971-acdc-4b0e-af2a-6240ddd52916 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:56.349560 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-f1c190f1-1ddb-4afe-8243-fa3ede752bb1 req-5005c971-acdc-4b0e-af2a-6240ddd52916 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:56.363034 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-f1c190f1-1ddb-4afe-8243-fa3ede752bb1 req-5005c971-acdc-4b0e-af2a-6240ddd52916 service nova] Creating event network-changed:5dd9a8e9-ad33-45d4-9c64-b8e4e48e3190 for instance ceced78a-58d9-4175-b4fe-0d085be62c94 on nch2-master-1 Oct 08 20:57:56.369146 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-f1c190f1-1ddb-4afe-8243-fa3ede752bb1 req-5005c971-acdc-4b0e-af2a-6240ddd52916 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051451 Oct 08 20:57:56.370117 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 847/1617] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:57:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:57:56.377325 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-7ac08ca2-a1c6-4e8b-aab5-dcc7c8001131 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:56.378120 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-7ac08ca2-a1c6-4e8b-aab5-dcc7c8001131 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] [instance: 0568d34c-9aa0-452f-b5c5-b3fc19ebbf15] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:56.385095 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7ac08ca2-a1c6-4e8b-aab5-dcc7c8001131 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:56.386004 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7ac08ca2-a1c6-4e8b-aab5-dcc7c8001131 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:56.386612 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7ac08ca2-a1c6-4e8b-aab5-dcc7c8001131 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:56.387488 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7ac08ca2-a1c6-4e8b-aab5-dcc7c8001131 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:56.388115 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7ac08ca2-a1c6-4e8b-aab5-dcc7c8001131 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:56.388707 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7ac08ca2-a1c6-4e8b-aab5-dcc7c8001131 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:56.526493 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-7ac08ca2-a1c6-4e8b-aab5-dcc7c8001131 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] 10.222.0.26 "GET /compute/v2.1/servers/0568d34c-9aa0-452f-b5c5-b3fc19ebbf15/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.154926 Oct 08 20:57:56.529221 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-2c72ebe5-8b06-45a4-b199-b4f364073a89 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] 10.222.0.26 "PUT /compute/v2.1/os-security-groups/d44856f4-b7de-4e3e-bb16-bb272bbd8857" status: 200 len: 217 microversion: 2.1 time: 0.337810 Oct 08 20:57:56.530070 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 771/1618] 10.222.0.26 () {60 vars in 1290 bytes} [Sat Oct 8 20:57:56 2022] PUT /compute/v2.1/os-security-groups/d44856f4-b7de-4e3e-bb16-bb272bbd8857 => generated 217 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:57:56.534573 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-f90c5c3a-66ba-41f1-8a80-a81742826368 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:56.535285 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-f90c5c3a-66ba-41f1-8a80-a81742826368 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] [instance: e338d559-3f7c-4cc8-95c6-face79e11ca2] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:56.554559 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 848/1619] 10.222.0.26 () {58 vars in 1275 bytes} [Sat Oct 8 20:57:56 2022] GET /compute/v2.1/servers/0568d34c-9aa0-452f-b5c5-b3fc19ebbf15/os-interface => generated 284 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:57:56.555522 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f90c5c3a-66ba-41f1-8a80-a81742826368 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:56.556040 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f90c5c3a-66ba-41f1-8a80-a81742826368 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:56.562709 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f90c5c3a-66ba-41f1-8a80-a81742826368 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:56.563837 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f90c5c3a-66ba-41f1-8a80-a81742826368 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:56.565372 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f90c5c3a-66ba-41f1-8a80-a81742826368 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:56.566802 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f90c5c3a-66ba-41f1-8a80-a81742826368 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:56.574622 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-b426f732-7d3d-4324-ba66-577323b120c3 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Calling method '.version_select at 0x7f1a8c151790>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:56.707454 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-f90c5c3a-66ba-41f1-8a80-a81742826368 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474ca64d1b1d4e30916b517645aba882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecc2dd2407b4819874bed09cb27959a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:56.721717 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-f90c5c3a-66ba-41f1-8a80-a81742826368 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] 10.222.0.26 "GET /compute/v2.1/servers/e338d559-3f7c-4cc8-95c6-face79e11ca2" status: 200 len: 1600 microversion: 2.1 time: 0.190276 Oct 08 20:57:56.723112 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 772/1620] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:57:56 2022] GET /compute/v2.1/servers/e338d559-3f7c-4cc8-95c6-face79e11ca2 => generated 1600 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:57:56.729582 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-65a7cd18-54cc-4149-aad9-32106b714fdd tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:56.731014 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-65a7cd18-54cc-4149-aad9-32106b714fdd tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] [instance: 74bdac1c-9b70-46f7-b671-9752894d8980] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:56.744092 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-65a7cd18-54cc-4149-aad9-32106b714fdd tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:56.744517 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-65a7cd18-54cc-4149-aad9-32106b714fdd tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:56.744964 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-65a7cd18-54cc-4149-aad9-32106b714fdd tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:56.745709 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-65a7cd18-54cc-4149-aad9-32106b714fdd tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:56.746348 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-65a7cd18-54cc-4149-aad9-32106b714fdd tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:56.746974 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-65a7cd18-54cc-4149-aad9-32106b714fdd tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:56.823839 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-b426f732-7d3d-4324-ba66-577323b120c3 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] 10.222.0.26 "GET /compute/v2.1/os-security-groups/d44856f4-b7de-4e3e-bb16-bb272bbd8857" status: 200 len: 217 microversion: 2.1 time: 0.265840 Oct 08 20:57:56.824781 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 849/1621] 10.222.0.26 () {58 vars in 1269 bytes} [Sat Oct 8 20:57:56 2022] GET /compute/v2.1/os-security-groups/d44856f4-b7de-4e3e-bb16-bb272bbd8857 => generated 217 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:57:56.830871 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-1aebbdf6-9b1d-4baf-97c1-c5c8d1c4c508 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:56.831784 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-1aebbdf6-9b1d-4baf-97c1-c5c8d1c4c508 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] [instance: 19327d3e-de51-432b-b594-cb9a1bfe2f49] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:56.844225 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1aebbdf6-9b1d-4baf-97c1-c5c8d1c4c508 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:56.846428 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1aebbdf6-9b1d-4baf-97c1-c5c8d1c4c508 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:56.847919 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1aebbdf6-9b1d-4baf-97c1-c5c8d1c4c508 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:56.849822 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1aebbdf6-9b1d-4baf-97c1-c5c8d1c4c508 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:56.850401 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1aebbdf6-9b1d-4baf-97c1-c5c8d1c4c508 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:56.851418 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1aebbdf6-9b1d-4baf-97c1-c5c8d1c4c508 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:57.011509 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-65a7cd18-54cc-4149-aad9-32106b714fdd tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:57.021045 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-65a7cd18-54cc-4149-aad9-32106b714fdd tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:57.022919 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-65a7cd18-54cc-4149-aad9-32106b714fdd tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:57.024371 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-65a7cd18-54cc-4149-aad9-32106b714fdd tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] 10.222.0.26 "GET /compute/v2.1/servers/74bdac1c-9b70-46f7-b671-9752894d8980" status: 200 len: 1488 microversion: 2.25 time: 0.299402 Oct 08 20:57:57.025109 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 773/1622] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:57:56 2022] GET /compute/v2.1/servers/74bdac1c-9b70-46f7-b671-9752894d8980 => generated 1488 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:57:57.037127 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-22101896-ccba-46e0-9893-5d7fc99cd112 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Calling method '.version_select at 0x7f1a8c63a550>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:57.531005 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-22101896-ccba-46e0-9893-5d7fc99cd112 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/d44856f4-b7de-4e3e-bb16-bb272bbd8857" status: 202 len: 0 microversion: 2.1 time: 0.496902 Oct 08 20:57:57.532415 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 774/1623] 10.222.0.26 () {58 vars in 1272 bytes} [Sat Oct 8 20:57:57 2022] DELETE /compute/v2.1/os-security-groups/d44856f4-b7de-4e3e-bb16-bb272bbd8857 => generated 0 bytes in 506 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 20:57:57.540394 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-45887bf9-832b-4820-bc56-1ae8edd689d8 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:57.542956 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-45887bf9-832b-4820-bc56-1ae8edd689d8 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] [instance: 8ceaf7df-4795-4969-be16-a2a1b94a3fa6] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:57.564199 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-45887bf9-832b-4820-bc56-1ae8edd689d8 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:57.565115 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-45887bf9-832b-4820-bc56-1ae8edd689d8 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:57.565877 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-45887bf9-832b-4820-bc56-1ae8edd689d8 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:57.566948 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-45887bf9-832b-4820-bc56-1ae8edd689d8 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:57.567615 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-45887bf9-832b-4820-bc56-1ae8edd689d8 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:57.569630 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-45887bf9-832b-4820-bc56-1ae8edd689d8 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:57.619426 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-1aebbdf6-9b1d-4baf-97c1-c5c8d1c4c508 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322606d4cb0f45d3ac2eceab4999d45b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24a29bd6efb40609e31fbb6dba839e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:57.635471 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-1aebbdf6-9b1d-4baf-97c1-c5c8d1c4c508 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] 10.222.0.26 "GET /compute/v2.1/servers/19327d3e-de51-432b-b594-cb9a1bfe2f49" status: 200 len: 1317 microversion: 2.1 time: 0.808787 Oct 08 20:57:57.636557 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 850/1624] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:57:56 2022] GET /compute/v2.1/servers/19327d3e-de51-432b-b594-cb9a1bfe2f49 => generated 1317 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:57:57.642916 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-45b079d4-b673-4547-accd-b81d196e02e3 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:57.643733 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-45b079d4-b673-4547-accd-b81d196e02e3 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] [instance: e5389d1b-b9f3-491a-898c-be611599d73a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:57.653440 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-45b079d4-b673-4547-accd-b81d196e02e3 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:57.654228 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-45b079d4-b673-4547-accd-b81d196e02e3 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:57.655053 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-45b079d4-b673-4547-accd-b81d196e02e3 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:57.656036 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-45b079d4-b673-4547-accd-b81d196e02e3 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:57.657349 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-45b079d4-b673-4547-accd-b81d196e02e3 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:57.657868 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-45b079d4-b673-4547-accd-b81d196e02e3 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:57.684892 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-45887bf9-832b-4820-bc56-1ae8edd689d8 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ddc3cd3c374bacbe5bf5e0877380e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8472b054404c46a99b81aba34d6b9f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:57.698659 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-45887bf9-832b-4820-bc56-1ae8edd689d8 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] 10.222.0.26 "GET /compute/v2.1/servers/8ceaf7df-4795-4969-be16-a2a1b94a3fa6" status: 200 len: 1269 microversion: 2.1 time: 0.165025 Oct 08 20:57:57.699520 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 775/1625] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:57:57 2022] GET /compute/v2.1/servers/8ceaf7df-4795-4969-be16-a2a1b94a3fa6 => generated 1269 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:57:57.727693 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-783a3505-36c8-4f4c-9b23-ae0a579e2f33 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:57.728306 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-783a3505-36c8-4f4c-9b23-ae0a579e2f33 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] [instance: 24d7af5b-10ba-4df7-a95d-bcd0b2104f37] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:57.737753 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-783a3505-36c8-4f4c-9b23-ae0a579e2f33 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:57.738577 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-783a3505-36c8-4f4c-9b23-ae0a579e2f33 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:57.739235 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-783a3505-36c8-4f4c-9b23-ae0a579e2f33 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:57.740343 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-783a3505-36c8-4f4c-9b23-ae0a579e2f33 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:57.741151 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-783a3505-36c8-4f4c-9b23-ae0a579e2f33 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:57.744752 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-783a3505-36c8-4f4c-9b23-ae0a579e2f33 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:57.760715 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-783a3505-36c8-4f4c-9b23-ae0a579e2f33 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] HTTP exception thrown: Instance 24d7af5b-10ba-4df7-a95d-bcd0b2104f37 could not be found. Oct 08 20:57:57.762488 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-783a3505-36c8-4f4c-9b23-ae0a579e2f33 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Request method failure captured: Oct 08 20:57:57.762488 ncdv-master-1 devstack@n-api.service[140491]: request: DELETE /compute/v2.1/servers/24d7af5b-10ba-4df7-a95d-bcd0b2104f37 HTTP/1.1 Oct 08 20:57:57.762488 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 20:57:57.762488 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 20:57:57.762488 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 20:57:57.762488 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 20:57:57.762488 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 20:57:57.762488 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 20:57:57.762488 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 20:57:57.762488 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 20:57:57.762488 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQePneH9r8wc6qFHuuUfUiwj20bfGS3ReCozGKtofTKF_Bibv-TeYrNnDr89OwEeHkYGW8sVcZZerG8KfPs5hnyFWI91x_kPrSGVuiWEZNP0tyGW3_Xh9-fgTNjxnIFiLidb-EHCBZb3EEyAGFqy03GkbophorT5sYui55pNleytp26U Oct 08 20:57:57.762488 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 20:57:57.762488 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 20:57:57.762488 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 20:57:57.762488 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 20:57:57.762488 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 20:57:57.762488 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 20:57:57.762488 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 1be94d02ab5244f98337fb9b90e74746 Oct 08 20:57:57.762488 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-SecurityGroupsTestJSON-1416879597 Oct 08 20:57:57.762488 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 20:57:57.762488 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 20:57:57.762488 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1be94d02ab5244f98337fb9b90e74746"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1be94d02ab5244f98337fb9b90e74746"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1be94d02ab5244f98337fb9b90e74746"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1be94d02ab5244f98337fb9b90e74746"}]}] Oct 08 20:57:57.762488 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-SecurityGroupsTestJSON-1416879597 Oct 08 20:57:57.762488 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 1be94d02ab5244f98337fb9b90e74746 Oct 08 20:57:57.762488 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1416879597 Oct 08 20:57:57.762488 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-SecurityGroupsTestJSON-1416879597-project Oct 08 20:57:57.762488 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 20:57:57.762488 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 20:57:57.762488 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 5ac1323815364df4a3a4d4dbbb9d70dd Oct 08 20:57:57.762488 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-SecurityGroupsTestJSON-1416879597-project Oct 08 20:57:57.762488 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 20:57:57.762488 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance 24d7af5b-10ba-4df7-a95d-bcd0b2104f37 could not be found. Oct 08 20:57:57.762488 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': '24d7af5b-10ba-4df7-a95d-bcd0b2104f37'} Oct 08 20:57:57.762488 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:57:57.762488 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:57:57.762488 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 20:57:57.762488 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 20:57:57.762488 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 20:57:57.762488 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 20:57:57.762488 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 20:57:57.762488 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 20:57:57.762488 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 20:57:57.762488 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 20:57:57.762488 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24d7af5b-10ba-4df7-a95d-bcd0b2104f37 could not be found. Oct 08 20:57:57.762488 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:57:57.762488 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:57:57.762488 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:57:57.762488 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:57:57.762488 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:57:57.762488 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:57:57.762488 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:57:57.762488 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:57:57.762488 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:57:57.762488 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:57:57.762488 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 08 20:57:57.762488 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 08 20:57:57.762488 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 08 20:57:57.762488 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 08 20:57:57.762488 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 20:57:57.762488 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 20:57:57.762488 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 20:57:57.762488 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 20:57:57.769127 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24d7af5b-10ba-4df7-a95d-bcd0b2104f37 could not be found. Oct 08 20:57:57.769127 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:57:57.769127 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:57:57.769127 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:57:57.769127 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:57:57.769127 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:57:57.769127 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:57:57.769127 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 20:57:57.769127 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 20:57:57.769127 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24d7af5b-10ba-4df7-a95d-bcd0b2104f37 could not be found. Oct 08 20:57:57.769127 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:57:57.769127 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-783a3505-36c8-4f4c-9b23-ae0a579e2f33 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Returning 404 to user: Instance 24d7af5b-10ba-4df7-a95d-bcd0b2104f37 could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:57:57.769127 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-783a3505-36c8-4f4c-9b23-ae0a579e2f33 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] 10.222.0.26 "DELETE /compute/v2.1/servers/24d7af5b-10ba-4df7-a95d-bcd0b2104f37" status: 404 len: 111 microversion: 2.1 time: 0.052085 Oct 08 20:57:57.769127 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 776/1626] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 20:57:57 2022] DELETE /compute/v2.1/servers/24d7af5b-10ba-4df7-a95d-bcd0b2104f37 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 20:57:57.772094 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-bfc46990-3e9e-4a9e-a5ec-37f89156994b tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:57.772094 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-bfc46990-3e9e-4a9e-a5ec-37f89156994b tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] [instance: e338d559-3f7c-4cc8-95c6-face79e11ca2] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:57.780317 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bfc46990-3e9e-4a9e-a5ec-37f89156994b tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:57.780734 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bfc46990-3e9e-4a9e-a5ec-37f89156994b tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:57.781305 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bfc46990-3e9e-4a9e-a5ec-37f89156994b tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:57.782435 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bfc46990-3e9e-4a9e-a5ec-37f89156994b tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:57.782435 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bfc46990-3e9e-4a9e-a5ec-37f89156994b tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:57.782789 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bfc46990-3e9e-4a9e-a5ec-37f89156994b tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:57.828000 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bfc46990-3e9e-4a9e-a5ec-37f89156994b tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:57.828573 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bfc46990-3e9e-4a9e-a5ec-37f89156994b tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:57.829627 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bfc46990-3e9e-4a9e-a5ec-37f89156994b tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:57.830181 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.objects.instance [None req-bfc46990-3e9e-4a9e-a5ec-37f89156994b tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lazy-loading 'fault' on Instance uuid e338d559-3f7c-4cc8-95c6-face79e11ca2 {{(pid=140491) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 20:57:57.875627 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-bfc46990-3e9e-4a9e-a5ec-37f89156994b tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474ca64d1b1d4e30916b517645aba882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecc2dd2407b4819874bed09cb27959a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:57.884517 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-bfc46990-3e9e-4a9e-a5ec-37f89156994b tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] 10.222.0.26 "GET /compute/v2.1/servers/e338d559-3f7c-4cc8-95c6-face79e11ca2" status: 200 len: 1323 microversion: 2.1 time: 0.118557 Oct 08 20:57:57.885100 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 777/1627] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:57:57 2022] GET /compute/v2.1/servers/e338d559-3f7c-4cc8-95c6-face79e11ca2 => generated 1323 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:57:57.891109 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-541e91da-b884-4b61-94b4-108109f52954 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:57.891912 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-541e91da-b884-4b61-94b4-108109f52954 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] [instance: 24d7af5b-10ba-4df7-a95d-bcd0b2104f37] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:57.905677 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-541e91da-b884-4b61-94b4-108109f52954 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:57.906887 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-541e91da-b884-4b61-94b4-108109f52954 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:57.907411 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-541e91da-b884-4b61-94b4-108109f52954 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:57.908805 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-541e91da-b884-4b61-94b4-108109f52954 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:57.909382 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-541e91da-b884-4b61-94b4-108109f52954 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:57.909907 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-541e91da-b884-4b61-94b4-108109f52954 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:57.927735 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-541e91da-b884-4b61-94b4-108109f52954 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] HTTP exception thrown: Instance 24d7af5b-10ba-4df7-a95d-bcd0b2104f37 could not be found. Oct 08 20:57:57.930922 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-541e91da-b884-4b61-94b4-108109f52954 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Request method failure captured: Oct 08 20:57:57.930922 ncdv-master-1 devstack@n-api.service[140491]: request: GET /compute/v2.1/servers/24d7af5b-10ba-4df7-a95d-bcd0b2104f37 HTTP/1.1 Oct 08 20:57:57.930922 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 20:57:57.930922 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 20:57:57.930922 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 20:57:57.930922 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 20:57:57.930922 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 20:57:57.930922 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 20:57:57.930922 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 20:57:57.930922 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 20:57:57.930922 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQePneH9r8wc6qFHuuUfUiwj20bfGS3ReCozGKtofTKF_Bibv-TeYrNnDr89OwEeHkYGW8sVcZZerG8KfPs5hnyFWI91x_kPrSGVuiWEZNP0tyGW3_Xh9-fgTNjxnIFiLidb-EHCBZb3EEyAGFqy03GkbophorT5sYui55pNleytp26U Oct 08 20:57:57.930922 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 20:57:57.930922 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 20:57:57.930922 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 20:57:57.930922 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 20:57:57.930922 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 20:57:57.930922 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 20:57:57.930922 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 1be94d02ab5244f98337fb9b90e74746 Oct 08 20:57:57.930922 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-SecurityGroupsTestJSON-1416879597 Oct 08 20:57:57.930922 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 20:57:57.930922 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 20:57:57.930922 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1be94d02ab5244f98337fb9b90e74746"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1be94d02ab5244f98337fb9b90e74746"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1be94d02ab5244f98337fb9b90e74746"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1be94d02ab5244f98337fb9b90e74746"}]}] Oct 08 20:57:57.930922 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-SecurityGroupsTestJSON-1416879597 Oct 08 20:57:57.930922 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 1be94d02ab5244f98337fb9b90e74746 Oct 08 20:57:57.930922 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1416879597 Oct 08 20:57:57.930922 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-SecurityGroupsTestJSON-1416879597-project Oct 08 20:57:57.930922 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 20:57:57.930922 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 20:57:57.930922 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 5ac1323815364df4a3a4d4dbbb9d70dd Oct 08 20:57:57.930922 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-SecurityGroupsTestJSON-1416879597-project Oct 08 20:57:57.930922 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 20:57:57.930922 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance 24d7af5b-10ba-4df7-a95d-bcd0b2104f37 could not be found. Oct 08 20:57:57.930922 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': '24d7af5b-10ba-4df7-a95d-bcd0b2104f37'} Oct 08 20:57:57.930922 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:57:57.930922 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:57:57.930922 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 20:57:57.930922 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 20:57:57.930922 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 20:57:57.930922 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 20:57:57.930922 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 20:57:57.930922 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 20:57:57.930922 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 20:57:57.930922 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 20:57:57.930922 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24d7af5b-10ba-4df7-a95d-bcd0b2104f37 could not be found. Oct 08 20:57:57.930922 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:57:57.930922 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:57:57.930922 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:57:57.930922 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:57:57.930922 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:57:57.930922 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:57:57.930922 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:57:57.930922 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:57:57.930922 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:57:57.930922 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:57:57.930922 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 20:57:57.930922 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 20:57:57.930922 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 20:57:57.930922 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 20:57:57.930922 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 20:57:57.930922 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 20:57:57.930922 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24d7af5b-10ba-4df7-a95d-bcd0b2104f37 could not be found. Oct 08 20:57:57.930922 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:57:57.930922 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:57:57.930922 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:57:57.935583 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:57:57.935583 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:57:57.935583 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:57:57.935583 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 20:57:57.935583 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 20:57:57.935583 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24d7af5b-10ba-4df7-a95d-bcd0b2104f37 could not be found. Oct 08 20:57:57.935583 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:57:57.937324 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-541e91da-b884-4b61-94b4-108109f52954 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Returning 404 to user: Instance 24d7af5b-10ba-4df7-a95d-bcd0b2104f37 could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:57:57.938261 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-541e91da-b884-4b61-94b4-108109f52954 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] 10.222.0.26 "GET /compute/v2.1/servers/24d7af5b-10ba-4df7-a95d-bcd0b2104f37" status: 404 len: 111 microversion: 2.1 time: 0.052205 Oct 08 20:57:57.939182 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 778/1628] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:57:57 2022] GET /compute/v2.1/servers/24d7af5b-10ba-4df7-a95d-bcd0b2104f37 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 20:57:57.950035 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-8bed5da2-9dbb-49c5-b381-3f368e83a3a1 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Calling method '.version_select at 0x7f1a8c61dca0>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:58.008674 ncdv-master-1 devstack@n-api.service[140491]: DEBUG neutronclient.v2_0.client [None req-8bed5da2-9dbb-49c5-b381-3f368e83a3a1 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 2df41a21-06a2-472b-a351-effdc7320dda does not exist", "detail": ""}} {{(pid=140491) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 08 20:57:58.009840 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.network.security_group_api [None req-8bed5da2-9dbb-49c5-b381-3f368e83a3a1 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Neutron security group 2df41a21-06a2-472b-a351-effdc7320dda not found {{(pid=140491) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 08 20:57:58.010831 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-8bed5da2-9dbb-49c5-b381-3f368e83a3a1 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] HTTP exception thrown: Security group 2df41a21-06a2-472b-a351-effdc7320dda does not exist Oct 08 20:57:58.010831 ncdv-master-1 devstack@n-api.service[140491]: Neutron server returns request_ids: ['req-70cc1bf5-e4cd-46cc-b37d-c5548e190b47'] Oct 08 20:57:58.015465 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-8bed5da2-9dbb-49c5-b381-3f368e83a3a1 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Request method failure captured: Oct 08 20:57:58.015465 ncdv-master-1 devstack@n-api.service[140491]: request: DELETE /compute/v2.1/os-security-groups/2df41a21-06a2-472b-a351-effdc7320dda HTTP/1.1 Oct 08 20:57:58.015465 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 20:57:58.015465 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 20:57:58.015465 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 20:57:58.015465 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 20:57:58.015465 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 20:57:58.015465 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 20:57:58.015465 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 20:57:58.015465 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 20:57:58.015465 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQePneH9r8wc6qFHuuUfUiwj20bfGS3ReCozGKtofTKF_Bibv-TeYrNnDr89OwEeHkYGW8sVcZZerG8KfPs5hnyFWI91x_kPrSGVuiWEZNP0tyGW3_Xh9-fgTNjxnIFiLidb-EHCBZb3EEyAGFqy03GkbophorT5sYui55pNleytp26U Oct 08 20:57:58.015465 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 20:57:58.015465 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 20:57:58.015465 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 20:57:58.015465 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 20:57:58.015465 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 20:57:58.015465 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 20:57:58.015465 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 1be94d02ab5244f98337fb9b90e74746 Oct 08 20:57:58.015465 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-SecurityGroupsTestJSON-1416879597 Oct 08 20:57:58.015465 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 20:57:58.015465 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 20:57:58.015465 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1be94d02ab5244f98337fb9b90e74746"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1be94d02ab5244f98337fb9b90e74746"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1be94d02ab5244f98337fb9b90e74746"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1be94d02ab5244f98337fb9b90e74746"}]}] Oct 08 20:57:58.015465 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-SecurityGroupsTestJSON-1416879597 Oct 08 20:57:58.015465 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 1be94d02ab5244f98337fb9b90e74746 Oct 08 20:57:58.015465 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1416879597 Oct 08 20:57:58.015465 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-SecurityGroupsTestJSON-1416879597-project Oct 08 20:57:58.015465 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 20:57:58.015465 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 20:57:58.015465 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 5ac1323815364df4a3a4d4dbbb9d70dd Oct 08 20:57:58.015465 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-SecurityGroupsTestJSON-1416879597-project Oct 08 20:57:58.015465 ncdv-master-1 devstack@n-api.service[140491]: method: Oct 08 20:57:58.015465 ncdv-master-1 devstack@n-api.service[140491]: exception: Security group 2df41a21-06a2-472b-a351-effdc7320dda does not exist Oct 08 20:57:58.015465 ncdv-master-1 devstack@n-api.service[140491]: Neutron server returns request_ids: ['req-70cc1bf5-e4cd-46cc-b37d-c5548e190b47'] Oct 08 20:57:58.015465 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': '2df41a21-06a2-472b-a351-effdc7320dda'} Oct 08 20:57:58.015465 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:57:58.015465 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:57:58.015465 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 08 20:57:58.015465 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 08 20:57:58.015465 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 08 20:57:58.015465 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 08 20:57:58.015465 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 08 20:57:58.015465 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 08 20:57:58.015465 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 08 20:57:58.015465 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 08 20:57:58.015465 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 08 20:57:58.015465 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 08 20:57:58.015465 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 08 20:57:58.015465 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 08 20:57:58.015465 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 08 20:57:58.015465 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 08 20:57:58.015465 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 08 20:57:58.015465 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 08 20:57:58.015465 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 08 20:57:58.015465 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 08 20:57:58.015465 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 08 20:57:58.015465 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 08 20:57:58.015465 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 08 20:57:58.015465 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 08 20:57:58.015465 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 08 20:57:58.015465 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 08 20:57:58.015465 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 2df41a21-06a2-472b-a351-effdc7320dda does not exist Oct 08 20:57:58.025379 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-70cc1bf5-e4cd-46cc-b37d-c5548e190b47'] Oct 08 20:57:58.025379 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:57:58.025379 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:57:58.025379 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:57:58.025379 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:57:58.025379 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 08 20:57:58.025379 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 08 20:57:58.025379 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 08 20:57:58.025379 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 08 20:57:58.025379 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 2df41a21-06a2-472b-a351-effdc7320dda does not exist Oct 08 20:57:58.025379 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-70cc1bf5-e4cd-46cc-b37d-c5548e190b47'] Oct 08 20:57:58.025379 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:57:58.025379 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:57:58.025379 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:57:58.025379 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:57:58.025379 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:57:58.025379 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:57:58.025379 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:57:58.025379 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:57:58.025379 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 08 20:57:58.025379 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 08 20:57:58.025379 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:57:58.025379 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:57:58.025379 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 08 20:57:58.025379 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 08 20:57:58.025379 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 2df41a21-06a2-472b-a351-effdc7320dda does not exist Oct 08 20:57:58.025379 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-70cc1bf5-e4cd-46cc-b37d-c5548e190b47'] Oct 08 20:57:58.025379 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:57:58.025379 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:57:58.025379 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:57:58.025379 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:57:58.025379 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:57:58.025379 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:57:58.025379 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 20:57:58.025379 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 20:57:58.025379 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 2df41a21-06a2-472b-a351-effdc7320dda does not exist Oct 08 20:57:58.025379 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-70cc1bf5-e4cd-46cc-b37d-c5548e190b47'] Oct 08 20:57:58.025379 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:57:58.025379 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-8bed5da2-9dbb-49c5-b381-3f368e83a3a1 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Returning 404 to user: Security group 2df41a21-06a2-472b-a351-effdc7320dda does not exist Oct 08 20:57:58.025379 ncdv-master-1 devstack@n-api.service[140491]: Neutron server returns request_ids: ['req-70cc1bf5-e4cd-46cc-b37d-c5548e190b47'] {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:57:58.025379 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-8bed5da2-9dbb-49c5-b381-3f368e83a3a1 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/2df41a21-06a2-472b-a351-effdc7320dda" status: 404 len: 194 microversion: 2.1 time: 0.072222 Oct 08 20:57:58.025379 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 779/1629] 10.222.0.26 () {58 vars in 1272 bytes} [Sat Oct 8 20:57:57 2022] DELETE /compute/v2.1/os-security-groups/2df41a21-06a2-472b-a351-effdc7320dda => generated 194 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 20:57:58.035508 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-fa5af593-5eff-4a6d-bf02-e50a54f5b870 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Calling method '.version_select at 0x7f1a8c61d8b0>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:58.063288 ncdv-master-1 devstack@n-api.service[140491]: DEBUG neutronclient.v2_0.client [None req-fa5af593-5eff-4a6d-bf02-e50a54f5b870 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group ed69df86-546b-4b92-802e-2ad5cb3327d6 does not exist", "detail": ""}} {{(pid=140491) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 08 20:57:58.063933 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.network.security_group_api [None req-fa5af593-5eff-4a6d-bf02-e50a54f5b870 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Neutron security group ed69df86-546b-4b92-802e-2ad5cb3327d6 not found {{(pid=140491) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 08 20:57:58.065679 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-fa5af593-5eff-4a6d-bf02-e50a54f5b870 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] HTTP exception thrown: Security group ed69df86-546b-4b92-802e-2ad5cb3327d6 does not exist Oct 08 20:57:58.065679 ncdv-master-1 devstack@n-api.service[140491]: Neutron server returns request_ids: ['req-912d2bca-c6e3-44d1-be4b-b64ef943ba3b'] Oct 08 20:57:58.068554 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-fa5af593-5eff-4a6d-bf02-e50a54f5b870 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Request method failure captured: Oct 08 20:57:58.068554 ncdv-master-1 devstack@n-api.service[140491]: request: DELETE /compute/v2.1/os-security-groups/ed69df86-546b-4b92-802e-2ad5cb3327d6 HTTP/1.1 Oct 08 20:57:58.068554 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 20:57:58.068554 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 20:57:58.068554 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 20:57:58.068554 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 20:57:58.068554 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 20:57:58.068554 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 20:57:58.068554 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 20:57:58.068554 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 20:57:58.068554 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQePneH9r8wc6qFHuuUfUiwj20bfGS3ReCozGKtofTKF_Bibv-TeYrNnDr89OwEeHkYGW8sVcZZerG8KfPs5hnyFWI91x_kPrSGVuiWEZNP0tyGW3_Xh9-fgTNjxnIFiLidb-EHCBZb3EEyAGFqy03GkbophorT5sYui55pNleytp26U Oct 08 20:57:58.068554 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 20:57:58.068554 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 20:57:58.068554 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 20:57:58.068554 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 20:57:58.068554 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 20:57:58.068554 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 20:57:58.068554 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 1be94d02ab5244f98337fb9b90e74746 Oct 08 20:57:58.068554 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-SecurityGroupsTestJSON-1416879597 Oct 08 20:57:58.068554 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 20:57:58.068554 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 20:57:58.068554 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1be94d02ab5244f98337fb9b90e74746"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1be94d02ab5244f98337fb9b90e74746"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1be94d02ab5244f98337fb9b90e74746"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1be94d02ab5244f98337fb9b90e74746"}]}] Oct 08 20:57:58.068554 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-SecurityGroupsTestJSON-1416879597 Oct 08 20:57:58.068554 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 1be94d02ab5244f98337fb9b90e74746 Oct 08 20:57:58.068554 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1416879597 Oct 08 20:57:58.068554 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-SecurityGroupsTestJSON-1416879597-project Oct 08 20:57:58.068554 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 20:57:58.068554 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 20:57:58.068554 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 5ac1323815364df4a3a4d4dbbb9d70dd Oct 08 20:57:58.068554 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-SecurityGroupsTestJSON-1416879597-project Oct 08 20:57:58.068554 ncdv-master-1 devstack@n-api.service[140491]: method: Oct 08 20:57:58.068554 ncdv-master-1 devstack@n-api.service[140491]: exception: Security group ed69df86-546b-4b92-802e-2ad5cb3327d6 does not exist Oct 08 20:57:58.068554 ncdv-master-1 devstack@n-api.service[140491]: Neutron server returns request_ids: ['req-912d2bca-c6e3-44d1-be4b-b64ef943ba3b'] Oct 08 20:57:58.068554 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': 'ed69df86-546b-4b92-802e-2ad5cb3327d6'} Oct 08 20:57:58.068554 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:57:58.068554 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:57:58.068554 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 08 20:57:58.068554 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 08 20:57:58.068554 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 08 20:57:58.068554 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 08 20:57:58.068554 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 08 20:57:58.068554 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 08 20:57:58.068554 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 08 20:57:58.068554 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 08 20:57:58.068554 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 08 20:57:58.068554 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 08 20:57:58.068554 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 08 20:57:58.068554 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 08 20:57:58.068554 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 08 20:57:58.068554 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 08 20:57:58.068554 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 08 20:57:58.068554 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 08 20:57:58.068554 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 08 20:57:58.068554 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 08 20:57:58.068554 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 08 20:57:58.068554 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 08 20:57:58.068554 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 08 20:57:58.068554 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 08 20:57:58.068554 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 08 20:57:58.068554 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 08 20:57:58.068554 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group ed69df86-546b-4b92-802e-2ad5cb3327d6 does not exist Oct 08 20:57:58.073624 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-912d2bca-c6e3-44d1-be4b-b64ef943ba3b'] Oct 08 20:57:58.073624 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:57:58.073624 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:57:58.073624 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:57:58.073624 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:57:58.073624 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 08 20:57:58.073624 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 08 20:57:58.073624 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 08 20:57:58.073624 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 08 20:57:58.073624 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group ed69df86-546b-4b92-802e-2ad5cb3327d6 does not exist Oct 08 20:57:58.073624 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-912d2bca-c6e3-44d1-be4b-b64ef943ba3b'] Oct 08 20:57:58.073624 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:57:58.073624 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:57:58.073624 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:57:58.073624 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:57:58.073624 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:57:58.073624 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:57:58.073624 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:57:58.073624 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:57:58.073624 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 08 20:57:58.073624 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 08 20:57:58.073624 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:57:58.073624 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:57:58.073624 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 08 20:57:58.073624 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 08 20:57:58.073624 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group ed69df86-546b-4b92-802e-2ad5cb3327d6 does not exist Oct 08 20:57:58.073624 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-912d2bca-c6e3-44d1-be4b-b64ef943ba3b'] Oct 08 20:57:58.073624 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:57:58.073624 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:57:58.073624 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:57:58.073624 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:57:58.073624 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:57:58.073624 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:57:58.073624 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 20:57:58.073624 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 20:57:58.073624 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group ed69df86-546b-4b92-802e-2ad5cb3327d6 does not exist Oct 08 20:57:58.073624 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-912d2bca-c6e3-44d1-be4b-b64ef943ba3b'] Oct 08 20:57:58.073624 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:57:58.081473 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-45b079d4-b673-4547-accd-b81d196e02e3 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01ec70849cfa44368a91df8b3410aba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c97b3b7fa484f97bdf40224f7cc34d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:58.081865 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-fa5af593-5eff-4a6d-bf02-e50a54f5b870 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Returning 404 to user: Security group ed69df86-546b-4b92-802e-2ad5cb3327d6 does not exist Oct 08 20:57:58.081865 ncdv-master-1 devstack@n-api.service[140491]: Neutron server returns request_ids: ['req-912d2bca-c6e3-44d1-be4b-b64ef943ba3b'] {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:57:58.081865 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-fa5af593-5eff-4a6d-bf02-e50a54f5b870 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/ed69df86-546b-4b92-802e-2ad5cb3327d6" status: 404 len: 194 microversion: 2.1 time: 0.050146 Oct 08 20:57:58.081865 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 780/1630] 10.222.0.26 () {58 vars in 1272 bytes} [Sat Oct 8 20:57:58 2022] DELETE /compute/v2.1/os-security-groups/ed69df86-546b-4b92-802e-2ad5cb3327d6 => generated 194 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 20:57:58.082426 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-45b079d4-b673-4547-accd-b81d196e02e3 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] 10.222.0.26 "GET /compute/v2.1/servers/e5389d1b-b9f3-491a-898c-be611599d73a" status: 200 len: 1524 microversion: 2.1 time: 0.444359 Oct 08 20:57:58.087745 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-68c6cb6f-2d6c-4ed7-b790-94597ade2aca tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:58.088737 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-68c6cb6f-2d6c-4ed7-b790-94597ade2aca tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] [instance: 74bdac1c-9b70-46f7-b671-9752894d8980] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:58.097533 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 851/1631] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:57:57 2022] GET /compute/v2.1/servers/e5389d1b-b9f3-491a-898c-be611599d73a => generated 1524 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:57:58.103372 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-6862d8c7-d13f-4798-8455-b2c0178931c0 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Calling method '.version_select at 0x7f1a8c18aaf0>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:58.115410 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-68c6cb6f-2d6c-4ed7-b790-94597ade2aca tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:58.116324 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-68c6cb6f-2d6c-4ed7-b790-94597ade2aca tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:58.117020 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-68c6cb6f-2d6c-4ed7-b790-94597ade2aca tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:58.118935 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-68c6cb6f-2d6c-4ed7-b790-94597ade2aca tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:58.119700 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-68c6cb6f-2d6c-4ed7-b790-94597ade2aca tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:58.120365 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-68c6cb6f-2d6c-4ed7-b790-94597ade2aca tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:58.210867 ncdv-master-1 devstack@n-api.service[140492]: DEBUG neutronclient.v2_0.client [None req-6862d8c7-d13f-4798-8455-b2c0178931c0 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 1c40ec60-bc42-4b10-b1ba-cf2aeffdedae does not exist", "detail": ""}} {{(pid=140492) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 08 20:57:58.212135 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.network.security_group_api [None req-6862d8c7-d13f-4798-8455-b2c0178931c0 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Neutron security group 1c40ec60-bc42-4b10-b1ba-cf2aeffdedae not found {{(pid=140492) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 08 20:57:58.212798 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-6862d8c7-d13f-4798-8455-b2c0178931c0 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] HTTP exception thrown: Security group 1c40ec60-bc42-4b10-b1ba-cf2aeffdedae does not exist Oct 08 20:57:58.212798 ncdv-master-1 devstack@n-api.service[140492]: Neutron server returns request_ids: ['req-6dac2370-3c6b-4c41-9ede-ffbf97f74e0e'] Oct 08 20:57:58.217142 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-6862d8c7-d13f-4798-8455-b2c0178931c0 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Request method failure captured: Oct 08 20:57:58.217142 ncdv-master-1 devstack@n-api.service[140492]: request: DELETE /compute/v2.1/os-security-groups/1c40ec60-bc42-4b10-b1ba-cf2aeffdedae HTTP/1.1 Oct 08 20:57:58.217142 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 20:57:58.217142 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 20:57:58.217142 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 20:57:58.217142 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 20:57:58.217142 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 20:57:58.217142 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 20:57:58.217142 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 20:57:58.217142 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 20:57:58.217142 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQePneH9r8wc6qFHuuUfUiwj20bfGS3ReCozGKtofTKF_Bibv-TeYrNnDr89OwEeHkYGW8sVcZZerG8KfPs5hnyFWI91x_kPrSGVuiWEZNP0tyGW3_Xh9-fgTNjxnIFiLidb-EHCBZb3EEyAGFqy03GkbophorT5sYui55pNleytp26U Oct 08 20:57:58.217142 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 20:57:58.217142 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 20:57:58.217142 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 20:57:58.217142 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 20:57:58.217142 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 20:57:58.217142 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 20:57:58.217142 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 1be94d02ab5244f98337fb9b90e74746 Oct 08 20:57:58.217142 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-SecurityGroupsTestJSON-1416879597 Oct 08 20:57:58.217142 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 20:57:58.217142 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 20:57:58.217142 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1be94d02ab5244f98337fb9b90e74746"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1be94d02ab5244f98337fb9b90e74746"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1be94d02ab5244f98337fb9b90e74746"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1be94d02ab5244f98337fb9b90e74746"}]}] Oct 08 20:57:58.217142 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-SecurityGroupsTestJSON-1416879597 Oct 08 20:57:58.217142 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 1be94d02ab5244f98337fb9b90e74746 Oct 08 20:57:58.217142 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1416879597 Oct 08 20:57:58.217142 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-SecurityGroupsTestJSON-1416879597-project Oct 08 20:57:58.217142 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 20:57:58.217142 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 20:57:58.217142 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 5ac1323815364df4a3a4d4dbbb9d70dd Oct 08 20:57:58.217142 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-SecurityGroupsTestJSON-1416879597-project Oct 08 20:57:58.217142 ncdv-master-1 devstack@n-api.service[140492]: method: Oct 08 20:57:58.217142 ncdv-master-1 devstack@n-api.service[140492]: exception: Security group 1c40ec60-bc42-4b10-b1ba-cf2aeffdedae does not exist Oct 08 20:57:58.217142 ncdv-master-1 devstack@n-api.service[140492]: Neutron server returns request_ids: ['req-6dac2370-3c6b-4c41-9ede-ffbf97f74e0e'] Oct 08 20:57:58.217142 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': '1c40ec60-bc42-4b10-b1ba-cf2aeffdedae'} Oct 08 20:57:58.217142 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:57:58.217142 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:57:58.217142 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 08 20:57:58.217142 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 08 20:57:58.217142 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 08 20:57:58.217142 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 08 20:57:58.217142 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 08 20:57:58.217142 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 08 20:57:58.217142 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 08 20:57:58.217142 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 08 20:57:58.217142 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 08 20:57:58.217142 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 08 20:57:58.217142 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 08 20:57:58.217142 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 08 20:57:58.217142 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 08 20:57:58.217142 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 08 20:57:58.217142 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 08 20:57:58.217142 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 08 20:57:58.217142 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 08 20:57:58.217142 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 08 20:57:58.217142 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 08 20:57:58.217142 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 08 20:57:58.217142 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 08 20:57:58.217142 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 08 20:57:58.217142 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 08 20:57:58.217142 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 08 20:57:58.217142 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 1c40ec60-bc42-4b10-b1ba-cf2aeffdedae does not exist Oct 08 20:57:58.222808 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6dac2370-3c6b-4c41-9ede-ffbf97f74e0e'] Oct 08 20:57:58.222808 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:57:58.222808 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:57:58.222808 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:57:58.222808 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:57:58.222808 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 08 20:57:58.222808 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 08 20:57:58.222808 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 08 20:57:58.222808 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 08 20:57:58.222808 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 1c40ec60-bc42-4b10-b1ba-cf2aeffdedae does not exist Oct 08 20:57:58.222808 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6dac2370-3c6b-4c41-9ede-ffbf97f74e0e'] Oct 08 20:57:58.222808 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:57:58.222808 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:57:58.222808 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:57:58.222808 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:57:58.222808 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:57:58.222808 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:57:58.222808 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:57:58.222808 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:57:58.222808 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 08 20:57:58.222808 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 08 20:57:58.222808 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:57:58.222808 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:57:58.222808 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 08 20:57:58.222808 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 08 20:57:58.222808 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 1c40ec60-bc42-4b10-b1ba-cf2aeffdedae does not exist Oct 08 20:57:58.222808 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6dac2370-3c6b-4c41-9ede-ffbf97f74e0e'] Oct 08 20:57:58.222808 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:57:58.222808 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:57:58.222808 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:57:58.222808 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:57:58.222808 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:57:58.222808 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:57:58.222808 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 20:57:58.222808 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 20:57:58.222808 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 1c40ec60-bc42-4b10-b1ba-cf2aeffdedae does not exist Oct 08 20:57:58.222808 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6dac2370-3c6b-4c41-9ede-ffbf97f74e0e'] Oct 08 20:57:58.222808 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:57:58.222808 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-6862d8c7-d13f-4798-8455-b2c0178931c0 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Returning 404 to user: Security group 1c40ec60-bc42-4b10-b1ba-cf2aeffdedae does not exist Oct 08 20:57:58.222808 ncdv-master-1 devstack@n-api.service[140492]: Neutron server returns request_ids: ['req-6dac2370-3c6b-4c41-9ede-ffbf97f74e0e'] {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:57:58.222808 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-6862d8c7-d13f-4798-8455-b2c0178931c0 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/1c40ec60-bc42-4b10-b1ba-cf2aeffdedae" status: 404 len: 194 microversion: 2.1 time: 0.120059 Oct 08 20:57:58.222808 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 852/1632] 10.222.0.26 () {58 vars in 1272 bytes} [Sat Oct 8 20:57:58 2022] DELETE /compute/v2.1/os-security-groups/1c40ec60-bc42-4b10-b1ba-cf2aeffdedae => generated 194 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 20:57:58.232603 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e766fd63-cd8e-4619-bdec-bccb6e7efb1c tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Calling method '.version_select at 0x7f1a91334700>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:58.325028 ncdv-master-1 devstack@n-api.service[140492]: DEBUG neutronclient.v2_0.client [None req-e766fd63-cd8e-4619-bdec-bccb6e7efb1c tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group f3eac078-74a5-4995-a964-efc4f5793217 does not exist", "detail": ""}} {{(pid=140492) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 08 20:57:58.325910 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.network.security_group_api [None req-e766fd63-cd8e-4619-bdec-bccb6e7efb1c tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Neutron security group f3eac078-74a5-4995-a964-efc4f5793217 not found {{(pid=140492) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 08 20:57:58.326655 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-e766fd63-cd8e-4619-bdec-bccb6e7efb1c tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] HTTP exception thrown: Security group f3eac078-74a5-4995-a964-efc4f5793217 does not exist Oct 08 20:57:58.326655 ncdv-master-1 devstack@n-api.service[140492]: Neutron server returns request_ids: ['req-e7c0bb25-e144-4daa-be4c-2b4f0f187064'] Oct 08 20:57:58.328945 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e766fd63-cd8e-4619-bdec-bccb6e7efb1c tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Request method failure captured: Oct 08 20:57:58.328945 ncdv-master-1 devstack@n-api.service[140492]: request: DELETE /compute/v2.1/os-security-groups/f3eac078-74a5-4995-a964-efc4f5793217 HTTP/1.1 Oct 08 20:57:58.328945 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 20:57:58.328945 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 20:57:58.328945 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 20:57:58.328945 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 20:57:58.328945 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 20:57:58.328945 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 20:57:58.328945 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 20:57:58.328945 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 20:57:58.328945 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQePneH9r8wc6qFHuuUfUiwj20bfGS3ReCozGKtofTKF_Bibv-TeYrNnDr89OwEeHkYGW8sVcZZerG8KfPs5hnyFWI91x_kPrSGVuiWEZNP0tyGW3_Xh9-fgTNjxnIFiLidb-EHCBZb3EEyAGFqy03GkbophorT5sYui55pNleytp26U Oct 08 20:57:58.328945 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 20:57:58.328945 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 20:57:58.328945 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 20:57:58.328945 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 20:57:58.328945 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 20:57:58.328945 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 20:57:58.328945 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 1be94d02ab5244f98337fb9b90e74746 Oct 08 20:57:58.328945 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-SecurityGroupsTestJSON-1416879597 Oct 08 20:57:58.328945 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 20:57:58.328945 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 20:57:58.328945 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1be94d02ab5244f98337fb9b90e74746"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1be94d02ab5244f98337fb9b90e74746"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1be94d02ab5244f98337fb9b90e74746"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1be94d02ab5244f98337fb9b90e74746"}]}] Oct 08 20:57:58.328945 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-SecurityGroupsTestJSON-1416879597 Oct 08 20:57:58.328945 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 1be94d02ab5244f98337fb9b90e74746 Oct 08 20:57:58.328945 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1416879597 Oct 08 20:57:58.328945 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-SecurityGroupsTestJSON-1416879597-project Oct 08 20:57:58.328945 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 20:57:58.328945 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 20:57:58.328945 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 5ac1323815364df4a3a4d4dbbb9d70dd Oct 08 20:57:58.328945 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-SecurityGroupsTestJSON-1416879597-project Oct 08 20:57:58.328945 ncdv-master-1 devstack@n-api.service[140492]: method: Oct 08 20:57:58.328945 ncdv-master-1 devstack@n-api.service[140492]: exception: Security group f3eac078-74a5-4995-a964-efc4f5793217 does not exist Oct 08 20:57:58.328945 ncdv-master-1 devstack@n-api.service[140492]: Neutron server returns request_ids: ['req-e7c0bb25-e144-4daa-be4c-2b4f0f187064'] Oct 08 20:57:58.328945 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': 'f3eac078-74a5-4995-a964-efc4f5793217'} Oct 08 20:57:58.328945 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:57:58.328945 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:57:58.328945 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 08 20:57:58.328945 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 08 20:57:58.328945 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 08 20:57:58.328945 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 08 20:57:58.328945 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 08 20:57:58.328945 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 08 20:57:58.328945 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 08 20:57:58.328945 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 08 20:57:58.328945 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 08 20:57:58.328945 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 08 20:57:58.328945 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 08 20:57:58.328945 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 08 20:57:58.328945 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 08 20:57:58.328945 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 08 20:57:58.328945 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 08 20:57:58.328945 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 08 20:57:58.328945 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 08 20:57:58.328945 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 08 20:57:58.328945 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 08 20:57:58.328945 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 08 20:57:58.328945 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 08 20:57:58.328945 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 08 20:57:58.328945 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 08 20:57:58.328945 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 08 20:57:58.328945 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group f3eac078-74a5-4995-a964-efc4f5793217 does not exist Oct 08 20:57:58.334331 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e7c0bb25-e144-4daa-be4c-2b4f0f187064'] Oct 08 20:57:58.334331 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:57:58.334331 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:57:58.334331 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:57:58.334331 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:57:58.334331 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 08 20:57:58.334331 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 08 20:57:58.334331 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 08 20:57:58.334331 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 08 20:57:58.334331 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group f3eac078-74a5-4995-a964-efc4f5793217 does not exist Oct 08 20:57:58.334331 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e7c0bb25-e144-4daa-be4c-2b4f0f187064'] Oct 08 20:57:58.334331 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:57:58.334331 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:57:58.334331 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:57:58.334331 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:57:58.334331 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:57:58.334331 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:57:58.334331 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:57:58.334331 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:57:58.334331 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 08 20:57:58.334331 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 08 20:57:58.334331 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:57:58.334331 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:57:58.334331 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 08 20:57:58.334331 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 08 20:57:58.334331 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group f3eac078-74a5-4995-a964-efc4f5793217 does not exist Oct 08 20:57:58.334331 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e7c0bb25-e144-4daa-be4c-2b4f0f187064'] Oct 08 20:57:58.334331 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:57:58.334331 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:57:58.334331 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:57:58.334331 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:57:58.334331 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:57:58.334331 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:57:58.334331 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 20:57:58.334331 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 20:57:58.334331 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group f3eac078-74a5-4995-a964-efc4f5793217 does not exist Oct 08 20:57:58.334331 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e7c0bb25-e144-4daa-be4c-2b4f0f187064'] Oct 08 20:57:58.334331 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:57:58.339503 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e766fd63-cd8e-4619-bdec-bccb6e7efb1c tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Returning 404 to user: Security group f3eac078-74a5-4995-a964-efc4f5793217 does not exist Oct 08 20:57:58.339503 ncdv-master-1 devstack@n-api.service[140492]: Neutron server returns request_ids: ['req-e7c0bb25-e144-4daa-be4c-2b4f0f187064'] {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:57:58.342410 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-e766fd63-cd8e-4619-bdec-bccb6e7efb1c tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/f3eac078-74a5-4995-a964-efc4f5793217" status: 404 len: 194 microversion: 2.1 time: 0.118176 Oct 08 20:57:58.343076 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 853/1633] 10.222.0.26 () {58 vars in 1272 bytes} [Sat Oct 8 20:57:58 2022] DELETE /compute/v2.1/os-security-groups/f3eac078-74a5-4995-a964-efc4f5793217 => generated 194 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 08 20:57:58.355201 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-bbac8076-b80e-4000-a585-99c531bdf438 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Calling method '.version_select at 0x7f1a8c0faca0>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:58.404433 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-68c6cb6f-2d6c-4ed7-b790-94597ade2aca tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:58.415458 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-68c6cb6f-2d6c-4ed7-b790-94597ade2aca tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:58.418127 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-68c6cb6f-2d6c-4ed7-b790-94597ade2aca tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:58.421572 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-68c6cb6f-2d6c-4ed7-b790-94597ade2aca tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] 10.222.0.26 "GET /compute/v2.1/servers/74bdac1c-9b70-46f7-b671-9752894d8980" status: 200 len: 1488 microversion: 2.25 time: 0.340522 Oct 08 20:57:58.422758 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 781/1634] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:57:58 2022] GET /compute/v2.1/servers/74bdac1c-9b70-46f7-b671-9752894d8980 => generated 1488 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:57:58.428170 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-3630fb88-e9da-4660-ab7f-dd043cf30d06 req-fc2e4b2c-fdf1-4151-8332-e723cc7b6d72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e338d559-3f7c-4cc8-95c6-face79e11ca2", "name": "network-vif-deleted", "tag": "c9d2434a-d900-4b35-afb9-1bca1da86155"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:57:58.439426 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-3630fb88-e9da-4660-ab7f-dd043cf30d06 req-fc2e4b2c-fdf1-4151-8332-e723cc7b6d72 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:58.439426 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-3630fb88-e9da-4660-ab7f-dd043cf30d06 req-fc2e4b2c-fdf1-4151-8332-e723cc7b6d72 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:58.439769 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-3630fb88-e9da-4660-ab7f-dd043cf30d06 req-fc2e4b2c-fdf1-4151-8332-e723cc7b6d72 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:58.451704 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-3630fb88-e9da-4660-ab7f-dd043cf30d06 req-fc2e4b2c-fdf1-4151-8332-e723cc7b6d72 service nova] Creating event network-vif-deleted:c9d2434a-d900-4b35-afb9-1bca1da86155 for instance e338d559-3f7c-4cc8-95c6-face79e11ca2 on nch1-master-1 Oct 08 20:57:58.458865 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-3630fb88-e9da-4660-ab7f-dd043cf30d06 req-fc2e4b2c-fdf1-4151-8332-e723cc7b6d72 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034071 Oct 08 20:57:58.460567 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 782/1635] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:57:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:57:58.462486 ncdv-master-1 devstack@n-api.service[140492]: DEBUG neutronclient.v2_0.client [None req-bbac8076-b80e-4000-a585-99c531bdf438 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group edb6bc31-d59b-459a-827c-f8f8818ce070 does not exist", "detail": ""}} {{(pid=140492) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 08 20:57:58.463808 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.network.security_group_api [None req-bbac8076-b80e-4000-a585-99c531bdf438 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Neutron security group edb6bc31-d59b-459a-827c-f8f8818ce070 not found {{(pid=140492) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 08 20:57:58.464407 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-bbac8076-b80e-4000-a585-99c531bdf438 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] HTTP exception thrown: Security group edb6bc31-d59b-459a-827c-f8f8818ce070 does not exist Oct 08 20:57:58.464407 ncdv-master-1 devstack@n-api.service[140492]: Neutron server returns request_ids: ['req-e39090fd-d25e-4d00-8c18-04524b41c650'] Oct 08 20:57:58.466775 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-bbac8076-b80e-4000-a585-99c531bdf438 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Request method failure captured: Oct 08 20:57:58.466775 ncdv-master-1 devstack@n-api.service[140492]: request: DELETE /compute/v2.1/os-security-groups/edb6bc31-d59b-459a-827c-f8f8818ce070 HTTP/1.1 Oct 08 20:57:58.466775 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 20:57:58.466775 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 20:57:58.466775 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 20:57:58.466775 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 20:57:58.466775 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 20:57:58.466775 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 20:57:58.466775 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 20:57:58.466775 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 20:57:58.466775 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQePneH9r8wc6qFHuuUfUiwj20bfGS3ReCozGKtofTKF_Bibv-TeYrNnDr89OwEeHkYGW8sVcZZerG8KfPs5hnyFWI91x_kPrSGVuiWEZNP0tyGW3_Xh9-fgTNjxnIFiLidb-EHCBZb3EEyAGFqy03GkbophorT5sYui55pNleytp26U Oct 08 20:57:58.466775 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 20:57:58.466775 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 20:57:58.466775 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 20:57:58.466775 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 20:57:58.466775 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 20:57:58.466775 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 20:57:58.466775 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 1be94d02ab5244f98337fb9b90e74746 Oct 08 20:57:58.466775 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-SecurityGroupsTestJSON-1416879597 Oct 08 20:57:58.466775 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 20:57:58.466775 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 20:57:58.466775 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1be94d02ab5244f98337fb9b90e74746"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1be94d02ab5244f98337fb9b90e74746"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1be94d02ab5244f98337fb9b90e74746"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1be94d02ab5244f98337fb9b90e74746"}]}] Oct 08 20:57:58.466775 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-SecurityGroupsTestJSON-1416879597 Oct 08 20:57:58.466775 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 1be94d02ab5244f98337fb9b90e74746 Oct 08 20:57:58.466775 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1416879597 Oct 08 20:57:58.466775 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-SecurityGroupsTestJSON-1416879597-project Oct 08 20:57:58.466775 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 20:57:58.466775 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 20:57:58.466775 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 5ac1323815364df4a3a4d4dbbb9d70dd Oct 08 20:57:58.466775 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-SecurityGroupsTestJSON-1416879597-project Oct 08 20:57:58.466775 ncdv-master-1 devstack@n-api.service[140492]: method: Oct 08 20:57:58.466775 ncdv-master-1 devstack@n-api.service[140492]: exception: Security group edb6bc31-d59b-459a-827c-f8f8818ce070 does not exist Oct 08 20:57:58.466775 ncdv-master-1 devstack@n-api.service[140492]: Neutron server returns request_ids: ['req-e39090fd-d25e-4d00-8c18-04524b41c650'] Oct 08 20:57:58.466775 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': 'edb6bc31-d59b-459a-827c-f8f8818ce070'} Oct 08 20:57:58.466775 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:57:58.466775 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:57:58.466775 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 08 20:57:58.466775 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 08 20:57:58.466775 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 08 20:57:58.466775 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 08 20:57:58.466775 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 08 20:57:58.466775 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 08 20:57:58.466775 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 08 20:57:58.466775 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 08 20:57:58.466775 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 08 20:57:58.466775 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 08 20:57:58.466775 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 08 20:57:58.466775 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 08 20:57:58.466775 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 08 20:57:58.466775 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 08 20:57:58.466775 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 08 20:57:58.466775 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 08 20:57:58.466775 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 08 20:57:58.466775 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 08 20:57:58.466775 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 08 20:57:58.466775 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 08 20:57:58.466775 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 08 20:57:58.466775 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 08 20:57:58.466775 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 08 20:57:58.466775 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 08 20:57:58.466775 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group edb6bc31-d59b-459a-827c-f8f8818ce070 does not exist Oct 08 20:57:58.471044 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e39090fd-d25e-4d00-8c18-04524b41c650'] Oct 08 20:57:58.471044 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:57:58.471044 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:57:58.471044 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:57:58.471044 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:57:58.471044 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 08 20:57:58.471044 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 08 20:57:58.471044 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 08 20:57:58.471044 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 08 20:57:58.471044 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group edb6bc31-d59b-459a-827c-f8f8818ce070 does not exist Oct 08 20:57:58.471044 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e39090fd-d25e-4d00-8c18-04524b41c650'] Oct 08 20:57:58.471044 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:57:58.471044 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:57:58.471044 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:57:58.471044 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:57:58.471044 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:57:58.471044 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:57:58.471044 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:57:58.471044 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:57:58.471044 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 08 20:57:58.471044 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 08 20:57:58.471044 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:57:58.471044 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:57:58.471044 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 08 20:57:58.471044 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 08 20:57:58.471044 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group edb6bc31-d59b-459a-827c-f8f8818ce070 does not exist Oct 08 20:57:58.471044 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e39090fd-d25e-4d00-8c18-04524b41c650'] Oct 08 20:57:58.471044 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:57:58.471044 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:57:58.471044 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:57:58.471044 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:57:58.471044 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:57:58.471044 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:57:58.471044 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 20:57:58.471044 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 20:57:58.471044 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group edb6bc31-d59b-459a-827c-f8f8818ce070 does not exist Oct 08 20:57:58.471044 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e39090fd-d25e-4d00-8c18-04524b41c650'] Oct 08 20:57:58.471044 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:57:58.471044 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-bbac8076-b80e-4000-a585-99c531bdf438 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Returning 404 to user: Security group edb6bc31-d59b-459a-827c-f8f8818ce070 does not exist Oct 08 20:57:58.471044 ncdv-master-1 devstack@n-api.service[140492]: Neutron server returns request_ids: ['req-e39090fd-d25e-4d00-8c18-04524b41c650'] {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:57:58.471044 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-bbac8076-b80e-4000-a585-99c531bdf438 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/edb6bc31-d59b-459a-827c-f8f8818ce070" status: 404 len: 194 microversion: 2.1 time: 0.118990 Oct 08 20:57:58.471044 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 854/1636] 10.222.0.26 () {58 vars in 1272 bytes} [Sat Oct 8 20:57:58 2022] DELETE /compute/v2.1/os-security-groups/edb6bc31-d59b-459a-827c-f8f8818ce070 => generated 194 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 20:57:58.484262 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-8dcec115-24ab-47f7-b0b6-a1334cc984c9 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Calling method '.version_select at 0x7f1a8ca32670>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:58.535651 ncdv-master-1 devstack@n-api.service[140491]: DEBUG neutronclient.v2_0.client [None req-8dcec115-24ab-47f7-b0b6-a1334cc984c9 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 6e6daaa3-cbc3-4322-ab19-f19963e4cc06 does not exist", "detail": ""}} {{(pid=140491) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 08 20:57:58.537383 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.network.security_group_api [None req-8dcec115-24ab-47f7-b0b6-a1334cc984c9 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Neutron security group 6e6daaa3-cbc3-4322-ab19-f19963e4cc06 not found {{(pid=140491) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 08 20:57:58.538872 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-8dcec115-24ab-47f7-b0b6-a1334cc984c9 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] HTTP exception thrown: Security group 6e6daaa3-cbc3-4322-ab19-f19963e4cc06 does not exist Oct 08 20:57:58.538872 ncdv-master-1 devstack@n-api.service[140491]: Neutron server returns request_ids: ['req-ece6ce82-efab-4a5c-b7fa-de43597fdf39'] Oct 08 20:57:58.543806 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-8dcec115-24ab-47f7-b0b6-a1334cc984c9 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Request method failure captured: Oct 08 20:57:58.543806 ncdv-master-1 devstack@n-api.service[140491]: request: DELETE /compute/v2.1/os-security-groups/6e6daaa3-cbc3-4322-ab19-f19963e4cc06 HTTP/1.1 Oct 08 20:57:58.543806 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 20:57:58.543806 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 20:57:58.543806 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 20:57:58.543806 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 20:57:58.543806 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 20:57:58.543806 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 20:57:58.543806 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 20:57:58.543806 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 20:57:58.543806 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQePneH9r8wc6qFHuuUfUiwj20bfGS3ReCozGKtofTKF_Bibv-TeYrNnDr89OwEeHkYGW8sVcZZerG8KfPs5hnyFWI91x_kPrSGVuiWEZNP0tyGW3_Xh9-fgTNjxnIFiLidb-EHCBZb3EEyAGFqy03GkbophorT5sYui55pNleytp26U Oct 08 20:57:58.543806 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 20:57:58.543806 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 20:57:58.543806 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 20:57:58.543806 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 20:57:58.543806 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 20:57:58.543806 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 20:57:58.543806 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 1be94d02ab5244f98337fb9b90e74746 Oct 08 20:57:58.543806 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-SecurityGroupsTestJSON-1416879597 Oct 08 20:57:58.543806 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 20:57:58.543806 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 20:57:58.543806 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1be94d02ab5244f98337fb9b90e74746"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1be94d02ab5244f98337fb9b90e74746"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1be94d02ab5244f98337fb9b90e74746"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1be94d02ab5244f98337fb9b90e74746"}]}] Oct 08 20:57:58.543806 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-SecurityGroupsTestJSON-1416879597 Oct 08 20:57:58.543806 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 1be94d02ab5244f98337fb9b90e74746 Oct 08 20:57:58.543806 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1416879597 Oct 08 20:57:58.543806 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-SecurityGroupsTestJSON-1416879597-project Oct 08 20:57:58.543806 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 20:57:58.543806 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 20:57:58.543806 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 5ac1323815364df4a3a4d4dbbb9d70dd Oct 08 20:57:58.543806 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-SecurityGroupsTestJSON-1416879597-project Oct 08 20:57:58.543806 ncdv-master-1 devstack@n-api.service[140491]: method: Oct 08 20:57:58.543806 ncdv-master-1 devstack@n-api.service[140491]: exception: Security group 6e6daaa3-cbc3-4322-ab19-f19963e4cc06 does not exist Oct 08 20:57:58.543806 ncdv-master-1 devstack@n-api.service[140491]: Neutron server returns request_ids: ['req-ece6ce82-efab-4a5c-b7fa-de43597fdf39'] Oct 08 20:57:58.543806 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': '6e6daaa3-cbc3-4322-ab19-f19963e4cc06'} Oct 08 20:57:58.543806 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:57:58.543806 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:57:58.543806 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 08 20:57:58.543806 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 08 20:57:58.543806 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 08 20:57:58.543806 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 08 20:57:58.543806 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 08 20:57:58.543806 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 08 20:57:58.543806 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 08 20:57:58.543806 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 08 20:57:58.543806 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 08 20:57:58.543806 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 08 20:57:58.543806 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 08 20:57:58.543806 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 08 20:57:58.543806 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 08 20:57:58.543806 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 08 20:57:58.543806 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 08 20:57:58.543806 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 08 20:57:58.543806 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 08 20:57:58.543806 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 08 20:57:58.543806 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 08 20:57:58.543806 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 08 20:57:58.543806 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 08 20:57:58.543806 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 08 20:57:58.543806 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 08 20:57:58.543806 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 08 20:57:58.543806 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 6e6daaa3-cbc3-4322-ab19-f19963e4cc06 does not exist Oct 08 20:57:58.556225 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ece6ce82-efab-4a5c-b7fa-de43597fdf39'] Oct 08 20:57:58.556225 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:57:58.556225 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:57:58.556225 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:57:58.556225 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:57:58.556225 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 08 20:57:58.556225 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 08 20:57:58.556225 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 08 20:57:58.556225 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 08 20:57:58.556225 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 6e6daaa3-cbc3-4322-ab19-f19963e4cc06 does not exist Oct 08 20:57:58.556225 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ece6ce82-efab-4a5c-b7fa-de43597fdf39'] Oct 08 20:57:58.556225 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:57:58.556225 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:57:58.556225 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:57:58.556225 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:57:58.556225 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:57:58.556225 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:57:58.556225 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:57:58.556225 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:57:58.556225 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 08 20:57:58.556225 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 08 20:57:58.556225 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:57:58.556225 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:57:58.556225 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 08 20:57:58.556225 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 08 20:57:58.556225 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 6e6daaa3-cbc3-4322-ab19-f19963e4cc06 does not exist Oct 08 20:57:58.556225 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ece6ce82-efab-4a5c-b7fa-de43597fdf39'] Oct 08 20:57:58.556225 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:57:58.556225 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:57:58.556225 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:57:58.556225 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:57:58.556225 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:57:58.556225 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:57:58.556225 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 20:57:58.556225 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 20:57:58.556225 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 6e6daaa3-cbc3-4322-ab19-f19963e4cc06 does not exist Oct 08 20:57:58.556225 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ece6ce82-efab-4a5c-b7fa-de43597fdf39'] Oct 08 20:57:58.556225 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:57:58.564434 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-8dcec115-24ab-47f7-b0b6-a1334cc984c9 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Returning 404 to user: Security group 6e6daaa3-cbc3-4322-ab19-f19963e4cc06 does not exist Oct 08 20:57:58.564434 ncdv-master-1 devstack@n-api.service[140491]: Neutron server returns request_ids: ['req-ece6ce82-efab-4a5c-b7fa-de43597fdf39'] {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:57:58.564434 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-8dcec115-24ab-47f7-b0b6-a1334cc984c9 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/6e6daaa3-cbc3-4322-ab19-f19963e4cc06" status: 404 len: 194 microversion: 2.1 time: 0.082582 Oct 08 20:57:58.566056 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 783/1637] 10.222.0.26 () {58 vars in 1272 bytes} [Sat Oct 8 20:57:58 2022] DELETE /compute/v2.1/os-security-groups/6e6daaa3-cbc3-4322-ab19-f19963e4cc06 => generated 194 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 20:57:58.571097 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-afb1c65b-2374-47d6-b734-f99c4ba1bf52 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:58.571859 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-afb1c65b-2374-47d6-b734-f99c4ba1bf52 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] [instance: b5452da7-7cb6-493b-a5d1-4c60ed1e342c] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:58.580957 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-afb1c65b-2374-47d6-b734-f99c4ba1bf52 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:58.581779 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-afb1c65b-2374-47d6-b734-f99c4ba1bf52 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:58.582435 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-afb1c65b-2374-47d6-b734-f99c4ba1bf52 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:58.583741 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-afb1c65b-2374-47d6-b734-f99c4ba1bf52 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:58.584242 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-afb1c65b-2374-47d6-b734-f99c4ba1bf52 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:58.584913 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-afb1c65b-2374-47d6-b734-f99c4ba1bf52 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:58.616503 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-afb1c65b-2374-47d6-b734-f99c4ba1bf52 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] [instance: b5452da7-7cb6-493b-a5d1-4c60ed1e342c] Going to try to terminate instance {{(pid=140492) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 20:57:58.664970 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-854ab96b-8eb4-4839-b201-023218f489c1 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:58.666108 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-854ab96b-8eb4-4839-b201-023218f489c1 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] [instance: 19327d3e-de51-432b-b594-cb9a1bfe2f49] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:58.673611 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:57:58.685095 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-854ab96b-8eb4-4839-b201-023218f489c1 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:58.685629 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-854ab96b-8eb4-4839-b201-023218f489c1 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:58.686146 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-854ab96b-8eb4-4839-b201-023218f489c1 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:58.686937 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-854ab96b-8eb4-4839-b201-023218f489c1 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:58.693709 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-854ab96b-8eb4-4839-b201-023218f489c1 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:58.694551 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-854ab96b-8eb4-4839-b201-023218f489c1 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:58.717350 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-afb1c65b-2374-47d6-b734-f99c4ba1bf52 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] 10.222.0.26 "DELETE /compute/v2.1/servers/b5452da7-7cb6-493b-a5d1-4c60ed1e342c" status: 204 len: 0 microversion: 2.1 time: 0.149976 Oct 08 20:57:58.719362 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 855/1638] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 20:57:58 2022] DELETE /compute/v2.1/servers/b5452da7-7cb6-493b-a5d1-4c60ed1e342c => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 20:57:58.735659 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-c0db2500-69ae-42d1-9953-43c234bf8b6b tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:58.736785 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-c0db2500-69ae-42d1-9953-43c234bf8b6b tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] [instance: 8ceaf7df-4795-4969-be16-a2a1b94a3fa6] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:58.747078 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c0db2500-69ae-42d1-9953-43c234bf8b6b tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:58.748052 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c0db2500-69ae-42d1-9953-43c234bf8b6b tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:58.748793 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c0db2500-69ae-42d1-9953-43c234bf8b6b tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:58.752209 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c0db2500-69ae-42d1-9953-43c234bf8b6b tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:58.753211 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c0db2500-69ae-42d1-9953-43c234bf8b6b tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:58.754162 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c0db2500-69ae-42d1-9953-43c234bf8b6b tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:58.903410 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-c0db2500-69ae-42d1-9953-43c234bf8b6b tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ddc3cd3c374bacbe5bf5e0877380e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8472b054404c46a99b81aba34d6b9f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:58.923318 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-c0db2500-69ae-42d1-9953-43c234bf8b6b tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] 10.222.0.26 "GET /compute/v2.1/servers/8ceaf7df-4795-4969-be16-a2a1b94a3fa6" status: 200 len: 1275 microversion: 2.1 time: 0.200158 Oct 08 20:57:58.925041 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 856/1639] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:57:58 2022] GET /compute/v2.1/servers/8ceaf7df-4795-4969-be16-a2a1b94a3fa6 => generated 1275 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:57:58.938887 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-2c36e583-df54-4a88-a5d8-ee72ddad54b3 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:58.939769 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-2c36e583-df54-4a88-a5d8-ee72ddad54b3 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] [instance: b5452da7-7cb6-493b-a5d1-4c60ed1e342c] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:58.950381 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2c36e583-df54-4a88-a5d8-ee72ddad54b3 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:58.951335 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2c36e583-df54-4a88-a5d8-ee72ddad54b3 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:58.952082 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2c36e583-df54-4a88-a5d8-ee72ddad54b3 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:58.953661 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2c36e583-df54-4a88-a5d8-ee72ddad54b3 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:58.954469 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2c36e583-df54-4a88-a5d8-ee72ddad54b3 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:58.955083 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2c36e583-df54-4a88-a5d8-ee72ddad54b3 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:58.994721 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-854ab96b-8eb4-4839-b201-023218f489c1 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322606d4cb0f45d3ac2eceab4999d45b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24a29bd6efb40609e31fbb6dba839e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:59.002756 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-854ab96b-8eb4-4839-b201-023218f489c1 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] 10.222.0.26 "GET /compute/v2.1/servers/19327d3e-de51-432b-b594-cb9a1bfe2f49" status: 200 len: 1467 microversion: 2.1 time: 0.348086 Oct 08 20:57:59.021914 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 784/1640] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:57:58 2022] GET /compute/v2.1/servers/19327d3e-de51-432b-b594-cb9a1bfe2f49 => generated 1467 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:57:59.030671 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-a5f05712-b2d3-4827-a7ed-cde78961dff6 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:59.031293 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-a5f05712-b2d3-4827-a7ed-cde78961dff6 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] [instance: e338d559-3f7c-4cc8-95c6-face79e11ca2] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:59.037951 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a5f05712-b2d3-4827-a7ed-cde78961dff6 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:59.038728 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a5f05712-b2d3-4827-a7ed-cde78961dff6 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:59.039200 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a5f05712-b2d3-4827-a7ed-cde78961dff6 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:59.040173 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a5f05712-b2d3-4827-a7ed-cde78961dff6 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:59.040702 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a5f05712-b2d3-4827-a7ed-cde78961dff6 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:59.041407 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a5f05712-b2d3-4827-a7ed-cde78961dff6 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:59.056453 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-a5f05712-b2d3-4827-a7ed-cde78961dff6 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] HTTP exception thrown: Instance e338d559-3f7c-4cc8-95c6-face79e11ca2 could not be found. Oct 08 20:57:59.058505 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-a5f05712-b2d3-4827-a7ed-cde78961dff6 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Request method failure captured: Oct 08 20:57:59.058505 ncdv-master-1 devstack@n-api.service[140491]: request: GET /compute/v2.1/servers/e338d559-3f7c-4cc8-95c6-face79e11ca2 HTTP/1.1 Oct 08 20:57:59.058505 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 20:57:59.058505 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 20:57:59.058505 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 20:57:59.058505 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 20:57:59.058505 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 20:57:59.058505 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 20:57:59.058505 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 20:57:59.058505 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 20:57:59.058505 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeMXC9JeN9Mlk5jzCgs-_cPtRtdIPAXhmbadFJaShbL5RJJyNFLD60Grhe8NzKLmyv9j_DFRSKoTNMw2TlfcMFQd60Gx2njCIaEqOyEM-mQSbVpxdhzzTuSuygraSUzGQKPLwQlBymj0axQFAl4TsB_9ApQq2i8hMTqwWvlfGcMSM0g Oct 08 20:57:59.058505 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 20:57:59.058505 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 20:57:59.058505 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 20:57:59.058505 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 20:57:59.058505 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 20:57:59.058505 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 20:57:59.058505 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 6ecc2dd2407b4819874bed09cb27959a Oct 08 20:57:59.058505 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-LiveMigrationTest-739175934 Oct 08 20:57:59.058505 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 20:57:59.058505 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 20:57:59.058505 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6ecc2dd2407b4819874bed09cb27959a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6ecc2dd2407b4819874bed09cb27959a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6ecc2dd2407b4819874bed09cb27959a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6ecc2dd2407b4819874bed09cb27959a"}]}] Oct 08 20:57:59.058505 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-LiveMigrationTest-739175934 Oct 08 20:57:59.058505 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 6ecc2dd2407b4819874bed09cb27959a Oct 08 20:57:59.058505 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-LiveMigrationTest-739175934 Oct 08 20:57:59.058505 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-LiveMigrationTest-739175934-project Oct 08 20:57:59.058505 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 20:57:59.058505 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 20:57:59.058505 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 474ca64d1b1d4e30916b517645aba882 Oct 08 20:57:59.058505 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-LiveMigrationTest-739175934-project Oct 08 20:57:59.058505 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 20:57:59.058505 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance e338d559-3f7c-4cc8-95c6-face79e11ca2 could not be found. Oct 08 20:57:59.058505 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': 'e338d559-3f7c-4cc8-95c6-face79e11ca2'} Oct 08 20:57:59.058505 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:57:59.058505 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:57:59.058505 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 20:57:59.058505 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 20:57:59.058505 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 20:57:59.058505 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 20:57:59.058505 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 20:57:59.058505 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 20:57:59.058505 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 20:57:59.058505 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 20:57:59.058505 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e338d559-3f7c-4cc8-95c6-face79e11ca2 could not be found. Oct 08 20:57:59.058505 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:57:59.058505 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:57:59.058505 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:57:59.058505 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:57:59.058505 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:57:59.058505 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:57:59.058505 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:57:59.058505 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:57:59.058505 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:57:59.058505 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:57:59.058505 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 20:57:59.058505 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 20:57:59.058505 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 20:57:59.058505 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 20:57:59.058505 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 20:57:59.058505 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 20:57:59.058505 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e338d559-3f7c-4cc8-95c6-face79e11ca2 could not be found. Oct 08 20:57:59.058505 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:57:59.058505 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:57:59.058505 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:57:59.064060 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:57:59.064060 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:57:59.064060 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:57:59.064060 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 20:57:59.064060 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 20:57:59.064060 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e338d559-3f7c-4cc8-95c6-face79e11ca2 could not be found. Oct 08 20:57:59.064060 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:57:59.064060 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-a5f05712-b2d3-4827-a7ed-cde78961dff6 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Returning 404 to user: Instance e338d559-3f7c-4cc8-95c6-face79e11ca2 could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:57:59.064060 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-a5f05712-b2d3-4827-a7ed-cde78961dff6 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] 10.222.0.26 "GET /compute/v2.1/servers/e338d559-3f7c-4cc8-95c6-face79e11ca2" status: 404 len: 111 microversion: 2.1 time: 0.035438 Oct 08 20:57:59.065657 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 785/1641] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:57:59 2022] GET /compute/v2.1/servers/e338d559-3f7c-4cc8-95c6-face79e11ca2 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 20:57:59.070478 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-aad6cdf4-f705-40fa-adca-7b9a2e62812a tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-605303360", "metadata": {"image_type": "test"}}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:57:59.073164 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-aad6cdf4-f705-40fa-adca-7b9a2e62812a tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] [instance: 19327d3e-de51-432b-b594-cb9a1bfe2f49] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:59.081119 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-aad6cdf4-f705-40fa-adca-7b9a2e62812a tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:59.081321 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-aad6cdf4-f705-40fa-adca-7b9a2e62812a tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:59.081926 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-aad6cdf4-f705-40fa-adca-7b9a2e62812a tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:59.083340 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-aad6cdf4-f705-40fa-adca-7b9a2e62812a tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:59.084186 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-aad6cdf4-f705-40fa-adca-7b9a2e62812a tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:59.085117 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-aad6cdf4-f705-40fa-adca-7b9a2e62812a tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:59.129508 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:57:59.140245 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-aad6cdf4-f705-40fa-adca-7b9a2e62812a tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Getting quotas for project d24a29bd6efb40609e31fbb6dba839e8. Resources: dict_keys(['metadata_items']) {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 20:57:59.148465 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-aad6cdf4-f705-40fa-adca-7b9a2e62812a tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Getting quotas for user 322606d4cb0f45d3ac2eceab4999d45b and project d24a29bd6efb40609e31fbb6dba839e8. Resources: dict_keys(['metadata_items']) {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 20:57:59.158563 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=10 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:57:59.254314 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-2c36e583-df54-4a88-a5d8-ee72ddad54b3 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac1323815364df4a3a4d4dbbb9d70dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be94d02ab5244f98337fb9b90e74746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:59.264049 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-2c36e583-df54-4a88-a5d8-ee72ddad54b3 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] 10.222.0.26 "GET /compute/v2.1/servers/b5452da7-7cb6-493b-a5d1-4c60ed1e342c" status: 200 len: 1646 microversion: 2.1 time: 0.337574 Oct 08 20:57:59.268910 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 857/1642] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:57:58 2022] GET /compute/v2.1/servers/b5452da7-7cb6-493b-a5d1-4c60ed1e342c => generated 1646 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:57:59.289348 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-a6a69ed4-f1e9-46dd-ad20-c888277e1f7f tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Calling method '.version_select at 0x7f1a8c151c10>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:59.337229 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-a6a69ed4-f1e9-46dd-ad20-c888277e1f7f tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-16026981" status: 202 len: 0 microversion: 2.1 time: 0.066332 Oct 08 20:57:59.337463 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 858/1643] 10.222.0.26 () {58 vars in 1215 bytes} [Sat Oct 8 20:57:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-16026981 => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 20:57:59.346398 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-176633e5-4c6b-4e8b-898c-6c3279a7657f tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:59.347216 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-176633e5-4c6b-4e8b-898c-6c3279a7657f tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] [instance: e5389d1b-b9f3-491a-898c-be611599d73a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:59.369125 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-176633e5-4c6b-4e8b-898c-6c3279a7657f tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:59.369308 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-176633e5-4c6b-4e8b-898c-6c3279a7657f tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:59.369669 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-176633e5-4c6b-4e8b-898c-6c3279a7657f tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:59.370415 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-176633e5-4c6b-4e8b-898c-6c3279a7657f tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:59.370881 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-176633e5-4c6b-4e8b-898c-6c3279a7657f tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:59.371320 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-176633e5-4c6b-4e8b-898c-6c3279a7657f tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:59.468014 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-aad6cdf4-f705-40fa-adca-7b9a2e62812a tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] 10.222.0.26 "POST /compute/v2.1/servers/19327d3e-de51-432b-b594-cb9a1bfe2f49/action" status: 202 len: 0 microversion: 2.1 time: 0.396446 Oct 08 20:57:59.469018 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 786/1644] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 20:57:59 2022] POST /compute/v2.1/servers/19327d3e-de51-432b-b594-cb9a1bfe2f49/action => generated 0 bytes in 404 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 08 20:57:59.496220 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-e22160bc-cff9-4211-b592-160476981fa0 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:59.497438 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-e22160bc-cff9-4211-b592-160476981fa0 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] [instance: 0568d34c-9aa0-452f-b5c5-b3fc19ebbf15] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:59.527124 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e22160bc-cff9-4211-b592-160476981fa0 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:59.527124 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e22160bc-cff9-4211-b592-160476981fa0 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:59.527418 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e22160bc-cff9-4211-b592-160476981fa0 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:59.528156 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e22160bc-cff9-4211-b592-160476981fa0 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:59.529476 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e22160bc-cff9-4211-b592-160476981fa0 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:59.529881 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e22160bc-cff9-4211-b592-160476981fa0 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:59.717569 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-176633e5-4c6b-4e8b-898c-6c3279a7657f tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01ec70849cfa44368a91df8b3410aba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c97b3b7fa484f97bdf40224f7cc34d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:59.731217 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-176633e5-4c6b-4e8b-898c-6c3279a7657f tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] 10.222.0.26 "GET /compute/v2.1/servers/e5389d1b-b9f3-491a-898c-be611599d73a" status: 200 len: 1524 microversion: 2.1 time: 0.392621 Oct 08 20:57:59.731914 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 859/1645] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:57:59 2022] GET /compute/v2.1/servers/e5389d1b-b9f3-491a-898c-be611599d73a => generated 1524 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:57:59.747780 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-517eb368-f204-45c5-a1c9-c47e61b07c6b tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:59.748885 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-517eb368-f204-45c5-a1c9-c47e61b07c6b tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] [instance: 74bdac1c-9b70-46f7-b671-9752894d8980] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:59.766372 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-517eb368-f204-45c5-a1c9-c47e61b07c6b tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:59.767361 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-517eb368-f204-45c5-a1c9-c47e61b07c6b tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:59.767824 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-517eb368-f204-45c5-a1c9-c47e61b07c6b tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:59.768626 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-517eb368-f204-45c5-a1c9-c47e61b07c6b tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:59.769520 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-517eb368-f204-45c5-a1c9-c47e61b07c6b tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:59.769970 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-517eb368-f204-45c5-a1c9-c47e61b07c6b tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:59.845796 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-e22160bc-cff9-4211-b592-160476981fa0 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9facf5ea0743cb821cec1b40f6b609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdaf5b9230f4e09949a39a5cbe72011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:57:59.858462 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-e22160bc-cff9-4211-b592-160476981fa0 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] 10.222.0.26 "GET /compute/v2.1/servers/0568d34c-9aa0-452f-b5c5-b3fc19ebbf15" status: 200 len: 1589 microversion: 2.1 time: 0.377814 Oct 08 20:57:59.861885 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 787/1646] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:57:59 2022] GET /compute/v2.1/servers/0568d34c-9aa0-452f-b5c5-b3fc19ebbf15 => generated 1589 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:57:59.874503 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-a014249a-49e1-4a23-b152-c227b5ffcf94 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Calling method '.version_select at 0x7f1a8c9e60d0>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:59.958762 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-a014249a-49e1-4a23-b152-c227b5ffcf94 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] 10.222.0.26 "GET /compute/v2.1/images/51380a40-a52a-46bf-a537-f30ae7be94ef" status: 200 len: 1419 microversion: 2.1 time: 0.089936 Oct 08 20:57:59.959983 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 788/1647] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:57:59 2022] GET /compute/v2.1/images/51380a40-a52a-46bf-a537-f30ae7be94ef => generated 1419 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:57:59.969095 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-85bbe74c-2935-4813-9006-7ca9c978cfaa tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:57:59.969934 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-85bbe74c-2935-4813-9006-7ca9c978cfaa tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] [instance: 8ceaf7df-4795-4969-be16-a2a1b94a3fa6] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:57:59.980357 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-85bbe74c-2935-4813-9006-7ca9c978cfaa tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:59.981018 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-85bbe74c-2935-4813-9006-7ca9c978cfaa tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:59.981853 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-85bbe74c-2935-4813-9006-7ca9c978cfaa tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:57:59.983144 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-85bbe74c-2935-4813-9006-7ca9c978cfaa tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:57:59.984684 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-85bbe74c-2935-4813-9006-7ca9c978cfaa tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:57:59.986397 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-85bbe74c-2935-4813-9006-7ca9c978cfaa tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:00.046433 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-517eb368-f204-45c5-a1c9-c47e61b07c6b tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:58:00.056473 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-517eb368-f204-45c5-a1c9-c47e61b07c6b tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:58:00.065160 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-517eb368-f204-45c5-a1c9-c47e61b07c6b tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:58:00.066704 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-517eb368-f204-45c5-a1c9-c47e61b07c6b tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] 10.222.0.26 "GET /compute/v2.1/servers/74bdac1c-9b70-46f7-b671-9752894d8980" status: 200 len: 1488 microversion: 2.25 time: 0.333001 Oct 08 20:58:00.071750 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 860/1648] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:57:59 2022] GET /compute/v2.1/servers/74bdac1c-9b70-46f7-b671-9752894d8980 => generated 1488 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:58:00.292397 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-177eb80e-218c-4ac7-bd39-b434f7a240bc tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:00.293019 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-177eb80e-218c-4ac7-bd39-b434f7a240bc tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] [instance: b5452da7-7cb6-493b-a5d1-4c60ed1e342c] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:58:00.300018 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-177eb80e-218c-4ac7-bd39-b434f7a240bc tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:00.300750 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-177eb80e-218c-4ac7-bd39-b434f7a240bc tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:00.300998 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-177eb80e-218c-4ac7-bd39-b434f7a240bc tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:00.302454 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-177eb80e-218c-4ac7-bd39-b434f7a240bc tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:00.302880 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-177eb80e-218c-4ac7-bd39-b434f7a240bc tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:00.303313 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-177eb80e-218c-4ac7-bd39-b434f7a240bc tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:00.304524 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-85bbe74c-2935-4813-9006-7ca9c978cfaa tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ddc3cd3c374bacbe5bf5e0877380e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8472b054404c46a99b81aba34d6b9f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:58:00.321355 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-85bbe74c-2935-4813-9006-7ca9c978cfaa tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] 10.222.0.26 "GET /compute/v2.1/servers/8ceaf7df-4795-4969-be16-a2a1b94a3fa6" status: 200 len: 1317 microversion: 2.1 time: 0.360002 Oct 08 20:58:00.321955 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 789/1649] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:57:59 2022] GET /compute/v2.1/servers/8ceaf7df-4795-4969-be16-a2a1b94a3fa6 => generated 1317 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:58:00.508368 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-4f507040-c81d-4f67-9448-bd70daec036d req-6158a2a2-2e83-4a85-b7bb-e21089e2b07e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74bdac1c-9b70-46f7-b671-9752894d8980", "name": "network-vif-unplugged", "status": "completed", "tag": "6bec4ac2-ff67-4158-be6a-9cd282b10d00"}, {"name": "network-changed", "server_uuid": "0568d34c-9aa0-452f-b5c5-b3fc19ebbf15", "tag": "9856b2f7-707c-4f16-a64b-c8cc9a82cceb"}, {"name": "network-changed", "server_uuid": "74bdac1c-9b70-46f7-b671-9752894d8980", "tag": "6bec4ac2-ff67-4158-be6a-9cd282b10d00"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:58:00.559003 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-4f507040-c81d-4f67-9448-bd70daec036d req-6158a2a2-2e83-4a85-b7bb-e21089e2b07e service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:00.561617 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-4f507040-c81d-4f67-9448-bd70daec036d req-6158a2a2-2e83-4a85-b7bb-e21089e2b07e service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:00.563095 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-4f507040-c81d-4f67-9448-bd70daec036d req-6158a2a2-2e83-4a85-b7bb-e21089e2b07e service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:00.600156 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-4f507040-c81d-4f67-9448-bd70daec036d req-6158a2a2-2e83-4a85-b7bb-e21089e2b07e service nova] Creating event network-vif-unplugged:6bec4ac2-ff67-4158-be6a-9cd282b10d00 for instance 74bdac1c-9b70-46f7-b671-9752894d8980 on nch2-master-1 Oct 08 20:58:00.601622 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-4f507040-c81d-4f67-9448-bd70daec036d req-6158a2a2-2e83-4a85-b7bb-e21089e2b07e service nova] Creating event network-changed:9856b2f7-707c-4f16-a64b-c8cc9a82cceb for instance 0568d34c-9aa0-452f-b5c5-b3fc19ebbf15 on nch1-master-1 Oct 08 20:58:00.604194 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-4f507040-c81d-4f67-9448-bd70daec036d req-6158a2a2-2e83-4a85-b7bb-e21089e2b07e service nova] Creating event network-changed:6bec4ac2-ff67-4158-be6a-9cd282b10d00 for instance 74bdac1c-9b70-46f7-b671-9752894d8980 on nch2-master-1 Oct 08 20:58:00.644436 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-4f507040-c81d-4f67-9448-bd70daec036d req-6158a2a2-2e83-4a85-b7bb-e21089e2b07e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 519 microversion: 2.1 time: 0.150821 Oct 08 20:58:00.646430 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 790/1650] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:58:00 2022] POST /compute/v2.1/os-server-external-events => generated 519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 08 20:58:00.818052 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-177eb80e-218c-4ac7-bd39-b434f7a240bc tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac1323815364df4a3a4d4dbbb9d70dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be94d02ab5244f98337fb9b90e74746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:58:00.828759 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-ff1c4d93-1ed6-449e-9700-40943289a660 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:00.829371 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-ff1c4d93-1ed6-449e-9700-40943289a660 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] [instance: a80fbf87-8203-4e6c-bee7-fe781bfccff1] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:58:00.840283 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-177eb80e-218c-4ac7-bd39-b434f7a240bc tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] 10.222.0.26 "GET /compute/v2.1/servers/b5452da7-7cb6-493b-a5d1-4c60ed1e342c" status: 200 len: 1646 microversion: 2.1 time: 0.551745 Oct 08 20:58:00.840544 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ff1c4d93-1ed6-449e-9700-40943289a660 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:00.841832 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ff1c4d93-1ed6-449e-9700-40943289a660 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:00.842534 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ff1c4d93-1ed6-449e-9700-40943289a660 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:00.843770 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ff1c4d93-1ed6-449e-9700-40943289a660 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:00.857249 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 861/1651] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:58:00 2022] GET /compute/v2.1/servers/b5452da7-7cb6-493b-a5d1-4c60ed1e342c => generated 1646 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 20:58:00.857249 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-d6541ecc-0332-4e48-9004-ca7680064753 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:00.857249 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-d6541ecc-0332-4e48-9004-ca7680064753 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] [instance: e5389d1b-b9f3-491a-898c-be611599d73a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:58:00.861238 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ff1c4d93-1ed6-449e-9700-40943289a660 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:00.861964 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ff1c4d93-1ed6-449e-9700-40943289a660 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:00.862403 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d6541ecc-0332-4e48-9004-ca7680064753 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:00.863570 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d6541ecc-0332-4e48-9004-ca7680064753 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:00.865058 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d6541ecc-0332-4e48-9004-ca7680064753 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:00.866409 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d6541ecc-0332-4e48-9004-ca7680064753 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:00.867218 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d6541ecc-0332-4e48-9004-ca7680064753 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:00.868487 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d6541ecc-0332-4e48-9004-ca7680064753 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:00.869794 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:58:00.901341 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-ff1c4d93-1ed6-449e-9700-40943289a660 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] [instance: a80fbf87-8203-4e6c-bee7-fe781bfccff1] Going to try to terminate instance {{(pid=140491) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 20:58:01.021099 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-ff1c4d93-1ed6-449e-9700-40943289a660 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] 10.222.0.26 "DELETE /compute/v2.1/servers/a80fbf87-8203-4e6c-bee7-fe781bfccff1" status: 204 len: 0 microversion: 2.1 time: 0.372109 Oct 08 20:58:01.025825 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 791/1652] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 20:58:00 2022] DELETE /compute/v2.1/servers/a80fbf87-8203-4e6c-bee7-fe781bfccff1 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 20:58:01.033424 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-8edfe225-3aef-4173-a60b-673f726327ca tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Calling method '.version_select at 0x7f1a8c697700>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:01.115156 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-8edfe225-3aef-4173-a60b-673f726327ca tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] 10.222.0.26 "GET /compute/v2.1/images/51380a40-a52a-46bf-a537-f30ae7be94ef" status: 200 len: 1419 microversion: 2.1 time: 0.087634 Oct 08 20:58:01.116874 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 792/1653] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:58:01 2022] GET /compute/v2.1/images/51380a40-a52a-46bf-a537-f30ae7be94ef => generated 1419 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:58:01.128268 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-46e6bcfc-5db7-47bc-8201-45feddf1f731 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:01.129009 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-46e6bcfc-5db7-47bc-8201-45feddf1f731 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] [instance: a80fbf87-8203-4e6c-bee7-fe781bfccff1] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:58:01.138323 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-46e6bcfc-5db7-47bc-8201-45feddf1f731 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:01.139038 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-46e6bcfc-5db7-47bc-8201-45feddf1f731 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:01.139664 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-46e6bcfc-5db7-47bc-8201-45feddf1f731 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:01.140375 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-46e6bcfc-5db7-47bc-8201-45feddf1f731 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:01.140995 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-46e6bcfc-5db7-47bc-8201-45feddf1f731 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:01.141876 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-46e6bcfc-5db7-47bc-8201-45feddf1f731 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:01.229846 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-d6541ecc-0332-4e48-9004-ca7680064753 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01ec70849cfa44368a91df8b3410aba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c97b3b7fa484f97bdf40224f7cc34d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:58:01.240146 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-d6541ecc-0332-4e48-9004-ca7680064753 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] 10.222.0.26 "GET /compute/v2.1/servers/e5389d1b-b9f3-491a-898c-be611599d73a" status: 200 len: 1524 microversion: 2.1 time: 0.394472 Oct 08 20:58:01.240742 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 862/1654] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:58:00 2022] GET /compute/v2.1/servers/e5389d1b-b9f3-491a-898c-be611599d73a => generated 1524 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:58:01.248847 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-a91ba138-78a3-4064-b579-5e070ac3357f req-f4e30693-ec2e-4e7d-b160-0cb47ab8ca6a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ceaf7df-4795-4969-be16-a2a1b94a3fa6", "tag": "d52f6b6f-09bf-466a-abab-fe4533f27ab5"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:58:01.264803 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-a91ba138-78a3-4064-b579-5e070ac3357f req-f4e30693-ec2e-4e7d-b160-0cb47ab8ca6a service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:01.265358 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-a91ba138-78a3-4064-b579-5e070ac3357f req-f4e30693-ec2e-4e7d-b160-0cb47ab8ca6a service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:01.265856 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-a91ba138-78a3-4064-b579-5e070ac3357f req-f4e30693-ec2e-4e7d-b160-0cb47ab8ca6a service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:01.282174 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-a91ba138-78a3-4064-b579-5e070ac3357f req-f4e30693-ec2e-4e7d-b160-0cb47ab8ca6a service nova] Creating event network-changed:d52f6b6f-09bf-466a-abab-fe4533f27ab5 for instance 8ceaf7df-4795-4969-be16-a2a1b94a3fa6 on nch1-master-1 Oct 08 20:58:01.288304 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-a91ba138-78a3-4064-b579-5e070ac3357f req-f4e30693-ec2e-4e7d-b160-0cb47ab8ca6a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044941 Oct 08 20:58:01.288909 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 863/1655] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:58:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:58:01.295345 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-598b44c0-f5e8-41c0-9b92-6beb269dd753 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:01.296346 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-598b44c0-f5e8-41c0-9b92-6beb269dd753 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] [instance: 74bdac1c-9b70-46f7-b671-9752894d8980] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:58:01.303834 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-598b44c0-f5e8-41c0-9b92-6beb269dd753 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:01.306614 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-598b44c0-f5e8-41c0-9b92-6beb269dd753 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:01.307335 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-598b44c0-f5e8-41c0-9b92-6beb269dd753 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:01.308251 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-598b44c0-f5e8-41c0-9b92-6beb269dd753 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:01.310083 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-598b44c0-f5e8-41c0-9b92-6beb269dd753 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:01.310655 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-598b44c0-f5e8-41c0-9b92-6beb269dd753 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:01.510368 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-46e6bcfc-5db7-47bc-8201-45feddf1f731 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474ca64d1b1d4e30916b517645aba882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecc2dd2407b4819874bed09cb27959a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:58:01.518431 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-46e6bcfc-5db7-47bc-8201-45feddf1f731 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] 10.222.0.26 "GET /compute/v2.1/servers/a80fbf87-8203-4e6c-bee7-fe781bfccff1" status: 200 len: 1486 microversion: 2.1 time: 0.400107 Oct 08 20:58:01.519348 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 793/1656] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:58:01 2022] GET /compute/v2.1/servers/a80fbf87-8203-4e6c-bee7-fe781bfccff1 => generated 1486 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:58:01.533379 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-e89ce8fd-0b5d-4516-b0db-6e56aa3e85b5 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:01.534115 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-e89ce8fd-0b5d-4516-b0db-6e56aa3e85b5 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] [instance: 8ceaf7df-4795-4969-be16-a2a1b94a3fa6] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:58:01.542523 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e89ce8fd-0b5d-4516-b0db-6e56aa3e85b5 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:01.543013 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e89ce8fd-0b5d-4516-b0db-6e56aa3e85b5 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:01.543463 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e89ce8fd-0b5d-4516-b0db-6e56aa3e85b5 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:01.544190 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e89ce8fd-0b5d-4516-b0db-6e56aa3e85b5 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:01.544652 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e89ce8fd-0b5d-4516-b0db-6e56aa3e85b5 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:01.545082 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e89ce8fd-0b5d-4516-b0db-6e56aa3e85b5 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:01.957896 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-e89ce8fd-0b5d-4516-b0db-6e56aa3e85b5 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ddc3cd3c374bacbe5bf5e0877380e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8472b054404c46a99b81aba34d6b9f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:58:01.971519 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-e89ce8fd-0b5d-4516-b0db-6e56aa3e85b5 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] 10.222.0.26 "GET /compute/v2.1/servers/8ceaf7df-4795-4969-be16-a2a1b94a3fa6" status: 200 len: 1317 microversion: 2.1 time: 0.450909 Oct 08 20:58:01.972533 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 794/1657] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:58:01 2022] GET /compute/v2.1/servers/8ceaf7df-4795-4969-be16-a2a1b94a3fa6 => generated 1317 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:58:01.978560 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-8d270115-5483-4155-a27d-ff9dbdb2b47b tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:01.979873 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-8d270115-5483-4155-a27d-ff9dbdb2b47b tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] [instance: b5452da7-7cb6-493b-a5d1-4c60ed1e342c] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:58:01.987224 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8d270115-5483-4155-a27d-ff9dbdb2b47b tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:01.988319 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8d270115-5483-4155-a27d-ff9dbdb2b47b tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:01.989886 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8d270115-5483-4155-a27d-ff9dbdb2b47b tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:01.990950 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8d270115-5483-4155-a27d-ff9dbdb2b47b tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:01.991516 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8d270115-5483-4155-a27d-ff9dbdb2b47b tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:01.992049 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8d270115-5483-4155-a27d-ff9dbdb2b47b tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:02.032354 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8d270115-5483-4155-a27d-ff9dbdb2b47b tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:02.033148 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8d270115-5483-4155-a27d-ff9dbdb2b47b tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:02.033785 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8d270115-5483-4155-a27d-ff9dbdb2b47b tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:02.034261 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.objects.instance [None req-8d270115-5483-4155-a27d-ff9dbdb2b47b tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lazy-loading 'fault' on Instance uuid b5452da7-7cb6-493b-a5d1-4c60ed1e342c {{(pid=140491) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 20:58:02.124308 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-8d270115-5483-4155-a27d-ff9dbdb2b47b tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac1323815364df4a3a4d4dbbb9d70dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be94d02ab5244f98337fb9b90e74746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:58:02.135331 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-8d270115-5483-4155-a27d-ff9dbdb2b47b tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] 10.222.0.26 "GET /compute/v2.1/servers/b5452da7-7cb6-493b-a5d1-4c60ed1e342c" status: 200 len: 1305 microversion: 2.1 time: 0.160856 Oct 08 20:58:02.136034 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 795/1658] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:58:01 2022] GET /compute/v2.1/servers/b5452da7-7cb6-493b-a5d1-4c60ed1e342c => generated 1305 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:58:02.141896 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-8740fe2a-a0e9-4a08-81a1-04d11a724a66 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Calling method '.version_select at 0x7f1a8c61d430>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:02.172295 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-598b44c0-f5e8-41c0-9b92-6beb269dd753 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:58:02.193882 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-598b44c0-f5e8-41c0-9b92-6beb269dd753 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:58:02.197549 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-8740fe2a-a0e9-4a08-81a1-04d11a724a66 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] 10.222.0.26 "GET /compute/v2.1/images/51380a40-a52a-46bf-a537-f30ae7be94ef" status: 200 len: 1419 microversion: 2.1 time: 0.060006 Oct 08 20:58:02.199263 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 796/1659] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:58:02 2022] GET /compute/v2.1/images/51380a40-a52a-46bf-a537-f30ae7be94ef => generated 1419 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:58:02.210112 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-598b44c0-f5e8-41c0-9b92-6beb269dd753 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:58:02.212589 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-598b44c0-f5e8-41c0-9b92-6beb269dd753 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] 10.222.0.26 "GET /compute/v2.1/servers/74bdac1c-9b70-46f7-b671-9752894d8980" status: 200 len: 1488 microversion: 2.25 time: 0.920787 Oct 08 20:58:02.216061 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 864/1660] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:58:01 2022] GET /compute/v2.1/servers/74bdac1c-9b70-46f7-b671-9752894d8980 => generated 1488 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:58:02.263877 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-cceaf686-6420-4aa0-9f53-2e3c2f91a1b2 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:02.264471 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-cceaf686-6420-4aa0-9f53-2e3c2f91a1b2 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] [instance: e5389d1b-b9f3-491a-898c-be611599d73a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:58:02.270841 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cceaf686-6420-4aa0-9f53-2e3c2f91a1b2 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:02.271338 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cceaf686-6420-4aa0-9f53-2e3c2f91a1b2 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:02.271814 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cceaf686-6420-4aa0-9f53-2e3c2f91a1b2 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:02.272525 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cceaf686-6420-4aa0-9f53-2e3c2f91a1b2 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:02.272986 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cceaf686-6420-4aa0-9f53-2e3c2f91a1b2 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:02.273448 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cceaf686-6420-4aa0-9f53-2e3c2f91a1b2 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:02.523156 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-cceaf686-6420-4aa0-9f53-2e3c2f91a1b2 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01ec70849cfa44368a91df8b3410aba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c97b3b7fa484f97bdf40224f7cc34d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:58:02.531442 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-cceaf686-6420-4aa0-9f53-2e3c2f91a1b2 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] 10.222.0.26 "GET /compute/v2.1/servers/e5389d1b-b9f3-491a-898c-be611599d73a" status: 200 len: 1524 microversion: 2.1 time: 0.271367 Oct 08 20:58:02.532545 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 797/1661] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:58:02 2022] GET /compute/v2.1/servers/e5389d1b-b9f3-491a-898c-be611599d73a => generated 1524 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:58:02.546862 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-f570666e-bb3f-4e94-a80a-26c016d63607 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:02.547514 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-f570666e-bb3f-4e94-a80a-26c016d63607 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] [instance: a80fbf87-8203-4e6c-bee7-fe781bfccff1] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:58:02.555108 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f570666e-bb3f-4e94-a80a-26c016d63607 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:02.555602 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f570666e-bb3f-4e94-a80a-26c016d63607 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:02.556195 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f570666e-bb3f-4e94-a80a-26c016d63607 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:02.556949 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f570666e-bb3f-4e94-a80a-26c016d63607 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:02.557431 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f570666e-bb3f-4e94-a80a-26c016d63607 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:02.557861 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f570666e-bb3f-4e94-a80a-26c016d63607 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:02.626900 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-f570666e-bb3f-4e94-a80a-26c016d63607 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474ca64d1b1d4e30916b517645aba882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecc2dd2407b4819874bed09cb27959a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:58:02.636098 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-f570666e-bb3f-4e94-a80a-26c016d63607 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] 10.222.0.26 "GET /compute/v2.1/servers/a80fbf87-8203-4e6c-bee7-fe781bfccff1" status: 200 len: 1444 microversion: 2.1 time: 0.093260 Oct 08 20:58:02.636836 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 865/1662] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:58:02 2022] GET /compute/v2.1/servers/a80fbf87-8203-4e6c-bee7-fe781bfccff1 => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:58:02.996121 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-11635e00-ed74-42c2-88a5-ad956c769f8b tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:02.996742 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-11635e00-ed74-42c2-88a5-ad956c769f8b tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] [instance: 8ceaf7df-4795-4969-be16-a2a1b94a3fa6] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:58:03.003596 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-11635e00-ed74-42c2-88a5-ad956c769f8b tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:03.004092 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-11635e00-ed74-42c2-88a5-ad956c769f8b tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:03.005132 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-11635e00-ed74-42c2-88a5-ad956c769f8b tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:03.005910 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-11635e00-ed74-42c2-88a5-ad956c769f8b tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:03.006461 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-11635e00-ed74-42c2-88a5-ad956c769f8b tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:03.006840 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-11635e00-ed74-42c2-88a5-ad956c769f8b tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:03.160260 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-11635e00-ed74-42c2-88a5-ad956c769f8b tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ddc3cd3c374bacbe5bf5e0877380e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8472b054404c46a99b81aba34d6b9f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:58:03.160443 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-59f1dcca-bf37-4a76-a6db-af2e8702a0dc tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:03.161231 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-59f1dcca-bf37-4a76-a6db-af2e8702a0dc tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] [instance: b5452da7-7cb6-493b-a5d1-4c60ed1e342c] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:58:03.169036 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-59f1dcca-bf37-4a76-a6db-af2e8702a0dc tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:03.169562 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-11635e00-ed74-42c2-88a5-ad956c769f8b tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] 10.222.0.26 "GET /compute/v2.1/servers/8ceaf7df-4795-4969-be16-a2a1b94a3fa6" status: 200 len: 1317 microversion: 2.1 time: 0.177433 Oct 08 20:58:03.169799 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-59f1dcca-bf37-4a76-a6db-af2e8702a0dc tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:03.170147 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 798/1663] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:58:02 2022] GET /compute/v2.1/servers/8ceaf7df-4795-4969-be16-a2a1b94a3fa6 => generated 1317 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:58:03.170601 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-59f1dcca-bf37-4a76-a6db-af2e8702a0dc tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:03.171415 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-59f1dcca-bf37-4a76-a6db-af2e8702a0dc tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:03.171893 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-59f1dcca-bf37-4a76-a6db-af2e8702a0dc tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:03.172334 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-59f1dcca-bf37-4a76-a6db-af2e8702a0dc tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:03.187191 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-59f1dcca-bf37-4a76-a6db-af2e8702a0dc tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] HTTP exception thrown: Instance b5452da7-7cb6-493b-a5d1-4c60ed1e342c could not be found. Oct 08 20:58:03.188934 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-59f1dcca-bf37-4a76-a6db-af2e8702a0dc tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Request method failure captured: Oct 08 20:58:03.188934 ncdv-master-1 devstack@n-api.service[140492]: request: GET /compute/v2.1/servers/b5452da7-7cb6-493b-a5d1-4c60ed1e342c HTTP/1.1 Oct 08 20:58:03.188934 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 20:58:03.188934 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 20:58:03.188934 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 20:58:03.188934 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 20:58:03.188934 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 20:58:03.188934 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 20:58:03.188934 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 20:58:03.188934 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 20:58:03.188934 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQePneH9r8wc6qFHuuUfUiwj20bfGS3ReCozGKtofTKF_Bibv-TeYrNnDr89OwEeHkYGW8sVcZZerG8KfPs5hnyFWI91x_kPrSGVuiWEZNP0tyGW3_Xh9-fgTNjxnIFiLidb-EHCBZb3EEyAGFqy03GkbophorT5sYui55pNleytp26U Oct 08 20:58:03.188934 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 20:58:03.188934 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 20:58:03.188934 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 20:58:03.188934 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 20:58:03.188934 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 20:58:03.188934 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 20:58:03.188934 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 1be94d02ab5244f98337fb9b90e74746 Oct 08 20:58:03.188934 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-SecurityGroupsTestJSON-1416879597 Oct 08 20:58:03.188934 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 20:58:03.188934 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 20:58:03.188934 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1be94d02ab5244f98337fb9b90e74746"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1be94d02ab5244f98337fb9b90e74746"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1be94d02ab5244f98337fb9b90e74746"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1be94d02ab5244f98337fb9b90e74746"}]}] Oct 08 20:58:03.188934 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-SecurityGroupsTestJSON-1416879597 Oct 08 20:58:03.188934 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 1be94d02ab5244f98337fb9b90e74746 Oct 08 20:58:03.188934 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1416879597 Oct 08 20:58:03.188934 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-SecurityGroupsTestJSON-1416879597-project Oct 08 20:58:03.188934 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 20:58:03.188934 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 20:58:03.188934 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 5ac1323815364df4a3a4d4dbbb9d70dd Oct 08 20:58:03.188934 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-SecurityGroupsTestJSON-1416879597-project Oct 08 20:58:03.188934 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 20:58:03.188934 ncdv-master-1 devstack@n-api.service[140492]: exception: Instance b5452da7-7cb6-493b-a5d1-4c60ed1e342c could not be found. Oct 08 20:58:03.188934 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': 'b5452da7-7cb6-493b-a5d1-4c60ed1e342c'} Oct 08 20:58:03.188934 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:58:03.188934 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:58:03.188934 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 20:58:03.188934 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 20:58:03.188934 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 20:58:03.188934 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 20:58:03.188934 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 20:58:03.188934 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 20:58:03.188934 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 20:58:03.188934 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 20:58:03.188934 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5452da7-7cb6-493b-a5d1-4c60ed1e342c could not be found. Oct 08 20:58:03.188934 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:58:03.188934 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:58:03.188934 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:58:03.188934 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:58:03.188934 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:58:03.188934 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:58:03.188934 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:58:03.188934 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:58:03.188934 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:58:03.188934 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:58:03.188934 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 20:58:03.188934 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 20:58:03.188934 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 20:58:03.188934 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 20:58:03.188934 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 20:58:03.188934 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 20:58:03.188934 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5452da7-7cb6-493b-a5d1-4c60ed1e342c could not be found. Oct 08 20:58:03.188934 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:58:03.188934 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:58:03.188934 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:58:03.194764 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:58:03.194764 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:58:03.194764 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:58:03.194764 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 20:58:03.194764 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 20:58:03.194764 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5452da7-7cb6-493b-a5d1-4c60ed1e342c could not be found. Oct 08 20:58:03.194764 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:58:03.194764 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-59f1dcca-bf37-4a76-a6db-af2e8702a0dc tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Returning 404 to user: Instance b5452da7-7cb6-493b-a5d1-4c60ed1e342c could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:58:03.194764 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-59f1dcca-bf37-4a76-a6db-af2e8702a0dc tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] 10.222.0.26 "GET /compute/v2.1/servers/b5452da7-7cb6-493b-a5d1-4c60ed1e342c" status: 404 len: 111 microversion: 2.1 time: 0.034022 Oct 08 20:58:03.194764 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 866/1664] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:58:03 2022] GET /compute/v2.1/servers/b5452da7-7cb6-493b-a5d1-4c60ed1e342c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 08 20:58:03.200097 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-048ca1eb-bcbc-404e-9fe3-ce689c84f1e5 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Calling method '.version_select at 0x7f1a8cd68670>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:03.213639 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-59d9ba08-2655-4060-9155-bbe764a4028d tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Calling method '.version_select at 0x7f1a913fc0d0>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:03.271158 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-59d9ba08-2655-4060-9155-bbe764a4028d tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] 10.222.0.26 "GET /compute/v2.1/images/51380a40-a52a-46bf-a537-f30ae7be94ef" status: 200 len: 1419 microversion: 2.1 time: 0.061456 Oct 08 20:58:03.271735 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 867/1665] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:58:03 2022] GET /compute/v2.1/images/51380a40-a52a-46bf-a537-f30ae7be94ef => generated 1419 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:58:03.277176 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-890e8258-29e5-4724-bca5-f71ead36a559 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:03.278310 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-890e8258-29e5-4724-bca5-f71ead36a559 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] [instance: 74bdac1c-9b70-46f7-b671-9752894d8980] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:58:03.287032 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-890e8258-29e5-4724-bca5-f71ead36a559 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:03.287801 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-890e8258-29e5-4724-bca5-f71ead36a559 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:03.288503 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-890e8258-29e5-4724-bca5-f71ead36a559 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:03.289451 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-890e8258-29e5-4724-bca5-f71ead36a559 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:03.290698 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-890e8258-29e5-4724-bca5-f71ead36a559 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:03.291347 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-890e8258-29e5-4724-bca5-f71ead36a559 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:03.530831 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-048ca1eb-bcbc-404e-9fe3-ce689c84f1e5 tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/20dcc67a-ffa8-498f-accf-c202efca60e5" status: 202 len: 0 microversion: 2.1 time: 0.334666 Oct 08 20:58:03.534458 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 799/1666] 10.222.0.26 () {58 vars in 1272 bytes} [Sat Oct 8 20:58:03 2022] DELETE /compute/v2.1/os-security-groups/20dcc67a-ffa8-498f-accf-c202efca60e5 => generated 0 bytes in 336 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 20:58:03.537851 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-28f34c96-5245-4da4-a13f-5c73a9fbbcd0 req-71763f0e-1de3-4d3a-9d85-74d910f1dc7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5452da7-7cb6-493b-a5d1-4c60ed1e342c", "name": "network-vif-deleted", "tag": "93e84696-aa00-46c7-8d5d-36171a311b21"}, {"server_uuid": "a80fbf87-8203-4e6c-bee7-fe781bfccff1", "name": "network-vif-deleted", "tag": "01d74faf-31a5-494a-9dba-c900226fd0a9"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:58:03.560869 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-28f34c96-5245-4da4-a13f-5c73a9fbbcd0 req-71763f0e-1de3-4d3a-9d85-74d910f1dc7b service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:03.574122 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-28f34c96-5245-4da4-a13f-5c73a9fbbcd0 req-71763f0e-1de3-4d3a-9d85-74d910f1dc7b service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:03.588261 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-28f34c96-5245-4da4-a13f-5c73a9fbbcd0 req-71763f0e-1de3-4d3a-9d85-74d910f1dc7b service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:03.645326 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-28f34c96-5245-4da4-a13f-5c73a9fbbcd0 req-71763f0e-1de3-4d3a-9d85-74d910f1dc7b service nova] Creating event network-vif-deleted:93e84696-aa00-46c7-8d5d-36171a311b21 for instance b5452da7-7cb6-493b-a5d1-4c60ed1e342c on nch2-master-1 Oct 08 20:58:03.645859 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-28f34c96-5245-4da4-a13f-5c73a9fbbcd0 req-71763f0e-1de3-4d3a-9d85-74d910f1dc7b service nova] Creating event network-vif-deleted:01d74faf-31a5-494a-9dba-c900226fd0a9 for instance a80fbf87-8203-4e6c-bee7-fe781bfccff1 on nch1-master-1 Oct 08 20:58:03.658094 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-28f34c96-5245-4da4-a13f-5c73a9fbbcd0 req-71763f0e-1de3-4d3a-9d85-74d910f1dc7b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.123058 Oct 08 20:58:03.658771 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 800/1667] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:58:03 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:58:03.666676 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-5d7ab389-2ae8-4026-a828-6f071667bdbe tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] Calling method '.version_select at 0x7f1a8d4b1550>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:03.667987 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-890e8258-29e5-4724-bca5-f71ead36a559 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:58:03.681166 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-890e8258-29e5-4724-bca5-f71ead36a559 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:58:03.686267 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-890e8258-29e5-4724-bca5-f71ead36a559 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:58:03.688023 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-890e8258-29e5-4724-bca5-f71ead36a559 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] 10.222.0.26 "GET /compute/v2.1/servers/74bdac1c-9b70-46f7-b671-9752894d8980" status: 200 len: 1488 microversion: 2.25 time: 0.414752 Oct 08 20:58:03.689337 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 868/1668] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:58:03 2022] GET /compute/v2.1/servers/74bdac1c-9b70-46f7-b671-9752894d8980 => generated 1488 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:58:03.695765 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-75b7d544-138f-4a37-aa92-003004d20923 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:03.697447 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-75b7d544-138f-4a37-aa92-003004d20923 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] [instance: e5389d1b-b9f3-491a-898c-be611599d73a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:58:03.706308 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-75b7d544-138f-4a37-aa92-003004d20923 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:03.706992 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-75b7d544-138f-4a37-aa92-003004d20923 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:03.707496 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-75b7d544-138f-4a37-aa92-003004d20923 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:03.708697 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-75b7d544-138f-4a37-aa92-003004d20923 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:03.709494 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-75b7d544-138f-4a37-aa92-003004d20923 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:03.710168 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-75b7d544-138f-4a37-aa92-003004d20923 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:04.055723 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-75b7d544-138f-4a37-aa92-003004d20923 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01ec70849cfa44368a91df8b3410aba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c97b3b7fa484f97bdf40224f7cc34d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:58:04.066021 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-75b7d544-138f-4a37-aa92-003004d20923 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] 10.222.0.26 "GET /compute/v2.1/servers/e5389d1b-b9f3-491a-898c-be611599d73a" status: 200 len: 1524 microversion: 2.1 time: 0.375261 Oct 08 20:58:04.066614 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 869/1669] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:58:03 2022] GET /compute/v2.1/servers/e5389d1b-b9f3-491a-898c-be611599d73a => generated 1524 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:58:04.080105 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-3fdc9abd-0b18-4376-8b84-5f2825a91d03 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:04.081003 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-3fdc9abd-0b18-4376-8b84-5f2825a91d03 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] [instance: a80fbf87-8203-4e6c-bee7-fe781bfccff1] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:58:04.088591 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3fdc9abd-0b18-4376-8b84-5f2825a91d03 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:04.089336 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3fdc9abd-0b18-4376-8b84-5f2825a91d03 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:04.089847 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3fdc9abd-0b18-4376-8b84-5f2825a91d03 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:04.090571 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3fdc9abd-0b18-4376-8b84-5f2825a91d03 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:04.091086 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3fdc9abd-0b18-4376-8b84-5f2825a91d03 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:04.091766 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3fdc9abd-0b18-4376-8b84-5f2825a91d03 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:04.120947 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-5d7ab389-2ae8-4026-a828-6f071667bdbe tempest-SecurityGroupsTestJSON-1416879597 tempest-SecurityGroupsTestJSON-1416879597-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/37af8e43-9b01-4360-b8ce-fe640f13d95d" status: 202 len: 0 microversion: 2.1 time: 0.460486 Oct 08 20:58:04.121792 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 801/1670] 10.222.0.26 () {58 vars in 1272 bytes} [Sat Oct 8 20:58:03 2022] DELETE /compute/v2.1/os-security-groups/37af8e43-9b01-4360-b8ce-fe640f13d95d => generated 0 bytes in 462 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 20:58:04.135431 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3fdc9abd-0b18-4376-8b84-5f2825a91d03 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:04.135936 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3fdc9abd-0b18-4376-8b84-5f2825a91d03 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:04.136623 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3fdc9abd-0b18-4376-8b84-5f2825a91d03 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:04.137096 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.objects.instance [None req-3fdc9abd-0b18-4376-8b84-5f2825a91d03 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lazy-loading 'fault' on Instance uuid a80fbf87-8203-4e6c-bee7-fe781bfccff1 {{(pid=140492) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 20:58:04.194054 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-b9561834-6c4e-407c-9d88-f81477fc0054 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:04.194799 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-b9561834-6c4e-407c-9d88-f81477fc0054 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] [instance: 8ceaf7df-4795-4969-be16-a2a1b94a3fa6] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:58:04.201217 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b9561834-6c4e-407c-9d88-f81477fc0054 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:04.201747 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b9561834-6c4e-407c-9d88-f81477fc0054 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:04.202694 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b9561834-6c4e-407c-9d88-f81477fc0054 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:04.202905 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b9561834-6c4e-407c-9d88-f81477fc0054 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:04.203380 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b9561834-6c4e-407c-9d88-f81477fc0054 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:04.203817 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b9561834-6c4e-407c-9d88-f81477fc0054 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:04.207221 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-3fdc9abd-0b18-4376-8b84-5f2825a91d03 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474ca64d1b1d4e30916b517645aba882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecc2dd2407b4819874bed09cb27959a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:58:04.216493 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-3fdc9abd-0b18-4376-8b84-5f2825a91d03 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] 10.222.0.26 "GET /compute/v2.1/servers/a80fbf87-8203-4e6c-bee7-fe781bfccff1" status: 200 len: 1301 microversion: 2.1 time: 0.141229 Oct 08 20:58:04.217628 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 870/1671] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:58:04 2022] GET /compute/v2.1/servers/a80fbf87-8203-4e6c-bee7-fe781bfccff1 => generated 1301 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:58:04.287349 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-3bbf632a-699a-4201-8f45-47795b3a0cd8 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Calling method '.version_select at 0x7f1a8c10a160>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:04.397827 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-3bbf632a-699a-4201-8f45-47795b3a0cd8 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] 10.222.0.26 "GET /compute/v2.1/images/51380a40-a52a-46bf-a537-f30ae7be94ef" status: 200 len: 1419 microversion: 2.1 time: 0.114939 Oct 08 20:58:04.399717 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 871/1672] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:58:04 2022] GET /compute/v2.1/images/51380a40-a52a-46bf-a537-f30ae7be94ef => generated 1419 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:58:04.444326 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-b9561834-6c4e-407c-9d88-f81477fc0054 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ddc3cd3c374bacbe5bf5e0877380e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8472b054404c46a99b81aba34d6b9f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:58:04.453989 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-b9561834-6c4e-407c-9d88-f81477fc0054 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] 10.222.0.26 "GET /compute/v2.1/servers/8ceaf7df-4795-4969-be16-a2a1b94a3fa6" status: 200 len: 1317 microversion: 2.1 time: 0.264452 Oct 08 20:58:04.458731 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 802/1673] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:58:04 2022] GET /compute/v2.1/servers/8ceaf7df-4795-4969-be16-a2a1b94a3fa6 => generated 1317 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 20:58:04.717691 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-7f1c375e-6902-4ca1-8b11-3b0064ee8189 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:04.718332 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-7f1c375e-6902-4ca1-8b11-3b0064ee8189 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] [instance: 74bdac1c-9b70-46f7-b671-9752894d8980] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:58:04.726144 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7f1c375e-6902-4ca1-8b11-3b0064ee8189 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:04.726636 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7f1c375e-6902-4ca1-8b11-3b0064ee8189 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:04.727079 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7f1c375e-6902-4ca1-8b11-3b0064ee8189 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:04.727821 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7f1c375e-6902-4ca1-8b11-3b0064ee8189 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:04.728286 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7f1c375e-6902-4ca1-8b11-3b0064ee8189 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:04.729027 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7f1c375e-6902-4ca1-8b11-3b0064ee8189 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:05.090592 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-f5d76465-3b57-40bd-90bc-88c42d3496a8 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:05.091396 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-f5d76465-3b57-40bd-90bc-88c42d3496a8 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] [instance: e5389d1b-b9f3-491a-898c-be611599d73a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:58:05.094053 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=2 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:58:05.095981 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=6 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:58:05.107071 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f5d76465-3b57-40bd-90bc-88c42d3496a8 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:05.109418 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f5d76465-3b57-40bd-90bc-88c42d3496a8 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:05.110205 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f5d76465-3b57-40bd-90bc-88c42d3496a8 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:05.115072 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f5d76465-3b57-40bd-90bc-88c42d3496a8 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:05.116731 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f5d76465-3b57-40bd-90bc-88c42d3496a8 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:05.117441 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f5d76465-3b57-40bd-90bc-88c42d3496a8 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:05.149575 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-7f1c375e-6902-4ca1-8b11-3b0064ee8189 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:58:05.160684 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-7f1c375e-6902-4ca1-8b11-3b0064ee8189 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:58:05.166980 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-7f1c375e-6902-4ca1-8b11-3b0064ee8189 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:58:05.171120 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-7f1c375e-6902-4ca1-8b11-3b0064ee8189 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] 10.222.0.26 "GET /compute/v2.1/servers/74bdac1c-9b70-46f7-b671-9752894d8980" status: 200 len: 1488 microversion: 2.25 time: 0.456914 Oct 08 20:58:05.196095 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 872/1674] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:58:04 2022] GET /compute/v2.1/servers/74bdac1c-9b70-46f7-b671-9752894d8980 => generated 1488 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 08 20:58:05.244184 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-fc180ae3-0462-49b0-a7b0-35b17ad18af5 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:05.245899 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-fc180ae3-0462-49b0-a7b0-35b17ad18af5 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] [instance: a80fbf87-8203-4e6c-bee7-fe781bfccff1] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:58:05.253106 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fc180ae3-0462-49b0-a7b0-35b17ad18af5 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:05.254527 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fc180ae3-0462-49b0-a7b0-35b17ad18af5 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:05.255141 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fc180ae3-0462-49b0-a7b0-35b17ad18af5 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:05.256065 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fc180ae3-0462-49b0-a7b0-35b17ad18af5 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:05.257355 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fc180ae3-0462-49b0-a7b0-35b17ad18af5 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:05.257965 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fc180ae3-0462-49b0-a7b0-35b17ad18af5 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:05.277881 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-fc180ae3-0462-49b0-a7b0-35b17ad18af5 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] HTTP exception thrown: Instance a80fbf87-8203-4e6c-bee7-fe781bfccff1 could not be found. Oct 08 20:58:05.280218 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-fc180ae3-0462-49b0-a7b0-35b17ad18af5 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Request method failure captured: Oct 08 20:58:05.280218 ncdv-master-1 devstack@n-api.service[140492]: request: GET /compute/v2.1/servers/a80fbf87-8203-4e6c-bee7-fe781bfccff1 HTTP/1.1 Oct 08 20:58:05.280218 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 20:58:05.280218 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 20:58:05.280218 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 20:58:05.280218 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 20:58:05.280218 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 20:58:05.280218 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 20:58:05.280218 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 20:58:05.280218 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 20:58:05.280218 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeMXC9JeN9Mlk5jzCgs-_cPtRtdIPAXhmbadFJaShbL5RJJyNFLD60Grhe8NzKLmyv9j_DFRSKoTNMw2TlfcMFQd60Gx2njCIaEqOyEM-mQSbVpxdhzzTuSuygraSUzGQKPLwQlBymj0axQFAl4TsB_9ApQq2i8hMTqwWvlfGcMSM0g Oct 08 20:58:05.280218 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 20:58:05.280218 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 20:58:05.280218 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 20:58:05.280218 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 20:58:05.280218 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 20:58:05.280218 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 20:58:05.280218 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 6ecc2dd2407b4819874bed09cb27959a Oct 08 20:58:05.280218 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-LiveMigrationTest-739175934 Oct 08 20:58:05.280218 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 20:58:05.280218 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 20:58:05.280218 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6ecc2dd2407b4819874bed09cb27959a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6ecc2dd2407b4819874bed09cb27959a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6ecc2dd2407b4819874bed09cb27959a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6ecc2dd2407b4819874bed09cb27959a"}]}] Oct 08 20:58:05.280218 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-LiveMigrationTest-739175934 Oct 08 20:58:05.280218 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 6ecc2dd2407b4819874bed09cb27959a Oct 08 20:58:05.280218 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-LiveMigrationTest-739175934 Oct 08 20:58:05.280218 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-LiveMigrationTest-739175934-project Oct 08 20:58:05.280218 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 20:58:05.280218 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 20:58:05.280218 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 474ca64d1b1d4e30916b517645aba882 Oct 08 20:58:05.280218 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-LiveMigrationTest-739175934-project Oct 08 20:58:05.280218 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 20:58:05.280218 ncdv-master-1 devstack@n-api.service[140492]: exception: Instance a80fbf87-8203-4e6c-bee7-fe781bfccff1 could not be found. Oct 08 20:58:05.280218 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': 'a80fbf87-8203-4e6c-bee7-fe781bfccff1'} Oct 08 20:58:05.280218 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:58:05.280218 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:58:05.280218 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 20:58:05.280218 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 20:58:05.280218 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 20:58:05.280218 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 20:58:05.280218 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 20:58:05.280218 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 20:58:05.280218 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 20:58:05.280218 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 20:58:05.280218 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a80fbf87-8203-4e6c-bee7-fe781bfccff1 could not be found. Oct 08 20:58:05.280218 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:58:05.280218 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:58:05.280218 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:58:05.280218 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:58:05.280218 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:58:05.280218 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:58:05.280218 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:58:05.280218 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:58:05.280218 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:58:05.280218 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:58:05.280218 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 20:58:05.280218 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 20:58:05.280218 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 20:58:05.280218 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 20:58:05.280218 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 20:58:05.280218 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 20:58:05.280218 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a80fbf87-8203-4e6c-bee7-fe781bfccff1 could not be found. Oct 08 20:58:05.280218 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:58:05.280218 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:58:05.280218 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:58:05.287582 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:58:05.287582 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:58:05.287582 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:58:05.287582 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 20:58:05.287582 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 20:58:05.287582 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a80fbf87-8203-4e6c-bee7-fe781bfccff1 could not be found. Oct 08 20:58:05.287582 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:58:05.287582 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-fc180ae3-0462-49b0-a7b0-35b17ad18af5 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Returning 404 to user: Instance a80fbf87-8203-4e6c-bee7-fe781bfccff1 could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:58:05.289809 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-fc180ae3-0462-49b0-a7b0-35b17ad18af5 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] 10.222.0.26 "GET /compute/v2.1/servers/a80fbf87-8203-4e6c-bee7-fe781bfccff1" status: 404 len: 111 microversion: 2.1 time: 0.053015 Oct 08 20:58:05.290402 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 873/1675] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:58:05 2022] GET /compute/v2.1/servers/a80fbf87-8203-4e6c-bee7-fe781bfccff1 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 20:58:05.303485 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-bcef12f1-4b5f-4503-a90d-ac29b0b51704 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:05.304004 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-bcef12f1-4b5f-4503-a90d-ac29b0b51704 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] [instance: 279361ef-2171-49e1-9f33-eadbf5dc0313] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:58:05.314393 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bcef12f1-4b5f-4503-a90d-ac29b0b51704 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:05.315361 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bcef12f1-4b5f-4503-a90d-ac29b0b51704 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:05.316292 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bcef12f1-4b5f-4503-a90d-ac29b0b51704 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:05.318123 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bcef12f1-4b5f-4503-a90d-ac29b0b51704 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:05.320302 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bcef12f1-4b5f-4503-a90d-ac29b0b51704 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:05.321019 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bcef12f1-4b5f-4503-a90d-ac29b0b51704 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:05.323130 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-f5d76465-3b57-40bd-90bc-88c42d3496a8 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01ec70849cfa44368a91df8b3410aba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c97b3b7fa484f97bdf40224f7cc34d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:58:05.333863 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-f5d76465-3b57-40bd-90bc-88c42d3496a8 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] 10.222.0.26 "GET /compute/v2.1/servers/e5389d1b-b9f3-491a-898c-be611599d73a" status: 200 len: 1524 microversion: 2.1 time: 0.247324 Oct 08 20:58:05.334463 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 803/1676] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:58:05 2022] GET /compute/v2.1/servers/e5389d1b-b9f3-491a-898c-be611599d73a => generated 1524 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 20:58:05.367522 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-bcef12f1-4b5f-4503-a90d-ac29b0b51704 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] [instance: 279361ef-2171-49e1-9f33-eadbf5dc0313] Going to try to terminate instance {{(pid=140492) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 20:58:05.415074 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-dc0442aa-4dbd-4e37-8508-29ee6a299f31 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Calling method '.version_select at 0x7f1a914cc310>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:05.500702 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-bcef12f1-4b5f-4503-a90d-ac29b0b51704 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] 10.222.0.26 "DELETE /compute/v2.1/servers/279361ef-2171-49e1-9f33-eadbf5dc0313" status: 204 len: 0 microversion: 2.1 time: 0.205528 Oct 08 20:58:05.501528 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 874/1677] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 20:58:05 2022] DELETE /compute/v2.1/servers/279361ef-2171-49e1-9f33-eadbf5dc0313 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 20:58:05.511185 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-c5ac460b-f355-4c04-b9a5-84dc225eac31 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:05.511917 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-c5ac460b-f355-4c04-b9a5-84dc225eac31 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] [instance: 8ceaf7df-4795-4969-be16-a2a1b94a3fa6] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:58:05.517375 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-dc0442aa-4dbd-4e37-8508-29ee6a299f31 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] 10.222.0.26 "GET /compute/v2.1/images/51380a40-a52a-46bf-a537-f30ae7be94ef" status: 200 len: 1419 microversion: 2.1 time: 0.107208 Oct 08 20:58:05.517967 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 804/1678] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:58:05 2022] GET /compute/v2.1/images/51380a40-a52a-46bf-a537-f30ae7be94ef => generated 1419 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:58:05.526152 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c5ac460b-f355-4c04-b9a5-84dc225eac31 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:05.526152 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c5ac460b-f355-4c04-b9a5-84dc225eac31 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:05.526152 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c5ac460b-f355-4c04-b9a5-84dc225eac31 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:05.526152 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c5ac460b-f355-4c04-b9a5-84dc225eac31 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:05.526152 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c5ac460b-f355-4c04-b9a5-84dc225eac31 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:05.526152 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c5ac460b-f355-4c04-b9a5-84dc225eac31 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:05.528832 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:58:05.539108 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-fbb77291-d144-47b4-bc25-dd53fe24d60f tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:05.539738 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-fbb77291-d144-47b4-bc25-dd53fe24d60f tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] [instance: 279361ef-2171-49e1-9f33-eadbf5dc0313] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:58:05.560169 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fbb77291-d144-47b4-bc25-dd53fe24d60f tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:05.561868 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fbb77291-d144-47b4-bc25-dd53fe24d60f tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:05.562345 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fbb77291-d144-47b4-bc25-dd53fe24d60f tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:05.563094 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fbb77291-d144-47b4-bc25-dd53fe24d60f tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:05.564481 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fbb77291-d144-47b4-bc25-dd53fe24d60f tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:05.565241 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fbb77291-d144-47b4-bc25-dd53fe24d60f tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:05.812774 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-fbb77291-d144-47b4-bc25-dd53fe24d60f tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474ca64d1b1d4e30916b517645aba882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecc2dd2407b4819874bed09cb27959a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:58:05.822617 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-fbb77291-d144-47b4-bc25-dd53fe24d60f tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] 10.222.0.26 "GET /compute/v2.1/servers/279361ef-2171-49e1-9f33-eadbf5dc0313" status: 200 len: 1500 microversion: 2.1 time: 0.293544 Oct 08 20:58:05.823452 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 805/1679] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:58:05 2022] GET /compute/v2.1/servers/279361ef-2171-49e1-9f33-eadbf5dc0313 => generated 1500 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:58:05.897711 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-c544f938-6abe-4c6b-b518-2be5dd6aed23 req-7fcb98f1-7a91-43cc-9950-a4d7141175f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19327d3e-de51-432b-b594-cb9a1bfe2f49", "name": "network-vif-plugged", "status": "completed", "tag": "6fbec29d-5924-4cc1-9f8d-c5ac27cbc284"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:58:05.915720 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-c544f938-6abe-4c6b-b518-2be5dd6aed23 req-7fcb98f1-7a91-43cc-9950-a4d7141175f1 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:05.918067 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-c544f938-6abe-4c6b-b518-2be5dd6aed23 req-7fcb98f1-7a91-43cc-9950-a4d7141175f1 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:05.922219 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-c5ac460b-f355-4c04-b9a5-84dc225eac31 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ddc3cd3c374bacbe5bf5e0877380e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8472b054404c46a99b81aba34d6b9f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:58:05.922424 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-c544f938-6abe-4c6b-b518-2be5dd6aed23 req-7fcb98f1-7a91-43cc-9950-a4d7141175f1 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:05.931219 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-c5ac460b-f355-4c04-b9a5-84dc225eac31 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] 10.222.0.26 "GET /compute/v2.1/servers/8ceaf7df-4795-4969-be16-a2a1b94a3fa6" status: 200 len: 1317 microversion: 2.1 time: 0.428130 Oct 08 20:58:05.935010 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 875/1680] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:58:05 2022] GET /compute/v2.1/servers/8ceaf7df-4795-4969-be16-a2a1b94a3fa6 => generated 1317 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:58:05.948550 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-c544f938-6abe-4c6b-b518-2be5dd6aed23 req-7fcb98f1-7a91-43cc-9950-a4d7141175f1 service nova] Creating event network-vif-plugged:6fbec29d-5924-4cc1-9f8d-c5ac27cbc284 for instance 19327d3e-de51-432b-b594-cb9a1bfe2f49 on nch1-master-1 Oct 08 20:58:05.959942 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-c544f938-6abe-4c6b-b518-2be5dd6aed23 req-7fcb98f1-7a91-43cc-9950-a4d7141175f1 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068471 Oct 08 20:58:05.963880 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 806/1681] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:58:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Oct 08 20:58:06.204771 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-5f45ab2b-40c1-4da8-a6ab-dad5ea1cebd3 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:06.205727 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-5f45ab2b-40c1-4da8-a6ab-dad5ea1cebd3 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] [instance: 74bdac1c-9b70-46f7-b671-9752894d8980] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:58:06.209754 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:58:06.214882 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5f45ab2b-40c1-4da8-a6ab-dad5ea1cebd3 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:06.216750 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5f45ab2b-40c1-4da8-a6ab-dad5ea1cebd3 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:06.232281 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5f45ab2b-40c1-4da8-a6ab-dad5ea1cebd3 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:06.233487 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5f45ab2b-40c1-4da8-a6ab-dad5ea1cebd3 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:06.234794 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5f45ab2b-40c1-4da8-a6ab-dad5ea1cebd3 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:06.236628 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5f45ab2b-40c1-4da8-a6ab-dad5ea1cebd3 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:06.358813 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-b1342ffe-3f8b-4648-94ca-1c0824299bea tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:06.360304 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-b1342ffe-3f8b-4648-94ca-1c0824299bea tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] [instance: e5389d1b-b9f3-491a-898c-be611599d73a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:58:06.374314 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b1342ffe-3f8b-4648-94ca-1c0824299bea tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:06.375084 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b1342ffe-3f8b-4648-94ca-1c0824299bea tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:06.375787 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b1342ffe-3f8b-4648-94ca-1c0824299bea tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:06.376764 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b1342ffe-3f8b-4648-94ca-1c0824299bea tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:06.381006 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b1342ffe-3f8b-4648-94ca-1c0824299bea tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:06.387310 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b1342ffe-3f8b-4648-94ca-1c0824299bea tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:06.787082 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-5f45ab2b-40c1-4da8-a6ab-dad5ea1cebd3 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:58:06.803356 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-5f45ab2b-40c1-4da8-a6ab-dad5ea1cebd3 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:58:06.804826 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-5f45ab2b-40c1-4da8-a6ab-dad5ea1cebd3 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:58:06.806377 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-5f45ab2b-40c1-4da8-a6ab-dad5ea1cebd3 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] 10.222.0.26 "GET /compute/v2.1/servers/74bdac1c-9b70-46f7-b671-9752894d8980" status: 200 len: 1488 microversion: 2.25 time: 0.606953 Oct 08 20:58:06.807464 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 876/1682] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:58:06 2022] GET /compute/v2.1/servers/74bdac1c-9b70-46f7-b671-9752894d8980 => generated 1488 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:58:06.812321 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-1da07dd6-fe3c-4920-a97e-7570e13257ec tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Calling method '.version_select at 0x7f1a8c0dc280>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:06.902286 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-1da07dd6-fe3c-4920-a97e-7570e13257ec tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] 10.222.0.26 "GET /compute/v2.1/images/51380a40-a52a-46bf-a537-f30ae7be94ef" status: 200 len: 1419 microversion: 2.1 time: 0.093403 Oct 08 20:58:06.902846 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 877/1683] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:58:06 2022] GET /compute/v2.1/images/51380a40-a52a-46bf-a537-f30ae7be94ef => generated 1419 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:58:06.909884 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-2b112ee6-18a8-4f4d-916a-93337b8117b7 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:06.915082 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-2b112ee6-18a8-4f4d-916a-93337b8117b7 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] [instance: 279361ef-2171-49e1-9f33-eadbf5dc0313] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:58:06.925262 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2b112ee6-18a8-4f4d-916a-93337b8117b7 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:06.927139 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2b112ee6-18a8-4f4d-916a-93337b8117b7 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:06.927758 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2b112ee6-18a8-4f4d-916a-93337b8117b7 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:06.928670 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2b112ee6-18a8-4f4d-916a-93337b8117b7 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:06.929338 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2b112ee6-18a8-4f4d-916a-93337b8117b7 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:06.929930 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2b112ee6-18a8-4f4d-916a-93337b8117b7 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:07.145853 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-b1342ffe-3f8b-4648-94ca-1c0824299bea tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01ec70849cfa44368a91df8b3410aba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c97b3b7fa484f97bdf40224f7cc34d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:58:07.157969 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-b1342ffe-3f8b-4648-94ca-1c0824299bea tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] 10.222.0.26 "GET /compute/v2.1/servers/e5389d1b-b9f3-491a-898c-be611599d73a" status: 200 len: 1524 microversion: 2.1 time: 0.804259 Oct 08 20:58:07.164997 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 807/1684] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:58:06 2022] GET /compute/v2.1/servers/e5389d1b-b9f3-491a-898c-be611599d73a => generated 1524 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:58:07.174369 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-2f987f55-6f4a-464e-a3f7-eab30a7b527d tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:07.179506 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-2f987f55-6f4a-464e-a3f7-eab30a7b527d tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] [instance: 8ceaf7df-4795-4969-be16-a2a1b94a3fa6] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:58:07.204382 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2f987f55-6f4a-464e-a3f7-eab30a7b527d tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:07.205226 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2f987f55-6f4a-464e-a3f7-eab30a7b527d tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:07.205845 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2f987f55-6f4a-464e-a3f7-eab30a7b527d tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:07.206733 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2f987f55-6f4a-464e-a3f7-eab30a7b527d tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:07.207394 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2f987f55-6f4a-464e-a3f7-eab30a7b527d tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:07.208000 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2f987f55-6f4a-464e-a3f7-eab30a7b527d tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:07.260472 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-2b112ee6-18a8-4f4d-916a-93337b8117b7 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474ca64d1b1d4e30916b517645aba882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecc2dd2407b4819874bed09cb27959a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:58:07.279875 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-2b112ee6-18a8-4f4d-916a-93337b8117b7 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] 10.222.0.26 "GET /compute/v2.1/servers/279361ef-2171-49e1-9f33-eadbf5dc0313" status: 200 len: 1500 microversion: 2.1 time: 0.368741 Oct 08 20:58:07.282747 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 878/1685] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:58:06 2022] GET /compute/v2.1/servers/279361ef-2171-49e1-9f33-eadbf5dc0313 => generated 1500 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:58:07.526934 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-a50cac7e-ffb0-4fa8-8eaf-9e4ca0970ee5 req-8b3259ca-3bfa-4cd1-a745-074be1d85a2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "279361ef-2171-49e1-9f33-eadbf5dc0313", "name": "network-vif-deleted", "tag": "331433c9-6d41-4903-b1f6-3eedf2e2ae2d"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:58:07.545262 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-2f987f55-6f4a-464e-a3f7-eab30a7b527d tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ddc3cd3c374bacbe5bf5e0877380e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8472b054404c46a99b81aba34d6b9f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:58:07.557971 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-a50cac7e-ffb0-4fa8-8eaf-9e4ca0970ee5 req-8b3259ca-3bfa-4cd1-a745-074be1d85a2c service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:07.558470 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-a50cac7e-ffb0-4fa8-8eaf-9e4ca0970ee5 req-8b3259ca-3bfa-4cd1-a745-074be1d85a2c service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:07.558935 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-a50cac7e-ffb0-4fa8-8eaf-9e4ca0970ee5 req-8b3259ca-3bfa-4cd1-a745-074be1d85a2c service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:07.560451 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-2f987f55-6f4a-464e-a3f7-eab30a7b527d tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] 10.222.0.26 "GET /compute/v2.1/servers/8ceaf7df-4795-4969-be16-a2a1b94a3fa6" status: 200 len: 1317 microversion: 2.1 time: 0.393464 Oct 08 20:58:07.561641 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 808/1686] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:58:07 2022] GET /compute/v2.1/servers/8ceaf7df-4795-4969-be16-a2a1b94a3fa6 => generated 1317 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:58:07.585818 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-a50cac7e-ffb0-4fa8-8eaf-9e4ca0970ee5 req-8b3259ca-3bfa-4cd1-a745-074be1d85a2c service nova] Creating event network-vif-deleted:331433c9-6d41-4903-b1f6-3eedf2e2ae2d for instance 279361ef-2171-49e1-9f33-eadbf5dc0313 on nch1-master-1 Oct 08 20:58:07.593245 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-a50cac7e-ffb0-4fa8-8eaf-9e4ca0970ee5 req-8b3259ca-3bfa-4cd1-a745-074be1d85a2c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073874 Oct 08 20:58:07.597115 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 879/1687] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:58:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:58:07.838965 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-8b4d463f-e27b-4147-94b6-8a63f730e63e tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:07.839455 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-8b4d463f-e27b-4147-94b6-8a63f730e63e tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] [instance: 74bdac1c-9b70-46f7-b671-9752894d8980] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:58:07.851889 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8b4d463f-e27b-4147-94b6-8a63f730e63e tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:07.852394 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8b4d463f-e27b-4147-94b6-8a63f730e63e tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:07.852841 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8b4d463f-e27b-4147-94b6-8a63f730e63e tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:07.859374 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8b4d463f-e27b-4147-94b6-8a63f730e63e tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:07.859647 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8b4d463f-e27b-4147-94b6-8a63f730e63e tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:07.860090 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8b4d463f-e27b-4147-94b6-8a63f730e63e tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:07.918020 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-88bc5d1d-7dd5-4c2d-a1fb-955c9aa4fd79 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Calling method '.version_select at 0x7f1a8c0dc670>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:08.015114 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-88bc5d1d-7dd5-4c2d-a1fb-955c9aa4fd79 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] 10.222.0.26 "GET /compute/v2.1/images/51380a40-a52a-46bf-a537-f30ae7be94ef" status: 200 len: 1419 microversion: 2.1 time: 0.090421 Oct 08 20:58:08.019344 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 880/1688] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:58:07 2022] GET /compute/v2.1/images/51380a40-a52a-46bf-a537-f30ae7be94ef => generated 1419 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:58:08.024402 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-3bfcc502-6573-4e79-946d-956c052eff95 req-12662233-b8a4-4d51-91f0-982854ca044f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ceaf7df-4795-4969-be16-a2a1b94a3fa6", "name": "network-vif-plugged", "status": "completed", "tag": "d52f6b6f-09bf-466a-abab-fe4533f27ab5"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:58:08.076938 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-3bfcc502-6573-4e79-946d-956c052eff95 req-12662233-b8a4-4d51-91f0-982854ca044f service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:08.077480 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-3bfcc502-6573-4e79-946d-956c052eff95 req-12662233-b8a4-4d51-91f0-982854ca044f service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:08.085658 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-3bfcc502-6573-4e79-946d-956c052eff95 req-12662233-b8a4-4d51-91f0-982854ca044f service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:08.128409 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-3bfcc502-6573-4e79-946d-956c052eff95 req-12662233-b8a4-4d51-91f0-982854ca044f service nova] Creating event network-vif-plugged:d52f6b6f-09bf-466a-abab-fe4533f27ab5 for instance 8ceaf7df-4795-4969-be16-a2a1b94a3fa6 on nch1-master-1 Oct 08 20:58:08.144142 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-3bfcc502-6573-4e79-946d-956c052eff95 req-12662233-b8a4-4d51-91f0-982854ca044f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123111 Oct 08 20:58:08.147397 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 881/1689] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:58:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:58:08.179603 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-8b4d463f-e27b-4147-94b6-8a63f730e63e tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:58:08.193293 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-9e86075e-dcc2-4cf6-be97-3b16f4fd251c tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:08.194746 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-9e86075e-dcc2-4cf6-be97-3b16f4fd251c tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] [instance: e5389d1b-b9f3-491a-898c-be611599d73a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:58:08.205297 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-8b4d463f-e27b-4147-94b6-8a63f730e63e tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:58:08.212177 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9e86075e-dcc2-4cf6-be97-3b16f4fd251c tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:08.213604 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9e86075e-dcc2-4cf6-be97-3b16f4fd251c tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:08.213762 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-8b4d463f-e27b-4147-94b6-8a63f730e63e tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:58:08.215268 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-8b4d463f-e27b-4147-94b6-8a63f730e63e tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] 10.222.0.26 "GET /compute/v2.1/servers/74bdac1c-9b70-46f7-b671-9752894d8980" status: 200 len: 1478 microversion: 2.25 time: 0.380180 Oct 08 20:58:08.215982 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9e86075e-dcc2-4cf6-be97-3b16f4fd251c tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:08.217322 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9e86075e-dcc2-4cf6-be97-3b16f4fd251c tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:08.230331 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9e86075e-dcc2-4cf6-be97-3b16f4fd251c tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:08.230804 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9e86075e-dcc2-4cf6-be97-3b16f4fd251c tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:08.232645 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 809/1690] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:58:07 2022] GET /compute/v2.1/servers/74bdac1c-9b70-46f7-b671-9752894d8980 => generated 1478 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:58:08.247621 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-7408f368-8d53-48ff-aa97-0b6de78490ca tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Calling method '.version_select at 0x7f1a8c642af0>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:08.253349 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7408f368-8d53-48ff-aa97-0b6de78490ca tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:08.261908 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7408f368-8d53-48ff-aa97-0b6de78490ca tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:08.264698 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7408f368-8d53-48ff-aa97-0b6de78490ca tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:08.293026 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-7408f368-8d53-48ff-aa97-0b6de78490ca tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] 10.222.0.26 "GET /compute/v2.1/os-migrations" status: 200 len: 2360 microversion: 2.25 time: 0.048993 Oct 08 20:58:08.305380 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 810/1691] 10.222.0.26 () {60 vars in 1184 bytes} [Sat Oct 8 20:58:08 2022] GET /compute/v2.1/os-migrations => generated 2360 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:58:08.311159 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-bdea3b8d-2465-4c6e-9589-1f87027a4982 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:08.321853 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-bdea3b8d-2465-4c6e-9589-1f87027a4982 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] [instance: 279361ef-2171-49e1-9f33-eadbf5dc0313] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:58:08.343278 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bdea3b8d-2465-4c6e-9589-1f87027a4982 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:08.348667 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bdea3b8d-2465-4c6e-9589-1f87027a4982 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:08.350797 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bdea3b8d-2465-4c6e-9589-1f87027a4982 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:08.352906 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bdea3b8d-2465-4c6e-9589-1f87027a4982 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:08.356104 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bdea3b8d-2465-4c6e-9589-1f87027a4982 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:08.359677 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bdea3b8d-2465-4c6e-9589-1f87027a4982 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:08.532187 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bdea3b8d-2465-4c6e-9589-1f87027a4982 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:08.534455 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bdea3b8d-2465-4c6e-9589-1f87027a4982 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:08.539714 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bdea3b8d-2465-4c6e-9589-1f87027a4982 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:08.541370 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.objects.instance [None req-bdea3b8d-2465-4c6e-9589-1f87027a4982 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lazy-loading 'fault' on Instance uuid 279361ef-2171-49e1-9f33-eadbf5dc0313 {{(pid=140491) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 20:58:08.586099 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-9e86075e-dcc2-4cf6-be97-3b16f4fd251c tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01ec70849cfa44368a91df8b3410aba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c97b3b7fa484f97bdf40224f7cc34d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:58:08.600114 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-9e86075e-dcc2-4cf6-be97-3b16f4fd251c tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] 10.222.0.26 "GET /compute/v2.1/servers/e5389d1b-b9f3-491a-898c-be611599d73a" status: 200 len: 1524 microversion: 2.1 time: 0.411935 Oct 08 20:58:08.601589 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 882/1692] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:58:08 2022] GET /compute/v2.1/servers/e5389d1b-b9f3-491a-898c-be611599d73a => generated 1524 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 20:58:08.617215 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-4969f1e7-b7fc-42a2-8bb5-7e53ae684229 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:08.617945 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-4969f1e7-b7fc-42a2-8bb5-7e53ae684229 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] [instance: 74bdac1c-9b70-46f7-b671-9752894d8980] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:58:08.632924 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4969f1e7-b7fc-42a2-8bb5-7e53ae684229 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:08.633906 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4969f1e7-b7fc-42a2-8bb5-7e53ae684229 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:08.634606 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4969f1e7-b7fc-42a2-8bb5-7e53ae684229 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:08.636209 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4969f1e7-b7fc-42a2-8bb5-7e53ae684229 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:08.640066 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4969f1e7-b7fc-42a2-8bb5-7e53ae684229 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:08.640817 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4969f1e7-b7fc-42a2-8bb5-7e53ae684229 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:08.746092 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-bdea3b8d-2465-4c6e-9589-1f87027a4982 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474ca64d1b1d4e30916b517645aba882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecc2dd2407b4819874bed09cb27959a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:58:08.759973 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-bdea3b8d-2465-4c6e-9589-1f87027a4982 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] 10.222.0.26 "GET /compute/v2.1/servers/279361ef-2171-49e1-9f33-eadbf5dc0313" status: 200 len: 1300 microversion: 2.1 time: 0.452515 Oct 08 20:58:08.760566 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 811/1693] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:58:08 2022] GET /compute/v2.1/servers/279361ef-2171-49e1-9f33-eadbf5dc0313 => generated 1300 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:58:08.787352 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-d656007d-1922-4852-b511-24c53bc94238 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:08.790104 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-d656007d-1922-4852-b511-24c53bc94238 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] [instance: 8ceaf7df-4795-4969-be16-a2a1b94a3fa6] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:58:08.804288 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d656007d-1922-4852-b511-24c53bc94238 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:08.805870 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d656007d-1922-4852-b511-24c53bc94238 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:08.806392 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d656007d-1922-4852-b511-24c53bc94238 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:08.807060 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d656007d-1922-4852-b511-24c53bc94238 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:08.807494 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d656007d-1922-4852-b511-24c53bc94238 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:08.807924 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d656007d-1922-4852-b511-24c53bc94238 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:08.851662 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:58:08.978234 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.objects.instance [None req-4969f1e7-b7fc-42a2-8bb5-7e53ae684229 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] Lazy-loading 'services' on Instance uuid 74bdac1c-9b70-46f7-b671-9752894d8980 {{(pid=140492) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 20:58:09.018695 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-4969f1e7-b7fc-42a2-8bb5-7e53ae684229 tempest-LiveAutoBlockMigrationV225Test-1752855597 tempest-LiveAutoBlockMigrationV225Test-1752855597-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/74bdac1c-9b70-46f7-b671-9752894d8980" status: 200 len: 1971 microversion: 2.25 time: 0.413273 Oct 08 20:58:09.029373 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 883/1694] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:58:08 2022] GET /compute/v2.1/servers/74bdac1c-9b70-46f7-b671-9752894d8980 => generated 1971 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:58:09.046328 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-f75c68a7-ae96-4cfa-9206-b5cae051d990 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Calling method '.version_select at 0x7f1a8c0dc550>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:09.138710 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-f75c68a7-ae96-4cfa-9206-b5cae051d990 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] 10.222.0.26 "GET /compute/v2.1/images/51380a40-a52a-46bf-a537-f30ae7be94ef" status: 200 len: 1419 microversion: 2.1 time: 0.107359 Oct 08 20:58:09.140959 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 884/1695] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:58:09 2022] GET /compute/v2.1/images/51380a40-a52a-46bf-a537-f30ae7be94ef => generated 1419 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:58:09.142954 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-d656007d-1922-4852-b511-24c53bc94238 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ddc3cd3c374bacbe5bf5e0877380e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8472b054404c46a99b81aba34d6b9f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:58:09.147346 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-924e014a-79d8-4ec4-b9ac-d7a6c48ec3db tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:09.148179 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-924e014a-79d8-4ec4-b9ac-d7a6c48ec3db tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] [instance: 74bdac1c-9b70-46f7-b671-9752894d8980] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:58:09.155195 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-d656007d-1922-4852-b511-24c53bc94238 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] 10.222.0.26 "GET /compute/v2.1/servers/8ceaf7df-4795-4969-be16-a2a1b94a3fa6" status: 200 len: 1317 microversion: 2.1 time: 0.384023 Oct 08 20:58:09.155564 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-924e014a-79d8-4ec4-b9ac-d7a6c48ec3db tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:09.156449 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-924e014a-79d8-4ec4-b9ac-d7a6c48ec3db tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:09.156826 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 812/1696] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:58:08 2022] GET /compute/v2.1/servers/8ceaf7df-4795-4969-be16-a2a1b94a3fa6 => generated 1317 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:58:09.157757 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-924e014a-79d8-4ec4-b9ac-d7a6c48ec3db tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:09.159074 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-924e014a-79d8-4ec4-b9ac-d7a6c48ec3db tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:09.159973 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-924e014a-79d8-4ec4-b9ac-d7a6c48ec3db tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:09.161292 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-924e014a-79d8-4ec4-b9ac-d7a6c48ec3db tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:09.193962 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-924e014a-79d8-4ec4-b9ac-d7a6c48ec3db tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] [instance: 74bdac1c-9b70-46f7-b671-9752894d8980] Going to try to terminate instance {{(pid=140492) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 20:58:09.297878 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-924e014a-79d8-4ec4-b9ac-d7a6c48ec3db tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] 10.222.0.26 "DELETE /compute/v2.1/servers/74bdac1c-9b70-46f7-b671-9752894d8980" status: 204 len: 0 microversion: 2.25 time: 0.155132 Oct 08 20:58:09.307417 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 885/1697] 10.222.0.26 () {60 vars in 1280 bytes} [Sat Oct 8 20:58:09 2022] DELETE /compute/v2.1/servers/74bdac1c-9b70-46f7-b671-9752894d8980 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 08 20:58:09.311396 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-20aabf72-4628-4b15-8f3b-538f70af7861 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:09.313118 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-20aabf72-4628-4b15-8f3b-538f70af7861 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] [instance: 74bdac1c-9b70-46f7-b671-9752894d8980] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:58:09.340661 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-20aabf72-4628-4b15-8f3b-538f70af7861 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:09.341242 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-20aabf72-4628-4b15-8f3b-538f70af7861 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:09.341847 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-20aabf72-4628-4b15-8f3b-538f70af7861 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:09.343666 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-20aabf72-4628-4b15-8f3b-538f70af7861 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:09.344486 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-20aabf72-4628-4b15-8f3b-538f70af7861 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:09.344927 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-20aabf72-4628-4b15-8f3b-538f70af7861 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:09.561496 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-20aabf72-4628-4b15-8f3b-538f70af7861 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:58:09.583149 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-20aabf72-4628-4b15-8f3b-538f70af7861 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:58:09.588110 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-20aabf72-4628-4b15-8f3b-538f70af7861 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:58:09.589422 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-20aabf72-4628-4b15-8f3b-538f70af7861 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] 10.222.0.26 "GET /compute/v2.1/servers/74bdac1c-9b70-46f7-b671-9752894d8980" status: 200 len: 1484 microversion: 2.25 time: 0.286342 Oct 08 20:58:09.590307 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 813/1698] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:58:09 2022] GET /compute/v2.1/servers/74bdac1c-9b70-46f7-b671-9752894d8980 => generated 1484 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 08 20:58:09.624566 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-cb72c78b-d0f2-418a-a43e-ee8a4cbdfa96 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:09.625601 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-cb72c78b-d0f2-418a-a43e-ee8a4cbdfa96 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] [instance: e5389d1b-b9f3-491a-898c-be611599d73a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:58:09.634414 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cb72c78b-d0f2-418a-a43e-ee8a4cbdfa96 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:09.635770 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cb72c78b-d0f2-418a-a43e-ee8a4cbdfa96 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:09.636280 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cb72c78b-d0f2-418a-a43e-ee8a4cbdfa96 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:09.637361 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cb72c78b-d0f2-418a-a43e-ee8a4cbdfa96 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:09.638009 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cb72c78b-d0f2-418a-a43e-ee8a4cbdfa96 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:09.638802 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cb72c78b-d0f2-418a-a43e-ee8a4cbdfa96 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:09.789812 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-362998ea-11cf-43dc-b137-2c7ad916f324 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:09.791146 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-362998ea-11cf-43dc-b137-2c7ad916f324 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] [instance: 279361ef-2171-49e1-9f33-eadbf5dc0313] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:58:09.798971 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-362998ea-11cf-43dc-b137-2c7ad916f324 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:09.799465 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-362998ea-11cf-43dc-b137-2c7ad916f324 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:09.799971 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-362998ea-11cf-43dc-b137-2c7ad916f324 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:09.800827 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-362998ea-11cf-43dc-b137-2c7ad916f324 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:09.801173 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-362998ea-11cf-43dc-b137-2c7ad916f324 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:09.801626 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-362998ea-11cf-43dc-b137-2c7ad916f324 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:09.828495 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-362998ea-11cf-43dc-b137-2c7ad916f324 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] HTTP exception thrown: Instance 279361ef-2171-49e1-9f33-eadbf5dc0313 could not be found. Oct 08 20:58:09.830212 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-362998ea-11cf-43dc-b137-2c7ad916f324 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Request method failure captured: Oct 08 20:58:09.830212 ncdv-master-1 devstack@n-api.service[140491]: request: GET /compute/v2.1/servers/279361ef-2171-49e1-9f33-eadbf5dc0313 HTTP/1.1 Oct 08 20:58:09.830212 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 20:58:09.830212 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 20:58:09.830212 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 20:58:09.830212 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 20:58:09.830212 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 20:58:09.830212 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 20:58:09.830212 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 20:58:09.830212 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 20:58:09.830212 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeMXC9JeN9Mlk5jzCgs-_cPtRtdIPAXhmbadFJaShbL5RJJyNFLD60Grhe8NzKLmyv9j_DFRSKoTNMw2TlfcMFQd60Gx2njCIaEqOyEM-mQSbVpxdhzzTuSuygraSUzGQKPLwQlBymj0axQFAl4TsB_9ApQq2i8hMTqwWvlfGcMSM0g Oct 08 20:58:09.830212 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 20:58:09.830212 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 20:58:09.830212 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 20:58:09.830212 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 20:58:09.830212 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 20:58:09.830212 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 20:58:09.830212 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 6ecc2dd2407b4819874bed09cb27959a Oct 08 20:58:09.830212 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-LiveMigrationTest-739175934 Oct 08 20:58:09.830212 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 20:58:09.830212 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 20:58:09.830212 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6ecc2dd2407b4819874bed09cb27959a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6ecc2dd2407b4819874bed09cb27959a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6ecc2dd2407b4819874bed09cb27959a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6ecc2dd2407b4819874bed09cb27959a"}]}] Oct 08 20:58:09.830212 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-LiveMigrationTest-739175934 Oct 08 20:58:09.830212 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 6ecc2dd2407b4819874bed09cb27959a Oct 08 20:58:09.830212 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-LiveMigrationTest-739175934 Oct 08 20:58:09.830212 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-LiveMigrationTest-739175934-project Oct 08 20:58:09.830212 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 20:58:09.830212 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 20:58:09.830212 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 474ca64d1b1d4e30916b517645aba882 Oct 08 20:58:09.830212 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-LiveMigrationTest-739175934-project Oct 08 20:58:09.830212 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 20:58:09.830212 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance 279361ef-2171-49e1-9f33-eadbf5dc0313 could not be found. Oct 08 20:58:09.830212 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': '279361ef-2171-49e1-9f33-eadbf5dc0313'} Oct 08 20:58:09.830212 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:58:09.830212 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:58:09.830212 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 20:58:09.830212 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 20:58:09.830212 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 20:58:09.830212 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 20:58:09.830212 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 20:58:09.830212 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 20:58:09.830212 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 20:58:09.830212 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 20:58:09.830212 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 279361ef-2171-49e1-9f33-eadbf5dc0313 could not be found. Oct 08 20:58:09.830212 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:58:09.830212 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:58:09.830212 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:58:09.830212 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:58:09.830212 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:58:09.830212 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:58:09.830212 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:58:09.830212 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:58:09.830212 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:58:09.830212 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:58:09.830212 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 20:58:09.830212 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 20:58:09.830212 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 20:58:09.830212 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 20:58:09.830212 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 20:58:09.830212 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 20:58:09.830212 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 279361ef-2171-49e1-9f33-eadbf5dc0313 could not be found. Oct 08 20:58:09.830212 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:58:09.830212 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:58:09.830212 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:58:09.837289 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:58:09.837289 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:58:09.837289 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:58:09.837289 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 20:58:09.837289 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 20:58:09.837289 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 279361ef-2171-49e1-9f33-eadbf5dc0313 could not be found. Oct 08 20:58:09.837289 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:58:09.837289 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-362998ea-11cf-43dc-b137-2c7ad916f324 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] Returning 404 to user: Instance 279361ef-2171-49e1-9f33-eadbf5dc0313 could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:58:09.837289 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-362998ea-11cf-43dc-b137-2c7ad916f324 tempest-LiveMigrationTest-739175934 tempest-LiveMigrationTest-739175934-project] 10.222.0.26 "GET /compute/v2.1/servers/279361ef-2171-49e1-9f33-eadbf5dc0313" status: 404 len: 111 microversion: 2.1 time: 0.047417 Oct 08 20:58:09.838295 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 814/1699] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:58:09 2022] GET /compute/v2.1/servers/279361ef-2171-49e1-9f33-eadbf5dc0313 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 08 20:58:09.876864 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-cb72c78b-d0f2-418a-a43e-ee8a4cbdfa96 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01ec70849cfa44368a91df8b3410aba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c97b3b7fa484f97bdf40224f7cc34d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:58:09.887266 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-cb72c78b-d0f2-418a-a43e-ee8a4cbdfa96 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] 10.222.0.26 "GET /compute/v2.1/servers/e5389d1b-b9f3-491a-898c-be611599d73a" status: 200 len: 1524 microversion: 2.1 time: 0.266979 Oct 08 20:58:09.887853 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 886/1700] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:58:09 2022] GET /compute/v2.1/servers/e5389d1b-b9f3-491a-898c-be611599d73a => generated 1524 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:58:10.156815 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-deeae04a-fac0-437d-bbf2-b05e0ab630fa tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Calling method '.version_select at 0x7f1a8c638d30>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:10.185053 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-57b03bb9-e894-483a-b5f8-8cf3db1c731a tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:10.186501 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-57b03bb9-e894-483a-b5f8-8cf3db1c731a tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] [instance: 8ceaf7df-4795-4969-be16-a2a1b94a3fa6] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:58:10.196974 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-57b03bb9-e894-483a-b5f8-8cf3db1c731a tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:10.201513 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-57b03bb9-e894-483a-b5f8-8cf3db1c731a tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:10.203319 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-57b03bb9-e894-483a-b5f8-8cf3db1c731a tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:10.204350 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-57b03bb9-e894-483a-b5f8-8cf3db1c731a tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:10.206198 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-57b03bb9-e894-483a-b5f8-8cf3db1c731a tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:10.206891 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-57b03bb9-e894-483a-b5f8-8cf3db1c731a tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:10.257306 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-deeae04a-fac0-437d-bbf2-b05e0ab630fa tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] 10.222.0.26 "GET /compute/v2.1/images/51380a40-a52a-46bf-a537-f30ae7be94ef" status: 200 len: 1419 microversion: 2.1 time: 0.105125 Oct 08 20:58:10.266880 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 815/1701] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:58:10 2022] GET /compute/v2.1/images/51380a40-a52a-46bf-a537-f30ae7be94ef => generated 1419 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:58:10.575021 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-57b03bb9-e894-483a-b5f8-8cf3db1c731a tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ddc3cd3c374bacbe5bf5e0877380e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8472b054404c46a99b81aba34d6b9f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:58:10.591087 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-57b03bb9-e894-483a-b5f8-8cf3db1c731a tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] 10.222.0.26 "GET /compute/v2.1/servers/8ceaf7df-4795-4969-be16-a2a1b94a3fa6" status: 200 len: 1467 microversion: 2.1 time: 0.410394 Oct 08 20:58:10.606313 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 887/1702] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:58:10 2022] GET /compute/v2.1/servers/8ceaf7df-4795-4969-be16-a2a1b94a3fa6 => generated 1467 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:58:10.616426 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-266854fa-8273-492f-8f85-c0d84697e248 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:10.617433 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-266854fa-8273-492f-8f85-c0d84697e248 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] [instance: 74bdac1c-9b70-46f7-b671-9752894d8980] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:58:10.636334 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-266854fa-8273-492f-8f85-c0d84697e248 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:10.638283 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-266854fa-8273-492f-8f85-c0d84697e248 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:10.639134 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-266854fa-8273-492f-8f85-c0d84697e248 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:10.640230 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-266854fa-8273-492f-8f85-c0d84697e248 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:10.646165 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-266854fa-8273-492f-8f85-c0d84697e248 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:10.647241 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-266854fa-8273-492f-8f85-c0d84697e248 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:10.784796 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-450e226b-ce7b-42b5-91ab-c59b2a07366c tempest-ServersOnMultiNodesTest-429096361 tempest-ServersOnMultiNodesTest-429096361-project-admin] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:10.785732 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-450e226b-ce7b-42b5-91ab-c59b2a07366c tempest-ServersOnMultiNodesTest-429096361 tempest-ServersOnMultiNodesTest-429096361-project-admin] [instance: 8ceaf7df-4795-4969-be16-a2a1b94a3fa6] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:58:10.802542 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-450e226b-ce7b-42b5-91ab-c59b2a07366c tempest-ServersOnMultiNodesTest-429096361 tempest-ServersOnMultiNodesTest-429096361-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:10.803864 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-450e226b-ce7b-42b5-91ab-c59b2a07366c tempest-ServersOnMultiNodesTest-429096361 tempest-ServersOnMultiNodesTest-429096361-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:10.804971 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-450e226b-ce7b-42b5-91ab-c59b2a07366c tempest-ServersOnMultiNodesTest-429096361 tempest-ServersOnMultiNodesTest-429096361-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:10.808677 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-450e226b-ce7b-42b5-91ab-c59b2a07366c tempest-ServersOnMultiNodesTest-429096361 tempest-ServersOnMultiNodesTest-429096361-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:10.811254 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-450e226b-ce7b-42b5-91ab-c59b2a07366c tempest-ServersOnMultiNodesTest-429096361 tempest-ServersOnMultiNodesTest-429096361-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:10.813472 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-450e226b-ce7b-42b5-91ab-c59b2a07366c tempest-ServersOnMultiNodesTest-429096361 tempest-ServersOnMultiNodesTest-429096361-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:11.364993 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-266854fa-8273-492f-8f85-c0d84697e248 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:58:11.379186 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-266854fa-8273-492f-8f85-c0d84697e248 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:58:11.384003 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-266854fa-8273-492f-8f85-c0d84697e248 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:58:11.394121 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-266854fa-8273-492f-8f85-c0d84697e248 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] 10.222.0.26 "GET /compute/v2.1/servers/74bdac1c-9b70-46f7-b671-9752894d8980" status: 200 len: 1484 microversion: 2.25 time: 0.782240 Oct 08 20:58:11.395891 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 816/1703] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:58:10 2022] GET /compute/v2.1/servers/74bdac1c-9b70-46f7-b671-9752894d8980 => generated 1484 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:58:11.406119 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-09d0817c-98ff-4a4e-8fad-8f261a71b5af tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:11.406985 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-09d0817c-98ff-4a4e-8fad-8f261a71b5af tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] [instance: e5389d1b-b9f3-491a-898c-be611599d73a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:58:11.429084 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-09d0817c-98ff-4a4e-8fad-8f261a71b5af tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:11.429884 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-09d0817c-98ff-4a4e-8fad-8f261a71b5af tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:11.430591 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-09d0817c-98ff-4a4e-8fad-8f261a71b5af tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:11.431556 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-09d0817c-98ff-4a4e-8fad-8f261a71b5af tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:11.432871 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-09d0817c-98ff-4a4e-8fad-8f261a71b5af tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:11.452267 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-09d0817c-98ff-4a4e-8fad-8f261a71b5af tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:11.504631 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-450e226b-ce7b-42b5-91ab-c59b2a07366c tempest-ServersOnMultiNodesTest-429096361 tempest-ServersOnMultiNodesTest-429096361-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/8ceaf7df-4795-4969-be16-a2a1b94a3fa6" status: 200 len: 1618 microversion: 2.1 time: 0.881602 Oct 08 20:58:11.505959 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 888/1704] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:58:10 2022] GET /compute/v2.1/servers/8ceaf7df-4795-4969-be16-a2a1b94a3fa6 => generated 1618 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:58:11.526419 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-b4c7ff49-3a54-4098-8a58-9ade7790e650 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Calling method '.version_select at 0x7f1a8c0b4430>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:11.577239 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-b4c7ff49-3a54-4098-8a58-9ade7790e650 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] 10.222.0.26 "GET /compute/v2.1/images/51380a40-a52a-46bf-a537-f30ae7be94ef" status: 200 len: 1419 microversion: 2.1 time: 0.054467 Oct 08 20:58:11.578634 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 889/1705] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:58:11 2022] GET /compute/v2.1/images/51380a40-a52a-46bf-a537-f30ae7be94ef => generated 1419 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:58:11.586434 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-3301ccf4-fee3-42b2-abb4-f35d1fba05ca tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Action: 'create', calling method: .version_select at 0x7f1a8c20f5e0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-455958083", "policies": ["affinity"]}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:58:11.615246 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-3301ccf4-fee3-42b2-abb4-f35d1fba05ca tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Getting quotas for project 8472b054404c46a99b81aba34d6b9f40. Resources: {'server_groups'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 20:58:11.625743 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-3301ccf4-fee3-42b2-abb4-f35d1fba05ca tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Getting quotas for user 67ddc3cd3c374bacbe5bf5e0877380e2 and project 8472b054404c46a99b81aba34d6b9f40. Resources: {'server_groups'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 20:58:11.697521 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-3301ccf4-fee3-42b2-abb4-f35d1fba05ca tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Getting quotas for project 8472b054404c46a99b81aba34d6b9f40. Resources: {'server_groups'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 20:58:11.707920 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-3301ccf4-fee3-42b2-abb4-f35d1fba05ca tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Getting quotas for user 67ddc3cd3c374bacbe5bf5e0877380e2 and project 8472b054404c46a99b81aba34d6b9f40. Resources: {'server_groups'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 20:58:11.723849 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-3301ccf4-fee3-42b2-abb4-f35d1fba05ca tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] 10.222.0.26 "POST /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.144043 Oct 08 20:58:11.733652 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 890/1706] 10.222.0.26 () {60 vars in 1174 bytes} [Sat Oct 8 20:58:11 2022] POST /compute/v2.1/os-server-groups => generated 187 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:58:11.876774 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-8a6c7f14-3eb8-47ac-b95c-2d3397598f5e tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1711394474", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "b66c37e0-ab81-4b03-9a68-eb3fe9175719"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:58:11.947989 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-09d0817c-98ff-4a4e-8fad-8f261a71b5af tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01ec70849cfa44368a91df8b3410aba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c97b3b7fa484f97bdf40224f7cc34d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:58:11.958491 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-09d0817c-98ff-4a4e-8fad-8f261a71b5af tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] 10.222.0.26 "GET /compute/v2.1/servers/e5389d1b-b9f3-491a-898c-be611599d73a" status: 200 len: 1524 microversion: 2.1 time: 0.561248 Oct 08 20:58:11.962294 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 817/1707] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:58:11 2022] GET /compute/v2.1/servers/e5389d1b-b9f3-491a-898c-be611599d73a => generated 1524 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:58:11.986478 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.network.neutron [None req-8a6c7f14-3eb8-47ac-b95c-2d3397598f5e tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] validate_networks() for None {{(pid=140492) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 20:58:12.296024 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-8a6c7f14-3eb8-47ac-b95c-2d3397598f5e tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Flavor limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 20:58:12.296996 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-8a6c7f14-3eb8-47ac-b95c-2d3397598f5e tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Image limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 20:58:12.297680 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-8a6c7f14-3eb8-47ac-b95c-2d3397598f5e tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Flavor pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 20:58:12.298257 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-8a6c7f14-3eb8-47ac-b95c-2d3397598f5e tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Image pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 20:58:12.298857 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-8a6c7f14-3eb8-47ac-b95c-2d3397598f5e tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 20:58:12.322606 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8a6c7f14-3eb8-47ac-b95c-2d3397598f5e tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:12.323128 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8a6c7f14-3eb8-47ac-b95c-2d3397598f5e tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:12.323635 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8a6c7f14-3eb8-47ac-b95c-2d3397598f5e tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:12.324399 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8a6c7f14-3eb8-47ac-b95c-2d3397598f5e tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:12.324857 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8a6c7f14-3eb8-47ac-b95c-2d3397598f5e tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:12.325510 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8a6c7f14-3eb8-47ac-b95c-2d3397598f5e tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:12.347359 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-8a6c7f14-3eb8-47ac-b95c-2d3397598f5e tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Getting quotas for project 8472b054404c46a99b81aba34d6b9f40. Resources: {'cores', 'instances', 'ram'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 20:58:12.360898 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-8a6c7f14-3eb8-47ac-b95c-2d3397598f5e tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Getting quotas for user 67ddc3cd3c374bacbe5bf5e0877380e2 and project 8472b054404c46a99b81aba34d6b9f40. Resources: {'cores', 'instances', 'ram'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 20:58:12.375599 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-8a6c7f14-3eb8-47ac-b95c-2d3397598f5e tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Going to run 2 instances... {{(pid=140492) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 20:58:12.378653 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-8a6c7f14-3eb8-47ac-b95c-2d3397598f5e tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] [instance: edebb288-3d28-4432-b9fd-d74cfb2de586] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c508bd7f-7db9-4b2c-af7c-be54a855c355',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140492) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 20:58:12.424586 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-1b529fa2-36a7-427e-b558-a0805f383280 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:12.426105 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-1b529fa2-36a7-427e-b558-a0805f383280 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] [instance: 74bdac1c-9b70-46f7-b671-9752894d8980] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:58:12.438903 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1b529fa2-36a7-427e-b558-a0805f383280 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:12.439812 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1b529fa2-36a7-427e-b558-a0805f383280 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:12.442454 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1b529fa2-36a7-427e-b558-a0805f383280 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:12.443591 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1b529fa2-36a7-427e-b558-a0805f383280 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:12.444394 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1b529fa2-36a7-427e-b558-a0805f383280 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:12.445524 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1b529fa2-36a7-427e-b558-a0805f383280 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:12.448731 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-8a6c7f14-3eb8-47ac-b95c-2d3397598f5e tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=140492) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Oct 08 20:58:12.485010 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-8a6c7f14-3eb8-47ac-b95c-2d3397598f5e tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Getting quotas for project 8472b054404c46a99b81aba34d6b9f40. Resources: {'server_group_members'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 20:58:12.492397 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-8a6c7f14-3eb8-47ac-b95c-2d3397598f5e tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Getting quotas for user 67ddc3cd3c374bacbe5bf5e0877380e2 and project 8472b054404c46a99b81aba34d6b9f40. Resources: {'server_group_members'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 20:58:12.584185 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-8a6c7f14-3eb8-47ac-b95c-2d3397598f5e tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Getting quotas for project 8472b054404c46a99b81aba34d6b9f40. Resources: {'server_group_members'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 20:58:12.594872 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-8a6c7f14-3eb8-47ac-b95c-2d3397598f5e tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Getting quotas for user 67ddc3cd3c374bacbe5bf5e0877380e2 and project 8472b054404c46a99b81aba34d6b9f40. Resources: {'server_group_members'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 20:58:12.620629 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-8a6c7f14-3eb8-47ac-b95c-2d3397598f5e tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] [instance: 84a8a931-6a18-4ef4-9e3c-63cf4054ea43] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c508bd7f-7db9-4b2c-af7c-be54a855c355',instance=,instance_uuid=edebb288-3d28-4432-b9fd-d74cfb2de586,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140492) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 20:58:12.670894 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=1,nova_api:INSERT=9 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:58:12.698519 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-8a6c7f14-3eb8-47ac-b95c-2d3397598f5e tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Getting quotas for project 8472b054404c46a99b81aba34d6b9f40. Resources: {'server_group_members'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 20:58:12.704756 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-8a6c7f14-3eb8-47ac-b95c-2d3397598f5e tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Getting quotas for user 67ddc3cd3c374bacbe5bf5e0877380e2 and project 8472b054404c46a99b81aba34d6b9f40. Resources: {'server_group_members'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 20:58:12.779549 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-8a6c7f14-3eb8-47ac-b95c-2d3397598f5e tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Getting quotas for project 8472b054404c46a99b81aba34d6b9f40. Resources: {'server_group_members'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 20:58:12.787762 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-8a6c7f14-3eb8-47ac-b95c-2d3397598f5e tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Getting quotas for user 67ddc3cd3c374bacbe5bf5e0877380e2 and project 8472b054404c46a99b81aba34d6b9f40. Resources: {'server_group_members'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 20:58:12.838630 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-8a6c7f14-3eb8-47ac-b95c-2d3397598f5e tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 0.967403 Oct 08 20:58:12.843303 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 891/1708] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 20:58:11 2022] POST /compute/v2.1/servers => generated 32 bytes in 973 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 08 20:58:12.849784 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-b48e85fd-bdb0-40f6-8086-d38c81677b45 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Calling method '.version_select at 0x7f1a8c062ee0>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:12.915955 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-b48e85fd-bdb0-40f6-8086-d38c81677b45 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] 10.222.0.26 "GET /compute/v2.1/images/51380a40-a52a-46bf-a537-f30ae7be94ef" status: 200 len: 1419 microversion: 2.1 time: 0.071131 Oct 08 20:58:12.924732 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-1b529fa2-36a7-427e-b558-a0805f383280 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:58:12.926835 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 892/1709] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:58:12 2022] GET /compute/v2.1/images/51380a40-a52a-46bf-a537-f30ae7be94ef => generated 1419 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:58:12.932961 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-55cd06cd-4b5b-480d-b30e-6da91a7a29b5 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:12.938542 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-1b529fa2-36a7-427e-b558-a0805f383280 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:58:12.939344 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-55cd06cd-4b5b-480d-b30e-6da91a7a29b5 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '67ddc3cd3c374bacbe5bf5e0877380e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8472b054404c46a99b81aba34d6b9f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:58:12.940335 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-55cd06cd-4b5b-480d-b30e-6da91a7a29b5 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Searching by: {'deleted': False, 'project_id': '8472b054404c46a99b81aba34d6b9f40'} {{(pid=140492) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 08 20:58:12.940804 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-1b529fa2-36a7-427e-b558-a0805f383280 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:58:12.942314 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-1b529fa2-36a7-427e-b558-a0805f383280 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] 10.222.0.26 "GET /compute/v2.1/servers/74bdac1c-9b70-46f7-b671-9752894d8980" status: 200 len: 1442 microversion: 2.25 time: 0.522048 Oct 08 20:58:12.943261 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 818/1710] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:58:12 2022] GET /compute/v2.1/servers/74bdac1c-9b70-46f7-b671-9752894d8980 => generated 1442 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 08 20:58:12.958418 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-c6780465-5c85-4ee9-bda1-93ecf3e4cc95 req-c8fb9e46-3585-4cb7-9204-808e24e81e7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74bdac1c-9b70-46f7-b671-9752894d8980", "name": "network-vif-deleted", "tag": "6bec4ac2-ff67-4158-be6a-9cd282b10d00"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:58:12.960672 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-55cd06cd-4b5b-480d-b30e-6da91a7a29b5 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:12.961316 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-55cd06cd-4b5b-480d-b30e-6da91a7a29b5 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:12.961831 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-55cd06cd-4b5b-480d-b30e-6da91a7a29b5 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:12.963321 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-55cd06cd-4b5b-480d-b30e-6da91a7a29b5 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:12.964385 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-55cd06cd-4b5b-480d-b30e-6da91a7a29b5 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:12.964550 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-55cd06cd-4b5b-480d-b30e-6da91a7a29b5 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:12.977486 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-c6780465-5c85-4ee9-bda1-93ecf3e4cc95 req-c8fb9e46-3585-4cb7-9204-808e24e81e7b service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:12.980348 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-c6780465-5c85-4ee9-bda1-93ecf3e4cc95 req-c8fb9e46-3585-4cb7-9204-808e24e81e7b service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:12.983907 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-c6780465-5c85-4ee9-bda1-93ecf3e4cc95 req-c8fb9e46-3585-4cb7-9204-808e24e81e7b service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:12.999612 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.multi_cell_list [None req-55cd06cd-4b5b-480d-b30e-6da91a7a29b5 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=140492) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 08 20:58:13.051576 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-c6780465-5c85-4ee9-bda1-93ecf3e4cc95 req-c8fb9e46-3585-4cb7-9204-808e24e81e7b service nova] Creating event network-vif-deleted:6bec4ac2-ff67-4158-be6a-9cd282b10d00 for instance 74bdac1c-9b70-46f7-b671-9752894d8980 on nch1-master-1 Oct 08 20:58:13.063280 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-55cd06cd-4b5b-480d-b30e-6da91a7a29b5 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] 10.222.0.26 "GET /compute/v2.1/servers" status: 200 len: 1004 microversion: 2.1 time: 0.134498 Oct 08 20:58:13.063884 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 893/1711] 10.222.0.26 () {58 vars in 1125 bytes} [Sat Oct 8 20:58:12 2022] GET /compute/v2.1/servers => generated 1004 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:58:13.081845 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-f5dce15d-4a1f-477e-bb38-1283ba74d70c tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:13.083115 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-f5dce15d-4a1f-477e-bb38-1283ba74d70c tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] [instance: e5389d1b-b9f3-491a-898c-be611599d73a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:58:13.096142 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-c6780465-5c85-4ee9-bda1-93ecf3e4cc95 req-c8fb9e46-3585-4cb7-9204-808e24e81e7b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141542 Oct 08 20:58:13.097788 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 819/1712] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:58:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:58:13.104894 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f5dce15d-4a1f-477e-bb38-1283ba74d70c tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:13.105450 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f5dce15d-4a1f-477e-bb38-1283ba74d70c tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:13.105892 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f5dce15d-4a1f-477e-bb38-1283ba74d70c tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:13.107129 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f5dce15d-4a1f-477e-bb38-1283ba74d70c tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:13.107129 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f5dce15d-4a1f-477e-bb38-1283ba74d70c tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:13.114038 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f5dce15d-4a1f-477e-bb38-1283ba74d70c tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:13.115870 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-6d58ae3f-7ea7-4eb0-9f65-0ca14e183b9e tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:13.116860 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-6d58ae3f-7ea7-4eb0-9f65-0ca14e183b9e tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] [instance: 84a8a931-6a18-4ef4-9e3c-63cf4054ea43] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:58:13.431940 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-f5dce15d-4a1f-477e-bb38-1283ba74d70c tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01ec70849cfa44368a91df8b3410aba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c97b3b7fa484f97bdf40224f7cc34d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:58:13.454249 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-f5dce15d-4a1f-477e-bb38-1283ba74d70c tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] 10.222.0.26 "GET /compute/v2.1/servers/e5389d1b-b9f3-491a-898c-be611599d73a" status: 200 len: 1524 microversion: 2.1 time: 0.389292 Oct 08 20:58:13.470702 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 894/1713] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:58:13 2022] GET /compute/v2.1/servers/e5389d1b-b9f3-491a-898c-be611599d73a => generated 1524 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:58:13.471086 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-6d58ae3f-7ea7-4eb0-9f65-0ca14e183b9e tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ddc3cd3c374bacbe5bf5e0877380e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8472b054404c46a99b81aba34d6b9f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:58:13.480823 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-6d58ae3f-7ea7-4eb0-9f65-0ca14e183b9e tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] 10.222.0.26 "GET /compute/v2.1/servers/84a8a931-6a18-4ef4-9e3c-63cf4054ea43" status: 200 len: 1219 microversion: 2.1 time: 0.378565 Oct 08 20:58:13.500255 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 820/1714] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:58:13 2022] GET /compute/v2.1/servers/84a8a931-6a18-4ef4-9e3c-63cf4054ea43 => generated 1219 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:58:13.932263 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-3ae174e9-b0a0-4c27-9502-b0b67a0fe55b tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Calling method '.version_select at 0x7f1a8c087940>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:13.980972 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-af99811f-dc00-4fa7-8885-ee156d6751dd tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:13.982570 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-af99811f-dc00-4fa7-8885-ee156d6751dd tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] [instance: 74bdac1c-9b70-46f7-b671-9752894d8980] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:58:14.007183 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-af99811f-dc00-4fa7-8885-ee156d6751dd tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:14.008376 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-af99811f-dc00-4fa7-8885-ee156d6751dd tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:14.009127 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-af99811f-dc00-4fa7-8885-ee156d6751dd tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:14.010711 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-af99811f-dc00-4fa7-8885-ee156d6751dd tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:14.011454 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-af99811f-dc00-4fa7-8885-ee156d6751dd tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:14.015666 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-af99811f-dc00-4fa7-8885-ee156d6751dd tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:14.038430 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-3ae174e9-b0a0-4c27-9502-b0b67a0fe55b tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] 10.222.0.26 "GET /compute/v2.1/images/51380a40-a52a-46bf-a537-f30ae7be94ef" status: 200 len: 1419 microversion: 2.1 time: 0.110289 Oct 08 20:58:14.039336 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 895/1715] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:58:13 2022] GET /compute/v2.1/images/51380a40-a52a-46bf-a537-f30ae7be94ef => generated 1419 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 20:58:14.059125 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-af99811f-dc00-4fa7-8885-ee156d6751dd tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] HTTP exception thrown: Instance 74bdac1c-9b70-46f7-b671-9752894d8980 could not be found. Oct 08 20:58:14.065314 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-af99811f-dc00-4fa7-8885-ee156d6751dd tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Request method failure captured: Oct 08 20:58:14.065314 ncdv-master-1 devstack@n-api.service[140491]: request: GET /compute/v2.1/servers/74bdac1c-9b70-46f7-b671-9752894d8980 HTTP/1.1 Oct 08 20:58:14.065314 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 20:58:14.065314 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 20:58:14.065314 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 20:58:14.065314 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 20:58:14.065314 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 20:58:14.065314 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 20:58:14.065314 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 20:58:14.065314 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 20:58:14.065314 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeM_8itqsdTjDSrlGxZZ-u44pmaEYPSQW4Sfx3OogMOjCfNSG1scpEldctJo7eYijpgGhtozXKwLr8evVzi5nf4wuH1lfEdHrH_7IHaykS_Ns0neu4keC9kqpsLbriJukycX0gnBg9-m0XH6tiS45uipRftXY8tUpNqJ0OB6f1O8wUg Oct 08 20:58:14.065314 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 20:58:14.065314 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 20:58:14.065314 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 20:58:14.065314 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 20:58:14.065314 ncdv-master-1 devstack@n-api.service[140491]: X-Openstack-Nova-Api-Version: 2.25 Oct 08 20:58:14.065314 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 20:58:14.065314 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 20:58:14.065314 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: ac5c7906a4714a1887cb823e1c3a6056 Oct 08 20:58:14.065314 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-2037918034 Oct 08 20:58:14.065314 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 20:58:14.065314 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 20:58:14.065314 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ac5c7906a4714a1887cb823e1c3a6056"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ac5c7906a4714a1887cb823e1c3a6056"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ac5c7906a4714a1887cb823e1c3a6056"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ac5c7906a4714a1887cb823e1c3a6056"}]}] Oct 08 20:58:14.065314 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-2037918034 Oct 08 20:58:14.065314 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: ac5c7906a4714a1887cb823e1c3a6056 Oct 08 20:58:14.065314 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-2037918034 Oct 08 20:58:14.065314 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-LiveAutoBlockMigrationV225Test-2037918034-project Oct 08 20:58:14.065314 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 20:58:14.065314 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 20:58:14.065314 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: d54b1c5c00544be4b60132d09817c8d6 Oct 08 20:58:14.065314 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-2037918034-project Oct 08 20:58:14.065314 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 20:58:14.065314 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance 74bdac1c-9b70-46f7-b671-9752894d8980 could not be found. Oct 08 20:58:14.065314 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': '74bdac1c-9b70-46f7-b671-9752894d8980'} Oct 08 20:58:14.065314 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:58:14.065314 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:58:14.065314 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 20:58:14.065314 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 20:58:14.065314 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 20:58:14.065314 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 20:58:14.065314 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 20:58:14.065314 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 20:58:14.065314 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 20:58:14.065314 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 20:58:14.065314 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74bdac1c-9b70-46f7-b671-9752894d8980 could not be found. Oct 08 20:58:14.065314 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:58:14.065314 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:58:14.065314 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:58:14.065314 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:58:14.065314 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:58:14.065314 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:58:14.065314 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:58:14.065314 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:58:14.065314 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:58:14.065314 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:58:14.065314 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 20:58:14.065314 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 20:58:14.065314 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 20:58:14.065314 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 20:58:14.065314 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 20:58:14.065314 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 20:58:14.065314 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74bdac1c-9b70-46f7-b671-9752894d8980 could not be found. Oct 08 20:58:14.065314 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:58:14.074926 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:58:14.074926 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:58:14.074926 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:58:14.074926 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:58:14.074926 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:58:14.074926 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 20:58:14.074926 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 20:58:14.074926 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74bdac1c-9b70-46f7-b671-9752894d8980 could not be found. Oct 08 20:58:14.074926 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:58:14.074926 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-af99811f-dc00-4fa7-8885-ee156d6751dd tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Returning 404 to user: Instance 74bdac1c-9b70-46f7-b671-9752894d8980 could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:58:14.074926 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-af99811f-dc00-4fa7-8885-ee156d6751dd tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] 10.222.0.26 "GET /compute/v2.1/servers/74bdac1c-9b70-46f7-b671-9752894d8980" status: 404 len: 111 microversion: 2.25 time: 0.093440 Oct 08 20:58:14.074926 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 821/1716] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:58:13 2022] GET /compute/v2.1/servers/74bdac1c-9b70-46f7-b671-9752894d8980 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 08 20:58:14.508737 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-078722eb-b6b5-4968-bd04-aaac73aceded tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:14.510609 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-078722eb-b6b5-4968-bd04-aaac73aceded tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] [instance: e5389d1b-b9f3-491a-898c-be611599d73a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:58:14.518480 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-cd13f3fc-31bb-4e6b-890b-6f5732fc755b tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:14.530741 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-cd13f3fc-31bb-4e6b-890b-6f5732fc755b tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] [instance: 84a8a931-6a18-4ef4-9e3c-63cf4054ea43] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:58:14.542997 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-078722eb-b6b5-4968-bd04-aaac73aceded tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:14.546193 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-078722eb-b6b5-4968-bd04-aaac73aceded tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:14.549310 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-078722eb-b6b5-4968-bd04-aaac73aceded tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:14.551050 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-078722eb-b6b5-4968-bd04-aaac73aceded tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:14.553484 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-078722eb-b6b5-4968-bd04-aaac73aceded tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:14.556597 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-078722eb-b6b5-4968-bd04-aaac73aceded tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:14.570261 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cd13f3fc-31bb-4e6b-890b-6f5732fc755b tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:14.570795 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cd13f3fc-31bb-4e6b-890b-6f5732fc755b tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:14.571255 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cd13f3fc-31bb-4e6b-890b-6f5732fc755b tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:14.572002 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cd13f3fc-31bb-4e6b-890b-6f5732fc755b tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:14.584036 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cd13f3fc-31bb-4e6b-890b-6f5732fc755b tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:14.589172 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cd13f3fc-31bb-4e6b-890b-6f5732fc755b tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:14.900479 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-cd13f3fc-31bb-4e6b-890b-6f5732fc755b tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ddc3cd3c374bacbe5bf5e0877380e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8472b054404c46a99b81aba34d6b9f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:58:14.920882 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-cd13f3fc-31bb-4e6b-890b-6f5732fc755b tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] 10.222.0.26 "GET /compute/v2.1/servers/84a8a931-6a18-4ef4-9e3c-63cf4054ea43" status: 200 len: 1215 microversion: 2.1 time: 0.416474 Oct 08 20:58:14.922377 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 822/1717] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:58:14 2022] GET /compute/v2.1/servers/84a8a931-6a18-4ef4-9e3c-63cf4054ea43 => generated 1215 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:58:15.056831 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-5c147cfd-1855-4e0f-9fda-066dcaf687dc tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Calling method '.version_select at 0x7f1a8c61d040>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:15.154824 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-5c147cfd-1855-4e0f-9fda-066dcaf687dc tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] 10.222.0.26 "GET /compute/v2.1/images/51380a40-a52a-46bf-a537-f30ae7be94ef" status: 200 len: 1419 microversion: 2.1 time: 0.102420 Oct 08 20:58:15.156181 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 823/1718] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:58:15 2022] GET /compute/v2.1/images/51380a40-a52a-46bf-a537-f30ae7be94ef => generated 1419 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:58:15.384924 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-078722eb-b6b5-4968-bd04-aaac73aceded tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01ec70849cfa44368a91df8b3410aba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c97b3b7fa484f97bdf40224f7cc34d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:58:15.400553 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-078722eb-b6b5-4968-bd04-aaac73aceded tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] 10.222.0.26 "GET /compute/v2.1/servers/e5389d1b-b9f3-491a-898c-be611599d73a" status: 200 len: 1524 microversion: 2.1 time: 0.919206 Oct 08 20:58:15.420106 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 896/1719] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:58:14 2022] GET /compute/v2.1/servers/e5389d1b-b9f3-491a-898c-be611599d73a => generated 1524 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:58:15.954773 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c9383bbf-ff69-406b-8fdc-db23666b8b7b tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:15.958081 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-c9383bbf-ff69-406b-8fdc-db23666b8b7b tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] [instance: 84a8a931-6a18-4ef4-9e3c-63cf4054ea43] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:58:15.982122 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c9383bbf-ff69-406b-8fdc-db23666b8b7b tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:15.986955 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c9383bbf-ff69-406b-8fdc-db23666b8b7b tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:15.988440 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c9383bbf-ff69-406b-8fdc-db23666b8b7b tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:15.989873 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c9383bbf-ff69-406b-8fdc-db23666b8b7b tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:15.996050 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c9383bbf-ff69-406b-8fdc-db23666b8b7b tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:15.996895 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c9383bbf-ff69-406b-8fdc-db23666b8b7b tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:16.174531 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-4de1b1f8-8b01-49f6-bd76-25f26c0bfb74 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Calling method '.version_select at 0x7f1a8c09f9d0>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:16.303208 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-4de1b1f8-8b01-49f6-bd76-25f26c0bfb74 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] 10.222.0.26 "GET /compute/v2.1/images/51380a40-a52a-46bf-a537-f30ae7be94ef" status: 200 len: 1419 microversion: 2.1 time: 0.134925 Oct 08 20:58:16.305378 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 897/1720] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:58:16 2022] GET /compute/v2.1/images/51380a40-a52a-46bf-a537-f30ae7be94ef => generated 1419 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 20:58:16.324387 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-c9383bbf-ff69-406b-8fdc-db23666b8b7b tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ddc3cd3c374bacbe5bf5e0877380e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8472b054404c46a99b81aba34d6b9f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:58:16.344966 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-c9383bbf-ff69-406b-8fdc-db23666b8b7b tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] 10.222.0.26 "GET /compute/v2.1/servers/84a8a931-6a18-4ef4-9e3c-63cf4054ea43" status: 200 len: 1271 microversion: 2.1 time: 0.398582 Oct 08 20:58:16.359101 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 824/1721] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:58:15 2022] GET /compute/v2.1/servers/84a8a931-6a18-4ef4-9e3c-63cf4054ea43 => generated 1271 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:58:16.437820 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-39450ef0-617d-4b73-9d02-a3c0f8f2d5c2 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:16.443526 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-39450ef0-617d-4b73-9d02-a3c0f8f2d5c2 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] [instance: e5389d1b-b9f3-491a-898c-be611599d73a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:58:16.492707 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-39450ef0-617d-4b73-9d02-a3c0f8f2d5c2 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:16.494883 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-39450ef0-617d-4b73-9d02-a3c0f8f2d5c2 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:16.497219 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-39450ef0-617d-4b73-9d02-a3c0f8f2d5c2 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:16.502661 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-39450ef0-617d-4b73-9d02-a3c0f8f2d5c2 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:16.504289 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-39450ef0-617d-4b73-9d02-a3c0f8f2d5c2 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:16.506247 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-39450ef0-617d-4b73-9d02-a3c0f8f2d5c2 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:16.533644 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-fead57bb-23a8-4b6a-a223-ec16b9049b19 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:16.534587 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-fead57bb-23a8-4b6a-a223-ec16b9049b19 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] [instance: 57016fcf-2d2c-488c-9af6-0530ebc199f6] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:58:16.543571 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fead57bb-23a8-4b6a-a223-ec16b9049b19 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:16.544702 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fead57bb-23a8-4b6a-a223-ec16b9049b19 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:16.545595 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fead57bb-23a8-4b6a-a223-ec16b9049b19 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:16.546596 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fead57bb-23a8-4b6a-a223-ec16b9049b19 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:16.547300 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fead57bb-23a8-4b6a-a223-ec16b9049b19 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:16.548040 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fead57bb-23a8-4b6a-a223-ec16b9049b19 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:16.631574 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-fead57bb-23a8-4b6a-a223-ec16b9049b19 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] [instance: 57016fcf-2d2c-488c-9af6-0530ebc199f6] Going to try to terminate instance {{(pid=140491) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 20:58:16.893546 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-fead57bb-23a8-4b6a-a223-ec16b9049b19 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] 10.222.0.26 "DELETE /compute/v2.1/servers/57016fcf-2d2c-488c-9af6-0530ebc199f6" status: 204 len: 0 microversion: 2.25 time: 0.365930 Oct 08 20:58:16.895184 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 825/1722] 10.222.0.26 () {60 vars in 1280 bytes} [Sat Oct 8 20:58:16 2022] DELETE /compute/v2.1/servers/57016fcf-2d2c-488c-9af6-0530ebc199f6 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 08 20:58:16.910493 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-6196fd2d-57e3-4b56-b035-8503a20a5f7b tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:16.913240 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-6196fd2d-57e3-4b56-b035-8503a20a5f7b tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] [instance: 57016fcf-2d2c-488c-9af6-0530ebc199f6] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:58:16.943648 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6196fd2d-57e3-4b56-b035-8503a20a5f7b tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:16.946151 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6196fd2d-57e3-4b56-b035-8503a20a5f7b tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:16.951481 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6196fd2d-57e3-4b56-b035-8503a20a5f7b tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:16.952601 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6196fd2d-57e3-4b56-b035-8503a20a5f7b tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:16.954118 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6196fd2d-57e3-4b56-b035-8503a20a5f7b tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:16.955035 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6196fd2d-57e3-4b56-b035-8503a20a5f7b tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:17.021744 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-39450ef0-617d-4b73-9d02-a3c0f8f2d5c2 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01ec70849cfa44368a91df8b3410aba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c97b3b7fa484f97bdf40224f7cc34d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:58:17.034001 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-39450ef0-617d-4b73-9d02-a3c0f8f2d5c2 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] 10.222.0.26 "GET /compute/v2.1/servers/e5389d1b-b9f3-491a-898c-be611599d73a" status: 200 len: 1524 microversion: 2.1 time: 0.603254 Oct 08 20:58:17.049367 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 898/1723] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:58:16 2022] GET /compute/v2.1/servers/e5389d1b-b9f3-491a-898c-be611599d73a => generated 1524 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:58:17.332977 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-250e4773-fffe-4a2d-980a-500f46a8f80f tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Calling method '.version_select at 0x7f1a8c0dc1f0>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:17.473866 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-250e4773-fffe-4a2d-980a-500f46a8f80f tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] 10.222.0.26 "GET /compute/v2.1/images/51380a40-a52a-46bf-a537-f30ae7be94ef" status: 200 len: 1419 microversion: 2.1 time: 0.155517 Oct 08 20:58:17.477178 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 899/1724] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:58:17 2022] GET /compute/v2.1/images/51380a40-a52a-46bf-a537-f30ae7be94ef => generated 1419 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 20:58:17.488172 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-9de034dd-0a63-4dc9-b23e-88de4006c87f tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:17.489231 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-9de034dd-0a63-4dc9-b23e-88de4006c87f tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] [instance: 84a8a931-6a18-4ef4-9e3c-63cf4054ea43] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:58:17.500459 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9de034dd-0a63-4dc9-b23e-88de4006c87f tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:17.501316 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9de034dd-0a63-4dc9-b23e-88de4006c87f tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:17.502108 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9de034dd-0a63-4dc9-b23e-88de4006c87f tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:17.509540 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9de034dd-0a63-4dc9-b23e-88de4006c87f tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:17.510184 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9de034dd-0a63-4dc9-b23e-88de4006c87f tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:17.510808 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9de034dd-0a63-4dc9-b23e-88de4006c87f tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:17.594553 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:58:17.881859 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-9de034dd-0a63-4dc9-b23e-88de4006c87f tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ddc3cd3c374bacbe5bf5e0877380e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8472b054404c46a99b81aba34d6b9f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:58:17.905092 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-9de034dd-0a63-4dc9-b23e-88de4006c87f tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] 10.222.0.26 "GET /compute/v2.1/servers/84a8a931-6a18-4ef4-9e3c-63cf4054ea43" status: 200 len: 1271 microversion: 2.1 time: 0.425568 Oct 08 20:58:17.915088 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 900/1725] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:58:17 2022] GET /compute/v2.1/servers/84a8a931-6a18-4ef4-9e3c-63cf4054ea43 => generated 1271 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:58:17.917917 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-6196fd2d-57e3-4b56-b035-8503a20a5f7b tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:58:17.932382 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-6196fd2d-57e3-4b56-b035-8503a20a5f7b tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:58:17.933855 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-6196fd2d-57e3-4b56-b035-8503a20a5f7b tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:58:17.935068 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-6196fd2d-57e3-4b56-b035-8503a20a5f7b tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] 10.222.0.26 "GET /compute/v2.1/servers/57016fcf-2d2c-488c-9af6-0530ebc199f6" status: 200 len: 1732 microversion: 2.25 time: 1.035443 Oct 08 20:58:17.935653 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 826/1726] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:58:16 2022] GET /compute/v2.1/servers/57016fcf-2d2c-488c-9af6-0530ebc199f6 => generated 1732 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 08 20:58:18.076528 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-8b6deaf1-a97c-4de1-8cf6-5615a22b50ff tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:18.078338 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-8b6deaf1-a97c-4de1-8cf6-5615a22b50ff tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] [instance: e5389d1b-b9f3-491a-898c-be611599d73a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:58:18.092126 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8b6deaf1-a97c-4de1-8cf6-5615a22b50ff tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:18.092792 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8b6deaf1-a97c-4de1-8cf6-5615a22b50ff tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:18.093279 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8b6deaf1-a97c-4de1-8cf6-5615a22b50ff tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:18.094642 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8b6deaf1-a97c-4de1-8cf6-5615a22b50ff tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:18.095125 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8b6deaf1-a97c-4de1-8cf6-5615a22b50ff tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:18.095556 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8b6deaf1-a97c-4de1-8cf6-5615a22b50ff tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:18.489998 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-7807a833-0ed5-44e9-8966-be46bd6ac1b5 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Calling method '.version_select at 0x7f1a914cbe50>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:18.588349 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-7807a833-0ed5-44e9-8966-be46bd6ac1b5 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] 10.222.0.26 "GET /compute/v2.1/images/51380a40-a52a-46bf-a537-f30ae7be94ef" status: 200 len: 1419 microversion: 2.1 time: 0.102225 Oct 08 20:58:18.590319 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 827/1727] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:58:18 2022] GET /compute/v2.1/images/51380a40-a52a-46bf-a537-f30ae7be94ef => generated 1419 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 20:58:18.602802 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-8b6deaf1-a97c-4de1-8cf6-5615a22b50ff tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01ec70849cfa44368a91df8b3410aba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c97b3b7fa484f97bdf40224f7cc34d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:58:18.615760 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-8b6deaf1-a97c-4de1-8cf6-5615a22b50ff tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] 10.222.0.26 "GET /compute/v2.1/servers/e5389d1b-b9f3-491a-898c-be611599d73a" status: 200 len: 1524 microversion: 2.1 time: 0.550857 Oct 08 20:58:18.618466 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 901/1728] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:58:18 2022] GET /compute/v2.1/servers/e5389d1b-b9f3-491a-898c-be611599d73a => generated 1524 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:58:18.936649 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-b0a31953-33d3-4b49-adbe-f86654c4605e tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:18.937943 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-b0a31953-33d3-4b49-adbe-f86654c4605e tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] [instance: 84a8a931-6a18-4ef4-9e3c-63cf4054ea43] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:58:18.951683 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b0a31953-33d3-4b49-adbe-f86654c4605e tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:18.953747 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b0a31953-33d3-4b49-adbe-f86654c4605e tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:18.954440 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b0a31953-33d3-4b49-adbe-f86654c4605e tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:18.958493 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b0a31953-33d3-4b49-adbe-f86654c4605e tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:18.959240 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b0a31953-33d3-4b49-adbe-f86654c4605e tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:18.960872 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b0a31953-33d3-4b49-adbe-f86654c4605e tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:18.964579 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-5a11eba0-44aa-48c5-b9e9-cdd1567d1324 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:18.965243 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-5a11eba0-44aa-48c5-b9e9-cdd1567d1324 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] [instance: 57016fcf-2d2c-488c-9af6-0530ebc199f6] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:58:18.976894 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5a11eba0-44aa-48c5-b9e9-cdd1567d1324 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:18.978599 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5a11eba0-44aa-48c5-b9e9-cdd1567d1324 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:18.979928 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5a11eba0-44aa-48c5-b9e9-cdd1567d1324 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:18.983491 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5a11eba0-44aa-48c5-b9e9-cdd1567d1324 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:18.984206 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5a11eba0-44aa-48c5-b9e9-cdd1567d1324 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:18.994832 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5a11eba0-44aa-48c5-b9e9-cdd1567d1324 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:19.219484 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-b0a31953-33d3-4b49-adbe-f86654c4605e tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ddc3cd3c374bacbe5bf5e0877380e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8472b054404c46a99b81aba34d6b9f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:58:19.233478 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-b0a31953-33d3-4b49-adbe-f86654c4605e tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] 10.222.0.26 "GET /compute/v2.1/servers/84a8a931-6a18-4ef4-9e3c-63cf4054ea43" status: 200 len: 1277 microversion: 2.1 time: 0.298693 Oct 08 20:58:19.234114 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 828/1729] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:58:18 2022] GET /compute/v2.1/servers/84a8a931-6a18-4ef4-9e3c-63cf4054ea43 => generated 1277 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:58:19.606623 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-2710b9a7-0bd1-497d-9ff8-a4e1ec155243 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Calling method '.version_select at 0x7f1a914cbca0>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:19.691794 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-2710b9a7-0bd1-497d-9ff8-a4e1ec155243 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] 10.222.0.26 "GET /compute/v2.1/images/51380a40-a52a-46bf-a537-f30ae7be94ef" status: 200 len: 1419 microversion: 2.1 time: 0.089844 Oct 08 20:58:19.692438 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 829/1730] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:58:19 2022] GET /compute/v2.1/images/51380a40-a52a-46bf-a537-f30ae7be94ef => generated 1419 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:58:19.702392 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-e6cfe484-684b-4f93-8e28-e8733904103a tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:19.705860 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-e6cfe484-684b-4f93-8e28-e8733904103a tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] [instance: e5389d1b-b9f3-491a-898c-be611599d73a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:58:19.722913 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e6cfe484-684b-4f93-8e28-e8733904103a tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:19.727095 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e6cfe484-684b-4f93-8e28-e8733904103a tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:19.727754 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e6cfe484-684b-4f93-8e28-e8733904103a tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:19.729675 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e6cfe484-684b-4f93-8e28-e8733904103a tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:19.731146 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e6cfe484-684b-4f93-8e28-e8733904103a tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:19.731945 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e6cfe484-684b-4f93-8e28-e8733904103a tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:20.000274 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-5a11eba0-44aa-48c5-b9e9-cdd1567d1324 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:58:20.009344 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-e6cfe484-684b-4f93-8e28-e8733904103a tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01ec70849cfa44368a91df8b3410aba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c97b3b7fa484f97bdf40224f7cc34d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:58:20.019873 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-5a11eba0-44aa-48c5-b9e9-cdd1567d1324 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:58:20.028319 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-5a11eba0-44aa-48c5-b9e9-cdd1567d1324 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:58:20.028597 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-e6cfe484-684b-4f93-8e28-e8733904103a tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] 10.222.0.26 "GET /compute/v2.1/servers/e5389d1b-b9f3-491a-898c-be611599d73a" status: 200 len: 1524 microversion: 2.1 time: 0.334787 Oct 08 20:58:20.029410 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 830/1731] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:58:19 2022] GET /compute/v2.1/servers/e5389d1b-b9f3-491a-898c-be611599d73a => generated 1524 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:58:20.033548 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-5a11eba0-44aa-48c5-b9e9-cdd1567d1324 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] 10.222.0.26 "GET /compute/v2.1/servers/57016fcf-2d2c-488c-9af6-0530ebc199f6" status: 200 len: 1732 microversion: 2.25 time: 1.074189 Oct 08 20:58:20.035743 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 902/1732] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:58:18 2022] GET /compute/v2.1/servers/57016fcf-2d2c-488c-9af6-0530ebc199f6 => generated 1732 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 08 20:58:20.258879 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-7e51c86d-110e-4a25-a92a-7098970aed1d tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:20.259518 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-7e51c86d-110e-4a25-a92a-7098970aed1d tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] [instance: 84a8a931-6a18-4ef4-9e3c-63cf4054ea43] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:58:20.276013 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7e51c86d-110e-4a25-a92a-7098970aed1d tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:20.276526 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7e51c86d-110e-4a25-a92a-7098970aed1d tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:20.276975 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7e51c86d-110e-4a25-a92a-7098970aed1d tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:20.277744 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7e51c86d-110e-4a25-a92a-7098970aed1d tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:20.278206 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7e51c86d-110e-4a25-a92a-7098970aed1d tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:20.296767 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7e51c86d-110e-4a25-a92a-7098970aed1d tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:20.716593 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-9c0a8cf1-e6f6-4ca8-ae6d-97900ca9ea44 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Calling method '.version_select at 0x7f1a8c0205e0>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:20.817939 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-7e51c86d-110e-4a25-a92a-7098970aed1d tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ddc3cd3c374bacbe5bf5e0877380e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8472b054404c46a99b81aba34d6b9f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:58:20.830301 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-7e51c86d-110e-4a25-a92a-7098970aed1d tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] 10.222.0.26 "GET /compute/v2.1/servers/84a8a931-6a18-4ef4-9e3c-63cf4054ea43" status: 200 len: 1277 microversion: 2.1 time: 0.576441 Oct 08 20:58:20.848574 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 831/1733] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:58:20 2022] GET /compute/v2.1/servers/84a8a931-6a18-4ef4-9e3c-63cf4054ea43 => generated 1277 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:58:20.861571 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-9c0a8cf1-e6f6-4ca8-ae6d-97900ca9ea44 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] 10.222.0.26 "GET /compute/v2.1/images/51380a40-a52a-46bf-a537-f30ae7be94ef" status: 200 len: 1419 microversion: 2.1 time: 0.157149 Oct 08 20:58:20.867017 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 903/1734] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:58:20 2022] GET /compute/v2.1/images/51380a40-a52a-46bf-a537-f30ae7be94ef => generated 1419 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:58:21.064278 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-b3662beb-4c3d-4ea0-bb07-4812ba070b53 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:21.065670 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-b3662beb-4c3d-4ea0-bb07-4812ba070b53 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] [instance: e5389d1b-b9f3-491a-898c-be611599d73a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:58:21.079791 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-89a275ac-370a-45e5-a3c2-27264917a1ad tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:21.086066 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-89a275ac-370a-45e5-a3c2-27264917a1ad tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] [instance: 57016fcf-2d2c-488c-9af6-0530ebc199f6] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:58:21.086982 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b3662beb-4c3d-4ea0-bb07-4812ba070b53 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:21.089728 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b3662beb-4c3d-4ea0-bb07-4812ba070b53 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:21.090930 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b3662beb-4c3d-4ea0-bb07-4812ba070b53 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:21.093178 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b3662beb-4c3d-4ea0-bb07-4812ba070b53 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:21.094413 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b3662beb-4c3d-4ea0-bb07-4812ba070b53 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:21.095992 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b3662beb-4c3d-4ea0-bb07-4812ba070b53 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:21.113487 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-89a275ac-370a-45e5-a3c2-27264917a1ad tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:21.114071 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-89a275ac-370a-45e5-a3c2-27264917a1ad tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:21.115840 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-89a275ac-370a-45e5-a3c2-27264917a1ad tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:21.116601 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-89a275ac-370a-45e5-a3c2-27264917a1ad tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:21.120774 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-89a275ac-370a-45e5-a3c2-27264917a1ad tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:21.121795 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-89a275ac-370a-45e5-a3c2-27264917a1ad tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:21.244368 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-89a275ac-370a-45e5-a3c2-27264917a1ad tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:58:21.262012 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-89a275ac-370a-45e5-a3c2-27264917a1ad tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:58:21.263725 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-89a275ac-370a-45e5-a3c2-27264917a1ad tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:58:21.268954 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-89a275ac-370a-45e5-a3c2-27264917a1ad tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] 10.222.0.26 "GET /compute/v2.1/servers/57016fcf-2d2c-488c-9af6-0530ebc199f6" status: 200 len: 1664 microversion: 2.25 time: 0.209234 Oct 08 20:58:21.270940 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 904/1735] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:58:21 2022] GET /compute/v2.1/servers/57016fcf-2d2c-488c-9af6-0530ebc199f6 => generated 1664 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:58:21.627808 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-b3662beb-4c3d-4ea0-bb07-4812ba070b53 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01ec70849cfa44368a91df8b3410aba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c97b3b7fa484f97bdf40224f7cc34d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:58:21.645109 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-b3662beb-4c3d-4ea0-bb07-4812ba070b53 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] 10.222.0.26 "GET /compute/v2.1/servers/e5389d1b-b9f3-491a-898c-be611599d73a" status: 200 len: 1504 microversion: 2.1 time: 0.596061 Oct 08 20:58:21.646461 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 832/1736] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:58:21 2022] GET /compute/v2.1/servers/e5389d1b-b9f3-491a-898c-be611599d73a => generated 1504 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:58:21.680224 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-993a28bb-b584-4517-a5f5-f74556c063fd tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Action: 'create', calling method: .version_select at 0x7f1a8c0dc040>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1197623015", "description": "tempest-description-1925012681"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:58:21.873541 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-06541a66-0119-44e6-983a-7e8f41643693 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:21.875738 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-06541a66-0119-44e6-983a-7e8f41643693 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] [instance: 84a8a931-6a18-4ef4-9e3c-63cf4054ea43] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:58:21.893436 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-06541a66-0119-44e6-983a-7e8f41643693 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:21.896087 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-06541a66-0119-44e6-983a-7e8f41643693 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:21.898630 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-06541a66-0119-44e6-983a-7e8f41643693 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:21.907536 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-06541a66-0119-44e6-983a-7e8f41643693 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:21.910985 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-06541a66-0119-44e6-983a-7e8f41643693 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:21.912546 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-06541a66-0119-44e6-983a-7e8f41643693 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:22.197919 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-993a28bb-b584-4517-a5f5-f74556c063fd tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] 10.222.0.26 "POST /compute/v2.1/os-security-groups" status: 200 len: 251 microversion: 2.1 time: 0.527508 Oct 08 20:58:22.198604 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 905/1737] 10.222.0.26 () {60 vars in 1180 bytes} [Sat Oct 8 20:58:21 2022] POST /compute/v2.1/os-security-groups => generated 251 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:58:22.204342 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-7d133938-b5b6-4e9f-9bc0-8511d0ddae83 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Calling method '.version_select at 0x7f1a8c028430>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:22.299563 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-7d133938-b5b6-4e9f-9bc0-8511d0ddae83 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] 10.222.0.26 "GET /compute/v2.1/images/51380a40-a52a-46bf-a537-f30ae7be94ef" status: 200 len: 1419 microversion: 2.1 time: 0.097145 Oct 08 20:58:22.306015 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 906/1738] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:58:22 2022] GET /compute/v2.1/images/51380a40-a52a-46bf-a537-f30ae7be94ef => generated 1419 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:58:22.324766 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-d06fd29e-c811-4a8c-8cdb-257624130fe4 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1197623015"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:58:22.333453 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-d06fd29e-c811-4a8c-8cdb-257624130fe4 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] [instance: e5389d1b-b9f3-491a-898c-be611599d73a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:58:22.358987 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d06fd29e-c811-4a8c-8cdb-257624130fe4 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:22.359554 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d06fd29e-c811-4a8c-8cdb-257624130fe4 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:22.364390 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d06fd29e-c811-4a8c-8cdb-257624130fe4 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:22.365201 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d06fd29e-c811-4a8c-8cdb-257624130fe4 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:22.365774 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d06fd29e-c811-4a8c-8cdb-257624130fe4 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:22.366223 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d06fd29e-c811-4a8c-8cdb-257624130fe4 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:22.466183 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-06541a66-0119-44e6-983a-7e8f41643693 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ddc3cd3c374bacbe5bf5e0877380e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8472b054404c46a99b81aba34d6b9f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:58:22.502345 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-06541a66-0119-44e6-983a-7e8f41643693 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] 10.222.0.26 "GET /compute/v2.1/servers/84a8a931-6a18-4ef4-9e3c-63cf4054ea43" status: 200 len: 1277 microversion: 2.1 time: 0.633980 Oct 08 20:58:22.520096 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 833/1739] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:58:21 2022] GET /compute/v2.1/servers/84a8a931-6a18-4ef4-9e3c-63cf4054ea43 => generated 1277 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:58:22.525652 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-f698cf7d-5c66-4e93-b1c1-0a5bc544fd7e tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:22.531753 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-f698cf7d-5c66-4e93-b1c1-0a5bc544fd7e tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] [instance: 57016fcf-2d2c-488c-9af6-0530ebc199f6] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:58:22.545558 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f698cf7d-5c66-4e93-b1c1-0a5bc544fd7e tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:22.546570 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f698cf7d-5c66-4e93-b1c1-0a5bc544fd7e tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:22.547207 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f698cf7d-5c66-4e93-b1c1-0a5bc544fd7e tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:22.553099 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f698cf7d-5c66-4e93-b1c1-0a5bc544fd7e tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:22.553850 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f698cf7d-5c66-4e93-b1c1-0a5bc544fd7e tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:22.554452 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f698cf7d-5c66-4e93-b1c1-0a5bc544fd7e tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:22.588547 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:58:22.650886 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.network.security_group_api [None req-d06fd29e-c811-4a8c-8cdb-257624130fe4 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Adding security group 8b3db8c1-381d-40d2-bb6b-b796a9dc29e9 to port d911c0da-f663-4272-afa4-3646c36b9e29 Oct 08 20:58:22.734413 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-f698cf7d-5c66-4e93-b1c1-0a5bc544fd7e tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:58:22.754901 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-f698cf7d-5c66-4e93-b1c1-0a5bc544fd7e tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:58:22.763002 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-f698cf7d-5c66-4e93-b1c1-0a5bc544fd7e tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:58:22.781495 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-f698cf7d-5c66-4e93-b1c1-0a5bc544fd7e tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] 10.222.0.26 "GET /compute/v2.1/servers/57016fcf-2d2c-488c-9af6-0530ebc199f6" status: 200 len: 1664 microversion: 2.25 time: 0.256648 Oct 08 20:58:22.782570 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 834/1740] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:58:22 2022] GET /compute/v2.1/servers/57016fcf-2d2c-488c-9af6-0530ebc199f6 => generated 1664 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:58:22.795988 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-15f08775-a834-4339-96fd-6a44878766a7 req-c8ae4827-178b-4fbd-9078-f22f53b5dfec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57016fcf-2d2c-488c-9af6-0530ebc199f6", "name": "network-vif-deleted", "tag": "574497fa-1919-4a57-bca6-30aeb414e335"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:58:22.797019 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=30 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:58:22.816191 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:58:22.842569 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-15f08775-a834-4339-96fd-6a44878766a7 req-c8ae4827-178b-4fbd-9078-f22f53b5dfec service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:22.843055 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-15f08775-a834-4339-96fd-6a44878766a7 req-c8ae4827-178b-4fbd-9078-f22f53b5dfec service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:22.843496 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-15f08775-a834-4339-96fd-6a44878766a7 req-c8ae4827-178b-4fbd-9078-f22f53b5dfec service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:22.939787 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-15f08775-a834-4339-96fd-6a44878766a7 req-c8ae4827-178b-4fbd-9078-f22f53b5dfec service nova] Creating event network-vif-deleted:574497fa-1919-4a57-bca6-30aeb414e335 for instance 57016fcf-2d2c-488c-9af6-0530ebc199f6 on nch2-master-1 Oct 08 20:58:22.980393 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=4 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:58:22.981776 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-15f08775-a834-4339-96fd-6a44878766a7 req-c8ae4827-178b-4fbd-9078-f22f53b5dfec service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.190196 Oct 08 20:58:22.984064 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 835/1741] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:58:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:58:23.323742 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-a85f254e-fc26-47cb-8135-df301c7a2cf5 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Calling method '.version_select at 0x7f1a914ccb80>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:23.433180 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-a85f254e-fc26-47cb-8135-df301c7a2cf5 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] 10.222.0.26 "GET /compute/v2.1/images/51380a40-a52a-46bf-a537-f30ae7be94ef" status: 200 len: 1419 microversion: 2.1 time: 0.115543 Oct 08 20:58:23.459986 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 836/1742] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:58:23 2022] GET /compute/v2.1/images/51380a40-a52a-46bf-a537-f30ae7be94ef => generated 1419 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:58:23.523788 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=2 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:58:23.532082 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-9128678f-df5b-4b09-a143-ea29d4a2ec4a tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:23.537683 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-9128678f-df5b-4b09-a143-ea29d4a2ec4a tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] [instance: 84a8a931-6a18-4ef4-9e3c-63cf4054ea43] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:58:23.575754 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9128678f-df5b-4b09-a143-ea29d4a2ec4a tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:23.576839 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9128678f-df5b-4b09-a143-ea29d4a2ec4a tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:23.577639 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9128678f-df5b-4b09-a143-ea29d4a2ec4a tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:23.582664 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9128678f-df5b-4b09-a143-ea29d4a2ec4a tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:23.583544 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9128678f-df5b-4b09-a143-ea29d4a2ec4a tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:23.584295 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9128678f-df5b-4b09-a143-ea29d4a2ec4a tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:23.951801 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-d06fd29e-c811-4a8c-8cdb-257624130fe4 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] 10.222.0.26 "POST /compute/v2.1/servers/e5389d1b-b9f3-491a-898c-be611599d73a/action" status: 202 len: 0 microversion: 2.1 time: 1.644347 Oct 08 20:58:23.952427 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 907/1743] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 20:58:22 2022] POST /compute/v2.1/servers/e5389d1b-b9f3-491a-898c-be611599d73a/action => generated 0 bytes in 1646 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 20:58:23.958594 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-c47d8ea3-a7c4-4562-875a-7b5c161f6462 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:23.959459 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-c47d8ea3-a7c4-4562-875a-7b5c161f6462 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] [instance: 57016fcf-2d2c-488c-9af6-0530ebc199f6] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:58:23.991004 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c47d8ea3-a7c4-4562-875a-7b5c161f6462 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:23.991592 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c47d8ea3-a7c4-4562-875a-7b5c161f6462 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:23.992117 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c47d8ea3-a7c4-4562-875a-7b5c161f6462 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:23.992860 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c47d8ea3-a7c4-4562-875a-7b5c161f6462 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:23.998681 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c47d8ea3-a7c4-4562-875a-7b5c161f6462 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:24.001688 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c47d8ea3-a7c4-4562-875a-7b5c161f6462 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:24.054730 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-c47d8ea3-a7c4-4562-875a-7b5c161f6462 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] HTTP exception thrown: Instance 57016fcf-2d2c-488c-9af6-0530ebc199f6 could not be found. Oct 08 20:58:24.063818 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-c47d8ea3-a7c4-4562-875a-7b5c161f6462 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Request method failure captured: Oct 08 20:58:24.063818 ncdv-master-1 devstack@n-api.service[140492]: request: GET /compute/v2.1/servers/57016fcf-2d2c-488c-9af6-0530ebc199f6 HTTP/1.1 Oct 08 20:58:24.063818 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 20:58:24.063818 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 20:58:24.063818 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 20:58:24.063818 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 20:58:24.063818 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 20:58:24.063818 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 20:58:24.063818 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 20:58:24.063818 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 20:58:24.063818 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeM_8itqsdTjDSrlGxZZ-u44pmaEYPSQW4Sfx3OogMOjCfNSG1scpEldctJo7eYijpgGhtozXKwLr8evVzi5nf4wuH1lfEdHrH_7IHaykS_Ns0neu4keC9kqpsLbriJukycX0gnBg9-m0XH6tiS45uipRftXY8tUpNqJ0OB6f1O8wUg Oct 08 20:58:24.063818 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 20:58:24.063818 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 20:58:24.063818 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 20:58:24.063818 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 20:58:24.063818 ncdv-master-1 devstack@n-api.service[140492]: X-Openstack-Nova-Api-Version: 2.25 Oct 08 20:58:24.063818 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 20:58:24.063818 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 20:58:24.063818 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: ac5c7906a4714a1887cb823e1c3a6056 Oct 08 20:58:24.063818 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-2037918034 Oct 08 20:58:24.063818 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 20:58:24.063818 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 20:58:24.063818 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ac5c7906a4714a1887cb823e1c3a6056"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ac5c7906a4714a1887cb823e1c3a6056"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ac5c7906a4714a1887cb823e1c3a6056"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ac5c7906a4714a1887cb823e1c3a6056"}]}] Oct 08 20:58:24.063818 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-2037918034 Oct 08 20:58:24.063818 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: ac5c7906a4714a1887cb823e1c3a6056 Oct 08 20:58:24.063818 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-2037918034 Oct 08 20:58:24.063818 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-LiveAutoBlockMigrationV225Test-2037918034-project Oct 08 20:58:24.063818 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 20:58:24.063818 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 20:58:24.063818 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: d54b1c5c00544be4b60132d09817c8d6 Oct 08 20:58:24.063818 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-2037918034-project Oct 08 20:58:24.063818 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 20:58:24.063818 ncdv-master-1 devstack@n-api.service[140492]: exception: Instance 57016fcf-2d2c-488c-9af6-0530ebc199f6 could not be found. Oct 08 20:58:24.063818 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': '57016fcf-2d2c-488c-9af6-0530ebc199f6'} Oct 08 20:58:24.063818 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:58:24.063818 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:58:24.063818 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 20:58:24.063818 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 20:58:24.063818 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 20:58:24.063818 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 20:58:24.063818 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 20:58:24.063818 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 20:58:24.063818 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 20:58:24.063818 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 20:58:24.063818 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57016fcf-2d2c-488c-9af6-0530ebc199f6 could not be found. Oct 08 20:58:24.063818 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:58:24.063818 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:58:24.063818 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:58:24.063818 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:58:24.063818 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:58:24.063818 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:58:24.063818 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:58:24.063818 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:58:24.063818 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:58:24.063818 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:58:24.063818 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 20:58:24.063818 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 20:58:24.063818 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 20:58:24.063818 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 20:58:24.063818 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 20:58:24.063818 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 20:58:24.063818 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57016fcf-2d2c-488c-9af6-0530ebc199f6 could not be found. Oct 08 20:58:24.063818 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:58:24.070715 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:58:24.070715 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:58:24.070715 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:58:24.070715 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:58:24.070715 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:58:24.070715 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 20:58:24.070715 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 20:58:24.070715 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57016fcf-2d2c-488c-9af6-0530ebc199f6 could not be found. Oct 08 20:58:24.070715 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 20:58:24.072259 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-c47d8ea3-a7c4-4562-875a-7b5c161f6462 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Returning 404 to user: Instance 57016fcf-2d2c-488c-9af6-0530ebc199f6 could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:58:24.074015 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-c47d8ea3-a7c4-4562-875a-7b5c161f6462 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] 10.222.0.26 "GET /compute/v2.1/servers/57016fcf-2d2c-488c-9af6-0530ebc199f6" status: 404 len: 111 microversion: 2.25 time: 0.120390 Oct 08 20:58:24.076968 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 908/1744] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:58:23 2022] GET /compute/v2.1/servers/57016fcf-2d2c-488c-9af6-0530ebc199f6 => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 08 20:58:24.093558 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-cff8c7fb-4c0b-4e34-a1fd-52a2f4b0bfed tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1197623015"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:58:24.095691 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-cff8c7fb-4c0b-4e34-a1fd-52a2f4b0bfed tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] [instance: e5389d1b-b9f3-491a-898c-be611599d73a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:58:24.112974 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cff8c7fb-4c0b-4e34-a1fd-52a2f4b0bfed tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:24.118249 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cff8c7fb-4c0b-4e34-a1fd-52a2f4b0bfed tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:24.119485 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cff8c7fb-4c0b-4e34-a1fd-52a2f4b0bfed tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:24.122062 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cff8c7fb-4c0b-4e34-a1fd-52a2f4b0bfed tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:24.123230 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cff8c7fb-4c0b-4e34-a1fd-52a2f4b0bfed tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:24.127165 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cff8c7fb-4c0b-4e34-a1fd-52a2f4b0bfed tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:24.184928 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-9128678f-df5b-4b09-a143-ea29d4a2ec4a tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ddc3cd3c374bacbe5bf5e0877380e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8472b054404c46a99b81aba34d6b9f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:58:24.198401 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-9128678f-df5b-4b09-a143-ea29d4a2ec4a tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] 10.222.0.26 "GET /compute/v2.1/servers/84a8a931-6a18-4ef4-9e3c-63cf4054ea43" status: 200 len: 1319 microversion: 2.1 time: 0.676372 Oct 08 20:58:24.203634 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 837/1745] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:58:23 2022] GET /compute/v2.1/servers/84a8a931-6a18-4ef4-9e3c-63cf4054ea43 => generated 1319 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 20:58:24.213775 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-fe6e07cf-6c00-44ad-b0b7-321baeac7bef req-9084fe0e-6930-4135-9f82-1eb743cfb75f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5389d1b-b9f3-491a-898c-be611599d73a", "tag": "d911c0da-f663-4272-afa4-3646c36b9e29"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:58:24.252314 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-fe6e07cf-6c00-44ad-b0b7-321baeac7bef req-9084fe0e-6930-4135-9f82-1eb743cfb75f service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:24.253220 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-fe6e07cf-6c00-44ad-b0b7-321baeac7bef req-9084fe0e-6930-4135-9f82-1eb743cfb75f service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:24.253871 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-fe6e07cf-6c00-44ad-b0b7-321baeac7bef req-9084fe0e-6930-4135-9f82-1eb743cfb75f service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:24.291350 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-fe6e07cf-6c00-44ad-b0b7-321baeac7bef req-9084fe0e-6930-4135-9f82-1eb743cfb75f service nova] Creating event network-changed:d911c0da-f663-4272-afa4-3646c36b9e29 for instance e5389d1b-b9f3-491a-898c-be611599d73a on nch2-master-1 Oct 08 20:58:24.319428 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-fe6e07cf-6c00-44ad-b0b7-321baeac7bef req-9084fe0e-6930-4135-9f82-1eb743cfb75f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114197 Oct 08 20:58:24.320360 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 838/1746] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:58:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:58:24.343457 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-f3852d2c-d4db-4845-bdb5-d38a071aa8b0 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Calling method '.version_select at 0x7f1a8c657af0>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:24.399970 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-f3852d2c-d4db-4845-bdb5-d38a071aa8b0 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1878385195" status: 204 len: 0 microversion: 2.25 time: 0.074780 Oct 08 20:58:24.402284 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 839/1747] 10.222.0.26 () {60 vars in 1262 bytes} [Sat Oct 8 20:58:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1878385195 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 08 20:58:24.458727 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-bf1d9c03-9f70-490d-9269-0e209c957c7e tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Calling method '.version_select at 0x7f1a914d83a0>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:24.600613 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-bf1d9c03-9f70-490d-9269-0e209c957c7e tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] 10.222.0.26 "GET /compute/v2.1/images/51380a40-a52a-46bf-a537-f30ae7be94ef" status: 200 len: 1419 microversion: 2.1 time: 0.149808 Oct 08 20:58:24.611079 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 840/1748] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:58:24 2022] GET /compute/v2.1/images/51380a40-a52a-46bf-a537-f30ae7be94ef => generated 1419 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:58:25.231646 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c3250634-1994-469f-9c85-15cd44870c3b tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:25.233855 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-c3250634-1994-469f-9c85-15cd44870c3b tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] [instance: 84a8a931-6a18-4ef4-9e3c-63cf4054ea43] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:58:25.253378 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c3250634-1994-469f-9c85-15cd44870c3b tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:25.255469 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c3250634-1994-469f-9c85-15cd44870c3b tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:25.258408 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c3250634-1994-469f-9c85-15cd44870c3b tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:25.262848 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c3250634-1994-469f-9c85-15cd44870c3b tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:25.263929 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c3250634-1994-469f-9c85-15cd44870c3b tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:25.265702 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c3250634-1994-469f-9c85-15cd44870c3b tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:25.271720 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.network.security_group_api [None req-cff8c7fb-4c0b-4e34-a1fd-52a2f4b0bfed tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Removing security group 8b3db8c1-381d-40d2-bb6b-b796a9dc29e9 from port d911c0da-f663-4272-afa4-3646c36b9e29 Oct 08 20:58:26.641348 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-c3250634-1994-469f-9c85-15cd44870c3b tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ddc3cd3c374bacbe5bf5e0877380e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8472b054404c46a99b81aba34d6b9f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:58:26.659626 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-c3250634-1994-469f-9c85-15cd44870c3b tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] 10.222.0.26 "GET /compute/v2.1/servers/84a8a931-6a18-4ef4-9e3c-63cf4054ea43" status: 200 len: 1319 microversion: 2.1 time: 1.434678 Oct 08 20:58:26.667084 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 841/1749] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:58:25 2022] GET /compute/v2.1/servers/84a8a931-6a18-4ef4-9e3c-63cf4054ea43 => generated 1319 bytes in 1443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 20:58:26.672195 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-9d4bc4ce-d91b-4c9e-b1c6-41dcbdafe471 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Calling method '.version_select at 0x7f1a914d7e50>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:26.791611 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-9d4bc4ce-d91b-4c9e-b1c6-41dcbdafe471 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] 10.222.0.26 "GET /compute/v2.1/images/51380a40-a52a-46bf-a537-f30ae7be94ef" status: 200 len: 1419 microversion: 2.1 time: 0.121870 Oct 08 20:58:26.793161 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 842/1750] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:58:26 2022] GET /compute/v2.1/images/51380a40-a52a-46bf-a537-f30ae7be94ef => generated 1419 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:58:26.802894 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-73ca64e4-201c-49eb-b0a9-fd42b808b0b9 req-7edb90ad-3383-4568-870c-2e8f9f097fda service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "edebb288-3d28-4432-b9fd-d74cfb2de586", "tag": "1f6c228d-41e1-4df4-baee-27c394cbf1f4"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:58:26.861569 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-73ca64e4-201c-49eb-b0a9-fd42b808b0b9 req-7edb90ad-3383-4568-870c-2e8f9f097fda service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:26.868846 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-73ca64e4-201c-49eb-b0a9-fd42b808b0b9 req-7edb90ad-3383-4568-870c-2e8f9f097fda service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:26.869905 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-73ca64e4-201c-49eb-b0a9-fd42b808b0b9 req-7edb90ad-3383-4568-870c-2e8f9f097fda service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:26.915724 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-73ca64e4-201c-49eb-b0a9-fd42b808b0b9 req-7edb90ad-3383-4568-870c-2e8f9f097fda service nova] Creating event network-changed:1f6c228d-41e1-4df4-baee-27c394cbf1f4 for instance edebb288-3d28-4432-b9fd-d74cfb2de586 on nch2-master-1 Oct 08 20:58:26.944959 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-73ca64e4-201c-49eb-b0a9-fd42b808b0b9 req-7edb90ad-3383-4568-870c-2e8f9f097fda service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.142455 Oct 08 20:58:26.948499 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 843/1751] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:58:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:58:27.693342 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-ef7ddc53-8703-4d6e-8eba-e17e022f44c1 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:27.694521 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-ef7ddc53-8703-4d6e-8eba-e17e022f44c1 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] [instance: 84a8a931-6a18-4ef4-9e3c-63cf4054ea43] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:58:27.706958 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ef7ddc53-8703-4d6e-8eba-e17e022f44c1 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:27.707526 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ef7ddc53-8703-4d6e-8eba-e17e022f44c1 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:27.714043 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ef7ddc53-8703-4d6e-8eba-e17e022f44c1 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:27.715804 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ef7ddc53-8703-4d6e-8eba-e17e022f44c1 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:27.716619 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ef7ddc53-8703-4d6e-8eba-e17e022f44c1 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:27.718097 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ef7ddc53-8703-4d6e-8eba-e17e022f44c1 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:27.826669 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-cff8c7fb-4c0b-4e34-a1fd-52a2f4b0bfed tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] 10.222.0.26 "POST /compute/v2.1/servers/e5389d1b-b9f3-491a-898c-be611599d73a/action" status: 202 len: 0 microversion: 2.1 time: 3.743010 Oct 08 20:58:27.836332 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 909/1752] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 20:58:24 2022] POST /compute/v2.1/servers/e5389d1b-b9f3-491a-898c-be611599d73a/action => generated 0 bytes in 3758 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 20:58:27.841984 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-7b3ae425-f82c-4757-a1b1-4baacce8a2ec tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Calling method '.version_select at 0x7f1a8c020700>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:27.962888 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-7b3ae425-f82c-4757-a1b1-4baacce8a2ec tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] 10.222.0.26 "GET /compute/v2.1/images/51380a40-a52a-46bf-a537-f30ae7be94ef" status: 200 len: 1419 microversion: 2.1 time: 0.125151 Oct 08 20:58:27.966194 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 910/1753] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:58:27 2022] GET /compute/v2.1/images/51380a40-a52a-46bf-a537-f30ae7be94ef => generated 1419 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:58:27.976096 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-354d112a-7767-4874-b56b-e18cd341519d tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Action: 'create', calling method: .version_select at 0x7f1a8c20fca0>, body: {"pool": null} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:58:28.346255 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-ef7ddc53-8703-4d6e-8eba-e17e022f44c1 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ddc3cd3c374bacbe5bf5e0877380e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8472b054404c46a99b81aba34d6b9f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:58:28.363633 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-ef7ddc53-8703-4d6e-8eba-e17e022f44c1 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] 10.222.0.26 "GET /compute/v2.1/servers/84a8a931-6a18-4ef4-9e3c-63cf4054ea43" status: 200 len: 1319 microversion: 2.1 time: 0.672736 Oct 08 20:58:28.365700 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 844/1754] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:58:27 2022] GET /compute/v2.1/servers/84a8a931-6a18-4ef4-9e3c-63cf4054ea43 => generated 1319 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:58:28.382500 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-9c2a2450-9e6a-46d3-afe9-9f55ac4ffe6b req-4499e2d7-62b5-4f5f-807c-956d1f4ffd16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84a8a931-6a18-4ef4-9e3c-63cf4054ea43", "tag": "57ce510b-4c73-4cf0-bb97-6d1baab62e75"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:58:28.413218 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-9c2a2450-9e6a-46d3-afe9-9f55ac4ffe6b req-4499e2d7-62b5-4f5f-807c-956d1f4ffd16 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:28.415544 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-9c2a2450-9e6a-46d3-afe9-9f55ac4ffe6b req-4499e2d7-62b5-4f5f-807c-956d1f4ffd16 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:28.417593 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-9c2a2450-9e6a-46d3-afe9-9f55ac4ffe6b req-4499e2d7-62b5-4f5f-807c-956d1f4ffd16 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:28.466958 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-9c2a2450-9e6a-46d3-afe9-9f55ac4ffe6b req-4499e2d7-62b5-4f5f-807c-956d1f4ffd16 service nova] Creating event network-changed:57ce510b-4c73-4cf0-bb97-6d1baab62e75 for instance 84a8a931-6a18-4ef4-9e3c-63cf4054ea43 on nch2-master-1 Oct 08 20:58:28.479227 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-9c2a2450-9e6a-46d3-afe9-9f55ac4ffe6b req-4499e2d7-62b5-4f5f-807c-956d1f4ffd16 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110342 Oct 08 20:58:28.480436 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 845/1755] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:58:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:58:29.013106 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-59339360-9568-4a31-b907-4bf0bd78475e tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Calling method '.version_select at 0x7f1a914d4160>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:29.133522 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-59339360-9568-4a31-b907-4bf0bd78475e tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] 10.222.0.26 "GET /compute/v2.1/images/51380a40-a52a-46bf-a537-f30ae7be94ef" status: 200 len: 1419 microversion: 2.1 time: 0.137970 Oct 08 20:58:29.134914 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 846/1756] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:58:28 2022] GET /compute/v2.1/images/51380a40-a52a-46bf-a537-f30ae7be94ef => generated 1419 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:58:29.140220 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-b3ee294b-2324-4037-a06f-6cfa44861054 req-445df50b-76c4-43cc-bd97-076c8c434af6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5389d1b-b9f3-491a-898c-be611599d73a", "tag": "d911c0da-f663-4272-afa4-3646c36b9e29"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:58:29.155612 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-b3ee294b-2324-4037-a06f-6cfa44861054 req-445df50b-76c4-43cc-bd97-076c8c434af6 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:29.163422 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-b3ee294b-2324-4037-a06f-6cfa44861054 req-445df50b-76c4-43cc-bd97-076c8c434af6 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:29.165501 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-b3ee294b-2324-4037-a06f-6cfa44861054 req-445df50b-76c4-43cc-bd97-076c8c434af6 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:29.181700 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-b3ee294b-2324-4037-a06f-6cfa44861054 req-445df50b-76c4-43cc-bd97-076c8c434af6 service nova] Creating event network-changed:d911c0da-f663-4272-afa4-3646c36b9e29 for instance e5389d1b-b9f3-491a-898c-be611599d73a on nch2-master-1 Oct 08 20:58:29.189771 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-b3ee294b-2324-4037-a06f-6cfa44861054 req-445df50b-76c4-43cc-bd97-076c8c434af6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052633 Oct 08 20:58:29.191142 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 847/1757] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:58:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:58:29.356848 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-6f256986-1fa7-4e27-9c88-63253a4ac031 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:29.357501 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-6f256986-1fa7-4e27-9c88-63253a4ac031 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] [instance: f04fdc43-98fc-4bfc-a0f6-6efb9d2ee5bc] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:58:29.371935 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6f256986-1fa7-4e27-9c88-63253a4ac031 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:29.374948 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6f256986-1fa7-4e27-9c88-63253a4ac031 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:29.377276 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6f256986-1fa7-4e27-9c88-63253a4ac031 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:29.379210 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6f256986-1fa7-4e27-9c88-63253a4ac031 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:29.382442 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6f256986-1fa7-4e27-9c88-63253a4ac031 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:29.386682 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6f256986-1fa7-4e27-9c88-63253a4ac031 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:29.434965 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-6f256986-1fa7-4e27-9c88-63253a4ac031 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] [instance: f04fdc43-98fc-4bfc-a0f6-6efb9d2ee5bc] Going to try to terminate instance {{(pid=140491) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 20:58:29.560734 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-6f256986-1fa7-4e27-9c88-63253a4ac031 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] 10.222.0.26 "DELETE /compute/v2.1/servers/f04fdc43-98fc-4bfc-a0f6-6efb9d2ee5bc" status: 204 len: 0 microversion: 2.25 time: 0.209385 Oct 08 20:58:29.563329 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 848/1758] 10.222.0.26 () {60 vars in 1280 bytes} [Sat Oct 8 20:58:29 2022] DELETE /compute/v2.1/servers/f04fdc43-98fc-4bfc-a0f6-6efb9d2ee5bc => generated 0 bytes in 213 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 08 20:58:29.578419 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-a7b2124e-0c3a-4c65-99f1-bc5a8f131dd4 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:29.582393 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-a7b2124e-0c3a-4c65-99f1-bc5a8f131dd4 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] [instance: 84a8a931-6a18-4ef4-9e3c-63cf4054ea43] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:58:29.598428 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a7b2124e-0c3a-4c65-99f1-bc5a8f131dd4 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:29.601046 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a7b2124e-0c3a-4c65-99f1-bc5a8f131dd4 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:29.601779 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a7b2124e-0c3a-4c65-99f1-bc5a8f131dd4 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:29.603938 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a7b2124e-0c3a-4c65-99f1-bc5a8f131dd4 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:29.604417 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a7b2124e-0c3a-4c65-99f1-bc5a8f131dd4 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:29.604860 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a7b2124e-0c3a-4c65-99f1-bc5a8f131dd4 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:30.740910 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-a7b2124e-0c3a-4c65-99f1-bc5a8f131dd4 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ddc3cd3c374bacbe5bf5e0877380e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8472b054404c46a99b81aba34d6b9f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:58:30.763177 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-a7b2124e-0c3a-4c65-99f1-bc5a8f131dd4 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] 10.222.0.26 "GET /compute/v2.1/servers/84a8a931-6a18-4ef4-9e3c-63cf4054ea43" status: 200 len: 1319 microversion: 2.1 time: 1.196811 Oct 08 20:58:30.764217 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 849/1759] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:58:29 2022] GET /compute/v2.1/servers/84a8a931-6a18-4ef4-9e3c-63cf4054ea43 => generated 1319 bytes in 1200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:58:30.806093 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-984960eb-c6cb-4649-8293-2f959e967716 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:30.808259 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-984960eb-c6cb-4649-8293-2f959e967716 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] [instance: f04fdc43-98fc-4bfc-a0f6-6efb9d2ee5bc] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:58:30.828426 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-984960eb-c6cb-4649-8293-2f959e967716 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:30.829446 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-984960eb-c6cb-4649-8293-2f959e967716 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:30.830463 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-984960eb-c6cb-4649-8293-2f959e967716 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:30.832079 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-984960eb-c6cb-4649-8293-2f959e967716 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:30.832790 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-984960eb-c6cb-4649-8293-2f959e967716 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:30.833550 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-984960eb-c6cb-4649-8293-2f959e967716 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:31.182627 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-984960eb-c6cb-4649-8293-2f959e967716 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:58:31.205625 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-984960eb-c6cb-4649-8293-2f959e967716 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:58:31.210357 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-984960eb-c6cb-4649-8293-2f959e967716 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:58:31.213314 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-984960eb-c6cb-4649-8293-2f959e967716 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] 10.222.0.26 "GET /compute/v2.1/servers/f04fdc43-98fc-4bfc-a0f6-6efb9d2ee5bc" status: 200 len: 1549 microversion: 2.25 time: 0.431543 Oct 08 20:58:31.215224 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 850/1760] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:58:30 2022] GET /compute/v2.1/servers/f04fdc43-98fc-4bfc-a0f6-6efb9d2ee5bc => generated 1549 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:58:31.432532 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-016ddce2-eb12-4421-b2aa-ffa23a418837 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Action: 'create', calling method: .version_select at 0x7f1a914ce430>, body: {"keypair": {"name": "tempest-keypair-1569579173", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLoDbStAI9us5fM1WLV2VJAh482zBmW9jbSKRBVgYIbMEoF0gzpS1FfP+nol5vQVS8ZDpzubGBfUFwQXXW/F0serKFdbwI0cai/mf1DCizRNxwuEKEEYRZ0eho4JYwmWJQ=="}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:58:31.454519 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-016ddce2-eb12-4421-b2aa-ffa23a418837 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Getting quotas for project a82999f8bc36455bafd8eed23c68e733. Resources: {'key_pairs'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 20:58:31.462764 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-016ddce2-eb12-4421-b2aa-ffa23a418837 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Getting quotas for user 3d96135705514061bef9306753143357 and project a82999f8bc36455bafd8eed23c68e733. Resources: {'key_pairs'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 20:58:31.508164 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-016ddce2-eb12-4421-b2aa-ffa23a418837 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.290747 Oct 08 20:58:31.509528 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 851/1761] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Oct 8 20:58:31 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:58:31.513488 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-6f5eb322-cd68-4f33-b82d-d3e7ca985f7f tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Calling method '.version_select at 0x7f1a914d1ca0>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:31.585444 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-6f5eb322-cd68-4f33-b82d-d3e7ca985f7f tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] 10.222.0.26 "GET /compute/v2.1/images/51380a40-a52a-46bf-a537-f30ae7be94ef" status: 200 len: 1428 microversion: 2.1 time: 0.075310 Oct 08 20:58:31.595691 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 852/1762] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:58:31 2022] GET /compute/v2.1/images/51380a40-a52a-46bf-a537-f30ae7be94ef => generated 1428 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:58:31.601125 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-9502a5e8-c176-43ad-a472-4693e2be8f37 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Calling method '.version_select at 0x7f1a914ccd30>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:31.672803 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-9502a5e8-c176-43ad-a472-4693e2be8f37 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] 10.222.0.26 "GET /compute/v2.1/images/51380a40-a52a-46bf-a537-f30ae7be94ef" status: 200 len: 1428 microversion: 2.1 time: 0.075403 Oct 08 20:58:31.691405 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 853/1763] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:58:31 2022] GET /compute/v2.1/images/51380a40-a52a-46bf-a537-f30ae7be94ef => generated 1428 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:58:31.707052 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-ac9543fc-39a0-43c0-83ab-4bad6e0dd215 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:31.707874 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-ac9543fc-39a0-43c0-83ab-4bad6e0dd215 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] [instance: 19327d3e-de51-432b-b594-cb9a1bfe2f49] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:58:31.722857 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ac9543fc-39a0-43c0-83ab-4bad6e0dd215 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:31.723367 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ac9543fc-39a0-43c0-83ab-4bad6e0dd215 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:31.723898 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ac9543fc-39a0-43c0-83ab-4bad6e0dd215 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:31.724719 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ac9543fc-39a0-43c0-83ab-4bad6e0dd215 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:31.725218 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ac9543fc-39a0-43c0-83ab-4bad6e0dd215 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:31.725792 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ac9543fc-39a0-43c0-83ab-4bad6e0dd215 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:32.592714 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-ac9543fc-39a0-43c0-83ab-4bad6e0dd215 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322606d4cb0f45d3ac2eceab4999d45b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24a29bd6efb40609e31fbb6dba839e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:58:32.609657 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-ac9543fc-39a0-43c0-83ab-4bad6e0dd215 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] 10.222.0.26 "GET /compute/v2.1/servers/19327d3e-de51-432b-b594-cb9a1bfe2f49" status: 200 len: 1467 microversion: 2.1 time: 0.909451 Oct 08 20:58:32.629008 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 854/1764] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:58:31 2022] GET /compute/v2.1/servers/19327d3e-de51-432b-b594-cb9a1bfe2f49 => generated 1467 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:58:32.643254 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-7b2aa655-42f9-4727-82b8-c22d29c9c7f7 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:32.647807 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-7b2aa655-42f9-4727-82b8-c22d29c9c7f7 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] [instance: 84a8a931-6a18-4ef4-9e3c-63cf4054ea43] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:58:32.658493 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7b2aa655-42f9-4727-82b8-c22d29c9c7f7 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:32.660429 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7b2aa655-42f9-4727-82b8-c22d29c9c7f7 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:32.661080 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7b2aa655-42f9-4727-82b8-c22d29c9c7f7 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:32.662207 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7b2aa655-42f9-4727-82b8-c22d29c9c7f7 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:32.662881 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7b2aa655-42f9-4727-82b8-c22d29c9c7f7 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:32.663788 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7b2aa655-42f9-4727-82b8-c22d29c9c7f7 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:32.692731 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-354d112a-7767-4874-b56b-e18cd341519d tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] 10.222.0.26 "POST /compute/v2.1/os-floating-ips" status: 200 len: 140 microversion: 2.1 time: 4.725043 Oct 08 20:58:32.693916 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 911/1765] 10.222.0.26 () {60 vars in 1170 bytes} [Sat Oct 8 20:58:27 2022] POST /compute/v2.1/os-floating-ips => generated 140 bytes in 4727 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:58:32.883989 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-c49d6ff0-1ac5-48b7-85f3-47780dc82ff1 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:32.884772 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-c49d6ff0-1ac5-48b7-85f3-47780dc82ff1 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] [instance: f04fdc43-98fc-4bfc-a0f6-6efb9d2ee5bc] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:58:32.905780 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c49d6ff0-1ac5-48b7-85f3-47780dc82ff1 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:32.908422 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c49d6ff0-1ac5-48b7-85f3-47780dc82ff1 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:32.909750 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c49d6ff0-1ac5-48b7-85f3-47780dc82ff1 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:32.911170 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c49d6ff0-1ac5-48b7-85f3-47780dc82ff1 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:32.911755 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c49d6ff0-1ac5-48b7-85f3-47780dc82ff1 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:32.912295 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c49d6ff0-1ac5-48b7-85f3-47780dc82ff1 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:32.952293 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c49d6ff0-1ac5-48b7-85f3-47780dc82ff1 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:32.953076 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c49d6ff0-1ac5-48b7-85f3-47780dc82ff1 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:32.954402 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c49d6ff0-1ac5-48b7-85f3-47780dc82ff1 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:32.955584 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.objects.instance [None req-c49d6ff0-1ac5-48b7-85f3-47780dc82ff1 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lazy-loading 'fault' on Instance uuid f04fdc43-98fc-4bfc-a0f6-6efb9d2ee5bc {{(pid=140492) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 20:58:33.024819 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-c49d6ff0-1ac5-48b7-85f3-47780dc82ff1 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:58:33.047146 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-c49d6ff0-1ac5-48b7-85f3-47780dc82ff1 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:58:33.048758 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-c49d6ff0-1ac5-48b7-85f3-47780dc82ff1 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:58:33.050749 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-c49d6ff0-1ac5-48b7-85f3-47780dc82ff1 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] 10.222.0.26 "GET /compute/v2.1/servers/f04fdc43-98fc-4bfc-a0f6-6efb9d2ee5bc" status: 200 len: 1352 microversion: 2.25 time: 0.355795 Oct 08 20:58:33.066379 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 912/1766] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:58:32 2022] GET /compute/v2.1/servers/f04fdc43-98fc-4bfc-a0f6-6efb9d2ee5bc => generated 1352 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:58:33.077822 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-a85536fe-d33c-4e2b-bc32-dd60d22d0e4d req-10fcc9b5-d789-4ec2-a78e-c07170e51e8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f04fdc43-98fc-4bfc-a0f6-6efb9d2ee5bc", "name": "network-vif-deleted", "tag": "84bc0e3e-26ae-44e6-9044-9b319506b2ff"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:58:33.092900 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-a85536fe-d33c-4e2b-bc32-dd60d22d0e4d req-10fcc9b5-d789-4ec2-a78e-c07170e51e8a service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:33.095628 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-a85536fe-d33c-4e2b-bc32-dd60d22d0e4d req-10fcc9b5-d789-4ec2-a78e-c07170e51e8a service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:33.098653 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-a85536fe-d33c-4e2b-bc32-dd60d22d0e4d req-10fcc9b5-d789-4ec2-a78e-c07170e51e8a service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:33.114813 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-a85536fe-d33c-4e2b-bc32-dd60d22d0e4d req-10fcc9b5-d789-4ec2-a78e-c07170e51e8a service nova] Creating event network-vif-deleted:84bc0e3e-26ae-44e6-9044-9b319506b2ff for instance f04fdc43-98fc-4bfc-a0f6-6efb9d2ee5bc on nch2-master-1 Oct 08 20:58:33.124149 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-a85536fe-d33c-4e2b-bc32-dd60d22d0e4d req-10fcc9b5-d789-4ec2-a78e-c07170e51e8a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054240 Oct 08 20:58:33.130998 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 913/1767] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:58:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:58:33.139003 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-0b052f16-64df-430c-b54b-2491ef0f09f8 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Calling method '.version_select at 0x7f1a8c025d30>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:33.202525 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-0b052f16-64df-430c-b54b-2491ef0f09f8 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] 10.222.0.26 "GET /compute/v2.1/images/c508bd7f-7db9-4b2c-af7c-be54a855c355" status: 200 len: 784 microversion: 2.1 time: 0.070182 Oct 08 20:58:33.212503 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 914/1768] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:58:33 2022] GET /compute/v2.1/images/c508bd7f-7db9-4b2c-af7c-be54a855c355 => generated 784 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:58:33.212503 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-28fb0739-5241-4cb8-a3d3-aa5720f0c76b tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Action: 'action', calling method: .version_select at 0x7f1a8e602ee0>, body: {"addFloatingIp": {"address": "172.35.5.9"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:58:33.213340 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-28fb0739-5241-4cb8-a3d3-aa5720f0c76b tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] [instance: e5389d1b-b9f3-491a-898c-be611599d73a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:58:33.220991 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-28fb0739-5241-4cb8-a3d3-aa5720f0c76b tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:33.222297 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-28fb0739-5241-4cb8-a3d3-aa5720f0c76b tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:33.222514 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-28fb0739-5241-4cb8-a3d3-aa5720f0c76b tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:33.223267 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-28fb0739-5241-4cb8-a3d3-aa5720f0c76b tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:33.223974 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-28fb0739-5241-4cb8-a3d3-aa5720f0c76b tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:33.224354 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-28fb0739-5241-4cb8-a3d3-aa5720f0c76b tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:33.358342 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-28fb0739-5241-4cb8-a3d3-aa5720f0c76b tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Acquiring lock "refresh_cache-e5389d1b-b9f3-491a-898c-be611599d73a" {{(pid=140492) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 08 20:58:33.358762 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-28fb0739-5241-4cb8-a3d3-aa5720f0c76b tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Acquired lock "refresh_cache-e5389d1b-b9f3-491a-898c-be611599d73a" {{(pid=140492) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 08 20:58:33.519571 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-7b2aa655-42f9-4727-82b8-c22d29c9c7f7 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ddc3cd3c374bacbe5bf5e0877380e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8472b054404c46a99b81aba34d6b9f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:58:33.541433 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-7b2aa655-42f9-4727-82b8-c22d29c9c7f7 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] 10.222.0.26 "GET /compute/v2.1/servers/84a8a931-6a18-4ef4-9e3c-63cf4054ea43" status: 200 len: 1319 microversion: 2.1 time: 0.904685 Oct 08 20:58:33.542439 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 855/1769] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:58:32 2022] GET /compute/v2.1/servers/84a8a931-6a18-4ef4-9e3c-63cf4054ea43 => generated 1319 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:58:33.547955 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-5f0f46f7-8d67-455c-89dd-2d6c569eb283 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:33.560043 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-5f0f46f7-8d67-455c-89dd-2d6c569eb283 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] 10.222.0.26 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.016181 Oct 08 20:58:33.569157 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 856/1770] 10.222.0.26 () {58 vars in 1137 bytes} [Sat Oct 8 20:58:33 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:58:33.575915 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-681627d4-8d37-4c78-898f-3aca00fd6966 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Calling method '.version_select at 0x7f1a914d7700>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:34.755046 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-681627d4-8d37-4c78-898f-3aca00fd6966 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] 10.222.0.26 "DELETE /compute/v2.1/images/51380a40-a52a-46bf-a537-f30ae7be94ef" status: 204 len: 0 microversion: 2.1 time: 1.183819 Oct 08 20:58:34.756266 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 857/1771] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:58:33 2022] DELETE /compute/v2.1/images/51380a40-a52a-46bf-a537-f30ae7be94ef => generated 0 bytes in 1186 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 20:58:34.761800 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-cb9d7af5-824d-40c7-9d94-1a19775072fd req-cd73da8e-ce4f-4ac2-bd4a-14fd0105361a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19327d3e-de51-432b-b594-cb9a1bfe2f49", "name": "network-vif-unplugged", "status": "completed", "tag": "6fbec29d-5924-4cc1-9f8d-c5ac27cbc284"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:58:34.775401 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-cb9d7af5-824d-40c7-9d94-1a19775072fd req-cd73da8e-ce4f-4ac2-bd4a-14fd0105361a service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:34.775847 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-cb9d7af5-824d-40c7-9d94-1a19775072fd req-cd73da8e-ce4f-4ac2-bd4a-14fd0105361a service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:34.776498 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-cb9d7af5-824d-40c7-9d94-1a19775072fd req-cd73da8e-ce4f-4ac2-bd4a-14fd0105361a service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:34.792682 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-cb9d7af5-824d-40c7-9d94-1a19775072fd req-cd73da8e-ce4f-4ac2-bd4a-14fd0105361a service nova] Creating event network-vif-unplugged:6fbec29d-5924-4cc1-9f8d-c5ac27cbc284 for instance 19327d3e-de51-432b-b594-cb9a1bfe2f49 on nch1-master-1 Oct 08 20:58:34.800134 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-cb9d7af5-824d-40c7-9d94-1a19775072fd req-cd73da8e-ce4f-4ac2-bd4a-14fd0105361a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042140 Oct 08 20:58:34.802776 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 858/1772] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:58:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:58:34.810135 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-0b4dad4e-026d-4104-90aa-00215548d85b tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:34.811656 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-0b4dad4e-026d-4104-90aa-00215548d85b tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] [instance: f04fdc43-98fc-4bfc-a0f6-6efb9d2ee5bc] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:58:34.821800 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0b4dad4e-026d-4104-90aa-00215548d85b tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:34.822642 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0b4dad4e-026d-4104-90aa-00215548d85b tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:34.825400 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0b4dad4e-026d-4104-90aa-00215548d85b tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:34.827169 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0b4dad4e-026d-4104-90aa-00215548d85b tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:34.828345 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0b4dad4e-026d-4104-90aa-00215548d85b tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:34.829117 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0b4dad4e-026d-4104-90aa-00215548d85b tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:34.855332 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-0b4dad4e-026d-4104-90aa-00215548d85b tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] HTTP exception thrown: Instance f04fdc43-98fc-4bfc-a0f6-6efb9d2ee5bc could not be found. Oct 08 20:58:34.859480 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-0b4dad4e-026d-4104-90aa-00215548d85b tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Request method failure captured: Oct 08 20:58:34.859480 ncdv-master-1 devstack@n-api.service[140491]: request: GET /compute/v2.1/servers/f04fdc43-98fc-4bfc-a0f6-6efb9d2ee5bc HTTP/1.1 Oct 08 20:58:34.859480 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 20:58:34.859480 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 20:58:34.859480 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 20:58:34.859480 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 20:58:34.859480 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 20:58:34.859480 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 20:58:34.859480 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 20:58:34.859480 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 20:58:34.859480 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeM_8itqsdTjDSrlGxZZ-u44pmaEYPSQW4Sfx3OogMOjCfNSG1scpEldctJo7eYijpgGhtozXKwLr8evVzi5nf4wuH1lfEdHrH_7IHaykS_Ns0neu4keC9kqpsLbriJukycX0gnBg9-m0XH6tiS45uipRftXY8tUpNqJ0OB6f1O8wUg Oct 08 20:58:34.859480 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 20:58:34.859480 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 20:58:34.859480 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 20:58:34.859480 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 20:58:34.859480 ncdv-master-1 devstack@n-api.service[140491]: X-Openstack-Nova-Api-Version: 2.25 Oct 08 20:58:34.859480 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 20:58:34.859480 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 20:58:34.859480 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: ac5c7906a4714a1887cb823e1c3a6056 Oct 08 20:58:34.859480 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-2037918034 Oct 08 20:58:34.859480 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 20:58:34.859480 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 20:58:34.859480 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ac5c7906a4714a1887cb823e1c3a6056"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ac5c7906a4714a1887cb823e1c3a6056"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ac5c7906a4714a1887cb823e1c3a6056"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ac5c7906a4714a1887cb823e1c3a6056"}]}] Oct 08 20:58:34.859480 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-2037918034 Oct 08 20:58:34.859480 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: ac5c7906a4714a1887cb823e1c3a6056 Oct 08 20:58:34.859480 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-2037918034 Oct 08 20:58:34.859480 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-LiveAutoBlockMigrationV225Test-2037918034-project Oct 08 20:58:34.859480 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 20:58:34.859480 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 20:58:34.859480 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: d54b1c5c00544be4b60132d09817c8d6 Oct 08 20:58:34.859480 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-2037918034-project Oct 08 20:58:34.859480 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 20:58:34.859480 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance f04fdc43-98fc-4bfc-a0f6-6efb9d2ee5bc could not be found. Oct 08 20:58:34.859480 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': 'f04fdc43-98fc-4bfc-a0f6-6efb9d2ee5bc'} Oct 08 20:58:34.859480 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:58:34.859480 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:58:34.859480 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 20:58:34.859480 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 20:58:34.859480 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 20:58:34.859480 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 20:58:34.859480 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 20:58:34.859480 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 20:58:34.859480 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 20:58:34.859480 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 20:58:34.859480 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f04fdc43-98fc-4bfc-a0f6-6efb9d2ee5bc could not be found. Oct 08 20:58:34.859480 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:58:34.859480 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:58:34.859480 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:58:34.859480 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:58:34.859480 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:58:34.859480 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:58:34.859480 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:58:34.859480 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:58:34.859480 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:58:34.859480 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:58:34.859480 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 20:58:34.859480 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 20:58:34.859480 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 20:58:34.859480 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 20:58:34.859480 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 20:58:34.859480 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 20:58:34.859480 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f04fdc43-98fc-4bfc-a0f6-6efb9d2ee5bc could not be found. Oct 08 20:58:34.859480 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:58:34.868211 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:58:34.868211 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:58:34.868211 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:58:34.868211 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:58:34.868211 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:58:34.868211 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 20:58:34.868211 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 20:58:34.868211 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f04fdc43-98fc-4bfc-a0f6-6efb9d2ee5bc could not be found. Oct 08 20:58:34.868211 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:58:34.872569 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-0b4dad4e-026d-4104-90aa-00215548d85b tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Returning 404 to user: Instance f04fdc43-98fc-4bfc-a0f6-6efb9d2ee5bc could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:58:34.873802 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-0b4dad4e-026d-4104-90aa-00215548d85b tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] 10.222.0.26 "GET /compute/v2.1/servers/f04fdc43-98fc-4bfc-a0f6-6efb9d2ee5bc" status: 404 len: 111 microversion: 2.25 time: 0.069053 Oct 08 20:58:34.875119 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 859/1773] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:58:34 2022] GET /compute/v2.1/servers/f04fdc43-98fc-4bfc-a0f6-6efb9d2ee5bc => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 08 20:58:34.882479 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-1a85563e-e2ff-4e55-a9fd-257447b0c8ae tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:34.883521 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-1a85563e-e2ff-4e55-a9fd-257447b0c8ae tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] [instance: 84a8a931-6a18-4ef4-9e3c-63cf4054ea43] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:58:34.890702 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1a85563e-e2ff-4e55-a9fd-257447b0c8ae tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:34.891845 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1a85563e-e2ff-4e55-a9fd-257447b0c8ae tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:34.892673 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1a85563e-e2ff-4e55-a9fd-257447b0c8ae tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:34.893726 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1a85563e-e2ff-4e55-a9fd-257447b0c8ae tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:34.894424 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1a85563e-e2ff-4e55-a9fd-257447b0c8ae tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:34.895364 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1a85563e-e2ff-4e55-a9fd-257447b0c8ae tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:35.175354 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.network.neutron [None req-28fb0739-5241-4cb8-a3d3-aa5720f0c76b tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] [instance: e5389d1b-b9f3-491a-898c-be611599d73a] Building network info cache for instance {{(pid=140492) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 08 20:58:35.621253 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-1a85563e-e2ff-4e55-a9fd-257447b0c8ae tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ddc3cd3c374bacbe5bf5e0877380e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8472b054404c46a99b81aba34d6b9f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:58:35.635083 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-1a85563e-e2ff-4e55-a9fd-257447b0c8ae tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] 10.222.0.26 "GET /compute/v2.1/servers/84a8a931-6a18-4ef4-9e3c-63cf4054ea43" status: 200 len: 1319 microversion: 2.1 time: 0.758260 Oct 08 20:58:35.651469 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 860/1774] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:58:34 2022] GET /compute/v2.1/servers/84a8a931-6a18-4ef4-9e3c-63cf4054ea43 => generated 1319 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:58:35.662330 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-ea97f5eb-3f96-467c-b5b4-6fef9070dd0a tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Calling method '.version_select at 0x7f1a914d8d30>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:35.687698 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-ea97f5eb-3f96-467c-b5b4-6fef9070dd0a tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] HTTP exception thrown: Image not found. Oct 08 20:58:35.692276 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-ea97f5eb-3f96-467c-b5b4-6fef9070dd0a tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Request method failure captured: Oct 08 20:58:35.692276 ncdv-master-1 devstack@n-api.service[140491]: request: GET /compute/v2.1/images/51380a40-a52a-46bf-a537-f30ae7be94ef HTTP/1.1 Oct 08 20:58:35.692276 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 20:58:35.692276 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 20:58:35.692276 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 20:58:35.692276 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 20:58:35.692276 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 20:58:35.692276 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 20:58:35.692276 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 20:58:35.692276 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 20:58:35.692276 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeQ8lmuamJgXJSwemYAXatbYzGYxm_vVecG_OkvuOFcfHBi0mwsDPaUy2fuPA0W4Cc63IKn5u45dzTXN2Hrfj_C4JN_oRWkar0MPXmWSzRRvEUZ20-nXU9GxMuOhWBfxj859Yy1sfVnVE5SohziLAPcgHkGVSZftQN4FJxkgA7wmzB4 Oct 08 20:58:35.692276 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 20:58:35.692276 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 20:58:35.692276 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 20:58:35.692276 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 20:58:35.692276 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 20:58:35.692276 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 20:58:35.692276 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: d24a29bd6efb40609e31fbb6dba839e8 Oct 08 20:58:35.692276 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-ImagesOneServerTestJSON-55201698 Oct 08 20:58:35.692276 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 20:58:35.692276 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 20:58:35.692276 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d24a29bd6efb40609e31fbb6dba839e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d24a29bd6efb40609e31fbb6dba839e8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d24a29bd6efb40609e31fbb6dba839e8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d24a29bd6efb40609e31fbb6dba839e8"}]}] Oct 08 20:58:35.692276 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-ImagesOneServerTestJSON-55201698 Oct 08 20:58:35.692276 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: d24a29bd6efb40609e31fbb6dba839e8 Oct 08 20:58:35.692276 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-55201698 Oct 08 20:58:35.692276 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-ImagesOneServerTestJSON-55201698-project Oct 08 20:58:35.692276 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 20:58:35.692276 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 20:58:35.692276 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 322606d4cb0f45d3ac2eceab4999d45b Oct 08 20:58:35.692276 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-ImagesOneServerTestJSON-55201698-project Oct 08 20:58:35.692276 ncdv-master-1 devstack@n-api.service[140491]: method: Oct 08 20:58:35.692276 ncdv-master-1 devstack@n-api.service[140491]: exception: Image not found. Oct 08 20:58:35.692276 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': '51380a40-a52a-46bf-a537-f30ae7be94ef'} Oct 08 20:58:35.692276 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:58:35.692276 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:58:35.692276 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 08 20:58:35.692276 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 08 20:58:35.692276 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 08 20:58:35.692276 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 08 20:58:35.692276 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 08 20:58:35.692276 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 08 20:58:35.692276 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 08 20:58:35.692276 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 08 20:58:35.692276 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 08 20:58:35.692276 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 08 20:58:35.692276 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 08 20:58:35.692276 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 08 20:58:35.692276 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 08 20:58:35.692276 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 08 20:58:35.692276 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 08 20:58:35.692276 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 08 20:58:35.692276 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 51380a40-a52a-46bf-a537-f30ae7be94ef Oct 08 20:58:35.692276 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:58:35.692276 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:58:35.692276 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:58:35.692276 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:58:35.692276 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 08 20:58:35.692276 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 08 20:58:35.692276 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 08 20:58:35.692276 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 08 20:58:35.692276 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 08 20:58:35.692276 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 08 20:58:35.692276 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 08 20:58:35.692276 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 08 20:58:35.701168 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 08 20:58:35.701168 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 08 20:58:35.701168 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 08 20:58:35.701168 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 08 20:58:35.701168 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 08 20:58:35.701168 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 08 20:58:35.701168 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 08 20:58:35.701168 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 08 20:58:35.701168 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 08 20:58:35.701168 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 08 20:58:35.701168 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 08 20:58:35.701168 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 08 20:58:35.701168 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 08 20:58:35.701168 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 08 20:58:35.701168 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 08 20:58:35.701168 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 08 20:58:35.701168 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 51380a40-a52a-46bf-a537-f30ae7be94ef could not be found. Oct 08 20:58:35.701168 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:58:35.701168 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:58:35.701168 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:58:35.701168 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:58:35.701168 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:58:35.701168 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:58:35.701168 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:58:35.701168 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:58:35.701168 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 08 20:58:35.701168 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 08 20:58:35.701168 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:58:35.701168 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:58:35.701168 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 08 20:58:35.701168 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 08 20:58:35.701168 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 08 20:58:35.701168 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:58:35.701168 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:58:35.701168 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:58:35.701168 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:58:35.701168 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:58:35.701168 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:58:35.701168 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 20:58:35.701168 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 20:58:35.701168 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 08 20:58:35.701168 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:58:35.701168 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-ea97f5eb-3f96-467c-b5b4-6fef9070dd0a tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Returning 404 to user: Image not found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:58:35.701168 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-ea97f5eb-3f96-467c-b5b4-6fef9070dd0a tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] 10.222.0.26 "GET /compute/v2.1/images/51380a40-a52a-46bf-a537-f30ae7be94ef" status: 404 len: 62 microversion: 2.1 time: 0.036663 Oct 08 20:58:35.708860 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 861/1775] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:58:35 2022] GET /compute/v2.1/images/51380a40-a52a-46bf-a537-f30ae7be94ef => generated 62 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 08 20:58:35.718596 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-8a41f630-42fb-4ab8-8bc1-e82b98abb51c tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:35.719115 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-8a41f630-42fb-4ab8-8bc1-e82b98abb51c tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] [instance: 139f7ae3-b380-4114-a566-6d496d4957f4] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:58:35.739456 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8a41f630-42fb-4ab8-8bc1-e82b98abb51c tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:35.739917 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8a41f630-42fb-4ab8-8bc1-e82b98abb51c tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:35.740461 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8a41f630-42fb-4ab8-8bc1-e82b98abb51c tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:35.741095 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8a41f630-42fb-4ab8-8bc1-e82b98abb51c tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:35.741640 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8a41f630-42fb-4ab8-8bc1-e82b98abb51c tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:35.743446 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8a41f630-42fb-4ab8-8bc1-e82b98abb51c tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:35.792356 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-8a41f630-42fb-4ab8-8bc1-e82b98abb51c tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] [instance: 139f7ae3-b380-4114-a566-6d496d4957f4] Going to try to terminate instance {{(pid=140491) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 20:58:35.938927 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-8a41f630-42fb-4ab8-8bc1-e82b98abb51c tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] 10.222.0.26 "DELETE /compute/v2.1/servers/139f7ae3-b380-4114-a566-6d496d4957f4" status: 204 len: 0 microversion: 2.25 time: 0.229087 Oct 08 20:58:35.940434 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 862/1776] 10.222.0.26 () {60 vars in 1280 bytes} [Sat Oct 8 20:58:35 2022] DELETE /compute/v2.1/servers/139f7ae3-b380-4114-a566-6d496d4957f4 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 08 20:58:35.957262 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-2e4fc6a1-458b-4df3-9628-1021b580e33a req-a1f351fc-2596-421f-8f9e-af56978e5312 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5389d1b-b9f3-491a-898c-be611599d73a", "tag": "d911c0da-f663-4272-afa4-3646c36b9e29"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:58:35.972574 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-2e4fc6a1-458b-4df3-9628-1021b580e33a req-a1f351fc-2596-421f-8f9e-af56978e5312 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:35.973545 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-2e4fc6a1-458b-4df3-9628-1021b580e33a req-a1f351fc-2596-421f-8f9e-af56978e5312 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:35.973995 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-2e4fc6a1-458b-4df3-9628-1021b580e33a req-a1f351fc-2596-421f-8f9e-af56978e5312 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:35.987962 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-2e4fc6a1-458b-4df3-9628-1021b580e33a req-a1f351fc-2596-421f-8f9e-af56978e5312 service nova] Creating event network-changed:d911c0da-f663-4272-afa4-3646c36b9e29 for instance e5389d1b-b9f3-491a-898c-be611599d73a on nch2-master-1 Oct 08 20:58:35.994028 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-2e4fc6a1-458b-4df3-9628-1021b580e33a req-a1f351fc-2596-421f-8f9e-af56978e5312 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046118 Oct 08 20:58:35.995987 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 863/1777] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:58:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:58:36.005060 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-beedbdc0-a3be-4061-b49a-239b5647627c tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-712336888"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:58:36.008551 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-beedbdc0-a3be-4061-b49a-239b5647627c tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] [instance: 19327d3e-de51-432b-b594-cb9a1bfe2f49] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:58:36.021116 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-beedbdc0-a3be-4061-b49a-239b5647627c tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:36.021887 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-beedbdc0-a3be-4061-b49a-239b5647627c tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:36.022543 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-beedbdc0-a3be-4061-b49a-239b5647627c tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:36.024155 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-beedbdc0-a3be-4061-b49a-239b5647627c tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:36.024812 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-beedbdc0-a3be-4061-b49a-239b5647627c tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:36.028151 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.network.neutron [None req-28fb0739-5241-4cb8-a3d3-aa5720f0c76b tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] [instance: e5389d1b-b9f3-491a-898c-be611599d73a] Updating instance_info_cache with network_info: [{"id": "d911c0da-f663-4272-afa4-3646c36b9e29", "address": "fa:16:3e:ba:65:e2", "network": {"id": "9a7c4906-c385-42bd-b7c0-9941e033f637", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-1486799263-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.5.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "6c97b3b7fa484f97bdf40224f7cc34d4", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapd911c0da-f6", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=140492) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 08 20:58:36.032611 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-beedbdc0-a3be-4061-b49a-239b5647627c tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:36.047017 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:58:36.050942 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-28fb0739-5241-4cb8-a3d3-aa5720f0c76b tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Releasing lock "refresh_cache-e5389d1b-b9f3-491a-898c-be611599d73a" {{(pid=140492) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 08 20:58:36.053597 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-28fb0739-5241-4cb8-a3d3-aa5720f0c76b tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] 10.222.0.26 "POST /compute/v2.1/servers/e5389d1b-b9f3-491a-898c-be611599d73a/action" status: 202 len: 0 microversion: 2.1 time: 2.847822 Oct 08 20:58:36.056717 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 915/1778] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 20:58:33 2022] POST /compute/v2.1/servers/e5389d1b-b9f3-491a-898c-be611599d73a/action => generated 0 bytes in 2852 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 08 20:58:36.065026 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-87c4cd59-56d9-447f-a038-cbdc5e83046e tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:36.071141 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-87c4cd59-56d9-447f-a038-cbdc5e83046e tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] [instance: 139f7ae3-b380-4114-a566-6d496d4957f4] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:58:36.087127 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-87c4cd59-56d9-447f-a038-cbdc5e83046e tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:36.087647 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-87c4cd59-56d9-447f-a038-cbdc5e83046e tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:36.088226 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-87c4cd59-56d9-447f-a038-cbdc5e83046e tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:36.088839 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-87c4cd59-56d9-447f-a038-cbdc5e83046e tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:36.092307 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-87c4cd59-56d9-447f-a038-cbdc5e83046e tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:36.093624 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-87c4cd59-56d9-447f-a038-cbdc5e83046e tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:36.306731 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-87c4cd59-56d9-447f-a038-cbdc5e83046e tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:58:36.326166 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-87c4cd59-56d9-447f-a038-cbdc5e83046e tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:58:36.328187 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-87c4cd59-56d9-447f-a038-cbdc5e83046e tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:58:36.329948 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-87c4cd59-56d9-447f-a038-cbdc5e83046e tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] 10.222.0.26 "GET /compute/v2.1/servers/139f7ae3-b380-4114-a566-6d496d4957f4" status: 200 len: 1564 microversion: 2.25 time: 0.271030 Oct 08 20:58:36.331071 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 916/1779] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:58:36 2022] GET /compute/v2.1/servers/139f7ae3-b380-4114-a566-6d496d4957f4 => generated 1564 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:58:36.356030 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-1cd1ed57-321c-4c99-8800-e698ff11c106 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Action: 'action', calling method: .version_select at 0x7f1a8e602f70>, body: {"removeFloatingIp": {"address": "172.35.5.9"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:58:36.407881 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-beedbdc0-a3be-4061-b49a-239b5647627c tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] 10.222.0.26 "POST /compute/v2.1/servers/19327d3e-de51-432b-b594-cb9a1bfe2f49/action" status: 202 len: 0 microversion: 2.1 time: 0.409513 Oct 08 20:58:36.410253 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 864/1780] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 20:58:35 2022] POST /compute/v2.1/servers/19327d3e-de51-432b-b594-cb9a1bfe2f49/action => generated 0 bytes in 414 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 08 20:58:36.422539 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-8ecea75b-3986-4070-9b63-77289f0f0b92 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Calling method '.version_select at 0x7f1a91491820>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:36.499788 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-8ecea75b-3986-4070-9b63-77289f0f0b92 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] 10.222.0.26 "GET /compute/v2.1/images/fa97ce22-1af3-4366-9d57-84040c24f915" status: 200 len: 1424 microversion: 2.1 time: 0.081426 Oct 08 20:58:36.502993 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 865/1781] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:58:36 2022] GET /compute/v2.1/images/fa97ce22-1af3-4366-9d57-84040c24f915 => generated 1424 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:58:36.665150 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-3e91b023-3c15-49bd-8c1a-3c629e418b2f tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:36.666969 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-3e91b023-3c15-49bd-8c1a-3c629e418b2f tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] [instance: 84a8a931-6a18-4ef4-9e3c-63cf4054ea43] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:58:36.684578 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-1cd1ed57-321c-4c99-8800-e698ff11c106 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] [instance: e5389d1b-b9f3-491a-898c-be611599d73a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:58:36.686851 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3e91b023-3c15-49bd-8c1a-3c629e418b2f tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:36.687565 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3e91b023-3c15-49bd-8c1a-3c629e418b2f tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:36.688202 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3e91b023-3c15-49bd-8c1a-3c629e418b2f tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:36.690589 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3e91b023-3c15-49bd-8c1a-3c629e418b2f tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:36.691286 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3e91b023-3c15-49bd-8c1a-3c629e418b2f tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:36.693311 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3e91b023-3c15-49bd-8c1a-3c629e418b2f tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:36.701659 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1cd1ed57-321c-4c99-8800-e698ff11c106 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:36.702448 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1cd1ed57-321c-4c99-8800-e698ff11c106 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:36.703027 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1cd1ed57-321c-4c99-8800-e698ff11c106 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:36.704651 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1cd1ed57-321c-4c99-8800-e698ff11c106 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:36.705576 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1cd1ed57-321c-4c99-8800-e698ff11c106 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:36.708070 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1cd1ed57-321c-4c99-8800-e698ff11c106 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:37.120153 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1cd1ed57-321c-4c99-8800-e698ff11c106 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Acquiring lock "refresh_cache-e5389d1b-b9f3-491a-898c-be611599d73a" {{(pid=140492) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 08 20:58:37.120582 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1cd1ed57-321c-4c99-8800-e698ff11c106 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Acquired lock "refresh_cache-e5389d1b-b9f3-491a-898c-be611599d73a" {{(pid=140492) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 08 20:58:37.207907 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-3e91b023-3c15-49bd-8c1a-3c629e418b2f tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ddc3cd3c374bacbe5bf5e0877380e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8472b054404c46a99b81aba34d6b9f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:58:37.217710 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-3e91b023-3c15-49bd-8c1a-3c629e418b2f tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] 10.222.0.26 "GET /compute/v2.1/servers/84a8a931-6a18-4ef4-9e3c-63cf4054ea43" status: 200 len: 1319 microversion: 2.1 time: 0.557741 Oct 08 20:58:37.229310 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 866/1782] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:58:36 2022] GET /compute/v2.1/servers/84a8a931-6a18-4ef4-9e3c-63cf4054ea43 => generated 1319 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:58:37.235172 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-4a09b88e-73f0-4ee3-8e3a-38e78463a20a req-e2875925-55fd-4b25-92bd-273b839cfb24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edebb288-3d28-4432-b9fd-d74cfb2de586", "name": "network-vif-plugged", "status": "completed", "tag": "1f6c228d-41e1-4df4-baee-27c394cbf1f4"}, {"server_uuid": "84a8a931-6a18-4ef4-9e3c-63cf4054ea43", "name": "network-vif-plugged", "status": "completed", "tag": "57ce510b-4c73-4cf0-bb97-6d1baab62e75"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:58:37.250610 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-4a09b88e-73f0-4ee3-8e3a-38e78463a20a req-e2875925-55fd-4b25-92bd-273b839cfb24 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:37.251343 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-4a09b88e-73f0-4ee3-8e3a-38e78463a20a req-e2875925-55fd-4b25-92bd-273b839cfb24 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:37.252018 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-4a09b88e-73f0-4ee3-8e3a-38e78463a20a req-e2875925-55fd-4b25-92bd-273b839cfb24 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:37.271919 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-4a09b88e-73f0-4ee3-8e3a-38e78463a20a req-e2875925-55fd-4b25-92bd-273b839cfb24 service nova] Creating event network-vif-plugged:1f6c228d-41e1-4df4-baee-27c394cbf1f4 for instance edebb288-3d28-4432-b9fd-d74cfb2de586 on nch2-master-1 Oct 08 20:58:37.272719 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-4a09b88e-73f0-4ee3-8e3a-38e78463a20a req-e2875925-55fd-4b25-92bd-273b839cfb24 service nova] Creating event network-vif-plugged:57ce510b-4c73-4cf0-bb97-6d1baab62e75 for instance 84a8a931-6a18-4ef4-9e3c-63cf4054ea43 on nch2-master-1 Oct 08 20:58:37.282047 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-4a09b88e-73f0-4ee3-8e3a-38e78463a20a req-e2875925-55fd-4b25-92bd-273b839cfb24 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.050710 Oct 08 20:58:37.284220 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 867/1783] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:58:37 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:58:37.292743 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-d16dd869-940f-4777-b9ca-4708c8fd906e tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:37.299179 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-d16dd869-940f-4777-b9ca-4708c8fd906e tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5d9facf5ea0743cb821cec1b40f6b609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdaf5b9230f4e09949a39a5cbe72011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:58:37.305900 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-d16dd869-940f-4777-b9ca-4708c8fd906e tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Searching by: {'deleted': False, 'project_id': '5cdaf5b9230f4e09949a39a5cbe72011'} {{(pid=140491) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 08 20:58:37.319617 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d16dd869-940f-4777-b9ca-4708c8fd906e tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:37.320522 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d16dd869-940f-4777-b9ca-4708c8fd906e tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:37.321485 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d16dd869-940f-4777-b9ca-4708c8fd906e tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:37.323045 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d16dd869-940f-4777-b9ca-4708c8fd906e tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:37.323844 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d16dd869-940f-4777-b9ca-4708c8fd906e tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:37.324506 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d16dd869-940f-4777-b9ca-4708c8fd906e tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:37.439909 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.multi_cell_list [None req-d16dd869-940f-4777-b9ca-4708c8fd906e tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=140491) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 08 20:58:37.532345 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-d16dd869-940f-4777-b9ca-4708c8fd906e tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] 10.222.0.26 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.246581 Oct 08 20:58:37.534419 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 868/1784] 10.222.0.26 () {58 vars in 1125 bytes} [Sat Oct 8 20:58:37 2022] GET /compute/v2.1/servers => generated 340 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:58:37.547525 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-ee6cb077-2da1-49b9-933d-778b3b48761c tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:37.548788 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-ee6cb077-2da1-49b9-933d-778b3b48761c tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] [instance: 139f7ae3-b380-4114-a566-6d496d4957f4] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:58:37.559260 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ee6cb077-2da1-49b9-933d-778b3b48761c tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:37.560207 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ee6cb077-2da1-49b9-933d-778b3b48761c tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:37.564607 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ee6cb077-2da1-49b9-933d-778b3b48761c tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:37.566500 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ee6cb077-2da1-49b9-933d-778b3b48761c tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:37.568285 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ee6cb077-2da1-49b9-933d-778b3b48761c tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:37.568954 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ee6cb077-2da1-49b9-933d-778b3b48761c tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:37.672139 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-ee6cb077-2da1-49b9-933d-778b3b48761c tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:58:37.684552 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-ee6cb077-2da1-49b9-933d-778b3b48761c tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:58:37.686953 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-ee6cb077-2da1-49b9-933d-778b3b48761c tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:58:37.688827 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-ee6cb077-2da1-49b9-933d-778b3b48761c tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] 10.222.0.26 "GET /compute/v2.1/servers/139f7ae3-b380-4114-a566-6d496d4957f4" status: 200 len: 1522 microversion: 2.25 time: 0.152774 Oct 08 20:58:37.690278 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 869/1785] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:58:37 2022] GET /compute/v2.1/servers/139f7ae3-b380-4114-a566-6d496d4957f4 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:58:37.697537 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-94b9ff1c-b9d2-4863-8c5a-052fada27e55 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Calling method '.version_select at 0x7f1a914d79d0>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:37.821378 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-94b9ff1c-b9d2-4863-8c5a-052fada27e55 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] 10.222.0.26 "GET /compute/v2.1/images/fa97ce22-1af3-4366-9d57-84040c24f915" status: 200 len: 1424 microversion: 2.1 time: 0.129284 Oct 08 20:58:37.822104 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 870/1786] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:58:37 2022] GET /compute/v2.1/images/fa97ce22-1af3-4366-9d57-84040c24f915 => generated 1424 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:58:37.829077 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-a1c56a4f-d474-4672-9788-2f3ff25249a1 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:37.834536 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-a1c56a4f-d474-4672-9788-2f3ff25249a1 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5d9facf5ea0743cb821cec1b40f6b609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdaf5b9230f4e09949a39a5cbe72011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:58:37.836348 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-a1c56a4f-d474-4672-9788-2f3ff25249a1 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Searching by: {'deleted': False, 'project_id': '5cdaf5b9230f4e09949a39a5cbe72011'} {{(pid=140491) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 08 20:58:37.842015 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a1c56a4f-d474-4672-9788-2f3ff25249a1 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:37.842816 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a1c56a4f-d474-4672-9788-2f3ff25249a1 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:37.843542 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a1c56a4f-d474-4672-9788-2f3ff25249a1 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:37.844395 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a1c56a4f-d474-4672-9788-2f3ff25249a1 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:37.845177 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a1c56a4f-d474-4672-9788-2f3ff25249a1 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:37.845949 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a1c56a4f-d474-4672-9788-2f3ff25249a1 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:37.887385 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.multi_cell_list [None req-a1c56a4f-d474-4672-9788-2f3ff25249a1 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=140491) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 08 20:58:37.937021 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-a1c56a4f-d474-4672-9788-2f3ff25249a1 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9facf5ea0743cb821cec1b40f6b609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdaf5b9230f4e09949a39a5cbe72011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:58:37.945711 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a1c56a4f-d474-4672-9788-2f3ff25249a1 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:37.946361 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a1c56a4f-d474-4672-9788-2f3ff25249a1 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:37.947780 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a1c56a4f-d474-4672-9788-2f3ff25249a1 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:38.123644 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-a1c56a4f-d474-4672-9788-2f3ff25249a1 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] 10.222.0.26 "GET /compute/v2.1/servers/detail" status: 200 len: 1710 microversion: 2.1 time: 0.300079 Oct 08 20:58:38.142739 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 871/1787] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Oct 8 20:58:37 2022] GET /compute/v2.1/servers/detail => generated 1710 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:58:38.153691 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-aefdc70b-fed2-4b5c-b4da-38e6f79c5800 req-8ce47324-c271-4dc4-b0eb-0692a0afccae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "139f7ae3-b380-4114-a566-6d496d4957f4", "name": "network-vif-deleted", "tag": "34b7dd73-89eb-4b12-ac78-40ef20772247"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:58:38.165434 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-aefdc70b-fed2-4b5c-b4da-38e6f79c5800 req-8ce47324-c271-4dc4-b0eb-0692a0afccae service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:38.167102 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-aefdc70b-fed2-4b5c-b4da-38e6f79c5800 req-8ce47324-c271-4dc4-b0eb-0692a0afccae service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:38.167102 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-aefdc70b-fed2-4b5c-b4da-38e6f79c5800 req-8ce47324-c271-4dc4-b0eb-0692a0afccae service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:38.179214 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-aefdc70b-fed2-4b5c-b4da-38e6f79c5800 req-8ce47324-c271-4dc4-b0eb-0692a0afccae service nova] Creating event network-vif-deleted:34b7dd73-89eb-4b12-ac78-40ef20772247 for instance 139f7ae3-b380-4114-a566-6d496d4957f4 on nch2-master-1 Oct 08 20:58:38.184437 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-aefdc70b-fed2-4b5c-b4da-38e6f79c5800 req-8ce47324-c271-4dc4-b0eb-0692a0afccae service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039723 Oct 08 20:58:38.188328 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 872/1788] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:58:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:58:38.205477 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-1b200a2c-36df-4524-80a1-e752b2acb48c tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:38.215533 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-1b200a2c-36df-4524-80a1-e752b2acb48c tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] 10.222.0.26 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.025709 Oct 08 20:58:38.216450 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 873/1789] 10.222.0.26 () {58 vars in 1137 bytes} [Sat Oct 8 20:58:38 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:58:38.258897 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-a4a3e0b6-ea3f-4d94-9e29-a3a96ca50bad tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:38.264479 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-a4a3e0b6-ea3f-4d94-9e29-a3a96ca50bad tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] [instance: 84a8a931-6a18-4ef4-9e3c-63cf4054ea43] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:58:38.284846 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a4a3e0b6-ea3f-4d94-9e29-a3a96ca50bad tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:38.285418 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a4a3e0b6-ea3f-4d94-9e29-a3a96ca50bad tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:38.286158 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a4a3e0b6-ea3f-4d94-9e29-a3a96ca50bad tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:38.287032 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a4a3e0b6-ea3f-4d94-9e29-a3a96ca50bad tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:38.287522 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a4a3e0b6-ea3f-4d94-9e29-a3a96ca50bad tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:38.287997 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a4a3e0b6-ea3f-4d94-9e29-a3a96ca50bad tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:38.482973 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-a4a3e0b6-ea3f-4d94-9e29-a3a96ca50bad tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ddc3cd3c374bacbe5bf5e0877380e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8472b054404c46a99b81aba34d6b9f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:58:38.492144 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-a4a3e0b6-ea3f-4d94-9e29-a3a96ca50bad tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] 10.222.0.26 "GET /compute/v2.1/servers/84a8a931-6a18-4ef4-9e3c-63cf4054ea43" status: 200 len: 1319 microversion: 2.1 time: 0.243329 Oct 08 20:58:38.492813 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 874/1790] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:58:38 2022] GET /compute/v2.1/servers/84a8a931-6a18-4ef4-9e3c-63cf4054ea43 => generated 1319 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:58:38.670858 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.network.neutron [None req-1cd1ed57-321c-4c99-8800-e698ff11c106 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] [instance: e5389d1b-b9f3-491a-898c-be611599d73a] Building network info cache for instance {{(pid=140492) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 08 20:58:38.680009 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-ef3ee162-e913-4885-97e8-4100f29ac038 req-cee17e51-11f0-4bc8-99cd-cf9b329867d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5389d1b-b9f3-491a-898c-be611599d73a", "tag": "d911c0da-f663-4272-afa4-3646c36b9e29"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:58:38.693582 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-ef3ee162-e913-4885-97e8-4100f29ac038 req-cee17e51-11f0-4bc8-99cd-cf9b329867d1 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:38.694414 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-ef3ee162-e913-4885-97e8-4100f29ac038 req-cee17e51-11f0-4bc8-99cd-cf9b329867d1 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:38.695189 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-ef3ee162-e913-4885-97e8-4100f29ac038 req-cee17e51-11f0-4bc8-99cd-cf9b329867d1 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:38.714735 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-ef3ee162-e913-4885-97e8-4100f29ac038 req-cee17e51-11f0-4bc8-99cd-cf9b329867d1 service nova] Creating event network-changed:d911c0da-f663-4272-afa4-3646c36b9e29 for instance e5389d1b-b9f3-491a-898c-be611599d73a on nch2-master-1 Oct 08 20:58:38.722258 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-ef3ee162-e913-4885-97e8-4100f29ac038 req-cee17e51-11f0-4bc8-99cd-cf9b329867d1 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045546 Oct 08 20:58:38.723296 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 875/1791] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:58:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 08 20:58:38.730240 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-2a845dff-bb93-4eba-b3c7-81daf60b8f35 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:38.738873 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-2a845dff-bb93-4eba-b3c7-81daf60b8f35 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] [instance: 139f7ae3-b380-4114-a566-6d496d4957f4] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:58:38.750093 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2a845dff-bb93-4eba-b3c7-81daf60b8f35 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:38.750603 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2a845dff-bb93-4eba-b3c7-81daf60b8f35 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:38.751189 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2a845dff-bb93-4eba-b3c7-81daf60b8f35 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:38.752001 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2a845dff-bb93-4eba-b3c7-81daf60b8f35 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:38.753964 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2a845dff-bb93-4eba-b3c7-81daf60b8f35 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:38.754178 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2a845dff-bb93-4eba-b3c7-81daf60b8f35 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:38.812534 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2a845dff-bb93-4eba-b3c7-81daf60b8f35 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:38.813262 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2a845dff-bb93-4eba-b3c7-81daf60b8f35 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:38.813870 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2a845dff-bb93-4eba-b3c7-81daf60b8f35 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:38.814496 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.objects.instance [None req-2a845dff-bb93-4eba-b3c7-81daf60b8f35 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lazy-loading 'fault' on Instance uuid 139f7ae3-b380-4114-a566-6d496d4957f4 {{(pid=140491) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 20:58:38.878343 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-2a845dff-bb93-4eba-b3c7-81daf60b8f35 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:58:38.895231 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-2a845dff-bb93-4eba-b3c7-81daf60b8f35 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:58:38.897529 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-2a845dff-bb93-4eba-b3c7-81daf60b8f35 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:58:38.898837 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-2a845dff-bb93-4eba-b3c7-81daf60b8f35 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] 10.222.0.26 "GET /compute/v2.1/servers/139f7ae3-b380-4114-a566-6d496d4957f4" status: 200 len: 1351 microversion: 2.25 time: 0.174407 Oct 08 20:58:38.918834 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 876/1792] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:58:38 2022] GET /compute/v2.1/servers/139f7ae3-b380-4114-a566-6d496d4957f4 => generated 1351 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:58:38.924953 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-21291216-b79a-44f7-b268-85b1848ce456 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:38.925678 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-21291216-b79a-44f7-b268-85b1848ce456 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] [instance: 0568d34c-9aa0-452f-b5c5-b3fc19ebbf15] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:58:38.932562 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-21291216-b79a-44f7-b268-85b1848ce456 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:38.933051 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-21291216-b79a-44f7-b268-85b1848ce456 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:38.933530 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-21291216-b79a-44f7-b268-85b1848ce456 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:38.935753 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-21291216-b79a-44f7-b268-85b1848ce456 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:38.936257 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-21291216-b79a-44f7-b268-85b1848ce456 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:38.936697 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-21291216-b79a-44f7-b268-85b1848ce456 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:38.979204 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-21291216-b79a-44f7-b268-85b1848ce456 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] [instance: 0568d34c-9aa0-452f-b5c5-b3fc19ebbf15] Going to try to terminate instance {{(pid=140491) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 20:58:39.108269 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-21291216-b79a-44f7-b268-85b1848ce456 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] 10.222.0.26 "DELETE /compute/v2.1/servers/0568d34c-9aa0-452f-b5c5-b3fc19ebbf15" status: 204 len: 0 microversion: 2.1 time: 0.187420 Oct 08 20:58:39.112659 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 877/1793] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 20:58:38 2022] DELETE /compute/v2.1/servers/0568d34c-9aa0-452f-b5c5-b3fc19ebbf15 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 20:58:39.116445 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-28195466-fa08-4ef9-b605-4f1a458b12d3 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Calling method '.version_select at 0x7f1a914ccc10>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:39.191052 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-28195466-fa08-4ef9-b605-4f1a458b12d3 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] 10.222.0.26 "GET /compute/v2.1/images/fa97ce22-1af3-4366-9d57-84040c24f915" status: 200 len: 1424 microversion: 2.1 time: 0.080361 Oct 08 20:58:39.191906 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 878/1794] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:58:39 2022] GET /compute/v2.1/images/fa97ce22-1af3-4366-9d57-84040c24f915 => generated 1424 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:58:39.197957 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-2e5bc900-cad6-4105-b2db-ee96ba60d948 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:39.199168 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-2e5bc900-cad6-4105-b2db-ee96ba60d948 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] [instance: 0568d34c-9aa0-452f-b5c5-b3fc19ebbf15] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:58:39.202534 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:UPDATE=3,nova_api:INSERT=1 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:58:39.208296 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2e5bc900-cad6-4105-b2db-ee96ba60d948 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:39.208795 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2e5bc900-cad6-4105-b2db-ee96ba60d948 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:39.209338 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2e5bc900-cad6-4105-b2db-ee96ba60d948 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:39.209962 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2e5bc900-cad6-4105-b2db-ee96ba60d948 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:39.210445 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2e5bc900-cad6-4105-b2db-ee96ba60d948 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:39.210925 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2e5bc900-cad6-4105-b2db-ee96ba60d948 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:39.441660 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-2e5bc900-cad6-4105-b2db-ee96ba60d948 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9facf5ea0743cb821cec1b40f6b609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdaf5b9230f4e09949a39a5cbe72011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:58:39.455464 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-2e5bc900-cad6-4105-b2db-ee96ba60d948 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] 10.222.0.26 "GET /compute/v2.1/servers/0568d34c-9aa0-452f-b5c5-b3fc19ebbf15" status: 200 len: 1713 microversion: 2.1 time: 0.262608 Oct 08 20:58:39.458460 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 879/1795] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:58:39 2022] GET /compute/v2.1/servers/0568d34c-9aa0-452f-b5c5-b3fc19ebbf15 => generated 1713 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:58:39.515193 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-221e8b27-4802-4ea0-aa86-acc97de705f2 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:39.516126 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-221e8b27-4802-4ea0-aa86-acc97de705f2 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] [instance: 84a8a931-6a18-4ef4-9e3c-63cf4054ea43] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:58:39.527459 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-221e8b27-4802-4ea0-aa86-acc97de705f2 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:39.529883 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-221e8b27-4802-4ea0-aa86-acc97de705f2 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:39.531268 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-221e8b27-4802-4ea0-aa86-acc97de705f2 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:39.536662 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-221e8b27-4802-4ea0-aa86-acc97de705f2 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:39.538906 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-221e8b27-4802-4ea0-aa86-acc97de705f2 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:39.539393 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-221e8b27-4802-4ea0-aa86-acc97de705f2 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:39.560958 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.network.neutron [None req-1cd1ed57-321c-4c99-8800-e698ff11c106 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] [instance: e5389d1b-b9f3-491a-898c-be611599d73a] Updating instance_info_cache with network_info: [{"id": "d911c0da-f663-4272-afa4-3646c36b9e29", "address": "fa:16:3e:ba:65:e2", "network": {"id": "9a7c4906-c385-42bd-b7c0-9941e033f637", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-1486799263-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "6c97b3b7fa484f97bdf40224f7cc34d4", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapd911c0da-f6", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=140492) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 08 20:58:39.582510 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1cd1ed57-321c-4c99-8800-e698ff11c106 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Releasing lock "refresh_cache-e5389d1b-b9f3-491a-898c-be611599d73a" {{(pid=140492) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 08 20:58:39.584532 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-1cd1ed57-321c-4c99-8800-e698ff11c106 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] 10.222.0.26 "POST /compute/v2.1/servers/e5389d1b-b9f3-491a-898c-be611599d73a/action" status: 202 len: 0 microversion: 2.1 time: 3.240167 Oct 08 20:58:39.585745 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 917/1796] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 20:58:36 2022] POST /compute/v2.1/servers/e5389d1b-b9f3-491a-898c-be611599d73a/action => generated 0 bytes in 3253 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 08 20:58:39.603433 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-a1697808-2b25-4aaa-9d28-988dc4c39c65 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Calling method '.version_select at 0x7f1a8c075550>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:39.779164 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-221e8b27-4802-4ea0-aa86-acc97de705f2 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ddc3cd3c374bacbe5bf5e0877380e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8472b054404c46a99b81aba34d6b9f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:58:39.799780 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-221e8b27-4802-4ea0-aa86-acc97de705f2 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] 10.222.0.26 "GET /compute/v2.1/servers/84a8a931-6a18-4ef4-9e3c-63cf4054ea43" status: 200 len: 1469 microversion: 2.1 time: 0.288310 Oct 08 20:58:39.818845 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 880/1797] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:58:39 2022] GET /compute/v2.1/servers/84a8a931-6a18-4ef4-9e3c-63cf4054ea43 => generated 1469 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 20:58:39.826316 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-26d77d58-0db9-4bc8-9e2f-14a5e8f3e708 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:39.827197 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-26d77d58-0db9-4bc8-9e2f-14a5e8f3e708 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] [instance: edebb288-3d28-4432-b9fd-d74cfb2de586] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:58:39.836209 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-26d77d58-0db9-4bc8-9e2f-14a5e8f3e708 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:39.836945 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-26d77d58-0db9-4bc8-9e2f-14a5e8f3e708 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:39.837531 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-26d77d58-0db9-4bc8-9e2f-14a5e8f3e708 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:39.838390 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-26d77d58-0db9-4bc8-9e2f-14a5e8f3e708 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:39.839235 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-26d77d58-0db9-4bc8-9e2f-14a5e8f3e708 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:39.839919 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-26d77d58-0db9-4bc8-9e2f-14a5e8f3e708 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:40.045786 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-26d77d58-0db9-4bc8-9e2f-14a5e8f3e708 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ddc3cd3c374bacbe5bf5e0877380e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8472b054404c46a99b81aba34d6b9f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:58:40.056248 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-26d77d58-0db9-4bc8-9e2f-14a5e8f3e708 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] 10.222.0.26 "GET /compute/v2.1/servers/edebb288-3d28-4432-b9fd-d74cfb2de586" status: 200 len: 1468 microversion: 2.1 time: 0.235091 Oct 08 20:58:40.056858 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 881/1798] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:58:39 2022] GET /compute/v2.1/servers/edebb288-3d28-4432-b9fd-d74cfb2de586 => generated 1468 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:58:40.069634 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-ed784408-ff26-4991-84a4-5b7384077eb0 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:40.069634 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-ed784408-ff26-4991-84a4-5b7384077eb0 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] [instance: 139f7ae3-b380-4114-a566-6d496d4957f4] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:58:40.069634 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ed784408-ff26-4991-84a4-5b7384077eb0 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:40.069983 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ed784408-ff26-4991-84a4-5b7384077eb0 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:40.070138 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ed784408-ff26-4991-84a4-5b7384077eb0 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:40.071003 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ed784408-ff26-4991-84a4-5b7384077eb0 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:40.071851 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ed784408-ff26-4991-84a4-5b7384077eb0 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:40.071967 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ed784408-ff26-4991-84a4-5b7384077eb0 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:40.106880 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:58:40.166113 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ed784408-ff26-4991-84a4-5b7384077eb0 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:40.168538 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ed784408-ff26-4991-84a4-5b7384077eb0 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:40.171449 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ed784408-ff26-4991-84a4-5b7384077eb0 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:40.171449 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.objects.instance [None req-ed784408-ff26-4991-84a4-5b7384077eb0 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lazy-loading 'fault' on Instance uuid 139f7ae3-b380-4114-a566-6d496d4957f4 {{(pid=140491) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 20:58:40.258838 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-ed784408-ff26-4991-84a4-5b7384077eb0 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:58:40.275768 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-ed784408-ff26-4991-84a4-5b7384077eb0 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:58:40.279327 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-ed784408-ff26-4991-84a4-5b7384077eb0 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd54b1c5c00544be4b60132d09817c8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5c7906a4714a1887cb823e1c3a6056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:58:40.281911 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-ed784408-ff26-4991-84a4-5b7384077eb0 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] 10.222.0.26 "GET /compute/v2.1/servers/139f7ae3-b380-4114-a566-6d496d4957f4" status: 200 len: 1351 microversion: 2.25 time: 0.223856 Oct 08 20:58:40.283105 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 882/1799] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:58:40 2022] GET /compute/v2.1/servers/139f7ae3-b380-4114-a566-6d496d4957f4 => generated 1351 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:58:40.294036 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-aea7e2ba-4448-4f5c-b1f8-4957af987453 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-2063921958", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "40f65150-6a63-4527-916a-108abacd8a63"}], "security_groups": [{"name": "tempest-securitygroup--1656758496"}], "key_name": "tempest-keypair-1569579173", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "f364ca50-5843-462f-9ca6-f2739fdb87ea", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:58:40.459993 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.network.neutron [None req-aea7e2ba-4448-4f5c-b1f8-4957af987453 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] validate_networks() for [('40f65150-6a63-4527-916a-108abacd8a63', None, None, None, None, None)] {{(pid=140491) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 20:58:41.119395 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-a1697808-2b25-4aaa-9d28-988dc4c39c65 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] 10.222.0.26 "DELETE /compute/v2.1/os-floating-ips/7b5e5370-bd4c-460f-8802-3f3460960ff7" status: 202 len: 0 microversion: 2.1 time: 1.528692 Oct 08 20:58:41.123982 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 918/1800] 10.222.0.26 () {58 vars in 1263 bytes} [Sat Oct 8 20:58:39 2022] DELETE /compute/v2.1/os-floating-ips/7b5e5370-bd4c-460f-8802-3f3460960ff7 => generated 0 bytes in 1534 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 20:58:41.129759 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-39628897-8a01-41e4-bd1f-be13c2c69d57 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:41.134892 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-39628897-8a01-41e4-bd1f-be13c2c69d57 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '67ddc3cd3c374bacbe5bf5e0877380e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8472b054404c46a99b81aba34d6b9f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:58:41.135771 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-39628897-8a01-41e4-bd1f-be13c2c69d57 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Searching by: {'reservation_id': 'r-tum291fd', 'deleted': False, 'project_id': '8472b054404c46a99b81aba34d6b9f40'} {{(pid=140492) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 08 20:58:41.141380 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-39628897-8a01-41e4-bd1f-be13c2c69d57 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:41.141871 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-39628897-8a01-41e4-bd1f-be13c2c69d57 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:41.142315 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-39628897-8a01-41e4-bd1f-be13c2c69d57 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:41.143611 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-39628897-8a01-41e4-bd1f-be13c2c69d57 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:41.144073 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-39628897-8a01-41e4-bd1f-be13c2c69d57 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:41.144708 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-39628897-8a01-41e4-bd1f-be13c2c69d57 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:41.229121 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-aea7e2ba-4448-4f5c-b1f8-4957af987453 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Getting quotas for project a82999f8bc36455bafd8eed23c68e733. Resources: dict_keys(['metadata_items']) {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 20:58:41.235028 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-aea7e2ba-4448-4f5c-b1f8-4957af987453 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Getting quotas for user 3d96135705514061bef9306753143357 and project a82999f8bc36455bafd8eed23c68e733. Resources: dict_keys(['metadata_items']) {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 20:58:41.248349 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-aea7e2ba-4448-4f5c-b1f8-4957af987453 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Flavor limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 20:58:41.248782 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-aea7e2ba-4448-4f5c-b1f8-4957af987453 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Image limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 20:58:41.249320 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-aea7e2ba-4448-4f5c-b1f8-4957af987453 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Flavor pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 20:58:41.249739 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-aea7e2ba-4448-4f5c-b1f8-4957af987453 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Image pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 20:58:41.250164 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-aea7e2ba-4448-4f5c-b1f8-4957af987453 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 20:58:41.258586 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-aea7e2ba-4448-4f5c-b1f8-4957af987453 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:41.259010 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-aea7e2ba-4448-4f5c-b1f8-4957af987453 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:41.259451 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-aea7e2ba-4448-4f5c-b1f8-4957af987453 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:41.260398 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-aea7e2ba-4448-4f5c-b1f8-4957af987453 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:41.260860 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-aea7e2ba-4448-4f5c-b1f8-4957af987453 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:41.261325 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-aea7e2ba-4448-4f5c-b1f8-4957af987453 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:41.279774 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-aea7e2ba-4448-4f5c-b1f8-4957af987453 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Getting quotas for project a82999f8bc36455bafd8eed23c68e733. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 20:58:41.286009 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-aea7e2ba-4448-4f5c-b1f8-4957af987453 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Getting quotas for user 3d96135705514061bef9306753143357 and project a82999f8bc36455bafd8eed23c68e733. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 20:58:41.313369 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.multi_cell_list [None req-39628897-8a01-41e4-bd1f-be13c2c69d57 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=140492) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 08 20:58:41.395374 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-aea7e2ba-4448-4f5c-b1f8-4957af987453 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Going to run 1 instances... {{(pid=140491) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 20:58:41.397771 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-aea7e2ba-4448-4f5c-b1f8-4957af987453 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] [instance: c9f0e1d2-6f87-485d-bff6-0ea83899b705] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f364ca50-5843-462f-9ca6-f2739fdb87ea',volume_size=None,volume_type=None)] {{(pid=140491) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 20:58:41.672429 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-aea7e2ba-4448-4f5c-b1f8-4957af987453 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 1.387413 Oct 08 20:58:41.673158 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 883/1801] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 20:58:40 2022] POST /compute/v2.1/servers => generated 407 bytes in 1390 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 08 20:58:41.685348 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-f776b9ed-c5ac-4b89-8290-090229b51cdf tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Calling method '.version_select at 0x7f1a914cbaf0>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:41.685946 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-39628897-8a01-41e4-bd1f-be13c2c69d57 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ddc3cd3c374bacbe5bf5e0877380e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8472b054404c46a99b81aba34d6b9f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:58:41.744384 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-39628897-8a01-41e4-bd1f-be13c2c69d57 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:41.745574 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-39628897-8a01-41e4-bd1f-be13c2c69d57 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:41.745574 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-39628897-8a01-41e4-bd1f-be13c2c69d57 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:41.799995 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-f776b9ed-c5ac-4b89-8290-090229b51cdf tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] 10.222.0.26 "GET /compute/v2.1/images/fa97ce22-1af3-4366-9d57-84040c24f915" status: 200 len: 1424 microversion: 2.1 time: 0.123273 Oct 08 20:58:41.801262 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 884/1802] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:58:41 2022] GET /compute/v2.1/images/fa97ce22-1af3-4366-9d57-84040c24f915 => generated 1424 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:58:41.808712 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-bcb4eabb-4be3-4746-83f9-3fe14b0ee963 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:41.810099 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-bcb4eabb-4be3-4746-83f9-3fe14b0ee963 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] [instance: 0568d34c-9aa0-452f-b5c5-b3fc19ebbf15] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:58:41.817767 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bcb4eabb-4be3-4746-83f9-3fe14b0ee963 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:41.818757 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bcb4eabb-4be3-4746-83f9-3fe14b0ee963 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:41.819440 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bcb4eabb-4be3-4746-83f9-3fe14b0ee963 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:41.820420 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bcb4eabb-4be3-4746-83f9-3fe14b0ee963 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:41.821114 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bcb4eabb-4be3-4746-83f9-3fe14b0ee963 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:41.822489 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bcb4eabb-4be3-4746-83f9-3fe14b0ee963 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:41.914900 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-bcb4eabb-4be3-4746-83f9-3fe14b0ee963 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9facf5ea0743cb821cec1b40f6b609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdaf5b9230f4e09949a39a5cbe72011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:58:41.927987 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-bcb4eabb-4be3-4746-83f9-3fe14b0ee963 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] 10.222.0.26 "GET /compute/v2.1/servers/0568d34c-9aa0-452f-b5c5-b3fc19ebbf15" status: 200 len: 1645 microversion: 2.1 time: 0.124190 Oct 08 20:58:41.930340 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 885/1803] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:58:41 2022] GET /compute/v2.1/servers/0568d34c-9aa0-452f-b5c5-b3fc19ebbf15 => generated 1645 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:58:41.989940 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-39628897-8a01-41e4-bd1f-be13c2c69d57 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] 10.222.0.26 "GET /compute/v2.1/servers/detail?reservation_id=r-tum291fd" status: 200 len: 2930 microversion: 2.1 time: 0.864427 Oct 08 20:58:42.006486 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 919/1804] 10.222.0.26 () {58 vars in 1197 bytes} [Sat Oct 8 20:58:41 2022] GET /compute/v2.1/servers/detail?reservation_id=r-tum291fd => generated 2930 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:58:42.013589 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-8091ef5a-adf9-49aa-be66-d2a501e0ebb1 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Calling method '.version_select at 0x7f1a8c09f8b0>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:42.150450 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-272efbde-756a-4ed9-bd55-f48e92823955 tempest-TenantUsagesNegativeTestJSON-651010983 tempest-TenantUsagesNegativeTestJSON-651010983-project-admin] 10.222.0.26 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-10-07T20%3A58%3A40.652770&end=2022-10-09T20%3A58%3A40.652770" status: 404 len: 112 microversion: - time: 0.218559 Oct 08 20:58:42.151724 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 886/1805] 10.222.0.26 () {58 vars in 1316 bytes} [Sat Oct 8 20:58:41 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-10-07T20%3A58%3A40.652770&end=2022-10-09T20%3A58%3A40.652770 => generated 112 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 08 20:58:42.166185 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-481ed88b-f71d-470d-bb50-a30a4430c758 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:42.169865 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-481ed88b-f71d-470d-bb50-a30a4430c758 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] [instance: 139f7ae3-b380-4114-a566-6d496d4957f4] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:58:42.188270 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-481ed88b-f71d-470d-bb50-a30a4430c758 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:42.193110 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-481ed88b-f71d-470d-bb50-a30a4430c758 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:42.193889 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-481ed88b-f71d-470d-bb50-a30a4430c758 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:42.196413 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-481ed88b-f71d-470d-bb50-a30a4430c758 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:42.197701 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-481ed88b-f71d-470d-bb50-a30a4430c758 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:42.200424 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-481ed88b-f71d-470d-bb50-a30a4430c758 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:42.225298 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-481ed88b-f71d-470d-bb50-a30a4430c758 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] HTTP exception thrown: Instance 139f7ae3-b380-4114-a566-6d496d4957f4 could not be found. Oct 08 20:58:42.228305 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-481ed88b-f71d-470d-bb50-a30a4430c758 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Request method failure captured: Oct 08 20:58:42.228305 ncdv-master-1 devstack@n-api.service[140491]: request: GET /compute/v2.1/servers/139f7ae3-b380-4114-a566-6d496d4957f4 HTTP/1.1 Oct 08 20:58:42.228305 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 20:58:42.228305 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 20:58:42.228305 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 20:58:42.228305 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 20:58:42.228305 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 20:58:42.228305 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 20:58:42.228305 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 20:58:42.228305 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 20:58:42.228305 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeM_8itqsdTjDSrlGxZZ-u44pmaEYPSQW4Sfx3OogMOjCfNSG1scpEldctJo7eYijpgGhtozXKwLr8evVzi5nf4wuH1lfEdHrH_7IHaykS_Ns0neu4keC9kqpsLbriJukycX0gnBg9-m0XH6tiS45uipRftXY8tUpNqJ0OB6f1O8wUg Oct 08 20:58:42.228305 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 20:58:42.228305 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 20:58:42.228305 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 20:58:42.228305 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 20:58:42.228305 ncdv-master-1 devstack@n-api.service[140491]: X-Openstack-Nova-Api-Version: 2.25 Oct 08 20:58:42.228305 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 20:58:42.228305 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 20:58:42.228305 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: ac5c7906a4714a1887cb823e1c3a6056 Oct 08 20:58:42.228305 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-2037918034 Oct 08 20:58:42.228305 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 20:58:42.228305 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 20:58:42.228305 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ac5c7906a4714a1887cb823e1c3a6056"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ac5c7906a4714a1887cb823e1c3a6056"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ac5c7906a4714a1887cb823e1c3a6056"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ac5c7906a4714a1887cb823e1c3a6056"}]}] Oct 08 20:58:42.228305 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-2037918034 Oct 08 20:58:42.228305 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: ac5c7906a4714a1887cb823e1c3a6056 Oct 08 20:58:42.228305 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-2037918034 Oct 08 20:58:42.228305 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-LiveAutoBlockMigrationV225Test-2037918034-project Oct 08 20:58:42.228305 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 20:58:42.228305 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 20:58:42.228305 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: d54b1c5c00544be4b60132d09817c8d6 Oct 08 20:58:42.228305 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-2037918034-project Oct 08 20:58:42.228305 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 20:58:42.228305 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance 139f7ae3-b380-4114-a566-6d496d4957f4 could not be found. Oct 08 20:58:42.228305 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': '139f7ae3-b380-4114-a566-6d496d4957f4'} Oct 08 20:58:42.228305 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:58:42.228305 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:58:42.228305 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 20:58:42.228305 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 20:58:42.228305 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 20:58:42.228305 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 20:58:42.228305 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 20:58:42.228305 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 20:58:42.228305 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 20:58:42.228305 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 20:58:42.228305 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 139f7ae3-b380-4114-a566-6d496d4957f4 could not be found. Oct 08 20:58:42.228305 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:58:42.228305 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:58:42.228305 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:58:42.228305 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:58:42.228305 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:58:42.228305 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:58:42.228305 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:58:42.228305 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:58:42.228305 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:58:42.228305 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:58:42.228305 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 20:58:42.228305 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 20:58:42.228305 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 20:58:42.228305 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 20:58:42.228305 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 20:58:42.228305 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 20:58:42.228305 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 139f7ae3-b380-4114-a566-6d496d4957f4 could not be found. Oct 08 20:58:42.228305 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:58:42.234537 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:58:42.234537 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:58:42.234537 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:58:42.234537 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:58:42.234537 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:58:42.234537 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 20:58:42.234537 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 20:58:42.234537 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 139f7ae3-b380-4114-a566-6d496d4957f4 could not be found. Oct 08 20:58:42.234537 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:58:42.237379 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-481ed88b-f71d-470d-bb50-a30a4430c758 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] Returning 404 to user: Instance 139f7ae3-b380-4114-a566-6d496d4957f4 could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:58:42.239379 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-481ed88b-f71d-470d-bb50-a30a4430c758 tempest-LiveAutoBlockMigrationV225Test-2037918034 tempest-LiveAutoBlockMigrationV225Test-2037918034-project] 10.222.0.26 "GET /compute/v2.1/servers/139f7ae3-b380-4114-a566-6d496d4957f4" status: 404 len: 111 microversion: 2.25 time: 0.084132 Oct 08 20:58:42.241797 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 887/1806] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:58:42 2022] GET /compute/v2.1/servers/139f7ae3-b380-4114-a566-6d496d4957f4 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 08 20:58:42.254228 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-55f2390d-6ca2-48e2-8e8c-88be66e9e0b0 req-72986b53-c084-4624-a319-12009b309261 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19327d3e-de51-432b-b594-cb9a1bfe2f49", "name": "network-vif-plugged", "status": "completed", "tag": "6fbec29d-5924-4cc1-9f8d-c5ac27cbc284"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:58:42.297739 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-55f2390d-6ca2-48e2-8e8c-88be66e9e0b0 req-72986b53-c084-4624-a319-12009b309261 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:42.299429 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-55f2390d-6ca2-48e2-8e8c-88be66e9e0b0 req-72986b53-c084-4624-a319-12009b309261 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:42.301525 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-55f2390d-6ca2-48e2-8e8c-88be66e9e0b0 req-72986b53-c084-4624-a319-12009b309261 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:42.351177 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-55f2390d-6ca2-48e2-8e8c-88be66e9e0b0 req-72986b53-c084-4624-a319-12009b309261 service nova] Creating event network-vif-plugged:6fbec29d-5924-4cc1-9f8d-c5ac27cbc284 for instance 19327d3e-de51-432b-b594-cb9a1bfe2f49 on nch1-master-1 Oct 08 20:58:42.371890 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-55f2390d-6ca2-48e2-8e8c-88be66e9e0b0 req-72986b53-c084-4624-a319-12009b309261 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126056 Oct 08 20:58:42.377769 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 888/1807] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:58:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:58:42.395467 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-22db7de6-f350-41d4-adeb-5b417aefda0c tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:42.396198 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-22db7de6-f350-41d4-adeb-5b417aefda0c tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] [instance: c9f0e1d2-6f87-485d-bff6-0ea83899b705] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:58:42.557863 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-8091ef5a-adf9-49aa-be66-d2a501e0ebb1 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/8b3db8c1-381d-40d2-bb6b-b796a9dc29e9" status: 202 len: 0 microversion: 2.1 time: 0.549788 Oct 08 20:58:42.559225 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 920/1808] 10.222.0.26 () {58 vars in 1272 bytes} [Sat Oct 8 20:58:42 2022] DELETE /compute/v2.1/os-security-groups/8b3db8c1-381d-40d2-bb6b-b796a9dc29e9 => generated 0 bytes in 552 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 20:58:42.564226 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-f54c5b7a-cedb-4145-ba51-766dd41ac0f6 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:42.623649 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-22db7de6-f350-41d4-adeb-5b417aefda0c tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d96135705514061bef9306753143357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82999f8bc36455bafd8eed23c68e733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:58:42.631124 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.compute.server_groups [None req-f54c5b7a-cedb-4145-ba51-766dd41ac0f6 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Querying cell 1a13ecad-3f87-496d-a2c5-ac44667fd176(cell1) for 2 instances {{(pid=140492) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 08 20:58:42.633495 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-22db7de6-f350-41d4-adeb-5b417aefda0c tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] 10.222.0.26 "GET /compute/v2.1/servers/c9f0e1d2-6f87-485d-bff6-0ea83899b705" status: 200 len: 1122 microversion: 2.1 time: 0.253605 Oct 08 20:58:42.634486 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f54c5b7a-cedb-4145-ba51-766dd41ac0f6 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:42.636100 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f54c5b7a-cedb-4145-ba51-766dd41ac0f6 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:42.638352 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f54c5b7a-cedb-4145-ba51-766dd41ac0f6 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:42.639801 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 889/1809] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:58:42 2022] GET /compute/v2.1/servers/c9f0e1d2-6f87-485d-bff6-0ea83899b705 => generated 1122 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:58:42.652791 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-5ef186eb-cf06-446d-8f6f-2a34776e5793 tempest-TenantUsagesNegativeTestJSON-651010983 tempest-TenantUsagesNegativeTestJSON-651010983-project-admin] Calling method '.version_select at 0x7f1a8c697f70>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:42.675950 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-5ef186eb-cf06-446d-8f6f-2a34776e5793 tempest-TenantUsagesNegativeTestJSON-651010983 tempest-TenantUsagesNegativeTestJSON-651010983-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Oct 08 20:58:42.688504 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-5ef186eb-cf06-446d-8f6f-2a34776e5793 tempest-TenantUsagesNegativeTestJSON-651010983 tempest-TenantUsagesNegativeTestJSON-651010983-project-admin] Request method failure captured: Oct 08 20:58:42.688504 ncdv-master-1 devstack@n-api.service[140491]: request: GET /compute/v2.1/os-simple-tenant-usage/90f1fb9485564af489b2b7bcf77b54a5?start=2022-10-09T20%3A58%3A40.652770&end=2022-10-07T20%3A58%3A40.652770 HTTP/1.1 Oct 08 20:58:42.688504 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 20:58:42.688504 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 20:58:42.688504 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 20:58:42.688504 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 20:58:42.688504 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 20:58:42.688504 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 20:58:42.688504 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 20:58:42.688504 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 20:58:42.688504 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeSAFfVfFSBFwIZcR3HR8CBkTVN-Neax1fZ0oqTfWvpbSihUwnKzpp6rp0QVrD-HXNsdeH3689S0saPENNER_Q8jHFseSYN5DtiSTDX3WCSH1UjH6LmBuiIp3fm5X6umRq-CpfmU23N5ry-4frkkrusiwvrQLOupubGbGKihYjDmSbI Oct 08 20:58:42.688504 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 20:58:42.688504 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 20:58:42.688504 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 20:58:42.688504 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 20:58:42.688504 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 20:58:42.688504 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 20:58:42.688504 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: a85df4e3b04f4ee0910c1a3f1ef94ced Oct 08 20:58:42.688504 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-651010983 Oct 08 20:58:42.688504 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,admin,member Oct 08 20:58:42.688504 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,admin,member Oct 08 20:58:42.688504 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/a85df4e3b04f4ee0910c1a3f1ef94ced"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a85df4e3b04f4ee0910c1a3f1ef94ced"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_a85df4e3b04f4ee0910c1a3f1ef94ced"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a85df4e3b04f4ee0910c1a3f1ef94ced"}]}] Oct 08 20:58:42.688504 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-651010983 Oct 08 20:58:42.688504 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: a85df4e3b04f4ee0910c1a3f1ef94ced Oct 08 20:58:42.688504 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-651010983 Oct 08 20:58:42.688504 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-TenantUsagesNegativeTestJSON-651010983-project-admin Oct 08 20:58:42.688504 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 20:58:42.688504 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 20:58:42.688504 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 6bc06833e5114397a01949658af14d47 Oct 08 20:58:42.688504 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-651010983-project-admin Oct 08 20:58:42.688504 ncdv-master-1 devstack@n-api.service[140491]: method: Oct 08 20:58:42.688504 ncdv-master-1 devstack@n-api.service[140491]: exception: Invalid start time. The start time cannot occur after the end time. Oct 08 20:58:42.688504 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': '90f1fb9485564af489b2b7bcf77b54a5'} Oct 08 20:58:42.688504 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:58:42.688504 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:58:42.688504 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:58:42.688504 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:58:42.688504 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:58:42.688504 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:58:42.688504 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 08 20:58:42.688504 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 08 20:58:42.688504 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 08 20:58:42.688504 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 20:58:42.688504 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:58:42.688504 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:58:42.688504 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Oct 08 20:58:42.688504 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 08 20:58:42.688504 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Oct 08 20:58:42.688504 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Oct 08 20:58:42.688504 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Oct 08 20:58:42.688504 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 08 20:58:42.688504 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Oct 08 20:58:42.688504 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:58:42.688504 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:58:42.688504 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:58:42.688504 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:58:42.688504 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:58:42.688504 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:58:42.688504 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 20:58:42.688504 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 20:58:42.688504 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Oct 08 20:58:42.688504 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:58:42.699709 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-5ef186eb-cf06-446d-8f6f-2a34776e5793 tempest-TenantUsagesNegativeTestJSON-651010983 tempest-TenantUsagesNegativeTestJSON-651010983-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:58:42.699709 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-5ef186eb-cf06-446d-8f6f-2a34776e5793 tempest-TenantUsagesNegativeTestJSON-651010983 tempest-TenantUsagesNegativeTestJSON-651010983-project-admin] 10.222.0.26 "GET /compute/v2.1/os-simple-tenant-usage/90f1fb9485564af489b2b7bcf77b54a5?start=2022-10-09T20%3A58%3A40.652770&end=2022-10-07T20%3A58%3A40.652770" status: 400 len: 111 microversion: 2.1 time: 0.049989 Oct 08 20:58:42.699709 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 890/1810] 10.222.0.26 () {58 vars in 1412 bytes} [Sat Oct 8 20:58:42 2022] GET /compute/v2.1/os-simple-tenant-usage/90f1fb9485564af489b2b7bcf77b54a5?start=2022-10-09T20%3A58%3A40.652770&end=2022-10-07T20%3A58%3A40.652770 => generated 111 bytes in 52 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 08 20:58:42.711873 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-74173916-1c6a-4dc8-af38-e96be0f2feab req-481b7353-2509-4092-97bb-390a972e5f8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0568d34c-9aa0-452f-b5c5-b3fc19ebbf15", "name": "network-vif-deleted", "tag": "9856b2f7-707c-4f16-a64b-c8cc9a82cceb"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:58:42.746784 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-74173916-1c6a-4dc8-af38-e96be0f2feab req-481b7353-2509-4092-97bb-390a972e5f8c service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:42.749489 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-f54c5b7a-cedb-4145-ba51-766dd41ac0f6 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] 10.222.0.26 "GET /compute/v2.1/os-server-groups/b66c37e0-ab81-4b03-9a68-eb3fe9175719" status: 200 len: 265 microversion: 2.1 time: 0.184568 Oct 08 20:58:42.750293 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 921/1811] 10.222.0.26 () {58 vars in 1263 bytes} [Sat Oct 8 20:58:42 2022] GET /compute/v2.1/os-server-groups/b66c37e0-ab81-4b03-9a68-eb3fe9175719 => generated 265 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:58:42.756199 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-74173916-1c6a-4dc8-af38-e96be0f2feab req-481b7353-2509-4092-97bb-390a972e5f8c service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:42.756743 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-74173916-1c6a-4dc8-af38-e96be0f2feab req-481b7353-2509-4092-97bb-390a972e5f8c service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:42.763400 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-139dc90f-f357-4f26-862f-51c7c8ee964d tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:42.763885 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-139dc90f-f357-4f26-862f-51c7c8ee964d tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] [instance: e5389d1b-b9f3-491a-898c-be611599d73a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:58:42.797055 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-74173916-1c6a-4dc8-af38-e96be0f2feab req-481b7353-2509-4092-97bb-390a972e5f8c service nova] Creating event network-vif-deleted:9856b2f7-707c-4f16-a64b-c8cc9a82cceb for instance 0568d34c-9aa0-452f-b5c5-b3fc19ebbf15 on nch1-master-1 Oct 08 20:58:42.808733 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=1 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:58:42.812147 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-139dc90f-f357-4f26-862f-51c7c8ee964d tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:42.817218 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-139dc90f-f357-4f26-862f-51c7c8ee964d tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:42.817731 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-139dc90f-f357-4f26-862f-51c7c8ee964d tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:42.819846 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-139dc90f-f357-4f26-862f-51c7c8ee964d tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:42.821626 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-139dc90f-f357-4f26-862f-51c7c8ee964d tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:42.822638 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-139dc90f-f357-4f26-862f-51c7c8ee964d tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:42.834324 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-74173916-1c6a-4dc8-af38-e96be0f2feab req-481b7353-2509-4092-97bb-390a972e5f8c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136255 Oct 08 20:58:42.834993 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 891/1812] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:58:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:58:42.883830 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-139dc90f-f357-4f26-862f-51c7c8ee964d tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] [instance: e5389d1b-b9f3-491a-898c-be611599d73a] Going to try to terminate instance {{(pid=140492) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 20:58:43.001679 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-139dc90f-f357-4f26-862f-51c7c8ee964d tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] 10.222.0.26 "DELETE /compute/v2.1/servers/e5389d1b-b9f3-491a-898c-be611599d73a" status: 204 len: 0 microversion: 2.1 time: 0.242895 Oct 08 20:58:43.003094 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 922/1813] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 20:58:42 2022] DELETE /compute/v2.1/servers/e5389d1b-b9f3-491a-898c-be611599d73a => generated 0 bytes in 252 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 20:58:43.010575 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-ac828ffd-eb2d-4bc5-95bd-d3e5a60cec6a tempest-ServersOnMultiNodesTest-429096361 tempest-ServersOnMultiNodesTest-429096361-project-admin] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:43.011556 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-ac828ffd-eb2d-4bc5-95bd-d3e5a60cec6a tempest-ServersOnMultiNodesTest-429096361 tempest-ServersOnMultiNodesTest-429096361-project-admin] [instance: 84a8a931-6a18-4ef4-9e3c-63cf4054ea43] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:58:43.032262 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ac828ffd-eb2d-4bc5-95bd-d3e5a60cec6a tempest-ServersOnMultiNodesTest-429096361 tempest-ServersOnMultiNodesTest-429096361-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:43.035723 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ac828ffd-eb2d-4bc5-95bd-d3e5a60cec6a tempest-ServersOnMultiNodesTest-429096361 tempest-ServersOnMultiNodesTest-429096361-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:43.036400 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ac828ffd-eb2d-4bc5-95bd-d3e5a60cec6a tempest-ServersOnMultiNodesTest-429096361 tempest-ServersOnMultiNodesTest-429096361-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:43.037169 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ac828ffd-eb2d-4bc5-95bd-d3e5a60cec6a tempest-ServersOnMultiNodesTest-429096361 tempest-ServersOnMultiNodesTest-429096361-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:43.037672 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ac828ffd-eb2d-4bc5-95bd-d3e5a60cec6a tempest-ServersOnMultiNodesTest-429096361 tempest-ServersOnMultiNodesTest-429096361-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:43.040612 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ac828ffd-eb2d-4bc5-95bd-d3e5a60cec6a tempest-ServersOnMultiNodesTest-429096361 tempest-ServersOnMultiNodesTest-429096361-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:43.049676 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=92,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=3,nova_cell1:RELEASE=2,nova_cell1:INSERT=1 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:58:43.096551 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-e18b3c8f-123e-447f-bdd8-1b3286ec8eca tempest-TenantUsagesNegativeTestJSON-960447600 tempest-TenantUsagesNegativeTestJSON-960447600-project] Calling method '.version_select at 0x7f1a913c6040>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:43.100537 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-e18b3c8f-123e-447f-bdd8-1b3286ec8eca tempest-TenantUsagesNegativeTestJSON-960447600 tempest-TenantUsagesNegativeTestJSON-960447600-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': 'f5c7e0962b264d15aae60bd10c959c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90f1fb9485564af489b2b7bcf77b54a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:58:43.106398 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-e18b3c8f-123e-447f-bdd8-1b3286ec8eca tempest-TenantUsagesNegativeTestJSON-960447600 tempest-TenantUsagesNegativeTestJSON-960447600-project] Request method failure captured: Oct 08 20:58:43.106398 ncdv-master-1 devstack@n-api.service[140491]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-07T20%3A58%3A40.652770&end=2022-10-09T20%3A58%3A40.652770&detailed=1 HTTP/1.1 Oct 08 20:58:43.106398 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 20:58:43.106398 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 20:58:43.106398 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 20:58:43.106398 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 20:58:43.106398 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 20:58:43.106398 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 20:58:43.106398 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 20:58:43.106398 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 20:58:43.106398 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeR_qXH3GUHGIok91Gbli25u7fNyaUSjrXm3jX2D-qXNLSCySHOYT_DE1zDCga0QWFyXXEZ3QujR1ixrLlBZf8V-VQyijyUlMqiG2qWxhfG6jlRmtFx8QTWZfHGGjE0Sr3CHsABGv7rdyZJwDoR8iVrccIs1pYRJf7_08GbOLs6EWF8 Oct 08 20:58:43.106398 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 20:58:43.106398 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 20:58:43.106398 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 20:58:43.106398 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 20:58:43.106398 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 20:58:43.106398 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 20:58:43.106398 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 90f1fb9485564af489b2b7bcf77b54a5 Oct 08 20:58:43.106398 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-960447600 Oct 08 20:58:43.106398 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 20:58:43.106398 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 20:58:43.106398 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/90f1fb9485564af489b2b7bcf77b54a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/90f1fb9485564af489b2b7bcf77b54a5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_90f1fb9485564af489b2b7bcf77b54a5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/90f1fb9485564af489b2b7bcf77b54a5"}]}] Oct 08 20:58:43.106398 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-960447600 Oct 08 20:58:43.106398 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 90f1fb9485564af489b2b7bcf77b54a5 Oct 08 20:58:43.106398 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-960447600 Oct 08 20:58:43.106398 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-TenantUsagesNegativeTestJSON-960447600-project Oct 08 20:58:43.106398 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 20:58:43.106398 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 20:58:43.106398 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: f5c7e0962b264d15aae60bd10c959c74 Oct 08 20:58:43.106398 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-960447600-project Oct 08 20:58:43.106398 ncdv-master-1 devstack@n-api.service[140491]: method: Oct 08 20:58:43.106398 ncdv-master-1 devstack@n-api.service[140491]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 08 20:58:43.106398 ncdv-master-1 devstack@n-api.service[140491]: action_args: {} Oct 08 20:58:43.106398 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:58:43.106398 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:58:43.106398 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:58:43.106398 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:58:43.106398 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:58:43.106398 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:58:43.106398 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 08 20:58:43.106398 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 08 20:58:43.106398 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 08 20:58:43.106398 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 20:58:43.106398 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:58:43.106398 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:58:43.106398 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Oct 08 20:58:43.106398 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return self._index(req) Oct 08 20:58:43.106398 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Oct 08 20:58:43.106398 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Oct 08 20:58:43.106398 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 08 20:58:43.106398 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 08 20:58:43.106398 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 08 20:58:43.106398 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 08 20:58:43.106398 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 08 20:58:43.106398 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 08 20:58:43.106398 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 08 20:58:43.106398 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise self.value Oct 08 20:58:43.106398 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 08 20:58:43.106398 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 08 20:58:43.106398 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 08 20:58:43.106398 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 08 20:58:43.106398 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 08 20:58:43.106398 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 08 20:58:43.111665 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 08 20:58:43.111665 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:58:43.111665 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:58:43.111665 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:58:43.111665 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:58:43.111665 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:58:43.111665 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:58:43.111665 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 08 20:58:43.111665 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 08 20:58:43.111665 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 08 20:58:43.111665 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:58:43.115351 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-e18b3c8f-123e-447f-bdd8-1b3286ec8eca tempest-TenantUsagesNegativeTestJSON-960447600 tempest-TenantUsagesNegativeTestJSON-960447600-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:58:43.119735 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-e18b3c8f-123e-447f-bdd8-1b3286ec8eca tempest-TenantUsagesNegativeTestJSON-960447600 tempest-TenantUsagesNegativeTestJSON-960447600-project] 10.222.0.26 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-07T20%3A58%3A40.652770&end=2022-10-09T20%3A58%3A40.652770&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.277202 Oct 08 20:58:43.123707 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 892/1814] 10.222.0.26 () {58 vars in 1335 bytes} [Sat Oct 8 20:58:42 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-07T20%3A58%3A40.652770&end=2022-10-09T20%3A58%3A40.652770&detailed=1 => generated 123 bytes in 282 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 08 20:58:43.131822 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-e700aa18-6fc3-4ff9-8b37-b84680d65b6b tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Calling method '.version_select at 0x7f1a9136df70>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:43.208203 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-e700aa18-6fc3-4ff9-8b37-b84680d65b6b tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] 10.222.0.26 "GET /compute/v2.1/images/fa97ce22-1af3-4366-9d57-84040c24f915" status: 200 len: 1424 microversion: 2.1 time: 0.083078 Oct 08 20:58:43.208867 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 893/1815] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:58:43 2022] GET /compute/v2.1/images/fa97ce22-1af3-4366-9d57-84040c24f915 => generated 1424 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:58:43.226648 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-3f41b297-dece-496b-b349-f3edc4b48011 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:43.227387 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-3f41b297-dece-496b-b349-f3edc4b48011 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] [instance: 0568d34c-9aa0-452f-b5c5-b3fc19ebbf15] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:58:43.236555 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3f41b297-dece-496b-b349-f3edc4b48011 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:43.237108 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3f41b297-dece-496b-b349-f3edc4b48011 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:43.237649 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3f41b297-dece-496b-b349-f3edc4b48011 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:43.238975 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3f41b297-dece-496b-b349-f3edc4b48011 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:43.239450 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3f41b297-dece-496b-b349-f3edc4b48011 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:43.241545 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3f41b297-dece-496b-b349-f3edc4b48011 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:43.327651 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3f41b297-dece-496b-b349-f3edc4b48011 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:43.331550 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3f41b297-dece-496b-b349-f3edc4b48011 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:43.333181 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3f41b297-dece-496b-b349-f3edc4b48011 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:43.339543 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.objects.instance [None req-3f41b297-dece-496b-b349-f3edc4b48011 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Lazy-loading 'fault' on Instance uuid 0568d34c-9aa0-452f-b5c5-b3fc19ebbf15 {{(pid=140491) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 20:58:43.425331 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-3f41b297-dece-496b-b349-f3edc4b48011 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9facf5ea0743cb821cec1b40f6b609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdaf5b9230f4e09949a39a5cbe72011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:58:43.438600 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-3f41b297-dece-496b-b349-f3edc4b48011 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] 10.222.0.26 "GET /compute/v2.1/servers/0568d34c-9aa0-452f-b5c5-b3fc19ebbf15" status: 200 len: 1367 microversion: 2.1 time: 0.216176 Oct 08 20:58:43.441143 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 894/1816] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:58:43 2022] GET /compute/v2.1/servers/0568d34c-9aa0-452f-b5c5-b3fc19ebbf15 => generated 1367 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:58:43.460982 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-bbaf4837-e653-47e6-b17c-1b9963f4f37c tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:43.463189 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-bbaf4837-e653-47e6-b17c-1b9963f4f37c tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] [instance: e5389d1b-b9f3-491a-898c-be611599d73a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:58:43.482239 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bbaf4837-e653-47e6-b17c-1b9963f4f37c tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:43.482921 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bbaf4837-e653-47e6-b17c-1b9963f4f37c tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:43.484432 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bbaf4837-e653-47e6-b17c-1b9963f4f37c tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:43.488422 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bbaf4837-e653-47e6-b17c-1b9963f4f37c tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:43.489319 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bbaf4837-e653-47e6-b17c-1b9963f4f37c tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:43.492522 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bbaf4837-e653-47e6-b17c-1b9963f4f37c tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:43.514655 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-ac828ffd-eb2d-4bc5-95bd-d3e5a60cec6a tempest-ServersOnMultiNodesTest-429096361 tempest-ServersOnMultiNodesTest-429096361-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/84a8a931-6a18-4ef4-9e3c-63cf4054ea43" status: 200 len: 1620 microversion: 2.1 time: 0.510183 Oct 08 20:58:43.517343 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 923/1817] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:58:43 2022] GET /compute/v2.1/servers/84a8a931-6a18-4ef4-9e3c-63cf4054ea43 => generated 1620 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:58:43.549577 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-315d955e-7cb7-4ee4-bb57-d5e3662035c4 tempest-ServersOnMultiNodesTest-429096361 tempest-ServersOnMultiNodesTest-429096361-project-admin] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:43.551040 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-315d955e-7cb7-4ee4-bb57-d5e3662035c4 tempest-ServersOnMultiNodesTest-429096361 tempest-ServersOnMultiNodesTest-429096361-project-admin] [instance: edebb288-3d28-4432-b9fd-d74cfb2de586] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:58:43.567840 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-315d955e-7cb7-4ee4-bb57-d5e3662035c4 tempest-ServersOnMultiNodesTest-429096361 tempest-ServersOnMultiNodesTest-429096361-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:43.568796 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-315d955e-7cb7-4ee4-bb57-d5e3662035c4 tempest-ServersOnMultiNodesTest-429096361 tempest-ServersOnMultiNodesTest-429096361-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:43.570392 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-315d955e-7cb7-4ee4-bb57-d5e3662035c4 tempest-ServersOnMultiNodesTest-429096361 tempest-ServersOnMultiNodesTest-429096361-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:43.571659 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-315d955e-7cb7-4ee4-bb57-d5e3662035c4 tempest-ServersOnMultiNodesTest-429096361 tempest-ServersOnMultiNodesTest-429096361-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:43.576017 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-315d955e-7cb7-4ee4-bb57-d5e3662035c4 tempest-ServersOnMultiNodesTest-429096361 tempest-ServersOnMultiNodesTest-429096361-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:43.576896 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-315d955e-7cb7-4ee4-bb57-d5e3662035c4 tempest-ServersOnMultiNodesTest-429096361 tempest-ServersOnMultiNodesTest-429096361-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:43.889047 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-bbaf4837-e653-47e6-b17c-1b9963f4f37c tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01ec70849cfa44368a91df8b3410aba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c97b3b7fa484f97bdf40224f7cc34d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:58:43.897518 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-bbaf4837-e653-47e6-b17c-1b9963f4f37c tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] 10.222.0.26 "GET /compute/v2.1/servers/e5389d1b-b9f3-491a-898c-be611599d73a" status: 200 len: 1510 microversion: 2.1 time: 0.450201 Oct 08 20:58:43.903106 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 895/1818] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:58:43 2022] GET /compute/v2.1/servers/e5389d1b-b9f3-491a-898c-be611599d73a => generated 1510 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:58:43.915154 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-6d71a1fa-833f-4091-8b6d-a1d9641e6a89 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:43.916091 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-6d71a1fa-833f-4091-8b6d-a1d9641e6a89 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] [instance: c9f0e1d2-6f87-485d-bff6-0ea83899b705] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:58:43.930839 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6d71a1fa-833f-4091-8b6d-a1d9641e6a89 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:43.933463 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6d71a1fa-833f-4091-8b6d-a1d9641e6a89 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:43.934314 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6d71a1fa-833f-4091-8b6d-a1d9641e6a89 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:43.943315 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6d71a1fa-833f-4091-8b6d-a1d9641e6a89 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:43.947378 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6d71a1fa-833f-4091-8b6d-a1d9641e6a89 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:43.952122 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6d71a1fa-833f-4091-8b6d-a1d9641e6a89 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:44.063126 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-315d955e-7cb7-4ee4-bb57-d5e3662035c4 tempest-ServersOnMultiNodesTest-429096361 tempest-ServersOnMultiNodesTest-429096361-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/edebb288-3d28-4432-b9fd-d74cfb2de586" status: 200 len: 1619 microversion: 2.1 time: 0.521675 Oct 08 20:58:44.065118 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 924/1819] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:58:43 2022] GET /compute/v2.1/servers/edebb288-3d28-4432-b9fd-d74cfb2de586 => generated 1619 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:58:44.071799 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-6d71a1fa-833f-4091-8b6d-a1d9641e6a89 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d96135705514061bef9306753143357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82999f8bc36455bafd8eed23c68e733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:58:44.098592 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-61925b57-216b-482c-8c56-975bf6b76455 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Action: 'create', calling method: .version_select at 0x7f1a8c157ee0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-979433657", "policies": ["anti-affinity"]}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:58:44.101438 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-6d71a1fa-833f-4091-8b6d-a1d9641e6a89 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] 10.222.0.26 "GET /compute/v2.1/servers/c9f0e1d2-6f87-485d-bff6-0ea83899b705" status: 200 len: 1220 microversion: 2.1 time: 0.195526 Oct 08 20:58:44.102782 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 896/1820] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:58:43 2022] GET /compute/v2.1/servers/c9f0e1d2-6f87-485d-bff6-0ea83899b705 => generated 1220 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:58:44.173229 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-61925b57-216b-482c-8c56-975bf6b76455 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Getting quotas for project 8472b054404c46a99b81aba34d6b9f40. Resources: {'server_groups'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 20:58:44.188890 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-61925b57-216b-482c-8c56-975bf6b76455 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Getting quotas for user 67ddc3cd3c374bacbe5bf5e0877380e2 and project 8472b054404c46a99b81aba34d6b9f40. Resources: {'server_groups'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 20:58:44.224429 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-a51b8408-e886-44fb-9cdb-db3afa5796e7 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Calling method '.version_select at 0x7f1a914cb3a0>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:44.296775 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-a51b8408-e886-44fb-9cdb-db3afa5796e7 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] 10.222.0.26 "GET /compute/v2.1/images/fa97ce22-1af3-4366-9d57-84040c24f915" status: 200 len: 1424 microversion: 2.1 time: 0.075871 Oct 08 20:58:44.297789 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 897/1821] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:58:44 2022] GET /compute/v2.1/images/fa97ce22-1af3-4366-9d57-84040c24f915 => generated 1424 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 20:58:44.336751 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-61925b57-216b-482c-8c56-975bf6b76455 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Getting quotas for project 8472b054404c46a99b81aba34d6b9f40. Resources: {'server_groups'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 20:58:44.355467 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-61925b57-216b-482c-8c56-975bf6b76455 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Getting quotas for user 67ddc3cd3c374bacbe5bf5e0877380e2 and project 8472b054404c46a99b81aba34d6b9f40. Resources: {'server_groups'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 20:58:44.418983 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-61925b57-216b-482c-8c56-975bf6b76455 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] 10.222.0.26 "POST /compute/v2.1/os-server-groups" status: 200 len: 192 microversion: 2.1 time: 0.324744 Oct 08 20:58:44.421927 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 925/1822] 10.222.0.26 () {60 vars in 1174 bytes} [Sat Oct 8 20:58:44 2022] POST /compute/v2.1/os-server-groups => generated 192 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:58:44.464675 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-3c612419-8a66-49fc-a335-9b6935072792 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:44.465811 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-3c612419-8a66-49fc-a335-9b6935072792 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] [instance: 0568d34c-9aa0-452f-b5c5-b3fc19ebbf15] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:58:44.481172 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3c612419-8a66-49fc-a335-9b6935072792 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:44.483436 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3c612419-8a66-49fc-a335-9b6935072792 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:44.484629 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3c612419-8a66-49fc-a335-9b6935072792 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:44.487517 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3c612419-8a66-49fc-a335-9b6935072792 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:44.488213 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3c612419-8a66-49fc-a335-9b6935072792 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:44.488855 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3c612419-8a66-49fc-a335-9b6935072792 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:44.538170 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-3c612419-8a66-49fc-a335-9b6935072792 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] HTTP exception thrown: Instance 0568d34c-9aa0-452f-b5c5-b3fc19ebbf15 could not be found. Oct 08 20:58:44.553972 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-3c612419-8a66-49fc-a335-9b6935072792 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Request method failure captured: Oct 08 20:58:44.553972 ncdv-master-1 devstack@n-api.service[140491]: request: GET /compute/v2.1/servers/0568d34c-9aa0-452f-b5c5-b3fc19ebbf15 HTTP/1.1 Oct 08 20:58:44.553972 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 20:58:44.553972 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 20:58:44.553972 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 20:58:44.553972 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 20:58:44.553972 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 20:58:44.553972 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 20:58:44.553972 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 20:58:44.553972 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 20:58:44.553972 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeQ1FSJuUSfH7_bgSfXe5XSpLHurWJWpBD7svG2a9ELj3ZChkSm-zHvPJHTrMaBSbYf_AKPJm0j1ijUg8wD1KjzWQGHWMdxwaBUIThksNo0ZztCH7xZ0zqo3Cg8CiiaqOo-YPs3WqSfir9ZAw6Pu_OPubznKSz6DqJ8SLAa8MlmmdWI Oct 08 20:58:44.553972 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 20:58:44.553972 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 20:58:44.553972 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 20:58:44.553972 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 20:58:44.553972 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 20:58:44.553972 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 20:58:44.553972 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 5cdaf5b9230f4e09949a39a5cbe72011 Oct 08 20:58:44.553972 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-ServersTestManualDisk-540107157 Oct 08 20:58:44.553972 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 20:58:44.553972 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 20:58:44.553972 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5cdaf5b9230f4e09949a39a5cbe72011"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5cdaf5b9230f4e09949a39a5cbe72011"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5cdaf5b9230f4e09949a39a5cbe72011"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5cdaf5b9230f4e09949a39a5cbe72011"}]}] Oct 08 20:58:44.553972 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-ServersTestManualDisk-540107157 Oct 08 20:58:44.553972 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 5cdaf5b9230f4e09949a39a5cbe72011 Oct 08 20:58:44.553972 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-ServersTestManualDisk-540107157 Oct 08 20:58:44.553972 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-ServersTestManualDisk-540107157-project Oct 08 20:58:44.553972 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 20:58:44.553972 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 20:58:44.553972 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 5d9facf5ea0743cb821cec1b40f6b609 Oct 08 20:58:44.553972 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-ServersTestManualDisk-540107157-project Oct 08 20:58:44.553972 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 20:58:44.553972 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance 0568d34c-9aa0-452f-b5c5-b3fc19ebbf15 could not be found. Oct 08 20:58:44.553972 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': '0568d34c-9aa0-452f-b5c5-b3fc19ebbf15'} Oct 08 20:58:44.553972 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:58:44.553972 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:58:44.553972 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 20:58:44.553972 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 20:58:44.553972 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 20:58:44.553972 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 20:58:44.553972 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 20:58:44.553972 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 20:58:44.553972 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 20:58:44.553972 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 20:58:44.553972 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0568d34c-9aa0-452f-b5c5-b3fc19ebbf15 could not be found. Oct 08 20:58:44.553972 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:58:44.553972 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:58:44.553972 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:58:44.553972 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:58:44.553972 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:58:44.553972 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:58:44.553972 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:58:44.553972 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:58:44.553972 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:58:44.553972 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:58:44.553972 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 20:58:44.553972 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 20:58:44.553972 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 20:58:44.553972 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 20:58:44.553972 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 20:58:44.553972 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 20:58:44.553972 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0568d34c-9aa0-452f-b5c5-b3fc19ebbf15 could not be found. Oct 08 20:58:44.553972 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:58:44.553972 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:58:44.553972 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:58:44.559840 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:58:44.559840 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:58:44.559840 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:58:44.559840 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 20:58:44.559840 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 20:58:44.559840 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0568d34c-9aa0-452f-b5c5-b3fc19ebbf15 could not be found. Oct 08 20:58:44.559840 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:58:44.565783 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-3c612419-8a66-49fc-a335-9b6935072792 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Returning 404 to user: Instance 0568d34c-9aa0-452f-b5c5-b3fc19ebbf15 could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:58:44.566994 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-3c612419-8a66-49fc-a335-9b6935072792 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] 10.222.0.26 "GET /compute/v2.1/servers/0568d34c-9aa0-452f-b5c5-b3fc19ebbf15" status: 404 len: 111 microversion: 2.1 time: 0.106945 Oct 08 20:58:44.571250 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 898/1823] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:58:44 2022] GET /compute/v2.1/servers/0568d34c-9aa0-452f-b5c5-b3fc19ebbf15 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 20:58:44.579248 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-96463a6d-5289-4c6f-84a7-e52edb6c7543 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] Calling method '.version_select at 0x7f1a8c134ca0>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:44.648620 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-96463a6d-5289-4c6f-84a7-e52edb6c7543 tempest-ServersTestManualDisk-540107157 tempest-ServersTestManualDisk-540107157-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-729921336" status: 202 len: 0 microversion: 2.1 time: 0.073173 Oct 08 20:58:44.656840 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 926/1824] 10.222.0.26 () {58 vars in 1218 bytes} [Sat Oct 8 20:58:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-729921336 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 20:58:44.718511 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-1b216497-9631-4fdc-ae3e-a6fb0c8f1dd5 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-344884845", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "fe819c51-52ee-4d77-83e3-6fe92bbd0690"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:58:44.853953 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.network.neutron [None req-1b216497-9631-4fdc-ae3e-a6fb0c8f1dd5 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] validate_networks() for None {{(pid=140491) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 20:58:44.928893 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-a0bb3150-520a-4cb4-a811-50861a3529e0 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:44.929581 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-a0bb3150-520a-4cb4-a811-50861a3529e0 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] [instance: e5389d1b-b9f3-491a-898c-be611599d73a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:58:44.938368 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a0bb3150-520a-4cb4-a811-50861a3529e0 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:44.938966 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a0bb3150-520a-4cb4-a811-50861a3529e0 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:44.939473 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a0bb3150-520a-4cb4-a811-50861a3529e0 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:44.940296 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a0bb3150-520a-4cb4-a811-50861a3529e0 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:44.940769 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a0bb3150-520a-4cb4-a811-50861a3529e0 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:44.958603 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a0bb3150-520a-4cb4-a811-50861a3529e0 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:45.886761 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-1b216497-9631-4fdc-ae3e-a6fb0c8f1dd5 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Flavor limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 20:58:45.888011 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-1b216497-9631-4fdc-ae3e-a6fb0c8f1dd5 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Image limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 20:58:45.888930 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-1b216497-9631-4fdc-ae3e-a6fb0c8f1dd5 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Flavor pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 20:58:45.889658 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-1b216497-9631-4fdc-ae3e-a6fb0c8f1dd5 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Image pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 20:58:45.890422 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-1b216497-9631-4fdc-ae3e-a6fb0c8f1dd5 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 20:58:45.927569 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1b216497-9631-4fdc-ae3e-a6fb0c8f1dd5 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:45.928471 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1b216497-9631-4fdc-ae3e-a6fb0c8f1dd5 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:45.929364 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1b216497-9631-4fdc-ae3e-a6fb0c8f1dd5 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:45.930599 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1b216497-9631-4fdc-ae3e-a6fb0c8f1dd5 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:45.931311 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1b216497-9631-4fdc-ae3e-a6fb0c8f1dd5 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:45.931996 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1b216497-9631-4fdc-ae3e-a6fb0c8f1dd5 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:45.965118 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-1b216497-9631-4fdc-ae3e-a6fb0c8f1dd5 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Getting quotas for project 8472b054404c46a99b81aba34d6b9f40. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 20:58:45.968834 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-a0bb3150-520a-4cb4-a811-50861a3529e0 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01ec70849cfa44368a91df8b3410aba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c97b3b7fa484f97bdf40224f7cc34d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:58:45.981679 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-1b216497-9631-4fdc-ae3e-a6fb0c8f1dd5 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Getting quotas for user 67ddc3cd3c374bacbe5bf5e0877380e2 and project 8472b054404c46a99b81aba34d6b9f40. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 20:58:45.984241 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-a0bb3150-520a-4cb4-a811-50861a3529e0 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] 10.222.0.26 "GET /compute/v2.1/servers/e5389d1b-b9f3-491a-898c-be611599d73a" status: 200 len: 1510 microversion: 2.1 time: 1.053574 Oct 08 20:58:45.998432 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 927/1825] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:58:44 2022] GET /compute/v2.1/servers/e5389d1b-b9f3-491a-898c-be611599d73a => generated 1510 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 20:58:46.010460 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-1b216497-9631-4fdc-ae3e-a6fb0c8f1dd5 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Going to run 2 instances... {{(pid=140491) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 20:58:46.015687 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-1b216497-9631-4fdc-ae3e-a6fb0c8f1dd5 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] [instance: 37daee2e-9629-4664-a85d-da2e8aa5ea2e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c508bd7f-7db9-4b2c-af7c-be54a855c355',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140491) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 20:58:46.018829 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-79f4fd12-0fd0-417c-ade2-914e51ed4b24 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:46.019735 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-79f4fd12-0fd0-417c-ade2-914e51ed4b24 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] [instance: c9f0e1d2-6f87-485d-bff6-0ea83899b705] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:58:46.041334 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-79f4fd12-0fd0-417c-ade2-914e51ed4b24 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:46.042283 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-79f4fd12-0fd0-417c-ade2-914e51ed4b24 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:46.042929 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-79f4fd12-0fd0-417c-ade2-914e51ed4b24 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:46.043874 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-79f4fd12-0fd0-417c-ade2-914e51ed4b24 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:46.054020 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-79f4fd12-0fd0-417c-ade2-914e51ed4b24 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:46.054773 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-79f4fd12-0fd0-417c-ade2-914e51ed4b24 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:46.100535 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-1b216497-9631-4fdc-ae3e-a6fb0c8f1dd5 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=140491) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Oct 08 20:58:46.179075 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-1b216497-9631-4fdc-ae3e-a6fb0c8f1dd5 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Getting quotas for project 8472b054404c46a99b81aba34d6b9f40. Resources: {'server_group_members'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 20:58:46.196565 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-1b216497-9631-4fdc-ae3e-a6fb0c8f1dd5 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Getting quotas for user 67ddc3cd3c374bacbe5bf5e0877380e2 and project 8472b054404c46a99b81aba34d6b9f40. Resources: {'server_group_members'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 20:58:46.279160 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-1b216497-9631-4fdc-ae3e-a6fb0c8f1dd5 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Getting quotas for project 8472b054404c46a99b81aba34d6b9f40. Resources: {'server_group_members'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 20:58:46.288759 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-1b216497-9631-4fdc-ae3e-a6fb0c8f1dd5 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Getting quotas for user 67ddc3cd3c374bacbe5bf5e0877380e2 and project 8472b054404c46a99b81aba34d6b9f40. Resources: {'server_group_members'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 20:58:46.311580 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:58:46.328788 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-1b216497-9631-4fdc-ae3e-a6fb0c8f1dd5 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] [instance: 4be597d7-a3dd-44f3-9d17-946635bea8e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c508bd7f-7db9-4b2c-af7c-be54a855c355',instance=,instance_uuid=37daee2e-9629-4664-a85d-da2e8aa5ea2e,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140491) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 20:58:46.441900 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-1b216497-9631-4fdc-ae3e-a6fb0c8f1dd5 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Getting quotas for project 8472b054404c46a99b81aba34d6b9f40. Resources: {'server_group_members'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 20:58:46.451032 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-1b216497-9631-4fdc-ae3e-a6fb0c8f1dd5 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Getting quotas for user 67ddc3cd3c374bacbe5bf5e0877380e2 and project 8472b054404c46a99b81aba34d6b9f40. Resources: {'server_group_members'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 20:58:46.508502 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-1b216497-9631-4fdc-ae3e-a6fb0c8f1dd5 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Getting quotas for project 8472b054404c46a99b81aba34d6b9f40. Resources: {'server_group_members'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 20:58:46.515685 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-1b216497-9631-4fdc-ae3e-a6fb0c8f1dd5 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Getting quotas for user 67ddc3cd3c374bacbe5bf5e0877380e2 and project 8472b054404c46a99b81aba34d6b9f40. Resources: {'server_group_members'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 20:58:46.551231 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-79f4fd12-0fd0-417c-ade2-914e51ed4b24 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d96135705514061bef9306753143357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82999f8bc36455bafd8eed23c68e733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:58:46.563648 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-79f4fd12-0fd0-417c-ade2-914e51ed4b24 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] 10.222.0.26 "GET /compute/v2.1/servers/c9f0e1d2-6f87-485d-bff6-0ea83899b705" status: 200 len: 1238 microversion: 2.1 time: 0.558124 Oct 08 20:58:46.568167 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-1b216497-9631-4fdc-ae3e-a6fb0c8f1dd5 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.854080 Oct 08 20:58:46.572461 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 899/1826] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 20:58:44 2022] POST /compute/v2.1/servers => generated 32 bytes in 1859 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 08 20:58:46.578331 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-2d22c993-95f5-4dfb-94d5-8f8dd838ef90 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Calling method '.version_select at 0x7f1a913c6550>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:46.586931 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 928/1827] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:58:45 2022] GET /compute/v2.1/servers/c9f0e1d2-6f87-485d-bff6-0ea83899b705 => generated 1238 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:58:46.616040 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-18af11f6-7a36-438b-9f24-fb239b270e49 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:46.636548 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-2d22c993-95f5-4dfb-94d5-8f8dd838ef90 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] 10.222.0.26 "GET /compute/v2.1/images/fa97ce22-1af3-4366-9d57-84040c24f915" status: 200 len: 1424 microversion: 2.1 time: 0.062413 Oct 08 20:58:46.638088 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 900/1828] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:58:46 2022] GET /compute/v2.1/images/fa97ce22-1af3-4366-9d57-84040c24f915 => generated 1424 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:58:46.653837 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-18af11f6-7a36-438b-9f24-fb239b270e49 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '67ddc3cd3c374bacbe5bf5e0877380e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8472b054404c46a99b81aba34d6b9f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:58:46.655985 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-18af11f6-7a36-438b-9f24-fb239b270e49 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Searching by: {'deleted': False, 'project_id': '8472b054404c46a99b81aba34d6b9f40'} {{(pid=140492) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 08 20:58:46.712347 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-18af11f6-7a36-438b-9f24-fb239b270e49 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:46.718118 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-18af11f6-7a36-438b-9f24-fb239b270e49 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:46.718118 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-18af11f6-7a36-438b-9f24-fb239b270e49 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:46.719001 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-18af11f6-7a36-438b-9f24-fb239b270e49 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:46.719952 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-18af11f6-7a36-438b-9f24-fb239b270e49 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:46.737151 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-18af11f6-7a36-438b-9f24-fb239b270e49 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:46.780956 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.multi_cell_list [None req-18af11f6-7a36-438b-9f24-fb239b270e49 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=140492) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 08 20:58:46.819028 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-18af11f6-7a36-438b-9f24-fb239b270e49 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] 10.222.0.26 "GET /compute/v2.1/servers" status: 200 len: 1664 microversion: 2.1 time: 0.230504 Oct 08 20:58:46.820396 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 929/1829] 10.222.0.26 () {58 vars in 1125 bytes} [Sat Oct 8 20:58:46 2022] GET /compute/v2.1/servers => generated 1664 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:58:46.835598 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-48f447f0-c37d-4daa-9623-d90c636316a0 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:46.836144 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-48f447f0-c37d-4daa-9623-d90c636316a0 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] [instance: 4be597d7-a3dd-44f3-9d17-946635bea8e6] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:58:47.013355 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-bc53f7c7-7470-4566-8a12-c7650570c9da tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:47.014057 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-bc53f7c7-7470-4566-8a12-c7650570c9da tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] [instance: e5389d1b-b9f3-491a-898c-be611599d73a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:58:47.035835 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bc53f7c7-7470-4566-8a12-c7650570c9da tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:47.039135 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bc53f7c7-7470-4566-8a12-c7650570c9da tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:47.039968 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bc53f7c7-7470-4566-8a12-c7650570c9da tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:47.047375 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bc53f7c7-7470-4566-8a12-c7650570c9da tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:47.051929 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bc53f7c7-7470-4566-8a12-c7650570c9da tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:47.054606 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bc53f7c7-7470-4566-8a12-c7650570c9da tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:47.239064 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-48f447f0-c37d-4daa-9623-d90c636316a0 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ddc3cd3c374bacbe5bf5e0877380e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8472b054404c46a99b81aba34d6b9f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:58:47.256468 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-48f447f0-c37d-4daa-9623-d90c636316a0 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] 10.222.0.26 "GET /compute/v2.1/servers/4be597d7-a3dd-44f3-9d17-946635bea8e6" status: 200 len: 1218 microversion: 2.1 time: 0.425188 Oct 08 20:58:47.259776 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 901/1830] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:58:46 2022] GET /compute/v2.1/servers/4be597d7-a3dd-44f3-9d17-946635bea8e6 => generated 1218 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:58:47.612111 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-4975ada6-8657-406e-9833-76a6900c15fa tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:47.613314 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-4975ada6-8657-406e-9833-76a6900c15fa tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] [instance: c9f0e1d2-6f87-485d-bff6-0ea83899b705] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:58:47.631835 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4975ada6-8657-406e-9833-76a6900c15fa tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:47.632396 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4975ada6-8657-406e-9833-76a6900c15fa tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:47.633037 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4975ada6-8657-406e-9833-76a6900c15fa tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:47.633811 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4975ada6-8657-406e-9833-76a6900c15fa tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:47.634732 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4975ada6-8657-406e-9833-76a6900c15fa tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:47.635630 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4975ada6-8657-406e-9833-76a6900c15fa tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:48.288738 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-4975ada6-8657-406e-9833-76a6900c15fa tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d96135705514061bef9306753143357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82999f8bc36455bafd8eed23c68e733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:58:48.338756 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-4975ada6-8657-406e-9833-76a6900c15fa tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] 10.222.0.26 "GET /compute/v2.1/servers/c9f0e1d2-6f87-485d-bff6-0ea83899b705" status: 200 len: 1294 microversion: 2.1 time: 0.731173 Oct 08 20:58:48.369230 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 902/1831] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:58:47 2022] GET /compute/v2.1/servers/c9f0e1d2-6f87-485d-bff6-0ea83899b705 => generated 1294 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 20:58:48.390807 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-be0ee240-4530-4c83-834b-8b9969463068 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Calling method '.version_select at 0x7f1a914d7d30>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:48.517079 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-be0ee240-4530-4c83-834b-8b9969463068 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] 10.222.0.26 "GET /compute/v2.1/images/fa97ce22-1af3-4366-9d57-84040c24f915" status: 200 len: 1424 microversion: 2.1 time: 0.144603 Oct 08 20:58:48.518743 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 903/1832] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:58:48 2022] GET /compute/v2.1/images/fa97ce22-1af3-4366-9d57-84040c24f915 => generated 1424 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:58:48.525019 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-20810a12-8e38-41aa-81d7-6576de2a0d64 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:48.526009 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-20810a12-8e38-41aa-81d7-6576de2a0d64 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] [instance: 4be597d7-a3dd-44f3-9d17-946635bea8e6] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:58:48.536033 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-20810a12-8e38-41aa-81d7-6576de2a0d64 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:48.537024 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-20810a12-8e38-41aa-81d7-6576de2a0d64 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:48.537781 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-20810a12-8e38-41aa-81d7-6576de2a0d64 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:48.539448 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-20810a12-8e38-41aa-81d7-6576de2a0d64 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:48.540346 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-20810a12-8e38-41aa-81d7-6576de2a0d64 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:48.541057 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-20810a12-8e38-41aa-81d7-6576de2a0d64 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:48.787552 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-20810a12-8e38-41aa-81d7-6576de2a0d64 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ddc3cd3c374bacbe5bf5e0877380e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8472b054404c46a99b81aba34d6b9f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:58:48.830879 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-20810a12-8e38-41aa-81d7-6576de2a0d64 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] 10.222.0.26 "GET /compute/v2.1/servers/4be597d7-a3dd-44f3-9d17-946635bea8e6" status: 200 len: 1214 microversion: 2.1 time: 0.300873 Oct 08 20:58:48.836871 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-bc53f7c7-7470-4566-8a12-c7650570c9da tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01ec70849cfa44368a91df8b3410aba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c97b3b7fa484f97bdf40224f7cc34d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:58:48.868264 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 904/1833] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:58:48 2022] GET /compute/v2.1/servers/4be597d7-a3dd-44f3-9d17-946635bea8e6 => generated 1214 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:58:48.887385 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-bc53f7c7-7470-4566-8a12-c7650570c9da tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] 10.222.0.26 "GET /compute/v2.1/servers/e5389d1b-b9f3-491a-898c-be611599d73a" status: 200 len: 1510 microversion: 2.1 time: 1.865844 Oct 08 20:58:48.890671 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 930/1834] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:58:47 2022] GET /compute/v2.1/servers/e5389d1b-b9f3-491a-898c-be611599d73a => generated 1510 bytes in 1883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 20:58:48.959645 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-8db4dede-e2d5-4ff3-977a-28b6c262b047 req-4a82b5ad-9147-487e-83a6-67b48a6a6422 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5389d1b-b9f3-491a-898c-be611599d73a", "name": "network-vif-deleted", "tag": "d911c0da-f663-4272-afa4-3646c36b9e29"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:58:48.977602 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-8db4dede-e2d5-4ff3-977a-28b6c262b047 req-4a82b5ad-9147-487e-83a6-67b48a6a6422 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:48.978314 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-8db4dede-e2d5-4ff3-977a-28b6c262b047 req-4a82b5ad-9147-487e-83a6-67b48a6a6422 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:48.979458 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-8db4dede-e2d5-4ff3-977a-28b6c262b047 req-4a82b5ad-9147-487e-83a6-67b48a6a6422 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:48.999717 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-8db4dede-e2d5-4ff3-977a-28b6c262b047 req-4a82b5ad-9147-487e-83a6-67b48a6a6422 service nova] Creating event network-vif-deleted:d911c0da-f663-4272-afa4-3646c36b9e29 for instance e5389d1b-b9f3-491a-898c-be611599d73a on nch2-master-1 Oct 08 20:58:49.009584 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-8db4dede-e2d5-4ff3-977a-28b6c262b047 req-4a82b5ad-9147-487e-83a6-67b48a6a6422 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064822 Oct 08 20:58:49.010770 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 905/1835] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:58:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:58:49.381114 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-fc7052ca-6424-4dcc-ae19-d315ff30767f tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:49.383975 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-fc7052ca-6424-4dcc-ae19-d315ff30767f tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] [instance: c9f0e1d2-6f87-485d-bff6-0ea83899b705] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:58:49.427650 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fc7052ca-6424-4dcc-ae19-d315ff30767f tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:49.431382 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fc7052ca-6424-4dcc-ae19-d315ff30767f tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:49.433339 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fc7052ca-6424-4dcc-ae19-d315ff30767f tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:49.438308 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fc7052ca-6424-4dcc-ae19-d315ff30767f tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:49.438814 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fc7052ca-6424-4dcc-ae19-d315ff30767f tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:49.446716 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fc7052ca-6424-4dcc-ae19-d315ff30767f tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:49.536175 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-bf0a315e-e93b-4ec9-a221-e35abbbfe67d tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Calling method '.version_select at 0x7f1a91378b80>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:49.668214 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-bf0a315e-e93b-4ec9-a221-e35abbbfe67d tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] 10.222.0.26 "GET /compute/v2.1/images/fa97ce22-1af3-4366-9d57-84040c24f915" status: 200 len: 1424 microversion: 2.1 time: 0.137707 Oct 08 20:58:49.675567 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 906/1836] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:58:49 2022] GET /compute/v2.1/images/fa97ce22-1af3-4366-9d57-84040c24f915 => generated 1424 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:58:49.815822 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-a0906259-9a1e-4bc8-96fd-aee6c86adb60 req-4c07fcc2-489d-4294-b4c1-4fa624c53197 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9f0e1d2-6f87-485d-bff6-0ea83899b705", "tag": "f8af2e56-5b37-4a10-8d70-4486ae942499"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:58:49.851868 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-a0906259-9a1e-4bc8-96fd-aee6c86adb60 req-4c07fcc2-489d-4294-b4c1-4fa624c53197 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:49.853618 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-a0906259-9a1e-4bc8-96fd-aee6c86adb60 req-4c07fcc2-489d-4294-b4c1-4fa624c53197 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:49.854790 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-a0906259-9a1e-4bc8-96fd-aee6c86adb60 req-4c07fcc2-489d-4294-b4c1-4fa624c53197 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:49.900306 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-a0906259-9a1e-4bc8-96fd-aee6c86adb60 req-4c07fcc2-489d-4294-b4c1-4fa624c53197 service nova] Creating event network-changed:f8af2e56-5b37-4a10-8d70-4486ae942499 for instance c9f0e1d2-6f87-485d-bff6-0ea83899b705 on nch1-master-1 Oct 08 20:58:49.916432 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-a0906259-9a1e-4bc8-96fd-aee6c86adb60 req-4c07fcc2-489d-4294-b4c1-4fa624c53197 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107145 Oct 08 20:58:49.925083 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 907/1837] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:58:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 08 20:58:49.949139 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-5fd98d4a-f249-4d51-89b2-2fe4141a04c6 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:49.951657 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-5fd98d4a-f249-4d51-89b2-2fe4141a04c6 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] [instance: 4be597d7-a3dd-44f3-9d17-946635bea8e6] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:58:49.980193 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5fd98d4a-f249-4d51-89b2-2fe4141a04c6 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:49.981842 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5fd98d4a-f249-4d51-89b2-2fe4141a04c6 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:49.982805 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5fd98d4a-f249-4d51-89b2-2fe4141a04c6 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:49.992267 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5fd98d4a-f249-4d51-89b2-2fe4141a04c6 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:49.992895 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5fd98d4a-f249-4d51-89b2-2fe4141a04c6 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:49.994423 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5fd98d4a-f249-4d51-89b2-2fe4141a04c6 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:50.225550 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-5fd98d4a-f249-4d51-89b2-2fe4141a04c6 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ddc3cd3c374bacbe5bf5e0877380e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8472b054404c46a99b81aba34d6b9f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:58:50.241261 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-5fd98d4a-f249-4d51-89b2-2fe4141a04c6 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] 10.222.0.26 "GET /compute/v2.1/servers/4be597d7-a3dd-44f3-9d17-946635bea8e6" status: 200 len: 1278 microversion: 2.1 time: 0.313566 Oct 08 20:58:50.242428 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 908/1838] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:58:49 2022] GET /compute/v2.1/servers/4be597d7-a3dd-44f3-9d17-946635bea8e6 => generated 1278 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:58:50.256770 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-056b33b7-ff6d-48ed-bf63-87436a752fd0 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:50.258486 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-056b33b7-ff6d-48ed-bf63-87436a752fd0 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] [instance: e5389d1b-b9f3-491a-898c-be611599d73a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:58:50.285967 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-056b33b7-ff6d-48ed-bf63-87436a752fd0 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:50.287824 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-056b33b7-ff6d-48ed-bf63-87436a752fd0 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:50.291428 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-056b33b7-ff6d-48ed-bf63-87436a752fd0 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:50.295736 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-056b33b7-ff6d-48ed-bf63-87436a752fd0 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:50.298113 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-056b33b7-ff6d-48ed-bf63-87436a752fd0 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:50.301376 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-056b33b7-ff6d-48ed-bf63-87436a752fd0 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:50.372659 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-fc7052ca-6424-4dcc-ae19-d315ff30767f tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d96135705514061bef9306753143357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82999f8bc36455bafd8eed23c68e733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:58:50.386923 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-fc7052ca-6424-4dcc-ae19-d315ff30767f tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] 10.222.0.26 "GET /compute/v2.1/servers/c9f0e1d2-6f87-485d-bff6-0ea83899b705" status: 200 len: 1294 microversion: 2.1 time: 1.022652 Oct 08 20:58:50.401221 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 931/1839] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:58:49 2022] GET /compute/v2.1/servers/c9f0e1d2-6f87-485d-bff6-0ea83899b705 => generated 1294 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:58:50.446004 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-056b33b7-ff6d-48ed-bf63-87436a752fd0 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:50.446910 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-056b33b7-ff6d-48ed-bf63-87436a752fd0 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:50.448093 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-056b33b7-ff6d-48ed-bf63-87436a752fd0 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:50.449031 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.objects.instance [None req-056b33b7-ff6d-48ed-bf63-87436a752fd0 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lazy-loading 'fault' on Instance uuid e5389d1b-b9f3-491a-898c-be611599d73a {{(pid=140491) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 20:58:50.644933 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-056b33b7-ff6d-48ed-bf63-87436a752fd0 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01ec70849cfa44368a91df8b3410aba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c97b3b7fa484f97bdf40224f7cc34d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:58:50.657228 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-056b33b7-ff6d-48ed-bf63-87436a752fd0 tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] 10.222.0.26 "GET /compute/v2.1/servers/e5389d1b-b9f3-491a-898c-be611599d73a" status: 200 len: 1312 microversion: 2.1 time: 0.413063 Oct 08 20:58:50.660748 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 909/1840] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:58:50 2022] GET /compute/v2.1/servers/e5389d1b-b9f3-491a-898c-be611599d73a => generated 1312 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:58:50.691942 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-9bb030ff-b7cb-41f8-b903-7035a922f9e4 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Calling method '.version_select at 0x7f1a8c134d30>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:50.773486 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-9bb030ff-b7cb-41f8-b903-7035a922f9e4 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] 10.222.0.26 "GET /compute/v2.1/images/fa97ce22-1af3-4366-9d57-84040c24f915" status: 200 len: 1424 microversion: 2.1 time: 0.086925 Oct 08 20:58:50.774568 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 932/1841] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:58:50 2022] GET /compute/v2.1/images/fa97ce22-1af3-4366-9d57-84040c24f915 => generated 1424 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 20:58:51.271696 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-b0cf05c9-cbbf-4e36-896d-376e38c1096a tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:51.272768 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-b0cf05c9-cbbf-4e36-896d-376e38c1096a tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] [instance: 4be597d7-a3dd-44f3-9d17-946635bea8e6] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:58:51.301056 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b0cf05c9-cbbf-4e36-896d-376e38c1096a tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:51.302052 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b0cf05c9-cbbf-4e36-896d-376e38c1096a tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:51.302825 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b0cf05c9-cbbf-4e36-896d-376e38c1096a tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:51.304209 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b0cf05c9-cbbf-4e36-896d-376e38c1096a tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:51.305271 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b0cf05c9-cbbf-4e36-896d-376e38c1096a tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:51.306242 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b0cf05c9-cbbf-4e36-896d-376e38c1096a tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:51.401854 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-b0cf05c9-cbbf-4e36-896d-376e38c1096a tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ddc3cd3c374bacbe5bf5e0877380e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8472b054404c46a99b81aba34d6b9f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:58:51.416698 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-b0cf05c9-cbbf-4e36-896d-376e38c1096a tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] 10.222.0.26 "GET /compute/v2.1/servers/4be597d7-a3dd-44f3-9d17-946635bea8e6" status: 200 len: 1276 microversion: 2.1 time: 0.152858 Oct 08 20:58:51.418429 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 910/1842] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:58:51 2022] GET /compute/v2.1/servers/4be597d7-a3dd-44f3-9d17-946635bea8e6 => generated 1276 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:58:51.436826 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-53a8ec4e-c93e-4bc0-ac1c-4998ba285db3 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:51.439362 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-53a8ec4e-c93e-4bc0-ac1c-4998ba285db3 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] [instance: c9f0e1d2-6f87-485d-bff6-0ea83899b705] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:58:51.460630 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-53a8ec4e-c93e-4bc0-ac1c-4998ba285db3 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:51.464095 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-53a8ec4e-c93e-4bc0-ac1c-4998ba285db3 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:51.465261 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-53a8ec4e-c93e-4bc0-ac1c-4998ba285db3 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:51.467882 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-53a8ec4e-c93e-4bc0-ac1c-4998ba285db3 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:51.468612 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-53a8ec4e-c93e-4bc0-ac1c-4998ba285db3 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:51.469407 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-53a8ec4e-c93e-4bc0-ac1c-4998ba285db3 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:51.684899 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-eba9b756-d599-4551-9ffa-d1bf116321ff tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:51.685577 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-eba9b756-d599-4551-9ffa-d1bf116321ff tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] [instance: e5389d1b-b9f3-491a-898c-be611599d73a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:58:51.701933 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-eba9b756-d599-4551-9ffa-d1bf116321ff tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:51.706148 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-eba9b756-d599-4551-9ffa-d1bf116321ff tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:51.707819 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-eba9b756-d599-4551-9ffa-d1bf116321ff tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:51.708880 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-eba9b756-d599-4551-9ffa-d1bf116321ff tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:51.710575 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-eba9b756-d599-4551-9ffa-d1bf116321ff tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:51.712432 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-eba9b756-d599-4551-9ffa-d1bf116321ff tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:51.741071 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-eba9b756-d599-4551-9ffa-d1bf116321ff tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] HTTP exception thrown: Instance e5389d1b-b9f3-491a-898c-be611599d73a could not be found. Oct 08 20:58:51.744358 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-eba9b756-d599-4551-9ffa-d1bf116321ff tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Request method failure captured: Oct 08 20:58:51.744358 ncdv-master-1 devstack@n-api.service[140491]: request: GET /compute/v2.1/servers/e5389d1b-b9f3-491a-898c-be611599d73a HTTP/1.1 Oct 08 20:58:51.744358 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 20:58:51.744358 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 20:58:51.744358 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 20:58:51.744358 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 20:58:51.744358 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 20:58:51.744358 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 20:58:51.744358 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 20:58:51.744358 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 20:58:51.744358 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeQ8NjEuQ_Pp_CiuEVAq-xrklO-U05v38vLCcOPbuY6HkRtR5tyzpCEXEEaBf1j6rtQjz5goeZXICNMl4C1s_9n2QO_h2pJzZyg63Bqh-SQF_3cmCgSmDwD8hDAgy64C7vhlvNe30Dm27VInQQf1vQbK4Cw0Tb8EFN4B2Tl5I-QSfAE Oct 08 20:58:51.744358 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 20:58:51.744358 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 20:58:51.744358 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 20:58:51.744358 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 20:58:51.744358 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 20:58:51.744358 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 20:58:51.744358 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 6c97b3b7fa484f97bdf40224f7cc34d4 Oct 08 20:58:51.744358 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-1802246321 Oct 08 20:58:51.744358 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 20:58:51.744358 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 20:58:51.744358 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6c97b3b7fa484f97bdf40224f7cc34d4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6c97b3b7fa484f97bdf40224f7cc34d4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6c97b3b7fa484f97bdf40224f7cc34d4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6c97b3b7fa484f97bdf40224f7cc34d4"}]}] Oct 08 20:58:51.744358 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-1802246321 Oct 08 20:58:51.744358 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 6c97b3b7fa484f97bdf40224f7cc34d4 Oct 08 20:58:51.744358 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-1802246321 Oct 08 20:58:51.744358 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-ServerRescueTestJSONUnderV235-1802246321-project Oct 08 20:58:51.744358 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 20:58:51.744358 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 20:58:51.744358 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 01ec70849cfa44368a91df8b3410aba8 Oct 08 20:58:51.744358 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-1802246321-project Oct 08 20:58:51.744358 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 20:58:51.744358 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance e5389d1b-b9f3-491a-898c-be611599d73a could not be found. Oct 08 20:58:51.744358 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': 'e5389d1b-b9f3-491a-898c-be611599d73a'} Oct 08 20:58:51.744358 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:58:51.744358 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:58:51.744358 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 20:58:51.744358 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 20:58:51.744358 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 20:58:51.744358 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 20:58:51.744358 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 20:58:51.744358 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 20:58:51.744358 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 20:58:51.744358 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 20:58:51.744358 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5389d1b-b9f3-491a-898c-be611599d73a could not be found. Oct 08 20:58:51.744358 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:58:51.744358 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:58:51.744358 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:58:51.744358 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:58:51.744358 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:58:51.744358 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:58:51.744358 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:58:51.744358 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:58:51.744358 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:58:51.744358 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:58:51.744358 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 20:58:51.744358 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 20:58:51.744358 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 20:58:51.744358 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 20:58:51.744358 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 20:58:51.744358 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 20:58:51.744358 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5389d1b-b9f3-491a-898c-be611599d73a could not be found. Oct 08 20:58:51.744358 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:58:51.744358 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:58:51.752982 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:58:51.752982 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:58:51.752982 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:58:51.752982 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:58:51.752982 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 20:58:51.752982 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 20:58:51.752982 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5389d1b-b9f3-491a-898c-be611599d73a could not be found. Oct 08 20:58:51.752982 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:58:51.755329 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-eba9b756-d599-4551-9ffa-d1bf116321ff tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] Returning 404 to user: Instance e5389d1b-b9f3-491a-898c-be611599d73a could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:58:51.757155 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-eba9b756-d599-4551-9ffa-d1bf116321ff tempest-ServerRescueTestJSONUnderV235-1802246321 tempest-ServerRescueTestJSONUnderV235-1802246321-project] 10.222.0.26 "GET /compute/v2.1/servers/e5389d1b-b9f3-491a-898c-be611599d73a" status: 404 len: 111 microversion: 2.1 time: 0.076981 Oct 08 20:58:51.758340 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 911/1843] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:58:51 2022] GET /compute/v2.1/servers/e5389d1b-b9f3-491a-898c-be611599d73a => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 20:58:51.798644 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c0c2b384-40d3-4029-bc58-1261996508c5 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Calling method '.version_select at 0x7f1a9133c700>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:51.867468 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-c0c2b384-40d3-4029-bc58-1261996508c5 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] 10.222.0.26 "GET /compute/v2.1/images/fa97ce22-1af3-4366-9d57-84040c24f915" status: 200 len: 1424 microversion: 2.1 time: 0.078778 Oct 08 20:58:51.868723 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 912/1844] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:58:51 2022] GET /compute/v2.1/images/fa97ce22-1af3-4366-9d57-84040c24f915 => generated 1424 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:58:52.450034 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-42760f53-bacb-4d64-9004-0186514b84c0 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:52.451373 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-42760f53-bacb-4d64-9004-0186514b84c0 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] [instance: 4be597d7-a3dd-44f3-9d17-946635bea8e6] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:58:52.471445 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-42760f53-bacb-4d64-9004-0186514b84c0 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:52.472384 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-42760f53-bacb-4d64-9004-0186514b84c0 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:52.484527 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-53a8ec4e-c93e-4bc0-ac1c-4998ba285db3 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d96135705514061bef9306753143357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82999f8bc36455bafd8eed23c68e733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:58:52.492246 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-42760f53-bacb-4d64-9004-0186514b84c0 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:52.495246 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-42760f53-bacb-4d64-9004-0186514b84c0 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:52.496404 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-42760f53-bacb-4d64-9004-0186514b84c0 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:52.498462 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-42760f53-bacb-4d64-9004-0186514b84c0 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:52.506849 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-53a8ec4e-c93e-4bc0-ac1c-4998ba285db3 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] 10.222.0.26 "GET /compute/v2.1/servers/c9f0e1d2-6f87-485d-bff6-0ea83899b705" status: 200 len: 1294 microversion: 2.1 time: 1.092733 Oct 08 20:58:52.513737 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 933/1845] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:58:51 2022] GET /compute/v2.1/servers/c9f0e1d2-6f87-485d-bff6-0ea83899b705 => generated 1294 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 20:58:52.636086 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-42760f53-bacb-4d64-9004-0186514b84c0 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ddc3cd3c374bacbe5bf5e0877380e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8472b054404c46a99b81aba34d6b9f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:58:52.648139 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-42760f53-bacb-4d64-9004-0186514b84c0 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] 10.222.0.26 "GET /compute/v2.1/servers/4be597d7-a3dd-44f3-9d17-946635bea8e6" status: 200 len: 1276 microversion: 2.1 time: 0.205778 Oct 08 20:58:52.649606 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 913/1846] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:58:52 2022] GET /compute/v2.1/servers/4be597d7-a3dd-44f3-9d17-946635bea8e6 => generated 1276 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 20:58:52.886993 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-df0fce3d-e8bc-4622-b1b1-d7bef02722da tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Calling method '.version_select at 0x7f1a8c16aca0>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:52.998231 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-df0fce3d-e8bc-4622-b1b1-d7bef02722da tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] 10.222.0.26 "GET /compute/v2.1/images/fa97ce22-1af3-4366-9d57-84040c24f915" status: 200 len: 1424 microversion: 2.1 time: 0.117970 Oct 08 20:58:53.000673 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 934/1847] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:58:52 2022] GET /compute/v2.1/images/fa97ce22-1af3-4366-9d57-84040c24f915 => generated 1424 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:58:53.537376 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-b230f148-bff3-411f-90bd-017200e637b7 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:53.538932 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-b230f148-bff3-411f-90bd-017200e637b7 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] [instance: c9f0e1d2-6f87-485d-bff6-0ea83899b705] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:58:53.557707 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b230f148-bff3-411f-90bd-017200e637b7 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:53.561281 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b230f148-bff3-411f-90bd-017200e637b7 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:53.571580 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b230f148-bff3-411f-90bd-017200e637b7 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:53.572651 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b230f148-bff3-411f-90bd-017200e637b7 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:53.573346 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b230f148-bff3-411f-90bd-017200e637b7 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:53.573978 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b230f148-bff3-411f-90bd-017200e637b7 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:53.676656 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-bc64ac87-a8a2-44d9-9c20-ab17b5bb3775 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:53.678059 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-bc64ac87-a8a2-44d9-9c20-ab17b5bb3775 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] [instance: 4be597d7-a3dd-44f3-9d17-946635bea8e6] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:58:53.693262 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bc64ac87-a8a2-44d9-9c20-ab17b5bb3775 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:53.695775 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bc64ac87-a8a2-44d9-9c20-ab17b5bb3775 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:53.696538 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bc64ac87-a8a2-44d9-9c20-ab17b5bb3775 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:53.698570 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bc64ac87-a8a2-44d9-9c20-ab17b5bb3775 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:53.700356 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bc64ac87-a8a2-44d9-9c20-ab17b5bb3775 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:53.701004 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bc64ac87-a8a2-44d9-9c20-ab17b5bb3775 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:54.192145 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-bc64ac87-a8a2-44d9-9c20-ab17b5bb3775 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ddc3cd3c374bacbe5bf5e0877380e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8472b054404c46a99b81aba34d6b9f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:58:54.201167 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-bc64ac87-a8a2-44d9-9c20-ab17b5bb3775 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] 10.222.0.26 "GET /compute/v2.1/servers/4be597d7-a3dd-44f3-9d17-946635bea8e6" status: 200 len: 1276 microversion: 2.1 time: 0.529709 Oct 08 20:58:54.217151 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 935/1848] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:58:53 2022] GET /compute/v2.1/servers/4be597d7-a3dd-44f3-9d17-946635bea8e6 => generated 1276 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:58:54.228704 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-c4407c20-37cd-447f-9081-a6e0d1603cb9 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Calling method '.version_select at 0x7f1a8c15f8b0>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:54.301181 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-b230f148-bff3-411f-90bd-017200e637b7 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d96135705514061bef9306753143357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82999f8bc36455bafd8eed23c68e733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:58:54.322405 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-b230f148-bff3-411f-90bd-017200e637b7 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] 10.222.0.26 "GET /compute/v2.1/servers/c9f0e1d2-6f87-485d-bff6-0ea83899b705" status: 200 len: 1294 microversion: 2.1 time: 0.786289 Oct 08 20:58:54.323148 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 914/1849] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:58:53 2022] GET /compute/v2.1/servers/c9f0e1d2-6f87-485d-bff6-0ea83899b705 => generated 1294 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:58:54.378015 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=10 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:58:54.394999 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-c4407c20-37cd-447f-9081-a6e0d1603cb9 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] 10.222.0.26 "GET /compute/v2.1/images/fa97ce22-1af3-4366-9d57-84040c24f915" status: 200 len: 1424 microversion: 2.1 time: 0.180360 Oct 08 20:58:54.403503 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 936/1850] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:58:54 2022] GET /compute/v2.1/images/fa97ce22-1af3-4366-9d57-84040c24f915 => generated 1424 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:58:55.225234 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-fe1f6dc2-264a-434c-96f6-5710f92369f1 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:55.225823 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-fe1f6dc2-264a-434c-96f6-5710f92369f1 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] [instance: 4be597d7-a3dd-44f3-9d17-946635bea8e6] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:58:55.243469 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fe1f6dc2-264a-434c-96f6-5710f92369f1 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:55.248424 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fe1f6dc2-264a-434c-96f6-5710f92369f1 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:55.249829 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fe1f6dc2-264a-434c-96f6-5710f92369f1 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:55.251634 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fe1f6dc2-264a-434c-96f6-5710f92369f1 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:55.252135 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fe1f6dc2-264a-434c-96f6-5710f92369f1 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:55.256756 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fe1f6dc2-264a-434c-96f6-5710f92369f1 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:55.355545 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-29bf3561-2362-4d79-be8d-f7d1f54a2535 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:55.356261 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-29bf3561-2362-4d79-be8d-f7d1f54a2535 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] [instance: c9f0e1d2-6f87-485d-bff6-0ea83899b705] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:58:55.382716 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-29bf3561-2362-4d79-be8d-f7d1f54a2535 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:55.384729 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-29bf3561-2362-4d79-be8d-f7d1f54a2535 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:55.385450 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-29bf3561-2362-4d79-be8d-f7d1f54a2535 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:55.387563 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-29bf3561-2362-4d79-be8d-f7d1f54a2535 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:55.389385 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-29bf3561-2362-4d79-be8d-f7d1f54a2535 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:55.392894 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-29bf3561-2362-4d79-be8d-f7d1f54a2535 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:55.923335 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-29bf3561-2362-4d79-be8d-f7d1f54a2535 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d96135705514061bef9306753143357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82999f8bc36455bafd8eed23c68e733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:58:55.938214 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-29bf3561-2362-4d79-be8d-f7d1f54a2535 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] 10.222.0.26 "GET /compute/v2.1/servers/c9f0e1d2-6f87-485d-bff6-0ea83899b705" status: 200 len: 1294 microversion: 2.1 time: 0.587611 Oct 08 20:58:55.939851 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 937/1851] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:58:55 2022] GET /compute/v2.1/servers/c9f0e1d2-6f87-485d-bff6-0ea83899b705 => generated 1294 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:58:55.943617 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=8 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:58:55.954085 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-ba9d12f7-ebb4-40be-b5cb-345a18587b35 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Calling method '.version_select at 0x7f1a8c15f5e0>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:56.034979 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-ba9d12f7-ebb4-40be-b5cb-345a18587b35 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] 10.222.0.26 "GET /compute/v2.1/images/fa97ce22-1af3-4366-9d57-84040c24f915" status: 200 len: 1424 microversion: 2.1 time: 0.093809 Oct 08 20:58:56.035568 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 938/1852] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:58:55 2022] GET /compute/v2.1/images/fa97ce22-1af3-4366-9d57-84040c24f915 => generated 1424 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:58:56.622501 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-fe1f6dc2-264a-434c-96f6-5710f92369f1 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ddc3cd3c374bacbe5bf5e0877380e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8472b054404c46a99b81aba34d6b9f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:58:56.642667 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-fe1f6dc2-264a-434c-96f6-5710f92369f1 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] 10.222.0.26 "GET /compute/v2.1/servers/4be597d7-a3dd-44f3-9d17-946635bea8e6" status: 200 len: 1318 microversion: 2.1 time: 1.421893 Oct 08 20:58:56.669766 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 915/1853] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:58:55 2022] GET /compute/v2.1/servers/4be597d7-a3dd-44f3-9d17-946635bea8e6 => generated 1318 bytes in 1450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:58:56.964194 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=4 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:58:56.970962 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-3e4f0f6e-b40d-489d-bc82-e520d3ca9613 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:56.971861 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-3e4f0f6e-b40d-489d-bc82-e520d3ca9613 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] [instance: c9f0e1d2-6f87-485d-bff6-0ea83899b705] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:58:57.002068 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3e4f0f6e-b40d-489d-bc82-e520d3ca9613 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:57.007848 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3e4f0f6e-b40d-489d-bc82-e520d3ca9613 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:57.011057 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3e4f0f6e-b40d-489d-bc82-e520d3ca9613 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:57.012187 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3e4f0f6e-b40d-489d-bc82-e520d3ca9613 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:57.015210 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3e4f0f6e-b40d-489d-bc82-e520d3ca9613 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:57.017962 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3e4f0f6e-b40d-489d-bc82-e520d3ca9613 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:57.053580 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-aec9e4ae-ec9f-477f-89a5-6e9d4291a71d tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Calling method '.version_select at 0x7f1a9133ce50>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:57.129483 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-aec9e4ae-ec9f-477f-89a5-6e9d4291a71d tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] 10.222.0.26 "GET /compute/v2.1/images/fa97ce22-1af3-4366-9d57-84040c24f915" status: 200 len: 1424 microversion: 2.1 time: 0.081244 Oct 08 20:58:57.131073 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 916/1854] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:58:57 2022] GET /compute/v2.1/images/fa97ce22-1af3-4366-9d57-84040c24f915 => generated 1424 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:58:57.674614 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=42 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:58:57.679191 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c24c2dda-40c2-4e8f-8eb6-c03ddf7c220b tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:57.679800 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-c24c2dda-40c2-4e8f-8eb6-c03ddf7c220b tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] [instance: 4be597d7-a3dd-44f3-9d17-946635bea8e6] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:58:57.712309 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c24c2dda-40c2-4e8f-8eb6-c03ddf7c220b tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:57.712309 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c24c2dda-40c2-4e8f-8eb6-c03ddf7c220b tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:57.712772 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c24c2dda-40c2-4e8f-8eb6-c03ddf7c220b tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:57.713866 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c24c2dda-40c2-4e8f-8eb6-c03ddf7c220b tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:57.714909 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c24c2dda-40c2-4e8f-8eb6-c03ddf7c220b tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:57.715735 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c24c2dda-40c2-4e8f-8eb6-c03ddf7c220b tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:57.723049 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=100 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:58:58.494552 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-3e4f0f6e-b40d-489d-bc82-e520d3ca9613 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d96135705514061bef9306753143357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82999f8bc36455bafd8eed23c68e733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:58:58.508252 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-3e4f0f6e-b40d-489d-bc82-e520d3ca9613 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] 10.222.0.26 "GET /compute/v2.1/servers/c9f0e1d2-6f87-485d-bff6-0ea83899b705" status: 200 len: 1294 microversion: 2.1 time: 1.541229 Oct 08 20:58:58.511808 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 939/1855] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:58:56 2022] GET /compute/v2.1/servers/c9f0e1d2-6f87-485d-bff6-0ea83899b705 => generated 1294 bytes in 1550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:58:58.533872 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-df81972d-36b1-41db-aa83-83ecd4600099 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Calling method '.version_select at 0x7f1a8c09fe50>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:58.673033 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-df81972d-36b1-41db-aa83-83ecd4600099 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] 10.222.0.26 "GET /compute/v2.1/images/fa97ce22-1af3-4366-9d57-84040c24f915" status: 200 len: 1424 microversion: 2.1 time: 0.159791 Oct 08 20:58:58.673819 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 940/1856] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:58:58 2022] GET /compute/v2.1/images/fa97ce22-1af3-4366-9d57-84040c24f915 => generated 1424 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:58:58.703447 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-c24c2dda-40c2-4e8f-8eb6-c03ddf7c220b tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ddc3cd3c374bacbe5bf5e0877380e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8472b054404c46a99b81aba34d6b9f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:58:58.718284 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-c24c2dda-40c2-4e8f-8eb6-c03ddf7c220b tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] 10.222.0.26 "GET /compute/v2.1/servers/4be597d7-a3dd-44f3-9d17-946635bea8e6" status: 200 len: 1318 microversion: 2.1 time: 1.046758 Oct 08 20:58:58.742536 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 917/1857] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:58:57 2022] GET /compute/v2.1/servers/4be597d7-a3dd-44f3-9d17-946635bea8e6 => generated 1318 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:58:59.541617 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-f3872ad7-03e6-4122-9b81-495670451885 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:59.542442 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-f3872ad7-03e6-4122-9b81-495670451885 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] [instance: c9f0e1d2-6f87-485d-bff6-0ea83899b705] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:58:59.559544 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f3872ad7-03e6-4122-9b81-495670451885 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:59.560085 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f3872ad7-03e6-4122-9b81-495670451885 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:59.560617 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f3872ad7-03e6-4122-9b81-495670451885 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:59.561457 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f3872ad7-03e6-4122-9b81-495670451885 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:59.561960 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f3872ad7-03e6-4122-9b81-495670451885 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:59.562395 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f3872ad7-03e6-4122-9b81-495670451885 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:59.691253 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-71763af0-2f57-48fd-a2be-0e4a82d6996e tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Calling method '.version_select at 0x7f1a8ca32670>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:59.794667 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-71763af0-2f57-48fd-a2be-0e4a82d6996e tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] 10.222.0.26 "GET /compute/v2.1/images/fa97ce22-1af3-4366-9d57-84040c24f915" status: 200 len: 1424 microversion: 2.1 time: 0.106004 Oct 08 20:58:59.795934 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 918/1858] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:58:59 2022] GET /compute/v2.1/images/fa97ce22-1af3-4366-9d57-84040c24f915 => generated 1424 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 20:58:59.808816 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-aa7eac77-bf48-4dc4-9f96-6b2292887cbf tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:58:59.809475 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-aa7eac77-bf48-4dc4-9f96-6b2292887cbf tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] [instance: 4be597d7-a3dd-44f3-9d17-946635bea8e6] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:58:59.837723 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-aa7eac77-bf48-4dc4-9f96-6b2292887cbf tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:59.838630 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-aa7eac77-bf48-4dc4-9f96-6b2292887cbf tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:59.839280 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-aa7eac77-bf48-4dc4-9f96-6b2292887cbf tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:58:59.840238 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-aa7eac77-bf48-4dc4-9f96-6b2292887cbf tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:58:59.840882 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-aa7eac77-bf48-4dc4-9f96-6b2292887cbf tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:58:59.848482 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-aa7eac77-bf48-4dc4-9f96-6b2292887cbf tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:00.571422 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-aa7eac77-bf48-4dc4-9f96-6b2292887cbf tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ddc3cd3c374bacbe5bf5e0877380e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8472b054404c46a99b81aba34d6b9f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:59:00.586967 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-aa7eac77-bf48-4dc4-9f96-6b2292887cbf tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] 10.222.0.26 "GET /compute/v2.1/servers/4be597d7-a3dd-44f3-9d17-946635bea8e6" status: 200 len: 1318 microversion: 2.1 time: 0.789922 Oct 08 20:59:00.595950 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 919/1859] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:58:59 2022] GET /compute/v2.1/servers/4be597d7-a3dd-44f3-9d17-946635bea8e6 => generated 1318 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:59:00.613787 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-3339f7ab-431a-46a9-bfc5-55b49bb0cc7d req-f6df2b30-83aa-4db2-8cb5-d48ca772531b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37daee2e-9629-4664-a85d-da2e8aa5ea2e", "tag": "b161e103-83f2-4169-9a06-338706b01d4c"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:59:00.639812 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-3339f7ab-431a-46a9-bfc5-55b49bb0cc7d req-f6df2b30-83aa-4db2-8cb5-d48ca772531b service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:00.640789 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-3339f7ab-431a-46a9-bfc5-55b49bb0cc7d req-f6df2b30-83aa-4db2-8cb5-d48ca772531b service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:00.641577 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-3339f7ab-431a-46a9-bfc5-55b49bb0cc7d req-f6df2b30-83aa-4db2-8cb5-d48ca772531b service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:00.662776 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-3339f7ab-431a-46a9-bfc5-55b49bb0cc7d req-f6df2b30-83aa-4db2-8cb5-d48ca772531b service nova] Creating event network-changed:b161e103-83f2-4169-9a06-338706b01d4c for instance 37daee2e-9629-4664-a85d-da2e8aa5ea2e on nch1-master-1 Oct 08 20:59:00.672157 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-3339f7ab-431a-46a9-bfc5-55b49bb0cc7d req-f6df2b30-83aa-4db2-8cb5-d48ca772531b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074647 Oct 08 20:59:00.676410 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 920/1860] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:59:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:59:00.691863 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-11c13b28-3f8b-4a30-86bd-4926e4d0e9a7 req-77fb1080-a7ab-4089-bdaa-ba9cf47dbedd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9f0e1d2-6f87-485d-bff6-0ea83899b705", "name": "network-vif-plugged", "status": "completed", "tag": "f8af2e56-5b37-4a10-8d70-4486ae942499"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:59:00.705790 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-11c13b28-3f8b-4a30-86bd-4926e4d0e9a7 req-77fb1080-a7ab-4089-bdaa-ba9cf47dbedd service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:00.706775 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-11c13b28-3f8b-4a30-86bd-4926e4d0e9a7 req-77fb1080-a7ab-4089-bdaa-ba9cf47dbedd service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:00.708427 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-11c13b28-3f8b-4a30-86bd-4926e4d0e9a7 req-77fb1080-a7ab-4089-bdaa-ba9cf47dbedd service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:00.731245 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-11c13b28-3f8b-4a30-86bd-4926e4d0e9a7 req-77fb1080-a7ab-4089-bdaa-ba9cf47dbedd service nova] Creating event network-vif-plugged:f8af2e56-5b37-4a10-8d70-4486ae942499 for instance c9f0e1d2-6f87-485d-bff6-0ea83899b705 on nch1-master-1 Oct 08 20:59:00.750328 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-11c13b28-3f8b-4a30-86bd-4926e4d0e9a7 req-77fb1080-a7ab-4089-bdaa-ba9cf47dbedd service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060514 Oct 08 20:59:00.765801 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 921/1861] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:59:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:59:00.810259 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-f3872ad7-03e6-4122-9b81-495670451885 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d96135705514061bef9306753143357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82999f8bc36455bafd8eed23c68e733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:59:00.834984 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-be170ea1-4c39-41ea-ae7e-3d43b3d268f3 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Calling method '.version_select at 0x7f1a913011f0>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:59:00.836078 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-f3872ad7-03e6-4122-9b81-495670451885 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] 10.222.0.26 "GET /compute/v2.1/servers/c9f0e1d2-6f87-485d-bff6-0ea83899b705" status: 200 len: 1294 microversion: 2.1 time: 1.298297 Oct 08 20:59:00.840742 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 941/1862] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:58:59 2022] GET /compute/v2.1/servers/c9f0e1d2-6f87-485d-bff6-0ea83899b705 => generated 1294 bytes in 1305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:59:00.980157 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-be170ea1-4c39-41ea-ae7e-3d43b3d268f3 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] 10.222.0.26 "GET /compute/v2.1/images/fa97ce22-1af3-4366-9d57-84040c24f915" status: 200 len: 1424 microversion: 2.1 time: 0.159746 Oct 08 20:59:00.987079 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 922/1863] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:59:00 2022] GET /compute/v2.1/images/fa97ce22-1af3-4366-9d57-84040c24f915 => generated 1424 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:59:01.625250 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-96ef3c8e-1210-4178-ad22-9721b1c510bc tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:59:01.626223 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-96ef3c8e-1210-4178-ad22-9721b1c510bc tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] [instance: 4be597d7-a3dd-44f3-9d17-946635bea8e6] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:59:01.640584 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-96ef3c8e-1210-4178-ad22-9721b1c510bc tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:01.643092 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-96ef3c8e-1210-4178-ad22-9721b1c510bc tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:01.644015 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-96ef3c8e-1210-4178-ad22-9721b1c510bc tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:01.647429 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-96ef3c8e-1210-4178-ad22-9721b1c510bc tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:01.653887 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-96ef3c8e-1210-4178-ad22-9721b1c510bc tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:01.654800 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-96ef3c8e-1210-4178-ad22-9721b1c510bc tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:01.867399 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-b319b41d-f15a-44a4-be46-c951b2eaf110 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:59:01.869583 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-b319b41d-f15a-44a4-be46-c951b2eaf110 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] [instance: c9f0e1d2-6f87-485d-bff6-0ea83899b705] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:59:01.914117 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b319b41d-f15a-44a4-be46-c951b2eaf110 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:01.914712 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b319b41d-f15a-44a4-be46-c951b2eaf110 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:01.915167 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b319b41d-f15a-44a4-be46-c951b2eaf110 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:01.915898 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b319b41d-f15a-44a4-be46-c951b2eaf110 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:01.916545 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b319b41d-f15a-44a4-be46-c951b2eaf110 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:01.917166 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b319b41d-f15a-44a4-be46-c951b2eaf110 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:02.187292 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-b319b41d-f15a-44a4-be46-c951b2eaf110 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d96135705514061bef9306753143357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82999f8bc36455bafd8eed23c68e733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:59:02.207815 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-b319b41d-f15a-44a4-be46-c951b2eaf110 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] 10.222.0.26 "GET /compute/v2.1/servers/c9f0e1d2-6f87-485d-bff6-0ea83899b705" status: 200 len: 1294 microversion: 2.1 time: 0.343591 Oct 08 20:59:02.229931 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 923/1864] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:59:01 2022] GET /compute/v2.1/servers/c9f0e1d2-6f87-485d-bff6-0ea83899b705 => generated 1294 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 20:59:02.237900 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-bef163d8-292f-46e2-be13-d97acc227cdc tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Calling method '.version_select at 0x7f1a91301670>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:59:02.295934 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-bef163d8-292f-46e2-be13-d97acc227cdc tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] 10.222.0.26 "GET /compute/v2.1/images/fa97ce22-1af3-4366-9d57-84040c24f915" status: 200 len: 1424 microversion: 2.1 time: 0.064429 Oct 08 20:59:02.297180 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 924/1865] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:59:02 2022] GET /compute/v2.1/images/fa97ce22-1af3-4366-9d57-84040c24f915 => generated 1424 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:59:02.947588 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-55f80e2c-6539-4d6a-acdf-f87f4d01c32d req-b27a5338-6bf7-4db0-83ca-07b2db42e12b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4be597d7-a3dd-44f3-9d17-946635bea8e6", "tag": "3fc8d85d-19bc-4dc0-956f-6f21b791d90a"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:59:02.998740 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-55f80e2c-6539-4d6a-acdf-f87f4d01c32d req-b27a5338-6bf7-4db0-83ca-07b2db42e12b service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:02.999246 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-55f80e2c-6539-4d6a-acdf-f87f4d01c32d req-b27a5338-6bf7-4db0-83ca-07b2db42e12b service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:02.999698 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-55f80e2c-6539-4d6a-acdf-f87f4d01c32d req-b27a5338-6bf7-4db0-83ca-07b2db42e12b service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:03.052356 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-55f80e2c-6539-4d6a-acdf-f87f4d01c32d req-b27a5338-6bf7-4db0-83ca-07b2db42e12b service nova] Creating event network-changed:3fc8d85d-19bc-4dc0-956f-6f21b791d90a for instance 4be597d7-a3dd-44f3-9d17-946635bea8e6 on nch2-master-1 Oct 08 20:59:03.060005 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-96ef3c8e-1210-4178-ad22-9721b1c510bc tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ddc3cd3c374bacbe5bf5e0877380e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8472b054404c46a99b81aba34d6b9f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:59:03.076760 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-96ef3c8e-1210-4178-ad22-9721b1c510bc tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] 10.222.0.26 "GET /compute/v2.1/servers/4be597d7-a3dd-44f3-9d17-946635bea8e6" status: 200 len: 1318 microversion: 2.1 time: 1.456448 Oct 08 20:59:03.083971 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-55f80e2c-6539-4d6a-acdf-f87f4d01c32d req-b27a5338-6bf7-4db0-83ca-07b2db42e12b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.135655 Oct 08 20:59:03.087164 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 925/1866] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:59:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:59:03.104040 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 942/1867] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:59:01 2022] GET /compute/v2.1/servers/4be597d7-a3dd-44f3-9d17-946635bea8e6 => generated 1318 bytes in 1484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:59:03.243462 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-68b754c2-30db-4dee-9450-3695498e1fb8 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:59:03.244196 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-68b754c2-30db-4dee-9450-3695498e1fb8 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] [instance: c9f0e1d2-6f87-485d-bff6-0ea83899b705] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:59:03.272758 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-68b754c2-30db-4dee-9450-3695498e1fb8 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:03.279298 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-68b754c2-30db-4dee-9450-3695498e1fb8 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:03.283337 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-68b754c2-30db-4dee-9450-3695498e1fb8 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:03.284771 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-68b754c2-30db-4dee-9450-3695498e1fb8 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:03.292048 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-68b754c2-30db-4dee-9450-3695498e1fb8 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:03.292748 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-68b754c2-30db-4dee-9450-3695498e1fb8 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:03.312041 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-5ae1ba88-02f6-49d9-a1ed-458a41db82fc tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Calling method '.version_select at 0x7f1a8c15f8b0>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:59:03.418878 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-5ae1ba88-02f6-49d9-a1ed-458a41db82fc tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] 10.222.0.26 "GET /compute/v2.1/images/fa97ce22-1af3-4366-9d57-84040c24f915" status: 200 len: 1424 microversion: 2.1 time: 0.110270 Oct 08 20:59:03.420385 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 943/1868] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:59:03 2022] GET /compute/v2.1/images/fa97ce22-1af3-4366-9d57-84040c24f915 => generated 1424 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 20:59:03.920204 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-68b754c2-30db-4dee-9450-3695498e1fb8 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d96135705514061bef9306753143357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82999f8bc36455bafd8eed23c68e733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:59:03.938898 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-68b754c2-30db-4dee-9450-3695498e1fb8 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] 10.222.0.26 "GET /compute/v2.1/servers/c9f0e1d2-6f87-485d-bff6-0ea83899b705" status: 200 len: 1486 microversion: 2.1 time: 0.698322 Oct 08 20:59:03.958321 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 926/1869] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:59:03 2022] GET /compute/v2.1/servers/c9f0e1d2-6f87-485d-bff6-0ea83899b705 => generated 1486 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:59:03.970640 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-75879759-60f8-48b8-9fbc-1a449c738a65 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:59:03.971734 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-75879759-60f8-48b8-9fbc-1a449c738a65 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] [instance: c9f0e1d2-6f87-485d-bff6-0ea83899b705] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:59:03.987330 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-75879759-60f8-48b8-9fbc-1a449c738a65 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:03.989824 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-75879759-60f8-48b8-9fbc-1a449c738a65 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:03.990748 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-75879759-60f8-48b8-9fbc-1a449c738a65 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:03.994557 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-75879759-60f8-48b8-9fbc-1a449c738a65 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:03.995396 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-75879759-60f8-48b8-9fbc-1a449c738a65 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:03.999290 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-75879759-60f8-48b8-9fbc-1a449c738a65 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:04.111317 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-d324c17a-3d6d-4a86-9db2-efd095f98123 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:59:04.112945 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-d324c17a-3d6d-4a86-9db2-efd095f98123 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] [instance: 4be597d7-a3dd-44f3-9d17-946635bea8e6] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:59:04.137048 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d324c17a-3d6d-4a86-9db2-efd095f98123 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:04.141025 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d324c17a-3d6d-4a86-9db2-efd095f98123 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:04.143794 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d324c17a-3d6d-4a86-9db2-efd095f98123 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:04.144667 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d324c17a-3d6d-4a86-9db2-efd095f98123 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:04.147595 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d324c17a-3d6d-4a86-9db2-efd095f98123 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:04.148320 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d324c17a-3d6d-4a86-9db2-efd095f98123 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:04.231689 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-75879759-60f8-48b8-9fbc-1a449c738a65 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] 10.222.0.26 "GET /compute/v2.1/servers/c9f0e1d2-6f87-485d-bff6-0ea83899b705/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.265363 Oct 08 20:59:04.233247 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 944/1870] 10.222.0.26 () {58 vars in 1275 bytes} [Sat Oct 8 20:59:03 2022] GET /compute/v2.1/servers/c9f0e1d2-6f87-485d-bff6-0ea83899b705/os-interface => generated 285 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 08 20:59:04.436458 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-7c1bd474-a84a-44e4-b91d-d1e9869fbff6 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Calling method '.version_select at 0x7f1a8c1bcdc0>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:59:04.542809 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-7c1bd474-a84a-44e4-b91d-d1e9869fbff6 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] 10.222.0.26 "GET /compute/v2.1/images/fa97ce22-1af3-4366-9d57-84040c24f915" status: 200 len: 1424 microversion: 2.1 time: 0.108572 Oct 08 20:59:04.550082 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 945/1871] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:59:04 2022] GET /compute/v2.1/images/fa97ce22-1af3-4366-9d57-84040c24f915 => generated 1424 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:59:04.712765 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-d324c17a-3d6d-4a86-9db2-efd095f98123 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ddc3cd3c374bacbe5bf5e0877380e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8472b054404c46a99b81aba34d6b9f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:59:04.736410 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-d324c17a-3d6d-4a86-9db2-efd095f98123 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] 10.222.0.26 "GET /compute/v2.1/servers/4be597d7-a3dd-44f3-9d17-946635bea8e6" status: 200 len: 1318 microversion: 2.1 time: 0.628668 Oct 08 20:59:04.740555 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 927/1872] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:59:04 2022] GET /compute/v2.1/servers/4be597d7-a3dd-44f3-9d17-946635bea8e6 => generated 1318 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:59:05.563173 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-55f02bfc-43a9-4b32-a6d2-d4057a25bab0 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Calling method '.version_select at 0x7f1a8c1340d0>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:59:05.685073 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-55f02bfc-43a9-4b32-a6d2-d4057a25bab0 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] 10.222.0.26 "GET /compute/v2.1/images/fa97ce22-1af3-4366-9d57-84040c24f915" status: 200 len: 1424 microversion: 2.1 time: 0.128470 Oct 08 20:59:05.696385 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 946/1873] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:59:05 2022] GET /compute/v2.1/images/fa97ce22-1af3-4366-9d57-84040c24f915 => generated 1424 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:59:05.762629 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-973dc36a-0399-4c51-aa25-3e829a0a5e3d tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:59:05.763412 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-973dc36a-0399-4c51-aa25-3e829a0a5e3d tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] [instance: 4be597d7-a3dd-44f3-9d17-946635bea8e6] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:59:05.797313 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-973dc36a-0399-4c51-aa25-3e829a0a5e3d tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:05.798457 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-973dc36a-0399-4c51-aa25-3e829a0a5e3d tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:05.798985 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-973dc36a-0399-4c51-aa25-3e829a0a5e3d tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:05.799806 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-973dc36a-0399-4c51-aa25-3e829a0a5e3d tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:05.803752 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-973dc36a-0399-4c51-aa25-3e829a0a5e3d tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:05.811289 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-973dc36a-0399-4c51-aa25-3e829a0a5e3d tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:06.380588 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-973dc36a-0399-4c51-aa25-3e829a0a5e3d tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ddc3cd3c374bacbe5bf5e0877380e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8472b054404c46a99b81aba34d6b9f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:59:06.394169 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-973dc36a-0399-4c51-aa25-3e829a0a5e3d tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] 10.222.0.26 "GET /compute/v2.1/servers/4be597d7-a3dd-44f3-9d17-946635bea8e6" status: 200 len: 1318 microversion: 2.1 time: 0.636058 Oct 08 20:59:06.394871 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 928/1874] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:59:05 2022] GET /compute/v2.1/servers/4be597d7-a3dd-44f3-9d17-946635bea8e6 => generated 1318 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:59:06.705360 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-55969f58-49b2-4ba4-b5de-6c66c5d8fc76 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Calling method '.version_select at 0x7f1a8c134040>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:59:06.802280 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-55969f58-49b2-4ba4-b5de-6c66c5d8fc76 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] 10.222.0.26 "GET /compute/v2.1/images/fa97ce22-1af3-4366-9d57-84040c24f915" status: 200 len: 1424 microversion: 2.1 time: 0.102270 Oct 08 20:59:06.803324 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 947/1875] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:59:06 2022] GET /compute/v2.1/images/fa97ce22-1af3-4366-9d57-84040c24f915 => generated 1424 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 20:59:07.419038 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-2e1ef037-c252-4f55-a331-84a223ae26b0 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:59:07.419653 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-2e1ef037-c252-4f55-a331-84a223ae26b0 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] [instance: 4be597d7-a3dd-44f3-9d17-946635bea8e6] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:59:07.436119 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2e1ef037-c252-4f55-a331-84a223ae26b0 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:07.437661 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2e1ef037-c252-4f55-a331-84a223ae26b0 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:07.445251 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2e1ef037-c252-4f55-a331-84a223ae26b0 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:07.446107 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2e1ef037-c252-4f55-a331-84a223ae26b0 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:07.446601 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2e1ef037-c252-4f55-a331-84a223ae26b0 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:07.447199 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2e1ef037-c252-4f55-a331-84a223ae26b0 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:07.821543 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-76cd1b99-72af-452b-8b70-63dbecbd3232 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Calling method '.version_select at 0x7f1a8c15fb80>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:59:07.954859 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-76cd1b99-72af-452b-8b70-63dbecbd3232 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] 10.222.0.26 "GET /compute/v2.1/images/fa97ce22-1af3-4366-9d57-84040c24f915" status: 200 len: 1424 microversion: 2.1 time: 0.139003 Oct 08 20:59:07.956785 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 948/1876] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:59:07 2022] GET /compute/v2.1/images/fa97ce22-1af3-4366-9d57-84040c24f915 => generated 1424 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:59:07.965563 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-2e1ef037-c252-4f55-a331-84a223ae26b0 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ddc3cd3c374bacbe5bf5e0877380e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8472b054404c46a99b81aba34d6b9f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:59:07.976272 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-2e1ef037-c252-4f55-a331-84a223ae26b0 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] 10.222.0.26 "GET /compute/v2.1/servers/4be597d7-a3dd-44f3-9d17-946635bea8e6" status: 200 len: 1318 microversion: 2.1 time: 0.561827 Oct 08 20:59:07.976882 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 929/1877] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:59:07 2022] GET /compute/v2.1/servers/4be597d7-a3dd-44f3-9d17-946635bea8e6 => generated 1318 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:59:08.520162 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-362c236d-bcfb-4f36-aed7-53a23cd62f8f req-185aadc2-c3f1-4af4-89e2-242cb6dc4345 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37daee2e-9629-4664-a85d-da2e8aa5ea2e", "name": "network-vif-plugged", "status": "completed", "tag": "b161e103-83f2-4169-9a06-338706b01d4c"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:59:08.565631 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-362c236d-bcfb-4f36-aed7-53a23cd62f8f req-185aadc2-c3f1-4af4-89e2-242cb6dc4345 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:08.568426 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-362c236d-bcfb-4f36-aed7-53a23cd62f8f req-185aadc2-c3f1-4af4-89e2-242cb6dc4345 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:08.568896 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-362c236d-bcfb-4f36-aed7-53a23cd62f8f req-185aadc2-c3f1-4af4-89e2-242cb6dc4345 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:08.606535 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-362c236d-bcfb-4f36-aed7-53a23cd62f8f req-185aadc2-c3f1-4af4-89e2-242cb6dc4345 service nova] Creating event network-vif-plugged:b161e103-83f2-4169-9a06-338706b01d4c for instance 37daee2e-9629-4664-a85d-da2e8aa5ea2e on nch1-master-1 Oct 08 20:59:08.631598 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-362c236d-bcfb-4f36-aed7-53a23cd62f8f req-185aadc2-c3f1-4af4-89e2-242cb6dc4345 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110012 Oct 08 20:59:08.633063 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 949/1878] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:59:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:59:08.971574 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-efbb54fb-7c42-4e32-9c42-7d5b0c75e027 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Calling method '.version_select at 0x7f1a914ccca0>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:59:09.015233 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-49634d2f-e6c3-45d1-8ee8-7938c34c27fb tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:59:09.016706 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-49634d2f-e6c3-45d1-8ee8-7938c34c27fb tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] [instance: 4be597d7-a3dd-44f3-9d17-946635bea8e6] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:59:09.042468 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-49634d2f-e6c3-45d1-8ee8-7938c34c27fb tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:09.044642 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-49634d2f-e6c3-45d1-8ee8-7938c34c27fb tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:09.046898 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-49634d2f-e6c3-45d1-8ee8-7938c34c27fb tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:09.050251 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-49634d2f-e6c3-45d1-8ee8-7938c34c27fb tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:09.052726 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-49634d2f-e6c3-45d1-8ee8-7938c34c27fb tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:09.053256 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-49634d2f-e6c3-45d1-8ee8-7938c34c27fb tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:09.055689 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-efbb54fb-7c42-4e32-9c42-7d5b0c75e027 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] 10.222.0.26 "GET /compute/v2.1/images/fa97ce22-1af3-4366-9d57-84040c24f915" status: 200 len: 1424 microversion: 2.1 time: 0.088789 Oct 08 20:59:09.062549 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 930/1879] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:59:08 2022] GET /compute/v2.1/images/fa97ce22-1af3-4366-9d57-84040c24f915 => generated 1424 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:59:10.001161 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-49634d2f-e6c3-45d1-8ee8-7938c34c27fb tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ddc3cd3c374bacbe5bf5e0877380e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8472b054404c46a99b81aba34d6b9f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:59:10.018635 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-49634d2f-e6c3-45d1-8ee8-7938c34c27fb tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] 10.222.0.26 "GET /compute/v2.1/servers/4be597d7-a3dd-44f3-9d17-946635bea8e6" status: 200 len: 1318 microversion: 2.1 time: 1.010371 Oct 08 20:59:10.033649 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 950/1880] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:59:09 2022] GET /compute/v2.1/servers/4be597d7-a3dd-44f3-9d17-946635bea8e6 => generated 1318 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:59:10.073480 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-0fa2a30a-77ed-4861-ab49-eb1731d561c5 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Calling method '.version_select at 0x7f1a91301430>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:59:10.123203 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-0fa2a30a-77ed-4861-ab49-eb1731d561c5 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] 10.222.0.26 "GET /compute/v2.1/images/fa97ce22-1af3-4366-9d57-84040c24f915" status: 200 len: 1433 microversion: 2.1 time: 0.055069 Oct 08 20:59:10.124469 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 931/1881] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:59:10 2022] GET /compute/v2.1/images/fa97ce22-1af3-4366-9d57-84040c24f915 => generated 1433 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:59:10.145698 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-cfc5b06a-6d37-42bc-8dfd-b05382f147df tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Calling method '.version_select at 0x7f1a8c15f550>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:59:10.229244 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-cfc5b06a-6d37-42bc-8dfd-b05382f147df tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] 10.222.0.26 "GET /compute/v2.1/images/fa97ce22-1af3-4366-9d57-84040c24f915" status: 200 len: 1433 microversion: 2.1 time: 0.091860 Oct 08 20:59:10.229897 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 951/1882] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 20:59:10 2022] GET /compute/v2.1/images/fa97ce22-1af3-4366-9d57-84040c24f915 => generated 1433 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:59:10.245264 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-fdeaf51a-14f4-4a87-8c1a-05c8de25d807 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:59:10.246260 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-fdeaf51a-14f4-4a87-8c1a-05c8de25d807 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] [instance: 19327d3e-de51-432b-b594-cb9a1bfe2f49] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:59:10.256914 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fdeaf51a-14f4-4a87-8c1a-05c8de25d807 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:10.257895 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fdeaf51a-14f4-4a87-8c1a-05c8de25d807 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:10.258571 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fdeaf51a-14f4-4a87-8c1a-05c8de25d807 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:10.259553 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fdeaf51a-14f4-4a87-8c1a-05c8de25d807 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:10.260379 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fdeaf51a-14f4-4a87-8c1a-05c8de25d807 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:10.260976 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fdeaf51a-14f4-4a87-8c1a-05c8de25d807 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:10.627632 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-fdeaf51a-14f4-4a87-8c1a-05c8de25d807 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322606d4cb0f45d3ac2eceab4999d45b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24a29bd6efb40609e31fbb6dba839e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:59:10.642027 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-fdeaf51a-14f4-4a87-8c1a-05c8de25d807 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] 10.222.0.26 "GET /compute/v2.1/servers/19327d3e-de51-432b-b594-cb9a1bfe2f49" status: 200 len: 1467 microversion: 2.1 time: 0.399351 Oct 08 20:59:10.668522 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 932/1883] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:59:10 2022] GET /compute/v2.1/servers/19327d3e-de51-432b-b594-cb9a1bfe2f49 => generated 1467 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:59:10.669546 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-8972d001-57f5-470e-a4b9-3177f33939c6 req-3a763613-db3b-4ef0-919d-9c77541012cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4be597d7-a3dd-44f3-9d17-946635bea8e6", "name": "network-vif-plugged", "status": "completed", "tag": "3fc8d85d-19bc-4dc0-956f-6f21b791d90a"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:59:10.678256 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-7f8b12ee-c4c9-4b32-8925-4326bac5b031 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Calling method '.version_select at 0x7f1a914cc820>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:59:10.694928 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-8972d001-57f5-470e-a4b9-3177f33939c6 req-3a763613-db3b-4ef0-919d-9c77541012cd service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:10.695593 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-8972d001-57f5-470e-a4b9-3177f33939c6 req-3a763613-db3b-4ef0-919d-9c77541012cd service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:10.695950 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-8972d001-57f5-470e-a4b9-3177f33939c6 req-3a763613-db3b-4ef0-919d-9c77541012cd service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:10.727665 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-8972d001-57f5-470e-a4b9-3177f33939c6 req-3a763613-db3b-4ef0-919d-9c77541012cd service nova] Creating event network-vif-plugged:3fc8d85d-19bc-4dc0-956f-6f21b791d90a for instance 4be597d7-a3dd-44f3-9d17-946635bea8e6 on nch2-master-1 Oct 08 20:59:10.745623 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-8972d001-57f5-470e-a4b9-3177f33939c6 req-3a763613-db3b-4ef0-919d-9c77541012cd service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080779 Oct 08 20:59:10.747968 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 952/1884] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:59:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:59:11.056539 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-5230182e-c48e-4073-b90d-76573878ba41 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:59:11.057761 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-5230182e-c48e-4073-b90d-76573878ba41 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] [instance: 4be597d7-a3dd-44f3-9d17-946635bea8e6] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:59:11.088999 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5230182e-c48e-4073-b90d-76573878ba41 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:11.102271 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5230182e-c48e-4073-b90d-76573878ba41 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:11.104078 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5230182e-c48e-4073-b90d-76573878ba41 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:11.109306 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5230182e-c48e-4073-b90d-76573878ba41 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:11.112403 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5230182e-c48e-4073-b90d-76573878ba41 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:11.112969 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5230182e-c48e-4073-b90d-76573878ba41 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:11.649215 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-5230182e-c48e-4073-b90d-76573878ba41 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ddc3cd3c374bacbe5bf5e0877380e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8472b054404c46a99b81aba34d6b9f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:59:11.658284 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-5230182e-c48e-4073-b90d-76573878ba41 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] 10.222.0.26 "GET /compute/v2.1/servers/4be597d7-a3dd-44f3-9d17-946635bea8e6" status: 200 len: 1318 microversion: 2.1 time: 0.611174 Oct 08 20:59:11.659124 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 953/1885] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:59:11 2022] GET /compute/v2.1/servers/4be597d7-a3dd-44f3-9d17-946635bea8e6 => generated 1318 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:59:11.677923 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-fc29c377-383c-483c-af53-eab7ad2cf358 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:59:11.682929 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-fc29c377-383c-483c-af53-eab7ad2cf358 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] [instance: c9f0e1d2-6f87-485d-bff6-0ea83899b705] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:59:11.714336 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fc29c377-383c-483c-af53-eab7ad2cf358 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:11.739023 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fc29c377-383c-483c-af53-eab7ad2cf358 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:11.740095 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fc29c377-383c-483c-af53-eab7ad2cf358 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:11.743519 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fc29c377-383c-483c-af53-eab7ad2cf358 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:11.753756 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fc29c377-383c-483c-af53-eab7ad2cf358 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:11.755534 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fc29c377-383c-483c-af53-eab7ad2cf358 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:11.842215 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=100 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:59:11.869490 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-7f8b12ee-c4c9-4b32-8925-4326bac5b031 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] 10.222.0.26 "DELETE /compute/v2.1/images/fa97ce22-1af3-4366-9d57-84040c24f915" status: 204 len: 0 microversion: 2.1 time: 1.195258 Oct 08 20:59:11.870442 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 933/1886] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:59:10 2022] DELETE /compute/v2.1/images/fa97ce22-1af3-4366-9d57-84040c24f915 => generated 0 bytes in 1197 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 08 20:59:11.881174 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-0c17072c-b91a-480f-9e24-17a982314441 req-a39c08dd-413a-465c-af5c-8f101c9b3446 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9f0e1d2-6f87-485d-bff6-0ea83899b705", "tag": "f8af2e56-5b37-4a10-8d70-4486ae942499"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:59:11.910218 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-0c17072c-b91a-480f-9e24-17a982314441 req-a39c08dd-413a-465c-af5c-8f101c9b3446 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:11.912872 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-0c17072c-b91a-480f-9e24-17a982314441 req-a39c08dd-413a-465c-af5c-8f101c9b3446 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:11.913566 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-0c17072c-b91a-480f-9e24-17a982314441 req-a39c08dd-413a-465c-af5c-8f101c9b3446 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:11.937242 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-0c17072c-b91a-480f-9e24-17a982314441 req-a39c08dd-413a-465c-af5c-8f101c9b3446 service nova] Creating event network-changed:f8af2e56-5b37-4a10-8d70-4486ae942499 for instance c9f0e1d2-6f87-485d-bff6-0ea83899b705 on nch1-master-1 Oct 08 20:59:11.943903 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-0c17072c-b91a-480f-9e24-17a982314441 req-a39c08dd-413a-465c-af5c-8f101c9b3446 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068287 Oct 08 20:59:11.945170 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 934/1887] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:59:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:59:11.950947 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-914eb409-b626-4410-bd7f-1b7e2205482c tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Calling method '.version_select at 0x7f1a8c778700>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:59:11.988001 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-914eb409-b626-4410-bd7f-1b7e2205482c tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] HTTP exception thrown: Image not found. Oct 08 20:59:11.990255 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-914eb409-b626-4410-bd7f-1b7e2205482c tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Request method failure captured: Oct 08 20:59:11.990255 ncdv-master-1 devstack@n-api.service[140491]: request: DELETE /compute/v2.1/images/51380a40-a52a-46bf-a537-f30ae7be94ef HTTP/1.1 Oct 08 20:59:11.990255 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 20:59:11.990255 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 20:59:11.990255 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 20:59:11.990255 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 20:59:11.990255 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 20:59:11.990255 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 20:59:11.990255 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 20:59:11.990255 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 20:59:11.990255 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeQ8lmuamJgXJSwemYAXatbYzGYxm_vVecG_OkvuOFcfHBi0mwsDPaUy2fuPA0W4Cc63IKn5u45dzTXN2Hrfj_C4JN_oRWkar0MPXmWSzRRvEUZ20-nXU9GxMuOhWBfxj859Yy1sfVnVE5SohziLAPcgHkGVSZftQN4FJxkgA7wmzB4 Oct 08 20:59:11.990255 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 20:59:11.990255 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 20:59:11.990255 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 20:59:11.990255 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 20:59:11.990255 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 20:59:11.990255 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 20:59:11.990255 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: d24a29bd6efb40609e31fbb6dba839e8 Oct 08 20:59:11.990255 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-ImagesOneServerTestJSON-55201698 Oct 08 20:59:11.990255 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 20:59:11.990255 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 20:59:11.990255 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d24a29bd6efb40609e31fbb6dba839e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d24a29bd6efb40609e31fbb6dba839e8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d24a29bd6efb40609e31fbb6dba839e8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d24a29bd6efb40609e31fbb6dba839e8"}]}] Oct 08 20:59:11.990255 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-ImagesOneServerTestJSON-55201698 Oct 08 20:59:11.990255 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: d24a29bd6efb40609e31fbb6dba839e8 Oct 08 20:59:11.990255 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-55201698 Oct 08 20:59:11.990255 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-ImagesOneServerTestJSON-55201698-project Oct 08 20:59:11.990255 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 20:59:11.990255 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 20:59:11.990255 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 322606d4cb0f45d3ac2eceab4999d45b Oct 08 20:59:11.990255 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-ImagesOneServerTestJSON-55201698-project Oct 08 20:59:11.990255 ncdv-master-1 devstack@n-api.service[140491]: method: Oct 08 20:59:11.990255 ncdv-master-1 devstack@n-api.service[140491]: exception: Image not found. Oct 08 20:59:11.990255 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': '51380a40-a52a-46bf-a537-f30ae7be94ef'} Oct 08 20:59:11.990255 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:59:11.990255 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:59:11.990255 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 08 20:59:11.990255 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 08 20:59:11.990255 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 08 20:59:11.990255 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 08 20:59:11.990255 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 08 20:59:11.990255 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 08 20:59:11.990255 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 08 20:59:11.990255 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 08 20:59:11.990255 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 08 20:59:11.990255 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 08 20:59:11.990255 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 08 20:59:11.990255 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 08 20:59:11.990255 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 08 20:59:11.990255 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 08 20:59:11.990255 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 51380a40-a52a-46bf-a537-f30ae7be94ef to delete Oct 08 20:59:11.990255 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:59:11.990255 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:59:11.990255 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:59:11.990255 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:59:11.990255 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 08 20:59:11.990255 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 08 20:59:11.990255 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 08 20:59:11.990255 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 08 20:59:11.990255 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 08 20:59:11.990255 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 08 20:59:11.990255 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 51380a40-a52a-46bf-a537-f30ae7be94ef could not be found. Oct 08 20:59:11.990255 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:59:11.990255 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:59:11.990255 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:59:11.990255 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:59:12.003113 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:59:12.003113 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:59:12.003113 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:59:12.003113 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:59:12.003113 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 08 20:59:12.003113 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 08 20:59:12.003113 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:59:12.003113 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:59:12.003113 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 08 20:59:12.003113 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 08 20:59:12.003113 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 08 20:59:12.003113 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:59:12.003113 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:59:12.003113 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:59:12.003113 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:59:12.003113 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:59:12.003113 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:59:12.003113 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 20:59:12.003113 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 20:59:12.003113 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 08 20:59:12.003113 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:59:12.003113 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-914eb409-b626-4410-bd7f-1b7e2205482c tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Returning 404 to user: Image not found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:59:12.003113 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-914eb409-b626-4410-bd7f-1b7e2205482c tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] 10.222.0.26 "DELETE /compute/v2.1/images/51380a40-a52a-46bf-a537-f30ae7be94ef" status: 404 len: 62 microversion: 2.1 time: 0.045178 Oct 08 20:59:12.003113 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 935/1888] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:59:11 2022] DELETE /compute/v2.1/images/51380a40-a52a-46bf-a537-f30ae7be94ef => generated 62 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 08 20:59:12.010947 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-569ca045-9fa1-45cb-8a42-b68016e4aeff tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:59:12.010947 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-569ca045-9fa1-45cb-8a42-b68016e4aeff tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] [instance: 19327d3e-de51-432b-b594-cb9a1bfe2f49] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:59:12.027577 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-569ca045-9fa1-45cb-8a42-b68016e4aeff tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:12.028177 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-569ca045-9fa1-45cb-8a42-b68016e4aeff tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:12.029110 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-569ca045-9fa1-45cb-8a42-b68016e4aeff tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:12.031087 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-569ca045-9fa1-45cb-8a42-b68016e4aeff tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:12.033548 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-569ca045-9fa1-45cb-8a42-b68016e4aeff tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:12.034250 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-569ca045-9fa1-45cb-8a42-b68016e4aeff tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:12.103288 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-569ca045-9fa1-45cb-8a42-b68016e4aeff tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] [instance: 19327d3e-de51-432b-b594-cb9a1bfe2f49] Going to try to terminate instance {{(pid=140491) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 20:59:12.294803 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-569ca045-9fa1-45cb-8a42-b68016e4aeff tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] 10.222.0.26 "DELETE /compute/v2.1/servers/19327d3e-de51-432b-b594-cb9a1bfe2f49" status: 204 len: 0 microversion: 2.1 time: 0.297267 Oct 08 20:59:12.296018 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 936/1889] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 20:59:11 2022] DELETE /compute/v2.1/servers/19327d3e-de51-432b-b594-cb9a1bfe2f49 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 20:59:12.306823 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-b627bb5e-6fe4-47f4-ae76-afbe1ab54514 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:59:12.308240 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-b627bb5e-6fe4-47f4-ae76-afbe1ab54514 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] [instance: 19327d3e-de51-432b-b594-cb9a1bfe2f49] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:59:12.327697 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b627bb5e-6fe4-47f4-ae76-afbe1ab54514 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:12.332234 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b627bb5e-6fe4-47f4-ae76-afbe1ab54514 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:12.333763 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b627bb5e-6fe4-47f4-ae76-afbe1ab54514 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:12.337630 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b627bb5e-6fe4-47f4-ae76-afbe1ab54514 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:12.338377 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b627bb5e-6fe4-47f4-ae76-afbe1ab54514 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:12.339158 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b627bb5e-6fe4-47f4-ae76-afbe1ab54514 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:12.659005 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-fc29c377-383c-483c-af53-eab7ad2cf358 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d96135705514061bef9306753143357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82999f8bc36455bafd8eed23c68e733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:59:12.676889 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-fc29c377-383c-483c-af53-eab7ad2cf358 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] 10.222.0.26 "GET /compute/v2.1/servers/c9f0e1d2-6f87-485d-bff6-0ea83899b705" status: 200 len: 1486 microversion: 2.1 time: 1.016366 Oct 08 20:59:12.677968 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 954/1890] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:59:11 2022] GET /compute/v2.1/servers/c9f0e1d2-6f87-485d-bff6-0ea83899b705 => generated 1486 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:59:12.684841 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-4ebfcb64-005c-4f31-ba84-1d89d5f084e2 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:59:12.690344 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-4ebfcb64-005c-4f31-ba84-1d89d5f084e2 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] [instance: 4be597d7-a3dd-44f3-9d17-946635bea8e6] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:59:12.711042 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4ebfcb64-005c-4f31-ba84-1d89d5f084e2 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:12.712014 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4ebfcb64-005c-4f31-ba84-1d89d5f084e2 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:12.712693 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4ebfcb64-005c-4f31-ba84-1d89d5f084e2 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:12.713726 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4ebfcb64-005c-4f31-ba84-1d89d5f084e2 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:12.714520 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4ebfcb64-005c-4f31-ba84-1d89d5f084e2 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:12.720045 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4ebfcb64-005c-4f31-ba84-1d89d5f084e2 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:12.785273 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-b627bb5e-6fe4-47f4-ae76-afbe1ab54514 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322606d4cb0f45d3ac2eceab4999d45b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24a29bd6efb40609e31fbb6dba839e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:59:12.793762 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-b627bb5e-6fe4-47f4-ae76-afbe1ab54514 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] 10.222.0.26 "GET /compute/v2.1/servers/19327d3e-de51-432b-b594-cb9a1bfe2f49" status: 200 len: 1473 microversion: 2.1 time: 0.493211 Oct 08 20:59:12.798843 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 937/1891] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:59:12 2022] GET /compute/v2.1/servers/19327d3e-de51-432b-b594-cb9a1bfe2f49 => generated 1473 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:59:13.376142 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-4ebfcb64-005c-4f31-ba84-1d89d5f084e2 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ddc3cd3c374bacbe5bf5e0877380e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8472b054404c46a99b81aba34d6b9f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:59:13.396883 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-4ebfcb64-005c-4f31-ba84-1d89d5f084e2 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] 10.222.0.26 "GET /compute/v2.1/servers/4be597d7-a3dd-44f3-9d17-946635bea8e6" status: 200 len: 1467 microversion: 2.1 time: 0.716468 Oct 08 20:59:13.400113 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 955/1892] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:59:12 2022] GET /compute/v2.1/servers/4be597d7-a3dd-44f3-9d17-946635bea8e6 => generated 1467 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:59:13.426469 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-41eac868-1cf9-44ae-ba57-bf7c13ae829f tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:59:13.427274 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-41eac868-1cf9-44ae-ba57-bf7c13ae829f tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] [instance: 37daee2e-9629-4664-a85d-da2e8aa5ea2e] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:59:13.435788 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-41eac868-1cf9-44ae-ba57-bf7c13ae829f tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:13.442353 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-41eac868-1cf9-44ae-ba57-bf7c13ae829f tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:13.443159 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-41eac868-1cf9-44ae-ba57-bf7c13ae829f tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:13.444269 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-41eac868-1cf9-44ae-ba57-bf7c13ae829f tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:13.444982 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-41eac868-1cf9-44ae-ba57-bf7c13ae829f tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:13.445682 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-41eac868-1cf9-44ae-ba57-bf7c13ae829f tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:13.826837 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-ab901083-3bbd-4c10-9a16-6f9609cad888 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:59:13.828058 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-ab901083-3bbd-4c10-9a16-6f9609cad888 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] [instance: 19327d3e-de51-432b-b594-cb9a1bfe2f49] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:59:13.834917 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=1,nova_api:INSERT=2,nova_api:DELETE=1 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:59:13.849936 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ab901083-3bbd-4c10-9a16-6f9609cad888 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:13.850785 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ab901083-3bbd-4c10-9a16-6f9609cad888 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:13.851406 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ab901083-3bbd-4c10-9a16-6f9609cad888 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:13.852349 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ab901083-3bbd-4c10-9a16-6f9609cad888 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:13.852991 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ab901083-3bbd-4c10-9a16-6f9609cad888 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:13.853879 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ab901083-3bbd-4c10-9a16-6f9609cad888 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:13.967833 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-41eac868-1cf9-44ae-ba57-bf7c13ae829f tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ddc3cd3c374bacbe5bf5e0877380e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8472b054404c46a99b81aba34d6b9f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:59:13.986375 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-41eac868-1cf9-44ae-ba57-bf7c13ae829f tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] 10.222.0.26 "GET /compute/v2.1/servers/37daee2e-9629-4664-a85d-da2e8aa5ea2e" status: 200 len: 1467 microversion: 2.1 time: 0.562883 Oct 08 20:59:13.989765 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 938/1893] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:59:13 2022] GET /compute/v2.1/servers/37daee2e-9629-4664-a85d-da2e8aa5ea2e => generated 1467 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:59:14.017074 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-3769a556-066a-45fe-aeab-9c15a105a6c2 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:59:14.029468 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-3769a556-066a-45fe-aeab-9c15a105a6c2 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '67ddc3cd3c374bacbe5bf5e0877380e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8472b054404c46a99b81aba34d6b9f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:59:14.033136 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-3769a556-066a-45fe-aeab-9c15a105a6c2 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Searching by: {'reservation_id': 'r-rxedu1eq', 'deleted': False, 'project_id': '8472b054404c46a99b81aba34d6b9f40'} {{(pid=140491) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 08 20:59:14.048407 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3769a556-066a-45fe-aeab-9c15a105a6c2 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:14.049630 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3769a556-066a-45fe-aeab-9c15a105a6c2 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:14.052945 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3769a556-066a-45fe-aeab-9c15a105a6c2 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:14.054236 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3769a556-066a-45fe-aeab-9c15a105a6c2 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:14.055982 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3769a556-066a-45fe-aeab-9c15a105a6c2 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:14.057650 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3769a556-066a-45fe-aeab-9c15a105a6c2 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:14.315561 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.multi_cell_list [None req-3769a556-066a-45fe-aeab-9c15a105a6c2 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=140491) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 08 20:59:14.478440 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-3769a556-066a-45fe-aeab-9c15a105a6c2 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ddc3cd3c374bacbe5bf5e0877380e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8472b054404c46a99b81aba34d6b9f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:59:14.510355 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3769a556-066a-45fe-aeab-9c15a105a6c2 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:14.510880 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3769a556-066a-45fe-aeab-9c15a105a6c2 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:14.511372 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3769a556-066a-45fe-aeab-9c15a105a6c2 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:15.010157 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-3769a556-066a-45fe-aeab-9c15a105a6c2 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] 10.222.0.26 "GET /compute/v2.1/servers/detail?reservation_id=r-rxedu1eq" status: 200 len: 2927 microversion: 2.1 time: 0.999841 Oct 08 20:59:15.011093 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 939/1894] 10.222.0.26 () {58 vars in 1197 bytes} [Sat Oct 8 20:59:14 2022] GET /compute/v2.1/servers/detail?reservation_id=r-rxedu1eq => generated 2927 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:59:15.016946 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-37edf226-4aa3-4aae-baf0-4dafb721f923 req-8726b0d3-cc46-4304-bf88-83e5a9edc895 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19327d3e-de51-432b-b594-cb9a1bfe2f49", "name": "network-vif-unplugged", "status": "completed", "tag": "6fbec29d-5924-4cc1-9f8d-c5ac27cbc284"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:59:15.039227 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-37edf226-4aa3-4aae-baf0-4dafb721f923 req-8726b0d3-cc46-4304-bf88-83e5a9edc895 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:15.040127 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-37edf226-4aa3-4aae-baf0-4dafb721f923 req-8726b0d3-cc46-4304-bf88-83e5a9edc895 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:15.041329 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-37edf226-4aa3-4aae-baf0-4dafb721f923 req-8726b0d3-cc46-4304-bf88-83e5a9edc895 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:15.057016 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-37edf226-4aa3-4aae-baf0-4dafb721f923 req-8726b0d3-cc46-4304-bf88-83e5a9edc895 service nova] Creating event network-vif-unplugged:6fbec29d-5924-4cc1-9f8d-c5ac27cbc284 for instance 19327d3e-de51-432b-b594-cb9a1bfe2f49 on nch1-master-1 Oct 08 20:59:15.071200 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-ab901083-3bbd-4c10-9a16-6f9609cad888 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322606d4cb0f45d3ac2eceab4999d45b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24a29bd6efb40609e31fbb6dba839e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:59:15.072531 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-37edf226-4aa3-4aae-baf0-4dafb721f923 req-8726b0d3-cc46-4304-bf88-83e5a9edc895 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.059957 Oct 08 20:59:15.074288 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 940/1895] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:59:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:59:15.088578 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-ab901083-3bbd-4c10-9a16-6f9609cad888 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] 10.222.0.26 "GET /compute/v2.1/servers/19327d3e-de51-432b-b594-cb9a1bfe2f49" status: 200 len: 1473 microversion: 2.1 time: 1.261904 Oct 08 20:59:15.089300 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 956/1896] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:59:13 2022] GET /compute/v2.1/servers/19327d3e-de51-432b-b594-cb9a1bfe2f49 => generated 1473 bytes in 1269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 20:59:15.114900 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-e6dff1c7-8a32-4b56-89f9-a3d139b7dfe0 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:59:15.132971 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:59:15.162651 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.compute.server_groups [None req-e6dff1c7-8a32-4b56-89f9-a3d139b7dfe0 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Querying cell 1a13ecad-3f87-496d-a2c5-ac44667fd176(cell1) for 2 instances {{(pid=140491) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 08 20:59:15.164227 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e6dff1c7-8a32-4b56-89f9-a3d139b7dfe0 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:15.165587 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e6dff1c7-8a32-4b56-89f9-a3d139b7dfe0 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:15.166276 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e6dff1c7-8a32-4b56-89f9-a3d139b7dfe0 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:15.247590 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-e6dff1c7-8a32-4b56-89f9-a3d139b7dfe0 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] 10.222.0.26 "GET /compute/v2.1/os-server-groups/fe819c51-52ee-4d77-83e3-6fe92bbd0690" status: 200 len: 270 microversion: 2.1 time: 0.171555 Oct 08 20:59:15.248915 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 941/1897] 10.222.0.26 () {58 vars in 1263 bytes} [Sat Oct 8 20:59:15 2022] GET /compute/v2.1/os-server-groups/fe819c51-52ee-4d77-83e3-6fe92bbd0690 => generated 270 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:59:15.261522 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-0634daba-68ef-49ed-a112-c3be33878ccc tempest-ServersOnMultiNodesTest-429096361 tempest-ServersOnMultiNodesTest-429096361-project-admin] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:59:15.262199 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-0634daba-68ef-49ed-a112-c3be33878ccc tempest-ServersOnMultiNodesTest-429096361 tempest-ServersOnMultiNodesTest-429096361-project-admin] [instance: 37daee2e-9629-4664-a85d-da2e8aa5ea2e] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:59:15.273632 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0634daba-68ef-49ed-a112-c3be33878ccc tempest-ServersOnMultiNodesTest-429096361 tempest-ServersOnMultiNodesTest-429096361-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:15.275805 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0634daba-68ef-49ed-a112-c3be33878ccc tempest-ServersOnMultiNodesTest-429096361 tempest-ServersOnMultiNodesTest-429096361-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:15.277903 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0634daba-68ef-49ed-a112-c3be33878ccc tempest-ServersOnMultiNodesTest-429096361 tempest-ServersOnMultiNodesTest-429096361-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:15.278998 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0634daba-68ef-49ed-a112-c3be33878ccc tempest-ServersOnMultiNodesTest-429096361 tempest-ServersOnMultiNodesTest-429096361-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:15.279718 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0634daba-68ef-49ed-a112-c3be33878ccc tempest-ServersOnMultiNodesTest-429096361 tempest-ServersOnMultiNodesTest-429096361-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:15.280651 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0634daba-68ef-49ed-a112-c3be33878ccc tempest-ServersOnMultiNodesTest-429096361 tempest-ServersOnMultiNodesTest-429096361-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:15.575755 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-f99d9a5f-d9d5-4885-8d7e-ec500700abdc req-b659252c-3553-4697-8c6b-851723ce7b97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19327d3e-de51-432b-b594-cb9a1bfe2f49", "name": "network-vif-deleted", "tag": "6fbec29d-5924-4cc1-9f8d-c5ac27cbc284"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:59:15.615303 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-f99d9a5f-d9d5-4885-8d7e-ec500700abdc req-b659252c-3553-4697-8c6b-851723ce7b97 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:15.621554 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-f99d9a5f-d9d5-4885-8d7e-ec500700abdc req-b659252c-3553-4697-8c6b-851723ce7b97 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:15.625763 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-f99d9a5f-d9d5-4885-8d7e-ec500700abdc req-b659252c-3553-4697-8c6b-851723ce7b97 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:15.652291 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:59:15.686414 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-f99d9a5f-d9d5-4885-8d7e-ec500700abdc req-b659252c-3553-4697-8c6b-851723ce7b97 service nova] Creating event network-vif-deleted:6fbec29d-5924-4cc1-9f8d-c5ac27cbc284 for instance 19327d3e-de51-432b-b594-cb9a1bfe2f49 on nch1-master-1 Oct 08 20:59:15.704099 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-f99d9a5f-d9d5-4885-8d7e-ec500700abdc req-b659252c-3553-4697-8c6b-851723ce7b97 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140692 Oct 08 20:59:15.709467 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 942/1898] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:59:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:59:16.125282 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-5a79df4f-a267-449a-bd30-948e0245c7b6 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:59:16.126681 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-5a79df4f-a267-449a-bd30-948e0245c7b6 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] [instance: 19327d3e-de51-432b-b594-cb9a1bfe2f49] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:59:16.135938 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5a79df4f-a267-449a-bd30-948e0245c7b6 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:16.136722 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5a79df4f-a267-449a-bd30-948e0245c7b6 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:16.137408 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5a79df4f-a267-449a-bd30-948e0245c7b6 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:16.138553 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5a79df4f-a267-449a-bd30-948e0245c7b6 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:16.139192 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5a79df4f-a267-449a-bd30-948e0245c7b6 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:16.140226 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5a79df4f-a267-449a-bd30-948e0245c7b6 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:16.240998 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5a79df4f-a267-449a-bd30-948e0245c7b6 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:16.242152 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5a79df4f-a267-449a-bd30-948e0245c7b6 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:16.242938 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5a79df4f-a267-449a-bd30-948e0245c7b6 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:16.244803 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.objects.instance [None req-5a79df4f-a267-449a-bd30-948e0245c7b6 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Lazy-loading 'fault' on Instance uuid 19327d3e-de51-432b-b594-cb9a1bfe2f49 {{(pid=140491) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 20:59:16.342129 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-0634daba-68ef-49ed-a112-c3be33878ccc tempest-ServersOnMultiNodesTest-429096361 tempest-ServersOnMultiNodesTest-429096361-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/37daee2e-9629-4664-a85d-da2e8aa5ea2e" status: 200 len: 1618 microversion: 2.1 time: 1.085656 Oct 08 20:59:16.343311 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 957/1899] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:59:15 2022] GET /compute/v2.1/servers/37daee2e-9629-4664-a85d-da2e8aa5ea2e => generated 1618 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:59:16.366267 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-a480decd-f215-4699-bc69-3f478bc5b45f tempest-ServersOnMultiNodesTest-429096361 tempest-ServersOnMultiNodesTest-429096361-project-admin] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:59:16.367159 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-a480decd-f215-4699-bc69-3f478bc5b45f tempest-ServersOnMultiNodesTest-429096361 tempest-ServersOnMultiNodesTest-429096361-project-admin] [instance: 4be597d7-a3dd-44f3-9d17-946635bea8e6] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:59:16.376776 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a480decd-f215-4699-bc69-3f478bc5b45f tempest-ServersOnMultiNodesTest-429096361 tempest-ServersOnMultiNodesTest-429096361-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:16.381443 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-5a79df4f-a267-449a-bd30-948e0245c7b6 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322606d4cb0f45d3ac2eceab4999d45b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24a29bd6efb40609e31fbb6dba839e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:59:16.382364 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a480decd-f215-4699-bc69-3f478bc5b45f tempest-ServersOnMultiNodesTest-429096361 tempest-ServersOnMultiNodesTest-429096361-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:16.383043 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a480decd-f215-4699-bc69-3f478bc5b45f tempest-ServersOnMultiNodesTest-429096361 tempest-ServersOnMultiNodesTest-429096361-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:16.384127 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a480decd-f215-4699-bc69-3f478bc5b45f tempest-ServersOnMultiNodesTest-429096361 tempest-ServersOnMultiNodesTest-429096361-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:16.390780 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a480decd-f215-4699-bc69-3f478bc5b45f tempest-ServersOnMultiNodesTest-429096361 tempest-ServersOnMultiNodesTest-429096361-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:16.392276 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a480decd-f215-4699-bc69-3f478bc5b45f tempest-ServersOnMultiNodesTest-429096361 tempest-ServersOnMultiNodesTest-429096361-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:16.396499 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-5a79df4f-a267-449a-bd30-948e0245c7b6 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] 10.222.0.26 "GET /compute/v2.1/servers/19327d3e-de51-432b-b594-cb9a1bfe2f49" status: 200 len: 1307 microversion: 2.1 time: 0.283391 Oct 08 20:59:16.398134 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 943/1900] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:59:16 2022] GET /compute/v2.1/servers/19327d3e-de51-432b-b594-cb9a1bfe2f49 => generated 1307 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 20:59:17.236884 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-a480decd-f215-4699-bc69-3f478bc5b45f tempest-ServersOnMultiNodesTest-429096361 tempest-ServersOnMultiNodesTest-429096361-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/4be597d7-a3dd-44f3-9d17-946635bea8e6" status: 200 len: 1618 microversion: 2.1 time: 0.874656 Oct 08 20:59:17.241789 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 958/1901] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:59:16 2022] GET /compute/v2.1/servers/4be597d7-a3dd-44f3-9d17-946635bea8e6 => generated 1618 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 20:59:17.424601 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-3d0b04ed-36da-4049-b48a-dbe3bbc140f4 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:59:17.425010 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-3d0b04ed-36da-4049-b48a-dbe3bbc140f4 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] [instance: 19327d3e-de51-432b-b594-cb9a1bfe2f49] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:59:17.435832 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3d0b04ed-36da-4049-b48a-dbe3bbc140f4 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:17.436878 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3d0b04ed-36da-4049-b48a-dbe3bbc140f4 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:17.438424 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3d0b04ed-36da-4049-b48a-dbe3bbc140f4 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:17.439812 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3d0b04ed-36da-4049-b48a-dbe3bbc140f4 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:17.441760 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3d0b04ed-36da-4049-b48a-dbe3bbc140f4 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:17.443192 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3d0b04ed-36da-4049-b48a-dbe3bbc140f4 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:17.469812 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-9003b8b9-f866-4455-bdad-3fa2d9fc541d tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1694725773", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "8ceaf7df-4795-4969-be16-a2a1b94a3fa6"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:59:17.499097 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-3d0b04ed-36da-4049-b48a-dbe3bbc140f4 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] HTTP exception thrown: Instance 19327d3e-de51-432b-b594-cb9a1bfe2f49 could not be found. Oct 08 20:59:17.510689 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-3d0b04ed-36da-4049-b48a-dbe3bbc140f4 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Request method failure captured: Oct 08 20:59:17.510689 ncdv-master-1 devstack@n-api.service[140491]: request: GET /compute/v2.1/servers/19327d3e-de51-432b-b594-cb9a1bfe2f49 HTTP/1.1 Oct 08 20:59:17.510689 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 20:59:17.510689 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 20:59:17.510689 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 20:59:17.510689 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 20:59:17.510689 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 20:59:17.510689 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 20:59:17.510689 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 20:59:17.510689 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 20:59:17.510689 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeQ8lmuamJgXJSwemYAXatbYzGYxm_vVecG_OkvuOFcfHBi0mwsDPaUy2fuPA0W4Cc63IKn5u45dzTXN2Hrfj_C4JN_oRWkar0MPXmWSzRRvEUZ20-nXU9GxMuOhWBfxj859Yy1sfVnVE5SohziLAPcgHkGVSZftQN4FJxkgA7wmzB4 Oct 08 20:59:17.510689 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 20:59:17.510689 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 20:59:17.510689 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 20:59:17.510689 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 20:59:17.510689 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 20:59:17.510689 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 20:59:17.510689 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: d24a29bd6efb40609e31fbb6dba839e8 Oct 08 20:59:17.510689 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-ImagesOneServerTestJSON-55201698 Oct 08 20:59:17.510689 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 20:59:17.510689 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 20:59:17.510689 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d24a29bd6efb40609e31fbb6dba839e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d24a29bd6efb40609e31fbb6dba839e8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d24a29bd6efb40609e31fbb6dba839e8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d24a29bd6efb40609e31fbb6dba839e8"}]}] Oct 08 20:59:17.510689 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-ImagesOneServerTestJSON-55201698 Oct 08 20:59:17.510689 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: d24a29bd6efb40609e31fbb6dba839e8 Oct 08 20:59:17.510689 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-55201698 Oct 08 20:59:17.510689 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-ImagesOneServerTestJSON-55201698-project Oct 08 20:59:17.510689 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 20:59:17.510689 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 20:59:17.510689 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 322606d4cb0f45d3ac2eceab4999d45b Oct 08 20:59:17.510689 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-ImagesOneServerTestJSON-55201698-project Oct 08 20:59:17.510689 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 20:59:17.510689 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance 19327d3e-de51-432b-b594-cb9a1bfe2f49 could not be found. Oct 08 20:59:17.510689 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': '19327d3e-de51-432b-b594-cb9a1bfe2f49'} Oct 08 20:59:17.510689 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:59:17.510689 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:59:17.510689 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 20:59:17.510689 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 20:59:17.510689 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 20:59:17.510689 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 20:59:17.510689 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 20:59:17.510689 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 20:59:17.510689 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 20:59:17.510689 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 20:59:17.510689 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19327d3e-de51-432b-b594-cb9a1bfe2f49 could not be found. Oct 08 20:59:17.510689 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:59:17.510689 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:59:17.510689 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:59:17.510689 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:59:17.510689 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:59:17.510689 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:59:17.510689 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:59:17.510689 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:59:17.510689 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:59:17.510689 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:59:17.510689 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 20:59:17.510689 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 20:59:17.510689 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 20:59:17.510689 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 20:59:17.510689 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 20:59:17.510689 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 20:59:17.510689 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19327d3e-de51-432b-b594-cb9a1bfe2f49 could not be found. Oct 08 20:59:17.510689 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:59:17.510689 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:59:17.510689 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:59:17.515285 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:59:17.515285 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:59:17.515285 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:59:17.515285 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 20:59:17.515285 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 20:59:17.515285 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19327d3e-de51-432b-b594-cb9a1bfe2f49 could not be found. Oct 08 20:59:17.515285 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:59:17.515285 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-3d0b04ed-36da-4049-b48a-dbe3bbc140f4 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] Returning 404 to user: Instance 19327d3e-de51-432b-b594-cb9a1bfe2f49 could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:59:17.517612 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-3d0b04ed-36da-4049-b48a-dbe3bbc140f4 tempest-ImagesOneServerTestJSON-55201698 tempest-ImagesOneServerTestJSON-55201698-project] 10.222.0.26 "GET /compute/v2.1/servers/19327d3e-de51-432b-b594-cb9a1bfe2f49" status: 404 len: 111 microversion: 2.1 time: 0.092317 Oct 08 20:59:17.518239 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 944/1902] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:59:17 2022] GET /compute/v2.1/servers/19327d3e-de51-432b-b594-cb9a1bfe2f49 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 20:59:17.596766 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.network.neutron [None req-9003b8b9-f866-4455-bdad-3fa2d9fc541d tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] validate_networks() for None {{(pid=140492) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 20:59:19.110692 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-9003b8b9-f866-4455-bdad-3fa2d9fc541d tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Flavor limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 20:59:19.111492 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-9003b8b9-f866-4455-bdad-3fa2d9fc541d tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Image limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 20:59:19.112457 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-9003b8b9-f866-4455-bdad-3fa2d9fc541d tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Flavor pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 20:59:19.113667 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-9003b8b9-f866-4455-bdad-3fa2d9fc541d tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Image pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 20:59:19.117548 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-9003b8b9-f866-4455-bdad-3fa2d9fc541d tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 20:59:19.138318 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9003b8b9-f866-4455-bdad-3fa2d9fc541d tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:19.139382 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9003b8b9-f866-4455-bdad-3fa2d9fc541d tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:19.141497 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9003b8b9-f866-4455-bdad-3fa2d9fc541d tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:19.142954 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9003b8b9-f866-4455-bdad-3fa2d9fc541d tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:19.148586 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9003b8b9-f866-4455-bdad-3fa2d9fc541d tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:19.152140 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9003b8b9-f866-4455-bdad-3fa2d9fc541d tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:19.194124 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-9003b8b9-f866-4455-bdad-3fa2d9fc541d tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Getting quotas for project 8472b054404c46a99b81aba34d6b9f40. Resources: {'cores', 'instances', 'ram'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 20:59:19.202177 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-9003b8b9-f866-4455-bdad-3fa2d9fc541d tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Getting quotas for user 67ddc3cd3c374bacbe5bf5e0877380e2 and project 8472b054404c46a99b81aba34d6b9f40. Resources: {'cores', 'instances', 'ram'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 20:59:19.221694 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-9003b8b9-f866-4455-bdad-3fa2d9fc541d tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Going to run 1 instances... {{(pid=140492) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 20:59:19.225050 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-9003b8b9-f866-4455-bdad-3fa2d9fc541d tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] [instance: 50c38cf5-c054-447c-99a8-10bae624b09a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c508bd7f-7db9-4b2c-af7c-be54a855c355',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140492) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 20:59:19.300954 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-9003b8b9-f866-4455-bdad-3fa2d9fc541d tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.836362 Oct 08 20:59:19.302407 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 959/1903] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 20:59:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1839 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 08 20:59:19.315294 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-0cbd4cae-0e28-43fb-b39d-ce28c78e0f71 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:59:19.316937 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-0cbd4cae-0e28-43fb-b39d-ce28c78e0f71 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] [instance: 50c38cf5-c054-447c-99a8-10bae624b09a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:59:19.471105 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-0cbd4cae-0e28-43fb-b39d-ce28c78e0f71 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ddc3cd3c374bacbe5bf5e0877380e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8472b054404c46a99b81aba34d6b9f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:59:19.486708 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-0cbd4cae-0e28-43fb-b39d-ce28c78e0f71 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] 10.222.0.26 "GET /compute/v2.1/servers/50c38cf5-c054-447c-99a8-10bae624b09a" status: 200 len: 1217 microversion: 2.1 time: 0.177097 Oct 08 20:59:19.490233 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 945/1904] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:59:19 2022] GET /compute/v2.1/servers/50c38cf5-c054-447c-99a8-10bae624b09a => generated 1217 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 20:59:20.515548 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e4c72d18-2575-4973-a6a7-bfd421ae0371 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:59:20.520024 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-e4c72d18-2575-4973-a6a7-bfd421ae0371 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] [instance: 50c38cf5-c054-447c-99a8-10bae624b09a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:59:20.536073 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e4c72d18-2575-4973-a6a7-bfd421ae0371 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:20.537703 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e4c72d18-2575-4973-a6a7-bfd421ae0371 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:20.539939 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e4c72d18-2575-4973-a6a7-bfd421ae0371 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:20.543022 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e4c72d18-2575-4973-a6a7-bfd421ae0371 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:20.549065 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e4c72d18-2575-4973-a6a7-bfd421ae0371 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:20.550078 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e4c72d18-2575-4973-a6a7-bfd421ae0371 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:20.794977 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-e4c72d18-2575-4973-a6a7-bfd421ae0371 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ddc3cd3c374bacbe5bf5e0877380e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8472b054404c46a99b81aba34d6b9f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:59:20.803864 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-e4c72d18-2575-4973-a6a7-bfd421ae0371 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] 10.222.0.26 "GET /compute/v2.1/servers/50c38cf5-c054-447c-99a8-10bae624b09a" status: 200 len: 1213 microversion: 2.1 time: 0.294908 Oct 08 20:59:20.809010 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 960/1905] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:59:20 2022] GET /compute/v2.1/servers/50c38cf5-c054-447c-99a8-10bae624b09a => generated 1213 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:59:21.839397 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-a4ab2402-fee6-4508-86f6-b8fbd94dc553 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:59:21.841492 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-a4ab2402-fee6-4508-86f6-b8fbd94dc553 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] [instance: 50c38cf5-c054-447c-99a8-10bae624b09a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:59:21.854602 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a4ab2402-fee6-4508-86f6-b8fbd94dc553 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:21.857178 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a4ab2402-fee6-4508-86f6-b8fbd94dc553 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:21.858147 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a4ab2402-fee6-4508-86f6-b8fbd94dc553 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:21.859177 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a4ab2402-fee6-4508-86f6-b8fbd94dc553 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:21.861457 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a4ab2402-fee6-4508-86f6-b8fbd94dc553 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:21.862228 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a4ab2402-fee6-4508-86f6-b8fbd94dc553 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:22.275492 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-a4ab2402-fee6-4508-86f6-b8fbd94dc553 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ddc3cd3c374bacbe5bf5e0877380e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8472b054404c46a99b81aba34d6b9f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:59:22.285292 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-a4ab2402-fee6-4508-86f6-b8fbd94dc553 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] 10.222.0.26 "GET /compute/v2.1/servers/50c38cf5-c054-447c-99a8-10bae624b09a" status: 200 len: 1277 microversion: 2.1 time: 0.453748 Oct 08 20:59:22.289229 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 946/1906] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:59:21 2022] GET /compute/v2.1/servers/50c38cf5-c054-447c-99a8-10bae624b09a => generated 1277 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:59:23.321400 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-da0934ab-2f26-4a4c-9fd4-527fef1efa8d tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:59:23.323140 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-da0934ab-2f26-4a4c-9fd4-527fef1efa8d tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] [instance: 50c38cf5-c054-447c-99a8-10bae624b09a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:59:23.345076 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-da0934ab-2f26-4a4c-9fd4-527fef1efa8d tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:23.349128 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-da0934ab-2f26-4a4c-9fd4-527fef1efa8d tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:23.351720 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-da0934ab-2f26-4a4c-9fd4-527fef1efa8d tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:23.354017 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-da0934ab-2f26-4a4c-9fd4-527fef1efa8d tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:23.355405 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-da0934ab-2f26-4a4c-9fd4-527fef1efa8d tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:23.357766 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-da0934ab-2f26-4a4c-9fd4-527fef1efa8d tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:23.644129 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-da0934ab-2f26-4a4c-9fd4-527fef1efa8d tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ddc3cd3c374bacbe5bf5e0877380e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8472b054404c46a99b81aba34d6b9f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:59:23.704631 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-5ebbfc3f-b74a-4f73-877e-e563feb8cd8c tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-303754492", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:59:23.713792 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-da0934ab-2f26-4a4c-9fd4-527fef1efa8d tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] 10.222.0.26 "GET /compute/v2.1/servers/50c38cf5-c054-447c-99a8-10bae624b09a" status: 200 len: 1275 microversion: 2.1 time: 0.399550 Oct 08 20:59:23.716942 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 961/1907] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:59:23 2022] GET /compute/v2.1/servers/50c38cf5-c054-447c-99a8-10bae624b09a => generated 1275 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:59:23.855049 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.network.neutron [None req-5ebbfc3f-b74a-4f73-877e-e563feb8cd8c tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] validate_networks() for None {{(pid=140491) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 20:59:24.139765 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-bbe7cc40-4e83-47b3-945b-479ac5a18714 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:59:24.140681 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-bbe7cc40-4e83-47b3-945b-479ac5a18714 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] [instance: ceced78a-58d9-4175-b4fe-0d085be62c94] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:59:24.150395 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bbe7cc40-4e83-47b3-945b-479ac5a18714 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:24.151225 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bbe7cc40-4e83-47b3-945b-479ac5a18714 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:24.152188 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bbe7cc40-4e83-47b3-945b-479ac5a18714 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:24.153454 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bbe7cc40-4e83-47b3-945b-479ac5a18714 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:24.155290 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bbe7cc40-4e83-47b3-945b-479ac5a18714 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:24.155951 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bbe7cc40-4e83-47b3-945b-479ac5a18714 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:24.171145 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=2 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:59:24.625722 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-5ebbfc3f-b74a-4f73-877e-e563feb8cd8c tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Flavor limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 20:59:24.626454 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-5ebbfc3f-b74a-4f73-877e-e563feb8cd8c tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Image limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 20:59:24.627823 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-5ebbfc3f-b74a-4f73-877e-e563feb8cd8c tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Flavor pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 20:59:24.628573 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-5ebbfc3f-b74a-4f73-877e-e563feb8cd8c tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Image pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 20:59:24.629657 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-5ebbfc3f-b74a-4f73-877e-e563feb8cd8c tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 20:59:24.654702 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5ebbfc3f-b74a-4f73-877e-e563feb8cd8c tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:24.658890 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5ebbfc3f-b74a-4f73-877e-e563feb8cd8c tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:24.659955 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5ebbfc3f-b74a-4f73-877e-e563feb8cd8c tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:24.675427 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5ebbfc3f-b74a-4f73-877e-e563feb8cd8c tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:24.676498 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5ebbfc3f-b74a-4f73-877e-e563feb8cd8c tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:24.677060 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5ebbfc3f-b74a-4f73-877e-e563feb8cd8c tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:24.773100 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-5ebbfc3f-b74a-4f73-877e-e563feb8cd8c tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Getting quotas for project 0ffdae031c4f47d599acb30f1d3c87b9. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 20:59:24.782966 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-5ebbfc3f-b74a-4f73-877e-e563feb8cd8c tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Getting quotas for user 5266cd6be4514b3eac30a195f6b25772 and project 0ffdae031c4f47d599acb30f1d3c87b9. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 20:59:24.801716 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-5ebbfc3f-b74a-4f73-877e-e563feb8cd8c tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Going to run 1 instances... {{(pid=140491) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 20:59:24.806901 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-5ebbfc3f-b74a-4f73-877e-e563feb8cd8c tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c508bd7f-7db9-4b2c-af7c-be54a855c355',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140491) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 20:59:24.919808 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-5ebbfc3f-b74a-4f73-877e-e563feb8cd8c tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.535375 Oct 08 20:59:24.924019 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 947/1908] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 20:59:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1542 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 08 20:59:24.964937 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-890a0b3f-a1ff-41ff-b779-5cb1967e588d tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:59:24.966750 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-890a0b3f-a1ff-41ff-b779-5cb1967e588d tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] [instance: 50c38cf5-c054-447c-99a8-10bae624b09a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:59:24.991619 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-890a0b3f-a1ff-41ff-b779-5cb1967e588d tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:24.993979 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-890a0b3f-a1ff-41ff-b779-5cb1967e588d tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:24.995384 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-890a0b3f-a1ff-41ff-b779-5cb1967e588d tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:24.997122 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-890a0b3f-a1ff-41ff-b779-5cb1967e588d tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:24.998891 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-890a0b3f-a1ff-41ff-b779-5cb1967e588d tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:25.002226 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-890a0b3f-a1ff-41ff-b779-5cb1967e588d tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:25.151706 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-bbe7cc40-4e83-47b3-945b-479ac5a18714 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:59:25.174865 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-bbe7cc40-4e83-47b3-945b-479ac5a18714 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:59:25.184852 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-bbe7cc40-4e83-47b3-945b-479ac5a18714 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:59:25.197615 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-bbe7cc40-4e83-47b3-945b-479ac5a18714 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] 10.222.0.26 "GET /compute/v2.1/servers/ceced78a-58d9-4175-b4fe-0d085be62c94" status: 200 len: 2950 microversion: 2.42 time: 1.054322 Oct 08 20:59:25.254536 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 962/1909] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 20:59:24 2022] GET /compute/v2.1/servers/ceced78a-58d9-4175-b4fe-0d085be62c94 => generated 2950 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:59:25.269989 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-4f8e46d3-4456-4862-9641-3fd987ced775 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:59:25.270470 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-4f8e46d3-4456-4862-9641-3fd987ced775 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:59:25.367881 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-890a0b3f-a1ff-41ff-b779-5cb1967e588d tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ddc3cd3c374bacbe5bf5e0877380e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8472b054404c46a99b81aba34d6b9f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:59:25.384383 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-890a0b3f-a1ff-41ff-b779-5cb1967e588d tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] 10.222.0.26 "GET /compute/v2.1/servers/50c38cf5-c054-447c-99a8-10bae624b09a" status: 200 len: 1275 microversion: 2.1 time: 0.458850 Oct 08 20:59:25.386214 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 948/1910] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:59:24 2022] GET /compute/v2.1/servers/50c38cf5-c054-447c-99a8-10bae624b09a => generated 1275 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:59:25.395962 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-7a644193-7fdb-4f17-a3de-8c9c9e154446 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:59:25.399764 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-7a644193-7fdb-4f17-a3de-8c9c9e154446 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] [instance: ceced78a-58d9-4175-b4fe-0d085be62c94] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:59:25.416852 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7a644193-7fdb-4f17-a3de-8c9c9e154446 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:25.429864 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7a644193-7fdb-4f17-a3de-8c9c9e154446 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:25.430707 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7a644193-7fdb-4f17-a3de-8c9c9e154446 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:25.432193 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7a644193-7fdb-4f17-a3de-8c9c9e154446 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:25.433231 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7a644193-7fdb-4f17-a3de-8c9c9e154446 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:25.433819 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7a644193-7fdb-4f17-a3de-8c9c9e154446 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:25.563616 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-4f8e46d3-4456-4862-9641-3fd987ced775 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:59:25.593222 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-4f8e46d3-4456-4862-9641-3fd987ced775 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd" status: 200 len: 1212 microversion: 2.1 time: 0.336062 Oct 08 20:59:25.595605 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 963/1911] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:59:25 2022] GET /compute/v2.1/servers/d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd => generated 1212 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:59:25.953674 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-7a644193-7fdb-4f17-a3de-8c9c9e154446 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] 10.222.0.26 "GET /compute/v2.1/servers/ceced78a-58d9-4175-b4fe-0d085be62c94/os-interface" status: 200 len: 1831 microversion: 2.42 time: 0.564993 Oct 08 20:59:25.965958 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 949/1912] 10.222.0.26 () {60 vars in 1316 bytes} [Sat Oct 8 20:59:25 2022] GET /compute/v2.1/servers/ceced78a-58d9-4175-b4fe-0d085be62c94/os-interface => generated 1831 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 20:59:26.421127 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-5975ffb9-76a2-4cb7-a958-d74f157a368e tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:59:26.421990 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-5975ffb9-76a2-4cb7-a958-d74f157a368e tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] [instance: 50c38cf5-c054-447c-99a8-10bae624b09a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:59:26.450603 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5975ffb9-76a2-4cb7-a958-d74f157a368e tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:26.451808 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5975ffb9-76a2-4cb7-a958-d74f157a368e tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:26.452721 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5975ffb9-76a2-4cb7-a958-d74f157a368e tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:26.455260 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5975ffb9-76a2-4cb7-a958-d74f157a368e tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:26.456179 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5975ffb9-76a2-4cb7-a958-d74f157a368e tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:26.457041 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5975ffb9-76a2-4cb7-a958-d74f157a368e tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:26.623327 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-ec352617-65a2-4ec0-9e4a-a07218ee4192 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:59:26.623952 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-ec352617-65a2-4ec0-9e4a-a07218ee4192 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:59:26.649289 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ec352617-65a2-4ec0-9e4a-a07218ee4192 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:26.667469 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ec352617-65a2-4ec0-9e4a-a07218ee4192 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:26.668153 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ec352617-65a2-4ec0-9e4a-a07218ee4192 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:26.682787 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ec352617-65a2-4ec0-9e4a-a07218ee4192 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:26.683679 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ec352617-65a2-4ec0-9e4a-a07218ee4192 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:26.690080 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ec352617-65a2-4ec0-9e4a-a07218ee4192 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:26.965435 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-ec352617-65a2-4ec0-9e4a-a07218ee4192 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:59:26.985445 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-ec352617-65a2-4ec0-9e4a-a07218ee4192 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd" status: 200 len: 1264 microversion: 2.1 time: 0.369592 Oct 08 20:59:26.994000 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 950/1913] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:59:26 2022] GET /compute/v2.1/servers/d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd => generated 1264 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:59:27.612989 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-5975ffb9-76a2-4cb7-a958-d74f157a368e tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ddc3cd3c374bacbe5bf5e0877380e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8472b054404c46a99b81aba34d6b9f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:59:27.627314 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-5975ffb9-76a2-4cb7-a958-d74f157a368e tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] 10.222.0.26 "GET /compute/v2.1/servers/50c38cf5-c054-447c-99a8-10bae624b09a" status: 200 len: 1275 microversion: 2.1 time: 1.216355 Oct 08 20:59:27.638830 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 964/1914] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:59:26 2022] GET /compute/v2.1/servers/50c38cf5-c054-447c-99a8-10bae624b09a => generated 1275 bytes in 1229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:59:28.021199 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-fea6fe86-f47f-4a4c-b28c-0870bf4cf935 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:59:28.021818 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-fea6fe86-f47f-4a4c-b28c-0870bf4cf935 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:59:28.036219 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fea6fe86-f47f-4a4c-b28c-0870bf4cf935 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:28.039664 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fea6fe86-f47f-4a4c-b28c-0870bf4cf935 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:28.039664 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fea6fe86-f47f-4a4c-b28c-0870bf4cf935 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:28.039664 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fea6fe86-f47f-4a4c-b28c-0870bf4cf935 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:28.039664 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fea6fe86-f47f-4a4c-b28c-0870bf4cf935 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:28.039664 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fea6fe86-f47f-4a4c-b28c-0870bf4cf935 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:28.340159 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-fea6fe86-f47f-4a4c-b28c-0870bf4cf935 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:59:28.354606 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-fea6fe86-f47f-4a4c-b28c-0870bf4cf935 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd" status: 200 len: 1270 microversion: 2.1 time: 0.338963 Oct 08 20:59:28.366215 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 951/1915] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:59:28 2022] GET /compute/v2.1/servers/d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd => generated 1270 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:59:28.456863 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-c492c5a0-4fc7-4050-a6c7-b9638234d0a2 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-201067527", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "networks": [{"uuid": "c41f533b-3d58-437d-aabe-ca70495afe03"}]}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:59:28.638760 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.network.neutron [None req-c492c5a0-4fc7-4050-a6c7-b9638234d0a2 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] validate_networks() for [('c41f533b-3d58-437d-aabe-ca70495afe03', None, None, None, None, None)] {{(pid=140492) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 20:59:28.664845 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-b7f25807-11a7-48b5-9be2-1091ad31355b tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:59:28.665960 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-b7f25807-11a7-48b5-9be2-1091ad31355b tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] [instance: 50c38cf5-c054-447c-99a8-10bae624b09a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:59:28.697002 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b7f25807-11a7-48b5-9be2-1091ad31355b tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:28.700590 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b7f25807-11a7-48b5-9be2-1091ad31355b tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:28.723361 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b7f25807-11a7-48b5-9be2-1091ad31355b tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:28.724320 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b7f25807-11a7-48b5-9be2-1091ad31355b tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:28.724870 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b7f25807-11a7-48b5-9be2-1091ad31355b tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:28.734144 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b7f25807-11a7-48b5-9be2-1091ad31355b tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:29.163044 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-b7f25807-11a7-48b5-9be2-1091ad31355b tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ddc3cd3c374bacbe5bf5e0877380e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8472b054404c46a99b81aba34d6b9f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:59:29.180913 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=2 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:59:29.216826 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-b7f25807-11a7-48b5-9be2-1091ad31355b tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] 10.222.0.26 "GET /compute/v2.1/servers/50c38cf5-c054-447c-99a8-10bae624b09a" status: 200 len: 1317 microversion: 2.1 time: 0.558256 Oct 08 20:59:29.217796 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 952/1916] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:59:28 2022] GET /compute/v2.1/servers/50c38cf5-c054-447c-99a8-10bae624b09a => generated 1317 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:59:29.470544 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-e152653d-97c8-40f0-be9c-453a0b410031 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Action: 'create', calling method: .version_select at 0x7f1a8c8d8ee0>, body: {"keypair": {"name": "tempest-keypair-1744260174", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAvbzKThmbPjiIhhhws2lCdzMHhA9NDQn/AxPYJFqnU6Kxdd8FeM3chBXGNHkNhqjZQWHE/Sbt9fttXCsW2qJkZzkMin0+iSOBUuJy2yZTXBojKxQOQsBih6yEq5jIUlig=="}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:59:29.503834 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-e152653d-97c8-40f0-be9c-453a0b410031 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Getting quotas for project e191d6217f024a17a14184071ac674c7. Resources: {'key_pairs'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 20:59:29.541977 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-e152653d-97c8-40f0-be9c-453a0b410031 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Getting quotas for user 3d2ddfa343e748c089129b0039a12ac0 and project e191d6217f024a17a14184071ac674c7. Resources: {'key_pairs'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 20:59:29.623000 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-e152653d-97c8-40f0-be9c-453a0b410031 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.402796 Oct 08 20:59:29.624783 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 953/1917] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Oct 8 20:59:29 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:59:29.655198 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-5aac76ca-ff8f-4828-8ba8-9bd1b13502d4 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:59:29.657339 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-5aac76ca-ff8f-4828-8ba8-9bd1b13502d4 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:59:29.681547 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5aac76ca-ff8f-4828-8ba8-9bd1b13502d4 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:29.682938 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5aac76ca-ff8f-4828-8ba8-9bd1b13502d4 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:29.682938 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5aac76ca-ff8f-4828-8ba8-9bd1b13502d4 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:29.684040 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5aac76ca-ff8f-4828-8ba8-9bd1b13502d4 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:29.684791 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5aac76ca-ff8f-4828-8ba8-9bd1b13502d4 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:29.685851 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5aac76ca-ff8f-4828-8ba8-9bd1b13502d4 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:30.046292 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-5aac76ca-ff8f-4828-8ba8-9bd1b13502d4 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:59:30.059629 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-5aac76ca-ff8f-4828-8ba8-9bd1b13502d4 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd" status: 200 len: 1270 microversion: 2.1 time: 0.433017 Oct 08 20:59:30.061778 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 954/1918] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:59:29 2022] GET /compute/v2.1/servers/d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd => generated 1270 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:59:30.245690 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-4e709492-37ba-4c39-8ef7-a8d4ddf15a21 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:59:30.247480 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-4e709492-37ba-4c39-8ef7-a8d4ddf15a21 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] [instance: 50c38cf5-c054-447c-99a8-10bae624b09a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:59:30.260305 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4e709492-37ba-4c39-8ef7-a8d4ddf15a21 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:30.263928 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4e709492-37ba-4c39-8ef7-a8d4ddf15a21 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:30.264692 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4e709492-37ba-4c39-8ef7-a8d4ddf15a21 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:30.265916 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4e709492-37ba-4c39-8ef7-a8d4ddf15a21 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:30.268408 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4e709492-37ba-4c39-8ef7-a8d4ddf15a21 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:30.269130 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4e709492-37ba-4c39-8ef7-a8d4ddf15a21 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:30.698722 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-4e709492-37ba-4c39-8ef7-a8d4ddf15a21 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ddc3cd3c374bacbe5bf5e0877380e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8472b054404c46a99b81aba34d6b9f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:59:30.712524 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-4e709492-37ba-4c39-8ef7-a8d4ddf15a21 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] 10.222.0.26 "GET /compute/v2.1/servers/50c38cf5-c054-447c-99a8-10bae624b09a" status: 200 len: 1317 microversion: 2.1 time: 0.469803 Oct 08 20:59:30.714447 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 955/1919] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:59:30 2022] GET /compute/v2.1/servers/50c38cf5-c054-447c-99a8-10bae624b09a => generated 1317 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:59:31.096543 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-04a28018-5da7-4ace-ac1b-48b65d59f59a tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:59:31.097829 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-04a28018-5da7-4ace-ac1b-48b65d59f59a tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:59:31.119362 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-04a28018-5da7-4ace-ac1b-48b65d59f59a tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:31.120860 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-04a28018-5da7-4ace-ac1b-48b65d59f59a tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:31.122422 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-04a28018-5da7-4ace-ac1b-48b65d59f59a tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:31.127819 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-04a28018-5da7-4ace-ac1b-48b65d59f59a tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:31.130193 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-04a28018-5da7-4ace-ac1b-48b65d59f59a tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:31.131225 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-04a28018-5da7-4ace-ac1b-48b65d59f59a tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:31.409854 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-04a28018-5da7-4ace-ac1b-48b65d59f59a tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:59:31.420230 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-04a28018-5da7-4ace-ac1b-48b65d59f59a tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd" status: 200 len: 1270 microversion: 2.1 time: 0.329839 Oct 08 20:59:31.425928 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 956/1920] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:59:31 2022] GET /compute/v2.1/servers/d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd => generated 1270 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:59:31.744080 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-881e4bad-8b47-4de6-9108-a45de11b3edb tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:59:31.745776 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-881e4bad-8b47-4de6-9108-a45de11b3edb tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] [instance: 50c38cf5-c054-447c-99a8-10bae624b09a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:59:31.770713 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-881e4bad-8b47-4de6-9108-a45de11b3edb tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:31.773819 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-881e4bad-8b47-4de6-9108-a45de11b3edb tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:31.774344 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-881e4bad-8b47-4de6-9108-a45de11b3edb tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:31.779014 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-881e4bad-8b47-4de6-9108-a45de11b3edb tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:31.779596 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-881e4bad-8b47-4de6-9108-a45de11b3edb tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:31.780053 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-881e4bad-8b47-4de6-9108-a45de11b3edb tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:32.243718 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-881e4bad-8b47-4de6-9108-a45de11b3edb tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ddc3cd3c374bacbe5bf5e0877380e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8472b054404c46a99b81aba34d6b9f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:59:32.256567 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-881e4bad-8b47-4de6-9108-a45de11b3edb tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] 10.222.0.26 "GET /compute/v2.1/servers/50c38cf5-c054-447c-99a8-10bae624b09a" status: 200 len: 1317 microversion: 2.1 time: 0.516459 Oct 08 20:59:32.259981 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 957/1921] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:59:31 2022] GET /compute/v2.1/servers/50c38cf5-c054-447c-99a8-10bae624b09a => generated 1317 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:59:32.337003 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-c492c5a0-4fc7-4050-a6c7-b9638234d0a2 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Flavor limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 20:59:32.337496 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-c492c5a0-4fc7-4050-a6c7-b9638234d0a2 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Image limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 20:59:32.337958 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-c492c5a0-4fc7-4050-a6c7-b9638234d0a2 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Flavor pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 20:59:32.338390 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-c492c5a0-4fc7-4050-a6c7-b9638234d0a2 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Image pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 20:59:32.338826 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-c492c5a0-4fc7-4050-a6c7-b9638234d0a2 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 20:59:32.378170 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c492c5a0-4fc7-4050-a6c7-b9638234d0a2 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:32.379270 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c492c5a0-4fc7-4050-a6c7-b9638234d0a2 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:32.380866 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c492c5a0-4fc7-4050-a6c7-b9638234d0a2 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:32.381804 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c492c5a0-4fc7-4050-a6c7-b9638234d0a2 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:32.382291 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c492c5a0-4fc7-4050-a6c7-b9638234d0a2 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:32.382744 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c492c5a0-4fc7-4050-a6c7-b9638234d0a2 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:32.413107 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-c492c5a0-4fc7-4050-a6c7-b9638234d0a2 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Getting quotas for project de0921d976db440c8f59ba2f065642a0. Resources: {'cores', 'instances', 'ram'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 20:59:32.426590 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-c492c5a0-4fc7-4050-a6c7-b9638234d0a2 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Getting quotas for user 6bee8de1c3524b0f8a0dd73898637aa7 and project de0921d976db440c8f59ba2f065642a0. Resources: {'cores', 'instances', 'ram'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 20:59:32.449361 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-404e7317-7691-473e-9e7f-f7bf057bd1c4 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:59:32.451398 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-404e7317-7691-473e-9e7f-f7bf057bd1c4 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:59:32.467634 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-c492c5a0-4fc7-4050-a6c7-b9638234d0a2 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Going to run 1 instances... {{(pid=140492) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 20:59:32.479255 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-c492c5a0-4fc7-4050-a6c7-b9638234d0a2 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] [instance: f38fc6d8-db15-4fcc-becb-9eff61447f11] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c508bd7f-7db9-4b2c-af7c-be54a855c355',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140492) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 20:59:32.480659 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-404e7317-7691-473e-9e7f-f7bf057bd1c4 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:32.481930 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-404e7317-7691-473e-9e7f-f7bf057bd1c4 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:32.486223 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-404e7317-7691-473e-9e7f-f7bf057bd1c4 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:32.490923 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-404e7317-7691-473e-9e7f-f7bf057bd1c4 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:32.493893 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-404e7317-7691-473e-9e7f-f7bf057bd1c4 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:32.496972 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-404e7317-7691-473e-9e7f-f7bf057bd1c4 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:32.596369 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-c492c5a0-4fc7-4050-a6c7-b9638234d0a2 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.305987 Oct 08 20:59:32.598285 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 965/1922] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 20:59:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 4312 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 08 20:59:32.612745 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-5511bdf6-d424-41fa-b568-17461715850f tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:59:32.616189 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-5511bdf6-d424-41fa-b568-17461715850f tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] [instance: f38fc6d8-db15-4fcc-becb-9eff61447f11] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:59:32.769929 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-404e7317-7691-473e-9e7f-f7bf057bd1c4 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:59:32.782011 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-404e7317-7691-473e-9e7f-f7bf057bd1c4 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd" status: 200 len: 1270 microversion: 2.1 time: 0.337824 Oct 08 20:59:32.802354 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 958/1923] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:59:32 2022] GET /compute/v2.1/servers/d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd => generated 1270 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 20:59:32.948472 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-1fdc0dc1-385f-4557-939f-a74f724f4d4b tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1911406225", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:59:32.999958 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-5511bdf6-d424-41fa-b568-17461715850f tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bee8de1c3524b0f8a0dd73898637aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0921d976db440c8f59ba2f065642a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:59:33.031929 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-5511bdf6-d424-41fa-b568-17461715850f tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] 10.222.0.26 "GET /compute/v2.1/servers/f38fc6d8-db15-4fcc-becb-9eff61447f11" status: 200 len: 1224 microversion: 2.1 time: 0.403449 Oct 08 20:59:33.035161 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 966/1924] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:59:32 2022] GET /compute/v2.1/servers/f38fc6d8-db15-4fcc-becb-9eff61447f11 => generated 1224 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 20:59:33.079060 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.network.neutron [None req-1fdc0dc1-385f-4557-939f-a74f724f4d4b tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] validate_networks() for [('397efcee-7238-4c94-81ba-59f55206810f', None, None, None, None, None)] {{(pid=140491) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 20:59:33.289808 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-03631a80-2f4d-4a4e-ab1b-dff467f2c5e9 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:59:33.290792 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-03631a80-2f4d-4a4e-ab1b-dff467f2c5e9 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] [instance: 50c38cf5-c054-447c-99a8-10bae624b09a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:59:33.307636 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-03631a80-2f4d-4a4e-ab1b-dff467f2c5e9 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:33.318420 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-03631a80-2f4d-4a4e-ab1b-dff467f2c5e9 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:33.322577 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-03631a80-2f4d-4a4e-ab1b-dff467f2c5e9 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:33.322577 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-03631a80-2f4d-4a4e-ab1b-dff467f2c5e9 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:33.322577 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-03631a80-2f4d-4a4e-ab1b-dff467f2c5e9 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:33.322577 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-03631a80-2f4d-4a4e-ab1b-dff467f2c5e9 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:34.723218 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=2 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:59:35.039329 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-03631a80-2f4d-4a4e-ab1b-dff467f2c5e9 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ddc3cd3c374bacbe5bf5e0877380e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8472b054404c46a99b81aba34d6b9f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:59:35.057565 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-03631a80-2f4d-4a4e-ab1b-dff467f2c5e9 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] 10.222.0.26 "GET /compute/v2.1/servers/50c38cf5-c054-447c-99a8-10bae624b09a" status: 200 len: 1317 microversion: 2.1 time: 1.773226 Oct 08 20:59:35.058242 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 967/1925] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:59:33 2022] GET /compute/v2.1/servers/50c38cf5-c054-447c-99a8-10bae624b09a => generated 1317 bytes in 1775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 20:59:35.082581 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-fde99788-d8eb-48a0-931a-3dac6aa2ea4a tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:59:35.083221 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-fde99788-d8eb-48a0-931a-3dac6aa2ea4a tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:59:35.097796 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fde99788-d8eb-48a0-931a-3dac6aa2ea4a tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:35.098313 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fde99788-d8eb-48a0-931a-3dac6aa2ea4a tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:35.098769 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fde99788-d8eb-48a0-931a-3dac6aa2ea4a tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:35.099510 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fde99788-d8eb-48a0-931a-3dac6aa2ea4a tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:35.109348 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fde99788-d8eb-48a0-931a-3dac6aa2ea4a tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:35.110022 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fde99788-d8eb-48a0-931a-3dac6aa2ea4a tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:35.548717 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-1fdc0dc1-385f-4557-939f-a74f724f4d4b tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Flavor limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 20:59:35.549155 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-1fdc0dc1-385f-4557-939f-a74f724f4d4b tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Image limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 20:59:35.549677 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-1fdc0dc1-385f-4557-939f-a74f724f4d4b tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Flavor pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 20:59:35.550110 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-1fdc0dc1-385f-4557-939f-a74f724f4d4b tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Image pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 20:59:35.550538 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-1fdc0dc1-385f-4557-939f-a74f724f4d4b tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 20:59:35.571424 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1fdc0dc1-385f-4557-939f-a74f724f4d4b tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:35.572022 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1fdc0dc1-385f-4557-939f-a74f724f4d4b tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:35.572951 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1fdc0dc1-385f-4557-939f-a74f724f4d4b tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:35.575523 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1fdc0dc1-385f-4557-939f-a74f724f4d4b tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:35.576798 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1fdc0dc1-385f-4557-939f-a74f724f4d4b tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:35.577119 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1fdc0dc1-385f-4557-939f-a74f724f4d4b tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:35.636925 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-1fdc0dc1-385f-4557-939f-a74f724f4d4b tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Getting quotas for project 8b00ee5e7828469f95bd90548d35982a. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 20:59:35.665105 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-1fdc0dc1-385f-4557-939f-a74f724f4d4b tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Getting quotas for user 1698dee4a2bf4ea19a6ee0c3d5cb5c09 and project 8b00ee5e7828469f95bd90548d35982a. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 20:59:35.718502 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-1fdc0dc1-385f-4557-939f-a74f724f4d4b tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Going to run 1 instances... {{(pid=140491) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 20:59:35.723609 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-1fdc0dc1-385f-4557-939f-a74f724f4d4b tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] [instance: 579b0f8b-ccae-4c2b-bb48-1da1aaf6a138] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c508bd7f-7db9-4b2c-af7c-be54a855c355',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140491) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 20:59:35.811034 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-1fdc0dc1-385f-4557-939f-a74f724f4d4b tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.974691 Oct 08 20:59:35.819758 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 959/1926] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 20:59:32 2022] POST /compute/v2.1/servers => generated 383 bytes in 2984 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 08 20:59:35.825069 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-7d4f66d7-86fe-4d91-ab68-1901a19b434e tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:59:35.840392 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-7d4f66d7-86fe-4d91-ab68-1901a19b434e tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] [instance: f38fc6d8-db15-4fcc-becb-9eff61447f11] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:59:35.872311 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7d4f66d7-86fe-4d91-ab68-1901a19b434e tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:35.873129 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7d4f66d7-86fe-4d91-ab68-1901a19b434e tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:35.878919 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7d4f66d7-86fe-4d91-ab68-1901a19b434e tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:35.879955 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7d4f66d7-86fe-4d91-ab68-1901a19b434e tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:35.881930 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7d4f66d7-86fe-4d91-ab68-1901a19b434e tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:35.882593 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7d4f66d7-86fe-4d91-ab68-1901a19b434e tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:35.980217 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-fde99788-d8eb-48a0-931a-3dac6aa2ea4a tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:59:35.998660 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-fde99788-d8eb-48a0-931a-3dac6aa2ea4a tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd" status: 200 len: 1312 microversion: 2.1 time: 0.927288 Oct 08 20:59:36.018593 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 968/1927] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:59:35 2022] GET /compute/v2.1/servers/d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd => generated 1312 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:59:36.028071 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-cf2aba1d-e26a-475f-b5f8-d0202ad24994 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:59:36.031910 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-cf2aba1d-e26a-475f-b5f8-d0202ad24994 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] [instance: 579b0f8b-ccae-4c2b-bb48-1da1aaf6a138] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:59:36.426579 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-cf2aba1d-e26a-475f-b5f8-d0202ad24994 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1698dee4a2bf4ea19a6ee0c3d5cb5c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b00ee5e7828469f95bd90548d35982a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:59:36.442045 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-cf2aba1d-e26a-475f-b5f8-d0202ad24994 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] 10.222.0.26 "GET /compute/v2.1/servers/579b0f8b-ccae-4c2b-bb48-1da1aaf6a138" status: 200 len: 1222 microversion: 2.1 time: 0.419109 Oct 08 20:59:36.444207 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 969/1928] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:59:36 2022] GET /compute/v2.1/servers/579b0f8b-ccae-4c2b-bb48-1da1aaf6a138 => generated 1222 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:59:36.450223 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-f99d8522-c502-48d5-9dd9-a85befba0dc3 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:59:36.451678 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-f99d8522-c502-48d5-9dd9-a85befba0dc3 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] [instance: 50c38cf5-c054-447c-99a8-10bae624b09a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:59:36.463391 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f99d8522-c502-48d5-9dd9-a85befba0dc3 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:36.465108 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f99d8522-c502-48d5-9dd9-a85befba0dc3 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:36.466312 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f99d8522-c502-48d5-9dd9-a85befba0dc3 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:36.467335 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f99d8522-c502-48d5-9dd9-a85befba0dc3 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:36.470994 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f99d8522-c502-48d5-9dd9-a85befba0dc3 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:36.471843 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f99d8522-c502-48d5-9dd9-a85befba0dc3 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:36.739163 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-7d4f66d7-86fe-4d91-ab68-1901a19b434e tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bee8de1c3524b0f8a0dd73898637aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0921d976db440c8f59ba2f065642a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:59:36.753537 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-7d4f66d7-86fe-4d91-ab68-1901a19b434e tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] 10.222.0.26 "GET /compute/v2.1/servers/f38fc6d8-db15-4fcc-becb-9eff61447f11" status: 200 len: 1282 microversion: 2.1 time: 0.928172 Oct 08 20:59:36.755133 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 960/1929] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:59:35 2022] GET /compute/v2.1/servers/f38fc6d8-db15-4fcc-becb-9eff61447f11 => generated 1282 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:59:36.770789 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-b82d0dd9-c72a-4d5d-8019-160b53269ea1 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-334134291", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:59:36.900844 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.network.neutron [None req-b82d0dd9-c72a-4d5d-8019-160b53269ea1 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] validate_networks() for [('397efcee-7238-4c94-81ba-59f55206810f', None, None, None, None, None)] {{(pid=140491) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 20:59:38.078329 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-b82d0dd9-c72a-4d5d-8019-160b53269ea1 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Flavor limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 20:59:38.079502 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-b82d0dd9-c72a-4d5d-8019-160b53269ea1 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Image limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 20:59:38.080228 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-b82d0dd9-c72a-4d5d-8019-160b53269ea1 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Flavor pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 20:59:38.081014 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-b82d0dd9-c72a-4d5d-8019-160b53269ea1 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Image pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 20:59:38.081659 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-b82d0dd9-c72a-4d5d-8019-160b53269ea1 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 20:59:38.091487 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=21 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:59:38.123892 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b82d0dd9-c72a-4d5d-8019-160b53269ea1 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:38.130293 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b82d0dd9-c72a-4d5d-8019-160b53269ea1 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:38.131687 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b82d0dd9-c72a-4d5d-8019-160b53269ea1 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:38.132638 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b82d0dd9-c72a-4d5d-8019-160b53269ea1 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:38.133116 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b82d0dd9-c72a-4d5d-8019-160b53269ea1 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:38.147899 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b82d0dd9-c72a-4d5d-8019-160b53269ea1 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:38.214876 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-b82d0dd9-c72a-4d5d-8019-160b53269ea1 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Getting quotas for project 8b00ee5e7828469f95bd90548d35982a. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 20:59:38.223364 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-b82d0dd9-c72a-4d5d-8019-160b53269ea1 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Getting quotas for user 1698dee4a2bf4ea19a6ee0c3d5cb5c09 and project 8b00ee5e7828469f95bd90548d35982a. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 20:59:38.263436 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-b82d0dd9-c72a-4d5d-8019-160b53269ea1 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Going to run 1 instances... {{(pid=140491) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 20:59:38.268042 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-b82d0dd9-c72a-4d5d-8019-160b53269ea1 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] [instance: 75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c508bd7f-7db9-4b2c-af7c-be54a855c355',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140491) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 20:59:38.288644 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-f99d8522-c502-48d5-9dd9-a85befba0dc3 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ddc3cd3c374bacbe5bf5e0877380e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8472b054404c46a99b81aba34d6b9f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:59:38.303605 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-f99d8522-c502-48d5-9dd9-a85befba0dc3 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] 10.222.0.26 "GET /compute/v2.1/servers/50c38cf5-c054-447c-99a8-10bae624b09a" status: 200 len: 1317 microversion: 2.1 time: 1.858304 Oct 08 20:59:38.305272 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 970/1930] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:59:36 2022] GET /compute/v2.1/servers/50c38cf5-c054-447c-99a8-10bae624b09a => generated 1317 bytes in 1860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:59:38.328151 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-4bba9814-1e65-462b-9211-3acbfba057d6 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1353742572", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "networks": [{"uuid": "76f17cb4-51d3-49d9-9b79-ac48564ee791"}], "security_groups": [{"name": "tempest-securitygroup--1043373005"}], "key_name": "tempest-keypair-1744260174", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:59:38.367844 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-b82d0dd9-c72a-4d5d-8019-160b53269ea1 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.609941 Oct 08 20:59:38.381793 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 961/1931] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 20:59:36 2022] POST /compute/v2.1/servers => generated 383 bytes in 1626 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 08 20:59:38.400257 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-9f60c04c-a19b-4d69-9161-9f03cdd20730 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:59:38.403657 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-9f60c04c-a19b-4d69-9161-9f03cdd20730 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:59:38.429904 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:59:38.440735 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9f60c04c-a19b-4d69-9161-9f03cdd20730 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:38.441539 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9f60c04c-a19b-4d69-9161-9f03cdd20730 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:38.442909 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9f60c04c-a19b-4d69-9161-9f03cdd20730 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:38.445283 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9f60c04c-a19b-4d69-9161-9f03cdd20730 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:38.446500 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9f60c04c-a19b-4d69-9161-9f03cdd20730 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:38.448557 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9f60c04c-a19b-4d69-9161-9f03cdd20730 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:38.944141 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.network.neutron [None req-4bba9814-1e65-462b-9211-3acbfba057d6 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] validate_networks() for [('76f17cb4-51d3-49d9-9b79-ac48564ee791', None, None, None, None, None)] {{(pid=140492) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 20:59:39.286230 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-9f60c04c-a19b-4d69-9161-9f03cdd20730 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:59:39.295963 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-9f60c04c-a19b-4d69-9161-9f03cdd20730 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd" status: 200 len: 1312 microversion: 2.1 time: 0.911123 Oct 08 20:59:39.300552 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 962/1932] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:59:38 2022] GET /compute/v2.1/servers/d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd => generated 1312 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:59:39.315376 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-5f0bd9f5-4b9c-43ef-bc64-2826f9d76f5d tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:59:39.316309 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-5f0bd9f5-4b9c-43ef-bc64-2826f9d76f5d tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] [instance: f38fc6d8-db15-4fcc-becb-9eff61447f11] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:59:39.332377 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5f0bd9f5-4b9c-43ef-bc64-2826f9d76f5d tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:39.333340 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5f0bd9f5-4b9c-43ef-bc64-2826f9d76f5d tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:39.334102 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5f0bd9f5-4b9c-43ef-bc64-2826f9d76f5d tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:39.335219 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5f0bd9f5-4b9c-43ef-bc64-2826f9d76f5d tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:39.338393 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5f0bd9f5-4b9c-43ef-bc64-2826f9d76f5d tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:39.340414 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5f0bd9f5-4b9c-43ef-bc64-2826f9d76f5d tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:39.693161 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-5f0bd9f5-4b9c-43ef-bc64-2826f9d76f5d tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bee8de1c3524b0f8a0dd73898637aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0921d976db440c8f59ba2f065642a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:59:39.706867 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-5f0bd9f5-4b9c-43ef-bc64-2826f9d76f5d tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] 10.222.0.26 "GET /compute/v2.1/servers/f38fc6d8-db15-4fcc-becb-9eff61447f11" status: 200 len: 1282 microversion: 2.1 time: 0.395467 Oct 08 20:59:39.710366 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 963/1933] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:59:39 2022] GET /compute/v2.1/servers/f38fc6d8-db15-4fcc-becb-9eff61447f11 => generated 1282 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:59:39.721930 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-79a934ac-77eb-48e7-836c-6240bf71a831 req-b955b764-4397-447f-b531-d7148aeca04c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50c38cf5-c054-447c-99a8-10bae624b09a", "tag": "f499078f-7a9e-454a-a5d3-4496996e319d"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:59:39.754519 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-79a934ac-77eb-48e7-836c-6240bf71a831 req-b955b764-4397-447f-b531-d7148aeca04c service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:39.755025 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-79a934ac-77eb-48e7-836c-6240bf71a831 req-b955b764-4397-447f-b531-d7148aeca04c service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:39.755485 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-79a934ac-77eb-48e7-836c-6240bf71a831 req-b955b764-4397-447f-b531-d7148aeca04c service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:39.771940 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=100 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:59:39.826689 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-79a934ac-77eb-48e7-836c-6240bf71a831 req-b955b764-4397-447f-b531-d7148aeca04c service nova] Creating event network-changed:f499078f-7a9e-454a-a5d3-4496996e319d for instance 50c38cf5-c054-447c-99a8-10bae624b09a on nch2-master-1 Oct 08 20:59:39.840330 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-79a934ac-77eb-48e7-836c-6240bf71a831 req-b955b764-4397-447f-b531-d7148aeca04c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126858 Oct 08 20:59:39.843471 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 964/1934] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:59:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:59:39.855139 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-37bde92c-2d65-45bb-bcaa-eba30dd3b691 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:59:39.857942 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-37bde92c-2d65-45bb-bcaa-eba30dd3b691 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] [instance: 75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:59:39.878347 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-37bde92c-2d65-45bb-bcaa-eba30dd3b691 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:39.879317 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-37bde92c-2d65-45bb-bcaa-eba30dd3b691 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:39.882019 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-37bde92c-2d65-45bb-bcaa-eba30dd3b691 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:39.883694 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-37bde92c-2d65-45bb-bcaa-eba30dd3b691 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:39.886502 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-37bde92c-2d65-45bb-bcaa-eba30dd3b691 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:39.889480 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-37bde92c-2d65-45bb-bcaa-eba30dd3b691 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:40.232903 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-37bde92c-2d65-45bb-bcaa-eba30dd3b691 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1698dee4a2bf4ea19a6ee0c3d5cb5c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b00ee5e7828469f95bd90548d35982a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:59:40.246368 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-37bde92c-2d65-45bb-bcaa-eba30dd3b691 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] 10.222.0.26 "GET /compute/v2.1/servers/75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a" status: 200 len: 1273 microversion: 2.1 time: 0.400821 Oct 08 20:59:40.249799 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 965/1935] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:59:39 2022] GET /compute/v2.1/servers/75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a => generated 1273 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:59:40.260544 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-b17056e3-cfac-444d-b058-05cb346bff12 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:59:40.263525 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-b17056e3-cfac-444d-b058-05cb346bff12 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] [instance: 50c38cf5-c054-447c-99a8-10bae624b09a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:59:40.282777 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b17056e3-cfac-444d-b058-05cb346bff12 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:40.283287 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b17056e3-cfac-444d-b058-05cb346bff12 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:40.283735 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b17056e3-cfac-444d-b058-05cb346bff12 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:40.293518 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b17056e3-cfac-444d-b058-05cb346bff12 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:40.295944 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b17056e3-cfac-444d-b058-05cb346bff12 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:40.297052 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b17056e3-cfac-444d-b058-05cb346bff12 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:40.795436 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-4bba9814-1e65-462b-9211-3acbfba057d6 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Flavor limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 20:59:40.796839 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-4bba9814-1e65-462b-9211-3acbfba057d6 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Image limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 20:59:40.797107 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-4bba9814-1e65-462b-9211-3acbfba057d6 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Flavor pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 20:59:40.797740 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-4bba9814-1e65-462b-9211-3acbfba057d6 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Image pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 20:59:40.798368 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-4bba9814-1e65-462b-9211-3acbfba057d6 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 20:59:40.823118 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4bba9814-1e65-462b-9211-3acbfba057d6 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:40.825586 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4bba9814-1e65-462b-9211-3acbfba057d6 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:40.826274 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4bba9814-1e65-462b-9211-3acbfba057d6 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:40.830147 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4bba9814-1e65-462b-9211-3acbfba057d6 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:40.831440 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4bba9814-1e65-462b-9211-3acbfba057d6 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:40.832550 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4bba9814-1e65-462b-9211-3acbfba057d6 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:40.908017 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-4bba9814-1e65-462b-9211-3acbfba057d6 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Getting quotas for project e191d6217f024a17a14184071ac674c7. Resources: {'cores', 'instances', 'ram'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 20:59:40.926258 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-4bba9814-1e65-462b-9211-3acbfba057d6 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Getting quotas for user 3d2ddfa343e748c089129b0039a12ac0 and project e191d6217f024a17a14184071ac674c7. Resources: {'cores', 'instances', 'ram'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 20:59:40.955726 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-4bba9814-1e65-462b-9211-3acbfba057d6 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Going to run 1 instances... {{(pid=140492) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 20:59:40.959890 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-4bba9814-1e65-462b-9211-3acbfba057d6 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] [instance: b1a2f781-46a1-43f3-946a-f269deb6455e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c508bd7f-7db9-4b2c-af7c-be54a855c355',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140492) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 20:59:41.073840 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-4bba9814-1e65-462b-9211-3acbfba057d6 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.767053 Oct 08 20:59:41.082921 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 971/1936] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 20:59:38 2022] POST /compute/v2.1/servers => generated 406 bytes in 2771 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 08 20:59:41.091519 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-29333c6b-a39c-4547-bde2-1e4f91f7a26c tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:59:41.094098 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-29333c6b-a39c-4547-bde2-1e4f91f7a26c tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:59:41.106761 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-29333c6b-a39c-4547-bde2-1e4f91f7a26c tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:41.107945 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-29333c6b-a39c-4547-bde2-1e4f91f7a26c tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:41.108833 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-29333c6b-a39c-4547-bde2-1e4f91f7a26c tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:41.110500 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-29333c6b-a39c-4547-bde2-1e4f91f7a26c tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:41.111073 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-29333c6b-a39c-4547-bde2-1e4f91f7a26c tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:41.111638 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-29333c6b-a39c-4547-bde2-1e4f91f7a26c tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:41.469099 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-b17056e3-cfac-444d-b058-05cb346bff12 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ddc3cd3c374bacbe5bf5e0877380e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8472b054404c46a99b81aba34d6b9f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:59:41.485072 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-b17056e3-cfac-444d-b058-05cb346bff12 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] 10.222.0.26 "GET /compute/v2.1/servers/50c38cf5-c054-447c-99a8-10bae624b09a" status: 200 len: 1317 microversion: 2.1 time: 1.233921 Oct 08 20:59:41.487450 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 966/1937] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:59:40 2022] GET /compute/v2.1/servers/50c38cf5-c054-447c-99a8-10bae624b09a => generated 1317 bytes in 1237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:59:41.501795 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-0e5289c0-e2a0-4d64-93f8-269fb1b0f536 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:59:41.503472 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-0e5289c0-e2a0-4d64-93f8-269fb1b0f536 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] [instance: f38fc6d8-db15-4fcc-becb-9eff61447f11] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:59:41.532131 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-29333c6b-a39c-4547-bde2-1e4f91f7a26c tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:59:41.535157 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0e5289c0-e2a0-4d64-93f8-269fb1b0f536 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:41.540995 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0e5289c0-e2a0-4d64-93f8-269fb1b0f536 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:41.544162 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0e5289c0-e2a0-4d64-93f8-269fb1b0f536 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:41.545160 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0e5289c0-e2a0-4d64-93f8-269fb1b0f536 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:41.545775 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0e5289c0-e2a0-4d64-93f8-269fb1b0f536 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:41.549006 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-29333c6b-a39c-4547-bde2-1e4f91f7a26c tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd" status: 200 len: 1312 microversion: 2.1 time: 0.470228 Oct 08 20:59:41.549724 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0e5289c0-e2a0-4d64-93f8-269fb1b0f536 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:41.554108 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 972/1938] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:59:41 2022] GET /compute/v2.1/servers/d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd => generated 1312 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:59:41.564711 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-2d728282-32b9-4c10-867c-dac9fc833bc1 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:59:41.571826 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-2d728282-32b9-4c10-867c-dac9fc833bc1 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] [instance: b1a2f781-46a1-43f3-946a-f269deb6455e] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:59:42.035722 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-2d728282-32b9-4c10-867c-dac9fc833bc1 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d2ddfa343e748c089129b0039a12ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e191d6217f024a17a14184071ac674c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:59:42.049689 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-2d728282-32b9-4c10-867c-dac9fc833bc1 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] 10.222.0.26 "GET /compute/v2.1/servers/b1a2f781-46a1-43f3-946a-f269deb6455e" status: 200 len: 1242 microversion: 2.1 time: 0.494065 Oct 08 20:59:42.058638 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 973/1939] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:59:41 2022] GET /compute/v2.1/servers/b1a2f781-46a1-43f3-946a-f269deb6455e => generated 1242 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:59:42.076471 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-20492b25-0233-456a-9392-d0c8b2fa7cc2 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:59:42.079971 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-20492b25-0233-456a-9392-d0c8b2fa7cc2 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] [instance: 75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:59:42.107771 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-20492b25-0233-456a-9392-d0c8b2fa7cc2 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:42.117363 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-20492b25-0233-456a-9392-d0c8b2fa7cc2 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:42.120428 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-20492b25-0233-456a-9392-d0c8b2fa7cc2 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:42.123589 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-20492b25-0233-456a-9392-d0c8b2fa7cc2 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:42.125256 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-20492b25-0233-456a-9392-d0c8b2fa7cc2 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:42.126759 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-20492b25-0233-456a-9392-d0c8b2fa7cc2 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:42.187085 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=83 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:59:42.396038 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-20492b25-0233-456a-9392-d0c8b2fa7cc2 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1698dee4a2bf4ea19a6ee0c3d5cb5c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b00ee5e7828469f95bd90548d35982a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:59:42.404789 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-20492b25-0233-456a-9392-d0c8b2fa7cc2 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] 10.222.0.26 "GET /compute/v2.1/servers/75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a" status: 200 len: 1279 microversion: 2.1 time: 0.344529 Oct 08 20:59:42.425683 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 974/1940] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:59:42 2022] GET /compute/v2.1/servers/75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a => generated 1279 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:59:42.442444 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-526f78ab-fed9-4ad3-880d-39a79158dc56 req-36d94c07-894e-4fb0-97a5-b22372bee577 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd", "tag": "1e8ee887-8012-4f64-a840-73388344bd23"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:59:42.473063 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-526f78ab-fed9-4ad3-880d-39a79158dc56 req-36d94c07-894e-4fb0-97a5-b22372bee577 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:42.476063 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-526f78ab-fed9-4ad3-880d-39a79158dc56 req-36d94c07-894e-4fb0-97a5-b22372bee577 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:42.476679 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-526f78ab-fed9-4ad3-880d-39a79158dc56 req-36d94c07-894e-4fb0-97a5-b22372bee577 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:42.514052 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-526f78ab-fed9-4ad3-880d-39a79158dc56 req-36d94c07-894e-4fb0-97a5-b22372bee577 service nova] Creating event network-changed:1e8ee887-8012-4f64-a840-73388344bd23 for instance d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd on nch2-master-1 Oct 08 20:59:42.525470 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-526f78ab-fed9-4ad3-880d-39a79158dc56 req-36d94c07-894e-4fb0-97a5-b22372bee577 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095046 Oct 08 20:59:42.526461 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 975/1941] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:59:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:59:42.532527 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-70bd9c93-724f-4565-b8d9-7af315450ed2 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:59:42.533693 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-70bd9c93-724f-4565-b8d9-7af315450ed2 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] [instance: 50c38cf5-c054-447c-99a8-10bae624b09a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:59:42.540683 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-70bd9c93-724f-4565-b8d9-7af315450ed2 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:42.541602 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-70bd9c93-724f-4565-b8d9-7af315450ed2 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:42.542326 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-70bd9c93-724f-4565-b8d9-7af315450ed2 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:42.543291 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-70bd9c93-724f-4565-b8d9-7af315450ed2 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:42.543991 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-70bd9c93-724f-4565-b8d9-7af315450ed2 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:42.544657 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-70bd9c93-724f-4565-b8d9-7af315450ed2 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:42.844570 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-0e5289c0-e2a0-4d64-93f8-269fb1b0f536 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bee8de1c3524b0f8a0dd73898637aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0921d976db440c8f59ba2f065642a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:59:42.867643 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-0e5289c0-e2a0-4d64-93f8-269fb1b0f536 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] 10.222.0.26 "GET /compute/v2.1/servers/f38fc6d8-db15-4fcc-becb-9eff61447f11" status: 200 len: 1324 microversion: 2.1 time: 1.362396 Oct 08 20:59:42.871592 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 967/1942] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:59:41 2022] GET /compute/v2.1/servers/f38fc6d8-db15-4fcc-becb-9eff61447f11 => generated 1324 bytes in 1383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:59:42.880730 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-a1eca2e3-80a5-41b0-9004-3f5e29d8631c tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:59:42.881400 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-a1eca2e3-80a5-41b0-9004-3f5e29d8631c tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:59:42.894543 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a1eca2e3-80a5-41b0-9004-3f5e29d8631c tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:42.895660 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a1eca2e3-80a5-41b0-9004-3f5e29d8631c tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:42.896208 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a1eca2e3-80a5-41b0-9004-3f5e29d8631c tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:42.902236 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a1eca2e3-80a5-41b0-9004-3f5e29d8631c tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:42.902990 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a1eca2e3-80a5-41b0-9004-3f5e29d8631c tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:42.903614 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a1eca2e3-80a5-41b0-9004-3f5e29d8631c tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:43.007413 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-70bd9c93-724f-4565-b8d9-7af315450ed2 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ddc3cd3c374bacbe5bf5e0877380e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8472b054404c46a99b81aba34d6b9f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:59:43.018368 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-70bd9c93-724f-4565-b8d9-7af315450ed2 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] 10.222.0.26 "GET /compute/v2.1/servers/50c38cf5-c054-447c-99a8-10bae624b09a" status: 200 len: 1317 microversion: 2.1 time: 0.490471 Oct 08 20:59:43.022886 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 976/1943] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:59:42 2022] GET /compute/v2.1/servers/50c38cf5-c054-447c-99a8-10bae624b09a => generated 1317 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:59:43.082984 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-6ad093d4-9102-48fe-ba08-8f8b18210546 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:59:43.083878 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-6ad093d4-9102-48fe-ba08-8f8b18210546 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] [instance: b1a2f781-46a1-43f3-946a-f269deb6455e] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:59:43.102377 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6ad093d4-9102-48fe-ba08-8f8b18210546 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:43.112538 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6ad093d4-9102-48fe-ba08-8f8b18210546 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:43.113051 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6ad093d4-9102-48fe-ba08-8f8b18210546 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:43.114039 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6ad093d4-9102-48fe-ba08-8f8b18210546 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:43.117686 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6ad093d4-9102-48fe-ba08-8f8b18210546 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:43.118470 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6ad093d4-9102-48fe-ba08-8f8b18210546 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:43.217213 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-6ad093d4-9102-48fe-ba08-8f8b18210546 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d2ddfa343e748c089129b0039a12ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e191d6217f024a17a14184071ac674c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:59:43.231242 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-6ad093d4-9102-48fe-ba08-8f8b18210546 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] 10.222.0.26 "GET /compute/v2.1/servers/b1a2f781-46a1-43f3-946a-f269deb6455e" status: 200 len: 1294 microversion: 2.1 time: 0.158101 Oct 08 20:59:43.233482 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 977/1944] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:59:43 2022] GET /compute/v2.1/servers/b1a2f781-46a1-43f3-946a-f269deb6455e => generated 1294 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:59:43.438603 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-5558afec-97ab-41fb-8a4e-1cd4039f8acc tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:59:43.439652 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-5558afec-97ab-41fb-8a4e-1cd4039f8acc tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] [instance: 75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:59:43.454645 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5558afec-97ab-41fb-8a4e-1cd4039f8acc tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:43.455653 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5558afec-97ab-41fb-8a4e-1cd4039f8acc tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:43.456440 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5558afec-97ab-41fb-8a4e-1cd4039f8acc tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:43.457909 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5558afec-97ab-41fb-8a4e-1cd4039f8acc tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:43.458588 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5558afec-97ab-41fb-8a4e-1cd4039f8acc tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:43.459236 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5558afec-97ab-41fb-8a4e-1cd4039f8acc tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:43.520247 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-a1eca2e3-80a5-41b0-9004-3f5e29d8631c tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:59:43.534016 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-a1eca2e3-80a5-41b0-9004-3f5e29d8631c tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd" status: 200 len: 1312 microversion: 2.1 time: 0.660931 Oct 08 20:59:43.534619 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 968/1945] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:59:42 2022] GET /compute/v2.1/servers/d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd => generated 1312 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:59:43.622895 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-5558afec-97ab-41fb-8a4e-1cd4039f8acc tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1698dee4a2bf4ea19a6ee0c3d5cb5c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b00ee5e7828469f95bd90548d35982a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:59:43.633016 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-5558afec-97ab-41fb-8a4e-1cd4039f8acc tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] 10.222.0.26 "GET /compute/v2.1/servers/75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a" status: 200 len: 1279 microversion: 2.1 time: 0.198648 Oct 08 20:59:43.647939 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 978/1946] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:59:43 2022] GET /compute/v2.1/servers/75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a => generated 1279 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:59:43.893467 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-e787047f-125b-4d78-af4e-b3439b938ff0 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:59:43.894085 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-e787047f-125b-4d78-af4e-b3439b938ff0 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] [instance: f38fc6d8-db15-4fcc-becb-9eff61447f11] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:59:43.911042 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e787047f-125b-4d78-af4e-b3439b938ff0 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:43.912003 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e787047f-125b-4d78-af4e-b3439b938ff0 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:43.912625 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e787047f-125b-4d78-af4e-b3439b938ff0 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:43.913582 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e787047f-125b-4d78-af4e-b3439b938ff0 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:43.914206 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e787047f-125b-4d78-af4e-b3439b938ff0 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:43.914810 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e787047f-125b-4d78-af4e-b3439b938ff0 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:44.044273 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-aa46b2c5-17f8-4372-9ca4-7d8ed47154e7 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:59:44.044913 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-aa46b2c5-17f8-4372-9ca4-7d8ed47154e7 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] [instance: 50c38cf5-c054-447c-99a8-10bae624b09a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:59:44.047807 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=9 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:59:44.054862 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-aa46b2c5-17f8-4372-9ca4-7d8ed47154e7 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:44.055828 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-aa46b2c5-17f8-4372-9ca4-7d8ed47154e7 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:44.056694 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-aa46b2c5-17f8-4372-9ca4-7d8ed47154e7 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:44.057968 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-aa46b2c5-17f8-4372-9ca4-7d8ed47154e7 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:44.059517 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-aa46b2c5-17f8-4372-9ca4-7d8ed47154e7 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:44.060251 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-aa46b2c5-17f8-4372-9ca4-7d8ed47154e7 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:44.286371 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-e787047f-125b-4d78-af4e-b3439b938ff0 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bee8de1c3524b0f8a0dd73898637aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0921d976db440c8f59ba2f065642a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:59:44.310653 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-e787047f-125b-4d78-af4e-b3439b938ff0 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] 10.222.0.26 "GET /compute/v2.1/servers/f38fc6d8-db15-4fcc-becb-9eff61447f11" status: 200 len: 1324 microversion: 2.1 time: 0.416487 Oct 08 20:59:44.312485 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 969/1947] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:59:43 2022] GET /compute/v2.1/servers/f38fc6d8-db15-4fcc-becb-9eff61447f11 => generated 1324 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:59:44.325758 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-4d809104-ed82-4d38-9feb-703881bc7464 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:59:44.328701 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-4d809104-ed82-4d38-9feb-703881bc7464 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] [instance: b1a2f781-46a1-43f3-946a-f269deb6455e] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:59:44.358907 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4d809104-ed82-4d38-9feb-703881bc7464 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:44.361975 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4d809104-ed82-4d38-9feb-703881bc7464 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:44.362649 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4d809104-ed82-4d38-9feb-703881bc7464 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:44.364097 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4d809104-ed82-4d38-9feb-703881bc7464 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:44.365557 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4d809104-ed82-4d38-9feb-703881bc7464 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:44.366385 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4d809104-ed82-4d38-9feb-703881bc7464 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:44.382964 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-aa46b2c5-17f8-4372-9ca4-7d8ed47154e7 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ddc3cd3c374bacbe5bf5e0877380e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8472b054404c46a99b81aba34d6b9f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:59:44.415107 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-aa46b2c5-17f8-4372-9ca4-7d8ed47154e7 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] 10.222.0.26 "GET /compute/v2.1/servers/50c38cf5-c054-447c-99a8-10bae624b09a" status: 200 len: 1317 microversion: 2.1 time: 0.374773 Oct 08 20:59:44.419920 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 979/1948] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:59:44 2022] GET /compute/v2.1/servers/50c38cf5-c054-447c-99a8-10bae624b09a => generated 1317 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 20:59:44.558340 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-4d809104-ed82-4d38-9feb-703881bc7464 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d2ddfa343e748c089129b0039a12ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e191d6217f024a17a14184071ac674c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:59:44.564457 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-afa49647-436a-42bb-9140-20d06c5f1cfd tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:59:44.565610 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-afa49647-436a-42bb-9140-20d06c5f1cfd tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:59:44.579901 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-4d809104-ed82-4d38-9feb-703881bc7464 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] 10.222.0.26 "GET /compute/v2.1/servers/b1a2f781-46a1-43f3-946a-f269deb6455e" status: 200 len: 1300 microversion: 2.1 time: 0.261710 Oct 08 20:59:44.584187 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-afa49647-436a-42bb-9140-20d06c5f1cfd tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:44.584693 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-afa49647-436a-42bb-9140-20d06c5f1cfd tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:44.585233 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-afa49647-436a-42bb-9140-20d06c5f1cfd tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:44.585895 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-afa49647-436a-42bb-9140-20d06c5f1cfd tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:44.589002 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-afa49647-436a-42bb-9140-20d06c5f1cfd tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:44.589605 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-afa49647-436a-42bb-9140-20d06c5f1cfd tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:44.592138 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 970/1949] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:59:44 2022] GET /compute/v2.1/servers/b1a2f781-46a1-43f3-946a-f269deb6455e => generated 1300 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:59:44.616620 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-69d94d0e-f02a-4c35-b426-03e1a63b016e req-a69e3235-dd90-47fb-8119-d1d6ce36f9c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f38fc6d8-db15-4fcc-becb-9eff61447f11", "tag": "7b0b7619-5cb0-4170-8f5a-649131231917"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:59:44.637555 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-69d94d0e-f02a-4c35-b426-03e1a63b016e req-a69e3235-dd90-47fb-8119-d1d6ce36f9c9 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:44.638609 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-69d94d0e-f02a-4c35-b426-03e1a63b016e req-a69e3235-dd90-47fb-8119-d1d6ce36f9c9 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:44.641724 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-69d94d0e-f02a-4c35-b426-03e1a63b016e req-a69e3235-dd90-47fb-8119-d1d6ce36f9c9 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:44.682065 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-69d94d0e-f02a-4c35-b426-03e1a63b016e req-a69e3235-dd90-47fb-8119-d1d6ce36f9c9 service nova] Creating event network-changed:7b0b7619-5cb0-4170-8f5a-649131231917 for instance f38fc6d8-db15-4fcc-becb-9eff61447f11 on nch1-master-1 Oct 08 20:59:44.695722 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-69d94d0e-f02a-4c35-b426-03e1a63b016e req-a69e3235-dd90-47fb-8119-d1d6ce36f9c9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088618 Oct 08 20:59:44.699534 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 971/1950] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:59:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:59:44.707542 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-320159b6-76b3-42f0-82f5-87633a782e59 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:59:44.715038 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-320159b6-76b3-42f0-82f5-87633a782e59 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] [instance: 75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:59:44.728091 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-320159b6-76b3-42f0-82f5-87633a782e59 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:44.731746 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-320159b6-76b3-42f0-82f5-87633a782e59 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:44.732523 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-320159b6-76b3-42f0-82f5-87633a782e59 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:44.734167 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-320159b6-76b3-42f0-82f5-87633a782e59 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:44.735333 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-320159b6-76b3-42f0-82f5-87633a782e59 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:44.737309 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-320159b6-76b3-42f0-82f5-87633a782e59 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:45.586275 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-afa49647-436a-42bb-9140-20d06c5f1cfd tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:59:45.591909 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-320159b6-76b3-42f0-82f5-87633a782e59 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1698dee4a2bf4ea19a6ee0c3d5cb5c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b00ee5e7828469f95bd90548d35982a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:59:45.602643 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-afa49647-436a-42bb-9140-20d06c5f1cfd tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd" status: 200 len: 1312 microversion: 2.1 time: 1.045553 Oct 08 20:59:45.618633 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 980/1951] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:59:44 2022] GET /compute/v2.1/servers/d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd => generated 1312 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:59:45.624975 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-db8c44ff-3373-47dd-8f93-b7199b13e5f0 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:59:45.626435 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-db8c44ff-3373-47dd-8f93-b7199b13e5f0 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] [instance: f38fc6d8-db15-4fcc-becb-9eff61447f11] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:59:45.628067 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-320159b6-76b3-42f0-82f5-87633a782e59 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] 10.222.0.26 "GET /compute/v2.1/servers/75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a" status: 200 len: 1321 microversion: 2.1 time: 0.924911 Oct 08 20:59:45.638844 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 972/1952] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:59:44 2022] GET /compute/v2.1/servers/75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a => generated 1321 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:59:45.640352 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-03739f19-0f60-4ae1-bb48-f52a6ac4d703 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:59:45.641613 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-03739f19-0f60-4ae1-bb48-f52a6ac4d703 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] [instance: 50c38cf5-c054-447c-99a8-10bae624b09a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:59:45.649828 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-03739f19-0f60-4ae1-bb48-f52a6ac4d703 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:45.651251 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-03739f19-0f60-4ae1-bb48-f52a6ac4d703 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:45.651901 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-03739f19-0f60-4ae1-bb48-f52a6ac4d703 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:45.652336 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-db8c44ff-3373-47dd-8f93-b7199b13e5f0 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:45.652955 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-db8c44ff-3373-47dd-8f93-b7199b13e5f0 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:45.653540 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-db8c44ff-3373-47dd-8f93-b7199b13e5f0 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:45.653987 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-03739f19-0f60-4ae1-bb48-f52a6ac4d703 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:45.654683 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-db8c44ff-3373-47dd-8f93-b7199b13e5f0 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:45.655232 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-03739f19-0f60-4ae1-bb48-f52a6ac4d703 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:45.655729 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-03739f19-0f60-4ae1-bb48-f52a6ac4d703 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:45.656044 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-db8c44ff-3373-47dd-8f93-b7199b13e5f0 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:45.656822 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-db8c44ff-3373-47dd-8f93-b7199b13e5f0 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:45.972394 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-db8c44ff-3373-47dd-8f93-b7199b13e5f0 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bee8de1c3524b0f8a0dd73898637aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0921d976db440c8f59ba2f065642a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:59:45.985427 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-db8c44ff-3373-47dd-8f93-b7199b13e5f0 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] 10.222.0.26 "GET /compute/v2.1/servers/f38fc6d8-db15-4fcc-becb-9eff61447f11" status: 200 len: 1324 microversion: 2.1 time: 0.364924 Oct 08 20:59:45.986363 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 981/1953] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:59:45 2022] GET /compute/v2.1/servers/f38fc6d8-db15-4fcc-becb-9eff61447f11 => generated 1324 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:59:45.992498 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-f5d3e2fc-ffd4-4af6-a437-386f8cf0fa35 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:59:45.993529 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-f5d3e2fc-ffd4-4af6-a437-386f8cf0fa35 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] [instance: b1a2f781-46a1-43f3-946a-f269deb6455e] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:59:46.001840 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f5d3e2fc-ffd4-4af6-a437-386f8cf0fa35 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:46.002484 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f5d3e2fc-ffd4-4af6-a437-386f8cf0fa35 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:46.003057 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f5d3e2fc-ffd4-4af6-a437-386f8cf0fa35 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:46.003985 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f5d3e2fc-ffd4-4af6-a437-386f8cf0fa35 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:46.004560 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f5d3e2fc-ffd4-4af6-a437-386f8cf0fa35 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:46.005436 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f5d3e2fc-ffd4-4af6-a437-386f8cf0fa35 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:46.096711 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-f5d3e2fc-ffd4-4af6-a437-386f8cf0fa35 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d2ddfa343e748c089129b0039a12ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e191d6217f024a17a14184071ac674c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:59:46.106416 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-f5d3e2fc-ffd4-4af6-a437-386f8cf0fa35 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] 10.222.0.26 "GET /compute/v2.1/servers/b1a2f781-46a1-43f3-946a-f269deb6455e" status: 200 len: 1300 microversion: 2.1 time: 0.118129 Oct 08 20:59:46.107021 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 982/1954] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:59:45 2022] GET /compute/v2.1/servers/b1a2f781-46a1-43f3-946a-f269deb6455e => generated 1300 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:59:46.613121 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-03739f19-0f60-4ae1-bb48-f52a6ac4d703 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ddc3cd3c374bacbe5bf5e0877380e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8472b054404c46a99b81aba34d6b9f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:59:46.634598 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-9e8eeef2-4c6f-4acb-8e80-dd7d4bdb8cfd tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:59:46.636241 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-9e8eeef2-4c6f-4acb-8e80-dd7d4bdb8cfd tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:59:46.656131 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-03739f19-0f60-4ae1-bb48-f52a6ac4d703 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] 10.222.0.26 "GET /compute/v2.1/servers/50c38cf5-c054-447c-99a8-10bae624b09a" status: 200 len: 1317 microversion: 2.1 time: 1.017312 Oct 08 20:59:46.659360 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 973/1955] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:59:45 2022] GET /compute/v2.1/servers/50c38cf5-c054-447c-99a8-10bae624b09a => generated 1317 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:59:46.661418 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9e8eeef2-4c6f-4acb-8e80-dd7d4bdb8cfd tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:46.662250 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9e8eeef2-4c6f-4acb-8e80-dd7d4bdb8cfd tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:46.663856 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9e8eeef2-4c6f-4acb-8e80-dd7d4bdb8cfd tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:46.664755 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9e8eeef2-4c6f-4acb-8e80-dd7d4bdb8cfd tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:46.665483 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9e8eeef2-4c6f-4acb-8e80-dd7d4bdb8cfd tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:46.668909 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9e8eeef2-4c6f-4acb-8e80-dd7d4bdb8cfd tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:46.673282 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-39319781-5c10-43c3-a6f9-0fa6e0ea5678 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:59:46.674462 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-39319781-5c10-43c3-a6f9-0fa6e0ea5678 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] [instance: 75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:59:46.687367 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-39319781-5c10-43c3-a6f9-0fa6e0ea5678 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:46.688256 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-39319781-5c10-43c3-a6f9-0fa6e0ea5678 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:46.689366 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-39319781-5c10-43c3-a6f9-0fa6e0ea5678 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:46.691274 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-39319781-5c10-43c3-a6f9-0fa6e0ea5678 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:46.692046 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-39319781-5c10-43c3-a6f9-0fa6e0ea5678 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:46.692739 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-39319781-5c10-43c3-a6f9-0fa6e0ea5678 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:47.016898 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-9e8eeef2-4c6f-4acb-8e80-dd7d4bdb8cfd tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:59:47.028589 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-9e8eeef2-4c6f-4acb-8e80-dd7d4bdb8cfd tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd" status: 200 len: 1312 microversion: 2.1 time: 0.400170 Oct 08 20:59:47.029245 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 983/1956] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:59:46 2022] GET /compute/v2.1/servers/d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd => generated 1312 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:59:47.050633 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-c912246f-8ab5-4a49-a8c8-42d0bd8fb4c6 req-f79590f4-daae-4f64-8239-b9320cfe3716 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50c38cf5-c054-447c-99a8-10bae624b09a", "name": "network-vif-plugged", "status": "completed", "tag": "f499078f-7a9e-454a-a5d3-4496996e319d"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:59:47.062332 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-c912246f-8ab5-4a49-a8c8-42d0bd8fb4c6 req-f79590f4-daae-4f64-8239-b9320cfe3716 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:47.063114 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-c912246f-8ab5-4a49-a8c8-42d0bd8fb4c6 req-f79590f4-daae-4f64-8239-b9320cfe3716 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:47.063723 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-c912246f-8ab5-4a49-a8c8-42d0bd8fb4c6 req-f79590f4-daae-4f64-8239-b9320cfe3716 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:47.078786 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-c912246f-8ab5-4a49-a8c8-42d0bd8fb4c6 req-f79590f4-daae-4f64-8239-b9320cfe3716 service nova] Creating event network-vif-plugged:f499078f-7a9e-454a-a5d3-4496996e319d for instance 50c38cf5-c054-447c-99a8-10bae624b09a on nch2-master-1 Oct 08 20:59:47.085435 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-c912246f-8ab5-4a49-a8c8-42d0bd8fb4c6 req-f79590f4-daae-4f64-8239-b9320cfe3716 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038681 Oct 08 20:59:47.086586 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 984/1957] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:59:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:59:47.092609 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-9f382f22-32e4-4bc2-bfbb-61c1c39450cc tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:59:47.093939 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-9f382f22-32e4-4bc2-bfbb-61c1c39450cc tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] [instance: f38fc6d8-db15-4fcc-becb-9eff61447f11] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:59:47.103920 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9f382f22-32e4-4bc2-bfbb-61c1c39450cc tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:47.104792 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9f382f22-32e4-4bc2-bfbb-61c1c39450cc tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:47.105501 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9f382f22-32e4-4bc2-bfbb-61c1c39450cc tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:47.106974 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9f382f22-32e4-4bc2-bfbb-61c1c39450cc tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:47.109012 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9f382f22-32e4-4bc2-bfbb-61c1c39450cc tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:47.109680 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9f382f22-32e4-4bc2-bfbb-61c1c39450cc tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:47.517143 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-9f382f22-32e4-4bc2-bfbb-61c1c39450cc tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bee8de1c3524b0f8a0dd73898637aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0921d976db440c8f59ba2f065642a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:59:47.523889 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-39319781-5c10-43c3-a6f9-0fa6e0ea5678 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1698dee4a2bf4ea19a6ee0c3d5cb5c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b00ee5e7828469f95bd90548d35982a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:59:47.527744 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-9f382f22-32e4-4bc2-bfbb-61c1c39450cc tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] 10.222.0.26 "GET /compute/v2.1/servers/f38fc6d8-db15-4fcc-becb-9eff61447f11" status: 200 len: 1324 microversion: 2.1 time: 0.439639 Oct 08 20:59:47.530327 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 985/1958] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:59:47 2022] GET /compute/v2.1/servers/f38fc6d8-db15-4fcc-becb-9eff61447f11 => generated 1324 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:59:47.538201 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-39319781-5c10-43c3-a6f9-0fa6e0ea5678 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] 10.222.0.26 "GET /compute/v2.1/servers/75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a" status: 200 len: 1321 microversion: 2.1 time: 0.876933 Oct 08 20:59:47.539715 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 974/1959] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:59:46 2022] GET /compute/v2.1/servers/75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a => generated 1321 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:59:47.548298 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-a1a53703-ef95-46e7-a28f-fe8eb6a8360a req-39e0bdbc-643d-4cb2-993b-bc5315394d3c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "579b0f8b-ccae-4c2b-bb48-1da1aaf6a138", "tag": "b8ba5770-3e26-4856-865d-c7bf36a1757a"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:59:47.555913 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-67af6384-1abb-4327-9f2e-7afb0c2a858a tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:59:47.556636 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-67af6384-1abb-4327-9f2e-7afb0c2a858a tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] [instance: b1a2f781-46a1-43f3-946a-f269deb6455e] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:59:47.564317 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-a1a53703-ef95-46e7-a28f-fe8eb6a8360a req-39e0bdbc-643d-4cb2-993b-bc5315394d3c service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:47.564788 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-67af6384-1abb-4327-9f2e-7afb0c2a858a tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:47.565534 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-67af6384-1abb-4327-9f2e-7afb0c2a858a tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:47.565703 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-a1a53703-ef95-46e7-a28f-fe8eb6a8360a req-39e0bdbc-643d-4cb2-993b-bc5315394d3c service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:47.566207 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-a1a53703-ef95-46e7-a28f-fe8eb6a8360a req-39e0bdbc-643d-4cb2-993b-bc5315394d3c service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:47.566604 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-67af6384-1abb-4327-9f2e-7afb0c2a858a tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:47.567568 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-67af6384-1abb-4327-9f2e-7afb0c2a858a tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:47.568210 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-67af6384-1abb-4327-9f2e-7afb0c2a858a tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:47.568877 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-67af6384-1abb-4327-9f2e-7afb0c2a858a tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:47.584888 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-a1a53703-ef95-46e7-a28f-fe8eb6a8360a req-39e0bdbc-643d-4cb2-993b-bc5315394d3c service nova] Creating event network-changed:b8ba5770-3e26-4856-865d-c7bf36a1757a for instance 579b0f8b-ccae-4c2b-bb48-1da1aaf6a138 on nch1-master-1 Oct 08 20:59:47.596571 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-a1a53703-ef95-46e7-a28f-fe8eb6a8360a req-39e0bdbc-643d-4cb2-993b-bc5315394d3c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053982 Oct 08 20:59:47.597303 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 975/1960] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:59:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:59:47.649606 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-67af6384-1abb-4327-9f2e-7afb0c2a858a tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d2ddfa343e748c089129b0039a12ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e191d6217f024a17a14184071ac674c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:59:47.661569 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-67af6384-1abb-4327-9f2e-7afb0c2a858a tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] 10.222.0.26 "GET /compute/v2.1/servers/b1a2f781-46a1-43f3-946a-f269deb6455e" status: 200 len: 1300 microversion: 2.1 time: 0.129696 Oct 08 20:59:47.662876 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 986/1961] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:59:47 2022] GET /compute/v2.1/servers/b1a2f781-46a1-43f3-946a-f269deb6455e => generated 1300 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:59:47.687395 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-d1953940-3829-42b8-b0b1-379042e81763 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:59:47.688924 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-d1953940-3829-42b8-b0b1-379042e81763 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] [instance: 50c38cf5-c054-447c-99a8-10bae624b09a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:59:47.696872 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d1953940-3829-42b8-b0b1-379042e81763 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:47.697393 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d1953940-3829-42b8-b0b1-379042e81763 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:47.698037 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d1953940-3829-42b8-b0b1-379042e81763 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:47.756994 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d1953940-3829-42b8-b0b1-379042e81763 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:47.756994 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d1953940-3829-42b8-b0b1-379042e81763 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:47.756994 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d1953940-3829-42b8-b0b1-379042e81763 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:48.055544 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-588a115c-a700-4130-a5c9-76a715e8f4c3 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:59:48.056950 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-588a115c-a700-4130-a5c9-76a715e8f4c3 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:59:48.067217 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-588a115c-a700-4130-a5c9-76a715e8f4c3 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:48.068050 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-588a115c-a700-4130-a5c9-76a715e8f4c3 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:48.068765 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-588a115c-a700-4130-a5c9-76a715e8f4c3 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:48.069800 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-588a115c-a700-4130-a5c9-76a715e8f4c3 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:48.070471 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-588a115c-a700-4130-a5c9-76a715e8f4c3 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:48.071199 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-588a115c-a700-4130-a5c9-76a715e8f4c3 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:48.188445 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=4 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:59:48.198493 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-d1953940-3829-42b8-b0b1-379042e81763 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ddc3cd3c374bacbe5bf5e0877380e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8472b054404c46a99b81aba34d6b9f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:59:48.216952 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-d1953940-3829-42b8-b0b1-379042e81763 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] 10.222.0.26 "GET /compute/v2.1/servers/50c38cf5-c054-447c-99a8-10bae624b09a" status: 200 len: 1317 microversion: 2.1 time: 0.535507 Oct 08 20:59:48.228750 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 976/1962] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:59:47 2022] GET /compute/v2.1/servers/50c38cf5-c054-447c-99a8-10bae624b09a => generated 1317 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:59:48.340600 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-588a115c-a700-4130-a5c9-76a715e8f4c3 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:59:48.353596 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-588a115c-a700-4130-a5c9-76a715e8f4c3 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd" status: 200 len: 1312 microversion: 2.1 time: 0.302674 Oct 08 20:59:48.368835 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 987/1963] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:59:48 2022] GET /compute/v2.1/servers/d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd => generated 1312 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:59:48.383041 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=5 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:59:48.456485 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-b2c896bf-2df0-4cb3-a22e-9050a3d92b00 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-914337094", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "networks": [{"uuid": "03b40f51-e6b4-4d4c-82cf-99e0f52c3cd5"}]}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:59:48.556678 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-74c355c8-11d2-4ccd-a14e-524bd4b76536 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:59:48.558158 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-74c355c8-11d2-4ccd-a14e-524bd4b76536 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] [instance: f38fc6d8-db15-4fcc-becb-9eff61447f11] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:59:48.564668 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.network.neutron [None req-b2c896bf-2df0-4cb3-a22e-9050a3d92b00 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] validate_networks() for [('03b40f51-e6b4-4d4c-82cf-99e0f52c3cd5', None, None, None, None, None)] {{(pid=140491) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 20:59:48.567728 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-74c355c8-11d2-4ccd-a14e-524bd4b76536 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:48.568438 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-74c355c8-11d2-4ccd-a14e-524bd4b76536 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:48.569041 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-74c355c8-11d2-4ccd-a14e-524bd4b76536 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:48.569949 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-74c355c8-11d2-4ccd-a14e-524bd4b76536 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:48.570591 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-74c355c8-11d2-4ccd-a14e-524bd4b76536 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:48.571267 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-74c355c8-11d2-4ccd-a14e-524bd4b76536 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:48.754486 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-74c355c8-11d2-4ccd-a14e-524bd4b76536 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bee8de1c3524b0f8a0dd73898637aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0921d976db440c8f59ba2f065642a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:59:48.769468 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-74c355c8-11d2-4ccd-a14e-524bd4b76536 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] 10.222.0.26 "GET /compute/v2.1/servers/f38fc6d8-db15-4fcc-becb-9eff61447f11" status: 200 len: 1324 microversion: 2.1 time: 0.217137 Oct 08 20:59:48.770679 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 988/1964] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:59:48 2022] GET /compute/v2.1/servers/f38fc6d8-db15-4fcc-becb-9eff61447f11 => generated 1324 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:59:48.778023 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-16eb9d19-ef5a-460b-9b9a-841e3464ee0e tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:59:48.778955 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-16eb9d19-ef5a-460b-9b9a-841e3464ee0e tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] [instance: 75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:59:48.786836 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-16eb9d19-ef5a-460b-9b9a-841e3464ee0e tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:48.787441 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-16eb9d19-ef5a-460b-9b9a-841e3464ee0e tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:48.787914 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-16eb9d19-ef5a-460b-9b9a-841e3464ee0e tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:48.788739 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-16eb9d19-ef5a-460b-9b9a-841e3464ee0e tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:48.789238 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-16eb9d19-ef5a-460b-9b9a-841e3464ee0e tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:48.789772 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-16eb9d19-ef5a-460b-9b9a-841e3464ee0e tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:48.999699 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-16eb9d19-ef5a-460b-9b9a-841e3464ee0e tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1698dee4a2bf4ea19a6ee0c3d5cb5c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b00ee5e7828469f95bd90548d35982a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:59:49.009915 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-16eb9d19-ef5a-460b-9b9a-841e3464ee0e tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] 10.222.0.26 "GET /compute/v2.1/servers/75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a" status: 200 len: 1321 microversion: 2.1 time: 0.237602 Oct 08 20:59:49.022216 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 989/1965] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:59:48 2022] GET /compute/v2.1/servers/75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a => generated 1321 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:59:49.032327 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-5d446d02-d69b-40ed-bfda-06648ca7e94a tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:59:49.032960 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-5d446d02-d69b-40ed-bfda-06648ca7e94a tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] [instance: b1a2f781-46a1-43f3-946a-f269deb6455e] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:59:49.041130 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5d446d02-d69b-40ed-bfda-06648ca7e94a tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:49.041758 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5d446d02-d69b-40ed-bfda-06648ca7e94a tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:49.042469 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5d446d02-d69b-40ed-bfda-06648ca7e94a tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:49.043291 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5d446d02-d69b-40ed-bfda-06648ca7e94a tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:49.043611 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5d446d02-d69b-40ed-bfda-06648ca7e94a tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:49.044042 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5d446d02-d69b-40ed-bfda-06648ca7e94a tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:49.235254 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-5d446d02-d69b-40ed-bfda-06648ca7e94a tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d2ddfa343e748c089129b0039a12ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e191d6217f024a17a14184071ac674c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:59:49.243999 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-5d446d02-d69b-40ed-bfda-06648ca7e94a tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] 10.222.0.26 "GET /compute/v2.1/servers/b1a2f781-46a1-43f3-946a-f269deb6455e" status: 200 len: 1368 microversion: 2.1 time: 0.220195 Oct 08 20:59:49.244820 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 990/1966] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:59:49 2022] GET /compute/v2.1/servers/b1a2f781-46a1-43f3-946a-f269deb6455e => generated 1368 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:59:49.252639 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-555f8cd3-9f24-4049-b2f0-791d93278920 req-c5a1956b-2cbf-41e5-aa70-0056f5350b7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd", "name": "network-vif-plugged", "status": "completed", "tag": "1e8ee887-8012-4f64-a840-73388344bd23"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:59:49.264095 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-555f8cd3-9f24-4049-b2f0-791d93278920 req-c5a1956b-2cbf-41e5-aa70-0056f5350b7b service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:49.265934 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-555f8cd3-9f24-4049-b2f0-791d93278920 req-c5a1956b-2cbf-41e5-aa70-0056f5350b7b service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:49.266359 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-555f8cd3-9f24-4049-b2f0-791d93278920 req-c5a1956b-2cbf-41e5-aa70-0056f5350b7b service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:49.280862 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-555f8cd3-9f24-4049-b2f0-791d93278920 req-c5a1956b-2cbf-41e5-aa70-0056f5350b7b service nova] Creating event network-vif-plugged:1e8ee887-8012-4f64-a840-73388344bd23 for instance d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd on nch2-master-1 Oct 08 20:59:49.286355 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-555f8cd3-9f24-4049-b2f0-791d93278920 req-c5a1956b-2cbf-41e5-aa70-0056f5350b7b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040122 Oct 08 20:59:49.288331 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 991/1967] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:59:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:59:49.294367 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-b60d472d-20b0-4cf0-8e04-da1229061c5c tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:59:49.295436 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-b60d472d-20b0-4cf0-8e04-da1229061c5c tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] [instance: 50c38cf5-c054-447c-99a8-10bae624b09a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:59:49.313789 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b60d472d-20b0-4cf0-8e04-da1229061c5c tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:49.314556 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b60d472d-20b0-4cf0-8e04-da1229061c5c tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:49.315208 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b60d472d-20b0-4cf0-8e04-da1229061c5c tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:49.316080 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b60d472d-20b0-4cf0-8e04-da1229061c5c tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:49.316680 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b60d472d-20b0-4cf0-8e04-da1229061c5c tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:49.317271 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b60d472d-20b0-4cf0-8e04-da1229061c5c tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:49.582030 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-b60d472d-20b0-4cf0-8e04-da1229061c5c tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ddc3cd3c374bacbe5bf5e0877380e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8472b054404c46a99b81aba34d6b9f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:59:49.584887 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=100 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:59:49.610299 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-b60d472d-20b0-4cf0-8e04-da1229061c5c tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] 10.222.0.26 "GET /compute/v2.1/servers/50c38cf5-c054-447c-99a8-10bae624b09a" status: 200 len: 1467 microversion: 2.1 time: 0.304805 Oct 08 20:59:49.617878 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 992/1968] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:59:49 2022] GET /compute/v2.1/servers/50c38cf5-c054-447c-99a8-10bae624b09a => generated 1467 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:59:49.635949 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-866c484a-5f61-4dc5-909a-f1b173c633cd tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:59:49.636821 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-866c484a-5f61-4dc5-909a-f1b173c633cd tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:59:49.650281 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-866c484a-5f61-4dc5-909a-f1b173c633cd tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:49.650863 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-866c484a-5f61-4dc5-909a-f1b173c633cd tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:49.651350 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-866c484a-5f61-4dc5-909a-f1b173c633cd tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:49.652162 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-866c484a-5f61-4dc5-909a-f1b173c633cd tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:49.652664 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-866c484a-5f61-4dc5-909a-f1b173c633cd tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:49.653174 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-866c484a-5f61-4dc5-909a-f1b173c633cd tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:49.822078 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-866c484a-5f61-4dc5-909a-f1b173c633cd tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:59:49.839162 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-866c484a-5f61-4dc5-909a-f1b173c633cd tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd" status: 200 len: 1312 microversion: 2.1 time: 0.218933 Oct 08 20:59:49.853599 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 993/1969] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:59:49 2022] GET /compute/v2.1/servers/d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd => generated 1312 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:59:49.853599 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-4b9cdd7c-8528-493d-85e1-61bc3f72e353 tempest-ServersOnMultiNodesTest-429096361 tempest-ServersOnMultiNodesTest-429096361-project-admin] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:59:49.853599 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-4b9cdd7c-8528-493d-85e1-61bc3f72e353 tempest-ServersOnMultiNodesTest-429096361 tempest-ServersOnMultiNodesTest-429096361-project-admin] [instance: 50c38cf5-c054-447c-99a8-10bae624b09a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:59:49.860775 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4b9cdd7c-8528-493d-85e1-61bc3f72e353 tempest-ServersOnMultiNodesTest-429096361 tempest-ServersOnMultiNodesTest-429096361-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:49.862545 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4b9cdd7c-8528-493d-85e1-61bc3f72e353 tempest-ServersOnMultiNodesTest-429096361 tempest-ServersOnMultiNodesTest-429096361-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:49.863116 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4b9cdd7c-8528-493d-85e1-61bc3f72e353 tempest-ServersOnMultiNodesTest-429096361 tempest-ServersOnMultiNodesTest-429096361-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:49.864150 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4b9cdd7c-8528-493d-85e1-61bc3f72e353 tempest-ServersOnMultiNodesTest-429096361 tempest-ServersOnMultiNodesTest-429096361-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:49.864901 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4b9cdd7c-8528-493d-85e1-61bc3f72e353 tempest-ServersOnMultiNodesTest-429096361 tempest-ServersOnMultiNodesTest-429096361-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:49.865699 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4b9cdd7c-8528-493d-85e1-61bc3f72e353 tempest-ServersOnMultiNodesTest-429096361 tempest-ServersOnMultiNodesTest-429096361-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:50.041420 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-4b9cdd7c-8528-493d-85e1-61bc3f72e353 tempest-ServersOnMultiNodesTest-429096361 tempest-ServersOnMultiNodesTest-429096361-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/50c38cf5-c054-447c-99a8-10bae624b09a" status: 200 len: 1618 microversion: 2.1 time: 0.198356 Oct 08 20:59:50.042886 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 994/1970] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:59:49 2022] GET /compute/v2.1/servers/50c38cf5-c054-447c-99a8-10bae624b09a => generated 1618 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:59:50.048224 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-48ed9061-8e60-4880-ac8b-02fbf3c07725 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:59:50.048841 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-48ed9061-8e60-4880-ac8b-02fbf3c07725 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] [instance: f38fc6d8-db15-4fcc-becb-9eff61447f11] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:59:50.057511 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-48ed9061-8e60-4880-ac8b-02fbf3c07725 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:50.058389 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-48ed9061-8e60-4880-ac8b-02fbf3c07725 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:50.058859 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-48ed9061-8e60-4880-ac8b-02fbf3c07725 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:50.059761 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-48ed9061-8e60-4880-ac8b-02fbf3c07725 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:50.060220 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-48ed9061-8e60-4880-ac8b-02fbf3c07725 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:50.061556 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-48ed9061-8e60-4880-ac8b-02fbf3c07725 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:50.074814 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-b2c896bf-2df0-4cb3-a22e-9050a3d92b00 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Flavor limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 20:59:50.075238 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-b2c896bf-2df0-4cb3-a22e-9050a3d92b00 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Image limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 20:59:50.075792 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-b2c896bf-2df0-4cb3-a22e-9050a3d92b00 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Flavor pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 20:59:50.076213 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-b2c896bf-2df0-4cb3-a22e-9050a3d92b00 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Image pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 20:59:50.077285 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-b2c896bf-2df0-4cb3-a22e-9050a3d92b00 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 20:59:50.099595 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b2c896bf-2df0-4cb3-a22e-9050a3d92b00 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:50.100206 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b2c896bf-2df0-4cb3-a22e-9050a3d92b00 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:50.100885 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b2c896bf-2df0-4cb3-a22e-9050a3d92b00 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:50.106441 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b2c896bf-2df0-4cb3-a22e-9050a3d92b00 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:50.107082 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b2c896bf-2df0-4cb3-a22e-9050a3d92b00 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:50.107645 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b2c896bf-2df0-4cb3-a22e-9050a3d92b00 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:50.153745 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-b2c896bf-2df0-4cb3-a22e-9050a3d92b00 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Getting quotas for project 76b10172715d423eb887d6c5b171defb. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 20:59:50.160104 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-b2c896bf-2df0-4cb3-a22e-9050a3d92b00 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Getting quotas for user f06caf10b6fa43a3a2ad34858594e329 and project 76b10172715d423eb887d6c5b171defb. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 20:59:50.185786 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-b2c896bf-2df0-4cb3-a22e-9050a3d92b00 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Going to run 1 instances... {{(pid=140491) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 20:59:50.188887 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-b2c896bf-2df0-4cb3-a22e-9050a3d92b00 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] [instance: 992277b1-0684-4013-a6c8-3937a1d41da3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c508bd7f-7db9-4b2c-af7c-be54a855c355',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140491) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 20:59:50.279044 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-48ed9061-8e60-4880-ac8b-02fbf3c07725 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bee8de1c3524b0f8a0dd73898637aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0921d976db440c8f59ba2f065642a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:59:50.282516 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-b2c896bf-2df0-4cb3-a22e-9050a3d92b00 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.904341 Oct 08 20:59:50.290093 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 977/1971] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 20:59:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1908 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 08 20:59:50.294452 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-77a7ef77-bbe4-4057-983e-9f635c71fa0a req-a14eb847-4815-4142-8554-1fb2f19963c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a", "tag": "acc4356a-62bc-4d7c-ae97-2b2901ef98e4"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:59:50.298163 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-48ed9061-8e60-4880-ac8b-02fbf3c07725 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] 10.222.0.26 "GET /compute/v2.1/servers/f38fc6d8-db15-4fcc-becb-9eff61447f11" status: 200 len: 1324 microversion: 2.1 time: 0.253819 Oct 08 20:59:50.300087 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 995/1972] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:59:50 2022] GET /compute/v2.1/servers/f38fc6d8-db15-4fcc-becb-9eff61447f11 => generated 1324 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:59:50.306648 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-77a7ef77-bbe4-4057-983e-9f635c71fa0a req-a14eb847-4815-4142-8554-1fb2f19963c3 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:50.307336 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-77a7ef77-bbe4-4057-983e-9f635c71fa0a req-a14eb847-4815-4142-8554-1fb2f19963c3 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:50.307916 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-77a7ef77-bbe4-4057-983e-9f635c71fa0a req-a14eb847-4815-4142-8554-1fb2f19963c3 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:50.309913 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-7347e838-864a-49fb-a3ae-27a78f6dd963 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:59:50.311640 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-7347e838-864a-49fb-a3ae-27a78f6dd963 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] [instance: 75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:59:50.318752 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7347e838-864a-49fb-a3ae-27a78f6dd963 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:50.319553 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7347e838-864a-49fb-a3ae-27a78f6dd963 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:50.320253 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7347e838-864a-49fb-a3ae-27a78f6dd963 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:50.324091 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7347e838-864a-49fb-a3ae-27a78f6dd963 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:50.326370 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7347e838-864a-49fb-a3ae-27a78f6dd963 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:50.327414 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7347e838-864a-49fb-a3ae-27a78f6dd963 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:50.335135 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-77a7ef77-bbe4-4057-983e-9f635c71fa0a req-a14eb847-4815-4142-8554-1fb2f19963c3 service nova] Creating event network-changed:acc4356a-62bc-4d7c-ae97-2b2901ef98e4 for instance 75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a on nch1-master-1 Oct 08 20:59:50.341571 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-77a7ef77-bbe4-4057-983e-9f635c71fa0a req-a14eb847-4815-4142-8554-1fb2f19963c3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054494 Oct 08 20:59:50.343584 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 978/1973] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:59:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:59:50.353452 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-2b9e26f2-e2a0-44cc-ad3a-47916879c35a tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1100566335", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["8ceaf7df-4795-4969-be16-a2a1b94a3fa6"]}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:59:50.441859 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.network.neutron [None req-2b9e26f2-e2a0-44cc-ad3a-47916879c35a tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] validate_networks() for None {{(pid=140491) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 20:59:50.655386 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-7347e838-864a-49fb-a3ae-27a78f6dd963 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1698dee4a2bf4ea19a6ee0c3d5cb5c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b00ee5e7828469f95bd90548d35982a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:59:50.667183 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-7347e838-864a-49fb-a3ae-27a78f6dd963 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] 10.222.0.26 "GET /compute/v2.1/servers/75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a" status: 200 len: 1321 microversion: 2.1 time: 0.364682 Oct 08 20:59:50.667492 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 996/1974] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:59:50 2022] GET /compute/v2.1/servers/75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a => generated 1321 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:59:50.678456 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-387938f8-d259-4faa-99fc-a6a30f5081a2 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:59:50.679141 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-387938f8-d259-4faa-99fc-a6a30f5081a2 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] [instance: b1a2f781-46a1-43f3-946a-f269deb6455e] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:59:50.687345 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-387938f8-d259-4faa-99fc-a6a30f5081a2 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:50.688131 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-387938f8-d259-4faa-99fc-a6a30f5081a2 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:50.688491 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-387938f8-d259-4faa-99fc-a6a30f5081a2 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:50.689450 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-387938f8-d259-4faa-99fc-a6a30f5081a2 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:50.689933 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-387938f8-d259-4faa-99fc-a6a30f5081a2 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:50.690600 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-387938f8-d259-4faa-99fc-a6a30f5081a2 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:50.868533 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=4 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:59:50.957242 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-387938f8-d259-4faa-99fc-a6a30f5081a2 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d2ddfa343e748c089129b0039a12ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e191d6217f024a17a14184071ac674c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:59:50.971058 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-387938f8-d259-4faa-99fc-a6a30f5081a2 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] 10.222.0.26 "GET /compute/v2.1/servers/b1a2f781-46a1-43f3-946a-f269deb6455e" status: 200 len: 1368 microversion: 2.1 time: 0.302264 Oct 08 20:59:50.972242 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 997/1975] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:59:50 2022] GET /compute/v2.1/servers/b1a2f781-46a1-43f3-946a-f269deb6455e => generated 1368 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:59:50.994448 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-8d620e36-c0fa-4212-9521-63e6b968381c tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:59:50.995099 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-8d620e36-c0fa-4212-9521-63e6b968381c tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] [instance: 992277b1-0684-4013-a6c8-3937a1d41da3] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:59:51.063751 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-8d620e36-c0fa-4212-9521-63e6b968381c tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06caf10b6fa43a3a2ad34858594e329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b10172715d423eb887d6c5b171defb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:59:51.066346 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=27 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:59:51.077122 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-8d620e36-c0fa-4212-9521-63e6b968381c tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] 10.222.0.26 "GET /compute/v2.1/servers/992277b1-0684-4013-a6c8-3937a1d41da3" status: 200 len: 1224 microversion: 2.1 time: 0.086939 Oct 08 20:59:51.077963 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 998/1976] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:59:50 2022] GET /compute/v2.1/servers/992277b1-0684-4013-a6c8-3937a1d41da3 => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:59:51.083222 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-a3c603af-82b4-48f3-b7b3-eb716ec59b52 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:59:51.083832 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-a3c603af-82b4-48f3-b7b3-eb716ec59b52 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:59:51.092292 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a3c603af-82b4-48f3-b7b3-eb716ec59b52 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:51.092811 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a3c603af-82b4-48f3-b7b3-eb716ec59b52 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:51.093306 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a3c603af-82b4-48f3-b7b3-eb716ec59b52 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:51.094052 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a3c603af-82b4-48f3-b7b3-eb716ec59b52 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:51.094523 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a3c603af-82b4-48f3-b7b3-eb716ec59b52 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:51.094966 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a3c603af-82b4-48f3-b7b3-eb716ec59b52 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:51.280547 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-a3c603af-82b4-48f3-b7b3-eb716ec59b52 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:59:51.289485 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-a3c603af-82b4-48f3-b7b3-eb716ec59b52 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd" status: 200 len: 1460 microversion: 2.1 time: 0.209904 Oct 08 20:59:51.290371 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 999/1977] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:59:51 2022] GET /compute/v2.1/servers/d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd => generated 1460 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:59:51.410194 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-4878e40f-d191-48c8-979a-b14b9c2ca310 tempest-MigrationsAdminTest-1609748928 tempest-MigrationsAdminTest-1609748928-project-admin] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:59:51.411351 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-4878e40f-d191-48c8-979a-b14b9c2ca310 tempest-MigrationsAdminTest-1609748928 tempest-MigrationsAdminTest-1609748928-project-admin] [instance: d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:59:51.421697 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4878e40f-d191-48c8-979a-b14b9c2ca310 tempest-MigrationsAdminTest-1609748928 tempest-MigrationsAdminTest-1609748928-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:51.422549 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4878e40f-d191-48c8-979a-b14b9c2ca310 tempest-MigrationsAdminTest-1609748928 tempest-MigrationsAdminTest-1609748928-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:51.423244 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4878e40f-d191-48c8-979a-b14b9c2ca310 tempest-MigrationsAdminTest-1609748928 tempest-MigrationsAdminTest-1609748928-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:51.424253 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4878e40f-d191-48c8-979a-b14b9c2ca310 tempest-MigrationsAdminTest-1609748928 tempest-MigrationsAdminTest-1609748928-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:51.424978 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4878e40f-d191-48c8-979a-b14b9c2ca310 tempest-MigrationsAdminTest-1609748928 tempest-MigrationsAdminTest-1609748928-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:51.425655 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4878e40f-d191-48c8-979a-b14b9c2ca310 tempest-MigrationsAdminTest-1609748928 tempest-MigrationsAdminTest-1609748928-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:51.504200 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-2b9e26f2-e2a0-44cc-ad3a-47916879c35a tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Flavor limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 20:59:51.504737 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-2b9e26f2-e2a0-44cc-ad3a-47916879c35a tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Image limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 20:59:51.505384 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-2b9e26f2-e2a0-44cc-ad3a-47916879c35a tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Flavor pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 20:59:51.505972 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-2b9e26f2-e2a0-44cc-ad3a-47916879c35a tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Image pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 20:59:51.506553 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-2b9e26f2-e2a0-44cc-ad3a-47916879c35a tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 20:59:51.523073 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2b9e26f2-e2a0-44cc-ad3a-47916879c35a tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:51.523783 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2b9e26f2-e2a0-44cc-ad3a-47916879c35a tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:51.524401 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2b9e26f2-e2a0-44cc-ad3a-47916879c35a tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:51.525352 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2b9e26f2-e2a0-44cc-ad3a-47916879c35a tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:51.526015 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2b9e26f2-e2a0-44cc-ad3a-47916879c35a tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:51.526624 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2b9e26f2-e2a0-44cc-ad3a-47916879c35a tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:51.554042 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-2b9e26f2-e2a0-44cc-ad3a-47916879c35a tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Getting quotas for project 8472b054404c46a99b81aba34d6b9f40. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 20:59:51.569026 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-2b9e26f2-e2a0-44cc-ad3a-47916879c35a tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Getting quotas for user 67ddc3cd3c374bacbe5bf5e0877380e2 and project 8472b054404c46a99b81aba34d6b9f40. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 20:59:51.587439 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-2b9e26f2-e2a0-44cc-ad3a-47916879c35a tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Going to run 1 instances... {{(pid=140491) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 20:59:51.590282 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-2b9e26f2-e2a0-44cc-ad3a-47916879c35a tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] [instance: ace99763-e046-4fb7-b944-9fd25a2205f2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c508bd7f-7db9-4b2c-af7c-be54a855c355',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140491) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 20:59:51.673142 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-2b9e26f2-e2a0-44cc-ad3a-47916879c35a tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.327618 Oct 08 20:59:51.674758 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 979/1978] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 20:59:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 1330 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 08 20:59:51.680914 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-341989d5-69f2-4117-87f5-9017dca3532a tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:59:51.681884 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-341989d5-69f2-4117-87f5-9017dca3532a tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] [instance: f38fc6d8-db15-4fcc-becb-9eff61447f11] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:59:51.694322 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-341989d5-69f2-4117-87f5-9017dca3532a tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:51.709068 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-341989d5-69f2-4117-87f5-9017dca3532a tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:51.710870 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-341989d5-69f2-4117-87f5-9017dca3532a tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:51.714173 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-341989d5-69f2-4117-87f5-9017dca3532a tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:51.714748 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-341989d5-69f2-4117-87f5-9017dca3532a tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:51.720097 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-341989d5-69f2-4117-87f5-9017dca3532a tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:51.931181 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-341989d5-69f2-4117-87f5-9017dca3532a tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bee8de1c3524b0f8a0dd73898637aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0921d976db440c8f59ba2f065642a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:59:51.938464 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-4878e40f-d191-48c8-979a-b14b9c2ca310 tempest-MigrationsAdminTest-1609748928 tempest-MigrationsAdminTest-1609748928-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd" status: 200 len: 1611 microversion: 2.1 time: 0.627687 Oct 08 20:59:51.939138 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1000/1979] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:59:51 2022] GET /compute/v2.1/servers/d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd => generated 1611 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:59:51.940674 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-341989d5-69f2-4117-87f5-9017dca3532a tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] 10.222.0.26 "GET /compute/v2.1/servers/f38fc6d8-db15-4fcc-becb-9eff61447f11" status: 200 len: 1324 microversion: 2.1 time: 0.264692 Oct 08 20:59:51.948545 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-5f59ce2f-7bf3-48b0-8e91-5ce04b3d511b req-06222335-4624-4f0f-b72b-e653095005f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f38fc6d8-db15-4fcc-becb-9eff61447f11", "name": "network-vif-plugged", "status": "completed", "tag": "7b0b7619-5cb0-4170-8f5a-649131231917"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:59:51.961148 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 980/1980] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:59:51 2022] GET /compute/v2.1/servers/f38fc6d8-db15-4fcc-becb-9eff61447f11 => generated 1324 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:59:51.966084 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-5e471194-3aa4-424e-a1f0-8b93e2dd876b tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:59:51.966708 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-5e471194-3aa4-424e-a1f0-8b93e2dd876b tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] [instance: ace99763-e046-4fb7-b944-9fd25a2205f2] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:59:51.978345 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-5f59ce2f-7bf3-48b0-8e91-5ce04b3d511b req-06222335-4624-4f0f-b72b-e653095005f7 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:51.978961 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-5f59ce2f-7bf3-48b0-8e91-5ce04b3d511b req-06222335-4624-4f0f-b72b-e653095005f7 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:51.980348 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-5f59ce2f-7bf3-48b0-8e91-5ce04b3d511b req-06222335-4624-4f0f-b72b-e653095005f7 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:52.001710 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-5f59ce2f-7bf3-48b0-8e91-5ce04b3d511b req-06222335-4624-4f0f-b72b-e653095005f7 service nova] Creating event network-vif-plugged:7b0b7619-5cb0-4170-8f5a-649131231917 for instance f38fc6d8-db15-4fcc-becb-9eff61447f11 on nch1-master-1 Oct 08 20:59:52.008769 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-5f59ce2f-7bf3-48b0-8e91-5ce04b3d511b req-06222335-4624-4f0f-b72b-e653095005f7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067762 Oct 08 20:59:52.009923 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1001/1981] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:59:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:59:52.018344 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-de516fa7-18d4-46b0-929b-c291a8ee4c3d tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:59:52.019186 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-de516fa7-18d4-46b0-929b-c291a8ee4c3d tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] [instance: 75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:59:52.029354 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-de516fa7-18d4-46b0-929b-c291a8ee4c3d tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:52.030914 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-de516fa7-18d4-46b0-929b-c291a8ee4c3d tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:52.031520 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-de516fa7-18d4-46b0-929b-c291a8ee4c3d tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:52.032421 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-de516fa7-18d4-46b0-929b-c291a8ee4c3d tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:52.034087 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-de516fa7-18d4-46b0-929b-c291a8ee4c3d tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:52.034733 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-de516fa7-18d4-46b0-929b-c291a8ee4c3d tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:52.228463 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-5e471194-3aa4-424e-a1f0-8b93e2dd876b tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ddc3cd3c374bacbe5bf5e0877380e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8472b054404c46a99b81aba34d6b9f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:59:52.239012 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-5e471194-3aa4-424e-a1f0-8b93e2dd876b tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] 10.222.0.26 "GET /compute/v2.1/servers/ace99763-e046-4fb7-b944-9fd25a2205f2" status: 200 len: 1217 microversion: 2.1 time: 0.277449 Oct 08 20:59:52.243095 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 981/1982] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:59:51 2022] GET /compute/v2.1/servers/ace99763-e046-4fb7-b944-9fd25a2205f2 => generated 1217 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:59:52.247996 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-007479de-fe52-491b-9d53-9499e840927e tempest-MigrationsAdminTest-1609748928 tempest-MigrationsAdminTest-1609748928-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:59:52.254193 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-007479de-fe52-491b-9d53-9499e840927e tempest-MigrationsAdminTest-1609748928 tempest-MigrationsAdminTest-1609748928-project-admin] [instance: d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:59:52.268885 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-007479de-fe52-491b-9d53-9499e840927e tempest-MigrationsAdminTest-1609748928 tempest-MigrationsAdminTest-1609748928-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:52.269814 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-007479de-fe52-491b-9d53-9499e840927e tempest-MigrationsAdminTest-1609748928 tempest-MigrationsAdminTest-1609748928-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:52.269903 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-007479de-fe52-491b-9d53-9499e840927e tempest-MigrationsAdminTest-1609748928 tempest-MigrationsAdminTest-1609748928-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:52.270615 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-007479de-fe52-491b-9d53-9499e840927e tempest-MigrationsAdminTest-1609748928 tempest-MigrationsAdminTest-1609748928-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:52.271095 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-007479de-fe52-491b-9d53-9499e840927e tempest-MigrationsAdminTest-1609748928 tempest-MigrationsAdminTest-1609748928-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:52.271545 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-007479de-fe52-491b-9d53-9499e840927e tempest-MigrationsAdminTest-1609748928 tempest-MigrationsAdminTest-1609748928-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:52.351654 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-de516fa7-18d4-46b0-929b-c291a8ee4c3d tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1698dee4a2bf4ea19a6ee0c3d5cb5c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b00ee5e7828469f95bd90548d35982a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:59:52.358494 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-007479de-fe52-491b-9d53-9499e840927e tempest-MigrationsAdminTest-1609748928 tempest-MigrationsAdminTest-1609748928-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '82eecd716629401493db6a979b7887cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cbd4579af204aa6b396906ca1430d3c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:59:52.359635 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-007479de-fe52-491b-9d53-9499e840927e tempest-MigrationsAdminTest-1609748928 tempest-MigrationsAdminTest-1609748928-project-admin] [instance: d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd] flavor_id is None. Assuming migration. {{(pid=140491) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 08 20:59:52.360716 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-007479de-fe52-491b-9d53-9499e840927e tempest-MigrationsAdminTest-1609748928 tempest-MigrationsAdminTest-1609748928-project-admin] [instance: d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=140491) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 08 20:59:52.372104 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-de516fa7-18d4-46b0-929b-c291a8ee4c3d tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] 10.222.0.26 "GET /compute/v2.1/servers/75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a" status: 200 len: 1321 microversion: 2.1 time: 0.360564 Oct 08 20:59:52.373077 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1002/1983] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:59:52 2022] GET /compute/v2.1/servers/75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a => generated 1321 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:59:52.382967 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-2f9d285b-8d11-4565-b143-15d17b2f3d9a tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:59:52.385696 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-2f9d285b-8d11-4565-b143-15d17b2f3d9a tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] [instance: b1a2f781-46a1-43f3-946a-f269deb6455e] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:59:52.396665 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2f9d285b-8d11-4565-b143-15d17b2f3d9a tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:52.397174 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2f9d285b-8d11-4565-b143-15d17b2f3d9a tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:52.398654 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2f9d285b-8d11-4565-b143-15d17b2f3d9a tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:52.399487 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2f9d285b-8d11-4565-b143-15d17b2f3d9a tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:52.400326 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2f9d285b-8d11-4565-b143-15d17b2f3d9a tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:52.401319 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2f9d285b-8d11-4565-b143-15d17b2f3d9a tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:52.825981 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-2f9d285b-8d11-4565-b143-15d17b2f3d9a tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d2ddfa343e748c089129b0039a12ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e191d6217f024a17a14184071ac674c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:59:52.838594 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-2f9d285b-8d11-4565-b143-15d17b2f3d9a tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] 10.222.0.26 "GET /compute/v2.1/servers/b1a2f781-46a1-43f3-946a-f269deb6455e" status: 200 len: 1368 microversion: 2.1 time: 0.464062 Oct 08 20:59:52.839251 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1003/1984] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:59:52 2022] GET /compute/v2.1/servers/b1a2f781-46a1-43f3-946a-f269deb6455e => generated 1368 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:59:52.862520 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-56c52807-a370-4cba-a80f-b49685f0110a tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:59:52.863356 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-56c52807-a370-4cba-a80f-b49685f0110a tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] [instance: 992277b1-0684-4013-a6c8-3937a1d41da3] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:59:52.879426 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-007479de-fe52-491b-9d53-9499e840927e tempest-MigrationsAdminTest-1609748928 tempest-MigrationsAdminTest-1609748928-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd/action" status: 202 len: 0 microversion: 2.1 time: 0.633303 Oct 08 20:59:52.886760 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-56c52807-a370-4cba-a80f-b49685f0110a tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:52.888407 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 982/1985] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 20:59:52 2022] POST /compute/v2.1/servers/d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd/action => generated 0 bytes in 644 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 20:59:52.888675 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-56c52807-a370-4cba-a80f-b49685f0110a tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:52.889746 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-56c52807-a370-4cba-a80f-b49685f0110a tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:52.890596 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-56c52807-a370-4cba-a80f-b49685f0110a tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:52.891076 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-56c52807-a370-4cba-a80f-b49685f0110a tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:52.891531 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-56c52807-a370-4cba-a80f-b49685f0110a tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:52.905154 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-c16795be-a3a1-4f97-9725-fec6e4b094af req-54245f07-4e24-4fe5-b794-32eb470fcec1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1a2f781-46a1-43f3-946a-f269deb6455e", "tag": "630c8b7f-3038-4d2d-a57b-d2e5f7052fc8"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:59:52.929747 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-c16795be-a3a1-4f97-9725-fec6e4b094af req-54245f07-4e24-4fe5-b794-32eb470fcec1 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:52.933765 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-c16795be-a3a1-4f97-9725-fec6e4b094af req-54245f07-4e24-4fe5-b794-32eb470fcec1 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:52.934712 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-c16795be-a3a1-4f97-9725-fec6e4b094af req-54245f07-4e24-4fe5-b794-32eb470fcec1 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:52.960252 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-c16795be-a3a1-4f97-9725-fec6e4b094af req-54245f07-4e24-4fe5-b794-32eb470fcec1 service nova] Creating event network-changed:630c8b7f-3038-4d2d-a57b-d2e5f7052fc8 for instance b1a2f781-46a1-43f3-946a-f269deb6455e on nch2-master-1 Oct 08 20:59:52.969077 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-c16795be-a3a1-4f97-9725-fec6e4b094af req-54245f07-4e24-4fe5-b794-32eb470fcec1 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078115 Oct 08 20:59:52.970238 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 983/1986] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:59:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:59:52.981295 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-0354f08e-06b9-4198-ae5c-6136e10f7490 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:59:52.982255 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-0354f08e-06b9-4198-ae5c-6136e10f7490 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:59:53.021641 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0354f08e-06b9-4198-ae5c-6136e10f7490 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:53.022152 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0354f08e-06b9-4198-ae5c-6136e10f7490 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:53.024845 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0354f08e-06b9-4198-ae5c-6136e10f7490 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:53.027684 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0354f08e-06b9-4198-ae5c-6136e10f7490 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:53.028186 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0354f08e-06b9-4198-ae5c-6136e10f7490 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:53.028678 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0354f08e-06b9-4198-ae5c-6136e10f7490 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:53.103298 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-56c52807-a370-4cba-a80f-b49685f0110a tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06caf10b6fa43a3a2ad34858594e329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b10172715d423eb887d6c5b171defb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:59:53.116032 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-56c52807-a370-4cba-a80f-b49685f0110a tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] 10.222.0.26 "GET /compute/v2.1/servers/992277b1-0684-4013-a6c8-3937a1d41da3" status: 200 len: 1276 microversion: 2.1 time: 0.262631 Oct 08 20:59:53.117437 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1004/1987] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:59:52 2022] GET /compute/v2.1/servers/992277b1-0684-4013-a6c8-3937a1d41da3 => generated 1276 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:59:53.123920 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-8a8b63fc-f3b2-4120-9681-2a4acde6bd1a tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:59:53.124860 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-8a8b63fc-f3b2-4120-9681-2a4acde6bd1a tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] [instance: f38fc6d8-db15-4fcc-becb-9eff61447f11] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:59:53.141600 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8a8b63fc-f3b2-4120-9681-2a4acde6bd1a tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:53.142270 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8a8b63fc-f3b2-4120-9681-2a4acde6bd1a tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:53.142801 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8a8b63fc-f3b2-4120-9681-2a4acde6bd1a tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:53.143689 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8a8b63fc-f3b2-4120-9681-2a4acde6bd1a tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:53.144251 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8a8b63fc-f3b2-4120-9681-2a4acde6bd1a tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:53.145083 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8a8b63fc-f3b2-4120-9681-2a4acde6bd1a tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:53.310642 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-8a8b63fc-f3b2-4120-9681-2a4acde6bd1a tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bee8de1c3524b0f8a0dd73898637aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0921d976db440c8f59ba2f065642a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:59:53.319995 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-8a8b63fc-f3b2-4120-9681-2a4acde6bd1a tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] 10.222.0.26 "GET /compute/v2.1/servers/f38fc6d8-db15-4fcc-becb-9eff61447f11" status: 200 len: 1324 microversion: 2.1 time: 0.201100 Oct 08 20:59:53.320804 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1005/1988] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:59:53 2022] GET /compute/v2.1/servers/f38fc6d8-db15-4fcc-becb-9eff61447f11 => generated 1324 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:59:53.326971 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-f5d26432-ca16-4104-9d37-506904124775 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:59:53.327586 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-f5d26432-ca16-4104-9d37-506904124775 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] [instance: ace99763-e046-4fb7-b944-9fd25a2205f2] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:59:53.336131 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f5d26432-ca16-4104-9d37-506904124775 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:53.337426 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f5d26432-ca16-4104-9d37-506904124775 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:53.338146 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f5d26432-ca16-4104-9d37-506904124775 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:53.339141 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f5d26432-ca16-4104-9d37-506904124775 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:53.340016 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f5d26432-ca16-4104-9d37-506904124775 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:53.340437 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f5d26432-ca16-4104-9d37-506904124775 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:53.352899 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-0354f08e-06b9-4198-ae5c-6136e10f7490 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:59:53.355662 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:59:53.364138 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-0354f08e-06b9-4198-ae5c-6136e10f7490 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd" status: 200 len: 1469 microversion: 2.1 time: 0.392083 Oct 08 20:59:53.364771 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 984/1989] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:59:52 2022] GET /compute/v2.1/servers/d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd => generated 1469 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:59:53.395332 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-4eb4b136-2d3f-411e-9884-03695da80e2a tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:59:53.396221 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-4eb4b136-2d3f-411e-9884-03695da80e2a tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] [instance: 75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:59:53.405671 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4eb4b136-2d3f-411e-9884-03695da80e2a tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:53.406290 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4eb4b136-2d3f-411e-9884-03695da80e2a tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:53.406847 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4eb4b136-2d3f-411e-9884-03695da80e2a tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:53.408015 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4eb4b136-2d3f-411e-9884-03695da80e2a tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:53.408660 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4eb4b136-2d3f-411e-9884-03695da80e2a tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:53.409278 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4eb4b136-2d3f-411e-9884-03695da80e2a tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:53.446827 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-f5d26432-ca16-4104-9d37-506904124775 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ddc3cd3c374bacbe5bf5e0877380e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8472b054404c46a99b81aba34d6b9f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:59:53.458058 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-f5d26432-ca16-4104-9d37-506904124775 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] 10.222.0.26 "GET /compute/v2.1/servers/ace99763-e046-4fb7-b944-9fd25a2205f2" status: 200 len: 1269 microversion: 2.1 time: 0.135821 Oct 08 20:59:53.468188 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1006/1990] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:59:53 2022] GET /compute/v2.1/servers/ace99763-e046-4fb7-b944-9fd25a2205f2 => generated 1269 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:59:53.612667 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-4eb4b136-2d3f-411e-9884-03695da80e2a tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1698dee4a2bf4ea19a6ee0c3d5cb5c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b00ee5e7828469f95bd90548d35982a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:59:53.621850 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-4eb4b136-2d3f-411e-9884-03695da80e2a tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] 10.222.0.26 "GET /compute/v2.1/servers/75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a" status: 200 len: 1321 microversion: 2.1 time: 0.230021 Oct 08 20:59:53.622521 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 985/1991] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:59:53 2022] GET /compute/v2.1/servers/75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a => generated 1321 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 20:59:53.868564 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-da05e949-c261-4608-a486-7057fd2752be tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:59:53.870151 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-da05e949-c261-4608-a486-7057fd2752be tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] [instance: b1a2f781-46a1-43f3-946a-f269deb6455e] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:59:53.890152 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-da05e949-c261-4608-a486-7057fd2752be tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:53.891837 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-da05e949-c261-4608-a486-7057fd2752be tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:53.892358 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-da05e949-c261-4608-a486-7057fd2752be tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:53.895243 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-da05e949-c261-4608-a486-7057fd2752be tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:53.896062 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-da05e949-c261-4608-a486-7057fd2752be tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:53.897965 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-da05e949-c261-4608-a486-7057fd2752be tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:54.142760 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-520d8c68-a559-4f0c-a19d-2d5a799007dd tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:59:54.143406 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-520d8c68-a559-4f0c-a19d-2d5a799007dd tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] [instance: 992277b1-0684-4013-a6c8-3937a1d41da3] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:59:54.163817 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-520d8c68-a559-4f0c-a19d-2d5a799007dd tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:54.164327 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-520d8c68-a559-4f0c-a19d-2d5a799007dd tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:54.165985 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-520d8c68-a559-4f0c-a19d-2d5a799007dd tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:54.166951 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-520d8c68-a559-4f0c-a19d-2d5a799007dd tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:54.167785 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-520d8c68-a559-4f0c-a19d-2d5a799007dd tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:54.168982 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-520d8c68-a559-4f0c-a19d-2d5a799007dd tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:54.325361 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-da05e949-c261-4608-a486-7057fd2752be tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d2ddfa343e748c089129b0039a12ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e191d6217f024a17a14184071ac674c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:59:54.339357 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-da05e949-c261-4608-a486-7057fd2752be tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] 10.222.0.26 "GET /compute/v2.1/servers/b1a2f781-46a1-43f3-946a-f269deb6455e" status: 200 len: 1368 microversion: 2.1 time: 0.477008 Oct 08 20:59:54.353399 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1007/1992] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:59:53 2022] GET /compute/v2.1/servers/b1a2f781-46a1-43f3-946a-f269deb6455e => generated 1368 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:59:54.366577 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-4ddfb9e9-b5d7-4abf-a2e7-7699b1ed391c req-0d123e57-c7c9-4862-872d-8fcea4205cd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "579b0f8b-ccae-4c2b-bb48-1da1aaf6a138", "name": "network-vif-plugged", "status": "completed", "tag": "b8ba5770-3e26-4856-865d-c7bf36a1757a"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:59:54.381338 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-4ddfb9e9-b5d7-4abf-a2e7-7699b1ed391c req-0d123e57-c7c9-4862-872d-8fcea4205cd1 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:54.382258 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-4ddfb9e9-b5d7-4abf-a2e7-7699b1ed391c req-0d123e57-c7c9-4862-872d-8fcea4205cd1 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:54.385037 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-4ddfb9e9-b5d7-4abf-a2e7-7699b1ed391c req-0d123e57-c7c9-4862-872d-8fcea4205cd1 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:54.403128 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-4ddfb9e9-b5d7-4abf-a2e7-7699b1ed391c req-0d123e57-c7c9-4862-872d-8fcea4205cd1 service nova] Creating event network-vif-plugged:b8ba5770-3e26-4856-865d-c7bf36a1757a for instance 579b0f8b-ccae-4c2b-bb48-1da1aaf6a138 on nch1-master-1 Oct 08 20:59:54.411525 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-4ddfb9e9-b5d7-4abf-a2e7-7699b1ed391c req-0d123e57-c7c9-4862-872d-8fcea4205cd1 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056008 Oct 08 20:59:54.414137 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1008/1993] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:59:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:59:54.421763 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-ad28f439-8c0c-4360-8826-9119a88adca1 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:59:54.422928 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-ad28f439-8c0c-4360-8826-9119a88adca1 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] [instance: f38fc6d8-db15-4fcc-becb-9eff61447f11] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:59:54.441826 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ad28f439-8c0c-4360-8826-9119a88adca1 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:54.442560 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ad28f439-8c0c-4360-8826-9119a88adca1 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:54.443227 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ad28f439-8c0c-4360-8826-9119a88adca1 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:54.444238 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ad28f439-8c0c-4360-8826-9119a88adca1 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:54.444927 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ad28f439-8c0c-4360-8826-9119a88adca1 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:54.445630 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ad28f439-8c0c-4360-8826-9119a88adca1 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:54.545902 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-520d8c68-a559-4f0c-a19d-2d5a799007dd tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06caf10b6fa43a3a2ad34858594e329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b10172715d423eb887d6c5b171defb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:59:54.559948 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-520d8c68-a559-4f0c-a19d-2d5a799007dd tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] 10.222.0.26 "GET /compute/v2.1/servers/992277b1-0684-4013-a6c8-3937a1d41da3" status: 200 len: 1284 microversion: 2.1 time: 0.423409 Oct 08 20:59:54.561385 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 986/1994] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:59:54 2022] GET /compute/v2.1/servers/992277b1-0684-4013-a6c8-3937a1d41da3 => generated 1284 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 20:59:54.581133 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-15ca0d79-60c8-47c6-8097-2bd45a95e266 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:59:54.582248 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-15ca0d79-60c8-47c6-8097-2bd45a95e266 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:59:54.609852 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-15ca0d79-60c8-47c6-8097-2bd45a95e266 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:54.611869 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-15ca0d79-60c8-47c6-8097-2bd45a95e266 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:54.612344 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-15ca0d79-60c8-47c6-8097-2bd45a95e266 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:54.613100 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-15ca0d79-60c8-47c6-8097-2bd45a95e266 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:54.614015 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-15ca0d79-60c8-47c6-8097-2bd45a95e266 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:54.614605 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-15ca0d79-60c8-47c6-8097-2bd45a95e266 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:54.753092 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-ad28f439-8c0c-4360-8826-9119a88adca1 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bee8de1c3524b0f8a0dd73898637aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0921d976db440c8f59ba2f065642a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:59:54.767038 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-ad28f439-8c0c-4360-8826-9119a88adca1 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] 10.222.0.26 "GET /compute/v2.1/servers/f38fc6d8-db15-4fcc-becb-9eff61447f11" status: 200 len: 1522 microversion: 2.1 time: 0.351434 Oct 08 20:59:54.767639 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1009/1995] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:59:54 2022] GET /compute/v2.1/servers/f38fc6d8-db15-4fcc-becb-9eff61447f11 => generated 1522 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:59:54.772466 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-9cbd49c4-a3ed-40fe-b458-35891ba4396e tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:59:54.774100 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-9cbd49c4-a3ed-40fe-b458-35891ba4396e tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] [instance: ace99763-e046-4fb7-b944-9fd25a2205f2] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:59:54.781715 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9cbd49c4-a3ed-40fe-b458-35891ba4396e tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:54.782334 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9cbd49c4-a3ed-40fe-b458-35891ba4396e tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:54.791117 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9cbd49c4-a3ed-40fe-b458-35891ba4396e tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:54.792923 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9cbd49c4-a3ed-40fe-b458-35891ba4396e tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:54.794096 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9cbd49c4-a3ed-40fe-b458-35891ba4396e tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:54.794797 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9cbd49c4-a3ed-40fe-b458-35891ba4396e tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:54.875732 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-9cbd49c4-a3ed-40fe-b458-35891ba4396e tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ddc3cd3c374bacbe5bf5e0877380e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8472b054404c46a99b81aba34d6b9f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:59:54.887806 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-9cbd49c4-a3ed-40fe-b458-35891ba4396e tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] 10.222.0.26 "GET /compute/v2.1/servers/ace99763-e046-4fb7-b944-9fd25a2205f2" status: 200 len: 1269 microversion: 2.1 time: 0.119089 Oct 08 20:59:54.897266 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1010/1996] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:59:54 2022] GET /compute/v2.1/servers/ace99763-e046-4fb7-b944-9fd25a2205f2 => generated 1269 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:59:54.897266 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-2f7c6a90-392e-4f30-ada0-612e0a85c91b tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:59:54.897266 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-2f7c6a90-392e-4f30-ada0-612e0a85c91b tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] [instance: 75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:59:54.902590 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2f7c6a90-392e-4f30-ada0-612e0a85c91b tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:54.903389 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2f7c6a90-392e-4f30-ada0-612e0a85c91b tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:54.903592 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2f7c6a90-392e-4f30-ada0-612e0a85c91b tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:54.904318 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2f7c6a90-392e-4f30-ada0-612e0a85c91b tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:54.905732 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2f7c6a90-392e-4f30-ada0-612e0a85c91b tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:54.906418 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2f7c6a90-392e-4f30-ada0-612e0a85c91b tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:55.082869 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-15ca0d79-60c8-47c6-8097-2bd45a95e266 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:59:55.092202 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-15ca0d79-60c8-47c6-8097-2bd45a95e266 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd" status: 200 len: 1469 microversion: 2.1 time: 0.529313 Oct 08 20:59:55.113944 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 987/1997] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:59:54 2022] GET /compute/v2.1/servers/d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd => generated 1469 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:59:55.121545 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-7e488bef-eb9d-4bbf-a52a-5fe6655af8f9 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:59:55.122415 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-7e488bef-eb9d-4bbf-a52a-5fe6655af8f9 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] [instance: f38fc6d8-db15-4fcc-becb-9eff61447f11] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:59:55.130774 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7e488bef-eb9d-4bbf-a52a-5fe6655af8f9 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:55.131589 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7e488bef-eb9d-4bbf-a52a-5fe6655af8f9 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:55.132561 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7e488bef-eb9d-4bbf-a52a-5fe6655af8f9 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:55.133553 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7e488bef-eb9d-4bbf-a52a-5fe6655af8f9 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:55.135128 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7e488bef-eb9d-4bbf-a52a-5fe6655af8f9 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:55.135766 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7e488bef-eb9d-4bbf-a52a-5fe6655af8f9 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:55.188041 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-7e488bef-eb9d-4bbf-a52a-5fe6655af8f9 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] HTTP exception thrown: Action 999 not found Oct 08 20:59:55.197629 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-7e488bef-eb9d-4bbf-a52a-5fe6655af8f9 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Request method failure captured: Oct 08 20:59:55.197629 ncdv-master-1 devstack@n-api.service[140491]: request: GET /compute/v2.1/servers/f38fc6d8-db15-4fcc-becb-9eff61447f11/os-instance-actions/999 HTTP/1.1 Oct 08 20:59:55.197629 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 20:59:55.197629 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 20:59:55.197629 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 20:59:55.197629 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 20:59:55.197629 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 20:59:55.197629 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 20:59:55.197629 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 20:59:55.197629 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 20:59:55.197629 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeSvKhkPuHk-j-aJO7AUkh3h3ZIRJfCslSGnoNixnYQkijkcFLfr60fjE0VPt0vLNyhAxwsw4S2hiCPaa9mu4UgYBtnuNKuPFvkAShdsyHDUEqNnuEDS6Qp1B1HF1Uzv4hdjCwDfasSehDca5Vkw5NviKfmkorEw13vG1LqEWdEpk0U Oct 08 20:59:55.197629 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 20:59:55.197629 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 20:59:55.197629 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 20:59:55.197629 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 20:59:55.197629 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 20:59:55.197629 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 20:59:55.197629 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: de0921d976db440c8f59ba2f065642a0 Oct 08 20:59:55.197629 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-879838128 Oct 08 20:59:55.197629 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 20:59:55.197629 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 20:59:55.197629 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/de0921d976db440c8f59ba2f065642a0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/de0921d976db440c8f59ba2f065642a0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_de0921d976db440c8f59ba2f065642a0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/de0921d976db440c8f59ba2f065642a0"}]}] Oct 08 20:59:55.197629 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-879838128 Oct 08 20:59:55.197629 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: de0921d976db440c8f59ba2f065642a0 Oct 08 20:59:55.197629 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-879838128 Oct 08 20:59:55.197629 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-InstanceActionsNegativeTestJSON-879838128-project Oct 08 20:59:55.197629 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 20:59:55.197629 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 20:59:55.197629 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 6bee8de1c3524b0f8a0dd73898637aa7 Oct 08 20:59:55.197629 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-879838128-project Oct 08 20:59:55.197629 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 20:59:55.197629 ncdv-master-1 devstack@n-api.service[140491]: exception: Action 999 not found Oct 08 20:59:55.197629 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'server_id': 'f38fc6d8-db15-4fcc-becb-9eff61447f11', 'id': '999'} Oct 08 20:59:55.197629 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:59:55.197629 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:59:55.197629 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:59:55.197629 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:59:55.197629 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:59:55.197629 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:59:55.197629 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:59:55.197629 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:59:55.197629 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Oct 08 20:59:55.197629 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 08 20:59:55.197629 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Oct 08 20:59:55.197629 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:59:55.197629 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:59:55.197629 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:59:55.197629 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:59:55.197629 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:59:55.197629 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:59:55.197629 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 20:59:55.197629 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 20:59:55.197629 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Oct 08 20:59:55.197629 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:59:55.207641 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-7e488bef-eb9d-4bbf-a52a-5fe6655af8f9 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Returning 404 to user: Action 999 not found {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:59:55.207641 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-7e488bef-eb9d-4bbf-a52a-5fe6655af8f9 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] 10.222.0.26 "GET /compute/v2.1/servers/f38fc6d8-db15-4fcc-becb-9eff61447f11/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.084017 Oct 08 20:59:55.207641 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 988/1998] 10.222.0.26 () {58 vars in 1308 bytes} [Sat Oct 8 20:59:55 2022] GET /compute/v2.1/servers/f38fc6d8-db15-4fcc-becb-9eff61447f11/os-instance-actions/999 => generated 66 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 08 20:59:55.211082 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-61065f2e-77d9-4066-9817-8f4167c54143 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Calling method '.version_select at 0x7f1a8c0b1820>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:59:55.211656 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-61065f2e-77d9-4066-9817-8f4167c54143 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] [instance: a2c9115b-2e68-4183-9e77-1983dc531b5e] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:59:55.221566 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-61065f2e-77d9-4066-9817-8f4167c54143 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] HTTP exception thrown: Instance a2c9115b-2e68-4183-9e77-1983dc531b5e could not be found. Oct 08 20:59:55.225726 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-61065f2e-77d9-4066-9817-8f4167c54143 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Request method failure captured: Oct 08 20:59:55.225726 ncdv-master-1 devstack@n-api.service[140491]: request: GET /compute/v2.1/servers/a2c9115b-2e68-4183-9e77-1983dc531b5e/os-instance-actions HTTP/1.1 Oct 08 20:59:55.225726 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 20:59:55.225726 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 20:59:55.225726 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 20:59:55.225726 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 20:59:55.225726 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 20:59:55.225726 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 20:59:55.225726 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 20:59:55.225726 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 20:59:55.225726 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeSvKhkPuHk-j-aJO7AUkh3h3ZIRJfCslSGnoNixnYQkijkcFLfr60fjE0VPt0vLNyhAxwsw4S2hiCPaa9mu4UgYBtnuNKuPFvkAShdsyHDUEqNnuEDS6Qp1B1HF1Uzv4hdjCwDfasSehDca5Vkw5NviKfmkorEw13vG1LqEWdEpk0U Oct 08 20:59:55.225726 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 20:59:55.225726 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 20:59:55.225726 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 20:59:55.225726 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 20:59:55.225726 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 20:59:55.225726 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 20:59:55.225726 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: de0921d976db440c8f59ba2f065642a0 Oct 08 20:59:55.225726 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-879838128 Oct 08 20:59:55.225726 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 20:59:55.225726 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 20:59:55.225726 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/de0921d976db440c8f59ba2f065642a0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/de0921d976db440c8f59ba2f065642a0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_de0921d976db440c8f59ba2f065642a0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/de0921d976db440c8f59ba2f065642a0"}]}] Oct 08 20:59:55.225726 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-879838128 Oct 08 20:59:55.225726 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: de0921d976db440c8f59ba2f065642a0 Oct 08 20:59:55.225726 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-879838128 Oct 08 20:59:55.225726 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-InstanceActionsNegativeTestJSON-879838128-project Oct 08 20:59:55.225726 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 20:59:55.225726 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 20:59:55.225726 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 6bee8de1c3524b0f8a0dd73898637aa7 Oct 08 20:59:55.225726 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-879838128-project Oct 08 20:59:55.225726 ncdv-master-1 devstack@n-api.service[140491]: method: Oct 08 20:59:55.225726 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance a2c9115b-2e68-4183-9e77-1983dc531b5e could not be found. Oct 08 20:59:55.225726 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'server_id': 'a2c9115b-2e68-4183-9e77-1983dc531b5e'} Oct 08 20:59:55.225726 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 20:59:55.225726 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:59:55.225726 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 20:59:55.225726 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 20:59:55.225726 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 20:59:55.225726 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 20:59:55.225726 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 08 20:59:55.225726 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 08 20:59:55.225726 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2c9115b-2e68-4183-9e77-1983dc531b5e could not be found. Oct 08 20:59:55.225726 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:59:55.225726 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:59:55.225726 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:59:55.225726 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:59:55.225726 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:59:55.225726 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:59:55.225726 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 20:59:55.225726 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 20:59:55.225726 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 08 20:59:55.225726 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 08 20:59:55.225726 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 20:59:55.225726 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 20:59:55.225726 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Oct 08 20:59:55.225726 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Oct 08 20:59:55.225726 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 08 20:59:55.225726 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 08 20:59:55.225726 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Oct 08 20:59:55.225726 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Oct 08 20:59:55.225726 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 20:59:55.225726 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 20:59:55.230010 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2c9115b-2e68-4183-9e77-1983dc531b5e could not be found. Oct 08 20:59:55.230010 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:59:55.230010 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 20:59:55.230010 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:59:55.230010 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 20:59:55.230010 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 20:59:55.230010 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 20:59:55.230010 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 20:59:55.230010 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 20:59:55.230010 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2c9115b-2e68-4183-9e77-1983dc531b5e could not be found. Oct 08 20:59:55.230010 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 20:59:55.231747 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-61065f2e-77d9-4066-9817-8f4167c54143 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Returning 404 to user: Instance a2c9115b-2e68-4183-9e77-1983dc531b5e could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 20:59:55.235265 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-61065f2e-77d9-4066-9817-8f4167c54143 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] 10.222.0.26 "GET /compute/v2.1/servers/a2c9115b-2e68-4183-9e77-1983dc531b5e/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.028616 Oct 08 20:59:55.237312 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 989/1999] 10.222.0.26 () {58 vars in 1296 bytes} [Sat Oct 8 20:59:55 2022] GET /compute/v2.1/servers/a2c9115b-2e68-4183-9e77-1983dc531b5e/os-instance-actions => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 08 20:59:55.252166 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-edbee361-07f6-4bec-8290-7c1b66233365 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:59:55.252954 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-edbee361-07f6-4bec-8290-7c1b66233365 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] [instance: f38fc6d8-db15-4fcc-becb-9eff61447f11] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:59:55.269676 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-edbee361-07f6-4bec-8290-7c1b66233365 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:55.270238 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-edbee361-07f6-4bec-8290-7c1b66233365 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:55.273985 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-edbee361-07f6-4bec-8290-7c1b66233365 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:55.276311 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-edbee361-07f6-4bec-8290-7c1b66233365 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:55.277083 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-edbee361-07f6-4bec-8290-7c1b66233365 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:55.280168 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-edbee361-07f6-4bec-8290-7c1b66233365 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:55.327731 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-2f7c6a90-392e-4f30-ada0-612e0a85c91b tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1698dee4a2bf4ea19a6ee0c3d5cb5c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b00ee5e7828469f95bd90548d35982a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:59:55.330145 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=100 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:59:55.336596 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-edbee361-07f6-4bec-8290-7c1b66233365 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] [instance: f38fc6d8-db15-4fcc-becb-9eff61447f11] Going to try to terminate instance {{(pid=140491) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 20:59:55.340116 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-2f7c6a90-392e-4f30-ada0-612e0a85c91b tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] 10.222.0.26 "GET /compute/v2.1/servers/75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a" status: 200 len: 1321 microversion: 2.1 time: 0.448695 Oct 08 20:59:55.340709 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1011/2000] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:59:54 2022] GET /compute/v2.1/servers/75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a => generated 1321 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:59:55.377588 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-4b8fbaab-6b79-40fe-aedc-b5b265d2bd0a tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:59:55.378547 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-4b8fbaab-6b79-40fe-aedc-b5b265d2bd0a tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] [instance: b1a2f781-46a1-43f3-946a-f269deb6455e] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:59:55.389593 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4b8fbaab-6b79-40fe-aedc-b5b265d2bd0a tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:55.390348 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4b8fbaab-6b79-40fe-aedc-b5b265d2bd0a tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:55.391138 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4b8fbaab-6b79-40fe-aedc-b5b265d2bd0a tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:55.392147 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4b8fbaab-6b79-40fe-aedc-b5b265d2bd0a tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:55.392769 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4b8fbaab-6b79-40fe-aedc-b5b265d2bd0a tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:55.393419 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4b8fbaab-6b79-40fe-aedc-b5b265d2bd0a tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:55.447518 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-edbee361-07f6-4bec-8290-7c1b66233365 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] 10.222.0.26 "DELETE /compute/v2.1/servers/f38fc6d8-db15-4fcc-becb-9eff61447f11" status: 204 len: 0 microversion: 2.1 time: 0.205837 Oct 08 20:59:55.448546 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 990/2001] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 20:59:55 2022] DELETE /compute/v2.1/servers/f38fc6d8-db15-4fcc-becb-9eff61447f11 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 20:59:55.460770 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-ef35aa63-6ddf-4eb0-b28b-7f414a13ea10 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:59:55.462106 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-ef35aa63-6ddf-4eb0-b28b-7f414a13ea10 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] [instance: f38fc6d8-db15-4fcc-becb-9eff61447f11] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:59:55.474127 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ef35aa63-6ddf-4eb0-b28b-7f414a13ea10 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:55.474781 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ef35aa63-6ddf-4eb0-b28b-7f414a13ea10 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:55.475357 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ef35aa63-6ddf-4eb0-b28b-7f414a13ea10 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:55.476222 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ef35aa63-6ddf-4eb0-b28b-7f414a13ea10 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:55.476917 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ef35aa63-6ddf-4eb0-b28b-7f414a13ea10 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:55.477701 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ef35aa63-6ddf-4eb0-b28b-7f414a13ea10 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:55.674390 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-4b8fbaab-6b79-40fe-aedc-b5b265d2bd0a tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d2ddfa343e748c089129b0039a12ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e191d6217f024a17a14184071ac674c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:59:55.699253 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-4b8fbaab-6b79-40fe-aedc-b5b265d2bd0a tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] 10.222.0.26 "GET /compute/v2.1/servers/b1a2f781-46a1-43f3-946a-f269deb6455e" status: 200 len: 1368 microversion: 2.1 time: 0.328198 Oct 08 20:59:55.700091 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1012/2002] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:59:55 2022] GET /compute/v2.1/servers/b1a2f781-46a1-43f3-946a-f269deb6455e => generated 1368 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 20:59:55.706976 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-80eb61a9-4615-4644-8844-027946ee45e2 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:59:55.707736 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-80eb61a9-4615-4644-8844-027946ee45e2 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] [instance: 992277b1-0684-4013-a6c8-3937a1d41da3] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:59:55.714863 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-80eb61a9-4615-4644-8844-027946ee45e2 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:55.715393 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-80eb61a9-4615-4644-8844-027946ee45e2 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:55.715858 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-80eb61a9-4615-4644-8844-027946ee45e2 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:55.716683 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-80eb61a9-4615-4644-8844-027946ee45e2 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:55.717917 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-80eb61a9-4615-4644-8844-027946ee45e2 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:55.718441 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-80eb61a9-4615-4644-8844-027946ee45e2 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:55.843280 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-80eb61a9-4615-4644-8844-027946ee45e2 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06caf10b6fa43a3a2ad34858594e329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b10172715d423eb887d6c5b171defb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:59:55.854325 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-80eb61a9-4615-4644-8844-027946ee45e2 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] 10.222.0.26 "GET /compute/v2.1/servers/992277b1-0684-4013-a6c8-3937a1d41da3" status: 200 len: 1282 microversion: 2.1 time: 0.152959 Oct 08 20:59:55.855089 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1013/2003] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:59:55 2022] GET /compute/v2.1/servers/992277b1-0684-4013-a6c8-3937a1d41da3 => generated 1282 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:59:55.916468 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-9b19b658-f0b1-4807-a5c3-4769fb348508 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:59:55.917490 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-9b19b658-f0b1-4807-a5c3-4769fb348508 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] [instance: ace99763-e046-4fb7-b944-9fd25a2205f2] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:59:55.926920 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9b19b658-f0b1-4807-a5c3-4769fb348508 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:55.928184 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9b19b658-f0b1-4807-a5c3-4769fb348508 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:55.929233 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9b19b658-f0b1-4807-a5c3-4769fb348508 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:55.930032 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9b19b658-f0b1-4807-a5c3-4769fb348508 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:55.930660 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9b19b658-f0b1-4807-a5c3-4769fb348508 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:55.931290 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9b19b658-f0b1-4807-a5c3-4769fb348508 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:56.005331 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-ef35aa63-6ddf-4eb0-b28b-7f414a13ea10 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bee8de1c3524b0f8a0dd73898637aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0921d976db440c8f59ba2f065642a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:59:56.019380 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-ef35aa63-6ddf-4eb0-b28b-7f414a13ea10 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] 10.222.0.26 "GET /compute/v2.1/servers/f38fc6d8-db15-4fcc-becb-9eff61447f11" status: 200 len: 1528 microversion: 2.1 time: 0.565684 Oct 08 20:59:56.020164 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 991/2004] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:59:55 2022] GET /compute/v2.1/servers/f38fc6d8-db15-4fcc-becb-9eff61447f11 => generated 1528 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:59:56.036479 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-9b19b658-f0b1-4807-a5c3-4769fb348508 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ddc3cd3c374bacbe5bf5e0877380e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8472b054404c46a99b81aba34d6b9f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:59:56.046346 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-9b19b658-f0b1-4807-a5c3-4769fb348508 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] 10.222.0.26 "GET /compute/v2.1/servers/ace99763-e046-4fb7-b944-9fd25a2205f2" status: 200 len: 1275 microversion: 2.1 time: 0.135239 Oct 08 20:59:56.047551 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1014/2005] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:59:55 2022] GET /compute/v2.1/servers/ace99763-e046-4fb7-b944-9fd25a2205f2 => generated 1275 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:59:56.127869 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-d545dcad-616d-4c16-b7da-1d8a3c256b0e tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:59:56.128883 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-d545dcad-616d-4c16-b7da-1d8a3c256b0e tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:59:56.137904 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d545dcad-616d-4c16-b7da-1d8a3c256b0e tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:56.139727 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d545dcad-616d-4c16-b7da-1d8a3c256b0e tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:56.140376 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d545dcad-616d-4c16-b7da-1d8a3c256b0e tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:56.141694 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d545dcad-616d-4c16-b7da-1d8a3c256b0e tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:56.142666 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d545dcad-616d-4c16-b7da-1d8a3c256b0e tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:56.143453 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d545dcad-616d-4c16-b7da-1d8a3c256b0e tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:56.365081 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-2c1c4901-50c0-4ae0-baf5-cf3bca865cb3 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:59:56.366598 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-2c1c4901-50c0-4ae0-baf5-cf3bca865cb3 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] [instance: 75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:59:56.393935 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2c1c4901-50c0-4ae0-baf5-cf3bca865cb3 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:56.394911 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2c1c4901-50c0-4ae0-baf5-cf3bca865cb3 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:56.396152 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2c1c4901-50c0-4ae0-baf5-cf3bca865cb3 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:56.398329 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2c1c4901-50c0-4ae0-baf5-cf3bca865cb3 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:56.399024 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2c1c4901-50c0-4ae0-baf5-cf3bca865cb3 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:56.399726 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2c1c4901-50c0-4ae0-baf5-cf3bca865cb3 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:56.417222 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-d545dcad-616d-4c16-b7da-1d8a3c256b0e tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:59:56.428610 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-d545dcad-616d-4c16-b7da-1d8a3c256b0e tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd" status: 200 len: 1469 microversion: 2.1 time: 0.306629 Oct 08 20:59:56.446491 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 992/2006] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:59:56 2022] GET /compute/v2.1/servers/d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd => generated 1469 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:59:56.501963 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-0ed83c47-6ddc-44bb-b6ba-27304813efa9 req-7810b6b8-35a8-41a1-8881-afdf5dcd4cad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a", "name": "network-vif-plugged", "status": "completed", "tag": "acc4356a-62bc-4d7c-ae97-2b2901ef98e4"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:59:56.519553 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:59:56.538264 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-0ed83c47-6ddc-44bb-b6ba-27304813efa9 req-7810b6b8-35a8-41a1-8881-afdf5dcd4cad service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:56.541317 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-0ed83c47-6ddc-44bb-b6ba-27304813efa9 req-7810b6b8-35a8-41a1-8881-afdf5dcd4cad service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:56.542064 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-0ed83c47-6ddc-44bb-b6ba-27304813efa9 req-7810b6b8-35a8-41a1-8881-afdf5dcd4cad service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:56.578667 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-0ed83c47-6ddc-44bb-b6ba-27304813efa9 req-7810b6b8-35a8-41a1-8881-afdf5dcd4cad service nova] Creating event network-vif-plugged:acc4356a-62bc-4d7c-ae97-2b2901ef98e4 for instance 75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a on nch1-master-1 Oct 08 20:59:56.586452 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-0ed83c47-6ddc-44bb-b6ba-27304813efa9 req-7810b6b8-35a8-41a1-8881-afdf5dcd4cad service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090168 Oct 08 20:59:56.587865 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 993/2007] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:59:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 08 20:59:56.724964 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-0c284107-48cd-4b7f-ad64-13d5a1761842 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:59:56.725658 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-0c284107-48cd-4b7f-ad64-13d5a1761842 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] [instance: b1a2f781-46a1-43f3-946a-f269deb6455e] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:59:56.734459 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0c284107-48cd-4b7f-ad64-13d5a1761842 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:56.734971 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0c284107-48cd-4b7f-ad64-13d5a1761842 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:56.735476 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0c284107-48cd-4b7f-ad64-13d5a1761842 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:56.736203 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0c284107-48cd-4b7f-ad64-13d5a1761842 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:56.736609 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0c284107-48cd-4b7f-ad64-13d5a1761842 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:56.737053 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0c284107-48cd-4b7f-ad64-13d5a1761842 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:56.901313 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-2c1c4901-50c0-4ae0-baf5-cf3bca865cb3 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1698dee4a2bf4ea19a6ee0c3d5cb5c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b00ee5e7828469f95bd90548d35982a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:59:56.925655 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-2c1c4901-50c0-4ae0-baf5-cf3bca865cb3 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] 10.222.0.26 "GET /compute/v2.1/servers/75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a" status: 200 len: 1321 microversion: 2.1 time: 0.563696 Oct 08 20:59:56.940369 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1015/2008] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:59:56 2022] GET /compute/v2.1/servers/75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a => generated 1321 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:59:56.954886 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-b8cfdad5-d9c5-4f6f-b26d-db38750d3c77 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:59:56.955939 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-b8cfdad5-d9c5-4f6f-b26d-db38750d3c77 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] [instance: 992277b1-0684-4013-a6c8-3937a1d41da3] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:59:56.964253 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b8cfdad5-d9c5-4f6f-b26d-db38750d3c77 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:56.965569 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b8cfdad5-d9c5-4f6f-b26d-db38750d3c77 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:56.966261 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b8cfdad5-d9c5-4f6f-b26d-db38750d3c77 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:56.967988 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b8cfdad5-d9c5-4f6f-b26d-db38750d3c77 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:56.968675 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b8cfdad5-d9c5-4f6f-b26d-db38750d3c77 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:56.969573 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b8cfdad5-d9c5-4f6f-b26d-db38750d3c77 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:57.003656 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-0c284107-48cd-4b7f-ad64-13d5a1761842 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d2ddfa343e748c089129b0039a12ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e191d6217f024a17a14184071ac674c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:59:57.016353 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-0c284107-48cd-4b7f-ad64-13d5a1761842 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] 10.222.0.26 "GET /compute/v2.1/servers/b1a2f781-46a1-43f3-946a-f269deb6455e" status: 200 len: 1368 microversion: 2.1 time: 0.295964 Oct 08 20:59:57.019438 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 994/2009] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:59:56 2022] GET /compute/v2.1/servers/b1a2f781-46a1-43f3-946a-f269deb6455e => generated 1368 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 20:59:57.044813 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-5690282f-30ee-4247-87e4-fe9b75680a16 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:59:57.045882 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-5690282f-30ee-4247-87e4-fe9b75680a16 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] [instance: f38fc6d8-db15-4fcc-becb-9eff61447f11] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:59:57.069877 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5690282f-30ee-4247-87e4-fe9b75680a16 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:57.073723 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5690282f-30ee-4247-87e4-fe9b75680a16 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:57.074871 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5690282f-30ee-4247-87e4-fe9b75680a16 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:57.077785 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5690282f-30ee-4247-87e4-fe9b75680a16 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:57.078271 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5690282f-30ee-4247-87e4-fe9b75680a16 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:57.078795 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5690282f-30ee-4247-87e4-fe9b75680a16 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:57.339544 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-b8cfdad5-d9c5-4f6f-b26d-db38750d3c77 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06caf10b6fa43a3a2ad34858594e329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b10172715d423eb887d6c5b171defb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:59:57.354679 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-b8cfdad5-d9c5-4f6f-b26d-db38750d3c77 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] 10.222.0.26 "GET /compute/v2.1/servers/992277b1-0684-4013-a6c8-3937a1d41da3" status: 200 len: 1324 microversion: 2.1 time: 0.411120 Oct 08 20:59:57.358349 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1016/2010] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:59:56 2022] GET /compute/v2.1/servers/992277b1-0684-4013-a6c8-3937a1d41da3 => generated 1324 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:59:57.367705 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-b2fe1f65-67ba-406c-beda-4916c7f2f6d2 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:59:57.368373 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-b2fe1f65-67ba-406c-beda-4916c7f2f6d2 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] [instance: ace99763-e046-4fb7-b944-9fd25a2205f2] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:59:57.395871 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b2fe1f65-67ba-406c-beda-4916c7f2f6d2 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:57.396424 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b2fe1f65-67ba-406c-beda-4916c7f2f6d2 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:57.396870 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b2fe1f65-67ba-406c-beda-4916c7f2f6d2 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:57.397824 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b2fe1f65-67ba-406c-beda-4916c7f2f6d2 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:57.398510 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b2fe1f65-67ba-406c-beda-4916c7f2f6d2 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:57.399087 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b2fe1f65-67ba-406c-beda-4916c7f2f6d2 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:57.505273 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-5690282f-30ee-4247-87e4-fe9b75680a16 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bee8de1c3524b0f8a0dd73898637aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0921d976db440c8f59ba2f065642a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:59:57.517566 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-5690282f-30ee-4247-87e4-fe9b75680a16 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] 10.222.0.26 "GET /compute/v2.1/servers/f38fc6d8-db15-4fcc-becb-9eff61447f11" status: 200 len: 1528 microversion: 2.1 time: 0.477157 Oct 08 20:59:57.518805 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 995/2011] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:59:57 2022] GET /compute/v2.1/servers/f38fc6d8-db15-4fcc-becb-9eff61447f11 => generated 1528 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:59:57.551312 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-3421d017-e498-4d22-84d2-6f7dc2a8d13e tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:59:57.553682 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-3421d017-e498-4d22-84d2-6f7dc2a8d13e tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:59:57.564681 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3421d017-e498-4d22-84d2-6f7dc2a8d13e tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:57.568511 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3421d017-e498-4d22-84d2-6f7dc2a8d13e tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:57.569739 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3421d017-e498-4d22-84d2-6f7dc2a8d13e tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:57.570803 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3421d017-e498-4d22-84d2-6f7dc2a8d13e tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:57.572167 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3421d017-e498-4d22-84d2-6f7dc2a8d13e tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:57.573209 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3421d017-e498-4d22-84d2-6f7dc2a8d13e tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:57.803384 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-b2fe1f65-67ba-406c-beda-4916c7f2f6d2 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ddc3cd3c374bacbe5bf5e0877380e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8472b054404c46a99b81aba34d6b9f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:59:57.830211 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-b2fe1f65-67ba-406c-beda-4916c7f2f6d2 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] 10.222.0.26 "GET /compute/v2.1/servers/ace99763-e046-4fb7-b944-9fd25a2205f2" status: 200 len: 1317 microversion: 2.1 time: 0.467869 Oct 08 20:59:57.832053 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1017/2012] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:59:57 2022] GET /compute/v2.1/servers/ace99763-e046-4fb7-b944-9fd25a2205f2 => generated 1317 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:59:57.947608 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-3421d017-e498-4d22-84d2-6f7dc2a8d13e tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:59:57.956576 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-be238bc6-0de2-4aa9-b696-ce010b5afc4c tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:59:57.958391 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-be238bc6-0de2-4aa9-b696-ce010b5afc4c tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] [instance: 75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:59:57.964081 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-3421d017-e498-4d22-84d2-6f7dc2a8d13e tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd" status: 200 len: 1469 microversion: 2.1 time: 0.424762 Oct 08 20:59:57.965290 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 996/2013] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:59:57 2022] GET /compute/v2.1/servers/d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd => generated 1469 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:59:57.969948 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-be238bc6-0de2-4aa9-b696-ce010b5afc4c tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:57.970981 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-be238bc6-0de2-4aa9-b696-ce010b5afc4c tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:57.971805 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-be238bc6-0de2-4aa9-b696-ce010b5afc4c tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:57.973460 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-be238bc6-0de2-4aa9-b696-ce010b5afc4c tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:57.974202 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-be238bc6-0de2-4aa9-b696-ce010b5afc4c tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:57.975552 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-be238bc6-0de2-4aa9-b696-ce010b5afc4c tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:58.049133 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-010089a7-c46a-4a57-9a04-087d92c91f48 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:59:58.049969 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-010089a7-c46a-4a57-9a04-087d92c91f48 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] [instance: b1a2f781-46a1-43f3-946a-f269deb6455e] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:59:58.058579 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-010089a7-c46a-4a57-9a04-087d92c91f48 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:58.059402 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-010089a7-c46a-4a57-9a04-087d92c91f48 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:58.060059 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-010089a7-c46a-4a57-9a04-087d92c91f48 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:58.061254 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-010089a7-c46a-4a57-9a04-087d92c91f48 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:58.061849 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-010089a7-c46a-4a57-9a04-087d92c91f48 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:58.062390 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-010089a7-c46a-4a57-9a04-087d92c91f48 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:58.309406 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-be238bc6-0de2-4aa9-b696-ce010b5afc4c tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1698dee4a2bf4ea19a6ee0c3d5cb5c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b00ee5e7828469f95bd90548d35982a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:59:58.321726 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-be238bc6-0de2-4aa9-b696-ce010b5afc4c tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] 10.222.0.26 "GET /compute/v2.1/servers/75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a" status: 200 len: 1321 microversion: 2.1 time: 0.370018 Oct 08 20:59:58.325670 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1018/2014] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:59:57 2022] GET /compute/v2.1/servers/75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a => generated 1321 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:59:58.335640 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-9ed6f736-112a-4b95-9d97-666713eb6807 req-f7e57e56-7eca-4763-8e79-36bada4365db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ace99763-e046-4fb7-b944-9fd25a2205f2", "tag": "e69d9159-fc32-433f-bf69-481ccceff1c2"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:59:58.362640 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-9ed6f736-112a-4b95-9d97-666713eb6807 req-f7e57e56-7eca-4763-8e79-36bada4365db service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:58.363258 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-9ed6f736-112a-4b95-9d97-666713eb6807 req-f7e57e56-7eca-4763-8e79-36bada4365db service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:58.363809 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-9ed6f736-112a-4b95-9d97-666713eb6807 req-f7e57e56-7eca-4763-8e79-36bada4365db service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:58.389370 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-9ed6f736-112a-4b95-9d97-666713eb6807 req-f7e57e56-7eca-4763-8e79-36bada4365db service nova] Creating event network-changed:e69d9159-fc32-433f-bf69-481ccceff1c2 for instance ace99763-e046-4fb7-b944-9fd25a2205f2 on nch2-master-1 Oct 08 20:59:58.395604 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-9ed6f736-112a-4b95-9d97-666713eb6807 req-f7e57e56-7eca-4763-8e79-36bada4365db service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067548 Oct 08 20:59:58.397012 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1019/2015] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:59:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:59:58.405482 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-0880797f-5716-42c2-9679-8612ec66f054 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:59:58.406492 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-0880797f-5716-42c2-9679-8612ec66f054 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] [instance: 992277b1-0684-4013-a6c8-3937a1d41da3] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:59:58.419277 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0880797f-5716-42c2-9679-8612ec66f054 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:58.419981 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0880797f-5716-42c2-9679-8612ec66f054 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:58.421540 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0880797f-5716-42c2-9679-8612ec66f054 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:58.422492 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0880797f-5716-42c2-9679-8612ec66f054 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:58.423596 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0880797f-5716-42c2-9679-8612ec66f054 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:58.423596 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0880797f-5716-42c2-9679-8612ec66f054 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:58.441558 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-010089a7-c46a-4a57-9a04-087d92c91f48 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d2ddfa343e748c089129b0039a12ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e191d6217f024a17a14184071ac674c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:59:58.451846 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-010089a7-c46a-4a57-9a04-087d92c91f48 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] 10.222.0.26 "GET /compute/v2.1/servers/b1a2f781-46a1-43f3-946a-f269deb6455e" status: 200 len: 1368 microversion: 2.1 time: 0.409392 Oct 08 20:59:58.453009 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 997/2016] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:59:58 2022] GET /compute/v2.1/servers/b1a2f781-46a1-43f3-946a-f269deb6455e => generated 1368 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:59:58.544048 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-19310883-f651-49fb-8e38-9d98c6cdd5b5 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:59:58.545823 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-19310883-f651-49fb-8e38-9d98c6cdd5b5 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] [instance: f38fc6d8-db15-4fcc-becb-9eff61447f11] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:59:58.554621 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-19310883-f651-49fb-8e38-9d98c6cdd5b5 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:58.555165 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-19310883-f651-49fb-8e38-9d98c6cdd5b5 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:58.555612 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-19310883-f651-49fb-8e38-9d98c6cdd5b5 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:58.556957 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-19310883-f651-49fb-8e38-9d98c6cdd5b5 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:58.557745 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-19310883-f651-49fb-8e38-9d98c6cdd5b5 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:58.558254 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-19310883-f651-49fb-8e38-9d98c6cdd5b5 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:58.672279 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-19310883-f651-49fb-8e38-9d98c6cdd5b5 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bee8de1c3524b0f8a0dd73898637aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0921d976db440c8f59ba2f065642a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:59:58.681460 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-19310883-f651-49fb-8e38-9d98c6cdd5b5 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] 10.222.0.26 "GET /compute/v2.1/servers/f38fc6d8-db15-4fcc-becb-9eff61447f11" status: 200 len: 1486 microversion: 2.1 time: 0.142265 Oct 08 20:59:58.682900 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 998/2017] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:59:58 2022] GET /compute/v2.1/servers/f38fc6d8-db15-4fcc-becb-9eff61447f11 => generated 1486 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:59:58.765901 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-8d5cb530-adfd-4e08-8276-10d16acb560f req-9eb0c18d-a542-4e25-a07d-a8caa65f4853 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "992277b1-0684-4013-a6c8-3937a1d41da3", "tag": "0aa370ab-ab6d-4bc3-990e-4bc72bb67a08"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:59:58.795006 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-8d5cb530-adfd-4e08-8276-10d16acb560f req-9eb0c18d-a542-4e25-a07d-a8caa65f4853 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:58.796070 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-8d5cb530-adfd-4e08-8276-10d16acb560f req-9eb0c18d-a542-4e25-a07d-a8caa65f4853 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:58.796534 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-8d5cb530-adfd-4e08-8276-10d16acb560f req-9eb0c18d-a542-4e25-a07d-a8caa65f4853 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:58.818494 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-8d5cb530-adfd-4e08-8276-10d16acb560f req-9eb0c18d-a542-4e25-a07d-a8caa65f4853 service nova] Creating event network-changed:0aa370ab-ab6d-4bc3-990e-4bc72bb67a08 for instance 992277b1-0684-4013-a6c8-3937a1d41da3 on nch1-master-1 Oct 08 20:59:58.831234 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-8d5cb530-adfd-4e08-8276-10d16acb560f req-9eb0c18d-a542-4e25-a07d-a8caa65f4853 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069697 Oct 08 20:59:58.833669 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 999/2018] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 20:59:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 20:59:58.860794 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-cbeedb21-a1fa-41d4-a68c-64c9c57ec738 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:59:58.861543 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-cbeedb21-a1fa-41d4-a68c-64c9c57ec738 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] [instance: ace99763-e046-4fb7-b944-9fd25a2205f2] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:59:58.871938 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cbeedb21-a1fa-41d4-a68c-64c9c57ec738 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:58.872668 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cbeedb21-a1fa-41d4-a68c-64c9c57ec738 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:58.873606 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cbeedb21-a1fa-41d4-a68c-64c9c57ec738 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:58.874459 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cbeedb21-a1fa-41d4-a68c-64c9c57ec738 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:58.875052 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cbeedb21-a1fa-41d4-a68c-64c9c57ec738 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:58.875597 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cbeedb21-a1fa-41d4-a68c-64c9c57ec738 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:59.139588 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-0880797f-5716-42c2-9679-8612ec66f054 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06caf10b6fa43a3a2ad34858594e329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b10172715d423eb887d6c5b171defb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:59:59.157921 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-0880797f-5716-42c2-9679-8612ec66f054 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] 10.222.0.26 "GET /compute/v2.1/servers/992277b1-0684-4013-a6c8-3937a1d41da3" status: 200 len: 1324 microversion: 2.1 time: 0.759193 Oct 08 20:59:59.169224 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1020/2019] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:59:58 2022] GET /compute/v2.1/servers/992277b1-0684-4013-a6c8-3937a1d41da3 => generated 1324 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:59:59.174643 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-6da83a36-624c-4758-b7c5-6f016dddd2c1 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:59:59.176282 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-6da83a36-624c-4758-b7c5-6f016dddd2c1 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:59:59.183850 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6da83a36-624c-4758-b7c5-6f016dddd2c1 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:59.184785 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6da83a36-624c-4758-b7c5-6f016dddd2c1 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:59.187245 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6da83a36-624c-4758-b7c5-6f016dddd2c1 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:59.188184 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6da83a36-624c-4758-b7c5-6f016dddd2c1 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:59.189630 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6da83a36-624c-4758-b7c5-6f016dddd2c1 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:59.190448 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6da83a36-624c-4758-b7c5-6f016dddd2c1 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:59.258179 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-cbeedb21-a1fa-41d4-a68c-64c9c57ec738 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ddc3cd3c374bacbe5bf5e0877380e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8472b054404c46a99b81aba34d6b9f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:59:59.274825 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-cbeedb21-a1fa-41d4-a68c-64c9c57ec738 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] 10.222.0.26 "GET /compute/v2.1/servers/ace99763-e046-4fb7-b944-9fd25a2205f2" status: 200 len: 1317 microversion: 2.1 time: 0.421672 Oct 08 20:59:59.275885 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1000/2020] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:59:58 2022] GET /compute/v2.1/servers/ace99763-e046-4fb7-b944-9fd25a2205f2 => generated 1317 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 20:59:59.347294 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-6f036309-a0ff-48f5-82aa-d29ab5491c33 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:59:59.348691 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-6f036309-a0ff-48f5-82aa-d29ab5491c33 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] [instance: 75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:59:59.356772 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6f036309-a0ff-48f5-82aa-d29ab5491c33 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:59.357821 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6f036309-a0ff-48f5-82aa-d29ab5491c33 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:59.358277 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6f036309-a0ff-48f5-82aa-d29ab5491c33 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:59.360206 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6f036309-a0ff-48f5-82aa-d29ab5491c33 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:59.360688 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6f036309-a0ff-48f5-82aa-d29ab5491c33 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:59.361214 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6f036309-a0ff-48f5-82aa-d29ab5491c33 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:59.449056 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-6da83a36-624c-4758-b7c5-6f016dddd2c1 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:59:59.459865 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-6da83a36-624c-4758-b7c5-6f016dddd2c1 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd" status: 200 len: 1474 microversion: 2.1 time: 0.290408 Oct 08 20:59:59.461202 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1021/2021] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:59:59 2022] GET /compute/v2.1/servers/d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd => generated 1474 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:59:59.479411 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-4ee71b6d-4dab-45a7-9f61-45603214d65a tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:59:59.480639 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-4ee71b6d-4dab-45a7-9f61-45603214d65a tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] [instance: b1a2f781-46a1-43f3-946a-f269deb6455e] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:59:59.487605 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4ee71b6d-4dab-45a7-9f61-45603214d65a tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:59.488419 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4ee71b6d-4dab-45a7-9f61-45603214d65a tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:59.489032 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4ee71b6d-4dab-45a7-9f61-45603214d65a tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:59.489865 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4ee71b6d-4dab-45a7-9f61-45603214d65a tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:59.490370 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4ee71b6d-4dab-45a7-9f61-45603214d65a tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:59.490785 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4ee71b6d-4dab-45a7-9f61-45603214d65a tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:59.611438 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-6f036309-a0ff-48f5-82aa-d29ab5491c33 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1698dee4a2bf4ea19a6ee0c3d5cb5c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b00ee5e7828469f95bd90548d35982a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:59:59.621451 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-6f036309-a0ff-48f5-82aa-d29ab5491c33 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] 10.222.0.26 "GET /compute/v2.1/servers/75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a" status: 200 len: 1515 microversion: 2.1 time: 0.278392 Oct 08 20:59:59.622189 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1001/2022] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:59:59 2022] GET /compute/v2.1/servers/75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a => generated 1515 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:59:59.646633 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-5a82707d-e3b4-4e69-a110-ce55aeafe6e3 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 20:59:59.649360 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-5a82707d-e3b4-4e69-a110-ce55aeafe6e3 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] [instance: 75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:59:59.653270 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-4ee71b6d-4dab-45a7-9f61-45603214d65a tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d2ddfa343e748c089129b0039a12ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e191d6217f024a17a14184071ac674c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:59:59.657153 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5a82707d-e3b4-4e69-a110-ce55aeafe6e3 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:59.657784 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5a82707d-e3b4-4e69-a110-ce55aeafe6e3 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:59.658336 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5a82707d-e3b4-4e69-a110-ce55aeafe6e3 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:59.659332 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5a82707d-e3b4-4e69-a110-ce55aeafe6e3 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:59.659800 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5a82707d-e3b4-4e69-a110-ce55aeafe6e3 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:59.660237 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5a82707d-e3b4-4e69-a110-ce55aeafe6e3 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:59.663051 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:59:59.663322 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-4ee71b6d-4dab-45a7-9f61-45603214d65a tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] 10.222.0.26 "GET /compute/v2.1/servers/b1a2f781-46a1-43f3-946a-f269deb6455e" status: 200 len: 1368 microversion: 2.1 time: 0.190843 Oct 08 20:59:59.663706 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1022/2023] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:59:59 2022] GET /compute/v2.1/servers/b1a2f781-46a1-43f3-946a-f269deb6455e => generated 1368 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 20:59:59.687601 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.objects.instance [None req-5a82707d-e3b4-4e69-a110-ce55aeafe6e3 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lazy-loading 'flavor' on Instance uuid 75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a {{(pid=140491) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 20:59:59.708489 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-5cd3cbaf-3c8a-4627-ba41-0ab3a5aee733 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:59:59.709267 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-5cd3cbaf-3c8a-4627-ba41-0ab3a5aee733 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] [instance: f38fc6d8-db15-4fcc-becb-9eff61447f11] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:59:59.717370 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5cd3cbaf-3c8a-4627-ba41-0ab3a5aee733 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:59.719749 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5cd3cbaf-3c8a-4627-ba41-0ab3a5aee733 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:59.720260 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5cd3cbaf-3c8a-4627-ba41-0ab3a5aee733 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:59.721113 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5cd3cbaf-3c8a-4627-ba41-0ab3a5aee733 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:59.721722 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5cd3cbaf-3c8a-4627-ba41-0ab3a5aee733 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:59.722208 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5cd3cbaf-3c8a-4627-ba41-0ab3a5aee733 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:59.760158 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5cd3cbaf-3c8a-4627-ba41-0ab3a5aee733 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:59.760619 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5cd3cbaf-3c8a-4627-ba41-0ab3a5aee733 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:59.761137 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5cd3cbaf-3c8a-4627-ba41-0ab3a5aee733 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:59.761701 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.objects.instance [None req-5cd3cbaf-3c8a-4627-ba41-0ab3a5aee733 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Lazy-loading 'fault' on Instance uuid f38fc6d8-db15-4fcc-becb-9eff61447f11 {{(pid=140492) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 20:59:59.812821 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-5cd3cbaf-3c8a-4627-ba41-0ab3a5aee733 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bee8de1c3524b0f8a0dd73898637aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0921d976db440c8f59ba2f065642a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 20:59:59.818902 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-5a82707d-e3b4-4e69-a110-ce55aeafe6e3 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] 10.222.0.26 "POST /compute/v2.1/servers/75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a/action" status: 200 len: 32 microversion: 2.1 time: 0.176419 Oct 08 20:59:59.819651 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1002/2024] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 20:59:59 2022] POST /compute/v2.1/servers/75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a/action => generated 32 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 08 20:59:59.832675 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-9bbbacdb-d061-4e90-8529-5b1ae93971e4 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 20:59:59.833148 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-5cd3cbaf-3c8a-4627-ba41-0ab3a5aee733 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] 10.222.0.26 "GET /compute/v2.1/servers/f38fc6d8-db15-4fcc-becb-9eff61447f11" status: 200 len: 1314 microversion: 2.1 time: 0.130528 Oct 08 20:59:59.833977 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-9bbbacdb-d061-4e90-8529-5b1ae93971e4 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] [instance: 75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 20:59:59.834127 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1023/2025] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:59:59 2022] GET /compute/v2.1/servers/f38fc6d8-db15-4fcc-becb-9eff61447f11 => generated 1314 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 20:59:59.841394 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9bbbacdb-d061-4e90-8529-5b1ae93971e4 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:59.842011 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9bbbacdb-d061-4e90-8529-5b1ae93971e4 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:59.842673 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9bbbacdb-d061-4e90-8529-5b1ae93971e4 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:59.843445 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9bbbacdb-d061-4e90-8529-5b1ae93971e4 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 20:59:59.843948 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9bbbacdb-d061-4e90-8529-5b1ae93971e4 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 20:59:59.844414 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9bbbacdb-d061-4e90-8529-5b1ae93971e4 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 20:59:59.998890 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-9bbbacdb-d061-4e90-8529-5b1ae93971e4 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1698dee4a2bf4ea19a6ee0c3d5cb5c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b00ee5e7828469f95bd90548d35982a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:00.008663 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-9bbbacdb-d061-4e90-8529-5b1ae93971e4 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] 10.222.0.26 "GET /compute/v2.1/servers/75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a" status: 200 len: 1521 microversion: 2.1 time: 0.181996 Oct 08 21:00:00.009641 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1003/2026] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 20:59:59 2022] GET /compute/v2.1/servers/75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:00.185299 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-887e8352-5117-4711-aaba-8b4338852617 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:00.186732 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-887e8352-5117-4711-aaba-8b4338852617 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] [instance: 992277b1-0684-4013-a6c8-3937a1d41da3] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:00.193481 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-887e8352-5117-4711-aaba-8b4338852617 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:00.193992 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-887e8352-5117-4711-aaba-8b4338852617 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:00.194445 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-887e8352-5117-4711-aaba-8b4338852617 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:00.195176 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-887e8352-5117-4711-aaba-8b4338852617 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:00.195644 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-887e8352-5117-4711-aaba-8b4338852617 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:00.196077 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-887e8352-5117-4711-aaba-8b4338852617 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:00.298929 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-0842adce-8d7f-4388-8f82-abee68896720 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:00.299753 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-0842adce-8d7f-4388-8f82-abee68896720 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] [instance: ace99763-e046-4fb7-b944-9fd25a2205f2] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:00.306817 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0842adce-8d7f-4388-8f82-abee68896720 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:00.307324 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0842adce-8d7f-4388-8f82-abee68896720 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:00.307858 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0842adce-8d7f-4388-8f82-abee68896720 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:00.308680 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0842adce-8d7f-4388-8f82-abee68896720 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:00.309319 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0842adce-8d7f-4388-8f82-abee68896720 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:00.309768 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0842adce-8d7f-4388-8f82-abee68896720 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:00.343933 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-887e8352-5117-4711-aaba-8b4338852617 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06caf10b6fa43a3a2ad34858594e329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b10172715d423eb887d6c5b171defb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:00.351862 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-887e8352-5117-4711-aaba-8b4338852617 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] 10.222.0.26 "GET /compute/v2.1/servers/992277b1-0684-4013-a6c8-3937a1d41da3" status: 200 len: 1324 microversion: 2.1 time: 0.170615 Oct 08 21:00:00.352518 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1024/2027] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:00 2022] GET /compute/v2.1/servers/992277b1-0684-4013-a6c8-3937a1d41da3 => generated 1324 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:00.426563 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-a0fb2920-90ec-42e5-879b-da3307bd1a37 req-b752fff2-5a1d-46b5-a980-5bc92fdaad9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f38fc6d8-db15-4fcc-becb-9eff61447f11", "name": "network-vif-deleted", "tag": "7b0b7619-5cb0-4170-8f5a-649131231917"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:00:00.438075 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-a0fb2920-90ec-42e5-879b-da3307bd1a37 req-b752fff2-5a1d-46b5-a980-5bc92fdaad9d service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:00.438759 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-a0fb2920-90ec-42e5-879b-da3307bd1a37 req-b752fff2-5a1d-46b5-a980-5bc92fdaad9d service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:00.439195 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-a0fb2920-90ec-42e5-879b-da3307bd1a37 req-b752fff2-5a1d-46b5-a980-5bc92fdaad9d service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:00.450991 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-a0fb2920-90ec-42e5-879b-da3307bd1a37 req-b752fff2-5a1d-46b5-a980-5bc92fdaad9d service nova] Creating event network-vif-deleted:7b0b7619-5cb0-4170-8f5a-649131231917 for instance f38fc6d8-db15-4fcc-becb-9eff61447f11 on nch1-master-1 Oct 08 21:00:00.453626 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-0842adce-8d7f-4388-8f82-abee68896720 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ddc3cd3c374bacbe5bf5e0877380e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8472b054404c46a99b81aba34d6b9f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:00.457927 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-a0fb2920-90ec-42e5-879b-da3307bd1a37 req-b752fff2-5a1d-46b5-a980-5bc92fdaad9d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035381 Oct 08 21:00:00.458865 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1025/2028] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:00:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:00:00.462531 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-0842adce-8d7f-4388-8f82-abee68896720 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] 10.222.0.26 "GET /compute/v2.1/servers/ace99763-e046-4fb7-b944-9fd25a2205f2" status: 200 len: 1317 microversion: 2.1 time: 0.168465 Oct 08 21:00:00.463151 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1004/2029] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:00 2022] GET /compute/v2.1/servers/ace99763-e046-4fb7-b944-9fd25a2205f2 => generated 1317 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:00:00.487176 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-507bc522-d917-4a0d-a4fd-dad2afcf045f tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:00.487934 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-507bc522-d917-4a0d-a4fd-dad2afcf045f tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:00.494579 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-507bc522-d917-4a0d-a4fd-dad2afcf045f tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:00.495058 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-507bc522-d917-4a0d-a4fd-dad2afcf045f tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:00.495519 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-507bc522-d917-4a0d-a4fd-dad2afcf045f tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:00.496250 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-507bc522-d917-4a0d-a4fd-dad2afcf045f tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:00.496717 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-507bc522-d917-4a0d-a4fd-dad2afcf045f tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:00.497155 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-507bc522-d917-4a0d-a4fd-dad2afcf045f tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:00.688045 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-7963f654-048b-4abe-8941-472ec3032e6f tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:00.688716 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-7963f654-048b-4abe-8941-472ec3032e6f tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] [instance: b1a2f781-46a1-43f3-946a-f269deb6455e] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:00.706814 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7963f654-048b-4abe-8941-472ec3032e6f tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:00.707311 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7963f654-048b-4abe-8941-472ec3032e6f tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:00.707827 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7963f654-048b-4abe-8941-472ec3032e6f tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:00.708828 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7963f654-048b-4abe-8941-472ec3032e6f tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:00.709360 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7963f654-048b-4abe-8941-472ec3032e6f tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:00.709800 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7963f654-048b-4abe-8941-472ec3032e6f tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:00.738432 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-507bc522-d917-4a0d-a4fd-dad2afcf045f tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:00.751022 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-507bc522-d917-4a0d-a4fd-dad2afcf045f tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd" status: 200 len: 1474 microversion: 2.1 time: 0.270542 Oct 08 21:00:00.752424 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1026/2030] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:00 2022] GET /compute/v2.1/servers/d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd => generated 1474 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:00.860210 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-b41a170f-12c5-4a00-96d4-d316ad890b28 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:00.860672 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-b41a170f-12c5-4a00-96d4-d316ad890b28 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] [instance: f38fc6d8-db15-4fcc-becb-9eff61447f11] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:00.864197 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=100 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:00:00.875858 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b41a170f-12c5-4a00-96d4-d316ad890b28 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:00.876613 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b41a170f-12c5-4a00-96d4-d316ad890b28 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:00.877007 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b41a170f-12c5-4a00-96d4-d316ad890b28 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:00.877890 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b41a170f-12c5-4a00-96d4-d316ad890b28 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:00.878407 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b41a170f-12c5-4a00-96d4-d316ad890b28 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:00.878992 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b41a170f-12c5-4a00-96d4-d316ad890b28 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:00.901323 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-7963f654-048b-4abe-8941-472ec3032e6f tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d2ddfa343e748c089129b0039a12ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e191d6217f024a17a14184071ac674c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:00.912561 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-7963f654-048b-4abe-8941-472ec3032e6f tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] 10.222.0.26 "GET /compute/v2.1/servers/b1a2f781-46a1-43f3-946a-f269deb6455e" status: 200 len: 1368 microversion: 2.1 time: 0.228257 Oct 08 21:00:00.918626 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1005/2031] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:00 2022] GET /compute/v2.1/servers/b1a2f781-46a1-43f3-946a-f269deb6455e => generated 1368 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:00:00.948564 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b41a170f-12c5-4a00-96d4-d316ad890b28 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:00.948564 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b41a170f-12c5-4a00-96d4-d316ad890b28 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:00.948564 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b41a170f-12c5-4a00-96d4-d316ad890b28 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:00.948937 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.objects.instance [None req-b41a170f-12c5-4a00-96d4-d316ad890b28 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Lazy-loading 'fault' on Instance uuid f38fc6d8-db15-4fcc-becb-9eff61447f11 {{(pid=140492) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 21:00:01.036194 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-b41a170f-12c5-4a00-96d4-d316ad890b28 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bee8de1c3524b0f8a0dd73898637aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0921d976db440c8f59ba2f065642a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:01.041848 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-b9f49944-4e2e-40d6-8684-303ddf8390c0 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:01.043708 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-b9f49944-4e2e-40d6-8684-303ddf8390c0 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] [instance: 75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:01.045527 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-b41a170f-12c5-4a00-96d4-d316ad890b28 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] 10.222.0.26 "GET /compute/v2.1/servers/f38fc6d8-db15-4fcc-becb-9eff61447f11" status: 200 len: 1314 microversion: 2.1 time: 0.190065 Oct 08 21:00:01.046282 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1027/2032] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:00 2022] GET /compute/v2.1/servers/f38fc6d8-db15-4fcc-becb-9eff61447f11 => generated 1314 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:00:01.057370 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b9f49944-4e2e-40d6-8684-303ddf8390c0 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:01.057885 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b9f49944-4e2e-40d6-8684-303ddf8390c0 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:01.061224 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b9f49944-4e2e-40d6-8684-303ddf8390c0 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:01.062196 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b9f49944-4e2e-40d6-8684-303ddf8390c0 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:01.062776 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b9f49944-4e2e-40d6-8684-303ddf8390c0 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:01.064988 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b9f49944-4e2e-40d6-8684-303ddf8390c0 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:01.247592 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-e9d30159-011c-4c7f-9a20-98a4dc3b4495 req-77cdeb19-4ed4-4192-b084-f7f228c5360b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1a2f781-46a1-43f3-946a-f269deb6455e", "name": "network-vif-plugged", "status": "completed", "tag": "630c8b7f-3038-4d2d-a57b-d2e5f7052fc8"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:00:01.253695 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=1 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:00:01.260573 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-e9d30159-011c-4c7f-9a20-98a4dc3b4495 req-77cdeb19-4ed4-4192-b084-f7f228c5360b service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:01.261267 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-e9d30159-011c-4c7f-9a20-98a4dc3b4495 req-77cdeb19-4ed4-4192-b084-f7f228c5360b service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:01.262037 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-e9d30159-011c-4c7f-9a20-98a4dc3b4495 req-77cdeb19-4ed4-4192-b084-f7f228c5360b service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:01.277762 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-e9d30159-011c-4c7f-9a20-98a4dc3b4495 req-77cdeb19-4ed4-4192-b084-f7f228c5360b service nova] Creating event network-vif-plugged:630c8b7f-3038-4d2d-a57b-d2e5f7052fc8 for instance b1a2f781-46a1-43f3-946a-f269deb6455e on nch2-master-1 Oct 08 21:00:01.283265 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-e9d30159-011c-4c7f-9a20-98a4dc3b4495 req-77cdeb19-4ed4-4192-b084-f7f228c5360b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039744 Oct 08 21:00:01.284445 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1028/2033] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:00:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 08 21:00:01.352183 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-b9f49944-4e2e-40d6-8684-303ddf8390c0 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1698dee4a2bf4ea19a6ee0c3d5cb5c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b00ee5e7828469f95bd90548d35982a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:01.361276 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-b9f49944-4e2e-40d6-8684-303ddf8390c0 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] 10.222.0.26 "GET /compute/v2.1/servers/75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a" status: 200 len: 1521 microversion: 2.1 time: 0.327213 Oct 08 21:00:01.361857 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1006/2034] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:01 2022] GET /compute/v2.1/servers/75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a => generated 1521 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:01.383125 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-8b609970-fde6-4973-8883-7dc45ca10efc tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:01.383844 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-8b609970-fde6-4973-8883-7dc45ca10efc tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] [instance: 992277b1-0684-4013-a6c8-3937a1d41da3] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:01.391386 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8b609970-fde6-4973-8883-7dc45ca10efc tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:01.391884 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8b609970-fde6-4973-8883-7dc45ca10efc tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:01.392333 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8b609970-fde6-4973-8883-7dc45ca10efc tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:01.393770 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8b609970-fde6-4973-8883-7dc45ca10efc tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:01.394400 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8b609970-fde6-4973-8883-7dc45ca10efc tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:01.394984 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8b609970-fde6-4973-8883-7dc45ca10efc tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:01.495345 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-876e2f08-4ec3-471f-9d31-51a436e554ec tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:01.496141 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-876e2f08-4ec3-471f-9d31-51a436e554ec tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] [instance: ace99763-e046-4fb7-b944-9fd25a2205f2] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:01.504037 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-876e2f08-4ec3-471f-9d31-51a436e554ec tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:01.504780 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-876e2f08-4ec3-471f-9d31-51a436e554ec tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:01.505413 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-876e2f08-4ec3-471f-9d31-51a436e554ec tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:01.506189 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-876e2f08-4ec3-471f-9d31-51a436e554ec tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:01.506707 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-876e2f08-4ec3-471f-9d31-51a436e554ec tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:01.507141 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-876e2f08-4ec3-471f-9d31-51a436e554ec tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:01.691862 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-8b609970-fde6-4973-8883-7dc45ca10efc tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06caf10b6fa43a3a2ad34858594e329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b10172715d423eb887d6c5b171defb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:01.695197 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=100 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:00:01.703355 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-8b609970-fde6-4973-8883-7dc45ca10efc tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] 10.222.0.26 "GET /compute/v2.1/servers/992277b1-0684-4013-a6c8-3937a1d41da3" status: 200 len: 1324 microversion: 2.1 time: 0.324975 Oct 08 21:00:01.706086 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1029/2035] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:01 2022] GET /compute/v2.1/servers/992277b1-0684-4013-a6c8-3937a1d41da3 => generated 1324 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:01.745691 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=4 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:00:01.777036 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-379ac20d-a68b-4f6e-b659-f637003f18b5 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:01.777752 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-379ac20d-a68b-4f6e-b659-f637003f18b5 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:01.785694 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-379ac20d-a68b-4f6e-b659-f637003f18b5 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:01.786146 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-379ac20d-a68b-4f6e-b659-f637003f18b5 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:01.787246 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-379ac20d-a68b-4f6e-b659-f637003f18b5 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:01.787984 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-379ac20d-a68b-4f6e-b659-f637003f18b5 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:01.788451 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-379ac20d-a68b-4f6e-b659-f637003f18b5 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:01.788895 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-379ac20d-a68b-4f6e-b659-f637003f18b5 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:01.897167 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-876e2f08-4ec3-471f-9d31-51a436e554ec tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ddc3cd3c374bacbe5bf5e0877380e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8472b054404c46a99b81aba34d6b9f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:01.912138 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-876e2f08-4ec3-471f-9d31-51a436e554ec tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] 10.222.0.26 "GET /compute/v2.1/servers/ace99763-e046-4fb7-b944-9fd25a2205f2" status: 200 len: 1317 microversion: 2.1 time: 0.422726 Oct 08 21:00:01.913536 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1007/2036] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:01 2022] GET /compute/v2.1/servers/ace99763-e046-4fb7-b944-9fd25a2205f2 => generated 1317 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:00:01.947803 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-4ddac8a1-cfe9-4c77-951d-955a666ef804 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:01.949708 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-4ddac8a1-cfe9-4c77-951d-955a666ef804 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] [instance: b1a2f781-46a1-43f3-946a-f269deb6455e] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:01.961207 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4ddac8a1-cfe9-4c77-951d-955a666ef804 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:01.962026 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4ddac8a1-cfe9-4c77-951d-955a666ef804 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:01.962528 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4ddac8a1-cfe9-4c77-951d-955a666ef804 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:01.963543 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4ddac8a1-cfe9-4c77-951d-955a666ef804 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:01.964016 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4ddac8a1-cfe9-4c77-951d-955a666ef804 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:01.964440 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4ddac8a1-cfe9-4c77-951d-955a666ef804 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:02.004019 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-379ac20d-a68b-4f6e-b659-f637003f18b5 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:02.015487 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-379ac20d-a68b-4f6e-b659-f637003f18b5 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd" status: 200 len: 1474 microversion: 2.1 time: 0.240555 Oct 08 21:00:02.016535 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1030/2037] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:01 2022] GET /compute/v2.1/servers/d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd => generated 1474 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:00:02.076950 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-91c7c98a-b453-4df3-a2d6-3c8aea6e1626 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:02.077915 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-91c7c98a-b453-4df3-a2d6-3c8aea6e1626 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] [instance: f38fc6d8-db15-4fcc-becb-9eff61447f11] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:02.089024 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-91c7c98a-b453-4df3-a2d6-3c8aea6e1626 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:02.089765 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-91c7c98a-b453-4df3-a2d6-3c8aea6e1626 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:02.090245 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-91c7c98a-b453-4df3-a2d6-3c8aea6e1626 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:02.091007 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-91c7c98a-b453-4df3-a2d6-3c8aea6e1626 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:02.091499 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-91c7c98a-b453-4df3-a2d6-3c8aea6e1626 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:02.092605 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-91c7c98a-b453-4df3-a2d6-3c8aea6e1626 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:02.107971 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-91c7c98a-b453-4df3-a2d6-3c8aea6e1626 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] HTTP exception thrown: Instance f38fc6d8-db15-4fcc-becb-9eff61447f11 could not be found. Oct 08 21:00:02.110900 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-91c7c98a-b453-4df3-a2d6-3c8aea6e1626 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Request method failure captured: Oct 08 21:00:02.110900 ncdv-master-1 devstack@n-api.service[140492]: request: GET /compute/v2.1/servers/f38fc6d8-db15-4fcc-becb-9eff61447f11 HTTP/1.1 Oct 08 21:00:02.110900 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:00:02.110900 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:00:02.110900 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:00:02.110900 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 21:00:02.110900 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:00:02.110900 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:00:02.110900 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:00:02.110900 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:00:02.110900 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeSvKhkPuHk-j-aJO7AUkh3h3ZIRJfCslSGnoNixnYQkijkcFLfr60fjE0VPt0vLNyhAxwsw4S2hiCPaa9mu4UgYBtnuNKuPFvkAShdsyHDUEqNnuEDS6Qp1B1HF1Uzv4hdjCwDfasSehDca5Vkw5NviKfmkorEw13vG1LqEWdEpk0U Oct 08 21:00:02.110900 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:00:02.110900 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:00:02.110900 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:00:02.110900 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:00:02.110900 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:00:02.110900 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:00:02.110900 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: de0921d976db440c8f59ba2f065642a0 Oct 08 21:00:02.110900 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-879838128 Oct 08 21:00:02.110900 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:00:02.110900 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:00:02.110900 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/de0921d976db440c8f59ba2f065642a0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/de0921d976db440c8f59ba2f065642a0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_de0921d976db440c8f59ba2f065642a0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/de0921d976db440c8f59ba2f065642a0"}]}] Oct 08 21:00:02.110900 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-879838128 Oct 08 21:00:02.110900 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: de0921d976db440c8f59ba2f065642a0 Oct 08 21:00:02.110900 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-879838128 Oct 08 21:00:02.110900 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-InstanceActionsNegativeTestJSON-879838128-project Oct 08 21:00:02.110900 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:00:02.110900 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:00:02.110900 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 6bee8de1c3524b0f8a0dd73898637aa7 Oct 08 21:00:02.110900 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-879838128-project Oct 08 21:00:02.110900 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 21:00:02.110900 ncdv-master-1 devstack@n-api.service[140492]: exception: Instance f38fc6d8-db15-4fcc-becb-9eff61447f11 could not be found. Oct 08 21:00:02.110900 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': 'f38fc6d8-db15-4fcc-becb-9eff61447f11'} Oct 08 21:00:02.110900 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:00:02.110900 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:00:02.110900 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:00:02.110900 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:00:02.110900 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:00:02.110900 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:00:02.110900 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:00:02.110900 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:00:02.110900 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:00:02.110900 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:00:02.110900 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f38fc6d8-db15-4fcc-becb-9eff61447f11 could not be found. Oct 08 21:00:02.110900 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:00:02.110900 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:00:02.110900 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:00:02.110900 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:00:02.110900 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:00:02.110900 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:00:02.110900 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:00:02.110900 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:00:02.110900 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:00:02.110900 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:00:02.110900 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:00:02.110900 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:00:02.110900 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:00:02.110900 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:00:02.110900 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:00:02.110900 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:00:02.110900 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f38fc6d8-db15-4fcc-becb-9eff61447f11 could not be found. Oct 08 21:00:02.110900 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:00:02.110900 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:00:02.114161 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:00:02.114161 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:00:02.114161 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:00:02.114161 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:00:02.114161 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:00:02.114161 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:00:02.114161 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f38fc6d8-db15-4fcc-becb-9eff61447f11 could not be found. Oct 08 21:00:02.114161 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:00:02.114161 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-91c7c98a-b453-4df3-a2d6-3c8aea6e1626 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] Returning 404 to user: Instance f38fc6d8-db15-4fcc-becb-9eff61447f11 could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:00:02.114161 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-91c7c98a-b453-4df3-a2d6-3c8aea6e1626 tempest-InstanceActionsNegativeTestJSON-879838128 tempest-InstanceActionsNegativeTestJSON-879838128-project] 10.222.0.26 "GET /compute/v2.1/servers/f38fc6d8-db15-4fcc-becb-9eff61447f11" status: 404 len: 111 microversion: 2.1 time: 0.044681 Oct 08 21:00:02.114161 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1031/2038] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:02 2022] GET /compute/v2.1/servers/f38fc6d8-db15-4fcc-becb-9eff61447f11 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:00:02.124344 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-4ddac8a1-cfe9-4c77-951d-955a666ef804 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d2ddfa343e748c089129b0039a12ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e191d6217f024a17a14184071ac674c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:02.133680 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-4ddac8a1-cfe9-4c77-951d-955a666ef804 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] 10.222.0.26 "GET /compute/v2.1/servers/b1a2f781-46a1-43f3-946a-f269deb6455e" status: 200 len: 1368 microversion: 2.1 time: 0.191074 Oct 08 21:00:02.134451 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1008/2039] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:01 2022] GET /compute/v2.1/servers/b1a2f781-46a1-43f3-946a-f269deb6455e => generated 1368 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:02.384096 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-0d3928f4-537f-4ac8-9d84-88d37525ce32 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:02.384835 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-0d3928f4-537f-4ac8-9d84-88d37525ce32 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] [instance: 75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:02.392682 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0d3928f4-537f-4ac8-9d84-88d37525ce32 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:02.393372 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0d3928f4-537f-4ac8-9d84-88d37525ce32 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:02.393842 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0d3928f4-537f-4ac8-9d84-88d37525ce32 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:02.394582 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0d3928f4-537f-4ac8-9d84-88d37525ce32 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:02.395365 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0d3928f4-537f-4ac8-9d84-88d37525ce32 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:02.395860 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0d3928f4-537f-4ac8-9d84-88d37525ce32 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:02.654694 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-0d3928f4-537f-4ac8-9d84-88d37525ce32 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1698dee4a2bf4ea19a6ee0c3d5cb5c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b00ee5e7828469f95bd90548d35982a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:02.664731 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-0d3928f4-537f-4ac8-9d84-88d37525ce32 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] 10.222.0.26 "GET /compute/v2.1/servers/75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a" status: 200 len: 1521 microversion: 2.1 time: 0.284518 Oct 08 21:00:02.665350 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1032/2040] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:02 2022] GET /compute/v2.1/servers/75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a => generated 1521 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:02.731550 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-7f5b13d4-e305-4316-a68a-add5a8bf68ad tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:02.732202 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-7f5b13d4-e305-4316-a68a-add5a8bf68ad tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] [instance: 992277b1-0684-4013-a6c8-3937a1d41da3] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:02.734635 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=14 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:00:02.745444 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7f5b13d4-e305-4316-a68a-add5a8bf68ad tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:02.746154 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7f5b13d4-e305-4316-a68a-add5a8bf68ad tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:02.746791 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7f5b13d4-e305-4316-a68a-add5a8bf68ad tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:02.747484 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7f5b13d4-e305-4316-a68a-add5a8bf68ad tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:02.748593 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7f5b13d4-e305-4316-a68a-add5a8bf68ad tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:02.749264 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7f5b13d4-e305-4316-a68a-add5a8bf68ad tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:02.898252 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-7f5b13d4-e305-4316-a68a-add5a8bf68ad tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06caf10b6fa43a3a2ad34858594e329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b10172715d423eb887d6c5b171defb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:02.906831 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-7f5b13d4-e305-4316-a68a-add5a8bf68ad tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] 10.222.0.26 "GET /compute/v2.1/servers/992277b1-0684-4013-a6c8-3937a1d41da3" status: 200 len: 1324 microversion: 2.1 time: 0.180646 Oct 08 21:00:02.907396 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1009/2041] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:02 2022] GET /compute/v2.1/servers/992277b1-0684-4013-a6c8-3937a1d41da3 => generated 1324 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:02.941522 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-3bdb0df5-8b39-4e4a-89bf-3d39b039531c tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:02.942269 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-3bdb0df5-8b39-4e4a-89bf-3d39b039531c tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] [instance: ace99763-e046-4fb7-b944-9fd25a2205f2] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:02.948858 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3bdb0df5-8b39-4e4a-89bf-3d39b039531c tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:02.949385 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3bdb0df5-8b39-4e4a-89bf-3d39b039531c tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:02.949860 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3bdb0df5-8b39-4e4a-89bf-3d39b039531c tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:02.950607 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3bdb0df5-8b39-4e4a-89bf-3d39b039531c tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:02.951590 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3bdb0df5-8b39-4e4a-89bf-3d39b039531c tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:02.952018 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3bdb0df5-8b39-4e4a-89bf-3d39b039531c tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:03.040456 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-af096ab9-58b5-4c6c-934d-bc65df2c3146 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:03.041440 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-af096ab9-58b5-4c6c-934d-bc65df2c3146 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:03.049087 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-af096ab9-58b5-4c6c-934d-bc65df2c3146 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:03.049890 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-af096ab9-58b5-4c6c-934d-bc65df2c3146 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:03.050463 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-af096ab9-58b5-4c6c-934d-bc65df2c3146 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:03.051224 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-af096ab9-58b5-4c6c-934d-bc65df2c3146 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:03.051776 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-af096ab9-58b5-4c6c-934d-bc65df2c3146 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:03.052277 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-af096ab9-58b5-4c6c-934d-bc65df2c3146 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:03.190771 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-3bdb0df5-8b39-4e4a-89bf-3d39b039531c tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ddc3cd3c374bacbe5bf5e0877380e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8472b054404c46a99b81aba34d6b9f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:03.202957 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-3bdb0df5-8b39-4e4a-89bf-3d39b039531c tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] 10.222.0.26 "GET /compute/v2.1/servers/ace99763-e046-4fb7-b944-9fd25a2205f2" status: 200 len: 1317 microversion: 2.1 time: 0.264421 Oct 08 21:00:03.215294 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-af096ab9-58b5-4c6c-934d-bc65df2c3146 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:03.221646 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1033/2042] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:02 2022] GET /compute/v2.1/servers/ace99763-e046-4fb7-b944-9fd25a2205f2 => generated 1317 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:03.231993 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-a23dd560-f071-45a1-b9c4-910ed9b01c2d tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:03.233218 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-a23dd560-f071-45a1-b9c4-910ed9b01c2d tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] [instance: b1a2f781-46a1-43f3-946a-f269deb6455e] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:03.234808 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-af096ab9-58b5-4c6c-934d-bc65df2c3146 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd" status: 200 len: 1474 microversion: 2.1 time: 0.198376 Oct 08 21:00:03.236628 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1010/2043] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:03 2022] GET /compute/v2.1/servers/d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd => generated 1474 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:00:03.240188 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a23dd560-f071-45a1-b9c4-910ed9b01c2d tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:03.240792 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a23dd560-f071-45a1-b9c4-910ed9b01c2d tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:03.241375 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a23dd560-f071-45a1-b9c4-910ed9b01c2d tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:03.242207 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a23dd560-f071-45a1-b9c4-910ed9b01c2d tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:03.242765 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a23dd560-f071-45a1-b9c4-910ed9b01c2d tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:03.243317 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a23dd560-f071-45a1-b9c4-910ed9b01c2d tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:03.475597 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-a23dd560-f071-45a1-b9c4-910ed9b01c2d tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d2ddfa343e748c089129b0039a12ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e191d6217f024a17a14184071ac674c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:03.487773 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-a23dd560-f071-45a1-b9c4-910ed9b01c2d tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] 10.222.0.26 "GET /compute/v2.1/servers/b1a2f781-46a1-43f3-946a-f269deb6455e" status: 200 len: 1559 microversion: 2.1 time: 0.262610 Oct 08 21:00:03.488300 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1034/2044] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:03 2022] GET /compute/v2.1/servers/b1a2f781-46a1-43f3-946a-f269deb6455e => generated 1559 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:03.510828 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-b98067c7-9e6d-44e1-8a63-f5879b67409f tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:03.511338 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-b98067c7-9e6d-44e1-8a63-f5879b67409f tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] [instance: b1a2f781-46a1-43f3-946a-f269deb6455e] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:03.517639 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b98067c7-9e6d-44e1-8a63-f5879b67409f tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:03.518136 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b98067c7-9e6d-44e1-8a63-f5879b67409f tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:03.518607 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b98067c7-9e6d-44e1-8a63-f5879b67409f tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:03.519316 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b98067c7-9e6d-44e1-8a63-f5879b67409f tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:03.519805 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b98067c7-9e6d-44e1-8a63-f5879b67409f tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:03.520234 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b98067c7-9e6d-44e1-8a63-f5879b67409f tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:03.598252 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-b98067c7-9e6d-44e1-8a63-f5879b67409f tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] 10.222.0.26 "GET /compute/v2.1/servers/b1a2f781-46a1-43f3-946a-f269deb6455e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091360 Oct 08 21:00:03.598962 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1011/2045] 10.222.0.26 () {58 vars in 1275 bytes} [Sat Oct 8 21:00:03 2022] GET /compute/v2.1/servers/b1a2f781-46a1-43f3-946a-f269deb6455e/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:00:03.688893 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-22ca5d92-286a-473b-9a45-95c6ef02c4a2 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:03.689560 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-22ca5d92-286a-473b-9a45-95c6ef02c4a2 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] [instance: 75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:03.698779 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-22ca5d92-286a-473b-9a45-95c6ef02c4a2 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:03.703095 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-22ca5d92-286a-473b-9a45-95c6ef02c4a2 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:03.703095 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-22ca5d92-286a-473b-9a45-95c6ef02c4a2 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:03.705790 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-22ca5d92-286a-473b-9a45-95c6ef02c4a2 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:03.706429 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-22ca5d92-286a-473b-9a45-95c6ef02c4a2 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:03.706989 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-22ca5d92-286a-473b-9a45-95c6ef02c4a2 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:03.930988 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-5746569e-3875-4b54-9d6c-e3ee00250470 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:03.932147 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-5746569e-3875-4b54-9d6c-e3ee00250470 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] [instance: 992277b1-0684-4013-a6c8-3937a1d41da3] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:03.940929 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5746569e-3875-4b54-9d6c-e3ee00250470 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:03.941692 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5746569e-3875-4b54-9d6c-e3ee00250470 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:03.942286 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5746569e-3875-4b54-9d6c-e3ee00250470 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:03.943151 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5746569e-3875-4b54-9d6c-e3ee00250470 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:03.943751 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5746569e-3875-4b54-9d6c-e3ee00250470 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:03.944555 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5746569e-3875-4b54-9d6c-e3ee00250470 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:03.975172 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-22ca5d92-286a-473b-9a45-95c6ef02c4a2 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1698dee4a2bf4ea19a6ee0c3d5cb5c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b00ee5e7828469f95bd90548d35982a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:03.983749 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-22ca5d92-286a-473b-9a45-95c6ef02c4a2 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] 10.222.0.26 "GET /compute/v2.1/servers/75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a" status: 200 len: 1521 microversion: 2.1 time: 0.299385 Oct 08 21:00:03.984346 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1035/2046] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:03 2022] GET /compute/v2.1/servers/75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a => generated 1521 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:04.231892 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e5e458a0-f2bc-427f-b54b-85a7a3edaad4 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:04.233151 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-e5e458a0-f2bc-427f-b54b-85a7a3edaad4 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] [instance: ace99763-e046-4fb7-b944-9fd25a2205f2] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:04.253792 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e5e458a0-f2bc-427f-b54b-85a7a3edaad4 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:04.256352 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e5e458a0-f2bc-427f-b54b-85a7a3edaad4 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:04.258058 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e5e458a0-f2bc-427f-b54b-85a7a3edaad4 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:04.260725 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e5e458a0-f2bc-427f-b54b-85a7a3edaad4 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:04.260725 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e5e458a0-f2bc-427f-b54b-85a7a3edaad4 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:04.262064 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e5e458a0-f2bc-427f-b54b-85a7a3edaad4 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:04.376412 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-5746569e-3875-4b54-9d6c-e3ee00250470 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06caf10b6fa43a3a2ad34858594e329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b10172715d423eb887d6c5b171defb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:04.385234 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-5746569e-3875-4b54-9d6c-e3ee00250470 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] 10.222.0.26 "GET /compute/v2.1/servers/992277b1-0684-4013-a6c8-3937a1d41da3" status: 200 len: 1324 microversion: 2.1 time: 0.458210 Oct 08 21:00:04.387848 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1012/2047] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:03 2022] GET /compute/v2.1/servers/992277b1-0684-4013-a6c8-3937a1d41da3 => generated 1324 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:04.406149 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-dc4465eb-6419-4877-ad8b-910a57191d7f req-f62a7944-f240-45d4-957c-3d8af2e394d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "992277b1-0684-4013-a6c8-3937a1d41da3", "name": "network-vif-plugged", "status": "completed", "tag": "0aa370ab-ab6d-4bc3-990e-4bc72bb67a08"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:00:04.417508 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-dc4465eb-6419-4877-ad8b-910a57191d7f req-f62a7944-f240-45d4-957c-3d8af2e394d5 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:04.419309 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-dc4465eb-6419-4877-ad8b-910a57191d7f req-f62a7944-f240-45d4-957c-3d8af2e394d5 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:04.419970 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-dc4465eb-6419-4877-ad8b-910a57191d7f req-f62a7944-f240-45d4-957c-3d8af2e394d5 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:04.439699 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-dc4465eb-6419-4877-ad8b-910a57191d7f req-f62a7944-f240-45d4-957c-3d8af2e394d5 service nova] Creating event network-vif-plugged:0aa370ab-ab6d-4bc3-990e-4bc72bb67a08 for instance 992277b1-0684-4013-a6c8-3937a1d41da3 on nch1-master-1 Oct 08 21:00:04.445414 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-dc4465eb-6419-4877-ad8b-910a57191d7f req-f62a7944-f240-45d4-957c-3d8af2e394d5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054829 Oct 08 21:00:04.449679 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1013/2048] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:00:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:00:04.456112 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-35bca177-22aa-4c78-a556-a86ee1693be8 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:04.457067 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-35bca177-22aa-4c78-a556-a86ee1693be8 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:04.465605 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-35bca177-22aa-4c78-a556-a86ee1693be8 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:04.466360 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-35bca177-22aa-4c78-a556-a86ee1693be8 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:04.467688 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-35bca177-22aa-4c78-a556-a86ee1693be8 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:04.468639 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-35bca177-22aa-4c78-a556-a86ee1693be8 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:04.469313 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-35bca177-22aa-4c78-a556-a86ee1693be8 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:04.470045 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-35bca177-22aa-4c78-a556-a86ee1693be8 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:04.810270 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-e5e458a0-f2bc-427f-b54b-85a7a3edaad4 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ddc3cd3c374bacbe5bf5e0877380e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8472b054404c46a99b81aba34d6b9f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:04.821208 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-e5e458a0-f2bc-427f-b54b-85a7a3edaad4 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] 10.222.0.26 "GET /compute/v2.1/servers/ace99763-e046-4fb7-b944-9fd25a2205f2" status: 200 len: 1317 microversion: 2.1 time: 0.596409 Oct 08 21:00:04.821907 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1036/2049] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:04 2022] GET /compute/v2.1/servers/ace99763-e046-4fb7-b944-9fd25a2205f2 => generated 1317 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:00:05.007946 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-ef56f311-4f42-4f2a-bc0a-19fdd8b06253 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:05.008891 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-ef56f311-4f42-4f2a-bc0a-19fdd8b06253 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] [instance: 75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:05.016054 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ef56f311-4f42-4f2a-bc0a-19fdd8b06253 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:05.016630 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ef56f311-4f42-4f2a-bc0a-19fdd8b06253 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:05.017145 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ef56f311-4f42-4f2a-bc0a-19fdd8b06253 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:05.018037 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ef56f311-4f42-4f2a-bc0a-19fdd8b06253 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:05.020079 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ef56f311-4f42-4f2a-bc0a-19fdd8b06253 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:05.020079 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ef56f311-4f42-4f2a-bc0a-19fdd8b06253 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:05.025460 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-35bca177-22aa-4c78-a556-a86ee1693be8 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:05.036860 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-35bca177-22aa-4c78-a556-a86ee1693be8 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd" status: 200 len: 1474 microversion: 2.1 time: 0.585518 Oct 08 21:00:05.056977 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1014/2050] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:04 2022] GET /compute/v2.1/servers/d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd => generated 1474 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:05.178339 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-286ce83b-41a4-4a76-baa4-365cf0d80734 req-fa894266-4b41-4127-869e-1f90e0c1268b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1a2f781-46a1-43f3-946a-f269deb6455e", "tag": "630c8b7f-3038-4d2d-a57b-d2e5f7052fc8"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:00:05.189496 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-286ce83b-41a4-4a76-baa4-365cf0d80734 req-fa894266-4b41-4127-869e-1f90e0c1268b service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:05.189989 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-286ce83b-41a4-4a76-baa4-365cf0d80734 req-fa894266-4b41-4127-869e-1f90e0c1268b service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:05.190433 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-286ce83b-41a4-4a76-baa4-365cf0d80734 req-fa894266-4b41-4127-869e-1f90e0c1268b service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:05.203656 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-286ce83b-41a4-4a76-baa4-365cf0d80734 req-fa894266-4b41-4127-869e-1f90e0c1268b service nova] Creating event network-changed:630c8b7f-3038-4d2d-a57b-d2e5f7052fc8 for instance b1a2f781-46a1-43f3-946a-f269deb6455e on nch2-master-1 Oct 08 21:00:05.214590 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-286ce83b-41a4-4a76-baa4-365cf0d80734 req-fa894266-4b41-4127-869e-1f90e0c1268b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039788 Oct 08 21:00:05.219618 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1015/2051] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:00:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 08 21:00:05.322554 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-ef56f311-4f42-4f2a-bc0a-19fdd8b06253 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1698dee4a2bf4ea19a6ee0c3d5cb5c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b00ee5e7828469f95bd90548d35982a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:05.335181 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-ef56f311-4f42-4f2a-bc0a-19fdd8b06253 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] 10.222.0.26 "GET /compute/v2.1/servers/75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a" status: 200 len: 1521 microversion: 2.1 time: 0.331325 Oct 08 21:00:05.337288 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1037/2052] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:05 2022] GET /compute/v2.1/servers/75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a => generated 1521 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:00:05.411372 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-fed40960-26e6-4ff5-9c6d-a82f22756c11 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:05.412087 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-fed40960-26e6-4ff5-9c6d-a82f22756c11 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] [instance: 992277b1-0684-4013-a6c8-3937a1d41da3] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:05.418757 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fed40960-26e6-4ff5-9c6d-a82f22756c11 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:05.420100 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fed40960-26e6-4ff5-9c6d-a82f22756c11 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:05.420962 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fed40960-26e6-4ff5-9c6d-a82f22756c11 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:05.422230 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fed40960-26e6-4ff5-9c6d-a82f22756c11 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:05.422834 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fed40960-26e6-4ff5-9c6d-a82f22756c11 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:05.423407 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fed40960-26e6-4ff5-9c6d-a82f22756c11 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:05.720068 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-fed40960-26e6-4ff5-9c6d-a82f22756c11 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06caf10b6fa43a3a2ad34858594e329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b10172715d423eb887d6c5b171defb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:05.738901 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-fed40960-26e6-4ff5-9c6d-a82f22756c11 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] 10.222.0.26 "GET /compute/v2.1/servers/992277b1-0684-4013-a6c8-3937a1d41da3" status: 200 len: 1324 microversion: 2.1 time: 0.331028 Oct 08 21:00:05.740284 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1016/2053] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:05 2022] GET /compute/v2.1/servers/992277b1-0684-4013-a6c8-3937a1d41da3 => generated 1324 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:05.846405 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-04e35921-b78e-4402-a75c-76ccc2d2e509 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:05.847309 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-04e35921-b78e-4402-a75c-76ccc2d2e509 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] [instance: ace99763-e046-4fb7-b944-9fd25a2205f2] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:05.855536 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-04e35921-b78e-4402-a75c-76ccc2d2e509 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:05.856219 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-04e35921-b78e-4402-a75c-76ccc2d2e509 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:05.856874 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-04e35921-b78e-4402-a75c-76ccc2d2e509 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:05.858160 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-04e35921-b78e-4402-a75c-76ccc2d2e509 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:05.859662 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-04e35921-b78e-4402-a75c-76ccc2d2e509 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:05.860308 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-04e35921-b78e-4402-a75c-76ccc2d2e509 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:06.061484 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-04e35921-b78e-4402-a75c-76ccc2d2e509 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ddc3cd3c374bacbe5bf5e0877380e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8472b054404c46a99b81aba34d6b9f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:06.063530 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-d728d00b-9a2e-4aad-85bb-172078674137 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:06.064256 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-d728d00b-9a2e-4aad-85bb-172078674137 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:06.074563 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-04e35921-b78e-4402-a75c-76ccc2d2e509 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] 10.222.0.26 "GET /compute/v2.1/servers/ace99763-e046-4fb7-b944-9fd25a2205f2" status: 200 len: 1317 microversion: 2.1 time: 0.232233 Oct 08 21:00:06.075630 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1038/2054] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:05 2022] GET /compute/v2.1/servers/ace99763-e046-4fb7-b944-9fd25a2205f2 => generated 1317 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:06.081031 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d728d00b-9a2e-4aad-85bb-172078674137 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:06.083320 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d728d00b-9a2e-4aad-85bb-172078674137 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:06.083869 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d728d00b-9a2e-4aad-85bb-172078674137 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:06.086013 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d728d00b-9a2e-4aad-85bb-172078674137 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:06.088174 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d728d00b-9a2e-4aad-85bb-172078674137 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:06.097732 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d728d00b-9a2e-4aad-85bb-172078674137 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:06.365709 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-4c0b12ad-1125-455c-a122-00bfe1591041 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:06.366360 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-4c0b12ad-1125-455c-a122-00bfe1591041 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] [instance: 75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:06.372497 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4c0b12ad-1125-455c-a122-00bfe1591041 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:06.373256 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4c0b12ad-1125-455c-a122-00bfe1591041 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:06.373748 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4c0b12ad-1125-455c-a122-00bfe1591041 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:06.374623 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4c0b12ad-1125-455c-a122-00bfe1591041 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:06.375101 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4c0b12ad-1125-455c-a122-00bfe1591041 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:06.375537 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4c0b12ad-1125-455c-a122-00bfe1591041 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:06.380968 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-d728d00b-9a2e-4aad-85bb-172078674137 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:06.388545 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-d728d00b-9a2e-4aad-85bb-172078674137 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd" status: 200 len: 1474 microversion: 2.1 time: 0.329759 Oct 08 21:00:06.389116 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1017/2055] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:06 2022] GET /compute/v2.1/servers/d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd => generated 1474 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:06.471001 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-f1784241-8f02-42c8-970a-0c6147a6be8f req-9a574f35-c537-4812-90f8-16fa20bbb949 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ace99763-e046-4fb7-b944-9fd25a2205f2", "name": "network-vif-plugged", "status": "completed", "tag": "e69d9159-fc32-433f-bf69-481ccceff1c2"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:00:06.485068 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-f1784241-8f02-42c8-970a-0c6147a6be8f req-9a574f35-c537-4812-90f8-16fa20bbb949 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:06.486268 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-f1784241-8f02-42c8-970a-0c6147a6be8f req-9a574f35-c537-4812-90f8-16fa20bbb949 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:06.487264 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-f1784241-8f02-42c8-970a-0c6147a6be8f req-9a574f35-c537-4812-90f8-16fa20bbb949 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:06.500706 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-f1784241-8f02-42c8-970a-0c6147a6be8f req-9a574f35-c537-4812-90f8-16fa20bbb949 service nova] Creating event network-vif-plugged:e69d9159-fc32-433f-bf69-481ccceff1c2 for instance ace99763-e046-4fb7-b944-9fd25a2205f2 on nch2-master-1 Oct 08 21:00:06.507882 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-f1784241-8f02-42c8-970a-0c6147a6be8f req-9a574f35-c537-4812-90f8-16fa20bbb949 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041090 Oct 08 21:00:06.508569 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1018/2056] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:00:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:00:06.523857 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-4c0b12ad-1125-455c-a122-00bfe1591041 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1698dee4a2bf4ea19a6ee0c3d5cb5c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b00ee5e7828469f95bd90548d35982a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:06.550004 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-4c0b12ad-1125-455c-a122-00bfe1591041 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] 10.222.0.26 "GET /compute/v2.1/servers/75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a" status: 200 len: 1521 microversion: 2.1 time: 0.188102 Oct 08 21:00:06.556110 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1039/2057] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:06 2022] GET /compute/v2.1/servers/75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a => generated 1521 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:06.766331 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-d6223c0c-afb9-4dd2-a816-315fd1c720b9 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:06.769437 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-d6223c0c-afb9-4dd2-a816-315fd1c720b9 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] [instance: 992277b1-0684-4013-a6c8-3937a1d41da3] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:06.778671 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d6223c0c-afb9-4dd2-a816-315fd1c720b9 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:06.779887 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d6223c0c-afb9-4dd2-a816-315fd1c720b9 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:06.780708 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d6223c0c-afb9-4dd2-a816-315fd1c720b9 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:06.781740 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d6223c0c-afb9-4dd2-a816-315fd1c720b9 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:06.782677 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d6223c0c-afb9-4dd2-a816-315fd1c720b9 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:06.784062 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d6223c0c-afb9-4dd2-a816-315fd1c720b9 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:06.789497 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:00:06.981652 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-d6223c0c-afb9-4dd2-a816-315fd1c720b9 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06caf10b6fa43a3a2ad34858594e329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b10172715d423eb887d6c5b171defb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:06.994276 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-d6223c0c-afb9-4dd2-a816-315fd1c720b9 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] 10.222.0.26 "GET /compute/v2.1/servers/992277b1-0684-4013-a6c8-3937a1d41da3" status: 200 len: 1520 microversion: 2.1 time: 0.234788 Oct 08 21:00:06.995429 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1019/2058] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:06 2022] GET /compute/v2.1/servers/992277b1-0684-4013-a6c8-3937a1d41da3 => generated 1520 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:07.018968 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-4d1abc62-1e20-47b0-9861-88d4931ef866 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:07.019960 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-4d1abc62-1e20-47b0-9861-88d4931ef866 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] [instance: 992277b1-0684-4013-a6c8-3937a1d41da3] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:07.033720 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4d1abc62-1e20-47b0-9861-88d4931ef866 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:07.034243 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4d1abc62-1e20-47b0-9861-88d4931ef866 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:07.034869 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4d1abc62-1e20-47b0-9861-88d4931ef866 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:07.035777 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4d1abc62-1e20-47b0-9861-88d4931ef866 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:07.036536 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4d1abc62-1e20-47b0-9861-88d4931ef866 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:07.036982 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4d1abc62-1e20-47b0-9861-88d4931ef866 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:07.099724 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-ac3d55e8-3df1-44e1-bd7d-ca293d9a9c02 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:07.101065 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-ac3d55e8-3df1-44e1-bd7d-ca293d9a9c02 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] [instance: ace99763-e046-4fb7-b944-9fd25a2205f2] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:07.109065 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ac3d55e8-3df1-44e1-bd7d-ca293d9a9c02 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:07.109807 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ac3d55e8-3df1-44e1-bd7d-ca293d9a9c02 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:07.110251 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ac3d55e8-3df1-44e1-bd7d-ca293d9a9c02 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:07.110995 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ac3d55e8-3df1-44e1-bd7d-ca293d9a9c02 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:07.111474 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ac3d55e8-3df1-44e1-bd7d-ca293d9a9c02 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:07.112044 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ac3d55e8-3df1-44e1-bd7d-ca293d9a9c02 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:07.213696 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-4d1abc62-1e20-47b0-9861-88d4931ef866 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06caf10b6fa43a3a2ad34858594e329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b10172715d423eb887d6c5b171defb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:07.224835 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-4d1abc62-1e20-47b0-9861-88d4931ef866 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] 10.222.0.26 "GET /compute/v2.1/servers/992277b1-0684-4013-a6c8-3937a1d41da3" status: 200 len: 1520 microversion: 2.1 time: 0.209675 Oct 08 21:00:07.226113 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1040/2059] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:07 2022] GET /compute/v2.1/servers/992277b1-0684-4013-a6c8-3937a1d41da3 => generated 1520 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:07.248712 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-d5589274-dcd4-4770-9400-c8e171474bba tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-309272091", "metadata": {"": ""}}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:00:07.253935 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-d5589274-dcd4-4770-9400-c8e171474bba tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Request method failure captured: Oct 08 21:00:07.253935 ncdv-master-1 devstack@n-api.service[140492]: request: POST /compute/v2.1/servers/992277b1-0684-4013-a6c8-3937a1d41da3/action HTTP/1.1 Oct 08 21:00:07.253935 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:00:07.253935 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:00:07.253935 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:00:07.253935 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 106 Oct 08 21:00:07.253935 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:00:07.253935 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:00:07.253935 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:00:07.253935 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:00:07.253935 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeTE7bTfM4hIhoviKx9l8mw-bWfYL6jsTZW_QjKSgS6NcvR5fjqeBn6E1jAPDuPpZvhMcTeb9kBH8YZZEMCFr_F1J-nxa8vLVrJvg33lxBDKWqjORjFzU7YTBNB-gB5p5hXf0cUCzsO7xU_2VbukaClcdx1U8H5njKq8mVnqRKHv1K4 Oct 08 21:00:07.253935 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:00:07.253935 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:00:07.253935 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:00:07.253935 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:00:07.253935 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:00:07.253935 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:00:07.253935 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 76b10172715d423eb887d6c5b171defb Oct 08 21:00:07.253935 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1001637313 Oct 08 21:00:07.253935 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:00:07.253935 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:00:07.253935 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/76b10172715d423eb887d6c5b171defb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/76b10172715d423eb887d6c5b171defb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_76b10172715d423eb887d6c5b171defb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/76b10172715d423eb887d6c5b171defb"}]}] Oct 08 21:00:07.253935 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1001637313 Oct 08 21:00:07.253935 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 76b10172715d423eb887d6c5b171defb Oct 08 21:00:07.253935 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1001637313 Oct 08 21:00:07.253935 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-ImagesOneServerNegativeTestJSON-1001637313-project Oct 08 21:00:07.253935 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:00:07.253935 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:00:07.253935 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: f06caf10b6fa43a3a2ad34858594e329 Oct 08 21:00:07.253935 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1001637313-project Oct 08 21:00:07.253935 ncdv-master-1 devstack@n-api.service[140492]: Oct 08 21:00:07.253935 ncdv-master-1 devstack@n-api.service[140492]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-309272091", "metadata": {"": ""}}} Oct 08 21:00:07.253935 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 21:00:07.253935 ncdv-master-1 devstack@n-api.service[140492]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 08 21:00:07.253935 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': '992277b1-0684-4013-a6c8-3937a1d41da3', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-309272091', 'metadata': {'': ''}}}} Oct 08 21:00:07.253935 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:00:07.253935 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:00:07.253935 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 08 21:00:07.253935 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 08 21:00:07.253935 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 08 21:00:07.253935 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise error Oct 08 21:00:07.253935 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 08 21:00:07.253935 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:00:07.253935 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Oct 08 21:00:07.253935 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 08 21:00:07.253935 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 08 21:00:07.253935 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 08 21:00:07.253935 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 08 21:00:07.253935 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:00:07.253935 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 08 21:00:07.253935 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi {'': ''} Oct 08 21:00:07.253935 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:00:07.253935 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:00:07.253935 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:00:07.253935 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:00:07.253935 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:00:07.253935 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:00:07.253935 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:00:07.253935 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:00:07.253935 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:00:07.253935 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:00:07.253935 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 21:00:07.253935 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 21:00:07.253935 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 08 21:00:07.258174 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 08 21:00:07.258174 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 08 21:00:07.258174 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 08 21:00:07.258174 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 08 21:00:07.258174 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 08 21:00:07.258174 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 08 21:00:07.258174 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:00:07.258174 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:00:07.258174 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:00:07.258174 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:00:07.258174 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:00:07.258174 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:00:07.258174 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 08 21:00:07.258174 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 08 21:00:07.258174 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 08 21:00:07.258174 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:00:07.259598 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-d5589274-dcd4-4770-9400-c8e171474bba tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:00:07.260695 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-d5589274-dcd4-4770-9400-c8e171474bba tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] 10.222.0.26 "POST /compute/v2.1/servers/992277b1-0684-4013-a6c8-3937a1d41da3/action" status: 400 len: 170 microversion: 2.1 time: 0.016459 Oct 08 21:00:07.261647 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1041/2060] 10.222.0.26 () {60 vars in 1279 bytes} [Sat Oct 8 21:00:07 2022] POST /compute/v2.1/servers/992277b1-0684-4013-a6c8-3937a1d41da3/action => generated 170 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 08 21:00:07.273874 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-2dc7ba62-4e4d-46fd-9b1e-78ed56a7b265 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:07.275867 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-2dc7ba62-4e4d-46fd-9b1e-78ed56a7b265 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] [instance: 992277b1-0684-4013-a6c8-3937a1d41da3] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:07.283462 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2dc7ba62-4e4d-46fd-9b1e-78ed56a7b265 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:07.283984 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2dc7ba62-4e4d-46fd-9b1e-78ed56a7b265 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:07.284458 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2dc7ba62-4e4d-46fd-9b1e-78ed56a7b265 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:07.285206 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2dc7ba62-4e4d-46fd-9b1e-78ed56a7b265 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:07.285847 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2dc7ba62-4e4d-46fd-9b1e-78ed56a7b265 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:07.286294 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2dc7ba62-4e4d-46fd-9b1e-78ed56a7b265 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:07.337507 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-ac3d55e8-3df1-44e1-bd7d-ca293d9a9c02 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ddc3cd3c374bacbe5bf5e0877380e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8472b054404c46a99b81aba34d6b9f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:07.346113 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-ac3d55e8-3df1-44e1-bd7d-ca293d9a9c02 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] 10.222.0.26 "GET /compute/v2.1/servers/ace99763-e046-4fb7-b944-9fd25a2205f2" status: 200 len: 1317 microversion: 2.1 time: 0.251663 Oct 08 21:00:07.346834 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1020/2061] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:07 2022] GET /compute/v2.1/servers/ace99763-e046-4fb7-b944-9fd25a2205f2 => generated 1317 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:00:07.412691 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-566c6d5e-0c4a-4580-92bb-fd3c6600c784 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:07.413333 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-566c6d5e-0c4a-4580-92bb-fd3c6600c784 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:07.420587 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-566c6d5e-0c4a-4580-92bb-fd3c6600c784 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:07.421123 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-566c6d5e-0c4a-4580-92bb-fd3c6600c784 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:07.421591 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-566c6d5e-0c4a-4580-92bb-fd3c6600c784 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:07.422323 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-566c6d5e-0c4a-4580-92bb-fd3c6600c784 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:07.422757 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-566c6d5e-0c4a-4580-92bb-fd3c6600c784 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:07.423665 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-566c6d5e-0c4a-4580-92bb-fd3c6600c784 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:07.442301 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-2dc7ba62-4e4d-46fd-9b1e-78ed56a7b265 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06caf10b6fa43a3a2ad34858594e329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b10172715d423eb887d6c5b171defb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:07.450483 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-2dc7ba62-4e4d-46fd-9b1e-78ed56a7b265 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] 10.222.0.26 "GET /compute/v2.1/servers/992277b1-0684-4013-a6c8-3937a1d41da3" status: 200 len: 1520 microversion: 2.1 time: 0.180775 Oct 08 21:00:07.451606 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1042/2062] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:07 2022] GET /compute/v2.1/servers/992277b1-0684-4013-a6c8-3937a1d41da3 => generated 1520 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:07.482430 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-4ded7ee6-c0cf-4465-98b6-c5435580c3b9 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:07.482991 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-4ded7ee6-c0cf-4465-98b6-c5435580c3b9 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] [instance: 992277b1-0684-4013-a6c8-3937a1d41da3] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:07.495238 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4ded7ee6-c0cf-4465-98b6-c5435580c3b9 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:07.495819 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4ded7ee6-c0cf-4465-98b6-c5435580c3b9 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:07.496336 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4ded7ee6-c0cf-4465-98b6-c5435580c3b9 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:07.497165 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4ded7ee6-c0cf-4465-98b6-c5435580c3b9 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:07.497760 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4ded7ee6-c0cf-4465-98b6-c5435580c3b9 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:07.498417 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4ded7ee6-c0cf-4465-98b6-c5435580c3b9 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:07.579160 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-566c6d5e-0c4a-4580-92bb-fd3c6600c784 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:07.590572 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-566c6d5e-0c4a-4580-92bb-fd3c6600c784 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd" status: 200 len: 1474 microversion: 2.1 time: 0.182969 Oct 08 21:00:07.591159 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1021/2063] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:07 2022] GET /compute/v2.1/servers/d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd => generated 1474 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:07.596908 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-33471552-d55d-483d-9d00-8cbac6cb4590 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:07.597845 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-33471552-d55d-483d-9d00-8cbac6cb4590 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] [instance: 75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:07.604087 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-33471552-d55d-483d-9d00-8cbac6cb4590 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:07.604587 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-33471552-d55d-483d-9d00-8cbac6cb4590 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:07.605511 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-33471552-d55d-483d-9d00-8cbac6cb4590 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:07.606306 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-33471552-d55d-483d-9d00-8cbac6cb4590 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:07.606782 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-33471552-d55d-483d-9d00-8cbac6cb4590 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:07.607254 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-33471552-d55d-483d-9d00-8cbac6cb4590 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:07.655327 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-4ded7ee6-c0cf-4465-98b6-c5435580c3b9 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06caf10b6fa43a3a2ad34858594e329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b10172715d423eb887d6c5b171defb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:07.664875 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-4ded7ee6-c0cf-4465-98b6-c5435580c3b9 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] 10.222.0.26 "GET /compute/v2.1/servers/992277b1-0684-4013-a6c8-3937a1d41da3" status: 200 len: 1520 microversion: 2.1 time: 0.193244 Oct 08 21:00:07.666161 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1043/2064] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:07 2022] GET /compute/v2.1/servers/992277b1-0684-4013-a6c8-3937a1d41da3 => generated 1520 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:00:07.689294 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e645d65b-41b4-4179-89eb-64befb7a4108 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-82522621", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:00:07.693960 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e645d65b-41b4-4179-89eb-64befb7a4108 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Request method failure captured: Oct 08 21:00:07.693960 ncdv-master-1 devstack@n-api.service[140492]: request: POST /compute/v2.1/servers/992277b1-0684-4013-a6c8-3937a1d41da3/action HTTP/1.1 Oct 08 21:00:07.693960 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:00:07.693960 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:00:07.693960 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:00:07.693960 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 617 Oct 08 21:00:07.693960 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:00:07.693960 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:00:07.693960 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:00:07.693960 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:00:07.693960 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeTE7bTfM4hIhoviKx9l8mw-bWfYL6jsTZW_QjKSgS6NcvR5fjqeBn6E1jAPDuPpZvhMcTeb9kBH8YZZEMCFr_F1J-nxa8vLVrJvg33lxBDKWqjORjFzU7YTBNB-gB5p5hXf0cUCzsO7xU_2VbukaClcdx1U8H5njKq8mVnqRKHv1K4 Oct 08 21:00:07.693960 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:00:07.693960 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:00:07.693960 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:00:07.693960 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:00:07.693960 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:00:07.693960 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:00:07.693960 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 76b10172715d423eb887d6c5b171defb Oct 08 21:00:07.693960 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1001637313 Oct 08 21:00:07.693960 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:00:07.693960 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:00:07.693960 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/76b10172715d423eb887d6c5b171defb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/76b10172715d423eb887d6c5b171defb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_76b10172715d423eb887d6c5b171defb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/76b10172715d423eb887d6c5b171defb"}]}] Oct 08 21:00:07.693960 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1001637313 Oct 08 21:00:07.693960 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 76b10172715d423eb887d6c5b171defb Oct 08 21:00:07.693960 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1001637313 Oct 08 21:00:07.693960 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-ImagesOneServerNegativeTestJSON-1001637313-project Oct 08 21:00:07.693960 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:00:07.693960 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:00:07.693960 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: f06caf10b6fa43a3a2ad34858594e329 Oct 08 21:00:07.693960 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1001637313-project Oct 08 21:00:07.693960 ncdv-master-1 devstack@n-api.service[140492]: Oct 08 21:00:07.693960 ncdv-master-1 devstack@n-api.service[140492]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-82522621", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Oct 08 21:00:07.693960 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 21:00:07.693960 ncdv-master-1 devstack@n-api.service[140492]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 08 21:00:07.693960 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': '992277b1-0684-4013-a6c8-3937a1d41da3', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-82522621', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Oct 08 21:00:07.693960 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:00:07.693960 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:00:07.693960 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 08 21:00:07.693960 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 08 21:00:07.693960 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 08 21:00:07.693960 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise error Oct 08 21:00:07.696207 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 08 21:00:07.696207 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:00:07.696207 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Oct 08 21:00:07.696207 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 08 21:00:07.696207 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 08 21:00:07.696207 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 08 21:00:07.696207 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 08 21:00:07.696207 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:00:07.696207 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 08 21:00:07.696207 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Oct 08 21:00:07.696207 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:00:07.696207 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:00:07.696207 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:00:07.696207 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:00:07.696207 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:00:07.696207 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:00:07.696207 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:00:07.696207 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:00:07.696207 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:00:07.696207 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:00:07.696207 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 21:00:07.696207 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 21:00:07.696207 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 08 21:00:07.696207 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 08 21:00:07.696207 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 08 21:00:07.696207 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 08 21:00:07.696207 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 08 21:00:07.696207 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 08 21:00:07.696207 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 08 21:00:07.696207 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:00:07.696207 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:00:07.696207 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:00:07.696207 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:00:07.696207 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:00:07.696207 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:00:07.696207 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 08 21:00:07.696207 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 08 21:00:07.696207 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 08 21:00:07.696207 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:00:07.699840 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e645d65b-41b4-4179-89eb-64befb7a4108 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:00:07.702387 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-e645d65b-41b4-4179-89eb-64befb7a4108 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] 10.222.0.26 "POST /compute/v2.1/servers/992277b1-0684-4013-a6c8-3937a1d41da3/action" status: 400 len: 938 microversion: 2.1 time: 0.018118 Oct 08 21:00:07.703430 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1044/2065] 10.222.0.26 () {60 vars in 1279 bytes} [Sat Oct 8 21:00:07 2022] POST /compute/v2.1/servers/992277b1-0684-4013-a6c8-3937a1d41da3/action => generated 938 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 08 21:00:07.712263 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-215e43a3-7ff9-41ab-803d-1bb7bbfa01d1 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:07.713442 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-215e43a3-7ff9-41ab-803d-1bb7bbfa01d1 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] [instance: 992277b1-0684-4013-a6c8-3937a1d41da3] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:07.722877 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-215e43a3-7ff9-41ab-803d-1bb7bbfa01d1 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:07.723356 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-215e43a3-7ff9-41ab-803d-1bb7bbfa01d1 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:07.723848 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-215e43a3-7ff9-41ab-803d-1bb7bbfa01d1 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:07.724786 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-215e43a3-7ff9-41ab-803d-1bb7bbfa01d1 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:07.725701 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-215e43a3-7ff9-41ab-803d-1bb7bbfa01d1 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:07.726363 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-215e43a3-7ff9-41ab-803d-1bb7bbfa01d1 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:07.809875 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-33471552-d55d-483d-9d00-8cbac6cb4590 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1698dee4a2bf4ea19a6ee0c3d5cb5c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b00ee5e7828469f95bd90548d35982a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:07.828626 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-33471552-d55d-483d-9d00-8cbac6cb4590 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] 10.222.0.26 "GET /compute/v2.1/servers/75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a" status: 200 len: 1521 microversion: 2.1 time: 0.235214 Oct 08 21:00:07.830262 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1022/2066] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:07 2022] GET /compute/v2.1/servers/75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a => generated 1521 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:07.895878 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-215e43a3-7ff9-41ab-803d-1bb7bbfa01d1 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06caf10b6fa43a3a2ad34858594e329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b10172715d423eb887d6c5b171defb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:07.905958 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-215e43a3-7ff9-41ab-803d-1bb7bbfa01d1 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] 10.222.0.26 "GET /compute/v2.1/servers/992277b1-0684-4013-a6c8-3937a1d41da3" status: 200 len: 1520 microversion: 2.1 time: 0.197833 Oct 08 21:00:07.906784 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1045/2067] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:07 2022] GET /compute/v2.1/servers/992277b1-0684-4013-a6c8-3937a1d41da3 => generated 1520 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:07.932292 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-9d269f48-760f-479f-b44a-7733b1cdbfb0 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:07.932926 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-9d269f48-760f-479f-b44a-7733b1cdbfb0 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] [instance: 992277b1-0684-4013-a6c8-3937a1d41da3] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:07.939278 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9d269f48-760f-479f-b44a-7733b1cdbfb0 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:07.939837 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9d269f48-760f-479f-b44a-7733b1cdbfb0 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:07.940550 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9d269f48-760f-479f-b44a-7733b1cdbfb0 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:07.941563 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9d269f48-760f-479f-b44a-7733b1cdbfb0 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:07.942110 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9d269f48-760f-479f-b44a-7733b1cdbfb0 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:07.942623 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9d269f48-760f-479f-b44a-7733b1cdbfb0 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:08.122630 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-9d269f48-760f-479f-b44a-7733b1cdbfb0 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06caf10b6fa43a3a2ad34858594e329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b10172715d423eb887d6c5b171defb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:08.138030 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-9d269f48-760f-479f-b44a-7733b1cdbfb0 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] 10.222.0.26 "GET /compute/v2.1/servers/992277b1-0684-4013-a6c8-3937a1d41da3" status: 200 len: 1520 microversion: 2.1 time: 0.209922 Oct 08 21:00:08.145765 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1023/2068] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:07 2022] GET /compute/v2.1/servers/992277b1-0684-4013-a6c8-3937a1d41da3 => generated 1520 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:08.167796 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-8c10e1f8-6d4e-44d6-984a-0b4ea936d822 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:00:08.172971 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-8c10e1f8-6d4e-44d6-984a-0b4ea936d822 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Request method failure captured: Oct 08 21:00:08.172971 ncdv-master-1 devstack@n-api.service[140492]: request: POST /compute/v2.1/servers/992277b1-0684-4013-a6c8-3937a1d41da3/action HTTP/1.1 Oct 08 21:00:08.172971 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:00:08.172971 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:00:08.172971 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:00:08.172971 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 285 Oct 08 21:00:08.172971 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:00:08.172971 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:00:08.172971 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:00:08.172971 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:00:08.172971 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeTE7bTfM4hIhoviKx9l8mw-bWfYL6jsTZW_QjKSgS6NcvR5fjqeBn6E1jAPDuPpZvhMcTeb9kBH8YZZEMCFr_F1J-nxa8vLVrJvg33lxBDKWqjORjFzU7YTBNB-gB5p5hXf0cUCzsO7xU_2VbukaClcdx1U8H5njKq8mVnqRKHv1K4 Oct 08 21:00:08.172971 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:00:08.172971 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:00:08.172971 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:00:08.172971 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:00:08.172971 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:00:08.172971 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:00:08.172971 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 76b10172715d423eb887d6c5b171defb Oct 08 21:00:08.172971 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1001637313 Oct 08 21:00:08.172971 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:00:08.172971 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:00:08.172971 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/76b10172715d423eb887d6c5b171defb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/76b10172715d423eb887d6c5b171defb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_76b10172715d423eb887d6c5b171defb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/76b10172715d423eb887d6c5b171defb"}]}] Oct 08 21:00:08.172971 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1001637313 Oct 08 21:00:08.172971 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 76b10172715d423eb887d6c5b171defb Oct 08 21:00:08.172971 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1001637313 Oct 08 21:00:08.172971 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-ImagesOneServerNegativeTestJSON-1001637313-project Oct 08 21:00:08.172971 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:00:08.172971 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:00:08.172971 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: f06caf10b6fa43a3a2ad34858594e329 Oct 08 21:00:08.172971 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1001637313-project Oct 08 21:00:08.172971 ncdv-master-1 devstack@n-api.service[140492]: Oct 08 21:00:08.172971 ncdv-master-1 devstack@n-api.service[140492]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 08 21:00:08.172971 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 21:00:08.172971 ncdv-master-1 devstack@n-api.service[140492]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 08 21:00:08.172971 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': '992277b1-0684-4013-a6c8-3937a1d41da3', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 08 21:00:08.172971 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:00:08.172971 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:00:08.172971 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 08 21:00:08.172971 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 08 21:00:08.172971 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 08 21:00:08.172971 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise error Oct 08 21:00:08.172971 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 08 21:00:08.172971 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:00:08.172971 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Oct 08 21:00:08.172971 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 08 21:00:08.172971 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:00:08.172971 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 08 21:00:08.172971 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 08 21:00:08.172971 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:00:08.172971 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:00:08.172971 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:00:08.176203 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:00:08.176203 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:00:08.176203 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:00:08.176203 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:00:08.176203 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:00:08.176203 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:00:08.176203 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:00:08.176203 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 21:00:08.176203 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 21:00:08.176203 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 08 21:00:08.176203 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 08 21:00:08.176203 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 08 21:00:08.176203 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 08 21:00:08.176203 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 08 21:00:08.176203 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 08 21:00:08.176203 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 08 21:00:08.176203 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:00:08.176203 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:00:08.176203 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:00:08.176203 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:00:08.176203 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:00:08.176203 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:00:08.176203 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 08 21:00:08.176203 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 08 21:00:08.176203 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 08 21:00:08.176203 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:00:08.176203 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-8c10e1f8-6d4e-44d6-984a-0b4ea936d822 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:00:08.181429 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-8c10e1f8-6d4e-44d6-984a-0b4ea936d822 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] 10.222.0.26 "POST /compute/v2.1/servers/992277b1-0684-4013-a6c8-3937a1d41da3/action" status: 400 len: 619 microversion: 2.1 time: 0.014168 Oct 08 21:00:08.181429 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1046/2069] 10.222.0.26 () {60 vars in 1279 bytes} [Sat Oct 8 21:00:08 2022] POST /compute/v2.1/servers/992277b1-0684-4013-a6c8-3937a1d41da3/action => generated 619 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 08 21:00:08.186672 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-2dc23f52-d556-4cf4-9a42-ab6c69f99e5f tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:08.187320 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-2dc23f52-d556-4cf4-9a42-ab6c69f99e5f tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] [instance: 992277b1-0684-4013-a6c8-3937a1d41da3] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:08.193510 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2dc23f52-d556-4cf4-9a42-ab6c69f99e5f tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:08.194009 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2dc23f52-d556-4cf4-9a42-ab6c69f99e5f tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:08.194473 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2dc23f52-d556-4cf4-9a42-ab6c69f99e5f tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:08.195357 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2dc23f52-d556-4cf4-9a42-ab6c69f99e5f tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:08.195976 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2dc23f52-d556-4cf4-9a42-ab6c69f99e5f tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:08.196540 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2dc23f52-d556-4cf4-9a42-ab6c69f99e5f tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:08.354478 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-2dc23f52-d556-4cf4-9a42-ab6c69f99e5f tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06caf10b6fa43a3a2ad34858594e329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b10172715d423eb887d6c5b171defb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:08.363778 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-2dc23f52-d556-4cf4-9a42-ab6c69f99e5f tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] 10.222.0.26 "GET /compute/v2.1/servers/992277b1-0684-4013-a6c8-3937a1d41da3" status: 200 len: 1520 microversion: 2.1 time: 0.181524 Oct 08 21:00:08.364786 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1024/2070] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:08 2022] GET /compute/v2.1/servers/992277b1-0684-4013-a6c8-3937a1d41da3 => generated 1520 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:08.371565 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-17a50f35-1719-4756-8227-e3e5924ca0d1 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:08.372270 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-17a50f35-1719-4756-8227-e3e5924ca0d1 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] [instance: ace99763-e046-4fb7-b944-9fd25a2205f2] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:08.380448 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-17a50f35-1719-4756-8227-e3e5924ca0d1 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:08.380960 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-17a50f35-1719-4756-8227-e3e5924ca0d1 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:08.381567 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-17a50f35-1719-4756-8227-e3e5924ca0d1 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:08.386037 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-17a50f35-1719-4756-8227-e3e5924ca0d1 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:08.387198 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-17a50f35-1719-4756-8227-e3e5924ca0d1 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:08.387960 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-f3e1c18e-e566-41eb-8113-6910fa8140ed tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:08.388819 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-17a50f35-1719-4756-8227-e3e5924ca0d1 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:08.389131 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-f3e1c18e-e566-41eb-8113-6910fa8140ed tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] [instance: 992277b1-0684-4013-a6c8-3937a1d41da3] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:08.395546 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f3e1c18e-e566-41eb-8113-6910fa8140ed tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:08.396200 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f3e1c18e-e566-41eb-8113-6910fa8140ed tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:08.396620 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f3e1c18e-e566-41eb-8113-6910fa8140ed tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:08.397535 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f3e1c18e-e566-41eb-8113-6910fa8140ed tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:08.398234 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f3e1c18e-e566-41eb-8113-6910fa8140ed tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:08.398756 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f3e1c18e-e566-41eb-8113-6910fa8140ed tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:08.554764 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-f3e1c18e-e566-41eb-8113-6910fa8140ed tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06caf10b6fa43a3a2ad34858594e329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b10172715d423eb887d6c5b171defb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:08.564229 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-f3e1c18e-e566-41eb-8113-6910fa8140ed tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] 10.222.0.26 "GET /compute/v2.1/servers/992277b1-0684-4013-a6c8-3937a1d41da3" status: 200 len: 1520 microversion: 2.1 time: 0.180356 Oct 08 21:00:08.565035 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1025/2071] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:08 2022] GET /compute/v2.1/servers/992277b1-0684-4013-a6c8-3937a1d41da3 => generated 1520 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:00:08.588142 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-6e80f04d-57e4-41f9-8196-60146bd9f803 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-37460002"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:00:08.590623 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-6e80f04d-57e4-41f9-8196-60146bd9f803 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] [instance: 992277b1-0684-4013-a6c8-3937a1d41da3] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:08.596294 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-17a50f35-1719-4756-8227-e3e5924ca0d1 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ddc3cd3c374bacbe5bf5e0877380e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8472b054404c46a99b81aba34d6b9f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:08.604918 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-17a50f35-1719-4756-8227-e3e5924ca0d1 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] 10.222.0.26 "GET /compute/v2.1/servers/ace99763-e046-4fb7-b944-9fd25a2205f2" status: 200 len: 1467 microversion: 2.1 time: 0.238382 Oct 08 21:00:08.606486 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6e80f04d-57e4-41f9-8196-60146bd9f803 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:08.607254 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6e80f04d-57e4-41f9-8196-60146bd9f803 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:08.608087 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6e80f04d-57e4-41f9-8196-60146bd9f803 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:08.609013 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6e80f04d-57e4-41f9-8196-60146bd9f803 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:08.614126 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6e80f04d-57e4-41f9-8196-60146bd9f803 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:08.614887 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6e80f04d-57e4-41f9-8196-60146bd9f803 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:08.618217 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1047/2072] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:08 2022] GET /compute/v2.1/servers/ace99763-e046-4fb7-b944-9fd25a2205f2 => generated 1467 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:08.630040 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-59dc618a-143f-486b-89a2-9a01c18fb3f2 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:08.630983 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-59dc618a-143f-486b-89a2-9a01c18fb3f2 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:08.637268 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-59dc618a-143f-486b-89a2-9a01c18fb3f2 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:08.637946 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-59dc618a-143f-486b-89a2-9a01c18fb3f2 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:08.639172 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-59dc618a-143f-486b-89a2-9a01c18fb3f2 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:08.640174 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-59dc618a-143f-486b-89a2-9a01c18fb3f2 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:08.640853 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-59dc618a-143f-486b-89a2-9a01c18fb3f2 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:08.641486 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-59dc618a-143f-486b-89a2-9a01c18fb3f2 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:08.864685 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-6e80f04d-57e4-41f9-8196-60146bd9f803 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] 10.222.0.26 "POST /compute/v2.1/servers/992277b1-0684-4013-a6c8-3937a1d41da3/action" status: 202 len: 0 microversion: 2.1 time: 0.280400 Oct 08 21:00:08.865397 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1026/2073] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:00:08 2022] POST /compute/v2.1/servers/992277b1-0684-4013-a6c8-3937a1d41da3/action => generated 0 bytes in 282 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Oct 08 21:00:08.877657 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-a8e9d282-3906-4a12-9f20-b727cd602cc8 tempest-ServersOnMultiNodesTest-429096361 tempest-ServersOnMultiNodesTest-429096361-project-admin] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:08.878980 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-a8e9d282-3906-4a12-9f20-b727cd602cc8 tempest-ServersOnMultiNodesTest-429096361 tempest-ServersOnMultiNodesTest-429096361-project-admin] [instance: ace99763-e046-4fb7-b944-9fd25a2205f2] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:08.889079 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a8e9d282-3906-4a12-9f20-b727cd602cc8 tempest-ServersOnMultiNodesTest-429096361 tempest-ServersOnMultiNodesTest-429096361-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:08.890628 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a8e9d282-3906-4a12-9f20-b727cd602cc8 tempest-ServersOnMultiNodesTest-429096361 tempest-ServersOnMultiNodesTest-429096361-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:08.891493 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a8e9d282-3906-4a12-9f20-b727cd602cc8 tempest-ServersOnMultiNodesTest-429096361 tempest-ServersOnMultiNodesTest-429096361-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:08.892682 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a8e9d282-3906-4a12-9f20-b727cd602cc8 tempest-ServersOnMultiNodesTest-429096361 tempest-ServersOnMultiNodesTest-429096361-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:08.893224 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a8e9d282-3906-4a12-9f20-b727cd602cc8 tempest-ServersOnMultiNodesTest-429096361 tempest-ServersOnMultiNodesTest-429096361-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:08.894644 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a8e9d282-3906-4a12-9f20-b727cd602cc8 tempest-ServersOnMultiNodesTest-429096361 tempest-ServersOnMultiNodesTest-429096361-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:08.910747 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-59dc618a-143f-486b-89a2-9a01c18fb3f2 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:08.920884 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-59dc618a-143f-486b-89a2-9a01c18fb3f2 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd" status: 200 len: 1474 microversion: 2.1 time: 0.301496 Oct 08 21:00:08.922727 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1048/2074] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:08 2022] GET /compute/v2.1/servers/d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd => generated 1474 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:08.931578 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-ee329bbb-c2e7-4969-b145-a57a65eb0801 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:08.932424 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-ee329bbb-c2e7-4969-b145-a57a65eb0801 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] [instance: 75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:08.944903 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ee329bbb-c2e7-4969-b145-a57a65eb0801 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:08.947139 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ee329bbb-c2e7-4969-b145-a57a65eb0801 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:08.950997 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ee329bbb-c2e7-4969-b145-a57a65eb0801 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:08.954606 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ee329bbb-c2e7-4969-b145-a57a65eb0801 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:08.955304 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ee329bbb-c2e7-4969-b145-a57a65eb0801 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:08.955947 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ee329bbb-c2e7-4969-b145-a57a65eb0801 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:09.094474 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-a8e9d282-3906-4a12-9f20-b727cd602cc8 tempest-ServersOnMultiNodesTest-429096361 tempest-ServersOnMultiNodesTest-429096361-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/ace99763-e046-4fb7-b944-9fd25a2205f2" status: 200 len: 1618 microversion: 2.1 time: 0.223687 Oct 08 21:00:09.096563 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1027/2075] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:08 2022] GET /compute/v2.1/servers/ace99763-e046-4fb7-b944-9fd25a2205f2 => generated 1618 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:09.148551 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-2f4e76e6-2fc8-461d-b58e-9ce591f47e3d tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-629592828"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:00:09.159348 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-2f4e76e6-2fc8-461d-b58e-9ce591f47e3d tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] [instance: 992277b1-0684-4013-a6c8-3937a1d41da3] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:09.183484 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2f4e76e6-2fc8-461d-b58e-9ce591f47e3d tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:09.183987 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2f4e76e6-2fc8-461d-b58e-9ce591f47e3d tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:09.188356 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2f4e76e6-2fc8-461d-b58e-9ce591f47e3d tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:09.189099 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2f4e76e6-2fc8-461d-b58e-9ce591f47e3d tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:09.190937 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2f4e76e6-2fc8-461d-b58e-9ce591f47e3d tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:09.191810 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2f4e76e6-2fc8-461d-b58e-9ce591f47e3d tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:09.235055 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-2f4e76e6-2fc8-461d-b58e-9ce591f47e3d tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] HTTP exception thrown: Cannot 'createImage' instance 992277b1-0684-4013-a6c8-3937a1d41da3 while it is in task_state image_snapshot Oct 08 21:00:09.236799 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-2f4e76e6-2fc8-461d-b58e-9ce591f47e3d tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Request method failure captured: Oct 08 21:00:09.236799 ncdv-master-1 devstack@n-api.service[140491]: request: POST /compute/v2.1/servers/992277b1-0684-4013-a6c8-3937a1d41da3/action HTTP/1.1 Oct 08 21:00:09.236799 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:00:09.236799 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:00:09.236799 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:00:09.236799 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 84 Oct 08 21:00:09.236799 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:00:09.236799 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:00:09.236799 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:00:09.236799 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:00:09.236799 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeTE7bTfM4hIhoviKx9l8mw-bWfYL6jsTZW_QjKSgS6NcvR5fjqeBn6E1jAPDuPpZvhMcTeb9kBH8YZZEMCFr_F1J-nxa8vLVrJvg33lxBDKWqjORjFzU7YTBNB-gB5p5hXf0cUCzsO7xU_2VbukaClcdx1U8H5njKq8mVnqRKHv1K4 Oct 08 21:00:09.236799 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:00:09.236799 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:00:09.236799 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:00:09.236799 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:00:09.236799 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:00:09.236799 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:00:09.236799 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 76b10172715d423eb887d6c5b171defb Oct 08 21:00:09.236799 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1001637313 Oct 08 21:00:09.236799 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:00:09.236799 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:00:09.236799 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/76b10172715d423eb887d6c5b171defb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/76b10172715d423eb887d6c5b171defb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_76b10172715d423eb887d6c5b171defb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/76b10172715d423eb887d6c5b171defb"}]}] Oct 08 21:00:09.236799 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1001637313 Oct 08 21:00:09.236799 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 76b10172715d423eb887d6c5b171defb Oct 08 21:00:09.236799 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1001637313 Oct 08 21:00:09.236799 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-ImagesOneServerNegativeTestJSON-1001637313-project Oct 08 21:00:09.236799 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:00:09.236799 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:00:09.236799 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: f06caf10b6fa43a3a2ad34858594e329 Oct 08 21:00:09.236799 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1001637313-project Oct 08 21:00:09.236799 ncdv-master-1 devstack@n-api.service[140491]: Oct 08 21:00:09.236799 ncdv-master-1 devstack@n-api.service[140491]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-629592828"}} Oct 08 21:00:09.236799 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:00:09.236799 ncdv-master-1 devstack@n-api.service[140491]: exception: Cannot 'createImage' instance 992277b1-0684-4013-a6c8-3937a1d41da3 while it is in task_state image_snapshot Oct 08 21:00:09.236799 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': '992277b1-0684-4013-a6c8-3937a1d41da3', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-629592828'}}} Oct 08 21:00:09.236799 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:00:09.236799 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:00:09.236799 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1349, in _action_create_image Oct 08 21:00:09.236799 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Oct 08 21:00:09.236799 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 155, in inner Oct 08 21:00:09.236799 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 08 21:00:09.236799 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 992277b1-0684-4013-a6c8-3937a1d41da3 in task_state image_snapshot. Cannot snapshot while the instance is in this state. Oct 08 21:00:09.236799 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:00:09.236799 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:00:09.236799 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:00:09.236799 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:00:09.236799 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:00:09.236799 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:00:09.236799 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:00:09.236799 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:00:09.236799 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:00:09.236799 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:00:09.236799 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 21:00:09.236799 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 21:00:09.236799 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 21:00:09.236799 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 21:00:09.236799 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1354, in _action_create_image Oct 08 21:00:09.236799 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 08 21:00:09.236799 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 08 21:00:09.236799 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 08 21:00:09.236799 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance 992277b1-0684-4013-a6c8-3937a1d41da3 while it is in task_state image_snapshot Oct 08 21:00:09.240129 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:00:09.240129 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:00:09.240129 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:00:09.240129 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:00:09.240129 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:00:09.240129 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:00:09.240129 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:00:09.240129 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:00:09.240129 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance 992277b1-0684-4013-a6c8-3937a1d41da3 while it is in task_state image_snapshot Oct 08 21:00:09.240129 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:00:09.242016 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-2f4e76e6-2fc8-461d-b58e-9ce591f47e3d tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Returning 409 to user: Cannot 'createImage' instance 992277b1-0684-4013-a6c8-3937a1d41da3 while it is in task_state image_snapshot {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:00:09.243094 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-2f4e76e6-2fc8-461d-b58e-9ce591f47e3d tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] 10.222.0.26 "POST /compute/v2.1/servers/992277b1-0684-4013-a6c8-3937a1d41da3/action" status: 409 len: 159 microversion: 2.1 time: 0.131012 Oct 08 21:00:09.247753 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1028/2076] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:00:09 2022] POST /compute/v2.1/servers/992277b1-0684-4013-a6c8-3937a1d41da3/action => generated 159 bytes in 151 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 08 21:00:09.252957 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-84ccf45a-d4a9-4ebd-8701-0e5a4ec4d91e tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Calling method '.version_select at 0x7f1a8c0e99d0>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:09.277101 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-ee329bbb-c2e7-4969-b145-a57a65eb0801 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1698dee4a2bf4ea19a6ee0c3d5cb5c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b00ee5e7828469f95bd90548d35982a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:09.291302 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-ee329bbb-c2e7-4969-b145-a57a65eb0801 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] 10.222.0.26 "GET /compute/v2.1/servers/75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a" status: 200 len: 1521 microversion: 2.1 time: 0.365786 Oct 08 21:00:09.292551 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1049/2077] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:08 2022] GET /compute/v2.1/servers/75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a => generated 1521 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:09.340303 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-dd064d8d-7442-43d1-a567-ca2583e7ff12 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-298037251", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "8ceaf7df-4795-4969-be16-a2a1b94a3fa6"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:00:09.414789 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.network.neutron [None req-dd064d8d-7442-43d1-a567-ca2583e7ff12 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] validate_networks() for None {{(pid=140492) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 21:00:09.418332 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-84ccf45a-d4a9-4ebd-8701-0e5a4ec4d91e tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] 10.222.0.26 "DELETE /compute/v2.1/images/fab51338-5bd8-407d-86c5-ba644b071019" status: 204 len: 0 microversion: 2.1 time: 0.169169 Oct 08 21:00:09.418976 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1029/2078] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:09 2022] DELETE /compute/v2.1/images/fab51338-5bd8-407d-86c5-ba644b071019 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 21:00:09.427927 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-15191e24-cddb-49aa-bdad-b794542c2f52 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:09.428598 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-15191e24-cddb-49aa-bdad-b794542c2f52 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] [instance: 992277b1-0684-4013-a6c8-3937a1d41da3] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:09.435740 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-15191e24-cddb-49aa-bdad-b794542c2f52 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:09.436246 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-15191e24-cddb-49aa-bdad-b794542c2f52 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:09.436698 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-15191e24-cddb-49aa-bdad-b794542c2f52 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:09.437456 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-15191e24-cddb-49aa-bdad-b794542c2f52 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:09.438096 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-15191e24-cddb-49aa-bdad-b794542c2f52 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:09.438565 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-15191e24-cddb-49aa-bdad-b794542c2f52 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:09.613106 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-15191e24-cddb-49aa-bdad-b794542c2f52 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06caf10b6fa43a3a2ad34858594e329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b10172715d423eb887d6c5b171defb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:09.623306 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-15191e24-cddb-49aa-bdad-b794542c2f52 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] 10.222.0.26 "GET /compute/v2.1/servers/992277b1-0684-4013-a6c8-3937a1d41da3" status: 200 len: 1532 microversion: 2.1 time: 0.199267 Oct 08 21:00:09.624188 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1030/2079] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:09 2022] GET /compute/v2.1/servers/992277b1-0684-4013-a6c8-3937a1d41da3 => generated 1532 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:00:09.710079 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-dd064d8d-7442-43d1-a567-ca2583e7ff12 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Flavor limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 21:00:09.710590 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-dd064d8d-7442-43d1-a567-ca2583e7ff12 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Image limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 21:00:09.711201 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-dd064d8d-7442-43d1-a567-ca2583e7ff12 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Flavor pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 21:00:09.711810 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-dd064d8d-7442-43d1-a567-ca2583e7ff12 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Image pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 21:00:09.712513 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-dd064d8d-7442-43d1-a567-ca2583e7ff12 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 21:00:09.722853 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dd064d8d-7442-43d1-a567-ca2583e7ff12 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:09.723363 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dd064d8d-7442-43d1-a567-ca2583e7ff12 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:09.723885 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dd064d8d-7442-43d1-a567-ca2583e7ff12 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:09.724772 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dd064d8d-7442-43d1-a567-ca2583e7ff12 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:09.725343 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dd064d8d-7442-43d1-a567-ca2583e7ff12 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:09.726013 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dd064d8d-7442-43d1-a567-ca2583e7ff12 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:09.734788 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=100 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:00:09.748258 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-dd064d8d-7442-43d1-a567-ca2583e7ff12 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Getting quotas for project 8472b054404c46a99b81aba34d6b9f40. Resources: {'cores', 'instances', 'ram'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:00:09.753761 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-dd064d8d-7442-43d1-a567-ca2583e7ff12 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Getting quotas for user 67ddc3cd3c374bacbe5bf5e0877380e2 and project 8472b054404c46a99b81aba34d6b9f40. Resources: {'cores', 'instances', 'ram'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:00:09.768162 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-dd064d8d-7442-43d1-a567-ca2583e7ff12 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Going to run 1 instances... {{(pid=140492) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 21:00:09.770834 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-dd064d8d-7442-43d1-a567-ca2583e7ff12 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] [instance: 655205e7-8a06-4704-896a-75b68056749e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c508bd7f-7db9-4b2c-af7c-be54a855c355',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140492) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 21:00:09.819266 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-dd064d8d-7442-43d1-a567-ca2583e7ff12 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.486640 Oct 08 21:00:09.820673 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1050/2080] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 21:00:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 489 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 08 21:00:09.835265 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c1ec4a38-87e4-4716-bf9b-69241bf62e3e tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:09.836349 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-c1ec4a38-87e4-4716-bf9b-69241bf62e3e tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] [instance: 655205e7-8a06-4704-896a-75b68056749e] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:09.909389 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-c1ec4a38-87e4-4716-bf9b-69241bf62e3e tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ddc3cd3c374bacbe5bf5e0877380e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8472b054404c46a99b81aba34d6b9f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:09.916953 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-c1ec4a38-87e4-4716-bf9b-69241bf62e3e tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] 10.222.0.26 "GET /compute/v2.1/servers/655205e7-8a06-4704-896a-75b68056749e" status: 200 len: 1216 microversion: 2.1 time: 0.088200 Oct 08 21:00:09.919441 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1031/2081] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:09 2022] GET /compute/v2.1/servers/655205e7-8a06-4704-896a-75b68056749e => generated 1216 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:09.952544 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-4725e796-5052-4dd0-9d2f-64299d8b5ff5 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:09.953733 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-4725e796-5052-4dd0-9d2f-64299d8b5ff5 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:09.962651 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4725e796-5052-4dd0-9d2f-64299d8b5ff5 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:09.963465 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4725e796-5052-4dd0-9d2f-64299d8b5ff5 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:09.964141 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4725e796-5052-4dd0-9d2f-64299d8b5ff5 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:09.966173 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4725e796-5052-4dd0-9d2f-64299d8b5ff5 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:09.967698 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4725e796-5052-4dd0-9d2f-64299d8b5ff5 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:09.968860 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4725e796-5052-4dd0-9d2f-64299d8b5ff5 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:10.251969 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-4725e796-5052-4dd0-9d2f-64299d8b5ff5 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:10.260720 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-4725e796-5052-4dd0-9d2f-64299d8b5ff5 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd" status: 200 len: 1474 microversion: 2.1 time: 0.313917 Oct 08 21:00:10.261914 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1051/2082] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:09 2022] GET /compute/v2.1/servers/d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd => generated 1474 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:10.319035 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-096b2ab5-60e5-42fe-bd55-d5dc69fa4ced tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:10.319671 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-096b2ab5-60e5-42fe-bd55-d5dc69fa4ced tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] [instance: 75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:10.330727 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-096b2ab5-60e5-42fe-bd55-d5dc69fa4ced tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:10.331500 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-096b2ab5-60e5-42fe-bd55-d5dc69fa4ced tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:10.332167 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-096b2ab5-60e5-42fe-bd55-d5dc69fa4ced tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:10.333216 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-096b2ab5-60e5-42fe-bd55-d5dc69fa4ced tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:10.333926 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-096b2ab5-60e5-42fe-bd55-d5dc69fa4ced tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:10.334415 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-096b2ab5-60e5-42fe-bd55-d5dc69fa4ced tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:10.519090 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-096b2ab5-60e5-42fe-bd55-d5dc69fa4ced tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1698dee4a2bf4ea19a6ee0c3d5cb5c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b00ee5e7828469f95bd90548d35982a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:10.537833 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-096b2ab5-60e5-42fe-bd55-d5dc69fa4ced tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] 10.222.0.26 "GET /compute/v2.1/servers/75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a" status: 200 len: 1521 microversion: 2.1 time: 0.222960 Oct 08 21:00:10.539965 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1032/2083] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:10 2022] GET /compute/v2.1/servers/75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a => generated 1521 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:10.648806 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-f1655e70-b05a-4497-b481-779b6313c657 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:10.650082 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-f1655e70-b05a-4497-b481-779b6313c657 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] [instance: 992277b1-0684-4013-a6c8-3937a1d41da3] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:10.659797 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f1655e70-b05a-4497-b481-779b6313c657 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:10.661906 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f1655e70-b05a-4497-b481-779b6313c657 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:10.662515 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f1655e70-b05a-4497-b481-779b6313c657 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:10.663474 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f1655e70-b05a-4497-b481-779b6313c657 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:10.664138 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f1655e70-b05a-4497-b481-779b6313c657 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:10.664746 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f1655e70-b05a-4497-b481-779b6313c657 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:10.941770 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-506f9dbe-2fa3-409b-8ff0-1fff2dc34f56 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:10.942554 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-506f9dbe-2fa3-409b-8ff0-1fff2dc34f56 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] [instance: 655205e7-8a06-4704-896a-75b68056749e] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:10.950812 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-506f9dbe-2fa3-409b-8ff0-1fff2dc34f56 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:10.951330 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-506f9dbe-2fa3-409b-8ff0-1fff2dc34f56 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:10.952081 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-506f9dbe-2fa3-409b-8ff0-1fff2dc34f56 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:10.953047 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-506f9dbe-2fa3-409b-8ff0-1fff2dc34f56 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:10.953584 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-506f9dbe-2fa3-409b-8ff0-1fff2dc34f56 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:10.954027 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-506f9dbe-2fa3-409b-8ff0-1fff2dc34f56 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:10.974293 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-f1655e70-b05a-4497-b481-779b6313c657 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06caf10b6fa43a3a2ad34858594e329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b10172715d423eb887d6c5b171defb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:10.989678 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-f1655e70-b05a-4497-b481-779b6313c657 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] 10.222.0.26 "GET /compute/v2.1/servers/992277b1-0684-4013-a6c8-3937a1d41da3" status: 200 len: 1538 microversion: 2.1 time: 0.346147 Oct 08 21:00:10.990515 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1052/2084] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:10 2022] GET /compute/v2.1/servers/992277b1-0684-4013-a6c8-3937a1d41da3 => generated 1538 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:11.020079 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-506f9dbe-2fa3-409b-8ff0-1fff2dc34f56 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ddc3cd3c374bacbe5bf5e0877380e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8472b054404c46a99b81aba34d6b9f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:11.029809 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-506f9dbe-2fa3-409b-8ff0-1fff2dc34f56 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] 10.222.0.26 "GET /compute/v2.1/servers/655205e7-8a06-4704-896a-75b68056749e" status: 200 len: 1268 microversion: 2.1 time: 0.092195 Oct 08 21:00:11.030403 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1033/2085] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:10 2022] GET /compute/v2.1/servers/655205e7-8a06-4704-896a-75b68056749e => generated 1268 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:00:11.288071 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-585674ea-7b4a-46cf-9bb3-d56b4c59ae77 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:11.289412 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-585674ea-7b4a-46cf-9bb3-d56b4c59ae77 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:11.297682 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-585674ea-7b4a-46cf-9bb3-d56b4c59ae77 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:11.298474 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-585674ea-7b4a-46cf-9bb3-d56b4c59ae77 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:11.298997 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-585674ea-7b4a-46cf-9bb3-d56b4c59ae77 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:11.299976 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-585674ea-7b4a-46cf-9bb3-d56b4c59ae77 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:11.300577 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-585674ea-7b4a-46cf-9bb3-d56b4c59ae77 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:11.301534 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-585674ea-7b4a-46cf-9bb3-d56b4c59ae77 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:11.565923 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-4c244321-d809-400c-84ea-b3e7505771d3 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:11.567109 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-4c244321-d809-400c-84ea-b3e7505771d3 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] [instance: 75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:11.577870 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4c244321-d809-400c-84ea-b3e7505771d3 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:11.578746 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4c244321-d809-400c-84ea-b3e7505771d3 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:11.579409 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4c244321-d809-400c-84ea-b3e7505771d3 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:11.580394 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4c244321-d809-400c-84ea-b3e7505771d3 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:11.581070 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4c244321-d809-400c-84ea-b3e7505771d3 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:11.581676 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4c244321-d809-400c-84ea-b3e7505771d3 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:11.714094 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-585674ea-7b4a-46cf-9bb3-d56b4c59ae77 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:11.726750 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-585674ea-7b4a-46cf-9bb3-d56b4c59ae77 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd" status: 200 len: 1474 microversion: 2.1 time: 0.443831 Oct 08 21:00:11.727354 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1053/2086] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:11 2022] GET /compute/v2.1/servers/d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd => generated 1474 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:11.809636 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-4c244321-d809-400c-84ea-b3e7505771d3 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1698dee4a2bf4ea19a6ee0c3d5cb5c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b00ee5e7828469f95bd90548d35982a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:11.829885 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-4c244321-d809-400c-84ea-b3e7505771d3 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] 10.222.0.26 "GET /compute/v2.1/servers/75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a" status: 200 len: 1521 microversion: 2.1 time: 0.269204 Oct 08 21:00:11.830742 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1034/2087] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:11 2022] GET /compute/v2.1/servers/75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a => generated 1521 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:12.018150 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e03c5b23-ecea-4cac-92b5-7e256ec5f9f9 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:12.019666 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-e03c5b23-ecea-4cac-92b5-7e256ec5f9f9 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] [instance: 992277b1-0684-4013-a6c8-3937a1d41da3] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:12.029098 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e03c5b23-ecea-4cac-92b5-7e256ec5f9f9 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:12.029898 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e03c5b23-ecea-4cac-92b5-7e256ec5f9f9 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:12.030446 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e03c5b23-ecea-4cac-92b5-7e256ec5f9f9 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:12.031297 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e03c5b23-ecea-4cac-92b5-7e256ec5f9f9 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:12.033020 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e03c5b23-ecea-4cac-92b5-7e256ec5f9f9 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:12.033614 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e03c5b23-ecea-4cac-92b5-7e256ec5f9f9 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:12.064684 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-fb93393e-54ce-4af0-9430-61df2adb2d07 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:12.065751 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-fb93393e-54ce-4af0-9430-61df2adb2d07 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] [instance: 655205e7-8a06-4704-896a-75b68056749e] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:12.078015 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fb93393e-54ce-4af0-9430-61df2adb2d07 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:12.079492 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fb93393e-54ce-4af0-9430-61df2adb2d07 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:12.082271 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fb93393e-54ce-4af0-9430-61df2adb2d07 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:12.084664 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fb93393e-54ce-4af0-9430-61df2adb2d07 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:12.088075 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fb93393e-54ce-4af0-9430-61df2adb2d07 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:12.089305 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fb93393e-54ce-4af0-9430-61df2adb2d07 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:12.188570 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-fb93393e-54ce-4af0-9430-61df2adb2d07 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ddc3cd3c374bacbe5bf5e0877380e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8472b054404c46a99b81aba34d6b9f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:12.198546 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-fb93393e-54ce-4af0-9430-61df2adb2d07 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] 10.222.0.26 "GET /compute/v2.1/servers/655205e7-8a06-4704-896a-75b68056749e" status: 200 len: 1274 microversion: 2.1 time: 0.146596 Oct 08 21:00:12.199807 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1035/2088] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:12 2022] GET /compute/v2.1/servers/655205e7-8a06-4704-896a-75b68056749e => generated 1274 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:12.483470 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-e03c5b23-ecea-4cac-92b5-7e256ec5f9f9 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06caf10b6fa43a3a2ad34858594e329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b10172715d423eb887d6c5b171defb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:12.510420 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-e03c5b23-ecea-4cac-92b5-7e256ec5f9f9 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] 10.222.0.26 "GET /compute/v2.1/servers/992277b1-0684-4013-a6c8-3937a1d41da3" status: 200 len: 1538 microversion: 2.1 time: 0.498293 Oct 08 21:00:12.511031 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1054/2089] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:12 2022] GET /compute/v2.1/servers/992277b1-0684-4013-a6c8-3937a1d41da3 => generated 1538 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:12.754993 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-b264c350-9a55-49bd-8d0a-48e8cc61ea89 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:12.756353 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-b264c350-9a55-49bd-8d0a-48e8cc61ea89 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:12.767081 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b264c350-9a55-49bd-8d0a-48e8cc61ea89 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:12.767533 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b264c350-9a55-49bd-8d0a-48e8cc61ea89 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:12.768146 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b264c350-9a55-49bd-8d0a-48e8cc61ea89 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:12.769483 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b264c350-9a55-49bd-8d0a-48e8cc61ea89 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:12.770136 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b264c350-9a55-49bd-8d0a-48e8cc61ea89 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:12.770706 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b264c350-9a55-49bd-8d0a-48e8cc61ea89 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:12.789500 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:00:12.853985 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-0cfd2a86-fdf1-4c67-a827-d59cd5727f5c tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:12.855586 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-0cfd2a86-fdf1-4c67-a827-d59cd5727f5c tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] [instance: 75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:12.863445 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0cfd2a86-fdf1-4c67-a827-d59cd5727f5c tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:12.864276 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0cfd2a86-fdf1-4c67-a827-d59cd5727f5c tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:12.864976 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0cfd2a86-fdf1-4c67-a827-d59cd5727f5c tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:12.865960 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0cfd2a86-fdf1-4c67-a827-d59cd5727f5c tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:12.866635 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0cfd2a86-fdf1-4c67-a827-d59cd5727f5c tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:12.867321 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0cfd2a86-fdf1-4c67-a827-d59cd5727f5c tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:12.973304 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-b264c350-9a55-49bd-8d0a-48e8cc61ea89 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:12.983939 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-b264c350-9a55-49bd-8d0a-48e8cc61ea89 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd" status: 200 len: 1474 microversion: 2.1 time: 0.234385 Oct 08 21:00:12.984649 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1036/2090] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:12 2022] GET /compute/v2.1/servers/d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd => generated 1474 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:13.224052 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-179fc73d-8d64-4e8f-935e-d7b7fc5316af tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:13.224688 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-179fc73d-8d64-4e8f-935e-d7b7fc5316af tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] [instance: 655205e7-8a06-4704-896a-75b68056749e] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:13.234132 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-179fc73d-8d64-4e8f-935e-d7b7fc5316af tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:13.235126 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-179fc73d-8d64-4e8f-935e-d7b7fc5316af tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:13.235579 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-179fc73d-8d64-4e8f-935e-d7b7fc5316af tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:13.236373 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-179fc73d-8d64-4e8f-935e-d7b7fc5316af tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:13.236885 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-179fc73d-8d64-4e8f-935e-d7b7fc5316af tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:13.237627 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-179fc73d-8d64-4e8f-935e-d7b7fc5316af tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:13.431054 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-179fc73d-8d64-4e8f-935e-d7b7fc5316af tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ddc3cd3c374bacbe5bf5e0877380e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8472b054404c46a99b81aba34d6b9f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:13.442353 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-179fc73d-8d64-4e8f-935e-d7b7fc5316af tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] 10.222.0.26 "GET /compute/v2.1/servers/655205e7-8a06-4704-896a-75b68056749e" status: 200 len: 1316 microversion: 2.1 time: 0.222887 Oct 08 21:00:13.443127 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1037/2091] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:13 2022] GET /compute/v2.1/servers/655205e7-8a06-4704-896a-75b68056749e => generated 1316 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:13.543065 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-66f94d0f-ff52-4e82-bcff-99e9fad41686 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:13.543994 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-66f94d0f-ff52-4e82-bcff-99e9fad41686 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] [instance: 992277b1-0684-4013-a6c8-3937a1d41da3] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:13.553829 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-66f94d0f-ff52-4e82-bcff-99e9fad41686 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:13.554696 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-66f94d0f-ff52-4e82-bcff-99e9fad41686 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:13.555529 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-66f94d0f-ff52-4e82-bcff-99e9fad41686 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:13.556485 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-66f94d0f-ff52-4e82-bcff-99e9fad41686 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:13.561488 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-0cfd2a86-fdf1-4c67-a827-d59cd5727f5c tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1698dee4a2bf4ea19a6ee0c3d5cb5c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b00ee5e7828469f95bd90548d35982a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:13.573399 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-0cfd2a86-fdf1-4c67-a827-d59cd5727f5c tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] 10.222.0.26 "GET /compute/v2.1/servers/75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a" status: 200 len: 1521 microversion: 2.1 time: 0.722848 Oct 08 21:00:13.574718 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1055/2092] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:12 2022] GET /compute/v2.1/servers/75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a => generated 1521 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:00:13.577772 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-66f94d0f-ff52-4e82-bcff-99e9fad41686 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:13.578441 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-66f94d0f-ff52-4e82-bcff-99e9fad41686 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:13.766075 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-66f94d0f-ff52-4e82-bcff-99e9fad41686 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06caf10b6fa43a3a2ad34858594e329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b10172715d423eb887d6c5b171defb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:13.782190 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-66f94d0f-ff52-4e82-bcff-99e9fad41686 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] 10.222.0.26 "GET /compute/v2.1/servers/992277b1-0684-4013-a6c8-3937a1d41da3" status: 200 len: 1520 microversion: 2.1 time: 0.245403 Oct 08 21:00:13.789686 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1038/2093] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:13 2022] GET /compute/v2.1/servers/992277b1-0684-4013-a6c8-3937a1d41da3 => generated 1520 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:13.813781 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-1571655e-0b19-4fc3-b0d1-024a5f453fbd tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:13.814303 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-1571655e-0b19-4fc3-b0d1-024a5f453fbd tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] [instance: 992277b1-0684-4013-a6c8-3937a1d41da3] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:13.825140 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1571655e-0b19-4fc3-b0d1-024a5f453fbd tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:13.826427 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1571655e-0b19-4fc3-b0d1-024a5f453fbd tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:13.827142 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1571655e-0b19-4fc3-b0d1-024a5f453fbd tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:13.827735 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1571655e-0b19-4fc3-b0d1-024a5f453fbd tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:13.828404 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1571655e-0b19-4fc3-b0d1-024a5f453fbd tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:13.829247 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1571655e-0b19-4fc3-b0d1-024a5f453fbd tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:13.864095 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-1571655e-0b19-4fc3-b0d1-024a5f453fbd tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] [instance: 992277b1-0684-4013-a6c8-3937a1d41da3] Going to try to terminate instance {{(pid=140492) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 21:00:13.974842 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-1571655e-0b19-4fc3-b0d1-024a5f453fbd tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] 10.222.0.26 "DELETE /compute/v2.1/servers/992277b1-0684-4013-a6c8-3937a1d41da3" status: 204 len: 0 microversion: 2.1 time: 0.163413 Oct 08 21:00:13.975928 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1056/2094] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:00:13 2022] DELETE /compute/v2.1/servers/992277b1-0684-4013-a6c8-3937a1d41da3 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 21:00:13.986872 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-853cbe7a-a1b9-49be-9a12-a0b3930f18b4 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:13.987595 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-853cbe7a-a1b9-49be-9a12-a0b3930f18b4 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] [instance: 992277b1-0684-4013-a6c8-3937a1d41da3] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:13.997615 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-853cbe7a-a1b9-49be-9a12-a0b3930f18b4 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:13.998683 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-853cbe7a-a1b9-49be-9a12-a0b3930f18b4 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:14.000060 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-853cbe7a-a1b9-49be-9a12-a0b3930f18b4 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:14.000921 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-853cbe7a-a1b9-49be-9a12-a0b3930f18b4 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:14.001658 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-853cbe7a-a1b9-49be-9a12-a0b3930f18b4 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:14.002495 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-853cbe7a-a1b9-49be-9a12-a0b3930f18b4 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:14.012419 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-dbbacc05-e6f4-4d5f-8d72-a6283a33a4e3 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:14.013275 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-dbbacc05-e6f4-4d5f-8d72-a6283a33a4e3 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:14.024062 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dbbacc05-e6f4-4d5f-8d72-a6283a33a4e3 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:14.024571 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dbbacc05-e6f4-4d5f-8d72-a6283a33a4e3 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:14.025061 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dbbacc05-e6f4-4d5f-8d72-a6283a33a4e3 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:14.026139 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dbbacc05-e6f4-4d5f-8d72-a6283a33a4e3 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:14.026759 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dbbacc05-e6f4-4d5f-8d72-a6283a33a4e3 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:14.027853 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dbbacc05-e6f4-4d5f-8d72-a6283a33a4e3 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:14.203562 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-853cbe7a-a1b9-49be-9a12-a0b3930f18b4 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06caf10b6fa43a3a2ad34858594e329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b10172715d423eb887d6c5b171defb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:14.212984 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-853cbe7a-a1b9-49be-9a12-a0b3930f18b4 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] 10.222.0.26 "GET /compute/v2.1/servers/992277b1-0684-4013-a6c8-3937a1d41da3" status: 200 len: 1526 microversion: 2.1 time: 0.231304 Oct 08 21:00:14.214788 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1039/2095] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:13 2022] GET /compute/v2.1/servers/992277b1-0684-4013-a6c8-3937a1d41da3 => generated 1526 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:14.371256 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-dbbacc05-e6f4-4d5f-8d72-a6283a33a4e3 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:14.384119 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-dbbacc05-e6f4-4d5f-8d72-a6283a33a4e3 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd" status: 200 len: 1474 microversion: 2.1 time: 0.378706 Oct 08 21:00:14.398246 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1057/2096] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:14 2022] GET /compute/v2.1/servers/d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd => generated 1474 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:14.469518 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-977f5401-b9ae-4f07-ae31-2dd6e495b914 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:14.470150 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-977f5401-b9ae-4f07-ae31-2dd6e495b914 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] [instance: 655205e7-8a06-4704-896a-75b68056749e] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:14.479130 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-977f5401-b9ae-4f07-ae31-2dd6e495b914 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:14.480479 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-977f5401-b9ae-4f07-ae31-2dd6e495b914 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:14.481258 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-977f5401-b9ae-4f07-ae31-2dd6e495b914 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:14.484222 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-977f5401-b9ae-4f07-ae31-2dd6e495b914 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:14.488250 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-977f5401-b9ae-4f07-ae31-2dd6e495b914 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:14.489156 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-977f5401-b9ae-4f07-ae31-2dd6e495b914 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:14.609572 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e519d284-6444-4e2e-8656-74f87408944c tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:14.610489 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-e519d284-6444-4e2e-8656-74f87408944c tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] [instance: 75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:14.624261 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e519d284-6444-4e2e-8656-74f87408944c tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:14.625094 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e519d284-6444-4e2e-8656-74f87408944c tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:14.626083 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e519d284-6444-4e2e-8656-74f87408944c tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:14.627175 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e519d284-6444-4e2e-8656-74f87408944c tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:14.628384 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e519d284-6444-4e2e-8656-74f87408944c tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:14.629552 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e519d284-6444-4e2e-8656-74f87408944c tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:14.741714 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-977f5401-b9ae-4f07-ae31-2dd6e495b914 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ddc3cd3c374bacbe5bf5e0877380e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8472b054404c46a99b81aba34d6b9f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:14.754422 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-977f5401-b9ae-4f07-ae31-2dd6e495b914 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] 10.222.0.26 "GET /compute/v2.1/servers/655205e7-8a06-4704-896a-75b68056749e" status: 200 len: 1316 microversion: 2.1 time: 0.290754 Oct 08 21:00:14.755301 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1040/2097] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:14 2022] GET /compute/v2.1/servers/655205e7-8a06-4704-896a-75b68056749e => generated 1316 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:14.999170 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-e519d284-6444-4e2e-8656-74f87408944c tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1698dee4a2bf4ea19a6ee0c3d5cb5c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b00ee5e7828469f95bd90548d35982a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:15.008228 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-e519d284-6444-4e2e-8656-74f87408944c tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] 10.222.0.26 "GET /compute/v2.1/servers/75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a" status: 200 len: 1521 microversion: 2.1 time: 0.412856 Oct 08 21:00:15.022956 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1058/2098] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:14 2022] GET /compute/v2.1/servers/75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a => generated 1521 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:15.039182 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-9ed05745-d689-4521-ac09-3918f9afa271 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:15.045537 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-9ed05745-d689-4521-ac09-3918f9afa271 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3d96135705514061bef9306753143357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82999f8bc36455bafd8eed23c68e733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:15.047924 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-9ed05745-d689-4521-ac09-3918f9afa271 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Searching by: {'deleted': False, 'project_id': 'a82999f8bc36455bafd8eed23c68e733'} {{(pid=140491) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 08 21:00:15.053946 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9ed05745-d689-4521-ac09-3918f9afa271 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:15.054659 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9ed05745-d689-4521-ac09-3918f9afa271 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:15.055135 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9ed05745-d689-4521-ac09-3918f9afa271 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:15.056302 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9ed05745-d689-4521-ac09-3918f9afa271 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:15.056784 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9ed05745-d689-4521-ac09-3918f9afa271 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:15.057295 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9ed05745-d689-4521-ac09-3918f9afa271 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:15.092036 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.multi_cell_list [None req-9ed05745-d689-4521-ac09-3918f9afa271 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=140491) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 08 21:00:15.130036 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-9ed05745-d689-4521-ac09-3918f9afa271 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] 10.222.0.26 "GET /compute/v2.1/servers" status: 200 len: 344 microversion: 2.1 time: 0.095723 Oct 08 21:00:15.131326 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1041/2099] 10.222.0.26 () {58 vars in 1125 bytes} [Sat Oct 8 21:00:15 2022] GET /compute/v2.1/servers => generated 344 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:00:15.145842 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-b6cad186-0a0b-4725-bd95-0996d2331944 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:15.151395 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-b6cad186-0a0b-4725-bd95-0996d2331944 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3d96135705514061bef9306753143357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82999f8bc36455bafd8eed23c68e733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:15.152312 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-b6cad186-0a0b-4725-bd95-0996d2331944 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Searching by: {'deleted': False, 'project_id': 'a82999f8bc36455bafd8eed23c68e733'} {{(pid=140492) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 08 21:00:15.162268 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b6cad186-0a0b-4725-bd95-0996d2331944 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:15.162930 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b6cad186-0a0b-4725-bd95-0996d2331944 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:15.164194 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b6cad186-0a0b-4725-bd95-0996d2331944 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:15.165157 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b6cad186-0a0b-4725-bd95-0996d2331944 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:15.166289 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b6cad186-0a0b-4725-bd95-0996d2331944 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:15.166889 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b6cad186-0a0b-4725-bd95-0996d2331944 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:15.204291 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.multi_cell_list [None req-b6cad186-0a0b-4725-bd95-0996d2331944 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=140492) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 08 21:00:15.241746 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-dee5235d-3c04-4afd-aabe-d55ef3ee9885 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:15.242420 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-dee5235d-3c04-4afd-aabe-d55ef3ee9885 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] [instance: 992277b1-0684-4013-a6c8-3937a1d41da3] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:15.252896 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dee5235d-3c04-4afd-aabe-d55ef3ee9885 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:15.253749 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dee5235d-3c04-4afd-aabe-d55ef3ee9885 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:15.255071 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dee5235d-3c04-4afd-aabe-d55ef3ee9885 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:15.260969 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dee5235d-3c04-4afd-aabe-d55ef3ee9885 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:15.261611 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dee5235d-3c04-4afd-aabe-d55ef3ee9885 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:15.262202 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dee5235d-3c04-4afd-aabe-d55ef3ee9885 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:15.262394 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-b6cad186-0a0b-4725-bd95-0996d2331944 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d96135705514061bef9306753143357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82999f8bc36455bafd8eed23c68e733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:15.272943 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b6cad186-0a0b-4725-bd95-0996d2331944 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:15.273792 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b6cad186-0a0b-4725-bd95-0996d2331944 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:15.274705 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b6cad186-0a0b-4725-bd95-0996d2331944 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:15.483686 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-dee5235d-3c04-4afd-aabe-d55ef3ee9885 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06caf10b6fa43a3a2ad34858594e329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b10172715d423eb887d6c5b171defb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:15.494483 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-dee5235d-3c04-4afd-aabe-d55ef3ee9885 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] 10.222.0.26 "GET /compute/v2.1/servers/992277b1-0684-4013-a6c8-3937a1d41da3" status: 200 len: 1526 microversion: 2.1 time: 0.257664 Oct 08 21:00:15.495693 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1042/2100] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:15 2022] GET /compute/v2.1/servers/992277b1-0684-4013-a6c8-3937a1d41da3 => generated 1526 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:15.500548 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-81a77496-55d9-43d0-b4bb-66d65c6c8d4b req-e1be7e91-055b-4590-a7dc-20e949459ddf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "655205e7-8a06-4704-896a-75b68056749e", "tag": "c815fb44-5023-410d-ae98-5c8ae72635bc"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:00:15.509267 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:SELECT=100 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:00:15.511573 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-81a77496-55d9-43d0-b4bb-66d65c6c8d4b req-e1be7e91-055b-4590-a7dc-20e949459ddf service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:15.512227 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-81a77496-55d9-43d0-b4bb-66d65c6c8d4b req-e1be7e91-055b-4590-a7dc-20e949459ddf service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:15.512896 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-81a77496-55d9-43d0-b4bb-66d65c6c8d4b req-e1be7e91-055b-4590-a7dc-20e949459ddf service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:15.525551 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-81a77496-55d9-43d0-b4bb-66d65c6c8d4b req-e1be7e91-055b-4590-a7dc-20e949459ddf service nova] Creating event network-changed:c815fb44-5023-410d-ae98-5c8ae72635bc for instance 655205e7-8a06-4704-896a-75b68056749e on nch1-master-1 Oct 08 21:00:15.531324 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-81a77496-55d9-43d0-b4bb-66d65c6c8d4b req-e1be7e91-055b-4590-a7dc-20e949459ddf service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034242 Oct 08 21:00:15.532010 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1043/2101] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:00:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:00:15.537346 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-6df6d111-8788-420a-89d2-4e2eb1e1c472 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:15.538125 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-6df6d111-8788-420a-89d2-4e2eb1e1c472 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:15.545495 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6df6d111-8788-420a-89d2-4e2eb1e1c472 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:15.546121 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6df6d111-8788-420a-89d2-4e2eb1e1c472 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:15.546786 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6df6d111-8788-420a-89d2-4e2eb1e1c472 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:15.547591 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6df6d111-8788-420a-89d2-4e2eb1e1c472 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:15.548261 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6df6d111-8788-420a-89d2-4e2eb1e1c472 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:15.548765 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6df6d111-8788-420a-89d2-4e2eb1e1c472 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:15.573643 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-b6cad186-0a0b-4725-bd95-0996d2331944 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] 10.222.0.26 "GET /compute/v2.1/servers/detail" status: 200 len: 1607 microversion: 2.1 time: 0.431984 Oct 08 21:00:15.587796 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1059/2102] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Oct 8 21:00:15 2022] GET /compute/v2.1/servers/detail => generated 1607 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:00:15.600137 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-bab4b76a-9707-47a9-a80f-942df6267bf6 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:15.626187 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-bab4b76a-9707-47a9-a80f-942df6267bf6 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] 10.222.0.26 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.030688 Oct 08 21:00:15.636485 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1060/2103] 10.222.0.26 () {58 vars in 1137 bytes} [Sat Oct 8 21:00:15 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:00:15.753409 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-6df6d111-8788-420a-89d2-4e2eb1e1c472 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:15.762273 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-6df6d111-8788-420a-89d2-4e2eb1e1c472 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd" status: 200 len: 1474 microversion: 2.1 time: 0.228638 Oct 08 21:00:15.763312 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1044/2104] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:15 2022] GET /compute/v2.1/servers/d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd => generated 1474 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:15.788321 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-f4365e6d-b45a-457d-b060-b42644e82e8f tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:15.788997 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-f4365e6d-b45a-457d-b060-b42644e82e8f tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] [instance: 655205e7-8a06-4704-896a-75b68056749e] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:15.795365 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f4365e6d-b45a-457d-b060-b42644e82e8f tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:15.795902 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f4365e6d-b45a-457d-b060-b42644e82e8f tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:15.796590 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f4365e6d-b45a-457d-b060-b42644e82e8f tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:15.797396 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f4365e6d-b45a-457d-b060-b42644e82e8f tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:15.798048 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f4365e6d-b45a-457d-b060-b42644e82e8f tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:15.798672 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f4365e6d-b45a-457d-b060-b42644e82e8f tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:16.032031 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-39ee7091-2888-4235-a504-b0d113fa710b tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:16.032677 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-39ee7091-2888-4235-a504-b0d113fa710b tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] [instance: 75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:16.040743 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-39ee7091-2888-4235-a504-b0d113fa710b tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:16.045219 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-39ee7091-2888-4235-a504-b0d113fa710b tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:16.045825 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-39ee7091-2888-4235-a504-b0d113fa710b tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:16.046603 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-39ee7091-2888-4235-a504-b0d113fa710b tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:16.047087 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-39ee7091-2888-4235-a504-b0d113fa710b tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:16.047531 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-39ee7091-2888-4235-a504-b0d113fa710b tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:16.307015 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-f4365e6d-b45a-457d-b060-b42644e82e8f tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ddc3cd3c374bacbe5bf5e0877380e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8472b054404c46a99b81aba34d6b9f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:16.323892 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-f4365e6d-b45a-457d-b060-b42644e82e8f tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] 10.222.0.26 "GET /compute/v2.1/servers/655205e7-8a06-4704-896a-75b68056749e" status: 200 len: 1316 microversion: 2.1 time: 0.549202 Oct 08 21:00:16.337793 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1061/2105] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:15 2022] GET /compute/v2.1/servers/655205e7-8a06-4704-896a-75b68056749e => generated 1316 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:00:16.346320 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-2dd1a620-5c0e-4d97-bc31-f43a3de4de9e tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:16.347137 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-2dd1a620-5c0e-4d97-bc31-f43a3de4de9e tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] [instance: c9f0e1d2-6f87-485d-bff6-0ea83899b705] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:16.360602 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2dd1a620-5c0e-4d97-bc31-f43a3de4de9e tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:16.361413 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2dd1a620-5c0e-4d97-bc31-f43a3de4de9e tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:16.362031 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2dd1a620-5c0e-4d97-bc31-f43a3de4de9e tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:16.364792 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2dd1a620-5c0e-4d97-bc31-f43a3de4de9e tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:16.365624 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2dd1a620-5c0e-4d97-bc31-f43a3de4de9e tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:16.366268 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2dd1a620-5c0e-4d97-bc31-f43a3de4de9e tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:16.439330 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-2dd1a620-5c0e-4d97-bc31-f43a3de4de9e tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] [instance: c9f0e1d2-6f87-485d-bff6-0ea83899b705] Going to try to terminate instance {{(pid=140492) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 21:00:16.564446 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-39ee7091-2888-4235-a504-b0d113fa710b tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1698dee4a2bf4ea19a6ee0c3d5cb5c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b00ee5e7828469f95bd90548d35982a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:16.587815 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-39ee7091-2888-4235-a504-b0d113fa710b tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] 10.222.0.26 "GET /compute/v2.1/servers/75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a" status: 200 len: 1521 microversion: 2.1 time: 0.559016 Oct 08 21:00:16.588435 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1045/2106] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:16 2022] GET /compute/v2.1/servers/75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a => generated 1521 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:00:16.603345 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-4747d35b-f7a5-4906-a583-8315fe1697d5 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:16.606073 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-4747d35b-f7a5-4906-a583-8315fe1697d5 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] [instance: 992277b1-0684-4013-a6c8-3937a1d41da3] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:16.609581 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-2dd1a620-5c0e-4d97-bc31-f43a3de4de9e tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] 10.222.0.26 "DELETE /compute/v2.1/servers/c9f0e1d2-6f87-485d-bff6-0ea83899b705" status: 204 len: 0 microversion: 2.1 time: 0.269310 Oct 08 21:00:16.610613 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1062/2107] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:00:16 2022] DELETE /compute/v2.1/servers/c9f0e1d2-6f87-485d-bff6-0ea83899b705 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 21:00:16.618146 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-5278c1fb-c72c-458f-8742-6b5990559232 req-0d7c5ada-1804-4562-9429-a230dc0d59b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "992277b1-0684-4013-a6c8-3937a1d41da3", "name": "network-vif-plugged", "status": "completed", "tag": "0aa370ab-ab6d-4bc3-990e-4bc72bb67a08"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:00:16.620247 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4747d35b-f7a5-4906-a583-8315fe1697d5 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:16.620748 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4747d35b-f7a5-4906-a583-8315fe1697d5 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:16.621217 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4747d35b-f7a5-4906-a583-8315fe1697d5 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:16.621931 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4747d35b-f7a5-4906-a583-8315fe1697d5 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:16.622552 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4747d35b-f7a5-4906-a583-8315fe1697d5 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:16.622846 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4747d35b-f7a5-4906-a583-8315fe1697d5 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:16.633218 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-5278c1fb-c72c-458f-8742-6b5990559232 req-0d7c5ada-1804-4562-9429-a230dc0d59b9 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:16.633865 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-5278c1fb-c72c-458f-8742-6b5990559232 req-0d7c5ada-1804-4562-9429-a230dc0d59b9 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:16.634518 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-5278c1fb-c72c-458f-8742-6b5990559232 req-0d7c5ada-1804-4562-9429-a230dc0d59b9 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:16.647766 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-5278c1fb-c72c-458f-8742-6b5990559232 req-0d7c5ada-1804-4562-9429-a230dc0d59b9 service nova] Creating event network-vif-plugged:0aa370ab-ab6d-4bc3-990e-4bc72bb67a08 for instance 992277b1-0684-4013-a6c8-3937a1d41da3 on nch1-master-1 Oct 08 21:00:16.653170 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-5278c1fb-c72c-458f-8742-6b5990559232 req-0d7c5ada-1804-4562-9429-a230dc0d59b9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040873 Oct 08 21:00:16.655002 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1063/2108] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:00:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:00:16.660851 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-9bfc2761-9175-4fb7-8cb3-f30bb009232c tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:16.661952 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-9bfc2761-9175-4fb7-8cb3-f30bb009232c tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] [instance: c9f0e1d2-6f87-485d-bff6-0ea83899b705] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:16.669511 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9bfc2761-9175-4fb7-8cb3-f30bb009232c tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:16.670431 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9bfc2761-9175-4fb7-8cb3-f30bb009232c tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:16.671110 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9bfc2761-9175-4fb7-8cb3-f30bb009232c tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:16.672062 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9bfc2761-9175-4fb7-8cb3-f30bb009232c tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:16.672745 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9bfc2761-9175-4fb7-8cb3-f30bb009232c tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:16.673705 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9bfc2761-9175-4fb7-8cb3-f30bb009232c tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:16.837801 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-4747d35b-f7a5-4906-a583-8315fe1697d5 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06caf10b6fa43a3a2ad34858594e329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b10172715d423eb887d6c5b171defb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:16.847064 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-4747d35b-f7a5-4906-a583-8315fe1697d5 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] 10.222.0.26 "GET /compute/v2.1/servers/992277b1-0684-4013-a6c8-3937a1d41da3" status: 200 len: 1526 microversion: 2.1 time: 0.250939 Oct 08 21:00:16.855977 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-9bfc2761-9175-4fb7-8cb3-f30bb009232c tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d96135705514061bef9306753143357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82999f8bc36455bafd8eed23c68e733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:16.865391 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-9bfc2761-9175-4fb7-8cb3-f30bb009232c tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] 10.222.0.26 "GET /compute/v2.1/servers/c9f0e1d2-6f87-485d-bff6-0ea83899b705" status: 200 len: 1610 microversion: 2.1 time: 0.208599 Oct 08 21:00:16.866174 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1064/2109] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:16 2022] GET /compute/v2.1/servers/c9f0e1d2-6f87-485d-bff6-0ea83899b705 => generated 1610 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:16.867698 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1046/2110] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:16 2022] GET /compute/v2.1/servers/992277b1-0684-4013-a6c8-3937a1d41da3 => generated 1526 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:16.879212 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-2b83ba22-8742-4ffb-b888-0e31777fe4c2 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:16.879951 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-2b83ba22-8742-4ffb-b888-0e31777fe4c2 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:16.885337 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:00:16.890815 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2b83ba22-8742-4ffb-b888-0e31777fe4c2 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:16.891330 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2b83ba22-8742-4ffb-b888-0e31777fe4c2 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:16.891785 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2b83ba22-8742-4ffb-b888-0e31777fe4c2 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:16.892521 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2b83ba22-8742-4ffb-b888-0e31777fe4c2 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:16.892991 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2b83ba22-8742-4ffb-b888-0e31777fe4c2 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:16.896030 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2b83ba22-8742-4ffb-b888-0e31777fe4c2 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:16.909127 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:00:17.138760 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c0a0538f-4cb6-49de-866e-af0f0423af51 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-250327130", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "fc3761cc-ac1c-4ef5-9c63-6edb44a3de44"}]}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:00:17.139288 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-2b83ba22-8742-4ffb-b888-0e31777fe4c2 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:17.158727 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-2b83ba22-8742-4ffb-b888-0e31777fe4c2 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd" status: 200 len: 1473 microversion: 2.1 time: 0.291487 Oct 08 21:00:17.159587 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1065/2111] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:16 2022] GET /compute/v2.1/servers/d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd => generated 1473 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:17.165618 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-95393d05-2fc7-4d29-9d83-da7131e62f57 req-e9ffc73f-cd14-485e-831a-aa9e731a4543 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "992277b1-0684-4013-a6c8-3937a1d41da3", "name": "network-vif-deleted", "tag": "0aa370ab-ab6d-4bc3-990e-4bc72bb67a08"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:00:17.182820 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-95393d05-2fc7-4d29-9d83-da7131e62f57 req-e9ffc73f-cd14-485e-831a-aa9e731a4543 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:17.183416 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-95393d05-2fc7-4d29-9d83-da7131e62f57 req-e9ffc73f-cd14-485e-831a-aa9e731a4543 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:17.184077 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-95393d05-2fc7-4d29-9d83-da7131e62f57 req-e9ffc73f-cd14-485e-831a-aa9e731a4543 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:17.203493 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-95393d05-2fc7-4d29-9d83-da7131e62f57 req-e9ffc73f-cd14-485e-831a-aa9e731a4543 service nova] Creating event network-vif-deleted:0aa370ab-ab6d-4bc3-990e-4bc72bb67a08 for instance 992277b1-0684-4013-a6c8-3937a1d41da3 on nch1-master-1 Oct 08 21:00:17.208804 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.network.neutron [None req-c0a0538f-4cb6-49de-866e-af0f0423af51 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] validate_networks() for [('fc3761cc-ac1c-4ef5-9c63-6edb44a3de44', None, None, None, None, None)] {{(pid=140491) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 21:00:17.211988 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-95393d05-2fc7-4d29-9d83-da7131e62f57 req-e9ffc73f-cd14-485e-831a-aa9e731a4543 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050678 Oct 08 21:00:17.217170 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1066/2112] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:00:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:00:17.349288 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e54c1633-0d37-4182-8e62-50ec911a1d96 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:17.350760 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-e54c1633-0d37-4182-8e62-50ec911a1d96 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] [instance: 655205e7-8a06-4704-896a-75b68056749e] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:17.358856 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e54c1633-0d37-4182-8e62-50ec911a1d96 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:17.359456 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e54c1633-0d37-4182-8e62-50ec911a1d96 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:17.359916 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e54c1633-0d37-4182-8e62-50ec911a1d96 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:17.361861 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e54c1633-0d37-4182-8e62-50ec911a1d96 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:17.362351 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e54c1633-0d37-4182-8e62-50ec911a1d96 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:17.362801 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e54c1633-0d37-4182-8e62-50ec911a1d96 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:17.514476 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-e54c1633-0d37-4182-8e62-50ec911a1d96 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ddc3cd3c374bacbe5bf5e0877380e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8472b054404c46a99b81aba34d6b9f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:17.523382 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-e54c1633-0d37-4182-8e62-50ec911a1d96 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] 10.222.0.26 "GET /compute/v2.1/servers/655205e7-8a06-4704-896a-75b68056749e" status: 200 len: 1316 microversion: 2.1 time: 0.178390 Oct 08 21:00:17.523981 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1067/2113] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:17 2022] GET /compute/v2.1/servers/655205e7-8a06-4704-896a-75b68056749e => generated 1316 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:00:17.612039 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-7554887a-1727-432e-a384-a5db27d9ef92 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:17.612670 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-7554887a-1727-432e-a384-a5db27d9ef92 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] [instance: 75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:17.619056 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7554887a-1727-432e-a384-a5db27d9ef92 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:17.619568 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7554887a-1727-432e-a384-a5db27d9ef92 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:17.620030 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7554887a-1727-432e-a384-a5db27d9ef92 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:17.620780 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7554887a-1727-432e-a384-a5db27d9ef92 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:17.621274 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7554887a-1727-432e-a384-a5db27d9ef92 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:17.621723 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7554887a-1727-432e-a384-a5db27d9ef92 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:17.634836 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-c0a0538f-4cb6-49de-866e-af0f0423af51 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Flavor limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 21:00:17.635301 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-c0a0538f-4cb6-49de-866e-af0f0423af51 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Image limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 21:00:17.635788 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-c0a0538f-4cb6-49de-866e-af0f0423af51 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Flavor pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 21:00:17.636300 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-c0a0538f-4cb6-49de-866e-af0f0423af51 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Image pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 21:00:17.636614 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-c0a0538f-4cb6-49de-866e-af0f0423af51 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 21:00:17.647656 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c0a0538f-4cb6-49de-866e-af0f0423af51 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:17.648259 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c0a0538f-4cb6-49de-866e-af0f0423af51 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:17.648947 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c0a0538f-4cb6-49de-866e-af0f0423af51 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:17.649963 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c0a0538f-4cb6-49de-866e-af0f0423af51 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:17.650432 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c0a0538f-4cb6-49de-866e-af0f0423af51 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:17.651260 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c0a0538f-4cb6-49de-866e-af0f0423af51 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:17.670674 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-c0a0538f-4cb6-49de-866e-af0f0423af51 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Getting quotas for project ac791938e6384c8c8473ffd65cf867a8. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:00:17.677172 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-c0a0538f-4cb6-49de-866e-af0f0423af51 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Getting quotas for user 463a3aac627c43d7af0dbc9facb52076 and project ac791938e6384c8c8473ffd65cf867a8. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:00:17.692146 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-c0a0538f-4cb6-49de-866e-af0f0423af51 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Going to run 3 instances... {{(pid=140491) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 21:00:17.694793 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-c0a0538f-4cb6-49de-866e-af0f0423af51 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] [instance: d02ba7e0-a550-4e8e-a3ab-37ed519e22b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c508bd7f-7db9-4b2c-af7c-be54a855c355',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140491) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 21:00:17.793697 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-c0a0538f-4cb6-49de-866e-af0f0423af51 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] [instance: 4832d86f-ddee-445e-8b26-fae015d901a4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c508bd7f-7db9-4b2c-af7c-be54a855c355',instance=,instance_uuid=d02ba7e0-a550-4e8e-a3ab-37ed519e22b0,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140491) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 21:00:17.835508 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-c0a0538f-4cb6-49de-866e-af0f0423af51 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] [instance: 3622a27e-b943-49a7-8d81-a6f553c32f7a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c508bd7f-7db9-4b2c-af7c-be54a855c355',instance=,instance_uuid=4832d86f-ddee-445e-8b26-fae015d901a4,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140491) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 21:00:17.843140 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-7554887a-1727-432e-a384-a5db27d9ef92 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1698dee4a2bf4ea19a6ee0c3d5cb5c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b00ee5e7828469f95bd90548d35982a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:17.853360 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-7554887a-1727-432e-a384-a5db27d9ef92 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] 10.222.0.26 "GET /compute/v2.1/servers/75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a" status: 200 len: 1521 microversion: 2.1 time: 0.245100 Oct 08 21:00:17.869971 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1068/2114] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:17 2022] GET /compute/v2.1/servers/75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a => generated 1521 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:00:17.878694 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-0d6ba952-f5c2-4809-bef6-0ce126b514c7 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:17.879384 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-0d6ba952-f5c2-4809-bef6-0ce126b514c7 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] [instance: 992277b1-0684-4013-a6c8-3937a1d41da3] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:17.887507 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0d6ba952-f5c2-4809-bef6-0ce126b514c7 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:17.889868 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0d6ba952-f5c2-4809-bef6-0ce126b514c7 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:17.890845 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0d6ba952-f5c2-4809-bef6-0ce126b514c7 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:17.891747 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0d6ba952-f5c2-4809-bef6-0ce126b514c7 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:17.892441 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0d6ba952-f5c2-4809-bef6-0ce126b514c7 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:17.893032 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0d6ba952-f5c2-4809-bef6-0ce126b514c7 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:17.921958 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-c0a0538f-4cb6-49de-866e-af0f0423af51 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.047620 Oct 08 21:00:17.928727 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1047/2115] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 21:00:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1055 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 08 21:00:17.935768 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-7d9e9793-d17d-494c-a86f-88ae4273e052 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:17.936401 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-7d9e9793-d17d-494c-a86f-88ae4273e052 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] [instance: c9f0e1d2-6f87-485d-bff6-0ea83899b705] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:17.960001 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7d9e9793-d17d-494c-a86f-88ae4273e052 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:17.961004 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7d9e9793-d17d-494c-a86f-88ae4273e052 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:17.964948 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7d9e9793-d17d-494c-a86f-88ae4273e052 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:17.966158 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7d9e9793-d17d-494c-a86f-88ae4273e052 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:17.966851 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7d9e9793-d17d-494c-a86f-88ae4273e052 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:17.967489 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7d9e9793-d17d-494c-a86f-88ae4273e052 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:17.995574 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-0d6ba952-f5c2-4809-bef6-0ce126b514c7 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06caf10b6fa43a3a2ad34858594e329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b10172715d423eb887d6c5b171defb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:18.011516 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-0d6ba952-f5c2-4809-bef6-0ce126b514c7 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] 10.222.0.26 "GET /compute/v2.1/servers/992277b1-0684-4013-a6c8-3937a1d41da3" status: 200 len: 1309 microversion: 2.1 time: 0.136342 Oct 08 21:00:18.028199 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1069/2116] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:17 2022] GET /compute/v2.1/servers/992277b1-0684-4013-a6c8-3937a1d41da3 => generated 1309 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:18.033047 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-f37bef78-80e3-4c1b-89b9-9476bb4bcab7 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:18.048139 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-f37bef78-80e3-4c1b-89b9-9476bb4bcab7 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '463a3aac627c43d7af0dbc9facb52076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac791938e6384c8c8473ffd65cf867a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:18.048950 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-f37bef78-80e3-4c1b-89b9-9476bb4bcab7 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Searching by: {'deleted': False, 'project_id': 'ac791938e6384c8c8473ffd65cf867a8'} {{(pid=140492) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 08 21:00:18.081535 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f37bef78-80e3-4c1b-89b9-9476bb4bcab7 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:18.082054 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f37bef78-80e3-4c1b-89b9-9476bb4bcab7 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:18.082509 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f37bef78-80e3-4c1b-89b9-9476bb4bcab7 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:18.083353 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f37bef78-80e3-4c1b-89b9-9476bb4bcab7 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:18.084494 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f37bef78-80e3-4c1b-89b9-9476bb4bcab7 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:18.084494 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f37bef78-80e3-4c1b-89b9-9476bb4bcab7 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:18.123505 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-f37bef78-80e3-4c1b-89b9-9476bb4bcab7 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] 10.222.0.26 "GET /compute/v2.1/servers" status: 200 len: 1015 microversion: 2.1 time: 0.096076 Oct 08 21:00:18.124451 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1070/2117] 10.222.0.26 () {58 vars in 1125 bytes} [Sat Oct 8 21:00:18 2022] GET /compute/v2.1/servers => generated 1015 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:18.137698 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-21751e00-f2e4-4ee0-a768-ef3ecf036e16 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:18.139021 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-21751e00-f2e4-4ee0-a768-ef3ecf036e16 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] [instance: 3622a27e-b943-49a7-8d81-a6f553c32f7a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:18.220149 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-21751e00-f2e4-4ee0-a768-ef3ecf036e16 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '463a3aac627c43d7af0dbc9facb52076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac791938e6384c8c8473ffd65cf867a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:18.227447 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-21751e00-f2e4-4ee0-a768-ef3ecf036e16 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] 10.222.0.26 "GET /compute/v2.1/servers/3622a27e-b943-49a7-8d81-a6f553c32f7a" status: 200 len: 1222 microversion: 2.1 time: 0.095347 Oct 08 21:00:18.228036 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1071/2118] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:18 2022] GET /compute/v2.1/servers/3622a27e-b943-49a7-8d81-a6f553c32f7a => generated 1222 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:18.233674 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-ce6d1153-e238-457c-875c-40173cedf7a4 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:18.234664 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-ce6d1153-e238-457c-875c-40173cedf7a4 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:18.240720 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ce6d1153-e238-457c-875c-40173cedf7a4 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:18.241479 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ce6d1153-e238-457c-875c-40173cedf7a4 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:18.242216 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ce6d1153-e238-457c-875c-40173cedf7a4 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:18.249480 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ce6d1153-e238-457c-875c-40173cedf7a4 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:18.250368 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ce6d1153-e238-457c-875c-40173cedf7a4 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:18.250846 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ce6d1153-e238-457c-875c-40173cedf7a4 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:18.390606 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-7d9e9793-d17d-494c-a86f-88ae4273e052 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d96135705514061bef9306753143357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82999f8bc36455bafd8eed23c68e733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:18.410257 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-7d9e9793-d17d-494c-a86f-88ae4273e052 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] 10.222.0.26 "GET /compute/v2.1/servers/c9f0e1d2-6f87-485d-bff6-0ea83899b705" status: 200 len: 1610 microversion: 2.1 time: 0.479839 Oct 08 21:00:18.423887 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1048/2119] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:17 2022] GET /compute/v2.1/servers/c9f0e1d2-6f87-485d-bff6-0ea83899b705 => generated 1610 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:18.443653 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-ce6d1153-e238-457c-875c-40173cedf7a4 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:18.451373 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-ce6d1153-e238-457c-875c-40173cedf7a4 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd" status: 200 len: 1473 microversion: 2.1 time: 0.221974 Oct 08 21:00:18.452528 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1072/2120] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:18 2022] GET /compute/v2.1/servers/d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd => generated 1473 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:18.547501 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-88950700-bb80-4262-af17-8514b541ae1a tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:18.548127 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-88950700-bb80-4262-af17-8514b541ae1a tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] [instance: 655205e7-8a06-4704-896a-75b68056749e] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:18.554737 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-88950700-bb80-4262-af17-8514b541ae1a tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:18.555732 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-88950700-bb80-4262-af17-8514b541ae1a tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:18.556202 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-88950700-bb80-4262-af17-8514b541ae1a tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:18.556908 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-88950700-bb80-4262-af17-8514b541ae1a tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:18.557410 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-88950700-bb80-4262-af17-8514b541ae1a tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:18.557853 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-88950700-bb80-4262-af17-8514b541ae1a tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:18.756087 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-88950700-bb80-4262-af17-8514b541ae1a tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ddc3cd3c374bacbe5bf5e0877380e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8472b054404c46a99b81aba34d6b9f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:18.768857 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-88950700-bb80-4262-af17-8514b541ae1a tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] 10.222.0.26 "GET /compute/v2.1/servers/655205e7-8a06-4704-896a-75b68056749e" status: 200 len: 1316 microversion: 2.1 time: 0.226365 Oct 08 21:00:18.770073 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1049/2121] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:18 2022] GET /compute/v2.1/servers/655205e7-8a06-4704-896a-75b68056749e => generated 1316 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:18.879577 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-12a9c5b8-7253-4889-9532-f69c40adfd24 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:18.880409 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-12a9c5b8-7253-4889-9532-f69c40adfd24 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] [instance: 75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:18.889766 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-12a9c5b8-7253-4889-9532-f69c40adfd24 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:18.890371 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-12a9c5b8-7253-4889-9532-f69c40adfd24 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:18.890776 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-12a9c5b8-7253-4889-9532-f69c40adfd24 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:18.891510 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-12a9c5b8-7253-4889-9532-f69c40adfd24 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:18.891968 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-12a9c5b8-7253-4889-9532-f69c40adfd24 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:18.892416 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-12a9c5b8-7253-4889-9532-f69c40adfd24 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:19.036754 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-bc7e45db-4ae9-44d9-b467-7830450af1e9 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:19.037862 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-bc7e45db-4ae9-44d9-b467-7830450af1e9 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] [instance: 992277b1-0684-4013-a6c8-3937a1d41da3] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:19.052162 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bc7e45db-4ae9-44d9-b467-7830450af1e9 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:19.053516 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bc7e45db-4ae9-44d9-b467-7830450af1e9 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:19.054249 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bc7e45db-4ae9-44d9-b467-7830450af1e9 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:19.055883 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bc7e45db-4ae9-44d9-b467-7830450af1e9 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:19.058236 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bc7e45db-4ae9-44d9-b467-7830450af1e9 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:19.058704 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bc7e45db-4ae9-44d9-b467-7830450af1e9 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:19.111072 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-12a9c5b8-7253-4889-9532-f69c40adfd24 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1698dee4a2bf4ea19a6ee0c3d5cb5c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b00ee5e7828469f95bd90548d35982a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:19.120479 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bc7e45db-4ae9-44d9-b467-7830450af1e9 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:19.123986 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-12a9c5b8-7253-4889-9532-f69c40adfd24 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] 10.222.0.26 "GET /compute/v2.1/servers/75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a" status: 200 len: 1521 microversion: 2.1 time: 0.248709 Oct 08 21:00:19.124702 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bc7e45db-4ae9-44d9-b467-7830450af1e9 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:19.125171 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bc7e45db-4ae9-44d9-b467-7830450af1e9 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:19.125681 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.objects.instance [None req-bc7e45db-4ae9-44d9-b467-7830450af1e9 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lazy-loading 'fault' on Instance uuid 992277b1-0684-4013-a6c8-3937a1d41da3 {{(pid=140491) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 21:00:19.129306 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1073/2122] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:18 2022] GET /compute/v2.1/servers/75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a => generated 1521 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:19.250297 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-9bbe077b-6063-4e60-b003-f5f1d9c7b3ea req-5c0d90bb-eae7-4c23-9ac0-3ebd58eedfbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd", "name": "network-vif-unplugged", "status": "completed", "tag": "1e8ee887-8012-4f64-a840-73388344bd23"}, {"name": "network-changed", "server_uuid": "d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd", "tag": "1e8ee887-8012-4f64-a840-73388344bd23"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:00:19.274737 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-9bbe077b-6063-4e60-b003-f5f1d9c7b3ea req-5c0d90bb-eae7-4c23-9ac0-3ebd58eedfbf service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:19.275732 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-9bbe077b-6063-4e60-b003-f5f1d9c7b3ea req-5c0d90bb-eae7-4c23-9ac0-3ebd58eedfbf service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:19.276581 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-9bbe077b-6063-4e60-b003-f5f1d9c7b3ea req-5c0d90bb-eae7-4c23-9ac0-3ebd58eedfbf service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:19.303162 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-9bbe077b-6063-4e60-b003-f5f1d9c7b3ea req-5c0d90bb-eae7-4c23-9ac0-3ebd58eedfbf service nova] Creating event network-vif-unplugged:1e8ee887-8012-4f64-a840-73388344bd23 for instance d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd on nch1-master-1 Oct 08 21:00:19.304244 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-9bbe077b-6063-4e60-b003-f5f1d9c7b3ea req-5c0d90bb-eae7-4c23-9ac0-3ebd58eedfbf service nova] Creating event network-changed:1e8ee887-8012-4f64-a840-73388344bd23 for instance d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd on nch1-master-1 Oct 08 21:00:19.329481 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [req-9bbe077b-6063-4e60-b003-f5f1d9c7b3ea req-5c0d90bb-eae7-4c23-9ac0-3ebd58eedfbf service nova] Instance d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140492) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 08 21:00:19.355701 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-9bbe077b-6063-4e60-b003-f5f1d9c7b3ea req-5c0d90bb-eae7-4c23-9ac0-3ebd58eedfbf service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.109555 Oct 08 21:00:19.357922 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1074/2123] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:00:19 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 08 21:00:19.365664 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-8a32a0ab-0cad-428c-af41-3ffc10919f27 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:19.368042 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-8a32a0ab-0cad-428c-af41-3ffc10919f27 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] [instance: 3622a27e-b943-49a7-8d81-a6f553c32f7a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:19.396011 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8a32a0ab-0cad-428c-af41-3ffc10919f27 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:19.396850 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8a32a0ab-0cad-428c-af41-3ffc10919f27 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:19.397995 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8a32a0ab-0cad-428c-af41-3ffc10919f27 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:19.399769 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8a32a0ab-0cad-428c-af41-3ffc10919f27 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:19.400253 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8a32a0ab-0cad-428c-af41-3ffc10919f27 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:19.400994 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8a32a0ab-0cad-428c-af41-3ffc10919f27 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:19.500799 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-bc7e45db-4ae9-44d9-b467-7830450af1e9 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06caf10b6fa43a3a2ad34858594e329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b10172715d423eb887d6c5b171defb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:19.523291 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-bc7e45db-4ae9-44d9-b467-7830450af1e9 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] 10.222.0.26 "GET /compute/v2.1/servers/992277b1-0684-4013-a6c8-3937a1d41da3" status: 200 len: 1314 microversion: 2.1 time: 0.486146 Oct 08 21:00:19.525647 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1050/2124] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:19 2022] GET /compute/v2.1/servers/992277b1-0684-4013-a6c8-3937a1d41da3 => generated 1314 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:19.541149 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-74b94a25-ed8e-4603-9749-a0a4ebe7b79c tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:19.542967 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-74b94a25-ed8e-4603-9749-a0a4ebe7b79c tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] [instance: c9f0e1d2-6f87-485d-bff6-0ea83899b705] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:19.553008 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-74b94a25-ed8e-4603-9749-a0a4ebe7b79c tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:19.555145 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-74b94a25-ed8e-4603-9749-a0a4ebe7b79c tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:19.555613 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-74b94a25-ed8e-4603-9749-a0a4ebe7b79c tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:19.556353 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-74b94a25-ed8e-4603-9749-a0a4ebe7b79c tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:19.556830 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-74b94a25-ed8e-4603-9749-a0a4ebe7b79c tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:19.557632 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-74b94a25-ed8e-4603-9749-a0a4ebe7b79c tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:19.604002 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-8a32a0ab-0cad-428c-af41-3ffc10919f27 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '463a3aac627c43d7af0dbc9facb52076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac791938e6384c8c8473ffd65cf867a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:19.626588 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-8a32a0ab-0cad-428c-af41-3ffc10919f27 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] 10.222.0.26 "GET /compute/v2.1/servers/3622a27e-b943-49a7-8d81-a6f553c32f7a" status: 200 len: 1226 microversion: 2.1 time: 0.265914 Oct 08 21:00:19.638965 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1075/2125] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:19 2022] GET /compute/v2.1/servers/3622a27e-b943-49a7-8d81-a6f553c32f7a => generated 1226 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:19.645971 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-c75f04a3-7967-494b-a179-50805de4aa10 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:19.646604 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-c75f04a3-7967-494b-a179-50805de4aa10 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:19.666571 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c75f04a3-7967-494b-a179-50805de4aa10 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:19.667127 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c75f04a3-7967-494b-a179-50805de4aa10 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:19.667645 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c75f04a3-7967-494b-a179-50805de4aa10 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:19.668393 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c75f04a3-7967-494b-a179-50805de4aa10 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:19.668919 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c75f04a3-7967-494b-a179-50805de4aa10 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:19.669396 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c75f04a3-7967-494b-a179-50805de4aa10 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:19.935589 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-c75f04a3-7967-494b-a179-50805de4aa10 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:19.948904 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-c75f04a3-7967-494b-a179-50805de4aa10 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd" status: 200 len: 1473 microversion: 2.1 time: 0.308778 Oct 08 21:00:19.951158 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1076/2126] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:19 2022] GET /compute/v2.1/servers/d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd => generated 1473 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:19.967445 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-62ce158c-d4b2-4caf-9fd2-f26a85e5acbc tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:19.969899 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-62ce158c-d4b2-4caf-9fd2-f26a85e5acbc tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] [instance: 655205e7-8a06-4704-896a-75b68056749e] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:19.985516 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-62ce158c-d4b2-4caf-9fd2-f26a85e5acbc tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:19.986901 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-62ce158c-d4b2-4caf-9fd2-f26a85e5acbc tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:19.993871 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-62ce158c-d4b2-4caf-9fd2-f26a85e5acbc tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:19.994864 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-62ce158c-d4b2-4caf-9fd2-f26a85e5acbc tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:19.995549 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-62ce158c-d4b2-4caf-9fd2-f26a85e5acbc tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:19.996263 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-62ce158c-d4b2-4caf-9fd2-f26a85e5acbc tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:20.282034 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-62ce158c-d4b2-4caf-9fd2-f26a85e5acbc tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ddc3cd3c374bacbe5bf5e0877380e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8472b054404c46a99b81aba34d6b9f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:20.292183 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-62ce158c-d4b2-4caf-9fd2-f26a85e5acbc tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] 10.222.0.26 "GET /compute/v2.1/servers/655205e7-8a06-4704-896a-75b68056749e" status: 200 len: 1316 microversion: 2.1 time: 0.339468 Oct 08 21:00:20.294557 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1077/2127] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:19 2022] GET /compute/v2.1/servers/655205e7-8a06-4704-896a-75b68056749e => generated 1316 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:20.302864 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-53ecee22-9f60-4142-946f-a7f62529b70b tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:20.304430 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-53ecee22-9f60-4142-946f-a7f62529b70b tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] [instance: 75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:20.328367 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-53ecee22-9f60-4142-946f-a7f62529b70b tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:20.329406 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-53ecee22-9f60-4142-946f-a7f62529b70b tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:20.330138 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-53ecee22-9f60-4142-946f-a7f62529b70b tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:20.332092 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-53ecee22-9f60-4142-946f-a7f62529b70b tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:20.332966 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-53ecee22-9f60-4142-946f-a7f62529b70b tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:20.333688 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-53ecee22-9f60-4142-946f-a7f62529b70b tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:20.479375 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-74b94a25-ed8e-4603-9749-a0a4ebe7b79c tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d96135705514061bef9306753143357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82999f8bc36455bafd8eed23c68e733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:20.492034 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-74b94a25-ed8e-4603-9749-a0a4ebe7b79c tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] 10.222.0.26 "GET /compute/v2.1/servers/c9f0e1d2-6f87-485d-bff6-0ea83899b705" status: 200 len: 1610 microversion: 2.1 time: 0.962396 Oct 08 21:00:20.494127 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1051/2128] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:19 2022] GET /compute/v2.1/servers/c9f0e1d2-6f87-485d-bff6-0ea83899b705 => generated 1610 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:20.554770 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-42a03d44-74cb-4b94-8f3b-4a9651f868a3 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:20.555581 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-42a03d44-74cb-4b94-8f3b-4a9651f868a3 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] [instance: 992277b1-0684-4013-a6c8-3937a1d41da3] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:20.569548 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-42a03d44-74cb-4b94-8f3b-4a9651f868a3 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:20.570216 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-42a03d44-74cb-4b94-8f3b-4a9651f868a3 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:20.571154 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-42a03d44-74cb-4b94-8f3b-4a9651f868a3 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:20.572012 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-42a03d44-74cb-4b94-8f3b-4a9651f868a3 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:20.574639 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-42a03d44-74cb-4b94-8f3b-4a9651f868a3 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:20.575875 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-42a03d44-74cb-4b94-8f3b-4a9651f868a3 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:20.622960 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-42a03d44-74cb-4b94-8f3b-4a9651f868a3 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] HTTP exception thrown: Instance 992277b1-0684-4013-a6c8-3937a1d41da3 could not be found. Oct 08 21:00:20.627892 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-42a03d44-74cb-4b94-8f3b-4a9651f868a3 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Request method failure captured: Oct 08 21:00:20.627892 ncdv-master-1 devstack@n-api.service[140491]: request: GET /compute/v2.1/servers/992277b1-0684-4013-a6c8-3937a1d41da3 HTTP/1.1 Oct 08 21:00:20.627892 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:00:20.627892 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:00:20.627892 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:00:20.627892 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 21:00:20.627892 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:00:20.627892 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:00:20.627892 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:00:20.627892 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:00:20.627892 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeTE7bTfM4hIhoviKx9l8mw-bWfYL6jsTZW_QjKSgS6NcvR5fjqeBn6E1jAPDuPpZvhMcTeb9kBH8YZZEMCFr_F1J-nxa8vLVrJvg33lxBDKWqjORjFzU7YTBNB-gB5p5hXf0cUCzsO7xU_2VbukaClcdx1U8H5njKq8mVnqRKHv1K4 Oct 08 21:00:20.627892 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:00:20.627892 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:00:20.627892 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:00:20.627892 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:00:20.627892 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:00:20.627892 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:00:20.627892 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 76b10172715d423eb887d6c5b171defb Oct 08 21:00:20.627892 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1001637313 Oct 08 21:00:20.627892 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:00:20.627892 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:00:20.627892 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/76b10172715d423eb887d6c5b171defb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/76b10172715d423eb887d6c5b171defb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_76b10172715d423eb887d6c5b171defb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/76b10172715d423eb887d6c5b171defb"}]}] Oct 08 21:00:20.627892 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1001637313 Oct 08 21:00:20.627892 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 76b10172715d423eb887d6c5b171defb Oct 08 21:00:20.627892 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1001637313 Oct 08 21:00:20.627892 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-ImagesOneServerNegativeTestJSON-1001637313-project Oct 08 21:00:20.627892 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:00:20.627892 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:00:20.627892 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: f06caf10b6fa43a3a2ad34858594e329 Oct 08 21:00:20.627892 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1001637313-project Oct 08 21:00:20.627892 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:00:20.627892 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance 992277b1-0684-4013-a6c8-3937a1d41da3 could not be found. Oct 08 21:00:20.627892 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': '992277b1-0684-4013-a6c8-3937a1d41da3'} Oct 08 21:00:20.627892 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:00:20.627892 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:00:20.627892 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:00:20.627892 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:00:20.627892 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:00:20.627892 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:00:20.627892 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:00:20.627892 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:00:20.627892 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:00:20.627892 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:00:20.627892 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 992277b1-0684-4013-a6c8-3937a1d41da3 could not be found. Oct 08 21:00:20.627892 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:00:20.627892 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:00:20.627892 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:00:20.627892 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:00:20.627892 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:00:20.627892 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:00:20.627892 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:00:20.627892 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:00:20.627892 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:00:20.627892 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:00:20.627892 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:00:20.627892 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:00:20.627892 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:00:20.627892 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:00:20.627892 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:00:20.627892 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:00:20.627892 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 992277b1-0684-4013-a6c8-3937a1d41da3 could not be found. Oct 08 21:00:20.627892 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:00:20.627892 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:00:20.631375 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:00:20.631375 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:00:20.631375 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:00:20.631375 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:00:20.631375 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:00:20.631375 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:00:20.631375 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 992277b1-0684-4013-a6c8-3937a1d41da3 could not be found. Oct 08 21:00:20.631375 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:00:20.636649 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-42a03d44-74cb-4b94-8f3b-4a9651f868a3 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Returning 404 to user: Instance 992277b1-0684-4013-a6c8-3937a1d41da3 could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:00:20.637792 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-42a03d44-74cb-4b94-8f3b-4a9651f868a3 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] 10.222.0.26 "GET /compute/v2.1/servers/992277b1-0684-4013-a6c8-3937a1d41da3" status: 404 len: 111 microversion: 2.1 time: 0.088248 Oct 08 21:00:20.641851 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1052/2129] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:20 2022] GET /compute/v2.1/servers/992277b1-0684-4013-a6c8-3937a1d41da3 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 08 21:00:20.661586 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-f84d6321-5c7c-4b6d-b52f-aec39b85daf8 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Action: 'create', calling method: .version_select at 0x7f1a9136d5e0>, body: {"keypair": {"name": "tempest-keypair-1532991558", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGQZ399e73CyFHC77vGacuF37HNIDjbucJf4gSThYutrIghOcNi5o2N+7PfGaiy6MgomfyWkOLtwhXs448ZrLTPtFXVGQ96B/zQjLjgLRlqAUxlILxqsqlTFPkTCmnwmqA=="}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:00:20.715506 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-f84d6321-5c7c-4b6d-b52f-aec39b85daf8 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Getting quotas for project 76b10172715d423eb887d6c5b171defb. Resources: {'key_pairs'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:00:20.729118 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-f84d6321-5c7c-4b6d-b52f-aec39b85daf8 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Getting quotas for user f06caf10b6fa43a3a2ad34858594e329 and project 76b10172715d423eb887d6c5b171defb. Resources: {'key_pairs'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:00:20.774983 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-f84d6321-5c7c-4b6d-b52f-aec39b85daf8 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.125339 Oct 08 21:00:20.776419 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1053/2130] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Oct 8 21:00:20 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:00:20.783560 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-2382b8de-227d-4e4b-9cf8-3f44d5d6cda3 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:20.784521 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-2382b8de-227d-4e4b-9cf8-3f44d5d6cda3 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] [instance: 3622a27e-b943-49a7-8d81-a6f553c32f7a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:20.793701 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2382b8de-227d-4e4b-9cf8-3f44d5d6cda3 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:20.796079 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2382b8de-227d-4e4b-9cf8-3f44d5d6cda3 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:20.796895 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2382b8de-227d-4e4b-9cf8-3f44d5d6cda3 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:20.798014 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2382b8de-227d-4e4b-9cf8-3f44d5d6cda3 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:20.798722 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2382b8de-227d-4e4b-9cf8-3f44d5d6cda3 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:20.799974 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2382b8de-227d-4e4b-9cf8-3f44d5d6cda3 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:21.205654 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-53ecee22-9f60-4142-946f-a7f62529b70b tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1698dee4a2bf4ea19a6ee0c3d5cb5c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b00ee5e7828469f95bd90548d35982a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:21.218570 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-53ecee22-9f60-4142-946f-a7f62529b70b tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] 10.222.0.26 "GET /compute/v2.1/servers/75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a" status: 200 len: 1521 microversion: 2.1 time: 0.922418 Oct 08 21:00:21.232768 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1078/2131] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:20 2022] GET /compute/v2.1/servers/75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a => generated 1521 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:21.232768 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-4fa96121-e0cd-41a3-8e4b-9070c1d655eb tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:21.232768 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-4fa96121-e0cd-41a3-8e4b-9070c1d655eb tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:21.244943 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4fa96121-e0cd-41a3-8e4b-9070c1d655eb tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:21.245476 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4fa96121-e0cd-41a3-8e4b-9070c1d655eb tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:21.245924 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4fa96121-e0cd-41a3-8e4b-9070c1d655eb tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:21.246753 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4fa96121-e0cd-41a3-8e4b-9070c1d655eb tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:21.247959 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-2382b8de-227d-4e4b-9cf8-3f44d5d6cda3 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '463a3aac627c43d7af0dbc9facb52076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac791938e6384c8c8473ffd65cf867a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:21.249789 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4fa96121-e0cd-41a3-8e4b-9070c1d655eb tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:21.250470 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4fa96121-e0cd-41a3-8e4b-9070c1d655eb tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:21.265434 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-2382b8de-227d-4e4b-9cf8-3f44d5d6cda3 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] 10.222.0.26 "GET /compute/v2.1/servers/3622a27e-b943-49a7-8d81-a6f553c32f7a" status: 200 len: 1218 microversion: 2.1 time: 0.486569 Oct 08 21:00:21.267180 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1054/2132] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:20 2022] GET /compute/v2.1/servers/3622a27e-b943-49a7-8d81-a6f553c32f7a => generated 1218 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:21.322274 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-aa9009f2-e0e7-4521-beef-8c7e8849b319 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:21.322994 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-aa9009f2-e0e7-4521-beef-8c7e8849b319 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] [instance: 655205e7-8a06-4704-896a-75b68056749e] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:21.331088 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-aa9009f2-e0e7-4521-beef-8c7e8849b319 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:21.333883 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-aa9009f2-e0e7-4521-beef-8c7e8849b319 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:21.334550 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-aa9009f2-e0e7-4521-beef-8c7e8849b319 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:21.335726 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-aa9009f2-e0e7-4521-beef-8c7e8849b319 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:21.336201 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-aa9009f2-e0e7-4521-beef-8c7e8849b319 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:21.336635 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-aa9009f2-e0e7-4521-beef-8c7e8849b319 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:21.362234 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=100 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:00:21.587802 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-4fa96121-e0cd-41a3-8e4b-9070c1d655eb tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:21.602758 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-4fa96121-e0cd-41a3-8e4b-9070c1d655eb tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd" status: 200 len: 1471 microversion: 2.1 time: 0.380901 Oct 08 21:00:21.604251 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1079/2133] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:21 2022] GET /compute/v2.1/servers/d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd => generated 1471 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:21.609926 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-65f17d8b-47b4-4df4-9d55-c6b92f7e35c9 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:21.610871 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-65f17d8b-47b4-4df4-9d55-c6b92f7e35c9 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] [instance: c9f0e1d2-6f87-485d-bff6-0ea83899b705] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:21.622470 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-65f17d8b-47b4-4df4-9d55-c6b92f7e35c9 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:21.624258 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-65f17d8b-47b4-4df4-9d55-c6b92f7e35c9 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:21.625594 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-65f17d8b-47b4-4df4-9d55-c6b92f7e35c9 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:21.629617 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-65f17d8b-47b4-4df4-9d55-c6b92f7e35c9 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:21.631794 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-65f17d8b-47b4-4df4-9d55-c6b92f7e35c9 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:21.632421 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-65f17d8b-47b4-4df4-9d55-c6b92f7e35c9 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:21.780448 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-aa9009f2-e0e7-4521-beef-8c7e8849b319 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ddc3cd3c374bacbe5bf5e0877380e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8472b054404c46a99b81aba34d6b9f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:21.793253 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-aa9009f2-e0e7-4521-beef-8c7e8849b319 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] 10.222.0.26 "GET /compute/v2.1/servers/655205e7-8a06-4704-896a-75b68056749e" status: 200 len: 1316 microversion: 2.1 time: 0.476856 Oct 08 21:00:21.798411 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1055/2134] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:21 2022] GET /compute/v2.1/servers/655205e7-8a06-4704-896a-75b68056749e => generated 1316 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:21.994724 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-65f17d8b-47b4-4df4-9d55-c6b92f7e35c9 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d96135705514061bef9306753143357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82999f8bc36455bafd8eed23c68e733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:22.007973 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-65f17d8b-47b4-4df4-9d55-c6b92f7e35c9 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] 10.222.0.26 "GET /compute/v2.1/servers/c9f0e1d2-6f87-485d-bff6-0ea83899b705" status: 200 len: 1610 microversion: 2.1 time: 0.399805 Oct 08 21:00:22.010828 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1080/2135] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:21 2022] GET /compute/v2.1/servers/c9f0e1d2-6f87-485d-bff6-0ea83899b705 => generated 1610 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:22.253803 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-f6bdcfcc-e853-4f36-b4c6-839b6ec45d18 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:22.254678 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-f6bdcfcc-e853-4f36-b4c6-839b6ec45d18 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] [instance: 75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:22.267617 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f6bdcfcc-e853-4f36-b4c6-839b6ec45d18 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:22.268452 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f6bdcfcc-e853-4f36-b4c6-839b6ec45d18 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:22.269020 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f6bdcfcc-e853-4f36-b4c6-839b6ec45d18 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:22.269958 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f6bdcfcc-e853-4f36-b4c6-839b6ec45d18 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:22.270481 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f6bdcfcc-e853-4f36-b4c6-839b6ec45d18 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:22.271014 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f6bdcfcc-e853-4f36-b4c6-839b6ec45d18 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:22.295717 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-2607e82c-b214-49c5-88a6-00e7eff0689e tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:22.297149 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-2607e82c-b214-49c5-88a6-00e7eff0689e tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] [instance: 3622a27e-b943-49a7-8d81-a6f553c32f7a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:22.309672 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2607e82c-b214-49c5-88a6-00e7eff0689e tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:22.311774 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2607e82c-b214-49c5-88a6-00e7eff0689e tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:22.312884 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2607e82c-b214-49c5-88a6-00e7eff0689e tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:22.316986 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2607e82c-b214-49c5-88a6-00e7eff0689e tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:22.320985 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2607e82c-b214-49c5-88a6-00e7eff0689e tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:22.323228 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2607e82c-b214-49c5-88a6-00e7eff0689e tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:22.499421 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-2607e82c-b214-49c5-88a6-00e7eff0689e tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '463a3aac627c43d7af0dbc9facb52076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac791938e6384c8c8473ffd65cf867a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:22.514034 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-2607e82c-b214-49c5-88a6-00e7eff0689e tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] 10.222.0.26 "GET /compute/v2.1/servers/3622a27e-b943-49a7-8d81-a6f553c32f7a" status: 200 len: 1218 microversion: 2.1 time: 0.223823 Oct 08 21:00:22.519495 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1081/2136] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:22 2022] GET /compute/v2.1/servers/3622a27e-b943-49a7-8d81-a6f553c32f7a => generated 1218 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:00:22.530321 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-ddc127a6-0513-40db-91be-4972b0d54397 req-dbccaff7-93f0-4ede-8f67-5008ac3d4949 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "655205e7-8a06-4704-896a-75b68056749e", "name": "network-vif-plugged", "status": "completed", "tag": "c815fb44-5023-410d-ae98-5c8ae72635bc"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:00:22.556486 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-ddc127a6-0513-40db-91be-4972b0d54397 req-dbccaff7-93f0-4ede-8f67-5008ac3d4949 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:22.560670 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-ddc127a6-0513-40db-91be-4972b0d54397 req-dbccaff7-93f0-4ede-8f67-5008ac3d4949 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:22.561456 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-ddc127a6-0513-40db-91be-4972b0d54397 req-dbccaff7-93f0-4ede-8f67-5008ac3d4949 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:22.596719 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-ddc127a6-0513-40db-91be-4972b0d54397 req-dbccaff7-93f0-4ede-8f67-5008ac3d4949 service nova] Creating event network-vif-plugged:c815fb44-5023-410d-ae98-5c8ae72635bc for instance 655205e7-8a06-4704-896a-75b68056749e on nch1-master-1 Oct 08 21:00:22.612190 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-ddc127a6-0513-40db-91be-4972b0d54397 req-dbccaff7-93f0-4ede-8f67-5008ac3d4949 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090923 Oct 08 21:00:22.614151 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1082/2137] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:00:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:00:22.631521 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-9901b5a9-785a-42b8-b965-43cab9144cbc tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:22.632639 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-9901b5a9-785a-42b8-b965-43cab9144cbc tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:22.645389 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9901b5a9-785a-42b8-b965-43cab9144cbc tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:22.648679 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9901b5a9-785a-42b8-b965-43cab9144cbc tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:22.651366 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9901b5a9-785a-42b8-b965-43cab9144cbc tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:22.652540 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9901b5a9-785a-42b8-b965-43cab9144cbc tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:22.654548 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9901b5a9-785a-42b8-b965-43cab9144cbc tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:22.655125 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9901b5a9-785a-42b8-b965-43cab9144cbc tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:23.323921 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-f6bdcfcc-e853-4f36-b4c6-839b6ec45d18 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1698dee4a2bf4ea19a6ee0c3d5cb5c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b00ee5e7828469f95bd90548d35982a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:23.333953 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-f6bdcfcc-e853-4f36-b4c6-839b6ec45d18 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] 10.222.0.26 "GET /compute/v2.1/servers/75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a" status: 200 len: 1521 microversion: 2.1 time: 1.093706 Oct 08 21:00:23.354604 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1056/2138] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:22 2022] GET /compute/v2.1/servers/75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a => generated 1521 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:23.363155 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-717380f3-7281-45c4-bfe7-2f5a97074fb1 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:23.364299 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-717380f3-7281-45c4-bfe7-2f5a97074fb1 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] [instance: 655205e7-8a06-4704-896a-75b68056749e] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:23.372852 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-717380f3-7281-45c4-bfe7-2f5a97074fb1 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:23.373762 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-717380f3-7281-45c4-bfe7-2f5a97074fb1 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:23.374522 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-717380f3-7281-45c4-bfe7-2f5a97074fb1 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:23.375458 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-717380f3-7281-45c4-bfe7-2f5a97074fb1 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:23.376372 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-717380f3-7281-45c4-bfe7-2f5a97074fb1 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:23.377115 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-717380f3-7281-45c4-bfe7-2f5a97074fb1 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:23.625464 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-9901b5a9-785a-42b8-b965-43cab9144cbc tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:23.638526 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-9901b5a9-785a-42b8-b965-43cab9144cbc tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd" status: 200 len: 1471 microversion: 2.1 time: 1.011667 Oct 08 21:00:23.639716 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1083/2139] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:22 2022] GET /compute/v2.1/servers/d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd => generated 1471 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:00:23.644566 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-ffd79716-42a0-49ce-bafc-574f69148278 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:23.645666 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-ffd79716-42a0-49ce-bafc-574f69148278 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] [instance: c9f0e1d2-6f87-485d-bff6-0ea83899b705] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:23.653904 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ffd79716-42a0-49ce-bafc-574f69148278 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:23.654681 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ffd79716-42a0-49ce-bafc-574f69148278 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:23.655321 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ffd79716-42a0-49ce-bafc-574f69148278 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:23.656249 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ffd79716-42a0-49ce-bafc-574f69148278 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:23.656725 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ffd79716-42a0-49ce-bafc-574f69148278 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:23.657208 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ffd79716-42a0-49ce-bafc-574f69148278 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:23.707630 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ffd79716-42a0-49ce-bafc-574f69148278 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:23.708152 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ffd79716-42a0-49ce-bafc-574f69148278 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:23.708603 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ffd79716-42a0-49ce-bafc-574f69148278 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:23.709109 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.objects.instance [None req-ffd79716-42a0-49ce-bafc-574f69148278 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Lazy-loading 'fault' on Instance uuid c9f0e1d2-6f87-485d-bff6-0ea83899b705 {{(pid=140492) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 21:00:23.723566 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-717380f3-7281-45c4-bfe7-2f5a97074fb1 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ddc3cd3c374bacbe5bf5e0877380e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8472b054404c46a99b81aba34d6b9f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:23.737004 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-717380f3-7281-45c4-bfe7-2f5a97074fb1 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] 10.222.0.26 "GET /compute/v2.1/servers/655205e7-8a06-4704-896a-75b68056749e" status: 200 len: 1316 microversion: 2.1 time: 0.380540 Oct 08 21:00:23.737684 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1057/2140] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:23 2022] GET /compute/v2.1/servers/655205e7-8a06-4704-896a-75b68056749e => generated 1316 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:23.744107 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-5d057750-cb18-4a94-b984-7ab526819312 req-fef09b23-deec-4c6b-853f-27b97e921797 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9f0e1d2-6f87-485d-bff6-0ea83899b705", "name": "network-vif-deleted", "tag": "f8af2e56-5b37-4a10-8d70-4486ae942499"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:00:23.775230 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-5d057750-cb18-4a94-b984-7ab526819312 req-fef09b23-deec-4c6b-853f-27b97e921797 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:23.775992 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-5d057750-cb18-4a94-b984-7ab526819312 req-fef09b23-deec-4c6b-853f-27b97e921797 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:23.776690 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-5d057750-cb18-4a94-b984-7ab526819312 req-fef09b23-deec-4c6b-853f-27b97e921797 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:23.798021 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-5d057750-cb18-4a94-b984-7ab526819312 req-fef09b23-deec-4c6b-853f-27b97e921797 service nova] Creating event network-vif-deleted:f8af2e56-5b37-4a10-8d70-4486ae942499 for instance c9f0e1d2-6f87-485d-bff6-0ea83899b705 on nch1-master-1 Oct 08 21:00:23.814963 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-5d057750-cb18-4a94-b984-7ab526819312 req-fef09b23-deec-4c6b-853f-27b97e921797 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070367 Oct 08 21:00:23.817571 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1058/2141] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:00:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:00:23.833098 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-8241ce67-a0f7-42ea-85f6-f66b6d9ec3f0 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:23.839306 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-8241ce67-a0f7-42ea-85f6-f66b6d9ec3f0 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] [instance: 3622a27e-b943-49a7-8d81-a6f553c32f7a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:23.854528 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8241ce67-a0f7-42ea-85f6-f66b6d9ec3f0 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:23.855575 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8241ce67-a0f7-42ea-85f6-f66b6d9ec3f0 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:23.856076 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8241ce67-a0f7-42ea-85f6-f66b6d9ec3f0 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:23.857484 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8241ce67-a0f7-42ea-85f6-f66b6d9ec3f0 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:23.857952 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8241ce67-a0f7-42ea-85f6-f66b6d9ec3f0 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:23.860296 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8241ce67-a0f7-42ea-85f6-f66b6d9ec3f0 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:23.923708 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-ffd79716-42a0-49ce-bafc-574f69148278 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d96135705514061bef9306753143357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82999f8bc36455bafd8eed23c68e733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:23.954142 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=100 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:00:23.959255 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-ffd79716-42a0-49ce-bafc-574f69148278 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] 10.222.0.26 "GET /compute/v2.1/servers/c9f0e1d2-6f87-485d-bff6-0ea83899b705" status: 200 len: 1258 microversion: 2.1 time: 0.318282 Oct 08 21:00:23.972692 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1084/2142] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:23 2022] GET /compute/v2.1/servers/c9f0e1d2-6f87-485d-bff6-0ea83899b705 => generated 1258 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:24.018435 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-8241ce67-a0f7-42ea-85f6-f66b6d9ec3f0 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '463a3aac627c43d7af0dbc9facb52076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac791938e6384c8c8473ffd65cf867a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:24.029766 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-8241ce67-a0f7-42ea-85f6-f66b6d9ec3f0 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] 10.222.0.26 "GET /compute/v2.1/servers/3622a27e-b943-49a7-8d81-a6f553c32f7a" status: 200 len: 1274 microversion: 2.1 time: 0.208555 Oct 08 21:00:24.030698 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1059/2143] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:23 2022] GET /compute/v2.1/servers/3622a27e-b943-49a7-8d81-a6f553c32f7a => generated 1274 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:24.365657 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-eb1c3db1-699b-45fb-a74f-206752b5f057 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:24.366858 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-eb1c3db1-699b-45fb-a74f-206752b5f057 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] [instance: 75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:24.379045 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-eb1c3db1-699b-45fb-a74f-206752b5f057 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:24.380195 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-eb1c3db1-699b-45fb-a74f-206752b5f057 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:24.381577 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-eb1c3db1-699b-45fb-a74f-206752b5f057 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:24.382981 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-eb1c3db1-699b-45fb-a74f-206752b5f057 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:24.383709 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-eb1c3db1-699b-45fb-a74f-206752b5f057 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:24.408403 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-eb1c3db1-699b-45fb-a74f-206752b5f057 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:24.669342 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-30353b10-989d-43e6-a050-3ce1b2848c6f tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:24.670150 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-30353b10-989d-43e6-a050-3ce1b2848c6f tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:24.693839 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-30353b10-989d-43e6-a050-3ce1b2848c6f tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:24.694369 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-30353b10-989d-43e6-a050-3ce1b2848c6f tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:24.694835 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-30353b10-989d-43e6-a050-3ce1b2848c6f tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:24.695590 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-30353b10-989d-43e6-a050-3ce1b2848c6f tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:24.703572 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-30353b10-989d-43e6-a050-3ce1b2848c6f tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:24.704190 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-30353b10-989d-43e6-a050-3ce1b2848c6f tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:24.885791 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-eb1c3db1-699b-45fb-a74f-206752b5f057 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1698dee4a2bf4ea19a6ee0c3d5cb5c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b00ee5e7828469f95bd90548d35982a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:24.897787 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-eb1c3db1-699b-45fb-a74f-206752b5f057 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] 10.222.0.26 "GET /compute/v2.1/servers/75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a" status: 200 len: 1521 microversion: 2.1 time: 0.539620 Oct 08 21:00:24.909212 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1085/2144] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:24 2022] GET /compute/v2.1/servers/75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a => generated 1521 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:24.909212 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-5d6ece60-2158-4f14-a1e7-7ef075718f0d tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:24.909212 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-5d6ece60-2158-4f14-a1e7-7ef075718f0d tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] [instance: 655205e7-8a06-4704-896a-75b68056749e] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:24.916558 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5d6ece60-2158-4f14-a1e7-7ef075718f0d tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:24.917216 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5d6ece60-2158-4f14-a1e7-7ef075718f0d tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:24.917804 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5d6ece60-2158-4f14-a1e7-7ef075718f0d tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:24.919695 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5d6ece60-2158-4f14-a1e7-7ef075718f0d tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:24.920662 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5d6ece60-2158-4f14-a1e7-7ef075718f0d tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:24.921991 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5d6ece60-2158-4f14-a1e7-7ef075718f0d tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:25.064354 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-30353b10-989d-43e6-a050-3ce1b2848c6f tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:25.074733 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-30353b10-989d-43e6-a050-3ce1b2848c6f tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd" status: 200 len: 1468 microversion: 2.1 time: 0.416688 Oct 08 21:00:25.077692 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1060/2145] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:24 2022] GET /compute/v2.1/servers/d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd => generated 1468 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:25.084447 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-44d442ce-faf2-4d7d-96a7-befa35ed5b9f tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:25.085394 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-44d442ce-faf2-4d7d-96a7-befa35ed5b9f tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] [instance: c9f0e1d2-6f87-485d-bff6-0ea83899b705] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:25.093479 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-44d442ce-faf2-4d7d-96a7-befa35ed5b9f tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:25.094324 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-44d442ce-faf2-4d7d-96a7-befa35ed5b9f tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:25.095038 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-44d442ce-faf2-4d7d-96a7-befa35ed5b9f tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:25.096055 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-44d442ce-faf2-4d7d-96a7-befa35ed5b9f tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:25.097314 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-44d442ce-faf2-4d7d-96a7-befa35ed5b9f tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:25.097993 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-44d442ce-faf2-4d7d-96a7-befa35ed5b9f tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:25.135192 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-44d442ce-faf2-4d7d-96a7-befa35ed5b9f tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:25.135707 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-44d442ce-faf2-4d7d-96a7-befa35ed5b9f tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:25.136337 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-44d442ce-faf2-4d7d-96a7-befa35ed5b9f tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:25.137097 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.objects.instance [None req-44d442ce-faf2-4d7d-96a7-befa35ed5b9f tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Lazy-loading 'fault' on Instance uuid c9f0e1d2-6f87-485d-bff6-0ea83899b705 {{(pid=140491) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 21:00:25.215381 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-44d442ce-faf2-4d7d-96a7-befa35ed5b9f tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d96135705514061bef9306753143357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82999f8bc36455bafd8eed23c68e733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:25.232783 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-44d442ce-faf2-4d7d-96a7-befa35ed5b9f tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] 10.222.0.26 "GET /compute/v2.1/servers/c9f0e1d2-6f87-485d-bff6-0ea83899b705" status: 200 len: 1258 microversion: 2.1 time: 0.153761 Oct 08 21:00:25.233865 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1061/2146] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:25 2022] GET /compute/v2.1/servers/c9f0e1d2-6f87-485d-bff6-0ea83899b705 => generated 1258 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:25.239498 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-305debdf-01f6-4c1e-befd-26eb60b3c5f4 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:25.240970 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-305debdf-01f6-4c1e-befd-26eb60b3c5f4 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] [instance: 3622a27e-b943-49a7-8d81-a6f553c32f7a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:25.248083 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-305debdf-01f6-4c1e-befd-26eb60b3c5f4 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:25.249479 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-305debdf-01f6-4c1e-befd-26eb60b3c5f4 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:25.250167 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-305debdf-01f6-4c1e-befd-26eb60b3c5f4 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:25.251243 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-305debdf-01f6-4c1e-befd-26eb60b3c5f4 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:25.252105 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-305debdf-01f6-4c1e-befd-26eb60b3c5f4 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:25.252820 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-305debdf-01f6-4c1e-befd-26eb60b3c5f4 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:25.325468 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-5d6ece60-2158-4f14-a1e7-7ef075718f0d tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ddc3cd3c374bacbe5bf5e0877380e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8472b054404c46a99b81aba34d6b9f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:25.341482 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-5d6ece60-2158-4f14-a1e7-7ef075718f0d tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] 10.222.0.26 "GET /compute/v2.1/servers/655205e7-8a06-4704-896a-75b68056749e" status: 200 len: 1464 microversion: 2.1 time: 0.440340 Oct 08 21:00:25.342428 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1086/2147] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:24 2022] GET /compute/v2.1/servers/655205e7-8a06-4704-896a-75b68056749e => generated 1464 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:25.359021 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-7e1b4d06-0a24-4106-a7de-1bb95c344b88 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:00:25.360072 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-7e1b4d06-0a24-4106-a7de-1bb95c344b88 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:25.367259 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7e1b4d06-0a24-4106-a7de-1bb95c344b88 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:25.369450 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7e1b4d06-0a24-4106-a7de-1bb95c344b88 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:25.370076 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7e1b4d06-0a24-4106-a7de-1bb95c344b88 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:25.372436 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7e1b4d06-0a24-4106-a7de-1bb95c344b88 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:25.373091 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7e1b4d06-0a24-4106-a7de-1bb95c344b88 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:25.377215 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7e1b4d06-0a24-4106-a7de-1bb95c344b88 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:25.424120 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-305debdf-01f6-4c1e-befd-26eb60b3c5f4 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '463a3aac627c43d7af0dbc9facb52076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac791938e6384c8c8473ffd65cf867a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:25.441770 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-305debdf-01f6-4c1e-befd-26eb60b3c5f4 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] 10.222.0.26 "GET /compute/v2.1/servers/3622a27e-b943-49a7-8d81-a6f553c32f7a" status: 200 len: 1280 microversion: 2.1 time: 0.204777 Oct 08 21:00:25.443844 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1062/2148] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:25 2022] GET /compute/v2.1/servers/3622a27e-b943-49a7-8d81-a6f553c32f7a => generated 1280 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:25.458496 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-664a8ab3-3672-46b6-ad4c-db54ab4ba957 tempest-ServersOnMultiNodesTest-429096361 tempest-ServersOnMultiNodesTest-429096361-project-admin] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:25.460389 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-664a8ab3-3672-46b6-ad4c-db54ab4ba957 tempest-ServersOnMultiNodesTest-429096361 tempest-ServersOnMultiNodesTest-429096361-project-admin] [instance: 655205e7-8a06-4704-896a-75b68056749e] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:25.474331 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-664a8ab3-3672-46b6-ad4c-db54ab4ba957 tempest-ServersOnMultiNodesTest-429096361 tempest-ServersOnMultiNodesTest-429096361-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:25.476846 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-664a8ab3-3672-46b6-ad4c-db54ab4ba957 tempest-ServersOnMultiNodesTest-429096361 tempest-ServersOnMultiNodesTest-429096361-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:25.477475 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-664a8ab3-3672-46b6-ad4c-db54ab4ba957 tempest-ServersOnMultiNodesTest-429096361 tempest-ServersOnMultiNodesTest-429096361-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:25.480150 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-664a8ab3-3672-46b6-ad4c-db54ab4ba957 tempest-ServersOnMultiNodesTest-429096361 tempest-ServersOnMultiNodesTest-429096361-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:25.480812 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-664a8ab3-3672-46b6-ad4c-db54ab4ba957 tempest-ServersOnMultiNodesTest-429096361 tempest-ServersOnMultiNodesTest-429096361-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:25.482517 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-664a8ab3-3672-46b6-ad4c-db54ab4ba957 tempest-ServersOnMultiNodesTest-429096361 tempest-ServersOnMultiNodesTest-429096361-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:25.552328 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-7e1b4d06-0a24-4106-a7de-1bb95c344b88 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "POST /compute/v2.1/servers/d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd/action" status: 204 len: 0 microversion: 2.1 time: 0.193379 Oct 08 21:00:25.557861 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1087/2149] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:00:25 2022] POST /compute/v2.1/servers/d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd/action => generated 0 bytes in 210 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 21:00:25.566661 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-058df9a1-ad58-4af2-b6c3-1b8a1748f925 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:25.568043 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-058df9a1-ad58-4af2-b6c3-1b8a1748f925 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:25.577051 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-058df9a1-ad58-4af2-b6c3-1b8a1748f925 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:25.578144 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-058df9a1-ad58-4af2-b6c3-1b8a1748f925 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:25.578990 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-058df9a1-ad58-4af2-b6c3-1b8a1748f925 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:25.580182 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-058df9a1-ad58-4af2-b6c3-1b8a1748f925 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:25.581125 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-058df9a1-ad58-4af2-b6c3-1b8a1748f925 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:25.582056 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-058df9a1-ad58-4af2-b6c3-1b8a1748f925 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:25.849774 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-058df9a1-ad58-4af2-b6c3-1b8a1748f925 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:25.859299 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-058df9a1-ad58-4af2-b6c3-1b8a1748f925 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd" status: 200 len: 1468 microversion: 2.1 time: 0.299861 Oct 08 21:00:25.860072 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1088/2150] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:25 2022] GET /compute/v2.1/servers/d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd => generated 1468 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:25.865099 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-f58ad2b7-78d9-4abc-8fa1-6c1069a31a1b tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-240076016", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:00:25.937598 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.network.neutron [None req-f58ad2b7-78d9-4abc-8fa1-6c1069a31a1b tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] validate_networks() for [('03b40f51-e6b4-4d4c-82cf-99e0f52c3cd5', None, None, None, None, None)] {{(pid=140492) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 21:00:25.975737 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-664a8ab3-3672-46b6-ad4c-db54ab4ba957 tempest-ServersOnMultiNodesTest-429096361 tempest-ServersOnMultiNodesTest-429096361-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/655205e7-8a06-4704-896a-75b68056749e" status: 200 len: 1615 microversion: 2.1 time: 0.530210 Oct 08 21:00:25.976601 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1063/2151] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:25 2022] GET /compute/v2.1/servers/655205e7-8a06-4704-896a-75b68056749e => generated 1615 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:25.982509 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-155fe3e8-cc9b-48e4-9b6c-3f0689eb31cb req-435b6c87-0d1e-465b-acdf-cfcd55c60ccf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4832d86f-ddee-445e-8b26-fae015d901a4", "tag": "b12b61d4-cc2a-4ad0-8a4c-e8c07da8ccb1"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:00:25.994552 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-155fe3e8-cc9b-48e4-9b6c-3f0689eb31cb req-435b6c87-0d1e-465b-acdf-cfcd55c60ccf service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:25.995373 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-155fe3e8-cc9b-48e4-9b6c-3f0689eb31cb req-435b6c87-0d1e-465b-acdf-cfcd55c60ccf service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:25.996036 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-155fe3e8-cc9b-48e4-9b6c-3f0689eb31cb req-435b6c87-0d1e-465b-acdf-cfcd55c60ccf service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:26.009586 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-155fe3e8-cc9b-48e4-9b6c-3f0689eb31cb req-435b6c87-0d1e-465b-acdf-cfcd55c60ccf service nova] Creating event network-changed:b12b61d4-cc2a-4ad0-8a4c-e8c07da8ccb1 for instance 4832d86f-ddee-445e-8b26-fae015d901a4 on nch2-master-1 Oct 08 21:00:26.015522 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-155fe3e8-cc9b-48e4-9b6c-3f0689eb31cb req-435b6c87-0d1e-465b-acdf-cfcd55c60ccf service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037165 Oct 08 21:00:26.016983 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1064/2152] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:00:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:00:26.022834 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-4bbd9ce3-3ffd-476b-865b-9373ba1b40ac tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:26.023858 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-4bbd9ce3-3ffd-476b-865b-9373ba1b40ac tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] [instance: 75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:26.032217 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4bbd9ce3-3ffd-476b-865b-9373ba1b40ac tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:26.032969 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4bbd9ce3-3ffd-476b-865b-9373ba1b40ac tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:26.033715 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4bbd9ce3-3ffd-476b-865b-9373ba1b40ac tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:26.034741 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4bbd9ce3-3ffd-476b-865b-9373ba1b40ac tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:26.035589 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4bbd9ce3-3ffd-476b-865b-9373ba1b40ac tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:26.036236 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4bbd9ce3-3ffd-476b-865b-9373ba1b40ac tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:26.680646 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-f58ad2b7-78d9-4abc-8fa1-6c1069a31a1b tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Flavor limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 21:00:26.681091 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-f58ad2b7-78d9-4abc-8fa1-6c1069a31a1b tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Image limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 21:00:26.681634 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-f58ad2b7-78d9-4abc-8fa1-6c1069a31a1b tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Flavor pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 21:00:26.682058 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-f58ad2b7-78d9-4abc-8fa1-6c1069a31a1b tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Image pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 21:00:26.682485 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-f58ad2b7-78d9-4abc-8fa1-6c1069a31a1b tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 21:00:26.692677 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f58ad2b7-78d9-4abc-8fa1-6c1069a31a1b tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:26.693378 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f58ad2b7-78d9-4abc-8fa1-6c1069a31a1b tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:26.694716 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f58ad2b7-78d9-4abc-8fa1-6c1069a31a1b tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:26.695657 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f58ad2b7-78d9-4abc-8fa1-6c1069a31a1b tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:26.696269 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f58ad2b7-78d9-4abc-8fa1-6c1069a31a1b tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:26.696970 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f58ad2b7-78d9-4abc-8fa1-6c1069a31a1b tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:26.717911 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-f58ad2b7-78d9-4abc-8fa1-6c1069a31a1b tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Getting quotas for project 76b10172715d423eb887d6c5b171defb. Resources: {'cores', 'instances', 'ram'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:00:26.727786 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-f58ad2b7-78d9-4abc-8fa1-6c1069a31a1b tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Getting quotas for user f06caf10b6fa43a3a2ad34858594e329 and project 76b10172715d423eb887d6c5b171defb. Resources: {'cores', 'instances', 'ram'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:00:26.743634 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-f58ad2b7-78d9-4abc-8fa1-6c1069a31a1b tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Going to run 1 instances... {{(pid=140492) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 21:00:26.746109 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-f58ad2b7-78d9-4abc-8fa1-6c1069a31a1b tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] [instance: a8b2f857-6c24-45fe-b934-cf92b2d18b7a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c508bd7f-7db9-4b2c-af7c-be54a855c355',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140492) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 21:00:26.806617 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-f58ad2b7-78d9-4abc-8fa1-6c1069a31a1b tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.943982 Oct 08 21:00:26.814818 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1089/2153] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 21:00:25 2022] POST /compute/v2.1/servers => generated 383 bytes in 947 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 08 21:00:26.816433 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-51146df3-69bc-487f-b8c5-4ba71d21fa27 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:26.817015 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-51146df3-69bc-487f-b8c5-4ba71d21fa27 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] [instance: 655205e7-8a06-4704-896a-75b68056749e] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:26.826322 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-51146df3-69bc-487f-b8c5-4ba71d21fa27 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:26.827107 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-51146df3-69bc-487f-b8c5-4ba71d21fa27 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:26.827713 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-51146df3-69bc-487f-b8c5-4ba71d21fa27 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:26.828647 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-51146df3-69bc-487f-b8c5-4ba71d21fa27 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:26.829289 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-51146df3-69bc-487f-b8c5-4ba71d21fa27 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:26.829877 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-51146df3-69bc-487f-b8c5-4ba71d21fa27 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:26.862389 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-51146df3-69bc-487f-b8c5-4ba71d21fa27 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] [instance: 655205e7-8a06-4704-896a-75b68056749e] Going to try to terminate instance {{(pid=140492) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 21:00:26.986868 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-51146df3-69bc-487f-b8c5-4ba71d21fa27 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] 10.222.0.26 "DELETE /compute/v2.1/servers/655205e7-8a06-4704-896a-75b68056749e" status: 204 len: 0 microversion: 2.1 time: 0.176685 Oct 08 21:00:26.988244 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1090/2154] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:00:26 2022] DELETE /compute/v2.1/servers/655205e7-8a06-4704-896a-75b68056749e => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 21:00:26.997405 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-2e01514a-7b49-47f2-be3a-a546e07b209f tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:26.999266 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-2e01514a-7b49-47f2-be3a-a546e07b209f tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] [instance: c9f0e1d2-6f87-485d-bff6-0ea83899b705] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:27.005988 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2e01514a-7b49-47f2-be3a-a546e07b209f tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:27.006564 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2e01514a-7b49-47f2-be3a-a546e07b209f tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:27.007065 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2e01514a-7b49-47f2-be3a-a546e07b209f tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:27.007789 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2e01514a-7b49-47f2-be3a-a546e07b209f tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:27.008263 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2e01514a-7b49-47f2-be3a-a546e07b209f tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:27.009090 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2e01514a-7b49-47f2-be3a-a546e07b209f tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:27.032553 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-2e01514a-7b49-47f2-be3a-a546e07b209f tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] HTTP exception thrown: Instance c9f0e1d2-6f87-485d-bff6-0ea83899b705 could not be found. Oct 08 21:00:27.034313 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-2e01514a-7b49-47f2-be3a-a546e07b209f tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Request method failure captured: Oct 08 21:00:27.034313 ncdv-master-1 devstack@n-api.service[140492]: request: GET /compute/v2.1/servers/c9f0e1d2-6f87-485d-bff6-0ea83899b705 HTTP/1.1 Oct 08 21:00:27.034313 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:00:27.034313 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:00:27.034313 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:00:27.034313 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 21:00:27.034313 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:00:27.034313 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:00:27.034313 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:00:27.034313 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:00:27.034313 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeR1NcY1lcKgvuSgf7QHch8gxlhdbw7VUJasp3tsrtII6DNMHkfwOAREvqfNcA0EJa-CSINSySeM20GHbEEt2rEKiMc94B-IkxxnEuJ3R3of0ftCR7e5ZwZPRBBy0zIqaSZ8HfGFJYdHgB4CpjdmQdBoLX2VaOexFjD1sct-Zkkr7qk Oct 08 21:00:27.034313 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:00:27.034313 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:00:27.034313 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:00:27.034313 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:00:27.034313 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:00:27.034313 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:00:27.034313 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: a82999f8bc36455bafd8eed23c68e733 Oct 08 21:00:27.034313 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-ServersTestBootFromVolume-2114207729 Oct 08 21:00:27.034313 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:00:27.034313 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:00:27.034313 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/a82999f8bc36455bafd8eed23c68e733"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a82999f8bc36455bafd8eed23c68e733"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_a82999f8bc36455bafd8eed23c68e733"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a82999f8bc36455bafd8eed23c68e733"}]}] Oct 08 21:00:27.034313 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-ServersTestBootFromVolume-2114207729 Oct 08 21:00:27.034313 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: a82999f8bc36455bafd8eed23c68e733 Oct 08 21:00:27.034313 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-ServersTestBootFromVolume-2114207729 Oct 08 21:00:27.034313 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-ServersTestBootFromVolume-2114207729-project Oct 08 21:00:27.034313 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:00:27.034313 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:00:27.034313 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 3d96135705514061bef9306753143357 Oct 08 21:00:27.034313 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-ServersTestBootFromVolume-2114207729-project Oct 08 21:00:27.034313 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 21:00:27.034313 ncdv-master-1 devstack@n-api.service[140492]: exception: Instance c9f0e1d2-6f87-485d-bff6-0ea83899b705 could not be found. Oct 08 21:00:27.034313 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': 'c9f0e1d2-6f87-485d-bff6-0ea83899b705'} Oct 08 21:00:27.034313 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:00:27.034313 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:00:27.034313 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:00:27.034313 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:00:27.034313 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:00:27.034313 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:00:27.034313 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:00:27.034313 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:00:27.034313 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:00:27.034313 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:00:27.034313 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9f0e1d2-6f87-485d-bff6-0ea83899b705 could not be found. Oct 08 21:00:27.034313 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:00:27.034313 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:00:27.034313 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:00:27.034313 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:00:27.034313 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:00:27.034313 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:00:27.034313 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:00:27.034313 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:00:27.034313 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:00:27.034313 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:00:27.034313 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:00:27.034313 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:00:27.034313 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:00:27.034313 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:00:27.034313 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:00:27.034313 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:00:27.034313 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9f0e1d2-6f87-485d-bff6-0ea83899b705 could not be found. Oct 08 21:00:27.034313 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:00:27.034313 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:00:27.034313 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:00:27.037638 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:00:27.037638 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:00:27.037638 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:00:27.037638 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:00:27.037638 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:00:27.037638 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9f0e1d2-6f87-485d-bff6-0ea83899b705 could not be found. Oct 08 21:00:27.037638 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:00:27.037638 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-2e01514a-7b49-47f2-be3a-a546e07b209f tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Returning 404 to user: Instance c9f0e1d2-6f87-485d-bff6-0ea83899b705 could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:00:27.037638 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-2e01514a-7b49-47f2-be3a-a546e07b209f tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] 10.222.0.26 "GET /compute/v2.1/servers/c9f0e1d2-6f87-485d-bff6-0ea83899b705" status: 404 len: 111 microversion: 2.1 time: 0.046025 Oct 08 21:00:27.037638 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1091/2155] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:26 2022] GET /compute/v2.1/servers/c9f0e1d2-6f87-485d-bff6-0ea83899b705 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:00:27.041890 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-7e69e944-8726-4102-a1dd-b53547f531ec tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:27.042518 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-7e69e944-8726-4102-a1dd-b53547f531ec tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] [instance: 3622a27e-b943-49a7-8d81-a6f553c32f7a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:27.055527 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7e69e944-8726-4102-a1dd-b53547f531ec tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:27.056048 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7e69e944-8726-4102-a1dd-b53547f531ec tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:27.061676 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7e69e944-8726-4102-a1dd-b53547f531ec tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:27.062516 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7e69e944-8726-4102-a1dd-b53547f531ec tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:27.063388 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7e69e944-8726-4102-a1dd-b53547f531ec tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:27.063605 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7e69e944-8726-4102-a1dd-b53547f531ec tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:27.182618 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-4bbd9ce3-3ffd-476b-865b-9373ba1b40ac tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1698dee4a2bf4ea19a6ee0c3d5cb5c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b00ee5e7828469f95bd90548d35982a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:27.201637 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-4bbd9ce3-3ffd-476b-865b-9373ba1b40ac tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] 10.222.0.26 "GET /compute/v2.1/servers/75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a" status: 200 len: 1521 microversion: 2.1 time: 1.183125 Oct 08 21:00:27.202386 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1065/2156] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:26 2022] GET /compute/v2.1/servers/75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a => generated 1521 bytes in 1185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:27.216173 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-7e69e944-8726-4102-a1dd-b53547f531ec tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '463a3aac627c43d7af0dbc9facb52076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac791938e6384c8c8473ffd65cf867a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:27.216680 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-320567d8-1815-455e-82fe-a3dbcbcd043d req-f957c0b2-a909-4e7f-a440-b9213bda461b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd", "name": "network-vif-plugged", "status": "completed", "tag": "1e8ee887-8012-4f64-a840-73388344bd23"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:00:27.228726 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-7e69e944-8726-4102-a1dd-b53547f531ec tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] 10.222.0.26 "GET /compute/v2.1/servers/3622a27e-b943-49a7-8d81-a6f553c32f7a" status: 200 len: 1322 microversion: 2.1 time: 0.190845 Oct 08 21:00:27.228888 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-320567d8-1815-455e-82fe-a3dbcbcd043d req-f957c0b2-a909-4e7f-a440-b9213bda461b service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:27.229331 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-320567d8-1815-455e-82fe-a3dbcbcd043d req-f957c0b2-a909-4e7f-a440-b9213bda461b service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:27.230199 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-320567d8-1815-455e-82fe-a3dbcbcd043d req-f957c0b2-a909-4e7f-a440-b9213bda461b service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:27.241709 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1092/2157] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:27 2022] GET /compute/v2.1/servers/3622a27e-b943-49a7-8d81-a6f553c32f7a => generated 1322 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:27.241709 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-370c04b8-6b87-4382-8312-4cf569458400 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:27.241709 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-370c04b8-6b87-4382-8312-4cf569458400 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] [instance: a8b2f857-6c24-45fe-b934-cf92b2d18b7a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:27.261121 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-320567d8-1815-455e-82fe-a3dbcbcd043d req-f957c0b2-a909-4e7f-a440-b9213bda461b service nova] Creating event network-vif-plugged:1e8ee887-8012-4f64-a840-73388344bd23 for instance d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd on nch1-master-1 Oct 08 21:00:27.270233 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [req-320567d8-1815-455e-82fe-a3dbcbcd043d req-f957c0b2-a909-4e7f-a440-b9213bda461b service nova] Instance d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140491) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 08 21:00:27.283396 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-320567d8-1815-455e-82fe-a3dbcbcd043d req-f957c0b2-a909-4e7f-a440-b9213bda461b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079515 Oct 08 21:00:27.288579 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1066/2158] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:00:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:00:27.295361 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-69f403cd-9613-416b-9d51-69fd08d5649b tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:27.296337 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-69f403cd-9613-416b-9d51-69fd08d5649b tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:27.304148 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-69f403cd-9613-416b-9d51-69fd08d5649b tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:27.304868 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-69f403cd-9613-416b-9d51-69fd08d5649b tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:27.305533 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-69f403cd-9613-416b-9d51-69fd08d5649b tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:27.306469 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-69f403cd-9613-416b-9d51-69fd08d5649b tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:27.307079 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-69f403cd-9613-416b-9d51-69fd08d5649b tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:27.307700 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-69f403cd-9613-416b-9d51-69fd08d5649b tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:27.392668 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-370c04b8-6b87-4382-8312-4cf569458400 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06caf10b6fa43a3a2ad34858594e329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b10172715d423eb887d6c5b171defb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:27.400330 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-370c04b8-6b87-4382-8312-4cf569458400 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] 10.222.0.26 "GET /compute/v2.1/servers/a8b2f857-6c24-45fe-b934-cf92b2d18b7a" status: 200 len: 1224 microversion: 2.1 time: 0.167800 Oct 08 21:00:27.417784 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1093/2159] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:27 2022] GET /compute/v2.1/servers/a8b2f857-6c24-45fe-b934-cf92b2d18b7a => generated 1224 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:27.423782 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-05bd91b2-8e90-4af1-9d03-9951dc15fd35 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:27.424318 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-05bd91b2-8e90-4af1-9d03-9951dc15fd35 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] [instance: 655205e7-8a06-4704-896a-75b68056749e] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:27.430612 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-05bd91b2-8e90-4af1-9d03-9951dc15fd35 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:27.431202 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-05bd91b2-8e90-4af1-9d03-9951dc15fd35 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:27.431723 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-05bd91b2-8e90-4af1-9d03-9951dc15fd35 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:27.433100 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-05bd91b2-8e90-4af1-9d03-9951dc15fd35 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:27.433100 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-05bd91b2-8e90-4af1-9d03-9951dc15fd35 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:27.434010 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-05bd91b2-8e90-4af1-9d03-9951dc15fd35 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:27.623777 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-69f403cd-9613-416b-9d51-69fd08d5649b tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:27.632009 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-69f403cd-9613-416b-9d51-69fd08d5649b tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd" status: 200 len: 1468 microversion: 2.1 time: 0.341728 Oct 08 21:00:27.648885 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1067/2160] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:27 2022] GET /compute/v2.1/servers/d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd => generated 1468 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:27.655383 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-067b2513-aedd-4fc1-8336-a3fbd06721b4 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] Calling method '.version_select at 0x7f1a913665e0>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:27.664479 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=4 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:00:27.690279 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-05bd91b2-8e90-4af1-9d03-9951dc15fd35 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ddc3cd3c374bacbe5bf5e0877380e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8472b054404c46a99b81aba34d6b9f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:27.699055 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-067b2513-aedd-4fc1-8336-a3fbd06721b4 tempest-ServersTestBootFromVolume-2114207729 tempest-ServersTestBootFromVolume-2114207729-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1569579173" status: 202 len: 0 microversion: 2.1 time: 0.048293 Oct 08 21:00:27.701027 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1068/2161] 10.222.0.26 () {58 vars in 1221 bytes} [Sat Oct 8 21:00:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1569579173 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 21:00:27.702691 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-05bd91b2-8e90-4af1-9d03-9951dc15fd35 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] 10.222.0.26 "GET /compute/v2.1/servers/655205e7-8a06-4704-896a-75b68056749e" status: 200 len: 1470 microversion: 2.1 time: 0.282883 Oct 08 21:00:27.736811 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1094/2162] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:27 2022] GET /compute/v2.1/servers/655205e7-8a06-4704-896a-75b68056749e => generated 1470 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:27.820030 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-0aa19971-5201-4a51-9310-4b9fe99ca16b req-0e19daf3-57b1-487c-a765-241c95954129 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d02ba7e0-a550-4e8e-a3ab-37ed519e22b0", "tag": "b0bda0a3-50c5-4910-8348-ff8c20ea254b"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:00:27.831768 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-0aa19971-5201-4a51-9310-4b9fe99ca16b req-0e19daf3-57b1-487c-a765-241c95954129 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:27.831911 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-0aa19971-5201-4a51-9310-4b9fe99ca16b req-0e19daf3-57b1-487c-a765-241c95954129 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:27.832414 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-0aa19971-5201-4a51-9310-4b9fe99ca16b req-0e19daf3-57b1-487c-a765-241c95954129 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:27.843814 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-0aa19971-5201-4a51-9310-4b9fe99ca16b req-0e19daf3-57b1-487c-a765-241c95954129 service nova] Creating event network-changed:b0bda0a3-50c5-4910-8348-ff8c20ea254b for instance d02ba7e0-a550-4e8e-a3ab-37ed519e22b0 on nch1-master-1 Oct 08 21:00:27.848792 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-0aa19971-5201-4a51-9310-4b9fe99ca16b req-0e19daf3-57b1-487c-a765-241c95954129 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033463 Oct 08 21:00:27.849640 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1069/2163] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:00:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:00:28.227172 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e068b8bb-c7cd-4254-abd1-55bd28a2cd21 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:28.227913 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-e068b8bb-c7cd-4254-abd1-55bd28a2cd21 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] [instance: 75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:28.235670 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e068b8bb-c7cd-4254-abd1-55bd28a2cd21 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:28.236227 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e068b8bb-c7cd-4254-abd1-55bd28a2cd21 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:28.236753 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e068b8bb-c7cd-4254-abd1-55bd28a2cd21 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:28.237593 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e068b8bb-c7cd-4254-abd1-55bd28a2cd21 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:28.238140 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e068b8bb-c7cd-4254-abd1-55bd28a2cd21 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:28.238650 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e068b8bb-c7cd-4254-abd1-55bd28a2cd21 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:28.257465 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-4ce7bc30-2c2f-419e-9cca-7513d6a51d53 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:28.261726 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-4ce7bc30-2c2f-419e-9cca-7513d6a51d53 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] [instance: 3622a27e-b943-49a7-8d81-a6f553c32f7a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:28.269692 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4ce7bc30-2c2f-419e-9cca-7513d6a51d53 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:28.270184 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4ce7bc30-2c2f-419e-9cca-7513d6a51d53 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:28.270803 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4ce7bc30-2c2f-419e-9cca-7513d6a51d53 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:28.271522 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4ce7bc30-2c2f-419e-9cca-7513d6a51d53 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:28.271989 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4ce7bc30-2c2f-419e-9cca-7513d6a51d53 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:28.272424 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4ce7bc30-2c2f-419e-9cca-7513d6a51d53 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:28.389658 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-e068b8bb-c7cd-4254-abd1-55bd28a2cd21 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1698dee4a2bf4ea19a6ee0c3d5cb5c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b00ee5e7828469f95bd90548d35982a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:28.401689 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-e068b8bb-c7cd-4254-abd1-55bd28a2cd21 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] 10.222.0.26 "GET /compute/v2.1/servers/75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a" status: 200 len: 1521 microversion: 2.1 time: 0.178541 Oct 08 21:00:28.402296 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1095/2164] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:28 2022] GET /compute/v2.1/servers/75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:28.424221 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-46d50e87-025c-4f0a-82de-c518ee9f1cf5 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:28.424987 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-46d50e87-025c-4f0a-82de-c518ee9f1cf5 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] [instance: a8b2f857-6c24-45fe-b934-cf92b2d18b7a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:28.431185 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-46d50e87-025c-4f0a-82de-c518ee9f1cf5 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:28.431696 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-46d50e87-025c-4f0a-82de-c518ee9f1cf5 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:28.432200 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-46d50e87-025c-4f0a-82de-c518ee9f1cf5 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:28.432950 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-46d50e87-025c-4f0a-82de-c518ee9f1cf5 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:28.433742 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-46d50e87-025c-4f0a-82de-c518ee9f1cf5 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:28.434241 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-46d50e87-025c-4f0a-82de-c518ee9f1cf5 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:28.534728 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-46d50e87-025c-4f0a-82de-c518ee9f1cf5 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06caf10b6fa43a3a2ad34858594e329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b10172715d423eb887d6c5b171defb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:28.543370 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-46d50e87-025c-4f0a-82de-c518ee9f1cf5 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] 10.222.0.26 "GET /compute/v2.1/servers/a8b2f857-6c24-45fe-b934-cf92b2d18b7a" status: 200 len: 1276 microversion: 2.1 time: 0.122917 Oct 08 21:00:28.544937 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1096/2165] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:28 2022] GET /compute/v2.1/servers/a8b2f857-6c24-45fe-b934-cf92b2d18b7a => generated 1276 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:00:28.656044 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-6fd24131-5331-496b-89c5-770409e2a881 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:28.656880 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-6fd24131-5331-496b-89c5-770409e2a881 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:28.664462 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6fd24131-5331-496b-89c5-770409e2a881 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:28.665168 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6fd24131-5331-496b-89c5-770409e2a881 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:28.666081 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6fd24131-5331-496b-89c5-770409e2a881 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:28.667112 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6fd24131-5331-496b-89c5-770409e2a881 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:28.667677 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6fd24131-5331-496b-89c5-770409e2a881 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:28.669148 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6fd24131-5331-496b-89c5-770409e2a881 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:28.811415 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-4ce7bc30-2c2f-419e-9cca-7513d6a51d53 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '463a3aac627c43d7af0dbc9facb52076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac791938e6384c8c8473ffd65cf867a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:28.820343 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-4ce7bc30-2c2f-419e-9cca-7513d6a51d53 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] 10.222.0.26 "GET /compute/v2.1/servers/3622a27e-b943-49a7-8d81-a6f553c32f7a" status: 200 len: 1322 microversion: 2.1 time: 0.567663 Oct 08 21:00:28.821053 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1070/2166] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:28 2022] GET /compute/v2.1/servers/3622a27e-b943-49a7-8d81-a6f553c32f7a => generated 1322 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:28.832293 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-101a85a4-9201-4bc4-8e34-b5122fd72fa7 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:28.833442 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-101a85a4-9201-4bc4-8e34-b5122fd72fa7 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] [instance: 655205e7-8a06-4704-896a-75b68056749e] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:28.841035 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-101a85a4-9201-4bc4-8e34-b5122fd72fa7 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:28.841744 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-101a85a4-9201-4bc4-8e34-b5122fd72fa7 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:28.842322 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-101a85a4-9201-4bc4-8e34-b5122fd72fa7 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:28.843175 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-101a85a4-9201-4bc4-8e34-b5122fd72fa7 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:28.843730 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-101a85a4-9201-4bc4-8e34-b5122fd72fa7 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:28.844446 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-101a85a4-9201-4bc4-8e34-b5122fd72fa7 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:29.199476 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-6fd24131-5331-496b-89c5-770409e2a881 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:29.213979 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-6fd24131-5331-496b-89c5-770409e2a881 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd" status: 200 len: 1468 microversion: 2.1 time: 0.561869 Oct 08 21:00:29.229934 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1097/2167] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:28 2022] GET /compute/v2.1/servers/d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd => generated 1468 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:00:29.425869 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-b2ed6ba0-2a11-4798-a3e1-56a246a93168 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:29.426491 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-b2ed6ba0-2a11-4798-a3e1-56a246a93168 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] [instance: 75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:29.436844 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b2ed6ba0-2a11-4798-a3e1-56a246a93168 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:29.437375 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b2ed6ba0-2a11-4798-a3e1-56a246a93168 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:29.437826 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b2ed6ba0-2a11-4798-a3e1-56a246a93168 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:29.438549 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b2ed6ba0-2a11-4798-a3e1-56a246a93168 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:29.439017 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b2ed6ba0-2a11-4798-a3e1-56a246a93168 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:29.439448 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b2ed6ba0-2a11-4798-a3e1-56a246a93168 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:29.679365 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-b2ed6ba0-2a11-4798-a3e1-56a246a93168 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1698dee4a2bf4ea19a6ee0c3d5cb5c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b00ee5e7828469f95bd90548d35982a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:29.694690 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-b2ed6ba0-2a11-4798-a3e1-56a246a93168 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] 10.222.0.26 "GET /compute/v2.1/servers/75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a" status: 200 len: 1521 microversion: 2.1 time: 0.272570 Oct 08 21:00:29.708698 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1098/2168] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:29 2022] GET /compute/v2.1/servers/75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a => generated 1521 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:00:29.726359 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-761a678a-faa3-4a00-8508-73326605f6a3 req-8af77d68-c19e-4c0a-b4a9-7f372b96b4fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "655205e7-8a06-4704-896a-75b68056749e", "name": "network-vif-deleted", "tag": "c815fb44-5023-410d-ae98-5c8ae72635bc"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:00:29.755150 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-761a678a-faa3-4a00-8508-73326605f6a3 req-8af77d68-c19e-4c0a-b4a9-7f372b96b4fc service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:29.756622 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-761a678a-faa3-4a00-8508-73326605f6a3 req-8af77d68-c19e-4c0a-b4a9-7f372b96b4fc service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:29.758491 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-761a678a-faa3-4a00-8508-73326605f6a3 req-8af77d68-c19e-4c0a-b4a9-7f372b96b4fc service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:29.786100 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-761a678a-faa3-4a00-8508-73326605f6a3 req-8af77d68-c19e-4c0a-b4a9-7f372b96b4fc service nova] Creating event network-vif-deleted:c815fb44-5023-410d-ae98-5c8ae72635bc for instance 655205e7-8a06-4704-896a-75b68056749e on nch1-master-1 Oct 08 21:00:29.800153 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-761a678a-faa3-4a00-8508-73326605f6a3 req-8af77d68-c19e-4c0a-b4a9-7f372b96b4fc service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089573 Oct 08 21:00:29.802293 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1099/2169] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:00:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:00:29.815959 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-5f2faf29-9da8-4ff3-a06c-4a664e7a53c6 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:29.816881 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-5f2faf29-9da8-4ff3-a06c-4a664e7a53c6 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] [instance: a8b2f857-6c24-45fe-b934-cf92b2d18b7a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:29.830332 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5f2faf29-9da8-4ff3-a06c-4a664e7a53c6 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:29.830844 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5f2faf29-9da8-4ff3-a06c-4a664e7a53c6 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:29.831299 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5f2faf29-9da8-4ff3-a06c-4a664e7a53c6 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:29.832027 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5f2faf29-9da8-4ff3-a06c-4a664e7a53c6 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:29.832497 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5f2faf29-9da8-4ff3-a06c-4a664e7a53c6 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:29.832935 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5f2faf29-9da8-4ff3-a06c-4a664e7a53c6 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:29.919796 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-101a85a4-9201-4bc4-8e34-b5122fd72fa7 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ddc3cd3c374bacbe5bf5e0877380e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8472b054404c46a99b81aba34d6b9f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:29.941905 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-101a85a4-9201-4bc4-8e34-b5122fd72fa7 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] 10.222.0.26 "GET /compute/v2.1/servers/655205e7-8a06-4704-896a-75b68056749e" status: 200 len: 1470 microversion: 2.1 time: 1.114524 Oct 08 21:00:29.942682 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1071/2170] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:28 2022] GET /compute/v2.1/servers/655205e7-8a06-4704-896a-75b68056749e => generated 1470 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:29.951545 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-2c49aeac-dcaf-4fe9-9fc4-63272a04a71d tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:29.952341 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-2c49aeac-dcaf-4fe9-9fc4-63272a04a71d tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] [instance: 3622a27e-b943-49a7-8d81-a6f553c32f7a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:29.971191 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2c49aeac-dcaf-4fe9-9fc4-63272a04a71d tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:29.971694 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2c49aeac-dcaf-4fe9-9fc4-63272a04a71d tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:29.972151 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2c49aeac-dcaf-4fe9-9fc4-63272a04a71d tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:29.972867 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2c49aeac-dcaf-4fe9-9fc4-63272a04a71d tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:29.978431 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2c49aeac-dcaf-4fe9-9fc4-63272a04a71d tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:29.979265 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2c49aeac-dcaf-4fe9-9fc4-63272a04a71d tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:30.049636 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-5f2faf29-9da8-4ff3-a06c-4a664e7a53c6 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06caf10b6fa43a3a2ad34858594e329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b10172715d423eb887d6c5b171defb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:30.060792 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-5f2faf29-9da8-4ff3-a06c-4a664e7a53c6 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] 10.222.0.26 "GET /compute/v2.1/servers/a8b2f857-6c24-45fe-b934-cf92b2d18b7a" status: 200 len: 1294 microversion: 2.1 time: 0.257219 Oct 08 21:00:30.081941 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1100/2171] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:29 2022] GET /compute/v2.1/servers/a8b2f857-6c24-45fe-b934-cf92b2d18b7a => generated 1294 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:30.241971 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-c8045f8a-cfa6-49bc-96fd-5f776a4080a2 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:30.246499 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-c8045f8a-cfa6-49bc-96fd-5f776a4080a2 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:30.259360 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c8045f8a-cfa6-49bc-96fd-5f776a4080a2 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:30.261747 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c8045f8a-cfa6-49bc-96fd-5f776a4080a2 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:30.262368 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c8045f8a-cfa6-49bc-96fd-5f776a4080a2 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:30.263124 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c8045f8a-cfa6-49bc-96fd-5f776a4080a2 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:30.263901 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c8045f8a-cfa6-49bc-96fd-5f776a4080a2 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:30.264234 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c8045f8a-cfa6-49bc-96fd-5f776a4080a2 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:30.290565 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:00:30.519983 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-c8045f8a-cfa6-49bc-96fd-5f776a4080a2 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:30.553657 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-c8045f8a-cfa6-49bc-96fd-5f776a4080a2 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd" status: 200 len: 1468 microversion: 2.1 time: 0.317759 Oct 08 21:00:30.560731 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1101/2172] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:30 2022] GET /compute/v2.1/servers/d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd => generated 1468 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:00:30.685645 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-2c49aeac-dcaf-4fe9-9fc4-63272a04a71d tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '463a3aac627c43d7af0dbc9facb52076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac791938e6384c8c8473ffd65cf867a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:30.694389 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-2c49aeac-dcaf-4fe9-9fc4-63272a04a71d tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] 10.222.0.26 "GET /compute/v2.1/servers/3622a27e-b943-49a7-8d81-a6f553c32f7a" status: 200 len: 1322 microversion: 2.1 time: 0.749872 Oct 08 21:00:30.696893 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1072/2173] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:29 2022] GET /compute/v2.1/servers/3622a27e-b943-49a7-8d81-a6f553c32f7a => generated 1322 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:30.724842 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-8046a09d-52fb-4e2e-90f0-930643695397 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:30.726417 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-8046a09d-52fb-4e2e-90f0-930643695397 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] [instance: 75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:30.732978 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:00:30.746094 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8046a09d-52fb-4e2e-90f0-930643695397 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:30.746815 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8046a09d-52fb-4e2e-90f0-930643695397 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:30.748030 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8046a09d-52fb-4e2e-90f0-930643695397 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:30.749009 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8046a09d-52fb-4e2e-90f0-930643695397 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:30.751491 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8046a09d-52fb-4e2e-90f0-930643695397 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:30.752354 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8046a09d-52fb-4e2e-90f0-930643695397 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:30.969875 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-437c841c-8164-4f96-8847-db6fb462f966 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:30.971221 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-437c841c-8164-4f96-8847-db6fb462f966 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] [instance: 655205e7-8a06-4704-896a-75b68056749e] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:30.980182 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=12 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:00:30.982292 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-437c841c-8164-4f96-8847-db6fb462f966 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:30.984152 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-437c841c-8164-4f96-8847-db6fb462f966 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:30.985471 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-437c841c-8164-4f96-8847-db6fb462f966 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:30.986549 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-437c841c-8164-4f96-8847-db6fb462f966 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:30.987802 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-437c841c-8164-4f96-8847-db6fb462f966 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:30.988455 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-437c841c-8164-4f96-8847-db6fb462f966 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:31.013090 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-437c841c-8164-4f96-8847-db6fb462f966 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] HTTP exception thrown: Instance 655205e7-8a06-4704-896a-75b68056749e could not be found. Oct 08 21:00:31.016349 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-437c841c-8164-4f96-8847-db6fb462f966 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Request method failure captured: Oct 08 21:00:31.016349 ncdv-master-1 devstack@n-api.service[140491]: request: GET /compute/v2.1/servers/655205e7-8a06-4704-896a-75b68056749e HTTP/1.1 Oct 08 21:00:31.016349 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:00:31.016349 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:00:31.016349 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:00:31.016349 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 21:00:31.016349 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:00:31.016349 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:00:31.016349 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:00:31.016349 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:00:31.016349 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeRR295mmmZhL7rSOgfacjSsWQ1Ti3FYd30sypy6B-ALaT7WOeiqaScllnDYtpa4eJ1mjmv4WUyVTLu5zt1pdJiZcKAFWv_GnEIqR6TqCn43v4gEmVWskuydtSKspT0UK00dWYkPU4ZM4UBd8cYd3myAyAfY7HLwKtG1LqfYrCLqzow Oct 08 21:00:31.016349 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:00:31.016349 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:00:31.016349 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:00:31.016349 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:00:31.016349 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:00:31.016349 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:00:31.016349 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 8472b054404c46a99b81aba34d6b9f40 Oct 08 21:00:31.016349 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-ServersOnMultiNodesTest-2078873751 Oct 08 21:00:31.016349 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:00:31.016349 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:00:31.016349 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8472b054404c46a99b81aba34d6b9f40"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8472b054404c46a99b81aba34d6b9f40"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8472b054404c46a99b81aba34d6b9f40"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8472b054404c46a99b81aba34d6b9f40"}]}] Oct 08 21:00:31.016349 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-ServersOnMultiNodesTest-2078873751 Oct 08 21:00:31.016349 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 8472b054404c46a99b81aba34d6b9f40 Oct 08 21:00:31.016349 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-2078873751 Oct 08 21:00:31.016349 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-ServersOnMultiNodesTest-2078873751-project Oct 08 21:00:31.016349 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:00:31.016349 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:00:31.016349 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 67ddc3cd3c374bacbe5bf5e0877380e2 Oct 08 21:00:31.016349 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-ServersOnMultiNodesTest-2078873751-project Oct 08 21:00:31.016349 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:00:31.016349 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance 655205e7-8a06-4704-896a-75b68056749e could not be found. Oct 08 21:00:31.016349 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': '655205e7-8a06-4704-896a-75b68056749e'} Oct 08 21:00:31.016349 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:00:31.016349 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:00:31.016349 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:00:31.016349 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:00:31.016349 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:00:31.016349 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:00:31.016349 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:00:31.016349 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:00:31.016349 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:00:31.016349 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:00:31.016349 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 655205e7-8a06-4704-896a-75b68056749e could not be found. Oct 08 21:00:31.016349 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:00:31.016349 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:00:31.016349 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:00:31.016349 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:00:31.016349 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:00:31.016349 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:00:31.016349 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:00:31.016349 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:00:31.016349 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:00:31.016349 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:00:31.016349 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:00:31.016349 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:00:31.016349 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:00:31.016349 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:00:31.016349 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:00:31.016349 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:00:31.016349 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 655205e7-8a06-4704-896a-75b68056749e could not be found. Oct 08 21:00:31.016349 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:00:31.016349 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:00:31.016349 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:00:31.020062 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:00:31.020062 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:00:31.020062 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:00:31.020062 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:00:31.020062 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:00:31.020062 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 655205e7-8a06-4704-896a-75b68056749e could not be found. Oct 08 21:00:31.020062 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:00:31.021859 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-437c841c-8164-4f96-8847-db6fb462f966 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Returning 404 to user: Instance 655205e7-8a06-4704-896a-75b68056749e could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:00:31.023626 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-437c841c-8164-4f96-8847-db6fb462f966 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] 10.222.0.26 "GET /compute/v2.1/servers/655205e7-8a06-4704-896a-75b68056749e" status: 404 len: 111 microversion: 2.1 time: 0.058881 Oct 08 21:00:31.025424 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1073/2174] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:30 2022] GET /compute/v2.1/servers/655205e7-8a06-4704-896a-75b68056749e => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:00:31.027284 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-8046a09d-52fb-4e2e-90f0-930643695397 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1698dee4a2bf4ea19a6ee0c3d5cb5c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b00ee5e7828469f95bd90548d35982a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:31.036008 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-330577f6-20f8-4172-bd75-d876c5d9408a tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:31.036595 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-330577f6-20f8-4172-bd75-d876c5d9408a tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] [instance: ace99763-e046-4fb7-b944-9fd25a2205f2] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:31.039899 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=10,nova_api:DELETE=1 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:00:31.040996 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-8046a09d-52fb-4e2e-90f0-930643695397 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] 10.222.0.26 "GET /compute/v2.1/servers/75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a" status: 200 len: 1521 microversion: 2.1 time: 0.322137 Oct 08 21:00:31.043142 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1102/2175] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:30 2022] GET /compute/v2.1/servers/75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a => generated 1521 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:31.052522 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-330577f6-20f8-4172-bd75-d876c5d9408a tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:31.053114 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-330577f6-20f8-4172-bd75-d876c5d9408a tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:31.053606 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-330577f6-20f8-4172-bd75-d876c5d9408a tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:31.056183 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-330577f6-20f8-4172-bd75-d876c5d9408a tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:31.056658 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-330577f6-20f8-4172-bd75-d876c5d9408a tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:31.057110 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-330577f6-20f8-4172-bd75-d876c5d9408a tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:31.093342 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-330577f6-20f8-4172-bd75-d876c5d9408a tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] [instance: ace99763-e046-4fb7-b944-9fd25a2205f2] Going to try to terminate instance {{(pid=140491) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 21:00:31.093827 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-cb034507-2705-4b1e-ada6-3eaff6f66ac5 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:31.094915 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-cb034507-2705-4b1e-ada6-3eaff6f66ac5 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] [instance: a8b2f857-6c24-45fe-b934-cf92b2d18b7a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:31.111429 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cb034507-2705-4b1e-ada6-3eaff6f66ac5 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:31.112036 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cb034507-2705-4b1e-ada6-3eaff6f66ac5 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:31.112467 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cb034507-2705-4b1e-ada6-3eaff6f66ac5 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:31.115448 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cb034507-2705-4b1e-ada6-3eaff6f66ac5 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:31.118013 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cb034507-2705-4b1e-ada6-3eaff6f66ac5 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:31.118715 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cb034507-2705-4b1e-ada6-3eaff6f66ac5 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:31.166029 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:00:31.244533 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-330577f6-20f8-4172-bd75-d876c5d9408a tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] 10.222.0.26 "DELETE /compute/v2.1/servers/ace99763-e046-4fb7-b944-9fd25a2205f2" status: 204 len: 0 microversion: 2.1 time: 0.213956 Oct 08 21:00:31.245617 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1074/2176] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:00:31 2022] DELETE /compute/v2.1/servers/ace99763-e046-4fb7-b944-9fd25a2205f2 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 21:00:31.259975 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-4cee89c5-57ba-439e-b662-19e66c0e0450 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:31.260671 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-4cee89c5-57ba-439e-b662-19e66c0e0450 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] [instance: ace99763-e046-4fb7-b944-9fd25a2205f2] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:31.268118 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4cee89c5-57ba-439e-b662-19e66c0e0450 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:31.268612 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4cee89c5-57ba-439e-b662-19e66c0e0450 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:31.269059 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4cee89c5-57ba-439e-b662-19e66c0e0450 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:31.269814 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4cee89c5-57ba-439e-b662-19e66c0e0450 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:31.270889 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4cee89c5-57ba-439e-b662-19e66c0e0450 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:31.271340 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4cee89c5-57ba-439e-b662-19e66c0e0450 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:31.432400 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-cb034507-2705-4b1e-ada6-3eaff6f66ac5 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06caf10b6fa43a3a2ad34858594e329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b10172715d423eb887d6c5b171defb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:31.444005 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-cb034507-2705-4b1e-ada6-3eaff6f66ac5 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] 10.222.0.26 "GET /compute/v2.1/servers/a8b2f857-6c24-45fe-b934-cf92b2d18b7a" status: 200 len: 1324 microversion: 2.1 time: 0.354761 Oct 08 21:00:31.450347 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1103/2177] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:31 2022] GET /compute/v2.1/servers/a8b2f857-6c24-45fe-b934-cf92b2d18b7a => generated 1324 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:31.585132 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-dacc93f6-bfdc-405f-b32b-12923d87d05f tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:31.586169 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-dacc93f6-bfdc-405f-b32b-12923d87d05f tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:31.598062 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dacc93f6-bfdc-405f-b32b-12923d87d05f tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:31.598574 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dacc93f6-bfdc-405f-b32b-12923d87d05f tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:31.599056 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dacc93f6-bfdc-405f-b32b-12923d87d05f tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:31.599788 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dacc93f6-bfdc-405f-b32b-12923d87d05f tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:31.600258 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dacc93f6-bfdc-405f-b32b-12923d87d05f tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:31.601044 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dacc93f6-bfdc-405f-b32b-12923d87d05f tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:31.720849 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-4cee89c5-57ba-439e-b662-19e66c0e0450 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ddc3cd3c374bacbe5bf5e0877380e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8472b054404c46a99b81aba34d6b9f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:31.729114 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-4cee89c5-57ba-439e-b662-19e66c0e0450 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] 10.222.0.26 "GET /compute/v2.1/servers/ace99763-e046-4fb7-b944-9fd25a2205f2" status: 200 len: 1473 microversion: 2.1 time: 0.473902 Oct 08 21:00:31.730888 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1075/2178] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:31 2022] GET /compute/v2.1/servers/ace99763-e046-4fb7-b944-9fd25a2205f2 => generated 1473 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:00:31.736320 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-86a06de9-51cd-471f-b42a-5ca505dccd90 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:31.737120 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-86a06de9-51cd-471f-b42a-5ca505dccd90 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] [instance: 3622a27e-b943-49a7-8d81-a6f553c32f7a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:31.744421 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-86a06de9-51cd-471f-b42a-5ca505dccd90 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:31.745104 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-86a06de9-51cd-471f-b42a-5ca505dccd90 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:31.745898 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-86a06de9-51cd-471f-b42a-5ca505dccd90 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:31.747317 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-86a06de9-51cd-471f-b42a-5ca505dccd90 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:31.747936 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-86a06de9-51cd-471f-b42a-5ca505dccd90 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:31.748530 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-86a06de9-51cd-471f-b42a-5ca505dccd90 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:31.837411 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-dacc93f6-bfdc-405f-b32b-12923d87d05f tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:31.845559 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-dacc93f6-bfdc-405f-b32b-12923d87d05f tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd" status: 200 len: 1468 microversion: 2.1 time: 0.265603 Oct 08 21:00:31.846142 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1104/2179] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:31 2022] GET /compute/v2.1/servers/d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd => generated 1468 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:00:31.850774 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-ec58666f-bae7-41a8-8d94-cfe9dc47bf54 req-6a541add-b0fb-4c5f-8005-2d8331f4ac3a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3622a27e-b943-49a7-8d81-a6f553c32f7a", "tag": "7a99af98-17a8-4923-a5c9-ed888cca7f5a"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:00:31.866401 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-ec58666f-bae7-41a8-8d94-cfe9dc47bf54 req-6a541add-b0fb-4c5f-8005-2d8331f4ac3a service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:31.866889 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-ec58666f-bae7-41a8-8d94-cfe9dc47bf54 req-6a541add-b0fb-4c5f-8005-2d8331f4ac3a service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:31.867329 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-ec58666f-bae7-41a8-8d94-cfe9dc47bf54 req-6a541add-b0fb-4c5f-8005-2d8331f4ac3a service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:31.879797 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-ec58666f-bae7-41a8-8d94-cfe9dc47bf54 req-6a541add-b0fb-4c5f-8005-2d8331f4ac3a service nova] Creating event network-changed:7a99af98-17a8-4923-a5c9-ed888cca7f5a for instance 3622a27e-b943-49a7-8d81-a6f553c32f7a on nch1-master-1 Oct 08 21:00:31.884971 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-ec58666f-bae7-41a8-8d94-cfe9dc47bf54 req-6a541add-b0fb-4c5f-8005-2d8331f4ac3a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037546 Oct 08 21:00:31.885691 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1105/2180] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:00:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:00:31.975313 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-07cb3ae9-fc35-46b3-bfdc-9a8cb78ecbfa req-24b213c7-639e-4f91-9713-d19fea053dd5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8b2f857-6c24-45fe-b934-cf92b2d18b7a", "tag": "d02c5c7d-36e9-42cf-a666-f4a9ae2674ec"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:00:31.983488 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-86a06de9-51cd-471f-b42a-5ca505dccd90 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '463a3aac627c43d7af0dbc9facb52076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac791938e6384c8c8473ffd65cf867a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:31.987448 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-07cb3ae9-fc35-46b3-bfdc-9a8cb78ecbfa req-24b213c7-639e-4f91-9713-d19fea053dd5 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:31.988066 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-07cb3ae9-fc35-46b3-bfdc-9a8cb78ecbfa req-24b213c7-639e-4f91-9713-d19fea053dd5 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:31.988616 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-07cb3ae9-fc35-46b3-bfdc-9a8cb78ecbfa req-24b213c7-639e-4f91-9713-d19fea053dd5 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:31.992557 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-86a06de9-51cd-471f-b42a-5ca505dccd90 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] 10.222.0.26 "GET /compute/v2.1/servers/3622a27e-b943-49a7-8d81-a6f553c32f7a" status: 200 len: 1322 microversion: 2.1 time: 0.260380 Oct 08 21:00:32.002429 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-07cb3ae9-fc35-46b3-bfdc-9a8cb78ecbfa req-24b213c7-639e-4f91-9713-d19fea053dd5 service nova] Creating event network-changed:d02c5c7d-36e9-42cf-a666-f4a9ae2674ec for instance a8b2f857-6c24-45fe-b934-cf92b2d18b7a on nch2-master-1 Oct 08 21:00:32.008331 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-07cb3ae9-fc35-46b3-bfdc-9a8cb78ecbfa req-24b213c7-639e-4f91-9713-d19fea053dd5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037865 Oct 08 21:00:32.008753 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1076/2181] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:31 2022] GET /compute/v2.1/servers/3622a27e-b943-49a7-8d81-a6f553c32f7a => generated 1322 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:32.009421 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1106/2182] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:00:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 08 21:00:32.067565 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-47ce03ae-bccf-4843-89fc-1bd904e6d0d0 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:32.068302 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-47ce03ae-bccf-4843-89fc-1bd904e6d0d0 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] [instance: 75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:32.074363 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-47ce03ae-bccf-4843-89fc-1bd904e6d0d0 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:32.075591 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-47ce03ae-bccf-4843-89fc-1bd904e6d0d0 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:32.076209 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-47ce03ae-bccf-4843-89fc-1bd904e6d0d0 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:32.076987 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-47ce03ae-bccf-4843-89fc-1bd904e6d0d0 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:32.077575 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-47ce03ae-bccf-4843-89fc-1bd904e6d0d0 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:32.078075 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-47ce03ae-bccf-4843-89fc-1bd904e6d0d0 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:32.316308 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-47ce03ae-bccf-4843-89fc-1bd904e6d0d0 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1698dee4a2bf4ea19a6ee0c3d5cb5c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b00ee5e7828469f95bd90548d35982a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:32.324904 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-47ce03ae-bccf-4843-89fc-1bd904e6d0d0 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] 10.222.0.26 "GET /compute/v2.1/servers/75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a" status: 200 len: 1521 microversion: 2.1 time: 0.261439 Oct 08 21:00:32.325723 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1077/2183] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:32 2022] GET /compute/v2.1/servers/75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a => generated 1521 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:32.472024 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-6383f954-6836-4beb-b69d-724831a4561c tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:32.472774 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-6383f954-6836-4beb-b69d-724831a4561c tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] [instance: a8b2f857-6c24-45fe-b934-cf92b2d18b7a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:32.480578 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6383f954-6836-4beb-b69d-724831a4561c tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:32.481214 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6383f954-6836-4beb-b69d-724831a4561c tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:32.482371 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6383f954-6836-4beb-b69d-724831a4561c tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:32.483105 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6383f954-6836-4beb-b69d-724831a4561c tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:32.483577 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6383f954-6836-4beb-b69d-724831a4561c tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:32.484014 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6383f954-6836-4beb-b69d-724831a4561c tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:32.662489 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-6383f954-6836-4beb-b69d-724831a4561c tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06caf10b6fa43a3a2ad34858594e329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b10172715d423eb887d6c5b171defb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:32.674824 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-6383f954-6836-4beb-b69d-724831a4561c tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] 10.222.0.26 "GET /compute/v2.1/servers/a8b2f857-6c24-45fe-b934-cf92b2d18b7a" status: 200 len: 1324 microversion: 2.1 time: 0.207044 Oct 08 21:00:32.676067 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1107/2184] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:32 2022] GET /compute/v2.1/servers/a8b2f857-6c24-45fe-b934-cf92b2d18b7a => generated 1324 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:32.753967 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-7a13bd27-672d-4cb2-9d98-56610ccf8c44 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:32.754654 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-7a13bd27-672d-4cb2-9d98-56610ccf8c44 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] [instance: ace99763-e046-4fb7-b944-9fd25a2205f2] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:32.761563 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7a13bd27-672d-4cb2-9d98-56610ccf8c44 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:32.763114 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7a13bd27-672d-4cb2-9d98-56610ccf8c44 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:32.763790 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7a13bd27-672d-4cb2-9d98-56610ccf8c44 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:32.764766 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7a13bd27-672d-4cb2-9d98-56610ccf8c44 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:32.765452 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7a13bd27-672d-4cb2-9d98-56610ccf8c44 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:32.766103 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7a13bd27-672d-4cb2-9d98-56610ccf8c44 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:32.869291 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-28e85ed4-b7d5-48a3-85ea-1d4f2355e0bc tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:32.870562 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-28e85ed4-b7d5-48a3-85ea-1d4f2355e0bc tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:32.881585 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-28e85ed4-b7d5-48a3-85ea-1d4f2355e0bc tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:32.882171 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-28e85ed4-b7d5-48a3-85ea-1d4f2355e0bc tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:32.885088 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-28e85ed4-b7d5-48a3-85ea-1d4f2355e0bc tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:32.886769 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-28e85ed4-b7d5-48a3-85ea-1d4f2355e0bc tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:32.888197 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-28e85ed4-b7d5-48a3-85ea-1d4f2355e0bc tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:32.888939 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-28e85ed4-b7d5-48a3-85ea-1d4f2355e0bc tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:33.135778 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-7a13bd27-672d-4cb2-9d98-56610ccf8c44 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ddc3cd3c374bacbe5bf5e0877380e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8472b054404c46a99b81aba34d6b9f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:33.149009 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-7a13bd27-672d-4cb2-9d98-56610ccf8c44 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] 10.222.0.26 "GET /compute/v2.1/servers/ace99763-e046-4fb7-b944-9fd25a2205f2" status: 200 len: 1473 microversion: 2.1 time: 0.399172 Oct 08 21:00:33.149651 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1078/2185] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:32 2022] GET /compute/v2.1/servers/ace99763-e046-4fb7-b944-9fd25a2205f2 => generated 1473 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:33.154974 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-539575db-4024-42be-916f-d60ec8f97a84 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:33.160036 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-539575db-4024-42be-916f-d60ec8f97a84 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] [instance: 3622a27e-b943-49a7-8d81-a6f553c32f7a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:33.176976 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-539575db-4024-42be-916f-d60ec8f97a84 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:33.178019 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-539575db-4024-42be-916f-d60ec8f97a84 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:33.178983 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-539575db-4024-42be-916f-d60ec8f97a84 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:33.180024 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-539575db-4024-42be-916f-d60ec8f97a84 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:33.180490 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-539575db-4024-42be-916f-d60ec8f97a84 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:33.181082 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-539575db-4024-42be-916f-d60ec8f97a84 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:33.417710 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-28e85ed4-b7d5-48a3-85ea-1d4f2355e0bc tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:33.433370 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-28e85ed4-b7d5-48a3-85ea-1d4f2355e0bc tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd" status: 200 len: 1468 microversion: 2.1 time: 0.567963 Oct 08 21:00:33.434677 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1108/2186] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:32 2022] GET /compute/v2.1/servers/d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd => generated 1468 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:00:33.442834 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-675fc6a8-fe5b-4134-96e8-cb9fcbff13cc tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:33.447201 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-675fc6a8-fe5b-4134-96e8-cb9fcbff13cc tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] [instance: 75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:33.455002 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-675fc6a8-fe5b-4134-96e8-cb9fcbff13cc tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:33.455942 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-675fc6a8-fe5b-4134-96e8-cb9fcbff13cc tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:33.456562 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-675fc6a8-fe5b-4134-96e8-cb9fcbff13cc tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:33.457590 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-675fc6a8-fe5b-4134-96e8-cb9fcbff13cc tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:33.459471 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-675fc6a8-fe5b-4134-96e8-cb9fcbff13cc tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:33.460045 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-675fc6a8-fe5b-4134-96e8-cb9fcbff13cc tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:33.537265 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-539575db-4024-42be-916f-d60ec8f97a84 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '463a3aac627c43d7af0dbc9facb52076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac791938e6384c8c8473ffd65cf867a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:33.546862 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-539575db-4024-42be-916f-d60ec8f97a84 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] 10.222.0.26 "GET /compute/v2.1/servers/3622a27e-b943-49a7-8d81-a6f553c32f7a" status: 200 len: 1322 microversion: 2.1 time: 0.395732 Oct 08 21:00:33.559091 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1079/2187] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:33 2022] GET /compute/v2.1/servers/3622a27e-b943-49a7-8d81-a6f553c32f7a => generated 1322 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:33.703094 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-1b141bfd-0d4e-493d-8ef5-cf65d9bd0093 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:33.704084 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-1b141bfd-0d4e-493d-8ef5-cf65d9bd0093 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] [instance: a8b2f857-6c24-45fe-b934-cf92b2d18b7a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:33.714544 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1b141bfd-0d4e-493d-8ef5-cf65d9bd0093 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:33.716066 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1b141bfd-0d4e-493d-8ef5-cf65d9bd0093 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:33.716744 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1b141bfd-0d4e-493d-8ef5-cf65d9bd0093 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:33.717758 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1b141bfd-0d4e-493d-8ef5-cf65d9bd0093 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:33.718453 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1b141bfd-0d4e-493d-8ef5-cf65d9bd0093 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:33.719200 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1b141bfd-0d4e-493d-8ef5-cf65d9bd0093 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:33.725305 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-675fc6a8-fe5b-4134-96e8-cb9fcbff13cc tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1698dee4a2bf4ea19a6ee0c3d5cb5c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b00ee5e7828469f95bd90548d35982a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:33.733925 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-675fc6a8-fe5b-4134-96e8-cb9fcbff13cc tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] 10.222.0.26 "GET /compute/v2.1/servers/75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a" status: 200 len: 1521 microversion: 2.1 time: 0.297629 Oct 08 21:00:33.734530 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1109/2188] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:33 2022] GET /compute/v2.1/servers/75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a => generated 1521 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:34.174421 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-b521e6ef-1b89-4a52-8e78-a3224ae9e70e tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:34.175907 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-b521e6ef-1b89-4a52-8e78-a3224ae9e70e tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] [instance: ace99763-e046-4fb7-b944-9fd25a2205f2] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:34.182758 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b521e6ef-1b89-4a52-8e78-a3224ae9e70e tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:34.183651 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b521e6ef-1b89-4a52-8e78-a3224ae9e70e tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:34.184742 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b521e6ef-1b89-4a52-8e78-a3224ae9e70e tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:34.185859 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b521e6ef-1b89-4a52-8e78-a3224ae9e70e tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:34.186331 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b521e6ef-1b89-4a52-8e78-a3224ae9e70e tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:34.186954 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b521e6ef-1b89-4a52-8e78-a3224ae9e70e tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:34.343641 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-b521e6ef-1b89-4a52-8e78-a3224ae9e70e tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ddc3cd3c374bacbe5bf5e0877380e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8472b054404c46a99b81aba34d6b9f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:34.355402 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-b521e6ef-1b89-4a52-8e78-a3224ae9e70e tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] 10.222.0.26 "GET /compute/v2.1/servers/ace99763-e046-4fb7-b944-9fd25a2205f2" status: 200 len: 1473 microversion: 2.1 time: 0.187281 Oct 08 21:00:34.357785 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1110/2189] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:34 2022] GET /compute/v2.1/servers/ace99763-e046-4fb7-b944-9fd25a2205f2 => generated 1473 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:00:34.394228 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-1b141bfd-0d4e-493d-8ef5-cf65d9bd0093 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06caf10b6fa43a3a2ad34858594e329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b10172715d423eb887d6c5b171defb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:34.405584 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-1b141bfd-0d4e-493d-8ef5-cf65d9bd0093 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] 10.222.0.26 "GET /compute/v2.1/servers/a8b2f857-6c24-45fe-b934-cf92b2d18b7a" status: 200 len: 1324 microversion: 2.1 time: 0.706825 Oct 08 21:00:34.406896 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1080/2190] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:33 2022] GET /compute/v2.1/servers/a8b2f857-6c24-45fe-b934-cf92b2d18b7a => generated 1324 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:34.457136 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e5ff64f0-9cde-4bfd-8ea7-39d1d46937b2 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:34.458469 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-e5ff64f0-9cde-4bfd-8ea7-39d1d46937b2 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:34.470958 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e5ff64f0-9cde-4bfd-8ea7-39d1d46937b2 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:34.472735 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e5ff64f0-9cde-4bfd-8ea7-39d1d46937b2 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:34.473541 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e5ff64f0-9cde-4bfd-8ea7-39d1d46937b2 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:34.474501 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e5ff64f0-9cde-4bfd-8ea7-39d1d46937b2 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:34.475152 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e5ff64f0-9cde-4bfd-8ea7-39d1d46937b2 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:34.476014 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e5ff64f0-9cde-4bfd-8ea7-39d1d46937b2 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:34.572414 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-131b0783-b86a-4079-927e-8c2c834839dc tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:34.573299 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-131b0783-b86a-4079-927e-8c2c834839dc tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] [instance: 3622a27e-b943-49a7-8d81-a6f553c32f7a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:34.581377 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-131b0783-b86a-4079-927e-8c2c834839dc tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:34.582787 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-131b0783-b86a-4079-927e-8c2c834839dc tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:34.584140 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-131b0783-b86a-4079-927e-8c2c834839dc tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:34.586694 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-131b0783-b86a-4079-927e-8c2c834839dc tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:34.587571 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-131b0783-b86a-4079-927e-8c2c834839dc tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:34.588201 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-131b0783-b86a-4079-927e-8c2c834839dc tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:34.808030 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-e5ff64f0-9cde-4bfd-8ea7-39d1d46937b2 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:34.819891 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-e5ff64f0-9cde-4bfd-8ea7-39d1d46937b2 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd" status: 200 len: 1460 microversion: 2.1 time: 0.367169 Oct 08 21:00:34.821840 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1111/2191] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:34 2022] GET /compute/v2.1/servers/d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd => generated 1460 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:00:34.826983 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-8cfcda2f-79e1-4b13-9d4a-65f24478c08d tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:34.828045 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-8cfcda2f-79e1-4b13-9d4a-65f24478c08d tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] [instance: 75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:34.835260 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8cfcda2f-79e1-4b13-9d4a-65f24478c08d tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:34.836057 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8cfcda2f-79e1-4b13-9d4a-65f24478c08d tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:34.836721 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8cfcda2f-79e1-4b13-9d4a-65f24478c08d tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:34.837695 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8cfcda2f-79e1-4b13-9d4a-65f24478c08d tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:34.838406 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8cfcda2f-79e1-4b13-9d4a-65f24478c08d tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:34.839195 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8cfcda2f-79e1-4b13-9d4a-65f24478c08d tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:35.032347 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-131b0783-b86a-4079-927e-8c2c834839dc tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '463a3aac627c43d7af0dbc9facb52076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac791938e6384c8c8473ffd65cf867a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:35.042053 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-131b0783-b86a-4079-927e-8c2c834839dc tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] 10.222.0.26 "GET /compute/v2.1/servers/3622a27e-b943-49a7-8d81-a6f553c32f7a" status: 200 len: 1322 microversion: 2.1 time: 0.473902 Oct 08 21:00:35.043977 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1081/2192] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:34 2022] GET /compute/v2.1/servers/3622a27e-b943-49a7-8d81-a6f553c32f7a => generated 1322 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:00:35.049770 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-86516cb7-b5a1-4edc-b8c0-92179ddc5ba3 tempest-MigrationsAdminTest-1609748928 tempest-MigrationsAdminTest-1609748928-project-admin] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:35.050756 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-86516cb7-b5a1-4edc-b8c0-92179ddc5ba3 tempest-MigrationsAdminTest-1609748928 tempest-MigrationsAdminTest-1609748928-project-admin] [instance: d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:35.057877 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-86516cb7-b5a1-4edc-b8c0-92179ddc5ba3 tempest-MigrationsAdminTest-1609748928 tempest-MigrationsAdminTest-1609748928-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:35.058597 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-86516cb7-b5a1-4edc-b8c0-92179ddc5ba3 tempest-MigrationsAdminTest-1609748928 tempest-MigrationsAdminTest-1609748928-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:35.059236 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-86516cb7-b5a1-4edc-b8c0-92179ddc5ba3 tempest-MigrationsAdminTest-1609748928 tempest-MigrationsAdminTest-1609748928-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:35.060760 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-86516cb7-b5a1-4edc-b8c0-92179ddc5ba3 tempest-MigrationsAdminTest-1609748928 tempest-MigrationsAdminTest-1609748928-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:35.061443 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-86516cb7-b5a1-4edc-b8c0-92179ddc5ba3 tempest-MigrationsAdminTest-1609748928 tempest-MigrationsAdminTest-1609748928-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:35.062027 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-86516cb7-b5a1-4edc-b8c0-92179ddc5ba3 tempest-MigrationsAdminTest-1609748928 tempest-MigrationsAdminTest-1609748928-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:35.064081 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-8cfcda2f-79e1-4b13-9d4a-65f24478c08d tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1698dee4a2bf4ea19a6ee0c3d5cb5c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b00ee5e7828469f95bd90548d35982a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:35.085954 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-8cfcda2f-79e1-4b13-9d4a-65f24478c08d tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] 10.222.0.26 "GET /compute/v2.1/servers/75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a" status: 200 len: 1521 microversion: 2.1 time: 0.254729 Oct 08 21:00:35.086657 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1112/2193] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:34 2022] GET /compute/v2.1/servers/75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a => generated 1521 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:35.107643 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-28348991-7b33-4e9f-bb59-9992f5ee641c req-99d560ea-e915-4ee2-9772-fc3c5e4aa49b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ace99763-e046-4fb7-b944-9fd25a2205f2", "name": "network-vif-deleted", "tag": "e69d9159-fc32-433f-bf69-481ccceff1c2"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:00:35.121543 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-28348991-7b33-4e9f-bb59-9992f5ee641c req-99d560ea-e915-4ee2-9772-fc3c5e4aa49b service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:35.122018 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-28348991-7b33-4e9f-bb59-9992f5ee641c req-99d560ea-e915-4ee2-9772-fc3c5e4aa49b service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:35.122127 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-28348991-7b33-4e9f-bb59-9992f5ee641c req-99d560ea-e915-4ee2-9772-fc3c5e4aa49b service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:35.137939 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-28348991-7b33-4e9f-bb59-9992f5ee641c req-99d560ea-e915-4ee2-9772-fc3c5e4aa49b service nova] Creating event network-vif-deleted:e69d9159-fc32-433f-bf69-481ccceff1c2 for instance ace99763-e046-4fb7-b944-9fd25a2205f2 on nch2-master-1 Oct 08 21:00:35.144264 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-28348991-7b33-4e9f-bb59-9992f5ee641c req-99d560ea-e915-4ee2-9772-fc3c5e4aa49b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051091 Oct 08 21:00:35.145259 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1113/2194] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:00:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:00:35.381046 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e7b21e7d-7ad6-4664-8835-4ccb1b436e65 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:35.382033 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-e7b21e7d-7ad6-4664-8835-4ccb1b436e65 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] [instance: ace99763-e046-4fb7-b944-9fd25a2205f2] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:35.393414 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e7b21e7d-7ad6-4664-8835-4ccb1b436e65 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:35.393926 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e7b21e7d-7ad6-4664-8835-4ccb1b436e65 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:35.394542 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e7b21e7d-7ad6-4664-8835-4ccb1b436e65 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:35.395436 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e7b21e7d-7ad6-4664-8835-4ccb1b436e65 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:35.396050 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e7b21e7d-7ad6-4664-8835-4ccb1b436e65 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:35.396495 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e7b21e7d-7ad6-4664-8835-4ccb1b436e65 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:35.459548 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e7b21e7d-7ad6-4664-8835-4ccb1b436e65 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:35.460874 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e7b21e7d-7ad6-4664-8835-4ccb1b436e65 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:35.462402 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e7b21e7d-7ad6-4664-8835-4ccb1b436e65 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:35.463083 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.objects.instance [None req-e7b21e7d-7ad6-4664-8835-4ccb1b436e65 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lazy-loading 'fault' on Instance uuid ace99763-e046-4fb7-b944-9fd25a2205f2 {{(pid=140492) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 21:00:35.524569 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-86516cb7-b5a1-4edc-b8c0-92179ddc5ba3 tempest-MigrationsAdminTest-1609748928 tempest-MigrationsAdminTest-1609748928-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd" status: 200 len: 1611 microversion: 2.1 time: 0.479200 Oct 08 21:00:35.526814 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1082/2195] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:35 2022] GET /compute/v2.1/servers/d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd => generated 1611 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:35.534123 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-e5c89280-2baf-4829-a28c-3cea43d35f0e tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:35.535140 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-e5c89280-2baf-4829-a28c-3cea43d35f0e tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] [instance: a8b2f857-6c24-45fe-b934-cf92b2d18b7a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:35.535418 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-e7b21e7d-7ad6-4664-8835-4ccb1b436e65 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ddc3cd3c374bacbe5bf5e0877380e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8472b054404c46a99b81aba34d6b9f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:35.545613 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e5c89280-2baf-4829-a28c-3cea43d35f0e tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:35.546022 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-e7b21e7d-7ad6-4664-8835-4ccb1b436e65 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] 10.222.0.26 "GET /compute/v2.1/servers/ace99763-e046-4fb7-b944-9fd25a2205f2" status: 200 len: 1307 microversion: 2.1 time: 0.169327 Oct 08 21:00:35.546822 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e5c89280-2baf-4829-a28c-3cea43d35f0e tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:35.547219 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1114/2196] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:35 2022] GET /compute/v2.1/servers/ace99763-e046-4fb7-b944-9fd25a2205f2 => generated 1307 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:00:35.547859 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e5c89280-2baf-4829-a28c-3cea43d35f0e tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:35.549539 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e5c89280-2baf-4829-a28c-3cea43d35f0e tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:35.550404 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e5c89280-2baf-4829-a28c-3cea43d35f0e tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:35.551046 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e5c89280-2baf-4829-a28c-3cea43d35f0e tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:35.567131 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-18db41ab-3907-45bd-a237-bfcc4af35746 tempest-MigrationsAdminTest-1609748928 tempest-MigrationsAdminTest-1609748928-project-admin] Calling method '.version_select at 0x7f1a8c9619d0>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:35.572216 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-18db41ab-3907-45bd-a237-bfcc4af35746 tempest-MigrationsAdminTest-1609748928 tempest-MigrationsAdminTest-1609748928-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:35.572982 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-18db41ab-3907-45bd-a237-bfcc4af35746 tempest-MigrationsAdminTest-1609748928 tempest-MigrationsAdminTest-1609748928-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:35.573759 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-18db41ab-3907-45bd-a237-bfcc4af35746 tempest-MigrationsAdminTest-1609748928 tempest-MigrationsAdminTest-1609748928-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:35.586507 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-18db41ab-3907-45bd-a237-bfcc4af35746 tempest-MigrationsAdminTest-1609748928 tempest-MigrationsAdminTest-1609748928-project-admin] 10.222.0.26 "GET /compute/v2.1/os-migrations" status: 200 len: 409 microversion: 2.1 time: 0.023357 Oct 08 21:00:35.593774 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1115/2197] 10.222.0.26 () {58 vars in 1143 bytes} [Sat Oct 8 21:00:35 2022] GET /compute/v2.1/os-migrations => generated 409 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:00:35.740026 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-9d1dd3da-367a-4529-aa9d-14abba6cc3b6 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-589296270", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:00:35.851226 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.network.neutron [None req-9d1dd3da-367a-4529-aa9d-14abba6cc3b6 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] validate_networks() for None {{(pid=140492) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 21:00:36.182456 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-e5c89280-2baf-4829-a28c-3cea43d35f0e tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06caf10b6fa43a3a2ad34858594e329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b10172715d423eb887d6c5b171defb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:36.228155 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-e5c89280-2baf-4829-a28c-3cea43d35f0e tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] 10.222.0.26 "GET /compute/v2.1/servers/a8b2f857-6c24-45fe-b934-cf92b2d18b7a" status: 200 len: 1324 microversion: 2.1 time: 0.674383 Oct 08 21:00:36.231889 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1083/2198] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:35 2022] GET /compute/v2.1/servers/a8b2f857-6c24-45fe-b934-cf92b2d18b7a => generated 1324 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:36.263366 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-fe6b3961-607c-4e6d-8ce7-870ce390432f req-6765f38e-bdad-48ca-8711-75cb11eb2754 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4832d86f-ddee-445e-8b26-fae015d901a4", "name": "network-vif-plugged", "status": "completed", "tag": "b12b61d4-cc2a-4ad0-8a4c-e8c07da8ccb1"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:00:36.278821 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-fe6b3961-607c-4e6d-8ce7-870ce390432f req-6765f38e-bdad-48ca-8711-75cb11eb2754 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:36.279824 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-fe6b3961-607c-4e6d-8ce7-870ce390432f req-6765f38e-bdad-48ca-8711-75cb11eb2754 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:36.280803 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-fe6b3961-607c-4e6d-8ce7-870ce390432f req-6765f38e-bdad-48ca-8711-75cb11eb2754 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:36.303880 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-fe6b3961-607c-4e6d-8ce7-870ce390432f req-6765f38e-bdad-48ca-8711-75cb11eb2754 service nova] Creating event network-vif-plugged:b12b61d4-cc2a-4ad0-8a4c-e8c07da8ccb1 for instance 4832d86f-ddee-445e-8b26-fae015d901a4 on nch2-master-1 Oct 08 21:00:36.311822 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-fe6b3961-607c-4e6d-8ce7-870ce390432f req-6765f38e-bdad-48ca-8711-75cb11eb2754 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053035 Oct 08 21:00:36.312955 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1084/2199] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:00:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:00:36.322894 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-43c383a7-52b9-404f-b768-fdd1c1787ef3 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:36.325680 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-43c383a7-52b9-404f-b768-fdd1c1787ef3 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] [instance: 3622a27e-b943-49a7-8d81-a6f553c32f7a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:36.337454 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-9d1dd3da-367a-4529-aa9d-14abba6cc3b6 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Flavor limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 21:00:36.337782 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-9d1dd3da-367a-4529-aa9d-14abba6cc3b6 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Image limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 21:00:36.338280 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-9d1dd3da-367a-4529-aa9d-14abba6cc3b6 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Flavor pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 21:00:36.338710 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-9d1dd3da-367a-4529-aa9d-14abba6cc3b6 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Image pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 21:00:36.339144 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-9d1dd3da-367a-4529-aa9d-14abba6cc3b6 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 21:00:36.343031 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-43c383a7-52b9-404f-b768-fdd1c1787ef3 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:36.343847 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-43c383a7-52b9-404f-b768-fdd1c1787ef3 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:36.345339 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-43c383a7-52b9-404f-b768-fdd1c1787ef3 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:36.348103 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-43c383a7-52b9-404f-b768-fdd1c1787ef3 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:36.350076 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-43c383a7-52b9-404f-b768-fdd1c1787ef3 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:36.353560 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=19 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:00:36.360700 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9d1dd3da-367a-4529-aa9d-14abba6cc3b6 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:36.361217 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9d1dd3da-367a-4529-aa9d-14abba6cc3b6 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:36.361723 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9d1dd3da-367a-4529-aa9d-14abba6cc3b6 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:36.362485 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9d1dd3da-367a-4529-aa9d-14abba6cc3b6 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:36.362978 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9d1dd3da-367a-4529-aa9d-14abba6cc3b6 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:36.363407 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9d1dd3da-367a-4529-aa9d-14abba6cc3b6 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:36.365302 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-43c383a7-52b9-404f-b768-fdd1c1787ef3 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:36.395482 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=9 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:00:36.434242 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-9d1dd3da-367a-4529-aa9d-14abba6cc3b6 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Getting quotas for project 0ffdae031c4f47d599acb30f1d3c87b9. Resources: {'cores', 'instances', 'ram'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:00:36.442589 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-9d1dd3da-367a-4529-aa9d-14abba6cc3b6 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Getting quotas for user 5266cd6be4514b3eac30a195f6b25772 and project 0ffdae031c4f47d599acb30f1d3c87b9. Resources: {'cores', 'instances', 'ram'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:00:36.459451 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-9d1dd3da-367a-4529-aa9d-14abba6cc3b6 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Going to run 1 instances... {{(pid=140492) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 21:00:36.470759 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-9d1dd3da-367a-4529-aa9d-14abba6cc3b6 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: 38b000d3-167b-4f7a-ab80-cd51fcb7cbaf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c508bd7f-7db9-4b2c-af7c-be54a855c355',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140492) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 21:00:36.542644 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-9d1dd3da-367a-4529-aa9d-14abba6cc3b6 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.807669 Oct 08 21:00:36.551456 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1116/2200] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 21:00:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 812 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 08 21:00:36.557696 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-d202435e-ad69-4288-bbed-3c73d0daabc8 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:36.559625 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-d202435e-ad69-4288-bbed-3c73d0daabc8 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] [instance: 75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:36.570644 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d202435e-ad69-4288-bbed-3c73d0daabc8 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:36.570738 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d202435e-ad69-4288-bbed-3c73d0daabc8 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:36.571173 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d202435e-ad69-4288-bbed-3c73d0daabc8 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:36.571907 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d202435e-ad69-4288-bbed-3c73d0daabc8 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:36.572864 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d202435e-ad69-4288-bbed-3c73d0daabc8 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:36.573552 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d202435e-ad69-4288-bbed-3c73d0daabc8 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:36.872579 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-d202435e-ad69-4288-bbed-3c73d0daabc8 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1698dee4a2bf4ea19a6ee0c3d5cb5c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b00ee5e7828469f95bd90548d35982a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:36.889496 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-d202435e-ad69-4288-bbed-3c73d0daabc8 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] 10.222.0.26 "GET /compute/v2.1/servers/75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a" status: 200 len: 1501 microversion: 2.1 time: 0.341747 Oct 08 21:00:36.897959 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1117/2201] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:36 2022] GET /compute/v2.1/servers/75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a => generated 1501 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:36.903985 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-822195d7-0746-4945-ada9-7121eaa9cf81 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:36.921532 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-822195d7-0746-4945-ada9-7121eaa9cf81 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: 38b000d3-167b-4f7a-ab80-cd51fcb7cbaf] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:36.930209 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-43c383a7-52b9-404f-b768-fdd1c1787ef3 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '463a3aac627c43d7af0dbc9facb52076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac791938e6384c8c8473ffd65cf867a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:36.947548 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-43c383a7-52b9-404f-b768-fdd1c1787ef3 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] 10.222.0.26 "GET /compute/v2.1/servers/3622a27e-b943-49a7-8d81-a6f553c32f7a" status: 200 len: 1322 microversion: 2.1 time: 0.631973 Oct 08 21:00:36.948580 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1085/2202] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:36 2022] GET /compute/v2.1/servers/3622a27e-b943-49a7-8d81-a6f553c32f7a => generated 1322 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:36.970799 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-86629fe7-15cb-48db-ad5e-b37585976562 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:36.974701 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-86629fe7-15cb-48db-ad5e-b37585976562 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] [instance: ace99763-e046-4fb7-b944-9fd25a2205f2] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:36.992801 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-86629fe7-15cb-48db-ad5e-b37585976562 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:36.993678 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-86629fe7-15cb-48db-ad5e-b37585976562 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:36.994812 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-86629fe7-15cb-48db-ad5e-b37585976562 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:36.998429 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-86629fe7-15cb-48db-ad5e-b37585976562 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:36.999471 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-86629fe7-15cb-48db-ad5e-b37585976562 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:37.000447 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-86629fe7-15cb-48db-ad5e-b37585976562 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:37.032487 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-822195d7-0746-4945-ada9-7121eaa9cf81 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:37.033777 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-86629fe7-15cb-48db-ad5e-b37585976562 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] HTTP exception thrown: Instance ace99763-e046-4fb7-b944-9fd25a2205f2 could not be found. Oct 08 21:00:37.036063 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-86629fe7-15cb-48db-ad5e-b37585976562 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Request method failure captured: Oct 08 21:00:37.036063 ncdv-master-1 devstack@n-api.service[140491]: request: GET /compute/v2.1/servers/ace99763-e046-4fb7-b944-9fd25a2205f2 HTTP/1.1 Oct 08 21:00:37.036063 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:00:37.036063 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:00:37.036063 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:00:37.036063 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 21:00:37.036063 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:00:37.036063 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:00:37.036063 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:00:37.036063 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:00:37.036063 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeRR295mmmZhL7rSOgfacjSsWQ1Ti3FYd30sypy6B-ALaT7WOeiqaScllnDYtpa4eJ1mjmv4WUyVTLu5zt1pdJiZcKAFWv_GnEIqR6TqCn43v4gEmVWskuydtSKspT0UK00dWYkPU4ZM4UBd8cYd3myAyAfY7HLwKtG1LqfYrCLqzow Oct 08 21:00:37.036063 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:00:37.036063 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:00:37.036063 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:00:37.036063 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:00:37.036063 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:00:37.036063 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:00:37.036063 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 8472b054404c46a99b81aba34d6b9f40 Oct 08 21:00:37.036063 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-ServersOnMultiNodesTest-2078873751 Oct 08 21:00:37.036063 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:00:37.036063 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:00:37.036063 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8472b054404c46a99b81aba34d6b9f40"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8472b054404c46a99b81aba34d6b9f40"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8472b054404c46a99b81aba34d6b9f40"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8472b054404c46a99b81aba34d6b9f40"}]}] Oct 08 21:00:37.036063 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-ServersOnMultiNodesTest-2078873751 Oct 08 21:00:37.036063 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 8472b054404c46a99b81aba34d6b9f40 Oct 08 21:00:37.036063 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-2078873751 Oct 08 21:00:37.036063 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-ServersOnMultiNodesTest-2078873751-project Oct 08 21:00:37.036063 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:00:37.036063 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:00:37.036063 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 67ddc3cd3c374bacbe5bf5e0877380e2 Oct 08 21:00:37.036063 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-ServersOnMultiNodesTest-2078873751-project Oct 08 21:00:37.036063 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:00:37.036063 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance ace99763-e046-4fb7-b944-9fd25a2205f2 could not be found. Oct 08 21:00:37.036063 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': 'ace99763-e046-4fb7-b944-9fd25a2205f2'} Oct 08 21:00:37.036063 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:00:37.036063 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:00:37.036063 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:00:37.036063 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:00:37.036063 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:00:37.036063 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:00:37.036063 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:00:37.036063 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:00:37.036063 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:00:37.036063 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:00:37.036063 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ace99763-e046-4fb7-b944-9fd25a2205f2 could not be found. Oct 08 21:00:37.036063 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:00:37.036063 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:00:37.036063 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:00:37.036063 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:00:37.036063 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:00:37.036063 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:00:37.036063 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:00:37.036063 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:00:37.036063 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:00:37.036063 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:00:37.036063 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:00:37.036063 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:00:37.036063 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:00:37.036063 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:00:37.036063 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:00:37.036063 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:00:37.036063 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ace99763-e046-4fb7-b944-9fd25a2205f2 could not be found. Oct 08 21:00:37.036063 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:00:37.036063 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:00:37.036063 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:00:37.041375 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:00:37.041375 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:00:37.041375 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:00:37.041375 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:00:37.041375 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:00:37.041375 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ace99763-e046-4fb7-b944-9fd25a2205f2 could not be found. Oct 08 21:00:37.041375 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:00:37.041375 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-86629fe7-15cb-48db-ad5e-b37585976562 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Returning 404 to user: Instance ace99763-e046-4fb7-b944-9fd25a2205f2 could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:00:37.041375 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-86629fe7-15cb-48db-ad5e-b37585976562 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] 10.222.0.26 "GET /compute/v2.1/servers/ace99763-e046-4fb7-b944-9fd25a2205f2" status: 404 len: 111 microversion: 2.1 time: 0.087744 Oct 08 21:00:37.045285 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1086/2203] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:36 2022] GET /compute/v2.1/servers/ace99763-e046-4fb7-b944-9fd25a2205f2 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:00:37.050246 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-0827f66a-4e03-4393-84de-619b0461959e tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:37.050896 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-0827f66a-4e03-4393-84de-619b0461959e tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] [instance: 579b0f8b-ccae-4c2b-bb48-1da1aaf6a138] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:37.057792 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0827f66a-4e03-4393-84de-619b0461959e tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:37.058343 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0827f66a-4e03-4393-84de-619b0461959e tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:37.059362 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0827f66a-4e03-4393-84de-619b0461959e tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:37.060333 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0827f66a-4e03-4393-84de-619b0461959e tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:37.060950 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0827f66a-4e03-4393-84de-619b0461959e tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:37.061755 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0827f66a-4e03-4393-84de-619b0461959e tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:37.073554 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-822195d7-0746-4945-ada9-7121eaa9cf81 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/38b000d3-167b-4f7a-ab80-cd51fcb7cbaf" status: 200 len: 1212 microversion: 2.1 time: 0.178792 Oct 08 21:00:37.075166 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1118/2204] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:36 2022] GET /compute/v2.1/servers/38b000d3-167b-4f7a-ab80-cd51fcb7cbaf => generated 1212 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:37.079960 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-2907c473-773e-42b6-97c6-bcea13222a2a tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:37.080601 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-2907c473-773e-42b6-97c6-bcea13222a2a tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] [instance: 50c38cf5-c054-447c-99a8-10bae624b09a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:37.087985 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2907c473-773e-42b6-97c6-bcea13222a2a tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:37.089515 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2907c473-773e-42b6-97c6-bcea13222a2a tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:37.090713 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2907c473-773e-42b6-97c6-bcea13222a2a tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:37.091858 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2907c473-773e-42b6-97c6-bcea13222a2a tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:37.092543 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2907c473-773e-42b6-97c6-bcea13222a2a tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:37.093219 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2907c473-773e-42b6-97c6-bcea13222a2a tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:37.127345 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-2907c473-773e-42b6-97c6-bcea13222a2a tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] [instance: 50c38cf5-c054-447c-99a8-10bae624b09a] Going to try to terminate instance {{(pid=140492) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 21:00:37.265099 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-2907c473-773e-42b6-97c6-bcea13222a2a tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] 10.222.0.26 "DELETE /compute/v2.1/servers/50c38cf5-c054-447c-99a8-10bae624b09a" status: 204 len: 0 microversion: 2.1 time: 0.187868 Oct 08 21:00:37.266264 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1119/2205] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:00:37 2022] DELETE /compute/v2.1/servers/50c38cf5-c054-447c-99a8-10bae624b09a => generated 0 bytes in 191 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 21:00:37.278218 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-66f8407e-306a-4653-a557-f0976fb798e1 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:37.279921 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-66f8407e-306a-4653-a557-f0976fb798e1 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] [instance: a8b2f857-6c24-45fe-b934-cf92b2d18b7a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:37.290261 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-66f8407e-306a-4653-a557-f0976fb798e1 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:37.291522 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-66f8407e-306a-4653-a557-f0976fb798e1 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:37.292302 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-66f8407e-306a-4653-a557-f0976fb798e1 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:37.293885 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-66f8407e-306a-4653-a557-f0976fb798e1 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:37.294835 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-66f8407e-306a-4653-a557-f0976fb798e1 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:37.295539 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-66f8407e-306a-4653-a557-f0976fb798e1 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:37.326081 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:00:37.348977 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-0827f66a-4e03-4393-84de-619b0461959e tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1698dee4a2bf4ea19a6ee0c3d5cb5c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b00ee5e7828469f95bd90548d35982a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:37.363828 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-0827f66a-4e03-4393-84de-619b0461959e tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] 10.222.0.26 "GET /compute/v2.1/servers/579b0f8b-ccae-4c2b-bb48-1da1aaf6a138" status: 200 len: 1517 microversion: 2.1 time: 0.317150 Oct 08 21:00:37.364373 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1087/2206] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:37 2022] GET /compute/v2.1/servers/579b0f8b-ccae-4c2b-bb48-1da1aaf6a138 => generated 1517 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:37.369708 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-ab00506d-c621-41a4-b5ad-acc2e39ebad4 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:37.370526 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-ab00506d-c621-41a4-b5ad-acc2e39ebad4 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] [instance: 50c38cf5-c054-447c-99a8-10bae624b09a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:37.378011 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ab00506d-c621-41a4-b5ad-acc2e39ebad4 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:37.378777 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ab00506d-c621-41a4-b5ad-acc2e39ebad4 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:37.379372 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ab00506d-c621-41a4-b5ad-acc2e39ebad4 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:37.380241 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ab00506d-c621-41a4-b5ad-acc2e39ebad4 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:37.380853 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ab00506d-c621-41a4-b5ad-acc2e39ebad4 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:37.381638 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ab00506d-c621-41a4-b5ad-acc2e39ebad4 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:37.567898 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-ab00506d-c621-41a4-b5ad-acc2e39ebad4 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ddc3cd3c374bacbe5bf5e0877380e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8472b054404c46a99b81aba34d6b9f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:37.576803 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-ab00506d-c621-41a4-b5ad-acc2e39ebad4 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] 10.222.0.26 "GET /compute/v2.1/servers/50c38cf5-c054-447c-99a8-10bae624b09a" status: 200 len: 1473 microversion: 2.1 time: 0.211025 Oct 08 21:00:37.577420 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1088/2207] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:37 2022] GET /compute/v2.1/servers/50c38cf5-c054-447c-99a8-10bae624b09a => generated 1473 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:37.582847 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-957ef53e-1918-43a8-aab9-2834b73d8845 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:00:37.585516 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-957ef53e-1918-43a8-aab9-2834b73d8845 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] [instance: e5ae6f79-0180-42cb-b7ad-4cf4658b8fa4] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:37.598287 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-957ef53e-1918-43a8-aab9-2834b73d8845 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] HTTP exception thrown: Instance e5ae6f79-0180-42cb-b7ad-4cf4658b8fa4 could not be found. Oct 08 21:00:37.603244 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-957ef53e-1918-43a8-aab9-2834b73d8845 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Request method failure captured: Oct 08 21:00:37.603244 ncdv-master-1 devstack@n-api.service[140491]: request: POST /compute/v2.1/servers/e5ae6f79-0180-42cb-b7ad-4cf4658b8fa4/action HTTP/1.1 Oct 08 21:00:37.603244 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:00:37.603244 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:00:37.603244 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:00:37.603244 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 14 Oct 08 21:00:37.603244 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:00:37.603244 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:00:37.603244 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:00:37.603244 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:00:37.603244 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeS0fE1W4PvU2_7k8u76nOm9Y1zh9DtzN6SifZox8c4Ee-O4iYj3CcpXLLEG93O-SwetyStVJsCOhK1z0DAluVdyejBt-R2ozc-SxCa3q7lzUNWL-Kx89hV0cNzOobKFM-EJsBUodFQ4EWnFtqD_Q-5HZD9KoD2jZ3YWHd3RuK5iGsY Oct 08 21:00:37.603244 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:00:37.603244 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:00:37.603244 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:00:37.603244 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:00:37.603244 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:00:37.603244 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:00:37.603244 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 8b00ee5e7828469f95bd90548d35982a Oct 08 21:00:37.603244 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1823882791 Oct 08 21:00:37.603244 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:00:37.603244 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:00:37.603244 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8b00ee5e7828469f95bd90548d35982a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8b00ee5e7828469f95bd90548d35982a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8b00ee5e7828469f95bd90548d35982a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8b00ee5e7828469f95bd90548d35982a"}]}] Oct 08 21:00:37.603244 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1823882791 Oct 08 21:00:37.603244 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 8b00ee5e7828469f95bd90548d35982a Oct 08 21:00:37.603244 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1823882791 Oct 08 21:00:37.603244 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-ServerRescueNegativeTestJSON-1823882791-project Oct 08 21:00:37.603244 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:00:37.603244 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:00:37.603244 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 1698dee4a2bf4ea19a6ee0c3d5cb5c09 Oct 08 21:00:37.603244 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1823882791-project Oct 08 21:00:37.603244 ncdv-master-1 devstack@n-api.service[140491]: Oct 08 21:00:37.603244 ncdv-master-1 devstack@n-api.service[140491]: {"rescue": {}} Oct 08 21:00:37.603244 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:00:37.603244 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance e5ae6f79-0180-42cb-b7ad-4cf4658b8fa4 could not be found. Oct 08 21:00:37.603244 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': 'e5ae6f79-0180-42cb-b7ad-4cf4658b8fa4', 'body': {'rescue': {}}} Oct 08 21:00:37.603244 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:00:37.603244 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:00:37.603244 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:00:37.603244 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:00:37.603244 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:00:37.603244 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:00:37.603244 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 08 21:00:37.603244 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 08 21:00:37.603244 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5ae6f79-0180-42cb-b7ad-4cf4658b8fa4 could not be found. Oct 08 21:00:37.603244 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:00:37.603244 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:00:37.603244 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:00:37.603244 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:00:37.603244 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:00:37.603244 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:00:37.603244 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:00:37.603244 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:00:37.603244 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:00:37.603244 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:00:37.603244 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 21:00:37.603244 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 21:00:37.603244 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Oct 08 21:00:37.603244 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 08 21:00:37.603244 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:00:37.603244 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:00:37.603244 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5ae6f79-0180-42cb-b7ad-4cf4658b8fa4 could not be found. Oct 08 21:00:37.603244 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:00:37.603244 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:00:37.603244 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:00:37.603244 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:00:37.608308 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:00:37.608308 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:00:37.608308 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:00:37.608308 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:00:37.608308 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5ae6f79-0180-42cb-b7ad-4cf4658b8fa4 could not be found. Oct 08 21:00:37.608308 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:00:37.609801 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-957ef53e-1918-43a8-aab9-2834b73d8845 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Returning 404 to user: Instance e5ae6f79-0180-42cb-b7ad-4cf4658b8fa4 could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:00:37.611314 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-957ef53e-1918-43a8-aab9-2834b73d8845 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] 10.222.0.26 "POST /compute/v2.1/servers/e5ae6f79-0180-42cb-b7ad-4cf4658b8fa4/action" status: 404 len: 111 microversion: 2.1 time: 0.032454 Oct 08 21:00:37.611950 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1089/2208] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:00:37 2022] POST /compute/v2.1/servers/e5ae6f79-0180-42cb-b7ad-4cf4658b8fa4/action => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:00:37.625459 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-66f8407e-306a-4653-a557-f0976fb798e1 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06caf10b6fa43a3a2ad34858594e329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b10172715d423eb887d6c5b171defb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:37.634503 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-a06b96ed-821d-4d0f-b1b3-eb9497c5c63d tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:00:37.635494 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-a06b96ed-821d-4d0f-b1b3-eb9497c5c63d tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] [instance: 579b0f8b-ccae-4c2b-bb48-1da1aaf6a138] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:37.636128 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-66f8407e-306a-4653-a557-f0976fb798e1 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] 10.222.0.26 "GET /compute/v2.1/servers/a8b2f857-6c24-45fe-b934-cf92b2d18b7a" status: 200 len: 1324 microversion: 2.1 time: 0.367911 Oct 08 21:00:37.642238 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1120/2209] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:37 2022] GET /compute/v2.1/servers/a8b2f857-6c24-45fe-b934-cf92b2d18b7a => generated 1324 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:37.648259 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a06b96ed-821d-4d0f-b1b3-eb9497c5c63d tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:37.649031 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a06b96ed-821d-4d0f-b1b3-eb9497c5c63d tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:37.649570 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a06b96ed-821d-4d0f-b1b3-eb9497c5c63d tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:37.650450 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a06b96ed-821d-4d0f-b1b3-eb9497c5c63d tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:37.651236 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a06b96ed-821d-4d0f-b1b3-eb9497c5c63d tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:37.651888 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a06b96ed-821d-4d0f-b1b3-eb9497c5c63d tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:37.742129 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-a06b96ed-821d-4d0f-b1b3-eb9497c5c63d tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] 10.222.0.26 "POST /compute/v2.1/servers/579b0f8b-ccae-4c2b-bb48-1da1aaf6a138/action" status: 202 len: 0 microversion: 2.1 time: 0.124288 Oct 08 21:00:37.751716 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-6f0ae292-3258-43cc-b2d0-0012e47abbb0 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:37.752349 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-6f0ae292-3258-43cc-b2d0-0012e47abbb0 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] [instance: 579b0f8b-ccae-4c2b-bb48-1da1aaf6a138] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:37.759114 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1090/2210] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:00:37 2022] POST /compute/v2.1/servers/579b0f8b-ccae-4c2b-bb48-1da1aaf6a138/action => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 08 21:00:37.762458 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6f0ae292-3258-43cc-b2d0-0012e47abbb0 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:37.762993 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6f0ae292-3258-43cc-b2d0-0012e47abbb0 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:37.765165 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6f0ae292-3258-43cc-b2d0-0012e47abbb0 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:37.766217 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6f0ae292-3258-43cc-b2d0-0012e47abbb0 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:37.767117 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6f0ae292-3258-43cc-b2d0-0012e47abbb0 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:37.767723 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6f0ae292-3258-43cc-b2d0-0012e47abbb0 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:37.932225 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-6f0ae292-3258-43cc-b2d0-0012e47abbb0 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1698dee4a2bf4ea19a6ee0c3d5cb5c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b00ee5e7828469f95bd90548d35982a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:37.950278 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-6f0ae292-3258-43cc-b2d0-0012e47abbb0 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] 10.222.0.26 "GET /compute/v2.1/servers/579b0f8b-ccae-4c2b-bb48-1da1aaf6a138" status: 200 len: 1522 microversion: 2.1 time: 0.202932 Oct 08 21:00:37.950884 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1121/2211] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:37 2022] GET /compute/v2.1/servers/579b0f8b-ccae-4c2b-bb48-1da1aaf6a138 => generated 1522 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:00:37.974609 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-259e0660-aeb6-4fda-aa5a-dc6589d6dd2d tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:37.975325 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-259e0660-aeb6-4fda-aa5a-dc6589d6dd2d tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] [instance: 3622a27e-b943-49a7-8d81-a6f553c32f7a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:37.983150 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-259e0660-aeb6-4fda-aa5a-dc6589d6dd2d tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:37.983640 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-259e0660-aeb6-4fda-aa5a-dc6589d6dd2d tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:37.984447 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-259e0660-aeb6-4fda-aa5a-dc6589d6dd2d tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:37.985802 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-259e0660-aeb6-4fda-aa5a-dc6589d6dd2d tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:37.986433 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-259e0660-aeb6-4fda-aa5a-dc6589d6dd2d tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:37.987020 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-259e0660-aeb6-4fda-aa5a-dc6589d6dd2d tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:38.099022 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-10b4a591-1531-4bd4-a889-ea85069a6204 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:38.099654 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-10b4a591-1531-4bd4-a889-ea85069a6204 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: 38b000d3-167b-4f7a-ab80-cd51fcb7cbaf] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:38.110080 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-10b4a591-1531-4bd4-a889-ea85069a6204 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:38.110789 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-10b4a591-1531-4bd4-a889-ea85069a6204 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:38.111387 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-10b4a591-1531-4bd4-a889-ea85069a6204 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:38.112308 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-10b4a591-1531-4bd4-a889-ea85069a6204 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:38.113048 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-10b4a591-1531-4bd4-a889-ea85069a6204 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:38.113655 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-10b4a591-1531-4bd4-a889-ea85069a6204 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:38.154045 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-259e0660-aeb6-4fda-aa5a-dc6589d6dd2d tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '463a3aac627c43d7af0dbc9facb52076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac791938e6384c8c8473ffd65cf867a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:38.162435 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-259e0660-aeb6-4fda-aa5a-dc6589d6dd2d tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] 10.222.0.26 "GET /compute/v2.1/servers/3622a27e-b943-49a7-8d81-a6f553c32f7a" status: 200 len: 1322 microversion: 2.1 time: 0.192007 Oct 08 21:00:38.166051 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1091/2212] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:37 2022] GET /compute/v2.1/servers/3622a27e-b943-49a7-8d81-a6f553c32f7a => generated 1322 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:38.206945 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-10b4a591-1531-4bd4-a889-ea85069a6204 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:38.216076 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-10b4a591-1531-4bd4-a889-ea85069a6204 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/38b000d3-167b-4f7a-ab80-cd51fcb7cbaf" status: 200 len: 1216 microversion: 2.1 time: 0.120850 Oct 08 21:00:38.216665 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1122/2213] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:38 2022] GET /compute/v2.1/servers/38b000d3-167b-4f7a-ab80-cd51fcb7cbaf => generated 1216 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:00:38.328637 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-be08f0e7-4a32-4e47-b1b5-e7d0906bd2fd req-6c3e0665-cf42-4731-9a60-cbf4b81226eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d02ba7e0-a550-4e8e-a3ab-37ed519e22b0", "name": "network-vif-plugged", "status": "completed", "tag": "b0bda0a3-50c5-4910-8348-ff8c20ea254b"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:00:38.339458 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-be08f0e7-4a32-4e47-b1b5-e7d0906bd2fd req-6c3e0665-cf42-4731-9a60-cbf4b81226eb service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:38.339944 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-be08f0e7-4a32-4e47-b1b5-e7d0906bd2fd req-6c3e0665-cf42-4731-9a60-cbf4b81226eb service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:38.340448 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-be08f0e7-4a32-4e47-b1b5-e7d0906bd2fd req-6c3e0665-cf42-4731-9a60-cbf4b81226eb service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:38.344275 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:00:38.352388 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-be08f0e7-4a32-4e47-b1b5-e7d0906bd2fd req-6c3e0665-cf42-4731-9a60-cbf4b81226eb service nova] Creating event network-vif-plugged:b0bda0a3-50c5-4910-8348-ff8c20ea254b for instance d02ba7e0-a550-4e8e-a3ab-37ed519e22b0 on nch1-master-1 Oct 08 21:00:38.358136 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-be08f0e7-4a32-4e47-b1b5-e7d0906bd2fd req-6c3e0665-cf42-4731-9a60-cbf4b81226eb service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033282 Oct 08 21:00:38.359037 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1092/2214] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:00:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:00:38.599940 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-34bcd1b7-7226-4e16-bb77-a5c898130acf tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:38.600578 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-34bcd1b7-7226-4e16-bb77-a5c898130acf tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] [instance: 50c38cf5-c054-447c-99a8-10bae624b09a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:38.608514 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-34bcd1b7-7226-4e16-bb77-a5c898130acf tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:38.609008 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-34bcd1b7-7226-4e16-bb77-a5c898130acf tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:38.609504 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-34bcd1b7-7226-4e16-bb77-a5c898130acf tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:38.610177 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-34bcd1b7-7226-4e16-bb77-a5c898130acf tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:38.610640 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-34bcd1b7-7226-4e16-bb77-a5c898130acf tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:38.611100 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-34bcd1b7-7226-4e16-bb77-a5c898130acf tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:38.665505 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-44444370-1d54-47ae-baee-1400c70e586b tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:38.666248 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-44444370-1d54-47ae-baee-1400c70e586b tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] [instance: a8b2f857-6c24-45fe-b934-cf92b2d18b7a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:38.681590 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-44444370-1d54-47ae-baee-1400c70e586b tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:38.682111 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-44444370-1d54-47ae-baee-1400c70e586b tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:38.682554 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-44444370-1d54-47ae-baee-1400c70e586b tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:38.683264 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-44444370-1d54-47ae-baee-1400c70e586b tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:38.683757 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-44444370-1d54-47ae-baee-1400c70e586b tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:38.684182 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-44444370-1d54-47ae-baee-1400c70e586b tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:38.785096 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-34bcd1b7-7226-4e16-bb77-a5c898130acf tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ddc3cd3c374bacbe5bf5e0877380e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8472b054404c46a99b81aba34d6b9f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:38.794283 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-34bcd1b7-7226-4e16-bb77-a5c898130acf tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] 10.222.0.26 "GET /compute/v2.1/servers/50c38cf5-c054-447c-99a8-10bae624b09a" status: 200 len: 1473 microversion: 2.1 time: 0.198236 Oct 08 21:00:38.795267 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1123/2215] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:38 2022] GET /compute/v2.1/servers/50c38cf5-c054-447c-99a8-10bae624b09a => generated 1473 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:38.838725 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-44444370-1d54-47ae-baee-1400c70e586b tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06caf10b6fa43a3a2ad34858594e329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b10172715d423eb887d6c5b171defb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:38.848075 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-44444370-1d54-47ae-baee-1400c70e586b tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] 10.222.0.26 "GET /compute/v2.1/servers/a8b2f857-6c24-45fe-b934-cf92b2d18b7a" status: 200 len: 1324 microversion: 2.1 time: 0.186694 Oct 08 21:00:38.848688 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1093/2216] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:38 2022] GET /compute/v2.1/servers/a8b2f857-6c24-45fe-b934-cf92b2d18b7a => generated 1324 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:38.975266 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-d64caa51-a517-4954-b801-de59b85d2f01 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:38.976417 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-d64caa51-a517-4954-b801-de59b85d2f01 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] [instance: 579b0f8b-ccae-4c2b-bb48-1da1aaf6a138] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:38.996724 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d64caa51-a517-4954-b801-de59b85d2f01 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:38.997274 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d64caa51-a517-4954-b801-de59b85d2f01 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:38.997901 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d64caa51-a517-4954-b801-de59b85d2f01 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:39.000074 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d64caa51-a517-4954-b801-de59b85d2f01 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:39.000813 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d64caa51-a517-4954-b801-de59b85d2f01 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:39.001740 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d64caa51-a517-4954-b801-de59b85d2f01 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:39.166206 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-d64caa51-a517-4954-b801-de59b85d2f01 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1698dee4a2bf4ea19a6ee0c3d5cb5c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b00ee5e7828469f95bd90548d35982a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:39.175287 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-d64caa51-a517-4954-b801-de59b85d2f01 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] 10.222.0.26 "GET /compute/v2.1/servers/579b0f8b-ccae-4c2b-bb48-1da1aaf6a138" status: 200 len: 1502 microversion: 2.1 time: 0.205506 Oct 08 21:00:39.176123 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1124/2217] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:38 2022] GET /compute/v2.1/servers/579b0f8b-ccae-4c2b-bb48-1da1aaf6a138 => generated 1502 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:39.197900 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c3d46793-7460-4ad4-9922-c50101102139 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:39.199092 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-c3d46793-7460-4ad4-9922-c50101102139 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] [instance: 3622a27e-b943-49a7-8d81-a6f553c32f7a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:39.212102 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c3d46793-7460-4ad4-9922-c50101102139 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:39.213577 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c3d46793-7460-4ad4-9922-c50101102139 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:39.213844 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-d7321c8a-37a8-408b-a0b2-e12e2e78d04a tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:00:39.214133 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c3d46793-7460-4ad4-9922-c50101102139 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:39.216118 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c3d46793-7460-4ad4-9922-c50101102139 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:39.216731 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c3d46793-7460-4ad4-9922-c50101102139 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:39.217178 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c3d46793-7460-4ad4-9922-c50101102139 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:39.217700 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-d7321c8a-37a8-408b-a0b2-e12e2e78d04a tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] [instance: 579b0f8b-ccae-4c2b-bb48-1da1aaf6a138] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:39.224827 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d7321c8a-37a8-408b-a0b2-e12e2e78d04a tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:39.226276 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d7321c8a-37a8-408b-a0b2-e12e2e78d04a tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:39.226276 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d7321c8a-37a8-408b-a0b2-e12e2e78d04a tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:39.226956 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d7321c8a-37a8-408b-a0b2-e12e2e78d04a tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:39.227549 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d7321c8a-37a8-408b-a0b2-e12e2e78d04a tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:39.228109 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d7321c8a-37a8-408b-a0b2-e12e2e78d04a tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:39.256338 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.objects.instance [None req-d7321c8a-37a8-408b-a0b2-e12e2e78d04a tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lazy-loading 'flavor' on Instance uuid 579b0f8b-ccae-4c2b-bb48-1da1aaf6a138 {{(pid=140492) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 21:00:39.274736 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-d7321c8a-37a8-408b-a0b2-e12e2e78d04a tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] HTTP exception thrown: Cannot 'rescue' instance 579b0f8b-ccae-4c2b-bb48-1da1aaf6a138 while it is in vm_state paused Oct 08 21:00:39.280205 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-d7321c8a-37a8-408b-a0b2-e12e2e78d04a tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Request method failure captured: Oct 08 21:00:39.280205 ncdv-master-1 devstack@n-api.service[140492]: request: POST /compute/v2.1/servers/579b0f8b-ccae-4c2b-bb48-1da1aaf6a138/action HTTP/1.1 Oct 08 21:00:39.280205 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:00:39.280205 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:00:39.280205 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:00:39.280205 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 14 Oct 08 21:00:39.280205 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:00:39.280205 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:00:39.280205 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:00:39.280205 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:00:39.280205 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeS0fE1W4PvU2_7k8u76nOm9Y1zh9DtzN6SifZox8c4Ee-O4iYj3CcpXLLEG93O-SwetyStVJsCOhK1z0DAluVdyejBt-R2ozc-SxCa3q7lzUNWL-Kx89hV0cNzOobKFM-EJsBUodFQ4EWnFtqD_Q-5HZD9KoD2jZ3YWHd3RuK5iGsY Oct 08 21:00:39.280205 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:00:39.280205 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:00:39.280205 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:00:39.280205 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:00:39.280205 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:00:39.280205 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:00:39.280205 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 8b00ee5e7828469f95bd90548d35982a Oct 08 21:00:39.280205 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1823882791 Oct 08 21:00:39.280205 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:00:39.280205 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:00:39.280205 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8b00ee5e7828469f95bd90548d35982a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8b00ee5e7828469f95bd90548d35982a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8b00ee5e7828469f95bd90548d35982a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8b00ee5e7828469f95bd90548d35982a"}]}] Oct 08 21:00:39.280205 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1823882791 Oct 08 21:00:39.280205 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 8b00ee5e7828469f95bd90548d35982a Oct 08 21:00:39.280205 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1823882791 Oct 08 21:00:39.280205 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-ServerRescueNegativeTestJSON-1823882791-project Oct 08 21:00:39.280205 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:00:39.280205 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:00:39.280205 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 1698dee4a2bf4ea19a6ee0c3d5cb5c09 Oct 08 21:00:39.280205 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1823882791-project Oct 08 21:00:39.280205 ncdv-master-1 devstack@n-api.service[140492]: Oct 08 21:00:39.280205 ncdv-master-1 devstack@n-api.service[140492]: {"rescue": {}} Oct 08 21:00:39.280205 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 21:00:39.280205 ncdv-master-1 devstack@n-api.service[140492]: exception: Cannot 'rescue' instance 579b0f8b-ccae-4c2b-bb48-1da1aaf6a138 while it is in vm_state paused Oct 08 21:00:39.280205 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': '579b0f8b-ccae-4c2b-bb48-1da1aaf6a138', 'body': {'rescue': {}}} Oct 08 21:00:39.280205 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:00:39.280205 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:00:39.280205 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Oct 08 21:00:39.280205 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Oct 08 21:00:39.280205 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 08 21:00:39.280205 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 08 21:00:39.280205 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 08 21:00:39.280205 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 08 21:00:39.280205 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 08 21:00:39.280205 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 08 21:00:39.280205 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 579b0f8b-ccae-4c2b-bb48-1da1aaf6a138 in vm_state paused. Cannot rescue while the instance is in this state. Oct 08 21:00:39.280205 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:00:39.280205 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:00:39.280205 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:00:39.280205 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:00:39.280205 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:00:39.280205 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:00:39.280205 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:00:39.280205 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:00:39.280205 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:00:39.280205 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:00:39.280205 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 21:00:39.280205 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 21:00:39.280205 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Oct 08 21:00:39.280205 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Oct 08 21:00:39.280205 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 08 21:00:39.280205 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 08 21:00:39.280205 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance 579b0f8b-ccae-4c2b-bb48-1da1aaf6a138 while it is in vm_state paused Oct 08 21:00:39.280205 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:00:39.287265 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:00:39.287265 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:00:39.287265 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:00:39.287265 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:00:39.287265 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:00:39.287265 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:00:39.287265 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:00:39.287265 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance 579b0f8b-ccae-4c2b-bb48-1da1aaf6a138 while it is in vm_state paused Oct 08 21:00:39.287265 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:00:39.287265 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-d7321c8a-37a8-408b-a0b2-e12e2e78d04a tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Returning 409 to user: Cannot 'rescue' instance 579b0f8b-ccae-4c2b-bb48-1da1aaf6a138 while it is in vm_state paused {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:00:39.287265 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-d7321c8a-37a8-408b-a0b2-e12e2e78d04a tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] 10.222.0.26 "POST /compute/v2.1/servers/579b0f8b-ccae-4c2b-bb48-1da1aaf6a138/action" status: 409 len: 144 microversion: 2.1 time: 0.077963 Oct 08 21:00:39.287265 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1125/2218] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:00:39 2022] POST /compute/v2.1/servers/579b0f8b-ccae-4c2b-bb48-1da1aaf6a138/action => generated 144 bytes in 83 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 08 21:00:39.292523 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-9f281d98-5bf3-4425-aa3e-8b1f511a9b04 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:39.294345 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-9f281d98-5bf3-4425-aa3e-8b1f511a9b04 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: 38b000d3-167b-4f7a-ab80-cd51fcb7cbaf] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:39.301509 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9f281d98-5bf3-4425-aa3e-8b1f511a9b04 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:39.302009 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9f281d98-5bf3-4425-aa3e-8b1f511a9b04 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:39.302484 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9f281d98-5bf3-4425-aa3e-8b1f511a9b04 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:39.303906 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9f281d98-5bf3-4425-aa3e-8b1f511a9b04 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:39.304536 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9f281d98-5bf3-4425-aa3e-8b1f511a9b04 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:39.304966 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9f281d98-5bf3-4425-aa3e-8b1f511a9b04 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:39.393468 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-9f281d98-5bf3-4425-aa3e-8b1f511a9b04 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:39.408768 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-9f281d98-5bf3-4425-aa3e-8b1f511a9b04 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/38b000d3-167b-4f7a-ab80-cd51fcb7cbaf" status: 200 len: 1208 microversion: 2.1 time: 0.121787 Oct 08 21:00:39.410174 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1126/2219] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:39 2022] GET /compute/v2.1/servers/38b000d3-167b-4f7a-ab80-cd51fcb7cbaf => generated 1208 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:39.427206 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-a931d900-4e6c-41dc-abf7-f0764a1272ef tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:00:39.428107 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-a931d900-4e6c-41dc-abf7-f0764a1272ef tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] [instance: 579b0f8b-ccae-4c2b-bb48-1da1aaf6a138] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:39.436251 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a931d900-4e6c-41dc-abf7-f0764a1272ef tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:39.437223 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a931d900-4e6c-41dc-abf7-f0764a1272ef tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:39.437549 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a931d900-4e6c-41dc-abf7-f0764a1272ef tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:39.438644 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a931d900-4e6c-41dc-abf7-f0764a1272ef tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:39.439534 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a931d900-4e6c-41dc-abf7-f0764a1272ef tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:39.439534 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a931d900-4e6c-41dc-abf7-f0764a1272ef tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:39.531512 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-a931d900-4e6c-41dc-abf7-f0764a1272ef tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] 10.222.0.26 "POST /compute/v2.1/servers/579b0f8b-ccae-4c2b-bb48-1da1aaf6a138/action" status: 202 len: 0 microversion: 2.1 time: 0.119108 Oct 08 21:00:39.536021 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1127/2220] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:00:39 2022] POST /compute/v2.1/servers/579b0f8b-ccae-4c2b-bb48-1da1aaf6a138/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 21:00:39.542684 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-220df771-6101-4083-8ed3-b2028c2a78c1 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:39.543967 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-220df771-6101-4083-8ed3-b2028c2a78c1 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] [instance: 579b0f8b-ccae-4c2b-bb48-1da1aaf6a138] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:39.563389 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-220df771-6101-4083-8ed3-b2028c2a78c1 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:39.564749 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-220df771-6101-4083-8ed3-b2028c2a78c1 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:39.566331 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-220df771-6101-4083-8ed3-b2028c2a78c1 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:39.568109 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-220df771-6101-4083-8ed3-b2028c2a78c1 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:39.569519 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-220df771-6101-4083-8ed3-b2028c2a78c1 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:39.582021 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-220df771-6101-4083-8ed3-b2028c2a78c1 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:39.602423 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-c3d46793-7460-4ad4-9922-c50101102139 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '463a3aac627c43d7af0dbc9facb52076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac791938e6384c8c8473ffd65cf867a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:39.614139 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-c3d46793-7460-4ad4-9922-c50101102139 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] 10.222.0.26 "GET /compute/v2.1/servers/3622a27e-b943-49a7-8d81-a6f553c32f7a" status: 200 len: 1322 microversion: 2.1 time: 0.422570 Oct 08 21:00:39.614901 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1094/2221] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:39 2022] GET /compute/v2.1/servers/3622a27e-b943-49a7-8d81-a6f553c32f7a => generated 1322 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:39.833494 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-6269af36-d2af-45a1-89bc-04b742ff0333 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:39.834436 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-6269af36-d2af-45a1-89bc-04b742ff0333 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] [instance: 50c38cf5-c054-447c-99a8-10bae624b09a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:39.850149 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-220df771-6101-4083-8ed3-b2028c2a78c1 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1698dee4a2bf4ea19a6ee0c3d5cb5c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b00ee5e7828469f95bd90548d35982a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:39.855865 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6269af36-d2af-45a1-89bc-04b742ff0333 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:39.856641 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6269af36-d2af-45a1-89bc-04b742ff0333 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:39.857522 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6269af36-d2af-45a1-89bc-04b742ff0333 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:39.858385 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6269af36-d2af-45a1-89bc-04b742ff0333 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:39.858847 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6269af36-d2af-45a1-89bc-04b742ff0333 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:39.859842 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6269af36-d2af-45a1-89bc-04b742ff0333 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:39.869750 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-220df771-6101-4083-8ed3-b2028c2a78c1 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] 10.222.0.26 "GET /compute/v2.1/servers/579b0f8b-ccae-4c2b-bb48-1da1aaf6a138" status: 200 len: 1509 microversion: 2.1 time: 0.327508 Oct 08 21:00:39.872503 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1128/2222] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:39 2022] GET /compute/v2.1/servers/579b0f8b-ccae-4c2b-bb48-1da1aaf6a138 => generated 1509 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:39.885902 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-831f883f-3bf3-4603-82d9-c7d670791307 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:39.887935 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-831f883f-3bf3-4603-82d9-c7d670791307 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] [instance: a8b2f857-6c24-45fe-b934-cf92b2d18b7a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:39.903100 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-831f883f-3bf3-4603-82d9-c7d670791307 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:39.905874 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-831f883f-3bf3-4603-82d9-c7d670791307 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:39.906581 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-831f883f-3bf3-4603-82d9-c7d670791307 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:39.909463 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-831f883f-3bf3-4603-82d9-c7d670791307 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:39.910182 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-831f883f-3bf3-4603-82d9-c7d670791307 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:39.910789 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-831f883f-3bf3-4603-82d9-c7d670791307 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:40.170043 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-6269af36-d2af-45a1-89bc-04b742ff0333 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ddc3cd3c374bacbe5bf5e0877380e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8472b054404c46a99b81aba34d6b9f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:40.194864 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-6269af36-d2af-45a1-89bc-04b742ff0333 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] 10.222.0.26 "GET /compute/v2.1/servers/50c38cf5-c054-447c-99a8-10bae624b09a" status: 200 len: 1473 microversion: 2.1 time: 0.376862 Oct 08 21:00:40.197818 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1095/2223] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:39 2022] GET /compute/v2.1/servers/50c38cf5-c054-447c-99a8-10bae624b09a => generated 1473 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:00:40.208212 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-831f883f-3bf3-4603-82d9-c7d670791307 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06caf10b6fa43a3a2ad34858594e329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b10172715d423eb887d6c5b171defb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:40.224268 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-831f883f-3bf3-4603-82d9-c7d670791307 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] 10.222.0.26 "GET /compute/v2.1/servers/a8b2f857-6c24-45fe-b934-cf92b2d18b7a" status: 200 len: 1324 microversion: 2.1 time: 0.349574 Oct 08 21:00:40.227174 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1129/2224] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:39 2022] GET /compute/v2.1/servers/a8b2f857-6c24-45fe-b934-cf92b2d18b7a => generated 1324 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:40.436058 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-b7b60150-dd36-4770-b28f-4fe3a86bd01a req-506d678e-bf18-4faa-9f16-468e0fcc5dee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50c38cf5-c054-447c-99a8-10bae624b09a", "name": "network-vif-deleted", "tag": "f499078f-7a9e-454a-a5d3-4496996e319d"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:00:40.441853 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-5f7a24ba-bb83-4740-a196-abbe25b80ff1 req-2c0780ba-4ae4-4e2c-9b1d-14bbef19629f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8b2f857-6c24-45fe-b934-cf92b2d18b7a", "name": "network-vif-plugged", "status": "completed", "tag": "d02c5c7d-36e9-42cf-a666-f4a9ae2674ec"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:00:40.492259 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-b7b60150-dd36-4770-b28f-4fe3a86bd01a req-506d678e-bf18-4faa-9f16-468e0fcc5dee service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:40.494528 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-b7b60150-dd36-4770-b28f-4fe3a86bd01a req-506d678e-bf18-4faa-9f16-468e0fcc5dee service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:40.495396 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-b7b60150-dd36-4770-b28f-4fe3a86bd01a req-506d678e-bf18-4faa-9f16-468e0fcc5dee service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:40.497539 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-5f7a24ba-bb83-4740-a196-abbe25b80ff1 req-2c0780ba-4ae4-4e2c-9b1d-14bbef19629f service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:40.499296 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-5f7a24ba-bb83-4740-a196-abbe25b80ff1 req-2c0780ba-4ae4-4e2c-9b1d-14bbef19629f service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:40.501666 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-5f7a24ba-bb83-4740-a196-abbe25b80ff1 req-2c0780ba-4ae4-4e2c-9b1d-14bbef19629f service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:40.524406 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-b7b60150-dd36-4770-b28f-4fe3a86bd01a req-506d678e-bf18-4faa-9f16-468e0fcc5dee service nova] Creating event network-vif-deleted:f499078f-7a9e-454a-a5d3-4496996e319d for instance 50c38cf5-c054-447c-99a8-10bae624b09a on nch2-master-1 Oct 08 21:00:40.530648 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-5f7a24ba-bb83-4740-a196-abbe25b80ff1 req-2c0780ba-4ae4-4e2c-9b1d-14bbef19629f service nova] Creating event network-vif-plugged:d02c5c7d-36e9-42cf-a666-f4a9ae2674ec for instance a8b2f857-6c24-45fe-b934-cf92b2d18b7a on nch2-master-1 Oct 08 21:00:40.538626 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-b7b60150-dd36-4770-b28f-4fe3a86bd01a req-506d678e-bf18-4faa-9f16-468e0fcc5dee service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109396 Oct 08 21:00:40.540236 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1130/2225] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:00:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:00:40.548071 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-5f7a24ba-bb83-4740-a196-abbe25b80ff1 req-2c0780ba-4ae4-4e2c-9b1d-14bbef19629f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119799 Oct 08 21:00:40.551778 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1096/2226] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:00:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 08 21:00:40.556826 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-aa7f81a9-c274-42ee-bb86-46c232120f6e tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:40.557924 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-aa7f81a9-c274-42ee-bb86-46c232120f6e tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: 38b000d3-167b-4f7a-ab80-cd51fcb7cbaf] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:40.565799 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-aa7f81a9-c274-42ee-bb86-46c232120f6e tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:40.567441 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-aa7f81a9-c274-42ee-bb86-46c232120f6e tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:40.568081 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-aa7f81a9-c274-42ee-bb86-46c232120f6e tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:40.569158 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-aa7f81a9-c274-42ee-bb86-46c232120f6e tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:40.570508 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-aa7f81a9-c274-42ee-bb86-46c232120f6e tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:40.571261 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-aa7f81a9-c274-42ee-bb86-46c232120f6e tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:40.645154 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-915eff6d-1cc9-4e5a-8f21-334aa7f12f73 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:40.646377 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-915eff6d-1cc9-4e5a-8f21-334aa7f12f73 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] [instance: 3622a27e-b943-49a7-8d81-a6f553c32f7a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:40.665787 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-915eff6d-1cc9-4e5a-8f21-334aa7f12f73 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:40.666776 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-915eff6d-1cc9-4e5a-8f21-334aa7f12f73 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:40.667644 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-915eff6d-1cc9-4e5a-8f21-334aa7f12f73 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:40.669696 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-915eff6d-1cc9-4e5a-8f21-334aa7f12f73 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:40.670675 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-915eff6d-1cc9-4e5a-8f21-334aa7f12f73 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:40.671393 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-915eff6d-1cc9-4e5a-8f21-334aa7f12f73 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:41.174849 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-aa7f81a9-c274-42ee-bb86-46c232120f6e tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:41.191236 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-aa7f81a9-c274-42ee-bb86-46c232120f6e tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/38b000d3-167b-4f7a-ab80-cd51fcb7cbaf" status: 200 len: 1270 microversion: 2.1 time: 0.647180 Oct 08 21:00:41.193075 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1131/2227] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:40 2022] GET /compute/v2.1/servers/38b000d3-167b-4f7a-ab80-cd51fcb7cbaf => generated 1270 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:41.202493 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-0506a3e4-858d-4896-967a-781d0bea7421 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:41.203967 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-0506a3e4-858d-4896-967a-781d0bea7421 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] [instance: 579b0f8b-ccae-4c2b-bb48-1da1aaf6a138] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:41.208261 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-915eff6d-1cc9-4e5a-8f21-334aa7f12f73 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '463a3aac627c43d7af0dbc9facb52076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac791938e6384c8c8473ffd65cf867a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:41.214539 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0506a3e4-858d-4896-967a-781d0bea7421 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:41.216363 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0506a3e4-858d-4896-967a-781d0bea7421 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:41.216982 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0506a3e4-858d-4896-967a-781d0bea7421 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:41.222054 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0506a3e4-858d-4896-967a-781d0bea7421 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:41.223381 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0506a3e4-858d-4896-967a-781d0bea7421 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:41.223535 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-915eff6d-1cc9-4e5a-8f21-334aa7f12f73 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] 10.222.0.26 "GET /compute/v2.1/servers/3622a27e-b943-49a7-8d81-a6f553c32f7a" status: 200 len: 1322 microversion: 2.1 time: 0.584635 Oct 08 21:00:41.224101 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1097/2228] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:40 2022] GET /compute/v2.1/servers/3622a27e-b943-49a7-8d81-a6f553c32f7a => generated 1322 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:41.235708 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-a82ecf2c-58d5-4439-a36e-597754065fa3 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:41.235708 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-a82ecf2c-58d5-4439-a36e-597754065fa3 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] [instance: 50c38cf5-c054-447c-99a8-10bae624b09a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:41.239201 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0506a3e4-858d-4896-967a-781d0bea7421 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:41.241938 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a82ecf2c-58d5-4439-a36e-597754065fa3 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:41.242462 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a82ecf2c-58d5-4439-a36e-597754065fa3 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:41.242912 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a82ecf2c-58d5-4439-a36e-597754065fa3 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:41.243725 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a82ecf2c-58d5-4439-a36e-597754065fa3 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:41.244190 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a82ecf2c-58d5-4439-a36e-597754065fa3 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:41.244626 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a82ecf2c-58d5-4439-a36e-597754065fa3 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:41.369793 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a82ecf2c-58d5-4439-a36e-597754065fa3 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:41.370390 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a82ecf2c-58d5-4439-a36e-597754065fa3 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:41.371558 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a82ecf2c-58d5-4439-a36e-597754065fa3 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:41.372306 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.objects.instance [None req-a82ecf2c-58d5-4439-a36e-597754065fa3 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lazy-loading 'fault' on Instance uuid 50c38cf5-c054-447c-99a8-10bae624b09a {{(pid=140491) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 21:00:41.445586 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-a82ecf2c-58d5-4439-a36e-597754065fa3 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ddc3cd3c374bacbe5bf5e0877380e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8472b054404c46a99b81aba34d6b9f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:41.470422 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-a82ecf2c-58d5-4439-a36e-597754065fa3 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] 10.222.0.26 "GET /compute/v2.1/servers/50c38cf5-c054-447c-99a8-10bae624b09a" status: 200 len: 1307 microversion: 2.1 time: 0.245230 Oct 08 21:00:41.472847 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1098/2229] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:41 2022] GET /compute/v2.1/servers/50c38cf5-c054-447c-99a8-10bae624b09a => generated 1307 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:41.477814 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-1dc7d93f-ec48-4688-aa66-2e100227f459 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:41.478704 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-1dc7d93f-ec48-4688-aa66-2e100227f459 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] [instance: a8b2f857-6c24-45fe-b934-cf92b2d18b7a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:41.489357 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1dc7d93f-ec48-4688-aa66-2e100227f459 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:41.490177 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1dc7d93f-ec48-4688-aa66-2e100227f459 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:41.490872 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1dc7d93f-ec48-4688-aa66-2e100227f459 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:41.491812 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1dc7d93f-ec48-4688-aa66-2e100227f459 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:41.492482 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1dc7d93f-ec48-4688-aa66-2e100227f459 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:41.493129 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1dc7d93f-ec48-4688-aa66-2e100227f459 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:41.582719 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-0506a3e4-858d-4896-967a-781d0bea7421 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1698dee4a2bf4ea19a6ee0c3d5cb5c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b00ee5e7828469f95bd90548d35982a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:41.591862 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-0506a3e4-858d-4896-967a-781d0bea7421 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] 10.222.0.26 "GET /compute/v2.1/servers/579b0f8b-ccae-4c2b-bb48-1da1aaf6a138" status: 200 len: 1517 microversion: 2.1 time: 0.396948 Oct 08 21:00:41.595751 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1132/2230] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:41 2022] GET /compute/v2.1/servers/579b0f8b-ccae-4c2b-bb48-1da1aaf6a138 => generated 1517 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:41.879822 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-1dc7d93f-ec48-4688-aa66-2e100227f459 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06caf10b6fa43a3a2ad34858594e329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b10172715d423eb887d6c5b171defb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:41.897536 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-1dc7d93f-ec48-4688-aa66-2e100227f459 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] 10.222.0.26 "GET /compute/v2.1/servers/a8b2f857-6c24-45fe-b934-cf92b2d18b7a" status: 200 len: 1324 microversion: 2.1 time: 0.422392 Oct 08 21:00:41.914875 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1099/2231] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:41 2022] GET /compute/v2.1/servers/a8b2f857-6c24-45fe-b934-cf92b2d18b7a => generated 1324 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:42.220674 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-4cc170c7-30c3-408e-aa2a-d0aad18ccae2 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:42.221698 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-4cc170c7-30c3-408e-aa2a-d0aad18ccae2 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: 38b000d3-167b-4f7a-ab80-cd51fcb7cbaf] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:42.254374 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-3c583559-fb9f-41aa-aee1-5b530ee7b367 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:42.255284 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-3c583559-fb9f-41aa-aee1-5b530ee7b367 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] [instance: 3622a27e-b943-49a7-8d81-a6f553c32f7a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:42.262776 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4cc170c7-30c3-408e-aa2a-d0aad18ccae2 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:42.263294 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4cc170c7-30c3-408e-aa2a-d0aad18ccae2 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:42.268466 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3c583559-fb9f-41aa-aee1-5b530ee7b367 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:42.269197 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4cc170c7-30c3-408e-aa2a-d0aad18ccae2 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:42.269980 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3c583559-fb9f-41aa-aee1-5b530ee7b367 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:42.270120 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4cc170c7-30c3-408e-aa2a-d0aad18ccae2 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:42.270476 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4cc170c7-30c3-408e-aa2a-d0aad18ccae2 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:42.271276 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3c583559-fb9f-41aa-aee1-5b530ee7b367 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:42.272316 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3c583559-fb9f-41aa-aee1-5b530ee7b367 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:42.275421 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3c583559-fb9f-41aa-aee1-5b530ee7b367 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:42.276145 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3c583559-fb9f-41aa-aee1-5b530ee7b367 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:42.276703 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4cc170c7-30c3-408e-aa2a-d0aad18ccae2 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:42.641939 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-4cc170c7-30c3-408e-aa2a-d0aad18ccae2 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:42.651417 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-4cc170c7-30c3-408e-aa2a-d0aad18ccae2 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/38b000d3-167b-4f7a-ab80-cd51fcb7cbaf" status: 200 len: 1312 microversion: 2.1 time: 0.434914 Oct 08 21:00:42.655615 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1133/2232] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:42 2022] GET /compute/v2.1/servers/38b000d3-167b-4f7a-ab80-cd51fcb7cbaf => generated 1312 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:42.660568 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-76a778c6-5aeb-47d8-8452-0a524c168036 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:42.662968 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-76a778c6-5aeb-47d8-8452-0a524c168036 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] [instance: 50c38cf5-c054-447c-99a8-10bae624b09a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:42.685543 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-76a778c6-5aeb-47d8-8452-0a524c168036 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:42.686052 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-76a778c6-5aeb-47d8-8452-0a524c168036 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:42.686703 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-76a778c6-5aeb-47d8-8452-0a524c168036 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:42.687613 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-76a778c6-5aeb-47d8-8452-0a524c168036 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:42.688091 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-76a778c6-5aeb-47d8-8452-0a524c168036 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:42.688527 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-76a778c6-5aeb-47d8-8452-0a524c168036 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:42.712945 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-76a778c6-5aeb-47d8-8452-0a524c168036 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] HTTP exception thrown: Instance 50c38cf5-c054-447c-99a8-10bae624b09a could not be found. Oct 08 21:00:42.715295 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-76a778c6-5aeb-47d8-8452-0a524c168036 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Request method failure captured: Oct 08 21:00:42.715295 ncdv-master-1 devstack@n-api.service[140492]: request: GET /compute/v2.1/servers/50c38cf5-c054-447c-99a8-10bae624b09a HTTP/1.1 Oct 08 21:00:42.715295 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:00:42.715295 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:00:42.715295 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:00:42.715295 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 21:00:42.715295 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:00:42.715295 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:00:42.715295 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:00:42.715295 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:00:42.715295 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeRR295mmmZhL7rSOgfacjSsWQ1Ti3FYd30sypy6B-ALaT7WOeiqaScllnDYtpa4eJ1mjmv4WUyVTLu5zt1pdJiZcKAFWv_GnEIqR6TqCn43v4gEmVWskuydtSKspT0UK00dWYkPU4ZM4UBd8cYd3myAyAfY7HLwKtG1LqfYrCLqzow Oct 08 21:00:42.715295 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:00:42.715295 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:00:42.715295 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:00:42.715295 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:00:42.715295 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:00:42.715295 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:00:42.715295 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 8472b054404c46a99b81aba34d6b9f40 Oct 08 21:00:42.715295 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-ServersOnMultiNodesTest-2078873751 Oct 08 21:00:42.715295 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:00:42.715295 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:00:42.715295 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8472b054404c46a99b81aba34d6b9f40"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8472b054404c46a99b81aba34d6b9f40"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8472b054404c46a99b81aba34d6b9f40"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8472b054404c46a99b81aba34d6b9f40"}]}] Oct 08 21:00:42.715295 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-ServersOnMultiNodesTest-2078873751 Oct 08 21:00:42.715295 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 8472b054404c46a99b81aba34d6b9f40 Oct 08 21:00:42.715295 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-2078873751 Oct 08 21:00:42.715295 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-ServersOnMultiNodesTest-2078873751-project Oct 08 21:00:42.715295 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:00:42.715295 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:00:42.715295 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 67ddc3cd3c374bacbe5bf5e0877380e2 Oct 08 21:00:42.715295 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-ServersOnMultiNodesTest-2078873751-project Oct 08 21:00:42.715295 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 21:00:42.715295 ncdv-master-1 devstack@n-api.service[140492]: exception: Instance 50c38cf5-c054-447c-99a8-10bae624b09a could not be found. Oct 08 21:00:42.715295 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': '50c38cf5-c054-447c-99a8-10bae624b09a'} Oct 08 21:00:42.715295 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:00:42.715295 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:00:42.715295 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:00:42.715295 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:00:42.715295 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:00:42.715295 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:00:42.715295 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:00:42.715295 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:00:42.715295 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:00:42.715295 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:00:42.715295 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50c38cf5-c054-447c-99a8-10bae624b09a could not be found. Oct 08 21:00:42.715295 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:00:42.715295 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:00:42.715295 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:00:42.715295 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:00:42.715295 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:00:42.715295 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:00:42.715295 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:00:42.715295 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:00:42.715295 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:00:42.715295 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:00:42.715295 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:00:42.715295 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:00:42.715295 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:00:42.715295 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:00:42.715295 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:00:42.715295 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:00:42.715295 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50c38cf5-c054-447c-99a8-10bae624b09a could not be found. Oct 08 21:00:42.715295 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:00:42.715295 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:00:42.715295 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:00:42.719796 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:00:42.719796 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:00:42.719796 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:00:42.719796 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:00:42.719796 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:00:42.719796 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50c38cf5-c054-447c-99a8-10bae624b09a could not be found. Oct 08 21:00:42.719796 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:00:42.720530 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-76a778c6-5aeb-47d8-8452-0a524c168036 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Returning 404 to user: Instance 50c38cf5-c054-447c-99a8-10bae624b09a could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:00:42.721578 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-76a778c6-5aeb-47d8-8452-0a524c168036 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] 10.222.0.26 "GET /compute/v2.1/servers/50c38cf5-c054-447c-99a8-10bae624b09a" status: 404 len: 111 microversion: 2.1 time: 0.064918 Oct 08 21:00:42.722470 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1134/2233] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:42 2022] GET /compute/v2.1/servers/50c38cf5-c054-447c-99a8-10bae624b09a => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:00:42.736266 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-83bcde27-c00a-4298-b83d-cd45efd1c9c1 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:42.737853 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-83bcde27-c00a-4298-b83d-cd45efd1c9c1 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] [instance: 37daee2e-9629-4664-a85d-da2e8aa5ea2e] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:42.748911 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-83bcde27-c00a-4298-b83d-cd45efd1c9c1 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:42.750093 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-83bcde27-c00a-4298-b83d-cd45efd1c9c1 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:42.751001 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-83bcde27-c00a-4298-b83d-cd45efd1c9c1 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:42.751969 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-83bcde27-c00a-4298-b83d-cd45efd1c9c1 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:42.752806 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-83bcde27-c00a-4298-b83d-cd45efd1c9c1 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:42.753716 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-83bcde27-c00a-4298-b83d-cd45efd1c9c1 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:42.803665 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-83bcde27-c00a-4298-b83d-cd45efd1c9c1 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] [instance: 37daee2e-9629-4664-a85d-da2e8aa5ea2e] Going to try to terminate instance {{(pid=140492) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 21:00:42.875203 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-3c583559-fb9f-41aa-aee1-5b530ee7b367 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '463a3aac627c43d7af0dbc9facb52076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac791938e6384c8c8473ffd65cf867a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:42.883803 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-3c583559-fb9f-41aa-aee1-5b530ee7b367 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] 10.222.0.26 "GET /compute/v2.1/servers/3622a27e-b943-49a7-8d81-a6f553c32f7a" status: 200 len: 1322 microversion: 2.1 time: 0.633438 Oct 08 21:00:42.884404 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1100/2234] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:42 2022] GET /compute/v2.1/servers/3622a27e-b943-49a7-8d81-a6f553c32f7a => generated 1322 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:00:42.909285 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:00:42.948678 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-ba3dd368-fc17-4fa9-93b1-925e80f42ede tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:42.950114 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-ba3dd368-fc17-4fa9-93b1-925e80f42ede tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] [instance: a8b2f857-6c24-45fe-b934-cf92b2d18b7a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:42.969851 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ba3dd368-fc17-4fa9-93b1-925e80f42ede tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:42.970527 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ba3dd368-fc17-4fa9-93b1-925e80f42ede tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:42.971073 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ba3dd368-fc17-4fa9-93b1-925e80f42ede tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:42.972736 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ba3dd368-fc17-4fa9-93b1-925e80f42ede tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:42.975505 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ba3dd368-fc17-4fa9-93b1-925e80f42ede tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:42.977661 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ba3dd368-fc17-4fa9-93b1-925e80f42ede tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:42.988115 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-83bcde27-c00a-4298-b83d-cd45efd1c9c1 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] 10.222.0.26 "DELETE /compute/v2.1/servers/37daee2e-9629-4664-a85d-da2e8aa5ea2e" status: 204 len: 0 microversion: 2.1 time: 0.258969 Oct 08 21:00:42.989656 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1135/2235] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:00:42 2022] DELETE /compute/v2.1/servers/37daee2e-9629-4664-a85d-da2e8aa5ea2e => generated 0 bytes in 262 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 21:00:43.004348 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-a03e2726-f7e9-4c48-abab-01d2b4553323 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:43.005154 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-a03e2726-f7e9-4c48-abab-01d2b4553323 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] [instance: 4be597d7-a3dd-44f3-9d17-946635bea8e6] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:43.016440 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a03e2726-f7e9-4c48-abab-01d2b4553323 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:43.017457 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a03e2726-f7e9-4c48-abab-01d2b4553323 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:43.018132 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a03e2726-f7e9-4c48-abab-01d2b4553323 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:43.019146 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a03e2726-f7e9-4c48-abab-01d2b4553323 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:43.020327 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a03e2726-f7e9-4c48-abab-01d2b4553323 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:43.024371 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a03e2726-f7e9-4c48-abab-01d2b4553323 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:43.083166 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-a03e2726-f7e9-4c48-abab-01d2b4553323 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] [instance: 4be597d7-a3dd-44f3-9d17-946635bea8e6] Going to try to terminate instance {{(pid=140492) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 21:00:43.229670 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:00:43.243386 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-a03e2726-f7e9-4c48-abab-01d2b4553323 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] 10.222.0.26 "DELETE /compute/v2.1/servers/4be597d7-a3dd-44f3-9d17-946635bea8e6" status: 204 len: 0 microversion: 2.1 time: 0.249156 Oct 08 21:00:43.244416 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1136/2236] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:00:42 2022] DELETE /compute/v2.1/servers/4be597d7-a3dd-44f3-9d17-946635bea8e6 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 08 21:00:43.255339 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-1fd3b1df-59ae-4ca4-91dc-53c65588838d tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:43.256352 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-1fd3b1df-59ae-4ca4-91dc-53c65588838d tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] [instance: 37daee2e-9629-4664-a85d-da2e8aa5ea2e] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:43.268947 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1fd3b1df-59ae-4ca4-91dc-53c65588838d tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:43.269964 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1fd3b1df-59ae-4ca4-91dc-53c65588838d tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:43.270496 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1fd3b1df-59ae-4ca4-91dc-53c65588838d tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:43.271423 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1fd3b1df-59ae-4ca4-91dc-53c65588838d tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:43.271977 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1fd3b1df-59ae-4ca4-91dc-53c65588838d tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:43.272516 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1fd3b1df-59ae-4ca4-91dc-53c65588838d tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:43.552166 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-1fd3b1df-59ae-4ca4-91dc-53c65588838d tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ddc3cd3c374bacbe5bf5e0877380e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8472b054404c46a99b81aba34d6b9f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:43.567923 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-1fd3b1df-59ae-4ca4-91dc-53c65588838d tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] 10.222.0.26 "GET /compute/v2.1/servers/37daee2e-9629-4664-a85d-da2e8aa5ea2e" status: 200 len: 1473 microversion: 2.1 time: 0.318546 Oct 08 21:00:43.568486 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1137/2237] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:43 2022] GET /compute/v2.1/servers/37daee2e-9629-4664-a85d-da2e8aa5ea2e => generated 1473 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:43.576861 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-601fafbf-a8e1-4559-a8df-b3022a09b25e tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:00:43.579886 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-601fafbf-a8e1-4559-a8df-b3022a09b25e tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] [instance: 579b0f8b-ccae-4c2b-bb48-1da1aaf6a138] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:43.601804 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-601fafbf-a8e1-4559-a8df-b3022a09b25e tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:43.602595 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-601fafbf-a8e1-4559-a8df-b3022a09b25e tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:43.603401 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-601fafbf-a8e1-4559-a8df-b3022a09b25e tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:43.604577 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-601fafbf-a8e1-4559-a8df-b3022a09b25e tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:43.605476 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-601fafbf-a8e1-4559-a8df-b3022a09b25e tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:43.606138 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-601fafbf-a8e1-4559-a8df-b3022a09b25e tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:43.645562 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.objects.instance [None req-601fafbf-a8e1-4559-a8df-b3022a09b25e tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lazy-loading 'flavor' on Instance uuid 579b0f8b-ccae-4c2b-bb48-1da1aaf6a138 {{(pid=140492) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 21:00:43.750181 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-ba3dd368-fc17-4fa9-93b1-925e80f42ede tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06caf10b6fa43a3a2ad34858594e329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b10172715d423eb887d6c5b171defb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:43.773644 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-601fafbf-a8e1-4559-a8df-b3022a09b25e tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] 10.222.0.26 "POST /compute/v2.1/servers/579b0f8b-ccae-4c2b-bb48-1da1aaf6a138/action" status: 200 len: 32 microversion: 2.1 time: 0.200383 Oct 08 21:00:43.775147 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1138/2238] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:00:43 2022] POST /compute/v2.1/servers/579b0f8b-ccae-4c2b-bb48-1da1aaf6a138/action => generated 32 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 08 21:00:43.776745 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-ba3dd368-fc17-4fa9-93b1-925e80f42ede tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] 10.222.0.26 "GET /compute/v2.1/servers/a8b2f857-6c24-45fe-b934-cf92b2d18b7a" status: 200 len: 1521 microversion: 2.1 time: 0.841132 Oct 08 21:00:43.781628 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1101/2239] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:42 2022] GET /compute/v2.1/servers/a8b2f857-6c24-45fe-b934-cf92b2d18b7a => generated 1521 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:43.791797 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-d1927711-551c-4692-8aa8-8e86d41753cb tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:43.794140 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-d1927711-551c-4692-8aa8-8e86d41753cb tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] [instance: 579b0f8b-ccae-4c2b-bb48-1da1aaf6a138] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:43.796785 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-51543095-4d0b-4e84-86f4-db9eac97c58b tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:43.799720 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-51543095-4d0b-4e84-86f4-db9eac97c58b tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: 38b000d3-167b-4f7a-ab80-cd51fcb7cbaf] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:43.812049 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d1927711-551c-4692-8aa8-8e86d41753cb tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:43.824565 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d1927711-551c-4692-8aa8-8e86d41753cb tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:43.825362 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d1927711-551c-4692-8aa8-8e86d41753cb tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:43.825820 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d1927711-551c-4692-8aa8-8e86d41753cb tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:43.829982 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-51543095-4d0b-4e84-86f4-db9eac97c58b tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:43.831767 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-51543095-4d0b-4e84-86f4-db9eac97c58b tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:43.832264 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-51543095-4d0b-4e84-86f4-db9eac97c58b tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:43.833022 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-51543095-4d0b-4e84-86f4-db9eac97c58b tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:43.833153 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d1927711-551c-4692-8aa8-8e86d41753cb tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:43.836244 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-51543095-4d0b-4e84-86f4-db9eac97c58b tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:43.836390 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d1927711-551c-4692-8aa8-8e86d41753cb tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:43.836903 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-51543095-4d0b-4e84-86f4-db9eac97c58b tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:44.037313 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-d1927711-551c-4692-8aa8-8e86d41753cb tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1698dee4a2bf4ea19a6ee0c3d5cb5c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b00ee5e7828469f95bd90548d35982a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:44.045936 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-d1927711-551c-4692-8aa8-8e86d41753cb tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] 10.222.0.26 "GET /compute/v2.1/servers/579b0f8b-ccae-4c2b-bb48-1da1aaf6a138" status: 200 len: 1523 microversion: 2.1 time: 0.262003 Oct 08 21:00:44.048418 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1102/2240] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:43 2022] GET /compute/v2.1/servers/579b0f8b-ccae-4c2b-bb48-1da1aaf6a138 => generated 1523 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:44.065419 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-ee887b67-d845-4d0c-b745-214040724e8c tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:44.066000 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-ee887b67-d845-4d0c-b745-214040724e8c tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] [instance: a8b2f857-6c24-45fe-b934-cf92b2d18b7a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:44.082009 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ee887b67-d845-4d0c-b745-214040724e8c tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:44.085058 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ee887b67-d845-4d0c-b745-214040724e8c tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:44.085633 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ee887b67-d845-4d0c-b745-214040724e8c tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:44.086422 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ee887b67-d845-4d0c-b745-214040724e8c tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:44.087057 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ee887b67-d845-4d0c-b745-214040724e8c tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:44.087902 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ee887b67-d845-4d0c-b745-214040724e8c tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:44.444129 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-ee887b67-d845-4d0c-b745-214040724e8c tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06caf10b6fa43a3a2ad34858594e329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b10172715d423eb887d6c5b171defb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:44.453315 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-ee887b67-d845-4d0c-b745-214040724e8c tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] 10.222.0.26 "GET /compute/v2.1/servers/a8b2f857-6c24-45fe-b934-cf92b2d18b7a" status: 200 len: 1521 microversion: 2.1 time: 0.403506 Oct 08 21:00:44.460202 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1103/2241] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:44 2022] GET /compute/v2.1/servers/a8b2f857-6c24-45fe-b934-cf92b2d18b7a => generated 1521 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:44.472125 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-9a8effe2-a294-4915-8430-287d93bb2b24 req-2f5c4e14-f911-4990-9159-5528d67e5c6f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38b000d3-167b-4f7a-ab80-cd51fcb7cbaf", "tag": "4e092828-fb69-410c-aa0c-7cbcee8350f3"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:00:44.500135 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-9a8effe2-a294-4915-8430-287d93bb2b24 req-2f5c4e14-f911-4990-9159-5528d67e5c6f service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:44.501418 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-9a8effe2-a294-4915-8430-287d93bb2b24 req-2f5c4e14-f911-4990-9159-5528d67e5c6f service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:44.502032 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-9a8effe2-a294-4915-8430-287d93bb2b24 req-2f5c4e14-f911-4990-9159-5528d67e5c6f service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:44.514263 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-51543095-4d0b-4e84-86f4-db9eac97c58b tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:44.514843 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-9a8effe2-a294-4915-8430-287d93bb2b24 req-2f5c4e14-f911-4990-9159-5528d67e5c6f service nova] Creating event network-changed:4e092828-fb69-410c-aa0c-7cbcee8350f3 for instance 38b000d3-167b-4f7a-ab80-cd51fcb7cbaf on nch2-master-1 Oct 08 21:00:44.523558 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-9a8effe2-a294-4915-8430-287d93bb2b24 req-2f5c4e14-f911-4990-9159-5528d67e5c6f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054699 Oct 08 21:00:44.524674 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1104/2242] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:00:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:00:44.526478 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-51543095-4d0b-4e84-86f4-db9eac97c58b tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/38b000d3-167b-4f7a-ab80-cd51fcb7cbaf" status: 200 len: 1312 microversion: 2.1 time: 0.740724 Oct 08 21:00:44.531841 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-a64ea8fa-dde0-423e-b2e8-3b373b5a38ba tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:44.532747 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-a64ea8fa-dde0-423e-b2e8-3b373b5a38ba tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] [instance: 3622a27e-b943-49a7-8d81-a6f553c32f7a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:44.540295 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a64ea8fa-dde0-423e-b2e8-3b373b5a38ba tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:44.541105 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a64ea8fa-dde0-423e-b2e8-3b373b5a38ba tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:44.542117 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a64ea8fa-dde0-423e-b2e8-3b373b5a38ba tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:44.543693 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a64ea8fa-dde0-423e-b2e8-3b373b5a38ba tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:44.544459 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a64ea8fa-dde0-423e-b2e8-3b373b5a38ba tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:44.545041 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a64ea8fa-dde0-423e-b2e8-3b373b5a38ba tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:44.547960 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1139/2243] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:43 2022] GET /compute/v2.1/servers/38b000d3-167b-4f7a-ab80-cd51fcb7cbaf => generated 1312 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:44.556317 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-5c3b4970-76c8-41eb-986b-05459adfc4d7 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1352271557"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:00:44.561256 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-5c3b4970-76c8-41eb-986b-05459adfc4d7 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] [instance: a8b2f857-6c24-45fe-b934-cf92b2d18b7a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:44.570584 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5c3b4970-76c8-41eb-986b-05459adfc4d7 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:44.571331 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5c3b4970-76c8-41eb-986b-05459adfc4d7 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:44.571960 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5c3b4970-76c8-41eb-986b-05459adfc4d7 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:44.572844 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5c3b4970-76c8-41eb-986b-05459adfc4d7 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:44.573495 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5c3b4970-76c8-41eb-986b-05459adfc4d7 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:44.574722 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5c3b4970-76c8-41eb-986b-05459adfc4d7 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:45.032982 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-5c3b4970-76c8-41eb-986b-05459adfc4d7 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] 10.222.0.26 "POST /compute/v2.1/servers/a8b2f857-6c24-45fe-b934-cf92b2d18b7a/action" status: 202 len: 0 microversion: 2.1 time: 0.482300 Oct 08 21:00:45.034434 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1140/2244] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:00:44 2022] POST /compute/v2.1/servers/a8b2f857-6c24-45fe-b934-cf92b2d18b7a/action => generated 0 bytes in 486 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 08 21:00:45.040782 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-750296f8-7e43-4cd9-9d7b-38376c5101e4 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:45.042976 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-750296f8-7e43-4cd9-9d7b-38376c5101e4 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] [instance: 37daee2e-9629-4664-a85d-da2e8aa5ea2e] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:45.053848 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-750296f8-7e43-4cd9-9d7b-38376c5101e4 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:45.055041 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-750296f8-7e43-4cd9-9d7b-38376c5101e4 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:45.055812 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-750296f8-7e43-4cd9-9d7b-38376c5101e4 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:45.056810 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-750296f8-7e43-4cd9-9d7b-38376c5101e4 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:45.057772 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-750296f8-7e43-4cd9-9d7b-38376c5101e4 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:45.058489 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-750296f8-7e43-4cd9-9d7b-38376c5101e4 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:45.290265 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-a64ea8fa-dde0-423e-b2e8-3b373b5a38ba tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '463a3aac627c43d7af0dbc9facb52076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac791938e6384c8c8473ffd65cf867a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:45.307392 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-a64ea8fa-dde0-423e-b2e8-3b373b5a38ba tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] 10.222.0.26 "GET /compute/v2.1/servers/3622a27e-b943-49a7-8d81-a6f553c32f7a" status: 200 len: 1322 microversion: 2.1 time: 0.781230 Oct 08 21:00:45.309499 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1105/2245] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:44 2022] GET /compute/v2.1/servers/3622a27e-b943-49a7-8d81-a6f553c32f7a => generated 1322 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:45.319756 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-14af42ca-89d6-4389-8a7a-85f777e0392a tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Calling method '.version_select at 0x7f1a91301dc0>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:45.684105 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-750296f8-7e43-4cd9-9d7b-38376c5101e4 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ddc3cd3c374bacbe5bf5e0877380e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8472b054404c46a99b81aba34d6b9f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:45.708997 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-14af42ca-89d6-4389-8a7a-85f777e0392a tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] 10.222.0.26 "DELETE /compute/v2.1/images/fb3d38b0-6546-4a9e-85ea-e5d55eb7feaf" status: 204 len: 0 microversion: 2.1 time: 0.397079 Oct 08 21:00:45.710064 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1106/2246] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:45 2022] DELETE /compute/v2.1/images/fb3d38b0-6546-4a9e-85ea-e5d55eb7feaf => generated 0 bytes in 400 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 21:00:45.718789 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-5df9bd26-a04a-45cd-bff4-ea5b83a9dd4c tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:45.723484 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-5df9bd26-a04a-45cd-bff4-ea5b83a9dd4c tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] [instance: 579b0f8b-ccae-4c2b-bb48-1da1aaf6a138] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:45.726339 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-750296f8-7e43-4cd9-9d7b-38376c5101e4 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] 10.222.0.26 "GET /compute/v2.1/servers/37daee2e-9629-4664-a85d-da2e8aa5ea2e" status: 200 len: 1473 microversion: 2.1 time: 0.684815 Oct 08 21:00:45.734885 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1141/2247] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:45 2022] GET /compute/v2.1/servers/37daee2e-9629-4664-a85d-da2e8aa5ea2e => generated 1473 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:45.741419 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-7bfe80ab-49de-4434-b389-a41ac1dbb937 req-88c08ee2-7fbb-4994-8b49-cea03f17387f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3622a27e-b943-49a7-8d81-a6f553c32f7a", "name": "network-vif-plugged", "status": "completed", "tag": "7a99af98-17a8-4923-a5c9-ed888cca7f5a"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:00:45.764178 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-7bfe80ab-49de-4434-b389-a41ac1dbb937 req-88c08ee2-7fbb-4994-8b49-cea03f17387f service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:45.765307 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-7bfe80ab-49de-4434-b389-a41ac1dbb937 req-88c08ee2-7fbb-4994-8b49-cea03f17387f service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:45.765946 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-7bfe80ab-49de-4434-b389-a41ac1dbb937 req-88c08ee2-7fbb-4994-8b49-cea03f17387f service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:45.768420 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5df9bd26-a04a-45cd-bff4-ea5b83a9dd4c tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:45.768926 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5df9bd26-a04a-45cd-bff4-ea5b83a9dd4c tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:45.772907 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5df9bd26-a04a-45cd-bff4-ea5b83a9dd4c tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:45.774239 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5df9bd26-a04a-45cd-bff4-ea5b83a9dd4c tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:45.774887 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5df9bd26-a04a-45cd-bff4-ea5b83a9dd4c tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:45.775628 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5df9bd26-a04a-45cd-bff4-ea5b83a9dd4c tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:45.800935 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-7bfe80ab-49de-4434-b389-a41ac1dbb937 req-88c08ee2-7fbb-4994-8b49-cea03f17387f service nova] Creating event network-vif-plugged:7a99af98-17a8-4923-a5c9-ed888cca7f5a for instance 3622a27e-b943-49a7-8d81-a6f553c32f7a on nch1-master-1 Oct 08 21:00:45.809686 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-7bfe80ab-49de-4434-b389-a41ac1dbb937 req-88c08ee2-7fbb-4994-8b49-cea03f17387f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071405 Oct 08 21:00:45.811215 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1142/2248] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:00:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:00:45.838728 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-83c463a1-f408-42bf-82be-5f7e911e1652 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:45.841605 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-83c463a1-f408-42bf-82be-5f7e911e1652 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: 38b000d3-167b-4f7a-ab80-cd51fcb7cbaf] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:45.887626 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-83c463a1-f408-42bf-82be-5f7e911e1652 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:45.890389 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-83c463a1-f408-42bf-82be-5f7e911e1652 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:45.892240 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-83c463a1-f408-42bf-82be-5f7e911e1652 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:45.895646 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-83c463a1-f408-42bf-82be-5f7e911e1652 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:45.897396 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-83c463a1-f408-42bf-82be-5f7e911e1652 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:45.898428 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-83c463a1-f408-42bf-82be-5f7e911e1652 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:46.254305 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-83c463a1-f408-42bf-82be-5f7e911e1652 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:46.271539 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-83c463a1-f408-42bf-82be-5f7e911e1652 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/38b000d3-167b-4f7a-ab80-cd51fcb7cbaf" status: 200 len: 1312 microversion: 2.1 time: 0.457065 Oct 08 21:00:46.274692 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1143/2249] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:45 2022] GET /compute/v2.1/servers/38b000d3-167b-4f7a-ab80-cd51fcb7cbaf => generated 1312 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:46.297790 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-c385dc15-e941-4a77-9375-0070d068bd17 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Calling method '.version_select at 0x7f1a8cacff70>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:46.327685 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-5df9bd26-a04a-45cd-bff4-ea5b83a9dd4c tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1698dee4a2bf4ea19a6ee0c3d5cb5c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b00ee5e7828469f95bd90548d35982a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:46.343727 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-c385dc15-e941-4a77-9375-0070d068bd17 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] HTTP exception thrown: Image not found. Oct 08 21:00:46.347223 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-c385dc15-e941-4a77-9375-0070d068bd17 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Request method failure captured: Oct 08 21:00:46.347223 ncdv-master-1 devstack@n-api.service[140492]: request: GET /compute/v2.1/images/fb3d38b0-6546-4a9e-85ea-e5d55eb7feaf HTTP/1.1 Oct 08 21:00:46.347223 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:00:46.347223 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:00:46.347223 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:00:46.347223 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 21:00:46.347223 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:00:46.347223 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:00:46.347223 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:00:46.347223 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:00:46.347223 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeTE7bTfM4hIhoviKx9l8mw-bWfYL6jsTZW_QjKSgS6NcvR5fjqeBn6E1jAPDuPpZvhMcTeb9kBH8YZZEMCFr_F1J-nxa8vLVrJvg33lxBDKWqjORjFzU7YTBNB-gB5p5hXf0cUCzsO7xU_2VbukaClcdx1U8H5njKq8mVnqRKHv1K4 Oct 08 21:00:46.347223 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:00:46.347223 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:00:46.347223 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:00:46.347223 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:00:46.347223 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:00:46.347223 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:00:46.347223 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 76b10172715d423eb887d6c5b171defb Oct 08 21:00:46.347223 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1001637313 Oct 08 21:00:46.347223 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:00:46.347223 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:00:46.347223 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/76b10172715d423eb887d6c5b171defb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/76b10172715d423eb887d6c5b171defb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_76b10172715d423eb887d6c5b171defb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/76b10172715d423eb887d6c5b171defb"}]}] Oct 08 21:00:46.347223 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1001637313 Oct 08 21:00:46.347223 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 76b10172715d423eb887d6c5b171defb Oct 08 21:00:46.347223 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1001637313 Oct 08 21:00:46.347223 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-ImagesOneServerNegativeTestJSON-1001637313-project Oct 08 21:00:46.347223 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:00:46.347223 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:00:46.347223 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: f06caf10b6fa43a3a2ad34858594e329 Oct 08 21:00:46.347223 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1001637313-project Oct 08 21:00:46.347223 ncdv-master-1 devstack@n-api.service[140492]: method: Oct 08 21:00:46.347223 ncdv-master-1 devstack@n-api.service[140492]: exception: Image not found. Oct 08 21:00:46.347223 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': 'fb3d38b0-6546-4a9e-85ea-e5d55eb7feaf'} Oct 08 21:00:46.347223 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:00:46.347223 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:00:46.347223 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 08 21:00:46.347223 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 08 21:00:46.347223 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 08 21:00:46.347223 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 08 21:00:46.347223 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 08 21:00:46.347223 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 08 21:00:46.347223 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 08 21:00:46.347223 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 08 21:00:46.347223 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 08 21:00:46.347223 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 08 21:00:46.347223 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 08 21:00:46.347223 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 08 21:00:46.347223 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 08 21:00:46.347223 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 08 21:00:46.347223 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 08 21:00:46.347223 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 08 21:00:46.347223 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID fb3d38b0-6546-4a9e-85ea-e5d55eb7feaf Oct 08 21:00:46.347223 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:00:46.347223 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:00:46.347223 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:00:46.347223 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:00:46.347223 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 08 21:00:46.347223 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 08 21:00:46.347223 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 08 21:00:46.347223 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 08 21:00:46.347223 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 08 21:00:46.347223 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 08 21:00:46.347223 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 08 21:00:46.351466 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 08 21:00:46.351466 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 08 21:00:46.351466 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 08 21:00:46.351466 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 08 21:00:46.351466 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 08 21:00:46.351466 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 08 21:00:46.351466 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 08 21:00:46.351466 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 08 21:00:46.351466 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 08 21:00:46.351466 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 08 21:00:46.351466 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 08 21:00:46.351466 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 08 21:00:46.351466 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 08 21:00:46.351466 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 08 21:00:46.351466 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 08 21:00:46.351466 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 08 21:00:46.351466 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 08 21:00:46.351466 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image fb3d38b0-6546-4a9e-85ea-e5d55eb7feaf could not be found. Oct 08 21:00:46.351466 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:00:46.351466 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:00:46.351466 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:00:46.351466 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:00:46.351466 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:00:46.351466 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:00:46.351466 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:00:46.351466 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:00:46.351466 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 08 21:00:46.351466 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 08 21:00:46.351466 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:00:46.351466 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:00:46.351466 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 08 21:00:46.351466 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 08 21:00:46.351466 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 08 21:00:46.351466 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:00:46.351466 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:00:46.351466 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:00:46.351466 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:00:46.351466 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:00:46.351466 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:00:46.351466 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:00:46.351466 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:00:46.351466 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 08 21:00:46.351466 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:00:46.351466 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-c385dc15-e941-4a77-9375-0070d068bd17 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Returning 404 to user: Image not found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:00:46.351466 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-c385dc15-e941-4a77-9375-0070d068bd17 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] 10.222.0.26 "GET /compute/v2.1/images/fb3d38b0-6546-4a9e-85ea-e5d55eb7feaf" status: 404 len: 62 microversion: 2.1 time: 0.072919 Oct 08 21:00:46.351466 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1144/2250] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:00:46 2022] GET /compute/v2.1/images/fb3d38b0-6546-4a9e-85ea-e5d55eb7feaf => generated 62 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 08 21:00:46.357281 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-5df9bd26-a04a-45cd-bff4-ea5b83a9dd4c tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] 10.222.0.26 "GET /compute/v2.1/servers/579b0f8b-ccae-4c2b-bb48-1da1aaf6a138" status: 200 len: 1523 microversion: 2.1 time: 0.632290 Oct 08 21:00:46.358374 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1107/2251] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:45 2022] GET /compute/v2.1/servers/579b0f8b-ccae-4c2b-bb48-1da1aaf6a138 => generated 1523 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:46.374789 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-fe5c768a-1e7e-4418-88a3-df16aa690ed7 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:46.375603 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-510dcf87-f209-4dfc-b696-f4ac1d4bfc2d req-ec24c82e-56d7-443a-be9b-df685661932b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37daee2e-9629-4664-a85d-da2e8aa5ea2e", "name": "network-vif-deleted", "tag": "b161e103-83f2-4169-9a06-338706b01d4c"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:00:46.376217 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-fe5c768a-1e7e-4418-88a3-df16aa690ed7 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] [instance: 3622a27e-b943-49a7-8d81-a6f553c32f7a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:46.396486 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fe5c768a-1e7e-4418-88a3-df16aa690ed7 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:46.397586 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fe5c768a-1e7e-4418-88a3-df16aa690ed7 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:46.398933 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fe5c768a-1e7e-4418-88a3-df16aa690ed7 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:46.400591 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fe5c768a-1e7e-4418-88a3-df16aa690ed7 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:46.401833 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fe5c768a-1e7e-4418-88a3-df16aa690ed7 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:46.403463 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fe5c768a-1e7e-4418-88a3-df16aa690ed7 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:46.409407 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=1 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:00:46.415334 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-510dcf87-f209-4dfc-b696-f4ac1d4bfc2d req-ec24c82e-56d7-443a-be9b-df685661932b service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:46.418340 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-510dcf87-f209-4dfc-b696-f4ac1d4bfc2d req-ec24c82e-56d7-443a-be9b-df685661932b service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:46.418881 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-510dcf87-f209-4dfc-b696-f4ac1d4bfc2d req-ec24c82e-56d7-443a-be9b-df685661932b service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:46.444337 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-510dcf87-f209-4dfc-b696-f4ac1d4bfc2d req-ec24c82e-56d7-443a-be9b-df685661932b service nova] Creating event network-vif-deleted:b161e103-83f2-4169-9a06-338706b01d4c for instance 37daee2e-9629-4664-a85d-da2e8aa5ea2e on nch1-master-1 Oct 08 21:00:46.456516 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-510dcf87-f209-4dfc-b696-f4ac1d4bfc2d req-ec24c82e-56d7-443a-be9b-df685661932b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104749 Oct 08 21:00:46.457880 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1145/2252] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:00:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:00:46.466750 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-89c6e000-08a5-41a5-9bf0-66040f381a2c tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:46.467740 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-89c6e000-08a5-41a5-9bf0-66040f381a2c tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] [instance: a8b2f857-6c24-45fe-b934-cf92b2d18b7a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:46.508341 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-89c6e000-08a5-41a5-9bf0-66040f381a2c tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:46.509585 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-89c6e000-08a5-41a5-9bf0-66040f381a2c tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:46.513341 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-89c6e000-08a5-41a5-9bf0-66040f381a2c tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:46.515302 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-89c6e000-08a5-41a5-9bf0-66040f381a2c tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:46.515883 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-89c6e000-08a5-41a5-9bf0-66040f381a2c tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:46.516425 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-89c6e000-08a5-41a5-9bf0-66040f381a2c tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:46.740399 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-fe5c768a-1e7e-4418-88a3-df16aa690ed7 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '463a3aac627c43d7af0dbc9facb52076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac791938e6384c8c8473ffd65cf867a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:46.756351 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-fe5c768a-1e7e-4418-88a3-df16aa690ed7 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] 10.222.0.26 "GET /compute/v2.1/servers/3622a27e-b943-49a7-8d81-a6f553c32f7a" status: 200 len: 1322 microversion: 2.1 time: 0.389789 Oct 08 21:00:46.769608 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1108/2253] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:46 2022] GET /compute/v2.1/servers/3622a27e-b943-49a7-8d81-a6f553c32f7a => generated 1322 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:46.782949 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-d131e69d-8ce2-4325-a74b-660afc9dbf6e tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:46.784475 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-d131e69d-8ce2-4325-a74b-660afc9dbf6e tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] [instance: 37daee2e-9629-4664-a85d-da2e8aa5ea2e] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:46.809967 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d131e69d-8ce2-4325-a74b-660afc9dbf6e tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:46.810724 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d131e69d-8ce2-4325-a74b-660afc9dbf6e tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:46.829494 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d131e69d-8ce2-4325-a74b-660afc9dbf6e tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:46.830528 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d131e69d-8ce2-4325-a74b-660afc9dbf6e tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:46.832790 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d131e69d-8ce2-4325-a74b-660afc9dbf6e tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:46.834332 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d131e69d-8ce2-4325-a74b-660afc9dbf6e tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:46.876084 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-89c6e000-08a5-41a5-9bf0-66040f381a2c tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06caf10b6fa43a3a2ad34858594e329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b10172715d423eb887d6c5b171defb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:46.901853 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-89c6e000-08a5-41a5-9bf0-66040f381a2c tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] 10.222.0.26 "GET /compute/v2.1/servers/a8b2f857-6c24-45fe-b934-cf92b2d18b7a" status: 200 len: 1533 microversion: 2.1 time: 0.435811 Oct 08 21:00:46.903115 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1146/2254] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:46 2022] GET /compute/v2.1/servers/a8b2f857-6c24-45fe-b934-cf92b2d18b7a => generated 1533 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:46.920471 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d131e69d-8ce2-4325-a74b-660afc9dbf6e tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:46.921246 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d131e69d-8ce2-4325-a74b-660afc9dbf6e tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:46.922013 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d131e69d-8ce2-4325-a74b-660afc9dbf6e tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:46.923076 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.objects.instance [None req-d131e69d-8ce2-4325-a74b-660afc9dbf6e tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lazy-loading 'fault' on Instance uuid 37daee2e-9629-4664-a85d-da2e8aa5ea2e {{(pid=140491) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 21:00:47.085690 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-d131e69d-8ce2-4325-a74b-660afc9dbf6e tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ddc3cd3c374bacbe5bf5e0877380e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8472b054404c46a99b81aba34d6b9f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:47.111879 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-d131e69d-8ce2-4325-a74b-660afc9dbf6e tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] 10.222.0.26 "GET /compute/v2.1/servers/37daee2e-9629-4664-a85d-da2e8aa5ea2e" status: 200 len: 1308 microversion: 2.1 time: 0.337051 Oct 08 21:00:47.112506 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1109/2255] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:46 2022] GET /compute/v2.1/servers/37daee2e-9629-4664-a85d-da2e8aa5ea2e => generated 1308 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:47.302040 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-261bfbeb-f110-489a-8d4d-4a4d91ea54b2 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:47.302950 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-261bfbeb-f110-489a-8d4d-4a4d91ea54b2 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: 38b000d3-167b-4f7a-ab80-cd51fcb7cbaf] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:47.317505 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=7 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:00:47.322482 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-261bfbeb-f110-489a-8d4d-4a4d91ea54b2 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:47.323435 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-261bfbeb-f110-489a-8d4d-4a4d91ea54b2 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:47.324378 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-261bfbeb-f110-489a-8d4d-4a4d91ea54b2 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:47.326012 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-261bfbeb-f110-489a-8d4d-4a4d91ea54b2 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:47.326851 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-261bfbeb-f110-489a-8d4d-4a4d91ea54b2 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:47.327554 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-261bfbeb-f110-489a-8d4d-4a4d91ea54b2 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:47.385346 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-583443ff-873d-4c4d-9a4b-212ee01976c9 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:47.385982 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-583443ff-873d-4c4d-9a4b-212ee01976c9 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] [instance: 579b0f8b-ccae-4c2b-bb48-1da1aaf6a138] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:47.415540 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-583443ff-873d-4c4d-9a4b-212ee01976c9 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:47.419352 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-583443ff-873d-4c4d-9a4b-212ee01976c9 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:47.419906 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-583443ff-873d-4c4d-9a4b-212ee01976c9 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:47.420685 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-583443ff-873d-4c4d-9a4b-212ee01976c9 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:47.421165 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-583443ff-873d-4c4d-9a4b-212ee01976c9 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:47.421631 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-583443ff-873d-4c4d-9a4b-212ee01976c9 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:47.930490 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-583443ff-873d-4c4d-9a4b-212ee01976c9 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1698dee4a2bf4ea19a6ee0c3d5cb5c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b00ee5e7828469f95bd90548d35982a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:47.945954 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-583443ff-873d-4c4d-9a4b-212ee01976c9 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] 10.222.0.26 "GET /compute/v2.1/servers/579b0f8b-ccae-4c2b-bb48-1da1aaf6a138" status: 200 len: 1523 microversion: 2.1 time: 0.563627 Oct 08 21:00:47.947947 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1110/2256] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:47 2022] GET /compute/v2.1/servers/579b0f8b-ccae-4c2b-bb48-1da1aaf6a138 => generated 1523 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:00:47.957067 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-8112734d-3e2f-4620-8e41-fdb53172dbd4 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:47.960127 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-8112734d-3e2f-4620-8e41-fdb53172dbd4 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] [instance: 3622a27e-b943-49a7-8d81-a6f553c32f7a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:47.978086 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8112734d-3e2f-4620-8e41-fdb53172dbd4 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:47.980876 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8112734d-3e2f-4620-8e41-fdb53172dbd4 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:47.981845 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8112734d-3e2f-4620-8e41-fdb53172dbd4 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:47.985016 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8112734d-3e2f-4620-8e41-fdb53172dbd4 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:47.986808 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8112734d-3e2f-4620-8e41-fdb53172dbd4 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:47.988783 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8112734d-3e2f-4620-8e41-fdb53172dbd4 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:48.000197 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=100 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:00:48.151677 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-261bfbeb-f110-489a-8d4d-4a4d91ea54b2 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:48.163049 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-261bfbeb-f110-489a-8d4d-4a4d91ea54b2 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/38b000d3-167b-4f7a-ab80-cd51fcb7cbaf" status: 200 len: 1312 microversion: 2.1 time: 0.871609 Oct 08 21:00:48.169578 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1147/2257] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:47 2022] GET /compute/v2.1/servers/38b000d3-167b-4f7a-ab80-cd51fcb7cbaf => generated 1312 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:48.176570 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-803b6ddc-5550-48cc-861f-6a2225f335ae tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:48.179299 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-803b6ddc-5550-48cc-861f-6a2225f335ae tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] [instance: a8b2f857-6c24-45fe-b934-cf92b2d18b7a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:48.212725 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-803b6ddc-5550-48cc-861f-6a2225f335ae tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:48.215741 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-803b6ddc-5550-48cc-861f-6a2225f335ae tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:48.216530 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-803b6ddc-5550-48cc-861f-6a2225f335ae tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:48.218335 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-803b6ddc-5550-48cc-861f-6a2225f335ae tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:48.221603 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-803b6ddc-5550-48cc-861f-6a2225f335ae tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:48.222075 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-803b6ddc-5550-48cc-861f-6a2225f335ae tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:48.471327 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-8112734d-3e2f-4620-8e41-fdb53172dbd4 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '463a3aac627c43d7af0dbc9facb52076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac791938e6384c8c8473ffd65cf867a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:48.487611 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-8112734d-3e2f-4620-8e41-fdb53172dbd4 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] 10.222.0.26 "GET /compute/v2.1/servers/3622a27e-b943-49a7-8d81-a6f553c32f7a" status: 200 len: 1514 microversion: 2.1 time: 0.536464 Oct 08 21:00:48.488236 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1111/2258] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:47 2022] GET /compute/v2.1/servers/3622a27e-b943-49a7-8d81-a6f553c32f7a => generated 1514 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:48.506613 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-70bcdc83-99a7-44ae-b2d0-ae2b4441e3d8 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:48.508323 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-70bcdc83-99a7-44ae-b2d0-ae2b4441e3d8 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] [instance: 37daee2e-9629-4664-a85d-da2e8aa5ea2e] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:48.518189 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-70bcdc83-99a7-44ae-b2d0-ae2b4441e3d8 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:48.520193 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-70bcdc83-99a7-44ae-b2d0-ae2b4441e3d8 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:48.520847 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-70bcdc83-99a7-44ae-b2d0-ae2b4441e3d8 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:48.521821 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-70bcdc83-99a7-44ae-b2d0-ae2b4441e3d8 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:48.522749 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-70bcdc83-99a7-44ae-b2d0-ae2b4441e3d8 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:48.523388 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-70bcdc83-99a7-44ae-b2d0-ae2b4441e3d8 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:48.546216 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-70bcdc83-99a7-44ae-b2d0-ae2b4441e3d8 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] HTTP exception thrown: Instance 37daee2e-9629-4664-a85d-da2e8aa5ea2e could not be found. Oct 08 21:00:48.548479 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-70bcdc83-99a7-44ae-b2d0-ae2b4441e3d8 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Request method failure captured: Oct 08 21:00:48.548479 ncdv-master-1 devstack@n-api.service[140491]: request: GET /compute/v2.1/servers/37daee2e-9629-4664-a85d-da2e8aa5ea2e HTTP/1.1 Oct 08 21:00:48.548479 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:00:48.548479 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:00:48.548479 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:00:48.548479 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 21:00:48.548479 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:00:48.548479 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:00:48.548479 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:00:48.548479 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:00:48.548479 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeRR295mmmZhL7rSOgfacjSsWQ1Ti3FYd30sypy6B-ALaT7WOeiqaScllnDYtpa4eJ1mjmv4WUyVTLu5zt1pdJiZcKAFWv_GnEIqR6TqCn43v4gEmVWskuydtSKspT0UK00dWYkPU4ZM4UBd8cYd3myAyAfY7HLwKtG1LqfYrCLqzow Oct 08 21:00:48.548479 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:00:48.548479 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:00:48.548479 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:00:48.548479 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:00:48.548479 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:00:48.548479 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:00:48.548479 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 8472b054404c46a99b81aba34d6b9f40 Oct 08 21:00:48.548479 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-ServersOnMultiNodesTest-2078873751 Oct 08 21:00:48.548479 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:00:48.548479 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:00:48.548479 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8472b054404c46a99b81aba34d6b9f40"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8472b054404c46a99b81aba34d6b9f40"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8472b054404c46a99b81aba34d6b9f40"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8472b054404c46a99b81aba34d6b9f40"}]}] Oct 08 21:00:48.548479 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-ServersOnMultiNodesTest-2078873751 Oct 08 21:00:48.548479 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 8472b054404c46a99b81aba34d6b9f40 Oct 08 21:00:48.548479 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-2078873751 Oct 08 21:00:48.548479 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-ServersOnMultiNodesTest-2078873751-project Oct 08 21:00:48.548479 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:00:48.548479 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:00:48.548479 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 67ddc3cd3c374bacbe5bf5e0877380e2 Oct 08 21:00:48.548479 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-ServersOnMultiNodesTest-2078873751-project Oct 08 21:00:48.548479 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:00:48.548479 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance 37daee2e-9629-4664-a85d-da2e8aa5ea2e could not be found. Oct 08 21:00:48.548479 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': '37daee2e-9629-4664-a85d-da2e8aa5ea2e'} Oct 08 21:00:48.548479 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:00:48.548479 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:00:48.548479 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:00:48.548479 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:00:48.548479 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:00:48.548479 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:00:48.548479 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:00:48.548479 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:00:48.548479 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:00:48.548479 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:00:48.548479 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37daee2e-9629-4664-a85d-da2e8aa5ea2e could not be found. Oct 08 21:00:48.548479 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:00:48.548479 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:00:48.548479 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:00:48.548479 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:00:48.548479 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:00:48.548479 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:00:48.548479 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:00:48.548479 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:00:48.548479 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:00:48.548479 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:00:48.548479 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:00:48.548479 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:00:48.548479 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:00:48.548479 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:00:48.548479 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:00:48.548479 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:00:48.548479 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37daee2e-9629-4664-a85d-da2e8aa5ea2e could not be found. Oct 08 21:00:48.548479 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:00:48.548479 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:00:48.548479 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:00:48.552606 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:00:48.552606 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:00:48.552606 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:00:48.552606 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:00:48.552606 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:00:48.552606 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37daee2e-9629-4664-a85d-da2e8aa5ea2e could not be found. Oct 08 21:00:48.552606 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:00:48.552606 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-70bcdc83-99a7-44ae-b2d0-ae2b4441e3d8 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Returning 404 to user: Instance 37daee2e-9629-4664-a85d-da2e8aa5ea2e could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:00:48.552606 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-70bcdc83-99a7-44ae-b2d0-ae2b4441e3d8 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] 10.222.0.26 "GET /compute/v2.1/servers/37daee2e-9629-4664-a85d-da2e8aa5ea2e" status: 404 len: 111 microversion: 2.1 time: 0.050605 Oct 08 21:00:48.553499 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-803b6ddc-5550-48cc-861f-6a2225f335ae tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06caf10b6fa43a3a2ad34858594e329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b10172715d423eb887d6c5b171defb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:48.555044 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1112/2259] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:48 2022] GET /compute/v2.1/servers/37daee2e-9629-4664-a85d-da2e8aa5ea2e => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:00:48.559936 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-2c4da399-a1c4-4450-a665-606f0e179177 req-9d0852df-3b75-41f4-9d03-67d4fc2c9004 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4be597d7-a3dd-44f3-9d17-946635bea8e6", "name": "network-vif-deleted", "tag": "3fc8d85d-19bc-4dc0-956f-6f21b791d90a"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:00:48.562068 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-803b6ddc-5550-48cc-861f-6a2225f335ae tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] 10.222.0.26 "GET /compute/v2.1/servers/a8b2f857-6c24-45fe-b934-cf92b2d18b7a" status: 200 len: 1539 microversion: 2.1 time: 0.391029 Oct 08 21:00:48.573587 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1148/2260] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:48 2022] GET /compute/v2.1/servers/a8b2f857-6c24-45fe-b934-cf92b2d18b7a => generated 1539 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:48.573587 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-a2a60e18-2c35-4dbc-ab59-b63cc06dd68b tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:48.573587 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-a2a60e18-2c35-4dbc-ab59-b63cc06dd68b tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] [instance: 4832d86f-ddee-445e-8b26-fae015d901a4] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:48.574327 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-2c4da399-a1c4-4450-a665-606f0e179177 req-9d0852df-3b75-41f4-9d03-67d4fc2c9004 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:48.574327 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-2c4da399-a1c4-4450-a665-606f0e179177 req-9d0852df-3b75-41f4-9d03-67d4fc2c9004 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:48.574327 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-2c4da399-a1c4-4450-a665-606f0e179177 req-9d0852df-3b75-41f4-9d03-67d4fc2c9004 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:48.580505 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a2a60e18-2c35-4dbc-ab59-b63cc06dd68b tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:48.580505 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a2a60e18-2c35-4dbc-ab59-b63cc06dd68b tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:48.580505 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a2a60e18-2c35-4dbc-ab59-b63cc06dd68b tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:48.580505 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a2a60e18-2c35-4dbc-ab59-b63cc06dd68b tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:48.580505 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a2a60e18-2c35-4dbc-ab59-b63cc06dd68b tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:48.580505 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a2a60e18-2c35-4dbc-ab59-b63cc06dd68b tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:48.584833 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-2c4da399-a1c4-4450-a665-606f0e179177 req-9d0852df-3b75-41f4-9d03-67d4fc2c9004 service nova] Creating event network-vif-deleted:3fc8d85d-19bc-4dc0-956f-6f21b791d90a for instance 4be597d7-a3dd-44f3-9d17-946635bea8e6 on nch2-master-1 Oct 08 21:00:48.590440 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-2c4da399-a1c4-4450-a665-606f0e179177 req-9d0852df-3b75-41f4-9d03-67d4fc2c9004 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033518 Oct 08 21:00:48.609591 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1113/2261] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:00:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:00:48.615030 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-755815f3-3e17-4268-ae03-960b5fda60a1 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:48.615750 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-755815f3-3e17-4268-ae03-960b5fda60a1 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] [instance: 4be597d7-a3dd-44f3-9d17-946635bea8e6] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:48.622510 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-755815f3-3e17-4268-ae03-960b5fda60a1 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:48.623017 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-755815f3-3e17-4268-ae03-960b5fda60a1 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:48.623473 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-755815f3-3e17-4268-ae03-960b5fda60a1 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:48.624199 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-755815f3-3e17-4268-ae03-960b5fda60a1 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:48.624669 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-755815f3-3e17-4268-ae03-960b5fda60a1 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:48.625107 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-755815f3-3e17-4268-ae03-960b5fda60a1 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:48.640115 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-755815f3-3e17-4268-ae03-960b5fda60a1 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] HTTP exception thrown: Instance 4be597d7-a3dd-44f3-9d17-946635bea8e6 could not be found. Oct 08 21:00:48.641859 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-755815f3-3e17-4268-ae03-960b5fda60a1 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Request method failure captured: Oct 08 21:00:48.641859 ncdv-master-1 devstack@n-api.service[140491]: request: GET /compute/v2.1/servers/4be597d7-a3dd-44f3-9d17-946635bea8e6 HTTP/1.1 Oct 08 21:00:48.641859 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:00:48.641859 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:00:48.641859 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:00:48.641859 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 21:00:48.641859 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:00:48.641859 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:00:48.641859 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:00:48.641859 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:00:48.641859 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeRR295mmmZhL7rSOgfacjSsWQ1Ti3FYd30sypy6B-ALaT7WOeiqaScllnDYtpa4eJ1mjmv4WUyVTLu5zt1pdJiZcKAFWv_GnEIqR6TqCn43v4gEmVWskuydtSKspT0UK00dWYkPU4ZM4UBd8cYd3myAyAfY7HLwKtG1LqfYrCLqzow Oct 08 21:00:48.641859 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:00:48.641859 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:00:48.641859 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:00:48.641859 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:00:48.641859 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:00:48.641859 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:00:48.641859 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 8472b054404c46a99b81aba34d6b9f40 Oct 08 21:00:48.641859 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-ServersOnMultiNodesTest-2078873751 Oct 08 21:00:48.641859 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:00:48.641859 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:00:48.641859 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8472b054404c46a99b81aba34d6b9f40"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8472b054404c46a99b81aba34d6b9f40"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8472b054404c46a99b81aba34d6b9f40"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8472b054404c46a99b81aba34d6b9f40"}]}] Oct 08 21:00:48.641859 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-ServersOnMultiNodesTest-2078873751 Oct 08 21:00:48.641859 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 8472b054404c46a99b81aba34d6b9f40 Oct 08 21:00:48.641859 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-2078873751 Oct 08 21:00:48.641859 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-ServersOnMultiNodesTest-2078873751-project Oct 08 21:00:48.641859 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:00:48.641859 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:00:48.641859 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 67ddc3cd3c374bacbe5bf5e0877380e2 Oct 08 21:00:48.641859 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-ServersOnMultiNodesTest-2078873751-project Oct 08 21:00:48.641859 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:00:48.641859 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance 4be597d7-a3dd-44f3-9d17-946635bea8e6 could not be found. Oct 08 21:00:48.641859 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': '4be597d7-a3dd-44f3-9d17-946635bea8e6'} Oct 08 21:00:48.641859 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:00:48.641859 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:00:48.641859 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:00:48.641859 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:00:48.641859 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:00:48.641859 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:00:48.641859 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:00:48.641859 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:00:48.641859 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:00:48.641859 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:00:48.641859 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4be597d7-a3dd-44f3-9d17-946635bea8e6 could not be found. Oct 08 21:00:48.641859 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:00:48.641859 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:00:48.641859 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:00:48.641859 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:00:48.641859 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:00:48.641859 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:00:48.641859 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:00:48.641859 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:00:48.641859 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:00:48.641859 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:00:48.641859 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:00:48.641859 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:00:48.641859 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:00:48.641859 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:00:48.641859 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:00:48.641859 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:00:48.641859 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4be597d7-a3dd-44f3-9d17-946635bea8e6 could not be found. Oct 08 21:00:48.641859 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:00:48.641859 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:00:48.641859 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:00:48.645960 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:00:48.645960 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:00:48.645960 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:00:48.645960 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:00:48.645960 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:00:48.645960 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4be597d7-a3dd-44f3-9d17-946635bea8e6 could not be found. Oct 08 21:00:48.645960 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:00:48.645960 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-755815f3-3e17-4268-ae03-960b5fda60a1 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Returning 404 to user: Instance 4be597d7-a3dd-44f3-9d17-946635bea8e6 could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:00:48.645960 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-755815f3-3e17-4268-ae03-960b5fda60a1 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] 10.222.0.26 "GET /compute/v2.1/servers/4be597d7-a3dd-44f3-9d17-946635bea8e6" status: 404 len: 111 microversion: 2.1 time: 0.032480 Oct 08 21:00:48.647136 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1114/2262] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:48 2022] GET /compute/v2.1/servers/4be597d7-a3dd-44f3-9d17-946635bea8e6 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:00:48.654223 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-8920aec2-f409-4114-8eed-98bc91178e9f tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:48.703009 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-8920aec2-f409-4114-8eed-98bc91178e9f tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] 10.222.0.26 "DELETE /compute/v2.1/os-server-groups/fe819c51-52ee-4d77-83e3-6fe92bbd0690" status: 204 len: 0 microversion: 2.1 time: 0.054595 Oct 08 21:00:48.703629 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1115/2263] 10.222.0.26 () {58 vars in 1266 bytes} [Sat Oct 8 21:00:48 2022] DELETE /compute/v2.1/os-server-groups/fe819c51-52ee-4d77-83e3-6fe92bbd0690 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 21:00:48.716433 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-363d9431-e0fb-4039-b9bd-45967ef06c24 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:48.717274 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-363d9431-e0fb-4039-b9bd-45967ef06c24 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] [instance: edebb288-3d28-4432-b9fd-d74cfb2de586] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:48.725234 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-363d9431-e0fb-4039-b9bd-45967ef06c24 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:48.725925 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-363d9431-e0fb-4039-b9bd-45967ef06c24 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:48.726568 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-363d9431-e0fb-4039-b9bd-45967ef06c24 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:48.727429 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-363d9431-e0fb-4039-b9bd-45967ef06c24 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:48.728033 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-363d9431-e0fb-4039-b9bd-45967ef06c24 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:48.728750 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-363d9431-e0fb-4039-b9bd-45967ef06c24 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:48.757130 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-a2a60e18-2c35-4dbc-ab59-b63cc06dd68b tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '463a3aac627c43d7af0dbc9facb52076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac791938e6384c8c8473ffd65cf867a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:48.760586 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:00:48.769297 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-363d9431-e0fb-4039-b9bd-45967ef06c24 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] [instance: edebb288-3d28-4432-b9fd-d74cfb2de586] Going to try to terminate instance {{(pid=140491) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 21:00:48.771066 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-a2a60e18-2c35-4dbc-ab59-b63cc06dd68b tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] 10.222.0.26 "GET /compute/v2.1/servers/4832d86f-ddee-445e-8b26-fae015d901a4" status: 200 len: 1514 microversion: 2.1 time: 0.206956 Oct 08 21:00:48.772890 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1149/2264] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:48 2022] GET /compute/v2.1/servers/4832d86f-ddee-445e-8b26-fae015d901a4 => generated 1514 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:48.793894 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-ee9bbadf-5a31-403e-bdf0-7cdd3616c26e tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:48.794635 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-ee9bbadf-5a31-403e-bdf0-7cdd3616c26e tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] [instance: d02ba7e0-a550-4e8e-a3ab-37ed519e22b0] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:48.801902 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ee9bbadf-5a31-403e-bdf0-7cdd3616c26e tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:48.802726 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ee9bbadf-5a31-403e-bdf0-7cdd3616c26e tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:48.803419 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ee9bbadf-5a31-403e-bdf0-7cdd3616c26e tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:48.804366 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ee9bbadf-5a31-403e-bdf0-7cdd3616c26e tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:48.805041 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ee9bbadf-5a31-403e-bdf0-7cdd3616c26e tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:48.805609 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ee9bbadf-5a31-403e-bdf0-7cdd3616c26e tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:48.837681 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:DELETE=3 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:00:48.858036 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-363d9431-e0fb-4039-b9bd-45967ef06c24 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] 10.222.0.26 "DELETE /compute/v2.1/servers/edebb288-3d28-4432-b9fd-d74cfb2de586" status: 204 len: 0 microversion: 2.1 time: 0.147268 Oct 08 21:00:48.858728 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1116/2265] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:00:48 2022] DELETE /compute/v2.1/servers/edebb288-3d28-4432-b9fd-d74cfb2de586 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 21:00:48.963079 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-ee9bbadf-5a31-403e-bdf0-7cdd3616c26e tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '463a3aac627c43d7af0dbc9facb52076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac791938e6384c8c8473ffd65cf867a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:48.973048 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-ee9bbadf-5a31-403e-bdf0-7cdd3616c26e tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] 10.222.0.26 "GET /compute/v2.1/servers/d02ba7e0-a550-4e8e-a3ab-37ed519e22b0" status: 200 len: 1515 microversion: 2.1 time: 0.182872 Oct 08 21:00:48.973825 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1150/2266] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:48 2022] GET /compute/v2.1/servers/d02ba7e0-a550-4e8e-a3ab-37ed519e22b0 => generated 1515 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:00:48.979388 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-00b4250f-d6e4-4af6-aabf-0491e5eb406c tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:48.979922 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-00b4250f-d6e4-4af6-aabf-0491e5eb406c tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] [instance: 84a8a931-6a18-4ef4-9e3c-63cf4054ea43] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:48.986642 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-00b4250f-d6e4-4af6-aabf-0491e5eb406c tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:48.987135 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-00b4250f-d6e4-4af6-aabf-0491e5eb406c tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:48.987633 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-a453efec-8e4d-4935-8604-d94050bbf057 tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Action: 'create', calling method: .version_select at 0x7f1a914d1f70>, body: {"keypair": {"name": "tempest-keypair-1813051332", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFVlCuzsXhOFIO6QL3jgKAjC1u78J0DkHxYvysLfbOMTQKZqDbfLJt9Q9KmUIdgyeFAg1RXLoLSN9xs9iHnEaGBxNa1jh/N5Q/z4VtAD3JCcHtvJ0qi1iLOAmZQVv3tMVQ=="}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:00:48.987770 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-00b4250f-d6e4-4af6-aabf-0491e5eb406c tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:48.988447 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-00b4250f-d6e4-4af6-aabf-0491e5eb406c tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:48.989206 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-00b4250f-d6e4-4af6-aabf-0491e5eb406c tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:48.989810 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-00b4250f-d6e4-4af6-aabf-0491e5eb406c tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:49.004346 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-a453efec-8e4d-4935-8604-d94050bbf057 tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Getting quotas for project ad3679a59b504731b5f56e52788fd645. Resources: {'key_pairs'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:00:49.010784 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-a453efec-8e4d-4935-8604-d94050bbf057 tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Getting quotas for user 56c7aebdf00342b1ba80833663f8c0a9 and project ad3679a59b504731b5f56e52788fd645. Resources: {'key_pairs'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:00:49.018692 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-00b4250f-d6e4-4af6-aabf-0491e5eb406c tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] [instance: 84a8a931-6a18-4ef4-9e3c-63cf4054ea43] Going to try to terminate instance {{(pid=140492) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 21:00:49.038132 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-a453efec-8e4d-4935-8604-d94050bbf057 tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.178030 Oct 08 21:00:49.038648 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1117/2267] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Oct 8 21:00:48 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:00:49.050135 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-b900cb43-c10f-41cd-81c0-78667fd89adf tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:49.051275 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-b900cb43-c10f-41cd-81c0-78667fd89adf tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] [instance: 579b0f8b-ccae-4c2b-bb48-1da1aaf6a138] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:49.059657 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b900cb43-c10f-41cd-81c0-78667fd89adf tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:49.060564 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b900cb43-c10f-41cd-81c0-78667fd89adf tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:49.061243 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b900cb43-c10f-41cd-81c0-78667fd89adf tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:49.062202 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b900cb43-c10f-41cd-81c0-78667fd89adf tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:49.062666 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b900cb43-c10f-41cd-81c0-78667fd89adf tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:49.063102 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b900cb43-c10f-41cd-81c0-78667fd89adf tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:49.139397 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-00b4250f-d6e4-4af6-aabf-0491e5eb406c tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] 10.222.0.26 "DELETE /compute/v2.1/servers/84a8a931-6a18-4ef4-9e3c-63cf4054ea43" status: 204 len: 0 microversion: 2.1 time: 0.163674 Oct 08 21:00:49.140528 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1151/2268] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:00:48 2022] DELETE /compute/v2.1/servers/84a8a931-6a18-4ef4-9e3c-63cf4054ea43 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 21:00:49.150746 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-248a4041-a671-4a87-bd16-0698b8faffb6 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:49.151333 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-248a4041-a671-4a87-bd16-0698b8faffb6 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] [instance: d02ba7e0-a550-4e8e-a3ab-37ed519e22b0] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:49.159841 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-248a4041-a671-4a87-bd16-0698b8faffb6 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:49.161313 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-248a4041-a671-4a87-bd16-0698b8faffb6 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:49.161911 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-248a4041-a671-4a87-bd16-0698b8faffb6 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:49.162657 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-248a4041-a671-4a87-bd16-0698b8faffb6 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:49.163367 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-248a4041-a671-4a87-bd16-0698b8faffb6 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:49.164088 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-248a4041-a671-4a87-bd16-0698b8faffb6 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:49.210035 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-248a4041-a671-4a87-bd16-0698b8faffb6 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] [instance: d02ba7e0-a550-4e8e-a3ab-37ed519e22b0] Going to try to terminate instance {{(pid=140492) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 21:00:49.251070 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-b900cb43-c10f-41cd-81c0-78667fd89adf tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1698dee4a2bf4ea19a6ee0c3d5cb5c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b00ee5e7828469f95bd90548d35982a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:49.260302 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-b900cb43-c10f-41cd-81c0-78667fd89adf tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] 10.222.0.26 "GET /compute/v2.1/servers/579b0f8b-ccae-4c2b-bb48-1da1aaf6a138" status: 200 len: 1523 microversion: 2.1 time: 0.220611 Oct 08 21:00:49.261298 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1118/2269] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:49 2022] GET /compute/v2.1/servers/579b0f8b-ccae-4c2b-bb48-1da1aaf6a138 => generated 1523 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:49.277463 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-f7fb739a-560a-4491-b141-a8669234550a tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:49.278126 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-f7fb739a-560a-4491-b141-a8669234550a tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] [instance: edebb288-3d28-4432-b9fd-d74cfb2de586] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:49.284941 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f7fb739a-560a-4491-b141-a8669234550a tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:49.285918 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f7fb739a-560a-4491-b141-a8669234550a tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:49.286697 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f7fb739a-560a-4491-b141-a8669234550a tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:49.287121 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f7fb739a-560a-4491-b141-a8669234550a tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:49.287439 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f7fb739a-560a-4491-b141-a8669234550a tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:49.287991 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f7fb739a-560a-4491-b141-a8669234550a tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:49.385920 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-248a4041-a671-4a87-bd16-0698b8faffb6 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] 10.222.0.26 "DELETE /compute/v2.1/servers/d02ba7e0-a550-4e8e-a3ab-37ed519e22b0" status: 204 len: 0 microversion: 2.1 time: 0.240219 Oct 08 21:00:49.387471 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1152/2270] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:00:49 2022] DELETE /compute/v2.1/servers/d02ba7e0-a550-4e8e-a3ab-37ed519e22b0 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 21:00:49.398638 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-37c58d51-74f6-4e59-84d8-9655630cd11c tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:49.399405 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-37c58d51-74f6-4e59-84d8-9655630cd11c tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: 38b000d3-167b-4f7a-ab80-cd51fcb7cbaf] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:49.411637 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-37c58d51-74f6-4e59-84d8-9655630cd11c tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:49.412138 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-37c58d51-74f6-4e59-84d8-9655630cd11c tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:49.412592 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-37c58d51-74f6-4e59-84d8-9655630cd11c tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:49.413338 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-37c58d51-74f6-4e59-84d8-9655630cd11c tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:49.413804 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-37c58d51-74f6-4e59-84d8-9655630cd11c tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:49.414236 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-37c58d51-74f6-4e59-84d8-9655630cd11c tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:49.468723 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-f7fb739a-560a-4491-b141-a8669234550a tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ddc3cd3c374bacbe5bf5e0877380e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8472b054404c46a99b81aba34d6b9f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:49.478439 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-f7fb739a-560a-4491-b141-a8669234550a tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] 10.222.0.26 "GET /compute/v2.1/servers/edebb288-3d28-4432-b9fd-d74cfb2de586" status: 200 len: 1474 microversion: 2.1 time: 0.214540 Oct 08 21:00:49.478439 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1119/2271] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:49 2022] GET /compute/v2.1/servers/edebb288-3d28-4432-b9fd-d74cfb2de586 => generated 1474 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:49.483186 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-f0367ce9-ced5-42b5-a6b6-069d8a40eec4 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:49.483787 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-f0367ce9-ced5-42b5-a6b6-069d8a40eec4 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] [instance: d02ba7e0-a550-4e8e-a3ab-37ed519e22b0] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:49.497648 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f0367ce9-ced5-42b5-a6b6-069d8a40eec4 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:49.498305 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f0367ce9-ced5-42b5-a6b6-069d8a40eec4 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:49.498756 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f0367ce9-ced5-42b5-a6b6-069d8a40eec4 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:49.499468 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f0367ce9-ced5-42b5-a6b6-069d8a40eec4 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:49.499942 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f0367ce9-ced5-42b5-a6b6-069d8a40eec4 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:49.500353 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f0367ce9-ced5-42b5-a6b6-069d8a40eec4 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:49.643283 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-37c58d51-74f6-4e59-84d8-9655630cd11c tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:49.653535 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-37c58d51-74f6-4e59-84d8-9655630cd11c tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/38b000d3-167b-4f7a-ab80-cd51fcb7cbaf" status: 200 len: 1312 microversion: 2.1 time: 0.264674 Oct 08 21:00:49.669358 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-f0367ce9-ced5-42b5-a6b6-069d8a40eec4 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '463a3aac627c43d7af0dbc9facb52076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac791938e6384c8c8473ffd65cf867a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:49.669358 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-f0367ce9-ced5-42b5-a6b6-069d8a40eec4 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] 10.222.0.26 "GET /compute/v2.1/servers/d02ba7e0-a550-4e8e-a3ab-37ed519e22b0" status: 200 len: 1521 microversion: 2.1 time: 0.190075 Oct 08 21:00:49.670318 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1120/2272] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:49 2022] GET /compute/v2.1/servers/d02ba7e0-a550-4e8e-a3ab-37ed519e22b0 => generated 1521 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:49.672286 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1153/2273] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:49 2022] GET /compute/v2.1/servers/38b000d3-167b-4f7a-ab80-cd51fcb7cbaf => generated 1312 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:49.677123 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-017c8df5-1696-4b41-83d0-e01579b80194 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:49.678184 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-017c8df5-1696-4b41-83d0-e01579b80194 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] [instance: a8b2f857-6c24-45fe-b934-cf92b2d18b7a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:49.684733 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-017c8df5-1696-4b41-83d0-e01579b80194 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:49.685266 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-017c8df5-1696-4b41-83d0-e01579b80194 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:49.685716 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-017c8df5-1696-4b41-83d0-e01579b80194 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:49.686904 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-017c8df5-1696-4b41-83d0-e01579b80194 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:49.687568 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-017c8df5-1696-4b41-83d0-e01579b80194 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:49.688202 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-017c8df5-1696-4b41-83d0-e01579b80194 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:50.218753 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-017c8df5-1696-4b41-83d0-e01579b80194 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06caf10b6fa43a3a2ad34858594e329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b10172715d423eb887d6c5b171defb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:50.232991 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-017c8df5-1696-4b41-83d0-e01579b80194 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] 10.222.0.26 "GET /compute/v2.1/servers/a8b2f857-6c24-45fe-b934-cf92b2d18b7a" status: 200 len: 1539 microversion: 2.1 time: 0.560097 Oct 08 21:00:50.234433 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1121/2274] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:49 2022] GET /compute/v2.1/servers/a8b2f857-6c24-45fe-b934-cf92b2d18b7a => generated 1539 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:50.288267 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-a70a90a5-3d3b-4805-8c56-915a0cd89eea tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:50.288756 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-a70a90a5-3d3b-4805-8c56-915a0cd89eea tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] [instance: 579b0f8b-ccae-4c2b-bb48-1da1aaf6a138] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:50.336237 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a70a90a5-3d3b-4805-8c56-915a0cd89eea tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:50.336775 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a70a90a5-3d3b-4805-8c56-915a0cd89eea tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:50.337323 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a70a90a5-3d3b-4805-8c56-915a0cd89eea tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:50.340692 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a70a90a5-3d3b-4805-8c56-915a0cd89eea tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:50.341383 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a70a90a5-3d3b-4805-8c56-915a0cd89eea tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:50.341949 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a70a90a5-3d3b-4805-8c56-915a0cd89eea tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:50.502321 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-24dcdb2c-e3cd-4649-a6e8-c64a6f3d9e4a tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:50.504428 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-24dcdb2c-e3cd-4649-a6e8-c64a6f3d9e4a tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] [instance: edebb288-3d28-4432-b9fd-d74cfb2de586] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:50.518174 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-24dcdb2c-e3cd-4649-a6e8-c64a6f3d9e4a tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:50.520408 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-24dcdb2c-e3cd-4649-a6e8-c64a6f3d9e4a tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:50.522041 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-24dcdb2c-e3cd-4649-a6e8-c64a6f3d9e4a tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:50.524403 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-24dcdb2c-e3cd-4649-a6e8-c64a6f3d9e4a tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:50.525552 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-24dcdb2c-e3cd-4649-a6e8-c64a6f3d9e4a tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:50.528639 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-24dcdb2c-e3cd-4649-a6e8-c64a6f3d9e4a tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:50.598494 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-a70a90a5-3d3b-4805-8c56-915a0cd89eea tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1698dee4a2bf4ea19a6ee0c3d5cb5c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b00ee5e7828469f95bd90548d35982a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:50.609897 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-a70a90a5-3d3b-4805-8c56-915a0cd89eea tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] 10.222.0.26 "GET /compute/v2.1/servers/579b0f8b-ccae-4c2b-bb48-1da1aaf6a138" status: 200 len: 1523 microversion: 2.1 time: 0.326305 Oct 08 21:00:50.621279 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1154/2275] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:50 2022] GET /compute/v2.1/servers/579b0f8b-ccae-4c2b-bb48-1da1aaf6a138 => generated 1523 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:50.679108 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-d3a7c8f2-8621-4b09-ba5b-61d9cb56dfbc tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:50.680133 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-d3a7c8f2-8621-4b09-ba5b-61d9cb56dfbc tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: 38b000d3-167b-4f7a-ab80-cd51fcb7cbaf] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:50.693616 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d3a7c8f2-8621-4b09-ba5b-61d9cb56dfbc tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:50.694393 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d3a7c8f2-8621-4b09-ba5b-61d9cb56dfbc tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:50.695007 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d3a7c8f2-8621-4b09-ba5b-61d9cb56dfbc tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:50.695897 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d3a7c8f2-8621-4b09-ba5b-61d9cb56dfbc tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:50.696665 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d3a7c8f2-8621-4b09-ba5b-61d9cb56dfbc tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:50.697427 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d3a7c8f2-8621-4b09-ba5b-61d9cb56dfbc tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:50.802775 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-24dcdb2c-e3cd-4649-a6e8-c64a6f3d9e4a tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ddc3cd3c374bacbe5bf5e0877380e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8472b054404c46a99b81aba34d6b9f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:50.816825 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-24dcdb2c-e3cd-4649-a6e8-c64a6f3d9e4a tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] 10.222.0.26 "GET /compute/v2.1/servers/edebb288-3d28-4432-b9fd-d74cfb2de586" status: 200 len: 1474 microversion: 2.1 time: 0.318569 Oct 08 21:00:50.817839 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1122/2276] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:50 2022] GET /compute/v2.1/servers/edebb288-3d28-4432-b9fd-d74cfb2de586 => generated 1474 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:50.822662 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-ca6ffdfa-c2fb-46c1-aa28-dc7236a14841 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:50.823456 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-ca6ffdfa-c2fb-46c1-aa28-dc7236a14841 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] [instance: d02ba7e0-a550-4e8e-a3ab-37ed519e22b0] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:50.838580 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ca6ffdfa-c2fb-46c1-aa28-dc7236a14841 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:50.839873 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ca6ffdfa-c2fb-46c1-aa28-dc7236a14841 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:50.841122 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ca6ffdfa-c2fb-46c1-aa28-dc7236a14841 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:50.842463 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ca6ffdfa-c2fb-46c1-aa28-dc7236a14841 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:50.843102 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ca6ffdfa-c2fb-46c1-aa28-dc7236a14841 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:50.843718 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ca6ffdfa-c2fb-46c1-aa28-dc7236a14841 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:50.868205 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-d3a7c8f2-8621-4b09-ba5b-61d9cb56dfbc tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:50.890672 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-d3a7c8f2-8621-4b09-ba5b-61d9cb56dfbc tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/38b000d3-167b-4f7a-ab80-cd51fcb7cbaf" status: 200 len: 1312 microversion: 2.1 time: 0.218296 Oct 08 21:00:50.896767 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1155/2277] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:50 2022] GET /compute/v2.1/servers/38b000d3-167b-4f7a-ab80-cd51fcb7cbaf => generated 1312 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:51.111159 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-ca6ffdfa-c2fb-46c1-aa28-dc7236a14841 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '463a3aac627c43d7af0dbc9facb52076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac791938e6384c8c8473ffd65cf867a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:51.120267 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-ca6ffdfa-c2fb-46c1-aa28-dc7236a14841 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] 10.222.0.26 "GET /compute/v2.1/servers/d02ba7e0-a550-4e8e-a3ab-37ed519e22b0" status: 200 len: 1521 microversion: 2.1 time: 0.301160 Oct 08 21:00:51.133712 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1123/2278] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:50 2022] GET /compute/v2.1/servers/d02ba7e0-a550-4e8e-a3ab-37ed519e22b0 => generated 1521 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:51.257732 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-6d6ed5fc-ec21-4f33-9ba6-fc6805d42ad9 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:51.259016 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-6d6ed5fc-ec21-4f33-9ba6-fc6805d42ad9 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] [instance: a8b2f857-6c24-45fe-b934-cf92b2d18b7a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:51.270271 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6d6ed5fc-ec21-4f33-9ba6-fc6805d42ad9 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:51.272176 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6d6ed5fc-ec21-4f33-9ba6-fc6805d42ad9 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:51.272629 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6d6ed5fc-ec21-4f33-9ba6-fc6805d42ad9 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:51.275521 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6d6ed5fc-ec21-4f33-9ba6-fc6805d42ad9 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:51.276192 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6d6ed5fc-ec21-4f33-9ba6-fc6805d42ad9 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:51.276637 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6d6ed5fc-ec21-4f33-9ba6-fc6805d42ad9 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:51.451027 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-6d6ed5fc-ec21-4f33-9ba6-fc6805d42ad9 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06caf10b6fa43a3a2ad34858594e329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b10172715d423eb887d6c5b171defb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:51.469344 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-bdaf543c-4fd3-4748-9692-e2825803abed tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "c8bb6bac-ceb6-4b3a-845c-361eacc45114"}], "security_groups": [{"name": "tempest-securitygroup--502919318"}], "key_name": "tempest-keypair-1813051332", "user_data": "}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:00:51.471353 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-6d6ed5fc-ec21-4f33-9ba6-fc6805d42ad9 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] 10.222.0.26 "GET /compute/v2.1/servers/a8b2f857-6c24-45fe-b934-cf92b2d18b7a" status: 200 len: 1539 microversion: 2.1 time: 0.215955 Oct 08 21:00:51.474772 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1156/2279] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:51 2022] GET /compute/v2.1/servers/a8b2f857-6c24-45fe-b934-cf92b2d18b7a => generated 1539 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:51.502189 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e31a2200-7943-42da-b12c-f1f83c473cb9 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7bdc4b7b-49a2-45d3-acde-2c3909fd91f7"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:00:51.505500 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-e31a2200-7943-42da-b12c-f1f83c473cb9 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] [instance: b1a2f781-46a1-43f3-946a-f269deb6455e] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:51.512884 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e31a2200-7943-42da-b12c-f1f83c473cb9 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:51.513488 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e31a2200-7943-42da-b12c-f1f83c473cb9 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:51.514329 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e31a2200-7943-42da-b12c-f1f83c473cb9 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:51.515153 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e31a2200-7943-42da-b12c-f1f83c473cb9 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:51.515859 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e31a2200-7943-42da-b12c-f1f83c473cb9 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:51.516483 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e31a2200-7943-42da-b12c-f1f83c473cb9 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:51.741701 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.network.neutron [None req-bdaf543c-4fd3-4748-9692-e2825803abed tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] validate_networks() for [('c8bb6bac-ceb6-4b3a-845c-361eacc45114', None, None, None, None, None)] {{(pid=140491) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 21:00:51.964746 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-e31a2200-7943-42da-b12c-f1f83c473cb9 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] 10.222.0.26 "POST /compute/v2.1/servers/b1a2f781-46a1-43f3-946a-f269deb6455e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.465916 Oct 08 21:00:51.966205 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1157/2280] 10.222.0.26 () {60 vars in 1323 bytes} [Sat Oct 8 21:00:51 2022] POST /compute/v2.1/servers/b1a2f781-46a1-43f3-946a-f269deb6455e/os-volume_attachments => generated 194 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 08 21:00:52.001318 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-afc43cb3-a1e8-4ee1-a649-f964d192aa5f tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:52.003779 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-afc43cb3-a1e8-4ee1-a649-f964d192aa5f tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] [instance: 579b0f8b-ccae-4c2b-bb48-1da1aaf6a138] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:52.046861 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-afc43cb3-a1e8-4ee1-a649-f964d192aa5f tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:52.047380 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-afc43cb3-a1e8-4ee1-a649-f964d192aa5f tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:52.051704 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-afc43cb3-a1e8-4ee1-a649-f964d192aa5f tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:52.056568 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-afc43cb3-a1e8-4ee1-a649-f964d192aa5f tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:52.060480 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-afc43cb3-a1e8-4ee1-a649-f964d192aa5f tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:52.061260 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-afc43cb3-a1e8-4ee1-a649-f964d192aa5f tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:53.054531 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-afc43cb3-a1e8-4ee1-a649-f964d192aa5f tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1698dee4a2bf4ea19a6ee0c3d5cb5c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b00ee5e7828469f95bd90548d35982a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:53.066966 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-afc43cb3-a1e8-4ee1-a649-f964d192aa5f tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] 10.222.0.26 "GET /compute/v2.1/servers/579b0f8b-ccae-4c2b-bb48-1da1aaf6a138" status: 200 len: 1523 microversion: 2.1 time: 1.099386 Oct 08 21:00:53.068209 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1158/2281] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:51 2022] GET /compute/v2.1/servers/579b0f8b-ccae-4c2b-bb48-1da1aaf6a138 => generated 1523 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:53.074867 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-33eea756-b46c-4688-b361-bad53956ac2b tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:53.075775 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-33eea756-b46c-4688-b361-bad53956ac2b tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] [instance: edebb288-3d28-4432-b9fd-d74cfb2de586] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:53.083807 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-33eea756-b46c-4688-b361-bad53956ac2b tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:53.084686 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-33eea756-b46c-4688-b361-bad53956ac2b tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:53.085558 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-33eea756-b46c-4688-b361-bad53956ac2b tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:53.086466 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-33eea756-b46c-4688-b361-bad53956ac2b tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:53.087153 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-33eea756-b46c-4688-b361-bad53956ac2b tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:53.087747 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-33eea756-b46c-4688-b361-bad53956ac2b tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:53.197833 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-33eea756-b46c-4688-b361-bad53956ac2b tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ddc3cd3c374bacbe5bf5e0877380e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8472b054404c46a99b81aba34d6b9f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:53.216009 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-33eea756-b46c-4688-b361-bad53956ac2b tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] 10.222.0.26 "GET /compute/v2.1/servers/edebb288-3d28-4432-b9fd-d74cfb2de586" status: 200 len: 1432 microversion: 2.1 time: 0.146465 Oct 08 21:00:53.229298 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1159/2282] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:53 2022] GET /compute/v2.1/servers/edebb288-3d28-4432-b9fd-d74cfb2de586 => generated 1432 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:53.229298 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e8168091-7495-4055-8348-f85b68b13ad7 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:53.229298 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-e8168091-7495-4055-8348-f85b68b13ad7 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: 38b000d3-167b-4f7a-ab80-cd51fcb7cbaf] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:53.233260 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e8168091-7495-4055-8348-f85b68b13ad7 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:53.234125 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e8168091-7495-4055-8348-f85b68b13ad7 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:53.234760 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e8168091-7495-4055-8348-f85b68b13ad7 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:53.236672 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e8168091-7495-4055-8348-f85b68b13ad7 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:53.237612 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e8168091-7495-4055-8348-f85b68b13ad7 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:53.238266 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e8168091-7495-4055-8348-f85b68b13ad7 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:53.270618 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-bdaf543c-4fd3-4748-9692-e2825803abed tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Flavor limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 21:00:53.271195 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-bdaf543c-4fd3-4748-9692-e2825803abed tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Image limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 21:00:53.271531 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-bdaf543c-4fd3-4748-9692-e2825803abed tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Flavor pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 21:00:53.271951 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-bdaf543c-4fd3-4748-9692-e2825803abed tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Image pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 21:00:53.272671 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-bdaf543c-4fd3-4748-9692-e2825803abed tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 21:00:53.285528 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bdaf543c-4fd3-4748-9692-e2825803abed tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:53.286028 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bdaf543c-4fd3-4748-9692-e2825803abed tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:53.286478 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bdaf543c-4fd3-4748-9692-e2825803abed tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:53.287221 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bdaf543c-4fd3-4748-9692-e2825803abed tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:53.287901 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bdaf543c-4fd3-4748-9692-e2825803abed tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:53.288616 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bdaf543c-4fd3-4748-9692-e2825803abed tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:53.327001 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-bdaf543c-4fd3-4748-9692-e2825803abed tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Getting quotas for project ad3679a59b504731b5f56e52788fd645. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:00:53.334234 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-bdaf543c-4fd3-4748-9692-e2825803abed tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Getting quotas for user 56c7aebdf00342b1ba80833663f8c0a9 and project ad3679a59b504731b5f56e52788fd645. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:00:53.351002 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-bdaf543c-4fd3-4748-9692-e2825803abed tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Going to run 1 instances... {{(pid=140491) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 21:00:53.353829 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-bdaf543c-4fd3-4748-9692-e2825803abed tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] [instance: 9ed82ee0-e56e-478e-a066-bad43e760a03] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c508bd7f-7db9-4b2c-af7c-be54a855c355',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140491) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 21:00:53.434637 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-bdaf543c-4fd3-4748-9692-e2825803abed tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.968191 Oct 08 21:00:53.443221 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1124/2283] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 21:00:51 2022] POST /compute/v2.1/servers => generated 408 bytes in 1979 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 08 21:00:53.453792 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-d163fa90-dcb5-4da9-ae4c-8de7a3bf1c4c tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:53.455941 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-d163fa90-dcb5-4da9-ae4c-8de7a3bf1c4c tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] [instance: d02ba7e0-a550-4e8e-a3ab-37ed519e22b0] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:53.469277 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d163fa90-dcb5-4da9-ae4c-8de7a3bf1c4c tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:53.472253 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d163fa90-dcb5-4da9-ae4c-8de7a3bf1c4c tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:53.472818 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d163fa90-dcb5-4da9-ae4c-8de7a3bf1c4c tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:53.478571 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d163fa90-dcb5-4da9-ae4c-8de7a3bf1c4c tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:53.479438 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d163fa90-dcb5-4da9-ae4c-8de7a3bf1c4c tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:53.480005 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d163fa90-dcb5-4da9-ae4c-8de7a3bf1c4c tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:53.556455 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d163fa90-dcb5-4da9-ae4c-8de7a3bf1c4c tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:53.558776 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d163fa90-dcb5-4da9-ae4c-8de7a3bf1c4c tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:53.559240 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d163fa90-dcb5-4da9-ae4c-8de7a3bf1c4c tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:53.562304 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.objects.instance [None req-d163fa90-dcb5-4da9-ae4c-8de7a3bf1c4c tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lazy-loading 'fault' on Instance uuid d02ba7e0-a550-4e8e-a3ab-37ed519e22b0 {{(pid=140491) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 21:00:53.577098 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-e8168091-7495-4055-8348-f85b68b13ad7 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:53.590520 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-e8168091-7495-4055-8348-f85b68b13ad7 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/38b000d3-167b-4f7a-ab80-cd51fcb7cbaf" status: 200 len: 1312 microversion: 2.1 time: 0.368320 Oct 08 21:00:53.591519 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1160/2284] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:53 2022] GET /compute/v2.1/servers/38b000d3-167b-4f7a-ab80-cd51fcb7cbaf => generated 1312 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:53.602569 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-98a8cba2-76c7-4d3d-8a9c-3f16e6a6625d tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:53.606993 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-98a8cba2-76c7-4d3d-8a9c-3f16e6a6625d tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] [instance: a8b2f857-6c24-45fe-b934-cf92b2d18b7a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:53.614539 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-98a8cba2-76c7-4d3d-8a9c-3f16e6a6625d tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:53.615372 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-98a8cba2-76c7-4d3d-8a9c-3f16e6a6625d tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:53.616099 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-98a8cba2-76c7-4d3d-8a9c-3f16e6a6625d tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:53.617045 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-98a8cba2-76c7-4d3d-8a9c-3f16e6a6625d tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:53.617746 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-98a8cba2-76c7-4d3d-8a9c-3f16e6a6625d tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:53.618397 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-98a8cba2-76c7-4d3d-8a9c-3f16e6a6625d tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:53.656160 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-d163fa90-dcb5-4da9-ae4c-8de7a3bf1c4c tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '463a3aac627c43d7af0dbc9facb52076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac791938e6384c8c8473ffd65cf867a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:53.665334 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-d163fa90-dcb5-4da9-ae4c-8de7a3bf1c4c tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] 10.222.0.26 "GET /compute/v2.1/servers/d02ba7e0-a550-4e8e-a3ab-37ed519e22b0" status: 200 len: 1312 microversion: 2.1 time: 0.220603 Oct 08 21:00:53.668846 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1125/2285] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:53 2022] GET /compute/v2.1/servers/d02ba7e0-a550-4e8e-a3ab-37ed519e22b0 => generated 1312 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:53.679116 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-37df6d03-b555-452f-a3f8-b2fa15219754 req-4a6776e9-1259-40a1-8cfd-05fef0446e10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d02ba7e0-a550-4e8e-a3ab-37ed519e22b0", "name": "network-vif-deleted", "tag": "b0bda0a3-50c5-4910-8348-ff8c20ea254b"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:00:53.702366 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-37df6d03-b555-452f-a3f8-b2fa15219754 req-4a6776e9-1259-40a1-8cfd-05fef0446e10 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:53.702961 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-37df6d03-b555-452f-a3f8-b2fa15219754 req-4a6776e9-1259-40a1-8cfd-05fef0446e10 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:53.704961 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-37df6d03-b555-452f-a3f8-b2fa15219754 req-4a6776e9-1259-40a1-8cfd-05fef0446e10 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:53.738565 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-37df6d03-b555-452f-a3f8-b2fa15219754 req-4a6776e9-1259-40a1-8cfd-05fef0446e10 service nova] Creating event network-vif-deleted:b0bda0a3-50c5-4910-8348-ff8c20ea254b for instance d02ba7e0-a550-4e8e-a3ab-37ed519e22b0 on nch1-master-1 Oct 08 21:00:53.752797 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-37df6d03-b555-452f-a3f8-b2fa15219754 req-4a6776e9-1259-40a1-8cfd-05fef0446e10 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080042 Oct 08 21:00:53.760013 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1126/2286] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:00:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:00:53.772914 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-afc2ec60-fc0c-417a-bfa1-74225e0f4574 req-fae859db-1f3f-4a77-bb7f-74dbdb4d0c27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84a8a931-6a18-4ef4-9e3c-63cf4054ea43", "name": "network-vif-deleted", "tag": "57ce510b-4c73-4cf0-bb97-6d1baab62e75"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:00:53.797278 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-afc2ec60-fc0c-417a-bfa1-74225e0f4574 req-fae859db-1f3f-4a77-bb7f-74dbdb4d0c27 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:53.798645 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-afc2ec60-fc0c-417a-bfa1-74225e0f4574 req-fae859db-1f3f-4a77-bb7f-74dbdb4d0c27 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:53.800895 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-afc2ec60-fc0c-417a-bfa1-74225e0f4574 req-fae859db-1f3f-4a77-bb7f-74dbdb4d0c27 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:53.828018 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-afc2ec60-fc0c-417a-bfa1-74225e0f4574 req-fae859db-1f3f-4a77-bb7f-74dbdb4d0c27 service nova] Creating event network-vif-deleted:57ce510b-4c73-4cf0-bb97-6d1baab62e75 for instance 84a8a931-6a18-4ef4-9e3c-63cf4054ea43 on nch2-master-1 Oct 08 21:00:53.840393 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-afc2ec60-fc0c-417a-bfa1-74225e0f4574 req-fae859db-1f3f-4a77-bb7f-74dbdb4d0c27 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076708 Oct 08 21:00:53.842753 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1127/2287] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:00:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:00:53.856063 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-76f07819-bf3c-45ae-803e-6917ce391a83 tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:53.857646 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-76f07819-bf3c-45ae-803e-6917ce391a83 tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] [instance: 9ed82ee0-e56e-478e-a066-bad43e760a03] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:53.905371 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-98a8cba2-76c7-4d3d-8a9c-3f16e6a6625d tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06caf10b6fa43a3a2ad34858594e329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b10172715d423eb887d6c5b171defb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:53.913875 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:00:53.926355 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-98a8cba2-76c7-4d3d-8a9c-3f16e6a6625d tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] 10.222.0.26 "GET /compute/v2.1/servers/a8b2f857-6c24-45fe-b934-cf92b2d18b7a" status: 200 len: 1521 microversion: 2.1 time: 0.333160 Oct 08 21:00:53.947379 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1161/2288] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:53 2022] GET /compute/v2.1/servers/a8b2f857-6c24-45fe-b934-cf92b2d18b7a => generated 1521 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:53.973892 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-01c9a3c2-23a9-480f-b577-e2ca32cb099c tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:53.974485 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-01c9a3c2-23a9-480f-b577-e2ca32cb099c tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] [instance: a8b2f857-6c24-45fe-b934-cf92b2d18b7a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:53.990050 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-01c9a3c2-23a9-480f-b577-e2ca32cb099c tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:53.990589 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-01c9a3c2-23a9-480f-b577-e2ca32cb099c tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:53.991027 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-01c9a3c2-23a9-480f-b577-e2ca32cb099c tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:53.991760 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-01c9a3c2-23a9-480f-b577-e2ca32cb099c tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:53.992228 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-01c9a3c2-23a9-480f-b577-e2ca32cb099c tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:53.992662 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-01c9a3c2-23a9-480f-b577-e2ca32cb099c tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:54.014381 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-76f07819-bf3c-45ae-803e-6917ce391a83 tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c7aebdf00342b1ba80833663f8c0a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad3679a59b504731b5f56e52788fd645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:54.026395 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-76f07819-bf3c-45ae-803e-6917ce391a83 tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] 10.222.0.26 "GET /compute/v2.1/servers/9ed82ee0-e56e-478e-a066-bad43e760a03" status: 200 len: 1226 microversion: 2.1 time: 0.180477 Oct 08 21:00:54.027715 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1128/2289] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:53 2022] GET /compute/v2.1/servers/9ed82ee0-e56e-478e-a066-bad43e760a03 => generated 1226 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:54.062233 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-01c9a3c2-23a9-480f-b577-e2ca32cb099c tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] [instance: a8b2f857-6c24-45fe-b934-cf92b2d18b7a] Going to try to terminate instance {{(pid=140492) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 21:00:54.097892 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-9345b629-5c4b-4b95-8b93-87cdfa9e33c7 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:54.098565 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-9345b629-5c4b-4b95-8b93-87cdfa9e33c7 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] [instance: 579b0f8b-ccae-4c2b-bb48-1da1aaf6a138] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:54.112225 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9345b629-5c4b-4b95-8b93-87cdfa9e33c7 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:54.115445 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9345b629-5c4b-4b95-8b93-87cdfa9e33c7 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:54.116139 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9345b629-5c4b-4b95-8b93-87cdfa9e33c7 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:54.117031 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9345b629-5c4b-4b95-8b93-87cdfa9e33c7 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:54.117604 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9345b629-5c4b-4b95-8b93-87cdfa9e33c7 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:54.121401 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9345b629-5c4b-4b95-8b93-87cdfa9e33c7 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:54.293275 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-01c9a3c2-23a9-480f-b577-e2ca32cb099c tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] 10.222.0.26 "DELETE /compute/v2.1/servers/a8b2f857-6c24-45fe-b934-cf92b2d18b7a" status: 204 len: 0 microversion: 2.1 time: 0.343759 Oct 08 21:00:54.303511 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1162/2290] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:00:53 2022] DELETE /compute/v2.1/servers/a8b2f857-6c24-45fe-b934-cf92b2d18b7a => generated 0 bytes in 356 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 21:00:54.312345 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-1294865b-5727-4420-a0eb-634d550bb8db tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:54.329795 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-1294865b-5727-4420-a0eb-634d550bb8db tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] [instance: edebb288-3d28-4432-b9fd-d74cfb2de586] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:54.373334 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1294865b-5727-4420-a0eb-634d550bb8db tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:54.374841 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1294865b-5727-4420-a0eb-634d550bb8db tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:54.376883 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1294865b-5727-4420-a0eb-634d550bb8db tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:54.377918 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1294865b-5727-4420-a0eb-634d550bb8db tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:54.379273 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1294865b-5727-4420-a0eb-634d550bb8db tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:54.386847 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1294865b-5727-4420-a0eb-634d550bb8db tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:54.470785 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1294865b-5727-4420-a0eb-634d550bb8db tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:54.471496 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1294865b-5727-4420-a0eb-634d550bb8db tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:54.476947 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1294865b-5727-4420-a0eb-634d550bb8db tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:54.477869 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.objects.instance [None req-1294865b-5727-4420-a0eb-634d550bb8db tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lazy-loading 'fault' on Instance uuid edebb288-3d28-4432-b9fd-d74cfb2de586 {{(pid=140492) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 21:00:54.523796 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-9345b629-5c4b-4b95-8b93-87cdfa9e33c7 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1698dee4a2bf4ea19a6ee0c3d5cb5c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b00ee5e7828469f95bd90548d35982a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:54.534830 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-9345b629-5c4b-4b95-8b93-87cdfa9e33c7 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] 10.222.0.26 "GET /compute/v2.1/servers/579b0f8b-ccae-4c2b-bb48-1da1aaf6a138" status: 200 len: 1523 microversion: 2.1 time: 0.442649 Oct 08 21:00:54.535151 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-1294865b-5727-4420-a0eb-634d550bb8db tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ddc3cd3c374bacbe5bf5e0877380e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8472b054404c46a99b81aba34d6b9f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:54.537075 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1129/2291] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:54 2022] GET /compute/v2.1/servers/579b0f8b-ccae-4c2b-bb48-1da1aaf6a138 => generated 1523 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:54.543108 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-76a412ce-29f0-4137-ab43-426af59403fa tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:54.544365 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-76a412ce-29f0-4137-ab43-426af59403fa tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] [instance: a8b2f857-6c24-45fe-b934-cf92b2d18b7a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:54.549965 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-1294865b-5727-4420-a0eb-634d550bb8db tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] 10.222.0.26 "GET /compute/v2.1/servers/edebb288-3d28-4432-b9fd-d74cfb2de586" status: 200 len: 1309 microversion: 2.1 time: 0.242424 Oct 08 21:00:54.551103 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1163/2292] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:54 2022] GET /compute/v2.1/servers/edebb288-3d28-4432-b9fd-d74cfb2de586 => generated 1309 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:54.554381 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-76a412ce-29f0-4137-ab43-426af59403fa tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:54.555185 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-76a412ce-29f0-4137-ab43-426af59403fa tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:54.555892 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-76a412ce-29f0-4137-ab43-426af59403fa tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:54.558991 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-76a412ce-29f0-4137-ab43-426af59403fa tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:54.559946 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-76a412ce-29f0-4137-ab43-426af59403fa tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:54.560803 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-76a412ce-29f0-4137-ab43-426af59403fa tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:54.619576 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-ef4e2fae-c0f7-4a86-a8f7-99f5dc67f39a req-9614bc23-3e25-4bf4-a632-0630415187c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38b000d3-167b-4f7a-ab80-cd51fcb7cbaf", "name": "network-vif-plugged", "status": "completed", "tag": "4e092828-fb69-410c-aa0c-7cbcee8350f3"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:00:54.647581 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-ef4e2fae-c0f7-4a86-a8f7-99f5dc67f39a req-9614bc23-3e25-4bf4-a632-0630415187c1 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:54.648064 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-ef4e2fae-c0f7-4a86-a8f7-99f5dc67f39a req-9614bc23-3e25-4bf4-a632-0630415187c1 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:54.648513 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-ef4e2fae-c0f7-4a86-a8f7-99f5dc67f39a req-9614bc23-3e25-4bf4-a632-0630415187c1 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:54.667854 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-ef4e2fae-c0f7-4a86-a8f7-99f5dc67f39a req-9614bc23-3e25-4bf4-a632-0630415187c1 service nova] Creating event network-vif-plugged:4e092828-fb69-410c-aa0c-7cbcee8350f3 for instance 38b000d3-167b-4f7a-ab80-cd51fcb7cbaf on nch2-master-1 Oct 08 21:00:54.676651 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-ef4e2fae-c0f7-4a86-a8f7-99f5dc67f39a req-9614bc23-3e25-4bf4-a632-0630415187c1 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068371 Oct 08 21:00:54.677249 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1164/2293] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:00:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:00:54.683582 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-9df320af-761b-4ae4-9c66-6fedee1922f2 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:54.684668 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-9df320af-761b-4ae4-9c66-6fedee1922f2 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: 38b000d3-167b-4f7a-ab80-cd51fcb7cbaf] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:54.694292 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9df320af-761b-4ae4-9c66-6fedee1922f2 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:54.695002 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9df320af-761b-4ae4-9c66-6fedee1922f2 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:54.695462 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9df320af-761b-4ae4-9c66-6fedee1922f2 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:54.696910 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9df320af-761b-4ae4-9c66-6fedee1922f2 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:54.697684 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9df320af-761b-4ae4-9c66-6fedee1922f2 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:54.698340 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9df320af-761b-4ae4-9c66-6fedee1922f2 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:54.781989 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-76a412ce-29f0-4137-ab43-426af59403fa tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06caf10b6fa43a3a2ad34858594e329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b10172715d423eb887d6c5b171defb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:54.793127 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-76a412ce-29f0-4137-ab43-426af59403fa tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] 10.222.0.26 "GET /compute/v2.1/servers/a8b2f857-6c24-45fe-b934-cf92b2d18b7a" status: 200 len: 1527 microversion: 2.1 time: 0.254077 Oct 08 21:00:54.793898 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1130/2294] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:54 2022] GET /compute/v2.1/servers/a8b2f857-6c24-45fe-b934-cf92b2d18b7a => generated 1527 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:54.805998 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-35ec719a-4f80-4072-afe7-348f00e6f892 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:54.805998 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-35ec719a-4f80-4072-afe7-348f00e6f892 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] [instance: d02ba7e0-a550-4e8e-a3ab-37ed519e22b0] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:54.805998 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-35ec719a-4f80-4072-afe7-348f00e6f892 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:54.806299 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-35ec719a-4f80-4072-afe7-348f00e6f892 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:54.806757 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-35ec719a-4f80-4072-afe7-348f00e6f892 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:54.808956 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-35ec719a-4f80-4072-afe7-348f00e6f892 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:54.809717 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-35ec719a-4f80-4072-afe7-348f00e6f892 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:54.810160 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-35ec719a-4f80-4072-afe7-348f00e6f892 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:54.839515 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-35ec719a-4f80-4072-afe7-348f00e6f892 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] HTTP exception thrown: Instance d02ba7e0-a550-4e8e-a3ab-37ed519e22b0 could not be found. Oct 08 21:00:54.841777 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-35ec719a-4f80-4072-afe7-348f00e6f892 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Request method failure captured: Oct 08 21:00:54.841777 ncdv-master-1 devstack@n-api.service[140491]: request: GET /compute/v2.1/servers/d02ba7e0-a550-4e8e-a3ab-37ed519e22b0 HTTP/1.1 Oct 08 21:00:54.841777 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:00:54.841777 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:00:54.841777 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:00:54.841777 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 21:00:54.841777 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:00:54.841777 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:00:54.841777 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:00:54.841777 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:00:54.841777 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeTgs6u98Kj2qNeUbhNZytTz3QZl3npCYhXvqzJPAHZJSisgyrybjMBWF-fdPl_tWpGYuTI6Puj6PawUImfVDEBxcbmulm9uh4lstHlNST7jgnukdD8WC74LVcFesaNP8PWq7Fzl1J3ZhXvWqEYDTsN6hHueqzcw9I-JZ0vsP9wgdik Oct 08 21:00:54.841777 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:00:54.841777 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:00:54.841777 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:00:54.841777 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:00:54.841777 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:00:54.841777 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:00:54.841777 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: ac791938e6384c8c8473ffd65cf867a8 Oct 08 21:00:54.841777 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-ListServersNegativeTestJSON-1263442127 Oct 08 21:00:54.841777 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:00:54.841777 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:00:54.841777 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ac791938e6384c8c8473ffd65cf867a8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ac791938e6384c8c8473ffd65cf867a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ac791938e6384c8c8473ffd65cf867a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ac791938e6384c8c8473ffd65cf867a8"}]}] Oct 08 21:00:54.841777 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-ListServersNegativeTestJSON-1263442127 Oct 08 21:00:54.841777 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: ac791938e6384c8c8473ffd65cf867a8 Oct 08 21:00:54.841777 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1263442127 Oct 08 21:00:54.841777 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-ListServersNegativeTestJSON-1263442127-project Oct 08 21:00:54.841777 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:00:54.841777 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:00:54.841777 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 463a3aac627c43d7af0dbc9facb52076 Oct 08 21:00:54.841777 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-ListServersNegativeTestJSON-1263442127-project Oct 08 21:00:54.841777 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:00:54.841777 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance d02ba7e0-a550-4e8e-a3ab-37ed519e22b0 could not be found. Oct 08 21:00:54.841777 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': 'd02ba7e0-a550-4e8e-a3ab-37ed519e22b0'} Oct 08 21:00:54.841777 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:00:54.841777 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:00:54.841777 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:00:54.841777 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:00:54.841777 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:00:54.841777 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:00:54.841777 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:00:54.841777 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:00:54.841777 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:00:54.841777 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:00:54.841777 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d02ba7e0-a550-4e8e-a3ab-37ed519e22b0 could not be found. Oct 08 21:00:54.841777 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:00:54.841777 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:00:54.841777 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:00:54.841777 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:00:54.841777 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:00:54.841777 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:00:54.841777 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:00:54.841777 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:00:54.841777 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:00:54.841777 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:00:54.841777 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:00:54.841777 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:00:54.841777 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:00:54.841777 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:00:54.841777 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:00:54.841777 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:00:54.841777 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d02ba7e0-a550-4e8e-a3ab-37ed519e22b0 could not be found. Oct 08 21:00:54.841777 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:00:54.841777 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:00:54.845933 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:00:54.845933 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:00:54.845933 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:00:54.845933 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:00:54.845933 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:00:54.845933 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:00:54.845933 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d02ba7e0-a550-4e8e-a3ab-37ed519e22b0 could not be found. Oct 08 21:00:54.845933 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:00:54.847374 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-35ec719a-4f80-4072-afe7-348f00e6f892 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Returning 404 to user: Instance d02ba7e0-a550-4e8e-a3ab-37ed519e22b0 could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:00:54.848584 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-35ec719a-4f80-4072-afe7-348f00e6f892 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] 10.222.0.26 "GET /compute/v2.1/servers/d02ba7e0-a550-4e8e-a3ab-37ed519e22b0" status: 404 len: 111 microversion: 2.1 time: 0.053514 Oct 08 21:00:54.849585 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1131/2295] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:54 2022] GET /compute/v2.1/servers/d02ba7e0-a550-4e8e-a3ab-37ed519e22b0 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:00:54.861487 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-0076f6f3-05d3-4c6e-8cea-44343a5efdda tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:54.868509 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-0076f6f3-05d3-4c6e-8cea-44343a5efdda tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '463a3aac627c43d7af0dbc9facb52076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac791938e6384c8c8473ffd65cf867a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:54.869981 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-0076f6f3-05d3-4c6e-8cea-44343a5efdda tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': 'ac791938e6384c8c8473ffd65cf867a8'} {{(pid=140491) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 08 21:00:54.876785 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0076f6f3-05d3-4c6e-8cea-44343a5efdda tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:54.877564 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0076f6f3-05d3-4c6e-8cea-44343a5efdda tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:54.878003 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0076f6f3-05d3-4c6e-8cea-44343a5efdda tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:54.878742 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0076f6f3-05d3-4c6e-8cea-44343a5efdda tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:54.879205 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0076f6f3-05d3-4c6e-8cea-44343a5efdda tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:54.879633 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0076f6f3-05d3-4c6e-8cea-44343a5efdda tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:54.919629 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-9df320af-761b-4ae4-9c66-6fedee1922f2 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:54.930899 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-9df320af-761b-4ae4-9c66-6fedee1922f2 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/38b000d3-167b-4f7a-ab80-cd51fcb7cbaf" status: 200 len: 1312 microversion: 2.1 time: 0.251093 Oct 08 21:00:54.931605 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1165/2296] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:54 2022] GET /compute/v2.1/servers/38b000d3-167b-4f7a-ab80-cd51fcb7cbaf => generated 1312 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:54.968241 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-0076f6f3-05d3-4c6e-8cea-44343a5efdda tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] 10.222.0.26 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.109933 Oct 08 21:00:54.969063 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1132/2297] 10.222.0.26 () {58 vars in 1230 bytes} [Sat Oct 8 21:00:54 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 08 21:00:54.982681 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-1847bb40-63dc-43ca-a596-57d162463a1e tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:54.987900 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-1847bb40-63dc-43ca-a596-57d162463a1e tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Request method failure captured: Oct 08 21:00:54.987900 ncdv-master-1 devstack@n-api.service[140492]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Oct 08 21:00:54.987900 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:00:54.987900 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:00:54.987900 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:00:54.987900 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 21:00:54.987900 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:00:54.987900 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:00:54.987900 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:00:54.987900 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:00:54.987900 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeTgs6u98Kj2qNeUbhNZytTz3QZl3npCYhXvqzJPAHZJSisgyrybjMBWF-fdPl_tWpGYuTI6Puj6PawUImfVDEBxcbmulm9uh4lstHlNST7jgnukdD8WC74LVcFesaNP8PWq7Fzl1J3ZhXvWqEYDTsN6hHueqzcw9I-JZ0vsP9wgdik Oct 08 21:00:54.987900 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:00:54.987900 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:00:54.987900 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:00:54.987900 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:00:54.987900 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:00:54.987900 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:00:54.987900 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: ac791938e6384c8c8473ffd65cf867a8 Oct 08 21:00:54.987900 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-ListServersNegativeTestJSON-1263442127 Oct 08 21:00:54.987900 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:00:54.987900 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:00:54.987900 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ac791938e6384c8c8473ffd65cf867a8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ac791938e6384c8c8473ffd65cf867a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ac791938e6384c8c8473ffd65cf867a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ac791938e6384c8c8473ffd65cf867a8"}]}] Oct 08 21:00:54.987900 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-ListServersNegativeTestJSON-1263442127 Oct 08 21:00:54.987900 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: ac791938e6384c8c8473ffd65cf867a8 Oct 08 21:00:54.987900 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1263442127 Oct 08 21:00:54.987900 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-ListServersNegativeTestJSON-1263442127-project Oct 08 21:00:54.987900 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:00:54.987900 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:00:54.987900 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 463a3aac627c43d7af0dbc9facb52076 Oct 08 21:00:54.987900 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-ListServersNegativeTestJSON-1263442127-project Oct 08 21:00:54.987900 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 21:00:54.987900 ncdv-master-1 devstack@n-api.service[140492]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 08 21:00:54.987900 ncdv-master-1 devstack@n-api.service[140492]: action_args: {} Oct 08 21:00:54.987900 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:00:54.987900 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:00:54.987900 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 08 21:00:54.987900 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 08 21:00:54.987900 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 08 21:00:54.987900 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise error Oct 08 21:00:54.987900 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Oct 08 21:00:54.987900 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:00:54.987900 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Oct 08 21:00:54.987900 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Oct 08 21:00:54.987900 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:00:54.987900 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 08 21:00:54.987900 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi '2011/01/01' Oct 08 21:00:54.987900 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:00:54.987900 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:00:54.987900 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:00:54.987900 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:00:54.987900 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:00:54.987900 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:00:54.987900 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:00:54.987900 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:00:54.987900 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:00:54.987900 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:00:54.987900 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 08 21:00:54.987900 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 21:00:54.987900 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 08 21:00:54.987900 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 21:00:54.987900 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 08 21:00:54.987900 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 21:00:54.987900 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 08 21:00:54.987900 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 08 21:00:54.987900 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 08 21:00:54.987900 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 08 21:00:54.992272 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 08 21:00:54.992272 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 08 21:00:54.992272 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 08 21:00:54.992272 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 08 21:00:54.992272 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:00:54.992272 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:00:54.992272 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:00:54.992272 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:00:54.992272 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:00:54.992272 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:00:54.992272 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 08 21:00:54.992272 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 08 21:00:54.992272 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 08 21:00:54.992272 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:00:55.001050 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-1847bb40-63dc-43ca-a596-57d162463a1e tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:00:55.013374 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-1847bb40-63dc-43ca-a596-57d162463a1e tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] 10.222.0.26 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.024130 Oct 08 21:00:55.019578 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1166/2298] 10.222.0.26 () {58 vars in 1182 bytes} [Sat Oct 8 21:00:54 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 42 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 08 21:00:55.025452 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-a2f2712c-efe2-4dda-9968-41d89082309b tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:55.030163 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-a2f2712c-efe2-4dda-9968-41d89082309b tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '463a3aac627c43d7af0dbc9facb52076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac791938e6384c8c8473ffd65cf867a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:55.030831 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-a2f2712c-efe2-4dda-9968-41d89082309b tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Searching by: {'deleted': False, 'project_id': 'ac791938e6384c8c8473ffd65cf867a8'} {{(pid=140491) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 08 21:00:55.036823 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a2f2712c-efe2-4dda-9968-41d89082309b tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:55.037344 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a2f2712c-efe2-4dda-9968-41d89082309b tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:55.037781 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a2f2712c-efe2-4dda-9968-41d89082309b tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:55.038510 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a2f2712c-efe2-4dda-9968-41d89082309b tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:55.038962 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a2f2712c-efe2-4dda-9968-41d89082309b tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:55.039389 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a2f2712c-efe2-4dda-9968-41d89082309b tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:55.055256 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-68f7743f-239f-4bb2-b2ca-aa536f944903 tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:55.055782 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-68f7743f-239f-4bb2-b2ca-aa536f944903 tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] [instance: 9ed82ee0-e56e-478e-a066-bad43e760a03] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:55.065285 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-68f7743f-239f-4bb2-b2ca-aa536f944903 tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:55.065953 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-68f7743f-239f-4bb2-b2ca-aa536f944903 tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:55.066204 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-68f7743f-239f-4bb2-b2ca-aa536f944903 tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:55.067087 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-68f7743f-239f-4bb2-b2ca-aa536f944903 tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:55.067700 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-68f7743f-239f-4bb2-b2ca-aa536f944903 tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:55.068277 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-68f7743f-239f-4bb2-b2ca-aa536f944903 tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:55.070236 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.multi_cell_list [None req-a2f2712c-efe2-4dda-9968-41d89082309b tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=140491) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 08 21:00:55.100785 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:00:55.124511 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-a2f2712c-efe2-4dda-9968-41d89082309b tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] 10.222.0.26 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.103510 Oct 08 21:00:55.125099 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1133/2299] 10.222.0.26 () {58 vars in 1125 bytes} [Sat Oct 8 21:00:55 2022] GET /compute/v2.1/servers => generated 681 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 08 21:00:55.138394 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-848bc63b-9eaf-46f4-9472-a406a70679ab tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:55.139659 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-68f7743f-239f-4bb2-b2ca-aa536f944903 tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c7aebdf00342b1ba80833663f8c0a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad3679a59b504731b5f56e52788fd645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:55.143443 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-848bc63b-9eaf-46f4-9472-a406a70679ab tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '463a3aac627c43d7af0dbc9facb52076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac791938e6384c8c8473ffd65cf867a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:55.143922 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.compute.servers [None req-848bc63b-9eaf-46f4-9472-a406a70679ab tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Removing options 'limit' from query {{(pid=140491) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 08 21:00:55.144583 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-848bc63b-9eaf-46f4-9472-a406a70679ab tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Searching by: {'deleted': False, 'project_id': 'ac791938e6384c8c8473ffd65cf867a8'} {{(pid=140491) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 08 21:00:55.147914 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-68f7743f-239f-4bb2-b2ca-aa536f944903 tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] 10.222.0.26 "GET /compute/v2.1/servers/9ed82ee0-e56e-478e-a066-bad43e760a03" status: 200 len: 1278 microversion: 2.1 time: 0.101690 Oct 08 21:00:55.148579 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1167/2300] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:55 2022] GET /compute/v2.1/servers/9ed82ee0-e56e-478e-a066-bad43e760a03 => generated 1278 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:00:55.150374 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-848bc63b-9eaf-46f4-9472-a406a70679ab tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:55.150865 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-848bc63b-9eaf-46f4-9472-a406a70679ab tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:55.151309 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-848bc63b-9eaf-46f4-9472-a406a70679ab tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:55.152080 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-848bc63b-9eaf-46f4-9472-a406a70679ab tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:55.152574 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-848bc63b-9eaf-46f4-9472-a406a70679ab tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:55.153039 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-848bc63b-9eaf-46f4-9472-a406a70679ab tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:55.177738 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.multi_cell_list [None req-848bc63b-9eaf-46f4-9472-a406a70679ab tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=140491) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 08 21:00:55.205511 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-848bc63b-9eaf-46f4-9472-a406a70679ab tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] 10.222.0.26 "GET /compute/v2.1/servers?limit=102" status: 200 len: 681 microversion: 2.1 time: 0.072074 Oct 08 21:00:55.206094 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1134/2301] 10.222.0.26 () {58 vars in 1144 bytes} [Sat Oct 8 21:00:55 2022] GET /compute/v2.1/servers?limit=102 => generated 681 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 08 21:00:55.219230 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-95f57a81-908c-49c4-87ae-fa68dd20d0be tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:55.223145 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-95f57a81-908c-49c4-87ae-fa68dd20d0be tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Request method failure captured: Oct 08 21:00:55.223145 ncdv-master-1 devstack@n-api.service[140492]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Oct 08 21:00:55.223145 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:00:55.223145 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:00:55.223145 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:00:55.223145 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 21:00:55.223145 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:00:55.223145 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:00:55.223145 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:00:55.223145 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:00:55.223145 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeTgs6u98Kj2qNeUbhNZytTz3QZl3npCYhXvqzJPAHZJSisgyrybjMBWF-fdPl_tWpGYuTI6Puj6PawUImfVDEBxcbmulm9uh4lstHlNST7jgnukdD8WC74LVcFesaNP8PWq7Fzl1J3ZhXvWqEYDTsN6hHueqzcw9I-JZ0vsP9wgdik Oct 08 21:00:55.223145 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:00:55.223145 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:00:55.223145 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:00:55.223145 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:00:55.223145 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:00:55.223145 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:00:55.223145 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: ac791938e6384c8c8473ffd65cf867a8 Oct 08 21:00:55.223145 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-ListServersNegativeTestJSON-1263442127 Oct 08 21:00:55.223145 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:00:55.223145 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:00:55.223145 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ac791938e6384c8c8473ffd65cf867a8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ac791938e6384c8c8473ffd65cf867a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ac791938e6384c8c8473ffd65cf867a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ac791938e6384c8c8473ffd65cf867a8"}]}] Oct 08 21:00:55.223145 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-ListServersNegativeTestJSON-1263442127 Oct 08 21:00:55.223145 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: ac791938e6384c8c8473ffd65cf867a8 Oct 08 21:00:55.223145 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1263442127 Oct 08 21:00:55.223145 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-ListServersNegativeTestJSON-1263442127-project Oct 08 21:00:55.223145 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:00:55.223145 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:00:55.223145 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 463a3aac627c43d7af0dbc9facb52076 Oct 08 21:00:55.223145 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-ListServersNegativeTestJSON-1263442127-project Oct 08 21:00:55.223145 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 21:00:55.223145 ncdv-master-1 devstack@n-api.service[140492]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 08 21:00:55.223145 ncdv-master-1 devstack@n-api.service[140492]: action_args: {} Oct 08 21:00:55.223145 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:00:55.223145 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:00:55.223145 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 08 21:00:55.223145 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 08 21:00:55.223145 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 08 21:00:55.223145 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise error Oct 08 21:00:55.223145 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Oct 08 21:00:55.223145 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:00:55.223145 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Oct 08 21:00:55.223145 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 08 21:00:55.223145 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi 'minimum': 0, Oct 08 21:00:55.223145 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 08 21:00:55.223145 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 08 21:00:55.223145 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:00:55.223145 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 08 21:00:55.223145 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi '-1' Oct 08 21:00:55.223145 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:00:55.223145 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:00:55.223145 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:00:55.223145 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:00:55.223145 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:00:55.223145 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:00:55.223145 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:00:55.223145 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:00:55.223145 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:00:55.223145 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:00:55.223145 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 08 21:00:55.223145 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 21:00:55.223145 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 08 21:00:55.223145 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 21:00:55.223145 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 08 21:00:55.223145 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 21:00:55.223145 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 08 21:00:55.223145 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 08 21:00:55.223145 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 08 21:00:55.227601 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 08 21:00:55.227601 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 08 21:00:55.227601 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 08 21:00:55.227601 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 08 21:00:55.227601 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 08 21:00:55.227601 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:00:55.227601 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:00:55.227601 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:00:55.227601 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:00:55.227601 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:00:55.227601 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:00:55.227601 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 08 21:00:55.227601 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 08 21:00:55.227601 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 08 21:00:55.227601 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:00:55.227601 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-95f57a81-908c-49c4-87ae-fa68dd20d0be tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:00:55.227601 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-95f57a81-908c-49c4-87ae-fa68dd20d0be tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] 10.222.0.26 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.009394 Oct 08 21:00:55.227601 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1168/2302] 10.222.0.26 () {58 vars in 1142 bytes} [Sat Oct 8 21:00:55 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 08 21:00:55.234068 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-dfa9b9e4-d6a5-49e5-9505-f7e93110be93 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:55.237946 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-dfa9b9e4-d6a5-49e5-9505-f7e93110be93 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Request method failure captured: Oct 08 21:00:55.237946 ncdv-master-1 devstack@n-api.service[140491]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Oct 08 21:00:55.237946 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:00:55.237946 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:00:55.237946 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:00:55.237946 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 21:00:55.237946 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:00:55.237946 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:00:55.237946 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:00:55.237946 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:00:55.237946 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeTgs6u98Kj2qNeUbhNZytTz3QZl3npCYhXvqzJPAHZJSisgyrybjMBWF-fdPl_tWpGYuTI6Puj6PawUImfVDEBxcbmulm9uh4lstHlNST7jgnukdD8WC74LVcFesaNP8PWq7Fzl1J3ZhXvWqEYDTsN6hHueqzcw9I-JZ0vsP9wgdik Oct 08 21:00:55.237946 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:00:55.237946 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:00:55.237946 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:00:55.237946 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:00:55.237946 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:00:55.237946 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:00:55.237946 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: ac791938e6384c8c8473ffd65cf867a8 Oct 08 21:00:55.237946 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-ListServersNegativeTestJSON-1263442127 Oct 08 21:00:55.237946 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:00:55.237946 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:00:55.237946 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ac791938e6384c8c8473ffd65cf867a8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ac791938e6384c8c8473ffd65cf867a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ac791938e6384c8c8473ffd65cf867a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ac791938e6384c8c8473ffd65cf867a8"}]}] Oct 08 21:00:55.237946 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-ListServersNegativeTestJSON-1263442127 Oct 08 21:00:55.237946 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: ac791938e6384c8c8473ffd65cf867a8 Oct 08 21:00:55.237946 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1263442127 Oct 08 21:00:55.237946 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-ListServersNegativeTestJSON-1263442127-project Oct 08 21:00:55.237946 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:00:55.237946 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:00:55.237946 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 463a3aac627c43d7af0dbc9facb52076 Oct 08 21:00:55.237946 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-ListServersNegativeTestJSON-1263442127-project Oct 08 21:00:55.237946 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:00:55.237946 ncdv-master-1 devstack@n-api.service[140491]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 08 21:00:55.237946 ncdv-master-1 devstack@n-api.service[140491]: action_args: {} Oct 08 21:00:55.237946 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:00:55.237946 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:00:55.237946 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 08 21:00:55.237946 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 08 21:00:55.237946 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 08 21:00:55.237946 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise error Oct 08 21:00:55.237946 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Oct 08 21:00:55.237946 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:00:55.237946 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Oct 08 21:00:55.237946 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 08 21:00:55.237946 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi 'minimum': 0, Oct 08 21:00:55.237946 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 08 21:00:55.237946 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 08 21:00:55.237946 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:00:55.237946 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 08 21:00:55.237946 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi 'testing' Oct 08 21:00:55.237946 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:00:55.237946 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:00:55.237946 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:00:55.237946 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:00:55.237946 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:00:55.237946 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:00:55.237946 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:00:55.237946 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:00:55.237946 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:00:55.237946 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:00:55.237946 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 08 21:00:55.237946 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 21:00:55.237946 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 08 21:00:55.237946 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 21:00:55.237946 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 08 21:00:55.237946 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 21:00:55.237946 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 08 21:00:55.237946 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 08 21:00:55.237946 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 08 21:00:55.242270 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 08 21:00:55.242270 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 08 21:00:55.242270 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 08 21:00:55.242270 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 08 21:00:55.242270 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 08 21:00:55.242270 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:00:55.242270 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:00:55.242270 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:00:55.242270 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:00:55.242270 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:00:55.242270 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:00:55.242270 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 08 21:00:55.242270 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 08 21:00:55.242270 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 08 21:00:55.242270 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:00:55.242270 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-dfa9b9e4-d6a5-49e5-9505-f7e93110be93 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:00:55.242270 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-dfa9b9e4-d6a5-49e5-9505-f7e93110be93 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] 10.222.0.26 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.009081 Oct 08 21:00:55.242270 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1135/2303] 10.222.0.26 () {58 vars in 1152 bytes} [Sat Oct 8 21:00:55 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 08 21:00:55.249160 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-f24e5a34-2d90-4315-b1bc-f7a3eb266ad8 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:55.254132 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-f24e5a34-2d90-4315-b1bc-f7a3eb266ad8 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '463a3aac627c43d7af0dbc9facb52076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac791938e6384c8c8473ffd65cf867a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:55.254919 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-f24e5a34-2d90-4315-b1bc-f7a3eb266ad8 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': 'ac791938e6384c8c8473ffd65cf867a8'} {{(pid=140492) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 08 21:00:55.264685 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.compute.servers [None req-f24e5a34-2d90-4315-b1bc-f7a3eb266ad8 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Flavor 'non_existing_flavor' could not be found {{(pid=140492) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Oct 08 21:00:55.265730 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-f24e5a34-2d90-4315-b1bc-f7a3eb266ad8 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] 10.222.0.26 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.020661 Oct 08 21:00:55.266278 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1169/2304] 10.222.0.26 () {58 vars in 1178 bytes} [Sat Oct 8 21:00:55 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 08 21:00:55.278019 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-2322bd5c-8277-4cdc-ac8f-497dd4adc0a2 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:55.282783 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-2322bd5c-8277-4cdc-ac8f-497dd4adc0a2 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '463a3aac627c43d7af0dbc9facb52076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac791938e6384c8c8473ffd65cf867a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:55.283449 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-2322bd5c-8277-4cdc-ac8f-497dd4adc0a2 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': 'ac791938e6384c8c8473ffd65cf867a8'} {{(pid=140491) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 08 21:00:55.289413 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2322bd5c-8277-4cdc-ac8f-497dd4adc0a2 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:55.289893 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2322bd5c-8277-4cdc-ac8f-497dd4adc0a2 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:55.290336 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2322bd5c-8277-4cdc-ac8f-497dd4adc0a2 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:55.291060 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2322bd5c-8277-4cdc-ac8f-497dd4adc0a2 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:55.291517 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2322bd5c-8277-4cdc-ac8f-497dd4adc0a2 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:55.291947 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2322bd5c-8277-4cdc-ac8f-497dd4adc0a2 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:55.374284 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-2322bd5c-8277-4cdc-ac8f-497dd4adc0a2 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] 10.222.0.26 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.099849 Oct 08 21:00:55.374873 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1136/2305] 10.222.0.26 () {58 vars in 1174 bytes} [Sat Oct 8 21:00:55 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 08 21:00:55.387803 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-843948f7-2b07-45e7-afa1-71611de5276d tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:55.392853 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-843948f7-2b07-45e7-afa1-71611de5276d tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '463a3aac627c43d7af0dbc9facb52076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac791938e6384c8c8473ffd65cf867a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:55.393557 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-843948f7-2b07-45e7-afa1-71611de5276d tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': 'ac791938e6384c8c8473ffd65cf867a8'} {{(pid=140492) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 08 21:00:55.399073 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-843948f7-2b07-45e7-afa1-71611de5276d tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:55.399568 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-843948f7-2b07-45e7-afa1-71611de5276d tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:55.400017 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-843948f7-2b07-45e7-afa1-71611de5276d tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:55.400760 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-843948f7-2b07-45e7-afa1-71611de5276d tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:55.401243 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-843948f7-2b07-45e7-afa1-71611de5276d tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:55.401712 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-843948f7-2b07-45e7-afa1-71611de5276d tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:55.492266 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-843948f7-2b07-45e7-afa1-71611de5276d tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] 10.222.0.26 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.108853 Oct 08 21:00:55.493128 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1170/2306] 10.222.0.26 () {58 vars in 1184 bytes} [Sat Oct 8 21:00:55 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 08 21:00:55.510545 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-694904f7-05cd-4a6e-8b57-80eb5f0324d2 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:55.516651 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-694904f7-05cd-4a6e-8b57-80eb5f0324d2 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '463a3aac627c43d7af0dbc9facb52076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac791938e6384c8c8473ffd65cf867a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:55.517521 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-694904f7-05cd-4a6e-8b57-80eb5f0324d2 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Searching by: {'deleted': False, 'project_id': 'ac791938e6384c8c8473ffd65cf867a8'} {{(pid=140491) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 08 21:00:55.524728 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-694904f7-05cd-4a6e-8b57-80eb5f0324d2 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:55.525432 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-694904f7-05cd-4a6e-8b57-80eb5f0324d2 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:55.526084 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-694904f7-05cd-4a6e-8b57-80eb5f0324d2 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:55.527080 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-694904f7-05cd-4a6e-8b57-80eb5f0324d2 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:55.527577 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-694904f7-05cd-4a6e-8b57-80eb5f0324d2 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:55.528215 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-694904f7-05cd-4a6e-8b57-80eb5f0324d2 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:55.560302 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.multi_cell_list [None req-694904f7-05cd-4a6e-8b57-80eb5f0324d2 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=140491) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 08 21:00:55.560823 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-01501fde-66b3-4bb6-accf-94d8bff57396 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:55.561495 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-01501fde-66b3-4bb6-accf-94d8bff57396 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] [instance: 579b0f8b-ccae-4c2b-bb48-1da1aaf6a138] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:55.569642 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-01501fde-66b3-4bb6-accf-94d8bff57396 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:55.570401 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-01501fde-66b3-4bb6-accf-94d8bff57396 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:55.571104 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-01501fde-66b3-4bb6-accf-94d8bff57396 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:55.571838 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-01501fde-66b3-4bb6-accf-94d8bff57396 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:55.572356 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-01501fde-66b3-4bb6-accf-94d8bff57396 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:55.572798 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-01501fde-66b3-4bb6-accf-94d8bff57396 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:55.597596 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-694904f7-05cd-4a6e-8b57-80eb5f0324d2 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '463a3aac627c43d7af0dbc9facb52076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac791938e6384c8c8473ffd65cf867a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:55.605845 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-694904f7-05cd-4a6e-8b57-80eb5f0324d2 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:55.606347 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-694904f7-05cd-4a6e-8b57-80eb5f0324d2 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:55.606801 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-694904f7-05cd-4a6e-8b57-80eb5f0324d2 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:55.725675 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-01501fde-66b3-4bb6-accf-94d8bff57396 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1698dee4a2bf4ea19a6ee0c3d5cb5c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b00ee5e7828469f95bd90548d35982a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:55.735241 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-01501fde-66b3-4bb6-accf-94d8bff57396 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] 10.222.0.26 "GET /compute/v2.1/servers/579b0f8b-ccae-4c2b-bb48-1da1aaf6a138" status: 200 len: 1523 microversion: 2.1 time: 0.179808 Oct 08 21:00:55.736445 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1171/2307] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:55 2022] GET /compute/v2.1/servers/579b0f8b-ccae-4c2b-bb48-1da1aaf6a138 => generated 1523 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:00:55.741412 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-60ddd8dc-a78b-41f4-9930-0d38fb9d9307 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:55.742031 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-60ddd8dc-a78b-41f4-9930-0d38fb9d9307 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] [instance: edebb288-3d28-4432-b9fd-d74cfb2de586] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:55.748149 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-60ddd8dc-a78b-41f4-9930-0d38fb9d9307 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:55.748809 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-60ddd8dc-a78b-41f4-9930-0d38fb9d9307 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:55.749295 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-60ddd8dc-a78b-41f4-9930-0d38fb9d9307 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:55.750197 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-60ddd8dc-a78b-41f4-9930-0d38fb9d9307 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:55.750652 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-60ddd8dc-a78b-41f4-9930-0d38fb9d9307 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:55.751087 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-60ddd8dc-a78b-41f4-9930-0d38fb9d9307 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:55.764738 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-60ddd8dc-a78b-41f4-9930-0d38fb9d9307 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] HTTP exception thrown: Instance edebb288-3d28-4432-b9fd-d74cfb2de586 could not be found. Oct 08 21:00:55.766491 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-60ddd8dc-a78b-41f4-9930-0d38fb9d9307 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Request method failure captured: Oct 08 21:00:55.766491 ncdv-master-1 devstack@n-api.service[140492]: request: GET /compute/v2.1/servers/edebb288-3d28-4432-b9fd-d74cfb2de586 HTTP/1.1 Oct 08 21:00:55.766491 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:00:55.766491 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:00:55.766491 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:00:55.766491 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 21:00:55.766491 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:00:55.766491 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:00:55.766491 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:00:55.766491 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:00:55.766491 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeRR295mmmZhL7rSOgfacjSsWQ1Ti3FYd30sypy6B-ALaT7WOeiqaScllnDYtpa4eJ1mjmv4WUyVTLu5zt1pdJiZcKAFWv_GnEIqR6TqCn43v4gEmVWskuydtSKspT0UK00dWYkPU4ZM4UBd8cYd3myAyAfY7HLwKtG1LqfYrCLqzow Oct 08 21:00:55.766491 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:00:55.766491 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:00:55.766491 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:00:55.766491 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:00:55.766491 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:00:55.766491 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:00:55.766491 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 8472b054404c46a99b81aba34d6b9f40 Oct 08 21:00:55.766491 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-ServersOnMultiNodesTest-2078873751 Oct 08 21:00:55.766491 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:00:55.766491 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:00:55.766491 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8472b054404c46a99b81aba34d6b9f40"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8472b054404c46a99b81aba34d6b9f40"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8472b054404c46a99b81aba34d6b9f40"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8472b054404c46a99b81aba34d6b9f40"}]}] Oct 08 21:00:55.766491 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-ServersOnMultiNodesTest-2078873751 Oct 08 21:00:55.766491 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 8472b054404c46a99b81aba34d6b9f40 Oct 08 21:00:55.766491 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-2078873751 Oct 08 21:00:55.766491 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-ServersOnMultiNodesTest-2078873751-project Oct 08 21:00:55.766491 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:00:55.766491 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:00:55.766491 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 67ddc3cd3c374bacbe5bf5e0877380e2 Oct 08 21:00:55.766491 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-ServersOnMultiNodesTest-2078873751-project Oct 08 21:00:55.766491 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 21:00:55.766491 ncdv-master-1 devstack@n-api.service[140492]: exception: Instance edebb288-3d28-4432-b9fd-d74cfb2de586 could not be found. Oct 08 21:00:55.766491 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': 'edebb288-3d28-4432-b9fd-d74cfb2de586'} Oct 08 21:00:55.766491 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:00:55.766491 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:00:55.766491 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:00:55.766491 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:00:55.766491 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:00:55.766491 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:00:55.766491 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:00:55.766491 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:00:55.766491 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:00:55.766491 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:00:55.766491 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance edebb288-3d28-4432-b9fd-d74cfb2de586 could not be found. Oct 08 21:00:55.766491 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:00:55.766491 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:00:55.766491 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:00:55.766491 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:00:55.766491 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:00:55.766491 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:00:55.766491 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:00:55.766491 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:00:55.766491 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:00:55.766491 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:00:55.766491 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:00:55.766491 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:00:55.766491 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:00:55.766491 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:00:55.766491 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:00:55.766491 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:00:55.766491 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance edebb288-3d28-4432-b9fd-d74cfb2de586 could not be found. Oct 08 21:00:55.766491 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:00:55.766491 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:00:55.766491 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:00:55.770184 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:00:55.770184 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:00:55.770184 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:00:55.770184 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:00:55.770184 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:00:55.770184 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance edebb288-3d28-4432-b9fd-d74cfb2de586 could not be found. Oct 08 21:00:55.770184 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:00:55.770184 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-60ddd8dc-a78b-41f4-9930-0d38fb9d9307 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Returning 404 to user: Instance edebb288-3d28-4432-b9fd-d74cfb2de586 could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:00:55.770184 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-60ddd8dc-a78b-41f4-9930-0d38fb9d9307 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] 10.222.0.26 "GET /compute/v2.1/servers/edebb288-3d28-4432-b9fd-d74cfb2de586" status: 404 len: 111 microversion: 2.1 time: 0.030450 Oct 08 21:00:55.770184 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1172/2308] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:55 2022] GET /compute/v2.1/servers/edebb288-3d28-4432-b9fd-d74cfb2de586 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:00:55.777109 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-038f82d9-0648-4094-b27a-683fc706f917 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:55.777880 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-038f82d9-0648-4094-b27a-683fc706f917 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] [instance: 84a8a931-6a18-4ef4-9e3c-63cf4054ea43] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:55.785208 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-038f82d9-0648-4094-b27a-683fc706f917 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:55.785793 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-038f82d9-0648-4094-b27a-683fc706f917 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:55.786371 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-038f82d9-0648-4094-b27a-683fc706f917 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:55.788524 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-038f82d9-0648-4094-b27a-683fc706f917 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:55.793246 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-038f82d9-0648-4094-b27a-683fc706f917 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:55.794198 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-038f82d9-0648-4094-b27a-683fc706f917 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:55.838222 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-038f82d9-0648-4094-b27a-683fc706f917 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:55.838742 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-038f82d9-0648-4094-b27a-683fc706f917 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:55.839817 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-038f82d9-0648-4094-b27a-683fc706f917 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:55.840296 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.objects.instance [None req-038f82d9-0648-4094-b27a-683fc706f917 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lazy-loading 'fault' on Instance uuid 84a8a931-6a18-4ef4-9e3c-63cf4054ea43 {{(pid=140492) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 21:00:55.860557 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-694904f7-05cd-4a6e-8b57-80eb5f0324d2 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] 10.222.0.26 "GET /compute/v2.1/servers/detail" status: 200 len: 3021 microversion: 2.1 time: 0.357695 Oct 08 21:00:55.861548 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1137/2309] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Oct 8 21:00:55 2022] GET /compute/v2.1/servers/detail => generated 3021 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:55.869331 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-9dc48120-0b84-459f-b316-53e94fad8c23 req-5f485cd4-94e4-42ac-9851-24bdfe957513 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edebb288-3d28-4432-b9fd-d74cfb2de586", "name": "network-vif-deleted", "tag": "1f6c228d-41e1-4df4-baee-27c394cbf1f4"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:00:55.883656 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-9dc48120-0b84-459f-b316-53e94fad8c23 req-5f485cd4-94e4-42ac-9851-24bdfe957513 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:55.884320 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-9dc48120-0b84-459f-b316-53e94fad8c23 req-5f485cd4-94e4-42ac-9851-24bdfe957513 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:55.896019 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-9dc48120-0b84-459f-b316-53e94fad8c23 req-5f485cd4-94e4-42ac-9851-24bdfe957513 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:55.904955 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-038f82d9-0648-4094-b27a-683fc706f917 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ddc3cd3c374bacbe5bf5e0877380e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8472b054404c46a99b81aba34d6b9f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:55.914322 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-9dc48120-0b84-459f-b316-53e94fad8c23 req-5f485cd4-94e4-42ac-9851-24bdfe957513 service nova] Creating event network-vif-deleted:1f6c228d-41e1-4df4-baee-27c394cbf1f4 for instance edebb288-3d28-4432-b9fd-d74cfb2de586 on nch2-master-1 Oct 08 21:00:55.920321 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-038f82d9-0648-4094-b27a-683fc706f917 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] 10.222.0.26 "GET /compute/v2.1/servers/84a8a931-6a18-4ef4-9e3c-63cf4054ea43" status: 200 len: 1309 microversion: 2.1 time: 0.144182 Oct 08 21:00:55.920524 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-9dc48120-0b84-459f-b316-53e94fad8c23 req-5f485cd4-94e4-42ac-9851-24bdfe957513 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057585 Oct 08 21:00:55.921235 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1138/2310] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:00:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:00:55.922418 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1173/2311] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:55 2022] GET /compute/v2.1/servers/84a8a931-6a18-4ef4-9e3c-63cf4054ea43 => generated 1309 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:55.933659 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-4e589829-7a0a-4d42-8672-8378cc1860c6 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:55.935047 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-d65dda63-d637-48be-bf84-14865e9981fc tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:55.937306 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-d65dda63-d637-48be-bf84-14865e9981fc tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] [instance: a8b2f857-6c24-45fe-b934-cf92b2d18b7a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:55.953310 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d65dda63-d637-48be-bf84-14865e9981fc tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:55.953815 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d65dda63-d637-48be-bf84-14865e9981fc tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:55.954271 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d65dda63-d637-48be-bf84-14865e9981fc tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:55.955023 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d65dda63-d637-48be-bf84-14865e9981fc tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:55.955486 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d65dda63-d637-48be-bf84-14865e9981fc tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:55.955924 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d65dda63-d637-48be-bf84-14865e9981fc tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:55.958749 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-4e589829-7a0a-4d42-8672-8378cc1860c6 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '463a3aac627c43d7af0dbc9facb52076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac791938e6384c8c8473ffd65cf867a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:55.965570 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-4e589829-7a0a-4d42-8672-8378cc1860c6 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] 10.222.0.26 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.038459 Oct 08 21:00:55.966503 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1174/2312] 10.222.0.26 () {58 vars in 1178 bytes} [Sat Oct 8 21:00:55 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 08 21:00:55.978374 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-0c250eac-b0cf-4637-b66a-59e7181142a8 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:55.979434 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-0c250eac-b0cf-4637-b66a-59e7181142a8 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: 38b000d3-167b-4f7a-ab80-cd51fcb7cbaf] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:55.994693 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0c250eac-b0cf-4637-b66a-59e7181142a8 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:56.000396 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0c250eac-b0cf-4637-b66a-59e7181142a8 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:56.000988 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0c250eac-b0cf-4637-b66a-59e7181142a8 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:56.001974 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0c250eac-b0cf-4637-b66a-59e7181142a8 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:56.002556 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0c250eac-b0cf-4637-b66a-59e7181142a8 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:56.003957 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0c250eac-b0cf-4637-b66a-59e7181142a8 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:56.278573 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-0c250eac-b0cf-4637-b66a-59e7181142a8 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:56.287807 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-0c250eac-b0cf-4637-b66a-59e7181142a8 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/38b000d3-167b-4f7a-ab80-cd51fcb7cbaf" status: 200 len: 1312 microversion: 2.1 time: 0.320007 Oct 08 21:00:56.288998 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1175/2313] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:55 2022] GET /compute/v2.1/servers/38b000d3-167b-4f7a-ab80-cd51fcb7cbaf => generated 1312 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:56.292531 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-d65dda63-d637-48be-bf84-14865e9981fc tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06caf10b6fa43a3a2ad34858594e329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b10172715d423eb887d6c5b171defb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:56.294509 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-71d469c5-8997-43cb-9f8d-d694a5e6c4db tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:56.299413 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-71d469c5-8997-43cb-9f8d-d694a5e6c4db tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '463a3aac627c43d7af0dbc9facb52076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac791938e6384c8c8473ffd65cf867a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:56.300632 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-71d469c5-8997-43cb-9f8d-d694a5e6c4db tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Searching by: {'deleted': False, 'project_id': 'ac791938e6384c8c8473ffd65cf867a8'} {{(pid=140492) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 08 21:00:56.303588 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-d65dda63-d637-48be-bf84-14865e9981fc tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] 10.222.0.26 "GET /compute/v2.1/servers/a8b2f857-6c24-45fe-b934-cf92b2d18b7a" status: 200 len: 1527 microversion: 2.1 time: 0.380934 Oct 08 21:00:56.304185 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1139/2314] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:55 2022] GET /compute/v2.1/servers/a8b2f857-6c24-45fe-b934-cf92b2d18b7a => generated 1527 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:56.316891 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-71d469c5-8997-43cb-9f8d-d694a5e6c4db tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:56.317606 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-71d469c5-8997-43cb-9f8d-d694a5e6c4db tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:56.318216 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-71d469c5-8997-43cb-9f8d-d694a5e6c4db tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:56.319130 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-71d469c5-8997-43cb-9f8d-d694a5e6c4db tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:56.319780 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-71d469c5-8997-43cb-9f8d-d694a5e6c4db tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:56.320377 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-71d469c5-8997-43cb-9f8d-d694a5e6c4db tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:56.325852 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-19440b51-75a6-4fc6-9f87-b871fc91fc6e tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:56.331030 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-19440b51-75a6-4fc6-9f87-b871fc91fc6e tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] [instance: 9ed82ee0-e56e-478e-a066-bad43e760a03] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:56.351214 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-19440b51-75a6-4fc6-9f87-b871fc91fc6e tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:56.351409 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-19440b51-75a6-4fc6-9f87-b871fc91fc6e tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:56.353267 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-19440b51-75a6-4fc6-9f87-b871fc91fc6e tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:56.355479 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-19440b51-75a6-4fc6-9f87-b871fc91fc6e tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:56.355994 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-19440b51-75a6-4fc6-9f87-b871fc91fc6e tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:56.356441 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-19440b51-75a6-4fc6-9f87-b871fc91fc6e tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:56.362724 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.multi_cell_list [None req-71d469c5-8997-43cb-9f8d-d694a5e6c4db tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=140492) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 08 21:00:56.398952 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-71d469c5-8997-43cb-9f8d-d694a5e6c4db tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] 10.222.0.26 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.108610 Oct 08 21:00:56.399865 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1176/2315] 10.222.0.26 () {58 vars in 1125 bytes} [Sat Oct 8 21:00:56 2022] GET /compute/v2.1/servers => generated 681 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:00:56.414171 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-98a867fc-1c78-4c6c-97cb-3f257c88638e tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:56.414681 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-98a867fc-1c78-4c6c-97cb-3f257c88638e tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] [instance: d02ba7e0-a550-4e8e-a3ab-37ed519e22b0] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:56.422009 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-98a867fc-1c78-4c6c-97cb-3f257c88638e tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:56.422514 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-98a867fc-1c78-4c6c-97cb-3f257c88638e tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:56.423129 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-98a867fc-1c78-4c6c-97cb-3f257c88638e tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:56.423682 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-98a867fc-1c78-4c6c-97cb-3f257c88638e tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:56.424379 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-98a867fc-1c78-4c6c-97cb-3f257c88638e tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:56.424597 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-98a867fc-1c78-4c6c-97cb-3f257c88638e tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:56.443618 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-98a867fc-1c78-4c6c-97cb-3f257c88638e tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] HTTP exception thrown: Instance d02ba7e0-a550-4e8e-a3ab-37ed519e22b0 could not be found. Oct 08 21:00:56.445458 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-98a867fc-1c78-4c6c-97cb-3f257c88638e tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Request method failure captured: Oct 08 21:00:56.445458 ncdv-master-1 devstack@n-api.service[140492]: request: DELETE /compute/v2.1/servers/d02ba7e0-a550-4e8e-a3ab-37ed519e22b0 HTTP/1.1 Oct 08 21:00:56.445458 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:00:56.445458 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:00:56.445458 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:00:56.445458 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 21:00:56.445458 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:00:56.445458 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:00:56.445458 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:00:56.445458 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:00:56.445458 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeTgs6u98Kj2qNeUbhNZytTz3QZl3npCYhXvqzJPAHZJSisgyrybjMBWF-fdPl_tWpGYuTI6Puj6PawUImfVDEBxcbmulm9uh4lstHlNST7jgnukdD8WC74LVcFesaNP8PWq7Fzl1J3ZhXvWqEYDTsN6hHueqzcw9I-JZ0vsP9wgdik Oct 08 21:00:56.445458 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:00:56.445458 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:00:56.445458 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:00:56.445458 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:00:56.445458 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:00:56.445458 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:00:56.445458 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: ac791938e6384c8c8473ffd65cf867a8 Oct 08 21:00:56.445458 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-ListServersNegativeTestJSON-1263442127 Oct 08 21:00:56.445458 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:00:56.445458 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:00:56.445458 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ac791938e6384c8c8473ffd65cf867a8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ac791938e6384c8c8473ffd65cf867a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ac791938e6384c8c8473ffd65cf867a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ac791938e6384c8c8473ffd65cf867a8"}]}] Oct 08 21:00:56.445458 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-ListServersNegativeTestJSON-1263442127 Oct 08 21:00:56.445458 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: ac791938e6384c8c8473ffd65cf867a8 Oct 08 21:00:56.445458 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1263442127 Oct 08 21:00:56.445458 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-ListServersNegativeTestJSON-1263442127-project Oct 08 21:00:56.445458 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:00:56.445458 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:00:56.445458 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 463a3aac627c43d7af0dbc9facb52076 Oct 08 21:00:56.445458 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-ListServersNegativeTestJSON-1263442127-project Oct 08 21:00:56.445458 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 21:00:56.445458 ncdv-master-1 devstack@n-api.service[140492]: exception: Instance d02ba7e0-a550-4e8e-a3ab-37ed519e22b0 could not be found. Oct 08 21:00:56.445458 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': 'd02ba7e0-a550-4e8e-a3ab-37ed519e22b0'} Oct 08 21:00:56.445458 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:00:56.445458 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:00:56.445458 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:00:56.445458 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:00:56.445458 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:00:56.445458 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:00:56.445458 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:00:56.445458 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:00:56.445458 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:00:56.445458 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:00:56.445458 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d02ba7e0-a550-4e8e-a3ab-37ed519e22b0 could not be found. Oct 08 21:00:56.445458 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:00:56.445458 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:00:56.445458 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:00:56.445458 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:00:56.445458 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:00:56.445458 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:00:56.445458 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:00:56.445458 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:00:56.445458 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:00:56.445458 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:00:56.445458 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 08 21:00:56.445458 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 08 21:00:56.445458 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 08 21:00:56.445458 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 08 21:00:56.445458 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:00:56.445458 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:00:56.445458 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:00:56.445458 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:00:56.449593 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d02ba7e0-a550-4e8e-a3ab-37ed519e22b0 could not be found. Oct 08 21:00:56.449593 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:00:56.449593 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:00:56.449593 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:00:56.449593 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:00:56.449593 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:00:56.449593 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:00:56.449593 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:00:56.449593 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:00:56.449593 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d02ba7e0-a550-4e8e-a3ab-37ed519e22b0 could not be found. Oct 08 21:00:56.449593 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:00:56.449593 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-98a867fc-1c78-4c6c-97cb-3f257c88638e tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Returning 404 to user: Instance d02ba7e0-a550-4e8e-a3ab-37ed519e22b0 could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:00:56.449593 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-98a867fc-1c78-4c6c-97cb-3f257c88638e tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] 10.222.0.26 "DELETE /compute/v2.1/servers/d02ba7e0-a550-4e8e-a3ab-37ed519e22b0" status: 404 len: 111 microversion: 2.1 time: 0.038360 Oct 08 21:00:56.449593 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1177/2316] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:00:56 2022] DELETE /compute/v2.1/servers/d02ba7e0-a550-4e8e-a3ab-37ed519e22b0 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 08 21:00:56.456446 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-3bcd7c12-bfd2-4b0d-8ba4-4feb82649c15 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:56.456954 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-3bcd7c12-bfd2-4b0d-8ba4-4feb82649c15 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] [instance: 4832d86f-ddee-445e-8b26-fae015d901a4] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:56.462886 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=4 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:00:56.465262 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3bcd7c12-bfd2-4b0d-8ba4-4feb82649c15 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:56.466086 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3bcd7c12-bfd2-4b0d-8ba4-4feb82649c15 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:56.466711 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3bcd7c12-bfd2-4b0d-8ba4-4feb82649c15 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:56.467069 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-19440b51-75a6-4fc6-9f87-b871fc91fc6e tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c7aebdf00342b1ba80833663f8c0a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad3679a59b504731b5f56e52788fd645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:56.467914 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3bcd7c12-bfd2-4b0d-8ba4-4feb82649c15 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:56.469125 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3bcd7c12-bfd2-4b0d-8ba4-4feb82649c15 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:56.469602 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3bcd7c12-bfd2-4b0d-8ba4-4feb82649c15 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:56.488030 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-19440b51-75a6-4fc6-9f87-b871fc91fc6e tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] 10.222.0.26 "GET /compute/v2.1/servers/9ed82ee0-e56e-478e-a066-bad43e760a03" status: 200 len: 1284 microversion: 2.1 time: 0.182623 Oct 08 21:00:56.489607 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1140/2317] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:56 2022] GET /compute/v2.1/servers/9ed82ee0-e56e-478e-a066-bad43e760a03 => generated 1284 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:56.509966 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-3bcd7c12-bfd2-4b0d-8ba4-4feb82649c15 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] [instance: 4832d86f-ddee-445e-8b26-fae015d901a4] Going to try to terminate instance {{(pid=140492) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 21:00:56.630316 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-3bcd7c12-bfd2-4b0d-8ba4-4feb82649c15 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] 10.222.0.26 "DELETE /compute/v2.1/servers/4832d86f-ddee-445e-8b26-fae015d901a4" status: 204 len: 0 microversion: 2.1 time: 0.177290 Oct 08 21:00:56.631314 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1178/2318] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:00:56 2022] DELETE /compute/v2.1/servers/4832d86f-ddee-445e-8b26-fae015d901a4 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 21:00:56.641082 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-dc0ab9d9-7985-4791-b159-d9cf10177c3a tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:56.641842 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-dc0ab9d9-7985-4791-b159-d9cf10177c3a tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] [instance: 3622a27e-b943-49a7-8d81-a6f553c32f7a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:56.647224 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-bc767eb6-8b06-4b6d-b425-be6108ca02af req-6e99a256-c526-491d-a9eb-34f151968699 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8b2f857-6c24-45fe-b934-cf92b2d18b7a", "name": "network-vif-deleted", "tag": "d02c5c7d-36e9-42cf-a666-f4a9ae2674ec"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:00:56.655864 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dc0ab9d9-7985-4791-b159-d9cf10177c3a tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:56.656576 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dc0ab9d9-7985-4791-b159-d9cf10177c3a tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:56.657129 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dc0ab9d9-7985-4791-b159-d9cf10177c3a tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:56.658487 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-bc767eb6-8b06-4b6d-b425-be6108ca02af req-6e99a256-c526-491d-a9eb-34f151968699 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:56.658812 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dc0ab9d9-7985-4791-b159-d9cf10177c3a tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:56.658989 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-bc767eb6-8b06-4b6d-b425-be6108ca02af req-6e99a256-c526-491d-a9eb-34f151968699 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:56.659438 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-bc767eb6-8b06-4b6d-b425-be6108ca02af req-6e99a256-c526-491d-a9eb-34f151968699 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:56.659552 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dc0ab9d9-7985-4791-b159-d9cf10177c3a tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:56.660046 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dc0ab9d9-7985-4791-b159-d9cf10177c3a tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:56.675701 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-bc767eb6-8b06-4b6d-b425-be6108ca02af req-6e99a256-c526-491d-a9eb-34f151968699 service nova] Creating event network-vif-deleted:d02c5c7d-36e9-42cf-a666-f4a9ae2674ec for instance a8b2f857-6c24-45fe-b934-cf92b2d18b7a on nch2-master-1 Oct 08 21:00:56.682063 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-bc767eb6-8b06-4b6d-b425-be6108ca02af req-6e99a256-c526-491d-a9eb-34f151968699 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039285 Oct 08 21:00:56.683988 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1179/2319] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:00:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:00:56.699974 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-dc0ab9d9-7985-4791-b159-d9cf10177c3a tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] [instance: 3622a27e-b943-49a7-8d81-a6f553c32f7a] Going to try to terminate instance {{(pid=140491) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 21:00:56.760266 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-d0cd6532-21ac-4488-9e97-b75ef6d6b82b tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:56.761588 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-d0cd6532-21ac-4488-9e97-b75ef6d6b82b tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] [instance: 579b0f8b-ccae-4c2b-bb48-1da1aaf6a138] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:56.771817 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d0cd6532-21ac-4488-9e97-b75ef6d6b82b tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:56.775859 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d0cd6532-21ac-4488-9e97-b75ef6d6b82b tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:56.776421 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d0cd6532-21ac-4488-9e97-b75ef6d6b82b tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:56.777871 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d0cd6532-21ac-4488-9e97-b75ef6d6b82b tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:56.778514 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d0cd6532-21ac-4488-9e97-b75ef6d6b82b tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:56.779087 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d0cd6532-21ac-4488-9e97-b75ef6d6b82b tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:56.844689 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-dc0ab9d9-7985-4791-b159-d9cf10177c3a tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] 10.222.0.26 "DELETE /compute/v2.1/servers/3622a27e-b943-49a7-8d81-a6f553c32f7a" status: 204 len: 0 microversion: 2.1 time: 0.208940 Oct 08 21:00:56.851143 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1141/2320] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:00:56 2022] DELETE /compute/v2.1/servers/3622a27e-b943-49a7-8d81-a6f553c32f7a => generated 0 bytes in 213 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 21:00:56.870142 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-08a2d3d3-f5f5-420d-9132-4e9c1f8b5332 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:56.871111 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-08a2d3d3-f5f5-420d-9132-4e9c1f8b5332 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] [instance: d02ba7e0-a550-4e8e-a3ab-37ed519e22b0] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:56.878083 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-08a2d3d3-f5f5-420d-9132-4e9c1f8b5332 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:56.878762 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-08a2d3d3-f5f5-420d-9132-4e9c1f8b5332 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:56.879322 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-08a2d3d3-f5f5-420d-9132-4e9c1f8b5332 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:56.880158 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-08a2d3d3-f5f5-420d-9132-4e9c1f8b5332 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:56.880742 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-08a2d3d3-f5f5-420d-9132-4e9c1f8b5332 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:56.881424 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-08a2d3d3-f5f5-420d-9132-4e9c1f8b5332 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:56.899312 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-08a2d3d3-f5f5-420d-9132-4e9c1f8b5332 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] HTTP exception thrown: Instance d02ba7e0-a550-4e8e-a3ab-37ed519e22b0 could not be found. Oct 08 21:00:56.901329 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-08a2d3d3-f5f5-420d-9132-4e9c1f8b5332 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Request method failure captured: Oct 08 21:00:56.901329 ncdv-master-1 devstack@n-api.service[140491]: request: GET /compute/v2.1/servers/d02ba7e0-a550-4e8e-a3ab-37ed519e22b0 HTTP/1.1 Oct 08 21:00:56.901329 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:00:56.901329 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:00:56.901329 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:00:56.901329 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 21:00:56.901329 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:00:56.901329 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:00:56.901329 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:00:56.901329 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:00:56.901329 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeTgs6u98Kj2qNeUbhNZytTz3QZl3npCYhXvqzJPAHZJSisgyrybjMBWF-fdPl_tWpGYuTI6Puj6PawUImfVDEBxcbmulm9uh4lstHlNST7jgnukdD8WC74LVcFesaNP8PWq7Fzl1J3ZhXvWqEYDTsN6hHueqzcw9I-JZ0vsP9wgdik Oct 08 21:00:56.901329 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:00:56.901329 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:00:56.901329 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:00:56.901329 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:00:56.901329 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:00:56.901329 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:00:56.901329 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: ac791938e6384c8c8473ffd65cf867a8 Oct 08 21:00:56.901329 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-ListServersNegativeTestJSON-1263442127 Oct 08 21:00:56.901329 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:00:56.901329 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:00:56.901329 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ac791938e6384c8c8473ffd65cf867a8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ac791938e6384c8c8473ffd65cf867a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ac791938e6384c8c8473ffd65cf867a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ac791938e6384c8c8473ffd65cf867a8"}]}] Oct 08 21:00:56.901329 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-ListServersNegativeTestJSON-1263442127 Oct 08 21:00:56.901329 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: ac791938e6384c8c8473ffd65cf867a8 Oct 08 21:00:56.901329 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1263442127 Oct 08 21:00:56.901329 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-ListServersNegativeTestJSON-1263442127-project Oct 08 21:00:56.901329 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:00:56.901329 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:00:56.901329 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 463a3aac627c43d7af0dbc9facb52076 Oct 08 21:00:56.901329 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-ListServersNegativeTestJSON-1263442127-project Oct 08 21:00:56.901329 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:00:56.901329 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance d02ba7e0-a550-4e8e-a3ab-37ed519e22b0 could not be found. Oct 08 21:00:56.901329 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': 'd02ba7e0-a550-4e8e-a3ab-37ed519e22b0'} Oct 08 21:00:56.901329 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:00:56.901329 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:00:56.901329 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:00:56.901329 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:00:56.901329 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:00:56.901329 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:00:56.901329 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:00:56.901329 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:00:56.901329 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:00:56.901329 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:00:56.901329 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d02ba7e0-a550-4e8e-a3ab-37ed519e22b0 could not be found. Oct 08 21:00:56.901329 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:00:56.901329 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:00:56.901329 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:00:56.901329 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:00:56.901329 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:00:56.901329 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:00:56.901329 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:00:56.901329 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:00:56.901329 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:00:56.901329 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:00:56.901329 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:00:56.901329 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:00:56.901329 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:00:56.901329 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:00:56.901329 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:00:56.901329 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:00:56.901329 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d02ba7e0-a550-4e8e-a3ab-37ed519e22b0 could not be found. Oct 08 21:00:56.901329 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:00:56.901329 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:00:56.905500 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:00:56.905500 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:00:56.905500 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:00:56.905500 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:00:56.905500 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:00:56.905500 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:00:56.905500 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d02ba7e0-a550-4e8e-a3ab-37ed519e22b0 could not be found. Oct 08 21:00:56.905500 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:00:56.908662 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-08a2d3d3-f5f5-420d-9132-4e9c1f8b5332 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Returning 404 to user: Instance d02ba7e0-a550-4e8e-a3ab-37ed519e22b0 could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:00:56.910139 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-08a2d3d3-f5f5-420d-9132-4e9c1f8b5332 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] 10.222.0.26 "GET /compute/v2.1/servers/d02ba7e0-a550-4e8e-a3ab-37ed519e22b0" status: 404 len: 111 microversion: 2.1 time: 0.056767 Oct 08 21:00:56.910968 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1142/2321] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:56 2022] GET /compute/v2.1/servers/d02ba7e0-a550-4e8e-a3ab-37ed519e22b0 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:00:56.921081 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-e44f54e9-5c0b-4b2a-83b1-b6ddbb2be046 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:56.922702 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-e44f54e9-5c0b-4b2a-83b1-b6ddbb2be046 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] [instance: 4832d86f-ddee-445e-8b26-fae015d901a4] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:56.930832 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e44f54e9-5c0b-4b2a-83b1-b6ddbb2be046 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:56.931693 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e44f54e9-5c0b-4b2a-83b1-b6ddbb2be046 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:56.932367 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e44f54e9-5c0b-4b2a-83b1-b6ddbb2be046 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:56.933408 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e44f54e9-5c0b-4b2a-83b1-b6ddbb2be046 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:56.934092 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e44f54e9-5c0b-4b2a-83b1-b6ddbb2be046 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:56.934760 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e44f54e9-5c0b-4b2a-83b1-b6ddbb2be046 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:56.954606 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-d0cd6532-21ac-4488-9e97-b75ef6d6b82b tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1698dee4a2bf4ea19a6ee0c3d5cb5c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b00ee5e7828469f95bd90548d35982a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:56.962802 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-d0cd6532-21ac-4488-9e97-b75ef6d6b82b tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] 10.222.0.26 "GET /compute/v2.1/servers/579b0f8b-ccae-4c2b-bb48-1da1aaf6a138" status: 200 len: 1523 microversion: 2.1 time: 0.207088 Oct 08 21:00:56.963396 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1180/2322] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:56 2022] GET /compute/v2.1/servers/579b0f8b-ccae-4c2b-bb48-1da1aaf6a138 => generated 1523 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:00:56.977142 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-d7c50a5a-0d97-49fb-9a5a-1044877a078e tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:56.977939 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-d7c50a5a-0d97-49fb-9a5a-1044877a078e tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] [instance: 84a8a931-6a18-4ef4-9e3c-63cf4054ea43] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:56.985517 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d7c50a5a-0d97-49fb-9a5a-1044877a078e tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:56.986286 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d7c50a5a-0d97-49fb-9a5a-1044877a078e tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:56.986893 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d7c50a5a-0d97-49fb-9a5a-1044877a078e tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:56.987900 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d7c50a5a-0d97-49fb-9a5a-1044877a078e tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:56.988562 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d7c50a5a-0d97-49fb-9a5a-1044877a078e tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:56.989156 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d7c50a5a-0d97-49fb-9a5a-1044877a078e tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:57.015359 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:00:57.029245 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d7c50a5a-0d97-49fb-9a5a-1044877a078e tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:57.030046 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d7c50a5a-0d97-49fb-9a5a-1044877a078e tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:57.030644 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d7c50a5a-0d97-49fb-9a5a-1044877a078e tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:57.031388 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.objects.instance [None req-d7c50a5a-0d97-49fb-9a5a-1044877a078e tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lazy-loading 'fault' on Instance uuid 84a8a931-6a18-4ef4-9e3c-63cf4054ea43 {{(pid=140492) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 21:00:57.080066 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-d7c50a5a-0d97-49fb-9a5a-1044877a078e tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ddc3cd3c374bacbe5bf5e0877380e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8472b054404c46a99b81aba34d6b9f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:57.087747 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-d7c50a5a-0d97-49fb-9a5a-1044877a078e tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] 10.222.0.26 "GET /compute/v2.1/servers/84a8a931-6a18-4ef4-9e3c-63cf4054ea43" status: 200 len: 1309 microversion: 2.1 time: 0.123228 Oct 08 21:00:57.088850 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1181/2323] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:56 2022] GET /compute/v2.1/servers/84a8a931-6a18-4ef4-9e3c-63cf4054ea43 => generated 1309 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:57.232035 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-e44f54e9-5c0b-4b2a-83b1-b6ddbb2be046 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '463a3aac627c43d7af0dbc9facb52076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac791938e6384c8c8473ffd65cf867a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:57.240201 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-e44f54e9-5c0b-4b2a-83b1-b6ddbb2be046 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] 10.222.0.26 "GET /compute/v2.1/servers/4832d86f-ddee-445e-8b26-fae015d901a4" status: 200 len: 1520 microversion: 2.1 time: 0.324728 Oct 08 21:00:57.240819 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1143/2324] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:56 2022] GET /compute/v2.1/servers/4832d86f-ddee-445e-8b26-fae015d901a4 => generated 1520 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:57.311620 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-7c3e5f42-e2da-4ca7-a335-677de6faa03b tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:57.312353 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-7c3e5f42-e2da-4ca7-a335-677de6faa03b tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: 38b000d3-167b-4f7a-ab80-cd51fcb7cbaf] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:57.318489 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7c3e5f42-e2da-4ca7-a335-677de6faa03b tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:57.318992 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7c3e5f42-e2da-4ca7-a335-677de6faa03b tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:57.319438 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7c3e5f42-e2da-4ca7-a335-677de6faa03b tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:57.320155 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7c3e5f42-e2da-4ca7-a335-677de6faa03b tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:57.320622 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7c3e5f42-e2da-4ca7-a335-677de6faa03b tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:57.321085 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7c3e5f42-e2da-4ca7-a335-677de6faa03b tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:57.333049 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-365f5c60-7294-4990-a48e-ce1edc1150f2 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:57.333800 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-365f5c60-7294-4990-a48e-ce1edc1150f2 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] [instance: a8b2f857-6c24-45fe-b934-cf92b2d18b7a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:57.345982 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-365f5c60-7294-4990-a48e-ce1edc1150f2 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:57.346865 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-365f5c60-7294-4990-a48e-ce1edc1150f2 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:57.347542 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-365f5c60-7294-4990-a48e-ce1edc1150f2 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:57.348963 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-365f5c60-7294-4990-a48e-ce1edc1150f2 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:57.349756 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-365f5c60-7294-4990-a48e-ce1edc1150f2 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:57.350372 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-365f5c60-7294-4990-a48e-ce1edc1150f2 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:57.458218 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-365f5c60-7294-4990-a48e-ce1edc1150f2 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06caf10b6fa43a3a2ad34858594e329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b10172715d423eb887d6c5b171defb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:57.466213 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-365f5c60-7294-4990-a48e-ce1edc1150f2 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] 10.222.0.26 "GET /compute/v2.1/servers/a8b2f857-6c24-45fe-b934-cf92b2d18b7a" status: 200 len: 1485 microversion: 2.1 time: 0.137776 Oct 08 21:00:57.466995 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1144/2325] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:57 2022] GET /compute/v2.1/servers/a8b2f857-6c24-45fe-b934-cf92b2d18b7a => generated 1485 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:57.471337 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-7c3e5f42-e2da-4ca7-a335-677de6faa03b tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:57.488250 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-7c3e5f42-e2da-4ca7-a335-677de6faa03b tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/38b000d3-167b-4f7a-ab80-cd51fcb7cbaf" status: 200 len: 1312 microversion: 2.1 time: 0.181031 Oct 08 21:00:57.497238 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1182/2326] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:57 2022] GET /compute/v2.1/servers/38b000d3-167b-4f7a-ab80-cd51fcb7cbaf => generated 1312 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:57.514858 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-70bed8f7-e1f9-4643-bbec-4225c3fb8570 tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:57.515477 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-70bed8f7-e1f9-4643-bbec-4225c3fb8570 tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] [instance: 9ed82ee0-e56e-478e-a066-bad43e760a03] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:57.521619 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-70bed8f7-e1f9-4643-bbec-4225c3fb8570 tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:57.522119 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-70bed8f7-e1f9-4643-bbec-4225c3fb8570 tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:57.522563 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-70bed8f7-e1f9-4643-bbec-4225c3fb8570 tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:57.523271 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-70bed8f7-e1f9-4643-bbec-4225c3fb8570 tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:57.523736 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-70bed8f7-e1f9-4643-bbec-4225c3fb8570 tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:57.524171 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-70bed8f7-e1f9-4643-bbec-4225c3fb8570 tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:57.946235 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-70bed8f7-e1f9-4643-bbec-4225c3fb8570 tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c7aebdf00342b1ba80833663f8c0a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad3679a59b504731b5f56e52788fd645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:57.954171 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-70bed8f7-e1f9-4643-bbec-4225c3fb8570 tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] 10.222.0.26 "GET /compute/v2.1/servers/9ed82ee0-e56e-478e-a066-bad43e760a03" status: 200 len: 1351 microversion: 2.1 time: 0.443680 Oct 08 21:00:57.954760 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1145/2327] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:57 2022] GET /compute/v2.1/servers/9ed82ee0-e56e-478e-a066-bad43e760a03 => generated 1351 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:57.989254 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-cc9d8e5b-f0f5-421e-8e8c-13a5708979f4 req-8cf52705-b3dc-4c22-b9f2-2f5c9539ad9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ed82ee0-e56e-478e-a066-bad43e760a03", "tag": "2d6b498c-db99-42bb-a03a-e6ad5fc72076"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:00:57.999865 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-cc9d8e5b-f0f5-421e-8e8c-13a5708979f4 req-8cf52705-b3dc-4c22-b9f2-2f5c9539ad9f service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:58.000544 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-cc9d8e5b-f0f5-421e-8e8c-13a5708979f4 req-8cf52705-b3dc-4c22-b9f2-2f5c9539ad9f service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:58.000741 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-1fba68c2-f6e9-4aed-a023-4b91d5df57a5 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:58.000995 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-cc9d8e5b-f0f5-421e-8e8c-13a5708979f4 req-8cf52705-b3dc-4c22-b9f2-2f5c9539ad9f service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:58.001358 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-1fba68c2-f6e9-4aed-a023-4b91d5df57a5 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] [instance: 579b0f8b-ccae-4c2b-bb48-1da1aaf6a138] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:58.004425 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:00:58.008262 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1fba68c2-f6e9-4aed-a023-4b91d5df57a5 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:58.008754 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1fba68c2-f6e9-4aed-a023-4b91d5df57a5 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:58.009577 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1fba68c2-f6e9-4aed-a023-4b91d5df57a5 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:58.010474 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1fba68c2-f6e9-4aed-a023-4b91d5df57a5 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:58.011104 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1fba68c2-f6e9-4aed-a023-4b91d5df57a5 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:58.011690 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1fba68c2-f6e9-4aed-a023-4b91d5df57a5 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:58.013222 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-cc9d8e5b-f0f5-421e-8e8c-13a5708979f4 req-8cf52705-b3dc-4c22-b9f2-2f5c9539ad9f service nova] Creating event network-changed:2d6b498c-db99-42bb-a03a-e6ad5fc72076 for instance 9ed82ee0-e56e-478e-a066-bad43e760a03 on nch1-master-1 Oct 08 21:00:58.018183 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-cc9d8e5b-f0f5-421e-8e8c-13a5708979f4 req-8cf52705-b3dc-4c22-b9f2-2f5c9539ad9f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032702 Oct 08 21:00:58.018809 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1183/2328] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:00:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 08 21:00:58.112477 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-c225285b-5213-4c54-9c02-b0e96cf69aad tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:58.113180 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-c225285b-5213-4c54-9c02-b0e96cf69aad tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] [instance: 84a8a931-6a18-4ef4-9e3c-63cf4054ea43] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:58.119486 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c225285b-5213-4c54-9c02-b0e96cf69aad tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:58.120005 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c225285b-5213-4c54-9c02-b0e96cf69aad tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:58.120475 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c225285b-5213-4c54-9c02-b0e96cf69aad tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:58.121176 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c225285b-5213-4c54-9c02-b0e96cf69aad tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:58.121660 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c225285b-5213-4c54-9c02-b0e96cf69aad tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:58.122090 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c225285b-5213-4c54-9c02-b0e96cf69aad tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:58.135474 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-c225285b-5213-4c54-9c02-b0e96cf69aad tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] HTTP exception thrown: Instance 84a8a931-6a18-4ef4-9e3c-63cf4054ea43 could not be found. Oct 08 21:00:58.137148 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-c225285b-5213-4c54-9c02-b0e96cf69aad tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Request method failure captured: Oct 08 21:00:58.137148 ncdv-master-1 devstack@n-api.service[140492]: request: GET /compute/v2.1/servers/84a8a931-6a18-4ef4-9e3c-63cf4054ea43 HTTP/1.1 Oct 08 21:00:58.137148 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:00:58.137148 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:00:58.137148 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:00:58.137148 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 21:00:58.137148 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:00:58.137148 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:00:58.137148 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:00:58.137148 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:00:58.137148 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeRR295mmmZhL7rSOgfacjSsWQ1Ti3FYd30sypy6B-ALaT7WOeiqaScllnDYtpa4eJ1mjmv4WUyVTLu5zt1pdJiZcKAFWv_GnEIqR6TqCn43v4gEmVWskuydtSKspT0UK00dWYkPU4ZM4UBd8cYd3myAyAfY7HLwKtG1LqfYrCLqzow Oct 08 21:00:58.137148 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:00:58.137148 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:00:58.137148 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:00:58.137148 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:00:58.137148 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:00:58.137148 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:00:58.137148 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 8472b054404c46a99b81aba34d6b9f40 Oct 08 21:00:58.137148 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-ServersOnMultiNodesTest-2078873751 Oct 08 21:00:58.137148 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:00:58.137148 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:00:58.137148 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8472b054404c46a99b81aba34d6b9f40"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8472b054404c46a99b81aba34d6b9f40"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8472b054404c46a99b81aba34d6b9f40"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8472b054404c46a99b81aba34d6b9f40"}]}] Oct 08 21:00:58.137148 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-ServersOnMultiNodesTest-2078873751 Oct 08 21:00:58.137148 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 8472b054404c46a99b81aba34d6b9f40 Oct 08 21:00:58.137148 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-2078873751 Oct 08 21:00:58.137148 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-ServersOnMultiNodesTest-2078873751-project Oct 08 21:00:58.137148 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:00:58.137148 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:00:58.137148 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 67ddc3cd3c374bacbe5bf5e0877380e2 Oct 08 21:00:58.137148 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-ServersOnMultiNodesTest-2078873751-project Oct 08 21:00:58.137148 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 21:00:58.137148 ncdv-master-1 devstack@n-api.service[140492]: exception: Instance 84a8a931-6a18-4ef4-9e3c-63cf4054ea43 could not be found. Oct 08 21:00:58.137148 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': '84a8a931-6a18-4ef4-9e3c-63cf4054ea43'} Oct 08 21:00:58.137148 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:00:58.137148 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:00:58.137148 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:00:58.137148 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:00:58.137148 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:00:58.137148 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:00:58.137148 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:00:58.137148 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:00:58.137148 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:00:58.137148 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:00:58.137148 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84a8a931-6a18-4ef4-9e3c-63cf4054ea43 could not be found. Oct 08 21:00:58.137148 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:00:58.137148 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:00:58.137148 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:00:58.137148 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:00:58.137148 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:00:58.137148 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:00:58.137148 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:00:58.137148 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:00:58.137148 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:00:58.137148 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:00:58.137148 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:00:58.137148 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:00:58.137148 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:00:58.137148 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:00:58.137148 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:00:58.137148 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:00:58.137148 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84a8a931-6a18-4ef4-9e3c-63cf4054ea43 could not be found. Oct 08 21:00:58.137148 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:00:58.137148 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:00:58.137148 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:00:58.141343 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:00:58.141343 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:00:58.141343 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:00:58.141343 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:00:58.141343 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:00:58.141343 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84a8a931-6a18-4ef4-9e3c-63cf4054ea43 could not be found. Oct 08 21:00:58.141343 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:00:58.141343 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-c225285b-5213-4c54-9c02-b0e96cf69aad tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Returning 404 to user: Instance 84a8a931-6a18-4ef4-9e3c-63cf4054ea43 could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:00:58.141343 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-c225285b-5213-4c54-9c02-b0e96cf69aad tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] 10.222.0.26 "GET /compute/v2.1/servers/84a8a931-6a18-4ef4-9e3c-63cf4054ea43" status: 404 len: 111 microversion: 2.1 time: 0.030493 Oct 08 21:00:58.141343 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1184/2329] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:58 2022] GET /compute/v2.1/servers/84a8a931-6a18-4ef4-9e3c-63cf4054ea43 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 08 21:00:58.147350 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-038e009c-feca-40a6-a149-d32ff8c40f28 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:58.160591 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-1fba68c2-f6e9-4aed-a023-4b91d5df57a5 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1698dee4a2bf4ea19a6ee0c3d5cb5c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b00ee5e7828469f95bd90548d35982a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:58.169879 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-1fba68c2-f6e9-4aed-a023-4b91d5df57a5 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] 10.222.0.26 "GET /compute/v2.1/servers/579b0f8b-ccae-4c2b-bb48-1da1aaf6a138" status: 200 len: 1523 microversion: 2.1 time: 0.172743 Oct 08 21:00:58.170972 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1146/2330] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:57 2022] GET /compute/v2.1/servers/579b0f8b-ccae-4c2b-bb48-1da1aaf6a138 => generated 1523 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:58.177227 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-038e009c-feca-40a6-a149-d32ff8c40f28 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] 10.222.0.26 "DELETE /compute/v2.1/os-server-groups/b66c37e0-ab81-4b03-9a68-eb3fe9175719" status: 204 len: 0 microversion: 2.1 time: 0.033598 Oct 08 21:00:58.178124 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1185/2331] 10.222.0.26 () {58 vars in 1266 bytes} [Sat Oct 8 21:00:58 2022] DELETE /compute/v2.1/os-server-groups/b66c37e0-ab81-4b03-9a68-eb3fe9175719 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 21:00:58.186155 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-64192a2b-3dcb-4b16-910f-19dda004f883 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:58.186727 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-64192a2b-3dcb-4b16-910f-19dda004f883 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] [instance: 8ceaf7df-4795-4969-be16-a2a1b94a3fa6] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:58.192738 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-64192a2b-3dcb-4b16-910f-19dda004f883 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:58.193357 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-64192a2b-3dcb-4b16-910f-19dda004f883 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:58.193935 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-64192a2b-3dcb-4b16-910f-19dda004f883 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:58.194586 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-64192a2b-3dcb-4b16-910f-19dda004f883 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:58.195044 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-64192a2b-3dcb-4b16-910f-19dda004f883 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:58.195502 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-64192a2b-3dcb-4b16-910f-19dda004f883 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:58.220369 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-64192a2b-3dcb-4b16-910f-19dda004f883 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] [instance: 8ceaf7df-4795-4969-be16-a2a1b94a3fa6] Going to try to terminate instance {{(pid=140491) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 21:00:58.264098 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-f266f1e3-0153-4597-9e6a-8691c744b31a tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:58.264731 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-f266f1e3-0153-4597-9e6a-8691c744b31a tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] [instance: 4832d86f-ddee-445e-8b26-fae015d901a4] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:58.271632 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f266f1e3-0153-4597-9e6a-8691c744b31a tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:58.272125 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f266f1e3-0153-4597-9e6a-8691c744b31a tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:58.272602 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f266f1e3-0153-4597-9e6a-8691c744b31a tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:58.273300 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f266f1e3-0153-4597-9e6a-8691c744b31a tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:58.273764 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f266f1e3-0153-4597-9e6a-8691c744b31a tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:58.274227 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f266f1e3-0153-4597-9e6a-8691c744b31a tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:58.296100 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-64192a2b-3dcb-4b16-910f-19dda004f883 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] 10.222.0.26 "DELETE /compute/v2.1/servers/8ceaf7df-4795-4969-be16-a2a1b94a3fa6" status: 204 len: 0 microversion: 2.1 time: 0.113702 Oct 08 21:00:58.296704 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1147/2332] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:00:58 2022] DELETE /compute/v2.1/servers/8ceaf7df-4795-4969-be16-a2a1b94a3fa6 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 21:00:58.305740 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-99c0fce3-47a4-4352-98df-16080480ba3f tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:58.306559 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-99c0fce3-47a4-4352-98df-16080480ba3f tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] [instance: 8ceaf7df-4795-4969-be16-a2a1b94a3fa6] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:58.313313 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-99c0fce3-47a4-4352-98df-16080480ba3f tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:58.313823 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-99c0fce3-47a4-4352-98df-16080480ba3f tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:58.314279 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-99c0fce3-47a4-4352-98df-16080480ba3f tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:58.315006 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-99c0fce3-47a4-4352-98df-16080480ba3f tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:58.315475 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-99c0fce3-47a4-4352-98df-16080480ba3f tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:58.315919 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-99c0fce3-47a4-4352-98df-16080480ba3f tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:58.423453 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-f266f1e3-0153-4597-9e6a-8691c744b31a tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '463a3aac627c43d7af0dbc9facb52076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac791938e6384c8c8473ffd65cf867a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:58.431391 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-f266f1e3-0153-4597-9e6a-8691c744b31a tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] 10.222.0.26 "GET /compute/v2.1/servers/4832d86f-ddee-445e-8b26-fae015d901a4" status: 200 len: 1520 microversion: 2.1 time: 0.171325 Oct 08 21:00:58.431959 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1186/2333] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:58 2022] GET /compute/v2.1/servers/4832d86f-ddee-445e-8b26-fae015d901a4 => generated 1520 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:00:58.461284 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-99c0fce3-47a4-4352-98df-16080480ba3f tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ddc3cd3c374bacbe5bf5e0877380e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8472b054404c46a99b81aba34d6b9f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:58.469787 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-99c0fce3-47a4-4352-98df-16080480ba3f tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] 10.222.0.26 "GET /compute/v2.1/servers/8ceaf7df-4795-4969-be16-a2a1b94a3fa6" status: 200 len: 1473 microversion: 2.1 time: 0.168919 Oct 08 21:00:58.470364 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1148/2334] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:58 2022] GET /compute/v2.1/servers/8ceaf7df-4795-4969-be16-a2a1b94a3fa6 => generated 1473 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:00:58.504896 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-dc73bb9d-fe8b-48ef-9a94-2fa33dab0892 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:58.507683 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-dc73bb9d-fe8b-48ef-9a94-2fa33dab0892 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] [instance: a8b2f857-6c24-45fe-b934-cf92b2d18b7a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:58.512293 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-855b58bf-3838-4ede-9bac-4bae68204555 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:58.512914 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-855b58bf-3838-4ede-9bac-4bae68204555 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: 38b000d3-167b-4f7a-ab80-cd51fcb7cbaf] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:58.519258 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-855b58bf-3838-4ede-9bac-4bae68204555 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:58.519926 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-855b58bf-3838-4ede-9bac-4bae68204555 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:58.520365 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-855b58bf-3838-4ede-9bac-4bae68204555 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:58.521098 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-855b58bf-3838-4ede-9bac-4bae68204555 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:58.521668 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-855b58bf-3838-4ede-9bac-4bae68204555 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:58.521975 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dc73bb9d-fe8b-48ef-9a94-2fa33dab0892 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:58.522126 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-855b58bf-3838-4ede-9bac-4bae68204555 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:58.522457 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dc73bb9d-fe8b-48ef-9a94-2fa33dab0892 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:58.522895 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dc73bb9d-fe8b-48ef-9a94-2fa33dab0892 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:58.523983 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dc73bb9d-fe8b-48ef-9a94-2fa33dab0892 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:58.524440 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dc73bb9d-fe8b-48ef-9a94-2fa33dab0892 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:58.525033 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dc73bb9d-fe8b-48ef-9a94-2fa33dab0892 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:58.528666 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:00:58.597623 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-dc73bb9d-fe8b-48ef-9a94-2fa33dab0892 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06caf10b6fa43a3a2ad34858594e329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b10172715d423eb887d6c5b171defb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:58.606289 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-dc73bb9d-fe8b-48ef-9a94-2fa33dab0892 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] 10.222.0.26 "GET /compute/v2.1/servers/a8b2f857-6c24-45fe-b934-cf92b2d18b7a" status: 200 len: 1309 microversion: 2.1 time: 0.110994 Oct 08 21:00:58.607315 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1187/2335] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:58 2022] GET /compute/v2.1/servers/a8b2f857-6c24-45fe-b934-cf92b2d18b7a => generated 1309 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:58.683709 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-855b58bf-3838-4ede-9bac-4bae68204555 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:58.691886 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-855b58bf-3838-4ede-9bac-4bae68204555 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/38b000d3-167b-4f7a-ab80-cd51fcb7cbaf" status: 200 len: 1312 microversion: 2.1 time: 0.184306 Oct 08 21:00:58.692473 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1149/2336] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:58 2022] GET /compute/v2.1/servers/38b000d3-167b-4f7a-ab80-cd51fcb7cbaf => generated 1312 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:00:58.970168 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-d2fe2da1-c24b-4abd-b8f4-14fedfdac56c tempest-VolumesAdminNegativeTest-947119268 tempest-VolumesAdminNegativeTest-947119268-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "e632d4ed-abe6-44a7-8c5d-f20d0950cfb6"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:00:58.977177 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-806ae7dd-d7a6-4b90-9874-3e3ca86f480d tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:58.978056 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-806ae7dd-d7a6-4b90-9874-3e3ca86f480d tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] [instance: 9ed82ee0-e56e-478e-a066-bad43e760a03] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:58.981848 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-d2fe2da1-c24b-4abd-b8f4-14fedfdac56c tempest-VolumesAdminNegativeTest-947119268 tempest-VolumesAdminNegativeTest-947119268-project-admin] [instance: b1a2f781-46a1-43f3-946a-f269deb6455e] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:58.988125 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d2fe2da1-c24b-4abd-b8f4-14fedfdac56c tempest-VolumesAdminNegativeTest-947119268 tempest-VolumesAdminNegativeTest-947119268-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:58.988588 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-806ae7dd-d7a6-4b90-9874-3e3ca86f480d tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:58.988809 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d2fe2da1-c24b-4abd-b8f4-14fedfdac56c tempest-VolumesAdminNegativeTest-947119268 tempest-VolumesAdminNegativeTest-947119268-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:58.989088 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-806ae7dd-d7a6-4b90-9874-3e3ca86f480d tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:58.989381 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d2fe2da1-c24b-4abd-b8f4-14fedfdac56c tempest-VolumesAdminNegativeTest-947119268 tempest-VolumesAdminNegativeTest-947119268-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:58.989601 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-806ae7dd-d7a6-4b90-9874-3e3ca86f480d tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:58.990143 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d2fe2da1-c24b-4abd-b8f4-14fedfdac56c tempest-VolumesAdminNegativeTest-947119268 tempest-VolumesAdminNegativeTest-947119268-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:58.990310 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-806ae7dd-d7a6-4b90-9874-3e3ca86f480d tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:58.990613 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d2fe2da1-c24b-4abd-b8f4-14fedfdac56c tempest-VolumesAdminNegativeTest-947119268 tempest-VolumesAdminNegativeTest-947119268-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:58.990790 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-806ae7dd-d7a6-4b90-9874-3e3ca86f480d tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:58.991051 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d2fe2da1-c24b-4abd-b8f4-14fedfdac56c tempest-VolumesAdminNegativeTest-947119268 tempest-VolumesAdminNegativeTest-947119268-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:58.991213 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-806ae7dd-d7a6-4b90-9874-3e3ca86f480d tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:59.111160 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-d2fe2da1-c24b-4abd-b8f4-14fedfdac56c tempest-VolumesAdminNegativeTest-947119268 tempest-VolumesAdminNegativeTest-947119268-project-admin] HTTP exception thrown: Volume e632d4ed-abe6-44a7-8c5d-f20d0950cfb6 could not be found. Oct 08 21:00:59.144042 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-d2fe2da1-c24b-4abd-b8f4-14fedfdac56c tempest-VolumesAdminNegativeTest-947119268 tempest-VolumesAdminNegativeTest-947119268-project-admin] Request method failure captured: Oct 08 21:00:59.144042 ncdv-master-1 devstack@n-api.service[140492]: request: PUT /compute/v2.1/servers/b1a2f781-46a1-43f3-946a-f269deb6455e/os-volume_attachments/7bdc4b7b-49a2-45d3-acde-2c3909fd91f7 HTTP/1.1 Oct 08 21:00:59.144042 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:00:59.144042 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:00:59.144042 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:00:59.144042 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 74 Oct 08 21:00:59.144042 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:00:59.144042 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:00:59.144042 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:00:59.144042 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:00:59.144042 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeSwakQbIJw1lTa2q5Yw0s3PXumFVZqxrVxGWf4nV_pdbQXONokb1F4cu3Jg5rdQ3tgVNoSgjvU8sYNEdAQOLMComb0NzvjHmDHGzweoELtk3jzaV7QaSM2pGGCQsQIFedcBAsY2LVeS0tWfCa2dU9hwDzolYxLg9_5mF7uP6AbuJDc Oct 08 21:00:59.144042 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:00:59.144042 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:00:59.144042 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:00:59.144042 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:00:59.144042 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:00:59.144042 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:00:59.144042 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: cff16d5d25424e24a25a40e1b0373536 Oct 08 21:00:59.144042 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-VolumesAdminNegativeTest-947119268 Oct 08 21:00:59.144042 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,admin,member Oct 08 21:00:59.144042 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,admin,member Oct 08 21:00:59.144042 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/cff16d5d25424e24a25a40e1b0373536"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/cff16d5d25424e24a25a40e1b0373536"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_cff16d5d25424e24a25a40e1b0373536"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/cff16d5d25424e24a25a40e1b0373536"}]}] Oct 08 21:00:59.144042 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-VolumesAdminNegativeTest-947119268 Oct 08 21:00:59.144042 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: cff16d5d25424e24a25a40e1b0373536 Oct 08 21:00:59.144042 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-947119268 Oct 08 21:00:59.144042 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-VolumesAdminNegativeTest-947119268-project-admin Oct 08 21:00:59.144042 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:00:59.144042 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:00:59.144042 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: fb0f01bd824f47bdbb676f945f6462fb Oct 08 21:00:59.144042 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-VolumesAdminNegativeTest-947119268-project-admin Oct 08 21:00:59.144042 ncdv-master-1 devstack@n-api.service[140492]: Oct 08 21:00:59.144042 ncdv-master-1 devstack@n-api.service[140492]: {"volumeAttachment": {"volumeId": "e632d4ed-abe6-44a7-8c5d-f20d0950cfb6"}} Oct 08 21:00:59.144042 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 21:00:59.144042 ncdv-master-1 devstack@n-api.service[140492]: exception: Volume e632d4ed-abe6-44a7-8c5d-f20d0950cfb6 could not be found. Oct 08 21:00:59.144042 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'server_id': 'b1a2f781-46a1-43f3-946a-f269deb6455e', 'id': '7bdc4b7b-49a2-45d3-acde-2c3909fd91f7', 'body': {'volumeAttachment': {'volumeId': 'e632d4ed-abe6-44a7-8c5d-f20d0950cfb6'}}} Oct 08 21:00:59.144042 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:00:59.144042 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:00:59.144042 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 08 21:00:59.144042 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 08 21:00:59.144042 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 08 21:00:59.144042 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 08 21:00:59.144042 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 08 21:00:59.144042 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 08 21:00:59.144042 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 08 21:00:59.144042 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 08 21:00:59.144042 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 08 21:00:59.144042 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 08 21:00:59.144042 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 08 21:00:59.144042 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 08 21:00:59.144042 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 08 21:00:59.144042 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 08 21:00:59.144042 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e632d4ed-abe6-44a7-8c5d-f20d0950cfb6 could not be found. (HTTP 404) (Request-ID: req-59f538c5-0311-4c3f-8917-8c797d6a53c4) Oct 08 21:00:59.144042 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:00:59.144042 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:00:59.144042 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:00:59.144042 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:00:59.144042 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Oct 08 21:00:59.144042 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Oct 08 21:00:59.144042 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 08 21:00:59.144042 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 08 21:00:59.144042 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 08 21:00:59.147824 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 08 21:00:59.147824 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 08 21:00:59.147824 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 08 21:00:59.147824 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 08 21:00:59.147824 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 08 21:00:59.147824 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 08 21:00:59.147824 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 08 21:00:59.147824 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 08 21:00:59.147824 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 08 21:00:59.147824 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 08 21:00:59.147824 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 08 21:00:59.147824 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 08 21:00:59.147824 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 08 21:00:59.147824 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 08 21:00:59.147824 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 08 21:00:59.147824 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 08 21:00:59.147824 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 08 21:00:59.147824 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e632d4ed-abe6-44a7-8c5d-f20d0950cfb6 could not be found. Oct 08 21:00:59.147824 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:00:59.147824 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:00:59.147824 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:00:59.147824 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:00:59.147824 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:00:59.147824 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:00:59.147824 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:00:59.147824 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:00:59.147824 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:00:59.147824 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:00:59.147824 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 21:00:59.147824 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 21:00:59.147824 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 21:00:59.147824 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 21:00:59.147824 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Oct 08 21:00:59.147824 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Oct 08 21:00:59.147824 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Oct 08 21:00:59.147824 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 08 21:00:59.147824 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume e632d4ed-abe6-44a7-8c5d-f20d0950cfb6 could not be found. Oct 08 21:00:59.147824 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:00:59.147824 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:00:59.147824 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:00:59.147824 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:00:59.147824 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:00:59.147824 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:00:59.147824 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:00:59.147824 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:00:59.147824 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e632d4ed-abe6-44a7-8c5d-f20d0950cfb6 could not be found. Oct 08 21:00:59.147824 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:00:59.147824 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-d2fe2da1-c24b-4abd-b8f4-14fedfdac56c tempest-VolumesAdminNegativeTest-947119268 tempest-VolumesAdminNegativeTest-947119268-project-admin] Returning 400 to user: Volume e632d4ed-abe6-44a7-8c5d-f20d0950cfb6 could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:00:59.147824 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-d2fe2da1-c24b-4abd-b8f4-14fedfdac56c tempest-VolumesAdminNegativeTest-947119268 tempest-VolumesAdminNegativeTest-947119268-project-admin] 10.222.0.26 "PUT /compute/v2.1/servers/b1a2f781-46a1-43f3-946a-f269deb6455e/os-volume_attachments/7bdc4b7b-49a2-45d3-acde-2c3909fd91f7" status: 400 len: 107 microversion: 2.1 time: 0.334616 Oct 08 21:00:59.147824 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1188/2337] 10.222.0.26 () {60 vars in 1433 bytes} [Sat Oct 8 21:00:58 2022] PUT /compute/v2.1/servers/b1a2f781-46a1-43f3-946a-f269deb6455e/os-volume_attachments/7bdc4b7b-49a2-45d3-acde-2c3909fd91f7 => generated 107 bytes in 336 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 08 21:00:59.153097 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-806ae7dd-d7a6-4b90-9874-3e3ca86f480d tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c7aebdf00342b1ba80833663f8c0a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad3679a59b504731b5f56e52788fd645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:59.161120 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-806ae7dd-d7a6-4b90-9874-3e3ca86f480d tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] 10.222.0.26 "GET /compute/v2.1/servers/9ed82ee0-e56e-478e-a066-bad43e760a03" status: 200 len: 1351 microversion: 2.1 time: 0.187788 Oct 08 21:00:59.162124 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1150/2338] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:58 2022] GET /compute/v2.1/servers/9ed82ee0-e56e-478e-a066-bad43e760a03 => generated 1351 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:59.194897 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-213e96ac-1802-40be-ba6a-7a28223fcb40 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:59.195564 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-213e96ac-1802-40be-ba6a-7a28223fcb40 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] [instance: 579b0f8b-ccae-4c2b-bb48-1da1aaf6a138] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:59.204122 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-213e96ac-1802-40be-ba6a-7a28223fcb40 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:59.205043 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-213e96ac-1802-40be-ba6a-7a28223fcb40 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:59.205535 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-213e96ac-1802-40be-ba6a-7a28223fcb40 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:59.206274 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-213e96ac-1802-40be-ba6a-7a28223fcb40 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:59.206776 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-213e96ac-1802-40be-ba6a-7a28223fcb40 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:59.207221 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-213e96ac-1802-40be-ba6a-7a28223fcb40 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:59.216266 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-ddd06415-8a5a-4791-9fa0-e4da228dbb44 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:59.216762 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-ddd06415-8a5a-4791-9fa0-e4da228dbb44 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] [instance: b1a2f781-46a1-43f3-946a-f269deb6455e] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:59.222839 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ddd06415-8a5a-4791-9fa0-e4da228dbb44 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:59.223267 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ddd06415-8a5a-4791-9fa0-e4da228dbb44 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:59.223709 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ddd06415-8a5a-4791-9fa0-e4da228dbb44 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:59.224412 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ddd06415-8a5a-4791-9fa0-e4da228dbb44 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:59.225033 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ddd06415-8a5a-4791-9fa0-e4da228dbb44 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:59.225653 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ddd06415-8a5a-4791-9fa0-e4da228dbb44 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:59.323915 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.objects.instance [None req-ddd06415-8a5a-4791-9fa0-e4da228dbb44 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lazy-loading 'services' on Instance uuid b1a2f781-46a1-43f3-946a-f269deb6455e {{(pid=140491) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 21:00:59.433230 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-ddd06415-8a5a-4791-9fa0-e4da228dbb44 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] 10.222.0.26 "DELETE /compute/v2.1/servers/b1a2f781-46a1-43f3-946a-f269deb6455e/os-volume_attachments/7bdc4b7b-49a2-45d3-acde-2c3909fd91f7" status: 202 len: 0 microversion: 2.1 time: 0.219595 Oct 08 21:00:59.433858 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1151/2339] 10.222.0.26 () {58 vars in 1416 bytes} [Sat Oct 8 21:00:59 2022] DELETE /compute/v2.1/servers/b1a2f781-46a1-43f3-946a-f269deb6455e/os-volume_attachments/7bdc4b7b-49a2-45d3-acde-2c3909fd91f7 => generated 0 bytes in 222 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 08 21:00:59.446038 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-1c141b6a-cd81-4943-b361-ac61df81d6e9 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:59.450722 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-1c141b6a-cd81-4943-b361-ac61df81d6e9 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] [instance: b1a2f781-46a1-43f3-946a-f269deb6455e] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:59.460694 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1c141b6a-cd81-4943-b361-ac61df81d6e9 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:59.461213 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1c141b6a-cd81-4943-b361-ac61df81d6e9 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:59.462103 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1c141b6a-cd81-4943-b361-ac61df81d6e9 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:59.463602 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1c141b6a-cd81-4943-b361-ac61df81d6e9 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:59.465086 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1c141b6a-cd81-4943-b361-ac61df81d6e9 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:59.465569 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1c141b6a-cd81-4943-b361-ac61df81d6e9 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:59.515463 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-1c141b6a-cd81-4943-b361-ac61df81d6e9 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] 10.222.0.26 "GET /compute/v2.1/servers/b1a2f781-46a1-43f3-946a-f269deb6455e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075919 Oct 08 21:00:59.516960 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1152/2340] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Oct 8 21:00:59 2022] GET /compute/v2.1/servers/b1a2f781-46a1-43f3-946a-f269deb6455e/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:00:59.522125 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-900b450a-d5a5-4aae-b488-6b83c456f3e5 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:59.523041 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-900b450a-d5a5-4aae-b488-6b83c456f3e5 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] [instance: 4832d86f-ddee-445e-8b26-fae015d901a4] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:59.530448 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-900b450a-d5a5-4aae-b488-6b83c456f3e5 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:59.531232 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-900b450a-d5a5-4aae-b488-6b83c456f3e5 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:59.532069 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-900b450a-d5a5-4aae-b488-6b83c456f3e5 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:59.533000 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-900b450a-d5a5-4aae-b488-6b83c456f3e5 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:59.533683 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-900b450a-d5a5-4aae-b488-6b83c456f3e5 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:59.534347 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-900b450a-d5a5-4aae-b488-6b83c456f3e5 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:59.573712 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-213e96ac-1802-40be-ba6a-7a28223fcb40 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1698dee4a2bf4ea19a6ee0c3d5cb5c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b00ee5e7828469f95bd90548d35982a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:59.585569 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-213e96ac-1802-40be-ba6a-7a28223fcb40 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] 10.222.0.26 "GET /compute/v2.1/servers/579b0f8b-ccae-4c2b-bb48-1da1aaf6a138" status: 200 len: 1523 microversion: 2.1 time: 0.396174 Oct 08 21:00:59.586159 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1189/2341] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:59 2022] GET /compute/v2.1/servers/579b0f8b-ccae-4c2b-bb48-1da1aaf6a138 => generated 1523 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:59.591637 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-586c5168-d61f-4fc9-900f-d6f1af336351 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:59.595321 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-586c5168-d61f-4fc9-900f-d6f1af336351 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] [instance: 8ceaf7df-4795-4969-be16-a2a1b94a3fa6] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:59.619921 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-586c5168-d61f-4fc9-900f-d6f1af336351 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:59.620910 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-586c5168-d61f-4fc9-900f-d6f1af336351 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:59.621657 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-586c5168-d61f-4fc9-900f-d6f1af336351 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:59.622746 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-586c5168-d61f-4fc9-900f-d6f1af336351 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:59.623423 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-586c5168-d61f-4fc9-900f-d6f1af336351 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:59.624229 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-586c5168-d61f-4fc9-900f-d6f1af336351 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:59.645780 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-900b450a-d5a5-4aae-b488-6b83c456f3e5 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '463a3aac627c43d7af0dbc9facb52076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac791938e6384c8c8473ffd65cf867a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:59.661652 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-900b450a-d5a5-4aae-b488-6b83c456f3e5 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] 10.222.0.26 "GET /compute/v2.1/servers/4832d86f-ddee-445e-8b26-fae015d901a4" status: 200 len: 1478 microversion: 2.1 time: 0.143339 Oct 08 21:00:59.662570 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1153/2342] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:59 2022] GET /compute/v2.1/servers/4832d86f-ddee-445e-8b26-fae015d901a4 => generated 1478 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:59.667354 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-3f4a4ddc-9bce-4ecd-ad6e-7a947da6f91b req-c96acf8b-5b8c-46ae-95f0-4cd3a39e4ed6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4832d86f-ddee-445e-8b26-fae015d901a4", "name": "network-vif-deleted", "tag": "b12b61d4-cc2a-4ad0-8a4c-e8c07da8ccb1"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:00:59.689379 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-3f4a4ddc-9bce-4ecd-ad6e-7a947da6f91b req-c96acf8b-5b8c-46ae-95f0-4cd3a39e4ed6 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:59.690147 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-3f4a4ddc-9bce-4ecd-ad6e-7a947da6f91b req-c96acf8b-5b8c-46ae-95f0-4cd3a39e4ed6 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:59.690863 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-3f4a4ddc-9bce-4ecd-ad6e-7a947da6f91b req-c96acf8b-5b8c-46ae-95f0-4cd3a39e4ed6 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:59.706833 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-3f4a4ddc-9bce-4ecd-ad6e-7a947da6f91b req-c96acf8b-5b8c-46ae-95f0-4cd3a39e4ed6 service nova] Creating event network-vif-deleted:b12b61d4-cc2a-4ad0-8a4c-e8c07da8ccb1 for instance 4832d86f-ddee-445e-8b26-fae015d901a4 on nch2-master-1 Oct 08 21:00:59.713928 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-3f4a4ddc-9bce-4ecd-ad6e-7a947da6f91b req-c96acf8b-5b8c-46ae-95f0-4cd3a39e4ed6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049620 Oct 08 21:00:59.714692 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1154/2343] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:00:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:00:59.721661 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-e360f1f6-e17a-4786-9a33-6ee3d02d2582 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:59.723587 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-e360f1f6-e17a-4786-9a33-6ee3d02d2582 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] [instance: a8b2f857-6c24-45fe-b934-cf92b2d18b7a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:59.741668 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e360f1f6-e17a-4786-9a33-6ee3d02d2582 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:59.742586 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e360f1f6-e17a-4786-9a33-6ee3d02d2582 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:59.742586 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e360f1f6-e17a-4786-9a33-6ee3d02d2582 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:59.743303 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e360f1f6-e17a-4786-9a33-6ee3d02d2582 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:59.743767 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e360f1f6-e17a-4786-9a33-6ee3d02d2582 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:59.744646 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e360f1f6-e17a-4786-9a33-6ee3d02d2582 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:59.779290 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-e360f1f6-e17a-4786-9a33-6ee3d02d2582 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] HTTP exception thrown: Instance a8b2f857-6c24-45fe-b934-cf92b2d18b7a could not be found. Oct 08 21:00:59.784048 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-e360f1f6-e17a-4786-9a33-6ee3d02d2582 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Request method failure captured: Oct 08 21:00:59.784048 ncdv-master-1 devstack@n-api.service[140491]: request: GET /compute/v2.1/servers/a8b2f857-6c24-45fe-b934-cf92b2d18b7a HTTP/1.1 Oct 08 21:00:59.784048 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:00:59.784048 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:00:59.784048 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:00:59.784048 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 21:00:59.784048 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:00:59.784048 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:00:59.784048 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:00:59.784048 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:00:59.784048 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeTE7bTfM4hIhoviKx9l8mw-bWfYL6jsTZW_QjKSgS6NcvR5fjqeBn6E1jAPDuPpZvhMcTeb9kBH8YZZEMCFr_F1J-nxa8vLVrJvg33lxBDKWqjORjFzU7YTBNB-gB5p5hXf0cUCzsO7xU_2VbukaClcdx1U8H5njKq8mVnqRKHv1K4 Oct 08 21:00:59.784048 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:00:59.784048 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:00:59.784048 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:00:59.784048 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:00:59.784048 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:00:59.784048 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:00:59.784048 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 76b10172715d423eb887d6c5b171defb Oct 08 21:00:59.784048 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1001637313 Oct 08 21:00:59.784048 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:00:59.784048 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:00:59.784048 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/76b10172715d423eb887d6c5b171defb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/76b10172715d423eb887d6c5b171defb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_76b10172715d423eb887d6c5b171defb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/76b10172715d423eb887d6c5b171defb"}]}] Oct 08 21:00:59.784048 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1001637313 Oct 08 21:00:59.784048 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 76b10172715d423eb887d6c5b171defb Oct 08 21:00:59.784048 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1001637313 Oct 08 21:00:59.784048 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-ImagesOneServerNegativeTestJSON-1001637313-project Oct 08 21:00:59.784048 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:00:59.784048 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:00:59.784048 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: f06caf10b6fa43a3a2ad34858594e329 Oct 08 21:00:59.784048 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1001637313-project Oct 08 21:00:59.784048 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:00:59.784048 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance a8b2f857-6c24-45fe-b934-cf92b2d18b7a could not be found. Oct 08 21:00:59.784048 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': 'a8b2f857-6c24-45fe-b934-cf92b2d18b7a'} Oct 08 21:00:59.784048 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:00:59.784048 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:00:59.784048 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:00:59.784048 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:00:59.784048 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:00:59.784048 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:00:59.784048 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:00:59.784048 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:00:59.784048 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:00:59.784048 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:00:59.784048 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8b2f857-6c24-45fe-b934-cf92b2d18b7a could not be found. Oct 08 21:00:59.784048 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:00:59.784048 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:00:59.784048 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:00:59.784048 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:00:59.784048 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:00:59.784048 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:00:59.784048 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:00:59.784048 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:00:59.784048 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:00:59.784048 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:00:59.784048 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:00:59.784048 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:00:59.784048 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:00:59.784048 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:00:59.784048 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:00:59.784048 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:00:59.784048 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8b2f857-6c24-45fe-b934-cf92b2d18b7a could not be found. Oct 08 21:00:59.784048 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:00:59.784048 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:00:59.788983 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:00:59.788983 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:00:59.788983 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:00:59.788983 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:00:59.788983 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:00:59.788983 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:00:59.788983 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8b2f857-6c24-45fe-b934-cf92b2d18b7a could not be found. Oct 08 21:00:59.788983 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:00:59.788983 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-e360f1f6-e17a-4786-9a33-6ee3d02d2582 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Returning 404 to user: Instance a8b2f857-6c24-45fe-b934-cf92b2d18b7a could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:00:59.791200 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-e360f1f6-e17a-4786-9a33-6ee3d02d2582 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] 10.222.0.26 "GET /compute/v2.1/servers/a8b2f857-6c24-45fe-b934-cf92b2d18b7a" status: 404 len: 111 microversion: 2.1 time: 0.074110 Oct 08 21:00:59.797435 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1155/2344] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:59 2022] GET /compute/v2.1/servers/a8b2f857-6c24-45fe-b934-cf92b2d18b7a => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:00:59.801791 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-40d96af7-3d1f-4db2-8d72-a85aabe21428 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:00:59.803127 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-40d96af7-3d1f-4db2-8d72-a85aabe21428 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: 38b000d3-167b-4f7a-ab80-cd51fcb7cbaf] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:59.809830 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-40d96af7-3d1f-4db2-8d72-a85aabe21428 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:59.810411 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-40d96af7-3d1f-4db2-8d72-a85aabe21428 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:59.811063 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-40d96af7-3d1f-4db2-8d72-a85aabe21428 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:59.811864 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-40d96af7-3d1f-4db2-8d72-a85aabe21428 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:00:59.812405 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-40d96af7-3d1f-4db2-8d72-a85aabe21428 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:00:59.812847 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-40d96af7-3d1f-4db2-8d72-a85aabe21428 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:00:59.826932 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-586c5168-d61f-4fc9-900f-d6f1af336351 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ddc3cd3c374bacbe5bf5e0877380e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8472b054404c46a99b81aba34d6b9f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:59.836010 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-586c5168-d61f-4fc9-900f-d6f1af336351 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] 10.222.0.26 "GET /compute/v2.1/servers/8ceaf7df-4795-4969-be16-a2a1b94a3fa6" status: 200 len: 1473 microversion: 2.1 time: 0.248512 Oct 08 21:00:59.836608 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1190/2345] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:59 2022] GET /compute/v2.1/servers/8ceaf7df-4795-4969-be16-a2a1b94a3fa6 => generated 1473 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:59.907049 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-24bfa285-1b20-4738-bee1-29729509d573 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1136946251", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:00:59.956962 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-40d96af7-3d1f-4db2-8d72-a85aabe21428 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:00:59.965792 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-40d96af7-3d1f-4db2-8d72-a85aabe21428 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/38b000d3-167b-4f7a-ab80-cd51fcb7cbaf" status: 200 len: 1462 microversion: 2.1 time: 0.167875 Oct 08 21:00:59.966364 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1156/2346] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:00:59 2022] GET /compute/v2.1/servers/38b000d3-167b-4f7a-ab80-cd51fcb7cbaf => generated 1462 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:00:59.966750 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.network.neutron [None req-24bfa285-1b20-4738-bee1-29729509d573 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] validate_networks() for [('03b40f51-e6b4-4d4c-82cf-99e0f52c3cd5', None, None, None, None, None)] {{(pid=140492) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 21:00:59.990013 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-d7c00b1a-b108-43fd-9a51-e81604612da9 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:00:59.992376 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-d7c00b1a-b108-43fd-9a51-e81604612da9 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: 38b000d3-167b-4f7a-ab80-cd51fcb7cbaf] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:00:59.999704 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d7c00b1a-b108-43fd-9a51-e81604612da9 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:00.000216 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d7c00b1a-b108-43fd-9a51-e81604612da9 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:00.000666 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d7c00b1a-b108-43fd-9a51-e81604612da9 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:00.001427 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d7c00b1a-b108-43fd-9a51-e81604612da9 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:00.001896 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d7c00b1a-b108-43fd-9a51-e81604612da9 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:00.002337 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d7c00b1a-b108-43fd-9a51-e81604612da9 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:00.102098 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-d7c00b1a-b108-43fd-9a51-e81604612da9 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:01:00.109222 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-d7c00b1a-b108-43fd-9a51-e81604612da9 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: 38b000d3-167b-4f7a-ab80-cd51fcb7cbaf] Old instance type m1.heat2, new instance type m1.heat {{(pid=140491) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 08 21:01:00.116036 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-d7c00b1a-b108-43fd-9a51-e81604612da9 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Flavor limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 21:01:00.116465 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-d7c00b1a-b108-43fd-9a51-e81604612da9 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Image limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 21:01:00.116949 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-d7c00b1a-b108-43fd-9a51-e81604612da9 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Flavor pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 21:01:00.117399 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-d7c00b1a-b108-43fd-9a51-e81604612da9 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Image pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 21:01:00.117816 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-d7c00b1a-b108-43fd-9a51-e81604612da9 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 21:01:00.231778 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-d7c00b1a-b108-43fd-9a51-e81604612da9 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "POST /compute/v2.1/servers/38b000d3-167b-4f7a-ab80-cd51fcb7cbaf/action" status: 202 len: 0 microversion: 2.1 time: 0.246552 Oct 08 21:01:00.233495 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1157/2347] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:00:59 2022] POST /compute/v2.1/servers/38b000d3-167b-4f7a-ab80-cd51fcb7cbaf/action => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 21:01:00.238827 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-087c6d33-d441-47c0-9fa7-5f28182b8235 tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:00.239746 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-087c6d33-d441-47c0-9fa7-5f28182b8235 tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] [instance: 9ed82ee0-e56e-478e-a066-bad43e760a03] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:00.249288 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-087c6d33-d441-47c0-9fa7-5f28182b8235 tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:00.250034 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-087c6d33-d441-47c0-9fa7-5f28182b8235 tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:00.250580 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-087c6d33-d441-47c0-9fa7-5f28182b8235 tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:00.251650 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-087c6d33-d441-47c0-9fa7-5f28182b8235 tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:00.252312 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-087c6d33-d441-47c0-9fa7-5f28182b8235 tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:00.252977 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-087c6d33-d441-47c0-9fa7-5f28182b8235 tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:00.468444 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-087c6d33-d441-47c0-9fa7-5f28182b8235 tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c7aebdf00342b1ba80833663f8c0a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad3679a59b504731b5f56e52788fd645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:01:00.468942 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-24bfa285-1b20-4738-bee1-29729509d573 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Flavor limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 21:01:00.469542 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-24bfa285-1b20-4738-bee1-29729509d573 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Image limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 21:01:00.470141 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-24bfa285-1b20-4738-bee1-29729509d573 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Flavor pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 21:01:00.470552 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-24bfa285-1b20-4738-bee1-29729509d573 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Image pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 21:01:00.471186 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-24bfa285-1b20-4738-bee1-29729509d573 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 21:01:00.480550 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-087c6d33-d441-47c0-9fa7-5f28182b8235 tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] 10.222.0.26 "GET /compute/v2.1/servers/9ed82ee0-e56e-478e-a066-bad43e760a03" status: 200 len: 1351 microversion: 2.1 time: 0.243483 Oct 08 21:01:00.481411 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1158/2348] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:01:00 2022] GET /compute/v2.1/servers/9ed82ee0-e56e-478e-a066-bad43e760a03 => generated 1351 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:01:00.488008 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-63b50292-d678-4030-be1a-813497217f79 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:00.490003 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-63b50292-d678-4030-be1a-813497217f79 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: 38b000d3-167b-4f7a-ab80-cd51fcb7cbaf] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:00.492519 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-24bfa285-1b20-4738-bee1-29729509d573 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:00.495053 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-24bfa285-1b20-4738-bee1-29729509d573 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:00.497222 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-24bfa285-1b20-4738-bee1-29729509d573 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:00.499211 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-24bfa285-1b20-4738-bee1-29729509d573 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:00.500971 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-63b50292-d678-4030-be1a-813497217f79 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:00.501525 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-24bfa285-1b20-4738-bee1-29729509d573 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:00.501722 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-63b50292-d678-4030-be1a-813497217f79 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:00.502329 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-24bfa285-1b20-4738-bee1-29729509d573 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:00.502893 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-63b50292-d678-4030-be1a-813497217f79 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:00.503750 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-63b50292-d678-4030-be1a-813497217f79 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:00.504203 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-63b50292-d678-4030-be1a-813497217f79 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:00.504641 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-63b50292-d678-4030-be1a-813497217f79 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:00.533650 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-24bfa285-1b20-4738-bee1-29729509d573 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Getting quotas for project 76b10172715d423eb887d6c5b171defb. Resources: {'cores', 'instances', 'ram'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:01:00.539565 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-24bfa285-1b20-4738-bee1-29729509d573 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Getting quotas for user f06caf10b6fa43a3a2ad34858594e329 and project 76b10172715d423eb887d6c5b171defb. Resources: {'cores', 'instances', 'ram'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:01:00.553476 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-24bfa285-1b20-4738-bee1-29729509d573 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Going to run 1 instances... {{(pid=140492) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 21:01:00.555952 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-24bfa285-1b20-4738-bee1-29729509d573 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] [instance: 1510673d-866c-4e8c-9cb8-2dbc7f0a4115] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c508bd7f-7db9-4b2c-af7c-be54a855c355',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140492) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 21:01:00.613441 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-24bfa285-1b20-4738-bee1-29729509d573 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.710468 Oct 08 21:01:00.615080 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1191/2349] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 21:00:59 2022] POST /compute/v2.1/servers => generated 383 bytes in 713 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 08 21:01:00.621212 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-cbb02574-653a-4b87-a485-d09f92f6ad2b tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:00.623980 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-cbb02574-653a-4b87-a485-d09f92f6ad2b tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] [instance: b1a2f781-46a1-43f3-946a-f269deb6455e] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:00.632724 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cbb02574-653a-4b87-a485-d09f92f6ad2b tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:00.633599 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cbb02574-653a-4b87-a485-d09f92f6ad2b tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:00.634268 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cbb02574-653a-4b87-a485-d09f92f6ad2b tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:00.635416 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cbb02574-653a-4b87-a485-d09f92f6ad2b tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:00.636618 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cbb02574-653a-4b87-a485-d09f92f6ad2b tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:00.637431 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cbb02574-653a-4b87-a485-d09f92f6ad2b tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:00.677618 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-cbb02574-653a-4b87-a485-d09f92f6ad2b tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] 10.222.0.26 "GET /compute/v2.1/servers/b1a2f781-46a1-43f3-946a-f269deb6455e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.061078 Oct 08 21:01:00.678498 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1192/2350] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Oct 8 21:01:00 2022] GET /compute/v2.1/servers/b1a2f781-46a1-43f3-946a-f269deb6455e/os-volume_attachments => generated 25 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 08 21:01:00.683469 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-6907a61d-6883-451a-9d2a-2f9fe7d77324 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:00.684422 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-6907a61d-6883-451a-9d2a-2f9fe7d77324 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] [instance: 579b0f8b-ccae-4c2b-bb48-1da1aaf6a138] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:00.694162 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6907a61d-6883-451a-9d2a-2f9fe7d77324 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:00.694963 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6907a61d-6883-451a-9d2a-2f9fe7d77324 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:00.695626 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6907a61d-6883-451a-9d2a-2f9fe7d77324 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:00.696569 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6907a61d-6883-451a-9d2a-2f9fe7d77324 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:00.697378 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6907a61d-6883-451a-9d2a-2f9fe7d77324 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:00.698922 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6907a61d-6883-451a-9d2a-2f9fe7d77324 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:01.007276 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-63b50292-d678-4030-be1a-813497217f79 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:01:01.022909 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-63b50292-d678-4030-be1a-813497217f79 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/38b000d3-167b-4f7a-ab80-cd51fcb7cbaf" status: 200 len: 1471 microversion: 2.1 time: 0.539003 Oct 08 21:01:01.023729 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1159/2351] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:01:00 2022] GET /compute/v2.1/servers/38b000d3-167b-4f7a-ab80-cd51fcb7cbaf => generated 1471 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:01:01.037850 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-430e6da3-8a61-4e3e-a27e-2d527fad09ab tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:01.040179 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-430e6da3-8a61-4e3e-a27e-2d527fad09ab tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] [instance: 1510673d-866c-4e8c-9cb8-2dbc7f0a4115] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:01.066234 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-6907a61d-6883-451a-9d2a-2f9fe7d77324 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1698dee4a2bf4ea19a6ee0c3d5cb5c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b00ee5e7828469f95bd90548d35982a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:01:01.077504 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-6907a61d-6883-451a-9d2a-2f9fe7d77324 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] 10.222.0.26 "GET /compute/v2.1/servers/579b0f8b-ccae-4c2b-bb48-1da1aaf6a138" status: 200 len: 1523 microversion: 2.1 time: 0.396121 Oct 08 21:01:01.078627 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1193/2352] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:01:00 2022] GET /compute/v2.1/servers/579b0f8b-ccae-4c2b-bb48-1da1aaf6a138 => generated 1523 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:01:01.086707 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-ec23ce9b-d937-42db-9987-ba0b2944c858 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:01.087445 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-ec23ce9b-d937-42db-9987-ba0b2944c858 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] [instance: 4832d86f-ddee-445e-8b26-fae015d901a4] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:01.095581 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ec23ce9b-d937-42db-9987-ba0b2944c858 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:01.096422 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ec23ce9b-d937-42db-9987-ba0b2944c858 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:01.097117 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ec23ce9b-d937-42db-9987-ba0b2944c858 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:01.098244 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ec23ce9b-d937-42db-9987-ba0b2944c858 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:01.099094 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ec23ce9b-d937-42db-9987-ba0b2944c858 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:01.099722 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ec23ce9b-d937-42db-9987-ba0b2944c858 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:01.119779 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-ec23ce9b-d937-42db-9987-ba0b2944c858 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] HTTP exception thrown: Instance 4832d86f-ddee-445e-8b26-fae015d901a4 could not be found. Oct 08 21:01:01.122630 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-ec23ce9b-d937-42db-9987-ba0b2944c858 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Request method failure captured: Oct 08 21:01:01.122630 ncdv-master-1 devstack@n-api.service[140492]: request: GET /compute/v2.1/servers/4832d86f-ddee-445e-8b26-fae015d901a4 HTTP/1.1 Oct 08 21:01:01.122630 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:01:01.122630 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:01:01.122630 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:01:01.122630 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 21:01:01.122630 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:01:01.122630 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:01:01.122630 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:01:01.122630 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:01:01.122630 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeTgs6u98Kj2qNeUbhNZytTz3QZl3npCYhXvqzJPAHZJSisgyrybjMBWF-fdPl_tWpGYuTI6Puj6PawUImfVDEBxcbmulm9uh4lstHlNST7jgnukdD8WC74LVcFesaNP8PWq7Fzl1J3ZhXvWqEYDTsN6hHueqzcw9I-JZ0vsP9wgdik Oct 08 21:01:01.122630 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:01:01.122630 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:01:01.122630 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:01:01.122630 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:01:01.122630 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:01:01.122630 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:01:01.122630 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: ac791938e6384c8c8473ffd65cf867a8 Oct 08 21:01:01.122630 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-ListServersNegativeTestJSON-1263442127 Oct 08 21:01:01.122630 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:01:01.122630 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:01:01.122630 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ac791938e6384c8c8473ffd65cf867a8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ac791938e6384c8c8473ffd65cf867a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ac791938e6384c8c8473ffd65cf867a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ac791938e6384c8c8473ffd65cf867a8"}]}] Oct 08 21:01:01.122630 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-ListServersNegativeTestJSON-1263442127 Oct 08 21:01:01.122630 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: ac791938e6384c8c8473ffd65cf867a8 Oct 08 21:01:01.122630 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1263442127 Oct 08 21:01:01.122630 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-ListServersNegativeTestJSON-1263442127-project Oct 08 21:01:01.122630 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:01:01.122630 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:01:01.122630 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 463a3aac627c43d7af0dbc9facb52076 Oct 08 21:01:01.122630 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-ListServersNegativeTestJSON-1263442127-project Oct 08 21:01:01.122630 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 21:01:01.122630 ncdv-master-1 devstack@n-api.service[140492]: exception: Instance 4832d86f-ddee-445e-8b26-fae015d901a4 could not be found. Oct 08 21:01:01.122630 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': '4832d86f-ddee-445e-8b26-fae015d901a4'} Oct 08 21:01:01.122630 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:01:01.122630 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:01:01.122630 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:01:01.122630 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:01:01.122630 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:01:01.122630 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:01:01.122630 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:01:01.122630 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:01:01.122630 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:01:01.122630 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:01:01.122630 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4832d86f-ddee-445e-8b26-fae015d901a4 could not be found. Oct 08 21:01:01.122630 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:01:01.122630 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:01:01.122630 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:01:01.122630 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:01:01.122630 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:01:01.122630 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:01:01.122630 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:01:01.122630 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:01:01.122630 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:01:01.122630 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:01:01.122630 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:01:01.122630 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:01:01.122630 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:01:01.122630 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:01:01.122630 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:01:01.122630 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:01:01.122630 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4832d86f-ddee-445e-8b26-fae015d901a4 could not be found. Oct 08 21:01:01.122630 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:01:01.122630 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:01:01.126195 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:01:01.126195 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:01:01.126195 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:01:01.126195 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:01:01.126195 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:01:01.126195 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:01:01.126195 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4832d86f-ddee-445e-8b26-fae015d901a4 could not be found. Oct 08 21:01:01.126195 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:01:01.138335 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-ec23ce9b-d937-42db-9987-ba0b2944c858 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Returning 404 to user: Instance 4832d86f-ddee-445e-8b26-fae015d901a4 could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:01:01.139500 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-ec23ce9b-d937-42db-9987-ba0b2944c858 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] 10.222.0.26 "GET /compute/v2.1/servers/4832d86f-ddee-445e-8b26-fae015d901a4" status: 404 len: 111 microversion: 2.1 time: 0.059698 Oct 08 21:01:01.140567 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1194/2353] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:01:01 2022] GET /compute/v2.1/servers/4832d86f-ddee-445e-8b26-fae015d901a4 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:01:01.146163 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-dbbd4d7e-9a40-476b-be96-7108a7853971 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:01.146984 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-dbbd4d7e-9a40-476b-be96-7108a7853971 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] [instance: 8ceaf7df-4795-4969-be16-a2a1b94a3fa6] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:01.154362 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dbbd4d7e-9a40-476b-be96-7108a7853971 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:01.155094 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dbbd4d7e-9a40-476b-be96-7108a7853971 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:01.155804 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dbbd4d7e-9a40-476b-be96-7108a7853971 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:01.156771 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dbbd4d7e-9a40-476b-be96-7108a7853971 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:01.157586 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dbbd4d7e-9a40-476b-be96-7108a7853971 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:01.158239 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dbbd4d7e-9a40-476b-be96-7108a7853971 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:01.181292 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-430e6da3-8a61-4e3e-a27e-2d527fad09ab tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06caf10b6fa43a3a2ad34858594e329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b10172715d423eb887d6c5b171defb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:01:01.188329 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-430e6da3-8a61-4e3e-a27e-2d527fad09ab tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] 10.222.0.26 "GET /compute/v2.1/servers/1510673d-866c-4e8c-9cb8-2dbc7f0a4115" status: 200 len: 1225 microversion: 2.1 time: 0.162527 Oct 08 21:01:01.193501 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1160/2354] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:01:01 2022] GET /compute/v2.1/servers/1510673d-866c-4e8c-9cb8-2dbc7f0a4115 => generated 1225 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:01:01.209073 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-4a473b55-b1cb-4909-a4dd-a12521cab384 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-392969786", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "networks": [{"uuid": "76f17cb4-51d3-49d9-9b79-ac48564ee791"}]}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:01:01.304176 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.network.neutron [None req-4a473b55-b1cb-4909-a4dd-a12521cab384 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] validate_networks() for [('76f17cb4-51d3-49d9-9b79-ac48564ee791', None, None, None, None, None)] {{(pid=140491) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 21:01:01.467386 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-dbbd4d7e-9a40-476b-be96-7108a7853971 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ddc3cd3c374bacbe5bf5e0877380e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8472b054404c46a99b81aba34d6b9f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:01:01.485570 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-dbbd4d7e-9a40-476b-be96-7108a7853971 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] 10.222.0.26 "GET /compute/v2.1/servers/8ceaf7df-4795-4969-be16-a2a1b94a3fa6" status: 200 len: 1473 microversion: 2.1 time: 0.339577 Oct 08 21:01:01.486402 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1195/2355] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:01:01 2022] GET /compute/v2.1/servers/8ceaf7df-4795-4969-be16-a2a1b94a3fa6 => generated 1473 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:01:01.502472 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-2d58d2c8-320b-40eb-b76d-200ca237f6f8 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:01.503230 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-2d58d2c8-320b-40eb-b76d-200ca237f6f8 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] [instance: 3622a27e-b943-49a7-8d81-a6f553c32f7a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:01.516254 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2d58d2c8-320b-40eb-b76d-200ca237f6f8 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:01.516765 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2d58d2c8-320b-40eb-b76d-200ca237f6f8 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:01.529387 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2d58d2c8-320b-40eb-b76d-200ca237f6f8 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:01.530317 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2d58d2c8-320b-40eb-b76d-200ca237f6f8 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:01.530811 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2d58d2c8-320b-40eb-b76d-200ca237f6f8 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:01.531267 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2d58d2c8-320b-40eb-b76d-200ca237f6f8 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:01.647357 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-2d58d2c8-320b-40eb-b76d-200ca237f6f8 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '463a3aac627c43d7af0dbc9facb52076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac791938e6384c8c8473ffd65cf867a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:01:01.657617 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-2d58d2c8-320b-40eb-b76d-200ca237f6f8 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] 10.222.0.26 "GET /compute/v2.1/servers/3622a27e-b943-49a7-8d81-a6f553c32f7a" status: 200 len: 1478 microversion: 2.1 time: 0.170249 Oct 08 21:01:01.659294 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1196/2356] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:01:01 2022] GET /compute/v2.1/servers/3622a27e-b943-49a7-8d81-a6f553c32f7a => generated 1478 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:01:01.671951 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e6309631-153b-4421-b5fe-e517ffcdb50e tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:01.672840 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-e6309631-153b-4421-b5fe-e517ffcdb50e tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] [instance: 9ed82ee0-e56e-478e-a066-bad43e760a03] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:01.680495 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e6309631-153b-4421-b5fe-e517ffcdb50e tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:01.681283 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e6309631-153b-4421-b5fe-e517ffcdb50e tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:01.681835 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e6309631-153b-4421-b5fe-e517ffcdb50e tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:01.682707 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e6309631-153b-4421-b5fe-e517ffcdb50e tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:01.683172 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e6309631-153b-4421-b5fe-e517ffcdb50e tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:01.683603 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e6309631-153b-4421-b5fe-e517ffcdb50e tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:01.907063 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-e6309631-153b-4421-b5fe-e517ffcdb50e tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c7aebdf00342b1ba80833663f8c0a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad3679a59b504731b5f56e52788fd645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:01:01.925591 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-e6309631-153b-4421-b5fe-e517ffcdb50e tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] 10.222.0.26 "GET /compute/v2.1/servers/9ed82ee0-e56e-478e-a066-bad43e760a03" status: 200 len: 1351 microversion: 2.1 time: 0.264700 Oct 08 21:01:01.927457 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1197/2357] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:01:01 2022] GET /compute/v2.1/servers/9ed82ee0-e56e-478e-a066-bad43e760a03 => generated 1351 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:01:01.939702 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-9440b769-35a6-482d-a97b-cb8919ddd281 req-9f3925f4-f4fc-4298-bdb7-efc907b64fcf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3622a27e-b943-49a7-8d81-a6f553c32f7a", "name": "network-vif-deleted", "tag": "7a99af98-17a8-4923-a5c9-ed888cca7f5a"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:01:01.950744 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-9440b769-35a6-482d-a97b-cb8919ddd281 req-9f3925f4-f4fc-4298-bdb7-efc907b64fcf service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:01.951845 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-9440b769-35a6-482d-a97b-cb8919ddd281 req-9f3925f4-f4fc-4298-bdb7-efc907b64fcf service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:01.952296 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-9440b769-35a6-482d-a97b-cb8919ddd281 req-9f3925f4-f4fc-4298-bdb7-efc907b64fcf service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:01.964819 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-9440b769-35a6-482d-a97b-cb8919ddd281 req-9f3925f4-f4fc-4298-bdb7-efc907b64fcf service nova] Creating event network-vif-deleted:7a99af98-17a8-4923-a5c9-ed888cca7f5a for instance 3622a27e-b943-49a7-8d81-a6f553c32f7a on nch1-master-1 Oct 08 21:01:01.969793 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-9440b769-35a6-482d-a97b-cb8919ddd281 req-9f3925f4-f4fc-4298-bdb7-efc907b64fcf service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040861 Oct 08 21:01:01.970400 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1198/2358] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:01:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:01:02.048756 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e8f29e0d-490c-41bb-8aef-9495857d9876 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:02.050575 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-e8f29e0d-490c-41bb-8aef-9495857d9876 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: 38b000d3-167b-4f7a-ab80-cd51fcb7cbaf] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:02.058214 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e8f29e0d-490c-41bb-8aef-9495857d9876 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:02.059072 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e8f29e0d-490c-41bb-8aef-9495857d9876 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:02.059975 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e8f29e0d-490c-41bb-8aef-9495857d9876 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:02.061172 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e8f29e0d-490c-41bb-8aef-9495857d9876 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:02.062078 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e8f29e0d-490c-41bb-8aef-9495857d9876 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:02.062749 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e8f29e0d-490c-41bb-8aef-9495857d9876 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:02.238239 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-e8f29e0d-490c-41bb-8aef-9495857d9876 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:01:02.247608 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-e8f29e0d-490c-41bb-8aef-9495857d9876 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/38b000d3-167b-4f7a-ab80-cd51fcb7cbaf" status: 200 len: 1471 microversion: 2.1 time: 0.204406 Oct 08 21:01:02.248188 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1199/2359] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:01:02 2022] GET /compute/v2.1/servers/38b000d3-167b-4f7a-ab80-cd51fcb7cbaf => generated 1471 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:01:02.253167 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-cd64f01d-abf6-4acf-b814-ad8046ab5a35 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:02.253985 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-cd64f01d-abf6-4acf-b814-ad8046ab5a35 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] [instance: 579b0f8b-ccae-4c2b-bb48-1da1aaf6a138] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:02.259949 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cd64f01d-abf6-4acf-b814-ad8046ab5a35 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:02.260441 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cd64f01d-abf6-4acf-b814-ad8046ab5a35 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:02.260981 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cd64f01d-abf6-4acf-b814-ad8046ab5a35 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:02.261744 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cd64f01d-abf6-4acf-b814-ad8046ab5a35 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:02.262201 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cd64f01d-abf6-4acf-b814-ad8046ab5a35 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:02.262831 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cd64f01d-abf6-4acf-b814-ad8046ab5a35 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:02.285116 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-4a473b55-b1cb-4909-a4dd-a12521cab384 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Flavor limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 21:01:02.285629 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-4a473b55-b1cb-4909-a4dd-a12521cab384 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Image limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 21:01:02.286183 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-4a473b55-b1cb-4909-a4dd-a12521cab384 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Flavor pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 21:01:02.286610 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-4a473b55-b1cb-4909-a4dd-a12521cab384 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Image pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 21:01:02.287034 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-4a473b55-b1cb-4909-a4dd-a12521cab384 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 21:01:02.296936 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4a473b55-b1cb-4909-a4dd-a12521cab384 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:02.297463 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4a473b55-b1cb-4909-a4dd-a12521cab384 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:02.297912 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4a473b55-b1cb-4909-a4dd-a12521cab384 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:02.298657 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4a473b55-b1cb-4909-a4dd-a12521cab384 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:02.299121 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4a473b55-b1cb-4909-a4dd-a12521cab384 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:02.299554 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4a473b55-b1cb-4909-a4dd-a12521cab384 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:02.320478 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-4a473b55-b1cb-4909-a4dd-a12521cab384 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Getting quotas for project e191d6217f024a17a14184071ac674c7. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:01:02.327677 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-4a473b55-b1cb-4909-a4dd-a12521cab384 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Getting quotas for user 3d2ddfa343e748c089129b0039a12ac0 and project e191d6217f024a17a14184071ac674c7. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:01:02.343404 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-4a473b55-b1cb-4909-a4dd-a12521cab384 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Going to run 1 instances... {{(pid=140491) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 21:01:02.346154 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-4a473b55-b1cb-4909-a4dd-a12521cab384 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] [instance: c7527526-138f-45ff-8efc-8802410df8eb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c508bd7f-7db9-4b2c-af7c-be54a855c355',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140491) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 21:01:02.402113 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-4a473b55-b1cb-4909-a4dd-a12521cab384 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.207246 Oct 08 21:01:02.403415 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1161/2360] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 21:01:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1209 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 08 21:01:02.408563 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-03e2b635-ec21-4643-bf36-d0526c5bc191 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:02.409532 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-03e2b635-ec21-4643-bf36-d0526c5bc191 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] [instance: 1510673d-866c-4e8c-9cb8-2dbc7f0a4115] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:02.422172 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-03e2b635-ec21-4643-bf36-d0526c5bc191 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:02.422962 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-03e2b635-ec21-4643-bf36-d0526c5bc191 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:02.423597 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-03e2b635-ec21-4643-bf36-d0526c5bc191 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:02.424660 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-03e2b635-ec21-4643-bf36-d0526c5bc191 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:02.425726 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-03e2b635-ec21-4643-bf36-d0526c5bc191 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:02.426379 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-03e2b635-ec21-4643-bf36-d0526c5bc191 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:02.487399 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-cd64f01d-abf6-4acf-b814-ad8046ab5a35 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1698dee4a2bf4ea19a6ee0c3d5cb5c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b00ee5e7828469f95bd90548d35982a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:01:02.507633 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-cd64f01d-abf6-4acf-b814-ad8046ab5a35 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] 10.222.0.26 "GET /compute/v2.1/servers/579b0f8b-ccae-4c2b-bb48-1da1aaf6a138" status: 200 len: 1523 microversion: 2.1 time: 0.258126 Oct 08 21:01:02.508412 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1200/2361] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:01:02 2022] GET /compute/v2.1/servers/579b0f8b-ccae-4c2b-bb48-1da1aaf6a138 => generated 1523 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:01:02.513793 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-268ce688-39f9-4ab9-bdde-fd3e4c8d520e req-8742eb42-1d10-4cb9-915d-7568c196f87f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ceaf7df-4795-4969-be16-a2a1b94a3fa6", "name": "network-vif-deleted", "tag": "d52f6b6f-09bf-466a-abab-fe4533f27ab5"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:01:02.530086 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-268ce688-39f9-4ab9-bdde-fd3e4c8d520e req-8742eb42-1d10-4cb9-915d-7568c196f87f service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:02.533943 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-268ce688-39f9-4ab9-bdde-fd3e4c8d520e req-8742eb42-1d10-4cb9-915d-7568c196f87f service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:02.534442 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-268ce688-39f9-4ab9-bdde-fd3e4c8d520e req-8742eb42-1d10-4cb9-915d-7568c196f87f service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:02.548992 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-03e2b635-ec21-4643-bf36-d0526c5bc191 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06caf10b6fa43a3a2ad34858594e329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b10172715d423eb887d6c5b171defb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:01:02.565482 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-03e2b635-ec21-4643-bf36-d0526c5bc191 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] 10.222.0.26 "GET /compute/v2.1/servers/1510673d-866c-4e8c-9cb8-2dbc7f0a4115" status: 200 len: 1277 microversion: 2.1 time: 0.154119 Oct 08 21:01:02.566460 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1162/2362] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:01:02 2022] GET /compute/v2.1/servers/1510673d-866c-4e8c-9cb8-2dbc7f0a4115 => generated 1277 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:01:02.571703 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-1fce5e16-922d-459b-85af-5a84db7d95ee tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:02.574900 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-1fce5e16-922d-459b-85af-5a84db7d95ee tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] [instance: c7527526-138f-45ff-8efc-8802410df8eb] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:02.575753 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-268ce688-39f9-4ab9-bdde-fd3e4c8d520e req-8742eb42-1d10-4cb9-915d-7568c196f87f service nova] Creating event network-vif-deleted:d52f6b6f-09bf-466a-abab-fe4533f27ab5 for instance 8ceaf7df-4795-4969-be16-a2a1b94a3fa6 on nch1-master-1 Oct 08 21:01:02.584333 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-268ce688-39f9-4ab9-bdde-fd3e4c8d520e req-8742eb42-1d10-4cb9-915d-7568c196f87f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074541 Oct 08 21:01:02.590135 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1201/2363] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:01:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:01:02.597320 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-5d1cd5dd-3c47-4b71-bc8d-6a2087edc4c3 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:02.598043 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-5d1cd5dd-3c47-4b71-bc8d-6a2087edc4c3 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] [instance: 8ceaf7df-4795-4969-be16-a2a1b94a3fa6] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:02.605751 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5d1cd5dd-3c47-4b71-bc8d-6a2087edc4c3 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:02.606257 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5d1cd5dd-3c47-4b71-bc8d-6a2087edc4c3 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:02.606876 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5d1cd5dd-3c47-4b71-bc8d-6a2087edc4c3 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:02.607609 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5d1cd5dd-3c47-4b71-bc8d-6a2087edc4c3 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:02.608371 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5d1cd5dd-3c47-4b71-bc8d-6a2087edc4c3 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:02.608574 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5d1cd5dd-3c47-4b71-bc8d-6a2087edc4c3 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:02.675378 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-1fce5e16-922d-459b-85af-5a84db7d95ee tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d2ddfa343e748c089129b0039a12ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e191d6217f024a17a14184071ac674c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:01:02.684818 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-1fce5e16-922d-459b-85af-5a84db7d95ee tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] 10.222.0.26 "GET /compute/v2.1/servers/c7527526-138f-45ff-8efc-8802410df8eb" status: 200 len: 1217 microversion: 2.1 time: 0.117078 Oct 08 21:01:02.686214 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1163/2364] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:01:02 2022] GET /compute/v2.1/servers/c7527526-138f-45ff-8efc-8802410df8eb => generated 1217 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:01:02.692989 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-89eaf514-c053-43ba-81b0-18372db13f60 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:02.693925 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-89eaf514-c053-43ba-81b0-18372db13f60 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] [instance: 3622a27e-b943-49a7-8d81-a6f553c32f7a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:02.701897 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-89eaf514-c053-43ba-81b0-18372db13f60 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:02.702825 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-89eaf514-c053-43ba-81b0-18372db13f60 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:02.703459 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-89eaf514-c053-43ba-81b0-18372db13f60 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:02.704431 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-89eaf514-c053-43ba-81b0-18372db13f60 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:02.705418 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-89eaf514-c053-43ba-81b0-18372db13f60 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:02.706175 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-89eaf514-c053-43ba-81b0-18372db13f60 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:02.805899 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-89eaf514-c053-43ba-81b0-18372db13f60 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:02.806877 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-89eaf514-c053-43ba-81b0-18372db13f60 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:02.808199 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-89eaf514-c053-43ba-81b0-18372db13f60 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:02.809137 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.objects.instance [None req-89eaf514-c053-43ba-81b0-18372db13f60 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lazy-loading 'fault' on Instance uuid 3622a27e-b943-49a7-8d81-a6f553c32f7a {{(pid=140491) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 21:01:02.822241 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-5d1cd5dd-3c47-4b71-bc8d-6a2087edc4c3 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ddc3cd3c374bacbe5bf5e0877380e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8472b054404c46a99b81aba34d6b9f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:01:02.836188 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-5d1cd5dd-3c47-4b71-bc8d-6a2087edc4c3 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] 10.222.0.26 "GET /compute/v2.1/servers/8ceaf7df-4795-4969-be16-a2a1b94a3fa6" status: 200 len: 1302 microversion: 2.1 time: 0.244561 Oct 08 21:01:02.842107 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1202/2365] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:01:02 2022] GET /compute/v2.1/servers/8ceaf7df-4795-4969-be16-a2a1b94a3fa6 => generated 1302 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:01:02.884063 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-89eaf514-c053-43ba-81b0-18372db13f60 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '463a3aac627c43d7af0dbc9facb52076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac791938e6384c8c8473ffd65cf867a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:01:02.906508 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-89eaf514-c053-43ba-81b0-18372db13f60 tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] 10.222.0.26 "GET /compute/v2.1/servers/3622a27e-b943-49a7-8d81-a6f553c32f7a" status: 200 len: 1312 microversion: 2.1 time: 0.218936 Oct 08 21:01:02.907883 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1164/2366] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:01:02 2022] GET /compute/v2.1/servers/3622a27e-b943-49a7-8d81-a6f553c32f7a => generated 1312 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:01:02.954073 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-4f1ffb0a-6ed5-4192-acc8-ca283a086f68 tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:02.954936 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-4f1ffb0a-6ed5-4192-acc8-ca283a086f68 tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] [instance: 9ed82ee0-e56e-478e-a066-bad43e760a03] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:02.965341 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4f1ffb0a-6ed5-4192-acc8-ca283a086f68 tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:02.965850 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4f1ffb0a-6ed5-4192-acc8-ca283a086f68 tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:02.966298 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4f1ffb0a-6ed5-4192-acc8-ca283a086f68 tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:02.967027 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4f1ffb0a-6ed5-4192-acc8-ca283a086f68 tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:02.967497 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4f1ffb0a-6ed5-4192-acc8-ca283a086f68 tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:02.967935 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4f1ffb0a-6ed5-4192-acc8-ca283a086f68 tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:02.978548 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=100 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:01:03.202382 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-4f1ffb0a-6ed5-4192-acc8-ca283a086f68 tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c7aebdf00342b1ba80833663f8c0a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad3679a59b504731b5f56e52788fd645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:01:03.211267 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-4f1ffb0a-6ed5-4192-acc8-ca283a086f68 tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] 10.222.0.26 "GET /compute/v2.1/servers/9ed82ee0-e56e-478e-a066-bad43e760a03" status: 200 len: 1351 microversion: 2.1 time: 0.265406 Oct 08 21:01:03.211848 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1203/2367] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:01:02 2022] GET /compute/v2.1/servers/9ed82ee0-e56e-478e-a066-bad43e760a03 => generated 1351 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:01:03.272104 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-13228e1c-0440-4a0d-bb2f-d2acf636e158 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:03.273613 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-13228e1c-0440-4a0d-bb2f-d2acf636e158 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: 38b000d3-167b-4f7a-ab80-cd51fcb7cbaf] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:03.284804 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-13228e1c-0440-4a0d-bb2f-d2acf636e158 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:03.285638 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-13228e1c-0440-4a0d-bb2f-d2acf636e158 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:03.287066 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-13228e1c-0440-4a0d-bb2f-d2acf636e158 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:03.288318 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-13228e1c-0440-4a0d-bb2f-d2acf636e158 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:03.289091 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-13228e1c-0440-4a0d-bb2f-d2acf636e158 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:03.290044 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-13228e1c-0440-4a0d-bb2f-d2acf636e158 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:03.535530 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-037111f8-368a-4401-8c3b-8fedbebc8c1f tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:03.535795 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-037111f8-368a-4401-8c3b-8fedbebc8c1f tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] [instance: 579b0f8b-ccae-4c2b-bb48-1da1aaf6a138] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:03.544150 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-037111f8-368a-4401-8c3b-8fedbebc8c1f tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:03.545260 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-037111f8-368a-4401-8c3b-8fedbebc8c1f tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:03.546538 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-037111f8-368a-4401-8c3b-8fedbebc8c1f tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:03.546740 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-037111f8-368a-4401-8c3b-8fedbebc8c1f tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:03.547250 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-037111f8-368a-4401-8c3b-8fedbebc8c1f tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:03.547669 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-037111f8-368a-4401-8c3b-8fedbebc8c1f tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:03.572958 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-13228e1c-0440-4a0d-bb2f-d2acf636e158 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:01:03.585800 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-13228e1c-0440-4a0d-bb2f-d2acf636e158 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/38b000d3-167b-4f7a-ab80-cd51fcb7cbaf" status: 200 len: 1471 microversion: 2.1 time: 0.318887 Oct 08 21:01:03.586384 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1165/2368] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:01:03 2022] GET /compute/v2.1/servers/38b000d3-167b-4f7a-ab80-cd51fcb7cbaf => generated 1471 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:01:03.598819 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-76b117c4-741e-4e5a-b2cd-876bf0405419 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:03.600704 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-76b117c4-741e-4e5a-b2cd-876bf0405419 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] [instance: 1510673d-866c-4e8c-9cb8-2dbc7f0a4115] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:03.613684 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-76b117c4-741e-4e5a-b2cd-876bf0405419 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:03.614728 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-76b117c4-741e-4e5a-b2cd-876bf0405419 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:03.615596 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-76b117c4-741e-4e5a-b2cd-876bf0405419 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:03.617407 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-76b117c4-741e-4e5a-b2cd-876bf0405419 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:03.618321 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-76b117c4-741e-4e5a-b2cd-876bf0405419 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:03.618970 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-76b117c4-741e-4e5a-b2cd-876bf0405419 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:03.848055 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-037111f8-368a-4401-8c3b-8fedbebc8c1f tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1698dee4a2bf4ea19a6ee0c3d5cb5c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b00ee5e7828469f95bd90548d35982a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:01:03.865321 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-037111f8-368a-4401-8c3b-8fedbebc8c1f tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] 10.222.0.26 "GET /compute/v2.1/servers/579b0f8b-ccae-4c2b-bb48-1da1aaf6a138" status: 200 len: 1503 microversion: 2.1 time: 0.333984 Oct 08 21:01:03.867560 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1204/2369] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:01:03 2022] GET /compute/v2.1/servers/579b0f8b-ccae-4c2b-bb48-1da1aaf6a138 => generated 1503 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:01:03.868463 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-76b117c4-741e-4e5a-b2cd-876bf0405419 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06caf10b6fa43a3a2ad34858594e329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b10172715d423eb887d6c5b171defb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:01:03.874211 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-77d7691b-dade-4ea3-99cb-70b9b197e147 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:03.874910 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-77d7691b-dade-4ea3-99cb-70b9b197e147 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] [instance: c7527526-138f-45ff-8efc-8802410df8eb] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:03.881821 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-76b117c4-741e-4e5a-b2cd-876bf0405419 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] 10.222.0.26 "GET /compute/v2.1/servers/1510673d-866c-4e8c-9cb8-2dbc7f0a4115" status: 200 len: 1325 microversion: 2.1 time: 0.290874 Oct 08 21:01:03.883515 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1166/2370] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:01:03 2022] GET /compute/v2.1/servers/1510673d-866c-4e8c-9cb8-2dbc7f0a4115 => generated 1325 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:01:03.893153 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c0c56c87-0f59-4d5d-ba0a-b67e48af2230 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:03.896539 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-c0c56c87-0f59-4d5d-ba0a-b67e48af2230 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] [instance: 8ceaf7df-4795-4969-be16-a2a1b94a3fa6] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:03.902823 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-77d7691b-dade-4ea3-99cb-70b9b197e147 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:03.903404 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-77d7691b-dade-4ea3-99cb-70b9b197e147 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:03.903916 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-77d7691b-dade-4ea3-99cb-70b9b197e147 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:03.904689 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-77d7691b-dade-4ea3-99cb-70b9b197e147 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:03.905174 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-77d7691b-dade-4ea3-99cb-70b9b197e147 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:03.905679 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-77d7691b-dade-4ea3-99cb-70b9b197e147 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:03.906778 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c0c56c87-0f59-4d5d-ba0a-b67e48af2230 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:03.907331 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c0c56c87-0f59-4d5d-ba0a-b67e48af2230 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:03.908017 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c0c56c87-0f59-4d5d-ba0a-b67e48af2230 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:03.908892 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c0c56c87-0f59-4d5d-ba0a-b67e48af2230 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:03.909538 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c0c56c87-0f59-4d5d-ba0a-b67e48af2230 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:03.910141 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c0c56c87-0f59-4d5d-ba0a-b67e48af2230 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:03.938183 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:01:03.961000 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c0c56c87-0f59-4d5d-ba0a-b67e48af2230 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:03.961535 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c0c56c87-0f59-4d5d-ba0a-b67e48af2230 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:03.966917 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c0c56c87-0f59-4d5d-ba0a-b67e48af2230 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:03.967499 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.objects.instance [None req-c0c56c87-0f59-4d5d-ba0a-b67e48af2230 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lazy-loading 'fault' on Instance uuid 8ceaf7df-4795-4969-be16-a2a1b94a3fa6 {{(pid=140491) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 21:01:04.048895 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-c0c56c87-0f59-4d5d-ba0a-b67e48af2230 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ddc3cd3c374bacbe5bf5e0877380e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8472b054404c46a99b81aba34d6b9f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:01:04.058477 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-c0c56c87-0f59-4d5d-ba0a-b67e48af2230 tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] 10.222.0.26 "GET /compute/v2.1/servers/8ceaf7df-4795-4969-be16-a2a1b94a3fa6" status: 200 len: 1307 microversion: 2.1 time: 0.173397 Oct 08 21:01:04.059082 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1167/2371] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:01:03 2022] GET /compute/v2.1/servers/8ceaf7df-4795-4969-be16-a2a1b94a3fa6 => generated 1307 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:01:04.063781 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-23f5aeda-c3ce-40d1-8fe0-5548cb3495cf tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8867601a-3418-4e8c-baf2-da1a50e3ef73"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:01:04.075159 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-23f5aeda-c3ce-40d1-8fe0-5548cb3495cf tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] [instance: 579b0f8b-ccae-4c2b-bb48-1da1aaf6a138] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:04.085753 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-23f5aeda-c3ce-40d1-8fe0-5548cb3495cf tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:04.086921 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-23f5aeda-c3ce-40d1-8fe0-5548cb3495cf tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:04.088476 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-23f5aeda-c3ce-40d1-8fe0-5548cb3495cf tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:04.089791 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-23f5aeda-c3ce-40d1-8fe0-5548cb3495cf tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:04.090728 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-23f5aeda-c3ce-40d1-8fe0-5548cb3495cf tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:04.091404 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-23f5aeda-c3ce-40d1-8fe0-5548cb3495cf tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:04.124528 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-77d7691b-dade-4ea3-99cb-70b9b197e147 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d2ddfa343e748c089129b0039a12ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e191d6217f024a17a14184071ac674c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:01:04.133041 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-77d7691b-dade-4ea3-99cb-70b9b197e147 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] 10.222.0.26 "GET /compute/v2.1/servers/c7527526-138f-45ff-8efc-8802410df8eb" status: 200 len: 1269 microversion: 2.1 time: 0.264384 Oct 08 21:01:04.133667 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1205/2372] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:01:03 2022] GET /compute/v2.1/servers/c7527526-138f-45ff-8efc-8802410df8eb => generated 1269 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:01:04.143231 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-23f5aeda-c3ce-40d1-8fe0-5548cb3495cf tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] HTTP exception thrown: Cannot 'attach_volume' instance 579b0f8b-ccae-4c2b-bb48-1da1aaf6a138 while it is in vm_state rescued Oct 08 21:01:04.145313 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-dadfb185-4169-4d0d-a6e9-5a5514492d6a tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:04.147591 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-23f5aeda-c3ce-40d1-8fe0-5548cb3495cf tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Request method failure captured: Oct 08 21:01:04.147591 ncdv-master-1 devstack@n-api.service[140491]: request: POST /compute/v2.1/servers/579b0f8b-ccae-4c2b-bb48-1da1aaf6a138/os-volume_attachments HTTP/1.1 Oct 08 21:01:04.147591 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:01:04.147591 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:01:04.147591 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:01:04.147591 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 74 Oct 08 21:01:04.147591 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:01:04.147591 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:01:04.147591 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:01:04.147591 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:01:04.147591 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeS0fE1W4PvU2_7k8u76nOm9Y1zh9DtzN6SifZox8c4Ee-O4iYj3CcpXLLEG93O-SwetyStVJsCOhK1z0DAluVdyejBt-R2ozc-SxCa3q7lzUNWL-Kx89hV0cNzOobKFM-EJsBUodFQ4EWnFtqD_Q-5HZD9KoD2jZ3YWHd3RuK5iGsY Oct 08 21:01:04.147591 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:01:04.147591 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:01:04.147591 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:01:04.147591 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:01:04.147591 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:01:04.147591 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:01:04.147591 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 8b00ee5e7828469f95bd90548d35982a Oct 08 21:01:04.147591 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1823882791 Oct 08 21:01:04.147591 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:01:04.147591 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:01:04.147591 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8b00ee5e7828469f95bd90548d35982a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8b00ee5e7828469f95bd90548d35982a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8b00ee5e7828469f95bd90548d35982a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8b00ee5e7828469f95bd90548d35982a"}]}] Oct 08 21:01:04.147591 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1823882791 Oct 08 21:01:04.147591 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 8b00ee5e7828469f95bd90548d35982a Oct 08 21:01:04.147591 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1823882791 Oct 08 21:01:04.147591 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-ServerRescueNegativeTestJSON-1823882791-project Oct 08 21:01:04.147591 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:01:04.147591 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:01:04.147591 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 1698dee4a2bf4ea19a6ee0c3d5cb5c09 Oct 08 21:01:04.147591 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1823882791-project Oct 08 21:01:04.147591 ncdv-master-1 devstack@n-api.service[140491]: Oct 08 21:01:04.147591 ncdv-master-1 devstack@n-api.service[140491]: {"volumeAttachment": {"volumeId": "8867601a-3418-4e8c-baf2-da1a50e3ef73"}} Oct 08 21:01:04.147591 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:01:04.147591 ncdv-master-1 devstack@n-api.service[140491]: exception: Cannot 'attach_volume' instance 579b0f8b-ccae-4c2b-bb48-1da1aaf6a138 while it is in vm_state rescued Oct 08 21:01:04.147591 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'server_id': '579b0f8b-ccae-4c2b-bb48-1da1aaf6a138', 'body': {'volumeAttachment': {'volumeId': '8867601a-3418-4e8c-baf2-da1a50e3ef73'}}} Oct 08 21:01:04.147591 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:01:04.147591 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:01:04.147591 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 08 21:01:04.147591 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 08 21:01:04.147591 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 08 21:01:04.147591 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 08 21:01:04.147591 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 08 21:01:04.147591 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 08 21:01:04.147591 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 579b0f8b-ccae-4c2b-bb48-1da1aaf6a138 in vm_state rescued. Cannot attach_volume while the instance is in this state. Oct 08 21:01:04.147591 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:01:04.147591 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:01:04.147591 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:01:04.147591 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:01:04.147591 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:01:04.147591 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:01:04.147591 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:01:04.147591 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:01:04.147591 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:01:04.147591 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:01:04.147591 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 21:01:04.147591 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 21:01:04.147591 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 21:01:04.147591 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 21:01:04.147591 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 21:01:04.147591 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 21:01:04.147591 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Oct 08 21:01:04.147591 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 08 21:01:04.151652 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 08 21:01:04.151652 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 08 21:01:04.151652 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 579b0f8b-ccae-4c2b-bb48-1da1aaf6a138 while it is in vm_state rescued Oct 08 21:01:04.151652 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:01:04.151652 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:01:04.151652 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:01:04.151652 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:01:04.151652 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:01:04.151652 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:01:04.151652 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:01:04.151652 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:01:04.151652 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 579b0f8b-ccae-4c2b-bb48-1da1aaf6a138 while it is in vm_state rescued Oct 08 21:01:04.151652 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:01:04.151652 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-23f5aeda-c3ce-40d1-8fe0-5548cb3495cf tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Returning 409 to user: Cannot 'attach_volume' instance 579b0f8b-ccae-4c2b-bb48-1da1aaf6a138 while it is in vm_state rescued {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:01:04.151652 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-23f5aeda-c3ce-40d1-8fe0-5548cb3495cf tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] 10.222.0.26 "POST /compute/v2.1/servers/579b0f8b-ccae-4c2b-bb48-1da1aaf6a138/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.089021 Oct 08 21:01:04.153853 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-dadfb185-4169-4d0d-a6e9-5a5514492d6a tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] [instance: 3622a27e-b943-49a7-8d81-a6f553c32f7a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:04.154928 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1168/2373] 10.222.0.26 () {60 vars in 1323 bytes} [Sat Oct 8 21:01:04 2022] POST /compute/v2.1/servers/579b0f8b-ccae-4c2b-bb48-1da1aaf6a138/os-volume_attachments => generated 152 bytes in 95 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 08 21:01:04.163044 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-4d80eca1-0e7e-4c19-acb3-abd9071005d4 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:01:04.163668 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-4d80eca1-0e7e-4c19-acb3-abd9071005d4 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] [instance: 579b0f8b-ccae-4c2b-bb48-1da1aaf6a138] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:04.166733 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dadfb185-4169-4d0d-a6e9-5a5514492d6a tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:04.169750 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dadfb185-4169-4d0d-a6e9-5a5514492d6a tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:04.170516 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dadfb185-4169-4d0d-a6e9-5a5514492d6a tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:04.171488 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dadfb185-4169-4d0d-a6e9-5a5514492d6a tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:04.172196 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dadfb185-4169-4d0d-a6e9-5a5514492d6a tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:04.172893 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4d80eca1-0e7e-4c19-acb3-abd9071005d4 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:04.173011 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dadfb185-4169-4d0d-a6e9-5a5514492d6a tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:04.173423 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4d80eca1-0e7e-4c19-acb3-abd9071005d4 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:04.173955 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4d80eca1-0e7e-4c19-acb3-abd9071005d4 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:04.174672 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4d80eca1-0e7e-4c19-acb3-abd9071005d4 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:04.175130 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4d80eca1-0e7e-4c19-acb3-abd9071005d4 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:04.175595 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4d80eca1-0e7e-4c19-acb3-abd9071005d4 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:04.199501 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-dadfb185-4169-4d0d-a6e9-5a5514492d6a tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] HTTP exception thrown: Instance 3622a27e-b943-49a7-8d81-a6f553c32f7a could not be found. Oct 08 21:01:04.201559 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-dadfb185-4169-4d0d-a6e9-5a5514492d6a tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Request method failure captured: Oct 08 21:01:04.201559 ncdv-master-1 devstack@n-api.service[140492]: request: GET /compute/v2.1/servers/3622a27e-b943-49a7-8d81-a6f553c32f7a HTTP/1.1 Oct 08 21:01:04.201559 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:01:04.201559 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:01:04.201559 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:01:04.201559 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 21:01:04.201559 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:01:04.201559 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:01:04.201559 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:01:04.201559 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:01:04.201559 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeTgs6u98Kj2qNeUbhNZytTz3QZl3npCYhXvqzJPAHZJSisgyrybjMBWF-fdPl_tWpGYuTI6Puj6PawUImfVDEBxcbmulm9uh4lstHlNST7jgnukdD8WC74LVcFesaNP8PWq7Fzl1J3ZhXvWqEYDTsN6hHueqzcw9I-JZ0vsP9wgdik Oct 08 21:01:04.201559 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:01:04.201559 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:01:04.201559 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:01:04.201559 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:01:04.201559 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:01:04.201559 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:01:04.201559 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: ac791938e6384c8c8473ffd65cf867a8 Oct 08 21:01:04.201559 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-ListServersNegativeTestJSON-1263442127 Oct 08 21:01:04.201559 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:01:04.201559 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:01:04.201559 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ac791938e6384c8c8473ffd65cf867a8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ac791938e6384c8c8473ffd65cf867a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ac791938e6384c8c8473ffd65cf867a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ac791938e6384c8c8473ffd65cf867a8"}]}] Oct 08 21:01:04.201559 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-ListServersNegativeTestJSON-1263442127 Oct 08 21:01:04.201559 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: ac791938e6384c8c8473ffd65cf867a8 Oct 08 21:01:04.201559 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1263442127 Oct 08 21:01:04.201559 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-ListServersNegativeTestJSON-1263442127-project Oct 08 21:01:04.201559 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:01:04.201559 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:01:04.201559 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 463a3aac627c43d7af0dbc9facb52076 Oct 08 21:01:04.201559 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-ListServersNegativeTestJSON-1263442127-project Oct 08 21:01:04.201559 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 21:01:04.201559 ncdv-master-1 devstack@n-api.service[140492]: exception: Instance 3622a27e-b943-49a7-8d81-a6f553c32f7a could not be found. Oct 08 21:01:04.201559 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': '3622a27e-b943-49a7-8d81-a6f553c32f7a'} Oct 08 21:01:04.201559 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:01:04.201559 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:01:04.201559 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:01:04.201559 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:01:04.201559 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:01:04.201559 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:01:04.201559 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:01:04.201559 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:01:04.201559 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:01:04.201559 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:01:04.201559 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3622a27e-b943-49a7-8d81-a6f553c32f7a could not be found. Oct 08 21:01:04.201559 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:01:04.201559 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:01:04.201559 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:01:04.201559 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:01:04.201559 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:01:04.201559 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:01:04.201559 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:01:04.201559 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:01:04.201559 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:01:04.201559 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:01:04.201559 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:01:04.201559 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:01:04.201559 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:01:04.201559 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:01:04.201559 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:01:04.201559 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:01:04.201559 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3622a27e-b943-49a7-8d81-a6f553c32f7a could not be found. Oct 08 21:01:04.201559 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:01:04.201559 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:01:04.204949 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:01:04.204949 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:01:04.204949 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:01:04.204949 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:01:04.204949 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:01:04.204949 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:01:04.204949 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3622a27e-b943-49a7-8d81-a6f553c32f7a could not be found. Oct 08 21:01:04.204949 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:01:04.204949 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-dadfb185-4169-4d0d-a6e9-5a5514492d6a tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] Returning 404 to user: Instance 3622a27e-b943-49a7-8d81-a6f553c32f7a could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:01:04.204949 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-dadfb185-4169-4d0d-a6e9-5a5514492d6a tempest-ListServersNegativeTestJSON-1263442127 tempest-ListServersNegativeTestJSON-1263442127-project] 10.222.0.26 "GET /compute/v2.1/servers/3622a27e-b943-49a7-8d81-a6f553c32f7a" status: 404 len: 111 microversion: 2.1 time: 0.064307 Oct 08 21:01:04.207235 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1206/2374] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:01:04 2022] GET /compute/v2.1/servers/3622a27e-b943-49a7-8d81-a6f553c32f7a => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:01:04.235752 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-364ec368-114c-479d-ace3-944b7002254a tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:04.236720 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-364ec368-114c-479d-ace3-944b7002254a tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] [instance: 9ed82ee0-e56e-478e-a066-bad43e760a03] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:04.244361 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-364ec368-114c-479d-ace3-944b7002254a tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:04.245555 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-364ec368-114c-479d-ace3-944b7002254a tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:04.246526 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-364ec368-114c-479d-ace3-944b7002254a tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:04.247750 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-364ec368-114c-479d-ace3-944b7002254a tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:04.248657 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-364ec368-114c-479d-ace3-944b7002254a tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:04.249445 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-364ec368-114c-479d-ace3-944b7002254a tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:04.275816 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-4d80eca1-0e7e-4c19-acb3-abd9071005d4 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] 10.222.0.26 "POST /compute/v2.1/servers/579b0f8b-ccae-4c2b-bb48-1da1aaf6a138/action" status: 202 len: 0 microversion: 2.1 time: 0.117509 Oct 08 21:01:04.277802 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1169/2375] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:01:04 2022] POST /compute/v2.1/servers/579b0f8b-ccae-4c2b-bb48-1da1aaf6a138/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 21:01:04.291101 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c702aca7-bb9a-489f-8d0e-05b9f80d1f88 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:04.293055 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-c702aca7-bb9a-489f-8d0e-05b9f80d1f88 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] [instance: 579b0f8b-ccae-4c2b-bb48-1da1aaf6a138] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:04.302805 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c702aca7-bb9a-489f-8d0e-05b9f80d1f88 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:04.303947 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c702aca7-bb9a-489f-8d0e-05b9f80d1f88 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:04.304482 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c702aca7-bb9a-489f-8d0e-05b9f80d1f88 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:04.305422 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c702aca7-bb9a-489f-8d0e-05b9f80d1f88 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:04.305997 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c702aca7-bb9a-489f-8d0e-05b9f80d1f88 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:04.306593 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c702aca7-bb9a-489f-8d0e-05b9f80d1f88 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:04.578020 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-364ec368-114c-479d-ace3-944b7002254a tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c7aebdf00342b1ba80833663f8c0a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad3679a59b504731b5f56e52788fd645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:01:04.589581 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-364ec368-114c-479d-ace3-944b7002254a tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] 10.222.0.26 "GET /compute/v2.1/servers/9ed82ee0-e56e-478e-a066-bad43e760a03" status: 200 len: 1351 microversion: 2.1 time: 0.356875 Oct 08 21:01:04.590764 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1207/2376] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:01:04 2022] GET /compute/v2.1/servers/9ed82ee0-e56e-478e-a066-bad43e760a03 => generated 1351 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:01:04.611474 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-056dd604-e146-4184-9723-181de99d42ef tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:04.612498 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-056dd604-e146-4184-9723-181de99d42ef tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: 38b000d3-167b-4f7a-ab80-cd51fcb7cbaf] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:04.621517 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-056dd604-e146-4184-9723-181de99d42ef tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:04.622121 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-056dd604-e146-4184-9723-181de99d42ef tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:04.622675 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-056dd604-e146-4184-9723-181de99d42ef tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:04.623473 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-056dd604-e146-4184-9723-181de99d42ef tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:04.624061 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-056dd604-e146-4184-9723-181de99d42ef tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:04.625027 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-056dd604-e146-4184-9723-181de99d42ef tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:04.964795 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-056dd604-e146-4184-9723-181de99d42ef tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:01:04.977637 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-056dd604-e146-4184-9723-181de99d42ef tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/38b000d3-167b-4f7a-ab80-cd51fcb7cbaf" status: 200 len: 1471 microversion: 2.1 time: 0.370315 Oct 08 21:01:04.978232 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1208/2377] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:01:04 2022] GET /compute/v2.1/servers/38b000d3-167b-4f7a-ab80-cd51fcb7cbaf => generated 1471 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:01:04.984538 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-0588f9e4-b0ff-42a0-b5e4-c898eee47c19 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:04.985403 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-0588f9e4-b0ff-42a0-b5e4-c898eee47c19 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] [instance: 1510673d-866c-4e8c-9cb8-2dbc7f0a4115] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:04.992144 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0588f9e4-b0ff-42a0-b5e4-c898eee47c19 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:04.993307 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0588f9e4-b0ff-42a0-b5e4-c898eee47c19 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:04.993924 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0588f9e4-b0ff-42a0-b5e4-c898eee47c19 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:04.994851 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0588f9e4-b0ff-42a0-b5e4-c898eee47c19 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:04.996194 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0588f9e4-b0ff-42a0-b5e4-c898eee47c19 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:04.996635 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0588f9e4-b0ff-42a0-b5e4-c898eee47c19 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:05.027557 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-c702aca7-bb9a-489f-8d0e-05b9f80d1f88 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1698dee4a2bf4ea19a6ee0c3d5cb5c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b00ee5e7828469f95bd90548d35982a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:01:05.037964 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-c702aca7-bb9a-489f-8d0e-05b9f80d1f88 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] 10.222.0.26 "GET /compute/v2.1/servers/579b0f8b-ccae-4c2b-bb48-1da1aaf6a138" status: 200 len: 1511 microversion: 2.1 time: 0.752861 Oct 08 21:01:05.055059 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1170/2378] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:01:04 2022] GET /compute/v2.1/servers/579b0f8b-ccae-4c2b-bb48-1da1aaf6a138 => generated 1511 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:01:05.086797 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-879024f2-3780-468d-9462-4f6b347bccfb tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:05.087169 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-879024f2-3780-468d-9462-4f6b347bccfb tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] [instance: 8ceaf7df-4795-4969-be16-a2a1b94a3fa6] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:05.103492 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-879024f2-3780-468d-9462-4f6b347bccfb tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:05.104595 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-879024f2-3780-468d-9462-4f6b347bccfb tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:05.105457 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-879024f2-3780-468d-9462-4f6b347bccfb tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:05.106657 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-879024f2-3780-468d-9462-4f6b347bccfb tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:05.107976 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-879024f2-3780-468d-9462-4f6b347bccfb tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:05.108679 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-879024f2-3780-468d-9462-4f6b347bccfb tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:05.133939 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-879024f2-3780-468d-9462-4f6b347bccfb tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] HTTP exception thrown: Instance 8ceaf7df-4795-4969-be16-a2a1b94a3fa6 could not be found. Oct 08 21:01:05.136119 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-879024f2-3780-468d-9462-4f6b347bccfb tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Request method failure captured: Oct 08 21:01:05.136119 ncdv-master-1 devstack@n-api.service[140491]: request: GET /compute/v2.1/servers/8ceaf7df-4795-4969-be16-a2a1b94a3fa6 HTTP/1.1 Oct 08 21:01:05.136119 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:01:05.136119 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:01:05.136119 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:01:05.136119 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 21:01:05.136119 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:01:05.136119 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:01:05.136119 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:01:05.136119 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:01:05.136119 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeRR295mmmZhL7rSOgfacjSsWQ1Ti3FYd30sypy6B-ALaT7WOeiqaScllnDYtpa4eJ1mjmv4WUyVTLu5zt1pdJiZcKAFWv_GnEIqR6TqCn43v4gEmVWskuydtSKspT0UK00dWYkPU4ZM4UBd8cYd3myAyAfY7HLwKtG1LqfYrCLqzow Oct 08 21:01:05.136119 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:01:05.136119 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:01:05.136119 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:01:05.136119 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:01:05.136119 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:01:05.136119 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:01:05.136119 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 8472b054404c46a99b81aba34d6b9f40 Oct 08 21:01:05.136119 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-ServersOnMultiNodesTest-2078873751 Oct 08 21:01:05.136119 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:01:05.136119 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:01:05.136119 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8472b054404c46a99b81aba34d6b9f40"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8472b054404c46a99b81aba34d6b9f40"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8472b054404c46a99b81aba34d6b9f40"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8472b054404c46a99b81aba34d6b9f40"}]}] Oct 08 21:01:05.136119 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-ServersOnMultiNodesTest-2078873751 Oct 08 21:01:05.136119 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 8472b054404c46a99b81aba34d6b9f40 Oct 08 21:01:05.136119 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-2078873751 Oct 08 21:01:05.136119 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-ServersOnMultiNodesTest-2078873751-project Oct 08 21:01:05.136119 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:01:05.136119 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:01:05.136119 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 67ddc3cd3c374bacbe5bf5e0877380e2 Oct 08 21:01:05.136119 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-ServersOnMultiNodesTest-2078873751-project Oct 08 21:01:05.136119 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:01:05.136119 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance 8ceaf7df-4795-4969-be16-a2a1b94a3fa6 could not be found. Oct 08 21:01:05.136119 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': '8ceaf7df-4795-4969-be16-a2a1b94a3fa6'} Oct 08 21:01:05.136119 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:01:05.136119 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:01:05.136119 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:01:05.136119 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:01:05.136119 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:01:05.136119 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:01:05.136119 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:01:05.136119 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:01:05.136119 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:01:05.136119 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:01:05.136119 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ceaf7df-4795-4969-be16-a2a1b94a3fa6 could not be found. Oct 08 21:01:05.136119 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:01:05.136119 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:01:05.136119 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:01:05.136119 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:01:05.136119 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:01:05.136119 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:01:05.136119 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:01:05.136119 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:01:05.136119 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:01:05.136119 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:01:05.136119 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:01:05.136119 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:01:05.136119 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:01:05.136119 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:01:05.136119 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:01:05.136119 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:01:05.136119 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ceaf7df-4795-4969-be16-a2a1b94a3fa6 could not be found. Oct 08 21:01:05.136119 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:01:05.136119 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:01:05.136119 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:01:05.141236 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:01:05.141236 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:01:05.141236 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:01:05.141236 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:01:05.141236 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:01:05.141236 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ceaf7df-4795-4969-be16-a2a1b94a3fa6 could not be found. Oct 08 21:01:05.141236 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:01:05.141236 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-879024f2-3780-468d-9462-4f6b347bccfb tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] Returning 404 to user: Instance 8ceaf7df-4795-4969-be16-a2a1b94a3fa6 could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:01:05.142590 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-879024f2-3780-468d-9462-4f6b347bccfb tempest-ServersOnMultiNodesTest-2078873751 tempest-ServersOnMultiNodesTest-2078873751-project] 10.222.0.26 "GET /compute/v2.1/servers/8ceaf7df-4795-4969-be16-a2a1b94a3fa6" status: 404 len: 111 microversion: 2.1 time: 0.063279 Oct 08 21:01:05.143878 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1171/2379] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:01:05 2022] GET /compute/v2.1/servers/8ceaf7df-4795-4969-be16-a2a1b94a3fa6 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:01:05.164295 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-dacad2f3-1b13-4c11-8818-940bec0722b9 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:05.165847 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-dacad2f3-1b13-4c11-8818-940bec0722b9 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] [instance: c7527526-138f-45ff-8efc-8802410df8eb] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:05.172263 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dacad2f3-1b13-4c11-8818-940bec0722b9 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:05.172700 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dacad2f3-1b13-4c11-8818-940bec0722b9 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:05.173352 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dacad2f3-1b13-4c11-8818-940bec0722b9 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:05.174407 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dacad2f3-1b13-4c11-8818-940bec0722b9 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:05.174890 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dacad2f3-1b13-4c11-8818-940bec0722b9 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:05.175328 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dacad2f3-1b13-4c11-8818-940bec0722b9 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:05.319866 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-dacad2f3-1b13-4c11-8818-940bec0722b9 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d2ddfa343e748c089129b0039a12ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e191d6217f024a17a14184071ac674c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:01:05.336654 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-dacad2f3-1b13-4c11-8818-940bec0722b9 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] 10.222.0.26 "GET /compute/v2.1/servers/c7527526-138f-45ff-8efc-8802410df8eb" status: 200 len: 1275 microversion: 2.1 time: 0.177111 Oct 08 21:01:05.337779 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1172/2380] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:01:05 2022] GET /compute/v2.1/servers/c7527526-138f-45ff-8efc-8802410df8eb => generated 1275 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:01:05.615882 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-ee0589bb-412d-49ee-b307-574f2ebef610 tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:05.616504 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-ee0589bb-412d-49ee-b307-574f2ebef610 tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] [instance: 9ed82ee0-e56e-478e-a066-bad43e760a03] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:05.623306 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ee0589bb-412d-49ee-b307-574f2ebef610 tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:05.623803 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ee0589bb-412d-49ee-b307-574f2ebef610 tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:05.624247 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ee0589bb-412d-49ee-b307-574f2ebef610 tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:05.625228 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ee0589bb-412d-49ee-b307-574f2ebef610 tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:05.625866 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ee0589bb-412d-49ee-b307-574f2ebef610 tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:05.626125 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ee0589bb-412d-49ee-b307-574f2ebef610 tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:05.681163 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-0588f9e4-b0ff-42a0-b5e4-c898eee47c19 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06caf10b6fa43a3a2ad34858594e329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b10172715d423eb887d6c5b171defb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:01:05.691409 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-0588f9e4-b0ff-42a0-b5e4-c898eee47c19 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] 10.222.0.26 "GET /compute/v2.1/servers/1510673d-866c-4e8c-9cb8-2dbc7f0a4115" status: 200 len: 1325 microversion: 2.1 time: 0.710456 Oct 08 21:01:05.692650 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1209/2381] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:01:04 2022] GET /compute/v2.1/servers/1510673d-866c-4e8c-9cb8-2dbc7f0a4115 => generated 1325 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:01:05.804763 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-a1c6d1f0-85c4-4e72-9d6d-da46ea25f283 req-a5fe33c8-1197-4d3b-9e02-534d1b01f367 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1510673d-866c-4e8c-9cb8-2dbc7f0a4115", "tag": "97731b82-e11f-43c5-aae3-a4d1491e39b9"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:01:05.819663 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-a1c6d1f0-85c4-4e72-9d6d-da46ea25f283 req-a5fe33c8-1197-4d3b-9e02-534d1b01f367 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:05.820375 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-a1c6d1f0-85c4-4e72-9d6d-da46ea25f283 req-a5fe33c8-1197-4d3b-9e02-534d1b01f367 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:05.820831 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-a1c6d1f0-85c4-4e72-9d6d-da46ea25f283 req-a5fe33c8-1197-4d3b-9e02-534d1b01f367 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:05.835280 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-a1c6d1f0-85c4-4e72-9d6d-da46ea25f283 req-a5fe33c8-1197-4d3b-9e02-534d1b01f367 service nova] Creating event network-changed:97731b82-e11f-43c5-aae3-a4d1491e39b9 for instance 1510673d-866c-4e8c-9cb8-2dbc7f0a4115 on nch2-master-1 Oct 08 21:01:05.841871 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-a1c6d1f0-85c4-4e72-9d6d-da46ea25f283 req-a5fe33c8-1197-4d3b-9e02-534d1b01f367 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050179 Oct 08 21:01:05.842496 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1210/2382] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:01:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:01:05.993786 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-ee0589bb-412d-49ee-b307-574f2ebef610 tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c7aebdf00342b1ba80833663f8c0a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad3679a59b504731b5f56e52788fd645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:01:06.002173 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-ee0589bb-412d-49ee-b307-574f2ebef610 tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] 10.222.0.26 "GET /compute/v2.1/servers/9ed82ee0-e56e-478e-a066-bad43e760a03" status: 200 len: 1351 microversion: 2.1 time: 0.391886 Oct 08 21:01:06.002734 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1173/2383] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:01:05 2022] GET /compute/v2.1/servers/9ed82ee0-e56e-478e-a066-bad43e760a03 => generated 1351 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:01:06.002936 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-ba169239-1513-4af1-86eb-65d226526f8e tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:06.003656 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-ba169239-1513-4af1-86eb-65d226526f8e tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: 38b000d3-167b-4f7a-ab80-cd51fcb7cbaf] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:06.022579 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ba169239-1513-4af1-86eb-65d226526f8e tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:06.023088 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ba169239-1513-4af1-86eb-65d226526f8e tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:06.023540 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ba169239-1513-4af1-86eb-65d226526f8e tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:06.024264 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ba169239-1513-4af1-86eb-65d226526f8e tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:06.024733 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ba169239-1513-4af1-86eb-65d226526f8e tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:06.025177 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ba169239-1513-4af1-86eb-65d226526f8e tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:06.062996 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-dd74734d-42b9-4020-a6bf-fb3d60a33e3a tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:06.063622 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-dd74734d-42b9-4020-a6bf-fb3d60a33e3a tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] [instance: 579b0f8b-ccae-4c2b-bb48-1da1aaf6a138] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:06.071080 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dd74734d-42b9-4020-a6bf-fb3d60a33e3a tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:06.071591 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dd74734d-42b9-4020-a6bf-fb3d60a33e3a tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:06.072035 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dd74734d-42b9-4020-a6bf-fb3d60a33e3a tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:06.072762 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dd74734d-42b9-4020-a6bf-fb3d60a33e3a tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:06.073890 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dd74734d-42b9-4020-a6bf-fb3d60a33e3a tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:06.074327 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dd74734d-42b9-4020-a6bf-fb3d60a33e3a tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:06.331098 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-dd74734d-42b9-4020-a6bf-fb3d60a33e3a tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1698dee4a2bf4ea19a6ee0c3d5cb5c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b00ee5e7828469f95bd90548d35982a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:01:06.343219 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-dd74734d-42b9-4020-a6bf-fb3d60a33e3a tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] 10.222.0.26 "GET /compute/v2.1/servers/579b0f8b-ccae-4c2b-bb48-1da1aaf6a138" status: 200 len: 1511 microversion: 2.1 time: 0.283909 Oct 08 21:01:06.360427 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1174/2384] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:01:06 2022] GET /compute/v2.1/servers/579b0f8b-ccae-4c2b-bb48-1da1aaf6a138 => generated 1511 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:01:06.366989 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-324a8314-1c3f-48e1-9449-b48373ba7f1d tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:06.367807 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-324a8314-1c3f-48e1-9449-b48373ba7f1d tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] [instance: c7527526-138f-45ff-8efc-8802410df8eb] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:06.374480 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-324a8314-1c3f-48e1-9449-b48373ba7f1d tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:06.378708 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-324a8314-1c3f-48e1-9449-b48373ba7f1d tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:06.379710 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-324a8314-1c3f-48e1-9449-b48373ba7f1d tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:06.380806 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-324a8314-1c3f-48e1-9449-b48373ba7f1d tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:06.381771 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-324a8314-1c3f-48e1-9449-b48373ba7f1d tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:06.382794 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-324a8314-1c3f-48e1-9449-b48373ba7f1d tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:06.512648 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-ba169239-1513-4af1-86eb-65d226526f8e tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:01:06.525102 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-ba169239-1513-4af1-86eb-65d226526f8e tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/38b000d3-167b-4f7a-ab80-cd51fcb7cbaf" status: 200 len: 1476 microversion: 2.1 time: 0.526266 Oct 08 21:01:06.541075 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1211/2385] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:01:05 2022] GET /compute/v2.1/servers/38b000d3-167b-4f7a-ab80-cd51fcb7cbaf => generated 1476 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:01:06.716899 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-c6d8a65d-f847-467e-b6aa-17ac65e05392 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:06.717294 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-c6d8a65d-f847-467e-b6aa-17ac65e05392 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] [instance: 1510673d-866c-4e8c-9cb8-2dbc7f0a4115] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:06.722788 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-324a8314-1c3f-48e1-9449-b48373ba7f1d tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d2ddfa343e748c089129b0039a12ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e191d6217f024a17a14184071ac674c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:01:06.725562 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c6d8a65d-f847-467e-b6aa-17ac65e05392 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:06.726074 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c6d8a65d-f847-467e-b6aa-17ac65e05392 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:06.726527 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c6d8a65d-f847-467e-b6aa-17ac65e05392 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:06.727624 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c6d8a65d-f847-467e-b6aa-17ac65e05392 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:06.728104 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c6d8a65d-f847-467e-b6aa-17ac65e05392 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:06.728543 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c6d8a65d-f847-467e-b6aa-17ac65e05392 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:06.733644 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-324a8314-1c3f-48e1-9449-b48373ba7f1d tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] 10.222.0.26 "GET /compute/v2.1/servers/c7527526-138f-45ff-8efc-8802410df8eb" status: 200 len: 1317 microversion: 2.1 time: 0.371560 Oct 08 21:01:06.734546 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1175/2386] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:01:06 2022] GET /compute/v2.1/servers/c7527526-138f-45ff-8efc-8802410df8eb => generated 1317 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:01:07.031496 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-023a33ea-79cb-485a-bb35-7a547a981a52 tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:07.033405 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-023a33ea-79cb-485a-bb35-7a547a981a52 tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] [instance: 9ed82ee0-e56e-478e-a066-bad43e760a03] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:07.044895 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-023a33ea-79cb-485a-bb35-7a547a981a52 tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:07.045596 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-023a33ea-79cb-485a-bb35-7a547a981a52 tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:07.046187 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-023a33ea-79cb-485a-bb35-7a547a981a52 tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:07.047164 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-023a33ea-79cb-485a-bb35-7a547a981a52 tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:07.047786 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-023a33ea-79cb-485a-bb35-7a547a981a52 tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:07.048700 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-023a33ea-79cb-485a-bb35-7a547a981a52 tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:07.179102 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-c6d8a65d-f847-467e-b6aa-17ac65e05392 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06caf10b6fa43a3a2ad34858594e329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b10172715d423eb887d6c5b171defb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:01:07.191949 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-c6d8a65d-f847-467e-b6aa-17ac65e05392 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] 10.222.0.26 "GET /compute/v2.1/servers/1510673d-866c-4e8c-9cb8-2dbc7f0a4115" status: 200 len: 1325 microversion: 2.1 time: 0.480165 Oct 08 21:01:07.192551 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1212/2387] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:01:06 2022] GET /compute/v2.1/servers/1510673d-866c-4e8c-9cb8-2dbc7f0a4115 => generated 1325 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:01:07.287368 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-c1f37367-dd52-493c-a074-45f342c1cec9 req-79b8bec9-1ba7-4b4d-a48f-f523898118c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7527526-138f-45ff-8efc-8802410df8eb", "tag": "60c45ac4-b88e-4186-8382-80cf71deafab"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:01:07.300562 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-023a33ea-79cb-485a-bb35-7a547a981a52 tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c7aebdf00342b1ba80833663f8c0a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad3679a59b504731b5f56e52788fd645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:01:07.316579 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-023a33ea-79cb-485a-bb35-7a547a981a52 tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] 10.222.0.26 "GET /compute/v2.1/servers/9ed82ee0-e56e-478e-a066-bad43e760a03" status: 200 len: 1351 microversion: 2.1 time: 0.290636 Oct 08 21:01:07.318311 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-c1f37367-dd52-493c-a074-45f342c1cec9 req-79b8bec9-1ba7-4b4d-a48f-f523898118c7 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:07.319433 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1176/2388] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:01:07 2022] GET /compute/v2.1/servers/9ed82ee0-e56e-478e-a066-bad43e760a03 => generated 1351 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:01:07.320231 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-c1f37367-dd52-493c-a074-45f342c1cec9 req-79b8bec9-1ba7-4b4d-a48f-f523898118c7 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:07.321839 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-c1f37367-dd52-493c-a074-45f342c1cec9 req-79b8bec9-1ba7-4b4d-a48f-f523898118c7 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:07.367419 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-43ed64cd-1037-4ccc-bc62-071b3d473dd4 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:07.368040 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-43ed64cd-1037-4ccc-bc62-071b3d473dd4 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] [instance: 579b0f8b-ccae-4c2b-bb48-1da1aaf6a138] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:07.376998 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-c1f37367-dd52-493c-a074-45f342c1cec9 req-79b8bec9-1ba7-4b4d-a48f-f523898118c7 service nova] Creating event network-changed:60c45ac4-b88e-4186-8382-80cf71deafab for instance c7527526-138f-45ff-8efc-8802410df8eb on nch2-master-1 Oct 08 21:01:07.379598 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-43ed64cd-1037-4ccc-bc62-071b3d473dd4 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:07.380333 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-43ed64cd-1037-4ccc-bc62-071b3d473dd4 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:07.380786 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-43ed64cd-1037-4ccc-bc62-071b3d473dd4 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:07.381539 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-43ed64cd-1037-4ccc-bc62-071b3d473dd4 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:07.384961 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-43ed64cd-1037-4ccc-bc62-071b3d473dd4 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:07.387644 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-43ed64cd-1037-4ccc-bc62-071b3d473dd4 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:07.395135 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-c1f37367-dd52-493c-a074-45f342c1cec9 req-79b8bec9-1ba7-4b4d-a48f-f523898118c7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112050 Oct 08 21:01:07.396164 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1213/2389] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:01:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:01:07.550622 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-0f143b3a-ebd1-46ce-8620-de243c7c3733 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:07.551359 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-0f143b3a-ebd1-46ce-8620-de243c7c3733 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: 38b000d3-167b-4f7a-ab80-cd51fcb7cbaf] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:07.553566 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:DELETE=3,nova_api:INSERT=3 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:01:07.569615 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0f143b3a-ebd1-46ce-8620-de243c7c3733 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:07.570141 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0f143b3a-ebd1-46ce-8620-de243c7c3733 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:07.570599 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0f143b3a-ebd1-46ce-8620-de243c7c3733 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:07.574091 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0f143b3a-ebd1-46ce-8620-de243c7c3733 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:07.574852 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0f143b3a-ebd1-46ce-8620-de243c7c3733 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:07.575380 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0f143b3a-ebd1-46ce-8620-de243c7c3733 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:07.612378 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-43ed64cd-1037-4ccc-bc62-071b3d473dd4 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1698dee4a2bf4ea19a6ee0c3d5cb5c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b00ee5e7828469f95bd90548d35982a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:01:07.625841 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-43ed64cd-1037-4ccc-bc62-071b3d473dd4 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] 10.222.0.26 "GET /compute/v2.1/servers/579b0f8b-ccae-4c2b-bb48-1da1aaf6a138" status: 200 len: 1511 microversion: 2.1 time: 0.262208 Oct 08 21:01:07.641596 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1177/2390] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:01:07 2022] GET /compute/v2.1/servers/579b0f8b-ccae-4c2b-bb48-1da1aaf6a138 => generated 1511 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:01:07.761556 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-458452d3-e48a-4431-8361-af51f0578dea tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:07.762190 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-458452d3-e48a-4431-8361-af51f0578dea tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] [instance: c7527526-138f-45ff-8efc-8802410df8eb] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:07.775196 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-0f143b3a-ebd1-46ce-8620-de243c7c3733 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:01:07.784330 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-0f143b3a-ebd1-46ce-8620-de243c7c3733 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/38b000d3-167b-4f7a-ab80-cd51fcb7cbaf" status: 200 len: 1476 microversion: 2.1 time: 0.239863 Oct 08 21:01:07.784897 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-458452d3-e48a-4431-8361-af51f0578dea tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:07.795133 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1214/2391] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:01:07 2022] GET /compute/v2.1/servers/38b000d3-167b-4f7a-ab80-cd51fcb7cbaf => generated 1476 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:01:07.799676 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-458452d3-e48a-4431-8361-af51f0578dea tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:07.800249 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-458452d3-e48a-4431-8361-af51f0578dea tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:07.802892 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-458452d3-e48a-4431-8361-af51f0578dea tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:07.803385 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-458452d3-e48a-4431-8361-af51f0578dea tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:07.803827 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-458452d3-e48a-4431-8361-af51f0578dea tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:08.085685 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-458452d3-e48a-4431-8361-af51f0578dea tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d2ddfa343e748c089129b0039a12ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e191d6217f024a17a14184071ac674c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:01:08.097212 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-458452d3-e48a-4431-8361-af51f0578dea tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] 10.222.0.26 "GET /compute/v2.1/servers/c7527526-138f-45ff-8efc-8802410df8eb" status: 200 len: 1317 microversion: 2.1 time: 0.343384 Oct 08 21:01:08.110235 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1178/2392] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:01:07 2022] GET /compute/v2.1/servers/c7527526-138f-45ff-8efc-8802410df8eb => generated 1317 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:01:08.217418 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-0569fb21-f5e3-43ee-958d-fdf5152c1df7 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:08.218145 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-0569fb21-f5e3-43ee-958d-fdf5152c1df7 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] [instance: 1510673d-866c-4e8c-9cb8-2dbc7f0a4115] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:08.231826 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0569fb21-f5e3-43ee-958d-fdf5152c1df7 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:08.236133 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0569fb21-f5e3-43ee-958d-fdf5152c1df7 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:08.236811 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0569fb21-f5e3-43ee-958d-fdf5152c1df7 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:08.238325 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0569fb21-f5e3-43ee-958d-fdf5152c1df7 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:08.241632 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0569fb21-f5e3-43ee-958d-fdf5152c1df7 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:08.242215 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0569fb21-f5e3-43ee-958d-fdf5152c1df7 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:08.347456 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-b8e9c753-519f-4c25-9d2b-8077efb32ec6 tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:08.349141 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-b8e9c753-519f-4c25-9d2b-8077efb32ec6 tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] [instance: 9ed82ee0-e56e-478e-a066-bad43e760a03] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:08.364101 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b8e9c753-519f-4c25-9d2b-8077efb32ec6 tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:08.367317 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b8e9c753-519f-4c25-9d2b-8077efb32ec6 tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:08.370327 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b8e9c753-519f-4c25-9d2b-8077efb32ec6 tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:08.373093 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b8e9c753-519f-4c25-9d2b-8077efb32ec6 tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:08.375285 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b8e9c753-519f-4c25-9d2b-8077efb32ec6 tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:08.376029 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b8e9c753-519f-4c25-9d2b-8077efb32ec6 tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:08.504430 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-0569fb21-f5e3-43ee-958d-fdf5152c1df7 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06caf10b6fa43a3a2ad34858594e329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b10172715d423eb887d6c5b171defb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:01:08.514895 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-0569fb21-f5e3-43ee-958d-fdf5152c1df7 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] 10.222.0.26 "GET /compute/v2.1/servers/1510673d-866c-4e8c-9cb8-2dbc7f0a4115" status: 200 len: 1325 microversion: 2.1 time: 0.301321 Oct 08 21:01:08.515496 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1215/2393] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:01:08 2022] GET /compute/v2.1/servers/1510673d-866c-4e8c-9cb8-2dbc7f0a4115 => generated 1325 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:01:08.651214 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-288c4927-63a4-40e6-b85f-3a8bf24bb50d tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:08.652248 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-288c4927-63a4-40e6-b85f-3a8bf24bb50d tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] [instance: 579b0f8b-ccae-4c2b-bb48-1da1aaf6a138] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:08.659709 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-288c4927-63a4-40e6-b85f-3a8bf24bb50d tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:08.660488 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-288c4927-63a4-40e6-b85f-3a8bf24bb50d tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:08.661142 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-288c4927-63a4-40e6-b85f-3a8bf24bb50d tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:08.662099 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-288c4927-63a4-40e6-b85f-3a8bf24bb50d tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:08.662761 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-288c4927-63a4-40e6-b85f-3a8bf24bb50d tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:08.663430 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-288c4927-63a4-40e6-b85f-3a8bf24bb50d tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:08.890653 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-b8e9c753-519f-4c25-9d2b-8077efb32ec6 tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c7aebdf00342b1ba80833663f8c0a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad3679a59b504731b5f56e52788fd645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:01:08.891433 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-288c4927-63a4-40e6-b85f-3a8bf24bb50d tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1698dee4a2bf4ea19a6ee0c3d5cb5c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b00ee5e7828469f95bd90548d35982a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:01:08.902065 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-288c4927-63a4-40e6-b85f-3a8bf24bb50d tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] 10.222.0.26 "GET /compute/v2.1/servers/579b0f8b-ccae-4c2b-bb48-1da1aaf6a138" status: 200 len: 1517 microversion: 2.1 time: 0.255274 Oct 08 21:01:08.903715 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1216/2394] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:01:08 2022] GET /compute/v2.1/servers/579b0f8b-ccae-4c2b-bb48-1da1aaf6a138 => generated 1517 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:01:08.908457 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-97f4b284-1993-47d0-80be-f1e90dc06923 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:08.914254 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-97f4b284-1993-47d0-80be-f1e90dc06923 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: 38b000d3-167b-4f7a-ab80-cd51fcb7cbaf] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:08.929362 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-97f4b284-1993-47d0-80be-f1e90dc06923 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:08.929946 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-97f4b284-1993-47d0-80be-f1e90dc06923 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:08.930456 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-97f4b284-1993-47d0-80be-f1e90dc06923 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:08.931198 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-97f4b284-1993-47d0-80be-f1e90dc06923 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:08.931685 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-97f4b284-1993-47d0-80be-f1e90dc06923 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:08.932202 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-97f4b284-1993-47d0-80be-f1e90dc06923 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:08.940620 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-b8e9c753-519f-4c25-9d2b-8077efb32ec6 tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] 10.222.0.26 "GET /compute/v2.1/servers/9ed82ee0-e56e-478e-a066-bad43e760a03" status: 200 len: 1351 microversion: 2.1 time: 0.602506 Oct 08 21:01:08.942377 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1179/2395] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:01:08 2022] GET /compute/v2.1/servers/9ed82ee0-e56e-478e-a066-bad43e760a03 => generated 1351 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:01:09.122552 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-e93a366a-9ab7-41c1-b244-931acabbeccb req-19deef4e-11f5-4347-995b-5caa4385746a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ed82ee0-e56e-478e-a066-bad43e760a03", "name": "network-vif-plugged", "status": "completed", "tag": "2d6b498c-db99-42bb-a03a-e6ad5fc72076"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:01:09.138350 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:01:09.141586 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-e93a366a-9ab7-41c1-b244-931acabbeccb req-19deef4e-11f5-4347-995b-5caa4385746a service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:09.143121 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-e93a366a-9ab7-41c1-b244-931acabbeccb req-19deef4e-11f5-4347-995b-5caa4385746a service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:09.143898 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-e93a366a-9ab7-41c1-b244-931acabbeccb req-19deef4e-11f5-4347-995b-5caa4385746a service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:09.177959 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-e93a366a-9ab7-41c1-b244-931acabbeccb req-19deef4e-11f5-4347-995b-5caa4385746a service nova] Creating event network-vif-plugged:2d6b498c-db99-42bb-a03a-e6ad5fc72076 for instance 9ed82ee0-e56e-478e-a066-bad43e760a03 on nch1-master-1 Oct 08 21:01:09.189334 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-e93a366a-9ab7-41c1-b244-931acabbeccb req-19deef4e-11f5-4347-995b-5caa4385746a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077425 Oct 08 21:01:09.193270 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1180/2396] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:01:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:01:09.220041 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-a7055373-7cb6-4fea-888c-50f4cd1635e3 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:09.220829 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-a7055373-7cb6-4fea-888c-50f4cd1635e3 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] [instance: c7527526-138f-45ff-8efc-8802410df8eb] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:09.232802 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-97f4b284-1993-47d0-80be-f1e90dc06923 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:01:09.245580 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-97f4b284-1993-47d0-80be-f1e90dc06923 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/38b000d3-167b-4f7a-ab80-cd51fcb7cbaf" status: 200 len: 1476 microversion: 2.1 time: 0.340506 Oct 08 21:01:09.247950 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1217/2397] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:01:08 2022] GET /compute/v2.1/servers/38b000d3-167b-4f7a-ab80-cd51fcb7cbaf => generated 1476 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:01:09.256787 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a7055373-7cb6-4fea-888c-50f4cd1635e3 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:09.257426 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a7055373-7cb6-4fea-888c-50f4cd1635e3 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:09.257942 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a7055373-7cb6-4fea-888c-50f4cd1635e3 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:09.258891 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a7055373-7cb6-4fea-888c-50f4cd1635e3 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:09.259534 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a7055373-7cb6-4fea-888c-50f4cd1635e3 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:09.260326 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a7055373-7cb6-4fea-888c-50f4cd1635e3 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:09.539881 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-cec98649-173a-4ac3-9e1a-ae30ba74a8e1 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:09.541100 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-cec98649-173a-4ac3-9e1a-ae30ba74a8e1 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] [instance: 1510673d-866c-4e8c-9cb8-2dbc7f0a4115] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:09.549967 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cec98649-173a-4ac3-9e1a-ae30ba74a8e1 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:09.550760 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cec98649-173a-4ac3-9e1a-ae30ba74a8e1 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:09.551658 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cec98649-173a-4ac3-9e1a-ae30ba74a8e1 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:09.552630 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cec98649-173a-4ac3-9e1a-ae30ba74a8e1 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:09.553908 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cec98649-173a-4ac3-9e1a-ae30ba74a8e1 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:09.555432 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cec98649-173a-4ac3-9e1a-ae30ba74a8e1 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:09.728379 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-cec98649-173a-4ac3-9e1a-ae30ba74a8e1 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06caf10b6fa43a3a2ad34858594e329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b10172715d423eb887d6c5b171defb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:01:09.736756 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-cec98649-173a-4ac3-9e1a-ae30ba74a8e1 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] 10.222.0.26 "GET /compute/v2.1/servers/1510673d-866c-4e8c-9cb8-2dbc7f0a4115" status: 200 len: 1325 microversion: 2.1 time: 0.201737 Oct 08 21:01:09.737365 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1218/2398] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:01:09 2022] GET /compute/v2.1/servers/1510673d-866c-4e8c-9cb8-2dbc7f0a4115 => generated 1325 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:01:09.968812 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-9bfefb33-68cd-4640-ad4c-1b71dcf97f3f tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:09.969458 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-9bfefb33-68cd-4640-ad4c-1b71dcf97f3f tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] [instance: 9ed82ee0-e56e-478e-a066-bad43e760a03] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:09.975865 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9bfefb33-68cd-4640-ad4c-1b71dcf97f3f tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:09.976579 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9bfefb33-68cd-4640-ad4c-1b71dcf97f3f tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:09.977175 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9bfefb33-68cd-4640-ad4c-1b71dcf97f3f tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:09.978083 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-a7055373-7cb6-4fea-888c-50f4cd1635e3 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d2ddfa343e748c089129b0039a12ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e191d6217f024a17a14184071ac674c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:01:09.978606 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9bfefb33-68cd-4640-ad4c-1b71dcf97f3f tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:09.979496 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9bfefb33-68cd-4640-ad4c-1b71dcf97f3f tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:09.980102 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9bfefb33-68cd-4640-ad4c-1b71dcf97f3f tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:09.989628 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-a7055373-7cb6-4fea-888c-50f4cd1635e3 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] 10.222.0.26 "GET /compute/v2.1/servers/c7527526-138f-45ff-8efc-8802410df8eb" status: 200 len: 1317 microversion: 2.1 time: 0.794917 Oct 08 21:01:10.005589 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1181/2399] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:01:09 2022] GET /compute/v2.1/servers/c7527526-138f-45ff-8efc-8802410df8eb => generated 1317 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:01:10.190934 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-9bfefb33-68cd-4640-ad4c-1b71dcf97f3f tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c7aebdf00342b1ba80833663f8c0a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad3679a59b504731b5f56e52788fd645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:01:10.206130 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-9bfefb33-68cd-4640-ad4c-1b71dcf97f3f tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] 10.222.0.26 "GET /compute/v2.1/servers/9ed82ee0-e56e-478e-a066-bad43e760a03" status: 200 len: 1351 microversion: 2.1 time: 0.241064 Oct 08 21:01:10.206897 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1219/2400] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:01:09 2022] GET /compute/v2.1/servers/9ed82ee0-e56e-478e-a066-bad43e760a03 => generated 1351 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:01:10.273882 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-ec3e0f60-85d9-46dc-a180-3015e174e2df tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:10.274546 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-ec3e0f60-85d9-46dc-a180-3015e174e2df tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: 38b000d3-167b-4f7a-ab80-cd51fcb7cbaf] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:10.282133 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ec3e0f60-85d9-46dc-a180-3015e174e2df tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:10.283364 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ec3e0f60-85d9-46dc-a180-3015e174e2df tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:10.284200 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ec3e0f60-85d9-46dc-a180-3015e174e2df tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:10.285173 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ec3e0f60-85d9-46dc-a180-3015e174e2df tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:10.288904 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ec3e0f60-85d9-46dc-a180-3015e174e2df tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:10.289568 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ec3e0f60-85d9-46dc-a180-3015e174e2df tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:10.519460 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=6 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:01:10.524296 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-4a4fc945-6c70-4eda-bd78-41a9ffb3d611 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Action: 'create', calling method: .version_select at 0x7f1a87e68e50>, body: {"keypair": {"name": "tempest-keypair-1186969454", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPdpd1reWMGZUslRfrWy88qA2qya/mSEXbd6uDSTYeYaKm9GjL8tmf3xeFgXCC2DgunrtAc/5QTzRZZMAPD41LKhFqOYsXFqBgeSG0hNXf5n7BCnDZMp5dGiX73Sk026rQ=="}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:01:10.542801 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-4a4fc945-6c70-4eda-bd78-41a9ffb3d611 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Getting quotas for project 8b00ee5e7828469f95bd90548d35982a. Resources: {'key_pairs'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:01:10.550668 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-4a4fc945-6c70-4eda-bd78-41a9ffb3d611 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Getting quotas for user 1698dee4a2bf4ea19a6ee0c3d5cb5c09 and project 8b00ee5e7828469f95bd90548d35982a. Resources: {'key_pairs'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:01:10.553702 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-ec3e0f60-85d9-46dc-a180-3015e174e2df tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:01:10.562284 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-ec3e0f60-85d9-46dc-a180-3015e174e2df tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/38b000d3-167b-4f7a-ab80-cd51fcb7cbaf" status: 200 len: 1476 microversion: 2.1 time: 0.294575 Oct 08 21:01:10.566464 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1182/2401] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:01:10 2022] GET /compute/v2.1/servers/38b000d3-167b-4f7a-ab80-cd51fcb7cbaf => generated 1476 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:01:10.589920 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-4a4fc945-6c70-4eda-bd78-41a9ffb3d611 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.071753 Oct 08 21:01:10.590547 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1220/2402] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Oct 8 21:01:10 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:01:10.759071 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-b6071d02-b2c7-485b-af48-2da97788fec8 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:10.760112 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-b6071d02-b2c7-485b-af48-2da97788fec8 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] [instance: 1510673d-866c-4e8c-9cb8-2dbc7f0a4115] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:10.767465 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b6071d02-b2c7-485b-af48-2da97788fec8 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:10.768332 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b6071d02-b2c7-485b-af48-2da97788fec8 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:10.769021 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b6071d02-b2c7-485b-af48-2da97788fec8 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:10.770020 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b6071d02-b2c7-485b-af48-2da97788fec8 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:10.770708 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b6071d02-b2c7-485b-af48-2da97788fec8 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:10.771387 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b6071d02-b2c7-485b-af48-2da97788fec8 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:11.014595 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e866b03a-ff1f-403a-a41c-263d71c257c0 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:11.015450 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-e866b03a-ff1f-403a-a41c-263d71c257c0 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] [instance: c7527526-138f-45ff-8efc-8802410df8eb] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:11.022296 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e866b03a-ff1f-403a-a41c-263d71c257c0 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:11.023041 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e866b03a-ff1f-403a-a41c-263d71c257c0 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:11.023644 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e866b03a-ff1f-403a-a41c-263d71c257c0 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:11.024613 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e866b03a-ff1f-403a-a41c-263d71c257c0 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:11.025388 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e866b03a-ff1f-403a-a41c-263d71c257c0 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:11.026597 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e866b03a-ff1f-403a-a41c-263d71c257c0 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:11.249168 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-e866b03a-ff1f-403a-a41c-263d71c257c0 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d2ddfa343e748c089129b0039a12ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e191d6217f024a17a14184071ac674c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:01:11.262102 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-e866b03a-ff1f-403a-a41c-263d71c257c0 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] 10.222.0.26 "GET /compute/v2.1/servers/c7527526-138f-45ff-8efc-8802410df8eb" status: 200 len: 1317 microversion: 2.1 time: 0.251684 Oct 08 21:01:11.262956 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1221/2403] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:01:11 2022] GET /compute/v2.1/servers/c7527526-138f-45ff-8efc-8802410df8eb => generated 1317 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:01:11.291965 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-6aabd6fc-2fa9-4780-a3a1-76b950acdf31 tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:11.294534 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-6aabd6fc-2fa9-4780-a3a1-76b950acdf31 tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] [instance: 9ed82ee0-e56e-478e-a066-bad43e760a03] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:11.316410 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6aabd6fc-2fa9-4780-a3a1-76b950acdf31 tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:11.318186 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6aabd6fc-2fa9-4780-a3a1-76b950acdf31 tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:11.320062 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6aabd6fc-2fa9-4780-a3a1-76b950acdf31 tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:11.321338 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6aabd6fc-2fa9-4780-a3a1-76b950acdf31 tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:11.322148 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6aabd6fc-2fa9-4780-a3a1-76b950acdf31 tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:11.322869 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6aabd6fc-2fa9-4780-a3a1-76b950acdf31 tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:11.451300 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-b6071d02-b2c7-485b-af48-2da97788fec8 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06caf10b6fa43a3a2ad34858594e329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b10172715d423eb887d6c5b171defb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:01:11.472343 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-b6071d02-b2c7-485b-af48-2da97788fec8 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] 10.222.0.26 "GET /compute/v2.1/servers/1510673d-866c-4e8c-9cb8-2dbc7f0a4115" status: 200 len: 1325 microversion: 2.1 time: 0.716778 Oct 08 21:01:11.486703 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1183/2404] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:01:10 2022] GET /compute/v2.1/servers/1510673d-866c-4e8c-9cb8-2dbc7f0a4115 => generated 1325 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:01:11.591450 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-76d06032-38c4-402f-9bbd-580464a7e63b tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:11.592624 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-76d06032-38c4-402f-9bbd-580464a7e63b tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: 38b000d3-167b-4f7a-ab80-cd51fcb7cbaf] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:11.603057 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-76d06032-38c4-402f-9bbd-580464a7e63b tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:11.604747 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-76d06032-38c4-402f-9bbd-580464a7e63b tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:11.605449 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-76d06032-38c4-402f-9bbd-580464a7e63b tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:11.606604 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-76d06032-38c4-402f-9bbd-580464a7e63b tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:11.607351 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-76d06032-38c4-402f-9bbd-580464a7e63b tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:11.608151 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-76d06032-38c4-402f-9bbd-580464a7e63b tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:11.621278 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-6aabd6fc-2fa9-4780-a3a1-76b950acdf31 tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c7aebdf00342b1ba80833663f8c0a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad3679a59b504731b5f56e52788fd645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:01:11.631195 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=100 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:01:11.642105 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:01:11.644603 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-6aabd6fc-2fa9-4780-a3a1-76b950acdf31 tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] 10.222.0.26 "GET /compute/v2.1/servers/9ed82ee0-e56e-478e-a066-bad43e760a03" status: 200 len: 1542 microversion: 2.1 time: 0.380540 Oct 08 21:01:11.645233 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1222/2405] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:01:11 2022] GET /compute/v2.1/servers/9ed82ee0-e56e-478e-a066-bad43e760a03 => generated 1542 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:01:11.673856 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-3b062241-d21d-4af0-9d36-bdcf14652757 tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:11.678083 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-3b062241-d21d-4af0-9d36-bdcf14652757 tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] [instance: 9ed82ee0-e56e-478e-a066-bad43e760a03] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:11.685822 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3b062241-d21d-4af0-9d36-bdcf14652757 tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:11.686143 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3b062241-d21d-4af0-9d36-bdcf14652757 tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:11.686588 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3b062241-d21d-4af0-9d36-bdcf14652757 tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:11.687305 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3b062241-d21d-4af0-9d36-bdcf14652757 tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:11.689007 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3b062241-d21d-4af0-9d36-bdcf14652757 tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:11.691061 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3b062241-d21d-4af0-9d36-bdcf14652757 tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:11.920516 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-76d06032-38c4-402f-9bbd-580464a7e63b tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:01:11.928678 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-76d06032-38c4-402f-9bbd-580464a7e63b tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/38b000d3-167b-4f7a-ab80-cd51fcb7cbaf" status: 200 len: 1476 microversion: 2.1 time: 0.343790 Oct 08 21:01:11.930022 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1184/2406] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:01:11 2022] GET /compute/v2.1/servers/38b000d3-167b-4f7a-ab80-cd51fcb7cbaf => generated 1476 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:01:11.930591 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-3b062241-d21d-4af0-9d36-bdcf14652757 tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] 10.222.0.26 "GET /compute/v2.1/servers/9ed82ee0-e56e-478e-a066-bad43e760a03/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.261114 Oct 08 21:01:11.931316 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1223/2407] 10.222.0.26 () {58 vars in 1275 bytes} [Sat Oct 8 21:01:11 2022] GET /compute/v2.1/servers/9ed82ee0-e56e-478e-a066-bad43e760a03/os-interface => generated 285 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 08 21:01:12.284836 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-e5e629af-ae77-466b-8515-020f918a27a0 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:12.285563 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-e5e629af-ae77-466b-8515-020f918a27a0 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] [instance: c7527526-138f-45ff-8efc-8802410df8eb] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:12.295079 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e5e629af-ae77-466b-8515-020f918a27a0 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:12.295836 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e5e629af-ae77-466b-8515-020f918a27a0 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:12.296037 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e5e629af-ae77-466b-8515-020f918a27a0 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:12.296760 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e5e629af-ae77-466b-8515-020f918a27a0 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:12.300806 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e5e629af-ae77-466b-8515-020f918a27a0 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:12.303028 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e5e629af-ae77-466b-8515-020f918a27a0 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:12.312401 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=14 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:01:12.510223 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-48907c62-f13d-43ce-b696-ab7161245f9b tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:12.512100 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-48907c62-f13d-43ce-b696-ab7161245f9b tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] [instance: 1510673d-866c-4e8c-9cb8-2dbc7f0a4115] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:12.550919 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-48907c62-f13d-43ce-b696-ab7161245f9b tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:12.555587 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-48907c62-f13d-43ce-b696-ab7161245f9b tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:12.557168 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-48907c62-f13d-43ce-b696-ab7161245f9b tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:12.558357 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-48907c62-f13d-43ce-b696-ab7161245f9b tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:12.559028 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-48907c62-f13d-43ce-b696-ab7161245f9b tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:12.567704 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-48907c62-f13d-43ce-b696-ab7161245f9b tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:12.621487 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-e5e629af-ae77-466b-8515-020f918a27a0 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d2ddfa343e748c089129b0039a12ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e191d6217f024a17a14184071ac674c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:01:12.634302 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-e5e629af-ae77-466b-8515-020f918a27a0 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] 10.222.0.26 "GET /compute/v2.1/servers/c7527526-138f-45ff-8efc-8802410df8eb" status: 200 len: 1317 microversion: 2.1 time: 0.353109 Oct 08 21:01:12.637830 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1185/2408] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:01:12 2022] GET /compute/v2.1/servers/c7527526-138f-45ff-8efc-8802410df8eb => generated 1317 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:01:12.864809 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-a1151bc3-8995-480e-b3f3-21ad57fe9707 req-dd88f064-4ac7-4361-8af6-1148b09209e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1510673d-866c-4e8c-9cb8-2dbc7f0a4115", "name": "network-vif-plugged", "status": "completed", "tag": "97731b82-e11f-43c5-aae3-a4d1491e39b9"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:01:12.881737 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=24 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:01:12.896823 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-a1151bc3-8995-480e-b3f3-21ad57fe9707 req-dd88f064-4ac7-4361-8af6-1148b09209e9 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:12.898717 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-a1151bc3-8995-480e-b3f3-21ad57fe9707 req-dd88f064-4ac7-4361-8af6-1148b09209e9 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:12.899383 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-a1151bc3-8995-480e-b3f3-21ad57fe9707 req-dd88f064-4ac7-4361-8af6-1148b09209e9 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:12.931149 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-a1151bc3-8995-480e-b3f3-21ad57fe9707 req-dd88f064-4ac7-4361-8af6-1148b09209e9 service nova] Creating event network-vif-plugged:97731b82-e11f-43c5-aae3-a4d1491e39b9 for instance 1510673d-866c-4e8c-9cb8-2dbc7f0a4115 on nch2-master-1 Oct 08 21:01:12.948430 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-a1151bc3-8995-480e-b3f3-21ad57fe9707 req-dd88f064-4ac7-4361-8af6-1148b09209e9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088510 Oct 08 21:01:12.949846 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1186/2409] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:01:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:01:12.956296 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-4e4ec8c3-0305-4a8d-861e-808f87ddeca4 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:12.957335 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-4e4ec8c3-0305-4a8d-861e-808f87ddeca4 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: 38b000d3-167b-4f7a-ab80-cd51fcb7cbaf] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:12.965263 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4e4ec8c3-0305-4a8d-861e-808f87ddeca4 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:12.966245 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4e4ec8c3-0305-4a8d-861e-808f87ddeca4 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:12.967013 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4e4ec8c3-0305-4a8d-861e-808f87ddeca4 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:12.967971 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4e4ec8c3-0305-4a8d-861e-808f87ddeca4 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:12.968702 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4e4ec8c3-0305-4a8d-861e-808f87ddeca4 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:12.969372 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4e4ec8c3-0305-4a8d-861e-808f87ddeca4 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:13.166418 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-48907c62-f13d-43ce-b696-ab7161245f9b tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06caf10b6fa43a3a2ad34858594e329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b10172715d423eb887d6c5b171defb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:01:13.187957 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-48907c62-f13d-43ce-b696-ab7161245f9b tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] 10.222.0.26 "GET /compute/v2.1/servers/1510673d-866c-4e8c-9cb8-2dbc7f0a4115" status: 200 len: 1325 microversion: 2.1 time: 0.693460 Oct 08 21:01:13.188933 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1224/2410] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:01:12 2022] GET /compute/v2.1/servers/1510673d-866c-4e8c-9cb8-2dbc7f0a4115 => generated 1325 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:01:13.390153 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-4e4ec8c3-0305-4a8d-861e-808f87ddeca4 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:01:13.401963 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-4e4ec8c3-0305-4a8d-861e-808f87ddeca4 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/38b000d3-167b-4f7a-ab80-cd51fcb7cbaf" status: 200 len: 1476 microversion: 2.1 time: 0.450522 Oct 08 21:01:13.404723 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1187/2411] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:01:12 2022] GET /compute/v2.1/servers/38b000d3-167b-4f7a-ab80-cd51fcb7cbaf => generated 1476 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:01:13.660228 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-3cbbca02-8ad4-486c-aa04-b67cd7b129e3 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:13.660771 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-3cbbca02-8ad4-486c-aa04-b67cd7b129e3 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] [instance: c7527526-138f-45ff-8efc-8802410df8eb] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:13.668980 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3cbbca02-8ad4-486c-aa04-b67cd7b129e3 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:13.669465 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3cbbca02-8ad4-486c-aa04-b67cd7b129e3 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:13.669888 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3cbbca02-8ad4-486c-aa04-b67cd7b129e3 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:13.670796 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3cbbca02-8ad4-486c-aa04-b67cd7b129e3 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:13.671719 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3cbbca02-8ad4-486c-aa04-b67cd7b129e3 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:13.672442 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3cbbca02-8ad4-486c-aa04-b67cd7b129e3 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:13.878737 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-ad21b26d-f296-4dd3-9ae3-067ec4336b03 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-136646135", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "397efcee-7238-4c94-81ba-59f55206810f"}], "security_groups": [{"name": "tempest-securitygroup--400081875"}], "key_name": "tempest-keypair-1186969454", "user_data": "}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:01:14.017540 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.network.neutron [None req-ad21b26d-f296-4dd3-9ae3-067ec4336b03 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] validate_networks() for [('397efcee-7238-4c94-81ba-59f55206810f', None, None, None, None, None)] {{(pid=140491) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 21:01:14.499334 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-ad21b26d-f296-4dd3-9ae3-067ec4336b03 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Flavor limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 21:01:14.499775 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-ad21b26d-f296-4dd3-9ae3-067ec4336b03 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Image limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 21:01:14.501474 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-ad21b26d-f296-4dd3-9ae3-067ec4336b03 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Flavor pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 21:01:14.502814 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-ad21b26d-f296-4dd3-9ae3-067ec4336b03 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Image pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 21:01:14.503251 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-ad21b26d-f296-4dd3-9ae3-067ec4336b03 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 21:01:14.526772 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ad21b26d-f296-4dd3-9ae3-067ec4336b03 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:14.527268 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ad21b26d-f296-4dd3-9ae3-067ec4336b03 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:14.527710 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ad21b26d-f296-4dd3-9ae3-067ec4336b03 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:14.534005 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ad21b26d-f296-4dd3-9ae3-067ec4336b03 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:14.534868 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ad21b26d-f296-4dd3-9ae3-067ec4336b03 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:14.535490 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ad21b26d-f296-4dd3-9ae3-067ec4336b03 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:14.558666 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-3cbbca02-8ad4-486c-aa04-b67cd7b129e3 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d2ddfa343e748c089129b0039a12ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e191d6217f024a17a14184071ac674c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:01:14.566503 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-ad21b26d-f296-4dd3-9ae3-067ec4336b03 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Getting quotas for project 8b00ee5e7828469f95bd90548d35982a. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:01:14.568775 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-3cbbca02-8ad4-486c-aa04-b67cd7b129e3 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] 10.222.0.26 "GET /compute/v2.1/servers/c7527526-138f-45ff-8efc-8802410df8eb" status: 200 len: 1317 microversion: 2.1 time: 0.912295 Oct 08 21:01:14.573997 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-ad21b26d-f296-4dd3-9ae3-067ec4336b03 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Getting quotas for user 1698dee4a2bf4ea19a6ee0c3d5cb5c09 and project 8b00ee5e7828469f95bd90548d35982a. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:01:14.581897 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1225/2412] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:01:13 2022] GET /compute/v2.1/servers/c7527526-138f-45ff-8efc-8802410df8eb => generated 1317 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:01:14.590269 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-ad21b26d-f296-4dd3-9ae3-067ec4336b03 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Going to run 1 instances... {{(pid=140491) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 21:01:14.592991 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-ad21b26d-f296-4dd3-9ae3-067ec4336b03 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] [instance: 4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c508bd7f-7db9-4b2c-af7c-be54a855c355',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140491) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 21:01:14.595171 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-cc3a5c72-2546-436b-9623-f1935b21254f tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:14.596355 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-cc3a5c72-2546-436b-9623-f1935b21254f tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] [instance: 1510673d-866c-4e8c-9cb8-2dbc7f0a4115] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:14.606196 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cc3a5c72-2546-436b-9623-f1935b21254f tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:14.607100 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cc3a5c72-2546-436b-9623-f1935b21254f tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:14.607901 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cc3a5c72-2546-436b-9623-f1935b21254f tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:14.609062 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cc3a5c72-2546-436b-9623-f1935b21254f tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:14.609896 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cc3a5c72-2546-436b-9623-f1935b21254f tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:14.610594 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cc3a5c72-2546-436b-9623-f1935b21254f tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:14.664886 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-ad21b26d-f296-4dd3-9ae3-067ec4336b03 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.790132 Oct 08 21:01:14.667068 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1188/2413] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 21:01:13 2022] POST /compute/v2.1/servers => generated 408 bytes in 793 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 08 21:01:14.702922 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-73d4e64c-12a3-4ccf-881c-2b2d82497d07 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:14.703931 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-73d4e64c-12a3-4ccf-881c-2b2d82497d07 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: 38b000d3-167b-4f7a-ab80-cd51fcb7cbaf] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:14.711793 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-73d4e64c-12a3-4ccf-881c-2b2d82497d07 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:14.712415 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-73d4e64c-12a3-4ccf-881c-2b2d82497d07 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:14.712963 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-73d4e64c-12a3-4ccf-881c-2b2d82497d07 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:14.713846 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-73d4e64c-12a3-4ccf-881c-2b2d82497d07 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:14.714537 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-73d4e64c-12a3-4ccf-881c-2b2d82497d07 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:14.715080 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-73d4e64c-12a3-4ccf-881c-2b2d82497d07 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:14.881294 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-73d4e64c-12a3-4ccf-881c-2b2d82497d07 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:01:14.890179 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-73d4e64c-12a3-4ccf-881c-2b2d82497d07 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/38b000d3-167b-4f7a-ab80-cd51fcb7cbaf" status: 200 len: 1476 microversion: 2.1 time: 0.221928 Oct 08 21:01:14.907070 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1189/2414] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:01:14 2022] GET /compute/v2.1/servers/38b000d3-167b-4f7a-ab80-cd51fcb7cbaf => generated 1476 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:01:14.912320 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-bdf9e721-7606-4a45-a07e-7c964251dc81 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:14.913100 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-bdf9e721-7606-4a45-a07e-7c964251dc81 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] [instance: 4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:14.977043 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-bdf9e721-7606-4a45-a07e-7c964251dc81 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1698dee4a2bf4ea19a6ee0c3d5cb5c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b00ee5e7828469f95bd90548d35982a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:01:14.988103 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-bdf9e721-7606-4a45-a07e-7c964251dc81 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] 10.222.0.26 "GET /compute/v2.1/servers/4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711" status: 200 len: 1245 microversion: 2.1 time: 0.079547 Oct 08 21:01:14.989039 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1190/2415] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:01:14 2022] GET /compute/v2.1/servers/4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711 => generated 1245 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:01:14.995713 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-d351c77b-7d20-43f5-958a-f63d45941e3c req-eeda79e6-f4ef-42a5-a8ea-80b74d8184ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7527526-138f-45ff-8efc-8802410df8eb", "name": "network-vif-plugged", "status": "completed", "tag": "60c45ac4-b88e-4186-8382-80cf71deafab"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:01:15.019330 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-d351c77b-7d20-43f5-958a-f63d45941e3c req-eeda79e6-f4ef-42a5-a8ea-80b74d8184ec service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:15.020159 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-d351c77b-7d20-43f5-958a-f63d45941e3c req-eeda79e6-f4ef-42a5-a8ea-80b74d8184ec service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:15.020890 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-d351c77b-7d20-43f5-958a-f63d45941e3c req-eeda79e6-f4ef-42a5-a8ea-80b74d8184ec service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:15.038590 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-d351c77b-7d20-43f5-958a-f63d45941e3c req-eeda79e6-f4ef-42a5-a8ea-80b74d8184ec service nova] Creating event network-vif-plugged:60c45ac4-b88e-4186-8382-80cf71deafab for instance c7527526-138f-45ff-8efc-8802410df8eb on nch2-master-1 Oct 08 21:01:15.046963 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-d351c77b-7d20-43f5-958a-f63d45941e3c req-eeda79e6-f4ef-42a5-a8ea-80b74d8184ec service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055620 Oct 08 21:01:15.047808 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1191/2416] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:01:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:01:15.057988 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-cc3a5c72-2546-436b-9623-f1935b21254f tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06caf10b6fa43a3a2ad34858594e329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b10172715d423eb887d6c5b171defb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:01:15.073405 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-cc3a5c72-2546-436b-9623-f1935b21254f tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] 10.222.0.26 "GET /compute/v2.1/servers/1510673d-866c-4e8c-9cb8-2dbc7f0a4115" status: 200 len: 1325 microversion: 2.1 time: 0.485610 Oct 08 21:01:15.098561 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1226/2417] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:01:14 2022] GET /compute/v2.1/servers/1510673d-866c-4e8c-9cb8-2dbc7f0a4115 => generated 1325 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:01:15.103286 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-dd303943-b122-4cbd-b62a-35011c4e2685 req-ac1b1d08-3433-4f56-b979-80acaf8c0f07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ed82ee0-e56e-478e-a066-bad43e760a03", "tag": "2d6b498c-db99-42bb-a03a-e6ad5fc72076"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:01:15.143646 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-dd303943-b122-4cbd-b62a-35011c4e2685 req-ac1b1d08-3433-4f56-b979-80acaf8c0f07 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:15.146859 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-dd303943-b122-4cbd-b62a-35011c4e2685 req-ac1b1d08-3433-4f56-b979-80acaf8c0f07 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:15.152222 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-dd303943-b122-4cbd-b62a-35011c4e2685 req-ac1b1d08-3433-4f56-b979-80acaf8c0f07 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:15.187594 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-dd303943-b122-4cbd-b62a-35011c4e2685 req-ac1b1d08-3433-4f56-b979-80acaf8c0f07 service nova] Creating event network-changed:2d6b498c-db99-42bb-a03a-e6ad5fc72076 for instance 9ed82ee0-e56e-478e-a066-bad43e760a03 on nch1-master-1 Oct 08 21:01:15.199587 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-dd303943-b122-4cbd-b62a-35011c4e2685 req-ac1b1d08-3433-4f56-b979-80acaf8c0f07 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123654 Oct 08 21:01:15.202657 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1192/2418] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:01:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:01:15.598436 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-c89f7b5d-481a-4621-aab0-bad116ef1808 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:15.600219 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-c89f7b5d-481a-4621-aab0-bad116ef1808 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] [instance: c7527526-138f-45ff-8efc-8802410df8eb] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:15.618655 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c89f7b5d-481a-4621-aab0-bad116ef1808 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:15.619614 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c89f7b5d-481a-4621-aab0-bad116ef1808 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:15.620837 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c89f7b5d-481a-4621-aab0-bad116ef1808 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:15.623259 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c89f7b5d-481a-4621-aab0-bad116ef1808 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:15.625111 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c89f7b5d-481a-4621-aab0-bad116ef1808 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:15.627016 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c89f7b5d-481a-4621-aab0-bad116ef1808 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:15.914082 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-09aa9b08-6276-496d-bfba-4e3c1a5c4b2a tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:15.914797 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-09aa9b08-6276-496d-bfba-4e3c1a5c4b2a tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: 38b000d3-167b-4f7a-ab80-cd51fcb7cbaf] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:15.928984 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-c89f7b5d-481a-4621-aab0-bad116ef1808 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d2ddfa343e748c089129b0039a12ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e191d6217f024a17a14184071ac674c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:01:15.930241 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-09aa9b08-6276-496d-bfba-4e3c1a5c4b2a tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:15.930925 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-09aa9b08-6276-496d-bfba-4e3c1a5c4b2a tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:15.931697 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-09aa9b08-6276-496d-bfba-4e3c1a5c4b2a tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:15.936998 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-09aa9b08-6276-496d-bfba-4e3c1a5c4b2a tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:15.937718 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-09aa9b08-6276-496d-bfba-4e3c1a5c4b2a tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:15.938317 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-09aa9b08-6276-496d-bfba-4e3c1a5c4b2a tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:15.938659 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-c89f7b5d-481a-4621-aab0-bad116ef1808 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] 10.222.0.26 "GET /compute/v2.1/servers/c7527526-138f-45ff-8efc-8802410df8eb" status: 200 len: 1317 microversion: 2.1 time: 0.346426 Oct 08 21:01:15.958386 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1227/2419] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:01:15 2022] GET /compute/v2.1/servers/c7527526-138f-45ff-8efc-8802410df8eb => generated 1317 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:01:16.017520 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-26731f64-d9a5-40e4-8e3e-6f6b6c163c7c tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:16.018582 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-26731f64-d9a5-40e4-8e3e-6f6b6c163c7c tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] [instance: 4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:16.030344 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-26731f64-d9a5-40e4-8e3e-6f6b6c163c7c tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:16.033485 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-26731f64-d9a5-40e4-8e3e-6f6b6c163c7c tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:16.034019 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-26731f64-d9a5-40e4-8e3e-6f6b6c163c7c tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:16.035865 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-26731f64-d9a5-40e4-8e3e-6f6b6c163c7c tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:16.036361 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-26731f64-d9a5-40e4-8e3e-6f6b6c163c7c tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:16.036811 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-26731f64-d9a5-40e4-8e3e-6f6b6c163c7c tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:16.249731 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-26731f64-d9a5-40e4-8e3e-6f6b6c163c7c tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1698dee4a2bf4ea19a6ee0c3d5cb5c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b00ee5e7828469f95bd90548d35982a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:01:16.265066 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-26731f64-d9a5-40e4-8e3e-6f6b6c163c7c tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] 10.222.0.26 "GET /compute/v2.1/servers/4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711" status: 200 len: 1297 microversion: 2.1 time: 0.252261 Oct 08 21:01:16.265977 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1228/2420] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:01:16 2022] GET /compute/v2.1/servers/4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711 => generated 1297 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:01:16.270545 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-3b4f07d0-b034-4c16-99aa-e7cdf4677875 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:16.277389 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-3b4f07d0-b034-4c16-99aa-e7cdf4677875 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] [instance: 1510673d-866c-4e8c-9cb8-2dbc7f0a4115] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:16.310923 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3b4f07d0-b034-4c16-99aa-e7cdf4677875 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:16.311592 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3b4f07d0-b034-4c16-99aa-e7cdf4677875 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:16.312187 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3b4f07d0-b034-4c16-99aa-e7cdf4677875 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:16.313067 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3b4f07d0-b034-4c16-99aa-e7cdf4677875 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:16.313695 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3b4f07d0-b034-4c16-99aa-e7cdf4677875 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:16.314276 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3b4f07d0-b034-4c16-99aa-e7cdf4677875 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:16.380352 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-09aa9b08-6276-496d-bfba-4e3c1a5c4b2a tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:01:16.391644 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-09aa9b08-6276-496d-bfba-4e3c1a5c4b2a tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/38b000d3-167b-4f7a-ab80-cd51fcb7cbaf" status: 200 len: 1476 microversion: 2.1 time: 0.481982 Oct 08 21:01:16.403567 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1193/2421] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:01:15 2022] GET /compute/v2.1/servers/38b000d3-167b-4f7a-ab80-cd51fcb7cbaf => generated 1476 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:01:16.770502 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-3b4f07d0-b034-4c16-99aa-e7cdf4677875 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06caf10b6fa43a3a2ad34858594e329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b10172715d423eb887d6c5b171defb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:01:16.786100 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-3b4f07d0-b034-4c16-99aa-e7cdf4677875 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] 10.222.0.26 "GET /compute/v2.1/servers/1510673d-866c-4e8c-9cb8-2dbc7f0a4115" status: 200 len: 1522 microversion: 2.1 time: 0.519010 Oct 08 21:01:16.806259 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1229/2422] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:01:16 2022] GET /compute/v2.1/servers/1510673d-866c-4e8c-9cb8-2dbc7f0a4115 => generated 1522 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:01:16.820301 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c5afef00-d07c-4360-b023-83dce7477881 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:16.821266 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-c5afef00-d07c-4360-b023-83dce7477881 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] [instance: 1510673d-866c-4e8c-9cb8-2dbc7f0a4115] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:16.833553 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c5afef00-d07c-4360-b023-83dce7477881 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:16.835816 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c5afef00-d07c-4360-b023-83dce7477881 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:16.839796 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c5afef00-d07c-4360-b023-83dce7477881 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:16.843777 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c5afef00-d07c-4360-b023-83dce7477881 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:16.846471 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c5afef00-d07c-4360-b023-83dce7477881 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:16.847620 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c5afef00-d07c-4360-b023-83dce7477881 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:16.910294 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-c5afef00-d07c-4360-b023-83dce7477881 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] [instance: 1510673d-866c-4e8c-9cb8-2dbc7f0a4115] Going to try to terminate instance {{(pid=140491) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 21:01:16.971891 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-3172e08a-22ef-4226-8e54-5c16b3a0c7c0 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:16.972519 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-3172e08a-22ef-4226-8e54-5c16b3a0c7c0 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] [instance: c7527526-138f-45ff-8efc-8802410df8eb] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:16.983350 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3172e08a-22ef-4226-8e54-5c16b3a0c7c0 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:16.983866 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3172e08a-22ef-4226-8e54-5c16b3a0c7c0 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:16.984319 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3172e08a-22ef-4226-8e54-5c16b3a0c7c0 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:16.985053 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3172e08a-22ef-4226-8e54-5c16b3a0c7c0 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:16.988279 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3172e08a-22ef-4226-8e54-5c16b3a0c7c0 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:16.988784 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3172e08a-22ef-4226-8e54-5c16b3a0c7c0 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:17.110531 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-c5afef00-d07c-4360-b023-83dce7477881 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] 10.222.0.26 "DELETE /compute/v2.1/servers/1510673d-866c-4e8c-9cb8-2dbc7f0a4115" status: 204 len: 0 microversion: 2.1 time: 0.297535 Oct 08 21:01:17.112170 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1194/2423] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:01:16 2022] DELETE /compute/v2.1/servers/1510673d-866c-4e8c-9cb8-2dbc7f0a4115 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 21:01:17.125700 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-a31bdf59-0696-4eee-94e0-12fc58d4042d tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:17.128107 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-a31bdf59-0696-4eee-94e0-12fc58d4042d tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] [instance: 1510673d-866c-4e8c-9cb8-2dbc7f0a4115] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:17.148441 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a31bdf59-0696-4eee-94e0-12fc58d4042d tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:17.149353 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a31bdf59-0696-4eee-94e0-12fc58d4042d tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:17.149988 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a31bdf59-0696-4eee-94e0-12fc58d4042d tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:17.151684 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a31bdf59-0696-4eee-94e0-12fc58d4042d tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:17.152426 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a31bdf59-0696-4eee-94e0-12fc58d4042d tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:17.153009 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a31bdf59-0696-4eee-94e0-12fc58d4042d tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:17.357672 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-3172e08a-22ef-4226-8e54-5c16b3a0c7c0 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d2ddfa343e748c089129b0039a12ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e191d6217f024a17a14184071ac674c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:01:17.366603 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-3172e08a-22ef-4226-8e54-5c16b3a0c7c0 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] 10.222.0.26 "GET /compute/v2.1/servers/c7527526-138f-45ff-8efc-8802410df8eb" status: 200 len: 1508 microversion: 2.1 time: 0.398514 Oct 08 21:01:17.367210 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1230/2424] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:01:16 2022] GET /compute/v2.1/servers/c7527526-138f-45ff-8efc-8802410df8eb => generated 1508 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:01:17.385695 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-d3405386-5f13-4efa-a497-5a7ca2069e16 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:17.398822 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-d3405386-5f13-4efa-a497-5a7ca2069e16 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] [instance: 4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:17.425100 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d3405386-5f13-4efa-a497-5a7ca2069e16 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:17.426492 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d3405386-5f13-4efa-a497-5a7ca2069e16 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:17.427368 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d3405386-5f13-4efa-a497-5a7ca2069e16 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:17.428490 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d3405386-5f13-4efa-a497-5a7ca2069e16 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:17.430081 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d3405386-5f13-4efa-a497-5a7ca2069e16 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:17.430759 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d3405386-5f13-4efa-a497-5a7ca2069e16 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:17.585789 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-d3405386-5f13-4efa-a497-5a7ca2069e16 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1698dee4a2bf4ea19a6ee0c3d5cb5c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b00ee5e7828469f95bd90548d35982a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:01:17.613793 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-d3405386-5f13-4efa-a497-5a7ca2069e16 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] 10.222.0.26 "GET /compute/v2.1/servers/4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711" status: 200 len: 1303 microversion: 2.1 time: 0.245265 Oct 08 21:01:17.614641 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1231/2425] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:01:17 2022] GET /compute/v2.1/servers/4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711 => generated 1303 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:01:17.662300 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-6b27d294-1812-4325-810c-ffebf1fedca9 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:17.662954 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-6b27d294-1812-4325-810c-ffebf1fedca9 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: 38b000d3-167b-4f7a-ab80-cd51fcb7cbaf] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:17.686140 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6b27d294-1812-4325-810c-ffebf1fedca9 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:17.690362 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6b27d294-1812-4325-810c-ffebf1fedca9 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:17.690897 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6b27d294-1812-4325-810c-ffebf1fedca9 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:17.696747 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6b27d294-1812-4325-810c-ffebf1fedca9 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:17.705434 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6b27d294-1812-4325-810c-ffebf1fedca9 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:17.706078 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6b27d294-1812-4325-810c-ffebf1fedca9 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:17.709400 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-a31bdf59-0696-4eee-94e0-12fc58d4042d tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06caf10b6fa43a3a2ad34858594e329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b10172715d423eb887d6c5b171defb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:01:17.719630 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-a31bdf59-0696-4eee-94e0-12fc58d4042d tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] 10.222.0.26 "GET /compute/v2.1/servers/1510673d-866c-4e8c-9cb8-2dbc7f0a4115" status: 200 len: 1528 microversion: 2.1 time: 0.599900 Oct 08 21:01:17.721280 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1195/2426] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:01:17 2022] GET /compute/v2.1/servers/1510673d-866c-4e8c-9cb8-2dbc7f0a4115 => generated 1528 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:01:18.339364 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-6b27d294-1812-4325-810c-ffebf1fedca9 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:01:18.359727 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-6b27d294-1812-4325-810c-ffebf1fedca9 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/38b000d3-167b-4f7a-ab80-cd51fcb7cbaf" status: 200 len: 1476 microversion: 2.1 time: 0.743678 Oct 08 21:01:18.360965 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1232/2427] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:01:17 2022] GET /compute/v2.1/servers/38b000d3-167b-4f7a-ab80-cd51fcb7cbaf => generated 1476 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:01:18.643176 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-baa49af5-7ff0-40f9-9319-2a8196785bba tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:18.644087 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-baa49af5-7ff0-40f9-9319-2a8196785bba tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] [instance: 4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:18.665967 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-baa49af5-7ff0-40f9-9319-2a8196785bba tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:18.670942 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-baa49af5-7ff0-40f9-9319-2a8196785bba tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:18.672252 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-baa49af5-7ff0-40f9-9319-2a8196785bba tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:18.677663 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-baa49af5-7ff0-40f9-9319-2a8196785bba tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:18.678633 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-baa49af5-7ff0-40f9-9319-2a8196785bba tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:18.679250 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-baa49af5-7ff0-40f9-9319-2a8196785bba tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:18.749096 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-b83ff37c-d915-4887-8420-7baf2121470a tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:18.750051 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-b83ff37c-d915-4887-8420-7baf2121470a tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] [instance: 1510673d-866c-4e8c-9cb8-2dbc7f0a4115] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:18.802732 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b83ff37c-d915-4887-8420-7baf2121470a tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:18.803584 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b83ff37c-d915-4887-8420-7baf2121470a tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:18.806233 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b83ff37c-d915-4887-8420-7baf2121470a tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:18.807868 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b83ff37c-d915-4887-8420-7baf2121470a tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:18.810467 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b83ff37c-d915-4887-8420-7baf2121470a tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:18.812104 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b83ff37c-d915-4887-8420-7baf2121470a tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:19.009103 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-baa49af5-7ff0-40f9-9319-2a8196785bba tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1698dee4a2bf4ea19a6ee0c3d5cb5c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b00ee5e7828469f95bd90548d35982a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:01:19.024530 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-baa49af5-7ff0-40f9-9319-2a8196785bba tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] 10.222.0.26 "GET /compute/v2.1/servers/4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711" status: 200 len: 1303 microversion: 2.1 time: 0.380011 Oct 08 21:01:19.025358 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1196/2428] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:01:18 2022] GET /compute/v2.1/servers/4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711 => generated 1303 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:01:19.199662 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c6dc1dd1-1e90-4518-a8dd-9acefa2181fb tempest-VolumesAdminNegativeTest-947119268 tempest-VolumesAdminNegativeTest-947119268-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "c8bffdb4-b1dc-45a7-b95f-5219d71fdc6c"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:01:19.202387 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-c6dc1dd1-1e90-4518-a8dd-9acefa2181fb tempest-VolumesAdminNegativeTest-947119268 tempest-VolumesAdminNegativeTest-947119268-project-admin] [instance: c7527526-138f-45ff-8efc-8802410df8eb] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:19.213823 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c6dc1dd1-1e90-4518-a8dd-9acefa2181fb tempest-VolumesAdminNegativeTest-947119268 tempest-VolumesAdminNegativeTest-947119268-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:19.214323 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c6dc1dd1-1e90-4518-a8dd-9acefa2181fb tempest-VolumesAdminNegativeTest-947119268 tempest-VolumesAdminNegativeTest-947119268-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:19.214766 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c6dc1dd1-1e90-4518-a8dd-9acefa2181fb tempest-VolumesAdminNegativeTest-947119268 tempest-VolumesAdminNegativeTest-947119268-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:19.215481 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c6dc1dd1-1e90-4518-a8dd-9acefa2181fb tempest-VolumesAdminNegativeTest-947119268 tempest-VolumesAdminNegativeTest-947119268-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:19.215934 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c6dc1dd1-1e90-4518-a8dd-9acefa2181fb tempest-VolumesAdminNegativeTest-947119268 tempest-VolumesAdminNegativeTest-947119268-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:19.216362 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c6dc1dd1-1e90-4518-a8dd-9acefa2181fb tempest-VolumesAdminNegativeTest-947119268 tempest-VolumesAdminNegativeTest-947119268-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:19.290481 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-c6dc1dd1-1e90-4518-a8dd-9acefa2181fb tempest-VolumesAdminNegativeTest-947119268 tempest-VolumesAdminNegativeTest-947119268-project-admin] HTTP exception thrown: Volume 5a49ee5e-6f76-4757-91be-86470f6b03d9 could not be found. Oct 08 21:01:19.295674 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c6dc1dd1-1e90-4518-a8dd-9acefa2181fb tempest-VolumesAdminNegativeTest-947119268 tempest-VolumesAdminNegativeTest-947119268-project-admin] Request method failure captured: Oct 08 21:01:19.295674 ncdv-master-1 devstack@n-api.service[140491]: request: PUT /compute/v2.1/servers/c7527526-138f-45ff-8efc-8802410df8eb/os-volume_attachments/5a49ee5e-6f76-4757-91be-86470f6b03d9 HTTP/1.1 Oct 08 21:01:19.295674 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:01:19.295674 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:01:19.295674 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:01:19.295674 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 74 Oct 08 21:01:19.295674 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:01:19.295674 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:01:19.295674 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:01:19.295674 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:01:19.295674 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeSwakQbIJw1lTa2q5Yw0s3PXumFVZqxrVxGWf4nV_pdbQXONokb1F4cu3Jg5rdQ3tgVNoSgjvU8sYNEdAQOLMComb0NzvjHmDHGzweoELtk3jzaV7QaSM2pGGCQsQIFedcBAsY2LVeS0tWfCa2dU9hwDzolYxLg9_5mF7uP6AbuJDc Oct 08 21:01:19.295674 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:01:19.295674 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:01:19.295674 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:01:19.295674 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:01:19.295674 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:01:19.295674 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:01:19.295674 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: cff16d5d25424e24a25a40e1b0373536 Oct 08 21:01:19.295674 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-VolumesAdminNegativeTest-947119268 Oct 08 21:01:19.295674 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,admin,member Oct 08 21:01:19.295674 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,admin,member Oct 08 21:01:19.295674 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/cff16d5d25424e24a25a40e1b0373536"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/cff16d5d25424e24a25a40e1b0373536"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_cff16d5d25424e24a25a40e1b0373536"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/cff16d5d25424e24a25a40e1b0373536"}]}] Oct 08 21:01:19.295674 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-VolumesAdminNegativeTest-947119268 Oct 08 21:01:19.295674 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: cff16d5d25424e24a25a40e1b0373536 Oct 08 21:01:19.295674 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-947119268 Oct 08 21:01:19.295674 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-VolumesAdminNegativeTest-947119268-project-admin Oct 08 21:01:19.295674 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:01:19.295674 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:01:19.295674 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: fb0f01bd824f47bdbb676f945f6462fb Oct 08 21:01:19.295674 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-VolumesAdminNegativeTest-947119268-project-admin Oct 08 21:01:19.295674 ncdv-master-1 devstack@n-api.service[140491]: Oct 08 21:01:19.295674 ncdv-master-1 devstack@n-api.service[140491]: {"volumeAttachment": {"volumeId": "c8bffdb4-b1dc-45a7-b95f-5219d71fdc6c"}} Oct 08 21:01:19.295674 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:01:19.295674 ncdv-master-1 devstack@n-api.service[140491]: exception: Volume 5a49ee5e-6f76-4757-91be-86470f6b03d9 could not be found. Oct 08 21:01:19.295674 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'server_id': 'c7527526-138f-45ff-8efc-8802410df8eb', 'id': '5a49ee5e-6f76-4757-91be-86470f6b03d9', 'body': {'volumeAttachment': {'volumeId': 'c8bffdb4-b1dc-45a7-b95f-5219d71fdc6c'}}} Oct 08 21:01:19.295674 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:01:19.295674 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:01:19.295674 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 08 21:01:19.295674 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 08 21:01:19.295674 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 08 21:01:19.295674 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 08 21:01:19.295674 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 08 21:01:19.295674 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 08 21:01:19.295674 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 08 21:01:19.295674 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 08 21:01:19.295674 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 08 21:01:19.295674 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 08 21:01:19.295674 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 08 21:01:19.295674 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 08 21:01:19.295674 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 08 21:01:19.295674 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 08 21:01:19.295674 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5a49ee5e-6f76-4757-91be-86470f6b03d9 could not be found. (HTTP 404) (Request-ID: req-90caceda-bfa6-4b75-9d70-aa5fbb20dee2) Oct 08 21:01:19.295674 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:01:19.295674 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:01:19.295674 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:01:19.295674 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:01:19.295674 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Oct 08 21:01:19.295674 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Oct 08 21:01:19.295674 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 08 21:01:19.295674 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 08 21:01:19.295674 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 08 21:01:19.299946 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 08 21:01:19.299946 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 08 21:01:19.299946 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 08 21:01:19.299946 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 08 21:01:19.299946 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 08 21:01:19.299946 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 08 21:01:19.299946 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 08 21:01:19.299946 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 08 21:01:19.299946 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 08 21:01:19.299946 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 08 21:01:19.299946 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 08 21:01:19.299946 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 08 21:01:19.299946 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 08 21:01:19.299946 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 08 21:01:19.299946 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 08 21:01:19.299946 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 08 21:01:19.299946 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 08 21:01:19.299946 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5a49ee5e-6f76-4757-91be-86470f6b03d9 could not be found. Oct 08 21:01:19.299946 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:01:19.299946 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:01:19.299946 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:01:19.299946 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:01:19.299946 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:01:19.299946 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:01:19.299946 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:01:19.299946 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:01:19.299946 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:01:19.299946 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:01:19.299946 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 21:01:19.299946 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 21:01:19.299946 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 21:01:19.299946 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 21:01:19.299946 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Oct 08 21:01:19.299946 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Oct 08 21:01:19.299946 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Oct 08 21:01:19.299946 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:01:19.299946 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5a49ee5e-6f76-4757-91be-86470f6b03d9 could not be found. Oct 08 21:01:19.299946 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:01:19.299946 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:01:19.299946 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:01:19.299946 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:01:19.299946 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:01:19.299946 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:01:19.299946 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:01:19.299946 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:01:19.299946 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5a49ee5e-6f76-4757-91be-86470f6b03d9 could not be found. Oct 08 21:01:19.299946 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:01:19.305571 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c6dc1dd1-1e90-4518-a8dd-9acefa2181fb tempest-VolumesAdminNegativeTest-947119268 tempest-VolumesAdminNegativeTest-947119268-project-admin] Returning 404 to user: Volume 5a49ee5e-6f76-4757-91be-86470f6b03d9 could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:01:19.306680 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-c6dc1dd1-1e90-4518-a8dd-9acefa2181fb tempest-VolumesAdminNegativeTest-947119268 tempest-VolumesAdminNegativeTest-947119268-project-admin] 10.222.0.26 "PUT /compute/v2.1/servers/c7527526-138f-45ff-8efc-8802410df8eb/os-volume_attachments/5a49ee5e-6f76-4757-91be-86470f6b03d9" status: 404 len: 109 microversion: 2.1 time: 0.110986 Oct 08 21:01:19.312858 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1197/2429] 10.222.0.26 () {60 vars in 1433 bytes} [Sat Oct 8 21:01:19 2022] PUT /compute/v2.1/servers/c7527526-138f-45ff-8efc-8802410df8eb/os-volume_attachments/5a49ee5e-6f76-4757-91be-86470f6b03d9 => generated 109 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 08 21:01:19.331161 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-b83ff37c-d915-4887-8420-7baf2121470a tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06caf10b6fa43a3a2ad34858594e329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b10172715d423eb887d6c5b171defb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:01:19.340957 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-b83ff37c-d915-4887-8420-7baf2121470a tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] 10.222.0.26 "GET /compute/v2.1/servers/1510673d-866c-4e8c-9cb8-2dbc7f0a4115" status: 200 len: 1528 microversion: 2.1 time: 0.598418 Oct 08 21:01:19.341714 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1233/2430] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:01:18 2022] GET /compute/v2.1/servers/1510673d-866c-4e8c-9cb8-2dbc7f0a4115 => generated 1528 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:01:19.387886 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-7f41b97f-16da-436e-b02a-9bace15c2bcc tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:19.388730 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-7f41b97f-16da-436e-b02a-9bace15c2bcc tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: 38b000d3-167b-4f7a-ab80-cd51fcb7cbaf] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:19.398190 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7f41b97f-16da-436e-b02a-9bace15c2bcc tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:19.399183 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7f41b97f-16da-436e-b02a-9bace15c2bcc tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:19.399950 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7f41b97f-16da-436e-b02a-9bace15c2bcc tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:19.401595 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7f41b97f-16da-436e-b02a-9bace15c2bcc tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:19.402259 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7f41b97f-16da-436e-b02a-9bace15c2bcc tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:19.402885 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7f41b97f-16da-436e-b02a-9bace15c2bcc tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:20.056105 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-fb99ea31-716c-40d1-abbd-df36fffddfa7 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:20.056777 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-fb99ea31-716c-40d1-abbd-df36fffddfa7 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] [instance: 4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:20.078715 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fb99ea31-716c-40d1-abbd-df36fffddfa7 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:20.079225 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fb99ea31-716c-40d1-abbd-df36fffddfa7 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:20.079678 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fb99ea31-716c-40d1-abbd-df36fffddfa7 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:20.087764 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fb99ea31-716c-40d1-abbd-df36fffddfa7 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:20.087898 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fb99ea31-716c-40d1-abbd-df36fffddfa7 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:20.088906 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fb99ea31-716c-40d1-abbd-df36fffddfa7 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:20.137356 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-7f41b97f-16da-436e-b02a-9bace15c2bcc tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:01:20.151305 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-7f41b97f-16da-436e-b02a-9bace15c2bcc tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/38b000d3-167b-4f7a-ab80-cd51fcb7cbaf" status: 200 len: 1476 microversion: 2.1 time: 0.770092 Oct 08 21:01:20.151995 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1198/2431] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:01:19 2022] GET /compute/v2.1/servers/38b000d3-167b-4f7a-ab80-cd51fcb7cbaf => generated 1476 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:01:20.365871 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-97f68cc1-8ab3-437a-855e-d2b54f6bfbe0 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:20.366746 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-97f68cc1-8ab3-437a-855e-d2b54f6bfbe0 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] [instance: 1510673d-866c-4e8c-9cb8-2dbc7f0a4115] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:20.375671 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-97f68cc1-8ab3-437a-855e-d2b54f6bfbe0 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:20.380933 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-97f68cc1-8ab3-437a-855e-d2b54f6bfbe0 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:20.382359 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-97f68cc1-8ab3-437a-855e-d2b54f6bfbe0 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:20.388346 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-97f68cc1-8ab3-437a-855e-d2b54f6bfbe0 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:20.389749 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-97f68cc1-8ab3-437a-855e-d2b54f6bfbe0 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:20.390396 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-97f68cc1-8ab3-437a-855e-d2b54f6bfbe0 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:20.430142 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-fb99ea31-716c-40d1-abbd-df36fffddfa7 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1698dee4a2bf4ea19a6ee0c3d5cb5c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b00ee5e7828469f95bd90548d35982a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:01:20.438430 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-fb99ea31-716c-40d1-abbd-df36fffddfa7 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] 10.222.0.26 "GET /compute/v2.1/servers/4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711" status: 200 len: 1303 microversion: 2.1 time: 0.394045 Oct 08 21:01:20.442281 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1234/2432] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:01:20 2022] GET /compute/v2.1/servers/4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711 => generated 1303 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:01:20.567720 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-27e47c46-2042-4a19-8064-28a85e8c28e3 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:20.568496 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-27e47c46-2042-4a19-8064-28a85e8c28e3 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] [instance: c7527526-138f-45ff-8efc-8802410df8eb] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:20.571483 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=10 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:01:20.575960 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-27e47c46-2042-4a19-8064-28a85e8c28e3 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:20.576452 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-27e47c46-2042-4a19-8064-28a85e8c28e3 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:20.576896 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-27e47c46-2042-4a19-8064-28a85e8c28e3 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:20.586453 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-27e47c46-2042-4a19-8064-28a85e8c28e3 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:20.586967 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-27e47c46-2042-4a19-8064-28a85e8c28e3 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:20.587421 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-27e47c46-2042-4a19-8064-28a85e8c28e3 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:20.637899 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-27e47c46-2042-4a19-8064-28a85e8c28e3 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] [instance: c7527526-138f-45ff-8efc-8802410df8eb] Going to try to terminate instance {{(pid=140492) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 21:01:20.816046 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-27e47c46-2042-4a19-8064-28a85e8c28e3 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] 10.222.0.26 "DELETE /compute/v2.1/servers/c7527526-138f-45ff-8efc-8802410df8eb" status: 204 len: 0 microversion: 2.1 time: 0.250600 Oct 08 21:01:20.825298 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1235/2433] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:01:20 2022] DELETE /compute/v2.1/servers/c7527526-138f-45ff-8efc-8802410df8eb => generated 0 bytes in 259 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 08 21:01:20.834848 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-cd33e447-a903-467c-8cde-de26c568dbbb tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:20.845825 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-cd33e447-a903-467c-8cde-de26c568dbbb tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] [instance: c7527526-138f-45ff-8efc-8802410df8eb] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:20.853866 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cd33e447-a903-467c-8cde-de26c568dbbb tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:20.857826 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cd33e447-a903-467c-8cde-de26c568dbbb tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:20.858287 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cd33e447-a903-467c-8cde-de26c568dbbb tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:20.859051 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cd33e447-a903-467c-8cde-de26c568dbbb tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:20.859526 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cd33e447-a903-467c-8cde-de26c568dbbb tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:20.859957 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cd33e447-a903-467c-8cde-de26c568dbbb tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:20.949162 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-97f68cc1-8ab3-437a-855e-d2b54f6bfbe0 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06caf10b6fa43a3a2ad34858594e329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b10172715d423eb887d6c5b171defb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:01:20.985334 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-97f68cc1-8ab3-437a-855e-d2b54f6bfbe0 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] 10.222.0.26 "GET /compute/v2.1/servers/1510673d-866c-4e8c-9cb8-2dbc7f0a4115" status: 200 len: 1528 microversion: 2.1 time: 0.617995 Oct 08 21:01:20.987325 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1199/2434] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:01:20 2022] GET /compute/v2.1/servers/1510673d-866c-4e8c-9cb8-2dbc7f0a4115 => generated 1528 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:01:21.126600 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-89d915df-a973-47fc-8b0a-cccb91961797 req-06d6c946-c101-495f-9eb2-7fa759a2aa27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1510673d-866c-4e8c-9cb8-2dbc7f0a4115", "name": "network-vif-deleted", "tag": "97731b82-e11f-43c5-aae3-a4d1491e39b9"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:01:21.146934 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-89d915df-a973-47fc-8b0a-cccb91961797 req-06d6c946-c101-495f-9eb2-7fa759a2aa27 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:21.153688 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-89d915df-a973-47fc-8b0a-cccb91961797 req-06d6c946-c101-495f-9eb2-7fa759a2aa27 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:21.154491 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-89d915df-a973-47fc-8b0a-cccb91961797 req-06d6c946-c101-495f-9eb2-7fa759a2aa27 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:21.179922 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-cd33e447-a903-467c-8cde-de26c568dbbb tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d2ddfa343e748c089129b0039a12ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e191d6217f024a17a14184071ac674c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:01:21.184078 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-89d915df-a973-47fc-8b0a-cccb91961797 req-06d6c946-c101-495f-9eb2-7fa759a2aa27 service nova] Creating event network-vif-deleted:97731b82-e11f-43c5-aae3-a4d1491e39b9 for instance 1510673d-866c-4e8c-9cb8-2dbc7f0a4115 on nch2-master-1 Oct 08 21:01:21.191421 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-89d915df-a973-47fc-8b0a-cccb91961797 req-06d6c946-c101-495f-9eb2-7fa759a2aa27 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076934 Oct 08 21:01:21.191946 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-cd33e447-a903-467c-8cde-de26c568dbbb tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] 10.222.0.26 "GET /compute/v2.1/servers/c7527526-138f-45ff-8efc-8802410df8eb" status: 200 len: 1514 microversion: 2.1 time: 0.363267 Oct 08 21:01:21.193961 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1236/2435] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:01:20 2022] GET /compute/v2.1/servers/c7527526-138f-45ff-8efc-8802410df8eb => generated 1514 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:01:21.208420 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e22454a6-c388-4414-b98a-d25ed68be9a1 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:21.208974 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1200/2436] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:01:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 08 21:01:21.209548 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-e22454a6-c388-4414-b98a-d25ed68be9a1 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: 38b000d3-167b-4f7a-ab80-cd51fcb7cbaf] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:21.240652 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e22454a6-c388-4414-b98a-d25ed68be9a1 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:21.241507 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e22454a6-c388-4414-b98a-d25ed68be9a1 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:21.245947 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e22454a6-c388-4414-b98a-d25ed68be9a1 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:21.247034 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e22454a6-c388-4414-b98a-d25ed68be9a1 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:21.256472 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e22454a6-c388-4414-b98a-d25ed68be9a1 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:21.257741 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e22454a6-c388-4414-b98a-d25ed68be9a1 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:21.474214 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-73f12566-16b2-427c-9709-2c4425811d64 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:21.475279 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-73f12566-16b2-427c-9709-2c4425811d64 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] [instance: 4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:21.487343 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-73f12566-16b2-427c-9709-2c4425811d64 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:21.490096 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-73f12566-16b2-427c-9709-2c4425811d64 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:21.491451 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-73f12566-16b2-427c-9709-2c4425811d64 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:21.493154 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-73f12566-16b2-427c-9709-2c4425811d64 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:21.494904 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-73f12566-16b2-427c-9709-2c4425811d64 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:21.495758 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-73f12566-16b2-427c-9709-2c4425811d64 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:21.596500 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-e22454a6-c388-4414-b98a-d25ed68be9a1 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:01:21.609152 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-e22454a6-c388-4414-b98a-d25ed68be9a1 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/38b000d3-167b-4f7a-ab80-cd51fcb7cbaf" status: 200 len: 1476 microversion: 2.1 time: 0.413604 Oct 08 21:01:21.610539 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1237/2437] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:01:21 2022] GET /compute/v2.1/servers/38b000d3-167b-4f7a-ab80-cd51fcb7cbaf => generated 1476 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:01:21.927269 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-73f12566-16b2-427c-9709-2c4425811d64 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1698dee4a2bf4ea19a6ee0c3d5cb5c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b00ee5e7828469f95bd90548d35982a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:01:21.938644 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-73f12566-16b2-427c-9709-2c4425811d64 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] 10.222.0.26 "GET /compute/v2.1/servers/4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711" status: 200 len: 1370 microversion: 2.1 time: 0.471902 Oct 08 21:01:21.941020 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1201/2438] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:01:21 2022] GET /compute/v2.1/servers/4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711 => generated 1370 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:01:22.013719 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-9d41214e-7cbf-4b7f-a099-89e5f2a874d5 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:22.016002 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-9d41214e-7cbf-4b7f-a099-89e5f2a874d5 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] [instance: 1510673d-866c-4e8c-9cb8-2dbc7f0a4115] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:22.030461 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9d41214e-7cbf-4b7f-a099-89e5f2a874d5 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:22.031112 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9d41214e-7cbf-4b7f-a099-89e5f2a874d5 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:22.031768 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9d41214e-7cbf-4b7f-a099-89e5f2a874d5 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:22.032287 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9d41214e-7cbf-4b7f-a099-89e5f2a874d5 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:22.036577 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9d41214e-7cbf-4b7f-a099-89e5f2a874d5 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:22.037059 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9d41214e-7cbf-4b7f-a099-89e5f2a874d5 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:22.058211 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:01:22.196271 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-9d41214e-7cbf-4b7f-a099-89e5f2a874d5 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06caf10b6fa43a3a2ad34858594e329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b10172715d423eb887d6c5b171defb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:01:22.206863 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-9d41214e-7cbf-4b7f-a099-89e5f2a874d5 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] 10.222.0.26 "GET /compute/v2.1/servers/1510673d-866c-4e8c-9cb8-2dbc7f0a4115" status: 200 len: 1310 microversion: 2.1 time: 0.201198 Oct 08 21:01:22.208627 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1238/2439] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:01:22 2022] GET /compute/v2.1/servers/1510673d-866c-4e8c-9cb8-2dbc7f0a4115 => generated 1310 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:01:22.230472 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-0f726c2f-9f64-4db2-b810-e57522eef702 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:22.231120 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-0f726c2f-9f64-4db2-b810-e57522eef702 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] [instance: c7527526-138f-45ff-8efc-8802410df8eb] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:22.241544 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0f726c2f-9f64-4db2-b810-e57522eef702 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:22.242434 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0f726c2f-9f64-4db2-b810-e57522eef702 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:22.251061 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0f726c2f-9f64-4db2-b810-e57522eef702 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:22.256096 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0f726c2f-9f64-4db2-b810-e57522eef702 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:22.256910 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0f726c2f-9f64-4db2-b810-e57522eef702 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:22.257594 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0f726c2f-9f64-4db2-b810-e57522eef702 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:22.632655 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-3d6be4ef-19c6-4840-91b4-f649af7a9e0d tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:22.633391 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-3d6be4ef-19c6-4840-91b4-f649af7a9e0d tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: 38b000d3-167b-4f7a-ab80-cd51fcb7cbaf] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:22.646669 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3d6be4ef-19c6-4840-91b4-f649af7a9e0d tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:22.649470 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3d6be4ef-19c6-4840-91b4-f649af7a9e0d tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:22.651626 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3d6be4ef-19c6-4840-91b4-f649af7a9e0d tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:22.652647 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3d6be4ef-19c6-4840-91b4-f649af7a9e0d tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:22.655140 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3d6be4ef-19c6-4840-91b4-f649af7a9e0d tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:22.657687 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3d6be4ef-19c6-4840-91b4-f649af7a9e0d tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:22.706611 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-0f726c2f-9f64-4db2-b810-e57522eef702 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d2ddfa343e748c089129b0039a12ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e191d6217f024a17a14184071ac674c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:01:22.716448 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-0f726c2f-9f64-4db2-b810-e57522eef702 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] 10.222.0.26 "GET /compute/v2.1/servers/c7527526-138f-45ff-8efc-8802410df8eb" status: 200 len: 1514 microversion: 2.1 time: 0.493770 Oct 08 21:01:22.725279 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1202/2440] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:01:22 2022] GET /compute/v2.1/servers/c7527526-138f-45ff-8efc-8802410df8eb => generated 1514 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:01:22.968308 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-70542c90-0231-473b-80c4-d4c28f054454 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:22.969271 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-70542c90-0231-473b-80c4-d4c28f054454 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] [instance: 4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:22.977111 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-70542c90-0231-473b-80c4-d4c28f054454 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:22.990381 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-70542c90-0231-473b-80c4-d4c28f054454 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:22.990854 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-70542c90-0231-473b-80c4-d4c28f054454 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:22.991649 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-70542c90-0231-473b-80c4-d4c28f054454 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:22.992097 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-70542c90-0231-473b-80c4-d4c28f054454 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:23.004384 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-70542c90-0231-473b-80c4-d4c28f054454 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:23.327618 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-3d6be4ef-19c6-4840-91b4-f649af7a9e0d tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:01:23.341721 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-3d6be4ef-19c6-4840-91b4-f649af7a9e0d tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/38b000d3-167b-4f7a-ab80-cd51fcb7cbaf" status: 200 len: 1476 microversion: 2.1 time: 0.713408 Oct 08 21:01:23.353221 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1239/2441] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:01:22 2022] GET /compute/v2.1/servers/38b000d3-167b-4f7a-ab80-cd51fcb7cbaf => generated 1476 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:01:23.359507 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-8c04caef-a682-467f-8103-4fd6ecc10b53 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:23.359507 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-8c04caef-a682-467f-8103-4fd6ecc10b53 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] [instance: 1510673d-866c-4e8c-9cb8-2dbc7f0a4115] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:23.373011 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8c04caef-a682-467f-8103-4fd6ecc10b53 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:23.376047 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8c04caef-a682-467f-8103-4fd6ecc10b53 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:23.376517 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8c04caef-a682-467f-8103-4fd6ecc10b53 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:23.380675 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8c04caef-a682-467f-8103-4fd6ecc10b53 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:23.381728 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8c04caef-a682-467f-8103-4fd6ecc10b53 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:23.382185 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8c04caef-a682-467f-8103-4fd6ecc10b53 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:23.486252 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8c04caef-a682-467f-8103-4fd6ecc10b53 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:23.486751 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8c04caef-a682-467f-8103-4fd6ecc10b53 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:23.487194 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8c04caef-a682-467f-8103-4fd6ecc10b53 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:23.487655 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.objects.instance [None req-8c04caef-a682-467f-8103-4fd6ecc10b53 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lazy-loading 'fault' on Instance uuid 1510673d-866c-4e8c-9cb8-2dbc7f0a4115 {{(pid=140492) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 21:01:23.531862 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-70542c90-0231-473b-80c4-d4c28f054454 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1698dee4a2bf4ea19a6ee0c3d5cb5c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b00ee5e7828469f95bd90548d35982a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:01:23.543465 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-70542c90-0231-473b-80c4-d4c28f054454 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] 10.222.0.26 "GET /compute/v2.1/servers/4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711" status: 200 len: 1370 microversion: 2.1 time: 0.579157 Oct 08 21:01:23.544433 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1203/2442] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:01:22 2022] GET /compute/v2.1/servers/4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711 => generated 1370 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:01:23.622628 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-8c04caef-a682-467f-8103-4fd6ecc10b53 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06caf10b6fa43a3a2ad34858594e329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b10172715d423eb887d6c5b171defb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:01:23.634290 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-8c04caef-a682-467f-8103-4fd6ecc10b53 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] 10.222.0.26 "GET /compute/v2.1/servers/1510673d-866c-4e8c-9cb8-2dbc7f0a4115" status: 200 len: 1315 microversion: 2.1 time: 0.290051 Oct 08 21:01:23.638450 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1240/2443] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:01:23 2022] GET /compute/v2.1/servers/1510673d-866c-4e8c-9cb8-2dbc7f0a4115 => generated 1315 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:01:23.749263 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-d870d706-8149-45c6-af1f-af5722dfa734 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:23.750002 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-d870d706-8149-45c6-af1f-af5722dfa734 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] [instance: c7527526-138f-45ff-8efc-8802410df8eb] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:23.765910 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d870d706-8149-45c6-af1f-af5722dfa734 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:23.768380 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d870d706-8149-45c6-af1f-af5722dfa734 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:23.769949 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d870d706-8149-45c6-af1f-af5722dfa734 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:23.777163 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d870d706-8149-45c6-af1f-af5722dfa734 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:23.777960 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d870d706-8149-45c6-af1f-af5722dfa734 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:23.778589 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d870d706-8149-45c6-af1f-af5722dfa734 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:23.782362 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:01:23.967616 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-4a84d58a-3cdb-4049-8144-092dd4e187b0 req-c43babb2-7e4f-4a83-aa8b-5fd6c04598da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711", "tag": "946a04d7-8297-4f58-81d9-eda02ade611b"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:01:24.005478 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-4a84d58a-3cdb-4049-8144-092dd4e187b0 req-c43babb2-7e4f-4a83-aa8b-5fd6c04598da service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:24.006084 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-4a84d58a-3cdb-4049-8144-092dd4e187b0 req-c43babb2-7e4f-4a83-aa8b-5fd6c04598da service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:24.006684 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-4a84d58a-3cdb-4049-8144-092dd4e187b0 req-c43babb2-7e4f-4a83-aa8b-5fd6c04598da service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:24.031756 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-4a84d58a-3cdb-4049-8144-092dd4e187b0 req-c43babb2-7e4f-4a83-aa8b-5fd6c04598da service nova] Creating event network-changed:946a04d7-8297-4f58-81d9-eda02ade611b for instance 4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711 on nch1-master-1 Oct 08 21:01:24.040611 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-4a84d58a-3cdb-4049-8144-092dd4e187b0 req-c43babb2-7e4f-4a83-aa8b-5fd6c04598da service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082004 Oct 08 21:01:24.041915 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1241/2444] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:01:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 08 21:01:24.313639 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-b48af8dd-7455-4b9b-b4c4-3319235ecce3 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-61503033", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "networks": [{"uuid": "29af7df3-8960-406a-b175-f7f23d53fb33"}]}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:01:24.424603 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.network.neutron [None req-b48af8dd-7455-4b9b-b4c4-3319235ecce3 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] validate_networks() for [('29af7df3-8960-406a-b175-f7f23d53fb33', None, None, None, None, None)] {{(pid=140492) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 21:01:24.520550 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-d870d706-8149-45c6-af1f-af5722dfa734 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d2ddfa343e748c089129b0039a12ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e191d6217f024a17a14184071ac674c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:01:24.536764 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-d870d706-8149-45c6-af1f-af5722dfa734 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] 10.222.0.26 "GET /compute/v2.1/servers/c7527526-138f-45ff-8efc-8802410df8eb" status: 200 len: 1514 microversion: 2.1 time: 0.792356 Oct 08 21:01:24.538016 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1204/2445] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:01:23 2022] GET /compute/v2.1/servers/c7527526-138f-45ff-8efc-8802410df8eb => generated 1514 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:01:24.553455 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-3514036a-fbab-4887-81a9-de8a78d1466b req-57712962-66aa-4901-af67-135c84a76012 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7527526-138f-45ff-8efc-8802410df8eb", "name": "network-vif-deleted", "tag": "60c45ac4-b88e-4186-8382-80cf71deafab"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:01:24.562539 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=2 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:01:24.571238 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-3514036a-fbab-4887-81a9-de8a78d1466b req-57712962-66aa-4901-af67-135c84a76012 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:24.572056 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-3514036a-fbab-4887-81a9-de8a78d1466b req-57712962-66aa-4901-af67-135c84a76012 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:24.573520 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-3514036a-fbab-4887-81a9-de8a78d1466b req-57712962-66aa-4901-af67-135c84a76012 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:24.596634 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-3514036a-fbab-4887-81a9-de8a78d1466b req-57712962-66aa-4901-af67-135c84a76012 service nova] Creating event network-vif-deleted:60c45ac4-b88e-4186-8382-80cf71deafab for instance c7527526-138f-45ff-8efc-8802410df8eb on nch2-master-1 Oct 08 21:01:24.604033 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-3514036a-fbab-4887-81a9-de8a78d1466b req-57712962-66aa-4901-af67-135c84a76012 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063003 Oct 08 21:01:24.606687 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1205/2446] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:01:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:01:24.614038 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-8d83d69b-e8ce-4c25-9124-cdafd3b65e6d tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:24.615019 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-8d83d69b-e8ce-4c25-9124-cdafd3b65e6d tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: 38b000d3-167b-4f7a-ab80-cd51fcb7cbaf] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:24.625176 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8d83d69b-e8ce-4c25-9124-cdafd3b65e6d tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:24.626209 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8d83d69b-e8ce-4c25-9124-cdafd3b65e6d tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:24.627056 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8d83d69b-e8ce-4c25-9124-cdafd3b65e6d tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:24.629424 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8d83d69b-e8ce-4c25-9124-cdafd3b65e6d tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:24.630154 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8d83d69b-e8ce-4c25-9124-cdafd3b65e6d tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:24.631272 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8d83d69b-e8ce-4c25-9124-cdafd3b65e6d tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:24.987593 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=8 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:01:25.151521 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-8d83d69b-e8ce-4c25-9124-cdafd3b65e6d tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:01:25.163927 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-8d83d69b-e8ce-4c25-9124-cdafd3b65e6d tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/38b000d3-167b-4f7a-ab80-cd51fcb7cbaf" status: 200 len: 1475 microversion: 2.1 time: 0.554682 Oct 08 21:01:25.168441 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1206/2447] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:01:24 2022] GET /compute/v2.1/servers/38b000d3-167b-4f7a-ab80-cd51fcb7cbaf => generated 1475 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:01:25.174808 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-a1576f2d-513d-46cd-9f26-1b38b347d369 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:25.180663 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-a1576f2d-513d-46cd-9f26-1b38b347d369 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] [instance: 4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:25.198336 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a1576f2d-513d-46cd-9f26-1b38b347d369 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:25.198851 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a1576f2d-513d-46cd-9f26-1b38b347d369 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:25.199307 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a1576f2d-513d-46cd-9f26-1b38b347d369 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:25.200038 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a1576f2d-513d-46cd-9f26-1b38b347d369 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:25.202741 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a1576f2d-513d-46cd-9f26-1b38b347d369 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:25.203425 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a1576f2d-513d-46cd-9f26-1b38b347d369 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:25.374263 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-b48af8dd-7455-4b9b-b4c4-3319235ecce3 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Flavor limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 21:01:25.375342 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-b48af8dd-7455-4b9b-b4c4-3319235ecce3 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Image limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 21:01:25.375989 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-b48af8dd-7455-4b9b-b4c4-3319235ecce3 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Flavor pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 21:01:25.376605 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-b48af8dd-7455-4b9b-b4c4-3319235ecce3 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Image pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 21:01:25.377329 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-b48af8dd-7455-4b9b-b4c4-3319235ecce3 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 21:01:25.400782 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b48af8dd-7455-4b9b-b4c4-3319235ecce3 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:25.401634 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b48af8dd-7455-4b9b-b4c4-3319235ecce3 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:25.402249 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b48af8dd-7455-4b9b-b4c4-3319235ecce3 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:25.403161 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b48af8dd-7455-4b9b-b4c4-3319235ecce3 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:25.405053 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b48af8dd-7455-4b9b-b4c4-3319235ecce3 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:25.405706 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b48af8dd-7455-4b9b-b4c4-3319235ecce3 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:25.466233 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-b48af8dd-7455-4b9b-b4c4-3319235ecce3 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Getting quotas for project 8c917d40fe85495081525a0d2952f888. Resources: {'cores', 'instances', 'ram'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:01:25.503973 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-b48af8dd-7455-4b9b-b4c4-3319235ecce3 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Getting quotas for user 612551711ec44a9b856a706a1c4c46e7 and project 8c917d40fe85495081525a0d2952f888. Resources: {'cores', 'instances', 'ram'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:01:25.535344 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-b48af8dd-7455-4b9b-b4c4-3319235ecce3 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Going to run 1 instances... {{(pid=140492) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 21:01:25.539246 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-b48af8dd-7455-4b9b-b4c4-3319235ecce3 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] [instance: 43b537b7-2c01-4b03-af22-c87f1c9152d3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c508bd7f-7db9-4b2c-af7c-be54a855c355',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140492) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 21:01:25.551707 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-a1576f2d-513d-46cd-9f26-1b38b347d369 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1698dee4a2bf4ea19a6ee0c3d5cb5c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b00ee5e7828469f95bd90548d35982a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:01:25.564159 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-a1576f2d-513d-46cd-9f26-1b38b347d369 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] 10.222.0.26 "GET /compute/v2.1/servers/4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711" status: 200 len: 1370 microversion: 2.1 time: 0.394144 Oct 08 21:01:25.578995 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1207/2448] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:01:25 2022] GET /compute/v2.1/servers/4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711 => generated 1370 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:01:25.587100 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-4258ecf8-3f56-48eb-afcc-1937099e79a0 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:25.589114 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-4258ecf8-3f56-48eb-afcc-1937099e79a0 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] [instance: 1510673d-866c-4e8c-9cb8-2dbc7f0a4115] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:25.601337 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4258ecf8-3f56-48eb-afcc-1937099e79a0 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:25.604196 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4258ecf8-3f56-48eb-afcc-1937099e79a0 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:25.604884 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4258ecf8-3f56-48eb-afcc-1937099e79a0 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:25.605860 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4258ecf8-3f56-48eb-afcc-1937099e79a0 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:25.607415 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4258ecf8-3f56-48eb-afcc-1937099e79a0 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:25.608786 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4258ecf8-3f56-48eb-afcc-1937099e79a0 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:25.635818 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-b48af8dd-7455-4b9b-b4c4-3319235ecce3 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.575302 Oct 08 21:01:25.636929 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1242/2449] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 21:01:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 1578 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 08 21:01:25.638574 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-4258ecf8-3f56-48eb-afcc-1937099e79a0 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] HTTP exception thrown: Instance 1510673d-866c-4e8c-9cb8-2dbc7f0a4115 could not be found. Oct 08 21:01:25.640736 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-4258ecf8-3f56-48eb-afcc-1937099e79a0 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Request method failure captured: Oct 08 21:01:25.640736 ncdv-master-1 devstack@n-api.service[140491]: request: GET /compute/v2.1/servers/1510673d-866c-4e8c-9cb8-2dbc7f0a4115 HTTP/1.1 Oct 08 21:01:25.640736 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:01:25.640736 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:01:25.640736 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:01:25.640736 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 21:01:25.640736 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:01:25.640736 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:01:25.640736 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:01:25.640736 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:01:25.640736 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeTE7bTfM4hIhoviKx9l8mw-bWfYL6jsTZW_QjKSgS6NcvR5fjqeBn6E1jAPDuPpZvhMcTeb9kBH8YZZEMCFr_F1J-nxa8vLVrJvg33lxBDKWqjORjFzU7YTBNB-gB5p5hXf0cUCzsO7xU_2VbukaClcdx1U8H5njKq8mVnqRKHv1K4 Oct 08 21:01:25.640736 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:01:25.640736 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:01:25.640736 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:01:25.640736 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:01:25.640736 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:01:25.640736 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:01:25.640736 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 76b10172715d423eb887d6c5b171defb Oct 08 21:01:25.640736 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1001637313 Oct 08 21:01:25.640736 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:01:25.640736 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:01:25.640736 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/76b10172715d423eb887d6c5b171defb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/76b10172715d423eb887d6c5b171defb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_76b10172715d423eb887d6c5b171defb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/76b10172715d423eb887d6c5b171defb"}]}] Oct 08 21:01:25.640736 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1001637313 Oct 08 21:01:25.640736 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 76b10172715d423eb887d6c5b171defb Oct 08 21:01:25.640736 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1001637313 Oct 08 21:01:25.640736 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-ImagesOneServerNegativeTestJSON-1001637313-project Oct 08 21:01:25.640736 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:01:25.640736 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:01:25.640736 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: f06caf10b6fa43a3a2ad34858594e329 Oct 08 21:01:25.640736 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1001637313-project Oct 08 21:01:25.640736 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:01:25.640736 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance 1510673d-866c-4e8c-9cb8-2dbc7f0a4115 could not be found. Oct 08 21:01:25.640736 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': '1510673d-866c-4e8c-9cb8-2dbc7f0a4115'} Oct 08 21:01:25.640736 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:01:25.640736 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:01:25.640736 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:01:25.640736 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:01:25.640736 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:01:25.640736 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:01:25.640736 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:01:25.640736 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:01:25.640736 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:01:25.640736 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:01:25.640736 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1510673d-866c-4e8c-9cb8-2dbc7f0a4115 could not be found. Oct 08 21:01:25.640736 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:01:25.640736 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:01:25.640736 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:01:25.640736 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:01:25.640736 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:01:25.640736 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:01:25.640736 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:01:25.640736 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:01:25.640736 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:01:25.640736 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:01:25.640736 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:01:25.640736 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:01:25.640736 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:01:25.640736 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:01:25.640736 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:01:25.640736 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:01:25.640736 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1510673d-866c-4e8c-9cb8-2dbc7f0a4115 could not be found. Oct 08 21:01:25.640736 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:01:25.640736 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:01:25.646003 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:01:25.646003 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:01:25.646003 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:01:25.646003 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:01:25.646003 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:01:25.646003 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:01:25.646003 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1510673d-866c-4e8c-9cb8-2dbc7f0a4115 could not be found. Oct 08 21:01:25.646003 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:01:25.646445 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-f284d2a5-f862-4f3e-bc97-d82320b5ca9a req-7c321f3c-0f54-413f-b43e-7ef411efa322 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38b000d3-167b-4f7a-ab80-cd51fcb7cbaf", "name": "network-vif-unplugged", "status": "completed", "tag": "4e092828-fb69-410c-aa0c-7cbcee8350f3"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:01:25.648596 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-4258ecf8-3f56-48eb-afcc-1937099e79a0 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Returning 404 to user: Instance 1510673d-866c-4e8c-9cb8-2dbc7f0a4115 could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:01:25.649876 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-4258ecf8-3f56-48eb-afcc-1937099e79a0 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] 10.222.0.26 "GET /compute/v2.1/servers/1510673d-866c-4e8c-9cb8-2dbc7f0a4115" status: 404 len: 111 microversion: 2.1 time: 0.069704 Oct 08 21:01:25.651817 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1208/2450] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:01:25 2022] GET /compute/v2.1/servers/1510673d-866c-4e8c-9cb8-2dbc7f0a4115 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:01:25.657094 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-17fe0f8f-2ecb-4516-baf4-880399712a18 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:25.658098 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-17fe0f8f-2ecb-4516-baf4-880399712a18 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] [instance: c7527526-138f-45ff-8efc-8802410df8eb] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:25.659981 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-f284d2a5-f862-4f3e-bc97-d82320b5ca9a req-7c321f3c-0f54-413f-b43e-7ef411efa322 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:25.661068 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-f284d2a5-f862-4f3e-bc97-d82320b5ca9a req-7c321f3c-0f54-413f-b43e-7ef411efa322 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:25.662560 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-f284d2a5-f862-4f3e-bc97-d82320b5ca9a req-7c321f3c-0f54-413f-b43e-7ef411efa322 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:25.665480 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-17fe0f8f-2ecb-4516-baf4-880399712a18 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:25.666117 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-17fe0f8f-2ecb-4516-baf4-880399712a18 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:25.666661 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-17fe0f8f-2ecb-4516-baf4-880399712a18 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:25.667650 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-17fe0f8f-2ecb-4516-baf4-880399712a18 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:25.668229 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-17fe0f8f-2ecb-4516-baf4-880399712a18 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:25.668759 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-17fe0f8f-2ecb-4516-baf4-880399712a18 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:25.680519 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-f284d2a5-f862-4f3e-bc97-d82320b5ca9a req-7c321f3c-0f54-413f-b43e-7ef411efa322 service nova] Creating event network-vif-unplugged:4e092828-fb69-410c-aa0c-7cbcee8350f3 for instance 38b000d3-167b-4f7a-ab80-cd51fcb7cbaf on nch2-master-1 Oct 08 21:01:25.688225 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [req-f284d2a5-f862-4f3e-bc97-d82320b5ca9a req-7c321f3c-0f54-413f-b43e-7ef411efa322 service nova] Instance 38b000d3-167b-4f7a-ab80-cd51fcb7cbaf is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1'} {{(pid=140492) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 08 21:01:25.691168 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-17fe0f8f-2ecb-4516-baf4-880399712a18 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] HTTP exception thrown: Instance c7527526-138f-45ff-8efc-8802410df8eb could not be found. Oct 08 21:01:25.694445 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-17fe0f8f-2ecb-4516-baf4-880399712a18 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Request method failure captured: Oct 08 21:01:25.694445 ncdv-master-1 devstack@n-api.service[140491]: request: GET /compute/v2.1/servers/c7527526-138f-45ff-8efc-8802410df8eb HTTP/1.1 Oct 08 21:01:25.694445 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:01:25.694445 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:01:25.694445 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:01:25.694445 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 21:01:25.694445 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:01:25.694445 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:01:25.694445 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:01:25.694445 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:01:25.694445 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeSb4M26O_vDGku5blaRklPpWXMIkDkkYLHI4TQR3Lkj6ugAmZnXiEMbhbwcUUkKJxmJE_1GVhVwNr6_LCWPu8Cri-ZcBOuC9m35LAuoyQgqlRCHKUNztXiOLKFmIaCLGBcHhmGZivrgtOjs4S01nh-4JJFMgvybLWfGoSHKMKKau80 Oct 08 21:01:25.694445 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:01:25.694445 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:01:25.694445 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:01:25.694445 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:01:25.694445 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:01:25.694445 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:01:25.694445 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: e191d6217f024a17a14184071ac674c7 Oct 08 21:01:25.694445 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-VolumesAdminNegativeTest-557516914 Oct 08 21:01:25.694445 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:01:25.694445 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:01:25.694445 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/e191d6217f024a17a14184071ac674c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e191d6217f024a17a14184071ac674c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_e191d6217f024a17a14184071ac674c7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e191d6217f024a17a14184071ac674c7"}]}] Oct 08 21:01:25.694445 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-VolumesAdminNegativeTest-557516914 Oct 08 21:01:25.694445 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: e191d6217f024a17a14184071ac674c7 Oct 08 21:01:25.694445 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-557516914 Oct 08 21:01:25.694445 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-VolumesAdminNegativeTest-557516914-project Oct 08 21:01:25.694445 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:01:25.694445 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:01:25.694445 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 3d2ddfa343e748c089129b0039a12ac0 Oct 08 21:01:25.694445 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-VolumesAdminNegativeTest-557516914-project Oct 08 21:01:25.694445 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:01:25.694445 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance c7527526-138f-45ff-8efc-8802410df8eb could not be found. Oct 08 21:01:25.694445 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': 'c7527526-138f-45ff-8efc-8802410df8eb'} Oct 08 21:01:25.694445 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:01:25.694445 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:01:25.694445 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:01:25.694445 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:01:25.694445 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:01:25.694445 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:01:25.694445 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:01:25.694445 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:01:25.694445 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:01:25.694445 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:01:25.694445 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7527526-138f-45ff-8efc-8802410df8eb could not be found. Oct 08 21:01:25.694445 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:01:25.694445 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:01:25.694445 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:01:25.694445 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:01:25.694445 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:01:25.694445 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:01:25.694445 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:01:25.694445 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:01:25.694445 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:01:25.694445 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:01:25.694445 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:01:25.694445 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:01:25.694445 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:01:25.694445 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:01:25.694445 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:01:25.694445 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:01:25.694445 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7527526-138f-45ff-8efc-8802410df8eb could not be found. Oct 08 21:01:25.694445 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:01:25.694445 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:01:25.694445 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:01:25.700294 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:01:25.700294 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:01:25.700294 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:01:25.700294 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:01:25.700294 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:01:25.700294 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7527526-138f-45ff-8efc-8802410df8eb could not be found. Oct 08 21:01:25.700294 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:01:25.701641 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-f284d2a5-f862-4f3e-bc97-d82320b5ca9a req-7c321f3c-0f54-413f-b43e-7ef411efa322 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.058462 Oct 08 21:01:25.701641 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1243/2451] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:01:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:01:25.703229 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-17fe0f8f-2ecb-4516-baf4-880399712a18 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Returning 404 to user: Instance c7527526-138f-45ff-8efc-8802410df8eb could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:01:25.704515 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-17fe0f8f-2ecb-4516-baf4-880399712a18 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] 10.222.0.26 "GET /compute/v2.1/servers/c7527526-138f-45ff-8efc-8802410df8eb" status: 404 len: 111 microversion: 2.1 time: 0.051407 Oct 08 21:01:25.705823 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1209/2452] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:01:25 2022] GET /compute/v2.1/servers/c7527526-138f-45ff-8efc-8802410df8eb => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:01:25.706845 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-843e77ff-54ef-4912-8fa9-afd05b4f8035 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:25.707738 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-843e77ff-54ef-4912-8fa9-afd05b4f8035 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] [instance: 43b537b7-2c01-4b03-af22-c87f1c9152d3] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:25.726008 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-9435dba1-f107-42c3-82f7-24f28c52825b tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Calling method '.version_select at 0x7f1a8c697ee0>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:25.770802 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-9435dba1-f107-42c3-82f7-24f28c52825b tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] HTTP exception thrown: Image not found. Oct 08 21:01:25.774000 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-9435dba1-f107-42c3-82f7-24f28c52825b tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Request method failure captured: Oct 08 21:01:25.774000 ncdv-master-1 devstack@n-api.service[140491]: request: DELETE /compute/v2.1/images/fb3d38b0-6546-4a9e-85ea-e5d55eb7feaf HTTP/1.1 Oct 08 21:01:25.774000 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:01:25.774000 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:01:25.774000 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:01:25.774000 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 21:01:25.774000 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:01:25.774000 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:01:25.774000 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:01:25.774000 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:01:25.774000 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeTE7bTfM4hIhoviKx9l8mw-bWfYL6jsTZW_QjKSgS6NcvR5fjqeBn6E1jAPDuPpZvhMcTeb9kBH8YZZEMCFr_F1J-nxa8vLVrJvg33lxBDKWqjORjFzU7YTBNB-gB5p5hXf0cUCzsO7xU_2VbukaClcdx1U8H5njKq8mVnqRKHv1K4 Oct 08 21:01:25.774000 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:01:25.774000 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:01:25.774000 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:01:25.774000 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:01:25.774000 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:01:25.774000 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:01:25.774000 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 76b10172715d423eb887d6c5b171defb Oct 08 21:01:25.774000 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1001637313 Oct 08 21:01:25.774000 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:01:25.774000 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:01:25.774000 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/76b10172715d423eb887d6c5b171defb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/76b10172715d423eb887d6c5b171defb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_76b10172715d423eb887d6c5b171defb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/76b10172715d423eb887d6c5b171defb"}]}] Oct 08 21:01:25.774000 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1001637313 Oct 08 21:01:25.774000 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 76b10172715d423eb887d6c5b171defb Oct 08 21:01:25.774000 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1001637313 Oct 08 21:01:25.774000 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-ImagesOneServerNegativeTestJSON-1001637313-project Oct 08 21:01:25.774000 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:01:25.774000 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:01:25.774000 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: f06caf10b6fa43a3a2ad34858594e329 Oct 08 21:01:25.774000 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1001637313-project Oct 08 21:01:25.774000 ncdv-master-1 devstack@n-api.service[140491]: method: Oct 08 21:01:25.774000 ncdv-master-1 devstack@n-api.service[140491]: exception: Image not found. Oct 08 21:01:25.774000 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': 'fb3d38b0-6546-4a9e-85ea-e5d55eb7feaf'} Oct 08 21:01:25.774000 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:01:25.774000 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:01:25.774000 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 08 21:01:25.774000 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 08 21:01:25.774000 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 08 21:01:25.774000 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 08 21:01:25.774000 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 08 21:01:25.774000 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 08 21:01:25.774000 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 08 21:01:25.774000 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 08 21:01:25.774000 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 08 21:01:25.774000 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 08 21:01:25.774000 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 08 21:01:25.774000 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 08 21:01:25.774000 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 08 21:01:25.774000 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 08 21:01:25.774000 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image fb3d38b0-6546-4a9e-85ea-e5d55eb7feaf to delete Oct 08 21:01:25.774000 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:01:25.774000 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:01:25.774000 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:01:25.774000 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:01:25.774000 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 08 21:01:25.774000 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 08 21:01:25.774000 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 08 21:01:25.774000 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 08 21:01:25.774000 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 08 21:01:25.774000 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 08 21:01:25.774000 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image fb3d38b0-6546-4a9e-85ea-e5d55eb7feaf could not be found. Oct 08 21:01:25.774000 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:01:25.774000 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:01:25.774000 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:01:25.779983 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:01:25.779983 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:01:25.779983 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:01:25.779983 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:01:25.779983 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:01:25.779983 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 08 21:01:25.779983 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 08 21:01:25.779983 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:01:25.779983 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:01:25.779983 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 08 21:01:25.779983 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 08 21:01:25.779983 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 08 21:01:25.779983 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:01:25.779983 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:01:25.779983 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:01:25.779983 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:01:25.779983 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:01:25.779983 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:01:25.779983 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:01:25.779983 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:01:25.779983 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 08 21:01:25.779983 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:01:25.779983 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-9435dba1-f107-42c3-82f7-24f28c52825b tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Returning 404 to user: Image not found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:01:25.779983 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-9435dba1-f107-42c3-82f7-24f28c52825b tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] 10.222.0.26 "DELETE /compute/v2.1/images/fb3d38b0-6546-4a9e-85ea-e5d55eb7feaf" status: 404 len: 62 microversion: 2.1 time: 0.070188 Oct 08 21:01:25.781467 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1210/2453] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:01:25 2022] DELETE /compute/v2.1/images/fb3d38b0-6546-4a9e-85ea-e5d55eb7feaf => generated 62 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 08 21:01:25.810214 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-5dab94ee-792f-42ef-a193-a0ee4c8c621b tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:25.815668 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-5dab94ee-792f-42ef-a193-a0ee4c8c621b tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] [instance: a8b2f857-6c24-45fe-b934-cf92b2d18b7a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:25.849213 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5dab94ee-792f-42ef-a193-a0ee4c8c621b tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:25.849727 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5dab94ee-792f-42ef-a193-a0ee4c8c621b tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:25.850176 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5dab94ee-792f-42ef-a193-a0ee4c8c621b tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:25.860881 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5dab94ee-792f-42ef-a193-a0ee4c8c621b tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:25.861833 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5dab94ee-792f-42ef-a193-a0ee4c8c621b tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:25.862295 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5dab94ee-792f-42ef-a193-a0ee4c8c621b tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:25.902414 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-843e77ff-54ef-4912-8fa9-afd05b4f8035 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612551711ec44a9b856a706a1c4c46e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c917d40fe85495081525a0d2952f888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:01:25.933051 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-843e77ff-54ef-4912-8fa9-afd05b4f8035 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] 10.222.0.26 "GET /compute/v2.1/servers/43b537b7-2c01-4b03-af22-c87f1c9152d3" status: 200 len: 1223 microversion: 2.1 time: 0.218979 Oct 08 21:01:25.942144 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1244/2454] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:01:25 2022] GET /compute/v2.1/servers/43b537b7-2c01-4b03-af22-c87f1c9152d3 => generated 1223 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:01:25.998130 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-5dab94ee-792f-42ef-a193-a0ee4c8c621b tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] HTTP exception thrown: Instance a8b2f857-6c24-45fe-b934-cf92b2d18b7a could not be found. Oct 08 21:01:26.006065 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-5dab94ee-792f-42ef-a193-a0ee4c8c621b tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Request method failure captured: Oct 08 21:01:26.006065 ncdv-master-1 devstack@n-api.service[140491]: request: DELETE /compute/v2.1/servers/a8b2f857-6c24-45fe-b934-cf92b2d18b7a HTTP/1.1 Oct 08 21:01:26.006065 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:01:26.006065 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:01:26.006065 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:01:26.006065 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 21:01:26.006065 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:01:26.006065 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:01:26.006065 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:01:26.006065 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:01:26.006065 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeTE7bTfM4hIhoviKx9l8mw-bWfYL6jsTZW_QjKSgS6NcvR5fjqeBn6E1jAPDuPpZvhMcTeb9kBH8YZZEMCFr_F1J-nxa8vLVrJvg33lxBDKWqjORjFzU7YTBNB-gB5p5hXf0cUCzsO7xU_2VbukaClcdx1U8H5njKq8mVnqRKHv1K4 Oct 08 21:01:26.006065 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:01:26.006065 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:01:26.006065 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:01:26.006065 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:01:26.006065 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:01:26.006065 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:01:26.006065 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 76b10172715d423eb887d6c5b171defb Oct 08 21:01:26.006065 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1001637313 Oct 08 21:01:26.006065 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:01:26.006065 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:01:26.006065 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/76b10172715d423eb887d6c5b171defb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/76b10172715d423eb887d6c5b171defb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_76b10172715d423eb887d6c5b171defb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/76b10172715d423eb887d6c5b171defb"}]}] Oct 08 21:01:26.006065 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1001637313 Oct 08 21:01:26.006065 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 76b10172715d423eb887d6c5b171defb Oct 08 21:01:26.006065 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1001637313 Oct 08 21:01:26.006065 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-ImagesOneServerNegativeTestJSON-1001637313-project Oct 08 21:01:26.006065 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:01:26.006065 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:01:26.006065 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: f06caf10b6fa43a3a2ad34858594e329 Oct 08 21:01:26.006065 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1001637313-project Oct 08 21:01:26.006065 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:01:26.006065 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance a8b2f857-6c24-45fe-b934-cf92b2d18b7a could not be found. Oct 08 21:01:26.006065 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': 'a8b2f857-6c24-45fe-b934-cf92b2d18b7a'} Oct 08 21:01:26.006065 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:01:26.006065 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:01:26.006065 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:01:26.006065 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:01:26.006065 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:01:26.006065 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:01:26.006065 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:01:26.006065 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:01:26.006065 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:01:26.006065 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:01:26.006065 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8b2f857-6c24-45fe-b934-cf92b2d18b7a could not be found. Oct 08 21:01:26.006065 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:01:26.006065 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:01:26.006065 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:01:26.006065 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:01:26.006065 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:01:26.006065 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:01:26.006065 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:01:26.006065 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:01:26.006065 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:01:26.006065 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:01:26.006065 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 08 21:01:26.006065 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 08 21:01:26.006065 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 08 21:01:26.006065 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 08 21:01:26.006065 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:01:26.006065 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:01:26.006065 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:01:26.006065 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:01:26.011056 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8b2f857-6c24-45fe-b934-cf92b2d18b7a could not be found. Oct 08 21:01:26.011056 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:01:26.011056 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:01:26.011056 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:01:26.011056 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:01:26.011056 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:01:26.011056 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:01:26.011056 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:01:26.011056 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:01:26.011056 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8b2f857-6c24-45fe-b934-cf92b2d18b7a could not be found. Oct 08 21:01:26.011056 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:01:26.011056 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-5dab94ee-792f-42ef-a193-a0ee4c8c621b tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Returning 404 to user: Instance a8b2f857-6c24-45fe-b934-cf92b2d18b7a could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:01:26.012188 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-5dab94ee-792f-42ef-a193-a0ee4c8c621b tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] 10.222.0.26 "DELETE /compute/v2.1/servers/a8b2f857-6c24-45fe-b934-cf92b2d18b7a" status: 404 len: 111 microversion: 2.1 time: 0.218504 Oct 08 21:01:26.017339 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1211/2455] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:01:25 2022] DELETE /compute/v2.1/servers/a8b2f857-6c24-45fe-b934-cf92b2d18b7a => generated 111 bytes in 226 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:01:26.025651 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-adf6ed5a-69d7-4fef-ab1e-26f8f5da6553 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:26.039455 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-adf6ed5a-69d7-4fef-ab1e-26f8f5da6553 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] [instance: a8b2f857-6c24-45fe-b934-cf92b2d18b7a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:26.065071 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-adf6ed5a-69d7-4fef-ab1e-26f8f5da6553 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:26.065616 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-adf6ed5a-69d7-4fef-ab1e-26f8f5da6553 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:26.066068 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-adf6ed5a-69d7-4fef-ab1e-26f8f5da6553 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:26.070373 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-adf6ed5a-69d7-4fef-ab1e-26f8f5da6553 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:26.070882 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-adf6ed5a-69d7-4fef-ab1e-26f8f5da6553 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:26.071335 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-adf6ed5a-69d7-4fef-ab1e-26f8f5da6553 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:26.099637 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-adf6ed5a-69d7-4fef-ab1e-26f8f5da6553 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] HTTP exception thrown: Instance a8b2f857-6c24-45fe-b934-cf92b2d18b7a could not be found. Oct 08 21:01:26.101917 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-adf6ed5a-69d7-4fef-ab1e-26f8f5da6553 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Request method failure captured: Oct 08 21:01:26.101917 ncdv-master-1 devstack@n-api.service[140492]: request: GET /compute/v2.1/servers/a8b2f857-6c24-45fe-b934-cf92b2d18b7a HTTP/1.1 Oct 08 21:01:26.101917 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:01:26.101917 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:01:26.101917 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:01:26.101917 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 21:01:26.101917 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:01:26.101917 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:01:26.101917 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:01:26.101917 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:01:26.101917 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeTE7bTfM4hIhoviKx9l8mw-bWfYL6jsTZW_QjKSgS6NcvR5fjqeBn6E1jAPDuPpZvhMcTeb9kBH8YZZEMCFr_F1J-nxa8vLVrJvg33lxBDKWqjORjFzU7YTBNB-gB5p5hXf0cUCzsO7xU_2VbukaClcdx1U8H5njKq8mVnqRKHv1K4 Oct 08 21:01:26.101917 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:01:26.101917 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:01:26.101917 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:01:26.101917 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:01:26.101917 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:01:26.101917 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:01:26.101917 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 76b10172715d423eb887d6c5b171defb Oct 08 21:01:26.101917 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1001637313 Oct 08 21:01:26.101917 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:01:26.101917 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:01:26.101917 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/76b10172715d423eb887d6c5b171defb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/76b10172715d423eb887d6c5b171defb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_76b10172715d423eb887d6c5b171defb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/76b10172715d423eb887d6c5b171defb"}]}] Oct 08 21:01:26.101917 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1001637313 Oct 08 21:01:26.101917 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 76b10172715d423eb887d6c5b171defb Oct 08 21:01:26.101917 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1001637313 Oct 08 21:01:26.101917 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-ImagesOneServerNegativeTestJSON-1001637313-project Oct 08 21:01:26.101917 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:01:26.101917 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:01:26.101917 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: f06caf10b6fa43a3a2ad34858594e329 Oct 08 21:01:26.101917 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1001637313-project Oct 08 21:01:26.101917 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 21:01:26.101917 ncdv-master-1 devstack@n-api.service[140492]: exception: Instance a8b2f857-6c24-45fe-b934-cf92b2d18b7a could not be found. Oct 08 21:01:26.101917 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': 'a8b2f857-6c24-45fe-b934-cf92b2d18b7a'} Oct 08 21:01:26.101917 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:01:26.101917 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:01:26.101917 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:01:26.101917 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:01:26.101917 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:01:26.101917 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:01:26.101917 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:01:26.101917 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:01:26.101917 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:01:26.101917 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:01:26.101917 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8b2f857-6c24-45fe-b934-cf92b2d18b7a could not be found. Oct 08 21:01:26.101917 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:01:26.101917 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:01:26.101917 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:01:26.101917 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:01:26.101917 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:01:26.101917 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:01:26.101917 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:01:26.101917 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:01:26.101917 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:01:26.101917 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:01:26.101917 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:01:26.101917 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:01:26.101917 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:01:26.101917 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:01:26.101917 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:01:26.101917 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:01:26.101917 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8b2f857-6c24-45fe-b934-cf92b2d18b7a could not be found. Oct 08 21:01:26.101917 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:01:26.101917 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:01:26.106468 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:01:26.106468 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:01:26.106468 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:01:26.106468 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:01:26.106468 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:01:26.106468 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:01:26.106468 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8b2f857-6c24-45fe-b934-cf92b2d18b7a could not be found. Oct 08 21:01:26.106468 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:01:26.106468 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-adf6ed5a-69d7-4fef-ab1e-26f8f5da6553 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Returning 404 to user: Instance a8b2f857-6c24-45fe-b934-cf92b2d18b7a could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:01:26.106468 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-adf6ed5a-69d7-4fef-ab1e-26f8f5da6553 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] 10.222.0.26 "GET /compute/v2.1/servers/a8b2f857-6c24-45fe-b934-cf92b2d18b7a" status: 404 len: 111 microversion: 2.1 time: 0.082750 Oct 08 21:01:26.106468 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1245/2456] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:01:26 2022] GET /compute/v2.1/servers/a8b2f857-6c24-45fe-b934-cf92b2d18b7a => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:01:26.114123 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-02477c2c-f36d-4d4b-8113-b91005769870 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Calling method '.version_select at 0x7f1a8c9e6310>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:26.167240 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-02477c2c-f36d-4d4b-8113-b91005769870 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1532991558" status: 202 len: 0 microversion: 2.1 time: 0.058567 Oct 08 21:01:26.168541 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1212/2457] 10.222.0.26 () {58 vars in 1221 bytes} [Sat Oct 8 21:01:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1532991558 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 08 21:01:26.194751 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-fb803d27-f14c-41df-9d9e-b432f4affcd9 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:26.195479 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-fb803d27-f14c-41df-9d9e-b432f4affcd9 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: 38b000d3-167b-4f7a-ab80-cd51fcb7cbaf] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:26.216801 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fb803d27-f14c-41df-9d9e-b432f4affcd9 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:26.217361 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fb803d27-f14c-41df-9d9e-b432f4affcd9 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:26.218019 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fb803d27-f14c-41df-9d9e-b432f4affcd9 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:26.220679 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fb803d27-f14c-41df-9d9e-b432f4affcd9 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:26.221354 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fb803d27-f14c-41df-9d9e-b432f4affcd9 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:26.236151 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fb803d27-f14c-41df-9d9e-b432f4affcd9 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:26.595641 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-b9aace61-44fa-4fe7-ae10-51ec17095006 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:26.596964 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-b9aace61-44fa-4fe7-ae10-51ec17095006 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] [instance: 4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:26.610198 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b9aace61-44fa-4fe7-ae10-51ec17095006 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:26.616635 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b9aace61-44fa-4fe7-ae10-51ec17095006 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:26.618453 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b9aace61-44fa-4fe7-ae10-51ec17095006 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:26.620802 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b9aace61-44fa-4fe7-ae10-51ec17095006 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:26.626736 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b9aace61-44fa-4fe7-ae10-51ec17095006 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:26.627681 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b9aace61-44fa-4fe7-ae10-51ec17095006 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:27.209231 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-fb803d27-f14c-41df-9d9e-b432f4affcd9 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:01:27.224853 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-b9aace61-44fa-4fe7-ae10-51ec17095006 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1698dee4a2bf4ea19a6ee0c3d5cb5c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b00ee5e7828469f95bd90548d35982a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:01:27.236473 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-fb803d27-f14c-41df-9d9e-b432f4affcd9 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/38b000d3-167b-4f7a-ab80-cd51fcb7cbaf" status: 200 len: 1473 microversion: 2.1 time: 1.045416 Oct 08 21:01:27.238502 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-b9aace61-44fa-4fe7-ae10-51ec17095006 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] 10.222.0.26 "GET /compute/v2.1/servers/4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711" status: 200 len: 1370 microversion: 2.1 time: 0.648521 Oct 08 21:01:27.246481 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1213/2458] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:01:26 2022] GET /compute/v2.1/servers/4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711 => generated 1370 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:01:27.256941 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-e9c4dcf6-1f8b-4e30-876d-bef9e95d6217 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:27.258081 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1246/2459] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:01:26 2022] GET /compute/v2.1/servers/38b000d3-167b-4f7a-ab80-cd51fcb7cbaf => generated 1473 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:01:27.261095 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-e9c4dcf6-1f8b-4e30-876d-bef9e95d6217 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] [instance: 43b537b7-2c01-4b03-af22-c87f1c9152d3] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:27.273350 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-51ff0855-8674-4d48-b630-f72b62e73129 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:27.274753 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-51ff0855-8674-4d48-b630-f72b62e73129 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] [instance: b1a2f781-46a1-43f3-946a-f269deb6455e] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:27.286843 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:01:27.291965 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-51ff0855-8674-4d48-b630-f72b62e73129 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:27.292697 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-51ff0855-8674-4d48-b630-f72b62e73129 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:27.293380 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-51ff0855-8674-4d48-b630-f72b62e73129 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:27.294567 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-51ff0855-8674-4d48-b630-f72b62e73129 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:27.295251 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-51ff0855-8674-4d48-b630-f72b62e73129 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:27.296120 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-51ff0855-8674-4d48-b630-f72b62e73129 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:27.311470 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e9c4dcf6-1f8b-4e30-876d-bef9e95d6217 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:27.315864 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e9c4dcf6-1f8b-4e30-876d-bef9e95d6217 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:27.316795 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e9c4dcf6-1f8b-4e30-876d-bef9e95d6217 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:27.320495 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e9c4dcf6-1f8b-4e30-876d-bef9e95d6217 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:27.325871 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e9c4dcf6-1f8b-4e30-876d-bef9e95d6217 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:27.326624 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e9c4dcf6-1f8b-4e30-876d-bef9e95d6217 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:27.387197 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-51ff0855-8674-4d48-b630-f72b62e73129 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] [instance: b1a2f781-46a1-43f3-946a-f269deb6455e] Going to try to terminate instance {{(pid=140492) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 21:01:27.561538 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-e9c4dcf6-1f8b-4e30-876d-bef9e95d6217 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612551711ec44a9b856a706a1c4c46e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c917d40fe85495081525a0d2952f888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:01:27.571621 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-e9c4dcf6-1f8b-4e30-876d-bef9e95d6217 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] 10.222.0.26 "GET /compute/v2.1/servers/43b537b7-2c01-4b03-af22-c87f1c9152d3" status: 200 len: 1219 microversion: 2.1 time: 0.323688 Oct 08 21:01:27.575478 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1214/2460] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:01:27 2022] GET /compute/v2.1/servers/43b537b7-2c01-4b03-af22-c87f1c9152d3 => generated 1219 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:01:27.640788 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-51ff0855-8674-4d48-b630-f72b62e73129 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] 10.222.0.26 "DELETE /compute/v2.1/servers/b1a2f781-46a1-43f3-946a-f269deb6455e" status: 204 len: 0 microversion: 2.1 time: 0.381251 Oct 08 21:01:27.644351 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1247/2461] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:01:27 2022] DELETE /compute/v2.1/servers/b1a2f781-46a1-43f3-946a-f269deb6455e => generated 0 bytes in 386 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 21:01:27.655200 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c48aed38-c0c5-44ef-a675-65f4e63cb5c1 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:27.655878 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-c48aed38-c0c5-44ef-a675-65f4e63cb5c1 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] [instance: b1a2f781-46a1-43f3-946a-f269deb6455e] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:27.682447 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c48aed38-c0c5-44ef-a675-65f4e63cb5c1 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:27.682982 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c48aed38-c0c5-44ef-a675-65f4e63cb5c1 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:27.685028 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c48aed38-c0c5-44ef-a675-65f4e63cb5c1 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:27.685814 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c48aed38-c0c5-44ef-a675-65f4e63cb5c1 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:27.686329 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c48aed38-c0c5-44ef-a675-65f4e63cb5c1 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:27.686767 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c48aed38-c0c5-44ef-a675-65f4e63cb5c1 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:28.045442 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-c48aed38-c0c5-44ef-a675-65f4e63cb5c1 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d2ddfa343e748c089129b0039a12ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e191d6217f024a17a14184071ac674c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:01:28.054121 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-c48aed38-c0c5-44ef-a675-65f4e63cb5c1 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] 10.222.0.26 "GET /compute/v2.1/servers/b1a2f781-46a1-43f3-946a-f269deb6455e" status: 200 len: 1684 microversion: 2.1 time: 0.403440 Oct 08 21:01:28.055268 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1215/2462] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:01:27 2022] GET /compute/v2.1/servers/b1a2f781-46a1-43f3-946a-f269deb6455e => generated 1684 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:01:28.265543 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-bb0512af-50b7-4131-a86d-5ec78ee0576c tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:28.266346 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-bb0512af-50b7-4131-a86d-5ec78ee0576c tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: 38b000d3-167b-4f7a-ab80-cd51fcb7cbaf] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:28.274376 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-32be5636-ce56-4db2-99e0-a7b3569bc3f9 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:28.275443 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-32be5636-ce56-4db2-99e0-a7b3569bc3f9 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] [instance: 4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:28.285034 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-32be5636-ce56-4db2-99e0-a7b3569bc3f9 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:28.285568 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-32be5636-ce56-4db2-99e0-a7b3569bc3f9 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:28.287027 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bb0512af-50b7-4131-a86d-5ec78ee0576c tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:28.287538 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bb0512af-50b7-4131-a86d-5ec78ee0576c tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:28.287999 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bb0512af-50b7-4131-a86d-5ec78ee0576c tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:28.288726 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bb0512af-50b7-4131-a86d-5ec78ee0576c tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:28.289251 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bb0512af-50b7-4131-a86d-5ec78ee0576c tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:28.289687 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bb0512af-50b7-4131-a86d-5ec78ee0576c tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:28.290817 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-32be5636-ce56-4db2-99e0-a7b3569bc3f9 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:28.291808 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-32be5636-ce56-4db2-99e0-a7b3569bc3f9 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:28.292462 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-32be5636-ce56-4db2-99e0-a7b3569bc3f9 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:28.292908 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-32be5636-ce56-4db2-99e0-a7b3569bc3f9 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:28.565575 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-32be5636-ce56-4db2-99e0-a7b3569bc3f9 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1698dee4a2bf4ea19a6ee0c3d5cb5c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b00ee5e7828469f95bd90548d35982a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:01:28.574392 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-32be5636-ce56-4db2-99e0-a7b3569bc3f9 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] 10.222.0.26 "GET /compute/v2.1/servers/4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711" status: 200 len: 1370 microversion: 2.1 time: 0.304282 Oct 08 21:01:28.574981 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1216/2463] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:01:28 2022] GET /compute/v2.1/servers/4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711 => generated 1370 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:01:28.605006 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-4ef053fa-7e7d-4479-9be4-0a349cda852e tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:28.606139 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-4ef053fa-7e7d-4479-9be4-0a349cda852e tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] [instance: 43b537b7-2c01-4b03-af22-c87f1c9152d3] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:28.619896 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4ef053fa-7e7d-4479-9be4-0a349cda852e tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:28.620665 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4ef053fa-7e7d-4479-9be4-0a349cda852e tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:28.621120 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4ef053fa-7e7d-4479-9be4-0a349cda852e tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:28.622345 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4ef053fa-7e7d-4479-9be4-0a349cda852e tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:28.622819 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4ef053fa-7e7d-4479-9be4-0a349cda852e tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:28.623912 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4ef053fa-7e7d-4479-9be4-0a349cda852e tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:28.693145 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-4ef053fa-7e7d-4479-9be4-0a349cda852e tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612551711ec44a9b856a706a1c4c46e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c917d40fe85495081525a0d2952f888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:01:28.703994 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-4ef053fa-7e7d-4479-9be4-0a349cda852e tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] 10.222.0.26 "GET /compute/v2.1/servers/43b537b7-2c01-4b03-af22-c87f1c9152d3" status: 200 len: 1219 microversion: 2.1 time: 0.107889 Oct 08 21:01:28.710020 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1217/2464] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:01:28 2022] GET /compute/v2.1/servers/43b537b7-2c01-4b03-af22-c87f1c9152d3 => generated 1219 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:01:28.792516 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-bb0512af-50b7-4131-a86d-5ec78ee0576c tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:01:28.813576 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-bb0512af-50b7-4131-a86d-5ec78ee0576c tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/38b000d3-167b-4f7a-ab80-cd51fcb7cbaf" status: 200 len: 1470 microversion: 2.1 time: 0.552413 Oct 08 21:01:28.838857 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1248/2465] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:01:28 2022] GET /compute/v2.1/servers/38b000d3-167b-4f7a-ab80-cd51fcb7cbaf => generated 1470 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:01:28.845101 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-cfb3e1d5-393a-46bf-b085-62f67b10785d tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:01:28.845950 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-cfb3e1d5-393a-46bf-b085-62f67b10785d tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: 38b000d3-167b-4f7a-ab80-cd51fcb7cbaf] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:28.863319 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:01:28.865800 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cfb3e1d5-393a-46bf-b085-62f67b10785d tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:28.866743 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cfb3e1d5-393a-46bf-b085-62f67b10785d tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:28.870291 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cfb3e1d5-393a-46bf-b085-62f67b10785d tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:28.871427 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cfb3e1d5-393a-46bf-b085-62f67b10785d tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:28.872465 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cfb3e1d5-393a-46bf-b085-62f67b10785d tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:28.873116 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cfb3e1d5-393a-46bf-b085-62f67b10785d tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:28.985355 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-cfb3e1d5-393a-46bf-b085-62f67b10785d tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "POST /compute/v2.1/servers/38b000d3-167b-4f7a-ab80-cd51fcb7cbaf/action" status: 204 len: 0 microversion: 2.1 time: 0.145150 Oct 08 21:01:28.986267 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1218/2466] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:01:28 2022] POST /compute/v2.1/servers/38b000d3-167b-4f7a-ab80-cd51fcb7cbaf/action => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 08 21:01:28.996931 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-c9ac5518-edad-4ea4-8af6-3bdfab56006d tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:28.997583 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-c9ac5518-edad-4ea4-8af6-3bdfab56006d tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: 38b000d3-167b-4f7a-ab80-cd51fcb7cbaf] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:29.011407 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c9ac5518-edad-4ea4-8af6-3bdfab56006d tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:29.012025 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c9ac5518-edad-4ea4-8af6-3bdfab56006d tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:29.012489 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c9ac5518-edad-4ea4-8af6-3bdfab56006d tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:29.013260 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c9ac5518-edad-4ea4-8af6-3bdfab56006d tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:29.020328 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c9ac5518-edad-4ea4-8af6-3bdfab56006d tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:29.020797 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c9ac5518-edad-4ea4-8af6-3bdfab56006d tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:29.083788 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-1dae5a91-d525-4b00-b77c-a1d20d605605 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:29.084646 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-1dae5a91-d525-4b00-b77c-a1d20d605605 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] [instance: b1a2f781-46a1-43f3-946a-f269deb6455e] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:29.100851 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1dae5a91-d525-4b00-b77c-a1d20d605605 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:29.104166 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1dae5a91-d525-4b00-b77c-a1d20d605605 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:29.104679 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1dae5a91-d525-4b00-b77c-a1d20d605605 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:29.105473 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1dae5a91-d525-4b00-b77c-a1d20d605605 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:29.105948 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1dae5a91-d525-4b00-b77c-a1d20d605605 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:29.109133 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1dae5a91-d525-4b00-b77c-a1d20d605605 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:29.583718 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-1dae5a91-d525-4b00-b77c-a1d20d605605 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d2ddfa343e748c089129b0039a12ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e191d6217f024a17a14184071ac674c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:01:29.598664 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-1dae5a91-d525-4b00-b77c-a1d20d605605 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] 10.222.0.26 "GET /compute/v2.1/servers/b1a2f781-46a1-43f3-946a-f269deb6455e" status: 200 len: 1684 microversion: 2.1 time: 0.519517 Oct 08 21:01:29.613876 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1219/2467] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:01:29 2022] GET /compute/v2.1/servers/b1a2f781-46a1-43f3-946a-f269deb6455e => generated 1684 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:01:29.648238 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-dca43677-1ffe-49f0-8f34-71ab2db819da tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Calling method '.version_select at 0x7f1a8c9288b0>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:29.667696 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-c9ac5518-edad-4ea4-8af6-3bdfab56006d tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:01:29.695701 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-c9ac5518-edad-4ea4-8af6-3bdfab56006d tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/38b000d3-167b-4f7a-ab80-cd51fcb7cbaf" status: 200 len: 1470 microversion: 2.1 time: 0.704671 Oct 08 21:01:29.708614 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-dca43677-1ffe-49f0-8f34-71ab2db819da tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] HTTP exception thrown: Image not found. Oct 08 21:01:29.708614 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-dca43677-1ffe-49f0-8f34-71ab2db819da tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Request method failure captured: Oct 08 21:01:29.708614 ncdv-master-1 devstack@n-api.service[140491]: request: DELETE /compute/v2.1/images/fab51338-5bd8-407d-86c5-ba644b071019 HTTP/1.1 Oct 08 21:01:29.708614 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:01:29.708614 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:01:29.708614 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:01:29.708614 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 21:01:29.708614 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:01:29.708614 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:01:29.708614 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:01:29.708614 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:01:29.708614 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeTE7bTfM4hIhoviKx9l8mw-bWfYL6jsTZW_QjKSgS6NcvR5fjqeBn6E1jAPDuPpZvhMcTeb9kBH8YZZEMCFr_F1J-nxa8vLVrJvg33lxBDKWqjORjFzU7YTBNB-gB5p5hXf0cUCzsO7xU_2VbukaClcdx1U8H5njKq8mVnqRKHv1K4 Oct 08 21:01:29.708614 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:01:29.708614 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:01:29.708614 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:01:29.708614 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:01:29.708614 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:01:29.708614 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:01:29.708614 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 76b10172715d423eb887d6c5b171defb Oct 08 21:01:29.708614 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1001637313 Oct 08 21:01:29.708614 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:01:29.708614 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:01:29.708614 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/76b10172715d423eb887d6c5b171defb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/76b10172715d423eb887d6c5b171defb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_76b10172715d423eb887d6c5b171defb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/76b10172715d423eb887d6c5b171defb"}]}] Oct 08 21:01:29.708614 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1001637313 Oct 08 21:01:29.708614 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 76b10172715d423eb887d6c5b171defb Oct 08 21:01:29.708614 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1001637313 Oct 08 21:01:29.708614 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-ImagesOneServerNegativeTestJSON-1001637313-project Oct 08 21:01:29.708614 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:01:29.708614 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:01:29.708614 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: f06caf10b6fa43a3a2ad34858594e329 Oct 08 21:01:29.708614 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1001637313-project Oct 08 21:01:29.708614 ncdv-master-1 devstack@n-api.service[140491]: method: Oct 08 21:01:29.708614 ncdv-master-1 devstack@n-api.service[140491]: exception: Image not found. Oct 08 21:01:29.708614 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': 'fab51338-5bd8-407d-86c5-ba644b071019'} Oct 08 21:01:29.708614 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:01:29.708614 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:01:29.708614 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 08 21:01:29.708614 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 08 21:01:29.708614 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 08 21:01:29.708614 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 08 21:01:29.708614 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 08 21:01:29.708614 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 08 21:01:29.708614 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 08 21:01:29.708614 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 08 21:01:29.708614 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 08 21:01:29.708614 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 08 21:01:29.708614 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 08 21:01:29.708614 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 08 21:01:29.708614 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 08 21:01:29.708614 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 08 21:01:29.708614 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image fab51338-5bd8-407d-86c5-ba644b071019 to delete Oct 08 21:01:29.708614 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:01:29.708614 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:01:29.708614 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:01:29.708614 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:01:29.708614 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 08 21:01:29.708614 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 08 21:01:29.708614 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 08 21:01:29.708614 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 08 21:01:29.708614 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 08 21:01:29.708614 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 08 21:01:29.712728 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image fab51338-5bd8-407d-86c5-ba644b071019 could not be found. Oct 08 21:01:29.712728 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:01:29.712728 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:01:29.712728 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:01:29.712728 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:01:29.712728 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:01:29.712728 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:01:29.712728 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:01:29.712728 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:01:29.712728 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 08 21:01:29.712728 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 08 21:01:29.712728 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:01:29.712728 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:01:29.712728 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 08 21:01:29.712728 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 08 21:01:29.712728 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 08 21:01:29.712728 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:01:29.712728 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:01:29.712728 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:01:29.712728 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:01:29.712728 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:01:29.712728 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:01:29.712728 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:01:29.712728 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:01:29.712728 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 08 21:01:29.712728 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:01:29.712728 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-dca43677-1ffe-49f0-8f34-71ab2db819da tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Returning 404 to user: Image not found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:01:29.712728 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-dca43677-1ffe-49f0-8f34-71ab2db819da tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] 10.222.0.26 "DELETE /compute/v2.1/images/fab51338-5bd8-407d-86c5-ba644b071019" status: 404 len: 62 microversion: 2.1 time: 0.091173 Oct 08 21:01:29.712728 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1220/2468] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:01:29 2022] DELETE /compute/v2.1/images/fab51338-5bd8-407d-86c5-ba644b071019 => generated 62 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 08 21:01:29.721355 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-68b148b1-8d81-4252-b55e-949dcd86bd69 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:29.724336 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-68b148b1-8d81-4252-b55e-949dcd86bd69 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] [instance: 4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:29.726203 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1249/2469] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:01:28 2022] GET /compute/v2.1/servers/38b000d3-167b-4f7a-ab80-cd51fcb7cbaf => generated 1470 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:01:29.737873 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-479aaf44-6a78-4923-997d-0dc68ffa4780 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:29.738393 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-479aaf44-6a78-4923-997d-0dc68ffa4780 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] [instance: 992277b1-0684-4013-a6c8-3937a1d41da3] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:29.745620 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-68b148b1-8d81-4252-b55e-949dcd86bd69 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:29.747946 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-479aaf44-6a78-4923-997d-0dc68ffa4780 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:29.748309 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-68b148b1-8d81-4252-b55e-949dcd86bd69 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:29.748863 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-68b148b1-8d81-4252-b55e-949dcd86bd69 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:29.749755 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-68b148b1-8d81-4252-b55e-949dcd86bd69 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:29.751791 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-68b148b1-8d81-4252-b55e-949dcd86bd69 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:29.752659 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-68b148b1-8d81-4252-b55e-949dcd86bd69 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:29.753066 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-479aaf44-6a78-4923-997d-0dc68ffa4780 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:29.753586 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-479aaf44-6a78-4923-997d-0dc68ffa4780 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:29.755648 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-479aaf44-6a78-4923-997d-0dc68ffa4780 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:29.756134 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-479aaf44-6a78-4923-997d-0dc68ffa4780 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:29.756590 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-479aaf44-6a78-4923-997d-0dc68ffa4780 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:29.778883 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-479aaf44-6a78-4923-997d-0dc68ffa4780 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] HTTP exception thrown: Instance 992277b1-0684-4013-a6c8-3937a1d41da3 could not be found. Oct 08 21:01:29.780914 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-479aaf44-6a78-4923-997d-0dc68ffa4780 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Request method failure captured: Oct 08 21:01:29.780914 ncdv-master-1 devstack@n-api.service[140492]: request: DELETE /compute/v2.1/servers/992277b1-0684-4013-a6c8-3937a1d41da3 HTTP/1.1 Oct 08 21:01:29.780914 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:01:29.780914 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:01:29.780914 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:01:29.780914 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 21:01:29.780914 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:01:29.780914 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:01:29.780914 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:01:29.780914 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:01:29.780914 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeTE7bTfM4hIhoviKx9l8mw-bWfYL6jsTZW_QjKSgS6NcvR5fjqeBn6E1jAPDuPpZvhMcTeb9kBH8YZZEMCFr_F1J-nxa8vLVrJvg33lxBDKWqjORjFzU7YTBNB-gB5p5hXf0cUCzsO7xU_2VbukaClcdx1U8H5njKq8mVnqRKHv1K4 Oct 08 21:01:29.780914 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:01:29.780914 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:01:29.780914 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:01:29.780914 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:01:29.780914 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:01:29.780914 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:01:29.780914 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 76b10172715d423eb887d6c5b171defb Oct 08 21:01:29.780914 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1001637313 Oct 08 21:01:29.780914 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:01:29.780914 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:01:29.780914 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/76b10172715d423eb887d6c5b171defb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/76b10172715d423eb887d6c5b171defb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_76b10172715d423eb887d6c5b171defb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/76b10172715d423eb887d6c5b171defb"}]}] Oct 08 21:01:29.780914 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1001637313 Oct 08 21:01:29.780914 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 76b10172715d423eb887d6c5b171defb Oct 08 21:01:29.780914 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1001637313 Oct 08 21:01:29.780914 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-ImagesOneServerNegativeTestJSON-1001637313-project Oct 08 21:01:29.780914 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:01:29.780914 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:01:29.780914 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: f06caf10b6fa43a3a2ad34858594e329 Oct 08 21:01:29.780914 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1001637313-project Oct 08 21:01:29.780914 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 21:01:29.780914 ncdv-master-1 devstack@n-api.service[140492]: exception: Instance 992277b1-0684-4013-a6c8-3937a1d41da3 could not be found. Oct 08 21:01:29.780914 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': '992277b1-0684-4013-a6c8-3937a1d41da3'} Oct 08 21:01:29.780914 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:01:29.780914 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:01:29.780914 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:01:29.780914 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:01:29.780914 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:01:29.780914 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:01:29.780914 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:01:29.780914 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:01:29.780914 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:01:29.780914 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:01:29.780914 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 992277b1-0684-4013-a6c8-3937a1d41da3 could not be found. Oct 08 21:01:29.780914 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:01:29.780914 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:01:29.780914 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:01:29.780914 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:01:29.780914 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:01:29.780914 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:01:29.780914 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:01:29.780914 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:01:29.780914 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:01:29.780914 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:01:29.780914 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 08 21:01:29.780914 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 08 21:01:29.780914 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 08 21:01:29.780914 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 08 21:01:29.780914 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:01:29.780914 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:01:29.780914 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:01:29.780914 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:01:29.784539 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 992277b1-0684-4013-a6c8-3937a1d41da3 could not be found. Oct 08 21:01:29.784539 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:01:29.784539 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:01:29.784539 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:01:29.784539 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:01:29.784539 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:01:29.784539 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:01:29.784539 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:01:29.784539 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:01:29.784539 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 992277b1-0684-4013-a6c8-3937a1d41da3 could not be found. Oct 08 21:01:29.784539 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:01:29.787442 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-479aaf44-6a78-4923-997d-0dc68ffa4780 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Returning 404 to user: Instance 992277b1-0684-4013-a6c8-3937a1d41da3 could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:01:29.788772 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-479aaf44-6a78-4923-997d-0dc68ffa4780 tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] 10.222.0.26 "DELETE /compute/v2.1/servers/992277b1-0684-4013-a6c8-3937a1d41da3" status: 404 len: 111 microversion: 2.1 time: 0.055284 Oct 08 21:01:29.789875 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1250/2470] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:01:29 2022] DELETE /compute/v2.1/servers/992277b1-0684-4013-a6c8-3937a1d41da3 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:01:29.796248 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-12b9e903-588c-41a8-8f50-9cb476a82baa tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:29.797481 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-12b9e903-588c-41a8-8f50-9cb476a82baa tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] [instance: 43b537b7-2c01-4b03-af22-c87f1c9152d3] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:29.822947 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-12b9e903-588c-41a8-8f50-9cb476a82baa tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:29.826058 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-12b9e903-588c-41a8-8f50-9cb476a82baa tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:29.827975 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-12b9e903-588c-41a8-8f50-9cb476a82baa tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:29.832479 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-12b9e903-588c-41a8-8f50-9cb476a82baa tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:29.833155 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-12b9e903-588c-41a8-8f50-9cb476a82baa tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:29.834370 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-12b9e903-588c-41a8-8f50-9cb476a82baa tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:30.185980 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-12b9e903-588c-41a8-8f50-9cb476a82baa tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612551711ec44a9b856a706a1c4c46e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c917d40fe85495081525a0d2952f888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:01:30.197074 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-12b9e903-588c-41a8-8f50-9cb476a82baa tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] 10.222.0.26 "GET /compute/v2.1/servers/43b537b7-2c01-4b03-af22-c87f1c9152d3" status: 200 len: 1275 microversion: 2.1 time: 0.405790 Oct 08 21:01:30.198456 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1251/2471] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:01:29 2022] GET /compute/v2.1/servers/43b537b7-2c01-4b03-af22-c87f1c9152d3 => generated 1275 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:01:30.203692 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e41b8a5d-8500-484d-8d5a-2fcedf1c6ebf tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:30.215355 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-e41b8a5d-8500-484d-8d5a-2fcedf1c6ebf tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] [instance: 992277b1-0684-4013-a6c8-3937a1d41da3] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:30.227132 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e41b8a5d-8500-484d-8d5a-2fcedf1c6ebf tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:30.227910 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e41b8a5d-8500-484d-8d5a-2fcedf1c6ebf tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:30.229087 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e41b8a5d-8500-484d-8d5a-2fcedf1c6ebf tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:30.230009 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e41b8a5d-8500-484d-8d5a-2fcedf1c6ebf tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:30.233918 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e41b8a5d-8500-484d-8d5a-2fcedf1c6ebf tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:30.234607 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e41b8a5d-8500-484d-8d5a-2fcedf1c6ebf tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:30.260276 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-e41b8a5d-8500-484d-8d5a-2fcedf1c6ebf tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] HTTP exception thrown: Instance 992277b1-0684-4013-a6c8-3937a1d41da3 could not be found. Oct 08 21:01:30.262124 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e41b8a5d-8500-484d-8d5a-2fcedf1c6ebf tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Request method failure captured: Oct 08 21:01:30.262124 ncdv-master-1 devstack@n-api.service[140492]: request: GET /compute/v2.1/servers/992277b1-0684-4013-a6c8-3937a1d41da3 HTTP/1.1 Oct 08 21:01:30.262124 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:01:30.262124 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:01:30.262124 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:01:30.262124 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 21:01:30.262124 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:01:30.262124 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:01:30.262124 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:01:30.262124 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:01:30.262124 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeTE7bTfM4hIhoviKx9l8mw-bWfYL6jsTZW_QjKSgS6NcvR5fjqeBn6E1jAPDuPpZvhMcTeb9kBH8YZZEMCFr_F1J-nxa8vLVrJvg33lxBDKWqjORjFzU7YTBNB-gB5p5hXf0cUCzsO7xU_2VbukaClcdx1U8H5njKq8mVnqRKHv1K4 Oct 08 21:01:30.262124 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:01:30.262124 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:01:30.262124 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:01:30.262124 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:01:30.262124 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:01:30.262124 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:01:30.262124 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 76b10172715d423eb887d6c5b171defb Oct 08 21:01:30.262124 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1001637313 Oct 08 21:01:30.262124 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:01:30.262124 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:01:30.262124 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/76b10172715d423eb887d6c5b171defb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/76b10172715d423eb887d6c5b171defb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_76b10172715d423eb887d6c5b171defb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/76b10172715d423eb887d6c5b171defb"}]}] Oct 08 21:01:30.262124 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1001637313 Oct 08 21:01:30.262124 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 76b10172715d423eb887d6c5b171defb Oct 08 21:01:30.262124 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1001637313 Oct 08 21:01:30.262124 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-ImagesOneServerNegativeTestJSON-1001637313-project Oct 08 21:01:30.262124 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:01:30.262124 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:01:30.262124 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: f06caf10b6fa43a3a2ad34858594e329 Oct 08 21:01:30.262124 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1001637313-project Oct 08 21:01:30.262124 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 21:01:30.262124 ncdv-master-1 devstack@n-api.service[140492]: exception: Instance 992277b1-0684-4013-a6c8-3937a1d41da3 could not be found. Oct 08 21:01:30.262124 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': '992277b1-0684-4013-a6c8-3937a1d41da3'} Oct 08 21:01:30.262124 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:01:30.262124 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:01:30.262124 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:01:30.262124 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:01:30.262124 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:01:30.262124 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:01:30.262124 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:01:30.262124 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:01:30.262124 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:01:30.262124 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:01:30.262124 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 992277b1-0684-4013-a6c8-3937a1d41da3 could not be found. Oct 08 21:01:30.262124 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:01:30.262124 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:01:30.262124 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:01:30.262124 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:01:30.262124 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:01:30.262124 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:01:30.262124 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:01:30.262124 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:01:30.262124 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:01:30.262124 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:01:30.262124 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:01:30.262124 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:01:30.262124 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:01:30.262124 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:01:30.262124 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:01:30.262124 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:01:30.262124 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 992277b1-0684-4013-a6c8-3937a1d41da3 could not be found. Oct 08 21:01:30.262124 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:01:30.262124 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:01:30.265961 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:01:30.265961 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:01:30.265961 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:01:30.265961 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:01:30.265961 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:01:30.265961 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:01:30.265961 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 992277b1-0684-4013-a6c8-3937a1d41da3 could not be found. Oct 08 21:01:30.265961 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:01:30.269559 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e41b8a5d-8500-484d-8d5a-2fcedf1c6ebf tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] Returning 404 to user: Instance 992277b1-0684-4013-a6c8-3937a1d41da3 could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:01:30.270765 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-e41b8a5d-8500-484d-8d5a-2fcedf1c6ebf tempest-ImagesOneServerNegativeTestJSON-1001637313 tempest-ImagesOneServerNegativeTestJSON-1001637313-project] 10.222.0.26 "GET /compute/v2.1/servers/992277b1-0684-4013-a6c8-3937a1d41da3" status: 404 len: 111 microversion: 2.1 time: 0.070989 Oct 08 21:01:30.271540 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1252/2472] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:01:30 2022] GET /compute/v2.1/servers/992277b1-0684-4013-a6c8-3937a1d41da3 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:01:30.701537 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-23231f70-c294-428e-9b90-0dab128dbaa9 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:30.702895 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-23231f70-c294-428e-9b90-0dab128dbaa9 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] [instance: b1a2f781-46a1-43f3-946a-f269deb6455e] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:30.716413 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-23231f70-c294-428e-9b90-0dab128dbaa9 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:30.717273 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-23231f70-c294-428e-9b90-0dab128dbaa9 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:30.718049 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-23231f70-c294-428e-9b90-0dab128dbaa9 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:30.719246 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-23231f70-c294-428e-9b90-0dab128dbaa9 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:30.720187 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-23231f70-c294-428e-9b90-0dab128dbaa9 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:30.720820 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-23231f70-c294-428e-9b90-0dab128dbaa9 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:31.082360 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-68b148b1-8d81-4252-b55e-949dcd86bd69 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1698dee4a2bf4ea19a6ee0c3d5cb5c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b00ee5e7828469f95bd90548d35982a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:01:31.086281 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-23231f70-c294-428e-9b90-0dab128dbaa9 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d2ddfa343e748c089129b0039a12ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e191d6217f024a17a14184071ac674c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:01:31.101735 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-68b148b1-8d81-4252-b55e-949dcd86bd69 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] 10.222.0.26 "GET /compute/v2.1/servers/4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711" status: 200 len: 1370 microversion: 2.1 time: 1.389950 Oct 08 21:01:31.105108 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-23231f70-c294-428e-9b90-0dab128dbaa9 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] 10.222.0.26 "GET /compute/v2.1/servers/b1a2f781-46a1-43f3-946a-f269deb6455e" status: 200 len: 1616 microversion: 2.1 time: 0.407544 Oct 08 21:01:31.107354 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1221/2473] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:01:29 2022] GET /compute/v2.1/servers/4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711 => generated 1370 bytes in 1397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:01:31.109133 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1253/2474] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:01:30 2022] GET /compute/v2.1/servers/b1a2f781-46a1-43f3-946a-f269deb6455e => generated 1616 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:01:31.112827 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-08d98bac-2afe-48da-9651-7dee1a3143b6 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:31.113762 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-08d98bac-2afe-48da-9651-7dee1a3143b6 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: 38b000d3-167b-4f7a-ab80-cd51fcb7cbaf] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:31.120803 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-08d98bac-2afe-48da-9651-7dee1a3143b6 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:31.121644 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-08d98bac-2afe-48da-9651-7dee1a3143b6 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:31.122319 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-08d98bac-2afe-48da-9651-7dee1a3143b6 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:31.123267 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-08d98bac-2afe-48da-9651-7dee1a3143b6 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:31.123961 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-08d98bac-2afe-48da-9651-7dee1a3143b6 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:31.124599 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-08d98bac-2afe-48da-9651-7dee1a3143b6 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:31.225476 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-cca52cba-fd99-4e4d-ac7b-b12fb9b89377 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:31.226463 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-cca52cba-fd99-4e4d-ac7b-b12fb9b89377 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] [instance: 43b537b7-2c01-4b03-af22-c87f1c9152d3] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:31.234291 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cca52cba-fd99-4e4d-ac7b-b12fb9b89377 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:31.235725 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cca52cba-fd99-4e4d-ac7b-b12fb9b89377 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:31.236480 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cca52cba-fd99-4e4d-ac7b-b12fb9b89377 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:31.237599 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cca52cba-fd99-4e4d-ac7b-b12fb9b89377 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:31.238287 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cca52cba-fd99-4e4d-ac7b-b12fb9b89377 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:31.239057 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cca52cba-fd99-4e4d-ac7b-b12fb9b89377 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:31.338295 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-cca52cba-fd99-4e4d-ac7b-b12fb9b89377 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612551711ec44a9b856a706a1c4c46e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c917d40fe85495081525a0d2952f888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:01:31.356215 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-cca52cba-fd99-4e4d-ac7b-b12fb9b89377 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] 10.222.0.26 "GET /compute/v2.1/servers/43b537b7-2c01-4b03-af22-c87f1c9152d3" status: 200 len: 1281 microversion: 2.1 time: 0.134360 Oct 08 21:01:31.369904 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1254/2475] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:01:31 2022] GET /compute/v2.1/servers/43b537b7-2c01-4b03-af22-c87f1c9152d3 => generated 1281 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:01:31.510047 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-08d98bac-2afe-48da-9651-7dee1a3143b6 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:01:31.526401 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-09d0f099-d4e3-459f-a0f8-89de6d190bb0 req-3f974ddf-802e-4e1a-a2c7-70b4d86d1fd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1a2f781-46a1-43f3-946a-f269deb6455e", "name": "network-vif-deleted", "tag": "630c8b7f-3038-4d2d-a57b-d2e5f7052fc8"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:01:31.536318 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-08d98bac-2afe-48da-9651-7dee1a3143b6 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/38b000d3-167b-4f7a-ab80-cd51fcb7cbaf" status: 200 len: 1470 microversion: 2.1 time: 0.427428 Oct 08 21:01:31.547655 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1222/2476] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:01:31 2022] GET /compute/v2.1/servers/38b000d3-167b-4f7a-ab80-cd51fcb7cbaf => generated 1470 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:01:31.551443 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-09d0f099-d4e3-459f-a0f8-89de6d190bb0 req-3f974ddf-802e-4e1a-a2c7-70b4d86d1fd7 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:31.552227 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-09d0f099-d4e3-459f-a0f8-89de6d190bb0 req-3f974ddf-802e-4e1a-a2c7-70b4d86d1fd7 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:31.553256 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-09d0f099-d4e3-459f-a0f8-89de6d190bb0 req-3f974ddf-802e-4e1a-a2c7-70b4d86d1fd7 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:31.572223 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-09d0f099-d4e3-459f-a0f8-89de6d190bb0 req-3f974ddf-802e-4e1a-a2c7-70b4d86d1fd7 service nova] Creating event network-vif-deleted:630c8b7f-3038-4d2d-a57b-d2e5f7052fc8 for instance b1a2f781-46a1-43f3-946a-f269deb6455e on nch2-master-1 Oct 08 21:01:31.579515 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-09d0f099-d4e3-459f-a0f8-89de6d190bb0 req-3f974ddf-802e-4e1a-a2c7-70b4d86d1fd7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057438 Oct 08 21:01:31.580689 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1255/2477] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:01:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:01:31.814003 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-72a093e2-8c7f-4838-b659-3d871aa5bf12 req-5db9a634-863a-4b0e-83be-5581ce6a9d12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711", "name": "network-vif-plugged", "status": "completed", "tag": "946a04d7-8297-4f58-81d9-eda02ade611b"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:01:31.847034 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-72a093e2-8c7f-4838-b659-3d871aa5bf12 req-5db9a634-863a-4b0e-83be-5581ce6a9d12 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:31.850047 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-72a093e2-8c7f-4838-b659-3d871aa5bf12 req-5db9a634-863a-4b0e-83be-5581ce6a9d12 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:31.851566 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-72a093e2-8c7f-4838-b659-3d871aa5bf12 req-5db9a634-863a-4b0e-83be-5581ce6a9d12 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:31.893522 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-72a093e2-8c7f-4838-b659-3d871aa5bf12 req-5db9a634-863a-4b0e-83be-5581ce6a9d12 service nova] Creating event network-vif-plugged:946a04d7-8297-4f58-81d9-eda02ade611b for instance 4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711 on nch1-master-1 Oct 08 21:01:31.904206 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-72a093e2-8c7f-4838-b659-3d871aa5bf12 req-5db9a634-863a-4b0e-83be-5581ce6a9d12 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099371 Oct 08 21:01:31.905496 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1223/2478] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:01:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:01:32.130899 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-da07e14f-f9a1-4ecb-9432-b787ff633909 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:32.132399 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-da07e14f-f9a1-4ecb-9432-b787ff633909 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] [instance: 4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:32.135811 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c22f214a-1956-49a5-8322-109c76fcb4cd tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:32.136533 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-c22f214a-1956-49a5-8322-109c76fcb4cd tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] [instance: b1a2f781-46a1-43f3-946a-f269deb6455e] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:32.142385 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-da07e14f-f9a1-4ecb-9432-b787ff633909 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:32.143591 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-da07e14f-f9a1-4ecb-9432-b787ff633909 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:32.144039 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-da07e14f-f9a1-4ecb-9432-b787ff633909 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:32.144988 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-da07e14f-f9a1-4ecb-9432-b787ff633909 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:32.145683 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-da07e14f-f9a1-4ecb-9432-b787ff633909 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:32.146117 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-da07e14f-f9a1-4ecb-9432-b787ff633909 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:32.147501 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c22f214a-1956-49a5-8322-109c76fcb4cd tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:32.156913 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c22f214a-1956-49a5-8322-109c76fcb4cd tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:32.157618 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c22f214a-1956-49a5-8322-109c76fcb4cd tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:32.158459 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c22f214a-1956-49a5-8322-109c76fcb4cd tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:32.158949 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c22f214a-1956-49a5-8322-109c76fcb4cd tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:32.159408 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c22f214a-1956-49a5-8322-109c76fcb4cd tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:32.215419 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c22f214a-1956-49a5-8322-109c76fcb4cd tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:32.215921 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c22f214a-1956-49a5-8322-109c76fcb4cd tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:32.216371 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c22f214a-1956-49a5-8322-109c76fcb4cd tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:32.216853 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.objects.instance [None req-c22f214a-1956-49a5-8322-109c76fcb4cd tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lazy-loading 'fault' on Instance uuid b1a2f781-46a1-43f3-946a-f269deb6455e {{(pid=140491) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 21:01:32.290130 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-c22f214a-1956-49a5-8322-109c76fcb4cd tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d2ddfa343e748c089129b0039a12ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e191d6217f024a17a14184071ac674c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:01:32.303423 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-c22f214a-1956-49a5-8322-109c76fcb4cd tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] 10.222.0.26 "GET /compute/v2.1/servers/b1a2f781-46a1-43f3-946a-f269deb6455e" status: 200 len: 1332 microversion: 2.1 time: 0.172072 Oct 08 21:01:32.321929 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1224/2479] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:01:32 2022] GET /compute/v2.1/servers/b1a2f781-46a1-43f3-946a-f269deb6455e => generated 1332 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:01:32.549180 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-60f2ab62-6b0d-4167-b90f-13d76c8cf0fa tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:32.549821 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-60f2ab62-6b0d-4167-b90f-13d76c8cf0fa tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] [instance: ceced78a-58d9-4175-b4fe-0d085be62c94] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:32.568584 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-60f2ab62-6b0d-4167-b90f-13d76c8cf0fa tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:32.569112 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-60f2ab62-6b0d-4167-b90f-13d76c8cf0fa tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:32.569604 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-60f2ab62-6b0d-4167-b90f-13d76c8cf0fa tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:32.570357 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-60f2ab62-6b0d-4167-b90f-13d76c8cf0fa tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:32.570826 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-60f2ab62-6b0d-4167-b90f-13d76c8cf0fa tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:32.571505 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-60f2ab62-6b0d-4167-b90f-13d76c8cf0fa tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:32.617333 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:01:32.643496 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-60f2ab62-6b0d-4167-b90f-13d76c8cf0fa tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] [instance: ceced78a-58d9-4175-b4fe-0d085be62c94] Going to try to terminate instance {{(pid=140491) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 21:01:32.785110 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-60f2ab62-6b0d-4167-b90f-13d76c8cf0fa tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] 10.222.0.26 "DELETE /compute/v2.1/servers/ceced78a-58d9-4175-b4fe-0d085be62c94" status: 204 len: 0 microversion: 2.42 time: 0.461330 Oct 08 21:01:32.791134 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1225/2480] 10.222.0.26 () {60 vars in 1280 bytes} [Sat Oct 8 21:01:32 2022] DELETE /compute/v2.1/servers/ceced78a-58d9-4175-b4fe-0d085be62c94 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 08 21:01:32.800370 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-833bc30c-b33c-4dd4-9f77-bc7bfbe79111 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:32.801394 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-833bc30c-b33c-4dd4-9f77-bc7bfbe79111 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] [instance: 43b537b7-2c01-4b03-af22-c87f1c9152d3] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:32.811649 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-833bc30c-b33c-4dd4-9f77-bc7bfbe79111 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:32.812608 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-833bc30c-b33c-4dd4-9f77-bc7bfbe79111 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:32.813833 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-833bc30c-b33c-4dd4-9f77-bc7bfbe79111 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:32.815655 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-833bc30c-b33c-4dd4-9f77-bc7bfbe79111 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:32.816750 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-833bc30c-b33c-4dd4-9f77-bc7bfbe79111 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:32.817825 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-833bc30c-b33c-4dd4-9f77-bc7bfbe79111 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:33.164970 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-833bc30c-b33c-4dd4-9f77-bc7bfbe79111 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612551711ec44a9b856a706a1c4c46e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c917d40fe85495081525a0d2952f888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:01:33.175760 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-833bc30c-b33c-4dd4-9f77-bc7bfbe79111 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] 10.222.0.26 "GET /compute/v2.1/servers/43b537b7-2c01-4b03-af22-c87f1c9152d3" status: 200 len: 1323 microversion: 2.1 time: 0.382656 Oct 08 21:01:33.178303 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1226/2481] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:01:32 2022] GET /compute/v2.1/servers/43b537b7-2c01-4b03-af22-c87f1c9152d3 => generated 1323 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:01:33.187810 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-0effc1a5-b301-4d90-93ef-25fdf036dee3 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:33.191522 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-0effc1a5-b301-4d90-93ef-25fdf036dee3 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: 38b000d3-167b-4f7a-ab80-cd51fcb7cbaf] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:33.205055 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0effc1a5-b301-4d90-93ef-25fdf036dee3 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:33.205844 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0effc1a5-b301-4d90-93ef-25fdf036dee3 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:33.206460 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0effc1a5-b301-4d90-93ef-25fdf036dee3 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:33.207336 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0effc1a5-b301-4d90-93ef-25fdf036dee3 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:33.209268 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0effc1a5-b301-4d90-93ef-25fdf036dee3 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:33.209889 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0effc1a5-b301-4d90-93ef-25fdf036dee3 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:33.368459 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-da07e14f-f9a1-4ecb-9432-b787ff633909 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1698dee4a2bf4ea19a6ee0c3d5cb5c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b00ee5e7828469f95bd90548d35982a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:01:33.399106 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-da07e14f-f9a1-4ecb-9432-b787ff633909 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] 10.222.0.26 "GET /compute/v2.1/servers/4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711" status: 200 len: 1370 microversion: 2.1 time: 1.261614 Oct 08 21:01:33.437442 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1256/2482] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:01:32 2022] GET /compute/v2.1/servers/4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711 => generated 1370 bytes in 1314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:01:33.458543 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-7700fe41-9229-43e9-a385-a0753d237d9c tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:33.463919 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-7700fe41-9229-43e9-a385-a0753d237d9c tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] [instance: ceced78a-58d9-4175-b4fe-0d085be62c94] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:33.484425 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7700fe41-9229-43e9-a385-a0753d237d9c tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:33.485714 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7700fe41-9229-43e9-a385-a0753d237d9c tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:33.488047 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7700fe41-9229-43e9-a385-a0753d237d9c tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:33.490053 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7700fe41-9229-43e9-a385-a0753d237d9c tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:33.490769 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7700fe41-9229-43e9-a385-a0753d237d9c tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:33.496189 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7700fe41-9229-43e9-a385-a0753d237d9c tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:33.612313 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-0effc1a5-b301-4d90-93ef-25fdf036dee3 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:01:33.624410 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-0effc1a5-b301-4d90-93ef-25fdf036dee3 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/38b000d3-167b-4f7a-ab80-cd51fcb7cbaf" status: 200 len: 1470 microversion: 2.1 time: 0.444755 Oct 08 21:01:33.628075 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1227/2483] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:01:33 2022] GET /compute/v2.1/servers/38b000d3-167b-4f7a-ab80-cd51fcb7cbaf => generated 1470 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:01:33.633200 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-6f7bfadb-a9cc-4e50-9c15-096fe4c7e14b tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:33.640245 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-6f7bfadb-a9cc-4e50-9c15-096fe4c7e14b tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] [instance: b1a2f781-46a1-43f3-946a-f269deb6455e] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:33.657321 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6f7bfadb-a9cc-4e50-9c15-096fe4c7e14b tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:33.660103 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6f7bfadb-a9cc-4e50-9c15-096fe4c7e14b tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:33.660770 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6f7bfadb-a9cc-4e50-9c15-096fe4c7e14b tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:33.664371 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6f7bfadb-a9cc-4e50-9c15-096fe4c7e14b tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:33.665072 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6f7bfadb-a9cc-4e50-9c15-096fe4c7e14b tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:33.665935 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6f7bfadb-a9cc-4e50-9c15-096fe4c7e14b tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:33.703662 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-6f7bfadb-a9cc-4e50-9c15-096fe4c7e14b tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] HTTP exception thrown: Instance b1a2f781-46a1-43f3-946a-f269deb6455e could not be found. Oct 08 21:01:33.706610 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-6f7bfadb-a9cc-4e50-9c15-096fe4c7e14b tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Request method failure captured: Oct 08 21:01:33.706610 ncdv-master-1 devstack@n-api.service[140491]: request: GET /compute/v2.1/servers/b1a2f781-46a1-43f3-946a-f269deb6455e HTTP/1.1 Oct 08 21:01:33.706610 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:01:33.706610 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:01:33.706610 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:01:33.706610 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 21:01:33.706610 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:01:33.706610 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:01:33.706610 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:01:33.706610 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:01:33.706610 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeSb4M26O_vDGku5blaRklPpWXMIkDkkYLHI4TQR3Lkj6ugAmZnXiEMbhbwcUUkKJxmJE_1GVhVwNr6_LCWPu8Cri-ZcBOuC9m35LAuoyQgqlRCHKUNztXiOLKFmIaCLGBcHhmGZivrgtOjs4S01nh-4JJFMgvybLWfGoSHKMKKau80 Oct 08 21:01:33.706610 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:01:33.706610 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:01:33.706610 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:01:33.706610 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:01:33.706610 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:01:33.706610 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:01:33.706610 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: e191d6217f024a17a14184071ac674c7 Oct 08 21:01:33.706610 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-VolumesAdminNegativeTest-557516914 Oct 08 21:01:33.706610 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:01:33.706610 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:01:33.706610 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/e191d6217f024a17a14184071ac674c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e191d6217f024a17a14184071ac674c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_e191d6217f024a17a14184071ac674c7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e191d6217f024a17a14184071ac674c7"}]}] Oct 08 21:01:33.706610 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-VolumesAdminNegativeTest-557516914 Oct 08 21:01:33.706610 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: e191d6217f024a17a14184071ac674c7 Oct 08 21:01:33.706610 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-557516914 Oct 08 21:01:33.706610 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-VolumesAdminNegativeTest-557516914-project Oct 08 21:01:33.706610 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:01:33.706610 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:01:33.706610 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 3d2ddfa343e748c089129b0039a12ac0 Oct 08 21:01:33.706610 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-VolumesAdminNegativeTest-557516914-project Oct 08 21:01:33.706610 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:01:33.706610 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance b1a2f781-46a1-43f3-946a-f269deb6455e could not be found. Oct 08 21:01:33.706610 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': 'b1a2f781-46a1-43f3-946a-f269deb6455e'} Oct 08 21:01:33.706610 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:01:33.706610 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:01:33.706610 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:01:33.706610 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:01:33.706610 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:01:33.706610 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:01:33.706610 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:01:33.706610 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:01:33.706610 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:01:33.706610 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:01:33.706610 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1a2f781-46a1-43f3-946a-f269deb6455e could not be found. Oct 08 21:01:33.706610 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:01:33.706610 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:01:33.706610 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:01:33.706610 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:01:33.706610 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:01:33.706610 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:01:33.706610 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:01:33.706610 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:01:33.706610 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:01:33.706610 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:01:33.706610 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:01:33.706610 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:01:33.706610 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:01:33.706610 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:01:33.706610 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:01:33.706610 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:01:33.706610 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1a2f781-46a1-43f3-946a-f269deb6455e could not be found. Oct 08 21:01:33.706610 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:01:33.706610 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:01:33.706610 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:01:33.710287 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:01:33.710287 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:01:33.710287 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:01:33.710287 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:01:33.710287 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:01:33.710287 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1a2f781-46a1-43f3-946a-f269deb6455e could not be found. Oct 08 21:01:33.710287 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:01:33.710287 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-6f7bfadb-a9cc-4e50-9c15-096fe4c7e14b tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Returning 404 to user: Instance b1a2f781-46a1-43f3-946a-f269deb6455e could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:01:33.710287 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-6f7bfadb-a9cc-4e50-9c15-096fe4c7e14b tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] 10.222.0.26 "GET /compute/v2.1/servers/b1a2f781-46a1-43f3-946a-f269deb6455e" status: 404 len: 111 microversion: 2.1 time: 0.079829 Oct 08 21:01:33.713953 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1228/2484] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:01:33 2022] GET /compute/v2.1/servers/b1a2f781-46a1-43f3-946a-f269deb6455e => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:01:33.723247 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-84af51d4-2f9b-4bf1-b467-ed1093f377a8 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] Calling method '.version_select at 0x7f1a914c9b80>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:33.748445 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-84af51d4-2f9b-4bf1-b467-ed1093f377a8 tempest-VolumesAdminNegativeTest-557516914 tempest-VolumesAdminNegativeTest-557516914-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1744260174" status: 202 len: 0 microversion: 2.1 time: 0.032282 Oct 08 21:01:33.749414 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1229/2485] 10.222.0.26 () {58 vars in 1221 bytes} [Sat Oct 8 21:01:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1744260174 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 21:01:34.015105 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-7700fe41-9229-43e9-a385-a0753d237d9c tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:01:34.025582 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-7700fe41-9229-43e9-a385-a0753d237d9c tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:01:34.027500 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-7700fe41-9229-43e9-a385-a0753d237d9c tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:01:34.029054 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-7700fe41-9229-43e9-a385-a0753d237d9c tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] 10.222.0.26 "GET /compute/v2.1/servers/ceced78a-58d9-4175-b4fe-0d085be62c94" status: 200 len: 2956 microversion: 2.42 time: 0.586345 Oct 08 21:01:34.041677 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1257/2486] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:01:33 2022] GET /compute/v2.1/servers/ceced78a-58d9-4175-b4fe-0d085be62c94 => generated 2956 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:01:34.058577 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-2e13a52b-755e-4861-bd56-ca3ae9388e0e req-3d9feda4-3ce2-44d7-a7ab-7d63b9859f04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38b000d3-167b-4f7a-ab80-cd51fcb7cbaf", "name": "network-vif-plugged", "status": "completed", "tag": "4e092828-fb69-410c-aa0c-7cbcee8350f3"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:01:34.072022 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-2e13a52b-755e-4861-bd56-ca3ae9388e0e req-3d9feda4-3ce2-44d7-a7ab-7d63b9859f04 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:34.072901 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-2e13a52b-755e-4861-bd56-ca3ae9388e0e req-3d9feda4-3ce2-44d7-a7ab-7d63b9859f04 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:34.073676 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-2e13a52b-755e-4861-bd56-ca3ae9388e0e req-3d9feda4-3ce2-44d7-a7ab-7d63b9859f04 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:34.089163 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-2e13a52b-755e-4861-bd56-ca3ae9388e0e req-3d9feda4-3ce2-44d7-a7ab-7d63b9859f04 service nova] Creating event network-vif-plugged:4e092828-fb69-410c-aa0c-7cbcee8350f3 for instance 38b000d3-167b-4f7a-ab80-cd51fcb7cbaf on nch2-master-1 Oct 08 21:01:34.096754 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [req-2e13a52b-755e-4861-bd56-ca3ae9388e0e req-3d9feda4-3ce2-44d7-a7ab-7d63b9859f04 service nova] Instance 38b000d3-167b-4f7a-ab80-cd51fcb7cbaf is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1'} {{(pid=140491) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 08 21:01:34.104861 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-2e13a52b-755e-4861-bd56-ca3ae9388e0e req-3d9feda4-3ce2-44d7-a7ab-7d63b9859f04 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050888 Oct 08 21:01:34.106263 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1230/2487] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:01:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 08 21:01:34.212121 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-ee1a3d6d-06ff-4561-aa47-0d39a8391910 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:34.215399 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-ee1a3d6d-06ff-4561-aa47-0d39a8391910 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] [instance: 43b537b7-2c01-4b03-af22-c87f1c9152d3] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:34.230340 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ee1a3d6d-06ff-4561-aa47-0d39a8391910 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:34.231358 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ee1a3d6d-06ff-4561-aa47-0d39a8391910 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:34.232202 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ee1a3d6d-06ff-4561-aa47-0d39a8391910 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:34.233249 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ee1a3d6d-06ff-4561-aa47-0d39a8391910 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:34.234235 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ee1a3d6d-06ff-4561-aa47-0d39a8391910 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:34.235027 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ee1a3d6d-06ff-4561-aa47-0d39a8391910 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:34.244773 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:01:34.434465 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-505f9cfc-6883-4bcf-aa97-507d26849115 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:34.435189 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-505f9cfc-6883-4bcf-aa97-507d26849115 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] [instance: 4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:34.454943 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-505f9cfc-6883-4bcf-aa97-507d26849115 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:34.457367 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-505f9cfc-6883-4bcf-aa97-507d26849115 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:34.458627 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-505f9cfc-6883-4bcf-aa97-507d26849115 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:34.462277 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-505f9cfc-6883-4bcf-aa97-507d26849115 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:34.464077 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-505f9cfc-6883-4bcf-aa97-507d26849115 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:34.465623 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-505f9cfc-6883-4bcf-aa97-507d26849115 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:34.708681 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-ee1a3d6d-06ff-4561-aa47-0d39a8391910 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612551711ec44a9b856a706a1c4c46e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c917d40fe85495081525a0d2952f888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:01:34.718178 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-ee1a3d6d-06ff-4561-aa47-0d39a8391910 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] 10.222.0.26 "GET /compute/v2.1/servers/43b537b7-2c01-4b03-af22-c87f1c9152d3" status: 200 len: 1323 microversion: 2.1 time: 0.516277 Oct 08 21:01:34.733674 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1258/2488] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:01:34 2022] GET /compute/v2.1/servers/43b537b7-2c01-4b03-af22-c87f1c9152d3 => generated 1323 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:01:34.742420 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-f0672e01-fe9a-4150-9651-7ef85d18aa60 req-edf7b527-674f-4aee-a96b-104741c52257 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43b537b7-2c01-4b03-af22-c87f1c9152d3", "tag": "11347a56-be77-4cfa-a05b-dfedc81d337a"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:01:34.778646 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-f0672e01-fe9a-4150-9651-7ef85d18aa60 req-edf7b527-674f-4aee-a96b-104741c52257 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:34.787157 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-f0672e01-fe9a-4150-9651-7ef85d18aa60 req-edf7b527-674f-4aee-a96b-104741c52257 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:34.787628 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-f0672e01-fe9a-4150-9651-7ef85d18aa60 req-edf7b527-674f-4aee-a96b-104741c52257 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:34.826664 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-f0672e01-fe9a-4150-9651-7ef85d18aa60 req-edf7b527-674f-4aee-a96b-104741c52257 service nova] Creating event network-changed:11347a56-be77-4cfa-a05b-dfedc81d337a for instance 43b537b7-2c01-4b03-af22-c87f1c9152d3 on nch2-master-1 Oct 08 21:01:34.834401 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-f0672e01-fe9a-4150-9651-7ef85d18aa60 req-edf7b527-674f-4aee-a96b-104741c52257 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099250 Oct 08 21:01:34.839234 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1259/2489] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:01:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:01:34.847578 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-31900db8-f2c4-47ef-aca2-c60f239d18bd tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:34.848575 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-31900db8-f2c4-47ef-aca2-c60f239d18bd tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: 38b000d3-167b-4f7a-ab80-cd51fcb7cbaf] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:34.856293 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-31900db8-f2c4-47ef-aca2-c60f239d18bd tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:34.856740 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-31900db8-f2c4-47ef-aca2-c60f239d18bd tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:34.857214 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-31900db8-f2c4-47ef-aca2-c60f239d18bd tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:34.857936 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-31900db8-f2c4-47ef-aca2-c60f239d18bd tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:34.863789 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-31900db8-f2c4-47ef-aca2-c60f239d18bd tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:34.864541 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-31900db8-f2c4-47ef-aca2-c60f239d18bd tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:34.920986 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-505f9cfc-6883-4bcf-aa97-507d26849115 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1698dee4a2bf4ea19a6ee0c3d5cb5c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b00ee5e7828469f95bd90548d35982a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:01:34.934827 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-505f9cfc-6883-4bcf-aa97-507d26849115 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] 10.222.0.26 "GET /compute/v2.1/servers/4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711" status: 200 len: 1565 microversion: 2.1 time: 0.507904 Oct 08 21:01:34.935823 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1231/2490] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:01:34 2022] GET /compute/v2.1/servers/4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711 => generated 1565 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:01:34.962989 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-a3a39224-8a76-4d02-bc7a-1cf6c9c6cec3 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:34.965637 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-a3a39224-8a76-4d02-bc7a-1cf6c9c6cec3 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] [instance: 4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:34.973366 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a3a39224-8a76-4d02-bc7a-1cf6c9c6cec3 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:34.974217 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a3a39224-8a76-4d02-bc7a-1cf6c9c6cec3 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:34.974774 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a3a39224-8a76-4d02-bc7a-1cf6c9c6cec3 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:34.975687 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a3a39224-8a76-4d02-bc7a-1cf6c9c6cec3 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:34.976263 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a3a39224-8a76-4d02-bc7a-1cf6c9c6cec3 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:34.976798 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a3a39224-8a76-4d02-bc7a-1cf6c9c6cec3 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:35.158158 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-a3a39224-8a76-4d02-bc7a-1cf6c9c6cec3 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] 10.222.0.26 "GET /compute/v2.1/servers/4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.200608 Oct 08 21:01:35.159056 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1232/2491] 10.222.0.26 () {58 vars in 1275 bytes} [Sat Oct 8 21:01:34 2022] GET /compute/v2.1/servers/4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711/os-interface => generated 285 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:01:35.163926 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-b34831b8-c076-446a-aad9-f65ad579f98b tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:35.164817 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-b34831b8-c076-446a-aad9-f65ad579f98b tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] [instance: ceced78a-58d9-4175-b4fe-0d085be62c94] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:35.175210 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b34831b8-c076-446a-aad9-f65ad579f98b tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:35.180653 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b34831b8-c076-446a-aad9-f65ad579f98b tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:35.181879 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b34831b8-c076-446a-aad9-f65ad579f98b tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:35.182879 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b34831b8-c076-446a-aad9-f65ad579f98b tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:35.183455 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b34831b8-c076-446a-aad9-f65ad579f98b tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:35.184402 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b34831b8-c076-446a-aad9-f65ad579f98b tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:35.424139 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-31900db8-f2c4-47ef-aca2-c60f239d18bd tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:01:35.468647 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=2 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:01:35.472864 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-31900db8-f2c4-47ef-aca2-c60f239d18bd tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/38b000d3-167b-4f7a-ab80-cd51fcb7cbaf" status: 200 len: 1470 microversion: 2.1 time: 0.636377 Oct 08 21:01:35.474002 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1260/2492] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:01:34 2022] GET /compute/v2.1/servers/38b000d3-167b-4f7a-ab80-cd51fcb7cbaf => generated 1470 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:01:35.748710 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-ba12cf5f-4789-49ba-96e4-27de4e3c7a72 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:35.750199 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-ba12cf5f-4789-49ba-96e4-27de4e3c7a72 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] [instance: 43b537b7-2c01-4b03-af22-c87f1c9152d3] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:35.770787 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ba12cf5f-4789-49ba-96e4-27de4e3c7a72 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:35.771549 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ba12cf5f-4789-49ba-96e4-27de4e3c7a72 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:35.772226 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ba12cf5f-4789-49ba-96e4-27de4e3c7a72 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:35.773231 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ba12cf5f-4789-49ba-96e4-27de4e3c7a72 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:35.773920 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ba12cf5f-4789-49ba-96e4-27de4e3c7a72 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:35.775426 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ba12cf5f-4789-49ba-96e4-27de4e3c7a72 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:35.854988 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-b34831b8-c076-446a-aad9-f65ad579f98b tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:01:35.885525 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-b34831b8-c076-446a-aad9-f65ad579f98b tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:01:35.888210 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-b34831b8-c076-446a-aad9-f65ad579f98b tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:01:35.889887 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-b34831b8-c076-446a-aad9-f65ad579f98b tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] 10.222.0.26 "GET /compute/v2.1/servers/ceced78a-58d9-4175-b4fe-0d085be62c94" status: 200 len: 2956 microversion: 2.42 time: 0.729651 Oct 08 21:01:35.890965 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1233/2493] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:01:35 2022] GET /compute/v2.1/servers/ceced78a-58d9-4175-b4fe-0d085be62c94 => generated 2956 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:01:35.914527 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=8 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:01:36.502526 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-054dfdd3-0527-47a3-aed2-9fef0188253d tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:36.503156 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-054dfdd3-0527-47a3-aed2-9fef0188253d tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: 38b000d3-167b-4f7a-ab80-cd51fcb7cbaf] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:36.518127 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-054dfdd3-0527-47a3-aed2-9fef0188253d tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:36.518637 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-054dfdd3-0527-47a3-aed2-9fef0188253d tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:36.519088 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-054dfdd3-0527-47a3-aed2-9fef0188253d tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:36.519821 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-054dfdd3-0527-47a3-aed2-9fef0188253d tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:36.520292 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-054dfdd3-0527-47a3-aed2-9fef0188253d tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:36.520730 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-054dfdd3-0527-47a3-aed2-9fef0188253d tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:36.870620 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-054dfdd3-0527-47a3-aed2-9fef0188253d tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:01:36.881833 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-054dfdd3-0527-47a3-aed2-9fef0188253d tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/38b000d3-167b-4f7a-ab80-cd51fcb7cbaf" status: 200 len: 1462 microversion: 2.1 time: 0.382609 Oct 08 21:01:36.882989 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1234/2494] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:01:36 2022] GET /compute/v2.1/servers/38b000d3-167b-4f7a-ab80-cd51fcb7cbaf => generated 1462 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:01:36.909024 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-ba12cf5f-4789-49ba-96e4-27de4e3c7a72 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612551711ec44a9b856a706a1c4c46e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c917d40fe85495081525a0d2952f888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:01:36.928871 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-5980413d-ad8d-47d7-af0f-35c16b8394b0 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:36.929895 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-5980413d-ad8d-47d7-af0f-35c16b8394b0 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: 38b000d3-167b-4f7a-ab80-cd51fcb7cbaf] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:36.936351 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-ba12cf5f-4789-49ba-96e4-27de4e3c7a72 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] 10.222.0.26 "GET /compute/v2.1/servers/43b537b7-2c01-4b03-af22-c87f1c9152d3" status: 200 len: 1323 microversion: 2.1 time: 1.194252 Oct 08 21:01:36.936956 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1261/2495] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:01:35 2022] GET /compute/v2.1/servers/43b537b7-2c01-4b03-af22-c87f1c9152d3 => generated 1323 bytes in 1196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:01:36.944202 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-d906055b-ded8-43c8-ac7f-e65facf507ce tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:36.946037 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5980413d-ad8d-47d7-af0f-35c16b8394b0 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:36.947040 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5980413d-ad8d-47d7-af0f-35c16b8394b0 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:36.947693 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5980413d-ad8d-47d7-af0f-35c16b8394b0 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:36.948563 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5980413d-ad8d-47d7-af0f-35c16b8394b0 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:36.949565 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-d906055b-ded8-43c8-ac7f-e65facf507ce tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] [instance: ceced78a-58d9-4175-b4fe-0d085be62c94] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:36.950203 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5980413d-ad8d-47d7-af0f-35c16b8394b0 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:36.953672 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5980413d-ad8d-47d7-af0f-35c16b8394b0 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:36.962024 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d906055b-ded8-43c8-ac7f-e65facf507ce tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:36.963135 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d906055b-ded8-43c8-ac7f-e65facf507ce tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:36.963597 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d906055b-ded8-43c8-ac7f-e65facf507ce tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:36.965335 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d906055b-ded8-43c8-ac7f-e65facf507ce tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:36.965875 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d906055b-ded8-43c8-ac7f-e65facf507ce tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:36.967292 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d906055b-ded8-43c8-ac7f-e65facf507ce tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:37.409179 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-d906055b-ded8-43c8-ac7f-e65facf507ce tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:01:37.423008 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-d906055b-ded8-43c8-ac7f-e65facf507ce tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:01:37.424892 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-d906055b-ded8-43c8-ac7f-e65facf507ce tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:01:37.426363 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-d906055b-ded8-43c8-ac7f-e65facf507ce tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] 10.222.0.26 "GET /compute/v2.1/servers/ceced78a-58d9-4175-b4fe-0d085be62c94" status: 200 len: 2956 microversion: 2.42 time: 0.487653 Oct 08 21:01:37.427453 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1262/2496] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:01:36 2022] GET /compute/v2.1/servers/ceced78a-58d9-4175-b4fe-0d085be62c94 => generated 2956 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:01:37.580223 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-5980413d-ad8d-47d7-af0f-35c16b8394b0 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:01:37.593859 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-5980413d-ad8d-47d7-af0f-35c16b8394b0 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/38b000d3-167b-4f7a-ab80-cd51fcb7cbaf" status: 200 len: 1462 microversion: 2.1 time: 0.680056 Oct 08 21:01:37.613012 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1235/2497] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:01:36 2022] GET /compute/v2.1/servers/38b000d3-167b-4f7a-ab80-cd51fcb7cbaf => generated 1462 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:01:37.624298 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-ac373932-c998-45d4-802a-3c22ca1640c0 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Action: 'create', calling method: .version_select at 0x7f1a87e1d280>, body: {"keypair": {"name": "tempest-keypair-143633498", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI+eM1P5hVGguZJ+Id8UuD8Lb6hxsBrdxD5s0AG/84gJW/odJRvoZ+Pp+p725nvrG7vlqnvAX2ZplHU2XEzUBxkuf4a/PoPVBnYOMzQScotq720GSMDA1xrpazN8Uvt1Fg=="}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:01:37.644145 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-ac373932-c998-45d4-802a-3c22ca1640c0 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Getting quotas for project 0ffdae031c4f47d599acb30f1d3c87b9. Resources: {'key_pairs'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:01:37.651884 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-ac373932-c998-45d4-802a-3c22ca1640c0 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Getting quotas for user 5266cd6be4514b3eac30a195f6b25772 and project 0ffdae031c4f47d599acb30f1d3c87b9. Resources: {'key_pairs'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:01:37.682464 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-ac373932-c998-45d4-802a-3c22ca1640c0 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.061935 Oct 08 21:01:37.684064 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1263/2498] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Oct 8 21:01:37 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:01:37.960225 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-bf22483c-82e9-4a73-9cd6-9b4357149591 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:37.960942 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-bf22483c-82e9-4a73-9cd6-9b4357149591 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] [instance: 43b537b7-2c01-4b03-af22-c87f1c9152d3] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:37.970229 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bf22483c-82e9-4a73-9cd6-9b4357149591 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:37.975137 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bf22483c-82e9-4a73-9cd6-9b4357149591 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:37.975925 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bf22483c-82e9-4a73-9cd6-9b4357149591 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:37.976925 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bf22483c-82e9-4a73-9cd6-9b4357149591 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:37.977428 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bf22483c-82e9-4a73-9cd6-9b4357149591 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:37.978882 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bf22483c-82e9-4a73-9cd6-9b4357149591 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:38.337468 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-cf251134-4254-4d73-980c-eed0241a0f57 req-0836bae1-5608-4783-9b22-24506ef20065 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711", "tag": "946a04d7-8297-4f58-81d9-eda02ade611b"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:01:38.361796 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-cf251134-4254-4d73-980c-eed0241a0f57 req-0836bae1-5608-4783-9b22-24506ef20065 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:38.362311 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-cf251134-4254-4d73-980c-eed0241a0f57 req-0836bae1-5608-4783-9b22-24506ef20065 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:38.362760 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-cf251134-4254-4d73-980c-eed0241a0f57 req-0836bae1-5608-4783-9b22-24506ef20065 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:38.397392 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-cf251134-4254-4d73-980c-eed0241a0f57 req-0836bae1-5608-4783-9b22-24506ef20065 service nova] Creating event network-changed:946a04d7-8297-4f58-81d9-eda02ade611b for instance 4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711 on nch1-master-1 Oct 08 21:01:38.403517 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-cf251134-4254-4d73-980c-eed0241a0f57 req-0836bae1-5608-4783-9b22-24506ef20065 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069786 Oct 08 21:01:38.404737 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1264/2499] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:01:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:01:38.457651 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-9d09441e-5e33-4bc8-bbab-4625bf12eeca tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:38.459796 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-9d09441e-5e33-4bc8-bbab-4625bf12eeca tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] [instance: ceced78a-58d9-4175-b4fe-0d085be62c94] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:38.468009 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9d09441e-5e33-4bc8-bbab-4625bf12eeca tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:38.469015 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9d09441e-5e33-4bc8-bbab-4625bf12eeca tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:38.469741 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9d09441e-5e33-4bc8-bbab-4625bf12eeca tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:38.470645 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9d09441e-5e33-4bc8-bbab-4625bf12eeca tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:38.471264 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9d09441e-5e33-4bc8-bbab-4625bf12eeca tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:38.471898 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9d09441e-5e33-4bc8-bbab-4625bf12eeca tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:38.550869 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-bf22483c-82e9-4a73-9cd6-9b4357149591 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612551711ec44a9b856a706a1c4c46e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c917d40fe85495081525a0d2952f888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:01:38.561008 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-bf22483c-82e9-4a73-9cd6-9b4357149591 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] 10.222.0.26 "GET /compute/v2.1/servers/43b537b7-2c01-4b03-af22-c87f1c9152d3" status: 200 len: 1323 microversion: 2.1 time: 0.604795 Oct 08 21:01:38.582386 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1236/2500] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:01:37 2022] GET /compute/v2.1/servers/43b537b7-2c01-4b03-af22-c87f1c9152d3 => generated 1323 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:01:39.275824 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-9d09441e-5e33-4bc8-bbab-4625bf12eeca tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:01:39.307227 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-9d09441e-5e33-4bc8-bbab-4625bf12eeca tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:01:39.311565 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-9d09441e-5e33-4bc8-bbab-4625bf12eeca tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:01:39.317392 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-9d09441e-5e33-4bc8-bbab-4625bf12eeca tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] 10.222.0.26 "GET /compute/v2.1/servers/ceced78a-58d9-4175-b4fe-0d085be62c94" status: 200 len: 2956 microversion: 2.42 time: 0.864784 Oct 08 21:01:39.334249 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1265/2501] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:01:38 2022] GET /compute/v2.1/servers/ceced78a-58d9-4175-b4fe-0d085be62c94 => generated 2956 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:01:39.590644 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-ca1f4805-d4dd-439b-88bd-a1da243a24f7 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:39.591970 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-ca1f4805-d4dd-439b-88bd-a1da243a24f7 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] [instance: 43b537b7-2c01-4b03-af22-c87f1c9152d3] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:39.600303 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ca1f4805-d4dd-439b-88bd-a1da243a24f7 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:39.601080 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ca1f4805-d4dd-439b-88bd-a1da243a24f7 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:39.601786 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ca1f4805-d4dd-439b-88bd-a1da243a24f7 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:39.602772 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ca1f4805-d4dd-439b-88bd-a1da243a24f7 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:39.603718 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ca1f4805-d4dd-439b-88bd-a1da243a24f7 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:39.604389 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ca1f4805-d4dd-439b-88bd-a1da243a24f7 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:39.982311 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-ca1f4805-d4dd-439b-88bd-a1da243a24f7 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612551711ec44a9b856a706a1c4c46e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c917d40fe85495081525a0d2952f888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:01:39.991622 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-ca1f4805-d4dd-439b-88bd-a1da243a24f7 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] 10.222.0.26 "GET /compute/v2.1/servers/43b537b7-2c01-4b03-af22-c87f1c9152d3" status: 200 len: 1323 microversion: 2.1 time: 0.405415 Oct 08 21:01:39.993490 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1237/2502] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:01:39 2022] GET /compute/v2.1/servers/43b537b7-2c01-4b03-af22-c87f1c9152d3 => generated 1323 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:01:40.373729 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-305fda74-da85-4761-8a99-8e9a6a1a8b68 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:40.377419 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-305fda74-da85-4761-8a99-8e9a6a1a8b68 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] [instance: ceced78a-58d9-4175-b4fe-0d085be62c94] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:40.397895 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-305fda74-da85-4761-8a99-8e9a6a1a8b68 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:40.398393 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-305fda74-da85-4761-8a99-8e9a6a1a8b68 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:40.403937 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-305fda74-da85-4761-8a99-8e9a6a1a8b68 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:40.405004 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-305fda74-da85-4761-8a99-8e9a6a1a8b68 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:40.405659 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-305fda74-da85-4761-8a99-8e9a6a1a8b68 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:40.406242 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-305fda74-da85-4761-8a99-8e9a6a1a8b68 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:40.983282 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-0fa4705c-b555-4a50-ab68-b9af8c39206d req-91b1342c-e65c-4c62-847c-5c4b6a6e1965 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ceced78a-58d9-4175-b4fe-0d085be62c94", "name": "network-vif-unplugged", "status": "completed", "tag": "5dd9a8e9-ad33-45d4-9c64-b8e4e48e3190"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:01:41.007103 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-0fa4705c-b555-4a50-ab68-b9af8c39206d req-91b1342c-e65c-4c62-847c-5c4b6a6e1965 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:41.007596 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-0fa4705c-b555-4a50-ab68-b9af8c39206d req-91b1342c-e65c-4c62-847c-5c4b6a6e1965 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:41.008041 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-0fa4705c-b555-4a50-ab68-b9af8c39206d req-91b1342c-e65c-4c62-847c-5c4b6a6e1965 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:41.045477 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-0fa4705c-b555-4a50-ab68-b9af8c39206d req-91b1342c-e65c-4c62-847c-5c4b6a6e1965 service nova] Creating event network-vif-unplugged:5dd9a8e9-ad33-45d4-9c64-b8e4e48e3190 for instance ceced78a-58d9-4175-b4fe-0d085be62c94 on nch2-master-1 Oct 08 21:01:41.054762 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-0fa4705c-b555-4a50-ab68-b9af8c39206d req-91b1342c-e65c-4c62-847c-5c4b6a6e1965 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.077116 Oct 08 21:01:41.058118 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1238/2503] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:01:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 08 21:01:41.070776 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-1a9821a3-1b4f-4518-adf3-4891f7a72311 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:41.074941 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-1a9821a3-1b4f-4518-adf3-4891f7a72311 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] [instance: 43b537b7-2c01-4b03-af22-c87f1c9152d3] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:41.091658 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1a9821a3-1b4f-4518-adf3-4891f7a72311 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:41.094533 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1a9821a3-1b4f-4518-adf3-4891f7a72311 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:41.096271 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1a9821a3-1b4f-4518-adf3-4891f7a72311 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:41.097907 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1a9821a3-1b4f-4518-adf3-4891f7a72311 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:41.106580 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1a9821a3-1b4f-4518-adf3-4891f7a72311 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:41.107940 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1a9821a3-1b4f-4518-adf3-4891f7a72311 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:41.405951 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-1a9821a3-1b4f-4518-adf3-4891f7a72311 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612551711ec44a9b856a706a1c4c46e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c917d40fe85495081525a0d2952f888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:01:41.420794 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-1a9821a3-1b4f-4518-adf3-4891f7a72311 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] 10.222.0.26 "GET /compute/v2.1/servers/43b537b7-2c01-4b03-af22-c87f1c9152d3" status: 200 len: 1323 microversion: 2.1 time: 0.361120 Oct 08 21:01:41.422713 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1239/2504] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:01:41 2022] GET /compute/v2.1/servers/43b537b7-2c01-4b03-af22-c87f1c9152d3 => generated 1323 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:01:42.455837 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-1e5e7cad-6af2-4da3-bd9d-d333145ba21e tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:42.457419 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-1e5e7cad-6af2-4da3-bd9d-d333145ba21e tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] [instance: 43b537b7-2c01-4b03-af22-c87f1c9152d3] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:42.472077 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1e5e7cad-6af2-4da3-bd9d-d333145ba21e tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:42.473979 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1e5e7cad-6af2-4da3-bd9d-d333145ba21e tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:42.482832 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1e5e7cad-6af2-4da3-bd9d-d333145ba21e tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:42.492492 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1e5e7cad-6af2-4da3-bd9d-d333145ba21e tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:42.493914 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1e5e7cad-6af2-4da3-bd9d-d333145ba21e tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:42.494799 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1e5e7cad-6af2-4da3-bd9d-d333145ba21e tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:42.559786 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-305fda74-da85-4761-8a99-8e9a6a1a8b68 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:01:42.572022 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-305fda74-da85-4761-8a99-8e9a6a1a8b68 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:01:42.573530 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-305fda74-da85-4761-8a99-8e9a6a1a8b68 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:01:42.574821 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-305fda74-da85-4761-8a99-8e9a6a1a8b68 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] 10.222.0.26 "GET /compute/v2.1/servers/ceced78a-58d9-4175-b4fe-0d085be62c94" status: 200 len: 2935 microversion: 2.42 time: 2.212748 Oct 08 21:01:42.598692 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1266/2505] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:01:40 2022] GET /compute/v2.1/servers/ceced78a-58d9-4175-b4fe-0d085be62c94 => generated 2935 bytes in 2237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:01:43.472335 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-98d56c64-d334-4e5b-9ae3-4b5db17c6fd2 req-4fd6592f-dcd4-4c3d-9063-0ca77eba8b14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ceced78a-58d9-4175-b4fe-0d085be62c94", "name": "network-vif-unplugged", "status": "completed", "tag": "aa2712c9-7942-46c1-ba5f-b344a76ff083"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:01:43.525540 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-98d56c64-d334-4e5b-9ae3-4b5db17c6fd2 req-4fd6592f-dcd4-4c3d-9063-0ca77eba8b14 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:43.526097 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-98d56c64-d334-4e5b-9ae3-4b5db17c6fd2 req-4fd6592f-dcd4-4c3d-9063-0ca77eba8b14 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.029s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:43.526556 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-98d56c64-d334-4e5b-9ae3-4b5db17c6fd2 req-4fd6592f-dcd4-4c3d-9063-0ca77eba8b14 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:43.566335 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-98d56c64-d334-4e5b-9ae3-4b5db17c6fd2 req-4fd6592f-dcd4-4c3d-9063-0ca77eba8b14 service nova] Creating event network-vif-unplugged:aa2712c9-7942-46c1-ba5f-b344a76ff083 for instance ceced78a-58d9-4175-b4fe-0d085be62c94 on nch2-master-1 Oct 08 21:01:43.576585 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-98d56c64-d334-4e5b-9ae3-4b5db17c6fd2 req-4fd6592f-dcd4-4c3d-9063-0ca77eba8b14 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.107956 Oct 08 21:01:43.578850 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1267/2506] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:01:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:01:43.613344 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-54897621-c869-4f72-bd8b-a83d8cb778b3 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:43.614955 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-54897621-c869-4f72-bd8b-a83d8cb778b3 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] [instance: ceced78a-58d9-4175-b4fe-0d085be62c94] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:43.640389 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-54897621-c869-4f72-bd8b-a83d8cb778b3 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:43.642806 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-54897621-c869-4f72-bd8b-a83d8cb778b3 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:43.644752 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-54897621-c869-4f72-bd8b-a83d8cb778b3 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:43.646262 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-54897621-c869-4f72-bd8b-a83d8cb778b3 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:43.647072 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-54897621-c869-4f72-bd8b-a83d8cb778b3 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:43.650011 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-54897621-c869-4f72-bd8b-a83d8cb778b3 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:44.076729 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-54897621-c869-4f72-bd8b-a83d8cb778b3 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:01:44.092756 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-54897621-c869-4f72-bd8b-a83d8cb778b3 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:01:44.094478 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-54897621-c869-4f72-bd8b-a83d8cb778b3 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:01:44.112757 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-1e5e7cad-6af2-4da3-bd9d-d333145ba21e tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612551711ec44a9b856a706a1c4c46e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c917d40fe85495081525a0d2952f888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:01:44.116125 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-54897621-c869-4f72-bd8b-a83d8cb778b3 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] 10.222.0.26 "GET /compute/v2.1/servers/ceced78a-58d9-4175-b4fe-0d085be62c94" status: 200 len: 2868 microversion: 2.42 time: 0.507443 Oct 08 21:01:44.132432 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-1e5e7cad-6af2-4da3-bd9d-d333145ba21e tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] 10.222.0.26 "GET /compute/v2.1/servers/43b537b7-2c01-4b03-af22-c87f1c9152d3" status: 200 len: 1323 microversion: 2.1 time: 1.682000 Oct 08 21:01:44.150776 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1268/2507] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:01:43 2022] GET /compute/v2.1/servers/ceced78a-58d9-4175-b4fe-0d085be62c94 => generated 2868 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 08 21:01:44.167435 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-160d6d15-aa63-458a-8389-0b6acef4b35a req-71b34399-9976-48e0-b911-0b3ed3835236 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ceced78a-58d9-4175-b4fe-0d085be62c94", "name": "network-vif-deleted", "tag": "f16f4042-95b4-4dfa-afa7-41b0147a6cf2"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:01:44.171439 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1240/2508] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:01:42 2022] GET /compute/v2.1/servers/43b537b7-2c01-4b03-af22-c87f1c9152d3 => generated 1323 bytes in 1721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:01:44.211368 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-160d6d15-aa63-458a-8389-0b6acef4b35a req-71b34399-9976-48e0-b911-0b3ed3835236 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:44.211906 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-160d6d15-aa63-458a-8389-0b6acef4b35a req-71b34399-9976-48e0-b911-0b3ed3835236 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:44.212349 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-160d6d15-aa63-458a-8389-0b6acef4b35a req-71b34399-9976-48e0-b911-0b3ed3835236 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:44.239409 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-160d6d15-aa63-458a-8389-0b6acef4b35a req-71b34399-9976-48e0-b911-0b3ed3835236 service nova] Creating event network-vif-deleted:f16f4042-95b4-4dfa-afa7-41b0147a6cf2 for instance ceced78a-58d9-4175-b4fe-0d085be62c94 on nch2-master-1 Oct 08 21:01:44.265709 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-160d6d15-aa63-458a-8389-0b6acef4b35a req-71b34399-9976-48e0-b911-0b3ed3835236 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113464 Oct 08 21:01:44.270925 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1269/2509] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:01:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:01:45.158807 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c82f13cc-6772-44aa-8818-f9566dbb2e39 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:45.159502 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-c82f13cc-6772-44aa-8818-f9566dbb2e39 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] [instance: 43b537b7-2c01-4b03-af22-c87f1c9152d3] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:45.169343 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-056a6afb-f95f-41b9-a488-57a2d663a7c5 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:45.170248 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-056a6afb-f95f-41b9-a488-57a2d663a7c5 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] [instance: ceced78a-58d9-4175-b4fe-0d085be62c94] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:45.189513 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c82f13cc-6772-44aa-8818-f9566dbb2e39 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:45.190025 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c82f13cc-6772-44aa-8818-f9566dbb2e39 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:45.202110 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c82f13cc-6772-44aa-8818-f9566dbb2e39 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:45.203449 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c82f13cc-6772-44aa-8818-f9566dbb2e39 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:45.204556 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-056a6afb-f95f-41b9-a488-57a2d663a7c5 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:45.205072 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-056a6afb-f95f-41b9-a488-57a2d663a7c5 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:45.205576 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-056a6afb-f95f-41b9-a488-57a2d663a7c5 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:45.206309 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-056a6afb-f95f-41b9-a488-57a2d663a7c5 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:45.207089 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c82f13cc-6772-44aa-8818-f9566dbb2e39 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:45.207542 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c82f13cc-6772-44aa-8818-f9566dbb2e39 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:45.209997 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-056a6afb-f95f-41b9-a488-57a2d663a7c5 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:45.210416 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-056a6afb-f95f-41b9-a488-57a2d663a7c5 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:46.013084 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-056a6afb-f95f-41b9-a488-57a2d663a7c5 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:01:46.023306 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-056a6afb-f95f-41b9-a488-57a2d663a7c5 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:01:46.036358 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-056a6afb-f95f-41b9-a488-57a2d663a7c5 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:01:46.037757 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-056a6afb-f95f-41b9-a488-57a2d663a7c5 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] 10.222.0.26 "GET /compute/v2.1/servers/ceced78a-58d9-4175-b4fe-0d085be62c94" status: 200 len: 2708 microversion: 2.42 time: 0.873550 Oct 08 21:01:46.065433 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1270/2510] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:01:45 2022] GET /compute/v2.1/servers/ceced78a-58d9-4175-b4fe-0d085be62c94 => generated 2708 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:01:46.095891 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-b6606bf3-8f9c-431e-bcd8-da86d16e282f req-3e48981b-09c0-487f-9956-2caccf2c9e6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ceced78a-58d9-4175-b4fe-0d085be62c94", "name": "network-vif-unplugged", "status": "completed", "tag": "b0a57839-341e-4831-b37b-2d1a263887b4"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:01:46.130027 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-b6606bf3-8f9c-431e-bcd8-da86d16e282f req-3e48981b-09c0-487f-9956-2caccf2c9e6b service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:46.132900 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-b6606bf3-8f9c-431e-bcd8-da86d16e282f req-3e48981b-09c0-487f-9956-2caccf2c9e6b service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:46.138944 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-b6606bf3-8f9c-431e-bcd8-da86d16e282f req-3e48981b-09c0-487f-9956-2caccf2c9e6b service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:46.166828 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-b6606bf3-8f9c-431e-bcd8-da86d16e282f req-3e48981b-09c0-487f-9956-2caccf2c9e6b service nova] Creating event network-vif-unplugged:b0a57839-341e-4831-b37b-2d1a263887b4 for instance ceced78a-58d9-4175-b4fe-0d085be62c94 on nch2-master-1 Oct 08 21:01:46.181045 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-b6606bf3-8f9c-431e-bcd8-da86d16e282f req-3e48981b-09c0-487f-9956-2caccf2c9e6b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.113628 Oct 08 21:01:46.182822 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1271/2511] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:01:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:01:46.299338 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-c82f13cc-6772-44aa-8818-f9566dbb2e39 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612551711ec44a9b856a706a1c4c46e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c917d40fe85495081525a0d2952f888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:01:46.309964 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-c82f13cc-6772-44aa-8818-f9566dbb2e39 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] 10.222.0.26 "GET /compute/v2.1/servers/43b537b7-2c01-4b03-af22-c87f1c9152d3" status: 200 len: 1323 microversion: 2.1 time: 1.155103 Oct 08 21:01:46.325575 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1241/2512] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:01:45 2022] GET /compute/v2.1/servers/43b537b7-2c01-4b03-af22-c87f1c9152d3 => generated 1323 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:01:46.890209 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-2d033ef6-ea64-4cd0-bcf2-12cc187ef88a req-7a20e535-734b-401d-bb2e-860fee00b3e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ceced78a-58d9-4175-b4fe-0d085be62c94", "name": "network-vif-deleted", "tag": "aa2712c9-7942-46c1-ba5f-b344a76ff083"}, {"server_uuid": "ceced78a-58d9-4175-b4fe-0d085be62c94", "name": "network-vif-deleted", "tag": "91fedb87-f0c8-47ba-8994-fc3b2f3d3d1f"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:01:46.919058 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-2d033ef6-ea64-4cd0-bcf2-12cc187ef88a req-7a20e535-734b-401d-bb2e-860fee00b3e1 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:46.921331 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-2d033ef6-ea64-4cd0-bcf2-12cc187ef88a req-7a20e535-734b-401d-bb2e-860fee00b3e1 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:46.924767 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-2d033ef6-ea64-4cd0-bcf2-12cc187ef88a req-7a20e535-734b-401d-bb2e-860fee00b3e1 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:46.959168 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-2d033ef6-ea64-4cd0-bcf2-12cc187ef88a req-7a20e535-734b-401d-bb2e-860fee00b3e1 service nova] Creating event network-vif-deleted:aa2712c9-7942-46c1-ba5f-b344a76ff083 for instance ceced78a-58d9-4175-b4fe-0d085be62c94 on nch2-master-1 Oct 08 21:01:46.963694 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-2d033ef6-ea64-4cd0-bcf2-12cc187ef88a req-7a20e535-734b-401d-bb2e-860fee00b3e1 service nova] Creating event network-vif-deleted:91fedb87-f0c8-47ba-8994-fc3b2f3d3d1f for instance ceced78a-58d9-4175-b4fe-0d085be62c94 on nch2-master-1 Oct 08 21:01:46.977370 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-2d033ef6-ea64-4cd0-bcf2-12cc187ef88a req-7a20e535-734b-401d-bb2e-860fee00b3e1 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.091975 Oct 08 21:01:46.979601 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1272/2513] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:01:46 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:01:47.075095 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-a45c3f8e-4133-46d8-b74f-31799aa269a2 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:47.076315 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-a45c3f8e-4133-46d8-b74f-31799aa269a2 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] [instance: ceced78a-58d9-4175-b4fe-0d085be62c94] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:47.084318 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a45c3f8e-4133-46d8-b74f-31799aa269a2 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:47.085072 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a45c3f8e-4133-46d8-b74f-31799aa269a2 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:47.085697 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a45c3f8e-4133-46d8-b74f-31799aa269a2 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:47.089312 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a45c3f8e-4133-46d8-b74f-31799aa269a2 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:47.089955 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a45c3f8e-4133-46d8-b74f-31799aa269a2 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:47.090578 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a45c3f8e-4133-46d8-b74f-31799aa269a2 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:47.352131 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-416486d5-7c1c-4a47-a050-e98769495a29 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:47.354449 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-416486d5-7c1c-4a47-a050-e98769495a29 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] [instance: 43b537b7-2c01-4b03-af22-c87f1c9152d3] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:47.375037 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-416486d5-7c1c-4a47-a050-e98769495a29 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:47.380771 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-416486d5-7c1c-4a47-a050-e98769495a29 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:47.381437 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-416486d5-7c1c-4a47-a050-e98769495a29 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:47.382295 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-416486d5-7c1c-4a47-a050-e98769495a29 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:47.382871 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-416486d5-7c1c-4a47-a050-e98769495a29 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:47.383411 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-416486d5-7c1c-4a47-a050-e98769495a29 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:47.660529 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=4 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:01:47.779772 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-a45c3f8e-4133-46d8-b74f-31799aa269a2 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:01:47.793716 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-a45c3f8e-4133-46d8-b74f-31799aa269a2 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:01:47.801146 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-a45c3f8e-4133-46d8-b74f-31799aa269a2 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:01:47.805655 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-a45c3f8e-4133-46d8-b74f-31799aa269a2 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] 10.222.0.26 "GET /compute/v2.1/servers/ceced78a-58d9-4175-b4fe-0d085be62c94" status: 200 len: 2435 microversion: 2.42 time: 0.736291 Oct 08 21:01:47.809114 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1242/2514] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:01:47 2022] GET /compute/v2.1/servers/ceced78a-58d9-4175-b4fe-0d085be62c94 => generated 2435 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 08 21:01:47.818344 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-aec2116b-2237-46cc-aa93-0b91dc30cee9 tempest-MigrationsAdminTest-1609748928 tempest-MigrationsAdminTest-1609748928-project-admin] Calling method '.version_select at 0x7f1a8cc633a0>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:47.832468 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-aec2116b-2237-46cc-aa93-0b91dc30cee9 tempest-MigrationsAdminTest-1609748928 tempest-MigrationsAdminTest-1609748928-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:47.833249 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-aec2116b-2237-46cc-aa93-0b91dc30cee9 tempest-MigrationsAdminTest-1609748928 tempest-MigrationsAdminTest-1609748928-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:47.835724 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-aec2116b-2237-46cc-aa93-0b91dc30cee9 tempest-MigrationsAdminTest-1609748928 tempest-MigrationsAdminTest-1609748928-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:47.855139 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-aec2116b-2237-46cc-aa93-0b91dc30cee9 tempest-MigrationsAdminTest-1609748928 tempest-MigrationsAdminTest-1609748928-project-admin] 10.222.0.26 "GET /compute/v2.1/os-migrations" status: 200 len: 803 microversion: 2.1 time: 0.042123 Oct 08 21:01:47.874120 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1243/2515] 10.222.0.26 () {58 vars in 1143 bytes} [Sat Oct 8 21:01:47 2022] GET /compute/v2.1/os-migrations => generated 803 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:01:47.891984 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-4b8da782-a18d-4e69-80e6-eb4583ebbe51 tempest-MigrationsAdminTest-1609748928 tempest-MigrationsAdminTest-1609748928-project-admin] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:47.908008 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-4b8da782-a18d-4e69-80e6-eb4583ebbe51 tempest-MigrationsAdminTest-1609748928 tempest-MigrationsAdminTest-1609748928-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.025997 Oct 08 21:01:47.910699 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1244/2516] 10.222.0.26 () {58 vars in 1137 bytes} [Sat Oct 8 21:01:47 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:01:47.933359 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-bc54dc24-f70e-4790-a5ba-26686d5682b0 tempest-MigrationsAdminTest-1609748928 tempest-MigrationsAdminTest-1609748928-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-1021005527", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:01:47.974036 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-bc54dc24-f70e-4790-a5ba-26686d5682b0 tempest-MigrationsAdminTest-1609748928 tempest-MigrationsAdminTest-1609748928-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 499 microversion: 2.1 time: 0.045347 Oct 08 21:01:47.980330 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1245/2517] 10.222.0.26 () {60 vars in 1146 bytes} [Sat Oct 8 21:01:47 2022] POST /compute/v2.1/flavors => generated 499 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:01:48.006745 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-48ca7006-efe1-4530-8ab6-6c9dadc05ae9 tempest-MigrationsAdminTest-1609748928 tempest-MigrationsAdminTest-1609748928-project-admin] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:48.032130 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-48ca7006-efe1-4530-8ab6-6c9dadc05ae9 tempest-MigrationsAdminTest-1609748928 tempest-MigrationsAdminTest-1609748928-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.040218 Oct 08 21:01:48.033784 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1246/2518] 10.222.0.26 () {58 vars in 1182 bytes} [Sat Oct 8 21:01:47 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 08 21:01:48.233472 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-3eec49ce-31f9-4cf3-a358-363de08c63dc req-e39f04de-db85-4425-bda9-3a7a0bb0be87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ceced78a-58d9-4175-b4fe-0d085be62c94", "name": "network-vif-unplugged", "status": "completed", "tag": "91fedb87-f0c8-47ba-8994-fc3b2f3d3d1f"}, {"server_uuid": "43b537b7-2c01-4b03-af22-c87f1c9152d3", "name": "network-vif-plugged", "status": "completed", "tag": "11347a56-be77-4cfa-a05b-dfedc81d337a"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:01:48.234368 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-416486d5-7c1c-4a47-a050-e98769495a29 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612551711ec44a9b856a706a1c4c46e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c917d40fe85495081525a0d2952f888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:01:48.242481 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-416486d5-7c1c-4a47-a050-e98769495a29 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] 10.222.0.26 "GET /compute/v2.1/servers/43b537b7-2c01-4b03-af22-c87f1c9152d3" status: 200 len: 1323 microversion: 2.1 time: 0.896623 Oct 08 21:01:48.245487 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1273/2519] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:01:47 2022] GET /compute/v2.1/servers/43b537b7-2c01-4b03-af22-c87f1c9152d3 => generated 1323 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:01:48.261526 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-3eec49ce-31f9-4cf3-a358-363de08c63dc req-e39f04de-db85-4425-bda9-3a7a0bb0be87 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:48.262277 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-3eec49ce-31f9-4cf3-a358-363de08c63dc req-e39f04de-db85-4425-bda9-3a7a0bb0be87 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:48.262958 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-3eec49ce-31f9-4cf3-a358-363de08c63dc req-e39f04de-db85-4425-bda9-3a7a0bb0be87 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:48.275464 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-6502e153-e49c-484e-9877-995971ba73fe tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1600396517", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "a27506c8-e431-412e-9a38-928f17d8819e"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:01:48.276384 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:01:48.281683 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-3eec49ce-31f9-4cf3-a358-363de08c63dc req-e39f04de-db85-4425-bda9-3a7a0bb0be87 service nova] Creating event network-vif-unplugged:91fedb87-f0c8-47ba-8994-fc3b2f3d3d1f for instance ceced78a-58d9-4175-b4fe-0d085be62c94 on nch2-master-1 Oct 08 21:01:48.282597 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-3eec49ce-31f9-4cf3-a358-363de08c63dc req-e39f04de-db85-4425-bda9-3a7a0bb0be87 service nova] Creating event network-vif-plugged:11347a56-be77-4cfa-a05b-dfedc81d337a for instance 43b537b7-2c01-4b03-af22-c87f1c9152d3 on nch2-master-1 Oct 08 21:01:48.294272 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-3eec49ce-31f9-4cf3-a358-363de08c63dc req-e39f04de-db85-4425-bda9-3a7a0bb0be87 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.066069 Oct 08 21:01:48.297427 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1247/2520] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:01:48 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 08 21:01:48.398185 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.network.neutron [None req-6502e153-e49c-484e-9877-995971ba73fe tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] validate_networks() for None {{(pid=140492) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 21:01:48.851291 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-00d8b547-6c26-4824-9ddf-881780da8c50 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:48.852363 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-00d8b547-6c26-4824-9ddf-881780da8c50 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] [instance: ceced78a-58d9-4175-b4fe-0d085be62c94] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:48.868364 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-00d8b547-6c26-4824-9ddf-881780da8c50 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:48.872060 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-00d8b547-6c26-4824-9ddf-881780da8c50 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:48.881114 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-00d8b547-6c26-4824-9ddf-881780da8c50 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:48.884925 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-00d8b547-6c26-4824-9ddf-881780da8c50 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:48.885738 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-00d8b547-6c26-4824-9ddf-881780da8c50 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:48.888449 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-00d8b547-6c26-4824-9ddf-881780da8c50 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:49.367601 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-00d8b547-6c26-4824-9ddf-881780da8c50 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:01:49.390734 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-00d8b547-6c26-4824-9ddf-881780da8c50 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:01:49.394726 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-00d8b547-6c26-4824-9ddf-881780da8c50 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:01:49.402258 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-00d8b547-6c26-4824-9ddf-881780da8c50 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] 10.222.0.26 "GET /compute/v2.1/servers/ceced78a-58d9-4175-b4fe-0d085be62c94" status: 200 len: 2389 microversion: 2.42 time: 0.554822 Oct 08 21:01:49.409744 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1248/2521] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:01:48 2022] GET /compute/v2.1/servers/ceced78a-58d9-4175-b4fe-0d085be62c94 => generated 2389 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:01:49.420832 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-1aa8ad3a-3c1c-4010-9dc2-da236c4add76 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:49.423412 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-1aa8ad3a-3c1c-4010-9dc2-da236c4add76 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] [instance: 43b537b7-2c01-4b03-af22-c87f1c9152d3] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:49.440130 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1aa8ad3a-3c1c-4010-9dc2-da236c4add76 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:49.440846 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1aa8ad3a-3c1c-4010-9dc2-da236c4add76 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:49.444070 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1aa8ad3a-3c1c-4010-9dc2-da236c4add76 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:49.447446 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1aa8ad3a-3c1c-4010-9dc2-da236c4add76 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:49.448108 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1aa8ad3a-3c1c-4010-9dc2-da236c4add76 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:49.448698 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1aa8ad3a-3c1c-4010-9dc2-da236c4add76 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:49.753726 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-1aa8ad3a-3c1c-4010-9dc2-da236c4add76 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612551711ec44a9b856a706a1c4c46e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c917d40fe85495081525a0d2952f888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:01:49.766474 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-1aa8ad3a-3c1c-4010-9dc2-da236c4add76 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] 10.222.0.26 "GET /compute/v2.1/servers/43b537b7-2c01-4b03-af22-c87f1c9152d3" status: 200 len: 1323 microversion: 2.1 time: 0.354510 Oct 08 21:01:49.770457 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1249/2522] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:01:49 2022] GET /compute/v2.1/servers/43b537b7-2c01-4b03-af22-c87f1c9152d3 => generated 1323 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:01:49.783686 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c510ef7a-bbb2-4600-9b7c-fbba12b01842 tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:49.784607 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-c510ef7a-bbb2-4600-9b7c-fbba12b01842 tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] [instance: 9ed82ee0-e56e-478e-a066-bad43e760a03] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:49.795157 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c510ef7a-bbb2-4600-9b7c-fbba12b01842 tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:49.797817 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c510ef7a-bbb2-4600-9b7c-fbba12b01842 tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:49.798458 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c510ef7a-bbb2-4600-9b7c-fbba12b01842 tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:49.799377 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c510ef7a-bbb2-4600-9b7c-fbba12b01842 tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:49.800388 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c510ef7a-bbb2-4600-9b7c-fbba12b01842 tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:49.801703 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c510ef7a-bbb2-4600-9b7c-fbba12b01842 tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:49.859754 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-c510ef7a-bbb2-4600-9b7c-fbba12b01842 tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] [instance: 9ed82ee0-e56e-478e-a066-bad43e760a03] Going to try to terminate instance {{(pid=140491) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 21:01:49.926864 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-6502e153-e49c-484e-9877-995971ba73fe tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Flavor limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 21:01:49.927405 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-6502e153-e49c-484e-9877-995971ba73fe tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Image limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 21:01:49.927826 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-6502e153-e49c-484e-9877-995971ba73fe tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Flavor pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 21:01:49.928260 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-6502e153-e49c-484e-9877-995971ba73fe tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Image pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 21:01:49.928877 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-6502e153-e49c-484e-9877-995971ba73fe tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 21:01:49.954102 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6502e153-e49c-484e-9877-995971ba73fe tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:49.955820 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6502e153-e49c-484e-9877-995971ba73fe tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:49.959458 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6502e153-e49c-484e-9877-995971ba73fe tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:49.960292 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6502e153-e49c-484e-9877-995971ba73fe tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:49.960781 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6502e153-e49c-484e-9877-995971ba73fe tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:49.961242 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6502e153-e49c-484e-9877-995971ba73fe tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:50.008192 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-6502e153-e49c-484e-9877-995971ba73fe tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Getting quotas for project 0ffdae031c4f47d599acb30f1d3c87b9. Resources: {'cores', 'instances', 'ram'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:01:50.041383 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-6502e153-e49c-484e-9877-995971ba73fe tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Getting quotas for user 5266cd6be4514b3eac30a195f6b25772 and project 0ffdae031c4f47d599acb30f1d3c87b9. Resources: {'cores', 'instances', 'ram'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:01:50.079673 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-6502e153-e49c-484e-9877-995971ba73fe tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Going to run 1 instances... {{(pid=140492) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 21:01:50.093599 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-c510ef7a-bbb2-4600-9b7c-fbba12b01842 tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] 10.222.0.26 "DELETE /compute/v2.1/servers/9ed82ee0-e56e-478e-a066-bad43e760a03" status: 204 len: 0 microversion: 2.1 time: 0.321344 Oct 08 21:01:50.094383 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1250/2523] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:01:49 2022] DELETE /compute/v2.1/servers/9ed82ee0-e56e-478e-a066-bad43e760a03 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 21:01:50.106882 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-6502e153-e49c-484e-9877-995971ba73fe tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: d7f3a7bd-a731-45de-a24b-e04e9d81358d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c508bd7f-7db9-4b2c-af7c-be54a855c355',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140492) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 21:01:50.195024 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-6502e153-e49c-484e-9877-995971ba73fe tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.924124 Oct 08 21:01:50.204857 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1274/2524] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 21:01:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1935 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 08 21:01:50.213741 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-5f5a3c40-0f0e-40a4-89cf-15c726dee8b4 req-8c58b980-893d-40b0-9838-06856fcf0878 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ceced78a-58d9-4175-b4fe-0d085be62c94", "name": "network-vif-deleted", "tag": "5dd9a8e9-ad33-45d4-9c64-b8e4e48e3190"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:01:50.230152 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-5f5a3c40-0f0e-40a4-89cf-15c726dee8b4 req-8c58b980-893d-40b0-9838-06856fcf0878 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:50.231460 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-5f5a3c40-0f0e-40a4-89cf-15c726dee8b4 req-8c58b980-893d-40b0-9838-06856fcf0878 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:50.232091 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-5f5a3c40-0f0e-40a4-89cf-15c726dee8b4 req-8c58b980-893d-40b0-9838-06856fcf0878 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:50.249346 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-5f5a3c40-0f0e-40a4-89cf-15c726dee8b4 req-8c58b980-893d-40b0-9838-06856fcf0878 service nova] Creating event network-vif-deleted:5dd9a8e9-ad33-45d4-9c64-b8e4e48e3190 for instance ceced78a-58d9-4175-b4fe-0d085be62c94 on nch2-master-1 Oct 08 21:01:50.256493 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-5f5a3c40-0f0e-40a4-89cf-15c726dee8b4 req-8c58b980-893d-40b0-9838-06856fcf0878 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049358 Oct 08 21:01:50.258920 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1275/2525] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:01:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:01:50.267341 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-055ecb70-9a0c-4dbb-9026-5aa13ba76299 tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:50.268633 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-055ecb70-9a0c-4dbb-9026-5aa13ba76299 tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] [instance: 9ed82ee0-e56e-478e-a066-bad43e760a03] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:50.277401 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-055ecb70-9a0c-4dbb-9026-5aa13ba76299 tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:50.279795 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-055ecb70-9a0c-4dbb-9026-5aa13ba76299 tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:50.284783 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-055ecb70-9a0c-4dbb-9026-5aa13ba76299 tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:50.285929 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-055ecb70-9a0c-4dbb-9026-5aa13ba76299 tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:50.286690 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-055ecb70-9a0c-4dbb-9026-5aa13ba76299 tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:50.287430 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-055ecb70-9a0c-4dbb-9026-5aa13ba76299 tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:50.576284 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-edc005ac-72a9-4c8b-a2da-10574223daf7 tempest-AZV2TestJSON-70521455 tempest-AZV2TestJSON-70521455-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:50.578093 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-edc005ac-72a9-4c8b-a2da-10574223daf7 tempest-AZV2TestJSON-70521455 tempest-AZV2TestJSON-70521455-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:50.579142 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-edc005ac-72a9-4c8b-a2da-10574223daf7 tempest-AZV2TestJSON-70521455 tempest-AZV2TestJSON-70521455-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:50.579614 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-edc005ac-72a9-4c8b-a2da-10574223daf7 tempest-AZV2TestJSON-70521455 tempest-AZV2TestJSON-70521455-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:50.580426 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-edc005ac-72a9-4c8b-a2da-10574223daf7 tempest-AZV2TestJSON-70521455 tempest-AZV2TestJSON-70521455-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:50.580896 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-edc005ac-72a9-4c8b-a2da-10574223daf7 tempest-AZV2TestJSON-70521455 tempest-AZV2TestJSON-70521455-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:50.585946 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-edc005ac-72a9-4c8b-a2da-10574223daf7 tempest-AZV2TestJSON-70521455 tempest-AZV2TestJSON-70521455-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:50.696742 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-edc005ac-72a9-4c8b-a2da-10574223daf7 tempest-AZV2TestJSON-70521455 tempest-AZV2TestJSON-70521455-project] 10.222.0.26 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.594649 Oct 08 21:01:50.706925 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1251/2526] 10.222.0.26 () {58 vars in 1164 bytes} [Sat Oct 8 21:01:50 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 08 21:01:50.712738 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-0cc42240-6404-4810-a68e-af24646a91eb tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:50.713965 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-0cc42240-6404-4810-a68e-af24646a91eb tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: d7f3a7bd-a731-45de-a24b-e04e9d81358d] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:50.962194 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-0cc42240-6404-4810-a68e-af24646a91eb tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:01:50.979467 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-0cc42240-6404-4810-a68e-af24646a91eb tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/d7f3a7bd-a731-45de-a24b-e04e9d81358d" status: 200 len: 1279 microversion: 2.1 time: 0.270970 Oct 08 21:01:50.981874 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1252/2527] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:01:50 2022] GET /compute/v2.1/servers/d7f3a7bd-a731-45de-a24b-e04e9d81358d => generated 1279 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:01:51.001624 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-fe975368-49f2-4eef-beb4-de65cbf35335 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:51.003167 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-fe975368-49f2-4eef-beb4-de65cbf35335 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] [instance: ceced78a-58d9-4175-b4fe-0d085be62c94] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:51.046694 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fe975368-49f2-4eef-beb4-de65cbf35335 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:51.047219 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fe975368-49f2-4eef-beb4-de65cbf35335 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:51.056154 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fe975368-49f2-4eef-beb4-de65cbf35335 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:51.061131 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fe975368-49f2-4eef-beb4-de65cbf35335 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:51.061665 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fe975368-49f2-4eef-beb4-de65cbf35335 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:51.062102 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fe975368-49f2-4eef-beb4-de65cbf35335 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:51.234670 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-055ecb70-9a0c-4dbb-9026-5aa13ba76299 tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c7aebdf00342b1ba80833663f8c0a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad3679a59b504731b5f56e52788fd645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:01:51.245721 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-055ecb70-9a0c-4dbb-9026-5aa13ba76299 tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] 10.222.0.26 "GET /compute/v2.1/servers/9ed82ee0-e56e-478e-a066-bad43e760a03" status: 200 len: 1667 microversion: 2.1 time: 0.984608 Oct 08 21:01:51.259470 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1276/2528] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:01:50 2022] GET /compute/v2.1/servers/9ed82ee0-e56e-478e-a066-bad43e760a03 => generated 1667 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:01:51.307766 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-9f9ef856-e81a-421a-b9f3-d89b3f70b76e tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:51.308496 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-9f9ef856-e81a-421a-b9f3-d89b3f70b76e tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] [instance: 43b537b7-2c01-4b03-af22-c87f1c9152d3] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:51.327981 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9f9ef856-e81a-421a-b9f3-d89b3f70b76e tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:51.329471 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9f9ef856-e81a-421a-b9f3-d89b3f70b76e tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:51.329951 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9f9ef856-e81a-421a-b9f3-d89b3f70b76e tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:51.336298 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9f9ef856-e81a-421a-b9f3-d89b3f70b76e tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:51.337416 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9f9ef856-e81a-421a-b9f3-d89b3f70b76e tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:51.337877 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9f9ef856-e81a-421a-b9f3-d89b3f70b76e tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:51.898997 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-9f9ef856-e81a-421a-b9f3-d89b3f70b76e tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612551711ec44a9b856a706a1c4c46e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c917d40fe85495081525a0d2952f888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:01:51.954129 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-9f9ef856-e81a-421a-b9f3-d89b3f70b76e tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] 10.222.0.26 "GET /compute/v2.1/servers/43b537b7-2c01-4b03-af22-c87f1c9152d3" status: 200 len: 1520 microversion: 2.1 time: 0.693311 Oct 08 21:01:51.954930 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1277/2529] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:01:51 2022] GET /compute/v2.1/servers/43b537b7-2c01-4b03-af22-c87f1c9152d3 => generated 1520 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:01:51.994630 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-ce24d33c-4418-4191-ac26-303dd6354997 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:52.002234 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-ce24d33c-4418-4191-ac26-303dd6354997 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] [instance: 43b537b7-2c01-4b03-af22-c87f1c9152d3] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:52.015358 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ce24d33c-4418-4191-ac26-303dd6354997 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:52.016083 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ce24d33c-4418-4191-ac26-303dd6354997 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:52.016600 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ce24d33c-4418-4191-ac26-303dd6354997 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:52.020177 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ce24d33c-4418-4191-ac26-303dd6354997 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:52.020730 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ce24d33c-4418-4191-ac26-303dd6354997 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:52.021539 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ce24d33c-4418-4191-ac26-303dd6354997 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:52.082591 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-ce24d33c-4418-4191-ac26-303dd6354997 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] HTTP exception thrown: Instance is not a member of specified network Oct 08 21:01:52.092751 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-ce24d33c-4418-4191-ac26-303dd6354997 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Request method failure captured: Oct 08 21:01:52.092751 ncdv-master-1 devstack@n-api.service[140492]: request: GET /compute/v2.1/servers/43b537b7-2c01-4b03-af22-c87f1c9152d3/ips/invalid HTTP/1.1 Oct 08 21:01:52.092751 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:01:52.092751 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:01:52.092751 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:01:52.092751 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 21:01:52.092751 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:01:52.092751 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:01:52.092751 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:01:52.092751 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:01:52.092751 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeUjaJ0AalaLu7xJuZOtBjYVn-d0WZz_7s03rREFySKUdhMDJymjIGG_-7sdLXL5BA6eOVtjnJQOL9mkYwMYPCci_MhYgvJ2DG-ZBtkmCFVKvQCVSg4zOlynrpCstA5Vz5yAFB62wnYTb3D8-bYOLyE9aYmV09KDjvO0ZiPNdmdfd-M Oct 08 21:01:52.092751 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:01:52.092751 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:01:52.092751 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:01:52.092751 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:01:52.092751 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:01:52.092751 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:01:52.092751 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 8c917d40fe85495081525a0d2952f888 Oct 08 21:01:52.092751 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1432451186 Oct 08 21:01:52.092751 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:01:52.092751 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:01:52.092751 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8c917d40fe85495081525a0d2952f888"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8c917d40fe85495081525a0d2952f888"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8c917d40fe85495081525a0d2952f888"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8c917d40fe85495081525a0d2952f888"}]}] Oct 08 21:01:52.092751 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1432451186 Oct 08 21:01:52.092751 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 8c917d40fe85495081525a0d2952f888 Oct 08 21:01:52.092751 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1432451186 Oct 08 21:01:52.092751 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-ServerAddressesNegativeTestJSON-1432451186-project Oct 08 21:01:52.092751 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:01:52.092751 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:01:52.092751 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 612551711ec44a9b856a706a1c4c46e7 Oct 08 21:01:52.092751 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1432451186-project Oct 08 21:01:52.092751 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 21:01:52.092751 ncdv-master-1 devstack@n-api.service[140492]: exception: Instance is not a member of specified network Oct 08 21:01:52.092751 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'server_id': '43b537b7-2c01-4b03-af22-c87f1c9152d3', 'id': 'invalid'} Oct 08 21:01:52.092751 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:01:52.092751 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:01:52.092751 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:01:52.092751 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:01:52.092751 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:01:52.092751 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:01:52.092751 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:01:52.092751 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:01:52.092751 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Oct 08 21:01:52.092751 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 08 21:01:52.092751 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Oct 08 21:01:52.092751 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:01:52.092751 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:01:52.092751 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:01:52.092751 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:01:52.092751 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:01:52.092751 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:01:52.092751 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:01:52.092751 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:01:52.092751 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Oct 08 21:01:52.092751 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:01:52.097834 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-ce24d33c-4418-4191-ac26-303dd6354997 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Returning 404 to user: Instance is not a member of specified network {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:01:52.099048 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-ce24d33c-4418-4191-ac26-303dd6354997 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] 10.222.0.26 "GET /compute/v2.1/servers/43b537b7-2c01-4b03-af22-c87f1c9152d3/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.109035 Oct 08 21:01:52.102094 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1278/2530] 10.222.0.26 () {58 vars in 1272 bytes} [Sat Oct 8 21:01:51 2022] GET /compute/v2.1/servers/43b537b7-2c01-4b03-af22-c87f1c9152d3/ips/invalid => generated 91 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 08 21:01:52.131724 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-780cdaac-0bc1-4751-ba3a-59134c59ec7a tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:52.134795 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-780cdaac-0bc1-4751-ba3a-59134c59ec7a tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: d7f3a7bd-a731-45de-a24b-e04e9d81358d] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:52.155821 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-780cdaac-0bc1-4751-ba3a-59134c59ec7a tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:52.161705 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-780cdaac-0bc1-4751-ba3a-59134c59ec7a tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:52.162411 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-780cdaac-0bc1-4751-ba3a-59134c59ec7a tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:52.170134 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-780cdaac-0bc1-4751-ba3a-59134c59ec7a tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:52.170984 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-780cdaac-0bc1-4751-ba3a-59134c59ec7a tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:52.171818 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-780cdaac-0bc1-4751-ba3a-59134c59ec7a tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:52.331478 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-fe975368-49f2-4eef-beb4-de65cbf35335 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:01:52.346170 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-fe975368-49f2-4eef-beb4-de65cbf35335 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:01:52.353150 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-fe975368-49f2-4eef-beb4-de65cbf35335 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:01:52.357350 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-fe975368-49f2-4eef-beb4-de65cbf35335 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] 10.222.0.26 "GET /compute/v2.1/servers/ceced78a-58d9-4175-b4fe-0d085be62c94" status: 200 len: 2031 microversion: 2.42 time: 1.372237 Oct 08 21:01:52.368984 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1253/2531] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:01:50 2022] GET /compute/v2.1/servers/ceced78a-58d9-4175-b4fe-0d085be62c94 => generated 2031 bytes in 1385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:01:52.397712 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-39e4ec01-001b-4a8c-a163-6c86f828cf11 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:52.397712 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-39e4ec01-001b-4a8c-a163-6c86f828cf11 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Failed to fetch instance by id 999 {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 08 21:01:52.401800 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-39e4ec01-001b-4a8c-a163-6c86f828cf11 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] HTTP exception thrown: Instance 999 could not be found. Oct 08 21:01:52.404216 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-39e4ec01-001b-4a8c-a163-6c86f828cf11 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Request method failure captured: Oct 08 21:01:52.404216 ncdv-master-1 devstack@n-api.service[140491]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Oct 08 21:01:52.404216 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:01:52.404216 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:01:52.404216 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:01:52.404216 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 21:01:52.404216 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:01:52.404216 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:01:52.404216 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:01:52.404216 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:01:52.404216 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeUjaJ0AalaLu7xJuZOtBjYVn-d0WZz_7s03rREFySKUdhMDJymjIGG_-7sdLXL5BA6eOVtjnJQOL9mkYwMYPCci_MhYgvJ2DG-ZBtkmCFVKvQCVSg4zOlynrpCstA5Vz5yAFB62wnYTb3D8-bYOLyE9aYmV09KDjvO0ZiPNdmdfd-M Oct 08 21:01:52.404216 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:01:52.404216 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:01:52.404216 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:01:52.404216 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:01:52.404216 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:01:52.404216 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:01:52.404216 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 8c917d40fe85495081525a0d2952f888 Oct 08 21:01:52.404216 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1432451186 Oct 08 21:01:52.404216 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:01:52.404216 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:01:52.404216 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8c917d40fe85495081525a0d2952f888"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8c917d40fe85495081525a0d2952f888"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8c917d40fe85495081525a0d2952f888"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8c917d40fe85495081525a0d2952f888"}]}] Oct 08 21:01:52.404216 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1432451186 Oct 08 21:01:52.404216 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 8c917d40fe85495081525a0d2952f888 Oct 08 21:01:52.404216 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1432451186 Oct 08 21:01:52.404216 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-ServerAddressesNegativeTestJSON-1432451186-project Oct 08 21:01:52.404216 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:01:52.404216 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:01:52.404216 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 612551711ec44a9b856a706a1c4c46e7 Oct 08 21:01:52.404216 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1432451186-project Oct 08 21:01:52.404216 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:01:52.404216 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance 999 could not be found. Oct 08 21:01:52.404216 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'server_id': '999'} Oct 08 21:01:52.404216 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:01:52.404216 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:01:52.404216 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:01:52.404216 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:01:52.404216 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 08 21:01:52.404216 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 08 21:01:52.404216 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Oct 08 21:01:52.404216 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:01:52.404216 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:01:52.404216 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:01:52.404216 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:01:52.404216 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:01:52.404216 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:01:52.404216 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:01:52.404216 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:01:52.404216 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:01:52.404216 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:01:52.404216 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Oct 08 21:01:52.404216 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Oct 08 21:01:52.404216 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:01:52.404216 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:01:52.404216 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Oct 08 21:01:52.404216 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:01:52.404216 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:01:52.404216 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:01:52.404216 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:01:52.404216 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:01:52.404216 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:01:52.404216 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:01:52.404216 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:01:52.404216 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Oct 08 21:01:52.404216 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:01:52.410264 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-39e4ec01-001b-4a8c-a163-6c86f828cf11 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Returning 404 to user: Instance 999 could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:01:52.417615 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-39e4ec01-001b-4a8c-a163-6c86f828cf11 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] 10.222.0.26 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.041088 Oct 08 21:01:52.418242 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1254/2532] 10.222.0.26 () {58 vars in 1149 bytes} [Sat Oct 8 21:01:52 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 08 21:01:52.425522 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-3d165480-ccd2-4040-b3ff-8ead9a149f6c tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:52.426364 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-3d165480-ccd2-4040-b3ff-8ead9a149f6c tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] [instance: 9ed82ee0-e56e-478e-a066-bad43e760a03] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:52.439651 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3d165480-ccd2-4040-b3ff-8ead9a149f6c tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:52.440561 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3d165480-ccd2-4040-b3ff-8ead9a149f6c tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:52.441161 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3d165480-ccd2-4040-b3ff-8ead9a149f6c tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:52.442064 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3d165480-ccd2-4040-b3ff-8ead9a149f6c tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:52.442673 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3d165480-ccd2-4040-b3ff-8ead9a149f6c tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:52.443252 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3d165480-ccd2-4040-b3ff-8ead9a149f6c tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:52.458286 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-780cdaac-0bc1-4751-ba3a-59134c59ec7a tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:01:52.487995 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-780cdaac-0bc1-4751-ba3a-59134c59ec7a tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/d7f3a7bd-a731-45de-a24b-e04e9d81358d" status: 200 len: 1331 microversion: 2.1 time: 0.381286 Oct 08 21:01:52.500850 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1279/2533] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:01:52 2022] GET /compute/v2.1/servers/d7f3a7bd-a731-45de-a24b-e04e9d81358d => generated 1331 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:01:52.518290 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-65c6be9a-9367-42d3-af73-17c75944d84d req-553a3a17-ed49-4fb6-94d0-c3e200c07aa7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ceced78a-58d9-4175-b4fe-0d085be62c94", "name": "network-vif-deleted", "tag": "b0a57839-341e-4831-b37b-2d1a263887b4"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:01:52.534319 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-65c6be9a-9367-42d3-af73-17c75944d84d req-553a3a17-ed49-4fb6-94d0-c3e200c07aa7 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:52.535227 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-65c6be9a-9367-42d3-af73-17c75944d84d req-553a3a17-ed49-4fb6-94d0-c3e200c07aa7 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:52.535896 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-65c6be9a-9367-42d3-af73-17c75944d84d req-553a3a17-ed49-4fb6-94d0-c3e200c07aa7 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:52.549218 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-65c6be9a-9367-42d3-af73-17c75944d84d req-553a3a17-ed49-4fb6-94d0-c3e200c07aa7 service nova] Creating event network-vif-deleted:b0a57839-341e-4831-b37b-2d1a263887b4 for instance ceced78a-58d9-4175-b4fe-0d085be62c94 on nch2-master-1 Oct 08 21:01:52.555571 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-65c6be9a-9367-42d3-af73-17c75944d84d req-553a3a17-ed49-4fb6-94d0-c3e200c07aa7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052795 Oct 08 21:01:52.556825 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1280/2534] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:01:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:01:52.577698 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-5fd03d18-a71b-49b9-ba28-af1fb410a003 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:52.592692 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-5fd03d18-a71b-49b9-ba28-af1fb410a003 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] [instance: 43b537b7-2c01-4b03-af22-c87f1c9152d3] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:52.610651 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5fd03d18-a71b-49b9-ba28-af1fb410a003 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:52.611233 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5fd03d18-a71b-49b9-ba28-af1fb410a003 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:52.611691 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5fd03d18-a71b-49b9-ba28-af1fb410a003 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:52.612429 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5fd03d18-a71b-49b9-ba28-af1fb410a003 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:52.612902 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5fd03d18-a71b-49b9-ba28-af1fb410a003 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:52.613376 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5fd03d18-a71b-49b9-ba28-af1fb410a003 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:52.663762 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-5fd03d18-a71b-49b9-ba28-af1fb410a003 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] [instance: 43b537b7-2c01-4b03-af22-c87f1c9152d3] Going to try to terminate instance {{(pid=140492) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 21:01:52.707029 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=100 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:01:52.860610 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:01:52.887611 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-5fd03d18-a71b-49b9-ba28-af1fb410a003 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] 10.222.0.26 "DELETE /compute/v2.1/servers/43b537b7-2c01-4b03-af22-c87f1c9152d3" status: 204 len: 0 microversion: 2.1 time: 0.328362 Oct 08 21:01:52.901867 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1281/2535] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:01:52 2022] DELETE /compute/v2.1/servers/43b537b7-2c01-4b03-af22-c87f1c9152d3 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 21:01:52.913319 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-8e2a49ed-63da-41d5-8af2-ae8b61ae63b3 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:52.933255 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-8e2a49ed-63da-41d5-8af2-ae8b61ae63b3 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] [instance: 43b537b7-2c01-4b03-af22-c87f1c9152d3] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:52.934546 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-3d165480-ccd2-4040-b3ff-8ead9a149f6c tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c7aebdf00342b1ba80833663f8c0a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad3679a59b504731b5f56e52788fd645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:01:52.947039 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8e2a49ed-63da-41d5-8af2-ae8b61ae63b3 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:52.948563 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8e2a49ed-63da-41d5-8af2-ae8b61ae63b3 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:52.949232 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8e2a49ed-63da-41d5-8af2-ae8b61ae63b3 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:52.951174 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8e2a49ed-63da-41d5-8af2-ae8b61ae63b3 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:52.952738 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8e2a49ed-63da-41d5-8af2-ae8b61ae63b3 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:52.953484 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8e2a49ed-63da-41d5-8af2-ae8b61ae63b3 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:52.990366 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-3d165480-ccd2-4040-b3ff-8ead9a149f6c tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] 10.222.0.26 "GET /compute/v2.1/servers/9ed82ee0-e56e-478e-a066-bad43e760a03" status: 200 len: 1667 microversion: 2.1 time: 0.569104 Oct 08 21:01:52.998788 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1255/2536] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:01:52 2022] GET /compute/v2.1/servers/9ed82ee0-e56e-478e-a066-bad43e760a03 => generated 1667 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:01:53.220511 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-8e2a49ed-63da-41d5-8af2-ae8b61ae63b3 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612551711ec44a9b856a706a1c4c46e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c917d40fe85495081525a0d2952f888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:01:53.233086 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-8e2a49ed-63da-41d5-8af2-ae8b61ae63b3 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] 10.222.0.26 "GET /compute/v2.1/servers/43b537b7-2c01-4b03-af22-c87f1c9152d3" status: 200 len: 1526 microversion: 2.1 time: 0.329335 Oct 08 21:01:53.241293 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1282/2537] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:01:52 2022] GET /compute/v2.1/servers/43b537b7-2c01-4b03-af22-c87f1c9152d3 => generated 1526 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:01:53.402511 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-8968a8f3-b849-41a1-ae5a-aec416af59e4 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:53.403287 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-8968a8f3-b849-41a1-ae5a-aec416af59e4 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] [instance: ceced78a-58d9-4175-b4fe-0d085be62c94] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:53.416956 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8968a8f3-b849-41a1-ae5a-aec416af59e4 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:53.417757 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8968a8f3-b849-41a1-ae5a-aec416af59e4 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:53.418365 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8968a8f3-b849-41a1-ae5a-aec416af59e4 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:53.419883 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8968a8f3-b849-41a1-ae5a-aec416af59e4 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:53.421701 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8968a8f3-b849-41a1-ae5a-aec416af59e4 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:53.423953 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8968a8f3-b849-41a1-ae5a-aec416af59e4 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:53.535834 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-90d97dba-d645-470d-9581-222135caa7c8 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:53.536469 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-90d97dba-d645-470d-9581-222135caa7c8 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: d7f3a7bd-a731-45de-a24b-e04e9d81358d] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:53.551478 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-90d97dba-d645-470d-9581-222135caa7c8 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:53.551986 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-90d97dba-d645-470d-9581-222135caa7c8 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:53.552841 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-90d97dba-d645-470d-9581-222135caa7c8 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:53.553230 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-90d97dba-d645-470d-9581-222135caa7c8 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:53.553633 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-90d97dba-d645-470d-9581-222135caa7c8 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:53.563837 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-90d97dba-d645-470d-9581-222135caa7c8 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:53.600898 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8968a8f3-b849-41a1-ae5a-aec416af59e4 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:53.606714 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8968a8f3-b849-41a1-ae5a-aec416af59e4 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:53.607358 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8968a8f3-b849-41a1-ae5a-aec416af59e4 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:53.612201 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.objects.instance [None req-8968a8f3-b849-41a1-ae5a-aec416af59e4 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lazy-loading 'fault' on Instance uuid ceced78a-58d9-4175-b4fe-0d085be62c94 {{(pid=140491) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 21:01:53.786701 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-90d97dba-d645-470d-9581-222135caa7c8 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:01:53.806701 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-90d97dba-d645-470d-9581-222135caa7c8 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/d7f3a7bd-a731-45de-a24b-e04e9d81358d" status: 200 len: 1349 microversion: 2.1 time: 0.276211 Oct 08 21:01:53.807841 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1283/2538] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:01:53 2022] GET /compute/v2.1/servers/d7f3a7bd-a731-45de-a24b-e04e9d81358d => generated 1349 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:01:54.003040 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-8968a8f3-b849-41a1-ae5a-aec416af59e4 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:01:54.025012 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-fae7d80d-43c0-44ba-a053-824a8bd6fc6c tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:54.025712 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-fae7d80d-43c0-44ba-a053-824a8bd6fc6c tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] [instance: 9ed82ee0-e56e-478e-a066-bad43e760a03] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:54.032721 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-8968a8f3-b849-41a1-ae5a-aec416af59e4 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:01:54.040672 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-8968a8f3-b849-41a1-ae5a-aec416af59e4 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec51fae793a147d88e5d956352f18b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:01:54.046181 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-8968a8f3-b849-41a1-ae5a-aec416af59e4 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] 10.222.0.26 "GET /compute/v2.1/servers/ceced78a-58d9-4175-b4fe-0d085be62c94" status: 200 len: 1609 microversion: 2.42 time: 0.650357 Oct 08 21:01:54.049766 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1256/2539] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:01:53 2022] GET /compute/v2.1/servers/ceced78a-58d9-4175-b4fe-0d085be62c94 => generated 1609 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:01:54.073526 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fae7d80d-43c0-44ba-a053-824a8bd6fc6c tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:54.073526 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fae7d80d-43c0-44ba-a053-824a8bd6fc6c tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:54.073526 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fae7d80d-43c0-44ba-a053-824a8bd6fc6c tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:54.076724 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fae7d80d-43c0-44ba-a053-824a8bd6fc6c tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:54.077285 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fae7d80d-43c0-44ba-a053-824a8bd6fc6c tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:54.080048 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fae7d80d-43c0-44ba-a053-824a8bd6fc6c tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:54.248290 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-fae7d80d-43c0-44ba-a053-824a8bd6fc6c tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c7aebdf00342b1ba80833663f8c0a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad3679a59b504731b5f56e52788fd645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:01:54.276590 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-bd0a46ee-720b-410c-9450-11e108114606 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:54.277231 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-bd0a46ee-720b-410c-9450-11e108114606 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] [instance: 43b537b7-2c01-4b03-af22-c87f1c9152d3] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:54.278683 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-fae7d80d-43c0-44ba-a053-824a8bd6fc6c tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] 10.222.0.26 "GET /compute/v2.1/servers/9ed82ee0-e56e-478e-a066-bad43e760a03" status: 200 len: 1600 microversion: 2.1 time: 0.258380 Oct 08 21:01:54.279490 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1284/2540] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:01:54 2022] GET /compute/v2.1/servers/9ed82ee0-e56e-478e-a066-bad43e760a03 => generated 1600 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:01:54.324050 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bd0a46ee-720b-410c-9450-11e108114606 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:54.327677 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bd0a46ee-720b-410c-9450-11e108114606 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:54.328146 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bd0a46ee-720b-410c-9450-11e108114606 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:54.331241 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bd0a46ee-720b-410c-9450-11e108114606 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:54.331835 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bd0a46ee-720b-410c-9450-11e108114606 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:54.333566 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bd0a46ee-720b-410c-9450-11e108114606 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:54.850678 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-73cbe0f1-8163-43da-ba8b-532e56ade97c tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:54.851307 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-73cbe0f1-8163-43da-ba8b-532e56ade97c tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: d7f3a7bd-a731-45de-a24b-e04e9d81358d] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:54.863956 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-73cbe0f1-8163-43da-ba8b-532e56ade97c tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:54.864600 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-73cbe0f1-8163-43da-ba8b-532e56ade97c tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:54.888130 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-73cbe0f1-8163-43da-ba8b-532e56ade97c tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:54.896190 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-73cbe0f1-8163-43da-ba8b-532e56ade97c tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:54.900544 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-73cbe0f1-8163-43da-ba8b-532e56ade97c tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:54.901348 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-73cbe0f1-8163-43da-ba8b-532e56ade97c tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:54.961350 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-bd0a46ee-720b-410c-9450-11e108114606 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612551711ec44a9b856a706a1c4c46e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c917d40fe85495081525a0d2952f888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:01:55.005133 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-bd0a46ee-720b-410c-9450-11e108114606 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] 10.222.0.26 "GET /compute/v2.1/servers/43b537b7-2c01-4b03-af22-c87f1c9152d3" status: 200 len: 1526 microversion: 2.1 time: 0.737499 Oct 08 21:01:55.007871 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1257/2541] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:01:54 2022] GET /compute/v2.1/servers/43b537b7-2c01-4b03-af22-c87f1c9152d3 => generated 1526 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:01:55.026710 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-c40eb2e9-3b1f-4664-80f7-9fcf1f7aff6f req-7bc02204-8a8c-4988-bd05-21a4eec95ecf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ed82ee0-e56e-478e-a066-bad43e760a03", "name": "network-vif-deleted", "tag": "2d6b498c-db99-42bb-a03a-e6ad5fc72076"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:01:55.054843 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-c40eb2e9-3b1f-4664-80f7-9fcf1f7aff6f req-7bc02204-8a8c-4988-bd05-21a4eec95ecf service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:55.056201 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-c40eb2e9-3b1f-4664-80f7-9fcf1f7aff6f req-7bc02204-8a8c-4988-bd05-21a4eec95ecf service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:55.057026 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-c40eb2e9-3b1f-4664-80f7-9fcf1f7aff6f req-7bc02204-8a8c-4988-bd05-21a4eec95ecf service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:55.079703 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-c40eb2e9-3b1f-4664-80f7-9fcf1f7aff6f req-7bc02204-8a8c-4988-bd05-21a4eec95ecf service nova] Creating event network-vif-deleted:2d6b498c-db99-42bb-a03a-e6ad5fc72076 for instance 9ed82ee0-e56e-478e-a066-bad43e760a03 on nch1-master-1 Oct 08 21:01:55.090080 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-c40eb2e9-3b1f-4664-80f7-9fcf1f7aff6f req-7bc02204-8a8c-4988-bd05-21a4eec95ecf service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078170 Oct 08 21:01:55.091003 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1258/2542] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:01:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:01:55.100824 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-a127fd7c-4fa5-4a1d-9e43-14fa076fad59 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:55.101778 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-a127fd7c-4fa5-4a1d-9e43-14fa076fad59 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] [instance: ceced78a-58d9-4175-b4fe-0d085be62c94] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:55.110104 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:01:55.112447 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a127fd7c-4fa5-4a1d-9e43-14fa076fad59 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:55.113022 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a127fd7c-4fa5-4a1d-9e43-14fa076fad59 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:55.113695 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a127fd7c-4fa5-4a1d-9e43-14fa076fad59 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:55.115403 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a127fd7c-4fa5-4a1d-9e43-14fa076fad59 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:55.116039 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a127fd7c-4fa5-4a1d-9e43-14fa076fad59 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:55.116759 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a127fd7c-4fa5-4a1d-9e43-14fa076fad59 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:55.146976 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-a127fd7c-4fa5-4a1d-9e43-14fa076fad59 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] HTTP exception thrown: Instance ceced78a-58d9-4175-b4fe-0d085be62c94 could not be found. Oct 08 21:01:55.149216 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-a127fd7c-4fa5-4a1d-9e43-14fa076fad59 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Request method failure captured: Oct 08 21:01:55.149216 ncdv-master-1 devstack@n-api.service[140491]: request: GET /compute/v2.1/servers/ceced78a-58d9-4175-b4fe-0d085be62c94 HTTP/1.1 Oct 08 21:01:55.149216 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:01:55.149216 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:01:55.149216 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:01:55.149216 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 21:01:55.149216 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:01:55.149216 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:01:55.149216 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:01:55.149216 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:01:55.149216 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeOg5hfVEcicdIe7aaXklpUOMq2mfErMqnJe3L7AI8d4ToM7BwYeipy4-blhKiHTZtcrReXj2hr5TdHoeL5QdryvPoS3-j0NMgHPon-rvUEezyrq8jPXDx1hKhK6BThR2wnBpfSRRprQ5SYoFEo0_71jZMlABPl7RMKBihwD_IdK1s8 Oct 08 21:01:55.149216 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:01:55.149216 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:01:55.149216 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:01:55.149216 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:01:55.149216 ncdv-master-1 devstack@n-api.service[140491]: X-Openstack-Nova-Api-Version: 2.42 Oct 08 21:01:55.149216 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:01:55.149216 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:01:55.149216 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: ec51fae793a147d88e5d956352f18b92 Oct 08 21:01:55.149216 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1262294407 Oct 08 21:01:55.149216 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:01:55.149216 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:01:55.149216 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ec51fae793a147d88e5d956352f18b92"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ec51fae793a147d88e5d956352f18b92"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ec51fae793a147d88e5d956352f18b92"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ec51fae793a147d88e5d956352f18b92"}]}] Oct 08 21:01:55.149216 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1262294407 Oct 08 21:01:55.149216 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: ec51fae793a147d88e5d956352f18b92 Oct 08 21:01:55.149216 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1262294407 Oct 08 21:01:55.149216 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-TaggedBootDevicesTest_v242-1262294407-project Oct 08 21:01:55.149216 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:01:55.149216 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:01:55.149216 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: bc0c5c9593754f1cb98f9689b29606a2 Oct 08 21:01:55.149216 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1262294407-project Oct 08 21:01:55.149216 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:01:55.149216 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance ceced78a-58d9-4175-b4fe-0d085be62c94 could not be found. Oct 08 21:01:55.149216 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': 'ceced78a-58d9-4175-b4fe-0d085be62c94'} Oct 08 21:01:55.149216 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:01:55.149216 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:01:55.149216 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:01:55.149216 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:01:55.149216 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:01:55.149216 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:01:55.149216 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:01:55.149216 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:01:55.149216 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:01:55.149216 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:01:55.149216 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ceced78a-58d9-4175-b4fe-0d085be62c94 could not be found. Oct 08 21:01:55.149216 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:01:55.149216 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:01:55.149216 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:01:55.149216 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:01:55.149216 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:01:55.149216 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:01:55.149216 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:01:55.149216 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:01:55.149216 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:01:55.149216 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:01:55.149216 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:01:55.149216 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:01:55.149216 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:01:55.149216 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:01:55.149216 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:01:55.149216 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:01:55.149216 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ceced78a-58d9-4175-b4fe-0d085be62c94 could not be found. Oct 08 21:01:55.149216 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:01:55.149216 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:01:55.153883 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:01:55.153883 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:01:55.153883 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:01:55.153883 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:01:55.153883 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:01:55.153883 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:01:55.153883 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ceced78a-58d9-4175-b4fe-0d085be62c94 could not be found. Oct 08 21:01:55.153883 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:01:55.153883 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-a127fd7c-4fa5-4a1d-9e43-14fa076fad59 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Returning 404 to user: Instance ceced78a-58d9-4175-b4fe-0d085be62c94 could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:01:55.153883 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-a127fd7c-4fa5-4a1d-9e43-14fa076fad59 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] 10.222.0.26 "GET /compute/v2.1/servers/ceced78a-58d9-4175-b4fe-0d085be62c94" status: 404 len: 111 microversion: 2.42 time: 0.059356 Oct 08 21:01:55.158262 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1259/2543] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:01:55 2022] GET /compute/v2.1/servers/ceced78a-58d9-4175-b4fe-0d085be62c94 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 08 21:01:55.166034 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-e619cf5e-2f47-4602-80fa-808fa078817d tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Calling method '.version_select at 0x7f1a8c85d940>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:55.222511 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-e619cf5e-2f47-4602-80fa-808fa078817d tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-528451165" status: 204 len: 0 microversion: 2.42 time: 0.062616 Oct 08 21:01:55.223593 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1260/2544] 10.222.0.26 () {60 vars in 1259 bytes} [Sat Oct 8 21:01:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-528451165 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 08 21:01:55.224348 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-73cbe0f1-8163-43da-ba8b-532e56ade97c tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:01:55.233401 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-73cbe0f1-8163-43da-ba8b-532e56ade97c tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/d7f3a7bd-a731-45de-a24b-e04e9d81358d" status: 200 len: 1337 microversion: 2.1 time: 0.390896 Oct 08 21:01:55.234624 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1285/2545] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:01:54 2022] GET /compute/v2.1/servers/d7f3a7bd-a731-45de-a24b-e04e9d81358d => generated 1337 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:01:55.312393 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-0fd1777c-9f22-4d26-8bd1-1fac2d5d2797 tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:55.313031 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-0fd1777c-9f22-4d26-8bd1-1fac2d5d2797 tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] [instance: 9ed82ee0-e56e-478e-a066-bad43e760a03] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:55.327188 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0fd1777c-9f22-4d26-8bd1-1fac2d5d2797 tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:55.327727 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0fd1777c-9f22-4d26-8bd1-1fac2d5d2797 tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:55.328323 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0fd1777c-9f22-4d26-8bd1-1fac2d5d2797 tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:55.328940 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0fd1777c-9f22-4d26-8bd1-1fac2d5d2797 tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:55.329478 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0fd1777c-9f22-4d26-8bd1-1fac2d5d2797 tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:55.329923 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0fd1777c-9f22-4d26-8bd1-1fac2d5d2797 tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:55.396800 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0fd1777c-9f22-4d26-8bd1-1fac2d5d2797 tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:55.397320 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0fd1777c-9f22-4d26-8bd1-1fac2d5d2797 tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:55.398075 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0fd1777c-9f22-4d26-8bd1-1fac2d5d2797 tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:55.398214 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.objects.instance [None req-0fd1777c-9f22-4d26-8bd1-1fac2d5d2797 tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Lazy-loading 'fault' on Instance uuid 9ed82ee0-e56e-478e-a066-bad43e760a03 {{(pid=140491) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 21:01:55.498093 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-0fd1777c-9f22-4d26-8bd1-1fac2d5d2797 tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c7aebdf00342b1ba80833663f8c0a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad3679a59b504731b5f56e52788fd645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:01:55.530691 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-0fd1777c-9f22-4d26-8bd1-1fac2d5d2797 tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] 10.222.0.26 "GET /compute/v2.1/servers/9ed82ee0-e56e-478e-a066-bad43e760a03" status: 200 len: 1316 microversion: 2.1 time: 0.222242 Oct 08 21:01:55.550871 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1261/2546] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:01:55 2022] GET /compute/v2.1/servers/9ed82ee0-e56e-478e-a066-bad43e760a03 => generated 1316 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:01:56.036615 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-9ad94c89-fd12-41c2-b248-4f09571b7ae4 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:56.037492 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-9ad94c89-fd12-41c2-b248-4f09571b7ae4 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] [instance: 43b537b7-2c01-4b03-af22-c87f1c9152d3] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:56.072744 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9ad94c89-fd12-41c2-b248-4f09571b7ae4 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:56.081273 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9ad94c89-fd12-41c2-b248-4f09571b7ae4 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:56.088172 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9ad94c89-fd12-41c2-b248-4f09571b7ae4 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:56.096269 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9ad94c89-fd12-41c2-b248-4f09571b7ae4 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:56.096773 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9ad94c89-fd12-41c2-b248-4f09571b7ae4 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:56.104672 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9ad94c89-fd12-41c2-b248-4f09571b7ae4 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:56.260617 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-52e38a3f-2402-48ef-8421-518bb2f7bccf tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:56.262521 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-52e38a3f-2402-48ef-8421-518bb2f7bccf tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: d7f3a7bd-a731-45de-a24b-e04e9d81358d] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:56.283493 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-52e38a3f-2402-48ef-8421-518bb2f7bccf tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:56.285907 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-52e38a3f-2402-48ef-8421-518bb2f7bccf tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:56.287580 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-52e38a3f-2402-48ef-8421-518bb2f7bccf tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:56.288444 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-52e38a3f-2402-48ef-8421-518bb2f7bccf tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:56.290468 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-52e38a3f-2402-48ef-8421-518bb2f7bccf tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:56.290998 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-52e38a3f-2402-48ef-8421-518bb2f7bccf tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:56.474247 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-52e38a3f-2402-48ef-8421-518bb2f7bccf tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:01:56.488165 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-52e38a3f-2402-48ef-8421-518bb2f7bccf tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/d7f3a7bd-a731-45de-a24b-e04e9d81358d" status: 200 len: 1337 microversion: 2.1 time: 0.232974 Oct 08 21:01:56.505704 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1262/2547] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:01:56 2022] GET /compute/v2.1/servers/d7f3a7bd-a731-45de-a24b-e04e9d81358d => generated 1337 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:01:56.557007 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-ae968f46-d38c-4d3c-bdda-ff0cd60a1aed tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:56.558056 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-ae968f46-d38c-4d3c-bdda-ff0cd60a1aed tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] [instance: 9ed82ee0-e56e-478e-a066-bad43e760a03] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:56.571875 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ae968f46-d38c-4d3c-bdda-ff0cd60a1aed tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:56.572789 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ae968f46-d38c-4d3c-bdda-ff0cd60a1aed tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:56.573668 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ae968f46-d38c-4d3c-bdda-ff0cd60a1aed tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:56.574762 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ae968f46-d38c-4d3c-bdda-ff0cd60a1aed tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:56.575490 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ae968f46-d38c-4d3c-bdda-ff0cd60a1aed tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:56.579773 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ae968f46-d38c-4d3c-bdda-ff0cd60a1aed tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:56.608055 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-ae968f46-d38c-4d3c-bdda-ff0cd60a1aed tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] HTTP exception thrown: Instance 9ed82ee0-e56e-478e-a066-bad43e760a03 could not be found. Oct 08 21:01:56.610044 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-ae968f46-d38c-4d3c-bdda-ff0cd60a1aed tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Request method failure captured: Oct 08 21:01:56.610044 ncdv-master-1 devstack@n-api.service[140491]: request: GET /compute/v2.1/servers/9ed82ee0-e56e-478e-a066-bad43e760a03 HTTP/1.1 Oct 08 21:01:56.610044 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:01:56.610044 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:01:56.610044 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:01:56.610044 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 21:01:56.610044 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:01:56.610044 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:01:56.610044 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:01:56.610044 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:01:56.610044 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeUA_9evpqjNh6hI8eJWWJbOTnk6OlIhRjkUr_1x0nVcuTbDlki9tIDmQSmTg-jww7y8RxyhFC49Em-iIMfjmkmj_N2KoIv35aSh8p16V6v6Fkeq-VFpElyPlF2-JcQUW1r6PckZfqcJsDMoJEl6_gLr6dTusHJvmcmnYhuVquWLe0E Oct 08 21:01:56.610044 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:01:56.610044 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:01:56.610044 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:01:56.610044 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:01:56.610044 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:01:56.610044 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:01:56.610044 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: ad3679a59b504731b5f56e52788fd645 Oct 08 21:01:56.610044 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-ServersTestFqdnHostnames-1814589782 Oct 08 21:01:56.610044 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:01:56.610044 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:01:56.610044 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ad3679a59b504731b5f56e52788fd645"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ad3679a59b504731b5f56e52788fd645"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ad3679a59b504731b5f56e52788fd645"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ad3679a59b504731b5f56e52788fd645"}]}] Oct 08 21:01:56.610044 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-ServersTestFqdnHostnames-1814589782 Oct 08 21:01:56.610044 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: ad3679a59b504731b5f56e52788fd645 Oct 08 21:01:56.610044 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-1814589782 Oct 08 21:01:56.610044 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-ServersTestFqdnHostnames-1814589782-project Oct 08 21:01:56.610044 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:01:56.610044 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:01:56.610044 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 56c7aebdf00342b1ba80833663f8c0a9 Oct 08 21:01:56.610044 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-ServersTestFqdnHostnames-1814589782-project Oct 08 21:01:56.610044 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:01:56.610044 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance 9ed82ee0-e56e-478e-a066-bad43e760a03 could not be found. Oct 08 21:01:56.610044 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': '9ed82ee0-e56e-478e-a066-bad43e760a03'} Oct 08 21:01:56.610044 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:01:56.610044 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:01:56.610044 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:01:56.610044 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:01:56.610044 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:01:56.610044 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:01:56.610044 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:01:56.610044 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:01:56.610044 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:01:56.610044 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:01:56.610044 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ed82ee0-e56e-478e-a066-bad43e760a03 could not be found. Oct 08 21:01:56.610044 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:01:56.610044 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:01:56.610044 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:01:56.610044 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:01:56.610044 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:01:56.610044 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:01:56.610044 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:01:56.610044 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:01:56.610044 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:01:56.610044 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:01:56.610044 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:01:56.610044 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:01:56.610044 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:01:56.610044 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:01:56.610044 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:01:56.610044 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:01:56.610044 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ed82ee0-e56e-478e-a066-bad43e760a03 could not be found. Oct 08 21:01:56.610044 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:01:56.610044 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:01:56.610044 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:01:56.613676 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:01:56.613676 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:01:56.613676 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:01:56.613676 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:01:56.613676 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:01:56.613676 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ed82ee0-e56e-478e-a066-bad43e760a03 could not be found. Oct 08 21:01:56.613676 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:01:56.620111 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-ae968f46-d38c-4d3c-bdda-ff0cd60a1aed tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Returning 404 to user: Instance 9ed82ee0-e56e-478e-a066-bad43e760a03 could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:01:56.621510 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-ae968f46-d38c-4d3c-bdda-ff0cd60a1aed tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] 10.222.0.26 "GET /compute/v2.1/servers/9ed82ee0-e56e-478e-a066-bad43e760a03" status: 404 len: 111 microversion: 2.1 time: 0.069016 Oct 08 21:01:56.630012 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1263/2548] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:01:56 2022] GET /compute/v2.1/servers/9ed82ee0-e56e-478e-a066-bad43e760a03 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 08 21:01:56.639072 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-db8ca995-afa4-4917-85b1-ed1904aa3e0c tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] Calling method '.version_select at 0x7f1a8c113dc0>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:56.679592 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-db8ca995-afa4-4917-85b1-ed1904aa3e0c tempest-ServersTestFqdnHostnames-1814589782 tempest-ServersTestFqdnHostnames-1814589782-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1813051332" status: 202 len: 0 microversion: 2.1 time: 0.044322 Oct 08 21:01:56.681142 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1264/2549] 10.222.0.26 () {58 vars in 1221 bytes} [Sat Oct 8 21:01:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1813051332 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 08 21:01:56.842222 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-40c5ef2d-5ad0-4186-a6e7-01d108be2c78 req-44847ed7-2233-42b5-b56b-5891f5c6487d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43b537b7-2c01-4b03-af22-c87f1c9152d3", "name": "network-vif-unplugged", "status": "completed", "tag": "11347a56-be77-4cfa-a05b-dfedc81d337a"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:01:56.880726 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-40c5ef2d-5ad0-4186-a6e7-01d108be2c78 req-44847ed7-2233-42b5-b56b-5891f5c6487d service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:56.881962 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-40c5ef2d-5ad0-4186-a6e7-01d108be2c78 req-44847ed7-2233-42b5-b56b-5891f5c6487d service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:56.882653 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-40c5ef2d-5ad0-4186-a6e7-01d108be2c78 req-44847ed7-2233-42b5-b56b-5891f5c6487d service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:56.907950 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-40c5ef2d-5ad0-4186-a6e7-01d108be2c78 req-44847ed7-2233-42b5-b56b-5891f5c6487d service nova] Creating event network-vif-unplugged:11347a56-be77-4cfa-a05b-dfedc81d337a for instance 43b537b7-2c01-4b03-af22-c87f1c9152d3 on nch2-master-1 Oct 08 21:01:56.918337 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-40c5ef2d-5ad0-4186-a6e7-01d108be2c78 req-44847ed7-2233-42b5-b56b-5891f5c6487d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.080235 Oct 08 21:01:56.920539 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1265/2550] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:01:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 08 21:01:57.521862 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-ee4cd5ca-d02b-4982-911c-6fd81052763c tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:57.523284 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-ee4cd5ca-d02b-4982-911c-6fd81052763c tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: d7f3a7bd-a731-45de-a24b-e04e9d81358d] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:57.542849 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ee4cd5ca-d02b-4982-911c-6fd81052763c tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:57.551693 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ee4cd5ca-d02b-4982-911c-6fd81052763c tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:57.552517 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ee4cd5ca-d02b-4982-911c-6fd81052763c tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:57.555588 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ee4cd5ca-d02b-4982-911c-6fd81052763c tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:57.558465 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ee4cd5ca-d02b-4982-911c-6fd81052763c tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:57.560758 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ee4cd5ca-d02b-4982-911c-6fd81052763c tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:57.683389 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-9ad94c89-fd12-41c2-b248-4f09571b7ae4 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '612551711ec44a9b856a706a1c4c46e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c917d40fe85495081525a0d2952f888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:01:57.694815 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-9ad94c89-fd12-41c2-b248-4f09571b7ae4 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] 10.222.0.26 "GET /compute/v2.1/servers/43b537b7-2c01-4b03-af22-c87f1c9152d3" status: 200 len: 1526 microversion: 2.1 time: 1.661032 Oct 08 21:01:57.699440 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1286/2551] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:01:56 2022] GET /compute/v2.1/servers/43b537b7-2c01-4b03-af22-c87f1c9152d3 => generated 1526 bytes in 1670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:01:58.123559 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-68ecbc18-a7a2-4ca4-8fb1-1dbbdb553ab2 req-e45e500b-ffed-453f-b99d-be1bdcac1079 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43b537b7-2c01-4b03-af22-c87f1c9152d3", "name": "network-vif-deleted", "tag": "11347a56-be77-4cfa-a05b-dfedc81d337a"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:01:58.148025 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-68ecbc18-a7a2-4ca4-8fb1-1dbbdb553ab2 req-e45e500b-ffed-453f-b99d-be1bdcac1079 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:58.166248 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-68ecbc18-a7a2-4ca4-8fb1-1dbbdb553ab2 req-e45e500b-ffed-453f-b99d-be1bdcac1079 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:58.170125 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-68ecbc18-a7a2-4ca4-8fb1-1dbbdb553ab2 req-e45e500b-ffed-453f-b99d-be1bdcac1079 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:58.214059 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-68ecbc18-a7a2-4ca4-8fb1-1dbbdb553ab2 req-e45e500b-ffed-453f-b99d-be1bdcac1079 service nova] Creating event network-vif-deleted:11347a56-be77-4cfa-a05b-dfedc81d337a for instance 43b537b7-2c01-4b03-af22-c87f1c9152d3 on nch2-master-1 Oct 08 21:01:58.239837 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-68ecbc18-a7a2-4ca4-8fb1-1dbbdb553ab2 req-e45e500b-ffed-453f-b99d-be1bdcac1079 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120629 Oct 08 21:01:58.249319 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1287/2552] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:01:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:01:58.259165 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-ee4cd5ca-d02b-4982-911c-6fd81052763c tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:01:58.270641 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-ee4cd5ca-d02b-4982-911c-6fd81052763c tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/d7f3a7bd-a731-45de-a24b-e04e9d81358d" status: 200 len: 1379 microversion: 2.1 time: 0.754429 Oct 08 21:01:58.277477 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1266/2553] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:01:57 2022] GET /compute/v2.1/servers/d7f3a7bd-a731-45de-a24b-e04e9d81358d => generated 1379 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:01:58.719699 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-68eeb903-37e0-455c-b9ca-a04c59eae234 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:58.721531 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-68eeb903-37e0-455c-b9ca-a04c59eae234 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] [instance: 43b537b7-2c01-4b03-af22-c87f1c9152d3] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:58.744898 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-68eeb903-37e0-455c-b9ca-a04c59eae234 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:58.748454 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-68eeb903-37e0-455c-b9ca-a04c59eae234 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:58.750043 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-68eeb903-37e0-455c-b9ca-a04c59eae234 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:58.751392 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-68eeb903-37e0-455c-b9ca-a04c59eae234 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:58.755102 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-68eeb903-37e0-455c-b9ca-a04c59eae234 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:58.758118 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-68eeb903-37e0-455c-b9ca-a04c59eae234 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:58.855358 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-68eeb903-37e0-455c-b9ca-a04c59eae234 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] HTTP exception thrown: Instance 43b537b7-2c01-4b03-af22-c87f1c9152d3 could not be found. Oct 08 21:01:58.857344 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-68eeb903-37e0-455c-b9ca-a04c59eae234 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Request method failure captured: Oct 08 21:01:58.857344 ncdv-master-1 devstack@n-api.service[140492]: request: GET /compute/v2.1/servers/43b537b7-2c01-4b03-af22-c87f1c9152d3 HTTP/1.1 Oct 08 21:01:58.857344 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:01:58.857344 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:01:58.857344 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:01:58.857344 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 21:01:58.857344 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:01:58.857344 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:01:58.857344 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:01:58.857344 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:01:58.857344 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeUjaJ0AalaLu7xJuZOtBjYVn-d0WZz_7s03rREFySKUdhMDJymjIGG_-7sdLXL5BA6eOVtjnJQOL9mkYwMYPCci_MhYgvJ2DG-ZBtkmCFVKvQCVSg4zOlynrpCstA5Vz5yAFB62wnYTb3D8-bYOLyE9aYmV09KDjvO0ZiPNdmdfd-M Oct 08 21:01:58.857344 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:01:58.857344 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:01:58.857344 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:01:58.857344 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:01:58.857344 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:01:58.857344 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:01:58.857344 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 8c917d40fe85495081525a0d2952f888 Oct 08 21:01:58.857344 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1432451186 Oct 08 21:01:58.857344 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:01:58.857344 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:01:58.857344 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8c917d40fe85495081525a0d2952f888"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8c917d40fe85495081525a0d2952f888"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8c917d40fe85495081525a0d2952f888"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8c917d40fe85495081525a0d2952f888"}]}] Oct 08 21:01:58.857344 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1432451186 Oct 08 21:01:58.857344 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 8c917d40fe85495081525a0d2952f888 Oct 08 21:01:58.857344 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1432451186 Oct 08 21:01:58.857344 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-ServerAddressesNegativeTestJSON-1432451186-project Oct 08 21:01:58.857344 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:01:58.857344 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:01:58.857344 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 612551711ec44a9b856a706a1c4c46e7 Oct 08 21:01:58.857344 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1432451186-project Oct 08 21:01:58.857344 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 21:01:58.857344 ncdv-master-1 devstack@n-api.service[140492]: exception: Instance 43b537b7-2c01-4b03-af22-c87f1c9152d3 could not be found. Oct 08 21:01:58.857344 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': '43b537b7-2c01-4b03-af22-c87f1c9152d3'} Oct 08 21:01:58.857344 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:01:58.857344 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:01:58.857344 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:01:58.857344 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:01:58.857344 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:01:58.857344 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:01:58.857344 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:01:58.857344 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:01:58.857344 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:01:58.857344 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:01:58.857344 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43b537b7-2c01-4b03-af22-c87f1c9152d3 could not be found. Oct 08 21:01:58.857344 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:01:58.857344 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:01:58.857344 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:01:58.857344 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:01:58.857344 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:01:58.857344 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:01:58.857344 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:01:58.857344 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:01:58.857344 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:01:58.857344 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:01:58.857344 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:01:58.857344 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:01:58.857344 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:01:58.857344 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:01:58.857344 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:01:58.857344 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:01:58.857344 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43b537b7-2c01-4b03-af22-c87f1c9152d3 could not be found. Oct 08 21:01:58.857344 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:01:58.857344 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:01:58.861485 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:01:58.861485 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:01:58.861485 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:01:58.861485 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:01:58.861485 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:01:58.861485 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:01:58.861485 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43b537b7-2c01-4b03-af22-c87f1c9152d3 could not be found. Oct 08 21:01:58.861485 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:01:58.862976 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-68eeb903-37e0-455c-b9ca-a04c59eae234 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] Returning 404 to user: Instance 43b537b7-2c01-4b03-af22-c87f1c9152d3 could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:01:58.863994 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-68eeb903-37e0-455c-b9ca-a04c59eae234 tempest-ServerAddressesNegativeTestJSON-1432451186 tempest-ServerAddressesNegativeTestJSON-1432451186-project] 10.222.0.26 "GET /compute/v2.1/servers/43b537b7-2c01-4b03-af22-c87f1c9152d3" status: 404 len: 111 microversion: 2.1 time: 0.149157 Oct 08 21:01:58.864880 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1288/2554] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:01:58 2022] GET /compute/v2.1/servers/43b537b7-2c01-4b03-af22-c87f1c9152d3 => generated 111 bytes in 151 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:01:59.307262 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-2037d7fe-baad-4048-859c-78e8ffab3f6d tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:01:59.307896 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-2037d7fe-baad-4048-859c-78e8ffab3f6d tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: d7f3a7bd-a731-45de-a24b-e04e9d81358d] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:01:59.319178 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2037d7fe-baad-4048-859c-78e8ffab3f6d tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:59.319776 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2037d7fe-baad-4048-859c-78e8ffab3f6d tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:59.320234 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2037d7fe-baad-4048-859c-78e8ffab3f6d tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:59.321578 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2037d7fe-baad-4048-859c-78e8ffab3f6d tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:01:59.323044 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2037d7fe-baad-4048-859c-78e8ffab3f6d tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:01:59.323491 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2037d7fe-baad-4048-859c-78e8ffab3f6d tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:01:59.772350 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-2037d7fe-baad-4048-859c-78e8ffab3f6d tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:01:59.799566 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-2037d7fe-baad-4048-859c-78e8ffab3f6d tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/d7f3a7bd-a731-45de-a24b-e04e9d81358d" status: 200 len: 1379 microversion: 2.1 time: 0.497728 Oct 08 21:01:59.815351 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1267/2555] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:01:59 2022] GET /compute/v2.1/servers/d7f3a7bd-a731-45de-a24b-e04e9d81358d => generated 1379 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:02:00.832593 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-d433e180-9715-42b6-8bee-2a80ab6a13cd tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:02:00.834213 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-d433e180-9715-42b6-8bee-2a80ab6a13cd tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: d7f3a7bd-a731-45de-a24b-e04e9d81358d] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:02:00.869602 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=2 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:02:00.870733 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=6 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:02:00.874104 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d433e180-9715-42b6-8bee-2a80ab6a13cd tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:00.876420 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d433e180-9715-42b6-8bee-2a80ab6a13cd tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:00.877742 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d433e180-9715-42b6-8bee-2a80ab6a13cd tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:00.880686 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d433e180-9715-42b6-8bee-2a80ab6a13cd tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:00.885404 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d433e180-9715-42b6-8bee-2a80ab6a13cd tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:00.890189 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d433e180-9715-42b6-8bee-2a80ab6a13cd tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:02.322480 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-d433e180-9715-42b6-8bee-2a80ab6a13cd tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:02:02.343831 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-d433e180-9715-42b6-8bee-2a80ab6a13cd tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/d7f3a7bd-a731-45de-a24b-e04e9d81358d" status: 200 len: 1379 microversion: 2.1 time: 1.518512 Oct 08 21:02:02.375761 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1289/2556] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:02:00 2022] GET /compute/v2.1/servers/d7f3a7bd-a731-45de-a24b-e04e9d81358d => generated 1379 bytes in 1552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:02:03.373675 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-9f1c2806-f90d-4ddb-949d-6f1a2865be67 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:02:03.374354 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-9f1c2806-f90d-4ddb-949d-6f1a2865be67 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: d7f3a7bd-a731-45de-a24b-e04e9d81358d] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:02:03.382527 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=2 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:02:03.383284 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=2 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:02:03.385147 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9f1c2806-f90d-4ddb-949d-6f1a2865be67 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:03.385654 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9f1c2806-f90d-4ddb-949d-6f1a2865be67 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:03.386093 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9f1c2806-f90d-4ddb-949d-6f1a2865be67 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:03.386819 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9f1c2806-f90d-4ddb-949d-6f1a2865be67 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:03.387288 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9f1c2806-f90d-4ddb-949d-6f1a2865be67 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:03.387763 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9f1c2806-f90d-4ddb-949d-6f1a2865be67 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:03.673310 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-9f1c2806-f90d-4ddb-949d-6f1a2865be67 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:02:03.684689 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-9f1c2806-f90d-4ddb-949d-6f1a2865be67 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/d7f3a7bd-a731-45de-a24b-e04e9d81358d" status: 200 len: 1379 microversion: 2.1 time: 0.315439 Oct 08 21:02:03.699319 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1268/2557] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:02:03 2022] GET /compute/v2.1/servers/d7f3a7bd-a731-45de-a24b-e04e9d81358d => generated 1379 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:02:04.169030 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-4645c07c-e1b0-4ff5-81d9-a68e1514ea29 req-1990304c-10fb-4794-9acc-c9696632c8da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7f3a7bd-a731-45de-a24b-e04e9d81358d", "tag": "0a909b9a-561b-42d5-bf2f-d3cc0b3356b5"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:02:04.188823 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-4645c07c-e1b0-4ff5-81d9-a68e1514ea29 req-1990304c-10fb-4794-9acc-c9696632c8da service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:04.189357 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-4645c07c-e1b0-4ff5-81d9-a68e1514ea29 req-1990304c-10fb-4794-9acc-c9696632c8da service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:04.192096 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-4645c07c-e1b0-4ff5-81d9-a68e1514ea29 req-1990304c-10fb-4794-9acc-c9696632c8da service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:04.215384 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-4645c07c-e1b0-4ff5-81d9-a68e1514ea29 req-1990304c-10fb-4794-9acc-c9696632c8da service nova] Creating event network-changed:0a909b9a-561b-42d5-bf2f-d3cc0b3356b5 for instance d7f3a7bd-a731-45de-a24b-e04e9d81358d on nch2-master-1 Oct 08 21:02:04.227661 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-4645c07c-e1b0-4ff5-81d9-a68e1514ea29 req-1990304c-10fb-4794-9acc-c9696632c8da service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.322267 Oct 08 21:02:04.228930 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1290/2558] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:02:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:02:04.524386 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-17da20ea-c77c-4dd1-9706-3cf4b8e80a9e tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:02:04.528526 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-17da20ea-c77c-4dd1-9706-3cf4b8e80a9e tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] [instance: ceced78a-58d9-4175-b4fe-0d085be62c94] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:02:04.542123 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-17da20ea-c77c-4dd1-9706-3cf4b8e80a9e tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:04.543126 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-17da20ea-c77c-4dd1-9706-3cf4b8e80a9e tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:04.543725 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-17da20ea-c77c-4dd1-9706-3cf4b8e80a9e tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:04.544652 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-17da20ea-c77c-4dd1-9706-3cf4b8e80a9e tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:04.545431 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-17da20ea-c77c-4dd1-9706-3cf4b8e80a9e tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:04.546019 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-17da20ea-c77c-4dd1-9706-3cf4b8e80a9e tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:04.588583 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-17da20ea-c77c-4dd1-9706-3cf4b8e80a9e tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] HTTP exception thrown: Instance ceced78a-58d9-4175-b4fe-0d085be62c94 could not be found. Oct 08 21:02:04.594143 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-17da20ea-c77c-4dd1-9706-3cf4b8e80a9e tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Request method failure captured: Oct 08 21:02:04.594143 ncdv-master-1 devstack@n-api.service[140491]: request: DELETE /compute/v2.1/servers/ceced78a-58d9-4175-b4fe-0d085be62c94 HTTP/1.1 Oct 08 21:02:04.594143 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:02:04.594143 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:02:04.594143 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:02:04.594143 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 21:02:04.594143 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:02:04.594143 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:02:04.594143 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:02:04.594143 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:02:04.594143 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeOg5hfVEcicdIe7aaXklpUOMq2mfErMqnJe3L7AI8d4ToM7BwYeipy4-blhKiHTZtcrReXj2hr5TdHoeL5QdryvPoS3-j0NMgHPon-rvUEezyrq8jPXDx1hKhK6BThR2wnBpfSRRprQ5SYoFEo0_71jZMlABPl7RMKBihwD_IdK1s8 Oct 08 21:02:04.594143 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:02:04.594143 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:02:04.594143 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:02:04.594143 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:02:04.594143 ncdv-master-1 devstack@n-api.service[140491]: X-Openstack-Nova-Api-Version: 2.42 Oct 08 21:02:04.594143 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:02:04.594143 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:02:04.594143 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: ec51fae793a147d88e5d956352f18b92 Oct 08 21:02:04.594143 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1262294407 Oct 08 21:02:04.594143 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:02:04.594143 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:02:04.594143 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ec51fae793a147d88e5d956352f18b92"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ec51fae793a147d88e5d956352f18b92"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ec51fae793a147d88e5d956352f18b92"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ec51fae793a147d88e5d956352f18b92"}]}] Oct 08 21:02:04.594143 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1262294407 Oct 08 21:02:04.594143 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: ec51fae793a147d88e5d956352f18b92 Oct 08 21:02:04.594143 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1262294407 Oct 08 21:02:04.594143 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-TaggedBootDevicesTest_v242-1262294407-project Oct 08 21:02:04.594143 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:02:04.594143 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:02:04.594143 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: bc0c5c9593754f1cb98f9689b29606a2 Oct 08 21:02:04.594143 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1262294407-project Oct 08 21:02:04.594143 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:02:04.594143 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance ceced78a-58d9-4175-b4fe-0d085be62c94 could not be found. Oct 08 21:02:04.594143 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': 'ceced78a-58d9-4175-b4fe-0d085be62c94'} Oct 08 21:02:04.594143 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:02:04.594143 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:02:04.594143 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:02:04.594143 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:02:04.594143 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:02:04.594143 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:02:04.594143 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:02:04.594143 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:02:04.594143 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:02:04.594143 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:02:04.594143 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ceced78a-58d9-4175-b4fe-0d085be62c94 could not be found. Oct 08 21:02:04.594143 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:02:04.594143 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:02:04.594143 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:02:04.594143 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:02:04.594143 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:02:04.594143 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:02:04.594143 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:02:04.594143 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:02:04.594143 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:02:04.594143 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:02:04.594143 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 08 21:02:04.594143 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 08 21:02:04.594143 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 08 21:02:04.594143 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 08 21:02:04.594143 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:02:04.594143 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:02:04.594143 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:02:04.594143 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:02:04.598662 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ceced78a-58d9-4175-b4fe-0d085be62c94 could not be found. Oct 08 21:02:04.598662 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:02:04.598662 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:02:04.598662 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:02:04.598662 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:02:04.598662 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:02:04.598662 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:02:04.598662 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:02:04.598662 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:02:04.598662 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ceced78a-58d9-4175-b4fe-0d085be62c94 could not be found. Oct 08 21:02:04.598662 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:02:04.598662 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-17da20ea-c77c-4dd1-9706-3cf4b8e80a9e tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Returning 404 to user: Instance ceced78a-58d9-4175-b4fe-0d085be62c94 could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:02:04.598662 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-17da20ea-c77c-4dd1-9706-3cf4b8e80a9e tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] 10.222.0.26 "DELETE /compute/v2.1/servers/ceced78a-58d9-4175-b4fe-0d085be62c94" status: 404 len: 111 microversion: 2.42 time: 0.081900 Oct 08 21:02:04.598662 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1269/2559] 10.222.0.26 () {60 vars in 1280 bytes} [Sat Oct 8 21:02:04 2022] DELETE /compute/v2.1/servers/ceced78a-58d9-4175-b4fe-0d085be62c94 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 08 21:02:04.607217 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-1dab64a6-62f7-4e1f-8075-eaa6bad5bf68 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:02:04.608237 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-1dab64a6-62f7-4e1f-8075-eaa6bad5bf68 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] [instance: ceced78a-58d9-4175-b4fe-0d085be62c94] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:02:04.621676 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1dab64a6-62f7-4e1f-8075-eaa6bad5bf68 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:04.629034 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1dab64a6-62f7-4e1f-8075-eaa6bad5bf68 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:04.631932 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1dab64a6-62f7-4e1f-8075-eaa6bad5bf68 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:04.633013 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1dab64a6-62f7-4e1f-8075-eaa6bad5bf68 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:04.634012 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1dab64a6-62f7-4e1f-8075-eaa6bad5bf68 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:04.635738 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1dab64a6-62f7-4e1f-8075-eaa6bad5bf68 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:04.674705 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-1dab64a6-62f7-4e1f-8075-eaa6bad5bf68 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] HTTP exception thrown: Instance ceced78a-58d9-4175-b4fe-0d085be62c94 could not be found. Oct 08 21:02:04.677522 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-1dab64a6-62f7-4e1f-8075-eaa6bad5bf68 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Request method failure captured: Oct 08 21:02:04.677522 ncdv-master-1 devstack@n-api.service[140492]: request: GET /compute/v2.1/servers/ceced78a-58d9-4175-b4fe-0d085be62c94 HTTP/1.1 Oct 08 21:02:04.677522 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:02:04.677522 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:02:04.677522 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:02:04.677522 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 21:02:04.677522 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:02:04.677522 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:02:04.677522 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:02:04.677522 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:02:04.677522 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeOg5hfVEcicdIe7aaXklpUOMq2mfErMqnJe3L7AI8d4ToM7BwYeipy4-blhKiHTZtcrReXj2hr5TdHoeL5QdryvPoS3-j0NMgHPon-rvUEezyrq8jPXDx1hKhK6BThR2wnBpfSRRprQ5SYoFEo0_71jZMlABPl7RMKBihwD_IdK1s8 Oct 08 21:02:04.677522 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:02:04.677522 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:02:04.677522 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:02:04.677522 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:02:04.677522 ncdv-master-1 devstack@n-api.service[140492]: X-Openstack-Nova-Api-Version: 2.42 Oct 08 21:02:04.677522 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:02:04.677522 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:02:04.677522 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: ec51fae793a147d88e5d956352f18b92 Oct 08 21:02:04.677522 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1262294407 Oct 08 21:02:04.677522 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:02:04.677522 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:02:04.677522 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ec51fae793a147d88e5d956352f18b92"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ec51fae793a147d88e5d956352f18b92"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ec51fae793a147d88e5d956352f18b92"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ec51fae793a147d88e5d956352f18b92"}]}] Oct 08 21:02:04.677522 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1262294407 Oct 08 21:02:04.677522 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: ec51fae793a147d88e5d956352f18b92 Oct 08 21:02:04.677522 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1262294407 Oct 08 21:02:04.677522 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-TaggedBootDevicesTest_v242-1262294407-project Oct 08 21:02:04.677522 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:02:04.677522 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:02:04.677522 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: bc0c5c9593754f1cb98f9689b29606a2 Oct 08 21:02:04.677522 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1262294407-project Oct 08 21:02:04.677522 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 21:02:04.677522 ncdv-master-1 devstack@n-api.service[140492]: exception: Instance ceced78a-58d9-4175-b4fe-0d085be62c94 could not be found. Oct 08 21:02:04.677522 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': 'ceced78a-58d9-4175-b4fe-0d085be62c94'} Oct 08 21:02:04.677522 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:02:04.677522 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:02:04.677522 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:02:04.677522 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:02:04.677522 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:02:04.677522 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:02:04.677522 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:02:04.677522 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:02:04.677522 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:02:04.677522 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:02:04.677522 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ceced78a-58d9-4175-b4fe-0d085be62c94 could not be found. Oct 08 21:02:04.677522 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:02:04.677522 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:02:04.677522 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:02:04.677522 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:02:04.677522 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:02:04.677522 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:02:04.677522 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:02:04.677522 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:02:04.677522 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:02:04.677522 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:02:04.677522 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:02:04.677522 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:02:04.677522 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:02:04.677522 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:02:04.677522 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:02:04.677522 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:02:04.677522 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ceced78a-58d9-4175-b4fe-0d085be62c94 could not be found. Oct 08 21:02:04.677522 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:02:04.677522 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:02:04.683576 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:02:04.683576 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:02:04.683576 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:02:04.683576 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:02:04.683576 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:02:04.683576 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:02:04.683576 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ceced78a-58d9-4175-b4fe-0d085be62c94 could not be found. Oct 08 21:02:04.683576 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:02:04.683576 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-1dab64a6-62f7-4e1f-8075-eaa6bad5bf68 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] Returning 404 to user: Instance ceced78a-58d9-4175-b4fe-0d085be62c94 could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:02:04.686870 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-1dab64a6-62f7-4e1f-8075-eaa6bad5bf68 tempest-TaggedBootDevicesTest_v242-1262294407 tempest-TaggedBootDevicesTest_v242-1262294407-project] 10.222.0.26 "GET /compute/v2.1/servers/ceced78a-58d9-4175-b4fe-0d085be62c94" status: 404 len: 111 microversion: 2.42 time: 0.081818 Oct 08 21:02:04.689092 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1291/2560] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:02:04 2022] GET /compute/v2.1/servers/ceced78a-58d9-4175-b4fe-0d085be62c94 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 08 21:02:04.712631 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-b8b2aae2-11b1-4918-8904-5e0c73b15eb0 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:02:04.713283 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-b8b2aae2-11b1-4918-8904-5e0c73b15eb0 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: d7f3a7bd-a731-45de-a24b-e04e9d81358d] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:02:04.734254 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b8b2aae2-11b1-4918-8904-5e0c73b15eb0 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:04.740822 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b8b2aae2-11b1-4918-8904-5e0c73b15eb0 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:04.741473 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b8b2aae2-11b1-4918-8904-5e0c73b15eb0 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:04.742746 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b8b2aae2-11b1-4918-8904-5e0c73b15eb0 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:04.743225 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b8b2aae2-11b1-4918-8904-5e0c73b15eb0 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:04.743656 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b8b2aae2-11b1-4918-8904-5e0c73b15eb0 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:04.755386 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:02:05.485407 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-b8b2aae2-11b1-4918-8904-5e0c73b15eb0 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:02:05.506091 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-b8b2aae2-11b1-4918-8904-5e0c73b15eb0 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/d7f3a7bd-a731-45de-a24b-e04e9d81358d" status: 200 len: 1379 microversion: 2.1 time: 0.798295 Oct 08 21:02:05.508317 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1270/2561] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:02:04 2022] GET /compute/v2.1/servers/d7f3a7bd-a731-45de-a24b-e04e9d81358d => generated 1379 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:02:06.530111 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-d9dc33b0-7b59-4141-b8c6-430e59ec5c77 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:02:06.530747 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-d9dc33b0-7b59-4141-b8c6-430e59ec5c77 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: d7f3a7bd-a731-45de-a24b-e04e9d81358d] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:02:06.545146 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d9dc33b0-7b59-4141-b8c6-430e59ec5c77 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:06.549675 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d9dc33b0-7b59-4141-b8c6-430e59ec5c77 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:06.550488 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d9dc33b0-7b59-4141-b8c6-430e59ec5c77 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:06.551769 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d9dc33b0-7b59-4141-b8c6-430e59ec5c77 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:06.552690 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d9dc33b0-7b59-4141-b8c6-430e59ec5c77 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:06.553390 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d9dc33b0-7b59-4141-b8c6-430e59ec5c77 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:07.032715 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-d9dc33b0-7b59-4141-b8c6-430e59ec5c77 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:02:07.047311 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-d9dc33b0-7b59-4141-b8c6-430e59ec5c77 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/d7f3a7bd-a731-45de-a24b-e04e9d81358d" status: 200 len: 1379 microversion: 2.1 time: 0.521396 Oct 08 21:02:07.048170 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1292/2562] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:02:06 2022] GET /compute/v2.1/servers/d7f3a7bd-a731-45de-a24b-e04e9d81358d => generated 1379 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:02:08.077660 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-fca934e5-40bd-4755-bc2d-b9ec135eadcc tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:02:08.078302 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-fca934e5-40bd-4755-bc2d-b9ec135eadcc tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: d7f3a7bd-a731-45de-a24b-e04e9d81358d] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:02:08.099488 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fca934e5-40bd-4755-bc2d-b9ec135eadcc tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:08.100002 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fca934e5-40bd-4755-bc2d-b9ec135eadcc tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:08.103792 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fca934e5-40bd-4755-bc2d-b9ec135eadcc tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:08.106200 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fca934e5-40bd-4755-bc2d-b9ec135eadcc tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:08.107680 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fca934e5-40bd-4755-bc2d-b9ec135eadcc tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:08.114325 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fca934e5-40bd-4755-bc2d-b9ec135eadcc tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:08.600239 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-fca934e5-40bd-4755-bc2d-b9ec135eadcc tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:02:08.612036 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-fca934e5-40bd-4755-bc2d-b9ec135eadcc tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/d7f3a7bd-a731-45de-a24b-e04e9d81358d" status: 200 len: 1379 microversion: 2.1 time: 0.541402 Oct 08 21:02:08.626669 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1271/2563] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:02:08 2022] GET /compute/v2.1/servers/d7f3a7bd-a731-45de-a24b-e04e9d81358d => generated 1379 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:02:09.640451 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-0a158a5c-7b49-4cc1-965c-b5f1759d7d07 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:02:09.641076 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-0a158a5c-7b49-4cc1-965c-b5f1759d7d07 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: d7f3a7bd-a731-45de-a24b-e04e9d81358d] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:02:09.652496 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0a158a5c-7b49-4cc1-965c-b5f1759d7d07 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:09.655151 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0a158a5c-7b49-4cc1-965c-b5f1759d7d07 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:09.655807 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0a158a5c-7b49-4cc1-965c-b5f1759d7d07 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:09.656765 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0a158a5c-7b49-4cc1-965c-b5f1759d7d07 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:09.659796 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0a158a5c-7b49-4cc1-965c-b5f1759d7d07 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:09.660427 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0a158a5c-7b49-4cc1-965c-b5f1759d7d07 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:10.475676 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-0a158a5c-7b49-4cc1-965c-b5f1759d7d07 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:02:10.501112 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-0a158a5c-7b49-4cc1-965c-b5f1759d7d07 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/d7f3a7bd-a731-45de-a24b-e04e9d81358d" status: 200 len: 1379 microversion: 2.1 time: 0.860842 Oct 08 21:02:10.505557 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1293/2564] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:02:09 2022] GET /compute/v2.1/servers/d7f3a7bd-a731-45de-a24b-e04e9d81358d => generated 1379 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:02:11.530128 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-81fcc8cc-2cd4-42bd-af65-21f2756877fd tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:02:11.532067 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-81fcc8cc-2cd4-42bd-af65-21f2756877fd tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: d7f3a7bd-a731-45de-a24b-e04e9d81358d] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:02:11.544177 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-81fcc8cc-2cd4-42bd-af65-21f2756877fd tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:11.545058 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-81fcc8cc-2cd4-42bd-af65-21f2756877fd tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:11.545757 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-81fcc8cc-2cd4-42bd-af65-21f2756877fd tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:11.558294 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-81fcc8cc-2cd4-42bd-af65-21f2756877fd tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:11.559214 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-81fcc8cc-2cd4-42bd-af65-21f2756877fd tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:11.559898 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-81fcc8cc-2cd4-42bd-af65-21f2756877fd tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:12.361262 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-81fcc8cc-2cd4-42bd-af65-21f2756877fd tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:02:12.369771 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-81fcc8cc-2cd4-42bd-af65-21f2756877fd tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/d7f3a7bd-a731-45de-a24b-e04e9d81358d" status: 200 len: 1379 microversion: 2.1 time: 0.843430 Oct 08 21:02:12.385724 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1272/2565] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:02:11 2022] GET /compute/v2.1/servers/d7f3a7bd-a731-45de-a24b-e04e9d81358d => generated 1379 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:02:12.812324 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-098dd8ec-2633-4dd0-8fa8-45752e86e0fa tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3d9000e4-0140-4d89-9d9e-4730705b15bf"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:02:12.815185 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-098dd8ec-2633-4dd0-8fa8-45752e86e0fa tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] [instance: 4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:02:12.836093 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-098dd8ec-2633-4dd0-8fa8-45752e86e0fa tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:12.844528 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-098dd8ec-2633-4dd0-8fa8-45752e86e0fa tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:12.845452 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-098dd8ec-2633-4dd0-8fa8-45752e86e0fa tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:12.846400 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-098dd8ec-2633-4dd0-8fa8-45752e86e0fa tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:12.847167 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-098dd8ec-2633-4dd0-8fa8-45752e86e0fa tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:12.854857 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-098dd8ec-2633-4dd0-8fa8-45752e86e0fa tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:13.400845 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-49070e7f-ce8c-4bea-a54a-a299b385f0e5 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:02:13.401496 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-49070e7f-ce8c-4bea-a54a-a299b385f0e5 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: d7f3a7bd-a731-45de-a24b-e04e9d81358d] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:02:13.419472 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-49070e7f-ce8c-4bea-a54a-a299b385f0e5 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:13.419976 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-49070e7f-ce8c-4bea-a54a-a299b385f0e5 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:13.420420 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-49070e7f-ce8c-4bea-a54a-a299b385f0e5 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:13.421137 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-49070e7f-ce8c-4bea-a54a-a299b385f0e5 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:13.432578 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-49070e7f-ce8c-4bea-a54a-a299b385f0e5 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:13.433837 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-49070e7f-ce8c-4bea-a54a-a299b385f0e5 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:13.498192 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-098dd8ec-2633-4dd0-8fa8-45752e86e0fa tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] 10.222.0.26 "POST /compute/v2.1/servers/4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.697569 Oct 08 21:02:13.499107 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1294/2566] 10.222.0.26 () {60 vars in 1323 bytes} [Sat Oct 8 21:02:12 2022] POST /compute/v2.1/servers/4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711/os-volume_attachments => generated 194 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:02:14.868493 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-49070e7f-ce8c-4bea-a54a-a299b385f0e5 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:02:14.882058 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-49070e7f-ce8c-4bea-a54a-a299b385f0e5 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/d7f3a7bd-a731-45de-a24b-e04e9d81358d" status: 200 len: 1379 microversion: 2.1 time: 1.485388 Oct 08 21:02:14.884442 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1273/2567] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:02:13 2022] GET /compute/v2.1/servers/d7f3a7bd-a731-45de-a24b-e04e9d81358d => generated 1379 bytes in 1488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:02:15.911815 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-f6dbad66-941c-44db-a194-1a6df071d530 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:02:15.912598 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-f6dbad66-941c-44db-a194-1a6df071d530 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: d7f3a7bd-a731-45de-a24b-e04e9d81358d] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:02:15.936565 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f6dbad66-941c-44db-a194-1a6df071d530 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:15.937089 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f6dbad66-941c-44db-a194-1a6df071d530 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:15.944071 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f6dbad66-941c-44db-a194-1a6df071d530 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:15.954018 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f6dbad66-941c-44db-a194-1a6df071d530 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:15.955062 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f6dbad66-941c-44db-a194-1a6df071d530 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:15.959533 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f6dbad66-941c-44db-a194-1a6df071d530 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:16.414538 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-60a1b520-cd5d-4a80-8110-9e5bd6fc68d6 req-03c921a0-d149-41e4-a779-93be33f990c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7f3a7bd-a731-45de-a24b-e04e9d81358d", "name": "network-vif-plugged", "status": "completed", "tag": "0a909b9a-561b-42d5-bf2f-d3cc0b3356b5"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:02:16.464025 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-60a1b520-cd5d-4a80-8110-9e5bd6fc68d6 req-03c921a0-d149-41e4-a779-93be33f990c4 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:16.470213 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-60a1b520-cd5d-4a80-8110-9e5bd6fc68d6 req-03c921a0-d149-41e4-a779-93be33f990c4 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:16.470824 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-60a1b520-cd5d-4a80-8110-9e5bd6fc68d6 req-03c921a0-d149-41e4-a779-93be33f990c4 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:16.537129 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-60a1b520-cd5d-4a80-8110-9e5bd6fc68d6 req-03c921a0-d149-41e4-a779-93be33f990c4 service nova] Creating event network-vif-plugged:0a909b9a-561b-42d5-bf2f-d3cc0b3356b5 for instance d7f3a7bd-a731-45de-a24b-e04e9d81358d on nch2-master-1 Oct 08 21:02:16.584242 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-60a1b520-cd5d-4a80-8110-9e5bd6fc68d6 req-03c921a0-d149-41e4-a779-93be33f990c4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.822044 Oct 08 21:02:16.589588 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1295/2568] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:02:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:02:17.016366 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-f6dbad66-941c-44db-a194-1a6df071d530 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:02:17.035777 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-f6dbad66-941c-44db-a194-1a6df071d530 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/d7f3a7bd-a731-45de-a24b-e04e9d81358d" status: 200 len: 1379 microversion: 2.1 time: 1.127937 Oct 08 21:02:17.042622 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1274/2569] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:02:15 2022] GET /compute/v2.1/servers/d7f3a7bd-a731-45de-a24b-e04e9d81358d => generated 1379 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:02:17.584390 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-9e077c2f-a5cb-4fb9-83bc-67070016060d tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-246764598", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "networks": [{"uuid": "c58d2a45-a109-4b9e-9df8-34ff65bb2288"}, {"uuid": "a7a52edc-4db7-41b8-b0d6-2db4aafddae5"}, {"uuid": "c58d2a45-a109-4b9e-9df8-34ff65bb2288"}]}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:02:17.656479 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.network.neutron [None req-9e077c2f-a5cb-4fb9-83bc-67070016060d tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] validate_networks() for [('c58d2a45-a109-4b9e-9df8-34ff65bb2288', None, None, None, None, None), ('a7a52edc-4db7-41b8-b0d6-2db4aafddae5', None, None, None, None, None), ('c58d2a45-a109-4b9e-9df8-34ff65bb2288', None, None, None, None, None)] {{(pid=140492) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 21:02:18.067047 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-15b3341e-5740-4229-9f78-6f3179521c07 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:02:18.068026 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-15b3341e-5740-4229-9f78-6f3179521c07 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: d7f3a7bd-a731-45de-a24b-e04e9d81358d] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:02:18.091675 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-15b3341e-5740-4229-9f78-6f3179521c07 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:18.093283 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-15b3341e-5740-4229-9f78-6f3179521c07 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:18.095101 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-15b3341e-5740-4229-9f78-6f3179521c07 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:18.096525 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-15b3341e-5740-4229-9f78-6f3179521c07 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:18.109007 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-15b3341e-5740-4229-9f78-6f3179521c07 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:18.110638 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-15b3341e-5740-4229-9f78-6f3179521c07 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:19.273811 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-15b3341e-5740-4229-9f78-6f3179521c07 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:02:19.296345 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-15b3341e-5740-4229-9f78-6f3179521c07 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/d7f3a7bd-a731-45de-a24b-e04e9d81358d" status: 200 len: 1379 microversion: 2.1 time: 1.232682 Oct 08 21:02:19.299837 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1275/2570] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:02:18 2022] GET /compute/v2.1/servers/d7f3a7bd-a731-45de-a24b-e04e9d81358d => generated 1379 bytes in 1238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:02:19.312946 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-d00f8be3-cf85-4f04-aaa9-cde23ab055d3 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:02:19.317005 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-d00f8be3-cf85-4f04-aaa9-cde23ab055d3 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] [instance: 4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:02:19.325691 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d00f8be3-cf85-4f04-aaa9-cde23ab055d3 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:19.326585 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d00f8be3-cf85-4f04-aaa9-cde23ab055d3 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:19.327332 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d00f8be3-cf85-4f04-aaa9-cde23ab055d3 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:19.328658 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d00f8be3-cf85-4f04-aaa9-cde23ab055d3 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:19.329581 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d00f8be3-cf85-4f04-aaa9-cde23ab055d3 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:19.330553 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d00f8be3-cf85-4f04-aaa9-cde23ab055d3 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:19.373888 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.objects.instance [None req-d00f8be3-cf85-4f04-aaa9-cde23ab055d3 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lazy-loading 'flavor' on Instance uuid 4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711 {{(pid=140491) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 21:02:19.620342 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-d00f8be3-cf85-4f04-aaa9-cde23ab055d3 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] 10.222.0.26 "POST /compute/v2.1/servers/4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711/action" status: 200 len: 32 microversion: 2.1 time: 0.315317 Oct 08 21:02:19.622102 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1276/2571] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:02:19 2022] POST /compute/v2.1/servers/4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711/action => generated 32 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 08 21:02:19.644209 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-a84d59a4-5876-4b43-ba7a-f518b1ea3ac6 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:02:19.646204 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-a84d59a4-5876-4b43-ba7a-f518b1ea3ac6 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] [instance: 4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:02:19.660006 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a84d59a4-5876-4b43-ba7a-f518b1ea3ac6 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:19.673143 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a84d59a4-5876-4b43-ba7a-f518b1ea3ac6 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:19.674925 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a84d59a4-5876-4b43-ba7a-f518b1ea3ac6 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:19.676558 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a84d59a4-5876-4b43-ba7a-f518b1ea3ac6 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:19.677329 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a84d59a4-5876-4b43-ba7a-f518b1ea3ac6 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:19.678449 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a84d59a4-5876-4b43-ba7a-f518b1ea3ac6 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:20.134837 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-9e077c2f-a5cb-4fb9-83bc-67070016060d tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Flavor limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 21:02:20.136123 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-9e077c2f-a5cb-4fb9-83bc-67070016060d tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Image limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 21:02:20.137442 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-9e077c2f-a5cb-4fb9-83bc-67070016060d tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Flavor pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 21:02:20.138529 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-9e077c2f-a5cb-4fb9-83bc-67070016060d tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Image pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 21:02:20.139239 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-9e077c2f-a5cb-4fb9-83bc-67070016060d tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 21:02:20.151310 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9e077c2f-a5cb-4fb9-83bc-67070016060d tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:20.152358 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9e077c2f-a5cb-4fb9-83bc-67070016060d tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:20.153030 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9e077c2f-a5cb-4fb9-83bc-67070016060d tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:20.154036 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9e077c2f-a5cb-4fb9-83bc-67070016060d tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:20.155368 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9e077c2f-a5cb-4fb9-83bc-67070016060d tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:20.156398 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9e077c2f-a5cb-4fb9-83bc-67070016060d tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:20.188713 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-9e077c2f-a5cb-4fb9-83bc-67070016060d tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Getting quotas for project 4735bf74f33a4739800d766c82d973d4. Resources: {'cores', 'instances', 'ram'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:02:20.196596 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-9e077c2f-a5cb-4fb9-83bc-67070016060d tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Getting quotas for user 40f60e33f334465fac1148669de3f00c and project 4735bf74f33a4739800d766c82d973d4. Resources: {'cores', 'instances', 'ram'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:02:20.216400 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-9e077c2f-a5cb-4fb9-83bc-67070016060d tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Going to run 1 instances... {{(pid=140492) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 21:02:20.219704 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-9e077c2f-a5cb-4fb9-83bc-67070016060d tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] [instance: 0e762f82-ada3-411d-9072-37e72381145d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c508bd7f-7db9-4b2c-af7c-be54a855c355',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140492) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 21:02:20.338500 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-9e077c2f-a5cb-4fb9-83bc-67070016060d tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.767656 Oct 08 21:02:20.340046 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1296/2572] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 21:02:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 2771 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 08 21:02:20.345031 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-952a4c60-a143-448e-8463-1360ad3891f1 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:02:20.346199 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-952a4c60-a143-448e-8463-1360ad3891f1 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: d7f3a7bd-a731-45de-a24b-e04e9d81358d] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:02:20.359111 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-952a4c60-a143-448e-8463-1360ad3891f1 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:20.360235 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-952a4c60-a143-448e-8463-1360ad3891f1 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:20.361529 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-952a4c60-a143-448e-8463-1360ad3891f1 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:20.362542 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-952a4c60-a143-448e-8463-1360ad3891f1 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:20.363775 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-952a4c60-a143-448e-8463-1360ad3891f1 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:20.364670 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-952a4c60-a143-448e-8463-1360ad3891f1 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:20.596736 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-a84d59a4-5876-4b43-ba7a-f518b1ea3ac6 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1698dee4a2bf4ea19a6ee0c3d5cb5c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b00ee5e7828469f95bd90548d35982a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:02:20.612708 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-a84d59a4-5876-4b43-ba7a-f518b1ea3ac6 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] 10.222.0.26 "GET /compute/v2.1/servers/4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711" status: 200 len: 1735 microversion: 2.1 time: 0.978170 Oct 08 21:02:20.614784 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1277/2573] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:02:19 2022] GET /compute/v2.1/servers/4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711 => generated 1735 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:02:20.631896 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-214462cb-d22d-4e73-8efc-5c43d446efec tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:02:20.638931 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-214462cb-d22d-4e73-8efc-5c43d446efec tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] [instance: 0e762f82-ada3-411d-9072-37e72381145d] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:02:20.882426 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-952a4c60-a143-448e-8463-1360ad3891f1 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:02:20.952618 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-952a4c60-a143-448e-8463-1360ad3891f1 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/d7f3a7bd-a731-45de-a24b-e04e9d81358d" status: 200 len: 1529 microversion: 2.1 time: 0.546984 Oct 08 21:02:20.952861 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-214462cb-d22d-4e73-8efc-5c43d446efec tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f60e33f334465fac1148669de3f00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4735bf74f33a4739800d766c82d973d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:02:20.952961 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1297/2574] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:02:20 2022] GET /compute/v2.1/servers/d7f3a7bd-a731-45de-a24b-e04e9d81358d => generated 1529 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:02:20.953045 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-214462cb-d22d-4e73-8efc-5c43d446efec tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] 10.222.0.26 "GET /compute/v2.1/servers/0e762f82-ada3-411d-9072-37e72381145d" status: 200 len: 1212 microversion: 2.1 time: 0.318061 Oct 08 21:02:20.953045 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1278/2575] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:02:20 2022] GET /compute/v2.1/servers/0e762f82-ada3-411d-9072-37e72381145d => generated 1212 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:02:20.953176 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-63d339d0-027b-4855-be95-5353085239f9 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:02:20.953176 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-63d339d0-027b-4855-be95-5353085239f9 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: d7f3a7bd-a731-45de-a24b-e04e9d81358d] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:02:20.959779 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-63d339d0-027b-4855-be95-5353085239f9 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:20.960864 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-63d339d0-027b-4855-be95-5353085239f9 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:20.961338 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-63d339d0-027b-4855-be95-5353085239f9 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:20.962084 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-63d339d0-027b-4855-be95-5353085239f9 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:20.962542 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-63d339d0-027b-4855-be95-5353085239f9 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:20.962996 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-63d339d0-027b-4855-be95-5353085239f9 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:21.641708 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-2813a561-ea07-4053-b93a-a3e942f04dfd tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:02:21.642314 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-2813a561-ea07-4053-b93a-a3e942f04dfd tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] [instance: 4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:02:21.663127 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2813a561-ea07-4053-b93a-a3e942f04dfd tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:21.666589 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2813a561-ea07-4053-b93a-a3e942f04dfd tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:21.667290 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2813a561-ea07-4053-b93a-a3e942f04dfd tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:21.674595 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2813a561-ea07-4053-b93a-a3e942f04dfd tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:21.676615 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2813a561-ea07-4053-b93a-a3e942f04dfd tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:21.679529 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2813a561-ea07-4053-b93a-a3e942f04dfd tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:21.712587 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-63d339d0-027b-4855-be95-5353085239f9 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:02:21.728271 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-63d339d0-027b-4855-be95-5353085239f9 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/d7f3a7bd-a731-45de-a24b-e04e9d81358d" status: 200 len: 1529 microversion: 2.1 time: 0.787266 Oct 08 21:02:21.749244 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1298/2576] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:02:20 2022] GET /compute/v2.1/servers/d7f3a7bd-a731-45de-a24b-e04e9d81358d => generated 1529 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:02:21.754810 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-09b96003-0b11-401c-b42b-f15c2a1645a2 tempest-MigrationsAdminTest-1609748928 tempest-MigrationsAdminTest-1609748928-project-admin] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:02:21.808334 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-09b96003-0b11-401c-b42b-f15c2a1645a2 tempest-MigrationsAdminTest-1609748928 tempest-MigrationsAdminTest-1609748928-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/a27506c8-e431-412e-9a38-928f17d8819e" status: 202 len: 0 microversion: 2.1 time: 0.057544 Oct 08 21:02:21.812886 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1299/2577] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:02:21 2022] DELETE /compute/v2.1/flavors/a27506c8-e431-412e-9a38-928f17d8819e => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 21:02:21.818582 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-c89855d5-623e-48d9-8dd1-2918aae6a78f tempest-MigrationsAdminTest-1609748928 tempest-MigrationsAdminTest-1609748928-project-admin] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:02:21.899399 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-c89855d5-623e-48d9-8dd1-2918aae6a78f tempest-MigrationsAdminTest-1609748928 tempest-MigrationsAdminTest-1609748928-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.084666 Oct 08 21:02:21.900173 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1300/2578] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Oct 8 21:02:21 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:02:21.926313 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-15a3736f-13bf-4f60-bc1f-d0044ed80336 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:02:21.941543 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-15a3736f-13bf-4f60-bc1f-d0044ed80336 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: d7f3a7bd-a731-45de-a24b-e04e9d81358d] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:02:21.970841 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-15a3736f-13bf-4f60-bc1f-d0044ed80336 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:21.975014 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-15a3736f-13bf-4f60-bc1f-d0044ed80336 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:21.976009 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-15a3736f-13bf-4f60-bc1f-d0044ed80336 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:21.976978 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-15a3736f-13bf-4f60-bc1f-d0044ed80336 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:21.981825 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-15a3736f-13bf-4f60-bc1f-d0044ed80336 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:21.982311 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-15a3736f-13bf-4f60-bc1f-d0044ed80336 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:22.558948 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-2813a561-ea07-4053-b93a-a3e942f04dfd tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1698dee4a2bf4ea19a6ee0c3d5cb5c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b00ee5e7828469f95bd90548d35982a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:02:22.580116 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-2813a561-ea07-4053-b93a-a3e942f04dfd tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] 10.222.0.26 "GET /compute/v2.1/servers/4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711" status: 200 len: 1735 microversion: 2.1 time: 0.941546 Oct 08 21:02:22.586284 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1279/2579] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:02:21 2022] GET /compute/v2.1/servers/4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711 => generated 1735 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:02:22.604176 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-f0730ac8-bad5-4362-a89e-1ab1387f2775 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:02:22.608296 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-f0730ac8-bad5-4362-a89e-1ab1387f2775 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] [instance: 0e762f82-ada3-411d-9072-37e72381145d] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:02:22.636471 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f0730ac8-bad5-4362-a89e-1ab1387f2775 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:22.656030 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f0730ac8-bad5-4362-a89e-1ab1387f2775 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:22.656680 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f0730ac8-bad5-4362-a89e-1ab1387f2775 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:22.667882 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f0730ac8-bad5-4362-a89e-1ab1387f2775 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:22.668401 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f0730ac8-bad5-4362-a89e-1ab1387f2775 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:22.668854 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f0730ac8-bad5-4362-a89e-1ab1387f2775 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:22.950863 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-f0730ac8-bad5-4362-a89e-1ab1387f2775 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f60e33f334465fac1148669de3f00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4735bf74f33a4739800d766c82d973d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:02:22.962504 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-f0730ac8-bad5-4362-a89e-1ab1387f2775 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] 10.222.0.26 "GET /compute/v2.1/servers/0e762f82-ada3-411d-9072-37e72381145d" status: 200 len: 1264 microversion: 2.1 time: 0.370951 Oct 08 21:02:22.965669 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1280/2580] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:02:22 2022] GET /compute/v2.1/servers/0e762f82-ada3-411d-9072-37e72381145d => generated 1264 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:02:22.971369 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-15a3736f-13bf-4f60-bc1f-d0044ed80336 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:02:22.974616 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=3 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:02:22.980666 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-15a3736f-13bf-4f60-bc1f-d0044ed80336 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: d7f3a7bd-a731-45de-a24b-e04e9d81358d] Old instance type tempest-test_resize_flavor_-1021005527, new instance type m1.heat {{(pid=140492) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 08 21:02:22.999176 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:02:23.001879 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-15a3736f-13bf-4f60-bc1f-d0044ed80336 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Flavor limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 21:02:23.002751 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-15a3736f-13bf-4f60-bc1f-d0044ed80336 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Image limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 21:02:23.004126 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-15a3736f-13bf-4f60-bc1f-d0044ed80336 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Flavor pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 21:02:23.005728 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-15a3736f-13bf-4f60-bc1f-d0044ed80336 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Image pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 21:02:23.008375 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-15a3736f-13bf-4f60-bc1f-d0044ed80336 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 21:02:23.283240 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-15a3736f-13bf-4f60-bc1f-d0044ed80336 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "POST /compute/v2.1/servers/d7f3a7bd-a731-45de-a24b-e04e9d81358d/action" status: 202 len: 0 microversion: 2.1 time: 1.364364 Oct 08 21:02:23.291539 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1301/2581] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:02:21 2022] POST /compute/v2.1/servers/d7f3a7bd-a731-45de-a24b-e04e9d81358d/action => generated 0 bytes in 1373 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 21:02:23.310948 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-927ee7cd-c9f8-4962-8271-f0987fee29f7 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:02:23.312072 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-927ee7cd-c9f8-4962-8271-f0987fee29f7 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: d7f3a7bd-a731-45de-a24b-e04e9d81358d] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:02:23.322309 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-927ee7cd-c9f8-4962-8271-f0987fee29f7 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:23.325128 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-927ee7cd-c9f8-4962-8271-f0987fee29f7 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:23.325920 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-927ee7cd-c9f8-4962-8271-f0987fee29f7 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:23.326950 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-927ee7cd-c9f8-4962-8271-f0987fee29f7 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:23.329970 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-927ee7cd-c9f8-4962-8271-f0987fee29f7 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:23.330668 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-927ee7cd-c9f8-4962-8271-f0987fee29f7 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:23.420754 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-13502add-cd9b-456d-9c8d-cb8c215a91f3 tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Action: 'create', calling method: .version_select at 0x7f1a8cccf3a0>, body: {"keypair": {"name": "tempest-keypair-907560983", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBzM9cNGIbgRT0/VQdP1NFCkQunsxMYw6rp1uB/3rBBZZhbza43BMuNkrKDyXByUSTIhBO0cTFSHJtwzxAArEJYmmzKNOMtamnof+t+EzdDaYP6F4X2htuSIsJkQjwUgBQ=="}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:02:23.455878 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-13502add-cd9b-456d-9c8d-cb8c215a91f3 tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Getting quotas for project 9e0310d9e59942729d685e6eb06c6460. Resources: {'key_pairs'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:02:23.465647 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-13502add-cd9b-456d-9c8d-cb8c215a91f3 tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Getting quotas for user 5e3216124a4f41b2b931a16c750649df and project 9e0310d9e59942729d685e6eb06c6460. Resources: {'key_pairs'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:02:23.518567 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-13502add-cd9b-456d-9c8d-cb8c215a91f3 tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.548630 Oct 08 21:02:23.520083 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1281/2582] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Oct 8 21:02:22 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:02:23.614140 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-11f0f165-2386-4712-8b3f-78d7e35162cb tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:02:23.615901 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-11f0f165-2386-4712-8b3f-78d7e35162cb tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] [instance: 4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:02:23.632085 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-11f0f165-2386-4712-8b3f-78d7e35162cb tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:23.632984 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-11f0f165-2386-4712-8b3f-78d7e35162cb tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:23.633662 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-11f0f165-2386-4712-8b3f-78d7e35162cb tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:23.634860 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-11f0f165-2386-4712-8b3f-78d7e35162cb tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:23.635525 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-11f0f165-2386-4712-8b3f-78d7e35162cb tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:23.638214 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-11f0f165-2386-4712-8b3f-78d7e35162cb tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:24.212937 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-927ee7cd-c9f8-4962-8271-f0987fee29f7 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:02:24.222882 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-927ee7cd-c9f8-4962-8271-f0987fee29f7 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/d7f3a7bd-a731-45de-a24b-e04e9d81358d" status: 200 len: 1538 microversion: 2.1 time: 0.929804 Oct 08 21:02:24.223543 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1302/2583] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:02:23 2022] GET /compute/v2.1/servers/d7f3a7bd-a731-45de-a24b-e04e9d81358d => generated 1538 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:02:24.238687 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-ed95283d-e1c9-4739-9401-9d50feb0f39b tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:02:24.239312 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-ed95283d-e1c9-4739-9401-9d50feb0f39b tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] [instance: 0e762f82-ada3-411d-9072-37e72381145d] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:02:24.269199 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ed95283d-e1c9-4739-9401-9d50feb0f39b tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:24.269772 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ed95283d-e1c9-4739-9401-9d50feb0f39b tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:24.270234 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ed95283d-e1c9-4739-9401-9d50feb0f39b tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:24.271044 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ed95283d-e1c9-4739-9401-9d50feb0f39b tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:24.271450 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ed95283d-e1c9-4739-9401-9d50feb0f39b tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:24.271881 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ed95283d-e1c9-4739-9401-9d50feb0f39b tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:24.439460 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-ed95283d-e1c9-4739-9401-9d50feb0f39b tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f60e33f334465fac1148669de3f00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4735bf74f33a4739800d766c82d973d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:02:24.449987 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-ed95283d-e1c9-4739-9401-9d50feb0f39b tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] 10.222.0.26 "GET /compute/v2.1/servers/0e762f82-ada3-411d-9072-37e72381145d" status: 200 len: 1270 microversion: 2.1 time: 0.218218 Oct 08 21:02:24.461404 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1303/2584] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:02:24 2022] GET /compute/v2.1/servers/0e762f82-ada3-411d-9072-37e72381145d => generated 1270 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:02:24.599905 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-11f0f165-2386-4712-8b3f-78d7e35162cb tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1698dee4a2bf4ea19a6ee0c3d5cb5c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b00ee5e7828469f95bd90548d35982a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:02:24.616968 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-11f0f165-2386-4712-8b3f-78d7e35162cb tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] 10.222.0.26 "GET /compute/v2.1/servers/4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711" status: 200 len: 1735 microversion: 2.1 time: 1.011430 Oct 08 21:02:24.618022 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1282/2585] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:02:23 2022] GET /compute/v2.1/servers/4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711 => generated 1735 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:02:25.252022 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e6664f0d-90e4-467e-8f8f-04a7eb6dbac3 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:02:25.253528 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-e6664f0d-90e4-467e-8f8f-04a7eb6dbac3 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: d7f3a7bd-a731-45de-a24b-e04e9d81358d] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:02:25.284304 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e6664f0d-90e4-467e-8f8f-04a7eb6dbac3 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:25.285066 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e6664f0d-90e4-467e-8f8f-04a7eb6dbac3 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:25.285699 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e6664f0d-90e4-467e-8f8f-04a7eb6dbac3 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:25.286667 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e6664f0d-90e4-467e-8f8f-04a7eb6dbac3 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:25.287288 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e6664f0d-90e4-467e-8f8f-04a7eb6dbac3 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:25.287918 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e6664f0d-90e4-467e-8f8f-04a7eb6dbac3 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:25.482556 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-a9b393ab-7384-4d66-8635-e1f5e3f9123c tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:02:25.482556 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-a9b393ab-7384-4d66-8635-e1f5e3f9123c tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] [instance: 0e762f82-ada3-411d-9072-37e72381145d] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:02:25.496838 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:SELECT=62,nova_api:DELETE=2,nova_api:INSERT=1 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:02:25.521932 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a9b393ab-7384-4d66-8635-e1f5e3f9123c tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:25.524704 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a9b393ab-7384-4d66-8635-e1f5e3f9123c tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:25.525180 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a9b393ab-7384-4d66-8635-e1f5e3f9123c tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:25.527027 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a9b393ab-7384-4d66-8635-e1f5e3f9123c tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:25.527516 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a9b393ab-7384-4d66-8635-e1f5e3f9123c tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:25.527960 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a9b393ab-7384-4d66-8635-e1f5e3f9123c tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:25.763878 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-e6664f0d-90e4-467e-8f8f-04a7eb6dbac3 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:02:25.781076 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-e6664f0d-90e4-467e-8f8f-04a7eb6dbac3 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/d7f3a7bd-a731-45de-a24b-e04e9d81358d" status: 200 len: 1538 microversion: 2.1 time: 0.536193 Oct 08 21:02:25.784656 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1304/2586] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:02:25 2022] GET /compute/v2.1/servers/d7f3a7bd-a731-45de-a24b-e04e9d81358d => generated 1538 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:02:25.786724 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-341ab678-9bbd-4c22-82a4-0beb59047886 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:02:25.787858 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-341ab678-9bbd-4c22-82a4-0beb59047886 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] [instance: 4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:02:25.803381 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-341ab678-9bbd-4c22-82a4-0beb59047886 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:25.804545 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-341ab678-9bbd-4c22-82a4-0beb59047886 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:25.808009 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-341ab678-9bbd-4c22-82a4-0beb59047886 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:25.810847 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-341ab678-9bbd-4c22-82a4-0beb59047886 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:25.812718 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-341ab678-9bbd-4c22-82a4-0beb59047886 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:25.817078 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-341ab678-9bbd-4c22-82a4-0beb59047886 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:26.215103 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-a9b393ab-7384-4d66-8635-e1f5e3f9123c tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f60e33f334465fac1148669de3f00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4735bf74f33a4739800d766c82d973d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:02:26.239121 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-a9b393ab-7384-4d66-8635-e1f5e3f9123c tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] 10.222.0.26 "GET /compute/v2.1/servers/0e762f82-ada3-411d-9072-37e72381145d" status: 200 len: 1312 microversion: 2.1 time: 0.768711 Oct 08 21:02:26.244423 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1283/2587] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:02:25 2022] GET /compute/v2.1/servers/0e762f82-ada3-411d-9072-37e72381145d => generated 1312 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:02:26.367703 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-48b8e076-b1b8-407e-ae43-6382895cd78e tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-1785495566", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "networks": [{"uuid": "89cb3a4e-12f8-49ec-9464-0652fc2151e8"}]}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:02:26.480859 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.network.neutron [None req-48b8e076-b1b8-407e-ae43-6382895cd78e tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] validate_networks() for [('89cb3a4e-12f8-49ec-9464-0652fc2151e8', None, None, None, None, None)] {{(pid=140491) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 21:02:26.658178 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-341ab678-9bbd-4c22-82a4-0beb59047886 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1698dee4a2bf4ea19a6ee0c3d5cb5c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b00ee5e7828469f95bd90548d35982a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:02:26.671366 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-341ab678-9bbd-4c22-82a4-0beb59047886 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] 10.222.0.26 "GET /compute/v2.1/servers/4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711" status: 200 len: 1735 microversion: 2.1 time: 0.888243 Oct 08 21:02:26.674312 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1305/2588] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:02:25 2022] GET /compute/v2.1/servers/4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711 => generated 1735 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:02:26.809716 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-50c32bc2-32b8-4e55-80ed-99d3ab3dc370 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:02:26.811489 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-50c32bc2-32b8-4e55-80ed-99d3ab3dc370 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: d7f3a7bd-a731-45de-a24b-e04e9d81358d] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:02:26.824907 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-50c32bc2-32b8-4e55-80ed-99d3ab3dc370 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:26.832813 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-50c32bc2-32b8-4e55-80ed-99d3ab3dc370 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:26.833426 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-50c32bc2-32b8-4e55-80ed-99d3ab3dc370 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:26.834331 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-50c32bc2-32b8-4e55-80ed-99d3ab3dc370 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:26.836338 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-50c32bc2-32b8-4e55-80ed-99d3ab3dc370 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:26.840258 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-50c32bc2-32b8-4e55-80ed-99d3ab3dc370 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:28.645021 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-50c32bc2-32b8-4e55-80ed-99d3ab3dc370 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:02:28.654029 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-50c32bc2-32b8-4e55-80ed-99d3ab3dc370 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/d7f3a7bd-a731-45de-a24b-e04e9d81358d" status: 200 len: 1538 microversion: 2.1 time: 1.852492 Oct 08 21:02:28.654630 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1306/2589] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:02:26 2022] GET /compute/v2.1/servers/d7f3a7bd-a731-45de-a24b-e04e9d81358d => generated 1538 bytes in 1855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:02:28.670205 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-66f5ad3b-e1a7-4323-ab0e-6ba05204da1a tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:02:28.671063 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-66f5ad3b-e1a7-4323-ab0e-6ba05204da1a tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] [instance: 0e762f82-ada3-411d-9072-37e72381145d] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:02:28.677534 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-66f5ad3b-e1a7-4323-ab0e-6ba05204da1a tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:28.678028 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-66f5ad3b-e1a7-4323-ab0e-6ba05204da1a tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:28.678472 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-66f5ad3b-e1a7-4323-ab0e-6ba05204da1a tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:28.679821 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-66f5ad3b-e1a7-4323-ab0e-6ba05204da1a tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:28.680283 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-66f5ad3b-e1a7-4323-ab0e-6ba05204da1a tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:28.680713 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-66f5ad3b-e1a7-4323-ab0e-6ba05204da1a tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:29.015503 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-48b8e076-b1b8-407e-ae43-6382895cd78e tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Flavor limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 21:02:29.015977 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-48b8e076-b1b8-407e-ae43-6382895cd78e tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Image limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 21:02:29.016424 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-48b8e076-b1b8-407e-ae43-6382895cd78e tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Flavor pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 21:02:29.016849 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-48b8e076-b1b8-407e-ae43-6382895cd78e tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Image pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 21:02:29.017406 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-48b8e076-b1b8-407e-ae43-6382895cd78e tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 21:02:29.037334 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-48b8e076-b1b8-407e-ae43-6382895cd78e tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:29.039450 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-48b8e076-b1b8-407e-ae43-6382895cd78e tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:29.040397 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-48b8e076-b1b8-407e-ae43-6382895cd78e tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:29.054443 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-48b8e076-b1b8-407e-ae43-6382895cd78e tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:29.055379 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-48b8e076-b1b8-407e-ae43-6382895cd78e tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:29.056094 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-48b8e076-b1b8-407e-ae43-6382895cd78e tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:29.095238 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-48b8e076-b1b8-407e-ae43-6382895cd78e tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Getting quotas for project 2f51fe43d7c143ebb6d53f5942941c9d. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:02:29.111649 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-48b8e076-b1b8-407e-ae43-6382895cd78e tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Getting quotas for user 95cfeacf062f486c985ca772f2f36faf and project 2f51fe43d7c143ebb6d53f5942941c9d. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:02:29.154479 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-48b8e076-b1b8-407e-ae43-6382895cd78e tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Going to run 1 instances... {{(pid=140491) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 21:02:29.156826 ncdv-master-1 devstack@n-api.service[140491]: WARNING nova.utils [None req-48b8e076-b1b8-407e-ae43-6382895cd78e tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Hostname tempest-FloatingIPsAssociationNegativeTestJSON-server-1785495566 is longer than 63, truncate it to tempest-FloatingIPsAssociationNegativeTestJSON-server-178549556 Oct 08 21:02:29.168167 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-48b8e076-b1b8-407e-ae43-6382895cd78e tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] [instance: 50a243fc-ec9e-4e15-a0c6-240c525af882] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c508bd7f-7db9-4b2c-af7c-be54a855c355',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140491) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 21:02:29.293855 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-48b8e076-b1b8-407e-ae43-6382895cd78e tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.024673 Oct 08 21:02:29.295060 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1284/2590] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 21:02:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 3032 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 08 21:02:29.312812 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-b6761b99-1668-460f-8b0b-2bd217128615 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:02:29.313817 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-b6761b99-1668-460f-8b0b-2bd217128615 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] [instance: 4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:02:29.328948 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b6761b99-1668-460f-8b0b-2bd217128615 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:29.331285 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b6761b99-1668-460f-8b0b-2bd217128615 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:29.332036 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b6761b99-1668-460f-8b0b-2bd217128615 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:29.336333 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b6761b99-1668-460f-8b0b-2bd217128615 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:29.337086 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b6761b99-1668-460f-8b0b-2bd217128615 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:29.345651 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b6761b99-1668-460f-8b0b-2bd217128615 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:29.793120 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-b6761b99-1668-460f-8b0b-2bd217128615 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1698dee4a2bf4ea19a6ee0c3d5cb5c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b00ee5e7828469f95bd90548d35982a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:02:29.808037 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-b6761b99-1668-460f-8b0b-2bd217128615 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] 10.222.0.26 "GET /compute/v2.1/servers/4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711" status: 200 len: 1735 microversion: 2.1 time: 0.499010 Oct 08 21:02:29.817273 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1285/2591] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:02:29 2022] GET /compute/v2.1/servers/4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711 => generated 1735 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:02:29.817273 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-957724b8-f967-47e4-b392-9c9d30aab22c tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:02:29.817273 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-957724b8-f967-47e4-b392-9c9d30aab22c tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] [instance: 50a243fc-ec9e-4e15-a0c6-240c525af882] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:02:29.978364 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-957724b8-f967-47e4-b392-9c9d30aab22c tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95cfeacf062f486c985ca772f2f36faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f51fe43d7c143ebb6d53f5942941c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:02:29.991893 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-957724b8-f967-47e4-b392-9c9d30aab22c tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] 10.222.0.26 "GET /compute/v2.1/servers/50a243fc-ec9e-4e15-a0c6-240c525af882" status: 200 len: 1232 microversion: 2.1 time: 0.181798 Oct 08 21:02:29.992500 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1286/2592] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:02:29 2022] GET /compute/v2.1/servers/50a243fc-ec9e-4e15-a0c6-240c525af882 => generated 1232 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:02:30.026547 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-a3abeebe-2f70-40d4-a1dd-08431a00d5bb tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:02:30.028047 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-a3abeebe-2f70-40d4-a1dd-08431a00d5bb tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: d7f3a7bd-a731-45de-a24b-e04e9d81358d] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:02:30.041568 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a3abeebe-2f70-40d4-a1dd-08431a00d5bb tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:30.042300 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a3abeebe-2f70-40d4-a1dd-08431a00d5bb tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:30.043115 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a3abeebe-2f70-40d4-a1dd-08431a00d5bb tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:30.048469 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a3abeebe-2f70-40d4-a1dd-08431a00d5bb tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:30.049063 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a3abeebe-2f70-40d4-a1dd-08431a00d5bb tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:30.049611 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a3abeebe-2f70-40d4-a1dd-08431a00d5bb tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:30.175252 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=2 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:02:30.209134 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=6 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:02:30.231736 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-66f5ad3b-e1a7-4323-ab0e-6ba05204da1a tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f60e33f334465fac1148669de3f00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4735bf74f33a4739800d766c82d973d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:02:30.246063 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-66f5ad3b-e1a7-4323-ab0e-6ba05204da1a tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] 10.222.0.26 "GET /compute/v2.1/servers/0e762f82-ada3-411d-9072-37e72381145d" status: 200 len: 1312 microversion: 2.1 time: 1.585321 Oct 08 21:02:30.246785 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1307/2593] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:02:28 2022] GET /compute/v2.1/servers/0e762f82-ada3-411d-9072-37e72381145d => generated 1312 bytes in 1587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:02:30.836256 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-c9d8a7fc-2835-4483-bd8f-d19de08fefd1 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:02:30.837346 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-c9d8a7fc-2835-4483-bd8f-d19de08fefd1 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] [instance: 4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:02:30.853078 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c9d8a7fc-2835-4483-bd8f-d19de08fefd1 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:30.854296 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c9d8a7fc-2835-4483-bd8f-d19de08fefd1 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:30.854864 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c9d8a7fc-2835-4483-bd8f-d19de08fefd1 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:30.856214 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c9d8a7fc-2835-4483-bd8f-d19de08fefd1 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:30.856810 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c9d8a7fc-2835-4483-bd8f-d19de08fefd1 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:30.858602 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c9d8a7fc-2835-4483-bd8f-d19de08fefd1 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:30.960735 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-a3abeebe-2f70-40d4-a1dd-08431a00d5bb tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:02:30.972223 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-a3abeebe-2f70-40d4-a1dd-08431a00d5bb tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/d7f3a7bd-a731-45de-a24b-e04e9d81358d" status: 200 len: 1538 microversion: 2.1 time: 0.959151 Oct 08 21:02:30.978614 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1287/2594] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:02:30 2022] GET /compute/v2.1/servers/d7f3a7bd-a731-45de-a24b-e04e9d81358d => generated 1538 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:02:31.019359 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-dac820c3-371b-4741-a3f2-9d991adab7c9 tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:02:31.020227 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-dac820c3-371b-4741-a3f2-9d991adab7c9 tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] [instance: 50a243fc-ec9e-4e15-a0c6-240c525af882] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:02:31.031618 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dac820c3-371b-4741-a3f2-9d991adab7c9 tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:31.033335 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dac820c3-371b-4741-a3f2-9d991adab7c9 tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:31.033927 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dac820c3-371b-4741-a3f2-9d991adab7c9 tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:31.034779 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dac820c3-371b-4741-a3f2-9d991adab7c9 tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:31.038093 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dac820c3-371b-4741-a3f2-9d991adab7c9 tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:31.038858 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dac820c3-371b-4741-a3f2-9d991adab7c9 tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:31.108877 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:02:31.234254 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-dac820c3-371b-4741-a3f2-9d991adab7c9 tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95cfeacf062f486c985ca772f2f36faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f51fe43d7c143ebb6d53f5942941c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:02:31.243591 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-dac820c3-371b-4741-a3f2-9d991adab7c9 tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] 10.222.0.26 "GET /compute/v2.1/servers/50a243fc-ec9e-4e15-a0c6-240c525af882" status: 200 len: 1284 microversion: 2.1 time: 0.228296 Oct 08 21:02:31.262068 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1288/2595] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:02:31 2022] GET /compute/v2.1/servers/50a243fc-ec9e-4e15-a0c6-240c525af882 => generated 1284 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:02:31.275378 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-cf7a37bf-2039-4a18-b021-bfe87019985c tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:02:31.276441 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-cf7a37bf-2039-4a18-b021-bfe87019985c tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] [instance: 0e762f82-ada3-411d-9072-37e72381145d] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:02:31.293491 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cf7a37bf-2039-4a18-b021-bfe87019985c tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:31.294178 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cf7a37bf-2039-4a18-b021-bfe87019985c tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:31.301129 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cf7a37bf-2039-4a18-b021-bfe87019985c tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:31.302347 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cf7a37bf-2039-4a18-b021-bfe87019985c tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:31.303067 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cf7a37bf-2039-4a18-b021-bfe87019985c tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:31.303695 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cf7a37bf-2039-4a18-b021-bfe87019985c tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:31.431106 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-c9d8a7fc-2835-4483-bd8f-d19de08fefd1 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1698dee4a2bf4ea19a6ee0c3d5cb5c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b00ee5e7828469f95bd90548d35982a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:02:31.449572 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-c9d8a7fc-2835-4483-bd8f-d19de08fefd1 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] 10.222.0.26 "GET /compute/v2.1/servers/4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711" status: 200 len: 1735 microversion: 2.1 time: 0.617575 Oct 08 21:02:31.465324 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1308/2596] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:02:30 2022] GET /compute/v2.1/servers/4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711 => generated 1735 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:02:31.988644 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-9861425e-4bbb-48cb-bb2a-d78e5b420254 tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-94941950", "imageRef": "fff2e6cd-f3b8-4182-86d5-e13ce81498e2", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "feaf06b2-18f3-4b74-82ad-5911e4219f9d"}], "security_groups": [{"name": "tempest-securitygroup--1465921299"}], "key_name": "tempest-keypair-907560983", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:02:32.352965 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.network.neutron [None req-9861425e-4bbb-48cb-bb2a-d78e5b420254 tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] validate_networks() for [('feaf06b2-18f3-4b74-82ad-5911e4219f9d', None, None, None, None, None)] {{(pid=140492) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 21:02:32.378916 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-cf7a37bf-2039-4a18-b021-bfe87019985c tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f60e33f334465fac1148669de3f00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4735bf74f33a4739800d766c82d973d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:02:32.453748 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-cf7a37bf-2039-4a18-b021-bfe87019985c tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] 10.222.0.26 "GET /compute/v2.1/servers/0e762f82-ada3-411d-9072-37e72381145d" status: 200 len: 1312 microversion: 2.1 time: 1.183427 Oct 08 21:02:32.457478 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1289/2597] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:02:31 2022] GET /compute/v2.1/servers/0e762f82-ada3-411d-9072-37e72381145d => generated 1312 bytes in 1188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:02:32.474828 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-4b64b786-5e50-4546-a8f5-8ba5af6f716d tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:02:32.477903 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-4b64b786-5e50-4546-a8f5-8ba5af6f716d tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: d7f3a7bd-a731-45de-a24b-e04e9d81358d] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:02:32.505766 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4b64b786-5e50-4546-a8f5-8ba5af6f716d tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:32.509296 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4b64b786-5e50-4546-a8f5-8ba5af6f716d tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:32.509935 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4b64b786-5e50-4546-a8f5-8ba5af6f716d tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:32.514323 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4b64b786-5e50-4546-a8f5-8ba5af6f716d tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:32.516204 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4b64b786-5e50-4546-a8f5-8ba5af6f716d tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:32.517251 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4b64b786-5e50-4546-a8f5-8ba5af6f716d tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:33.169685 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-4b64b786-5e50-4546-a8f5-8ba5af6f716d tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:02:33.180158 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-4b64b786-5e50-4546-a8f5-8ba5af6f716d tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/d7f3a7bd-a731-45de-a24b-e04e9d81358d" status: 200 len: 1543 microversion: 2.1 time: 0.718710 Oct 08 21:02:33.189780 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1290/2598] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:02:32 2022] GET /compute/v2.1/servers/d7f3a7bd-a731-45de-a24b-e04e9d81358d => generated 1543 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:02:33.198846 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-90f88d13-51dd-4ae2-b028-38f253ac528b tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:02:33.212000 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-90f88d13-51dd-4ae2-b028-38f253ac528b tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] [instance: 50a243fc-ec9e-4e15-a0c6-240c525af882] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:02:33.236873 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-90f88d13-51dd-4ae2-b028-38f253ac528b tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:33.238145 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-90f88d13-51dd-4ae2-b028-38f253ac528b tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:33.238896 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-90f88d13-51dd-4ae2-b028-38f253ac528b tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:33.240651 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-90f88d13-51dd-4ae2-b028-38f253ac528b tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:33.242182 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-90f88d13-51dd-4ae2-b028-38f253ac528b tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:33.250759 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-90f88d13-51dd-4ae2-b028-38f253ac528b tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:33.521989 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-90f88d13-51dd-4ae2-b028-38f253ac528b tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95cfeacf062f486c985ca772f2f36faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f51fe43d7c143ebb6d53f5942941c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:02:33.533114 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-90f88d13-51dd-4ae2-b028-38f253ac528b tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] 10.222.0.26 "GET /compute/v2.1/servers/50a243fc-ec9e-4e15-a0c6-240c525af882" status: 200 len: 1290 microversion: 2.1 time: 0.338777 Oct 08 21:02:33.549731 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1291/2599] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:02:33 2022] GET /compute/v2.1/servers/50a243fc-ec9e-4e15-a0c6-240c525af882 => generated 1290 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:02:33.554980 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-deebcbf4-cee9-4450-ab2f-8dc378f1792a tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:02:33.555830 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-deebcbf4-cee9-4450-ab2f-8dc378f1792a tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] [instance: 4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:02:33.562375 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-deebcbf4-cee9-4450-ab2f-8dc378f1792a tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:33.563079 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-deebcbf4-cee9-4450-ab2f-8dc378f1792a tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:33.563709 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-deebcbf4-cee9-4450-ab2f-8dc378f1792a tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:33.564608 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-deebcbf4-cee9-4450-ab2f-8dc378f1792a tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:33.565248 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-deebcbf4-cee9-4450-ab2f-8dc378f1792a tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:33.565840 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-deebcbf4-cee9-4450-ab2f-8dc378f1792a tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:34.262159 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-deebcbf4-cee9-4450-ab2f-8dc378f1792a tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1698dee4a2bf4ea19a6ee0c3d5cb5c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b00ee5e7828469f95bd90548d35982a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:02:34.275026 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-deebcbf4-cee9-4450-ab2f-8dc378f1792a tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] 10.222.0.26 "GET /compute/v2.1/servers/4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711" status: 200 len: 1735 microversion: 2.1 time: 0.723857 Oct 08 21:02:34.275726 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1292/2600] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:02:33 2022] GET /compute/v2.1/servers/4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711 => generated 1735 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:02:34.296785 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-a4c07c00-8232-493e-8c39-81b35e2321f3 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:02:34.297643 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-a4c07c00-8232-493e-8c39-81b35e2321f3 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] [instance: 0e762f82-ada3-411d-9072-37e72381145d] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:02:34.312199 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a4c07c00-8232-493e-8c39-81b35e2321f3 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:34.316805 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a4c07c00-8232-493e-8c39-81b35e2321f3 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:34.317490 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a4c07c00-8232-493e-8c39-81b35e2321f3 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:34.318366 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a4c07c00-8232-493e-8c39-81b35e2321f3 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:34.325113 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a4c07c00-8232-493e-8c39-81b35e2321f3 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:34.325764 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a4c07c00-8232-493e-8c39-81b35e2321f3 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:34.635513 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-9861425e-4bbb-48cb-bb2a-d78e5b420254 tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Flavor limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 21:02:34.636885 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-9861425e-4bbb-48cb-bb2a-d78e5b420254 tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Image limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 21:02:34.637753 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-9861425e-4bbb-48cb-bb2a-d78e5b420254 tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Flavor pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 21:02:34.638526 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-9861425e-4bbb-48cb-bb2a-d78e5b420254 tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Image pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 21:02:34.639144 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-9861425e-4bbb-48cb-bb2a-d78e5b420254 tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 21:02:34.659454 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9861425e-4bbb-48cb-bb2a-d78e5b420254 tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:34.661552 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9861425e-4bbb-48cb-bb2a-d78e5b420254 tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:34.664072 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9861425e-4bbb-48cb-bb2a-d78e5b420254 tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:34.666254 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9861425e-4bbb-48cb-bb2a-d78e5b420254 tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:34.669178 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9861425e-4bbb-48cb-bb2a-d78e5b420254 tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:34.669884 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9861425e-4bbb-48cb-bb2a-d78e5b420254 tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:34.715726 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-9861425e-4bbb-48cb-bb2a-d78e5b420254 tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Getting quotas for project 9e0310d9e59942729d685e6eb06c6460. Resources: {'cores', 'instances', 'ram'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:02:34.724342 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-9861425e-4bbb-48cb-bb2a-d78e5b420254 tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Getting quotas for user 5e3216124a4f41b2b931a16c750649df and project 9e0310d9e59942729d685e6eb06c6460. Resources: {'cores', 'instances', 'ram'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:02:34.774000 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-9861425e-4bbb-48cb-bb2a-d78e5b420254 tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Going to run 1 instances... {{(pid=140492) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 21:02:34.779362 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-9861425e-4bbb-48cb-bb2a-d78e5b420254 tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] [instance: 401433a8-84ff-4525-9a86-c0b6a517eeb3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fff2e6cd-f3b8-4182-86d5-e13ce81498e2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140492) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 21:02:34.865532 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-9861425e-4bbb-48cb-bb2a-d78e5b420254 tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.880366 Oct 08 21:02:34.866955 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1309/2601] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 21:02:31 2022] POST /compute/v2.1/servers => generated 406 bytes in 2883 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 08 21:02:34.872666 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-d129b4ed-9c3d-428c-b44d-70a9d5e116c6 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:02:34.873547 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-d129b4ed-9c3d-428c-b44d-70a9d5e116c6 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: d7f3a7bd-a731-45de-a24b-e04e9d81358d] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:02:34.883085 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d129b4ed-9c3d-428c-b44d-70a9d5e116c6 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:34.883832 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d129b4ed-9c3d-428c-b44d-70a9d5e116c6 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:34.885228 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d129b4ed-9c3d-428c-b44d-70a9d5e116c6 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:34.886154 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d129b4ed-9c3d-428c-b44d-70a9d5e116c6 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:34.886907 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d129b4ed-9c3d-428c-b44d-70a9d5e116c6 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:34.887503 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d129b4ed-9c3d-428c-b44d-70a9d5e116c6 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:36.015042 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-d129b4ed-9c3d-428c-b44d-70a9d5e116c6 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:02:36.032001 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-d129b4ed-9c3d-428c-b44d-70a9d5e116c6 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/d7f3a7bd-a731-45de-a24b-e04e9d81358d" status: 200 len: 1543 microversion: 2.1 time: 1.163712 Oct 08 21:02:36.047981 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1310/2602] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:02:34 2022] GET /compute/v2.1/servers/d7f3a7bd-a731-45de-a24b-e04e9d81358d => generated 1543 bytes in 1180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:02:36.059315 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-22e3d36c-cfdc-46fd-a787-8e1e9966302a tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:02:36.060188 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-22e3d36c-cfdc-46fd-a787-8e1e9966302a tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] [instance: 50a243fc-ec9e-4e15-a0c6-240c525af882] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:02:36.068936 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-22e3d36c-cfdc-46fd-a787-8e1e9966302a tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:36.070385 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-22e3d36c-cfdc-46fd-a787-8e1e9966302a tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:36.071073 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-22e3d36c-cfdc-46fd-a787-8e1e9966302a tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:36.072078 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-22e3d36c-cfdc-46fd-a787-8e1e9966302a tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:36.073396 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-22e3d36c-cfdc-46fd-a787-8e1e9966302a tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:36.075063 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-22e3d36c-cfdc-46fd-a787-8e1e9966302a tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:36.361575 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-a4c07c00-8232-493e-8c39-81b35e2321f3 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f60e33f334465fac1148669de3f00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4735bf74f33a4739800d766c82d973d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:02:36.378990 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-a4c07c00-8232-493e-8c39-81b35e2321f3 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] 10.222.0.26 "GET /compute/v2.1/servers/0e762f82-ada3-411d-9072-37e72381145d" status: 200 len: 1333 microversion: 2.1 time: 2.092795 Oct 08 21:02:36.400409 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1293/2603] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:02:34 2022] GET /compute/v2.1/servers/0e762f82-ada3-411d-9072-37e72381145d => generated 1333 bytes in 2110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:02:36.401444 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-eb8c9ba0-6b00-491b-a4d0-15e2d21b65b2 tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:02:36.404082 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-eb8c9ba0-6b00-491b-a4d0-15e2d21b65b2 tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] [instance: 401433a8-84ff-4525-9a86-c0b6a517eeb3] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:02:36.422645 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-eb8c9ba0-6b00-491b-a4d0-15e2d21b65b2 tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:36.423399 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-eb8c9ba0-6b00-491b-a4d0-15e2d21b65b2 tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:36.424085 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-eb8c9ba0-6b00-491b-a4d0-15e2d21b65b2 tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:36.425418 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-eb8c9ba0-6b00-491b-a4d0-15e2d21b65b2 tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:36.426103 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-eb8c9ba0-6b00-491b-a4d0-15e2d21b65b2 tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:36.426752 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-eb8c9ba0-6b00-491b-a4d0-15e2d21b65b2 tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:36.631160 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-22e3d36c-cfdc-46fd-a787-8e1e9966302a tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95cfeacf062f486c985ca772f2f36faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f51fe43d7c143ebb6d53f5942941c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:02:36.645502 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-22e3d36c-cfdc-46fd-a787-8e1e9966302a tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] 10.222.0.26 "GET /compute/v2.1/servers/50a243fc-ec9e-4e15-a0c6-240c525af882" status: 200 len: 1332 microversion: 2.1 time: 0.596045 Oct 08 21:02:36.649325 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1311/2604] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:02:36 2022] GET /compute/v2.1/servers/50a243fc-ec9e-4e15-a0c6-240c525af882 => generated 1332 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:02:36.657662 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-a099973d-bdb8-4e38-968d-110551feede0 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:02:36.659602 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-a099973d-bdb8-4e38-968d-110551feede0 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] [instance: 4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:02:36.675809 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a099973d-bdb8-4e38-968d-110551feede0 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:36.688612 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a099973d-bdb8-4e38-968d-110551feede0 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:36.689745 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a099973d-bdb8-4e38-968d-110551feede0 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:36.691487 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a099973d-bdb8-4e38-968d-110551feede0 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:36.692483 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a099973d-bdb8-4e38-968d-110551feede0 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:36.693578 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a099973d-bdb8-4e38-968d-110551feede0 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:36.738603 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-eb8c9ba0-6b00-491b-a4d0-15e2d21b65b2 tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e3216124a4f41b2b931a16c750649df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0310d9e59942729d685e6eb06c6460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:02:36.755462 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-eb8c9ba0-6b00-491b-a4d0-15e2d21b65b2 tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] 10.222.0.26 "GET /compute/v2.1/servers/401433a8-84ff-4525-9a86-c0b6a517eeb3" status: 200 len: 1295 microversion: 2.1 time: 0.363904 Oct 08 21:02:36.769220 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1294/2605] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:02:36 2022] GET /compute/v2.1/servers/401433a8-84ff-4525-9a86-c0b6a517eeb3 => generated 1295 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:02:36.976015 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-a099973d-bdb8-4e38-968d-110551feede0 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1698dee4a2bf4ea19a6ee0c3d5cb5c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b00ee5e7828469f95bd90548d35982a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:02:36.989162 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-a099973d-bdb8-4e38-968d-110551feede0 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] 10.222.0.26 "GET /compute/v2.1/servers/4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711" status: 200 len: 1735 microversion: 2.1 time: 0.336578 Oct 08 21:02:36.995741 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1312/2606] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:02:36 2022] GET /compute/v2.1/servers/4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711 => generated 1735 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:02:37.062954 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-17416a60-96a1-47bb-9a08-ad6102de29b1 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:02:37.063572 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-17416a60-96a1-47bb-9a08-ad6102de29b1 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: d7f3a7bd-a731-45de-a24b-e04e9d81358d] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:02:37.081313 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-17416a60-96a1-47bb-9a08-ad6102de29b1 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:37.082151 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-17416a60-96a1-47bb-9a08-ad6102de29b1 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:37.082760 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-17416a60-96a1-47bb-9a08-ad6102de29b1 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:37.083523 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-17416a60-96a1-47bb-9a08-ad6102de29b1 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:37.084318 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-17416a60-96a1-47bb-9a08-ad6102de29b1 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:37.085024 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-17416a60-96a1-47bb-9a08-ad6102de29b1 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:37.416422 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-96059306-0772-4c3e-82a8-ea75d57fa95c tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:02:37.417614 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-96059306-0772-4c3e-82a8-ea75d57fa95c tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] [instance: 0e762f82-ada3-411d-9072-37e72381145d] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:02:37.430287 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-96059306-0772-4c3e-82a8-ea75d57fa95c tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:37.436892 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-96059306-0772-4c3e-82a8-ea75d57fa95c tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:37.440054 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-96059306-0772-4c3e-82a8-ea75d57fa95c tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:37.441226 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-96059306-0772-4c3e-82a8-ea75d57fa95c tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:37.442526 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-96059306-0772-4c3e-82a8-ea75d57fa95c tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:37.445895 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-96059306-0772-4c3e-82a8-ea75d57fa95c tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:37.795983 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-96059306-0772-4c3e-82a8-ea75d57fa95c tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f60e33f334465fac1148669de3f00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4735bf74f33a4739800d766c82d973d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:02:37.806264 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-96059306-0772-4c3e-82a8-ea75d57fa95c tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] 10.222.0.26 "GET /compute/v2.1/servers/0e762f82-ada3-411d-9072-37e72381145d" status: 200 len: 1354 microversion: 2.1 time: 0.402242 Oct 08 21:02:37.816219 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1313/2607] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:02:37 2022] GET /compute/v2.1/servers/0e762f82-ada3-411d-9072-37e72381145d => generated 1354 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:02:37.826393 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-f481e931-2c2a-4aee-9d44-5214f89572e7 tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:02:37.827025 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-f481e931-2c2a-4aee-9d44-5214f89572e7 tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] [instance: 50a243fc-ec9e-4e15-a0c6-240c525af882] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:02:37.842580 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f481e931-2c2a-4aee-9d44-5214f89572e7 tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:37.843039 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f481e931-2c2a-4aee-9d44-5214f89572e7 tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:37.843737 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f481e931-2c2a-4aee-9d44-5214f89572e7 tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:37.844766 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f481e931-2c2a-4aee-9d44-5214f89572e7 tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:37.845743 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f481e931-2c2a-4aee-9d44-5214f89572e7 tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:37.846203 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f481e931-2c2a-4aee-9d44-5214f89572e7 tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:37.889101 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-17416a60-96a1-47bb-9a08-ad6102de29b1 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:02:37.901335 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-17416a60-96a1-47bb-9a08-ad6102de29b1 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/d7f3a7bd-a731-45de-a24b-e04e9d81358d" status: 200 len: 1543 microversion: 2.1 time: 0.837815 Oct 08 21:02:37.917814 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1295/2608] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:02:37 2022] GET /compute/v2.1/servers/d7f3a7bd-a731-45de-a24b-e04e9d81358d => generated 1543 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:02:37.923043 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-1bbcdbdf-2506-4ede-920f-5aa762903182 tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:02:37.923912 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-1bbcdbdf-2506-4ede-920f-5aa762903182 tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] [instance: 401433a8-84ff-4525-9a86-c0b6a517eeb3] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:02:37.930947 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1bbcdbdf-2506-4ede-920f-5aa762903182 tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:37.931767 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1bbcdbdf-2506-4ede-920f-5aa762903182 tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:37.932419 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1bbcdbdf-2506-4ede-920f-5aa762903182 tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:37.933317 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1bbcdbdf-2506-4ede-920f-5aa762903182 tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:37.933977 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1bbcdbdf-2506-4ede-920f-5aa762903182 tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:37.934599 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1bbcdbdf-2506-4ede-920f-5aa762903182 tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:38.437763 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-1bbcdbdf-2506-4ede-920f-5aa762903182 tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e3216124a4f41b2b931a16c750649df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0310d9e59942729d685e6eb06c6460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:02:38.453957 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-1bbcdbdf-2506-4ede-920f-5aa762903182 tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] 10.222.0.26 "GET /compute/v2.1/servers/401433a8-84ff-4525-9a86-c0b6a517eeb3" status: 200 len: 1301 microversion: 2.1 time: 0.534894 Oct 08 21:02:38.454607 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1296/2609] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:02:37 2022] GET /compute/v2.1/servers/401433a8-84ff-4525-9a86-c0b6a517eeb3 => generated 1301 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:02:38.460017 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c0c57cf4-89d7-453e-8f2c-5928a219ba23 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:02:38.460793 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-c0c57cf4-89d7-453e-8f2c-5928a219ba23 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] [instance: 4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:02:38.474951 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c0c57cf4-89d7-453e-8f2c-5928a219ba23 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:38.485244 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c0c57cf4-89d7-453e-8f2c-5928a219ba23 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:38.485932 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c0c57cf4-89d7-453e-8f2c-5928a219ba23 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:38.486854 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c0c57cf4-89d7-453e-8f2c-5928a219ba23 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:38.487473 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c0c57cf4-89d7-453e-8f2c-5928a219ba23 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:38.488071 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c0c57cf4-89d7-453e-8f2c-5928a219ba23 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:38.610591 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-f481e931-2c2a-4aee-9d44-5214f89572e7 tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95cfeacf062f486c985ca772f2f36faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f51fe43d7c143ebb6d53f5942941c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:02:38.621241 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-f481e931-2c2a-4aee-9d44-5214f89572e7 tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] 10.222.0.26 "GET /compute/v2.1/servers/50a243fc-ec9e-4e15-a0c6-240c525af882" status: 200 len: 1332 microversion: 2.1 time: 0.803695 Oct 08 21:02:38.630468 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1314/2610] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:02:37 2022] GET /compute/v2.1/servers/50a243fc-ec9e-4e15-a0c6-240c525af882 => generated 1332 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:02:38.832790 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-ee1593e6-1ffd-4211-9be0-c99e096a1764 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:02:38.833724 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-ee1593e6-1ffd-4211-9be0-c99e096a1764 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] [instance: 0e762f82-ada3-411d-9072-37e72381145d] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:02:38.849523 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ee1593e6-1ffd-4211-9be0-c99e096a1764 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:38.854017 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ee1593e6-1ffd-4211-9be0-c99e096a1764 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:38.854805 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ee1593e6-1ffd-4211-9be0-c99e096a1764 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:38.865993 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ee1593e6-1ffd-4211-9be0-c99e096a1764 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:38.868015 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ee1593e6-1ffd-4211-9be0-c99e096a1764 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:38.868704 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ee1593e6-1ffd-4211-9be0-c99e096a1764 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:39.074512 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=2 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:02:39.696950 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-ee1593e6-1ffd-4211-9be0-c99e096a1764 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f60e33f334465fac1148669de3f00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4735bf74f33a4739800d766c82d973d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:02:39.708122 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-ee1593e6-1ffd-4211-9be0-c99e096a1764 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] 10.222.0.26 "GET /compute/v2.1/servers/0e762f82-ada3-411d-9072-37e72381145d" status: 200 len: 1354 microversion: 2.1 time: 0.883061 Oct 08 21:02:39.714219 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1315/2611] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:02:38 2022] GET /compute/v2.1/servers/0e762f82-ada3-411d-9072-37e72381145d => generated 1354 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:02:39.726051 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-f00ff3b2-053b-4a4b-a4cf-9f409d804ac5 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:02:39.732567 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-f00ff3b2-053b-4a4b-a4cf-9f409d804ac5 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: d7f3a7bd-a731-45de-a24b-e04e9d81358d] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:02:39.747348 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f00ff3b2-053b-4a4b-a4cf-9f409d804ac5 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:39.750153 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f00ff3b2-053b-4a4b-a4cf-9f409d804ac5 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:39.750744 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f00ff3b2-053b-4a4b-a4cf-9f409d804ac5 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:39.751649 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f00ff3b2-053b-4a4b-a4cf-9f409d804ac5 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:39.753499 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f00ff3b2-053b-4a4b-a4cf-9f409d804ac5 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:39.754919 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f00ff3b2-053b-4a4b-a4cf-9f409d804ac5 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:39.862578 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-c0c57cf4-89d7-453e-8f2c-5928a219ba23 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1698dee4a2bf4ea19a6ee0c3d5cb5c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b00ee5e7828469f95bd90548d35982a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:02:39.894570 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-c0c57cf4-89d7-453e-8f2c-5928a219ba23 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] 10.222.0.26 "GET /compute/v2.1/servers/4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711" status: 200 len: 1735 microversion: 2.1 time: 1.419021 Oct 08 21:02:39.901441 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1297/2612] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:02:38 2022] GET /compute/v2.1/servers/4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711 => generated 1735 bytes in 1445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:02:39.920361 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-a729957e-f4c5-4062-a4b5-cb41f4724226 tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:02:39.923069 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-a729957e-f4c5-4062-a4b5-cb41f4724226 tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] [instance: 401433a8-84ff-4525-9a86-c0b6a517eeb3] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:02:39.942962 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a729957e-f4c5-4062-a4b5-cb41f4724226 tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:39.946422 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a729957e-f4c5-4062-a4b5-cb41f4724226 tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:39.947724 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a729957e-f4c5-4062-a4b5-cb41f4724226 tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:39.951331 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a729957e-f4c5-4062-a4b5-cb41f4724226 tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:39.953875 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a729957e-f4c5-4062-a4b5-cb41f4724226 tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:39.954922 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a729957e-f4c5-4062-a4b5-cb41f4724226 tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:40.059467 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=14 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:02:40.906664 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-a729957e-f4c5-4062-a4b5-cb41f4724226 tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e3216124a4f41b2b931a16c750649df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0310d9e59942729d685e6eb06c6460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:02:40.918425 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-a729957e-f4c5-4062-a4b5-cb41f4724226 tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] 10.222.0.26 "GET /compute/v2.1/servers/401433a8-84ff-4525-9a86-c0b6a517eeb3" status: 200 len: 1369 microversion: 2.1 time: 1.011025 Oct 08 21:02:40.933624 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1298/2613] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:02:39 2022] GET /compute/v2.1/servers/401433a8-84ff-4525-9a86-c0b6a517eeb3 => generated 1369 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:02:40.940538 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-32cab6c9-c8b1-4514-ac83-6a19310f8569 tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:02:40.941590 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-32cab6c9-c8b1-4514-ac83-6a19310f8569 tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] [instance: 50a243fc-ec9e-4e15-a0c6-240c525af882] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:02:40.953881 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-32cab6c9-c8b1-4514-ac83-6a19310f8569 tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:40.954797 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-32cab6c9-c8b1-4514-ac83-6a19310f8569 tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:40.955481 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-32cab6c9-c8b1-4514-ac83-6a19310f8569 tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:40.956561 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-32cab6c9-c8b1-4514-ac83-6a19310f8569 tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:40.967047 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-32cab6c9-c8b1-4514-ac83-6a19310f8569 tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:40.968029 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-32cab6c9-c8b1-4514-ac83-6a19310f8569 tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:41.360000 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-f00ff3b2-053b-4a4b-a4cf-9f409d804ac5 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:02:41.373724 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-f00ff3b2-053b-4a4b-a4cf-9f409d804ac5 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/d7f3a7bd-a731-45de-a24b-e04e9d81358d" status: 200 len: 1543 microversion: 2.1 time: 1.658023 Oct 08 21:02:41.377055 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1316/2614] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:02:39 2022] GET /compute/v2.1/servers/d7f3a7bd-a731-45de-a24b-e04e9d81358d => generated 1543 bytes in 1662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:02:41.407265 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-c1076b02-4507-4a88-9be6-bb98a117756a req-f92c3cca-a82b-4ca5-a193-6ce4f7112f8b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e762f82-ada3-411d-9072-37e72381145d", "tag": "c71c8a62-3e86-493c-9ee0-a514776c7ea0"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:02:41.437549 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-c1076b02-4507-4a88-9be6-bb98a117756a req-f92c3cca-a82b-4ca5-a193-6ce4f7112f8b service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:41.438031 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-c1076b02-4507-4a88-9be6-bb98a117756a req-f92c3cca-a82b-4ca5-a193-6ce4f7112f8b service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:41.438520 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-c1076b02-4507-4a88-9be6-bb98a117756a req-f92c3cca-a82b-4ca5-a193-6ce4f7112f8b service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:41.454383 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-c1076b02-4507-4a88-9be6-bb98a117756a req-f92c3cca-a82b-4ca5-a193-6ce4f7112f8b service nova] Creating event network-changed:c71c8a62-3e86-493c-9ee0-a514776c7ea0 for instance 0e762f82-ada3-411d-9072-37e72381145d on nch2-master-1 Oct 08 21:02:41.460304 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-c1076b02-4507-4a88-9be6-bb98a117756a req-f92c3cca-a82b-4ca5-a193-6ce4f7112f8b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060508 Oct 08 21:02:41.463650 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1317/2615] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:02:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:02:41.469394 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-9d574ecc-5629-4fec-9ee4-deaba908a200 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:02:41.470434 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-9d574ecc-5629-4fec-9ee4-deaba908a200 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] [instance: 0e762f82-ada3-411d-9072-37e72381145d] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:02:41.483609 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9d574ecc-5629-4fec-9ee4-deaba908a200 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:41.486003 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9d574ecc-5629-4fec-9ee4-deaba908a200 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:41.486494 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9d574ecc-5629-4fec-9ee4-deaba908a200 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:41.487278 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9d574ecc-5629-4fec-9ee4-deaba908a200 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:41.487758 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9d574ecc-5629-4fec-9ee4-deaba908a200 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:41.488208 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9d574ecc-5629-4fec-9ee4-deaba908a200 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:41.532156 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:02:41.692953 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-32cab6c9-c8b1-4514-ac83-6a19310f8569 tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95cfeacf062f486c985ca772f2f36faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f51fe43d7c143ebb6d53f5942941c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:02:41.713890 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-32cab6c9-c8b1-4514-ac83-6a19310f8569 tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] 10.222.0.26 "GET /compute/v2.1/servers/50a243fc-ec9e-4e15-a0c6-240c525af882" status: 200 len: 1332 microversion: 2.1 time: 0.778621 Oct 08 21:02:41.714703 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1299/2616] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:02:40 2022] GET /compute/v2.1/servers/50a243fc-ec9e-4e15-a0c6-240c525af882 => generated 1332 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:02:41.738758 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-2248fc21-56b0-4953-b584-a2bd8cb90bd1 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:02:41.741516 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-2248fc21-56b0-4953-b584-a2bd8cb90bd1 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] [instance: 4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:02:41.759765 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2248fc21-56b0-4953-b584-a2bd8cb90bd1 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:41.761041 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2248fc21-56b0-4953-b584-a2bd8cb90bd1 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:41.762148 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2248fc21-56b0-4953-b584-a2bd8cb90bd1 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:41.763289 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2248fc21-56b0-4953-b584-a2bd8cb90bd1 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:41.764146 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2248fc21-56b0-4953-b584-a2bd8cb90bd1 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:41.764756 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2248fc21-56b0-4953-b584-a2bd8cb90bd1 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:42.648088 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-9d574ecc-5629-4fec-9ee4-deaba908a200 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f60e33f334465fac1148669de3f00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4735bf74f33a4739800d766c82d973d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:02:42.660708 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-9d574ecc-5629-4fec-9ee4-deaba908a200 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] 10.222.0.26 "GET /compute/v2.1/servers/0e762f82-ada3-411d-9072-37e72381145d" status: 200 len: 1354 microversion: 2.1 time: 1.195582 Oct 08 21:02:42.673789 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1318/2617] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:02:41 2022] GET /compute/v2.1/servers/0e762f82-ada3-411d-9072-37e72381145d => generated 1354 bytes in 1209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:02:42.702911 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-2248fc21-56b0-4953-b584-a2bd8cb90bd1 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1698dee4a2bf4ea19a6ee0c3d5cb5c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b00ee5e7828469f95bd90548d35982a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:02:42.712813 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-2248fc21-56b0-4953-b584-a2bd8cb90bd1 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] 10.222.0.26 "GET /compute/v2.1/servers/4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711" status: 200 len: 1735 microversion: 2.1 time: 0.985567 Oct 08 21:02:42.717964 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1300/2618] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:02:41 2022] GET /compute/v2.1/servers/4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711 => generated 1735 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:02:42.727078 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-cfea34e1-e8c9-44ce-9842-14e03cfe7784 tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:02:42.731701 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-cfea34e1-e8c9-44ce-9842-14e03cfe7784 tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] [instance: 401433a8-84ff-4525-9a86-c0b6a517eeb3] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:02:42.762845 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cfea34e1-e8c9-44ce-9842-14e03cfe7784 tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:42.770578 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cfea34e1-e8c9-44ce-9842-14e03cfe7784 tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:42.771116 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cfea34e1-e8c9-44ce-9842-14e03cfe7784 tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:42.772778 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cfea34e1-e8c9-44ce-9842-14e03cfe7784 tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:42.781948 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cfea34e1-e8c9-44ce-9842-14e03cfe7784 tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:42.789759 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cfea34e1-e8c9-44ce-9842-14e03cfe7784 tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:43.047106 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-f74a00b0-2ced-4e59-9654-93286287cdfc req-1bf0fbb1-fa8a-4fc2-a2e9-56dfa21570f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50a243fc-ec9e-4e15-a0c6-240c525af882", "tag": "87b9c9d6-fc1c-4415-b9ba-4d06b63de0b4"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:02:43.082100 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-f74a00b0-2ced-4e59-9654-93286287cdfc req-1bf0fbb1-fa8a-4fc2-a2e9-56dfa21570f6 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:43.090734 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-f74a00b0-2ced-4e59-9654-93286287cdfc req-1bf0fbb1-fa8a-4fc2-a2e9-56dfa21570f6 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:43.091868 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-f74a00b0-2ced-4e59-9654-93286287cdfc req-1bf0fbb1-fa8a-4fc2-a2e9-56dfa21570f6 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:43.180422 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-f74a00b0-2ced-4e59-9654-93286287cdfc req-1bf0fbb1-fa8a-4fc2-a2e9-56dfa21570f6 service nova] Creating event network-changed:87b9c9d6-fc1c-4415-b9ba-4d06b63de0b4 for instance 50a243fc-ec9e-4e15-a0c6-240c525af882 on nch1-master-1 Oct 08 21:02:43.197942 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-f74a00b0-2ced-4e59-9654-93286287cdfc req-1bf0fbb1-fa8a-4fc2-a2e9-56dfa21570f6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.521266 Oct 08 21:02:43.201090 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1319/2619] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:02:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:02:43.212964 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-0c37e311-04cc-4872-af0c-8ec35ba21428 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:02:43.217029 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-0c37e311-04cc-4872-af0c-8ec35ba21428 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: d7f3a7bd-a731-45de-a24b-e04e9d81358d] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:02:43.243132 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0c37e311-04cc-4872-af0c-8ec35ba21428 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:43.244033 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0c37e311-04cc-4872-af0c-8ec35ba21428 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:43.246428 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0c37e311-04cc-4872-af0c-8ec35ba21428 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:43.248128 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0c37e311-04cc-4872-af0c-8ec35ba21428 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:43.251015 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0c37e311-04cc-4872-af0c-8ec35ba21428 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:43.251953 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0c37e311-04cc-4872-af0c-8ec35ba21428 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:43.608140 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-0c37e311-04cc-4872-af0c-8ec35ba21428 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:02:43.624003 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-0c37e311-04cc-4872-af0c-8ec35ba21428 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/d7f3a7bd-a731-45de-a24b-e04e9d81358d" status: 200 len: 1543 microversion: 2.1 time: 0.421395 Oct 08 21:02:43.631839 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1320/2620] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:02:43 2022] GET /compute/v2.1/servers/d7f3a7bd-a731-45de-a24b-e04e9d81358d => generated 1543 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:02:43.640972 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-9381643a-ee68-4181-9a28-016dbaaabefa tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:02:43.642062 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-9381643a-ee68-4181-9a28-016dbaaabefa tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] [instance: 50a243fc-ec9e-4e15-a0c6-240c525af882] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:02:43.664711 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9381643a-ee68-4181-9a28-016dbaaabefa tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:43.666039 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9381643a-ee68-4181-9a28-016dbaaabefa tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:43.666704 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9381643a-ee68-4181-9a28-016dbaaabefa tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:43.667663 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9381643a-ee68-4181-9a28-016dbaaabefa tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:43.668337 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9381643a-ee68-4181-9a28-016dbaaabefa tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:43.668973 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9381643a-ee68-4181-9a28-016dbaaabefa tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:43.778652 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-cfea34e1-e8c9-44ce-9842-14e03cfe7784 tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e3216124a4f41b2b931a16c750649df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0310d9e59942729d685e6eb06c6460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:02:43.803269 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-cfea34e1-e8c9-44ce-9842-14e03cfe7784 tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] 10.222.0.26 "GET /compute/v2.1/servers/401433a8-84ff-4525-9a86-c0b6a517eeb3" status: 200 len: 1369 microversion: 2.1 time: 1.083812 Oct 08 21:02:43.804882 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1301/2621] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:02:42 2022] GET /compute/v2.1/servers/401433a8-84ff-4525-9a86-c0b6a517eeb3 => generated 1369 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:02:44.180896 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-6c23efcb-97b7-49e0-8d6a-012c7537ea53 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1537945694", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:02:44.289487 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.network.neutron [None req-6c23efcb-97b7-49e0-8d6a-012c7537ea53 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] validate_networks() for [('cb0d6829-56c1-4723-b251-d2d657c0a658', None, None, None, None, None)] {{(pid=140491) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 21:02:44.522863 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-9381643a-ee68-4181-9a28-016dbaaabefa tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95cfeacf062f486c985ca772f2f36faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f51fe43d7c143ebb6d53f5942941c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:02:44.531761 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-9381643a-ee68-4181-9a28-016dbaaabefa tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] 10.222.0.26 "GET /compute/v2.1/servers/50a243fc-ec9e-4e15-a0c6-240c525af882" status: 200 len: 1332 microversion: 2.1 time: 0.898033 Oct 08 21:02:44.532357 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1321/2622] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:02:43 2022] GET /compute/v2.1/servers/50a243fc-ec9e-4e15-a0c6-240c525af882 => generated 1332 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:02:44.564531 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-90d85322-54bc-49fc-b791-f796c4282bf1 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:02:44.571172 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-90d85322-54bc-49fc-b791-f796c4282bf1 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] [instance: 0e762f82-ada3-411d-9072-37e72381145d] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:02:44.592457 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-90d85322-54bc-49fc-b791-f796c4282bf1 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:44.600222 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-90d85322-54bc-49fc-b791-f796c4282bf1 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:44.601028 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-90d85322-54bc-49fc-b791-f796c4282bf1 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:44.603692 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-90d85322-54bc-49fc-b791-f796c4282bf1 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:44.607425 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-90d85322-54bc-49fc-b791-f796c4282bf1 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:44.610622 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-90d85322-54bc-49fc-b791-f796c4282bf1 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:44.699727 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=2 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:02:44.753580 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=6 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:02:45.540731 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-90d85322-54bc-49fc-b791-f796c4282bf1 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f60e33f334465fac1148669de3f00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4735bf74f33a4739800d766c82d973d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:02:45.574441 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-90d85322-54bc-49fc-b791-f796c4282bf1 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] 10.222.0.26 "GET /compute/v2.1/servers/0e762f82-ada3-411d-9072-37e72381145d" status: 200 len: 1354 microversion: 2.1 time: 1.030846 Oct 08 21:02:45.575619 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1322/2623] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:02:44 2022] GET /compute/v2.1/servers/0e762f82-ada3-411d-9072-37e72381145d => generated 1354 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:02:45.586315 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-25fdec87-d415-4c98-a2a9-0d8f42589f14 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:02:45.590301 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-25fdec87-d415-4c98-a2a9-0d8f42589f14 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] [instance: 4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:02:45.603250 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-25fdec87-d415-4c98-a2a9-0d8f42589f14 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:45.606742 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-25fdec87-d415-4c98-a2a9-0d8f42589f14 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:45.607687 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-25fdec87-d415-4c98-a2a9-0d8f42589f14 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:45.608676 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-25fdec87-d415-4c98-a2a9-0d8f42589f14 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:45.609740 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-25fdec87-d415-4c98-a2a9-0d8f42589f14 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:45.612440 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-25fdec87-d415-4c98-a2a9-0d8f42589f14 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:46.558575 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-6c23efcb-97b7-49e0-8d6a-012c7537ea53 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Flavor limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 21:02:46.559101 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-6c23efcb-97b7-49e0-8d6a-012c7537ea53 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Image limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 21:02:46.559474 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-6c23efcb-97b7-49e0-8d6a-012c7537ea53 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Flavor pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 21:02:46.561021 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-6c23efcb-97b7-49e0-8d6a-012c7537ea53 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Image pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 21:02:46.563115 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-6c23efcb-97b7-49e0-8d6a-012c7537ea53 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 21:02:46.604733 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6c23efcb-97b7-49e0-8d6a-012c7537ea53 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:46.605938 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6c23efcb-97b7-49e0-8d6a-012c7537ea53 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:46.608027 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6c23efcb-97b7-49e0-8d6a-012c7537ea53 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:46.609815 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6c23efcb-97b7-49e0-8d6a-012c7537ea53 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:46.610524 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6c23efcb-97b7-49e0-8d6a-012c7537ea53 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:46.611351 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6c23efcb-97b7-49e0-8d6a-012c7537ea53 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:46.645146 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-6c23efcb-97b7-49e0-8d6a-012c7537ea53 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Getting quotas for project 75b2a56286924e2d953bebe717ce591b. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:02:46.655345 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-6c23efcb-97b7-49e0-8d6a-012c7537ea53 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Getting quotas for user bf2e13f1952a4e5bb23d57dd7fa31875 and project 75b2a56286924e2d953bebe717ce591b. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:02:46.698684 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-6c23efcb-97b7-49e0-8d6a-012c7537ea53 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Going to run 1 instances... {{(pid=140491) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 21:02:46.703219 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-6c23efcb-97b7-49e0-8d6a-012c7537ea53 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] [instance: 570d4898-169b-4f6b-aef6-ab79ea0fbefd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c508bd7f-7db9-4b2c-af7c-be54a855c355',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140491) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 21:02:46.735079 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-25fdec87-d415-4c98-a2a9-0d8f42589f14 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1698dee4a2bf4ea19a6ee0c3d5cb5c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b00ee5e7828469f95bd90548d35982a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:02:46.757409 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-25fdec87-d415-4c98-a2a9-0d8f42589f14 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] 10.222.0.26 "GET /compute/v2.1/servers/4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711" status: 200 len: 1735 microversion: 2.1 time: 1.175505 Oct 08 21:02:46.758661 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1323/2624] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:02:45 2022] GET /compute/v2.1/servers/4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711 => generated 1735 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:02:46.909402 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-6c23efcb-97b7-49e0-8d6a-012c7537ea53 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.101493 Oct 08 21:02:46.913298 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1302/2625] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 21:02:43 2022] POST /compute/v2.1/servers => generated 383 bytes in 3107 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 08 21:02:46.930668 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-75a6f9ce-a4a5-40e8-a722-4a3f898a817c tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:02:46.936433 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-75a6f9ce-a4a5-40e8-a722-4a3f898a817c tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: d7f3a7bd-a731-45de-a24b-e04e9d81358d] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:02:46.964356 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-75a6f9ce-a4a5-40e8-a722-4a3f898a817c tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:46.968385 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-75a6f9ce-a4a5-40e8-a722-4a3f898a817c tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:46.970205 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-75a6f9ce-a4a5-40e8-a722-4a3f898a817c tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:46.973847 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-75a6f9ce-a4a5-40e8-a722-4a3f898a817c tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:46.974399 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-75a6f9ce-a4a5-40e8-a722-4a3f898a817c tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:46.974826 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-75a6f9ce-a4a5-40e8-a722-4a3f898a817c tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:47.286700 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-75a6f9ce-a4a5-40e8-a722-4a3f898a817c tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:02:47.309007 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-75a6f9ce-a4a5-40e8-a722-4a3f898a817c tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/d7f3a7bd-a731-45de-a24b-e04e9d81358d" status: 200 len: 1543 microversion: 2.1 time: 0.393480 Oct 08 21:02:47.341906 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1303/2626] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:02:46 2022] GET /compute/v2.1/servers/d7f3a7bd-a731-45de-a24b-e04e9d81358d => generated 1543 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:02:47.346897 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c4043366-7a01-41a5-9264-80293beef620 tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:02:47.347840 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-c4043366-7a01-41a5-9264-80293beef620 tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] [instance: 401433a8-84ff-4525-9a86-c0b6a517eeb3] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:02:47.352423 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-52e47842-a4ca-4b58-b995-cb107cbc37d4 tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-1424541974", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "networks": [{"uuid": "6bdf09c7-7902-46af-b485-0fc763e53465"}]}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:02:47.368387 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c4043366-7a01-41a5-9264-80293beef620 tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:47.369867 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c4043366-7a01-41a5-9264-80293beef620 tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:47.370565 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c4043366-7a01-41a5-9264-80293beef620 tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:47.372379 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c4043366-7a01-41a5-9264-80293beef620 tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:47.378551 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c4043366-7a01-41a5-9264-80293beef620 tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:47.380087 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c4043366-7a01-41a5-9264-80293beef620 tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:47.503537 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.network.neutron [None req-52e47842-a4ca-4b58-b995-cb107cbc37d4 tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] validate_networks() for [('6bdf09c7-7902-46af-b485-0fc763e53465', None, None, None, None, None)] {{(pid=140492) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 21:02:48.507176 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-c4043366-7a01-41a5-9264-80293beef620 tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e3216124a4f41b2b931a16c750649df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0310d9e59942729d685e6eb06c6460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:02:48.515790 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-c4043366-7a01-41a5-9264-80293beef620 tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] 10.222.0.26 "GET /compute/v2.1/servers/401433a8-84ff-4525-9a86-c0b6a517eeb3" status: 200 len: 1369 microversion: 2.1 time: 1.172691 Oct 08 21:02:48.519872 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1304/2627] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:02:47 2022] GET /compute/v2.1/servers/401433a8-84ff-4525-9a86-c0b6a517eeb3 => generated 1369 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:02:48.542408 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-79d46dec-947e-44b8-96cd-2fb4abd1c35f req-35a414fc-c86f-4f57-b6eb-bf61811be012 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e762f82-ada3-411d-9072-37e72381145d", "tag": "582a8fd3-4fba-41bc-be82-7424ac768342"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:02:48.587565 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-79d46dec-947e-44b8-96cd-2fb4abd1c35f req-35a414fc-c86f-4f57-b6eb-bf61811be012 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:48.588004 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-79d46dec-947e-44b8-96cd-2fb4abd1c35f req-35a414fc-c86f-4f57-b6eb-bf61811be012 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:48.588447 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-79d46dec-947e-44b8-96cd-2fb4abd1c35f req-35a414fc-c86f-4f57-b6eb-bf61811be012 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:48.634689 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-79d46dec-947e-44b8-96cd-2fb4abd1c35f req-35a414fc-c86f-4f57-b6eb-bf61811be012 service nova] Creating event network-changed:582a8fd3-4fba-41bc-be82-7424ac768342 for instance 0e762f82-ada3-411d-9072-37e72381145d on nch2-master-1 Oct 08 21:02:48.649773 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-79d46dec-947e-44b8-96cd-2fb4abd1c35f req-35a414fc-c86f-4f57-b6eb-bf61811be012 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118562 Oct 08 21:02:48.651283 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1305/2628] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:02:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:02:48.658071 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-d29bf808-b5a8-48c7-a437-3fd30554aaad tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:02:48.669683 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-d29bf808-b5a8-48c7-a437-3fd30554aaad tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] [instance: 50a243fc-ec9e-4e15-a0c6-240c525af882] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:02:48.683496 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d29bf808-b5a8-48c7-a437-3fd30554aaad tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:48.684009 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d29bf808-b5a8-48c7-a437-3fd30554aaad tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:48.684469 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d29bf808-b5a8-48c7-a437-3fd30554aaad tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:48.685453 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d29bf808-b5a8-48c7-a437-3fd30554aaad tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:48.685994 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d29bf808-b5a8-48c7-a437-3fd30554aaad tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:48.686434 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d29bf808-b5a8-48c7-a437-3fd30554aaad tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:48.732516 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=100 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:02:49.125666 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-d29bf808-b5a8-48c7-a437-3fd30554aaad tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95cfeacf062f486c985ca772f2f36faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f51fe43d7c143ebb6d53f5942941c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:02:49.135790 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-d29bf808-b5a8-48c7-a437-3fd30554aaad tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] 10.222.0.26 "GET /compute/v2.1/servers/50a243fc-ec9e-4e15-a0c6-240c525af882" status: 200 len: 1332 microversion: 2.1 time: 0.482755 Oct 08 21:02:49.155952 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1306/2629] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:02:48 2022] GET /compute/v2.1/servers/50a243fc-ec9e-4e15-a0c6-240c525af882 => generated 1332 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:02:49.167300 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-a8098913-81e6-4a9c-b91e-74774e440802 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:02:49.168226 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-a8098913-81e6-4a9c-b91e-74774e440802 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] [instance: 0e762f82-ada3-411d-9072-37e72381145d] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:02:49.179088 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a8098913-81e6-4a9c-b91e-74774e440802 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:49.181256 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a8098913-81e6-4a9c-b91e-74774e440802 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:49.181927 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a8098913-81e6-4a9c-b91e-74774e440802 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:49.182869 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a8098913-81e6-4a9c-b91e-74774e440802 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:49.183535 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a8098913-81e6-4a9c-b91e-74774e440802 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:49.184171 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a8098913-81e6-4a9c-b91e-74774e440802 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:49.368156 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-52e47842-a4ca-4b58-b995-cb107cbc37d4 tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Flavor limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 21:02:49.369033 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-52e47842-a4ca-4b58-b995-cb107cbc37d4 tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Image limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 21:02:49.369499 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-52e47842-a4ca-4b58-b995-cb107cbc37d4 tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Flavor pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 21:02:49.370365 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-52e47842-a4ca-4b58-b995-cb107cbc37d4 tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Image pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 21:02:49.370960 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-52e47842-a4ca-4b58-b995-cb107cbc37d4 tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 21:02:49.423765 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-52e47842-a4ca-4b58-b995-cb107cbc37d4 tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:49.424270 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-52e47842-a4ca-4b58-b995-cb107cbc37d4 tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:49.424714 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-52e47842-a4ca-4b58-b995-cb107cbc37d4 tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:49.425487 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-52e47842-a4ca-4b58-b995-cb107cbc37d4 tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:49.433740 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-52e47842-a4ca-4b58-b995-cb107cbc37d4 tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:49.434309 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-52e47842-a4ca-4b58-b995-cb107cbc37d4 tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:49.546483 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-52e47842-a4ca-4b58-b995-cb107cbc37d4 tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Getting quotas for project 0b70cb43c39e4e0ba89680d7b8459c01. Resources: {'cores', 'instances', 'ram'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:02:49.579800 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-52e47842-a4ca-4b58-b995-cb107cbc37d4 tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Getting quotas for user 0f6088285b46499a98162b6237517174 and project 0b70cb43c39e4e0ba89680d7b8459c01. Resources: {'cores', 'instances', 'ram'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:02:49.632825 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-52e47842-a4ca-4b58-b995-cb107cbc37d4 tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Going to run 1 instances... {{(pid=140492) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 21:02:49.638840 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-52e47842-a4ca-4b58-b995-cb107cbc37d4 tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] [instance: 6e8a4e07-0b30-44a3-aa7d-8d4677cc1d5f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c508bd7f-7db9-4b2c-af7c-be54a855c355',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140492) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 21:02:49.717355 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-a8098913-81e6-4a9c-b91e-74774e440802 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f60e33f334465fac1148669de3f00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4735bf74f33a4739800d766c82d973d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:02:49.734815 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-a8098913-81e6-4a9c-b91e-74774e440802 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] 10.222.0.26 "GET /compute/v2.1/servers/0e762f82-ada3-411d-9072-37e72381145d" status: 200 len: 1354 microversion: 2.1 time: 0.573434 Oct 08 21:02:49.738486 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1307/2630] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:02:49 2022] GET /compute/v2.1/servers/0e762f82-ada3-411d-9072-37e72381145d => generated 1354 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:02:49.756257 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-10e9043a-399b-4f6c-a5c3-ba2366f5af9b tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:02:49.759285 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-10e9043a-399b-4f6c-a5c3-ba2366f5af9b tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] [instance: 570d4898-169b-4f6b-aef6-ab79ea0fbefd] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:02:49.806596 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-10e9043a-399b-4f6c-a5c3-ba2366f5af9b tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:49.809407 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-10e9043a-399b-4f6c-a5c3-ba2366f5af9b tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:49.809874 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-10e9043a-399b-4f6c-a5c3-ba2366f5af9b tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:49.813793 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-10e9043a-399b-4f6c-a5c3-ba2366f5af9b tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:49.822610 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-10e9043a-399b-4f6c-a5c3-ba2366f5af9b tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:49.823710 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-10e9043a-399b-4f6c-a5c3-ba2366f5af9b tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:49.885542 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-52e47842-a4ca-4b58-b995-cb107cbc37d4 tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.108518 Oct 08 21:02:49.887847 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1324/2631] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 21:02:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 3129 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 08 21:02:49.909959 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-3e32c52f-9f4b-456e-8f4f-c5e156f8ce79 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:02:49.910674 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-3e32c52f-9f4b-456e-8f4f-c5e156f8ce79 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] [instance: 4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:02:49.952425 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3e32c52f-9f4b-456e-8f4f-c5e156f8ce79 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:49.952778 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3e32c52f-9f4b-456e-8f4f-c5e156f8ce79 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:49.961224 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3e32c52f-9f4b-456e-8f4f-c5e156f8ce79 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:49.964077 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3e32c52f-9f4b-456e-8f4f-c5e156f8ce79 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:49.964753 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3e32c52f-9f4b-456e-8f4f-c5e156f8ce79 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:49.975315 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3e32c52f-9f4b-456e-8f4f-c5e156f8ce79 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:50.212582 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-10e9043a-399b-4f6c-a5c3-ba2366f5af9b tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2e13f1952a4e5bb23d57dd7fa31875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b2a56286924e2d953bebe717ce591b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:02:50.224129 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-10e9043a-399b-4f6c-a5c3-ba2366f5af9b tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] 10.222.0.26 "GET /compute/v2.1/servers/570d4898-169b-4f6b-aef6-ab79ea0fbefd" status: 200 len: 1274 microversion: 2.1 time: 0.478895 Oct 08 21:02:50.227948 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1308/2632] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:02:49 2022] GET /compute/v2.1/servers/570d4898-169b-4f6b-aef6-ab79ea0fbefd => generated 1274 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:02:50.244759 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-59ce8e4e-2c4b-4c6c-b5af-4be509bbcd54 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:02:50.250110 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-59ce8e4e-2c4b-4c6c-b5af-4be509bbcd54 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: d7f3a7bd-a731-45de-a24b-e04e9d81358d] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:02:50.278643 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-59ce8e4e-2c4b-4c6c-b5af-4be509bbcd54 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:50.289397 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-59ce8e4e-2c4b-4c6c-b5af-4be509bbcd54 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:50.291379 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-59ce8e4e-2c4b-4c6c-b5af-4be509bbcd54 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:50.293120 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-59ce8e4e-2c4b-4c6c-b5af-4be509bbcd54 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:50.295731 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-59ce8e4e-2c4b-4c6c-b5af-4be509bbcd54 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:50.299227 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-59ce8e4e-2c4b-4c6c-b5af-4be509bbcd54 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:50.765751 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-3e32c52f-9f4b-456e-8f4f-c5e156f8ce79 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1698dee4a2bf4ea19a6ee0c3d5cb5c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b00ee5e7828469f95bd90548d35982a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:02:50.781282 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-3e32c52f-9f4b-456e-8f4f-c5e156f8ce79 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] 10.222.0.26 "GET /compute/v2.1/servers/4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711" status: 200 len: 1715 microversion: 2.1 time: 0.888859 Oct 08 21:02:50.784604 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1325/2633] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:02:49 2022] GET /compute/v2.1/servers/4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711 => generated 1715 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:02:50.804175 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-08c5938f-2ae7-4bcc-8e03-c77b719da2da tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:02:50.806813 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-08c5938f-2ae7-4bcc-8e03-c77b719da2da tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] [instance: 401433a8-84ff-4525-9a86-c0b6a517eeb3] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:02:50.819209 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-08c5938f-2ae7-4bcc-8e03-c77b719da2da tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:50.820487 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-08c5938f-2ae7-4bcc-8e03-c77b719da2da tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:50.821170 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-08c5938f-2ae7-4bcc-8e03-c77b719da2da tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:50.823716 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-08c5938f-2ae7-4bcc-8e03-c77b719da2da tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:50.824662 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-08c5938f-2ae7-4bcc-8e03-c77b719da2da tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:50.826024 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-08c5938f-2ae7-4bcc-8e03-c77b719da2da tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:50.955794 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-59ce8e4e-2c4b-4c6c-b5af-4be509bbcd54 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:02:50.970223 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-59ce8e4e-2c4b-4c6c-b5af-4be509bbcd54 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/d7f3a7bd-a731-45de-a24b-e04e9d81358d" status: 200 len: 1543 microversion: 2.1 time: 0.739978 Oct 08 21:02:50.986481 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1309/2634] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:02:50 2022] GET /compute/v2.1/servers/d7f3a7bd-a731-45de-a24b-e04e9d81358d => generated 1543 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:02:50.997342 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-21ab48a2-7859-466c-8185-f0f4ac567bb1 tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:02:50.998194 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-21ab48a2-7859-466c-8185-f0f4ac567bb1 tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] [instance: 6e8a4e07-0b30-44a3-aa7d-8d4677cc1d5f] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:02:51.011663 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-21ab48a2-7859-466c-8185-f0f4ac567bb1 tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:51.012158 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-21ab48a2-7859-466c-8185-f0f4ac567bb1 tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:51.012631 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-21ab48a2-7859-466c-8185-f0f4ac567bb1 tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:51.018798 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-21ab48a2-7859-466c-8185-f0f4ac567bb1 tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:51.019330 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-21ab48a2-7859-466c-8185-f0f4ac567bb1 tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:51.030584 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-21ab48a2-7859-466c-8185-f0f4ac567bb1 tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:51.173866 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-21ab48a2-7859-466c-8185-f0f4ac567bb1 tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6088285b46499a98162b6237517174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b70cb43c39e4e0ba89680d7b8459c01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:02:51.186976 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-21ab48a2-7859-466c-8185-f0f4ac567bb1 tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] 10.222.0.26 "GET /compute/v2.1/servers/6e8a4e07-0b30-44a3-aa7d-8d4677cc1d5f" status: 200 len: 1221 microversion: 2.1 time: 0.208490 Oct 08 21:02:51.187701 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1310/2635] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:02:50 2022] GET /compute/v2.1/servers/6e8a4e07-0b30-44a3-aa7d-8d4677cc1d5f => generated 1221 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:02:51.196467 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-08c5938f-2ae7-4bcc-8e03-c77b719da2da tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e3216124a4f41b2b931a16c750649df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0310d9e59942729d685e6eb06c6460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:02:51.207720 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-08c5938f-2ae7-4bcc-8e03-c77b719da2da tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] 10.222.0.26 "GET /compute/v2.1/servers/401433a8-84ff-4525-9a86-c0b6a517eeb3" status: 200 len: 1369 microversion: 2.1 time: 0.414906 Oct 08 21:02:51.209627 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-5ebacc31-8d26-4c5d-b5f3-4e46b485a637 tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:02:51.210417 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-5ebacc31-8d26-4c5d-b5f3-4e46b485a637 tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] [instance: 50a243fc-ec9e-4e15-a0c6-240c525af882] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:02:51.211091 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1326/2636] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:02:50 2022] GET /compute/v2.1/servers/401433a8-84ff-4525-9a86-c0b6a517eeb3 => generated 1369 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:02:51.217679 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5ebacc31-8d26-4c5d-b5f3-4e46b485a637 tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:51.218359 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5ebacc31-8d26-4c5d-b5f3-4e46b485a637 tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:51.218967 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5ebacc31-8d26-4c5d-b5f3-4e46b485a637 tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:51.219828 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5ebacc31-8d26-4c5d-b5f3-4e46b485a637 tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:51.220437 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5ebacc31-8d26-4c5d-b5f3-4e46b485a637 tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:51.220999 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5ebacc31-8d26-4c5d-b5f3-4e46b485a637 tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:51.226168 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-91f1aa34-31bf-42b3-a598-ad44967d0341 req-94480417-7486-4dba-9800-99ee59bd8b15 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "401433a8-84ff-4525-9a86-c0b6a517eeb3", "tag": "47b7d203-baac-4d79-a17a-77efb2e4892e"}, {"name": "network-changed", "server_uuid": "0e762f82-ada3-411d-9072-37e72381145d", "tag": "2311dae7-2451-42a1-9d7c-d14f8767e430"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:02:51.247212 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-91f1aa34-31bf-42b3-a598-ad44967d0341 req-94480417-7486-4dba-9800-99ee59bd8b15 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:51.247992 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-91f1aa34-31bf-42b3-a598-ad44967d0341 req-94480417-7486-4dba-9800-99ee59bd8b15 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:51.249348 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-91f1aa34-31bf-42b3-a598-ad44967d0341 req-94480417-7486-4dba-9800-99ee59bd8b15 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:51.270373 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-91f1aa34-31bf-42b3-a598-ad44967d0341 req-94480417-7486-4dba-9800-99ee59bd8b15 service nova] Creating event network-changed:47b7d203-baac-4d79-a17a-77efb2e4892e for instance 401433a8-84ff-4525-9a86-c0b6a517eeb3 on nch2-master-1 Oct 08 21:02:51.270918 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-91f1aa34-31bf-42b3-a598-ad44967d0341 req-94480417-7486-4dba-9800-99ee59bd8b15 service nova] Creating event network-changed:2311dae7-2451-42a1-9d7c-d14f8767e430 for instance 0e762f82-ada3-411d-9072-37e72381145d on nch2-master-1 Oct 08 21:02:51.284406 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-91f1aa34-31bf-42b3-a598-ad44967d0341 req-94480417-7486-4dba-9800-99ee59bd8b15 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.072108 Oct 08 21:02:51.285042 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1327/2637] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:02:51 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:02:51.296447 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e37c3c47-9276-4c36-846d-878e512c9c82 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:02:51.297177 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-e37c3c47-9276-4c36-846d-878e512c9c82 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] [instance: 0e762f82-ada3-411d-9072-37e72381145d] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:02:51.317837 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e37c3c47-9276-4c36-846d-878e512c9c82 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:51.318858 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e37c3c47-9276-4c36-846d-878e512c9c82 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:51.319641 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e37c3c47-9276-4c36-846d-878e512c9c82 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:51.321176 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e37c3c47-9276-4c36-846d-878e512c9c82 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:51.321964 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e37c3c47-9276-4c36-846d-878e512c9c82 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:51.322459 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e37c3c47-9276-4c36-846d-878e512c9c82 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:51.478265 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-5ebacc31-8d26-4c5d-b5f3-4e46b485a637 tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95cfeacf062f486c985ca772f2f36faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f51fe43d7c143ebb6d53f5942941c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:02:51.492405 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-5ebacc31-8d26-4c5d-b5f3-4e46b485a637 tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] 10.222.0.26 "GET /compute/v2.1/servers/50a243fc-ec9e-4e15-a0c6-240c525af882" status: 200 len: 1332 microversion: 2.1 time: 0.288232 Oct 08 21:02:51.494105 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1311/2638] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:02:51 2022] GET /compute/v2.1/servers/50a243fc-ec9e-4e15-a0c6-240c525af882 => generated 1332 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:02:51.514776 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-e37c3c47-9276-4c36-846d-878e512c9c82 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f60e33f334465fac1148669de3f00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4735bf74f33a4739800d766c82d973d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:02:51.529277 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-e37c3c47-9276-4c36-846d-878e512c9c82 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] 10.222.0.26 "GET /compute/v2.1/servers/0e762f82-ada3-411d-9072-37e72381145d" status: 200 len: 1354 microversion: 2.1 time: 0.241159 Oct 08 21:02:51.530614 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1328/2639] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:02:51 2022] GET /compute/v2.1/servers/0e762f82-ada3-411d-9072-37e72381145d => generated 1354 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:02:51.546236 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-a847c32e-f1f5-406f-8a54-b3c41b1e5cd0 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:02:51.549858 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-a847c32e-f1f5-406f-8a54-b3c41b1e5cd0 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] [instance: 4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:02:51.558666 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a847c32e-f1f5-406f-8a54-b3c41b1e5cd0 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:51.559402 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a847c32e-f1f5-406f-8a54-b3c41b1e5cd0 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:51.560139 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a847c32e-f1f5-406f-8a54-b3c41b1e5cd0 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:51.561171 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a847c32e-f1f5-406f-8a54-b3c41b1e5cd0 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:51.561759 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a847c32e-f1f5-406f-8a54-b3c41b1e5cd0 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:51.562357 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a847c32e-f1f5-406f-8a54-b3c41b1e5cd0 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:51.656372 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-2fc9f2cf-5ced-4b19-8292-9737d3c91a40 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-637299003", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "networks": [{"uuid": "63b00ee0-8a90-4fc6-b2cb-2ad09c2d70ab"}]}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:02:51.688609 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-a847c32e-f1f5-406f-8a54-b3c41b1e5cd0 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] HTTP exception thrown: Cannot 'detach_volume' instance 4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711 while it is in vm_state rescued Oct 08 21:02:51.692287 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-a847c32e-f1f5-406f-8a54-b3c41b1e5cd0 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Request method failure captured: Oct 08 21:02:51.692287 ncdv-master-1 devstack@n-api.service[140492]: request: DELETE /compute/v2.1/servers/4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711/os-volume_attachments/3d9000e4-0140-4d89-9d9e-4730705b15bf HTTP/1.1 Oct 08 21:02:51.692287 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:02:51.692287 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:02:51.692287 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:02:51.692287 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 21:02:51.692287 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:02:51.692287 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:02:51.692287 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:02:51.692287 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:02:51.692287 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeS0fE1W4PvU2_7k8u76nOm9Y1zh9DtzN6SifZox8c4Ee-O4iYj3CcpXLLEG93O-SwetyStVJsCOhK1z0DAluVdyejBt-R2ozc-SxCa3q7lzUNWL-Kx89hV0cNzOobKFM-EJsBUodFQ4EWnFtqD_Q-5HZD9KoD2jZ3YWHd3RuK5iGsY Oct 08 21:02:51.692287 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:02:51.692287 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:02:51.692287 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:02:51.692287 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:02:51.692287 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:02:51.692287 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:02:51.692287 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 8b00ee5e7828469f95bd90548d35982a Oct 08 21:02:51.692287 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1823882791 Oct 08 21:02:51.692287 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:02:51.692287 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:02:51.692287 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8b00ee5e7828469f95bd90548d35982a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8b00ee5e7828469f95bd90548d35982a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8b00ee5e7828469f95bd90548d35982a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8b00ee5e7828469f95bd90548d35982a"}]}] Oct 08 21:02:51.692287 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1823882791 Oct 08 21:02:51.692287 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 8b00ee5e7828469f95bd90548d35982a Oct 08 21:02:51.692287 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1823882791 Oct 08 21:02:51.692287 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-ServerRescueNegativeTestJSON-1823882791-project Oct 08 21:02:51.692287 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:02:51.692287 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:02:51.692287 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 1698dee4a2bf4ea19a6ee0c3d5cb5c09 Oct 08 21:02:51.692287 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1823882791-project Oct 08 21:02:51.692287 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 21:02:51.692287 ncdv-master-1 devstack@n-api.service[140492]: exception: Cannot 'detach_volume' instance 4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711 while it is in vm_state rescued Oct 08 21:02:51.692287 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'server_id': '4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711', 'id': '3d9000e4-0140-4d89-9d9e-4730705b15bf'} Oct 08 21:02:51.692287 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:02:51.692287 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:02:51.692287 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Oct 08 21:02:51.692287 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Oct 08 21:02:51.692287 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 08 21:02:51.692287 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 08 21:02:51.692287 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 08 21:02:51.692287 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 08 21:02:51.692287 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711 in vm_state rescued. Cannot detach_volume while the instance is in this state. Oct 08 21:02:51.692287 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:02:51.692287 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:02:51.692287 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:02:51.692287 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:02:51.692287 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:02:51.692287 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:02:51.692287 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:02:51.692287 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:02:51.692287 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:02:51.692287 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:02:51.692287 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Oct 08 21:02:51.692287 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 08 21:02:51.692287 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 08 21:02:51.692287 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 08 21:02:51.692287 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711 while it is in vm_state rescued Oct 08 21:02:51.692287 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:02:51.692287 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:02:51.692287 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:02:51.692287 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:02:51.697461 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:02:51.697461 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:02:51.697461 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:02:51.697461 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:02:51.697461 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711 while it is in vm_state rescued Oct 08 21:02:51.697461 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:02:51.697461 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-a847c32e-f1f5-406f-8a54-b3c41b1e5cd0 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Returning 409 to user: Cannot 'detach_volume' instance 4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711 while it is in vm_state rescued {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:02:51.699324 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-a847c32e-f1f5-406f-8a54-b3c41b1e5cd0 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] 10.222.0.26 "DELETE /compute/v2.1/servers/4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711/os-volume_attachments/3d9000e4-0140-4d89-9d9e-4730705b15bf" status: 409 len: 152 microversion: 2.1 time: 0.166394 Oct 08 21:02:51.700703 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1329/2640] 10.222.0.26 () {58 vars in 1416 bytes} [Sat Oct 8 21:02:51 2022] DELETE /compute/v2.1/servers/4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711/os-volume_attachments/3d9000e4-0140-4d89-9d9e-4730705b15bf => generated 152 bytes in 169 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 08 21:02:51.707220 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-228bed05-24e3-4981-8b00-b36d806a04b0 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:02:51.708025 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-228bed05-24e3-4981-8b00-b36d806a04b0 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] [instance: 570d4898-169b-4f6b-aef6-ab79ea0fbefd] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:02:51.715001 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-228bed05-24e3-4981-8b00-b36d806a04b0 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:51.716113 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-228bed05-24e3-4981-8b00-b36d806a04b0 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:51.716769 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-228bed05-24e3-4981-8b00-b36d806a04b0 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:51.717694 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-228bed05-24e3-4981-8b00-b36d806a04b0 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:51.718407 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-228bed05-24e3-4981-8b00-b36d806a04b0 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:51.719187 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-228bed05-24e3-4981-8b00-b36d806a04b0 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:51.744836 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.network.neutron [None req-2fc9f2cf-5ced-4b19-8292-9737d3c91a40 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] validate_networks() for [('63b00ee0-8a90-4fc6-b2cb-2ad09c2d70ab', None, None, None, None, None)] {{(pid=140491) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 21:02:51.903859 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-228bed05-24e3-4981-8b00-b36d806a04b0 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2e13f1952a4e5bb23d57dd7fa31875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b2a56286924e2d953bebe717ce591b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:02:51.915475 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-228bed05-24e3-4981-8b00-b36d806a04b0 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] 10.222.0.26 "GET /compute/v2.1/servers/570d4898-169b-4f6b-aef6-ab79ea0fbefd" status: 200 len: 1314 microversion: 2.1 time: 0.213203 Oct 08 21:02:51.921726 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1330/2641] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:02:51 2022] GET /compute/v2.1/servers/570d4898-169b-4f6b-aef6-ab79ea0fbefd => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:02:51.980773 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-80aaf4e4-b927-44fe-a140-1c32835ce412 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:02:51.982778 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-80aaf4e4-b927-44fe-a140-1c32835ce412 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] [instance: 4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:02:52.009632 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-80aaf4e4-b927-44fe-a140-1c32835ce412 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:52.010217 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-80aaf4e4-b927-44fe-a140-1c32835ce412 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:52.010777 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-80aaf4e4-b927-44fe-a140-1c32835ce412 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:52.013797 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-80aaf4e4-b927-44fe-a140-1c32835ce412 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:52.018070 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-80aaf4e4-b927-44fe-a140-1c32835ce412 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:52.018603 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-80aaf4e4-b927-44fe-a140-1c32835ce412 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:52.183165 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-80aaf4e4-b927-44fe-a140-1c32835ce412 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] 10.222.0.26 "POST /compute/v2.1/servers/4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711/action" status: 202 len: 0 microversion: 2.1 time: 0.240462 Oct 08 21:02:52.189936 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1331/2642] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:02:51 2022] POST /compute/v2.1/servers/4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711/action => generated 0 bytes in 266 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 21:02:52.202587 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-bb00265d-b22c-4dfd-b25c-dfec03c2c7b1 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:02:52.203306 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-bb00265d-b22c-4dfd-b25c-dfec03c2c7b1 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: d7f3a7bd-a731-45de-a24b-e04e9d81358d] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:02:52.227759 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bb00265d-b22c-4dfd-b25c-dfec03c2c7b1 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:52.229639 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bb00265d-b22c-4dfd-b25c-dfec03c2c7b1 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:52.230111 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bb00265d-b22c-4dfd-b25c-dfec03c2c7b1 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:52.231419 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bb00265d-b22c-4dfd-b25c-dfec03c2c7b1 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:52.232004 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bb00265d-b22c-4dfd-b25c-dfec03c2c7b1 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:52.232719 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bb00265d-b22c-4dfd-b25c-dfec03c2c7b1 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:52.786711 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-bb00265d-b22c-4dfd-b25c-dfec03c2c7b1 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:02:52.798307 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-bb00265d-b22c-4dfd-b25c-dfec03c2c7b1 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/d7f3a7bd-a731-45de-a24b-e04e9d81358d" status: 200 len: 1542 microversion: 2.1 time: 0.606741 Oct 08 21:02:52.799388 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1332/2643] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:02:52 2022] GET /compute/v2.1/servers/d7f3a7bd-a731-45de-a24b-e04e9d81358d => generated 1542 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:02:52.820388 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-955d93c6-617f-4123-a26e-a291efe557c9 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:02:52.821666 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-955d93c6-617f-4123-a26e-a291efe557c9 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] [instance: 4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:02:52.831600 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-955d93c6-617f-4123-a26e-a291efe557c9 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:52.832684 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-955d93c6-617f-4123-a26e-a291efe557c9 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:52.833405 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-955d93c6-617f-4123-a26e-a291efe557c9 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:52.835132 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-955d93c6-617f-4123-a26e-a291efe557c9 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:52.835816 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-955d93c6-617f-4123-a26e-a291efe557c9 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:52.836622 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-955d93c6-617f-4123-a26e-a291efe557c9 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:53.238641 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-2fc9f2cf-5ced-4b19-8292-9737d3c91a40 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Flavor limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 21:02:53.239084 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-2fc9f2cf-5ced-4b19-8292-9737d3c91a40 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Image limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 21:02:53.239508 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-2fc9f2cf-5ced-4b19-8292-9737d3c91a40 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Flavor pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 21:02:53.240104 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-2fc9f2cf-5ced-4b19-8292-9737d3c91a40 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Image pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 21:02:53.241020 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-955d93c6-617f-4123-a26e-a291efe557c9 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1698dee4a2bf4ea19a6ee0c3d5cb5c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b00ee5e7828469f95bd90548d35982a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:02:53.241802 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-2fc9f2cf-5ced-4b19-8292-9737d3c91a40 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 21:02:53.252127 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-955d93c6-617f-4123-a26e-a291efe557c9 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] 10.222.0.26 "GET /compute/v2.1/servers/4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711" status: 200 len: 1723 microversion: 2.1 time: 0.451314 Oct 08 21:02:53.265210 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2fc9f2cf-5ced-4b19-8292-9737d3c91a40 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:53.265210 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2fc9f2cf-5ced-4b19-8292-9737d3c91a40 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:53.265210 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2fc9f2cf-5ced-4b19-8292-9737d3c91a40 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:53.265210 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2fc9f2cf-5ced-4b19-8292-9737d3c91a40 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:53.265682 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1333/2644] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:02:52 2022] GET /compute/v2.1/servers/4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711 => generated 1723 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:02:53.265780 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2fc9f2cf-5ced-4b19-8292-9737d3c91a40 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:53.265780 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2fc9f2cf-5ced-4b19-8292-9737d3c91a40 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:53.266102 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-ea1347e3-74d5-4d31-975d-625f1c28b8b0 tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:02:53.266740 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-ea1347e3-74d5-4d31-975d-625f1c28b8b0 tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] [instance: 6e8a4e07-0b30-44a3-aa7d-8d4677cc1d5f] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:02:53.282791 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ea1347e3-74d5-4d31-975d-625f1c28b8b0 tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:53.285017 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ea1347e3-74d5-4d31-975d-625f1c28b8b0 tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:53.287690 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ea1347e3-74d5-4d31-975d-625f1c28b8b0 tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:53.288433 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ea1347e3-74d5-4d31-975d-625f1c28b8b0 tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:53.288903 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ea1347e3-74d5-4d31-975d-625f1c28b8b0 tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:53.289150 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-2fc9f2cf-5ced-4b19-8292-9737d3c91a40 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Getting quotas for project bc9bed6d76834f6fa66d681ecd9f4e90. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:02:53.291840 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ea1347e3-74d5-4d31-975d-625f1c28b8b0 tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:53.300148 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-2fc9f2cf-5ced-4b19-8292-9737d3c91a40 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Getting quotas for user 095debf3968c448fb3c3add0322d8d1b and project bc9bed6d76834f6fa66d681ecd9f4e90. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:02:53.327046 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-2fc9f2cf-5ced-4b19-8292-9737d3c91a40 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Going to run 1 instances... {{(pid=140491) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 21:02:53.329474 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-2fc9f2cf-5ced-4b19-8292-9737d3c91a40 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] [instance: 814f7da9-1d8d-4695-8cfa-6db50c3e846a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c508bd7f-7db9-4b2c-af7c-be54a855c355',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140491) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 21:02:53.358517 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:02:53.402160 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-2fc9f2cf-5ced-4b19-8292-9737d3c91a40 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.906734 Oct 08 21:02:53.403442 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1312/2645] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 21:02:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 1908 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 08 21:02:53.408300 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-20141b60-9f08-4d09-a333-04eee9834c3c tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:02:53.409126 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-20141b60-9f08-4d09-a333-04eee9834c3c tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] [instance: 401433a8-84ff-4525-9a86-c0b6a517eeb3] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:02:53.418691 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-20141b60-9f08-4d09-a333-04eee9834c3c tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:53.419394 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-20141b60-9f08-4d09-a333-04eee9834c3c tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:53.420009 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-20141b60-9f08-4d09-a333-04eee9834c3c tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:53.420884 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-20141b60-9f08-4d09-a333-04eee9834c3c tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:53.421541 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-20141b60-9f08-4d09-a333-04eee9834c3c tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:53.422127 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-20141b60-9f08-4d09-a333-04eee9834c3c tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:53.521075 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-ea1347e3-74d5-4d31-975d-625f1c28b8b0 tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6088285b46499a98162b6237517174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b70cb43c39e4e0ba89680d7b8459c01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:02:53.532760 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-ea1347e3-74d5-4d31-975d-625f1c28b8b0 tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] 10.222.0.26 "GET /compute/v2.1/servers/6e8a4e07-0b30-44a3-aa7d-8d4677cc1d5f" status: 200 len: 1275 microversion: 2.1 time: 0.275830 Oct 08 21:02:53.537879 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1334/2646] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:02:53 2022] GET /compute/v2.1/servers/6e8a4e07-0b30-44a3-aa7d-8d4677cc1d5f => generated 1275 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:02:53.542860 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-70e5e5d5-49d4-48e5-9cc1-1e6d8911bfbf tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:02:53.543488 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-70e5e5d5-49d4-48e5-9cc1-1e6d8911bfbf tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] [instance: 50a243fc-ec9e-4e15-a0c6-240c525af882] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:02:53.546006 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:02:53.571831 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-70e5e5d5-49d4-48e5-9cc1-1e6d8911bfbf tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:53.572567 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-70e5e5d5-49d4-48e5-9cc1-1e6d8911bfbf tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:53.576284 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-70e5e5d5-49d4-48e5-9cc1-1e6d8911bfbf tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:53.583159 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-70e5e5d5-49d4-48e5-9cc1-1e6d8911bfbf tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:53.584982 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-70e5e5d5-49d4-48e5-9cc1-1e6d8911bfbf tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:53.592927 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-70e5e5d5-49d4-48e5-9cc1-1e6d8911bfbf tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:53.979778 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-20141b60-9f08-4d09-a333-04eee9834c3c tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e3216124a4f41b2b931a16c750649df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0310d9e59942729d685e6eb06c6460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:02:53.989919 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-20141b60-9f08-4d09-a333-04eee9834c3c tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] 10.222.0.26 "GET /compute/v2.1/servers/401433a8-84ff-4525-9a86-c0b6a517eeb3" status: 200 len: 1369 microversion: 2.1 time: 0.585148 Oct 08 21:02:53.997831 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1313/2647] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:02:53 2022] GET /compute/v2.1/servers/401433a8-84ff-4525-9a86-c0b6a517eeb3 => generated 1369 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:02:54.022875 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-d3df347a-ceb0-423a-8d8b-bea0b1f6d707 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:02:54.023877 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-d3df347a-ceb0-423a-8d8b-bea0b1f6d707 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] [instance: 0e762f82-ada3-411d-9072-37e72381145d] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:02:54.041113 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d3df347a-ceb0-423a-8d8b-bea0b1f6d707 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:54.042758 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d3df347a-ceb0-423a-8d8b-bea0b1f6d707 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:54.047645 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d3df347a-ceb0-423a-8d8b-bea0b1f6d707 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:54.051631 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d3df347a-ceb0-423a-8d8b-bea0b1f6d707 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:54.052956 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d3df347a-ceb0-423a-8d8b-bea0b1f6d707 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:54.054085 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d3df347a-ceb0-423a-8d8b-bea0b1f6d707 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:54.238958 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-70e5e5d5-49d4-48e5-9cc1-1e6d8911bfbf tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95cfeacf062f486c985ca772f2f36faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f51fe43d7c143ebb6d53f5942941c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:02:54.252146 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-70e5e5d5-49d4-48e5-9cc1-1e6d8911bfbf tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] 10.222.0.26 "GET /compute/v2.1/servers/50a243fc-ec9e-4e15-a0c6-240c525af882" status: 200 len: 1332 microversion: 2.1 time: 0.713030 Oct 08 21:02:54.257780 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1335/2648] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:02:53 2022] GET /compute/v2.1/servers/50a243fc-ec9e-4e15-a0c6-240c525af882 => generated 1332 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:02:54.262995 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-8b5304f2-a259-441c-b082-bf8c34edfc67 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:02:54.263638 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-8b5304f2-a259-441c-b082-bf8c34edfc67 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] [instance: 570d4898-169b-4f6b-aef6-ab79ea0fbefd] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:02:54.285037 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8b5304f2-a259-441c-b082-bf8c34edfc67 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:54.285652 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8b5304f2-a259-441c-b082-bf8c34edfc67 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:54.286046 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8b5304f2-a259-441c-b082-bf8c34edfc67 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:54.286788 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8b5304f2-a259-441c-b082-bf8c34edfc67 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:54.287832 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8b5304f2-a259-441c-b082-bf8c34edfc67 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:54.288278 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8b5304f2-a259-441c-b082-bf8c34edfc67 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:54.291443 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:02:54.563298 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-d3df347a-ceb0-423a-8d8b-bea0b1f6d707 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f60e33f334465fac1148669de3f00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4735bf74f33a4739800d766c82d973d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:02:54.574934 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-d3df347a-ceb0-423a-8d8b-bea0b1f6d707 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] 10.222.0.26 "GET /compute/v2.1/servers/0e762f82-ada3-411d-9072-37e72381145d" status: 200 len: 1354 microversion: 2.1 time: 0.575738 Oct 08 21:02:54.586668 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1314/2649] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:02:53 2022] GET /compute/v2.1/servers/0e762f82-ada3-411d-9072-37e72381145d => generated 1354 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:02:54.602607 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-eb026ae6-c112-4005-ba96-e59bf925468b tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1846078484", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "networks": [{"uuid": "63b00ee0-8a90-4fc6-b2cb-2ad09c2d70ab"}]}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:02:54.605359 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-8b5304f2-a259-441c-b082-bf8c34edfc67 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2e13f1952a4e5bb23d57dd7fa31875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b2a56286924e2d953bebe717ce591b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:02:54.616073 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-8b5304f2-a259-441c-b082-bf8c34edfc67 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] 10.222.0.26 "GET /compute/v2.1/servers/570d4898-169b-4f6b-aef6-ab79ea0fbefd" status: 200 len: 1314 microversion: 2.1 time: 0.354483 Oct 08 21:02:54.616894 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1336/2650] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:02:54 2022] GET /compute/v2.1/servers/570d4898-169b-4f6b-aef6-ab79ea0fbefd => generated 1314 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:02:54.623730 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-7909c81e-f1cc-464c-8b72-48599eb30c1a tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:02:54.624549 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-7909c81e-f1cc-464c-8b72-48599eb30c1a tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: d7f3a7bd-a731-45de-a24b-e04e9d81358d] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:02:54.632047 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7909c81e-f1cc-464c-8b72-48599eb30c1a tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:54.632736 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7909c81e-f1cc-464c-8b72-48599eb30c1a tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:54.633367 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7909c81e-f1cc-464c-8b72-48599eb30c1a tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:54.645000 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7909c81e-f1cc-464c-8b72-48599eb30c1a tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:54.645559 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7909c81e-f1cc-464c-8b72-48599eb30c1a tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:54.646252 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7909c81e-f1cc-464c-8b72-48599eb30c1a tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:54.688374 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.network.neutron [None req-eb026ae6-c112-4005-ba96-e59bf925468b tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] validate_networks() for [('63b00ee0-8a90-4fc6-b2cb-2ad09c2d70ab', None, None, None, None, None)] {{(pid=140491) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 21:02:54.930502 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-7909c81e-f1cc-464c-8b72-48599eb30c1a tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:02:54.943015 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-7909c81e-f1cc-464c-8b72-48599eb30c1a tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/d7f3a7bd-a731-45de-a24b-e04e9d81358d" status: 200 len: 1542 microversion: 2.1 time: 0.324427 Oct 08 21:02:54.944920 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1337/2651] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:02:54 2022] GET /compute/v2.1/servers/d7f3a7bd-a731-45de-a24b-e04e9d81358d => generated 1542 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:02:54.951106 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-ef336c07-1e2f-488e-91e8-177da82a1520 req-0ddde2c3-828e-4198-ba4c-25feaf5e642a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7f3a7bd-a731-45de-a24b-e04e9d81358d", "name": "network-vif-unplugged", "status": "completed", "tag": "0a909b9a-561b-42d5-bf2f-d3cc0b3356b5"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:02:54.963062 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-ef336c07-1e2f-488e-91e8-177da82a1520 req-0ddde2c3-828e-4198-ba4c-25feaf5e642a service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:54.963565 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-ef336c07-1e2f-488e-91e8-177da82a1520 req-0ddde2c3-828e-4198-ba4c-25feaf5e642a service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:54.964013 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-ef336c07-1e2f-488e-91e8-177da82a1520 req-0ddde2c3-828e-4198-ba4c-25feaf5e642a service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:54.993149 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-ef336c07-1e2f-488e-91e8-177da82a1520 req-0ddde2c3-828e-4198-ba4c-25feaf5e642a service nova] Creating event network-vif-unplugged:0a909b9a-561b-42d5-bf2f-d3cc0b3356b5 for instance d7f3a7bd-a731-45de-a24b-e04e9d81358d on nch1-master-1 Oct 08 21:02:54.998940 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [req-ef336c07-1e2f-488e-91e8-177da82a1520 req-0ddde2c3-828e-4198-ba4c-25feaf5e642a service nova] Instance d7f3a7bd-a731-45de-a24b-e04e9d81358d is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140492) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 08 21:02:55.012477 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-ef336c07-1e2f-488e-91e8-177da82a1520 req-0ddde2c3-828e-4198-ba4c-25feaf5e642a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.066149 Oct 08 21:02:55.013535 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1338/2652] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:02:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:02:55.031859 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-c2297c24-5ec1-4b0d-86f7-77eb42ff9036 req-e2a9639d-bdde-455a-966e-9b8238e50003 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50a243fc-ec9e-4e15-a0c6-240c525af882", "name": "network-vif-plugged", "status": "completed", "tag": "87b9c9d6-fc1c-4415-b9ba-4d06b63de0b4"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:02:55.052277 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-c2297c24-5ec1-4b0d-86f7-77eb42ff9036 req-e2a9639d-bdde-455a-966e-9b8238e50003 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:55.053423 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-c2297c24-5ec1-4b0d-86f7-77eb42ff9036 req-e2a9639d-bdde-455a-966e-9b8238e50003 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:55.054622 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-c2297c24-5ec1-4b0d-86f7-77eb42ff9036 req-e2a9639d-bdde-455a-966e-9b8238e50003 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:55.074732 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-c2297c24-5ec1-4b0d-86f7-77eb42ff9036 req-e2a9639d-bdde-455a-966e-9b8238e50003 service nova] Creating event network-vif-plugged:87b9c9d6-fc1c-4415-b9ba-4d06b63de0b4 for instance 50a243fc-ec9e-4e15-a0c6-240c525af882 on nch1-master-1 Oct 08 21:02:55.080503 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-c2297c24-5ec1-4b0d-86f7-77eb42ff9036 req-e2a9639d-bdde-455a-966e-9b8238e50003 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064966 Oct 08 21:02:55.081294 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1339/2653] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:02:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:02:55.087224 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-068f467e-1294-4408-a253-48450cf72500 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:02:55.088371 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-068f467e-1294-4408-a253-48450cf72500 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] [instance: 4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:02:55.097607 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-068f467e-1294-4408-a253-48450cf72500 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:55.101417 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-068f467e-1294-4408-a253-48450cf72500 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:55.102522 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-068f467e-1294-4408-a253-48450cf72500 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:55.103595 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-068f467e-1294-4408-a253-48450cf72500 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:55.104478 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-068f467e-1294-4408-a253-48450cf72500 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:55.105283 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-068f467e-1294-4408-a253-48450cf72500 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:55.445980 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-068f467e-1294-4408-a253-48450cf72500 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1698dee4a2bf4ea19a6ee0c3d5cb5c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b00ee5e7828469f95bd90548d35982a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:02:55.456637 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-068f467e-1294-4408-a253-48450cf72500 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] 10.222.0.26 "GET /compute/v2.1/servers/4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711" status: 200 len: 1723 microversion: 2.1 time: 0.373967 Oct 08 21:02:55.458141 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1340/2654] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:02:55 2022] GET /compute/v2.1/servers/4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711 => generated 1723 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:02:55.465920 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-8dd92ca8-c2f0-4719-8e6f-8c575a9b7fce tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:02:55.467243 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-8dd92ca8-c2f0-4719-8e6f-8c575a9b7fce tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] [instance: 6e8a4e07-0b30-44a3-aa7d-8d4677cc1d5f] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:02:55.492136 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8dd92ca8-c2f0-4719-8e6f-8c575a9b7fce tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:55.492830 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8dd92ca8-c2f0-4719-8e6f-8c575a9b7fce tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:55.493735 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8dd92ca8-c2f0-4719-8e6f-8c575a9b7fce tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:55.494626 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8dd92ca8-c2f0-4719-8e6f-8c575a9b7fce tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:55.495238 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8dd92ca8-c2f0-4719-8e6f-8c575a9b7fce tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:55.495901 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8dd92ca8-c2f0-4719-8e6f-8c575a9b7fce tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:55.922759 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-eb026ae6-c112-4005-ba96-e59bf925468b tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Flavor limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 21:02:55.923900 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-eb026ae6-c112-4005-ba96-e59bf925468b tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Image limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 21:02:55.924630 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-eb026ae6-c112-4005-ba96-e59bf925468b tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Flavor pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 21:02:55.925299 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-eb026ae6-c112-4005-ba96-e59bf925468b tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Image pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 21:02:55.925926 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-eb026ae6-c112-4005-ba96-e59bf925468b tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 21:02:55.946338 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-eb026ae6-c112-4005-ba96-e59bf925468b tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:55.949111 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-eb026ae6-c112-4005-ba96-e59bf925468b tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:55.949773 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-eb026ae6-c112-4005-ba96-e59bf925468b tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:55.951730 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-eb026ae6-c112-4005-ba96-e59bf925468b tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:55.953485 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-eb026ae6-c112-4005-ba96-e59bf925468b tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:55.956848 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-eb026ae6-c112-4005-ba96-e59bf925468b tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:56.009546 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-eb026ae6-c112-4005-ba96-e59bf925468b tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Getting quotas for project bc9bed6d76834f6fa66d681ecd9f4e90. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:02:56.026996 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-eb026ae6-c112-4005-ba96-e59bf925468b tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Getting quotas for user 095debf3968c448fb3c3add0322d8d1b and project bc9bed6d76834f6fa66d681ecd9f4e90. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:02:56.057608 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-eb026ae6-c112-4005-ba96-e59bf925468b tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Going to run 1 instances... {{(pid=140491) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 21:02:56.062821 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-eb026ae6-c112-4005-ba96-e59bf925468b tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] [instance: 3d7debe3-3039-401c-891d-4c6e4b96cbb8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c508bd7f-7db9-4b2c-af7c-be54a855c355',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140491) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 21:02:56.136536 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-eb026ae6-c112-4005-ba96-e59bf925468b tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.541558 Oct 08 21:02:56.137946 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1315/2655] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 21:02:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 1550 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 08 21:02:56.153507 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-01d0d17d-45f1-403d-8ad2-5d6a3bc37c56 tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:02:56.154289 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-01d0d17d-45f1-403d-8ad2-5d6a3bc37c56 tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] [instance: 401433a8-84ff-4525-9a86-c0b6a517eeb3] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:02:56.176908 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-01d0d17d-45f1-403d-8ad2-5d6a3bc37c56 tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:56.178210 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-01d0d17d-45f1-403d-8ad2-5d6a3bc37c56 tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:56.180706 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-01d0d17d-45f1-403d-8ad2-5d6a3bc37c56 tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:56.181676 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-01d0d17d-45f1-403d-8ad2-5d6a3bc37c56 tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:56.186193 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-01d0d17d-45f1-403d-8ad2-5d6a3bc37c56 tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:56.187331 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-01d0d17d-45f1-403d-8ad2-5d6a3bc37c56 tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:56.341862 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-8dd92ca8-c2f0-4719-8e6f-8c575a9b7fce tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6088285b46499a98162b6237517174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b70cb43c39e4e0ba89680d7b8459c01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:02:56.351544 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-8dd92ca8-c2f0-4719-8e6f-8c575a9b7fce tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] 10.222.0.26 "GET /compute/v2.1/servers/6e8a4e07-0b30-44a3-aa7d-8d4677cc1d5f" status: 200 len: 1317 microversion: 2.1 time: 0.890565 Oct 08 21:02:56.357173 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1341/2656] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:02:55 2022] GET /compute/v2.1/servers/6e8a4e07-0b30-44a3-aa7d-8d4677cc1d5f => generated 1317 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:02:56.367294 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-c2684ed1-6dde-4aa0-84f1-44973a94e71b tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:02:56.369888 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-c2684ed1-6dde-4aa0-84f1-44973a94e71b tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] [instance: 50a243fc-ec9e-4e15-a0c6-240c525af882] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:02:56.379793 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c2684ed1-6dde-4aa0-84f1-44973a94e71b tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:56.380668 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c2684ed1-6dde-4aa0-84f1-44973a94e71b tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:56.381795 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c2684ed1-6dde-4aa0-84f1-44973a94e71b tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:56.382705 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c2684ed1-6dde-4aa0-84f1-44973a94e71b tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:56.383480 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c2684ed1-6dde-4aa0-84f1-44973a94e71b tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:56.384219 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c2684ed1-6dde-4aa0-84f1-44973a94e71b tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:56.595452 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-01d0d17d-45f1-403d-8ad2-5d6a3bc37c56 tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e3216124a4f41b2b931a16c750649df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0310d9e59942729d685e6eb06c6460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:02:56.610954 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-01d0d17d-45f1-403d-8ad2-5d6a3bc37c56 tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] 10.222.0.26 "GET /compute/v2.1/servers/401433a8-84ff-4525-9a86-c0b6a517eeb3" status: 200 len: 1369 microversion: 2.1 time: 0.470919 Oct 08 21:02:56.625546 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-c2684ed1-6dde-4aa0-84f1-44973a94e71b tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95cfeacf062f486c985ca772f2f36faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f51fe43d7c143ebb6d53f5942941c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:02:56.626001 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1316/2657] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:02:56 2022] GET /compute/v2.1/servers/401433a8-84ff-4525-9a86-c0b6a517eeb3 => generated 1369 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:02:56.629926 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-c2684ed1-6dde-4aa0-84f1-44973a94e71b tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] 10.222.0.26 "GET /compute/v2.1/servers/50a243fc-ec9e-4e15-a0c6-240c525af882" status: 200 len: 1332 microversion: 2.1 time: 0.271402 Oct 08 21:02:56.630527 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1342/2658] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:02:56 2022] GET /compute/v2.1/servers/50a243fc-ec9e-4e15-a0c6-240c525af882 => generated 1332 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:02:56.648591 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c5c8ea19-3a1d-47ba-9393-e9004c08753f tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:02:56.649487 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-c5c8ea19-3a1d-47ba-9393-e9004c08753f tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] [instance: 0e762f82-ada3-411d-9072-37e72381145d] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:02:56.652684 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-23c16842-4032-4b81-87f2-2664fc57d501 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:02:56.653454 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-23c16842-4032-4b81-87f2-2664fc57d501 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] [instance: 570d4898-169b-4f6b-aef6-ab79ea0fbefd] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:02:56.657623 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c5c8ea19-3a1d-47ba-9393-e9004c08753f tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:56.658408 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c5c8ea19-3a1d-47ba-9393-e9004c08753f tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:56.659193 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c5c8ea19-3a1d-47ba-9393-e9004c08753f tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:56.660391 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c5c8ea19-3a1d-47ba-9393-e9004c08753f tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:56.661049 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c5c8ea19-3a1d-47ba-9393-e9004c08753f tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:56.661784 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c5c8ea19-3a1d-47ba-9393-e9004c08753f tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:56.663202 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-23c16842-4032-4b81-87f2-2664fc57d501 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:56.663761 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-23c16842-4032-4b81-87f2-2664fc57d501 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:56.664223 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-23c16842-4032-4b81-87f2-2664fc57d501 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:56.664958 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-23c16842-4032-4b81-87f2-2664fc57d501 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:56.667710 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-23c16842-4032-4b81-87f2-2664fc57d501 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:56.668198 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-23c16842-4032-4b81-87f2-2664fc57d501 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:56.895820 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-c5c8ea19-3a1d-47ba-9393-e9004c08753f tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f60e33f334465fac1148669de3f00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4735bf74f33a4739800d766c82d973d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:02:56.904350 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-c5c8ea19-3a1d-47ba-9393-e9004c08753f tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] 10.222.0.26 "GET /compute/v2.1/servers/0e762f82-ada3-411d-9072-37e72381145d" status: 200 len: 1354 microversion: 2.1 time: 0.280223 Oct 08 21:02:56.904958 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1317/2659] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:02:56 2022] GET /compute/v2.1/servers/0e762f82-ada3-411d-9072-37e72381145d => generated 1354 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:02:56.909636 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-37e80a2b-fbb0-4488-9b71-3e7167b1bf0a tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:02:56.910735 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-37e80a2b-fbb0-4488-9b71-3e7167b1bf0a tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: d7f3a7bd-a731-45de-a24b-e04e9d81358d] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:02:56.917480 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-37e80a2b-fbb0-4488-9b71-3e7167b1bf0a tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:56.918254 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-37e80a2b-fbb0-4488-9b71-3e7167b1bf0a tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:56.918978 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-37e80a2b-fbb0-4488-9b71-3e7167b1bf0a tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:56.919954 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-37e80a2b-fbb0-4488-9b71-3e7167b1bf0a tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:56.920620 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-37e80a2b-fbb0-4488-9b71-3e7167b1bf0a tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:56.921279 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-37e80a2b-fbb0-4488-9b71-3e7167b1bf0a tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:56.957961 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-23c16842-4032-4b81-87f2-2664fc57d501 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2e13f1952a4e5bb23d57dd7fa31875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b2a56286924e2d953bebe717ce591b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:02:56.968093 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-23c16842-4032-4b81-87f2-2664fc57d501 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] 10.222.0.26 "GET /compute/v2.1/servers/570d4898-169b-4f6b-aef6-ab79ea0fbefd" status: 200 len: 1314 microversion: 2.1 time: 0.333038 Oct 08 21:02:56.981229 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1343/2660] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:02:56 2022] GET /compute/v2.1/servers/570d4898-169b-4f6b-aef6-ab79ea0fbefd => generated 1314 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:02:56.981229 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-90d9723d-5473-467b-9bb2-c997869373bd tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1698105440", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "451", "networks": [{"uuid": "63b00ee0-8a90-4fc6-b2cb-2ad09c2d70ab"}]}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:02:57.043557 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.network.neutron [None req-90d9723d-5473-467b-9bb2-c997869373bd tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] validate_networks() for [('63b00ee0-8a90-4fc6-b2cb-2ad09c2d70ab', None, None, None, None, None)] {{(pid=140492) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 21:02:57.567540 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-37e80a2b-fbb0-4488-9b71-3e7167b1bf0a tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:02:57.578765 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-37e80a2b-fbb0-4488-9b71-3e7167b1bf0a tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/d7f3a7bd-a731-45de-a24b-e04e9d81358d" status: 200 len: 1542 microversion: 2.1 time: 0.670958 Oct 08 21:02:57.579901 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1318/2661] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:02:56 2022] GET /compute/v2.1/servers/d7f3a7bd-a731-45de-a24b-e04e9d81358d => generated 1542 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:02:57.587640 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-ee147a13-8e72-4e34-b149-c8d2cf0072e1 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:02:57.588661 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-ee147a13-8e72-4e34-b149-c8d2cf0072e1 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] [instance: 4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:02:57.612243 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ee147a13-8e72-4e34-b149-c8d2cf0072e1 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:57.615606 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ee147a13-8e72-4e34-b149-c8d2cf0072e1 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:57.616653 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ee147a13-8e72-4e34-b149-c8d2cf0072e1 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:57.618944 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ee147a13-8e72-4e34-b149-c8d2cf0072e1 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:57.620890 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ee147a13-8e72-4e34-b149-c8d2cf0072e1 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:57.621588 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ee147a13-8e72-4e34-b149-c8d2cf0072e1 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:57.938756 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-ee147a13-8e72-4e34-b149-c8d2cf0072e1 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1698dee4a2bf4ea19a6ee0c3d5cb5c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b00ee5e7828469f95bd90548d35982a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:02:57.948442 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-ee147a13-8e72-4e34-b149-c8d2cf0072e1 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] 10.222.0.26 "GET /compute/v2.1/servers/4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711" status: 200 len: 1729 microversion: 2.1 time: 0.367276 Oct 08 21:02:57.949140 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1319/2662] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:02:57 2022] GET /compute/v2.1/servers/4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711 => generated 1729 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:02:57.953995 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-ce6886de-49d2-4f33-9501-73a1a1538017 req-edb4b7d0-0050-408c-8729-4a8fe3477e73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "401433a8-84ff-4525-9a86-c0b6a517eeb3", "name": "network-vif-plugged", "status": "completed", "tag": "47b7d203-baac-4d79-a17a-77efb2e4892e"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:02:57.965144 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-ce6886de-49d2-4f33-9501-73a1a1538017 req-edb4b7d0-0050-408c-8729-4a8fe3477e73 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:57.966142 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-ce6886de-49d2-4f33-9501-73a1a1538017 req-edb4b7d0-0050-408c-8729-4a8fe3477e73 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:57.966815 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-ce6886de-49d2-4f33-9501-73a1a1538017 req-edb4b7d0-0050-408c-8729-4a8fe3477e73 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:57.979507 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-ce6886de-49d2-4f33-9501-73a1a1538017 req-edb4b7d0-0050-408c-8729-4a8fe3477e73 service nova] Creating event network-vif-plugged:47b7d203-baac-4d79-a17a-77efb2e4892e for instance 401433a8-84ff-4525-9a86-c0b6a517eeb3 on nch2-master-1 Oct 08 21:02:57.984789 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-ce6886de-49d2-4f33-9501-73a1a1538017 req-edb4b7d0-0050-408c-8729-4a8fe3477e73 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033756 Oct 08 21:02:57.985308 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1320/2663] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:02:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:02:57.990323 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-ab7c657f-c1d0-41ff-b605-c018336c8742 req-0b2bbb2e-2240-4bcb-b97e-b42e6c450df0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "570d4898-169b-4f6b-aef6-ab79ea0fbefd", "tag": "ae67c0ac-063e-4061-b746-096da184c437"}, {"name": "network-changed", "server_uuid": "d7f3a7bd-a731-45de-a24b-e04e9d81358d", "tag": "0a909b9a-561b-42d5-bf2f-d3cc0b3356b5"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:02:58.002033 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-ab7c657f-c1d0-41ff-b605-c018336c8742 req-0b2bbb2e-2240-4bcb-b97e-b42e6c450df0 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:58.002033 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-ab7c657f-c1d0-41ff-b605-c018336c8742 req-0b2bbb2e-2240-4bcb-b97e-b42e6c450df0 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:58.002438 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-ab7c657f-c1d0-41ff-b605-c018336c8742 req-0b2bbb2e-2240-4bcb-b97e-b42e6c450df0 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:58.016093 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-ab7c657f-c1d0-41ff-b605-c018336c8742 req-0b2bbb2e-2240-4bcb-b97e-b42e6c450df0 service nova] Creating event network-changed:ae67c0ac-063e-4061-b746-096da184c437 for instance 570d4898-169b-4f6b-aef6-ab79ea0fbefd on nch1-master-1 Oct 08 21:02:58.016641 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-ab7c657f-c1d0-41ff-b605-c018336c8742 req-0b2bbb2e-2240-4bcb-b97e-b42e6c450df0 service nova] Creating event network-changed:0a909b9a-561b-42d5-bf2f-d3cc0b3356b5 for instance d7f3a7bd-a731-45de-a24b-e04e9d81358d on nch1-master-1 Oct 08 21:02:58.024878 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [req-ab7c657f-c1d0-41ff-b605-c018336c8742 req-0b2bbb2e-2240-4bcb-b97e-b42e6c450df0 service nova] Instance d7f3a7bd-a731-45de-a24b-e04e9d81358d is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140491) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 08 21:02:58.040239 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-ab7c657f-c1d0-41ff-b605-c018336c8742 req-0b2bbb2e-2240-4bcb-b97e-b42e6c450df0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.053439 Oct 08 21:02:58.041172 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1321/2664] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:02:57 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:02:58.046498 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-e6d854fb-c913-4ded-9439-e128cd6f7940 tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:02:58.047466 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-e6d854fb-c913-4ded-9439-e128cd6f7940 tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] [instance: 6e8a4e07-0b30-44a3-aa7d-8d4677cc1d5f] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:02:58.055041 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e6d854fb-c913-4ded-9439-e128cd6f7940 tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:58.055806 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e6d854fb-c913-4ded-9439-e128cd6f7940 tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:58.056502 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e6d854fb-c913-4ded-9439-e128cd6f7940 tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:58.057498 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e6d854fb-c913-4ded-9439-e128cd6f7940 tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:58.058125 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e6d854fb-c913-4ded-9439-e128cd6f7940 tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:58.058721 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e6d854fb-c913-4ded-9439-e128cd6f7940 tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:58.209952 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-90d9723d-5473-467b-9bb2-c997869373bd tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Flavor limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 21:02:58.210403 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-90d9723d-5473-467b-9bb2-c997869373bd tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Image limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 21:02:58.210896 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-90d9723d-5473-467b-9bb2-c997869373bd tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Flavor pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 21:02:58.211462 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-90d9723d-5473-467b-9bb2-c997869373bd tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Image pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 21:02:58.212108 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-90d9723d-5473-467b-9bb2-c997869373bd tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 21:02:58.223212 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-90d9723d-5473-467b-9bb2-c997869373bd tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:58.223947 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-90d9723d-5473-467b-9bb2-c997869373bd tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:58.224458 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-90d9723d-5473-467b-9bb2-c997869373bd tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:58.225954 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-90d9723d-5473-467b-9bb2-c997869373bd tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:58.227122 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-90d9723d-5473-467b-9bb2-c997869373bd tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:58.227740 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-90d9723d-5473-467b-9bb2-c997869373bd tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:58.247814 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-90d9723d-5473-467b-9bb2-c997869373bd tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Getting quotas for project bc9bed6d76834f6fa66d681ecd9f4e90. Resources: {'cores', 'instances', 'ram'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:02:58.254058 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-90d9723d-5473-467b-9bb2-c997869373bd tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Getting quotas for user 095debf3968c448fb3c3add0322d8d1b and project bc9bed6d76834f6fa66d681ecd9f4e90. Resources: {'cores', 'instances', 'ram'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:02:58.268117 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-90d9723d-5473-467b-9bb2-c997869373bd tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Going to run 1 instances... {{(pid=140492) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 21:02:58.270717 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-90d9723d-5473-467b-9bb2-c997869373bd tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] [instance: 0b52e623-6990-4978-811d-68fc294fe304] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c508bd7f-7db9-4b2c-af7c-be54a855c355',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140492) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 21:02:58.331527 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-90d9723d-5473-467b-9bb2-c997869373bd tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.360869 Oct 08 21:02:58.340213 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1344/2665] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 21:02:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 1365 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 08 21:02:58.342417 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-b1d4a013-b26a-4e28-94ef-d0f6ed4a2810 tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:02:58.343077 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-b1d4a013-b26a-4e28-94ef-d0f6ed4a2810 tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] [instance: 401433a8-84ff-4525-9a86-c0b6a517eeb3] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:02:58.355476 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b1d4a013-b26a-4e28-94ef-d0f6ed4a2810 tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:58.356217 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b1d4a013-b26a-4e28-94ef-d0f6ed4a2810 tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:58.356864 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b1d4a013-b26a-4e28-94ef-d0f6ed4a2810 tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:58.357692 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b1d4a013-b26a-4e28-94ef-d0f6ed4a2810 tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:58.358176 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b1d4a013-b26a-4e28-94ef-d0f6ed4a2810 tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:58.359732 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b1d4a013-b26a-4e28-94ef-d0f6ed4a2810 tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:58.452485 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-e6d854fb-c913-4ded-9439-e128cd6f7940 tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6088285b46499a98162b6237517174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b70cb43c39e4e0ba89680d7b8459c01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:02:58.464455 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-e6d854fb-c913-4ded-9439-e128cd6f7940 tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] 10.222.0.26 "GET /compute/v2.1/servers/6e8a4e07-0b30-44a3-aa7d-8d4677cc1d5f" status: 200 len: 1317 microversion: 2.1 time: 0.422065 Oct 08 21:02:58.469674 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1322/2666] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:02:58 2022] GET /compute/v2.1/servers/6e8a4e07-0b30-44a3-aa7d-8d4677cc1d5f => generated 1317 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:02:58.491849 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-0bba6f87-37e4-4ab2-a966-0dce1bcba4b6 tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:02:58.492786 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-0bba6f87-37e4-4ab2-a966-0dce1bcba4b6 tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] [instance: 50a243fc-ec9e-4e15-a0c6-240c525af882] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:02:58.499854 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0bba6f87-37e4-4ab2-a966-0dce1bcba4b6 tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:58.500696 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0bba6f87-37e4-4ab2-a966-0dce1bcba4b6 tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:58.501420 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0bba6f87-37e4-4ab2-a966-0dce1bcba4b6 tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:58.502605 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0bba6f87-37e4-4ab2-a966-0dce1bcba4b6 tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:58.503398 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0bba6f87-37e4-4ab2-a966-0dce1bcba4b6 tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:58.504027 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0bba6f87-37e4-4ab2-a966-0dce1bcba4b6 tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:58.693670 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-b1d4a013-b26a-4e28-94ef-d0f6ed4a2810 tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e3216124a4f41b2b931a16c750649df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0310d9e59942729d685e6eb06c6460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:02:58.709364 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-b1d4a013-b26a-4e28-94ef-d0f6ed4a2810 tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] 10.222.0.26 "GET /compute/v2.1/servers/401433a8-84ff-4525-9a86-c0b6a517eeb3" status: 200 len: 1369 microversion: 2.1 time: 0.372133 Oct 08 21:02:58.713146 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1345/2667] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:02:58 2022] GET /compute/v2.1/servers/401433a8-84ff-4525-9a86-c0b6a517eeb3 => generated 1369 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:02:58.730430 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-0d755633-4785-4339-a5d2-dbe01d4fbaea tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:02:58.731852 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-0d755633-4785-4339-a5d2-dbe01d4fbaea tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] [instance: 0e762f82-ada3-411d-9072-37e72381145d] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:02:58.753904 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0d755633-4785-4339-a5d2-dbe01d4fbaea tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:58.754640 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0d755633-4785-4339-a5d2-dbe01d4fbaea tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:58.755183 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0d755633-4785-4339-a5d2-dbe01d4fbaea tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:58.758976 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0d755633-4785-4339-a5d2-dbe01d4fbaea tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:58.759753 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0d755633-4785-4339-a5d2-dbe01d4fbaea tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:58.761219 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0d755633-4785-4339-a5d2-dbe01d4fbaea tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:58.881541 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-0bba6f87-37e4-4ab2-a966-0dce1bcba4b6 tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95cfeacf062f486c985ca772f2f36faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f51fe43d7c143ebb6d53f5942941c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:02:58.890426 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-0bba6f87-37e4-4ab2-a966-0dce1bcba4b6 tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] 10.222.0.26 "GET /compute/v2.1/servers/50a243fc-ec9e-4e15-a0c6-240c525af882" status: 200 len: 1536 microversion: 2.1 time: 0.419417 Oct 08 21:02:58.894189 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1323/2668] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:02:58 2022] GET /compute/v2.1/servers/50a243fc-ec9e-4e15-a0c6-240c525af882 => generated 1536 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:02:58.909835 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c4a39832-01aa-4a29-9437-a1b109ce4e5e tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:02:58.910531 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-c4a39832-01aa-4a29-9437-a1b109ce4e5e tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] [instance: 4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:02:58.934552 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c4a39832-01aa-4a29-9437-a1b109ce4e5e tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:58.935749 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c4a39832-01aa-4a29-9437-a1b109ce4e5e tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:58.938103 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c4a39832-01aa-4a29-9437-a1b109ce4e5e tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:58.942666 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c4a39832-01aa-4a29-9437-a1b109ce4e5e tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:58.945348 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c4a39832-01aa-4a29-9437-a1b109ce4e5e tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:58.946114 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c4a39832-01aa-4a29-9437-a1b109ce4e5e tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:59.181873 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-0d755633-4785-4339-a5d2-dbe01d4fbaea tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f60e33f334465fac1148669de3f00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4735bf74f33a4739800d766c82d973d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:02:59.204538 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-c4a39832-01aa-4a29-9437-a1b109ce4e5e tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] 10.222.0.26 "GET /compute/v2.1/servers/4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.308414 Oct 08 21:02:59.212715 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1324/2669] 10.222.0.26 () {58 vars in 1275 bytes} [Sat Oct 8 21:02:58 2022] GET /compute/v2.1/servers/4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711/os-interface => generated 285 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:02:59.218414 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-dfabb918-b2d6-4c46-97ce-3db62ca3a350 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:02:59.218941 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-dfabb918-b2d6-4c46-97ce-3db62ca3a350 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] [instance: 570d4898-169b-4f6b-aef6-ab79ea0fbefd] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:02:59.223141 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-0d755633-4785-4339-a5d2-dbe01d4fbaea tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] 10.222.0.26 "GET /compute/v2.1/servers/0e762f82-ada3-411d-9072-37e72381145d" status: 200 len: 1354 microversion: 2.1 time: 0.484338 Oct 08 21:02:59.228452 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1346/2670] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:02:58 2022] GET /compute/v2.1/servers/0e762f82-ada3-411d-9072-37e72381145d => generated 1354 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:02:59.236214 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e95589a1-3de9-4c1b-a678-218d81a613a8 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:02:59.237459 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-e95589a1-3de9-4c1b-a678-218d81a613a8 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] [instance: 0b52e623-6990-4978-811d-68fc294fe304] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:02:59.245533 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dfabb918-b2d6-4c46-97ce-3db62ca3a350 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:59.246358 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dfabb918-b2d6-4c46-97ce-3db62ca3a350 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:59.247088 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dfabb918-b2d6-4c46-97ce-3db62ca3a350 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:59.248344 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dfabb918-b2d6-4c46-97ce-3db62ca3a350 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:59.249346 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dfabb918-b2d6-4c46-97ce-3db62ca3a350 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:59.250013 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dfabb918-b2d6-4c46-97ce-3db62ca3a350 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:59.279662 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e95589a1-3de9-4c1b-a678-218d81a613a8 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:59.280199 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e95589a1-3de9-4c1b-a678-218d81a613a8 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:59.282753 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e95589a1-3de9-4c1b-a678-218d81a613a8 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:59.283522 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e95589a1-3de9-4c1b-a678-218d81a613a8 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:59.283993 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e95589a1-3de9-4c1b-a678-218d81a613a8 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:59.285325 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e95589a1-3de9-4c1b-a678-218d81a613a8 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:59.528601 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-e95589a1-3de9-4c1b-a678-218d81a613a8 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095debf3968c448fb3c3add0322d8d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc9bed6d76834f6fa66d681ecd9f4e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:02:59.538126 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-e95589a1-3de9-4c1b-a678-218d81a613a8 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] 10.222.0.26 "GET /compute/v2.1/servers/0b52e623-6990-4978-811d-68fc294fe304" status: 200 len: 1225 microversion: 2.1 time: 0.308043 Oct 08 21:02:59.542711 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1347/2671] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:02:59 2022] GET /compute/v2.1/servers/0b52e623-6990-4978-811d-68fc294fe304 => generated 1225 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:02:59.554198 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-0c8d0d18-a058-4c26-9539-23e6a33bd041 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:02:59.555156 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-0c8d0d18-a058-4c26-9539-23e6a33bd041 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: d7f3a7bd-a731-45de-a24b-e04e9d81358d] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:02:59.575469 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0c8d0d18-a058-4c26-9539-23e6a33bd041 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:59.576395 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0c8d0d18-a058-4c26-9539-23e6a33bd041 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:59.577050 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0c8d0d18-a058-4c26-9539-23e6a33bd041 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:59.578071 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0c8d0d18-a058-4c26-9539-23e6a33bd041 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:02:59.578746 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0c8d0d18-a058-4c26-9539-23e6a33bd041 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:02:59.579394 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0c8d0d18-a058-4c26-9539-23e6a33bd041 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:02:59.675330 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-dfabb918-b2d6-4c46-97ce-3db62ca3a350 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2e13f1952a4e5bb23d57dd7fa31875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b2a56286924e2d953bebe717ce591b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:02:59.680035 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=100 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:02:59.689587 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-dfabb918-b2d6-4c46-97ce-3db62ca3a350 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] 10.222.0.26 "GET /compute/v2.1/servers/570d4898-169b-4f6b-aef6-ab79ea0fbefd" status: 200 len: 1314 microversion: 2.1 time: 0.475609 Oct 08 21:02:59.701480 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1325/2672] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:02:59 2022] GET /compute/v2.1/servers/570d4898-169b-4f6b-aef6-ab79ea0fbefd => generated 1314 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:02:59.705482 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-88939e6c-48e0-4631-a4af-5654e038d620 tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Action: 'create', calling method: .version_select at 0x7f1a8c7b0790>, body: {"pool": "3c42c553-144c-41e7-a630-7c37a150f55f"} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:03:00.057999 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-0c8d0d18-a058-4c26-9539-23e6a33bd041 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:00.066913 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-0c8d0d18-a058-4c26-9539-23e6a33bd041 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/d7f3a7bd-a731-45de-a24b-e04e9d81358d" status: 200 len: 1474 microversion: 2.1 time: 0.522871 Oct 08 21:03:00.067499 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1348/2673] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:02:59 2022] GET /compute/v2.1/servers/d7f3a7bd-a731-45de-a24b-e04e9d81358d => generated 1474 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:00.072976 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-919e1ab8-d118-4e80-a113-de0403ab5fb3 req-9fb62a7c-f644-4167-a21b-a3fe930f9e2f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "814f7da9-1d8d-4695-8cfa-6db50c3e846a", "tag": "cd12e184-b7f8-4558-a631-e695359ed8f7"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:03:00.085042 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-919e1ab8-d118-4e80-a113-de0403ab5fb3 req-9fb62a7c-f644-4167-a21b-a3fe930f9e2f service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:00.086009 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-919e1ab8-d118-4e80-a113-de0403ab5fb3 req-9fb62a7c-f644-4167-a21b-a3fe930f9e2f service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:00.086449 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-919e1ab8-d118-4e80-a113-de0403ab5fb3 req-9fb62a7c-f644-4167-a21b-a3fe930f9e2f service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:00.099475 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-919e1ab8-d118-4e80-a113-de0403ab5fb3 req-9fb62a7c-f644-4167-a21b-a3fe930f9e2f service nova] Creating event network-changed:cd12e184-b7f8-4558-a631-e695359ed8f7 for instance 814f7da9-1d8d-4695-8cfa-6db50c3e846a on nch2-master-1 Oct 08 21:03:00.104596 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-919e1ab8-d118-4e80-a113-de0403ab5fb3 req-9fb62a7c-f644-4167-a21b-a3fe930f9e2f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035313 Oct 08 21:03:00.105487 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1349/2674] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:03:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:03:00.110660 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-297e5ebe-0a8c-4fc2-b947-84b09b271f51 tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:00.111545 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-297e5ebe-0a8c-4fc2-b947-84b09b271f51 tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] [instance: 6e8a4e07-0b30-44a3-aa7d-8d4677cc1d5f] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:00.118047 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-297e5ebe-0a8c-4fc2-b947-84b09b271f51 tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:00.118544 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-297e5ebe-0a8c-4fc2-b947-84b09b271f51 tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:00.118990 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-297e5ebe-0a8c-4fc2-b947-84b09b271f51 tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:00.119696 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-297e5ebe-0a8c-4fc2-b947-84b09b271f51 tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:00.120160 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-297e5ebe-0a8c-4fc2-b947-84b09b271f51 tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:00.120846 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-297e5ebe-0a8c-4fc2-b947-84b09b271f51 tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:00.863042 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-297e5ebe-0a8c-4fc2-b947-84b09b271f51 tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6088285b46499a98162b6237517174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b70cb43c39e4e0ba89680d7b8459c01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:00.876507 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-297e5ebe-0a8c-4fc2-b947-84b09b271f51 tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] 10.222.0.26 "GET /compute/v2.1/servers/6e8a4e07-0b30-44a3-aa7d-8d4677cc1d5f" status: 200 len: 1317 microversion: 2.1 time: 0.769639 Oct 08 21:03:00.877521 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1350/2675] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:00 2022] GET /compute/v2.1/servers/6e8a4e07-0b30-44a3-aa7d-8d4677cc1d5f => generated 1317 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:00.888370 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-d986997e-6ca4-4992-95a0-59af9763db6b tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:00.889334 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-d986997e-6ca4-4992-95a0-59af9763db6b tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] [instance: 401433a8-84ff-4525-9a86-c0b6a517eeb3] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:00.902844 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d986997e-6ca4-4992-95a0-59af9763db6b tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:00.903758 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d986997e-6ca4-4992-95a0-59af9763db6b tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:00.904365 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d986997e-6ca4-4992-95a0-59af9763db6b tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:00.906572 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d986997e-6ca4-4992-95a0-59af9763db6b tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:00.907249 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d986997e-6ca4-4992-95a0-59af9763db6b tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:00.908017 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d986997e-6ca4-4992-95a0-59af9763db6b tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:01.186990 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-d986997e-6ca4-4992-95a0-59af9763db6b tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e3216124a4f41b2b931a16c750649df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0310d9e59942729d685e6eb06c6460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:01.196455 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-d986997e-6ca4-4992-95a0-59af9763db6b tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] 10.222.0.26 "GET /compute/v2.1/servers/401433a8-84ff-4525-9a86-c0b6a517eeb3" status: 200 len: 1556 microversion: 2.1 time: 0.317537 Oct 08 21:03:01.197462 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1351/2676] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:00 2022] GET /compute/v2.1/servers/401433a8-84ff-4525-9a86-c0b6a517eeb3 => generated 1556 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:01.202181 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-1ae3911e-153b-4091-b79a-0a612cd8af35 req-005feea2-d53a-4365-95a3-beac85bfeb48 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e8a4e07-0b30-44a3-aa7d-8d4677cc1d5f", "tag": "e696087b-5fe1-4819-992b-75cf2676375b"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:03:01.212480 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-1ae3911e-153b-4091-b79a-0a612cd8af35 req-005feea2-d53a-4365-95a3-beac85bfeb48 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:01.213226 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-1ae3911e-153b-4091-b79a-0a612cd8af35 req-005feea2-d53a-4365-95a3-beac85bfeb48 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:01.213723 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-1ae3911e-153b-4091-b79a-0a612cd8af35 req-005feea2-d53a-4365-95a3-beac85bfeb48 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:01.226618 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-1ae3911e-153b-4091-b79a-0a612cd8af35 req-005feea2-d53a-4365-95a3-beac85bfeb48 service nova] Creating event network-changed:e696087b-5fe1-4819-992b-75cf2676375b for instance 6e8a4e07-0b30-44a3-aa7d-8d4677cc1d5f on nch2-master-1 Oct 08 21:03:01.231888 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-1ae3911e-153b-4091-b79a-0a612cd8af35 req-005feea2-d53a-4365-95a3-beac85bfeb48 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033207 Oct 08 21:03:01.232745 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1352/2677] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:03:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:03:01.237800 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-d8d17318-e792-47e6-ad11-bc235cd97c4c tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:01.238594 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-d8d17318-e792-47e6-ad11-bc235cd97c4c tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] [instance: 0e762f82-ada3-411d-9072-37e72381145d] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:01.245459 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d8d17318-e792-47e6-ad11-bc235cd97c4c tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:01.246047 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d8d17318-e792-47e6-ad11-bc235cd97c4c tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:01.246587 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d8d17318-e792-47e6-ad11-bc235cd97c4c tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:01.247374 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d8d17318-e792-47e6-ad11-bc235cd97c4c tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:01.247916 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d8d17318-e792-47e6-ad11-bc235cd97c4c tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:01.248430 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d8d17318-e792-47e6-ad11-bc235cd97c4c tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:01.504015 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-d8d17318-e792-47e6-ad11-bc235cd97c4c tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f60e33f334465fac1148669de3f00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4735bf74f33a4739800d766c82d973d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:01.515252 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-d8d17318-e792-47e6-ad11-bc235cd97c4c tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] 10.222.0.26 "GET /compute/v2.1/servers/0e762f82-ada3-411d-9072-37e72381145d" status: 200 len: 1354 microversion: 2.1 time: 0.280955 Oct 08 21:03:01.525218 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1353/2678] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:01 2022] GET /compute/v2.1/servers/0e762f82-ada3-411d-9072-37e72381145d => generated 1354 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:01.525218 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-dce4cb2e-6498-47c9-8e84-b077231547ec tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:01.525218 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-dce4cb2e-6498-47c9-8e84-b077231547ec tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] [instance: 0b52e623-6990-4978-811d-68fc294fe304] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:01.531714 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dce4cb2e-6498-47c9-8e84-b077231547ec tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:01.531714 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dce4cb2e-6498-47c9-8e84-b077231547ec tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:01.531714 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dce4cb2e-6498-47c9-8e84-b077231547ec tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:01.532054 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dce4cb2e-6498-47c9-8e84-b077231547ec tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:01.532946 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dce4cb2e-6498-47c9-8e84-b077231547ec tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:01.532946 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dce4cb2e-6498-47c9-8e84-b077231547ec tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:01.607570 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-dce4cb2e-6498-47c9-8e84-b077231547ec tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095debf3968c448fb3c3add0322d8d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc9bed6d76834f6fa66d681ecd9f4e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:01.616314 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-dce4cb2e-6498-47c9-8e84-b077231547ec tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] 10.222.0.26 "GET /compute/v2.1/servers/0b52e623-6990-4978-811d-68fc294fe304" status: 200 len: 1279 microversion: 2.1 time: 0.098884 Oct 08 21:03:01.617757 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1354/2679] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:01 2022] GET /compute/v2.1/servers/0b52e623-6990-4978-811d-68fc294fe304 => generated 1279 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:01.635208 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-d558cff0-e3c2-4c8f-b6cf-f26b07838c47 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:01.636495 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-d558cff0-e3c2-4c8f-b6cf-f26b07838c47 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] [instance: 570d4898-169b-4f6b-aef6-ab79ea0fbefd] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:01.644213 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d558cff0-e3c2-4c8f-b6cf-f26b07838c47 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:01.644810 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d558cff0-e3c2-4c8f-b6cf-f26b07838c47 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:01.645364 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d558cff0-e3c2-4c8f-b6cf-f26b07838c47 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:01.646303 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d558cff0-e3c2-4c8f-b6cf-f26b07838c47 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:01.646849 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d558cff0-e3c2-4c8f-b6cf-f26b07838c47 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:01.647368 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d558cff0-e3c2-4c8f-b6cf-f26b07838c47 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:01.822452 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-d558cff0-e3c2-4c8f-b6cf-f26b07838c47 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2e13f1952a4e5bb23d57dd7fa31875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b2a56286924e2d953bebe717ce591b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:01.826546 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=100 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:03:01.835724 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-d558cff0-e3c2-4c8f-b6cf-f26b07838c47 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] 10.222.0.26 "GET /compute/v2.1/servers/570d4898-169b-4f6b-aef6-ab79ea0fbefd" status: 200 len: 1314 microversion: 2.1 time: 0.206899 Oct 08 21:03:01.854284 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1355/2680] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:01 2022] GET /compute/v2.1/servers/570d4898-169b-4f6b-aef6-ab79ea0fbefd => generated 1314 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:01.860363 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-457ba9d3-9a00-4c3e-8624-6cbd93274624 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:01.861258 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-457ba9d3-9a00-4c3e-8624-6cbd93274624 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: d7f3a7bd-a731-45de-a24b-e04e9d81358d] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:01.877231 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-457ba9d3-9a00-4c3e-8624-6cbd93274624 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:01.878302 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-457ba9d3-9a00-4c3e-8624-6cbd93274624 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:01.878302 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-457ba9d3-9a00-4c3e-8624-6cbd93274624 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:01.879252 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-457ba9d3-9a00-4c3e-8624-6cbd93274624 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:01.881688 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-457ba9d3-9a00-4c3e-8624-6cbd93274624 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:01.882276 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-457ba9d3-9a00-4c3e-8624-6cbd93274624 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:02.063812 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-457ba9d3-9a00-4c3e-8624-6cbd93274624 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:02.076125 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-457ba9d3-9a00-4c3e-8624-6cbd93274624 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/d7f3a7bd-a731-45de-a24b-e04e9d81358d" status: 200 len: 1471 microversion: 2.1 time: 0.220228 Oct 08 21:03:02.108432 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1356/2681] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:01 2022] GET /compute/v2.1/servers/d7f3a7bd-a731-45de-a24b-e04e9d81358d => generated 1471 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:02.118120 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-2859f9b6-6af3-433a-8bab-04af8abd19d7 tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:02.118625 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-2859f9b6-6af3-433a-8bab-04af8abd19d7 tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] [instance: 401433a8-84ff-4525-9a86-c0b6a517eeb3] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:02.135218 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2859f9b6-6af3-433a-8bab-04af8abd19d7 tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:02.135218 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2859f9b6-6af3-433a-8bab-04af8abd19d7 tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:02.135607 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2859f9b6-6af3-433a-8bab-04af8abd19d7 tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:02.136478 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2859f9b6-6af3-433a-8bab-04af8abd19d7 tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:02.136950 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2859f9b6-6af3-433a-8bab-04af8abd19d7 tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:02.137459 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2859f9b6-6af3-433a-8bab-04af8abd19d7 tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:02.242424 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-2859f9b6-6af3-433a-8bab-04af8abd19d7 tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] 10.222.0.26 "GET /compute/v2.1/servers/401433a8-84ff-4525-9a86-c0b6a517eeb3/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.132705 Oct 08 21:03:02.243565 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1357/2682] 10.222.0.26 () {58 vars in 1275 bytes} [Sat Oct 8 21:03:02 2022] GET /compute/v2.1/servers/401433a8-84ff-4525-9a86-c0b6a517eeb3/os-interface => generated 285 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:03:02.249997 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-65138f07-d14f-417a-ad44-ecdff7e312bb tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:02.254637 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-65138f07-d14f-417a-ad44-ecdff7e312bb tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] [instance: 6e8a4e07-0b30-44a3-aa7d-8d4677cc1d5f] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:02.264411 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-65138f07-d14f-417a-ad44-ecdff7e312bb tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:02.272221 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-65138f07-d14f-417a-ad44-ecdff7e312bb tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:02.272710 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-65138f07-d14f-417a-ad44-ecdff7e312bb tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:02.273862 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-65138f07-d14f-417a-ad44-ecdff7e312bb tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:02.274055 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-65138f07-d14f-417a-ad44-ecdff7e312bb tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:02.274452 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-65138f07-d14f-417a-ad44-ecdff7e312bb tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:02.812812 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-65138f07-d14f-417a-ad44-ecdff7e312bb tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6088285b46499a98162b6237517174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b70cb43c39e4e0ba89680d7b8459c01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:02.840730 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-65138f07-d14f-417a-ad44-ecdff7e312bb tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] 10.222.0.26 "GET /compute/v2.1/servers/6e8a4e07-0b30-44a3-aa7d-8d4677cc1d5f" status: 200 len: 1317 microversion: 2.1 time: 0.594506 Oct 08 21:03:02.842103 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1358/2683] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:02 2022] GET /compute/v2.1/servers/6e8a4e07-0b30-44a3-aa7d-8d4677cc1d5f => generated 1317 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:02.852308 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-877daa15-950a-451e-b061-92013b3b4c7b tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:03:02.853298 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-877daa15-950a-451e-b061-92013b3b4c7b tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: d7f3a7bd-a731-45de-a24b-e04e9d81358d] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:02.869534 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-877daa15-950a-451e-b061-92013b3b4c7b tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:02.871402 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-877daa15-950a-451e-b061-92013b3b4c7b tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:02.872496 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-877daa15-950a-451e-b061-92013b3b4c7b tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:02.878354 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-877daa15-950a-451e-b061-92013b3b4c7b tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:02.898053 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-877daa15-950a-451e-b061-92013b3b4c7b tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:02.898516 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-877daa15-950a-451e-b061-92013b3b4c7b tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:02.969204 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-877daa15-950a-451e-b061-92013b3b4c7b tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:02.969402 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-877daa15-950a-451e-b061-92013b3b4c7b tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:02.969838 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-877daa15-950a-451e-b061-92013b3b4c7b tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:02.970646 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-877daa15-950a-451e-b061-92013b3b4c7b tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:02.971120 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-877daa15-950a-451e-b061-92013b3b4c7b tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:02.971559 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-877daa15-950a-451e-b061-92013b3b4c7b tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:03.024510 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-877daa15-950a-451e-b061-92013b3b4c7b tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Getting quotas for project 0ffdae031c4f47d599acb30f1d3c87b9. Resources: {'cores', 'ram'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:03:03.033274 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-877daa15-950a-451e-b061-92013b3b4c7b tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Getting quotas for user 5266cd6be4514b3eac30a195f6b25772 and project 0ffdae031c4f47d599acb30f1d3c87b9. Resources: {'cores', 'ram'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:03:03.200681 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-877daa15-950a-451e-b061-92013b3b4c7b tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "POST /compute/v2.1/servers/d7f3a7bd-a731-45de-a24b-e04e9d81358d/action" status: 202 len: 0 microversion: 2.1 time: 0.350072 Oct 08 21:03:03.201774 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1359/2684] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:03:02 2022] POST /compute/v2.1/servers/d7f3a7bd-a731-45de-a24b-e04e9d81358d/action => generated 0 bytes in 359 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 21:03:03.207966 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-aafd0494-8d9d-4f1d-84db-a5cf431078f0 req-1f929afc-b956-40b5-9992-abec337408cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711", "tag": "946a04d7-8297-4f58-81d9-eda02ade611b"}, {"name": "network-changed", "server_uuid": "4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711", "tag": "946a04d7-8297-4f58-81d9-eda02ade611b"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:03:03.220159 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-aafd0494-8d9d-4f1d-84db-a5cf431078f0 req-1f929afc-b956-40b5-9992-abec337408cc service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:03.220568 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-aafd0494-8d9d-4f1d-84db-a5cf431078f0 req-1f929afc-b956-40b5-9992-abec337408cc service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:03.221085 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-aafd0494-8d9d-4f1d-84db-a5cf431078f0 req-1f929afc-b956-40b5-9992-abec337408cc service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:03.238624 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-aafd0494-8d9d-4f1d-84db-a5cf431078f0 req-1f929afc-b956-40b5-9992-abec337408cc service nova] Creating event network-changed:946a04d7-8297-4f58-81d9-eda02ade611b for instance 4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711 on nch1-master-1 Oct 08 21:03:03.238624 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-aafd0494-8d9d-4f1d-84db-a5cf431078f0 req-1f929afc-b956-40b5-9992-abec337408cc service nova] Creating event network-changed:946a04d7-8297-4f58-81d9-eda02ade611b for instance 4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711 on nch1-master-1 Oct 08 21:03:03.244312 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-aafd0494-8d9d-4f1d-84db-a5cf431078f0 req-1f929afc-b956-40b5-9992-abec337408cc service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.041080 Oct 08 21:03:03.245366 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1360/2685] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:03:03 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:03:03.251663 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-42b9e016-e214-49a0-abea-edc3ca814069 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:03.252597 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-42b9e016-e214-49a0-abea-edc3ca814069 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] [instance: 0e762f82-ada3-411d-9072-37e72381145d] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:03.259992 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-42b9e016-e214-49a0-abea-edc3ca814069 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:03.260503 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-42b9e016-e214-49a0-abea-edc3ca814069 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:03.261094 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-42b9e016-e214-49a0-abea-edc3ca814069 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:03.261890 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-42b9e016-e214-49a0-abea-edc3ca814069 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:03.262370 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-42b9e016-e214-49a0-abea-edc3ca814069 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:03.263124 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-42b9e016-e214-49a0-abea-edc3ca814069 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:03.707184 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-42b9e016-e214-49a0-abea-edc3ca814069 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f60e33f334465fac1148669de3f00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4735bf74f33a4739800d766c82d973d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:03.725998 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-42b9e016-e214-49a0-abea-edc3ca814069 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] 10.222.0.26 "GET /compute/v2.1/servers/0e762f82-ada3-411d-9072-37e72381145d" status: 200 len: 1354 microversion: 2.1 time: 0.479099 Oct 08 21:03:03.742019 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1361/2686] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:03 2022] GET /compute/v2.1/servers/0e762f82-ada3-411d-9072-37e72381145d => generated 1354 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:03.747009 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-46e52393-802f-4fb8-91d3-eb169ebe951e req-553ca0c0-a508-4a55-b59a-d18cb06cd94a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e762f82-ada3-411d-9072-37e72381145d", "name": "network-vif-plugged", "status": "completed", "tag": "582a8fd3-4fba-41bc-be82-7424ac768342"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:03:03.758670 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-46e52393-802f-4fb8-91d3-eb169ebe951e req-553ca0c0-a508-4a55-b59a-d18cb06cd94a service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:03.759159 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-46e52393-802f-4fb8-91d3-eb169ebe951e req-553ca0c0-a508-4a55-b59a-d18cb06cd94a service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:03.759614 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-46e52393-802f-4fb8-91d3-eb169ebe951e req-553ca0c0-a508-4a55-b59a-d18cb06cd94a service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:03.772750 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-46e52393-802f-4fb8-91d3-eb169ebe951e req-553ca0c0-a508-4a55-b59a-d18cb06cd94a service nova] Creating event network-vif-plugged:582a8fd3-4fba-41bc-be82-7424ac768342 for instance 0e762f82-ada3-411d-9072-37e72381145d on nch2-master-1 Oct 08 21:03:03.777858 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-46e52393-802f-4fb8-91d3-eb169ebe951e req-553ca0c0-a508-4a55-b59a-d18cb06cd94a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034906 Oct 08 21:03:03.779156 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1362/2687] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:03:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:03:03.784311 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-b8710157-3c92-4513-b818-e172f5119183 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:03.785026 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-b8710157-3c92-4513-b818-e172f5119183 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] [instance: 0b52e623-6990-4978-811d-68fc294fe304] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:03.792136 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b8710157-3c92-4513-b818-e172f5119183 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:03.792620 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b8710157-3c92-4513-b818-e172f5119183 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:03.793110 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b8710157-3c92-4513-b818-e172f5119183 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:03.794157 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b8710157-3c92-4513-b818-e172f5119183 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:03.794347 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b8710157-3c92-4513-b818-e172f5119183 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:03.794742 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b8710157-3c92-4513-b818-e172f5119183 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:03.921947 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-b8710157-3c92-4513-b818-e172f5119183 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095debf3968c448fb3c3add0322d8d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc9bed6d76834f6fa66d681ecd9f4e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:03.934180 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-b8710157-3c92-4513-b818-e172f5119183 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] 10.222.0.26 "GET /compute/v2.1/servers/0b52e623-6990-4978-811d-68fc294fe304" status: 200 len: 1279 microversion: 2.1 time: 0.153757 Oct 08 21:03:03.950848 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1363/2688] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:03 2022] GET /compute/v2.1/servers/0b52e623-6990-4978-811d-68fc294fe304 => generated 1279 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:03.961079 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-b5f6bfe1-8d84-4691-98a4-e3a62e885dbf tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:03.963296 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-b5f6bfe1-8d84-4691-98a4-e3a62e885dbf tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] [instance: 570d4898-169b-4f6b-aef6-ab79ea0fbefd] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:03.974592 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b5f6bfe1-8d84-4691-98a4-e3a62e885dbf tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:03.975989 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b5f6bfe1-8d84-4691-98a4-e3a62e885dbf tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:03.976582 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b5f6bfe1-8d84-4691-98a4-e3a62e885dbf tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:03.977524 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b5f6bfe1-8d84-4691-98a4-e3a62e885dbf tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:03.978219 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b5f6bfe1-8d84-4691-98a4-e3a62e885dbf tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:03.978406 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b5f6bfe1-8d84-4691-98a4-e3a62e885dbf tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:04.550371 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-b5f6bfe1-8d84-4691-98a4-e3a62e885dbf tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2e13f1952a4e5bb23d57dd7fa31875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b2a56286924e2d953bebe717ce591b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:04.562579 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-b5f6bfe1-8d84-4691-98a4-e3a62e885dbf tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] 10.222.0.26 "GET /compute/v2.1/servers/570d4898-169b-4f6b-aef6-ab79ea0fbefd" status: 200 len: 1314 microversion: 2.1 time: 0.626268 Oct 08 21:03:04.569247 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1364/2689] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:03 2022] GET /compute/v2.1/servers/570d4898-169b-4f6b-aef6-ab79ea0fbefd => generated 1314 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:04.574837 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-224c5192-4dec-4328-90a4-5c27a01c7d8c tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:04.575697 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-224c5192-4dec-4328-90a4-5c27a01c7d8c tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: d7f3a7bd-a731-45de-a24b-e04e9d81358d] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:04.585852 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-224c5192-4dec-4328-90a4-5c27a01c7d8c tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:04.586545 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-224c5192-4dec-4328-90a4-5c27a01c7d8c tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:04.587093 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-224c5192-4dec-4328-90a4-5c27a01c7d8c tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:04.588280 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-224c5192-4dec-4328-90a4-5c27a01c7d8c tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:04.589563 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-224c5192-4dec-4328-90a4-5c27a01c7d8c tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:04.590127 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-224c5192-4dec-4328-90a4-5c27a01c7d8c tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:04.751559 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-224c5192-4dec-4328-90a4-5c27a01c7d8c tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:04.760820 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-224c5192-4dec-4328-90a4-5c27a01c7d8c tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/d7f3a7bd-a731-45de-a24b-e04e9d81358d" status: 200 len: 1470 microversion: 2.1 time: 0.194539 Oct 08 21:03:04.761660 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1365/2690] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:04 2022] GET /compute/v2.1/servers/d7f3a7bd-a731-45de-a24b-e04e9d81358d => generated 1470 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:04.766991 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-793d8fd7-e11e-476d-a436-7ae7fa7b732b tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:04.767900 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-793d8fd7-e11e-476d-a436-7ae7fa7b732b tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] [instance: 6e8a4e07-0b30-44a3-aa7d-8d4677cc1d5f] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:04.775397 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-793d8fd7-e11e-476d-a436-7ae7fa7b732b tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:04.775908 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-793d8fd7-e11e-476d-a436-7ae7fa7b732b tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:04.776356 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-793d8fd7-e11e-476d-a436-7ae7fa7b732b tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:04.777073 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-793d8fd7-e11e-476d-a436-7ae7fa7b732b tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:04.777574 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-793d8fd7-e11e-476d-a436-7ae7fa7b732b tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:04.778014 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-793d8fd7-e11e-476d-a436-7ae7fa7b732b tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:04.899325 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-88939e6c-48e0-4631-a4af-5654e038d620 tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] 10.222.0.26 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 5.201163 Oct 08 21:03:04.899943 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1326/2691] 10.222.0.26 () {60 vars in 1170 bytes} [Sat Oct 8 21:02:59 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 5202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:03:04.905493 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-a12fb8ac-9fa2-44b6-88af-819b7849177a tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:04.906263 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-a12fb8ac-9fa2-44b6-88af-819b7849177a tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] [instance: 0e762f82-ada3-411d-9072-37e72381145d] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:04.916856 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a12fb8ac-9fa2-44b6-88af-819b7849177a tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:04.917402 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a12fb8ac-9fa2-44b6-88af-819b7849177a tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:04.918016 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a12fb8ac-9fa2-44b6-88af-819b7849177a tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:04.919999 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a12fb8ac-9fa2-44b6-88af-819b7849177a tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:04.920626 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a12fb8ac-9fa2-44b6-88af-819b7849177a tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:04.921329 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a12fb8ac-9fa2-44b6-88af-819b7849177a tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:04.949114 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-793d8fd7-e11e-476d-a436-7ae7fa7b732b tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6088285b46499a98162b6237517174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b70cb43c39e4e0ba89680d7b8459c01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:04.959556 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-793d8fd7-e11e-476d-a436-7ae7fa7b732b tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] 10.222.0.26 "GET /compute/v2.1/servers/6e8a4e07-0b30-44a3-aa7d-8d4677cc1d5f" status: 200 len: 1317 microversion: 2.1 time: 0.196069 Oct 08 21:03:04.975435 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1366/2692] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:04 2022] GET /compute/v2.1/servers/6e8a4e07-0b30-44a3-aa7d-8d4677cc1d5f => generated 1317 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:04.982091 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-230123c7-02b5-438b-929e-819549df1b0b tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.5.192"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:03:04.985431 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-230123c7-02b5-438b-929e-819549df1b0b tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] [instance: 50a243fc-ec9e-4e15-a0c6-240c525af882] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:04.992968 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-230123c7-02b5-438b-929e-819549df1b0b tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:04.993465 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-230123c7-02b5-438b-929e-819549df1b0b tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:04.993917 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-230123c7-02b5-438b-929e-819549df1b0b tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:04.994649 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-230123c7-02b5-438b-929e-819549df1b0b tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:04.995114 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-230123c7-02b5-438b-929e-819549df1b0b tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:04.995544 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-230123c7-02b5-438b-929e-819549df1b0b tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:05.024036 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-230123c7-02b5-438b-929e-819549df1b0b tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Acquiring lock "refresh_cache-50a243fc-ec9e-4e15-a0c6-240c525af882" {{(pid=140492) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 08 21:03:05.024446 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-230123c7-02b5-438b-929e-819549df1b0b tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Acquired lock "refresh_cache-50a243fc-ec9e-4e15-a0c6-240c525af882" {{(pid=140492) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 08 21:03:05.964995 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-a12fb8ac-9fa2-44b6-88af-819b7849177a tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f60e33f334465fac1148669de3f00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4735bf74f33a4739800d766c82d973d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:05.980033 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-a12fb8ac-9fa2-44b6-88af-819b7849177a tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] 10.222.0.26 "GET /compute/v2.1/servers/0e762f82-ada3-411d-9072-37e72381145d" status: 200 len: 1354 microversion: 2.1 time: 1.078841 Oct 08 21:03:05.993701 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1327/2693] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:04 2022] GET /compute/v2.1/servers/0e762f82-ada3-411d-9072-37e72381145d => generated 1354 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:06.014130 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-91490de0-dcc2-4832-8a9e-d214cbdfef5c tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:06.017523 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-91490de0-dcc2-4832-8a9e-d214cbdfef5c tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] [instance: 0b52e623-6990-4978-811d-68fc294fe304] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:06.034264 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=6 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:03:06.038433 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-91490de0-dcc2-4832-8a9e-d214cbdfef5c tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:06.040354 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-91490de0-dcc2-4832-8a9e-d214cbdfef5c tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:06.041375 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-91490de0-dcc2-4832-8a9e-d214cbdfef5c tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:06.042748 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-91490de0-dcc2-4832-8a9e-d214cbdfef5c tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:06.044547 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-91490de0-dcc2-4832-8a9e-d214cbdfef5c tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:06.045160 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-91490de0-dcc2-4832-8a9e-d214cbdfef5c tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:06.048950 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=18 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:03:06.680430 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-91490de0-dcc2-4832-8a9e-d214cbdfef5c tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095debf3968c448fb3c3add0322d8d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc9bed6d76834f6fa66d681ecd9f4e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:06.689803 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-91490de0-dcc2-4832-8a9e-d214cbdfef5c tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] 10.222.0.26 "GET /compute/v2.1/servers/0b52e623-6990-4978-811d-68fc294fe304" status: 200 len: 1321 microversion: 2.1 time: 0.693398 Oct 08 21:03:06.690656 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1328/2694] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:05 2022] GET /compute/v2.1/servers/0b52e623-6990-4978-811d-68fc294fe304 => generated 1321 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:06.697962 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-59e685c8-c706-4281-84ae-34102aa9b058 req-01e45d6d-ff0b-40f2-88a8-1141626a60ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "401433a8-84ff-4525-9a86-c0b6a517eeb3", "tag": "47b7d203-baac-4d79-a17a-77efb2e4892e"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:03:06.715502 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.network.neutron [None req-230123c7-02b5-438b-929e-819549df1b0b tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] [instance: 50a243fc-ec9e-4e15-a0c6-240c525af882] Building network info cache for instance {{(pid=140492) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 08 21:03:06.732744 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-59e685c8-c706-4281-84ae-34102aa9b058 req-01e45d6d-ff0b-40f2-88a8-1141626a60ae service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:06.733419 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-59e685c8-c706-4281-84ae-34102aa9b058 req-01e45d6d-ff0b-40f2-88a8-1141626a60ae service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:06.733954 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-59e685c8-c706-4281-84ae-34102aa9b058 req-01e45d6d-ff0b-40f2-88a8-1141626a60ae service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:06.749119 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-59e685c8-c706-4281-84ae-34102aa9b058 req-01e45d6d-ff0b-40f2-88a8-1141626a60ae service nova] Creating event network-changed:47b7d203-baac-4d79-a17a-77efb2e4892e for instance 401433a8-84ff-4525-9a86-c0b6a517eeb3 on nch2-master-1 Oct 08 21:03:06.759209 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-59e685c8-c706-4281-84ae-34102aa9b058 req-01e45d6d-ff0b-40f2-88a8-1141626a60ae service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066288 Oct 08 21:03:06.766264 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1329/2695] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:03:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:03:06.771721 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-bdcc7261-f0c3-4185-8a30-85d8e5086ae2 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:06.773843 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-bdcc7261-f0c3-4185-8a30-85d8e5086ae2 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] [instance: 570d4898-169b-4f6b-aef6-ab79ea0fbefd] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:06.796975 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bdcc7261-f0c3-4185-8a30-85d8e5086ae2 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:06.797518 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bdcc7261-f0c3-4185-8a30-85d8e5086ae2 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:06.797966 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bdcc7261-f0c3-4185-8a30-85d8e5086ae2 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:06.798688 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bdcc7261-f0c3-4185-8a30-85d8e5086ae2 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:06.799335 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bdcc7261-f0c3-4185-8a30-85d8e5086ae2 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:06.799949 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bdcc7261-f0c3-4185-8a30-85d8e5086ae2 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:07.336949 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-bdcc7261-f0c3-4185-8a30-85d8e5086ae2 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2e13f1952a4e5bb23d57dd7fa31875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b2a56286924e2d953bebe717ce591b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:07.342949 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.network.neutron [None req-230123c7-02b5-438b-929e-819549df1b0b tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] [instance: 50a243fc-ec9e-4e15-a0c6-240c525af882] Updating instance_info_cache with network_info: [{"id": "87b9c9d6-fc1c-4415-b9ba-4d06b63de0b4", "address": "fa:16:3e:b6:e5:81", "network": {"id": "89cb3a4e-12f8-49ec-9464-0652fc2151e8", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1908016860-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.5.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "2f51fe43d7c143ebb6d53f5942941c9d", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap87b9c9d6-fc", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=140492) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 08 21:03:07.348515 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-bdcc7261-f0c3-4185-8a30-85d8e5086ae2 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] 10.222.0.26 "GET /compute/v2.1/servers/570d4898-169b-4f6b-aef6-ab79ea0fbefd" status: 200 len: 1314 microversion: 2.1 time: 0.580955 Oct 08 21:03:07.351496 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1330/2696] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:06 2022] GET /compute/v2.1/servers/570d4898-169b-4f6b-aef6-ab79ea0fbefd => generated 1314 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:07.358326 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-e6a420eb-e465-4928-8ac9-95ddce00c8ff tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:07.359061 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-230123c7-02b5-438b-929e-819549df1b0b tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Releasing lock "refresh_cache-50a243fc-ec9e-4e15-a0c6-240c525af882" {{(pid=140492) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 08 21:03:07.359548 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-e6a420eb-e465-4928-8ac9-95ddce00c8ff tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: d7f3a7bd-a731-45de-a24b-e04e9d81358d] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:07.360486 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-230123c7-02b5-438b-929e-819549df1b0b tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] 10.222.0.26 "POST /compute/v2.1/servers/50a243fc-ec9e-4e15-a0c6-240c525af882/action" status: 202 len: 0 microversion: 2.1 time: 2.383665 Oct 08 21:03:07.366364 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1367/2697] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:03:04 2022] POST /compute/v2.1/servers/50a243fc-ec9e-4e15-a0c6-240c525af882/action => generated 0 bytes in 2390 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 08 21:03:07.370054 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e6a420eb-e465-4928-8ac9-95ddce00c8ff tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:07.370958 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e6a420eb-e465-4928-8ac9-95ddce00c8ff tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:07.371922 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e6a420eb-e465-4928-8ac9-95ddce00c8ff tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:07.373176 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e6a420eb-e465-4928-8ac9-95ddce00c8ff tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:07.374162 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e6a420eb-e465-4928-8ac9-95ddce00c8ff tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:07.374861 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-fc04d6ee-c3d9-4f99-8556-97645c697c52 req-cbf7a3e5-c58a-4621-b6f5-1ff8a8c88021 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e762f82-ada3-411d-9072-37e72381145d", "name": "network-vif-plugged", "status": "completed", "tag": "c71c8a62-3e86-493c-9ee0-a514776c7ea0"}, {"server_uuid": "0e762f82-ada3-411d-9072-37e72381145d", "name": "network-vif-plugged", "status": "completed", "tag": "2311dae7-2451-42a1-9d7c-d14f8767e430"}, {"server_uuid": "570d4898-169b-4f6b-aef6-ab79ea0fbefd", "name": "network-vif-plugged", "status": "completed", "tag": "ae67c0ac-063e-4061-b746-096da184c437"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:03:07.375227 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e6a420eb-e465-4928-8ac9-95ddce00c8ff tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:07.388723 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-fc04d6ee-c3d9-4f99-8556-97645c697c52 req-cbf7a3e5-c58a-4621-b6f5-1ff8a8c88021 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:07.389539 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-fc04d6ee-c3d9-4f99-8556-97645c697c52 req-cbf7a3e5-c58a-4621-b6f5-1ff8a8c88021 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:07.391018 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-fc04d6ee-c3d9-4f99-8556-97645c697c52 req-cbf7a3e5-c58a-4621-b6f5-1ff8a8c88021 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:07.407700 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-fc04d6ee-c3d9-4f99-8556-97645c697c52 req-cbf7a3e5-c58a-4621-b6f5-1ff8a8c88021 service nova] Creating event network-vif-plugged:c71c8a62-3e86-493c-9ee0-a514776c7ea0 for instance 0e762f82-ada3-411d-9072-37e72381145d on nch2-master-1 Oct 08 21:03:07.409410 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-fc04d6ee-c3d9-4f99-8556-97645c697c52 req-cbf7a3e5-c58a-4621-b6f5-1ff8a8c88021 service nova] Creating event network-vif-plugged:2311dae7-2451-42a1-9d7c-d14f8767e430 for instance 0e762f82-ada3-411d-9072-37e72381145d on nch2-master-1 Oct 08 21:03:07.410130 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-fc04d6ee-c3d9-4f99-8556-97645c697c52 req-cbf7a3e5-c58a-4621-b6f5-1ff8a8c88021 service nova] Creating event network-vif-plugged:ae67c0ac-063e-4061-b746-096da184c437 for instance 570d4898-169b-4f6b-aef6-ab79ea0fbefd on nch1-master-1 Oct 08 21:03:07.422680 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-fc04d6ee-c3d9-4f99-8556-97645c697c52 req-cbf7a3e5-c58a-4621-b6f5-1ff8a8c88021 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.054175 Oct 08 21:03:07.424014 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1368/2698] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:03:07 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:03:07.431260 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-38f79cd1-7a48-4290-b62f-2b316c667d24 tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:07.432238 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-38f79cd1-7a48-4290-b62f-2b316c667d24 tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] [instance: 6e8a4e07-0b30-44a3-aa7d-8d4677cc1d5f] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:07.442584 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-38f79cd1-7a48-4290-b62f-2b316c667d24 tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:07.443516 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-38f79cd1-7a48-4290-b62f-2b316c667d24 tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:07.444126 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-38f79cd1-7a48-4290-b62f-2b316c667d24 tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:07.445032 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-38f79cd1-7a48-4290-b62f-2b316c667d24 tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:07.445687 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-38f79cd1-7a48-4290-b62f-2b316c667d24 tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:07.446303 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-38f79cd1-7a48-4290-b62f-2b316c667d24 tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:07.680595 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-38f79cd1-7a48-4290-b62f-2b316c667d24 tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6088285b46499a98162b6237517174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b70cb43c39e4e0ba89680d7b8459c01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:07.689850 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-38f79cd1-7a48-4290-b62f-2b316c667d24 tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] 10.222.0.26 "GET /compute/v2.1/servers/6e8a4e07-0b30-44a3-aa7d-8d4677cc1d5f" status: 200 len: 1317 microversion: 2.1 time: 0.264335 Oct 08 21:03:07.690440 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1369/2699] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:07 2022] GET /compute/v2.1/servers/6e8a4e07-0b30-44a3-aa7d-8d4677cc1d5f => generated 1317 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:07.696533 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-cea1af8d-8d03-4a7d-9202-b66960a53f41 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:07.697371 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-cea1af8d-8d03-4a7d-9202-b66960a53f41 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] [instance: 0e762f82-ada3-411d-9072-37e72381145d] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:07.700365 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:03:07.704206 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cea1af8d-8d03-4a7d-9202-b66960a53f41 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:07.705023 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cea1af8d-8d03-4a7d-9202-b66960a53f41 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:07.705556 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cea1af8d-8d03-4a7d-9202-b66960a53f41 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:07.706439 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cea1af8d-8d03-4a7d-9202-b66960a53f41 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:07.707020 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cea1af8d-8d03-4a7d-9202-b66960a53f41 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:07.707454 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cea1af8d-8d03-4a7d-9202-b66960a53f41 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:07.889018 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-cea1af8d-8d03-4a7d-9202-b66960a53f41 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f60e33f334465fac1148669de3f00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4735bf74f33a4739800d766c82d973d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:07.893935 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:03:07.899240 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-cea1af8d-8d03-4a7d-9202-b66960a53f41 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] 10.222.0.26 "GET /compute/v2.1/servers/0e762f82-ada3-411d-9072-37e72381145d" status: 200 len: 1354 microversion: 2.1 time: 0.207441 Oct 08 21:03:07.900420 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1370/2700] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:07 2022] GET /compute/v2.1/servers/0e762f82-ada3-411d-9072-37e72381145d => generated 1354 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:07.905611 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-83b5cb73-1148-4b53-b3c8-369d79e082ef tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Action: 'create', calling method: .version_select at 0x7f1a9149fc10>, body: {"pool": "3c42c553-144c-41e7-a630-7c37a150f55f"} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:03:08.113250 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-e6a420eb-e465-4928-8ac9-95ddce00c8ff tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:08.141642 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-e6a420eb-e465-4928-8ac9-95ddce00c8ff tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/d7f3a7bd-a731-45de-a24b-e04e9d81358d" status: 200 len: 1470 microversion: 2.1 time: 0.787419 Oct 08 21:03:08.144723 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1331/2701] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:07 2022] GET /compute/v2.1/servers/d7f3a7bd-a731-45de-a24b-e04e9d81358d => generated 1470 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:08.153529 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-ac7004b0-46a9-443d-8796-fbc29a846023 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:08.155040 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-ac7004b0-46a9-443d-8796-fbc29a846023 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] [instance: 0b52e623-6990-4978-811d-68fc294fe304] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:08.169232 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ac7004b0-46a9-443d-8796-fbc29a846023 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:08.171024 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ac7004b0-46a9-443d-8796-fbc29a846023 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:08.171509 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ac7004b0-46a9-443d-8796-fbc29a846023 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:08.172263 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ac7004b0-46a9-443d-8796-fbc29a846023 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:08.172732 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ac7004b0-46a9-443d-8796-fbc29a846023 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:08.173178 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ac7004b0-46a9-443d-8796-fbc29a846023 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:08.261923 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=12 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:03:08.763519 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-ac7004b0-46a9-443d-8796-fbc29a846023 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095debf3968c448fb3c3add0322d8d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc9bed6d76834f6fa66d681ecd9f4e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:08.773118 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-ac7004b0-46a9-443d-8796-fbc29a846023 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] 10.222.0.26 "GET /compute/v2.1/servers/0b52e623-6990-4978-811d-68fc294fe304" status: 200 len: 1321 microversion: 2.1 time: 0.626195 Oct 08 21:03:08.797689 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1332/2702] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:08 2022] GET /compute/v2.1/servers/0b52e623-6990-4978-811d-68fc294fe304 => generated 1321 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:08.802667 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-e390b7d0-8df8-4d69-bad9-12e3bab50365 req-c446703c-2bd5-4179-8474-a42656df488e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d7debe3-3039-401c-891d-4c6e4b96cbb8", "tag": "9be27357-49f2-42c9-a347-c6ce1c36dbff"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:03:08.818418 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-e390b7d0-8df8-4d69-bad9-12e3bab50365 req-c446703c-2bd5-4179-8474-a42656df488e service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:08.819167 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-e390b7d0-8df8-4d69-bad9-12e3bab50365 req-c446703c-2bd5-4179-8474-a42656df488e service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:08.819798 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-e390b7d0-8df8-4d69-bad9-12e3bab50365 req-c446703c-2bd5-4179-8474-a42656df488e service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:08.837462 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-e390b7d0-8df8-4d69-bad9-12e3bab50365 req-c446703c-2bd5-4179-8474-a42656df488e service nova] Creating event network-changed:9be27357-49f2-42c9-a347-c6ce1c36dbff for instance 3d7debe3-3039-401c-891d-4c6e4b96cbb8 on nch1-master-1 Oct 08 21:03:08.845275 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-e390b7d0-8df8-4d69-bad9-12e3bab50365 req-c446703c-2bd5-4179-8474-a42656df488e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045992 Oct 08 21:03:08.846409 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1333/2703] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:03:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:03:08.862005 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-f757b4c5-1750-46a0-ac5d-0c3cd116f56e tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:08.868071 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-f757b4c5-1750-46a0-ac5d-0c3cd116f56e tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] [instance: 570d4898-169b-4f6b-aef6-ab79ea0fbefd] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:08.877748 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f757b4c5-1750-46a0-ac5d-0c3cd116f56e tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:08.882217 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f757b4c5-1750-46a0-ac5d-0c3cd116f56e tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:08.883973 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f757b4c5-1750-46a0-ac5d-0c3cd116f56e tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:08.885402 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f757b4c5-1750-46a0-ac5d-0c3cd116f56e tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:08.885926 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f757b4c5-1750-46a0-ac5d-0c3cd116f56e tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:08.888379 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f757b4c5-1750-46a0-ac5d-0c3cd116f56e tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:09.333082 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-f757b4c5-1750-46a0-ac5d-0c3cd116f56e tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2e13f1952a4e5bb23d57dd7fa31875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b2a56286924e2d953bebe717ce591b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:09.343004 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-f757b4c5-1750-46a0-ac5d-0c3cd116f56e tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] 10.222.0.26 "GET /compute/v2.1/servers/570d4898-169b-4f6b-aef6-ab79ea0fbefd" status: 200 len: 1314 microversion: 2.1 time: 0.495138 Oct 08 21:03:09.344068 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1334/2704] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:08 2022] GET /compute/v2.1/servers/570d4898-169b-4f6b-aef6-ab79ea0fbefd => generated 1314 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:09.352048 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-7b4573f7-4133-4557-bdfa-941e21a648aa tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:09.352898 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-7b4573f7-4133-4557-bdfa-941e21a648aa tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] [instance: 6e8a4e07-0b30-44a3-aa7d-8d4677cc1d5f] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:09.360449 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7b4573f7-4133-4557-bdfa-941e21a648aa tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:09.361375 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7b4573f7-4133-4557-bdfa-941e21a648aa tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:09.362043 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7b4573f7-4133-4557-bdfa-941e21a648aa tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:09.363005 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7b4573f7-4133-4557-bdfa-941e21a648aa tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:09.363564 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7b4573f7-4133-4557-bdfa-941e21a648aa tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:09.364051 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7b4573f7-4133-4557-bdfa-941e21a648aa tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:09.422608 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-83b5cb73-1148-4b53-b3c8-369d79e082ef tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] 10.222.0.26 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 1.520915 Oct 08 21:03:09.423749 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1371/2705] 10.222.0.26 () {60 vars in 1170 bytes} [Sat Oct 8 21:03:07 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 1523 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:03:09.429757 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-868bb7b0-d855-4cbd-b94c-9f6cd0f321f0 req-97ede6e4-a162-4836-82e0-dcff43a9b988 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50a243fc-ec9e-4e15-a0c6-240c525af882", "tag": "87b9c9d6-fc1c-4415-b9ba-4d06b63de0b4"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:03:09.440096 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-868bb7b0-d855-4cbd-b94c-9f6cd0f321f0 req-97ede6e4-a162-4836-82e0-dcff43a9b988 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:09.440588 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-868bb7b0-d855-4cbd-b94c-9f6cd0f321f0 req-97ede6e4-a162-4836-82e0-dcff43a9b988 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:09.441029 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-868bb7b0-d855-4cbd-b94c-9f6cd0f321f0 req-97ede6e4-a162-4836-82e0-dcff43a9b988 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:09.453426 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-868bb7b0-d855-4cbd-b94c-9f6cd0f321f0 req-97ede6e4-a162-4836-82e0-dcff43a9b988 service nova] Creating event network-changed:87b9c9d6-fc1c-4415-b9ba-4d06b63de0b4 for instance 50a243fc-ec9e-4e15-a0c6-240c525af882 on nch1-master-1 Oct 08 21:03:09.458572 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-868bb7b0-d855-4cbd-b94c-9f6cd0f321f0 req-97ede6e4-a162-4836-82e0-dcff43a9b988 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033272 Oct 08 21:03:09.459163 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1372/2706] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:03:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:03:09.465404 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-81b9782a-6c05-46f1-92b4-e441b6fc66f3 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:09.466118 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-81b9782a-6c05-46f1-92b4-e441b6fc66f3 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] [instance: 0e762f82-ada3-411d-9072-37e72381145d] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:09.472252 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-81b9782a-6c05-46f1-92b4-e441b6fc66f3 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:09.472745 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-81b9782a-6c05-46f1-92b4-e441b6fc66f3 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:09.473208 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-81b9782a-6c05-46f1-92b4-e441b6fc66f3 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:09.479351 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-81b9782a-6c05-46f1-92b4-e441b6fc66f3 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:09.479351 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-81b9782a-6c05-46f1-92b4-e441b6fc66f3 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:09.479351 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-81b9782a-6c05-46f1-92b4-e441b6fc66f3 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:09.623704 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-81b9782a-6c05-46f1-92b4-e441b6fc66f3 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f60e33f334465fac1148669de3f00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4735bf74f33a4739800d766c82d973d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:09.631527 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-81b9782a-6c05-46f1-92b4-e441b6fc66f3 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] 10.222.0.26 "GET /compute/v2.1/servers/0e762f82-ada3-411d-9072-37e72381145d" status: 200 len: 1804 microversion: 2.1 time: 0.171259 Oct 08 21:03:09.632172 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1373/2707] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:09 2022] GET /compute/v2.1/servers/0e762f82-ada3-411d-9072-37e72381145d => generated 1804 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:09.636891 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e8f1e8e4-5789-4fec-9e83-94a67964b97d tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:09.637602 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-e8f1e8e4-5789-4fec-9e83-94a67964b97d tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: d7f3a7bd-a731-45de-a24b-e04e9d81358d] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:09.643602 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e8f1e8e4-5789-4fec-9e83-94a67964b97d tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:09.644753 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e8f1e8e4-5789-4fec-9e83-94a67964b97d tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:09.645121 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e8f1e8e4-5789-4fec-9e83-94a67964b97d tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:09.646326 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e8f1e8e4-5789-4fec-9e83-94a67964b97d tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:09.646980 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e8f1e8e4-5789-4fec-9e83-94a67964b97d tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:09.647628 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e8f1e8e4-5789-4fec-9e83-94a67964b97d tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:09.683197 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-7b4573f7-4133-4557-bdfa-941e21a648aa tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6088285b46499a98162b6237517174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b70cb43c39e4e0ba89680d7b8459c01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:09.691864 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-7b4573f7-4133-4557-bdfa-941e21a648aa tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] 10.222.0.26 "GET /compute/v2.1/servers/6e8a4e07-0b30-44a3-aa7d-8d4677cc1d5f" status: 200 len: 1317 microversion: 2.1 time: 0.345074 Oct 08 21:03:09.692848 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1335/2708] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:09 2022] GET /compute/v2.1/servers/6e8a4e07-0b30-44a3-aa7d-8d4677cc1d5f => generated 1317 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:09.698265 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-45b54054-6b72-4477-8545-0b9cfcbd3921 tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Action: 'action', calling method: .version_select at 0x7f1a8e646f70>, body: {"addFloatingIp": {"address": "172.35.5.105"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:03:09.701015 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-45b54054-6b72-4477-8545-0b9cfcbd3921 tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] [instance: 50a243fc-ec9e-4e15-a0c6-240c525af882] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:09.708276 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-45b54054-6b72-4477-8545-0b9cfcbd3921 tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:09.709149 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-45b54054-6b72-4477-8545-0b9cfcbd3921 tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:09.709863 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-45b54054-6b72-4477-8545-0b9cfcbd3921 tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:09.710711 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-45b54054-6b72-4477-8545-0b9cfcbd3921 tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:09.711275 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-45b54054-6b72-4477-8545-0b9cfcbd3921 tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:09.711812 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-45b54054-6b72-4477-8545-0b9cfcbd3921 tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:09.780410 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-45b54054-6b72-4477-8545-0b9cfcbd3921 tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Acquiring lock "refresh_cache-50a243fc-ec9e-4e15-a0c6-240c525af882" {{(pid=140491) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 08 21:03:09.781071 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-45b54054-6b72-4477-8545-0b9cfcbd3921 tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Acquired lock "refresh_cache-50a243fc-ec9e-4e15-a0c6-240c525af882" {{(pid=140491) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 08 21:03:09.796365 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-e8f1e8e4-5789-4fec-9e83-94a67964b97d tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:09.806124 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-e8f1e8e4-5789-4fec-9e83-94a67964b97d tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/d7f3a7bd-a731-45de-a24b-e04e9d81358d" status: 200 len: 1470 microversion: 2.1 time: 0.172709 Oct 08 21:03:09.817398 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1374/2709] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:09 2022] GET /compute/v2.1/servers/d7f3a7bd-a731-45de-a24b-e04e9d81358d => generated 1470 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:09.822987 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-ab252d83-1887-48ce-adf3-8726c1fc4d9b req-9ef63245-a913-42b4-9807-6476eb371763 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7f3a7bd-a731-45de-a24b-e04e9d81358d", "name": "network-vif-plugged", "status": "completed", "tag": "0a909b9a-561b-42d5-bf2f-d3cc0b3356b5"}, {"server_uuid": "6e8a4e07-0b30-44a3-aa7d-8d4677cc1d5f", "name": "network-vif-plugged", "status": "completed", "tag": "e696087b-5fe1-4819-992b-75cf2676375b"}, {"server_uuid": "814f7da9-1d8d-4695-8cfa-6db50c3e846a", "name": "network-vif-plugged", "status": "completed", "tag": "cd12e184-b7f8-4558-a631-e695359ed8f7"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:03:09.835073 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-ab252d83-1887-48ce-adf3-8726c1fc4d9b req-9ef63245-a913-42b4-9807-6476eb371763 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:09.835571 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-ab252d83-1887-48ce-adf3-8726c1fc4d9b req-9ef63245-a913-42b4-9807-6476eb371763 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:09.836021 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-ab252d83-1887-48ce-adf3-8726c1fc4d9b req-9ef63245-a913-42b4-9807-6476eb371763 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:09.851432 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-ab252d83-1887-48ce-adf3-8726c1fc4d9b req-9ef63245-a913-42b4-9807-6476eb371763 service nova] Creating event network-vif-plugged:0a909b9a-561b-42d5-bf2f-d3cc0b3356b5 for instance d7f3a7bd-a731-45de-a24b-e04e9d81358d on nch1-master-1 Oct 08 21:03:09.852456 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-ab252d83-1887-48ce-adf3-8726c1fc4d9b req-9ef63245-a913-42b4-9807-6476eb371763 service nova] Creating event network-vif-plugged:e696087b-5fe1-4819-992b-75cf2676375b for instance 6e8a4e07-0b30-44a3-aa7d-8d4677cc1d5f on nch2-master-1 Oct 08 21:03:09.852977 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-ab252d83-1887-48ce-adf3-8726c1fc4d9b req-9ef63245-a913-42b4-9807-6476eb371763 service nova] Creating event network-vif-plugged:cd12e184-b7f8-4558-a631-e695359ed8f7 for instance 814f7da9-1d8d-4695-8cfa-6db50c3e846a on nch2-master-1 Oct 08 21:03:09.858849 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [req-ab252d83-1887-48ce-adf3-8726c1fc4d9b req-9ef63245-a913-42b4-9807-6476eb371763 service nova] Instance d7f3a7bd-a731-45de-a24b-e04e9d81358d is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140492) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 08 21:03:09.874245 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-ab252d83-1887-48ce-adf3-8726c1fc4d9b req-9ef63245-a913-42b4-9807-6476eb371763 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.055052 Oct 08 21:03:09.875163 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1375/2710] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:03:09 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:03:09.880737 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-856952e1-9d9d-4c81-a029-70c17705e592 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:09.881407 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-856952e1-9d9d-4c81-a029-70c17705e592 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] [instance: 0e762f82-ada3-411d-9072-37e72381145d] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:09.888668 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-856952e1-9d9d-4c81-a029-70c17705e592 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:09.889230 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-856952e1-9d9d-4c81-a029-70c17705e592 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:09.889688 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-856952e1-9d9d-4c81-a029-70c17705e592 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:09.890417 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-856952e1-9d9d-4c81-a029-70c17705e592 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:09.890916 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-856952e1-9d9d-4c81-a029-70c17705e592 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:09.891355 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-856952e1-9d9d-4c81-a029-70c17705e592 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:09.919212 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-856952e1-9d9d-4c81-a029-70c17705e592 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] 10.222.0.26 "GET /compute/v2.1/servers/0e762f82-ada3-411d-9072-37e72381145d/ips" status: 200 len: 218 microversion: 2.1 time: 0.042506 Oct 08 21:03:09.926505 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1376/2711] 10.222.0.26 () {58 vars in 1248 bytes} [Sat Oct 8 21:03:09 2022] GET /compute/v2.1/servers/0e762f82-ada3-411d-9072-37e72381145d/ips => generated 218 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:03:09.932363 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-06c2170d-aa5f-488f-9582-3c37a44d7fb9 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:09.934155 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-06c2170d-aa5f-488f-9582-3c37a44d7fb9 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] [instance: 0b52e623-6990-4978-811d-68fc294fe304] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:09.941916 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-06c2170d-aa5f-488f-9582-3c37a44d7fb9 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:09.942751 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-06c2170d-aa5f-488f-9582-3c37a44d7fb9 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:09.943825 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-06c2170d-aa5f-488f-9582-3c37a44d7fb9 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:09.944889 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-06c2170d-aa5f-488f-9582-3c37a44d7fb9 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:09.945696 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-06c2170d-aa5f-488f-9582-3c37a44d7fb9 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:09.946390 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-06c2170d-aa5f-488f-9582-3c37a44d7fb9 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:10.152896 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-06c2170d-aa5f-488f-9582-3c37a44d7fb9 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095debf3968c448fb3c3add0322d8d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc9bed6d76834f6fa66d681ecd9f4e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:10.161509 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-06c2170d-aa5f-488f-9582-3c37a44d7fb9 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] 10.222.0.26 "GET /compute/v2.1/servers/0b52e623-6990-4978-811d-68fc294fe304" status: 200 len: 1321 microversion: 2.1 time: 0.232802 Oct 08 21:03:10.162791 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1377/2712] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:09 2022] GET /compute/v2.1/servers/0b52e623-6990-4978-811d-68fc294fe304 => generated 1321 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:10.167486 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-56b0b574-78a8-4e6b-8a57-6ee3931877f0 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:10.167997 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-56b0b574-78a8-4e6b-8a57-6ee3931877f0 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] [instance: 0e762f82-ada3-411d-9072-37e72381145d] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:10.173973 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-56b0b574-78a8-4e6b-8a57-6ee3931877f0 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:10.174542 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-56b0b574-78a8-4e6b-8a57-6ee3931877f0 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:10.174921 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-56b0b574-78a8-4e6b-8a57-6ee3931877f0 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:10.175827 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-56b0b574-78a8-4e6b-8a57-6ee3931877f0 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:10.176294 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-56b0b574-78a8-4e6b-8a57-6ee3931877f0 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:10.176742 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-56b0b574-78a8-4e6b-8a57-6ee3931877f0 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:10.205223 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-56b0b574-78a8-4e6b-8a57-6ee3931877f0 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] [instance: 0e762f82-ada3-411d-9072-37e72381145d] Going to try to terminate instance {{(pid=140492) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 21:03:10.308088 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-56b0b574-78a8-4e6b-8a57-6ee3931877f0 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] 10.222.0.26 "DELETE /compute/v2.1/servers/0e762f82-ada3-411d-9072-37e72381145d" status: 204 len: 0 microversion: 2.1 time: 0.144140 Oct 08 21:03:10.308700 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1378/2713] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:03:10 2022] DELETE /compute/v2.1/servers/0e762f82-ada3-411d-9072-37e72381145d => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 21:03:10.318299 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-cf1765d2-703f-4f44-a227-71cce5e76b0f tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:10.319048 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-cf1765d2-703f-4f44-a227-71cce5e76b0f tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] [instance: 0e762f82-ada3-411d-9072-37e72381145d] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:10.326654 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cf1765d2-703f-4f44-a227-71cce5e76b0f tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:10.327164 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cf1765d2-703f-4f44-a227-71cce5e76b0f tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:10.327621 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cf1765d2-703f-4f44-a227-71cce5e76b0f tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:10.328353 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cf1765d2-703f-4f44-a227-71cce5e76b0f tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:10.328824 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cf1765d2-703f-4f44-a227-71cce5e76b0f tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:10.329311 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cf1765d2-703f-4f44-a227-71cce5e76b0f tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:10.543841 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-cf1765d2-703f-4f44-a227-71cce5e76b0f tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f60e33f334465fac1148669de3f00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4735bf74f33a4739800d766c82d973d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:10.553375 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-cf1765d2-703f-4f44-a227-71cce5e76b0f tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] 10.222.0.26 "GET /compute/v2.1/servers/0e762f82-ada3-411d-9072-37e72381145d" status: 200 len: 1810 microversion: 2.1 time: 0.239376 Oct 08 21:03:10.554817 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1379/2714] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:10 2022] GET /compute/v2.1/servers/0e762f82-ada3-411d-9072-37e72381145d => generated 1810 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:10.559779 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-2d561a51-cb98-4679-87e2-521df0e6c469 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:10.560681 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-2d561a51-cb98-4679-87e2-521df0e6c469 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] [instance: 570d4898-169b-4f6b-aef6-ab79ea0fbefd] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:10.568282 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2d561a51-cb98-4679-87e2-521df0e6c469 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:10.568902 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2d561a51-cb98-4679-87e2-521df0e6c469 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:10.569634 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2d561a51-cb98-4679-87e2-521df0e6c469 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:10.570319 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2d561a51-cb98-4679-87e2-521df0e6c469 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:10.571274 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2d561a51-cb98-4679-87e2-521df0e6c469 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:10.571402 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2d561a51-cb98-4679-87e2-521df0e6c469 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:10.711988 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-2d561a51-cb98-4679-87e2-521df0e6c469 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2e13f1952a4e5bb23d57dd7fa31875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b2a56286924e2d953bebe717ce591b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:10.720426 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-2d561a51-cb98-4679-87e2-521df0e6c469 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] 10.222.0.26 "GET /compute/v2.1/servers/570d4898-169b-4f6b-aef6-ab79ea0fbefd" status: 200 len: 1500 microversion: 2.1 time: 0.164562 Oct 08 21:03:10.722466 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1380/2715] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:10 2022] GET /compute/v2.1/servers/570d4898-169b-4f6b-aef6-ab79ea0fbefd => generated 1500 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:10.738810 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-ee2dcbf8-b9c3-49b5-a43a-5c857333965d tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:10.740110 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-ee2dcbf8-b9c3-49b5-a43a-5c857333965d tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] [instance: 6e8a4e07-0b30-44a3-aa7d-8d4677cc1d5f] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:10.746518 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ee2dcbf8-b9c3-49b5-a43a-5c857333965d tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:10.747192 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ee2dcbf8-b9c3-49b5-a43a-5c857333965d tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:10.747720 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ee2dcbf8-b9c3-49b5-a43a-5c857333965d tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:10.748511 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ee2dcbf8-b9c3-49b5-a43a-5c857333965d tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:10.748987 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ee2dcbf8-b9c3-49b5-a43a-5c857333965d tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:10.749453 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ee2dcbf8-b9c3-49b5-a43a-5c857333965d tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:10.880024 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-ee2dcbf8-b9c3-49b5-a43a-5c857333965d tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6088285b46499a98162b6237517174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b70cb43c39e4e0ba89680d7b8459c01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:10.888740 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-ee2dcbf8-b9c3-49b5-a43a-5c857333965d tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] 10.222.0.26 "GET /compute/v2.1/servers/6e8a4e07-0b30-44a3-aa7d-8d4677cc1d5f" status: 200 len: 1317 microversion: 2.1 time: 0.154463 Oct 08 21:03:10.891481 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1381/2716] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:10 2022] GET /compute/v2.1/servers/6e8a4e07-0b30-44a3-aa7d-8d4677cc1d5f => generated 1317 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:10.896562 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-b90d1ca5-34cf-4dc6-913e-c4a72cf5f9d6 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:03:10.899123 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-b90d1ca5-34cf-4dc6-913e-c4a72cf5f9d6 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] [instance: 570d4898-169b-4f6b-aef6-ab79ea0fbefd] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:10.905276 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b90d1ca5-34cf-4dc6-913e-c4a72cf5f9d6 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:10.905783 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b90d1ca5-34cf-4dc6-913e-c4a72cf5f9d6 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:10.906277 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b90d1ca5-34cf-4dc6-913e-c4a72cf5f9d6 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:10.907093 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b90d1ca5-34cf-4dc6-913e-c4a72cf5f9d6 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:10.907597 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b90d1ca5-34cf-4dc6-913e-c4a72cf5f9d6 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:10.908036 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b90d1ca5-34cf-4dc6-913e-c4a72cf5f9d6 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:10.918754 ncdv-master-1 devstack@n-api.service[140491]: DEBUG neutronclient.v2_0.client [None req-45b54054-6b72-4477-8545-0b9cfcbd3921 tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.35.5.105 (d176a280-16da-4590-971c-6465149a2ba6) with port 87b9c9d6-fc1c-4415-b9ba-4d06b63de0b4 using fixed IP 172.20.0.5, as that fixed IP already has a floating IP on external network 3c42c553-144c-41e7-a630-7c37a150f55f.", "detail": ""}} {{(pid=140491) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 08 21:03:10.919417 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-45b54054-6b72-4477-8545-0b9cfcbd3921 tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Releasing lock "refresh_cache-50a243fc-ec9e-4e15-a0c6-240c525af882" {{(pid=140491) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 08 21:03:10.920042 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-45b54054-6b72-4477-8545-0b9cfcbd3921 tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] HTTP exception thrown: Cannot associate floating IP 172.35.5.105 (d176a280-16da-4590-971c-6465149a2ba6) with port 87b9c9d6-fc1c-4415-b9ba-4d06b63de0b4 using fixed IP 172.20.0.5, as that fixed IP already has a floating IP on external network 3c42c553-144c-41e7-a630-7c37a150f55f. Oct 08 21:03:10.920042 ncdv-master-1 devstack@n-api.service[140491]: Neutron server returns request_ids: ['req-6d62ab08-4258-4a7d-9ef0-b6b8760f6491'] Oct 08 21:03:10.923231 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-45b54054-6b72-4477-8545-0b9cfcbd3921 tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Request method failure captured: Oct 08 21:03:10.923231 ncdv-master-1 devstack@n-api.service[140491]: request: POST /compute/v2.1/servers/50a243fc-ec9e-4e15-a0c6-240c525af882/action HTTP/1.1 Oct 08 21:03:10.923231 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:03:10.923231 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:03:10.923231 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:03:10.923231 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 46 Oct 08 21:03:10.923231 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:03:10.923231 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:03:10.923231 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:03:10.923231 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:03:10.923231 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeVhytWoQnk6GVQNvRMaqutcfZ6oHhkZP17q3DZBE_Z-aIXrWYoWaZvOrCLjXswvQZhsvOMlQ97sPPGJvZ9uuo2pOaZbTZO4doq_hStRmKG5PBA9RC4Ww5qGjeV7Tyd28DZQ4iRmZpW-M76h1C_SCBWQG7sk3OM8xT1LaXoZt-RmIps Oct 08 21:03:10.923231 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:03:10.923231 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:03:10.923231 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:03:10.923231 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:03:10.923231 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:03:10.923231 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:03:10.923231 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 2f51fe43d7c143ebb6d53f5942941c9d Oct 08 21:03:10.923231 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-693193549 Oct 08 21:03:10.923231 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:03:10.923231 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:03:10.923231 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/2f51fe43d7c143ebb6d53f5942941c9d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2f51fe43d7c143ebb6d53f5942941c9d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_2f51fe43d7c143ebb6d53f5942941c9d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2f51fe43d7c143ebb6d53f5942941c9d"}]}] Oct 08 21:03:10.923231 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-693193549 Oct 08 21:03:10.923231 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 2f51fe43d7c143ebb6d53f5942941c9d Oct 08 21:03:10.923231 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-693193549 Oct 08 21:03:10.923231 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project Oct 08 21:03:10.923231 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:03:10.923231 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:03:10.923231 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 95cfeacf062f486c985ca772f2f36faf Oct 08 21:03:10.923231 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project Oct 08 21:03:10.923231 ncdv-master-1 devstack@n-api.service[140491]: Oct 08 21:03:10.923231 ncdv-master-1 devstack@n-api.service[140491]: {"addFloatingIp": {"address": "172.35.5.105"}} Oct 08 21:03:10.923231 ncdv-master-1 devstack@n-api.service[140491]: method: Oct 08 21:03:10.923231 ncdv-master-1 devstack@n-api.service[140491]: exception: Cannot associate floating IP 172.35.5.105 (d176a280-16da-4590-971c-6465149a2ba6) with port 87b9c9d6-fc1c-4415-b9ba-4d06b63de0b4 using fixed IP 172.20.0.5, as that fixed IP already has a floating IP on external network 3c42c553-144c-41e7-a630-7c37a150f55f. Oct 08 21:03:10.923231 ncdv-master-1 devstack@n-api.service[140491]: Neutron server returns request_ids: ['req-6d62ab08-4258-4a7d-9ef0-b6b8760f6491'] Oct 08 21:03:10.923231 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': '50a243fc-ec9e-4e15-a0c6-240c525af882', 'body': {'addFloatingIp': {'address': '172.35.5.105'}}} Oct 08 21:03:10.923231 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:03:10.923231 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:03:10.923231 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2703, in associate_floating_ip Oct 08 21:03:10.923231 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Oct 08 21:03:10.923231 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 08 21:03:10.923231 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 08 21:03:10.923231 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1016, in update_floatingip Oct 08 21:03:10.923231 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Oct 08 21:03:10.923231 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 08 21:03:10.923231 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 08 21:03:10.923231 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2548, in _update_resource Oct 08 21:03:10.923231 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Oct 08 21:03:10.923231 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 08 21:03:10.923231 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 08 21:03:10.923231 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Oct 08 21:03:10.923231 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Oct 08 21:03:10.923231 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 08 21:03:10.923231 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 08 21:03:10.923231 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 08 21:03:10.923231 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 08 21:03:10.923231 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 08 21:03:10.923231 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 08 21:03:10.923231 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 08 21:03:10.923231 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 08 21:03:10.931415 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 08 21:03:10.931415 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 08 21:03:10.931415 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 08 21:03:10.931415 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 08 21:03:10.931415 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 08 21:03:10.931415 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 08 21:03:10.931415 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.35.5.105 (d176a280-16da-4590-971c-6465149a2ba6) with port 87b9c9d6-fc1c-4415-b9ba-4d06b63de0b4 using fixed IP 172.20.0.5, as that fixed IP already has a floating IP on external network 3c42c553-144c-41e7-a630-7c37a150f55f. Oct 08 21:03:10.931415 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6d62ab08-4258-4a7d-9ef0-b6b8760f6491'] Oct 08 21:03:10.931415 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:03:10.931415 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:03:10.931415 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:03:10.931415 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:03:10.931415 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Oct 08 21:03:10.931415 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Oct 08 21:03:10.931415 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Oct 08 21:03:10.931415 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Oct 08 21:03:10.931415 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2705, in associate_floating_ip Oct 08 21:03:10.931415 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Oct 08 21:03:10.931415 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.35.5.105 (d176a280-16da-4590-971c-6465149a2ba6) with port 87b9c9d6-fc1c-4415-b9ba-4d06b63de0b4 using fixed IP 172.20.0.5, as that fixed IP already has a floating IP on external network 3c42c553-144c-41e7-a630-7c37a150f55f. Oct 08 21:03:10.931415 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6d62ab08-4258-4a7d-9ef0-b6b8760f6491'] Oct 08 21:03:10.931415 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:03:10.931415 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:03:10.931415 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:03:10.931415 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:03:10.931415 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:03:10.931415 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:03:10.931415 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:03:10.931415 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:03:10.931415 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 08 21:03:10.931415 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 08 21:03:10.931415 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:03:10.931415 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:03:10.931415 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 21:03:10.931415 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 21:03:10.931415 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Oct 08 21:03:10.931415 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Oct 08 21:03:10.931415 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.35.5.105 (d176a280-16da-4590-971c-6465149a2ba6) with port 87b9c9d6-fc1c-4415-b9ba-4d06b63de0b4 using fixed IP 172.20.0.5, as that fixed IP already has a floating IP on external network 3c42c553-144c-41e7-a630-7c37a150f55f. Oct 08 21:03:10.931415 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6d62ab08-4258-4a7d-9ef0-b6b8760f6491'] Oct 08 21:03:10.931415 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:03:10.931415 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:03:10.931415 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:03:10.931415 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:03:10.931415 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:03:10.931415 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:03:10.931415 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:03:10.931415 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:03:10.931415 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.35.5.105 (d176a280-16da-4590-971c-6465149a2ba6) with port 87b9c9d6-fc1c-4415-b9ba-4d06b63de0b4 using fixed IP 172.20.0.5, as that fixed IP already has a floating IP on external network 3c42c553-144c-41e7-a630-7c37a150f55f. Oct 08 21:03:10.931415 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6d62ab08-4258-4a7d-9ef0-b6b8760f6491'] Oct 08 21:03:10.931415 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:03:10.934733 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-45b54054-6b72-4477-8545-0b9cfcbd3921 tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Returning 400 to user: Cannot associate floating IP 172.35.5.105 (d176a280-16da-4590-971c-6465149a2ba6) with port 87b9c9d6-fc1c-4415-b9ba-4d06b63de0b4 using fixed IP 172.20.0.5, as that fixed IP already has a floating IP on external network 3c42c553-144c-41e7-a630-7c37a150f55f. Oct 08 21:03:10.934733 ncdv-master-1 devstack@n-api.service[140491]: Neutron server returns request_ids: ['req-6d62ab08-4258-4a7d-9ef0-b6b8760f6491'] {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:03:10.934733 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-45b54054-6b72-4477-8545-0b9cfcbd3921 tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] 10.222.0.26 "POST /compute/v2.1/servers/50a243fc-ec9e-4e15-a0c6-240c525af882/action" status: 400 len: 381 microversion: 2.1 time: 1.230431 Oct 08 21:03:10.934733 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1336/2717] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:03:09 2022] POST /compute/v2.1/servers/50a243fc-ec9e-4e15-a0c6-240c525af882/action => generated 381 bytes in 1232 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 08 21:03:10.934733 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-8045cba7-1fa3-4e2c-b35b-fc24ca0ae162 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:10.934733 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-8045cba7-1fa3-4e2c-b35b-fc24ca0ae162 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: d7f3a7bd-a731-45de-a24b-e04e9d81358d] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:10.935171 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.objects.instance [None req-b90d1ca5-34cf-4dc6-913e-c4a72cf5f9d6 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lazy-loading 'flavor' on Instance uuid 570d4898-169b-4f6b-aef6-ab79ea0fbefd {{(pid=140492) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 21:03:10.937899 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8045cba7-1fa3-4e2c-b35b-fc24ca0ae162 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:10.938390 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8045cba7-1fa3-4e2c-b35b-fc24ca0ae162 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:10.938951 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8045cba7-1fa3-4e2c-b35b-fc24ca0ae162 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:10.939589 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8045cba7-1fa3-4e2c-b35b-fc24ca0ae162 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:10.940041 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8045cba7-1fa3-4e2c-b35b-fc24ca0ae162 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:10.940468 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8045cba7-1fa3-4e2c-b35b-fc24ca0ae162 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:11.007313 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-b90d1ca5-34cf-4dc6-913e-c4a72cf5f9d6 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] 10.222.0.26 "POST /compute/v2.1/servers/570d4898-169b-4f6b-aef6-ab79ea0fbefd/action" status: 200 len: 32 microversion: 2.1 time: 0.114440 Oct 08 21:03:11.007948 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1382/2718] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:03:10 2022] POST /compute/v2.1/servers/570d4898-169b-4f6b-aef6-ab79ea0fbefd/action => generated 32 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 08 21:03:11.013388 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-b2c70d7d-4b61-4b9e-9186-23f3ec8de2a6 req-31f93d2b-c0f2-444a-b460-4c605a0944a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b52e623-6990-4978-811d-68fc294fe304", "tag": "d9c32cf0-f551-46d0-b582-c534f69aced9"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:03:11.023011 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-b2c70d7d-4b61-4b9e-9186-23f3ec8de2a6 req-31f93d2b-c0f2-444a-b460-4c605a0944a2 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:11.023503 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-b2c70d7d-4b61-4b9e-9186-23f3ec8de2a6 req-31f93d2b-c0f2-444a-b460-4c605a0944a2 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:11.023951 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-b2c70d7d-4b61-4b9e-9186-23f3ec8de2a6 req-31f93d2b-c0f2-444a-b460-4c605a0944a2 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:11.034988 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-b2c70d7d-4b61-4b9e-9186-23f3ec8de2a6 req-31f93d2b-c0f2-444a-b460-4c605a0944a2 service nova] Creating event network-changed:d9c32cf0-f551-46d0-b582-c534f69aced9 for instance 0b52e623-6990-4978-811d-68fc294fe304 on nch2-master-1 Oct 08 21:03:11.039791 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-b2c70d7d-4b61-4b9e-9186-23f3ec8de2a6 req-31f93d2b-c0f2-444a-b460-4c605a0944a2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030509 Oct 08 21:03:11.040584 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1383/2719] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:03:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:03:11.045334 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-dfd0e6c5-22b0-48f4-bab9-20be6952c142 tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Calling method '.version_select at 0x7f1a87e33790>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:11.081809 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-8045cba7-1fa3-4e2c-b35b-fc24ca0ae162 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:11.090023 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-8045cba7-1fa3-4e2c-b35b-fc24ca0ae162 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/d7f3a7bd-a731-45de-a24b-e04e9d81358d" status: 200 len: 1536 microversion: 2.1 time: 0.163788 Oct 08 21:03:11.090601 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1337/2720] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:10 2022] GET /compute/v2.1/servers/d7f3a7bd-a731-45de-a24b-e04e9d81358d => generated 1536 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:11.095203 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-b6da4c98-3101-44e7-bc22-b39c85b35439 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:11.095820 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-b6da4c98-3101-44e7-bc22-b39c85b35439 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] [instance: 570d4898-169b-4f6b-aef6-ab79ea0fbefd] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:11.103293 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b6da4c98-3101-44e7-bc22-b39c85b35439 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:11.103789 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b6da4c98-3101-44e7-bc22-b39c85b35439 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:11.104360 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b6da4c98-3101-44e7-bc22-b39c85b35439 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:11.105067 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b6da4c98-3101-44e7-bc22-b39c85b35439 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:11.105554 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b6da4c98-3101-44e7-bc22-b39c85b35439 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:11.105987 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b6da4c98-3101-44e7-bc22-b39c85b35439 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:11.237642 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-b6da4c98-3101-44e7-bc22-b39c85b35439 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2e13f1952a4e5bb23d57dd7fa31875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b2a56286924e2d953bebe717ce591b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:11.246513 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-b6da4c98-3101-44e7-bc22-b39c85b35439 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] 10.222.0.26 "GET /compute/v2.1/servers/570d4898-169b-4f6b-aef6-ab79ea0fbefd" status: 200 len: 1506 microversion: 2.1 time: 0.154953 Oct 08 21:03:11.247095 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1338/2721] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:11 2022] GET /compute/v2.1/servers/570d4898-169b-4f6b-aef6-ab79ea0fbefd => generated 1506 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:11.251702 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-580e41a1-2361-425f-8f60-40e8c9d5c2d7 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:11.252313 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-580e41a1-2361-425f-8f60-40e8c9d5c2d7 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] [instance: 0b52e623-6990-4978-811d-68fc294fe304] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:11.258905 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-580e41a1-2361-425f-8f60-40e8c9d5c2d7 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:11.259325 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-580e41a1-2361-425f-8f60-40e8c9d5c2d7 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:11.259762 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-580e41a1-2361-425f-8f60-40e8c9d5c2d7 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:11.260704 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-580e41a1-2361-425f-8f60-40e8c9d5c2d7 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:11.261158 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-580e41a1-2361-425f-8f60-40e8c9d5c2d7 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:11.261849 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-580e41a1-2361-425f-8f60-40e8c9d5c2d7 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:11.395678 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-580e41a1-2361-425f-8f60-40e8c9d5c2d7 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095debf3968c448fb3c3add0322d8d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc9bed6d76834f6fa66d681ecd9f4e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:11.404052 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-580e41a1-2361-425f-8f60-40e8c9d5c2d7 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] 10.222.0.26 "GET /compute/v2.1/servers/0b52e623-6990-4978-811d-68fc294fe304" status: 200 len: 1321 microversion: 2.1 time: 0.155950 Oct 08 21:03:11.404634 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1339/2722] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:11 2022] GET /compute/v2.1/servers/0b52e623-6990-4978-811d-68fc294fe304 => generated 1321 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:11.581742 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-2b7889ef-122a-4b1b-b97f-8fb57dedab2b tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:11.582517 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-2b7889ef-122a-4b1b-b97f-8fb57dedab2b tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] [instance: 0e762f82-ada3-411d-9072-37e72381145d] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:11.589263 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2b7889ef-122a-4b1b-b97f-8fb57dedab2b tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:11.589754 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2b7889ef-122a-4b1b-b97f-8fb57dedab2b tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:11.590192 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2b7889ef-122a-4b1b-b97f-8fb57dedab2b tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:11.590885 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2b7889ef-122a-4b1b-b97f-8fb57dedab2b tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:11.591344 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2b7889ef-122a-4b1b-b97f-8fb57dedab2b tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:11.591769 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2b7889ef-122a-4b1b-b97f-8fb57dedab2b tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:11.747697 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-2b7889ef-122a-4b1b-b97f-8fb57dedab2b tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f60e33f334465fac1148669de3f00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4735bf74f33a4739800d766c82d973d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:11.755835 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-2b7889ef-122a-4b1b-b97f-8fb57dedab2b tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] 10.222.0.26 "GET /compute/v2.1/servers/0e762f82-ada3-411d-9072-37e72381145d" status: 200 len: 1810 microversion: 2.1 time: 0.177990 Oct 08 21:03:11.756412 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1340/2723] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:11 2022] GET /compute/v2.1/servers/0e762f82-ada3-411d-9072-37e72381145d => generated 1810 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:11.796660 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-dfd0e6c5-22b0-48f4-bab9-20be6952c142 tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] 10.222.0.26 "DELETE /compute/v2.1/os-floating-ips/d176a280-16da-4590-971c-6465149a2ba6" status: 202 len: 0 microversion: 2.1 time: 0.755049 Oct 08 21:03:11.797271 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1384/2724] 10.222.0.26 () {58 vars in 1263 bytes} [Sat Oct 8 21:03:11 2022] DELETE /compute/v2.1/os-floating-ips/d176a280-16da-4590-971c-6465149a2ba6 => generated 0 bytes in 756 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 21:03:11.805450 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-756f0701-43af-4ffb-9034-da057c06cf12 tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Action: 'action', calling method: .version_select at 0x7f1a8e646430>, body: {"removeFloatingIp": {"address": "172.35.5.192"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:03:11.911361 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-eda0503a-ec9f-4c59-8810-4cc3df01562e tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:11.912215 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-eda0503a-ec9f-4c59-8810-4cc3df01562e tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] [instance: 6e8a4e07-0b30-44a3-aa7d-8d4677cc1d5f] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:11.918607 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-eda0503a-ec9f-4c59-8810-4cc3df01562e tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:11.919099 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-eda0503a-ec9f-4c59-8810-4cc3df01562e tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:11.919543 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-eda0503a-ec9f-4c59-8810-4cc3df01562e tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:11.920257 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-eda0503a-ec9f-4c59-8810-4cc3df01562e tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:11.920718 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-eda0503a-ec9f-4c59-8810-4cc3df01562e tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:11.921150 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-eda0503a-ec9f-4c59-8810-4cc3df01562e tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:12.062307 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-eda0503a-ec9f-4c59-8810-4cc3df01562e tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6088285b46499a98162b6237517174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b70cb43c39e4e0ba89680d7b8459c01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:12.070805 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-eda0503a-ec9f-4c59-8810-4cc3df01562e tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] 10.222.0.26 "GET /compute/v2.1/servers/6e8a4e07-0b30-44a3-aa7d-8d4677cc1d5f" status: 200 len: 1317 microversion: 2.1 time: 0.163496 Oct 08 21:03:12.071389 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1385/2725] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:11 2022] GET /compute/v2.1/servers/6e8a4e07-0b30-44a3-aa7d-8d4677cc1d5f => generated 1317 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:03:12.123678 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-412051c6-47c4-4840-b1c4-ade5bc95074c tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:12.124329 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-412051c6-47c4-4840-b1c4-ade5bc95074c tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: d7f3a7bd-a731-45de-a24b-e04e9d81358d] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:12.130973 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-412051c6-47c4-4840-b1c4-ade5bc95074c tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:12.131646 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-412051c6-47c4-4840-b1c4-ade5bc95074c tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:12.131961 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-412051c6-47c4-4840-b1c4-ade5bc95074c tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:12.132692 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-412051c6-47c4-4840-b1c4-ade5bc95074c tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:12.133158 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-412051c6-47c4-4840-b1c4-ade5bc95074c tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:12.133618 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-412051c6-47c4-4840-b1c4-ade5bc95074c tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:12.240551 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-756f0701-43af-4ffb-9034-da057c06cf12 tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] [instance: 50a243fc-ec9e-4e15-a0c6-240c525af882] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:12.252193 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-756f0701-43af-4ffb-9034-da057c06cf12 tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:12.253157 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-756f0701-43af-4ffb-9034-da057c06cf12 tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:12.253831 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-756f0701-43af-4ffb-9034-da057c06cf12 tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:12.256654 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-756f0701-43af-4ffb-9034-da057c06cf12 tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:12.258199 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-756f0701-43af-4ffb-9034-da057c06cf12 tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:12.259088 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-756f0701-43af-4ffb-9034-da057c06cf12 tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:12.277916 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-412051c6-47c4-4840-b1c4-ade5bc95074c tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:12.287264 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-412051c6-47c4-4840-b1c4-ade5bc95074c tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/d7f3a7bd-a731-45de-a24b-e04e9d81358d" status: 200 len: 1536 microversion: 2.1 time: 0.175478 Oct 08 21:03:12.297218 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1386/2726] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:12 2022] GET /compute/v2.1/servers/d7f3a7bd-a731-45de-a24b-e04e9d81358d => generated 1536 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:12.297218 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-d658552f-3cb4-491c-8a41-f0c01e686b1a req-4f845bc3-eaa0-4560-8617-d94e826dd132 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7f3a7bd-a731-45de-a24b-e04e9d81358d", "name": "network-vif-unplugged", "status": "completed", "tag": "0a909b9a-561b-42d5-bf2f-d3cc0b3356b5"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:03:12.314112 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-d658552f-3cb4-491c-8a41-f0c01e686b1a req-4f845bc3-eaa0-4560-8617-d94e826dd132 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:12.314701 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-d658552f-3cb4-491c-8a41-f0c01e686b1a req-4f845bc3-eaa0-4560-8617-d94e826dd132 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:12.315408 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-d658552f-3cb4-491c-8a41-f0c01e686b1a req-4f845bc3-eaa0-4560-8617-d94e826dd132 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:12.329164 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-d658552f-3cb4-491c-8a41-f0c01e686b1a req-4f845bc3-eaa0-4560-8617-d94e826dd132 service nova] Creating event network-vif-unplugged:0a909b9a-561b-42d5-bf2f-d3cc0b3356b5 for instance d7f3a7bd-a731-45de-a24b-e04e9d81358d on nch2-master-1 Oct 08 21:03:12.335520 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [req-d658552f-3cb4-491c-8a41-f0c01e686b1a req-4f845bc3-eaa0-4560-8617-d94e826dd132 service nova] Instance d7f3a7bd-a731-45de-a24b-e04e9d81358d is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140492) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 08 21:03:12.347202 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-d658552f-3cb4-491c-8a41-f0c01e686b1a req-4f845bc3-eaa0-4560-8617-d94e826dd132 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057576 Oct 08 21:03:12.348025 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1387/2727] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:03:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:03:12.355301 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e56a7f22-be19-4068-86de-7005795c3383 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:12.356025 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-e56a7f22-be19-4068-86de-7005795c3383 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] [instance: 570d4898-169b-4f6b-aef6-ab79ea0fbefd] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:12.362306 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e56a7f22-be19-4068-86de-7005795c3383 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:12.362825 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e56a7f22-be19-4068-86de-7005795c3383 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:12.363269 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e56a7f22-be19-4068-86de-7005795c3383 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:12.363991 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e56a7f22-be19-4068-86de-7005795c3383 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:12.364549 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e56a7f22-be19-4068-86de-7005795c3383 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:12.364997 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e56a7f22-be19-4068-86de-7005795c3383 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:12.369268 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:03:12.512175 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-e56a7f22-be19-4068-86de-7005795c3383 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2e13f1952a4e5bb23d57dd7fa31875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b2a56286924e2d953bebe717ce591b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:12.520165 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-e56a7f22-be19-4068-86de-7005795c3383 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] 10.222.0.26 "GET /compute/v2.1/servers/570d4898-169b-4f6b-aef6-ab79ea0fbefd" status: 200 len: 1506 microversion: 2.1 time: 0.169985 Oct 08 21:03:12.521325 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1388/2728] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:12 2022] GET /compute/v2.1/servers/570d4898-169b-4f6b-aef6-ab79ea0fbefd => generated 1506 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:12.525973 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-d0e0c035-bc5f-4d12-9d69-3b77d040e538 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:12.526605 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-d0e0c035-bc5f-4d12-9d69-3b77d040e538 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] [instance: 0b52e623-6990-4978-811d-68fc294fe304] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:12.532764 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d0e0c035-bc5f-4d12-9d69-3b77d040e538 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:12.533308 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d0e0c035-bc5f-4d12-9d69-3b77d040e538 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:12.533766 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d0e0c035-bc5f-4d12-9d69-3b77d040e538 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:12.534508 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d0e0c035-bc5f-4d12-9d69-3b77d040e538 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:12.535000 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d0e0c035-bc5f-4d12-9d69-3b77d040e538 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:12.535448 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d0e0c035-bc5f-4d12-9d69-3b77d040e538 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:12.670638 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-d0e0c035-bc5f-4d12-9d69-3b77d040e538 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095debf3968c448fb3c3add0322d8d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc9bed6d76834f6fa66d681ecd9f4e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:12.680127 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-d0e0c035-bc5f-4d12-9d69-3b77d040e538 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] 10.222.0.26 "GET /compute/v2.1/servers/0b52e623-6990-4978-811d-68fc294fe304" status: 200 len: 1321 microversion: 2.1 time: 0.157750 Oct 08 21:03:12.680738 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1389/2729] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:12 2022] GET /compute/v2.1/servers/0b52e623-6990-4978-811d-68fc294fe304 => generated 1321 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:12.780031 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-ea2e0fa7-6c2e-4cd9-b60f-a8bef74c3aab tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:12.780661 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-ea2e0fa7-6c2e-4cd9-b60f-a8bef74c3aab tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] [instance: 0e762f82-ada3-411d-9072-37e72381145d] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:12.787248 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ea2e0fa7-6c2e-4cd9-b60f-a8bef74c3aab tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:12.787743 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ea2e0fa7-6c2e-4cd9-b60f-a8bef74c3aab tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:12.788190 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ea2e0fa7-6c2e-4cd9-b60f-a8bef74c3aab tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:12.788909 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ea2e0fa7-6c2e-4cd9-b60f-a8bef74c3aab tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:12.789411 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ea2e0fa7-6c2e-4cd9-b60f-a8bef74c3aab tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:12.789846 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ea2e0fa7-6c2e-4cd9-b60f-a8bef74c3aab tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:12.935746 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-ea2e0fa7-6c2e-4cd9-b60f-a8bef74c3aab tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f60e33f334465fac1148669de3f00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4735bf74f33a4739800d766c82d973d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:12.943748 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-756f0701-43af-4ffb-9034-da057c06cf12 tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Acquiring lock "refresh_cache-50a243fc-ec9e-4e15-a0c6-240c525af882" {{(pid=140491) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 08 21:03:12.944914 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-756f0701-43af-4ffb-9034-da057c06cf12 tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Acquired lock "refresh_cache-50a243fc-ec9e-4e15-a0c6-240c525af882" {{(pid=140491) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 08 21:03:12.945140 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-ea2e0fa7-6c2e-4cd9-b60f-a8bef74c3aab tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] 10.222.0.26 "GET /compute/v2.1/servers/0e762f82-ada3-411d-9072-37e72381145d" status: 200 len: 1810 microversion: 2.1 time: 0.169048 Oct 08 21:03:12.945755 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1390/2730] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:12 2022] GET /compute/v2.1/servers/0e762f82-ada3-411d-9072-37e72381145d => generated 1810 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:03:13.093978 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-12c2070d-731f-472f-855e-149fea35116a tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:13.094673 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-12c2070d-731f-472f-855e-149fea35116a tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] [instance: 6e8a4e07-0b30-44a3-aa7d-8d4677cc1d5f] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:13.096705 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=7 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:03:13.102847 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-12c2070d-731f-472f-855e-149fea35116a tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:13.103801 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-12c2070d-731f-472f-855e-149fea35116a tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:13.103801 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-12c2070d-731f-472f-855e-149fea35116a tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:13.104513 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-12c2070d-731f-472f-855e-149fea35116a tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:13.104980 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-12c2070d-731f-472f-855e-149fea35116a tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:13.105462 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-12c2070d-731f-472f-855e-149fea35116a tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:13.388604 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-12c2070d-731f-472f-855e-149fea35116a tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6088285b46499a98162b6237517174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b70cb43c39e4e0ba89680d7b8459c01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:13.400604 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-12c2070d-731f-472f-855e-149fea35116a tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] 10.222.0.26 "GET /compute/v2.1/servers/6e8a4e07-0b30-44a3-aa7d-8d4677cc1d5f" status: 200 len: 1317 microversion: 2.1 time: 0.310569 Oct 08 21:03:13.414365 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1391/2731] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:13 2022] GET /compute/v2.1/servers/6e8a4e07-0b30-44a3-aa7d-8d4677cc1d5f => generated 1317 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:03:13.414365 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-f93a65d1-67b9-4405-92cb-c3bb5b301883 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:13.414365 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-f93a65d1-67b9-4405-92cb-c3bb5b301883 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: d7f3a7bd-a731-45de-a24b-e04e9d81358d] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:13.437943 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f93a65d1-67b9-4405-92cb-c3bb5b301883 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:13.439756 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f93a65d1-67b9-4405-92cb-c3bb5b301883 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:13.440434 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f93a65d1-67b9-4405-92cb-c3bb5b301883 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:13.444378 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f93a65d1-67b9-4405-92cb-c3bb5b301883 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:13.445133 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f93a65d1-67b9-4405-92cb-c3bb5b301883 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:13.447222 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f93a65d1-67b9-4405-92cb-c3bb5b301883 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:14.184222 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-f93a65d1-67b9-4405-92cb-c3bb5b301883 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:14.194190 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-f93a65d1-67b9-4405-92cb-c3bb5b301883 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/d7f3a7bd-a731-45de-a24b-e04e9d81358d" status: 200 len: 1536 microversion: 2.1 time: 0.788302 Oct 08 21:03:14.210186 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1392/2732] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:13 2022] GET /compute/v2.1/servers/d7f3a7bd-a731-45de-a24b-e04e9d81358d => generated 1536 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:14.215421 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-7a95786e-1dc0-4c68-914a-513e11d0215a tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:14.216502 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-7a95786e-1dc0-4c68-914a-513e11d0215a tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] [instance: 570d4898-169b-4f6b-aef6-ab79ea0fbefd] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:14.225213 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7a95786e-1dc0-4c68-914a-513e11d0215a tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:14.227974 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7a95786e-1dc0-4c68-914a-513e11d0215a tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:14.228441 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7a95786e-1dc0-4c68-914a-513e11d0215a tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:14.229211 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7a95786e-1dc0-4c68-914a-513e11d0215a tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:14.229879 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7a95786e-1dc0-4c68-914a-513e11d0215a tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:14.230598 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7a95786e-1dc0-4c68-914a-513e11d0215a tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:14.556481 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.network.neutron [None req-756f0701-43af-4ffb-9034-da057c06cf12 tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] [instance: 50a243fc-ec9e-4e15-a0c6-240c525af882] Building network info cache for instance {{(pid=140491) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 08 21:03:14.563951 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-7a95786e-1dc0-4c68-914a-513e11d0215a tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2e13f1952a4e5bb23d57dd7fa31875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b2a56286924e2d953bebe717ce591b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:14.574375 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-7a95786e-1dc0-4c68-914a-513e11d0215a tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] 10.222.0.26 "GET /compute/v2.1/servers/570d4898-169b-4f6b-aef6-ab79ea0fbefd" status: 200 len: 1506 microversion: 2.1 time: 0.362323 Oct 08 21:03:14.592386 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1393/2733] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:14 2022] GET /compute/v2.1/servers/570d4898-169b-4f6b-aef6-ab79ea0fbefd => generated 1506 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:14.597905 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-358c21b4-355a-4096-9bd0-e6b65288c4f3 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:14.599409 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-358c21b4-355a-4096-9bd0-e6b65288c4f3 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] [instance: 0b52e623-6990-4978-811d-68fc294fe304] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:14.616317 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-358c21b4-355a-4096-9bd0-e6b65288c4f3 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:14.617055 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-358c21b4-355a-4096-9bd0-e6b65288c4f3 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:14.617675 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-358c21b4-355a-4096-9bd0-e6b65288c4f3 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:14.619589 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-358c21b4-355a-4096-9bd0-e6b65288c4f3 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:14.623516 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-358c21b4-355a-4096-9bd0-e6b65288c4f3 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:14.624177 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-358c21b4-355a-4096-9bd0-e6b65288c4f3 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:14.926567 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-358c21b4-355a-4096-9bd0-e6b65288c4f3 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095debf3968c448fb3c3add0322d8d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc9bed6d76834f6fa66d681ecd9f4e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:14.939997 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-358c21b4-355a-4096-9bd0-e6b65288c4f3 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] 10.222.0.26 "GET /compute/v2.1/servers/0b52e623-6990-4978-811d-68fc294fe304" status: 200 len: 1321 microversion: 2.1 time: 0.345256 Oct 08 21:03:14.955508 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1394/2734] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:14 2022] GET /compute/v2.1/servers/0b52e623-6990-4978-811d-68fc294fe304 => generated 1321 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:14.965422 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-77720cf3-3dda-4583-959a-c21c626f3e85 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:14.966898 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-77720cf3-3dda-4583-959a-c21c626f3e85 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] [instance: 0e762f82-ada3-411d-9072-37e72381145d] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:14.981332 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-77720cf3-3dda-4583-959a-c21c626f3e85 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:14.982216 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-77720cf3-3dda-4583-959a-c21c626f3e85 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:14.982830 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-77720cf3-3dda-4583-959a-c21c626f3e85 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:14.984273 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-77720cf3-3dda-4583-959a-c21c626f3e85 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:14.984923 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-77720cf3-3dda-4583-959a-c21c626f3e85 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:14.985547 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-77720cf3-3dda-4583-959a-c21c626f3e85 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:15.405304 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.network.neutron [None req-756f0701-43af-4ffb-9034-da057c06cf12 tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] [instance: 50a243fc-ec9e-4e15-a0c6-240c525af882] Updating instance_info_cache with network_info: [{"id": "87b9c9d6-fc1c-4415-b9ba-4d06b63de0b4", "address": "fa:16:3e:b6:e5:81", "network": {"id": "89cb3a4e-12f8-49ec-9464-0652fc2151e8", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1908016860-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "2f51fe43d7c143ebb6d53f5942941c9d", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap87b9c9d6-fc", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=140491) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 08 21:03:15.421836 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-756f0701-43af-4ffb-9034-da057c06cf12 tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Releasing lock "refresh_cache-50a243fc-ec9e-4e15-a0c6-240c525af882" {{(pid=140491) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 08 21:03:15.423023 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-756f0701-43af-4ffb-9034-da057c06cf12 tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] 10.222.0.26 "POST /compute/v2.1/servers/50a243fc-ec9e-4e15-a0c6-240c525af882/action" status: 202 len: 0 microversion: 2.1 time: 3.621426 Oct 08 21:03:15.427456 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1341/2735] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:03:11 2022] POST /compute/v2.1/servers/50a243fc-ec9e-4e15-a0c6-240c525af882/action => generated 0 bytes in 3623 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 08 21:03:15.431904 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-1124715a-a711-40fd-b4f3-5691b69866fc tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:15.432462 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-1124715a-a711-40fd-b4f3-5691b69866fc tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] [instance: 6e8a4e07-0b30-44a3-aa7d-8d4677cc1d5f] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:15.439278 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1124715a-a711-40fd-b4f3-5691b69866fc tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:15.439869 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1124715a-a711-40fd-b4f3-5691b69866fc tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:15.440442 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1124715a-a711-40fd-b4f3-5691b69866fc tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:15.441406 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1124715a-a711-40fd-b4f3-5691b69866fc tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:15.441947 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1124715a-a711-40fd-b4f3-5691b69866fc tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:15.442514 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1124715a-a711-40fd-b4f3-5691b69866fc tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:15.499439 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-77720cf3-3dda-4583-959a-c21c626f3e85 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f60e33f334465fac1148669de3f00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4735bf74f33a4739800d766c82d973d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:15.515779 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-77720cf3-3dda-4583-959a-c21c626f3e85 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] 10.222.0.26 "GET /compute/v2.1/servers/0e762f82-ada3-411d-9072-37e72381145d" status: 200 len: 1789 microversion: 2.1 time: 0.558803 Oct 08 21:03:15.518150 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1395/2736] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:14 2022] GET /compute/v2.1/servers/0e762f82-ada3-411d-9072-37e72381145d => generated 1789 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:15.528220 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-a6cb33f9-e8b3-4030-b709-c96df9f83885 req-f6ece915-240f-4de6-b85f-2029b1e38e6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50a243fc-ec9e-4e15-a0c6-240c525af882", "tag": "87b9c9d6-fc1c-4415-b9ba-4d06b63de0b4"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:03:15.547267 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-a6cb33f9-e8b3-4030-b709-c96df9f83885 req-f6ece915-240f-4de6-b85f-2029b1e38e6b service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:15.548493 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-a6cb33f9-e8b3-4030-b709-c96df9f83885 req-f6ece915-240f-4de6-b85f-2029b1e38e6b service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:15.549651 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-a6cb33f9-e8b3-4030-b709-c96df9f83885 req-f6ece915-240f-4de6-b85f-2029b1e38e6b service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:15.571264 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-a6cb33f9-e8b3-4030-b709-c96df9f83885 req-f6ece915-240f-4de6-b85f-2029b1e38e6b service nova] Creating event network-changed:87b9c9d6-fc1c-4415-b9ba-4d06b63de0b4 for instance 50a243fc-ec9e-4e15-a0c6-240c525af882 on nch1-master-1 Oct 08 21:03:15.578742 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-a6cb33f9-e8b3-4030-b709-c96df9f83885 req-f6ece915-240f-4de6-b85f-2029b1e38e6b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057816 Oct 08 21:03:15.580671 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1396/2737] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:03:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:03:15.592883 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-2a556fbe-da1a-49d1-937e-2ce3f4a7c9c2 req-8a78f968-a037-4968-87aa-2f6937fc4036 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e762f82-ada3-411d-9072-37e72381145d", "name": "network-vif-deleted", "tag": "2311dae7-2451-42a1-9d7c-d14f8767e430"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:03:15.613764 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-2a556fbe-da1a-49d1-937e-2ce3f4a7c9c2 req-8a78f968-a037-4968-87aa-2f6937fc4036 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:15.615374 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-2a556fbe-da1a-49d1-937e-2ce3f4a7c9c2 req-8a78f968-a037-4968-87aa-2f6937fc4036 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:15.617032 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-2a556fbe-da1a-49d1-937e-2ce3f4a7c9c2 req-8a78f968-a037-4968-87aa-2f6937fc4036 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:15.636650 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-2a556fbe-da1a-49d1-937e-2ce3f4a7c9c2 req-8a78f968-a037-4968-87aa-2f6937fc4036 service nova] Creating event network-vif-deleted:2311dae7-2451-42a1-9d7c-d14f8767e430 for instance 0e762f82-ada3-411d-9072-37e72381145d on nch2-master-1 Oct 08 21:03:15.642943 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-2a556fbe-da1a-49d1-937e-2ce3f4a7c9c2 req-8a78f968-a037-4968-87aa-2f6937fc4036 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060622 Oct 08 21:03:15.644913 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1397/2738] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:03:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:03:15.655576 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-86487d24-28c5-478f-9b5a-1f4d6353423c tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:15.657297 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-86487d24-28c5-478f-9b5a-1f4d6353423c tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: d7f3a7bd-a731-45de-a24b-e04e9d81358d] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:15.670763 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-86487d24-28c5-478f-9b5a-1f4d6353423c tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:15.672258 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-86487d24-28c5-478f-9b5a-1f4d6353423c tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:15.673251 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-86487d24-28c5-478f-9b5a-1f4d6353423c tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:15.676296 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-86487d24-28c5-478f-9b5a-1f4d6353423c tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:15.680376 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-86487d24-28c5-478f-9b5a-1f4d6353423c tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:15.682354 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-86487d24-28c5-478f-9b5a-1f4d6353423c tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:15.693845 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-1124715a-a711-40fd-b4f3-5691b69866fc tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6088285b46499a98162b6237517174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b70cb43c39e4e0ba89680d7b8459c01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:15.711212 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-1124715a-a711-40fd-b4f3-5691b69866fc tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] 10.222.0.26 "GET /compute/v2.1/servers/6e8a4e07-0b30-44a3-aa7d-8d4677cc1d5f" status: 200 len: 1506 microversion: 2.1 time: 0.285526 Oct 08 21:03:15.712588 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1342/2739] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:15 2022] GET /compute/v2.1/servers/6e8a4e07-0b30-44a3-aa7d-8d4677cc1d5f => generated 1506 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:15.718226 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-ee0c507d-0600-4625-8356-e6073d79cd69 tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Calling method '.version_select at 0x7f1a8c928af0>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:16.023756 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-86487d24-28c5-478f-9b5a-1f4d6353423c tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:16.037363 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-86487d24-28c5-478f-9b5a-1f4d6353423c tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/d7f3a7bd-a731-45de-a24b-e04e9d81358d" status: 200 len: 1536 microversion: 2.1 time: 0.385882 Oct 08 21:03:16.038425 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1398/2740] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:15 2022] GET /compute/v2.1/servers/d7f3a7bd-a731-45de-a24b-e04e9d81358d => generated 1536 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:16.043269 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-c6cd6f90-a677-4fa5-b36c-00f4b69951b6 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:16.043894 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-c6cd6f90-a677-4fa5-b36c-00f4b69951b6 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] [instance: 570d4898-169b-4f6b-aef6-ab79ea0fbefd] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:16.060761 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c6cd6f90-a677-4fa5-b36c-00f4b69951b6 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:16.061604 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c6cd6f90-a677-4fa5-b36c-00f4b69951b6 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:16.062220 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c6cd6f90-a677-4fa5-b36c-00f4b69951b6 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:16.063113 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c6cd6f90-a677-4fa5-b36c-00f4b69951b6 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:16.063977 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c6cd6f90-a677-4fa5-b36c-00f4b69951b6 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:16.064904 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c6cd6f90-a677-4fa5-b36c-00f4b69951b6 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:16.528382 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-c6cd6f90-a677-4fa5-b36c-00f4b69951b6 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2e13f1952a4e5bb23d57dd7fa31875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b2a56286924e2d953bebe717ce591b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:16.538283 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-c6cd6f90-a677-4fa5-b36c-00f4b69951b6 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] 10.222.0.26 "GET /compute/v2.1/servers/570d4898-169b-4f6b-aef6-ab79ea0fbefd" status: 200 len: 1506 microversion: 2.1 time: 0.498661 Oct 08 21:03:16.539947 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1399/2741] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:16 2022] GET /compute/v2.1/servers/570d4898-169b-4f6b-aef6-ab79ea0fbefd => generated 1506 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:16.545859 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-bd613ed7-c7e0-4628-984c-3e56b5993045 tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:16.546625 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-bd613ed7-c7e0-4628-984c-3e56b5993045 tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] [instance: 6e8a4e07-0b30-44a3-aa7d-8d4677cc1d5f] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:16.553407 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bd613ed7-c7e0-4628-984c-3e56b5993045 tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:16.554211 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bd613ed7-c7e0-4628-984c-3e56b5993045 tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:16.555049 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bd613ed7-c7e0-4628-984c-3e56b5993045 tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:16.555998 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bd613ed7-c7e0-4628-984c-3e56b5993045 tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:16.556593 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bd613ed7-c7e0-4628-984c-3e56b5993045 tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:16.557104 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bd613ed7-c7e0-4628-984c-3e56b5993045 tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:16.588580 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-bd613ed7-c7e0-4628-984c-3e56b5993045 tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] 10.222.0.26 "GET /compute/v2.1/servers/6e8a4e07-0b30-44a3-aa7d-8d4677cc1d5f/ips" status: 200 len: 109 microversion: 2.1 time: 0.046855 Oct 08 21:03:16.589562 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1400/2742] 10.222.0.26 () {58 vars in 1248 bytes} [Sat Oct 8 21:03:16 2022] GET /compute/v2.1/servers/6e8a4e07-0b30-44a3-aa7d-8d4677cc1d5f/ips => generated 109 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:03:16.596617 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-d2912272-ea4c-4865-900a-f470d1034929 req-5b0c89da-a1c3-444e-a9d4-9d1c69434b16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b52e623-6990-4978-811d-68fc294fe304", "name": "network-vif-plugged", "status": "completed", "tag": "d9c32cf0-f551-46d0-b582-c534f69aced9"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:03:16.608620 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-d2912272-ea4c-4865-900a-f470d1034929 req-5b0c89da-a1c3-444e-a9d4-9d1c69434b16 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:16.609117 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-d2912272-ea4c-4865-900a-f470d1034929 req-5b0c89da-a1c3-444e-a9d4-9d1c69434b16 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:16.609593 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-d2912272-ea4c-4865-900a-f470d1034929 req-5b0c89da-a1c3-444e-a9d4-9d1c69434b16 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:16.623597 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-d2912272-ea4c-4865-900a-f470d1034929 req-5b0c89da-a1c3-444e-a9d4-9d1c69434b16 service nova] Creating event network-vif-plugged:d9c32cf0-f551-46d0-b582-c534f69aced9 for instance 0b52e623-6990-4978-811d-68fc294fe304 on nch2-master-1 Oct 08 21:03:16.628950 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-d2912272-ea4c-4865-900a-f470d1034929 req-5b0c89da-a1c3-444e-a9d4-9d1c69434b16 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037365 Oct 08 21:03:16.633856 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1401/2743] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:03:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:03:16.639406 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-77ae381f-e75c-4dde-a944-870f20b604f7 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:16.640140 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-77ae381f-e75c-4dde-a944-870f20b604f7 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] [instance: 0b52e623-6990-4978-811d-68fc294fe304] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:16.648099 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-77ae381f-e75c-4dde-a944-870f20b604f7 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:16.648617 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-77ae381f-e75c-4dde-a944-870f20b604f7 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:16.649072 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-77ae381f-e75c-4dde-a944-870f20b604f7 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:16.649852 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-77ae381f-e75c-4dde-a944-870f20b604f7 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:16.650320 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-77ae381f-e75c-4dde-a944-870f20b604f7 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:16.650760 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-77ae381f-e75c-4dde-a944-870f20b604f7 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:16.943719 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-77ae381f-e75c-4dde-a944-870f20b604f7 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095debf3968c448fb3c3add0322d8d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc9bed6d76834f6fa66d681ecd9f4e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:16.956708 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-77ae381f-e75c-4dde-a944-870f20b604f7 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] 10.222.0.26 "GET /compute/v2.1/servers/0b52e623-6990-4978-811d-68fc294fe304" status: 200 len: 1321 microversion: 2.1 time: 0.321476 Oct 08 21:03:16.969795 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1402/2744] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:16 2022] GET /compute/v2.1/servers/0b52e623-6990-4978-811d-68fc294fe304 => generated 1321 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:16.969795 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-3e8cd2a4-d022-4801-842d-af35ca3f150d tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:16.969795 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-3e8cd2a4-d022-4801-842d-af35ca3f150d tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] [instance: 0e762f82-ada3-411d-9072-37e72381145d] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:16.969795 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3e8cd2a4-d022-4801-842d-af35ca3f150d tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:16.969795 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3e8cd2a4-d022-4801-842d-af35ca3f150d tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:16.970316 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3e8cd2a4-d022-4801-842d-af35ca3f150d tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:16.970942 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3e8cd2a4-d022-4801-842d-af35ca3f150d tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:16.971406 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3e8cd2a4-d022-4801-842d-af35ca3f150d tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:16.972086 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3e8cd2a4-d022-4801-842d-af35ca3f150d tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:17.043955 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-3e8cd2a4-d022-4801-842d-af35ca3f150d tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f60e33f334465fac1148669de3f00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4735bf74f33a4739800d766c82d973d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:17.053114 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-3e8cd2a4-d022-4801-842d-af35ca3f150d tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] 10.222.0.26 "GET /compute/v2.1/servers/0e762f82-ada3-411d-9072-37e72381145d" status: 200 len: 1611 microversion: 2.1 time: 0.094122 Oct 08 21:03:17.055934 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-ee0c507d-0600-4625-8356-e6073d79cd69 tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] 10.222.0.26 "DELETE /compute/v2.1/os-floating-ips/d5f0e824-f1e2-40ff-9622-3a79153b0bb3" status: 202 len: 0 microversion: 2.1 time: 1.341362 Oct 08 21:03:17.056954 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1343/2745] 10.222.0.26 () {58 vars in 1263 bytes} [Sat Oct 8 21:03:15 2022] DELETE /compute/v2.1/os-floating-ips/d5f0e824-f1e2-40ff-9622-3a79153b0bb3 => generated 0 bytes in 1343 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 21:03:17.061694 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-cc6a97cf-9d36-4d36-ac28-683df3dac7d7 tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:17.062215 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-cc6a97cf-9d36-4d36-ac28-683df3dac7d7 tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] [instance: 6e8a4e07-0b30-44a3-aa7d-8d4677cc1d5f] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:17.062473 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1403/2746] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:16 2022] GET /compute/v2.1/servers/0e762f82-ada3-411d-9072-37e72381145d => generated 1611 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:17.068215 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-c0a2a93e-3b56-41ee-b37d-fe48359e1b4b tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:17.068850 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-c0a2a93e-3b56-41ee-b37d-fe48359e1b4b tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: d7f3a7bd-a731-45de-a24b-e04e9d81358d] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:17.071772 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cc6a97cf-9d36-4d36-ac28-683df3dac7d7 tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:17.072582 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cc6a97cf-9d36-4d36-ac28-683df3dac7d7 tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:17.073028 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cc6a97cf-9d36-4d36-ac28-683df3dac7d7 tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:17.073784 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cc6a97cf-9d36-4d36-ac28-683df3dac7d7 tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:17.074366 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cc6a97cf-9d36-4d36-ac28-683df3dac7d7 tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:17.074801 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cc6a97cf-9d36-4d36-ac28-683df3dac7d7 tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:17.079023 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c0a2a93e-3b56-41ee-b37d-fe48359e1b4b tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:17.081379 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c0a2a93e-3b56-41ee-b37d-fe48359e1b4b tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:17.081851 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c0a2a93e-3b56-41ee-b37d-fe48359e1b4b tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:17.082595 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c0a2a93e-3b56-41ee-b37d-fe48359e1b4b tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:17.083138 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c0a2a93e-3b56-41ee-b37d-fe48359e1b4b tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:17.084328 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c0a2a93e-3b56-41ee-b37d-fe48359e1b4b tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:17.103940 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-cc6a97cf-9d36-4d36-ac28-683df3dac7d7 tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] 10.222.0.26 "GET /compute/v2.1/servers/6e8a4e07-0b30-44a3-aa7d-8d4677cc1d5f/ips" status: 200 len: 109 microversion: 2.1 time: 0.045979 Oct 08 21:03:17.104652 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1344/2747] 10.222.0.26 () {58 vars in 1248 bytes} [Sat Oct 8 21:03:17 2022] GET /compute/v2.1/servers/6e8a4e07-0b30-44a3-aa7d-8d4677cc1d5f/ips => generated 109 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:03:17.109550 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-ab1423e9-2975-4643-b459-845c760f5aad tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:03:17.121456 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-ab1423e9-2975-4643-b459-845c760f5aad tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Request method failure captured: Oct 08 21:03:17.121456 ncdv-master-1 devstack@n-api.service[140491]: request: POST /compute/v2.1/servers/50a243fc-ec9e-4e15-a0c6-240c525af882/action HTTP/1.1 Oct 08 21:03:17.121456 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:03:17.121456 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:03:17.121456 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:03:17.121456 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 34 Oct 08 21:03:17.121456 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:03:17.121456 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:03:17.121456 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:03:17.121456 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:03:17.121456 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeVhytWoQnk6GVQNvRMaqutcfZ6oHhkZP17q3DZBE_Z-aIXrWYoWaZvOrCLjXswvQZhsvOMlQ97sPPGJvZ9uuo2pOaZbTZO4doq_hStRmKG5PBA9RC4Ww5qGjeV7Tyd28DZQ4iRmZpW-M76h1C_SCBWQG7sk3OM8xT1LaXoZt-RmIps Oct 08 21:03:17.121456 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:03:17.121456 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:03:17.121456 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:03:17.121456 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:03:17.121456 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:03:17.121456 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:03:17.121456 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 2f51fe43d7c143ebb6d53f5942941c9d Oct 08 21:03:17.121456 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-693193549 Oct 08 21:03:17.121456 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:03:17.121456 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:03:17.121456 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/2f51fe43d7c143ebb6d53f5942941c9d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2f51fe43d7c143ebb6d53f5942941c9d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_2f51fe43d7c143ebb6d53f5942941c9d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2f51fe43d7c143ebb6d53f5942941c9d"}]}] Oct 08 21:03:17.121456 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-693193549 Oct 08 21:03:17.121456 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 2f51fe43d7c143ebb6d53f5942941c9d Oct 08 21:03:17.121456 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-693193549 Oct 08 21:03:17.121456 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project Oct 08 21:03:17.121456 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:03:17.121456 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:03:17.121456 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 95cfeacf062f486c985ca772f2f36faf Oct 08 21:03:17.121456 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project Oct 08 21:03:17.121456 ncdv-master-1 devstack@n-api.service[140491]: Oct 08 21:03:17.121456 ncdv-master-1 devstack@n-api.service[140491]: {"addFloatingIp": {"address": ""}} Oct 08 21:03:17.121456 ncdv-master-1 devstack@n-api.service[140491]: method: Oct 08 21:03:17.121456 ncdv-master-1 devstack@n-api.service[140491]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 08 21:03:17.121456 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': '50a243fc-ec9e-4e15-a0c6-240c525af882', 'body': {'addFloatingIp': {'address': ''}}} Oct 08 21:03:17.121456 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:03:17.121456 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:03:17.121456 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 08 21:03:17.121456 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 08 21:03:17.121456 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 08 21:03:17.121456 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise error Oct 08 21:03:17.121456 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Oct 08 21:03:17.121456 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:03:17.121456 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Oct 08 21:03:17.121456 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Oct 08 21:03:17.121456 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:03:17.121456 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Oct 08 21:03:17.121456 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi '' Oct 08 21:03:17.121456 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:03:17.121456 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:03:17.121456 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:03:17.121456 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:03:17.121456 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:03:17.121456 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:03:17.121456 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:03:17.121456 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:03:17.121456 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 08 21:03:17.121456 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 08 21:03:17.121456 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:03:17.121456 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:03:17.121456 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 08 21:03:17.121456 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 08 21:03:17.121456 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 08 21:03:17.121456 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 08 21:03:17.121456 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 08 21:03:17.125627 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 08 21:03:17.125627 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 08 21:03:17.125627 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:03:17.125627 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:03:17.125627 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:03:17.125627 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:03:17.125627 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:03:17.125627 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:03:17.125627 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 08 21:03:17.125627 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 08 21:03:17.125627 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 08 21:03:17.125627 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:03:17.125627 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-ab1423e9-2975-4643-b459-845c760f5aad tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:03:17.125627 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-ab1423e9-2975-4643-b459-845c760f5aad tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] 10.222.0.26 "POST /compute/v2.1/servers/50a243fc-ec9e-4e15-a0c6-240c525af882/action" status: 400 len: 142 microversion: 2.1 time: 0.017394 Oct 08 21:03:17.125627 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1345/2748] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:03:17 2022] POST /compute/v2.1/servers/50a243fc-ec9e-4e15-a0c6-240c525af882/action => generated 142 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 08 21:03:17.128227 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-6a9b6cb2-8128-4137-97b3-868db42a46d6 tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:17.128620 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-6a9b6cb2-8128-4137-97b3-868db42a46d6 tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] [instance: 6e8a4e07-0b30-44a3-aa7d-8d4677cc1d5f] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:17.136278 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6a9b6cb2-8128-4137-97b3-868db42a46d6 tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:17.136781 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6a9b6cb2-8128-4137-97b3-868db42a46d6 tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:17.137251 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6a9b6cb2-8128-4137-97b3-868db42a46d6 tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:17.137963 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6a9b6cb2-8128-4137-97b3-868db42a46d6 tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:17.138426 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6a9b6cb2-8128-4137-97b3-868db42a46d6 tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:17.138861 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6a9b6cb2-8128-4137-97b3-868db42a46d6 tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:17.165518 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-6a9b6cb2-8128-4137-97b3-868db42a46d6 tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] 10.222.0.26 "GET /compute/v2.1/servers/6e8a4e07-0b30-44a3-aa7d-8d4677cc1d5f/ips/tempest-ServerAddressesTestJSON-336144812-network" status: 200 len: 94 microversion: 2.1 time: 0.040911 Oct 08 21:03:17.166102 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1346/2749] 10.222.0.26 () {58 vars in 1398 bytes} [Sat Oct 8 21:03:17 2022] GET /compute/v2.1/servers/6e8a4e07-0b30-44a3-aa7d-8d4677cc1d5f/ips/tempest-ServerAddressesTestJSON-336144812-network => generated 94 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 08 21:03:17.170812 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-2d83b3cc-2759-417b-8b2f-ce3d7ade515e tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:03:17.175061 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-2d83b3cc-2759-417b-8b2f-ce3d7ade515e tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] [instance: 50a243fc-ec9e-4e15-a0c6-240c525af882] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:17.181163 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2d83b3cc-2759-417b-8b2f-ce3d7ade515e tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:17.181687 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2d83b3cc-2759-417b-8b2f-ce3d7ade515e tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:17.182124 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2d83b3cc-2759-417b-8b2f-ce3d7ade515e tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:17.183395 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2d83b3cc-2759-417b-8b2f-ce3d7ade515e tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:17.183862 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2d83b3cc-2759-417b-8b2f-ce3d7ade515e tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:17.184298 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2d83b3cc-2759-417b-8b2f-ce3d7ade515e tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:17.188491 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:03:17.215191 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2d83b3cc-2759-417b-8b2f-ce3d7ade515e tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Acquiring lock "refresh_cache-50a243fc-ec9e-4e15-a0c6-240c525af882" {{(pid=140491) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 08 21:03:17.215593 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2d83b3cc-2759-417b-8b2f-ce3d7ade515e tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Acquired lock "refresh_cache-50a243fc-ec9e-4e15-a0c6-240c525af882" {{(pid=140491) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 08 21:03:17.244155 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-c0a2a93e-3b56-41ee-b37d-fe48359e1b4b tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:17.252014 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-c0a2a93e-3b56-41ee-b37d-fe48359e1b4b tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/d7f3a7bd-a731-45de-a24b-e04e9d81358d" status: 200 len: 1536 microversion: 2.1 time: 0.188307 Oct 08 21:03:17.252592 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1404/2750] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:17 2022] GET /compute/v2.1/servers/d7f3a7bd-a731-45de-a24b-e04e9d81358d => generated 1536 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:17.265435 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-bc334fd7-0634-4d27-8f84-fd128c69cc23 tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:17.265435 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-bc334fd7-0634-4d27-8f84-fd128c69cc23 tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] [instance: 6e8a4e07-0b30-44a3-aa7d-8d4677cc1d5f] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:17.265435 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bc334fd7-0634-4d27-8f84-fd128c69cc23 tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:17.265435 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bc334fd7-0634-4d27-8f84-fd128c69cc23 tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:17.265435 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bc334fd7-0634-4d27-8f84-fd128c69cc23 tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:17.266809 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bc334fd7-0634-4d27-8f84-fd128c69cc23 tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:17.267277 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bc334fd7-0634-4d27-8f84-fd128c69cc23 tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:17.267711 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bc334fd7-0634-4d27-8f84-fd128c69cc23 tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:17.294324 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-bc334fd7-0634-4d27-8f84-fd128c69cc23 tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] [instance: 6e8a4e07-0b30-44a3-aa7d-8d4677cc1d5f] Going to try to terminate instance {{(pid=140492) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 21:03:17.314033 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2d83b3cc-2759-417b-8b2f-ce3d7ade515e tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Releasing lock "refresh_cache-50a243fc-ec9e-4e15-a0c6-240c525af882" {{(pid=140491) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 08 21:03:17.314604 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-2d83b3cc-2759-417b-8b2f-ce3d7ade515e tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] HTTP exception thrown: floating IP not found Oct 08 21:03:17.316203 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-2d83b3cc-2759-417b-8b2f-ce3d7ade515e tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Request method failure captured: Oct 08 21:03:17.316203 ncdv-master-1 devstack@n-api.service[140491]: request: POST /compute/v2.1/servers/50a243fc-ec9e-4e15-a0c6-240c525af882/action HTTP/1.1 Oct 08 21:03:17.316203 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:03:17.316203 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:03:17.316203 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:03:17.316203 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 41 Oct 08 21:03:17.316203 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:03:17.316203 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:03:17.316203 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:03:17.316203 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:03:17.316203 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeVhytWoQnk6GVQNvRMaqutcfZ6oHhkZP17q3DZBE_Z-aIXrWYoWaZvOrCLjXswvQZhsvOMlQ97sPPGJvZ9uuo2pOaZbTZO4doq_hStRmKG5PBA9RC4Ww5qGjeV7Tyd28DZQ4iRmZpW-M76h1C_SCBWQG7sk3OM8xT1LaXoZt-RmIps Oct 08 21:03:17.316203 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:03:17.316203 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:03:17.316203 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:03:17.316203 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:03:17.316203 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:03:17.316203 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:03:17.316203 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 2f51fe43d7c143ebb6d53f5942941c9d Oct 08 21:03:17.316203 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-693193549 Oct 08 21:03:17.316203 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:03:17.316203 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:03:17.316203 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/2f51fe43d7c143ebb6d53f5942941c9d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2f51fe43d7c143ebb6d53f5942941c9d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_2f51fe43d7c143ebb6d53f5942941c9d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2f51fe43d7c143ebb6d53f5942941c9d"}]}] Oct 08 21:03:17.316203 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-693193549 Oct 08 21:03:17.316203 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 2f51fe43d7c143ebb6d53f5942941c9d Oct 08 21:03:17.316203 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-693193549 Oct 08 21:03:17.316203 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project Oct 08 21:03:17.316203 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:03:17.316203 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:03:17.316203 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 95cfeacf062f486c985ca772f2f36faf Oct 08 21:03:17.316203 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project Oct 08 21:03:17.316203 ncdv-master-1 devstack@n-api.service[140491]: Oct 08 21:03:17.316203 ncdv-master-1 devstack@n-api.service[140491]: {"addFloatingIp": {"address": "0.0.0.0"}} Oct 08 21:03:17.316203 ncdv-master-1 devstack@n-api.service[140491]: method: Oct 08 21:03:17.316203 ncdv-master-1 devstack@n-api.service[140491]: exception: floating IP not found Oct 08 21:03:17.316203 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': '50a243fc-ec9e-4e15-a0c6-240c525af882', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Oct 08 21:03:17.316203 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:03:17.316203 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:03:17.316203 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Oct 08 21:03:17.316203 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Oct 08 21:03:17.316203 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Oct 08 21:03:17.316203 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Oct 08 21:03:17.316203 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2699, in associate_floating_ip Oct 08 21:03:17.316203 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Oct 08 21:03:17.316203 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Oct 08 21:03:17.316203 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Oct 08 21:03:17.316203 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Oct 08 21:03:17.316203 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:03:17.316203 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:03:17.316203 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:03:17.316203 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:03:17.316203 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:03:17.316203 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:03:17.316203 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:03:17.316203 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:03:17.316203 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 08 21:03:17.316203 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 08 21:03:17.316203 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:03:17.316203 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:03:17.316203 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 21:03:17.316203 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 21:03:17.316203 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Oct 08 21:03:17.316203 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 08 21:03:17.316203 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Oct 08 21:03:17.316203 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:03:17.321461 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:03:17.321461 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:03:17.321461 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:03:17.321461 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:03:17.321461 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:03:17.321461 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:03:17.321461 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:03:17.321461 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Oct 08 21:03:17.321461 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:03:17.321461 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-2d83b3cc-2759-417b-8b2f-ce3d7ade515e tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Returning 404 to user: floating IP not found {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:03:17.321461 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-2d83b3cc-2759-417b-8b2f-ce3d7ade515e tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] 10.222.0.26 "POST /compute/v2.1/servers/50a243fc-ec9e-4e15-a0c6-240c525af882/action" status: 404 len: 67 microversion: 2.1 time: 0.150608 Oct 08 21:03:17.321461 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1347/2751] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:03:17 2022] POST /compute/v2.1/servers/50a243fc-ec9e-4e15-a0c6-240c525af882/action => generated 67 bytes in 152 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 08 21:03:17.328386 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-9ead6fc0-ca44-47ae-bf4b-7b208a3703d2 tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:03:17.346640 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:03:17.379318 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-bc334fd7-0634-4d27-8f84-fd128c69cc23 tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] 10.222.0.26 "DELETE /compute/v2.1/servers/6e8a4e07-0b30-44a3-aa7d-8d4677cc1d5f" status: 204 len: 0 microversion: 2.1 time: 0.125261 Oct 08 21:03:17.379535 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-9ead6fc0-ca44-47ae-bf4b-7b208a3703d2 tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Oct 08 21:03:17.380642 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1405/2752] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:03:17 2022] DELETE /compute/v2.1/servers/6e8a4e07-0b30-44a3-aa7d-8d4677cc1d5f => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 21:03:17.381843 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-9ead6fc0-ca44-47ae-bf4b-7b208a3703d2 tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Request method failure captured: Oct 08 21:03:17.381843 ncdv-master-1 devstack@n-api.service[140491]: request: POST /compute/v2.1/servers/50a243fc-ec9e-4e15-a0c6-240c525af882/action HTTP/1.1 Oct 08 21:03:17.381843 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:03:17.381843 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:03:17.381843 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:03:17.381843 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 44 Oct 08 21:03:17.381843 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:03:17.381843 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:03:17.381843 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:03:17.381843 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:03:17.381843 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeVhytWoQnk6GVQNvRMaqutcfZ6oHhkZP17q3DZBE_Z-aIXrWYoWaZvOrCLjXswvQZhsvOMlQ97sPPGJvZ9uuo2pOaZbTZO4doq_hStRmKG5PBA9RC4Ww5qGjeV7Tyd28DZQ4iRmZpW-M76h1C_SCBWQG7sk3OM8xT1LaXoZt-RmIps Oct 08 21:03:17.381843 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:03:17.381843 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:03:17.381843 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:03:17.381843 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:03:17.381843 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:03:17.381843 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:03:17.381843 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 2f51fe43d7c143ebb6d53f5942941c9d Oct 08 21:03:17.381843 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-693193549 Oct 08 21:03:17.381843 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:03:17.381843 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:03:17.381843 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/2f51fe43d7c143ebb6d53f5942941c9d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2f51fe43d7c143ebb6d53f5942941c9d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_2f51fe43d7c143ebb6d53f5942941c9d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2f51fe43d7c143ebb6d53f5942941c9d"}]}] Oct 08 21:03:17.381843 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-693193549 Oct 08 21:03:17.381843 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 2f51fe43d7c143ebb6d53f5942941c9d Oct 08 21:03:17.381843 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-693193549 Oct 08 21:03:17.381843 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project Oct 08 21:03:17.381843 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:03:17.381843 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:03:17.381843 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 95cfeacf062f486c985ca772f2f36faf Oct 08 21:03:17.381843 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project Oct 08 21:03:17.381843 ncdv-master-1 devstack@n-api.service[140491]: Oct 08 21:03:17.381843 ncdv-master-1 devstack@n-api.service[140491]: {"removeFloatingIp": {"address": "0.0.0.0"}} Oct 08 21:03:17.381843 ncdv-master-1 devstack@n-api.service[140491]: method: Oct 08 21:03:17.381843 ncdv-master-1 devstack@n-api.service[140491]: exception: Floating IP not found for address 0.0.0.0. Oct 08 21:03:17.381843 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': '50a243fc-ec9e-4e15-a0c6-240c525af882', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Oct 08 21:03:17.381843 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:03:17.381843 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:03:17.381843 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Oct 08 21:03:17.381843 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Oct 08 21:03:17.381843 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2927, in get_instance_id_by_floating_address Oct 08 21:03:17.381843 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Oct 08 21:03:17.381843 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Oct 08 21:03:17.381843 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Oct 08 21:03:17.381843 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Oct 08 21:03:17.381843 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:03:17.381843 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:03:17.381843 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:03:17.381843 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:03:17.381843 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:03:17.381843 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:03:17.381843 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:03:17.381843 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:03:17.381843 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 08 21:03:17.381843 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 08 21:03:17.381843 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:03:17.381843 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:03:17.381843 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 21:03:17.381843 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 21:03:17.381843 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Oct 08 21:03:17.381843 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Oct 08 21:03:17.381843 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Oct 08 21:03:17.381843 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Oct 08 21:03:17.386099 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Oct 08 21:03:17.386099 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:03:17.386099 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:03:17.386099 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:03:17.386099 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:03:17.386099 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:03:17.386099 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:03:17.386099 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:03:17.386099 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:03:17.386099 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Oct 08 21:03:17.386099 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:03:17.386099 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-9ead6fc0-ca44-47ae-bf4b-7b208a3703d2 tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:03:17.386099 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-9ead6fc0-ca44-47ae-bf4b-7b208a3703d2 tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] 10.222.0.26 "POST /compute/v2.1/servers/50a243fc-ec9e-4e15-a0c6-240c525af882/action" status: 404 len: 88 microversion: 2.1 time: 0.058625 Oct 08 21:03:17.386099 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1348/2753] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:03:17 2022] POST /compute/v2.1/servers/50a243fc-ec9e-4e15-a0c6-240c525af882/action => generated 88 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 08 21:03:17.392530 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-2088d567-9451-48a9-9fbb-76831920daa8 tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:17.392677 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-17767edc-5528-4b17-9237-8af726a59b9d tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:17.393277 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-2088d567-9451-48a9-9fbb-76831920daa8 tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] [instance: 6e8a4e07-0b30-44a3-aa7d-8d4677cc1d5f] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:17.397253 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-17767edc-5528-4b17-9237-8af726a59b9d tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] [instance: 50a243fc-ec9e-4e15-a0c6-240c525af882] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:17.400436 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2088d567-9451-48a9-9fbb-76831920daa8 tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:17.401013 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2088d567-9451-48a9-9fbb-76831920daa8 tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:17.401566 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2088d567-9451-48a9-9fbb-76831920daa8 tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:17.402309 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2088d567-9451-48a9-9fbb-76831920daa8 tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:17.402774 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2088d567-9451-48a9-9fbb-76831920daa8 tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:17.403206 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2088d567-9451-48a9-9fbb-76831920daa8 tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:17.404676 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-17767edc-5528-4b17-9237-8af726a59b9d tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:17.405400 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-17767edc-5528-4b17-9237-8af726a59b9d tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:17.405878 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-17767edc-5528-4b17-9237-8af726a59b9d tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:17.406568 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-17767edc-5528-4b17-9237-8af726a59b9d tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:17.407034 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-17767edc-5528-4b17-9237-8af726a59b9d tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:17.407660 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-17767edc-5528-4b17-9237-8af726a59b9d tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:17.433079 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-17767edc-5528-4b17-9237-8af726a59b9d tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] [instance: 50a243fc-ec9e-4e15-a0c6-240c525af882] Going to try to terminate instance {{(pid=140491) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 21:03:17.520551 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-17767edc-5528-4b17-9237-8af726a59b9d tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] 10.222.0.26 "DELETE /compute/v2.1/servers/50a243fc-ec9e-4e15-a0c6-240c525af882" status: 204 len: 0 microversion: 2.1 time: 0.131049 Oct 08 21:03:17.521122 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1349/2754] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:03:17 2022] DELETE /compute/v2.1/servers/50a243fc-ec9e-4e15-a0c6-240c525af882 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 08 21:03:17.529730 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c2dea718-44f1-4b8f-a967-670a08bf2109 tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:17.530428 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-c2dea718-44f1-4b8f-a967-670a08bf2109 tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] [instance: 50a243fc-ec9e-4e15-a0c6-240c525af882] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:17.536239 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c2dea718-44f1-4b8f-a967-670a08bf2109 tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:17.539542 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-2088d567-9451-48a9-9fbb-76831920daa8 tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6088285b46499a98162b6237517174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b70cb43c39e4e0ba89680d7b8459c01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:17.540206 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c2dea718-44f1-4b8f-a967-670a08bf2109 tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:17.540704 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c2dea718-44f1-4b8f-a967-670a08bf2109 tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:17.541484 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c2dea718-44f1-4b8f-a967-670a08bf2109 tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:17.541965 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c2dea718-44f1-4b8f-a967-670a08bf2109 tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:17.542399 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c2dea718-44f1-4b8f-a967-670a08bf2109 tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:17.547326 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-2088d567-9451-48a9-9fbb-76831920daa8 tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] 10.222.0.26 "GET /compute/v2.1/servers/6e8a4e07-0b30-44a3-aa7d-8d4677cc1d5f" status: 200 len: 1512 microversion: 2.1 time: 0.158873 Oct 08 21:03:17.547902 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1406/2755] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:17 2022] GET /compute/v2.1/servers/6e8a4e07-0b30-44a3-aa7d-8d4677cc1d5f => generated 1512 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:03:17.561972 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-d99c47fb-6a63-46b2-b3fd-0cd15edbab08 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:17.562749 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-d99c47fb-6a63-46b2-b3fd-0cd15edbab08 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] [instance: 570d4898-169b-4f6b-aef6-ab79ea0fbefd] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:17.570429 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d99c47fb-6a63-46b2-b3fd-0cd15edbab08 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:17.570929 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d99c47fb-6a63-46b2-b3fd-0cd15edbab08 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:17.571382 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d99c47fb-6a63-46b2-b3fd-0cd15edbab08 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:17.572094 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d99c47fb-6a63-46b2-b3fd-0cd15edbab08 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:17.572586 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d99c47fb-6a63-46b2-b3fd-0cd15edbab08 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:17.573025 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d99c47fb-6a63-46b2-b3fd-0cd15edbab08 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:17.675998 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-c2dea718-44f1-4b8f-a967-670a08bf2109 tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95cfeacf062f486c985ca772f2f36faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f51fe43d7c143ebb6d53f5942941c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:17.684339 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-c2dea718-44f1-4b8f-a967-670a08bf2109 tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] 10.222.0.26 "GET /compute/v2.1/servers/50a243fc-ec9e-4e15-a0c6-240c525af882" status: 200 len: 1542 microversion: 2.1 time: 0.158770 Oct 08 21:03:17.684901 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1350/2756] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:17 2022] GET /compute/v2.1/servers/50a243fc-ec9e-4e15-a0c6-240c525af882 => generated 1542 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:03:17.689417 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-b2730fd4-c372-476f-8e62-84eaad378123 req-5b667bfb-5895-4056-9b94-d01b802724fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7f3a7bd-a731-45de-a24b-e04e9d81358d", "tag": "0a909b9a-561b-42d5-bf2f-d3cc0b3356b5"}, {"server_uuid": "0e762f82-ada3-411d-9072-37e72381145d", "name": "network-vif-deleted", "tag": "582a8fd3-4fba-41bc-be82-7424ac768342"}, {"server_uuid": "0e762f82-ada3-411d-9072-37e72381145d", "name": "network-vif-deleted", "tag": "c71c8a62-3e86-493c-9ee0-a514776c7ea0"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:03:17.700420 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-b2730fd4-c372-476f-8e62-84eaad378123 req-5b667bfb-5895-4056-9b94-d01b802724fb service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:17.701135 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-b2730fd4-c372-476f-8e62-84eaad378123 req-5b667bfb-5895-4056-9b94-d01b802724fb service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:17.701594 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-b2730fd4-c372-476f-8e62-84eaad378123 req-5b667bfb-5895-4056-9b94-d01b802724fb service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:17.709502 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-d99c47fb-6a63-46b2-b3fd-0cd15edbab08 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2e13f1952a4e5bb23d57dd7fa31875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b2a56286924e2d953bebe717ce591b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:17.714846 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-b2730fd4-c372-476f-8e62-84eaad378123 req-5b667bfb-5895-4056-9b94-d01b802724fb service nova] Creating event network-changed:0a909b9a-561b-42d5-bf2f-d3cc0b3356b5 for instance d7f3a7bd-a731-45de-a24b-e04e9d81358d on nch2-master-1 Oct 08 21:03:17.715364 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-b2730fd4-c372-476f-8e62-84eaad378123 req-5b667bfb-5895-4056-9b94-d01b802724fb service nova] Creating event network-vif-deleted:582a8fd3-4fba-41bc-be82-7424ac768342 for instance 0e762f82-ada3-411d-9072-37e72381145d on nch2-master-1 Oct 08 21:03:17.715869 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-b2730fd4-c372-476f-8e62-84eaad378123 req-5b667bfb-5895-4056-9b94-d01b802724fb service nova] Creating event network-vif-deleted:c71c8a62-3e86-493c-9ee0-a514776c7ea0 for instance 0e762f82-ada3-411d-9072-37e72381145d on nch2-master-1 Oct 08 21:03:17.717460 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-d99c47fb-6a63-46b2-b3fd-0cd15edbab08 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] 10.222.0.26 "GET /compute/v2.1/servers/570d4898-169b-4f6b-aef6-ab79ea0fbefd" status: 200 len: 1506 microversion: 2.1 time: 0.159370 Oct 08 21:03:17.718310 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1407/2757] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:17 2022] GET /compute/v2.1/servers/570d4898-169b-4f6b-aef6-ab79ea0fbefd => generated 1506 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:03:17.721703 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [req-b2730fd4-c372-476f-8e62-84eaad378123 req-5b667bfb-5895-4056-9b94-d01b802724fb service nova] Instance d7f3a7bd-a731-45de-a24b-e04e9d81358d is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140491) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 08 21:03:17.734262 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-b2730fd4-c372-476f-8e62-84eaad378123 req-5b667bfb-5895-4056-9b94-d01b802724fb service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 521 microversion: 2.1 time: 0.048202 Oct 08 21:03:17.734845 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1351/2758] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:03:17 2022] POST /compute/v2.1/os-server-external-events => generated 521 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:03:17.979695 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-b5cec26e-4d7b-4e60-b8bc-f14755faffac tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:17.980341 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-b5cec26e-4d7b-4e60-b8bc-f14755faffac tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] [instance: 0b52e623-6990-4978-811d-68fc294fe304] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:17.986888 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b5cec26e-4d7b-4e60-b8bc-f14755faffac tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:17.987378 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b5cec26e-4d7b-4e60-b8bc-f14755faffac tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:17.987823 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b5cec26e-4d7b-4e60-b8bc-f14755faffac tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:17.988520 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b5cec26e-4d7b-4e60-b8bc-f14755faffac tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:17.988984 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b5cec26e-4d7b-4e60-b8bc-f14755faffac tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:17.990062 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b5cec26e-4d7b-4e60-b8bc-f14755faffac tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:18.086649 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-29996889-112e-43aa-ad22-ea400876262f tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:18.087348 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-29996889-112e-43aa-ad22-ea400876262f tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] [instance: 0e762f82-ada3-411d-9072-37e72381145d] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:18.093634 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-29996889-112e-43aa-ad22-ea400876262f tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:18.094123 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-29996889-112e-43aa-ad22-ea400876262f tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:18.094559 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-29996889-112e-43aa-ad22-ea400876262f tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:18.095253 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-29996889-112e-43aa-ad22-ea400876262f tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:18.095709 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-29996889-112e-43aa-ad22-ea400876262f tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:18.096163 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-29996889-112e-43aa-ad22-ea400876262f tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:18.123819 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-b5cec26e-4d7b-4e60-b8bc-f14755faffac tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095debf3968c448fb3c3add0322d8d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc9bed6d76834f6fa66d681ecd9f4e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:18.131736 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-b5cec26e-4d7b-4e60-b8bc-f14755faffac tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] 10.222.0.26 "GET /compute/v2.1/servers/0b52e623-6990-4978-811d-68fc294fe304" status: 200 len: 1321 microversion: 2.1 time: 0.156258 Oct 08 21:03:18.132322 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1408/2759] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:17 2022] GET /compute/v2.1/servers/0b52e623-6990-4978-811d-68fc294fe304 => generated 1321 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:18.159597 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-29996889-112e-43aa-ad22-ea400876262f tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f60e33f334465fac1148669de3f00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4735bf74f33a4739800d766c82d973d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:18.167938 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-29996889-112e-43aa-ad22-ea400876262f tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] 10.222.0.26 "GET /compute/v2.1/servers/0e762f82-ada3-411d-9072-37e72381145d" status: 200 len: 1297 microversion: 2.1 time: 0.085442 Oct 08 21:03:18.168509 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1352/2760] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:18 2022] GET /compute/v2.1/servers/0e762f82-ada3-411d-9072-37e72381145d => generated 1297 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:03:18.277933 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-b4698916-92fb-4038-9c2c-005689ce62dd tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:18.278566 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-b4698916-92fb-4038-9c2c-005689ce62dd tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: d7f3a7bd-a731-45de-a24b-e04e9d81358d] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:18.285425 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b4698916-92fb-4038-9c2c-005689ce62dd tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:18.285927 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b4698916-92fb-4038-9c2c-005689ce62dd tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:18.286999 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b4698916-92fb-4038-9c2c-005689ce62dd tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:18.287723 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b4698916-92fb-4038-9c2c-005689ce62dd tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:18.288191 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b4698916-92fb-4038-9c2c-005689ce62dd tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:18.288630 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b4698916-92fb-4038-9c2c-005689ce62dd tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:18.427967 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-b4698916-92fb-4038-9c2c-005689ce62dd tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:18.436583 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-b4698916-92fb-4038-9c2c-005689ce62dd tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/d7f3a7bd-a731-45de-a24b-e04e9d81358d" status: 200 len: 1536 microversion: 2.1 time: 0.162491 Oct 08 21:03:18.437332 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1409/2761] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:18 2022] GET /compute/v2.1/servers/d7f3a7bd-a731-45de-a24b-e04e9d81358d => generated 1536 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:18.571992 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-9438d4b9-8492-4923-96f9-c3eb2c3cf0cf tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:18.572530 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-9438d4b9-8492-4923-96f9-c3eb2c3cf0cf tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] [instance: 6e8a4e07-0b30-44a3-aa7d-8d4677cc1d5f] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:18.579421 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9438d4b9-8492-4923-96f9-c3eb2c3cf0cf tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:18.579907 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9438d4b9-8492-4923-96f9-c3eb2c3cf0cf tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:18.580357 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9438d4b9-8492-4923-96f9-c3eb2c3cf0cf tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:18.581033 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9438d4b9-8492-4923-96f9-c3eb2c3cf0cf tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:18.581522 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9438d4b9-8492-4923-96f9-c3eb2c3cf0cf tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:18.581947 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9438d4b9-8492-4923-96f9-c3eb2c3cf0cf tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:18.646353 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-92a3ef11-4e5f-47e7-b370-463c70e20be7 req-c0909ba2-874e-4acc-b570-8111c1d7e97a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d7debe3-3039-401c-891d-4c6e4b96cbb8", "name": "network-vif-plugged", "status": "completed", "tag": "9be27357-49f2-42c9-a347-c6ce1c36dbff"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:03:18.657706 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-92a3ef11-4e5f-47e7-b370-463c70e20be7 req-c0909ba2-874e-4acc-b570-8111c1d7e97a service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:18.658189 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-92a3ef11-4e5f-47e7-b370-463c70e20be7 req-c0909ba2-874e-4acc-b570-8111c1d7e97a service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:18.658621 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-92a3ef11-4e5f-47e7-b370-463c70e20be7 req-c0909ba2-874e-4acc-b570-8111c1d7e97a service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:18.670033 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-92a3ef11-4e5f-47e7-b370-463c70e20be7 req-c0909ba2-874e-4acc-b570-8111c1d7e97a service nova] Creating event network-vif-plugged:9be27357-49f2-42c9-a347-c6ce1c36dbff for instance 3d7debe3-3039-401c-891d-4c6e4b96cbb8 on nch1-master-1 Oct 08 21:03:18.675100 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-92a3ef11-4e5f-47e7-b370-463c70e20be7 req-c0909ba2-874e-4acc-b570-8111c1d7e97a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034270 Oct 08 21:03:18.676049 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1410/2762] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:03:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 08 21:03:18.711653 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-1f83ce53-b2f2-43e4-9c8f-56289eadbf5b tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:18.712531 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-1f83ce53-b2f2-43e4-9c8f-56289eadbf5b tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] [instance: 50a243fc-ec9e-4e15-a0c6-240c525af882] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:18.719697 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1f83ce53-b2f2-43e4-9c8f-56289eadbf5b tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:18.720199 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1f83ce53-b2f2-43e4-9c8f-56289eadbf5b tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:18.720641 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1f83ce53-b2f2-43e4-9c8f-56289eadbf5b tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:18.721388 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1f83ce53-b2f2-43e4-9c8f-56289eadbf5b tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:18.721852 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1f83ce53-b2f2-43e4-9c8f-56289eadbf5b tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:18.722286 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1f83ce53-b2f2-43e4-9c8f-56289eadbf5b tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:18.747765 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-9438d4b9-8492-4923-96f9-c3eb2c3cf0cf tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6088285b46499a98162b6237517174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b70cb43c39e4e0ba89680d7b8459c01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:18.758340 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-9438d4b9-8492-4923-96f9-c3eb2c3cf0cf tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] 10.222.0.26 "GET /compute/v2.1/servers/6e8a4e07-0b30-44a3-aa7d-8d4677cc1d5f" status: 200 len: 1512 microversion: 2.1 time: 0.190907 Oct 08 21:03:18.759194 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1353/2763] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:18 2022] GET /compute/v2.1/servers/6e8a4e07-0b30-44a3-aa7d-8d4677cc1d5f => generated 1512 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:18.780510 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-3ba1a06f-7d69-43d6-8cb2-7d1f09266b8a tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:18.781129 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-3ba1a06f-7d69-43d6-8cb2-7d1f09266b8a tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] [instance: 570d4898-169b-4f6b-aef6-ab79ea0fbefd] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:18.787344 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3ba1a06f-7d69-43d6-8cb2-7d1f09266b8a tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:18.787835 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3ba1a06f-7d69-43d6-8cb2-7d1f09266b8a tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:18.788273 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3ba1a06f-7d69-43d6-8cb2-7d1f09266b8a tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:18.788973 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3ba1a06f-7d69-43d6-8cb2-7d1f09266b8a tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:18.789462 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3ba1a06f-7d69-43d6-8cb2-7d1f09266b8a tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:18.789888 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3ba1a06f-7d69-43d6-8cb2-7d1f09266b8a tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:18.878016 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-1f83ce53-b2f2-43e4-9c8f-56289eadbf5b tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95cfeacf062f486c985ca772f2f36faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f51fe43d7c143ebb6d53f5942941c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:18.886635 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-1f83ce53-b2f2-43e4-9c8f-56289eadbf5b tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] 10.222.0.26 "GET /compute/v2.1/servers/50a243fc-ec9e-4e15-a0c6-240c525af882" status: 200 len: 1542 microversion: 2.1 time: 0.180641 Oct 08 21:03:18.887233 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1411/2764] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:18 2022] GET /compute/v2.1/servers/50a243fc-ec9e-4e15-a0c6-240c525af882 => generated 1542 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:03:19.154834 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-1bc49883-6e08-427f-a097-0d2e6a3fbb31 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:19.155516 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-1bc49883-6e08-427f-a097-0d2e6a3fbb31 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] [instance: 0b52e623-6990-4978-811d-68fc294fe304] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:19.167298 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1bc49883-6e08-427f-a097-0d2e6a3fbb31 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:19.168248 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1bc49883-6e08-427f-a097-0d2e6a3fbb31 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:19.168380 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1bc49883-6e08-427f-a097-0d2e6a3fbb31 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:19.171948 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1bc49883-6e08-427f-a097-0d2e6a3fbb31 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:19.172674 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1bc49883-6e08-427f-a097-0d2e6a3fbb31 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:19.175575 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1bc49883-6e08-427f-a097-0d2e6a3fbb31 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:19.483630 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-3ba1a06f-7d69-43d6-8cb2-7d1f09266b8a tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2e13f1952a4e5bb23d57dd7fa31875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b2a56286924e2d953bebe717ce591b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:19.516388 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-3ba1a06f-7d69-43d6-8cb2-7d1f09266b8a tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] 10.222.0.26 "GET /compute/v2.1/servers/570d4898-169b-4f6b-aef6-ab79ea0fbefd" status: 200 len: 1506 microversion: 2.1 time: 0.751749 Oct 08 21:03:19.518848 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1354/2765] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:18 2022] GET /compute/v2.1/servers/570d4898-169b-4f6b-aef6-ab79ea0fbefd => generated 1506 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:19.538119 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-071de34c-a13f-4fed-bfa7-420b91acccfa tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:19.549823 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-071de34c-a13f-4fed-bfa7-420b91acccfa tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] [instance: 0e762f82-ada3-411d-9072-37e72381145d] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:19.555387 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:INSERT=6,nova_api:SELECT=93,nova_api:UPDATE=1 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:03:19.556779 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-071de34c-a13f-4fed-bfa7-420b91acccfa tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:19.557526 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-071de34c-a13f-4fed-bfa7-420b91acccfa tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:19.558145 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-071de34c-a13f-4fed-bfa7-420b91acccfa tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:19.559071 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-071de34c-a13f-4fed-bfa7-420b91acccfa tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:19.569948 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-071de34c-a13f-4fed-bfa7-420b91acccfa tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:19.570676 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-071de34c-a13f-4fed-bfa7-420b91acccfa tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:19.639031 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-071de34c-a13f-4fed-bfa7-420b91acccfa tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:19.639526 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-071de34c-a13f-4fed-bfa7-420b91acccfa tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:19.639977 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-071de34c-a13f-4fed-bfa7-420b91acccfa tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:19.640430 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.objects.instance [None req-071de34c-a13f-4fed-bfa7-420b91acccfa tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lazy-loading 'fault' on Instance uuid 0e762f82-ada3-411d-9072-37e72381145d {{(pid=140491) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 21:03:19.716349 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-071de34c-a13f-4fed-bfa7-420b91acccfa tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f60e33f334465fac1148669de3f00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4735bf74f33a4739800d766c82d973d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:19.725141 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-071de34c-a13f-4fed-bfa7-420b91acccfa tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] 10.222.0.26 "GET /compute/v2.1/servers/0e762f82-ada3-411d-9072-37e72381145d" status: 200 len: 1302 microversion: 2.1 time: 0.202455 Oct 08 21:03:19.725772 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1355/2766] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:19 2022] GET /compute/v2.1/servers/0e762f82-ada3-411d-9072-37e72381145d => generated 1302 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:19.732667 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-1bc49883-6e08-427f-a097-0d2e6a3fbb31 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095debf3968c448fb3c3add0322d8d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc9bed6d76834f6fa66d681ecd9f4e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:19.741854 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-1bc49883-6e08-427f-a097-0d2e6a3fbb31 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] 10.222.0.26 "GET /compute/v2.1/servers/0b52e623-6990-4978-811d-68fc294fe304" status: 200 len: 1321 microversion: 2.1 time: 0.591991 Oct 08 21:03:19.742437 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1412/2767] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:19 2022] GET /compute/v2.1/servers/0b52e623-6990-4978-811d-68fc294fe304 => generated 1321 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:03:19.743693 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-410e0a63-f87e-4cae-b081-d492da69a3d6 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:19.744380 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-410e0a63-f87e-4cae-b081-d492da69a3d6 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: d7f3a7bd-a731-45de-a24b-e04e9d81358d] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:19.750551 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-410e0a63-f87e-4cae-b081-d492da69a3d6 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:19.751039 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-410e0a63-f87e-4cae-b081-d492da69a3d6 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:19.751476 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-410e0a63-f87e-4cae-b081-d492da69a3d6 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:19.752181 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-410e0a63-f87e-4cae-b081-d492da69a3d6 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:19.752637 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-410e0a63-f87e-4cae-b081-d492da69a3d6 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:19.753062 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-410e0a63-f87e-4cae-b081-d492da69a3d6 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:19.790839 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-6f12a069-1c17-465d-b499-43057b4e6c10 tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:19.791478 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-6f12a069-1c17-465d-b499-43057b4e6c10 tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] [instance: 6e8a4e07-0b30-44a3-aa7d-8d4677cc1d5f] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:19.814850 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6f12a069-1c17-465d-b499-43057b4e6c10 tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:19.815324 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6f12a069-1c17-465d-b499-43057b4e6c10 tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:19.817095 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6f12a069-1c17-465d-b499-43057b4e6c10 tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:19.819477 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6f12a069-1c17-465d-b499-43057b4e6c10 tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:19.822456 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6f12a069-1c17-465d-b499-43057b4e6c10 tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:19.822611 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6f12a069-1c17-465d-b499-43057b4e6c10 tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:20.061387 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-6f12a069-1c17-465d-b499-43057b4e6c10 tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6088285b46499a98162b6237517174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b70cb43c39e4e0ba89680d7b8459c01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:20.069944 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-6f12a069-1c17-465d-b499-43057b4e6c10 tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] 10.222.0.26 "GET /compute/v2.1/servers/6e8a4e07-0b30-44a3-aa7d-8d4677cc1d5f" status: 200 len: 1512 microversion: 2.1 time: 0.291385 Oct 08 21:03:20.070532 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1413/2768] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:19 2022] GET /compute/v2.1/servers/6e8a4e07-0b30-44a3-aa7d-8d4677cc1d5f => generated 1512 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:03:20.075205 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-5f59b693-ebee-4a02-b2e0-15e9ab6804bb tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:20.075830 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-5f59b693-ebee-4a02-b2e0-15e9ab6804bb tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] [instance: 50a243fc-ec9e-4e15-a0c6-240c525af882] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:20.081724 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5f59b693-ebee-4a02-b2e0-15e9ab6804bb tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:20.082232 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5f59b693-ebee-4a02-b2e0-15e9ab6804bb tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:20.082687 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5f59b693-ebee-4a02-b2e0-15e9ab6804bb tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:20.084243 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5f59b693-ebee-4a02-b2e0-15e9ab6804bb tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:20.084896 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5f59b693-ebee-4a02-b2e0-15e9ab6804bb tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:20.085361 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5f59b693-ebee-4a02-b2e0-15e9ab6804bb tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:20.198756 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-410e0a63-f87e-4cae-b081-d492da69a3d6 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:20.208487 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-410e0a63-f87e-4cae-b081-d492da69a3d6 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/d7f3a7bd-a731-45de-a24b-e04e9d81358d" status: 200 len: 1529 microversion: 2.1 time: 0.480822 Oct 08 21:03:20.209217 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1356/2769] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:19 2022] GET /compute/v2.1/servers/d7f3a7bd-a731-45de-a24b-e04e9d81358d => generated 1529 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:20.224585 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-5f59b693-ebee-4a02-b2e0-15e9ab6804bb tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95cfeacf062f486c985ca772f2f36faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f51fe43d7c143ebb6d53f5942941c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:20.231206 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-755db018-af06-46d4-bee8-2485c4c623aa tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:20.232067 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-755db018-af06-46d4-bee8-2485c4c623aa tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: d7f3a7bd-a731-45de-a24b-e04e9d81358d] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:20.234790 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-5f59b693-ebee-4a02-b2e0-15e9ab6804bb tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] 10.222.0.26 "GET /compute/v2.1/servers/50a243fc-ec9e-4e15-a0c6-240c525af882" status: 200 len: 1542 microversion: 2.1 time: 0.163237 Oct 08 21:03:20.235525 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1414/2770] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:20 2022] GET /compute/v2.1/servers/50a243fc-ec9e-4e15-a0c6-240c525af882 => generated 1542 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:20.238556 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-755db018-af06-46d4-bee8-2485c4c623aa tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:20.239040 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-755db018-af06-46d4-bee8-2485c4c623aa tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:20.239538 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-755db018-af06-46d4-bee8-2485c4c623aa tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:20.240215 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-755db018-af06-46d4-bee8-2485c4c623aa tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:20.240673 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-755db018-af06-46d4-bee8-2485c4c623aa tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:20.241098 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-755db018-af06-46d4-bee8-2485c4c623aa tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:20.544414 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-4dbf0ba3-5847-46f9-807f-9950d6fe2369 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:20.545447 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-4dbf0ba3-5847-46f9-807f-9950d6fe2369 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] [instance: 570d4898-169b-4f6b-aef6-ab79ea0fbefd] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:20.557673 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4dbf0ba3-5847-46f9-807f-9950d6fe2369 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:20.558287 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4dbf0ba3-5847-46f9-807f-9950d6fe2369 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:20.558806 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4dbf0ba3-5847-46f9-807f-9950d6fe2369 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:20.559593 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4dbf0ba3-5847-46f9-807f-9950d6fe2369 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:20.560250 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4dbf0ba3-5847-46f9-807f-9950d6fe2369 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:20.560813 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4dbf0ba3-5847-46f9-807f-9950d6fe2369 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:20.624157 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-755db018-af06-46d4-bee8-2485c4c623aa tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:20.641078 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-755db018-af06-46d4-bee8-2485c4c623aa tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/d7f3a7bd-a731-45de-a24b-e04e9d81358d" status: 200 len: 1529 microversion: 2.1 time: 0.413554 Oct 08 21:03:20.642078 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1357/2771] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:20 2022] GET /compute/v2.1/servers/d7f3a7bd-a731-45de-a24b-e04e9d81358d => generated 1529 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:20.668675 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-3abfc121-9ac1-4823-9145-90d6305cd015 tempest-MigrationsAdminTest-1609748928 tempest-MigrationsAdminTest-1609748928-project-admin] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:20.675758 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-3abfc121-9ac1-4823-9145-90d6305cd015 tempest-MigrationsAdminTest-1609748928 tempest-MigrationsAdminTest-1609748928-project-admin] HTTP exception thrown: Flavor a27506c8-e431-412e-9a38-928f17d8819e could not be found. Oct 08 21:03:20.700656 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-3abfc121-9ac1-4823-9145-90d6305cd015 tempest-MigrationsAdminTest-1609748928 tempest-MigrationsAdminTest-1609748928-project-admin] Request method failure captured: Oct 08 21:03:20.700656 ncdv-master-1 devstack@n-api.service[140491]: request: DELETE /compute/v2.1/flavors/a27506c8-e431-412e-9a38-928f17d8819e HTTP/1.1 Oct 08 21:03:20.700656 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:03:20.700656 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:03:20.700656 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:03:20.700656 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 21:03:20.700656 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:03:20.700656 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:03:20.700656 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:03:20.700656 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:03:20.700656 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeSqymibhTe2nzO-wqH8zZgwtmk6z7_FF46CKieSB16Dw3r50O1Wf8OrhQmNMUN20WJq9WA8I9kvbgZ9JMM9BxnWpR-TNmmuH1luqFgDAtQYbhJui6wRz7WG6Ig-OvgNdwxoyxsX0MhrirG5KffwDeJzFiPtXpIEFoUkPdyfMsQzPJQ Oct 08 21:03:20.700656 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:03:20.700656 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:03:20.700656 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:03:20.700656 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:03:20.700656 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:03:20.700656 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:03:20.700656 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 6cbd4579af204aa6b396906ca1430d3c Oct 08 21:03:20.700656 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-MigrationsAdminTest-1609748928 Oct 08 21:03:20.700656 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,admin,member Oct 08 21:03:20.700656 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,admin,member Oct 08 21:03:20.700656 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6cbd4579af204aa6b396906ca1430d3c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6cbd4579af204aa6b396906ca1430d3c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6cbd4579af204aa6b396906ca1430d3c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6cbd4579af204aa6b396906ca1430d3c"}]}] Oct 08 21:03:20.700656 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-MigrationsAdminTest-1609748928 Oct 08 21:03:20.700656 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 6cbd4579af204aa6b396906ca1430d3c Oct 08 21:03:20.700656 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-MigrationsAdminTest-1609748928 Oct 08 21:03:20.700656 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-MigrationsAdminTest-1609748928-project-admin Oct 08 21:03:20.700656 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:03:20.700656 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:03:20.700656 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 82eecd716629401493db6a979b7887cf Oct 08 21:03:20.700656 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-MigrationsAdminTest-1609748928-project-admin Oct 08 21:03:20.700656 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:03:20.700656 ncdv-master-1 devstack@n-api.service[140491]: exception: Flavor a27506c8-e431-412e-9a38-928f17d8819e could not be found. Oct 08 21:03:20.700656 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': 'a27506c8-e431-412e-9a38-928f17d8819e'} Oct 08 21:03:20.700656 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:03:20.700656 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:03:20.700656 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Oct 08 21:03:20.700656 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi flavor.destroy() Oct 08 21:03:20.700656 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 08 21:03:20.700656 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 08 21:03:20.700656 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Oct 08 21:03:20.700656 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Oct 08 21:03:20.700656 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Oct 08 21:03:20.700656 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Oct 08 21:03:20.700656 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 08 21:03:20.700656 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 08 21:03:20.700656 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Oct 08 21:03:20.700656 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Oct 08 21:03:20.700656 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor a27506c8-e431-412e-9a38-928f17d8819e could not be found. Oct 08 21:03:20.700656 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:03:20.700656 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:03:20.700656 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:03:20.700656 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:03:20.700656 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:03:20.700656 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:03:20.700656 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:03:20.700656 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:03:20.700656 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:03:20.700656 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:03:20.700656 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Oct 08 21:03:20.700656 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:03:20.700656 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor a27506c8-e431-412e-9a38-928f17d8819e could not be found. Oct 08 21:03:20.700656 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:03:20.700656 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:03:20.706738 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:03:20.706738 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:03:20.706738 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:03:20.706738 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:03:20.706738 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:03:20.706738 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:03:20.706738 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor a27506c8-e431-412e-9a38-928f17d8819e could not be found. Oct 08 21:03:20.706738 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:03:20.706738 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-3abfc121-9ac1-4823-9145-90d6305cd015 tempest-MigrationsAdminTest-1609748928 tempest-MigrationsAdminTest-1609748928-project-admin] Returning 404 to user: Flavor a27506c8-e431-412e-9a38-928f17d8819e could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:03:20.709223 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-3abfc121-9ac1-4823-9145-90d6305cd015 tempest-MigrationsAdminTest-1609748928 tempest-MigrationsAdminTest-1609748928-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/a27506c8-e431-412e-9a38-928f17d8819e" status: 404 len: 109 microversion: 2.1 time: 0.040514 Oct 08 21:03:20.711723 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1358/2772] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:03:20 2022] DELETE /compute/v2.1/flavors/a27506c8-e431-412e-9a38-928f17d8819e => generated 109 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:03:20.750488 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-aad55946-4b84-4ee8-8e6b-fe4ac68af9bf tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:20.751270 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-aad55946-4b84-4ee8-8e6b-fe4ac68af9bf tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] [instance: 0e762f82-ada3-411d-9072-37e72381145d] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:20.762555 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-4dbf0ba3-5847-46f9-807f-9950d6fe2369 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2e13f1952a4e5bb23d57dd7fa31875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b2a56286924e2d953bebe717ce591b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:20.769559 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-aad55946-4b84-4ee8-8e6b-fe4ac68af9bf tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:20.770186 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-aad55946-4b84-4ee8-8e6b-fe4ac68af9bf tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:20.772340 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-aad55946-4b84-4ee8-8e6b-fe4ac68af9bf tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:20.773523 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-aad55946-4b84-4ee8-8e6b-fe4ac68af9bf tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:20.774492 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-aad55946-4b84-4ee8-8e6b-fe4ac68af9bf tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:20.777328 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-aad55946-4b84-4ee8-8e6b-fe4ac68af9bf tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:20.779799 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-4dbf0ba3-5847-46f9-807f-9950d6fe2369 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] 10.222.0.26 "GET /compute/v2.1/servers/570d4898-169b-4f6b-aef6-ab79ea0fbefd" status: 200 len: 1506 microversion: 2.1 time: 0.240053 Oct 08 21:03:20.794567 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1415/2773] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:20 2022] GET /compute/v2.1/servers/570d4898-169b-4f6b-aef6-ab79ea0fbefd => generated 1506 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:20.800704 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-aad55946-4b84-4ee8-8e6b-fe4ac68af9bf tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] HTTP exception thrown: Instance 0e762f82-ada3-411d-9072-37e72381145d could not be found. Oct 08 21:03:20.803071 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-aad55946-4b84-4ee8-8e6b-fe4ac68af9bf tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Request method failure captured: Oct 08 21:03:20.803071 ncdv-master-1 devstack@n-api.service[140491]: request: GET /compute/v2.1/servers/0e762f82-ada3-411d-9072-37e72381145d HTTP/1.1 Oct 08 21:03:20.803071 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:03:20.803071 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:03:20.803071 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:03:20.803071 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 21:03:20.803071 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:03:20.803071 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:03:20.803071 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:03:20.803071 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:03:20.803071 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeVUEnRvCLyCdYjboZWSkex8rTCtYI1WBk9L9mszZTx76Yjj3LxtSlFNG9MVk6PLQz6uz0j43wAsyIQ12BqqCeuqBLoD2YPavK2g1xvBbLBuCYCYfHR4_kPFl1spz3btBQTXrY3gFkG7sssAZkB-WmdL9ekIbfJeNfVQZChikHfwtuo Oct 08 21:03:20.803071 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:03:20.803071 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:03:20.803071 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:03:20.803071 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:03:20.803071 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:03:20.803071 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:03:20.803071 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 4735bf74f33a4739800d766c82d973d4 Oct 08 21:03:20.803071 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-ServersTestMultiNic-898906473 Oct 08 21:03:20.803071 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:03:20.803071 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:03:20.803071 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/4735bf74f33a4739800d766c82d973d4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4735bf74f33a4739800d766c82d973d4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_4735bf74f33a4739800d766c82d973d4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4735bf74f33a4739800d766c82d973d4"}]}] Oct 08 21:03:20.803071 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-ServersTestMultiNic-898906473 Oct 08 21:03:20.803071 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 4735bf74f33a4739800d766c82d973d4 Oct 08 21:03:20.803071 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-ServersTestMultiNic-898906473 Oct 08 21:03:20.803071 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-ServersTestMultiNic-898906473-project Oct 08 21:03:20.803071 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:03:20.803071 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:03:20.803071 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 40f60e33f334465fac1148669de3f00c Oct 08 21:03:20.803071 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-ServersTestMultiNic-898906473-project Oct 08 21:03:20.803071 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:03:20.803071 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance 0e762f82-ada3-411d-9072-37e72381145d could not be found. Oct 08 21:03:20.803071 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': '0e762f82-ada3-411d-9072-37e72381145d'} Oct 08 21:03:20.803071 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:03:20.803071 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:03:20.803071 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:03:20.803071 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:03:20.803071 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:03:20.803071 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:03:20.803071 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:03:20.803071 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:03:20.803071 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:03:20.803071 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:03:20.803071 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e762f82-ada3-411d-9072-37e72381145d could not be found. Oct 08 21:03:20.803071 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:03:20.803071 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:03:20.803071 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:03:20.803071 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:03:20.803071 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:03:20.803071 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:03:20.803071 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:03:20.803071 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:03:20.803071 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:03:20.803071 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:03:20.803071 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:03:20.803071 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:03:20.803071 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:03:20.803071 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:03:20.803071 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:03:20.803071 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:03:20.803071 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e762f82-ada3-411d-9072-37e72381145d could not be found. Oct 08 21:03:20.803071 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:03:20.803071 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:03:20.803071 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:03:20.807865 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:03:20.807865 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:03:20.807865 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:03:20.807865 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:03:20.807865 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:03:20.807865 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e762f82-ada3-411d-9072-37e72381145d could not be found. Oct 08 21:03:20.807865 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:03:20.809749 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-aad55946-4b84-4ee8-8e6b-fe4ac68af9bf tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Returning 404 to user: Instance 0e762f82-ada3-411d-9072-37e72381145d could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:03:20.810991 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-aad55946-4b84-4ee8-8e6b-fe4ac68af9bf tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] 10.222.0.26 "GET /compute/v2.1/servers/0e762f82-ada3-411d-9072-37e72381145d" status: 404 len: 111 microversion: 2.1 time: 0.064863 Oct 08 21:03:20.811879 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e042ada4-5fc5-45c4-b63f-57c6aa1f01f8 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:20.812915 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1359/2774] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:20 2022] GET /compute/v2.1/servers/0e762f82-ada3-411d-9072-37e72381145d => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:03:20.813590 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-e042ada4-5fc5-45c4-b63f-57c6aa1f01f8 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] [instance: 0b52e623-6990-4978-811d-68fc294fe304] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:20.823162 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-2cf63eb3-d27e-4e72-bf4b-fa61fbc523d1 req-e06dbee9-e006-4c6d-8440-4e3fe540d53f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50a243fc-ec9e-4e15-a0c6-240c525af882", "name": "network-vif-deleted", "tag": "87b9c9d6-fc1c-4415-b9ba-4d06b63de0b4"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:03:20.832053 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:03:20.836109 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e042ada4-5fc5-45c4-b63f-57c6aa1f01f8 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:20.842449 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-2cf63eb3-d27e-4e72-bf4b-fa61fbc523d1 req-e06dbee9-e006-4c6d-8440-4e3fe540d53f service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:20.842939 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-2cf63eb3-d27e-4e72-bf4b-fa61fbc523d1 req-e06dbee9-e006-4c6d-8440-4e3fe540d53f service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:20.843463 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-2cf63eb3-d27e-4e72-bf4b-fa61fbc523d1 req-e06dbee9-e006-4c6d-8440-4e3fe540d53f service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:20.845064 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e042ada4-5fc5-45c4-b63f-57c6aa1f01f8 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:20.845804 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e042ada4-5fc5-45c4-b63f-57c6aa1f01f8 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:20.846813 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e042ada4-5fc5-45c4-b63f-57c6aa1f01f8 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:20.847524 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e042ada4-5fc5-45c4-b63f-57c6aa1f01f8 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:20.848207 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e042ada4-5fc5-45c4-b63f-57c6aa1f01f8 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:20.882582 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-2cf63eb3-d27e-4e72-bf4b-fa61fbc523d1 req-e06dbee9-e006-4c6d-8440-4e3fe540d53f service nova] Creating event network-vif-deleted:87b9c9d6-fc1c-4415-b9ba-4d06b63de0b4 for instance 50a243fc-ec9e-4e15-a0c6-240c525af882 on nch1-master-1 Oct 08 21:03:20.904832 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-2cf63eb3-d27e-4e72-bf4b-fa61fbc523d1 req-e06dbee9-e006-4c6d-8440-4e3fe540d53f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087343 Oct 08 21:03:20.910562 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1360/2775] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:03:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:03:20.988497 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-ae622e6f-a46d-4fc6-a210-e9ed5ea177b7 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-2058998701", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:03:21.054174 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.network.neutron [None req-ae622e6f-a46d-4fc6-a210-e9ed5ea177b7 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] validate_networks() for None {{(pid=140491) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 21:03:21.214351 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-e042ada4-5fc5-45c4-b63f-57c6aa1f01f8 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095debf3968c448fb3c3add0322d8d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc9bed6d76834f6fa66d681ecd9f4e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:21.222796 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-e042ada4-5fc5-45c4-b63f-57c6aa1f01f8 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] 10.222.0.26 "GET /compute/v2.1/servers/0b52e623-6990-4978-811d-68fc294fe304" status: 200 len: 1321 microversion: 2.1 time: 0.427039 Oct 08 21:03:21.223412 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1416/2776] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:20 2022] GET /compute/v2.1/servers/0b52e623-6990-4978-811d-68fc294fe304 => generated 1321 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:21.247469 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-9395c222-766d-4984-a29b-d87730b42278 tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:21.248138 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-9395c222-766d-4984-a29b-d87730b42278 tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] [instance: 6e8a4e07-0b30-44a3-aa7d-8d4677cc1d5f] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:21.255079 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9395c222-766d-4984-a29b-d87730b42278 tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:21.255772 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9395c222-766d-4984-a29b-d87730b42278 tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:21.256235 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9395c222-766d-4984-a29b-d87730b42278 tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:21.257017 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9395c222-766d-4984-a29b-d87730b42278 tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:21.257979 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9395c222-766d-4984-a29b-d87730b42278 tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:21.258699 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9395c222-766d-4984-a29b-d87730b42278 tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:21.318806 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9395c222-766d-4984-a29b-d87730b42278 tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:21.322245 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9395c222-766d-4984-a29b-d87730b42278 tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:21.323500 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9395c222-766d-4984-a29b-d87730b42278 tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:21.325640 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.objects.instance [None req-9395c222-766d-4984-a29b-d87730b42278 tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Lazy-loading 'fault' on Instance uuid 6e8a4e07-0b30-44a3-aa7d-8d4677cc1d5f {{(pid=140492) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 21:03:21.378690 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-9395c222-766d-4984-a29b-d87730b42278 tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6088285b46499a98162b6237517174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b70cb43c39e4e0ba89680d7b8459c01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:21.388768 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-9395c222-766d-4984-a29b-d87730b42278 tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] 10.222.0.26 "GET /compute/v2.1/servers/6e8a4e07-0b30-44a3-aa7d-8d4677cc1d5f" status: 200 len: 1307 microversion: 2.1 time: 0.145719 Oct 08 21:03:21.402374 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1417/2777] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:21 2022] GET /compute/v2.1/servers/6e8a4e07-0b30-44a3-aa7d-8d4677cc1d5f => generated 1307 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:21.413534 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-1933ebf5-936d-470e-9222-d929d2bafd00 tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:21.414444 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-1933ebf5-936d-470e-9222-d929d2bafd00 tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] [instance: 50a243fc-ec9e-4e15-a0c6-240c525af882] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:21.422049 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1933ebf5-936d-470e-9222-d929d2bafd00 tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:21.422746 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1933ebf5-936d-470e-9222-d929d2bafd00 tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:21.423366 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1933ebf5-936d-470e-9222-d929d2bafd00 tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:21.424264 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1933ebf5-936d-470e-9222-d929d2bafd00 tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:21.424900 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1933ebf5-936d-470e-9222-d929d2bafd00 tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:21.425586 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1933ebf5-936d-470e-9222-d929d2bafd00 tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:21.467083 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1933ebf5-936d-470e-9222-d929d2bafd00 tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:21.467540 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1933ebf5-936d-470e-9222-d929d2bafd00 tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:21.467999 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1933ebf5-936d-470e-9222-d929d2bafd00 tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:21.468622 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.objects.instance [None req-1933ebf5-936d-470e-9222-d929d2bafd00 tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Lazy-loading 'fault' on Instance uuid 50a243fc-ec9e-4e15-a0c6-240c525af882 {{(pid=140492) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 21:03:21.525955 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-1933ebf5-936d-470e-9222-d929d2bafd00 tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95cfeacf062f486c985ca772f2f36faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f51fe43d7c143ebb6d53f5942941c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:21.544523 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-1933ebf5-936d-470e-9222-d929d2bafd00 tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] 10.222.0.26 "GET /compute/v2.1/servers/50a243fc-ec9e-4e15-a0c6-240c525af882" status: 200 len: 1322 microversion: 2.1 time: 0.140783 Oct 08 21:03:21.545508 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1418/2778] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:21 2022] GET /compute/v2.1/servers/50a243fc-ec9e-4e15-a0c6-240c525af882 => generated 1322 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:21.551058 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-befc35d1-e6c2-48d8-af06-eeaf8ec293b2 req-1e05ffc6-8e6b-40e3-8e35-5ef886994399 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7f3a7bd-a731-45de-a24b-e04e9d81358d", "name": "network-vif-plugged", "status": "completed", "tag": "0a909b9a-561b-42d5-bf2f-d3cc0b3356b5"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:03:21.560309 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-ae622e6f-a46d-4fc6-a210-e9ed5ea177b7 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Flavor limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 21:03:21.561398 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-ae622e6f-a46d-4fc6-a210-e9ed5ea177b7 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Image limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 21:03:21.562116 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-befc35d1-e6c2-48d8-af06-eeaf8ec293b2 req-1e05ffc6-8e6b-40e3-8e35-5ef886994399 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:21.562275 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-ae622e6f-a46d-4fc6-a210-e9ed5ea177b7 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Flavor pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 21:03:21.562750 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-ae622e6f-a46d-4fc6-a210-e9ed5ea177b7 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Image pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 21:03:21.563253 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-befc35d1-e6c2-48d8-af06-eeaf8ec293b2 req-1e05ffc6-8e6b-40e3-8e35-5ef886994399 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:21.563408 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-ae622e6f-a46d-4fc6-a210-e9ed5ea177b7 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 21:03:21.564005 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-befc35d1-e6c2-48d8-af06-eeaf8ec293b2 req-1e05ffc6-8e6b-40e3-8e35-5ef886994399 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:21.574850 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ae622e6f-a46d-4fc6-a210-e9ed5ea177b7 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:21.575669 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ae622e6f-a46d-4fc6-a210-e9ed5ea177b7 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:21.576242 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ae622e6f-a46d-4fc6-a210-e9ed5ea177b7 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:21.577418 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ae622e6f-a46d-4fc6-a210-e9ed5ea177b7 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:21.578232 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ae622e6f-a46d-4fc6-a210-e9ed5ea177b7 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:21.578813 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-befc35d1-e6c2-48d8-af06-eeaf8ec293b2 req-1e05ffc6-8e6b-40e3-8e35-5ef886994399 service nova] Creating event network-vif-plugged:0a909b9a-561b-42d5-bf2f-d3cc0b3356b5 for instance d7f3a7bd-a731-45de-a24b-e04e9d81358d on nch2-master-1 Oct 08 21:03:21.579156 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ae622e6f-a46d-4fc6-a210-e9ed5ea177b7 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:21.584601 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-befc35d1-e6c2-48d8-af06-eeaf8ec293b2 req-1e05ffc6-8e6b-40e3-8e35-5ef886994399 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037669 Oct 08 21:03:21.585395 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1419/2779] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:03:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:03:21.601002 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-ae622e6f-a46d-4fc6-a210-e9ed5ea177b7 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Getting quotas for project 0ffdae031c4f47d599acb30f1d3c87b9. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:03:21.606905 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-ae622e6f-a46d-4fc6-a210-e9ed5ea177b7 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Getting quotas for user 5266cd6be4514b3eac30a195f6b25772 and project 0ffdae031c4f47d599acb30f1d3c87b9. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:03:21.620815 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-ae622e6f-a46d-4fc6-a210-e9ed5ea177b7 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Going to run 1 instances... {{(pid=140491) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 21:03:21.623288 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-ae622e6f-a46d-4fc6-a210-e9ed5ea177b7 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: 6ef37448-690b-4fcf-85f8-a2fb71207f38] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c508bd7f-7db9-4b2c-af7c-be54a855c355',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140491) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 21:03:21.683097 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-ae622e6f-a46d-4fc6-a210-e9ed5ea177b7 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.698749 Oct 08 21:03:21.690430 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1361/2780] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 21:03:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 701 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 08 21:03:21.698084 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-5d8a0e31-c516-4743-8b17-53b34e6e988b tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:21.698693 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-5d8a0e31-c516-4743-8b17-53b34e6e988b tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: 6ef37448-690b-4fcf-85f8-a2fb71207f38] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:21.803737 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-5d8a0e31-c516-4743-8b17-53b34e6e988b tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:21.810294 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-bf604399-7c35-4720-be27-be97c102b060 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:21.811091 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-5d8a0e31-c516-4743-8b17-53b34e6e988b tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/6ef37448-690b-4fcf-85f8-a2fb71207f38" status: 200 len: 1213 microversion: 2.1 time: 0.118795 Oct 08 21:03:21.811222 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-bf604399-7c35-4720-be27-be97c102b060 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] [instance: 570d4898-169b-4f6b-aef6-ab79ea0fbefd] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:21.822072 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1420/2781] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:21 2022] GET /compute/v2.1/servers/6ef37448-690b-4fcf-85f8-a2fb71207f38 => generated 1213 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:21.831897 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bf604399-7c35-4720-be27-be97c102b060 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:21.833701 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bf604399-7c35-4720-be27-be97c102b060 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:21.833701 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bf604399-7c35-4720-be27-be97c102b060 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:21.834942 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bf604399-7c35-4720-be27-be97c102b060 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:21.840027 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bf604399-7c35-4720-be27-be97c102b060 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:21.841234 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bf604399-7c35-4720-be27-be97c102b060 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:22.071504 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-bf604399-7c35-4720-be27-be97c102b060 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2e13f1952a4e5bb23d57dd7fa31875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b2a56286924e2d953bebe717ce591b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:22.079826 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-bf604399-7c35-4720-be27-be97c102b060 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] 10.222.0.26 "GET /compute/v2.1/servers/570d4898-169b-4f6b-aef6-ab79ea0fbefd" status: 200 len: 1506 microversion: 2.1 time: 0.274814 Oct 08 21:03:22.096155 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1362/2782] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:21 2022] GET /compute/v2.1/servers/570d4898-169b-4f6b-aef6-ab79ea0fbefd => generated 1506 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:03:22.251177 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-cc4d268a-ffcc-4e5d-aae3-4dc3944e7d23 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:22.252059 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-cc4d268a-ffcc-4e5d-aae3-4dc3944e7d23 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] [instance: 0b52e623-6990-4978-811d-68fc294fe304] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:22.262397 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cc4d268a-ffcc-4e5d-aae3-4dc3944e7d23 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:22.263250 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cc4d268a-ffcc-4e5d-aae3-4dc3944e7d23 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:22.263899 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cc4d268a-ffcc-4e5d-aae3-4dc3944e7d23 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:22.264958 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cc4d268a-ffcc-4e5d-aae3-4dc3944e7d23 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:22.265823 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cc4d268a-ffcc-4e5d-aae3-4dc3944e7d23 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:22.266496 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cc4d268a-ffcc-4e5d-aae3-4dc3944e7d23 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:22.416719 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-be4c0eb3-8510-47df-996d-e77813d6a427 tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:22.417505 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-be4c0eb3-8510-47df-996d-e77813d6a427 tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] [instance: 6e8a4e07-0b30-44a3-aa7d-8d4677cc1d5f] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:22.424012 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-be4c0eb3-8510-47df-996d-e77813d6a427 tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:22.424508 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-be4c0eb3-8510-47df-996d-e77813d6a427 tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:22.424955 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-be4c0eb3-8510-47df-996d-e77813d6a427 tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:22.425722 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-be4c0eb3-8510-47df-996d-e77813d6a427 tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:22.426188 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-be4c0eb3-8510-47df-996d-e77813d6a427 tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:22.427235 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-be4c0eb3-8510-47df-996d-e77813d6a427 tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:22.441376 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-be4c0eb3-8510-47df-996d-e77813d6a427 tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] HTTP exception thrown: Instance 6e8a4e07-0b30-44a3-aa7d-8d4677cc1d5f could not be found. Oct 08 21:03:22.443153 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-be4c0eb3-8510-47df-996d-e77813d6a427 tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Request method failure captured: Oct 08 21:03:22.443153 ncdv-master-1 devstack@n-api.service[140491]: request: GET /compute/v2.1/servers/6e8a4e07-0b30-44a3-aa7d-8d4677cc1d5f HTTP/1.1 Oct 08 21:03:22.443153 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:03:22.443153 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:03:22.443153 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:03:22.443153 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 21:03:22.443153 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:03:22.443153 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:03:22.443153 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:03:22.443153 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:03:22.443153 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeVzlb1PTFaei52BE8GKWBFnI0_XETKP5uW-TZaGh7gVX30ZBejeX4KlIAKF-fhd6-6NlYikBWOUzLsHzNRZSB7MEYTE235cHarosHlbFDvLK0lqxXhu6cY0Tn1nw1LloLFK9qqiGSyvz3PvJoYra-LVluyqxWlKoC6njW6CZIGx3p4 Oct 08 21:03:22.443153 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:03:22.443153 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:03:22.443153 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:03:22.443153 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:03:22.443153 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:03:22.443153 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:03:22.443153 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 0b70cb43c39e4e0ba89680d7b8459c01 Oct 08 21:03:22.443153 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-ServerAddressesTestJSON-153882042 Oct 08 21:03:22.443153 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:03:22.443153 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:03:22.443153 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0b70cb43c39e4e0ba89680d7b8459c01"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0b70cb43c39e4e0ba89680d7b8459c01"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0b70cb43c39e4e0ba89680d7b8459c01"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0b70cb43c39e4e0ba89680d7b8459c01"}]}] Oct 08 21:03:22.443153 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-ServerAddressesTestJSON-153882042 Oct 08 21:03:22.443153 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 0b70cb43c39e4e0ba89680d7b8459c01 Oct 08 21:03:22.443153 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-ServerAddressesTestJSON-153882042 Oct 08 21:03:22.443153 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-ServerAddressesTestJSON-153882042-project Oct 08 21:03:22.443153 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:03:22.443153 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:03:22.443153 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 0f6088285b46499a98162b6237517174 Oct 08 21:03:22.443153 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-ServerAddressesTestJSON-153882042-project Oct 08 21:03:22.443153 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:03:22.443153 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance 6e8a4e07-0b30-44a3-aa7d-8d4677cc1d5f could not be found. Oct 08 21:03:22.443153 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': '6e8a4e07-0b30-44a3-aa7d-8d4677cc1d5f'} Oct 08 21:03:22.443153 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:03:22.443153 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:03:22.443153 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:03:22.443153 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:03:22.443153 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:03:22.443153 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:03:22.443153 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:03:22.443153 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:03:22.443153 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:03:22.443153 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:03:22.443153 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e8a4e07-0b30-44a3-aa7d-8d4677cc1d5f could not be found. Oct 08 21:03:22.443153 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:03:22.443153 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:03:22.443153 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:03:22.443153 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:03:22.443153 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:03:22.443153 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:03:22.443153 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:03:22.443153 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:03:22.443153 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:03:22.443153 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:03:22.443153 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:03:22.443153 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:03:22.443153 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:03:22.443153 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:03:22.443153 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:03:22.443153 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:03:22.443153 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e8a4e07-0b30-44a3-aa7d-8d4677cc1d5f could not be found. Oct 08 21:03:22.443153 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:03:22.443153 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:03:22.443153 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:03:22.447167 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:03:22.447167 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:03:22.447167 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:03:22.447167 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:03:22.447167 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:03:22.447167 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e8a4e07-0b30-44a3-aa7d-8d4677cc1d5f could not be found. Oct 08 21:03:22.447167 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:03:22.447167 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-be4c0eb3-8510-47df-996d-e77813d6a427 tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] Returning 404 to user: Instance 6e8a4e07-0b30-44a3-aa7d-8d4677cc1d5f could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:03:22.447167 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-be4c0eb3-8510-47df-996d-e77813d6a427 tempest-ServerAddressesTestJSON-153882042 tempest-ServerAddressesTestJSON-153882042-project] 10.222.0.26 "GET /compute/v2.1/servers/6e8a4e07-0b30-44a3-aa7d-8d4677cc1d5f" status: 404 len: 111 microversion: 2.1 time: 0.033525 Oct 08 21:03:22.448688 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1363/2783] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:22 2022] GET /compute/v2.1/servers/6e8a4e07-0b30-44a3-aa7d-8d4677cc1d5f => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:03:22.535714 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-cc4d268a-ffcc-4e5d-aae3-4dc3944e7d23 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095debf3968c448fb3c3add0322d8d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc9bed6d76834f6fa66d681ecd9f4e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:22.546775 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-cc4d268a-ffcc-4e5d-aae3-4dc3944e7d23 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] 10.222.0.26 "GET /compute/v2.1/servers/0b52e623-6990-4978-811d-68fc294fe304" status: 200 len: 1511 microversion: 2.1 time: 0.301737 Oct 08 21:03:22.547369 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1421/2784] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:22 2022] GET /compute/v2.1/servers/0b52e623-6990-4978-811d-68fc294fe304 => generated 1511 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:22.569624 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-29dee91c-1175-4505-9d70-c2983bca95e1 tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:22.570732 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-29dee91c-1175-4505-9d70-c2983bca95e1 tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] [instance: 50a243fc-ec9e-4e15-a0c6-240c525af882] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:22.582779 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-29dee91c-1175-4505-9d70-c2983bca95e1 tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:22.586744 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-29dee91c-1175-4505-9d70-c2983bca95e1 tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:22.588908 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-29dee91c-1175-4505-9d70-c2983bca95e1 tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:22.589758 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-29dee91c-1175-4505-9d70-c2983bca95e1 tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:22.590296 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-7e356a13-17ed-46b6-b229-5cf9f73c9730 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:22.591236 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-7e356a13-17ed-46b6-b229-5cf9f73c9730 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] [instance: 814f7da9-1d8d-4695-8cfa-6db50c3e846a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:22.593040 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-29dee91c-1175-4505-9d70-c2983bca95e1 tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:22.593590 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-29dee91c-1175-4505-9d70-c2983bca95e1 tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:22.601271 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7e356a13-17ed-46b6-b229-5cf9f73c9730 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:22.602027 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7e356a13-17ed-46b6-b229-5cf9f73c9730 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:22.605383 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7e356a13-17ed-46b6-b229-5cf9f73c9730 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:22.606622 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7e356a13-17ed-46b6-b229-5cf9f73c9730 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:22.607112 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7e356a13-17ed-46b6-b229-5cf9f73c9730 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:22.607702 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7e356a13-17ed-46b6-b229-5cf9f73c9730 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:22.616017 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-29dee91c-1175-4505-9d70-c2983bca95e1 tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] HTTP exception thrown: Instance 50a243fc-ec9e-4e15-a0c6-240c525af882 could not be found. Oct 08 21:03:22.618024 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-29dee91c-1175-4505-9d70-c2983bca95e1 tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Request method failure captured: Oct 08 21:03:22.618024 ncdv-master-1 devstack@n-api.service[140491]: request: GET /compute/v2.1/servers/50a243fc-ec9e-4e15-a0c6-240c525af882 HTTP/1.1 Oct 08 21:03:22.618024 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:03:22.618024 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:03:22.618024 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:03:22.618024 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 21:03:22.618024 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:03:22.618024 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:03:22.618024 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:03:22.618024 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:03:22.618024 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeVhytWoQnk6GVQNvRMaqutcfZ6oHhkZP17q3DZBE_Z-aIXrWYoWaZvOrCLjXswvQZhsvOMlQ97sPPGJvZ9uuo2pOaZbTZO4doq_hStRmKG5PBA9RC4Ww5qGjeV7Tyd28DZQ4iRmZpW-M76h1C_SCBWQG7sk3OM8xT1LaXoZt-RmIps Oct 08 21:03:22.618024 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:03:22.618024 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:03:22.618024 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:03:22.618024 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:03:22.618024 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:03:22.618024 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:03:22.618024 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 2f51fe43d7c143ebb6d53f5942941c9d Oct 08 21:03:22.618024 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-693193549 Oct 08 21:03:22.618024 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:03:22.618024 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:03:22.618024 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/2f51fe43d7c143ebb6d53f5942941c9d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2f51fe43d7c143ebb6d53f5942941c9d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_2f51fe43d7c143ebb6d53f5942941c9d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2f51fe43d7c143ebb6d53f5942941c9d"}]}] Oct 08 21:03:22.618024 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-693193549 Oct 08 21:03:22.618024 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 2f51fe43d7c143ebb6d53f5942941c9d Oct 08 21:03:22.618024 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-693193549 Oct 08 21:03:22.618024 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project Oct 08 21:03:22.618024 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:03:22.618024 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:03:22.618024 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 95cfeacf062f486c985ca772f2f36faf Oct 08 21:03:22.618024 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project Oct 08 21:03:22.618024 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:03:22.618024 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance 50a243fc-ec9e-4e15-a0c6-240c525af882 could not be found. Oct 08 21:03:22.618024 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': '50a243fc-ec9e-4e15-a0c6-240c525af882'} Oct 08 21:03:22.618024 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:03:22.618024 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:03:22.618024 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:03:22.618024 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:03:22.618024 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:03:22.618024 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:03:22.618024 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:03:22.618024 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:03:22.618024 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:03:22.618024 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:03:22.618024 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50a243fc-ec9e-4e15-a0c6-240c525af882 could not be found. Oct 08 21:03:22.618024 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:03:22.618024 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:03:22.618024 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:03:22.618024 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:03:22.618024 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:03:22.618024 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:03:22.618024 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:03:22.618024 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:03:22.618024 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:03:22.618024 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:03:22.618024 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:03:22.618024 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:03:22.618024 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:03:22.618024 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:03:22.618024 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:03:22.618024 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:03:22.618024 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50a243fc-ec9e-4e15-a0c6-240c525af882 could not be found. Oct 08 21:03:22.618024 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:03:22.621661 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:03:22.621661 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:03:22.621661 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:03:22.621661 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:03:22.621661 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:03:22.621661 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:03:22.621661 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:03:22.621661 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50a243fc-ec9e-4e15-a0c6-240c525af882 could not be found. Oct 08 21:03:22.621661 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:03:22.623554 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-29dee91c-1175-4505-9d70-c2983bca95e1 tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] Returning 404 to user: Instance 50a243fc-ec9e-4e15-a0c6-240c525af882 could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:03:22.624640 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-29dee91c-1175-4505-9d70-c2983bca95e1 tempest-FloatingIPsAssociationNegativeTestJSON-693193549 tempest-FloatingIPsAssociationNegativeTestJSON-693193549-project] 10.222.0.26 "GET /compute/v2.1/servers/50a243fc-ec9e-4e15-a0c6-240c525af882" status: 404 len: 111 microversion: 2.1 time: 0.060328 Oct 08 21:03:22.625902 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1364/2785] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:22 2022] GET /compute/v2.1/servers/50a243fc-ec9e-4e15-a0c6-240c525af882 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:03:22.838332 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-3ded0333-a938-48da-b49b-35cd027fd6c5 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:22.839687 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-3ded0333-a938-48da-b49b-35cd027fd6c5 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: 6ef37448-690b-4fcf-85f8-a2fb71207f38] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:22.846085 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3ded0333-a938-48da-b49b-35cd027fd6c5 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:22.852374 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3ded0333-a938-48da-b49b-35cd027fd6c5 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:22.852374 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3ded0333-a938-48da-b49b-35cd027fd6c5 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:22.854152 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3ded0333-a938-48da-b49b-35cd027fd6c5 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:22.854791 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3ded0333-a938-48da-b49b-35cd027fd6c5 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:22.855630 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3ded0333-a938-48da-b49b-35cd027fd6c5 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:22.886330 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-7e356a13-17ed-46b6-b229-5cf9f73c9730 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095debf3968c448fb3c3add0322d8d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc9bed6d76834f6fa66d681ecd9f4e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:22.897233 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-7e356a13-17ed-46b6-b229-5cf9f73c9730 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] 10.222.0.26 "GET /compute/v2.1/servers/814f7da9-1d8d-4695-8cfa-6db50c3e846a" status: 200 len: 1510 microversion: 2.1 time: 0.318548 Oct 08 21:03:22.897831 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1422/2786] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:22 2022] GET /compute/v2.1/servers/814f7da9-1d8d-4695-8cfa-6db50c3e846a => generated 1510 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:22.920644 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-3817514f-ec61-4554-9dec-f1472e7210ec tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:22.921409 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-3817514f-ec61-4554-9dec-f1472e7210ec tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] [instance: 3d7debe3-3039-401c-891d-4c6e4b96cbb8] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:22.929981 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3817514f-ec61-4554-9dec-f1472e7210ec tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:22.930714 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3817514f-ec61-4554-9dec-f1472e7210ec tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:22.931333 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3817514f-ec61-4554-9dec-f1472e7210ec tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:22.932220 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3817514f-ec61-4554-9dec-f1472e7210ec tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:22.932831 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3817514f-ec61-4554-9dec-f1472e7210ec tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:22.935788 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3817514f-ec61-4554-9dec-f1472e7210ec tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:22.990722 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-3ded0333-a938-48da-b49b-35cd027fd6c5 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:22.999918 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-3ded0333-a938-48da-b49b-35cd027fd6c5 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/6ef37448-690b-4fcf-85f8-a2fb71207f38" status: 200 len: 1265 microversion: 2.1 time: 0.165202 Oct 08 21:03:23.000600 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1365/2787] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:22 2022] GET /compute/v2.1/servers/6ef37448-690b-4fcf-85f8-a2fb71207f38 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:03:23.021825 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-3bd6bf99-48f6-4fa9-8ca3-b2b4428791f0 req-430b9317-4b21-406a-9d75-1fddaeb5aee8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e8a4e07-0b30-44a3-aa7d-8d4677cc1d5f", "name": "network-vif-deleted", "tag": "e696087b-5fe1-4819-992b-75cf2676375b"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:03:23.032209 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-3bd6bf99-48f6-4fa9-8ca3-b2b4428791f0 req-430b9317-4b21-406a-9d75-1fddaeb5aee8 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:23.032833 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-3bd6bf99-48f6-4fa9-8ca3-b2b4428791f0 req-430b9317-4b21-406a-9d75-1fddaeb5aee8 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:23.033425 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-3bd6bf99-48f6-4fa9-8ca3-b2b4428791f0 req-430b9317-4b21-406a-9d75-1fddaeb5aee8 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:23.052112 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-3bd6bf99-48f6-4fa9-8ca3-b2b4428791f0 req-430b9317-4b21-406a-9d75-1fddaeb5aee8 service nova] Creating event network-vif-deleted:e696087b-5fe1-4819-992b-75cf2676375b for instance 6e8a4e07-0b30-44a3-aa7d-8d4677cc1d5f on nch2-master-1 Oct 08 21:03:23.059882 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-3bd6bf99-48f6-4fa9-8ca3-b2b4428791f0 req-430b9317-4b21-406a-9d75-1fddaeb5aee8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040141 Oct 08 21:03:23.060538 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1366/2788] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:03:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:03:23.105125 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-7c96fe89-691e-4584-a75e-0352c0545191 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:23.106414 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-7c96fe89-691e-4584-a75e-0352c0545191 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] [instance: 570d4898-169b-4f6b-aef6-ab79ea0fbefd] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:23.113024 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7c96fe89-691e-4584-a75e-0352c0545191 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:23.113935 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7c96fe89-691e-4584-a75e-0352c0545191 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:23.115299 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7c96fe89-691e-4584-a75e-0352c0545191 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:23.116356 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7c96fe89-691e-4584-a75e-0352c0545191 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:23.123375 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7c96fe89-691e-4584-a75e-0352c0545191 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:23.124276 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7c96fe89-691e-4584-a75e-0352c0545191 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:23.251785 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-3817514f-ec61-4554-9dec-f1472e7210ec tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095debf3968c448fb3c3add0322d8d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc9bed6d76834f6fa66d681ecd9f4e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:23.255802 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:03:23.261717 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-3817514f-ec61-4554-9dec-f1472e7210ec tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] 10.222.0.26 "GET /compute/v2.1/servers/3d7debe3-3039-401c-891d-4c6e4b96cbb8" status: 200 len: 1512 microversion: 2.1 time: 0.345240 Oct 08 21:03:23.288100 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1423/2789] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:22 2022] GET /compute/v2.1/servers/3d7debe3-3039-401c-891d-4c6e4b96cbb8 => generated 1512 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:23.297226 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-414a11eb-a750-450d-ae60-0f6ced083357 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:23.305454 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-414a11eb-a750-450d-ae60-0f6ced083357 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '095debf3968c448fb3c3add0322d8d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc9bed6d76834f6fa66d681ecd9f4e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:23.306638 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-414a11eb-a750-450d-ae60-0f6ced083357 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': 'bc9bed6d76834f6fa66d681ecd9f4e90'} {{(pid=140492) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 08 21:03:23.321341 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-414a11eb-a750-450d-ae60-0f6ced083357 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:23.322278 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-414a11eb-a750-450d-ae60-0f6ced083357 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:23.322982 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-414a11eb-a750-450d-ae60-0f6ced083357 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:23.325243 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-414a11eb-a750-450d-ae60-0f6ced083357 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:23.325927 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-414a11eb-a750-450d-ae60-0f6ced083357 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:23.326533 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-414a11eb-a750-450d-ae60-0f6ced083357 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:23.452354 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.multi_cell_list [None req-414a11eb-a750-450d-ae60-0f6ced083357 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=140492) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 08 21:03:23.537012 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-414a11eb-a750-450d-ae60-0f6ced083357 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095debf3968c448fb3c3add0322d8d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc9bed6d76834f6fa66d681ecd9f4e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:23.555325 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-414a11eb-a750-450d-ae60-0f6ced083357 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:23.556047 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-414a11eb-a750-450d-ae60-0f6ced083357 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:23.556874 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-414a11eb-a750-450d-ae60-0f6ced083357 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:23.748905 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-7c96fe89-691e-4584-a75e-0352c0545191 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2e13f1952a4e5bb23d57dd7fa31875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b2a56286924e2d953bebe717ce591b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:23.761722 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-7c96fe89-691e-4584-a75e-0352c0545191 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] 10.222.0.26 "GET /compute/v2.1/servers/570d4898-169b-4f6b-aef6-ab79ea0fbefd" status: 200 len: 1506 microversion: 2.1 time: 0.661222 Oct 08 21:03:23.762577 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1367/2790] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:23 2022] GET /compute/v2.1/servers/570d4898-169b-4f6b-aef6-ab79ea0fbefd => generated 1506 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:24.025168 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-a40f5afd-ea8d-4114-b7c7-be2f10452c25 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:24.025791 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-a40f5afd-ea8d-4114-b7c7-be2f10452c25 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: 6ef37448-690b-4fcf-85f8-a2fb71207f38] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:24.032255 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a40f5afd-ea8d-4114-b7c7-be2f10452c25 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:24.033121 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a40f5afd-ea8d-4114-b7c7-be2f10452c25 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:24.033839 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a40f5afd-ea8d-4114-b7c7-be2f10452c25 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:24.034769 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a40f5afd-ea8d-4114-b7c7-be2f10452c25 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:24.035467 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a40f5afd-ea8d-4114-b7c7-be2f10452c25 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:24.035934 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a40f5afd-ea8d-4114-b7c7-be2f10452c25 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:24.052726 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:03:24.138805 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-a40f5afd-ea8d-4114-b7c7-be2f10452c25 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:24.155250 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-a40f5afd-ea8d-4114-b7c7-be2f10452c25 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/6ef37448-690b-4fcf-85f8-a2fb71207f38" status: 200 len: 1271 microversion: 2.1 time: 0.135133 Oct 08 21:03:24.156567 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1368/2791] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:24 2022] GET /compute/v2.1/servers/6ef37448-690b-4fcf-85f8-a2fb71207f38 => generated 1271 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:24.261637 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-414a11eb-a750-450d-ae60-0f6ced083357 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] 10.222.0.26 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1514 microversion: 2.1 time: 0.969579 Oct 08 21:03:24.263697 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1424/2792] 10.222.0.26 () {58 vars in 1167 bytes} [Sat Oct 8 21:03:23 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1514 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:03:24.289552 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-e1badce2-9405-4af9-8484-df1efcba8954 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:24.295537 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-e1badce2-9405-4af9-8484-df1efcba8954 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '095debf3968c448fb3c3add0322d8d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc9bed6d76834f6fa66d681ecd9f4e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:24.296429 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-e1badce2-9405-4af9-8484-df1efcba8954 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-637299003', 'deleted': False, 'project_id': 'bc9bed6d76834f6fa66d681ecd9f4e90'} {{(pid=140491) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 08 21:03:24.302248 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e1badce2-9405-4af9-8484-df1efcba8954 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:24.302998 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e1badce2-9405-4af9-8484-df1efcba8954 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:24.303657 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e1badce2-9405-4af9-8484-df1efcba8954 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:24.304588 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e1badce2-9405-4af9-8484-df1efcba8954 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:24.305273 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e1badce2-9405-4af9-8484-df1efcba8954 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:24.305912 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e1badce2-9405-4af9-8484-df1efcba8954 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:24.404086 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.multi_cell_list [None req-e1badce2-9405-4af9-8484-df1efcba8954 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=140491) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 08 21:03:24.500373 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-e1badce2-9405-4af9-8484-df1efcba8954 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095debf3968c448fb3c3add0322d8d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc9bed6d76834f6fa66d681ecd9f4e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:24.513000 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e1badce2-9405-4af9-8484-df1efcba8954 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:24.514287 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e1badce2-9405-4af9-8484-df1efcba8954 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:24.514951 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e1badce2-9405-4af9-8484-df1efcba8954 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:24.793831 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-fe8eac34-7a14-41b6-b160-d02a484e0371 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:24.794729 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-fe8eac34-7a14-41b6-b160-d02a484e0371 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] [instance: 570d4898-169b-4f6b-aef6-ab79ea0fbefd] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:24.806348 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fe8eac34-7a14-41b6-b160-d02a484e0371 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:24.807223 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fe8eac34-7a14-41b6-b160-d02a484e0371 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:24.808176 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fe8eac34-7a14-41b6-b160-d02a484e0371 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:24.809744 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fe8eac34-7a14-41b6-b160-d02a484e0371 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:24.810664 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fe8eac34-7a14-41b6-b160-d02a484e0371 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:24.811390 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fe8eac34-7a14-41b6-b160-d02a484e0371 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:24.869945 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-e1badce2-9405-4af9-8484-df1efcba8954 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] 10.222.0.26 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-637299003" status: 200 len: 1513 microversion: 2.1 time: 0.584931 Oct 08 21:03:24.870658 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1369/2793] 10.222.0.26 () {58 vars in 1261 bytes} [Sat Oct 8 21:03:24 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-637299003 => generated 1513 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:24.898608 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-1f3dba4f-04fa-46e3-a77b-3524b7c910b8 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:24.904495 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-1f3dba4f-04fa-46e3-a77b-3524b7c910b8 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '095debf3968c448fb3c3add0322d8d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc9bed6d76834f6fa66d681ecd9f4e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:24.905428 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-1f3dba4f-04fa-46e3-a77b-3524b7c910b8 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': 'bc9bed6d76834f6fa66d681ecd9f4e90'} {{(pid=140491) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 08 21:03:24.915022 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1f3dba4f-04fa-46e3-a77b-3524b7c910b8 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:24.915521 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1f3dba4f-04fa-46e3-a77b-3524b7c910b8 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:24.916008 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1f3dba4f-04fa-46e3-a77b-3524b7c910b8 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:24.916990 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1f3dba4f-04fa-46e3-a77b-3524b7c910b8 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:24.917642 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1f3dba4f-04fa-46e3-a77b-3524b7c910b8 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:24.918084 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1f3dba4f-04fa-46e3-a77b-3524b7c910b8 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:25.018174 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.multi_cell_list [None req-1f3dba4f-04fa-46e3-a77b-3524b7c910b8 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=140491) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 08 21:03:25.099160 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-1f3dba4f-04fa-46e3-a77b-3524b7c910b8 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095debf3968c448fb3c3add0322d8d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc9bed6d76834f6fa66d681ecd9f4e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:25.107657 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1f3dba4f-04fa-46e3-a77b-3524b7c910b8 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:25.108307 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1f3dba4f-04fa-46e3-a77b-3524b7c910b8 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:25.108803 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1f3dba4f-04fa-46e3-a77b-3524b7c910b8 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:25.251058 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-fe8eac34-7a14-41b6-b160-d02a484e0371 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2e13f1952a4e5bb23d57dd7fa31875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b2a56286924e2d953bebe717ce591b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:25.262255 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-fe8eac34-7a14-41b6-b160-d02a484e0371 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] 10.222.0.26 "GET /compute/v2.1/servers/570d4898-169b-4f6b-aef6-ab79ea0fbefd" status: 200 len: 1506 microversion: 2.1 time: 0.476408 Oct 08 21:03:25.263035 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1425/2794] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:24 2022] GET /compute/v2.1/servers/570d4898-169b-4f6b-aef6-ab79ea0fbefd => generated 1506 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:25.278326 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-11fe6fef-70c8-494d-a314-26f70bef7c49 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:25.279460 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-11fe6fef-70c8-494d-a314-26f70bef7c49 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: 6ef37448-690b-4fcf-85f8-a2fb71207f38] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:25.287762 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-11fe6fef-70c8-494d-a314-26f70bef7c49 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:25.288636 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-11fe6fef-70c8-494d-a314-26f70bef7c49 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:25.289356 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-11fe6fef-70c8-494d-a314-26f70bef7c49 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:25.290427 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-11fe6fef-70c8-494d-a314-26f70bef7c49 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:25.291122 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-11fe6fef-70c8-494d-a314-26f70bef7c49 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:25.291783 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-11fe6fef-70c8-494d-a314-26f70bef7c49 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:25.403916 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-1f3dba4f-04fa-46e3-a77b-3524b7c910b8 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] 10.222.0.26 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4516 microversion: 2.1 time: 0.510583 Oct 08 21:03:25.404716 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1370/2795] 10.222.0.26 () {58 vars in 1173 bytes} [Sat Oct 8 21:03:24 2022] GET /compute/v2.1/servers/detail?status=active => generated 4516 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:03:25.434957 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-b4a7dbfc-1267-4f6d-8e50-0ac4013fd284 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:25.440082 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-b4a7dbfc-1267-4f6d-8e50-0ac4013fd284 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '095debf3968c448fb3c3add0322d8d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc9bed6d76834f6fa66d681ecd9f4e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:25.450842 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.compute.servers [None req-b4a7dbfc-1267-4f6d-8e50-0ac4013fd284 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Removing options 'limit' from query {{(pid=140491) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 08 21:03:25.452502 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-b4a7dbfc-1267-4f6d-8e50-0ac4013fd284 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Searching by: {'deleted': False, 'project_id': 'bc9bed6d76834f6fa66d681ecd9f4e90'} {{(pid=140491) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 08 21:03:25.479091 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b4a7dbfc-1267-4f6d-8e50-0ac4013fd284 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:25.479091 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b4a7dbfc-1267-4f6d-8e50-0ac4013fd284 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:25.479091 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b4a7dbfc-1267-4f6d-8e50-0ac4013fd284 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:25.479091 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b4a7dbfc-1267-4f6d-8e50-0ac4013fd284 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:25.479666 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b4a7dbfc-1267-4f6d-8e50-0ac4013fd284 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:25.480373 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b4a7dbfc-1267-4f6d-8e50-0ac4013fd284 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:25.550910 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-b4a7dbfc-1267-4f6d-8e50-0ac4013fd284 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095debf3968c448fb3c3add0322d8d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc9bed6d76834f6fa66d681ecd9f4e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:25.565287 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b4a7dbfc-1267-4f6d-8e50-0ac4013fd284 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:25.565798 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b4a7dbfc-1267-4f6d-8e50-0ac4013fd284 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:25.566249 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b4a7dbfc-1267-4f6d-8e50-0ac4013fd284 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:25.777594 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-b4a7dbfc-1267-4f6d-8e50-0ac4013fd284 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] 10.222.0.26 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1660 microversion: 2.1 time: 0.346694 Oct 08 21:03:25.779243 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1371/2796] 10.222.0.26 () {58 vars in 1161 bytes} [Sat Oct 8 21:03:25 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1660 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:25.811377 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-ed146ffe-dee6-409f-925a-f021c66af487 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:25.818964 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-ed146ffe-dee6-409f-925a-f021c66af487 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '095debf3968c448fb3c3add0322d8d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc9bed6d76834f6fa66d681ecd9f4e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:25.820006 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-ed146ffe-dee6-409f-925a-f021c66af487 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': 'bc9bed6d76834f6fa66d681ecd9f4e90'} {{(pid=140491) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 08 21:03:25.828382 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ed146ffe-dee6-409f-925a-f021c66af487 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:25.829088 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ed146ffe-dee6-409f-925a-f021c66af487 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:25.829711 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ed146ffe-dee6-409f-925a-f021c66af487 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:25.830792 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ed146ffe-dee6-409f-925a-f021c66af487 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:25.831451 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ed146ffe-dee6-409f-925a-f021c66af487 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:25.832058 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ed146ffe-dee6-409f-925a-f021c66af487 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:25.850925 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-11fe6fef-70c8-494d-a314-26f70bef7c49 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:25.863682 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-11fe6fef-70c8-494d-a314-26f70bef7c49 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/6ef37448-690b-4fcf-85f8-a2fb71207f38" status: 200 len: 1313 microversion: 2.1 time: 0.599394 Oct 08 21:03:25.866602 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1426/2797] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:25 2022] GET /compute/v2.1/servers/6ef37448-690b-4fcf-85f8-a2fb71207f38 => generated 1313 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:26.209536 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.multi_cell_list [None req-ed146ffe-dee6-409f-925a-f021c66af487 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=140491) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 08 21:03:26.286366 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-58b2835a-9da3-4f0d-bfbe-f0d76e1d8c1e tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:26.286980 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-ed146ffe-dee6-409f-925a-f021c66af487 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] 10.222.0.26 "GET /compute/v2.1/servers?status=active" status: 200 len: 1011 microversion: 2.1 time: 0.481249 Oct 08 21:03:26.287128 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-58b2835a-9da3-4f0d-bfbe-f0d76e1d8c1e tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] [instance: 570d4898-169b-4f6b-aef6-ab79ea0fbefd] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:26.287877 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1372/2798] 10.222.0.26 () {58 vars in 1152 bytes} [Sat Oct 8 21:03:25 2022] GET /compute/v2.1/servers?status=active => generated 1011 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:03:26.300823 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-1e6f7543-c4d5-4fae-8f41-c493345dfa05 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:26.303694 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-58b2835a-9da3-4f0d-bfbe-f0d76e1d8c1e tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:26.304440 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-58b2835a-9da3-4f0d-bfbe-f0d76e1d8c1e tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:26.305073 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-58b2835a-9da3-4f0d-bfbe-f0d76e1d8c1e tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:26.305981 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-58b2835a-9da3-4f0d-bfbe-f0d76e1d8c1e tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:26.307323 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-58b2835a-9da3-4f0d-bfbe-f0d76e1d8c1e tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:26.307464 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-1e6f7543-c4d5-4fae-8f41-c493345dfa05 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '095debf3968c448fb3c3add0322d8d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc9bed6d76834f6fa66d681ecd9f4e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:26.307854 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.compute.servers [None req-1e6f7543-c4d5-4fae-8f41-c493345dfa05 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Removing options 'limit' from query {{(pid=140491) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 08 21:03:26.308255 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-58b2835a-9da3-4f0d-bfbe-f0d76e1d8c1e tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:26.308687 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-1e6f7543-c4d5-4fae-8f41-c493345dfa05 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Searching by: {'deleted': False, 'project_id': 'bc9bed6d76834f6fa66d681ecd9f4e90'} {{(pid=140491) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 08 21:03:26.331943 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1e6f7543-c4d5-4fae-8f41-c493345dfa05 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:26.332214 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1e6f7543-c4d5-4fae-8f41-c493345dfa05 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:26.332655 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1e6f7543-c4d5-4fae-8f41-c493345dfa05 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:26.333542 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1e6f7543-c4d5-4fae-8f41-c493345dfa05 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:26.334007 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1e6f7543-c4d5-4fae-8f41-c493345dfa05 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:26.334437 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1e6f7543-c4d5-4fae-8f41-c493345dfa05 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:26.380992 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.multi_cell_list [None req-1e6f7543-c4d5-4fae-8f41-c493345dfa05 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=140491) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 08 21:03:26.433172 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-1e6f7543-c4d5-4fae-8f41-c493345dfa05 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] 10.222.0.26 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1011 microversion: 2.1 time: 0.136051 Oct 08 21:03:26.443155 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1373/2799] 10.222.0.26 () {58 vars in 1150 bytes} [Sat Oct 8 21:03:26 2022] GET /compute/v2.1/servers?limit=100000 => generated 1011 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:26.449785 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-0c1871f6-6636-464f-8bf8-fdbc5e0ee30a tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:26.456608 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-0c1871f6-6636-464f-8bf8-fdbc5e0ee30a tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '095debf3968c448fb3c3add0322d8d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc9bed6d76834f6fa66d681ecd9f4e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:26.458492 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-0c1871f6-6636-464f-8bf8-fdbc5e0ee30a tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Searching by: {'deleted': False, 'project_id': 'bc9bed6d76834f6fa66d681ecd9f4e90'} {{(pid=140491) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 08 21:03:26.466187 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0c1871f6-6636-464f-8bf8-fdbc5e0ee30a tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:26.466906 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0c1871f6-6636-464f-8bf8-fdbc5e0ee30a tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:26.467508 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0c1871f6-6636-464f-8bf8-fdbc5e0ee30a tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:26.468400 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0c1871f6-6636-464f-8bf8-fdbc5e0ee30a tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:26.470193 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0c1871f6-6636-464f-8bf8-fdbc5e0ee30a tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:26.470819 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0c1871f6-6636-464f-8bf8-fdbc5e0ee30a tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:26.531362 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.multi_cell_list [None req-0c1871f6-6636-464f-8bf8-fdbc5e0ee30a tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=140491) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 08 21:03:26.571149 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-0c1871f6-6636-464f-8bf8-fdbc5e0ee30a tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] 10.222.0.26 "GET /compute/v2.1/servers" status: 200 len: 1011 microversion: 2.1 time: 0.126518 Oct 08 21:03:26.584461 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1374/2800] 10.222.0.26 () {58 vars in 1125 bytes} [Sat Oct 8 21:03:26 2022] GET /compute/v2.1/servers => generated 1011 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:26.589853 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-cf7bfd48-aca9-4641-a310-992b58c3d124 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:26.596466 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-cf7bfd48-aca9-4641-a310-992b58c3d124 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '095debf3968c448fb3c3add0322d8d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc9bed6d76834f6fa66d681ecd9f4e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:26.597455 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-cf7bfd48-aca9-4641-a310-992b58c3d124 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': 'bc9bed6d76834f6fa66d681ecd9f4e90'} {{(pid=140491) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 08 21:03:26.611226 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cf7bfd48-aca9-4641-a310-992b58c3d124 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:26.612975 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cf7bfd48-aca9-4641-a310-992b58c3d124 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:26.615054 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cf7bfd48-aca9-4641-a310-992b58c3d124 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:26.616664 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cf7bfd48-aca9-4641-a310-992b58c3d124 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:26.617463 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cf7bfd48-aca9-4641-a310-992b58c3d124 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:26.618056 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cf7bfd48-aca9-4641-a310-992b58c3d124 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:26.765003 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.multi_cell_list [None req-cf7bfd48-aca9-4641-a310-992b58c3d124 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=140491) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 08 21:03:26.835735 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-cf7bfd48-aca9-4641-a310-992b58c3d124 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] 10.222.0.26 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 346 microversion: 2.1 time: 0.249609 Oct 08 21:03:26.846775 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1375/2801] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Oct 8 21:03:26 2022] GET /compute/v2.1/servers?flavor=451 => generated 346 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:03:26.854979 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-e9983ebb-3ce4-4695-abd8-8c45a8699c09 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:26.860505 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-e9983ebb-3ce4-4695-abd8-8c45a8699c09 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '095debf3968c448fb3c3add0322d8d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc9bed6d76834f6fa66d681ecd9f4e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:26.860848 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.compute.servers [None req-e9983ebb-3ce4-4695-abd8-8c45a8699c09 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Removing options 'limit' from query {{(pid=140491) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 08 21:03:26.861646 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-e9983ebb-3ce4-4695-abd8-8c45a8699c09 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Searching by: {'deleted': False, 'project_id': 'bc9bed6d76834f6fa66d681ecd9f4e90'} {{(pid=140491) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 08 21:03:26.867188 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e9983ebb-3ce4-4695-abd8-8c45a8699c09 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:26.867814 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e9983ebb-3ce4-4695-abd8-8c45a8699c09 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:26.868486 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e9983ebb-3ce4-4695-abd8-8c45a8699c09 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:26.869329 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e9983ebb-3ce4-4695-abd8-8c45a8699c09 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:26.869851 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e9983ebb-3ce4-4695-abd8-8c45a8699c09 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:26.870627 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e9983ebb-3ce4-4695-abd8-8c45a8699c09 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:26.905118 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-e9983ebb-3ce4-4695-abd8-8c45a8699c09 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] 10.222.0.26 "GET /compute/v2.1/servers?limit=1" status: 200 len: 485 microversion: 2.1 time: 0.054592 Oct 08 21:03:26.913826 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1376/2802] 10.222.0.26 () {58 vars in 1140 bytes} [Sat Oct 8 21:03:26 2022] GET /compute/v2.1/servers?limit=1 => generated 485 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 08 21:03:26.913826 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-bb7001bf-e532-4efd-b661-4804b54698e2 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:26.913826 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-bb7001bf-e532-4efd-b661-4804b54698e2 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: 6ef37448-690b-4fcf-85f8-a2fb71207f38] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:26.919915 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bb7001bf-e532-4efd-b661-4804b54698e2 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:26.920446 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bb7001bf-e532-4efd-b661-4804b54698e2 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:26.921025 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bb7001bf-e532-4efd-b661-4804b54698e2 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:26.921787 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bb7001bf-e532-4efd-b661-4804b54698e2 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:26.922281 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bb7001bf-e532-4efd-b661-4804b54698e2 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:26.922704 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bb7001bf-e532-4efd-b661-4804b54698e2 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:27.090802 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-58b2835a-9da3-4f0d-bfbe-f0d76e1d8c1e tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2e13f1952a4e5bb23d57dd7fa31875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b2a56286924e2d953bebe717ce591b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:27.116185 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-58b2835a-9da3-4f0d-bfbe-f0d76e1d8c1e tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] 10.222.0.26 "GET /compute/v2.1/servers/570d4898-169b-4f6b-aef6-ab79ea0fbefd" status: 200 len: 1506 microversion: 2.1 time: 0.834883 Oct 08 21:03:27.123054 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1427/2803] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:26 2022] GET /compute/v2.1/servers/570d4898-169b-4f6b-aef6-ab79ea0fbefd => generated 1506 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:03:27.138517 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-5d762a44-28a6-4a6c-b895-2ac4cbf26970 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:27.147184 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-5d762a44-28a6-4a6c-b895-2ac4cbf26970 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '095debf3968c448fb3c3add0322d8d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc9bed6d76834f6fa66d681ecd9f4e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:27.148418 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-5d762a44-28a6-4a6c-b895-2ac4cbf26970 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-637299003', 'deleted': False, 'project_id': 'bc9bed6d76834f6fa66d681ecd9f4e90'} {{(pid=140492) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 08 21:03:27.154153 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5d762a44-28a6-4a6c-b895-2ac4cbf26970 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:27.154865 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5d762a44-28a6-4a6c-b895-2ac4cbf26970 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:27.155468 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5d762a44-28a6-4a6c-b895-2ac4cbf26970 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:27.156810 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5d762a44-28a6-4a6c-b895-2ac4cbf26970 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:27.157861 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5d762a44-28a6-4a6c-b895-2ac4cbf26970 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:27.158488 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5d762a44-28a6-4a6c-b895-2ac4cbf26970 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:27.162409 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-bb7001bf-e532-4efd-b661-4804b54698e2 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:27.176376 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-bb7001bf-e532-4efd-b661-4804b54698e2 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/6ef37448-690b-4fcf-85f8-a2fb71207f38" status: 200 len: 1313 microversion: 2.1 time: 0.268797 Oct 08 21:03:27.177160 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1377/2804] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:26 2022] GET /compute/v2.1/servers/6ef37448-690b-4fcf-85f8-a2fb71207f38 => generated 1313 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:27.273378 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.multi_cell_list [None req-5d762a44-28a6-4a6c-b895-2ac4cbf26970 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=140492) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 08 21:03:27.360223 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-5d762a44-28a6-4a6c-b895-2ac4cbf26970 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] 10.222.0.26 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-637299003" status: 200 len: 345 microversion: 2.1 time: 0.233989 Oct 08 21:03:27.362044 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1428/2805] 10.222.0.26 () {58 vars in 1240 bytes} [Sat Oct 8 21:03:27 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-637299003 => generated 345 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:03:27.376223 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-dfc1600f-fdc8-44f1-bb2a-5d3b0a66d9a1 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:03:27.385986 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dfc1600f-fdc8-44f1-bb2a-5d3b0a66d9a1 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:27.386500 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dfc1600f-fdc8-44f1-bb2a-5d3b0a66d9a1 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:27.386955 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dfc1600f-fdc8-44f1-bb2a-5d3b0a66d9a1 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:27.470443 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-dfc1600f-fdc8-44f1-bb2a-5d3b0a66d9a1 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] [instance: 814f7da9-1d8d-4695-8cfa-6db50c3e846a] Going to try to stop instance {{(pid=140491) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 08 21:03:27.566136 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-dfc1600f-fdc8-44f1-bb2a-5d3b0a66d9a1 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] 10.222.0.26 "POST /compute/v2.1/servers/814f7da9-1d8d-4695-8cfa-6db50c3e846a/action" status: 202 len: 0 microversion: 2.1 time: 0.194563 Oct 08 21:03:27.581817 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1378/2806] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:03:27 2022] POST /compute/v2.1/servers/814f7da9-1d8d-4695-8cfa-6db50c3e846a/action => generated 0 bytes in 211 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 21:03:27.592062 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-0d66d78f-7c69-43da-9e2c-bd006c20077d tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:27.592755 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-0d66d78f-7c69-43da-9e2c-bd006c20077d tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] [instance: 814f7da9-1d8d-4695-8cfa-6db50c3e846a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:27.602464 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0d66d78f-7c69-43da-9e2c-bd006c20077d tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:27.607226 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0d66d78f-7c69-43da-9e2c-bd006c20077d tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:27.607739 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0d66d78f-7c69-43da-9e2c-bd006c20077d tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:27.608506 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0d66d78f-7c69-43da-9e2c-bd006c20077d tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:27.608988 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0d66d78f-7c69-43da-9e2c-bd006c20077d tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:27.616135 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0d66d78f-7c69-43da-9e2c-bd006c20077d tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:27.859104 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-0d66d78f-7c69-43da-9e2c-bd006c20077d tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095debf3968c448fb3c3add0322d8d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc9bed6d76834f6fa66d681ecd9f4e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:27.872921 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-0d66d78f-7c69-43da-9e2c-bd006c20077d tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] 10.222.0.26 "GET /compute/v2.1/servers/814f7da9-1d8d-4695-8cfa-6db50c3e846a" status: 200 len: 1520 microversion: 2.1 time: 0.286384 Oct 08 21:03:27.875673 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1429/2807] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:27 2022] GET /compute/v2.1/servers/814f7da9-1d8d-4695-8cfa-6db50c3e846a => generated 1520 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:27.964887 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-d5ca9ea0-e8b2-4706-a7ca-d852be538e50 req-c1bbca3c-c1c3-4447-83bd-b9338d0b2cb1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ef37448-690b-4fcf-85f8-a2fb71207f38", "tag": "066ce620-e2c6-4bca-97c2-d42e20280dcc"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:03:27.987156 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-d5ca9ea0-e8b2-4706-a7ca-d852be538e50 req-c1bbca3c-c1c3-4447-83bd-b9338d0b2cb1 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:27.993852 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-d5ca9ea0-e8b2-4706-a7ca-d852be538e50 req-c1bbca3c-c1c3-4447-83bd-b9338d0b2cb1 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:27.995035 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-d5ca9ea0-e8b2-4706-a7ca-d852be538e50 req-c1bbca3c-c1c3-4447-83bd-b9338d0b2cb1 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:28.009806 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-d5ca9ea0-e8b2-4706-a7ca-d852be538e50 req-c1bbca3c-c1c3-4447-83bd-b9338d0b2cb1 service nova] Creating event network-changed:066ce620-e2c6-4bca-97c2-d42e20280dcc for instance 6ef37448-690b-4fcf-85f8-a2fb71207f38 on nch2-master-1 Oct 08 21:03:28.019631 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-d5ca9ea0-e8b2-4706-a7ca-d852be538e50 req-c1bbca3c-c1c3-4447-83bd-b9338d0b2cb1 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059023 Oct 08 21:03:28.021509 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1379/2808] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:03:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:03:28.153251 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-49b712cb-7c85-4ddc-add2-659631dad398 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:28.153251 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-49b712cb-7c85-4ddc-add2-659631dad398 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] [instance: 570d4898-169b-4f6b-aef6-ab79ea0fbefd] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:28.162968 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-49b712cb-7c85-4ddc-add2-659631dad398 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:28.167691 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-49b712cb-7c85-4ddc-add2-659631dad398 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:28.167691 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-49b712cb-7c85-4ddc-add2-659631dad398 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:28.168440 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-49b712cb-7c85-4ddc-add2-659631dad398 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:28.169371 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-49b712cb-7c85-4ddc-add2-659631dad398 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:28.169900 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-49b712cb-7c85-4ddc-add2-659631dad398 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:28.211113 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-7f394340-2f90-475f-b63f-4a9e2cdd51aa tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:28.212019 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-7f394340-2f90-475f-b63f-4a9e2cdd51aa tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: 6ef37448-690b-4fcf-85f8-a2fb71207f38] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:28.231730 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7f394340-2f90-475f-b63f-4a9e2cdd51aa tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:28.232557 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7f394340-2f90-475f-b63f-4a9e2cdd51aa tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:28.233215 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7f394340-2f90-475f-b63f-4a9e2cdd51aa tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:28.235778 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7f394340-2f90-475f-b63f-4a9e2cdd51aa tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:28.241129 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7f394340-2f90-475f-b63f-4a9e2cdd51aa tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:28.241729 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7f394340-2f90-475f-b63f-4a9e2cdd51aa tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:28.432282 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-49b712cb-7c85-4ddc-add2-659631dad398 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2e13f1952a4e5bb23d57dd7fa31875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b2a56286924e2d953bebe717ce591b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:28.443748 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-49b712cb-7c85-4ddc-add2-659631dad398 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] 10.222.0.26 "GET /compute/v2.1/servers/570d4898-169b-4f6b-aef6-ab79ea0fbefd" status: 200 len: 1506 microversion: 2.1 time: 0.296767 Oct 08 21:03:28.444823 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1430/2809] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:28 2022] GET /compute/v2.1/servers/570d4898-169b-4f6b-aef6-ab79ea0fbefd => generated 1506 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:28.904841 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-cd2005b9-3015-4103-972a-b67cc1be71ce tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:28.947824 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-cd2005b9-3015-4103-972a-b67cc1be71ce tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] [instance: 814f7da9-1d8d-4695-8cfa-6db50c3e846a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:28.981774 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cd2005b9-3015-4103-972a-b67cc1be71ce tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:28.985930 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cd2005b9-3015-4103-972a-b67cc1be71ce tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:28.988069 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cd2005b9-3015-4103-972a-b67cc1be71ce tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:28.988212 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-7f394340-2f90-475f-b63f-4a9e2cdd51aa tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:28.990281 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cd2005b9-3015-4103-972a-b67cc1be71ce tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:28.993267 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cd2005b9-3015-4103-972a-b67cc1be71ce tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:28.993941 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cd2005b9-3015-4103-972a-b67cc1be71ce tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:29.003560 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-7f394340-2f90-475f-b63f-4a9e2cdd51aa tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/6ef37448-690b-4fcf-85f8-a2fb71207f38" status: 200 len: 1313 microversion: 2.1 time: 0.799463 Oct 08 21:03:29.009751 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1380/2810] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:28 2022] GET /compute/v2.1/servers/6ef37448-690b-4fcf-85f8-a2fb71207f38 => generated 1313 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:03:29.363394 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-cd2005b9-3015-4103-972a-b67cc1be71ce tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095debf3968c448fb3c3add0322d8d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc9bed6d76834f6fa66d681ecd9f4e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:29.379025 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-cd2005b9-3015-4103-972a-b67cc1be71ce tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] 10.222.0.26 "GET /compute/v2.1/servers/814f7da9-1d8d-4695-8cfa-6db50c3e846a" status: 200 len: 1520 microversion: 2.1 time: 0.478400 Oct 08 21:03:29.379025 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1431/2811] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:28 2022] GET /compute/v2.1/servers/814f7da9-1d8d-4695-8cfa-6db50c3e846a => generated 1520 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:29.469592 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-2528bdbc-64d2-407e-bd8f-85dadf0f01f6 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:29.470990 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-2528bdbc-64d2-407e-bd8f-85dadf0f01f6 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] [instance: 570d4898-169b-4f6b-aef6-ab79ea0fbefd] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:29.479534 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2528bdbc-64d2-407e-bd8f-85dadf0f01f6 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:29.480369 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2528bdbc-64d2-407e-bd8f-85dadf0f01f6 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:29.481097 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2528bdbc-64d2-407e-bd8f-85dadf0f01f6 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:29.482373 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2528bdbc-64d2-407e-bd8f-85dadf0f01f6 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:29.487295 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2528bdbc-64d2-407e-bd8f-85dadf0f01f6 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:29.488132 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2528bdbc-64d2-407e-bd8f-85dadf0f01f6 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:29.755137 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-2528bdbc-64d2-407e-bd8f-85dadf0f01f6 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2e13f1952a4e5bb23d57dd7fa31875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b2a56286924e2d953bebe717ce591b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:29.764056 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-2528bdbc-64d2-407e-bd8f-85dadf0f01f6 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] 10.222.0.26 "GET /compute/v2.1/servers/570d4898-169b-4f6b-aef6-ab79ea0fbefd" status: 200 len: 1506 microversion: 2.1 time: 0.299103 Oct 08 21:03:29.764890 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1381/2812] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:29 2022] GET /compute/v2.1/servers/570d4898-169b-4f6b-aef6-ab79ea0fbefd => generated 1506 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:03:30.031850 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-741fef2b-50db-4125-a8dd-0c68fbc975bf tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:30.033600 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-741fef2b-50db-4125-a8dd-0c68fbc975bf tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: 6ef37448-690b-4fcf-85f8-a2fb71207f38] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:30.051780 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-741fef2b-50db-4125-a8dd-0c68fbc975bf tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:30.052294 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-741fef2b-50db-4125-a8dd-0c68fbc975bf tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:30.052744 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-741fef2b-50db-4125-a8dd-0c68fbc975bf tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:30.053506 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-741fef2b-50db-4125-a8dd-0c68fbc975bf tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:30.053979 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-741fef2b-50db-4125-a8dd-0c68fbc975bf tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:30.054421 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-741fef2b-50db-4125-a8dd-0c68fbc975bf tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:30.085121 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-b217ecc7-6792-4572-8064-a7a2a6ddcd57 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1356008993", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "networks": [{"uuid": "ff25fefa-ae40-4555-863b-bad0f7f1694c"}, {"uuid": "e92f36f9-0c1d-45b2-a603-c6179182149d"}]}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:03:30.251039 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.network.neutron [None req-b217ecc7-6792-4572-8064-a7a2a6ddcd57 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] validate_networks() for [('ff25fefa-ae40-4555-863b-bad0f7f1694c', None, None, None, None, None), ('e92f36f9-0c1d-45b2-a603-c6179182149d', None, None, None, None, None)] {{(pid=140491) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 21:03:30.609058 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-741fef2b-50db-4125-a8dd-0c68fbc975bf tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:30.632881 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-741fef2b-50db-4125-a8dd-0c68fbc975bf tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/6ef37448-690b-4fcf-85f8-a2fb71207f38" status: 200 len: 1313 microversion: 2.1 time: 0.603191 Oct 08 21:03:30.637564 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1432/2813] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:30 2022] GET /compute/v2.1/servers/6ef37448-690b-4fcf-85f8-a2fb71207f38 => generated 1313 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:30.646783 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-68277264-58bb-4932-92fc-e69dbc04241b tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:30.648923 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-68277264-58bb-4932-92fc-e69dbc04241b tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] [instance: 814f7da9-1d8d-4695-8cfa-6db50c3e846a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:30.677849 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-68277264-58bb-4932-92fc-e69dbc04241b tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:30.695754 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-68277264-58bb-4932-92fc-e69dbc04241b tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:30.698266 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-68277264-58bb-4932-92fc-e69dbc04241b tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:30.701373 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-68277264-58bb-4932-92fc-e69dbc04241b tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:30.701947 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-68277264-58bb-4932-92fc-e69dbc04241b tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:30.703124 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-68277264-58bb-4932-92fc-e69dbc04241b tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:31.110480 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-68277264-58bb-4932-92fc-e69dbc04241b tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095debf3968c448fb3c3add0322d8d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc9bed6d76834f6fa66d681ecd9f4e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:31.129014 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-68277264-58bb-4932-92fc-e69dbc04241b tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] 10.222.0.26 "GET /compute/v2.1/servers/814f7da9-1d8d-4695-8cfa-6db50c3e846a" status: 200 len: 1520 microversion: 2.1 time: 0.489944 Oct 08 21:03:31.134084 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1433/2814] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:30 2022] GET /compute/v2.1/servers/814f7da9-1d8d-4695-8cfa-6db50c3e846a => generated 1520 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:31.148382 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-48d0d12d-49dc-4f44-9098-3c5f1fa5174a tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:31.155323 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-48d0d12d-49dc-4f44-9098-3c5f1fa5174a tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] [instance: 570d4898-169b-4f6b-aef6-ab79ea0fbefd] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:31.185772 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-48d0d12d-49dc-4f44-9098-3c5f1fa5174a tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:31.186293 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-48d0d12d-49dc-4f44-9098-3c5f1fa5174a tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:31.186752 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-48d0d12d-49dc-4f44-9098-3c5f1fa5174a tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:31.193890 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-48d0d12d-49dc-4f44-9098-3c5f1fa5174a tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:31.194421 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-48d0d12d-49dc-4f44-9098-3c5f1fa5174a tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:31.196145 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-48d0d12d-49dc-4f44-9098-3c5f1fa5174a tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:31.288998 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-b217ecc7-6792-4572-8064-a7a2a6ddcd57 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Flavor limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 21:03:31.289567 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-b217ecc7-6792-4572-8064-a7a2a6ddcd57 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Image limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 21:03:31.290141 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-b217ecc7-6792-4572-8064-a7a2a6ddcd57 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Flavor pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 21:03:31.290776 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-b217ecc7-6792-4572-8064-a7a2a6ddcd57 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Image pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 21:03:31.291268 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-b217ecc7-6792-4572-8064-a7a2a6ddcd57 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 21:03:31.309166 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b217ecc7-6792-4572-8064-a7a2a6ddcd57 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:31.310698 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b217ecc7-6792-4572-8064-a7a2a6ddcd57 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:31.311819 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b217ecc7-6792-4572-8064-a7a2a6ddcd57 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:31.312940 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b217ecc7-6792-4572-8064-a7a2a6ddcd57 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:31.313664 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b217ecc7-6792-4572-8064-a7a2a6ddcd57 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:31.314308 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b217ecc7-6792-4572-8064-a7a2a6ddcd57 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:31.343989 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-b217ecc7-6792-4572-8064-a7a2a6ddcd57 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Getting quotas for project 4735bf74f33a4739800d766c82d973d4. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:03:31.352890 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-b217ecc7-6792-4572-8064-a7a2a6ddcd57 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Getting quotas for user 40f60e33f334465fac1148669de3f00c and project 4735bf74f33a4739800d766c82d973d4. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:03:31.375842 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-b217ecc7-6792-4572-8064-a7a2a6ddcd57 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Going to run 1 instances... {{(pid=140491) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 21:03:31.379438 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-b217ecc7-6792-4572-8064-a7a2a6ddcd57 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] [instance: ede2a1aa-f65b-424e-9034-15a2aaf13e60] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c508bd7f-7db9-4b2c-af7c-be54a855c355',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140491) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 21:03:31.472747 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-b217ecc7-6792-4572-8064-a7a2a6ddcd57 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.394366 Oct 08 21:03:31.476891 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1382/2815] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 21:03:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1405 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 08 21:03:31.491266 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-00f19048-8707-4f8d-93d4-0e460ef742bf tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:31.492372 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-00f19048-8707-4f8d-93d4-0e460ef742bf tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] [instance: ede2a1aa-f65b-424e-9034-15a2aaf13e60] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:31.590723 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-00f19048-8707-4f8d-93d4-0e460ef742bf tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f60e33f334465fac1148669de3f00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4735bf74f33a4739800d766c82d973d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:31.601697 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-00f19048-8707-4f8d-93d4-0e460ef742bf tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] 10.222.0.26 "GET /compute/v2.1/servers/ede2a1aa-f65b-424e-9034-15a2aaf13e60" status: 200 len: 1213 microversion: 2.1 time: 0.119895 Oct 08 21:03:31.621489 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1383/2816] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:31 2022] GET /compute/v2.1/servers/ede2a1aa-f65b-424e-9034-15a2aaf13e60 => generated 1213 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:31.639546 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-48d0d12d-49dc-4f44-9098-3c5f1fa5174a tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2e13f1952a4e5bb23d57dd7fa31875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b2a56286924e2d953bebe717ce591b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:31.654057 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-48d0d12d-49dc-4f44-9098-3c5f1fa5174a tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] 10.222.0.26 "GET /compute/v2.1/servers/570d4898-169b-4f6b-aef6-ab79ea0fbefd" status: 200 len: 1506 microversion: 2.1 time: 0.518184 Oct 08 21:03:31.658442 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1434/2817] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:31 2022] GET /compute/v2.1/servers/570d4898-169b-4f6b-aef6-ab79ea0fbefd => generated 1506 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:31.668960 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-a4a17415-910c-49bc-9840-43ccb4b3d5b5 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:31.669966 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-a4a17415-910c-49bc-9840-43ccb4b3d5b5 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: 6ef37448-690b-4fcf-85f8-a2fb71207f38] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:31.686706 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a4a17415-910c-49bc-9840-43ccb4b3d5b5 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:31.687239 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a4a17415-910c-49bc-9840-43ccb4b3d5b5 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:31.687875 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a4a17415-910c-49bc-9840-43ccb4b3d5b5 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:31.688975 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a4a17415-910c-49bc-9840-43ccb4b3d5b5 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:31.689654 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a4a17415-910c-49bc-9840-43ccb4b3d5b5 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:31.691443 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a4a17415-910c-49bc-9840-43ccb4b3d5b5 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:31.730147 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:03:32.093959 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-a4a17415-910c-49bc-9840-43ccb4b3d5b5 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:32.106960 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-a4a17415-910c-49bc-9840-43ccb4b3d5b5 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/6ef37448-690b-4fcf-85f8-a2fb71207f38" status: 200 len: 1313 microversion: 2.1 time: 0.453239 Oct 08 21:03:32.126874 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1384/2818] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:31 2022] GET /compute/v2.1/servers/6ef37448-690b-4fcf-85f8-a2fb71207f38 => generated 1313 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:32.159208 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-9fcf0cb6-a74b-4d63-b64f-0e8e0c3e558b tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:32.160994 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-9fcf0cb6-a74b-4d63-b64f-0e8e0c3e558b tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] [instance: 814f7da9-1d8d-4695-8cfa-6db50c3e846a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:32.180145 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9fcf0cb6-a74b-4d63-b64f-0e8e0c3e558b tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:32.180573 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9fcf0cb6-a74b-4d63-b64f-0e8e0c3e558b tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:32.181029 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9fcf0cb6-a74b-4d63-b64f-0e8e0c3e558b tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:32.182792 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9fcf0cb6-a74b-4d63-b64f-0e8e0c3e558b tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:32.183321 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9fcf0cb6-a74b-4d63-b64f-0e8e0c3e558b tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:32.183685 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9fcf0cb6-a74b-4d63-b64f-0e8e0c3e558b tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:32.637034 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-0b423825-2744-4c51-8e8b-117fe4ee38c1 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:32.637817 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-0b423825-2744-4c51-8e8b-117fe4ee38c1 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] [instance: ede2a1aa-f65b-424e-9034-15a2aaf13e60] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:32.645598 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-9fcf0cb6-a74b-4d63-b64f-0e8e0c3e558b tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095debf3968c448fb3c3add0322d8d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc9bed6d76834f6fa66d681ecd9f4e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:32.647150 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:03:32.659486 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-9fcf0cb6-a74b-4d63-b64f-0e8e0c3e558b tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] 10.222.0.26 "GET /compute/v2.1/servers/814f7da9-1d8d-4695-8cfa-6db50c3e846a" status: 200 len: 1520 microversion: 2.1 time: 0.505001 Oct 08 21:03:32.664091 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0b423825-2744-4c51-8e8b-117fe4ee38c1 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:32.664612 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0b423825-2744-4c51-8e8b-117fe4ee38c1 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:32.671508 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1435/2819] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:32 2022] GET /compute/v2.1/servers/814f7da9-1d8d-4695-8cfa-6db50c3e846a => generated 1520 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:32.675094 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0b423825-2744-4c51-8e8b-117fe4ee38c1 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:32.681463 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0b423825-2744-4c51-8e8b-117fe4ee38c1 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:32.682475 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0b423825-2744-4c51-8e8b-117fe4ee38c1 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:32.682947 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0b423825-2744-4c51-8e8b-117fe4ee38c1 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:32.683245 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-3c5578e1-49e4-482b-a3fb-e9c3e2f5e3f5 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:32.684897 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-3c5578e1-49e4-482b-a3fb-e9c3e2f5e3f5 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] [instance: 570d4898-169b-4f6b-aef6-ab79ea0fbefd] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:32.702662 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3c5578e1-49e4-482b-a3fb-e9c3e2f5e3f5 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:32.703638 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3c5578e1-49e4-482b-a3fb-e9c3e2f5e3f5 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:32.704711 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3c5578e1-49e4-482b-a3fb-e9c3e2f5e3f5 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:32.705722 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3c5578e1-49e4-482b-a3fb-e9c3e2f5e3f5 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:32.706670 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3c5578e1-49e4-482b-a3fb-e9c3e2f5e3f5 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:32.710392 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3c5578e1-49e4-482b-a3fb-e9c3e2f5e3f5 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:32.857154 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-0b423825-2744-4c51-8e8b-117fe4ee38c1 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f60e33f334465fac1148669de3f00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4735bf74f33a4739800d766c82d973d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:32.870446 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-0b423825-2744-4c51-8e8b-117fe4ee38c1 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] 10.222.0.26 "GET /compute/v2.1/servers/ede2a1aa-f65b-424e-9034-15a2aaf13e60" status: 200 len: 1209 microversion: 2.1 time: 0.245911 Oct 08 21:03:32.871135 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1385/2820] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:32 2022] GET /compute/v2.1/servers/ede2a1aa-f65b-424e-9034-15a2aaf13e60 => generated 1209 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:33.088720 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-3c5578e1-49e4-482b-a3fb-e9c3e2f5e3f5 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2e13f1952a4e5bb23d57dd7fa31875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b2a56286924e2d953bebe717ce591b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:33.103077 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-3c5578e1-49e4-482b-a3fb-e9c3e2f5e3f5 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] 10.222.0.26 "GET /compute/v2.1/servers/570d4898-169b-4f6b-aef6-ab79ea0fbefd" status: 200 len: 1506 microversion: 2.1 time: 0.424330 Oct 08 21:03:33.104749 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1436/2821] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:32 2022] GET /compute/v2.1/servers/570d4898-169b-4f6b-aef6-ab79ea0fbefd => generated 1506 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:33.134666 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-e202ffb7-15f7-43e5-958a-bbeb329df9b3 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:33.135284 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-e202ffb7-15f7-43e5-958a-bbeb329df9b3 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: 6ef37448-690b-4fcf-85f8-a2fb71207f38] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:33.148992 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e202ffb7-15f7-43e5-958a-bbeb329df9b3 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:33.149969 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e202ffb7-15f7-43e5-958a-bbeb329df9b3 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:33.150426 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e202ffb7-15f7-43e5-958a-bbeb329df9b3 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:33.151166 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e202ffb7-15f7-43e5-958a-bbeb329df9b3 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:33.151638 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e202ffb7-15f7-43e5-958a-bbeb329df9b3 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:33.152071 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e202ffb7-15f7-43e5-958a-bbeb329df9b3 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:33.565546 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-e202ffb7-15f7-43e5-958a-bbeb329df9b3 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:33.574794 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-e202ffb7-15f7-43e5-958a-bbeb329df9b3 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/6ef37448-690b-4fcf-85f8-a2fb71207f38" status: 200 len: 1313 microversion: 2.1 time: 0.444149 Oct 08 21:03:33.585272 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1386/2822] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:33 2022] GET /compute/v2.1/servers/6ef37448-690b-4fcf-85f8-a2fb71207f38 => generated 1313 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:33.684792 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-a74d1341-9664-4b50-be1b-0ec2bf18b5b7 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:33.685528 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-a74d1341-9664-4b50-be1b-0ec2bf18b5b7 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] [instance: 814f7da9-1d8d-4695-8cfa-6db50c3e846a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:33.695904 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=4 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:03:33.709072 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a74d1341-9664-4b50-be1b-0ec2bf18b5b7 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:33.709784 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a74d1341-9664-4b50-be1b-0ec2bf18b5b7 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:33.710246 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a74d1341-9664-4b50-be1b-0ec2bf18b5b7 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:33.711119 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a74d1341-9664-4b50-be1b-0ec2bf18b5b7 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:33.711600 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a74d1341-9664-4b50-be1b-0ec2bf18b5b7 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:33.712045 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a74d1341-9664-4b50-be1b-0ec2bf18b5b7 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:33.895609 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-1cd255e4-1ac0-4c3e-b629-9da831d4412a tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:33.897051 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-1cd255e4-1ac0-4c3e-b629-9da831d4412a tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] [instance: ede2a1aa-f65b-424e-9034-15a2aaf13e60] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:33.910721 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1cd255e4-1ac0-4c3e-b629-9da831d4412a tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:33.911221 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1cd255e4-1ac0-4c3e-b629-9da831d4412a tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:33.912977 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1cd255e4-1ac0-4c3e-b629-9da831d4412a tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:33.913907 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1cd255e4-1ac0-4c3e-b629-9da831d4412a tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:33.915478 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1cd255e4-1ac0-4c3e-b629-9da831d4412a tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:33.916083 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1cd255e4-1ac0-4c3e-b629-9da831d4412a tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:34.022509 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-1cd255e4-1ac0-4c3e-b629-9da831d4412a tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f60e33f334465fac1148669de3f00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4735bf74f33a4739800d766c82d973d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:34.038041 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-1cd255e4-1ac0-4c3e-b629-9da831d4412a tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] 10.222.0.26 "GET /compute/v2.1/servers/ede2a1aa-f65b-424e-9034-15a2aaf13e60" status: 200 len: 1271 microversion: 2.1 time: 0.147329 Oct 08 21:03:34.039401 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1387/2823] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:33 2022] GET /compute/v2.1/servers/ede2a1aa-f65b-424e-9034-15a2aaf13e60 => generated 1271 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:34.057840 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-19efcf71-353d-49f4-9272-37d1d3a8bf91 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:34.058263 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-19efcf71-353d-49f4-9272-37d1d3a8bf91 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] [instance: 4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:34.068028 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-19efcf71-353d-49f4-9272-37d1d3a8bf91 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:34.071281 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-19efcf71-353d-49f4-9272-37d1d3a8bf91 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:34.071760 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-19efcf71-353d-49f4-9272-37d1d3a8bf91 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:34.075053 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-19efcf71-353d-49f4-9272-37d1d3a8bf91 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:34.075053 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-19efcf71-353d-49f4-9272-37d1d3a8bf91 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:34.075053 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-19efcf71-353d-49f4-9272-37d1d3a8bf91 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:34.207054 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.objects.instance [None req-19efcf71-353d-49f4-9272-37d1d3a8bf91 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lazy-loading 'services' on Instance uuid 4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711 {{(pid=140491) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 21:03:34.329906 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-19efcf71-353d-49f4-9272-37d1d3a8bf91 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] 10.222.0.26 "DELETE /compute/v2.1/servers/4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711/os-volume_attachments/3d9000e4-0140-4d89-9d9e-4730705b15bf" status: 202 len: 0 microversion: 2.1 time: 0.287141 Oct 08 21:03:34.332818 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1388/2824] 10.222.0.26 () {58 vars in 1416 bytes} [Sat Oct 8 21:03:34 2022] DELETE /compute/v2.1/servers/4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711/os-volume_attachments/3d9000e4-0140-4d89-9d9e-4730705b15bf => generated 0 bytes in 293 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 21:03:34.359701 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-e4369cd7-fbf9-4bc5-8aa9-dc5c1d4c6535 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:34.361101 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-e4369cd7-fbf9-4bc5-8aa9-dc5c1d4c6535 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] [instance: 570d4898-169b-4f6b-aef6-ab79ea0fbefd] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:34.377372 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e4369cd7-fbf9-4bc5-8aa9-dc5c1d4c6535 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:34.383717 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e4369cd7-fbf9-4bc5-8aa9-dc5c1d4c6535 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:34.384434 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e4369cd7-fbf9-4bc5-8aa9-dc5c1d4c6535 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:34.387319 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e4369cd7-fbf9-4bc5-8aa9-dc5c1d4c6535 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:34.388013 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e4369cd7-fbf9-4bc5-8aa9-dc5c1d4c6535 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:34.389201 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e4369cd7-fbf9-4bc5-8aa9-dc5c1d4c6535 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:34.493173 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-a74d1341-9664-4b50-be1b-0ec2bf18b5b7 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095debf3968c448fb3c3add0322d8d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc9bed6d76834f6fa66d681ecd9f4e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:34.505536 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-a74d1341-9664-4b50-be1b-0ec2bf18b5b7 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] 10.222.0.26 "GET /compute/v2.1/servers/814f7da9-1d8d-4695-8cfa-6db50c3e846a" status: 200 len: 1520 microversion: 2.1 time: 0.824852 Oct 08 21:03:34.506824 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1437/2825] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:33 2022] GET /compute/v2.1/servers/814f7da9-1d8d-4695-8cfa-6db50c3e846a => generated 1520 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:34.524237 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-10412610-6128-42cf-86c3-e7ea1f81fa26 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:34.527237 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-10412610-6128-42cf-86c3-e7ea1f81fa26 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] [instance: 4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:34.544460 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-10412610-6128-42cf-86c3-e7ea1f81fa26 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:34.545093 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-10412610-6128-42cf-86c3-e7ea1f81fa26 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:34.546464 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-10412610-6128-42cf-86c3-e7ea1f81fa26 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:34.548259 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-10412610-6128-42cf-86c3-e7ea1f81fa26 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:34.550349 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-10412610-6128-42cf-86c3-e7ea1f81fa26 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:34.551063 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-10412610-6128-42cf-86c3-e7ea1f81fa26 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:34.620383 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-10412610-6128-42cf-86c3-e7ea1f81fa26 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] 10.222.0.26 "GET /compute/v2.1/servers/4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.112214 Oct 08 21:03:34.625568 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1438/2826] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Oct 8 21:03:34 2022] GET /compute/v2.1/servers/4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711/os-volume_attachments => generated 197 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:03:34.634352 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-de2b7e31-6ae4-4801-b326-3cf577c05730 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:34.636406 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-de2b7e31-6ae4-4801-b326-3cf577c05730 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: 6ef37448-690b-4fcf-85f8-a2fb71207f38] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:34.664317 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-de2b7e31-6ae4-4801-b326-3cf577c05730 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:34.664910 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-de2b7e31-6ae4-4801-b326-3cf577c05730 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:34.665623 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-de2b7e31-6ae4-4801-b326-3cf577c05730 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:34.666631 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-de2b7e31-6ae4-4801-b326-3cf577c05730 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:34.667193 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-de2b7e31-6ae4-4801-b326-3cf577c05730 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:34.667784 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-de2b7e31-6ae4-4801-b326-3cf577c05730 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:34.691372 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=100 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:03:34.858077 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-de2b7e31-6ae4-4801-b326-3cf577c05730 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:34.870952 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-de2b7e31-6ae4-4801-b326-3cf577c05730 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/6ef37448-690b-4fcf-85f8-a2fb71207f38" status: 200 len: 1313 microversion: 2.1 time: 0.243719 Oct 08 21:03:34.885228 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1439/2827] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:34 2022] GET /compute/v2.1/servers/6ef37448-690b-4fcf-85f8-a2fb71207f38 => generated 1313 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:34.963757 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-e4369cd7-fbf9-4bc5-8aa9-dc5c1d4c6535 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2e13f1952a4e5bb23d57dd7fa31875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b2a56286924e2d953bebe717ce591b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:34.975977 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-e4369cd7-fbf9-4bc5-8aa9-dc5c1d4c6535 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] 10.222.0.26 "GET /compute/v2.1/servers/570d4898-169b-4f6b-aef6-ab79ea0fbefd" status: 200 len: 1506 microversion: 2.1 time: 0.636246 Oct 08 21:03:34.977787 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1389/2828] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:34 2022] GET /compute/v2.1/servers/570d4898-169b-4f6b-aef6-ab79ea0fbefd => generated 1506 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:35.069815 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-ad0223ff-26ec-4ded-8175-5282b3265548 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:35.070717 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-ad0223ff-26ec-4ded-8175-5282b3265548 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] [instance: ede2a1aa-f65b-424e-9034-15a2aaf13e60] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:35.077322 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ad0223ff-26ec-4ded-8175-5282b3265548 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:35.078247 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ad0223ff-26ec-4ded-8175-5282b3265548 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:35.079342 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ad0223ff-26ec-4ded-8175-5282b3265548 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:35.080203 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ad0223ff-26ec-4ded-8175-5282b3265548 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:35.080850 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ad0223ff-26ec-4ded-8175-5282b3265548 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:35.081475 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ad0223ff-26ec-4ded-8175-5282b3265548 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:35.159309 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-ad0223ff-26ec-4ded-8175-5282b3265548 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f60e33f334465fac1148669de3f00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4735bf74f33a4739800d766c82d973d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:35.170529 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-ad0223ff-26ec-4ded-8175-5282b3265548 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] 10.222.0.26 "GET /compute/v2.1/servers/ede2a1aa-f65b-424e-9034-15a2aaf13e60" status: 200 len: 1271 microversion: 2.1 time: 0.105266 Oct 08 21:03:35.175916 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1440/2829] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:35 2022] GET /compute/v2.1/servers/ede2a1aa-f65b-424e-9034-15a2aaf13e60 => generated 1271 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:35.532919 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-396becb7-f5cc-43a2-a18c-df230ee43772 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:35.533659 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-396becb7-f5cc-43a2-a18c-df230ee43772 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] [instance: 814f7da9-1d8d-4695-8cfa-6db50c3e846a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:35.547876 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-396becb7-f5cc-43a2-a18c-df230ee43772 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:35.548659 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-396becb7-f5cc-43a2-a18c-df230ee43772 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:35.550365 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-396becb7-f5cc-43a2-a18c-df230ee43772 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:35.553571 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-396becb7-f5cc-43a2-a18c-df230ee43772 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:35.555270 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-396becb7-f5cc-43a2-a18c-df230ee43772 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:35.557132 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-396becb7-f5cc-43a2-a18c-df230ee43772 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:35.636710 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e49e2774-0b77-494d-9f9c-f15de5d4dcc0 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:35.639272 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-e49e2774-0b77-494d-9f9c-f15de5d4dcc0 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] [instance: 4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:35.652088 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e49e2774-0b77-494d-9f9c-f15de5d4dcc0 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:35.652897 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e49e2774-0b77-494d-9f9c-f15de5d4dcc0 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:35.654941 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e49e2774-0b77-494d-9f9c-f15de5d4dcc0 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:35.657365 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e49e2774-0b77-494d-9f9c-f15de5d4dcc0 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:35.659256 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e49e2774-0b77-494d-9f9c-f15de5d4dcc0 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:35.668261 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e49e2774-0b77-494d-9f9c-f15de5d4dcc0 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:35.722800 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-e49e2774-0b77-494d-9f9c-f15de5d4dcc0 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] 10.222.0.26 "GET /compute/v2.1/servers/4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.090612 Oct 08 21:03:35.724039 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1441/2830] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Oct 8 21:03:35 2022] GET /compute/v2.1/servers/4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711/os-volume_attachments => generated 25 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 08 21:03:35.737625 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-07a875a2-447e-4d66-acae-024af66866d0 req-d1d5bcbd-da63-4a5f-ac21-64dac69c0910 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ef37448-690b-4fcf-85f8-a2fb71207f38", "name": "network-vif-plugged", "status": "completed", "tag": "066ce620-e2c6-4bca-97c2-d42e20280dcc"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:03:35.768032 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-07a875a2-447e-4d66-acae-024af66866d0 req-d1d5bcbd-da63-4a5f-ac21-64dac69c0910 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:35.781256 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-07a875a2-447e-4d66-acae-024af66866d0 req-d1d5bcbd-da63-4a5f-ac21-64dac69c0910 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:35.782240 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-07a875a2-447e-4d66-acae-024af66866d0 req-d1d5bcbd-da63-4a5f-ac21-64dac69c0910 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:35.805009 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-07a875a2-447e-4d66-acae-024af66866d0 req-d1d5bcbd-da63-4a5f-ac21-64dac69c0910 service nova] Creating event network-vif-plugged:066ce620-e2c6-4bca-97c2-d42e20280dcc for instance 6ef37448-690b-4fcf-85f8-a2fb71207f38 on nch2-master-1 Oct 08 21:03:35.810891 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-07a875a2-447e-4d66-acae-024af66866d0 req-d1d5bcbd-da63-4a5f-ac21-64dac69c0910 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085506 Oct 08 21:03:35.811920 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1442/2831] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:03:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:03:35.825915 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-c82ddb09-db6e-4598-a4a0-e9b1f7df68a7 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:03:35.829867 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-c82ddb09-db6e-4598-a4a0-e9b1f7df68a7 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] [instance: 75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:35.838360 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c82ddb09-db6e-4598-a4a0-e9b1f7df68a7 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:35.838879 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c82ddb09-db6e-4598-a4a0-e9b1f7df68a7 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:35.839514 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c82ddb09-db6e-4598-a4a0-e9b1f7df68a7 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:35.840609 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c82ddb09-db6e-4598-a4a0-e9b1f7df68a7 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:35.841755 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c82ddb09-db6e-4598-a4a0-e9b1f7df68a7 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:35.842836 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c82ddb09-db6e-4598-a4a0-e9b1f7df68a7 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:35.883422 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-c82ddb09-db6e-4598-a4a0-e9b1f7df68a7 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] HTTP exception thrown: Cannot 'reboot' instance 75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a while it is in vm_state rescued Oct 08 21:03:35.885248 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-c82ddb09-db6e-4598-a4a0-e9b1f7df68a7 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Request method failure captured: Oct 08 21:03:35.885248 ncdv-master-1 devstack@n-api.service[140492]: request: POST /compute/v2.1/servers/75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a/action HTTP/1.1 Oct 08 21:03:35.885248 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:03:35.885248 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:03:35.885248 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:03:35.885248 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 28 Oct 08 21:03:35.885248 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:03:35.885248 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:03:35.885248 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:03:35.885248 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:03:35.885248 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeS0fE1W4PvU2_7k8u76nOm9Y1zh9DtzN6SifZox8c4Ee-O4iYj3CcpXLLEG93O-SwetyStVJsCOhK1z0DAluVdyejBt-R2ozc-SxCa3q7lzUNWL-Kx89hV0cNzOobKFM-EJsBUodFQ4EWnFtqD_Q-5HZD9KoD2jZ3YWHd3RuK5iGsY Oct 08 21:03:35.885248 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:03:35.885248 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:03:35.885248 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:03:35.885248 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:03:35.885248 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:03:35.885248 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:03:35.885248 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 8b00ee5e7828469f95bd90548d35982a Oct 08 21:03:35.885248 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1823882791 Oct 08 21:03:35.885248 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:03:35.885248 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:03:35.885248 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8b00ee5e7828469f95bd90548d35982a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8b00ee5e7828469f95bd90548d35982a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8b00ee5e7828469f95bd90548d35982a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8b00ee5e7828469f95bd90548d35982a"}]}] Oct 08 21:03:35.885248 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1823882791 Oct 08 21:03:35.885248 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 8b00ee5e7828469f95bd90548d35982a Oct 08 21:03:35.885248 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1823882791 Oct 08 21:03:35.885248 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-ServerRescueNegativeTestJSON-1823882791-project Oct 08 21:03:35.885248 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:03:35.885248 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:03:35.885248 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 1698dee4a2bf4ea19a6ee0c3d5cb5c09 Oct 08 21:03:35.885248 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1823882791-project Oct 08 21:03:35.885248 ncdv-master-1 devstack@n-api.service[140492]: Oct 08 21:03:35.885248 ncdv-master-1 devstack@n-api.service[140492]: {"reboot": {"type": "HARD"}} Oct 08 21:03:35.885248 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 21:03:35.885248 ncdv-master-1 devstack@n-api.service[140492]: exception: Cannot 'reboot' instance 75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a while it is in vm_state rescued Oct 08 21:03:35.885248 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': '75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a', 'body': {'reboot': {'type': 'HARD'}}} Oct 08 21:03:35.885248 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:03:35.885248 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:03:35.885248 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Oct 08 21:03:35.885248 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Oct 08 21:03:35.885248 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 08 21:03:35.885248 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 08 21:03:35.885248 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3552, in reboot Oct 08 21:03:35.885248 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Oct 08 21:03:35.885248 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 08 21:03:35.885248 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 08 21:03:35.885248 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Oct 08 21:03:35.885248 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:03:35.885248 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:03:35.885248 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:03:35.885248 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:03:35.885248 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:03:35.885248 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:03:35.885248 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:03:35.885248 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:03:35.885248 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:03:35.885248 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:03:35.885248 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 21:03:35.885248 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 21:03:35.885248 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Oct 08 21:03:35.885248 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 08 21:03:35.885248 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 08 21:03:35.885248 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 08 21:03:35.889974 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance 75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a while it is in vm_state rescued Oct 08 21:03:35.889974 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:03:35.889974 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:03:35.889974 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:03:35.889974 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:03:35.889974 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:03:35.889974 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:03:35.889974 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:03:35.889974 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:03:35.889974 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance 75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a while it is in vm_state rescued Oct 08 21:03:35.889974 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:03:35.892063 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-c82ddb09-db6e-4598-a4a0-e9b1f7df68a7 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Returning 409 to user: Cannot 'reboot' instance 75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a while it is in vm_state rescued {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:03:35.893160 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-c82ddb09-db6e-4598-a4a0-e9b1f7df68a7 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] 10.222.0.26 "POST /compute/v2.1/servers/75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a/action" status: 409 len: 145 microversion: 2.1 time: 0.073575 Oct 08 21:03:35.894210 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1443/2832] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:03:35 2022] POST /compute/v2.1/servers/75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a/action => generated 145 bytes in 76 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 08 21:03:35.908130 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-032db50d-dbb0-4204-a3f8-31e68f6770ab tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:35.908833 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-032db50d-dbb0-4204-a3f8-31e68f6770ab tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: 6ef37448-690b-4fcf-85f8-a2fb71207f38] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:35.916546 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-032db50d-dbb0-4204-a3f8-31e68f6770ab tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:35.917304 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-032db50d-dbb0-4204-a3f8-31e68f6770ab tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:35.917899 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-032db50d-dbb0-4204-a3f8-31e68f6770ab tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:35.918782 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-032db50d-dbb0-4204-a3f8-31e68f6770ab tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:35.919247 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-032db50d-dbb0-4204-a3f8-31e68f6770ab tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:35.919681 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-032db50d-dbb0-4204-a3f8-31e68f6770ab tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:36.135829 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-032db50d-dbb0-4204-a3f8-31e68f6770ab tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:36.147205 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-032db50d-dbb0-4204-a3f8-31e68f6770ab tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/6ef37448-690b-4fcf-85f8-a2fb71207f38" status: 200 len: 1313 microversion: 2.1 time: 0.251111 Oct 08 21:03:36.147980 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1444/2833] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:35 2022] GET /compute/v2.1/servers/6ef37448-690b-4fcf-85f8-a2fb71207f38 => generated 1313 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:36.174718 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-2e96d5e3-292b-4449-b481-76421c25148f tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:03:36.179897 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-2e96d5e3-292b-4449-b481-76421c25148f tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] [instance: 75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:36.188237 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2e96d5e3-292b-4449-b481-76421c25148f tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:36.189931 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2e96d5e3-292b-4449-b481-76421c25148f tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:36.189931 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2e96d5e3-292b-4449-b481-76421c25148f tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:36.190193 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2e96d5e3-292b-4449-b481-76421c25148f tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:36.190655 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2e96d5e3-292b-4449-b481-76421c25148f tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:36.191103 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2e96d5e3-292b-4449-b481-76421c25148f tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:36.208784 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-396becb7-f5cc-43a2-a18c-df230ee43772 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095debf3968c448fb3c3add0322d8d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc9bed6d76834f6fa66d681ecd9f4e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:36.217031 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-396becb7-f5cc-43a2-a18c-df230ee43772 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] 10.222.0.26 "GET /compute/v2.1/servers/814f7da9-1d8d-4695-8cfa-6db50c3e846a" status: 200 len: 1520 microversion: 2.1 time: 0.690328 Oct 08 21:03:36.217903 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1390/2834] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:35 2022] GET /compute/v2.1/servers/814f7da9-1d8d-4695-8cfa-6db50c3e846a => generated 1520 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:36.224805 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-a2377cef-106d-49c9-8a8c-2d79b289e2db tempest-ImagesMetadataTestJSON-481984484 tempest-ImagesMetadataTestJSON-481984484-project] Calling method '.version_select at 0x7f1a87e07670>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:36.284921 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-2e96d5e3-292b-4449-b481-76421c25148f tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] HTTP exception thrown: Cannot 'rebuild' instance 75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a while it is in vm_state rescued Oct 08 21:03:36.286731 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-2e96d5e3-292b-4449-b481-76421c25148f tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Request method failure captured: Oct 08 21:03:36.286731 ncdv-master-1 devstack@n-api.service[140492]: request: POST /compute/v2.1/servers/75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a/action HTTP/1.1 Oct 08 21:03:36.286731 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:03:36.286731 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:03:36.286731 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:03:36.286731 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 65 Oct 08 21:03:36.286731 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:03:36.286731 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:03:36.286731 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:03:36.286731 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:03:36.286731 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeS0fE1W4PvU2_7k8u76nOm9Y1zh9DtzN6SifZox8c4Ee-O4iYj3CcpXLLEG93O-SwetyStVJsCOhK1z0DAluVdyejBt-R2ozc-SxCa3q7lzUNWL-Kx89hV0cNzOobKFM-EJsBUodFQ4EWnFtqD_Q-5HZD9KoD2jZ3YWHd3RuK5iGsY Oct 08 21:03:36.286731 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:03:36.286731 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:03:36.286731 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:03:36.286731 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:03:36.286731 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:03:36.286731 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:03:36.286731 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 8b00ee5e7828469f95bd90548d35982a Oct 08 21:03:36.286731 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1823882791 Oct 08 21:03:36.286731 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:03:36.286731 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:03:36.286731 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8b00ee5e7828469f95bd90548d35982a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8b00ee5e7828469f95bd90548d35982a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8b00ee5e7828469f95bd90548d35982a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8b00ee5e7828469f95bd90548d35982a"}]}] Oct 08 21:03:36.286731 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1823882791 Oct 08 21:03:36.286731 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 8b00ee5e7828469f95bd90548d35982a Oct 08 21:03:36.286731 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1823882791 Oct 08 21:03:36.286731 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-ServerRescueNegativeTestJSON-1823882791-project Oct 08 21:03:36.286731 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:03:36.286731 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:03:36.286731 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 1698dee4a2bf4ea19a6ee0c3d5cb5c09 Oct 08 21:03:36.286731 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1823882791-project Oct 08 21:03:36.286731 ncdv-master-1 devstack@n-api.service[140492]: Oct 08 21:03:36.286731 ncdv-master-1 devstack@n-api.service[140492]: {"rebuild": {"imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355"}} Oct 08 21:03:36.286731 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 21:03:36.286731 ncdv-master-1 devstack@n-api.service[140492]: exception: Cannot 'rebuild' instance 75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a while it is in vm_state rescued Oct 08 21:03:36.286731 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': '75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a', 'body': {'rebuild': {'imageRef': 'c508bd7f-7db9-4b2c-af7c-be54a855c355'}}} Oct 08 21:03:36.286731 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:03:36.286731 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:03:36.286731 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1223, in _action_rebuild Oct 08 21:03:36.286731 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Oct 08 21:03:36.286731 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 08 21:03:36.286731 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 08 21:03:36.286731 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 08 21:03:36.286731 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 08 21:03:36.286731 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 08 21:03:36.286731 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 08 21:03:36.286731 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 08 21:03:36.286731 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 08 21:03:36.286731 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a in vm_state rescued. Cannot rebuild while the instance is in this state. Oct 08 21:03:36.286731 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:03:36.286731 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:03:36.286731 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:03:36.286731 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:03:36.286731 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:03:36.286731 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:03:36.286731 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:03:36.286731 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:03:36.286731 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:03:36.286731 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:03:36.286731 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 21:03:36.286731 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 21:03:36.286731 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 21:03:36.286731 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 21:03:36.286731 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 21:03:36.291277 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 21:03:36.291277 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 08 21:03:36.291277 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1231, in _action_rebuild Oct 08 21:03:36.291277 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 08 21:03:36.291277 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 08 21:03:36.291277 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 08 21:03:36.291277 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance 75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a while it is in vm_state rescued Oct 08 21:03:36.291277 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:03:36.291277 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:03:36.291277 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:03:36.291277 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:03:36.291277 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:03:36.291277 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:03:36.291277 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:03:36.291277 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:03:36.291277 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance 75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a while it is in vm_state rescued Oct 08 21:03:36.291277 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:03:36.291277 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-2e96d5e3-292b-4449-b481-76421c25148f tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Returning 409 to user: Cannot 'rebuild' instance 75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a while it is in vm_state rescued {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:03:36.310910 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-2e96d5e3-292b-4449-b481-76421c25148f tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] 10.222.0.26 "POST /compute/v2.1/servers/75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a/action" status: 409 len: 146 microversion: 2.1 time: 0.119149 Oct 08 21:03:36.311864 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1445/2835] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:03:36 2022] POST /compute/v2.1/servers/75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a/action => generated 146 bytes in 143 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 08 21:03:36.317514 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-d9397b16-3d0b-4b00-a7d1-3cd50445f768 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:36.318491 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-d9397b16-3d0b-4b00-a7d1-3cd50445f768 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] [instance: 570d4898-169b-4f6b-aef6-ab79ea0fbefd] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:36.326350 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d9397b16-3d0b-4b00-a7d1-3cd50445f768 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:36.328463 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d9397b16-3d0b-4b00-a7d1-3cd50445f768 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:36.329123 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d9397b16-3d0b-4b00-a7d1-3cd50445f768 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:36.330117 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d9397b16-3d0b-4b00-a7d1-3cd50445f768 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:36.330813 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d9397b16-3d0b-4b00-a7d1-3cd50445f768 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:36.331485 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d9397b16-3d0b-4b00-a7d1-3cd50445f768 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:36.342453 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-a2377cef-106d-49c9-8a8c-2d79b289e2db tempest-ImagesMetadataTestJSON-481984484 tempest-ImagesMetadataTestJSON-481984484-project] 10.222.0.26 "GET /compute/v2.1/images/a85c77b2-02fa-45c5-95c3-474248d91892" status: 200 len: 636 microversion: 2.1 time: 0.123243 Oct 08 21:03:36.355936 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1391/2836] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:03:36 2022] GET /compute/v2.1/images/a85c77b2-02fa-45c5-95c3-474248d91892 => generated 636 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:03:36.361713 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-3522c58e-0f31-43eb-8201-0f2e69564293 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:36.364094 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-3522c58e-0f31-43eb-8201-0f2e69564293 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] [instance: ede2a1aa-f65b-424e-9034-15a2aaf13e60] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:36.372167 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3522c58e-0f31-43eb-8201-0f2e69564293 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:36.373004 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3522c58e-0f31-43eb-8201-0f2e69564293 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:36.373733 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3522c58e-0f31-43eb-8201-0f2e69564293 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:36.374714 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3522c58e-0f31-43eb-8201-0f2e69564293 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:36.376008 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3522c58e-0f31-43eb-8201-0f2e69564293 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:36.376700 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3522c58e-0f31-43eb-8201-0f2e69564293 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:36.593060 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-d9397b16-3d0b-4b00-a7d1-3cd50445f768 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2e13f1952a4e5bb23d57dd7fa31875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b2a56286924e2d953bebe717ce591b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:36.603428 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-d9397b16-3d0b-4b00-a7d1-3cd50445f768 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] 10.222.0.26 "GET /compute/v2.1/servers/570d4898-169b-4f6b-aef6-ab79ea0fbefd" status: 200 len: 1506 microversion: 2.1 time: 0.290440 Oct 08 21:03:36.613485 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1446/2837] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:36 2022] GET /compute/v2.1/servers/570d4898-169b-4f6b-aef6-ab79ea0fbefd => generated 1506 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:36.613485 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-4eaeeebb-7105-4130-8184-571ec98db9e3 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:36.613485 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-4eaeeebb-7105-4130-8184-571ec98db9e3 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] [instance: 4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:36.617514 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4eaeeebb-7105-4130-8184-571ec98db9e3 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:36.618321 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4eaeeebb-7105-4130-8184-571ec98db9e3 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:36.619023 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4eaeeebb-7105-4130-8184-571ec98db9e3 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:36.619988 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4eaeeebb-7105-4130-8184-571ec98db9e3 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:36.621446 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4eaeeebb-7105-4130-8184-571ec98db9e3 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:36.622109 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4eaeeebb-7105-4130-8184-571ec98db9e3 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:36.660583 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-4eaeeebb-7105-4130-8184-571ec98db9e3 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] [instance: 4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711] Going to try to terminate instance {{(pid=140492) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 21:03:36.841234 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-4eaeeebb-7105-4130-8184-571ec98db9e3 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] 10.222.0.26 "DELETE /compute/v2.1/servers/4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711" status: 204 len: 0 microversion: 2.1 time: 0.234404 Oct 08 21:03:36.845564 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1447/2838] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:03:36 2022] DELETE /compute/v2.1/servers/4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 21:03:36.857003 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e91434c1-d179-43c7-a0e5-50e41430532d tempest-ImagesMetadataTestJSON-481984484 tempest-ImagesMetadataTestJSON-481984484-project] Action: 'update_all', calling method: .version_select at 0x7f1a87e5c430>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:03:36.862875 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-3522c58e-0f31-43eb-8201-0f2e69564293 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f60e33f334465fac1148669de3f00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4735bf74f33a4739800d766c82d973d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:36.876861 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-3522c58e-0f31-43eb-8201-0f2e69564293 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] 10.222.0.26 "GET /compute/v2.1/servers/ede2a1aa-f65b-424e-9034-15a2aaf13e60" status: 200 len: 1313 microversion: 2.1 time: 0.519237 Oct 08 21:03:36.878676 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1392/2839] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:36 2022] GET /compute/v2.1/servers/ede2a1aa-f65b-424e-9034-15a2aaf13e60 => generated 1313 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:36.886242 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-7d5f0250-cfd7-413d-bb99-416528613ca8 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:36.887052 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-7d5f0250-cfd7-413d-bb99-416528613ca8 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] [instance: 4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:36.898717 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7d5f0250-cfd7-413d-bb99-416528613ca8 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:36.899477 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7d5f0250-cfd7-413d-bb99-416528613ca8 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:36.900122 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7d5f0250-cfd7-413d-bb99-416528613ca8 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:36.901018 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7d5f0250-cfd7-413d-bb99-416528613ca8 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:36.901717 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7d5f0250-cfd7-413d-bb99-416528613ca8 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:36.902315 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7d5f0250-cfd7-413d-bb99-416528613ca8 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:36.951674 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-e91434c1-d179-43c7-a0e5-50e41430532d tempest-ImagesMetadataTestJSON-481984484 tempest-ImagesMetadataTestJSON-481984484-project] Getting quotas for project 413b42a72c864890b9373a0ff695c225. Resources: dict_keys(['metadata_items']) {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:03:36.958376 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-e91434c1-d179-43c7-a0e5-50e41430532d tempest-ImagesMetadataTestJSON-481984484 tempest-ImagesMetadataTestJSON-481984484-project] Getting quotas for user 09d0d3c3f74a428098162e4f8df65fa4 and project 413b42a72c864890b9373a0ff695c225. Resources: dict_keys(['metadata_items']) {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:03:37.192942 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=4 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:03:37.262230 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-7d5f0250-cfd7-413d-bb99-416528613ca8 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1698dee4a2bf4ea19a6ee0c3d5cb5c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b00ee5e7828469f95bd90548d35982a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:37.275114 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-7d5f0250-cfd7-413d-bb99-416528613ca8 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] 10.222.0.26 "GET /compute/v2.1/servers/4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711" status: 200 len: 1689 microversion: 2.1 time: 0.395756 Oct 08 21:03:37.276283 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1393/2840] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:36 2022] GET /compute/v2.1/servers/4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711 => generated 1689 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:37.283294 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-a1d82eec-56ff-4043-8aca-16d313b4b481 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:37.284284 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-a1d82eec-56ff-4043-8aca-16d313b4b481 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: 6ef37448-690b-4fcf-85f8-a2fb71207f38] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:37.292604 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a1d82eec-56ff-4043-8aca-16d313b4b481 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:37.293178 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a1d82eec-56ff-4043-8aca-16d313b4b481 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:37.293721 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a1d82eec-56ff-4043-8aca-16d313b4b481 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:37.294446 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a1d82eec-56ff-4043-8aca-16d313b4b481 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:37.295624 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a1d82eec-56ff-4043-8aca-16d313b4b481 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:37.296128 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a1d82eec-56ff-4043-8aca-16d313b4b481 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:37.332849 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-e91434c1-d179-43c7-a0e5-50e41430532d tempest-ImagesMetadataTestJSON-481984484 tempest-ImagesMetadataTestJSON-481984484-project] 10.222.0.26 "PUT /compute/v2.1/images/a85c77b2-02fa-45c5-95c3-474248d91892/metadata" status: 200 len: 61 microversion: 2.1 time: 0.484425 Oct 08 21:03:37.334843 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1448/2841] 10.222.0.26 () {60 vars in 1280 bytes} [Sat Oct 8 21:03:36 2022] PUT /compute/v2.1/images/a85c77b2-02fa-45c5-95c3-474248d91892/metadata => generated 61 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 08 21:03:37.341485 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-c3033ae8-0b1c-4ef5-98d1-07ce59f31672 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:37.342597 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-c3033ae8-0b1c-4ef5-98d1-07ce59f31672 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] [instance: 814f7da9-1d8d-4695-8cfa-6db50c3e846a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:37.351251 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c3033ae8-0b1c-4ef5-98d1-07ce59f31672 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:37.352685 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c3033ae8-0b1c-4ef5-98d1-07ce59f31672 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:37.353419 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c3033ae8-0b1c-4ef5-98d1-07ce59f31672 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:37.354516 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c3033ae8-0b1c-4ef5-98d1-07ce59f31672 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:37.355243 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c3033ae8-0b1c-4ef5-98d1-07ce59f31672 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:37.355875 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c3033ae8-0b1c-4ef5-98d1-07ce59f31672 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:37.529973 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-c3033ae8-0b1c-4ef5-98d1-07ce59f31672 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095debf3968c448fb3c3add0322d8d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc9bed6d76834f6fa66d681ecd9f4e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:37.540595 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-c3033ae8-0b1c-4ef5-98d1-07ce59f31672 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] 10.222.0.26 "GET /compute/v2.1/servers/814f7da9-1d8d-4695-8cfa-6db50c3e846a" status: 200 len: 1520 microversion: 2.1 time: 0.204419 Oct 08 21:03:37.541842 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1449/2842] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:37 2022] GET /compute/v2.1/servers/814f7da9-1d8d-4695-8cfa-6db50c3e846a => generated 1520 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:37.547915 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-00e7317d-a9cb-4f6f-a577-a144fd04017f tempest-ImagesMetadataTestJSON-481984484 tempest-ImagesMetadataTestJSON-481984484-project] Calling method '.version_select at 0x7f1a87e5c5e0>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:37.668478 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-a1d82eec-56ff-4043-8aca-16d313b4b481 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:37.686815 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-a1d82eec-56ff-4043-8aca-16d313b4b481 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/6ef37448-690b-4fcf-85f8-a2fb71207f38" status: 200 len: 1313 microversion: 2.1 time: 0.408700 Oct 08 21:03:37.687620 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1394/2843] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:37 2022] GET /compute/v2.1/servers/6ef37448-690b-4fcf-85f8-a2fb71207f38 => generated 1313 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:37.702219 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-ab04813e-1226-4db8-ab8a-849ab389018f tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:37.702921 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-ab04813e-1226-4db8-ab8a-849ab389018f tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] [instance: 570d4898-169b-4f6b-aef6-ab79ea0fbefd] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:37.709856 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ab04813e-1226-4db8-ab8a-849ab389018f tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:37.710448 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ab04813e-1226-4db8-ab8a-849ab389018f tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:37.711183 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ab04813e-1226-4db8-ab8a-849ab389018f tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:37.712085 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ab04813e-1226-4db8-ab8a-849ab389018f tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:37.712678 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ab04813e-1226-4db8-ab8a-849ab389018f tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:37.713360 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ab04813e-1226-4db8-ab8a-849ab389018f tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:37.830059 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-00e7317d-a9cb-4f6f-a577-a144fd04017f tempest-ImagesMetadataTestJSON-481984484 tempest-ImagesMetadataTestJSON-481984484-project] 10.222.0.26 "DELETE /compute/v2.1/images/a85c77b2-02fa-45c5-95c3-474248d91892/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.286921 Oct 08 21:03:37.830655 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1450/2844] 10.222.0.26 () {58 vars in 1296 bytes} [Sat Oct 8 21:03:37 2022] DELETE /compute/v2.1/images/a85c77b2-02fa-45c5-95c3-474248d91892/metadata/os_version => generated 0 bytes in 288 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 21:03:37.838805 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-fe58d6c8-b73b-4db1-a91b-993f76faa093 tempest-ImagesMetadataTestJSON-481984484 tempest-ImagesMetadataTestJSON-481984484-project] Calling method '.version_select at 0x7f1a87e559d0>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:37.881720 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-fe58d6c8-b73b-4db1-a91b-993f76faa093 tempest-ImagesMetadataTestJSON-481984484 tempest-ImagesMetadataTestJSON-481984484-project] 10.222.0.26 "GET /compute/v2.1/images/a85c77b2-02fa-45c5-95c3-474248d91892/metadata" status: 200 len: 37 microversion: 2.1 time: 0.046463 Oct 08 21:03:37.885223 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1451/2845] 10.222.0.26 () {58 vars in 1260 bytes} [Sat Oct 8 21:03:37 2022] GET /compute/v2.1/images/a85c77b2-02fa-45c5-95c3-474248d91892/metadata => generated 37 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 08 21:03:37.893102 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-2f500512-7dea-48cf-ae38-2a93520fa414 tempest-ImagesMetadataTestJSON-481984484 tempest-ImagesMetadataTestJSON-481984484-project] Action: 'update_all', calling method: .version_select at 0x7f1a87e33f70>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:03:37.943242 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-2f500512-7dea-48cf-ae38-2a93520fa414 tempest-ImagesMetadataTestJSON-481984484 tempest-ImagesMetadataTestJSON-481984484-project] Getting quotas for project 413b42a72c864890b9373a0ff695c225. Resources: dict_keys(['metadata_items']) {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:03:37.949522 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-2f500512-7dea-48cf-ae38-2a93520fa414 tempest-ImagesMetadataTestJSON-481984484 tempest-ImagesMetadataTestJSON-481984484-project] Getting quotas for user 09d0d3c3f74a428098162e4f8df65fa4 and project 413b42a72c864890b9373a0ff695c225. Resources: dict_keys(['metadata_items']) {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:03:38.249844 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-2f500512-7dea-48cf-ae38-2a93520fa414 tempest-ImagesMetadataTestJSON-481984484 tempest-ImagesMetadataTestJSON-481984484-project] 10.222.0.26 "PUT /compute/v2.1/images/a85c77b2-02fa-45c5-95c3-474248d91892/metadata" status: 200 len: 61 microversion: 2.1 time: 0.360789 Oct 08 21:03:38.254992 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1452/2846] 10.222.0.26 () {60 vars in 1280 bytes} [Sat Oct 8 21:03:37 2022] PUT /compute/v2.1/images/a85c77b2-02fa-45c5-95c3-474248d91892/metadata => generated 61 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 08 21:03:38.257294 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-1c711d3a-d289-4f14-a2e2-be63fa01a36b tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:38.258034 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-1c711d3a-d289-4f14-a2e2-be63fa01a36b tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] [instance: ede2a1aa-f65b-424e-9034-15a2aaf13e60] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:38.264901 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1c711d3a-d289-4f14-a2e2-be63fa01a36b tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:38.265554 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1c711d3a-d289-4f14-a2e2-be63fa01a36b tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:38.265927 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-ab04813e-1226-4db8-ab8a-849ab389018f tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2e13f1952a4e5bb23d57dd7fa31875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b2a56286924e2d953bebe717ce591b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:38.266427 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1c711d3a-d289-4f14-a2e2-be63fa01a36b tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:38.267046 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1c711d3a-d289-4f14-a2e2-be63fa01a36b tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:38.267711 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1c711d3a-d289-4f14-a2e2-be63fa01a36b tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:38.268292 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1c711d3a-d289-4f14-a2e2-be63fa01a36b tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:38.277347 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-ab04813e-1226-4db8-ab8a-849ab389018f tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] 10.222.0.26 "GET /compute/v2.1/servers/570d4898-169b-4f6b-aef6-ab79ea0fbefd" status: 200 len: 1506 microversion: 2.1 time: 0.588214 Oct 08 21:03:38.292492 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1395/2847] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:37 2022] GET /compute/v2.1/servers/570d4898-169b-4f6b-aef6-ab79ea0fbefd => generated 1506 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:38.300661 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-b0eab982-98c3-47c6-887e-f2d98237e818 tempest-ImagesMetadataTestJSON-481984484 tempest-ImagesMetadataTestJSON-481984484-project] Calling method '.version_select at 0x7f1a87d8b310>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:38.354427 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-b0eab982-98c3-47c6-887e-f2d98237e818 tempest-ImagesMetadataTestJSON-481984484 tempest-ImagesMetadataTestJSON-481984484-project] 10.222.0.26 "GET /compute/v2.1/images/a85c77b2-02fa-45c5-95c3-474248d91892/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.060542 Oct 08 21:03:38.361366 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1396/2848] 10.222.0.26 () {58 vars in 1290 bytes} [Sat Oct 8 21:03:38 2022] GET /compute/v2.1/images/a85c77b2-02fa-45c5-95c3-474248d91892/metadata/os_distro => generated 33 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 08 21:03:38.367524 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-66e6bb05-a842-451c-8100-10d43c4fd2f0 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:38.368615 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-66e6bb05-a842-451c-8100-10d43c4fd2f0 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] [instance: 4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:38.376128 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-66e6bb05-a842-451c-8100-10d43c4fd2f0 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:38.377003 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-66e6bb05-a842-451c-8100-10d43c4fd2f0 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:38.377783 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-66e6bb05-a842-451c-8100-10d43c4fd2f0 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:38.379661 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-66e6bb05-a842-451c-8100-10d43c4fd2f0 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:38.380375 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-66e6bb05-a842-451c-8100-10d43c4fd2f0 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:38.381054 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-66e6bb05-a842-451c-8100-10d43c4fd2f0 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:38.537348 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-1c711d3a-d289-4f14-a2e2-be63fa01a36b tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f60e33f334465fac1148669de3f00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4735bf74f33a4739800d766c82d973d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:38.546939 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-1c711d3a-d289-4f14-a2e2-be63fa01a36b tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] 10.222.0.26 "GET /compute/v2.1/servers/ede2a1aa-f65b-424e-9034-15a2aaf13e60" status: 200 len: 1313 microversion: 2.1 time: 0.295045 Oct 08 21:03:38.564023 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1453/2849] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:38 2022] GET /compute/v2.1/servers/ede2a1aa-f65b-424e-9034-15a2aaf13e60 => generated 1313 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:38.569891 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-40708908-695b-42ed-9950-508280dd638f tempest-ImagesMetadataTestJSON-481984484 tempest-ImagesMetadataTestJSON-481984484-project] Action: 'update_all', calling method: .version_select at 0x7f1a87e33ee0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:03:38.634105 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:03:38.640094 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-40708908-695b-42ed-9950-508280dd638f tempest-ImagesMetadataTestJSON-481984484 tempest-ImagesMetadataTestJSON-481984484-project] Getting quotas for project 413b42a72c864890b9373a0ff695c225. Resources: dict_keys(['metadata_items']) {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:03:38.647704 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-40708908-695b-42ed-9950-508280dd638f tempest-ImagesMetadataTestJSON-481984484 tempest-ImagesMetadataTestJSON-481984484-project] Getting quotas for user 09d0d3c3f74a428098162e4f8df65fa4 and project 413b42a72c864890b9373a0ff695c225. Resources: dict_keys(['metadata_items']) {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:03:38.671338 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-66e6bb05-a842-451c-8100-10d43c4fd2f0 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1698dee4a2bf4ea19a6ee0c3d5cb5c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b00ee5e7828469f95bd90548d35982a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:38.683849 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-66e6bb05-a842-451c-8100-10d43c4fd2f0 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] 10.222.0.26 "GET /compute/v2.1/servers/4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711" status: 200 len: 1689 microversion: 2.1 time: 0.317966 Oct 08 21:03:38.684605 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1397/2850] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:38 2022] GET /compute/v2.1/servers/4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711 => generated 1689 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:38.722896 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-e16d1b21-c107-41db-b637-041db66ebb3e tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:38.723839 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-e16d1b21-c107-41db-b637-041db66ebb3e tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] [instance: 814f7da9-1d8d-4695-8cfa-6db50c3e846a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:38.739082 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e16d1b21-c107-41db-b637-041db66ebb3e tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:38.740617 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e16d1b21-c107-41db-b637-041db66ebb3e tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:38.741803 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e16d1b21-c107-41db-b637-041db66ebb3e tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:38.744579 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e16d1b21-c107-41db-b637-041db66ebb3e tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:38.746244 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e16d1b21-c107-41db-b637-041db66ebb3e tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:38.746917 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e16d1b21-c107-41db-b637-041db66ebb3e tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:38.891020 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-40708908-695b-42ed-9950-508280dd638f tempest-ImagesMetadataTestJSON-481984484 tempest-ImagesMetadataTestJSON-481984484-project] 10.222.0.26 "PUT /compute/v2.1/images/a85c77b2-02fa-45c5-95c3-474248d91892/metadata" status: 200 len: 61 microversion: 2.1 time: 0.325534 Oct 08 21:03:38.891731 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1454/2851] 10.222.0.26 () {60 vars in 1280 bytes} [Sat Oct 8 21:03:38 2022] PUT /compute/v2.1/images/a85c77b2-02fa-45c5-95c3-474248d91892/metadata => generated 61 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 08 21:03:38.898137 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-4bcef4a9-0296-4494-ade4-dadb7cfa05d5 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:38.901780 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-4bcef4a9-0296-4494-ade4-dadb7cfa05d5 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: 6ef37448-690b-4fcf-85f8-a2fb71207f38] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:38.919552 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4bcef4a9-0296-4494-ade4-dadb7cfa05d5 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:38.920407 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4bcef4a9-0296-4494-ade4-dadb7cfa05d5 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:38.922475 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4bcef4a9-0296-4494-ade4-dadb7cfa05d5 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:38.924305 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4bcef4a9-0296-4494-ade4-dadb7cfa05d5 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:38.925573 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4bcef4a9-0296-4494-ade4-dadb7cfa05d5 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:38.927683 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4bcef4a9-0296-4494-ade4-dadb7cfa05d5 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:39.076462 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-e16d1b21-c107-41db-b637-041db66ebb3e tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095debf3968c448fb3c3add0322d8d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc9bed6d76834f6fa66d681ecd9f4e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:39.085166 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-e16d1b21-c107-41db-b637-041db66ebb3e tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] 10.222.0.26 "GET /compute/v2.1/servers/814f7da9-1d8d-4695-8cfa-6db50c3e846a" status: 200 len: 1520 microversion: 2.1 time: 0.385652 Oct 08 21:03:39.086678 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1398/2852] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:38 2022] GET /compute/v2.1/servers/814f7da9-1d8d-4695-8cfa-6db50c3e846a => generated 1520 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:39.091508 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-d6ca6262-fa69-41ce-a976-efdd24879f54 tempest-ImagesMetadataTestJSON-481984484 tempest-ImagesMetadataTestJSON-481984484-project] Calling method '.version_select at 0x7f1a87d35e50>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:39.134550 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-d6ca6262-fa69-41ce-a976-efdd24879f54 tempest-ImagesMetadataTestJSON-481984484 tempest-ImagesMetadataTestJSON-481984484-project] 10.222.0.26 "GET /compute/v2.1/images/a85c77b2-02fa-45c5-95c3-474248d91892/metadata" status: 200 len: 61 microversion: 2.1 time: 0.046607 Oct 08 21:03:39.135388 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1399/2853] 10.222.0.26 () {58 vars in 1260 bytes} [Sat Oct 8 21:03:39 2022] GET /compute/v2.1/images/a85c77b2-02fa-45c5-95c3-474248d91892/metadata => generated 61 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 08 21:03:39.147081 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-5d07963d-554e-46cf-b6d1-48786cef82b3 tempest-ImagesMetadataTestJSON-481984484 tempest-ImagesMetadataTestJSON-481984484-project] Action: 'update_all', calling method: .version_select at 0x7f1a87d25700>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:03:39.225658 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-5d07963d-554e-46cf-b6d1-48786cef82b3 tempest-ImagesMetadataTestJSON-481984484 tempest-ImagesMetadataTestJSON-481984484-project] Getting quotas for project 413b42a72c864890b9373a0ff695c225. Resources: dict_keys(['metadata_items']) {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:03:39.231828 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-5d07963d-554e-46cf-b6d1-48786cef82b3 tempest-ImagesMetadataTestJSON-481984484 tempest-ImagesMetadataTestJSON-481984484-project] Getting quotas for user 09d0d3c3f74a428098162e4f8df65fa4 and project 413b42a72c864890b9373a0ff695c225. Resources: dict_keys(['metadata_items']) {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:03:39.272289 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-4bcef4a9-0296-4494-ade4-dadb7cfa05d5 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:39.283654 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-4bcef4a9-0296-4494-ade4-dadb7cfa05d5 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/6ef37448-690b-4fcf-85f8-a2fb71207f38" status: 200 len: 1462 microversion: 2.1 time: 0.390567 Oct 08 21:03:39.284255 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1455/2854] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:38 2022] GET /compute/v2.1/servers/6ef37448-690b-4fcf-85f8-a2fb71207f38 => generated 1462 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:39.304741 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-be5ed1ce-b16e-4d57-bf32-2489d90d27b2 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:39.305584 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-be5ed1ce-b16e-4d57-bf32-2489d90d27b2 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] [instance: 570d4898-169b-4f6b-aef6-ab79ea0fbefd] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:39.312567 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-be5ed1ce-b16e-4d57-bf32-2489d90d27b2 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:39.320791 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-be5ed1ce-b16e-4d57-bf32-2489d90d27b2 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:39.321669 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-be5ed1ce-b16e-4d57-bf32-2489d90d27b2 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:39.323218 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-be5ed1ce-b16e-4d57-bf32-2489d90d27b2 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:39.323869 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-be5ed1ce-b16e-4d57-bf32-2489d90d27b2 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:39.324599 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-be5ed1ce-b16e-4d57-bf32-2489d90d27b2 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:39.454066 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-5d07963d-554e-46cf-b6d1-48786cef82b3 tempest-ImagesMetadataTestJSON-481984484 tempest-ImagesMetadataTestJSON-481984484-project] 10.222.0.26 "PUT /compute/v2.1/images/a85c77b2-02fa-45c5-95c3-474248d91892/metadata" status: 200 len: 61 microversion: 2.1 time: 0.311426 Oct 08 21:03:39.455356 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1400/2855] 10.222.0.26 () {60 vars in 1280 bytes} [Sat Oct 8 21:03:39 2022] PUT /compute/v2.1/images/a85c77b2-02fa-45c5-95c3-474248d91892/metadata => generated 61 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 08 21:03:39.461435 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-834b0e06-54c0-4689-b7bf-4f3f2309f762 tempest-MigrationsAdminTest-1609748928 tempest-MigrationsAdminTest-1609748928-project-admin] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:39.462444 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-834b0e06-54c0-4689-b7bf-4f3f2309f762 tempest-MigrationsAdminTest-1609748928 tempest-MigrationsAdminTest-1609748928-project-admin] [instance: 6ef37448-690b-4fcf-85f8-a2fb71207f38] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:39.470117 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-834b0e06-54c0-4689-b7bf-4f3f2309f762 tempest-MigrationsAdminTest-1609748928 tempest-MigrationsAdminTest-1609748928-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:39.471341 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-834b0e06-54c0-4689-b7bf-4f3f2309f762 tempest-MigrationsAdminTest-1609748928 tempest-MigrationsAdminTest-1609748928-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:39.472015 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-834b0e06-54c0-4689-b7bf-4f3f2309f762 tempest-MigrationsAdminTest-1609748928 tempest-MigrationsAdminTest-1609748928-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:39.473701 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-834b0e06-54c0-4689-b7bf-4f3f2309f762 tempest-MigrationsAdminTest-1609748928 tempest-MigrationsAdminTest-1609748928-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:39.474416 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-834b0e06-54c0-4689-b7bf-4f3f2309f762 tempest-MigrationsAdminTest-1609748928 tempest-MigrationsAdminTest-1609748928-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:39.475220 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-834b0e06-54c0-4689-b7bf-4f3f2309f762 tempest-MigrationsAdminTest-1609748928 tempest-MigrationsAdminTest-1609748928-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:39.590039 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-be5ed1ce-b16e-4d57-bf32-2489d90d27b2 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2e13f1952a4e5bb23d57dd7fa31875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b2a56286924e2d953bebe717ce591b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:39.599441 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-be5ed1ce-b16e-4d57-bf32-2489d90d27b2 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] 10.222.0.26 "GET /compute/v2.1/servers/570d4898-169b-4f6b-aef6-ab79ea0fbefd" status: 200 len: 1506 microversion: 2.1 time: 0.299347 Oct 08 21:03:39.600044 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1456/2856] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:39 2022] GET /compute/v2.1/servers/570d4898-169b-4f6b-aef6-ab79ea0fbefd => generated 1506 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:03:39.621940 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-d4944da9-4d16-4dde-92cb-6c977377111e tempest-ImagesMetadataTestJSON-481984484 tempest-ImagesMetadataTestJSON-481984484-project] Action: 'update_all', calling method: .version_select at 0x7f1a8c0870d0>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:03:39.685054 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-d4944da9-4d16-4dde-92cb-6c977377111e tempest-ImagesMetadataTestJSON-481984484 tempest-ImagesMetadataTestJSON-481984484-project] Getting quotas for project 413b42a72c864890b9373a0ff695c225. Resources: dict_keys(['metadata_items']) {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:03:39.686181 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-834b0e06-54c0-4689-b7bf-4f3f2309f762 tempest-MigrationsAdminTest-1609748928 tempest-MigrationsAdminTest-1609748928-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/6ef37448-690b-4fcf-85f8-a2fb71207f38" status: 200 len: 1613 microversion: 2.1 time: 0.229153 Oct 08 21:03:39.687376 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1401/2857] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:39 2022] GET /compute/v2.1/servers/6ef37448-690b-4fcf-85f8-a2fb71207f38 => generated 1613 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:39.699599 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-8626a1f0-2f20-47b4-bf86-de2dbe00311d tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:39.702044 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-8626a1f0-2f20-47b4-bf86-de2dbe00311d tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] [instance: ede2a1aa-f65b-424e-9034-15a2aaf13e60] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:39.710639 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-d4944da9-4d16-4dde-92cb-6c977377111e tempest-ImagesMetadataTestJSON-481984484 tempest-ImagesMetadataTestJSON-481984484-project] Getting quotas for user 09d0d3c3f74a428098162e4f8df65fa4 and project 413b42a72c864890b9373a0ff695c225. Resources: dict_keys(['metadata_items']) {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:03:39.712095 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8626a1f0-2f20-47b4-bf86-de2dbe00311d tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:39.712892 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8626a1f0-2f20-47b4-bf86-de2dbe00311d tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:39.714090 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8626a1f0-2f20-47b4-bf86-de2dbe00311d tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:39.715062 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8626a1f0-2f20-47b4-bf86-de2dbe00311d tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:39.715751 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8626a1f0-2f20-47b4-bf86-de2dbe00311d tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:39.716812 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8626a1f0-2f20-47b4-bf86-de2dbe00311d tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:40.106239 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-8626a1f0-2f20-47b4-bf86-de2dbe00311d tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f60e33f334465fac1148669de3f00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4735bf74f33a4739800d766c82d973d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:40.124561 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-8626a1f0-2f20-47b4-bf86-de2dbe00311d tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] 10.222.0.26 "GET /compute/v2.1/servers/ede2a1aa-f65b-424e-9034-15a2aaf13e60" status: 200 len: 1334 microversion: 2.1 time: 0.434668 Oct 08 21:03:40.131468 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1402/2858] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:39 2022] GET /compute/v2.1/servers/ede2a1aa-f65b-424e-9034-15a2aaf13e60 => generated 1334 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:40.143967 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-2acbb7ed-1667-4cf1-bd72-968e8c20e377 tempest-MigrationsAdminTest-1609748928 tempest-MigrationsAdminTest-1609748928-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:03:40.147146 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-2acbb7ed-1667-4cf1-bd72-968e8c20e377 tempest-MigrationsAdminTest-1609748928 tempest-MigrationsAdminTest-1609748928-project-admin] [instance: 6ef37448-690b-4fcf-85f8-a2fb71207f38] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:40.166774 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2acbb7ed-1667-4cf1-bd72-968e8c20e377 tempest-MigrationsAdminTest-1609748928 tempest-MigrationsAdminTest-1609748928-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:40.167309 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2acbb7ed-1667-4cf1-bd72-968e8c20e377 tempest-MigrationsAdminTest-1609748928 tempest-MigrationsAdminTest-1609748928-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:40.168599 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2acbb7ed-1667-4cf1-bd72-968e8c20e377 tempest-MigrationsAdminTest-1609748928 tempest-MigrationsAdminTest-1609748928-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:40.169382 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2acbb7ed-1667-4cf1-bd72-968e8c20e377 tempest-MigrationsAdminTest-1609748928 tempest-MigrationsAdminTest-1609748928-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:40.172468 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2acbb7ed-1667-4cf1-bd72-968e8c20e377 tempest-MigrationsAdminTest-1609748928 tempest-MigrationsAdminTest-1609748928-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:40.174654 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2acbb7ed-1667-4cf1-bd72-968e8c20e377 tempest-MigrationsAdminTest-1609748928 tempest-MigrationsAdminTest-1609748928-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:40.341448 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-d4944da9-4d16-4dde-92cb-6c977377111e tempest-ImagesMetadataTestJSON-481984484 tempest-ImagesMetadataTestJSON-481984484-project] 10.222.0.26 "PUT /compute/v2.1/images/a85c77b2-02fa-45c5-95c3-474248d91892/metadata" status: 200 len: 64 microversion: 2.1 time: 0.717286 Oct 08 21:03:40.341448 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1457/2859] 10.222.0.26 () {60 vars in 1280 bytes} [Sat Oct 8 21:03:39 2022] PUT /compute/v2.1/images/a85c77b2-02fa-45c5-95c3-474248d91892/metadata => generated 64 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 08 21:03:40.341448 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-d6cb8a13-466e-43d8-898e-4c88bdfc259b tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:40.342431 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-d6cb8a13-466e-43d8-898e-4c88bdfc259b tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] [instance: 4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:40.362016 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d6cb8a13-466e-43d8-898e-4c88bdfc259b tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:40.362542 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d6cb8a13-466e-43d8-898e-4c88bdfc259b tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:40.363009 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d6cb8a13-466e-43d8-898e-4c88bdfc259b tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:40.364455 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d6cb8a13-466e-43d8-898e-4c88bdfc259b tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:40.364939 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d6cb8a13-466e-43d8-898e-4c88bdfc259b tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:40.365436 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d6cb8a13-466e-43d8-898e-4c88bdfc259b tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:40.670778 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-2acbb7ed-1667-4cf1-bd72-968e8c20e377 tempest-MigrationsAdminTest-1609748928 tempest-MigrationsAdminTest-1609748928-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '82eecd716629401493db6a979b7887cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cbd4579af204aa6b396906ca1430d3c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:40.672671 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-2acbb7ed-1667-4cf1-bd72-968e8c20e377 tempest-MigrationsAdminTest-1609748928 tempest-MigrationsAdminTest-1609748928-project-admin] [instance: 6ef37448-690b-4fcf-85f8-a2fb71207f38] flavor_id is None. Assuming migration. {{(pid=140491) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 08 21:03:40.673406 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-2acbb7ed-1667-4cf1-bd72-968e8c20e377 tempest-MigrationsAdminTest-1609748928 tempest-MigrationsAdminTest-1609748928-project-admin] [instance: 6ef37448-690b-4fcf-85f8-a2fb71207f38] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=140491) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 08 21:03:40.809619 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:03:40.829842 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-d6cb8a13-466e-43d8-898e-4c88bdfc259b tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1698dee4a2bf4ea19a6ee0c3d5cb5c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b00ee5e7828469f95bd90548d35982a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:40.845087 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-d6cb8a13-466e-43d8-898e-4c88bdfc259b tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] 10.222.0.26 "GET /compute/v2.1/servers/4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711" status: 200 len: 1689 microversion: 2.1 time: 0.510075 Oct 08 21:03:40.869745 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1458/2860] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:40 2022] GET /compute/v2.1/servers/4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711 => generated 1689 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:40.881016 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-d49b1256-4868-4923-8757-30d6c47b43a0 req-0e90cf03-f5a8-4d31-a64d-1f7865bcc064 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ede2a1aa-f65b-424e-9034-15a2aaf13e60", "tag": "d651f0cc-7f26-4fcd-8f94-fbd142dbaba0"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:03:40.909676 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-d49b1256-4868-4923-8757-30d6c47b43a0 req-0e90cf03-f5a8-4d31-a64d-1f7865bcc064 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:40.911143 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-d49b1256-4868-4923-8757-30d6c47b43a0 req-0e90cf03-f5a8-4d31-a64d-1f7865bcc064 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:40.911846 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-d49b1256-4868-4923-8757-30d6c47b43a0 req-0e90cf03-f5a8-4d31-a64d-1f7865bcc064 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:40.928032 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-d49b1256-4868-4923-8757-30d6c47b43a0 req-0e90cf03-f5a8-4d31-a64d-1f7865bcc064 service nova] Creating event network-changed:d651f0cc-7f26-4fcd-8f94-fbd142dbaba0 for instance ede2a1aa-f65b-424e-9034-15a2aaf13e60 on nch2-master-1 Oct 08 21:03:40.931427 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-2acbb7ed-1667-4cf1-bd72-968e8c20e377 tempest-MigrationsAdminTest-1609748928 tempest-MigrationsAdminTest-1609748928-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/6ef37448-690b-4fcf-85f8-a2fb71207f38/action" status: 202 len: 0 microversion: 2.1 time: 0.798274 Oct 08 21:03:40.936468 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1403/2861] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:03:40 2022] POST /compute/v2.1/servers/6ef37448-690b-4fcf-85f8-a2fb71207f38/action => generated 0 bytes in 804 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 21:03:40.942157 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-d49b1256-4868-4923-8757-30d6c47b43a0 req-0e90cf03-f5a8-4d31-a64d-1f7865bcc064 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070727 Oct 08 21:03:40.943588 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1459/2862] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:03:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:03:40.949899 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-6e611003-5972-453b-ac37-be962d21abbd tempest-ImagesMetadataTestJSON-481984484 tempest-ImagesMetadataTestJSON-481984484-project] Calling method '.version_select at 0x7f1a8c0259d0>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:40.970997 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-0fe0acbc-2dce-4ffd-a5b3-3f470676e41a tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:40.971642 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-0fe0acbc-2dce-4ffd-a5b3-3f470676e41a tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] [instance: 814f7da9-1d8d-4695-8cfa-6db50c3e846a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:41.004117 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0fe0acbc-2dce-4ffd-a5b3-3f470676e41a tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:41.005455 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0fe0acbc-2dce-4ffd-a5b3-3f470676e41a tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:41.006566 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0fe0acbc-2dce-4ffd-a5b3-3f470676e41a tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:41.007879 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0fe0acbc-2dce-4ffd-a5b3-3f470676e41a tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:41.008565 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0fe0acbc-2dce-4ffd-a5b3-3f470676e41a tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:41.009238 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0fe0acbc-2dce-4ffd-a5b3-3f470676e41a tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:41.027884 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-6e611003-5972-453b-ac37-be962d21abbd tempest-ImagesMetadataTestJSON-481984484 tempest-ImagesMetadataTestJSON-481984484-project] 10.222.0.26 "GET /compute/v2.1/images/a85c77b2-02fa-45c5-95c3-474248d91892/metadata" status: 200 len: 64 microversion: 2.1 time: 0.082814 Oct 08 21:03:41.028756 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1460/2863] 10.222.0.26 () {58 vars in 1260 bytes} [Sat Oct 8 21:03:40 2022] GET /compute/v2.1/images/a85c77b2-02fa-45c5-95c3-474248d91892/metadata => generated 64 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 08 21:03:41.040865 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-636703fe-4f33-4d5b-b2fe-f01ba7376e1e tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:41.041965 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-636703fe-4f33-4d5b-b2fe-f01ba7376e1e tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] [instance: 570d4898-169b-4f6b-aef6-ab79ea0fbefd] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:41.055370 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-636703fe-4f33-4d5b-b2fe-f01ba7376e1e tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:41.057300 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-636703fe-4f33-4d5b-b2fe-f01ba7376e1e tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:41.059024 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-636703fe-4f33-4d5b-b2fe-f01ba7376e1e tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:41.065427 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-636703fe-4f33-4d5b-b2fe-f01ba7376e1e tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:41.066306 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-636703fe-4f33-4d5b-b2fe-f01ba7376e1e tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:41.067541 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-636703fe-4f33-4d5b-b2fe-f01ba7376e1e tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:41.326177 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=20 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:03:41.529720 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-0fe0acbc-2dce-4ffd-a5b3-3f470676e41a tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095debf3968c448fb3c3add0322d8d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc9bed6d76834f6fa66d681ecd9f4e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:41.542531 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-0fe0acbc-2dce-4ffd-a5b3-3f470676e41a tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] 10.222.0.26 "GET /compute/v2.1/servers/814f7da9-1d8d-4695-8cfa-6db50c3e846a" status: 200 len: 1520 microversion: 2.1 time: 0.604866 Oct 08 21:03:41.543920 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1404/2864] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:40 2022] GET /compute/v2.1/servers/814f7da9-1d8d-4695-8cfa-6db50c3e846a => generated 1520 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:41.549425 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-ecf472c6-eb00-43cf-bd34-30c21a7d430c tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:41.552133 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-ecf472c6-eb00-43cf-bd34-30c21a7d430c tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: 6ef37448-690b-4fcf-85f8-a2fb71207f38] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:41.559522 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ecf472c6-eb00-43cf-bd34-30c21a7d430c tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:41.560304 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ecf472c6-eb00-43cf-bd34-30c21a7d430c tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:41.560940 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ecf472c6-eb00-43cf-bd34-30c21a7d430c tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:41.562090 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ecf472c6-eb00-43cf-bd34-30c21a7d430c tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:41.562720 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ecf472c6-eb00-43cf-bd34-30c21a7d430c tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:41.563315 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ecf472c6-eb00-43cf-bd34-30c21a7d430c tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:41.772249 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-636703fe-4f33-4d5b-b2fe-f01ba7376e1e tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2e13f1952a4e5bb23d57dd7fa31875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b2a56286924e2d953bebe717ce591b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:41.801405 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-636703fe-4f33-4d5b-b2fe-f01ba7376e1e tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] 10.222.0.26 "GET /compute/v2.1/servers/570d4898-169b-4f6b-aef6-ab79ea0fbefd" status: 200 len: 1506 microversion: 2.1 time: 0.769324 Oct 08 21:03:41.802887 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1461/2865] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:41 2022] GET /compute/v2.1/servers/570d4898-169b-4f6b-aef6-ab79ea0fbefd => generated 1506 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:41.827775 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-7337f43d-2d4f-4f37-8ea9-5346471dd67f tempest-ImagesMetadataTestJSON-481984484 tempest-ImagesMetadataTestJSON-481984484-project] Action: 'update_all', calling method: .version_select at 0x7f1a8c0258b0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:03:41.939296 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-ecf472c6-eb00-43cf-bd34-30c21a7d430c tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:41.957929 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-ecf472c6-eb00-43cf-bd34-30c21a7d430c tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/6ef37448-690b-4fcf-85f8-a2fb71207f38" status: 200 len: 1471 microversion: 2.1 time: 0.412703 Oct 08 21:03:41.961429 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1405/2866] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:41 2022] GET /compute/v2.1/servers/6ef37448-690b-4fcf-85f8-a2fb71207f38 => generated 1471 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:41.978154 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-3fbd6021-7287-46cf-a543-e17e9c8d0fb7 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:41.978827 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-3fbd6021-7287-46cf-a543-e17e9c8d0fb7 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] [instance: ede2a1aa-f65b-424e-9034-15a2aaf13e60] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:41.981045 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-7337f43d-2d4f-4f37-8ea9-5346471dd67f tempest-ImagesMetadataTestJSON-481984484 tempest-ImagesMetadataTestJSON-481984484-project] Getting quotas for project 413b42a72c864890b9373a0ff695c225. Resources: dict_keys(['metadata_items']) {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:03:41.987428 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3fbd6021-7287-46cf-a543-e17e9c8d0fb7 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:41.988202 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3fbd6021-7287-46cf-a543-e17e9c8d0fb7 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:41.989646 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3fbd6021-7287-46cf-a543-e17e9c8d0fb7 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:41.990652 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3fbd6021-7287-46cf-a543-e17e9c8d0fb7 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:41.991706 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3fbd6021-7287-46cf-a543-e17e9c8d0fb7 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:41.992516 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3fbd6021-7287-46cf-a543-e17e9c8d0fb7 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:42.012068 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-7337f43d-2d4f-4f37-8ea9-5346471dd67f tempest-ImagesMetadataTestJSON-481984484 tempest-ImagesMetadataTestJSON-481984484-project] Getting quotas for user 09d0d3c3f74a428098162e4f8df65fa4 and project 413b42a72c864890b9373a0ff695c225. Resources: dict_keys(['metadata_items']) {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:03:42.345318 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-3fbd6021-7287-46cf-a543-e17e9c8d0fb7 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f60e33f334465fac1148669de3f00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4735bf74f33a4739800d766c82d973d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:42.356911 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-3fbd6021-7287-46cf-a543-e17e9c8d0fb7 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] 10.222.0.26 "GET /compute/v2.1/servers/ede2a1aa-f65b-424e-9034-15a2aaf13e60" status: 200 len: 1334 microversion: 2.1 time: 0.394170 Oct 08 21:03:42.360305 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1406/2867] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:41 2022] GET /compute/v2.1/servers/ede2a1aa-f65b-424e-9034-15a2aaf13e60 => generated 1334 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:42.368419 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-500a7063-fd5b-4a87-abf4-8ee98ad1e19b tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2fb0d853-c668-4eb3-b56a-73cc4e960e16"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:03:42.378068 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-500a7063-fd5b-4a87-abf4-8ee98ad1e19b tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] [instance: 401433a8-84ff-4525-9a86-c0b6a517eeb3] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:42.388369 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-500a7063-fd5b-4a87-abf4-8ee98ad1e19b tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:42.389424 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-500a7063-fd5b-4a87-abf4-8ee98ad1e19b tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:42.390122 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-500a7063-fd5b-4a87-abf4-8ee98ad1e19b tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:42.391179 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-500a7063-fd5b-4a87-abf4-8ee98ad1e19b tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:42.392108 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-500a7063-fd5b-4a87-abf4-8ee98ad1e19b tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:42.392809 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-500a7063-fd5b-4a87-abf4-8ee98ad1e19b tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:42.534741 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-7337f43d-2d4f-4f37-8ea9-5346471dd67f tempest-ImagesMetadataTestJSON-481984484 tempest-ImagesMetadataTestJSON-481984484-project] 10.222.0.26 "PUT /compute/v2.1/images/a85c77b2-02fa-45c5-95c3-474248d91892/metadata" status: 200 len: 61 microversion: 2.1 time: 0.728970 Oct 08 21:03:42.536213 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1462/2868] 10.222.0.26 () {60 vars in 1280 bytes} [Sat Oct 8 21:03:41 2022] PUT /compute/v2.1/images/a85c77b2-02fa-45c5-95c3-474248d91892/metadata => generated 61 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 08 21:03:42.544998 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-193cf9f0-7160-4e20-be0b-a2c2a27d6fd0 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:42.545915 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-193cf9f0-7160-4e20-be0b-a2c2a27d6fd0 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] [instance: 4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:42.563557 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-193cf9f0-7160-4e20-be0b-a2c2a27d6fd0 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:42.565939 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-193cf9f0-7160-4e20-be0b-a2c2a27d6fd0 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:42.566937 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-193cf9f0-7160-4e20-be0b-a2c2a27d6fd0 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:42.570309 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-193cf9f0-7160-4e20-be0b-a2c2a27d6fd0 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:42.570812 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-193cf9f0-7160-4e20-be0b-a2c2a27d6fd0 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:42.573177 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-193cf9f0-7160-4e20-be0b-a2c2a27d6fd0 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:42.872177 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-500a7063-fd5b-4a87-abf4-8ee98ad1e19b tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] 10.222.0.26 "POST /compute/v2.1/servers/401433a8-84ff-4525-9a86-c0b6a517eeb3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.503485 Oct 08 21:03:42.873029 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1407/2869] 10.222.0.26 () {60 vars in 1323 bytes} [Sat Oct 8 21:03:42 2022] POST /compute/v2.1/servers/401433a8-84ff-4525-9a86-c0b6a517eeb3/os-volume_attachments => generated 194 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:03:42.975468 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-193cf9f0-7160-4e20-be0b-a2c2a27d6fd0 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1698dee4a2bf4ea19a6ee0c3d5cb5c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b00ee5e7828469f95bd90548d35982a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:42.993315 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-193cf9f0-7160-4e20-be0b-a2c2a27d6fd0 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] 10.222.0.26 "GET /compute/v2.1/servers/4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711" status: 200 len: 1622 microversion: 2.1 time: 0.454390 Oct 08 21:03:42.995288 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1463/2870] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:42 2022] GET /compute/v2.1/servers/4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711 => generated 1622 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:43.008202 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-3ef8c88f-16ea-453b-a4b5-f544288ecee7 tempest-ImagesMetadataTestJSON-481984484 tempest-ImagesMetadataTestJSON-481984484-project] Action: 'update', calling method: .version_select at 0x7f1a8c7789d0>, body: {"meta": {"os_version": "alt"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:03:43.125385 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-3ef8c88f-16ea-453b-a4b5-f544288ecee7 tempest-ImagesMetadataTestJSON-481984484 tempest-ImagesMetadataTestJSON-481984484-project] Getting quotas for project 413b42a72c864890b9373a0ff695c225. Resources: dict_keys(['metadata_items']) {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:03:43.135122 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-3ef8c88f-16ea-453b-a4b5-f544288ecee7 tempest-ImagesMetadataTestJSON-481984484 tempest-ImagesMetadataTestJSON-481984484-project] Getting quotas for user 09d0d3c3f74a428098162e4f8df65fa4 and project 413b42a72c864890b9373a0ff695c225. Resources: dict_keys(['metadata_items']) {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:03:43.289328 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-51dd6ec6-9452-442b-96bc-9e8f92a73dbc tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-49678015", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "networks": [{"uuid": "4ed0ebdc-5b0b-4c37-9306-ef8a7f034a7c"}]}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:03:43.450992 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.network.neutron [None req-51dd6ec6-9452-442b-96bc-9e8f92a73dbc tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] validate_networks() for [('4ed0ebdc-5b0b-4c37-9306-ef8a7f034a7c', None, None, None, None, None)] {{(pid=140491) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 21:03:43.809565 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-3ef8c88f-16ea-453b-a4b5-f544288ecee7 tempest-ImagesMetadataTestJSON-481984484 tempest-ImagesMetadataTestJSON-481984484-project] 10.222.0.26 "PUT /compute/v2.1/images/a85c77b2-02fa-45c5-95c3-474248d91892/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.812797 Oct 08 21:03:43.811366 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1464/2871] 10.222.0.26 () {60 vars in 1313 bytes} [Sat Oct 8 21:03:42 2022] PUT /compute/v2.1/images/a85c77b2-02fa-45c5-95c3-474248d91892/metadata/os_version => generated 31 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 08 21:03:43.824239 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-4a2255ad-6ddf-4328-b9c0-f05e9c897882 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:43.830195 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-4a2255ad-6ddf-4328-b9c0-f05e9c897882 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] [instance: 814f7da9-1d8d-4695-8cfa-6db50c3e846a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:43.845375 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4a2255ad-6ddf-4328-b9c0-f05e9c897882 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:43.846677 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4a2255ad-6ddf-4328-b9c0-f05e9c897882 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:43.847334 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4a2255ad-6ddf-4328-b9c0-f05e9c897882 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:43.849955 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4a2255ad-6ddf-4328-b9c0-f05e9c897882 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:43.850627 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4a2255ad-6ddf-4328-b9c0-f05e9c897882 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:43.852877 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4a2255ad-6ddf-4328-b9c0-f05e9c897882 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:43.945778 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:03:44.320888 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-4a2255ad-6ddf-4328-b9c0-f05e9c897882 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095debf3968c448fb3c3add0322d8d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc9bed6d76834f6fa66d681ecd9f4e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:44.343813 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-4a2255ad-6ddf-4328-b9c0-f05e9c897882 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] 10.222.0.26 "GET /compute/v2.1/servers/814f7da9-1d8d-4695-8cfa-6db50c3e846a" status: 200 len: 1520 microversion: 2.1 time: 0.531137 Oct 08 21:03:44.346129 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1465/2872] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:43 2022] GET /compute/v2.1/servers/814f7da9-1d8d-4695-8cfa-6db50c3e846a => generated 1520 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:44.355253 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-7e6b2305-667d-4d61-973f-1f3d7d618145 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:44.358410 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-7e6b2305-667d-4d61-973f-1f3d7d618145 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] [instance: 570d4898-169b-4f6b-aef6-ab79ea0fbefd] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:44.375638 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7e6b2305-667d-4d61-973f-1f3d7d618145 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:44.376611 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7e6b2305-667d-4d61-973f-1f3d7d618145 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:44.377431 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7e6b2305-667d-4d61-973f-1f3d7d618145 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:44.378476 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7e6b2305-667d-4d61-973f-1f3d7d618145 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:44.381477 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7e6b2305-667d-4d61-973f-1f3d7d618145 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:44.382672 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7e6b2305-667d-4d61-973f-1f3d7d618145 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:44.583000 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-7e6b2305-667d-4d61-973f-1f3d7d618145 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2e13f1952a4e5bb23d57dd7fa31875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b2a56286924e2d953bebe717ce591b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:44.592662 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-7e6b2305-667d-4d61-973f-1f3d7d618145 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] 10.222.0.26 "GET /compute/v2.1/servers/570d4898-169b-4f6b-aef6-ab79ea0fbefd" status: 200 len: 1486 microversion: 2.1 time: 0.241663 Oct 08 21:03:44.614007 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1466/2873] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:44 2022] GET /compute/v2.1/servers/570d4898-169b-4f6b-aef6-ab79ea0fbefd => generated 1486 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:44.621918 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-c96fbbbd-0e74-45d8-bc49-9a3def1b911b tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:44.626946 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-c96fbbbd-0e74-45d8-bc49-9a3def1b911b tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: 6ef37448-690b-4fcf-85f8-a2fb71207f38] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:44.642536 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c96fbbbd-0e74-45d8-bc49-9a3def1b911b tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:44.645823 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c96fbbbd-0e74-45d8-bc49-9a3def1b911b tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:44.647233 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c96fbbbd-0e74-45d8-bc49-9a3def1b911b tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:44.649059 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c96fbbbd-0e74-45d8-bc49-9a3def1b911b tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:44.652860 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c96fbbbd-0e74-45d8-bc49-9a3def1b911b tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:44.653856 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c96fbbbd-0e74-45d8-bc49-9a3def1b911b tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:44.813041 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-51dd6ec6-9452-442b-96bc-9e8f92a73dbc tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Flavor limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 21:03:44.813699 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-51dd6ec6-9452-442b-96bc-9e8f92a73dbc tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Image limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 21:03:44.813857 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-51dd6ec6-9452-442b-96bc-9e8f92a73dbc tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Flavor pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 21:03:44.814972 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-51dd6ec6-9452-442b-96bc-9e8f92a73dbc tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Image pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 21:03:44.815589 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-51dd6ec6-9452-442b-96bc-9e8f92a73dbc tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 21:03:44.836720 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-51dd6ec6-9452-442b-96bc-9e8f92a73dbc tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:44.839630 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-51dd6ec6-9452-442b-96bc-9e8f92a73dbc tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:44.840342 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-51dd6ec6-9452-442b-96bc-9e8f92a73dbc tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:44.841418 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-51dd6ec6-9452-442b-96bc-9e8f92a73dbc tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:44.841969 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-51dd6ec6-9452-442b-96bc-9e8f92a73dbc tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:44.842420 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-51dd6ec6-9452-442b-96bc-9e8f92a73dbc tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:44.883390 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-51dd6ec6-9452-442b-96bc-9e8f92a73dbc tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Getting quotas for project 8f455695c0214bfab0f412aa34417e34. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:03:44.890163 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-51dd6ec6-9452-442b-96bc-9e8f92a73dbc tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Getting quotas for user 9f2395fe934d458faa80e28587458bd2 and project 8f455695c0214bfab0f412aa34417e34. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:03:44.907512 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-51dd6ec6-9452-442b-96bc-9e8f92a73dbc tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Going to run 1 instances... {{(pid=140491) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 21:03:44.910550 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-51dd6ec6-9452-442b-96bc-9e8f92a73dbc tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] [instance: 4e392800-b237-4d1d-8372-e635e2450b91] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c508bd7f-7db9-4b2c-af7c-be54a855c355',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140491) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 21:03:44.931962 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-c96fbbbd-0e74-45d8-bc49-9a3def1b911b tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:44.944324 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-c96fbbbd-0e74-45d8-bc49-9a3def1b911b tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/6ef37448-690b-4fcf-85f8-a2fb71207f38" status: 200 len: 1471 microversion: 2.1 time: 0.327950 Oct 08 21:03:44.953354 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1467/2874] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:44 2022] GET /compute/v2.1/servers/6ef37448-690b-4fcf-85f8-a2fb71207f38 => generated 1471 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:44.961275 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-aec00458-5a2e-4e43-8046-a6674592c571 req-c4a5a70d-aa90-407a-a36b-45f0f3c36c9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ede2a1aa-f65b-424e-9034-15a2aaf13e60", "tag": "761d6383-28be-4b4b-87b9-3cd96e5126ce"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:03:44.983750 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-aec00458-5a2e-4e43-8046-a6674592c571 req-c4a5a70d-aa90-407a-a36b-45f0f3c36c9d service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:44.984499 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-aec00458-5a2e-4e43-8046-a6674592c571 req-c4a5a70d-aa90-407a-a36b-45f0f3c36c9d service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:44.984625 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-51dd6ec6-9452-442b-96bc-9e8f92a73dbc tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.109216 Oct 08 21:03:44.985308 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-aec00458-5a2e-4e43-8046-a6674592c571 req-c4a5a70d-aa90-407a-a36b-45f0f3c36c9d service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:44.985432 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1408/2875] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 21:03:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 2112 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 08 21:03:44.990291 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-5c52efb0-b9b7-46f0-bd97-ec562c53c99a tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:44.990976 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-5c52efb0-b9b7-46f0-bd97-ec562c53c99a tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] [instance: ede2a1aa-f65b-424e-9034-15a2aaf13e60] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:44.998276 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5c52efb0-b9b7-46f0-bd97-ec562c53c99a tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:44.998877 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5c52efb0-b9b7-46f0-bd97-ec562c53c99a tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:44.999397 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5c52efb0-b9b7-46f0-bd97-ec562c53c99a tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:45.000143 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5c52efb0-b9b7-46f0-bd97-ec562c53c99a tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:45.000720 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5c52efb0-b9b7-46f0-bd97-ec562c53c99a tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:45.001208 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5c52efb0-b9b7-46f0-bd97-ec562c53c99a tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:45.013601 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-aec00458-5a2e-4e43-8046-a6674592c571 req-c4a5a70d-aa90-407a-a36b-45f0f3c36c9d service nova] Creating event network-changed:761d6383-28be-4b4b-87b9-3cd96e5126ce for instance ede2a1aa-f65b-424e-9034-15a2aaf13e60 on nch2-master-1 Oct 08 21:03:45.018680 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-aec00458-5a2e-4e43-8046-a6674592c571 req-c4a5a70d-aa90-407a-a36b-45f0f3c36c9d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070162 Oct 08 21:03:45.019326 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1468/2876] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:03:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:03:45.027552 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-7f8836b6-29e9-4816-8e0f-b375c2ccf4d3 tempest-ImagesMetadataTestJSON-481984484 tempest-ImagesMetadataTestJSON-481984484-project] Calling method '.version_select at 0x7f1a87e5cf70>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:45.096357 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-7f8836b6-29e9-4816-8e0f-b375c2ccf4d3 tempest-ImagesMetadataTestJSON-481984484 tempest-ImagesMetadataTestJSON-481984484-project] 10.222.0.26 "GET /compute/v2.1/images/a85c77b2-02fa-45c5-95c3-474248d91892/metadata" status: 200 len: 58 microversion: 2.1 time: 0.074899 Oct 08 21:03:45.098045 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1469/2877] 10.222.0.26 () {58 vars in 1260 bytes} [Sat Oct 8 21:03:45 2022] GET /compute/v2.1/images/a85c77b2-02fa-45c5-95c3-474248d91892/metadata => generated 58 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 08 21:03:45.103153 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-9b8268e6-c73c-491d-85fc-22a59d7a7ff7 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:45.104264 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-9b8268e6-c73c-491d-85fc-22a59d7a7ff7 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] [instance: 4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:45.113625 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9b8268e6-c73c-491d-85fc-22a59d7a7ff7 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:45.114480 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9b8268e6-c73c-491d-85fc-22a59d7a7ff7 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:45.115591 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9b8268e6-c73c-491d-85fc-22a59d7a7ff7 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:45.116714 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9b8268e6-c73c-491d-85fc-22a59d7a7ff7 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:45.124493 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9b8268e6-c73c-491d-85fc-22a59d7a7ff7 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:45.125026 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9b8268e6-c73c-491d-85fc-22a59d7a7ff7 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:45.147153 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-9b8268e6-c73c-491d-85fc-22a59d7a7ff7 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] HTTP exception thrown: Instance 4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711 could not be found. Oct 08 21:03:45.149120 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-9b8268e6-c73c-491d-85fc-22a59d7a7ff7 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Request method failure captured: Oct 08 21:03:45.149120 ncdv-master-1 devstack@n-api.service[140492]: request: GET /compute/v2.1/servers/4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711 HTTP/1.1 Oct 08 21:03:45.149120 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:03:45.149120 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:03:45.149120 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:03:45.149120 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 21:03:45.149120 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:03:45.149120 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:03:45.149120 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:03:45.149120 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:03:45.149120 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeS0fE1W4PvU2_7k8u76nOm9Y1zh9DtzN6SifZox8c4Ee-O4iYj3CcpXLLEG93O-SwetyStVJsCOhK1z0DAluVdyejBt-R2ozc-SxCa3q7lzUNWL-Kx89hV0cNzOobKFM-EJsBUodFQ4EWnFtqD_Q-5HZD9KoD2jZ3YWHd3RuK5iGsY Oct 08 21:03:45.149120 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:03:45.149120 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:03:45.149120 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:03:45.149120 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:03:45.149120 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:03:45.149120 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:03:45.149120 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 8b00ee5e7828469f95bd90548d35982a Oct 08 21:03:45.149120 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1823882791 Oct 08 21:03:45.149120 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:03:45.149120 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:03:45.149120 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8b00ee5e7828469f95bd90548d35982a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8b00ee5e7828469f95bd90548d35982a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8b00ee5e7828469f95bd90548d35982a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8b00ee5e7828469f95bd90548d35982a"}]}] Oct 08 21:03:45.149120 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1823882791 Oct 08 21:03:45.149120 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 8b00ee5e7828469f95bd90548d35982a Oct 08 21:03:45.149120 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1823882791 Oct 08 21:03:45.149120 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-ServerRescueNegativeTestJSON-1823882791-project Oct 08 21:03:45.149120 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:03:45.149120 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:03:45.149120 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 1698dee4a2bf4ea19a6ee0c3d5cb5c09 Oct 08 21:03:45.149120 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1823882791-project Oct 08 21:03:45.149120 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 21:03:45.149120 ncdv-master-1 devstack@n-api.service[140492]: exception: Instance 4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711 could not be found. Oct 08 21:03:45.149120 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': '4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711'} Oct 08 21:03:45.149120 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:03:45.149120 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:03:45.149120 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:03:45.149120 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:03:45.149120 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:03:45.149120 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:03:45.149120 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:03:45.149120 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:03:45.149120 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:03:45.149120 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:03:45.149120 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711 could not be found. Oct 08 21:03:45.149120 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:03:45.149120 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:03:45.149120 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:03:45.149120 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:03:45.149120 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:03:45.149120 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:03:45.149120 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:03:45.149120 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:03:45.149120 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:03:45.149120 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:03:45.149120 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:03:45.149120 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:03:45.149120 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:03:45.149120 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:03:45.149120 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:03:45.149120 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:03:45.149120 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711 could not be found. Oct 08 21:03:45.149120 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:03:45.149120 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:03:45.153880 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:03:45.153880 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:03:45.153880 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:03:45.153880 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:03:45.153880 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:03:45.153880 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:03:45.153880 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711 could not be found. Oct 08 21:03:45.153880 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:03:45.155834 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-9b8268e6-c73c-491d-85fc-22a59d7a7ff7 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Returning 404 to user: Instance 4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711 could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:03:45.157628 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-9b8268e6-c73c-491d-85fc-22a59d7a7ff7 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] 10.222.0.26 "GET /compute/v2.1/servers/4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711" status: 404 len: 111 microversion: 2.1 time: 0.057881 Oct 08 21:03:45.158382 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1470/2878] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:45 2022] GET /compute/v2.1/servers/4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:03:45.183608 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-48892653-2265-4a12-bbf1-48906fd5fc88 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1070376266", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:03:45.212223 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-5c52efb0-b9b7-46f0-bd97-ec562c53c99a tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f60e33f334465fac1148669de3f00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4735bf74f33a4739800d766c82d973d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:45.223493 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-5c52efb0-b9b7-46f0-bd97-ec562c53c99a tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] 10.222.0.26 "GET /compute/v2.1/servers/ede2a1aa-f65b-424e-9034-15a2aaf13e60" status: 200 len: 1334 microversion: 2.1 time: 0.236382 Oct 08 21:03:45.224389 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1409/2879] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:44 2022] GET /compute/v2.1/servers/ede2a1aa-f65b-424e-9034-15a2aaf13e60 => generated 1334 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:45.231268 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-bd366198-a99e-4282-a2ad-4d5370cdc303 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:45.231886 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-bd366198-a99e-4282-a2ad-4d5370cdc303 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] [instance: 4e392800-b237-4d1d-8372-e635e2450b91] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:45.300282 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-bd366198-a99e-4282-a2ad-4d5370cdc303 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2395fe934d458faa80e28587458bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f455695c0214bfab0f412aa34417e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:45.301829 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.network.neutron [None req-48892653-2265-4a12-bbf1-48906fd5fc88 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] validate_networks() for [('cb0d6829-56c1-4723-b251-d2d657c0a658', None, None, None, None, None)] {{(pid=140492) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 21:03:45.311316 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-bd366198-a99e-4282-a2ad-4d5370cdc303 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] 10.222.0.26 "GET /compute/v2.1/servers/4e392800-b237-4d1d-8372-e635e2450b91" status: 200 len: 1214 microversion: 2.1 time: 0.083945 Oct 08 21:03:45.311920 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1410/2880] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:45 2022] GET /compute/v2.1/servers/4e392800-b237-4d1d-8372-e635e2450b91 => generated 1214 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:45.326584 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-f5cfc931-e7d8-4787-a0b0-e1d710f67473 tempest-ImagesMetadataTestJSON-481984484 tempest-ImagesMetadataTestJSON-481984484-project] Action: 'update_all', calling method: .version_select at 0x7f1a8c8018b0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:03:45.608133 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-f5cfc931-e7d8-4787-a0b0-e1d710f67473 tempest-ImagesMetadataTestJSON-481984484 tempest-ImagesMetadataTestJSON-481984484-project] Getting quotas for project 413b42a72c864890b9373a0ff695c225. Resources: dict_keys(['metadata_items']) {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:03:45.632300 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-f5cfc931-e7d8-4787-a0b0-e1d710f67473 tempest-ImagesMetadataTestJSON-481984484 tempest-ImagesMetadataTestJSON-481984484-project] Getting quotas for user 09d0d3c3f74a428098162e4f8df65fa4 and project 413b42a72c864890b9373a0ff695c225. Resources: dict_keys(['metadata_items']) {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:03:46.030744 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-f5cfc931-e7d8-4787-a0b0-e1d710f67473 tempest-ImagesMetadataTestJSON-481984484 tempest-ImagesMetadataTestJSON-481984484-project] 10.222.0.26 "PUT /compute/v2.1/images/a85c77b2-02fa-45c5-95c3-474248d91892/metadata" status: 200 len: 61 microversion: 2.1 time: 0.713936 Oct 08 21:03:46.032453 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1411/2881] 10.222.0.26 () {60 vars in 1280 bytes} [Sat Oct 8 21:03:45 2022] PUT /compute/v2.1/images/a85c77b2-02fa-45c5-95c3-474248d91892/metadata => generated 61 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 08 21:03:46.037737 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-f3e2c35b-d2bc-46a7-ae52-4da770a7cbfc tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Calling method '.version_select at 0x7f1a8c8d8940>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:46.088004 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-f3e2c35b-d2bc-46a7-ae52-4da770a7cbfc tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1186969454" status: 202 len: 0 microversion: 2.1 time: 0.053978 Oct 08 21:03:46.091868 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1412/2882] 10.222.0.26 () {58 vars in 1221 bytes} [Sat Oct 8 21:03:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1186969454 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 21:03:46.099999 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-eb1b745a-beb1-452f-93f0-e586218b2a54 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:46.106584 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-eb1b745a-beb1-452f-93f0-e586218b2a54 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] [instance: 814f7da9-1d8d-4695-8cfa-6db50c3e846a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:46.130817 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-eb1b745a-beb1-452f-93f0-e586218b2a54 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:46.131333 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-eb1b745a-beb1-452f-93f0-e586218b2a54 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:46.131787 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-eb1b745a-beb1-452f-93f0-e586218b2a54 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:46.132522 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-eb1b745a-beb1-452f-93f0-e586218b2a54 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:46.132989 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-eb1b745a-beb1-452f-93f0-e586218b2a54 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:46.133456 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-eb1b745a-beb1-452f-93f0-e586218b2a54 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:46.374040 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-eb1b745a-beb1-452f-93f0-e586218b2a54 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095debf3968c448fb3c3add0322d8d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc9bed6d76834f6fa66d681ecd9f4e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:46.383798 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-eb1b745a-beb1-452f-93f0-e586218b2a54 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] 10.222.0.26 "GET /compute/v2.1/servers/814f7da9-1d8d-4695-8cfa-6db50c3e846a" status: 200 len: 1520 microversion: 2.1 time: 0.290639 Oct 08 21:03:46.384656 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1413/2883] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:46 2022] GET /compute/v2.1/servers/814f7da9-1d8d-4695-8cfa-6db50c3e846a => generated 1520 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:46.391825 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-48892653-2265-4a12-bbf1-48906fd5fc88 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Flavor limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 21:03:46.392759 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-48892653-2265-4a12-bbf1-48906fd5fc88 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Image limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 21:03:46.393545 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-48892653-2265-4a12-bbf1-48906fd5fc88 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Flavor pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 21:03:46.394139 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-48892653-2265-4a12-bbf1-48906fd5fc88 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Image pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 21:03:46.395304 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-48892653-2265-4a12-bbf1-48906fd5fc88 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 21:03:46.402241 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-6e842d69-9e1a-423a-a997-f2368d6a7568 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:46.404214 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-6e842d69-9e1a-423a-a997-f2368d6a7568 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: 6ef37448-690b-4fcf-85f8-a2fb71207f38] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:46.410135 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-48892653-2265-4a12-bbf1-48906fd5fc88 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:46.410634 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-48892653-2265-4a12-bbf1-48906fd5fc88 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:46.411084 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-48892653-2265-4a12-bbf1-48906fd5fc88 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:46.411819 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-48892653-2265-4a12-bbf1-48906fd5fc88 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:46.412280 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-48892653-2265-4a12-bbf1-48906fd5fc88 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:46.412707 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-48892653-2265-4a12-bbf1-48906fd5fc88 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:46.417724 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6e842d69-9e1a-423a-a997-f2368d6a7568 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:46.419695 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6e842d69-9e1a-423a-a997-f2368d6a7568 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:46.420307 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6e842d69-9e1a-423a-a997-f2368d6a7568 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:46.425479 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6e842d69-9e1a-423a-a997-f2368d6a7568 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:46.426258 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6e842d69-9e1a-423a-a997-f2368d6a7568 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:46.426897 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6e842d69-9e1a-423a-a997-f2368d6a7568 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:46.458179 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-48892653-2265-4a12-bbf1-48906fd5fc88 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Getting quotas for project 75b2a56286924e2d953bebe717ce591b. Resources: {'cores', 'instances', 'ram'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:03:46.480081 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-48892653-2265-4a12-bbf1-48906fd5fc88 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Getting quotas for user bf2e13f1952a4e5bb23d57dd7fa31875 and project 75b2a56286924e2d953bebe717ce591b. Resources: {'cores', 'instances', 'ram'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:03:46.502096 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-48892653-2265-4a12-bbf1-48906fd5fc88 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Going to run 1 instances... {{(pid=140492) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 21:03:46.504922 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-48892653-2265-4a12-bbf1-48906fd5fc88 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] [instance: 136d0aa6-479d-4d9c-b633-23203ee44ae4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c508bd7f-7db9-4b2c-af7c-be54a855c355',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140492) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 21:03:46.579728 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-48892653-2265-4a12-bbf1-48906fd5fc88 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.419850 Oct 08 21:03:46.580688 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1471/2884] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 21:03:45 2022] POST /compute/v2.1/servers => generated 383 bytes in 1422 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 08 21:03:46.587914 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-1b3e3338-e5e2-49a7-949a-d32def069f76 tempest-ImagesMetadataTestJSON-481984484 tempest-ImagesMetadataTestJSON-481984484-project] Action: 'create', calling method: .version_select at 0x7f1a87e335e0>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:03:46.651784 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-1b3e3338-e5e2-49a7-949a-d32def069f76 tempest-ImagesMetadataTestJSON-481984484 tempest-ImagesMetadataTestJSON-481984484-project] Getting quotas for project 413b42a72c864890b9373a0ff695c225. Resources: dict_keys(['metadata_items']) {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:03:46.657342 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-1b3e3338-e5e2-49a7-949a-d32def069f76 tempest-ImagesMetadataTestJSON-481984484 tempest-ImagesMetadataTestJSON-481984484-project] Getting quotas for user 09d0d3c3f74a428098162e4f8df65fa4 and project 413b42a72c864890b9373a0ff695c225. Resources: dict_keys(['metadata_items']) {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:03:46.921787 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-6e842d69-9e1a-423a-a997-f2368d6a7568 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:46.933666 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-6e842d69-9e1a-423a-a997-f2368d6a7568 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/6ef37448-690b-4fcf-85f8-a2fb71207f38" status: 200 len: 1471 microversion: 2.1 time: 0.547703 Oct 08 21:03:46.934271 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1414/2885] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:46 2022] GET /compute/v2.1/servers/6ef37448-690b-4fcf-85f8-a2fb71207f38 => generated 1471 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:46.959494 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-e2be3832-fe3c-48c2-a403-b65dc4a6c858 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:46.966824 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-e2be3832-fe3c-48c2-a403-b65dc4a6c858 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] [instance: ede2a1aa-f65b-424e-9034-15a2aaf13e60] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:46.981781 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e2be3832-fe3c-48c2-a403-b65dc4a6c858 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:46.982286 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e2be3832-fe3c-48c2-a403-b65dc4a6c858 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:46.982732 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e2be3832-fe3c-48c2-a403-b65dc4a6c858 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:46.988109 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e2be3832-fe3c-48c2-a403-b65dc4a6c858 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:46.988850 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e2be3832-fe3c-48c2-a403-b65dc4a6c858 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:46.993224 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e2be3832-fe3c-48c2-a403-b65dc4a6c858 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:47.205366 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-1b3e3338-e5e2-49a7-949a-d32def069f76 tempest-ImagesMetadataTestJSON-481984484 tempest-ImagesMetadataTestJSON-481984484-project] 10.222.0.26 "POST /compute/v2.1/images/a85c77b2-02fa-45c5-95c3-474248d91892/metadata" status: 200 len: 85 microversion: 2.1 time: 0.623044 Oct 08 21:03:47.206114 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1472/2886] 10.222.0.26 () {60 vars in 1281 bytes} [Sat Oct 8 21:03:46 2022] POST /compute/v2.1/images/a85c77b2-02fa-45c5-95c3-474248d91892/metadata => generated 85 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 08 21:03:47.211934 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-ff3752c3-4495-49ba-bd43-f57c1308aa4a tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:47.212824 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-ff3752c3-4495-49ba-bd43-f57c1308aa4a tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] [instance: 4e392800-b237-4d1d-8372-e635e2450b91] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:47.221424 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ff3752c3-4495-49ba-bd43-f57c1308aa4a tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:47.222279 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ff3752c3-4495-49ba-bd43-f57c1308aa4a tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:47.223538 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ff3752c3-4495-49ba-bd43-f57c1308aa4a tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:47.224418 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ff3752c3-4495-49ba-bd43-f57c1308aa4a tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:47.225506 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ff3752c3-4495-49ba-bd43-f57c1308aa4a tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:47.226101 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ff3752c3-4495-49ba-bd43-f57c1308aa4a tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:47.316076 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-ff3752c3-4495-49ba-bd43-f57c1308aa4a tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2395fe934d458faa80e28587458bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f455695c0214bfab0f412aa34417e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:47.326608 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-ff3752c3-4495-49ba-bd43-f57c1308aa4a tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] 10.222.0.26 "GET /compute/v2.1/servers/4e392800-b237-4d1d-8372-e635e2450b91" status: 200 len: 1284 microversion: 2.1 time: 0.119111 Oct 08 21:03:47.327338 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1473/2887] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:47 2022] GET /compute/v2.1/servers/4e392800-b237-4d1d-8372-e635e2450b91 => generated 1284 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:47.332722 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-277cc6be-fbe5-4b27-b7a7-c5c0c3692bda tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:47.333618 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-277cc6be-fbe5-4b27-b7a7-c5c0c3692bda tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] [instance: 136d0aa6-479d-4d9c-b633-23203ee44ae4] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:47.414300 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-e2be3832-fe3c-48c2-a403-b65dc4a6c858 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f60e33f334465fac1148669de3f00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4735bf74f33a4739800d766c82d973d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:47.436662 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-277cc6be-fbe5-4b27-b7a7-c5c0c3692bda tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2e13f1952a4e5bb23d57dd7fa31875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b2a56286924e2d953bebe717ce591b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:47.438546 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-e2be3832-fe3c-48c2-a403-b65dc4a6c858 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] 10.222.0.26 "GET /compute/v2.1/servers/ede2a1aa-f65b-424e-9034-15a2aaf13e60" status: 200 len: 1334 microversion: 2.1 time: 0.503206 Oct 08 21:03:47.447220 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-277cc6be-fbe5-4b27-b7a7-c5c0c3692bda tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] 10.222.0.26 "GET /compute/v2.1/servers/136d0aa6-479d-4d9c-b633-23203ee44ae4" status: 200 len: 1214 microversion: 2.1 time: 0.118757 Oct 08 21:03:47.453668 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1415/2888] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:46 2022] GET /compute/v2.1/servers/ede2a1aa-f65b-424e-9034-15a2aaf13e60 => generated 1334 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:47.460874 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1474/2889] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:47 2022] GET /compute/v2.1/servers/136d0aa6-479d-4d9c-b633-23203ee44ae4 => generated 1214 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:47.464876 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-5dd4e012-5b92-4123-99ec-a28203c4ac76 req-47198ba9-dac9-4aca-8f22-324528eac517 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711", "name": "network-vif-deleted", "tag": "946a04d7-8297-4f58-81d9-eda02ade611b"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:03:47.470373 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-02c2ba2c-3396-4829-91f1-ccf7dec23126 tempest-ImagesMetadataTestJSON-481984484 tempest-ImagesMetadataTestJSON-481984484-project] Calling method '.version_select at 0x7f1a8c025310>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:47.489517 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-5dd4e012-5b92-4123-99ec-a28203c4ac76 req-47198ba9-dac9-4aca-8f22-324528eac517 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:47.490413 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-5dd4e012-5b92-4123-99ec-a28203c4ac76 req-47198ba9-dac9-4aca-8f22-324528eac517 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:47.491349 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-5dd4e012-5b92-4123-99ec-a28203c4ac76 req-47198ba9-dac9-4aca-8f22-324528eac517 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:47.511304 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-5dd4e012-5b92-4123-99ec-a28203c4ac76 req-47198ba9-dac9-4aca-8f22-324528eac517 service nova] Creating event network-vif-deleted:946a04d7-8297-4f58-81d9-eda02ade611b for instance 4e3f1d56-12f4-46e5-bfb3-8ed0f6f79711 on nch1-master-1 Oct 08 21:03:47.517951 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-5dd4e012-5b92-4123-99ec-a28203c4ac76 req-47198ba9-dac9-4aca-8f22-324528eac517 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062512 Oct 08 21:03:47.520257 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1416/2890] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:03:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:03:47.526979 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-8b957355-1e54-48f2-818d-b78287a54f76 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:47.527752 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-8b957355-1e54-48f2-818d-b78287a54f76 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] [instance: 814f7da9-1d8d-4695-8cfa-6db50c3e846a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:47.555841 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8b957355-1e54-48f2-818d-b78287a54f76 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:47.561866 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8b957355-1e54-48f2-818d-b78287a54f76 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:47.562604 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8b957355-1e54-48f2-818d-b78287a54f76 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:47.563718 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8b957355-1e54-48f2-818d-b78287a54f76 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:47.564380 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8b957355-1e54-48f2-818d-b78287a54f76 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:47.568354 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-02c2ba2c-3396-4829-91f1-ccf7dec23126 tempest-ImagesMetadataTestJSON-481984484 tempest-ImagesMetadataTestJSON-481984484-project] 10.222.0.26 "GET /compute/v2.1/images/a85c77b2-02fa-45c5-95c3-474248d91892/metadata" status: 200 len: 85 microversion: 2.1 time: 0.105529 Oct 08 21:03:47.569961 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1475/2891] 10.222.0.26 () {58 vars in 1260 bytes} [Sat Oct 8 21:03:47 2022] GET /compute/v2.1/images/a85c77b2-02fa-45c5-95c3-474248d91892/metadata => generated 85 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 08 21:03:47.574616 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8b957355-1e54-48f2-818d-b78287a54f76 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:47.793245 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-3b48d9d2-477a-4046-8d8c-8f28377d5c3c tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:47.796895 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-3b48d9d2-477a-4046-8d8c-8f28377d5c3c tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] [instance: 401433a8-84ff-4525-9a86-c0b6a517eeb3] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:47.805912 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3b48d9d2-477a-4046-8d8c-8f28377d5c3c tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:47.806939 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3b48d9d2-477a-4046-8d8c-8f28377d5c3c tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:47.807972 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3b48d9d2-477a-4046-8d8c-8f28377d5c3c tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:47.808803 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3b48d9d2-477a-4046-8d8c-8f28377d5c3c tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:47.809427 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3b48d9d2-477a-4046-8d8c-8f28377d5c3c tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:47.810310 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3b48d9d2-477a-4046-8d8c-8f28377d5c3c tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:47.850278 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-3b48d9d2-477a-4046-8d8c-8f28377d5c3c tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] 10.222.0.26 "GET /compute/v2.1/servers/401433a8-84ff-4525-9a86-c0b6a517eeb3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063256 Oct 08 21:03:47.858641 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1476/2892] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Oct 8 21:03:47 2022] GET /compute/v2.1/servers/401433a8-84ff-4525-9a86-c0b6a517eeb3/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 08 21:03:47.866607 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-d70ed0b9-a8c3-4c84-9b8f-d49075c1b441 tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:47.867553 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-d70ed0b9-a8c3-4c84-9b8f-d49075c1b441 tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] [instance: 401433a8-84ff-4525-9a86-c0b6a517eeb3] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:47.874973 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d70ed0b9-a8c3-4c84-9b8f-d49075c1b441 tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:47.876895 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d70ed0b9-a8c3-4c84-9b8f-d49075c1b441 tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:47.876895 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d70ed0b9-a8c3-4c84-9b8f-d49075c1b441 tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:47.878195 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d70ed0b9-a8c3-4c84-9b8f-d49075c1b441 tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:47.879481 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d70ed0b9-a8c3-4c84-9b8f-d49075c1b441 tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:47.880227 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d70ed0b9-a8c3-4c84-9b8f-d49075c1b441 tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:48.047115 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.objects.instance [None req-d70ed0b9-a8c3-4c84-9b8f-d49075c1b441 tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Lazy-loading 'services' on Instance uuid 401433a8-84ff-4525-9a86-c0b6a517eeb3 {{(pid=140492) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 21:03:48.215551 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-8b957355-1e54-48f2-818d-b78287a54f76 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095debf3968c448fb3c3add0322d8d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc9bed6d76834f6fa66d681ecd9f4e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:48.227990 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-8b957355-1e54-48f2-818d-b78287a54f76 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] 10.222.0.26 "GET /compute/v2.1/servers/814f7da9-1d8d-4695-8cfa-6db50c3e846a" status: 200 len: 1520 microversion: 2.1 time: 0.705582 Oct 08 21:03:48.230672 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1417/2893] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:47 2022] GET /compute/v2.1/servers/814f7da9-1d8d-4695-8cfa-6db50c3e846a => generated 1520 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:48.242240 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-54019e8e-e010-448d-939b-a80d5987b45a tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:48.243278 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-54019e8e-e010-448d-939b-a80d5987b45a tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: 6ef37448-690b-4fcf-85f8-a2fb71207f38] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:48.251815 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-54019e8e-e010-448d-939b-a80d5987b45a tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:48.252662 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-54019e8e-e010-448d-939b-a80d5987b45a tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:48.253002 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-d70ed0b9-a8c3-4c84-9b8f-d49075c1b441 tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] 10.222.0.26 "DELETE /compute/v2.1/servers/401433a8-84ff-4525-9a86-c0b6a517eeb3/os-volume_attachments/2fb0d853-c668-4eb3-b56a-73cc4e960e16" status: 202 len: 0 microversion: 2.1 time: 0.391797 Oct 08 21:03:48.253496 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-54019e8e-e010-448d-939b-a80d5987b45a tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:48.254628 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1477/2894] 10.222.0.26 () {58 vars in 1416 bytes} [Sat Oct 8 21:03:47 2022] DELETE /compute/v2.1/servers/401433a8-84ff-4525-9a86-c0b6a517eeb3/os-volume_attachments/2fb0d853-c668-4eb3-b56a-73cc4e960e16 => generated 0 bytes in 395 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 21:03:48.259208 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-54019e8e-e010-448d-939b-a80d5987b45a tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:48.260152 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-54019e8e-e010-448d-939b-a80d5987b45a tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:48.260739 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-54019e8e-e010-448d-939b-a80d5987b45a tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:48.351860 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-539de78d-e94a-4ad5-9849-7ad7ceb60951 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:48.352592 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-539de78d-e94a-4ad5-9849-7ad7ceb60951 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] [instance: 4e392800-b237-4d1d-8372-e635e2450b91] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:48.396844 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-539de78d-e94a-4ad5-9849-7ad7ceb60951 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:48.397466 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-539de78d-e94a-4ad5-9849-7ad7ceb60951 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:48.403013 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-539de78d-e94a-4ad5-9849-7ad7ceb60951 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:48.403902 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-539de78d-e94a-4ad5-9849-7ad7ceb60951 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:48.404432 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-539de78d-e94a-4ad5-9849-7ad7ceb60951 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:48.404940 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-539de78d-e94a-4ad5-9849-7ad7ceb60951 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:48.552626 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-539de78d-e94a-4ad5-9849-7ad7ceb60951 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2395fe934d458faa80e28587458bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f455695c0214bfab0f412aa34417e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:48.563485 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-539de78d-e94a-4ad5-9849-7ad7ceb60951 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] 10.222.0.26 "GET /compute/v2.1/servers/4e392800-b237-4d1d-8372-e635e2450b91" status: 200 len: 1272 microversion: 2.1 time: 0.217856 Oct 08 21:03:48.564091 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1478/2895] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:48 2022] GET /compute/v2.1/servers/4e392800-b237-4d1d-8372-e635e2450b91 => generated 1272 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:03:48.584048 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-ef737c2d-75f0-4f70-aabe-a2ed201b0eda tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:48.584999 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-ef737c2d-75f0-4f70-aabe-a2ed201b0eda tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] [instance: ede2a1aa-f65b-424e-9034-15a2aaf13e60] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:48.598992 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ef737c2d-75f0-4f70-aabe-a2ed201b0eda tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:48.601041 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ef737c2d-75f0-4f70-aabe-a2ed201b0eda tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:48.601820 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ef737c2d-75f0-4f70-aabe-a2ed201b0eda tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:48.602577 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ef737c2d-75f0-4f70-aabe-a2ed201b0eda tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:48.603028 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ef737c2d-75f0-4f70-aabe-a2ed201b0eda tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:48.603478 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ef737c2d-75f0-4f70-aabe-a2ed201b0eda tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:48.759462 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-54019e8e-e010-448d-939b-a80d5987b45a tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:48.780623 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-54019e8e-e010-448d-939b-a80d5987b45a tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/6ef37448-690b-4fcf-85f8-a2fb71207f38" status: 200 len: 1476 microversion: 2.1 time: 0.546540 Oct 08 21:03:48.800220 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1418/2896] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:48 2022] GET /compute/v2.1/servers/6ef37448-690b-4fcf-85f8-a2fb71207f38 => generated 1476 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:48.807260 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-ec5641ab-8a69-47ac-ad8a-546f4274ef0d tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:48.808204 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-ec5641ab-8a69-47ac-ad8a-546f4274ef0d tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] [instance: 136d0aa6-479d-4d9c-b633-23203ee44ae4] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:48.817741 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ec5641ab-8a69-47ac-ad8a-546f4274ef0d tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:48.818389 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ec5641ab-8a69-47ac-ad8a-546f4274ef0d tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:48.818951 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ec5641ab-8a69-47ac-ad8a-546f4274ef0d tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:48.819928 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ec5641ab-8a69-47ac-ad8a-546f4274ef0d tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:48.820622 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ec5641ab-8a69-47ac-ad8a-546f4274ef0d tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:48.821164 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ec5641ab-8a69-47ac-ad8a-546f4274ef0d tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:48.835113 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-ef737c2d-75f0-4f70-aabe-a2ed201b0eda tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f60e33f334465fac1148669de3f00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4735bf74f33a4739800d766c82d973d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:48.850808 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-ef737c2d-75f0-4f70-aabe-a2ed201b0eda tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] 10.222.0.26 "GET /compute/v2.1/servers/ede2a1aa-f65b-424e-9034-15a2aaf13e60" status: 200 len: 1334 microversion: 2.1 time: 0.279241 Oct 08 21:03:48.851973 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1479/2897] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:48 2022] GET /compute/v2.1/servers/ede2a1aa-f65b-424e-9034-15a2aaf13e60 => generated 1334 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:48.942118 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-ec5641ab-8a69-47ac-ad8a-546f4274ef0d tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2e13f1952a4e5bb23d57dd7fa31875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b2a56286924e2d953bebe717ce591b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:48.958862 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-ec5641ab-8a69-47ac-ad8a-546f4274ef0d tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] 10.222.0.26 "GET /compute/v2.1/servers/136d0aa6-479d-4d9c-b633-23203ee44ae4" status: 200 len: 1266 microversion: 2.1 time: 0.154075 Oct 08 21:03:48.970315 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1419/2898] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:48 2022] GET /compute/v2.1/servers/136d0aa6-479d-4d9c-b633-23203ee44ae4 => generated 1266 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:49.255832 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-d921b4b6-bf7d-49b0-9a52-6f0921ae52e1 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:49.256545 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-d921b4b6-bf7d-49b0-9a52-6f0921ae52e1 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] [instance: 814f7da9-1d8d-4695-8cfa-6db50c3e846a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:49.270014 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d921b4b6-bf7d-49b0-9a52-6f0921ae52e1 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:49.270530 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d921b4b6-bf7d-49b0-9a52-6f0921ae52e1 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:49.270988 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d921b4b6-bf7d-49b0-9a52-6f0921ae52e1 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:49.271735 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d921b4b6-bf7d-49b0-9a52-6f0921ae52e1 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:49.272207 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d921b4b6-bf7d-49b0-9a52-6f0921ae52e1 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:49.272663 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d921b4b6-bf7d-49b0-9a52-6f0921ae52e1 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:49.588720 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-3219813a-f2b3-4377-92c7-09c1e311af0e tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:49.589337 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-3219813a-f2b3-4377-92c7-09c1e311af0e tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] [instance: 4e392800-b237-4d1d-8372-e635e2450b91] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:49.596524 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3219813a-f2b3-4377-92c7-09c1e311af0e tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:49.597029 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3219813a-f2b3-4377-92c7-09c1e311af0e tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:49.605270 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3219813a-f2b3-4377-92c7-09c1e311af0e tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:49.606952 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3219813a-f2b3-4377-92c7-09c1e311af0e tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:49.607643 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3219813a-f2b3-4377-92c7-09c1e311af0e tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:49.608270 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3219813a-f2b3-4377-92c7-09c1e311af0e tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:49.688756 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-d921b4b6-bf7d-49b0-9a52-6f0921ae52e1 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095debf3968c448fb3c3add0322d8d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc9bed6d76834f6fa66d681ecd9f4e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:49.716791 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-d921b4b6-bf7d-49b0-9a52-6f0921ae52e1 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] 10.222.0.26 "GET /compute/v2.1/servers/814f7da9-1d8d-4695-8cfa-6db50c3e846a" status: 200 len: 1497 microversion: 2.1 time: 0.465636 Oct 08 21:03:49.718164 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1480/2899] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:49 2022] GET /compute/v2.1/servers/814f7da9-1d8d-4695-8cfa-6db50c3e846a => generated 1497 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:49.743237 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-f88123ef-e94b-4516-b1d4-7900024093a1 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:49.762260 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-f88123ef-e94b-4516-b1d4-7900024093a1 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '095debf3968c448fb3c3add0322d8d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc9bed6d76834f6fa66d681ecd9f4e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:49.763144 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-f88123ef-e94b-4516-b1d4-7900024093a1 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': 'bc9bed6d76834f6fa66d681ecd9f4e90'} {{(pid=140492) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 08 21:03:49.778114 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f88123ef-e94b-4516-b1d4-7900024093a1 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:49.778332 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f88123ef-e94b-4516-b1d4-7900024093a1 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:49.786211 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f88123ef-e94b-4516-b1d4-7900024093a1 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:49.787195 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f88123ef-e94b-4516-b1d4-7900024093a1 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:49.787692 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f88123ef-e94b-4516-b1d4-7900024093a1 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:49.788137 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f88123ef-e94b-4516-b1d4-7900024093a1 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:49.847256 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.multi_cell_list [None req-f88123ef-e94b-4516-b1d4-7900024093a1 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=140492) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 08 21:03:49.915672 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-f88123ef-e94b-4516-b1d4-7900024093a1 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] 10.222.0.26 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 345 microversion: 2.1 time: 0.175955 Oct 08 21:03:49.920869 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1481/2900] 10.222.0.26 () {58 vars in 1154 bytes} [Sat Oct 8 21:03:49 2022] GET /compute/v2.1/servers?status=shutoff => generated 345 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:03:49.926554 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-828f6699-c530-493b-ab5f-153f472dd949 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:49.927184 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-828f6699-c530-493b-ab5f-153f472dd949 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: 6ef37448-690b-4fcf-85f8-a2fb71207f38] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:49.933426 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-828f6699-c530-493b-ab5f-153f472dd949 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:49.933935 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-828f6699-c530-493b-ab5f-153f472dd949 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:49.934387 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-828f6699-c530-493b-ab5f-153f472dd949 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:49.935120 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-828f6699-c530-493b-ab5f-153f472dd949 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:49.935720 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-828f6699-c530-493b-ab5f-153f472dd949 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:49.936303 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-828f6699-c530-493b-ab5f-153f472dd949 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:50.031425 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-3219813a-f2b3-4377-92c7-09c1e311af0e tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2395fe934d458faa80e28587458bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f455695c0214bfab0f412aa34417e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:50.045957 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-3219813a-f2b3-4377-92c7-09c1e311af0e tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] 10.222.0.26 "GET /compute/v2.1/servers/4e392800-b237-4d1d-8372-e635e2450b91" status: 200 len: 1314 microversion: 2.1 time: 0.456986 Oct 08 21:03:50.049175 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1420/2901] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:49 2022] GET /compute/v2.1/servers/4e392800-b237-4d1d-8372-e635e2450b91 => generated 1314 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:03:50.054423 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-998b5500-31ec-43c7-93c2-e5f0c7aed3b0 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:50.055055 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-998b5500-31ec-43c7-93c2-e5f0c7aed3b0 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] [instance: ede2a1aa-f65b-424e-9034-15a2aaf13e60] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:50.084376 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-998b5500-31ec-43c7-93c2-e5f0c7aed3b0 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:50.085329 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-998b5500-31ec-43c7-93c2-e5f0c7aed3b0 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:50.085964 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-998b5500-31ec-43c7-93c2-e5f0c7aed3b0 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:50.086883 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-998b5500-31ec-43c7-93c2-e5f0c7aed3b0 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:50.087563 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-998b5500-31ec-43c7-93c2-e5f0c7aed3b0 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:50.088174 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-998b5500-31ec-43c7-93c2-e5f0c7aed3b0 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:50.154197 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-828f6699-c530-493b-ab5f-153f472dd949 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:50.164446 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-828f6699-c530-493b-ab5f-153f472dd949 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/6ef37448-690b-4fcf-85f8-a2fb71207f38" status: 200 len: 1476 microversion: 2.1 time: 0.242518 Oct 08 21:03:50.165052 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1482/2902] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:49 2022] GET /compute/v2.1/servers/6ef37448-690b-4fcf-85f8-a2fb71207f38 => generated 1476 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:50.172144 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-5b986295-8729-4474-b2f6-8ceb75718c5d tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:03:50.179302 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5b986295-8729-4474-b2f6-8ceb75718c5d tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:50.180127 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5b986295-8729-4474-b2f6-8ceb75718c5d tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:50.183669 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5b986295-8729-4474-b2f6-8ceb75718c5d tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:50.283872 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-5b986295-8729-4474-b2f6-8ceb75718c5d tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] [instance: 814f7da9-1d8d-4695-8cfa-6db50c3e846a] Going to try to start instance {{(pid=140492) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 08 21:03:50.340047 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-5b986295-8729-4474-b2f6-8ceb75718c5d tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] 10.222.0.26 "POST /compute/v2.1/servers/814f7da9-1d8d-4695-8cfa-6db50c3e846a/action" status: 202 len: 0 microversion: 2.1 time: 0.169777 Oct 08 21:03:50.350574 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1483/2903] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:03:50 2022] POST /compute/v2.1/servers/814f7da9-1d8d-4695-8cfa-6db50c3e846a/action => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 21:03:50.358041 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-c7daa121-7967-43df-aa96-1a44aef7def5 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:50.359315 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-c7daa121-7967-43df-aa96-1a44aef7def5 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] [instance: 136d0aa6-479d-4d9c-b633-23203ee44ae4] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:50.371069 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:03:50.373657 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c7daa121-7967-43df-aa96-1a44aef7def5 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:50.376693 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c7daa121-7967-43df-aa96-1a44aef7def5 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:50.383333 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c7daa121-7967-43df-aa96-1a44aef7def5 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:50.386484 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c7daa121-7967-43df-aa96-1a44aef7def5 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:50.387315 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c7daa121-7967-43df-aa96-1a44aef7def5 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:50.389937 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c7daa121-7967-43df-aa96-1a44aef7def5 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:50.435004 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-998b5500-31ec-43c7-93c2-e5f0c7aed3b0 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f60e33f334465fac1148669de3f00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4735bf74f33a4739800d766c82d973d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:50.450326 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-998b5500-31ec-43c7-93c2-e5f0c7aed3b0 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] 10.222.0.26 "GET /compute/v2.1/servers/ede2a1aa-f65b-424e-9034-15a2aaf13e60" status: 200 len: 1334 microversion: 2.1 time: 0.399350 Oct 08 21:03:50.464935 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1421/2904] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:50 2022] GET /compute/v2.1/servers/ede2a1aa-f65b-424e-9034-15a2aaf13e60 => generated 1334 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:50.484427 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-27d7e587-aa83-466f-bd55-2bc8806afe75 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:50.485089 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-27d7e587-aa83-466f-bd55-2bc8806afe75 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] [instance: 814f7da9-1d8d-4695-8cfa-6db50c3e846a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:50.500901 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:03:50.502713 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-27d7e587-aa83-466f-bd55-2bc8806afe75 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:50.503704 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-27d7e587-aa83-466f-bd55-2bc8806afe75 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:50.505508 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-27d7e587-aa83-466f-bd55-2bc8806afe75 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:50.511099 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-27d7e587-aa83-466f-bd55-2bc8806afe75 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:50.511852 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-27d7e587-aa83-466f-bd55-2bc8806afe75 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:50.512456 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-27d7e587-aa83-466f-bd55-2bc8806afe75 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:50.564318 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:03:50.715662 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-c7daa121-7967-43df-aa96-1a44aef7def5 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2e13f1952a4e5bb23d57dd7fa31875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b2a56286924e2d953bebe717ce591b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:50.732891 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-c7daa121-7967-43df-aa96-1a44aef7def5 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] 10.222.0.26 "GET /compute/v2.1/servers/136d0aa6-479d-4d9c-b633-23203ee44ae4" status: 200 len: 1272 microversion: 2.1 time: 0.379845 Oct 08 21:03:50.734578 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1484/2905] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:50 2022] GET /compute/v2.1/servers/136d0aa6-479d-4d9c-b633-23203ee44ae4 => generated 1272 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:50.742245 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-008fe4aa-1989-4f2d-b2f2-ddca531edbef tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:50.745830 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-008fe4aa-1989-4f2d-b2f2-ddca531edbef tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] [instance: 401433a8-84ff-4525-9a86-c0b6a517eeb3] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:50.759007 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-008fe4aa-1989-4f2d-b2f2-ddca531edbef tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:50.760153 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-008fe4aa-1989-4f2d-b2f2-ddca531edbef tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:50.760797 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-008fe4aa-1989-4f2d-b2f2-ddca531edbef tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:50.762735 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-008fe4aa-1989-4f2d-b2f2-ddca531edbef tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:50.763426 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-008fe4aa-1989-4f2d-b2f2-ddca531edbef tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:50.764187 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-008fe4aa-1989-4f2d-b2f2-ddca531edbef tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:50.828349 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-008fe4aa-1989-4f2d-b2f2-ddca531edbef tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] 10.222.0.26 "GET /compute/v2.1/servers/401433a8-84ff-4525-9a86-c0b6a517eeb3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.092501 Oct 08 21:03:50.829230 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1485/2906] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Oct 8 21:03:50 2022] GET /compute/v2.1/servers/401433a8-84ff-4525-9a86-c0b6a517eeb3/os-volume_attachments => generated 25 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 08 21:03:50.925765 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-9470eeb9-b5ac-47d5-b4ba-b1ac5531b8ea tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:50.928175 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-9470eeb9-b5ac-47d5-b4ba-b1ac5531b8ea tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] [instance: 401433a8-84ff-4525-9a86-c0b6a517eeb3] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:50.937881 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9470eeb9-b5ac-47d5-b4ba-b1ac5531b8ea tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:50.938927 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9470eeb9-b5ac-47d5-b4ba-b1ac5531b8ea tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:50.939605 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9470eeb9-b5ac-47d5-b4ba-b1ac5531b8ea tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:50.940565 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9470eeb9-b5ac-47d5-b4ba-b1ac5531b8ea tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:50.941816 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9470eeb9-b5ac-47d5-b4ba-b1ac5531b8ea tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:50.942468 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9470eeb9-b5ac-47d5-b4ba-b1ac5531b8ea tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:50.986078 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:03:50.997990 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-9470eeb9-b5ac-47d5-b4ba-b1ac5531b8ea tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] 10.222.0.26 "GET /compute/v2.1/servers/401433a8-84ff-4525-9a86-c0b6a517eeb3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.076450 Oct 08 21:03:50.999246 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1486/2907] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Oct 8 21:03:50 2022] GET /compute/v2.1/servers/401433a8-84ff-4525-9a86-c0b6a517eeb3/os-volume_attachments => generated 25 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 08 21:03:51.004798 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-f8ce17b4-d1f4-42dd-8932-99917921a07c tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:51.005477 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-f8ce17b4-d1f4-42dd-8932-99917921a07c tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] [instance: 75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:51.014029 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f8ce17b4-d1f4-42dd-8932-99917921a07c tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:51.014564 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f8ce17b4-d1f4-42dd-8932-99917921a07c tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:51.015014 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f8ce17b4-d1f4-42dd-8932-99917921a07c tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:51.016015 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f8ce17b4-d1f4-42dd-8932-99917921a07c tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:51.016493 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f8ce17b4-d1f4-42dd-8932-99917921a07c tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:51.017464 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f8ce17b4-d1f4-42dd-8932-99917921a07c tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:51.049216 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-f8ce17b4-d1f4-42dd-8932-99917921a07c tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] [instance: 75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a] Going to try to terminate instance {{(pid=140492) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 21:03:51.053795 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-27d7e587-aa83-466f-bd55-2bc8806afe75 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095debf3968c448fb3c3add0322d8d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc9bed6d76834f6fa66d681ecd9f4e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:51.067863 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-27d7e587-aa83-466f-bd55-2bc8806afe75 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] 10.222.0.26 "GET /compute/v2.1/servers/814f7da9-1d8d-4695-8cfa-6db50c3e846a" status: 200 len: 1506 microversion: 2.1 time: 0.599332 Oct 08 21:03:51.087420 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1422/2908] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:50 2022] GET /compute/v2.1/servers/814f7da9-1d8d-4695-8cfa-6db50c3e846a => generated 1506 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:51.092607 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-12a7def1-466e-4161-9472-3010d4f06185 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:51.101567 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-12a7def1-466e-4161-9472-3010d4f06185 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] [instance: 4e392800-b237-4d1d-8372-e635e2450b91] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:51.114882 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-12a7def1-466e-4161-9472-3010d4f06185 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:51.115408 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-12a7def1-466e-4161-9472-3010d4f06185 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:51.126195 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-12a7def1-466e-4161-9472-3010d4f06185 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:51.127072 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-12a7def1-466e-4161-9472-3010d4f06185 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:51.127564 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-12a7def1-466e-4161-9472-3010d4f06185 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:51.128008 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-12a7def1-466e-4161-9472-3010d4f06185 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:51.234202 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-f8ce17b4-d1f4-42dd-8932-99917921a07c tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] 10.222.0.26 "DELETE /compute/v2.1/servers/75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a" status: 204 len: 0 microversion: 2.1 time: 0.233291 Oct 08 21:03:51.235773 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1487/2909] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:03:50 2022] DELETE /compute/v2.1/servers/75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a => generated 0 bytes in 235 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 21:03:51.242501 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-7012d768-24c2-49e8-aee7-bf0ddb58078a tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:51.243407 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-7012d768-24c2-49e8-aee7-bf0ddb58078a tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] [instance: 401433a8-84ff-4525-9a86-c0b6a517eeb3] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:51.250609 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7012d768-24c2-49e8-aee7-bf0ddb58078a tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:51.252024 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7012d768-24c2-49e8-aee7-bf0ddb58078a tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:51.252646 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7012d768-24c2-49e8-aee7-bf0ddb58078a tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:51.253939 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7012d768-24c2-49e8-aee7-bf0ddb58078a tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:51.254582 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7012d768-24c2-49e8-aee7-bf0ddb58078a tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:51.255305 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7012d768-24c2-49e8-aee7-bf0ddb58078a tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:51.291089 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-7012d768-24c2-49e8-aee7-bf0ddb58078a tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] [instance: 401433a8-84ff-4525-9a86-c0b6a517eeb3] Going to try to terminate instance {{(pid=140492) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 21:03:51.416697 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-7012d768-24c2-49e8-aee7-bf0ddb58078a tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] 10.222.0.26 "DELETE /compute/v2.1/servers/401433a8-84ff-4525-9a86-c0b6a517eeb3" status: 204 len: 0 microversion: 2.1 time: 0.179266 Oct 08 21:03:51.417758 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1488/2910] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:03:51 2022] DELETE /compute/v2.1/servers/401433a8-84ff-4525-9a86-c0b6a517eeb3 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 21:03:51.428348 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-5140b244-6500-481a-940b-42f82813be50 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:51.429546 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-5140b244-6500-481a-940b-42f82813be50 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: 6ef37448-690b-4fcf-85f8-a2fb71207f38] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:51.437709 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5140b244-6500-481a-940b-42f82813be50 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:51.439148 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5140b244-6500-481a-940b-42f82813be50 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:51.439834 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5140b244-6500-481a-940b-42f82813be50 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:51.440787 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5140b244-6500-481a-940b-42f82813be50 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:51.441442 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5140b244-6500-481a-940b-42f82813be50 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:51.442634 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5140b244-6500-481a-940b-42f82813be50 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:51.465751 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-12a7def1-466e-4161-9472-3010d4f06185 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2395fe934d458faa80e28587458bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f455695c0214bfab0f412aa34417e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:51.505043 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-12a7def1-466e-4161-9472-3010d4f06185 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] 10.222.0.26 "GET /compute/v2.1/servers/4e392800-b237-4d1d-8372-e635e2450b91" status: 200 len: 1314 microversion: 2.1 time: 0.415080 Oct 08 21:03:51.506341 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1423/2911] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:51 2022] GET /compute/v2.1/servers/4e392800-b237-4d1d-8372-e635e2450b91 => generated 1314 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:51.686699 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c920135d-5fb2-414e-aa1c-1bdf6606eb06 tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-398981769", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "networks": "none"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:03:51.755386 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-c920135d-5fb2-414e-aa1c-1bdf6606eb06 tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Flavor limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 21:03:51.755386 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-c920135d-5fb2-414e-aa1c-1bdf6606eb06 tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Image limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 21:03:51.755386 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-c920135d-5fb2-414e-aa1c-1bdf6606eb06 tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Flavor pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 21:03:51.755666 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-c920135d-5fb2-414e-aa1c-1bdf6606eb06 tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Image pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 21:03:51.756046 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-c920135d-5fb2-414e-aa1c-1bdf6606eb06 tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 21:03:51.760399 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-5140b244-6500-481a-940b-42f82813be50 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:51.765711 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=37 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:03:51.768065 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c920135d-5fb2-414e-aa1c-1bdf6606eb06 tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:51.768789 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c920135d-5fb2-414e-aa1c-1bdf6606eb06 tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:51.769796 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c920135d-5fb2-414e-aa1c-1bdf6606eb06 tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:51.769929 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-5140b244-6500-481a-940b-42f82813be50 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/6ef37448-690b-4fcf-85f8-a2fb71207f38" status: 200 len: 1476 microversion: 2.1 time: 0.350163 Oct 08 21:03:51.770877 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1489/2912] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:51 2022] GET /compute/v2.1/servers/6ef37448-690b-4fcf-85f8-a2fb71207f38 => generated 1476 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:51.771415 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c920135d-5fb2-414e-aa1c-1bdf6606eb06 tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:51.772330 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c920135d-5fb2-414e-aa1c-1bdf6606eb06 tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:51.773027 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c920135d-5fb2-414e-aa1c-1bdf6606eb06 tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:51.776840 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-91af17d8-ad0f-4497-bbdf-f9b53908a080 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:51.777509 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-91af17d8-ad0f-4497-bbdf-f9b53908a080 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] [instance: 75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:51.788112 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-91af17d8-ad0f-4497-bbdf-f9b53908a080 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:51.788624 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-91af17d8-ad0f-4497-bbdf-f9b53908a080 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:51.789759 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-91af17d8-ad0f-4497-bbdf-f9b53908a080 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:51.790599 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-91af17d8-ad0f-4497-bbdf-f9b53908a080 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:51.791627 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-91af17d8-ad0f-4497-bbdf-f9b53908a080 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:51.792000 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-91af17d8-ad0f-4497-bbdf-f9b53908a080 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:51.797558 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-c920135d-5fb2-414e-aa1c-1bdf6606eb06 tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Getting quotas for project 9a9dfe2733a844928b29194b54f4a0a4. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:03:51.806612 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-c920135d-5fb2-414e-aa1c-1bdf6606eb06 tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Getting quotas for user fd917f61a1c043f599ef923f41c3a938 and project 9a9dfe2733a844928b29194b54f4a0a4. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:03:51.820521 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-c920135d-5fb2-414e-aa1c-1bdf6606eb06 tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Going to run 1 instances... {{(pid=140491) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 21:03:51.822904 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-c920135d-5fb2-414e-aa1c-1bdf6606eb06 tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] [instance: 7fb18924-877c-4768-a503-718e32ae5765] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c508bd7f-7db9-4b2c-af7c-be54a855c355',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140491) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 21:03:51.879159 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-c920135d-5fb2-414e-aa1c-1bdf6606eb06 tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.370257 Oct 08 21:03:51.880511 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1424/2913] 10.222.0.26 () {62 vars in 1188 bytes} [Sat Oct 8 21:03:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 373 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 08 21:03:51.886556 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-0109195f-9607-4dfa-9591-cdd3d59ade86 tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:51.887658 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-0109195f-9607-4dfa-9591-cdd3d59ade86 tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] [instance: 401433a8-84ff-4525-9a86-c0b6a517eeb3] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:51.895817 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0109195f-9607-4dfa-9591-cdd3d59ade86 tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:51.896386 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0109195f-9607-4dfa-9591-cdd3d59ade86 tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:51.896901 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0109195f-9607-4dfa-9591-cdd3d59ade86 tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:51.897902 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0109195f-9607-4dfa-9591-cdd3d59ade86 tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:51.898460 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0109195f-9607-4dfa-9591-cdd3d59ade86 tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:51.898972 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0109195f-9607-4dfa-9591-cdd3d59ade86 tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:52.008803 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-91af17d8-ad0f-4497-bbdf-f9b53908a080 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1698dee4a2bf4ea19a6ee0c3d5cb5c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b00ee5e7828469f95bd90548d35982a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:52.021324 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-91af17d8-ad0f-4497-bbdf-f9b53908a080 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] 10.222.0.26 "GET /compute/v2.1/servers/75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a" status: 200 len: 1507 microversion: 2.1 time: 0.248895 Oct 08 21:03:52.022263 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1490/2914] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:51 2022] GET /compute/v2.1/servers/75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a => generated 1507 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:52.030171 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-b8198de3-fee5-4b9a-8b37-1d8463a8b82c tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:52.031693 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-b8198de3-fee5-4b9a-8b37-1d8463a8b82c tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] [instance: ede2a1aa-f65b-424e-9034-15a2aaf13e60] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:52.040235 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b8198de3-fee5-4b9a-8b37-1d8463a8b82c tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:52.041432 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b8198de3-fee5-4b9a-8b37-1d8463a8b82c tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:52.042117 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b8198de3-fee5-4b9a-8b37-1d8463a8b82c tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:52.043725 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b8198de3-fee5-4b9a-8b37-1d8463a8b82c tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:52.044283 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b8198de3-fee5-4b9a-8b37-1d8463a8b82c tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:52.044921 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b8198de3-fee5-4b9a-8b37-1d8463a8b82c tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:52.257131 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-b8198de3-fee5-4b9a-8b37-1d8463a8b82c tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f60e33f334465fac1148669de3f00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4735bf74f33a4739800d766c82d973d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:52.265883 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-b8198de3-fee5-4b9a-8b37-1d8463a8b82c tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] 10.222.0.26 "GET /compute/v2.1/servers/ede2a1aa-f65b-424e-9034-15a2aaf13e60" status: 200 len: 1334 microversion: 2.1 time: 0.242251 Oct 08 21:03:52.266488 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1491/2915] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:52 2022] GET /compute/v2.1/servers/ede2a1aa-f65b-424e-9034-15a2aaf13e60 => generated 1334 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:52.271740 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-b9011ff5-7bd8-4f9b-a139-cd906ca4443a req-1ac9f383-421f-4900-93e5-7ee99834a19f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ede2a1aa-f65b-424e-9034-15a2aaf13e60", "name": "network-vif-plugged", "status": "completed", "tag": "761d6383-28be-4b4b-87b9-3cd96e5126ce"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:03:52.281574 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-b9011ff5-7bd8-4f9b-a139-cd906ca4443a req-1ac9f383-421f-4900-93e5-7ee99834a19f service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:52.282271 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-b9011ff5-7bd8-4f9b-a139-cd906ca4443a req-1ac9f383-421f-4900-93e5-7ee99834a19f service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:52.282892 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-b9011ff5-7bd8-4f9b-a139-cd906ca4443a req-1ac9f383-421f-4900-93e5-7ee99834a19f service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:52.300083 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-b9011ff5-7bd8-4f9b-a139-cd906ca4443a req-1ac9f383-421f-4900-93e5-7ee99834a19f service nova] Creating event network-vif-plugged:761d6383-28be-4b4b-87b9-3cd96e5126ce for instance ede2a1aa-f65b-424e-9034-15a2aaf13e60 on nch2-master-1 Oct 08 21:03:52.306160 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-b9011ff5-7bd8-4f9b-a139-cd906ca4443a req-1ac9f383-421f-4900-93e5-7ee99834a19f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037900 Oct 08 21:03:52.308054 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1492/2916] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:03:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:03:52.313773 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-d69de402-6756-4656-89b8-89a2bbff3c0a req-104a6809-48ce-40ca-a096-d2ad0f80324a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e392800-b237-4d1d-8372-e635e2450b91", "tag": "7b5e3817-0dd1-47a2-b7d0-f75aa022f9b9"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:03:52.325268 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-d69de402-6756-4656-89b8-89a2bbff3c0a req-104a6809-48ce-40ca-a096-d2ad0f80324a service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:52.325751 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-d69de402-6756-4656-89b8-89a2bbff3c0a req-104a6809-48ce-40ca-a096-d2ad0f80324a service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:52.326190 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-d69de402-6756-4656-89b8-89a2bbff3c0a req-104a6809-48ce-40ca-a096-d2ad0f80324a service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:52.337153 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-d69de402-6756-4656-89b8-89a2bbff3c0a req-104a6809-48ce-40ca-a096-d2ad0f80324a service nova] Creating event network-changed:7b5e3817-0dd1-47a2-b7d0-f75aa022f9b9 for instance 4e392800-b237-4d1d-8372-e635e2450b91 on nch1-master-1 Oct 08 21:03:52.342847 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-d69de402-6756-4656-89b8-89a2bbff3c0a req-104a6809-48ce-40ca-a096-d2ad0f80324a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033383 Oct 08 21:03:52.343454 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1493/2917] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:03:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:03:52.349139 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-7e9cb69f-653c-4ac1-ba0b-6749cd90c064 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:52.349875 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-7e9cb69f-653c-4ac1-ba0b-6749cd90c064 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] [instance: 136d0aa6-479d-4d9c-b633-23203ee44ae4] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:52.356331 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7e9cb69f-653c-4ac1-ba0b-6749cd90c064 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:52.356821 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7e9cb69f-653c-4ac1-ba0b-6749cd90c064 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:52.357501 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7e9cb69f-653c-4ac1-ba0b-6749cd90c064 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:52.358211 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7e9cb69f-653c-4ac1-ba0b-6749cd90c064 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:52.358674 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7e9cb69f-653c-4ac1-ba0b-6749cd90c064 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:52.359105 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7e9cb69f-653c-4ac1-ba0b-6749cd90c064 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:52.369010 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-0109195f-9607-4dfa-9591-cdd3d59ade86 tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e3216124a4f41b2b931a16c750649df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0310d9e59942729d685e6eb06c6460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:52.380074 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-0109195f-9607-4dfa-9591-cdd3d59ade86 tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] 10.222.0.26 "GET /compute/v2.1/servers/401433a8-84ff-4525-9a86-c0b6a517eeb3" status: 200 len: 1681 microversion: 2.1 time: 0.498183 Oct 08 21:03:52.380855 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1425/2918] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:51 2022] GET /compute/v2.1/servers/401433a8-84ff-4525-9a86-c0b6a517eeb3 => generated 1681 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:52.385798 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-44f95725-5c29-43e1-95ba-f0aec4b300a9 tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:52.386637 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-44f95725-5c29-43e1-95ba-f0aec4b300a9 tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] [instance: 7fb18924-877c-4768-a503-718e32ae5765] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:52.448722 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-44f95725-5c29-43e1-95ba-f0aec4b300a9 tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd917f61a1c043f599ef923f41c3a938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a9dfe2733a844928b29194b54f4a0a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:52.458219 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-44f95725-5c29-43e1-95ba-f0aec4b300a9 tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd917f61a1c043f599ef923f41c3a938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a9dfe2733a844928b29194b54f4a0a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:52.459733 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-44f95725-5c29-43e1-95ba-f0aec4b300a9 tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd917f61a1c043f599ef923f41c3a938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a9dfe2733a844928b29194b54f4a0a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:52.461012 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-44f95725-5c29-43e1-95ba-f0aec4b300a9 tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] 10.222.0.26 "GET /compute/v2.1/servers/7fb18924-877c-4768-a503-718e32ae5765" status: 200 len: 1280 microversion: 2.47 time: 0.079029 Oct 08 21:03:52.461651 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1426/2919] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:03:52 2022] GET /compute/v2.1/servers/7fb18924-877c-4768-a503-718e32ae5765 => generated 1280 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:03:52.466322 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-14bb907c-4d88-4af8-b38a-5df210de5e8a req-0c64658e-e600-4e07-a8c8-7d1664427aeb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "136d0aa6-479d-4d9c-b633-23203ee44ae4", "tag": "d41be44e-6c58-4f86-ad3d-4f4cdf8c4028"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:03:52.483818 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-14bb907c-4d88-4af8-b38a-5df210de5e8a req-0c64658e-e600-4e07-a8c8-7d1664427aeb service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:52.484309 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-14bb907c-4d88-4af8-b38a-5df210de5e8a req-0c64658e-e600-4e07-a8c8-7d1664427aeb service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:52.490649 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-14bb907c-4d88-4af8-b38a-5df210de5e8a req-0c64658e-e600-4e07-a8c8-7d1664427aeb service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:52.496072 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-14bb907c-4d88-4af8-b38a-5df210de5e8a req-0c64658e-e600-4e07-a8c8-7d1664427aeb service nova] Creating event network-changed:d41be44e-6c58-4f86-ad3d-4f4cdf8c4028 for instance 136d0aa6-479d-4d9c-b633-23203ee44ae4 on nch2-master-1 Oct 08 21:03:52.500929 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-14bb907c-4d88-4af8-b38a-5df210de5e8a req-0c64658e-e600-4e07-a8c8-7d1664427aeb service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038132 Oct 08 21:03:52.501748 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1427/2920] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:03:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:03:52.507034 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-20cb5ac7-2f63-4401-900c-4eaff7641b3b tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:52.507787 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-20cb5ac7-2f63-4401-900c-4eaff7641b3b tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] [instance: 814f7da9-1d8d-4695-8cfa-6db50c3e846a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:52.513987 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-20cb5ac7-2f63-4401-900c-4eaff7641b3b tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:52.514482 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-20cb5ac7-2f63-4401-900c-4eaff7641b3b tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:52.514929 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-20cb5ac7-2f63-4401-900c-4eaff7641b3b tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:52.515638 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-20cb5ac7-2f63-4401-900c-4eaff7641b3b tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:52.516105 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-20cb5ac7-2f63-4401-900c-4eaff7641b3b tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:52.516539 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-20cb5ac7-2f63-4401-900c-4eaff7641b3b tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:52.526532 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-7e9cb69f-653c-4ac1-ba0b-6749cd90c064 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2e13f1952a4e5bb23d57dd7fa31875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b2a56286924e2d953bebe717ce591b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:52.534427 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-7e9cb69f-653c-4ac1-ba0b-6749cd90c064 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] 10.222.0.26 "GET /compute/v2.1/servers/136d0aa6-479d-4d9c-b633-23203ee44ae4" status: 200 len: 1314 microversion: 2.1 time: 0.189704 Oct 08 21:03:52.535051 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1494/2921] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:52 2022] GET /compute/v2.1/servers/136d0aa6-479d-4d9c-b633-23203ee44ae4 => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:52.539496 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-20dab6b2-bb71-4fdd-8bbb-a63eaf9b2f7d tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:52.540259 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-20dab6b2-bb71-4fdd-8bbb-a63eaf9b2f7d tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] [instance: 4e392800-b237-4d1d-8372-e635e2450b91] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:52.546072 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-20dab6b2-bb71-4fdd-8bbb-a63eaf9b2f7d tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:52.546580 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-20dab6b2-bb71-4fdd-8bbb-a63eaf9b2f7d tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:52.547012 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-20dab6b2-bb71-4fdd-8bbb-a63eaf9b2f7d tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:52.547712 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-20dab6b2-bb71-4fdd-8bbb-a63eaf9b2f7d tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:52.548354 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-20dab6b2-bb71-4fdd-8bbb-a63eaf9b2f7d tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:52.548799 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-20dab6b2-bb71-4fdd-8bbb-a63eaf9b2f7d tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:52.654799 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-20cb5ac7-2f63-4401-900c-4eaff7641b3b tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095debf3968c448fb3c3add0322d8d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc9bed6d76834f6fa66d681ecd9f4e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:52.662630 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-20cb5ac7-2f63-4401-900c-4eaff7641b3b tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] 10.222.0.26 "GET /compute/v2.1/servers/814f7da9-1d8d-4695-8cfa-6db50c3e846a" status: 200 len: 1506 microversion: 2.1 time: 0.159962 Oct 08 21:03:52.663211 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1428/2922] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:52 2022] GET /compute/v2.1/servers/814f7da9-1d8d-4695-8cfa-6db50c3e846a => generated 1506 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:52.678214 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-20dab6b2-bb71-4fdd-8bbb-a63eaf9b2f7d tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2395fe934d458faa80e28587458bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f455695c0214bfab0f412aa34417e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:52.686034 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-20dab6b2-bb71-4fdd-8bbb-a63eaf9b2f7d tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] 10.222.0.26 "GET /compute/v2.1/servers/4e392800-b237-4d1d-8372-e635e2450b91" status: 200 len: 1314 microversion: 2.1 time: 0.150039 Oct 08 21:03:52.686599 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1495/2923] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:52 2022] GET /compute/v2.1/servers/4e392800-b237-4d1d-8372-e635e2450b91 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:52.796014 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-77106768-7353-4ad2-be20-72e55e4d5a74 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:52.796532 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-77106768-7353-4ad2-be20-72e55e4d5a74 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: 6ef37448-690b-4fcf-85f8-a2fb71207f38] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:52.803631 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-77106768-7353-4ad2-be20-72e55e4d5a74 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:52.804123 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-77106768-7353-4ad2-be20-72e55e4d5a74 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:52.804574 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-77106768-7353-4ad2-be20-72e55e4d5a74 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:52.805316 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-77106768-7353-4ad2-be20-72e55e4d5a74 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:52.805902 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-77106768-7353-4ad2-be20-72e55e4d5a74 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:52.806334 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-77106768-7353-4ad2-be20-72e55e4d5a74 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:52.997409 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-77106768-7353-4ad2-be20-72e55e4d5a74 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:53.007948 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-77106768-7353-4ad2-be20-72e55e4d5a74 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/6ef37448-690b-4fcf-85f8-a2fb71207f38" status: 200 len: 1476 microversion: 2.1 time: 0.216754 Oct 08 21:03:53.008846 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1429/2924] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:52 2022] GET /compute/v2.1/servers/6ef37448-690b-4fcf-85f8-a2fb71207f38 => generated 1476 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:53.050156 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-28dadbea-0488-4636-9989-d5a18e1fcd7b tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:53.051292 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-28dadbea-0488-4636-9989-d5a18e1fcd7b tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] [instance: 75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:53.058303 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-28dadbea-0488-4636-9989-d5a18e1fcd7b tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:53.058838 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-28dadbea-0488-4636-9989-d5a18e1fcd7b tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:53.059299 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-28dadbea-0488-4636-9989-d5a18e1fcd7b tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:53.059996 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-28dadbea-0488-4636-9989-d5a18e1fcd7b tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:53.060494 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-28dadbea-0488-4636-9989-d5a18e1fcd7b tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:53.060927 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-28dadbea-0488-4636-9989-d5a18e1fcd7b tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:53.292875 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-dd193a7f-26ef-4733-ab74-b441f0ca8ae8 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:53.293643 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-dd193a7f-26ef-4733-ab74-b441f0ca8ae8 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] [instance: ede2a1aa-f65b-424e-9034-15a2aaf13e60] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:53.302447 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dd193a7f-26ef-4733-ab74-b441f0ca8ae8 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:53.303245 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dd193a7f-26ef-4733-ab74-b441f0ca8ae8 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:53.303903 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dd193a7f-26ef-4733-ab74-b441f0ca8ae8 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:53.304809 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dd193a7f-26ef-4733-ab74-b441f0ca8ae8 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:53.305483 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dd193a7f-26ef-4733-ab74-b441f0ca8ae8 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:53.306100 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dd193a7f-26ef-4733-ab74-b441f0ca8ae8 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:53.359659 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-28dadbea-0488-4636-9989-d5a18e1fcd7b tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1698dee4a2bf4ea19a6ee0c3d5cb5c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b00ee5e7828469f95bd90548d35982a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:53.368389 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-28dadbea-0488-4636-9989-d5a18e1fcd7b tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] 10.222.0.26 "GET /compute/v2.1/servers/75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a" status: 200 len: 1507 microversion: 2.1 time: 0.322201 Oct 08 21:03:53.369077 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1496/2925] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:53 2022] GET /compute/v2.1/servers/75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a => generated 1507 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:53.406254 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-ada1064d-1d93-4c4a-a8af-8e1d89914b2b tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:53.407427 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-ada1064d-1d93-4c4a-a8af-8e1d89914b2b tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] [instance: 401433a8-84ff-4525-9a86-c0b6a517eeb3] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:53.414700 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ada1064d-1d93-4c4a-a8af-8e1d89914b2b tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:53.415296 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ada1064d-1d93-4c4a-a8af-8e1d89914b2b tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:53.415811 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ada1064d-1d93-4c4a-a8af-8e1d89914b2b tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:53.416597 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ada1064d-1d93-4c4a-a8af-8e1d89914b2b tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:53.417550 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ada1064d-1d93-4c4a-a8af-8e1d89914b2b tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:53.418624 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ada1064d-1d93-4c4a-a8af-8e1d89914b2b tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:53.632208 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-dd193a7f-26ef-4733-ab74-b441f0ca8ae8 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f60e33f334465fac1148669de3f00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4735bf74f33a4739800d766c82d973d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:53.643434 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-dd193a7f-26ef-4733-ab74-b441f0ca8ae8 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] 10.222.0.26 "GET /compute/v2.1/servers/ede2a1aa-f65b-424e-9034-15a2aaf13e60" status: 200 len: 1334 microversion: 2.1 time: 0.357459 Oct 08 21:03:53.661302 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1430/2926] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:53 2022] GET /compute/v2.1/servers/ede2a1aa-f65b-424e-9034-15a2aaf13e60 => generated 1334 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:03:53.668739 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-cb4570c3-aa20-4b3e-8240-b488163c25bb tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:53.669684 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-cb4570c3-aa20-4b3e-8240-b488163c25bb tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] [instance: 7fb18924-877c-4768-a503-718e32ae5765] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:53.676850 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cb4570c3-aa20-4b3e-8240-b488163c25bb tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:53.677382 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cb4570c3-aa20-4b3e-8240-b488163c25bb tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:53.678061 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cb4570c3-aa20-4b3e-8240-b488163c25bb tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:53.680577 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cb4570c3-aa20-4b3e-8240-b488163c25bb tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:53.681389 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cb4570c3-aa20-4b3e-8240-b488163c25bb tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:53.682081 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cb4570c3-aa20-4b3e-8240-b488163c25bb tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:53.845864 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-cb4570c3-aa20-4b3e-8240-b488163c25bb tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd917f61a1c043f599ef923f41c3a938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a9dfe2733a844928b29194b54f4a0a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:53.857131 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-cb4570c3-aa20-4b3e-8240-b488163c25bb tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd917f61a1c043f599ef923f41c3a938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a9dfe2733a844928b29194b54f4a0a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:53.858661 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-cb4570c3-aa20-4b3e-8240-b488163c25bb tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd917f61a1c043f599ef923f41c3a938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a9dfe2733a844928b29194b54f4a0a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:53.860285 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-cb4570c3-aa20-4b3e-8240-b488163c25bb tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] 10.222.0.26 "GET /compute/v2.1/servers/7fb18924-877c-4768-a503-718e32ae5765" status: 200 len: 1332 microversion: 2.47 time: 0.197531 Oct 08 21:03:53.861026 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1431/2927] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:03:53 2022] GET /compute/v2.1/servers/7fb18924-877c-4768-a503-718e32ae5765 => generated 1332 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:03:53.866488 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-b8034a6b-6472-41f8-bd6c-276d8a88ee23 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:53.867383 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-b8034a6b-6472-41f8-bd6c-276d8a88ee23 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] [instance: 136d0aa6-479d-4d9c-b633-23203ee44ae4] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:53.893219 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b8034a6b-6472-41f8-bd6c-276d8a88ee23 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:53.894798 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b8034a6b-6472-41f8-bd6c-276d8a88ee23 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:53.895511 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b8034a6b-6472-41f8-bd6c-276d8a88ee23 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:53.896495 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b8034a6b-6472-41f8-bd6c-276d8a88ee23 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:53.897416 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b8034a6b-6472-41f8-bd6c-276d8a88ee23 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:53.898093 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b8034a6b-6472-41f8-bd6c-276d8a88ee23 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:54.060004 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-ada1064d-1d93-4c4a-a8af-8e1d89914b2b tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e3216124a4f41b2b931a16c750649df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0310d9e59942729d685e6eb06c6460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:54.069474 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-ada1064d-1d93-4c4a-a8af-8e1d89914b2b tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] 10.222.0.26 "GET /compute/v2.1/servers/401433a8-84ff-4525-9a86-c0b6a517eeb3" status: 200 len: 1681 microversion: 2.1 time: 0.667792 Oct 08 21:03:54.085211 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1497/2928] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:53 2022] GET /compute/v2.1/servers/401433a8-84ff-4525-9a86-c0b6a517eeb3 => generated 1681 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:54.085211 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-8a4201f4-9208-4090-ab50-67fb8c2ee345 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:54.085211 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-8a4201f4-9208-4090-ab50-67fb8c2ee345 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] [instance: 814f7da9-1d8d-4695-8cfa-6db50c3e846a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:54.090938 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8a4201f4-9208-4090-ab50-67fb8c2ee345 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:54.091511 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8a4201f4-9208-4090-ab50-67fb8c2ee345 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:54.092024 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8a4201f4-9208-4090-ab50-67fb8c2ee345 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:54.092808 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8a4201f4-9208-4090-ab50-67fb8c2ee345 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:54.093377 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8a4201f4-9208-4090-ab50-67fb8c2ee345 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:54.094097 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8a4201f4-9208-4090-ab50-67fb8c2ee345 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:54.245293 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-b8034a6b-6472-41f8-bd6c-276d8a88ee23 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2e13f1952a4e5bb23d57dd7fa31875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b2a56286924e2d953bebe717ce591b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:54.259703 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-b8034a6b-6472-41f8-bd6c-276d8a88ee23 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] 10.222.0.26 "GET /compute/v2.1/servers/136d0aa6-479d-4d9c-b633-23203ee44ae4" status: 200 len: 1314 microversion: 2.1 time: 0.396953 Oct 08 21:03:54.260304 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1432/2929] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:53 2022] GET /compute/v2.1/servers/136d0aa6-479d-4d9c-b633-23203ee44ae4 => generated 1314 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:54.267023 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-0a93a738-40d2-469e-9229-6c7da91575cd tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:54.268197 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-0a93a738-40d2-469e-9229-6c7da91575cd tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] [instance: 4e392800-b237-4d1d-8372-e635e2450b91] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:54.276308 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0a93a738-40d2-469e-9229-6c7da91575cd tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:54.277131 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0a93a738-40d2-469e-9229-6c7da91575cd tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:54.277787 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0a93a738-40d2-469e-9229-6c7da91575cd tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:54.278744 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0a93a738-40d2-469e-9229-6c7da91575cd tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:54.279537 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0a93a738-40d2-469e-9229-6c7da91575cd tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:54.280203 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0a93a738-40d2-469e-9229-6c7da91575cd tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:54.357295 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-8a4201f4-9208-4090-ab50-67fb8c2ee345 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095debf3968c448fb3c3add0322d8d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc9bed6d76834f6fa66d681ecd9f4e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:54.373367 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-8a4201f4-9208-4090-ab50-67fb8c2ee345 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] 10.222.0.26 "GET /compute/v2.1/servers/814f7da9-1d8d-4695-8cfa-6db50c3e846a" status: 200 len: 1510 microversion: 2.1 time: 0.295533 Oct 08 21:03:54.374089 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1498/2930] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:54 2022] GET /compute/v2.1/servers/814f7da9-1d8d-4695-8cfa-6db50c3e846a => generated 1510 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:54.383639 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-656f5365-dfbe-48f7-befd-bdcf31aa2f42 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:54.385119 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-656f5365-dfbe-48f7-befd-bdcf31aa2f42 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: 6ef37448-690b-4fcf-85f8-a2fb71207f38] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:54.400401 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-656f5365-dfbe-48f7-befd-bdcf31aa2f42 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:54.401339 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-656f5365-dfbe-48f7-befd-bdcf31aa2f42 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:54.402081 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-656f5365-dfbe-48f7-befd-bdcf31aa2f42 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:54.403047 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-656f5365-dfbe-48f7-befd-bdcf31aa2f42 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:54.403915 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-656f5365-dfbe-48f7-befd-bdcf31aa2f42 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:54.404645 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-656f5365-dfbe-48f7-befd-bdcf31aa2f42 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:54.620383 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-0a93a738-40d2-469e-9229-6c7da91575cd tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2395fe934d458faa80e28587458bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f455695c0214bfab0f412aa34417e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:54.632616 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-0a93a738-40d2-469e-9229-6c7da91575cd tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] 10.222.0.26 "GET /compute/v2.1/servers/4e392800-b237-4d1d-8372-e635e2450b91" status: 200 len: 1314 microversion: 2.1 time: 0.370428 Oct 08 21:03:54.651802 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-656f5365-dfbe-48f7-befd-bdcf31aa2f42 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:54.661894 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1433/2931] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:54 2022] GET /compute/v2.1/servers/4e392800-b237-4d1d-8372-e635e2450b91 => generated 1314 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:54.662539 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-656f5365-dfbe-48f7-befd-bdcf31aa2f42 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/6ef37448-690b-4fcf-85f8-a2fb71207f38" status: 200 len: 1476 microversion: 2.1 time: 0.284358 Oct 08 21:03:54.667035 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1499/2932] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:54 2022] GET /compute/v2.1/servers/6ef37448-690b-4fcf-85f8-a2fb71207f38 => generated 1476 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:54.670341 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-d1cc947e-7260-4ba6-a51f-4eef21f1c455 req-78bda9fc-11ec-4197-b38a-ec3d362ceace service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ede2a1aa-f65b-424e-9034-15a2aaf13e60", "name": "network-vif-plugged", "status": "completed", "tag": "d651f0cc-7f26-4fcd-8f94-fbd142dbaba0"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:03:54.680746 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-c5fe3cea-44bd-4fb0-9f1e-030ffc1eb0e2 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:54.681622 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-c5fe3cea-44bd-4fb0-9f1e-030ffc1eb0e2 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] [instance: 75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:54.689506 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c5fe3cea-44bd-4fb0-9f1e-030ffc1eb0e2 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:54.690259 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c5fe3cea-44bd-4fb0-9f1e-030ffc1eb0e2 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:54.692419 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-d1cc947e-7260-4ba6-a51f-4eef21f1c455 req-78bda9fc-11ec-4197-b38a-ec3d362ceace service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:54.693082 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c5fe3cea-44bd-4fb0-9f1e-030ffc1eb0e2 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:54.694008 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c5fe3cea-44bd-4fb0-9f1e-030ffc1eb0e2 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:54.695038 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-d1cc947e-7260-4ba6-a51f-4eef21f1c455 req-78bda9fc-11ec-4197-b38a-ec3d362ceace service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:54.695504 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-d1cc947e-7260-4ba6-a51f-4eef21f1c455 req-78bda9fc-11ec-4197-b38a-ec3d362ceace service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:54.697695 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c5fe3cea-44bd-4fb0-9f1e-030ffc1eb0e2 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:54.698112 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c5fe3cea-44bd-4fb0-9f1e-030ffc1eb0e2 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:54.723661 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-d1cc947e-7260-4ba6-a51f-4eef21f1c455 req-78bda9fc-11ec-4197-b38a-ec3d362ceace service nova] Creating event network-vif-plugged:d651f0cc-7f26-4fcd-8f94-fbd142dbaba0 for instance ede2a1aa-f65b-424e-9034-15a2aaf13e60 on nch2-master-1 Oct 08 21:03:54.733126 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-d1cc947e-7260-4ba6-a51f-4eef21f1c455 req-78bda9fc-11ec-4197-b38a-ec3d362ceace service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070815 Oct 08 21:03:54.734489 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1434/2933] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:03:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:03:54.742321 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c961758b-4d51-445d-8643-aa331051706a tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:54.748911 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-c961758b-4d51-445d-8643-aa331051706a tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '095debf3968c448fb3c3add0322d8d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc9bed6d76834f6fa66d681ecd9f4e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:54.749494 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.compute.servers [None req-c961758b-4d51-445d-8643-aa331051706a tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Removing options 'limit' from query {{(pid=140491) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 08 21:03:54.750338 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-c961758b-4d51-445d-8643-aa331051706a tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Searching by: {'deleted': False, 'project_id': 'bc9bed6d76834f6fa66d681ecd9f4e90'} {{(pid=140491) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 08 21:03:54.751566 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c961758b-4d51-445d-8643-aa331051706a tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:54.752126 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c961758b-4d51-445d-8643-aa331051706a tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:54.752636 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c961758b-4d51-445d-8643-aa331051706a tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:54.753505 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c961758b-4d51-445d-8643-aa331051706a tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:54.753967 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c961758b-4d51-445d-8643-aa331051706a tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:54.754391 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c961758b-4d51-445d-8643-aa331051706a tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:54.755932 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-c961758b-4d51-445d-8643-aa331051706a tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] 10.222.0.26 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.020160 Oct 08 21:03:54.756719 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1435/2934] 10.222.0.26 () {58 vars in 1140 bytes} [Sat Oct 8 21:03:54 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 08 21:03:54.770858 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-e0caa718-c0b6-46a8-bd70-fa439c523960 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:54.771913 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-e0caa718-c0b6-46a8-bd70-fa439c523960 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] [instance: ede2a1aa-f65b-424e-9034-15a2aaf13e60] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:54.779142 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e0caa718-c0b6-46a8-bd70-fa439c523960 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:54.782603 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e0caa718-c0b6-46a8-bd70-fa439c523960 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:54.783244 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e0caa718-c0b6-46a8-bd70-fa439c523960 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:54.784176 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e0caa718-c0b6-46a8-bd70-fa439c523960 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:54.785718 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e0caa718-c0b6-46a8-bd70-fa439c523960 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:54.786372 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e0caa718-c0b6-46a8-bd70-fa439c523960 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:54.859564 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-c5fe3cea-44bd-4fb0-9f1e-030ffc1eb0e2 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1698dee4a2bf4ea19a6ee0c3d5cb5c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b00ee5e7828469f95bd90548d35982a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:54.864354 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:03:54.869890 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-c5fe3cea-44bd-4fb0-9f1e-030ffc1eb0e2 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] 10.222.0.26 "GET /compute/v2.1/servers/75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a" status: 200 len: 1465 microversion: 2.1 time: 0.201765 Oct 08 21:03:54.882191 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1500/2935] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:54 2022] GET /compute/v2.1/servers/75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a => generated 1465 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:54.893605 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-c57a950c-ac3f-44fb-ac87-953498f95d48 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:54.894803 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-c57a950c-ac3f-44fb-ac87-953498f95d48 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] [instance: 814f7da9-1d8d-4695-8cfa-6db50c3e846a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:54.904082 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c57a950c-ac3f-44fb-ac87-953498f95d48 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:54.905051 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c57a950c-ac3f-44fb-ac87-953498f95d48 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:54.905607 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c57a950c-ac3f-44fb-ac87-953498f95d48 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:54.906436 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c57a950c-ac3f-44fb-ac87-953498f95d48 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:54.907147 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c57a950c-ac3f-44fb-ac87-953498f95d48 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:54.907774 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c57a950c-ac3f-44fb-ac87-953498f95d48 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:54.981212 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-e0caa718-c0b6-46a8-bd70-fa439c523960 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f60e33f334465fac1148669de3f00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4735bf74f33a4739800d766c82d973d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:54.990642 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-e0caa718-c0b6-46a8-bd70-fa439c523960 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] 10.222.0.26 "GET /compute/v2.1/servers/ede2a1aa-f65b-424e-9034-15a2aaf13e60" status: 200 len: 1334 microversion: 2.1 time: 0.224403 Oct 08 21:03:55.002297 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1436/2936] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:54 2022] GET /compute/v2.1/servers/ede2a1aa-f65b-424e-9034-15a2aaf13e60 => generated 1334 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:55.010142 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-c371d4b1-a2c3-4ff1-9d1c-720e033f8b8c req-92e5c7f2-45bb-43bb-b48b-954c1e168ca7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a", "name": "network-vif-deleted", "tag": "acc4356a-62bc-4d7c-ae97-2b2901ef98e4"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:03:55.018249 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-c371d4b1-a2c3-4ff1-9d1c-720e033f8b8c req-92e5c7f2-45bb-43bb-b48b-954c1e168ca7 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:55.018747 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-c371d4b1-a2c3-4ff1-9d1c-720e033f8b8c req-92e5c7f2-45bb-43bb-b48b-954c1e168ca7 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:55.019818 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-c371d4b1-a2c3-4ff1-9d1c-720e033f8b8c req-92e5c7f2-45bb-43bb-b48b-954c1e168ca7 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:55.033588 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-c371d4b1-a2c3-4ff1-9d1c-720e033f8b8c req-92e5c7f2-45bb-43bb-b48b-954c1e168ca7 service nova] Creating event network-vif-deleted:acc4356a-62bc-4d7c-ae97-2b2901ef98e4 for instance 75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a on nch1-master-1 Oct 08 21:03:55.041236 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-c371d4b1-a2c3-4ff1-9d1c-720e033f8b8c req-92e5c7f2-45bb-43bb-b48b-954c1e168ca7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048268 Oct 08 21:03:55.041870 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1437/2937] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:03:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:03:55.048027 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-f069b087-ad29-4f76-bcca-63a68af0d06a req-88f93f44-bcd9-409f-9eb9-be24c76224a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "401433a8-84ff-4525-9a86-c0b6a517eeb3", "name": "network-vif-deleted", "tag": "47b7d203-baac-4d79-a17a-77efb2e4892e"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:03:55.064121 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-f069b087-ad29-4f76-bcca-63a68af0d06a req-88f93f44-bcd9-409f-9eb9-be24c76224a3 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:55.064880 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-f069b087-ad29-4f76-bcca-63a68af0d06a req-88f93f44-bcd9-409f-9eb9-be24c76224a3 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:55.065586 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-f069b087-ad29-4f76-bcca-63a68af0d06a req-88f93f44-bcd9-409f-9eb9-be24c76224a3 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:55.078816 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-f069b087-ad29-4f76-bcca-63a68af0d06a req-88f93f44-bcd9-409f-9eb9-be24c76224a3 service nova] Creating event network-vif-deleted:47b7d203-baac-4d79-a17a-77efb2e4892e for instance 401433a8-84ff-4525-9a86-c0b6a517eeb3 on nch2-master-1 Oct 08 21:03:55.085138 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-f069b087-ad29-4f76-bcca-63a68af0d06a req-88f93f44-bcd9-409f-9eb9-be24c76224a3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041872 Oct 08 21:03:55.086077 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1438/2938] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:03:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:03:55.094226 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-5fa47611-025c-4a59-9463-0dcf5ada3d45 tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:55.095045 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-5fa47611-025c-4a59-9463-0dcf5ada3d45 tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] [instance: 7fb18924-877c-4768-a503-718e32ae5765] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:55.102526 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5fa47611-025c-4a59-9463-0dcf5ada3d45 tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:55.103033 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5fa47611-025c-4a59-9463-0dcf5ada3d45 tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:55.103683 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5fa47611-025c-4a59-9463-0dcf5ada3d45 tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:55.104602 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5fa47611-025c-4a59-9463-0dcf5ada3d45 tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:55.105423 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5fa47611-025c-4a59-9463-0dcf5ada3d45 tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:55.106850 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5fa47611-025c-4a59-9463-0dcf5ada3d45 tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:55.112462 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-c57a950c-ac3f-44fb-ac87-953498f95d48 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095debf3968c448fb3c3add0322d8d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc9bed6d76834f6fa66d681ecd9f4e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:55.122632 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-c57a950c-ac3f-44fb-ac87-953498f95d48 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] 10.222.0.26 "GET /compute/v2.1/servers/814f7da9-1d8d-4695-8cfa-6db50c3e846a" status: 200 len: 1510 microversion: 2.1 time: 0.239174 Oct 08 21:03:55.123579 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1501/2939] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:54 2022] GET /compute/v2.1/servers/814f7da9-1d8d-4695-8cfa-6db50c3e846a => generated 1510 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:55.131389 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-4658a516-c9dd-4c8d-a921-7f8d6afaecbe tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:55.132041 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-4658a516-c9dd-4c8d-a921-7f8d6afaecbe tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] [instance: 401433a8-84ff-4525-9a86-c0b6a517eeb3] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:55.144205 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4658a516-c9dd-4c8d-a921-7f8d6afaecbe tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:55.144870 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4658a516-c9dd-4c8d-a921-7f8d6afaecbe tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:55.145362 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4658a516-c9dd-4c8d-a921-7f8d6afaecbe tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:55.146099 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4658a516-c9dd-4c8d-a921-7f8d6afaecbe tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:55.146605 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4658a516-c9dd-4c8d-a921-7f8d6afaecbe tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:55.147047 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4658a516-c9dd-4c8d-a921-7f8d6afaecbe tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:55.184569 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-5fa47611-025c-4a59-9463-0dcf5ada3d45 tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd917f61a1c043f599ef923f41c3a938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a9dfe2733a844928b29194b54f4a0a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:55.196737 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-5fa47611-025c-4a59-9463-0dcf5ada3d45 tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd917f61a1c043f599ef923f41c3a938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a9dfe2733a844928b29194b54f4a0a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:55.198511 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-5fa47611-025c-4a59-9463-0dcf5ada3d45 tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd917f61a1c043f599ef923f41c3a938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a9dfe2733a844928b29194b54f4a0a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:55.201280 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-5fa47611-025c-4a59-9463-0dcf5ada3d45 tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] 10.222.0.26 "GET /compute/v2.1/servers/7fb18924-877c-4768-a503-718e32ae5765" status: 200 len: 1338 microversion: 2.47 time: 0.112373 Oct 08 21:03:55.221413 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1439/2940] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:03:55 2022] GET /compute/v2.1/servers/7fb18924-877c-4768-a503-718e32ae5765 => generated 1338 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:03:55.227248 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-11fba7e2-fe32-408b-9d5c-268f0929d729 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:55.230956 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-11fba7e2-fe32-408b-9d5c-268f0929d729 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] [instance: 3d7debe3-3039-401c-891d-4c6e4b96cbb8] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:55.241357 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-11fba7e2-fe32-408b-9d5c-268f0929d729 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:55.242012 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-11fba7e2-fe32-408b-9d5c-268f0929d729 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:55.242538 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-11fba7e2-fe32-408b-9d5c-268f0929d729 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:55.243516 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-11fba7e2-fe32-408b-9d5c-268f0929d729 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:55.244058 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-11fba7e2-fe32-408b-9d5c-268f0929d729 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:55.244559 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-11fba7e2-fe32-408b-9d5c-268f0929d729 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:55.245315 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-4658a516-c9dd-4c8d-a921-7f8d6afaecbe tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e3216124a4f41b2b931a16c750649df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0310d9e59942729d685e6eb06c6460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:55.256231 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-4658a516-c9dd-4c8d-a921-7f8d6afaecbe tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] 10.222.0.26 "GET /compute/v2.1/servers/401433a8-84ff-4525-9a86-c0b6a517eeb3" status: 200 len: 1613 microversion: 2.1 time: 0.131476 Oct 08 21:03:55.256838 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1502/2941] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:55 2022] GET /compute/v2.1/servers/401433a8-84ff-4525-9a86-c0b6a517eeb3 => generated 1613 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:55.282997 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-da244f7d-c4fe-41ed-8e54-b6ab153b9493 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:55.284143 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-da244f7d-c4fe-41ed-8e54-b6ab153b9493 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] [instance: 136d0aa6-479d-4d9c-b633-23203ee44ae4] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:55.301271 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-da244f7d-c4fe-41ed-8e54-b6ab153b9493 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:55.303056 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-da244f7d-c4fe-41ed-8e54-b6ab153b9493 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:55.304245 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-da244f7d-c4fe-41ed-8e54-b6ab153b9493 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:55.305179 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-da244f7d-c4fe-41ed-8e54-b6ab153b9493 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:55.305708 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-da244f7d-c4fe-41ed-8e54-b6ab153b9493 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:55.306357 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-da244f7d-c4fe-41ed-8e54-b6ab153b9493 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:55.432929 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-11fba7e2-fe32-408b-9d5c-268f0929d729 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095debf3968c448fb3c3add0322d8d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc9bed6d76834f6fa66d681ecd9f4e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:55.447728 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-11fba7e2-fe32-408b-9d5c-268f0929d729 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] 10.222.0.26 "GET /compute/v2.1/servers/3d7debe3-3039-401c-891d-4c6e4b96cbb8" status: 200 len: 1512 microversion: 2.1 time: 0.224636 Oct 08 21:03:55.461159 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1440/2942] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:55 2022] GET /compute/v2.1/servers/3d7debe3-3039-401c-891d-4c6e4b96cbb8 => generated 1512 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:55.472744 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c1662374-7db9-4eb7-b336-dfcf9c5c802b tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:55.478000 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-c1662374-7db9-4eb7-b336-dfcf9c5c802b tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] [instance: 0b52e623-6990-4978-811d-68fc294fe304] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:55.489783 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c1662374-7db9-4eb7-b336-dfcf9c5c802b tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:55.490666 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c1662374-7db9-4eb7-b336-dfcf9c5c802b tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:55.491331 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c1662374-7db9-4eb7-b336-dfcf9c5c802b tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:55.492199 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c1662374-7db9-4eb7-b336-dfcf9c5c802b tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:55.492696 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c1662374-7db9-4eb7-b336-dfcf9c5c802b tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:55.493422 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c1662374-7db9-4eb7-b336-dfcf9c5c802b tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:55.612598 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-da244f7d-c4fe-41ed-8e54-b6ab153b9493 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2e13f1952a4e5bb23d57dd7fa31875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b2a56286924e2d953bebe717ce591b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:55.631655 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-da244f7d-c4fe-41ed-8e54-b6ab153b9493 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] 10.222.0.26 "GET /compute/v2.1/servers/136d0aa6-479d-4d9c-b633-23203ee44ae4" status: 200 len: 1314 microversion: 2.1 time: 0.352537 Oct 08 21:03:55.632245 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1503/2943] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:55 2022] GET /compute/v2.1/servers/136d0aa6-479d-4d9c-b633-23203ee44ae4 => generated 1314 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:03:55.659660 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-46973a9f-5edd-4030-83b6-ea100219ec0b tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:55.660976 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-46973a9f-5edd-4030-83b6-ea100219ec0b tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] [instance: 4e392800-b237-4d1d-8372-e635e2450b91] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:55.669128 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-46973a9f-5edd-4030-83b6-ea100219ec0b tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:55.669883 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-46973a9f-5edd-4030-83b6-ea100219ec0b tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:55.671542 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-46973a9f-5edd-4030-83b6-ea100219ec0b tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:55.673403 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-46973a9f-5edd-4030-83b6-ea100219ec0b tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:55.674059 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-46973a9f-5edd-4030-83b6-ea100219ec0b tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:55.674658 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-46973a9f-5edd-4030-83b6-ea100219ec0b tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:55.789547 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-c1662374-7db9-4eb7-b336-dfcf9c5c802b tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095debf3968c448fb3c3add0322d8d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc9bed6d76834f6fa66d681ecd9f4e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:55.802335 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-c1662374-7db9-4eb7-b336-dfcf9c5c802b tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] 10.222.0.26 "GET /compute/v2.1/servers/0b52e623-6990-4978-811d-68fc294fe304" status: 200 len: 1511 microversion: 2.1 time: 0.334091 Oct 08 21:03:55.803614 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1441/2944] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:55 2022] GET /compute/v2.1/servers/0b52e623-6990-4978-811d-68fc294fe304 => generated 1511 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:55.809574 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-10e7acb7-12f3-4749-8961-a903143fb7ac tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:55.810672 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-10e7acb7-12f3-4749-8961-a903143fb7ac tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: 6ef37448-690b-4fcf-85f8-a2fb71207f38] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:55.820854 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-10e7acb7-12f3-4749-8961-a903143fb7ac tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:55.821562 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-10e7acb7-12f3-4749-8961-a903143fb7ac tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:55.822135 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-10e7acb7-12f3-4749-8961-a903143fb7ac tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:55.822970 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-10e7acb7-12f3-4749-8961-a903143fb7ac tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:55.823541 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-10e7acb7-12f3-4749-8961-a903143fb7ac tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:55.824082 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-10e7acb7-12f3-4749-8961-a903143fb7ac tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:55.850819 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-46973a9f-5edd-4030-83b6-ea100219ec0b tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2395fe934d458faa80e28587458bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f455695c0214bfab0f412aa34417e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:55.859198 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-46973a9f-5edd-4030-83b6-ea100219ec0b tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] 10.222.0.26 "GET /compute/v2.1/servers/4e392800-b237-4d1d-8372-e635e2450b91" status: 200 len: 1314 microversion: 2.1 time: 0.203334 Oct 08 21:03:55.859912 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1504/2945] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:55 2022] GET /compute/v2.1/servers/4e392800-b237-4d1d-8372-e635e2450b91 => generated 1314 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:55.864837 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-25ab89e2-66d7-4d39-ae01-4dfe9c383d19 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:55.870114 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-25ab89e2-66d7-4d39-ae01-4dfe9c383d19 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '095debf3968c448fb3c3add0322d8d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc9bed6d76834f6fa66d681ecd9f4e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:55.871114 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-25ab89e2-66d7-4d39-ae01-4dfe9c383d19 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Searching by: {'ip': '172.20.0.11', 'deleted': False, 'project_id': 'bc9bed6d76834f6fa66d681ecd9f4e90'} {{(pid=140492) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 08 21:03:55.996611 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-25ab89e2-66d7-4d39-ae01-4dfe9c383d19 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:55.997116 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-25ab89e2-66d7-4d39-ae01-4dfe9c383d19 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:55.997755 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-25ab89e2-66d7-4d39-ae01-4dfe9c383d19 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:55.998886 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-25ab89e2-66d7-4d39-ae01-4dfe9c383d19 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:55.999350 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-25ab89e2-66d7-4d39-ae01-4dfe9c383d19 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:56.000211 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-25ab89e2-66d7-4d39-ae01-4dfe9c383d19 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:56.065253 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-10e7acb7-12f3-4749-8961-a903143fb7ac tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:56.076998 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-10e7acb7-12f3-4749-8961-a903143fb7ac tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/6ef37448-690b-4fcf-85f8-a2fb71207f38" status: 200 len: 1476 microversion: 2.1 time: 0.271982 Oct 08 21:03:56.078771 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1442/2946] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:55 2022] GET /compute/v2.1/servers/6ef37448-690b-4fcf-85f8-a2fb71207f38 => generated 1476 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:56.085649 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-d1fd5ea2-3718-4dae-94fb-9711e55d8c53 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:56.086461 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-d1fd5ea2-3718-4dae-94fb-9711e55d8c53 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] [instance: 75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:56.096826 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d1fd5ea2-3718-4dae-94fb-9711e55d8c53 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:56.097670 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d1fd5ea2-3718-4dae-94fb-9711e55d8c53 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:56.098291 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d1fd5ea2-3718-4dae-94fb-9711e55d8c53 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:56.099192 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d1fd5ea2-3718-4dae-94fb-9711e55d8c53 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:56.099931 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d1fd5ea2-3718-4dae-94fb-9711e55d8c53 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:56.100531 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d1fd5ea2-3718-4dae-94fb-9711e55d8c53 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:56.141019 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d1fd5ea2-3718-4dae-94fb-9711e55d8c53 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:56.141706 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d1fd5ea2-3718-4dae-94fb-9711e55d8c53 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:56.142164 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d1fd5ea2-3718-4dae-94fb-9711e55d8c53 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:56.142718 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.objects.instance [None req-d1fd5ea2-3718-4dae-94fb-9711e55d8c53 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lazy-loading 'fault' on Instance uuid 75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a {{(pid=140491) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 21:03:56.150997 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.multi_cell_list [None req-25ab89e2-66d7-4d39-ae01-4dfe9c383d19 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=140492) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 08 21:03:56.191076 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-d1fd5ea2-3718-4dae-94fb-9711e55d8c53 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1698dee4a2bf4ea19a6ee0c3d5cb5c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b00ee5e7828469f95bd90548d35982a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:56.203752 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-d1fd5ea2-3718-4dae-94fb-9711e55d8c53 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] 10.222.0.26 "GET /compute/v2.1/servers/75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a" status: 200 len: 1311 microversion: 2.1 time: 0.123108 Oct 08 21:03:56.204336 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1443/2947] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:56 2022] GET /compute/v2.1/servers/75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a => generated 1311 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:56.216518 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-89d52775-d75d-42eb-b09d-4a503c738eb0 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:56.216518 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-89d52775-d75d-42eb-b09d-4a503c738eb0 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] [instance: ede2a1aa-f65b-424e-9034-15a2aaf13e60] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:56.217857 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-25ab89e2-66d7-4d39-ae01-4dfe9c383d19 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] 10.222.0.26 "GET /compute/v2.1/servers?ip=172.20.0.11" status: 200 len: 346 microversion: 2.1 time: 0.356644 Oct 08 21:03:56.218519 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1505/2948] 10.222.0.26 () {58 vars in 1154 bytes} [Sat Oct 8 21:03:55 2022] GET /compute/v2.1/servers?ip=172.20.0.11 => generated 346 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:03:56.228410 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-89d52775-d75d-42eb-b09d-4a503c738eb0 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:56.228930 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-89d52775-d75d-42eb-b09d-4a503c738eb0 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:56.229602 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-89d52775-d75d-42eb-b09d-4a503c738eb0 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:56.230229 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-89d52775-d75d-42eb-b09d-4a503c738eb0 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:56.230817 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-89d52775-d75d-42eb-b09d-4a503c738eb0 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:56.231439 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-89d52775-d75d-42eb-b09d-4a503c738eb0 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:56.237385 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=100 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:03:56.239734 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-4e8db91a-9622-4e3b-99ac-c5bb3b87dfc0 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:56.240380 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-4e8db91a-9622-4e3b-99ac-c5bb3b87dfc0 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] [instance: 814f7da9-1d8d-4695-8cfa-6db50c3e846a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:56.251987 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4e8db91a-9622-4e3b-99ac-c5bb3b87dfc0 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:56.260951 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4e8db91a-9622-4e3b-99ac-c5bb3b87dfc0 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:56.261851 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4e8db91a-9622-4e3b-99ac-c5bb3b87dfc0 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:56.262775 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4e8db91a-9622-4e3b-99ac-c5bb3b87dfc0 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:56.263657 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4e8db91a-9622-4e3b-99ac-c5bb3b87dfc0 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:56.264440 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4e8db91a-9622-4e3b-99ac-c5bb3b87dfc0 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:56.415182 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-89d52775-d75d-42eb-b09d-4a503c738eb0 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f60e33f334465fac1148669de3f00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4735bf74f33a4739800d766c82d973d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:56.418244 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-4e8db91a-9622-4e3b-99ac-c5bb3b87dfc0 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095debf3968c448fb3c3add0322d8d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc9bed6d76834f6fa66d681ecd9f4e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:56.423464 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-89d52775-d75d-42eb-b09d-4a503c738eb0 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] 10.222.0.26 "GET /compute/v2.1/servers/ede2a1aa-f65b-424e-9034-15a2aaf13e60" status: 200 len: 1334 microversion: 2.1 time: 0.215167 Oct 08 21:03:56.423980 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1444/2949] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:56 2022] GET /compute/v2.1/servers/ede2a1aa-f65b-424e-9034-15a2aaf13e60 => generated 1334 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:56.427516 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-4e8db91a-9622-4e3b-99ac-c5bb3b87dfc0 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] 10.222.0.26 "GET /compute/v2.1/servers/814f7da9-1d8d-4695-8cfa-6db50c3e846a" status: 200 len: 1510 microversion: 2.1 time: 0.195208 Oct 08 21:03:56.428204 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1506/2950] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:56 2022] GET /compute/v2.1/servers/814f7da9-1d8d-4695-8cfa-6db50c3e846a => generated 1510 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:56.432956 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-5ee04ab6-1c12-4505-856e-c9d0700e1c71 tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:56.433741 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-5ee04ab6-1c12-4505-856e-c9d0700e1c71 tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] [instance: 401433a8-84ff-4525-9a86-c0b6a517eeb3] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:56.439715 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5ee04ab6-1c12-4505-856e-c9d0700e1c71 tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:56.440319 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5ee04ab6-1c12-4505-856e-c9d0700e1c71 tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:56.440920 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5ee04ab6-1c12-4505-856e-c9d0700e1c71 tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:56.441692 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5ee04ab6-1c12-4505-856e-c9d0700e1c71 tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:56.442165 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5ee04ab6-1c12-4505-856e-c9d0700e1c71 tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:56.442603 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5ee04ab6-1c12-4505-856e-c9d0700e1c71 tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:56.442876 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-028f20f1-05e6-4528-8ccb-f8fa2bbdf292 tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:56.443598 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-028f20f1-05e6-4528-8ccb-f8fa2bbdf292 tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] [instance: 7fb18924-877c-4768-a503-718e32ae5765] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:56.450051 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-028f20f1-05e6-4528-8ccb-f8fa2bbdf292 tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:56.450641 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-028f20f1-05e6-4528-8ccb-f8fa2bbdf292 tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:56.451252 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-028f20f1-05e6-4528-8ccb-f8fa2bbdf292 tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:56.451964 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-028f20f1-05e6-4528-8ccb-f8fa2bbdf292 tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:56.452427 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-028f20f1-05e6-4528-8ccb-f8fa2bbdf292 tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:56.452853 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-028f20f1-05e6-4528-8ccb-f8fa2bbdf292 tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:56.474661 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5ee04ab6-1c12-4505-856e-c9d0700e1c71 tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:56.475432 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5ee04ab6-1c12-4505-856e-c9d0700e1c71 tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:56.475834 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5ee04ab6-1c12-4505-856e-c9d0700e1c71 tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:56.476556 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.objects.instance [None req-5ee04ab6-1c12-4505-856e-c9d0700e1c71 tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Lazy-loading 'fault' on Instance uuid 401433a8-84ff-4525-9a86-c0b6a517eeb3 {{(pid=140492) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 21:03:56.517634 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-5ee04ab6-1c12-4505-856e-c9d0700e1c71 tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e3216124a4f41b2b931a16c750649df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0310d9e59942729d685e6eb06c6460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:56.526095 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-5ee04ab6-1c12-4505-856e-c9d0700e1c71 tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] 10.222.0.26 "GET /compute/v2.1/servers/401433a8-84ff-4525-9a86-c0b6a517eeb3" status: 200 len: 1329 microversion: 2.1 time: 0.096668 Oct 08 21:03:56.526676 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1507/2951] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:56 2022] GET /compute/v2.1/servers/401433a8-84ff-4525-9a86-c0b6a517eeb3 => generated 1329 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:56.531103 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-d65e59de-7639-4ab7-a8c0-61702a7e4fdd tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:56.531721 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-d65e59de-7639-4ab7-a8c0-61702a7e4fdd tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] [instance: 3d7debe3-3039-401c-891d-4c6e4b96cbb8] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:56.536862 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-028f20f1-05e6-4528-8ccb-f8fa2bbdf292 tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd917f61a1c043f599ef923f41c3a938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a9dfe2733a844928b29194b54f4a0a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:56.538282 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d65e59de-7639-4ab7-a8c0-61702a7e4fdd tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:56.539057 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d65e59de-7639-4ab7-a8c0-61702a7e4fdd tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:56.539543 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d65e59de-7639-4ab7-a8c0-61702a7e4fdd tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:56.540250 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d65e59de-7639-4ab7-a8c0-61702a7e4fdd tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:56.540726 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d65e59de-7639-4ab7-a8c0-61702a7e4fdd tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:56.541167 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d65e59de-7639-4ab7-a8c0-61702a7e4fdd tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:56.545945 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-028f20f1-05e6-4528-8ccb-f8fa2bbdf292 tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd917f61a1c043f599ef923f41c3a938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a9dfe2733a844928b29194b54f4a0a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:56.547456 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-028f20f1-05e6-4528-8ccb-f8fa2bbdf292 tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd917f61a1c043f599ef923f41c3a938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a9dfe2733a844928b29194b54f4a0a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:56.548603 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-028f20f1-05e6-4528-8ccb-f8fa2bbdf292 tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] 10.222.0.26 "GET /compute/v2.1/servers/7fb18924-877c-4768-a503-718e32ae5765" status: 200 len: 1338 microversion: 2.47 time: 0.123691 Oct 08 21:03:56.549171 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1445/2952] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:03:56 2022] GET /compute/v2.1/servers/7fb18924-877c-4768-a503-718e32ae5765 => generated 1338 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:03:56.654905 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-5647919e-0731-47ad-a5bf-e35d49ff1b10 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:56.655532 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-5647919e-0731-47ad-a5bf-e35d49ff1b10 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] [instance: 136d0aa6-479d-4d9c-b633-23203ee44ae4] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:56.662670 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5647919e-0731-47ad-a5bf-e35d49ff1b10 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:56.663175 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5647919e-0731-47ad-a5bf-e35d49ff1b10 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:56.663626 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5647919e-0731-47ad-a5bf-e35d49ff1b10 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:56.664353 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5647919e-0731-47ad-a5bf-e35d49ff1b10 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:56.664814 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5647919e-0731-47ad-a5bf-e35d49ff1b10 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:56.665282 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5647919e-0731-47ad-a5bf-e35d49ff1b10 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:56.670644 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-d65e59de-7639-4ab7-a8c0-61702a7e4fdd tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095debf3968c448fb3c3add0322d8d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc9bed6d76834f6fa66d681ecd9f4e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:56.678789 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-d65e59de-7639-4ab7-a8c0-61702a7e4fdd tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] 10.222.0.26 "GET /compute/v2.1/servers/3d7debe3-3039-401c-891d-4c6e4b96cbb8" status: 200 len: 1512 microversion: 2.1 time: 0.151078 Oct 08 21:03:56.679311 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1508/2953] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:56 2022] GET /compute/v2.1/servers/3d7debe3-3039-401c-891d-4c6e4b96cbb8 => generated 1512 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:56.700124 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-91e73857-e2df-448f-b2c1-868e91f70a85 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:56.700752 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-91e73857-e2df-448f-b2c1-868e91f70a85 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] [instance: 0b52e623-6990-4978-811d-68fc294fe304] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:56.707564 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-91e73857-e2df-448f-b2c1-868e91f70a85 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:56.708059 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-91e73857-e2df-448f-b2c1-868e91f70a85 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:56.708508 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-91e73857-e2df-448f-b2c1-868e91f70a85 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:56.709247 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-91e73857-e2df-448f-b2c1-868e91f70a85 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:56.709714 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-91e73857-e2df-448f-b2c1-868e91f70a85 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:56.710146 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-91e73857-e2df-448f-b2c1-868e91f70a85 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:56.799122 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-5647919e-0731-47ad-a5bf-e35d49ff1b10 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2e13f1952a4e5bb23d57dd7fa31875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b2a56286924e2d953bebe717ce591b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:56.807575 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-5647919e-0731-47ad-a5bf-e35d49ff1b10 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] 10.222.0.26 "GET /compute/v2.1/servers/136d0aa6-479d-4d9c-b633-23203ee44ae4" status: 200 len: 1314 microversion: 2.1 time: 0.156527 Oct 08 21:03:56.808164 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1446/2954] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:56 2022] GET /compute/v2.1/servers/136d0aa6-479d-4d9c-b633-23203ee44ae4 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:03:56.852891 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-91e73857-e2df-448f-b2c1-868e91f70a85 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095debf3968c448fb3c3add0322d8d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc9bed6d76834f6fa66d681ecd9f4e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:56.861538 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-91e73857-e2df-448f-b2c1-868e91f70a85 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] 10.222.0.26 "GET /compute/v2.1/servers/0b52e623-6990-4978-811d-68fc294fe304" status: 200 len: 1511 microversion: 2.1 time: 0.165153 Oct 08 21:03:56.862126 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1509/2955] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:56 2022] GET /compute/v2.1/servers/0b52e623-6990-4978-811d-68fc294fe304 => generated 1511 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:03:56.882823 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-a282f3b2-e802-42e6-b6ab-a4fc374657a0 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:56.883444 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-a282f3b2-e802-42e6-b6ab-a4fc374657a0 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] [instance: 4e392800-b237-4d1d-8372-e635e2450b91] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:56.884759 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-71698e7b-ad51-4f34-984f-88d1b118dd72 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:56.889833 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a282f3b2-e802-42e6-b6ab-a4fc374657a0 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:56.890107 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-71698e7b-ad51-4f34-984f-88d1b118dd72 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '095debf3968c448fb3c3add0322d8d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc9bed6d76834f6fa66d681ecd9f4e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:56.890753 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a282f3b2-e802-42e6-b6ab-a4fc374657a0 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:56.891040 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-71698e7b-ad51-4f34-984f-88d1b118dd72 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Searching by: {'deleted': False, 'project_id': 'bc9bed6d76834f6fa66d681ecd9f4e90'} {{(pid=140492) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 08 21:03:56.891192 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a282f3b2-e802-42e6-b6ab-a4fc374657a0 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:56.891911 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a282f3b2-e802-42e6-b6ab-a4fc374657a0 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:56.892415 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a282f3b2-e802-42e6-b6ab-a4fc374657a0 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:56.893263 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a282f3b2-e802-42e6-b6ab-a4fc374657a0 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:56.897510 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-71698e7b-ad51-4f34-984f-88d1b118dd72 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:56.899435 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-71698e7b-ad51-4f34-984f-88d1b118dd72 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:56.899435 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-71698e7b-ad51-4f34-984f-88d1b118dd72 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:56.899435 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-71698e7b-ad51-4f34-984f-88d1b118dd72 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:56.899859 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-71698e7b-ad51-4f34-984f-88d1b118dd72 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:56.900067 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-71698e7b-ad51-4f34-984f-88d1b118dd72 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:56.931365 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.multi_cell_list [None req-71698e7b-ad51-4f34-984f-88d1b118dd72 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=140492) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 08 21:03:56.968442 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-71698e7b-ad51-4f34-984f-88d1b118dd72 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095debf3968c448fb3c3add0322d8d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc9bed6d76834f6fa66d681ecd9f4e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:56.975751 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-71698e7b-ad51-4f34-984f-88d1b118dd72 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:56.976507 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-71698e7b-ad51-4f34-984f-88d1b118dd72 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:56.976981 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-71698e7b-ad51-4f34-984f-88d1b118dd72 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:57.038681 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-a282f3b2-e802-42e6-b6ab-a4fc374657a0 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2395fe934d458faa80e28587458bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f455695c0214bfab0f412aa34417e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:57.046525 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-a282f3b2-e802-42e6-b6ab-a4fc374657a0 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] 10.222.0.26 "GET /compute/v2.1/servers/4e392800-b237-4d1d-8372-e635e2450b91" status: 200 len: 1314 microversion: 2.1 time: 0.168072 Oct 08 21:03:57.047110 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1447/2956] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:56 2022] GET /compute/v2.1/servers/4e392800-b237-4d1d-8372-e635e2450b91 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:03:57.103512 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-db22e111-3ee5-48a3-b286-68accac298ed tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:57.104244 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-db22e111-3ee5-48a3-b286-68accac298ed tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: 6ef37448-690b-4fcf-85f8-a2fb71207f38] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:57.106753 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-71698e7b-ad51-4f34-984f-88d1b118dd72 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] 10.222.0.26 "GET /compute/v2.1/servers/detail" status: 200 len: 4516 microversion: 2.1 time: 0.226387 Oct 08 21:03:57.107529 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1510/2957] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Oct 8 21:03:56 2022] GET /compute/v2.1/servers/detail => generated 4516 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:57.110492 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-db22e111-3ee5-48a3-b286-68accac298ed tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:57.110991 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-db22e111-3ee5-48a3-b286-68accac298ed tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:57.111443 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-db22e111-3ee5-48a3-b286-68accac298ed tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:57.112162 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-db22e111-3ee5-48a3-b286-68accac298ed tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:57.112632 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-db22e111-3ee5-48a3-b286-68accac298ed tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:57.113106 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-db22e111-3ee5-48a3-b286-68accac298ed tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:57.132792 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-74e73e0c-bbb5-4f4a-99aa-f9c3bb50ff60 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:57.137744 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-74e73e0c-bbb5-4f4a-99aa-f9c3bb50ff60 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '095debf3968c448fb3c3add0322d8d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc9bed6d76834f6fa66d681ecd9f4e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:57.138428 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-74e73e0c-bbb5-4f4a-99aa-f9c3bb50ff60 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': 'bc9bed6d76834f6fa66d681ecd9f4e90'} {{(pid=140492) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 08 21:03:57.205463 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-74e73e0c-bbb5-4f4a-99aa-f9c3bb50ff60 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:57.206032 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-74e73e0c-bbb5-4f4a-99aa-f9c3bb50ff60 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:57.206374 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-74e73e0c-bbb5-4f4a-99aa-f9c3bb50ff60 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:57.207790 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-74e73e0c-bbb5-4f4a-99aa-f9c3bb50ff60 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:57.208343 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-74e73e0c-bbb5-4f4a-99aa-f9c3bb50ff60 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:57.208776 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-74e73e0c-bbb5-4f4a-99aa-f9c3bb50ff60 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:57.251785 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-db22e111-3ee5-48a3-b286-68accac298ed tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:57.254764 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.multi_cell_list [None req-74e73e0c-bbb5-4f4a-99aa-f9c3bb50ff60 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=140492) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 08 21:03:57.261062 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-db22e111-3ee5-48a3-b286-68accac298ed tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/6ef37448-690b-4fcf-85f8-a2fb71207f38" status: 200 len: 1476 microversion: 2.1 time: 0.161479 Oct 08 21:03:57.269919 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1448/2958] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:57 2022] GET /compute/v2.1/servers/6ef37448-690b-4fcf-85f8-a2fb71207f38 => generated 1476 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:03:57.275802 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-6366e362-0dea-4bfe-be1f-d6dcf2e2a8de tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:57.279248 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-6366e362-0dea-4bfe-be1f-d6dcf2e2a8de tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] [instance: 75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:57.286158 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-74e73e0c-bbb5-4f4a-99aa-f9c3bb50ff60 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] 10.222.0.26 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1011 microversion: 2.1 time: 0.157318 Oct 08 21:03:57.286352 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6366e362-0dea-4bfe-be1f-d6dcf2e2a8de tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:57.286791 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6366e362-0dea-4bfe-be1f-d6dcf2e2a8de tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:57.287334 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6366e362-0dea-4bfe-be1f-d6dcf2e2a8de tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:57.288124 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6366e362-0dea-4bfe-be1f-d6dcf2e2a8de tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:57.288657 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6366e362-0dea-4bfe-be1f-d6dcf2e2a8de tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:57.289569 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6366e362-0dea-4bfe-be1f-d6dcf2e2a8de tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:57.295923 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1511/2959] 10.222.0.26 () {58 vars in 1150 bytes} [Sat Oct 8 21:03:57 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1011 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:03:57.301206 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-d44548cb-1ea1-484d-a904-df258e1eacc2 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:57.306303 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-d44548cb-1ea1-484d-a904-df258e1eacc2 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '095debf3968c448fb3c3add0322d8d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc9bed6d76834f6fa66d681ecd9f4e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:57.306975 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-d44548cb-1ea1-484d-a904-df258e1eacc2 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': 'bc9bed6d76834f6fa66d681ecd9f4e90'} {{(pid=140492) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 08 21:03:57.312215 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d44548cb-1ea1-484d-a904-df258e1eacc2 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:57.312698 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d44548cb-1ea1-484d-a904-df258e1eacc2 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:57.313141 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d44548cb-1ea1-484d-a904-df258e1eacc2 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:57.313908 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d44548cb-1ea1-484d-a904-df258e1eacc2 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:57.314368 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d44548cb-1ea1-484d-a904-df258e1eacc2 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:57.314795 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d44548cb-1ea1-484d-a904-df258e1eacc2 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:57.329963 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6366e362-0dea-4bfe-be1f-d6dcf2e2a8de tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:57.330827 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6366e362-0dea-4bfe-be1f-d6dcf2e2a8de tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:57.331291 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6366e362-0dea-4bfe-be1f-d6dcf2e2a8de tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:57.332476 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.objects.instance [None req-6366e362-0dea-4bfe-be1f-d6dcf2e2a8de tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lazy-loading 'fault' on Instance uuid 75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a {{(pid=140491) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 21:03:57.389596 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-6366e362-0dea-4bfe-be1f-d6dcf2e2a8de tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1698dee4a2bf4ea19a6ee0c3d5cb5c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b00ee5e7828469f95bd90548d35982a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:57.399239 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-6366e362-0dea-4bfe-be1f-d6dcf2e2a8de tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] 10.222.0.26 "GET /compute/v2.1/servers/75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a" status: 200 len: 1311 microversion: 2.1 time: 0.130708 Oct 08 21:03:57.399866 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1449/2960] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:57 2022] GET /compute/v2.1/servers/75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a => generated 1311 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:57.439827 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.multi_cell_list [None req-d44548cb-1ea1-484d-a904-df258e1eacc2 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=140492) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 08 21:03:57.446928 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-23e2fa81-25e8-413e-8497-4ecfcab6bc7e tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:57.449974 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-23e2fa81-25e8-413e-8497-4ecfcab6bc7e tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] [instance: ede2a1aa-f65b-424e-9034-15a2aaf13e60] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:57.457754 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-23e2fa81-25e8-413e-8497-4ecfcab6bc7e tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:57.458259 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-23e2fa81-25e8-413e-8497-4ecfcab6bc7e tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:57.458841 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-23e2fa81-25e8-413e-8497-4ecfcab6bc7e tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:57.459564 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-23e2fa81-25e8-413e-8497-4ecfcab6bc7e tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:57.460199 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-23e2fa81-25e8-413e-8497-4ecfcab6bc7e tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:57.460632 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-23e2fa81-25e8-413e-8497-4ecfcab6bc7e tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:57.508025 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-d44548cb-1ea1-484d-a904-df258e1eacc2 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] 10.222.0.26 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1011 microversion: 2.1 time: 0.210976 Oct 08 21:03:57.508961 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1512/2961] 10.222.0.26 () {58 vars in 1212 bytes} [Sat Oct 8 21:03:57 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1011 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:03:57.521253 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-bd65a402-31f9-42b3-a5db-124053a8e7e2 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:57.526464 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-bd65a402-31f9-42b3-a5db-124053a8e7e2 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '095debf3968c448fb3c3add0322d8d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc9bed6d76834f6fa66d681ecd9f4e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:57.527140 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-bd65a402-31f9-42b3-a5db-124053a8e7e2 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': 'bc9bed6d76834f6fa66d681ecd9f4e90'} {{(pid=140492) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 08 21:03:57.532555 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bd65a402-31f9-42b3-a5db-124053a8e7e2 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:57.533399 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bd65a402-31f9-42b3-a5db-124053a8e7e2 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:57.533557 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bd65a402-31f9-42b3-a5db-124053a8e7e2 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:57.534236 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bd65a402-31f9-42b3-a5db-124053a8e7e2 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:57.535255 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bd65a402-31f9-42b3-a5db-124053a8e7e2 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:57.535696 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bd65a402-31f9-42b3-a5db-124053a8e7e2 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:57.608631 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-23e2fa81-25e8-413e-8497-4ecfcab6bc7e tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f60e33f334465fac1148669de3f00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4735bf74f33a4739800d766c82d973d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:57.616617 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-23e2fa81-25e8-413e-8497-4ecfcab6bc7e tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] 10.222.0.26 "GET /compute/v2.1/servers/ede2a1aa-f65b-424e-9034-15a2aaf13e60" status: 200 len: 1668 microversion: 2.1 time: 0.173735 Oct 08 21:03:57.624989 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.multi_cell_list [None req-bd65a402-31f9-42b3-a5db-124053a8e7e2 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=140492) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 08 21:03:57.633593 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1450/2962] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:57 2022] GET /compute/v2.1/servers/ede2a1aa-f65b-424e-9034-15a2aaf13e60 => generated 1668 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:03:57.639563 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-b7df616f-00f8-455c-80e8-e1c228168e9f tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:57.640210 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-b7df616f-00f8-455c-80e8-e1c228168e9f tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] [instance: 401433a8-84ff-4525-9a86-c0b6a517eeb3] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:57.647269 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b7df616f-00f8-455c-80e8-e1c228168e9f tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:57.647766 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b7df616f-00f8-455c-80e8-e1c228168e9f tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:57.648215 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b7df616f-00f8-455c-80e8-e1c228168e9f tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:57.648942 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b7df616f-00f8-455c-80e8-e1c228168e9f tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:57.649443 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b7df616f-00f8-455c-80e8-e1c228168e9f tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:57.649873 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b7df616f-00f8-455c-80e8-e1c228168e9f tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:57.665882 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-b7df616f-00f8-455c-80e8-e1c228168e9f tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] HTTP exception thrown: Instance 401433a8-84ff-4525-9a86-c0b6a517eeb3 could not be found. Oct 08 21:03:57.669267 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-b7df616f-00f8-455c-80e8-e1c228168e9f tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Request method failure captured: Oct 08 21:03:57.669267 ncdv-master-1 devstack@n-api.service[140491]: request: GET /compute/v2.1/servers/401433a8-84ff-4525-9a86-c0b6a517eeb3 HTTP/1.1 Oct 08 21:03:57.669267 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:03:57.669267 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:03:57.669267 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:03:57.669267 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 21:03:57.669267 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:03:57.669267 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:03:57.669267 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:03:57.669267 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:03:57.669267 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeUh9lhu1zAsNryzKZom6Yx5udzKSeVp2iZDxMX-0HrBuvSNG_-eIHE9g0npDKTlUcBUKW5HZmWq01jPHhZN5xsugmuV2gkx1rU30bTx_9qAaVGx_pVF8xfqhQM5l51akXkKYp_PlVZveqqrIRCc4l5TlE8nJU0c4eD-A8ZLiGQPfc4 Oct 08 21:03:57.669267 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:03:57.669267 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:03:57.669267 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:03:57.669267 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:03:57.669267 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:03:57.669267 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:03:57.669267 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 9e0310d9e59942729d685e6eb06c6460 Oct 08 21:03:57.669267 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-185688184 Oct 08 21:03:57.669267 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:03:57.669267 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:03:57.669267 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9e0310d9e59942729d685e6eb06c6460"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9e0310d9e59942729d685e6eb06c6460"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9e0310d9e59942729d685e6eb06c6460"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9e0310d9e59942729d685e6eb06c6460"}]}] Oct 08 21:03:57.669267 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-185688184 Oct 08 21:03:57.669267 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 9e0310d9e59942729d685e6eb06c6460 Oct 08 21:03:57.669267 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-185688184 Oct 08 21:03:57.669267 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-AttachSCSIVolumeTestJSON-185688184-project Oct 08 21:03:57.669267 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:03:57.669267 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:03:57.669267 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 5e3216124a4f41b2b931a16c750649df Oct 08 21:03:57.669267 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-185688184-project Oct 08 21:03:57.669267 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:03:57.669267 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance 401433a8-84ff-4525-9a86-c0b6a517eeb3 could not be found. Oct 08 21:03:57.669267 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': '401433a8-84ff-4525-9a86-c0b6a517eeb3'} Oct 08 21:03:57.669267 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:03:57.669267 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:03:57.669267 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:03:57.669267 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:03:57.669267 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:03:57.669267 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:03:57.669267 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:03:57.669267 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:03:57.669267 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:03:57.669267 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:03:57.669267 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 401433a8-84ff-4525-9a86-c0b6a517eeb3 could not be found. Oct 08 21:03:57.669267 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:03:57.669267 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:03:57.669267 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:03:57.669267 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:03:57.669267 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:03:57.669267 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:03:57.669267 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:03:57.669267 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:03:57.669267 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:03:57.669267 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:03:57.669267 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:03:57.669267 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:03:57.669267 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:03:57.669267 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:03:57.669267 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:03:57.669267 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:03:57.669267 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 401433a8-84ff-4525-9a86-c0b6a517eeb3 could not be found. Oct 08 21:03:57.669267 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:03:57.669267 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:03:57.669267 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:03:57.678813 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:03:57.678813 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:03:57.678813 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:03:57.678813 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:03:57.678813 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:03:57.678813 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 401433a8-84ff-4525-9a86-c0b6a517eeb3 could not be found. Oct 08 21:03:57.678813 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:03:57.678813 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-b7df616f-00f8-455c-80e8-e1c228168e9f tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Returning 404 to user: Instance 401433a8-84ff-4525-9a86-c0b6a517eeb3 could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:03:57.678813 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-b7df616f-00f8-455c-80e8-e1c228168e9f tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] 10.222.0.26 "GET /compute/v2.1/servers/401433a8-84ff-4525-9a86-c0b6a517eeb3" status: 404 len: 111 microversion: 2.1 time: 0.036375 Oct 08 21:03:57.678813 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1451/2963] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:57 2022] GET /compute/v2.1/servers/401433a8-84ff-4525-9a86-c0b6a517eeb3 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:03:57.681215 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-b0abe865-a3e4-4dfd-87c0-ccd99626b4c9 tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:57.682018 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-b0abe865-a3e4-4dfd-87c0-ccd99626b4c9 tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] [instance: 7fb18924-877c-4768-a503-718e32ae5765] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:57.688498 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b0abe865-a3e4-4dfd-87c0-ccd99626b4c9 tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:57.688994 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b0abe865-a3e4-4dfd-87c0-ccd99626b4c9 tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:57.689533 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b0abe865-a3e4-4dfd-87c0-ccd99626b4c9 tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:57.690249 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b0abe865-a3e4-4dfd-87c0-ccd99626b4c9 tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:57.690716 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b0abe865-a3e4-4dfd-87c0-ccd99626b4c9 tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:57.691699 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b0abe865-a3e4-4dfd-87c0-ccd99626b4c9 tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:57.716317 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-bd65a402-31f9-42b3-a5db-124053a8e7e2 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] 10.222.0.26 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1011 microversion: 2.1 time: 0.199440 Oct 08 21:03:57.717255 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1513/2964] 10.222.0.26 () {58 vars in 1196 bytes} [Sat Oct 8 21:03:57 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1011 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:03:57.722131 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-8d574ff5-3bb3-4c16-bd73-e0a642da3622 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:57.722641 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-8d574ff5-3bb3-4c16-bd73-e0a642da3622 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] [instance: ede2a1aa-f65b-424e-9034-15a2aaf13e60] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:57.730171 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8d574ff5-3bb3-4c16-bd73-e0a642da3622 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:57.730756 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8d574ff5-3bb3-4c16-bd73-e0a642da3622 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:57.732111 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8d574ff5-3bb3-4c16-bd73-e0a642da3622 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:57.732898 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8d574ff5-3bb3-4c16-bd73-e0a642da3622 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:57.733402 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8d574ff5-3bb3-4c16-bd73-e0a642da3622 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:57.733846 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8d574ff5-3bb3-4c16-bd73-e0a642da3622 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:57.759755 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-8d574ff5-3bb3-4c16-bd73-e0a642da3622 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] 10.222.0.26 "GET /compute/v2.1/servers/ede2a1aa-f65b-424e-9034-15a2aaf13e60/ips" status: 200 len: 178 microversion: 2.1 time: 0.041398 Oct 08 21:03:57.760351 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1514/2965] 10.222.0.26 () {58 vars in 1248 bytes} [Sat Oct 8 21:03:57 2022] GET /compute/v2.1/servers/ede2a1aa-f65b-424e-9034-15a2aaf13e60/ips => generated 178 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:03:57.764901 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-81b7273b-965c-4c91-a3e4-2bebd960aa7c tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Calling method '.version_select at 0x7f1a8d0c2790>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:57.785360 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-b0abe865-a3e4-4dfd-87c0-ccd99626b4c9 tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd917f61a1c043f599ef923f41c3a938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a9dfe2733a844928b29194b54f4a0a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:57.786763 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-81b7273b-965c-4c91-a3e4-2bebd960aa7c tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-907560983" status: 202 len: 0 microversion: 2.1 time: 0.025200 Oct 08 21:03:57.790932 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1515/2966] 10.222.0.26 () {58 vars in 1218 bytes} [Sat Oct 8 21:03:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-907560983 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 21:03:57.792987 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-603ce226-b066-41ae-a49f-41b33c3a4968 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:57.799098 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-603ce226-b066-41ae-a49f-41b33c3a4968 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '095debf3968c448fb3c3add0322d8d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc9bed6d76834f6fa66d681ecd9f4e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:57.799995 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-603ce226-b066-41ae-a49f-41b33c3a4968 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Searching by: {'name': '-637299003', 'deleted': False, 'project_id': 'bc9bed6d76834f6fa66d681ecd9f4e90'} {{(pid=140492) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 08 21:03:57.804580 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-b0abe865-a3e4-4dfd-87c0-ccd99626b4c9 tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd917f61a1c043f599ef923f41c3a938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a9dfe2733a844928b29194b54f4a0a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:57.806082 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-b0abe865-a3e4-4dfd-87c0-ccd99626b4c9 tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd917f61a1c043f599ef923f41c3a938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a9dfe2733a844928b29194b54f4a0a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:57.807205 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-603ce226-b066-41ae-a49f-41b33c3a4968 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:57.807342 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-b0abe865-a3e4-4dfd-87c0-ccd99626b4c9 tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] 10.222.0.26 "GET /compute/v2.1/servers/7fb18924-877c-4768-a503-718e32ae5765" status: 200 len: 1338 microversion: 2.47 time: 0.130037 Oct 08 21:03:57.807776 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-603ce226-b066-41ae-a49f-41b33c3a4968 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:57.808497 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-603ce226-b066-41ae-a49f-41b33c3a4968 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:57.809365 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-603ce226-b066-41ae-a49f-41b33c3a4968 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:57.809895 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-603ce226-b066-41ae-a49f-41b33c3a4968 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:57.810436 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-603ce226-b066-41ae-a49f-41b33c3a4968 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:57.839148 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1452/2967] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:03:57 2022] GET /compute/v2.1/servers/7fb18924-877c-4768-a503-718e32ae5765 => generated 1338 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:03:57.851531 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-00e5669a-781f-40d3-be08-a2ea1e810f72 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:57.852416 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-00e5669a-781f-40d3-be08-a2ea1e810f72 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] [instance: ede2a1aa-f65b-424e-9034-15a2aaf13e60] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:57.869487 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-00e5669a-781f-40d3-be08-a2ea1e810f72 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:57.869990 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-00e5669a-781f-40d3-be08-a2ea1e810f72 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:57.870434 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-00e5669a-781f-40d3-be08-a2ea1e810f72 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:57.871152 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-00e5669a-781f-40d3-be08-a2ea1e810f72 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:57.871615 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-00e5669a-781f-40d3-be08-a2ea1e810f72 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:57.872118 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-00e5669a-781f-40d3-be08-a2ea1e810f72 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:57.906743 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-00e5669a-781f-40d3-be08-a2ea1e810f72 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] [instance: ede2a1aa-f65b-424e-9034-15a2aaf13e60] Going to try to terminate instance {{(pid=140491) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 21:03:57.907723 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.multi_cell_list [None req-603ce226-b066-41ae-a49f-41b33c3a4968 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=140492) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 08 21:03:57.910841 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=100 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:03:57.994485 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-603ce226-b066-41ae-a49f-41b33c3a4968 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] 10.222.0.26 "GET /compute/v2.1/servers?name=-637299003" status: 200 len: 345 microversion: 2.1 time: 0.205640 Oct 08 21:03:57.995635 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1516/2968] 10.222.0.26 () {58 vars in 1156 bytes} [Sat Oct 8 21:03:57 2022] GET /compute/v2.1/servers?name=-637299003 => generated 345 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:03:58.000415 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-69291dea-28c8-4652-b3f7-a4d39886d95f tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:58.002744 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-69291dea-28c8-4652-b3f7-a4d39886d95f tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] [instance: 136d0aa6-479d-4d9c-b633-23203ee44ae4] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:58.010337 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-69291dea-28c8-4652-b3f7-a4d39886d95f tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:58.011685 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-69291dea-28c8-4652-b3f7-a4d39886d95f tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:58.012398 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-69291dea-28c8-4652-b3f7-a4d39886d95f tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:58.013319 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-69291dea-28c8-4652-b3f7-a4d39886d95f tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:58.014173 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-69291dea-28c8-4652-b3f7-a4d39886d95f tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:58.014861 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-69291dea-28c8-4652-b3f7-a4d39886d95f tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:58.027528 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-00e5669a-781f-40d3-be08-a2ea1e810f72 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] 10.222.0.26 "DELETE /compute/v2.1/servers/ede2a1aa-f65b-424e-9034-15a2aaf13e60" status: 204 len: 0 microversion: 2.1 time: 0.184003 Oct 08 21:03:58.028524 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1453/2969] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:03:57 2022] DELETE /compute/v2.1/servers/ede2a1aa-f65b-424e-9034-15a2aaf13e60 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 21:03:58.042500 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-aff3ebea-8838-4f07-bc2f-0238f388836a tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:58.056281 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-aff3ebea-8838-4f07-bc2f-0238f388836a tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '095debf3968c448fb3c3add0322d8d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc9bed6d76834f6fa66d681ecd9f4e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:58.057059 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-aff3ebea-8838-4f07-bc2f-0238f388836a tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': 'bc9bed6d76834f6fa66d681ecd9f4e90'} {{(pid=140491) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 08 21:03:58.062782 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-aff3ebea-8838-4f07-bc2f-0238f388836a tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:58.063474 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-aff3ebea-8838-4f07-bc2f-0238f388836a tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:58.064238 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-aff3ebea-8838-4f07-bc2f-0238f388836a tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:58.065600 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-aff3ebea-8838-4f07-bc2f-0238f388836a tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:58.066786 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-aff3ebea-8838-4f07-bc2f-0238f388836a tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:58.067374 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-aff3ebea-8838-4f07-bc2f-0238f388836a tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:58.180776 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.multi_cell_list [None req-aff3ebea-8838-4f07-bc2f-0238f388836a tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=140491) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 08 21:03:58.201526 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-69291dea-28c8-4652-b3f7-a4d39886d95f tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2e13f1952a4e5bb23d57dd7fa31875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b2a56286924e2d953bebe717ce591b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:58.210750 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-69291dea-28c8-4652-b3f7-a4d39886d95f tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] 10.222.0.26 "GET /compute/v2.1/servers/136d0aa6-479d-4d9c-b633-23203ee44ae4" status: 200 len: 1314 microversion: 2.1 time: 0.213822 Oct 08 21:03:58.212422 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1517/2970] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:57 2022] GET /compute/v2.1/servers/136d0aa6-479d-4d9c-b633-23203ee44ae4 => generated 1314 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:58.219048 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-f064a480-d248-4c99-b9b6-f9e8e77ded8e tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:58.220057 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-f064a480-d248-4c99-b9b6-f9e8e77ded8e tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] [instance: ede2a1aa-f65b-424e-9034-15a2aaf13e60] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:58.229974 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f064a480-d248-4c99-b9b6-f9e8e77ded8e tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:58.230406 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f064a480-d248-4c99-b9b6-f9e8e77ded8e tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:58.231019 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f064a480-d248-4c99-b9b6-f9e8e77ded8e tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:58.231922 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f064a480-d248-4c99-b9b6-f9e8e77ded8e tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:58.232389 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f064a480-d248-4c99-b9b6-f9e8e77ded8e tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:58.232821 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f064a480-d248-4c99-b9b6-f9e8e77ded8e tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:58.265639 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-aff3ebea-8838-4f07-bc2f-0238f388836a tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] 10.222.0.26 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1011 microversion: 2.1 time: 0.234969 Oct 08 21:03:58.266764 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1454/2971] 10.222.0.26 () {58 vars in 1154 bytes} [Sat Oct 8 21:03:58 2022] GET /compute/v2.1/servers?name=-instance => generated 1011 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:58.271754 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-bffc07b0-d540-4f98-a936-a2e717d420d3 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:58.272490 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-bffc07b0-d540-4f98-a936-a2e717d420d3 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] [instance: 4e392800-b237-4d1d-8372-e635e2450b91] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:58.279464 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bffc07b0-d540-4f98-a936-a2e717d420d3 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:58.280195 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bffc07b0-d540-4f98-a936-a2e717d420d3 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:58.280632 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bffc07b0-d540-4f98-a936-a2e717d420d3 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:58.281383 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bffc07b0-d540-4f98-a936-a2e717d420d3 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:58.281843 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bffc07b0-d540-4f98-a936-a2e717d420d3 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:58.282275 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bffc07b0-d540-4f98-a936-a2e717d420d3 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:58.406144 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-f064a480-d248-4c99-b9b6-f9e8e77ded8e tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f60e33f334465fac1148669de3f00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4735bf74f33a4739800d766c82d973d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:58.415378 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-f064a480-d248-4c99-b9b6-f9e8e77ded8e tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] 10.222.0.26 "GET /compute/v2.1/servers/ede2a1aa-f65b-424e-9034-15a2aaf13e60" status: 200 len: 1674 microversion: 2.1 time: 0.201660 Oct 08 21:03:58.417299 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1518/2972] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:58 2022] GET /compute/v2.1/servers/ede2a1aa-f65b-424e-9034-15a2aaf13e60 => generated 1674 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:58.421488 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-483fea49-443b-486e-9db0-a0595f6328e2 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:58.427511 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-483fea49-443b-486e-9db0-a0595f6328e2 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '095debf3968c448fb3c3add0322d8d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc9bed6d76834f6fa66d681ecd9f4e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:58.428323 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-483fea49-443b-486e-9db0-a0595f6328e2 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-63729900', 'deleted': False, 'project_id': 'bc9bed6d76834f6fa66d681ecd9f4e90'} {{(pid=140492) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 08 21:03:58.433562 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-483fea49-443b-486e-9db0-a0595f6328e2 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:58.434050 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-483fea49-443b-486e-9db0-a0595f6328e2 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:58.434490 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-483fea49-443b-486e-9db0-a0595f6328e2 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:58.435214 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-483fea49-443b-486e-9db0-a0595f6328e2 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:58.435678 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-483fea49-443b-486e-9db0-a0595f6328e2 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:58.436101 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-483fea49-443b-486e-9db0-a0595f6328e2 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:58.512870 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-bffc07b0-d540-4f98-a936-a2e717d420d3 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2395fe934d458faa80e28587458bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f455695c0214bfab0f412aa34417e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:58.519361 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.multi_cell_list [None req-483fea49-443b-486e-9db0-a0595f6328e2 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=140492) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 08 21:03:58.521344 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-bffc07b0-d540-4f98-a936-a2e717d420d3 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] 10.222.0.26 "GET /compute/v2.1/servers/4e392800-b237-4d1d-8372-e635e2450b91" status: 200 len: 1314 microversion: 2.1 time: 0.253382 Oct 08 21:03:58.522325 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1455/2973] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:58 2022] GET /compute/v2.1/servers/4e392800-b237-4d1d-8372-e635e2450b91 => generated 1314 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:58.526992 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-334d99f6-2baf-4845-a3be-d300865b2e50 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:58.527594 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-334d99f6-2baf-4845-a3be-d300865b2e50 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: 6ef37448-690b-4fcf-85f8-a2fb71207f38] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:58.533388 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-334d99f6-2baf-4845-a3be-d300865b2e50 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:58.534086 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-334d99f6-2baf-4845-a3be-d300865b2e50 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:58.536843 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-334d99f6-2baf-4845-a3be-d300865b2e50 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:58.537835 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-334d99f6-2baf-4845-a3be-d300865b2e50 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:58.538402 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-334d99f6-2baf-4845-a3be-d300865b2e50 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:58.538896 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-334d99f6-2baf-4845-a3be-d300865b2e50 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:58.590189 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-483fea49-443b-486e-9db0-a0595f6328e2 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] 10.222.0.26 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-63729900" status: 200 len: 345 microversion: 2.1 time: 0.173142 Oct 08 21:03:58.590789 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1519/2974] 10.222.0.26 () {58 vars in 1226 bytes} [Sat Oct 8 21:03:58 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-63729900 => generated 345 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:03:58.595531 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-92d41362-c72a-4c7e-a278-97cce6f3232a tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:58.595839 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-92d41362-c72a-4c7e-a278-97cce6f3232a tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] [instance: 75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:58.603896 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-92d41362-c72a-4c7e-a278-97cce6f3232a tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:58.604394 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-92d41362-c72a-4c7e-a278-97cce6f3232a tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:58.604836 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-92d41362-c72a-4c7e-a278-97cce6f3232a tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:58.605572 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-92d41362-c72a-4c7e-a278-97cce6f3232a tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:58.606067 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-92d41362-c72a-4c7e-a278-97cce6f3232a tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:58.606495 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-92d41362-c72a-4c7e-a278-97cce6f3232a tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:58.620466 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-92d41362-c72a-4c7e-a278-97cce6f3232a tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] HTTP exception thrown: Instance 75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a could not be found. Oct 08 21:03:58.622266 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-92d41362-c72a-4c7e-a278-97cce6f3232a tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Request method failure captured: Oct 08 21:03:58.622266 ncdv-master-1 devstack@n-api.service[140492]: request: GET /compute/v2.1/servers/75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a HTTP/1.1 Oct 08 21:03:58.622266 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:03:58.622266 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:03:58.622266 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:03:58.622266 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 21:03:58.622266 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:03:58.622266 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:03:58.622266 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:03:58.622266 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:03:58.622266 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeS0fE1W4PvU2_7k8u76nOm9Y1zh9DtzN6SifZox8c4Ee-O4iYj3CcpXLLEG93O-SwetyStVJsCOhK1z0DAluVdyejBt-R2ozc-SxCa3q7lzUNWL-Kx89hV0cNzOobKFM-EJsBUodFQ4EWnFtqD_Q-5HZD9KoD2jZ3YWHd3RuK5iGsY Oct 08 21:03:58.622266 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:03:58.622266 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:03:58.622266 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:03:58.622266 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:03:58.622266 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:03:58.622266 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:03:58.622266 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 8b00ee5e7828469f95bd90548d35982a Oct 08 21:03:58.622266 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1823882791 Oct 08 21:03:58.622266 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:03:58.622266 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:03:58.622266 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8b00ee5e7828469f95bd90548d35982a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8b00ee5e7828469f95bd90548d35982a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8b00ee5e7828469f95bd90548d35982a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8b00ee5e7828469f95bd90548d35982a"}]}] Oct 08 21:03:58.622266 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1823882791 Oct 08 21:03:58.622266 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 8b00ee5e7828469f95bd90548d35982a Oct 08 21:03:58.622266 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1823882791 Oct 08 21:03:58.622266 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-ServerRescueNegativeTestJSON-1823882791-project Oct 08 21:03:58.622266 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:03:58.622266 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:03:58.622266 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 1698dee4a2bf4ea19a6ee0c3d5cb5c09 Oct 08 21:03:58.622266 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1823882791-project Oct 08 21:03:58.622266 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 21:03:58.622266 ncdv-master-1 devstack@n-api.service[140492]: exception: Instance 75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a could not be found. Oct 08 21:03:58.622266 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': '75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a'} Oct 08 21:03:58.622266 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:03:58.622266 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:03:58.622266 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:03:58.622266 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:03:58.622266 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:03:58.622266 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:03:58.622266 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:03:58.622266 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:03:58.622266 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:03:58.622266 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:03:58.622266 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a could not be found. Oct 08 21:03:58.622266 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:03:58.622266 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:03:58.622266 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:03:58.622266 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:03:58.622266 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:03:58.622266 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:03:58.622266 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:03:58.622266 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:03:58.622266 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:03:58.622266 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:03:58.622266 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:03:58.622266 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:03:58.622266 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:03:58.622266 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:03:58.622266 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:03:58.622266 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:03:58.622266 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a could not be found. Oct 08 21:03:58.622266 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:03:58.622266 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:03:58.629278 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:03:58.629278 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:03:58.629278 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:03:58.629278 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:03:58.629278 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:03:58.629278 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:03:58.629278 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a could not be found. Oct 08 21:03:58.629278 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:03:58.629278 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-92d41362-c72a-4c7e-a278-97cce6f3232a tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Returning 404 to user: Instance 75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:03:58.629278 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-92d41362-c72a-4c7e-a278-97cce6f3232a tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] 10.222.0.26 "GET /compute/v2.1/servers/75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a" status: 404 len: 111 microversion: 2.1 time: 0.031956 Oct 08 21:03:58.629278 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1520/2975] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:58 2022] GET /compute/v2.1/servers/75ebfbfd-9cd9-4dd9-a6e1-f4c138255a0a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:03:58.632006 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-0df60b7c-d094-42e8-9ba4-61c8b0a5b2cd tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:58.632501 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-0df60b7c-d094-42e8-9ba4-61c8b0a5b2cd tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] [instance: 0b52e623-6990-4978-811d-68fc294fe304] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:58.638835 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0df60b7c-d094-42e8-9ba4-61c8b0a5b2cd tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:58.639268 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0df60b7c-d094-42e8-9ba4-61c8b0a5b2cd tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:58.639712 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0df60b7c-d094-42e8-9ba4-61c8b0a5b2cd tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:58.640450 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0df60b7c-d094-42e8-9ba4-61c8b0a5b2cd tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:58.640927 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0df60b7c-d094-42e8-9ba4-61c8b0a5b2cd tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:58.641375 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0df60b7c-d094-42e8-9ba4-61c8b0a5b2cd tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:58.667638 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-0df60b7c-d094-42e8-9ba4-61c8b0a5b2cd tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] [instance: 0b52e623-6990-4978-811d-68fc294fe304] Going to try to terminate instance {{(pid=140492) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 21:03:58.745612 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-0df60b7c-d094-42e8-9ba4-61c8b0a5b2cd tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] 10.222.0.26 "DELETE /compute/v2.1/servers/0b52e623-6990-4978-811d-68fc294fe304" status: 204 len: 0 microversion: 2.1 time: 0.117191 Oct 08 21:03:58.746594 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1521/2976] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:03:58 2022] DELETE /compute/v2.1/servers/0b52e623-6990-4978-811d-68fc294fe304 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 21:03:58.752008 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-69ba2468-a2d5-48b7-ba09-aae6eed76b19 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:58.752659 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-69ba2468-a2d5-48b7-ba09-aae6eed76b19 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] [instance: 579b0f8b-ccae-4c2b-bb48-1da1aaf6a138] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:58.759353 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-69ba2468-a2d5-48b7-ba09-aae6eed76b19 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:58.759846 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-69ba2468-a2d5-48b7-ba09-aae6eed76b19 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:58.760342 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-69ba2468-a2d5-48b7-ba09-aae6eed76b19 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:58.760995 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-69ba2468-a2d5-48b7-ba09-aae6eed76b19 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:58.761509 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-69ba2468-a2d5-48b7-ba09-aae6eed76b19 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:58.761946 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-69ba2468-a2d5-48b7-ba09-aae6eed76b19 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:58.769597 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-334d99f6-2baf-4845-a3be-d300865b2e50 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:58.781703 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-334d99f6-2baf-4845-a3be-d300865b2e50 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/6ef37448-690b-4fcf-85f8-a2fb71207f38" status: 200 len: 1476 microversion: 2.1 time: 0.255341 Oct 08 21:03:58.781703 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1456/2977] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:58 2022] GET /compute/v2.1/servers/6ef37448-690b-4fcf-85f8-a2fb71207f38 => generated 1476 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:58.785545 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-7c9f6de4-478c-4650-a494-ffedd99b187a tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:58.786242 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-7c9f6de4-478c-4650-a494-ffedd99b187a tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] [instance: 0b52e623-6990-4978-811d-68fc294fe304] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:58.790570 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-69ba2468-a2d5-48b7-ba09-aae6eed76b19 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] [instance: 579b0f8b-ccae-4c2b-bb48-1da1aaf6a138] Going to try to terminate instance {{(pid=140492) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 21:03:58.792216 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7c9f6de4-478c-4650-a494-ffedd99b187a tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:58.792863 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7c9f6de4-478c-4650-a494-ffedd99b187a tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:58.793425 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7c9f6de4-478c-4650-a494-ffedd99b187a tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:58.794199 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7c9f6de4-478c-4650-a494-ffedd99b187a tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:58.794740 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7c9f6de4-478c-4650-a494-ffedd99b187a tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:58.795238 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7c9f6de4-478c-4650-a494-ffedd99b187a tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:58.870323 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:03:58.882448 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-69ba2468-a2d5-48b7-ba09-aae6eed76b19 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] 10.222.0.26 "DELETE /compute/v2.1/servers/579b0f8b-ccae-4c2b-bb48-1da1aaf6a138" status: 204 len: 0 microversion: 2.1 time: 0.134198 Oct 08 21:03:58.883574 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1522/2978] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:03:58 2022] DELETE /compute/v2.1/servers/579b0f8b-ccae-4c2b-bb48-1da1aaf6a138 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 21:03:58.890848 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-624894d1-01d1-42fc-a09e-09f3e1edb577 tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:58.891656 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-624894d1-01d1-42fc-a09e-09f3e1edb577 tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] [instance: 7fb18924-877c-4768-a503-718e32ae5765] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:58.898845 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-624894d1-01d1-42fc-a09e-09f3e1edb577 tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:58.899549 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-624894d1-01d1-42fc-a09e-09f3e1edb577 tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:58.900343 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-624894d1-01d1-42fc-a09e-09f3e1edb577 tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:58.901028 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-624894d1-01d1-42fc-a09e-09f3e1edb577 tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:58.901757 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-624894d1-01d1-42fc-a09e-09f3e1edb577 tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:58.902360 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-624894d1-01d1-42fc-a09e-09f3e1edb577 tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:58.977888 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-7c9f6de4-478c-4650-a494-ffedd99b187a tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095debf3968c448fb3c3add0322d8d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc9bed6d76834f6fa66d681ecd9f4e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:58.986124 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-7c9f6de4-478c-4650-a494-ffedd99b187a tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] 10.222.0.26 "GET /compute/v2.1/servers/0b52e623-6990-4978-811d-68fc294fe304" status: 200 len: 1517 microversion: 2.1 time: 0.205654 Oct 08 21:03:58.986699 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1457/2979] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:58 2022] GET /compute/v2.1/servers/0b52e623-6990-4978-811d-68fc294fe304 => generated 1517 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:58.991501 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-6b98229b-0a3d-4513-b4ba-505f2b965c99 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:58.992113 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-6b98229b-0a3d-4513-b4ba-505f2b965c99 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] [instance: 579b0f8b-ccae-4c2b-bb48-1da1aaf6a138] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:58.997900 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6b98229b-0a3d-4513-b4ba-505f2b965c99 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:58.998397 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6b98229b-0a3d-4513-b4ba-505f2b965c99 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:58.998996 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6b98229b-0a3d-4513-b4ba-505f2b965c99 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:58.999706 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6b98229b-0a3d-4513-b4ba-505f2b965c99 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:59.000163 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6b98229b-0a3d-4513-b4ba-505f2b965c99 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:59.000588 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6b98229b-0a3d-4513-b4ba-505f2b965c99 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:59.005604 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-624894d1-01d1-42fc-a09e-09f3e1edb577 tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd917f61a1c043f599ef923f41c3a938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a9dfe2733a844928b29194b54f4a0a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:59.013995 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-624894d1-01d1-42fc-a09e-09f3e1edb577 tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd917f61a1c043f599ef923f41c3a938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a9dfe2733a844928b29194b54f4a0a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:59.015387 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-624894d1-01d1-42fc-a09e-09f3e1edb577 tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd917f61a1c043f599ef923f41c3a938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a9dfe2733a844928b29194b54f4a0a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:59.016565 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-624894d1-01d1-42fc-a09e-09f3e1edb577 tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] 10.222.0.26 "GET /compute/v2.1/servers/7fb18924-877c-4768-a503-718e32ae5765" status: 200 len: 1359 microversion: 2.47 time: 0.131810 Oct 08 21:03:59.017136 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1523/2980] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:03:58 2022] GET /compute/v2.1/servers/7fb18924-877c-4768-a503-718e32ae5765 => generated 1359 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:03:59.043643 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-5671298c-d259-499a-af6f-83a7eaeb9620 tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-128589046"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:03:59.046072 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-5671298c-d259-499a-af6f-83a7eaeb9620 tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] [instance: 7fb18924-877c-4768-a503-718e32ae5765] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:59.053213 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5671298c-d259-499a-af6f-83a7eaeb9620 tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:59.053718 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5671298c-d259-499a-af6f-83a7eaeb9620 tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:59.054168 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5671298c-d259-499a-af6f-83a7eaeb9620 tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:59.054868 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5671298c-d259-499a-af6f-83a7eaeb9620 tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:59.055331 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5671298c-d259-499a-af6f-83a7eaeb9620 tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:59.055765 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5671298c-d259-499a-af6f-83a7eaeb9620 tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:59.159297 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-6b98229b-0a3d-4513-b4ba-505f2b965c99 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1698dee4a2bf4ea19a6ee0c3d5cb5c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b00ee5e7828469f95bd90548d35982a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:59.168215 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-6b98229b-0a3d-4513-b4ba-505f2b965c99 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] 10.222.0.26 "GET /compute/v2.1/servers/579b0f8b-ccae-4c2b-bb48-1da1aaf6a138" status: 200 len: 1523 microversion: 2.1 time: 0.180335 Oct 08 21:03:59.168881 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1458/2981] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:58 2022] GET /compute/v2.1/servers/579b0f8b-ccae-4c2b-bb48-1da1aaf6a138 => generated 1523 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:59.235072 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-31ff2ba0-a204-4e27-9956-c2c5711c371d tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:59.235892 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-31ff2ba0-a204-4e27-9956-c2c5711c371d tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] [instance: 136d0aa6-479d-4d9c-b633-23203ee44ae4] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:59.243386 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-31ff2ba0-a204-4e27-9956-c2c5711c371d tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:59.244126 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-31ff2ba0-a204-4e27-9956-c2c5711c371d tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:59.244650 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-31ff2ba0-a204-4e27-9956-c2c5711c371d tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:59.245555 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-31ff2ba0-a204-4e27-9956-c2c5711c371d tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:59.246695 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-31ff2ba0-a204-4e27-9956-c2c5711c371d tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:59.247201 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-31ff2ba0-a204-4e27-9956-c2c5711c371d tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:59.252111 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:03:59.268397 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-5671298c-d259-499a-af6f-83a7eaeb9620 tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] 10.222.0.26 "POST /compute/v2.1/servers/7fb18924-877c-4768-a503-718e32ae5765/action" status: 202 len: 52 microversion: 2.47 time: 0.228392 Oct 08 21:03:59.273239 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1524/2982] 10.222.0.26 () {62 vars in 1319 bytes} [Sat Oct 8 21:03:59 2022] POST /compute/v2.1/servers/7fb18924-877c-4768-a503-718e32ae5765/action => generated 52 bytes in 230 msecs (HTTP/1.1 202) 9 headers in 364 bytes (2 switches on core 0) Oct 08 21:03:59.283170 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-1744fd78-00bf-47cc-b2fb-d7c991968816 tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:59.283897 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-1744fd78-00bf-47cc-b2fb-d7c991968816 tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] [instance: 7fb18924-877c-4768-a503-718e32ae5765] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:59.290922 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1744fd78-00bf-47cc-b2fb-d7c991968816 tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:59.291501 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1744fd78-00bf-47cc-b2fb-d7c991968816 tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:59.292022 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1744fd78-00bf-47cc-b2fb-d7c991968816 tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:59.292825 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1744fd78-00bf-47cc-b2fb-d7c991968816 tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:59.293402 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1744fd78-00bf-47cc-b2fb-d7c991968816 tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:59.293911 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1744fd78-00bf-47cc-b2fb-d7c991968816 tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:59.321857 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-1744fd78-00bf-47cc-b2fb-d7c991968816 tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] [instance: 7fb18924-877c-4768-a503-718e32ae5765] Going to try to terminate instance {{(pid=140492) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 21:03:59.426526 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-1744fd78-00bf-47cc-b2fb-d7c991968816 tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] 10.222.0.26 "DELETE /compute/v2.1/servers/7fb18924-877c-4768-a503-718e32ae5765" status: 204 len: 0 microversion: 2.47 time: 0.147019 Oct 08 21:03:59.427062 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1525/2983] 10.222.0.26 () {60 vars in 1280 bytes} [Sat Oct 8 21:03:59 2022] DELETE /compute/v2.1/servers/7fb18924-877c-4768-a503-718e32ae5765 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 08 21:03:59.438824 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-31ff2ba0-a204-4e27-9956-c2c5711c371d tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2e13f1952a4e5bb23d57dd7fa31875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b2a56286924e2d953bebe717ce591b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:59.442382 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-976e6308-4971-4e8c-9ab0-f4ea1e5e476d tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:59.444000 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-976e6308-4971-4e8c-9ab0-f4ea1e5e476d tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] [instance: 7fb18924-877c-4768-a503-718e32ae5765] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:59.451077 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-976e6308-4971-4e8c-9ab0-f4ea1e5e476d tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:59.451712 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-976e6308-4971-4e8c-9ab0-f4ea1e5e476d tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:59.452254 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-976e6308-4971-4e8c-9ab0-f4ea1e5e476d tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:59.452772 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-31ff2ba0-a204-4e27-9956-c2c5711c371d tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] 10.222.0.26 "GET /compute/v2.1/servers/136d0aa6-479d-4d9c-b633-23203ee44ae4" status: 200 len: 1314 microversion: 2.1 time: 0.221604 Oct 08 21:03:59.453467 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-976e6308-4971-4e8c-9ab0-f4ea1e5e476d tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:59.453925 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-976e6308-4971-4e8c-9ab0-f4ea1e5e476d tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:59.454523 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-976e6308-4971-4e8c-9ab0-f4ea1e5e476d tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:59.454902 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1459/2984] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:59 2022] GET /compute/v2.1/servers/136d0aa6-479d-4d9c-b633-23203ee44ae4 => generated 1314 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:03:59.469527 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-7dc0fabf-7a19-4672-8a57-93b5ee765ac8 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:59.472513 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-7dc0fabf-7a19-4672-8a57-93b5ee765ac8 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] [instance: ede2a1aa-f65b-424e-9034-15a2aaf13e60] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:59.486612 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:03:59.491920 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7dc0fabf-7a19-4672-8a57-93b5ee765ac8 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:59.493423 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7dc0fabf-7a19-4672-8a57-93b5ee765ac8 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:59.495418 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7dc0fabf-7a19-4672-8a57-93b5ee765ac8 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:59.496330 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7dc0fabf-7a19-4672-8a57-93b5ee765ac8 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:59.497550 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7dc0fabf-7a19-4672-8a57-93b5ee765ac8 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:59.497991 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7dc0fabf-7a19-4672-8a57-93b5ee765ac8 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:59.534140 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-976e6308-4971-4e8c-9ab0-f4ea1e5e476d tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd917f61a1c043f599ef923f41c3a938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a9dfe2733a844928b29194b54f4a0a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:59.540419 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=4,nova_cell1:INSERT=4 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:03:59.544782 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-976e6308-4971-4e8c-9ab0-f4ea1e5e476d tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd917f61a1c043f599ef923f41c3a938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a9dfe2733a844928b29194b54f4a0a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:59.546737 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-976e6308-4971-4e8c-9ab0-f4ea1e5e476d tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd917f61a1c043f599ef923f41c3a938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a9dfe2733a844928b29194b54f4a0a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:59.548142 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-976e6308-4971-4e8c-9ab0-f4ea1e5e476d tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] 10.222.0.26 "GET /compute/v2.1/servers/7fb18924-877c-4768-a503-718e32ae5765" status: 200 len: 1365 microversion: 2.47 time: 0.116812 Oct 08 21:03:59.549312 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1526/2985] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:03:59 2022] GET /compute/v2.1/servers/7fb18924-877c-4768-a503-718e32ae5765 => generated 1365 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:03:59.554950 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-9324b0e9-d8f3-468e-98a6-8abc5e530bd5 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:59.555648 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-9324b0e9-d8f3-468e-98a6-8abc5e530bd5 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] [instance: 4e392800-b237-4d1d-8372-e635e2450b91] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:59.562564 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9324b0e9-d8f3-468e-98a6-8abc5e530bd5 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:59.563122 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9324b0e9-d8f3-468e-98a6-8abc5e530bd5 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:59.564030 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9324b0e9-d8f3-468e-98a6-8abc5e530bd5 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:59.564422 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9324b0e9-d8f3-468e-98a6-8abc5e530bd5 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:59.564977 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9324b0e9-d8f3-468e-98a6-8abc5e530bd5 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:59.565514 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9324b0e9-d8f3-468e-98a6-8abc5e530bd5 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:59.692236 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-7dc0fabf-7a19-4672-8a57-93b5ee765ac8 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f60e33f334465fac1148669de3f00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4735bf74f33a4739800d766c82d973d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:59.706575 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-7dc0fabf-7a19-4672-8a57-93b5ee765ac8 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] 10.222.0.26 "GET /compute/v2.1/servers/ede2a1aa-f65b-424e-9034-15a2aaf13e60" status: 200 len: 1674 microversion: 2.1 time: 0.249900 Oct 08 21:03:59.707404 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1460/2986] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:59 2022] GET /compute/v2.1/servers/ede2a1aa-f65b-424e-9034-15a2aaf13e60 => generated 1674 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:59.719109 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-c61b3f3d-ccbb-4300-9521-eff70f3d9bd4 req-0b385e79-83dc-4483-b772-64b10a5d381e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "136d0aa6-479d-4d9c-b633-23203ee44ae4", "name": "network-vif-plugged", "status": "completed", "tag": "d41be44e-6c58-4f86-ad3d-4f4cdf8c4028"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:03:59.744543 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-c61b3f3d-ccbb-4300-9521-eff70f3d9bd4 req-0b385e79-83dc-4483-b772-64b10a5d381e service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:59.745118 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-c61b3f3d-ccbb-4300-9521-eff70f3d9bd4 req-0b385e79-83dc-4483-b772-64b10a5d381e service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:59.745870 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-c61b3f3d-ccbb-4300-9521-eff70f3d9bd4 req-0b385e79-83dc-4483-b772-64b10a5d381e service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:59.754297 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-9324b0e9-d8f3-468e-98a6-8abc5e530bd5 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2395fe934d458faa80e28587458bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f455695c0214bfab0f412aa34417e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:59.760436 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-c61b3f3d-ccbb-4300-9521-eff70f3d9bd4 req-0b385e79-83dc-4483-b772-64b10a5d381e service nova] Creating event network-vif-plugged:d41be44e-6c58-4f86-ad3d-4f4cdf8c4028 for instance 136d0aa6-479d-4d9c-b633-23203ee44ae4 on nch2-master-1 Oct 08 21:03:59.762493 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-9324b0e9-d8f3-468e-98a6-8abc5e530bd5 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] 10.222.0.26 "GET /compute/v2.1/servers/4e392800-b237-4d1d-8372-e635e2450b91" status: 200 len: 1314 microversion: 2.1 time: 0.212139 Oct 08 21:03:59.763065 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1527/2987] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:59 2022] GET /compute/v2.1/servers/4e392800-b237-4d1d-8372-e635e2450b91 => generated 1314 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:03:59.779454 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-c61b3f3d-ccbb-4300-9521-eff70f3d9bd4 req-0b385e79-83dc-4483-b772-64b10a5d381e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071060 Oct 08 21:03:59.780247 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1461/2988] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:03:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:03:59.802233 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-2c9bddbd-d273-4a58-9ade-64d8d2b99bc6 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:03:59.802859 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-2c9bddbd-d273-4a58-9ade-64d8d2b99bc6 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: 6ef37448-690b-4fcf-85f8-a2fb71207f38] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:03:59.809240 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2c9bddbd-d273-4a58-9ade-64d8d2b99bc6 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:59.809745 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2c9bddbd-d273-4a58-9ade-64d8d2b99bc6 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:59.810195 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2c9bddbd-d273-4a58-9ade-64d8d2b99bc6 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:59.811905 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2c9bddbd-d273-4a58-9ade-64d8d2b99bc6 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:03:59.812111 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2c9bddbd-d273-4a58-9ade-64d8d2b99bc6 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:03:59.812554 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2c9bddbd-d273-4a58-9ade-64d8d2b99bc6 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:03:59.950606 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-2c9bddbd-d273-4a58-9ade-64d8d2b99bc6 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:03:59.961774 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-2c9bddbd-d273-4a58-9ade-64d8d2b99bc6 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/6ef37448-690b-4fcf-85f8-a2fb71207f38" status: 200 len: 1476 microversion: 2.1 time: 0.163306 Oct 08 21:03:59.962585 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1528/2989] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:03:59 2022] GET /compute/v2.1/servers/6ef37448-690b-4fcf-85f8-a2fb71207f38 => generated 1476 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:04:00.011996 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-cca63096-365f-4352-8917-7836d45e2de2 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:00.012738 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-cca63096-365f-4352-8917-7836d45e2de2 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] [instance: 0b52e623-6990-4978-811d-68fc294fe304] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:00.019741 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cca63096-365f-4352-8917-7836d45e2de2 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:00.020237 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cca63096-365f-4352-8917-7836d45e2de2 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:00.020680 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cca63096-365f-4352-8917-7836d45e2de2 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:00.021414 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cca63096-365f-4352-8917-7836d45e2de2 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:00.021883 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cca63096-365f-4352-8917-7836d45e2de2 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:00.022316 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cca63096-365f-4352-8917-7836d45e2de2 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:00.192374 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-a830c948-1bb0-4ad7-a38d-0d1c87013669 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:00.193004 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-a830c948-1bb0-4ad7-a38d-0d1c87013669 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] [instance: 579b0f8b-ccae-4c2b-bb48-1da1aaf6a138] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:00.200040 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a830c948-1bb0-4ad7-a38d-0d1c87013669 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:00.200540 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a830c948-1bb0-4ad7-a38d-0d1c87013669 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:00.200981 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a830c948-1bb0-4ad7-a38d-0d1c87013669 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:00.201723 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a830c948-1bb0-4ad7-a38d-0d1c87013669 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:00.202217 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a830c948-1bb0-4ad7-a38d-0d1c87013669 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:00.202644 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a830c948-1bb0-4ad7-a38d-0d1c87013669 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:00.350977 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-a830c948-1bb0-4ad7-a38d-0d1c87013669 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1698dee4a2bf4ea19a6ee0c3d5cb5c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b00ee5e7828469f95bd90548d35982a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:00.360369 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-a830c948-1bb0-4ad7-a38d-0d1c87013669 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] 10.222.0.26 "GET /compute/v2.1/servers/579b0f8b-ccae-4c2b-bb48-1da1aaf6a138" status: 200 len: 1523 microversion: 2.1 time: 0.172379 Oct 08 21:04:00.365253 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1529/2990] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:04:00 2022] GET /compute/v2.1/servers/579b0f8b-ccae-4c2b-bb48-1da1aaf6a138 => generated 1523 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:04:00.427341 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-cca63096-365f-4352-8917-7836d45e2de2 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095debf3968c448fb3c3add0322d8d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc9bed6d76834f6fa66d681ecd9f4e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:00.435528 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-cca63096-365f-4352-8917-7836d45e2de2 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] 10.222.0.26 "GET /compute/v2.1/servers/0b52e623-6990-4978-811d-68fc294fe304" status: 200 len: 1517 microversion: 2.1 time: 0.428082 Oct 08 21:04:00.436003 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1462/2991] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:04:00 2022] GET /compute/v2.1/servers/0b52e623-6990-4978-811d-68fc294fe304 => generated 1517 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:04:00.478692 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-01a5ac6b-b456-4b6f-a5a7-6c8caa55561b tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:00.479326 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-01a5ac6b-b456-4b6f-a5a7-6c8caa55561b tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] [instance: 136d0aa6-479d-4d9c-b633-23203ee44ae4] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:00.485438 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-01a5ac6b-b456-4b6f-a5a7-6c8caa55561b tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:00.485867 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-01a5ac6b-b456-4b6f-a5a7-6c8caa55561b tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:00.486636 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-01a5ac6b-b456-4b6f-a5a7-6c8caa55561b tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:00.487043 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-01a5ac6b-b456-4b6f-a5a7-6c8caa55561b tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:00.487496 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-01a5ac6b-b456-4b6f-a5a7-6c8caa55561b tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:00.488002 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-01a5ac6b-b456-4b6f-a5a7-6c8caa55561b tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:00.578255 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-5b4d2e27-8be5-4da1-8c14-b095b4b01281 tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:00.578871 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-5b4d2e27-8be5-4da1-8c14-b095b4b01281 tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] [instance: 7fb18924-877c-4768-a503-718e32ae5765] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:00.587315 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5b4d2e27-8be5-4da1-8c14-b095b4b01281 tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:00.587819 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5b4d2e27-8be5-4da1-8c14-b095b4b01281 tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:00.588265 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5b4d2e27-8be5-4da1-8c14-b095b4b01281 tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:00.588977 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5b4d2e27-8be5-4da1-8c14-b095b4b01281 tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:00.589462 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5b4d2e27-8be5-4da1-8c14-b095b4b01281 tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:00.589900 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5b4d2e27-8be5-4da1-8c14-b095b4b01281 tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:00.624139 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-01a5ac6b-b456-4b6f-a5a7-6c8caa55561b tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2e13f1952a4e5bb23d57dd7fa31875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b2a56286924e2d953bebe717ce591b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:00.632530 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-01a5ac6b-b456-4b6f-a5a7-6c8caa55561b tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] 10.222.0.26 "GET /compute/v2.1/servers/136d0aa6-479d-4d9c-b633-23203ee44ae4" status: 200 len: 1314 microversion: 2.1 time: 0.157980 Oct 08 21:04:00.633175 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1530/2992] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:04:00 2022] GET /compute/v2.1/servers/136d0aa6-479d-4d9c-b633-23203ee44ae4 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:04:00.655477 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-5b4d2e27-8be5-4da1-8c14-b095b4b01281 tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd917f61a1c043f599ef923f41c3a938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a9dfe2733a844928b29194b54f4a0a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:00.663736 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-5b4d2e27-8be5-4da1-8c14-b095b4b01281 tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd917f61a1c043f599ef923f41c3a938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a9dfe2733a844928b29194b54f4a0a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:00.665213 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-5b4d2e27-8be5-4da1-8c14-b095b4b01281 tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd917f61a1c043f599ef923f41c3a938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a9dfe2733a844928b29194b54f4a0a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:00.666388 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-5b4d2e27-8be5-4da1-8c14-b095b4b01281 tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] 10.222.0.26 "GET /compute/v2.1/servers/7fb18924-877c-4768-a503-718e32ae5765" status: 200 len: 1365 microversion: 2.47 time: 0.092105 Oct 08 21:04:00.666954 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1463/2993] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:04:00 2022] GET /compute/v2.1/servers/7fb18924-877c-4768-a503-718e32ae5765 => generated 1365 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 08 21:04:00.731487 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-3c7d13e8-c2e1-48ab-a8e3-166f7d4faf96 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:00.732207 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-3c7d13e8-c2e1-48ab-a8e3-166f7d4faf96 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] [instance: ede2a1aa-f65b-424e-9034-15a2aaf13e60] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:00.738361 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3c7d13e8-c2e1-48ab-a8e3-166f7d4faf96 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:00.738858 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3c7d13e8-c2e1-48ab-a8e3-166f7d4faf96 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:00.739308 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3c7d13e8-c2e1-48ab-a8e3-166f7d4faf96 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:00.740017 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3c7d13e8-c2e1-48ab-a8e3-166f7d4faf96 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:00.740480 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3c7d13e8-c2e1-48ab-a8e3-166f7d4faf96 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:00.740917 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3c7d13e8-c2e1-48ab-a8e3-166f7d4faf96 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:00.759351 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-6dbd1b8d-91a9-4ccd-8a8f-fceb90302cef tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:00.759989 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-6dbd1b8d-91a9-4ccd-8a8f-fceb90302cef tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] [instance: 401433a8-84ff-4525-9a86-c0b6a517eeb3] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:00.766446 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6dbd1b8d-91a9-4ccd-8a8f-fceb90302cef tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:00.766941 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6dbd1b8d-91a9-4ccd-8a8f-fceb90302cef tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:00.767387 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6dbd1b8d-91a9-4ccd-8a8f-fceb90302cef tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:00.768097 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6dbd1b8d-91a9-4ccd-8a8f-fceb90302cef tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:00.768560 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6dbd1b8d-91a9-4ccd-8a8f-fceb90302cef tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:00.769663 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6dbd1b8d-91a9-4ccd-8a8f-fceb90302cef tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:00.783367 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-6dbd1b8d-91a9-4ccd-8a8f-fceb90302cef tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] HTTP exception thrown: Instance 401433a8-84ff-4525-9a86-c0b6a517eeb3 could not be found. Oct 08 21:04:00.785092 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-6dbd1b8d-91a9-4ccd-8a8f-fceb90302cef tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Request method failure captured: Oct 08 21:04:00.785092 ncdv-master-1 devstack@n-api.service[140491]: request: DELETE /compute/v2.1/servers/401433a8-84ff-4525-9a86-c0b6a517eeb3 HTTP/1.1 Oct 08 21:04:00.785092 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:04:00.785092 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:04:00.785092 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:04:00.785092 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 21:04:00.785092 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:04:00.785092 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:04:00.785092 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:04:00.785092 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:04:00.785092 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeUh9lhu1zAsNryzKZom6Yx5udzKSeVp2iZDxMX-0HrBuvSNG_-eIHE9g0npDKTlUcBUKW5HZmWq01jPHhZN5xsugmuV2gkx1rU30bTx_9qAaVGx_pVF8xfqhQM5l51akXkKYp_PlVZveqqrIRCc4l5TlE8nJU0c4eD-A8ZLiGQPfc4 Oct 08 21:04:00.785092 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:04:00.785092 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:04:00.785092 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:04:00.785092 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:04:00.785092 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:04:00.785092 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:04:00.785092 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 9e0310d9e59942729d685e6eb06c6460 Oct 08 21:04:00.785092 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-185688184 Oct 08 21:04:00.785092 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:04:00.785092 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:04:00.785092 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9e0310d9e59942729d685e6eb06c6460"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9e0310d9e59942729d685e6eb06c6460"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9e0310d9e59942729d685e6eb06c6460"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9e0310d9e59942729d685e6eb06c6460"}]}] Oct 08 21:04:00.785092 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-185688184 Oct 08 21:04:00.785092 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 9e0310d9e59942729d685e6eb06c6460 Oct 08 21:04:00.785092 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-185688184 Oct 08 21:04:00.785092 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-AttachSCSIVolumeTestJSON-185688184-project Oct 08 21:04:00.785092 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:04:00.785092 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:04:00.785092 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 5e3216124a4f41b2b931a16c750649df Oct 08 21:04:00.785092 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-185688184-project Oct 08 21:04:00.785092 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:04:00.785092 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance 401433a8-84ff-4525-9a86-c0b6a517eeb3 could not be found. Oct 08 21:04:00.785092 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': '401433a8-84ff-4525-9a86-c0b6a517eeb3'} Oct 08 21:04:00.785092 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:04:00.785092 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:04:00.785092 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:04:00.785092 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:04:00.785092 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:04:00.785092 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:04:00.785092 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:04:00.785092 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:04:00.785092 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:04:00.785092 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:04:00.785092 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 401433a8-84ff-4525-9a86-c0b6a517eeb3 could not be found. Oct 08 21:04:00.785092 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:04:00.785092 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:04:00.785092 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:04:00.785092 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:04:00.785092 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:04:00.785092 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:04:00.785092 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:04:00.785092 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:04:00.785092 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:04:00.785092 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:04:00.785092 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 08 21:04:00.785092 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 08 21:04:00.785092 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 08 21:04:00.785092 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 08 21:04:00.785092 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:04:00.785092 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:04:00.785092 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:04:00.785092 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:04:00.789739 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 401433a8-84ff-4525-9a86-c0b6a517eeb3 could not be found. Oct 08 21:04:00.789739 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:04:00.789739 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:04:00.789739 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:04:00.789739 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:04:00.789739 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:04:00.789739 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:04:00.789739 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:04:00.789739 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:04:00.789739 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 401433a8-84ff-4525-9a86-c0b6a517eeb3 could not be found. Oct 08 21:04:00.789739 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:04:00.789739 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-6dbd1b8d-91a9-4ccd-8a8f-fceb90302cef tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Returning 404 to user: Instance 401433a8-84ff-4525-9a86-c0b6a517eeb3 could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:04:00.789739 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-6dbd1b8d-91a9-4ccd-8a8f-fceb90302cef tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] 10.222.0.26 "DELETE /compute/v2.1/servers/401433a8-84ff-4525-9a86-c0b6a517eeb3" status: 404 len: 111 microversion: 2.1 time: 0.031045 Oct 08 21:04:00.790676 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1464/2994] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:04:00 2022] DELETE /compute/v2.1/servers/401433a8-84ff-4525-9a86-c0b6a517eeb3 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 08 21:04:00.794684 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-084b799a-2a3c-4a34-9412-d7f5b455ea94 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:00.795306 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-084b799a-2a3c-4a34-9412-d7f5b455ea94 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] [instance: 4e392800-b237-4d1d-8372-e635e2450b91] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:00.801305 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-084b799a-2a3c-4a34-9412-d7f5b455ea94 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:00.801818 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-084b799a-2a3c-4a34-9412-d7f5b455ea94 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:00.802262 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-084b799a-2a3c-4a34-9412-d7f5b455ea94 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:00.802963 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-084b799a-2a3c-4a34-9412-d7f5b455ea94 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:00.803423 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-084b799a-2a3c-4a34-9412-d7f5b455ea94 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:00.803858 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-084b799a-2a3c-4a34-9412-d7f5b455ea94 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:00.892135 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-3c7d13e8-c2e1-48ab-a8e3-166f7d4faf96 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f60e33f334465fac1148669de3f00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4735bf74f33a4739800d766c82d973d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:00.901433 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-3c7d13e8-c2e1-48ab-a8e3-166f7d4faf96 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] 10.222.0.26 "GET /compute/v2.1/servers/ede2a1aa-f65b-424e-9034-15a2aaf13e60" status: 200 len: 1674 microversion: 2.1 time: 0.173712 Oct 08 21:04:00.917220 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1531/2995] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:04:00 2022] GET /compute/v2.1/servers/ede2a1aa-f65b-424e-9034-15a2aaf13e60 => generated 1674 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:04:00.917220 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e9b65f09-993d-4a53-ad37-95ba2b9c676b tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:00.917220 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-e9b65f09-993d-4a53-ad37-95ba2b9c676b tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] [instance: 401433a8-84ff-4525-9a86-c0b6a517eeb3] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:00.917220 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e9b65f09-993d-4a53-ad37-95ba2b9c676b tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:00.917220 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e9b65f09-993d-4a53-ad37-95ba2b9c676b tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:00.917764 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e9b65f09-993d-4a53-ad37-95ba2b9c676b tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:00.918049 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e9b65f09-993d-4a53-ad37-95ba2b9c676b tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:00.918524 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e9b65f09-993d-4a53-ad37-95ba2b9c676b tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:00.918962 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e9b65f09-993d-4a53-ad37-95ba2b9c676b tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:00.933225 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-e9b65f09-993d-4a53-ad37-95ba2b9c676b tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] HTTP exception thrown: Instance 401433a8-84ff-4525-9a86-c0b6a517eeb3 could not be found. Oct 08 21:04:00.935107 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e9b65f09-993d-4a53-ad37-95ba2b9c676b tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Request method failure captured: Oct 08 21:04:00.935107 ncdv-master-1 devstack@n-api.service[140492]: request: GET /compute/v2.1/servers/401433a8-84ff-4525-9a86-c0b6a517eeb3 HTTP/1.1 Oct 08 21:04:00.935107 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:04:00.935107 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:04:00.935107 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:04:00.935107 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 21:04:00.935107 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:04:00.935107 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:04:00.935107 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:04:00.935107 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:04:00.935107 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeUh9lhu1zAsNryzKZom6Yx5udzKSeVp2iZDxMX-0HrBuvSNG_-eIHE9g0npDKTlUcBUKW5HZmWq01jPHhZN5xsugmuV2gkx1rU30bTx_9qAaVGx_pVF8xfqhQM5l51akXkKYp_PlVZveqqrIRCc4l5TlE8nJU0c4eD-A8ZLiGQPfc4 Oct 08 21:04:00.935107 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:04:00.935107 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:04:00.935107 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:04:00.935107 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:04:00.935107 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:04:00.935107 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:04:00.935107 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 9e0310d9e59942729d685e6eb06c6460 Oct 08 21:04:00.935107 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-185688184 Oct 08 21:04:00.935107 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:04:00.935107 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:04:00.935107 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9e0310d9e59942729d685e6eb06c6460"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9e0310d9e59942729d685e6eb06c6460"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9e0310d9e59942729d685e6eb06c6460"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9e0310d9e59942729d685e6eb06c6460"}]}] Oct 08 21:04:00.935107 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-185688184 Oct 08 21:04:00.935107 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 9e0310d9e59942729d685e6eb06c6460 Oct 08 21:04:00.935107 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-185688184 Oct 08 21:04:00.935107 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-AttachSCSIVolumeTestJSON-185688184-project Oct 08 21:04:00.935107 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:04:00.935107 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:04:00.935107 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 5e3216124a4f41b2b931a16c750649df Oct 08 21:04:00.935107 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-185688184-project Oct 08 21:04:00.935107 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 21:04:00.935107 ncdv-master-1 devstack@n-api.service[140492]: exception: Instance 401433a8-84ff-4525-9a86-c0b6a517eeb3 could not be found. Oct 08 21:04:00.935107 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': '401433a8-84ff-4525-9a86-c0b6a517eeb3'} Oct 08 21:04:00.935107 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:04:00.935107 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:04:00.935107 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:04:00.935107 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:04:00.935107 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:04:00.935107 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:04:00.935107 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:04:00.935107 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:04:00.935107 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:04:00.935107 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:04:00.935107 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 401433a8-84ff-4525-9a86-c0b6a517eeb3 could not be found. Oct 08 21:04:00.935107 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:04:00.935107 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:04:00.935107 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:04:00.935107 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:04:00.935107 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:04:00.935107 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:04:00.935107 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:04:00.935107 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:04:00.935107 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:04:00.935107 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:04:00.935107 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:04:00.935107 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:04:00.935107 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:04:00.935107 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:04:00.935107 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:04:00.935107 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:04:00.935107 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 401433a8-84ff-4525-9a86-c0b6a517eeb3 could not be found. Oct 08 21:04:00.935107 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:04:00.935107 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:04:00.935107 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:04:00.939247 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:04:00.939247 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:04:00.939247 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:04:00.939247 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:04:00.939247 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:04:00.939247 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 401433a8-84ff-4525-9a86-c0b6a517eeb3 could not be found. Oct 08 21:04:00.939247 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:04:00.939247 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e9b65f09-993d-4a53-ad37-95ba2b9c676b tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] Returning 404 to user: Instance 401433a8-84ff-4525-9a86-c0b6a517eeb3 could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:04:00.939247 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-e9b65f09-993d-4a53-ad37-95ba2b9c676b tempest-AttachSCSIVolumeTestJSON-185688184 tempest-AttachSCSIVolumeTestJSON-185688184-project] 10.222.0.26 "GET /compute/v2.1/servers/401433a8-84ff-4525-9a86-c0b6a517eeb3" status: 404 len: 111 microversion: 2.1 time: 0.035623 Oct 08 21:04:00.939822 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1532/2996] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:04:00 2022] GET /compute/v2.1/servers/401433a8-84ff-4525-9a86-c0b6a517eeb3 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:04:00.958411 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-084b799a-2a3c-4a34-9412-d7f5b455ea94 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2395fe934d458faa80e28587458bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f455695c0214bfab0f412aa34417e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:00.966797 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-084b799a-2a3c-4a34-9412-d7f5b455ea94 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] 10.222.0.26 "GET /compute/v2.1/servers/4e392800-b237-4d1d-8372-e635e2450b91" status: 200 len: 1314 microversion: 2.1 time: 0.175575 Oct 08 21:04:00.982973 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1465/2997] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:04:00 2022] GET /compute/v2.1/servers/4e392800-b237-4d1d-8372-e635e2450b91 => generated 1314 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:04:00.986574 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-5475f1e7-0d30-429f-adef-922bec3b713b tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:00.987205 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-5475f1e7-0d30-429f-adef-922bec3b713b tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: 6ef37448-690b-4fcf-85f8-a2fb71207f38] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:00.994284 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5475f1e7-0d30-429f-adef-922bec3b713b tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:00.994869 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5475f1e7-0d30-429f-adef-922bec3b713b tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:00.995343 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5475f1e7-0d30-429f-adef-922bec3b713b tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:00.996087 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5475f1e7-0d30-429f-adef-922bec3b713b tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:00.996549 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5475f1e7-0d30-429f-adef-922bec3b713b tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:00.996983 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5475f1e7-0d30-429f-adef-922bec3b713b tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:01.267036 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-5475f1e7-0d30-429f-adef-922bec3b713b tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:01.274947 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-5475f1e7-0d30-429f-adef-922bec3b713b tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/6ef37448-690b-4fcf-85f8-a2fb71207f38" status: 200 len: 1476 microversion: 2.1 time: 0.293474 Oct 08 21:04:01.275522 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1533/2998] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:04:00 2022] GET /compute/v2.1/servers/6ef37448-690b-4fcf-85f8-a2fb71207f38 => generated 1476 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:04:01.383615 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-9cb21db2-fb11-4028-a7d7-5f8c5559ec7d tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:01.384270 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-9cb21db2-fb11-4028-a7d7-5f8c5559ec7d tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] [instance: 579b0f8b-ccae-4c2b-bb48-1da1aaf6a138] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:01.392213 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9cb21db2-fb11-4028-a7d7-5f8c5559ec7d tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:01.392656 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9cb21db2-fb11-4028-a7d7-5f8c5559ec7d tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:01.393256 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9cb21db2-fb11-4028-a7d7-5f8c5559ec7d tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:01.394514 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9cb21db2-fb11-4028-a7d7-5f8c5559ec7d tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:01.395155 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9cb21db2-fb11-4028-a7d7-5f8c5559ec7d tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:01.395728 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9cb21db2-fb11-4028-a7d7-5f8c5559ec7d tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:01.458472 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-55a88fb0-bef1-4212-9eb3-c4d806ed2c13 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:01.459183 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-55a88fb0-bef1-4212-9eb3-c4d806ed2c13 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] [instance: 0b52e623-6990-4978-811d-68fc294fe304] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:01.468369 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-55a88fb0-bef1-4212-9eb3-c4d806ed2c13 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:01.469244 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-55a88fb0-bef1-4212-9eb3-c4d806ed2c13 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:01.469419 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-55a88fb0-bef1-4212-9eb3-c4d806ed2c13 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:01.470160 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-55a88fb0-bef1-4212-9eb3-c4d806ed2c13 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:01.470702 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-55a88fb0-bef1-4212-9eb3-c4d806ed2c13 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:01.471601 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-55a88fb0-bef1-4212-9eb3-c4d806ed2c13 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:01.546413 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-9cb21db2-fb11-4028-a7d7-5f8c5559ec7d tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1698dee4a2bf4ea19a6ee0c3d5cb5c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b00ee5e7828469f95bd90548d35982a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:01.555804 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-9cb21db2-fb11-4028-a7d7-5f8c5559ec7d tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] 10.222.0.26 "GET /compute/v2.1/servers/579b0f8b-ccae-4c2b-bb48-1da1aaf6a138" status: 200 len: 1523 microversion: 2.1 time: 0.175885 Oct 08 21:04:01.556418 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1466/2999] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:04:01 2022] GET /compute/v2.1/servers/579b0f8b-ccae-4c2b-bb48-1da1aaf6a138 => generated 1523 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:04:01.657401 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-ac93d6ff-116b-449a-9028-f82b4e0292f3 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:01.658050 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-ac93d6ff-116b-449a-9028-f82b4e0292f3 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] [instance: 136d0aa6-479d-4d9c-b633-23203ee44ae4] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:01.664653 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ac93d6ff-116b-449a-9028-f82b4e0292f3 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:01.665152 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ac93d6ff-116b-449a-9028-f82b4e0292f3 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:01.665632 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ac93d6ff-116b-449a-9028-f82b4e0292f3 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:01.666377 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ac93d6ff-116b-449a-9028-f82b4e0292f3 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:01.666851 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ac93d6ff-116b-449a-9028-f82b4e0292f3 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:01.667301 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ac93d6ff-116b-449a-9028-f82b4e0292f3 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:01.803189 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-ac93d6ff-116b-449a-9028-f82b4e0292f3 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2e13f1952a4e5bb23d57dd7fa31875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b2a56286924e2d953bebe717ce591b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:01.811053 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-ac93d6ff-116b-449a-9028-f82b4e0292f3 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] 10.222.0.26 "GET /compute/v2.1/servers/136d0aa6-479d-4d9c-b633-23203ee44ae4" status: 200 len: 1314 microversion: 2.1 time: 0.158978 Oct 08 21:04:01.811724 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1467/3000] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:04:01 2022] GET /compute/v2.1/servers/136d0aa6-479d-4d9c-b633-23203ee44ae4 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:04:01.816149 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-5b97741a-34ac-462e-8865-3fe786a12275 tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:01.817057 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-5b97741a-34ac-462e-8865-3fe786a12275 tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] [instance: 7fb18924-877c-4768-a503-718e32ae5765] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:01.822631 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5b97741a-34ac-462e-8865-3fe786a12275 tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:01.823352 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5b97741a-34ac-462e-8865-3fe786a12275 tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:01.823573 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5b97741a-34ac-462e-8865-3fe786a12275 tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:01.824272 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5b97741a-34ac-462e-8865-3fe786a12275 tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:01.824738 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5b97741a-34ac-462e-8865-3fe786a12275 tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:01.825171 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5b97741a-34ac-462e-8865-3fe786a12275 tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:01.892189 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-5b97741a-34ac-462e-8865-3fe786a12275 tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd917f61a1c043f599ef923f41c3a938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a9dfe2733a844928b29194b54f4a0a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:01.900850 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-5b97741a-34ac-462e-8865-3fe786a12275 tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd917f61a1c043f599ef923f41c3a938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a9dfe2733a844928b29194b54f4a0a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:01.902342 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-5b97741a-34ac-462e-8865-3fe786a12275 tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd917f61a1c043f599ef923f41c3a938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a9dfe2733a844928b29194b54f4a0a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:01.903526 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-5b97741a-34ac-462e-8865-3fe786a12275 tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] 10.222.0.26 "GET /compute/v2.1/servers/7fb18924-877c-4768-a503-718e32ae5765" status: 200 len: 1365 microversion: 2.47 time: 0.090978 Oct 08 21:04:01.904100 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1468/3001] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:04:01 2022] GET /compute/v2.1/servers/7fb18924-877c-4768-a503-718e32ae5765 => generated 1365 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:04:01.932190 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-faa36d55-c79e-4b9e-b3de-4897638d62bb tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:01.932820 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-faa36d55-c79e-4b9e-b3de-4897638d62bb tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] [instance: ede2a1aa-f65b-424e-9034-15a2aaf13e60] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:01.939135 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-faa36d55-c79e-4b9e-b3de-4897638d62bb tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:01.939633 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-faa36d55-c79e-4b9e-b3de-4897638d62bb tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:01.940077 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-faa36d55-c79e-4b9e-b3de-4897638d62bb tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:01.940819 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-faa36d55-c79e-4b9e-b3de-4897638d62bb tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:01.941456 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-faa36d55-c79e-4b9e-b3de-4897638d62bb tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:01.941888 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-faa36d55-c79e-4b9e-b3de-4897638d62bb tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:02.086332 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-faa36d55-c79e-4b9e-b3de-4897638d62bb tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f60e33f334465fac1148669de3f00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4735bf74f33a4739800d766c82d973d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:02.094675 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-faa36d55-c79e-4b9e-b3de-4897638d62bb tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] 10.222.0.26 "GET /compute/v2.1/servers/ede2a1aa-f65b-424e-9034-15a2aaf13e60" status: 200 len: 1674 microversion: 2.1 time: 0.174567 Oct 08 21:04:02.095465 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1469/3002] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:04:01 2022] GET /compute/v2.1/servers/ede2a1aa-f65b-424e-9034-15a2aaf13e60 => generated 1674 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:04:02.111095 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-5243c2d9-52e4-45cf-aabd-6b292afa6761 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:02.111824 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-5243c2d9-52e4-45cf-aabd-6b292afa6761 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] [instance: 4e392800-b237-4d1d-8372-e635e2450b91] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:02.118669 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5243c2d9-52e4-45cf-aabd-6b292afa6761 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:02.119280 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5243c2d9-52e4-45cf-aabd-6b292afa6761 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:02.119735 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5243c2d9-52e4-45cf-aabd-6b292afa6761 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:02.120469 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5243c2d9-52e4-45cf-aabd-6b292afa6761 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:02.120975 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5243c2d9-52e4-45cf-aabd-6b292afa6761 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:02.121434 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5243c2d9-52e4-45cf-aabd-6b292afa6761 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:02.240722 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-55a88fb0-bef1-4212-9eb3-c4d806ed2c13 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095debf3968c448fb3c3add0322d8d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc9bed6d76834f6fa66d681ecd9f4e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:02.249572 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-55a88fb0-bef1-4212-9eb3-c4d806ed2c13 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] 10.222.0.26 "GET /compute/v2.1/servers/0b52e623-6990-4978-811d-68fc294fe304" status: 200 len: 1517 microversion: 2.1 time: 0.794933 Oct 08 21:04:02.250151 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1534/3003] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:04:01 2022] GET /compute/v2.1/servers/0b52e623-6990-4978-811d-68fc294fe304 => generated 1517 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:04:02.271134 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-5243c2d9-52e4-45cf-aabd-6b292afa6761 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2395fe934d458faa80e28587458bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f455695c0214bfab0f412aa34417e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:02.279427 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-5243c2d9-52e4-45cf-aabd-6b292afa6761 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] 10.222.0.26 "GET /compute/v2.1/servers/4e392800-b237-4d1d-8372-e635e2450b91" status: 200 len: 1314 microversion: 2.1 time: 0.172480 Oct 08 21:04:02.280198 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1470/3004] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:04:02 2022] GET /compute/v2.1/servers/4e392800-b237-4d1d-8372-e635e2450b91 => generated 1314 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:04:02.298710 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-7a165256-4ecc-4796-93d0-f655c75a3b80 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:02.299468 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-7a165256-4ecc-4796-93d0-f655c75a3b80 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: 6ef37448-690b-4fcf-85f8-a2fb71207f38] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:02.306878 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7a165256-4ecc-4796-93d0-f655c75a3b80 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:02.307511 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7a165256-4ecc-4796-93d0-f655c75a3b80 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:02.308791 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7a165256-4ecc-4796-93d0-f655c75a3b80 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:02.309903 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7a165256-4ecc-4796-93d0-f655c75a3b80 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:02.310634 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7a165256-4ecc-4796-93d0-f655c75a3b80 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:02.311397 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7a165256-4ecc-4796-93d0-f655c75a3b80 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:02.561615 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-b1082d84-fa18-493f-bd76-9cb8a0e5d1d4 req-003d09ca-dcdc-45ba-81f8-f65f8f637580 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e392800-b237-4d1d-8372-e635e2450b91", "name": "network-vif-plugged", "status": "completed", "tag": "7b5e3817-0dd1-47a2-b7d0-f75aa022f9b9"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:04:02.583133 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=7 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:04:02.587887 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-b1082d84-fa18-493f-bd76-9cb8a0e5d1d4 req-003d09ca-dcdc-45ba-81f8-f65f8f637580 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:02.588731 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-b1082d84-fa18-493f-bd76-9cb8a0e5d1d4 req-003d09ca-dcdc-45ba-81f8-f65f8f637580 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:02.589488 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-b1082d84-fa18-493f-bd76-9cb8a0e5d1d4 req-003d09ca-dcdc-45ba-81f8-f65f8f637580 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:02.610490 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-b1082d84-fa18-493f-bd76-9cb8a0e5d1d4 req-003d09ca-dcdc-45ba-81f8-f65f8f637580 service nova] Creating event network-vif-plugged:7b5e3817-0dd1-47a2-b7d0-f75aa022f9b9 for instance 4e392800-b237-4d1d-8372-e635e2450b91 on nch1-master-1 Oct 08 21:04:02.619523 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-b1082d84-fa18-493f-bd76-9cb8a0e5d1d4 req-003d09ca-dcdc-45ba-81f8-f65f8f637580 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063038 Oct 08 21:04:02.621009 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1471/3005] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:04:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 08 21:04:02.627890 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-6a6301a6-9a4d-46e4-a58a-c568b1c5bff6 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:02.629941 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-6a6301a6-9a4d-46e4-a58a-c568b1c5bff6 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] [instance: 579b0f8b-ccae-4c2b-bb48-1da1aaf6a138] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:02.638733 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6a6301a6-9a4d-46e4-a58a-c568b1c5bff6 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:02.646826 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6a6301a6-9a4d-46e4-a58a-c568b1c5bff6 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:02.647321 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6a6301a6-9a4d-46e4-a58a-c568b1c5bff6 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:02.648287 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6a6301a6-9a4d-46e4-a58a-c568b1c5bff6 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:02.649804 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6a6301a6-9a4d-46e4-a58a-c568b1c5bff6 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:02.650779 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6a6301a6-9a4d-46e4-a58a-c568b1c5bff6 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:02.745110 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-7a165256-4ecc-4796-93d0-f655c75a3b80 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:02.756529 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-7a165256-4ecc-4796-93d0-f655c75a3b80 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/6ef37448-690b-4fcf-85f8-a2fb71207f38" status: 200 len: 1476 microversion: 2.1 time: 0.462152 Oct 08 21:04:02.781725 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1535/3006] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:04:02 2022] GET /compute/v2.1/servers/6ef37448-690b-4fcf-85f8-a2fb71207f38 => generated 1476 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:04:02.834517 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-32892d99-384c-441d-b606-54d1cc5a79e3 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:02.835148 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-32892d99-384c-441d-b606-54d1cc5a79e3 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] [instance: 136d0aa6-479d-4d9c-b633-23203ee44ae4] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:02.849408 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-32892d99-384c-441d-b606-54d1cc5a79e3 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:02.854377 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-32892d99-384c-441d-b606-54d1cc5a79e3 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:02.855105 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-32892d99-384c-441d-b606-54d1cc5a79e3 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:02.856187 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-32892d99-384c-441d-b606-54d1cc5a79e3 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:02.856778 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-32892d99-384c-441d-b606-54d1cc5a79e3 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:02.857371 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-32892d99-384c-441d-b606-54d1cc5a79e3 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:03.067629 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-6a6301a6-9a4d-46e4-a58a-c568b1c5bff6 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1698dee4a2bf4ea19a6ee0c3d5cb5c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b00ee5e7828469f95bd90548d35982a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:03.078949 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-6a6301a6-9a4d-46e4-a58a-c568b1c5bff6 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] 10.222.0.26 "GET /compute/v2.1/servers/579b0f8b-ccae-4c2b-bb48-1da1aaf6a138" status: 200 len: 1523 microversion: 2.1 time: 0.456402 Oct 08 21:04:03.080147 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1472/3007] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:04:02 2022] GET /compute/v2.1/servers/579b0f8b-ccae-4c2b-bb48-1da1aaf6a138 => generated 1523 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:04:03.108090 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-aa73b63f-4bc6-48e8-98f1-1ae3a005ec6b tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:03.110516 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-aa73b63f-4bc6-48e8-98f1-1ae3a005ec6b tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] [instance: 7fb18924-877c-4768-a503-718e32ae5765] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:03.156360 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-aa73b63f-4bc6-48e8-98f1-1ae3a005ec6b tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:03.157099 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-aa73b63f-4bc6-48e8-98f1-1ae3a005ec6b tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:03.157814 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-aa73b63f-4bc6-48e8-98f1-1ae3a005ec6b tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:03.158725 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-aa73b63f-4bc6-48e8-98f1-1ae3a005ec6b tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:03.160066 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-aa73b63f-4bc6-48e8-98f1-1ae3a005ec6b tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:03.160805 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-aa73b63f-4bc6-48e8-98f1-1ae3a005ec6b tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:03.279429 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-aa73b63f-4bc6-48e8-98f1-1ae3a005ec6b tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd917f61a1c043f599ef923f41c3a938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a9dfe2733a844928b29194b54f4a0a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:03.292691 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-aa73b63f-4bc6-48e8-98f1-1ae3a005ec6b tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd917f61a1c043f599ef923f41c3a938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a9dfe2733a844928b29194b54f4a0a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:03.294413 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-aa73b63f-4bc6-48e8-98f1-1ae3a005ec6b tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd917f61a1c043f599ef923f41c3a938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a9dfe2733a844928b29194b54f4a0a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:03.297240 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-aa73b63f-4bc6-48e8-98f1-1ae3a005ec6b tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] 10.222.0.26 "GET /compute/v2.1/servers/7fb18924-877c-4768-a503-718e32ae5765" status: 200 len: 1365 microversion: 2.47 time: 0.215838 Oct 08 21:04:03.298160 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1473/3008] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:04:03 2022] GET /compute/v2.1/servers/7fb18924-877c-4768-a503-718e32ae5765 => generated 1365 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:04:03.303537 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-d1f70613-23fb-49ef-bfbc-619b3359e9b1 req-4408d400-392d-42c9-84da-1b0ba578e5db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b52e623-6990-4978-811d-68fc294fe304", "name": "network-vif-deleted", "tag": "d9c32cf0-f551-46d0-b582-c534f69aced9"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:04:03.313579 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-d1f70613-23fb-49ef-bfbc-619b3359e9b1 req-4408d400-392d-42c9-84da-1b0ba578e5db service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:03.314322 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-d1f70613-23fb-49ef-bfbc-619b3359e9b1 req-4408d400-392d-42c9-84da-1b0ba578e5db service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:03.315098 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-d1f70613-23fb-49ef-bfbc-619b3359e9b1 req-4408d400-392d-42c9-84da-1b0ba578e5db service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:03.340676 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-d1f70613-23fb-49ef-bfbc-619b3359e9b1 req-4408d400-392d-42c9-84da-1b0ba578e5db service nova] Creating event network-vif-deleted:d9c32cf0-f551-46d0-b582-c534f69aced9 for instance 0b52e623-6990-4978-811d-68fc294fe304 on nch2-master-1 Oct 08 21:04:03.347787 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-d1f70613-23fb-49ef-bfbc-619b3359e9b1 req-4408d400-392d-42c9-84da-1b0ba578e5db service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047595 Oct 08 21:04:03.348776 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1474/3009] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:04:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:04:03.355739 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-ae5a7a5d-192d-453f-b419-5c78bf9d1def tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:03.357065 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-ae5a7a5d-192d-453f-b419-5c78bf9d1def tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] [instance: ede2a1aa-f65b-424e-9034-15a2aaf13e60] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:03.366399 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ae5a7a5d-192d-453f-b419-5c78bf9d1def tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:03.367393 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ae5a7a5d-192d-453f-b419-5c78bf9d1def tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:03.368288 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ae5a7a5d-192d-453f-b419-5c78bf9d1def tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:03.370846 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ae5a7a5d-192d-453f-b419-5c78bf9d1def tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:03.371527 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ae5a7a5d-192d-453f-b419-5c78bf9d1def tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:03.372127 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ae5a7a5d-192d-453f-b419-5c78bf9d1def tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:03.404040 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-32892d99-384c-441d-b606-54d1cc5a79e3 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2e13f1952a4e5bb23d57dd7fa31875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b2a56286924e2d953bebe717ce591b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:03.435228 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-32892d99-384c-441d-b606-54d1cc5a79e3 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] 10.222.0.26 "GET /compute/v2.1/servers/136d0aa6-479d-4d9c-b633-23203ee44ae4" status: 200 len: 1501 microversion: 2.1 time: 0.605106 Oct 08 21:04:03.450171 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1536/3010] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:04:02 2022] GET /compute/v2.1/servers/136d0aa6-479d-4d9c-b633-23203ee44ae4 => generated 1501 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:04:03.460851 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-1e9e2f0c-e2fb-44f2-8bc7-2e55786dcb66 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:03.462104 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-1e9e2f0c-e2fb-44f2-8bc7-2e55786dcb66 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] [instance: 0b52e623-6990-4978-811d-68fc294fe304] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:03.469284 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1e9e2f0c-e2fb-44f2-8bc7-2e55786dcb66 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:03.469987 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1e9e2f0c-e2fb-44f2-8bc7-2e55786dcb66 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:03.471412 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1e9e2f0c-e2fb-44f2-8bc7-2e55786dcb66 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:03.473048 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1e9e2f0c-e2fb-44f2-8bc7-2e55786dcb66 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:03.473802 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1e9e2f0c-e2fb-44f2-8bc7-2e55786dcb66 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:03.474597 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1e9e2f0c-e2fb-44f2-8bc7-2e55786dcb66 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:03.538736 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1e9e2f0c-e2fb-44f2-8bc7-2e55786dcb66 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:03.539547 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1e9e2f0c-e2fb-44f2-8bc7-2e55786dcb66 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:03.540010 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1e9e2f0c-e2fb-44f2-8bc7-2e55786dcb66 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:03.540505 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.objects.instance [None req-1e9e2f0c-e2fb-44f2-8bc7-2e55786dcb66 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lazy-loading 'fault' on Instance uuid 0b52e623-6990-4978-811d-68fc294fe304 {{(pid=140492) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 21:04:03.622287 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-1e9e2f0c-e2fb-44f2-8bc7-2e55786dcb66 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095debf3968c448fb3c3add0322d8d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc9bed6d76834f6fa66d681ecd9f4e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:03.632772 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-1e9e2f0c-e2fb-44f2-8bc7-2e55786dcb66 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] 10.222.0.26 "GET /compute/v2.1/servers/0b52e623-6990-4978-811d-68fc294fe304" status: 200 len: 1311 microversion: 2.1 time: 0.181425 Oct 08 21:04:03.633538 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1537/3011] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:04:03 2022] GET /compute/v2.1/servers/0b52e623-6990-4978-811d-68fc294fe304 => generated 1311 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:04:03.640930 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-c491c911-0107-4417-bb1c-b47d373ae5a2 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:03.642343 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-c491c911-0107-4417-bb1c-b47d373ae5a2 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] [instance: 4e392800-b237-4d1d-8372-e635e2450b91] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:03.652602 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c491c911-0107-4417-bb1c-b47d373ae5a2 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:03.653104 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c491c911-0107-4417-bb1c-b47d373ae5a2 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:03.653588 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c491c911-0107-4417-bb1c-b47d373ae5a2 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:03.654312 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c491c911-0107-4417-bb1c-b47d373ae5a2 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:03.654780 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c491c911-0107-4417-bb1c-b47d373ae5a2 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:03.655221 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c491c911-0107-4417-bb1c-b47d373ae5a2 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:03.677767 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-ae5a7a5d-192d-453f-b419-5c78bf9d1def tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f60e33f334465fac1148669de3f00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4735bf74f33a4739800d766c82d973d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:03.686441 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-ae5a7a5d-192d-453f-b419-5c78bf9d1def tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] 10.222.0.26 "GET /compute/v2.1/servers/ede2a1aa-f65b-424e-9034-15a2aaf13e60" status: 200 len: 1653 microversion: 2.1 time: 0.336169 Oct 08 21:04:03.687116 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1475/3012] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:04:03 2022] GET /compute/v2.1/servers/ede2a1aa-f65b-424e-9034-15a2aaf13e60 => generated 1653 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:04:03.693073 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-ebc2f47f-6836-4ed3-8edb-c3b9f2b329dc tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:04:03.695794 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-ebc2f47f-6836-4ed3-8edb-c3b9f2b329dc tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] [instance: 136d0aa6-479d-4d9c-b633-23203ee44ae4] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:03.702269 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ebc2f47f-6836-4ed3-8edb-c3b9f2b329dc tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:03.703035 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ebc2f47f-6836-4ed3-8edb-c3b9f2b329dc tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:03.703551 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ebc2f47f-6836-4ed3-8edb-c3b9f2b329dc tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:03.704337 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ebc2f47f-6836-4ed3-8edb-c3b9f2b329dc tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:03.704877 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ebc2f47f-6836-4ed3-8edb-c3b9f2b329dc tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:03.705493 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ebc2f47f-6836-4ed3-8edb-c3b9f2b329dc tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:03.729889 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.objects.instance [None req-ebc2f47f-6836-4ed3-8edb-c3b9f2b329dc tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lazy-loading 'flavor' on Instance uuid 136d0aa6-479d-4d9c-b633-23203ee44ae4 {{(pid=140491) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 21:04:03.785436 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:04:03.813384 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-ebc2f47f-6836-4ed3-8edb-c3b9f2b329dc tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] 10.222.0.26 "POST /compute/v2.1/servers/136d0aa6-479d-4d9c-b633-23203ee44ae4/action" status: 200 len: 32 microversion: 2.1 time: 0.124609 Oct 08 21:04:03.814033 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1476/3013] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:04:03 2022] POST /compute/v2.1/servers/136d0aa6-479d-4d9c-b633-23203ee44ae4/action => generated 32 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 08 21:04:03.820257 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-ba61a31b-ab49-4ba8-b4a2-6e2346a2dd10 req-273e510a-8aab-4409-8235-0afbd3a1f3be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "579b0f8b-ccae-4c2b-bb48-1da1aaf6a138", "name": "network-vif-deleted", "tag": "b8ba5770-3e26-4856-865d-c7bf36a1757a"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:04:03.830497 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-ba61a31b-ab49-4ba8-b4a2-6e2346a2dd10 req-273e510a-8aab-4409-8235-0afbd3a1f3be service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:03.831034 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-ba61a31b-ab49-4ba8-b4a2-6e2346a2dd10 req-273e510a-8aab-4409-8235-0afbd3a1f3be service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:03.832047 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-ba61a31b-ab49-4ba8-b4a2-6e2346a2dd10 req-273e510a-8aab-4409-8235-0afbd3a1f3be service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:03.843863 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-ba61a31b-ab49-4ba8-b4a2-6e2346a2dd10 req-273e510a-8aab-4409-8235-0afbd3a1f3be service nova] Creating event network-vif-deleted:b8ba5770-3e26-4856-865d-c7bf36a1757a for instance 579b0f8b-ccae-4c2b-bb48-1da1aaf6a138 on nch1-master-1 Oct 08 21:04:03.849379 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-ba61a31b-ab49-4ba8-b4a2-6e2346a2dd10 req-273e510a-8aab-4409-8235-0afbd3a1f3be service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033618 Oct 08 21:04:03.850112 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1477/3014] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:04:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:04:03.856639 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-4ec89181-12de-44ad-b315-3d05ea80f667 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:03.857772 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-4ec89181-12de-44ad-b315-3d05ea80f667 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: 6ef37448-690b-4fcf-85f8-a2fb71207f38] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:03.865779 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4ec89181-12de-44ad-b315-3d05ea80f667 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:03.866873 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4ec89181-12de-44ad-b315-3d05ea80f667 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:03.868072 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4ec89181-12de-44ad-b315-3d05ea80f667 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:03.869040 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4ec89181-12de-44ad-b315-3d05ea80f667 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:03.869940 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4ec89181-12de-44ad-b315-3d05ea80f667 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:03.872022 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4ec89181-12de-44ad-b315-3d05ea80f667 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:04.032581 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-c491c911-0107-4417-bb1c-b47d373ae5a2 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2395fe934d458faa80e28587458bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f455695c0214bfab0f412aa34417e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:04.053612 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-c491c911-0107-4417-bb1c-b47d373ae5a2 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] 10.222.0.26 "GET /compute/v2.1/servers/4e392800-b237-4d1d-8372-e635e2450b91" status: 200 len: 1314 microversion: 2.1 time: 0.416793 Oct 08 21:04:04.056199 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1538/3015] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:04:03 2022] GET /compute/v2.1/servers/4e392800-b237-4d1d-8372-e635e2450b91 => generated 1314 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:04:04.067619 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-48dce358-89bc-4500-be21-426c80ac8dd4 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:04.070083 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-48dce358-89bc-4500-be21-426c80ac8dd4 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] [instance: 136d0aa6-479d-4d9c-b633-23203ee44ae4] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:04.092741 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-48dce358-89bc-4500-be21-426c80ac8dd4 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:04.093285 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-48dce358-89bc-4500-be21-426c80ac8dd4 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:04.093911 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-48dce358-89bc-4500-be21-426c80ac8dd4 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:04.101729 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-48dce358-89bc-4500-be21-426c80ac8dd4 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:04.102252 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-48dce358-89bc-4500-be21-426c80ac8dd4 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:04.102705 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-48dce358-89bc-4500-be21-426c80ac8dd4 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:04.160263 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-4ec89181-12de-44ad-b315-3d05ea80f667 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:04.170656 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-4ec89181-12de-44ad-b315-3d05ea80f667 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/6ef37448-690b-4fcf-85f8-a2fb71207f38" status: 200 len: 1476 microversion: 2.1 time: 0.319136 Oct 08 21:04:04.171641 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1478/3016] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:04:03 2022] GET /compute/v2.1/servers/6ef37448-690b-4fcf-85f8-a2fb71207f38 => generated 1476 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:04:04.184696 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-ea7a4f30-9cea-47b3-8952-0828426b0d65 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:04.185585 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-ea7a4f30-9cea-47b3-8952-0828426b0d65 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] [instance: 579b0f8b-ccae-4c2b-bb48-1da1aaf6a138] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:04.194793 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ea7a4f30-9cea-47b3-8952-0828426b0d65 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:04.195586 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ea7a4f30-9cea-47b3-8952-0828426b0d65 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:04.196217 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ea7a4f30-9cea-47b3-8952-0828426b0d65 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:04.196951 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ea7a4f30-9cea-47b3-8952-0828426b0d65 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:04.197621 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ea7a4f30-9cea-47b3-8952-0828426b0d65 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:04.198062 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ea7a4f30-9cea-47b3-8952-0828426b0d65 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:04.234396 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ea7a4f30-9cea-47b3-8952-0828426b0d65 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:04.234894 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ea7a4f30-9cea-47b3-8952-0828426b0d65 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:04.235343 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ea7a4f30-9cea-47b3-8952-0828426b0d65 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:04.235896 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.objects.instance [None req-ea7a4f30-9cea-47b3-8952-0828426b0d65 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lazy-loading 'fault' on Instance uuid 579b0f8b-ccae-4c2b-bb48-1da1aaf6a138 {{(pid=140491) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 21:04:04.277897 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-ea7a4f30-9cea-47b3-8952-0828426b0d65 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1698dee4a2bf4ea19a6ee0c3d5cb5c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b00ee5e7828469f95bd90548d35982a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:04.286872 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-ea7a4f30-9cea-47b3-8952-0828426b0d65 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] 10.222.0.26 "GET /compute/v2.1/servers/579b0f8b-ccae-4c2b-bb48-1da1aaf6a138" status: 200 len: 1312 microversion: 2.1 time: 0.106989 Oct 08 21:04:04.287326 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1479/3017] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:04:04 2022] GET /compute/v2.1/servers/579b0f8b-ccae-4c2b-bb48-1da1aaf6a138 => generated 1312 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:04:04.328131 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-4ff6570a-baf0-4031-9453-d115ae6817cf tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:04.328873 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-4ff6570a-baf0-4031-9453-d115ae6817cf tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] [instance: 7fb18924-877c-4768-a503-718e32ae5765] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:04.336202 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4ff6570a-baf0-4031-9453-d115ae6817cf tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:04.336799 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4ff6570a-baf0-4031-9453-d115ae6817cf tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:04.337427 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4ff6570a-baf0-4031-9453-d115ae6817cf tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:04.338298 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4ff6570a-baf0-4031-9453-d115ae6817cf tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:04.338784 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4ff6570a-baf0-4031-9453-d115ae6817cf tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:04.339367 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4ff6570a-baf0-4031-9453-d115ae6817cf tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:04.457961 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-4ff6570a-baf0-4031-9453-d115ae6817cf tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd917f61a1c043f599ef923f41c3a938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a9dfe2733a844928b29194b54f4a0a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:04.470989 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-4ff6570a-baf0-4031-9453-d115ae6817cf tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd917f61a1c043f599ef923f41c3a938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a9dfe2733a844928b29194b54f4a0a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:04.472916 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-4ff6570a-baf0-4031-9453-d115ae6817cf tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd917f61a1c043f599ef923f41c3a938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a9dfe2733a844928b29194b54f4a0a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:04.474377 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-4ff6570a-baf0-4031-9453-d115ae6817cf tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] 10.222.0.26 "GET /compute/v2.1/servers/7fb18924-877c-4768-a503-718e32ae5765" status: 200 len: 1365 microversion: 2.47 time: 0.150053 Oct 08 21:04:04.489215 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1480/3018] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:04:04 2022] GET /compute/v2.1/servers/7fb18924-877c-4768-a503-718e32ae5765 => generated 1365 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:04:04.614589 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-48dce358-89bc-4500-be21-426c80ac8dd4 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2e13f1952a4e5bb23d57dd7fa31875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b2a56286924e2d953bebe717ce591b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:04.634572 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-48dce358-89bc-4500-be21-426c80ac8dd4 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] 10.222.0.26 "GET /compute/v2.1/servers/136d0aa6-479d-4d9c-b633-23203ee44ae4" status: 200 len: 1507 microversion: 2.1 time: 0.573753 Oct 08 21:04:04.636090 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1539/3019] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:04:04 2022] GET /compute/v2.1/servers/136d0aa6-479d-4d9c-b633-23203ee44ae4 => generated 1507 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:04:04.658697 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-1d1561f1-7632-46dd-ac20-da9cf2f2f0db tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:04.659755 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-1d1561f1-7632-46dd-ac20-da9cf2f2f0db tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] [instance: 0b52e623-6990-4978-811d-68fc294fe304] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:04.668195 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1d1561f1-7632-46dd-ac20-da9cf2f2f0db tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:04.668977 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1d1561f1-7632-46dd-ac20-da9cf2f2f0db tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:04.669675 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1d1561f1-7632-46dd-ac20-da9cf2f2f0db tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:04.670577 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1d1561f1-7632-46dd-ac20-da9cf2f2f0db tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:04.671210 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1d1561f1-7632-46dd-ac20-da9cf2f2f0db tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:04.671912 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1d1561f1-7632-46dd-ac20-da9cf2f2f0db tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:04.700502 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-1d1561f1-7632-46dd-ac20-da9cf2f2f0db tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] HTTP exception thrown: Instance 0b52e623-6990-4978-811d-68fc294fe304 could not be found. Oct 08 21:04:04.702207 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-1d1561f1-7632-46dd-ac20-da9cf2f2f0db tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Request method failure captured: Oct 08 21:04:04.702207 ncdv-master-1 devstack@n-api.service[140491]: request: GET /compute/v2.1/servers/0b52e623-6990-4978-811d-68fc294fe304 HTTP/1.1 Oct 08 21:04:04.702207 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:04:04.702207 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:04:04.702207 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:04:04.702207 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 21:04:04.702207 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:04:04.702207 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:04:04.702207 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:04:04.702207 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:04:04.702207 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeV6gyhhqTwzNzF_DVQE7VbX1i-ngOCRm15dLpkxnz5WVdql8AoVlqCCwyqOkCOk76oWuq0Ya4x_PWsPouJg9rloWzVgiZk1L2YjlEbL6DHjUi-iP3oO8lV6lZU_lN1aEJkywJ-KczU9NSltZHb65aAZbd_JEDRI6tcAk9x88eHP9pU Oct 08 21:04:04.702207 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:04:04.702207 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:04:04.702207 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:04:04.702207 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:04:04.702207 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:04:04.702207 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:04:04.702207 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: bc9bed6d76834f6fa66d681ecd9f4e90 Oct 08 21:04:04.702207 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-ListServerFiltersTestJSON-235970729 Oct 08 21:04:04.702207 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:04:04.702207 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:04:04.702207 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/bc9bed6d76834f6fa66d681ecd9f4e90"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/bc9bed6d76834f6fa66d681ecd9f4e90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_bc9bed6d76834f6fa66d681ecd9f4e90"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/bc9bed6d76834f6fa66d681ecd9f4e90"}]}] Oct 08 21:04:04.702207 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-ListServerFiltersTestJSON-235970729 Oct 08 21:04:04.702207 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: bc9bed6d76834f6fa66d681ecd9f4e90 Oct 08 21:04:04.702207 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-235970729 Oct 08 21:04:04.702207 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-ListServerFiltersTestJSON-235970729-project Oct 08 21:04:04.702207 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:04:04.702207 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:04:04.702207 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 095debf3968c448fb3c3add0322d8d1b Oct 08 21:04:04.702207 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-ListServerFiltersTestJSON-235970729-project Oct 08 21:04:04.702207 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:04:04.702207 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance 0b52e623-6990-4978-811d-68fc294fe304 could not be found. Oct 08 21:04:04.702207 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': '0b52e623-6990-4978-811d-68fc294fe304'} Oct 08 21:04:04.702207 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:04:04.702207 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:04:04.702207 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:04:04.702207 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:04:04.702207 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:04:04.702207 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:04:04.702207 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:04:04.702207 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:04:04.702207 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:04:04.702207 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:04:04.702207 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b52e623-6990-4978-811d-68fc294fe304 could not be found. Oct 08 21:04:04.702207 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:04:04.702207 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:04:04.702207 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:04:04.702207 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:04:04.702207 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:04:04.702207 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:04:04.702207 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:04:04.702207 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:04:04.702207 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:04:04.702207 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:04:04.702207 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:04:04.702207 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:04:04.702207 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:04:04.702207 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:04:04.702207 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:04:04.702207 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:04:04.702207 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b52e623-6990-4978-811d-68fc294fe304 could not be found. Oct 08 21:04:04.702207 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:04:04.702207 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:04:04.702207 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:04:04.708855 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:04:04.708855 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:04:04.708855 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:04:04.708855 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:04:04.708855 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:04:04.708855 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b52e623-6990-4978-811d-68fc294fe304 could not be found. Oct 08 21:04:04.708855 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:04:04.708855 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-1d1561f1-7632-46dd-ac20-da9cf2f2f0db tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Returning 404 to user: Instance 0b52e623-6990-4978-811d-68fc294fe304 could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:04:04.708855 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-1d1561f1-7632-46dd-ac20-da9cf2f2f0db tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] 10.222.0.26 "GET /compute/v2.1/servers/0b52e623-6990-4978-811d-68fc294fe304" status: 404 len: 111 microversion: 2.1 time: 0.050434 Oct 08 21:04:04.711211 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1481/3020] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:04:04 2022] GET /compute/v2.1/servers/0b52e623-6990-4978-811d-68fc294fe304 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:04:04.713382 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-a9de296b-6287-49fd-8137-29dff842806e tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:04.714013 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-a9de296b-6287-49fd-8137-29dff842806e tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] [instance: ede2a1aa-f65b-424e-9034-15a2aaf13e60] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:04.724280 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a9de296b-6287-49fd-8137-29dff842806e tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:04.724786 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a9de296b-6287-49fd-8137-29dff842806e tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:04.725317 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a9de296b-6287-49fd-8137-29dff842806e tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:04.726016 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a9de296b-6287-49fd-8137-29dff842806e tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:04.726723 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a9de296b-6287-49fd-8137-29dff842806e tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:04.727207 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a9de296b-6287-49fd-8137-29dff842806e tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:04.730621 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c0f4f379-4f9b-45d1-9e07-4e9030213f7e tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:04.731552 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-c0f4f379-4f9b-45d1-9e07-4e9030213f7e tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] [instance: 3d7debe3-3039-401c-891d-4c6e4b96cbb8] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:04.740314 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c0f4f379-4f9b-45d1-9e07-4e9030213f7e tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:04.740817 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c0f4f379-4f9b-45d1-9e07-4e9030213f7e tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:04.741313 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c0f4f379-4f9b-45d1-9e07-4e9030213f7e tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:04.742032 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c0f4f379-4f9b-45d1-9e07-4e9030213f7e tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:04.742486 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c0f4f379-4f9b-45d1-9e07-4e9030213f7e tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:04.743177 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c0f4f379-4f9b-45d1-9e07-4e9030213f7e tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:04.774269 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a9de296b-6287-49fd-8137-29dff842806e tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:04.774756 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a9de296b-6287-49fd-8137-29dff842806e tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:04.775448 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a9de296b-6287-49fd-8137-29dff842806e tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:04.776129 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.objects.instance [None req-a9de296b-6287-49fd-8137-29dff842806e tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lazy-loading 'fault' on Instance uuid ede2a1aa-f65b-424e-9034-15a2aaf13e60 {{(pid=140492) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 21:04:04.785475 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-c0f4f379-4f9b-45d1-9e07-4e9030213f7e tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] [instance: 3d7debe3-3039-401c-891d-4c6e4b96cbb8] Going to try to terminate instance {{(pid=140491) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 21:04:04.856721 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-a9de296b-6287-49fd-8137-29dff842806e tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f60e33f334465fac1148669de3f00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4735bf74f33a4739800d766c82d973d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:04.869771 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-a9de296b-6287-49fd-8137-29dff842806e tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] 10.222.0.26 "GET /compute/v2.1/servers/ede2a1aa-f65b-424e-9034-15a2aaf13e60" status: 200 len: 1303 microversion: 2.1 time: 0.161312 Oct 08 21:04:04.870662 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1540/3021] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:04:04 2022] GET /compute/v2.1/servers/ede2a1aa-f65b-424e-9034-15a2aaf13e60 => generated 1303 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:04:04.876175 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-c0f4f379-4f9b-45d1-9e07-4e9030213f7e tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] 10.222.0.26 "DELETE /compute/v2.1/servers/3d7debe3-3039-401c-891d-4c6e4b96cbb8" status: 204 len: 0 microversion: 2.1 time: 0.154418 Oct 08 21:04:04.876837 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1482/3022] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:04:04 2022] DELETE /compute/v2.1/servers/3d7debe3-3039-401c-891d-4c6e4b96cbb8 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 21:04:04.884873 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-1282252f-3e9d-45b2-8a01-0296214096ea tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:04.885759 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-1282252f-3e9d-45b2-8a01-0296214096ea tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] [instance: 3d7debe3-3039-401c-891d-4c6e4b96cbb8] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:04.892657 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1282252f-3e9d-45b2-8a01-0296214096ea tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:04.893163 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1282252f-3e9d-45b2-8a01-0296214096ea tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:04.894154 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1282252f-3e9d-45b2-8a01-0296214096ea tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:04.894892 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1282252f-3e9d-45b2-8a01-0296214096ea tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:04.895420 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1282252f-3e9d-45b2-8a01-0296214096ea tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:04.896234 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1282252f-3e9d-45b2-8a01-0296214096ea tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:05.080637 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-f112e8f7-8c02-4a61-9760-630ea10d4661 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:05.082403 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-f112e8f7-8c02-4a61-9760-630ea10d4661 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] [instance: 4e392800-b237-4d1d-8372-e635e2450b91] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:05.089111 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f112e8f7-8c02-4a61-9760-630ea10d4661 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:05.089649 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f112e8f7-8c02-4a61-9760-630ea10d4661 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:05.090092 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f112e8f7-8c02-4a61-9760-630ea10d4661 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:05.090803 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f112e8f7-8c02-4a61-9760-630ea10d4661 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:05.091264 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f112e8f7-8c02-4a61-9760-630ea10d4661 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:05.091696 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f112e8f7-8c02-4a61-9760-630ea10d4661 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:05.225609 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-1282252f-3e9d-45b2-8a01-0296214096ea tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095debf3968c448fb3c3add0322d8d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc9bed6d76834f6fa66d681ecd9f4e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:05.233861 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-f112e8f7-8c02-4a61-9760-630ea10d4661 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2395fe934d458faa80e28587458bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f455695c0214bfab0f412aa34417e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:05.241866 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-1282252f-3e9d-45b2-8a01-0296214096ea tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] 10.222.0.26 "GET /compute/v2.1/servers/3d7debe3-3039-401c-891d-4c6e4b96cbb8" status: 200 len: 1518 microversion: 2.1 time: 0.360793 Oct 08 21:04:05.242456 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1541/3023] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:04:04 2022] GET /compute/v2.1/servers/3d7debe3-3039-401c-891d-4c6e4b96cbb8 => generated 1518 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:04:05.255862 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-f112e8f7-8c02-4a61-9760-630ea10d4661 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] 10.222.0.26 "GET /compute/v2.1/servers/4e392800-b237-4d1d-8372-e635e2450b91" status: 200 len: 1314 microversion: 2.1 time: 0.168788 Oct 08 21:04:05.255862 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1483/3024] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:04:05 2022] GET /compute/v2.1/servers/4e392800-b237-4d1d-8372-e635e2450b91 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:04:05.255862 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-9afd726b-af68-4e62-9106-19020763e191 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:05.255862 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-9afd726b-af68-4e62-9106-19020763e191 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: 6ef37448-690b-4fcf-85f8-a2fb71207f38] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:05.257676 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9afd726b-af68-4e62-9106-19020763e191 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:05.258330 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9afd726b-af68-4e62-9106-19020763e191 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:05.258937 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9afd726b-af68-4e62-9106-19020763e191 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:05.259632 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9afd726b-af68-4e62-9106-19020763e191 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:05.260257 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9afd726b-af68-4e62-9106-19020763e191 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:05.260685 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9afd726b-af68-4e62-9106-19020763e191 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:05.313776 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-bfccd210-ce58-429b-b282-fb833bf2ab78 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:05.314513 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-bfccd210-ce58-429b-b282-fb833bf2ab78 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] [instance: 579b0f8b-ccae-4c2b-bb48-1da1aaf6a138] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:05.322432 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bfccd210-ce58-429b-b282-fb833bf2ab78 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:05.324107 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bfccd210-ce58-429b-b282-fb833bf2ab78 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:05.324676 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bfccd210-ce58-429b-b282-fb833bf2ab78 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:05.325693 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bfccd210-ce58-429b-b282-fb833bf2ab78 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:05.326381 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bfccd210-ce58-429b-b282-fb833bf2ab78 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:05.327103 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bfccd210-ce58-429b-b282-fb833bf2ab78 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:05.366810 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bfccd210-ce58-429b-b282-fb833bf2ab78 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:05.367627 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bfccd210-ce58-429b-b282-fb833bf2ab78 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:05.368296 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bfccd210-ce58-429b-b282-fb833bf2ab78 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:05.369016 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.objects.instance [None req-bfccd210-ce58-429b-b282-fb833bf2ab78 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lazy-loading 'fault' on Instance uuid 579b0f8b-ccae-4c2b-bb48-1da1aaf6a138 {{(pid=140492) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 21:04:05.418350 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-9afd726b-af68-4e62-9106-19020763e191 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:05.428488 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-9afd726b-af68-4e62-9106-19020763e191 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/6ef37448-690b-4fcf-85f8-a2fb71207f38" status: 200 len: 1476 microversion: 2.1 time: 0.181459 Oct 08 21:04:05.429740 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1484/3025] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:04:05 2022] GET /compute/v2.1/servers/6ef37448-690b-4fcf-85f8-a2fb71207f38 => generated 1476 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:04:05.502761 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-470dbcc2-ec55-4b32-a889-d6a34e92f175 tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:05.504063 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-470dbcc2-ec55-4b32-a889-d6a34e92f175 tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] [instance: 7fb18924-877c-4768-a503-718e32ae5765] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:05.510579 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-470dbcc2-ec55-4b32-a889-d6a34e92f175 tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:05.511088 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-470dbcc2-ec55-4b32-a889-d6a34e92f175 tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:05.511730 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-470dbcc2-ec55-4b32-a889-d6a34e92f175 tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:05.512471 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-470dbcc2-ec55-4b32-a889-d6a34e92f175 tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:05.512940 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-470dbcc2-ec55-4b32-a889-d6a34e92f175 tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:05.513420 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-470dbcc2-ec55-4b32-a889-d6a34e92f175 tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:05.580418 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-470dbcc2-ec55-4b32-a889-d6a34e92f175 tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd917f61a1c043f599ef923f41c3a938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a9dfe2733a844928b29194b54f4a0a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:05.589719 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-470dbcc2-ec55-4b32-a889-d6a34e92f175 tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd917f61a1c043f599ef923f41c3a938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a9dfe2733a844928b29194b54f4a0a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:05.591100 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-470dbcc2-ec55-4b32-a889-d6a34e92f175 tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd917f61a1c043f599ef923f41c3a938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a9dfe2733a844928b29194b54f4a0a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:05.592294 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-470dbcc2-ec55-4b32-a889-d6a34e92f175 tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] 10.222.0.26 "GET /compute/v2.1/servers/7fb18924-877c-4768-a503-718e32ae5765" status: 200 len: 1365 microversion: 2.47 time: 0.093641 Oct 08 21:04:05.593066 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1485/3026] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:04:05 2022] GET /compute/v2.1/servers/7fb18924-877c-4768-a503-718e32ae5765 => generated 1365 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 08 21:04:05.658989 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-a37c2015-8cd5-4fa6-a4e0-ca639f7181ce tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:05.659613 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-a37c2015-8cd5-4fa6-a4e0-ca639f7181ce tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] [instance: 136d0aa6-479d-4d9c-b633-23203ee44ae4] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:05.666081 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a37c2015-8cd5-4fa6-a4e0-ca639f7181ce tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:05.666581 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a37c2015-8cd5-4fa6-a4e0-ca639f7181ce tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:05.667026 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a37c2015-8cd5-4fa6-a4e0-ca639f7181ce tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:05.667771 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a37c2015-8cd5-4fa6-a4e0-ca639f7181ce tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:05.668272 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a37c2015-8cd5-4fa6-a4e0-ca639f7181ce tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:05.668706 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a37c2015-8cd5-4fa6-a4e0-ca639f7181ce tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:05.715193 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-bfccd210-ce58-429b-b282-fb833bf2ab78 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1698dee4a2bf4ea19a6ee0c3d5cb5c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b00ee5e7828469f95bd90548d35982a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:05.723155 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-bfccd210-ce58-429b-b282-fb833bf2ab78 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] 10.222.0.26 "GET /compute/v2.1/servers/579b0f8b-ccae-4c2b-bb48-1da1aaf6a138" status: 200 len: 1312 microversion: 2.1 time: 0.415131 Oct 08 21:04:05.724066 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1542/3027] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:04:05 2022] GET /compute/v2.1/servers/579b0f8b-ccae-4c2b-bb48-1da1aaf6a138 => generated 1312 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:04:05.729144 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-d350386d-4f1a-47be-bd84-10f038870eae req-2ba8d099-84e8-40c4-a7cc-aa50b7f9b4bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ede2a1aa-f65b-424e-9034-15a2aaf13e60", "name": "network-vif-deleted", "tag": "761d6383-28be-4b4b-87b9-3cd96e5126ce"}, {"server_uuid": "ede2a1aa-f65b-424e-9034-15a2aaf13e60", "name": "network-vif-deleted", "tag": "d651f0cc-7f26-4fcd-8f94-fbd142dbaba0"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:04:05.739357 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-d350386d-4f1a-47be-bd84-10f038870eae req-2ba8d099-84e8-40c4-a7cc-aa50b7f9b4bc service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:05.740146 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-d350386d-4f1a-47be-bd84-10f038870eae req-2ba8d099-84e8-40c4-a7cc-aa50b7f9b4bc service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:05.740584 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-d350386d-4f1a-47be-bd84-10f038870eae req-2ba8d099-84e8-40c4-a7cc-aa50b7f9b4bc service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:05.744590 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=100 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:04:05.753828 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-d350386d-4f1a-47be-bd84-10f038870eae req-2ba8d099-84e8-40c4-a7cc-aa50b7f9b4bc service nova] Creating event network-vif-deleted:761d6383-28be-4b4b-87b9-3cd96e5126ce for instance ede2a1aa-f65b-424e-9034-15a2aaf13e60 on nch2-master-1 Oct 08 21:04:05.754355 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-d350386d-4f1a-47be-bd84-10f038870eae req-2ba8d099-84e8-40c4-a7cc-aa50b7f9b4bc service nova] Creating event network-vif-deleted:d651f0cc-7f26-4fcd-8f94-fbd142dbaba0 for instance ede2a1aa-f65b-424e-9034-15a2aaf13e60 on nch2-master-1 Oct 08 21:04:05.759561 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-d350386d-4f1a-47be-bd84-10f038870eae req-2ba8d099-84e8-40c4-a7cc-aa50b7f9b4bc service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.034353 Oct 08 21:04:05.760170 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1543/3028] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:04:05 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:04:05.809819 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-a37c2015-8cd5-4fa6-a4e0-ca639f7181ce tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2e13f1952a4e5bb23d57dd7fa31875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b2a56286924e2d953bebe717ce591b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:05.818864 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-a37c2015-8cd5-4fa6-a4e0-ca639f7181ce tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] 10.222.0.26 "GET /compute/v2.1/servers/136d0aa6-479d-4d9c-b633-23203ee44ae4" status: 200 len: 1507 microversion: 2.1 time: 0.163784 Oct 08 21:04:05.819918 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1486/3029] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:04:05 2022] GET /compute/v2.1/servers/136d0aa6-479d-4d9c-b633-23203ee44ae4 => generated 1507 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:04:05.897811 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-aecf78fe-7511-489e-88c9-a1cddd038f0e tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:05.898447 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-aecf78fe-7511-489e-88c9-a1cddd038f0e tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] [instance: ede2a1aa-f65b-424e-9034-15a2aaf13e60] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:05.907084 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-aecf78fe-7511-489e-88c9-a1cddd038f0e tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:05.907598 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-aecf78fe-7511-489e-88c9-a1cddd038f0e tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:05.908035 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-aecf78fe-7511-489e-88c9-a1cddd038f0e tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:05.908973 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-aecf78fe-7511-489e-88c9-a1cddd038f0e tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:05.909982 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-aecf78fe-7511-489e-88c9-a1cddd038f0e tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:05.910578 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-aecf78fe-7511-489e-88c9-a1cddd038f0e tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:05.924834 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-aecf78fe-7511-489e-88c9-a1cddd038f0e tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] HTTP exception thrown: Instance ede2a1aa-f65b-424e-9034-15a2aaf13e60 could not be found. Oct 08 21:04:05.927211 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-aecf78fe-7511-489e-88c9-a1cddd038f0e tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Request method failure captured: Oct 08 21:04:05.927211 ncdv-master-1 devstack@n-api.service[140492]: request: GET /compute/v2.1/servers/ede2a1aa-f65b-424e-9034-15a2aaf13e60 HTTP/1.1 Oct 08 21:04:05.927211 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:04:05.927211 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:04:05.927211 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:04:05.927211 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 21:04:05.927211 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:04:05.927211 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:04:05.927211 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:04:05.927211 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:04:05.927211 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeVUEnRvCLyCdYjboZWSkex8rTCtYI1WBk9L9mszZTx76Yjj3LxtSlFNG9MVk6PLQz6uz0j43wAsyIQ12BqqCeuqBLoD2YPavK2g1xvBbLBuCYCYfHR4_kPFl1spz3btBQTXrY3gFkG7sssAZkB-WmdL9ekIbfJeNfVQZChikHfwtuo Oct 08 21:04:05.927211 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:04:05.927211 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:04:05.927211 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:04:05.927211 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:04:05.927211 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:04:05.927211 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:04:05.927211 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 4735bf74f33a4739800d766c82d973d4 Oct 08 21:04:05.927211 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-ServersTestMultiNic-898906473 Oct 08 21:04:05.927211 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:04:05.927211 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:04:05.927211 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/4735bf74f33a4739800d766c82d973d4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4735bf74f33a4739800d766c82d973d4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_4735bf74f33a4739800d766c82d973d4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4735bf74f33a4739800d766c82d973d4"}]}] Oct 08 21:04:05.927211 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-ServersTestMultiNic-898906473 Oct 08 21:04:05.927211 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 4735bf74f33a4739800d766c82d973d4 Oct 08 21:04:05.927211 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-ServersTestMultiNic-898906473 Oct 08 21:04:05.927211 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-ServersTestMultiNic-898906473-project Oct 08 21:04:05.927211 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:04:05.927211 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:04:05.927211 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 40f60e33f334465fac1148669de3f00c Oct 08 21:04:05.927211 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-ServersTestMultiNic-898906473-project Oct 08 21:04:05.927211 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 21:04:05.927211 ncdv-master-1 devstack@n-api.service[140492]: exception: Instance ede2a1aa-f65b-424e-9034-15a2aaf13e60 could not be found. Oct 08 21:04:05.927211 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': 'ede2a1aa-f65b-424e-9034-15a2aaf13e60'} Oct 08 21:04:05.927211 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:04:05.927211 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:04:05.927211 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:04:05.927211 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:04:05.927211 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:04:05.927211 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:04:05.927211 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:04:05.927211 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:04:05.927211 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:04:05.927211 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:04:05.927211 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ede2a1aa-f65b-424e-9034-15a2aaf13e60 could not be found. Oct 08 21:04:05.927211 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:04:05.927211 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:04:05.927211 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:04:05.927211 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:04:05.927211 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:04:05.927211 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:04:05.927211 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:04:05.927211 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:04:05.927211 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:04:05.927211 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:04:05.927211 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:04:05.927211 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:04:05.927211 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:04:05.927211 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:04:05.927211 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:04:05.927211 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:04:05.927211 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ede2a1aa-f65b-424e-9034-15a2aaf13e60 could not be found. Oct 08 21:04:05.927211 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:04:05.927211 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:04:05.927211 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:04:05.931109 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:04:05.931109 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:04:05.931109 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:04:05.931109 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:04:05.931109 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:04:05.931109 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ede2a1aa-f65b-424e-9034-15a2aaf13e60 could not be found. Oct 08 21:04:05.931109 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:04:05.931109 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-aecf78fe-7511-489e-88c9-a1cddd038f0e tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Returning 404 to user: Instance ede2a1aa-f65b-424e-9034-15a2aaf13e60 could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:04:05.931109 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-aecf78fe-7511-489e-88c9-a1cddd038f0e tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] 10.222.0.26 "GET /compute/v2.1/servers/ede2a1aa-f65b-424e-9034-15a2aaf13e60" status: 404 len: 111 microversion: 2.1 time: 0.038045 Oct 08 21:04:05.932528 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1544/3030] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:04:05 2022] GET /compute/v2.1/servers/ede2a1aa-f65b-424e-9034-15a2aaf13e60 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 08 21:04:06.266669 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-3fbf6544-9c90-49d8-af6b-ceab236512b0 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:06.267220 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-f6872fd7-51fb-41e7-9d02-0f3d76d10379 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:06.267345 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-3fbf6544-9c90-49d8-af6b-ceab236512b0 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] [instance: 4e392800-b237-4d1d-8372-e635e2450b91] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:06.267662 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-f6872fd7-51fb-41e7-9d02-0f3d76d10379 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] [instance: 3d7debe3-3039-401c-891d-4c6e4b96cbb8] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:06.280395 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3fbf6544-9c90-49d8-af6b-ceab236512b0 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:06.281658 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f6872fd7-51fb-41e7-9d02-0f3d76d10379 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:06.282417 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f6872fd7-51fb-41e7-9d02-0f3d76d10379 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:06.283058 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f6872fd7-51fb-41e7-9d02-0f3d76d10379 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:06.284086 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3fbf6544-9c90-49d8-af6b-ceab236512b0 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:06.286901 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f6872fd7-51fb-41e7-9d02-0f3d76d10379 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:06.287398 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3fbf6544-9c90-49d8-af6b-ceab236512b0 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:06.289225 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f6872fd7-51fb-41e7-9d02-0f3d76d10379 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:06.289692 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f6872fd7-51fb-41e7-9d02-0f3d76d10379 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:06.289844 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3fbf6544-9c90-49d8-af6b-ceab236512b0 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:06.292801 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3fbf6544-9c90-49d8-af6b-ceab236512b0 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:06.297636 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3fbf6544-9c90-49d8-af6b-ceab236512b0 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:06.656016 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-f6872fd7-51fb-41e7-9d02-0f3d76d10379 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095debf3968c448fb3c3add0322d8d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc9bed6d76834f6fa66d681ecd9f4e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:06.670881 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-f6872fd7-51fb-41e7-9d02-0f3d76d10379 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] 10.222.0.26 "GET /compute/v2.1/servers/3d7debe3-3039-401c-891d-4c6e4b96cbb8" status: 200 len: 1518 microversion: 2.1 time: 0.408283 Oct 08 21:04:06.672715 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1487/3031] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:04:06 2022] GET /compute/v2.1/servers/3d7debe3-3039-401c-891d-4c6e4b96cbb8 => generated 1518 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:04:06.681219 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-786849dd-5b20-47a7-b95b-f896eeaa50c8 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:06.682287 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-786849dd-5b20-47a7-b95b-f896eeaa50c8 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: 6ef37448-690b-4fcf-85f8-a2fb71207f38] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:06.692733 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-786849dd-5b20-47a7-b95b-f896eeaa50c8 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:06.693508 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-786849dd-5b20-47a7-b95b-f896eeaa50c8 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:06.694103 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-786849dd-5b20-47a7-b95b-f896eeaa50c8 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:06.694975 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-786849dd-5b20-47a7-b95b-f896eeaa50c8 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:06.695594 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-786849dd-5b20-47a7-b95b-f896eeaa50c8 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:06.696201 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-786849dd-5b20-47a7-b95b-f896eeaa50c8 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:06.764813 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-3fbf6544-9c90-49d8-af6b-ceab236512b0 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2395fe934d458faa80e28587458bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f455695c0214bfab0f412aa34417e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:06.795970 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-3fbf6544-9c90-49d8-af6b-ceab236512b0 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] 10.222.0.26 "GET /compute/v2.1/servers/4e392800-b237-4d1d-8372-e635e2450b91" status: 200 len: 1314 microversion: 2.1 time: 0.532786 Oct 08 21:04:06.797324 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1545/3032] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:04:06 2022] GET /compute/v2.1/servers/4e392800-b237-4d1d-8372-e635e2450b91 => generated 1314 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:04:06.806532 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-800ff075-f780-4898-8874-0cba5a93455a tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:06.811895 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-800ff075-f780-4898-8874-0cba5a93455a tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] [instance: 7fb18924-877c-4768-a503-718e32ae5765] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:06.829304 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-800ff075-f780-4898-8874-0cba5a93455a tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:06.830444 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-800ff075-f780-4898-8874-0cba5a93455a tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:06.831716 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-800ff075-f780-4898-8874-0cba5a93455a tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:06.832801 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-800ff075-f780-4898-8874-0cba5a93455a tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:06.838364 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-800ff075-f780-4898-8874-0cba5a93455a tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:06.839165 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-800ff075-f780-4898-8874-0cba5a93455a tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:06.888575 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-800ff075-f780-4898-8874-0cba5a93455a tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:06.889786 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-800ff075-f780-4898-8874-0cba5a93455a tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:06.890539 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-800ff075-f780-4898-8874-0cba5a93455a tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:06.891015 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.objects.instance [None req-800ff075-f780-4898-8874-0cba5a93455a tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Lazy-loading 'fault' on Instance uuid 7fb18924-877c-4768-a503-718e32ae5765 {{(pid=140492) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 21:04:06.953018 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-800ff075-f780-4898-8874-0cba5a93455a tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd917f61a1c043f599ef923f41c3a938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a9dfe2733a844928b29194b54f4a0a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:06.970729 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-800ff075-f780-4898-8874-0cba5a93455a tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd917f61a1c043f599ef923f41c3a938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a9dfe2733a844928b29194b54f4a0a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:06.974794 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-800ff075-f780-4898-8874-0cba5a93455a tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd917f61a1c043f599ef923f41c3a938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a9dfe2733a844928b29194b54f4a0a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:06.977120 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-800ff075-f780-4898-8874-0cba5a93455a tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] 10.222.0.26 "GET /compute/v2.1/servers/7fb18924-877c-4768-a503-718e32ae5765" status: 200 len: 1370 microversion: 2.47 time: 0.178524 Oct 08 21:04:06.991114 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1546/3033] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:04:06 2022] GET /compute/v2.1/servers/7fb18924-877c-4768-a503-718e32ae5765 => generated 1370 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:04:07.017488 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-f4f418af-9290-4797-8934-9e6e11e09871 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:07.018827 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-f4f418af-9290-4797-8934-9e6e11e09871 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] [instance: 579b0f8b-ccae-4c2b-bb48-1da1aaf6a138] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:07.035887 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=38 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:04:07.062566 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f4f418af-9290-4797-8934-9e6e11e09871 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:07.066421 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f4f418af-9290-4797-8934-9e6e11e09871 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:07.068385 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f4f418af-9290-4797-8934-9e6e11e09871 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:07.070759 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f4f418af-9290-4797-8934-9e6e11e09871 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:07.071478 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f4f418af-9290-4797-8934-9e6e11e09871 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:07.072722 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f4f418af-9290-4797-8934-9e6e11e09871 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:07.106887 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-f4f418af-9290-4797-8934-9e6e11e09871 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] HTTP exception thrown: Instance 579b0f8b-ccae-4c2b-bb48-1da1aaf6a138 could not be found. Oct 08 21:04:07.119397 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-f4f418af-9290-4797-8934-9e6e11e09871 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Request method failure captured: Oct 08 21:04:07.119397 ncdv-master-1 devstack@n-api.service[140492]: request: GET /compute/v2.1/servers/579b0f8b-ccae-4c2b-bb48-1da1aaf6a138 HTTP/1.1 Oct 08 21:04:07.119397 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:04:07.119397 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:04:07.119397 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:04:07.119397 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 21:04:07.119397 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:04:07.119397 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:04:07.119397 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:04:07.119397 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:04:07.119397 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeS0fE1W4PvU2_7k8u76nOm9Y1zh9DtzN6SifZox8c4Ee-O4iYj3CcpXLLEG93O-SwetyStVJsCOhK1z0DAluVdyejBt-R2ozc-SxCa3q7lzUNWL-Kx89hV0cNzOobKFM-EJsBUodFQ4EWnFtqD_Q-5HZD9KoD2jZ3YWHd3RuK5iGsY Oct 08 21:04:07.119397 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:04:07.119397 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:04:07.119397 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:04:07.119397 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:04:07.119397 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:04:07.119397 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:04:07.119397 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 8b00ee5e7828469f95bd90548d35982a Oct 08 21:04:07.119397 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1823882791 Oct 08 21:04:07.119397 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:04:07.119397 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:04:07.119397 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8b00ee5e7828469f95bd90548d35982a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8b00ee5e7828469f95bd90548d35982a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8b00ee5e7828469f95bd90548d35982a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8b00ee5e7828469f95bd90548d35982a"}]}] Oct 08 21:04:07.119397 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1823882791 Oct 08 21:04:07.119397 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 8b00ee5e7828469f95bd90548d35982a Oct 08 21:04:07.119397 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1823882791 Oct 08 21:04:07.119397 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-ServerRescueNegativeTestJSON-1823882791-project Oct 08 21:04:07.119397 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:04:07.119397 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:04:07.119397 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 1698dee4a2bf4ea19a6ee0c3d5cb5c09 Oct 08 21:04:07.119397 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1823882791-project Oct 08 21:04:07.119397 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 21:04:07.119397 ncdv-master-1 devstack@n-api.service[140492]: exception: Instance 579b0f8b-ccae-4c2b-bb48-1da1aaf6a138 could not be found. Oct 08 21:04:07.119397 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': '579b0f8b-ccae-4c2b-bb48-1da1aaf6a138'} Oct 08 21:04:07.119397 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:04:07.119397 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:04:07.119397 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:04:07.119397 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:04:07.119397 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:04:07.119397 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:04:07.119397 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:04:07.119397 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:04:07.119397 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:04:07.119397 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:04:07.119397 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 579b0f8b-ccae-4c2b-bb48-1da1aaf6a138 could not be found. Oct 08 21:04:07.119397 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:04:07.119397 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:04:07.119397 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:04:07.119397 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:04:07.119397 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:04:07.119397 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:04:07.119397 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:04:07.119397 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:04:07.119397 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:04:07.119397 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:04:07.119397 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:04:07.119397 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:04:07.119397 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:04:07.119397 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:04:07.119397 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:04:07.119397 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:04:07.119397 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 579b0f8b-ccae-4c2b-bb48-1da1aaf6a138 could not be found. Oct 08 21:04:07.119397 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:04:07.119397 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:04:07.123388 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:04:07.123388 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:04:07.123388 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:04:07.123388 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:04:07.123388 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:04:07.123388 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:04:07.123388 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 579b0f8b-ccae-4c2b-bb48-1da1aaf6a138 could not be found. Oct 08 21:04:07.123388 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:04:07.125524 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-f4f418af-9290-4797-8934-9e6e11e09871 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] Returning 404 to user: Instance 579b0f8b-ccae-4c2b-bb48-1da1aaf6a138 could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:04:07.129989 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-f4f418af-9290-4797-8934-9e6e11e09871 tempest-ServerRescueNegativeTestJSON-1823882791 tempest-ServerRescueNegativeTestJSON-1823882791-project] 10.222.0.26 "GET /compute/v2.1/servers/579b0f8b-ccae-4c2b-bb48-1da1aaf6a138" status: 404 len: 111 microversion: 2.1 time: 0.136988 Oct 08 21:04:07.136073 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1547/3034] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:04:06 2022] GET /compute/v2.1/servers/579b0f8b-ccae-4c2b-bb48-1da1aaf6a138 => generated 111 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:04:07.147295 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-19c2e2b4-bb6f-4a15-ba0b-3070baf98309 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:07.148153 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-19c2e2b4-bb6f-4a15-ba0b-3070baf98309 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] [instance: 136d0aa6-479d-4d9c-b633-23203ee44ae4] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:07.156130 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-19c2e2b4-bb6f-4a15-ba0b-3070baf98309 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:07.156854 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-19c2e2b4-bb6f-4a15-ba0b-3070baf98309 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:07.157589 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-19c2e2b4-bb6f-4a15-ba0b-3070baf98309 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:07.159224 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-19c2e2b4-bb6f-4a15-ba0b-3070baf98309 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:07.160509 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-19c2e2b4-bb6f-4a15-ba0b-3070baf98309 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:07.161288 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-19c2e2b4-bb6f-4a15-ba0b-3070baf98309 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:07.164745 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-786849dd-5b20-47a7-b95b-f896eeaa50c8 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:07.172645 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-786849dd-5b20-47a7-b95b-f896eeaa50c8 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/6ef37448-690b-4fcf-85f8-a2fb71207f38" status: 200 len: 1476 microversion: 2.1 time: 0.498140 Oct 08 21:04:07.173250 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1488/3035] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:04:06 2022] GET /compute/v2.1/servers/6ef37448-690b-4fcf-85f8-a2fb71207f38 => generated 1476 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:04:07.631877 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-19c2e2b4-bb6f-4a15-ba0b-3070baf98309 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2e13f1952a4e5bb23d57dd7fa31875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b2a56286924e2d953bebe717ce591b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:07.640186 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-19c2e2b4-bb6f-4a15-ba0b-3070baf98309 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] 10.222.0.26 "GET /compute/v2.1/servers/136d0aa6-479d-4d9c-b633-23203ee44ae4" status: 200 len: 1507 microversion: 2.1 time: 0.502693 Oct 08 21:04:07.641023 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1548/3036] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:04:07 2022] GET /compute/v2.1/servers/136d0aa6-479d-4d9c-b633-23203ee44ae4 => generated 1507 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:04:07.696964 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-4f8bce77-75ee-4114-bf27-85b73f384e2f tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:07.697963 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-4f8bce77-75ee-4114-bf27-85b73f384e2f tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] [instance: 3d7debe3-3039-401c-891d-4c6e4b96cbb8] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:07.707943 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4f8bce77-75ee-4114-bf27-85b73f384e2f tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:07.708678 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4f8bce77-75ee-4114-bf27-85b73f384e2f tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:07.709355 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4f8bce77-75ee-4114-bf27-85b73f384e2f tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:07.711018 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4f8bce77-75ee-4114-bf27-85b73f384e2f tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:07.711803 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4f8bce77-75ee-4114-bf27-85b73f384e2f tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:07.712394 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4f8bce77-75ee-4114-bf27-85b73f384e2f tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:07.822257 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-2f589444-43fb-4e1f-b040-dd8ffb6bf0a7 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:07.823678 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-2f589444-43fb-4e1f-b040-dd8ffb6bf0a7 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] [instance: 4e392800-b237-4d1d-8372-e635e2450b91] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:07.838701 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2f589444-43fb-4e1f-b040-dd8ffb6bf0a7 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:07.839503 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2f589444-43fb-4e1f-b040-dd8ffb6bf0a7 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:07.840295 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2f589444-43fb-4e1f-b040-dd8ffb6bf0a7 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:07.841674 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2f589444-43fb-4e1f-b040-dd8ffb6bf0a7 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:07.842911 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-4f8bce77-75ee-4114-bf27-85b73f384e2f tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095debf3968c448fb3c3add0322d8d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc9bed6d76834f6fa66d681ecd9f4e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:07.843292 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2f589444-43fb-4e1f-b040-dd8ffb6bf0a7 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:07.843979 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2f589444-43fb-4e1f-b040-dd8ffb6bf0a7 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:07.858292 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-4f8bce77-75ee-4114-bf27-85b73f384e2f tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] 10.222.0.26 "GET /compute/v2.1/servers/3d7debe3-3039-401c-891d-4c6e4b96cbb8" status: 200 len: 1476 microversion: 2.1 time: 0.166298 Oct 08 21:04:07.859471 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1489/3037] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:04:07 2022] GET /compute/v2.1/servers/3d7debe3-3039-401c-891d-4c6e4b96cbb8 => generated 1476 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:04:07.902886 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-d6b65f41-97a1-44d0-be5f-8fe6f8da7ace req-b91323ed-77e7-42ae-bcdd-af5d7f7bc9d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d7debe3-3039-401c-891d-4c6e4b96cbb8", "name": "network-vif-deleted", "tag": "9be27357-49f2-42c9-a347-c6ce1c36dbff"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:04:07.917127 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-d6b65f41-97a1-44d0-be5f-8fe6f8da7ace req-b91323ed-77e7-42ae-bcdd-af5d7f7bc9d9 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:07.921562 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-d6b65f41-97a1-44d0-be5f-8fe6f8da7ace req-b91323ed-77e7-42ae-bcdd-af5d7f7bc9d9 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:07.922153 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-d6b65f41-97a1-44d0-be5f-8fe6f8da7ace req-b91323ed-77e7-42ae-bcdd-af5d7f7bc9d9 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:07.938328 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-d6b65f41-97a1-44d0-be5f-8fe6f8da7ace req-b91323ed-77e7-42ae-bcdd-af5d7f7bc9d9 service nova] Creating event network-vif-deleted:9be27357-49f2-42c9-a347-c6ce1c36dbff for instance 3d7debe3-3039-401c-891d-4c6e4b96cbb8 on nch1-master-1 Oct 08 21:04:07.943730 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-d6b65f41-97a1-44d0-be5f-8fe6f8da7ace req-b91323ed-77e7-42ae-bcdd-af5d7f7bc9d9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044770 Oct 08 21:04:07.944590 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1490/3038] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:04:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Oct 08 21:04:08.009995 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-4aaac672-c47e-46b8-bb45-8037aaa87663 tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:08.011012 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-4aaac672-c47e-46b8-bb45-8037aaa87663 tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] [instance: 7fb18924-877c-4768-a503-718e32ae5765] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:08.026895 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4aaac672-c47e-46b8-bb45-8037aaa87663 tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:08.027609 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4aaac672-c47e-46b8-bb45-8037aaa87663 tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:08.028267 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4aaac672-c47e-46b8-bb45-8037aaa87663 tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:08.029203 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4aaac672-c47e-46b8-bb45-8037aaa87663 tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:08.030121 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4aaac672-c47e-46b8-bb45-8037aaa87663 tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:08.031729 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4aaac672-c47e-46b8-bb45-8037aaa87663 tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:08.054287 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-4aaac672-c47e-46b8-bb45-8037aaa87663 tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] HTTP exception thrown: Instance 7fb18924-877c-4768-a503-718e32ae5765 could not be found. Oct 08 21:04:08.058801 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-4aaac672-c47e-46b8-bb45-8037aaa87663 tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Request method failure captured: Oct 08 21:04:08.058801 ncdv-master-1 devstack@n-api.service[140491]: request: GET /compute/v2.1/servers/7fb18924-877c-4768-a503-718e32ae5765 HTTP/1.1 Oct 08 21:04:08.058801 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:04:08.058801 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:04:08.058801 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:04:08.058801 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 21:04:08.058801 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:04:08.058801 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:04:08.058801 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:04:08.058801 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:04:08.058801 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeW2r3n9OqzaI4DEunFVvFoQtY_pfJtNUt7SPDg39KMAcU3ujj2tCavnq1bE7EOqfIXgxTdQGnzql3bxzjIaekBv-_YdVzzm-ic4SErWn2ZcI4QF1YTYfGik_oyXLtr3XVlNqTmKjxmw6c6dYUFOqMKrdSOSWwjq9gndbw3rW71VCwA Oct 08 21:04:08.058801 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:04:08.058801 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:04:08.058801 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:04:08.058801 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:04:08.058801 ncdv-master-1 devstack@n-api.service[140491]: X-Openstack-Nova-Api-Version: 2.47 Oct 08 21:04:08.058801 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:04:08.058801 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:04:08.058801 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 9a9dfe2733a844928b29194b54f4a0a4 Oct 08 21:04:08.058801 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-ServersAaction247Test-338676422 Oct 08 21:04:08.058801 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:04:08.058801 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:04:08.058801 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9a9dfe2733a844928b29194b54f4a0a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9a9dfe2733a844928b29194b54f4a0a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9a9dfe2733a844928b29194b54f4a0a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9a9dfe2733a844928b29194b54f4a0a4"}]}] Oct 08 21:04:08.058801 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-ServersAaction247Test-338676422 Oct 08 21:04:08.058801 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 9a9dfe2733a844928b29194b54f4a0a4 Oct 08 21:04:08.058801 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-ServersAaction247Test-338676422 Oct 08 21:04:08.058801 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-ServersAaction247Test-338676422-project Oct 08 21:04:08.058801 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:04:08.058801 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:04:08.058801 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: fd917f61a1c043f599ef923f41c3a938 Oct 08 21:04:08.058801 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-ServersAaction247Test-338676422-project Oct 08 21:04:08.058801 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:04:08.058801 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance 7fb18924-877c-4768-a503-718e32ae5765 could not be found. Oct 08 21:04:08.058801 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': '7fb18924-877c-4768-a503-718e32ae5765'} Oct 08 21:04:08.058801 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:04:08.058801 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:04:08.058801 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:04:08.058801 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:04:08.058801 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:04:08.058801 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:04:08.058801 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:04:08.058801 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:04:08.058801 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:04:08.058801 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:04:08.058801 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7fb18924-877c-4768-a503-718e32ae5765 could not be found. Oct 08 21:04:08.058801 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:04:08.058801 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:04:08.058801 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:04:08.058801 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:04:08.058801 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:04:08.058801 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:04:08.058801 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:04:08.058801 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:04:08.058801 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:04:08.058801 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:04:08.058801 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:04:08.058801 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:04:08.058801 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:04:08.058801 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:04:08.058801 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:04:08.058801 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:04:08.058801 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7fb18924-877c-4768-a503-718e32ae5765 could not be found. Oct 08 21:04:08.058801 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:04:08.058801 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:04:08.058801 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:04:08.062859 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:04:08.062859 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:04:08.062859 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:04:08.062859 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:04:08.062859 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:04:08.062859 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7fb18924-877c-4768-a503-718e32ae5765 could not be found. Oct 08 21:04:08.062859 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:04:08.062859 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-4aaac672-c47e-46b8-bb45-8037aaa87663 tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] Returning 404 to user: Instance 7fb18924-877c-4768-a503-718e32ae5765 could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:04:08.062859 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-4aaac672-c47e-46b8-bb45-8037aaa87663 tempest-ServersAaction247Test-338676422 tempest-ServersAaction247Test-338676422-project] 10.222.0.26 "GET /compute/v2.1/servers/7fb18924-877c-4768-a503-718e32ae5765" status: 404 len: 111 microversion: 2.47 time: 0.057616 Oct 08 21:04:08.063607 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1491/3039] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:04:08 2022] GET /compute/v2.1/servers/7fb18924-877c-4768-a503-718e32ae5765 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 08 21:04:08.196570 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-5d7553e2-b686-412f-bec2-e83cde546bc5 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:08.197879 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-5d7553e2-b686-412f-bec2-e83cde546bc5 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: 6ef37448-690b-4fcf-85f8-a2fb71207f38] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:08.210650 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=6 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:04:08.228861 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5d7553e2-b686-412f-bec2-e83cde546bc5 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:08.230729 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5d7553e2-b686-412f-bec2-e83cde546bc5 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:08.232980 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5d7553e2-b686-412f-bec2-e83cde546bc5 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:08.234030 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5d7553e2-b686-412f-bec2-e83cde546bc5 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:08.234947 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5d7553e2-b686-412f-bec2-e83cde546bc5 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:08.235720 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5d7553e2-b686-412f-bec2-e83cde546bc5 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:08.407236 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-2f589444-43fb-4e1f-b040-dd8ffb6bf0a7 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2395fe934d458faa80e28587458bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f455695c0214bfab0f412aa34417e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:08.419143 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-2f589444-43fb-4e1f-b040-dd8ffb6bf0a7 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] 10.222.0.26 "GET /compute/v2.1/servers/4e392800-b237-4d1d-8372-e635e2450b91" status: 200 len: 1501 microversion: 2.1 time: 0.602936 Oct 08 21:04:08.429592 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1549/3040] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:04:07 2022] GET /compute/v2.1/servers/4e392800-b237-4d1d-8372-e635e2450b91 => generated 1501 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:04:08.448907 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-4e5ac6dd-a353-425a-a05e-1879838a336f tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:08.449449 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-4e5ac6dd-a353-425a-a05e-1879838a336f tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] [instance: 4e392800-b237-4d1d-8372-e635e2450b91] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:08.460376 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4e5ac6dd-a353-425a-a05e-1879838a336f tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:08.460883 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4e5ac6dd-a353-425a-a05e-1879838a336f tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:08.461358 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4e5ac6dd-a353-425a-a05e-1879838a336f tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:08.462083 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4e5ac6dd-a353-425a-a05e-1879838a336f tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:08.462550 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4e5ac6dd-a353-425a-a05e-1879838a336f tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:08.463006 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4e5ac6dd-a353-425a-a05e-1879838a336f tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:08.463456 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=18 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:04:08.610631 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-4e5ac6dd-a353-425a-a05e-1879838a336f tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] 10.222.0.26 "DELETE /compute/v2.1/servers/4e392800-b237-4d1d-8372-e635e2450b91/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.167078 Oct 08 21:04:08.617062 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1550/3041] 10.222.0.26 () {58 vars in 1296 bytes} [Sat Oct 8 21:04:08 2022] DELETE /compute/v2.1/servers/4e392800-b237-4d1d-8372-e635e2450b91/os-server-password => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 21:04:08.628548 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-af6a26cd-8972-4085-a33c-e4beb038af46 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:08.629087 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-af6a26cd-8972-4085-a33c-e4beb038af46 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] [instance: 4e392800-b237-4d1d-8372-e635e2450b91] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:08.649267 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-af6a26cd-8972-4085-a33c-e4beb038af46 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:08.649892 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-af6a26cd-8972-4085-a33c-e4beb038af46 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:08.650219 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-af6a26cd-8972-4085-a33c-e4beb038af46 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:08.651432 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-af6a26cd-8972-4085-a33c-e4beb038af46 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:08.651901 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-af6a26cd-8972-4085-a33c-e4beb038af46 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:08.652337 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-af6a26cd-8972-4085-a33c-e4beb038af46 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:08.685960 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-af6a26cd-8972-4085-a33c-e4beb038af46 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] 10.222.0.26 "GET /compute/v2.1/servers/4e392800-b237-4d1d-8372-e635e2450b91/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.067520 Oct 08 21:04:08.687338 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1551/3042] 10.222.0.26 () {58 vars in 1293 bytes} [Sat Oct 8 21:04:08 2022] GET /compute/v2.1/servers/4e392800-b237-4d1d-8372-e635e2450b91/os-server-password => generated 16 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 08 21:04:08.700584 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-51e0da80-a13d-4bae-87b2-c37f28ade793 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:08.702706 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-51e0da80-a13d-4bae-87b2-c37f28ade793 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] [instance: 136d0aa6-479d-4d9c-b633-23203ee44ae4] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:08.710196 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-51e0da80-a13d-4bae-87b2-c37f28ade793 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:08.710938 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-51e0da80-a13d-4bae-87b2-c37f28ade793 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:08.711585 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-51e0da80-a13d-4bae-87b2-c37f28ade793 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:08.712475 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-51e0da80-a13d-4bae-87b2-c37f28ade793 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:08.713224 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-51e0da80-a13d-4bae-87b2-c37f28ade793 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:08.713816 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-51e0da80-a13d-4bae-87b2-c37f28ade793 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:09.088787 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-5d7553e2-b686-412f-bec2-e83cde546bc5 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:09.100947 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-5d7553e2-b686-412f-bec2-e83cde546bc5 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/6ef37448-690b-4fcf-85f8-a2fb71207f38" status: 200 len: 1476 microversion: 2.1 time: 0.908909 Oct 08 21:04:09.103869 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1492/3043] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:04:08 2022] GET /compute/v2.1/servers/6ef37448-690b-4fcf-85f8-a2fb71207f38 => generated 1476 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:04:09.116672 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-9b13f5d7-5055-41d3-b314-223a91f5ebba tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:09.117208 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-9b13f5d7-5055-41d3-b314-223a91f5ebba tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] [instance: 4e392800-b237-4d1d-8372-e635e2450b91] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:09.131389 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9b13f5d7-5055-41d3-b314-223a91f5ebba tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:09.132186 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9b13f5d7-5055-41d3-b314-223a91f5ebba tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:09.133063 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9b13f5d7-5055-41d3-b314-223a91f5ebba tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:09.134029 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9b13f5d7-5055-41d3-b314-223a91f5ebba tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:09.134708 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9b13f5d7-5055-41d3-b314-223a91f5ebba tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:09.135350 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9b13f5d7-5055-41d3-b314-223a91f5ebba tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:09.165408 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-9b13f5d7-5055-41d3-b314-223a91f5ebba tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] [instance: 4e392800-b237-4d1d-8372-e635e2450b91] Going to try to terminate instance {{(pid=140491) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 21:04:09.169832 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:04:09.177314 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-51e0da80-a13d-4bae-87b2-c37f28ade793 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2e13f1952a4e5bb23d57dd7fa31875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b2a56286924e2d953bebe717ce591b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:09.189529 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-51e0da80-a13d-4bae-87b2-c37f28ade793 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] 10.222.0.26 "GET /compute/v2.1/servers/136d0aa6-479d-4d9c-b633-23203ee44ae4" status: 200 len: 1507 microversion: 2.1 time: 0.493499 Oct 08 21:04:09.190119 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1552/3044] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:04:08 2022] GET /compute/v2.1/servers/136d0aa6-479d-4d9c-b633-23203ee44ae4 => generated 1507 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:04:09.195340 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-f7a9a76b-e0d6-4bfc-b17d-c2826a4e031d tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:09.201498 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-f7a9a76b-e0d6-4bfc-b17d-c2826a4e031d tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] [instance: 3d7debe3-3039-401c-891d-4c6e4b96cbb8] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:09.223318 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f7a9a76b-e0d6-4bfc-b17d-c2826a4e031d tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:09.223837 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f7a9a76b-e0d6-4bfc-b17d-c2826a4e031d tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:09.224294 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f7a9a76b-e0d6-4bfc-b17d-c2826a4e031d tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:09.225028 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f7a9a76b-e0d6-4bfc-b17d-c2826a4e031d tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:09.225534 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f7a9a76b-e0d6-4bfc-b17d-c2826a4e031d tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:09.226380 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f7a9a76b-e0d6-4bfc-b17d-c2826a4e031d tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:09.251100 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-f7a9a76b-e0d6-4bfc-b17d-c2826a4e031d tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] HTTP exception thrown: Instance 3d7debe3-3039-401c-891d-4c6e4b96cbb8 could not be found. Oct 08 21:04:09.252649 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-f7a9a76b-e0d6-4bfc-b17d-c2826a4e031d tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Request method failure captured: Oct 08 21:04:09.252649 ncdv-master-1 devstack@n-api.service[140492]: request: GET /compute/v2.1/servers/3d7debe3-3039-401c-891d-4c6e4b96cbb8 HTTP/1.1 Oct 08 21:04:09.252649 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:04:09.252649 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:04:09.252649 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:04:09.252649 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 21:04:09.252649 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:04:09.252649 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:04:09.252649 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:04:09.252649 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:04:09.252649 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeV6gyhhqTwzNzF_DVQE7VbX1i-ngOCRm15dLpkxnz5WVdql8AoVlqCCwyqOkCOk76oWuq0Ya4x_PWsPouJg9rloWzVgiZk1L2YjlEbL6DHjUi-iP3oO8lV6lZU_lN1aEJkywJ-KczU9NSltZHb65aAZbd_JEDRI6tcAk9x88eHP9pU Oct 08 21:04:09.252649 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:04:09.252649 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:04:09.252649 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:04:09.252649 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:04:09.252649 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:04:09.252649 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:04:09.252649 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: bc9bed6d76834f6fa66d681ecd9f4e90 Oct 08 21:04:09.252649 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-ListServerFiltersTestJSON-235970729 Oct 08 21:04:09.252649 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:04:09.252649 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:04:09.252649 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/bc9bed6d76834f6fa66d681ecd9f4e90"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/bc9bed6d76834f6fa66d681ecd9f4e90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_bc9bed6d76834f6fa66d681ecd9f4e90"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/bc9bed6d76834f6fa66d681ecd9f4e90"}]}] Oct 08 21:04:09.252649 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-ListServerFiltersTestJSON-235970729 Oct 08 21:04:09.252649 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: bc9bed6d76834f6fa66d681ecd9f4e90 Oct 08 21:04:09.252649 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-235970729 Oct 08 21:04:09.252649 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-ListServerFiltersTestJSON-235970729-project Oct 08 21:04:09.252649 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:04:09.252649 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:04:09.252649 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 095debf3968c448fb3c3add0322d8d1b Oct 08 21:04:09.252649 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-ListServerFiltersTestJSON-235970729-project Oct 08 21:04:09.252649 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 21:04:09.252649 ncdv-master-1 devstack@n-api.service[140492]: exception: Instance 3d7debe3-3039-401c-891d-4c6e4b96cbb8 could not be found. Oct 08 21:04:09.252649 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': '3d7debe3-3039-401c-891d-4c6e4b96cbb8'} Oct 08 21:04:09.252649 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:04:09.252649 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:04:09.252649 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:04:09.252649 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:04:09.252649 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:04:09.252649 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:04:09.252649 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:04:09.252649 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:04:09.252649 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:04:09.252649 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:04:09.252649 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d7debe3-3039-401c-891d-4c6e4b96cbb8 could not be found. Oct 08 21:04:09.252649 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:04:09.252649 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:04:09.252649 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:04:09.252649 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:04:09.252649 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:04:09.252649 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:04:09.252649 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:04:09.252649 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:04:09.252649 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:04:09.252649 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:04:09.252649 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:04:09.252649 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:04:09.252649 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:04:09.252649 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:04:09.252649 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:04:09.252649 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:04:09.252649 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d7debe3-3039-401c-891d-4c6e4b96cbb8 could not be found. Oct 08 21:04:09.252649 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:04:09.252649 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:04:09.252649 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:04:09.260112 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:04:09.260112 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:04:09.260112 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:04:09.260112 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:04:09.260112 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:04:09.260112 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d7debe3-3039-401c-891d-4c6e4b96cbb8 could not be found. Oct 08 21:04:09.260112 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:04:09.261632 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-f7a9a76b-e0d6-4bfc-b17d-c2826a4e031d tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Returning 404 to user: Instance 3d7debe3-3039-401c-891d-4c6e4b96cbb8 could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:04:09.262632 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-f7a9a76b-e0d6-4bfc-b17d-c2826a4e031d tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] 10.222.0.26 "GET /compute/v2.1/servers/3d7debe3-3039-401c-891d-4c6e4b96cbb8" status: 404 len: 111 microversion: 2.1 time: 0.070815 Oct 08 21:04:09.263253 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1553/3045] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:04:09 2022] GET /compute/v2.1/servers/3d7debe3-3039-401c-891d-4c6e4b96cbb8 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:04:09.273479 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-0e4d9825-f85a-47d7-aae6-8e1a8f48b785 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:09.274387 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-0e4d9825-f85a-47d7-aae6-8e1a8f48b785 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] [instance: 814f7da9-1d8d-4695-8cfa-6db50c3e846a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:09.280741 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0e4d9825-f85a-47d7-aae6-8e1a8f48b785 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:09.281551 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0e4d9825-f85a-47d7-aae6-8e1a8f48b785 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:09.282224 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0e4d9825-f85a-47d7-aae6-8e1a8f48b785 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:09.283199 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0e4d9825-f85a-47d7-aae6-8e1a8f48b785 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:09.283858 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0e4d9825-f85a-47d7-aae6-8e1a8f48b785 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:09.284521 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0e4d9825-f85a-47d7-aae6-8e1a8f48b785 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:09.317618 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-0e4d9825-f85a-47d7-aae6-8e1a8f48b785 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] [instance: 814f7da9-1d8d-4695-8cfa-6db50c3e846a] Going to try to terminate instance {{(pid=140492) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 21:04:09.338474 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-9b13f5d7-5055-41d3-b314-223a91f5ebba tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] 10.222.0.26 "DELETE /compute/v2.1/servers/4e392800-b237-4d1d-8372-e635e2450b91" status: 204 len: 0 microversion: 2.1 time: 0.232326 Oct 08 21:04:09.340389 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1493/3046] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:04:09 2022] DELETE /compute/v2.1/servers/4e392800-b237-4d1d-8372-e635e2450b91 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 21:04:09.360408 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-6bce2365-dc9b-4256-ac71-38c9dcf338c0 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:09.361138 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-6bce2365-dc9b-4256-ac71-38c9dcf338c0 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] [instance: 4e392800-b237-4d1d-8372-e635e2450b91] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:09.380983 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6bce2365-dc9b-4256-ac71-38c9dcf338c0 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:09.381515 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6bce2365-dc9b-4256-ac71-38c9dcf338c0 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:09.381962 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6bce2365-dc9b-4256-ac71-38c9dcf338c0 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:09.382690 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6bce2365-dc9b-4256-ac71-38c9dcf338c0 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:09.383146 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6bce2365-dc9b-4256-ac71-38c9dcf338c0 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:09.383574 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6bce2365-dc9b-4256-ac71-38c9dcf338c0 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:09.448436 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-0e4d9825-f85a-47d7-aae6-8e1a8f48b785 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] 10.222.0.26 "DELETE /compute/v2.1/servers/814f7da9-1d8d-4695-8cfa-6db50c3e846a" status: 204 len: 0 microversion: 2.1 time: 0.178220 Oct 08 21:04:09.450082 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1554/3047] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:04:09 2022] DELETE /compute/v2.1/servers/814f7da9-1d8d-4695-8cfa-6db50c3e846a => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 21:04:09.465769 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-7dab8d0b-0dda-416c-95e4-4ee10bd69af4 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:09.467137 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-7dab8d0b-0dda-416c-95e4-4ee10bd69af4 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] [instance: 814f7da9-1d8d-4695-8cfa-6db50c3e846a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:09.478067 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7dab8d0b-0dda-416c-95e4-4ee10bd69af4 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:09.479088 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7dab8d0b-0dda-416c-95e4-4ee10bd69af4 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:09.479785 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7dab8d0b-0dda-416c-95e4-4ee10bd69af4 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:09.480790 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7dab8d0b-0dda-416c-95e4-4ee10bd69af4 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:09.481600 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7dab8d0b-0dda-416c-95e4-4ee10bd69af4 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:09.482527 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7dab8d0b-0dda-416c-95e4-4ee10bd69af4 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:09.696392 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-6bce2365-dc9b-4256-ac71-38c9dcf338c0 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2395fe934d458faa80e28587458bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f455695c0214bfab0f412aa34417e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:09.708735 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-6bce2365-dc9b-4256-ac71-38c9dcf338c0 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] 10.222.0.26 "GET /compute/v2.1/servers/4e392800-b237-4d1d-8372-e635e2450b91" status: 200 len: 1507 microversion: 2.1 time: 0.363892 Oct 08 21:04:09.710336 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1494/3048] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:04:09 2022] GET /compute/v2.1/servers/4e392800-b237-4d1d-8372-e635e2450b91 => generated 1507 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:04:09.916628 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-7dab8d0b-0dda-416c-95e4-4ee10bd69af4 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095debf3968c448fb3c3add0322d8d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc9bed6d76834f6fa66d681ecd9f4e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:09.925706 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-7dab8d0b-0dda-416c-95e4-4ee10bd69af4 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] 10.222.0.26 "GET /compute/v2.1/servers/814f7da9-1d8d-4695-8cfa-6db50c3e846a" status: 200 len: 1516 microversion: 2.1 time: 0.470855 Oct 08 21:04:09.926502 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1555/3049] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:04:09 2022] GET /compute/v2.1/servers/814f7da9-1d8d-4695-8cfa-6db50c3e846a => generated 1516 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:04:10.134775 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-210750c3-5ae5-481a-91bc-4aab43884be9 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:10.136096 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-210750c3-5ae5-481a-91bc-4aab43884be9 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: 6ef37448-690b-4fcf-85f8-a2fb71207f38] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:10.143202 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-210750c3-5ae5-481a-91bc-4aab43884be9 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:10.143898 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-210750c3-5ae5-481a-91bc-4aab43884be9 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:10.144693 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-210750c3-5ae5-481a-91bc-4aab43884be9 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:10.145611 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-210750c3-5ae5-481a-91bc-4aab43884be9 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:10.146406 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-210750c3-5ae5-481a-91bc-4aab43884be9 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:10.146992 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-210750c3-5ae5-481a-91bc-4aab43884be9 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:10.234724 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-cb2c4dc6-9bc5-4aef-a2b4-088f1ae6ebfe tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:10.235588 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-cb2c4dc6-9bc5-4aef-a2b4-088f1ae6ebfe tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] [instance: 136d0aa6-479d-4d9c-b633-23203ee44ae4] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:10.243749 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cb2c4dc6-9bc5-4aef-a2b4-088f1ae6ebfe tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:10.244448 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cb2c4dc6-9bc5-4aef-a2b4-088f1ae6ebfe tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:10.245210 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cb2c4dc6-9bc5-4aef-a2b4-088f1ae6ebfe tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:10.246346 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cb2c4dc6-9bc5-4aef-a2b4-088f1ae6ebfe tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:10.247028 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cb2c4dc6-9bc5-4aef-a2b4-088f1ae6ebfe tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:10.247621 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cb2c4dc6-9bc5-4aef-a2b4-088f1ae6ebfe tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:10.446908 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-210750c3-5ae5-481a-91bc-4aab43884be9 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:10.461215 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-210750c3-5ae5-481a-91bc-4aab43884be9 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/6ef37448-690b-4fcf-85f8-a2fb71207f38" status: 200 len: 1476 microversion: 2.1 time: 0.330674 Oct 08 21:04:10.461809 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1495/3050] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:04:10 2022] GET /compute/v2.1/servers/6ef37448-690b-4fcf-85f8-a2fb71207f38 => generated 1476 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:04:10.674059 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-cb2c4dc6-9bc5-4aef-a2b4-088f1ae6ebfe tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2e13f1952a4e5bb23d57dd7fa31875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b2a56286924e2d953bebe717ce591b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:10.696435 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-cb2c4dc6-9bc5-4aef-a2b4-088f1ae6ebfe tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] 10.222.0.26 "GET /compute/v2.1/servers/136d0aa6-479d-4d9c-b633-23203ee44ae4" status: 200 len: 1507 microversion: 2.1 time: 0.465858 Oct 08 21:04:10.696435 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1556/3051] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:04:10 2022] GET /compute/v2.1/servers/136d0aa6-479d-4d9c-b633-23203ee44ae4 => generated 1507 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:04:10.697915 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-6a36032d-d66f-4b1c-8a88-1b3374a033c4 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:10.698414 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-6a36032d-d66f-4b1c-8a88-1b3374a033c4 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] [instance: ede2a1aa-f65b-424e-9034-15a2aaf13e60] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:10.713463 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6a36032d-d66f-4b1c-8a88-1b3374a033c4 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:10.714118 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6a36032d-d66f-4b1c-8a88-1b3374a033c4 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:10.714790 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6a36032d-d66f-4b1c-8a88-1b3374a033c4 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:10.715576 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6a36032d-d66f-4b1c-8a88-1b3374a033c4 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:10.716109 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6a36032d-d66f-4b1c-8a88-1b3374a033c4 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:10.716688 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6a36032d-d66f-4b1c-8a88-1b3374a033c4 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:10.734787 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-6ce4d7fc-2d7c-4b4a-8e90-b08f3119ed46 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:10.735696 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-6ce4d7fc-2d7c-4b4a-8e90-b08f3119ed46 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] [instance: 4e392800-b237-4d1d-8372-e635e2450b91] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:10.736422 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-6a36032d-d66f-4b1c-8a88-1b3374a033c4 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] HTTP exception thrown: Instance ede2a1aa-f65b-424e-9034-15a2aaf13e60 could not be found. Oct 08 21:04:10.741247 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-6a36032d-d66f-4b1c-8a88-1b3374a033c4 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Request method failure captured: Oct 08 21:04:10.741247 ncdv-master-1 devstack@n-api.service[140491]: request: DELETE /compute/v2.1/servers/ede2a1aa-f65b-424e-9034-15a2aaf13e60 HTTP/1.1 Oct 08 21:04:10.741247 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:04:10.741247 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:04:10.741247 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:04:10.741247 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 21:04:10.741247 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:04:10.741247 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:04:10.741247 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:04:10.741247 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:04:10.741247 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeVUEnRvCLyCdYjboZWSkex8rTCtYI1WBk9L9mszZTx76Yjj3LxtSlFNG9MVk6PLQz6uz0j43wAsyIQ12BqqCeuqBLoD2YPavK2g1xvBbLBuCYCYfHR4_kPFl1spz3btBQTXrY3gFkG7sssAZkB-WmdL9ekIbfJeNfVQZChikHfwtuo Oct 08 21:04:10.741247 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:04:10.741247 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:04:10.741247 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:04:10.741247 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:04:10.741247 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:04:10.741247 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:04:10.741247 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 4735bf74f33a4739800d766c82d973d4 Oct 08 21:04:10.741247 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-ServersTestMultiNic-898906473 Oct 08 21:04:10.741247 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:04:10.741247 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:04:10.741247 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/4735bf74f33a4739800d766c82d973d4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4735bf74f33a4739800d766c82d973d4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_4735bf74f33a4739800d766c82d973d4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4735bf74f33a4739800d766c82d973d4"}]}] Oct 08 21:04:10.741247 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-ServersTestMultiNic-898906473 Oct 08 21:04:10.741247 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 4735bf74f33a4739800d766c82d973d4 Oct 08 21:04:10.741247 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-ServersTestMultiNic-898906473 Oct 08 21:04:10.741247 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-ServersTestMultiNic-898906473-project Oct 08 21:04:10.741247 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:04:10.741247 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:04:10.741247 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 40f60e33f334465fac1148669de3f00c Oct 08 21:04:10.741247 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-ServersTestMultiNic-898906473-project Oct 08 21:04:10.741247 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:04:10.741247 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance ede2a1aa-f65b-424e-9034-15a2aaf13e60 could not be found. Oct 08 21:04:10.741247 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': 'ede2a1aa-f65b-424e-9034-15a2aaf13e60'} Oct 08 21:04:10.741247 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:04:10.741247 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:04:10.741247 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:04:10.741247 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:04:10.741247 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:04:10.741247 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:04:10.741247 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:04:10.741247 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:04:10.741247 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:04:10.741247 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:04:10.741247 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ede2a1aa-f65b-424e-9034-15a2aaf13e60 could not be found. Oct 08 21:04:10.741247 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:04:10.741247 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:04:10.741247 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:04:10.741247 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:04:10.741247 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:04:10.741247 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:04:10.741247 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:04:10.741247 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:04:10.741247 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:04:10.741247 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:04:10.741247 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 08 21:04:10.741247 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 08 21:04:10.741247 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 08 21:04:10.741247 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 08 21:04:10.741247 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:04:10.741247 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:04:10.741247 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:04:10.741247 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:04:10.745176 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ede2a1aa-f65b-424e-9034-15a2aaf13e60 could not be found. Oct 08 21:04:10.745176 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:04:10.745176 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:04:10.745176 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:04:10.745176 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:04:10.745176 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:04:10.745176 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:04:10.745176 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:04:10.745176 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:04:10.745176 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ede2a1aa-f65b-424e-9034-15a2aaf13e60 could not be found. Oct 08 21:04:10.745176 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:04:10.749145 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-6a36032d-d66f-4b1c-8a88-1b3374a033c4 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Returning 404 to user: Instance ede2a1aa-f65b-424e-9034-15a2aaf13e60 could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:04:10.749145 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-6a36032d-d66f-4b1c-8a88-1b3374a033c4 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] 10.222.0.26 "DELETE /compute/v2.1/servers/ede2a1aa-f65b-424e-9034-15a2aaf13e60" status: 404 len: 111 microversion: 2.1 time: 0.053016 Oct 08 21:04:10.750274 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6ce4d7fc-2d7c-4b4a-8e90-b08f3119ed46 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:10.750789 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6ce4d7fc-2d7c-4b4a-8e90-b08f3119ed46 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:10.751255 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6ce4d7fc-2d7c-4b4a-8e90-b08f3119ed46 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:10.756591 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6ce4d7fc-2d7c-4b4a-8e90-b08f3119ed46 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:10.756591 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6ce4d7fc-2d7c-4b4a-8e90-b08f3119ed46 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:10.756591 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6ce4d7fc-2d7c-4b4a-8e90-b08f3119ed46 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:10.761361 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1496/3052] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:04:10 2022] DELETE /compute/v2.1/servers/ede2a1aa-f65b-424e-9034-15a2aaf13e60 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:04:10.787127 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-2db8bb6c-947b-4e12-b51d-24b46fcc3fb4 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:10.790152 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-2db8bb6c-947b-4e12-b51d-24b46fcc3fb4 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] [instance: ede2a1aa-f65b-424e-9034-15a2aaf13e60] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:10.799307 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2db8bb6c-947b-4e12-b51d-24b46fcc3fb4 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:10.800484 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2db8bb6c-947b-4e12-b51d-24b46fcc3fb4 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:10.801164 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2db8bb6c-947b-4e12-b51d-24b46fcc3fb4 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:10.802148 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2db8bb6c-947b-4e12-b51d-24b46fcc3fb4 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:10.802823 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2db8bb6c-947b-4e12-b51d-24b46fcc3fb4 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:10.803461 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2db8bb6c-947b-4e12-b51d-24b46fcc3fb4 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:10.818786 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-2db8bb6c-947b-4e12-b51d-24b46fcc3fb4 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] HTTP exception thrown: Instance ede2a1aa-f65b-424e-9034-15a2aaf13e60 could not be found. Oct 08 21:04:10.820833 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-2db8bb6c-947b-4e12-b51d-24b46fcc3fb4 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Request method failure captured: Oct 08 21:04:10.820833 ncdv-master-1 devstack@n-api.service[140491]: request: GET /compute/v2.1/servers/ede2a1aa-f65b-424e-9034-15a2aaf13e60 HTTP/1.1 Oct 08 21:04:10.820833 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:04:10.820833 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:04:10.820833 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:04:10.820833 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 21:04:10.820833 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:04:10.820833 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:04:10.820833 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:04:10.820833 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:04:10.820833 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeVUEnRvCLyCdYjboZWSkex8rTCtYI1WBk9L9mszZTx76Yjj3LxtSlFNG9MVk6PLQz6uz0j43wAsyIQ12BqqCeuqBLoD2YPavK2g1xvBbLBuCYCYfHR4_kPFl1spz3btBQTXrY3gFkG7sssAZkB-WmdL9ekIbfJeNfVQZChikHfwtuo Oct 08 21:04:10.820833 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:04:10.820833 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:04:10.820833 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:04:10.820833 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:04:10.820833 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:04:10.820833 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:04:10.820833 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 4735bf74f33a4739800d766c82d973d4 Oct 08 21:04:10.820833 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-ServersTestMultiNic-898906473 Oct 08 21:04:10.820833 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:04:10.820833 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:04:10.820833 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/4735bf74f33a4739800d766c82d973d4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4735bf74f33a4739800d766c82d973d4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_4735bf74f33a4739800d766c82d973d4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4735bf74f33a4739800d766c82d973d4"}]}] Oct 08 21:04:10.820833 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-ServersTestMultiNic-898906473 Oct 08 21:04:10.820833 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 4735bf74f33a4739800d766c82d973d4 Oct 08 21:04:10.820833 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-ServersTestMultiNic-898906473 Oct 08 21:04:10.820833 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-ServersTestMultiNic-898906473-project Oct 08 21:04:10.820833 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:04:10.820833 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:04:10.820833 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 40f60e33f334465fac1148669de3f00c Oct 08 21:04:10.820833 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-ServersTestMultiNic-898906473-project Oct 08 21:04:10.820833 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:04:10.820833 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance ede2a1aa-f65b-424e-9034-15a2aaf13e60 could not be found. Oct 08 21:04:10.820833 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': 'ede2a1aa-f65b-424e-9034-15a2aaf13e60'} Oct 08 21:04:10.820833 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:04:10.820833 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:04:10.820833 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:04:10.820833 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:04:10.820833 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:04:10.820833 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:04:10.820833 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:04:10.820833 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:04:10.820833 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:04:10.820833 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:04:10.820833 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ede2a1aa-f65b-424e-9034-15a2aaf13e60 could not be found. Oct 08 21:04:10.820833 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:04:10.820833 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:04:10.820833 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:04:10.820833 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:04:10.820833 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:04:10.820833 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:04:10.820833 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:04:10.820833 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:04:10.820833 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:04:10.820833 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:04:10.820833 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:04:10.820833 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:04:10.820833 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:04:10.820833 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:04:10.820833 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:04:10.820833 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:04:10.820833 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ede2a1aa-f65b-424e-9034-15a2aaf13e60 could not be found. Oct 08 21:04:10.820833 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:04:10.820833 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:04:10.820833 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:04:10.824783 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:04:10.824783 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:04:10.824783 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:04:10.824783 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:04:10.824783 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:04:10.824783 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ede2a1aa-f65b-424e-9034-15a2aaf13e60 could not be found. Oct 08 21:04:10.824783 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:04:10.826610 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-2db8bb6c-947b-4e12-b51d-24b46fcc3fb4 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Returning 404 to user: Instance ede2a1aa-f65b-424e-9034-15a2aaf13e60 could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:04:10.827550 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-2db8bb6c-947b-4e12-b51d-24b46fcc3fb4 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] 10.222.0.26 "GET /compute/v2.1/servers/ede2a1aa-f65b-424e-9034-15a2aaf13e60" status: 404 len: 111 microversion: 2.1 time: 0.060691 Oct 08 21:04:10.828184 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1497/3053] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:04:10 2022] GET /compute/v2.1/servers/ede2a1aa-f65b-424e-9034-15a2aaf13e60 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:04:10.838256 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-4c906fdb-7625-48b2-963b-cc307d133497 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:10.839199 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-4c906fdb-7625-48b2-963b-cc307d133497 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] [instance: 0e762f82-ada3-411d-9072-37e72381145d] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:10.850222 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4c906fdb-7625-48b2-963b-cc307d133497 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:10.850855 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4c906fdb-7625-48b2-963b-cc307d133497 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:10.851633 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4c906fdb-7625-48b2-963b-cc307d133497 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:10.852707 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4c906fdb-7625-48b2-963b-cc307d133497 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:10.853453 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4c906fdb-7625-48b2-963b-cc307d133497 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:10.855244 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4c906fdb-7625-48b2-963b-cc307d133497 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:10.876921 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-4c906fdb-7625-48b2-963b-cc307d133497 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] HTTP exception thrown: Instance 0e762f82-ada3-411d-9072-37e72381145d could not be found. Oct 08 21:04:10.879036 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-4c906fdb-7625-48b2-963b-cc307d133497 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Request method failure captured: Oct 08 21:04:10.879036 ncdv-master-1 devstack@n-api.service[140491]: request: DELETE /compute/v2.1/servers/0e762f82-ada3-411d-9072-37e72381145d HTTP/1.1 Oct 08 21:04:10.879036 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:04:10.879036 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:04:10.879036 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:04:10.879036 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 21:04:10.879036 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:04:10.879036 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:04:10.879036 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:04:10.879036 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:04:10.879036 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeVUEnRvCLyCdYjboZWSkex8rTCtYI1WBk9L9mszZTx76Yjj3LxtSlFNG9MVk6PLQz6uz0j43wAsyIQ12BqqCeuqBLoD2YPavK2g1xvBbLBuCYCYfHR4_kPFl1spz3btBQTXrY3gFkG7sssAZkB-WmdL9ekIbfJeNfVQZChikHfwtuo Oct 08 21:04:10.879036 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:04:10.879036 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:04:10.879036 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:04:10.879036 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:04:10.879036 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:04:10.879036 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:04:10.879036 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 4735bf74f33a4739800d766c82d973d4 Oct 08 21:04:10.879036 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-ServersTestMultiNic-898906473 Oct 08 21:04:10.879036 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:04:10.879036 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:04:10.879036 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/4735bf74f33a4739800d766c82d973d4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4735bf74f33a4739800d766c82d973d4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_4735bf74f33a4739800d766c82d973d4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4735bf74f33a4739800d766c82d973d4"}]}] Oct 08 21:04:10.879036 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-ServersTestMultiNic-898906473 Oct 08 21:04:10.879036 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 4735bf74f33a4739800d766c82d973d4 Oct 08 21:04:10.879036 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-ServersTestMultiNic-898906473 Oct 08 21:04:10.879036 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-ServersTestMultiNic-898906473-project Oct 08 21:04:10.879036 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:04:10.879036 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:04:10.879036 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 40f60e33f334465fac1148669de3f00c Oct 08 21:04:10.879036 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-ServersTestMultiNic-898906473-project Oct 08 21:04:10.879036 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:04:10.879036 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance 0e762f82-ada3-411d-9072-37e72381145d could not be found. Oct 08 21:04:10.879036 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': '0e762f82-ada3-411d-9072-37e72381145d'} Oct 08 21:04:10.879036 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:04:10.879036 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:04:10.879036 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:04:10.879036 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:04:10.879036 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:04:10.879036 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:04:10.879036 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:04:10.879036 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:04:10.879036 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:04:10.879036 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:04:10.879036 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e762f82-ada3-411d-9072-37e72381145d could not be found. Oct 08 21:04:10.879036 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:04:10.879036 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:04:10.879036 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:04:10.879036 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:04:10.879036 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:04:10.879036 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:04:10.879036 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:04:10.879036 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:04:10.879036 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:04:10.879036 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:04:10.879036 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 08 21:04:10.879036 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 08 21:04:10.879036 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 08 21:04:10.879036 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 08 21:04:10.879036 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:04:10.879036 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:04:10.879036 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:04:10.879036 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:04:10.885236 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e762f82-ada3-411d-9072-37e72381145d could not be found. Oct 08 21:04:10.885236 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:04:10.885236 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:04:10.885236 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:04:10.885236 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:04:10.885236 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:04:10.885236 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:04:10.885236 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:04:10.885236 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:04:10.885236 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e762f82-ada3-411d-9072-37e72381145d could not be found. Oct 08 21:04:10.885236 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:04:10.888424 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-4c906fdb-7625-48b2-963b-cc307d133497 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Returning 404 to user: Instance 0e762f82-ada3-411d-9072-37e72381145d could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:04:10.889946 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-4c906fdb-7625-48b2-963b-cc307d133497 tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] 10.222.0.26 "DELETE /compute/v2.1/servers/0e762f82-ada3-411d-9072-37e72381145d" status: 404 len: 111 microversion: 2.1 time: 0.056588 Oct 08 21:04:10.891058 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1498/3054] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:04:10 2022] DELETE /compute/v2.1/servers/0e762f82-ada3-411d-9072-37e72381145d => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:04:10.902430 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-020dfaf6-ea12-43ee-a30b-f86169d4fc2d tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:10.903000 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-020dfaf6-ea12-43ee-a30b-f86169d4fc2d tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] [instance: 0e762f82-ada3-411d-9072-37e72381145d] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:10.913116 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-020dfaf6-ea12-43ee-a30b-f86169d4fc2d tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:10.913858 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-020dfaf6-ea12-43ee-a30b-f86169d4fc2d tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:10.914413 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-020dfaf6-ea12-43ee-a30b-f86169d4fc2d tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:10.915212 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-020dfaf6-ea12-43ee-a30b-f86169d4fc2d tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:10.915740 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-020dfaf6-ea12-43ee-a30b-f86169d4fc2d tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:10.916188 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-020dfaf6-ea12-43ee-a30b-f86169d4fc2d tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:10.938904 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-020dfaf6-ea12-43ee-a30b-f86169d4fc2d tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] HTTP exception thrown: Instance 0e762f82-ada3-411d-9072-37e72381145d could not be found. Oct 08 21:04:10.941104 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-020dfaf6-ea12-43ee-a30b-f86169d4fc2d tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Request method failure captured: Oct 08 21:04:10.941104 ncdv-master-1 devstack@n-api.service[140491]: request: GET /compute/v2.1/servers/0e762f82-ada3-411d-9072-37e72381145d HTTP/1.1 Oct 08 21:04:10.941104 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:04:10.941104 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:04:10.941104 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:04:10.941104 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 21:04:10.941104 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:04:10.941104 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:04:10.941104 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:04:10.941104 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:04:10.941104 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeVUEnRvCLyCdYjboZWSkex8rTCtYI1WBk9L9mszZTx76Yjj3LxtSlFNG9MVk6PLQz6uz0j43wAsyIQ12BqqCeuqBLoD2YPavK2g1xvBbLBuCYCYfHR4_kPFl1spz3btBQTXrY3gFkG7sssAZkB-WmdL9ekIbfJeNfVQZChikHfwtuo Oct 08 21:04:10.941104 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:04:10.941104 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:04:10.941104 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:04:10.941104 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:04:10.941104 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:04:10.941104 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:04:10.941104 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 4735bf74f33a4739800d766c82d973d4 Oct 08 21:04:10.941104 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-ServersTestMultiNic-898906473 Oct 08 21:04:10.941104 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:04:10.941104 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:04:10.941104 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/4735bf74f33a4739800d766c82d973d4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4735bf74f33a4739800d766c82d973d4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_4735bf74f33a4739800d766c82d973d4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4735bf74f33a4739800d766c82d973d4"}]}] Oct 08 21:04:10.941104 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-ServersTestMultiNic-898906473 Oct 08 21:04:10.941104 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 4735bf74f33a4739800d766c82d973d4 Oct 08 21:04:10.941104 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-ServersTestMultiNic-898906473 Oct 08 21:04:10.941104 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-ServersTestMultiNic-898906473-project Oct 08 21:04:10.941104 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:04:10.941104 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:04:10.941104 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 40f60e33f334465fac1148669de3f00c Oct 08 21:04:10.941104 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-ServersTestMultiNic-898906473-project Oct 08 21:04:10.941104 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:04:10.941104 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance 0e762f82-ada3-411d-9072-37e72381145d could not be found. Oct 08 21:04:10.941104 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': '0e762f82-ada3-411d-9072-37e72381145d'} Oct 08 21:04:10.941104 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:04:10.941104 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:04:10.941104 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:04:10.941104 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:04:10.941104 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:04:10.941104 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:04:10.941104 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:04:10.941104 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:04:10.941104 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:04:10.941104 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:04:10.941104 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e762f82-ada3-411d-9072-37e72381145d could not be found. Oct 08 21:04:10.941104 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:04:10.941104 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:04:10.941104 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:04:10.941104 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:04:10.941104 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:04:10.941104 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:04:10.941104 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:04:10.941104 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:04:10.941104 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:04:10.941104 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:04:10.941104 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:04:10.941104 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:04:10.941104 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:04:10.941104 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:04:10.941104 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:04:10.941104 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:04:10.941104 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e762f82-ada3-411d-9072-37e72381145d could not be found. Oct 08 21:04:10.941104 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:04:10.941104 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:04:10.941104 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:04:10.945023 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:04:10.945023 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:04:10.945023 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:04:10.945023 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:04:10.945023 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:04:10.945023 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e762f82-ada3-411d-9072-37e72381145d could not be found. Oct 08 21:04:10.945023 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:04:10.945023 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-020dfaf6-ea12-43ee-a30b-f86169d4fc2d tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] Returning 404 to user: Instance 0e762f82-ada3-411d-9072-37e72381145d could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:04:10.945023 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-020dfaf6-ea12-43ee-a30b-f86169d4fc2d tempest-ServersTestMultiNic-898906473 tempest-ServersTestMultiNic-898906473-project] 10.222.0.26 "GET /compute/v2.1/servers/0e762f82-ada3-411d-9072-37e72381145d" status: 404 len: 111 microversion: 2.1 time: 0.047412 Oct 08 21:04:10.945023 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1499/3055] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:04:10 2022] GET /compute/v2.1/servers/0e762f82-ada3-411d-9072-37e72381145d => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:04:10.952040 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-efefcc63-9f44-4561-b5bc-9a3c24dfd8fc tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:10.953255 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-efefcc63-9f44-4561-b5bc-9a3c24dfd8fc tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] [instance: 814f7da9-1d8d-4695-8cfa-6db50c3e846a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:10.962714 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-efefcc63-9f44-4561-b5bc-9a3c24dfd8fc tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:10.963370 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-efefcc63-9f44-4561-b5bc-9a3c24dfd8fc tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:10.964618 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-efefcc63-9f44-4561-b5bc-9a3c24dfd8fc tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:10.966236 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-efefcc63-9f44-4561-b5bc-9a3c24dfd8fc tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:10.966719 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-efefcc63-9f44-4561-b5bc-9a3c24dfd8fc tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:10.967161 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-efefcc63-9f44-4561-b5bc-9a3c24dfd8fc tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:11.277373 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-6ce4d7fc-2d7c-4b4a-8e90-b08f3119ed46 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2395fe934d458faa80e28587458bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f455695c0214bfab0f412aa34417e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:11.294777 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-6ce4d7fc-2d7c-4b4a-8e90-b08f3119ed46 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] 10.222.0.26 "GET /compute/v2.1/servers/4e392800-b237-4d1d-8372-e635e2450b91" status: 200 len: 1507 microversion: 2.1 time: 0.563564 Oct 08 21:04:11.296235 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-efefcc63-9f44-4561-b5bc-9a3c24dfd8fc tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095debf3968c448fb3c3add0322d8d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc9bed6d76834f6fa66d681ecd9f4e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:11.303427 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1557/3056] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:04:10 2022] GET /compute/v2.1/servers/4e392800-b237-4d1d-8372-e635e2450b91 => generated 1507 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:04:11.305233 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-efefcc63-9f44-4561-b5bc-9a3c24dfd8fc tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] 10.222.0.26 "GET /compute/v2.1/servers/814f7da9-1d8d-4695-8cfa-6db50c3e846a" status: 200 len: 1516 microversion: 2.1 time: 0.358709 Oct 08 21:04:11.306016 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1500/3057] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:04:10 2022] GET /compute/v2.1/servers/814f7da9-1d8d-4695-8cfa-6db50c3e846a => generated 1516 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:04:11.495779 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-0f49c408-517c-47fc-a782-6e62d089c1fc tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:11.496418 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-0f49c408-517c-47fc-a782-6e62d089c1fc tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: 6ef37448-690b-4fcf-85f8-a2fb71207f38] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:11.509275 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0f49c408-517c-47fc-a782-6e62d089c1fc tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:11.510027 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0f49c408-517c-47fc-a782-6e62d089c1fc tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:11.510701 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0f49c408-517c-47fc-a782-6e62d089c1fc tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:11.511611 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0f49c408-517c-47fc-a782-6e62d089c1fc tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:11.512638 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0f49c408-517c-47fc-a782-6e62d089c1fc tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:11.513360 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0f49c408-517c-47fc-a782-6e62d089c1fc tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:11.839866 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-3444f31d-bcd9-4255-a541-4415f57b5365 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-532815066", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "networks": "none"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:04:11.937179 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-3444f31d-bcd9-4255-a541-4415f57b5365 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Flavor limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 21:04:11.941697 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-3444f31d-bcd9-4255-a541-4415f57b5365 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Image limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 21:04:11.942393 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-3444f31d-bcd9-4255-a541-4415f57b5365 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Flavor pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 21:04:11.942976 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-3444f31d-bcd9-4255-a541-4415f57b5365 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Image pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 21:04:11.943556 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-3444f31d-bcd9-4255-a541-4415f57b5365 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 21:04:11.963846 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3444f31d-bcd9-4255-a541-4415f57b5365 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:11.964847 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3444f31d-bcd9-4255-a541-4415f57b5365 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:11.965332 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3444f31d-bcd9-4255-a541-4415f57b5365 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:11.974444 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3444f31d-bcd9-4255-a541-4415f57b5365 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:11.974964 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3444f31d-bcd9-4255-a541-4415f57b5365 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:11.975421 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3444f31d-bcd9-4255-a541-4415f57b5365 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:12.013677 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:04:12.019682 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-3444f31d-bcd9-4255-a541-4415f57b5365 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Getting quotas for project f92d768a1a654e199e14845aab7d565b. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:04:12.027143 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-3444f31d-bcd9-4255-a541-4415f57b5365 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Getting quotas for user 07280ef2c5da4903a62092a44499f455 and project f92d768a1a654e199e14845aab7d565b. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:04:12.042766 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-3444f31d-bcd9-4255-a541-4415f57b5365 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Going to run 1 instances... {{(pid=140491) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 21:04:12.045866 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-3444f31d-bcd9-4255-a541-4415f57b5365 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] [instance: 562434d8-1c7a-4aa4-8cb5-e5d37bf07592] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c508bd7f-7db9-4b2c-af7c-be54a855c355',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140491) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 21:04:12.047546 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-0f49c408-517c-47fc-a782-6e62d089c1fc tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:12.071496 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-0f49c408-517c-47fc-a782-6e62d089c1fc tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/6ef37448-690b-4fcf-85f8-a2fb71207f38" status: 200 len: 1476 microversion: 2.1 time: 0.588510 Oct 08 21:04:12.072927 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1558/3058] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:04:11 2022] GET /compute/v2.1/servers/6ef37448-690b-4fcf-85f8-a2fb71207f38 => generated 1476 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:04:12.081547 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-8f7463a3-cadb-409e-bae8-7e9acaa64810 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:12.083142 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-8f7463a3-cadb-409e-bae8-7e9acaa64810 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] [instance: 136d0aa6-479d-4d9c-b633-23203ee44ae4] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:12.091672 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8f7463a3-cadb-409e-bae8-7e9acaa64810 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:12.092172 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8f7463a3-cadb-409e-bae8-7e9acaa64810 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:12.093241 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8f7463a3-cadb-409e-bae8-7e9acaa64810 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:12.094175 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8f7463a3-cadb-409e-bae8-7e9acaa64810 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:12.094796 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8f7463a3-cadb-409e-bae8-7e9acaa64810 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:12.095507 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8f7463a3-cadb-409e-bae8-7e9acaa64810 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:12.135574 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-3444f31d-bcd9-4255-a541-4415f57b5365 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.463703 Oct 08 21:04:12.152740 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1501/3059] 10.222.0.26 () {62 vars in 1188 bytes} [Sat Oct 8 21:04:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 482 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 08 21:04:12.158866 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-b7089569-b244-4781-b4cf-931a816f58ad req-a8892315-5aff-4c33-bdaf-ee6c69595548 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e392800-b237-4d1d-8372-e635e2450b91", "name": "network-vif-deleted", "tag": "7b5e3817-0dd1-47a2-b7d0-f75aa022f9b9"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:04:12.173940 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-b7089569-b244-4781-b4cf-931a816f58ad req-a8892315-5aff-4c33-bdaf-ee6c69595548 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:12.174727 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-b7089569-b244-4781-b4cf-931a816f58ad req-a8892315-5aff-4c33-bdaf-ee6c69595548 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:12.175888 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-b7089569-b244-4781-b4cf-931a816f58ad req-a8892315-5aff-4c33-bdaf-ee6c69595548 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:12.183278 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=2,nova_cell1:INSERT=5 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:04:12.202777 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-b7089569-b244-4781-b4cf-931a816f58ad req-a8892315-5aff-4c33-bdaf-ee6c69595548 service nova] Creating event network-vif-deleted:7b5e3817-0dd1-47a2-b7d0-f75aa022f9b9 for instance 4e392800-b237-4d1d-8372-e635e2450b91 on nch1-master-1 Oct 08 21:04:12.214992 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-b7089569-b244-4781-b4cf-931a816f58ad req-a8892315-5aff-4c33-bdaf-ee6c69595548 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060046 Oct 08 21:04:12.217116 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1502/3060] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:04:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:04:12.228332 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-4cb9162a-14fc-4438-b835-5b74f902be6c tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:12.229071 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-4cb9162a-14fc-4438-b835-5b74f902be6c tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] [instance: 562434d8-1c7a-4aa4-8cb5-e5d37bf07592] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:12.434535 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-4cb9162a-14fc-4438-b835-5b74f902be6c tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07280ef2c5da4903a62092a44499f455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92d768a1a654e199e14845aab7d565b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:12.452526 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-4cb9162a-14fc-4438-b835-5b74f902be6c tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07280ef2c5da4903a62092a44499f455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92d768a1a654e199e14845aab7d565b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:12.459644 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-4cb9162a-14fc-4438-b835-5b74f902be6c tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07280ef2c5da4903a62092a44499f455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92d768a1a654e199e14845aab7d565b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:12.464300 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-4cb9162a-14fc-4438-b835-5b74f902be6c tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] 10.222.0.26 "GET /compute/v2.1/servers/562434d8-1c7a-4aa4-8cb5-e5d37bf07592" status: 200 len: 1277 microversion: 2.57 time: 0.242653 Oct 08 21:04:12.466884 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1503/3061] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:04:12 2022] GET /compute/v2.1/servers/562434d8-1c7a-4aa4-8cb5-e5d37bf07592 => generated 1277 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:04:12.502345 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-d7b70ec4-90fa-4c4d-9d2b-fdec99fe5770 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:12.503080 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-d7b70ec4-90fa-4c4d-9d2b-fdec99fe5770 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] [instance: 4e392800-b237-4d1d-8372-e635e2450b91] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:12.517338 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d7b70ec4-90fa-4c4d-9d2b-fdec99fe5770 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:12.518241 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d7b70ec4-90fa-4c4d-9d2b-fdec99fe5770 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:12.519341 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d7b70ec4-90fa-4c4d-9d2b-fdec99fe5770 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:12.520780 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d7b70ec4-90fa-4c4d-9d2b-fdec99fe5770 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:12.522306 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d7b70ec4-90fa-4c4d-9d2b-fdec99fe5770 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:12.523331 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d7b70ec4-90fa-4c4d-9d2b-fdec99fe5770 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:12.566003 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d7b70ec4-90fa-4c4d-9d2b-fdec99fe5770 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:12.566877 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d7b70ec4-90fa-4c4d-9d2b-fdec99fe5770 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:12.567676 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d7b70ec4-90fa-4c4d-9d2b-fdec99fe5770 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:12.568368 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.objects.instance [None req-d7b70ec4-90fa-4c4d-9d2b-fdec99fe5770 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Lazy-loading 'fault' on Instance uuid 4e392800-b237-4d1d-8372-e635e2450b91 {{(pid=140491) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 21:04:12.672994 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-d7b70ec4-90fa-4c4d-9d2b-fdec99fe5770 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2395fe934d458faa80e28587458bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f455695c0214bfab0f412aa34417e34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:12.683480 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-d7b70ec4-90fa-4c4d-9d2b-fdec99fe5770 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] 10.222.0.26 "GET /compute/v2.1/servers/4e392800-b237-4d1d-8372-e635e2450b91" status: 200 len: 1304 microversion: 2.1 time: 0.196563 Oct 08 21:04:12.700844 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1504/3062] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:04:12 2022] GET /compute/v2.1/servers/4e392800-b237-4d1d-8372-e635e2450b91 => generated 1304 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:04:12.722476 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-d6807f1e-c3c8-4825-90cb-a552b642a217 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:12.723510 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-d6807f1e-c3c8-4825-90cb-a552b642a217 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] [instance: 814f7da9-1d8d-4695-8cfa-6db50c3e846a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:12.736805 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d6807f1e-c3c8-4825-90cb-a552b642a217 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:12.741443 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d6807f1e-c3c8-4825-90cb-a552b642a217 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:12.742587 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d6807f1e-c3c8-4825-90cb-a552b642a217 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:12.747247 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d6807f1e-c3c8-4825-90cb-a552b642a217 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:12.747966 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d6807f1e-c3c8-4825-90cb-a552b642a217 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:12.748713 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d6807f1e-c3c8-4825-90cb-a552b642a217 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:12.984114 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-8f7463a3-cadb-409e-bae8-7e9acaa64810 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2e13f1952a4e5bb23d57dd7fa31875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b2a56286924e2d953bebe717ce591b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:12.992739 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-8f7463a3-cadb-409e-bae8-7e9acaa64810 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] 10.222.0.26 "GET /compute/v2.1/servers/136d0aa6-479d-4d9c-b633-23203ee44ae4" status: 200 len: 1507 microversion: 2.1 time: 0.918394 Oct 08 21:04:12.997404 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1559/3063] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:04:12 2022] GET /compute/v2.1/servers/136d0aa6-479d-4d9c-b633-23203ee44ae4 => generated 1507 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:04:13.094955 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e1bdf36f-de39-40d5-9bab-161cc63099db tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:13.095578 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-e1bdf36f-de39-40d5-9bab-161cc63099db tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: 6ef37448-690b-4fcf-85f8-a2fb71207f38] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:13.112923 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e1bdf36f-de39-40d5-9bab-161cc63099db tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:13.113466 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e1bdf36f-de39-40d5-9bab-161cc63099db tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:13.113916 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e1bdf36f-de39-40d5-9bab-161cc63099db tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:13.114641 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e1bdf36f-de39-40d5-9bab-161cc63099db tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:13.115101 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e1bdf36f-de39-40d5-9bab-161cc63099db tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:13.115531 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e1bdf36f-de39-40d5-9bab-161cc63099db tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:13.254638 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-d6807f1e-c3c8-4825-90cb-a552b642a217 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095debf3968c448fb3c3add0322d8d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc9bed6d76834f6fa66d681ecd9f4e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:13.279232 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-d6807f1e-c3c8-4825-90cb-a552b642a217 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] 10.222.0.26 "GET /compute/v2.1/servers/814f7da9-1d8d-4695-8cfa-6db50c3e846a" status: 200 len: 1516 microversion: 2.1 time: 0.569531 Oct 08 21:04:13.283114 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1505/3064] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:04:12 2022] GET /compute/v2.1/servers/814f7da9-1d8d-4695-8cfa-6db50c3e846a => generated 1516 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:04:13.497972 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-8d62e936-2cf3-4800-952e-f54f89e9ebdc tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:13.498594 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-8d62e936-2cf3-4800-952e-f54f89e9ebdc tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] [instance: 562434d8-1c7a-4aa4-8cb5-e5d37bf07592] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:13.510783 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8d62e936-2cf3-4800-952e-f54f89e9ebdc tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:13.511349 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8d62e936-2cf3-4800-952e-f54f89e9ebdc tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:13.511828 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8d62e936-2cf3-4800-952e-f54f89e9ebdc tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:13.515407 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8d62e936-2cf3-4800-952e-f54f89e9ebdc tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:13.515929 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8d62e936-2cf3-4800-952e-f54f89e9ebdc tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:13.516555 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8d62e936-2cf3-4800-952e-f54f89e9ebdc tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:13.725305 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-8d62e936-2cf3-4800-952e-f54f89e9ebdc tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07280ef2c5da4903a62092a44499f455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92d768a1a654e199e14845aab7d565b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:13.745377 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-8d62e936-2cf3-4800-952e-f54f89e9ebdc tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07280ef2c5da4903a62092a44499f455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92d768a1a654e199e14845aab7d565b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:13.747254 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-8d62e936-2cf3-4800-952e-f54f89e9ebdc tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07280ef2c5da4903a62092a44499f455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92d768a1a654e199e14845aab7d565b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:13.748742 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-8d62e936-2cf3-4800-952e-f54f89e9ebdc tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] 10.222.0.26 "GET /compute/v2.1/servers/562434d8-1c7a-4aa4-8cb5-e5d37bf07592" status: 200 len: 1329 microversion: 2.57 time: 0.255369 Oct 08 21:04:13.749510 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1506/3065] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:04:13 2022] GET /compute/v2.1/servers/562434d8-1c7a-4aa4-8cb5-e5d37bf07592 => generated 1329 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 08 21:04:13.764858 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-ae77a71e-e116-452a-91c1-9df1821f61a7 req-7303b3ad-46b4-4998-b1ab-5c08cc4eae6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "814f7da9-1d8d-4695-8cfa-6db50c3e846a", "name": "network-vif-deleted", "tag": "cd12e184-b7f8-4558-a631-e695359ed8f7"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:04:13.791531 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-ae77a71e-e116-452a-91c1-9df1821f61a7 req-7303b3ad-46b4-4998-b1ab-5c08cc4eae6c service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:13.792266 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-ae77a71e-e116-452a-91c1-9df1821f61a7 req-7303b3ad-46b4-4998-b1ab-5c08cc4eae6c service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:13.795443 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-ae77a71e-e116-452a-91c1-9df1821f61a7 req-7303b3ad-46b4-4998-b1ab-5c08cc4eae6c service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:13.819975 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-ae77a71e-e116-452a-91c1-9df1821f61a7 req-7303b3ad-46b4-4998-b1ab-5c08cc4eae6c service nova] Creating event network-vif-deleted:cd12e184-b7f8-4558-a631-e695359ed8f7 for instance 814f7da9-1d8d-4695-8cfa-6db50c3e846a on nch2-master-1 Oct 08 21:04:13.834714 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-ae77a71e-e116-452a-91c1-9df1821f61a7 req-7303b3ad-46b4-4998-b1ab-5c08cc4eae6c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083757 Oct 08 21:04:13.835324 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1507/3066] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:04:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:04:13.840594 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-05d20be0-7123-4ce8-9dcf-2b7a0134dc24 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:13.841334 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-05d20be0-7123-4ce8-9dcf-2b7a0134dc24 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] [instance: 4e392800-b237-4d1d-8372-e635e2450b91] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:13.860036 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-05d20be0-7123-4ce8-9dcf-2b7a0134dc24 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:13.860559 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-05d20be0-7123-4ce8-9dcf-2b7a0134dc24 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:13.861022 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-05d20be0-7123-4ce8-9dcf-2b7a0134dc24 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:13.861860 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-05d20be0-7123-4ce8-9dcf-2b7a0134dc24 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:13.862277 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-05d20be0-7123-4ce8-9dcf-2b7a0134dc24 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:13.862713 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-05d20be0-7123-4ce8-9dcf-2b7a0134dc24 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:13.881623 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-e1bdf36f-de39-40d5-9bab-161cc63099db tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:13.894448 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-05d20be0-7123-4ce8-9dcf-2b7a0134dc24 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] HTTP exception thrown: Instance 4e392800-b237-4d1d-8372-e635e2450b91 could not be found. Oct 08 21:04:13.896626 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-e1bdf36f-de39-40d5-9bab-161cc63099db tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/6ef37448-690b-4fcf-85f8-a2fb71207f38" status: 200 len: 1476 microversion: 2.1 time: 0.804283 Oct 08 21:04:13.897043 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-05d20be0-7123-4ce8-9dcf-2b7a0134dc24 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Request method failure captured: Oct 08 21:04:13.897043 ncdv-master-1 devstack@n-api.service[140491]: request: GET /compute/v2.1/servers/4e392800-b237-4d1d-8372-e635e2450b91 HTTP/1.1 Oct 08 21:04:13.897043 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:04:13.897043 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:04:13.897043 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:04:13.897043 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 21:04:13.897043 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:04:13.897043 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:04:13.897043 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:04:13.897043 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:04:13.897043 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeWtfsRij8DS-wzEpvH6DwBysKsrAm24qQYEhsUBoJMap9gyIC1aM_Q2tzQGCKPzbCAs0hGEv8DoChEPD-NjJ0saSnso5v1x0g9b0O5ShVuoMUHeFCA-scoTTCPuGR_ghNSyGnJ1HAAC2_YQGOt3-C8qxXqjikeg9_Tj0ZzFOZybXME Oct 08 21:04:13.897043 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:04:13.897043 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:04:13.897043 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:04:13.897043 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:04:13.897043 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:04:13.897043 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:04:13.897043 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 8f455695c0214bfab0f412aa34417e34 Oct 08 21:04:13.897043 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-ServerPasswordTestJSON-585227563 Oct 08 21:04:13.897043 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:04:13.897043 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:04:13.897043 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8f455695c0214bfab0f412aa34417e34"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8f455695c0214bfab0f412aa34417e34"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8f455695c0214bfab0f412aa34417e34"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8f455695c0214bfab0f412aa34417e34"}]}] Oct 08 21:04:13.897043 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-ServerPasswordTestJSON-585227563 Oct 08 21:04:13.897043 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 8f455695c0214bfab0f412aa34417e34 Oct 08 21:04:13.897043 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-ServerPasswordTestJSON-585227563 Oct 08 21:04:13.897043 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-ServerPasswordTestJSON-585227563-project Oct 08 21:04:13.897043 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:04:13.897043 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:04:13.897043 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 9f2395fe934d458faa80e28587458bd2 Oct 08 21:04:13.897043 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-ServerPasswordTestJSON-585227563-project Oct 08 21:04:13.897043 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:04:13.897043 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance 4e392800-b237-4d1d-8372-e635e2450b91 could not be found. Oct 08 21:04:13.897043 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': '4e392800-b237-4d1d-8372-e635e2450b91'} Oct 08 21:04:13.897043 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:04:13.897043 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:04:13.897043 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:04:13.897043 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:04:13.897043 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:04:13.897043 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:04:13.897043 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:04:13.897043 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:04:13.897043 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:04:13.897043 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:04:13.897043 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e392800-b237-4d1d-8372-e635e2450b91 could not be found. Oct 08 21:04:13.897043 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:04:13.897043 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:04:13.897043 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:04:13.897043 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:04:13.897043 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:04:13.897043 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:04:13.897043 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:04:13.897043 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:04:13.897043 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:04:13.897043 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:04:13.897043 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:04:13.897043 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:04:13.897043 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:04:13.897043 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:04:13.897043 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:04:13.897043 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:04:13.897043 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e392800-b237-4d1d-8372-e635e2450b91 could not be found. Oct 08 21:04:13.897043 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:04:13.897043 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:04:13.897043 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:04:13.902261 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:04:13.902261 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:04:13.902261 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:04:13.902261 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:04:13.902261 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:04:13.902261 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e392800-b237-4d1d-8372-e635e2450b91 could not be found. Oct 08 21:04:13.902261 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:04:13.902261 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-05d20be0-7123-4ce8-9dcf-2b7a0134dc24 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] Returning 404 to user: Instance 4e392800-b237-4d1d-8372-e635e2450b91 could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:04:13.902261 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-05d20be0-7123-4ce8-9dcf-2b7a0134dc24 tempest-ServerPasswordTestJSON-585227563 tempest-ServerPasswordTestJSON-585227563-project] 10.222.0.26 "GET /compute/v2.1/servers/4e392800-b237-4d1d-8372-e635e2450b91" status: 404 len: 111 microversion: 2.1 time: 0.063264 Oct 08 21:04:13.905278 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1508/3067] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:04:13 2022] GET /compute/v2.1/servers/4e392800-b237-4d1d-8372-e635e2450b91 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:04:13.905761 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1560/3068] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:04:13 2022] GET /compute/v2.1/servers/6ef37448-690b-4fcf-85f8-a2fb71207f38 => generated 1476 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:04:14.025456 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-9daff17a-c0c0-4e32-a676-29c52bee5116 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:14.026073 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-9daff17a-c0c0-4e32-a676-29c52bee5116 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] [instance: 136d0aa6-479d-4d9c-b633-23203ee44ae4] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:14.037376 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9daff17a-c0c0-4e32-a676-29c52bee5116 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:14.037962 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9daff17a-c0c0-4e32-a676-29c52bee5116 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:14.038574 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9daff17a-c0c0-4e32-a676-29c52bee5116 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:14.039339 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9daff17a-c0c0-4e32-a676-29c52bee5116 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:14.039813 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9daff17a-c0c0-4e32-a676-29c52bee5116 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:14.040227 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9daff17a-c0c0-4e32-a676-29c52bee5116 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:14.312188 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e06fb229-a674-4de7-b6ce-3dcfcb6129e9 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:14.313787 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-e06fb229-a674-4de7-b6ce-3dcfcb6129e9 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] [instance: 814f7da9-1d8d-4695-8cfa-6db50c3e846a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:14.320059 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:UPDATE=3,nova_api:SELECT=97 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:04:14.333925 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e06fb229-a674-4de7-b6ce-3dcfcb6129e9 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:14.337250 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e06fb229-a674-4de7-b6ce-3dcfcb6129e9 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:14.339059 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e06fb229-a674-4de7-b6ce-3dcfcb6129e9 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:14.341699 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e06fb229-a674-4de7-b6ce-3dcfcb6129e9 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:14.343215 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e06fb229-a674-4de7-b6ce-3dcfcb6129e9 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:14.345397 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e06fb229-a674-4de7-b6ce-3dcfcb6129e9 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:14.512311 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e06fb229-a674-4de7-b6ce-3dcfcb6129e9 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:14.514043 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e06fb229-a674-4de7-b6ce-3dcfcb6129e9 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:14.514043 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e06fb229-a674-4de7-b6ce-3dcfcb6129e9 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:14.516300 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.objects.instance [None req-e06fb229-a674-4de7-b6ce-3dcfcb6129e9 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lazy-loading 'fault' on Instance uuid 814f7da9-1d8d-4695-8cfa-6db50c3e846a {{(pid=140492) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 21:04:14.643279 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-e06fb229-a674-4de7-b6ce-3dcfcb6129e9 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095debf3968c448fb3c3add0322d8d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc9bed6d76834f6fa66d681ecd9f4e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:14.659280 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-e06fb229-a674-4de7-b6ce-3dcfcb6129e9 tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] 10.222.0.26 "GET /compute/v2.1/servers/814f7da9-1d8d-4695-8cfa-6db50c3e846a" status: 200 len: 1310 microversion: 2.1 time: 0.351873 Oct 08 21:04:14.659893 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1561/3069] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:04:14 2022] GET /compute/v2.1/servers/814f7da9-1d8d-4695-8cfa-6db50c3e846a => generated 1310 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:04:14.781179 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-effee03d-3399-4b62-b213-840d23c90737 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:14.782915 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-effee03d-3399-4b62-b213-840d23c90737 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] [instance: 562434d8-1c7a-4aa4-8cb5-e5d37bf07592] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:14.796138 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-effee03d-3399-4b62-b213-840d23c90737 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:14.797108 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-effee03d-3399-4b62-b213-840d23c90737 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:14.798428 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-effee03d-3399-4b62-b213-840d23c90737 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:14.799943 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-effee03d-3399-4b62-b213-840d23c90737 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:14.800712 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-effee03d-3399-4b62-b213-840d23c90737 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:14.801814 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-effee03d-3399-4b62-b213-840d23c90737 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:14.936685 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-9daff17a-c0c0-4e32-a676-29c52bee5116 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2e13f1952a4e5bb23d57dd7fa31875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b2a56286924e2d953bebe717ce591b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:14.955581 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-effee03d-3399-4b62-b213-840d23c90737 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07280ef2c5da4903a62092a44499f455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92d768a1a654e199e14845aab7d565b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:14.962065 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-9daff17a-c0c0-4e32-a676-29c52bee5116 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] 10.222.0.26 "GET /compute/v2.1/servers/136d0aa6-479d-4d9c-b633-23203ee44ae4" status: 200 len: 1507 microversion: 2.1 time: 0.940464 Oct 08 21:04:14.962659 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1509/3070] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:04:14 2022] GET /compute/v2.1/servers/136d0aa6-479d-4d9c-b633-23203ee44ae4 => generated 1507 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:04:14.977443 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-a4a6302c-7c09-45fe-962e-7a69a4fee21f tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:14.978075 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-a4a6302c-7c09-45fe-962e-7a69a4fee21f tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: 6ef37448-690b-4fcf-85f8-a2fb71207f38] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:14.986355 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-effee03d-3399-4b62-b213-840d23c90737 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07280ef2c5da4903a62092a44499f455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92d768a1a654e199e14845aab7d565b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:14.988203 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-effee03d-3399-4b62-b213-840d23c90737 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07280ef2c5da4903a62092a44499f455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92d768a1a654e199e14845aab7d565b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:14.990038 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-effee03d-3399-4b62-b213-840d23c90737 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] 10.222.0.26 "GET /compute/v2.1/servers/562434d8-1c7a-4aa4-8cb5-e5d37bf07592" status: 200 len: 1335 microversion: 2.57 time: 0.213728 Oct 08 21:04:14.990735 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1562/3071] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:04:14 2022] GET /compute/v2.1/servers/562434d8-1c7a-4aa4-8cb5-e5d37bf07592 => generated 1335 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 08 21:04:14.998913 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a4a6302c-7c09-45fe-962e-7a69a4fee21f tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:14.999629 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a4a6302c-7c09-45fe-962e-7a69a4fee21f tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:15.000246 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a4a6302c-7c09-45fe-962e-7a69a4fee21f tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:15.000988 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a4a6302c-7c09-45fe-962e-7a69a4fee21f tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:15.013691 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a4a6302c-7c09-45fe-962e-7a69a4fee21f tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:15.014232 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a4a6302c-7c09-45fe-962e-7a69a4fee21f tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:15.333223 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-a4a6302c-7c09-45fe-962e-7a69a4fee21f tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:15.342345 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-a4a6302c-7c09-45fe-962e-7a69a4fee21f tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/6ef37448-690b-4fcf-85f8-a2fb71207f38" status: 200 len: 1476 microversion: 2.1 time: 0.368948 Oct 08 21:04:15.352725 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1510/3072] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:04:14 2022] GET /compute/v2.1/servers/6ef37448-690b-4fcf-85f8-a2fb71207f38 => generated 1476 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:04:15.691401 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-5381b041-fca2-465e-a0fa-57db9b17ec8e tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:15.692132 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-5381b041-fca2-465e-a0fa-57db9b17ec8e tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] [instance: 814f7da9-1d8d-4695-8cfa-6db50c3e846a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:15.706128 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5381b041-fca2-465e-a0fa-57db9b17ec8e tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:15.706990 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5381b041-fca2-465e-a0fa-57db9b17ec8e tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:15.707852 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5381b041-fca2-465e-a0fa-57db9b17ec8e tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:15.708794 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5381b041-fca2-465e-a0fa-57db9b17ec8e tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:15.709483 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5381b041-fca2-465e-a0fa-57db9b17ec8e tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:15.710083 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5381b041-fca2-465e-a0fa-57db9b17ec8e tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:15.728275 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-5381b041-fca2-465e-a0fa-57db9b17ec8e tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] HTTP exception thrown: Instance 814f7da9-1d8d-4695-8cfa-6db50c3e846a could not be found. Oct 08 21:04:15.730240 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-5381b041-fca2-465e-a0fa-57db9b17ec8e tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Request method failure captured: Oct 08 21:04:15.730240 ncdv-master-1 devstack@n-api.service[140492]: request: GET /compute/v2.1/servers/814f7da9-1d8d-4695-8cfa-6db50c3e846a HTTP/1.1 Oct 08 21:04:15.730240 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:04:15.730240 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:04:15.730240 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:04:15.730240 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 21:04:15.730240 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:04:15.730240 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:04:15.730240 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:04:15.730240 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:04:15.730240 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeV6gyhhqTwzNzF_DVQE7VbX1i-ngOCRm15dLpkxnz5WVdql8AoVlqCCwyqOkCOk76oWuq0Ya4x_PWsPouJg9rloWzVgiZk1L2YjlEbL6DHjUi-iP3oO8lV6lZU_lN1aEJkywJ-KczU9NSltZHb65aAZbd_JEDRI6tcAk9x88eHP9pU Oct 08 21:04:15.730240 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:04:15.730240 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:04:15.730240 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:04:15.730240 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:04:15.730240 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:04:15.730240 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:04:15.730240 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: bc9bed6d76834f6fa66d681ecd9f4e90 Oct 08 21:04:15.730240 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-ListServerFiltersTestJSON-235970729 Oct 08 21:04:15.730240 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:04:15.730240 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:04:15.730240 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/bc9bed6d76834f6fa66d681ecd9f4e90"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/bc9bed6d76834f6fa66d681ecd9f4e90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_bc9bed6d76834f6fa66d681ecd9f4e90"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/bc9bed6d76834f6fa66d681ecd9f4e90"}]}] Oct 08 21:04:15.730240 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-ListServerFiltersTestJSON-235970729 Oct 08 21:04:15.730240 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: bc9bed6d76834f6fa66d681ecd9f4e90 Oct 08 21:04:15.730240 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-235970729 Oct 08 21:04:15.730240 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-ListServerFiltersTestJSON-235970729-project Oct 08 21:04:15.730240 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:04:15.730240 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:04:15.730240 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 095debf3968c448fb3c3add0322d8d1b Oct 08 21:04:15.730240 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-ListServerFiltersTestJSON-235970729-project Oct 08 21:04:15.730240 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 21:04:15.730240 ncdv-master-1 devstack@n-api.service[140492]: exception: Instance 814f7da9-1d8d-4695-8cfa-6db50c3e846a could not be found. Oct 08 21:04:15.730240 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': '814f7da9-1d8d-4695-8cfa-6db50c3e846a'} Oct 08 21:04:15.730240 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:04:15.730240 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:04:15.730240 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:04:15.730240 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:04:15.730240 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:04:15.730240 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:04:15.730240 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:04:15.730240 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:04:15.730240 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:04:15.730240 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:04:15.730240 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 814f7da9-1d8d-4695-8cfa-6db50c3e846a could not be found. Oct 08 21:04:15.730240 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:04:15.730240 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:04:15.730240 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:04:15.730240 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:04:15.730240 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:04:15.730240 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:04:15.730240 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:04:15.730240 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:04:15.730240 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:04:15.730240 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:04:15.730240 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:04:15.730240 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:04:15.730240 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:04:15.730240 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:04:15.730240 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:04:15.730240 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:04:15.730240 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 814f7da9-1d8d-4695-8cfa-6db50c3e846a could not be found. Oct 08 21:04:15.730240 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:04:15.730240 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:04:15.730240 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:04:15.734331 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:04:15.734331 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:04:15.734331 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:04:15.734331 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:04:15.734331 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:04:15.734331 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 814f7da9-1d8d-4695-8cfa-6db50c3e846a could not be found. Oct 08 21:04:15.734331 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:04:15.737996 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-5381b041-fca2-465e-a0fa-57db9b17ec8e tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] Returning 404 to user: Instance 814f7da9-1d8d-4695-8cfa-6db50c3e846a could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:04:15.739222 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-5381b041-fca2-465e-a0fa-57db9b17ec8e tempest-ListServerFiltersTestJSON-235970729 tempest-ListServerFiltersTestJSON-235970729-project] 10.222.0.26 "GET /compute/v2.1/servers/814f7da9-1d8d-4695-8cfa-6db50c3e846a" status: 404 len: 111 microversion: 2.1 time: 0.056488 Oct 08 21:04:15.740133 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1563/3073] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:04:15 2022] GET /compute/v2.1/servers/814f7da9-1d8d-4695-8cfa-6db50c3e846a => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:04:15.991229 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-871b610c-2c8d-4fa4-a120-e7bb208d5b83 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:15.993144 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-871b610c-2c8d-4fa4-a120-e7bb208d5b83 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] [instance: 136d0aa6-479d-4d9c-b633-23203ee44ae4] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:16.003457 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-871b610c-2c8d-4fa4-a120-e7bb208d5b83 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:16.004465 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-871b610c-2c8d-4fa4-a120-e7bb208d5b83 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:16.005163 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-871b610c-2c8d-4fa4-a120-e7bb208d5b83 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:16.007140 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-871b610c-2c8d-4fa4-a120-e7bb208d5b83 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:16.007904 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-871b610c-2c8d-4fa4-a120-e7bb208d5b83 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:16.009628 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-871b610c-2c8d-4fa4-a120-e7bb208d5b83 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:16.021114 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-4b5c8b20-42ad-4588-a7ef-254da109df4b tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:16.022161 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-4b5c8b20-42ad-4588-a7ef-254da109df4b tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] [instance: 562434d8-1c7a-4aa4-8cb5-e5d37bf07592] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:16.039387 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4b5c8b20-42ad-4588-a7ef-254da109df4b tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:16.045037 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4b5c8b20-42ad-4588-a7ef-254da109df4b tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:16.047886 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4b5c8b20-42ad-4588-a7ef-254da109df4b tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:16.052518 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4b5c8b20-42ad-4588-a7ef-254da109df4b tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:16.053766 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4b5c8b20-42ad-4588-a7ef-254da109df4b tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:16.054459 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4b5c8b20-42ad-4588-a7ef-254da109df4b tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:16.550649 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-871b610c-2c8d-4fa4-a120-e7bb208d5b83 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2e13f1952a4e5bb23d57dd7fa31875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b2a56286924e2d953bebe717ce591b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:16.567413 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-871b610c-2c8d-4fa4-a120-e7bb208d5b83 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] 10.222.0.26 "GET /compute/v2.1/servers/136d0aa6-479d-4d9c-b633-23203ee44ae4" status: 200 len: 1507 microversion: 2.1 time: 0.584362 Oct 08 21:04:16.586368 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1511/3074] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:04:15 2022] GET /compute/v2.1/servers/136d0aa6-479d-4d9c-b633-23203ee44ae4 => generated 1507 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:04:16.598699 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-ace68113-a5af-4cc8-b7e6-5697dbf6dd5c tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:16.599762 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-ace68113-a5af-4cc8-b7e6-5697dbf6dd5c tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: 6ef37448-690b-4fcf-85f8-a2fb71207f38] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:16.614043 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ace68113-a5af-4cc8-b7e6-5697dbf6dd5c tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:16.616072 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ace68113-a5af-4cc8-b7e6-5697dbf6dd5c tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:16.616556 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ace68113-a5af-4cc8-b7e6-5697dbf6dd5c tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:16.619439 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ace68113-a5af-4cc8-b7e6-5697dbf6dd5c tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:16.619937 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ace68113-a5af-4cc8-b7e6-5697dbf6dd5c tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:16.620389 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ace68113-a5af-4cc8-b7e6-5697dbf6dd5c tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:16.985966 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-4b5c8b20-42ad-4588-a7ef-254da109df4b tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07280ef2c5da4903a62092a44499f455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92d768a1a654e199e14845aab7d565b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:17.000689 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-4b5c8b20-42ad-4588-a7ef-254da109df4b tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07280ef2c5da4903a62092a44499f455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92d768a1a654e199e14845aab7d565b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:17.008325 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-4b5c8b20-42ad-4588-a7ef-254da109df4b tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07280ef2c5da4903a62092a44499f455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92d768a1a654e199e14845aab7d565b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:17.010567 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-4b5c8b20-42ad-4588-a7ef-254da109df4b tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] 10.222.0.26 "GET /compute/v2.1/servers/562434d8-1c7a-4aa4-8cb5-e5d37bf07592" status: 200 len: 1335 microversion: 2.57 time: 0.997201 Oct 08 21:04:17.012462 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1564/3075] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:04:16 2022] GET /compute/v2.1/servers/562434d8-1c7a-4aa4-8cb5-e5d37bf07592 => generated 1335 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:04:17.046856 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-ace68113-a5af-4cc8-b7e6-5697dbf6dd5c tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:17.082818 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-ace68113-a5af-4cc8-b7e6-5697dbf6dd5c tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/6ef37448-690b-4fcf-85f8-a2fb71207f38" status: 200 len: 1476 microversion: 2.1 time: 0.495151 Oct 08 21:04:17.084771 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1512/3076] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:04:16 2022] GET /compute/v2.1/servers/6ef37448-690b-4fcf-85f8-a2fb71207f38 => generated 1476 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:04:17.597329 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-f968ae71-e338-40ff-b646-5987b7c5c410 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:17.598152 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-f968ae71-e338-40ff-b646-5987b7c5c410 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] [instance: 136d0aa6-479d-4d9c-b633-23203ee44ae4] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:17.608896 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f968ae71-e338-40ff-b646-5987b7c5c410 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:17.609514 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f968ae71-e338-40ff-b646-5987b7c5c410 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:17.610066 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f968ae71-e338-40ff-b646-5987b7c5c410 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:17.610883 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f968ae71-e338-40ff-b646-5987b7c5c410 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:17.611551 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f968ae71-e338-40ff-b646-5987b7c5c410 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:17.612310 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f968ae71-e338-40ff-b646-5987b7c5c410 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:18.043849 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-19597bfe-a721-4b52-9819-393bca9002e1 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:18.044465 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-19597bfe-a721-4b52-9819-393bca9002e1 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] [instance: 562434d8-1c7a-4aa4-8cb5-e5d37bf07592] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:18.052119 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-19597bfe-a721-4b52-9819-393bca9002e1 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:18.052759 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-19597bfe-a721-4b52-9819-393bca9002e1 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:18.053045 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-19597bfe-a721-4b52-9819-393bca9002e1 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:18.053772 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-19597bfe-a721-4b52-9819-393bca9002e1 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:18.054513 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-19597bfe-a721-4b52-9819-393bca9002e1 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:18.055155 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-19597bfe-a721-4b52-9819-393bca9002e1 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:18.171100 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-19597bfe-a721-4b52-9819-393bca9002e1 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07280ef2c5da4903a62092a44499f455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92d768a1a654e199e14845aab7d565b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:18.192887 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-19597bfe-a721-4b52-9819-393bca9002e1 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07280ef2c5da4903a62092a44499f455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92d768a1a654e199e14845aab7d565b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:18.207189 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-19597bfe-a721-4b52-9819-393bca9002e1 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07280ef2c5da4903a62092a44499f455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92d768a1a654e199e14845aab7d565b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:18.208847 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-19597bfe-a721-4b52-9819-393bca9002e1 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] 10.222.0.26 "GET /compute/v2.1/servers/562434d8-1c7a-4aa4-8cb5-e5d37bf07592" status: 200 len: 1356 microversion: 2.57 time: 0.168884 Oct 08 21:04:18.213892 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1513/3077] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:04:18 2022] GET /compute/v2.1/servers/562434d8-1c7a-4aa4-8cb5-e5d37bf07592 => generated 1356 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 08 21:04:18.221033 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-98fbea01-cb43-43d9-9662-71b9d8019ced tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:18.222612 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-98fbea01-cb43-43d9-9662-71b9d8019ced tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: 6ef37448-690b-4fcf-85f8-a2fb71207f38] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:18.233256 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-98fbea01-cb43-43d9-9662-71b9d8019ced tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:18.234182 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-98fbea01-cb43-43d9-9662-71b9d8019ced tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:18.234905 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-98fbea01-cb43-43d9-9662-71b9d8019ced tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:18.235988 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-98fbea01-cb43-43d9-9662-71b9d8019ced tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:18.237344 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-98fbea01-cb43-43d9-9662-71b9d8019ced tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:18.238058 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-98fbea01-cb43-43d9-9662-71b9d8019ced tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:18.304732 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-f968ae71-e338-40ff-b646-5987b7c5c410 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2e13f1952a4e5bb23d57dd7fa31875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b2a56286924e2d953bebe717ce591b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:18.322573 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-f968ae71-e338-40ff-b646-5987b7c5c410 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] 10.222.0.26 "GET /compute/v2.1/servers/136d0aa6-479d-4d9c-b633-23203ee44ae4" status: 200 len: 1507 microversion: 2.1 time: 0.730683 Oct 08 21:04:18.323025 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1565/3078] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:04:17 2022] GET /compute/v2.1/servers/136d0aa6-479d-4d9c-b633-23203ee44ae4 => generated 1507 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:04:18.338050 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-ff27b913-c0c5-4910-bfa8-e603c9e7a791 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:04:18.341425 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-ff27b913-c0c5-4910-bfa8-e603c9e7a791 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] [instance: 562434d8-1c7a-4aa4-8cb5-e5d37bf07592] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:18.351238 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ff27b913-c0c5-4910-bfa8-e603c9e7a791 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:18.352077 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ff27b913-c0c5-4910-bfa8-e603c9e7a791 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:18.353134 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ff27b913-c0c5-4910-bfa8-e603c9e7a791 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:18.355404 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ff27b913-c0c5-4910-bfa8-e603c9e7a791 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:18.356107 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ff27b913-c0c5-4910-bfa8-e603c9e7a791 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:18.356758 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ff27b913-c0c5-4910-bfa8-e603c9e7a791 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:18.447633 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-98fbea01-cb43-43d9-9662-71b9d8019ced tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:18.456281 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:04:18.462913 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-98fbea01-cb43-43d9-9662-71b9d8019ced tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/6ef37448-690b-4fcf-85f8-a2fb71207f38" status: 200 len: 1476 microversion: 2.1 time: 0.246081 Oct 08 21:04:18.464608 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1514/3079] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:04:18 2022] GET /compute/v2.1/servers/6ef37448-690b-4fcf-85f8-a2fb71207f38 => generated 1476 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:04:18.505349 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-ff27b913-c0c5-4910-bfa8-e603c9e7a791 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Flavor limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 21:04:18.505795 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-ff27b913-c0c5-4910-bfa8-e603c9e7a791 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Image limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 21:04:18.506286 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-ff27b913-c0c5-4910-bfa8-e603c9e7a791 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Flavor pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 21:04:18.507586 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-ff27b913-c0c5-4910-bfa8-e603c9e7a791 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Image pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 21:04:18.508184 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-ff27b913-c0c5-4910-bfa8-e603c9e7a791 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 21:04:18.598889 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-ff27b913-c0c5-4910-bfa8-e603c9e7a791 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] [instance: 562434d8-1c7a-4aa4-8cb5-e5d37bf07592] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:18.611121 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ff27b913-c0c5-4910-bfa8-e603c9e7a791 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:18.612149 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ff27b913-c0c5-4910-bfa8-e603c9e7a791 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:18.614461 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ff27b913-c0c5-4910-bfa8-e603c9e7a791 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:18.615551 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ff27b913-c0c5-4910-bfa8-e603c9e7a791 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:18.617806 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ff27b913-c0c5-4910-bfa8-e603c9e7a791 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:18.618559 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ff27b913-c0c5-4910-bfa8-e603c9e7a791 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:18.692269 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-ff27b913-c0c5-4910-bfa8-e603c9e7a791 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] 10.222.0.26 "POST /compute/v2.1/servers/562434d8-1c7a-4aa4-8cb5-e5d37bf07592/action" status: 202 len: 1137 microversion: 2.57 time: 0.364962 Oct 08 21:04:18.713215 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1566/3080] 10.222.0.26 () {62 vars in 1320 bytes} [Sat Oct 8 21:04:18 2022] POST /compute/v2.1/servers/562434d8-1c7a-4aa4-8cb5-e5d37bf07592/action => generated 1137 bytes in 369 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 08 21:04:18.731633 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-251ec759-eeaa-4582-8956-c9903fff539f tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:18.734289 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-251ec759-eeaa-4582-8956-c9903fff539f tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] [instance: 562434d8-1c7a-4aa4-8cb5-e5d37bf07592] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:18.761176 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-251ec759-eeaa-4582-8956-c9903fff539f tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:18.761711 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-251ec759-eeaa-4582-8956-c9903fff539f tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:18.762159 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-251ec759-eeaa-4582-8956-c9903fff539f tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:18.763999 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-251ec759-eeaa-4582-8956-c9903fff539f tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:18.764476 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-251ec759-eeaa-4582-8956-c9903fff539f tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:18.766827 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-251ec759-eeaa-4582-8956-c9903fff539f tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:18.905291 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-251ec759-eeaa-4582-8956-c9903fff539f tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07280ef2c5da4903a62092a44499f455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92d768a1a654e199e14845aab7d565b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:18.934489 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-251ec759-eeaa-4582-8956-c9903fff539f tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07280ef2c5da4903a62092a44499f455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92d768a1a654e199e14845aab7d565b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:18.937367 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-251ec759-eeaa-4582-8956-c9903fff539f tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07280ef2c5da4903a62092a44499f455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92d768a1a654e199e14845aab7d565b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:18.941274 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-251ec759-eeaa-4582-8956-c9903fff539f tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] 10.222.0.26 "GET /compute/v2.1/servers/562434d8-1c7a-4aa4-8cb5-e5d37bf07592" status: 200 len: 1365 microversion: 2.57 time: 0.220960 Oct 08 21:04:18.954665 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1515/3081] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:04:18 2022] GET /compute/v2.1/servers/562434d8-1c7a-4aa4-8cb5-e5d37bf07592 => generated 1365 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:04:19.348324 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-26f21da9-0c77-49ec-a4b1-66af23c94df6 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:19.349724 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-26f21da9-0c77-49ec-a4b1-66af23c94df6 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] [instance: 136d0aa6-479d-4d9c-b633-23203ee44ae4] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:19.362569 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-26f21da9-0c77-49ec-a4b1-66af23c94df6 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:19.366937 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-26f21da9-0c77-49ec-a4b1-66af23c94df6 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:19.368617 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-26f21da9-0c77-49ec-a4b1-66af23c94df6 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:19.380688 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-26f21da9-0c77-49ec-a4b1-66af23c94df6 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:19.385386 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-26f21da9-0c77-49ec-a4b1-66af23c94df6 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:19.386131 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-26f21da9-0c77-49ec-a4b1-66af23c94df6 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:19.488863 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-e20fb127-80ef-4c42-b2c9-f12bb586aab4 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:19.489655 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-e20fb127-80ef-4c42-b2c9-f12bb586aab4 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: 6ef37448-690b-4fcf-85f8-a2fb71207f38] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:19.500068 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e20fb127-80ef-4c42-b2c9-f12bb586aab4 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:19.504263 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e20fb127-80ef-4c42-b2c9-f12bb586aab4 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:19.505397 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e20fb127-80ef-4c42-b2c9-f12bb586aab4 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:19.508099 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e20fb127-80ef-4c42-b2c9-f12bb586aab4 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:19.508873 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e20fb127-80ef-4c42-b2c9-f12bb586aab4 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:19.511225 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e20fb127-80ef-4c42-b2c9-f12bb586aab4 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:19.796555 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-26f21da9-0c77-49ec-a4b1-66af23c94df6 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2e13f1952a4e5bb23d57dd7fa31875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b2a56286924e2d953bebe717ce591b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:19.808450 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-26f21da9-0c77-49ec-a4b1-66af23c94df6 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] 10.222.0.26 "GET /compute/v2.1/servers/136d0aa6-479d-4d9c-b633-23203ee44ae4" status: 200 len: 1507 microversion: 2.1 time: 0.464224 Oct 08 21:04:19.811631 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1567/3082] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:04:19 2022] GET /compute/v2.1/servers/136d0aa6-479d-4d9c-b633-23203ee44ae4 => generated 1507 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:04:19.980994 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-d1cbb720-f597-4ce9-81e9-ca4e5c6cf34c tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:19.982145 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-d1cbb720-f597-4ce9-81e9-ca4e5c6cf34c tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] [instance: 562434d8-1c7a-4aa4-8cb5-e5d37bf07592] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:20.002690 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d1cbb720-f597-4ce9-81e9-ca4e5c6cf34c tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:20.003189 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d1cbb720-f597-4ce9-81e9-ca4e5c6cf34c tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:20.003648 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d1cbb720-f597-4ce9-81e9-ca4e5c6cf34c tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:20.004391 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d1cbb720-f597-4ce9-81e9-ca4e5c6cf34c tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:20.005281 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d1cbb720-f597-4ce9-81e9-ca4e5c6cf34c tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:20.005740 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d1cbb720-f597-4ce9-81e9-ca4e5c6cf34c tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:20.134479 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-e20fb127-80ef-4c42-b2c9-f12bb586aab4 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:20.147284 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-e20fb127-80ef-4c42-b2c9-f12bb586aab4 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/6ef37448-690b-4fcf-85f8-a2fb71207f38" status: 200 len: 1475 microversion: 2.1 time: 0.663216 Oct 08 21:04:20.164215 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1516/3083] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:04:19 2022] GET /compute/v2.1/servers/6ef37448-690b-4fcf-85f8-a2fb71207f38 => generated 1475 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:04:20.271530 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-d1cbb720-f597-4ce9-81e9-ca4e5c6cf34c tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07280ef2c5da4903a62092a44499f455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92d768a1a654e199e14845aab7d565b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:20.284911 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-d1cbb720-f597-4ce9-81e9-ca4e5c6cf34c tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07280ef2c5da4903a62092a44499f455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92d768a1a654e199e14845aab7d565b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:20.290830 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-d1cbb720-f597-4ce9-81e9-ca4e5c6cf34c tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07280ef2c5da4903a62092a44499f455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92d768a1a654e199e14845aab7d565b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:20.292378 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-d1cbb720-f597-4ce9-81e9-ca4e5c6cf34c tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] 10.222.0.26 "GET /compute/v2.1/servers/562434d8-1c7a-4aa4-8cb5-e5d37bf07592" status: 200 len: 1365 microversion: 2.57 time: 0.316301 Oct 08 21:04:20.292532 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-e20fb127-80ef-4c42-b2c9-f12bb586aab4 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:20.296772 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-e20fb127-80ef-4c42-b2c9-f12bb586aab4 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001291 Oct 08 21:04:20.315642 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1568/3084] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:04:19 2022] GET /compute/v2.1/servers/562434d8-1c7a-4aa4-8cb5-e5d37bf07592 => generated 1365 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 08 21:04:20.317176 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1517/3085] 10.222.0.26 () {56 vars in 886 bytes} [Sat Oct 8 21:04:20 2022] GET /compute/ => generated 377 bytes in 25 msecs (HTTP/1.1 200) 3 headers in 91 bytes (2 switches on core 0) Oct 08 21:04:20.506113 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-e5fb1c44-8fa8-4b15-8754-7ac79fe26530 req-e767cca5-9905-466b-8dfb-8fb9f5b4bdaf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ef37448-690b-4fcf-85f8-a2fb71207f38", "name": "network-vif-unplugged", "status": "completed", "tag": "066ce620-e2c6-4bca-97c2-d42e20280dcc"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:04:20.522159 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-e5fb1c44-8fa8-4b15-8754-7ac79fe26530 req-e767cca5-9905-466b-8dfb-8fb9f5b4bdaf service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:20.523084 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-e5fb1c44-8fa8-4b15-8754-7ac79fe26530 req-e767cca5-9905-466b-8dfb-8fb9f5b4bdaf service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:20.524015 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-e5fb1c44-8fa8-4b15-8754-7ac79fe26530 req-e767cca5-9905-466b-8dfb-8fb9f5b4bdaf service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:20.540736 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-e5fb1c44-8fa8-4b15-8754-7ac79fe26530 req-e767cca5-9905-466b-8dfb-8fb9f5b4bdaf service nova] Creating event network-vif-unplugged:066ce620-e2c6-4bca-97c2-d42e20280dcc for instance 6ef37448-690b-4fcf-85f8-a2fb71207f38 on nch1-master-1 Oct 08 21:04:20.548163 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [req-e5fb1c44-8fa8-4b15-8754-7ac79fe26530 req-e767cca5-9905-466b-8dfb-8fb9f5b4bdaf service nova] Instance 6ef37448-690b-4fcf-85f8-a2fb71207f38 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140492) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 08 21:04:20.560965 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-e5fb1c44-8fa8-4b15-8754-7ac79fe26530 req-e767cca5-9905-466b-8dfb-8fb9f5b4bdaf service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.062326 Oct 08 21:04:20.562024 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1569/3086] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:04:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:04:20.837809 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-4449debc-8042-4961-9605-be8b6aa9cb38 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:20.839730 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-4449debc-8042-4961-9605-be8b6aa9cb38 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] [instance: 136d0aa6-479d-4d9c-b633-23203ee44ae4] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:20.858368 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4449debc-8042-4961-9605-be8b6aa9cb38 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:20.859242 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4449debc-8042-4961-9605-be8b6aa9cb38 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:20.860443 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4449debc-8042-4961-9605-be8b6aa9cb38 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:20.863042 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4449debc-8042-4961-9605-be8b6aa9cb38 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:20.863794 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4449debc-8042-4961-9605-be8b6aa9cb38 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:20.864467 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4449debc-8042-4961-9605-be8b6aa9cb38 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:21.191043 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-af830a71-7cd7-417c-a182-5983008947f1 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:21.191762 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-af830a71-7cd7-417c-a182-5983008947f1 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: 6ef37448-690b-4fcf-85f8-a2fb71207f38] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:21.198364 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-af830a71-7cd7-417c-a182-5983008947f1 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:21.199176 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-af830a71-7cd7-417c-a182-5983008947f1 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:21.199828 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-af830a71-7cd7-417c-a182-5983008947f1 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:21.200801 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-af830a71-7cd7-417c-a182-5983008947f1 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:21.201514 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-af830a71-7cd7-417c-a182-5983008947f1 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:21.202168 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-af830a71-7cd7-417c-a182-5983008947f1 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:21.251107 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-4449debc-8042-4961-9605-be8b6aa9cb38 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2e13f1952a4e5bb23d57dd7fa31875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b2a56286924e2d953bebe717ce591b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:21.260488 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-4449debc-8042-4961-9605-be8b6aa9cb38 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] 10.222.0.26 "GET /compute/v2.1/servers/136d0aa6-479d-4d9c-b633-23203ee44ae4" status: 200 len: 1507 microversion: 2.1 time: 0.427801 Oct 08 21:04:21.262274 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1518/3087] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:04:20 2022] GET /compute/v2.1/servers/136d0aa6-479d-4d9c-b633-23203ee44ae4 => generated 1507 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:04:21.323617 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-e9b48b50-5e31-43a3-b226-04851d964313 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:21.324470 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-e9b48b50-5e31-43a3-b226-04851d964313 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] [instance: 562434d8-1c7a-4aa4-8cb5-e5d37bf07592] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:21.332353 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e9b48b50-5e31-43a3-b226-04851d964313 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:21.339385 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e9b48b50-5e31-43a3-b226-04851d964313 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:21.339932 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e9b48b50-5e31-43a3-b226-04851d964313 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:21.342234 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e9b48b50-5e31-43a3-b226-04851d964313 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:21.343884 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e9b48b50-5e31-43a3-b226-04851d964313 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:21.345227 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e9b48b50-5e31-43a3-b226-04851d964313 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:21.563101 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-e9b48b50-5e31-43a3-b226-04851d964313 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07280ef2c5da4903a62092a44499f455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92d768a1a654e199e14845aab7d565b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:21.580433 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-e9b48b50-5e31-43a3-b226-04851d964313 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07280ef2c5da4903a62092a44499f455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92d768a1a654e199e14845aab7d565b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:21.584865 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-e9b48b50-5e31-43a3-b226-04851d964313 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07280ef2c5da4903a62092a44499f455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92d768a1a654e199e14845aab7d565b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:21.588717 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-e9b48b50-5e31-43a3-b226-04851d964313 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] 10.222.0.26 "GET /compute/v2.1/servers/562434d8-1c7a-4aa4-8cb5-e5d37bf07592" status: 200 len: 1365 microversion: 2.57 time: 0.269362 Oct 08 21:04:21.605218 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1519/3088] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:04:21 2022] GET /compute/v2.1/servers/562434d8-1c7a-4aa4-8cb5-e5d37bf07592 => generated 1365 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 08 21:04:21.978595 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-af830a71-7cd7-417c-a182-5983008947f1 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:21.988058 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-af830a71-7cd7-417c-a182-5983008947f1 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/6ef37448-690b-4fcf-85f8-a2fb71207f38" status: 200 len: 1475 microversion: 2.1 time: 0.801218 Oct 08 21:04:21.989522 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1570/3089] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:04:21 2022] GET /compute/v2.1/servers/6ef37448-690b-4fcf-85f8-a2fb71207f38 => generated 1475 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:04:22.288928 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c6d13169-0bf1-4100-b1f7-0d10a5c9705b tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:22.289645 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-c6d13169-0bf1-4100-b1f7-0d10a5c9705b tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] [instance: 136d0aa6-479d-4d9c-b633-23203ee44ae4] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:22.292312 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=2 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:04:22.305380 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c6d13169-0bf1-4100-b1f7-0d10a5c9705b tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:22.306177 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c6d13169-0bf1-4100-b1f7-0d10a5c9705b tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:22.307140 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c6d13169-0bf1-4100-b1f7-0d10a5c9705b tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:22.308228 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c6d13169-0bf1-4100-b1f7-0d10a5c9705b tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:22.308890 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c6d13169-0bf1-4100-b1f7-0d10a5c9705b tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:22.310997 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c6d13169-0bf1-4100-b1f7-0d10a5c9705b tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:22.440350 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=8 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:04:22.601837 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-10b4a77b-8f3b-43b6-ade7-68575ae7e2e2 req-79b7df44-8d8a-4baa-a82f-978cd547163f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ef37448-690b-4fcf-85f8-a2fb71207f38", "tag": "066ce620-e2c6-4bca-97c2-d42e20280dcc"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:04:22.614552 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-10b4a77b-8f3b-43b6-ade7-68575ae7e2e2 req-79b7df44-8d8a-4baa-a82f-978cd547163f service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:22.615341 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-10b4a77b-8f3b-43b6-ade7-68575ae7e2e2 req-79b7df44-8d8a-4baa-a82f-978cd547163f service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:22.616066 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-10b4a77b-8f3b-43b6-ade7-68575ae7e2e2 req-79b7df44-8d8a-4baa-a82f-978cd547163f service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:22.630476 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-10b4a77b-8f3b-43b6-ade7-68575ae7e2e2 req-79b7df44-8d8a-4baa-a82f-978cd547163f service nova] Creating event network-changed:066ce620-e2c6-4bca-97c2-d42e20280dcc for instance 6ef37448-690b-4fcf-85f8-a2fb71207f38 on nch1-master-1 Oct 08 21:04:22.637174 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [req-10b4a77b-8f3b-43b6-ade7-68575ae7e2e2 req-79b7df44-8d8a-4baa-a82f-978cd547163f service nova] Instance 6ef37448-690b-4fcf-85f8-a2fb71207f38 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140492) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 08 21:04:22.639885 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-c6d13169-0bf1-4100-b1f7-0d10a5c9705b tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2e13f1952a4e5bb23d57dd7fa31875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b2a56286924e2d953bebe717ce591b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:22.651237 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-10b4a77b-8f3b-43b6-ade7-68575ae7e2e2 req-79b7df44-8d8a-4baa-a82f-978cd547163f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053051 Oct 08 21:04:22.655607 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1571/3090] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:04:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 08 21:04:22.661682 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-fdfa7a35-9390-4b4d-8740-d51aeaf0cbba tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:22.662658 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-fdfa7a35-9390-4b4d-8740-d51aeaf0cbba tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] [instance: 562434d8-1c7a-4aa4-8cb5-e5d37bf07592] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:22.670521 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fdfa7a35-9390-4b4d-8740-d51aeaf0cbba tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:22.671042 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fdfa7a35-9390-4b4d-8740-d51aeaf0cbba tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:22.671554 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fdfa7a35-9390-4b4d-8740-d51aeaf0cbba tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:22.672480 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fdfa7a35-9390-4b4d-8740-d51aeaf0cbba tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:22.673140 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fdfa7a35-9390-4b4d-8740-d51aeaf0cbba tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:22.673802 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fdfa7a35-9390-4b4d-8740-d51aeaf0cbba tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:22.675876 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-c6d13169-0bf1-4100-b1f7-0d10a5c9705b tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] 10.222.0.26 "GET /compute/v2.1/servers/136d0aa6-479d-4d9c-b633-23203ee44ae4" status: 200 len: 1507 microversion: 2.1 time: 0.388311 Oct 08 21:04:22.692338 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1520/3091] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:04:22 2022] GET /compute/v2.1/servers/136d0aa6-479d-4d9c-b633-23203ee44ae4 => generated 1507 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:04:22.833738 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-fdfa7a35-9390-4b4d-8740-d51aeaf0cbba tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07280ef2c5da4903a62092a44499f455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92d768a1a654e199e14845aab7d565b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:22.861272 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-fdfa7a35-9390-4b4d-8740-d51aeaf0cbba tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07280ef2c5da4903a62092a44499f455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92d768a1a654e199e14845aab7d565b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:22.863860 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-fdfa7a35-9390-4b4d-8740-d51aeaf0cbba tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07280ef2c5da4903a62092a44499f455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92d768a1a654e199e14845aab7d565b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:22.866451 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-fdfa7a35-9390-4b4d-8740-d51aeaf0cbba tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] 10.222.0.26 "GET /compute/v2.1/servers/562434d8-1c7a-4aa4-8cb5-e5d37bf07592" status: 200 len: 1365 microversion: 2.57 time: 0.209417 Oct 08 21:04:22.867302 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1572/3092] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:04:22 2022] GET /compute/v2.1/servers/562434d8-1c7a-4aa4-8cb5-e5d37bf07592 => generated 1365 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:04:23.022069 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-d5f1e0aa-8435-467d-b87f-54a2fc730731 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:23.022659 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-d5f1e0aa-8435-467d-b87f-54a2fc730731 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: 6ef37448-690b-4fcf-85f8-a2fb71207f38] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:23.037897 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d5f1e0aa-8435-467d-b87f-54a2fc730731 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:23.038622 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d5f1e0aa-8435-467d-b87f-54a2fc730731 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:23.039903 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d5f1e0aa-8435-467d-b87f-54a2fc730731 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:23.043036 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d5f1e0aa-8435-467d-b87f-54a2fc730731 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:23.043492 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d5f1e0aa-8435-467d-b87f-54a2fc730731 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:23.044070 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d5f1e0aa-8435-467d-b87f-54a2fc730731 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:23.552013 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-d5f1e0aa-8435-467d-b87f-54a2fc730731 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:23.568106 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-d5f1e0aa-8435-467d-b87f-54a2fc730731 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/6ef37448-690b-4fcf-85f8-a2fb71207f38" status: 200 len: 1475 microversion: 2.1 time: 0.552036 Oct 08 21:04:23.569023 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1521/3093] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:04:23 2022] GET /compute/v2.1/servers/6ef37448-690b-4fcf-85f8-a2fb71207f38 => generated 1475 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:04:23.599847 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-8093477f-c1bf-4def-9fcd-83d54d4dea0c tempest-QuotasTestJSON-444876636 tempest-QuotasTestJSON-444876636-project] Calling method '.version_select at 0x7f1a913a23a0>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:23.672143 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-8093477f-c1bf-4def-9fcd-83d54d4dea0c tempest-QuotasTestJSON-444876636 tempest-QuotasTestJSON-444876636-project] 10.222.0.26 "GET /compute/v2.1/os-quota-sets/0f79ff98437a4243817f8f931103a27e/defaults" status: 200 len: 371 microversion: 2.1 time: 0.318570 Oct 08 21:04:23.675144 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1573/3094] 10.222.0.26 () {58 vars in 1269 bytes} [Sat Oct 8 21:04:23 2022] GET /compute/v2.1/os-quota-sets/0f79ff98437a4243817f8f931103a27e/defaults => generated 371 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:04:23.688899 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-92bbb24c-2eb2-4237-b575-e308bb71096a tempest-QuotasTestJSON-444876636 tempest-QuotasTestJSON-444876636-project] Calling method '.version_select at 0x7f1a8c638310>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:23.705050 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-6998033f-a42c-4a3b-954d-b5bcc0859ca9 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:23.723024 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-6998033f-a42c-4a3b-954d-b5bcc0859ca9 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] [instance: 136d0aa6-479d-4d9c-b633-23203ee44ae4] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:23.736057 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6998033f-a42c-4a3b-954d-b5bcc0859ca9 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:23.737644 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6998033f-a42c-4a3b-954d-b5bcc0859ca9 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:23.739193 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6998033f-a42c-4a3b-954d-b5bcc0859ca9 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:23.740274 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6998033f-a42c-4a3b-954d-b5bcc0859ca9 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:23.741205 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6998033f-a42c-4a3b-954d-b5bcc0859ca9 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:23.742041 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6998033f-a42c-4a3b-954d-b5bcc0859ca9 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:23.887355 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-92bbb24c-2eb2-4237-b575-e308bb71096a tempest-QuotasTestJSON-444876636 tempest-QuotasTestJSON-444876636-project] 10.222.0.26 "GET /compute/v2.1/os-quota-sets/0f79ff98437a4243817f8f931103a27e" status: 200 len: 371 microversion: 2.1 time: 0.203106 Oct 08 21:04:23.891114 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1522/3095] 10.222.0.26 () {58 vars in 1242 bytes} [Sat Oct 8 21:04:23 2022] GET /compute/v2.1/os-quota-sets/0f79ff98437a4243817f8f931103a27e => generated 371 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:04:23.906213 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-6699e4da-aff8-4598-8e7a-ddc9434a0596 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:23.910027 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-6699e4da-aff8-4598-8e7a-ddc9434a0596 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] [instance: 562434d8-1c7a-4aa4-8cb5-e5d37bf07592] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:23.930011 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6699e4da-aff8-4598-8e7a-ddc9434a0596 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:23.933384 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6699e4da-aff8-4598-8e7a-ddc9434a0596 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:23.934153 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6699e4da-aff8-4598-8e7a-ddc9434a0596 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:23.936292 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6699e4da-aff8-4598-8e7a-ddc9434a0596 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:23.936773 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6699e4da-aff8-4598-8e7a-ddc9434a0596 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:23.938988 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6699e4da-aff8-4598-8e7a-ddc9434a0596 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:24.193966 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-6998033f-a42c-4a3b-954d-b5bcc0859ca9 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2e13f1952a4e5bb23d57dd7fa31875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b2a56286924e2d953bebe717ce591b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:24.203180 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-6998033f-a42c-4a3b-954d-b5bcc0859ca9 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] 10.222.0.26 "GET /compute/v2.1/servers/136d0aa6-479d-4d9c-b633-23203ee44ae4" status: 200 len: 1507 microversion: 2.1 time: 0.504624 Oct 08 21:04:24.210407 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1574/3096] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:04:23 2022] GET /compute/v2.1/servers/136d0aa6-479d-4d9c-b633-23203ee44ae4 => generated 1507 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:04:24.216867 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-dc1061b1-340f-4377-b2af-e5b9b61987f9 tempest-QuotasTestJSON-444876636 tempest-QuotasTestJSON-444876636-project] Calling method '.version_select at 0x7f1a8c0629d0>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:24.390577 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-6699e4da-aff8-4598-8e7a-ddc9434a0596 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07280ef2c5da4903a62092a44499f455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92d768a1a654e199e14845aab7d565b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:24.413048 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-6699e4da-aff8-4598-8e7a-ddc9434a0596 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07280ef2c5da4903a62092a44499f455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92d768a1a654e199e14845aab7d565b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:24.415003 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-6699e4da-aff8-4598-8e7a-ddc9434a0596 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07280ef2c5da4903a62092a44499f455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92d768a1a654e199e14845aab7d565b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:24.416691 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-6699e4da-aff8-4598-8e7a-ddc9434a0596 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] 10.222.0.26 "GET /compute/v2.1/servers/562434d8-1c7a-4aa4-8cb5-e5d37bf07592" status: 200 len: 1365 microversion: 2.57 time: 0.523250 Oct 08 21:04:24.419368 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1523/3097] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:04:23 2022] GET /compute/v2.1/servers/562434d8-1c7a-4aa4-8cb5-e5d37bf07592 => generated 1365 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:04:24.605815 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-dc1061b1-340f-4377-b2af-e5b9b61987f9 tempest-QuotasTestJSON-444876636 tempest-QuotasTestJSON-444876636-project] 10.222.0.26 "GET /compute/v2.1/os-quota-sets/0f79ff98437a4243817f8f931103a27e/defaults" status: 200 len: 371 microversion: 2.1 time: 0.393792 Oct 08 21:04:24.616919 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1575/3098] 10.222.0.26 () {58 vars in 1269 bytes} [Sat Oct 8 21:04:24 2022] GET /compute/v2.1/os-quota-sets/0f79ff98437a4243817f8f931103a27e/defaults => generated 371 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:04:24.623252 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-ebfa7bce-cb1b-44bc-b238-78c90f30dfb2 tempest-QuotasTestJSON-444876636 tempest-QuotasTestJSON-444876636-project] Calling method '.version_select at 0x7f1a8c062160>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:24.818790 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-382bbb8e-47b3-4c2c-bed1-38949ff689ad tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:24.819651 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-382bbb8e-47b3-4c2c-bed1-38949ff689ad tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: 6ef37448-690b-4fcf-85f8-a2fb71207f38] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:24.833401 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-382bbb8e-47b3-4c2c-bed1-38949ff689ad tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:24.834304 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-382bbb8e-47b3-4c2c-bed1-38949ff689ad tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:24.835581 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-382bbb8e-47b3-4c2c-bed1-38949ff689ad tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:24.838539 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-382bbb8e-47b3-4c2c-bed1-38949ff689ad tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:24.839473 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-382bbb8e-47b3-4c2c-bed1-38949ff689ad tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:24.840278 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-382bbb8e-47b3-4c2c-bed1-38949ff689ad tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:25.054197 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-ebfa7bce-cb1b-44bc-b238-78c90f30dfb2 tempest-QuotasTestJSON-444876636 tempest-QuotasTestJSON-444876636-project] 10.222.0.26 "GET /compute/v2.1/os-quota-sets/0f79ff98437a4243817f8f931103a27e" status: 200 len: 371 microversion: 2.1 time: 0.435260 Oct 08 21:04:25.059342 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1576/3099] 10.222.0.26 () {58 vars in 1242 bytes} [Sat Oct 8 21:04:24 2022] GET /compute/v2.1/os-quota-sets/0f79ff98437a4243817f8f931103a27e => generated 371 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:04:25.070262 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-1ff2c5d5-7727-43e0-8a0f-122a5b34b9b2 tempest-QuotasTestJSON-444876636 tempest-QuotasTestJSON-444876636-project] Calling method '.version_select at 0x7f1a8c15f4c0>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:25.389130 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-382bbb8e-47b3-4c2c-bed1-38949ff689ad tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:25.412174 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-382bbb8e-47b3-4c2c-bed1-38949ff689ad tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/6ef37448-690b-4fcf-85f8-a2fb71207f38" status: 200 len: 1473 microversion: 2.1 time: 0.820344 Oct 08 21:04:25.432487 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1524/3100] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:04:24 2022] GET /compute/v2.1/servers/6ef37448-690b-4fcf-85f8-a2fb71207f38 => generated 1473 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:04:25.442472 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-721f83fe-b0a2-45aa-861c-347a16c07788 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:25.443344 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-721f83fe-b0a2-45aa-861c-347a16c07788 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] [instance: 136d0aa6-479d-4d9c-b633-23203ee44ae4] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:25.450624 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-721f83fe-b0a2-45aa-861c-347a16c07788 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:25.452561 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-721f83fe-b0a2-45aa-861c-347a16c07788 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:25.453403 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-721f83fe-b0a2-45aa-861c-347a16c07788 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:25.454499 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-721f83fe-b0a2-45aa-861c-347a16c07788 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:25.455150 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-721f83fe-b0a2-45aa-861c-347a16c07788 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:25.457344 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-721f83fe-b0a2-45aa-861c-347a16c07788 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:25.731203 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-1ff2c5d5-7727-43e0-8a0f-122a5b34b9b2 tempest-QuotasTestJSON-444876636 tempest-QuotasTestJSON-444876636-project] 10.222.0.26 "GET /compute/v2.1/os-quota-sets/0f79ff98437a4243817f8f931103a27e?user_id=68f231eaeb554115b5499d4e27a00f79" status: 200 len: 371 microversion: 2.1 time: 0.665550 Oct 08 21:04:25.733221 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1577/3101] 10.222.0.26 () {58 vars in 1323 bytes} [Sat Oct 8 21:04:25 2022] GET /compute/v2.1/os-quota-sets/0f79ff98437a4243817f8f931103a27e?user_id=68f231eaeb554115b5499d4e27a00f79 => generated 371 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:04:25.742064 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-83eb2ad8-1d8d-4d28-abfa-499282b98c8e tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:25.748294 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-83eb2ad8-1d8d-4d28-abfa-499282b98c8e tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] [instance: 562434d8-1c7a-4aa4-8cb5-e5d37bf07592] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:25.773536 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-83eb2ad8-1d8d-4d28-abfa-499282b98c8e tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:25.776599 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-83eb2ad8-1d8d-4d28-abfa-499282b98c8e tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:25.778569 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-83eb2ad8-1d8d-4d28-abfa-499282b98c8e tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:25.779672 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-83eb2ad8-1d8d-4d28-abfa-499282b98c8e tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:25.782742 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-83eb2ad8-1d8d-4d28-abfa-499282b98c8e tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:25.784344 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-83eb2ad8-1d8d-4d28-abfa-499282b98c8e tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:26.029533 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-83eb2ad8-1d8d-4d28-abfa-499282b98c8e tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07280ef2c5da4903a62092a44499f455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92d768a1a654e199e14845aab7d565b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:26.043328 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-83eb2ad8-1d8d-4d28-abfa-499282b98c8e tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07280ef2c5da4903a62092a44499f455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92d768a1a654e199e14845aab7d565b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:26.047113 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-83eb2ad8-1d8d-4d28-abfa-499282b98c8e tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07280ef2c5da4903a62092a44499f455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92d768a1a654e199e14845aab7d565b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:26.052234 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-83eb2ad8-1d8d-4d28-abfa-499282b98c8e tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] 10.222.0.26 "GET /compute/v2.1/servers/562434d8-1c7a-4aa4-8cb5-e5d37bf07592" status: 200 len: 1365 microversion: 2.57 time: 0.316579 Oct 08 21:04:26.053536 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1578/3102] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:04:25 2022] GET /compute/v2.1/servers/562434d8-1c7a-4aa4-8cb5-e5d37bf07592 => generated 1365 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:04:26.201526 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-721f83fe-b0a2-45aa-861c-347a16c07788 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2e13f1952a4e5bb23d57dd7fa31875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b2a56286924e2d953bebe717ce591b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:26.216876 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-721f83fe-b0a2-45aa-861c-347a16c07788 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] 10.222.0.26 "GET /compute/v2.1/servers/136d0aa6-479d-4d9c-b633-23203ee44ae4" status: 200 len: 1507 microversion: 2.1 time: 0.781224 Oct 08 21:04:26.218303 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1525/3103] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:04:25 2022] GET /compute/v2.1/servers/136d0aa6-479d-4d9c-b633-23203ee44ae4 => generated 1507 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:04:26.438461 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-9f57bfe5-a6c7-4a8b-aeab-39155682567a tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:26.439313 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-9f57bfe5-a6c7-4a8b-aeab-39155682567a tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: 6ef37448-690b-4fcf-85f8-a2fb71207f38] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:26.451902 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9f57bfe5-a6c7-4a8b-aeab-39155682567a tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:26.452675 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9f57bfe5-a6c7-4a8b-aeab-39155682567a tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:26.453352 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9f57bfe5-a6c7-4a8b-aeab-39155682567a tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:26.454316 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9f57bfe5-a6c7-4a8b-aeab-39155682567a tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:26.456584 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9f57bfe5-a6c7-4a8b-aeab-39155682567a tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:26.457756 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9f57bfe5-a6c7-4a8b-aeab-39155682567a tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:26.513534 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:04:27.023204 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-9f57bfe5-a6c7-4a8b-aeab-39155682567a tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:27.036887 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-9f57bfe5-a6c7-4a8b-aeab-39155682567a tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/6ef37448-690b-4fcf-85f8-a2fb71207f38" status: 200 len: 1470 microversion: 2.1 time: 0.598771 Oct 08 21:04:27.037677 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1579/3104] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:04:26 2022] GET /compute/v2.1/servers/6ef37448-690b-4fcf-85f8-a2fb71207f38 => generated 1470 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:04:27.069465 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-cf6c3a45-2c56-4b2a-9078-b64d5cd05cb2 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:04:27.070288 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-cf6c3a45-2c56-4b2a-9078-b64d5cd05cb2 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: 6ef37448-690b-4fcf-85f8-a2fb71207f38] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:27.095384 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cf6c3a45-2c56-4b2a-9078-b64d5cd05cb2 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:27.099746 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cf6c3a45-2c56-4b2a-9078-b64d5cd05cb2 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:27.102932 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cf6c3a45-2c56-4b2a-9078-b64d5cd05cb2 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:27.104278 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cf6c3a45-2c56-4b2a-9078-b64d5cd05cb2 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:27.107672 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cf6c3a45-2c56-4b2a-9078-b64d5cd05cb2 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:27.109134 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cf6c3a45-2c56-4b2a-9078-b64d5cd05cb2 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:27.262298 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-ff41a58c-73e9-4a49-881c-50233fc0674a tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-112152610", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "networks": "none"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:04:27.390261 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-ff41a58c-73e9-4a49-881c-50233fc0674a tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Flavor limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 21:04:27.390640 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-ff41a58c-73e9-4a49-881c-50233fc0674a tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Image limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 21:04:27.391416 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-ff41a58c-73e9-4a49-881c-50233fc0674a tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Flavor pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 21:04:27.392202 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-ff41a58c-73e9-4a49-881c-50233fc0674a tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Image pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 21:04:27.394178 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-ff41a58c-73e9-4a49-881c-50233fc0674a tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 21:04:27.409609 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ff41a58c-73e9-4a49-881c-50233fc0674a tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:27.410466 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ff41a58c-73e9-4a49-881c-50233fc0674a tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:27.411346 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ff41a58c-73e9-4a49-881c-50233fc0674a tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:27.412593 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ff41a58c-73e9-4a49-881c-50233fc0674a tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:27.413522 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ff41a58c-73e9-4a49-881c-50233fc0674a tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:27.416227 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ff41a58c-73e9-4a49-881c-50233fc0674a tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:27.422253 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-cf6c3a45-2c56-4b2a-9078-b64d5cd05cb2 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "POST /compute/v2.1/servers/6ef37448-690b-4fcf-85f8-a2fb71207f38/action" status: 202 len: 0 microversion: 2.1 time: 0.361082 Oct 08 21:04:27.423481 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1580/3105] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:04:27 2022] POST /compute/v2.1/servers/6ef37448-690b-4fcf-85f8-a2fb71207f38/action => generated 0 bytes in 363 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 08 21:04:27.433034 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-6d1f3737-6fbd-440d-8d78-84d6b01317ce tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:27.446896 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-ff41a58c-73e9-4a49-881c-50233fc0674a tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Getting quotas for project 527bbe10db744ab4bcc8078f2d754d53. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:04:27.452137 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-6d1f3737-6fbd-440d-8d78-84d6b01317ce tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] [instance: 562434d8-1c7a-4aa4-8cb5-e5d37bf07592] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:27.464293 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6d1f3737-6fbd-440d-8d78-84d6b01317ce tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:27.465142 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6d1f3737-6fbd-440d-8d78-84d6b01317ce tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:27.465949 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6d1f3737-6fbd-440d-8d78-84d6b01317ce tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:27.467150 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-ff41a58c-73e9-4a49-881c-50233fc0674a tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Getting quotas for user 3245fc05926b49118c0d1028de3f09a4 and project 527bbe10db744ab4bcc8078f2d754d53. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:04:27.469425 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6d1f3737-6fbd-440d-8d78-84d6b01317ce tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:27.470355 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6d1f3737-6fbd-440d-8d78-84d6b01317ce tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:27.473021 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6d1f3737-6fbd-440d-8d78-84d6b01317ce tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:27.505914 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-ff41a58c-73e9-4a49-881c-50233fc0674a tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Going to run 1 instances... {{(pid=140491) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 21:04:27.516349 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-ff41a58c-73e9-4a49-881c-50233fc0674a tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] [instance: 4bfa24d1-ed76-495d-a52b-dab5d1a3a366] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c508bd7f-7db9-4b2c-af7c-be54a855c355',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140491) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 21:04:27.559427 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-6d1f3737-6fbd-440d-8d78-84d6b01317ce tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07280ef2c5da4903a62092a44499f455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92d768a1a654e199e14845aab7d565b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:27.574047 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-6d1f3737-6fbd-440d-8d78-84d6b01317ce tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07280ef2c5da4903a62092a44499f455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92d768a1a654e199e14845aab7d565b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:27.576618 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-6d1f3737-6fbd-440d-8d78-84d6b01317ce tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07280ef2c5da4903a62092a44499f455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92d768a1a654e199e14845aab7d565b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:27.578074 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-6d1f3737-6fbd-440d-8d78-84d6b01317ce tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] 10.222.0.26 "GET /compute/v2.1/servers/562434d8-1c7a-4aa4-8cb5-e5d37bf07592" status: 200 len: 1365 microversion: 2.57 time: 0.152710 Oct 08 21:04:27.578877 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1581/3106] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:04:27 2022] GET /compute/v2.1/servers/562434d8-1c7a-4aa4-8cb5-e5d37bf07592 => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:04:27.584836 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-4afe9e3d-4bc3-42c6-a7f8-be23afbe9815 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:27.585754 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-4afe9e3d-4bc3-42c6-a7f8-be23afbe9815 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] [instance: 136d0aa6-479d-4d9c-b633-23203ee44ae4] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:27.593011 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4afe9e3d-4bc3-42c6-a7f8-be23afbe9815 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:27.593788 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4afe9e3d-4bc3-42c6-a7f8-be23afbe9815 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:27.594460 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4afe9e3d-4bc3-42c6-a7f8-be23afbe9815 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:27.595267 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-ff41a58c-73e9-4a49-881c-50233fc0674a tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.758962 Oct 08 21:04:27.595599 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4afe9e3d-4bc3-42c6-a7f8-be23afbe9815 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:27.596515 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1526/3107] 10.222.0.26 () {62 vars in 1188 bytes} [Sat Oct 8 21:04:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 761 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 08 21:04:27.597374 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4afe9e3d-4bc3-42c6-a7f8-be23afbe9815 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:27.598016 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4afe9e3d-4bc3-42c6-a7f8-be23afbe9815 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:27.613403 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-7f0202bf-5a82-4f88-b6a8-1c03c56b5f36 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:27.614381 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-7f0202bf-5a82-4f88-b6a8-1c03c56b5f36 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: 6ef37448-690b-4fcf-85f8-a2fb71207f38] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:27.632014 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7f0202bf-5a82-4f88-b6a8-1c03c56b5f36 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:27.633689 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7f0202bf-5a82-4f88-b6a8-1c03c56b5f36 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:27.635274 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7f0202bf-5a82-4f88-b6a8-1c03c56b5f36 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:27.639819 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7f0202bf-5a82-4f88-b6a8-1c03c56b5f36 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:27.640506 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7f0202bf-5a82-4f88-b6a8-1c03c56b5f36 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:27.641795 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7f0202bf-5a82-4f88-b6a8-1c03c56b5f36 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:28.209500 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-7f0202bf-5a82-4f88-b6a8-1c03c56b5f36 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:28.227068 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-7f0202bf-5a82-4f88-b6a8-1c03c56b5f36 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/6ef37448-690b-4fcf-85f8-a2fb71207f38" status: 200 len: 1469 microversion: 2.1 time: 0.622830 Oct 08 21:04:28.241447 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-4afe9e3d-4bc3-42c6-a7f8-be23afbe9815 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2e13f1952a4e5bb23d57dd7fa31875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b2a56286924e2d953bebe717ce591b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:28.250648 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1527/3108] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:04:27 2022] GET /compute/v2.1/servers/6ef37448-690b-4fcf-85f8-a2fb71207f38 => generated 1469 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:04:28.264833 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-4afe9e3d-4bc3-42c6-a7f8-be23afbe9815 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] 10.222.0.26 "GET /compute/v2.1/servers/136d0aa6-479d-4d9c-b633-23203ee44ae4" status: 200 len: 1507 microversion: 2.1 time: 0.683792 Oct 08 21:04:28.264983 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-31a0e0ca-f6bc-4259-8350-ec3d09b490e1 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:28.265526 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1582/3109] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:04:27 2022] GET /compute/v2.1/servers/136d0aa6-479d-4d9c-b633-23203ee44ae4 => generated 1507 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:04:28.277766 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-31a0e0ca-f6bc-4259-8350-ec3d09b490e1 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] [instance: 4bfa24d1-ed76-495d-a52b-dab5d1a3a366] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:28.564381 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-31a0e0ca-f6bc-4259-8350-ec3d09b490e1 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3245fc05926b49118c0d1028de3f09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527bbe10db744ab4bcc8078f2d754d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:28.577425 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-31a0e0ca-f6bc-4259-8350-ec3d09b490e1 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3245fc05926b49118c0d1028de3f09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527bbe10db744ab4bcc8078f2d754d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:28.578878 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-31a0e0ca-f6bc-4259-8350-ec3d09b490e1 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3245fc05926b49118c0d1028de3f09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527bbe10db744ab4bcc8078f2d754d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:28.580025 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-31a0e0ca-f6bc-4259-8350-ec3d09b490e1 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] 10.222.0.26 "GET /compute/v2.1/servers/4bfa24d1-ed76-495d-a52b-dab5d1a3a366" status: 200 len: 1277 microversion: 2.47 time: 0.328128 Oct 08 21:04:28.581273 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1528/3110] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:04:28 2022] GET /compute/v2.1/servers/4bfa24d1-ed76-495d-a52b-dab5d1a3a366 => generated 1277 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:04:28.610503 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-138e8bcc-4179-4ca0-a515-927ebe45174b tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:28.611133 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-138e8bcc-4179-4ca0-a515-927ebe45174b tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] [instance: 562434d8-1c7a-4aa4-8cb5-e5d37bf07592] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:28.625941 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-138e8bcc-4179-4ca0-a515-927ebe45174b tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:28.626632 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-138e8bcc-4179-4ca0-a515-927ebe45174b tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:28.626896 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-138e8bcc-4179-4ca0-a515-927ebe45174b tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:28.628156 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-138e8bcc-4179-4ca0-a515-927ebe45174b tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:28.628631 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-138e8bcc-4179-4ca0-a515-927ebe45174b tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:28.629074 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-138e8bcc-4179-4ca0-a515-927ebe45174b tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:28.680869 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-6407ee90-2077-473b-8373-ccc5924a2164 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-693249702", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "networks": "none"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:04:28.753718 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-6407ee90-2077-473b-8373-ccc5924a2164 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Flavor limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 21:04:28.754170 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-6407ee90-2077-473b-8373-ccc5924a2164 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Image limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 21:04:28.756456 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-6407ee90-2077-473b-8373-ccc5924a2164 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Flavor pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 21:04:28.757360 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-6407ee90-2077-473b-8373-ccc5924a2164 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Image pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 21:04:28.759538 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-6407ee90-2077-473b-8373-ccc5924a2164 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 21:04:28.778571 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6407ee90-2077-473b-8373-ccc5924a2164 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:28.780774 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6407ee90-2077-473b-8373-ccc5924a2164 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:28.782707 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6407ee90-2077-473b-8373-ccc5924a2164 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:28.799514 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6407ee90-2077-473b-8373-ccc5924a2164 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:28.808101 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6407ee90-2077-473b-8373-ccc5924a2164 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:28.810540 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6407ee90-2077-473b-8373-ccc5924a2164 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:28.884861 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-138e8bcc-4179-4ca0-a515-927ebe45174b tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07280ef2c5da4903a62092a44499f455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92d768a1a654e199e14845aab7d565b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:28.886540 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-6407ee90-2077-473b-8373-ccc5924a2164 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Getting quotas for project 527bbe10db744ab4bcc8078f2d754d53. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:04:28.896138 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-138e8bcc-4179-4ca0-a515-927ebe45174b tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07280ef2c5da4903a62092a44499f455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92d768a1a654e199e14845aab7d565b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:28.902731 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-138e8bcc-4179-4ca0-a515-927ebe45174b tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07280ef2c5da4903a62092a44499f455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92d768a1a654e199e14845aab7d565b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:28.909080 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-138e8bcc-4179-4ca0-a515-927ebe45174b tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] 10.222.0.26 "GET /compute/v2.1/servers/562434d8-1c7a-4aa4-8cb5-e5d37bf07592" status: 200 len: 1365 microversion: 2.57 time: 0.303988 Oct 08 21:04:28.910189 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1583/3111] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:04:28 2022] GET /compute/v2.1/servers/562434d8-1c7a-4aa4-8cb5-e5d37bf07592 => generated 1365 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:04:28.947024 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-6407ee90-2077-473b-8373-ccc5924a2164 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Getting quotas for user 3245fc05926b49118c0d1028de3f09a4 and project 527bbe10db744ab4bcc8078f2d754d53. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:04:29.007679 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-6407ee90-2077-473b-8373-ccc5924a2164 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Going to run 1 instances... {{(pid=140491) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 21:04:29.019337 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-6407ee90-2077-473b-8373-ccc5924a2164 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] [instance: 93b29a96-2b64-46bd-b6ab-fd44e6599d8f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c508bd7f-7db9-4b2c-af7c-be54a855c355',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140491) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 21:04:29.172543 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:04:29.228659 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-6407ee90-2077-473b-8373-ccc5924a2164 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.549851 Oct 08 21:04:29.237749 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1529/3112] 10.222.0.26 () {62 vars in 1188 bytes} [Sat Oct 8 21:04:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 556 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 08 21:04:29.243929 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-b88fd4b4-1188-443c-bdb5-8917f523b5cb tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:04:29.246486 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-b88fd4b4-1188-443c-bdb5-8917f523b5cb tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] [instance: 93b29a96-2b64-46bd-b6ab-fd44e6599d8f] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:29.259633 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-43ef53fd-be10-4132-9264-ef4406937147 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:29.260630 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-43ef53fd-be10-4132-9264-ef4406937147 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: 6ef37448-690b-4fcf-85f8-a2fb71207f38] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:29.273065 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-43ef53fd-be10-4132-9264-ef4406937147 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:29.278064 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-43ef53fd-be10-4132-9264-ef4406937147 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:29.281432 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-43ef53fd-be10-4132-9264-ef4406937147 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:29.285634 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-43ef53fd-be10-4132-9264-ef4406937147 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:29.287705 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-43ef53fd-be10-4132-9264-ef4406937147 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:29.288437 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-43ef53fd-be10-4132-9264-ef4406937147 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:29.431722 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-b88fd4b4-1188-443c-bdb5-8917f523b5cb tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] 10.222.0.26 "PUT /compute/v2.1/servers/93b29a96-2b64-46bd-b6ab-fd44e6599d8f" status: 200 len: 991 microversion: 2.47 time: 0.192822 Oct 08 21:04:29.445866 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1584/3113] 10.222.0.26 () {62 vars in 1297 bytes} [Sat Oct 8 21:04:29 2022] PUT /compute/v2.1/servers/93b29a96-2b64-46bd-b6ab-fd44e6599d8f => generated 991 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 08 21:04:29.474104 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-387ff5da-b059-4767-b09b-fbd56bf7df5a tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:29.478247 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-387ff5da-b059-4767-b09b-fbd56bf7df5a tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] [instance: 136d0aa6-479d-4d9c-b633-23203ee44ae4] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:29.513631 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-387ff5da-b059-4767-b09b-fbd56bf7df5a tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:29.514242 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-387ff5da-b059-4767-b09b-fbd56bf7df5a tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:29.515758 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-387ff5da-b059-4767-b09b-fbd56bf7df5a tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:29.516535 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-387ff5da-b059-4767-b09b-fbd56bf7df5a tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:29.517013 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-387ff5da-b059-4767-b09b-fbd56bf7df5a tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:29.517486 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-387ff5da-b059-4767-b09b-fbd56bf7df5a tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:29.994524 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-387ff5da-b059-4767-b09b-fbd56bf7df5a tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2e13f1952a4e5bb23d57dd7fa31875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b2a56286924e2d953bebe717ce591b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:30.006011 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-387ff5da-b059-4767-b09b-fbd56bf7df5a tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] 10.222.0.26 "GET /compute/v2.1/servers/136d0aa6-479d-4d9c-b633-23203ee44ae4" status: 200 len: 1507 microversion: 2.1 time: 0.557709 Oct 08 21:04:30.006613 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1585/3114] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:04:29 2022] GET /compute/v2.1/servers/136d0aa6-479d-4d9c-b633-23203ee44ae4 => generated 1507 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:04:30.043012 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-4a60b1fc-14e9-427b-9b95-d35c851f91f6 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:30.043661 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-4a60b1fc-14e9-427b-9b95-d35c851f91f6 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] [instance: 93b29a96-2b64-46bd-b6ab-fd44e6599d8f] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:30.131351 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-43ef53fd-be10-4132-9264-ef4406937147 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:30.149028 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-43ef53fd-be10-4132-9264-ef4406937147 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/6ef37448-690b-4fcf-85f8-a2fb71207f38" status: 200 len: 1469 microversion: 2.1 time: 0.897232 Oct 08 21:04:30.149696 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1530/3115] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:04:29 2022] GET /compute/v2.1/servers/6ef37448-690b-4fcf-85f8-a2fb71207f38 => generated 1469 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:04:30.176432 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-881b68b4-dd41-4692-bb51-b5e73b8fce9d req-b7682b81-b338-4f1c-a50d-f632dcd4d23e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ef37448-690b-4fcf-85f8-a2fb71207f38", "name": "network-vif-plugged", "status": "completed", "tag": "066ce620-e2c6-4bca-97c2-d42e20280dcc"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:04:30.191076 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-4a60b1fc-14e9-427b-9b95-d35c851f91f6 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3245fc05926b49118c0d1028de3f09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527bbe10db744ab4bcc8078f2d754d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:30.199085 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-4a60b1fc-14e9-427b-9b95-d35c851f91f6 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3245fc05926b49118c0d1028de3f09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527bbe10db744ab4bcc8078f2d754d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:30.207643 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-881b68b4-dd41-4692-bb51-b5e73b8fce9d req-b7682b81-b338-4f1c-a50d-f632dcd4d23e service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:30.208535 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-4a60b1fc-14e9-427b-9b95-d35c851f91f6 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3245fc05926b49118c0d1028de3f09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527bbe10db744ab4bcc8078f2d754d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:30.209617 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-881b68b4-dd41-4692-bb51-b5e73b8fce9d req-b7682b81-b338-4f1c-a50d-f632dcd4d23e service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:30.211031 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-4a60b1fc-14e9-427b-9b95-d35c851f91f6 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] 10.222.0.26 "GET /compute/v2.1/servers/93b29a96-2b64-46bd-b6ab-fd44e6599d8f" status: 200 len: 1277 microversion: 2.47 time: 0.186874 Oct 08 21:04:30.211512 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-881b68b4-dd41-4692-bb51-b5e73b8fce9d req-b7682b81-b338-4f1c-a50d-f632dcd4d23e service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:30.214959 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1586/3116] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:04:30 2022] GET /compute/v2.1/servers/93b29a96-2b64-46bd-b6ab-fd44e6599d8f => generated 1277 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:04:30.243735 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-881b68b4-dd41-4692-bb51-b5e73b8fce9d req-b7682b81-b338-4f1c-a50d-f632dcd4d23e service nova] Creating event network-vif-plugged:066ce620-e2c6-4bca-97c2-d42e20280dcc for instance 6ef37448-690b-4fcf-85f8-a2fb71207f38 on nch1-master-1 Oct 08 21:04:30.247603 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-c3735913-0439-44fd-ad9e-666b67084ccf tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:30.253257 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-c3735913-0439-44fd-ad9e-666b67084ccf tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] [instance: 562434d8-1c7a-4aa4-8cb5-e5d37bf07592] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:30.261373 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [req-881b68b4-dd41-4692-bb51-b5e73b8fce9d req-b7682b81-b338-4f1c-a50d-f632dcd4d23e service nova] Instance 6ef37448-690b-4fcf-85f8-a2fb71207f38 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140491) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 08 21:04:30.274980 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c3735913-0439-44fd-ad9e-666b67084ccf tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:30.275500 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c3735913-0439-44fd-ad9e-666b67084ccf tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:30.275959 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c3735913-0439-44fd-ad9e-666b67084ccf tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:30.276713 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c3735913-0439-44fd-ad9e-666b67084ccf tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:30.277209 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c3735913-0439-44fd-ad9e-666b67084ccf tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:30.283417 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c3735913-0439-44fd-ad9e-666b67084ccf tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:30.284672 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-881b68b4-dd41-4692-bb51-b5e73b8fce9d req-b7682b81-b338-4f1c-a50d-f632dcd4d23e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125774 Oct 08 21:04:30.289974 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1531/3117] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:04:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:04:30.511232 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-c3735913-0439-44fd-ad9e-666b67084ccf tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07280ef2c5da4903a62092a44499f455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92d768a1a654e199e14845aab7d565b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:30.520813 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-c3735913-0439-44fd-ad9e-666b67084ccf tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07280ef2c5da4903a62092a44499f455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92d768a1a654e199e14845aab7d565b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:30.526819 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-c3735913-0439-44fd-ad9e-666b67084ccf tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07280ef2c5da4903a62092a44499f455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92d768a1a654e199e14845aab7d565b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:30.536506 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-c3735913-0439-44fd-ad9e-666b67084ccf tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] 10.222.0.26 "GET /compute/v2.1/servers/562434d8-1c7a-4aa4-8cb5-e5d37bf07592" status: 200 len: 1365 microversion: 2.57 time: 0.318656 Oct 08 21:04:30.558757 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1587/3118] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:04:30 2022] GET /compute/v2.1/servers/562434d8-1c7a-4aa4-8cb5-e5d37bf07592 => generated 1365 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:04:31.034704 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-e612c77f-20e4-4410-9d25-79ffebeac3b3 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:31.035436 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-e612c77f-20e4-4410-9d25-79ffebeac3b3 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] [instance: 136d0aa6-479d-4d9c-b633-23203ee44ae4] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:31.063981 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e612c77f-20e4-4410-9d25-79ffebeac3b3 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:31.065242 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e612c77f-20e4-4410-9d25-79ffebeac3b3 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:31.070834 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e612c77f-20e4-4410-9d25-79ffebeac3b3 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:31.071708 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e612c77f-20e4-4410-9d25-79ffebeac3b3 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:31.072207 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e612c77f-20e4-4410-9d25-79ffebeac3b3 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:31.076025 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e612c77f-20e4-4410-9d25-79ffebeac3b3 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:31.175689 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-149a1d72-4d12-42f3-b5c6-c69a7f4a2f95 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:31.176564 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-149a1d72-4d12-42f3-b5c6-c69a7f4a2f95 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: 6ef37448-690b-4fcf-85f8-a2fb71207f38] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:31.184039 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-149a1d72-4d12-42f3-b5c6-c69a7f4a2f95 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:31.184816 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-149a1d72-4d12-42f3-b5c6-c69a7f4a2f95 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:31.185714 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-149a1d72-4d12-42f3-b5c6-c69a7f4a2f95 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:31.186689 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-149a1d72-4d12-42f3-b5c6-c69a7f4a2f95 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:31.187382 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-149a1d72-4d12-42f3-b5c6-c69a7f4a2f95 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:31.188609 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-149a1d72-4d12-42f3-b5c6-c69a7f4a2f95 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:31.683000 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-149a1d72-4d12-42f3-b5c6-c69a7f4a2f95 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:31.701783 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-149a1d72-4d12-42f3-b5c6-c69a7f4a2f95 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/6ef37448-690b-4fcf-85f8-a2fb71207f38" status: 200 len: 1469 microversion: 2.1 time: 0.530994 Oct 08 21:04:31.703061 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1588/3119] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:04:31 2022] GET /compute/v2.1/servers/6ef37448-690b-4fcf-85f8-a2fb71207f38 => generated 1469 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:04:31.752033 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-a317e601-05a3-4f41-bbfb-775f251dbf28 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:31.753842 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-a317e601-05a3-4f41-bbfb-775f251dbf28 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] [instance: 93b29a96-2b64-46bd-b6ab-fd44e6599d8f] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:31.767109 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a317e601-05a3-4f41-bbfb-775f251dbf28 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:31.773602 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a317e601-05a3-4f41-bbfb-775f251dbf28 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:31.774185 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a317e601-05a3-4f41-bbfb-775f251dbf28 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:31.775199 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a317e601-05a3-4f41-bbfb-775f251dbf28 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:31.792622 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-e612c77f-20e4-4410-9d25-79ffebeac3b3 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2e13f1952a4e5bb23d57dd7fa31875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b2a56286924e2d953bebe717ce591b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:31.803166 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a317e601-05a3-4f41-bbfb-775f251dbf28 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:31.810806 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-e612c77f-20e4-4410-9d25-79ffebeac3b3 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] 10.222.0.26 "GET /compute/v2.1/servers/136d0aa6-479d-4d9c-b633-23203ee44ae4" status: 200 len: 1507 microversion: 2.1 time: 0.775491 Oct 08 21:04:31.815740 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a317e601-05a3-4f41-bbfb-775f251dbf28 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:31.829590 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1532/3120] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:04:31 2022] GET /compute/v2.1/servers/136d0aa6-479d-4d9c-b633-23203ee44ae4 => generated 1507 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:04:31.837728 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-041de592-96ea-449c-880d-69ee55514bd3 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:31.838668 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-041de592-96ea-449c-880d-69ee55514bd3 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] [instance: 562434d8-1c7a-4aa4-8cb5-e5d37bf07592] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:31.858224 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-041de592-96ea-449c-880d-69ee55514bd3 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:31.859221 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-041de592-96ea-449c-880d-69ee55514bd3 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:31.860239 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-041de592-96ea-449c-880d-69ee55514bd3 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:31.861562 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-041de592-96ea-449c-880d-69ee55514bd3 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:31.862496 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-041de592-96ea-449c-880d-69ee55514bd3 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:31.863278 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-041de592-96ea-449c-880d-69ee55514bd3 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:32.051941 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-a317e601-05a3-4f41-bbfb-775f251dbf28 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3245fc05926b49118c0d1028de3f09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527bbe10db744ab4bcc8078f2d754d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:32.068788 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-a317e601-05a3-4f41-bbfb-775f251dbf28 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3245fc05926b49118c0d1028de3f09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527bbe10db744ab4bcc8078f2d754d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:32.071023 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-a317e601-05a3-4f41-bbfb-775f251dbf28 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3245fc05926b49118c0d1028de3f09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527bbe10db744ab4bcc8078f2d754d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:32.072588 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-a317e601-05a3-4f41-bbfb-775f251dbf28 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] 10.222.0.26 "GET /compute/v2.1/servers/93b29a96-2b64-46bd-b6ab-fd44e6599d8f" status: 200 len: 1337 microversion: 2.47 time: 0.367740 Oct 08 21:04:32.073815 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1589/3121] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:04:31 2022] GET /compute/v2.1/servers/93b29a96-2b64-46bd-b6ab-fd44e6599d8f => generated 1337 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:04:32.570919 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-041de592-96ea-449c-880d-69ee55514bd3 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07280ef2c5da4903a62092a44499f455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92d768a1a654e199e14845aab7d565b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:32.605908 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-041de592-96ea-449c-880d-69ee55514bd3 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07280ef2c5da4903a62092a44499f455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92d768a1a654e199e14845aab7d565b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:32.608498 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-041de592-96ea-449c-880d-69ee55514bd3 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07280ef2c5da4903a62092a44499f455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92d768a1a654e199e14845aab7d565b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:32.611131 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-041de592-96ea-449c-880d-69ee55514bd3 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] 10.222.0.26 "GET /compute/v2.1/servers/562434d8-1c7a-4aa4-8cb5-e5d37bf07592" status: 200 len: 1365 microversion: 2.57 time: 0.778566 Oct 08 21:04:32.624984 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1533/3122] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:04:31 2022] GET /compute/v2.1/servers/562434d8-1c7a-4aa4-8cb5-e5d37bf07592 => generated 1365 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:04:32.730609 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-21ec7f69-d032-4eb4-9eb8-4699bbbbeaf2 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:32.731544 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-21ec7f69-d032-4eb4-9eb8-4699bbbbeaf2 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: 6ef37448-690b-4fcf-85f8-a2fb71207f38] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:32.743381 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-21ec7f69-d032-4eb4-9eb8-4699bbbbeaf2 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:32.744201 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-21ec7f69-d032-4eb4-9eb8-4699bbbbeaf2 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:32.744817 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-21ec7f69-d032-4eb4-9eb8-4699bbbbeaf2 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:32.745830 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-21ec7f69-d032-4eb4-9eb8-4699bbbbeaf2 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:32.746468 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-21ec7f69-d032-4eb4-9eb8-4699bbbbeaf2 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:32.747698 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-21ec7f69-d032-4eb4-9eb8-4699bbbbeaf2 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:32.854255 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-2c4a14b4-af62-486f-bc8c-9b90013574b0 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:32.855044 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-2c4a14b4-af62-486f-bc8c-9b90013574b0 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] [instance: 136d0aa6-479d-4d9c-b633-23203ee44ae4] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:32.862876 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2c4a14b4-af62-486f-bc8c-9b90013574b0 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:32.866137 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2c4a14b4-af62-486f-bc8c-9b90013574b0 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:32.866829 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2c4a14b4-af62-486f-bc8c-9b90013574b0 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:32.867834 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2c4a14b4-af62-486f-bc8c-9b90013574b0 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:32.868553 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2c4a14b4-af62-486f-bc8c-9b90013574b0 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:32.870086 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2c4a14b4-af62-486f-bc8c-9b90013574b0 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:33.217945 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-21ec7f69-d032-4eb4-9eb8-4699bbbbeaf2 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:33.268784 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-21ec7f69-d032-4eb4-9eb8-4699bbbbeaf2 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/6ef37448-690b-4fcf-85f8-a2fb71207f38" status: 200 len: 1469 microversion: 2.1 time: 0.538216 Oct 08 21:04:33.271328 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1590/3123] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:04:32 2022] GET /compute/v2.1/servers/6ef37448-690b-4fcf-85f8-a2fb71207f38 => generated 1469 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:04:33.282403 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-a20509d1-086c-425b-909b-9415e3b74233 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:33.284024 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-a20509d1-086c-425b-909b-9415e3b74233 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] [instance: 93b29a96-2b64-46bd-b6ab-fd44e6599d8f] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:33.316831 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a20509d1-086c-425b-909b-9415e3b74233 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:33.317481 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a20509d1-086c-425b-909b-9415e3b74233 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:33.317987 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a20509d1-086c-425b-909b-9415e3b74233 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:33.318963 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a20509d1-086c-425b-909b-9415e3b74233 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:33.319583 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a20509d1-086c-425b-909b-9415e3b74233 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:33.320161 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a20509d1-086c-425b-909b-9415e3b74233 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:33.444659 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-2c4a14b4-af62-486f-bc8c-9b90013574b0 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2e13f1952a4e5bb23d57dd7fa31875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b2a56286924e2d953bebe717ce591b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:33.480241 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-2c4a14b4-af62-486f-bc8c-9b90013574b0 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] 10.222.0.26 "GET /compute/v2.1/servers/136d0aa6-479d-4d9c-b633-23203ee44ae4" status: 200 len: 1507 microversion: 2.1 time: 0.628806 Oct 08 21:04:33.486290 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1534/3124] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:04:32 2022] GET /compute/v2.1/servers/136d0aa6-479d-4d9c-b633-23203ee44ae4 => generated 1507 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:04:33.660488 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-2284a985-c679-4fd2-bc65-678b5fb8f0de tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:33.661754 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-2284a985-c679-4fd2-bc65-678b5fb8f0de tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] [instance: 562434d8-1c7a-4aa4-8cb5-e5d37bf07592] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:33.681339 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2284a985-c679-4fd2-bc65-678b5fb8f0de tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:33.684139 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2284a985-c679-4fd2-bc65-678b5fb8f0de tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:33.690725 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2284a985-c679-4fd2-bc65-678b5fb8f0de tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:33.691749 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2284a985-c679-4fd2-bc65-678b5fb8f0de tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:33.692381 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2284a985-c679-4fd2-bc65-678b5fb8f0de tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:33.692966 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2284a985-c679-4fd2-bc65-678b5fb8f0de tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:33.939125 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-2284a985-c679-4fd2-bc65-678b5fb8f0de tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07280ef2c5da4903a62092a44499f455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92d768a1a654e199e14845aab7d565b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:33.959764 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-a20509d1-086c-425b-909b-9415e3b74233 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3245fc05926b49118c0d1028de3f09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527bbe10db744ab4bcc8078f2d754d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:33.971882 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-a20509d1-086c-425b-909b-9415e3b74233 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3245fc05926b49118c0d1028de3f09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527bbe10db744ab4bcc8078f2d754d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:33.973063 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-2284a985-c679-4fd2-bc65-678b5fb8f0de tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07280ef2c5da4903a62092a44499f455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92d768a1a654e199e14845aab7d565b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:33.976349 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-2284a985-c679-4fd2-bc65-678b5fb8f0de tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07280ef2c5da4903a62092a44499f455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92d768a1a654e199e14845aab7d565b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:33.981484 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-2284a985-c679-4fd2-bc65-678b5fb8f0de tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] 10.222.0.26 "GET /compute/v2.1/servers/562434d8-1c7a-4aa4-8cb5-e5d37bf07592" status: 200 len: 1365 microversion: 2.57 time: 0.338020 Oct 08 21:04:33.982783 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1535/3125] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:04:33 2022] GET /compute/v2.1/servers/562434d8-1c7a-4aa4-8cb5-e5d37bf07592 => generated 1365 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:04:33.988164 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-a20509d1-086c-425b-909b-9415e3b74233 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3245fc05926b49118c0d1028de3f09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527bbe10db744ab4bcc8078f2d754d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:33.989447 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-a20509d1-086c-425b-909b-9415e3b74233 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] 10.222.0.26 "GET /compute/v2.1/servers/93b29a96-2b64-46bd-b6ab-fd44e6599d8f" status: 200 len: 1335 microversion: 2.47 time: 0.716830 Oct 08 21:04:34.006657 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1591/3126] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:04:33 2022] GET /compute/v2.1/servers/93b29a96-2b64-46bd-b6ab-fd44e6599d8f => generated 1335 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:04:34.298155 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-d2b3d76b-0419-43f2-ab69-81552751e128 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:34.299843 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-d2b3d76b-0419-43f2-ab69-81552751e128 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: 6ef37448-690b-4fcf-85f8-a2fb71207f38] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:34.313225 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d2b3d76b-0419-43f2-ab69-81552751e128 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:34.314093 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d2b3d76b-0419-43f2-ab69-81552751e128 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:34.315307 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d2b3d76b-0419-43f2-ab69-81552751e128 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:34.320033 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d2b3d76b-0419-43f2-ab69-81552751e128 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:34.320826 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d2b3d76b-0419-43f2-ab69-81552751e128 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:34.321502 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d2b3d76b-0419-43f2-ab69-81552751e128 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:34.325292 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=100 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:04:34.511302 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-d6706d32-d316-48a8-95f7-ec6fb4d4b732 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:34.511928 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-d6706d32-d316-48a8-95f7-ec6fb4d4b732 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] [instance: 136d0aa6-479d-4d9c-b633-23203ee44ae4] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:34.520886 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d6706d32-d316-48a8-95f7-ec6fb4d4b732 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:34.524635 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d6706d32-d316-48a8-95f7-ec6fb4d4b732 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:34.525431 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d6706d32-d316-48a8-95f7-ec6fb4d4b732 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:34.528311 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d6706d32-d316-48a8-95f7-ec6fb4d4b732 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:34.529349 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d6706d32-d316-48a8-95f7-ec6fb4d4b732 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:34.529995 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d6706d32-d316-48a8-95f7-ec6fb4d4b732 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:34.933816 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-d2b3d76b-0419-43f2-ab69-81552751e128 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:34.975670 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-d2b3d76b-0419-43f2-ab69-81552751e128 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/6ef37448-690b-4fcf-85f8-a2fb71207f38" status: 200 len: 1469 microversion: 2.1 time: 0.681340 Oct 08 21:04:34.985754 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1536/3127] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:04:34 2022] GET /compute/v2.1/servers/6ef37448-690b-4fcf-85f8-a2fb71207f38 => generated 1469 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:04:35.011932 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-656a84b8-1db6-4ce9-b16a-3556a68f6cbc tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:35.012774 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-656a84b8-1db6-4ce9-b16a-3556a68f6cbc tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] [instance: 562434d8-1c7a-4aa4-8cb5-e5d37bf07592] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:35.027913 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-656a84b8-1db6-4ce9-b16a-3556a68f6cbc tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:35.066089 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-656a84b8-1db6-4ce9-b16a-3556a68f6cbc tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:35.067029 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-656a84b8-1db6-4ce9-b16a-3556a68f6cbc tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.038s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:35.072313 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-d6706d32-d316-48a8-95f7-ec6fb4d4b732 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2e13f1952a4e5bb23d57dd7fa31875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b2a56286924e2d953bebe717ce591b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:35.095649 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-656a84b8-1db6-4ce9-b16a-3556a68f6cbc tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:35.103208 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-656a84b8-1db6-4ce9-b16a-3556a68f6cbc tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:35.105431 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-656a84b8-1db6-4ce9-b16a-3556a68f6cbc tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:35.108476 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-d6706d32-d316-48a8-95f7-ec6fb4d4b732 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] 10.222.0.26 "GET /compute/v2.1/servers/136d0aa6-479d-4d9c-b633-23203ee44ae4" status: 200 len: 1487 microversion: 2.1 time: 0.598916 Oct 08 21:04:35.112199 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1592/3128] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:04:34 2022] GET /compute/v2.1/servers/136d0aa6-479d-4d9c-b633-23203ee44ae4 => generated 1487 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:04:35.125012 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-3430c961-cb2b-42de-9ad1-923cbdaf407a tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:35.129810 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-3430c961-cb2b-42de-9ad1-923cbdaf407a tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] [instance: 93b29a96-2b64-46bd-b6ab-fd44e6599d8f] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:35.168026 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3430c961-cb2b-42de-9ad1-923cbdaf407a tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:35.168658 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3430c961-cb2b-42de-9ad1-923cbdaf407a tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:35.172517 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3430c961-cb2b-42de-9ad1-923cbdaf407a tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:35.173547 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3430c961-cb2b-42de-9ad1-923cbdaf407a tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:35.174689 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3430c961-cb2b-42de-9ad1-923cbdaf407a tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:35.175992 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3430c961-cb2b-42de-9ad1-923cbdaf407a tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:35.404313 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-3430c961-cb2b-42de-9ad1-923cbdaf407a tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3245fc05926b49118c0d1028de3f09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527bbe10db744ab4bcc8078f2d754d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:35.420973 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-3430c961-cb2b-42de-9ad1-923cbdaf407a tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3245fc05926b49118c0d1028de3f09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527bbe10db744ab4bcc8078f2d754d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:35.427763 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-3430c961-cb2b-42de-9ad1-923cbdaf407a tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3245fc05926b49118c0d1028de3f09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527bbe10db744ab4bcc8078f2d754d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:35.429482 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-3430c961-cb2b-42de-9ad1-923cbdaf407a tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] 10.222.0.26 "GET /compute/v2.1/servers/93b29a96-2b64-46bd-b6ab-fd44e6599d8f" status: 200 len: 1335 microversion: 2.47 time: 0.315747 Oct 08 21:04:35.450803 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1593/3129] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:04:35 2022] GET /compute/v2.1/servers/93b29a96-2b64-46bd-b6ab-fd44e6599d8f => generated 1335 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:04:35.461294 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-969b940a-4659-45b1-8238-6ea224d76863 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:04:35.466431 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-969b940a-4659-45b1-8238-6ea224d76863 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] [instance: 136d0aa6-479d-4d9c-b633-23203ee44ae4] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:35.498810 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-969b940a-4659-45b1-8238-6ea224d76863 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:35.499776 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-969b940a-4659-45b1-8238-6ea224d76863 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:35.500480 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-969b940a-4659-45b1-8238-6ea224d76863 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:35.501655 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-969b940a-4659-45b1-8238-6ea224d76863 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:35.502670 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-656a84b8-1db6-4ce9-b16a-3556a68f6cbc tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07280ef2c5da4903a62092a44499f455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92d768a1a654e199e14845aab7d565b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:35.503262 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-969b940a-4659-45b1-8238-6ea224d76863 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:35.503909 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-969b940a-4659-45b1-8238-6ea224d76863 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:35.521857 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-656a84b8-1db6-4ce9-b16a-3556a68f6cbc tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07280ef2c5da4903a62092a44499f455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92d768a1a654e199e14845aab7d565b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:35.523333 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-656a84b8-1db6-4ce9-b16a-3556a68f6cbc tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07280ef2c5da4903a62092a44499f455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92d768a1a654e199e14845aab7d565b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:35.539300 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-656a84b8-1db6-4ce9-b16a-3556a68f6cbc tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] 10.222.0.26 "GET /compute/v2.1/servers/562434d8-1c7a-4aa4-8cb5-e5d37bf07592" status: 200 len: 1365 microversion: 2.57 time: 0.517300 Oct 08 21:04:35.543126 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1537/3130] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:04:35 2022] GET /compute/v2.1/servers/562434d8-1c7a-4aa4-8cb5-e5d37bf07592 => generated 1365 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 08 21:04:35.619914 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-969b940a-4659-45b1-8238-6ea224d76863 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] 10.222.0.26 "POST /compute/v2.1/servers/136d0aa6-479d-4d9c-b633-23203ee44ae4/action" status: 202 len: 0 microversion: 2.1 time: 0.166810 Oct 08 21:04:35.621400 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1594/3131] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:04:35 2022] POST /compute/v2.1/servers/136d0aa6-479d-4d9c-b633-23203ee44ae4/action => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 21:04:35.636254 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-9e1e8e4f-cf9e-4252-9d57-d11968d36d49 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:35.636978 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-9e1e8e4f-cf9e-4252-9d57-d11968d36d49 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] [instance: 136d0aa6-479d-4d9c-b633-23203ee44ae4] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:35.663701 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9e1e8e4f-cf9e-4252-9d57-d11968d36d49 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:35.672213 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9e1e8e4f-cf9e-4252-9d57-d11968d36d49 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:35.673647 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9e1e8e4f-cf9e-4252-9d57-d11968d36d49 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:35.681250 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9e1e8e4f-cf9e-4252-9d57-d11968d36d49 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:35.682191 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9e1e8e4f-cf9e-4252-9d57-d11968d36d49 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:35.683563 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9e1e8e4f-cf9e-4252-9d57-d11968d36d49 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:35.701528 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:04:35.939987 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-7446731e-59f9-4992-92cf-a6cce73a13b0 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-417122436", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "networks": [{"uuid": "b449bb70-491a-439e-8976-e26644902f7a"}]}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:04:36.050918 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.network.neutron [None req-7446731e-59f9-4992-92cf-a6cce73a13b0 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] validate_networks() for [('b449bb70-491a-439e-8976-e26644902f7a', None, None, None, None, None)] {{(pid=140491) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 21:04:36.644924 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-9e1e8e4f-cf9e-4252-9d57-d11968d36d49 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2e13f1952a4e5bb23d57dd7fa31875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b2a56286924e2d953bebe717ce591b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:36.659679 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-9e1e8e4f-cf9e-4252-9d57-d11968d36d49 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] 10.222.0.26 "GET /compute/v2.1/servers/136d0aa6-479d-4d9c-b633-23203ee44ae4" status: 200 len: 1495 microversion: 2.1 time: 1.028893 Oct 08 21:04:36.669412 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1595/3132] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:04:35 2022] GET /compute/v2.1/servers/136d0aa6-479d-4d9c-b633-23203ee44ae4 => generated 1495 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:04:36.690619 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-3bbbbd9a-29bf-4c39-9a4d-72fba1c4ee4e tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:36.694902 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-3bbbbd9a-29bf-4c39-9a4d-72fba1c4ee4e tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: 6ef37448-690b-4fcf-85f8-a2fb71207f38] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:36.712466 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3bbbbd9a-29bf-4c39-9a4d-72fba1c4ee4e tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:36.713093 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3bbbbd9a-29bf-4c39-9a4d-72fba1c4ee4e tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:36.715051 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3bbbbd9a-29bf-4c39-9a4d-72fba1c4ee4e tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:36.715835 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3bbbbd9a-29bf-4c39-9a4d-72fba1c4ee4e tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:36.743435 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3bbbbd9a-29bf-4c39-9a4d-72fba1c4ee4e tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:36.743954 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3bbbbd9a-29bf-4c39-9a4d-72fba1c4ee4e tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:37.647640 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-3bbbbd9a-29bf-4c39-9a4d-72fba1c4ee4e tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:37.676296 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-3bbbbd9a-29bf-4c39-9a4d-72fba1c4ee4e tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/6ef37448-690b-4fcf-85f8-a2fb71207f38" status: 200 len: 1469 microversion: 2.1 time: 1.000979 Oct 08 21:04:37.716020 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1596/3133] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:04:36 2022] GET /compute/v2.1/servers/6ef37448-690b-4fcf-85f8-a2fb71207f38 => generated 1469 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:04:37.742944 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-7a5aa5d3-2203-43c8-88f1-8df2baa66fca tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:37.743905 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-7a5aa5d3-2203-43c8-88f1-8df2baa66fca tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] [instance: 93b29a96-2b64-46bd-b6ab-fd44e6599d8f] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:37.753687 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7a5aa5d3-2203-43c8-88f1-8df2baa66fca tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:37.754546 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7a5aa5d3-2203-43c8-88f1-8df2baa66fca tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:37.755148 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7a5aa5d3-2203-43c8-88f1-8df2baa66fca tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:37.756577 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7a5aa5d3-2203-43c8-88f1-8df2baa66fca tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:37.757376 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7a5aa5d3-2203-43c8-88f1-8df2baa66fca tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:37.758049 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7a5aa5d3-2203-43c8-88f1-8df2baa66fca tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:37.890369 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-7a5aa5d3-2203-43c8-88f1-8df2baa66fca tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3245fc05926b49118c0d1028de3f09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527bbe10db744ab4bcc8078f2d754d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:37.922960 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-7a5aa5d3-2203-43c8-88f1-8df2baa66fca tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3245fc05926b49118c0d1028de3f09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527bbe10db744ab4bcc8078f2d754d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:37.927489 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-7a5aa5d3-2203-43c8-88f1-8df2baa66fca tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3245fc05926b49118c0d1028de3f09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527bbe10db744ab4bcc8078f2d754d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:37.933115 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-7a5aa5d3-2203-43c8-88f1-8df2baa66fca tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] 10.222.0.26 "GET /compute/v2.1/servers/93b29a96-2b64-46bd-b6ab-fd44e6599d8f" status: 200 len: 1356 microversion: 2.47 time: 0.213306 Oct 08 21:04:37.936467 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1597/3134] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:04:37 2022] GET /compute/v2.1/servers/93b29a96-2b64-46bd-b6ab-fd44e6599d8f => generated 1356 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:04:37.953461 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-cbea34e5-5878-48cc-96b0-0b0558cc3a8a tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:37.954084 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-cbea34e5-5878-48cc-96b0-0b0558cc3a8a tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] [instance: 562434d8-1c7a-4aa4-8cb5-e5d37bf07592] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:37.971808 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cbea34e5-5878-48cc-96b0-0b0558cc3a8a tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:37.972627 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cbea34e5-5878-48cc-96b0-0b0558cc3a8a tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:37.973263 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cbea34e5-5878-48cc-96b0-0b0558cc3a8a tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:37.974163 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cbea34e5-5878-48cc-96b0-0b0558cc3a8a tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:37.977816 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cbea34e5-5878-48cc-96b0-0b0558cc3a8a tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:37.978274 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cbea34e5-5878-48cc-96b0-0b0558cc3a8a tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:38.187645 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-cbea34e5-5878-48cc-96b0-0b0558cc3a8a tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07280ef2c5da4903a62092a44499f455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92d768a1a654e199e14845aab7d565b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:38.200184 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-cbea34e5-5878-48cc-96b0-0b0558cc3a8a tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07280ef2c5da4903a62092a44499f455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92d768a1a654e199e14845aab7d565b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:38.203894 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-cbea34e5-5878-48cc-96b0-0b0558cc3a8a tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07280ef2c5da4903a62092a44499f455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92d768a1a654e199e14845aab7d565b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:38.219305 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-cbea34e5-5878-48cc-96b0-0b0558cc3a8a tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] 10.222.0.26 "GET /compute/v2.1/servers/562434d8-1c7a-4aa4-8cb5-e5d37bf07592" status: 200 len: 1365 microversion: 2.57 time: 0.269492 Oct 08 21:04:38.220514 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1598/3135] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:04:37 2022] GET /compute/v2.1/servers/562434d8-1c7a-4aa4-8cb5-e5d37bf07592 => generated 1365 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:04:38.246480 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-94d2b170-c71f-468e-b0b5-0c15a16ae15b req-48cf163f-f17b-40e7-b833-61ad30be9443 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ef37448-690b-4fcf-85f8-a2fb71207f38", "name": "network-vif-unplugged", "status": "completed", "tag": "066ce620-e2c6-4bca-97c2-d42e20280dcc"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:04:38.266418 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=100 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:04:38.269316 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-94d2b170-c71f-468e-b0b5-0c15a16ae15b req-48cf163f-f17b-40e7-b833-61ad30be9443 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:38.273396 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-94d2b170-c71f-468e-b0b5-0c15a16ae15b req-48cf163f-f17b-40e7-b833-61ad30be9443 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:38.274092 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-94d2b170-c71f-468e-b0b5-0c15a16ae15b req-48cf163f-f17b-40e7-b833-61ad30be9443 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:38.312005 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-94d2b170-c71f-468e-b0b5-0c15a16ae15b req-48cf163f-f17b-40e7-b833-61ad30be9443 service nova] Creating event network-vif-unplugged:066ce620-e2c6-4bca-97c2-d42e20280dcc for instance 6ef37448-690b-4fcf-85f8-a2fb71207f38 on nch2-master-1 Oct 08 21:04:38.333481 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [req-94d2b170-c71f-468e-b0b5-0c15a16ae15b req-48cf163f-f17b-40e7-b833-61ad30be9443 service nova] Instance 6ef37448-690b-4fcf-85f8-a2fb71207f38 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140492) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 08 21:04:38.375941 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-94d2b170-c71f-468e-b0b5-0c15a16ae15b req-48cf163f-f17b-40e7-b833-61ad30be9443 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.153798 Oct 08 21:04:38.382871 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1599/3136] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:04:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:04:38.389711 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-fb087ccf-8b6d-4f34-a590-ed51ca4adb20 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:38.390688 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-fb087ccf-8b6d-4f34-a590-ed51ca4adb20 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] [instance: 136d0aa6-479d-4d9c-b633-23203ee44ae4] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:38.404407 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fb087ccf-8b6d-4f34-a590-ed51ca4adb20 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:38.405119 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fb087ccf-8b6d-4f34-a590-ed51ca4adb20 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:38.405908 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fb087ccf-8b6d-4f34-a590-ed51ca4adb20 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:38.406925 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fb087ccf-8b6d-4f34-a590-ed51ca4adb20 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:38.407577 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fb087ccf-8b6d-4f34-a590-ed51ca4adb20 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:38.408209 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fb087ccf-8b6d-4f34-a590-ed51ca4adb20 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:38.867862 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=4 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:04:38.989710 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=16 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:04:39.224901 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-fb087ccf-8b6d-4f34-a590-ed51ca4adb20 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2e13f1952a4e5bb23d57dd7fa31875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b2a56286924e2d953bebe717ce591b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:39.237075 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-7446731e-59f9-4992-92cf-a6cce73a13b0 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Flavor limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 21:04:39.238616 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-7446731e-59f9-4992-92cf-a6cce73a13b0 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Image limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 21:04:39.239379 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-7446731e-59f9-4992-92cf-a6cce73a13b0 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Flavor pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 21:04:39.240010 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-7446731e-59f9-4992-92cf-a6cce73a13b0 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Image pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 21:04:39.240875 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-7446731e-59f9-4992-92cf-a6cce73a13b0 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 21:04:39.247204 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-fb087ccf-8b6d-4f34-a590-ed51ca4adb20 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] 10.222.0.26 "GET /compute/v2.1/servers/136d0aa6-479d-4d9c-b633-23203ee44ae4" status: 200 len: 1495 microversion: 2.1 time: 0.862469 Oct 08 21:04:39.247942 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1600/3137] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:04:38 2022] GET /compute/v2.1/servers/136d0aa6-479d-4d9c-b633-23203ee44ae4 => generated 1495 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:04:39.256210 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7446731e-59f9-4992-92cf-a6cce73a13b0 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:39.256937 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7446731e-59f9-4992-92cf-a6cce73a13b0 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:39.257508 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7446731e-59f9-4992-92cf-a6cce73a13b0 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:39.258451 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7446731e-59f9-4992-92cf-a6cce73a13b0 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:39.259027 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7446731e-59f9-4992-92cf-a6cce73a13b0 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:39.259571 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7446731e-59f9-4992-92cf-a6cce73a13b0 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:39.286189 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-d09c755c-eac3-4138-963d-fb0c76484d80 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:04:39.290754 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-7446731e-59f9-4992-92cf-a6cce73a13b0 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Getting quotas for project c405aac48e9b403ca8d1e3ac28fab76e. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:04:39.296392 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-d09c755c-eac3-4138-963d-fb0c76484d80 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] [instance: 93b29a96-2b64-46bd-b6ab-fd44e6599d8f] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:39.298607 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-7446731e-59f9-4992-92cf-a6cce73a13b0 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Getting quotas for user 0c6153d58d264272a375b3169e0874d3 and project c405aac48e9b403ca8d1e3ac28fab76e. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:04:39.311483 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d09c755c-eac3-4138-963d-fb0c76484d80 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:39.312181 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d09c755c-eac3-4138-963d-fb0c76484d80 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:39.312800 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d09c755c-eac3-4138-963d-fb0c76484d80 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:39.319728 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-7446731e-59f9-4992-92cf-a6cce73a13b0 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Going to run 1 instances... {{(pid=140491) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 21:04:39.321293 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d09c755c-eac3-4138-963d-fb0c76484d80 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:39.322484 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-7446731e-59f9-4992-92cf-a6cce73a13b0 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] [instance: de9d6639-040b-44b7-b00a-c1022c705c89] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c508bd7f-7db9-4b2c-af7c-be54a855c355',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140491) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 21:04:39.327622 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d09c755c-eac3-4138-963d-fb0c76484d80 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:39.328616 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d09c755c-eac3-4138-963d-fb0c76484d80 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:39.393550 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-7446731e-59f9-4992-92cf-a6cce73a13b0 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.849069 Oct 08 21:04:39.395676 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1538/3138] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 21:04:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 3852 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 08 21:04:39.403943 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-4ecee524-9f94-44b8-b01d-d13cfdb6aa7f tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:39.418010 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-4ecee524-9f94-44b8-b01d-d13cfdb6aa7f tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: 6ef37448-690b-4fcf-85f8-a2fb71207f38] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:39.432103 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4ecee524-9f94-44b8-b01d-d13cfdb6aa7f tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:39.432576 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4ecee524-9f94-44b8-b01d-d13cfdb6aa7f tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:39.433037 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4ecee524-9f94-44b8-b01d-d13cfdb6aa7f tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:39.433811 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4ecee524-9f94-44b8-b01d-d13cfdb6aa7f tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:39.434285 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4ecee524-9f94-44b8-b01d-d13cfdb6aa7f tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:39.441366 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4ecee524-9f94-44b8-b01d-d13cfdb6aa7f tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:39.558569 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-d09c755c-eac3-4138-963d-fb0c76484d80 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Flavor limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 21:04:39.559009 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-d09c755c-eac3-4138-963d-fb0c76484d80 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Image limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 21:04:39.559503 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-d09c755c-eac3-4138-963d-fb0c76484d80 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Flavor pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 21:04:39.559926 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-d09c755c-eac3-4138-963d-fb0c76484d80 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Image pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 21:04:39.560350 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-d09c755c-eac3-4138-963d-fb0c76484d80 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 21:04:39.764097 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-d09c755c-eac3-4138-963d-fb0c76484d80 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] [instance: 93b29a96-2b64-46bd-b6ab-fd44e6599d8f] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:39.792283 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d09c755c-eac3-4138-963d-fb0c76484d80 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:39.797837 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d09c755c-eac3-4138-963d-fb0c76484d80 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:39.800113 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d09c755c-eac3-4138-963d-fb0c76484d80 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:39.804396 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d09c755c-eac3-4138-963d-fb0c76484d80 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:39.804956 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d09c755c-eac3-4138-963d-fb0c76484d80 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:39.807687 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d09c755c-eac3-4138-963d-fb0c76484d80 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:39.923695 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-d09c755c-eac3-4138-963d-fb0c76484d80 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] 10.222.0.26 "POST /compute/v2.1/servers/93b29a96-2b64-46bd-b6ab-fd44e6599d8f/action" status: 202 len: 1078 microversion: 2.47 time: 0.652173 Oct 08 21:04:39.929658 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1601/3139] 10.222.0.26 () {62 vars in 1319 bytes} [Sat Oct 8 21:04:39 2022] POST /compute/v2.1/servers/93b29a96-2b64-46bd-b6ab-fd44e6599d8f/action => generated 1078 bytes in 681 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 08 21:04:39.941599 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-c8854748-1398-4618-a6ec-408c64787553 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:39.942620 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-c8854748-1398-4618-a6ec-408c64787553 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] [instance: 562434d8-1c7a-4aa4-8cb5-e5d37bf07592] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:39.959187 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-4ecee524-9f94-44b8-b01d-d13cfdb6aa7f tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:39.968874 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c8854748-1398-4618-a6ec-408c64787553 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:39.970292 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c8854748-1398-4618-a6ec-408c64787553 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:39.973511 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c8854748-1398-4618-a6ec-408c64787553 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:39.974460 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c8854748-1398-4618-a6ec-408c64787553 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:39.975003 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-4ecee524-9f94-44b8-b01d-d13cfdb6aa7f tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/6ef37448-690b-4fcf-85f8-a2fb71207f38" status: 200 len: 1469 microversion: 2.1 time: 0.576117 Oct 08 21:04:39.975627 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1539/3140] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:04:39 2022] GET /compute/v2.1/servers/6ef37448-690b-4fcf-85f8-a2fb71207f38 => generated 1469 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:04:39.985064 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-6dac7446-aa41-4de9-bcd6-f6b060f3db33 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:39.985616 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c8854748-1398-4618-a6ec-408c64787553 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:39.986939 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c8854748-1398-4618-a6ec-408c64787553 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:39.993149 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-6dac7446-aa41-4de9-bcd6-f6b060f3db33 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] [instance: de9d6639-040b-44b7-b00a-c1022c705c89] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:40.179018 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-c8854748-1398-4618-a6ec-408c64787553 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07280ef2c5da4903a62092a44499f455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92d768a1a654e199e14845aab7d565b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:40.195118 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-c8854748-1398-4618-a6ec-408c64787553 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07280ef2c5da4903a62092a44499f455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92d768a1a654e199e14845aab7d565b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:40.200782 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-c8854748-1398-4618-a6ec-408c64787553 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07280ef2c5da4903a62092a44499f455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92d768a1a654e199e14845aab7d565b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:40.203885 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-c8854748-1398-4618-a6ec-408c64787553 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] 10.222.0.26 "GET /compute/v2.1/servers/562434d8-1c7a-4aa4-8cb5-e5d37bf07592" status: 200 len: 1365 microversion: 2.57 time: 0.272832 Oct 08 21:04:40.209609 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1602/3141] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:04:39 2022] GET /compute/v2.1/servers/562434d8-1c7a-4aa4-8cb5-e5d37bf07592 => generated 1365 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:04:40.237523 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=8 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:04:40.263798 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-6dac7446-aa41-4de9-bcd6-f6b060f3db33 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c6153d58d264272a375b3169e0874d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c405aac48e9b403ca8d1e3ac28fab76e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:40.271537 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-6dac7446-aa41-4de9-bcd6-f6b060f3db33 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] 10.222.0.26 "GET /compute/v2.1/servers/de9d6639-040b-44b7-b00a-c1022c705c89" status: 200 len: 1223 microversion: 2.1 time: 0.294597 Oct 08 21:04:40.282007 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1540/3142] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:04:39 2022] GET /compute/v2.1/servers/de9d6639-040b-44b7-b00a-c1022c705c89 => generated 1223 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:04:40.287090 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-4ff24869-a883-4b1f-9ea2-3d865e718ee8 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:40.302029 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-4ff24869-a883-4b1f-9ea2-3d865e718ee8 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] [instance: 93b29a96-2b64-46bd-b6ab-fd44e6599d8f] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:40.323187 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4ff24869-a883-4b1f-9ea2-3d865e718ee8 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:40.323690 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4ff24869-a883-4b1f-9ea2-3d865e718ee8 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:40.324143 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4ff24869-a883-4b1f-9ea2-3d865e718ee8 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:40.324871 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4ff24869-a883-4b1f-9ea2-3d865e718ee8 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:40.325366 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4ff24869-a883-4b1f-9ea2-3d865e718ee8 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:40.335801 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4ff24869-a883-4b1f-9ea2-3d865e718ee8 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:40.366419 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-591c92d5-3352-4407-8cc1-ddd23a421e85 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-1214600975", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "a0890bdd-866a-48dd-987c-791ef29d5b3c"}]}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:04:40.498324 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.network.neutron [None req-591c92d5-3352-4407-8cc1-ddd23a421e85 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] validate_networks() for [('a0890bdd-866a-48dd-987c-791ef29d5b3c', None, None, None, None, None)] {{(pid=140492) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 21:04:40.650319 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-4ff24869-a883-4b1f-9ea2-3d865e718ee8 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3245fc05926b49118c0d1028de3f09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527bbe10db744ab4bcc8078f2d754d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:40.665234 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-4ff24869-a883-4b1f-9ea2-3d865e718ee8 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3245fc05926b49118c0d1028de3f09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527bbe10db744ab4bcc8078f2d754d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:40.666942 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-4ff24869-a883-4b1f-9ea2-3d865e718ee8 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3245fc05926b49118c0d1028de3f09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527bbe10db744ab4bcc8078f2d754d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:40.668565 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-4ff24869-a883-4b1f-9ea2-3d865e718ee8 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] 10.222.0.26 "GET /compute/v2.1/servers/93b29a96-2b64-46bd-b6ab-fd44e6599d8f" status: 200 len: 1365 microversion: 2.47 time: 0.385313 Oct 08 21:04:40.673509 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1541/3143] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:04:40 2022] GET /compute/v2.1/servers/93b29a96-2b64-46bd-b6ab-fd44e6599d8f => generated 1365 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:04:40.680632 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-43e510f1-a4cc-44e3-9231-55cacff19ef2 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:40.686004 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-43e510f1-a4cc-44e3-9231-55cacff19ef2 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] [instance: 136d0aa6-479d-4d9c-b633-23203ee44ae4] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:40.695157 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-43e510f1-a4cc-44e3-9231-55cacff19ef2 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:40.700650 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-43e510f1-a4cc-44e3-9231-55cacff19ef2 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:40.701488 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-43e510f1-a4cc-44e3-9231-55cacff19ef2 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:40.702461 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-43e510f1-a4cc-44e3-9231-55cacff19ef2 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:40.703098 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-43e510f1-a4cc-44e3-9231-55cacff19ef2 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:40.703686 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-43e510f1-a4cc-44e3-9231-55cacff19ef2 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:41.228495 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-43e510f1-a4cc-44e3-9231-55cacff19ef2 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2e13f1952a4e5bb23d57dd7fa31875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b2a56286924e2d953bebe717ce591b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:41.244222 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-43e510f1-a4cc-44e3-9231-55cacff19ef2 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] 10.222.0.26 "GET /compute/v2.1/servers/136d0aa6-479d-4d9c-b633-23203ee44ae4" status: 200 len: 1501 microversion: 2.1 time: 0.567154 Oct 08 21:04:41.244618 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1542/3144] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:04:40 2022] GET /compute/v2.1/servers/136d0aa6-479d-4d9c-b633-23203ee44ae4 => generated 1501 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:04:41.257284 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-a04622e0-3a7e-4914-a0e1-17702ae828e3 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:41.258213 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-a04622e0-3a7e-4914-a0e1-17702ae828e3 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: 6ef37448-690b-4fcf-85f8-a2fb71207f38] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:41.278648 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a04622e0-3a7e-4914-a0e1-17702ae828e3 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:41.281093 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a04622e0-3a7e-4914-a0e1-17702ae828e3 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:41.282701 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a04622e0-3a7e-4914-a0e1-17702ae828e3 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:41.287036 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a04622e0-3a7e-4914-a0e1-17702ae828e3 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:41.287742 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a04622e0-3a7e-4914-a0e1-17702ae828e3 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:41.291512 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a04622e0-3a7e-4914-a0e1-17702ae828e3 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:41.835727 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-591c92d5-3352-4407-8cc1-ddd23a421e85 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Flavor limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 21:04:41.836674 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-591c92d5-3352-4407-8cc1-ddd23a421e85 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Image limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 21:04:41.837312 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-591c92d5-3352-4407-8cc1-ddd23a421e85 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Flavor pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 21:04:41.838342 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-591c92d5-3352-4407-8cc1-ddd23a421e85 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Image pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 21:04:41.838940 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-591c92d5-3352-4407-8cc1-ddd23a421e85 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 21:04:41.902311 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-591c92d5-3352-4407-8cc1-ddd23a421e85 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:41.902889 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-591c92d5-3352-4407-8cc1-ddd23a421e85 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:41.903975 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-591c92d5-3352-4407-8cc1-ddd23a421e85 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:41.904769 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-591c92d5-3352-4407-8cc1-ddd23a421e85 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:41.905260 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-591c92d5-3352-4407-8cc1-ddd23a421e85 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:41.907940 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-591c92d5-3352-4407-8cc1-ddd23a421e85 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:42.025859 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-591c92d5-3352-4407-8cc1-ddd23a421e85 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Getting quotas for project 917519b500674698a68dc01a4e8d68a8. Resources: {'cores', 'instances', 'ram'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:04:42.044073 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-591c92d5-3352-4407-8cc1-ddd23a421e85 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Getting quotas for user 5000948fa98a4b5d96ad27436d3d0edb and project 917519b500674698a68dc01a4e8d68a8. Resources: {'cores', 'instances', 'ram'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:04:42.082292 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-591c92d5-3352-4407-8cc1-ddd23a421e85 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Going to run 2 instances... {{(pid=140492) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 21:04:42.085062 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-591c92d5-3352-4407-8cc1-ddd23a421e85 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] [instance: 5848e7ba-40bb-4c4d-a2d0-f4dce5bb2842] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c508bd7f-7db9-4b2c-af7c-be54a855c355',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140492) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 21:04:42.172738 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-591c92d5-3352-4407-8cc1-ddd23a421e85 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] [instance: 930c77ec-9649-47fe-bdee-e215c32e28b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c508bd7f-7db9-4b2c-af7c-be54a855c355',instance=,instance_uuid=5848e7ba-40bb-4c4d-a2d0-f4dce5bb2842,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140492) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 21:04:42.299530 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-591c92d5-3352-4407-8cc1-ddd23a421e85 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.088198 Oct 08 21:04:42.300571 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1603/3145] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 21:04:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 2090 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 08 21:04:42.309370 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-37a27f7b-ed69-4ee7-a7f0-8597e1cbaee2 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:42.312606 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-37a27f7b-ed69-4ee7-a7f0-8597e1cbaee2 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] [instance: 562434d8-1c7a-4aa4-8cb5-e5d37bf07592] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:42.328622 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-37a27f7b-ed69-4ee7-a7f0-8597e1cbaee2 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:42.347023 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-a04622e0-3a7e-4914-a0e1-17702ae828e3 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:42.349057 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-37a27f7b-ed69-4ee7-a7f0-8597e1cbaee2 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:42.349578 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-37a27f7b-ed69-4ee7-a7f0-8597e1cbaee2 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:42.350353 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-37a27f7b-ed69-4ee7-a7f0-8597e1cbaee2 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:42.361586 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-a04622e0-3a7e-4914-a0e1-17702ae828e3 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/6ef37448-690b-4fcf-85f8-a2fb71207f38" status: 200 len: 1469 microversion: 2.1 time: 1.114492 Oct 08 21:04:42.362242 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1543/3146] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:04:41 2022] GET /compute/v2.1/servers/6ef37448-690b-4fcf-85f8-a2fb71207f38 => generated 1469 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:04:42.369909 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-37a27f7b-ed69-4ee7-a7f0-8597e1cbaee2 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:42.370518 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-37a27f7b-ed69-4ee7-a7f0-8597e1cbaee2 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:42.375569 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-8a224838-9cc5-46ab-84d1-2cf69765230a tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:42.376271 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-8a224838-9cc5-46ab-84d1-2cf69765230a tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] [instance: 136d0aa6-479d-4d9c-b633-23203ee44ae4] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:42.390074 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8a224838-9cc5-46ab-84d1-2cf69765230a tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:42.394722 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8a224838-9cc5-46ab-84d1-2cf69765230a tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:42.395466 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8a224838-9cc5-46ab-84d1-2cf69765230a tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:42.396411 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8a224838-9cc5-46ab-84d1-2cf69765230a tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:42.397598 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8a224838-9cc5-46ab-84d1-2cf69765230a tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:42.398255 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8a224838-9cc5-46ab-84d1-2cf69765230a tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:42.462760 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-8a224838-9cc5-46ab-84d1-2cf69765230a tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] [instance: 136d0aa6-479d-4d9c-b633-23203ee44ae4] Going to try to terminate instance {{(pid=140491) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 21:04:42.673141 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-8a224838-9cc5-46ab-84d1-2cf69765230a tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] 10.222.0.26 "DELETE /compute/v2.1/servers/136d0aa6-479d-4d9c-b633-23203ee44ae4" status: 204 len: 0 microversion: 2.1 time: 0.307367 Oct 08 21:04:42.677676 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1544/3147] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:04:42 2022] DELETE /compute/v2.1/servers/136d0aa6-479d-4d9c-b633-23203ee44ae4 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 21:04:42.685786 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-8f891240-0060-497c-8cfa-4000582f9ae2 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:42.689869 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-8f891240-0060-497c-8cfa-4000582f9ae2 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] [instance: de9d6639-040b-44b7-b00a-c1022c705c89] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:42.710697 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8f891240-0060-497c-8cfa-4000582f9ae2 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:42.712054 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8f891240-0060-497c-8cfa-4000582f9ae2 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:42.712579 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8f891240-0060-497c-8cfa-4000582f9ae2 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:42.713760 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8f891240-0060-497c-8cfa-4000582f9ae2 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:42.714242 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8f891240-0060-497c-8cfa-4000582f9ae2 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:42.714931 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8f891240-0060-497c-8cfa-4000582f9ae2 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:42.795307 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-37a27f7b-ed69-4ee7-a7f0-8597e1cbaee2 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07280ef2c5da4903a62092a44499f455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92d768a1a654e199e14845aab7d565b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:42.806802 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-37a27f7b-ed69-4ee7-a7f0-8597e1cbaee2 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07280ef2c5da4903a62092a44499f455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92d768a1a654e199e14845aab7d565b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:42.808975 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-37a27f7b-ed69-4ee7-a7f0-8597e1cbaee2 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07280ef2c5da4903a62092a44499f455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92d768a1a654e199e14845aab7d565b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:42.810584 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-37a27f7b-ed69-4ee7-a7f0-8597e1cbaee2 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] 10.222.0.26 "GET /compute/v2.1/servers/562434d8-1c7a-4aa4-8cb5-e5d37bf07592" status: 200 len: 1365 microversion: 2.57 time: 0.508832 Oct 08 21:04:42.812376 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1604/3148] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:04:42 2022] GET /compute/v2.1/servers/562434d8-1c7a-4aa4-8cb5-e5d37bf07592 => generated 1365 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:04:42.824870 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-6234e2c4-3efe-42db-a306-7c40dfa1977d tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:42.826126 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-6234e2c4-3efe-42db-a306-7c40dfa1977d tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] [instance: 93b29a96-2b64-46bd-b6ab-fd44e6599d8f] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:42.849732 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6234e2c4-3efe-42db-a306-7c40dfa1977d tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:42.851113 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6234e2c4-3efe-42db-a306-7c40dfa1977d tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:42.851836 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6234e2c4-3efe-42db-a306-7c40dfa1977d tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:42.852752 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6234e2c4-3efe-42db-a306-7c40dfa1977d tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:42.853419 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6234e2c4-3efe-42db-a306-7c40dfa1977d tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:42.854019 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6234e2c4-3efe-42db-a306-7c40dfa1977d tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:42.945135 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-8f891240-0060-497c-8cfa-4000582f9ae2 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c6153d58d264272a375b3169e0874d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c405aac48e9b403ca8d1e3ac28fab76e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:42.966474 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-8f891240-0060-497c-8cfa-4000582f9ae2 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] 10.222.0.26 "GET /compute/v2.1/servers/de9d6639-040b-44b7-b00a-c1022c705c89" status: 200 len: 1281 microversion: 2.1 time: 0.286639 Oct 08 21:04:42.968140 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1545/3149] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:04:42 2022] GET /compute/v2.1/servers/de9d6639-040b-44b7-b00a-c1022c705c89 => generated 1281 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:04:42.978081 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-55265124-55ca-4c1b-8543-aba46c9567e7 req-c29b7357-497e-4762-b3c4-9c39fa15b1c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ef37448-690b-4fcf-85f8-a2fb71207f38", "tag": "066ce620-e2c6-4bca-97c2-d42e20280dcc"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:04:42.990273 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-6234e2c4-3efe-42db-a306-7c40dfa1977d tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3245fc05926b49118c0d1028de3f09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527bbe10db744ab4bcc8078f2d754d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:43.010401 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-6234e2c4-3efe-42db-a306-7c40dfa1977d tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3245fc05926b49118c0d1028de3f09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527bbe10db744ab4bcc8078f2d754d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:43.015970 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-6234e2c4-3efe-42db-a306-7c40dfa1977d tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3245fc05926b49118c0d1028de3f09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527bbe10db744ab4bcc8078f2d754d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:43.016879 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-55265124-55ca-4c1b-8543-aba46c9567e7 req-c29b7357-497e-4762-b3c4-9c39fa15b1c4 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:43.018258 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-55265124-55ca-4c1b-8543-aba46c9567e7 req-c29b7357-497e-4762-b3c4-9c39fa15b1c4 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:43.019836 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-6234e2c4-3efe-42db-a306-7c40dfa1977d tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] 10.222.0.26 "GET /compute/v2.1/servers/93b29a96-2b64-46bd-b6ab-fd44e6599d8f" status: 200 len: 1365 microversion: 2.47 time: 0.206315 Oct 08 21:04:43.020785 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-55265124-55ca-4c1b-8543-aba46c9567e7 req-c29b7357-497e-4762-b3c4-9c39fa15b1c4 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:43.022850 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1605/3150] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:04:42 2022] GET /compute/v2.1/servers/93b29a96-2b64-46bd-b6ab-fd44e6599d8f => generated 1365 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:04:43.031145 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-ba450a64-c09d-41f4-87c2-fbaa484995db tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:43.048971 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-ba450a64-c09d-41f4-87c2-fbaa484995db tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5000948fa98a4b5d96ad27436d3d0edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917519b500674698a68dc01a4e8d68a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:43.053077 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-55265124-55ca-4c1b-8543-aba46c9567e7 req-c29b7357-497e-4762-b3c4-9c39fa15b1c4 service nova] Creating event network-changed:066ce620-e2c6-4bca-97c2-d42e20280dcc for instance 6ef37448-690b-4fcf-85f8-a2fb71207f38 on nch2-master-1 Oct 08 21:04:43.054448 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-ba450a64-c09d-41f4-87c2-fbaa484995db tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Searching by: {'deleted': False, 'project_id': '917519b500674698a68dc01a4e8d68a8'} {{(pid=140492) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 08 21:04:43.069272 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [req-55265124-55ca-4c1b-8543-aba46c9567e7 req-c29b7357-497e-4762-b3c4-9c39fa15b1c4 service nova] Instance 6ef37448-690b-4fcf-85f8-a2fb71207f38 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140491) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 08 21:04:43.096278 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ba450a64-c09d-41f4-87c2-fbaa484995db tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:43.096723 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ba450a64-c09d-41f4-87c2-fbaa484995db tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:43.097276 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ba450a64-c09d-41f4-87c2-fbaa484995db tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:43.099390 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-55265124-55ca-4c1b-8543-aba46c9567e7 req-c29b7357-497e-4762-b3c4-9c39fa15b1c4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129613 Oct 08 21:04:43.100967 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ba450a64-c09d-41f4-87c2-fbaa484995db tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:43.101542 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1546/3151] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:04:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:04:43.103279 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ba450a64-c09d-41f4-87c2-fbaa484995db tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:43.103780 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ba450a64-c09d-41f4-87c2-fbaa484995db tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:43.111581 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-9d2b86fc-9737-4021-8eeb-3ce8ad80e817 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:43.112696 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-9d2b86fc-9737-4021-8eeb-3ce8ad80e817 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] [instance: 136d0aa6-479d-4d9c-b633-23203ee44ae4] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:43.130467 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9d2b86fc-9737-4021-8eeb-3ce8ad80e817 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:43.130977 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9d2b86fc-9737-4021-8eeb-3ce8ad80e817 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:43.132623 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9d2b86fc-9737-4021-8eeb-3ce8ad80e817 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:43.134611 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9d2b86fc-9737-4021-8eeb-3ce8ad80e817 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:43.135105 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9d2b86fc-9737-4021-8eeb-3ce8ad80e817 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:43.135548 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9d2b86fc-9737-4021-8eeb-3ce8ad80e817 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:43.155777 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-ba450a64-c09d-41f4-87c2-fbaa484995db tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] 10.222.0.26 "GET /compute/v2.1/servers" status: 200 len: 677 microversion: 2.1 time: 0.129281 Oct 08 21:04:43.166939 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1606/3152] 10.222.0.26 () {58 vars in 1125 bytes} [Sat Oct 8 21:04:43 2022] GET /compute/v2.1/servers => generated 677 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:04:43.177849 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-cf689494-b327-48ee-a7fa-3f3f861a1ff7 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:43.178481 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-cf689494-b327-48ee-a7fa-3f3f861a1ff7 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] [instance: 930c77ec-9649-47fe-bdee-e215c32e28b4] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:43.310806 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-cf689494-b327-48ee-a7fa-3f3f861a1ff7 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5000948fa98a4b5d96ad27436d3d0edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917519b500674698a68dc01a4e8d68a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:43.328002 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-cf689494-b327-48ee-a7fa-3f3f861a1ff7 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] 10.222.0.26 "GET /compute/v2.1/servers/930c77ec-9649-47fe-bdee-e215c32e28b4" status: 200 len: 1220 microversion: 2.1 time: 0.161344 Oct 08 21:04:43.333293 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1607/3153] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:04:43 2022] GET /compute/v2.1/servers/930c77ec-9649-47fe-bdee-e215c32e28b4 => generated 1220 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:04:43.384467 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-9797d3c8-0ed8-421d-98c3-201a9afd94d2 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:43.385558 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-9797d3c8-0ed8-421d-98c3-201a9afd94d2 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: 6ef37448-690b-4fcf-85f8-a2fb71207f38] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:43.400146 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9797d3c8-0ed8-421d-98c3-201a9afd94d2 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:43.401066 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9797d3c8-0ed8-421d-98c3-201a9afd94d2 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:43.403972 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9797d3c8-0ed8-421d-98c3-201a9afd94d2 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:43.406910 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9797d3c8-0ed8-421d-98c3-201a9afd94d2 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:43.409425 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9797d3c8-0ed8-421d-98c3-201a9afd94d2 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:43.410870 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9797d3c8-0ed8-421d-98c3-201a9afd94d2 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:43.744832 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-9d2b86fc-9737-4021-8eeb-3ce8ad80e817 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2e13f1952a4e5bb23d57dd7fa31875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b2a56286924e2d953bebe717ce591b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:43.761026 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-9d2b86fc-9737-4021-8eeb-3ce8ad80e817 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] 10.222.0.26 "GET /compute/v2.1/servers/136d0aa6-479d-4d9c-b633-23203ee44ae4" status: 200 len: 1507 microversion: 2.1 time: 0.655408 Oct 08 21:04:43.762309 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1547/3154] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:04:43 2022] GET /compute/v2.1/servers/136d0aa6-479d-4d9c-b633-23203ee44ae4 => generated 1507 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:04:43.853567 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-a12bc36e-b905-46d7-85a9-df0606817630 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:43.854815 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-a12bc36e-b905-46d7-85a9-df0606817630 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] [instance: 562434d8-1c7a-4aa4-8cb5-e5d37bf07592] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:43.863281 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a12bc36e-b905-46d7-85a9-df0606817630 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:43.864105 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a12bc36e-b905-46d7-85a9-df0606817630 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:43.864846 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a12bc36e-b905-46d7-85a9-df0606817630 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:43.865982 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a12bc36e-b905-46d7-85a9-df0606817630 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:43.866625 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a12bc36e-b905-46d7-85a9-df0606817630 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:43.867579 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a12bc36e-b905-46d7-85a9-df0606817630 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:44.006483 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-9797d3c8-0ed8-421d-98c3-201a9afd94d2 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:44.015893 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-9797d3c8-0ed8-421d-98c3-201a9afd94d2 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/6ef37448-690b-4fcf-85f8-a2fb71207f38" status: 200 len: 1469 microversion: 2.1 time: 0.635391 Oct 08 21:04:44.021412 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1608/3155] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:04:43 2022] GET /compute/v2.1/servers/6ef37448-690b-4fcf-85f8-a2fb71207f38 => generated 1469 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:04:44.031590 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-bda52b5c-762b-4589-bc3c-ef2b3063f227 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:44.034398 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-bda52b5c-762b-4589-bc3c-ef2b3063f227 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] [instance: de9d6639-040b-44b7-b00a-c1022c705c89] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:44.068718 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bda52b5c-762b-4589-bc3c-ef2b3063f227 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:44.084665 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bda52b5c-762b-4589-bc3c-ef2b3063f227 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:44.086155 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bda52b5c-762b-4589-bc3c-ef2b3063f227 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:44.087015 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bda52b5c-762b-4589-bc3c-ef2b3063f227 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:44.089894 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bda52b5c-762b-4589-bc3c-ef2b3063f227 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:44.090354 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bda52b5c-762b-4589-bc3c-ef2b3063f227 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:44.175185 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-a12bc36e-b905-46d7-85a9-df0606817630 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07280ef2c5da4903a62092a44499f455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92d768a1a654e199e14845aab7d565b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:44.190283 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-a12bc36e-b905-46d7-85a9-df0606817630 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07280ef2c5da4903a62092a44499f455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92d768a1a654e199e14845aab7d565b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:44.192134 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-a12bc36e-b905-46d7-85a9-df0606817630 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07280ef2c5da4903a62092a44499f455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92d768a1a654e199e14845aab7d565b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:44.194546 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-a12bc36e-b905-46d7-85a9-df0606817630 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] 10.222.0.26 "GET /compute/v2.1/servers/562434d8-1c7a-4aa4-8cb5-e5d37bf07592" status: 200 len: 1365 microversion: 2.57 time: 0.353299 Oct 08 21:04:44.218992 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1548/3156] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:04:43 2022] GET /compute/v2.1/servers/562434d8-1c7a-4aa4-8cb5-e5d37bf07592 => generated 1365 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:04:44.227246 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-d495337e-f8c9-4b34-b247-515cb3d1abd0 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:44.228179 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-d495337e-f8c9-4b34-b247-515cb3d1abd0 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] [instance: 93b29a96-2b64-46bd-b6ab-fd44e6599d8f] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:44.235481 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d495337e-f8c9-4b34-b247-515cb3d1abd0 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:44.236913 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d495337e-f8c9-4b34-b247-515cb3d1abd0 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:44.237650 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d495337e-f8c9-4b34-b247-515cb3d1abd0 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:44.238735 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d495337e-f8c9-4b34-b247-515cb3d1abd0 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:44.240225 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d495337e-f8c9-4b34-b247-515cb3d1abd0 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:44.240913 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d495337e-f8c9-4b34-b247-515cb3d1abd0 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:44.341356 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-bda52b5c-762b-4589-bc3c-ef2b3063f227 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c6153d58d264272a375b3169e0874d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c405aac48e9b403ca8d1e3ac28fab76e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:44.357812 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-d495337e-f8c9-4b34-b247-515cb3d1abd0 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3245fc05926b49118c0d1028de3f09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527bbe10db744ab4bcc8078f2d754d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:44.358887 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-bda52b5c-762b-4589-bc3c-ef2b3063f227 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] 10.222.0.26 "GET /compute/v2.1/servers/de9d6639-040b-44b7-b00a-c1022c705c89" status: 200 len: 1281 microversion: 2.1 time: 0.333470 Oct 08 21:04:44.361057 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1609/3157] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:04:44 2022] GET /compute/v2.1/servers/de9d6639-040b-44b7-b00a-c1022c705c89 => generated 1281 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:04:44.373724 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-d495337e-f8c9-4b34-b247-515cb3d1abd0 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3245fc05926b49118c0d1028de3f09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527bbe10db744ab4bcc8078f2d754d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:44.375782 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-d495337e-f8c9-4b34-b247-515cb3d1abd0 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3245fc05926b49118c0d1028de3f09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527bbe10db744ab4bcc8078f2d754d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:44.379378 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-d495337e-f8c9-4b34-b247-515cb3d1abd0 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] 10.222.0.26 "GET /compute/v2.1/servers/93b29a96-2b64-46bd-b6ab-fd44e6599d8f" status: 200 len: 1365 microversion: 2.47 time: 0.156359 Oct 08 21:04:44.381267 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-a2ac1f22-3154-49f0-8780-8eec7aae7fac tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:44.384677 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-a2ac1f22-3154-49f0-8780-8eec7aae7fac tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] [instance: 930c77ec-9649-47fe-bdee-e215c32e28b4] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:44.397994 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a2ac1f22-3154-49f0-8780-8eec7aae7fac tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:44.400687 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1549/3158] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:04:44 2022] GET /compute/v2.1/servers/93b29a96-2b64-46bd-b6ab-fd44e6599d8f => generated 1365 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:04:44.401447 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a2ac1f22-3154-49f0-8780-8eec7aae7fac tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:44.405369 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a2ac1f22-3154-49f0-8780-8eec7aae7fac tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:44.406504 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a2ac1f22-3154-49f0-8780-8eec7aae7fac tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:44.409598 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a2ac1f22-3154-49f0-8780-8eec7aae7fac tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:44.410273 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a2ac1f22-3154-49f0-8780-8eec7aae7fac tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:44.632959 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-a2ac1f22-3154-49f0-8780-8eec7aae7fac tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5000948fa98a4b5d96ad27436d3d0edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917519b500674698a68dc01a4e8d68a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:44.659751 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-a2ac1f22-3154-49f0-8780-8eec7aae7fac tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] 10.222.0.26 "GET /compute/v2.1/servers/930c77ec-9649-47fe-bdee-e215c32e28b4" status: 200 len: 1272 microversion: 2.1 time: 0.284724 Oct 08 21:04:44.662723 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1610/3159] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:04:44 2022] GET /compute/v2.1/servers/930c77ec-9649-47fe-bdee-e215c32e28b4 => generated 1272 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:04:44.790054 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-84386d27-8fe9-4342-82f0-90d289339a8b tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:44.790616 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-84386d27-8fe9-4342-82f0-90d289339a8b tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] [instance: 136d0aa6-479d-4d9c-b633-23203ee44ae4] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:44.804890 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-84386d27-8fe9-4342-82f0-90d289339a8b tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:44.811422 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-84386d27-8fe9-4342-82f0-90d289339a8b tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:44.812168 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-84386d27-8fe9-4342-82f0-90d289339a8b tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:44.812958 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-84386d27-8fe9-4342-82f0-90d289339a8b tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:44.813476 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-84386d27-8fe9-4342-82f0-90d289339a8b tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:44.813937 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-84386d27-8fe9-4342-82f0-90d289339a8b tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:45.048412 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-49cf8806-9796-4634-a267-1488fdef390f tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:45.049861 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-49cf8806-9796-4634-a267-1488fdef390f tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: 6ef37448-690b-4fcf-85f8-a2fb71207f38] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:45.065659 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-49cf8806-9796-4634-a267-1488fdef390f tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:45.066477 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-49cf8806-9796-4634-a267-1488fdef390f tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:45.067887 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-49cf8806-9796-4634-a267-1488fdef390f tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:45.070065 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-49cf8806-9796-4634-a267-1488fdef390f tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:45.073006 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-49cf8806-9796-4634-a267-1488fdef390f tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:45.075621 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-49cf8806-9796-4634-a267-1488fdef390f tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:45.124789 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-84386d27-8fe9-4342-82f0-90d289339a8b tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2e13f1952a4e5bb23d57dd7fa31875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b2a56286924e2d953bebe717ce591b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:45.142171 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-84386d27-8fe9-4342-82f0-90d289339a8b tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] 10.222.0.26 "GET /compute/v2.1/servers/136d0aa6-479d-4d9c-b633-23203ee44ae4" status: 200 len: 1507 microversion: 2.1 time: 0.359271 Oct 08 21:04:45.161219 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1550/3160] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:04:44 2022] GET /compute/v2.1/servers/136d0aa6-479d-4d9c-b633-23203ee44ae4 => generated 1507 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:04:45.235245 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-1647b020-f4bb-404c-98a4-0d96f7294acd tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:45.235882 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-1647b020-f4bb-404c-98a4-0d96f7294acd tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] [instance: 562434d8-1c7a-4aa4-8cb5-e5d37bf07592] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:45.245321 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1647b020-f4bb-404c-98a4-0d96f7294acd tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:45.246296 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1647b020-f4bb-404c-98a4-0d96f7294acd tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:45.251393 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1647b020-f4bb-404c-98a4-0d96f7294acd tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:45.252940 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1647b020-f4bb-404c-98a4-0d96f7294acd tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:45.254395 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1647b020-f4bb-404c-98a4-0d96f7294acd tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:45.255059 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1647b020-f4bb-404c-98a4-0d96f7294acd tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:45.392131 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-1647b020-f4bb-404c-98a4-0d96f7294acd tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07280ef2c5da4903a62092a44499f455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92d768a1a654e199e14845aab7d565b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:45.411902 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-1647b020-f4bb-404c-98a4-0d96f7294acd tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07280ef2c5da4903a62092a44499f455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92d768a1a654e199e14845aab7d565b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:45.414726 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-1647b020-f4bb-404c-98a4-0d96f7294acd tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07280ef2c5da4903a62092a44499f455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92d768a1a654e199e14845aab7d565b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:45.416216 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-1647b020-f4bb-404c-98a4-0d96f7294acd tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] 10.222.0.26 "GET /compute/v2.1/servers/562434d8-1c7a-4aa4-8cb5-e5d37bf07592" status: 200 len: 1365 microversion: 2.57 time: 0.185106 Oct 08 21:04:45.420808 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1551/3161] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:04:45 2022] GET /compute/v2.1/servers/562434d8-1c7a-4aa4-8cb5-e5d37bf07592 => generated 1365 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 08 21:04:45.435593 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-acf5ad96-c08c-4e35-a5f8-34539aedf5e3 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:45.438472 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-acf5ad96-c08c-4e35-a5f8-34539aedf5e3 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] [instance: de9d6639-040b-44b7-b00a-c1022c705c89] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:45.459759 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-acf5ad96-c08c-4e35-a5f8-34539aedf5e3 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:45.463498 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-acf5ad96-c08c-4e35-a5f8-34539aedf5e3 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:45.465854 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-acf5ad96-c08c-4e35-a5f8-34539aedf5e3 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:45.469375 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-acf5ad96-c08c-4e35-a5f8-34539aedf5e3 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:45.470166 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-acf5ad96-c08c-4e35-a5f8-34539aedf5e3 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:45.471511 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-acf5ad96-c08c-4e35-a5f8-34539aedf5e3 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:45.554335 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-49cf8806-9796-4634-a267-1488fdef390f tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:45.576044 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-49cf8806-9796-4634-a267-1488fdef390f tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/6ef37448-690b-4fcf-85f8-a2fb71207f38" status: 200 len: 1469 microversion: 2.1 time: 0.518958 Oct 08 21:04:45.578305 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1611/3162] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:04:45 2022] GET /compute/v2.1/servers/6ef37448-690b-4fcf-85f8-a2fb71207f38 => generated 1469 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:04:45.590570 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-ed8c49b7-8844-4479-8601-4a4361b04b90 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:45.591204 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-ed8c49b7-8844-4479-8601-4a4361b04b90 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] [instance: 93b29a96-2b64-46bd-b6ab-fd44e6599d8f] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:45.634983 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ed8c49b7-8844-4479-8601-4a4361b04b90 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:45.638257 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ed8c49b7-8844-4479-8601-4a4361b04b90 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:45.650202 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ed8c49b7-8844-4479-8601-4a4361b04b90 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:45.651510 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ed8c49b7-8844-4479-8601-4a4361b04b90 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:45.658340 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ed8c49b7-8844-4479-8601-4a4361b04b90 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:45.659012 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ed8c49b7-8844-4479-8601-4a4361b04b90 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:45.732777 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:04:46.523948 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-ed8c49b7-8844-4479-8601-4a4361b04b90 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3245fc05926b49118c0d1028de3f09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527bbe10db744ab4bcc8078f2d754d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:46.549364 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-ed8c49b7-8844-4479-8601-4a4361b04b90 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3245fc05926b49118c0d1028de3f09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527bbe10db744ab4bcc8078f2d754d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:46.553221 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-ed8c49b7-8844-4479-8601-4a4361b04b90 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3245fc05926b49118c0d1028de3f09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527bbe10db744ab4bcc8078f2d754d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:46.558688 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-ed8c49b7-8844-4479-8601-4a4361b04b90 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] 10.222.0.26 "GET /compute/v2.1/servers/93b29a96-2b64-46bd-b6ab-fd44e6599d8f" status: 200 len: 1365 microversion: 2.47 time: 0.979204 Oct 08 21:04:46.559319 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1612/3163] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:04:45 2022] GET /compute/v2.1/servers/93b29a96-2b64-46bd-b6ab-fd44e6599d8f => generated 1365 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:04:46.577587 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-0fc3e920-0488-421d-af4e-52ab1c3aad90 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:46.578222 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-0fc3e920-0488-421d-af4e-52ab1c3aad90 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] [instance: 930c77ec-9649-47fe-bdee-e215c32e28b4] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:46.590294 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0fc3e920-0488-421d-af4e-52ab1c3aad90 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:46.590730 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0fc3e920-0488-421d-af4e-52ab1c3aad90 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:46.591182 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0fc3e920-0488-421d-af4e-52ab1c3aad90 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:46.591910 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0fc3e920-0488-421d-af4e-52ab1c3aad90 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:46.592383 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0fc3e920-0488-421d-af4e-52ab1c3aad90 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:46.592819 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0fc3e920-0488-421d-af4e-52ab1c3aad90 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:46.834346 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-acf5ad96-c08c-4e35-a5f8-34539aedf5e3 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c6153d58d264272a375b3169e0874d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c405aac48e9b403ca8d1e3ac28fab76e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:46.843416 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-acf5ad96-c08c-4e35-a5f8-34539aedf5e3 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] 10.222.0.26 "GET /compute/v2.1/servers/de9d6639-040b-44b7-b00a-c1022c705c89" status: 200 len: 1323 microversion: 2.1 time: 1.420316 Oct 08 21:04:46.845341 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1552/3164] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:04:45 2022] GET /compute/v2.1/servers/de9d6639-040b-44b7-b00a-c1022c705c89 => generated 1323 bytes in 1423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:04:46.859334 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c20bb8ff-f084-46a3-90ea-ea2405b1816d tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:46.860305 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-c20bb8ff-f084-46a3-90ea-ea2405b1816d tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] [instance: 136d0aa6-479d-4d9c-b633-23203ee44ae4] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:46.871856 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c20bb8ff-f084-46a3-90ea-ea2405b1816d tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:46.873890 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c20bb8ff-f084-46a3-90ea-ea2405b1816d tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:46.878582 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c20bb8ff-f084-46a3-90ea-ea2405b1816d tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:46.879602 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c20bb8ff-f084-46a3-90ea-ea2405b1816d tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:46.880265 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c20bb8ff-f084-46a3-90ea-ea2405b1816d tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:46.884306 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c20bb8ff-f084-46a3-90ea-ea2405b1816d tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:46.933879 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:04:47.024338 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-0fc3e920-0488-421d-af4e-52ab1c3aad90 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5000948fa98a4b5d96ad27436d3d0edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917519b500674698a68dc01a4e8d68a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:47.041812 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-0fc3e920-0488-421d-af4e-52ab1c3aad90 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] 10.222.0.26 "GET /compute/v2.1/servers/930c77ec-9649-47fe-bdee-e215c32e28b4" status: 200 len: 1280 microversion: 2.1 time: 0.481310 Oct 08 21:04:47.043584 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1613/3165] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:04:46 2022] GET /compute/v2.1/servers/930c77ec-9649-47fe-bdee-e215c32e28b4 => generated 1280 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:04:47.053429 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-1838f544-e788-4d18-bd82-574311a8fc9c tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:47.059525 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-1838f544-e788-4d18-bd82-574311a8fc9c tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] [instance: 562434d8-1c7a-4aa4-8cb5-e5d37bf07592] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:47.087787 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1838f544-e788-4d18-bd82-574311a8fc9c tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:47.090760 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1838f544-e788-4d18-bd82-574311a8fc9c tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:47.092260 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1838f544-e788-4d18-bd82-574311a8fc9c tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:47.095573 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1838f544-e788-4d18-bd82-574311a8fc9c tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:47.097700 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1838f544-e788-4d18-bd82-574311a8fc9c tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:47.099508 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1838f544-e788-4d18-bd82-574311a8fc9c tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:47.378021 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-1838f544-e788-4d18-bd82-574311a8fc9c tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07280ef2c5da4903a62092a44499f455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92d768a1a654e199e14845aab7d565b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:47.386750 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-1838f544-e788-4d18-bd82-574311a8fc9c tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07280ef2c5da4903a62092a44499f455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92d768a1a654e199e14845aab7d565b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:47.388223 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-1838f544-e788-4d18-bd82-574311a8fc9c tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07280ef2c5da4903a62092a44499f455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92d768a1a654e199e14845aab7d565b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:47.389472 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-1838f544-e788-4d18-bd82-574311a8fc9c tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] 10.222.0.26 "GET /compute/v2.1/servers/562434d8-1c7a-4aa4-8cb5-e5d37bf07592" status: 200 len: 1371 microversion: 2.57 time: 0.344807 Oct 08 21:04:47.413502 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1614/3166] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:04:47 2022] GET /compute/v2.1/servers/562434d8-1c7a-4aa4-8cb5-e5d37bf07592 => generated 1371 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:04:47.427729 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-42d406bf-4828-40f1-801b-f86b1ea038bf tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:47.428632 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-42d406bf-4828-40f1-801b-f86b1ea038bf tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: 6ef37448-690b-4fcf-85f8-a2fb71207f38] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:47.438762 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-42d406bf-4828-40f1-801b-f86b1ea038bf tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:47.446400 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-42d406bf-4828-40f1-801b-f86b1ea038bf tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:47.447125 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-42d406bf-4828-40f1-801b-f86b1ea038bf tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:47.448420 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-42d406bf-4828-40f1-801b-f86b1ea038bf tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:47.449654 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-42d406bf-4828-40f1-801b-f86b1ea038bf tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:47.450635 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-42d406bf-4828-40f1-801b-f86b1ea038bf tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:47.873024 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-42d406bf-4828-40f1-801b-f86b1ea038bf tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:47.881986 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-42d406bf-4828-40f1-801b-f86b1ea038bf tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/6ef37448-690b-4fcf-85f8-a2fb71207f38" status: 200 len: 1469 microversion: 2.1 time: 0.466852 Oct 08 21:04:47.887554 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1615/3167] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:04:47 2022] GET /compute/v2.1/servers/6ef37448-690b-4fcf-85f8-a2fb71207f38 => generated 1469 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:04:47.893328 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-2c9b1c8b-7fb3-4db4-804f-cb11964c554f tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:47.901920 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-2c9b1c8b-7fb3-4db4-804f-cb11964c554f tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] [instance: 93b29a96-2b64-46bd-b6ab-fd44e6599d8f] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:47.909138 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2c9b1c8b-7fb3-4db4-804f-cb11964c554f tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:47.913909 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2c9b1c8b-7fb3-4db4-804f-cb11964c554f tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:47.916208 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2c9b1c8b-7fb3-4db4-804f-cb11964c554f tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:47.917125 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2c9b1c8b-7fb3-4db4-804f-cb11964c554f tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:47.920919 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2c9b1c8b-7fb3-4db4-804f-cb11964c554f tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:47.921660 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2c9b1c8b-7fb3-4db4-804f-cb11964c554f tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:48.089069 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-2c9b1c8b-7fb3-4db4-804f-cb11964c554f tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3245fc05926b49118c0d1028de3f09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527bbe10db744ab4bcc8078f2d754d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:48.097697 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-2c9b1c8b-7fb3-4db4-804f-cb11964c554f tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3245fc05926b49118c0d1028de3f09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527bbe10db744ab4bcc8078f2d754d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:48.108266 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-2c9b1c8b-7fb3-4db4-804f-cb11964c554f tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3245fc05926b49118c0d1028de3f09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527bbe10db744ab4bcc8078f2d754d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:48.109867 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-2c9b1c8b-7fb3-4db4-804f-cb11964c554f tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] 10.222.0.26 "GET /compute/v2.1/servers/93b29a96-2b64-46bd-b6ab-fd44e6599d8f" status: 200 len: 1365 microversion: 2.47 time: 0.221009 Oct 08 21:04:48.111108 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1616/3168] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:04:47 2022] GET /compute/v2.1/servers/93b29a96-2b64-46bd-b6ab-fd44e6599d8f => generated 1365 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:04:48.121157 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-0f86129b-5465-4136-ac15-71772483357c tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:48.121526 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-0f86129b-5465-4136-ac15-71772483357c tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] [instance: de9d6639-040b-44b7-b00a-c1022c705c89] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:48.146289 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0f86129b-5465-4136-ac15-71772483357c tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:48.146864 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0f86129b-5465-4136-ac15-71772483357c tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:48.147339 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0f86129b-5465-4136-ac15-71772483357c tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:48.148091 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0f86129b-5465-4136-ac15-71772483357c tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:48.148565 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0f86129b-5465-4136-ac15-71772483357c tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:48.149025 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0f86129b-5465-4136-ac15-71772483357c tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:48.308389 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-c20bb8ff-f084-46a3-90ea-ea2405b1816d tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2e13f1952a4e5bb23d57dd7fa31875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b2a56286924e2d953bebe717ce591b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:48.323351 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-c20bb8ff-f084-46a3-90ea-ea2405b1816d tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] 10.222.0.26 "GET /compute/v2.1/servers/136d0aa6-479d-4d9c-b633-23203ee44ae4" status: 200 len: 1507 microversion: 2.1 time: 1.476115 Oct 08 21:04:48.350536 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1553/3169] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:04:46 2022] GET /compute/v2.1/servers/136d0aa6-479d-4d9c-b633-23203ee44ae4 => generated 1507 bytes in 1498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:04:48.356405 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-dbef80c7-fcb5-4df9-abdd-0b84a8334636 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:48.356964 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-dbef80c7-fcb5-4df9-abdd-0b84a8334636 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] [instance: 930c77ec-9649-47fe-bdee-e215c32e28b4] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:48.387027 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dbef80c7-fcb5-4df9-abdd-0b84a8334636 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:48.387809 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dbef80c7-fcb5-4df9-abdd-0b84a8334636 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:48.388439 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dbef80c7-fcb5-4df9-abdd-0b84a8334636 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:48.389471 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dbef80c7-fcb5-4df9-abdd-0b84a8334636 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:48.390917 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dbef80c7-fcb5-4df9-abdd-0b84a8334636 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:48.394602 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dbef80c7-fcb5-4df9-abdd-0b84a8334636 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:48.630618 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-dbef80c7-fcb5-4df9-abdd-0b84a8334636 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5000948fa98a4b5d96ad27436d3d0edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917519b500674698a68dc01a4e8d68a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:48.640667 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-dbef80c7-fcb5-4df9-abdd-0b84a8334636 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] 10.222.0.26 "GET /compute/v2.1/servers/930c77ec-9649-47fe-bdee-e215c32e28b4" status: 200 len: 1278 microversion: 2.1 time: 0.288537 Oct 08 21:04:48.647245 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1554/3170] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:04:48 2022] GET /compute/v2.1/servers/930c77ec-9649-47fe-bdee-e215c32e28b4 => generated 1278 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:04:48.660240 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-0f86129b-5465-4136-ac15-71772483357c tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c6153d58d264272a375b3169e0874d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c405aac48e9b403ca8d1e3ac28fab76e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:48.669413 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-4ed9fb0b-65f3-4ee5-beff-22db1390124f tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:48.673365 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-4ed9fb0b-65f3-4ee5-beff-22db1390124f tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] [instance: 562434d8-1c7a-4aa4-8cb5-e5d37bf07592] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:48.680121 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-0f86129b-5465-4136-ac15-71772483357c tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] 10.222.0.26 "GET /compute/v2.1/servers/de9d6639-040b-44b7-b00a-c1022c705c89" status: 200 len: 1323 microversion: 2.1 time: 0.562887 Oct 08 21:04:48.686017 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1617/3171] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:04:48 2022] GET /compute/v2.1/servers/de9d6639-040b-44b7-b00a-c1022c705c89 => generated 1323 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:04:48.707997 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4ed9fb0b-65f3-4ee5-beff-22db1390124f tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:48.709763 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4ed9fb0b-65f3-4ee5-beff-22db1390124f tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:48.712205 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-0d03ff78-ba05-4da6-a10e-e51386c853dc req-0c0c963c-0c6c-4903-835c-9b1abdc9628b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "136d0aa6-479d-4d9c-b633-23203ee44ae4", "name": "network-vif-deleted", "tag": "d41be44e-6c58-4f86-ad3d-4f4cdf8c4028"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:04:48.713020 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4ed9fb0b-65f3-4ee5-beff-22db1390124f tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:48.716711 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4ed9fb0b-65f3-4ee5-beff-22db1390124f tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:48.717498 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4ed9fb0b-65f3-4ee5-beff-22db1390124f tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:48.726747 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4ed9fb0b-65f3-4ee5-beff-22db1390124f tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:48.747673 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-0d03ff78-ba05-4da6-a10e-e51386c853dc req-0c0c963c-0c6c-4903-835c-9b1abdc9628b service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:48.749096 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-0d03ff78-ba05-4da6-a10e-e51386c853dc req-0c0c963c-0c6c-4903-835c-9b1abdc9628b service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:48.759557 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-0d03ff78-ba05-4da6-a10e-e51386c853dc req-0c0c963c-0c6c-4903-835c-9b1abdc9628b service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:48.784313 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-0d03ff78-ba05-4da6-a10e-e51386c853dc req-0c0c963c-0c6c-4903-835c-9b1abdc9628b service nova] Creating event network-vif-deleted:d41be44e-6c58-4f86-ad3d-4f4cdf8c4028 for instance 136d0aa6-479d-4d9c-b633-23203ee44ae4 on nch2-master-1 Oct 08 21:04:48.813775 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-0d03ff78-ba05-4da6-a10e-e51386c853dc req-0c0c963c-0c6c-4903-835c-9b1abdc9628b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114467 Oct 08 21:04:48.815743 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1618/3172] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:04:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:04:48.937995 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-88115ae6-bc19-4b1f-94f5-81001bab775e tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:48.940629 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-88115ae6-bc19-4b1f-94f5-81001bab775e tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: 6ef37448-690b-4fcf-85f8-a2fb71207f38] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:48.959213 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-88115ae6-bc19-4b1f-94f5-81001bab775e tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:48.959873 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-88115ae6-bc19-4b1f-94f5-81001bab775e tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:48.960424 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-88115ae6-bc19-4b1f-94f5-81001bab775e tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:48.966462 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-88115ae6-bc19-4b1f-94f5-81001bab775e tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:48.967388 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-88115ae6-bc19-4b1f-94f5-81001bab775e tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:48.968311 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-88115ae6-bc19-4b1f-94f5-81001bab775e tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:49.114405 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-4ed9fb0b-65f3-4ee5-beff-22db1390124f tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07280ef2c5da4903a62092a44499f455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92d768a1a654e199e14845aab7d565b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:49.123815 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-4ed9fb0b-65f3-4ee5-beff-22db1390124f tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07280ef2c5da4903a62092a44499f455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92d768a1a654e199e14845aab7d565b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:49.131699 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-4ed9fb0b-65f3-4ee5-beff-22db1390124f tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07280ef2c5da4903a62092a44499f455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92d768a1a654e199e14845aab7d565b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:49.134672 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-4ed9fb0b-65f3-4ee5-beff-22db1390124f tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] 10.222.0.26 "GET /compute/v2.1/servers/562434d8-1c7a-4aa4-8cb5-e5d37bf07592" status: 200 len: 1371 microversion: 2.57 time: 0.486042 Oct 08 21:04:49.154646 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1555/3173] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:04:48 2022] GET /compute/v2.1/servers/562434d8-1c7a-4aa4-8cb5-e5d37bf07592 => generated 1371 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:04:49.167259 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-fde57e5d-a97a-4daa-9fff-55a387659c9d tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:49.187400 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-fde57e5d-a97a-4daa-9fff-55a387659c9d tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] [instance: 93b29a96-2b64-46bd-b6ab-fd44e6599d8f] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:49.195377 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fde57e5d-a97a-4daa-9fff-55a387659c9d tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:49.196519 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fde57e5d-a97a-4daa-9fff-55a387659c9d tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:49.197331 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fde57e5d-a97a-4daa-9fff-55a387659c9d tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:49.198609 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fde57e5d-a97a-4daa-9fff-55a387659c9d tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:49.199349 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fde57e5d-a97a-4daa-9fff-55a387659c9d tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:49.200134 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fde57e5d-a97a-4daa-9fff-55a387659c9d tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:49.279529 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=2 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:04:49.447913 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-fde57e5d-a97a-4daa-9fff-55a387659c9d tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3245fc05926b49118c0d1028de3f09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527bbe10db744ab4bcc8078f2d754d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:49.463620 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-fde57e5d-a97a-4daa-9fff-55a387659c9d tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3245fc05926b49118c0d1028de3f09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527bbe10db744ab4bcc8078f2d754d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:49.469272 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-fde57e5d-a97a-4daa-9fff-55a387659c9d tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3245fc05926b49118c0d1028de3f09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527bbe10db744ab4bcc8078f2d754d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:49.471481 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-fde57e5d-a97a-4daa-9fff-55a387659c9d tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] 10.222.0.26 "GET /compute/v2.1/servers/93b29a96-2b64-46bd-b6ab-fd44e6599d8f" status: 200 len: 1365 microversion: 2.47 time: 0.315311 Oct 08 21:04:49.474742 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1556/3174] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:04:49 2022] GET /compute/v2.1/servers/93b29a96-2b64-46bd-b6ab-fd44e6599d8f => generated 1365 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:04:49.489107 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c743d7fd-c304-405f-92ed-6e6db74291e4 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:49.490138 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-c743d7fd-c304-405f-92ed-6e6db74291e4 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] [instance: 136d0aa6-479d-4d9c-b633-23203ee44ae4] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:49.507734 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c743d7fd-c304-405f-92ed-6e6db74291e4 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:49.508630 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c743d7fd-c304-405f-92ed-6e6db74291e4 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:49.509562 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c743d7fd-c304-405f-92ed-6e6db74291e4 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:49.510535 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c743d7fd-c304-405f-92ed-6e6db74291e4 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:49.514425 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c743d7fd-c304-405f-92ed-6e6db74291e4 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:49.521093 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c743d7fd-c304-405f-92ed-6e6db74291e4 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:49.658574 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-c743d7fd-c304-405f-92ed-6e6db74291e4 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2e13f1952a4e5bb23d57dd7fa31875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b2a56286924e2d953bebe717ce591b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:49.676629 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-c743d7fd-c304-405f-92ed-6e6db74291e4 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] 10.222.0.26 "GET /compute/v2.1/servers/136d0aa6-479d-4d9c-b633-23203ee44ae4" status: 200 len: 1299 microversion: 2.1 time: 0.198014 Oct 08 21:04:49.678016 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1557/3175] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:04:49 2022] GET /compute/v2.1/servers/136d0aa6-479d-4d9c-b633-23203ee44ae4 => generated 1299 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:04:49.684357 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-57aff8c1-4c54-4803-814f-f6792c7bf3bd tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:49.687984 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-57aff8c1-4c54-4803-814f-f6792c7bf3bd tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] [instance: 930c77ec-9649-47fe-bdee-e215c32e28b4] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:49.697521 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-57aff8c1-4c54-4803-814f-f6792c7bf3bd tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:49.698303 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-57aff8c1-4c54-4803-814f-f6792c7bf3bd tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:49.698948 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-57aff8c1-4c54-4803-814f-f6792c7bf3bd tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:49.701054 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-57aff8c1-4c54-4803-814f-f6792c7bf3bd tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:49.701860 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-57aff8c1-4c54-4803-814f-f6792c7bf3bd tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:49.702453 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-57aff8c1-4c54-4803-814f-f6792c7bf3bd tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:49.793914 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-88115ae6-bc19-4b1f-94f5-81001bab775e tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:49.808144 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-88115ae6-bc19-4b1f-94f5-81001bab775e tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/6ef37448-690b-4fcf-85f8-a2fb71207f38" status: 200 len: 1469 microversion: 2.1 time: 0.888495 Oct 08 21:04:49.809000 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1619/3176] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:04:48 2022] GET /compute/v2.1/servers/6ef37448-690b-4fcf-85f8-a2fb71207f38 => generated 1469 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:04:49.824531 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-57aff8c1-4c54-4803-814f-f6792c7bf3bd tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5000948fa98a4b5d96ad27436d3d0edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917519b500674698a68dc01a4e8d68a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:49.837514 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-aa87451f-d091-413f-a58a-df16225f4c37 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:49.842723 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-57aff8c1-4c54-4803-814f-f6792c7bf3bd tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] 10.222.0.26 "GET /compute/v2.1/servers/930c77ec-9649-47fe-bdee-e215c32e28b4" status: 200 len: 1278 microversion: 2.1 time: 0.163358 Oct 08 21:04:49.843757 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-aa87451f-d091-413f-a58a-df16225f4c37 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] [instance: de9d6639-040b-44b7-b00a-c1022c705c89] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:49.846830 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1558/3177] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:04:49 2022] GET /compute/v2.1/servers/930c77ec-9649-47fe-bdee-e215c32e28b4 => generated 1278 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:04:49.852098 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-aa87451f-d091-413f-a58a-df16225f4c37 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:49.852798 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-aa87451f-d091-413f-a58a-df16225f4c37 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:49.853488 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-aa87451f-d091-413f-a58a-df16225f4c37 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:49.854375 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-aa87451f-d091-413f-a58a-df16225f4c37 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:49.854996 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-aa87451f-d091-413f-a58a-df16225f4c37 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:49.855591 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-aa87451f-d091-413f-a58a-df16225f4c37 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:50.176878 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-7f53511c-003d-4a23-b918-b4b574cb0a86 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:50.177561 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-7f53511c-003d-4a23-b918-b4b574cb0a86 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] [instance: 562434d8-1c7a-4aa4-8cb5-e5d37bf07592] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:50.185417 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7f53511c-003d-4a23-b918-b4b574cb0a86 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:50.185929 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7f53511c-003d-4a23-b918-b4b574cb0a86 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:50.186376 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7f53511c-003d-4a23-b918-b4b574cb0a86 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:50.187097 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7f53511c-003d-4a23-b918-b4b574cb0a86 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:50.187840 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7f53511c-003d-4a23-b918-b4b574cb0a86 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:50.188437 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7f53511c-003d-4a23-b918-b4b574cb0a86 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:50.271118 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=8 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:04:50.377212 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-aa87451f-d091-413f-a58a-df16225f4c37 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c6153d58d264272a375b3169e0874d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c405aac48e9b403ca8d1e3ac28fab76e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:50.394834 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-aa87451f-d091-413f-a58a-df16225f4c37 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] 10.222.0.26 "GET /compute/v2.1/servers/de9d6639-040b-44b7-b00a-c1022c705c89" status: 200 len: 1323 microversion: 2.1 time: 0.562174 Oct 08 21:04:50.396493 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1620/3178] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:04:49 2022] GET /compute/v2.1/servers/de9d6639-040b-44b7-b00a-c1022c705c89 => generated 1323 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:04:50.404030 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-33c066fc-a9de-4492-8c56-d47462396d56 req-00be42ba-095c-4814-b6e0-955961eb5a35 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de9d6639-040b-44b7-b00a-c1022c705c89", "tag": "ca9cb617-2f51-474b-b74d-d32ecd4a80b9"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:04:50.418951 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-33c066fc-a9de-4492-8c56-d47462396d56 req-00be42ba-095c-4814-b6e0-955961eb5a35 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:50.420026 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-33c066fc-a9de-4492-8c56-d47462396d56 req-00be42ba-095c-4814-b6e0-955961eb5a35 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:50.422058 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-33c066fc-a9de-4492-8c56-d47462396d56 req-00be42ba-095c-4814-b6e0-955961eb5a35 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:50.443155 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-7f53511c-003d-4a23-b918-b4b574cb0a86 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07280ef2c5da4903a62092a44499f455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92d768a1a654e199e14845aab7d565b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:50.453704 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-33c066fc-a9de-4492-8c56-d47462396d56 req-00be42ba-095c-4814-b6e0-955961eb5a35 service nova] Creating event network-changed:ca9cb617-2f51-474b-b74d-d32ecd4a80b9 for instance de9d6639-040b-44b7-b00a-c1022c705c89 on nch1-master-1 Oct 08 21:04:50.462072 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-7f53511c-003d-4a23-b918-b4b574cb0a86 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07280ef2c5da4903a62092a44499f455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92d768a1a654e199e14845aab7d565b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:50.464339 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-7f53511c-003d-4a23-b918-b4b574cb0a86 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07280ef2c5da4903a62092a44499f455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92d768a1a654e199e14845aab7d565b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:50.467303 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-7f53511c-003d-4a23-b918-b4b574cb0a86 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] 10.222.0.26 "GET /compute/v2.1/servers/562434d8-1c7a-4aa4-8cb5-e5d37bf07592" status: 200 len: 1356 microversion: 2.57 time: 0.293679 Oct 08 21:04:50.472775 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1559/3179] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:04:50 2022] GET /compute/v2.1/servers/562434d8-1c7a-4aa4-8cb5-e5d37bf07592 => generated 1356 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 08 21:04:50.480214 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-33c066fc-a9de-4492-8c56-d47462396d56 req-00be42ba-095c-4814-b6e0-955961eb5a35 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075528 Oct 08 21:04:50.483389 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1621/3180] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:04:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:04:50.504298 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-336f016b-4452-40bc-a7d9-6c9afc5c74c9 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:50.504923 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-336f016b-4452-40bc-a7d9-6c9afc5c74c9 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] [instance: 93b29a96-2b64-46bd-b6ab-fd44e6599d8f] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:50.513570 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-c69c7b8f-85d0-4688-a9ec-cfc4e3c491e1 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:50.519150 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-c69c7b8f-85d0-4688-a9ec-cfc4e3c491e1 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] [instance: 562434d8-1c7a-4aa4-8cb5-e5d37bf07592] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:50.522411 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-336f016b-4452-40bc-a7d9-6c9afc5c74c9 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:50.522925 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-336f016b-4452-40bc-a7d9-6c9afc5c74c9 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:50.523373 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-336f016b-4452-40bc-a7d9-6c9afc5c74c9 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:50.524096 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-336f016b-4452-40bc-a7d9-6c9afc5c74c9 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:50.524564 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-336f016b-4452-40bc-a7d9-6c9afc5c74c9 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:50.524995 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-336f016b-4452-40bc-a7d9-6c9afc5c74c9 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:50.543311 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c69c7b8f-85d0-4688-a9ec-cfc4e3c491e1 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:50.543824 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c69c7b8f-85d0-4688-a9ec-cfc4e3c491e1 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:50.544279 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c69c7b8f-85d0-4688-a9ec-cfc4e3c491e1 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:50.554049 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c69c7b8f-85d0-4688-a9ec-cfc4e3c491e1 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:50.559881 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c69c7b8f-85d0-4688-a9ec-cfc4e3c491e1 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:50.560589 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c69c7b8f-85d0-4688-a9ec-cfc4e3c491e1 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:50.623603 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-c69c7b8f-85d0-4688-a9ec-cfc4e3c491e1 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] [instance: 562434d8-1c7a-4aa4-8cb5-e5d37bf07592] Going to try to terminate instance {{(pid=140492) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 21:04:50.760089 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-c69c7b8f-85d0-4688-a9ec-cfc4e3c491e1 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] 10.222.0.26 "DELETE /compute/v2.1/servers/562434d8-1c7a-4aa4-8cb5-e5d37bf07592" status: 204 len: 0 microversion: 2.57 time: 0.250071 Oct 08 21:04:50.762100 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1622/3181] 10.222.0.26 () {60 vars in 1280 bytes} [Sat Oct 8 21:04:50 2022] DELETE /compute/v2.1/servers/562434d8-1c7a-4aa4-8cb5-e5d37bf07592 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 08 21:04:50.775888 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e4fcb8f0-a075-4ca6-8508-85bceec77071 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:50.777172 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-e4fcb8f0-a075-4ca6-8508-85bceec77071 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] [instance: 136d0aa6-479d-4d9c-b633-23203ee44ae4] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:50.790114 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e4fcb8f0-a075-4ca6-8508-85bceec77071 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:50.790914 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e4fcb8f0-a075-4ca6-8508-85bceec77071 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:50.792085 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e4fcb8f0-a075-4ca6-8508-85bceec77071 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:50.793390 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e4fcb8f0-a075-4ca6-8508-85bceec77071 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:50.794381 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e4fcb8f0-a075-4ca6-8508-85bceec77071 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:50.794986 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e4fcb8f0-a075-4ca6-8508-85bceec77071 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:50.932204 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e4fcb8f0-a075-4ca6-8508-85bceec77071 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:50.934048 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e4fcb8f0-a075-4ca6-8508-85bceec77071 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:50.935800 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e4fcb8f0-a075-4ca6-8508-85bceec77071 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:50.936331 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.objects.instance [None req-e4fcb8f0-a075-4ca6-8508-85bceec77071 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lazy-loading 'fault' on Instance uuid 136d0aa6-479d-4d9c-b633-23203ee44ae4 {{(pid=140492) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 21:04:51.188243 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-336f016b-4452-40bc-a7d9-6c9afc5c74c9 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3245fc05926b49118c0d1028de3f09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527bbe10db744ab4bcc8078f2d754d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:51.197607 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-336f016b-4452-40bc-a7d9-6c9afc5c74c9 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3245fc05926b49118c0d1028de3f09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527bbe10db744ab4bcc8078f2d754d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:51.199076 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-336f016b-4452-40bc-a7d9-6c9afc5c74c9 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3245fc05926b49118c0d1028de3f09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527bbe10db744ab4bcc8078f2d754d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:51.200277 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-336f016b-4452-40bc-a7d9-6c9afc5c74c9 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] 10.222.0.26 "GET /compute/v2.1/servers/93b29a96-2b64-46bd-b6ab-fd44e6599d8f" status: 200 len: 1365 microversion: 2.47 time: 0.700220 Oct 08 21:04:51.201137 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1560/3182] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:04:50 2022] GET /compute/v2.1/servers/93b29a96-2b64-46bd-b6ab-fd44e6599d8f => generated 1365 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:04:51.206601 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-2bb6af31-2134-4acc-b0d2-488b93c12783 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:51.213805 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-e4fcb8f0-a075-4ca6-8508-85bceec77071 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2e13f1952a4e5bb23d57dd7fa31875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b2a56286924e2d953bebe717ce591b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:51.215010 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-2bb6af31-2134-4acc-b0d2-488b93c12783 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] [instance: 562434d8-1c7a-4aa4-8cb5-e5d37bf07592] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:51.222654 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-e4fcb8f0-a075-4ca6-8508-85bceec77071 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] 10.222.0.26 "GET /compute/v2.1/servers/136d0aa6-479d-4d9c-b633-23203ee44ae4" status: 200 len: 1304 microversion: 2.1 time: 0.458887 Oct 08 21:04:51.232212 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1623/3183] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:04:50 2022] GET /compute/v2.1/servers/136d0aa6-479d-4d9c-b633-23203ee44ae4 => generated 1304 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:04:51.247023 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2bb6af31-2134-4acc-b0d2-488b93c12783 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:51.247536 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2bb6af31-2134-4acc-b0d2-488b93c12783 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:51.247991 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2bb6af31-2134-4acc-b0d2-488b93c12783 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:51.248578 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-794d30f8-e02e-4ee8-a71a-be0a72a0ed3b tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:51.248797 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2bb6af31-2134-4acc-b0d2-488b93c12783 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:51.249162 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2bb6af31-2134-4acc-b0d2-488b93c12783 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:51.249622 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2bb6af31-2134-4acc-b0d2-488b93c12783 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:51.250107 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-794d30f8-e02e-4ee8-a71a-be0a72a0ed3b tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: 6ef37448-690b-4fcf-85f8-a2fb71207f38] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:51.256854 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-794d30f8-e02e-4ee8-a71a-be0a72a0ed3b tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:51.257737 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-794d30f8-e02e-4ee8-a71a-be0a72a0ed3b tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:51.258420 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-794d30f8-e02e-4ee8-a71a-be0a72a0ed3b tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:51.259382 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-794d30f8-e02e-4ee8-a71a-be0a72a0ed3b tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:51.260083 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-794d30f8-e02e-4ee8-a71a-be0a72a0ed3b tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:51.260733 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-794d30f8-e02e-4ee8-a71a-be0a72a0ed3b tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:51.446490 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-2bb6af31-2134-4acc-b0d2-488b93c12783 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07280ef2c5da4903a62092a44499f455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92d768a1a654e199e14845aab7d565b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:51.459040 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-2bb6af31-2134-4acc-b0d2-488b93c12783 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07280ef2c5da4903a62092a44499f455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92d768a1a654e199e14845aab7d565b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:51.460817 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-2bb6af31-2134-4acc-b0d2-488b93c12783 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07280ef2c5da4903a62092a44499f455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92d768a1a654e199e14845aab7d565b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:51.463085 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-2bb6af31-2134-4acc-b0d2-488b93c12783 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] 10.222.0.26 "GET /compute/v2.1/servers/562434d8-1c7a-4aa4-8cb5-e5d37bf07592" status: 200 len: 1362 microversion: 2.57 time: 0.260566 Oct 08 21:04:51.464096 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1561/3184] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:04:51 2022] GET /compute/v2.1/servers/562434d8-1c7a-4aa4-8cb5-e5d37bf07592 => generated 1362 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:04:51.500554 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-e7f9c2a9-dabf-47d1-94ed-23e8400f6ce5 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:51.501675 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-e7f9c2a9-dabf-47d1-94ed-23e8400f6ce5 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] [instance: 930c77ec-9649-47fe-bdee-e215c32e28b4] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:51.509773 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e7f9c2a9-dabf-47d1-94ed-23e8400f6ce5 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:51.510573 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e7f9c2a9-dabf-47d1-94ed-23e8400f6ce5 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:51.511195 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e7f9c2a9-dabf-47d1-94ed-23e8400f6ce5 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:51.512435 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e7f9c2a9-dabf-47d1-94ed-23e8400f6ce5 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:51.513107 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e7f9c2a9-dabf-47d1-94ed-23e8400f6ce5 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:51.513725 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e7f9c2a9-dabf-47d1-94ed-23e8400f6ce5 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:51.819462 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-e7f9c2a9-dabf-47d1-94ed-23e8400f6ce5 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5000948fa98a4b5d96ad27436d3d0edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917519b500674698a68dc01a4e8d68a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:51.833398 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-e7f9c2a9-dabf-47d1-94ed-23e8400f6ce5 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] 10.222.0.26 "GET /compute/v2.1/servers/930c77ec-9649-47fe-bdee-e215c32e28b4" status: 200 len: 1320 microversion: 2.1 time: 0.367908 Oct 08 21:04:51.834818 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1562/3185] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:04:51 2022] GET /compute/v2.1/servers/930c77ec-9649-47fe-bdee-e215c32e28b4 => generated 1320 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:04:51.847795 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-ebeddc08-3dab-4f6e-aa57-40582a2d5885 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:51.850221 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-ebeddc08-3dab-4f6e-aa57-40582a2d5885 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] [instance: de9d6639-040b-44b7-b00a-c1022c705c89] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:51.884965 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ebeddc08-3dab-4f6e-aa57-40582a2d5885 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:51.885645 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ebeddc08-3dab-4f6e-aa57-40582a2d5885 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:51.886517 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ebeddc08-3dab-4f6e-aa57-40582a2d5885 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:51.887531 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ebeddc08-3dab-4f6e-aa57-40582a2d5885 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:51.888324 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ebeddc08-3dab-4f6e-aa57-40582a2d5885 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:51.888960 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ebeddc08-3dab-4f6e-aa57-40582a2d5885 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:52.067003 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-794d30f8-e02e-4ee8-a71a-be0a72a0ed3b tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:52.081774 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-794d30f8-e02e-4ee8-a71a-be0a72a0ed3b tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/6ef37448-690b-4fcf-85f8-a2fb71207f38" status: 200 len: 1462 microversion: 2.1 time: 0.834006 Oct 08 21:04:52.099435 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1624/3186] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:04:51 2022] GET /compute/v2.1/servers/6ef37448-690b-4fcf-85f8-a2fb71207f38 => generated 1462 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:04:52.248626 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-ebeddc08-3dab-4f6e-aa57-40582a2d5885 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c6153d58d264272a375b3169e0874d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c405aac48e9b403ca8d1e3ac28fab76e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:52.274030 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-ebeddc08-3dab-4f6e-aa57-40582a2d5885 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] 10.222.0.26 "GET /compute/v2.1/servers/de9d6639-040b-44b7-b00a-c1022c705c89" status: 200 len: 1323 microversion: 2.1 time: 0.437396 Oct 08 21:04:52.294940 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1563/3187] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:04:51 2022] GET /compute/v2.1/servers/de9d6639-040b-44b7-b00a-c1022c705c89 => generated 1323 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:04:52.304519 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-b96c5ab6-f782-4384-b8cd-f79082a8fc68 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:52.306196 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-b96c5ab6-f782-4384-b8cd-f79082a8fc68 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] [instance: 93b29a96-2b64-46bd-b6ab-fd44e6599d8f] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:52.323532 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b96c5ab6-f782-4384-b8cd-f79082a8fc68 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:52.324587 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b96c5ab6-f782-4384-b8cd-f79082a8fc68 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:52.326808 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b96c5ab6-f782-4384-b8cd-f79082a8fc68 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:52.327753 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b96c5ab6-f782-4384-b8cd-f79082a8fc68 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:52.328608 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b96c5ab6-f782-4384-b8cd-f79082a8fc68 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:52.333882 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b96c5ab6-f782-4384-b8cd-f79082a8fc68 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:52.597410 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-76d810c6-d1bd-40fb-b9c2-7c907aeb24ae tempest-MigrationsAdminTest-1609748928 tempest-MigrationsAdminTest-1609748928-project-admin] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:52.598373 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-76d810c6-d1bd-40fb-b9c2-7c907aeb24ae tempest-MigrationsAdminTest-1609748928 tempest-MigrationsAdminTest-1609748928-project-admin] [instance: 6ef37448-690b-4fcf-85f8-a2fb71207f38] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:52.606659 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-76d810c6-d1bd-40fb-b9c2-7c907aeb24ae tempest-MigrationsAdminTest-1609748928 tempest-MigrationsAdminTest-1609748928-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:52.607686 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-76d810c6-d1bd-40fb-b9c2-7c907aeb24ae tempest-MigrationsAdminTest-1609748928 tempest-MigrationsAdminTest-1609748928-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:52.608458 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-76d810c6-d1bd-40fb-b9c2-7c907aeb24ae tempest-MigrationsAdminTest-1609748928 tempest-MigrationsAdminTest-1609748928-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:52.609950 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-76d810c6-d1bd-40fb-b9c2-7c907aeb24ae tempest-MigrationsAdminTest-1609748928 tempest-MigrationsAdminTest-1609748928-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:52.610595 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-76d810c6-d1bd-40fb-b9c2-7c907aeb24ae tempest-MigrationsAdminTest-1609748928 tempest-MigrationsAdminTest-1609748928-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:52.611226 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-76d810c6-d1bd-40fb-b9c2-7c907aeb24ae tempest-MigrationsAdminTest-1609748928 tempest-MigrationsAdminTest-1609748928-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:53.002305 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-b96c5ab6-f782-4384-b8cd-f79082a8fc68 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3245fc05926b49118c0d1028de3f09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527bbe10db744ab4bcc8078f2d754d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:53.014957 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-b96c5ab6-f782-4384-b8cd-f79082a8fc68 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3245fc05926b49118c0d1028de3f09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527bbe10db744ab4bcc8078f2d754d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:53.016750 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-b96c5ab6-f782-4384-b8cd-f79082a8fc68 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3245fc05926b49118c0d1028de3f09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527bbe10db744ab4bcc8078f2d754d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:53.018797 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-b96c5ab6-f782-4384-b8cd-f79082a8fc68 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] 10.222.0.26 "GET /compute/v2.1/servers/93b29a96-2b64-46bd-b6ab-fd44e6599d8f" status: 200 len: 1365 microversion: 2.47 time: 0.722246 Oct 08 21:04:53.019900 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1564/3188] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:04:52 2022] GET /compute/v2.1/servers/93b29a96-2b64-46bd-b6ab-fd44e6599d8f => generated 1365 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:04:53.025219 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-77169c6c-5953-485f-9cbc-54fe2418cf07 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:53.026136 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-77169c6c-5953-485f-9cbc-54fe2418cf07 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] [instance: 136d0aa6-479d-4d9c-b633-23203ee44ae4] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:53.035725 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-77169c6c-5953-485f-9cbc-54fe2418cf07 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:53.038598 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-77169c6c-5953-485f-9cbc-54fe2418cf07 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:53.039288 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-77169c6c-5953-485f-9cbc-54fe2418cf07 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:53.042149 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-77169c6c-5953-485f-9cbc-54fe2418cf07 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:53.046930 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-77169c6c-5953-485f-9cbc-54fe2418cf07 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:53.049473 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-77169c6c-5953-485f-9cbc-54fe2418cf07 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:53.094294 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-77169c6c-5953-485f-9cbc-54fe2418cf07 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] HTTP exception thrown: Instance 136d0aa6-479d-4d9c-b633-23203ee44ae4 could not be found. Oct 08 21:04:53.097242 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-77169c6c-5953-485f-9cbc-54fe2418cf07 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Request method failure captured: Oct 08 21:04:53.097242 ncdv-master-1 devstack@n-api.service[140491]: request: GET /compute/v2.1/servers/136d0aa6-479d-4d9c-b633-23203ee44ae4 HTTP/1.1 Oct 08 21:04:53.097242 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:04:53.097242 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:04:53.097242 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:04:53.097242 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 21:04:53.097242 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:04:53.097242 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:04:53.097242 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:04:53.097242 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:04:53.097242 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeVzSRIt5rTQrfJyuOQlK1PvDMGkmLTWxWDV1e9OeipSc7OGozpm0DiV6ed9pImj2w-Ep8gcu0ZARwZRHPSrh6foq-wN9D7n07tB59TtJvIajEV-U2r3gvgNSK4q8VjvthNxW8QBysPddSfSl6Ch4mtN7SNqAxmmR7xqGLFYIYWAYUA Oct 08 21:04:53.097242 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:04:53.097242 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:04:53.097242 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:04:53.097242 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:04:53.097242 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:04:53.097242 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:04:53.097242 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 75b2a56286924e2d953bebe717ce591b Oct 08 21:04:53.097242 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-ServerRescueTestJSON-1567629939 Oct 08 21:04:53.097242 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:04:53.097242 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:04:53.097242 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/75b2a56286924e2d953bebe717ce591b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/75b2a56286924e2d953bebe717ce591b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_75b2a56286924e2d953bebe717ce591b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/75b2a56286924e2d953bebe717ce591b"}]}] Oct 08 21:04:53.097242 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-ServerRescueTestJSON-1567629939 Oct 08 21:04:53.097242 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 75b2a56286924e2d953bebe717ce591b Oct 08 21:04:53.097242 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-ServerRescueTestJSON-1567629939 Oct 08 21:04:53.097242 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-ServerRescueTestJSON-1567629939-project Oct 08 21:04:53.097242 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:04:53.097242 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:04:53.097242 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: bf2e13f1952a4e5bb23d57dd7fa31875 Oct 08 21:04:53.097242 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-ServerRescueTestJSON-1567629939-project Oct 08 21:04:53.097242 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:04:53.097242 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance 136d0aa6-479d-4d9c-b633-23203ee44ae4 could not be found. Oct 08 21:04:53.097242 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': '136d0aa6-479d-4d9c-b633-23203ee44ae4'} Oct 08 21:04:53.097242 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:04:53.097242 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:04:53.097242 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:04:53.097242 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:04:53.097242 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:04:53.097242 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:04:53.097242 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:04:53.097242 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:04:53.097242 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:04:53.097242 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:04:53.097242 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 136d0aa6-479d-4d9c-b633-23203ee44ae4 could not be found. Oct 08 21:04:53.097242 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:04:53.097242 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:04:53.097242 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:04:53.097242 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:04:53.097242 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:04:53.097242 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:04:53.097242 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:04:53.097242 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:04:53.097242 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:04:53.097242 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:04:53.097242 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:04:53.097242 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:04:53.097242 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:04:53.097242 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:04:53.097242 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:04:53.097242 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:04:53.097242 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 136d0aa6-479d-4d9c-b633-23203ee44ae4 could not be found. Oct 08 21:04:53.097242 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:04:53.097242 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:04:53.097242 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:04:53.103376 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:04:53.103376 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:04:53.103376 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:04:53.103376 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:04:53.103376 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:04:53.103376 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 136d0aa6-479d-4d9c-b633-23203ee44ae4 could not be found. Oct 08 21:04:53.103376 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:04:53.110672 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-77169c6c-5953-485f-9cbc-54fe2418cf07 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Returning 404 to user: Instance 136d0aa6-479d-4d9c-b633-23203ee44ae4 could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:04:53.111956 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-77169c6c-5953-485f-9cbc-54fe2418cf07 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] 10.222.0.26 "GET /compute/v2.1/servers/136d0aa6-479d-4d9c-b633-23203ee44ae4" status: 404 len: 111 microversion: 2.1 time: 0.090623 Oct 08 21:04:53.112725 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1565/3189] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:04:53 2022] GET /compute/v2.1/servers/136d0aa6-479d-4d9c-b633-23203ee44ae4 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:04:53.117023 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-76d810c6-d1bd-40fb-b9c2-7c907aeb24ae tempest-MigrationsAdminTest-1609748928 tempest-MigrationsAdminTest-1609748928-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/6ef37448-690b-4fcf-85f8-a2fb71207f38" status: 200 len: 1613 microversion: 2.1 time: 1.010187 Oct 08 21:04:53.118818 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1625/3190] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:04:52 2022] GET /compute/v2.1/servers/6ef37448-690b-4fcf-85f8-a2fb71207f38 => generated 1613 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:04:53.126848 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-dc363ec6-a29d-476f-bcc7-f2b68036bd6d tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:53.127432 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-dc363ec6-a29d-476f-bcc7-f2b68036bd6d tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] [instance: 930c77ec-9649-47fe-bdee-e215c32e28b4] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:53.131179 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-4ec9ce85-3080-4f90-89a7-6f33f7a7ff27 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:53.131748 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-4ec9ce85-3080-4f90-89a7-6f33f7a7ff27 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] [instance: 562434d8-1c7a-4aa4-8cb5-e5d37bf07592] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:53.169439 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=4 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:04:53.171300 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dc363ec6-a29d-476f-bcc7-f2b68036bd6d tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:53.172259 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dc363ec6-a29d-476f-bcc7-f2b68036bd6d tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:53.173089 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4ec9ce85-3080-4f90-89a7-6f33f7a7ff27 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:53.173463 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dc363ec6-a29d-476f-bcc7-f2b68036bd6d tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:53.173703 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4ec9ce85-3080-4f90-89a7-6f33f7a7ff27 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:53.174163 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4ec9ce85-3080-4f90-89a7-6f33f7a7ff27 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:53.174863 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dc363ec6-a29d-476f-bcc7-f2b68036bd6d tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:53.174980 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4ec9ce85-3080-4f90-89a7-6f33f7a7ff27 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:53.175363 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4ec9ce85-3080-4f90-89a7-6f33f7a7ff27 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:53.175797 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4ec9ce85-3080-4f90-89a7-6f33f7a7ff27 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:53.176041 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dc363ec6-a29d-476f-bcc7-f2b68036bd6d tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:53.176663 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dc363ec6-a29d-476f-bcc7-f2b68036bd6d tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:53.269752 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4ec9ce85-3080-4f90-89a7-6f33f7a7ff27 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:53.270551 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4ec9ce85-3080-4f90-89a7-6f33f7a7ff27 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:53.271249 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4ec9ce85-3080-4f90-89a7-6f33f7a7ff27 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:53.271894 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.objects.instance [None req-4ec9ce85-3080-4f90-89a7-6f33f7a7ff27 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Lazy-loading 'fault' on Instance uuid 562434d8-1c7a-4aa4-8cb5-e5d37bf07592 {{(pid=140491) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 21:04:53.319319 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=8 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:04:53.506617 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-4ec9ce85-3080-4f90-89a7-6f33f7a7ff27 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07280ef2c5da4903a62092a44499f455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92d768a1a654e199e14845aab7d565b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:53.521545 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-4ec9ce85-3080-4f90-89a7-6f33f7a7ff27 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07280ef2c5da4903a62092a44499f455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92d768a1a654e199e14845aab7d565b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:53.524019 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-4ec9ce85-3080-4f90-89a7-6f33f7a7ff27 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07280ef2c5da4903a62092a44499f455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92d768a1a654e199e14845aab7d565b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:53.526787 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-4ec9ce85-3080-4f90-89a7-6f33f7a7ff27 tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] 10.222.0.26 "GET /compute/v2.1/servers/562434d8-1c7a-4aa4-8cb5-e5d37bf07592" status: 200 len: 1367 microversion: 2.57 time: 0.412715 Oct 08 21:04:53.529490 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1566/3191] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:04:53 2022] GET /compute/v2.1/servers/562434d8-1c7a-4aa4-8cb5-e5d37bf07592 => generated 1367 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:04:53.540664 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c4b9753f-62db-4a92-a08f-da2a52366890 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:53.542021 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-c4b9753f-62db-4a92-a08f-da2a52366890 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] [instance: 570d4898-169b-4f6b-aef6-ab79ea0fbefd] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:53.550874 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-dc363ec6-a29d-476f-bcc7-f2b68036bd6d tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5000948fa98a4b5d96ad27436d3d0edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917519b500674698a68dc01a4e8d68a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:53.560960 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-dc363ec6-a29d-476f-bcc7-f2b68036bd6d tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] 10.222.0.26 "GET /compute/v2.1/servers/930c77ec-9649-47fe-bdee-e215c32e28b4" status: 200 len: 1320 microversion: 2.1 time: 0.438651 Oct 08 21:04:53.573798 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1626/3192] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:04:53 2022] GET /compute/v2.1/servers/930c77ec-9649-47fe-bdee-e215c32e28b4 => generated 1320 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:04:53.582237 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=95,nova_api:UPDATE=1 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:04:53.585105 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-8cff9794-ae42-4b0f-9397-f9567433281d tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:53.586700 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-8cff9794-ae42-4b0f-9397-f9567433281d tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: 6ef37448-690b-4fcf-85f8-a2fb71207f38] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:53.589462 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c4b9753f-62db-4a92-a08f-da2a52366890 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:53.593404 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c4b9753f-62db-4a92-a08f-da2a52366890 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:53.593943 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c4b9753f-62db-4a92-a08f-da2a52366890 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:53.595895 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8cff9794-ae42-4b0f-9397-f9567433281d tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:53.596769 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8cff9794-ae42-4b0f-9397-f9567433281d tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:53.597468 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8cff9794-ae42-4b0f-9397-f9567433281d tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:53.598457 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8cff9794-ae42-4b0f-9397-f9567433281d tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:53.599130 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8cff9794-ae42-4b0f-9397-f9567433281d tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:53.599794 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8cff9794-ae42-4b0f-9397-f9567433281d tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:53.600551 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c4b9753f-62db-4a92-a08f-da2a52366890 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:53.602729 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c4b9753f-62db-4a92-a08f-da2a52366890 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:53.603507 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c4b9753f-62db-4a92-a08f-da2a52366890 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:53.641103 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-8cff9794-ae42-4b0f-9397-f9567433281d tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: 6ef37448-690b-4fcf-85f8-a2fb71207f38] Going to try to terminate instance {{(pid=140492) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 21:04:53.680036 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-c4b9753f-62db-4a92-a08f-da2a52366890 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] [instance: 570d4898-169b-4f6b-aef6-ab79ea0fbefd] Going to try to terminate instance {{(pid=140491) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 21:04:53.715107 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:04:53.818830 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-8cff9794-ae42-4b0f-9397-f9567433281d tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "DELETE /compute/v2.1/servers/6ef37448-690b-4fcf-85f8-a2fb71207f38" status: 204 len: 0 microversion: 2.1 time: 0.243166 Oct 08 21:04:53.819753 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1627/3193] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:04:53 2022] DELETE /compute/v2.1/servers/6ef37448-690b-4fcf-85f8-a2fb71207f38 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 21:04:53.838870 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-a0158831-b905-47e7-b2e9-ce407d6975ff tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:53.839987 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-a0158831-b905-47e7-b2e9-ce407d6975ff tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] [instance: de9d6639-040b-44b7-b00a-c1022c705c89] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:53.868239 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a0158831-b905-47e7-b2e9-ce407d6975ff tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:53.873600 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a0158831-b905-47e7-b2e9-ce407d6975ff tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:53.874273 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a0158831-b905-47e7-b2e9-ce407d6975ff tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:53.875186 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a0158831-b905-47e7-b2e9-ce407d6975ff tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:53.877724 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a0158831-b905-47e7-b2e9-ce407d6975ff tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:53.878292 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a0158831-b905-47e7-b2e9-ce407d6975ff tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:53.888803 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-c4b9753f-62db-4a92-a08f-da2a52366890 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] 10.222.0.26 "DELETE /compute/v2.1/servers/570d4898-169b-4f6b-aef6-ab79ea0fbefd" status: 204 len: 0 microversion: 2.1 time: 0.357666 Oct 08 21:04:53.889935 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1567/3194] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:04:53 2022] DELETE /compute/v2.1/servers/570d4898-169b-4f6b-aef6-ab79ea0fbefd => generated 0 bytes in 359 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 21:04:53.979685 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-5d34bc2b-b53a-44ed-976c-c53aa57f5f9d tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Action: 'create', calling method: .version_select at 0x7f1a914cc820>, body: {"keypair": {"name": "tempest-keypair-1680820787", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE2HUIp5bd0iLZLMZi4RtB2vtejbYWiMq6cZxqJlrbiREZciyXDxzj5BWoPAGVeZCBQAMxv+htH729mMQ7uNFtEmWebKJMMudSt8qKQ5XN1MpWKxn6fmdtr7hhmoENJx9g=="}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:04:53.998561 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-5d34bc2b-b53a-44ed-976c-c53aa57f5f9d tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Getting quotas for project 665f66e846c24a6db01274679100bdbf. Resources: {'key_pairs'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:04:54.007927 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-5d34bc2b-b53a-44ed-976c-c53aa57f5f9d tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Getting quotas for user 21870fe169dc42359d9bdb149d0016d7 and project 665f66e846c24a6db01274679100bdbf. Resources: {'key_pairs'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:04:54.043218 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-5d34bc2b-b53a-44ed-976c-c53aa57f5f9d tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.148795 Oct 08 21:04:54.044329 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1568/3195] 10.222.0.26 () {62 vars in 1200 bytes} [Sat Oct 8 21:04:53 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 154 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 08 21:04:54.050304 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-eb1ff52d-1542-478c-935d-239b6275a247 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:54.051393 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-eb1ff52d-1542-478c-935d-239b6275a247 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: 6ef37448-690b-4fcf-85f8-a2fb71207f38] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:54.060397 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-eb1ff52d-1542-478c-935d-239b6275a247 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:54.061320 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-eb1ff52d-1542-478c-935d-239b6275a247 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:54.062018 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-eb1ff52d-1542-478c-935d-239b6275a247 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:54.063028 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-eb1ff52d-1542-478c-935d-239b6275a247 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:54.063711 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-eb1ff52d-1542-478c-935d-239b6275a247 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:54.064993 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-eb1ff52d-1542-478c-935d-239b6275a247 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:54.090012 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:04:54.138761 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-a0158831-b905-47e7-b2e9-ce407d6975ff tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c6153d58d264272a375b3169e0874d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c405aac48e9b403ca8d1e3ac28fab76e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:54.148352 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-a0158831-b905-47e7-b2e9-ce407d6975ff tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] 10.222.0.26 "GET /compute/v2.1/servers/de9d6639-040b-44b7-b00a-c1022c705c89" status: 200 len: 1323 microversion: 2.1 time: 0.326972 Oct 08 21:04:54.157399 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1628/3196] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:04:53 2022] GET /compute/v2.1/servers/de9d6639-040b-44b7-b00a-c1022c705c89 => generated 1323 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:04:54.172721 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-d6bc98b9-0b81-4b33-a284-2ce8768f308d tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:54.175378 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-d6bc98b9-0b81-4b33-a284-2ce8768f308d tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] [instance: 570d4898-169b-4f6b-aef6-ab79ea0fbefd] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:54.184275 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d6bc98b9-0b81-4b33-a284-2ce8768f308d tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:54.186482 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d6bc98b9-0b81-4b33-a284-2ce8768f308d tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:54.187175 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d6bc98b9-0b81-4b33-a284-2ce8768f308d tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:54.188235 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d6bc98b9-0b81-4b33-a284-2ce8768f308d tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:54.189716 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d6bc98b9-0b81-4b33-a284-2ce8768f308d tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:54.190410 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d6bc98b9-0b81-4b33-a284-2ce8768f308d tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:54.380098 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-d6bc98b9-0b81-4b33-a284-2ce8768f308d tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2e13f1952a4e5bb23d57dd7fa31875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b2a56286924e2d953bebe717ce591b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:54.396842 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-d6bc98b9-0b81-4b33-a284-2ce8768f308d tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] 10.222.0.26 "GET /compute/v2.1/servers/570d4898-169b-4f6b-aef6-ab79ea0fbefd" status: 200 len: 1492 microversion: 2.1 time: 0.245888 Oct 08 21:04:54.414762 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1629/3197] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:04:54 2022] GET /compute/v2.1/servers/570d4898-169b-4f6b-aef6-ab79ea0fbefd => generated 1492 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:04:54.424145 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-b13af1cb-2b8d-4867-9b7d-9fce1b111caf req-6e1955fa-158a-470a-8f08-5bf79c5ec85e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5848e7ba-40bb-4c4d-a2d0-f4dce5bb2842", "tag": "a4e3d4d3-79ff-4d23-9f0a-7308ad60535a"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:04:54.439668 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:04:54.442506 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-b13af1cb-2b8d-4867-9b7d-9fce1b111caf req-6e1955fa-158a-470a-8f08-5bf79c5ec85e service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:54.443372 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-b13af1cb-2b8d-4867-9b7d-9fce1b111caf req-6e1955fa-158a-470a-8f08-5bf79c5ec85e service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:54.444137 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-b13af1cb-2b8d-4867-9b7d-9fce1b111caf req-6e1955fa-158a-470a-8f08-5bf79c5ec85e service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:54.463823 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-b13af1cb-2b8d-4867-9b7d-9fce1b111caf req-6e1955fa-158a-470a-8f08-5bf79c5ec85e service nova] Creating event network-changed:a4e3d4d3-79ff-4d23-9f0a-7308ad60535a for instance 5848e7ba-40bb-4c4d-a2d0-f4dce5bb2842 on nch2-master-1 Oct 08 21:04:54.470092 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-b13af1cb-2b8d-4867-9b7d-9fce1b111caf req-6e1955fa-158a-470a-8f08-5bf79c5ec85e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052031 Oct 08 21:04:54.471680 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1630/3198] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:04:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:04:54.480446 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-350edd1a-80d6-416a-a4b1-92ccdc969da0 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:54.480446 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-350edd1a-80d6-416a-a4b1-92ccdc969da0 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] [instance: 93b29a96-2b64-46bd-b6ab-fd44e6599d8f] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:54.490227 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-350edd1a-80d6-416a-a4b1-92ccdc969da0 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:54.491112 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-350edd1a-80d6-416a-a4b1-92ccdc969da0 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:54.491628 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-350edd1a-80d6-416a-a4b1-92ccdc969da0 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:54.493813 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-350edd1a-80d6-416a-a4b1-92ccdc969da0 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:54.494908 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-350edd1a-80d6-416a-a4b1-92ccdc969da0 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:54.495415 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-350edd1a-80d6-416a-a4b1-92ccdc969da0 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:54.533238 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-eb1ff52d-1542-478c-935d-239b6275a247 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:54.545483 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-eb1ff52d-1542-478c-935d-239b6275a247 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/6ef37448-690b-4fcf-85f8-a2fb71207f38" status: 200 len: 1468 microversion: 2.1 time: 0.499370 Oct 08 21:04:54.561678 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1569/3199] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:04:54 2022] GET /compute/v2.1/servers/6ef37448-690b-4fcf-85f8-a2fb71207f38 => generated 1468 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:04:54.567617 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-8c990eea-f2c0-4254-b692-3baee3be1ded tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:54.568533 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-8c990eea-f2c0-4254-b692-3baee3be1ded tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] [instance: 562434d8-1c7a-4aa4-8cb5-e5d37bf07592] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:54.574949 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8c990eea-f2c0-4254-b692-3baee3be1ded tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:54.579332 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8c990eea-f2c0-4254-b692-3baee3be1ded tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:54.580607 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8c990eea-f2c0-4254-b692-3baee3be1ded tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:54.581580 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8c990eea-f2c0-4254-b692-3baee3be1ded tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:54.584268 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8c990eea-f2c0-4254-b692-3baee3be1ded tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:54.585025 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8c990eea-f2c0-4254-b692-3baee3be1ded tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:54.590954 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-350edd1a-80d6-416a-a4b1-92ccdc969da0 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3245fc05926b49118c0d1028de3f09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527bbe10db744ab4bcc8078f2d754d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:54.604677 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-8c990eea-f2c0-4254-b692-3baee3be1ded tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] HTTP exception thrown: Instance 562434d8-1c7a-4aa4-8cb5-e5d37bf07592 could not be found. Oct 08 21:04:54.604886 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-350edd1a-80d6-416a-a4b1-92ccdc969da0 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3245fc05926b49118c0d1028de3f09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527bbe10db744ab4bcc8078f2d754d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:54.606882 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-8c990eea-f2c0-4254-b692-3baee3be1ded tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Request method failure captured: Oct 08 21:04:54.606882 ncdv-master-1 devstack@n-api.service[140491]: request: GET /compute/v2.1/servers/562434d8-1c7a-4aa4-8cb5-e5d37bf07592 HTTP/1.1 Oct 08 21:04:54.606882 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:04:54.606882 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:04:54.606882 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:04:54.606882 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 21:04:54.606882 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:04:54.606882 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:04:54.606882 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:04:54.606882 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:04:54.606882 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeXL3XtKh8I6sWjCcsDx02Gfb-z_d8kdDywz0ur7tZUDEud0vapKSfsPM3zsfL6ysdZAjkTbp0tw8AsN5XXxLxPRChYgoudRpw1yTAf2pJUgN7AzlOy36mvdaoQlDztIjjQWfCzt9lVaLE8P4T5omcB92ifMWw5ovAE3V3FCR3aLU1c Oct 08 21:04:54.606882 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:04:54.606882 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:04:54.606882 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:04:54.606882 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:04:54.606882 ncdv-master-1 devstack@n-api.service[140491]: X-Openstack-Nova-Api-Version: 2.57 Oct 08 21:04:54.606882 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:04:54.606882 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:04:54.606882 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: f92d768a1a654e199e14845aab7d565b Oct 08 21:04:54.606882 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-ServerShowV257Test-94120704 Oct 08 21:04:54.606882 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:04:54.606882 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:04:54.606882 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f92d768a1a654e199e14845aab7d565b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f92d768a1a654e199e14845aab7d565b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f92d768a1a654e199e14845aab7d565b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f92d768a1a654e199e14845aab7d565b"}]}] Oct 08 21:04:54.606882 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-ServerShowV257Test-94120704 Oct 08 21:04:54.606882 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: f92d768a1a654e199e14845aab7d565b Oct 08 21:04:54.606882 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-ServerShowV257Test-94120704 Oct 08 21:04:54.606882 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-ServerShowV257Test-94120704-project Oct 08 21:04:54.606882 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:04:54.606882 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:04:54.606882 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 07280ef2c5da4903a62092a44499f455 Oct 08 21:04:54.606882 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-ServerShowV257Test-94120704-project Oct 08 21:04:54.606882 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:04:54.606882 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance 562434d8-1c7a-4aa4-8cb5-e5d37bf07592 could not be found. Oct 08 21:04:54.606882 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': '562434d8-1c7a-4aa4-8cb5-e5d37bf07592'} Oct 08 21:04:54.606882 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:04:54.606882 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:04:54.606882 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:04:54.606882 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:04:54.606882 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:04:54.606882 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:04:54.606882 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:04:54.606882 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:04:54.606882 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:04:54.606882 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:04:54.606882 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 562434d8-1c7a-4aa4-8cb5-e5d37bf07592 could not be found. Oct 08 21:04:54.606882 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:04:54.606882 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:04:54.606882 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:04:54.606882 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:04:54.606882 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:04:54.606882 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:04:54.606882 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:04:54.606882 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:04:54.606882 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:04:54.606882 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:04:54.606882 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:04:54.606882 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:04:54.606882 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:04:54.606882 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:04:54.606882 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:04:54.606882 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:04:54.606882 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 562434d8-1c7a-4aa4-8cb5-e5d37bf07592 could not be found. Oct 08 21:04:54.606882 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:04:54.606882 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:04:54.606882 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:04:54.611554 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:04:54.611554 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:04:54.611554 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:04:54.611554 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:04:54.611554 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:04:54.611554 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 562434d8-1c7a-4aa4-8cb5-e5d37bf07592 could not be found. Oct 08 21:04:54.611554 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:04:54.612021 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-350edd1a-80d6-416a-a4b1-92ccdc969da0 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3245fc05926b49118c0d1028de3f09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527bbe10db744ab4bcc8078f2d754d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:54.612021 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-350edd1a-80d6-416a-a4b1-92ccdc969da0 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] 10.222.0.26 "GET /compute/v2.1/servers/93b29a96-2b64-46bd-b6ab-fd44e6599d8f" status: 200 len: 1365 microversion: 2.47 time: 0.136228 Oct 08 21:04:54.612021 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1631/3200] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:04:54 2022] GET /compute/v2.1/servers/93b29a96-2b64-46bd-b6ab-fd44e6599d8f => generated 1365 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:04:54.613563 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-8c990eea-f2c0-4254-b692-3baee3be1ded tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] Returning 404 to user: Instance 562434d8-1c7a-4aa4-8cb5-e5d37bf07592 could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:04:54.614763 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-8c990eea-f2c0-4254-b692-3baee3be1ded tempest-ServerShowV257Test-94120704 tempest-ServerShowV257Test-94120704-project] 10.222.0.26 "GET /compute/v2.1/servers/562434d8-1c7a-4aa4-8cb5-e5d37bf07592" status: 404 len: 111 microversion: 2.57 time: 0.051600 Oct 08 21:04:54.615557 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1570/3201] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:04:54 2022] GET /compute/v2.1/servers/562434d8-1c7a-4aa4-8cb5-e5d37bf07592 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 08 21:04:54.620371 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-d2aa27c3-7068-46d2-a15f-93b6d79d487d tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:54.620371 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-d2aa27c3-7068-46d2-a15f-93b6d79d487d tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] [instance: 930c77ec-9649-47fe-bdee-e215c32e28b4] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:54.626212 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d2aa27c3-7068-46d2-a15f-93b6d79d487d tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:54.627537 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d2aa27c3-7068-46d2-a15f-93b6d79d487d tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:54.628186 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d2aa27c3-7068-46d2-a15f-93b6d79d487d tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:54.629112 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d2aa27c3-7068-46d2-a15f-93b6d79d487d tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:54.629617 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d2aa27c3-7068-46d2-a15f-93b6d79d487d tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:54.630052 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d2aa27c3-7068-46d2-a15f-93b6d79d487d tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:54.769895 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-80dea488-a3cc-4750-a00a-d4a299c6d4e1 req-70a45eb9-7026-450c-bdc8-7310e2836570 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ef37448-690b-4fcf-85f8-a2fb71207f38", "name": "network-vif-plugged", "status": "completed", "tag": "066ce620-e2c6-4bca-97c2-d42e20280dcc"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:04:54.798376 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-80dea488-a3cc-4750-a00a-d4a299c6d4e1 req-70a45eb9-7026-450c-bdc8-7310e2836570 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:54.798870 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-80dea488-a3cc-4750-a00a-d4a299c6d4e1 req-70a45eb9-7026-450c-bdc8-7310e2836570 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:54.799317 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-80dea488-a3cc-4750-a00a-d4a299c6d4e1 req-70a45eb9-7026-450c-bdc8-7310e2836570 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:54.823572 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-80dea488-a3cc-4750-a00a-d4a299c6d4e1 req-70a45eb9-7026-450c-bdc8-7310e2836570 service nova] Creating event network-vif-plugged:066ce620-e2c6-4bca-97c2-d42e20280dcc for instance 6ef37448-690b-4fcf-85f8-a2fb71207f38 on nch2-master-1 Oct 08 21:04:54.842349 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-80dea488-a3cc-4750-a00a-d4a299c6d4e1 req-70a45eb9-7026-450c-bdc8-7310e2836570 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076623 Oct 08 21:04:54.846761 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1571/3202] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:04:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:04:55.005276 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-d2aa27c3-7068-46d2-a15f-93b6d79d487d tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5000948fa98a4b5d96ad27436d3d0edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917519b500674698a68dc01a4e8d68a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:55.014008 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-d2aa27c3-7068-46d2-a15f-93b6d79d487d tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] 10.222.0.26 "GET /compute/v2.1/servers/930c77ec-9649-47fe-bdee-e215c32e28b4" status: 200 len: 1320 microversion: 2.1 time: 0.401117 Oct 08 21:04:55.014606 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1632/3203] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:04:54 2022] GET /compute/v2.1/servers/930c77ec-9649-47fe-bdee-e215c32e28b4 => generated 1320 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:04:55.203136 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-35f11ab1-8679-494e-9b36-fae5c26e29db tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:55.207787 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-35f11ab1-8679-494e-9b36-fae5c26e29db tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] [instance: de9d6639-040b-44b7-b00a-c1022c705c89] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:55.226739 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-35f11ab1-8679-494e-9b36-fae5c26e29db tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:55.229243 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-35f11ab1-8679-494e-9b36-fae5c26e29db tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:55.232338 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-35f11ab1-8679-494e-9b36-fae5c26e29db tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:55.239251 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-35f11ab1-8679-494e-9b36-fae5c26e29db tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:55.240832 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-35f11ab1-8679-494e-9b36-fae5c26e29db tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:55.243806 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-35f11ab1-8679-494e-9b36-fae5c26e29db tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:55.421658 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-69cc0696-4d5b-4f30-b647-eb0de00d1738 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:55.423339 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-69cc0696-4d5b-4f30-b647-eb0de00d1738 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] [instance: 570d4898-169b-4f6b-aef6-ab79ea0fbefd] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:55.435343 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-69cc0696-4d5b-4f30-b647-eb0de00d1738 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:55.441740 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-69cc0696-4d5b-4f30-b647-eb0de00d1738 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:55.443398 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-69cc0696-4d5b-4f30-b647-eb0de00d1738 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:55.444536 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-69cc0696-4d5b-4f30-b647-eb0de00d1738 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:55.445667 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-69cc0696-4d5b-4f30-b647-eb0de00d1738 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:55.446167 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-69cc0696-4d5b-4f30-b647-eb0de00d1738 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:55.771762 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-69cc0696-4d5b-4f30-b647-eb0de00d1738 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2e13f1952a4e5bb23d57dd7fa31875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b2a56286924e2d953bebe717ce591b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:55.780135 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-69cc0696-4d5b-4f30-b647-eb0de00d1738 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] 10.222.0.26 "GET /compute/v2.1/servers/570d4898-169b-4f6b-aef6-ab79ea0fbefd" status: 200 len: 1492 microversion: 2.1 time: 0.363283 Oct 08 21:04:55.788650 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1633/3204] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:04:55 2022] GET /compute/v2.1/servers/570d4898-169b-4f6b-aef6-ab79ea0fbefd => generated 1492 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:04:55.798683 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-1b0c565f-707d-4364-897b-999789f7bfb6 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:55.799475 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-1b0c565f-707d-4364-897b-999789f7bfb6 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: 6ef37448-690b-4fcf-85f8-a2fb71207f38] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:55.815358 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1b0c565f-707d-4364-897b-999789f7bfb6 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:55.817697 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1b0c565f-707d-4364-897b-999789f7bfb6 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:55.818271 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1b0c565f-707d-4364-897b-999789f7bfb6 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:55.825745 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1b0c565f-707d-4364-897b-999789f7bfb6 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:55.826347 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1b0c565f-707d-4364-897b-999789f7bfb6 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:55.826894 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1b0c565f-707d-4364-897b-999789f7bfb6 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:56.172964 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-1b0c565f-707d-4364-897b-999789f7bfb6 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:56.181442 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-1b0c565f-707d-4364-897b-999789f7bfb6 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/6ef37448-690b-4fcf-85f8-a2fb71207f38" status: 200 len: 1468 microversion: 2.1 time: 0.391480 Oct 08 21:04:56.185053 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1634/3205] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:04:55 2022] GET /compute/v2.1/servers/6ef37448-690b-4fcf-85f8-a2fb71207f38 => generated 1468 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:04:56.190021 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-7f06be38-137a-48c0-b6fe-a72b5fdce06e tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:56.190785 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-7f06be38-137a-48c0-b6fe-a72b5fdce06e tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] [instance: 93b29a96-2b64-46bd-b6ab-fd44e6599d8f] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:56.218029 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7f06be38-137a-48c0-b6fe-a72b5fdce06e tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:56.218556 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7f06be38-137a-48c0-b6fe-a72b5fdce06e tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:56.219011 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7f06be38-137a-48c0-b6fe-a72b5fdce06e tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:56.219747 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7f06be38-137a-48c0-b6fe-a72b5fdce06e tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:56.220734 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7f06be38-137a-48c0-b6fe-a72b5fdce06e tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:56.221167 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7f06be38-137a-48c0-b6fe-a72b5fdce06e tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:56.319687 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-7f06be38-137a-48c0-b6fe-a72b5fdce06e tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3245fc05926b49118c0d1028de3f09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527bbe10db744ab4bcc8078f2d754d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:56.331140 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-7f06be38-137a-48c0-b6fe-a72b5fdce06e tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3245fc05926b49118c0d1028de3f09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527bbe10db744ab4bcc8078f2d754d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:56.334326 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-7f06be38-137a-48c0-b6fe-a72b5fdce06e tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3245fc05926b49118c0d1028de3f09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527bbe10db744ab4bcc8078f2d754d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:56.335719 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-7f06be38-137a-48c0-b6fe-a72b5fdce06e tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] 10.222.0.26 "GET /compute/v2.1/servers/93b29a96-2b64-46bd-b6ab-fd44e6599d8f" status: 200 len: 1365 microversion: 2.47 time: 0.149604 Oct 08 21:04:56.341349 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1635/3206] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:04:56 2022] GET /compute/v2.1/servers/93b29a96-2b64-46bd-b6ab-fd44e6599d8f => generated 1365 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:04:56.349871 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-f2c5ad61-2704-42f0-ade1-8f630a1149a8 req-345a0652-abf6-400f-9e78-068b283c183c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "930c77ec-9649-47fe-bdee-e215c32e28b4", "tag": "bb41a678-69e1-4d9b-9a19-9898e186a74e"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:04:56.363558 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-f2c5ad61-2704-42f0-ade1-8f630a1149a8 req-345a0652-abf6-400f-9e78-068b283c183c service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:56.364199 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-f2c5ad61-2704-42f0-ade1-8f630a1149a8 req-345a0652-abf6-400f-9e78-068b283c183c service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:56.365095 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-f2c5ad61-2704-42f0-ade1-8f630a1149a8 req-345a0652-abf6-400f-9e78-068b283c183c service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:56.380487 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-f2c5ad61-2704-42f0-ade1-8f630a1149a8 req-345a0652-abf6-400f-9e78-068b283c183c service nova] Creating event network-changed:bb41a678-69e1-4d9b-9a19-9898e186a74e for instance 930c77ec-9649-47fe-bdee-e215c32e28b4 on nch1-master-1 Oct 08 21:04:56.390615 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-f2c5ad61-2704-42f0-ade1-8f630a1149a8 req-345a0652-abf6-400f-9e78-068b283c183c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052347 Oct 08 21:04:56.391408 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1636/3207] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:04:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:04:56.400164 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-a4afeb91-7f16-43e1-9d7d-4af30d22fbd5 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:56.400621 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-a4afeb91-7f16-43e1-9d7d-4af30d22fbd5 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] [instance: 930c77ec-9649-47fe-bdee-e215c32e28b4] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:56.410580 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a4afeb91-7f16-43e1-9d7d-4af30d22fbd5 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:56.411166 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a4afeb91-7f16-43e1-9d7d-4af30d22fbd5 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:56.411612 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a4afeb91-7f16-43e1-9d7d-4af30d22fbd5 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:56.412343 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a4afeb91-7f16-43e1-9d7d-4af30d22fbd5 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:56.412815 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a4afeb91-7f16-43e1-9d7d-4af30d22fbd5 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:56.413277 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a4afeb91-7f16-43e1-9d7d-4af30d22fbd5 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:56.491446 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-35f11ab1-8679-494e-9b36-fae5c26e29db tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c6153d58d264272a375b3169e0874d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c405aac48e9b403ca8d1e3ac28fab76e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:56.499694 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-35f11ab1-8679-494e-9b36-fae5c26e29db tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] 10.222.0.26 "GET /compute/v2.1/servers/de9d6639-040b-44b7-b00a-c1022c705c89" status: 200 len: 1323 microversion: 2.1 time: 1.328339 Oct 08 21:04:56.499986 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1572/3208] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:04:55 2022] GET /compute/v2.1/servers/de9d6639-040b-44b7-b00a-c1022c705c89 => generated 1323 bytes in 1330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:04:56.668812 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-a4afeb91-7f16-43e1-9d7d-4af30d22fbd5 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5000948fa98a4b5d96ad27436d3d0edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917519b500674698a68dc01a4e8d68a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:56.692604 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-a4afeb91-7f16-43e1-9d7d-4af30d22fbd5 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] 10.222.0.26 "GET /compute/v2.1/servers/930c77ec-9649-47fe-bdee-e215c32e28b4" status: 200 len: 1320 microversion: 2.1 time: 0.299312 Oct 08 21:04:56.713224 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1637/3209] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:04:56 2022] GET /compute/v2.1/servers/930c77ec-9649-47fe-bdee-e215c32e28b4 => generated 1320 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:04:56.814753 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-abec40c9-6e19-4e67-b195-fb59811a7ec9 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:56.815663 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-abec40c9-6e19-4e67-b195-fb59811a7ec9 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] [instance: 570d4898-169b-4f6b-aef6-ab79ea0fbefd] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:56.822900 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-abec40c9-6e19-4e67-b195-fb59811a7ec9 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:56.823793 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-abec40c9-6e19-4e67-b195-fb59811a7ec9 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:56.824466 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-abec40c9-6e19-4e67-b195-fb59811a7ec9 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:56.825460 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-abec40c9-6e19-4e67-b195-fb59811a7ec9 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:56.826150 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-abec40c9-6e19-4e67-b195-fb59811a7ec9 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:56.826813 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-abec40c9-6e19-4e67-b195-fb59811a7ec9 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:57.214340 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-8cfc456e-f47b-4c07-af5a-9e4d242289e3 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:57.215355 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-8cfc456e-f47b-4c07-af5a-9e4d242289e3 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: 6ef37448-690b-4fcf-85f8-a2fb71207f38] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:57.223386 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8cfc456e-f47b-4c07-af5a-9e4d242289e3 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:57.224177 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8cfc456e-f47b-4c07-af5a-9e4d242289e3 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:57.224850 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8cfc456e-f47b-4c07-af5a-9e4d242289e3 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:57.226125 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8cfc456e-f47b-4c07-af5a-9e4d242289e3 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:57.227009 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8cfc456e-f47b-4c07-af5a-9e4d242289e3 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:57.227605 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8cfc456e-f47b-4c07-af5a-9e4d242289e3 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:57.471431 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-8cfc456e-f47b-4c07-af5a-9e4d242289e3 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:57.501012 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-8cfc456e-f47b-4c07-af5a-9e4d242289e3 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/6ef37448-690b-4fcf-85f8-a2fb71207f38" status: 200 len: 1468 microversion: 2.1 time: 0.297431 Oct 08 21:04:57.517988 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1638/3210] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:04:57 2022] GET /compute/v2.1/servers/6ef37448-690b-4fcf-85f8-a2fb71207f38 => generated 1468 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:04:57.525223 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-425b009d-8234-4454-bf00-5c62c89ce4c4 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:57.525892 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-425b009d-8234-4454-bf00-5c62c89ce4c4 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] [instance: 93b29a96-2b64-46bd-b6ab-fd44e6599d8f] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:57.535086 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-425b009d-8234-4454-bf00-5c62c89ce4c4 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:57.535991 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-425b009d-8234-4454-bf00-5c62c89ce4c4 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:57.536605 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-425b009d-8234-4454-bf00-5c62c89ce4c4 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:57.539059 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-425b009d-8234-4454-bf00-5c62c89ce4c4 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:57.539809 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-425b009d-8234-4454-bf00-5c62c89ce4c4 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:57.540264 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-425b009d-8234-4454-bf00-5c62c89ce4c4 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:57.638132 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-425b009d-8234-4454-bf00-5c62c89ce4c4 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3245fc05926b49118c0d1028de3f09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527bbe10db744ab4bcc8078f2d754d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:57.650991 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-abec40c9-6e19-4e67-b195-fb59811a7ec9 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2e13f1952a4e5bb23d57dd7fa31875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b2a56286924e2d953bebe717ce591b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:57.686428 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-abec40c9-6e19-4e67-b195-fb59811a7ec9 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] 10.222.0.26 "GET /compute/v2.1/servers/570d4898-169b-4f6b-aef6-ab79ea0fbefd" status: 200 len: 1492 microversion: 2.1 time: 0.876334 Oct 08 21:04:57.688181 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1573/3211] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:04:56 2022] GET /compute/v2.1/servers/570d4898-169b-4f6b-aef6-ab79ea0fbefd => generated 1492 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:04:57.707346 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-425b009d-8234-4454-bf00-5c62c89ce4c4 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3245fc05926b49118c0d1028de3f09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527bbe10db744ab4bcc8078f2d754d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:57.709655 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-425b009d-8234-4454-bf00-5c62c89ce4c4 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3245fc05926b49118c0d1028de3f09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527bbe10db744ab4bcc8078f2d754d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:57.709861 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c385f7fe-3573-4cb9-b4a1-6c01c1092da7 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:57.710989 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-c385f7fe-3573-4cb9-b4a1-6c01c1092da7 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] [instance: de9d6639-040b-44b7-b00a-c1022c705c89] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:57.712031 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-425b009d-8234-4454-bf00-5c62c89ce4c4 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] 10.222.0.26 "GET /compute/v2.1/servers/93b29a96-2b64-46bd-b6ab-fd44e6599d8f" status: 200 len: 1365 microversion: 2.47 time: 0.192622 Oct 08 21:04:57.719093 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c385f7fe-3573-4cb9-b4a1-6c01c1092da7 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:57.720800 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c385f7fe-3573-4cb9-b4a1-6c01c1092da7 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:57.722012 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c385f7fe-3573-4cb9-b4a1-6c01c1092da7 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:57.731162 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c385f7fe-3573-4cb9-b4a1-6c01c1092da7 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:57.733642 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c385f7fe-3573-4cb9-b4a1-6c01c1092da7 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:57.734388 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c385f7fe-3573-4cb9-b4a1-6c01c1092da7 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:57.736260 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1639/3212] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:04:57 2022] GET /compute/v2.1/servers/93b29a96-2b64-46bd-b6ab-fd44e6599d8f => generated 1365 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:04:57.748052 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-636f9dbb-a5e8-4119-b326-b3837b2fff60 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:57.748704 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-636f9dbb-a5e8-4119-b326-b3837b2fff60 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] [instance: 930c77ec-9649-47fe-bdee-e215c32e28b4] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:57.759929 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-636f9dbb-a5e8-4119-b326-b3837b2fff60 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:57.761095 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-636f9dbb-a5e8-4119-b326-b3837b2fff60 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:57.761837 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-636f9dbb-a5e8-4119-b326-b3837b2fff60 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:57.762988 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-636f9dbb-a5e8-4119-b326-b3837b2fff60 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:57.764244 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-636f9dbb-a5e8-4119-b326-b3837b2fff60 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:57.764972 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-636f9dbb-a5e8-4119-b326-b3837b2fff60 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:58.007912 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-636f9dbb-a5e8-4119-b326-b3837b2fff60 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5000948fa98a4b5d96ad27436d3d0edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917519b500674698a68dc01a4e8d68a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:58.017460 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-636f9dbb-a5e8-4119-b326-b3837b2fff60 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] 10.222.0.26 "GET /compute/v2.1/servers/930c77ec-9649-47fe-bdee-e215c32e28b4" status: 200 len: 1320 microversion: 2.1 time: 0.277230 Oct 08 21:04:58.018766 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1640/3213] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:04:57 2022] GET /compute/v2.1/servers/930c77ec-9649-47fe-bdee-e215c32e28b4 => generated 1320 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:04:58.023425 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-649a30af-7305-4a55-97ad-c04366e56a48 req-53e97cb9-0545-4a46-acee-ae69749c65b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "570d4898-169b-4f6b-aef6-ab79ea0fbefd", "name": "network-vif-deleted", "tag": "ae67c0ac-063e-4061-b746-096da184c437"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:04:58.034740 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-649a30af-7305-4a55-97ad-c04366e56a48 req-53e97cb9-0545-4a46-acee-ae69749c65b6 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:58.035498 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-649a30af-7305-4a55-97ad-c04366e56a48 req-53e97cb9-0545-4a46-acee-ae69749c65b6 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:58.036095 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-649a30af-7305-4a55-97ad-c04366e56a48 req-53e97cb9-0545-4a46-acee-ae69749c65b6 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:58.049552 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-649a30af-7305-4a55-97ad-c04366e56a48 req-53e97cb9-0545-4a46-acee-ae69749c65b6 service nova] Creating event network-vif-deleted:ae67c0ac-063e-4061-b746-096da184c437 for instance 570d4898-169b-4f6b-aef6-ab79ea0fbefd on nch1-master-1 Oct 08 21:04:58.054850 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-649a30af-7305-4a55-97ad-c04366e56a48 req-53e97cb9-0545-4a46-acee-ae69749c65b6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034781 Oct 08 21:04:58.059520 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1641/3214] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:04:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:04:58.530705 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-3427db67-63ba-4e17-abc1-827be0b317a9 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:58.531702 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-3427db67-63ba-4e17-abc1-827be0b317a9 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: 6ef37448-690b-4fcf-85f8-a2fb71207f38] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:58.553738 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3427db67-63ba-4e17-abc1-827be0b317a9 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:58.554625 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3427db67-63ba-4e17-abc1-827be0b317a9 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:58.555554 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3427db67-63ba-4e17-abc1-827be0b317a9 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:58.556503 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3427db67-63ba-4e17-abc1-827be0b317a9 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:58.557158 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3427db67-63ba-4e17-abc1-827be0b317a9 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:58.558298 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3427db67-63ba-4e17-abc1-827be0b317a9 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:58.670678 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-c385f7fe-3573-4cb9-b4a1-6c01c1092da7 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c6153d58d264272a375b3169e0874d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c405aac48e9b403ca8d1e3ac28fab76e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:58.684015 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-c385f7fe-3573-4cb9-b4a1-6c01c1092da7 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] 10.222.0.26 "GET /compute/v2.1/servers/de9d6639-040b-44b7-b00a-c1022c705c89" status: 200 len: 1323 microversion: 2.1 time: 0.980288 Oct 08 21:04:58.684678 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1574/3215] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:04:57 2022] GET /compute/v2.1/servers/de9d6639-040b-44b7-b00a-c1022c705c89 => generated 1323 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:04:58.712298 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-3427db67-63ba-4e17-abc1-827be0b317a9 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:58.713117 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-75eb1ab4-d90b-427c-8c38-012b7ed496c1 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:58.714238 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-75eb1ab4-d90b-427c-8c38-012b7ed496c1 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] [instance: 570d4898-169b-4f6b-aef6-ab79ea0fbefd] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:58.727343 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-75eb1ab4-d90b-427c-8c38-012b7ed496c1 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:58.728043 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-3427db67-63ba-4e17-abc1-827be0b317a9 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/6ef37448-690b-4fcf-85f8-a2fb71207f38" status: 200 len: 1426 microversion: 2.1 time: 0.201704 Oct 08 21:04:58.728264 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-75eb1ab4-d90b-427c-8c38-012b7ed496c1 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:58.728866 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-75eb1ab4-d90b-427c-8c38-012b7ed496c1 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:58.729814 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-75eb1ab4-d90b-427c-8c38-012b7ed496c1 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:58.731675 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1642/3216] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:04:58 2022] GET /compute/v2.1/servers/6ef37448-690b-4fcf-85f8-a2fb71207f38 => generated 1426 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:04:58.732835 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-75eb1ab4-d90b-427c-8c38-012b7ed496c1 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:58.733163 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-75eb1ab4-d90b-427c-8c38-012b7ed496c1 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:58.746596 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-ee5ba565-4333-4890-8e6e-8aa877de5b94 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:58.751052 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-ee5ba565-4333-4890-8e6e-8aa877de5b94 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] [instance: 93b29a96-2b64-46bd-b6ab-fd44e6599d8f] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:58.761179 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ee5ba565-4333-4890-8e6e-8aa877de5b94 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:58.764122 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ee5ba565-4333-4890-8e6e-8aa877de5b94 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:58.764749 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ee5ba565-4333-4890-8e6e-8aa877de5b94 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:58.768922 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ee5ba565-4333-4890-8e6e-8aa877de5b94 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:58.769513 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ee5ba565-4333-4890-8e6e-8aa877de5b94 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:58.770035 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ee5ba565-4333-4890-8e6e-8aa877de5b94 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:58.822706 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-75eb1ab4-d90b-427c-8c38-012b7ed496c1 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:58.825104 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-75eb1ab4-d90b-427c-8c38-012b7ed496c1 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:58.826308 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-75eb1ab4-d90b-427c-8c38-012b7ed496c1 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:58.826984 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.objects.instance [None req-75eb1ab4-d90b-427c-8c38-012b7ed496c1 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lazy-loading 'fault' on Instance uuid 570d4898-169b-4f6b-aef6-ab79ea0fbefd {{(pid=140491) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 21:04:58.946008 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-ee5ba565-4333-4890-8e6e-8aa877de5b94 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3245fc05926b49118c0d1028de3f09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527bbe10db744ab4bcc8078f2d754d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:58.960622 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-ee5ba565-4333-4890-8e6e-8aa877de5b94 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3245fc05926b49118c0d1028de3f09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527bbe10db744ab4bcc8078f2d754d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:58.970839 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-ee5ba565-4333-4890-8e6e-8aa877de5b94 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3245fc05926b49118c0d1028de3f09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527bbe10db744ab4bcc8078f2d754d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:58.974407 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-ee5ba565-4333-4890-8e6e-8aa877de5b94 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] 10.222.0.26 "GET /compute/v2.1/servers/93b29a96-2b64-46bd-b6ab-fd44e6599d8f" status: 200 len: 1365 microversion: 2.47 time: 0.231621 Oct 08 21:04:58.976070 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1643/3217] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:04:58 2022] GET /compute/v2.1/servers/93b29a96-2b64-46bd-b6ab-fd44e6599d8f => generated 1365 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:04:58.983506 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-75eb1ab4-d90b-427c-8c38-012b7ed496c1 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2e13f1952a4e5bb23d57dd7fa31875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b2a56286924e2d953bebe717ce591b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:58.990621 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-be8c6642-c32f-4f32-8fb9-92657c0ce335 req-2a3732be-53a0-4879-9316-55b87a4ca383 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ef37448-690b-4fcf-85f8-a2fb71207f38", "name": "network-vif-deleted", "tag": "066ce620-e2c6-4bca-97c2-d42e20280dcc"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:04:58.995306 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-75eb1ab4-d90b-427c-8c38-012b7ed496c1 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] 10.222.0.26 "GET /compute/v2.1/servers/570d4898-169b-4f6b-aef6-ab79ea0fbefd" status: 200 len: 1304 microversion: 2.1 time: 0.284839 Oct 08 21:04:58.995916 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1575/3218] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:04:58 2022] GET /compute/v2.1/servers/570d4898-169b-4f6b-aef6-ab79ea0fbefd => generated 1304 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:04:59.006437 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-be8c6642-c32f-4f32-8fb9-92657c0ce335 req-2a3732be-53a0-4879-9316-55b87a4ca383 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:59.006927 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-be8c6642-c32f-4f32-8fb9-92657c0ce335 req-2a3732be-53a0-4879-9316-55b87a4ca383 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:59.007615 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-be8c6642-c32f-4f32-8fb9-92657c0ce335 req-2a3732be-53a0-4879-9316-55b87a4ca383 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:59.021581 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-be8c6642-c32f-4f32-8fb9-92657c0ce335 req-2a3732be-53a0-4879-9316-55b87a4ca383 service nova] Creating event network-vif-deleted:066ce620-e2c6-4bca-97c2-d42e20280dcc for instance 6ef37448-690b-4fcf-85f8-a2fb71207f38 on nch2-master-1 Oct 08 21:04:59.027717 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-be8c6642-c32f-4f32-8fb9-92657c0ce335 req-2a3732be-53a0-4879-9316-55b87a4ca383 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049945 Oct 08 21:04:59.028997 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1644/3219] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:04:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:04:59.043532 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-14589ee1-dbe5-4a0b-866d-bbe906ecd111 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:59.044158 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-14589ee1-dbe5-4a0b-866d-bbe906ecd111 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] [instance: 930c77ec-9649-47fe-bdee-e215c32e28b4] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:59.054374 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-14589ee1-dbe5-4a0b-866d-bbe906ecd111 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:59.054885 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-14589ee1-dbe5-4a0b-866d-bbe906ecd111 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:59.055333 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-14589ee1-dbe5-4a0b-866d-bbe906ecd111 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:59.056071 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-14589ee1-dbe5-4a0b-866d-bbe906ecd111 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:59.056537 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-14589ee1-dbe5-4a0b-866d-bbe906ecd111 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:59.057009 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-14589ee1-dbe5-4a0b-866d-bbe906ecd111 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:59.422119 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-14589ee1-dbe5-4a0b-866d-bbe906ecd111 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5000948fa98a4b5d96ad27436d3d0edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917519b500674698a68dc01a4e8d68a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:59.430966 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-14589ee1-dbe5-4a0b-866d-bbe906ecd111 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] 10.222.0.26 "GET /compute/v2.1/servers/930c77ec-9649-47fe-bdee-e215c32e28b4" status: 200 len: 1320 microversion: 2.1 time: 0.391488 Oct 08 21:04:59.431655 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1576/3220] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:04:59 2022] GET /compute/v2.1/servers/930c77ec-9649-47fe-bdee-e215c32e28b4 => generated 1320 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:04:59.709282 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-1d4a52ae-63e9-42f8-929f-4f25608cf051 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:59.709995 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-1d4a52ae-63e9-42f8-929f-4f25608cf051 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] [instance: de9d6639-040b-44b7-b00a-c1022c705c89] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:59.717052 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1d4a52ae-63e9-42f8-929f-4f25608cf051 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:59.717873 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1d4a52ae-63e9-42f8-929f-4f25608cf051 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:59.718006 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1d4a52ae-63e9-42f8-929f-4f25608cf051 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:59.718723 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1d4a52ae-63e9-42f8-929f-4f25608cf051 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:59.719218 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1d4a52ae-63e9-42f8-929f-4f25608cf051 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:59.719652 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1d4a52ae-63e9-42f8-929f-4f25608cf051 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:59.753538 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-50136090-4395-4337-9f91-7bb3be7a6f2e tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:59.754502 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-50136090-4395-4337-9f91-7bb3be7a6f2e tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: 6ef37448-690b-4fcf-85f8-a2fb71207f38] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:59.761226 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-50136090-4395-4337-9f91-7bb3be7a6f2e tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:59.761871 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-50136090-4395-4337-9f91-7bb3be7a6f2e tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:59.762542 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-50136090-4395-4337-9f91-7bb3be7a6f2e tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:59.763404 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-50136090-4395-4337-9f91-7bb3be7a6f2e tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:59.763948 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-50136090-4395-4337-9f91-7bb3be7a6f2e tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:59.764648 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-50136090-4395-4337-9f91-7bb3be7a6f2e tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:59.783348 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-50136090-4395-4337-9f91-7bb3be7a6f2e tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] HTTP exception thrown: Instance 6ef37448-690b-4fcf-85f8-a2fb71207f38 could not be found. Oct 08 21:04:59.785063 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-50136090-4395-4337-9f91-7bb3be7a6f2e tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Request method failure captured: Oct 08 21:04:59.785063 ncdv-master-1 devstack@n-api.service[140491]: request: GET /compute/v2.1/servers/6ef37448-690b-4fcf-85f8-a2fb71207f38 HTTP/1.1 Oct 08 21:04:59.785063 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:04:59.785063 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:04:59.785063 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:04:59.785063 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 21:04:59.785063 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:04:59.785063 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:04:59.785063 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:04:59.785063 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:04:59.785063 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeSpH4XDiYW19iQbBiok8uGM0c09fRqx5RRIizvfuTfqVgRGIpA6bFXwFHQqBS5yIR3OkB2E0bcw2nYeKqHv0LMQ6Oyj572d2Mx3XOjvMpnN8CYfHcY_H_6fonfL0ijUqcg70H8pyQhVd4bZHdhW8zWnUCcY8Nk9k_rfX1dbnTaTfN8 Oct 08 21:04:59.785063 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:04:59.785063 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:04:59.785063 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:04:59.785063 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:04:59.785063 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:04:59.785063 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:04:59.785063 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 0ffdae031c4f47d599acb30f1d3c87b9 Oct 08 21:04:59.785063 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-MigrationsAdminTest-1214086769 Oct 08 21:04:59.785063 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:04:59.785063 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:04:59.785063 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0ffdae031c4f47d599acb30f1d3c87b9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0ffdae031c4f47d599acb30f1d3c87b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0ffdae031c4f47d599acb30f1d3c87b9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0ffdae031c4f47d599acb30f1d3c87b9"}]}] Oct 08 21:04:59.785063 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-MigrationsAdminTest-1214086769 Oct 08 21:04:59.785063 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 0ffdae031c4f47d599acb30f1d3c87b9 Oct 08 21:04:59.785063 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-MigrationsAdminTest-1214086769 Oct 08 21:04:59.785063 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-MigrationsAdminTest-1214086769-project Oct 08 21:04:59.785063 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:04:59.785063 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:04:59.785063 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 5266cd6be4514b3eac30a195f6b25772 Oct 08 21:04:59.785063 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-MigrationsAdminTest-1214086769-project Oct 08 21:04:59.785063 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:04:59.785063 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance 6ef37448-690b-4fcf-85f8-a2fb71207f38 could not be found. Oct 08 21:04:59.785063 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': '6ef37448-690b-4fcf-85f8-a2fb71207f38'} Oct 08 21:04:59.785063 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:04:59.785063 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:04:59.785063 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:04:59.785063 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:04:59.785063 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:04:59.785063 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:04:59.785063 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:04:59.785063 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:04:59.785063 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:04:59.785063 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:04:59.785063 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ef37448-690b-4fcf-85f8-a2fb71207f38 could not be found. Oct 08 21:04:59.785063 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:04:59.785063 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:04:59.785063 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:04:59.785063 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:04:59.785063 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:04:59.785063 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:04:59.785063 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:04:59.785063 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:04:59.785063 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:04:59.785063 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:04:59.785063 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:04:59.785063 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:04:59.785063 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:04:59.785063 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:04:59.785063 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:04:59.785063 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:04:59.785063 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ef37448-690b-4fcf-85f8-a2fb71207f38 could not be found. Oct 08 21:04:59.785063 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:04:59.785063 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:04:59.785063 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:04:59.789053 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:04:59.789053 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:04:59.789053 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:04:59.789053 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:04:59.789053 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:04:59.789053 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ef37448-690b-4fcf-85f8-a2fb71207f38 could not be found. Oct 08 21:04:59.789053 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:04:59.789053 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-50136090-4395-4337-9f91-7bb3be7a6f2e tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Returning 404 to user: Instance 6ef37448-690b-4fcf-85f8-a2fb71207f38 could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:04:59.789053 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-50136090-4395-4337-9f91-7bb3be7a6f2e tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/6ef37448-690b-4fcf-85f8-a2fb71207f38" status: 404 len: 111 microversion: 2.1 time: 0.037307 Oct 08 21:04:59.789053 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1577/3221] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:04:59 2022] GET /compute/v2.1/servers/6ef37448-690b-4fcf-85f8-a2fb71207f38 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 08 21:04:59.795451 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-93367b2d-f02c-41c0-8ec3-f47cbfefb937 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:59.796253 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-93367b2d-f02c-41c0-8ec3-f47cbfefb937 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: d7f3a7bd-a731-45de-a24b-e04e9d81358d] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:59.803156 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-93367b2d-f02c-41c0-8ec3-f47cbfefb937 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:59.803653 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-93367b2d-f02c-41c0-8ec3-f47cbfefb937 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:59.804098 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-93367b2d-f02c-41c0-8ec3-f47cbfefb937 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:59.804815 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-93367b2d-f02c-41c0-8ec3-f47cbfefb937 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:59.805296 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-93367b2d-f02c-41c0-8ec3-f47cbfefb937 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:59.805725 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-93367b2d-f02c-41c0-8ec3-f47cbfefb937 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:59.834778 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-93367b2d-f02c-41c0-8ec3-f47cbfefb937 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: d7f3a7bd-a731-45de-a24b-e04e9d81358d] Going to try to terminate instance {{(pid=140491) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 21:04:59.871399 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-1d4a52ae-63e9-42f8-929f-4f25608cf051 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c6153d58d264272a375b3169e0874d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c405aac48e9b403ca8d1e3ac28fab76e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:04:59.884077 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-1d4a52ae-63e9-42f8-929f-4f25608cf051 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] 10.222.0.26 "GET /compute/v2.1/servers/de9d6639-040b-44b7-b00a-c1022c705c89" status: 200 len: 1323 microversion: 2.1 time: 0.179366 Oct 08 21:04:59.885168 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1645/3222] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:04:59 2022] GET /compute/v2.1/servers/de9d6639-040b-44b7-b00a-c1022c705c89 => generated 1323 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:04:59.927893 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-93367b2d-f02c-41c0-8ec3-f47cbfefb937 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "DELETE /compute/v2.1/servers/d7f3a7bd-a731-45de-a24b-e04e9d81358d" status: 204 len: 0 microversion: 2.1 time: 0.135548 Oct 08 21:04:59.928888 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1578/3223] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:04:59 2022] DELETE /compute/v2.1/servers/d7f3a7bd-a731-45de-a24b-e04e9d81358d => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 21:04:59.937601 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-2afbf004-ae4b-47ff-bbb1-b76880ee9153 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:04:59.939426 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-2afbf004-ae4b-47ff-bbb1-b76880ee9153 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: d7f3a7bd-a731-45de-a24b-e04e9d81358d] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:04:59.947316 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2afbf004-ae4b-47ff-bbb1-b76880ee9153 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:59.948079 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2afbf004-ae4b-47ff-bbb1-b76880ee9153 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:59.948621 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2afbf004-ae4b-47ff-bbb1-b76880ee9153 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:59.949643 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2afbf004-ae4b-47ff-bbb1-b76880ee9153 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:04:59.950336 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2afbf004-ae4b-47ff-bbb1-b76880ee9153 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:04:59.950834 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2afbf004-ae4b-47ff-bbb1-b76880ee9153 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:04:59.956705 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:05:00.027908 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-5157b23b-141d-4d01-8016-c169b14003db tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:05:00.028504 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-5157b23b-141d-4d01-8016-c169b14003db tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] [instance: 93b29a96-2b64-46bd-b6ab-fd44e6599d8f] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:05:00.042567 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5157b23b-141d-4d01-8016-c169b14003db tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:00.043087 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5157b23b-141d-4d01-8016-c169b14003db tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:00.043549 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5157b23b-141d-4d01-8016-c169b14003db tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:00.060301 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5157b23b-141d-4d01-8016-c169b14003db tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:00.061240 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5157b23b-141d-4d01-8016-c169b14003db tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:00.062960 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5157b23b-141d-4d01-8016-c169b14003db tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:00.305379 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-5157b23b-141d-4d01-8016-c169b14003db tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3245fc05926b49118c0d1028de3f09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527bbe10db744ab4bcc8078f2d754d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:00.319549 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-5157b23b-141d-4d01-8016-c169b14003db tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3245fc05926b49118c0d1028de3f09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527bbe10db744ab4bcc8078f2d754d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:00.321561 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-5157b23b-141d-4d01-8016-c169b14003db tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3245fc05926b49118c0d1028de3f09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527bbe10db744ab4bcc8078f2d754d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:00.326583 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-5157b23b-141d-4d01-8016-c169b14003db tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] 10.222.0.26 "GET /compute/v2.1/servers/93b29a96-2b64-46bd-b6ab-fd44e6599d8f" status: 200 len: 1365 microversion: 2.47 time: 0.316526 Oct 08 21:05:00.327792 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1579/3224] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:05:00 2022] GET /compute/v2.1/servers/93b29a96-2b64-46bd-b6ab-fd44e6599d8f => generated 1365 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:05:00.333107 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-f2daa0b5-af08-45fa-ba24-0b02b3c1b4d5 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:05:00.339552 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-f2daa0b5-af08-45fa-ba24-0b02b3c1b4d5 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] [instance: 570d4898-169b-4f6b-aef6-ab79ea0fbefd] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:05:00.352839 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f2daa0b5-af08-45fa-ba24-0b02b3c1b4d5 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:00.353405 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f2daa0b5-af08-45fa-ba24-0b02b3c1b4d5 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:00.353997 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f2daa0b5-af08-45fa-ba24-0b02b3c1b4d5 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:00.354942 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f2daa0b5-af08-45fa-ba24-0b02b3c1b4d5 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:00.355608 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f2daa0b5-af08-45fa-ba24-0b02b3c1b4d5 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:00.356201 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f2daa0b5-af08-45fa-ba24-0b02b3c1b4d5 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:00.372052 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-f2daa0b5-af08-45fa-ba24-0b02b3c1b4d5 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] HTTP exception thrown: Instance 570d4898-169b-4f6b-aef6-ab79ea0fbefd could not be found. Oct 08 21:05:00.374019 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-f2daa0b5-af08-45fa-ba24-0b02b3c1b4d5 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Request method failure captured: Oct 08 21:05:00.374019 ncdv-master-1 devstack@n-api.service[140491]: request: GET /compute/v2.1/servers/570d4898-169b-4f6b-aef6-ab79ea0fbefd HTTP/1.1 Oct 08 21:05:00.374019 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:05:00.374019 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:05:00.374019 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:05:00.374019 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 21:05:00.374019 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:05:00.374019 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:05:00.374019 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:05:00.374019 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:05:00.374019 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeVzSRIt5rTQrfJyuOQlK1PvDMGkmLTWxWDV1e9OeipSc7OGozpm0DiV6ed9pImj2w-Ep8gcu0ZARwZRHPSrh6foq-wN9D7n07tB59TtJvIajEV-U2r3gvgNSK4q8VjvthNxW8QBysPddSfSl6Ch4mtN7SNqAxmmR7xqGLFYIYWAYUA Oct 08 21:05:00.374019 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:05:00.374019 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:05:00.374019 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:05:00.374019 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:05:00.374019 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:05:00.374019 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:05:00.374019 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 75b2a56286924e2d953bebe717ce591b Oct 08 21:05:00.374019 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-ServerRescueTestJSON-1567629939 Oct 08 21:05:00.374019 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:05:00.374019 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:05:00.374019 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/75b2a56286924e2d953bebe717ce591b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/75b2a56286924e2d953bebe717ce591b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_75b2a56286924e2d953bebe717ce591b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/75b2a56286924e2d953bebe717ce591b"}]}] Oct 08 21:05:00.374019 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-ServerRescueTestJSON-1567629939 Oct 08 21:05:00.374019 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 75b2a56286924e2d953bebe717ce591b Oct 08 21:05:00.374019 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-ServerRescueTestJSON-1567629939 Oct 08 21:05:00.374019 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-ServerRescueTestJSON-1567629939-project Oct 08 21:05:00.374019 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:05:00.374019 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:05:00.374019 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: bf2e13f1952a4e5bb23d57dd7fa31875 Oct 08 21:05:00.374019 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-ServerRescueTestJSON-1567629939-project Oct 08 21:05:00.374019 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:05:00.374019 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance 570d4898-169b-4f6b-aef6-ab79ea0fbefd could not be found. Oct 08 21:05:00.374019 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': '570d4898-169b-4f6b-aef6-ab79ea0fbefd'} Oct 08 21:05:00.374019 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:05:00.374019 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:05:00.374019 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:05:00.374019 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:05:00.374019 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:05:00.374019 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:05:00.374019 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:05:00.374019 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:05:00.374019 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:05:00.374019 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:05:00.374019 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 570d4898-169b-4f6b-aef6-ab79ea0fbefd could not be found. Oct 08 21:05:00.374019 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:05:00.374019 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:05:00.374019 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:05:00.374019 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:05:00.374019 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:05:00.374019 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:05:00.374019 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:05:00.374019 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:05:00.374019 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:05:00.374019 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:05:00.374019 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:05:00.374019 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:05:00.374019 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:05:00.374019 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:05:00.374019 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:05:00.374019 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:05:00.374019 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 570d4898-169b-4f6b-aef6-ab79ea0fbefd could not be found. Oct 08 21:05:00.374019 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:05:00.374019 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:05:00.374019 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:05:00.378398 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:05:00.378398 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:05:00.378398 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:05:00.378398 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:05:00.378398 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:05:00.378398 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 570d4898-169b-4f6b-aef6-ab79ea0fbefd could not be found. Oct 08 21:05:00.378398 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:05:00.380073 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-f2daa0b5-af08-45fa-ba24-0b02b3c1b4d5 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] Returning 404 to user: Instance 570d4898-169b-4f6b-aef6-ab79ea0fbefd could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:05:00.381153 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-f2daa0b5-af08-45fa-ba24-0b02b3c1b4d5 tempest-ServerRescueTestJSON-1567629939 tempest-ServerRescueTestJSON-1567629939-project] 10.222.0.26 "GET /compute/v2.1/servers/570d4898-169b-4f6b-aef6-ab79ea0fbefd" status: 404 len: 111 microversion: 2.1 time: 0.052197 Oct 08 21:05:00.382264 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1580/3225] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:05:00 2022] GET /compute/v2.1/servers/570d4898-169b-4f6b-aef6-ab79ea0fbefd => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:05:00.455675 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-87e7fa77-d701-4cd2-a67d-632cee6453d1 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:05:00.456876 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-87e7fa77-d701-4cd2-a67d-632cee6453d1 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] [instance: 930c77ec-9649-47fe-bdee-e215c32e28b4] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:05:00.466978 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-87e7fa77-d701-4cd2-a67d-632cee6453d1 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:00.476580 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-87e7fa77-d701-4cd2-a67d-632cee6453d1 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:00.477239 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-87e7fa77-d701-4cd2-a67d-632cee6453d1 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:00.478113 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-87e7fa77-d701-4cd2-a67d-632cee6453d1 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:00.478695 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-87e7fa77-d701-4cd2-a67d-632cee6453d1 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:00.479229 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-87e7fa77-d701-4cd2-a67d-632cee6453d1 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:00.648598 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-2afbf004-ae4b-47ff-bbb1-b76880ee9153 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:00.659301 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-2afbf004-ae4b-47ff-bbb1-b76880ee9153 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/d7f3a7bd-a731-45de-a24b-e04e9d81358d" status: 200 len: 1535 microversion: 2.1 time: 0.726242 Oct 08 21:05:00.667609 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1646/3226] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:04:59 2022] GET /compute/v2.1/servers/d7f3a7bd-a731-45de-a24b-e04e9d81358d => generated 1535 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:05:00.909667 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-fe952674-ebc0-48ec-b920-708c58fba168 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:05:00.910391 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-fe952674-ebc0-48ec-b920-708c58fba168 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] [instance: de9d6639-040b-44b7-b00a-c1022c705c89] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:05:00.922739 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fe952674-ebc0-48ec-b920-708c58fba168 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:00.923284 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fe952674-ebc0-48ec-b920-708c58fba168 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:00.923739 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fe952674-ebc0-48ec-b920-708c58fba168 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:00.924473 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fe952674-ebc0-48ec-b920-708c58fba168 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:00.929206 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fe952674-ebc0-48ec-b920-708c58fba168 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:00.929741 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fe952674-ebc0-48ec-b920-708c58fba168 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:01.099152 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-87e7fa77-d701-4cd2-a67d-632cee6453d1 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5000948fa98a4b5d96ad27436d3d0edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917519b500674698a68dc01a4e8d68a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:01.119412 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-87e7fa77-d701-4cd2-a67d-632cee6453d1 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] 10.222.0.26 "GET /compute/v2.1/servers/930c77ec-9649-47fe-bdee-e215c32e28b4" status: 200 len: 1320 microversion: 2.1 time: 0.668994 Oct 08 21:05:01.120022 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1581/3227] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:05:00 2022] GET /compute/v2.1/servers/930c77ec-9649-47fe-bdee-e215c32e28b4 => generated 1320 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:05:01.134378 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-adad9527-e0c3-4e9d-b1ea-2ab36b91a8fc req-0a33baf8-5dbc-463b-8dbd-dc4ad60d1cef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de9d6639-040b-44b7-b00a-c1022c705c89", "name": "network-vif-plugged", "status": "completed", "tag": "ca9cb617-2f51-474b-b74d-d32ecd4a80b9"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:05:01.145974 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-adad9527-e0c3-4e9d-b1ea-2ab36b91a8fc req-0a33baf8-5dbc-463b-8dbd-dc4ad60d1cef service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:01.146484 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-adad9527-e0c3-4e9d-b1ea-2ab36b91a8fc req-0a33baf8-5dbc-463b-8dbd-dc4ad60d1cef service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:01.146934 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-adad9527-e0c3-4e9d-b1ea-2ab36b91a8fc req-0a33baf8-5dbc-463b-8dbd-dc4ad60d1cef service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:01.174023 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-adad9527-e0c3-4e9d-b1ea-2ab36b91a8fc req-0a33baf8-5dbc-463b-8dbd-dc4ad60d1cef service nova] Creating event network-vif-plugged:ca9cb617-2f51-474b-b74d-d32ecd4a80b9 for instance de9d6639-040b-44b7-b00a-c1022c705c89 on nch1-master-1 Oct 08 21:05:01.187386 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-adad9527-e0c3-4e9d-b1ea-2ab36b91a8fc req-0a33baf8-5dbc-463b-8dbd-dc4ad60d1cef service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066051 Oct 08 21:05:01.188312 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1582/3228] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:05:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:05:01.357992 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-345f3e9b-8eca-4491-8f03-4d10de16a778 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:05:01.358748 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-345f3e9b-8eca-4491-8f03-4d10de16a778 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] [instance: 93b29a96-2b64-46bd-b6ab-fd44e6599d8f] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:05:01.365043 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-fe952674-ebc0-48ec-b920-708c58fba168 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c6153d58d264272a375b3169e0874d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c405aac48e9b403ca8d1e3ac28fab76e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:01.375601 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-fe952674-ebc0-48ec-b920-708c58fba168 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] 10.222.0.26 "GET /compute/v2.1/servers/de9d6639-040b-44b7-b00a-c1022c705c89" status: 200 len: 1323 microversion: 2.1 time: 0.471391 Oct 08 21:05:01.380537 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-345f3e9b-8eca-4491-8f03-4d10de16a778 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:01.381049 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-345f3e9b-8eca-4491-8f03-4d10de16a778 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:01.381529 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-345f3e9b-8eca-4491-8f03-4d10de16a778 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:01.382257 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-345f3e9b-8eca-4491-8f03-4d10de16a778 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:01.382725 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-345f3e9b-8eca-4491-8f03-4d10de16a778 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:01.383158 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-345f3e9b-8eca-4491-8f03-4d10de16a778 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:01.396739 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1647/3229] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:05:00 2022] GET /compute/v2.1/servers/de9d6639-040b-44b7-b00a-c1022c705c89 => generated 1323 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:05:01.465884 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-cf5b805d-2677-4234-94b2-d8afc58da155 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1860252481", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "12b33944-7c6a-4c51-871c-7288dba89654"}], "security_groups": [{"name": "tempest-securitygroup--39561708"}], "key_name": "tempest-keypair-1680820787", "user_data": "}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:05:01.606037 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-345f3e9b-8eca-4491-8f03-4d10de16a778 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3245fc05926b49118c0d1028de3f09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527bbe10db744ab4bcc8078f2d754d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:01.614806 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-345f3e9b-8eca-4491-8f03-4d10de16a778 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3245fc05926b49118c0d1028de3f09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527bbe10db744ab4bcc8078f2d754d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:01.616701 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-345f3e9b-8eca-4491-8f03-4d10de16a778 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3245fc05926b49118c0d1028de3f09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527bbe10db744ab4bcc8078f2d754d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:01.618219 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-345f3e9b-8eca-4491-8f03-4d10de16a778 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] 10.222.0.26 "GET /compute/v2.1/servers/93b29a96-2b64-46bd-b6ab-fd44e6599d8f" status: 200 len: 1365 microversion: 2.47 time: 0.265745 Oct 08 21:05:01.619039 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1583/3230] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:05:01 2022] GET /compute/v2.1/servers/93b29a96-2b64-46bd-b6ab-fd44e6599d8f => generated 1365 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 08 21:05:01.691707 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-bd51382c-f56b-4e7e-bd93-cbcb147426f7 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:05:01.692448 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-bd51382c-f56b-4e7e-bd93-cbcb147426f7 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: d7f3a7bd-a731-45de-a24b-e04e9d81358d] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:05:01.699003 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bd51382c-f56b-4e7e-bd93-cbcb147426f7 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:01.699861 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bd51382c-f56b-4e7e-bd93-cbcb147426f7 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:01.700565 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bd51382c-f56b-4e7e-bd93-cbcb147426f7 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:01.701566 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bd51382c-f56b-4e7e-bd93-cbcb147426f7 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:01.702399 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bd51382c-f56b-4e7e-bd93-cbcb147426f7 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:01.703054 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bd51382c-f56b-4e7e-bd93-cbcb147426f7 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:01.980531 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.network.neutron [None req-cf5b805d-2677-4234-94b2-d8afc58da155 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] validate_networks() for [('12b33944-7c6a-4c51-871c-7288dba89654', None, None, None, None, None)] {{(pid=140492) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 21:05:02.169353 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-bd51382c-f56b-4e7e-bd93-cbcb147426f7 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:02.178692 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-bd51382c-f56b-4e7e-bd93-cbcb147426f7 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/d7f3a7bd-a731-45de-a24b-e04e9d81358d" status: 200 len: 1535 microversion: 2.1 time: 0.491660 Oct 08 21:05:02.182313 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1584/3231] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:05:01 2022] GET /compute/v2.1/servers/d7f3a7bd-a731-45de-a24b-e04e9d81358d => generated 1535 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:05:02.187642 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-630d8639-92f2-4885-a586-1029fb953fac tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:05:02.188468 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-630d8639-92f2-4885-a586-1029fb953fac tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] [instance: 930c77ec-9649-47fe-bdee-e215c32e28b4] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:05:02.209606 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-630d8639-92f2-4885-a586-1029fb953fac tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:02.213932 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-630d8639-92f2-4885-a586-1029fb953fac tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:02.214499 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-630d8639-92f2-4885-a586-1029fb953fac tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:02.215369 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-630d8639-92f2-4885-a586-1029fb953fac tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:02.215908 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-630d8639-92f2-4885-a586-1029fb953fac tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:02.216594 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-630d8639-92f2-4885-a586-1029fb953fac tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:03.112235 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-630d8639-92f2-4885-a586-1029fb953fac tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5000948fa98a4b5d96ad27436d3d0edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917519b500674698a68dc01a4e8d68a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:03.120915 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-630d8639-92f2-4885-a586-1029fb953fac tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] 10.222.0.26 "GET /compute/v2.1/servers/930c77ec-9649-47fe-bdee-e215c32e28b4" status: 200 len: 1320 microversion: 2.1 time: 0.937300 Oct 08 21:05:03.130400 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1585/3232] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:05:02 2022] GET /compute/v2.1/servers/930c77ec-9649-47fe-bdee-e215c32e28b4 => generated 1320 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:05:03.135456 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-0cf77f62-123a-4725-9777-361d24b1eba3 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:05:03.136260 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-0cf77f62-123a-4725-9777-361d24b1eba3 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] [instance: de9d6639-040b-44b7-b00a-c1022c705c89] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:05:03.151891 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0cf77f62-123a-4725-9777-361d24b1eba3 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:03.152561 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0cf77f62-123a-4725-9777-361d24b1eba3 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:03.152944 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0cf77f62-123a-4725-9777-361d24b1eba3 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:03.153749 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0cf77f62-123a-4725-9777-361d24b1eba3 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:03.156352 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0cf77f62-123a-4725-9777-361d24b1eba3 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:03.156712 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0cf77f62-123a-4725-9777-361d24b1eba3 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:03.605559 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-cf5b805d-2677-4234-94b2-d8afc58da155 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Flavor limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 21:05:03.606044 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-cf5b805d-2677-4234-94b2-d8afc58da155 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Image limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 21:05:03.606613 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-cf5b805d-2677-4234-94b2-d8afc58da155 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Flavor pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 21:05:03.607112 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-cf5b805d-2677-4234-94b2-d8afc58da155 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Image pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 21:05:03.607612 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-cf5b805d-2677-4234-94b2-d8afc58da155 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 21:05:03.624035 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cf5b805d-2677-4234-94b2-d8afc58da155 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:03.626737 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cf5b805d-2677-4234-94b2-d8afc58da155 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:03.629817 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-0cf77f62-123a-4725-9777-361d24b1eba3 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c6153d58d264272a375b3169e0874d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c405aac48e9b403ca8d1e3ac28fab76e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:03.638988 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-0cf77f62-123a-4725-9777-361d24b1eba3 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] 10.222.0.26 "GET /compute/v2.1/servers/de9d6639-040b-44b7-b00a-c1022c705c89" status: 200 len: 1323 microversion: 2.1 time: 0.507228 Oct 08 21:05:03.640960 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cf5b805d-2677-4234-94b2-d8afc58da155 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:03.644081 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cf5b805d-2677-4234-94b2-d8afc58da155 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:03.644916 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1586/3233] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:05:03 2022] GET /compute/v2.1/servers/de9d6639-040b-44b7-b00a-c1022c705c89 => generated 1323 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:05:03.646427 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cf5b805d-2677-4234-94b2-d8afc58da155 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:03.647004 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cf5b805d-2677-4234-94b2-d8afc58da155 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:03.660429 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-6c2e33f0-00e6-46f2-bf97-7dba0d2faf3a tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:05:03.661663 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-6c2e33f0-00e6-46f2-bf97-7dba0d2faf3a tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] [instance: 93b29a96-2b64-46bd-b6ab-fd44e6599d8f] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:05:03.675423 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6c2e33f0-00e6-46f2-bf97-7dba0d2faf3a tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:03.681811 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6c2e33f0-00e6-46f2-bf97-7dba0d2faf3a tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:03.682620 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6c2e33f0-00e6-46f2-bf97-7dba0d2faf3a tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:03.683593 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6c2e33f0-00e6-46f2-bf97-7dba0d2faf3a tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:03.684343 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6c2e33f0-00e6-46f2-bf97-7dba0d2faf3a tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:03.685049 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6c2e33f0-00e6-46f2-bf97-7dba0d2faf3a tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:03.727375 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-cf5b805d-2677-4234-94b2-d8afc58da155 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Getting quotas for project 665f66e846c24a6db01274679100bdbf. Resources: {'cores', 'instances', 'ram'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:05:03.750163 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-cf5b805d-2677-4234-94b2-d8afc58da155 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Getting quotas for user 21870fe169dc42359d9bdb149d0016d7 and project 665f66e846c24a6db01274679100bdbf. Resources: {'cores', 'instances', 'ram'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:05:03.786574 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:05:03.811686 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-cf5b805d-2677-4234-94b2-d8afc58da155 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Going to run 1 instances... {{(pid=140492) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 21:05:03.820528 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-cf5b805d-2677-4234-94b2-d8afc58da155 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] [instance: dbacaeed-a40b-4e05-9635-5073dfdd8621] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c508bd7f-7db9-4b2c-af7c-be54a855c355',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140492) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 21:05:03.891420 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-6c2e33f0-00e6-46f2-bf97-7dba0d2faf3a tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3245fc05926b49118c0d1028de3f09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527bbe10db744ab4bcc8078f2d754d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:03.901850 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-6c2e33f0-00e6-46f2-bf97-7dba0d2faf3a tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3245fc05926b49118c0d1028de3f09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527bbe10db744ab4bcc8078f2d754d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:03.904219 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-6c2e33f0-00e6-46f2-bf97-7dba0d2faf3a tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3245fc05926b49118c0d1028de3f09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527bbe10db744ab4bcc8078f2d754d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:03.905743 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-6c2e33f0-00e6-46f2-bf97-7dba0d2faf3a tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] 10.222.0.26 "GET /compute/v2.1/servers/93b29a96-2b64-46bd-b6ab-fd44e6599d8f" status: 200 len: 1365 microversion: 2.47 time: 0.259564 Oct 08 21:05:03.934605 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1587/3234] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:05:03 2022] GET /compute/v2.1/servers/93b29a96-2b64-46bd-b6ab-fd44e6599d8f => generated 1365 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:05:03.936078 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-cf5b805d-2677-4234-94b2-d8afc58da155 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 2.474528 Oct 08 21:05:03.937176 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1648/3235] 10.222.0.26 () {62 vars in 1188 bytes} [Sat Oct 8 21:05:01 2022] POST /compute/v2.1/servers => generated 400 bytes in 2476 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 08 21:05:03.942013 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-bc3b2f39-cbe1-421b-8d0c-e092d74c8ff6 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:05:03.943883 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-a463f2ee-e388-403d-9b53-4bc58508dc1c req-84149846-e6d1-48cf-8a87-c046b1be70aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5848e7ba-40bb-4c4d-a2d0-f4dce5bb2842", "name": "network-vif-plugged", "status": "completed", "tag": "a4e3d4d3-79ff-4d23-9f0a-7308ad60535a"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:05:03.946779 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-bc3b2f39-cbe1-421b-8d0c-e092d74c8ff6 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: d7f3a7bd-a731-45de-a24b-e04e9d81358d] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:05:03.959469 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bc3b2f39-cbe1-421b-8d0c-e092d74c8ff6 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:03.959695 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-a463f2ee-e388-403d-9b53-4bc58508dc1c req-84149846-e6d1-48cf-8a87-c046b1be70aa service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:03.960113 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-a463f2ee-e388-403d-9b53-4bc58508dc1c req-84149846-e6d1-48cf-8a87-c046b1be70aa service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:03.960561 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-a463f2ee-e388-403d-9b53-4bc58508dc1c req-84149846-e6d1-48cf-8a87-c046b1be70aa service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:03.962182 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bc3b2f39-cbe1-421b-8d0c-e092d74c8ff6 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:03.963030 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bc3b2f39-cbe1-421b-8d0c-e092d74c8ff6 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:03.965807 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bc3b2f39-cbe1-421b-8d0c-e092d74c8ff6 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:03.966460 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bc3b2f39-cbe1-421b-8d0c-e092d74c8ff6 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:03.967091 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bc3b2f39-cbe1-421b-8d0c-e092d74c8ff6 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:04.007049 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-a463f2ee-e388-403d-9b53-4bc58508dc1c req-84149846-e6d1-48cf-8a87-c046b1be70aa service nova] Creating event network-vif-plugged:a4e3d4d3-79ff-4d23-9f0a-7308ad60535a for instance 5848e7ba-40bb-4c4d-a2d0-f4dce5bb2842 on nch2-master-1 Oct 08 21:05:04.017358 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-a463f2ee-e388-403d-9b53-4bc58508dc1c req-84149846-e6d1-48cf-8a87-c046b1be70aa service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076286 Oct 08 21:05:04.019824 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1649/3236] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:05:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:05:04.035867 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=4 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:05:04.040650 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bc3b2f39-cbe1-421b-8d0c-e092d74c8ff6 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:04.041161 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bc3b2f39-cbe1-421b-8d0c-e092d74c8ff6 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:04.041670 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bc3b2f39-cbe1-421b-8d0c-e092d74c8ff6 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:04.042998 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.objects.instance [None req-bc3b2f39-cbe1-421b-8d0c-e092d74c8ff6 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lazy-loading 'fault' on Instance uuid d7f3a7bd-a731-45de-a24b-e04e9d81358d {{(pid=140491) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 21:05:04.046463 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-a68a7cce-8226-4fe6-896a-9e45cea3eedd req-3668ba8c-414f-40e1-8b79-ad887305f53d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7f3a7bd-a731-45de-a24b-e04e9d81358d", "name": "network-vif-deleted", "tag": "0a909b9a-561b-42d5-bf2f-d3cc0b3356b5"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:05:04.097728 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-a68a7cce-8226-4fe6-896a-9e45cea3eedd req-3668ba8c-414f-40e1-8b79-ad887305f53d service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:04.098480 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-a68a7cce-8226-4fe6-896a-9e45cea3eedd req-3668ba8c-414f-40e1-8b79-ad887305f53d service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:04.099278 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-a68a7cce-8226-4fe6-896a-9e45cea3eedd req-3668ba8c-414f-40e1-8b79-ad887305f53d service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:04.140005 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-a68a7cce-8226-4fe6-896a-9e45cea3eedd req-3668ba8c-414f-40e1-8b79-ad887305f53d service nova] Creating event network-vif-deleted:0a909b9a-561b-42d5-bf2f-d3cc0b3356b5 for instance d7f3a7bd-a731-45de-a24b-e04e9d81358d on nch2-master-1 Oct 08 21:05:04.144955 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-a68a7cce-8226-4fe6-896a-9e45cea3eedd req-3668ba8c-414f-40e1-8b79-ad887305f53d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122636 Oct 08 21:05:04.145903 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1650/3237] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:05:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:05:04.151752 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-b890856a-f447-4807-a168-2f399c426d63 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:05:04.152641 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-b890856a-f447-4807-a168-2f399c426d63 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] [instance: dbacaeed-a40b-4e05-9635-5073dfdd8621] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:05:04.328265 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-bc3b2f39-cbe1-421b-8d0c-e092d74c8ff6 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:04.343752 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-bc3b2f39-cbe1-421b-8d0c-e092d74c8ff6 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/d7f3a7bd-a731-45de-a24b-e04e9d81358d" status: 200 len: 1369 microversion: 2.1 time: 0.407688 Oct 08 21:05:04.345834 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-b890856a-f447-4807-a168-2f399c426d63 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:04.352031 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1588/3238] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:05:03 2022] GET /compute/v2.1/servers/d7f3a7bd-a731-45de-a24b-e04e9d81358d => generated 1369 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:05:04.357993 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-278cfcfb-2651-42f3-bb1e-a9b4dc5c1cf9 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:05:04.368822 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-278cfcfb-2651-42f3-bb1e-a9b4dc5c1cf9 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] [instance: 930c77ec-9649-47fe-bdee-e215c32e28b4] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:05:04.371709 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-b890856a-f447-4807-a168-2f399c426d63 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:04.377999 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-b890856a-f447-4807-a168-2f399c426d63 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:04.380933 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-b890856a-f447-4807-a168-2f399c426d63 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] 10.222.0.26 "GET /compute/v2.1/servers/dbacaeed-a40b-4e05-9635-5073dfdd8621" status: 200 len: 1282 microversion: 2.20 time: 0.233701 Oct 08 21:05:04.386441 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-278cfcfb-2651-42f3-bb1e-a9b4dc5c1cf9 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:04.387780 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-278cfcfb-2651-42f3-bb1e-a9b4dc5c1cf9 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:04.389828 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-278cfcfb-2651-42f3-bb1e-a9b4dc5c1cf9 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:04.390537 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1651/3239] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:05:04 2022] GET /compute/v2.1/servers/dbacaeed-a40b-4e05-9635-5073dfdd8621 => generated 1282 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:05:04.392981 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-278cfcfb-2651-42f3-bb1e-a9b4dc5c1cf9 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:04.394226 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-278cfcfb-2651-42f3-bb1e-a9b4dc5c1cf9 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:04.394888 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-278cfcfb-2651-42f3-bb1e-a9b4dc5c1cf9 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:04.667351 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-5a27506d-c5aa-4ea5-bd9d-7e685561e56d tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:05:04.668805 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-5a27506d-c5aa-4ea5-bd9d-7e685561e56d tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] [instance: de9d6639-040b-44b7-b00a-c1022c705c89] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:05:04.679258 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5a27506d-c5aa-4ea5-bd9d-7e685561e56d tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:04.680091 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5a27506d-c5aa-4ea5-bd9d-7e685561e56d tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:04.680788 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5a27506d-c5aa-4ea5-bd9d-7e685561e56d tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:04.681884 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5a27506d-c5aa-4ea5-bd9d-7e685561e56d tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:04.682731 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5a27506d-c5aa-4ea5-bd9d-7e685561e56d tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:04.683340 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5a27506d-c5aa-4ea5-bd9d-7e685561e56d tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:04.783345 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-278cfcfb-2651-42f3-bb1e-a9b4dc5c1cf9 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5000948fa98a4b5d96ad27436d3d0edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917519b500674698a68dc01a4e8d68a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:04.795915 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-278cfcfb-2651-42f3-bb1e-a9b4dc5c1cf9 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] 10.222.0.26 "GET /compute/v2.1/servers/930c77ec-9649-47fe-bdee-e215c32e28b4" status: 200 len: 1320 microversion: 2.1 time: 0.438547 Oct 08 21:05:04.812010 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1589/3240] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:05:04 2022] GET /compute/v2.1/servers/930c77ec-9649-47fe-bdee-e215c32e28b4 => generated 1320 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:05:04.935018 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-f6ea1461-dff4-4d3d-95ab-be706910b053 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:05:04.935653 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-f6ea1461-dff4-4d3d-95ab-be706910b053 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] [instance: 93b29a96-2b64-46bd-b6ab-fd44e6599d8f] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:05:04.944184 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f6ea1461-dff4-4d3d-95ab-be706910b053 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:04.945630 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f6ea1461-dff4-4d3d-95ab-be706910b053 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:04.946258 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f6ea1461-dff4-4d3d-95ab-be706910b053 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:04.947534 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f6ea1461-dff4-4d3d-95ab-be706910b053 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:04.948180 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f6ea1461-dff4-4d3d-95ab-be706910b053 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:04.948792 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f6ea1461-dff4-4d3d-95ab-be706910b053 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:05.060686 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-f6ea1461-dff4-4d3d-95ab-be706910b053 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3245fc05926b49118c0d1028de3f09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527bbe10db744ab4bcc8078f2d754d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:05.074347 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-f6ea1461-dff4-4d3d-95ab-be706910b053 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3245fc05926b49118c0d1028de3f09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527bbe10db744ab4bcc8078f2d754d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:05.078735 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-f6ea1461-dff4-4d3d-95ab-be706910b053 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3245fc05926b49118c0d1028de3f09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527bbe10db744ab4bcc8078f2d754d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:05.080401 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-f6ea1461-dff4-4d3d-95ab-be706910b053 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] 10.222.0.26 "GET /compute/v2.1/servers/93b29a96-2b64-46bd-b6ab-fd44e6599d8f" status: 200 len: 1365 microversion: 2.47 time: 0.149730 Oct 08 21:05:05.081180 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1590/3241] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:05:04 2022] GET /compute/v2.1/servers/93b29a96-2b64-46bd-b6ab-fd44e6599d8f => generated 1365 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 08 21:05:05.313634 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-5a27506d-c5aa-4ea5-bd9d-7e685561e56d tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c6153d58d264272a375b3169e0874d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c405aac48e9b403ca8d1e3ac28fab76e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:05.334551 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-5a27506d-c5aa-4ea5-bd9d-7e685561e56d tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] 10.222.0.26 "GET /compute/v2.1/servers/de9d6639-040b-44b7-b00a-c1022c705c89" status: 200 len: 1519 microversion: 2.1 time: 0.671879 Oct 08 21:05:05.335826 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1652/3242] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:05:04 2022] GET /compute/v2.1/servers/de9d6639-040b-44b7-b00a-c1022c705c89 => generated 1519 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:05:05.359195 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-eae3ca1a-19bd-488f-b708-82b1a2f826fc tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Action: 'create', calling method: .version_select at 0x7f1a8cd84040>, body: {"pool": null} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:05:05.376410 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-60c1463e-b5d4-4fe8-822a-0671721baf9b tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:05:05.377450 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-60c1463e-b5d4-4fe8-822a-0671721baf9b tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: d7f3a7bd-a731-45de-a24b-e04e9d81358d] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:05:05.393882 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-60c1463e-b5d4-4fe8-822a-0671721baf9b tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:05.394725 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-60c1463e-b5d4-4fe8-822a-0671721baf9b tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:05.395430 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-60c1463e-b5d4-4fe8-822a-0671721baf9b tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:05.396660 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-60c1463e-b5d4-4fe8-822a-0671721baf9b tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:05.397385 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-60c1463e-b5d4-4fe8-822a-0671721baf9b tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:05.398045 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-60c1463e-b5d4-4fe8-822a-0671721baf9b tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:05.419993 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-60c1463e-b5d4-4fe8-822a-0671721baf9b tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] HTTP exception thrown: Instance d7f3a7bd-a731-45de-a24b-e04e9d81358d could not be found. Oct 08 21:05:05.427713 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-60c1463e-b5d4-4fe8-822a-0671721baf9b tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Request method failure captured: Oct 08 21:05:05.427713 ncdv-master-1 devstack@n-api.service[140492]: request: GET /compute/v2.1/servers/d7f3a7bd-a731-45de-a24b-e04e9d81358d HTTP/1.1 Oct 08 21:05:05.427713 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:05:05.427713 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:05:05.427713 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:05:05.427713 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 21:05:05.427713 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:05:05.427713 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:05:05.427713 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:05:05.427713 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:05:05.427713 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeSpH4XDiYW19iQbBiok8uGM0c09fRqx5RRIizvfuTfqVgRGIpA6bFXwFHQqBS5yIR3OkB2E0bcw2nYeKqHv0LMQ6Oyj572d2Mx3XOjvMpnN8CYfHcY_H_6fonfL0ijUqcg70H8pyQhVd4bZHdhW8zWnUCcY8Nk9k_rfX1dbnTaTfN8 Oct 08 21:05:05.427713 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:05:05.427713 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:05:05.427713 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:05:05.427713 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:05:05.427713 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:05:05.427713 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:05:05.427713 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 0ffdae031c4f47d599acb30f1d3c87b9 Oct 08 21:05:05.427713 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-MigrationsAdminTest-1214086769 Oct 08 21:05:05.427713 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:05:05.427713 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:05:05.427713 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0ffdae031c4f47d599acb30f1d3c87b9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0ffdae031c4f47d599acb30f1d3c87b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0ffdae031c4f47d599acb30f1d3c87b9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0ffdae031c4f47d599acb30f1d3c87b9"}]}] Oct 08 21:05:05.427713 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-MigrationsAdminTest-1214086769 Oct 08 21:05:05.427713 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 0ffdae031c4f47d599acb30f1d3c87b9 Oct 08 21:05:05.427713 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-MigrationsAdminTest-1214086769 Oct 08 21:05:05.427713 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-MigrationsAdminTest-1214086769-project Oct 08 21:05:05.427713 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:05:05.427713 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:05:05.427713 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 5266cd6be4514b3eac30a195f6b25772 Oct 08 21:05:05.427713 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-MigrationsAdminTest-1214086769-project Oct 08 21:05:05.427713 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 21:05:05.427713 ncdv-master-1 devstack@n-api.service[140492]: exception: Instance d7f3a7bd-a731-45de-a24b-e04e9d81358d could not be found. Oct 08 21:05:05.427713 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': 'd7f3a7bd-a731-45de-a24b-e04e9d81358d'} Oct 08 21:05:05.427713 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:05:05.427713 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:05:05.427713 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:05:05.427713 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:05:05.427713 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:05:05.427713 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:05:05.427713 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:05:05.427713 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:05:05.427713 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:05:05.427713 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:05:05.427713 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7f3a7bd-a731-45de-a24b-e04e9d81358d could not be found. Oct 08 21:05:05.427713 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:05:05.427713 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:05:05.427713 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:05:05.427713 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:05:05.427713 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:05:05.427713 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:05:05.427713 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:05:05.427713 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:05:05.427713 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:05:05.427713 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:05:05.427713 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:05:05.427713 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:05:05.427713 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:05:05.427713 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:05:05.427713 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:05:05.427713 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:05:05.427713 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7f3a7bd-a731-45de-a24b-e04e9d81358d could not be found. Oct 08 21:05:05.427713 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:05:05.427713 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:05:05.427713 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:05:05.431876 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:05:05.431876 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:05:05.431876 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:05:05.431876 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:05:05.431876 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:05:05.431876 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7f3a7bd-a731-45de-a24b-e04e9d81358d could not be found. Oct 08 21:05:05.431876 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:05:05.437712 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-60c1463e-b5d4-4fe8-822a-0671721baf9b tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Returning 404 to user: Instance d7f3a7bd-a731-45de-a24b-e04e9d81358d could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:05:05.438966 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-60c1463e-b5d4-4fe8-822a-0671721baf9b tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/d7f3a7bd-a731-45de-a24b-e04e9d81358d" status: 404 len: 111 microversion: 2.1 time: 0.072424 Oct 08 21:05:05.443470 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1653/3243] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:05:05 2022] GET /compute/v2.1/servers/d7f3a7bd-a731-45de-a24b-e04e9d81358d => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:05:05.459080 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-b4a7137a-25c2-48e3-8562-f4a048005a76 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:05:05.461315 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-b4a7137a-25c2-48e3-8562-f4a048005a76 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] [instance: dbacaeed-a40b-4e05-9635-5073dfdd8621] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:05:05.477071 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b4a7137a-25c2-48e3-8562-f4a048005a76 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:05.478206 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b4a7137a-25c2-48e3-8562-f4a048005a76 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:05.478908 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b4a7137a-25c2-48e3-8562-f4a048005a76 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:05.479874 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b4a7137a-25c2-48e3-8562-f4a048005a76 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:05.480553 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b4a7137a-25c2-48e3-8562-f4a048005a76 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:05.481221 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b4a7137a-25c2-48e3-8562-f4a048005a76 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:05.842885 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-b4a7137a-25c2-48e3-8562-f4a048005a76 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:05.871763 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-b4a7137a-25c2-48e3-8562-f4a048005a76 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:05.873829 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-b4a7137a-25c2-48e3-8562-f4a048005a76 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:05.875271 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-b4a7137a-25c2-48e3-8562-f4a048005a76 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] 10.222.0.26 "GET /compute/v2.1/servers/dbacaeed-a40b-4e05-9635-5073dfdd8621" status: 200 len: 1278 microversion: 2.20 time: 0.427428 Oct 08 21:05:05.876667 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1654/3244] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:05:05 2022] GET /compute/v2.1/servers/dbacaeed-a40b-4e05-9635-5073dfdd8621 => generated 1278 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:05:05.895018 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-02fa4614-c6c4-4da1-abfd-df8c988299c3 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '.version_select at 0x7f1a8c214dc0>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:05:05.942441 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-02fa4614-c6c4-4da1-abfd-df8c988299c3 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-143633498" status: 202 len: 0 microversion: 2.1 time: 0.064229 Oct 08 21:05:05.964345 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1655/3245] 10.222.0.26 () {58 vars in 1218 bytes} [Sat Oct 8 21:05:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-143633498 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 21:05:05.984592 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e29bef19-fd10-4329-97b9-376d20b427b3 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:05:05.987741 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-e29bef19-fd10-4329-97b9-376d20b427b3 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] [instance: 930c77ec-9649-47fe-bdee-e215c32e28b4] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:05:06.000198 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e29bef19-fd10-4329-97b9-376d20b427b3 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:06.002013 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e29bef19-fd10-4329-97b9-376d20b427b3 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:06.002868 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e29bef19-fd10-4329-97b9-376d20b427b3 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:06.003982 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e29bef19-fd10-4329-97b9-376d20b427b3 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:06.004642 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e29bef19-fd10-4329-97b9-376d20b427b3 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:06.005382 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e29bef19-fd10-4329-97b9-376d20b427b3 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:06.449323 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-e29bef19-fd10-4329-97b9-376d20b427b3 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5000948fa98a4b5d96ad27436d3d0edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917519b500674698a68dc01a4e8d68a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:06.467319 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-e29bef19-fd10-4329-97b9-376d20b427b3 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] 10.222.0.26 "GET /compute/v2.1/servers/930c77ec-9649-47fe-bdee-e215c32e28b4" status: 200 len: 1320 microversion: 2.1 time: 0.499401 Oct 08 21:05:06.481494 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1656/3246] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:05:05 2022] GET /compute/v2.1/servers/930c77ec-9649-47fe-bdee-e215c32e28b4 => generated 1320 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:05:06.505033 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-f5951308-e165-475f-8180-f0b314e39075 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:05:06.507181 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-f5951308-e165-475f-8180-f0b314e39075 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] [instance: 93b29a96-2b64-46bd-b6ab-fd44e6599d8f] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:05:06.530005 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f5951308-e165-475f-8180-f0b314e39075 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:06.530684 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f5951308-e165-475f-8180-f0b314e39075 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:06.534068 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f5951308-e165-475f-8180-f0b314e39075 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:06.534928 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f5951308-e165-475f-8180-f0b314e39075 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:06.535420 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f5951308-e165-475f-8180-f0b314e39075 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:06.535863 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f5951308-e165-475f-8180-f0b314e39075 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:06.676372 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-f5951308-e165-475f-8180-f0b314e39075 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3245fc05926b49118c0d1028de3f09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527bbe10db744ab4bcc8078f2d754d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:06.688955 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-f5951308-e165-475f-8180-f0b314e39075 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3245fc05926b49118c0d1028de3f09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527bbe10db744ab4bcc8078f2d754d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:06.697681 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-f5951308-e165-475f-8180-f0b314e39075 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3245fc05926b49118c0d1028de3f09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527bbe10db744ab4bcc8078f2d754d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:06.699009 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-f5951308-e165-475f-8180-f0b314e39075 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] 10.222.0.26 "GET /compute/v2.1/servers/93b29a96-2b64-46bd-b6ab-fd44e6599d8f" status: 200 len: 1365 microversion: 2.47 time: 0.216073 Oct 08 21:05:06.699852 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1657/3247] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:05:06 2022] GET /compute/v2.1/servers/93b29a96-2b64-46bd-b6ab-fd44e6599d8f => generated 1365 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:05:06.919761 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-5d85efeb-47eb-4fc7-bd0d-477b0b73f376 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:05:06.922554 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-5d85efeb-47eb-4fc7-bd0d-477b0b73f376 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] [instance: dbacaeed-a40b-4e05-9635-5073dfdd8621] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:05:06.972883 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5d85efeb-47eb-4fc7-bd0d-477b0b73f376 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:06.973434 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5d85efeb-47eb-4fc7-bd0d-477b0b73f376 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:06.973911 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5d85efeb-47eb-4fc7-bd0d-477b0b73f376 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:06.975971 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5d85efeb-47eb-4fc7-bd0d-477b0b73f376 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:06.976496 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5d85efeb-47eb-4fc7-bd0d-477b0b73f376 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:06.978073 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5d85efeb-47eb-4fc7-bd0d-477b0b73f376 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:07.106277 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-5d85efeb-47eb-4fc7-bd0d-477b0b73f376 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:07.115605 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-5d85efeb-47eb-4fc7-bd0d-477b0b73f376 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:07.117093 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-5d85efeb-47eb-4fc7-bd0d-477b0b73f376 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:07.130755 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-5d85efeb-47eb-4fc7-bd0d-477b0b73f376 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] 10.222.0.26 "GET /compute/v2.1/servers/dbacaeed-a40b-4e05-9635-5073dfdd8621" status: 200 len: 1340 microversion: 2.20 time: 0.230487 Oct 08 21:05:07.131744 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1658/3248] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:05:06 2022] GET /compute/v2.1/servers/dbacaeed-a40b-4e05-9635-5073dfdd8621 => generated 1340 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:05:07.499670 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-84a114ea-79ea-4fb0-ad4f-8007246ea681 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:05:07.500279 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-84a114ea-79ea-4fb0-ad4f-8007246ea681 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] [instance: 930c77ec-9649-47fe-bdee-e215c32e28b4] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:05:07.514035 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-84a114ea-79ea-4fb0-ad4f-8007246ea681 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:07.515557 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-84a114ea-79ea-4fb0-ad4f-8007246ea681 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:07.517500 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-84a114ea-79ea-4fb0-ad4f-8007246ea681 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:07.520436 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-84a114ea-79ea-4fb0-ad4f-8007246ea681 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:07.524793 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-84a114ea-79ea-4fb0-ad4f-8007246ea681 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:07.525518 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-84a114ea-79ea-4fb0-ad4f-8007246ea681 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:08.080439 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-84a114ea-79ea-4fb0-ad4f-8007246ea681 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5000948fa98a4b5d96ad27436d3d0edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917519b500674698a68dc01a4e8d68a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:08.091238 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-84a114ea-79ea-4fb0-ad4f-8007246ea681 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] 10.222.0.26 "GET /compute/v2.1/servers/930c77ec-9649-47fe-bdee-e215c32e28b4" status: 200 len: 1320 microversion: 2.1 time: 0.599570 Oct 08 21:05:08.096120 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1659/3249] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:05:07 2022] GET /compute/v2.1/servers/930c77ec-9649-47fe-bdee-e215c32e28b4 => generated 1320 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:05:08.102759 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-5961c1fd-227c-41eb-9f0f-8499f48e7f22 req-1cc0bbd4-af86-4b13-bb7c-ae0f0dd3b6bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "930c77ec-9649-47fe-bdee-e215c32e28b4", "name": "network-vif-plugged", "status": "completed", "tag": "bb41a678-69e1-4d9b-9a19-9898e186a74e"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:05:08.130291 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-5961c1fd-227c-41eb-9f0f-8499f48e7f22 req-1cc0bbd4-af86-4b13-bb7c-ae0f0dd3b6bf service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:08.130977 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-5961c1fd-227c-41eb-9f0f-8499f48e7f22 req-1cc0bbd4-af86-4b13-bb7c-ae0f0dd3b6bf service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:08.132047 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-5961c1fd-227c-41eb-9f0f-8499f48e7f22 req-1cc0bbd4-af86-4b13-bb7c-ae0f0dd3b6bf service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:08.162640 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-5961c1fd-227c-41eb-9f0f-8499f48e7f22 req-1cc0bbd4-af86-4b13-bb7c-ae0f0dd3b6bf service nova] Creating event network-vif-plugged:bb41a678-69e1-4d9b-9a19-9898e186a74e for instance 930c77ec-9649-47fe-bdee-e215c32e28b4 on nch1-master-1 Oct 08 21:05:08.170726 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-5961c1fd-227c-41eb-9f0f-8499f48e7f22 req-1cc0bbd4-af86-4b13-bb7c-ae0f0dd3b6bf service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072371 Oct 08 21:05:08.172022 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1660/3250] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:05:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:05:08.189229 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e491fc00-47d7-43fa-82fa-13576eff5141 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:05:08.192756 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-e491fc00-47d7-43fa-82fa-13576eff5141 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] [instance: 93b29a96-2b64-46bd-b6ab-fd44e6599d8f] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:05:08.213286 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e491fc00-47d7-43fa-82fa-13576eff5141 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:08.215260 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e491fc00-47d7-43fa-82fa-13576eff5141 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:08.217439 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e491fc00-47d7-43fa-82fa-13576eff5141 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:08.220772 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e491fc00-47d7-43fa-82fa-13576eff5141 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:08.222339 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e491fc00-47d7-43fa-82fa-13576eff5141 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:08.222987 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e491fc00-47d7-43fa-82fa-13576eff5141 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:08.425162 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-e491fc00-47d7-43fa-82fa-13576eff5141 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3245fc05926b49118c0d1028de3f09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527bbe10db744ab4bcc8078f2d754d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:08.435231 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-e491fc00-47d7-43fa-82fa-13576eff5141 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3245fc05926b49118c0d1028de3f09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527bbe10db744ab4bcc8078f2d754d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:08.439759 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-e491fc00-47d7-43fa-82fa-13576eff5141 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3245fc05926b49118c0d1028de3f09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527bbe10db744ab4bcc8078f2d754d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:08.440994 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-e491fc00-47d7-43fa-82fa-13576eff5141 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] 10.222.0.26 "GET /compute/v2.1/servers/93b29a96-2b64-46bd-b6ab-fd44e6599d8f" status: 200 len: 1371 microversion: 2.47 time: 0.266863 Oct 08 21:05:08.454693 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1661/3251] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:05:08 2022] GET /compute/v2.1/servers/93b29a96-2b64-46bd-b6ab-fd44e6599d8f => generated 1371 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:05:08.513330 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-5e7035b3-5311-4316-8fbe-fd5b8cd502cd tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:05:08.513330 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-5e7035b3-5311-4316-8fbe-fd5b8cd502cd tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] [instance: dbacaeed-a40b-4e05-9635-5073dfdd8621] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:05:08.516661 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5e7035b3-5311-4316-8fbe-fd5b8cd502cd tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:08.517205 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5e7035b3-5311-4316-8fbe-fd5b8cd502cd tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:08.518783 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5e7035b3-5311-4316-8fbe-fd5b8cd502cd tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:08.521323 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5e7035b3-5311-4316-8fbe-fd5b8cd502cd tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:08.523381 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5e7035b3-5311-4316-8fbe-fd5b8cd502cd tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:08.523841 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5e7035b3-5311-4316-8fbe-fd5b8cd502cd tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:08.838782 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-5e7035b3-5311-4316-8fbe-fd5b8cd502cd tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:08.849422 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-5e7035b3-5311-4316-8fbe-fd5b8cd502cd tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:08.851567 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-5e7035b3-5311-4316-8fbe-fd5b8cd502cd tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:08.853070 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-5e7035b3-5311-4316-8fbe-fd5b8cd502cd tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] 10.222.0.26 "GET /compute/v2.1/servers/dbacaeed-a40b-4e05-9635-5073dfdd8621" status: 200 len: 1340 microversion: 2.20 time: 0.397316 Oct 08 21:05:08.854368 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1662/3252] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:05:08 2022] GET /compute/v2.1/servers/dbacaeed-a40b-4e05-9635-5073dfdd8621 => generated 1340 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:05:09.116993 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-9af8c9e1-ca88-437b-bd20-98267cfddbe8 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:05:09.117709 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-9af8c9e1-ca88-437b-bd20-98267cfddbe8 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] [instance: 930c77ec-9649-47fe-bdee-e215c32e28b4] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:05:09.131376 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9af8c9e1-ca88-437b-bd20-98267cfddbe8 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:09.131893 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9af8c9e1-ca88-437b-bd20-98267cfddbe8 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:09.132346 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9af8c9e1-ca88-437b-bd20-98267cfddbe8 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:09.136575 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9af8c9e1-ca88-437b-bd20-98267cfddbe8 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:09.138267 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9af8c9e1-ca88-437b-bd20-98267cfddbe8 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:09.138728 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9af8c9e1-ca88-437b-bd20-98267cfddbe8 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:09.456564 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-9af8c9e1-ca88-437b-bd20-98267cfddbe8 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5000948fa98a4b5d96ad27436d3d0edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917519b500674698a68dc01a4e8d68a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:09.474096 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-9af8c9e1-ca88-437b-bd20-98267cfddbe8 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] 10.222.0.26 "GET /compute/v2.1/servers/930c77ec-9649-47fe-bdee-e215c32e28b4" status: 200 len: 1320 microversion: 2.1 time: 0.361512 Oct 08 21:05:09.478310 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1663/3253] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:05:09 2022] GET /compute/v2.1/servers/930c77ec-9649-47fe-bdee-e215c32e28b4 => generated 1320 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:05:09.487341 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-306aa924-fa74-4987-9a5b-feeec15b066f tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:05:09.488483 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-306aa924-fa74-4987-9a5b-feeec15b066f tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] [instance: 93b29a96-2b64-46bd-b6ab-fd44e6599d8f] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:05:09.497384 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-306aa924-fa74-4987-9a5b-feeec15b066f tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:09.529253 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-306aa924-fa74-4987-9a5b-feeec15b066f tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.032s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:09.529819 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-306aa924-fa74-4987-9a5b-feeec15b066f tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:09.532690 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-306aa924-fa74-4987-9a5b-feeec15b066f tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:09.542756 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-306aa924-fa74-4987-9a5b-feeec15b066f tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:09.545113 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-306aa924-fa74-4987-9a5b-feeec15b066f tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:09.753065 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-306aa924-fa74-4987-9a5b-feeec15b066f tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3245fc05926b49118c0d1028de3f09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527bbe10db744ab4bcc8078f2d754d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:09.780132 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-306aa924-fa74-4987-9a5b-feeec15b066f tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3245fc05926b49118c0d1028de3f09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527bbe10db744ab4bcc8078f2d754d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:09.787056 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-306aa924-fa74-4987-9a5b-feeec15b066f tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3245fc05926b49118c0d1028de3f09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527bbe10db744ab4bcc8078f2d754d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:09.799209 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-306aa924-fa74-4987-9a5b-feeec15b066f tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] 10.222.0.26 "GET /compute/v2.1/servers/93b29a96-2b64-46bd-b6ab-fd44e6599d8f" status: 200 len: 1371 microversion: 2.47 time: 0.319166 Oct 08 21:05:09.801518 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1664/3254] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:05:09 2022] GET /compute/v2.1/servers/93b29a96-2b64-46bd-b6ab-fd44e6599d8f => generated 1371 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:05:09.883773 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-7fcbbcea-fc3b-4f99-8ab3-ecf748bb4c39 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:05:09.885702 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-7fcbbcea-fc3b-4f99-8ab3-ecf748bb4c39 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] [instance: dbacaeed-a40b-4e05-9635-5073dfdd8621] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:05:09.898753 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7fcbbcea-fc3b-4f99-8ab3-ecf748bb4c39 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:09.899583 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7fcbbcea-fc3b-4f99-8ab3-ecf748bb4c39 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:09.900219 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7fcbbcea-fc3b-4f99-8ab3-ecf748bb4c39 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:09.902527 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7fcbbcea-fc3b-4f99-8ab3-ecf748bb4c39 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:09.905804 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7fcbbcea-fc3b-4f99-8ab3-ecf748bb4c39 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:09.906575 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7fcbbcea-fc3b-4f99-8ab3-ecf748bb4c39 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:10.145706 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-7fcbbcea-fc3b-4f99-8ab3-ecf748bb4c39 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:10.186073 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-7fcbbcea-fc3b-4f99-8ab3-ecf748bb4c39 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:10.190833 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-7fcbbcea-fc3b-4f99-8ab3-ecf748bb4c39 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:10.192612 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-7fcbbcea-fc3b-4f99-8ab3-ecf748bb4c39 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] 10.222.0.26 "GET /compute/v2.1/servers/dbacaeed-a40b-4e05-9635-5073dfdd8621" status: 200 len: 1340 microversion: 2.20 time: 0.312771 Oct 08 21:05:10.209292 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1665/3255] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:05:09 2022] GET /compute/v2.1/servers/dbacaeed-a40b-4e05-9635-5073dfdd8621 => generated 1340 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:05:10.341053 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-fb864ccc-4b98-46ef-bd88-573ef418cd2e tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:05:10.342034 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-fb864ccc-4b98-46ef-bd88-573ef418cd2e tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: 38b000d3-167b-4f7a-ab80-cd51fcb7cbaf] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:05:10.349002 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fb864ccc-4b98-46ef-bd88-573ef418cd2e tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:10.349617 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fb864ccc-4b98-46ef-bd88-573ef418cd2e tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:10.350131 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fb864ccc-4b98-46ef-bd88-573ef418cd2e tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:10.351201 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fb864ccc-4b98-46ef-bd88-573ef418cd2e tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:10.351727 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fb864ccc-4b98-46ef-bd88-573ef418cd2e tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:10.352261 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fb864ccc-4b98-46ef-bd88-573ef418cd2e tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:10.392067 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-fb864ccc-4b98-46ef-bd88-573ef418cd2e tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: 38b000d3-167b-4f7a-ab80-cd51fcb7cbaf] Going to try to terminate instance {{(pid=140492) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 21:05:10.581322 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:05:10.714488 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-fb864ccc-4b98-46ef-bd88-573ef418cd2e tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "DELETE /compute/v2.1/servers/38b000d3-167b-4f7a-ab80-cd51fcb7cbaf" status: 204 len: 0 microversion: 2.1 time: 0.377428 Oct 08 21:05:10.715139 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1666/3256] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:05:10 2022] DELETE /compute/v2.1/servers/38b000d3-167b-4f7a-ab80-cd51fcb7cbaf => generated 0 bytes in 379 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 08 21:05:10.720791 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-679121ec-1847-4ac8-85ca-e8fb29e85b83 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:05:10.729476 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-679121ec-1847-4ac8-85ca-e8fb29e85b83 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] [instance: 930c77ec-9649-47fe-bdee-e215c32e28b4] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:05:10.733272 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:05:10.752264 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-679121ec-1847-4ac8-85ca-e8fb29e85b83 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:10.752783 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-679121ec-1847-4ac8-85ca-e8fb29e85b83 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:10.753264 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-679121ec-1847-4ac8-85ca-e8fb29e85b83 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:10.754004 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-679121ec-1847-4ac8-85ca-e8fb29e85b83 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:10.754492 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-679121ec-1847-4ac8-85ca-e8fb29e85b83 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:10.754921 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-679121ec-1847-4ac8-85ca-e8fb29e85b83 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:11.230481 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-eae3ca1a-19bd-488f-b708-82b1a2f826fc tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] 10.222.0.26 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 5.875149 Oct 08 21:05:11.244683 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1591/3257] 10.222.0.26 () {60 vars in 1170 bytes} [Sat Oct 8 21:05:05 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 5890 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:05:11.251435 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-18bdc570-2558-4087-b83e-9dffe35de746 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:05:11.252098 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-18bdc570-2558-4087-b83e-9dffe35de746 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: 38b000d3-167b-4f7a-ab80-cd51fcb7cbaf] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:05:11.264887 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-18bdc570-2558-4087-b83e-9dffe35de746 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:11.265445 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-18bdc570-2558-4087-b83e-9dffe35de746 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:11.270681 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-18bdc570-2558-4087-b83e-9dffe35de746 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:11.270681 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-18bdc570-2558-4087-b83e-9dffe35de746 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:11.270681 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-18bdc570-2558-4087-b83e-9dffe35de746 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:11.270681 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-18bdc570-2558-4087-b83e-9dffe35de746 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:11.832360 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-679121ec-1847-4ac8-85ca-e8fb29e85b83 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5000948fa98a4b5d96ad27436d3d0edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917519b500674698a68dc01a4e8d68a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:11.847928 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-679121ec-1847-4ac8-85ca-e8fb29e85b83 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] 10.222.0.26 "GET /compute/v2.1/servers/930c77ec-9649-47fe-bdee-e215c32e28b4" status: 200 len: 1508 microversion: 2.1 time: 1.131222 Oct 08 21:05:11.849127 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1667/3258] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:05:10 2022] GET /compute/v2.1/servers/930c77ec-9649-47fe-bdee-e215c32e28b4 => generated 1508 bytes in 1133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:05:11.858183 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-894e7cec-e35f-48cc-bf97-e0c7eb9f9c66 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:05:11.865376 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-894e7cec-e35f-48cc-bf97-e0c7eb9f9c66 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] [instance: 93b29a96-2b64-46bd-b6ab-fd44e6599d8f] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:05:11.917094 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-894e7cec-e35f-48cc-bf97-e0c7eb9f9c66 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:11.922561 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-894e7cec-e35f-48cc-bf97-e0c7eb9f9c66 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:11.923037 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-894e7cec-e35f-48cc-bf97-e0c7eb9f9c66 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:11.928059 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-894e7cec-e35f-48cc-bf97-e0c7eb9f9c66 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:11.928561 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-894e7cec-e35f-48cc-bf97-e0c7eb9f9c66 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:11.929011 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-894e7cec-e35f-48cc-bf97-e0c7eb9f9c66 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:12.069153 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-894e7cec-e35f-48cc-bf97-e0c7eb9f9c66 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3245fc05926b49118c0d1028de3f09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527bbe10db744ab4bcc8078f2d754d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:12.079804 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-894e7cec-e35f-48cc-bf97-e0c7eb9f9c66 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3245fc05926b49118c0d1028de3f09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527bbe10db744ab4bcc8078f2d754d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:12.081275 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-894e7cec-e35f-48cc-bf97-e0c7eb9f9c66 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3245fc05926b49118c0d1028de3f09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527bbe10db744ab4bcc8078f2d754d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:12.082659 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-894e7cec-e35f-48cc-bf97-e0c7eb9f9c66 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] 10.222.0.26 "GET /compute/v2.1/servers/93b29a96-2b64-46bd-b6ab-fd44e6599d8f" status: 200 len: 1356 microversion: 2.47 time: 0.232311 Oct 08 21:05:12.083458 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1668/3259] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:05:11 2022] GET /compute/v2.1/servers/93b29a96-2b64-46bd-b6ab-fd44e6599d8f => generated 1356 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:05:12.091847 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-349d23cf-32e1-47cf-a806-afa5d3f2645f tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:05:12.092677 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-349d23cf-32e1-47cf-a806-afa5d3f2645f tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] [instance: dbacaeed-a40b-4e05-9635-5073dfdd8621] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:05:12.100847 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-349d23cf-32e1-47cf-a806-afa5d3f2645f tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:12.101613 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-349d23cf-32e1-47cf-a806-afa5d3f2645f tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:12.102366 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-349d23cf-32e1-47cf-a806-afa5d3f2645f tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:12.105437 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-349d23cf-32e1-47cf-a806-afa5d3f2645f tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:12.105948 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-349d23cf-32e1-47cf-a806-afa5d3f2645f tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:12.106392 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-349d23cf-32e1-47cf-a806-afa5d3f2645f tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:12.245826 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-18bdc570-2558-4087-b83e-9dffe35de746 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:12.258573 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-18bdc570-2558-4087-b83e-9dffe35de746 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/38b000d3-167b-4f7a-ab80-cd51fcb7cbaf" status: 200 len: 1468 microversion: 2.1 time: 1.012559 Oct 08 21:05:12.259996 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1592/3260] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:05:11 2022] GET /compute/v2.1/servers/38b000d3-167b-4f7a-ab80-cd51fcb7cbaf => generated 1468 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:05:12.267480 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-130611c2-586c-400c-a0c3-bc3b49126ea9 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-938363330", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "networks": [{"uuid": "b449bb70-491a-439e-8976-e26644902f7a"}]}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:05:12.363371 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.network.neutron [None req-130611c2-586c-400c-a0c3-bc3b49126ea9 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] validate_networks() for [('b449bb70-491a-439e-8976-e26644902f7a', None, None, None, None, None)] {{(pid=140491) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 21:05:13.003456 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-349d23cf-32e1-47cf-a806-afa5d3f2645f tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:13.018649 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-349d23cf-32e1-47cf-a806-afa5d3f2645f tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:13.020531 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-349d23cf-32e1-47cf-a806-afa5d3f2645f tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:13.021850 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-349d23cf-32e1-47cf-a806-afa5d3f2645f tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] 10.222.0.26 "GET /compute/v2.1/servers/dbacaeed-a40b-4e05-9635-5073dfdd8621" status: 200 len: 1406 microversion: 2.20 time: 0.936549 Oct 08 21:05:13.024758 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1669/3261] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:05:12 2022] GET /compute/v2.1/servers/dbacaeed-a40b-4e05-9635-5073dfdd8621 => generated 1406 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:05:13.034034 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-9ddf765e-b464-4393-b8d7-b0cb6ef6c04f tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:05:13.038166 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-9ddf765e-b464-4393-b8d7-b0cb6ef6c04f tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] [instance: 5848e7ba-40bb-4c4d-a2d0-f4dce5bb2842] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:05:13.052303 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9ddf765e-b464-4393-b8d7-b0cb6ef6c04f tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:13.057751 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9ddf765e-b464-4393-b8d7-b0cb6ef6c04f tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:13.058634 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9ddf765e-b464-4393-b8d7-b0cb6ef6c04f tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:13.062335 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-130611c2-586c-400c-a0c3-bc3b49126ea9 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Flavor limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 21:05:13.062914 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-130611c2-586c-400c-a0c3-bc3b49126ea9 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Image limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 21:05:13.063986 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-130611c2-586c-400c-a0c3-bc3b49126ea9 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Flavor pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 21:05:13.064415 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-130611c2-586c-400c-a0c3-bc3b49126ea9 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Image pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 21:05:13.064842 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-130611c2-586c-400c-a0c3-bc3b49126ea9 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 21:05:13.075699 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9ddf765e-b464-4393-b8d7-b0cb6ef6c04f tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:13.076265 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9ddf765e-b464-4393-b8d7-b0cb6ef6c04f tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:13.076733 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9ddf765e-b464-4393-b8d7-b0cb6ef6c04f tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:13.084947 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-130611c2-586c-400c-a0c3-bc3b49126ea9 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:13.085505 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-130611c2-586c-400c-a0c3-bc3b49126ea9 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:13.089362 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-130611c2-586c-400c-a0c3-bc3b49126ea9 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:13.096478 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-130611c2-586c-400c-a0c3-bc3b49126ea9 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:13.097010 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-130611c2-586c-400c-a0c3-bc3b49126ea9 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:13.097555 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-130611c2-586c-400c-a0c3-bc3b49126ea9 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:13.168497 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-130611c2-586c-400c-a0c3-bc3b49126ea9 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Getting quotas for project c405aac48e9b403ca8d1e3ac28fab76e. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:05:13.186911 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-130611c2-586c-400c-a0c3-bc3b49126ea9 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Getting quotas for user 0c6153d58d264272a375b3169e0874d3 and project c405aac48e9b403ca8d1e3ac28fab76e. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:05:13.233279 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-130611c2-586c-400c-a0c3-bc3b49126ea9 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Going to run 1 instances... {{(pid=140491) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 21:05:13.240557 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-130611c2-586c-400c-a0c3-bc3b49126ea9 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] [instance: 58ad88cd-b5d3-4aac-ae20-857736605fa0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c508bd7f-7db9-4b2c-af7c-be54a855c355',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140491) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 21:05:13.378062 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-130611c2-586c-400c-a0c3-bc3b49126ea9 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.116660 Oct 08 21:05:13.378716 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1593/3262] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 21:05:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1118 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 08 21:05:13.394478 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-dd32d367-0f5e-46c1-9769-9160e24d54ed tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:05:13.406510 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-dd32d367-0f5e-46c1-9769-9160e24d54ed tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3245fc05926b49118c0d1028de3f09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527bbe10db744ab4bcc8078f2d754d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:13.410347 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-dd32d367-0f5e-46c1-9769-9160e24d54ed tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Searching by: {'deleted': False, 'project_id': '527bbe10db744ab4bcc8078f2d754d53'} {{(pid=140491) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 08 21:05:13.428998 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dd32d367-0f5e-46c1-9769-9160e24d54ed tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:13.429603 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dd32d367-0f5e-46c1-9769-9160e24d54ed tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:13.430117 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dd32d367-0f5e-46c1-9769-9160e24d54ed tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:13.430982 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dd32d367-0f5e-46c1-9769-9160e24d54ed tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:13.431505 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dd32d367-0f5e-46c1-9769-9160e24d54ed tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:13.432824 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dd32d367-0f5e-46c1-9769-9160e24d54ed tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:13.617325 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.multi_cell_list [None req-dd32d367-0f5e-46c1-9769-9160e24d54ed tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=140491) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 08 21:05:13.679187 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=2 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:05:13.726744 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-dd32d367-0f5e-46c1-9769-9160e24d54ed tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3245fc05926b49118c0d1028de3f09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527bbe10db744ab4bcc8078f2d754d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:13.734208 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dd32d367-0f5e-46c1-9769-9160e24d54ed tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:13.734951 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dd32d367-0f5e-46c1-9769-9160e24d54ed tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:13.735941 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dd32d367-0f5e-46c1-9769-9160e24d54ed tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:13.750532 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-dd32d367-0f5e-46c1-9769-9160e24d54ed tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3245fc05926b49118c0d1028de3f09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527bbe10db744ab4bcc8078f2d754d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:13.753473 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-dd32d367-0f5e-46c1-9769-9160e24d54ed tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3245fc05926b49118c0d1028de3f09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527bbe10db744ab4bcc8078f2d754d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:13.874610 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-dd32d367-0f5e-46c1-9769-9160e24d54ed tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] 10.222.0.26 "GET /compute/v2.1/servers/detail" status: 200 len: 2705 microversion: 2.47 time: 0.488409 Oct 08 21:05:13.875216 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1594/3263] 10.222.0.26 () {60 vars in 1187 bytes} [Sat Oct 8 21:05:13 2022] GET /compute/v2.1/servers/detail => generated 2705 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:05:13.880587 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-0a05ceea-1da4-42d6-86a0-cd317efa97f4 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:05:13.881525 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-0a05ceea-1da4-42d6-86a0-cd317efa97f4 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: 38b000d3-167b-4f7a-ab80-cd51fcb7cbaf] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:05:13.893666 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0a05ceea-1da4-42d6-86a0-cd317efa97f4 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:13.897788 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0a05ceea-1da4-42d6-86a0-cd317efa97f4 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:13.899971 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0a05ceea-1da4-42d6-86a0-cd317efa97f4 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:13.902250 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0a05ceea-1da4-42d6-86a0-cd317efa97f4 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:13.903110 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0a05ceea-1da4-42d6-86a0-cd317efa97f4 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:13.905680 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0a05ceea-1da4-42d6-86a0-cd317efa97f4 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:14.007217 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0a05ceea-1da4-42d6-86a0-cd317efa97f4 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:14.013251 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0a05ceea-1da4-42d6-86a0-cd317efa97f4 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:14.013902 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0a05ceea-1da4-42d6-86a0-cd317efa97f4 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:14.014391 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.objects.instance [None req-0a05ceea-1da4-42d6-86a0-cd317efa97f4 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lazy-loading 'fault' on Instance uuid 38b000d3-167b-4f7a-ab80-cd51fcb7cbaf {{(pid=140491) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 21:05:14.045000 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-9ddf765e-b464-4393-b8d7-b0cb6ef6c04f tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5000948fa98a4b5d96ad27436d3d0edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917519b500674698a68dc01a4e8d68a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:14.061041 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-9ddf765e-b464-4393-b8d7-b0cb6ef6c04f tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] 10.222.0.26 "GET /compute/v2.1/servers/5848e7ba-40bb-4c4d-a2d0-f4dce5bb2842" status: 200 len: 1509 microversion: 2.1 time: 1.034904 Oct 08 21:05:14.062497 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1670/3264] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:05:13 2022] GET /compute/v2.1/servers/5848e7ba-40bb-4c4d-a2d0-f4dce5bb2842 => generated 1509 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:05:14.077827 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-2a62a7d0-27da-4356-bd65-f333c16c2c2e tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:05:14.078686 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-2a62a7d0-27da-4356-bd65-f333c16c2c2e tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] [instance: 58ad88cd-b5d3-4aac-ae20-857736605fa0] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:05:14.109525 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-0a05ceea-1da4-42d6-86a0-cd317efa97f4 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:14.124228 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-0a05ceea-1da4-42d6-86a0-cd317efa97f4 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/38b000d3-167b-4f7a-ab80-cd51fcb7cbaf" status: 200 len: 1302 microversion: 2.1 time: 0.246694 Oct 08 21:05:14.126883 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1595/3265] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:05:13 2022] GET /compute/v2.1/servers/38b000d3-167b-4f7a-ab80-cd51fcb7cbaf => generated 1302 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:05:14.140914 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-5e3a2166-b906-4d32-b13a-5fb420525341 req-295f943e-2f45-456c-9fee-64ac8fed80d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38b000d3-167b-4f7a-ab80-cd51fcb7cbaf", "name": "network-vif-deleted", "tag": "4e092828-fb69-410c-aa0c-7cbcee8350f3"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:05:14.155982 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:05:14.158548 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-5e3a2166-b906-4d32-b13a-5fb420525341 req-295f943e-2f45-456c-9fee-64ac8fed80d0 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:14.159130 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-5e3a2166-b906-4d32-b13a-5fb420525341 req-295f943e-2f45-456c-9fee-64ac8fed80d0 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:14.159622 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-5e3a2166-b906-4d32-b13a-5fb420525341 req-295f943e-2f45-456c-9fee-64ac8fed80d0 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:14.197096 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-5e3a2166-b906-4d32-b13a-5fb420525341 req-295f943e-2f45-456c-9fee-64ac8fed80d0 service nova] Creating event network-vif-deleted:4e092828-fb69-410c-aa0c-7cbcee8350f3 for instance 38b000d3-167b-4f7a-ab80-cd51fcb7cbaf on nch2-master-1 Oct 08 21:05:14.211943 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-5e3a2166-b906-4d32-b13a-5fb420525341 req-295f943e-2f45-456c-9fee-64ac8fed80d0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078786 Oct 08 21:05:14.213853 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1596/3266] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:05:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:05:14.222352 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-47279408-3b36-4851-8c2d-a45e86040702 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:05:14.223325 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-47279408-3b36-4851-8c2d-a45e86040702 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] [instance: 93b29a96-2b64-46bd-b6ab-fd44e6599d8f] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:05:14.235723 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-47279408-3b36-4851-8c2d-a45e86040702 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:14.236590 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-47279408-3b36-4851-8c2d-a45e86040702 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:14.237505 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-47279408-3b36-4851-8c2d-a45e86040702 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:14.238915 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-47279408-3b36-4851-8c2d-a45e86040702 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:14.240279 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-47279408-3b36-4851-8c2d-a45e86040702 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:14.241595 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-47279408-3b36-4851-8c2d-a45e86040702 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:14.252171 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-2a62a7d0-27da-4356-bd65-f333c16c2c2e tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c6153d58d264272a375b3169e0874d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c405aac48e9b403ca8d1e3ac28fab76e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:14.262399 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-2a62a7d0-27da-4356-bd65-f333c16c2c2e tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] 10.222.0.26 "GET /compute/v2.1/servers/58ad88cd-b5d3-4aac-ae20-857736605fa0" status: 200 len: 1223 microversion: 2.1 time: 0.197914 Oct 08 21:05:14.265765 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1671/3267] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:05:14 2022] GET /compute/v2.1/servers/58ad88cd-b5d3-4aac-ae20-857736605fa0 => generated 1223 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:05:14.283027 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-47279408-3b36-4851-8c2d-a45e86040702 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] [instance: 93b29a96-2b64-46bd-b6ab-fd44e6599d8f] Going to try to terminate instance {{(pid=140491) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 21:05:14.307420 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-b9172691-8ee7-4fb0-8e8d-e6dbbeca751a req-9481a065-c20c-46fb-93c7-a2522086288a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dbacaeed-a40b-4e05-9635-5073dfdd8621", "tag": "6fe657e1-039e-4549-b2d4-955cfbaed37d"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:05:14.351496 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-b9172691-8ee7-4fb0-8e8d-e6dbbeca751a req-9481a065-c20c-46fb-93c7-a2522086288a service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:14.354760 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-b9172691-8ee7-4fb0-8e8d-e6dbbeca751a req-9481a065-c20c-46fb-93c7-a2522086288a service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:14.355495 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-b9172691-8ee7-4fb0-8e8d-e6dbbeca751a req-9481a065-c20c-46fb-93c7-a2522086288a service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:14.371029 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-b9172691-8ee7-4fb0-8e8d-e6dbbeca751a req-9481a065-c20c-46fb-93c7-a2522086288a service nova] Creating event network-changed:6fe657e1-039e-4549-b2d4-955cfbaed37d for instance dbacaeed-a40b-4e05-9635-5073dfdd8621 on nch2-master-1 Oct 08 21:05:14.378353 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-b9172691-8ee7-4fb0-8e8d-e6dbbeca751a req-9481a065-c20c-46fb-93c7-a2522086288a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080391 Oct 08 21:05:14.379755 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1672/3268] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:05:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:05:14.386073 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-d701c41a-eb21-42ee-a8ad-a0c2695a5c94 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:05:14.387091 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-d701c41a-eb21-42ee-a8ad-a0c2695a5c94 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] [instance: dbacaeed-a40b-4e05-9635-5073dfdd8621] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:05:14.397833 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d701c41a-eb21-42ee-a8ad-a0c2695a5c94 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:14.399534 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d701c41a-eb21-42ee-a8ad-a0c2695a5c94 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:14.400218 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d701c41a-eb21-42ee-a8ad-a0c2695a5c94 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:14.401210 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d701c41a-eb21-42ee-a8ad-a0c2695a5c94 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:14.401901 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d701c41a-eb21-42ee-a8ad-a0c2695a5c94 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:14.403648 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d701c41a-eb21-42ee-a8ad-a0c2695a5c94 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:14.434824 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-47279408-3b36-4851-8c2d-a45e86040702 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] 10.222.0.26 "DELETE /compute/v2.1/servers/93b29a96-2b64-46bd-b6ab-fd44e6599d8f" status: 204 len: 0 microversion: 2.47 time: 0.218310 Oct 08 21:05:14.439419 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1597/3269] 10.222.0.26 () {60 vars in 1280 bytes} [Sat Oct 8 21:05:14 2022] DELETE /compute/v2.1/servers/93b29a96-2b64-46bd-b6ab-fd44e6599d8f => generated 0 bytes in 225 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 08 21:05:14.446584 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-ad26dd31-4a62-4425-b446-133f1d789238 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:05:14.447372 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-ad26dd31-4a62-4425-b446-133f1d789238 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] [instance: 5848e7ba-40bb-4c4d-a2d0-f4dce5bb2842] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:05:14.457293 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ad26dd31-4a62-4425-b446-133f1d789238 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:14.458086 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ad26dd31-4a62-4425-b446-133f1d789238 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:14.459790 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ad26dd31-4a62-4425-b446-133f1d789238 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:14.460778 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ad26dd31-4a62-4425-b446-133f1d789238 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:14.461330 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ad26dd31-4a62-4425-b446-133f1d789238 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:14.461905 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ad26dd31-4a62-4425-b446-133f1d789238 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:14.510102 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-ad26dd31-4a62-4425-b446-133f1d789238 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] [instance: 5848e7ba-40bb-4c4d-a2d0-f4dce5bb2842] Going to try to terminate instance {{(pid=140491) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 21:05:14.667713 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-ad26dd31-4a62-4425-b446-133f1d789238 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] 10.222.0.26 "DELETE /compute/v2.1/servers/5848e7ba-40bb-4c4d-a2d0-f4dce5bb2842" status: 204 len: 0 microversion: 2.1 time: 0.226619 Oct 08 21:05:14.673084 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1598/3270] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:05:14 2022] DELETE /compute/v2.1/servers/5848e7ba-40bb-4c4d-a2d0-f4dce5bb2842 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 21:05:14.690303 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-2499767c-71d3-4be1-84ca-f56a7a0e7dcc tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:05:14.695278 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-2499767c-71d3-4be1-84ca-f56a7a0e7dcc tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] [instance: 93b29a96-2b64-46bd-b6ab-fd44e6599d8f] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:05:14.718269 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2499767c-71d3-4be1-84ca-f56a7a0e7dcc tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:14.722071 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2499767c-71d3-4be1-84ca-f56a7a0e7dcc tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:14.726352 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2499767c-71d3-4be1-84ca-f56a7a0e7dcc tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:14.729563 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2499767c-71d3-4be1-84ca-f56a7a0e7dcc tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:14.730418 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2499767c-71d3-4be1-84ca-f56a7a0e7dcc tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:14.730961 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2499767c-71d3-4be1-84ca-f56a7a0e7dcc tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:14.750476 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-d701c41a-eb21-42ee-a8ad-a0c2695a5c94 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:14.764883 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-d701c41a-eb21-42ee-a8ad-a0c2695a5c94 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:14.768720 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-d701c41a-eb21-42ee-a8ad-a0c2695a5c94 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:14.769961 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-d701c41a-eb21-42ee-a8ad-a0c2695a5c94 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] 10.222.0.26 "GET /compute/v2.1/servers/dbacaeed-a40b-4e05-9635-5073dfdd8621" status: 200 len: 1406 microversion: 2.20 time: 0.388896 Oct 08 21:05:14.774866 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1673/3271] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:05:14 2022] GET /compute/v2.1/servers/dbacaeed-a40b-4e05-9635-5073dfdd8621 => generated 1406 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:05:14.780917 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-ccbe0c2a-2a22-42dd-9e91-f22c70e02e35 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:05:14.781432 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-ccbe0c2a-2a22-42dd-9e91-f22c70e02e35 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] [instance: 930c77ec-9649-47fe-bdee-e215c32e28b4] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:05:14.801157 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ccbe0c2a-2a22-42dd-9e91-f22c70e02e35 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:14.807855 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ccbe0c2a-2a22-42dd-9e91-f22c70e02e35 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:14.808568 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ccbe0c2a-2a22-42dd-9e91-f22c70e02e35 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:14.809762 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ccbe0c2a-2a22-42dd-9e91-f22c70e02e35 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:14.810550 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ccbe0c2a-2a22-42dd-9e91-f22c70e02e35 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:14.811170 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ccbe0c2a-2a22-42dd-9e91-f22c70e02e35 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:14.876405 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-ccbe0c2a-2a22-42dd-9e91-f22c70e02e35 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] [instance: 930c77ec-9649-47fe-bdee-e215c32e28b4] Going to try to terminate instance {{(pid=140492) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 21:05:15.026719 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-ccbe0c2a-2a22-42dd-9e91-f22c70e02e35 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] 10.222.0.26 "DELETE /compute/v2.1/servers/930c77ec-9649-47fe-bdee-e215c32e28b4" status: 204 len: 0 microversion: 2.1 time: 0.250304 Oct 08 21:05:15.029215 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1674/3272] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:05:14 2022] DELETE /compute/v2.1/servers/930c77ec-9649-47fe-bdee-e215c32e28b4 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 21:05:15.042848 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-2499767c-71d3-4be1-84ca-f56a7a0e7dcc tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3245fc05926b49118c0d1028de3f09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527bbe10db744ab4bcc8078f2d754d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:15.077730 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-2499767c-71d3-4be1-84ca-f56a7a0e7dcc tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3245fc05926b49118c0d1028de3f09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527bbe10db744ab4bcc8078f2d754d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:15.083606 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-2499767c-71d3-4be1-84ca-f56a7a0e7dcc tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3245fc05926b49118c0d1028de3f09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527bbe10db744ab4bcc8078f2d754d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:15.093984 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-2499767c-71d3-4be1-84ca-f56a7a0e7dcc tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] 10.222.0.26 "GET /compute/v2.1/servers/93b29a96-2b64-46bd-b6ab-fd44e6599d8f" status: 200 len: 1362 microversion: 2.47 time: 0.414180 Oct 08 21:05:15.096648 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1599/3273] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:05:14 2022] GET /compute/v2.1/servers/93b29a96-2b64-46bd-b6ab-fd44e6599d8f => generated 1362 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:05:15.148532 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-b23be430-225e-4cc4-a373-12b5e49c94a4 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:05:15.149353 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-b23be430-225e-4cc4-a373-12b5e49c94a4 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: 38b000d3-167b-4f7a-ab80-cd51fcb7cbaf] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:05:15.164530 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b23be430-225e-4cc4-a373-12b5e49c94a4 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:15.165966 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b23be430-225e-4cc4-a373-12b5e49c94a4 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:15.167786 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b23be430-225e-4cc4-a373-12b5e49c94a4 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:15.173924 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b23be430-225e-4cc4-a373-12b5e49c94a4 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:15.174599 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b23be430-225e-4cc4-a373-12b5e49c94a4 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:15.175581 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b23be430-225e-4cc4-a373-12b5e49c94a4 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:15.218195 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-b23be430-225e-4cc4-a373-12b5e49c94a4 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] HTTP exception thrown: Instance 38b000d3-167b-4f7a-ab80-cd51fcb7cbaf could not be found. Oct 08 21:05:15.224172 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-b23be430-225e-4cc4-a373-12b5e49c94a4 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Request method failure captured: Oct 08 21:05:15.224172 ncdv-master-1 devstack@n-api.service[140491]: request: GET /compute/v2.1/servers/38b000d3-167b-4f7a-ab80-cd51fcb7cbaf HTTP/1.1 Oct 08 21:05:15.224172 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:05:15.224172 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:05:15.224172 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:05:15.224172 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 21:05:15.224172 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:05:15.224172 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:05:15.224172 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:05:15.224172 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:05:15.224172 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeSpH4XDiYW19iQbBiok8uGM0c09fRqx5RRIizvfuTfqVgRGIpA6bFXwFHQqBS5yIR3OkB2E0bcw2nYeKqHv0LMQ6Oyj572d2Mx3XOjvMpnN8CYfHcY_H_6fonfL0ijUqcg70H8pyQhVd4bZHdhW8zWnUCcY8Nk9k_rfX1dbnTaTfN8 Oct 08 21:05:15.224172 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:05:15.224172 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:05:15.224172 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:05:15.224172 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:05:15.224172 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:05:15.224172 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:05:15.224172 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 0ffdae031c4f47d599acb30f1d3c87b9 Oct 08 21:05:15.224172 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-MigrationsAdminTest-1214086769 Oct 08 21:05:15.224172 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:05:15.224172 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:05:15.224172 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0ffdae031c4f47d599acb30f1d3c87b9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0ffdae031c4f47d599acb30f1d3c87b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0ffdae031c4f47d599acb30f1d3c87b9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0ffdae031c4f47d599acb30f1d3c87b9"}]}] Oct 08 21:05:15.224172 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-MigrationsAdminTest-1214086769 Oct 08 21:05:15.224172 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 0ffdae031c4f47d599acb30f1d3c87b9 Oct 08 21:05:15.224172 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-MigrationsAdminTest-1214086769 Oct 08 21:05:15.224172 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-MigrationsAdminTest-1214086769-project Oct 08 21:05:15.224172 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:05:15.224172 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:05:15.224172 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 5266cd6be4514b3eac30a195f6b25772 Oct 08 21:05:15.224172 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-MigrationsAdminTest-1214086769-project Oct 08 21:05:15.224172 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:05:15.224172 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance 38b000d3-167b-4f7a-ab80-cd51fcb7cbaf could not be found. Oct 08 21:05:15.224172 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': '38b000d3-167b-4f7a-ab80-cd51fcb7cbaf'} Oct 08 21:05:15.224172 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:05:15.224172 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:05:15.224172 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:05:15.224172 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:05:15.224172 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:05:15.224172 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:05:15.224172 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:05:15.224172 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:05:15.224172 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:05:15.224172 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:05:15.224172 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38b000d3-167b-4f7a-ab80-cd51fcb7cbaf could not be found. Oct 08 21:05:15.224172 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:05:15.224172 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:05:15.224172 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:05:15.224172 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:05:15.224172 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:05:15.224172 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:05:15.224172 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:05:15.224172 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:05:15.224172 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:05:15.224172 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:05:15.224172 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:05:15.224172 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:05:15.224172 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:05:15.224172 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:05:15.224172 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:05:15.224172 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:05:15.224172 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38b000d3-167b-4f7a-ab80-cd51fcb7cbaf could not be found. Oct 08 21:05:15.224172 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:05:15.224172 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:05:15.224172 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:05:15.229293 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:05:15.229293 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:05:15.229293 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:05:15.229293 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:05:15.229293 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:05:15.229293 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38b000d3-167b-4f7a-ab80-cd51fcb7cbaf could not be found. Oct 08 21:05:15.229293 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:05:15.230741 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-b23be430-225e-4cc4-a373-12b5e49c94a4 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Returning 404 to user: Instance 38b000d3-167b-4f7a-ab80-cd51fcb7cbaf could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:05:15.234424 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-b23be430-225e-4cc4-a373-12b5e49c94a4 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/38b000d3-167b-4f7a-ab80-cd51fcb7cbaf" status: 404 len: 111 microversion: 2.1 time: 0.089527 Oct 08 21:05:15.236829 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1600/3274] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:05:15 2022] GET /compute/v2.1/servers/38b000d3-167b-4f7a-ab80-cd51fcb7cbaf => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 08 21:05:15.274619 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-8d28305e-b286-45e7-893d-962808919d2d tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:05:15.275136 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-8d28305e-b286-45e7-893d-962808919d2d tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:05:15.287777 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8d28305e-b286-45e7-893d-962808919d2d tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:15.288283 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8d28305e-b286-45e7-893d-962808919d2d tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:15.290209 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8d28305e-b286-45e7-893d-962808919d2d tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:15.292698 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8d28305e-b286-45e7-893d-962808919d2d tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:15.293385 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8d28305e-b286-45e7-893d-962808919d2d tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:15.293983 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8d28305e-b286-45e7-893d-962808919d2d tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:15.316158 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-13587b46-256e-4cae-9737-bc7ab07204ca tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Action: 'create', calling method: .version_select at 0x7f1a8ca764c0>, body: {"keypair": {"name": "tempest-keypair-1643426037", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBZcaUQnBLXbkDcvAP8uuNqoJVKHJvSs62BkO6MtqNIPR7ESjI4ApWpOiK1j4AB1m80kFeBZPUW3CyOA3uMPoxJgZF7CoRe5Bp8VJH/y+GkyBE4YEldo52ogeqvYXf6Pqg=="}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:05:15.343536 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-8d28305e-b286-45e7-893d-962808919d2d tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd] Going to try to terminate instance {{(pid=140491) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 21:05:15.357576 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-13587b46-256e-4cae-9737-bc7ab07204ca tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Getting quotas for project c68b14967e8249fd886f168d366f241f. Resources: {'key_pairs'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:05:15.367834 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-13587b46-256e-4cae-9737-bc7ab07204ca tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Getting quotas for user 85abb492492343c58734564a2b26c8f6 and project c68b14967e8249fd886f168d366f241f. Resources: {'key_pairs'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:05:15.377290 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:05:15.436226 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-13587b46-256e-4cae-9737-bc7ab07204ca tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.391859 Oct 08 21:05:15.443952 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1675/3275] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Oct 8 21:05:15 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:05:15.451801 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-62a770d6-581a-4dc2-b652-db6b0500d26f tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-550716395", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "a0890bdd-866a-48dd-987c-791ef29d5b3c"}]}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:05:15.522471 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-8d28305e-b286-45e7-893d-962808919d2d tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "DELETE /compute/v2.1/servers/d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd" status: 204 len: 0 microversion: 2.1 time: 0.280916 Oct 08 21:05:15.524320 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1601/3276] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:05:15 2022] DELETE /compute/v2.1/servers/d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd => generated 0 bytes in 285 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 21:05:15.533736 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.network.neutron [None req-62a770d6-581a-4dc2-b652-db6b0500d26f tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] validate_networks() for [('a0890bdd-866a-48dd-987c-791ef29d5b3c', None, None, None, None, None)] {{(pid=140492) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 21:05:15.552211 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-63b06f03-ff99-46f5-a667-04e857a88e70 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:05:15.553069 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-63b06f03-ff99-46f5-a667-04e857a88e70 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] [instance: 58ad88cd-b5d3-4aac-ae20-857736605fa0] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:05:15.560220 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-63b06f03-ff99-46f5-a667-04e857a88e70 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:15.560720 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-63b06f03-ff99-46f5-a667-04e857a88e70 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:15.561161 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-63b06f03-ff99-46f5-a667-04e857a88e70 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:15.561903 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-63b06f03-ff99-46f5-a667-04e857a88e70 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:15.562361 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-63b06f03-ff99-46f5-a667-04e857a88e70 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:15.562787 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-63b06f03-ff99-46f5-a667-04e857a88e70 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:15.675435 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-63b06f03-ff99-46f5-a667-04e857a88e70 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c6153d58d264272a375b3169e0874d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c405aac48e9b403ca8d1e3ac28fab76e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:15.687104 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-63b06f03-ff99-46f5-a667-04e857a88e70 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] 10.222.0.26 "GET /compute/v2.1/servers/58ad88cd-b5d3-4aac-ae20-857736605fa0" status: 200 len: 1275 microversion: 2.1 time: 0.159900 Oct 08 21:05:15.705443 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1602/3277] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:05:15 2022] GET /compute/v2.1/servers/58ad88cd-b5d3-4aac-ae20-857736605fa0 => generated 1275 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:05:15.713136 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-e5321eaf-eeb5-44ec-afea-f4f4cafce024 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:05:15.714152 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-e5321eaf-eeb5-44ec-afea-f4f4cafce024 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:05:15.722013 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e5321eaf-eeb5-44ec-afea-f4f4cafce024 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:15.722515 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e5321eaf-eeb5-44ec-afea-f4f4cafce024 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:15.723192 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e5321eaf-eeb5-44ec-afea-f4f4cafce024 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:15.723728 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e5321eaf-eeb5-44ec-afea-f4f4cafce024 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:15.724342 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e5321eaf-eeb5-44ec-afea-f4f4cafce024 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:15.725294 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e5321eaf-eeb5-44ec-afea-f4f4cafce024 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:16.278363 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-e5321eaf-eeb5-44ec-afea-f4f4cafce024 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:16.293758 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-e5321eaf-eeb5-44ec-afea-f4f4cafce024 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd" status: 200 len: 1466 microversion: 2.1 time: 0.583804 Oct 08 21:05:16.297763 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1603/3278] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:05:15 2022] GET /compute/v2.1/servers/d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd => generated 1466 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:05:16.306859 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-22428a09-89f9-4a9f-b526-dd69b0a7c1d5 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:05:16.309282 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-22428a09-89f9-4a9f-b526-dd69b0a7c1d5 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] [instance: dbacaeed-a40b-4e05-9635-5073dfdd8621] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:05:16.312295 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-62a770d6-581a-4dc2-b652-db6b0500d26f tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Flavor limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 21:05:16.312740 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-62a770d6-581a-4dc2-b652-db6b0500d26f tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Image limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 21:05:16.314778 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-62a770d6-581a-4dc2-b652-db6b0500d26f tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Flavor pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 21:05:16.316630 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-62a770d6-581a-4dc2-b652-db6b0500d26f tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Image pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 21:05:16.318136 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-62a770d6-581a-4dc2-b652-db6b0500d26f tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 21:05:16.323935 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-22428a09-89f9-4a9f-b526-dd69b0a7c1d5 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:16.326455 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-22428a09-89f9-4a9f-b526-dd69b0a7c1d5 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:16.328346 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-22428a09-89f9-4a9f-b526-dd69b0a7c1d5 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:16.330545 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-22428a09-89f9-4a9f-b526-dd69b0a7c1d5 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:16.331714 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-22428a09-89f9-4a9f-b526-dd69b0a7c1d5 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:16.333732 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-22428a09-89f9-4a9f-b526-dd69b0a7c1d5 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:16.341163 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-62a770d6-581a-4dc2-b652-db6b0500d26f tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:16.341688 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-62a770d6-581a-4dc2-b652-db6b0500d26f tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:16.342139 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-62a770d6-581a-4dc2-b652-db6b0500d26f tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:16.353262 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-62a770d6-581a-4dc2-b652-db6b0500d26f tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:16.353768 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-62a770d6-581a-4dc2-b652-db6b0500d26f tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:16.354216 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-62a770d6-581a-4dc2-b652-db6b0500d26f tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:16.408477 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-62a770d6-581a-4dc2-b652-db6b0500d26f tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Getting quotas for project 917519b500674698a68dc01a4e8d68a8. Resources: {'cores', 'instances', 'ram'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:05:16.449740 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-62a770d6-581a-4dc2-b652-db6b0500d26f tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Getting quotas for user 5000948fa98a4b5d96ad27436d3d0edb and project 917519b500674698a68dc01a4e8d68a8. Resources: {'cores', 'instances', 'ram'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:05:16.505070 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-62a770d6-581a-4dc2-b652-db6b0500d26f tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Going to run 2 instances... {{(pid=140492) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 21:05:16.512225 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-62a770d6-581a-4dc2-b652-db6b0500d26f tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] [instance: 62ddef97-0025-4e6d-a62e-59a824562796] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c508bd7f-7db9-4b2c-af7c-be54a855c355',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140492) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 21:05:16.601118 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-62a770d6-581a-4dc2-b652-db6b0500d26f tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] [instance: 47d524a3-cb1f-4972-9ffb-a8225135461f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c508bd7f-7db9-4b2c-af7c-be54a855c355',instance=,instance_uuid=62ddef97-0025-4e6d-a62e-59a824562796,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140492) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 21:05:16.713808 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-62a770d6-581a-4dc2-b652-db6b0500d26f tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.268155 Oct 08 21:05:16.714701 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1676/3279] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 21:05:15 2022] POST /compute/v2.1/servers => generated 32 bytes in 1270 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 08 21:05:16.722904 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-10b91aa6-eccd-4c03-963b-af541139f08d tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:05:16.724842 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-10b91aa6-eccd-4c03-963b-af541139f08d tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] [instance: 93b29a96-2b64-46bd-b6ab-fd44e6599d8f] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:05:16.739174 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-10b91aa6-eccd-4c03-963b-af541139f08d tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:16.740154 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-10b91aa6-eccd-4c03-963b-af541139f08d tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:16.740826 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-10b91aa6-eccd-4c03-963b-af541139f08d tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:16.741995 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-10b91aa6-eccd-4c03-963b-af541139f08d tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:16.743152 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-10b91aa6-eccd-4c03-963b-af541139f08d tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:16.744015 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-10b91aa6-eccd-4c03-963b-af541139f08d tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:16.799097 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-22428a09-89f9-4a9f-b526-dd69b0a7c1d5 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:16.812044 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-22428a09-89f9-4a9f-b526-dd69b0a7c1d5 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:16.814456 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-22428a09-89f9-4a9f-b526-dd69b0a7c1d5 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:16.817490 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-22428a09-89f9-4a9f-b526-dd69b0a7c1d5 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] 10.222.0.26 "GET /compute/v2.1/servers/dbacaeed-a40b-4e05-9635-5073dfdd8621" status: 200 len: 1406 microversion: 2.20 time: 0.518082 Oct 08 21:05:16.834715 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1604/3280] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:05:16 2022] GET /compute/v2.1/servers/dbacaeed-a40b-4e05-9635-5073dfdd8621 => generated 1406 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:05:16.848011 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-0c1d5674-5727-483a-9d7a-e365d3848c74 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:05:16.848687 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-0c1d5674-5727-483a-9d7a-e365d3848c74 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] [instance: 58ad88cd-b5d3-4aac-ae20-857736605fa0] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:05:16.856272 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0c1d5674-5727-483a-9d7a-e365d3848c74 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:16.856822 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0c1d5674-5727-483a-9d7a-e365d3848c74 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:16.857302 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0c1d5674-5727-483a-9d7a-e365d3848c74 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:16.858020 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0c1d5674-5727-483a-9d7a-e365d3848c74 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:16.858480 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0c1d5674-5727-483a-9d7a-e365d3848c74 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:16.858906 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0c1d5674-5727-483a-9d7a-e365d3848c74 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:17.022228 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-10b91aa6-eccd-4c03-963b-af541139f08d tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3245fc05926b49118c0d1028de3f09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527bbe10db744ab4bcc8078f2d754d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:17.038658 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-10b91aa6-eccd-4c03-963b-af541139f08d tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3245fc05926b49118c0d1028de3f09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527bbe10db744ab4bcc8078f2d754d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:17.040134 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-10b91aa6-eccd-4c03-963b-af541139f08d tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3245fc05926b49118c0d1028de3f09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527bbe10db744ab4bcc8078f2d754d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:17.041379 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-10b91aa6-eccd-4c03-963b-af541139f08d tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] 10.222.0.26 "GET /compute/v2.1/servers/93b29a96-2b64-46bd-b6ab-fd44e6599d8f" status: 200 len: 1362 microversion: 2.47 time: 0.325328 Oct 08 21:05:17.041969 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1677/3281] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:05:16 2022] GET /compute/v2.1/servers/93b29a96-2b64-46bd-b6ab-fd44e6599d8f => generated 1362 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:05:17.073173 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-7bb60059-b304-4a98-80ee-3c2b20d281e6 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:05:17.075917 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-0c1d5674-5727-483a-9d7a-e365d3848c74 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c6153d58d264272a375b3169e0874d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c405aac48e9b403ca8d1e3ac28fab76e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:17.085895 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-7bb60059-b304-4a98-80ee-3c2b20d281e6 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5000948fa98a4b5d96ad27436d3d0edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917519b500674698a68dc01a4e8d68a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:17.086731 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-7bb60059-b304-4a98-80ee-3c2b20d281e6 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Searching by: {'deleted': False, 'project_id': '917519b500674698a68dc01a4e8d68a8'} {{(pid=140492) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 08 21:05:17.095321 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-0c1d5674-5727-483a-9d7a-e365d3848c74 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] 10.222.0.26 "GET /compute/v2.1/servers/58ad88cd-b5d3-4aac-ae20-857736605fa0" status: 200 len: 1283 microversion: 2.1 time: 0.255766 Oct 08 21:05:17.096901 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1605/3282] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:05:16 2022] GET /compute/v2.1/servers/58ad88cd-b5d3-4aac-ae20-857736605fa0 => generated 1283 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:05:17.128355 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7bb60059-b304-4a98-80ee-3c2b20d281e6 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:17.128871 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7bb60059-b304-4a98-80ee-3c2b20d281e6 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:17.130718 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7bb60059-b304-4a98-80ee-3c2b20d281e6 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:17.131510 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7bb60059-b304-4a98-80ee-3c2b20d281e6 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:17.131993 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7bb60059-b304-4a98-80ee-3c2b20d281e6 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:17.134736 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7bb60059-b304-4a98-80ee-3c2b20d281e6 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:17.199564 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.multi_cell_list [None req-7bb60059-b304-4a98-80ee-3c2b20d281e6 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Listed batch of 2 results from cell out of 998 limit. Returned 2 total so far. {{(pid=140492) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 08 21:05:17.255243 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-7bb60059-b304-4a98-80ee-3c2b20d281e6 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] 10.222.0.26 "GET /compute/v2.1/servers" status: 200 len: 1335 microversion: 2.1 time: 0.198552 Oct 08 21:05:17.255850 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1678/3283] 10.222.0.26 () {58 vars in 1125 bytes} [Sat Oct 8 21:05:17 2022] GET /compute/v2.1/servers => generated 1335 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:05:17.269236 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-f1b10ce0-ad76-4180-87d0-eb6eda48ab19 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:05:17.270141 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-f1b10ce0-ad76-4180-87d0-eb6eda48ab19 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] [instance: 47d524a3-cb1f-4972-9ffb-a8225135461f] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:05:17.321661 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-4de9f8d6-b4b5-4a97-8c28-15a8eaf9b73d tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:05:17.322479 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-4de9f8d6-b4b5-4a97-8c28-15a8eaf9b73d tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:05:17.334111 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4de9f8d6-b4b5-4a97-8c28-15a8eaf9b73d tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:17.335308 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4de9f8d6-b4b5-4a97-8c28-15a8eaf9b73d tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:17.336230 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4de9f8d6-b4b5-4a97-8c28-15a8eaf9b73d tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:17.337702 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4de9f8d6-b4b5-4a97-8c28-15a8eaf9b73d tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:17.338987 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4de9f8d6-b4b5-4a97-8c28-15a8eaf9b73d tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:17.339550 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4de9f8d6-b4b5-4a97-8c28-15a8eaf9b73d tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:17.550763 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-f1b10ce0-ad76-4180-87d0-eb6eda48ab19 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5000948fa98a4b5d96ad27436d3d0edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917519b500674698a68dc01a4e8d68a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:17.559033 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-f1b10ce0-ad76-4180-87d0-eb6eda48ab19 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] 10.222.0.26 "GET /compute/v2.1/servers/47d524a3-cb1f-4972-9ffb-a8225135461f" status: 200 len: 1217 microversion: 2.1 time: 0.293663 Oct 08 21:05:17.559634 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1606/3284] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:05:17 2022] GET /compute/v2.1/servers/47d524a3-cb1f-4972-9ffb-a8225135461f => generated 1217 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:05:17.850296 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-19522f52-2a8b-48da-a3f1-8daba514f611 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:05:17.851998 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-19522f52-2a8b-48da-a3f1-8daba514f611 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] [instance: dbacaeed-a40b-4e05-9635-5073dfdd8621] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:05:17.878305 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-19522f52-2a8b-48da-a3f1-8daba514f611 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:17.879225 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-19522f52-2a8b-48da-a3f1-8daba514f611 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:17.879794 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-19522f52-2a8b-48da-a3f1-8daba514f611 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:17.880660 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-19522f52-2a8b-48da-a3f1-8daba514f611 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:17.881471 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-19522f52-2a8b-48da-a3f1-8daba514f611 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:17.882023 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-19522f52-2a8b-48da-a3f1-8daba514f611 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:18.432369 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-19522f52-2a8b-48da-a3f1-8daba514f611 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:18.484548 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-19522f52-2a8b-48da-a3f1-8daba514f611 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:18.495481 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-19522f52-2a8b-48da-a3f1-8daba514f611 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:18.496878 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-19522f52-2a8b-48da-a3f1-8daba514f611 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] 10.222.0.26 "GET /compute/v2.1/servers/dbacaeed-a40b-4e05-9635-5073dfdd8621" status: 200 len: 1406 microversion: 2.20 time: 0.650851 Oct 08 21:05:18.528519 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1607/3285] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:05:17 2022] GET /compute/v2.1/servers/dbacaeed-a40b-4e05-9635-5073dfdd8621 => generated 1406 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:05:18.540550 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-5b7d6d95-0bea-4188-a72f-5c96da1e09f0 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:05:18.551340 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-5b7d6d95-0bea-4188-a72f-5c96da1e09f0 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] [instance: 93b29a96-2b64-46bd-b6ab-fd44e6599d8f] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:05:18.559329 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5b7d6d95-0bea-4188-a72f-5c96da1e09f0 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:18.559848 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5b7d6d95-0bea-4188-a72f-5c96da1e09f0 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:18.560305 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5b7d6d95-0bea-4188-a72f-5c96da1e09f0 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:18.561031 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5b7d6d95-0bea-4188-a72f-5c96da1e09f0 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:18.561588 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5b7d6d95-0bea-4188-a72f-5c96da1e09f0 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:18.562023 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5b7d6d95-0bea-4188-a72f-5c96da1e09f0 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:18.854968 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-4de9f8d6-b4b5-4a97-8c28-15a8eaf9b73d tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:18.864140 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-4de9f8d6-b4b5-4a97-8c28-15a8eaf9b73d tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd" status: 200 len: 1466 microversion: 2.1 time: 1.549480 Oct 08 21:05:18.873656 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1679/3286] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:05:17 2022] GET /compute/v2.1/servers/d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd => generated 1466 bytes in 1559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:05:18.880993 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-d3d8ef65-715a-4fa9-8ce9-79ca626dbd25 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:05:18.882020 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-d3d8ef65-715a-4fa9-8ce9-79ca626dbd25 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] [instance: 58ad88cd-b5d3-4aac-ae20-857736605fa0] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:05:18.901717 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d3d8ef65-715a-4fa9-8ce9-79ca626dbd25 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:18.902359 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d3d8ef65-715a-4fa9-8ce9-79ca626dbd25 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:18.902924 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d3d8ef65-715a-4fa9-8ce9-79ca626dbd25 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:18.903781 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d3d8ef65-715a-4fa9-8ce9-79ca626dbd25 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:18.904365 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d3d8ef65-715a-4fa9-8ce9-79ca626dbd25 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:18.904910 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d3d8ef65-715a-4fa9-8ce9-79ca626dbd25 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:19.062529 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-5b7d6d95-0bea-4188-a72f-5c96da1e09f0 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3245fc05926b49118c0d1028de3f09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527bbe10db744ab4bcc8078f2d754d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:19.086473 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-5b7d6d95-0bea-4188-a72f-5c96da1e09f0 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3245fc05926b49118c0d1028de3f09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527bbe10db744ab4bcc8078f2d754d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:19.092438 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-5b7d6d95-0bea-4188-a72f-5c96da1e09f0 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3245fc05926b49118c0d1028de3f09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527bbe10db744ab4bcc8078f2d754d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:19.103188 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-5b7d6d95-0bea-4188-a72f-5c96da1e09f0 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] 10.222.0.26 "GET /compute/v2.1/servers/93b29a96-2b64-46bd-b6ab-fd44e6599d8f" status: 200 len: 1362 microversion: 2.47 time: 0.568618 Oct 08 21:05:19.121650 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1608/3287] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:05:18 2022] GET /compute/v2.1/servers/93b29a96-2b64-46bd-b6ab-fd44e6599d8f => generated 1362 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:05:19.129599 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-dec2f38d-1c3d-4e9d-bae7-113d0374b044 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:05:19.130245 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-dec2f38d-1c3d-4e9d-bae7-113d0374b044 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] [instance: 47d524a3-cb1f-4972-9ffb-a8225135461f] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:05:19.145801 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dec2f38d-1c3d-4e9d-bae7-113d0374b044 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:19.146576 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dec2f38d-1c3d-4e9d-bae7-113d0374b044 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:19.147233 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dec2f38d-1c3d-4e9d-bae7-113d0374b044 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:19.148158 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dec2f38d-1c3d-4e9d-bae7-113d0374b044 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:19.148796 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dec2f38d-1c3d-4e9d-bae7-113d0374b044 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:19.149465 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dec2f38d-1c3d-4e9d-bae7-113d0374b044 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:19.363965 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-d3d8ef65-715a-4fa9-8ce9-79ca626dbd25 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c6153d58d264272a375b3169e0874d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c405aac48e9b403ca8d1e3ac28fab76e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:19.388931 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-d3d8ef65-715a-4fa9-8ce9-79ca626dbd25 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] 10.222.0.26 "GET /compute/v2.1/servers/58ad88cd-b5d3-4aac-ae20-857736605fa0" status: 200 len: 1281 microversion: 2.1 time: 0.513690 Oct 08 21:05:19.394369 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1680/3288] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:05:18 2022] GET /compute/v2.1/servers/58ad88cd-b5d3-4aac-ae20-857736605fa0 => generated 1281 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:05:19.400662 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-415b5b30-6c08-4e15-9d31-e85dda4f7087 req-491923ff-4416-43be-b8e3-1a7f8982e3a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5848e7ba-40bb-4c4d-a2d0-f4dce5bb2842", "name": "network-vif-deleted", "tag": "a4e3d4d3-79ff-4d23-9f0a-7308ad60535a"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:05:19.446408 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-415b5b30-6c08-4e15-9d31-e85dda4f7087 req-491923ff-4416-43be-b8e3-1a7f8982e3a1 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:19.451253 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-415b5b30-6c08-4e15-9d31-e85dda4f7087 req-491923ff-4416-43be-b8e3-1a7f8982e3a1 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:19.452222 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-415b5b30-6c08-4e15-9d31-e85dda4f7087 req-491923ff-4416-43be-b8e3-1a7f8982e3a1 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:19.488973 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-415b5b30-6c08-4e15-9d31-e85dda4f7087 req-491923ff-4416-43be-b8e3-1a7f8982e3a1 service nova] Creating event network-vif-deleted:a4e3d4d3-79ff-4d23-9f0a-7308ad60535a for instance 5848e7ba-40bb-4c4d-a2d0-f4dce5bb2842 on nch2-master-1 Oct 08 21:05:19.507772 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-415b5b30-6c08-4e15-9d31-e85dda4f7087 req-491923ff-4416-43be-b8e3-1a7f8982e3a1 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110909 Oct 08 21:05:19.508402 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1681/3289] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:05:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:05:19.538860 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-cacf0251-59bb-4b32-8da2-4e0d97a3d60f tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:05:19.539685 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-cacf0251-59bb-4b32-8da2-4e0d97a3d60f tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] [instance: dbacaeed-a40b-4e05-9635-5073dfdd8621] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:05:19.569812 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cacf0251-59bb-4b32-8da2-4e0d97a3d60f tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:19.573134 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cacf0251-59bb-4b32-8da2-4e0d97a3d60f tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:19.573973 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cacf0251-59bb-4b32-8da2-4e0d97a3d60f tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:19.574951 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cacf0251-59bb-4b32-8da2-4e0d97a3d60f tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:19.575619 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cacf0251-59bb-4b32-8da2-4e0d97a3d60f tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:19.577059 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cacf0251-59bb-4b32-8da2-4e0d97a3d60f tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:19.745902 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-dec2f38d-1c3d-4e9d-bae7-113d0374b044 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5000948fa98a4b5d96ad27436d3d0edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917519b500674698a68dc01a4e8d68a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:19.764412 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-dec2f38d-1c3d-4e9d-bae7-113d0374b044 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] 10.222.0.26 "GET /compute/v2.1/servers/47d524a3-cb1f-4972-9ffb-a8225135461f" status: 200 len: 1213 microversion: 2.1 time: 0.641130 Oct 08 21:05:19.765257 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1609/3290] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:05:19 2022] GET /compute/v2.1/servers/47d524a3-cb1f-4972-9ffb-a8225135461f => generated 1213 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:05:19.892215 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-63eed7ab-17f7-4dfa-bbc4-d4ccd50a58ff tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:05:19.893513 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-63eed7ab-17f7-4dfa-bbc4-d4ccd50a58ff tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:05:19.916600 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-63eed7ab-17f7-4dfa-bbc4-d4ccd50a58ff tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:19.918221 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-63eed7ab-17f7-4dfa-bbc4-d4ccd50a58ff tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:19.918939 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-63eed7ab-17f7-4dfa-bbc4-d4ccd50a58ff tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:19.920258 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-63eed7ab-17f7-4dfa-bbc4-d4ccd50a58ff tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:19.921048 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-63eed7ab-17f7-4dfa-bbc4-d4ccd50a58ff tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:19.924066 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-63eed7ab-17f7-4dfa-bbc4-d4ccd50a58ff tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:20.945689 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-cacf0251-59bb-4b32-8da2-4e0d97a3d60f tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:20.995132 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-cacf0251-59bb-4b32-8da2-4e0d97a3d60f tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:21.002285 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-cacf0251-59bb-4b32-8da2-4e0d97a3d60f tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:21.006000 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-cacf0251-59bb-4b32-8da2-4e0d97a3d60f tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] 10.222.0.26 "GET /compute/v2.1/servers/dbacaeed-a40b-4e05-9635-5073dfdd8621" status: 200 len: 1406 microversion: 2.20 time: 1.473496 Oct 08 21:05:21.008396 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1682/3291] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:05:19 2022] GET /compute/v2.1/servers/dbacaeed-a40b-4e05-9635-5073dfdd8621 => generated 1406 bytes in 1478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:05:21.021975 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-404edf0b-09ab-4e37-910c-b9825a691161 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:05:21.023716 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-404edf0b-09ab-4e37-910c-b9825a691161 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] [instance: 93b29a96-2b64-46bd-b6ab-fd44e6599d8f] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:05:21.041739 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-404edf0b-09ab-4e37-910c-b9825a691161 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:21.042613 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-404edf0b-09ab-4e37-910c-b9825a691161 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:21.043475 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-404edf0b-09ab-4e37-910c-b9825a691161 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:21.044476 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-404edf0b-09ab-4e37-910c-b9825a691161 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:21.045540 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-404edf0b-09ab-4e37-910c-b9825a691161 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:21.046933 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-404edf0b-09ab-4e37-910c-b9825a691161 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:21.069971 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-404edf0b-09ab-4e37-910c-b9825a691161 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] HTTP exception thrown: Instance 93b29a96-2b64-46bd-b6ab-fd44e6599d8f could not be found. Oct 08 21:05:21.073553 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-404edf0b-09ab-4e37-910c-b9825a691161 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Request method failure captured: Oct 08 21:05:21.073553 ncdv-master-1 devstack@n-api.service[140492]: request: GET /compute/v2.1/servers/93b29a96-2b64-46bd-b6ab-fd44e6599d8f HTTP/1.1 Oct 08 21:05:21.073553 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:05:21.073553 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:05:21.073553 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:05:21.073553 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 21:05:21.073553 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:05:21.073553 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:05:21.073553 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:05:21.073553 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:05:21.073553 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeXay4Qf9odEg5sQ4UfbmfLrqkO8S5BHQBUPO3vn7IP4Y1nyXBa0q6fIMN9J0LMTohQNditg6Ii1Fx-A_WhOpC678XZDgc1UGndAneuOCwSjkrBXed--Pvg6w8M6fV0C8wu-DcMBATvv4HXhiXVlIEfvKUSJp5-CX-TQg8hcI3ljTl4 Oct 08 21:05:21.073553 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:05:21.073553 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:05:21.073553 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:05:21.073553 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:05:21.073553 ncdv-master-1 devstack@n-api.service[140492]: X-Openstack-Nova-Api-Version: 2.47 Oct 08 21:05:21.073553 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:05:21.073553 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:05:21.073553 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 527bbe10db744ab4bcc8078f2d754d53 Oct 08 21:05:21.073553 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-ServerShowV247Test-1720874898 Oct 08 21:05:21.073553 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:05:21.073553 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:05:21.073553 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/527bbe10db744ab4bcc8078f2d754d53"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/527bbe10db744ab4bcc8078f2d754d53"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_527bbe10db744ab4bcc8078f2d754d53"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/527bbe10db744ab4bcc8078f2d754d53"}]}] Oct 08 21:05:21.073553 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-ServerShowV247Test-1720874898 Oct 08 21:05:21.073553 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 527bbe10db744ab4bcc8078f2d754d53 Oct 08 21:05:21.073553 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-ServerShowV247Test-1720874898 Oct 08 21:05:21.073553 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-ServerShowV247Test-1720874898-project Oct 08 21:05:21.073553 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:05:21.073553 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:05:21.073553 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 3245fc05926b49118c0d1028de3f09a4 Oct 08 21:05:21.073553 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-ServerShowV247Test-1720874898-project Oct 08 21:05:21.073553 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 21:05:21.073553 ncdv-master-1 devstack@n-api.service[140492]: exception: Instance 93b29a96-2b64-46bd-b6ab-fd44e6599d8f could not be found. Oct 08 21:05:21.073553 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': '93b29a96-2b64-46bd-b6ab-fd44e6599d8f'} Oct 08 21:05:21.073553 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:05:21.073553 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:05:21.073553 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:05:21.073553 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:05:21.073553 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:05:21.073553 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:05:21.073553 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:05:21.073553 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:05:21.073553 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:05:21.073553 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:05:21.073553 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93b29a96-2b64-46bd-b6ab-fd44e6599d8f could not be found. Oct 08 21:05:21.073553 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:05:21.073553 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:05:21.073553 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:05:21.073553 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:05:21.073553 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:05:21.073553 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:05:21.073553 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:05:21.073553 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:05:21.073553 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:05:21.073553 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:05:21.073553 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:05:21.073553 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:05:21.073553 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:05:21.073553 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:05:21.073553 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:05:21.073553 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:05:21.073553 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93b29a96-2b64-46bd-b6ab-fd44e6599d8f could not be found. Oct 08 21:05:21.073553 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:05:21.073553 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:05:21.073553 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:05:21.077952 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:05:21.077952 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:05:21.077952 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:05:21.077952 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:05:21.077952 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:05:21.077952 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93b29a96-2b64-46bd-b6ab-fd44e6599d8f could not be found. Oct 08 21:05:21.077952 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:05:21.081797 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-404edf0b-09ab-4e37-910c-b9825a691161 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Returning 404 to user: Instance 93b29a96-2b64-46bd-b6ab-fd44e6599d8f could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:05:21.082978 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-404edf0b-09ab-4e37-910c-b9825a691161 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] 10.222.0.26 "GET /compute/v2.1/servers/93b29a96-2b64-46bd-b6ab-fd44e6599d8f" status: 404 len: 111 microversion: 2.47 time: 0.073621 Oct 08 21:05:21.083824 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1683/3292] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:05:21 2022] GET /compute/v2.1/servers/93b29a96-2b64-46bd-b6ab-fd44e6599d8f => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 08 21:05:21.089610 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-c91f46f0-ae62-42ec-a274-50fc481eefdb tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:05:21.091705 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-c91f46f0-ae62-42ec-a274-50fc481eefdb tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] [instance: 58ad88cd-b5d3-4aac-ae20-857736605fa0] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:05:21.099786 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c91f46f0-ae62-42ec-a274-50fc481eefdb tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:21.101470 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c91f46f0-ae62-42ec-a274-50fc481eefdb tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:21.102176 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c91f46f0-ae62-42ec-a274-50fc481eefdb tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:21.103158 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c91f46f0-ae62-42ec-a274-50fc481eefdb tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:21.103899 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c91f46f0-ae62-42ec-a274-50fc481eefdb tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:21.104603 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c91f46f0-ae62-42ec-a274-50fc481eefdb tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:21.434385 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-c91f46f0-ae62-42ec-a274-50fc481eefdb tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c6153d58d264272a375b3169e0874d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c405aac48e9b403ca8d1e3ac28fab76e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:21.457454 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-c91f46f0-ae62-42ec-a274-50fc481eefdb tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] 10.222.0.26 "GET /compute/v2.1/servers/58ad88cd-b5d3-4aac-ae20-857736605fa0" status: 200 len: 1281 microversion: 2.1 time: 0.368317 Oct 08 21:05:21.460485 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1684/3293] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:05:21 2022] GET /compute/v2.1/servers/58ad88cd-b5d3-4aac-ae20-857736605fa0 => generated 1281 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:05:21.468574 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-717d10fe-89d1-4282-8ca3-3d6fb91c90f0 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:05:21.475634 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-717d10fe-89d1-4282-8ca3-3d6fb91c90f0 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] [instance: 47d524a3-cb1f-4972-9ffb-a8225135461f] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:05:21.493032 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-717d10fe-89d1-4282-8ca3-3d6fb91c90f0 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:21.494137 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-717d10fe-89d1-4282-8ca3-3d6fb91c90f0 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:21.494844 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-717d10fe-89d1-4282-8ca3-3d6fb91c90f0 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:21.495824 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-717d10fe-89d1-4282-8ca3-3d6fb91c90f0 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:21.496515 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-717d10fe-89d1-4282-8ca3-3d6fb91c90f0 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:21.497175 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-717d10fe-89d1-4282-8ca3-3d6fb91c90f0 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:21.884550 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-717d10fe-89d1-4282-8ca3-3d6fb91c90f0 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5000948fa98a4b5d96ad27436d3d0edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917519b500674698a68dc01a4e8d68a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:21.891549 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:05:21.894731 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-717d10fe-89d1-4282-8ca3-3d6fb91c90f0 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] 10.222.0.26 "GET /compute/v2.1/servers/47d524a3-cb1f-4972-9ffb-a8225135461f" status: 200 len: 1275 microversion: 2.1 time: 0.430591 Oct 08 21:05:21.895605 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1685/3294] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:05:21 2022] GET /compute/v2.1/servers/47d524a3-cb1f-4972-9ffb-a8225135461f => generated 1275 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:05:21.908746 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-4f1f2a82-8183-44d5-8faa-816c7dec7978 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:05:21.913804 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-4f1f2a82-8183-44d5-8faa-816c7dec7978 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] [instance: 4bfa24d1-ed76-495d-a52b-dab5d1a3a366] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:05:21.932373 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4f1f2a82-8183-44d5-8faa-816c7dec7978 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:21.933517 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4f1f2a82-8183-44d5-8faa-816c7dec7978 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:21.934224 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4f1f2a82-8183-44d5-8faa-816c7dec7978 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:21.935193 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4f1f2a82-8183-44d5-8faa-816c7dec7978 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:21.938564 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4f1f2a82-8183-44d5-8faa-816c7dec7978 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:21.940037 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4f1f2a82-8183-44d5-8faa-816c7dec7978 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:21.999216 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-63eed7ab-17f7-4dfa-bbc4-d4ccd50a58ff tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:22.013882 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-63eed7ab-17f7-4dfa-bbc4-d4ccd50a58ff tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd" status: 200 len: 1466 microversion: 2.1 time: 2.123280 Oct 08 21:05:22.014085 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-4f1f2a82-8183-44d5-8faa-816c7dec7978 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] [instance: 4bfa24d1-ed76-495d-a52b-dab5d1a3a366] Going to try to terminate instance {{(pid=140492) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 21:05:22.016853 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1610/3295] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:05:19 2022] GET /compute/v2.1/servers/d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd => generated 1466 bytes in 2130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:05:22.035679 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-00c1ff60-6bda-45ea-8f8d-22ee5eb8a3ea tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:05:22.036304 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-00c1ff60-6bda-45ea-8f8d-22ee5eb8a3ea tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] [instance: dbacaeed-a40b-4e05-9635-5073dfdd8621] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:05:22.045516 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-00c1ff60-6bda-45ea-8f8d-22ee5eb8a3ea tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:22.046025 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-00c1ff60-6bda-45ea-8f8d-22ee5eb8a3ea tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:22.046472 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-00c1ff60-6bda-45ea-8f8d-22ee5eb8a3ea tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:22.047190 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-00c1ff60-6bda-45ea-8f8d-22ee5eb8a3ea tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:22.047752 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-00c1ff60-6bda-45ea-8f8d-22ee5eb8a3ea tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:22.052629 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-00c1ff60-6bda-45ea-8f8d-22ee5eb8a3ea tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:22.259368 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-4f1f2a82-8183-44d5-8faa-816c7dec7978 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] 10.222.0.26 "DELETE /compute/v2.1/servers/4bfa24d1-ed76-495d-a52b-dab5d1a3a366" status: 204 len: 0 microversion: 2.47 time: 0.360476 Oct 08 21:05:22.265529 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1686/3296] 10.222.0.26 () {60 vars in 1280 bytes} [Sat Oct 8 21:05:21 2022] DELETE /compute/v2.1/servers/4bfa24d1-ed76-495d-a52b-dab5d1a3a366 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 08 21:05:22.282560 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-da9cb998-47de-4336-ae43-329e6bc97c8e tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:05:22.284007 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-da9cb998-47de-4336-ae43-329e6bc97c8e tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] [instance: 4bfa24d1-ed76-495d-a52b-dab5d1a3a366] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:05:22.296130 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-da9cb998-47de-4336-ae43-329e6bc97c8e tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:22.297915 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-da9cb998-47de-4336-ae43-329e6bc97c8e tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:22.300488 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-da9cb998-47de-4336-ae43-329e6bc97c8e tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:22.305174 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-da9cb998-47de-4336-ae43-329e6bc97c8e tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:22.305979 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-da9cb998-47de-4336-ae43-329e6bc97c8e tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:22.306655 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-da9cb998-47de-4336-ae43-329e6bc97c8e tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:22.596692 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-00c1ff60-6bda-45ea-8f8d-22ee5eb8a3ea tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:22.615720 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-00c1ff60-6bda-45ea-8f8d-22ee5eb8a3ea tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:22.627532 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-00c1ff60-6bda-45ea-8f8d-22ee5eb8a3ea tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:22.628870 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-00c1ff60-6bda-45ea-8f8d-22ee5eb8a3ea tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] 10.222.0.26 "GET /compute/v2.1/servers/dbacaeed-a40b-4e05-9635-5073dfdd8621" status: 200 len: 1406 microversion: 2.20 time: 0.599589 Oct 08 21:05:22.631191 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1611/3297] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:05:22 2022] GET /compute/v2.1/servers/dbacaeed-a40b-4e05-9635-5073dfdd8621 => generated 1406 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 08 21:05:22.635342 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-da9cb998-47de-4336-ae43-329e6bc97c8e tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3245fc05926b49118c0d1028de3f09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527bbe10db744ab4bcc8078f2d754d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:22.648879 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-da9cb998-47de-4336-ae43-329e6bc97c8e tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3245fc05926b49118c0d1028de3f09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527bbe10db744ab4bcc8078f2d754d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:22.651970 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-da9cb998-47de-4336-ae43-329e6bc97c8e tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3245fc05926b49118c0d1028de3f09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527bbe10db744ab4bcc8078f2d754d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:22.655851 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-da9cb998-47de-4336-ae43-329e6bc97c8e tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] 10.222.0.26 "GET /compute/v2.1/servers/4bfa24d1-ed76-495d-a52b-dab5d1a3a366" status: 200 len: 1362 microversion: 2.47 time: 0.387502 Oct 08 21:05:22.659561 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-4bae28b3-9cb9-483f-97f8-c0b4f77858f0 req-140eff97-3303-467f-a009-4594c2e5916e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "930c77ec-9649-47fe-bdee-e215c32e28b4", "name": "network-vif-deleted", "tag": "bb41a678-69e1-4d9b-9a19-9898e186a74e"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:05:22.660303 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1687/3298] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:05:22 2022] GET /compute/v2.1/servers/4bfa24d1-ed76-495d-a52b-dab5d1a3a366 => generated 1362 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:05:22.679529 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-8ad380eb-3da8-4172-8103-4d7a0367d8ac tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:05:22.680483 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-8ad380eb-3da8-4172-8103-4d7a0367d8ac tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] [instance: 58ad88cd-b5d3-4aac-ae20-857736605fa0] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:05:22.693292 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-4bae28b3-9cb9-483f-97f8-c0b4f77858f0 req-140eff97-3303-467f-a009-4594c2e5916e service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:22.694615 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8ad380eb-3da8-4172-8103-4d7a0367d8ac tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:22.696063 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-4bae28b3-9cb9-483f-97f8-c0b4f77858f0 req-140eff97-3303-467f-a009-4594c2e5916e service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:22.696790 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8ad380eb-3da8-4172-8103-4d7a0367d8ac tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:22.697343 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8ad380eb-3da8-4172-8103-4d7a0367d8ac tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:22.699920 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-4bae28b3-9cb9-483f-97f8-c0b4f77858f0 req-140eff97-3303-467f-a009-4594c2e5916e service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:22.700959 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8ad380eb-3da8-4172-8103-4d7a0367d8ac tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:22.701609 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8ad380eb-3da8-4172-8103-4d7a0367d8ac tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:22.703044 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8ad380eb-3da8-4172-8103-4d7a0367d8ac tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:22.740335 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-4bae28b3-9cb9-483f-97f8-c0b4f77858f0 req-140eff97-3303-467f-a009-4594c2e5916e service nova] Creating event network-vif-deleted:bb41a678-69e1-4d9b-9a19-9898e186a74e for instance 930c77ec-9649-47fe-bdee-e215c32e28b4 on nch1-master-1 Oct 08 21:05:22.754315 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-4bae28b3-9cb9-483f-97f8-c0b4f77858f0 req-140eff97-3303-467f-a009-4594c2e5916e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115648 Oct 08 21:05:22.757493 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1612/3299] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:05:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:05:22.772595 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-c5ed2464-7dfd-4c33-a034-148f8cda5c5d req-24416abc-999f-4a7e-a2a6-c1de2344282d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd", "name": "network-vif-deleted", "tag": "1e8ee887-8012-4f64-a840-73388344bd23"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:05:22.798348 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-c5ed2464-7dfd-4c33-a034-148f8cda5c5d req-24416abc-999f-4a7e-a2a6-c1de2344282d service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:22.800409 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-c5ed2464-7dfd-4c33-a034-148f8cda5c5d req-24416abc-999f-4a7e-a2a6-c1de2344282d service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:22.801785 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-c5ed2464-7dfd-4c33-a034-148f8cda5c5d req-24416abc-999f-4a7e-a2a6-c1de2344282d service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:22.832870 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-c5ed2464-7dfd-4c33-a034-148f8cda5c5d req-24416abc-999f-4a7e-a2a6-c1de2344282d service nova] Creating event network-vif-deleted:1e8ee887-8012-4f64-a840-73388344bd23 for instance d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd on nch1-master-1 Oct 08 21:05:22.848630 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-c5ed2464-7dfd-4c33-a034-148f8cda5c5d req-24416abc-999f-4a7e-a2a6-c1de2344282d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088240 Oct 08 21:05:22.850186 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1613/3300] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:05:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:05:22.891472 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-8ad380eb-3da8-4172-8103-4d7a0367d8ac tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c6153d58d264272a375b3169e0874d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c405aac48e9b403ca8d1e3ac28fab76e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:22.903039 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-8ad380eb-3da8-4172-8103-4d7a0367d8ac tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] 10.222.0.26 "GET /compute/v2.1/servers/58ad88cd-b5d3-4aac-ae20-857736605fa0" status: 200 len: 1281 microversion: 2.1 time: 0.239345 Oct 08 21:05:22.925142 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-4cd23654-d13d-4693-944b-6f8b3e12a4dd tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:05:22.926157 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-4cd23654-d13d-4693-944b-6f8b3e12a4dd tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] [instance: 47d524a3-cb1f-4972-9ffb-a8225135461f] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:05:22.929596 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1688/3301] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:05:22 2022] GET /compute/v2.1/servers/58ad88cd-b5d3-4aac-ae20-857736605fa0 => generated 1281 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:05:22.933208 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4cd23654-d13d-4693-944b-6f8b3e12a4dd tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:22.934066 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4cd23654-d13d-4693-944b-6f8b3e12a4dd tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:22.934829 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4cd23654-d13d-4693-944b-6f8b3e12a4dd tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:22.935828 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4cd23654-d13d-4693-944b-6f8b3e12a4dd tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:22.936447 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4cd23654-d13d-4693-944b-6f8b3e12a4dd tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:22.937158 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4cd23654-d13d-4693-944b-6f8b3e12a4dd tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:23.050362 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-7db51380-9583-44e6-9bdd-cd8c79b23ea4 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:05:23.053300 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-7db51380-9583-44e6-9bdd-cd8c79b23ea4 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:05:23.063517 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-4cd23654-d13d-4693-944b-6f8b3e12a4dd tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5000948fa98a4b5d96ad27436d3d0edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917519b500674698a68dc01a4e8d68a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:23.073972 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-4cd23654-d13d-4693-944b-6f8b3e12a4dd tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] 10.222.0.26 "GET /compute/v2.1/servers/47d524a3-cb1f-4972-9ffb-a8225135461f" status: 200 len: 1275 microversion: 2.1 time: 0.153639 Oct 08 21:05:23.076342 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7db51380-9583-44e6-9bdd-cd8c79b23ea4 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:23.077632 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1614/3302] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:05:22 2022] GET /compute/v2.1/servers/47d524a3-cb1f-4972-9ffb-a8225135461f => generated 1275 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:05:23.090418 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7db51380-9583-44e6-9bdd-cd8c79b23ea4 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:23.090418 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7db51380-9583-44e6-9bdd-cd8c79b23ea4 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:23.091619 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7db51380-9583-44e6-9bdd-cd8c79b23ea4 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:23.092147 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7db51380-9583-44e6-9bdd-cd8c79b23ea4 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:23.092604 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7db51380-9583-44e6-9bdd-cd8c79b23ea4 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:23.190504 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7db51380-9583-44e6-9bdd-cd8c79b23ea4 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:23.196518 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7db51380-9583-44e6-9bdd-cd8c79b23ea4 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:23.197257 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7db51380-9583-44e6-9bdd-cd8c79b23ea4 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:23.197789 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.objects.instance [None req-7db51380-9583-44e6-9bdd-cd8c79b23ea4 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lazy-loading 'fault' on Instance uuid d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd {{(pid=140492) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 21:05:23.636077 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-7db51380-9583-44e6-9bdd-cd8c79b23ea4 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5266cd6be4514b3eac30a195f6b25772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffdae031c4f47d599acb30f1d3c87b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:23.658786 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c27fbc9c-e89c-449c-95ff-021136efa101 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:05:23.659304 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-c27fbc9c-e89c-449c-95ff-021136efa101 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] [instance: dbacaeed-a40b-4e05-9635-5073dfdd8621] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:05:23.662343 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=4 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:05:23.662791 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-7db51380-9583-44e6-9bdd-cd8c79b23ea4 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd" status: 200 len: 1302 microversion: 2.1 time: 0.608641 Oct 08 21:05:23.665034 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1689/3303] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:05:23 2022] GET /compute/v2.1/servers/d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd => generated 1302 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:05:23.668901 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c27fbc9c-e89c-449c-95ff-021136efa101 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:23.669432 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c27fbc9c-e89c-449c-95ff-021136efa101 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:23.669874 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c27fbc9c-e89c-449c-95ff-021136efa101 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:23.676665 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c27fbc9c-e89c-449c-95ff-021136efa101 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:23.677406 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c27fbc9c-e89c-449c-95ff-021136efa101 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:23.678034 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c27fbc9c-e89c-449c-95ff-021136efa101 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:23.702715 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e6178723-ecfb-49bb-9deb-9a1ed01da075 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:05:23.704547 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-e6178723-ecfb-49bb-9deb-9a1ed01da075 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] [instance: 4bfa24d1-ed76-495d-a52b-dab5d1a3a366] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:05:23.750416 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e6178723-ecfb-49bb-9deb-9a1ed01da075 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:23.751508 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e6178723-ecfb-49bb-9deb-9a1ed01da075 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:23.758042 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e6178723-ecfb-49bb-9deb-9a1ed01da075 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:23.761375 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e6178723-ecfb-49bb-9deb-9a1ed01da075 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:23.767542 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e6178723-ecfb-49bb-9deb-9a1ed01da075 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:23.769551 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e6178723-ecfb-49bb-9deb-9a1ed01da075 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:23.994085 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-e6178723-ecfb-49bb-9deb-9a1ed01da075 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3245fc05926b49118c0d1028de3f09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527bbe10db744ab4bcc8078f2d754d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:24.010139 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-e6178723-ecfb-49bb-9deb-9a1ed01da075 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3245fc05926b49118c0d1028de3f09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527bbe10db744ab4bcc8078f2d754d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:24.018274 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-e6178723-ecfb-49bb-9deb-9a1ed01da075 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3245fc05926b49118c0d1028de3f09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527bbe10db744ab4bcc8078f2d754d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:24.020506 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-e6178723-ecfb-49bb-9deb-9a1ed01da075 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] 10.222.0.26 "GET /compute/v2.1/servers/4bfa24d1-ed76-495d-a52b-dab5d1a3a366" status: 200 len: 1362 microversion: 2.47 time: 0.336345 Oct 08 21:05:24.024490 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1690/3304] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:05:23 2022] GET /compute/v2.1/servers/4bfa24d1-ed76-495d-a52b-dab5d1a3a366 => generated 1362 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:05:24.035222 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-c471dd12-571c-4440-a150-257affeba9fa tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:05:24.039032 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-c471dd12-571c-4440-a150-257affeba9fa tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] [instance: 58ad88cd-b5d3-4aac-ae20-857736605fa0] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:05:24.054481 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c471dd12-571c-4440-a150-257affeba9fa tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:24.055236 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c471dd12-571c-4440-a150-257affeba9fa tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:24.055446 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c471dd12-571c-4440-a150-257affeba9fa tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:24.061549 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c471dd12-571c-4440-a150-257affeba9fa tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:24.070202 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c471dd12-571c-4440-a150-257affeba9fa tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:24.071149 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c471dd12-571c-4440-a150-257affeba9fa tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:24.136381 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-c27fbc9c-e89c-449c-95ff-021136efa101 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:24.152734 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-c27fbc9c-e89c-449c-95ff-021136efa101 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:24.170217 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-c27fbc9c-e89c-449c-95ff-021136efa101 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:24.172308 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-c27fbc9c-e89c-449c-95ff-021136efa101 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] 10.222.0.26 "GET /compute/v2.1/servers/dbacaeed-a40b-4e05-9635-5073dfdd8621" status: 200 len: 1406 microversion: 2.20 time: 0.518749 Oct 08 21:05:24.177991 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1615/3305] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:05:23 2022] GET /compute/v2.1/servers/dbacaeed-a40b-4e05-9635-5073dfdd8621 => generated 1406 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 08 21:05:24.184741 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-5a369bcc-acf6-4616-8f92-d433f2749781 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:05:24.193568 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-5a369bcc-acf6-4616-8f92-d433f2749781 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] [instance: 47d524a3-cb1f-4972-9ffb-a8225135461f] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:05:24.215255 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5a369bcc-acf6-4616-8f92-d433f2749781 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:24.220043 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5a369bcc-acf6-4616-8f92-d433f2749781 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:24.223394 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5a369bcc-acf6-4616-8f92-d433f2749781 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:24.224359 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5a369bcc-acf6-4616-8f92-d433f2749781 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:24.229203 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5a369bcc-acf6-4616-8f92-d433f2749781 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:24.232799 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5a369bcc-acf6-4616-8f92-d433f2749781 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:24.518962 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-5a369bcc-acf6-4616-8f92-d433f2749781 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5000948fa98a4b5d96ad27436d3d0edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917519b500674698a68dc01a4e8d68a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:24.542143 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-5a369bcc-acf6-4616-8f92-d433f2749781 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] 10.222.0.26 "GET /compute/v2.1/servers/47d524a3-cb1f-4972-9ffb-a8225135461f" status: 200 len: 1275 microversion: 2.1 time: 0.362656 Oct 08 21:05:24.542758 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1616/3306] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:05:24 2022] GET /compute/v2.1/servers/47d524a3-cb1f-4972-9ffb-a8225135461f => generated 1275 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:05:24.689451 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-9f6ea70b-c13a-464e-92de-a05921bfdcd7 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:05:24.690088 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-9f6ea70b-c13a-464e-92de-a05921bfdcd7 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] [instance: d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:05:24.699985 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9f6ea70b-c13a-464e-92de-a05921bfdcd7 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:24.700502 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9f6ea70b-c13a-464e-92de-a05921bfdcd7 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:24.700965 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9f6ea70b-c13a-464e-92de-a05921bfdcd7 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:24.712223 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9f6ea70b-c13a-464e-92de-a05921bfdcd7 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:24.728380 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9f6ea70b-c13a-464e-92de-a05921bfdcd7 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:24.730092 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9f6ea70b-c13a-464e-92de-a05921bfdcd7 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:24.786213 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-9f6ea70b-c13a-464e-92de-a05921bfdcd7 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] HTTP exception thrown: Instance d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd could not be found. Oct 08 21:05:24.788121 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-9f6ea70b-c13a-464e-92de-a05921bfdcd7 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Request method failure captured: Oct 08 21:05:24.788121 ncdv-master-1 devstack@n-api.service[140491]: request: GET /compute/v2.1/servers/d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd HTTP/1.1 Oct 08 21:05:24.788121 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:05:24.788121 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:05:24.788121 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:05:24.788121 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 21:05:24.788121 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:05:24.788121 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:05:24.788121 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:05:24.788121 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:05:24.788121 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeSpH4XDiYW19iQbBiok8uGM0c09fRqx5RRIizvfuTfqVgRGIpA6bFXwFHQqBS5yIR3OkB2E0bcw2nYeKqHv0LMQ6Oyj572d2Mx3XOjvMpnN8CYfHcY_H_6fonfL0ijUqcg70H8pyQhVd4bZHdhW8zWnUCcY8Nk9k_rfX1dbnTaTfN8 Oct 08 21:05:24.788121 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:05:24.788121 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:05:24.788121 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:05:24.788121 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:05:24.788121 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:05:24.788121 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:05:24.788121 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 0ffdae031c4f47d599acb30f1d3c87b9 Oct 08 21:05:24.788121 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-MigrationsAdminTest-1214086769 Oct 08 21:05:24.788121 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:05:24.788121 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:05:24.788121 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0ffdae031c4f47d599acb30f1d3c87b9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0ffdae031c4f47d599acb30f1d3c87b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0ffdae031c4f47d599acb30f1d3c87b9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0ffdae031c4f47d599acb30f1d3c87b9"}]}] Oct 08 21:05:24.788121 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-MigrationsAdminTest-1214086769 Oct 08 21:05:24.788121 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 0ffdae031c4f47d599acb30f1d3c87b9 Oct 08 21:05:24.788121 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-MigrationsAdminTest-1214086769 Oct 08 21:05:24.788121 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-MigrationsAdminTest-1214086769-project Oct 08 21:05:24.788121 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:05:24.788121 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:05:24.788121 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 5266cd6be4514b3eac30a195f6b25772 Oct 08 21:05:24.788121 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-MigrationsAdminTest-1214086769-project Oct 08 21:05:24.788121 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:05:24.788121 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd could not be found. Oct 08 21:05:24.788121 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': 'd8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd'} Oct 08 21:05:24.788121 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:05:24.788121 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:05:24.788121 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:05:24.788121 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:05:24.788121 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:05:24.788121 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:05:24.788121 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:05:24.788121 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:05:24.788121 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:05:24.788121 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:05:24.788121 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd could not be found. Oct 08 21:05:24.788121 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:05:24.788121 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:05:24.788121 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:05:24.788121 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:05:24.788121 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:05:24.788121 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:05:24.788121 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:05:24.788121 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:05:24.788121 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:05:24.788121 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:05:24.788121 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:05:24.788121 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:05:24.788121 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:05:24.788121 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:05:24.788121 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:05:24.788121 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:05:24.788121 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd could not be found. Oct 08 21:05:24.788121 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:05:24.788121 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:05:24.788121 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:05:24.793015 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:05:24.793015 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:05:24.793015 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:05:24.793015 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:05:24.793015 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:05:24.793015 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd could not be found. Oct 08 21:05:24.793015 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:05:24.796040 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-9f6ea70b-c13a-464e-92de-a05921bfdcd7 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] Returning 404 to user: Instance d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:05:24.798753 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-9f6ea70b-c13a-464e-92de-a05921bfdcd7 tempest-MigrationsAdminTest-1214086769 tempest-MigrationsAdminTest-1214086769-project] 10.222.0.26 "GET /compute/v2.1/servers/d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd" status: 404 len: 111 microversion: 2.1 time: 0.113346 Oct 08 21:05:24.802465 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1617/3307] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:05:24 2022] GET /compute/v2.1/servers/d8acc5d9-a0cf-41ec-8d80-b0bcb2c905bd => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:05:24.815865 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-a141b783-c508-47a8-8532-10ea8342951f tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1946300073", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b408a2cd-643c-40fc-91b9-deec142ef1f1"}], "security_groups": [{"name": "tempest-securitygroup--1519309985"}], "key_name": "tempest-keypair-1643426037", "user_data": "}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:05:25.164776 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.network.neutron [None req-a141b783-c508-47a8-8532-10ea8342951f tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] validate_networks() for [('b408a2cd-643c-40fc-91b9-deec142ef1f1', None, None, None, None, None)] {{(pid=140491) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 21:05:25.834035 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-c471dd12-571c-4440-a150-257affeba9fa tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c6153d58d264272a375b3169e0874d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c405aac48e9b403ca8d1e3ac28fab76e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:25.854066 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-c471dd12-571c-4440-a150-257affeba9fa tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] 10.222.0.26 "GET /compute/v2.1/servers/58ad88cd-b5d3-4aac-ae20-857736605fa0" status: 200 len: 1323 microversion: 2.1 time: 1.827894 Oct 08 21:05:25.859934 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1691/3308] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:05:24 2022] GET /compute/v2.1/servers/58ad88cd-b5d3-4aac-ae20-857736605fa0 => generated 1323 bytes in 1835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:05:25.864867 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-449784ef-9c62-4e04-a567-9bd91981ea5e req-1e7bcb4f-bea1-4fa6-a8e8-db41f7ad1438 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbacaeed-a40b-4e05-9635-5073dfdd8621", "name": "network-vif-plugged", "status": "completed", "tag": "6fe657e1-039e-4549-b2d4-955cfbaed37d"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:05:25.899489 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-449784ef-9c62-4e04-a567-9bd91981ea5e req-1e7bcb4f-bea1-4fa6-a8e8-db41f7ad1438 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:25.899979 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-449784ef-9c62-4e04-a567-9bd91981ea5e req-1e7bcb4f-bea1-4fa6-a8e8-db41f7ad1438 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:25.900601 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-449784ef-9c62-4e04-a567-9bd91981ea5e req-1e7bcb4f-bea1-4fa6-a8e8-db41f7ad1438 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:25.921734 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-449784ef-9c62-4e04-a567-9bd91981ea5e req-1e7bcb4f-bea1-4fa6-a8e8-db41f7ad1438 service nova] Creating event network-vif-plugged:6fe657e1-039e-4549-b2d4-955cfbaed37d for instance dbacaeed-a40b-4e05-9635-5073dfdd8621 on nch2-master-1 Oct 08 21:05:25.933412 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-449784ef-9c62-4e04-a567-9bd91981ea5e req-1e7bcb4f-bea1-4fa6-a8e8-db41f7ad1438 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071846 Oct 08 21:05:25.934266 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1692/3309] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:05:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:05:25.939969 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-b591c2fc-97a8-4df8-a192-37ff8b804ce5 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:05:25.946247 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-b591c2fc-97a8-4df8-a192-37ff8b804ce5 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] [instance: 4bfa24d1-ed76-495d-a52b-dab5d1a3a366] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:05:25.962406 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b591c2fc-97a8-4df8-a192-37ff8b804ce5 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:25.963164 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b591c2fc-97a8-4df8-a192-37ff8b804ce5 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:25.963779 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b591c2fc-97a8-4df8-a192-37ff8b804ce5 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:25.964696 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b591c2fc-97a8-4df8-a192-37ff8b804ce5 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:25.965362 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b591c2fc-97a8-4df8-a192-37ff8b804ce5 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:25.965971 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b591c2fc-97a8-4df8-a192-37ff8b804ce5 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:25.990908 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-b591c2fc-97a8-4df8-a192-37ff8b804ce5 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] HTTP exception thrown: Instance 4bfa24d1-ed76-495d-a52b-dab5d1a3a366 could not be found. Oct 08 21:05:26.005549 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-b591c2fc-97a8-4df8-a192-37ff8b804ce5 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Request method failure captured: Oct 08 21:05:26.005549 ncdv-master-1 devstack@n-api.service[140492]: request: GET /compute/v2.1/servers/4bfa24d1-ed76-495d-a52b-dab5d1a3a366 HTTP/1.1 Oct 08 21:05:26.005549 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:05:26.005549 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:05:26.005549 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:05:26.005549 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 21:05:26.005549 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:05:26.005549 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:05:26.005549 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:05:26.005549 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:05:26.005549 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeXay4Qf9odEg5sQ4UfbmfLrqkO8S5BHQBUPO3vn7IP4Y1nyXBa0q6fIMN9J0LMTohQNditg6Ii1Fx-A_WhOpC678XZDgc1UGndAneuOCwSjkrBXed--Pvg6w8M6fV0C8wu-DcMBATvv4HXhiXVlIEfvKUSJp5-CX-TQg8hcI3ljTl4 Oct 08 21:05:26.005549 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:05:26.005549 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:05:26.005549 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:05:26.005549 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:05:26.005549 ncdv-master-1 devstack@n-api.service[140492]: X-Openstack-Nova-Api-Version: 2.47 Oct 08 21:05:26.005549 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:05:26.005549 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:05:26.005549 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 527bbe10db744ab4bcc8078f2d754d53 Oct 08 21:05:26.005549 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-ServerShowV247Test-1720874898 Oct 08 21:05:26.005549 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:05:26.005549 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:05:26.005549 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/527bbe10db744ab4bcc8078f2d754d53"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/527bbe10db744ab4bcc8078f2d754d53"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_527bbe10db744ab4bcc8078f2d754d53"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/527bbe10db744ab4bcc8078f2d754d53"}]}] Oct 08 21:05:26.005549 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-ServerShowV247Test-1720874898 Oct 08 21:05:26.005549 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 527bbe10db744ab4bcc8078f2d754d53 Oct 08 21:05:26.005549 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-ServerShowV247Test-1720874898 Oct 08 21:05:26.005549 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-ServerShowV247Test-1720874898-project Oct 08 21:05:26.005549 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:05:26.005549 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:05:26.005549 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 3245fc05926b49118c0d1028de3f09a4 Oct 08 21:05:26.005549 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-ServerShowV247Test-1720874898-project Oct 08 21:05:26.005549 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 21:05:26.005549 ncdv-master-1 devstack@n-api.service[140492]: exception: Instance 4bfa24d1-ed76-495d-a52b-dab5d1a3a366 could not be found. Oct 08 21:05:26.005549 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': '4bfa24d1-ed76-495d-a52b-dab5d1a3a366'} Oct 08 21:05:26.005549 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:05:26.005549 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:05:26.005549 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:05:26.005549 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:05:26.005549 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:05:26.005549 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:05:26.005549 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:05:26.005549 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:05:26.005549 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:05:26.005549 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:05:26.005549 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4bfa24d1-ed76-495d-a52b-dab5d1a3a366 could not be found. Oct 08 21:05:26.005549 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:05:26.005549 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:05:26.005549 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:05:26.005549 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:05:26.005549 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:05:26.005549 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:05:26.005549 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:05:26.005549 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:05:26.005549 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:05:26.005549 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:05:26.005549 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:05:26.005549 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:05:26.005549 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:05:26.005549 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:05:26.005549 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:05:26.005549 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:05:26.005549 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4bfa24d1-ed76-495d-a52b-dab5d1a3a366 could not be found. Oct 08 21:05:26.005549 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:05:26.005549 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:05:26.005549 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:05:26.012153 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:05:26.012153 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:05:26.012153 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:05:26.012153 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:05:26.012153 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:05:26.012153 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4bfa24d1-ed76-495d-a52b-dab5d1a3a366 could not be found. Oct 08 21:05:26.012153 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:05:26.012153 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-b591c2fc-97a8-4df8-a192-37ff8b804ce5 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] Returning 404 to user: Instance 4bfa24d1-ed76-495d-a52b-dab5d1a3a366 could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:05:26.012153 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-b591c2fc-97a8-4df8-a192-37ff8b804ce5 tempest-ServerShowV247Test-1720874898 tempest-ServerShowV247Test-1720874898-project] 10.222.0.26 "GET /compute/v2.1/servers/4bfa24d1-ed76-495d-a52b-dab5d1a3a366" status: 404 len: 111 microversion: 2.47 time: 0.071635 Oct 08 21:05:26.012153 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1693/3310] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:05:25 2022] GET /compute/v2.1/servers/4bfa24d1-ed76-495d-a52b-dab5d1a3a366 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 08 21:05:26.012803 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-55b0ed5c-c65e-4eb1-b419-87d76db5e8a1 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:05:26.013730 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-55b0ed5c-c65e-4eb1-b419-87d76db5e8a1 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] [instance: dbacaeed-a40b-4e05-9635-5073dfdd8621] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:05:26.030209 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-55b0ed5c-c65e-4eb1-b419-87d76db5e8a1 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:26.030980 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-55b0ed5c-c65e-4eb1-b419-87d76db5e8a1 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:26.032361 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-55b0ed5c-c65e-4eb1-b419-87d76db5e8a1 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:26.033304 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-55b0ed5c-c65e-4eb1-b419-87d76db5e8a1 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:26.033935 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-55b0ed5c-c65e-4eb1-b419-87d76db5e8a1 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:26.034574 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-55b0ed5c-c65e-4eb1-b419-87d76db5e8a1 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:26.484105 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-a141b783-c508-47a8-8532-10ea8342951f tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Flavor limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 21:05:26.486217 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-a141b783-c508-47a8-8532-10ea8342951f tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Image limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 21:05:26.487113 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-a141b783-c508-47a8-8532-10ea8342951f tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Flavor pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 21:05:26.494431 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=20 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:05:26.495225 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-a141b783-c508-47a8-8532-10ea8342951f tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Image pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 21:05:26.496510 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-a141b783-c508-47a8-8532-10ea8342951f tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 21:05:26.517555 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a141b783-c508-47a8-8532-10ea8342951f tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:26.518055 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a141b783-c508-47a8-8532-10ea8342951f tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:26.518504 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a141b783-c508-47a8-8532-10ea8342951f tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:26.521578 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a141b783-c508-47a8-8532-10ea8342951f tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:26.522486 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a141b783-c508-47a8-8532-10ea8342951f tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:26.523347 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a141b783-c508-47a8-8532-10ea8342951f tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:26.562150 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-a141b783-c508-47a8-8532-10ea8342951f tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Getting quotas for project c68b14967e8249fd886f168d366f241f. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:05:26.571547 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-a141b783-c508-47a8-8532-10ea8342951f tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Getting quotas for user 85abb492492343c58734564a2b26c8f6 and project c68b14967e8249fd886f168d366f241f. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:05:26.588825 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-a141b783-c508-47a8-8532-10ea8342951f tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Going to run 1 instances... {{(pid=140491) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 21:05:26.591998 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-a141b783-c508-47a8-8532-10ea8342951f tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] [instance: ce4a2fbf-76f3-4577-a704-3b64ec30d84b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c508bd7f-7db9-4b2c-af7c-be54a855c355',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140491) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 21:05:26.711102 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-a141b783-c508-47a8-8532-10ea8342951f tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.907322 Oct 08 21:05:26.715473 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1618/3311] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 21:05:24 2022] POST /compute/v2.1/servers => generated 402 bytes in 1912 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 08 21:05:26.761964 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-3d44f604-d230-4674-bfbe-631bb8414ae6 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:05:26.765028 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-3d44f604-d230-4674-bfbe-631bb8414ae6 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] [instance: 47d524a3-cb1f-4972-9ffb-a8225135461f] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:05:26.788798 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3d44f604-d230-4674-bfbe-631bb8414ae6 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:26.794250 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3d44f604-d230-4674-bfbe-631bb8414ae6 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:26.794844 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3d44f604-d230-4674-bfbe-631bb8414ae6 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:26.796051 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3d44f604-d230-4674-bfbe-631bb8414ae6 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:26.796646 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3d44f604-d230-4674-bfbe-631bb8414ae6 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:26.797554 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3d44f604-d230-4674-bfbe-631bb8414ae6 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:26.909251 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-55b0ed5c-c65e-4eb1-b419-87d76db5e8a1 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:26.925708 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-55b0ed5c-c65e-4eb1-b419-87d76db5e8a1 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:26.935423 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-55b0ed5c-c65e-4eb1-b419-87d76db5e8a1 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:26.937321 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-55b0ed5c-c65e-4eb1-b419-87d76db5e8a1 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] 10.222.0.26 "GET /compute/v2.1/servers/dbacaeed-a40b-4e05-9635-5073dfdd8621" status: 200 len: 1406 microversion: 2.20 time: 0.928403 Oct 08 21:05:26.940251 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1694/3312] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:05:26 2022] GET /compute/v2.1/servers/dbacaeed-a40b-4e05-9635-5073dfdd8621 => generated 1406 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:05:26.949966 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-7c912aca-7bdc-410e-a857-cfc64e03642d req-dc572982-6892-4146-81a3-86d5f4345488 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58ad88cd-b5d3-4aac-ae20-857736605fa0", "tag": "b52b4792-7889-4b9f-ab09-74d565a895ac"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:05:26.976732 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=2,nova_api:INSERT=7 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:05:26.981158 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-7c912aca-7bdc-410e-a857-cfc64e03642d req-dc572982-6892-4146-81a3-86d5f4345488 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:26.981658 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-7c912aca-7bdc-410e-a857-cfc64e03642d req-dc572982-6892-4146-81a3-86d5f4345488 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:26.984263 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-7c912aca-7bdc-410e-a857-cfc64e03642d req-dc572982-6892-4146-81a3-86d5f4345488 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:27.006433 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-7c912aca-7bdc-410e-a857-cfc64e03642d req-dc572982-6892-4146-81a3-86d5f4345488 service nova] Creating event network-changed:b52b4792-7889-4b9f-ab09-74d565a895ac for instance 58ad88cd-b5d3-4aac-ae20-857736605fa0 on nch1-master-1 Oct 08 21:05:27.011560 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-7c912aca-7bdc-410e-a857-cfc64e03642d req-dc572982-6892-4146-81a3-86d5f4345488 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068880 Oct 08 21:05:27.013222 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1695/3313] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:05:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:05:27.020564 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-867272b0-7792-4507-b7fb-6f762a934f10 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:05:27.021342 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-867272b0-7792-4507-b7fb-6f762a934f10 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] [instance: ce4a2fbf-76f3-4577-a704-3b64ec30d84b] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:05:27.159371 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=4 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:05:27.178644 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-867272b0-7792-4507-b7fb-6f762a934f10 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85abb492492343c58734564a2b26c8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68b14967e8249fd886f168d366f241f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:27.191290 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-867272b0-7792-4507-b7fb-6f762a934f10 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] 10.222.0.26 "GET /compute/v2.1/servers/ce4a2fbf-76f3-4577-a704-3b64ec30d84b" status: 200 len: 1238 microversion: 2.1 time: 0.175651 Oct 08 21:05:27.197335 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1696/3314] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:05:27 2022] GET /compute/v2.1/servers/ce4a2fbf-76f3-4577-a704-3b64ec30d84b => generated 1238 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:05:27.220854 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-2a3fdfa1-347e-4a0f-a729-8ccd7554e788 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:05:27.222999 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-2a3fdfa1-347e-4a0f-a729-8ccd7554e788 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] [instance: 58ad88cd-b5d3-4aac-ae20-857736605fa0] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:05:27.242519 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2a3fdfa1-347e-4a0f-a729-8ccd7554e788 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:27.244665 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2a3fdfa1-347e-4a0f-a729-8ccd7554e788 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:27.247656 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2a3fdfa1-347e-4a0f-a729-8ccd7554e788 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:27.250193 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2a3fdfa1-347e-4a0f-a729-8ccd7554e788 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:27.251275 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2a3fdfa1-347e-4a0f-a729-8ccd7554e788 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:27.252423 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2a3fdfa1-347e-4a0f-a729-8ccd7554e788 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:27.485768 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-3d44f604-d230-4674-bfbe-631bb8414ae6 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5000948fa98a4b5d96ad27436d3d0edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917519b500674698a68dc01a4e8d68a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:27.498977 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-3d44f604-d230-4674-bfbe-631bb8414ae6 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] 10.222.0.26 "GET /compute/v2.1/servers/47d524a3-cb1f-4972-9ffb-a8225135461f" status: 200 len: 1317 microversion: 2.1 time: 0.782110 Oct 08 21:05:27.508679 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1619/3315] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:05:26 2022] GET /compute/v2.1/servers/47d524a3-cb1f-4972-9ffb-a8225135461f => generated 1317 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:05:27.971365 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-9efaaecf-f51f-4731-9906-a99e9e286790 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:05:27.972376 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-9efaaecf-f51f-4731-9906-a99e9e286790 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] [instance: dbacaeed-a40b-4e05-9635-5073dfdd8621] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:05:27.979863 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9efaaecf-f51f-4731-9906-a99e9e286790 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:27.980662 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9efaaecf-f51f-4731-9906-a99e9e286790 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:27.981375 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9efaaecf-f51f-4731-9906-a99e9e286790 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:27.982337 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9efaaecf-f51f-4731-9906-a99e9e286790 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:27.983026 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9efaaecf-f51f-4731-9906-a99e9e286790 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:27.983671 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9efaaecf-f51f-4731-9906-a99e9e286790 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:28.042400 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-2a3fdfa1-347e-4a0f-a729-8ccd7554e788 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c6153d58d264272a375b3169e0874d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c405aac48e9b403ca8d1e3ac28fab76e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:28.060986 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-2a3fdfa1-347e-4a0f-a729-8ccd7554e788 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] 10.222.0.26 "GET /compute/v2.1/servers/58ad88cd-b5d3-4aac-ae20-857736605fa0" status: 200 len: 1323 microversion: 2.1 time: 0.861728 Oct 08 21:05:28.063219 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1697/3316] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:05:27 2022] GET /compute/v2.1/servers/58ad88cd-b5d3-4aac-ae20-857736605fa0 => generated 1323 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:05:28.216316 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-787fd508-b4e6-4c81-9abb-44c825b8edc6 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:05:28.216951 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-787fd508-b4e6-4c81-9abb-44c825b8edc6 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] [instance: ce4a2fbf-76f3-4577-a704-3b64ec30d84b] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:05:28.236847 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-787fd508-b4e6-4c81-9abb-44c825b8edc6 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:28.237629 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-787fd508-b4e6-4c81-9abb-44c825b8edc6 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:28.238298 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-787fd508-b4e6-4c81-9abb-44c825b8edc6 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:28.239347 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-787fd508-b4e6-4c81-9abb-44c825b8edc6 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:28.240379 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-787fd508-b4e6-4c81-9abb-44c825b8edc6 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:28.241094 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-787fd508-b4e6-4c81-9abb-44c825b8edc6 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:28.352068 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-9efaaecf-f51f-4731-9906-a99e9e286790 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:28.363013 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-9efaaecf-f51f-4731-9906-a99e9e286790 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:28.364850 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-9efaaecf-f51f-4731-9906-a99e9e286790 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:28.366647 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-9efaaecf-f51f-4731-9906-a99e9e286790 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] 10.222.0.26 "GET /compute/v2.1/servers/dbacaeed-a40b-4e05-9635-5073dfdd8621" status: 200 len: 1598 microversion: 2.20 time: 0.399634 Oct 08 21:05:28.367409 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1620/3317] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:05:27 2022] GET /compute/v2.1/servers/dbacaeed-a40b-4e05-9635-5073dfdd8621 => generated 1598 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 08 21:05:28.399112 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-606132b6-0664-444c-8289-b092665c3855 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:05:28.400632 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-606132b6-0664-444c-8289-b092665c3855 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] [instance: dbacaeed-a40b-4e05-9635-5073dfdd8621] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:05:28.412203 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-606132b6-0664-444c-8289-b092665c3855 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:28.415678 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-606132b6-0664-444c-8289-b092665c3855 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:28.417483 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-606132b6-0664-444c-8289-b092665c3855 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:28.419259 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-606132b6-0664-444c-8289-b092665c3855 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:28.420466 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-606132b6-0664-444c-8289-b092665c3855 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:28.423060 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-606132b6-0664-444c-8289-b092665c3855 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:28.428973 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:05:28.525236 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-787fd508-b4e6-4c81-9abb-44c825b8edc6 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85abb492492343c58734564a2b26c8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68b14967e8249fd886f168d366f241f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:28.535737 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-787fd508-b4e6-4c81-9abb-44c825b8edc6 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] 10.222.0.26 "GET /compute/v2.1/servers/ce4a2fbf-76f3-4577-a704-3b64ec30d84b" status: 200 len: 1290 microversion: 2.1 time: 0.321911 Oct 08 21:05:28.542839 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1698/3318] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:05:28 2022] GET /compute/v2.1/servers/ce4a2fbf-76f3-4577-a704-3b64ec30d84b => generated 1290 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:05:28.550260 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-f042e729-84d5-47f8-8b35-601023541def tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:05:28.555674 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-f042e729-84d5-47f8-8b35-601023541def tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] [instance: 47d524a3-cb1f-4972-9ffb-a8225135461f] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:05:28.572631 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f042e729-84d5-47f8-8b35-601023541def tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:28.576334 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f042e729-84d5-47f8-8b35-601023541def tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:28.579778 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f042e729-84d5-47f8-8b35-601023541def tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:28.580772 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f042e729-84d5-47f8-8b35-601023541def tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:28.581553 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f042e729-84d5-47f8-8b35-601023541def tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:28.585851 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f042e729-84d5-47f8-8b35-601023541def tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:28.664238 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-606132b6-0664-444c-8289-b092665c3855 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] 10.222.0.26 "GET /compute/v2.1/servers/dbacaeed-a40b-4e05-9635-5073dfdd8621/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.272274 Oct 08 21:05:28.667200 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1621/3319] 10.222.0.26 () {60 vars in 1316 bytes} [Sat Oct 8 21:05:28 2022] GET /compute/v2.1/servers/dbacaeed-a40b-4e05-9635-5073dfdd8621/os-interface => generated 284 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 08 21:05:28.690738 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-2b4c7a9b-f4ba-467f-9277-70f8b5717f75 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Action: 'create', calling method: .version_select at 0x7f1a9136db80>, body: {"keypair": {"name": "tempest-keypair-554567182", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEW90kJ/7FIybEtCFhD/1ltnyFLTAAJH9m1LznPRPTiA7HRMEaXxWXe8/VzLKAJROLKDlIbqWcpSu6B1UjhQqfvmIphycoMOY/3MsNXo8F9qWCr7LrU2wKi3AvHqyETLAA=="}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:05:28.723953 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-2b4c7a9b-f4ba-467f-9277-70f8b5717f75 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Getting quotas for project 22f2d56477794f8ab38b8e3535b3e8dc. Resources: {'key_pairs'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:05:28.733164 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-2b4c7a9b-f4ba-467f-9277-70f8b5717f75 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Getting quotas for user fc2bdd169daf4a1db830b1fa7f94f0b2 and project 22f2d56477794f8ab38b8e3535b3e8dc. Resources: {'key_pairs'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:05:28.775545 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-2b4c7a9b-f4ba-467f-9277-70f8b5717f75 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.32 time: 0.088987 Oct 08 21:05:28.777287 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1622/3320] 10.222.0.26 () {62 vars in 1200 bytes} [Sat Oct 8 21:05:28 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 91 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 08 21:05:29.029205 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-c73056f0-1e91-4d49-93f5-bfff5a6f2db6 req-40bc967c-02f4-402e-8b72-6ca3ebf27777 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62ddef97-0025-4e6d-a62e-59a824562796", "tag": "bef0ec0e-7edd-4a86-a362-d936a6a729ed"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:05:29.041649 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=3,nova_api:INSERT=4 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:05:29.044024 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-c73056f0-1e91-4d49-93f5-bfff5a6f2db6 req-40bc967c-02f4-402e-8b72-6ca3ebf27777 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:29.044726 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-c73056f0-1e91-4d49-93f5-bfff5a6f2db6 req-40bc967c-02f4-402e-8b72-6ca3ebf27777 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:29.045474 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-c73056f0-1e91-4d49-93f5-bfff5a6f2db6 req-40bc967c-02f4-402e-8b72-6ca3ebf27777 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:29.047850 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-f042e729-84d5-47f8-8b35-601023541def tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5000948fa98a4b5d96ad27436d3d0edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917519b500674698a68dc01a4e8d68a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:29.055902 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-f042e729-84d5-47f8-8b35-601023541def tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] 10.222.0.26 "GET /compute/v2.1/servers/47d524a3-cb1f-4972-9ffb-a8225135461f" status: 200 len: 1317 microversion: 2.1 time: 0.511501 Oct 08 21:05:29.065925 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1699/3321] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:05:28 2022] GET /compute/v2.1/servers/47d524a3-cb1f-4972-9ffb-a8225135461f => generated 1317 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:05:29.071687 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-c73056f0-1e91-4d49-93f5-bfff5a6f2db6 req-40bc967c-02f4-402e-8b72-6ca3ebf27777 service nova] Creating event network-changed:bef0ec0e-7edd-4a86-a362-d936a6a729ed for instance 62ddef97-0025-4e6d-a62e-59a824562796 on nch2-master-1 Oct 08 21:05:29.086536 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-5d8b48b1-80e1-401f-9fcd-a5b3f4b6532b tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:05:29.087187 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-5d8b48b1-80e1-401f-9fcd-a5b3f4b6532b tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] [instance: 58ad88cd-b5d3-4aac-ae20-857736605fa0] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:05:29.091295 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-c73056f0-1e91-4d49-93f5-bfff5a6f2db6 req-40bc967c-02f4-402e-8b72-6ca3ebf27777 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066610 Oct 08 21:05:29.092070 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1623/3322] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:05:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 08 21:05:29.102740 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5d8b48b1-80e1-401f-9fcd-a5b3f4b6532b tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:29.103820 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5d8b48b1-80e1-401f-9fcd-a5b3f4b6532b tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:29.104482 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5d8b48b1-80e1-401f-9fcd-a5b3f4b6532b tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:29.105447 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5d8b48b1-80e1-401f-9fcd-a5b3f4b6532b tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:29.106078 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5d8b48b1-80e1-401f-9fcd-a5b3f4b6532b tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:29.106877 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5d8b48b1-80e1-401f-9fcd-a5b3f4b6532b tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:29.569607 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-e4d6b096-13c5-4563-b8df-9f1d21b0d30b tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:05:29.570324 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-e4d6b096-13c5-4563-b8df-9f1d21b0d30b tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] [instance: ce4a2fbf-76f3-4577-a704-3b64ec30d84b] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:05:29.585103 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e4d6b096-13c5-4563-b8df-9f1d21b0d30b tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:29.585833 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e4d6b096-13c5-4563-b8df-9f1d21b0d30b tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:29.586449 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e4d6b096-13c5-4563-b8df-9f1d21b0d30b tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:29.587371 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e4d6b096-13c5-4563-b8df-9f1d21b0d30b tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:29.587999 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e4d6b096-13c5-4563-b8df-9f1d21b0d30b tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:29.588595 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e4d6b096-13c5-4563-b8df-9f1d21b0d30b tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:29.739384 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-5d8b48b1-80e1-401f-9fcd-a5b3f4b6532b tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c6153d58d264272a375b3169e0874d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c405aac48e9b403ca8d1e3ac28fab76e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:29.774024 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-5d8b48b1-80e1-401f-9fcd-a5b3f4b6532b tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] 10.222.0.26 "GET /compute/v2.1/servers/58ad88cd-b5d3-4aac-ae20-857736605fa0" status: 200 len: 1323 microversion: 2.1 time: 0.691335 Oct 08 21:05:29.790963 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1700/3323] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:05:29 2022] GET /compute/v2.1/servers/58ad88cd-b5d3-4aac-ae20-857736605fa0 => generated 1323 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:05:30.071631 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-e4d6b096-13c5-4563-b8df-9f1d21b0d30b tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85abb492492343c58734564a2b26c8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68b14967e8249fd886f168d366f241f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:30.083384 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-e4d6b096-13c5-4563-b8df-9f1d21b0d30b tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] 10.222.0.26 "GET /compute/v2.1/servers/ce4a2fbf-76f3-4577-a704-3b64ec30d84b" status: 200 len: 1290 microversion: 2.1 time: 0.518557 Oct 08 21:05:30.083712 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-2d342f75-364d-47a0-b517-1c89f6ee0818 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:05:30.084530 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-2d342f75-364d-47a0-b517-1c89f6ee0818 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] [instance: 47d524a3-cb1f-4972-9ffb-a8225135461f] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:05:30.098672 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1624/3324] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:05:29 2022] GET /compute/v2.1/servers/ce4a2fbf-76f3-4577-a704-3b64ec30d84b => generated 1290 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:05:30.100224 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2d342f75-364d-47a0-b517-1c89f6ee0818 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:30.101181 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2d342f75-364d-47a0-b517-1c89f6ee0818 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:30.101937 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2d342f75-364d-47a0-b517-1c89f6ee0818 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:30.102866 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2d342f75-364d-47a0-b517-1c89f6ee0818 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:30.103340 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2d342f75-364d-47a0-b517-1c89f6ee0818 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:30.103771 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2d342f75-364d-47a0-b517-1c89f6ee0818 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:30.807097 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-42edd52e-3e71-4743-894c-eab4c5e9af90 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:05:30.808183 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-42edd52e-3e71-4743-894c-eab4c5e9af90 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] [instance: 58ad88cd-b5d3-4aac-ae20-857736605fa0] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:05:30.816324 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-42edd52e-3e71-4743-894c-eab4c5e9af90 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:30.817124 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-42edd52e-3e71-4743-894c-eab4c5e9af90 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:30.817994 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-42edd52e-3e71-4743-894c-eab4c5e9af90 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:30.818981 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-42edd52e-3e71-4743-894c-eab4c5e9af90 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:30.819684 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-42edd52e-3e71-4743-894c-eab4c5e9af90 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:30.820365 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-42edd52e-3e71-4743-894c-eab4c5e9af90 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:30.833968 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-2d342f75-364d-47a0-b517-1c89f6ee0818 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5000948fa98a4b5d96ad27436d3d0edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917519b500674698a68dc01a4e8d68a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:30.850984 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-2d342f75-364d-47a0-b517-1c89f6ee0818 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] 10.222.0.26 "GET /compute/v2.1/servers/47d524a3-cb1f-4972-9ffb-a8225135461f" status: 200 len: 1317 microversion: 2.1 time: 0.771143 Oct 08 21:05:30.852869 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1701/3325] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:05:30 2022] GET /compute/v2.1/servers/47d524a3-cb1f-4972-9ffb-a8225135461f => generated 1317 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:05:31.110861 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-8fd56faa-c6fd-482f-ac96-fca582477c7a tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:05:31.111660 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-8fd56faa-c6fd-482f-ac96-fca582477c7a tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] [instance: ce4a2fbf-76f3-4577-a704-3b64ec30d84b] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:05:31.129475 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8fd56faa-c6fd-482f-ac96-fca582477c7a tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:31.130288 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8fd56faa-c6fd-482f-ac96-fca582477c7a tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:31.130869 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8fd56faa-c6fd-482f-ac96-fca582477c7a tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:31.131756 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8fd56faa-c6fd-482f-ac96-fca582477c7a tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:31.132446 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8fd56faa-c6fd-482f-ac96-fca582477c7a tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:31.133009 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8fd56faa-c6fd-482f-ac96-fca582477c7a tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:31.258207 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-8fd56faa-c6fd-482f-ac96-fca582477c7a tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85abb492492343c58734564a2b26c8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68b14967e8249fd886f168d366f241f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:31.271686 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-8fd56faa-c6fd-482f-ac96-fca582477c7a tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] 10.222.0.26 "GET /compute/v2.1/servers/ce4a2fbf-76f3-4577-a704-3b64ec30d84b" status: 200 len: 1296 microversion: 2.1 time: 0.165480 Oct 08 21:05:31.273165 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1702/3326] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:05:31 2022] GET /compute/v2.1/servers/ce4a2fbf-76f3-4577-a704-3b64ec30d84b => generated 1296 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:05:31.278674 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-b25b7c71-2e92-45e8-82b4-b86685dbe1fe req-3a996772-7bfe-4948-82a5-53b210460d52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47d524a3-cb1f-4972-9ffb-a8225135461f", "tag": "5f0872bf-ee36-4d31-b198-5c58bf1eae9e"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:05:31.293535 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-b25b7c71-2e92-45e8-82b4-b86685dbe1fe req-3a996772-7bfe-4948-82a5-53b210460d52 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:31.294031 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-b25b7c71-2e92-45e8-82b4-b86685dbe1fe req-3a996772-7bfe-4948-82a5-53b210460d52 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:31.294475 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-b25b7c71-2e92-45e8-82b4-b86685dbe1fe req-3a996772-7bfe-4948-82a5-53b210460d52 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:31.306994 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-b25b7c71-2e92-45e8-82b4-b86685dbe1fe req-3a996772-7bfe-4948-82a5-53b210460d52 service nova] Creating event network-changed:5f0872bf-ee36-4d31-b198-5c58bf1eae9e for instance 47d524a3-cb1f-4972-9ffb-a8225135461f on nch2-master-1 Oct 08 21:05:31.314818 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-b25b7c71-2e92-45e8-82b4-b86685dbe1fe req-3a996772-7bfe-4948-82a5-53b210460d52 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040044 Oct 08 21:05:31.315450 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1703/3327] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:05:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:05:31.330576 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-42edd52e-3e71-4743-894c-eab4c5e9af90 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c6153d58d264272a375b3169e0874d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c405aac48e9b403ca8d1e3ac28fab76e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:31.343170 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-42edd52e-3e71-4743-894c-eab4c5e9af90 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] 10.222.0.26 "GET /compute/v2.1/servers/58ad88cd-b5d3-4aac-ae20-857736605fa0" status: 200 len: 1323 microversion: 2.1 time: 0.539658 Oct 08 21:05:31.353282 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1625/3328] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:05:30 2022] GET /compute/v2.1/servers/58ad88cd-b5d3-4aac-ae20-857736605fa0 => generated 1323 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:05:31.876988 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-28f97d2f-6aa5-46f3-a9a1-31f1df3a2b97 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:05:31.877743 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-28f97d2f-6aa5-46f3-a9a1-31f1df3a2b97 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] [instance: 47d524a3-cb1f-4972-9ffb-a8225135461f] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:05:31.891594 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-28f97d2f-6aa5-46f3-a9a1-31f1df3a2b97 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:31.892687 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-28f97d2f-6aa5-46f3-a9a1-31f1df3a2b97 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:31.893415 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-28f97d2f-6aa5-46f3-a9a1-31f1df3a2b97 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:31.895580 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-28f97d2f-6aa5-46f3-a9a1-31f1df3a2b97 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:31.898700 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-28f97d2f-6aa5-46f3-a9a1-31f1df3a2b97 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:31.899445 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-28f97d2f-6aa5-46f3-a9a1-31f1df3a2b97 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:31.905603 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:05:32.300253 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-46f4b6ea-f53f-4ec0-9010-8eb5506c31fc tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:05:32.301915 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-46f4b6ea-f53f-4ec0-9010-8eb5506c31fc tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] [instance: ce4a2fbf-76f3-4577-a704-3b64ec30d84b] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:05:32.319526 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-46f4b6ea-f53f-4ec0-9010-8eb5506c31fc tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:32.320041 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-46f4b6ea-f53f-4ec0-9010-8eb5506c31fc tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:32.320489 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-46f4b6ea-f53f-4ec0-9010-8eb5506c31fc tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:32.323829 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-46f4b6ea-f53f-4ec0-9010-8eb5506c31fc tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:32.324315 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-46f4b6ea-f53f-4ec0-9010-8eb5506c31fc tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:32.324759 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-46f4b6ea-f53f-4ec0-9010-8eb5506c31fc tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:32.480493 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-28f97d2f-6aa5-46f3-a9a1-31f1df3a2b97 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5000948fa98a4b5d96ad27436d3d0edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917519b500674698a68dc01a4e8d68a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:32.494129 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-28f97d2f-6aa5-46f3-a9a1-31f1df3a2b97 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] 10.222.0.26 "GET /compute/v2.1/servers/47d524a3-cb1f-4972-9ffb-a8225135461f" status: 200 len: 1317 microversion: 2.1 time: 0.619052 Oct 08 21:05:32.511368 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1704/3329] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:05:31 2022] GET /compute/v2.1/servers/47d524a3-cb1f-4972-9ffb-a8225135461f => generated 1317 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:05:32.517153 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e248bee0-651b-4674-a1d4-b130fc3f8eca tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:05:32.518096 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-e248bee0-651b-4674-a1d4-b130fc3f8eca tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] [instance: 58ad88cd-b5d3-4aac-ae20-857736605fa0] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:05:32.529148 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e248bee0-651b-4674-a1d4-b130fc3f8eca tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:32.529937 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e248bee0-651b-4674-a1d4-b130fc3f8eca tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:32.530631 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e248bee0-651b-4674-a1d4-b130fc3f8eca tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:32.532217 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e248bee0-651b-4674-a1d4-b130fc3f8eca tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:32.533173 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e248bee0-651b-4674-a1d4-b130fc3f8eca tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:32.534030 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e248bee0-651b-4674-a1d4-b130fc3f8eca tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:32.557814 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-46f4b6ea-f53f-4ec0-9010-8eb5506c31fc tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85abb492492343c58734564a2b26c8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68b14967e8249fd886f168d366f241f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:32.577250 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-46f4b6ea-f53f-4ec0-9010-8eb5506c31fc tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] 10.222.0.26 "GET /compute/v2.1/servers/ce4a2fbf-76f3-4577-a704-3b64ec30d84b" status: 200 len: 1296 microversion: 2.1 time: 0.281802 Oct 08 21:05:32.579429 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1626/3330] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:05:32 2022] GET /compute/v2.1/servers/ce4a2fbf-76f3-4577-a704-3b64ec30d84b => generated 1296 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:05:32.604236 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-f6ee14c1-12c1-43f8-8593-aa75343113cc req-99c588f2-b6da-4c0b-8378-bc74aa9057af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dbacaeed-a40b-4e05-9635-5073dfdd8621", "tag": "6fe657e1-039e-4549-b2d4-955cfbaed37d"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:05:32.618330 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-f6ee14c1-12c1-43f8-8593-aa75343113cc req-99c588f2-b6da-4c0b-8378-bc74aa9057af service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:32.619233 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-f6ee14c1-12c1-43f8-8593-aa75343113cc req-99c588f2-b6da-4c0b-8378-bc74aa9057af service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:32.620331 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-f6ee14c1-12c1-43f8-8593-aa75343113cc req-99c588f2-b6da-4c0b-8378-bc74aa9057af service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:32.645365 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-f6ee14c1-12c1-43f8-8593-aa75343113cc req-99c588f2-b6da-4c0b-8378-bc74aa9057af service nova] Creating event network-changed:6fe657e1-039e-4549-b2d4-955cfbaed37d for instance dbacaeed-a40b-4e05-9635-5073dfdd8621 on nch2-master-1 Oct 08 21:05:32.654442 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-f6ee14c1-12c1-43f8-8593-aa75343113cc req-99c588f2-b6da-4c0b-8378-bc74aa9057af service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053660 Oct 08 21:05:32.655833 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1627/3331] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:05:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:05:33.140564 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-e248bee0-651b-4674-a1d4-b130fc3f8eca tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c6153d58d264272a375b3169e0874d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c405aac48e9b403ca8d1e3ac28fab76e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:33.164384 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-e248bee0-651b-4674-a1d4-b130fc3f8eca tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] 10.222.0.26 "GET /compute/v2.1/servers/58ad88cd-b5d3-4aac-ae20-857736605fa0" status: 200 len: 1323 microversion: 2.1 time: 0.651288 Oct 08 21:05:33.167268 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1705/3332] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:05:32 2022] GET /compute/v2.1/servers/58ad88cd-b5d3-4aac-ae20-857736605fa0 => generated 1323 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:05:33.520052 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-3a6a2fd7-f59f-46c9-9d21-cbc5e1ab9575 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:05:33.521763 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-3a6a2fd7-f59f-46c9-9d21-cbc5e1ab9575 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] [instance: 47d524a3-cb1f-4972-9ffb-a8225135461f] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:05:33.537324 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3a6a2fd7-f59f-46c9-9d21-cbc5e1ab9575 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:33.539128 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3a6a2fd7-f59f-46c9-9d21-cbc5e1ab9575 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:33.540104 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3a6a2fd7-f59f-46c9-9d21-cbc5e1ab9575 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:33.541501 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3a6a2fd7-f59f-46c9-9d21-cbc5e1ab9575 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:33.542270 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3a6a2fd7-f59f-46c9-9d21-cbc5e1ab9575 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:33.543473 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3a6a2fd7-f59f-46c9-9d21-cbc5e1ab9575 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:33.605517 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-9e47f2d8-4000-4f6b-807d-b91a034b6dcf tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:05:33.607148 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-9e47f2d8-4000-4f6b-807d-b91a034b6dcf tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] [instance: ce4a2fbf-76f3-4577-a704-3b64ec30d84b] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:05:33.615532 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9e47f2d8-4000-4f6b-807d-b91a034b6dcf tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:33.616361 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9e47f2d8-4000-4f6b-807d-b91a034b6dcf tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:33.618637 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9e47f2d8-4000-4f6b-807d-b91a034b6dcf tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:33.619684 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9e47f2d8-4000-4f6b-807d-b91a034b6dcf tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:33.620421 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9e47f2d8-4000-4f6b-807d-b91a034b6dcf tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:33.621105 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9e47f2d8-4000-4f6b-807d-b91a034b6dcf tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:34.040491 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-9e47f2d8-4000-4f6b-807d-b91a034b6dcf tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85abb492492343c58734564a2b26c8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68b14967e8249fd886f168d366f241f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:34.054177 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-9e47f2d8-4000-4f6b-807d-b91a034b6dcf tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] 10.222.0.26 "GET /compute/v2.1/servers/ce4a2fbf-76f3-4577-a704-3b64ec30d84b" status: 200 len: 1364 microversion: 2.1 time: 0.454050 Oct 08 21:05:34.078357 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1706/3333] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:05:33 2022] GET /compute/v2.1/servers/ce4a2fbf-76f3-4577-a704-3b64ec30d84b => generated 1364 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:05:34.093623 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-ea3be46f-b901-43a2-8362-45b12f6c3283 req-3e55ea9e-6907-4cf9-bc51-1fc13b459773 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58ad88cd-b5d3-4aac-ae20-857736605fa0", "name": "network-vif-plugged", "status": "completed", "tag": "b52b4792-7889-4b9f-ab09-74d565a895ac"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:05:34.114531 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-ea3be46f-b901-43a2-8362-45b12f6c3283 req-3e55ea9e-6907-4cf9-bc51-1fc13b459773 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:34.115515 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-ea3be46f-b901-43a2-8362-45b12f6c3283 req-3e55ea9e-6907-4cf9-bc51-1fc13b459773 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:34.120765 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-ea3be46f-b901-43a2-8362-45b12f6c3283 req-3e55ea9e-6907-4cf9-bc51-1fc13b459773 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:34.146753 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-ea3be46f-b901-43a2-8362-45b12f6c3283 req-3e55ea9e-6907-4cf9-bc51-1fc13b459773 service nova] Creating event network-vif-plugged:b52b4792-7889-4b9f-ab09-74d565a895ac for instance 58ad88cd-b5d3-4aac-ae20-857736605fa0 on nch1-master-1 Oct 08 21:05:34.165326 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-ea3be46f-b901-43a2-8362-45b12f6c3283 req-3e55ea9e-6907-4cf9-bc51-1fc13b459773 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084910 Oct 08 21:05:34.165708 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1707/3334] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:05:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:05:34.191576 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-f243595d-223e-4899-88a1-84b613b1d6e0 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:05:34.192316 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-f243595d-223e-4899-88a1-84b613b1d6e0 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] [instance: 58ad88cd-b5d3-4aac-ae20-857736605fa0] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:05:34.205819 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f243595d-223e-4899-88a1-84b613b1d6e0 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:34.208507 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f243595d-223e-4899-88a1-84b613b1d6e0 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:34.208975 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f243595d-223e-4899-88a1-84b613b1d6e0 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:34.211561 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f243595d-223e-4899-88a1-84b613b1d6e0 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:34.214555 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f243595d-223e-4899-88a1-84b613b1d6e0 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:34.216903 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f243595d-223e-4899-88a1-84b613b1d6e0 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:34.319294 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-3a6a2fd7-f59f-46c9-9d21-cbc5e1ab9575 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5000948fa98a4b5d96ad27436d3d0edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917519b500674698a68dc01a4e8d68a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:34.331958 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-3a6a2fd7-f59f-46c9-9d21-cbc5e1ab9575 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] 10.222.0.26 "GET /compute/v2.1/servers/47d524a3-cb1f-4972-9ffb-a8225135461f" status: 200 len: 1317 microversion: 2.1 time: 0.817085 Oct 08 21:05:34.332635 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1628/3335] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:05:33 2022] GET /compute/v2.1/servers/47d524a3-cb1f-4972-9ffb-a8225135461f => generated 1317 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:05:35.084354 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-61f0f3a5-31bf-428a-a29d-f0e929414774 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:05:35.085476 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-61f0f3a5-31bf-428a-a29d-f0e929414774 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] [instance: ce4a2fbf-76f3-4577-a704-3b64ec30d84b] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:05:35.097664 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-61f0f3a5-31bf-428a-a29d-f0e929414774 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:35.107022 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-61f0f3a5-31bf-428a-a29d-f0e929414774 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:35.108122 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-61f0f3a5-31bf-428a-a29d-f0e929414774 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:35.111125 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-61f0f3a5-31bf-428a-a29d-f0e929414774 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:35.111806 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-61f0f3a5-31bf-428a-a29d-f0e929414774 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:35.113716 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-61f0f3a5-31bf-428a-a29d-f0e929414774 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:35.436829 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-f243595d-223e-4899-88a1-84b613b1d6e0 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c6153d58d264272a375b3169e0874d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c405aac48e9b403ca8d1e3ac28fab76e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:35.446048 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-f243595d-223e-4899-88a1-84b613b1d6e0 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] 10.222.0.26 "GET /compute/v2.1/servers/58ad88cd-b5d3-4aac-ae20-857736605fa0" status: 200 len: 1323 microversion: 2.1 time: 1.259882 Oct 08 21:05:35.455772 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1708/3336] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:05:34 2022] GET /compute/v2.1/servers/58ad88cd-b5d3-4aac-ae20-857736605fa0 => generated 1323 bytes in 1270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:05:35.468422 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-cc32b9bb-0f4a-4f63-b10c-3160daba7f41 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:05:35.469998 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-cc32b9bb-0f4a-4f63-b10c-3160daba7f41 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] [instance: 47d524a3-cb1f-4972-9ffb-a8225135461f] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:05:35.479884 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cc32b9bb-0f4a-4f63-b10c-3160daba7f41 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:35.481799 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cc32b9bb-0f4a-4f63-b10c-3160daba7f41 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:35.483035 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cc32b9bb-0f4a-4f63-b10c-3160daba7f41 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:35.485100 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cc32b9bb-0f4a-4f63-b10c-3160daba7f41 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:35.486555 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cc32b9bb-0f4a-4f63-b10c-3160daba7f41 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:35.487161 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cc32b9bb-0f4a-4f63-b10c-3160daba7f41 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:35.925771 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-cc32b9bb-0f4a-4f63-b10c-3160daba7f41 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5000948fa98a4b5d96ad27436d3d0edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917519b500674698a68dc01a4e8d68a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:35.934374 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-cc32b9bb-0f4a-4f63-b10c-3160daba7f41 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] 10.222.0.26 "GET /compute/v2.1/servers/47d524a3-cb1f-4972-9ffb-a8225135461f" status: 200 len: 1317 microversion: 2.1 time: 0.477428 Oct 08 21:05:35.945883 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1709/3337] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:05:35 2022] GET /compute/v2.1/servers/47d524a3-cb1f-4972-9ffb-a8225135461f => generated 1317 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:05:36.472468 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-25979387-654b-468c-a47f-7dd4c7717e89 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:05:36.473265 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-25979387-654b-468c-a47f-7dd4c7717e89 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] [instance: 58ad88cd-b5d3-4aac-ae20-857736605fa0] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:05:36.491211 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-25979387-654b-468c-a47f-7dd4c7717e89 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:36.492078 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-25979387-654b-468c-a47f-7dd4c7717e89 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:36.492751 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-25979387-654b-468c-a47f-7dd4c7717e89 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:36.493728 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-25979387-654b-468c-a47f-7dd4c7717e89 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:36.494397 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-25979387-654b-468c-a47f-7dd4c7717e89 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:36.495055 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-25979387-654b-468c-a47f-7dd4c7717e89 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:36.536112 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=2 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:05:36.627160 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-61f0f3a5-31bf-428a-a29d-f0e929414774 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85abb492492343c58734564a2b26c8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68b14967e8249fd886f168d366f241f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:36.636009 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-61f0f3a5-31bf-428a-a29d-f0e929414774 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] 10.222.0.26 "GET /compute/v2.1/servers/ce4a2fbf-76f3-4577-a704-3b64ec30d84b" status: 200 len: 1364 microversion: 2.1 time: 1.555654 Oct 08 21:05:36.650949 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1629/3338] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:05:35 2022] GET /compute/v2.1/servers/ce4a2fbf-76f3-4577-a704-3b64ec30d84b => generated 1364 bytes in 1571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:05:36.878445 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-25979387-654b-468c-a47f-7dd4c7717e89 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c6153d58d264272a375b3169e0874d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c405aac48e9b403ca8d1e3ac28fab76e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:36.886952 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-25979387-654b-468c-a47f-7dd4c7717e89 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] 10.222.0.26 "GET /compute/v2.1/servers/58ad88cd-b5d3-4aac-ae20-857736605fa0" status: 200 len: 1519 microversion: 2.1 time: 0.418852 Oct 08 21:05:36.887532 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1710/3339] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:05:36 2022] GET /compute/v2.1/servers/58ad88cd-b5d3-4aac-ae20-857736605fa0 => generated 1519 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:05:36.911862 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-78d4350c-7c11-4605-9d01-979acb9292ff tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.5.73"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:05:36.914586 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-78d4350c-7c11-4605-9d01-979acb9292ff tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] [instance: de9d6639-040b-44b7-b00a-c1022c705c89] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:05:36.927704 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-78d4350c-7c11-4605-9d01-979acb9292ff tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:36.930681 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-78d4350c-7c11-4605-9d01-979acb9292ff tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:36.931087 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-78d4350c-7c11-4605-9d01-979acb9292ff tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:36.933403 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-78d4350c-7c11-4605-9d01-979acb9292ff tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:36.936517 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-78d4350c-7c11-4605-9d01-979acb9292ff tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:36.937211 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-78d4350c-7c11-4605-9d01-979acb9292ff tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:36.974606 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-ad7ebb22-5b9e-4c12-8dbe-66e6980ce713 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:05:36.974606 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-ad7ebb22-5b9e-4c12-8dbe-66e6980ce713 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] [instance: 47d524a3-cb1f-4972-9ffb-a8225135461f] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:05:36.986625 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ad7ebb22-5b9e-4c12-8dbe-66e6980ce713 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:36.987132 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ad7ebb22-5b9e-4c12-8dbe-66e6980ce713 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:36.987610 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ad7ebb22-5b9e-4c12-8dbe-66e6980ce713 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:36.988320 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ad7ebb22-5b9e-4c12-8dbe-66e6980ce713 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:36.988788 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ad7ebb22-5b9e-4c12-8dbe-66e6980ce713 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:36.989248 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ad7ebb22-5b9e-4c12-8dbe-66e6980ce713 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:37.011327 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-78d4350c-7c11-4605-9d01-979acb9292ff tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Acquiring lock "refresh_cache-de9d6639-040b-44b7-b00a-c1022c705c89" {{(pid=140491) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 08 21:05:37.011746 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-78d4350c-7c11-4605-9d01-979acb9292ff tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Acquired lock "refresh_cache-de9d6639-040b-44b7-b00a-c1022c705c89" {{(pid=140491) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 08 21:05:37.189805 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=2 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:05:37.385439 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-ad7ebb22-5b9e-4c12-8dbe-66e6980ce713 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5000948fa98a4b5d96ad27436d3d0edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917519b500674698a68dc01a4e8d68a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:37.395704 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-ad7ebb22-5b9e-4c12-8dbe-66e6980ce713 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] 10.222.0.26 "GET /compute/v2.1/servers/47d524a3-cb1f-4972-9ffb-a8225135461f" status: 200 len: 1317 microversion: 2.1 time: 0.431238 Oct 08 21:05:37.396580 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1711/3340] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:05:36 2022] GET /compute/v2.1/servers/47d524a3-cb1f-4972-9ffb-a8225135461f => generated 1317 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:05:37.401816 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-205f44bf-3f3e-4a11-aac3-ef78becaeea8 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1253096750", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "dd648fca-3938-4422-8838-865b5b1b3864"}, {"port": "9cbc0e0f-a528-4d53-9896-a83c004068d1", "tag": "port-1"}, {"port": "2a5f9012-714b-4b2f-b172-487879914396", "tag": "port-2"}, {"uuid": "221c6623-d183-4367-a70a-ecd4e3d90ea6", "tag": "net-1"}, {"uuid": "221c6623-d183-4367-a70a-ecd4e3d90ea6"}, {"uuid": "06ff48b2-e06b-4692-bbdc-3fa023f8601a", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "06ff48b2-e06b-4692-bbdc-3fa023f8601a", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "d9c63c96-d67e-46bf-97d4-00d738c11e05", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "a86c82f7-9354-427c-b8fd-facabded1ea9", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "1082d721-8d03-4d1a-a930-7e3c44810f2d", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1416222916"}], "key_name": "tempest-keypair-554567182", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:05:37.917411 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.network.neutron [None req-205f44bf-3f3e-4a11-aac3-ef78becaeea8 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] validate_networks() for [('dd648fca-3938-4422-8838-865b5b1b3864', None, None, None, None, None), (None, None, '9cbc0e0f-a528-4d53-9896-a83c004068d1', None, None, None), (None, None, '2a5f9012-714b-4b2f-b172-487879914396', None, None, None), ('221c6623-d183-4367-a70a-ecd4e3d90ea6', None, None, None, None, None), ('221c6623-d183-4367-a70a-ecd4e3d90ea6', None, None, None, None, None), ('06ff48b2-e06b-4692-bbdc-3fa023f8601a', '10.2.2.100', None, None, None, None), ('06ff48b2-e06b-4692-bbdc-3fa023f8601a', '10.2.2.200', None, None, None, None)] {{(pid=140492) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 21:05:38.747802 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=20 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:05:40.943210 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.network.neutron [None req-78d4350c-7c11-4605-9d01-979acb9292ff tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] [instance: de9d6639-040b-44b7-b00a-c1022c705c89] Building network info cache for instance {{(pid=140491) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 08 21:05:42.661011 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.network.neutron [None req-78d4350c-7c11-4605-9d01-979acb9292ff tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] [instance: de9d6639-040b-44b7-b00a-c1022c705c89] Updating instance_info_cache with network_info: [{"id": "ca9cb617-2f51-474b-b74d-d32ecd4a80b9", "address": "fa:16:3e:fd:94:07", "network": {"id": "b449bb70-491a-439e-8976-e26644902f7a", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-134175099-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.5.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "c405aac48e9b403ca8d1e3ac28fab76e", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapca9cb617-2f", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=140491) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 08 21:05:42.678963 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-78d4350c-7c11-4605-9d01-979acb9292ff tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Releasing lock "refresh_cache-de9d6639-040b-44b7-b00a-c1022c705c89" {{(pid=140491) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 08 21:05:42.680162 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-78d4350c-7c11-4605-9d01-979acb9292ff tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] 10.222.0.26 "POST /compute/v2.1/servers/de9d6639-040b-44b7-b00a-c1022c705c89/action" status: 202 len: 0 microversion: 2.1 time: 5.772867 Oct 08 21:05:42.680893 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1630/3341] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:05:36 2022] POST /compute/v2.1/servers/de9d6639-040b-44b7-b00a-c1022c705c89/action => generated 0 bytes in 5774 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 08 21:05:42.692088 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-e5725aae-a65a-46e6-bac1-0f38e4404393 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:05:42.696857 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-e5725aae-a65a-46e6-bac1-0f38e4404393 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] [instance: ce4a2fbf-76f3-4577-a704-3b64ec30d84b] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:05:42.707951 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e5725aae-a65a-46e6-bac1-0f38e4404393 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:42.708350 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e5725aae-a65a-46e6-bac1-0f38e4404393 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:42.708702 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e5725aae-a65a-46e6-bac1-0f38e4404393 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:42.714766 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e5725aae-a65a-46e6-bac1-0f38e4404393 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:42.715290 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e5725aae-a65a-46e6-bac1-0f38e4404393 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:42.717610 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e5725aae-a65a-46e6-bac1-0f38e4404393 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:43.050212 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-e5725aae-a65a-46e6-bac1-0f38e4404393 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85abb492492343c58734564a2b26c8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68b14967e8249fd886f168d366f241f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:43.058347 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-e5725aae-a65a-46e6-bac1-0f38e4404393 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] 10.222.0.26 "GET /compute/v2.1/servers/ce4a2fbf-76f3-4577-a704-3b64ec30d84b" status: 200 len: 1364 microversion: 2.1 time: 0.376207 Oct 08 21:05:43.059526 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1631/3342] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:05:42 2022] GET /compute/v2.1/servers/ce4a2fbf-76f3-4577-a704-3b64ec30d84b => generated 1364 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:05:43.067021 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-588f1163-1f8f-445a-a647-3198e298abf7 req-e4255e88-6c29-41b8-9777-2911c925c592 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62ddef97-0025-4e6d-a62e-59a824562796", "name": "network-vif-plugged", "status": "completed", "tag": "bef0ec0e-7edd-4a86-a362-d936a6a729ed"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:05:43.092137 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-588f1163-1f8f-445a-a647-3198e298abf7 req-e4255e88-6c29-41b8-9777-2911c925c592 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:43.092630 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-588f1163-1f8f-445a-a647-3198e298abf7 req-e4255e88-6c29-41b8-9777-2911c925c592 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:43.093068 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-588f1163-1f8f-445a-a647-3198e298abf7 req-e4255e88-6c29-41b8-9777-2911c925c592 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:43.130006 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-588f1163-1f8f-445a-a647-3198e298abf7 req-e4255e88-6c29-41b8-9777-2911c925c592 service nova] Creating event network-vif-plugged:bef0ec0e-7edd-4a86-a362-d936a6a729ed for instance 62ddef97-0025-4e6d-a62e-59a824562796 on nch2-master-1 Oct 08 21:05:43.136694 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-588f1163-1f8f-445a-a647-3198e298abf7 req-e4255e88-6c29-41b8-9777-2911c925c592 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076522 Oct 08 21:05:43.137859 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1632/3343] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:05:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:05:43.143964 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-7bbe758a-d344-4e5d-ba6e-f4a96f2c428f req-207ffec6-492c-4edd-a0db-f9fd6c13a166 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce4a2fbf-76f3-4577-a704-3b64ec30d84b", "tag": "0ad7b806-8ee9-493c-a2da-3f9bc61bb980"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:05:43.195067 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-7bbe758a-d344-4e5d-ba6e-f4a96f2c428f req-207ffec6-492c-4edd-a0db-f9fd6c13a166 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:43.199624 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-7bbe758a-d344-4e5d-ba6e-f4a96f2c428f req-207ffec6-492c-4edd-a0db-f9fd6c13a166 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:43.200367 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-7bbe758a-d344-4e5d-ba6e-f4a96f2c428f req-207ffec6-492c-4edd-a0db-f9fd6c13a166 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:43.217854 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-205f44bf-3f3e-4a11-aac3-ef78becaeea8 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Flavor limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 21:05:43.218342 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-205f44bf-3f3e-4a11-aac3-ef78becaeea8 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Image limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 21:05:43.219407 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-205f44bf-3f3e-4a11-aac3-ef78becaeea8 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Flavor pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 21:05:43.228713 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-205f44bf-3f3e-4a11-aac3-ef78becaeea8 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Image pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 21:05:43.230205 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-205f44bf-3f3e-4a11-aac3-ef78becaeea8 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 21:05:43.237845 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-7bbe758a-d344-4e5d-ba6e-f4a96f2c428f req-207ffec6-492c-4edd-a0db-f9fd6c13a166 service nova] Creating event network-changed:0ad7b806-8ee9-493c-a2da-3f9bc61bb980 for instance ce4a2fbf-76f3-4577-a704-3b64ec30d84b on nch1-master-1 Oct 08 21:05:43.244202 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-7bbe758a-d344-4e5d-ba6e-f4a96f2c428f req-207ffec6-492c-4edd-a0db-f9fd6c13a166 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103934 Oct 08 21:05:43.245875 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1633/3344] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:05:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:05:43.256015 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-351968e3-5392-4483-af29-19c339ae2412 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:05:43.256223 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-205f44bf-3f3e-4a11-aac3-ef78becaeea8 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:43.257224 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-205f44bf-3f3e-4a11-aac3-ef78becaeea8 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:43.257401 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-351968e3-5392-4483-af29-19c339ae2412 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] [instance: 47d524a3-cb1f-4972-9ffb-a8225135461f] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:05:43.258117 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-205f44bf-3f3e-4a11-aac3-ef78becaeea8 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:43.259759 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-205f44bf-3f3e-4a11-aac3-ef78becaeea8 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:43.260820 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-205f44bf-3f3e-4a11-aac3-ef78becaeea8 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:43.261857 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-205f44bf-3f3e-4a11-aac3-ef78becaeea8 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:43.266789 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-351968e3-5392-4483-af29-19c339ae2412 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:43.267525 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-351968e3-5392-4483-af29-19c339ae2412 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:43.268133 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-351968e3-5392-4483-af29-19c339ae2412 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:43.269024 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-351968e3-5392-4483-af29-19c339ae2412 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:43.269726 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-351968e3-5392-4483-af29-19c339ae2412 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:43.270326 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-351968e3-5392-4483-af29-19c339ae2412 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:43.316576 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-205f44bf-3f3e-4a11-aac3-ef78becaeea8 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Getting quotas for project 22f2d56477794f8ab38b8e3535b3e8dc. Resources: {'cores', 'instances', 'ram'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:05:43.325329 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-205f44bf-3f3e-4a11-aac3-ef78becaeea8 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Getting quotas for user fc2bdd169daf4a1db830b1fa7f94f0b2 and project 22f2d56477794f8ab38b8e3535b3e8dc. Resources: {'cores', 'instances', 'ram'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:05:43.640799 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-205f44bf-3f3e-4a11-aac3-ef78becaeea8 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Going to run 1 instances... {{(pid=140492) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 21:05:43.644430 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-205f44bf-3f3e-4a11-aac3-ef78becaeea8 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] [instance: 4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='d9c63c96-d67e-46bf-97d4-00d738c11e05',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='a86c82f7-9354-427c-b8fd-facabded1ea9',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1082d721-8d03-4d1a-a930-7e3c44810f2d',volume_size=None,volume_type=None)] {{(pid=140492) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 21:05:43.705304 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-351968e3-5392-4483-af29-19c339ae2412 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5000948fa98a4b5d96ad27436d3d0edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917519b500674698a68dc01a4e8d68a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:43.714645 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-351968e3-5392-4483-af29-19c339ae2412 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] 10.222.0.26 "GET /compute/v2.1/servers/47d524a3-cb1f-4972-9ffb-a8225135461f" status: 200 len: 1317 microversion: 2.1 time: 0.467206 Oct 08 21:05:43.715650 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1634/3345] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:05:43 2022] GET /compute/v2.1/servers/47d524a3-cb1f-4972-9ffb-a8225135461f => generated 1317 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:05:44.250377 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-877d3448-2b7d-4ebe-847f-7c0d58c6b60f tempest-FloatingIPsTestJSON-86978126 tempest-FloatingIPsTestJSON-86978126-project] Action: 'create', calling method: .version_select at 0x7f1a914cbd30>, body: {"pool": null} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:05:44.304648 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-205f44bf-3f3e-4a11-aac3-ef78becaeea8 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.32 time: 6.906672 Oct 08 21:05:44.306082 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1712/3346] 10.222.0.26 () {62 vars in 1189 bytes} [Sat Oct 8 21:05:37 2022] POST /compute/v2.1/servers => generated 406 bytes in 6909 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 08 21:05:44.311808 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-34a61a41-3c6f-46ba-a909-c64b0aad940a tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.5.73"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:05:44.315445 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-34a61a41-3c6f-46ba-a909-c64b0aad940a tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] [instance: 58ad88cd-b5d3-4aac-ae20-857736605fa0] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:05:44.323253 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-34a61a41-3c6f-46ba-a909-c64b0aad940a tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:44.324397 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-34a61a41-3c6f-46ba-a909-c64b0aad940a tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:44.325081 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-34a61a41-3c6f-46ba-a909-c64b0aad940a tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:44.326093 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-34a61a41-3c6f-46ba-a909-c64b0aad940a tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:44.326784 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-34a61a41-3c6f-46ba-a909-c64b0aad940a tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:44.327460 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-34a61a41-3c6f-46ba-a909-c64b0aad940a tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:44.359645 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-34a61a41-3c6f-46ba-a909-c64b0aad940a tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Acquiring lock "refresh_cache-58ad88cd-b5d3-4aac-ae20-857736605fa0" {{(pid=140492) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 08 21:05:44.360431 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-34a61a41-3c6f-46ba-a909-c64b0aad940a tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Acquired lock "refresh_cache-58ad88cd-b5d3-4aac-ae20-857736605fa0" {{(pid=140492) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 08 21:05:48.074231 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.network.neutron [None req-34a61a41-3c6f-46ba-a909-c64b0aad940a tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] [instance: 58ad88cd-b5d3-4aac-ae20-857736605fa0] re-assign floating IP 172.35.5.73 from instance de9d6639-040b-44b7-b00a-c1022c705c89 Oct 08 21:05:48.147820 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.network.neutron [None req-34a61a41-3c6f-46ba-a909-c64b0aad940a tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] [instance: de9d6639-040b-44b7-b00a-c1022c705c89] Building network info cache for instance {{(pid=140492) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 08 21:05:49.112364 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.network.neutron [None req-34a61a41-3c6f-46ba-a909-c64b0aad940a tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] [instance: de9d6639-040b-44b7-b00a-c1022c705c89] Updating instance_info_cache with network_info: [{"id": "ca9cb617-2f51-474b-b74d-d32ecd4a80b9", "address": "fa:16:3e:fd:94:07", "network": {"id": "b449bb70-491a-439e-8976-e26644902f7a", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-134175099-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "c405aac48e9b403ca8d1e3ac28fab76e", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapca9cb617-2f", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=140492) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 08 21:05:49.130025 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.network.neutron [None req-34a61a41-3c6f-46ba-a909-c64b0aad940a tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] [instance: 58ad88cd-b5d3-4aac-ae20-857736605fa0] Building network info cache for instance {{(pid=140492) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 08 21:05:49.964683 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-877d3448-2b7d-4ebe-847f-7c0d58c6b60f tempest-FloatingIPsTestJSON-86978126 tempest-FloatingIPsTestJSON-86978126-project] 10.222.0.26 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 6.247708 Oct 08 21:05:49.966057 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1635/3347] 10.222.0.26 () {60 vars in 1170 bytes} [Sat Oct 8 21:05:43 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 6250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:05:49.973744 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-0a7adb81-d113-48c2-8a89-bba5ad9dd67d tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:05:49.975656 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-0a7adb81-d113-48c2-8a89-bba5ad9dd67d tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] [instance: ce4a2fbf-76f3-4577-a704-3b64ec30d84b] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:05:50.013667 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0a7adb81-d113-48c2-8a89-bba5ad9dd67d tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:50.018716 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0a7adb81-d113-48c2-8a89-bba5ad9dd67d tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:50.019721 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0a7adb81-d113-48c2-8a89-bba5ad9dd67d tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:50.023021 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0a7adb81-d113-48c2-8a89-bba5ad9dd67d tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:50.023797 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0a7adb81-d113-48c2-8a89-bba5ad9dd67d tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:50.024588 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0a7adb81-d113-48c2-8a89-bba5ad9dd67d tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:50.444090 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-0a7adb81-d113-48c2-8a89-bba5ad9dd67d tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85abb492492343c58734564a2b26c8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68b14967e8249fd886f168d366f241f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:50.457977 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-0a7adb81-d113-48c2-8a89-bba5ad9dd67d tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] 10.222.0.26 "GET /compute/v2.1/servers/ce4a2fbf-76f3-4577-a704-3b64ec30d84b" status: 200 len: 1364 microversion: 2.1 time: 0.490155 Oct 08 21:05:50.458808 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1636/3348] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:05:49 2022] GET /compute/v2.1/servers/ce4a2fbf-76f3-4577-a704-3b64ec30d84b => generated 1364 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:05:50.484348 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-06b79391-e6a7-44f7-b5c1-cce38a546e13 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:05:50.485811 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-06b79391-e6a7-44f7-b5c1-cce38a546e13 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] [instance: 4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:05:50.501718 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-06b79391-e6a7-44f7-b5c1-cce38a546e13 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:50.505535 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-06b79391-e6a7-44f7-b5c1-cce38a546e13 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:50.507354 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-06b79391-e6a7-44f7-b5c1-cce38a546e13 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:50.509993 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-06b79391-e6a7-44f7-b5c1-cce38a546e13 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:50.511744 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-06b79391-e6a7-44f7-b5c1-cce38a546e13 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:50.513772 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-06b79391-e6a7-44f7-b5c1-cce38a546e13 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:50.549719 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.network.neutron [None req-34a61a41-3c6f-46ba-a909-c64b0aad940a tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] [instance: 58ad88cd-b5d3-4aac-ae20-857736605fa0] Updating instance_info_cache with network_info: [{"id": "b52b4792-7889-4b9f-ab09-74d565a895ac", "address": "fa:16:3e:0a:68:47", "network": {"id": "b449bb70-491a-439e-8976-e26644902f7a", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-134175099-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.5.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "c405aac48e9b403ca8d1e3ac28fab76e", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapb52b4792-78", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=140492) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 08 21:05:50.571439 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-34a61a41-3c6f-46ba-a909-c64b0aad940a tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Releasing lock "refresh_cache-58ad88cd-b5d3-4aac-ae20-857736605fa0" {{(pid=140492) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 08 21:05:50.572843 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-34a61a41-3c6f-46ba-a909-c64b0aad940a tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] 10.222.0.26 "POST /compute/v2.1/servers/58ad88cd-b5d3-4aac-ae20-857736605fa0/action" status: 202 len: 0 microversion: 2.1 time: 6.265143 Oct 08 21:05:50.573761 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1713/3349] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:05:44 2022] POST /compute/v2.1/servers/58ad88cd-b5d3-4aac-ae20-857736605fa0/action => generated 0 bytes in 6267 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 08 21:05:50.588589 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-d24f618d-4ed3-4e72-a7c8-5cd86cb82dfd tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:05:50.595263 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-d24f618d-4ed3-4e72-a7c8-5cd86cb82dfd tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] [instance: 47d524a3-cb1f-4972-9ffb-a8225135461f] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:05:50.614688 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d24f618d-4ed3-4e72-a7c8-5cd86cb82dfd tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:50.615244 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d24f618d-4ed3-4e72-a7c8-5cd86cb82dfd tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:50.615737 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d24f618d-4ed3-4e72-a7c8-5cd86cb82dfd tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:50.616484 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d24f618d-4ed3-4e72-a7c8-5cd86cb82dfd tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:50.626288 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d24f618d-4ed3-4e72-a7c8-5cd86cb82dfd tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:50.626762 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d24f618d-4ed3-4e72-a7c8-5cd86cb82dfd tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:50.739054 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-06b79391-e6a7-44f7-b5c1-cce38a546e13 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc2bdd169daf4a1db830b1fa7f94f0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f2d56477794f8ab38b8e3535b3e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:50.754242 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-06b79391-e6a7-44f7-b5c1-cce38a546e13 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc2bdd169daf4a1db830b1fa7f94f0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f2d56477794f8ab38b8e3535b3e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:50.756035 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-06b79391-e6a7-44f7-b5c1-cce38a546e13 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc2bdd169daf4a1db830b1fa7f94f0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f2d56477794f8ab38b8e3535b3e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:50.757248 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-06b79391-e6a7-44f7-b5c1-cce38a546e13 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] 10.222.0.26 "GET /compute/v2.1/servers/4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21" status: 200 len: 1593 microversion: 2.32 time: 0.289492 Oct 08 21:05:50.757826 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1637/3350] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:05:50 2022] GET /compute/v2.1/servers/4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21 => generated 1593 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:05:50.771284 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-4cce9df8-a99b-47c2-81e7-508e554ef9fc req-c56fda8d-85ba-46fc-9dbd-eef24ffe87ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47d524a3-cb1f-4972-9ffb-a8225135461f", "name": "network-vif-plugged", "status": "completed", "tag": "5f0872bf-ee36-4d31-b198-5c58bf1eae9e"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:05:50.782731 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-4cce9df8-a99b-47c2-81e7-508e554ef9fc req-c56fda8d-85ba-46fc-9dbd-eef24ffe87ee service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:50.783726 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-4cce9df8-a99b-47c2-81e7-508e554ef9fc req-c56fda8d-85ba-46fc-9dbd-eef24ffe87ee service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:50.784332 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-4cce9df8-a99b-47c2-81e7-508e554ef9fc req-c56fda8d-85ba-46fc-9dbd-eef24ffe87ee service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:50.797339 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-4cce9df8-a99b-47c2-81e7-508e554ef9fc req-c56fda8d-85ba-46fc-9dbd-eef24ffe87ee service nova] Creating event network-vif-plugged:5f0872bf-ee36-4d31-b198-5c58bf1eae9e for instance 47d524a3-cb1f-4972-9ffb-a8225135461f on nch2-master-1 Oct 08 21:05:50.810000 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-4cce9df8-a99b-47c2-81e7-508e554ef9fc req-c56fda8d-85ba-46fc-9dbd-eef24ffe87ee service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047401 Oct 08 21:05:50.810633 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1638/3351] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:05:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:05:50.831999 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-0fd23934-a156-4c52-936f-6a2a8844a047 req-bc01261e-d9ad-41cf-acb8-7c176f1e617d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de9d6639-040b-44b7-b00a-c1022c705c89", "tag": "ca9cb617-2f51-474b-b74d-d32ecd4a80b9"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:05:50.856022 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-0fd23934-a156-4c52-936f-6a2a8844a047 req-bc01261e-d9ad-41cf-acb8-7c176f1e617d service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:50.868873 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-0fd23934-a156-4c52-936f-6a2a8844a047 req-bc01261e-d9ad-41cf-acb8-7c176f1e617d service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:50.869841 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-0fd23934-a156-4c52-936f-6a2a8844a047 req-bc01261e-d9ad-41cf-acb8-7c176f1e617d service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:50.884651 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-0fd23934-a156-4c52-936f-6a2a8844a047 req-bc01261e-d9ad-41cf-acb8-7c176f1e617d service nova] Creating event network-changed:ca9cb617-2f51-474b-b74d-d32ecd4a80b9 for instance de9d6639-040b-44b7-b00a-c1022c705c89 on nch1-master-1 Oct 08 21:05:50.891469 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-0fd23934-a156-4c52-936f-6a2a8844a047 req-bc01261e-d9ad-41cf-acb8-7c176f1e617d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072418 Oct 08 21:05:50.892659 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1639/3352] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:05:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:05:50.899051 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-3273d193-ac12-4f4b-bd85-533c3822653f req-9db7019a-9146-4307-a02d-475a741124dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de9d6639-040b-44b7-b00a-c1022c705c89", "tag": "ca9cb617-2f51-474b-b74d-d32ecd4a80b9"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:05:50.913429 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-3273d193-ac12-4f4b-bd85-533c3822653f req-9db7019a-9146-4307-a02d-475a741124dd service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:50.914219 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-3273d193-ac12-4f4b-bd85-533c3822653f req-9db7019a-9146-4307-a02d-475a741124dd service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:50.914881 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-3273d193-ac12-4f4b-bd85-533c3822653f req-9db7019a-9146-4307-a02d-475a741124dd service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:50.931391 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-3273d193-ac12-4f4b-bd85-533c3822653f req-9db7019a-9146-4307-a02d-475a741124dd service nova] Creating event network-changed:ca9cb617-2f51-474b-b74d-d32ecd4a80b9 for instance de9d6639-040b-44b7-b00a-c1022c705c89 on nch1-master-1 Oct 08 21:05:50.939237 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-3273d193-ac12-4f4b-bd85-533c3822653f req-9db7019a-9146-4307-a02d-475a741124dd service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044728 Oct 08 21:05:50.940157 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1640/3353] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:05:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:05:50.975902 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-d24f618d-4ed3-4e72-a7c8-5cd86cb82dfd tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5000948fa98a4b5d96ad27436d3d0edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917519b500674698a68dc01a4e8d68a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:50.991390 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-d24f618d-4ed3-4e72-a7c8-5cd86cb82dfd tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] 10.222.0.26 "GET /compute/v2.1/servers/47d524a3-cb1f-4972-9ffb-a8225135461f" status: 200 len: 1317 microversion: 2.1 time: 0.414900 Oct 08 21:05:50.992267 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1714/3354] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:05:50 2022] GET /compute/v2.1/servers/47d524a3-cb1f-4972-9ffb-a8225135461f => generated 1317 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:05:50.998285 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-b04bda1a-7498-4fea-bc4b-296e877fc78e tempest-FloatingIPsTestJSON-86978126 tempest-FloatingIPsTestJSON-86978126-project] Calling method '.version_select at 0x7f1a913f4160>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:05:51.431442 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-b04bda1a-7498-4fea-bc4b-296e877fc78e tempest-FloatingIPsTestJSON-86978126 tempest-FloatingIPsTestJSON-86978126-project] 10.222.0.26 "GET /compute/v2.1/os-floating-ips/7be3b611-57db-421f-87f7-778f6f1d3e20" status: 200 len: 142 microversion: 2.1 time: 0.436032 Oct 08 21:05:51.433249 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1715/3355] 10.222.0.26 () {58 vars in 1260 bytes} [Sat Oct 8 21:05:50 2022] GET /compute/v2.1/os-floating-ips/7be3b611-57db-421f-87f7-778f6f1d3e20 => generated 142 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:05:51.446924 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-3da12d31-f6b3-4f77-ab39-5755dbdc1fe3 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.5.73"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:05:51.602391 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-34c4222d-a781-4253-beda-8341afcc354f tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-1681644547", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "networks": [{"uuid": "983c5654-1828-48da-a871-2028e691f4b0"}]}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:05:51.692130 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.network.neutron [None req-34c4222d-a781-4253-beda-8341afcc354f tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] validate_networks() for [('983c5654-1828-48da-a871-2028e691f4b0', None, None, None, None, None)] {{(pid=140491) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 21:05:51.742385 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-3da12d31-f6b3-4f77-ab39-5755dbdc1fe3 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] [instance: 58ad88cd-b5d3-4aac-ae20-857736605fa0] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:05:51.755675 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3da12d31-f6b3-4f77-ab39-5755dbdc1fe3 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:51.756434 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3da12d31-f6b3-4f77-ab39-5755dbdc1fe3 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:51.758908 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3da12d31-f6b3-4f77-ab39-5755dbdc1fe3 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:51.760702 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3da12d31-f6b3-4f77-ab39-5755dbdc1fe3 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:51.761406 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3da12d31-f6b3-4f77-ab39-5755dbdc1fe3 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:51.762989 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3da12d31-f6b3-4f77-ab39-5755dbdc1fe3 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:52.150606 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-3da12d31-f6b3-4f77-ab39-5755dbdc1fe3 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] HTTP exception thrown: Floating IP 172.35.5.73 is not associated with instance de9d6639-040b-44b7-b00a-c1022c705c89. Oct 08 21:05:52.153376 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-3da12d31-f6b3-4f77-ab39-5755dbdc1fe3 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Request method failure captured: Oct 08 21:05:52.153376 ncdv-master-1 devstack@n-api.service[140492]: request: POST /compute/v2.1/servers/de9d6639-040b-44b7-b00a-c1022c705c89/action HTTP/1.1 Oct 08 21:05:52.153376 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:05:52.153376 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:05:52.153376 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:05:52.153376 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 48 Oct 08 21:05:52.153376 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:05:52.153376 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:05:52.153376 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:05:52.153376 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:05:52.153376 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeXi16tkz_i1i7XbkgwY21JByktYX4GDP2nafLDfRJ1Rxq_b8BRtnCkaucvQt5-aBmzBGGT0K7woxgqPe_-7FRNV3MYD__u7v5IA0oeJ8DXdW7CG-IicMcSS5pGOZ95X2MGqNk7LSfwuDAJhCMfRn7FBMQvBzJdyTOeT1qaoWuuugbU Oct 08 21:05:52.153376 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:05:52.153376 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:05:52.153376 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:05:52.153376 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:05:52.153376 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:05:52.153376 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:05:52.153376 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: c405aac48e9b403ca8d1e3ac28fab76e Oct 08 21:05:52.153376 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-746342360 Oct 08 21:05:52.153376 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:05:52.153376 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:05:52.153376 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/c405aac48e9b403ca8d1e3ac28fab76e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c405aac48e9b403ca8d1e3ac28fab76e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_c405aac48e9b403ca8d1e3ac28fab76e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c405aac48e9b403ca8d1e3ac28fab76e"}]}] Oct 08 21:05:52.153376 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-746342360 Oct 08 21:05:52.153376 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: c405aac48e9b403ca8d1e3ac28fab76e Oct 08 21:05:52.153376 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-746342360 Oct 08 21:05:52.153376 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-FloatingIPsAssociationTestJSON-746342360-project Oct 08 21:05:52.153376 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:05:52.153376 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:05:52.153376 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 0c6153d58d264272a375b3169e0874d3 Oct 08 21:05:52.153376 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-746342360-project Oct 08 21:05:52.153376 ncdv-master-1 devstack@n-api.service[140492]: Oct 08 21:05:52.153376 ncdv-master-1 devstack@n-api.service[140492]: {"removeFloatingIp": {"address": "172.35.5.73"}} Oct 08 21:05:52.153376 ncdv-master-1 devstack@n-api.service[140492]: method: Oct 08 21:05:52.153376 ncdv-master-1 devstack@n-api.service[140492]: exception: Floating IP 172.35.5.73 is not associated with instance de9d6639-040b-44b7-b00a-c1022c705c89. Oct 08 21:05:52.153376 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': 'de9d6639-040b-44b7-b00a-c1022c705c89', 'body': {'removeFloatingIp': {'address': '172.35.5.73'}}} Oct 08 21:05:52.153376 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:05:52.153376 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:05:52.153376 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:05:52.153376 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:05:52.153376 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:05:52.153376 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:05:52.153376 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 08 21:05:52.153376 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 08 21:05:52.153376 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:05:52.153376 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:05:52.153376 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 21:05:52.153376 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 21:05:52.153376 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Oct 08 21:05:52.153376 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 08 21:05:52.153376 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.35.5.73 is not associated with instance de9d6639-040b-44b7-b00a-c1022c705c89. Oct 08 21:05:52.153376 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:05:52.153376 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:05:52.153376 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:05:52.153376 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:05:52.153376 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:05:52.153376 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:05:52.153376 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:05:52.153376 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:05:52.153376 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.35.5.73 is not associated with instance de9d6639-040b-44b7-b00a-c1022c705c89. Oct 08 21:05:52.153376 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:05:52.158261 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-3da12d31-f6b3-4f77-ab39-5755dbdc1fe3 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Returning 409 to user: Floating IP 172.35.5.73 is not associated with instance de9d6639-040b-44b7-b00a-c1022c705c89. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:05:52.158261 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-3da12d31-f6b3-4f77-ab39-5755dbdc1fe3 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] 10.222.0.26 "POST /compute/v2.1/servers/de9d6639-040b-44b7-b00a-c1022c705c89/action" status: 409 len: 145 microversion: 2.1 time: 0.719939 Oct 08 21:05:52.158261 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1716/3356] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:05:51 2022] POST /compute/v2.1/servers/de9d6639-040b-44b7-b00a-c1022c705c89/action => generated 145 bytes in 723 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 08 21:05:52.168870 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-b3c379c8-c486-47f0-8ad6-4ade9090c34f tempest-FloatingIPsTestJSON-86978126 tempest-FloatingIPsTestJSON-86978126-project] Calling method '.version_select at 0x7f1a8c0cd280>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:05:52.538490 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-b3c379c8-c486-47f0-8ad6-4ade9090c34f tempest-FloatingIPsTestJSON-86978126 tempest-FloatingIPsTestJSON-86978126-project] 10.222.0.26 "GET /compute/v2.1/os-floating-ips" status: 200 len: 145 microversion: 2.1 time: 0.379594 Oct 08 21:05:52.539404 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1717/3357] 10.222.0.26 () {58 vars in 1149 bytes} [Sat Oct 8 21:05:52 2022] GET /compute/v2.1/os-floating-ips => generated 145 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:05:52.544070 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-11e76363-8d86-45e4-83f4-e489244593ba tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:05:52.544688 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-11e76363-8d86-45e4-83f4-e489244593ba tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] [instance: ce4a2fbf-76f3-4577-a704-3b64ec30d84b] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:05:52.560985 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-11e76363-8d86-45e4-83f4-e489244593ba tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:52.561779 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-11e76363-8d86-45e4-83f4-e489244593ba tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:52.562939 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-11e76363-8d86-45e4-83f4-e489244593ba tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:52.563678 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-11e76363-8d86-45e4-83f4-e489244593ba tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:52.564123 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-11e76363-8d86-45e4-83f4-e489244593ba tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:52.564557 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-11e76363-8d86-45e4-83f4-e489244593ba tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:52.859816 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-11e76363-8d86-45e4-83f4-e489244593ba tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85abb492492343c58734564a2b26c8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68b14967e8249fd886f168d366f241f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:52.872903 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-11e76363-8d86-45e4-83f4-e489244593ba tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] 10.222.0.26 "GET /compute/v2.1/servers/ce4a2fbf-76f3-4577-a704-3b64ec30d84b" status: 200 len: 1364 microversion: 2.1 time: 0.332318 Oct 08 21:05:52.873867 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1718/3358] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:05:52 2022] GET /compute/v2.1/servers/ce4a2fbf-76f3-4577-a704-3b64ec30d84b => generated 1364 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:05:52.879120 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-46325321-d6f5-40de-9fa3-9420d6b5c054 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:05:52.880145 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-46325321-d6f5-40de-9fa3-9420d6b5c054 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] [instance: 4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:05:52.887171 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-46325321-d6f5-40de-9fa3-9420d6b5c054 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:52.887969 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-46325321-d6f5-40de-9fa3-9420d6b5c054 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:52.888732 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-46325321-d6f5-40de-9fa3-9420d6b5c054 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:52.890509 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-46325321-d6f5-40de-9fa3-9420d6b5c054 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:52.891222 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-46325321-d6f5-40de-9fa3-9420d6b5c054 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:52.891946 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-46325321-d6f5-40de-9fa3-9420d6b5c054 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:53.065351 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-46325321-d6f5-40de-9fa3-9420d6b5c054 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc2bdd169daf4a1db830b1fa7f94f0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f2d56477794f8ab38b8e3535b3e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:53.094677 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-46325321-d6f5-40de-9fa3-9420d6b5c054 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc2bdd169daf4a1db830b1fa7f94f0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f2d56477794f8ab38b8e3535b3e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:53.097100 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-46325321-d6f5-40de-9fa3-9420d6b5c054 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc2bdd169daf4a1db830b1fa7f94f0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f2d56477794f8ab38b8e3535b3e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:53.104560 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-46325321-d6f5-40de-9fa3-9420d6b5c054 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] 10.222.0.26 "GET /compute/v2.1/servers/4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21" status: 200 len: 1661 microversion: 2.32 time: 0.227146 Oct 08 21:05:53.107295 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1719/3359] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:05:52 2022] GET /compute/v2.1/servers/4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21 => generated 1661 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:05:53.117685 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-46a7e862-e9f8-4ab1-813a-9de62b3a1405 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:05:53.118382 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-46a7e862-e9f8-4ab1-813a-9de62b3a1405 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] [instance: 47d524a3-cb1f-4972-9ffb-a8225135461f] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:05:53.132266 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-46a7e862-e9f8-4ab1-813a-9de62b3a1405 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:53.135110 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-46a7e862-e9f8-4ab1-813a-9de62b3a1405 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:53.135606 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-46a7e862-e9f8-4ab1-813a-9de62b3a1405 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:53.137953 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-46a7e862-e9f8-4ab1-813a-9de62b3a1405 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:53.139757 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-46a7e862-e9f8-4ab1-813a-9de62b3a1405 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:53.141069 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-46a7e862-e9f8-4ab1-813a-9de62b3a1405 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:53.141234 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-34c4222d-a781-4253-beda-8341afcc354f tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Flavor limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 21:05:53.141773 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-34c4222d-a781-4253-beda-8341afcc354f tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Image limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 21:05:53.142024 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-34c4222d-a781-4253-beda-8341afcc354f tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Flavor pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 21:05:53.142490 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-34c4222d-a781-4253-beda-8341afcc354f tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Image pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 21:05:53.142920 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-34c4222d-a781-4253-beda-8341afcc354f tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 21:05:53.175975 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-34c4222d-a781-4253-beda-8341afcc354f tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:53.176475 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-34c4222d-a781-4253-beda-8341afcc354f tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:53.176935 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-34c4222d-a781-4253-beda-8341afcc354f tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:53.177746 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-34c4222d-a781-4253-beda-8341afcc354f tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:53.178205 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-34c4222d-a781-4253-beda-8341afcc354f tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:53.178870 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-34c4222d-a781-4253-beda-8341afcc354f tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:53.230990 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-34c4222d-a781-4253-beda-8341afcc354f tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Getting quotas for project e7ded993145b4eda9d6a33b994519012. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:05:53.237877 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-34c4222d-a781-4253-beda-8341afcc354f tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Getting quotas for user 06443b5728fb4d1e95d6245820e786bf and project e7ded993145b4eda9d6a33b994519012. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:05:53.272846 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-34c4222d-a781-4253-beda-8341afcc354f tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Going to run 1 instances... {{(pid=140491) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 21:05:53.286202 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-34c4222d-a781-4253-beda-8341afcc354f tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: edd393b3-ce87-41a9-a9c4-f3ad6a6f0130] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c508bd7f-7db9-4b2c-af7c-be54a855c355',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140491) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 21:05:53.301592 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=2 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:05:53.334823 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=6 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:05:53.387684 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-34c4222d-a781-4253-beda-8341afcc354f tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.445960 Oct 08 21:05:53.391682 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1641/3360] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 21:05:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 2451 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 08 21:05:53.397533 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-46a7e862-e9f8-4ab1-813a-9de62b3a1405 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5000948fa98a4b5d96ad27436d3d0edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917519b500674698a68dc01a4e8d68a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:53.403907 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-b163b5eb-c012-4b8d-8050-77277e9ce976 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.5.73"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:05:53.408389 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-46a7e862-e9f8-4ab1-813a-9de62b3a1405 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] 10.222.0.26 "GET /compute/v2.1/servers/47d524a3-cb1f-4972-9ffb-a8225135461f" status: 200 len: 1505 microversion: 2.1 time: 0.299752 Oct 08 21:05:53.419563 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1720/3361] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:05:53 2022] GET /compute/v2.1/servers/47d524a3-cb1f-4972-9ffb-a8225135461f => generated 1505 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:05:53.428530 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-08c74d7a-5815-46ef-b5c3-673742ee91a5 tempest-FloatingIPsTestJSON-86978126 tempest-FloatingIPsTestJSON-86978126-project] Calling method '.version_select at 0x7f1a8ca761f0>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:05:54.134135 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-b163b5eb-c012-4b8d-8050-77277e9ce976 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] [instance: 58ad88cd-b5d3-4aac-ae20-857736605fa0] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:05:54.142506 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b163b5eb-c012-4b8d-8050-77277e9ce976 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:54.143177 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b163b5eb-c012-4b8d-8050-77277e9ce976 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:54.149357 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b163b5eb-c012-4b8d-8050-77277e9ce976 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:54.150420 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b163b5eb-c012-4b8d-8050-77277e9ce976 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:54.151076 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b163b5eb-c012-4b8d-8050-77277e9ce976 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:54.152141 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b163b5eb-c012-4b8d-8050-77277e9ce976 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:54.942950 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-08c74d7a-5815-46ef-b5c3-673742ee91a5 tempest-FloatingIPsTestJSON-86978126 tempest-FloatingIPsTestJSON-86978126-project] 10.222.0.26 "DELETE /compute/v2.1/os-floating-ips/7be3b611-57db-421f-87f7-778f6f1d3e20" status: 202 len: 0 microversion: 2.1 time: 1.521917 Oct 08 21:05:54.944637 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1721/3362] 10.222.0.26 () {58 vars in 1263 bytes} [Sat Oct 8 21:05:53 2022] DELETE /compute/v2.1/os-floating-ips/7be3b611-57db-421f-87f7-778f6f1d3e20 => generated 0 bytes in 1524 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 21:05:54.949334 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-86b6e1e3-4be7-4447-8401-677fa5b42ce4 req-e88e82f7-0562-4d1f-afcf-a1dadd135507 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58ad88cd-b5d3-4aac-ae20-857736605fa0", "tag": "b52b4792-7889-4b9f-ab09-74d565a895ac"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:05:54.980207 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-86b6e1e3-4be7-4447-8401-677fa5b42ce4 req-e88e82f7-0562-4d1f-afcf-a1dadd135507 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:54.980567 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-86b6e1e3-4be7-4447-8401-677fa5b42ce4 req-e88e82f7-0562-4d1f-afcf-a1dadd135507 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:54.981074 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-86b6e1e3-4be7-4447-8401-677fa5b42ce4 req-e88e82f7-0562-4d1f-afcf-a1dadd135507 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:55.003463 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-86b6e1e3-4be7-4447-8401-677fa5b42ce4 req-e88e82f7-0562-4d1f-afcf-a1dadd135507 service nova] Creating event network-changed:b52b4792-7889-4b9f-ab09-74d565a895ac for instance 58ad88cd-b5d3-4aac-ae20-857736605fa0 on nch1-master-1 Oct 08 21:05:55.023353 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-86b6e1e3-4be7-4447-8401-677fa5b42ce4 req-e88e82f7-0562-4d1f-afcf-a1dadd135507 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077432 Oct 08 21:05:55.023999 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1722/3363] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:05:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:05:55.053379 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-3e0e98bc-6ef7-49de-b602-992d6c2ca94a req-dab6c231-9ea5-4e58-9de7-d5a109e66dcc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce4a2fbf-76f3-4577-a704-3b64ec30d84b", "name": "network-vif-plugged", "status": "completed", "tag": "0ad7b806-8ee9-493c-a2da-3f9bc61bb980"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:05:55.094413 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-3e0e98bc-6ef7-49de-b602-992d6c2ca94a req-dab6c231-9ea5-4e58-9de7-d5a109e66dcc service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:55.094920 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-3e0e98bc-6ef7-49de-b602-992d6c2ca94a req-dab6c231-9ea5-4e58-9de7-d5a109e66dcc service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:55.095370 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-3e0e98bc-6ef7-49de-b602-992d6c2ca94a req-dab6c231-9ea5-4e58-9de7-d5a109e66dcc service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:55.113638 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-3e0e98bc-6ef7-49de-b602-992d6c2ca94a req-dab6c231-9ea5-4e58-9de7-d5a109e66dcc service nova] Creating event network-vif-plugged:0ad7b806-8ee9-493c-a2da-3f9bc61bb980 for instance ce4a2fbf-76f3-4577-a704-3b64ec30d84b on nch1-master-1 Oct 08 21:05:55.119384 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-3e0e98bc-6ef7-49de-b602-992d6c2ca94a req-dab6c231-9ea5-4e58-9de7-d5a109e66dcc service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092505 Oct 08 21:05:55.122562 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1723/3364] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:05:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:05:55.132609 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-c5c6147f-a495-4fc9-adfa-f8baedf0946e tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:05:55.133026 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-c5c6147f-a495-4fc9-adfa-f8baedf0946e tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: edd393b3-ce87-41a9-a9c4-f3ad6a6f0130] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:05:55.147742 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c5c6147f-a495-4fc9-adfa-f8baedf0946e tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:55.148644 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c5c6147f-a495-4fc9-adfa-f8baedf0946e tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:55.149363 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c5c6147f-a495-4fc9-adfa-f8baedf0946e tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:55.150358 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c5c6147f-a495-4fc9-adfa-f8baedf0946e tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:55.151045 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c5c6147f-a495-4fc9-adfa-f8baedf0946e tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:55.151870 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c5c6147f-a495-4fc9-adfa-f8baedf0946e tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:55.177253 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=94,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=2,nova_cell1:RELEASE=2 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:05:55.304770 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b163b5eb-c012-4b8d-8050-77277e9ce976 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Acquiring lock "refresh_cache-58ad88cd-b5d3-4aac-ae20-857736605fa0" {{(pid=140491) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 08 21:05:55.305864 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b163b5eb-c012-4b8d-8050-77277e9ce976 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Acquired lock "refresh_cache-58ad88cd-b5d3-4aac-ae20-857736605fa0" {{(pid=140491) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 08 21:05:55.308426 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-c5c6147f-a495-4fc9-adfa-f8baedf0946e tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06443b5728fb4d1e95d6245820e786bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ded993145b4eda9d6a33b994519012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:55.317774 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-c5c6147f-a495-4fc9-adfa-f8baedf0946e tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "GET /compute/v2.1/servers/edd393b3-ce87-41a9-a9c4-f3ad6a6f0130" status: 200 len: 1245 microversion: 2.1 time: 0.191297 Oct 08 21:05:55.318366 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1724/3365] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:05:55 2022] GET /compute/v2.1/servers/edd393b3-ce87-41a9-a9c4-f3ad6a6f0130 => generated 1245 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:05:55.338960 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-b73abcf5-38ae-4f33-ad80-5d7f3e3d9676 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:05:55.341844 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-b73abcf5-38ae-4f33-ad80-5d7f3e3d9676 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] [instance: 62ddef97-0025-4e6d-a62e-59a824562796] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:05:55.357696 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b73abcf5-38ae-4f33-ad80-5d7f3e3d9676 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:55.358498 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b73abcf5-38ae-4f33-ad80-5d7f3e3d9676 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:55.363339 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b73abcf5-38ae-4f33-ad80-5d7f3e3d9676 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:55.364265 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b73abcf5-38ae-4f33-ad80-5d7f3e3d9676 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:55.365778 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b73abcf5-38ae-4f33-ad80-5d7f3e3d9676 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:55.366333 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b73abcf5-38ae-4f33-ad80-5d7f3e3d9676 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:55.681495 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-b73abcf5-38ae-4f33-ad80-5d7f3e3d9676 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5000948fa98a4b5d96ad27436d3d0edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917519b500674698a68dc01a4e8d68a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:55.699416 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-b73abcf5-38ae-4f33-ad80-5d7f3e3d9676 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] 10.222.0.26 "GET /compute/v2.1/servers/62ddef97-0025-4e6d-a62e-59a824562796" status: 200 len: 1506 microversion: 2.1 time: 0.377194 Oct 08 21:05:55.711210 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1725/3366] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:05:55 2022] GET /compute/v2.1/servers/62ddef97-0025-4e6d-a62e-59a824562796 => generated 1506 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:05:55.716703 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-caa79289-163f-457d-86e0-480272c97994 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:05:55.717716 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-caa79289-163f-457d-86e0-480272c97994 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] [instance: ce4a2fbf-76f3-4577-a704-3b64ec30d84b] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:05:55.735381 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-caa79289-163f-457d-86e0-480272c97994 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:55.737509 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-caa79289-163f-457d-86e0-480272c97994 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:55.738184 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-caa79289-163f-457d-86e0-480272c97994 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:55.739190 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-caa79289-163f-457d-86e0-480272c97994 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:55.739869 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-caa79289-163f-457d-86e0-480272c97994 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:55.740721 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-caa79289-163f-457d-86e0-480272c97994 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:55.936546 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-caa79289-163f-457d-86e0-480272c97994 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85abb492492343c58734564a2b26c8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68b14967e8249fd886f168d366f241f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:55.948227 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-caa79289-163f-457d-86e0-480272c97994 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] 10.222.0.26 "GET /compute/v2.1/servers/ce4a2fbf-76f3-4577-a704-3b64ec30d84b" status: 200 len: 1364 microversion: 2.1 time: 0.235470 Oct 08 21:05:55.950434 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1726/3367] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:05:55 2022] GET /compute/v2.1/servers/ce4a2fbf-76f3-4577-a704-3b64ec30d84b => generated 1364 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:05:55.955730 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e9c00bdb-f163-4e64-8f91-0a5a2cd23697 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:05:55.956635 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-e9c00bdb-f163-4e64-8f91-0a5a2cd23697 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] [instance: 4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:05:55.964205 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e9c00bdb-f163-4e64-8f91-0a5a2cd23697 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:55.964968 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e9c00bdb-f163-4e64-8f91-0a5a2cd23697 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:55.965668 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e9c00bdb-f163-4e64-8f91-0a5a2cd23697 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:55.966679 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e9c00bdb-f163-4e64-8f91-0a5a2cd23697 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:55.967538 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e9c00bdb-f163-4e64-8f91-0a5a2cd23697 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:55.968655 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e9c00bdb-f163-4e64-8f91-0a5a2cd23697 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:56.130018 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-e9c00bdb-f163-4e64-8f91-0a5a2cd23697 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc2bdd169daf4a1db830b1fa7f94f0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f2d56477794f8ab38b8e3535b3e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:56.139631 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-e9c00bdb-f163-4e64-8f91-0a5a2cd23697 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc2bdd169daf4a1db830b1fa7f94f0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f2d56477794f8ab38b8e3535b3e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:56.141272 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-e9c00bdb-f163-4e64-8f91-0a5a2cd23697 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc2bdd169daf4a1db830b1fa7f94f0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f2d56477794f8ab38b8e3535b3e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:56.142593 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-e9c00bdb-f163-4e64-8f91-0a5a2cd23697 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] 10.222.0.26 "GET /compute/v2.1/servers/4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21" status: 200 len: 1696 microversion: 2.32 time: 0.190978 Oct 08 21:05:56.143324 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1727/3368] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:05:55 2022] GET /compute/v2.1/servers/4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21 => generated 1696 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:05:56.147904 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-0d2c9f27-50b8-4d09-8da1-b10c0eaf49f9 tempest-FloatingIPsTestJSON-86978126 tempest-FloatingIPsTestJSON-86978126-project] Action: 'create', calling method: .version_select at 0x7f1a8ca76af0>, body: {"pool": null} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:05:58.041772 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-0d2c9f27-50b8-4d09-8da1-b10c0eaf49f9 tempest-FloatingIPsTestJSON-86978126 tempest-FloatingIPsTestJSON-86978126-project] 10.222.0.26 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 1.897223 Oct 08 21:05:58.043512 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1728/3369] 10.222.0.26 () {60 vars in 1170 bytes} [Sat Oct 8 21:05:56 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 1899 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:05:58.050729 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-a7f4a835-c297-487f-9dcd-853dee7aa7d6 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:05:58.051586 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-a7f4a835-c297-487f-9dcd-853dee7aa7d6 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] [instance: 62ddef97-0025-4e6d-a62e-59a824562796] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:05:58.058999 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=3 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:05:58.061279 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a7f4a835-c297-487f-9dcd-853dee7aa7d6 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:58.062179 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a7f4a835-c297-487f-9dcd-853dee7aa7d6 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:58.062916 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a7f4a835-c297-487f-9dcd-853dee7aa7d6 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:58.064139 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a7f4a835-c297-487f-9dcd-853dee7aa7d6 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:58.065078 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a7f4a835-c297-487f-9dcd-853dee7aa7d6 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:58.066084 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a7f4a835-c297-487f-9dcd-853dee7aa7d6 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:58.083402 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.network.neutron [None req-b163b5eb-c012-4b8d-8050-77277e9ce976 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] [instance: 58ad88cd-b5d3-4aac-ae20-857736605fa0] Building network info cache for instance {{(pid=140491) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 08 21:05:58.109071 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-a7f4a835-c297-487f-9dcd-853dee7aa7d6 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] [instance: 62ddef97-0025-4e6d-a62e-59a824562796] Going to try to terminate instance {{(pid=140492) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 21:05:58.247952 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-a7f4a835-c297-487f-9dcd-853dee7aa7d6 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] 10.222.0.26 "DELETE /compute/v2.1/servers/62ddef97-0025-4e6d-a62e-59a824562796" status: 204 len: 0 microversion: 2.1 time: 0.202749 Oct 08 21:05:58.248851 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1729/3370] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:05:58 2022] DELETE /compute/v2.1/servers/62ddef97-0025-4e6d-a62e-59a824562796 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 21:05:58.255383 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-10773d73-a9b9-4944-b324-827e552a1d40 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:05:58.256514 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-10773d73-a9b9-4944-b324-827e552a1d40 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: edd393b3-ce87-41a9-a9c4-f3ad6a6f0130] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:05:58.264194 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-10773d73-a9b9-4944-b324-827e552a1d40 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:58.265740 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-10773d73-a9b9-4944-b324-827e552a1d40 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:58.266591 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-10773d73-a9b9-4944-b324-827e552a1d40 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:58.267617 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-10773d73-a9b9-4944-b324-827e552a1d40 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:58.268578 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-10773d73-a9b9-4944-b324-827e552a1d40 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:58.269284 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-10773d73-a9b9-4944-b324-827e552a1d40 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:58.533432 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-10773d73-a9b9-4944-b324-827e552a1d40 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06443b5728fb4d1e95d6245820e786bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ded993145b4eda9d6a33b994519012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:58.541583 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-10773d73-a9b9-4944-b324-827e552a1d40 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "GET /compute/v2.1/servers/edd393b3-ce87-41a9-a9c4-f3ad6a6f0130" status: 200 len: 1293 microversion: 2.1 time: 0.290977 Oct 08 21:05:58.542183 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1730/3371] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:05:58 2022] GET /compute/v2.1/servers/edd393b3-ce87-41a9-a9c4-f3ad6a6f0130 => generated 1293 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:05:58.564386 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-79203062-ee0d-4d81-8db0-77fb1cff36ed tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:05:58.564386 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-79203062-ee0d-4d81-8db0-77fb1cff36ed tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] [instance: ce4a2fbf-76f3-4577-a704-3b64ec30d84b] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:05:58.575190 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-79203062-ee0d-4d81-8db0-77fb1cff36ed tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:58.575777 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-79203062-ee0d-4d81-8db0-77fb1cff36ed tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:58.576558 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-79203062-ee0d-4d81-8db0-77fb1cff36ed tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:58.578308 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-79203062-ee0d-4d81-8db0-77fb1cff36ed tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:58.579025 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-79203062-ee0d-4d81-8db0-77fb1cff36ed tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:58.579561 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-79203062-ee0d-4d81-8db0-77fb1cff36ed tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:58.800603 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-79203062-ee0d-4d81-8db0-77fb1cff36ed tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85abb492492343c58734564a2b26c8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68b14967e8249fd886f168d366f241f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:58.810659 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-79203062-ee0d-4d81-8db0-77fb1cff36ed tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] 10.222.0.26 "GET /compute/v2.1/servers/ce4a2fbf-76f3-4577-a704-3b64ec30d84b" status: 200 len: 1550 microversion: 2.1 time: 0.267432 Oct 08 21:05:58.822988 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1731/3372] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:05:58 2022] GET /compute/v2.1/servers/ce4a2fbf-76f3-4577-a704-3b64ec30d84b => generated 1550 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:05:58.826771 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-8f711338-5c03-4f3a-b7ce-ed59968e8807 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:05:58.828352 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-8f711338-5c03-4f3a-b7ce-ed59968e8807 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] [instance: 4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:05:58.834995 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8f711338-5c03-4f3a-b7ce-ed59968e8807 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:58.835763 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8f711338-5c03-4f3a-b7ce-ed59968e8807 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:58.836200 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8f711338-5c03-4f3a-b7ce-ed59968e8807 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:58.836933 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8f711338-5c03-4f3a-b7ce-ed59968e8807 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:58.837453 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8f711338-5c03-4f3a-b7ce-ed59968e8807 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:58.837900 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8f711338-5c03-4f3a-b7ce-ed59968e8807 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:59.054910 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-8f711338-5c03-4f3a-b7ce-ed59968e8807 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc2bdd169daf4a1db830b1fa7f94f0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f2d56477794f8ab38b8e3535b3e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:59.067082 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-8f711338-5c03-4f3a-b7ce-ed59968e8807 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc2bdd169daf4a1db830b1fa7f94f0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f2d56477794f8ab38b8e3535b3e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:59.068946 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-8f711338-5c03-4f3a-b7ce-ed59968e8807 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc2bdd169daf4a1db830b1fa7f94f0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f2d56477794f8ab38b8e3535b3e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:05:59.070496 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-8f711338-5c03-4f3a-b7ce-ed59968e8807 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] 10.222.0.26 "GET /compute/v2.1/servers/4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21" status: 200 len: 1743 microversion: 2.32 time: 0.257811 Oct 08 21:05:59.071710 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1732/3373] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:05:58 2022] GET /compute/v2.1/servers/4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21 => generated 1743 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:05:59.077234 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-1e1cb803-befe-436f-9b6e-925a4fa04f81 tempest-FloatingIPsTestJSON-86978126 tempest-FloatingIPsTestJSON-86978126-project] Calling method '.version_select at 0x7f1a8c134ee0>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:05:59.361068 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.network.neutron [None req-b163b5eb-c012-4b8d-8050-77277e9ce976 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] [instance: 58ad88cd-b5d3-4aac-ae20-857736605fa0] Updating instance_info_cache with network_info: [{"id": "b52b4792-7889-4b9f-ab09-74d565a895ac", "address": "fa:16:3e:0a:68:47", "network": {"id": "b449bb70-491a-439e-8976-e26644902f7a", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-134175099-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "c405aac48e9b403ca8d1e3ac28fab76e", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapb52b4792-78", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=140491) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 08 21:05:59.363439 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=88,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:05:59.383177 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b163b5eb-c012-4b8d-8050-77277e9ce976 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Releasing lock "refresh_cache-58ad88cd-b5d3-4aac-ae20-857736605fa0" {{(pid=140491) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 08 21:05:59.385029 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-b163b5eb-c012-4b8d-8050-77277e9ce976 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] 10.222.0.26 "POST /compute/v2.1/servers/58ad88cd-b5d3-4aac-ae20-857736605fa0/action" status: 202 len: 0 microversion: 2.1 time: 5.989537 Oct 08 21:05:59.387198 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1642/3374] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:05:53 2022] POST /compute/v2.1/servers/58ad88cd-b5d3-4aac-ae20-857736605fa0/action => generated 0 bytes in 5992 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 08 21:05:59.396962 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-853f5890-2476-45d0-a4e3-2eaeca498b1f req-c0b24287-a15b-4be7-a58e-9275a32e8994 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58ad88cd-b5d3-4aac-ae20-857736605fa0", "tag": "b52b4792-7889-4b9f-ab09-74d565a895ac"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:05:59.415107 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-853f5890-2476-45d0-a4e3-2eaeca498b1f req-c0b24287-a15b-4be7-a58e-9275a32e8994 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:59.416351 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-853f5890-2476-45d0-a4e3-2eaeca498b1f req-c0b24287-a15b-4be7-a58e-9275a32e8994 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:59.417262 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-853f5890-2476-45d0-a4e3-2eaeca498b1f req-c0b24287-a15b-4be7-a58e-9275a32e8994 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:59.440521 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-853f5890-2476-45d0-a4e3-2eaeca498b1f req-c0b24287-a15b-4be7-a58e-9275a32e8994 service nova] Creating event network-changed:b52b4792-7889-4b9f-ab09-74d565a895ac for instance 58ad88cd-b5d3-4aac-ae20-857736605fa0 on nch1-master-1 Oct 08 21:05:59.464924 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-853f5890-2476-45d0-a4e3-2eaeca498b1f req-c0b24287-a15b-4be7-a58e-9275a32e8994 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075214 Oct 08 21:05:59.467313 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1643/3375] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:05:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:05:59.496078 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-7dd1309a-f1a2-4a11-b1ad-5d46d9d81b9c tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:05:59.500758 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-7dd1309a-f1a2-4a11-b1ad-5d46d9d81b9c tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] [instance: 47d524a3-cb1f-4972-9ffb-a8225135461f] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:05:59.522814 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7dd1309a-f1a2-4a11-b1ad-5d46d9d81b9c tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:59.523566 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7dd1309a-f1a2-4a11-b1ad-5d46d9d81b9c tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:59.524136 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7dd1309a-f1a2-4a11-b1ad-5d46d9d81b9c tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:59.526582 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7dd1309a-f1a2-4a11-b1ad-5d46d9d81b9c tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:59.529295 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7dd1309a-f1a2-4a11-b1ad-5d46d9d81b9c tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:59.530400 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7dd1309a-f1a2-4a11-b1ad-5d46d9d81b9c tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:59.593564 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-7dd1309a-f1a2-4a11-b1ad-5d46d9d81b9c tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] [instance: 47d524a3-cb1f-4972-9ffb-a8225135461f] Going to try to terminate instance {{(pid=140491) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 21:05:59.726610 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:05:59.757728 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-7dd1309a-f1a2-4a11-b1ad-5d46d9d81b9c tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] 10.222.0.26 "DELETE /compute/v2.1/servers/47d524a3-cb1f-4972-9ffb-a8225135461f" status: 204 len: 0 microversion: 2.1 time: 0.284041 Oct 08 21:05:59.762624 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1644/3376] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:05:59 2022] DELETE /compute/v2.1/servers/47d524a3-cb1f-4972-9ffb-a8225135461f => generated 0 bytes in 290 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 21:05:59.767836 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-53092083-59d5-4a4a-80c3-a06f71799d91 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:05:59.768503 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-53092083-59d5-4a4a-80c3-a06f71799d91 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] [instance: ce4a2fbf-76f3-4577-a704-3b64ec30d84b] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:05:59.776388 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-53092083-59d5-4a4a-80c3-a06f71799d91 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:59.778118 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-53092083-59d5-4a4a-80c3-a06f71799d91 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:59.779881 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-53092083-59d5-4a4a-80c3-a06f71799d91 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:05:59.782108 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-53092083-59d5-4a4a-80c3-a06f71799d91 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:05:59.783809 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-53092083-59d5-4a4a-80c3-a06f71799d91 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:05:59.784623 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-53092083-59d5-4a4a-80c3-a06f71799d91 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:00.087580 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-53092083-59d5-4a4a-80c3-a06f71799d91 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] 10.222.0.26 "GET /compute/v2.1/servers/ce4a2fbf-76f3-4577-a704-3b64ec30d84b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.326031 Oct 08 21:06:00.088221 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1645/3377] 10.222.0.26 () {58 vars in 1275 bytes} [Sat Oct 8 21:05:59 2022] GET /compute/v2.1/servers/ce4a2fbf-76f3-4577-a704-3b64ec30d84b/os-interface => generated 284 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:06:00.103149 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-26042710-ade5-409c-8570-33edbc1cc7a1 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:06:00.103616 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-26042710-ade5-409c-8570-33edbc1cc7a1 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] [instance: 58ad88cd-b5d3-4aac-ae20-857736605fa0] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:06:00.121506 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-26042710-ade5-409c-8570-33edbc1cc7a1 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:00.122009 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-26042710-ade5-409c-8570-33edbc1cc7a1 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:00.122457 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-26042710-ade5-409c-8570-33edbc1cc7a1 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:00.123183 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-26042710-ade5-409c-8570-33edbc1cc7a1 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:00.123681 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-26042710-ade5-409c-8570-33edbc1cc7a1 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:00.130751 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-26042710-ade5-409c-8570-33edbc1cc7a1 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:00.179222 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-26042710-ade5-409c-8570-33edbc1cc7a1 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] [instance: 58ad88cd-b5d3-4aac-ae20-857736605fa0] Going to try to terminate instance {{(pid=140491) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 21:06:00.278353 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-26042710-ade5-409c-8570-33edbc1cc7a1 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] 10.222.0.26 "DELETE /compute/v2.1/servers/58ad88cd-b5d3-4aac-ae20-857736605fa0" status: 204 len: 0 microversion: 2.1 time: 0.178599 Oct 08 21:06:00.279367 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1646/3378] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:06:00 2022] DELETE /compute/v2.1/servers/58ad88cd-b5d3-4aac-ae20-857736605fa0 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 21:06:00.289170 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-479afaa9-95a6-4891-a739-21c33e2fd751 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:06:00.290279 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-479afaa9-95a6-4891-a739-21c33e2fd751 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: edd393b3-ce87-41a9-a9c4-f3ad6a6f0130] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:06:00.298709 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-479afaa9-95a6-4891-a739-21c33e2fd751 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:00.299606 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-479afaa9-95a6-4891-a739-21c33e2fd751 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:00.300920 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-479afaa9-95a6-4891-a739-21c33e2fd751 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:00.301953 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-479afaa9-95a6-4891-a739-21c33e2fd751 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:00.302728 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-479afaa9-95a6-4891-a739-21c33e2fd751 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:00.303487 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-479afaa9-95a6-4891-a739-21c33e2fd751 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:00.439514 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-1e1cb803-befe-436f-9b6e-925a4fa04f81 tempest-FloatingIPsTestJSON-86978126 tempest-FloatingIPsTestJSON-86978126-project] 10.222.0.26 "DELETE /compute/v2.1/os-floating-ips/c7fe23ad-e41d-4916-9ee9-4a622c51253f" status: 202 len: 0 microversion: 2.1 time: 1.366129 Oct 08 21:06:00.440239 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1733/3379] 10.222.0.26 () {58 vars in 1263 bytes} [Sat Oct 8 21:05:59 2022] DELETE /compute/v2.1/os-floating-ips/c7fe23ad-e41d-4916-9ee9-4a622c51253f => generated 0 bytes in 1368 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 21:06:00.445225 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-67985894-0f13-497c-89f6-5655d4eb5c22 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:06:00.445871 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-67985894-0f13-497c-89f6-5655d4eb5c22 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] [instance: 62ddef97-0025-4e6d-a62e-59a824562796] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:06:00.457041 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-67985894-0f13-497c-89f6-5655d4eb5c22 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:00.457724 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-67985894-0f13-497c-89f6-5655d4eb5c22 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:00.458550 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-67985894-0f13-497c-89f6-5655d4eb5c22 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:00.459698 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-67985894-0f13-497c-89f6-5655d4eb5c22 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:00.459854 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-67985894-0f13-497c-89f6-5655d4eb5c22 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:00.460518 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-67985894-0f13-497c-89f6-5655d4eb5c22 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:00.688455 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-479afaa9-95a6-4891-a739-21c33e2fd751 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06443b5728fb4d1e95d6245820e786bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ded993145b4eda9d6a33b994519012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:00.705568 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-479afaa9-95a6-4891-a739-21c33e2fd751 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "GET /compute/v2.1/servers/edd393b3-ce87-41a9-a9c4-f3ad6a6f0130" status: 200 len: 1293 microversion: 2.1 time: 0.423652 Oct 08 21:06:00.708185 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1647/3380] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:06:00 2022] GET /compute/v2.1/servers/edd393b3-ce87-41a9-a9c4-f3ad6a6f0130 => generated 1293 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:06:00.715163 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-f25095a2-6a7a-421d-a2ae-92658975c01e tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:06:00.715999 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-f25095a2-6a7a-421d-a2ae-92658975c01e tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] [instance: 4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:06:00.723959 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f25095a2-6a7a-421d-a2ae-92658975c01e tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:00.724953 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f25095a2-6a7a-421d-a2ae-92658975c01e tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:00.725979 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f25095a2-6a7a-421d-a2ae-92658975c01e tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:00.728280 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f25095a2-6a7a-421d-a2ae-92658975c01e tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:00.729635 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f25095a2-6a7a-421d-a2ae-92658975c01e tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:00.731159 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f25095a2-6a7a-421d-a2ae-92658975c01e tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:00.738503 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-67985894-0f13-497c-89f6-5655d4eb5c22 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5000948fa98a4b5d96ad27436d3d0edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917519b500674698a68dc01a4e8d68a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:00.749901 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-67985894-0f13-497c-89f6-5655d4eb5c22 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] 10.222.0.26 "GET /compute/v2.1/servers/62ddef97-0025-4e6d-a62e-59a824562796" status: 200 len: 1512 microversion: 2.1 time: 0.308107 Oct 08 21:06:00.750855 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1734/3381] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:06:00 2022] GET /compute/v2.1/servers/62ddef97-0025-4e6d-a62e-59a824562796 => generated 1512 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:06:00.772090 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-ddc74e3b-9da2-4533-b686-136ff658dc5d tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.5.73"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:06:00.772090 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-ddc74e3b-9da2-4533-b686-136ff658dc5d tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] [instance: de9d6639-040b-44b7-b00a-c1022c705c89] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:06:00.776491 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ddc74e3b-9da2-4533-b686-136ff658dc5d tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:00.777935 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ddc74e3b-9da2-4533-b686-136ff658dc5d tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:00.778992 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ddc74e3b-9da2-4533-b686-136ff658dc5d tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:00.780737 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ddc74e3b-9da2-4533-b686-136ff658dc5d tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:00.781833 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ddc74e3b-9da2-4533-b686-136ff658dc5d tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:00.782827 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ddc74e3b-9da2-4533-b686-136ff658dc5d tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:00.825684 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ddc74e3b-9da2-4533-b686-136ff658dc5d tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Acquiring lock "refresh_cache-de9d6639-040b-44b7-b00a-c1022c705c89" {{(pid=140492) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 08 21:06:00.826865 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ddc74e3b-9da2-4533-b686-136ff658dc5d tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Acquired lock "refresh_cache-de9d6639-040b-44b7-b00a-c1022c705c89" {{(pid=140492) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 08 21:06:01.112597 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-f25095a2-6a7a-421d-a2ae-92658975c01e tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc2bdd169daf4a1db830b1fa7f94f0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f2d56477794f8ab38b8e3535b3e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:01.147391 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-f25095a2-6a7a-421d-a2ae-92658975c01e tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc2bdd169daf4a1db830b1fa7f94f0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f2d56477794f8ab38b8e3535b3e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:01.150252 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-f25095a2-6a7a-421d-a2ae-92658975c01e tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc2bdd169daf4a1db830b1fa7f94f0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f2d56477794f8ab38b8e3535b3e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:01.152405 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-f25095a2-6a7a-421d-a2ae-92658975c01e tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] 10.222.0.26 "GET /compute/v2.1/servers/4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21" status: 200 len: 1790 microversion: 2.32 time: 0.441299 Oct 08 21:06:01.154585 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1648/3382] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:06:00 2022] GET /compute/v2.1/servers/4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21 => generated 1790 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:06:01.162933 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-a423e946-3586-4e0e-8435-5e54ea2f5571 tempest-FloatingIPsTestJSON-86978126 tempest-FloatingIPsTestJSON-86978126-project] Calling method '.version_select at 0x7f1a913534c0>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:06:01.566041 ncdv-master-1 devstack@n-api.service[140491]: DEBUG neutronclient.v2_0.client [None req-a423e946-3586-4e0e-8435-5e54ea2f5571 tempest-FloatingIPsTestJSON-86978126 tempest-FloatingIPsTestJSON-86978126-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP c7fe23ad-e41d-4916-9ee9-4a622c51253f could not be found", "detail": ""}} {{(pid=140491) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 08 21:06:01.567095 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-a423e946-3586-4e0e-8435-5e54ea2f5571 tempest-FloatingIPsTestJSON-86978126 tempest-FloatingIPsTestJSON-86978126-project] HTTP exception thrown: Floating IP not found for ID c7fe23ad-e41d-4916-9ee9-4a622c51253f Oct 08 21:06:01.569372 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-a423e946-3586-4e0e-8435-5e54ea2f5571 tempest-FloatingIPsTestJSON-86978126 tempest-FloatingIPsTestJSON-86978126-project] Request method failure captured: Oct 08 21:06:01.569372 ncdv-master-1 devstack@n-api.service[140491]: request: GET /compute/v2.1/os-floating-ips/c7fe23ad-e41d-4916-9ee9-4a622c51253f HTTP/1.1 Oct 08 21:06:01.569372 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:06:01.569372 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:06:01.569372 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:06:01.569372 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 21:06:01.569372 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:06:01.569372 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:06:01.569372 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:06:01.569372 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:06:01.569372 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeYl6767GbkFIRtRjSPlcFr2UTeqcJKCvd_jsPj6v53aQ7hJ7gXXO5EbRAlThM4CPz29X4od8kEVH2-hkbq5TO5AkoEFJ7NF7sCnQZl9lJye7AzEwuw6t7ujt7sXHHmkWwDR3XcGei5OrjhPz_5A0PKMpjBxhUhQ2Cr1DxuaywiVljM Oct 08 21:06:01.569372 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:06:01.569372 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:06:01.569372 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:06:01.569372 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:06:01.569372 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:06:01.569372 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:06:01.569372 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: c7377184b37740f6898266ee5c621f44 Oct 08 21:06:01.569372 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-FloatingIPsTestJSON-86978126 Oct 08 21:06:01.569372 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:06:01.569372 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:06:01.569372 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/c7377184b37740f6898266ee5c621f44"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c7377184b37740f6898266ee5c621f44"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_c7377184b37740f6898266ee5c621f44"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c7377184b37740f6898266ee5c621f44"}]}] Oct 08 21:06:01.569372 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-FloatingIPsTestJSON-86978126 Oct 08 21:06:01.569372 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: c7377184b37740f6898266ee5c621f44 Oct 08 21:06:01.569372 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-FloatingIPsTestJSON-86978126 Oct 08 21:06:01.569372 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-FloatingIPsTestJSON-86978126-project Oct 08 21:06:01.569372 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:06:01.569372 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:06:01.569372 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 88f002556c0f4584b29cb6dbea165876 Oct 08 21:06:01.569372 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-FloatingIPsTestJSON-86978126-project Oct 08 21:06:01.569372 ncdv-master-1 devstack@n-api.service[140491]: method: Oct 08 21:06:01.569372 ncdv-master-1 devstack@n-api.service[140491]: exception: Floating IP not found for ID c7fe23ad-e41d-4916-9ee9-4a622c51253f Oct 08 21:06:01.569372 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': 'c7fe23ad-e41d-4916-9ee9-4a622c51253f'} Oct 08 21:06:01.569372 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:06:01.569372 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:06:01.569372 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 08 21:06:01.569372 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 08 21:06:01.569372 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 08 21:06:01.569372 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 08 21:06:01.569372 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 08 21:06:01.569372 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 08 21:06:01.569372 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 08 21:06:01.569372 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 08 21:06:01.569372 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 08 21:06:01.569372 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 08 21:06:01.569372 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 08 21:06:01.569372 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 08 21:06:01.569372 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 08 21:06:01.569372 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 08 21:06:01.569372 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 08 21:06:01.569372 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 08 21:06:01.569372 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 08 21:06:01.569372 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 08 21:06:01.569372 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 08 21:06:01.569372 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 08 21:06:01.569372 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 08 21:06:01.569372 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 08 21:06:01.569372 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 08 21:06:01.569372 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 08 21:06:01.569372 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP c7fe23ad-e41d-4916-9ee9-4a622c51253f could not be found Oct 08 21:06:01.569372 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6fadc108-308a-48ab-bfe6-351b1cca9e8f'] Oct 08 21:06:01.569372 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:06:01.574875 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:06:01.574875 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:06:01.574875 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:06:01.574875 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Oct 08 21:06:01.574875 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 08 21:06:01.574875 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 08 21:06:01.574875 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 08 21:06:01.574875 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID c7fe23ad-e41d-4916-9ee9-4a622c51253f. Oct 08 21:06:01.574875 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:06:01.574875 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:06:01.574875 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:06:01.574875 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:06:01.574875 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:06:01.574875 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:06:01.574875 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:06:01.574875 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:06:01.574875 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 08 21:06:01.574875 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 08 21:06:01.574875 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:06:01.574875 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:06:01.574875 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Oct 08 21:06:01.574875 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 08 21:06:01.574875 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID c7fe23ad-e41d-4916-9ee9-4a622c51253f Oct 08 21:06:01.574875 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:06:01.574875 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:06:01.574875 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:06:01.574875 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:06:01.574875 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:06:01.574875 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:06:01.574875 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:06:01.574875 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:06:01.574875 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID c7fe23ad-e41d-4916-9ee9-4a622c51253f Oct 08 21:06:01.574875 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:06:01.579291 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-a423e946-3586-4e0e-8435-5e54ea2f5571 tempest-FloatingIPsTestJSON-86978126 tempest-FloatingIPsTestJSON-86978126-project] Returning 404 to user: Floating IP not found for ID c7fe23ad-e41d-4916-9ee9-4a622c51253f {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:06:01.581022 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-a423e946-3586-4e0e-8435-5e54ea2f5571 tempest-FloatingIPsTestJSON-86978126 tempest-FloatingIPsTestJSON-86978126-project] 10.222.0.26 "GET /compute/v2.1/os-floating-ips/c7fe23ad-e41d-4916-9ee9-4a622c51253f" status: 404 len: 111 microversion: 2.1 time: 0.424973 Oct 08 21:06:01.582315 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1649/3383] 10.222.0.26 () {58 vars in 1260 bytes} [Sat Oct 8 21:06:01 2022] GET /compute/v2.1/os-floating-ips/c7fe23ad-e41d-4916-9ee9-4a622c51253f => generated 111 bytes in 427 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:06:01.593986 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-cdcaa3c0-2842-4249-8718-ea3774173ec3 tempest-FloatingIPsTestJSON-86978126 tempest-FloatingIPsTestJSON-86978126-project] Calling method '.version_select at 0x7f1a87bde5e0>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:06:01.682536 ncdv-master-1 devstack@n-api.service[140491]: DEBUG neutronclient.v2_0.client [None req-cdcaa3c0-2842-4249-8718-ea3774173ec3 tempest-FloatingIPsTestJSON-86978126 tempest-FloatingIPsTestJSON-86978126-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP c7fe23ad-e41d-4916-9ee9-4a622c51253f could not be found", "detail": ""}} {{(pid=140491) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 08 21:06:01.683317 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-cdcaa3c0-2842-4249-8718-ea3774173ec3 tempest-FloatingIPsTestJSON-86978126 tempest-FloatingIPsTestJSON-86978126-project] HTTP exception thrown: Floating IP not found for ID c7fe23ad-e41d-4916-9ee9-4a622c51253f Oct 08 21:06:01.685264 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-cdcaa3c0-2842-4249-8718-ea3774173ec3 tempest-FloatingIPsTestJSON-86978126 tempest-FloatingIPsTestJSON-86978126-project] Request method failure captured: Oct 08 21:06:01.685264 ncdv-master-1 devstack@n-api.service[140491]: request: DELETE /compute/v2.1/os-floating-ips/c7fe23ad-e41d-4916-9ee9-4a622c51253f HTTP/1.1 Oct 08 21:06:01.685264 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:06:01.685264 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:06:01.685264 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:06:01.685264 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 21:06:01.685264 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:06:01.685264 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:06:01.685264 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:06:01.685264 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:06:01.685264 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeYl6767GbkFIRtRjSPlcFr2UTeqcJKCvd_jsPj6v53aQ7hJ7gXXO5EbRAlThM4CPz29X4od8kEVH2-hkbq5TO5AkoEFJ7NF7sCnQZl9lJye7AzEwuw6t7ujt7sXHHmkWwDR3XcGei5OrjhPz_5A0PKMpjBxhUhQ2Cr1DxuaywiVljM Oct 08 21:06:01.685264 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:06:01.685264 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:06:01.685264 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:06:01.685264 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:06:01.685264 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:06:01.685264 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:06:01.685264 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: c7377184b37740f6898266ee5c621f44 Oct 08 21:06:01.685264 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-FloatingIPsTestJSON-86978126 Oct 08 21:06:01.685264 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:06:01.685264 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:06:01.685264 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/c7377184b37740f6898266ee5c621f44"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c7377184b37740f6898266ee5c621f44"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_c7377184b37740f6898266ee5c621f44"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c7377184b37740f6898266ee5c621f44"}]}] Oct 08 21:06:01.685264 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-FloatingIPsTestJSON-86978126 Oct 08 21:06:01.685264 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: c7377184b37740f6898266ee5c621f44 Oct 08 21:06:01.685264 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-FloatingIPsTestJSON-86978126 Oct 08 21:06:01.685264 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-FloatingIPsTestJSON-86978126-project Oct 08 21:06:01.685264 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:06:01.685264 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:06:01.685264 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 88f002556c0f4584b29cb6dbea165876 Oct 08 21:06:01.685264 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-FloatingIPsTestJSON-86978126-project Oct 08 21:06:01.685264 ncdv-master-1 devstack@n-api.service[140491]: method: Oct 08 21:06:01.685264 ncdv-master-1 devstack@n-api.service[140491]: exception: Floating IP not found for ID c7fe23ad-e41d-4916-9ee9-4a622c51253f Oct 08 21:06:01.685264 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': 'c7fe23ad-e41d-4916-9ee9-4a622c51253f'} Oct 08 21:06:01.685264 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:06:01.685264 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:06:01.685264 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 08 21:06:01.685264 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 08 21:06:01.685264 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 08 21:06:01.685264 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 08 21:06:01.685264 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 08 21:06:01.685264 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 08 21:06:01.685264 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 08 21:06:01.685264 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 08 21:06:01.685264 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 08 21:06:01.685264 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 08 21:06:01.685264 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 08 21:06:01.685264 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 08 21:06:01.685264 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 08 21:06:01.685264 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 08 21:06:01.685264 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 08 21:06:01.685264 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 08 21:06:01.685264 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 08 21:06:01.685264 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 08 21:06:01.685264 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 08 21:06:01.685264 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 08 21:06:01.685264 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 08 21:06:01.685264 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 08 21:06:01.685264 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 08 21:06:01.685264 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 08 21:06:01.685264 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP c7fe23ad-e41d-4916-9ee9-4a622c51253f could not be found Oct 08 21:06:01.685264 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9f3ccce0-c174-4a16-8436-06c95c87d11b'] Oct 08 21:06:01.685264 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:06:01.690287 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:06:01.690287 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:06:01.690287 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:06:01.690287 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Oct 08 21:06:01.690287 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 08 21:06:01.690287 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 08 21:06:01.690287 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 08 21:06:01.690287 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID c7fe23ad-e41d-4916-9ee9-4a622c51253f. Oct 08 21:06:01.690287 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:06:01.690287 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:06:01.690287 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:06:01.690287 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:06:01.690287 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:06:01.690287 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:06:01.690287 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:06:01.690287 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:06:01.690287 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 08 21:06:01.690287 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 08 21:06:01.690287 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:06:01.690287 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:06:01.690287 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Oct 08 21:06:01.690287 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 08 21:06:01.690287 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID c7fe23ad-e41d-4916-9ee9-4a622c51253f Oct 08 21:06:01.690287 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:06:01.690287 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:06:01.690287 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:06:01.690287 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:06:01.690287 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:06:01.690287 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:06:01.690287 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:06:01.690287 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:06:01.690287 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID c7fe23ad-e41d-4916-9ee9-4a622c51253f Oct 08 21:06:01.690287 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:06:01.694504 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-cdcaa3c0-2842-4249-8718-ea3774173ec3 tempest-FloatingIPsTestJSON-86978126 tempest-FloatingIPsTestJSON-86978126-project] Returning 404 to user: Floating IP not found for ID c7fe23ad-e41d-4916-9ee9-4a622c51253f {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:06:01.695991 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-cdcaa3c0-2842-4249-8718-ea3774173ec3 tempest-FloatingIPsTestJSON-86978126 tempest-FloatingIPsTestJSON-86978126-project] 10.222.0.26 "DELETE /compute/v2.1/os-floating-ips/c7fe23ad-e41d-4916-9ee9-4a622c51253f" status: 404 len: 111 microversion: 2.1 time: 0.109133 Oct 08 21:06:01.696568 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1650/3384] 10.222.0.26 () {58 vars in 1263 bytes} [Sat Oct 8 21:06:01 2022] DELETE /compute/v2.1/os-floating-ips/c7fe23ad-e41d-4916-9ee9-4a622c51253f => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:06:01.731704 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-b666c0d0-b232-43ee-be04-e71943a8695b tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:06:01.734373 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-b666c0d0-b232-43ee-be04-e71943a8695b tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: edd393b3-ce87-41a9-a9c4-f3ad6a6f0130] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:06:01.742337 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b666c0d0-b232-43ee-be04-e71943a8695b tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:01.743092 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b666c0d0-b232-43ee-be04-e71943a8695b tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:01.743696 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b666c0d0-b232-43ee-be04-e71943a8695b tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:01.744579 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b666c0d0-b232-43ee-be04-e71943a8695b tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:01.745217 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b666c0d0-b232-43ee-be04-e71943a8695b tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:01.745804 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b666c0d0-b232-43ee-be04-e71943a8695b tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:02.423937 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-b666c0d0-b232-43ee-be04-e71943a8695b tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06443b5728fb4d1e95d6245820e786bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ded993145b4eda9d6a33b994519012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:02.432383 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-b666c0d0-b232-43ee-be04-e71943a8695b tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "GET /compute/v2.1/servers/edd393b3-ce87-41a9-a9c4-f3ad6a6f0130" status: 200 len: 1293 microversion: 2.1 time: 0.705287 Oct 08 21:06:02.445593 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1651/3385] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:06:01 2022] GET /compute/v2.1/servers/edd393b3-ce87-41a9-a9c4-f3ad6a6f0130 => generated 1293 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:06:02.454732 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-b5643f44-6e33-4558-9c42-a010756a32d4 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:06:02.455603 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-b5643f44-6e33-4558-9c42-a010756a32d4 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] [instance: 62ddef97-0025-4e6d-a62e-59a824562796] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:06:02.462006 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b5643f44-6e33-4558-9c42-a010756a32d4 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:02.462872 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b5643f44-6e33-4558-9c42-a010756a32d4 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:02.463476 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b5643f44-6e33-4558-9c42-a010756a32d4 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:02.464416 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b5643f44-6e33-4558-9c42-a010756a32d4 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:02.465099 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b5643f44-6e33-4558-9c42-a010756a32d4 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:02.465712 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b5643f44-6e33-4558-9c42-a010756a32d4 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:02.620653 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-b5643f44-6e33-4558-9c42-a010756a32d4 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5000948fa98a4b5d96ad27436d3d0edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917519b500674698a68dc01a4e8d68a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:02.629174 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-b5643f44-6e33-4558-9c42-a010756a32d4 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] 10.222.0.26 "GET /compute/v2.1/servers/62ddef97-0025-4e6d-a62e-59a824562796" status: 200 len: 1470 microversion: 2.1 time: 0.182208 Oct 08 21:06:02.629777 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1652/3386] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:06:02 2022] GET /compute/v2.1/servers/62ddef97-0025-4e6d-a62e-59a824562796 => generated 1470 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:06:02.634341 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-86f2d975-5cc8-4a7b-b835-a09530d4a77b req-419b7e24-7b97-4f19-89c6-82e71c693e1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "edd393b3-ce87-41a9-a9c4-f3ad6a6f0130", "tag": "b640a121-8510-4189-8a0e-189da869d29e"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:06:02.650123 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-86f2d975-5cc8-4a7b-b835-a09530d4a77b req-419b7e24-7b97-4f19-89c6-82e71c693e1a service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:02.650877 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-86f2d975-5cc8-4a7b-b835-a09530d4a77b req-419b7e24-7b97-4f19-89c6-82e71c693e1a service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:02.651479 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-86f2d975-5cc8-4a7b-b835-a09530d4a77b req-419b7e24-7b97-4f19-89c6-82e71c693e1a service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:02.666582 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-86f2d975-5cc8-4a7b-b835-a09530d4a77b req-419b7e24-7b97-4f19-89c6-82e71c693e1a service nova] Creating event network-changed:b640a121-8510-4189-8a0e-189da869d29e for instance edd393b3-ce87-41a9-a9c4-f3ad6a6f0130 on nch2-master-1 Oct 08 21:06:02.673143 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-86f2d975-5cc8-4a7b-b835-a09530d4a77b req-419b7e24-7b97-4f19-89c6-82e71c693e1a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041972 Oct 08 21:06:02.674377 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1653/3387] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:06:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:06:02.681240 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-fdc7fbcd-2273-4a66-a2d3-97fb520302f6 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:06:02.682160 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-fdc7fbcd-2273-4a66-a2d3-97fb520302f6 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] [instance: 4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:06:02.690818 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fdc7fbcd-2273-4a66-a2d3-97fb520302f6 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:02.691987 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fdc7fbcd-2273-4a66-a2d3-97fb520302f6 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:02.692606 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fdc7fbcd-2273-4a66-a2d3-97fb520302f6 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:02.693556 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fdc7fbcd-2273-4a66-a2d3-97fb520302f6 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:02.694323 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fdc7fbcd-2273-4a66-a2d3-97fb520302f6 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:02.694941 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fdc7fbcd-2273-4a66-a2d3-97fb520302f6 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:03.196952 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=2 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:06:03.255878 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=6 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:06:03.283233 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-fdc7fbcd-2273-4a66-a2d3-97fb520302f6 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc2bdd169daf4a1db830b1fa7f94f0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f2d56477794f8ab38b8e3535b3e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:03.293362 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-fdc7fbcd-2273-4a66-a2d3-97fb520302f6 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc2bdd169daf4a1db830b1fa7f94f0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f2d56477794f8ab38b8e3535b3e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:03.295016 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-fdc7fbcd-2273-4a66-a2d3-97fb520302f6 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc2bdd169daf4a1db830b1fa7f94f0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f2d56477794f8ab38b8e3535b3e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:03.296497 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-fdc7fbcd-2273-4a66-a2d3-97fb520302f6 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] 10.222.0.26 "GET /compute/v2.1/servers/4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21" status: 200 len: 1837 microversion: 2.32 time: 0.620862 Oct 08 21:06:03.297825 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1654/3388] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:06:02 2022] GET /compute/v2.1/servers/4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21 => generated 1837 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:06:03.305046 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-74d9579e-b47b-4be9-a6b6-a320a911e5fb req-d4213204-5402-42b7-bff5-0819ab778c92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62ddef97-0025-4e6d-a62e-59a824562796", "name": "network-vif-deleted", "tag": "bef0ec0e-7edd-4a86-a362-d936a6a729ed"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:06:03.315283 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-74d9579e-b47b-4be9-a6b6-a320a911e5fb req-d4213204-5402-42b7-bff5-0819ab778c92 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:03.316093 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-74d9579e-b47b-4be9-a6b6-a320a911e5fb req-d4213204-5402-42b7-bff5-0819ab778c92 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:03.316818 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-74d9579e-b47b-4be9-a6b6-a320a911e5fb req-d4213204-5402-42b7-bff5-0819ab778c92 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:03.330397 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-74d9579e-b47b-4be9-a6b6-a320a911e5fb req-d4213204-5402-42b7-bff5-0819ab778c92 service nova] Creating event network-vif-deleted:bef0ec0e-7edd-4a86-a362-d936a6a729ed for instance 62ddef97-0025-4e6d-a62e-59a824562796 on nch2-master-1 Oct 08 21:06:03.336096 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-74d9579e-b47b-4be9-a6b6-a320a911e5fb req-d4213204-5402-42b7-bff5-0819ab778c92 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036812 Oct 08 21:06:03.337171 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1655/3389] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:06:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:06:03.464417 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-406ea35c-7995-48b5-9fad-09ef2f2f146e tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:06:03.465878 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-406ea35c-7995-48b5-9fad-09ef2f2f146e tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: edd393b3-ce87-41a9-a9c4-f3ad6a6f0130] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:06:03.497150 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-406ea35c-7995-48b5-9fad-09ef2f2f146e tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:03.498213 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-406ea35c-7995-48b5-9fad-09ef2f2f146e tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:03.499001 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-406ea35c-7995-48b5-9fad-09ef2f2f146e tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:03.500745 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-406ea35c-7995-48b5-9fad-09ef2f2f146e tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:03.501638 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-406ea35c-7995-48b5-9fad-09ef2f2f146e tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:03.502284 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-406ea35c-7995-48b5-9fad-09ef2f2f146e tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:04.542012 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-406ea35c-7995-48b5-9fad-09ef2f2f146e tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06443b5728fb4d1e95d6245820e786bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ded993145b4eda9d6a33b994519012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:04.553035 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-406ea35c-7995-48b5-9fad-09ef2f2f146e tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "GET /compute/v2.1/servers/edd393b3-ce87-41a9-a9c4-f3ad6a6f0130" status: 200 len: 1293 microversion: 2.1 time: 1.096958 Oct 08 21:06:04.553906 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1656/3390] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:06:03 2022] GET /compute/v2.1/servers/edd393b3-ce87-41a9-a9c4-f3ad6a6f0130 => generated 1293 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:06:04.559430 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-a9a02265-df1e-4db8-ace4-a88b56e8cc0e tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:06:04.566386 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-a9a02265-df1e-4db8-ace4-a88b56e8cc0e tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] [instance: 62ddef97-0025-4e6d-a62e-59a824562796] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:06:04.580679 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a9a02265-df1e-4db8-ace4-a88b56e8cc0e tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:04.582645 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a9a02265-df1e-4db8-ace4-a88b56e8cc0e tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:04.585624 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a9a02265-df1e-4db8-ace4-a88b56e8cc0e tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:04.586698 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a9a02265-df1e-4db8-ace4-a88b56e8cc0e tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:04.587357 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a9a02265-df1e-4db8-ace4-a88b56e8cc0e tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:04.588777 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a9a02265-df1e-4db8-ace4-a88b56e8cc0e tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:04.641844 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-a9a02265-df1e-4db8-ace4-a88b56e8cc0e tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] HTTP exception thrown: Instance 62ddef97-0025-4e6d-a62e-59a824562796 could not be found. Oct 08 21:06:04.648539 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-a9a02265-df1e-4db8-ace4-a88b56e8cc0e tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Request method failure captured: Oct 08 21:06:04.648539 ncdv-master-1 devstack@n-api.service[140491]: request: GET /compute/v2.1/servers/62ddef97-0025-4e6d-a62e-59a824562796 HTTP/1.1 Oct 08 21:06:04.648539 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:06:04.648539 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:06:04.648539 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:06:04.648539 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 21:06:04.648539 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:06:04.648539 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:06:04.648539 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:06:04.648539 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:06:04.648539 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeXnFL1HUr3VqpswlaFCQH9LBdA9ltg3s7swmz0n-xPQMyGUNPsZE-pb8i3GV45alnrwqrfdVUi4KJ_6BmFJahNEup7wN12QmFTkrdfHepysw6xsqX5RdRQuQB5scCjHY092JKUmSVnDVntOH9ioeYZwTTT2rQUMD__JLZfO2xy_pDg Oct 08 21:06:04.648539 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:06:04.648539 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:06:04.648539 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:06:04.648539 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:06:04.648539 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:06:04.648539 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:06:04.648539 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 917519b500674698a68dc01a4e8d68a8 Oct 08 21:06:04.648539 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-MultipleCreateTestJSON-1652087706 Oct 08 21:06:04.648539 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:06:04.648539 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:06:04.648539 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/917519b500674698a68dc01a4e8d68a8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/917519b500674698a68dc01a4e8d68a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_917519b500674698a68dc01a4e8d68a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/917519b500674698a68dc01a4e8d68a8"}]}] Oct 08 21:06:04.648539 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-MultipleCreateTestJSON-1652087706 Oct 08 21:06:04.648539 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 917519b500674698a68dc01a4e8d68a8 Oct 08 21:06:04.648539 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1652087706 Oct 08 21:06:04.648539 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-MultipleCreateTestJSON-1652087706-project Oct 08 21:06:04.648539 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:06:04.648539 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:06:04.648539 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 5000948fa98a4b5d96ad27436d3d0edb Oct 08 21:06:04.648539 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-MultipleCreateTestJSON-1652087706-project Oct 08 21:06:04.648539 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:06:04.648539 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance 62ddef97-0025-4e6d-a62e-59a824562796 could not be found. Oct 08 21:06:04.648539 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': '62ddef97-0025-4e6d-a62e-59a824562796'} Oct 08 21:06:04.648539 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:06:04.648539 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:06:04.648539 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:06:04.648539 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:06:04.648539 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:06:04.648539 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:06:04.648539 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:06:04.648539 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:06:04.648539 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:06:04.648539 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:06:04.648539 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62ddef97-0025-4e6d-a62e-59a824562796 could not be found. Oct 08 21:06:04.648539 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:06:04.648539 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:06:04.648539 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:06:04.648539 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:06:04.648539 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:06:04.648539 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:06:04.648539 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:06:04.648539 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:06:04.648539 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:06:04.648539 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:06:04.648539 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:06:04.648539 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:06:04.648539 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:06:04.648539 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:06:04.648539 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:06:04.648539 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:06:04.648539 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62ddef97-0025-4e6d-a62e-59a824562796 could not be found. Oct 08 21:06:04.648539 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:06:04.648539 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:06:04.648539 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:06:04.653552 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:06:04.653552 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:06:04.653552 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:06:04.653552 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:06:04.653552 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:06:04.653552 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62ddef97-0025-4e6d-a62e-59a824562796 could not be found. Oct 08 21:06:04.653552 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:06:04.653552 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-a9a02265-df1e-4db8-ace4-a88b56e8cc0e tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Returning 404 to user: Instance 62ddef97-0025-4e6d-a62e-59a824562796 could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:06:04.653552 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-a9a02265-df1e-4db8-ace4-a88b56e8cc0e tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] 10.222.0.26 "GET /compute/v2.1/servers/62ddef97-0025-4e6d-a62e-59a824562796" status: 404 len: 111 microversion: 2.1 time: 0.095551 Oct 08 21:06:04.656113 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1657/3391] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:06:04 2022] GET /compute/v2.1/servers/62ddef97-0025-4e6d-a62e-59a824562796 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:06:04.662219 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-e450b4ad-4035-4b4b-912c-de9583a7ad0b tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:06:04.666982 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-e450b4ad-4035-4b4b-912c-de9583a7ad0b tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] [instance: 4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:06:04.685700 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e450b4ad-4035-4b4b-912c-de9583a7ad0b tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:04.688551 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e450b4ad-4035-4b4b-912c-de9583a7ad0b tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:04.690633 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e450b4ad-4035-4b4b-912c-de9583a7ad0b tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:04.692138 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e450b4ad-4035-4b4b-912c-de9583a7ad0b tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:04.692834 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e450b4ad-4035-4b4b-912c-de9583a7ad0b tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:04.693457 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e450b4ad-4035-4b4b-912c-de9583a7ad0b tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:05.026192 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.network.neutron [None req-ddc74e3b-9da2-4533-b686-136ff658dc5d tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] [instance: de9d6639-040b-44b7-b00a-c1022c705c89] Building network info cache for instance {{(pid=140492) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 08 21:06:05.289375 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-e450b4ad-4035-4b4b-912c-de9583a7ad0b tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc2bdd169daf4a1db830b1fa7f94f0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f2d56477794f8ab38b8e3535b3e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:05.310322 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-e450b4ad-4035-4b4b-912c-de9583a7ad0b tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc2bdd169daf4a1db830b1fa7f94f0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f2d56477794f8ab38b8e3535b3e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:05.316492 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-e450b4ad-4035-4b4b-912c-de9583a7ad0b tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc2bdd169daf4a1db830b1fa7f94f0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f2d56477794f8ab38b8e3535b3e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:05.322367 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-e450b4ad-4035-4b4b-912c-de9583a7ad0b tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] 10.222.0.26 "GET /compute/v2.1/servers/4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21" status: 200 len: 1837 microversion: 2.32 time: 0.662893 Oct 08 21:06:05.324944 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1658/3392] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:06:04 2022] GET /compute/v2.1/servers/4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21 => generated 1837 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:06:05.343406 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-ddef69b0-5326-4237-a496-fec7ed1cc327 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:06:05.345976 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-ddef69b0-5326-4237-a496-fec7ed1cc327 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] [instance: 47d524a3-cb1f-4972-9ffb-a8225135461f] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:06:05.365664 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ddef69b0-5326-4237-a496-fec7ed1cc327 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:05.366550 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ddef69b0-5326-4237-a496-fec7ed1cc327 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:05.369756 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ddef69b0-5326-4237-a496-fec7ed1cc327 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:05.370800 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ddef69b0-5326-4237-a496-fec7ed1cc327 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:05.373404 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ddef69b0-5326-4237-a496-fec7ed1cc327 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:05.374679 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ddef69b0-5326-4237-a496-fec7ed1cc327 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:05.405892 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-ddef69b0-5326-4237-a496-fec7ed1cc327 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] HTTP exception thrown: Instance 47d524a3-cb1f-4972-9ffb-a8225135461f could not be found. Oct 08 21:06:05.417496 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-ddef69b0-5326-4237-a496-fec7ed1cc327 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Request method failure captured: Oct 08 21:06:05.417496 ncdv-master-1 devstack@n-api.service[140491]: request: GET /compute/v2.1/servers/47d524a3-cb1f-4972-9ffb-a8225135461f HTTP/1.1 Oct 08 21:06:05.417496 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:06:05.417496 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:06:05.417496 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:06:05.417496 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 21:06:05.417496 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:06:05.417496 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:06:05.417496 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:06:05.417496 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:06:05.417496 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeXnFL1HUr3VqpswlaFCQH9LBdA9ltg3s7swmz0n-xPQMyGUNPsZE-pb8i3GV45alnrwqrfdVUi4KJ_6BmFJahNEup7wN12QmFTkrdfHepysw6xsqX5RdRQuQB5scCjHY092JKUmSVnDVntOH9ioeYZwTTT2rQUMD__JLZfO2xy_pDg Oct 08 21:06:05.417496 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:06:05.417496 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:06:05.417496 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:06:05.417496 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:06:05.417496 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:06:05.417496 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:06:05.417496 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 917519b500674698a68dc01a4e8d68a8 Oct 08 21:06:05.417496 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-MultipleCreateTestJSON-1652087706 Oct 08 21:06:05.417496 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:06:05.417496 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:06:05.417496 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/917519b500674698a68dc01a4e8d68a8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/917519b500674698a68dc01a4e8d68a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_917519b500674698a68dc01a4e8d68a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/917519b500674698a68dc01a4e8d68a8"}]}] Oct 08 21:06:05.417496 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-MultipleCreateTestJSON-1652087706 Oct 08 21:06:05.417496 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 917519b500674698a68dc01a4e8d68a8 Oct 08 21:06:05.417496 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1652087706 Oct 08 21:06:05.417496 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-MultipleCreateTestJSON-1652087706-project Oct 08 21:06:05.417496 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:06:05.417496 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:06:05.417496 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 5000948fa98a4b5d96ad27436d3d0edb Oct 08 21:06:05.417496 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-MultipleCreateTestJSON-1652087706-project Oct 08 21:06:05.417496 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:06:05.417496 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance 47d524a3-cb1f-4972-9ffb-a8225135461f could not be found. Oct 08 21:06:05.417496 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': '47d524a3-cb1f-4972-9ffb-a8225135461f'} Oct 08 21:06:05.417496 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:06:05.417496 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:06:05.417496 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:06:05.417496 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:06:05.417496 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:06:05.417496 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:06:05.417496 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:06:05.417496 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:06:05.417496 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:06:05.417496 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:06:05.417496 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47d524a3-cb1f-4972-9ffb-a8225135461f could not be found. Oct 08 21:06:05.417496 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:06:05.417496 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:06:05.417496 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:06:05.417496 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:06:05.417496 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:06:05.417496 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:06:05.417496 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:06:05.417496 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:06:05.417496 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:06:05.417496 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:06:05.417496 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:06:05.417496 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:06:05.417496 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:06:05.417496 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:06:05.417496 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:06:05.417496 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:06:05.417496 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47d524a3-cb1f-4972-9ffb-a8225135461f could not be found. Oct 08 21:06:05.417496 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:06:05.417496 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:06:05.417496 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:06:05.421796 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:06:05.421796 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:06:05.421796 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:06:05.421796 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:06:05.421796 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:06:05.421796 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47d524a3-cb1f-4972-9ffb-a8225135461f could not be found. Oct 08 21:06:05.421796 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:06:05.421796 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-ddef69b0-5326-4237-a496-fec7ed1cc327 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] Returning 404 to user: Instance 47d524a3-cb1f-4972-9ffb-a8225135461f could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:06:05.429144 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-ddef69b0-5326-4237-a496-fec7ed1cc327 tempest-MultipleCreateTestJSON-1652087706 tempest-MultipleCreateTestJSON-1652087706-project] 10.222.0.26 "GET /compute/v2.1/servers/47d524a3-cb1f-4972-9ffb-a8225135461f" status: 404 len: 111 microversion: 2.1 time: 0.100140 Oct 08 21:06:05.429915 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1659/3393] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:06:05 2022] GET /compute/v2.1/servers/47d524a3-cb1f-4972-9ffb-a8225135461f => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:06:05.437354 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-f6bcd988-4b52-4237-8cd4-7a532f98ad0f tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:06:05.437944 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-f6bcd988-4b52-4237-8cd4-7a532f98ad0f tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] [instance: dbacaeed-a40b-4e05-9635-5073dfdd8621] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:06:05.444768 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f6bcd988-4b52-4237-8cd4-7a532f98ad0f tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:05.445559 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f6bcd988-4b52-4237-8cd4-7a532f98ad0f tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:05.446229 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f6bcd988-4b52-4237-8cd4-7a532f98ad0f tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:05.447214 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f6bcd988-4b52-4237-8cd4-7a532f98ad0f tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:05.447875 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f6bcd988-4b52-4237-8cd4-7a532f98ad0f tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:05.448502 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f6bcd988-4b52-4237-8cd4-7a532f98ad0f tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:05.511150 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-f6bcd988-4b52-4237-8cd4-7a532f98ad0f tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] 10.222.0.26 "GET /compute/v2.1/servers/dbacaeed-a40b-4e05-9635-5073dfdd8621/ips" status: 200 len: 152 microversion: 2.20 time: 0.078186 Oct 08 21:06:05.516906 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1660/3394] 10.222.0.26 () {60 vars in 1289 bytes} [Sat Oct 8 21:06:05 2022] GET /compute/v2.1/servers/dbacaeed-a40b-4e05-9635-5073dfdd8621/ips => generated 152 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 08 21:06:05.529639 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-7896a382-6d12-4ff3-a7d1-d7adb6195d04 req-f74ea7ae-f9de-47f8-9abb-6cc0fad525d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47d524a3-cb1f-4972-9ffb-a8225135461f", "name": "network-vif-deleted", "tag": "5f0872bf-ee36-4d31-b198-5c58bf1eae9e"}, {"name": "network-changed", "server_uuid": "ce4a2fbf-76f3-4577-a704-3b64ec30d84b", "tag": "0ad7b806-8ee9-493c-a2da-3f9bc61bb980"}, {"server_uuid": "58ad88cd-b5d3-4aac-ae20-857736605fa0", "name": "network-vif-deleted", "tag": "b52b4792-7889-4b9f-ab09-74d565a895ac"}, {"name": "network-changed", "server_uuid": "de9d6639-040b-44b7-b00a-c1022c705c89", "tag": "ca9cb617-2f51-474b-b74d-d32ecd4a80b9"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:06:05.546434 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-7896a382-6d12-4ff3-a7d1-d7adb6195d04 req-f74ea7ae-f9de-47f8-9abb-6cc0fad525d6 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:05.547689 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-7896a382-6d12-4ff3-a7d1-d7adb6195d04 req-f74ea7ae-f9de-47f8-9abb-6cc0fad525d6 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:05.548309 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-7896a382-6d12-4ff3-a7d1-d7adb6195d04 req-f74ea7ae-f9de-47f8-9abb-6cc0fad525d6 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:05.584264 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-7896a382-6d12-4ff3-a7d1-d7adb6195d04 req-f74ea7ae-f9de-47f8-9abb-6cc0fad525d6 service nova] Creating event network-vif-deleted:5f0872bf-ee36-4d31-b198-5c58bf1eae9e for instance 47d524a3-cb1f-4972-9ffb-a8225135461f on nch2-master-1 Oct 08 21:06:05.584818 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-7896a382-6d12-4ff3-a7d1-d7adb6195d04 req-f74ea7ae-f9de-47f8-9abb-6cc0fad525d6 service nova] Creating event network-changed:0ad7b806-8ee9-493c-a2da-3f9bc61bb980 for instance ce4a2fbf-76f3-4577-a704-3b64ec30d84b on nch1-master-1 Oct 08 21:06:05.585345 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-7896a382-6d12-4ff3-a7d1-d7adb6195d04 req-f74ea7ae-f9de-47f8-9abb-6cc0fad525d6 service nova] Creating event network-vif-deleted:b52b4792-7889-4b9f-ab09-74d565a895ac for instance 58ad88cd-b5d3-4aac-ae20-857736605fa0 on nch1-master-1 Oct 08 21:06:05.585848 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-7896a382-6d12-4ff3-a7d1-d7adb6195d04 req-f74ea7ae-f9de-47f8-9abb-6cc0fad525d6 service nova] Creating event network-changed:ca9cb617-2f51-474b-b74d-d32ecd4a80b9 for instance de9d6639-040b-44b7-b00a-c1022c705c89 on nch1-master-1 Oct 08 21:06:05.599334 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-7896a382-6d12-4ff3-a7d1-d7adb6195d04 req-f74ea7ae-f9de-47f8-9abb-6cc0fad525d6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 688 microversion: 2.1 time: 0.074218 Oct 08 21:06:05.601012 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1661/3395] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:06:05 2022] POST /compute/v2.1/os-server-external-events => generated 688 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:06:05.621229 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-602b8eaa-af42-4942-a09c-02a005759c0e tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:06:05.622134 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-602b8eaa-af42-4942-a09c-02a005759c0e tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: edd393b3-ce87-41a9-a9c4-f3ad6a6f0130] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:06:05.631408 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-602b8eaa-af42-4942-a09c-02a005759c0e tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:05.632257 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-602b8eaa-af42-4942-a09c-02a005759c0e tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:05.632881 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-602b8eaa-af42-4942-a09c-02a005759c0e tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:05.638779 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-602b8eaa-af42-4942-a09c-02a005759c0e tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:05.640112 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-602b8eaa-af42-4942-a09c-02a005759c0e tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:05.640774 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-602b8eaa-af42-4942-a09c-02a005759c0e tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:05.648276 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=93,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=3,nova_cell1:RELEASE=1,nova_cell1:INSERT=2 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:06:06.496676 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-602b8eaa-af42-4942-a09c-02a005759c0e tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06443b5728fb4d1e95d6245820e786bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ded993145b4eda9d6a33b994519012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:06.526604 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-602b8eaa-af42-4942-a09c-02a005759c0e tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "GET /compute/v2.1/servers/edd393b3-ce87-41a9-a9c4-f3ad6a6f0130" status: 200 len: 1293 microversion: 2.1 time: 0.923271 Oct 08 21:06:06.532328 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1662/3396] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:06:05 2022] GET /compute/v2.1/servers/edd393b3-ce87-41a9-a9c4-f3ad6a6f0130 => generated 1293 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:06:06.547746 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-ad217053-e640-4715-9081-1593109a6f5e req-55a0f8b6-512d-4db3-884a-5139da7d377f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21", "tag": "35b26276-a306-4edc-9bc3-3ed3302b5672"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:06:06.598156 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-ad217053-e640-4715-9081-1593109a6f5e req-55a0f8b6-512d-4db3-884a-5139da7d377f service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:06.600370 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-ad217053-e640-4715-9081-1593109a6f5e req-55a0f8b6-512d-4db3-884a-5139da7d377f service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:06.601109 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-ad217053-e640-4715-9081-1593109a6f5e req-55a0f8b6-512d-4db3-884a-5139da7d377f service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:06.643512 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-ad217053-e640-4715-9081-1593109a6f5e req-55a0f8b6-512d-4db3-884a-5139da7d377f service nova] Creating event network-changed:35b26276-a306-4edc-9bc3-3ed3302b5672 for instance 4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21 on nch1-master-1 Oct 08 21:06:06.653468 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-ad217053-e640-4715-9081-1593109a6f5e req-55a0f8b6-512d-4db3-884a-5139da7d377f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119170 Oct 08 21:06:06.658186 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1663/3397] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:06:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:06:06.666804 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.network.neutron [None req-ddc74e3b-9da2-4533-b686-136ff658dc5d tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] [instance: de9d6639-040b-44b7-b00a-c1022c705c89] Updating instance_info_cache with network_info: [{"id": "ca9cb617-2f51-474b-b74d-d32ecd4a80b9", "address": "fa:16:3e:fd:94:07", "network": {"id": "b449bb70-491a-439e-8976-e26644902f7a", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-134175099-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.5.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "c405aac48e9b403ca8d1e3ac28fab76e", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapca9cb617-2f", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=140492) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 08 21:06:06.675429 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-0ee2e2a4-1546-4f7e-91fb-8e8a7eaebc06 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:06:06.683923 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-0ee2e2a4-1546-4f7e-91fb-8e8a7eaebc06 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] [instance: 4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:06:06.695175 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ddc74e3b-9da2-4533-b686-136ff658dc5d tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Releasing lock "refresh_cache-de9d6639-040b-44b7-b00a-c1022c705c89" {{(pid=140492) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 08 21:06:06.696254 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-ddc74e3b-9da2-4533-b686-136ff658dc5d tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] 10.222.0.26 "POST /compute/v2.1/servers/de9d6639-040b-44b7-b00a-c1022c705c89/action" status: 202 len: 0 microversion: 2.1 time: 5.944164 Oct 08 21:06:06.698265 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1735/3398] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:06:00 2022] POST /compute/v2.1/servers/de9d6639-040b-44b7-b00a-c1022c705c89/action => generated 0 bytes in 5947 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 08 21:06:06.702667 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0ee2e2a4-1546-4f7e-91fb-8e8a7eaebc06 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:06.704808 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0ee2e2a4-1546-4f7e-91fb-8e8a7eaebc06 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:06.705830 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0ee2e2a4-1546-4f7e-91fb-8e8a7eaebc06 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:06.708623 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0ee2e2a4-1546-4f7e-91fb-8e8a7eaebc06 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:06.709817 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0ee2e2a4-1546-4f7e-91fb-8e8a7eaebc06 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:06.711722 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0ee2e2a4-1546-4f7e-91fb-8e8a7eaebc06 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:06.725384 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-2edb6c82-0218-4332-b6ff-626da237796a tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Calling method '.version_select at 0x7f1a8c134820>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:06:07.238485 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-2edb6c82-0218-4332-b6ff-626da237796a tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] 10.222.0.26 "GET /compute/v2.1/os-floating-ips/52727b29-e01e-4fe4-bdaf-d1972b896bcc" status: 200 len: 184 microversion: 2.1 time: 0.519995 Oct 08 21:06:07.241524 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1736/3399] 10.222.0.26 () {58 vars in 1260 bytes} [Sat Oct 8 21:06:06 2022] GET /compute/v2.1/os-floating-ips/52727b29-e01e-4fe4-bdaf-d1972b896bcc => generated 184 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:06:07.252142 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-0d0adc76-3dc1-47fa-b38d-c35ce4b193a5 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.5.73"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:06:07.533853 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-0d0adc76-3dc1-47fa-b38d-c35ce4b193a5 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] [instance: de9d6639-040b-44b7-b00a-c1022c705c89] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:06:07.541631 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0d0adc76-3dc1-47fa-b38d-c35ce4b193a5 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:07.544207 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0d0adc76-3dc1-47fa-b38d-c35ce4b193a5 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:07.545269 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0d0adc76-3dc1-47fa-b38d-c35ce4b193a5 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:07.546296 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0d0adc76-3dc1-47fa-b38d-c35ce4b193a5 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:07.548247 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0d0adc76-3dc1-47fa-b38d-c35ce4b193a5 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:07.548917 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0d0adc76-3dc1-47fa-b38d-c35ce4b193a5 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:07.900902 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-0ee2e2a4-1546-4f7e-91fb-8e8a7eaebc06 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc2bdd169daf4a1db830b1fa7f94f0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f2d56477794f8ab38b8e3535b3e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:07.918485 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-0ee2e2a4-1546-4f7e-91fb-8e8a7eaebc06 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc2bdd169daf4a1db830b1fa7f94f0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f2d56477794f8ab38b8e3535b3e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:07.923785 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-0ee2e2a4-1546-4f7e-91fb-8e8a7eaebc06 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc2bdd169daf4a1db830b1fa7f94f0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f2d56477794f8ab38b8e3535b3e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:07.927173 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-0ee2e2a4-1546-4f7e-91fb-8e8a7eaebc06 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] 10.222.0.26 "GET /compute/v2.1/servers/4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21" status: 200 len: 1837 microversion: 2.32 time: 1.264880 Oct 08 21:06:07.929145 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1664/3400] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:06:06 2022] GET /compute/v2.1/servers/4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21 => generated 1837 bytes in 1267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:06:07.939230 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-8bfd512f-03e8-437e-99ae-2f362145a09b tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:06:07.940191 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-8bfd512f-03e8-437e-99ae-2f362145a09b tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: edd393b3-ce87-41a9-a9c4-f3ad6a6f0130] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:06:07.947219 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8bfd512f-03e8-437e-99ae-2f362145a09b tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:07.948072 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8bfd512f-03e8-437e-99ae-2f362145a09b tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:07.948871 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8bfd512f-03e8-437e-99ae-2f362145a09b tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:07.950005 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8bfd512f-03e8-437e-99ae-2f362145a09b tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:07.950488 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8bfd512f-03e8-437e-99ae-2f362145a09b tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:07.950877 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0d0adc76-3dc1-47fa-b38d-c35ce4b193a5 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Acquiring lock "refresh_cache-de9d6639-040b-44b7-b00a-c1022c705c89" {{(pid=140492) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 08 21:06:07.951344 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8bfd512f-03e8-437e-99ae-2f362145a09b tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:07.951450 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0d0adc76-3dc1-47fa-b38d-c35ce4b193a5 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Acquired lock "refresh_cache-de9d6639-040b-44b7-b00a-c1022c705c89" {{(pid=140492) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 08 21:06:08.751423 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-8bfd512f-03e8-437e-99ae-2f362145a09b tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06443b5728fb4d1e95d6245820e786bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ded993145b4eda9d6a33b994519012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:08.759645 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-8bfd512f-03e8-437e-99ae-2f362145a09b tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "GET /compute/v2.1/servers/edd393b3-ce87-41a9-a9c4-f3ad6a6f0130" status: 200 len: 1293 microversion: 2.1 time: 0.828755 Oct 08 21:06:08.774174 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1665/3401] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:06:07 2022] GET /compute/v2.1/servers/edd393b3-ce87-41a9-a9c4-f3ad6a6f0130 => generated 1293 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:06:08.785373 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-1a5c7326-9732-475a-a132-777411273d99 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:06:08.785373 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-1a5c7326-9732-475a-a132-777411273d99 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] [instance: dbacaeed-a40b-4e05-9635-5073dfdd8621] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:06:08.803032 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1a5c7326-9732-475a-a132-777411273d99 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:08.803865 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1a5c7326-9732-475a-a132-777411273d99 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:08.804489 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1a5c7326-9732-475a-a132-777411273d99 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:08.805320 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1a5c7326-9732-475a-a132-777411273d99 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:08.805855 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1a5c7326-9732-475a-a132-777411273d99 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:08.806356 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1a5c7326-9732-475a-a132-777411273d99 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:08.870019 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.objects.instance [None req-1a5c7326-9732-475a-a132-777411273d99 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lazy-loading 'flavor' on Instance uuid dbacaeed-a40b-4e05-9635-5073dfdd8621 {{(pid=140491) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 21:06:08.896346 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.network.neutron [None req-0d0adc76-3dc1-47fa-b38d-c35ce4b193a5 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] [instance: de9d6639-040b-44b7-b00a-c1022c705c89] Building network info cache for instance {{(pid=140492) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 08 21:06:09.172154 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-1a5c7326-9732-475a-a132-777411273d99 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] 10.222.0.26 "POST /compute/v2.1/servers/dbacaeed-a40b-4e05-9635-5073dfdd8621/action" status: 202 len: 0 microversion: 2.20 time: 0.394704 Oct 08 21:06:09.173078 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1666/3402] 10.222.0.26 () {62 vars in 1319 bytes} [Sat Oct 8 21:06:08 2022] POST /compute/v2.1/servers/dbacaeed-a40b-4e05-9635-5073dfdd8621/action => generated 0 bytes in 399 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 08 21:06:09.197460 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-99bcbd1f-1e45-4fb6-a58b-94b48d4f1a49 req-3d31cee8-7688-46b0-aae3-56bf11325852 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edd393b3-ce87-41a9-a9c4-f3ad6a6f0130", "name": "network-vif-plugged", "status": "completed", "tag": "b640a121-8510-4189-8a0e-189da869d29e"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:06:09.214811 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-99bcbd1f-1e45-4fb6-a58b-94b48d4f1a49 req-3d31cee8-7688-46b0-aae3-56bf11325852 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:09.215657 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-99bcbd1f-1e45-4fb6-a58b-94b48d4f1a49 req-3d31cee8-7688-46b0-aae3-56bf11325852 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:09.216310 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-99bcbd1f-1e45-4fb6-a58b-94b48d4f1a49 req-3d31cee8-7688-46b0-aae3-56bf11325852 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:09.231671 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-99bcbd1f-1e45-4fb6-a58b-94b48d4f1a49 req-3d31cee8-7688-46b0-aae3-56bf11325852 service nova] Creating event network-vif-plugged:b640a121-8510-4189-8a0e-189da869d29e for instance edd393b3-ce87-41a9-a9c4-f3ad6a6f0130 on nch2-master-1 Oct 08 21:06:09.239044 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-99bcbd1f-1e45-4fb6-a58b-94b48d4f1a49 req-3d31cee8-7688-46b0-aae3-56bf11325852 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049108 Oct 08 21:06:09.241582 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1667/3403] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:06:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:06:09.248330 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-30eb297c-5c3b-4a39-b407-9bb47f95072f req-f4fb558c-e3dc-4dfb-b2be-fd45125209b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de9d6639-040b-44b7-b00a-c1022c705c89", "tag": "ca9cb617-2f51-474b-b74d-d32ecd4a80b9"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:06:09.260514 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-30eb297c-5c3b-4a39-b407-9bb47f95072f req-f4fb558c-e3dc-4dfb-b2be-fd45125209b0 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:09.261424 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-30eb297c-5c3b-4a39-b407-9bb47f95072f req-f4fb558c-e3dc-4dfb-b2be-fd45125209b0 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:09.262724 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-30eb297c-5c3b-4a39-b407-9bb47f95072f req-f4fb558c-e3dc-4dfb-b2be-fd45125209b0 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:09.278096 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-30eb297c-5c3b-4a39-b407-9bb47f95072f req-f4fb558c-e3dc-4dfb-b2be-fd45125209b0 service nova] Creating event network-changed:ca9cb617-2f51-474b-b74d-d32ecd4a80b9 for instance de9d6639-040b-44b7-b00a-c1022c705c89 on nch1-master-1 Oct 08 21:06:09.284317 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-30eb297c-5c3b-4a39-b407-9bb47f95072f req-f4fb558c-e3dc-4dfb-b2be-fd45125209b0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040217 Oct 08 21:06:09.285868 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1668/3404] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:06:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:06:09.291278 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-8916efe7-162e-4349-818e-1a9efc71c65d tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:06:09.292284 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-8916efe7-162e-4349-818e-1a9efc71c65d tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] [instance: 4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:06:09.300348 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8916efe7-162e-4349-818e-1a9efc71c65d tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:09.301336 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8916efe7-162e-4349-818e-1a9efc71c65d tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:09.302284 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8916efe7-162e-4349-818e-1a9efc71c65d tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:09.304045 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8916efe7-162e-4349-818e-1a9efc71c65d tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:09.304947 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8916efe7-162e-4349-818e-1a9efc71c65d tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:09.306165 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8916efe7-162e-4349-818e-1a9efc71c65d tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:09.900139 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.network.neutron [None req-0d0adc76-3dc1-47fa-b38d-c35ce4b193a5 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] [instance: de9d6639-040b-44b7-b00a-c1022c705c89] Updating instance_info_cache with network_info: [{"id": "ca9cb617-2f51-474b-b74d-d32ecd4a80b9", "address": "fa:16:3e:fd:94:07", "network": {"id": "b449bb70-491a-439e-8976-e26644902f7a", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-134175099-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "c405aac48e9b403ca8d1e3ac28fab76e", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapca9cb617-2f", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=140492) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 08 21:06:09.923696 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0d0adc76-3dc1-47fa-b38d-c35ce4b193a5 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Releasing lock "refresh_cache-de9d6639-040b-44b7-b00a-c1022c705c89" {{(pid=140492) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 08 21:06:09.924716 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-0d0adc76-3dc1-47fa-b38d-c35ce4b193a5 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] 10.222.0.26 "POST /compute/v2.1/servers/de9d6639-040b-44b7-b00a-c1022c705c89/action" status: 202 len: 0 microversion: 2.1 time: 2.677095 Oct 08 21:06:09.931909 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1737/3405] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:06:07 2022] POST /compute/v2.1/servers/de9d6639-040b-44b7-b00a-c1022c705c89/action => generated 0 bytes in 2681 msecs (HTTP/1.1 202) 9 headers in 369 bytes (2 switches on core 0) Oct 08 21:06:09.943864 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-a180273e-4552-440e-8d74-0584055f2dfc tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:06:09.946410 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-a180273e-4552-440e-8d74-0584055f2dfc tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] [instance: dbacaeed-a40b-4e05-9635-5073dfdd8621] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:06:09.959070 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a180273e-4552-440e-8d74-0584055f2dfc tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:09.959703 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a180273e-4552-440e-8d74-0584055f2dfc tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:09.960269 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a180273e-4552-440e-8d74-0584055f2dfc tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:09.961561 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a180273e-4552-440e-8d74-0584055f2dfc tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:09.962271 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a180273e-4552-440e-8d74-0584055f2dfc tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:09.962814 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a180273e-4552-440e-8d74-0584055f2dfc tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:10.275373 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-8916efe7-162e-4349-818e-1a9efc71c65d tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc2bdd169daf4a1db830b1fa7f94f0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f2d56477794f8ab38b8e3535b3e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:10.290706 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-8916efe7-162e-4349-818e-1a9efc71c65d tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc2bdd169daf4a1db830b1fa7f94f0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f2d56477794f8ab38b8e3535b3e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:10.292203 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-8916efe7-162e-4349-818e-1a9efc71c65d tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc2bdd169daf4a1db830b1fa7f94f0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f2d56477794f8ab38b8e3535b3e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:10.294273 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-8916efe7-162e-4349-818e-1a9efc71c65d tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] 10.222.0.26 "GET /compute/v2.1/servers/4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21" status: 200 len: 1858 microversion: 2.32 time: 1.006183 Oct 08 21:06:10.295236 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1669/3406] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:06:09 2022] GET /compute/v2.1/servers/4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21 => generated 1858 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:06:10.316360 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-1afd7b31-6be6-4879-a66a-f96ba297ef92 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:06:10.316996 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-1afd7b31-6be6-4879-a66a-f96ba297ef92 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: edd393b3-ce87-41a9-a9c4-f3ad6a6f0130] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:06:10.339193 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1afd7b31-6be6-4879-a66a-f96ba297ef92 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:10.340780 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1afd7b31-6be6-4879-a66a-f96ba297ef92 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:10.341576 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1afd7b31-6be6-4879-a66a-f96ba297ef92 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:10.342331 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1afd7b31-6be6-4879-a66a-f96ba297ef92 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:10.345497 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1afd7b31-6be6-4879-a66a-f96ba297ef92 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:10.345969 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1afd7b31-6be6-4879-a66a-f96ba297ef92 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:10.690654 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-a180273e-4552-440e-8d74-0584055f2dfc tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:10.714395 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-a180273e-4552-440e-8d74-0584055f2dfc tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:10.717579 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-a180273e-4552-440e-8d74-0584055f2dfc tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:10.719516 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-a180273e-4552-440e-8d74-0584055f2dfc tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] 10.222.0.26 "GET /compute/v2.1/servers/dbacaeed-a40b-4e05-9635-5073dfdd8621" status: 200 len: 1723 microversion: 2.20 time: 0.789474 Oct 08 21:06:10.734485 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1738/3407] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:06:09 2022] GET /compute/v2.1/servers/dbacaeed-a40b-4e05-9635-5073dfdd8621 => generated 1723 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:06:10.747470 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-8ee39b6d-7cde-45bf-8550-c3772c6ac322 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:06:10.748225 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-8ee39b6d-7cde-45bf-8550-c3772c6ac322 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] [instance: 58ad88cd-b5d3-4aac-ae20-857736605fa0] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:06:10.757850 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8ee39b6d-7cde-45bf-8550-c3772c6ac322 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:10.758615 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8ee39b6d-7cde-45bf-8550-c3772c6ac322 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:10.759769 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8ee39b6d-7cde-45bf-8550-c3772c6ac322 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:10.760770 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8ee39b6d-7cde-45bf-8550-c3772c6ac322 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:10.761772 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8ee39b6d-7cde-45bf-8550-c3772c6ac322 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:10.762864 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8ee39b6d-7cde-45bf-8550-c3772c6ac322 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:10.789809 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-8ee39b6d-7cde-45bf-8550-c3772c6ac322 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] HTTP exception thrown: Instance 58ad88cd-b5d3-4aac-ae20-857736605fa0 could not be found. Oct 08 21:06:10.792146 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-8ee39b6d-7cde-45bf-8550-c3772c6ac322 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Request method failure captured: Oct 08 21:06:10.792146 ncdv-master-1 devstack@n-api.service[140492]: request: DELETE /compute/v2.1/servers/58ad88cd-b5d3-4aac-ae20-857736605fa0 HTTP/1.1 Oct 08 21:06:10.792146 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:06:10.792146 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:06:10.792146 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:06:10.792146 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 21:06:10.792146 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:06:10.792146 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:06:10.792146 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:06:10.792146 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:06:10.792146 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeXi16tkz_i1i7XbkgwY21JByktYX4GDP2nafLDfRJ1Rxq_b8BRtnCkaucvQt5-aBmzBGGT0K7woxgqPe_-7FRNV3MYD__u7v5IA0oeJ8DXdW7CG-IicMcSS5pGOZ95X2MGqNk7LSfwuDAJhCMfRn7FBMQvBzJdyTOeT1qaoWuuugbU Oct 08 21:06:10.792146 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:06:10.792146 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:06:10.792146 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:06:10.792146 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:06:10.792146 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:06:10.792146 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:06:10.792146 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: c405aac48e9b403ca8d1e3ac28fab76e Oct 08 21:06:10.792146 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-746342360 Oct 08 21:06:10.792146 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:06:10.792146 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:06:10.792146 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/c405aac48e9b403ca8d1e3ac28fab76e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c405aac48e9b403ca8d1e3ac28fab76e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_c405aac48e9b403ca8d1e3ac28fab76e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c405aac48e9b403ca8d1e3ac28fab76e"}]}] Oct 08 21:06:10.792146 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-746342360 Oct 08 21:06:10.792146 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: c405aac48e9b403ca8d1e3ac28fab76e Oct 08 21:06:10.792146 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-746342360 Oct 08 21:06:10.792146 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-FloatingIPsAssociationTestJSON-746342360-project Oct 08 21:06:10.792146 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:06:10.792146 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:06:10.792146 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 0c6153d58d264272a375b3169e0874d3 Oct 08 21:06:10.792146 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-746342360-project Oct 08 21:06:10.792146 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 21:06:10.792146 ncdv-master-1 devstack@n-api.service[140492]: exception: Instance 58ad88cd-b5d3-4aac-ae20-857736605fa0 could not be found. Oct 08 21:06:10.792146 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': '58ad88cd-b5d3-4aac-ae20-857736605fa0'} Oct 08 21:06:10.792146 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:06:10.792146 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:06:10.792146 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:06:10.792146 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:06:10.792146 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:06:10.792146 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:06:10.792146 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:06:10.792146 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:06:10.792146 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:06:10.792146 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:06:10.792146 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58ad88cd-b5d3-4aac-ae20-857736605fa0 could not be found. Oct 08 21:06:10.792146 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:06:10.792146 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:06:10.792146 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:06:10.792146 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:06:10.792146 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:06:10.792146 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:06:10.792146 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:06:10.792146 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:06:10.792146 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:06:10.792146 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:06:10.792146 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 08 21:06:10.792146 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 08 21:06:10.792146 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 08 21:06:10.792146 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 08 21:06:10.792146 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:06:10.792146 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:06:10.792146 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:06:10.792146 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:06:10.796476 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58ad88cd-b5d3-4aac-ae20-857736605fa0 could not be found. Oct 08 21:06:10.796476 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:06:10.796476 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:06:10.796476 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:06:10.796476 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:06:10.796476 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:06:10.796476 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:06:10.796476 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:06:10.796476 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:06:10.796476 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58ad88cd-b5d3-4aac-ae20-857736605fa0 could not be found. Oct 08 21:06:10.796476 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:06:10.799474 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-8ee39b6d-7cde-45bf-8550-c3772c6ac322 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Returning 404 to user: Instance 58ad88cd-b5d3-4aac-ae20-857736605fa0 could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:06:10.800621 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-8ee39b6d-7cde-45bf-8550-c3772c6ac322 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] 10.222.0.26 "DELETE /compute/v2.1/servers/58ad88cd-b5d3-4aac-ae20-857736605fa0" status: 404 len: 111 microversion: 2.1 time: 0.064564 Oct 08 21:06:10.801998 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1739/3408] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:06:10 2022] DELETE /compute/v2.1/servers/58ad88cd-b5d3-4aac-ae20-857736605fa0 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:06:10.811150 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-37b2bfd8-4be1-489f-a609-c66787dc274b tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:06:10.812324 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-37b2bfd8-4be1-489f-a609-c66787dc274b tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] [instance: 58ad88cd-b5d3-4aac-ae20-857736605fa0] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:06:10.842112 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-37b2bfd8-4be1-489f-a609-c66787dc274b tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:10.844917 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-37b2bfd8-4be1-489f-a609-c66787dc274b tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:10.846503 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-37b2bfd8-4be1-489f-a609-c66787dc274b tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:10.847975 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-37b2bfd8-4be1-489f-a609-c66787dc274b tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:10.850484 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-37b2bfd8-4be1-489f-a609-c66787dc274b tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:10.851588 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-37b2bfd8-4be1-489f-a609-c66787dc274b tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:10.887699 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-37b2bfd8-4be1-489f-a609-c66787dc274b tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] HTTP exception thrown: Instance 58ad88cd-b5d3-4aac-ae20-857736605fa0 could not be found. Oct 08 21:06:10.889873 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-37b2bfd8-4be1-489f-a609-c66787dc274b tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Request method failure captured: Oct 08 21:06:10.889873 ncdv-master-1 devstack@n-api.service[140492]: request: GET /compute/v2.1/servers/58ad88cd-b5d3-4aac-ae20-857736605fa0 HTTP/1.1 Oct 08 21:06:10.889873 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:06:10.889873 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:06:10.889873 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:06:10.889873 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 21:06:10.889873 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:06:10.889873 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:06:10.889873 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:06:10.889873 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:06:10.889873 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeXi16tkz_i1i7XbkgwY21JByktYX4GDP2nafLDfRJ1Rxq_b8BRtnCkaucvQt5-aBmzBGGT0K7woxgqPe_-7FRNV3MYD__u7v5IA0oeJ8DXdW7CG-IicMcSS5pGOZ95X2MGqNk7LSfwuDAJhCMfRn7FBMQvBzJdyTOeT1qaoWuuugbU Oct 08 21:06:10.889873 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:06:10.889873 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:06:10.889873 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:06:10.889873 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:06:10.889873 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:06:10.889873 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:06:10.889873 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: c405aac48e9b403ca8d1e3ac28fab76e Oct 08 21:06:10.889873 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-746342360 Oct 08 21:06:10.889873 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:06:10.889873 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:06:10.889873 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/c405aac48e9b403ca8d1e3ac28fab76e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c405aac48e9b403ca8d1e3ac28fab76e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_c405aac48e9b403ca8d1e3ac28fab76e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c405aac48e9b403ca8d1e3ac28fab76e"}]}] Oct 08 21:06:10.889873 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-746342360 Oct 08 21:06:10.889873 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: c405aac48e9b403ca8d1e3ac28fab76e Oct 08 21:06:10.889873 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-746342360 Oct 08 21:06:10.889873 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-FloatingIPsAssociationTestJSON-746342360-project Oct 08 21:06:10.889873 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:06:10.889873 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:06:10.889873 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 0c6153d58d264272a375b3169e0874d3 Oct 08 21:06:10.889873 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-746342360-project Oct 08 21:06:10.889873 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 21:06:10.889873 ncdv-master-1 devstack@n-api.service[140492]: exception: Instance 58ad88cd-b5d3-4aac-ae20-857736605fa0 could not be found. Oct 08 21:06:10.889873 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': '58ad88cd-b5d3-4aac-ae20-857736605fa0'} Oct 08 21:06:10.889873 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:06:10.889873 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:06:10.889873 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:06:10.889873 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:06:10.889873 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:06:10.889873 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:06:10.889873 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:06:10.889873 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:06:10.889873 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:06:10.889873 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:06:10.889873 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58ad88cd-b5d3-4aac-ae20-857736605fa0 could not be found. Oct 08 21:06:10.889873 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:06:10.889873 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:06:10.889873 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:06:10.889873 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:06:10.889873 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:06:10.889873 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:06:10.889873 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:06:10.889873 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:06:10.889873 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:06:10.889873 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:06:10.889873 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:06:10.889873 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:06:10.889873 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:06:10.889873 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:06:10.889873 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:06:10.889873 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:06:10.889873 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58ad88cd-b5d3-4aac-ae20-857736605fa0 could not be found. Oct 08 21:06:10.889873 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:06:10.889873 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:06:10.895457 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:06:10.895457 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:06:10.895457 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:06:10.895457 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:06:10.895457 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:06:10.895457 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:06:10.895457 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58ad88cd-b5d3-4aac-ae20-857736605fa0 could not be found. Oct 08 21:06:10.895457 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:06:10.897552 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-37b2bfd8-4be1-489f-a609-c66787dc274b tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Returning 404 to user: Instance 58ad88cd-b5d3-4aac-ae20-857736605fa0 could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:06:10.898482 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-37b2bfd8-4be1-489f-a609-c66787dc274b tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] 10.222.0.26 "GET /compute/v2.1/servers/58ad88cd-b5d3-4aac-ae20-857736605fa0" status: 404 len: 111 microversion: 2.1 time: 0.092741 Oct 08 21:06:10.904426 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1740/3409] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:06:10 2022] GET /compute/v2.1/servers/58ad88cd-b5d3-4aac-ae20-857736605fa0 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:06:10.910109 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-9a190fef-4848-43c4-a750-8ce2cef0b01c tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Calling method '.version_select at 0x7f1a8cfedaf0>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:06:11.309348 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-1afd7b31-6be6-4879-a66a-f96ba297ef92 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06443b5728fb4d1e95d6245820e786bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ded993145b4eda9d6a33b994519012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:11.330698 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-1afd7b31-6be6-4879-a66a-f96ba297ef92 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "GET /compute/v2.1/servers/edd393b3-ce87-41a9-a9c4-f3ad6a6f0130" status: 200 len: 1293 microversion: 2.1 time: 1.032454 Oct 08 21:06:11.332282 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1670/3410] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:06:10 2022] GET /compute/v2.1/servers/edd393b3-ce87-41a9-a9c4-f3ad6a6f0130 => generated 1293 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:06:11.347701 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-402b07de-f99f-4db2-b012-6ea0ebbe554a req-cdd43075-c37d-4be7-b733-a76023bb6a47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21", "tag": "9cbc0e0f-a528-4d53-9896-a83c004068d1"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:06:11.371777 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-402b07de-f99f-4db2-b012-6ea0ebbe554a req-cdd43075-c37d-4be7-b733-a76023bb6a47 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:11.372663 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-402b07de-f99f-4db2-b012-6ea0ebbe554a req-cdd43075-c37d-4be7-b733-a76023bb6a47 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:11.373211 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-402b07de-f99f-4db2-b012-6ea0ebbe554a req-cdd43075-c37d-4be7-b733-a76023bb6a47 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:11.393110 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-402b07de-f99f-4db2-b012-6ea0ebbe554a req-cdd43075-c37d-4be7-b733-a76023bb6a47 service nova] Creating event network-changed:9cbc0e0f-a528-4d53-9896-a83c004068d1 for instance 4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21 on nch1-master-1 Oct 08 21:06:11.403855 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-402b07de-f99f-4db2-b012-6ea0ebbe554a req-cdd43075-c37d-4be7-b733-a76023bb6a47 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067138 Oct 08 21:06:11.406556 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1671/3411] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:06:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:06:11.415517 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-6631b10a-3236-4501-b69a-ad672d5dfb97 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:06:11.435971 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-6631b10a-3236-4501-b69a-ad672d5dfb97 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] [instance: 4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:06:11.444117 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6631b10a-3236-4501-b69a-ad672d5dfb97 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:11.444924 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6631b10a-3236-4501-b69a-ad672d5dfb97 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:11.445775 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6631b10a-3236-4501-b69a-ad672d5dfb97 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:11.500324 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6631b10a-3236-4501-b69a-ad672d5dfb97 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:11.501309 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6631b10a-3236-4501-b69a-ad672d5dfb97 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.054s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:11.503856 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6631b10a-3236-4501-b69a-ad672d5dfb97 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:12.069131 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-6631b10a-3236-4501-b69a-ad672d5dfb97 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc2bdd169daf4a1db830b1fa7f94f0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f2d56477794f8ab38b8e3535b3e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:12.088258 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-6631b10a-3236-4501-b69a-ad672d5dfb97 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc2bdd169daf4a1db830b1fa7f94f0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f2d56477794f8ab38b8e3535b3e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:12.088258 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-6631b10a-3236-4501-b69a-ad672d5dfb97 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc2bdd169daf4a1db830b1fa7f94f0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f2d56477794f8ab38b8e3535b3e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:12.088258 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-6631b10a-3236-4501-b69a-ad672d5dfb97 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] 10.222.0.26 "GET /compute/v2.1/servers/4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21" status: 200 len: 1858 microversion: 2.32 time: 0.676731 Oct 08 21:06:12.088258 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1672/3412] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:06:11 2022] GET /compute/v2.1/servers/4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21 => generated 1858 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:06:12.091723 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-fb99b2aa-4836-4449-822a-9a19cc2d7fd2 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:06:12.092352 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-fb99b2aa-4836-4449-822a-9a19cc2d7fd2 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] [instance: dbacaeed-a40b-4e05-9635-5073dfdd8621] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:06:12.099279 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fb99b2aa-4836-4449-822a-9a19cc2d7fd2 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:12.099820 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fb99b2aa-4836-4449-822a-9a19cc2d7fd2 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:12.100794 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fb99b2aa-4836-4449-822a-9a19cc2d7fd2 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:12.101756 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fb99b2aa-4836-4449-822a-9a19cc2d7fd2 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:12.102495 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fb99b2aa-4836-4449-822a-9a19cc2d7fd2 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:12.103087 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fb99b2aa-4836-4449-822a-9a19cc2d7fd2 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:12.602826 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-fb99b2aa-4836-4449-822a-9a19cc2d7fd2 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:12.613577 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-fb99b2aa-4836-4449-822a-9a19cc2d7fd2 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:12.615747 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-fb99b2aa-4836-4449-822a-9a19cc2d7fd2 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:12.617304 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-fb99b2aa-4836-4449-822a-9a19cc2d7fd2 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] 10.222.0.26 "GET /compute/v2.1/servers/dbacaeed-a40b-4e05-9635-5073dfdd8621" status: 200 len: 1723 microversion: 2.20 time: 0.531086 Oct 08 21:06:12.618206 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1673/3413] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:06:12 2022] GET /compute/v2.1/servers/dbacaeed-a40b-4e05-9635-5073dfdd8621 => generated 1723 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:06:12.627706 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-451451a4-1be0-41ff-9e91-d89821802d96 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:06:12.629395 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-451451a4-1be0-41ff-9e91-d89821802d96 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: edd393b3-ce87-41a9-a9c4-f3ad6a6f0130] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:06:12.638581 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-451451a4-1be0-41ff-9e91-d89821802d96 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:12.639555 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-451451a4-1be0-41ff-9e91-d89821802d96 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:12.640221 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-451451a4-1be0-41ff-9e91-d89821802d96 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:12.641175 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-451451a4-1be0-41ff-9e91-d89821802d96 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:12.642846 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-451451a4-1be0-41ff-9e91-d89821802d96 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:12.645046 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-451451a4-1be0-41ff-9e91-d89821802d96 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:12.757795 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-9a190fef-4848-43c4-a750-8ce2cef0b01c tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] 10.222.0.26 "DELETE /compute/v2.1/os-floating-ips/52727b29-e01e-4fe4-bdaf-d1972b896bcc" status: 202 len: 0 microversion: 2.1 time: 1.852077 Oct 08 21:06:12.758393 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1741/3414] 10.222.0.26 () {58 vars in 1263 bytes} [Sat Oct 8 21:06:10 2022] DELETE /compute/v2.1/os-floating-ips/52727b29-e01e-4fe4-bdaf-d1972b896bcc => generated 0 bytes in 1853 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 21:06:12.766282 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-89414662-4cb0-4160-869f-22fa9cd6e22e tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:06:12.766787 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-89414662-4cb0-4160-869f-22fa9cd6e22e tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] [instance: de9d6639-040b-44b7-b00a-c1022c705c89] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:06:12.774311 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-89414662-4cb0-4160-869f-22fa9cd6e22e tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:12.776071 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-89414662-4cb0-4160-869f-22fa9cd6e22e tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:12.778820 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-89414662-4cb0-4160-869f-22fa9cd6e22e tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:12.783309 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-89414662-4cb0-4160-869f-22fa9cd6e22e tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:12.783908 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-89414662-4cb0-4160-869f-22fa9cd6e22e tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:12.785269 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-89414662-4cb0-4160-869f-22fa9cd6e22e tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:12.822580 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-89414662-4cb0-4160-869f-22fa9cd6e22e tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] [instance: de9d6639-040b-44b7-b00a-c1022c705c89] Going to try to terminate instance {{(pid=140492) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 21:06:12.841535 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=3,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=2,nova_cell1:RELEASE=2 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:06:12.945584 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-89414662-4cb0-4160-869f-22fa9cd6e22e tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] 10.222.0.26 "DELETE /compute/v2.1/servers/de9d6639-040b-44b7-b00a-c1022c705c89" status: 204 len: 0 microversion: 2.1 time: 0.182107 Oct 08 21:06:12.946385 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1742/3415] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:06:12 2022] DELETE /compute/v2.1/servers/de9d6639-040b-44b7-b00a-c1022c705c89 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 21:06:12.958806 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-92210539-b626-4bd5-af77-6d4115d62e93 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:06:12.959606 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-92210539-b626-4bd5-af77-6d4115d62e93 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] [instance: de9d6639-040b-44b7-b00a-c1022c705c89] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:06:12.967685 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-92210539-b626-4bd5-af77-6d4115d62e93 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:12.969044 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-92210539-b626-4bd5-af77-6d4115d62e93 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:12.969735 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-92210539-b626-4bd5-af77-6d4115d62e93 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:12.970824 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-92210539-b626-4bd5-af77-6d4115d62e93 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:12.971466 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-92210539-b626-4bd5-af77-6d4115d62e93 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:12.972613 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-92210539-b626-4bd5-af77-6d4115d62e93 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:13.214371 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-92210539-b626-4bd5-af77-6d4115d62e93 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c6153d58d264272a375b3169e0874d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c405aac48e9b403ca8d1e3ac28fab76e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:13.225908 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-92210539-b626-4bd5-af77-6d4115d62e93 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] 10.222.0.26 "GET /compute/v2.1/servers/de9d6639-040b-44b7-b00a-c1022c705c89" status: 200 len: 1525 microversion: 2.1 time: 0.274496 Oct 08 21:06:13.227333 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1743/3416] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:06:12 2022] GET /compute/v2.1/servers/de9d6639-040b-44b7-b00a-c1022c705c89 => generated 1525 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:06:13.237298 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-4489f135-aa2d-4b3b-823c-ff28ebd70c90 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:06:13.238275 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-4489f135-aa2d-4b3b-823c-ff28ebd70c90 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] [instance: 4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:06:13.246973 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4489f135-aa2d-4b3b-823c-ff28ebd70c90 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:13.247768 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4489f135-aa2d-4b3b-823c-ff28ebd70c90 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:13.248481 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4489f135-aa2d-4b3b-823c-ff28ebd70c90 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:13.250349 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4489f135-aa2d-4b3b-823c-ff28ebd70c90 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:13.251058 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4489f135-aa2d-4b3b-823c-ff28ebd70c90 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:13.251785 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4489f135-aa2d-4b3b-823c-ff28ebd70c90 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:13.260265 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-451451a4-1be0-41ff-9e91-d89821802d96 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06443b5728fb4d1e95d6245820e786bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ded993145b4eda9d6a33b994519012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:13.280587 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-451451a4-1be0-41ff-9e91-d89821802d96 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "GET /compute/v2.1/servers/edd393b3-ce87-41a9-a9c4-f3ad6a6f0130" status: 200 len: 1474 microversion: 2.1 time: 0.660383 Oct 08 21:06:13.281229 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1674/3417] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:06:12 2022] GET /compute/v2.1/servers/edd393b3-ce87-41a9-a9c4-f3ad6a6f0130 => generated 1474 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:06:13.597477 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-4489f135-aa2d-4b3b-823c-ff28ebd70c90 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc2bdd169daf4a1db830b1fa7f94f0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f2d56477794f8ab38b8e3535b3e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:13.609368 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-4489f135-aa2d-4b3b-823c-ff28ebd70c90 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc2bdd169daf4a1db830b1fa7f94f0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f2d56477794f8ab38b8e3535b3e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:13.610881 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-4489f135-aa2d-4b3b-823c-ff28ebd70c90 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc2bdd169daf4a1db830b1fa7f94f0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f2d56477794f8ab38b8e3535b3e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:13.612248 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-4489f135-aa2d-4b3b-823c-ff28ebd70c90 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] 10.222.0.26 "GET /compute/v2.1/servers/4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21" status: 200 len: 1879 microversion: 2.32 time: 0.383686 Oct 08 21:06:13.612913 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1744/3418] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:06:13 2022] GET /compute/v2.1/servers/4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21 => generated 1879 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:06:13.624213 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-d2f8e821-e970-4648-a958-9bf0df0201d6 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-955475051", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:06:13.647720 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-5368f1f0-ad32-420f-a3cd-00a1200b7969 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:06:13.648793 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-5368f1f0-ad32-420f-a3cd-00a1200b7969 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] [instance: dbacaeed-a40b-4e05-9635-5073dfdd8621] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:06:13.657396 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5368f1f0-ad32-420f-a3cd-00a1200b7969 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:13.658010 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5368f1f0-ad32-420f-a3cd-00a1200b7969 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:13.658687 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5368f1f0-ad32-420f-a3cd-00a1200b7969 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:13.659771 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5368f1f0-ad32-420f-a3cd-00a1200b7969 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:13.660647 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5368f1f0-ad32-420f-a3cd-00a1200b7969 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:13.661373 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5368f1f0-ad32-420f-a3cd-00a1200b7969 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:13.721914 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.network.neutron [None req-d2f8e821-e970-4648-a958-9bf0df0201d6 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] validate_networks() for [('983c5654-1828-48da-a871-2028e691f4b0', None, None, None, None, None)] {{(pid=140491) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 21:06:13.862594 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-5368f1f0-ad32-420f-a3cd-00a1200b7969 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:13.875492 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-5368f1f0-ad32-420f-a3cd-00a1200b7969 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:13.877628 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-5368f1f0-ad32-420f-a3cd-00a1200b7969 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:13.879360 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-5368f1f0-ad32-420f-a3cd-00a1200b7969 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] 10.222.0.26 "GET /compute/v2.1/servers/dbacaeed-a40b-4e05-9635-5073dfdd8621" status: 200 len: 1723 microversion: 2.20 time: 0.236415 Oct 08 21:06:13.883108 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1745/3419] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:06:13 2022] GET /compute/v2.1/servers/dbacaeed-a40b-4e05-9635-5073dfdd8621 => generated 1723 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:06:14.080890 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-517d1a66-31f0-4f48-85dc-08afa01e1fbc req-27712623-7fec-450b-94d6-5afca2de89f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21", "tag": "2a5f9012-714b-4b2f-b172-487879914396"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:06:14.105800 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-517d1a66-31f0-4f48-85dc-08afa01e1fbc req-27712623-7fec-450b-94d6-5afca2de89f6 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:14.106470 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-517d1a66-31f0-4f48-85dc-08afa01e1fbc req-27712623-7fec-450b-94d6-5afca2de89f6 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:14.107831 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-517d1a66-31f0-4f48-85dc-08afa01e1fbc req-27712623-7fec-450b-94d6-5afca2de89f6 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:14.123626 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-517d1a66-31f0-4f48-85dc-08afa01e1fbc req-27712623-7fec-450b-94d6-5afca2de89f6 service nova] Creating event network-changed:2a5f9012-714b-4b2f-b172-487879914396 for instance 4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21 on nch1-master-1 Oct 08 21:06:14.139244 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-517d1a66-31f0-4f48-85dc-08afa01e1fbc req-27712623-7fec-450b-94d6-5afca2de89f6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061872 Oct 08 21:06:14.140608 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1746/3420] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:06:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 08 21:06:14.250408 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-ac0ca8be-ca31-475a-9fc5-40ab571c21a9 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:06:14.251124 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-ac0ca8be-ca31-475a-9fc5-40ab571c21a9 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] [instance: de9d6639-040b-44b7-b00a-c1022c705c89] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:06:14.269053 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ac0ca8be-ca31-475a-9fc5-40ab571c21a9 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:14.269573 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ac0ca8be-ca31-475a-9fc5-40ab571c21a9 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:14.270030 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ac0ca8be-ca31-475a-9fc5-40ab571c21a9 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:14.270757 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ac0ca8be-ca31-475a-9fc5-40ab571c21a9 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:14.271227 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ac0ca8be-ca31-475a-9fc5-40ab571c21a9 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:14.271666 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ac0ca8be-ca31-475a-9fc5-40ab571c21a9 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:14.532636 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-ac0ca8be-ca31-475a-9fc5-40ab571c21a9 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c6153d58d264272a375b3169e0874d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c405aac48e9b403ca8d1e3ac28fab76e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:14.541710 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-ac0ca8be-ca31-475a-9fc5-40ab571c21a9 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] 10.222.0.26 "GET /compute/v2.1/servers/de9d6639-040b-44b7-b00a-c1022c705c89" status: 200 len: 1525 microversion: 2.1 time: 0.295508 Oct 08 21:06:14.542414 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1747/3421] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:06:14 2022] GET /compute/v2.1/servers/de9d6639-040b-44b7-b00a-c1022c705c89 => generated 1525 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:06:14.648644 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-2954adc0-533c-42ef-8cd0-7fef6362b70e tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:06:14.649378 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-2954adc0-533c-42ef-8cd0-7fef6362b70e tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] [instance: 4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:06:14.657806 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2954adc0-533c-42ef-8cd0-7fef6362b70e tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:14.658571 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2954adc0-533c-42ef-8cd0-7fef6362b70e tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:14.659192 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2954adc0-533c-42ef-8cd0-7fef6362b70e tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:14.660414 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2954adc0-533c-42ef-8cd0-7fef6362b70e tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:14.661065 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2954adc0-533c-42ef-8cd0-7fef6362b70e tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:14.662187 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2954adc0-533c-42ef-8cd0-7fef6362b70e tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:15.011428 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-2954adc0-533c-42ef-8cd0-7fef6362b70e tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc2bdd169daf4a1db830b1fa7f94f0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f2d56477794f8ab38b8e3535b3e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:15.025642 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-2954adc0-533c-42ef-8cd0-7fef6362b70e tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc2bdd169daf4a1db830b1fa7f94f0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f2d56477794f8ab38b8e3535b3e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:15.027135 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-2954adc0-533c-42ef-8cd0-7fef6362b70e tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc2bdd169daf4a1db830b1fa7f94f0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f2d56477794f8ab38b8e3535b3e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:15.036099 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-2954adc0-533c-42ef-8cd0-7fef6362b70e tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] 10.222.0.26 "GET /compute/v2.1/servers/4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21" status: 200 len: 1879 microversion: 2.32 time: 0.391759 Oct 08 21:06:15.037947 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1748/3422] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:06:14 2022] GET /compute/v2.1/servers/4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21 => generated 1879 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 08 21:06:15.042751 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-2835025e-f866-4849-8e84-78f5f27bcc89 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:06:15.049948 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-2835025e-f866-4849-8e84-78f5f27bcc89 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] [instance: dbacaeed-a40b-4e05-9635-5073dfdd8621] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:06:15.066601 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2835025e-f866-4849-8e84-78f5f27bcc89 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:15.067126 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2835025e-f866-4849-8e84-78f5f27bcc89 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:15.067648 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2835025e-f866-4849-8e84-78f5f27bcc89 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:15.069530 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2835025e-f866-4849-8e84-78f5f27bcc89 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:15.070020 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2835025e-f866-4849-8e84-78f5f27bcc89 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:15.074129 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2835025e-f866-4849-8e84-78f5f27bcc89 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:15.322006 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-2835025e-f866-4849-8e84-78f5f27bcc89 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:15.332410 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-2835025e-f866-4849-8e84-78f5f27bcc89 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:15.334501 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-2835025e-f866-4849-8e84-78f5f27bcc89 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:15.335864 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-2835025e-f866-4849-8e84-78f5f27bcc89 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] 10.222.0.26 "GET /compute/v2.1/servers/dbacaeed-a40b-4e05-9635-5073dfdd8621" status: 200 len: 1723 microversion: 2.20 time: 0.296938 Oct 08 21:06:15.337347 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1749/3423] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:06:15 2022] GET /compute/v2.1/servers/dbacaeed-a40b-4e05-9635-5073dfdd8621 => generated 1723 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:06:15.343459 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-cd7c1f1a-fcc8-460f-bdf4-843fdc83af80 req-cde7ec79-a976-4dc8-954b-be9d52a1edb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de9d6639-040b-44b7-b00a-c1022c705c89", "name": "network-vif-deleted", "tag": "ca9cb617-2f51-474b-b74d-d32ecd4a80b9"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:06:15.353652 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-cd7c1f1a-fcc8-460f-bdf4-843fdc83af80 req-cde7ec79-a976-4dc8-954b-be9d52a1edb3 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:15.354556 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-cd7c1f1a-fcc8-460f-bdf4-843fdc83af80 req-cde7ec79-a976-4dc8-954b-be9d52a1edb3 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:15.355278 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-cd7c1f1a-fcc8-460f-bdf4-843fdc83af80 req-cde7ec79-a976-4dc8-954b-be9d52a1edb3 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:15.392722 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-cd7c1f1a-fcc8-460f-bdf4-843fdc83af80 req-cde7ec79-a976-4dc8-954b-be9d52a1edb3 service nova] Creating event network-vif-deleted:ca9cb617-2f51-474b-b74d-d32ecd4a80b9 for instance de9d6639-040b-44b7-b00a-c1022c705c89 on nch1-master-1 Oct 08 21:06:15.399891 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-cd7c1f1a-fcc8-460f-bdf4-843fdc83af80 req-cde7ec79-a976-4dc8-954b-be9d52a1edb3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061128 Oct 08 21:06:15.401341 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1750/3424] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:06:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:06:15.568880 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-c878a8ec-43e7-48d4-b438-1a9eed035694 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:06:15.570273 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-c878a8ec-43e7-48d4-b438-1a9eed035694 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] [instance: de9d6639-040b-44b7-b00a-c1022c705c89] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:06:15.598930 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c878a8ec-43e7-48d4-b438-1a9eed035694 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:15.601075 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c878a8ec-43e7-48d4-b438-1a9eed035694 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:15.601590 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c878a8ec-43e7-48d4-b438-1a9eed035694 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:15.603945 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c878a8ec-43e7-48d4-b438-1a9eed035694 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:15.604440 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c878a8ec-43e7-48d4-b438-1a9eed035694 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:15.604884 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c878a8ec-43e7-48d4-b438-1a9eed035694 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:15.670092 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c878a8ec-43e7-48d4-b438-1a9eed035694 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:15.671525 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c878a8ec-43e7-48d4-b438-1a9eed035694 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:15.672204 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c878a8ec-43e7-48d4-b438-1a9eed035694 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:15.672901 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.objects.instance [None req-c878a8ec-43e7-48d4-b438-1a9eed035694 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lazy-loading 'fault' on Instance uuid de9d6639-040b-44b7-b00a-c1022c705c89 {{(pid=140492) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 21:06:15.722875 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-c878a8ec-43e7-48d4-b438-1a9eed035694 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c6153d58d264272a375b3169e0874d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c405aac48e9b403ca8d1e3ac28fab76e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:15.733382 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-c878a8ec-43e7-48d4-b438-1a9eed035694 tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] 10.222.0.26 "GET /compute/v2.1/servers/de9d6639-040b-44b7-b00a-c1022c705c89" status: 200 len: 1313 microversion: 2.1 time: 0.169265 Oct 08 21:06:15.749253 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1751/3425] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:06:15 2022] GET /compute/v2.1/servers/de9d6639-040b-44b7-b00a-c1022c705c89 => generated 1313 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:06:15.940457 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-d2f8e821-e970-4648-a958-9bf0df0201d6 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Flavor limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 21:06:15.943660 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-d2f8e821-e970-4648-a958-9bf0df0201d6 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Image limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 21:06:15.945770 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-d2f8e821-e970-4648-a958-9bf0df0201d6 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Flavor pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 21:06:15.946486 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-d2f8e821-e970-4648-a958-9bf0df0201d6 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Image pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 21:06:15.947430 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-d2f8e821-e970-4648-a958-9bf0df0201d6 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 21:06:15.969828 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d2f8e821-e970-4648-a958-9bf0df0201d6 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:15.971294 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d2f8e821-e970-4648-a958-9bf0df0201d6 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:15.972210 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d2f8e821-e970-4648-a958-9bf0df0201d6 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:15.973316 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d2f8e821-e970-4648-a958-9bf0df0201d6 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:15.974615 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d2f8e821-e970-4648-a958-9bf0df0201d6 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:15.976017 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d2f8e821-e970-4648-a958-9bf0df0201d6 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:16.006280 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-d2f8e821-e970-4648-a958-9bf0df0201d6 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Getting quotas for project e7ded993145b4eda9d6a33b994519012. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:06:16.014821 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-d2f8e821-e970-4648-a958-9bf0df0201d6 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Getting quotas for user 06443b5728fb4d1e95d6245820e786bf and project e7ded993145b4eda9d6a33b994519012. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:06:16.035529 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-d2f8e821-e970-4648-a958-9bf0df0201d6 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Going to run 1 instances... {{(pid=140491) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 21:06:16.038571 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-d2f8e821-e970-4648-a958-9bf0df0201d6 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: ba7e1478-4f49-4350-9ea9-06e23eb05c63] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c508bd7f-7db9-4b2c-af7c-be54a855c355',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140491) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 21:06:16.064213 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-f0777d66-09a4-41d1-8f76-169dd9721bcd tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:06:16.064839 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-f0777d66-09a4-41d1-8f76-169dd9721bcd tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] [instance: 4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:06:16.081023 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f0777d66-09a4-41d1-8f76-169dd9721bcd tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:16.081693 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f0777d66-09a4-41d1-8f76-169dd9721bcd tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:16.082242 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f0777d66-09a4-41d1-8f76-169dd9721bcd tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:16.083009 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f0777d66-09a4-41d1-8f76-169dd9721bcd tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:16.083672 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f0777d66-09a4-41d1-8f76-169dd9721bcd tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:16.084366 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f0777d66-09a4-41d1-8f76-169dd9721bcd tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:16.146280 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-d2f8e821-e970-4648-a958-9bf0df0201d6 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.524383 Oct 08 21:06:16.148006 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1675/3426] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 21:06:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 2530 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 08 21:06:16.160238 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-f58fffbe-80af-456e-ac18-e002d26a39f9 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:06:16.163218 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-f58fffbe-80af-456e-ac18-e002d26a39f9 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: ba7e1478-4f49-4350-9ea9-06e23eb05c63] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:06:16.188844 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-f58fffbe-80af-456e-ac18-e002d26a39f9 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: ba7e1478-4f49-4350-9ea9-06e23eb05c63] Going to try to terminate instance {{(pid=140491) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 21:06:16.398371 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-f0777d66-09a4-41d1-8f76-169dd9721bcd tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc2bdd169daf4a1db830b1fa7f94f0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f2d56477794f8ab38b8e3535b3e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:16.409177 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-f0777d66-09a4-41d1-8f76-169dd9721bcd tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc2bdd169daf4a1db830b1fa7f94f0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f2d56477794f8ab38b8e3535b3e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:16.410995 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-f0777d66-09a4-41d1-8f76-169dd9721bcd tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc2bdd169daf4a1db830b1fa7f94f0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f2d56477794f8ab38b8e3535b3e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:16.412223 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-f0777d66-09a4-41d1-8f76-169dd9721bcd tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] 10.222.0.26 "GET /compute/v2.1/servers/4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21" status: 200 len: 1879 microversion: 2.32 time: 0.353436 Oct 08 21:06:16.425819 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1752/3427] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:06:16 2022] GET /compute/v2.1/servers/4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21 => generated 1879 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 08 21:06:16.439173 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-926aa144-8815-4f64-9ea7-55c0fac4f40f tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:06:16.439953 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-926aa144-8815-4f64-9ea7-55c0fac4f40f tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] [instance: dbacaeed-a40b-4e05-9635-5073dfdd8621] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:06:16.447728 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-926aa144-8815-4f64-9ea7-55c0fac4f40f tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:16.448496 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-926aa144-8815-4f64-9ea7-55c0fac4f40f tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:16.448946 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-926aa144-8815-4f64-9ea7-55c0fac4f40f tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:16.450256 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-926aa144-8815-4f64-9ea7-55c0fac4f40f tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:16.451122 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-926aa144-8815-4f64-9ea7-55c0fac4f40f tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:16.451713 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-926aa144-8815-4f64-9ea7-55c0fac4f40f tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:16.689298 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-926aa144-8815-4f64-9ea7-55c0fac4f40f tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:16.701382 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-926aa144-8815-4f64-9ea7-55c0fac4f40f tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:16.703717 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-926aa144-8815-4f64-9ea7-55c0fac4f40f tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:16.705121 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-926aa144-8815-4f64-9ea7-55c0fac4f40f tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] 10.222.0.26 "GET /compute/v2.1/servers/dbacaeed-a40b-4e05-9635-5073dfdd8621" status: 200 len: 1723 microversion: 2.20 time: 0.278082 Oct 08 21:06:16.730091 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1753/3428] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:06:16 2022] GET /compute/v2.1/servers/dbacaeed-a40b-4e05-9635-5073dfdd8621 => generated 1723 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:06:16.762186 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-6414c658-e14b-4e8b-a117-3671136a57cb tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:06:16.763021 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-6414c658-e14b-4e8b-a117-3671136a57cb tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] [instance: de9d6639-040b-44b7-b00a-c1022c705c89] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:06:16.773473 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6414c658-e14b-4e8b-a117-3671136a57cb tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:16.774015 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6414c658-e14b-4e8b-a117-3671136a57cb tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:16.775634 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6414c658-e14b-4e8b-a117-3671136a57cb tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:16.776398 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6414c658-e14b-4e8b-a117-3671136a57cb tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:16.777009 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6414c658-e14b-4e8b-a117-3671136a57cb tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:16.778115 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6414c658-e14b-4e8b-a117-3671136a57cb tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:16.798017 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.scheduler.client.report [None req-f58fffbe-80af-456e-ac18-e002d26a39f9 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Deleted allocations for instance ba7e1478-4f49-4350-9ea9-06e23eb05c63 Oct 08 21:06:16.812573 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.compute.api [None req-f58fffbe-80af-456e-ac18-e002d26a39f9 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: ba7e1478-4f49-4350-9ea9-06e23eb05c63] Instance Mapping does not exist while attempting local delete cleanup. Oct 08 21:06:16.815421 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-f58fffbe-80af-456e-ac18-e002d26a39f9 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "DELETE /compute/v2.1/servers/ba7e1478-4f49-4350-9ea9-06e23eb05c63" status: 204 len: 0 microversion: 2.1 time: 0.659398 Oct 08 21:06:16.817867 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1676/3429] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:06:16 2022] DELETE /compute/v2.1/servers/ba7e1478-4f49-4350-9ea9-06e23eb05c63 => generated 0 bytes in 663 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 21:06:16.825549 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-6414c658-e14b-4e8b-a117-3671136a57cb tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] HTTP exception thrown: Instance de9d6639-040b-44b7-b00a-c1022c705c89 could not be found. Oct 08 21:06:16.831921 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-6414c658-e14b-4e8b-a117-3671136a57cb tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Request method failure captured: Oct 08 21:06:16.831921 ncdv-master-1 devstack@n-api.service[140492]: request: GET /compute/v2.1/servers/de9d6639-040b-44b7-b00a-c1022c705c89 HTTP/1.1 Oct 08 21:06:16.831921 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:06:16.831921 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:06:16.831921 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:06:16.831921 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 21:06:16.831921 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:06:16.831921 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:06:16.831921 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:06:16.831921 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:06:16.831921 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeXi16tkz_i1i7XbkgwY21JByktYX4GDP2nafLDfRJ1Rxq_b8BRtnCkaucvQt5-aBmzBGGT0K7woxgqPe_-7FRNV3MYD__u7v5IA0oeJ8DXdW7CG-IicMcSS5pGOZ95X2MGqNk7LSfwuDAJhCMfRn7FBMQvBzJdyTOeT1qaoWuuugbU Oct 08 21:06:16.831921 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:06:16.831921 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:06:16.831921 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:06:16.831921 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:06:16.831921 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:06:16.831921 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:06:16.831921 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: c405aac48e9b403ca8d1e3ac28fab76e Oct 08 21:06:16.831921 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-746342360 Oct 08 21:06:16.831921 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:06:16.831921 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:06:16.831921 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/c405aac48e9b403ca8d1e3ac28fab76e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c405aac48e9b403ca8d1e3ac28fab76e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_c405aac48e9b403ca8d1e3ac28fab76e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c405aac48e9b403ca8d1e3ac28fab76e"}]}] Oct 08 21:06:16.831921 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-746342360 Oct 08 21:06:16.831921 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: c405aac48e9b403ca8d1e3ac28fab76e Oct 08 21:06:16.831921 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-746342360 Oct 08 21:06:16.831921 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-FloatingIPsAssociationTestJSON-746342360-project Oct 08 21:06:16.831921 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:06:16.831921 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:06:16.831921 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 0c6153d58d264272a375b3169e0874d3 Oct 08 21:06:16.831921 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-746342360-project Oct 08 21:06:16.831921 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 21:06:16.831921 ncdv-master-1 devstack@n-api.service[140492]: exception: Instance de9d6639-040b-44b7-b00a-c1022c705c89 could not be found. Oct 08 21:06:16.831921 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': 'de9d6639-040b-44b7-b00a-c1022c705c89'} Oct 08 21:06:16.831921 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:06:16.831921 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:06:16.831921 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:06:16.831921 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:06:16.831921 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:06:16.831921 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:06:16.831921 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:06:16.831921 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:06:16.831921 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:06:16.831921 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:06:16.831921 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de9d6639-040b-44b7-b00a-c1022c705c89 could not be found. Oct 08 21:06:16.831921 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:06:16.831921 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:06:16.831921 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:06:16.831921 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:06:16.831921 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:06:16.831921 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:06:16.831921 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:06:16.831921 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:06:16.831921 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:06:16.831921 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:06:16.831921 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:06:16.831921 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:06:16.831921 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:06:16.831921 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:06:16.831921 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:06:16.831921 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:06:16.831921 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de9d6639-040b-44b7-b00a-c1022c705c89 could not be found. Oct 08 21:06:16.831921 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:06:16.831921 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:06:16.836802 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:06:16.836802 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:06:16.836802 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:06:16.836802 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:06:16.836802 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:06:16.836802 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:06:16.836802 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de9d6639-040b-44b7-b00a-c1022c705c89 could not be found. Oct 08 21:06:16.836802 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:06:16.836802 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-6414c658-e14b-4e8b-a117-3671136a57cb tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] Returning 404 to user: Instance de9d6639-040b-44b7-b00a-c1022c705c89 could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:06:16.836802 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-6414c658-e14b-4e8b-a117-3671136a57cb tempest-FloatingIPsAssociationTestJSON-746342360 tempest-FloatingIPsAssociationTestJSON-746342360-project] 10.222.0.26 "GET /compute/v2.1/servers/de9d6639-040b-44b7-b00a-c1022c705c89" status: 404 len: 111 microversion: 2.1 time: 0.078175 Oct 08 21:06:16.837662 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-aa832b0e-db22-43dc-b178-28d94858bf91 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:06:16.837662 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-aa832b0e-db22-43dc-b178-28d94858bf91 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: ba7e1478-4f49-4350-9ea9-06e23eb05c63] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:06:16.850747 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1754/3430] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:06:16 2022] GET /compute/v2.1/servers/de9d6639-040b-44b7-b00a-c1022c705c89 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:06:16.853722 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-aa832b0e-db22-43dc-b178-28d94858bf91 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] HTTP exception thrown: Instance ba7e1478-4f49-4350-9ea9-06e23eb05c63 could not be found. Oct 08 21:06:16.859462 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-aa832b0e-db22-43dc-b178-28d94858bf91 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Request method failure captured: Oct 08 21:06:16.859462 ncdv-master-1 devstack@n-api.service[140491]: request: GET /compute/v2.1/servers/ba7e1478-4f49-4350-9ea9-06e23eb05c63 HTTP/1.1 Oct 08 21:06:16.859462 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:06:16.859462 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:06:16.859462 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:06:16.859462 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 21:06:16.859462 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:06:16.859462 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:06:16.859462 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:06:16.859462 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:06:16.859462 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeYsdf-NgsPUaUb78CUpk0vq18mlUqdb1er-CKgSGnwcxKYVDw5Br5ObGheB0PHKIrwGHgJ4op59IUcxCd3ChQqclxeYxKhK3ZwkXmw1AwIGXWjgktrsk6DH6ba1NMLmZ1pzBqcyvzB3CMIuC4HBXIHDILjU44EobGpdQQ8lNmKdDFM Oct 08 21:06:16.859462 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:06:16.859462 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:06:16.859462 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:06:16.859462 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:06:16.859462 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:06:16.859462 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:06:16.859462 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: e7ded993145b4eda9d6a33b994519012 Oct 08 21:06:16.859462 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-ServersTestJSON-68907085 Oct 08 21:06:16.859462 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:06:16.859462 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:06:16.859462 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/e7ded993145b4eda9d6a33b994519012"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e7ded993145b4eda9d6a33b994519012"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_e7ded993145b4eda9d6a33b994519012"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e7ded993145b4eda9d6a33b994519012"}]}] Oct 08 21:06:16.859462 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-ServersTestJSON-68907085 Oct 08 21:06:16.859462 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: e7ded993145b4eda9d6a33b994519012 Oct 08 21:06:16.859462 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-ServersTestJSON-68907085 Oct 08 21:06:16.859462 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-ServersTestJSON-68907085-project Oct 08 21:06:16.859462 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:06:16.859462 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:06:16.859462 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 06443b5728fb4d1e95d6245820e786bf Oct 08 21:06:16.859462 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-ServersTestJSON-68907085-project Oct 08 21:06:16.859462 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:06:16.859462 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance ba7e1478-4f49-4350-9ea9-06e23eb05c63 could not be found. Oct 08 21:06:16.859462 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': 'ba7e1478-4f49-4350-9ea9-06e23eb05c63'} Oct 08 21:06:16.859462 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:06:16.859462 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:06:16.859462 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:06:16.859462 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:06:16.859462 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:06:16.859462 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:06:16.859462 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 08 21:06:16.859462 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 08 21:06:16.859462 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba7e1478-4f49-4350-9ea9-06e23eb05c63 could not be found. Oct 08 21:06:16.859462 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:06:16.859462 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:06:16.859462 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:06:16.859462 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:06:16.859462 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:06:16.859462 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:06:16.859462 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:06:16.859462 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:06:16.859462 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:06:16.859462 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:06:16.859462 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:06:16.859462 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:06:16.859462 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:06:16.859462 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:06:16.859462 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:06:16.859462 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:06:16.859462 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba7e1478-4f49-4350-9ea9-06e23eb05c63 could not be found. Oct 08 21:06:16.859462 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:06:16.859462 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:06:16.859462 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:06:16.859462 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:06:16.859462 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:06:16.859462 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:06:16.863847 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:06:16.863847 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:06:16.863847 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba7e1478-4f49-4350-9ea9-06e23eb05c63 could not be found. Oct 08 21:06:16.863847 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:06:16.863847 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-aa832b0e-db22-43dc-b178-28d94858bf91 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Returning 404 to user: Instance ba7e1478-4f49-4350-9ea9-06e23eb05c63 could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:06:16.864937 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-aa832b0e-db22-43dc-b178-28d94858bf91 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "GET /compute/v2.1/servers/ba7e1478-4f49-4350-9ea9-06e23eb05c63" status: 404 len: 111 microversion: 2.1 time: 0.042256 Oct 08 21:06:16.873498 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1677/3431] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:06:16 2022] GET /compute/v2.1/servers/ba7e1478-4f49-4350-9ea9-06e23eb05c63 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:06:17.144365 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-39116527-c860-4102-95f0-9989255c83eb req-a8dd4d39-de1f-45f5-ad3c-b3c4ce16ef34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21", "tag": "5335fdc0-eb0a-483f-85b3-3278a5303d53"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:06:17.166562 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-39116527-c860-4102-95f0-9989255c83eb req-a8dd4d39-de1f-45f5-ad3c-b3c4ce16ef34 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:17.168825 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-39116527-c860-4102-95f0-9989255c83eb req-a8dd4d39-de1f-45f5-ad3c-b3c4ce16ef34 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:17.169327 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-39116527-c860-4102-95f0-9989255c83eb req-a8dd4d39-de1f-45f5-ad3c-b3c4ce16ef34 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:17.198660 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-39116527-c860-4102-95f0-9989255c83eb req-a8dd4d39-de1f-45f5-ad3c-b3c4ce16ef34 service nova] Creating event network-changed:5335fdc0-eb0a-483f-85b3-3278a5303d53 for instance 4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21 on nch1-master-1 Oct 08 21:06:17.210313 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-39116527-c860-4102-95f0-9989255c83eb req-a8dd4d39-de1f-45f5-ad3c-b3c4ce16ef34 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071199 Oct 08 21:06:17.211261 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1755/3432] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:06:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:06:17.276490 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-547c007f-0549-4018-9f9b-a49d0e820e64 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1503518035", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "983c5654-1828-48da-a871-2028e691f4b0"}]}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:06:17.401929 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.network.neutron [None req-547c007f-0549-4018-9f9b-a49d0e820e64 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] validate_networks() for [('983c5654-1828-48da-a871-2028e691f4b0', None, None, None, None, None)] {{(pid=140491) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 21:06:17.445008 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-4cc14850-bc0d-4822-bf45-92659db2cd34 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:06:17.445806 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-4cc14850-bc0d-4822-bf45-92659db2cd34 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] [instance: 4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:06:17.460601 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4cc14850-bc0d-4822-bf45-92659db2cd34 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:17.461453 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4cc14850-bc0d-4822-bf45-92659db2cd34 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:17.462107 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4cc14850-bc0d-4822-bf45-92659db2cd34 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:17.463348 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4cc14850-bc0d-4822-bf45-92659db2cd34 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:17.464630 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4cc14850-bc0d-4822-bf45-92659db2cd34 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:17.465806 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4cc14850-bc0d-4822-bf45-92659db2cd34 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:17.848488 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-4cc14850-bc0d-4822-bf45-92659db2cd34 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc2bdd169daf4a1db830b1fa7f94f0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f2d56477794f8ab38b8e3535b3e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:17.862180 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-4cc14850-bc0d-4822-bf45-92659db2cd34 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc2bdd169daf4a1db830b1fa7f94f0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f2d56477794f8ab38b8e3535b3e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:17.868898 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-4cc14850-bc0d-4822-bf45-92659db2cd34 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc2bdd169daf4a1db830b1fa7f94f0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f2d56477794f8ab38b8e3535b3e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:17.873226 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-4cc14850-bc0d-4822-bf45-92659db2cd34 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] 10.222.0.26 "GET /compute/v2.1/servers/4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21" status: 200 len: 1879 microversion: 2.32 time: 0.432871 Oct 08 21:06:17.874755 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1756/3433] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:06:17 2022] GET /compute/v2.1/servers/4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21 => generated 1879 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:06:17.886106 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-76dbe1e3-fb73-4d3d-96ca-861e3b28e20b tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:06:17.887081 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-76dbe1e3-fb73-4d3d-96ca-861e3b28e20b tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] [instance: dbacaeed-a40b-4e05-9635-5073dfdd8621] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:06:17.902994 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-76dbe1e3-fb73-4d3d-96ca-861e3b28e20b tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:17.903742 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-76dbe1e3-fb73-4d3d-96ca-861e3b28e20b tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:17.906765 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-76dbe1e3-fb73-4d3d-96ca-861e3b28e20b tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:17.907852 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-76dbe1e3-fb73-4d3d-96ca-861e3b28e20b tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:17.909070 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-76dbe1e3-fb73-4d3d-96ca-861e3b28e20b tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:17.911328 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-76dbe1e3-fb73-4d3d-96ca-861e3b28e20b tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:18.288181 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-76dbe1e3-fb73-4d3d-96ca-861e3b28e20b tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:18.300244 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-76dbe1e3-fb73-4d3d-96ca-861e3b28e20b tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:18.307967 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-76dbe1e3-fb73-4d3d-96ca-861e3b28e20b tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:18.320798 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-76dbe1e3-fb73-4d3d-96ca-861e3b28e20b tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] 10.222.0.26 "GET /compute/v2.1/servers/dbacaeed-a40b-4e05-9635-5073dfdd8621" status: 200 len: 1723 microversion: 2.20 time: 0.444647 Oct 08 21:06:18.323839 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1757/3434] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:06:17 2022] GET /compute/v2.1/servers/dbacaeed-a40b-4e05-9635-5073dfdd8621 => generated 1723 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:06:18.606529 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e0d72414-9f9d-4466-9072-31d5d2fb5c46 tempest-ImagesMetadataNegativeTestJSON-109528549 tempest-ImagesMetadataNegativeTestJSON-109528549-project] Calling method '.version_select at 0x7f1a8cacf160>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:06:18.636116 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-e0d72414-9f9d-4466-9072-31d5d2fb5c46 tempest-ImagesMetadataNegativeTestJSON-109528549 tempest-ImagesMetadataNegativeTestJSON-109528549-project] HTTP exception thrown: Image not found. Oct 08 21:06:18.657601 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e0d72414-9f9d-4466-9072-31d5d2fb5c46 tempest-ImagesMetadataNegativeTestJSON-109528549 tempest-ImagesMetadataNegativeTestJSON-109528549-project] Request method failure captured: Oct 08 21:06:18.657601 ncdv-master-1 devstack@n-api.service[140492]: request: DELETE /compute/v2.1/images/c3f9d061-838b-47e5-b066-0f19e81d8f27/metadata/os_distro HTTP/1.1 Oct 08 21:06:18.657601 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:06:18.657601 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:06:18.657601 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:06:18.657601 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 21:06:18.657601 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:06:18.657601 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:06:18.657601 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:06:18.657601 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:06:18.657601 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeZJfo5stT-D2j5cSnRlbbu63P9qzxBZrq_K7EkwgJDdutq9Eypo4MBI4OHLM6FkVYi9k_G6rAifqjYbxNd_ymyBMF9sMoD0WVzGZB4DDy3-DD0KyeMlYff27D71a4hWm138uiH9Leoig7GW1izts-zYeX5U0bDVxER8PiF_G1c4RJQ Oct 08 21:06:18.657601 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:06:18.657601 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:06:18.657601 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:06:18.657601 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:06:18.657601 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:06:18.657601 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:06:18.657601 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 6dc1b8f80be04533b9c2f6b772350586 Oct 08 21:06:18.657601 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-109528549 Oct 08 21:06:18.657601 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:06:18.657601 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:06:18.657601 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6dc1b8f80be04533b9c2f6b772350586"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6dc1b8f80be04533b9c2f6b772350586"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6dc1b8f80be04533b9c2f6b772350586"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6dc1b8f80be04533b9c2f6b772350586"}]}] Oct 08 21:06:18.657601 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-109528549 Oct 08 21:06:18.657601 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 6dc1b8f80be04533b9c2f6b772350586 Oct 08 21:06:18.657601 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-109528549 Oct 08 21:06:18.657601 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-ImagesMetadataNegativeTestJSON-109528549-project Oct 08 21:06:18.657601 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:06:18.657601 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:06:18.657601 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 0d7f2813d2094f549a78a0b77cd99506 Oct 08 21:06:18.657601 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-109528549-project Oct 08 21:06:18.657601 ncdv-master-1 devstack@n-api.service[140492]: method: Oct 08 21:06:18.657601 ncdv-master-1 devstack@n-api.service[140492]: exception: Image not found. Oct 08 21:06:18.657601 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'image_id': 'c3f9d061-838b-47e5-b066-0f19e81d8f27', 'id': 'os_distro'} Oct 08 21:06:18.657601 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:06:18.657601 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:06:18.657601 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 08 21:06:18.657601 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 08 21:06:18.657601 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 08 21:06:18.657601 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 08 21:06:18.657601 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 08 21:06:18.657601 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 08 21:06:18.657601 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 08 21:06:18.657601 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 08 21:06:18.657601 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 08 21:06:18.657601 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 08 21:06:18.657601 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 08 21:06:18.657601 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 08 21:06:18.657601 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 08 21:06:18.657601 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 08 21:06:18.657601 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 08 21:06:18.657601 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 08 21:06:18.657601 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID c3f9d061-838b-47e5-b066-0f19e81d8f27 Oct 08 21:06:18.657601 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:06:18.657601 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:06:18.657601 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:06:18.657601 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:06:18.657601 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 08 21:06:18.657601 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 08 21:06:18.657601 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 08 21:06:18.657601 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 08 21:06:18.657601 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 08 21:06:18.657601 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 08 21:06:18.661810 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 08 21:06:18.661810 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 08 21:06:18.661810 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 08 21:06:18.661810 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 08 21:06:18.661810 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 08 21:06:18.661810 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 08 21:06:18.661810 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 08 21:06:18.661810 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 08 21:06:18.661810 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 08 21:06:18.661810 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 08 21:06:18.661810 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 08 21:06:18.661810 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 08 21:06:18.661810 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 08 21:06:18.661810 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 08 21:06:18.661810 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 08 21:06:18.661810 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 08 21:06:18.661810 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 08 21:06:18.661810 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 08 21:06:18.661810 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image c3f9d061-838b-47e5-b066-0f19e81d8f27 could not be found. Oct 08 21:06:18.661810 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:06:18.661810 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:06:18.661810 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:06:18.661810 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:06:18.661810 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:06:18.661810 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:06:18.661810 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:06:18.661810 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:06:18.661810 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 08 21:06:18.661810 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 08 21:06:18.661810 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:06:18.661810 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:06:18.661810 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Oct 08 21:06:18.661810 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 08 21:06:18.661810 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 08 21:06:18.661810 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 08 21:06:18.661810 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 08 21:06:18.661810 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:06:18.661810 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:06:18.661810 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:06:18.661810 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:06:18.661810 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:06:18.661810 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:06:18.661810 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:06:18.661810 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:06:18.661810 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 08 21:06:18.661810 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:06:18.661810 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e0d72414-9f9d-4466-9072-31d5d2fb5c46 tempest-ImagesMetadataNegativeTestJSON-109528549 tempest-ImagesMetadataNegativeTestJSON-109528549-project] Returning 404 to user: Image not found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:06:18.671204 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-e0d72414-9f9d-4466-9072-31d5d2fb5c46 tempest-ImagesMetadataNegativeTestJSON-109528549 tempest-ImagesMetadataNegativeTestJSON-109528549-project] 10.222.0.26 "DELETE /compute/v2.1/images/c3f9d061-838b-47e5-b066-0f19e81d8f27/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.333002 Oct 08 21:06:18.671204 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1758/3435] 10.222.0.26 () {58 vars in 1293 bytes} [Sat Oct 8 21:06:18 2022] DELETE /compute/v2.1/images/c3f9d061-838b-47e5-b066-0f19e81d8f27/metadata/os_distro => generated 62 bytes in 343 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 08 21:06:18.678442 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-9b606928-1e6f-4aa6-af07-d5b48e663ea2 tempest-ImagesMetadataNegativeTestJSON-109528549 tempest-ImagesMetadataNegativeTestJSON-109528549-project] Calling method '.version_select at 0x7f1a913344c0>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:06:18.708925 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-9b606928-1e6f-4aa6-af07-d5b48e663ea2 tempest-ImagesMetadataNegativeTestJSON-109528549 tempest-ImagesMetadataNegativeTestJSON-109528549-project] HTTP exception thrown: Image not found. Oct 08 21:06:18.712466 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-9b606928-1e6f-4aa6-af07-d5b48e663ea2 tempest-ImagesMetadataNegativeTestJSON-109528549 tempest-ImagesMetadataNegativeTestJSON-109528549-project] Request method failure captured: Oct 08 21:06:18.712466 ncdv-master-1 devstack@n-api.service[140492]: request: GET /compute/v2.1/images/33d86856-ce6a-426a-80e2-38acbbe677c2/metadata/os_version HTTP/1.1 Oct 08 21:06:18.712466 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:06:18.712466 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:06:18.712466 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:06:18.712466 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 21:06:18.712466 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:06:18.712466 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:06:18.712466 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:06:18.712466 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:06:18.712466 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeZJfo5stT-D2j5cSnRlbbu63P9qzxBZrq_K7EkwgJDdutq9Eypo4MBI4OHLM6FkVYi9k_G6rAifqjYbxNd_ymyBMF9sMoD0WVzGZB4DDy3-DD0KyeMlYff27D71a4hWm138uiH9Leoig7GW1izts-zYeX5U0bDVxER8PiF_G1c4RJQ Oct 08 21:06:18.712466 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:06:18.712466 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:06:18.712466 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:06:18.712466 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:06:18.712466 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:06:18.712466 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:06:18.712466 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 6dc1b8f80be04533b9c2f6b772350586 Oct 08 21:06:18.712466 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-109528549 Oct 08 21:06:18.712466 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:06:18.712466 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:06:18.712466 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6dc1b8f80be04533b9c2f6b772350586"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6dc1b8f80be04533b9c2f6b772350586"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6dc1b8f80be04533b9c2f6b772350586"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6dc1b8f80be04533b9c2f6b772350586"}]}] Oct 08 21:06:18.712466 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-109528549 Oct 08 21:06:18.712466 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 6dc1b8f80be04533b9c2f6b772350586 Oct 08 21:06:18.712466 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-109528549 Oct 08 21:06:18.712466 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-ImagesMetadataNegativeTestJSON-109528549-project Oct 08 21:06:18.712466 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:06:18.712466 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:06:18.712466 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 0d7f2813d2094f549a78a0b77cd99506 Oct 08 21:06:18.712466 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-109528549-project Oct 08 21:06:18.712466 ncdv-master-1 devstack@n-api.service[140492]: method: Oct 08 21:06:18.712466 ncdv-master-1 devstack@n-api.service[140492]: exception: Image not found. Oct 08 21:06:18.712466 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'image_id': '33d86856-ce6a-426a-80e2-38acbbe677c2', 'id': 'os_version'} Oct 08 21:06:18.712466 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:06:18.712466 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:06:18.712466 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 08 21:06:18.712466 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 08 21:06:18.712466 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 08 21:06:18.712466 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 08 21:06:18.712466 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 08 21:06:18.712466 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 08 21:06:18.712466 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 08 21:06:18.712466 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 08 21:06:18.712466 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 08 21:06:18.712466 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 08 21:06:18.712466 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 08 21:06:18.712466 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 08 21:06:18.712466 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 08 21:06:18.712466 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 08 21:06:18.712466 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 08 21:06:18.712466 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 08 21:06:18.712466 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 33d86856-ce6a-426a-80e2-38acbbe677c2 Oct 08 21:06:18.712466 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:06:18.712466 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:06:18.712466 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:06:18.712466 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:06:18.712466 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 08 21:06:18.712466 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 08 21:06:18.712466 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 08 21:06:18.712466 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 08 21:06:18.712466 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 08 21:06:18.712466 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 08 21:06:18.717729 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 08 21:06:18.717729 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 08 21:06:18.717729 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 08 21:06:18.717729 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 08 21:06:18.717729 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 08 21:06:18.717729 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 08 21:06:18.717729 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 08 21:06:18.717729 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 08 21:06:18.717729 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 08 21:06:18.717729 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 08 21:06:18.717729 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 08 21:06:18.717729 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 08 21:06:18.717729 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 08 21:06:18.717729 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 08 21:06:18.717729 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 08 21:06:18.717729 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 08 21:06:18.717729 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 08 21:06:18.717729 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 08 21:06:18.717729 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 33d86856-ce6a-426a-80e2-38acbbe677c2 could not be found. Oct 08 21:06:18.717729 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:06:18.717729 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:06:18.717729 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:06:18.717729 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:06:18.717729 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:06:18.717729 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:06:18.717729 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:06:18.717729 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:06:18.717729 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 08 21:06:18.717729 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 08 21:06:18.717729 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:06:18.717729 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:06:18.717729 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Oct 08 21:06:18.717729 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Oct 08 21:06:18.717729 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 08 21:06:18.717729 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 08 21:06:18.717729 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 08 21:06:18.717729 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:06:18.717729 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:06:18.717729 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:06:18.717729 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:06:18.717729 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:06:18.717729 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:06:18.717729 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:06:18.717729 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:06:18.717729 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 08 21:06:18.717729 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:06:18.717729 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-9b606928-1e6f-4aa6-af07-d5b48e663ea2 tempest-ImagesMetadataNegativeTestJSON-109528549 tempest-ImagesMetadataNegativeTestJSON-109528549-project] Returning 404 to user: Image not found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:06:18.717729 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-9b606928-1e6f-4aa6-af07-d5b48e663ea2 tempest-ImagesMetadataNegativeTestJSON-109528549 tempest-ImagesMetadataNegativeTestJSON-109528549-project] 10.222.0.26 "GET /compute/v2.1/images/33d86856-ce6a-426a-80e2-38acbbe677c2/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.046876 Oct 08 21:06:18.726580 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1759/3436] 10.222.0.26 () {58 vars in 1293 bytes} [Sat Oct 8 21:06:18 2022] GET /compute/v2.1/images/33d86856-ce6a-426a-80e2-38acbbe677c2/metadata/os_version => generated 62 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 08 21:06:18.731840 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-a2fe0786-dab2-421b-b1f1-2dbeaa857e5c tempest-ImagesMetadataNegativeTestJSON-109528549 tempest-ImagesMetadataNegativeTestJSON-109528549-project] Calling method '.version_select at 0x7f1a8cacfaf0>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:06:18.767072 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-a2fe0786-dab2-421b-b1f1-2dbeaa857e5c tempest-ImagesMetadataNegativeTestJSON-109528549 tempest-ImagesMetadataNegativeTestJSON-109528549-project] HTTP exception thrown: Image not found. Oct 08 21:06:18.772481 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-a2fe0786-dab2-421b-b1f1-2dbeaa857e5c tempest-ImagesMetadataNegativeTestJSON-109528549 tempest-ImagesMetadataNegativeTestJSON-109528549-project] Request method failure captured: Oct 08 21:06:18.772481 ncdv-master-1 devstack@n-api.service[140492]: request: GET /compute/v2.1/images/d2ff6979-13f8-49e9-bdc7-5807bf61d95b/metadata HTTP/1.1 Oct 08 21:06:18.772481 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:06:18.772481 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:06:18.772481 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:06:18.772481 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 21:06:18.772481 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:06:18.772481 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:06:18.772481 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:06:18.772481 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:06:18.772481 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeZJfo5stT-D2j5cSnRlbbu63P9qzxBZrq_K7EkwgJDdutq9Eypo4MBI4OHLM6FkVYi9k_G6rAifqjYbxNd_ymyBMF9sMoD0WVzGZB4DDy3-DD0KyeMlYff27D71a4hWm138uiH9Leoig7GW1izts-zYeX5U0bDVxER8PiF_G1c4RJQ Oct 08 21:06:18.772481 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:06:18.772481 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:06:18.772481 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:06:18.772481 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:06:18.772481 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:06:18.772481 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:06:18.772481 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 6dc1b8f80be04533b9c2f6b772350586 Oct 08 21:06:18.772481 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-109528549 Oct 08 21:06:18.772481 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:06:18.772481 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:06:18.772481 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6dc1b8f80be04533b9c2f6b772350586"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6dc1b8f80be04533b9c2f6b772350586"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6dc1b8f80be04533b9c2f6b772350586"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6dc1b8f80be04533b9c2f6b772350586"}]}] Oct 08 21:06:18.772481 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-109528549 Oct 08 21:06:18.772481 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 6dc1b8f80be04533b9c2f6b772350586 Oct 08 21:06:18.772481 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-109528549 Oct 08 21:06:18.772481 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-ImagesMetadataNegativeTestJSON-109528549-project Oct 08 21:06:18.772481 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:06:18.772481 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:06:18.772481 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 0d7f2813d2094f549a78a0b77cd99506 Oct 08 21:06:18.772481 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-109528549-project Oct 08 21:06:18.772481 ncdv-master-1 devstack@n-api.service[140492]: method: Oct 08 21:06:18.772481 ncdv-master-1 devstack@n-api.service[140492]: exception: Image not found. Oct 08 21:06:18.772481 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'image_id': 'd2ff6979-13f8-49e9-bdc7-5807bf61d95b'} Oct 08 21:06:18.772481 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:06:18.772481 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:06:18.772481 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 08 21:06:18.772481 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 08 21:06:18.772481 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 08 21:06:18.772481 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 08 21:06:18.772481 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 08 21:06:18.772481 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 08 21:06:18.772481 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 08 21:06:18.772481 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 08 21:06:18.772481 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 08 21:06:18.772481 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 08 21:06:18.772481 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 08 21:06:18.772481 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 08 21:06:18.772481 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 08 21:06:18.772481 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 08 21:06:18.772481 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 08 21:06:18.772481 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 08 21:06:18.772481 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID d2ff6979-13f8-49e9-bdc7-5807bf61d95b Oct 08 21:06:18.772481 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:06:18.772481 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:06:18.772481 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:06:18.772481 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:06:18.772481 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 08 21:06:18.772481 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 08 21:06:18.772481 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 08 21:06:18.772481 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 08 21:06:18.772481 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 08 21:06:18.772481 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 08 21:06:18.779481 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 08 21:06:18.779481 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 08 21:06:18.779481 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 08 21:06:18.779481 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 08 21:06:18.779481 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 08 21:06:18.779481 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 08 21:06:18.779481 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 08 21:06:18.779481 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 08 21:06:18.779481 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 08 21:06:18.779481 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 08 21:06:18.779481 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 08 21:06:18.779481 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 08 21:06:18.779481 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 08 21:06:18.779481 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 08 21:06:18.779481 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 08 21:06:18.779481 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 08 21:06:18.779481 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 08 21:06:18.779481 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 08 21:06:18.779481 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image d2ff6979-13f8-49e9-bdc7-5807bf61d95b could not be found. Oct 08 21:06:18.779481 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:06:18.779481 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:06:18.779481 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:06:18.779481 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:06:18.779481 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:06:18.779481 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:06:18.779481 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:06:18.779481 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:06:18.779481 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 08 21:06:18.779481 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 08 21:06:18.779481 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:06:18.779481 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:06:18.779481 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Oct 08 21:06:18.779481 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Oct 08 21:06:18.779481 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 08 21:06:18.779481 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 08 21:06:18.779481 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 08 21:06:18.779481 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:06:18.779481 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:06:18.779481 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:06:18.779481 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:06:18.779481 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:06:18.779481 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:06:18.779481 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:06:18.779481 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:06:18.779481 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 08 21:06:18.779481 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:06:18.779481 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-a2fe0786-dab2-421b-b1f1-2dbeaa857e5c tempest-ImagesMetadataNegativeTestJSON-109528549 tempest-ImagesMetadataNegativeTestJSON-109528549-project] Returning 404 to user: Image not found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:06:18.779481 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-a2fe0786-dab2-421b-b1f1-2dbeaa857e5c tempest-ImagesMetadataNegativeTestJSON-109528549 tempest-ImagesMetadataNegativeTestJSON-109528549-project] 10.222.0.26 "GET /compute/v2.1/images/d2ff6979-13f8-49e9-bdc7-5807bf61d95b/metadata" status: 404 len: 62 microversion: 2.1 time: 0.046159 Oct 08 21:06:18.779481 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1760/3437] 10.222.0.26 () {58 vars in 1260 bytes} [Sat Oct 8 21:06:18 2022] GET /compute/v2.1/images/d2ff6979-13f8-49e9-bdc7-5807bf61d95b/metadata => generated 62 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 08 21:06:18.788138 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-0dfc1e13-d2f0-432d-8ffb-832079185efc tempest-ImagesMetadataNegativeTestJSON-109528549 tempest-ImagesMetadataNegativeTestJSON-109528549-project] Action: 'update_all', calling method: .version_select at 0x7f1a8d3535e0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:06:18.848107 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-0dfc1e13-d2f0-432d-8ffb-832079185efc tempest-ImagesMetadataNegativeTestJSON-109528549 tempest-ImagesMetadataNegativeTestJSON-109528549-project] HTTP exception thrown: Image not found. Oct 08 21:06:18.851487 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-0dfc1e13-d2f0-432d-8ffb-832079185efc tempest-ImagesMetadataNegativeTestJSON-109528549 tempest-ImagesMetadataNegativeTestJSON-109528549-project] Request method failure captured: Oct 08 21:06:18.851487 ncdv-master-1 devstack@n-api.service[140492]: request: PUT /compute/v2.1/images/82b30879-d206-417b-b566-6afff7ee7c74/metadata HTTP/1.1 Oct 08 21:06:18.851487 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:06:18.851487 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:06:18.851487 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:06:18.851487 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 57 Oct 08 21:06:18.851487 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:06:18.851487 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:06:18.851487 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:06:18.851487 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:06:18.851487 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeZJfo5stT-D2j5cSnRlbbu63P9qzxBZrq_K7EkwgJDdutq9Eypo4MBI4OHLM6FkVYi9k_G6rAifqjYbxNd_ymyBMF9sMoD0WVzGZB4DDy3-DD0KyeMlYff27D71a4hWm138uiH9Leoig7GW1izts-zYeX5U0bDVxER8PiF_G1c4RJQ Oct 08 21:06:18.851487 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:06:18.851487 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:06:18.851487 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:06:18.851487 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:06:18.851487 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:06:18.851487 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:06:18.851487 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 6dc1b8f80be04533b9c2f6b772350586 Oct 08 21:06:18.851487 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-109528549 Oct 08 21:06:18.851487 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:06:18.851487 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:06:18.851487 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6dc1b8f80be04533b9c2f6b772350586"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6dc1b8f80be04533b9c2f6b772350586"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6dc1b8f80be04533b9c2f6b772350586"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6dc1b8f80be04533b9c2f6b772350586"}]}] Oct 08 21:06:18.851487 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-109528549 Oct 08 21:06:18.851487 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 6dc1b8f80be04533b9c2f6b772350586 Oct 08 21:06:18.851487 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-109528549 Oct 08 21:06:18.851487 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-ImagesMetadataNegativeTestJSON-109528549-project Oct 08 21:06:18.851487 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:06:18.851487 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:06:18.851487 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 0d7f2813d2094f549a78a0b77cd99506 Oct 08 21:06:18.851487 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-109528549-project Oct 08 21:06:18.851487 ncdv-master-1 devstack@n-api.service[140492]: Oct 08 21:06:18.851487 ncdv-master-1 devstack@n-api.service[140492]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Oct 08 21:06:18.851487 ncdv-master-1 devstack@n-api.service[140492]: method: Oct 08 21:06:18.851487 ncdv-master-1 devstack@n-api.service[140492]: exception: Image not found. Oct 08 21:06:18.851487 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'image_id': '82b30879-d206-417b-b566-6afff7ee7c74', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Oct 08 21:06:18.851487 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:06:18.851487 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:06:18.851487 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 08 21:06:18.851487 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 08 21:06:18.851487 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 08 21:06:18.851487 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 08 21:06:18.851487 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 08 21:06:18.851487 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 08 21:06:18.851487 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 08 21:06:18.851487 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 08 21:06:18.851487 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 08 21:06:18.851487 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 08 21:06:18.851487 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 08 21:06:18.851487 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 08 21:06:18.851487 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 08 21:06:18.851487 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 08 21:06:18.851487 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 08 21:06:18.851487 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 08 21:06:18.851487 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 82b30879-d206-417b-b566-6afff7ee7c74 Oct 08 21:06:18.851487 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:06:18.851487 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:06:18.851487 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:06:18.851487 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:06:18.851487 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 08 21:06:18.851487 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 08 21:06:18.851487 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 08 21:06:18.851487 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 08 21:06:18.851487 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 08 21:06:18.851487 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 08 21:06:18.856505 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 08 21:06:18.856505 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 08 21:06:18.856505 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 08 21:06:18.856505 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 08 21:06:18.856505 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 08 21:06:18.856505 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 08 21:06:18.856505 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 08 21:06:18.856505 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 08 21:06:18.856505 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 08 21:06:18.856505 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 08 21:06:18.856505 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 08 21:06:18.856505 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 08 21:06:18.856505 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 08 21:06:18.856505 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 08 21:06:18.856505 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 08 21:06:18.856505 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 08 21:06:18.856505 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 08 21:06:18.856505 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 08 21:06:18.856505 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 82b30879-d206-417b-b566-6afff7ee7c74 could not be found. Oct 08 21:06:18.856505 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:06:18.856505 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:06:18.856505 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:06:18.856505 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:06:18.856505 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:06:18.856505 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:06:18.856505 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:06:18.856505 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:06:18.856505 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 08 21:06:18.856505 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 08 21:06:18.856505 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:06:18.856505 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:06:18.856505 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 21:06:18.856505 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 21:06:18.856505 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Oct 08 21:06:18.856505 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 08 21:06:18.856505 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 08 21:06:18.856505 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 08 21:06:18.856505 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 08 21:06:18.856505 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:06:18.856505 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:06:18.856505 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:06:18.856505 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:06:18.856505 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:06:18.856505 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:06:18.856505 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:06:18.856505 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:06:18.856505 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 08 21:06:18.856505 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:06:18.863085 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-0dfc1e13-d2f0-432d-8ffb-832079185efc tempest-ImagesMetadataNegativeTestJSON-109528549 tempest-ImagesMetadataNegativeTestJSON-109528549-project] Returning 404 to user: Image not found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:06:18.863085 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-0dfc1e13-d2f0-432d-8ffb-832079185efc tempest-ImagesMetadataNegativeTestJSON-109528549 tempest-ImagesMetadataNegativeTestJSON-109528549-project] 10.222.0.26 "PUT /compute/v2.1/images/82b30879-d206-417b-b566-6afff7ee7c74/metadata" status: 404 len: 62 microversion: 2.1 time: 0.081962 Oct 08 21:06:18.863085 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1761/3438] 10.222.0.26 () {60 vars in 1280 bytes} [Sat Oct 8 21:06:18 2022] PUT /compute/v2.1/images/82b30879-d206-417b-b566-6afff7ee7c74/metadata => generated 62 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 08 21:06:18.876371 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-3b77880b-d0f1-4c13-9d1d-f37f5ddc32b8 tempest-ImagesMetadataNegativeTestJSON-109528549 tempest-ImagesMetadataNegativeTestJSON-109528549-project] Action: 'update', calling method: .version_select at 0x7f1a913340d0>, body: {"meta": {"os_distro": "alt"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:06:18.907290 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-3b77880b-d0f1-4c13-9d1d-f37f5ddc32b8 tempest-ImagesMetadataNegativeTestJSON-109528549 tempest-ImagesMetadataNegativeTestJSON-109528549-project] HTTP exception thrown: Image not found. Oct 08 21:06:18.910196 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-3b77880b-d0f1-4c13-9d1d-f37f5ddc32b8 tempest-ImagesMetadataNegativeTestJSON-109528549 tempest-ImagesMetadataNegativeTestJSON-109528549-project] Request method failure captured: Oct 08 21:06:18.910196 ncdv-master-1 devstack@n-api.service[140492]: request: PUT /compute/v2.1/images/15c9a043-19d3-48fd-a0dc-e54d7194c48b/metadata/os_distro HTTP/1.1 Oct 08 21:06:18.910196 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:06:18.910196 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:06:18.910196 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:06:18.910196 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 30 Oct 08 21:06:18.910196 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:06:18.910196 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:06:18.910196 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:06:18.910196 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:06:18.910196 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeZJfo5stT-D2j5cSnRlbbu63P9qzxBZrq_K7EkwgJDdutq9Eypo4MBI4OHLM6FkVYi9k_G6rAifqjYbxNd_ymyBMF9sMoD0WVzGZB4DDy3-DD0KyeMlYff27D71a4hWm138uiH9Leoig7GW1izts-zYeX5U0bDVxER8PiF_G1c4RJQ Oct 08 21:06:18.910196 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:06:18.910196 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:06:18.910196 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:06:18.910196 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:06:18.910196 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:06:18.910196 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:06:18.910196 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 6dc1b8f80be04533b9c2f6b772350586 Oct 08 21:06:18.910196 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-109528549 Oct 08 21:06:18.910196 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:06:18.910196 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:06:18.910196 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6dc1b8f80be04533b9c2f6b772350586"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6dc1b8f80be04533b9c2f6b772350586"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6dc1b8f80be04533b9c2f6b772350586"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6dc1b8f80be04533b9c2f6b772350586"}]}] Oct 08 21:06:18.910196 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-109528549 Oct 08 21:06:18.910196 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 6dc1b8f80be04533b9c2f6b772350586 Oct 08 21:06:18.910196 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-109528549 Oct 08 21:06:18.910196 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-ImagesMetadataNegativeTestJSON-109528549-project Oct 08 21:06:18.910196 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:06:18.910196 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:06:18.910196 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 0d7f2813d2094f549a78a0b77cd99506 Oct 08 21:06:18.910196 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-109528549-project Oct 08 21:06:18.910196 ncdv-master-1 devstack@n-api.service[140492]: Oct 08 21:06:18.910196 ncdv-master-1 devstack@n-api.service[140492]: {"meta": {"os_distro": "alt"}} Oct 08 21:06:18.910196 ncdv-master-1 devstack@n-api.service[140492]: method: Oct 08 21:06:18.910196 ncdv-master-1 devstack@n-api.service[140492]: exception: Image not found. Oct 08 21:06:18.910196 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'image_id': '15c9a043-19d3-48fd-a0dc-e54d7194c48b', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Oct 08 21:06:18.910196 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:06:18.910196 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:06:18.910196 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 08 21:06:18.910196 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 08 21:06:18.910196 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 08 21:06:18.910196 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 08 21:06:18.910196 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 08 21:06:18.910196 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 08 21:06:18.910196 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 08 21:06:18.910196 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 08 21:06:18.910196 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 08 21:06:18.910196 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 08 21:06:18.910196 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 08 21:06:18.910196 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 08 21:06:18.910196 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 08 21:06:18.910196 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 08 21:06:18.910196 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 08 21:06:18.910196 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 08 21:06:18.910196 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 15c9a043-19d3-48fd-a0dc-e54d7194c48b Oct 08 21:06:18.910196 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:06:18.910196 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:06:18.910196 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:06:18.910196 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:06:18.910196 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 08 21:06:18.910196 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 08 21:06:18.910196 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 08 21:06:18.910196 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 08 21:06:18.910196 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 08 21:06:18.910196 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 08 21:06:18.919401 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 08 21:06:18.919401 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 08 21:06:18.919401 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 08 21:06:18.919401 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 08 21:06:18.919401 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 08 21:06:18.919401 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 08 21:06:18.919401 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 08 21:06:18.919401 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 08 21:06:18.919401 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 08 21:06:18.919401 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 08 21:06:18.919401 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 08 21:06:18.919401 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 08 21:06:18.919401 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 08 21:06:18.919401 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 08 21:06:18.919401 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 08 21:06:18.919401 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 08 21:06:18.919401 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 08 21:06:18.919401 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 08 21:06:18.919401 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 15c9a043-19d3-48fd-a0dc-e54d7194c48b could not be found. Oct 08 21:06:18.919401 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:06:18.919401 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:06:18.919401 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:06:18.919401 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:06:18.919401 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:06:18.919401 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:06:18.919401 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:06:18.919401 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:06:18.919401 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 08 21:06:18.919401 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 08 21:06:18.919401 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:06:18.919401 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:06:18.919401 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 21:06:18.919401 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 21:06:18.919401 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Oct 08 21:06:18.919401 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 08 21:06:18.919401 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 08 21:06:18.919401 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 08 21:06:18.919401 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 08 21:06:18.919401 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:06:18.919401 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:06:18.919401 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:06:18.919401 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:06:18.919401 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:06:18.919401 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:06:18.919401 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:06:18.919401 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:06:18.919401 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 08 21:06:18.919401 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:06:18.919401 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-3b77880b-d0f1-4c13-9d1d-f37f5ddc32b8 tempest-ImagesMetadataNegativeTestJSON-109528549 tempest-ImagesMetadataNegativeTestJSON-109528549-project] Returning 404 to user: Image not found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:06:18.919401 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-3b77880b-d0f1-4c13-9d1d-f37f5ddc32b8 tempest-ImagesMetadataNegativeTestJSON-109528549 tempest-ImagesMetadataNegativeTestJSON-109528549-project] 10.222.0.26 "PUT /compute/v2.1/images/15c9a043-19d3-48fd-a0dc-e54d7194c48b/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.042938 Oct 08 21:06:18.919401 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1762/3439] 10.222.0.26 () {60 vars in 1310 bytes} [Sat Oct 8 21:06:18 2022] PUT /compute/v2.1/images/15c9a043-19d3-48fd-a0dc-e54d7194c48b/metadata/os_distro => generated 62 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 08 21:06:18.928407 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-081bd9f5-2a5f-4cd5-a4ff-4cf16bb0783c tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:06:18.929489 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-081bd9f5-2a5f-4cd5-a4ff-4cf16bb0783c tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] [instance: 4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:06:18.945666 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-081bd9f5-2a5f-4cd5-a4ff-4cf16bb0783c tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:18.946191 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-081bd9f5-2a5f-4cd5-a4ff-4cf16bb0783c tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:18.947424 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-081bd9f5-2a5f-4cd5-a4ff-4cf16bb0783c tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:18.948633 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-081bd9f5-2a5f-4cd5-a4ff-4cf16bb0783c tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:18.949142 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-081bd9f5-2a5f-4cd5-a4ff-4cf16bb0783c tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:18.952422 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-081bd9f5-2a5f-4cd5-a4ff-4cf16bb0783c tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:19.124759 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-547c007f-0549-4018-9f9b-a49d0e820e64 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Flavor limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 21:06:19.125423 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-547c007f-0549-4018-9f9b-a49d0e820e64 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Image limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 21:06:19.126082 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-547c007f-0549-4018-9f9b-a49d0e820e64 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Flavor pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 21:06:19.126640 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-547c007f-0549-4018-9f9b-a49d0e820e64 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Image pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 21:06:19.127177 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-547c007f-0549-4018-9f9b-a49d0e820e64 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 21:06:19.135700 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:06:19.143276 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-547c007f-0549-4018-9f9b-a49d0e820e64 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:19.144003 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-547c007f-0549-4018-9f9b-a49d0e820e64 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:19.145013 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-547c007f-0549-4018-9f9b-a49d0e820e64 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:19.146105 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-547c007f-0549-4018-9f9b-a49d0e820e64 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:19.146892 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-547c007f-0549-4018-9f9b-a49d0e820e64 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:19.147808 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-547c007f-0549-4018-9f9b-a49d0e820e64 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:19.174359 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-547c007f-0549-4018-9f9b-a49d0e820e64 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Getting quotas for project e7ded993145b4eda9d6a33b994519012. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:06:19.181308 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-547c007f-0549-4018-9f9b-a49d0e820e64 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Getting quotas for user 06443b5728fb4d1e95d6245820e786bf and project e7ded993145b4eda9d6a33b994519012. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:06:19.199756 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-547c007f-0549-4018-9f9b-a49d0e820e64 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Going to run 1 instances... {{(pid=140491) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 21:06:19.204203 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-547c007f-0549-4018-9f9b-a49d0e820e64 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: e1f1a2d9-92ff-4f2b-8f65-24cee7c6418d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c508bd7f-7db9-4b2c-af7c-be54a855c355',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140491) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 21:06:19.266449 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-081bd9f5-2a5f-4cd5-a4ff-4cf16bb0783c tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc2bdd169daf4a1db830b1fa7f94f0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f2d56477794f8ab38b8e3535b3e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:19.271050 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-547c007f-0549-4018-9f9b-a49d0e820e64 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.999819 Oct 08 21:06:19.277734 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1678/3440] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 21:06:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 2002 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 08 21:06:19.277734 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-0f43be29-b068-4a9c-a84f-6d5ba2c60685 tempest-ImagesMetadataNegativeTestJSON-109528549 tempest-ImagesMetadataNegativeTestJSON-109528549-project] Action: 'create', calling method: .version_select at 0x7f1a877ec550>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:06:19.281694 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-081bd9f5-2a5f-4cd5-a4ff-4cf16bb0783c tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc2bdd169daf4a1db830b1fa7f94f0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f2d56477794f8ab38b8e3535b3e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:19.286413 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-081bd9f5-2a5f-4cd5-a4ff-4cf16bb0783c tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc2bdd169daf4a1db830b1fa7f94f0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f2d56477794f8ab38b8e3535b3e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:19.287491 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-081bd9f5-2a5f-4cd5-a4ff-4cf16bb0783c tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] 10.222.0.26 "GET /compute/v2.1/servers/4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21" status: 200 len: 1879 microversion: 2.32 time: 0.373267 Oct 08 21:06:19.290251 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1763/3441] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:06:18 2022] GET /compute/v2.1/servers/4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21 => generated 1879 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:06:19.318962 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-a913eb53-e020-41b8-9cbf-d29acffa94e2 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:06:19.319761 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-a913eb53-e020-41b8-9cbf-d29acffa94e2 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: e1f1a2d9-92ff-4f2b-8f65-24cee7c6418d] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:06:19.339462 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-0f43be29-b068-4a9c-a84f-6d5ba2c60685 tempest-ImagesMetadataNegativeTestJSON-109528549 tempest-ImagesMetadataNegativeTestJSON-109528549-project] HTTP exception thrown: Image not found. Oct 08 21:06:19.341979 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-0f43be29-b068-4a9c-a84f-6d5ba2c60685 tempest-ImagesMetadataNegativeTestJSON-109528549 tempest-ImagesMetadataNegativeTestJSON-109528549-project] Request method failure captured: Oct 08 21:06:19.341979 ncdv-master-1 devstack@n-api.service[140491]: request: POST /compute/v2.1/images/6bba10ea-97eb-410e-906d-1f5e04d06c47/metadata HTTP/1.1 Oct 08 21:06:19.341979 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:06:19.341979 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:06:19.341979 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:06:19.341979 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 57 Oct 08 21:06:19.341979 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:06:19.341979 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:06:19.341979 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:06:19.341979 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:06:19.341979 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeZJfo5stT-D2j5cSnRlbbu63P9qzxBZrq_K7EkwgJDdutq9Eypo4MBI4OHLM6FkVYi9k_G6rAifqjYbxNd_ymyBMF9sMoD0WVzGZB4DDy3-DD0KyeMlYff27D71a4hWm138uiH9Leoig7GW1izts-zYeX5U0bDVxER8PiF_G1c4RJQ Oct 08 21:06:19.341979 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:06:19.341979 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:06:19.341979 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:06:19.341979 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:06:19.341979 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:06:19.341979 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:06:19.341979 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 6dc1b8f80be04533b9c2f6b772350586 Oct 08 21:06:19.341979 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-109528549 Oct 08 21:06:19.341979 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:06:19.341979 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:06:19.341979 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6dc1b8f80be04533b9c2f6b772350586"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6dc1b8f80be04533b9c2f6b772350586"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6dc1b8f80be04533b9c2f6b772350586"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6dc1b8f80be04533b9c2f6b772350586"}]}] Oct 08 21:06:19.341979 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-109528549 Oct 08 21:06:19.341979 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 6dc1b8f80be04533b9c2f6b772350586 Oct 08 21:06:19.341979 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-109528549 Oct 08 21:06:19.341979 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-ImagesMetadataNegativeTestJSON-109528549-project Oct 08 21:06:19.341979 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:06:19.341979 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:06:19.341979 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 0d7f2813d2094f549a78a0b77cd99506 Oct 08 21:06:19.341979 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-109528549-project Oct 08 21:06:19.341979 ncdv-master-1 devstack@n-api.service[140491]: Oct 08 21:06:19.341979 ncdv-master-1 devstack@n-api.service[140491]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Oct 08 21:06:19.341979 ncdv-master-1 devstack@n-api.service[140491]: method: Oct 08 21:06:19.341979 ncdv-master-1 devstack@n-api.service[140491]: exception: Image not found. Oct 08 21:06:19.341979 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'image_id': '6bba10ea-97eb-410e-906d-1f5e04d06c47', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Oct 08 21:06:19.341979 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:06:19.341979 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:06:19.341979 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 08 21:06:19.341979 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 08 21:06:19.341979 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 08 21:06:19.341979 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 08 21:06:19.341979 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 08 21:06:19.341979 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 08 21:06:19.341979 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 08 21:06:19.341979 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 08 21:06:19.341979 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 08 21:06:19.341979 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 08 21:06:19.341979 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 08 21:06:19.341979 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 08 21:06:19.341979 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 08 21:06:19.341979 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 08 21:06:19.341979 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 08 21:06:19.341979 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 08 21:06:19.341979 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 6bba10ea-97eb-410e-906d-1f5e04d06c47 Oct 08 21:06:19.341979 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:06:19.341979 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:06:19.341979 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:06:19.341979 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:06:19.341979 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 08 21:06:19.341979 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 08 21:06:19.341979 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 08 21:06:19.341979 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 08 21:06:19.341979 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 08 21:06:19.341979 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 08 21:06:19.347782 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 08 21:06:19.347782 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 08 21:06:19.347782 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 08 21:06:19.347782 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 08 21:06:19.347782 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 08 21:06:19.347782 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 08 21:06:19.347782 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 08 21:06:19.347782 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 08 21:06:19.347782 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 08 21:06:19.347782 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 08 21:06:19.347782 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 08 21:06:19.347782 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 08 21:06:19.347782 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 08 21:06:19.347782 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 08 21:06:19.347782 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 08 21:06:19.347782 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 08 21:06:19.347782 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 08 21:06:19.347782 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 08 21:06:19.347782 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 6bba10ea-97eb-410e-906d-1f5e04d06c47 could not be found. Oct 08 21:06:19.347782 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:06:19.347782 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:06:19.347782 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:06:19.347782 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:06:19.347782 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:06:19.347782 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:06:19.347782 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:06:19.347782 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:06:19.347782 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 08 21:06:19.347782 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 08 21:06:19.347782 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:06:19.347782 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:06:19.347782 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 21:06:19.347782 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 21:06:19.347782 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Oct 08 21:06:19.347782 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 08 21:06:19.347782 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 08 21:06:19.347782 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 08 21:06:19.347782 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 08 21:06:19.347782 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:06:19.347782 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:06:19.347782 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:06:19.347782 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:06:19.347782 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:06:19.347782 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:06:19.347782 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:06:19.347782 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:06:19.347782 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 08 21:06:19.347782 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:06:19.347782 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-0f43be29-b068-4a9c-a84f-6d5ba2c60685 tempest-ImagesMetadataNegativeTestJSON-109528549 tempest-ImagesMetadataNegativeTestJSON-109528549-project] Returning 404 to user: Image not found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:06:19.355454 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-0f43be29-b068-4a9c-a84f-6d5ba2c60685 tempest-ImagesMetadataNegativeTestJSON-109528549 tempest-ImagesMetadataNegativeTestJSON-109528549-project] 10.222.0.26 "POST /compute/v2.1/images/6bba10ea-97eb-410e-906d-1f5e04d06c47/metadata" status: 404 len: 62 microversion: 2.1 time: 0.074217 Oct 08 21:06:19.355454 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1679/3442] 10.222.0.26 () {60 vars in 1281 bytes} [Sat Oct 8 21:06:19 2022] POST /compute/v2.1/images/6bba10ea-97eb-410e-906d-1f5e04d06c47/metadata => generated 62 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 08 21:06:19.367718 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-7bf7ec11-a364-445a-bb0a-9964d6cb863c tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:06:19.368422 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-7bf7ec11-a364-445a-bb0a-9964d6cb863c tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] [instance: dbacaeed-a40b-4e05-9635-5073dfdd8621] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:06:19.390392 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7bf7ec11-a364-445a-bb0a-9964d6cb863c tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:19.391825 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7bf7ec11-a364-445a-bb0a-9964d6cb863c tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:19.392449 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7bf7ec11-a364-445a-bb0a-9964d6cb863c tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:19.397949 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-a913eb53-e020-41b8-9cbf-d29acffa94e2 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06443b5728fb4d1e95d6245820e786bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ded993145b4eda9d6a33b994519012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:19.398638 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7bf7ec11-a364-445a-bb0a-9964d6cb863c tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:19.399572 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7bf7ec11-a364-445a-bb0a-9964d6cb863c tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:19.400836 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7bf7ec11-a364-445a-bb0a-9964d6cb863c tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:19.408864 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-a913eb53-e020-41b8-9cbf-d29acffa94e2 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "GET /compute/v2.1/servers/e1f1a2d9-92ff-4f2b-8f65-24cee7c6418d" status: 200 len: 1221 microversion: 2.1 time: 0.115840 Oct 08 21:06:19.409777 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1764/3443] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:06:19 2022] GET /compute/v2.1/servers/e1f1a2d9-92ff-4f2b-8f65-24cee7c6418d => generated 1221 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:06:19.883461 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-7bf7ec11-a364-445a-bb0a-9964d6cb863c tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:19.893799 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-7bf7ec11-a364-445a-bb0a-9964d6cb863c tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:19.895269 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-7bf7ec11-a364-445a-bb0a-9964d6cb863c tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:19.896460 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-7bf7ec11-a364-445a-bb0a-9964d6cb863c tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] 10.222.0.26 "GET /compute/v2.1/servers/dbacaeed-a40b-4e05-9635-5073dfdd8621" status: 200 len: 1723 microversion: 2.20 time: 0.544408 Oct 08 21:06:19.902467 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1680/3444] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:06:19 2022] GET /compute/v2.1/servers/dbacaeed-a40b-4e05-9635-5073dfdd8621 => generated 1723 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:06:19.985356 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-4a52e411-6609-42ac-a806-628863b4d1f1 req-b2827a66-4433-42dc-85f3-0161fa65e2c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21", "tag": "394a1aae-3519-44f8-9e09-430c6dc79932"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:06:19.998800 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-4a52e411-6609-42ac-a806-628863b4d1f1 req-b2827a66-4433-42dc-85f3-0161fa65e2c6 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:19.999595 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-4a52e411-6609-42ac-a806-628863b4d1f1 req-b2827a66-4433-42dc-85f3-0161fa65e2c6 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:20.000030 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-4a52e411-6609-42ac-a806-628863b4d1f1 req-b2827a66-4433-42dc-85f3-0161fa65e2c6 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:20.013074 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-4a52e411-6609-42ac-a806-628863b4d1f1 req-b2827a66-4433-42dc-85f3-0161fa65e2c6 service nova] Creating event network-changed:394a1aae-3519-44f8-9e09-430c6dc79932 for instance 4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21 on nch1-master-1 Oct 08 21:06:20.018932 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-4a52e411-6609-42ac-a806-628863b4d1f1 req-b2827a66-4433-42dc-85f3-0161fa65e2c6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037259 Oct 08 21:06:20.020223 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1765/3445] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:06:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:06:20.318505 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-7423a6ed-ffab-4b98-bd86-f706848f8147 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:06:20.319428 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-7423a6ed-ffab-4b98-bd86-f706848f8147 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] [instance: 4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:06:20.331339 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7423a6ed-ffab-4b98-bd86-f706848f8147 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:20.331854 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7423a6ed-ffab-4b98-bd86-f706848f8147 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:20.332967 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7423a6ed-ffab-4b98-bd86-f706848f8147 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:20.335910 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7423a6ed-ffab-4b98-bd86-f706848f8147 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:20.336407 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7423a6ed-ffab-4b98-bd86-f706848f8147 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:20.336859 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7423a6ed-ffab-4b98-bd86-f706848f8147 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:20.439474 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-5bd66ee3-ceca-4a82-8a86-5f6f0a88cadd tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:06:20.440868 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-5bd66ee3-ceca-4a82-8a86-5f6f0a88cadd tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: e1f1a2d9-92ff-4f2b-8f65-24cee7c6418d] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:06:20.458735 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5bd66ee3-ceca-4a82-8a86-5f6f0a88cadd tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:20.459735 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5bd66ee3-ceca-4a82-8a86-5f6f0a88cadd tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:20.460458 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5bd66ee3-ceca-4a82-8a86-5f6f0a88cadd tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:20.461852 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5bd66ee3-ceca-4a82-8a86-5f6f0a88cadd tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:20.463537 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5bd66ee3-ceca-4a82-8a86-5f6f0a88cadd tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:20.464515 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5bd66ee3-ceca-4a82-8a86-5f6f0a88cadd tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:20.585231 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-5bd66ee3-ceca-4a82-8a86-5f6f0a88cadd tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06443b5728fb4d1e95d6245820e786bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ded993145b4eda9d6a33b994519012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:20.595206 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-5bd66ee3-ceca-4a82-8a86-5f6f0a88cadd tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "GET /compute/v2.1/servers/e1f1a2d9-92ff-4f2b-8f65-24cee7c6418d" status: 200 len: 1273 microversion: 2.1 time: 0.165107 Oct 08 21:06:20.595854 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1766/3446] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:06:20 2022] GET /compute/v2.1/servers/e1f1a2d9-92ff-4f2b-8f65-24cee7c6418d => generated 1273 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:06:20.940280 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-063f3699-fd30-41f1-a4dd-e7829ff09086 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:06:20.942326 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-063f3699-fd30-41f1-a4dd-e7829ff09086 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] [instance: dbacaeed-a40b-4e05-9635-5073dfdd8621] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:06:20.957524 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-063f3699-fd30-41f1-a4dd-e7829ff09086 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:20.958907 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-063f3699-fd30-41f1-a4dd-e7829ff09086 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:20.961448 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-063f3699-fd30-41f1-a4dd-e7829ff09086 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:20.964979 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-063f3699-fd30-41f1-a4dd-e7829ff09086 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:20.966488 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-063f3699-fd30-41f1-a4dd-e7829ff09086 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:20.967205 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-063f3699-fd30-41f1-a4dd-e7829ff09086 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:21.042426 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:06:21.211004 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-063f3699-fd30-41f1-a4dd-e7829ff09086 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:21.217865 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-063f3699-fd30-41f1-a4dd-e7829ff09086 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:21.220144 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-063f3699-fd30-41f1-a4dd-e7829ff09086 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:21.221446 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-063f3699-fd30-41f1-a4dd-e7829ff09086 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] 10.222.0.26 "GET /compute/v2.1/servers/dbacaeed-a40b-4e05-9635-5073dfdd8621" status: 200 len: 1723 microversion: 2.20 time: 0.290063 Oct 08 21:06:21.237219 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1767/3447] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:06:20 2022] GET /compute/v2.1/servers/dbacaeed-a40b-4e05-9635-5073dfdd8621 => generated 1723 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 08 21:06:21.538455 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-7423a6ed-ffab-4b98-bd86-f706848f8147 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc2bdd169daf4a1db830b1fa7f94f0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f2d56477794f8ab38b8e3535b3e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:21.558205 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-7423a6ed-ffab-4b98-bd86-f706848f8147 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc2bdd169daf4a1db830b1fa7f94f0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f2d56477794f8ab38b8e3535b3e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:21.559967 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-7423a6ed-ffab-4b98-bd86-f706848f8147 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc2bdd169daf4a1db830b1fa7f94f0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f2d56477794f8ab38b8e3535b3e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:21.561873 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-7423a6ed-ffab-4b98-bd86-f706848f8147 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] 10.222.0.26 "GET /compute/v2.1/servers/4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21" status: 200 len: 1879 microversion: 2.32 time: 1.248420 Oct 08 21:06:21.562631 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1681/3448] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:06:20 2022] GET /compute/v2.1/servers/4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21 => generated 1879 bytes in 1250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:06:21.623067 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-4277dc36-ad27-4b28-a754-dfcbb9a382a4 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:06:21.624447 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-4277dc36-ad27-4b28-a754-dfcbb9a382a4 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: e1f1a2d9-92ff-4f2b-8f65-24cee7c6418d] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:06:21.632681 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4277dc36-ad27-4b28-a754-dfcbb9a382a4 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:21.633832 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4277dc36-ad27-4b28-a754-dfcbb9a382a4 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:21.634558 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4277dc36-ad27-4b28-a754-dfcbb9a382a4 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:21.639687 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4277dc36-ad27-4b28-a754-dfcbb9a382a4 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:21.640884 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4277dc36-ad27-4b28-a754-dfcbb9a382a4 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:21.641587 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4277dc36-ad27-4b28-a754-dfcbb9a382a4 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:21.774299 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-4277dc36-ad27-4b28-a754-dfcbb9a382a4 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06443b5728fb4d1e95d6245820e786bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ded993145b4eda9d6a33b994519012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:21.791716 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-4277dc36-ad27-4b28-a754-dfcbb9a382a4 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "GET /compute/v2.1/servers/e1f1a2d9-92ff-4f2b-8f65-24cee7c6418d" status: 200 len: 1279 microversion: 2.1 time: 0.170489 Oct 08 21:06:21.793917 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1768/3449] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:06:21 2022] GET /compute/v2.1/servers/e1f1a2d9-92ff-4f2b-8f65-24cee7c6418d => generated 1279 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:06:22.247925 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-daebaa05-392d-4f9a-a5aa-bcf7fee31595 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:06:22.248669 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-daebaa05-392d-4f9a-a5aa-bcf7fee31595 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] [instance: dbacaeed-a40b-4e05-9635-5073dfdd8621] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:06:22.257722 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-daebaa05-392d-4f9a-a5aa-bcf7fee31595 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:22.259706 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-daebaa05-392d-4f9a-a5aa-bcf7fee31595 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:22.260604 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-daebaa05-392d-4f9a-a5aa-bcf7fee31595 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:22.261980 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-daebaa05-392d-4f9a-a5aa-bcf7fee31595 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:22.262629 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-daebaa05-392d-4f9a-a5aa-bcf7fee31595 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:22.263303 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-daebaa05-392d-4f9a-a5aa-bcf7fee31595 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:22.379954 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-dca0b7d8-362b-4603-8518-5d24139eb5c9 tempest-KeyPairsV22TestJSON-1571208042 tempest-KeyPairsV22TestJSON-1571208042-project] Action: 'create', calling method: .version_select at 0x7f1a877ec430>, body: {"keypair": {"name": "tempest-keypair-502900484", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPWmSOkGLfhZBvxdoNp6lPd3n5b4p5WbPTw5KrXetX+hn+q3MFt66BMbF9TKLgJvl4DZLjBfyd7tvZKOxJWPiD7VyZIPX26sGfo6gCDhdOBsG1WjJiFyvupV8fcn7Ih0vw=="}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:06:22.401525 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-dca0b7d8-362b-4603-8518-5d24139eb5c9 tempest-KeyPairsV22TestJSON-1571208042 tempest-KeyPairsV22TestJSON-1571208042-project] Getting quotas for project 7fa4985316324e9bb80d1ff7204a38c9. Resources: {'key_pairs'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:06:22.412204 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-dca0b7d8-362b-4603-8518-5d24139eb5c9 tempest-KeyPairsV22TestJSON-1571208042 tempest-KeyPairsV22TestJSON-1571208042-project] Getting quotas for user 0c80c948aa554d4cad968a62bda9fb7c and project 7fa4985316324e9bb80d1ff7204a38c9. Resources: {'key_pairs'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:06:22.457106 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-dca0b7d8-362b-4603-8518-5d24139eb5c9 tempest-KeyPairsV22TestJSON-1571208042 tempest-KeyPairsV22TestJSON-1571208042-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.445757 Oct 08 21:06:22.459106 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1682/3450] 10.222.0.26 () {62 vars in 1199 bytes} [Sat Oct 8 21:06:22 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 449 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 08 21:06:22.473931 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-bf1b32f0-91e4-4fb3-84d2-b2db7abe0c1b tempest-KeyPairsV22TestJSON-1571208042 tempest-KeyPairsV22TestJSON-1571208042-project] Calling method '.version_select at 0x7f1a87797820>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:06:22.488255 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-bf1b32f0-91e4-4fb3-84d2-b2db7abe0c1b tempest-KeyPairsV22TestJSON-1571208042 tempest-KeyPairsV22TestJSON-1571208042-project] 10.222.0.26 "GET /compute/v2.1/os-keypairs/tempest-keypair-502900484" status: 200 len: 512 microversion: 2.2 time: 0.021956 Oct 08 21:06:22.489494 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1683/3451] 10.222.0.26 () {60 vars in 1255 bytes} [Sat Oct 8 21:06:22 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-502900484 => generated 512 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:06:22.518527 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c04bfcef-0edb-44a9-a5e1-4b30a08230fb tempest-KeyPairsV22TestJSON-1571208042 tempest-KeyPairsV22TestJSON-1571208042-project] Calling method '.version_select at 0x7f1a877de040>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:06:22.549349 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-daebaa05-392d-4f9a-a5aa-bcf7fee31595 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:22.562670 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-daebaa05-392d-4f9a-a5aa-bcf7fee31595 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:22.564547 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-daebaa05-392d-4f9a-a5aa-bcf7fee31595 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:22.567025 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-daebaa05-392d-4f9a-a5aa-bcf7fee31595 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] 10.222.0.26 "GET /compute/v2.1/servers/dbacaeed-a40b-4e05-9635-5073dfdd8621" status: 200 len: 1723 microversion: 2.20 time: 0.323084 Oct 08 21:06:22.568074 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-c04bfcef-0edb-44a9-a5e1-4b30a08230fb tempest-KeyPairsV22TestJSON-1571208042 tempest-KeyPairsV22TestJSON-1571208042-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-502900484" status: 204 len: 0 microversion: 2.2 time: 0.063594 Oct 08 21:06:22.568761 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1684/3452] 10.222.0.26 () {60 vars in 1258 bytes} [Sat Oct 8 21:06:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-502900484 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 21:06:22.584806 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c32f9997-3b3f-493f-ae13-5fb894ba792d tempest-KeyPairsV22TestJSON-1571208042 tempest-KeyPairsV22TestJSON-1571208042-project] Action: 'create', calling method: .version_select at 0x7f1a877a7b80>, body: {"keypair": {"name": "tempest-keypair-196304254", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMOe56QXfoAnTcu/yoOzaSaInbFBfWCXHcFS+Fq/gf6/X+C+mxGg3BEXqmmHZtMRrfcys+GbJrgPKNxIiSEwdq0D3AxPbimg1gzVhxhYaNQF5KE4QsslslRDPlty9na0+g=="}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:06:22.594294 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1769/3453] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:06:22 2022] GET /compute/v2.1/servers/dbacaeed-a40b-4e05-9635-5073dfdd8621 => generated 1723 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 08 21:06:22.605508 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-6b549530-0302-48f6-ba98-969823c8f38e tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:06:22.606139 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-6b549530-0302-48f6-ba98-969823c8f38e tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] [instance: 4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:06:22.621705 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6b549530-0302-48f6-ba98-969823c8f38e tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:22.622751 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6b549530-0302-48f6-ba98-969823c8f38e tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:22.624206 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6b549530-0302-48f6-ba98-969823c8f38e tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:22.626051 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6b549530-0302-48f6-ba98-969823c8f38e tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:22.627093 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6b549530-0302-48f6-ba98-969823c8f38e tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:22.627894 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6b549530-0302-48f6-ba98-969823c8f38e tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:22.677526 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-c32f9997-3b3f-493f-ae13-5fb894ba792d tempest-KeyPairsV22TestJSON-1571208042 tempest-KeyPairsV22TestJSON-1571208042-project] Getting quotas for project 7fa4985316324e9bb80d1ff7204a38c9. Resources: {'key_pairs'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:06:22.702462 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-c32f9997-3b3f-493f-ae13-5fb894ba792d tempest-KeyPairsV22TestJSON-1571208042 tempest-KeyPairsV22TestJSON-1571208042-project] Getting quotas for user 0c80c948aa554d4cad968a62bda9fb7c and project 7fa4985316324e9bb80d1ff7204a38c9. Resources: {'key_pairs'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:06:22.769166 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-c32f9997-3b3f-493f-ae13-5fb894ba792d tempest-KeyPairsV22TestJSON-1571208042 tempest-KeyPairsV22TestJSON-1571208042-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.192517 Oct 08 21:06:22.770571 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1685/3454] 10.222.0.26 () {62 vars in 1199 bytes} [Sat Oct 8 21:06:22 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 195 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Oct 08 21:06:22.783729 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-8025d482-4c70-480a-b5c0-b03573f9a7db tempest-KeyPairsV22TestJSON-1571208042 tempest-KeyPairsV22TestJSON-1571208042-project] Calling method '.version_select at 0x7f1a877a6790>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:06:22.838052 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-8025d482-4c70-480a-b5c0-b03573f9a7db tempest-KeyPairsV22TestJSON-1571208042 tempest-KeyPairsV22TestJSON-1571208042-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-196304254" status: 204 len: 0 microversion: 2.2 time: 0.061006 Oct 08 21:06:22.838980 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1686/3455] 10.222.0.26 () {60 vars in 1258 bytes} [Sat Oct 8 21:06:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-196304254 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 08 21:06:22.846499 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-75a450e3-576a-4e63-92a0-82abd3976567 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:06:22.850575 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-75a450e3-576a-4e63-92a0-82abd3976567 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: e1f1a2d9-92ff-4f2b-8f65-24cee7c6418d] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:06:22.867432 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-75a450e3-576a-4e63-92a0-82abd3976567 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:22.868128 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-75a450e3-576a-4e63-92a0-82abd3976567 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:22.870733 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-75a450e3-576a-4e63-92a0-82abd3976567 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:22.871699 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-75a450e3-576a-4e63-92a0-82abd3976567 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:22.873441 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-75a450e3-576a-4e63-92a0-82abd3976567 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:22.875076 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-75a450e3-576a-4e63-92a0-82abd3976567 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:23.056497 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-75a450e3-576a-4e63-92a0-82abd3976567 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06443b5728fb4d1e95d6245820e786bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ded993145b4eda9d6a33b994519012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:23.071091 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-75a450e3-576a-4e63-92a0-82abd3976567 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "GET /compute/v2.1/servers/e1f1a2d9-92ff-4f2b-8f65-24cee7c6418d" status: 200 len: 1279 microversion: 2.1 time: 0.230489 Oct 08 21:06:23.090931 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1687/3456] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:06:22 2022] GET /compute/v2.1/servers/e1f1a2d9-92ff-4f2b-8f65-24cee7c6418d => generated 1279 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:06:23.106629 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-47048b32-6a32-4fc2-b943-05a3bd386587 tempest-KeyPairsV22TestJSON-1571208042 tempest-KeyPairsV22TestJSON-1571208042-project] Action: 'create', calling method: .version_select at 0x7f1a877ec670>, body: {"keypair": {"name": "tempest-keypair-2096858527", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:06:23.145094 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-47048b32-6a32-4fc2-b943-05a3bd386587 tempest-KeyPairsV22TestJSON-1571208042 tempest-KeyPairsV22TestJSON-1571208042-project] Getting quotas for project 7fa4985316324e9bb80d1ff7204a38c9. Resources: {'key_pairs'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:06:23.163109 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-47048b32-6a32-4fc2-b943-05a3bd386587 tempest-KeyPairsV22TestJSON-1571208042 tempest-KeyPairsV22TestJSON-1571208042-project] Getting quotas for user 0c80c948aa554d4cad968a62bda9fb7c and project 7fa4985316324e9bb80d1ff7204a38c9. Resources: {'key_pairs'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:06:23.222235 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-47048b32-6a32-4fc2-b943-05a3bd386587 tempest-KeyPairsV22TestJSON-1571208042 tempest-KeyPairsV22TestJSON-1571208042-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 589 microversion: 2.2 time: 0.129926 Oct 08 21:06:23.223168 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1688/3457] 10.222.0.26 () {62 vars in 1199 bytes} [Sat Oct 8 21:06:23 2022] POST /compute/v2.1/os-keypairs => generated 589 bytes in 132 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 08 21:06:23.234873 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-e98996cb-76dd-42ec-8b51-3cae384f2f9b tempest-KeyPairsV22TestJSON-1571208042 tempest-KeyPairsV22TestJSON-1571208042-project] Calling method '.version_select at 0x7f1a877a6af0>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:06:23.285238 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-e98996cb-76dd-42ec-8b51-3cae384f2f9b tempest-KeyPairsV22TestJSON-1571208042 tempest-KeyPairsV22TestJSON-1571208042-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2096858527" status: 204 len: 0 microversion: 2.2 time: 0.055225 Oct 08 21:06:23.286349 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1689/3458] 10.222.0.26 () {60 vars in 1261 bytes} [Sat Oct 8 21:06:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2096858527 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 21:06:23.291341 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-740cccb3-ca82-4384-a372-5df87712d5c7 req-30dbbd01-c1b2-4d18-8591-ccaea5e7d51e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21", "tag": "66996fef-fc80-47b0-aada-eadf2921916d"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:06:23.317924 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-740cccb3-ca82-4384-a372-5df87712d5c7 req-30dbbd01-c1b2-4d18-8591-ccaea5e7d51e service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:23.318459 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-740cccb3-ca82-4384-a372-5df87712d5c7 req-30dbbd01-c1b2-4d18-8591-ccaea5e7d51e service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:23.318950 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-740cccb3-ca82-4384-a372-5df87712d5c7 req-30dbbd01-c1b2-4d18-8591-ccaea5e7d51e service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:23.354569 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-740cccb3-ca82-4384-a372-5df87712d5c7 req-30dbbd01-c1b2-4d18-8591-ccaea5e7d51e service nova] Creating event network-changed:66996fef-fc80-47b0-aada-eadf2921916d for instance 4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21 on nch1-master-1 Oct 08 21:06:23.364253 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-740cccb3-ca82-4384-a372-5df87712d5c7 req-30dbbd01-c1b2-4d18-8591-ccaea5e7d51e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076640 Oct 08 21:06:23.365336 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1690/3459] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:06:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:06:23.371977 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-59cdbd90-8776-487a-a565-504c1e75a4be tempest-KeyPairsV22TestJSON-1571208042 tempest-KeyPairsV22TestJSON-1571208042-project] Action: 'create', calling method: .version_select at 0x7f1a877a6b80>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-90538290", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH0mte3rmoGom1oGeVYyI6Qh3iQIPkz/qu7hdFU9mOrJONUZrYs6Ix1k92zrWqcRPyxKt56+SFU6sdPIo/ijZkArvF8LoFiCfSeS1Ld+iA13g1qIQiu3I8ncJwosh4g6fA=="}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:06:23.424651 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-59cdbd90-8776-487a-a565-504c1e75a4be tempest-KeyPairsV22TestJSON-1571208042 tempest-KeyPairsV22TestJSON-1571208042-project] Getting quotas for project 7fa4985316324e9bb80d1ff7204a38c9. Resources: {'key_pairs'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:06:23.443697 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-59cdbd90-8776-487a-a565-504c1e75a4be tempest-KeyPairsV22TestJSON-1571208042 tempest-KeyPairsV22TestJSON-1571208042-project] Getting quotas for user 0c80c948aa554d4cad968a62bda9fb7c and project 7fa4985316324e9bb80d1ff7204a38c9. Resources: {'key_pairs'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:06:23.504358 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-59cdbd90-8776-487a-a565-504c1e75a4be tempest-KeyPairsV22TestJSON-1571208042 tempest-KeyPairsV22TestJSON-1571208042-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 419 microversion: 2.2 time: 0.136744 Oct 08 21:06:23.505362 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1691/3460] 10.222.0.26 () {62 vars in 1199 bytes} [Sat Oct 8 21:06:23 2022] POST /compute/v2.1/os-keypairs => generated 419 bytes in 139 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 08 21:06:23.521527 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-61ba1e98-b1c7-49e6-96bc-7bd2ac2a3354 tempest-KeyPairsV22TestJSON-1571208042 tempest-KeyPairsV22TestJSON-1571208042-project] Action: 'create', calling method: .version_select at 0x7f1a877a7790>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-718061307", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAc3PPbMxOfNQys7kmijeYUKhw+/+u23WruBt+hhzPcbuO8UtNwHxY7GEidMub04ZpDVxrYazQx15KYYy4XsSmnK+UKO3GxY1IfSpSR3Dq9JiOzwqyIHOjfqKjbUV1FenQ=="}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:06:23.578649 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-61ba1e98-b1c7-49e6-96bc-7bd2ac2a3354 tempest-KeyPairsV22TestJSON-1571208042 tempest-KeyPairsV22TestJSON-1571208042-project] Getting quotas for project 7fa4985316324e9bb80d1ff7204a38c9. Resources: {'key_pairs'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:06:23.584816 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-61ba1e98-b1c7-49e6-96bc-7bd2ac2a3354 tempest-KeyPairsV22TestJSON-1571208042 tempest-KeyPairsV22TestJSON-1571208042-project] Getting quotas for user 0c80c948aa554d4cad968a62bda9fb7c and project 7fa4985316324e9bb80d1ff7204a38c9. Resources: {'key_pairs'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:06:23.628053 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-61ba1e98-b1c7-49e6-96bc-7bd2ac2a3354 tempest-KeyPairsV22TestJSON-1571208042 tempest-KeyPairsV22TestJSON-1571208042-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.112744 Oct 08 21:06:23.628687 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1692/3461] 10.222.0.26 () {62 vars in 1199 bytes} [Sat Oct 8 21:06:23 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 115 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Oct 08 21:06:23.634396 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-623b6a1e-806e-45eb-95b3-f97f7a0fa477 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:06:23.635379 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-623b6a1e-806e-45eb-95b3-f97f7a0fa477 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] [instance: dbacaeed-a40b-4e05-9635-5073dfdd8621] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:06:23.645436 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-623b6a1e-806e-45eb-95b3-f97f7a0fa477 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:23.646402 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-623b6a1e-806e-45eb-95b3-f97f7a0fa477 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:23.647677 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-623b6a1e-806e-45eb-95b3-f97f7a0fa477 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:23.648973 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-623b6a1e-806e-45eb-95b3-f97f7a0fa477 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:23.649647 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-623b6a1e-806e-45eb-95b3-f97f7a0fa477 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:23.650444 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-623b6a1e-806e-45eb-95b3-f97f7a0fa477 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:23.685161 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:06:23.814357 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-6b549530-0302-48f6-ba98-969823c8f38e tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc2bdd169daf4a1db830b1fa7f94f0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f2d56477794f8ab38b8e3535b3e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:23.830564 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-6b549530-0302-48f6-ba98-969823c8f38e tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc2bdd169daf4a1db830b1fa7f94f0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f2d56477794f8ab38b8e3535b3e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:23.833253 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-6b549530-0302-48f6-ba98-969823c8f38e tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc2bdd169daf4a1db830b1fa7f94f0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f2d56477794f8ab38b8e3535b3e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:23.836668 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-6b549530-0302-48f6-ba98-969823c8f38e tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] 10.222.0.26 "GET /compute/v2.1/servers/4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21" status: 200 len: 1879 microversion: 2.32 time: 1.239314 Oct 08 21:06:23.850675 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1770/3462] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:06:22 2022] GET /compute/v2.1/servers/4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21 => generated 1879 bytes in 1243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:06:23.872064 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-213e592a-b361-4151-b886-c2e479043d53 tempest-KeyPairsV22TestJSON-1571208042 tempest-KeyPairsV22TestJSON-1571208042-project] Action: 'create', calling method: .version_select at 0x7f1a91327d30>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1932742365", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAg5qFFuy7bw3hA1Vt4hT2/TjZuv6fRJ0t28+d6VOpqaedWR6VXArq2KM4+pt+/+HaF+OA53YYOA73yyNQ6lWAkt5hBenlwC6NnYJV0YvuSimNFGRfE7jDwnm1sXwdtZEg=="}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:06:23.910428 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-213e592a-b361-4151-b886-c2e479043d53 tempest-KeyPairsV22TestJSON-1571208042 tempest-KeyPairsV22TestJSON-1571208042-project] Getting quotas for project 7fa4985316324e9bb80d1ff7204a38c9. Resources: {'key_pairs'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:06:23.920081 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-213e592a-b361-4151-b886-c2e479043d53 tempest-KeyPairsV22TestJSON-1571208042 tempest-KeyPairsV22TestJSON-1571208042-project] Getting quotas for user 0c80c948aa554d4cad968a62bda9fb7c and project 7fa4985316324e9bb80d1ff7204a38c9. Resources: {'key_pairs'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:06:23.983655 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-213e592a-b361-4151-b886-c2e479043d53 tempest-KeyPairsV22TestJSON-1571208042 tempest-KeyPairsV22TestJSON-1571208042-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.121622 Oct 08 21:06:23.986493 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1771/3463] 10.222.0.26 () {62 vars in 1199 bytes} [Sat Oct 8 21:06:23 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 127 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 08 21:06:24.010431 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-49aa2196-1d8f-4d4c-8bc2-3132ee9f0f86 tempest-KeyPairsV22TestJSON-1571208042 tempest-KeyPairsV22TestJSON-1571208042-project] Calling method '.version_select at 0x7f1a8caf41f0>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:06:24.017923 ncdv-master-1 devstack@n-api.service[140492]: WARNING oslo_db.sqlalchemy.utils [None req-49aa2196-1d8f-4d4c-8bc2-3132ee9f0f86 tempest-KeyPairsV22TestJSON-1571208042 tempest-KeyPairsV22TestJSON-1571208042-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 08 21:06:24.026736 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-49aa2196-1d8f-4d4c-8bc2-3132ee9f0f86 tempest-KeyPairsV22TestJSON-1571208042 tempest-KeyPairsV22TestJSON-1571208042-project] 10.222.0.26 "GET /compute/v2.1/os-keypairs" status: 200 len: 1139 microversion: 2.2 time: 0.024199 Oct 08 21:06:24.027915 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1772/3464] 10.222.0.26 () {60 vars in 1177 bytes} [Sat Oct 8 21:06:24 2022] GET /compute/v2.1/os-keypairs => generated 1139 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:06:24.042161 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-6c761c5c-dd99-419f-9114-a65fb3b71725 tempest-KeyPairsV22TestJSON-1571208042 tempest-KeyPairsV22TestJSON-1571208042-project] Calling method '.version_select at 0x7f1a8c90fca0>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:06:24.069792 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:06:24.086602 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-6c761c5c-dd99-419f-9114-a65fb3b71725 tempest-KeyPairsV22TestJSON-1571208042 tempest-KeyPairsV22TestJSON-1571208042-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1932742365" status: 204 len: 0 microversion: 2.2 time: 0.046037 Oct 08 21:06:24.087789 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1773/3465] 10.222.0.26 () {60 vars in 1321 bytes} [Sat Oct 8 21:06:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1932742365 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 21:06:24.098328 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-07513334-8d16-4e75-a3b0-fddd646dea3f tempest-KeyPairsV22TestJSON-1571208042 tempest-KeyPairsV22TestJSON-1571208042-project] Calling method '.version_select at 0x7f1a8c20f550>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:06:24.130919 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-07513334-8d16-4e75-a3b0-fddd646dea3f tempest-KeyPairsV22TestJSON-1571208042 tempest-KeyPairsV22TestJSON-1571208042-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-718061307" status: 204 len: 0 microversion: 2.2 time: 0.038702 Oct 08 21:06:24.131749 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1774/3466] 10.222.0.26 () {60 vars in 1318 bytes} [Sat Oct 8 21:06:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-718061307 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 08 21:06:24.137429 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-d562dff7-558b-41c5-b928-c67388b10e6a tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:06:24.138220 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-d562dff7-558b-41c5-b928-c67388b10e6a tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: e1f1a2d9-92ff-4f2b-8f65-24cee7c6418d] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:06:24.145206 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d562dff7-558b-41c5-b928-c67388b10e6a tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:24.145736 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d562dff7-558b-41c5-b928-c67388b10e6a tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:24.146185 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d562dff7-558b-41c5-b928-c67388b10e6a tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:24.147229 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d562dff7-558b-41c5-b928-c67388b10e6a tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:24.147772 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d562dff7-558b-41c5-b928-c67388b10e6a tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:24.148266 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d562dff7-558b-41c5-b928-c67388b10e6a tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:24.477953 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-d562dff7-558b-41c5-b928-c67388b10e6a tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06443b5728fb4d1e95d6245820e786bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ded993145b4eda9d6a33b994519012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:24.545958 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-d562dff7-558b-41c5-b928-c67388b10e6a tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "GET /compute/v2.1/servers/e1f1a2d9-92ff-4f2b-8f65-24cee7c6418d" status: 200 len: 1321 microversion: 2.1 time: 0.406817 Oct 08 21:06:24.547346 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1775/3467] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:06:24 2022] GET /compute/v2.1/servers/e1f1a2d9-92ff-4f2b-8f65-24cee7c6418d => generated 1321 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:06:24.563799 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-b1de59de-067f-4b4f-b4f9-f2b115795516 tempest-KeyPairsV22TestJSON-1571208042 tempest-KeyPairsV22TestJSON-1571208042-project] Calling method '.version_select at 0x7f1a8c7aa820>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:06:24.598062 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-b1de59de-067f-4b4f-b4f9-f2b115795516 tempest-KeyPairsV22TestJSON-1571208042 tempest-KeyPairsV22TestJSON-1571208042-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-90538290" status: 204 len: 0 microversion: 2.2 time: 0.048612 Oct 08 21:06:24.598788 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1776/3468] 10.222.0.26 () {60 vars in 1315 bytes} [Sat Oct 8 21:06:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-90538290 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 21:06:24.611021 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-7def048b-80c9-46f5-bc96-51271ed1b39d tempest-KeyPairsV22TestJSON-1571208042 tempest-KeyPairsV22TestJSON-1571208042-project] Action: 'create', calling method: .version_select at 0x7f1a8c90fca0>, body: {"keypair": {"name": "tempest-keypair-1568982869", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPLXQq5NZ4W14B9+0tiOtgXq8qWO7fNMLTmKJldE7+bUqDo4ZLfW+4ysQcmhDZp73Udxvw3svyUh7g5TRACuUnGLS1WyeC4crazKhp0LgVG5ltnQ2wxEFfzehTc3deDegg=="}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:06:24.629435 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-7def048b-80c9-46f5-bc96-51271ed1b39d tempest-KeyPairsV22TestJSON-1571208042 tempest-KeyPairsV22TestJSON-1571208042-project] Getting quotas for project 7fa4985316324e9bb80d1ff7204a38c9. Resources: {'key_pairs'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:06:24.637306 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-7def048b-80c9-46f5-bc96-51271ed1b39d tempest-KeyPairsV22TestJSON-1571208042 tempest-KeyPairsV22TestJSON-1571208042-project] Getting quotas for user 0c80c948aa554d4cad968a62bda9fb7c and project 7fa4985316324e9bb80d1ff7204a38c9. Resources: {'key_pairs'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:06:24.675277 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-7def048b-80c9-46f5-bc96-51271ed1b39d tempest-KeyPairsV22TestJSON-1571208042 tempest-KeyPairsV22TestJSON-1571208042-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.068146 Oct 08 21:06:24.676362 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1777/3469] 10.222.0.26 () {62 vars in 1199 bytes} [Sat Oct 8 21:06:24 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 70 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 08 21:06:24.687658 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-4617893a-060f-44e3-8a55-7c3a72e43250 tempest-KeyPairsV22TestJSON-1571208042 tempest-KeyPairsV22TestJSON-1571208042-project] Calling method '.version_select at 0x7f1a8c7c7ee0>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:06:24.706011 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-4617893a-060f-44e3-8a55-7c3a72e43250 tempest-KeyPairsV22TestJSON-1571208042 tempest-KeyPairsV22TestJSON-1571208042-project] 10.222.0.26 "GET /compute/v2.1/os-keypairs/tempest-keypair-1568982869" status: 200 len: 513 microversion: 2.2 time: 0.023103 Oct 08 21:06:24.711636 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1778/3470] 10.222.0.26 () {60 vars in 1258 bytes} [Sat Oct 8 21:06:24 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1568982869 => generated 513 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:06:24.721138 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-0d183edb-74b1-4d07-bfee-1469d46a2494 tempest-KeyPairsV22TestJSON-1571208042 tempest-KeyPairsV22TestJSON-1571208042-project] Calling method '.version_select at 0x7f1a8c961a60>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:06:24.733496 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-623b6a1e-806e-45eb-95b3-f97f7a0fa477 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:24.734048 ncdv-master-1 devstack@n-api.service[140492]: WARNING oslo_db.sqlalchemy.utils [None req-0d183edb-74b1-4d07-bfee-1469d46a2494 tempest-KeyPairsV22TestJSON-1571208042 tempest-KeyPairsV22TestJSON-1571208042-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 08 21:06:24.744953 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-0d183edb-74b1-4d07-bfee-1469d46a2494 tempest-KeyPairsV22TestJSON-1571208042 tempest-KeyPairsV22TestJSON-1571208042-project] 10.222.0.26 "GET /compute/v2.1/os-keypairs" status: 200 len: 370 microversion: 2.2 time: 0.030792 Oct 08 21:06:24.746085 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-623b6a1e-806e-45eb-95b3-f97f7a0fa477 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:24.747860 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-623b6a1e-806e-45eb-95b3-f97f7a0fa477 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:24.754631 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1779/3471] 10.222.0.26 () {60 vars in 1177 bytes} [Sat Oct 8 21:06:24 2022] GET /compute/v2.1/os-keypairs => generated 370 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:06:24.759572 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-8df7c844-343a-4b0c-9520-843b410777a2 tempest-KeyPairsV22TestJSON-1571208042 tempest-KeyPairsV22TestJSON-1571208042-project] Calling method '.version_select at 0x7f1a8c1bcd30>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:06:24.759803 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-623b6a1e-806e-45eb-95b3-f97f7a0fa477 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] 10.222.0.26 "GET /compute/v2.1/servers/dbacaeed-a40b-4e05-9635-5073dfdd8621" status: 200 len: 1723 microversion: 2.20 time: 1.128086 Oct 08 21:06:24.760588 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1693/3472] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:06:23 2022] GET /compute/v2.1/servers/dbacaeed-a40b-4e05-9635-5073dfdd8621 => generated 1723 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:06:24.825593 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-8df7c844-343a-4b0c-9520-843b410777a2 tempest-KeyPairsV22TestJSON-1571208042 tempest-KeyPairsV22TestJSON-1571208042-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1568982869" status: 204 len: 0 microversion: 2.2 time: 0.069838 Oct 08 21:06:24.828494 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1780/3473] 10.222.0.26 () {60 vars in 1261 bytes} [Sat Oct 8 21:06:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1568982869 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 08 21:06:24.841269 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-e5506bb1-cbe3-40be-8505-240c9a98d78b tempest-KeyPairsV22TestJSON-1571208042 tempest-KeyPairsV22TestJSON-1571208042-project] Action: 'create', calling method: .version_select at 0x7f1a877c3790>, body: {"keypair": {"name": "tempest-keypair-1255114111", "type": "x509"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:06:24.872932 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-2ab0e98c-5f3f-4a9f-9b28-7154b2cd0ab6 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:06:24.874207 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-2ab0e98c-5f3f-4a9f-9b28-7154b2cd0ab6 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] [instance: 4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:06:24.880993 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=8,nova_api:DELETE=3 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:06:24.888556 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2ab0e98c-5f3f-4a9f-9b28-7154b2cd0ab6 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:24.891294 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2ab0e98c-5f3f-4a9f-9b28-7154b2cd0ab6 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:24.892161 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2ab0e98c-5f3f-4a9f-9b28-7154b2cd0ab6 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:24.894727 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2ab0e98c-5f3f-4a9f-9b28-7154b2cd0ab6 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:24.896633 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2ab0e98c-5f3f-4a9f-9b28-7154b2cd0ab6 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:24.897263 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2ab0e98c-5f3f-4a9f-9b28-7154b2cd0ab6 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:24.900827 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-e5506bb1-cbe3-40be-8505-240c9a98d78b tempest-KeyPairsV22TestJSON-1571208042 tempest-KeyPairsV22TestJSON-1571208042-project] Getting quotas for project 7fa4985316324e9bb80d1ff7204a38c9. Resources: {'key_pairs'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:06:24.924229 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-e5506bb1-cbe3-40be-8505-240c9a98d78b tempest-KeyPairsV22TestJSON-1571208042 tempest-KeyPairsV22TestJSON-1571208042-project] Getting quotas for user 0c80c948aa554d4cad968a62bda9fb7c and project 7fa4985316324e9bb80d1ff7204a38c9. Resources: {'key_pairs'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:06:24.997403 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.processutils [None req-e5506bb1-cbe3-40be-8505-240c9a98d78b tempest-KeyPairsV22TestJSON-1571208042 tempest-KeyPairsV22TestJSON-1571208042-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmpghrvg9gh/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpghrvg9gh/temp.key -subj /CN=0c80c948aa554d4cad968a62bda9fb7c -extensions v3_req_client {{(pid=140491) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 08 21:06:25.246536 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.processutils [None req-e5506bb1-cbe3-40be-8505-240c9a98d78b tempest-KeyPairsV22TestJSON-1571208042 tempest-KeyPairsV22TestJSON-1571208042-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmpghrvg9gh/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpghrvg9gh/temp.key -subj /CN=0c80c948aa554d4cad968a62bda9fb7c -extensions v3_req_client" returned: 0 in 0.249s {{(pid=140491) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 08 21:06:25.248188 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.processutils [None req-e5506bb1-cbe3-40be-8505-240c9a98d78b tempest-KeyPairsV22TestJSON-1571208042 tempest-KeyPairsV22TestJSON-1571208042-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmpghrvg9gh/temp.key -password pass: {{(pid=140491) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 08 21:06:25.303042 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-2ab0e98c-5f3f-4a9f-9b28-7154b2cd0ab6 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc2bdd169daf4a1db830b1fa7f94f0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f2d56477794f8ab38b8e3535b3e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:25.314255 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-2ab0e98c-5f3f-4a9f-9b28-7154b2cd0ab6 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc2bdd169daf4a1db830b1fa7f94f0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f2d56477794f8ab38b8e3535b3e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:25.322409 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-2ab0e98c-5f3f-4a9f-9b28-7154b2cd0ab6 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc2bdd169daf4a1db830b1fa7f94f0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f2d56477794f8ab38b8e3535b3e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:25.323770 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-2ab0e98c-5f3f-4a9f-9b28-7154b2cd0ab6 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] 10.222.0.26 "GET /compute/v2.1/servers/4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21" status: 200 len: 1879 microversion: 2.32 time: 0.457121 Oct 08 21:06:25.325694 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.processutils [None req-e5506bb1-cbe3-40be-8505-240c9a98d78b tempest-KeyPairsV22TestJSON-1571208042 tempest-KeyPairsV22TestJSON-1571208042-project] CMD "openssl pkcs12 -export -inkey /tmp/tmpghrvg9gh/temp.key -password pass:" returned: 0 in 0.076s {{(pid=140491) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 08 21:06:25.335541 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1781/3474] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:06:24 2022] GET /compute/v2.1/servers/4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21 => generated 1879 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:06:25.439270 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-e5506bb1-cbe3-40be-8505-240c9a98d78b tempest-KeyPairsV22TestJSON-1571208042 tempest-KeyPairsV22TestJSON-1571208042-project] Getting quotas for project 7fa4985316324e9bb80d1ff7204a38c9. Resources: {'key_pairs'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:06:25.451097 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-e5506bb1-cbe3-40be-8505-240c9a98d78b tempest-KeyPairsV22TestJSON-1571208042 tempest-KeyPairsV22TestJSON-1571208042-project] Getting quotas for user 0c80c948aa554d4cad968a62bda9fb7c and project 7fa4985316324e9bb80d1ff7204a38c9. Resources: {'key_pairs'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:06:25.487519 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-e5506bb1-cbe3-40be-8505-240c9a98d78b tempest-KeyPairsV22TestJSON-1571208042 tempest-KeyPairsV22TestJSON-1571208042-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 4693 microversion: 2.2 time: 0.652688 Oct 08 21:06:25.497788 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1694/3475] 10.222.0.26 () {62 vars in 1198 bytes} [Sat Oct 8 21:06:24 2022] POST /compute/v2.1/os-keypairs => generated 4693 bytes in 665 msecs (HTTP/1.1 201) 9 headers in 363 bytes (2 switches on core 0) Oct 08 21:06:25.503499 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-63ad9e4b-f8b2-4fdd-b2a0-4a3a9ab4316a tempest-KeyPairsV22TestJSON-1571208042 tempest-KeyPairsV22TestJSON-1571208042-project] Calling method '.version_select at 0x7f1a913271f0>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:06:25.512908 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-63ad9e4b-f8b2-4fdd-b2a0-4a3a9ab4316a tempest-KeyPairsV22TestJSON-1571208042 tempest-KeyPairsV22TestJSON-1571208042-project] 10.222.0.26 "GET /compute/v2.1/os-keypairs/tempest-keypair-1255114111" status: 200 len: 1534 microversion: 2.2 time: 0.014178 Oct 08 21:06:25.520444 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1782/3476] 10.222.0.26 () {60 vars in 1258 bytes} [Sat Oct 8 21:06:25 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1255114111 => generated 1534 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:06:25.532712 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-11f973c0-dfc3-45ad-8c49-a59393c0d802 tempest-KeyPairsV22TestJSON-1571208042 tempest-KeyPairsV22TestJSON-1571208042-project] Calling method '.version_select at 0x7f1a8787ad30>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:06:25.546383 ncdv-master-1 devstack@n-api.service[140491]: WARNING oslo_db.sqlalchemy.utils [None req-11f973c0-dfc3-45ad-8c49-a59393c0d802 tempest-KeyPairsV22TestJSON-1571208042 tempest-KeyPairsV22TestJSON-1571208042-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 08 21:06:25.561458 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-11f973c0-dfc3-45ad-8c49-a59393c0d802 tempest-KeyPairsV22TestJSON-1571208042 tempest-KeyPairsV22TestJSON-1571208042-project] 10.222.0.26 "GET /compute/v2.1/os-keypairs" status: 200 len: 1391 microversion: 2.2 time: 0.035877 Oct 08 21:06:25.569368 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1695/3477] 10.222.0.26 () {60 vars in 1177 bytes} [Sat Oct 8 21:06:25 2022] GET /compute/v2.1/os-keypairs => generated 1391 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:06:25.573646 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-d4315c55-4d7f-4c20-a127-6ed6621c2c2f tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:06:25.574215 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-d4315c55-4d7f-4c20-a127-6ed6621c2c2f tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: e1f1a2d9-92ff-4f2b-8f65-24cee7c6418d] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:06:25.577487 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-b46f275d-9289-46d1-bca9-0ba674d62276 tempest-KeyPairsV22TestJSON-1571208042 tempest-KeyPairsV22TestJSON-1571208042-project] Calling method '.version_select at 0x7f1a877a78b0>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:06:25.582458 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d4315c55-4d7f-4c20-a127-6ed6621c2c2f tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:25.582984 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d4315c55-4d7f-4c20-a127-6ed6621c2c2f tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:25.587736 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d4315c55-4d7f-4c20-a127-6ed6621c2c2f tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:25.588582 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d4315c55-4d7f-4c20-a127-6ed6621c2c2f tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:25.589083 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d4315c55-4d7f-4c20-a127-6ed6621c2c2f tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:25.589752 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d4315c55-4d7f-4c20-a127-6ed6621c2c2f tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:25.641681 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-b46f275d-9289-46d1-bca9-0ba674d62276 tempest-KeyPairsV22TestJSON-1571208042 tempest-KeyPairsV22TestJSON-1571208042-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1255114111" status: 204 len: 0 microversion: 2.2 time: 0.070766 Oct 08 21:06:25.647532 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1696/3478] 10.222.0.26 () {60 vars in 1261 bytes} [Sat Oct 8 21:06:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1255114111 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 21:06:25.790393 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c5bfab94-0e14-4581-832a-02deb20ee320 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:06:25.791416 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-c5bfab94-0e14-4581-832a-02deb20ee320 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] [instance: dbacaeed-a40b-4e05-9635-5073dfdd8621] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:06:25.807509 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c5bfab94-0e14-4581-832a-02deb20ee320 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:25.809761 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c5bfab94-0e14-4581-832a-02deb20ee320 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:25.810817 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c5bfab94-0e14-4581-832a-02deb20ee320 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:25.815530 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c5bfab94-0e14-4581-832a-02deb20ee320 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:25.817679 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c5bfab94-0e14-4581-832a-02deb20ee320 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:25.818939 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c5bfab94-0e14-4581-832a-02deb20ee320 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:26.231041 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-d4315c55-4d7f-4c20-a127-6ed6621c2c2f tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06443b5728fb4d1e95d6245820e786bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ded993145b4eda9d6a33b994519012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:26.243666 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-d4315c55-4d7f-4c20-a127-6ed6621c2c2f tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "GET /compute/v2.1/servers/e1f1a2d9-92ff-4f2b-8f65-24cee7c6418d" status: 200 len: 1321 microversion: 2.1 time: 0.677764 Oct 08 21:06:26.244325 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1783/3479] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:06:25 2022] GET /compute/v2.1/servers/e1f1a2d9-92ff-4f2b-8f65-24cee7c6418d => generated 1321 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:06:26.373135 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-4b529d8a-c298-4c38-ba0a-c06051f5879d tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:06:26.375792 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-4b529d8a-c298-4c38-ba0a-c06051f5879d tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] [instance: 4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:06:26.384780 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4b529d8a-c298-4c38-ba0a-c06051f5879d tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:26.386066 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4b529d8a-c298-4c38-ba0a-c06051f5879d tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:26.387726 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4b529d8a-c298-4c38-ba0a-c06051f5879d tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:26.388829 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4b529d8a-c298-4c38-ba0a-c06051f5879d tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:26.390197 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4b529d8a-c298-4c38-ba0a-c06051f5879d tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:26.391017 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4b529d8a-c298-4c38-ba0a-c06051f5879d tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:26.445275 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-c5bfab94-0e14-4581-832a-02deb20ee320 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:26.455171 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-c5bfab94-0e14-4581-832a-02deb20ee320 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:26.457767 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-c5bfab94-0e14-4581-832a-02deb20ee320 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:26.459456 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-c5bfab94-0e14-4581-832a-02deb20ee320 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] 10.222.0.26 "GET /compute/v2.1/servers/dbacaeed-a40b-4e05-9635-5073dfdd8621" status: 200 len: 1744 microversion: 2.20 time: 0.673533 Oct 08 21:06:26.461163 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1697/3480] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:06:25 2022] GET /compute/v2.1/servers/dbacaeed-a40b-4e05-9635-5073dfdd8621 => generated 1744 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 08 21:06:26.733249 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-f57dd4d9-bdfc-4ad2-a138-41ef4e1d49ce req-602e6527-6e28-484c-8517-3a63220e67a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21", "tag": "818a7d0e-582a-4f5d-902b-606c8c4608af"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:06:26.745033 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-f57dd4d9-bdfc-4ad2-a138-41ef4e1d49ce req-602e6527-6e28-484c-8517-3a63220e67a0 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:26.745912 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-f57dd4d9-bdfc-4ad2-a138-41ef4e1d49ce req-602e6527-6e28-484c-8517-3a63220e67a0 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:26.746528 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-f57dd4d9-bdfc-4ad2-a138-41ef4e1d49ce req-602e6527-6e28-484c-8517-3a63220e67a0 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:26.760901 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-f57dd4d9-bdfc-4ad2-a138-41ef4e1d49ce req-602e6527-6e28-484c-8517-3a63220e67a0 service nova] Creating event network-changed:818a7d0e-582a-4f5d-902b-606c8c4608af for instance 4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21 on nch1-master-1 Oct 08 21:06:26.767926 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-f57dd4d9-bdfc-4ad2-a138-41ef4e1d49ce req-602e6527-6e28-484c-8517-3a63220e67a0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038354 Oct 08 21:06:26.769269 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1698/3481] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:06:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:06:26.801066 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-4b529d8a-c298-4c38-ba0a-c06051f5879d tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc2bdd169daf4a1db830b1fa7f94f0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f2d56477794f8ab38b8e3535b3e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:26.817696 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-4b529d8a-c298-4c38-ba0a-c06051f5879d tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc2bdd169daf4a1db830b1fa7f94f0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f2d56477794f8ab38b8e3535b3e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:26.819181 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-4b529d8a-c298-4c38-ba0a-c06051f5879d tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc2bdd169daf4a1db830b1fa7f94f0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f2d56477794f8ab38b8e3535b3e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:26.820397 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-4b529d8a-c298-4c38-ba0a-c06051f5879d tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] 10.222.0.26 "GET /compute/v2.1/servers/4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21" status: 200 len: 1879 microversion: 2.32 time: 0.454564 Oct 08 21:06:26.821215 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1784/3482] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:06:26 2022] GET /compute/v2.1/servers/4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21 => generated 1879 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:06:27.272768 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-5fee311a-1fd4-49f6-82c0-d3ec677330f4 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:06:27.274140 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-5fee311a-1fd4-49f6-82c0-d3ec677330f4 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: e1f1a2d9-92ff-4f2b-8f65-24cee7c6418d] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:06:27.290546 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5fee311a-1fd4-49f6-82c0-d3ec677330f4 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:27.291338 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5fee311a-1fd4-49f6-82c0-d3ec677330f4 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:27.292380 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5fee311a-1fd4-49f6-82c0-d3ec677330f4 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:27.296354 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5fee311a-1fd4-49f6-82c0-d3ec677330f4 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:27.300599 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5fee311a-1fd4-49f6-82c0-d3ec677330f4 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:27.302666 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5fee311a-1fd4-49f6-82c0-d3ec677330f4 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:27.495272 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-645d04f3-211b-494c-8c17-e9b3f37c37d5 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:06:27.495900 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-645d04f3-211b-494c-8c17-e9b3f37c37d5 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] [instance: dbacaeed-a40b-4e05-9635-5073dfdd8621] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:06:27.509962 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-645d04f3-211b-494c-8c17-e9b3f37c37d5 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:27.510472 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-645d04f3-211b-494c-8c17-e9b3f37c37d5 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:27.510937 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-645d04f3-211b-494c-8c17-e9b3f37c37d5 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:27.511685 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-645d04f3-211b-494c-8c17-e9b3f37c37d5 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:27.512160 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-645d04f3-211b-494c-8c17-e9b3f37c37d5 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:27.516813 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-645d04f3-211b-494c-8c17-e9b3f37c37d5 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:27.878554 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-645d04f3-211b-494c-8c17-e9b3f37c37d5 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:27.893540 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-645d04f3-211b-494c-8c17-e9b3f37c37d5 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:27.895015 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-645d04f3-211b-494c-8c17-e9b3f37c37d5 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:27.898420 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-645d04f3-211b-494c-8c17-e9b3f37c37d5 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] 10.222.0.26 "GET /compute/v2.1/servers/dbacaeed-a40b-4e05-9635-5073dfdd8621" status: 200 len: 1739 microversion: 2.20 time: 0.411181 Oct 08 21:06:27.902300 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1785/3483] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:06:27 2022] GET /compute/v2.1/servers/dbacaeed-a40b-4e05-9635-5073dfdd8621 => generated 1739 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:06:27.913160 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-3a0559ff-4735-4fe7-afd7-08298dc2e8c9 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:06:27.914038 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-3a0559ff-4735-4fe7-afd7-08298dc2e8c9 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] [instance: 4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:06:27.927980 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3a0559ff-4735-4fe7-afd7-08298dc2e8c9 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:27.928776 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3a0559ff-4735-4fe7-afd7-08298dc2e8c9 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:27.929766 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3a0559ff-4735-4fe7-afd7-08298dc2e8c9 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:27.933004 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3a0559ff-4735-4fe7-afd7-08298dc2e8c9 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:27.933702 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3a0559ff-4735-4fe7-afd7-08298dc2e8c9 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:27.934319 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3a0559ff-4735-4fe7-afd7-08298dc2e8c9 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:28.017746 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-5fee311a-1fd4-49f6-82c0-d3ec677330f4 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06443b5728fb4d1e95d6245820e786bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ded993145b4eda9d6a33b994519012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:28.028361 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-5fee311a-1fd4-49f6-82c0-d3ec677330f4 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "GET /compute/v2.1/servers/e1f1a2d9-92ff-4f2b-8f65-24cee7c6418d" status: 200 len: 1321 microversion: 2.1 time: 0.761408 Oct 08 21:06:28.029061 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1699/3484] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:06:27 2022] GET /compute/v2.1/servers/e1f1a2d9-92ff-4f2b-8f65-24cee7c6418d => generated 1321 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:06:28.431589 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-3a0559ff-4735-4fe7-afd7-08298dc2e8c9 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc2bdd169daf4a1db830b1fa7f94f0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f2d56477794f8ab38b8e3535b3e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:28.441874 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-3a0559ff-4735-4fe7-afd7-08298dc2e8c9 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc2bdd169daf4a1db830b1fa7f94f0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f2d56477794f8ab38b8e3535b3e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:28.443270 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-3a0559ff-4735-4fe7-afd7-08298dc2e8c9 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc2bdd169daf4a1db830b1fa7f94f0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f2d56477794f8ab38b8e3535b3e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:28.444402 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-3a0559ff-4735-4fe7-afd7-08298dc2e8c9 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] 10.222.0.26 "GET /compute/v2.1/servers/4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21" status: 200 len: 1879 microversion: 2.32 time: 0.540904 Oct 08 21:06:28.448442 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1786/3485] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:06:27 2022] GET /compute/v2.1/servers/4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21 => generated 1879 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:06:28.930159 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-bc9aa279-23b6-4f81-8828-878766d81539 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:06:28.930779 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-bc9aa279-23b6-4f81-8828-878766d81539 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] [instance: dbacaeed-a40b-4e05-9635-5073dfdd8621] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:06:28.947636 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bc9aa279-23b6-4f81-8828-878766d81539 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:28.948588 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bc9aa279-23b6-4f81-8828-878766d81539 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:28.949994 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bc9aa279-23b6-4f81-8828-878766d81539 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:28.952151 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bc9aa279-23b6-4f81-8828-878766d81539 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:28.957503 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bc9aa279-23b6-4f81-8828-878766d81539 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:28.957973 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bc9aa279-23b6-4f81-8828-878766d81539 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:29.029215 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-77680838-a578-4bd1-8c0d-e3046d09b04c req-045a7ceb-6cdd-46b7-bc1b-1ce7bb43b9df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1f1a2d9-92ff-4f2b-8f65-24cee7c6418d", "tag": "93a61fbf-d7d9-4ab4-b56a-97c0bdc56d8e"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:06:29.059397 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-77680838-a578-4bd1-8c0d-e3046d09b04c req-045a7ceb-6cdd-46b7-bc1b-1ce7bb43b9df service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:29.060208 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-77680838-a578-4bd1-8c0d-e3046d09b04c req-045a7ceb-6cdd-46b7-bc1b-1ce7bb43b9df service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:29.067542 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-77680838-a578-4bd1-8c0d-e3046d09b04c req-045a7ceb-6cdd-46b7-bc1b-1ce7bb43b9df service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:29.084941 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-77680838-a578-4bd1-8c0d-e3046d09b04c req-045a7ceb-6cdd-46b7-bc1b-1ce7bb43b9df service nova] Creating event network-changed:93a61fbf-d7d9-4ab4-b56a-97c0bdc56d8e for instance e1f1a2d9-92ff-4f2b-8f65-24cee7c6418d on nch2-master-1 Oct 08 21:06:29.109030 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-77680838-a578-4bd1-8c0d-e3046d09b04c req-045a7ceb-6cdd-46b7-bc1b-1ce7bb43b9df service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084623 Oct 08 21:06:29.111087 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1787/3486] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:06:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 08 21:06:29.129798 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-5926953d-a82e-4c26-a4ca-ad0369626c44 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:06:29.130720 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-5926953d-a82e-4c26-a4ca-ad0369626c44 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: e1f1a2d9-92ff-4f2b-8f65-24cee7c6418d] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:06:29.152235 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5926953d-a82e-4c26-a4ca-ad0369626c44 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:29.161709 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=4 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:06:29.163398 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5926953d-a82e-4c26-a4ca-ad0369626c44 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:29.164070 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5926953d-a82e-4c26-a4ca-ad0369626c44 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:29.167624 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5926953d-a82e-4c26-a4ca-ad0369626c44 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:29.180402 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5926953d-a82e-4c26-a4ca-ad0369626c44 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:29.181123 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5926953d-a82e-4c26-a4ca-ad0369626c44 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:29.862279 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-bc9aa279-23b6-4f81-8828-878766d81539 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:29.872100 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-bc9aa279-23b6-4f81-8828-878766d81539 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:29.878293 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-bc9aa279-23b6-4f81-8828-878766d81539 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:29.882153 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-bc9aa279-23b6-4f81-8828-878766d81539 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] 10.222.0.26 "GET /compute/v2.1/servers/dbacaeed-a40b-4e05-9635-5073dfdd8621" status: 200 len: 1739 microversion: 2.20 time: 0.955778 Oct 08 21:06:29.885004 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1700/3487] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:06:28 2022] GET /compute/v2.1/servers/dbacaeed-a40b-4e05-9635-5073dfdd8621 => generated 1739 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:06:30.019333 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-5926953d-a82e-4c26-a4ca-ad0369626c44 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06443b5728fb4d1e95d6245820e786bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ded993145b4eda9d6a33b994519012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:30.034307 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-5926953d-a82e-4c26-a4ca-ad0369626c44 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "GET /compute/v2.1/servers/e1f1a2d9-92ff-4f2b-8f65-24cee7c6418d" status: 200 len: 1321 microversion: 2.1 time: 0.921795 Oct 08 21:06:30.046473 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1788/3488] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:06:29 2022] GET /compute/v2.1/servers/e1f1a2d9-92ff-4f2b-8f65-24cee7c6418d => generated 1321 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:06:30.046473 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-1ba0887c-cf98-4d51-9eec-bb4dc2fffc08 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:06:30.047004 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-1ba0887c-cf98-4d51-9eec-bb4dc2fffc08 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] [instance: 4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:06:30.066300 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1ba0887c-cf98-4d51-9eec-bb4dc2fffc08 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:30.086274 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1ba0887c-cf98-4d51-9eec-bb4dc2fffc08 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:30.089467 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1ba0887c-cf98-4d51-9eec-bb4dc2fffc08 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:30.093235 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1ba0887c-cf98-4d51-9eec-bb4dc2fffc08 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:30.099025 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1ba0887c-cf98-4d51-9eec-bb4dc2fffc08 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:30.099811 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1ba0887c-cf98-4d51-9eec-bb4dc2fffc08 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:30.244715 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-3e8512fb-510e-4b3e-b19b-452df2965b81 tempest-AbsoluteLimitsNegativeTestJSON-2128721863 tempest-AbsoluteLimitsNegativeTestJSON-2128721863-project] Calling method '.version_select at 0x7f1a877a6e50>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:06:30.272361 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3e8512fb-510e-4b3e-b19b-452df2965b81 tempest-AbsoluteLimitsNegativeTestJSON-2128721863 tempest-AbsoluteLimitsNegativeTestJSON-2128721863-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:30.273211 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3e8512fb-510e-4b3e-b19b-452df2965b81 tempest-AbsoluteLimitsNegativeTestJSON-2128721863 tempest-AbsoluteLimitsNegativeTestJSON-2128721863-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:30.273882 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3e8512fb-510e-4b3e-b19b-452df2965b81 tempest-AbsoluteLimitsNegativeTestJSON-2128721863 tempest-AbsoluteLimitsNegativeTestJSON-2128721863-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:30.274874 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3e8512fb-510e-4b3e-b19b-452df2965b81 tempest-AbsoluteLimitsNegativeTestJSON-2128721863 tempest-AbsoluteLimitsNegativeTestJSON-2128721863-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:30.275549 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3e8512fb-510e-4b3e-b19b-452df2965b81 tempest-AbsoluteLimitsNegativeTestJSON-2128721863 tempest-AbsoluteLimitsNegativeTestJSON-2128721863-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:30.276198 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3e8512fb-510e-4b3e-b19b-452df2965b81 tempest-AbsoluteLimitsNegativeTestJSON-2128721863 tempest-AbsoluteLimitsNegativeTestJSON-2128721863-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:30.323796 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-3e8512fb-510e-4b3e-b19b-452df2965b81 tempest-AbsoluteLimitsNegativeTestJSON-2128721863 tempest-AbsoluteLimitsNegativeTestJSON-2128721863-project] 10.222.0.26 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.437555 Oct 08 21:06:30.324746 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1701/3489] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:06:29 2022] GET /compute/v2.1/limits => generated 511 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:06:30.341242 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-61208f38-dd4b-43b7-8d01-e5765e789dd5 req-5134f1dd-aa33-4b96-930b-a81e36527fe9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbacaeed-a40b-4e05-9635-5073dfdd8621", "name": "network-vif-plugged", "status": "completed", "tag": "6fe657e1-039e-4549-b2d4-955cfbaed37d"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:06:30.363684 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-61208f38-dd4b-43b7-8d01-e5765e789dd5 req-5134f1dd-aa33-4b96-930b-a81e36527fe9 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:30.364544 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-61208f38-dd4b-43b7-8d01-e5765e789dd5 req-5134f1dd-aa33-4b96-930b-a81e36527fe9 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:30.365215 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-61208f38-dd4b-43b7-8d01-e5765e789dd5 req-5134f1dd-aa33-4b96-930b-a81e36527fe9 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:30.387685 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-61208f38-dd4b-43b7-8d01-e5765e789dd5 req-5134f1dd-aa33-4b96-930b-a81e36527fe9 service nova] Creating event network-vif-plugged:6fe657e1-039e-4549-b2d4-955cfbaed37d for instance dbacaeed-a40b-4e05-9635-5073dfdd8621 on nch2-master-1 Oct 08 21:06:30.402724 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-61208f38-dd4b-43b7-8d01-e5765e789dd5 req-5134f1dd-aa33-4b96-930b-a81e36527fe9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071752 Oct 08 21:06:30.404237 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1702/3490] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:06:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:06:30.527702 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-0a644a5e-f067-4cb3-8d96-4ed3c628f5fd tempest-AbsoluteLimitsNegativeTestJSON-2128721863 tempest-AbsoluteLimitsNegativeTestJSON-2128721863-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-148502290", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:06:30.679718 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.network.neutron [None req-0a644a5e-f067-4cb3-8d96-4ed3c628f5fd tempest-AbsoluteLimitsNegativeTestJSON-2128721863 tempest-AbsoluteLimitsNegativeTestJSON-2128721863-project] validate_networks() for None {{(pid=140491) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 21:06:30.891060 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-1ba0887c-cf98-4d51-9eec-bb4dc2fffc08 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc2bdd169daf4a1db830b1fa7f94f0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f2d56477794f8ab38b8e3535b3e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:30.905545 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-1ba0887c-cf98-4d51-9eec-bb4dc2fffc08 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc2bdd169daf4a1db830b1fa7f94f0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f2d56477794f8ab38b8e3535b3e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:30.907024 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-1ba0887c-cf98-4d51-9eec-bb4dc2fffc08 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc2bdd169daf4a1db830b1fa7f94f0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f2d56477794f8ab38b8e3535b3e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:30.912455 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-1ba0887c-cf98-4d51-9eec-bb4dc2fffc08 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] 10.222.0.26 "GET /compute/v2.1/servers/4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21" status: 200 len: 1879 microversion: 2.32 time: 0.873721 Oct 08 21:06:30.913599 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1789/3491] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:06:30 2022] GET /compute/v2.1/servers/4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21 => generated 1879 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:06:30.922776 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-cfa9fa43-c40e-46fa-9dc0-40ec6cd5a790 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:06:30.924620 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-cfa9fa43-c40e-46fa-9dc0-40ec6cd5a790 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] [instance: dbacaeed-a40b-4e05-9635-5073dfdd8621] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:06:30.932313 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cfa9fa43-c40e-46fa-9dc0-40ec6cd5a790 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:30.935075 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cfa9fa43-c40e-46fa-9dc0-40ec6cd5a790 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:30.942728 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cfa9fa43-c40e-46fa-9dc0-40ec6cd5a790 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:30.943913 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cfa9fa43-c40e-46fa-9dc0-40ec6cd5a790 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:30.944628 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cfa9fa43-c40e-46fa-9dc0-40ec6cd5a790 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:30.945306 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cfa9fa43-c40e-46fa-9dc0-40ec6cd5a790 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:31.452943 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-cfa9fa43-c40e-46fa-9dc0-40ec6cd5a790 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:31.468218 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-cfa9fa43-c40e-46fa-9dc0-40ec6cd5a790 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:31.471304 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-cfa9fa43-c40e-46fa-9dc0-40ec6cd5a790 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:31.472823 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-cfa9fa43-c40e-46fa-9dc0-40ec6cd5a790 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] 10.222.0.26 "GET /compute/v2.1/servers/dbacaeed-a40b-4e05-9635-5073dfdd8621" status: 200 len: 1739 microversion: 2.20 time: 0.558093 Oct 08 21:06:31.474700 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1790/3492] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:06:30 2022] GET /compute/v2.1/servers/dbacaeed-a40b-4e05-9635-5073dfdd8621 => generated 1739 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:06:31.583520 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e3a69e70-192f-4207-8bef-54804b632d74 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:06:31.584575 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-e3a69e70-192f-4207-8bef-54804b632d74 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: e1f1a2d9-92ff-4f2b-8f65-24cee7c6418d] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:06:31.594822 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e3a69e70-192f-4207-8bef-54804b632d74 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:31.597049 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e3a69e70-192f-4207-8bef-54804b632d74 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:31.597811 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e3a69e70-192f-4207-8bef-54804b632d74 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:31.600267 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e3a69e70-192f-4207-8bef-54804b632d74 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:31.601296 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e3a69e70-192f-4207-8bef-54804b632d74 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:31.601984 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e3a69e70-192f-4207-8bef-54804b632d74 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:32.241024 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-e3a69e70-192f-4207-8bef-54804b632d74 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06443b5728fb4d1e95d6245820e786bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ded993145b4eda9d6a33b994519012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:32.251084 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-0a644a5e-f067-4cb3-8d96-4ed3c628f5fd tempest-AbsoluteLimitsNegativeTestJSON-2128721863 tempest-AbsoluteLimitsNegativeTestJSON-2128721863-project] Getting quotas for project 081bbe524ba84369944f20b4d86f21dc. Resources: dict_keys(['metadata_items']) {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:06:32.257395 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-e3a69e70-192f-4207-8bef-54804b632d74 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "GET /compute/v2.1/servers/e1f1a2d9-92ff-4f2b-8f65-24cee7c6418d" status: 200 len: 1321 microversion: 2.1 time: 0.780308 Oct 08 21:06:32.258482 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1791/3493] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:06:31 2022] GET /compute/v2.1/servers/e1f1a2d9-92ff-4f2b-8f65-24cee7c6418d => generated 1321 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:06:32.264178 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-ea474e13-3906-407e-b92a-a1ecc04f4fc1 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:06:32.265375 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-ea474e13-3906-407e-b92a-a1ecc04f4fc1 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] [instance: ce4a2fbf-76f3-4577-a704-3b64ec30d84b] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:06:32.272865 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ea474e13-3906-407e-b92a-a1ecc04f4fc1 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:32.273338 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-0a644a5e-f067-4cb3-8d96-4ed3c628f5fd tempest-AbsoluteLimitsNegativeTestJSON-2128721863 tempest-AbsoluteLimitsNegativeTestJSON-2128721863-project] Getting quotas for user 5b0d8160a9e04d84930264be71f29db7 and project 081bbe524ba84369944f20b4d86f21dc. Resources: dict_keys(['metadata_items']) {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:06:32.275157 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ea474e13-3906-407e-b92a-a1ecc04f4fc1 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:32.275851 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ea474e13-3906-407e-b92a-a1ecc04f4fc1 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:32.276848 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ea474e13-3906-407e-b92a-a1ecc04f4fc1 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:32.277681 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ea474e13-3906-407e-b92a-a1ecc04f4fc1 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:32.278384 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ea474e13-3906-407e-b92a-a1ecc04f4fc1 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:32.307957 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-0a644a5e-f067-4cb3-8d96-4ed3c628f5fd tempest-AbsoluteLimitsNegativeTestJSON-2128721863 tempest-AbsoluteLimitsNegativeTestJSON-2128721863-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Oct 08 21:06:32.312390 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-0a644a5e-f067-4cb3-8d96-4ed3c628f5fd tempest-AbsoluteLimitsNegativeTestJSON-2128721863 tempest-AbsoluteLimitsNegativeTestJSON-2128721863-project] Request method failure captured: Oct 08 21:06:32.312390 ncdv-master-1 devstack@n-api.service[140491]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 08 21:06:32.312390 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:06:32.312390 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:06:32.312390 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:06:32.312390 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 1751 Oct 08 21:06:32.312390 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:06:32.312390 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:06:32.312390 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:06:32.312390 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:06:32.312390 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeZV-ylyyWXlbh-vIcuBhRvznTkxDe4ouaDj6ibKeWXi3zpjUH0CXY0Av6SpzZyofHpaOAbIV9VEYmHiDF16wuajJsSYq2tnVP3hQorbdO6OVmp83WwVYIwmb96TVeioN1w5rgdVE_4GH4VvN-5D1nnXDa1dnKptob6vcSIWfiMizbc Oct 08 21:06:32.312390 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:06:32.312390 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:06:32.312390 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:06:32.312390 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:06:32.312390 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:06:32.312390 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:06:32.312390 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 081bbe524ba84369944f20b4d86f21dc Oct 08 21:06:32.312390 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-2128721863 Oct 08 21:06:32.312390 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:06:32.312390 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:06:32.312390 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/081bbe524ba84369944f20b4d86f21dc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/081bbe524ba84369944f20b4d86f21dc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_081bbe524ba84369944f20b4d86f21dc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/081bbe524ba84369944f20b4d86f21dc"}]}] Oct 08 21:06:32.312390 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-2128721863 Oct 08 21:06:32.312390 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 081bbe524ba84369944f20b4d86f21dc Oct 08 21:06:32.312390 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-2128721863 Oct 08 21:06:32.312390 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-2128721863-project Oct 08 21:06:32.312390 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:06:32.312390 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:06:32.312390 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 5b0d8160a9e04d84930264be71f29db7 Oct 08 21:06:32.312390 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-2128721863-project Oct 08 21:06:32.312390 ncdv-master-1 devstack@n-api.service[140491]: Oct 08 21:06:32.312390 ncdv-master-1 devstack@n-api.service[140491]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-148502290", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Oct 08 21:06:32.312390 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:06:32.312390 ncdv-master-1 devstack@n-api.service[140491]: exception: Maximum number of metadata items exceeds 128 Oct 08 21:06:32.318149 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-148502290', 'imageRef': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Oct 08 21:06:32.318149 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:06:32.318149 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:06:32.318149 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 476, in _check_metadata_properties_quota Oct 08 21:06:32.318149 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Oct 08 21:06:32.318149 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 08 21:06:32.318149 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 08 21:06:32.318149 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Oct 08 21:06:32.318149 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Oct 08 21:06:32.318149 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Oct 08 21:06:32.318149 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Oct 08 21:06:32.318149 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Oct 08 21:06:32.318149 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Oct 08 21:06:32.318149 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Oct 08 21:06:32.318149 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:06:32.318149 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:06:32.318149 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:06:32.318149 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:06:32.318149 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 08 21:06:32.318149 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 08 21:06:32.318149 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 08 21:06:32.318149 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 08 21:06:32.318149 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Oct 08 21:06:32.318149 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Oct 08 21:06:32.318149 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1016, in _checks_for_create_and_rebuild Oct 08 21:06:32.318149 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Oct 08 21:06:32.318149 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 483, in _check_metadata_properties_quota Oct 08 21:06:32.318149 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Oct 08 21:06:32.318149 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Oct 08 21:06:32.318149 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:06:32.318149 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:06:32.318149 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:06:32.318149 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:06:32.318149 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:06:32.318149 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:06:32.318149 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:06:32.318149 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:06:32.318149 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:06:32.318149 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:06:32.318149 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 21:06:32.318149 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 21:06:32.318149 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 21:06:32.318149 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 21:06:32.318149 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 21:06:32.336265 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 21:06:32.336265 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 08 21:06:32.336265 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 08 21:06:32.336265 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 08 21:06:32.336265 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Oct 08 21:06:32.336265 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:06:32.336265 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:06:32.336265 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:06:32.336265 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:06:32.336265 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:06:32.336265 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:06:32.336265 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:06:32.336265 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:06:32.336265 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Oct 08 21:06:32.336265 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:06:32.336265 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-0a644a5e-f067-4cb3-8d96-4ed3c628f5fd tempest-AbsoluteLimitsNegativeTestJSON-2128721863 tempest-AbsoluteLimitsNegativeTestJSON-2128721863-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:06:32.336265 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-0a644a5e-f067-4cb3-8d96-4ed3c628f5fd tempest-AbsoluteLimitsNegativeTestJSON-2128721863 tempest-AbsoluteLimitsNegativeTestJSON-2128721863-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 1.795196 Oct 08 21:06:32.336265 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1703/3494] 10.222.0.26 () {60 vars in 1148 bytes} [Sat Oct 8 21:06:30 2022] POST /compute/v2.1/servers => generated 87 bytes in 1799 msecs (HTTP/1.1 403) 9 headers in 378 bytes (2 switches on core 0) Oct 08 21:06:32.336265 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-bbdd3913-ae49-42dc-8e9d-f51b2f825671 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:06:32.336265 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-bbdd3913-ae49-42dc-8e9d-f51b2f825671 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] [instance: 4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:06:32.352797 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bbdd3913-ae49-42dc-8e9d-f51b2f825671 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:32.353387 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bbdd3913-ae49-42dc-8e9d-f51b2f825671 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:32.353998 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bbdd3913-ae49-42dc-8e9d-f51b2f825671 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:32.354728 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bbdd3913-ae49-42dc-8e9d-f51b2f825671 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:32.355972 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bbdd3913-ae49-42dc-8e9d-f51b2f825671 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:32.356418 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bbdd3913-ae49-42dc-8e9d-f51b2f825671 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:32.381283 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-ea474e13-3906-407e-b92a-a1ecc04f4fc1 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] 10.222.0.26 "GET /compute/v2.1/servers/ce4a2fbf-76f3-4577-a704-3b64ec30d84b/ips" status: 200 len: 145 microversion: 2.1 time: 0.077031 Oct 08 21:06:32.383087 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1792/3495] 10.222.0.26 () {58 vars in 1248 bytes} [Sat Oct 8 21:06:32 2022] GET /compute/v2.1/servers/ce4a2fbf-76f3-4577-a704-3b64ec30d84b/ips => generated 145 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:06:32.511463 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-520e4f5f-5b3b-4873-b418-186ba9b70214 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:06:32.512516 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-520e4f5f-5b3b-4873-b418-186ba9b70214 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] [instance: dbacaeed-a40b-4e05-9635-5073dfdd8621] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:06:32.535342 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-520e4f5f-5b3b-4873-b418-186ba9b70214 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:32.538832 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-520e4f5f-5b3b-4873-b418-186ba9b70214 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:32.541327 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-520e4f5f-5b3b-4873-b418-186ba9b70214 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:32.542671 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-520e4f5f-5b3b-4873-b418-186ba9b70214 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:32.545905 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-520e4f5f-5b3b-4873-b418-186ba9b70214 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:32.546826 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-520e4f5f-5b3b-4873-b418-186ba9b70214 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:33.002124 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-520e4f5f-5b3b-4873-b418-186ba9b70214 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:33.046966 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-520e4f5f-5b3b-4873-b418-186ba9b70214 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:33.052151 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-520e4f5f-5b3b-4873-b418-186ba9b70214 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:33.062927 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-520e4f5f-5b3b-4873-b418-186ba9b70214 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] 10.222.0.26 "GET /compute/v2.1/servers/dbacaeed-a40b-4e05-9635-5073dfdd8621" status: 200 len: 1739 microversion: 2.20 time: 0.564066 Oct 08 21:06:33.065672 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1793/3496] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:06:32 2022] GET /compute/v2.1/servers/dbacaeed-a40b-4e05-9635-5073dfdd8621 => generated 1739 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 08 21:06:33.477708 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-bbdd3913-ae49-42dc-8e9d-f51b2f825671 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc2bdd169daf4a1db830b1fa7f94f0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f2d56477794f8ab38b8e3535b3e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:33.530978 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-bbdd3913-ae49-42dc-8e9d-f51b2f825671 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc2bdd169daf4a1db830b1fa7f94f0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f2d56477794f8ab38b8e3535b3e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:33.538777 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-bbdd3913-ae49-42dc-8e9d-f51b2f825671 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc2bdd169daf4a1db830b1fa7f94f0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f2d56477794f8ab38b8e3535b3e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:33.546459 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-bbdd3913-ae49-42dc-8e9d-f51b2f825671 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] 10.222.0.26 "GET /compute/v2.1/servers/4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21" status: 200 len: 1879 microversion: 2.32 time: 1.219080 Oct 08 21:06:33.551119 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1704/3497] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:06:32 2022] GET /compute/v2.1/servers/4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21 => generated 1879 bytes in 1229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:06:33.585481 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-b384e294-eb6b-45b1-aa98-a36d0f07915d tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:06:33.586925 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-b384e294-eb6b-45b1-aa98-a36d0f07915d tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: e1f1a2d9-92ff-4f2b-8f65-24cee7c6418d] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:06:33.616588 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b384e294-eb6b-45b1-aa98-a36d0f07915d tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:33.618239 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b384e294-eb6b-45b1-aa98-a36d0f07915d tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:33.622099 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b384e294-eb6b-45b1-aa98-a36d0f07915d tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:33.624787 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b384e294-eb6b-45b1-aa98-a36d0f07915d tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:33.628860 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b384e294-eb6b-45b1-aa98-a36d0f07915d tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:33.630222 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b384e294-eb6b-45b1-aa98-a36d0f07915d tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:34.278001 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-6a00066b-5440-4e08-b66a-c06a343aa71b tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Action: 'create', calling method: .version_select at 0x7f1a914e2a60>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-317283591", "policies": ["affinity"]}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:06:34.356061 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-6a00066b-5440-4e08-b66a-c06a343aa71b tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Getting quotas for project 169293c01bf047358ff870a36c7a1247. Resources: {'server_groups'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:06:34.377791 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-6a00066b-5440-4e08-b66a-c06a343aa71b tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Getting quotas for user dcad18d0243f492591808197ca3dcc81 and project 169293c01bf047358ff870a36c7a1247. Resources: {'server_groups'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:06:34.518774 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-6a00066b-5440-4e08-b66a-c06a343aa71b tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Getting quotas for project 169293c01bf047358ff870a36c7a1247. Resources: {'server_groups'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:06:34.551439 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-6a00066b-5440-4e08-b66a-c06a343aa71b tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Getting quotas for user dcad18d0243f492591808197ca3dcc81 and project 169293c01bf047358ff870a36c7a1247. Resources: {'server_groups'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:06:34.574165 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-6a00066b-5440-4e08-b66a-c06a343aa71b tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] 10.222.0.26 "POST /compute/v2.1/os-server-groups" status: 200 len: 183 microversion: 2.1 time: 1.507263 Oct 08 21:06:34.574992 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1794/3498] 10.222.0.26 () {60 vars in 1174 bytes} [Sat Oct 8 21:06:33 2022] POST /compute/v2.1/os-server-groups => generated 183 bytes in 1509 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:06:34.587820 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-327fdc24-7cf5-421a-ace1-afd258807af0 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:06:34.588752 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-327fdc24-7cf5-421a-ace1-afd258807af0 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] [instance: dbacaeed-a40b-4e05-9635-5073dfdd8621] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:06:34.599077 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-327fdc24-7cf5-421a-ace1-afd258807af0 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:34.600188 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-327fdc24-7cf5-421a-ace1-afd258807af0 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:34.600865 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-327fdc24-7cf5-421a-ace1-afd258807af0 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:34.601854 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-327fdc24-7cf5-421a-ace1-afd258807af0 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:34.603052 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-327fdc24-7cf5-421a-ace1-afd258807af0 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:34.604171 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-327fdc24-7cf5-421a-ace1-afd258807af0 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:34.906659 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-b384e294-eb6b-45b1-aa98-a36d0f07915d tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06443b5728fb4d1e95d6245820e786bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ded993145b4eda9d6a33b994519012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:34.917803 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-b384e294-eb6b-45b1-aa98-a36d0f07915d tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "GET /compute/v2.1/servers/e1f1a2d9-92ff-4f2b-8f65-24cee7c6418d" status: 200 len: 1321 microversion: 2.1 time: 1.363064 Oct 08 21:06:34.923162 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1705/3499] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:06:33 2022] GET /compute/v2.1/servers/e1f1a2d9-92ff-4f2b-8f65-24cee7c6418d => generated 1321 bytes in 1371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:06:34.932198 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-a9016eed-ee56-40ed-bee0-6ddb09ed4fbf tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Action: 'create', calling method: .version_select at 0x7f1a914cbee0>, body: {"server_group": {"name": "tempest-server-group-1783801023", "policies": ["affinity"]}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:06:35.021457 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-a9016eed-ee56-40ed-bee0-6ddb09ed4fbf tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Getting quotas for project 169293c01bf047358ff870a36c7a1247. Resources: {'server_groups'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:06:35.049530 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-a9016eed-ee56-40ed-bee0-6ddb09ed4fbf tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Getting quotas for user dcad18d0243f492591808197ca3dcc81 and project 169293c01bf047358ff870a36c7a1247. Resources: {'server_groups'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:06:35.274317 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-a9016eed-ee56-40ed-bee0-6ddb09ed4fbf tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Getting quotas for project 169293c01bf047358ff870a36c7a1247. Resources: {'server_groups'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:06:35.290520 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-a9016eed-ee56-40ed-bee0-6ddb09ed4fbf tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Getting quotas for user dcad18d0243f492591808197ca3dcc81 and project 169293c01bf047358ff870a36c7a1247. Resources: {'server_groups'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:06:35.340665 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-a9016eed-ee56-40ed-bee0-6ddb09ed4fbf tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] 10.222.0.26 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.416139 Oct 08 21:06:35.346330 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1706/3500] 10.222.0.26 () {60 vars in 1173 bytes} [Sat Oct 8 21:06:34 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:06:35.366270 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-f2f9c310-29ff-434d-9a6d-ac81009abc51 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:06:35.381143 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-f2f9c310-29ff-434d-9a6d-ac81009abc51 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] [instance: 4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:06:35.410570 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f2f9c310-29ff-434d-9a6d-ac81009abc51 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:35.412694 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f2f9c310-29ff-434d-9a6d-ac81009abc51 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:35.413165 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f2f9c310-29ff-434d-9a6d-ac81009abc51 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:35.416619 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f2f9c310-29ff-434d-9a6d-ac81009abc51 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:35.419358 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f2f9c310-29ff-434d-9a6d-ac81009abc51 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:35.421420 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f2f9c310-29ff-434d-9a6d-ac81009abc51 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:36.232755 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-327fdc24-7cf5-421a-ace1-afd258807af0 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:36.236727 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=100 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:06:36.269745 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-327fdc24-7cf5-421a-ace1-afd258807af0 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:36.274139 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-327fdc24-7cf5-421a-ace1-afd258807af0 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:36.283328 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-327fdc24-7cf5-421a-ace1-afd258807af0 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] 10.222.0.26 "GET /compute/v2.1/servers/dbacaeed-a40b-4e05-9635-5073dfdd8621" status: 200 len: 1739 microversion: 2.20 time: 1.700039 Oct 08 21:06:36.286476 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1795/3501] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:06:34 2022] GET /compute/v2.1/servers/dbacaeed-a40b-4e05-9635-5073dfdd8621 => generated 1739 bytes in 1704 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:06:36.320701 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-aa902b4f-32be-407b-b85d-d1cb8c23f002 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Action: 'create', calling method: .version_select at 0x7f1a8c90fd30>, body: {"server_group": {"name": "tempest-server-group-1783801023", "policies": ["affinity"]}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:06:36.386066 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-aa902b4f-32be-407b-b85d-d1cb8c23f002 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Getting quotas for project 169293c01bf047358ff870a36c7a1247. Resources: {'server_groups'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:06:36.412664 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-aa902b4f-32be-407b-b85d-d1cb8c23f002 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Getting quotas for user dcad18d0243f492591808197ca3dcc81 and project 169293c01bf047358ff870a36c7a1247. Resources: {'server_groups'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:06:36.432900 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:DELETE=4,nova_api:SELECT=92,nova_api:INSERT=4 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:06:36.529144 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-aa902b4f-32be-407b-b85d-d1cb8c23f002 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Getting quotas for project 169293c01bf047358ff870a36c7a1247. Resources: {'server_groups'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:06:36.544590 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-f2f9c310-29ff-434d-9a6d-ac81009abc51 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc2bdd169daf4a1db830b1fa7f94f0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f2d56477794f8ab38b8e3535b3e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:36.555395 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-aa902b4f-32be-407b-b85d-d1cb8c23f002 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Getting quotas for user dcad18d0243f492591808197ca3dcc81 and project 169293c01bf047358ff870a36c7a1247. Resources: {'server_groups'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:06:36.570315 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-f2f9c310-29ff-434d-9a6d-ac81009abc51 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc2bdd169daf4a1db830b1fa7f94f0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f2d56477794f8ab38b8e3535b3e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:36.584223 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-f2f9c310-29ff-434d-9a6d-ac81009abc51 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc2bdd169daf4a1db830b1fa7f94f0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f2d56477794f8ab38b8e3535b3e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:36.587199 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-f2f9c310-29ff-434d-9a6d-ac81009abc51 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] 10.222.0.26 "GET /compute/v2.1/servers/4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21" status: 200 len: 1879 microversion: 2.32 time: 1.239805 Oct 08 21:06:36.587793 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1707/3502] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:06:35 2022] GET /compute/v2.1/servers/4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21 => generated 1879 bytes in 1241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:06:36.611754 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-f9d623f7-51f8-4d4c-b512-5ed17520714f tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:06:36.615806 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-f9d623f7-51f8-4d4c-b512-5ed17520714f tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: e1f1a2d9-92ff-4f2b-8f65-24cee7c6418d] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:06:36.629249 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-aa902b4f-32be-407b-b85d-d1cb8c23f002 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] 10.222.0.26 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.338287 Oct 08 21:06:36.632527 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f9d623f7-51f8-4d4c-b512-5ed17520714f tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:36.632878 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1796/3503] 10.222.0.26 () {60 vars in 1173 bytes} [Sat Oct 8 21:06:36 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:06:36.635711 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f9d623f7-51f8-4d4c-b512-5ed17520714f tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:36.636536 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f9d623f7-51f8-4d4c-b512-5ed17520714f tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:36.638716 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f9d623f7-51f8-4d4c-b512-5ed17520714f tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:36.643159 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f9d623f7-51f8-4d4c-b512-5ed17520714f tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:36.643898 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f9d623f7-51f8-4d4c-b512-5ed17520714f tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:36.659391 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-3cc8cb09-43a4-4586-b8b9-babb316fc80e tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2b9d2f56-8742-40d7-8421-fb2664f4d10e"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:06:36.672694 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-3cc8cb09-43a4-4586-b8b9-babb316fc80e tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] [instance: ce4a2fbf-76f3-4577-a704-3b64ec30d84b] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:06:36.704829 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3cc8cb09-43a4-4586-b8b9-babb316fc80e tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:36.705495 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3cc8cb09-43a4-4586-b8b9-babb316fc80e tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:36.706631 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3cc8cb09-43a4-4586-b8b9-babb316fc80e tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:36.709789 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3cc8cb09-43a4-4586-b8b9-babb316fc80e tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:36.712067 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3cc8cb09-43a4-4586-b8b9-babb316fc80e tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:36.714449 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3cc8cb09-43a4-4586-b8b9-babb316fc80e tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:37.085815 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-f9d623f7-51f8-4d4c-b512-5ed17520714f tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06443b5728fb4d1e95d6245820e786bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ded993145b4eda9d6a33b994519012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:37.097818 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-f9d623f7-51f8-4d4c-b512-5ed17520714f tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "GET /compute/v2.1/servers/e1f1a2d9-92ff-4f2b-8f65-24cee7c6418d" status: 200 len: 1321 microversion: 2.1 time: 0.503633 Oct 08 21:06:37.099291 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1708/3504] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:06:36 2022] GET /compute/v2.1/servers/e1f1a2d9-92ff-4f2b-8f65-24cee7c6418d => generated 1321 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:06:37.111298 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-07553512-69d5-4ac4-a41b-2394e738ef5b tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:06:37.175577 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-07553512-69d5-4ac4-a41b-2394e738ef5b tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] 10.222.0.26 "DELETE /compute/v2.1/os-server-groups/51a1f4f5-424c-4345-9dce-1aebbaa3f72f" status: 204 len: 0 microversion: 2.1 time: 0.073484 Oct 08 21:06:37.176773 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1709/3505] 10.222.0.26 () {58 vars in 1266 bytes} [Sat Oct 8 21:06:37 2022] DELETE /compute/v2.1/os-server-groups/51a1f4f5-424c-4345-9dce-1aebbaa3f72f => generated 0 bytes in 77 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 21:06:37.187182 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-6f6612a0-6491-4fb5-8ed4-e6f713b91b98 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:06:37.235838 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-6f6612a0-6491-4fb5-8ed4-e6f713b91b98 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] 10.222.0.26 "GET /compute/v2.1/os-server-groups" status: 200 len: 334 microversion: 2.1 time: 0.053566 Oct 08 21:06:37.238225 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1710/3506] 10.222.0.26 () {58 vars in 1152 bytes} [Sat Oct 8 21:06:37 2022] GET /compute/v2.1/os-server-groups => generated 334 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:06:37.266339 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-9555976b-28e1-43f8-814d-d156f198ee26 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:06:37.356684 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3,nova_api:DELETE=4 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:06:37.398379 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-3cc8cb09-43a4-4586-b8b9-babb316fc80e tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] 10.222.0.26 "POST /compute/v2.1/servers/ce4a2fbf-76f3-4577-a704-3b64ec30d84b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.764134 Oct 08 21:06:37.399544 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1797/3507] 10.222.0.26 () {60 vars in 1323 bytes} [Sat Oct 8 21:06:36 2022] POST /compute/v2.1/servers/ce4a2fbf-76f3-4577-a704-3b64ec30d84b/os-volume_attachments => generated 194 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:06:37.400650 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-9555976b-28e1-43f8-814d-d156f198ee26 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] 10.222.0.26 "DELETE /compute/v2.1/os-server-groups/26da0580-a573-4f29-9da7-036f8b51180e" status: 204 len: 0 microversion: 2.1 time: 0.150959 Oct 08 21:06:37.401601 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1711/3508] 10.222.0.26 () {58 vars in 1266 bytes} [Sat Oct 8 21:06:37 2022] DELETE /compute/v2.1/os-server-groups/26da0580-a573-4f29-9da7-036f8b51180e => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 21:06:37.413869 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-a7305ccf-4999-4a77-aeea-43c4500f5508 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:06:37.416077 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-a7305ccf-4999-4a77-aeea-43c4500f5508 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] [instance: dbacaeed-a40b-4e05-9635-5073dfdd8621] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:06:37.426560 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-52ad4d44-61af-416d-9a0a-bbd9cf250022 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:06:37.437446 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a7305ccf-4999-4a77-aeea-43c4500f5508 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:37.439501 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a7305ccf-4999-4a77-aeea-43c4500f5508 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:37.441958 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a7305ccf-4999-4a77-aeea-43c4500f5508 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:37.444161 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a7305ccf-4999-4a77-aeea-43c4500f5508 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:37.446519 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a7305ccf-4999-4a77-aeea-43c4500f5508 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:37.448397 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a7305ccf-4999-4a77-aeea-43c4500f5508 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:37.460637 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-52ad4d44-61af-416d-9a0a-bbd9cf250022 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] 10.222.0.26 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.047812 Oct 08 21:06:37.462872 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1712/3509] 10.222.0.26 () {58 vars in 1152 bytes} [Sat Oct 8 21:06:37 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:06:37.481767 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-e1c6f9e3-e70c-4cb2-97f9-3b35e4150e2b tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Action: 'create', calling method: .version_select at 0x7f1a87758b80>, body: {"server_group": {"name": "tempest-server-group-1420020944", "policies": ["affinity"]}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:06:37.560158 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-e1c6f9e3-e70c-4cb2-97f9-3b35e4150e2b tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Getting quotas for project 169293c01bf047358ff870a36c7a1247. Resources: {'server_groups'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:06:37.601479 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-e1c6f9e3-e70c-4cb2-97f9-3b35e4150e2b tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Getting quotas for user dcad18d0243f492591808197ca3dcc81 and project 169293c01bf047358ff870a36c7a1247. Resources: {'server_groups'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:06:37.823255 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-a7305ccf-4999-4a77-aeea-43c4500f5508 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:37.838370 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-a7305ccf-4999-4a77-aeea-43c4500f5508 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:37.840517 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-e1c6f9e3-e70c-4cb2-97f9-3b35e4150e2b tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Getting quotas for project 169293c01bf047358ff870a36c7a1247. Resources: {'server_groups'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:06:37.840945 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-a7305ccf-4999-4a77-aeea-43c4500f5508 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:37.843053 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-a7305ccf-4999-4a77-aeea-43c4500f5508 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] 10.222.0.26 "GET /compute/v2.1/servers/dbacaeed-a40b-4e05-9635-5073dfdd8621" status: 200 len: 1739 microversion: 2.20 time: 0.441113 Oct 08 21:06:37.857652 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1798/3510] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:06:37 2022] GET /compute/v2.1/servers/dbacaeed-a40b-4e05-9635-5073dfdd8621 => generated 1739 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:06:37.885490 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-1b505725-4180-4e33-86de-dcf0d7cbf32f req-80ba64e3-7c01-40e2-b0e8-2d2dfa23d560 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1f1a2d9-92ff-4f2b-8f65-24cee7c6418d", "name": "network-vif-plugged", "status": "completed", "tag": "93a61fbf-d7d9-4ab4-b56a-97c0bdc56d8e"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:06:37.896410 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-e1c6f9e3-e70c-4cb2-97f9-3b35e4150e2b tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Getting quotas for user dcad18d0243f492591808197ca3dcc81 and project 169293c01bf047358ff870a36c7a1247. Resources: {'server_groups'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:06:37.937520 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-1b505725-4180-4e33-86de-dcf0d7cbf32f req-80ba64e3-7c01-40e2-b0e8-2d2dfa23d560 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:37.946448 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-1b505725-4180-4e33-86de-dcf0d7cbf32f req-80ba64e3-7c01-40e2-b0e8-2d2dfa23d560 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:37.947352 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-1b505725-4180-4e33-86de-dcf0d7cbf32f req-80ba64e3-7c01-40e2-b0e8-2d2dfa23d560 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:37.965339 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-e1c6f9e3-e70c-4cb2-97f9-3b35e4150e2b tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] 10.222.0.26 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.494870 Oct 08 21:06:37.976565 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1713/3511] 10.222.0.26 () {60 vars in 1173 bytes} [Sat Oct 8 21:06:37 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 08 21:06:38.021083 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-8edc5f26-615e-44ba-adc8-010cb5931874 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:06:38.036619 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-1b505725-4180-4e33-86de-dcf0d7cbf32f req-80ba64e3-7c01-40e2-b0e8-2d2dfa23d560 service nova] Creating event network-vif-plugged:93a61fbf-d7d9-4ab4-b56a-97c0bdc56d8e for instance e1f1a2d9-92ff-4f2b-8f65-24cee7c6418d on nch2-master-1 Oct 08 21:06:38.040145 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-8edc5f26-615e-44ba-adc8-010cb5931874 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] [instance: 4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:06:38.077509 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-1b505725-4180-4e33-86de-dcf0d7cbf32f req-80ba64e3-7c01-40e2-b0e8-2d2dfa23d560 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.208602 Oct 08 21:06:38.080227 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1799/3512] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:06:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:06:38.111942 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8edc5f26-615e-44ba-adc8-010cb5931874 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:38.112453 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8edc5f26-615e-44ba-adc8-010cb5931874 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:38.112899 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8edc5f26-615e-44ba-adc8-010cb5931874 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:38.128516 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8edc5f26-615e-44ba-adc8-010cb5931874 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:38.142085 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8edc5f26-615e-44ba-adc8-010cb5931874 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:38.143014 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8edc5f26-615e-44ba-adc8-010cb5931874 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:38.150823 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e20c686b-90a0-4015-b8ef-073c301035e0 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:06:38.311349 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-e20c686b-90a0-4015-b8ef-073c301035e0 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] 10.222.0.26 "DELETE /compute/v2.1/os-server-groups/cde11d6e-d3f7-4b8f-b6dd-108d039faaaa" status: 204 len: 0 microversion: 2.1 time: 0.196365 Oct 08 21:06:38.312577 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1800/3513] 10.222.0.26 () {58 vars in 1266 bytes} [Sat Oct 8 21:06:38 2022] DELETE /compute/v2.1/os-server-groups/cde11d6e-d3f7-4b8f-b6dd-108d039faaaa => generated 0 bytes in 204 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 21:06:38.344580 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-232f9982-d747-4430-9ab4-d350d4736d59 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:06:38.357292 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-232f9982-d747-4430-9ab4-d350d4736d59 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: e1f1a2d9-92ff-4f2b-8f65-24cee7c6418d] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:06:38.366348 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-232f9982-d747-4430-9ab4-d350d4736d59 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:38.367134 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-232f9982-d747-4430-9ab4-d350d4736d59 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:38.367756 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-232f9982-d747-4430-9ab4-d350d4736d59 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:38.368677 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-232f9982-d747-4430-9ab4-d350d4736d59 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:38.369459 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-232f9982-d747-4430-9ab4-d350d4736d59 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:38.371960 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-232f9982-d747-4430-9ab4-d350d4736d59 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:38.628170 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-232f9982-d747-4430-9ab4-d350d4736d59 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06443b5728fb4d1e95d6245820e786bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ded993145b4eda9d6a33b994519012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:38.642288 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-232f9982-d747-4430-9ab4-d350d4736d59 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "GET /compute/v2.1/servers/e1f1a2d9-92ff-4f2b-8f65-24cee7c6418d" status: 200 len: 1321 microversion: 2.1 time: 0.300839 Oct 08 21:06:38.661104 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1801/3514] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:06:38 2022] GET /compute/v2.1/servers/e1f1a2d9-92ff-4f2b-8f65-24cee7c6418d => generated 1321 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:06:38.686112 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-25a06d75-74e7-453f-88e6-a9d083f47fc9 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:06:38.710583 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-25a06d75-74e7-453f-88e6-a9d083f47fc9 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] 10.222.0.26 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.046463 Oct 08 21:06:38.711238 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1802/3515] 10.222.0.26 () {58 vars in 1152 bytes} [Sat Oct 8 21:06:38 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:06:38.738471 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-0f968924-09e0-4ab1-a5cc-49a48f726b1b tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Action: 'create', calling method: .version_select at 0x7f1a8ca764c0>, body: {"server_group": {"name": "tempest-server-group-39325362", "policies": ["anti-affinity"]}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:06:38.774256 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-0f968924-09e0-4ab1-a5cc-49a48f726b1b tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Getting quotas for project 169293c01bf047358ff870a36c7a1247. Resources: {'server_groups'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:06:38.780972 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-0f968924-09e0-4ab1-a5cc-49a48f726b1b tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Getting quotas for user dcad18d0243f492591808197ca3dcc81 and project 169293c01bf047358ff870a36c7a1247. Resources: {'server_groups'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:06:38.877760 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-0f968924-09e0-4ab1-a5cc-49a48f726b1b tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Getting quotas for project 169293c01bf047358ff870a36c7a1247. Resources: {'server_groups'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:06:38.885893 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-0f968924-09e0-4ab1-a5cc-49a48f726b1b tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Getting quotas for user dcad18d0243f492591808197ca3dcc81 and project 169293c01bf047358ff870a36c7a1247. Resources: {'server_groups'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:06:38.886163 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-8edc5f26-615e-44ba-adc8-010cb5931874 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc2bdd169daf4a1db830b1fa7f94f0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f2d56477794f8ab38b8e3535b3e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:38.910770 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-8edc5f26-615e-44ba-adc8-010cb5931874 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc2bdd169daf4a1db830b1fa7f94f0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f2d56477794f8ab38b8e3535b3e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:38.912560 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-8edc5f26-615e-44ba-adc8-010cb5931874 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc2bdd169daf4a1db830b1fa7f94f0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f2d56477794f8ab38b8e3535b3e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:38.913995 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-8edc5f26-615e-44ba-adc8-010cb5931874 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] 10.222.0.26 "GET /compute/v2.1/servers/4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21" status: 200 len: 1879 microversion: 2.32 time: 0.926258 Oct 08 21:06:38.914752 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1714/3516] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:06:37 2022] GET /compute/v2.1/servers/4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21 => generated 1879 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:06:38.924390 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-ceeca65f-ebce-4b3d-978b-86f1e8e38091 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:06:38.925349 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-ceeca65f-ebce-4b3d-978b-86f1e8e38091 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] [instance: dbacaeed-a40b-4e05-9635-5073dfdd8621] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:06:38.932953 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-0f968924-09e0-4ab1-a5cc-49a48f726b1b tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] 10.222.0.26 "POST /compute/v2.1/os-server-groups" status: 200 len: 167 microversion: 2.1 time: 0.203034 Oct 08 21:06:38.943677 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ceeca65f-ebce-4b3d-978b-86f1e8e38091 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:38.943923 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1803/3517] 10.222.0.26 () {60 vars in 1173 bytes} [Sat Oct 8 21:06:38 2022] POST /compute/v2.1/os-server-groups => generated 167 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:06:38.945216 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ceeca65f-ebce-4b3d-978b-86f1e8e38091 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:38.945837 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ceeca65f-ebce-4b3d-978b-86f1e8e38091 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:38.946870 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ceeca65f-ebce-4b3d-978b-86f1e8e38091 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:38.947531 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ceeca65f-ebce-4b3d-978b-86f1e8e38091 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:38.948120 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ceeca65f-ebce-4b3d-978b-86f1e8e38091 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:38.959651 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-12770cac-71fc-4f52-94a2-8676acb7fecb tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:06:39.044292 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-12770cac-71fc-4f52-94a2-8676acb7fecb tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] 10.222.0.26 "DELETE /compute/v2.1/os-server-groups/74c48a4f-491d-4f7e-b52c-632952aba991" status: 204 len: 0 microversion: 2.1 time: 0.096876 Oct 08 21:06:39.045780 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1804/3518] 10.222.0.26 () {58 vars in 1266 bytes} [Sat Oct 8 21:06:38 2022] DELETE /compute/v2.1/os-server-groups/74c48a4f-491d-4f7e-b52c-632952aba991 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 21:06:39.060247 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e01ea6d2-4407-45cc-b61d-5f00b83f65c9 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:06:39.086768 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-e01ea6d2-4407-45cc-b61d-5f00b83f65c9 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] 10.222.0.26 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.034592 Oct 08 21:06:39.088054 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1805/3519] 10.222.0.26 () {58 vars in 1152 bytes} [Sat Oct 8 21:06:39 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:06:39.380824 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-ea835bd2-74d9-4632-b625-15ff13cc0a5d tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-343031440", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "networks": [{"uuid": "bca8acd6-e237-448c-b278-bf4ee4d1d5a2"}]}, "os:scheduler_hints": {"group": "62ebe1b7-fbe1-40bd-94c6-db26b37342d4"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:06:39.575827 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.network.neutron [None req-ea835bd2-74d9-4632-b625-15ff13cc0a5d tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] validate_networks() for [('bca8acd6-e237-448c-b278-bf4ee4d1d5a2', None, None, None, None, None)] {{(pid=140492) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 21:06:40.088544 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-ceeca65f-ebce-4b3d-978b-86f1e8e38091 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:40.112865 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-ceeca65f-ebce-4b3d-978b-86f1e8e38091 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:40.114728 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-ceeca65f-ebce-4b3d-978b-86f1e8e38091 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:40.116615 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-ceeca65f-ebce-4b3d-978b-86f1e8e38091 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] 10.222.0.26 "GET /compute/v2.1/servers/dbacaeed-a40b-4e05-9635-5073dfdd8621" status: 200 len: 1739 microversion: 2.20 time: 1.200744 Oct 08 21:06:40.138383 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1715/3520] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:06:38 2022] GET /compute/v2.1/servers/dbacaeed-a40b-4e05-9635-5073dfdd8621 => generated 1739 bytes in 1223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:06:40.154867 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-b6741435-9611-4765-a936-da34a14a9a34 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:06:40.155897 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-b6741435-9611-4765-a936-da34a14a9a34 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: e1f1a2d9-92ff-4f2b-8f65-24cee7c6418d] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:06:40.173324 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b6741435-9611-4765-a936-da34a14a9a34 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:40.174229 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b6741435-9611-4765-a936-da34a14a9a34 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:40.175043 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b6741435-9611-4765-a936-da34a14a9a34 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:40.175991 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b6741435-9611-4765-a936-da34a14a9a34 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:40.176699 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b6741435-9611-4765-a936-da34a14a9a34 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:40.177547 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b6741435-9611-4765-a936-da34a14a9a34 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:40.295741 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=2 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:06:40.666348 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-b6741435-9611-4765-a936-da34a14a9a34 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06443b5728fb4d1e95d6245820e786bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ded993145b4eda9d6a33b994519012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:40.679622 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-b6741435-9611-4765-a936-da34a14a9a34 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "GET /compute/v2.1/servers/e1f1a2d9-92ff-4f2b-8f65-24cee7c6418d" status: 200 len: 1503 microversion: 2.1 time: 0.539280 Oct 08 21:06:40.681507 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1716/3521] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:06:40 2022] GET /compute/v2.1/servers/e1f1a2d9-92ff-4f2b-8f65-24cee7c6418d => generated 1503 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:06:40.696715 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-5035c48b-84c9-4f86-9ef4-5a2721ca7d12 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:06:40.699895 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-5035c48b-84c9-4f86-9ef4-5a2721ca7d12 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] [instance: 4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:06:40.712682 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5035c48b-84c9-4f86-9ef4-5a2721ca7d12 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:40.716375 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5035c48b-84c9-4f86-9ef4-5a2721ca7d12 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:40.717089 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5035c48b-84c9-4f86-9ef4-5a2721ca7d12 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:40.721779 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5035c48b-84c9-4f86-9ef4-5a2721ca7d12 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:40.722778 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5035c48b-84c9-4f86-9ef4-5a2721ca7d12 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:40.725687 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5035c48b-84c9-4f86-9ef4-5a2721ca7d12 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:40.771620 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-ea835bd2-74d9-4632-b625-15ff13cc0a5d tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Flavor limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 21:06:40.772149 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-ea835bd2-74d9-4632-b625-15ff13cc0a5d tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Image limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 21:06:40.772733 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-ea835bd2-74d9-4632-b625-15ff13cc0a5d tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Flavor pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 21:06:40.773400 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-ea835bd2-74d9-4632-b625-15ff13cc0a5d tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Image pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 21:06:40.774013 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-ea835bd2-74d9-4632-b625-15ff13cc0a5d tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 21:06:40.821925 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ea835bd2-74d9-4632-b625-15ff13cc0a5d tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:40.822594 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ea835bd2-74d9-4632-b625-15ff13cc0a5d tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:40.823156 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ea835bd2-74d9-4632-b625-15ff13cc0a5d tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:40.824033 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ea835bd2-74d9-4632-b625-15ff13cc0a5d tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:40.826382 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ea835bd2-74d9-4632-b625-15ff13cc0a5d tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:40.827074 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ea835bd2-74d9-4632-b625-15ff13cc0a5d tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:40.863356 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-ea835bd2-74d9-4632-b625-15ff13cc0a5d tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Getting quotas for project 169293c01bf047358ff870a36c7a1247. Resources: {'cores', 'instances', 'ram'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:06:40.871618 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-ea835bd2-74d9-4632-b625-15ff13cc0a5d tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Getting quotas for user dcad18d0243f492591808197ca3dcc81 and project 169293c01bf047358ff870a36c7a1247. Resources: {'cores', 'instances', 'ram'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:06:40.902439 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-ea835bd2-74d9-4632-b625-15ff13cc0a5d tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Going to run 1 instances... {{(pid=140492) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 21:06:40.905811 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-ea835bd2-74d9-4632-b625-15ff13cc0a5d tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] [instance: ee440f9f-69e9-4d96-bab6-92f73d08b9dd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c508bd7f-7db9-4b2c-af7c-be54a855c355',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140492) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 21:06:41.090163 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-ea835bd2-74d9-4632-b625-15ff13cc0a5d tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Getting quotas for project 169293c01bf047358ff870a36c7a1247. Resources: {'server_group_members'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:06:41.105576 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-ea835bd2-74d9-4632-b625-15ff13cc0a5d tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Getting quotas for user dcad18d0243f492591808197ca3dcc81 and project 169293c01bf047358ff870a36c7a1247. Resources: {'server_group_members'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:06:41.155849 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:INSERT=7,nova_api:SELECT=87,nova_api:DELETE=6 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:06:41.192703 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-ea835bd2-74d9-4632-b625-15ff13cc0a5d tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Getting quotas for project 169293c01bf047358ff870a36c7a1247. Resources: {'server_group_members'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:06:41.204306 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-ea835bd2-74d9-4632-b625-15ff13cc0a5d tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Getting quotas for user dcad18d0243f492591808197ca3dcc81 and project 169293c01bf047358ff870a36c7a1247. Resources: {'server_group_members'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:06:41.253756 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-ea835bd2-74d9-4632-b625-15ff13cc0a5d tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.877376 Oct 08 21:06:41.255383 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1806/3522] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 21:06:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 1879 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 08 21:06:41.266438 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-d6d871d6-0bb9-4d2f-9991-c984b14b5021 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:06:41.268992 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-d6d871d6-0bb9-4d2f-9991-c984b14b5021 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: e1f1a2d9-92ff-4f2b-8f65-24cee7c6418d] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:06:41.279934 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d6d871d6-0bb9-4d2f-9991-c984b14b5021 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:41.280661 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d6d871d6-0bb9-4d2f-9991-c984b14b5021 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:41.282134 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d6d871d6-0bb9-4d2f-9991-c984b14b5021 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:41.283823 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d6d871d6-0bb9-4d2f-9991-c984b14b5021 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:41.284480 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d6d871d6-0bb9-4d2f-9991-c984b14b5021 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:41.285209 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d6d871d6-0bb9-4d2f-9991-c984b14b5021 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:41.911986 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-5035c48b-84c9-4f86-9ef4-5a2721ca7d12 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc2bdd169daf4a1db830b1fa7f94f0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f2d56477794f8ab38b8e3535b3e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:41.935006 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-5035c48b-84c9-4f86-9ef4-5a2721ca7d12 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc2bdd169daf4a1db830b1fa7f94f0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f2d56477794f8ab38b8e3535b3e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:41.940039 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-5035c48b-84c9-4f86-9ef4-5a2721ca7d12 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc2bdd169daf4a1db830b1fa7f94f0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f2d56477794f8ab38b8e3535b3e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:41.942476 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-5035c48b-84c9-4f86-9ef4-5a2721ca7d12 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] 10.222.0.26 "GET /compute/v2.1/servers/4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21" status: 200 len: 1879 microversion: 2.32 time: 1.259657 Oct 08 21:06:41.956746 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1717/3523] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:06:40 2022] GET /compute/v2.1/servers/4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21 => generated 1879 bytes in 1261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:06:41.999942 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-bdb0da2b-2d7f-41fa-bdd1-1d7def46722a tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:06:42.000982 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-bdb0da2b-2d7f-41fa-bdd1-1d7def46722a tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] [instance: dbacaeed-a40b-4e05-9635-5073dfdd8621] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:06:42.002949 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-d6d871d6-0bb9-4d2f-9991-c984b14b5021 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06443b5728fb4d1e95d6245820e786bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ded993145b4eda9d6a33b994519012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:42.011030 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bdb0da2b-2d7f-41fa-bdd1-1d7def46722a tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:42.011920 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bdb0da2b-2d7f-41fa-bdd1-1d7def46722a tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:42.015544 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bdb0da2b-2d7f-41fa-bdd1-1d7def46722a tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:42.017087 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bdb0da2b-2d7f-41fa-bdd1-1d7def46722a tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:42.017899 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bdb0da2b-2d7f-41fa-bdd1-1d7def46722a tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:42.018370 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-d6d871d6-0bb9-4d2f-9991-c984b14b5021 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "GET /compute/v2.1/servers/e1f1a2d9-92ff-4f2b-8f65-24cee7c6418d" status: 200 len: 1503 microversion: 2.1 time: 0.761563 Oct 08 21:06:42.019039 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bdb0da2b-2d7f-41fa-bdd1-1d7def46722a tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:42.019298 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1807/3524] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:06:41 2022] GET /compute/v2.1/servers/e1f1a2d9-92ff-4f2b-8f65-24cee7c6418d => generated 1503 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:06:42.037541 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-a0360fb4-1e9a-43be-a4eb-cc278cf88462 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:06:42.039656 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-a0360fb4-1e9a-43be-a4eb-cc278cf88462 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] [instance: ee440f9f-69e9-4d96-bab6-92f73d08b9dd] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:06:42.268277 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-a0360fb4-1e9a-43be-a4eb-cc278cf88462 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcad18d0243f492591808197ca3dcc81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169293c01bf047358ff870a36c7a1247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:42.281624 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-a0360fb4-1e9a-43be-a4eb-cc278cf88462 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] 10.222.0.26 "GET /compute/v2.1/servers/ee440f9f-69e9-4d96-bab6-92f73d08b9dd" status: 200 len: 1212 microversion: 2.1 time: 0.261007 Oct 08 21:06:42.288552 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1808/3525] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:06:42 2022] GET /compute/v2.1/servers/ee440f9f-69e9-4d96-bab6-92f73d08b9dd => generated 1212 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:06:42.311364 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-6eca5416-d25c-461a-b191-6540a6043846 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:06:42.311975 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-6eca5416-d25c-461a-b191-6540a6043846 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: e1f1a2d9-92ff-4f2b-8f65-24cee7c6418d] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:06:42.326745 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6eca5416-d25c-461a-b191-6540a6043846 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:42.328282 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6eca5416-d25c-461a-b191-6540a6043846 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:42.331087 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6eca5416-d25c-461a-b191-6540a6043846 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:42.332287 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6eca5416-d25c-461a-b191-6540a6043846 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:42.334905 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6eca5416-d25c-461a-b191-6540a6043846 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:42.335770 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6eca5416-d25c-461a-b191-6540a6043846 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:42.424836 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-6eca5416-d25c-461a-b191-6540a6043846 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: e1f1a2d9-92ff-4f2b-8f65-24cee7c6418d] Going to try to terminate instance {{(pid=140492) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 21:06:42.613366 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-6eca5416-d25c-461a-b191-6540a6043846 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "DELETE /compute/v2.1/servers/e1f1a2d9-92ff-4f2b-8f65-24cee7c6418d" status: 204 len: 0 microversion: 2.1 time: 0.320867 Oct 08 21:06:42.614055 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1809/3526] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:06:42 2022] DELETE /compute/v2.1/servers/e1f1a2d9-92ff-4f2b-8f65-24cee7c6418d => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 21:06:42.633826 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-8c6e641e-3d3b-4699-9747-f1950eeb41b5 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:06:42.643896 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8c6e641e-3d3b-4699-9747-f1950eeb41b5 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:42.645632 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8c6e641e-3d3b-4699-9747-f1950eeb41b5 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:42.646873 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8c6e641e-3d3b-4699-9747-f1950eeb41b5 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:42.696823 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-8c6e641e-3d3b-4699-9747-f1950eeb41b5 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] [instance: ce4a2fbf-76f3-4577-a704-3b64ec30d84b] Going to try to stop instance {{(pid=140492) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 08 21:06:42.814721 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-8c6e641e-3d3b-4699-9747-f1950eeb41b5 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] 10.222.0.26 "POST /compute/v2.1/servers/ce4a2fbf-76f3-4577-a704-3b64ec30d84b/action" status: 202 len: 0 microversion: 2.1 time: 0.197201 Oct 08 21:06:42.815996 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1810/3527] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:06:42 2022] POST /compute/v2.1/servers/ce4a2fbf-76f3-4577-a704-3b64ec30d84b/action => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 21:06:42.829839 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-717f6af9-2582-4874-b571-d619b1545f0e tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:06:42.833422 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-717f6af9-2582-4874-b571-d619b1545f0e tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: e1f1a2d9-92ff-4f2b-8f65-24cee7c6418d] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:06:42.844747 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-717f6af9-2582-4874-b571-d619b1545f0e tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:42.858175 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-717f6af9-2582-4874-b571-d619b1545f0e tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:42.858904 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-717f6af9-2582-4874-b571-d619b1545f0e tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:42.859871 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-717f6af9-2582-4874-b571-d619b1545f0e tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:42.860504 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-717f6af9-2582-4874-b571-d619b1545f0e tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:42.861114 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-717f6af9-2582-4874-b571-d619b1545f0e tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:42.962713 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-bdb0da2b-2d7f-41fa-bdd1-1d7def46722a tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:42.977002 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-bdb0da2b-2d7f-41fa-bdd1-1d7def46722a tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:42.979415 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-bdb0da2b-2d7f-41fa-bdd1-1d7def46722a tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:42.991051 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-bdb0da2b-2d7f-41fa-bdd1-1d7def46722a tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] 10.222.0.26 "GET /compute/v2.1/servers/dbacaeed-a40b-4e05-9635-5073dfdd8621" status: 200 len: 1739 microversion: 2.20 time: 0.997693 Oct 08 21:06:43.009980 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1718/3528] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:06:41 2022] GET /compute/v2.1/servers/dbacaeed-a40b-4e05-9635-5073dfdd8621 => generated 1739 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:06:43.022009 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-3c84864b-e4c5-46da-8235-922c3e909cb2 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:06:43.022607 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-3c84864b-e4c5-46da-8235-922c3e909cb2 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] [instance: ce4a2fbf-76f3-4577-a704-3b64ec30d84b] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:06:43.030248 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3c84864b-e4c5-46da-8235-922c3e909cb2 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:43.030910 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3c84864b-e4c5-46da-8235-922c3e909cb2 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:43.031185 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3c84864b-e4c5-46da-8235-922c3e909cb2 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:43.031900 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3c84864b-e4c5-46da-8235-922c3e909cb2 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:43.032480 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3c84864b-e4c5-46da-8235-922c3e909cb2 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:43.032775 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3c84864b-e4c5-46da-8235-922c3e909cb2 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:43.189207 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-717f6af9-2582-4874-b571-d619b1545f0e tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06443b5728fb4d1e95d6245820e786bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ded993145b4eda9d6a33b994519012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:43.207416 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-717f6af9-2582-4874-b571-d619b1545f0e tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "GET /compute/v2.1/servers/e1f1a2d9-92ff-4f2b-8f65-24cee7c6418d" status: 200 len: 1509 microversion: 2.1 time: 0.388919 Oct 08 21:06:43.213986 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1811/3529] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:06:42 2022] GET /compute/v2.1/servers/e1f1a2d9-92ff-4f2b-8f65-24cee7c6418d => generated 1509 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:06:43.229233 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-2c6b4642-cc8a-433c-981a-3da9a9a5b569 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:06:43.229947 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-2c6b4642-cc8a-433c-981a-3da9a9a5b569 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] [instance: 4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:06:43.245981 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2c6b4642-cc8a-433c-981a-3da9a9a5b569 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:43.249050 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2c6b4642-cc8a-433c-981a-3da9a9a5b569 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:43.249568 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2c6b4642-cc8a-433c-981a-3da9a9a5b569 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:43.250396 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2c6b4642-cc8a-433c-981a-3da9a9a5b569 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:43.254335 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2c6b4642-cc8a-433c-981a-3da9a9a5b569 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:43.254984 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2c6b4642-cc8a-433c-981a-3da9a9a5b569 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:43.506132 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-3c84864b-e4c5-46da-8235-922c3e909cb2 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85abb492492343c58734564a2b26c8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68b14967e8249fd886f168d366f241f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:43.518281 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-3c84864b-e4c5-46da-8235-922c3e909cb2 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] 10.222.0.26 "GET /compute/v2.1/servers/ce4a2fbf-76f3-4577-a704-3b64ec30d84b" status: 200 len: 1724 microversion: 2.1 time: 0.507005 Oct 08 21:06:43.542010 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1719/3530] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:06:43 2022] GET /compute/v2.1/servers/ce4a2fbf-76f3-4577-a704-3b64ec30d84b => generated 1724 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:06:43.567694 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-d97f2ea4-6279-4e19-9cdd-62f469eadd6e tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:06:43.570107 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-d97f2ea4-6279-4e19-9cdd-62f469eadd6e tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] [instance: ee440f9f-69e9-4d96-bab6-92f73d08b9dd] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:06:43.589148 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d97f2ea4-6279-4e19-9cdd-62f469eadd6e tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:43.590008 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d97f2ea4-6279-4e19-9cdd-62f469eadd6e tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:43.591039 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d97f2ea4-6279-4e19-9cdd-62f469eadd6e tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:43.591902 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d97f2ea4-6279-4e19-9cdd-62f469eadd6e tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:43.592427 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d97f2ea4-6279-4e19-9cdd-62f469eadd6e tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:43.592947 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d97f2ea4-6279-4e19-9cdd-62f469eadd6e tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:43.795974 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-d97f2ea4-6279-4e19-9cdd-62f469eadd6e tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcad18d0243f492591808197ca3dcc81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169293c01bf047358ff870a36c7a1247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:43.811274 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-d97f2ea4-6279-4e19-9cdd-62f469eadd6e tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] 10.222.0.26 "GET /compute/v2.1/servers/ee440f9f-69e9-4d96-bab6-92f73d08b9dd" status: 200 len: 1264 microversion: 2.1 time: 0.267930 Oct 08 21:06:43.815728 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1720/3531] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:06:43 2022] GET /compute/v2.1/servers/ee440f9f-69e9-4d96-bab6-92f73d08b9dd => generated 1264 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:06:43.963347 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-2c6b4642-cc8a-433c-981a-3da9a9a5b569 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc2bdd169daf4a1db830b1fa7f94f0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f2d56477794f8ab38b8e3535b3e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:43.976987 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-2c6b4642-cc8a-433c-981a-3da9a9a5b569 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc2bdd169daf4a1db830b1fa7f94f0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f2d56477794f8ab38b8e3535b3e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:43.979102 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-2c6b4642-cc8a-433c-981a-3da9a9a5b569 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc2bdd169daf4a1db830b1fa7f94f0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f2d56477794f8ab38b8e3535b3e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:43.980544 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-2c6b4642-cc8a-433c-981a-3da9a9a5b569 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] 10.222.0.26 "GET /compute/v2.1/servers/4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21" status: 200 len: 1879 microversion: 2.32 time: 0.763722 Oct 08 21:06:43.981650 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1812/3532] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:06:43 2022] GET /compute/v2.1/servers/4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21 => generated 1879 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:06:44.023430 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-75524f24-6e1f-4540-a1b7-eb1dee83417b tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:06:44.026004 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-75524f24-6e1f-4540-a1b7-eb1dee83417b tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] [instance: dbacaeed-a40b-4e05-9635-5073dfdd8621] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:06:44.036044 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-75524f24-6e1f-4540-a1b7-eb1dee83417b tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:44.037753 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-75524f24-6e1f-4540-a1b7-eb1dee83417b tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:44.038430 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-75524f24-6e1f-4540-a1b7-eb1dee83417b tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:44.040461 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-75524f24-6e1f-4540-a1b7-eb1dee83417b tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:44.041280 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-75524f24-6e1f-4540-a1b7-eb1dee83417b tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:44.041971 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-75524f24-6e1f-4540-a1b7-eb1dee83417b tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:44.241662 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-688bd8c6-739a-4a46-b701-f046018b12bc tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:06:44.242304 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-688bd8c6-739a-4a46-b701-f046018b12bc tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: e1f1a2d9-92ff-4f2b-8f65-24cee7c6418d] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:06:44.253853 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-688bd8c6-739a-4a46-b701-f046018b12bc tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:44.256055 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-688bd8c6-739a-4a46-b701-f046018b12bc tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:44.256657 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-688bd8c6-739a-4a46-b701-f046018b12bc tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:44.260861 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-688bd8c6-739a-4a46-b701-f046018b12bc tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:44.261467 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-688bd8c6-739a-4a46-b701-f046018b12bc tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:44.261982 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-688bd8c6-739a-4a46-b701-f046018b12bc tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:44.615274 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-75524f24-6e1f-4540-a1b7-eb1dee83417b tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:44.629662 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-75524f24-6e1f-4540-a1b7-eb1dee83417b tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:44.631533 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-75524f24-6e1f-4540-a1b7-eb1dee83417b tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:44.634979 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-75524f24-6e1f-4540-a1b7-eb1dee83417b tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] 10.222.0.26 "GET /compute/v2.1/servers/dbacaeed-a40b-4e05-9635-5073dfdd8621" status: 200 len: 1739 microversion: 2.20 time: 0.615506 Oct 08 21:06:44.639358 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1721/3533] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:06:44 2022] GET /compute/v2.1/servers/dbacaeed-a40b-4e05-9635-5073dfdd8621 => generated 1739 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:06:44.655777 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-6e3c29de-d7b4-4ba0-916d-ca3b90d0c60f tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:06:44.657170 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-6e3c29de-d7b4-4ba0-916d-ca3b90d0c60f tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] [instance: ce4a2fbf-76f3-4577-a704-3b64ec30d84b] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:06:44.669353 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6e3c29de-d7b4-4ba0-916d-ca3b90d0c60f tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:44.673465 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6e3c29de-d7b4-4ba0-916d-ca3b90d0c60f tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:44.674135 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6e3c29de-d7b4-4ba0-916d-ca3b90d0c60f tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:44.676885 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6e3c29de-d7b4-4ba0-916d-ca3b90d0c60f tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:44.677950 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6e3c29de-d7b4-4ba0-916d-ca3b90d0c60f tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:44.678610 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6e3c29de-d7b4-4ba0-916d-ca3b90d0c60f tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:44.725797 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=100 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:06:45.146364 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-6e3c29de-d7b4-4ba0-916d-ca3b90d0c60f tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85abb492492343c58734564a2b26c8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68b14967e8249fd886f168d366f241f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:45.165827 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-6e3c29de-d7b4-4ba0-916d-ca3b90d0c60f tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] 10.222.0.26 "GET /compute/v2.1/servers/ce4a2fbf-76f3-4577-a704-3b64ec30d84b" status: 200 len: 1724 microversion: 2.1 time: 0.523015 Oct 08 21:06:45.167435 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1722/3534] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:06:44 2022] GET /compute/v2.1/servers/ce4a2fbf-76f3-4577-a704-3b64ec30d84b => generated 1724 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:06:45.187870 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-9a7d15c7-8a86-46c1-940d-257e15dcf55e tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:06:45.191294 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-9a7d15c7-8a86-46c1-940d-257e15dcf55e tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] [instance: ee440f9f-69e9-4d96-bab6-92f73d08b9dd] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:06:45.213156 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9a7d15c7-8a86-46c1-940d-257e15dcf55e tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:45.213719 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9a7d15c7-8a86-46c1-940d-257e15dcf55e tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:45.214181 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9a7d15c7-8a86-46c1-940d-257e15dcf55e tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:45.219617 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9a7d15c7-8a86-46c1-940d-257e15dcf55e tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:45.220580 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9a7d15c7-8a86-46c1-940d-257e15dcf55e tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:45.221211 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9a7d15c7-8a86-46c1-940d-257e15dcf55e tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:45.630119 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-9a7d15c7-8a86-46c1-940d-257e15dcf55e tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcad18d0243f492591808197ca3dcc81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169293c01bf047358ff870a36c7a1247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:45.641907 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-9a7d15c7-8a86-46c1-940d-257e15dcf55e tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] 10.222.0.26 "GET /compute/v2.1/servers/ee440f9f-69e9-4d96-bab6-92f73d08b9dd" status: 200 len: 1272 microversion: 2.1 time: 0.471334 Oct 08 21:06:45.644483 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1723/3535] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:06:45 2022] GET /compute/v2.1/servers/ee440f9f-69e9-4d96-bab6-92f73d08b9dd => generated 1272 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:06:45.663112 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-48e67106-8e6b-4f3e-bd92-3926ddf5fe27 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:06:45.663754 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-48e67106-8e6b-4f3e-bd92-3926ddf5fe27 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] [instance: 4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:06:45.670848 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-48e67106-8e6b-4f3e-bd92-3926ddf5fe27 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:45.671267 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-48e67106-8e6b-4f3e-bd92-3926ddf5fe27 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:45.671706 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-48e67106-8e6b-4f3e-bd92-3926ddf5fe27 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:45.681601 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-48e67106-8e6b-4f3e-bd92-3926ddf5fe27 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:45.682116 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-48e67106-8e6b-4f3e-bd92-3926ddf5fe27 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:45.682569 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-48e67106-8e6b-4f3e-bd92-3926ddf5fe27 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:45.716728 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-688bd8c6-739a-4a46-b701-f046018b12bc tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06443b5728fb4d1e95d6245820e786bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ded993145b4eda9d6a33b994519012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:45.737819 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-688bd8c6-739a-4a46-b701-f046018b12bc tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "GET /compute/v2.1/servers/e1f1a2d9-92ff-4f2b-8f65-24cee7c6418d" status: 200 len: 1509 microversion: 2.1 time: 1.497133 Oct 08 21:06:45.787616 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1813/3536] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:06:44 2022] GET /compute/v2.1/servers/e1f1a2d9-92ff-4f2b-8f65-24cee7c6418d => generated 1509 bytes in 1551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:06:45.805157 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-86f870a4-9ecc-4820-a6dc-a0735aa222f2 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:06:45.809957 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-86f870a4-9ecc-4820-a6dc-a0735aa222f2 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] [instance: dbacaeed-a40b-4e05-9635-5073dfdd8621] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:06:45.847368 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-86f870a4-9ecc-4820-a6dc-a0735aa222f2 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:45.850813 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-86f870a4-9ecc-4820-a6dc-a0735aa222f2 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:45.851512 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-86f870a4-9ecc-4820-a6dc-a0735aa222f2 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:45.852505 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-86f870a4-9ecc-4820-a6dc-a0735aa222f2 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:45.857215 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-86f870a4-9ecc-4820-a6dc-a0735aa222f2 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:45.857876 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-86f870a4-9ecc-4820-a6dc-a0735aa222f2 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:46.332911 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-48e67106-8e6b-4f3e-bd92-3926ddf5fe27 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc2bdd169daf4a1db830b1fa7f94f0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f2d56477794f8ab38b8e3535b3e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:46.351110 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-48e67106-8e6b-4f3e-bd92-3926ddf5fe27 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc2bdd169daf4a1db830b1fa7f94f0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f2d56477794f8ab38b8e3535b3e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:46.355165 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-48e67106-8e6b-4f3e-bd92-3926ddf5fe27 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc2bdd169daf4a1db830b1fa7f94f0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f2d56477794f8ab38b8e3535b3e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:46.356415 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-48e67106-8e6b-4f3e-bd92-3926ddf5fe27 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] 10.222.0.26 "GET /compute/v2.1/servers/4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21" status: 200 len: 1879 microversion: 2.32 time: 0.711111 Oct 08 21:06:46.376229 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-86f870a4-9ecc-4820-a6dc-a0735aa222f2 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:46.377599 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1724/3537] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:06:45 2022] GET /compute/v2.1/servers/4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21 => generated 1879 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:06:46.388246 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-86f870a4-9ecc-4820-a6dc-a0735aa222f2 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:46.389038 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-888fe216-26a8-47ed-9b21-3ea4ec868ec6 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:06:46.389593 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-888fe216-26a8-47ed-9b21-3ea4ec868ec6 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] [instance: ce4a2fbf-76f3-4577-a704-3b64ec30d84b] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:06:46.394584 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-86f870a4-9ecc-4820-a6dc-a0735aa222f2 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:46.395814 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-86f870a4-9ecc-4820-a6dc-a0735aa222f2 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] 10.222.0.26 "GET /compute/v2.1/servers/dbacaeed-a40b-4e05-9635-5073dfdd8621" status: 200 len: 1739 microversion: 2.20 time: 0.606358 Oct 08 21:06:46.409231 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-888fe216-26a8-47ed-9b21-3ea4ec868ec6 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:46.410645 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1814/3538] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:06:45 2022] GET /compute/v2.1/servers/dbacaeed-a40b-4e05-9635-5073dfdd8621 => generated 1739 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:06:46.413291 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-888fe216-26a8-47ed-9b21-3ea4ec868ec6 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:46.414841 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-888fe216-26a8-47ed-9b21-3ea4ec868ec6 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:46.418842 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-888fe216-26a8-47ed-9b21-3ea4ec868ec6 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:46.420555 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-888fe216-26a8-47ed-9b21-3ea4ec868ec6 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:46.421838 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-888fe216-26a8-47ed-9b21-3ea4ec868ec6 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:46.671986 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-ff5f9fd0-e537-420a-ad1d-693f2532ee59 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:06:46.673179 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-ff5f9fd0-e537-420a-ad1d-693f2532ee59 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] [instance: ee440f9f-69e9-4d96-bab6-92f73d08b9dd] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:06:46.684818 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ff5f9fd0-e537-420a-ad1d-693f2532ee59 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:46.690204 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ff5f9fd0-e537-420a-ad1d-693f2532ee59 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:46.691053 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ff5f9fd0-e537-420a-ad1d-693f2532ee59 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:46.693732 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ff5f9fd0-e537-420a-ad1d-693f2532ee59 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:46.694408 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ff5f9fd0-e537-420a-ad1d-693f2532ee59 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:46.702264 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ff5f9fd0-e537-420a-ad1d-693f2532ee59 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:46.893436 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-ff5f9fd0-e537-420a-ad1d-693f2532ee59 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcad18d0243f492591808197ca3dcc81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169293c01bf047358ff870a36c7a1247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:46.903513 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-ff5f9fd0-e537-420a-ad1d-693f2532ee59 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] 10.222.0.26 "GET /compute/v2.1/servers/ee440f9f-69e9-4d96-bab6-92f73d08b9dd" status: 200 len: 1270 microversion: 2.1 time: 0.235407 Oct 08 21:06:46.912377 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1815/3539] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:06:46 2022] GET /compute/v2.1/servers/ee440f9f-69e9-4d96-bab6-92f73d08b9dd => generated 1270 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:06:46.933397 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e853bc52-5ee4-4465-9aef-2db94a535431 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:06:46.934993 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-e853bc52-5ee4-4465-9aef-2db94a535431 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: e1f1a2d9-92ff-4f2b-8f65-24cee7c6418d] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:06:46.962202 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e853bc52-5ee4-4465-9aef-2db94a535431 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:46.974664 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e853bc52-5ee4-4465-9aef-2db94a535431 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:46.977158 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e853bc52-5ee4-4465-9aef-2db94a535431 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:46.984630 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e853bc52-5ee4-4465-9aef-2db94a535431 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:46.985526 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e853bc52-5ee4-4465-9aef-2db94a535431 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:46.988661 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e853bc52-5ee4-4465-9aef-2db94a535431 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:47.009022 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-888fe216-26a8-47ed-9b21-3ea4ec868ec6 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85abb492492343c58734564a2b26c8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68b14967e8249fd886f168d366f241f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:47.041592 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-888fe216-26a8-47ed-9b21-3ea4ec868ec6 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] 10.222.0.26 "GET /compute/v2.1/servers/ce4a2fbf-76f3-4577-a704-3b64ec30d84b" status: 200 len: 1724 microversion: 2.1 time: 0.655065 Oct 08 21:06:47.046494 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1725/3540] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:06:46 2022] GET /compute/v2.1/servers/ce4a2fbf-76f3-4577-a704-3b64ec30d84b => generated 1724 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:06:47.079108 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-27bf1f71-c928-44d8-961f-e7ddabda9e2d req-7c26d041-51a1-4c5e-abcc-82b86f265c18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1f1a2d9-92ff-4f2b-8f65-24cee7c6418d", "name": "network-vif-deleted", "tag": "93a61fbf-d7d9-4ab4-b56a-97c0bdc56d8e"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:06:47.087518 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e853bc52-5ee4-4465-9aef-2db94a535431 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:47.088231 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e853bc52-5ee4-4465-9aef-2db94a535431 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:47.089035 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e853bc52-5ee4-4465-9aef-2db94a535431 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:47.090070 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.objects.instance [None req-e853bc52-5ee4-4465-9aef-2db94a535431 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lazy-loading 'fault' on Instance uuid e1f1a2d9-92ff-4f2b-8f65-24cee7c6418d {{(pid=140492) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 21:06:47.107710 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:06:47.118266 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-27bf1f71-c928-44d8-961f-e7ddabda9e2d req-7c26d041-51a1-4c5e-abcc-82b86f265c18 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:47.119152 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-27bf1f71-c928-44d8-961f-e7ddabda9e2d req-7c26d041-51a1-4c5e-abcc-82b86f265c18 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:47.125635 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-27bf1f71-c928-44d8-961f-e7ddabda9e2d req-7c26d041-51a1-4c5e-abcc-82b86f265c18 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:47.155087 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-27bf1f71-c928-44d8-961f-e7ddabda9e2d req-7c26d041-51a1-4c5e-abcc-82b86f265c18 service nova] Creating event network-vif-deleted:93a61fbf-d7d9-4ab4-b56a-97c0bdc56d8e for instance e1f1a2d9-92ff-4f2b-8f65-24cee7c6418d on nch2-master-1 Oct 08 21:06:47.161953 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-27bf1f71-c928-44d8-961f-e7ddabda9e2d req-7c26d041-51a1-4c5e-abcc-82b86f265c18 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109787 Oct 08 21:06:47.165518 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1726/3541] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:06:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:06:47.246531 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-e853bc52-5ee4-4465-9aef-2db94a535431 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06443b5728fb4d1e95d6245820e786bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ded993145b4eda9d6a33b994519012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:47.282694 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-e853bc52-5ee4-4465-9aef-2db94a535431 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "GET /compute/v2.1/servers/e1f1a2d9-92ff-4f2b-8f65-24cee7c6418d" status: 200 len: 1311 microversion: 2.1 time: 0.367708 Oct 08 21:06:47.293509 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1816/3542] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:06:46 2022] GET /compute/v2.1/servers/e1f1a2d9-92ff-4f2b-8f65-24cee7c6418d => generated 1311 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:06:47.391798 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-4ff129ce-1b23-4ade-8ce6-4401fc994cdc tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:06:47.393240 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-4ff129ce-1b23-4ade-8ce6-4401fc994cdc tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] [instance: 4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:06:47.408974 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4ff129ce-1b23-4ade-8ce6-4401fc994cdc tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:47.409511 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4ff129ce-1b23-4ade-8ce6-4401fc994cdc tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:47.409964 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4ff129ce-1b23-4ade-8ce6-4401fc994cdc tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:47.410699 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4ff129ce-1b23-4ade-8ce6-4401fc994cdc tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:47.411166 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4ff129ce-1b23-4ade-8ce6-4401fc994cdc tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:47.411604 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4ff129ce-1b23-4ade-8ce6-4401fc994cdc tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:47.428325 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-11dbc709-f1df-4b64-b27c-18fdb4a08cbf tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:06:47.429571 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-11dbc709-f1df-4b64-b27c-18fdb4a08cbf tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] [instance: dbacaeed-a40b-4e05-9635-5073dfdd8621] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:06:47.441129 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-11dbc709-f1df-4b64-b27c-18fdb4a08cbf tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:47.443372 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-11dbc709-f1df-4b64-b27c-18fdb4a08cbf tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:47.443928 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-11dbc709-f1df-4b64-b27c-18fdb4a08cbf tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:47.445060 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-11dbc709-f1df-4b64-b27c-18fdb4a08cbf tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:47.447655 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-11dbc709-f1df-4b64-b27c-18fdb4a08cbf tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:47.448262 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-11dbc709-f1df-4b64-b27c-18fdb4a08cbf tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:47.683360 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-11dbc709-f1df-4b64-b27c-18fdb4a08cbf tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:47.700881 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-11dbc709-f1df-4b64-b27c-18fdb4a08cbf tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:47.703997 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-11dbc709-f1df-4b64-b27c-18fdb4a08cbf tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:47.706490 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-11dbc709-f1df-4b64-b27c-18fdb4a08cbf tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] 10.222.0.26 "GET /compute/v2.1/servers/dbacaeed-a40b-4e05-9635-5073dfdd8621" status: 200 len: 1739 microversion: 2.20 time: 0.283561 Oct 08 21:06:47.709638 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1817/3543] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:06:47 2022] GET /compute/v2.1/servers/dbacaeed-a40b-4e05-9635-5073dfdd8621 => generated 1739 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 08 21:06:47.937742 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-f053049c-728f-434d-a2e2-72d00824eb1d tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:06:47.939215 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-f053049c-728f-434d-a2e2-72d00824eb1d tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] [instance: ee440f9f-69e9-4d96-bab6-92f73d08b9dd] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:06:47.941827 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=64 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:06:47.958509 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f053049c-728f-434d-a2e2-72d00824eb1d tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:47.959024 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f053049c-728f-434d-a2e2-72d00824eb1d tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:47.959475 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f053049c-728f-434d-a2e2-72d00824eb1d tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:47.960210 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f053049c-728f-434d-a2e2-72d00824eb1d tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:47.960682 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f053049c-728f-434d-a2e2-72d00824eb1d tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:47.961123 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f053049c-728f-434d-a2e2-72d00824eb1d tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:48.317112 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-4ff129ce-1b23-4ade-8ce6-4401fc994cdc tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc2bdd169daf4a1db830b1fa7f94f0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f2d56477794f8ab38b8e3535b3e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:48.338823 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-4ff129ce-1b23-4ade-8ce6-4401fc994cdc tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc2bdd169daf4a1db830b1fa7f94f0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f2d56477794f8ab38b8e3535b3e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:48.346647 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-4ff129ce-1b23-4ade-8ce6-4401fc994cdc tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc2bdd169daf4a1db830b1fa7f94f0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f2d56477794f8ab38b8e3535b3e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:48.354351 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-4ff129ce-1b23-4ade-8ce6-4401fc994cdc tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] 10.222.0.26 "GET /compute/v2.1/servers/4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21" status: 200 len: 1879 microversion: 2.32 time: 0.967648 Oct 08 21:06:48.358244 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1727/3544] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:06:47 2022] GET /compute/v2.1/servers/4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21 => generated 1879 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:06:48.373221 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-7cbc65c4-cd07-4520-9c4a-14e34ca14310 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:06:48.375740 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-7cbc65c4-cd07-4520-9c4a-14e34ca14310 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] [instance: ce4a2fbf-76f3-4577-a704-3b64ec30d84b] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:06:48.398718 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7cbc65c4-cd07-4520-9c4a-14e34ca14310 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:48.402871 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7cbc65c4-cd07-4520-9c4a-14e34ca14310 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:48.412640 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7cbc65c4-cd07-4520-9c4a-14e34ca14310 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:48.417361 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7cbc65c4-cd07-4520-9c4a-14e34ca14310 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:48.423641 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7cbc65c4-cd07-4520-9c4a-14e34ca14310 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:48.427838 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7cbc65c4-cd07-4520-9c4a-14e34ca14310 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:48.652028 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-f053049c-728f-434d-a2e2-72d00824eb1d tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcad18d0243f492591808197ca3dcc81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169293c01bf047358ff870a36c7a1247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:48.668961 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-f053049c-728f-434d-a2e2-72d00824eb1d tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] 10.222.0.26 "GET /compute/v2.1/servers/ee440f9f-69e9-4d96-bab6-92f73d08b9dd" status: 200 len: 1312 microversion: 2.1 time: 0.736321 Oct 08 21:06:48.670532 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1818/3545] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:06:47 2022] GET /compute/v2.1/servers/ee440f9f-69e9-4d96-bab6-92f73d08b9dd => generated 1312 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:06:48.690747 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-200af245-f046-40aa-a78b-bfb21391ea88 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:06:48.694174 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-200af245-f046-40aa-a78b-bfb21391ea88 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: e1f1a2d9-92ff-4f2b-8f65-24cee7c6418d] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:06:48.715603 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-200af245-f046-40aa-a78b-bfb21391ea88 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:48.717072 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-200af245-f046-40aa-a78b-bfb21391ea88 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:48.717797 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-200af245-f046-40aa-a78b-bfb21391ea88 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:48.719521 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-200af245-f046-40aa-a78b-bfb21391ea88 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:48.721831 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-200af245-f046-40aa-a78b-bfb21391ea88 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:48.731602 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-200af245-f046-40aa-a78b-bfb21391ea88 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:48.771583 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-200af245-f046-40aa-a78b-bfb21391ea88 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] HTTP exception thrown: Instance e1f1a2d9-92ff-4f2b-8f65-24cee7c6418d could not be found. Oct 08 21:06:48.785011 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-200af245-f046-40aa-a78b-bfb21391ea88 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Request method failure captured: Oct 08 21:06:48.785011 ncdv-master-1 devstack@n-api.service[140492]: request: GET /compute/v2.1/servers/e1f1a2d9-92ff-4f2b-8f65-24cee7c6418d HTTP/1.1 Oct 08 21:06:48.785011 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:06:48.785011 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:06:48.785011 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:06:48.785011 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 21:06:48.785011 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:06:48.785011 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:06:48.785011 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:06:48.785011 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:06:48.785011 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeYsdf-NgsPUaUb78CUpk0vq18mlUqdb1er-CKgSGnwcxKYVDw5Br5ObGheB0PHKIrwGHgJ4op59IUcxCd3ChQqclxeYxKhK3ZwkXmw1AwIGXWjgktrsk6DH6ba1NMLmZ1pzBqcyvzB3CMIuC4HBXIHDILjU44EobGpdQQ8lNmKdDFM Oct 08 21:06:48.785011 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:06:48.785011 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:06:48.785011 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:06:48.785011 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:06:48.785011 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:06:48.785011 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:06:48.785011 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: e7ded993145b4eda9d6a33b994519012 Oct 08 21:06:48.785011 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-ServersTestJSON-68907085 Oct 08 21:06:48.785011 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:06:48.785011 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:06:48.785011 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/e7ded993145b4eda9d6a33b994519012"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e7ded993145b4eda9d6a33b994519012"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_e7ded993145b4eda9d6a33b994519012"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e7ded993145b4eda9d6a33b994519012"}]}] Oct 08 21:06:48.785011 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-ServersTestJSON-68907085 Oct 08 21:06:48.785011 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: e7ded993145b4eda9d6a33b994519012 Oct 08 21:06:48.785011 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-ServersTestJSON-68907085 Oct 08 21:06:48.785011 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-ServersTestJSON-68907085-project Oct 08 21:06:48.785011 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:06:48.785011 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:06:48.785011 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 06443b5728fb4d1e95d6245820e786bf Oct 08 21:06:48.785011 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-ServersTestJSON-68907085-project Oct 08 21:06:48.785011 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 21:06:48.785011 ncdv-master-1 devstack@n-api.service[140492]: exception: Instance e1f1a2d9-92ff-4f2b-8f65-24cee7c6418d could not be found. Oct 08 21:06:48.785011 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': 'e1f1a2d9-92ff-4f2b-8f65-24cee7c6418d'} Oct 08 21:06:48.785011 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:06:48.785011 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:06:48.785011 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:06:48.785011 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:06:48.785011 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:06:48.785011 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:06:48.785011 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:06:48.785011 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:06:48.785011 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:06:48.785011 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:06:48.785011 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1f1a2d9-92ff-4f2b-8f65-24cee7c6418d could not be found. Oct 08 21:06:48.785011 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:06:48.785011 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:06:48.785011 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:06:48.785011 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:06:48.785011 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:06:48.785011 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:06:48.785011 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:06:48.785011 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:06:48.785011 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:06:48.785011 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:06:48.785011 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:06:48.785011 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:06:48.785011 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:06:48.785011 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:06:48.785011 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:06:48.785011 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:06:48.785011 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1f1a2d9-92ff-4f2b-8f65-24cee7c6418d could not be found. Oct 08 21:06:48.785011 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:06:48.785011 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:06:48.785011 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:06:48.785011 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:06:48.790857 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:06:48.790857 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:06:48.790857 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:06:48.790857 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:06:48.790857 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1f1a2d9-92ff-4f2b-8f65-24cee7c6418d could not be found. Oct 08 21:06:48.790857 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:06:48.793097 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-200af245-f046-40aa-a78b-bfb21391ea88 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Returning 404 to user: Instance e1f1a2d9-92ff-4f2b-8f65-24cee7c6418d could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:06:48.794273 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-200af245-f046-40aa-a78b-bfb21391ea88 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "GET /compute/v2.1/servers/e1f1a2d9-92ff-4f2b-8f65-24cee7c6418d" status: 404 len: 111 microversion: 2.1 time: 0.120586 Oct 08 21:06:48.795102 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1819/3546] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:06:48 2022] GET /compute/v2.1/servers/e1f1a2d9-92ff-4f2b-8f65-24cee7c6418d => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:06:48.809090 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-189f66a8-c21a-4bb0-b4e8-e20eccf36693 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:06:48.811215 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-189f66a8-c21a-4bb0-b4e8-e20eccf36693 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] [instance: dbacaeed-a40b-4e05-9635-5073dfdd8621] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:06:48.834143 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-189f66a8-c21a-4bb0-b4e8-e20eccf36693 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:48.835060 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-189f66a8-c21a-4bb0-b4e8-e20eccf36693 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:48.837718 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-189f66a8-c21a-4bb0-b4e8-e20eccf36693 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:48.842640 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-189f66a8-c21a-4bb0-b4e8-e20eccf36693 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:48.843869 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-189f66a8-c21a-4bb0-b4e8-e20eccf36693 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:48.844521 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-189f66a8-c21a-4bb0-b4e8-e20eccf36693 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:49.579539 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-7cbc65c4-cd07-4520-9c4a-14e34ca14310 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85abb492492343c58734564a2b26c8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68b14967e8249fd886f168d366f241f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:49.594335 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-7cbc65c4-cd07-4520-9c4a-14e34ca14310 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] 10.222.0.26 "GET /compute/v2.1/servers/ce4a2fbf-76f3-4577-a704-3b64ec30d84b" status: 200 len: 1724 microversion: 2.1 time: 1.234770 Oct 08 21:06:49.600822 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-189f66a8-c21a-4bb0-b4e8-e20eccf36693 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:49.606741 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1728/3547] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:06:48 2022] GET /compute/v2.1/servers/ce4a2fbf-76f3-4577-a704-3b64ec30d84b => generated 1724 bytes in 1248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:06:49.613795 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-189f66a8-c21a-4bb0-b4e8-e20eccf36693 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:49.620101 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-189f66a8-c21a-4bb0-b4e8-e20eccf36693 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:49.621886 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-189f66a8-c21a-4bb0-b4e8-e20eccf36693 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] 10.222.0.26 "GET /compute/v2.1/servers/dbacaeed-a40b-4e05-9635-5073dfdd8621" status: 200 len: 1739 microversion: 2.20 time: 0.824147 Oct 08 21:06:49.629160 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-37e36ffd-1a16-4fa0-8e6b-a7e6b3c771c7 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Action: 'create', calling method: .version_select at 0x7f1a87717c10>, body: {"keypair": {"name": "tempest-key-849184593", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ7qnZE/exVuGi25Z8VJHkh4saweZEYdPqOJvGu66wIsuUNM06gZzVVhEv91nJDkiQAc7JiACA8nuM4nFYtMvHAqeer4yYKmi2XhUrbf3V6O7t4ViLXM9K9DKjLubKg/dA=="}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:06:49.634385 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1820/3548] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:06:48 2022] GET /compute/v2.1/servers/dbacaeed-a40b-4e05-9635-5073dfdd8621 => generated 1739 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:06:49.639814 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e7a1a4a9-c991-4eb7-8426-19430feee33b tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:06:49.640436 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-e7a1a4a9-c991-4eb7-8426-19430feee33b tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] [instance: 4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:06:49.658556 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e7a1a4a9-c991-4eb7-8426-19430feee33b tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:49.659249 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e7a1a4a9-c991-4eb7-8426-19430feee33b tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:49.659702 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e7a1a4a9-c991-4eb7-8426-19430feee33b tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:49.661085 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e7a1a4a9-c991-4eb7-8426-19430feee33b tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:49.661602 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e7a1a4a9-c991-4eb7-8426-19430feee33b tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:49.662046 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e7a1a4a9-c991-4eb7-8426-19430feee33b tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:49.678143 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-37e36ffd-1a16-4fa0-8e6b-a7e6b3c771c7 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Getting quotas for project e7ded993145b4eda9d6a33b994519012. Resources: {'key_pairs'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:06:49.699569 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-37e36ffd-1a16-4fa0-8e6b-a7e6b3c771c7 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Getting quotas for user 06443b5728fb4d1e95d6245820e786bf and project e7ded993145b4eda9d6a33b994519012. Resources: {'key_pairs'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:06:49.768957 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-37e36ffd-1a16-4fa0-8e6b-a7e6b3c771c7 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 381 microversion: 2.1 time: 0.158740 Oct 08 21:06:49.770185 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1729/3549] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Oct 8 21:06:49 2022] POST /compute/v2.1/os-keypairs => generated 381 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:06:49.775118 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-39e20b3f-dfe5-42a4-93a4-fd8713eeb265 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:06:49.776050 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-39e20b3f-dfe5-42a4-93a4-fd8713eeb265 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] [instance: ee440f9f-69e9-4d96-bab6-92f73d08b9dd] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:06:49.793180 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-39e20b3f-dfe5-42a4-93a4-fd8713eeb265 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:49.794088 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-39e20b3f-dfe5-42a4-93a4-fd8713eeb265 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:49.794808 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-39e20b3f-dfe5-42a4-93a4-fd8713eeb265 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:49.796296 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-39e20b3f-dfe5-42a4-93a4-fd8713eeb265 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:49.797030 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-39e20b3f-dfe5-42a4-93a4-fd8713eeb265 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:49.797725 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-39e20b3f-dfe5-42a4-93a4-fd8713eeb265 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:50.127105 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-e7a1a4a9-c991-4eb7-8426-19430feee33b tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc2bdd169daf4a1db830b1fa7f94f0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f2d56477794f8ab38b8e3535b3e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:50.137329 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-39e20b3f-dfe5-42a4-93a4-fd8713eeb265 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcad18d0243f492591808197ca3dcc81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169293c01bf047358ff870a36c7a1247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:50.147243 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-39e20b3f-dfe5-42a4-93a4-fd8713eeb265 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] 10.222.0.26 "GET /compute/v2.1/servers/ee440f9f-69e9-4d96-bab6-92f73d08b9dd" status: 200 len: 1312 microversion: 2.1 time: 0.375710 Oct 08 21:06:50.147847 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-e7a1a4a9-c991-4eb7-8426-19430feee33b tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc2bdd169daf4a1db830b1fa7f94f0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f2d56477794f8ab38b8e3535b3e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:50.151350 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1730/3550] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:06:49 2022] GET /compute/v2.1/servers/ee440f9f-69e9-4d96-bab6-92f73d08b9dd => generated 1312 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:06:50.154895 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-e7a1a4a9-c991-4eb7-8426-19430feee33b tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc2bdd169daf4a1db830b1fa7f94f0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f2d56477794f8ab38b8e3535b3e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:50.160496 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-e7a1a4a9-c991-4eb7-8426-19430feee33b tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] 10.222.0.26 "GET /compute/v2.1/servers/4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21" status: 200 len: 1879 microversion: 2.32 time: 0.524050 Oct 08 21:06:50.161116 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1821/3551] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:06:49 2022] GET /compute/v2.1/servers/4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21 => generated 1879 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:06:50.162869 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-44be2acc-e8d7-44b9-aa64-fd182da45111 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '.version_select at 0x7f1a877678b0>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:06:50.177462 ncdv-master-1 devstack@n-api.service[140491]: WARNING oslo_db.sqlalchemy.utils [None req-44be2acc-e8d7-44b9-aa64-fd182da45111 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 08 21:06:50.191584 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-44be2acc-e8d7-44b9-aa64-fd182da45111 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "GET /compute/v2.1/os-keypairs" status: 200 len: 350 microversion: 2.1 time: 0.038012 Oct 08 21:06:50.192502 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1731/3552] 10.222.0.26 () {58 vars in 1137 bytes} [Sat Oct 8 21:06:50 2022] GET /compute/v2.1/os-keypairs => generated 350 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:06:50.351337 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-63e9ffff-c793-4aaa-a334-1e67d13a29f3 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-732040994", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "key_name": "tempest-key-849184593", "networks": [{"uuid": "983c5654-1828-48da-a871-2028e691f4b0"}]}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:06:50.489624 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.network.neutron [None req-63e9ffff-c793-4aaa-a334-1e67d13a29f3 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] validate_networks() for [('983c5654-1828-48da-a871-2028e691f4b0', None, None, None, None, None)] {{(pid=140492) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 21:06:50.632731 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-23460760-9f33-4d7f-ac3f-bd1b5a9438c1 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:06:50.634061 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-23460760-9f33-4d7f-ac3f-bd1b5a9438c1 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] [instance: ce4a2fbf-76f3-4577-a704-3b64ec30d84b] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:06:50.642054 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-23460760-9f33-4d7f-ac3f-bd1b5a9438c1 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:50.642822 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-23460760-9f33-4d7f-ac3f-bd1b5a9438c1 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:50.643464 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-23460760-9f33-4d7f-ac3f-bd1b5a9438c1 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:50.644348 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-23460760-9f33-4d7f-ac3f-bd1b5a9438c1 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:50.644986 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-23460760-9f33-4d7f-ac3f-bd1b5a9438c1 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:50.645922 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-23460760-9f33-4d7f-ac3f-bd1b5a9438c1 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:50.845533 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=2 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:06:51.418853 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-23460760-9f33-4d7f-ac3f-bd1b5a9438c1 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85abb492492343c58734564a2b26c8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68b14967e8249fd886f168d366f241f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:51.434544 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-23460760-9f33-4d7f-ac3f-bd1b5a9438c1 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] 10.222.0.26 "GET /compute/v2.1/servers/ce4a2fbf-76f3-4577-a704-3b64ec30d84b" status: 200 len: 1724 microversion: 2.1 time: 0.805520 Oct 08 21:06:51.438260 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1732/3553] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:06:50 2022] GET /compute/v2.1/servers/ce4a2fbf-76f3-4577-a704-3b64ec30d84b => generated 1724 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:06:51.452248 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-e18c4322-93ab-4568-a13d-b20188fe7d1b tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:06:51.453218 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-e18c4322-93ab-4568-a13d-b20188fe7d1b tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] [instance: dbacaeed-a40b-4e05-9635-5073dfdd8621] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:06:51.474170 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e18c4322-93ab-4568-a13d-b20188fe7d1b tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:51.475162 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e18c4322-93ab-4568-a13d-b20188fe7d1b tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:51.475788 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e18c4322-93ab-4568-a13d-b20188fe7d1b tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:51.476702 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e18c4322-93ab-4568-a13d-b20188fe7d1b tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:51.477534 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e18c4322-93ab-4568-a13d-b20188fe7d1b tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:51.479103 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e18c4322-93ab-4568-a13d-b20188fe7d1b tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:52.277665 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-e18c4322-93ab-4568-a13d-b20188fe7d1b tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:52.278622 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=50 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:06:52.295815 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-e18c4322-93ab-4568-a13d-b20188fe7d1b tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:52.297615 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-e18c4322-93ab-4568-a13d-b20188fe7d1b tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:52.309604 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-e18c4322-93ab-4568-a13d-b20188fe7d1b tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] 10.222.0.26 "GET /compute/v2.1/servers/dbacaeed-a40b-4e05-9635-5073dfdd8621" status: 200 len: 1739 microversion: 2.20 time: 0.867971 Oct 08 21:06:52.315269 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1733/3554] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:06:51 2022] GET /compute/v2.1/servers/dbacaeed-a40b-4e05-9635-5073dfdd8621 => generated 1739 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:06:52.324326 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-5195dff1-617e-472a-b708-1690831815b1 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:06:52.344854 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-5195dff1-617e-472a-b708-1690831815b1 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] [instance: ee440f9f-69e9-4d96-bab6-92f73d08b9dd] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:06:52.377539 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5195dff1-617e-472a-b708-1690831815b1 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:52.378361 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5195dff1-617e-472a-b708-1690831815b1 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:52.378981 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5195dff1-617e-472a-b708-1690831815b1 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:52.379945 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5195dff1-617e-472a-b708-1690831815b1 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:52.380597 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5195dff1-617e-472a-b708-1690831815b1 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:52.381221 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5195dff1-617e-472a-b708-1690831815b1 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:52.912444 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-63e9ffff-c793-4aaa-a334-1e67d13a29f3 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Flavor limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 21:06:52.912877 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-63e9ffff-c793-4aaa-a334-1e67d13a29f3 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Image limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 21:06:52.913609 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-63e9ffff-c793-4aaa-a334-1e67d13a29f3 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Flavor pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 21:06:52.914224 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-63e9ffff-c793-4aaa-a334-1e67d13a29f3 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Image pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 21:06:52.915027 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-63e9ffff-c793-4aaa-a334-1e67d13a29f3 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 21:06:52.917157 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-5195dff1-617e-472a-b708-1690831815b1 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcad18d0243f492591808197ca3dcc81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169293c01bf047358ff870a36c7a1247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:52.931651 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-5195dff1-617e-472a-b708-1690831815b1 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] 10.222.0.26 "GET /compute/v2.1/servers/ee440f9f-69e9-4d96-bab6-92f73d08b9dd" status: 200 len: 1312 microversion: 2.1 time: 0.614893 Oct 08 21:06:52.935473 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1734/3555] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:06:52 2022] GET /compute/v2.1/servers/ee440f9f-69e9-4d96-bab6-92f73d08b9dd => generated 1312 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:06:52.938700 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-63e9ffff-c793-4aaa-a334-1e67d13a29f3 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:52.940320 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-63e9ffff-c793-4aaa-a334-1e67d13a29f3 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:52.947479 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-63e9ffff-c793-4aaa-a334-1e67d13a29f3 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:52.953090 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-8f926c7e-0de1-458a-a10a-aa221839e125 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:06:52.957628 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-63e9ffff-c793-4aaa-a334-1e67d13a29f3 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:52.958130 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-63e9ffff-c793-4aaa-a334-1e67d13a29f3 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:52.958579 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-63e9ffff-c793-4aaa-a334-1e67d13a29f3 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:52.966095 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-8f926c7e-0de1-458a-a10a-aa221839e125 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] [instance: 4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:06:52.992520 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8f926c7e-0de1-458a-a10a-aa221839e125 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:53.000261 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8f926c7e-0de1-458a-a10a-aa221839e125 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:53.000924 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8f926c7e-0de1-458a-a10a-aa221839e125 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:53.002539 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8f926c7e-0de1-458a-a10a-aa221839e125 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:53.003178 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8f926c7e-0de1-458a-a10a-aa221839e125 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:53.003796 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8f926c7e-0de1-458a-a10a-aa221839e125 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:53.012959 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-63e9ffff-c793-4aaa-a334-1e67d13a29f3 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Getting quotas for project e7ded993145b4eda9d6a33b994519012. Resources: {'cores', 'instances', 'ram'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:06:53.038772 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-63e9ffff-c793-4aaa-a334-1e67d13a29f3 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Getting quotas for user 06443b5728fb4d1e95d6245820e786bf and project e7ded993145b4eda9d6a33b994519012. Resources: {'cores', 'instances', 'ram'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:06:53.058653 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-63e9ffff-c793-4aaa-a334-1e67d13a29f3 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Going to run 1 instances... {{(pid=140492) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 21:06:53.063836 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-63e9ffff-c793-4aaa-a334-1e67d13a29f3 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: a0a81300-bb0a-4528-96eb-43c422f9df2d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c508bd7f-7db9-4b2c-af7c-be54a855c355',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140492) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 21:06:53.189701 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-63e9ffff-c793-4aaa-a334-1e67d13a29f3 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.844273 Oct 08 21:06:53.190859 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1822/3556] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 21:06:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 2847 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 08 21:06:53.202406 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-eb0a6391-f50c-4cd4-9172-9aea6b3c626f req-72f42cbb-29e8-49d2-a876-b74a66817bb2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee440f9f-69e9-4d96-bab6-92f73d08b9dd", "tag": "0d491ec5-6d3e-49ad-95ec-23b25fbb1567"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:06:53.216363 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-eb0a6391-f50c-4cd4-9172-9aea6b3c626f req-72f42cbb-29e8-49d2-a876-b74a66817bb2 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:53.216963 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-eb0a6391-f50c-4cd4-9172-9aea6b3c626f req-72f42cbb-29e8-49d2-a876-b74a66817bb2 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:53.217450 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-eb0a6391-f50c-4cd4-9172-9aea6b3c626f req-72f42cbb-29e8-49d2-a876-b74a66817bb2 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:53.234374 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-eb0a6391-f50c-4cd4-9172-9aea6b3c626f req-72f42cbb-29e8-49d2-a876-b74a66817bb2 service nova] Creating event network-changed:0d491ec5-6d3e-49ad-95ec-23b25fbb1567 for instance ee440f9f-69e9-4d96-bab6-92f73d08b9dd on nch1-master-1 Oct 08 21:06:53.241598 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-eb0a6391-f50c-4cd4-9172-9aea6b3c626f req-72f42cbb-29e8-49d2-a876-b74a66817bb2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048211 Oct 08 21:06:53.242935 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1823/3557] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:06:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:06:53.250861 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-5b8dc7eb-d13a-44df-b37c-ad3498aef321 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:06:53.251907 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-5b8dc7eb-d13a-44df-b37c-ad3498aef321 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] [instance: ce4a2fbf-76f3-4577-a704-3b64ec30d84b] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:06:53.261298 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5b8dc7eb-d13a-44df-b37c-ad3498aef321 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:53.262050 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5b8dc7eb-d13a-44df-b37c-ad3498aef321 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:53.262687 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5b8dc7eb-d13a-44df-b37c-ad3498aef321 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:53.264283 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5b8dc7eb-d13a-44df-b37c-ad3498aef321 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:53.265598 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5b8dc7eb-d13a-44df-b37c-ad3498aef321 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:53.266279 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5b8dc7eb-d13a-44df-b37c-ad3498aef321 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:53.631436 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-5b8dc7eb-d13a-44df-b37c-ad3498aef321 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85abb492492343c58734564a2b26c8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68b14967e8249fd886f168d366f241f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:53.650412 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-5b8dc7eb-d13a-44df-b37c-ad3498aef321 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] 10.222.0.26 "GET /compute/v2.1/servers/ce4a2fbf-76f3-4577-a704-3b64ec30d84b" status: 200 len: 1724 microversion: 2.1 time: 0.405327 Oct 08 21:06:53.653614 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1824/3558] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:06:53 2022] GET /compute/v2.1/servers/ce4a2fbf-76f3-4577-a704-3b64ec30d84b => generated 1724 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:06:53.766122 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-df1e7c76-18da-4990-a846-8aee3174bb0c tempest-SecurityGroupRulesNegativeTestJSON-960839001 tempest-SecurityGroupRulesNegativeTestJSON-960839001-project] Action: 'create', calling method: .version_select at 0x7f1a8c025e50>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-960266570", "description": "tempest-description-639285883"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:06:53.839490 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-8f926c7e-0de1-458a-a10a-aa221839e125 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc2bdd169daf4a1db830b1fa7f94f0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f2d56477794f8ab38b8e3535b3e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:53.858777 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-8f926c7e-0de1-458a-a10a-aa221839e125 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc2bdd169daf4a1db830b1fa7f94f0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f2d56477794f8ab38b8e3535b3e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:53.863037 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-8f926c7e-0de1-458a-a10a-aa221839e125 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc2bdd169daf4a1db830b1fa7f94f0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f2d56477794f8ab38b8e3535b3e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:53.867310 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-8f926c7e-0de1-458a-a10a-aa221839e125 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] 10.222.0.26 "GET /compute/v2.1/servers/4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21" status: 200 len: 1879 microversion: 2.32 time: 0.922926 Oct 08 21:06:53.870001 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1735/3559] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:06:52 2022] GET /compute/v2.1/servers/4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21 => generated 1879 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:06:53.885134 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-4a2baa65-4751-4cbb-9342-c2706614d0c4 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:06:53.886274 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-4a2baa65-4751-4cbb-9342-c2706614d0c4 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: a0a81300-bb0a-4528-96eb-43c422f9df2d] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:06:54.126918 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-4a2baa65-4751-4cbb-9342-c2706614d0c4 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06443b5728fb4d1e95d6245820e786bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ded993145b4eda9d6a33b994519012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:54.129236 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-df1e7c76-18da-4990-a846-8aee3174bb0c tempest-SecurityGroupRulesNegativeTestJSON-960839001 tempest-SecurityGroupRulesNegativeTestJSON-960839001-project] 10.222.0.26 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.474237 Oct 08 21:06:54.137985 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1825/3560] 10.222.0.26 () {60 vars in 1180 bytes} [Sat Oct 8 21:06:53 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:06:54.137985 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-958f9e41-c619-46a5-9b43-c67de5e170c3 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:06:54.137985 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-958f9e41-c619-46a5-9b43-c67de5e170c3 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] [instance: dbacaeed-a40b-4e05-9635-5073dfdd8621] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:06:54.148387 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-4a2baa65-4751-4cbb-9342-c2706614d0c4 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "GET /compute/v2.1/servers/a0a81300-bb0a-4528-96eb-43c422f9df2d" status: 200 len: 1227 microversion: 2.1 time: 0.272694 Oct 08 21:06:54.152288 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1736/3561] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:06:53 2022] GET /compute/v2.1/servers/a0a81300-bb0a-4528-96eb-43c422f9df2d => generated 1227 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:06:54.158286 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-958f9e41-c619-46a5-9b43-c67de5e170c3 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:54.158798 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-958f9e41-c619-46a5-9b43-c67de5e170c3 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:54.159239 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-958f9e41-c619-46a5-9b43-c67de5e170c3 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:54.160509 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-958f9e41-c619-46a5-9b43-c67de5e170c3 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:54.162963 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-958f9e41-c619-46a5-9b43-c67de5e170c3 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:54.163990 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-958f9e41-c619-46a5-9b43-c67de5e170c3 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:54.175914 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-f06a483a-f25d-45d1-a7cd-b10b2bfc105e tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:06:54.179389 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-f06a483a-f25d-45d1-a7cd-b10b2bfc105e tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] [instance: ee440f9f-69e9-4d96-bab6-92f73d08b9dd] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:06:54.198781 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f06a483a-f25d-45d1-a7cd-b10b2bfc105e tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:54.199558 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f06a483a-f25d-45d1-a7cd-b10b2bfc105e tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:54.200241 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f06a483a-f25d-45d1-a7cd-b10b2bfc105e tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:54.201848 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f06a483a-f25d-45d1-a7cd-b10b2bfc105e tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:54.204717 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f06a483a-f25d-45d1-a7cd-b10b2bfc105e tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:54.205383 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f06a483a-f25d-45d1-a7cd-b10b2bfc105e tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:54.487801 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-958f9e41-c619-46a5-9b43-c67de5e170c3 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:54.507684 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-958f9e41-c619-46a5-9b43-c67de5e170c3 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:54.516903 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-958f9e41-c619-46a5-9b43-c67de5e170c3 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:54.522181 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-958f9e41-c619-46a5-9b43-c67de5e170c3 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] 10.222.0.26 "GET /compute/v2.1/servers/dbacaeed-a40b-4e05-9635-5073dfdd8621" status: 200 len: 1739 microversion: 2.20 time: 0.390728 Oct 08 21:06:54.526026 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1826/3562] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:06:54 2022] GET /compute/v2.1/servers/dbacaeed-a40b-4e05-9635-5073dfdd8621 => generated 1739 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:06:54.554991 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-6d7ae7a0-72e0-4586-948d-df9ca0e6ca09 tempest-SecurityGroupRulesNegativeTestJSON-960839001 tempest-SecurityGroupRulesNegativeTestJSON-960839001-project] Action: 'create', calling method: .version_select at 0x7f1a8c0251f0>, body: {"security_group_rule": {"parent_group_id": "f37a3a65-511a-437f-b853-8ec0c8d305c9", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:06:55.051349 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-6d7ae7a0-72e0-4586-948d-df9ca0e6ca09 tempest-SecurityGroupRulesNegativeTestJSON-960839001 tempest-SecurityGroupRulesNegativeTestJSON-960839001-project] 10.222.0.26 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.511851 Oct 08 21:06:55.052267 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1827/3563] 10.222.0.26 () {60 vars in 1195 bytes} [Sat Oct 8 21:06:54 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:06:55.057064 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-7cdf38df-991b-4ba9-abe0-c3d8d5041c38 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:06:55.057734 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-7cdf38df-991b-4ba9-abe0-c3d8d5041c38 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] [instance: ce4a2fbf-76f3-4577-a704-3b64ec30d84b] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:06:55.078827 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7cdf38df-991b-4ba9-abe0-c3d8d5041c38 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:55.079560 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7cdf38df-991b-4ba9-abe0-c3d8d5041c38 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:55.080023 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7cdf38df-991b-4ba9-abe0-c3d8d5041c38 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:55.080780 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7cdf38df-991b-4ba9-abe0-c3d8d5041c38 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:55.081278 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7cdf38df-991b-4ba9-abe0-c3d8d5041c38 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:55.081710 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7cdf38df-991b-4ba9-abe0-c3d8d5041c38 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:55.210874 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-f06a483a-f25d-45d1-a7cd-b10b2bfc105e tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcad18d0243f492591808197ca3dcc81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169293c01bf047358ff870a36c7a1247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:55.228190 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-f06a483a-f25d-45d1-a7cd-b10b2bfc105e tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] 10.222.0.26 "GET /compute/v2.1/servers/ee440f9f-69e9-4d96-bab6-92f73d08b9dd" status: 200 len: 1312 microversion: 2.1 time: 1.072258 Oct 08 21:06:55.229135 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1737/3564] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:06:54 2022] GET /compute/v2.1/servers/ee440f9f-69e9-4d96-bab6-92f73d08b9dd => generated 1312 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:06:55.244601 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c31fc2d4-d039-4e4e-a92a-88a19ca79284 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:06:55.249788 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-c31fc2d4-d039-4e4e-a92a-88a19ca79284 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] [instance: 4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:06:55.261987 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c31fc2d4-d039-4e4e-a92a-88a19ca79284 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:55.270633 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c31fc2d4-d039-4e4e-a92a-88a19ca79284 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:55.271103 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c31fc2d4-d039-4e4e-a92a-88a19ca79284 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:55.271857 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c31fc2d4-d039-4e4e-a92a-88a19ca79284 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:55.272384 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c31fc2d4-d039-4e4e-a92a-88a19ca79284 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:55.272847 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c31fc2d4-d039-4e4e-a92a-88a19ca79284 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:55.357820 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-7cdf38df-991b-4ba9-abe0-c3d8d5041c38 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85abb492492343c58734564a2b26c8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68b14967e8249fd886f168d366f241f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:55.370673 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-7cdf38df-991b-4ba9-abe0-c3d8d5041c38 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] 10.222.0.26 "GET /compute/v2.1/servers/ce4a2fbf-76f3-4577-a704-3b64ec30d84b" status: 200 len: 1701 microversion: 2.1 time: 0.317175 Oct 08 21:06:55.371734 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1828/3565] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:06:55 2022] GET /compute/v2.1/servers/ce4a2fbf-76f3-4577-a704-3b64ec30d84b => generated 1701 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:06:55.397441 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-7b907b66-7cd8-4926-9835-066adf93ce66 tempest-SecurityGroupRulesNegativeTestJSON-960839001 tempest-SecurityGroupRulesNegativeTestJSON-960839001-project] Action: 'create', calling method: .version_select at 0x7f1a91327af0>, body: {"security_group_rule": {"parent_group_id": "f37a3a65-511a-437f-b853-8ec0c8d305c9", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:06:55.521748 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-7b907b66-7cd8-4926-9835-066adf93ce66 tempest-SecurityGroupRulesNegativeTestJSON-960839001 tempest-SecurityGroupRulesNegativeTestJSON-960839001-project] HTTP exception thrown: This rule already exists in group f37a3a65-511a-437f-b853-8ec0c8d305c9 Oct 08 21:06:55.526202 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-7b907b66-7cd8-4926-9835-066adf93ce66 tempest-SecurityGroupRulesNegativeTestJSON-960839001 tempest-SecurityGroupRulesNegativeTestJSON-960839001-project] Request method failure captured: Oct 08 21:06:55.526202 ncdv-master-1 devstack@n-api.service[140492]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 08 21:06:55.526202 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:06:55.526202 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:06:55.526202 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:06:55.526202 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 138 Oct 08 21:06:55.526202 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:06:55.526202 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:06:55.526202 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:06:55.526202 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:06:55.526202 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeZsEgsSeifeIwS2LvOLY7BpNT7rZsP9rx5NDnTxru-VJy6iU3Yk0rKg5eqpMLCAuzk_evQgT731B2l4x9YIJmif4OJm6UAhBW4AXVWkicrpMvl_pzTMMncuCJY5sEVi6af8a0FVsM1ATF84XR56aHoO9Oz5yOJ23OSpGE7MFB6ll9g Oct 08 21:06:55.526202 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:06:55.526202 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:06:55.526202 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:06:55.526202 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:06:55.526202 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:06:55.526202 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:06:55.526202 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: b96051fc89de47e1b636dcb23b6fdc30 Oct 08 21:06:55.526202 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-960839001 Oct 08 21:06:55.526202 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:06:55.526202 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:06:55.526202 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b96051fc89de47e1b636dcb23b6fdc30"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b96051fc89de47e1b636dcb23b6fdc30"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b96051fc89de47e1b636dcb23b6fdc30"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b96051fc89de47e1b636dcb23b6fdc30"}]}] Oct 08 21:06:55.526202 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-960839001 Oct 08 21:06:55.526202 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: b96051fc89de47e1b636dcb23b6fdc30 Oct 08 21:06:55.526202 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-960839001 Oct 08 21:06:55.526202 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-960839001-project Oct 08 21:06:55.526202 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:06:55.526202 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:06:55.526202 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 751127bd91a24297b248f59af3e069d4 Oct 08 21:06:55.526202 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-960839001-project Oct 08 21:06:55.526202 ncdv-master-1 devstack@n-api.service[140492]: Oct 08 21:06:55.526202 ncdv-master-1 devstack@n-api.service[140492]: {"security_group_rule": {"parent_group_id": "f37a3a65-511a-437f-b853-8ec0c8d305c9", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 08 21:06:55.526202 ncdv-master-1 devstack@n-api.service[140492]: method: Oct 08 21:06:55.526202 ncdv-master-1 devstack@n-api.service[140492]: exception: This rule already exists in group f37a3a65-511a-437f-b853-8ec0c8d305c9 Oct 08 21:06:55.526202 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'f37a3a65-511a-437f-b853-8ec0c8d305c9', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 08 21:06:55.526202 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:06:55.526202 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:06:55.526202 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Oct 08 21:06:55.526202 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Oct 08 21:06:55.526202 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Oct 08 21:06:55.526202 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Oct 08 21:06:55.526202 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group f37a3a65-511a-437f-b853-8ec0c8d305c9 Oct 08 21:06:55.526202 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:06:55.526202 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:06:55.526202 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:06:55.526202 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:06:55.526202 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:06:55.526202 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:06:55.526202 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:06:55.526202 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:06:55.526202 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 08 21:06:55.526202 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 08 21:06:55.526202 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:06:55.526202 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:06:55.526202 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Oct 08 21:06:55.526202 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 08 21:06:55.526202 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group f37a3a65-511a-437f-b853-8ec0c8d305c9 Oct 08 21:06:55.526202 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:06:55.526202 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:06:55.526202 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:06:55.526202 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:06:55.526202 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:06:55.526202 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:06:55.532290 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:06:55.532290 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:06:55.532290 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group f37a3a65-511a-437f-b853-8ec0c8d305c9 Oct 08 21:06:55.532290 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:06:55.532290 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-7b907b66-7cd8-4926-9835-066adf93ce66 tempest-SecurityGroupRulesNegativeTestJSON-960839001 tempest-SecurityGroupRulesNegativeTestJSON-960839001-project] Returning 400 to user: This rule already exists in group f37a3a65-511a-437f-b853-8ec0c8d305c9 {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:06:55.532290 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-7b907b66-7cd8-4926-9835-066adf93ce66 tempest-SecurityGroupRulesNegativeTestJSON-960839001 tempest-SecurityGroupRulesNegativeTestJSON-960839001-project] 10.222.0.26 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.158472 Oct 08 21:06:55.536748 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1829/3566] 10.222.0.26 () {60 vars in 1195 bytes} [Sat Oct 8 21:06:55 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 164 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 08 21:06:55.568370 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-806dae1a-d494-48f2-b165-9cc659b7351a tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:06:55.572245 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-806dae1a-d494-48f2-b165-9cc659b7351a tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: a0a81300-bb0a-4528-96eb-43c422f9df2d] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:06:55.600583 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-806dae1a-d494-48f2-b165-9cc659b7351a tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:55.601871 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-806dae1a-d494-48f2-b165-9cc659b7351a tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:55.603150 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-806dae1a-d494-48f2-b165-9cc659b7351a tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:55.604169 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-806dae1a-d494-48f2-b165-9cc659b7351a tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:55.609007 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-806dae1a-d494-48f2-b165-9cc659b7351a tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:55.610085 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-806dae1a-d494-48f2-b165-9cc659b7351a tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:55.814221 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-806dae1a-d494-48f2-b165-9cc659b7351a tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06443b5728fb4d1e95d6245820e786bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ded993145b4eda9d6a33b994519012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:55.823004 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-806dae1a-d494-48f2-b165-9cc659b7351a tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "GET /compute/v2.1/servers/a0a81300-bb0a-4528-96eb-43c422f9df2d" status: 200 len: 1279 microversion: 2.1 time: 0.279771 Oct 08 21:06:55.847516 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1830/3567] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:06:55 2022] GET /compute/v2.1/servers/a0a81300-bb0a-4528-96eb-43c422f9df2d => generated 1279 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:06:55.853177 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-94d7517d-d94b-49ba-86c9-a833c24c1835 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:06:55.860401 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-94d7517d-d94b-49ba-86c9-a833c24c1835 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:55.860906 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-94d7517d-d94b-49ba-86c9-a833c24c1835 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:55.861553 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-94d7517d-d94b-49ba-86c9-a833c24c1835 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:55.948506 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-94d7517d-d94b-49ba-86c9-a833c24c1835 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] [instance: ce4a2fbf-76f3-4577-a704-3b64ec30d84b] Going to try to start instance {{(pid=140492) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 08 21:06:55.963949 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-c31fc2d4-d039-4e4e-a92a-88a19ca79284 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc2bdd169daf4a1db830b1fa7f94f0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f2d56477794f8ab38b8e3535b3e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:55.985228 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-c31fc2d4-d039-4e4e-a92a-88a19ca79284 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc2bdd169daf4a1db830b1fa7f94f0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f2d56477794f8ab38b8e3535b3e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:55.992312 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-c31fc2d4-d039-4e4e-a92a-88a19ca79284 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc2bdd169daf4a1db830b1fa7f94f0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f2d56477794f8ab38b8e3535b3e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:55.994070 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-c31fc2d4-d039-4e4e-a92a-88a19ca79284 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] 10.222.0.26 "GET /compute/v2.1/servers/4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21" status: 200 len: 1879 microversion: 2.32 time: 0.763568 Oct 08 21:06:55.994663 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1738/3568] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:06:55 2022] GET /compute/v2.1/servers/4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21 => generated 1879 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:06:56.007258 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-a7e9e0e7-6c49-4739-b33a-dd525bb11761 tempest-SecurityGroupRulesNegativeTestJSON-960839001 tempest-SecurityGroupRulesNegativeTestJSON-960839001-project] Calling method '.version_select at 0x7f1a87767af0>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:06:56.068104 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-94d7517d-d94b-49ba-86c9-a833c24c1835 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] 10.222.0.26 "POST /compute/v2.1/servers/ce4a2fbf-76f3-4577-a704-3b64ec30d84b/action" status: 202 len: 0 microversion: 2.1 time: 0.219046 Oct 08 21:06:56.071505 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1831/3569] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:06:55 2022] POST /compute/v2.1/servers/ce4a2fbf-76f3-4577-a704-3b64ec30d84b/action => generated 0 bytes in 223 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 21:06:56.088147 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-44619515-1442-4907-84ad-8e720ae6f14b tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:06:56.090633 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-44619515-1442-4907-84ad-8e720ae6f14b tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] [instance: dbacaeed-a40b-4e05-9635-5073dfdd8621] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:06:56.109526 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-44619515-1442-4907-84ad-8e720ae6f14b tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:56.112604 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-44619515-1442-4907-84ad-8e720ae6f14b tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:56.113444 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-44619515-1442-4907-84ad-8e720ae6f14b tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:56.116563 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-44619515-1442-4907-84ad-8e720ae6f14b tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:56.117719 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-44619515-1442-4907-84ad-8e720ae6f14b tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:56.118975 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-44619515-1442-4907-84ad-8e720ae6f14b tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:56.486357 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-44619515-1442-4907-84ad-8e720ae6f14b tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:56.508640 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-44619515-1442-4907-84ad-8e720ae6f14b tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:56.513840 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-44619515-1442-4907-84ad-8e720ae6f14b tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:56.517534 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-44619515-1442-4907-84ad-8e720ae6f14b tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] 10.222.0.26 "GET /compute/v2.1/servers/dbacaeed-a40b-4e05-9635-5073dfdd8621" status: 200 len: 1739 microversion: 2.20 time: 0.444375 Oct 08 21:06:56.520087 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1832/3570] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:06:56 2022] GET /compute/v2.1/servers/dbacaeed-a40b-4e05-9635-5073dfdd8621 => generated 1739 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:06:56.528015 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-741c7aa5-6919-4f7a-8add-8855424bcfcd tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:06:56.531778 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-741c7aa5-6919-4f7a-8add-8855424bcfcd tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] [instance: ce4a2fbf-76f3-4577-a704-3b64ec30d84b] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:06:56.539345 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-741c7aa5-6919-4f7a-8add-8855424bcfcd tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:56.539998 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-741c7aa5-6919-4f7a-8add-8855424bcfcd tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:56.540561 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-741c7aa5-6919-4f7a-8add-8855424bcfcd tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:56.541498 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-741c7aa5-6919-4f7a-8add-8855424bcfcd tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:56.542431 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-741c7aa5-6919-4f7a-8add-8855424bcfcd tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:56.543040 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-741c7aa5-6919-4f7a-8add-8855424bcfcd tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:56.915574 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-741c7aa5-6919-4f7a-8add-8855424bcfcd tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85abb492492343c58734564a2b26c8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68b14967e8249fd886f168d366f241f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:56.924973 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-741c7aa5-6919-4f7a-8add-8855424bcfcd tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] 10.222.0.26 "GET /compute/v2.1/servers/ce4a2fbf-76f3-4577-a704-3b64ec30d84b" status: 200 len: 1710 microversion: 2.1 time: 0.403693 Oct 08 21:06:56.935907 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1833/3571] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:06:56 2022] GET /compute/v2.1/servers/ce4a2fbf-76f3-4577-a704-3b64ec30d84b => generated 1710 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:06:56.954425 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-df63eb2a-2386-417b-b227-54a16dd0eb3b tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:06:56.955154 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-df63eb2a-2386-417b-b227-54a16dd0eb3b tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] [instance: ee440f9f-69e9-4d96-bab6-92f73d08b9dd] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:06:56.969567 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-df63eb2a-2386-417b-b227-54a16dd0eb3b tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:56.975253 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-df63eb2a-2386-417b-b227-54a16dd0eb3b tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:56.975990 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-df63eb2a-2386-417b-b227-54a16dd0eb3b tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:56.979952 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-df63eb2a-2386-417b-b227-54a16dd0eb3b tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:56.980641 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-df63eb2a-2386-417b-b227-54a16dd0eb3b tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:56.981397 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-df63eb2a-2386-417b-b227-54a16dd0eb3b tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:57.229026 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-df63eb2a-2386-417b-b227-54a16dd0eb3b tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcad18d0243f492591808197ca3dcc81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169293c01bf047358ff870a36c7a1247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:57.240418 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-df63eb2a-2386-417b-b227-54a16dd0eb3b tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] 10.222.0.26 "GET /compute/v2.1/servers/ee440f9f-69e9-4d96-bab6-92f73d08b9dd" status: 200 len: 1312 microversion: 2.1 time: 0.300418 Oct 08 21:06:57.245288 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1834/3572] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:06:56 2022] GET /compute/v2.1/servers/ee440f9f-69e9-4d96-bab6-92f73d08b9dd => generated 1312 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:06:57.362065 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-a7e9e0e7-6c49-4739-b33a-dd525bb11761 tempest-SecurityGroupRulesNegativeTestJSON-960839001 tempest-SecurityGroupRulesNegativeTestJSON-960839001-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-group-rules/e242a38b-4e70-4bb1-8ba9-61f2fed72612" status: 202 len: 0 microversion: 2.1 time: 1.366134 Oct 08 21:06:57.363188 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1739/3573] 10.222.0.26 () {58 vars in 1287 bytes} [Sat Oct 8 21:06:55 2022] DELETE /compute/v2.1/os-security-group-rules/e242a38b-4e70-4bb1-8ba9-61f2fed72612 => generated 0 bytes in 1368 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 21:06:57.368297 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-6ebbe793-e04c-4c70-8529-3c98f7b89f92 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:06:57.369120 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-6ebbe793-e04c-4c70-8529-3c98f7b89f92 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: a0a81300-bb0a-4528-96eb-43c422f9df2d] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:06:57.377433 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-b081cc64-1b4c-4e85-9fbb-4b671ff6ab06 tempest-FloatingIPsNegativeTestJSON-162787281 tempest-FloatingIPsNegativeTestJSON-162787281-project] Calling method '.version_select at 0x7f1a87e680d0>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:06:57.383892 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6ebbe793-e04c-4c70-8529-3c98f7b89f92 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:57.386236 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6ebbe793-e04c-4c70-8529-3c98f7b89f92 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:57.386885 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6ebbe793-e04c-4c70-8529-3c98f7b89f92 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:57.391118 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6ebbe793-e04c-4c70-8529-3c98f7b89f92 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:57.392047 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6ebbe793-e04c-4c70-8529-3c98f7b89f92 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:57.395107 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6ebbe793-e04c-4c70-8529-3c98f7b89f92 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:57.695042 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-b081cc64-1b4c-4e85-9fbb-4b671ff6ab06 tempest-FloatingIPsNegativeTestJSON-162787281 tempest-FloatingIPsNegativeTestJSON-162787281-project] 10.222.0.26 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.447991 Oct 08 21:06:57.696489 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1835/3574] 10.222.0.26 () {58 vars in 1149 bytes} [Sat Oct 8 21:06:57 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 08 21:06:57.703998 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-5c696c2a-a55b-4f67-b807-b090662bac6b tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:06:57.705592 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-5c696c2a-a55b-4f67-b807-b090662bac6b tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] [instance: 4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:06:57.743558 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5c696c2a-a55b-4f67-b807-b090662bac6b tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:57.744310 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5c696c2a-a55b-4f67-b807-b090662bac6b tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:57.744884 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5c696c2a-a55b-4f67-b807-b090662bac6b tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:57.746436 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5c696c2a-a55b-4f67-b807-b090662bac6b tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:57.748940 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5c696c2a-a55b-4f67-b807-b090662bac6b tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:57.750757 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5c696c2a-a55b-4f67-b807-b090662bac6b tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:58.560413 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-5c696c2a-a55b-4f67-b807-b090662bac6b tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc2bdd169daf4a1db830b1fa7f94f0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f2d56477794f8ab38b8e3535b3e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:58.577359 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-5c696c2a-a55b-4f67-b807-b090662bac6b tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc2bdd169daf4a1db830b1fa7f94f0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f2d56477794f8ab38b8e3535b3e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:58.580012 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-5c696c2a-a55b-4f67-b807-b090662bac6b tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc2bdd169daf4a1db830b1fa7f94f0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f2d56477794f8ab38b8e3535b3e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:58.581307 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-5c696c2a-a55b-4f67-b807-b090662bac6b tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] 10.222.0.26 "GET /compute/v2.1/servers/4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21" status: 200 len: 1879 microversion: 2.32 time: 0.883440 Oct 08 21:06:58.585341 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1836/3575] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:06:57 2022] GET /compute/v2.1/servers/4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21 => generated 1879 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:06:58.605924 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-12110df5-c0b8-4ee7-b355-4f56088774e8 tempest-SecurityGroupRulesNegativeTestJSON-960839001 tempest-SecurityGroupRulesNegativeTestJSON-960839001-project] Action: 'create', calling method: .version_select at 0x7f1a8c025280>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-826929662", "description": "tempest-description-881107920"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:06:58.660216 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-6ebbe793-e04c-4c70-8529-3c98f7b89f92 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06443b5728fb4d1e95d6245820e786bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ded993145b4eda9d6a33b994519012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:58.673346 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-6ebbe793-e04c-4c70-8529-3c98f7b89f92 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "GET /compute/v2.1/servers/a0a81300-bb0a-4528-96eb-43c422f9df2d" status: 200 len: 1327 microversion: 2.1 time: 1.308833 Oct 08 21:06:58.682481 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1740/3576] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:06:57 2022] GET /compute/v2.1/servers/a0a81300-bb0a-4528-96eb-43c422f9df2d => generated 1327 bytes in 1319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:06:58.707062 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-d623b0a4-dd02-4a77-857e-4dfecc1a9abe tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:06:58.707948 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-d623b0a4-dd02-4a77-857e-4dfecc1a9abe tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] [instance: dbacaeed-a40b-4e05-9635-5073dfdd8621] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:06:58.717041 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d623b0a4-dd02-4a77-857e-4dfecc1a9abe tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:58.717951 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d623b0a4-dd02-4a77-857e-4dfecc1a9abe tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:58.719345 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d623b0a4-dd02-4a77-857e-4dfecc1a9abe tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:58.720348 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d623b0a4-dd02-4a77-857e-4dfecc1a9abe tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:58.721126 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d623b0a4-dd02-4a77-857e-4dfecc1a9abe tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:58.722024 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d623b0a4-dd02-4a77-857e-4dfecc1a9abe tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:58.986482 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-d623b0a4-dd02-4a77-857e-4dfecc1a9abe tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:59.000999 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-d623b0a4-dd02-4a77-857e-4dfecc1a9abe tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:59.002840 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-d623b0a4-dd02-4a77-857e-4dfecc1a9abe tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:59.004198 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-d623b0a4-dd02-4a77-857e-4dfecc1a9abe tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] 10.222.0.26 "GET /compute/v2.1/servers/dbacaeed-a40b-4e05-9635-5073dfdd8621" status: 200 len: 1739 microversion: 2.20 time: 0.308415 Oct 08 21:06:59.005228 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1741/3577] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:06:58 2022] GET /compute/v2.1/servers/dbacaeed-a40b-4e05-9635-5073dfdd8621 => generated 1739 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:06:59.010734 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-14d3dfb2-f914-4973-a653-2d035800c9a1 tempest-FloatingIPsNegativeTestJSON-162787281 tempest-FloatingIPsNegativeTestJSON-162787281-project] Action: 'create', calling method: .version_select at 0x7f1a8776c310>, body: {"pool": "non_exist_pool"} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:06:59.063441 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-14d3dfb2-f914-4973-a653-2d035800c9a1 tempest-FloatingIPsNegativeTestJSON-162787281 tempest-FloatingIPsNegativeTestJSON-162787281-project] HTTP exception thrown: Floating IP pool not found. Oct 08 21:06:59.066251 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-14d3dfb2-f914-4973-a653-2d035800c9a1 tempest-FloatingIPsNegativeTestJSON-162787281 tempest-FloatingIPsNegativeTestJSON-162787281-project] Request method failure captured: Oct 08 21:06:59.066251 ncdv-master-1 devstack@n-api.service[140491]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Oct 08 21:06:59.066251 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:06:59.066251 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:06:59.066251 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:06:59.066251 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 26 Oct 08 21:06:59.066251 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:06:59.066251 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:06:59.066251 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:06:59.066251 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:06:59.066251 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeZwTyVvlenVNbci1NY86D1EsfUuvWXTNgoZblUvsZaB76c723BEEKag1QF-WNo7LzwqJB3L3Fa2MF6JmtzQVpKVHuBe_Uvv-I8RTQWI2YtiwLUlUtZR8x4g03H8PqooLz4bjfyLm7NgreWCZl32s7SfPIPhBhynhPMe7lvlCmOHW48 Oct 08 21:06:59.066251 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:06:59.066251 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:06:59.066251 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:06:59.066251 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:06:59.066251 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:06:59.066251 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:06:59.066251 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 6aa299e3b5df41429787365c80c28be2 Oct 08 21:06:59.066251 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-162787281 Oct 08 21:06:59.066251 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:06:59.066251 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:06:59.066251 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6aa299e3b5df41429787365c80c28be2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6aa299e3b5df41429787365c80c28be2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6aa299e3b5df41429787365c80c28be2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6aa299e3b5df41429787365c80c28be2"}]}] Oct 08 21:06:59.066251 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-162787281 Oct 08 21:06:59.066251 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 6aa299e3b5df41429787365c80c28be2 Oct 08 21:06:59.066251 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-162787281 Oct 08 21:06:59.066251 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-FloatingIPsNegativeTestJSON-162787281-project Oct 08 21:06:59.066251 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:06:59.066251 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:06:59.066251 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 1a561700ae4f44e59b3dd81c136447d1 Oct 08 21:06:59.066251 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-162787281-project Oct 08 21:06:59.066251 ncdv-master-1 devstack@n-api.service[140491]: Oct 08 21:06:59.066251 ncdv-master-1 devstack@n-api.service[140491]: {"pool": "non_exist_pool"} Oct 08 21:06:59.066251 ncdv-master-1 devstack@n-api.service[140491]: method: Oct 08 21:06:59.066251 ncdv-master-1 devstack@n-api.service[140491]: exception: Floating IP pool not found. Oct 08 21:06:59.066251 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'body': {'pool': 'non_exist_pool'}} Oct 08 21:06:59.066251 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:06:59.066251 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:06:59.066251 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Oct 08 21:06:59.066251 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Oct 08 21:06:59.066251 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2972, in allocate_floating_ip Oct 08 21:06:59.066251 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Oct 08 21:06:59.066251 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2962, in _get_floating_ip_pool_id_by_name_or_id Oct 08 21:06:59.066251 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Oct 08 21:06:59.066251 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Oct 08 21:06:59.066251 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:06:59.066251 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:06:59.066251 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:06:59.066251 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:06:59.066251 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:06:59.066251 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:06:59.066251 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:06:59.066251 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:06:59.066251 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 08 21:06:59.066251 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 08 21:06:59.066251 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:06:59.066251 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:06:59.066251 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Oct 08 21:06:59.066251 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:06:59.066251 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Oct 08 21:06:59.066251 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:06:59.066251 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:06:59.066251 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:06:59.066251 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:06:59.066251 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:06:59.066251 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:06:59.066251 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:06:59.066251 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:06:59.071907 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Oct 08 21:06:59.071907 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:06:59.077353 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-12110df5-c0b8-4ee7-b355-4f56088774e8 tempest-SecurityGroupRulesNegativeTestJSON-960839001 tempest-SecurityGroupRulesNegativeTestJSON-960839001-project] 10.222.0.26 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.490475 Oct 08 21:06:59.079399 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1837/3578] 10.222.0.26 () {60 vars in 1180 bytes} [Sat Oct 8 21:06:58 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:06:59.082428 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-14d3dfb2-f914-4973-a653-2d035800c9a1 tempest-FloatingIPsNegativeTestJSON-162787281 tempest-FloatingIPsNegativeTestJSON-162787281-project] Returning 404 to user: Floating IP pool not found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:06:59.083668 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-14d3dfb2-f914-4973-a653-2d035800c9a1 tempest-FloatingIPsNegativeTestJSON-162787281 tempest-FloatingIPsNegativeTestJSON-162787281-project] 10.222.0.26 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.076868 Oct 08 21:06:59.084243 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1742/3579] 10.222.0.26 () {60 vars in 1170 bytes} [Sat Oct 8 21:06:59 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 08 21:06:59.092582 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-6b1b2972-7b32-491c-b105-10b61adfa590 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:06:59.093513 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-6b1b2972-7b32-491c-b105-10b61adfa590 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] [instance: ce4a2fbf-76f3-4577-a704-3b64ec30d84b] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:06:59.097589 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-784817bd-4e1a-4634-a55e-6f370db2cf87 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:06:59.100252 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-784817bd-4e1a-4634-a55e-6f370db2cf87 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] [instance: ee440f9f-69e9-4d96-bab6-92f73d08b9dd] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:06:59.107955 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6b1b2972-7b32-491c-b105-10b61adfa590 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:59.111118 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6b1b2972-7b32-491c-b105-10b61adfa590 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:59.111778 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6b1b2972-7b32-491c-b105-10b61adfa590 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:59.120889 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6b1b2972-7b32-491c-b105-10b61adfa590 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:59.123949 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6b1b2972-7b32-491c-b105-10b61adfa590 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:59.125569 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=3,nova_api:INSERT=3 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:06:59.127310 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6b1b2972-7b32-491c-b105-10b61adfa590 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:59.135614 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-784817bd-4e1a-4634-a55e-6f370db2cf87 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:59.136954 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-784817bd-4e1a-4634-a55e-6f370db2cf87 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:59.137639 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-784817bd-4e1a-4634-a55e-6f370db2cf87 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:59.138570 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-784817bd-4e1a-4634-a55e-6f370db2cf87 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:59.139197 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-784817bd-4e1a-4634-a55e-6f370db2cf87 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:59.139793 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-784817bd-4e1a-4634-a55e-6f370db2cf87 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:59.429788 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-784817bd-4e1a-4634-a55e-6f370db2cf87 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcad18d0243f492591808197ca3dcc81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169293c01bf047358ff870a36c7a1247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:59.441959 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-784817bd-4e1a-4634-a55e-6f370db2cf87 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] 10.222.0.26 "GET /compute/v2.1/servers/ee440f9f-69e9-4d96-bab6-92f73d08b9dd" status: 200 len: 1312 microversion: 2.1 time: 0.355927 Oct 08 21:06:59.450003 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-6b1b2972-7b32-491c-b105-10b61adfa590 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85abb492492343c58734564a2b26c8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68b14967e8249fd886f168d366f241f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:06:59.459894 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1743/3580] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:06:59 2022] GET /compute/v2.1/servers/ee440f9f-69e9-4d96-bab6-92f73d08b9dd => generated 1312 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:06:59.464346 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-6b1b2972-7b32-491c-b105-10b61adfa590 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] 10.222.0.26 "GET /compute/v2.1/servers/ce4a2fbf-76f3-4577-a704-3b64ec30d84b" status: 200 len: 1710 microversion: 2.1 time: 0.383648 Oct 08 21:06:59.467736 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-151d0d3f-0705-4295-9db3-1245dee91c4e tempest-SecurityGroupRulesNegativeTestJSON-960839001 tempest-SecurityGroupRulesNegativeTestJSON-960839001-project] Action: 'create', calling method: .version_select at 0x7f1a8776c310>, body: {"security_group_rule": {"parent_group_id": "dccd1123-0e09-4879-a9ed-09d57ea5cee0", "ip_protocol": "tcp", "from_port": 680488219, "to_port": 22}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:06:59.477896 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1838/3581] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:06:59 2022] GET /compute/v2.1/servers/ce4a2fbf-76f3-4577-a704-3b64ec30d84b => generated 1710 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:06:59.488130 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-184688dd-419c-40f6-90ed-02755f77d626 tempest-FloatingIPsNegativeTestJSON-162787281 tempest-FloatingIPsNegativeTestJSON-162787281-project] Calling method '.version_select at 0x7f1a87e00ee0>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:06:59.598498 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-151d0d3f-0705-4295-9db3-1245dee91c4e tempest-SecurityGroupRulesNegativeTestJSON-960839001 tempest-SecurityGroupRulesNegativeTestJSON-960839001-project] HTTP exception thrown: Invalid port range 680488219:22. Former value cannot be greater than the later Oct 08 21:06:59.600652 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-151d0d3f-0705-4295-9db3-1245dee91c4e tempest-SecurityGroupRulesNegativeTestJSON-960839001 tempest-SecurityGroupRulesNegativeTestJSON-960839001-project] Request method failure captured: Oct 08 21:06:59.600652 ncdv-master-1 devstack@n-api.service[140491]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 08 21:06:59.600652 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:06:59.600652 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:06:59.600652 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:06:59.600652 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 145 Oct 08 21:06:59.600652 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:06:59.600652 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:06:59.600652 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:06:59.600652 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:06:59.600652 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeZsEgsSeifeIwS2LvOLY7BpNT7rZsP9rx5NDnTxru-VJy6iU3Yk0rKg5eqpMLCAuzk_evQgT731B2l4x9YIJmif4OJm6UAhBW4AXVWkicrpMvl_pzTMMncuCJY5sEVi6af8a0FVsM1ATF84XR56aHoO9Oz5yOJ23OSpGE7MFB6ll9g Oct 08 21:06:59.600652 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:06:59.600652 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:06:59.600652 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:06:59.600652 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:06:59.600652 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:06:59.600652 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:06:59.600652 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: b96051fc89de47e1b636dcb23b6fdc30 Oct 08 21:06:59.600652 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-960839001 Oct 08 21:06:59.600652 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:06:59.600652 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:06:59.600652 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b96051fc89de47e1b636dcb23b6fdc30"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b96051fc89de47e1b636dcb23b6fdc30"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b96051fc89de47e1b636dcb23b6fdc30"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b96051fc89de47e1b636dcb23b6fdc30"}]}] Oct 08 21:06:59.600652 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-960839001 Oct 08 21:06:59.600652 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: b96051fc89de47e1b636dcb23b6fdc30 Oct 08 21:06:59.600652 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-960839001 Oct 08 21:06:59.600652 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-960839001-project Oct 08 21:06:59.600652 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:06:59.600652 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:06:59.600652 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 751127bd91a24297b248f59af3e069d4 Oct 08 21:06:59.600652 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-960839001-project Oct 08 21:06:59.600652 ncdv-master-1 devstack@n-api.service[140491]: Oct 08 21:06:59.600652 ncdv-master-1 devstack@n-api.service[140491]: {"security_group_rule": {"parent_group_id": "dccd1123-0e09-4879-a9ed-09d57ea5cee0", "ip_protocol": "tcp", "from_port": 680488219, "to_port": 22}} Oct 08 21:06:59.600652 ncdv-master-1 devstack@n-api.service[140491]: method: Oct 08 21:06:59.600652 ncdv-master-1 devstack@n-api.service[140491]: exception: Invalid port range 680488219:22. Former value cannot be greater than the later Oct 08 21:06:59.600652 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'dccd1123-0e09-4879-a9ed-09d57ea5cee0', 'ip_protocol': 'tcp', 'from_port': 680488219, 'to_port': 22}}} Oct 08 21:06:59.600652 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:06:59.600652 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:06:59.600652 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 08 21:06:59.600652 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 08 21:06:59.600652 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 08 21:06:59.600652 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 08 21:06:59.600652 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 08 21:06:59.600652 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 08 21:06:59.600652 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Oct 08 21:06:59.600652 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 08 21:06:59.600652 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 680488219:22. Former value cannot be greater than the later Oct 08 21:06:59.600652 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:06:59.600652 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:06:59.600652 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:06:59.600652 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:06:59.600652 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:06:59.600652 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:06:59.600652 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:06:59.600652 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:06:59.600652 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 08 21:06:59.600652 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 08 21:06:59.600652 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:06:59.600652 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:06:59.600652 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 08 21:06:59.600652 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 08 21:06:59.600652 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 680488219:22. Former value cannot be greater than the later Oct 08 21:06:59.600652 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:06:59.605030 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:06:59.605030 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:06:59.605030 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:06:59.605030 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:06:59.605030 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:06:59.605030 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:06:59.605030 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:06:59.605030 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 680488219:22. Former value cannot be greater than the later Oct 08 21:06:59.605030 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:06:59.605876 ncdv-master-1 devstack@n-api.service[140492]: DEBUG neutronclient.v2_0.client [None req-184688dd-419c-40f6-90ed-02755f77d626 tempest-FloatingIPsNegativeTestJSON-162787281 tempest-FloatingIPsNegativeTestJSON-162787281-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP dea3be4f-5eba-4d5f-9c17-377219f1f0b0 could not be found", "detail": ""}} {{(pid=140492) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 08 21:06:59.605876 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-184688dd-419c-40f6-90ed-02755f77d626 tempest-FloatingIPsNegativeTestJSON-162787281 tempest-FloatingIPsNegativeTestJSON-162787281-project] HTTP exception thrown: Floating IP not found for ID dea3be4f-5eba-4d5f-9c17-377219f1f0b0 Oct 08 21:06:59.607393 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-184688dd-419c-40f6-90ed-02755f77d626 tempest-FloatingIPsNegativeTestJSON-162787281 tempest-FloatingIPsNegativeTestJSON-162787281-project] Request method failure captured: Oct 08 21:06:59.607393 ncdv-master-1 devstack@n-api.service[140492]: request: DELETE /compute/v2.1/os-floating-ips/dea3be4f-5eba-4d5f-9c17-377219f1f0b0 HTTP/1.1 Oct 08 21:06:59.607393 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:06:59.607393 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:06:59.607393 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:06:59.607393 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 21:06:59.607393 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:06:59.607393 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:06:59.607393 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:06:59.607393 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:06:59.607393 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeZwTyVvlenVNbci1NY86D1EsfUuvWXTNgoZblUvsZaB76c723BEEKag1QF-WNo7LzwqJB3L3Fa2MF6JmtzQVpKVHuBe_Uvv-I8RTQWI2YtiwLUlUtZR8x4g03H8PqooLz4bjfyLm7NgreWCZl32s7SfPIPhBhynhPMe7lvlCmOHW48 Oct 08 21:06:59.607393 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:06:59.607393 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:06:59.607393 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:06:59.607393 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:06:59.607393 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:06:59.607393 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:06:59.607393 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 6aa299e3b5df41429787365c80c28be2 Oct 08 21:06:59.607393 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-162787281 Oct 08 21:06:59.607393 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:06:59.607393 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:06:59.607393 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6aa299e3b5df41429787365c80c28be2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6aa299e3b5df41429787365c80c28be2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6aa299e3b5df41429787365c80c28be2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6aa299e3b5df41429787365c80c28be2"}]}] Oct 08 21:06:59.607393 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-162787281 Oct 08 21:06:59.607393 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 6aa299e3b5df41429787365c80c28be2 Oct 08 21:06:59.607393 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-162787281 Oct 08 21:06:59.607393 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-FloatingIPsNegativeTestJSON-162787281-project Oct 08 21:06:59.607393 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:06:59.607393 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:06:59.607393 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 1a561700ae4f44e59b3dd81c136447d1 Oct 08 21:06:59.607393 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-162787281-project Oct 08 21:06:59.607393 ncdv-master-1 devstack@n-api.service[140492]: method: Oct 08 21:06:59.607393 ncdv-master-1 devstack@n-api.service[140492]: exception: Floating IP not found for ID dea3be4f-5eba-4d5f-9c17-377219f1f0b0 Oct 08 21:06:59.607393 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': 'dea3be4f-5eba-4d5f-9c17-377219f1f0b0'} Oct 08 21:06:59.607393 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:06:59.607393 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:06:59.607393 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 08 21:06:59.607393 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 08 21:06:59.607393 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 08 21:06:59.607393 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 08 21:06:59.607393 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 08 21:06:59.607393 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 08 21:06:59.607393 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 08 21:06:59.607393 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 08 21:06:59.607393 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 08 21:06:59.607393 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 08 21:06:59.607393 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 08 21:06:59.607393 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 08 21:06:59.607393 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 08 21:06:59.607393 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 08 21:06:59.607393 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 08 21:06:59.607393 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 08 21:06:59.607393 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 08 21:06:59.607393 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 08 21:06:59.607393 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 08 21:06:59.607393 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 08 21:06:59.607393 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 08 21:06:59.607393 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 08 21:06:59.607393 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 08 21:06:59.607393 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 08 21:06:59.607393 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP dea3be4f-5eba-4d5f-9c17-377219f1f0b0 could not be found Oct 08 21:06:59.607393 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b8a91b93-acb3-424e-9b9d-7d3fdf9eb89f'] Oct 08 21:06:59.623124 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:06:59.623124 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:06:59.623124 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:06:59.623124 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:06:59.623124 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Oct 08 21:06:59.623124 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 08 21:06:59.623124 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 08 21:06:59.623124 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 08 21:06:59.623124 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID dea3be4f-5eba-4d5f-9c17-377219f1f0b0. Oct 08 21:06:59.623124 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:06:59.623124 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:06:59.623124 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:06:59.623124 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:06:59.623124 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:06:59.623124 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:06:59.623124 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:06:59.623124 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:06:59.623124 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 08 21:06:59.623124 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 08 21:06:59.623124 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:06:59.623124 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:06:59.623124 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Oct 08 21:06:59.623124 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 08 21:06:59.623124 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID dea3be4f-5eba-4d5f-9c17-377219f1f0b0 Oct 08 21:06:59.623124 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:06:59.623124 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:06:59.623124 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:06:59.623124 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:06:59.623124 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:06:59.623124 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:06:59.623124 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:06:59.623124 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:06:59.623124 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID dea3be4f-5eba-4d5f-9c17-377219f1f0b0 Oct 08 21:06:59.623124 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:06:59.623124 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-184688dd-419c-40f6-90ed-02755f77d626 tempest-FloatingIPsNegativeTestJSON-162787281 tempest-FloatingIPsNegativeTestJSON-162787281-project] Returning 404 to user: Floating IP not found for ID dea3be4f-5eba-4d5f-9c17-377219f1f0b0 {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:06:59.623124 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-184688dd-419c-40f6-90ed-02755f77d626 tempest-FloatingIPsNegativeTestJSON-162787281 tempest-FloatingIPsNegativeTestJSON-162787281-project] 10.222.0.26 "DELETE /compute/v2.1/os-floating-ips/dea3be4f-5eba-4d5f-9c17-377219f1f0b0" status: 404 len: 111 microversion: 2.1 time: 0.130266 Oct 08 21:06:59.623124 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1839/3582] 10.222.0.26 () {58 vars in 1263 bytes} [Sat Oct 8 21:06:59 2022] DELETE /compute/v2.1/os-floating-ips/dea3be4f-5eba-4d5f-9c17-377219f1f0b0 => generated 111 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:06:59.630896 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-151d0d3f-0705-4295-9db3-1245dee91c4e tempest-SecurityGroupRulesNegativeTestJSON-960839001 tempest-SecurityGroupRulesNegativeTestJSON-960839001-project] Returning 400 to user: Invalid port range 680488219:22. Former value cannot be greater than the later {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:06:59.630896 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-151d0d3f-0705-4295-9db3-1245dee91c4e tempest-SecurityGroupRulesNegativeTestJSON-960839001 tempest-SecurityGroupRulesNegativeTestJSON-960839001-project] 10.222.0.26 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 122 microversion: 2.1 time: 0.165151 Oct 08 21:06:59.631258 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-9de0e2b1-5579-4d86-93ff-b57c2ff0d721 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:06:59.631258 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-9de0e2b1-5579-4d86-93ff-b57c2ff0d721 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] [instance: 4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:06:59.632188 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1744/3583] 10.222.0.26 () {60 vars in 1195 bytes} [Sat Oct 8 21:06:59 2022] POST /compute/v2.1/os-security-group-rules => generated 122 bytes in 171 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 08 21:06:59.643615 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-eac244e3-c7cd-4fd6-857c-d82b013a10be tempest-SecurityGroupRulesNegativeTestJSON-960839001 tempest-SecurityGroupRulesNegativeTestJSON-960839001-project] Action: 'create', calling method: .version_select at 0x7f1a877678b0>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-127137902", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:06:59.646382 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-eac244e3-c7cd-4fd6-857c-d82b013a10be tempest-SecurityGroupRulesNegativeTestJSON-960839001 tempest-SecurityGroupRulesNegativeTestJSON-960839001-project] HTTP exception thrown: Security group id should be uuid Oct 08 21:06:59.649538 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-eac244e3-c7cd-4fd6-857c-d82b013a10be tempest-SecurityGroupRulesNegativeTestJSON-960839001 tempest-SecurityGroupRulesNegativeTestJSON-960839001-project] Request method failure captured: Oct 08 21:06:59.649538 ncdv-master-1 devstack@n-api.service[140491]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 08 21:06:59.649538 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:06:59.649538 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:06:59.649538 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:06:59.649538 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 130 Oct 08 21:06:59.649538 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:06:59.649538 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:06:59.649538 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:06:59.649538 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:06:59.649538 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeZsEgsSeifeIwS2LvOLY7BpNT7rZsP9rx5NDnTxru-VJy6iU3Yk0rKg5eqpMLCAuzk_evQgT731B2l4x9YIJmif4OJm6UAhBW4AXVWkicrpMvl_pzTMMncuCJY5sEVi6af8a0FVsM1ATF84XR56aHoO9Oz5yOJ23OSpGE7MFB6ll9g Oct 08 21:06:59.649538 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:06:59.649538 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:06:59.649538 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:06:59.649538 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:06:59.649538 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:06:59.649538 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:06:59.649538 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: b96051fc89de47e1b636dcb23b6fdc30 Oct 08 21:06:59.649538 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-960839001 Oct 08 21:06:59.649538 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:06:59.649538 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:06:59.649538 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b96051fc89de47e1b636dcb23b6fdc30"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b96051fc89de47e1b636dcb23b6fdc30"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b96051fc89de47e1b636dcb23b6fdc30"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b96051fc89de47e1b636dcb23b6fdc30"}]}] Oct 08 21:06:59.649538 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-960839001 Oct 08 21:06:59.649538 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: b96051fc89de47e1b636dcb23b6fdc30 Oct 08 21:06:59.649538 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-960839001 Oct 08 21:06:59.649538 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-960839001-project Oct 08 21:06:59.649538 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:06:59.649538 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:06:59.649538 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 751127bd91a24297b248f59af3e069d4 Oct 08 21:06:59.649538 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-960839001-project Oct 08 21:06:59.649538 ncdv-master-1 devstack@n-api.service[140491]: Oct 08 21:06:59.649538 ncdv-master-1 devstack@n-api.service[140491]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-127137902", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 08 21:06:59.649538 ncdv-master-1 devstack@n-api.service[140491]: method: Oct 08 21:06:59.649538 ncdv-master-1 devstack@n-api.service[140491]: exception: Security group id should be uuid Oct 08 21:06:59.649538 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-127137902', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 08 21:06:59.649538 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:06:59.649538 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:06:59.649538 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Oct 08 21:06:59.649538 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Oct 08 21:06:59.649538 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Oct 08 21:06:59.649538 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Oct 08 21:06:59.649538 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Oct 08 21:06:59.649538 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:06:59.649538 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:06:59.649538 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:06:59.649538 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:06:59.649538 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:06:59.649538 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:06:59.649538 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:06:59.649538 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:06:59.649538 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 08 21:06:59.649538 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 08 21:06:59.649538 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:06:59.649538 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:06:59.649538 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 08 21:06:59.649538 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 08 21:06:59.649538 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Oct 08 21:06:59.649538 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:06:59.649538 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:06:59.649538 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:06:59.649538 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:06:59.649538 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:06:59.649538 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:06:59.649538 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:06:59.649538 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:06:59.654652 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Oct 08 21:06:59.654652 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:06:59.656322 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-eac244e3-c7cd-4fd6-857c-d82b013a10be tempest-SecurityGroupRulesNegativeTestJSON-960839001 tempest-SecurityGroupRulesNegativeTestJSON-960839001-project] Returning 400 to user: Security group id should be uuid {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:06:59.657457 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-eac244e3-c7cd-4fd6-857c-d82b013a10be tempest-SecurityGroupRulesNegativeTestJSON-960839001 tempest-SecurityGroupRulesNegativeTestJSON-960839001-project] 10.222.0.26 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.019969 Oct 08 21:06:59.658624 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1745/3584] 10.222.0.26 () {60 vars in 1195 bytes} [Sat Oct 8 21:06:59 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Oct 08 21:06:59.662032 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9de0e2b1-5579-4d86-93ff-b57c2ff0d721 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:59.662897 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9de0e2b1-5579-4d86-93ff-b57c2ff0d721 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:59.663371 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9de0e2b1-5579-4d86-93ff-b57c2ff0d721 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:59.668367 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9de0e2b1-5579-4d86-93ff-b57c2ff0d721 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:06:59.668926 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9de0e2b1-5579-4d86-93ff-b57c2ff0d721 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:06:59.669904 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9de0e2b1-5579-4d86-93ff-b57c2ff0d721 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:06:59.672670 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-b0d7648d-df08-4d67-b937-a3c62c475bba tempest-SecurityGroupRulesNegativeTestJSON-960839001 tempest-SecurityGroupRulesNegativeTestJSON-960839001-project] Action: 'create', calling method: .version_select at 0x7f1a8786d3a0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-2009980915", "description": "tempest-description-1564434202"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:06:59.689812 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:07:00.141875 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-b0d7648d-df08-4d67-b937-a3c62c475bba tempest-SecurityGroupRulesNegativeTestJSON-960839001 tempest-SecurityGroupRulesNegativeTestJSON-960839001-project] 10.222.0.26 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.477968 Oct 08 21:07:00.143910 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1746/3585] 10.222.0.26 () {60 vars in 1180 bytes} [Sat Oct 8 21:06:59 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 08 21:07:00.157860 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-fe74826b-cfc2-494d-8cea-cbd77826baed tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:00.159004 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-fe74826b-cfc2-494d-8cea-cbd77826baed tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: a0a81300-bb0a-4528-96eb-43c422f9df2d] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:07:00.197931 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fe74826b-cfc2-494d-8cea-cbd77826baed tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:00.199540 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fe74826b-cfc2-494d-8cea-cbd77826baed tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:00.204501 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fe74826b-cfc2-494d-8cea-cbd77826baed tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:00.206086 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fe74826b-cfc2-494d-8cea-cbd77826baed tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:00.209930 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fe74826b-cfc2-494d-8cea-cbd77826baed tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:00.211309 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fe74826b-cfc2-494d-8cea-cbd77826baed tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:00.263624 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-9de0e2b1-5579-4d86-93ff-b57c2ff0d721 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc2bdd169daf4a1db830b1fa7f94f0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f2d56477794f8ab38b8e3535b3e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:00.277958 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=100 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:07:00.291106 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-9de0e2b1-5579-4d86-93ff-b57c2ff0d721 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc2bdd169daf4a1db830b1fa7f94f0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f2d56477794f8ab38b8e3535b3e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:00.296843 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-9de0e2b1-5579-4d86-93ff-b57c2ff0d721 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc2bdd169daf4a1db830b1fa7f94f0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f2d56477794f8ab38b8e3535b3e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:00.298918 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-9de0e2b1-5579-4d86-93ff-b57c2ff0d721 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] 10.222.0.26 "GET /compute/v2.1/servers/4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21" status: 200 len: 1879 microversion: 2.32 time: 0.686864 Oct 08 21:07:00.300172 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1840/3586] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:06:59 2022] GET /compute/v2.1/servers/4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21 => generated 1879 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:07:00.323195 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-55d8e493-f3f1-4d40-a3df-d50cdf01b28b tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:00.324637 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-55d8e493-f3f1-4d40-a3df-d50cdf01b28b tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] [instance: dbacaeed-a40b-4e05-9635-5073dfdd8621] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:07:00.344805 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-55d8e493-f3f1-4d40-a3df-d50cdf01b28b tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:00.345405 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-55d8e493-f3f1-4d40-a3df-d50cdf01b28b tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:00.345867 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-55d8e493-f3f1-4d40-a3df-d50cdf01b28b tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:00.350815 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-55d8e493-f3f1-4d40-a3df-d50cdf01b28b tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:00.351928 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-55d8e493-f3f1-4d40-a3df-d50cdf01b28b tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:00.352384 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-55d8e493-f3f1-4d40-a3df-d50cdf01b28b tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:00.501333 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-fe74826b-cfc2-494d-8cea-cbd77826baed tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06443b5728fb4d1e95d6245820e786bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ded993145b4eda9d6a33b994519012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:00.513559 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-fe74826b-cfc2-494d-8cea-cbd77826baed tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "GET /compute/v2.1/servers/a0a81300-bb0a-4528-96eb-43c422f9df2d" status: 200 len: 1327 microversion: 2.1 time: 0.366044 Oct 08 21:07:00.515153 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1747/3587] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:07:00 2022] GET /compute/v2.1/servers/a0a81300-bb0a-4528-96eb-43c422f9df2d => generated 1327 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:07:00.542594 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c805c35c-04a6-4171-b3ce-00425cddfa96 tempest-SecurityGroupRulesNegativeTestJSON-960839001 tempest-SecurityGroupRulesNegativeTestJSON-960839001-project] Action: 'create', calling method: .version_select at 0x7f1a87702d30>, body: {"security_group_rule": {"parent_group_id": "0ab12ec5-42e0-4803-a74e-0ecb4633d565", "ip_protocol": "tempest-999-1074954682", "from_port": 22, "to_port": 22}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:07:00.649729 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-c805c35c-04a6-4171-b3ce-00425cddfa96 tempest-SecurityGroupRulesNegativeTestJSON-960839001 tempest-SecurityGroupRulesNegativeTestJSON-960839001-project] HTTP exception thrown: Invalid IP protocol tempest-999-1074954682. Oct 08 21:07:00.651334 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c805c35c-04a6-4171-b3ce-00425cddfa96 tempest-SecurityGroupRulesNegativeTestJSON-960839001 tempest-SecurityGroupRulesNegativeTestJSON-960839001-project] Request method failure captured: Oct 08 21:07:00.651334 ncdv-master-1 devstack@n-api.service[140491]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 08 21:07:00.651334 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:07:00.651334 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:07:00.651334 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:07:00.651334 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 157 Oct 08 21:07:00.651334 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:07:00.651334 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:07:00.651334 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:07:00.651334 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:07:00.651334 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeZsEgsSeifeIwS2LvOLY7BpNT7rZsP9rx5NDnTxru-VJy6iU3Yk0rKg5eqpMLCAuzk_evQgT731B2l4x9YIJmif4OJm6UAhBW4AXVWkicrpMvl_pzTMMncuCJY5sEVi6af8a0FVsM1ATF84XR56aHoO9Oz5yOJ23OSpGE7MFB6ll9g Oct 08 21:07:00.651334 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:07:00.651334 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:07:00.651334 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:07:00.651334 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:07:00.651334 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:07:00.651334 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:07:00.651334 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: b96051fc89de47e1b636dcb23b6fdc30 Oct 08 21:07:00.651334 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-960839001 Oct 08 21:07:00.651334 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:07:00.651334 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:07:00.651334 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b96051fc89de47e1b636dcb23b6fdc30"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b96051fc89de47e1b636dcb23b6fdc30"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b96051fc89de47e1b636dcb23b6fdc30"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b96051fc89de47e1b636dcb23b6fdc30"}]}] Oct 08 21:07:00.651334 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-960839001 Oct 08 21:07:00.651334 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: b96051fc89de47e1b636dcb23b6fdc30 Oct 08 21:07:00.651334 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-960839001 Oct 08 21:07:00.651334 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-960839001-project Oct 08 21:07:00.651334 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:07:00.651334 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:07:00.651334 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 751127bd91a24297b248f59af3e069d4 Oct 08 21:07:00.651334 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-960839001-project Oct 08 21:07:00.651334 ncdv-master-1 devstack@n-api.service[140491]: Oct 08 21:07:00.651334 ncdv-master-1 devstack@n-api.service[140491]: {"security_group_rule": {"parent_group_id": "0ab12ec5-42e0-4803-a74e-0ecb4633d565", "ip_protocol": "tempest-999-1074954682", "from_port": 22, "to_port": 22}} Oct 08 21:07:00.651334 ncdv-master-1 devstack@n-api.service[140491]: method: Oct 08 21:07:00.651334 ncdv-master-1 devstack@n-api.service[140491]: exception: Invalid IP protocol tempest-999-1074954682. Oct 08 21:07:00.651334 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'body': {'security_group_rule': {'parent_group_id': '0ab12ec5-42e0-4803-a74e-0ecb4633d565', 'ip_protocol': 'tempest-999-1074954682', 'from_port': 22, 'to_port': 22}}} Oct 08 21:07:00.651334 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:07:00.651334 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:07:00.651334 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 08 21:07:00.651334 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 08 21:07:00.651334 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 08 21:07:00.651334 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 08 21:07:00.651334 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 08 21:07:00.651334 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 08 21:07:00.651334 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Oct 08 21:07:00.651334 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Oct 08 21:07:00.651334 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-1074954682. Oct 08 21:07:00.651334 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:07:00.651334 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:07:00.651334 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:07:00.651334 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:07:00.651334 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:07:00.651334 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:07:00.651334 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:07:00.651334 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:07:00.651334 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 08 21:07:00.651334 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 08 21:07:00.651334 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:07:00.651334 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:07:00.651334 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 08 21:07:00.651334 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 08 21:07:00.651334 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-1074954682. Oct 08 21:07:00.651334 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:07:00.651334 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:07:00.655752 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:07:00.655752 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:07:00.655752 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:07:00.655752 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:07:00.655752 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:07:00.655752 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:07:00.655752 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-1074954682. Oct 08 21:07:00.655752 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:07:00.655752 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c805c35c-04a6-4171-b3ce-00425cddfa96 tempest-SecurityGroupRulesNegativeTestJSON-960839001 tempest-SecurityGroupRulesNegativeTestJSON-960839001-project] Returning 400 to user: Invalid IP protocol tempest-999-1074954682. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:07:00.655752 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-c805c35c-04a6-4171-b3ce-00425cddfa96 tempest-SecurityGroupRulesNegativeTestJSON-960839001 tempest-SecurityGroupRulesNegativeTestJSON-960839001-project] 10.222.0.26 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 87 microversion: 2.1 time: 0.117018 Oct 08 21:07:00.655752 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1748/3588] 10.222.0.26 () {60 vars in 1195 bytes} [Sat Oct 8 21:07:00 2022] POST /compute/v2.1/os-security-group-rules => generated 87 bytes in 118 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 08 21:07:00.662900 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-59b5de91-8974-4a61-b66b-851018c5d234 req-654f4b6a-cd5e-4799-95a0-04cc0fdbcd8e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0a81300-bb0a-4528-96eb-43c422f9df2d", "tag": "21962079-10a4-45c9-895a-3c1a967155b3"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:07:00.677170 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-59b5de91-8974-4a61-b66b-851018c5d234 req-654f4b6a-cd5e-4799-95a0-04cc0fdbcd8e service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:00.677959 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-59b5de91-8974-4a61-b66b-851018c5d234 req-654f4b6a-cd5e-4799-95a0-04cc0fdbcd8e service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:00.678123 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-59b5de91-8974-4a61-b66b-851018c5d234 req-654f4b6a-cd5e-4799-95a0-04cc0fdbcd8e service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:00.691202 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-59b5de91-8974-4a61-b66b-851018c5d234 req-654f4b6a-cd5e-4799-95a0-04cc0fdbcd8e service nova] Creating event network-changed:21962079-10a4-45c9-895a-3c1a967155b3 for instance a0a81300-bb0a-4528-96eb-43c422f9df2d on nch2-master-1 Oct 08 21:07:00.697905 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-59b5de91-8974-4a61-b66b-851018c5d234 req-654f4b6a-cd5e-4799-95a0-04cc0fdbcd8e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042485 Oct 08 21:07:00.699356 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1749/3589] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:07:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:07:00.709394 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c168bdbe-2459-49db-9bc9-7c9788018ac4 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:00.711315 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-c168bdbe-2459-49db-9bc9-7c9788018ac4 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] [instance: ee440f9f-69e9-4d96-bab6-92f73d08b9dd] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:07:00.720820 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c168bdbe-2459-49db-9bc9-7c9788018ac4 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:00.721499 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c168bdbe-2459-49db-9bc9-7c9788018ac4 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:00.722307 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c168bdbe-2459-49db-9bc9-7c9788018ac4 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:00.724389 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c168bdbe-2459-49db-9bc9-7c9788018ac4 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:00.725630 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c168bdbe-2459-49db-9bc9-7c9788018ac4 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:00.727605 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c168bdbe-2459-49db-9bc9-7c9788018ac4 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:00.737788 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-55d8e493-f3f1-4d40-a3df-d50cdf01b28b tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:00.752963 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-55d8e493-f3f1-4d40-a3df-d50cdf01b28b tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:00.758983 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-55d8e493-f3f1-4d40-a3df-d50cdf01b28b tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:00.765810 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-55d8e493-f3f1-4d40-a3df-d50cdf01b28b tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] 10.222.0.26 "GET /compute/v2.1/servers/dbacaeed-a40b-4e05-9635-5073dfdd8621" status: 200 len: 1721 microversion: 2.20 time: 0.463178 Oct 08 21:07:00.766760 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1841/3590] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:07:00 2022] GET /compute/v2.1/servers/dbacaeed-a40b-4e05-9635-5073dfdd8621 => generated 1721 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:07:00.786325 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-8bb95611-f0d6-4d96-9567-1aea3e91bc9a tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:00.786984 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-8bb95611-f0d6-4d96-9567-1aea3e91bc9a tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] [instance: ce4a2fbf-76f3-4577-a704-3b64ec30d84b] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:07:00.795470 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8bb95611-f0d6-4d96-9567-1aea3e91bc9a tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:00.795985 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8bb95611-f0d6-4d96-9567-1aea3e91bc9a tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:00.796484 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8bb95611-f0d6-4d96-9567-1aea3e91bc9a tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:00.799406 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8bb95611-f0d6-4d96-9567-1aea3e91bc9a tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:00.800136 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8bb95611-f0d6-4d96-9567-1aea3e91bc9a tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:00.801708 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8bb95611-f0d6-4d96-9567-1aea3e91bc9a tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:01.074701 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-c168bdbe-2459-49db-9bc9-7c9788018ac4 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcad18d0243f492591808197ca3dcc81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169293c01bf047358ff870a36c7a1247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:01.082968 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-c168bdbe-2459-49db-9bc9-7c9788018ac4 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] 10.222.0.26 "GET /compute/v2.1/servers/ee440f9f-69e9-4d96-bab6-92f73d08b9dd" status: 200 len: 1312 microversion: 2.1 time: 0.380984 Oct 08 21:07:01.090371 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1750/3591] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:07:00 2022] GET /compute/v2.1/servers/ee440f9f-69e9-4d96-bab6-92f73d08b9dd => generated 1312 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:07:01.100700 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-8bb95611-f0d6-4d96-9567-1aea3e91bc9a tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85abb492492343c58734564a2b26c8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68b14967e8249fd886f168d366f241f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:01.103247 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-dcf23672-153a-45fb-9cfc-ed9636bd965c tempest-SecurityGroupRulesNegativeTestJSON-960839001 tempest-SecurityGroupRulesNegativeTestJSON-960839001-project] Action: 'create', calling method: .version_select at 0x7f1a877a6790>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1964014651", "description": "tempest-description-155046659"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:07:01.116052 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-8bb95611-f0d6-4d96-9567-1aea3e91bc9a tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] 10.222.0.26 "GET /compute/v2.1/servers/ce4a2fbf-76f3-4577-a704-3b64ec30d84b" status: 200 len: 1714 microversion: 2.1 time: 0.345959 Oct 08 21:07:01.118156 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1842/3592] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:07:00 2022] GET /compute/v2.1/servers/ce4a2fbf-76f3-4577-a704-3b64ec30d84b => generated 1714 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:07:01.143436 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-fc7a9435-e1eb-44ac-8e1a-bd955cd15039 req-1167fe6f-e9b1-4649-92fe-24aae75582e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21", "name": "network-vif-plugged", "status": "completed", "tag": "9cbc0e0f-a528-4d53-9896-a83c004068d1"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:07:01.162301 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-fc7a9435-e1eb-44ac-8e1a-bd955cd15039 req-1167fe6f-e9b1-4649-92fe-24aae75582e9 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:01.163066 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-fc7a9435-e1eb-44ac-8e1a-bd955cd15039 req-1167fe6f-e9b1-4649-92fe-24aae75582e9 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:01.163668 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-fc7a9435-e1eb-44ac-8e1a-bd955cd15039 req-1167fe6f-e9b1-4649-92fe-24aae75582e9 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:01.182468 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-fc7a9435-e1eb-44ac-8e1a-bd955cd15039 req-1167fe6f-e9b1-4649-92fe-24aae75582e9 service nova] Creating event network-vif-plugged:9cbc0e0f-a528-4d53-9896-a83c004068d1 for instance 4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21 on nch1-master-1 Oct 08 21:07:01.201055 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-fc7a9435-e1eb-44ac-8e1a-bd955cd15039 req-1167fe6f-e9b1-4649-92fe-24aae75582e9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075689 Oct 08 21:07:01.202722 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1843/3593] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:07:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:07:01.334473 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-57cc39d2-92f3-49ec-8625-3677129285c6 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:01.335694 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-57cc39d2-92f3-49ec-8625-3677129285c6 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] [instance: 4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:07:01.340461 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:07:01.346815 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-57cc39d2-92f3-49ec-8625-3677129285c6 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:01.347410 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-57cc39d2-92f3-49ec-8625-3677129285c6 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:01.347872 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-57cc39d2-92f3-49ec-8625-3677129285c6 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:01.348975 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-57cc39d2-92f3-49ec-8625-3677129285c6 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:01.349494 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-57cc39d2-92f3-49ec-8625-3677129285c6 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:01.350187 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-57cc39d2-92f3-49ec-8625-3677129285c6 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:01.471914 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-dcf23672-153a-45fb-9cfc-ed9636bd965c tempest-SecurityGroupRulesNegativeTestJSON-960839001 tempest-SecurityGroupRulesNegativeTestJSON-960839001-project] 10.222.0.26 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.379188 Oct 08 21:07:01.473722 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1751/3594] 10.222.0.26 () {60 vars in 1180 bytes} [Sat Oct 8 21:07:01 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:07:01.529799 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-ea0f7de9-8697-4e05-930e-7d5029688e83 tempest-SecurityGroupRulesNegativeTestJSON-960839001 tempest-SecurityGroupRulesNegativeTestJSON-960839001-project] Action: 'create', calling method: .version_select at 0x7f1a87702e50>, body: {"security_group_rule": {"parent_group_id": "e43cf75b-8478-4e75-8e43-35c924ab8e7d", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:07:01.711156 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-ea0f7de9-8697-4e05-930e-7d5029688e83 tempest-SecurityGroupRulesNegativeTestJSON-960839001 tempest-SecurityGroupRulesNegativeTestJSON-960839001-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Oct 08 21:07:01.713453 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-ea0f7de9-8697-4e05-930e-7d5029688e83 tempest-SecurityGroupRulesNegativeTestJSON-960839001 tempest-SecurityGroupRulesNegativeTestJSON-960839001-project] Request method failure captured: Oct 08 21:07:01.713453 ncdv-master-1 devstack@n-api.service[140491]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 08 21:07:01.713453 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:07:01.713453 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:07:01.713453 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:07:01.713453 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 138 Oct 08 21:07:01.713453 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:07:01.713453 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:07:01.713453 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:07:01.713453 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:07:01.713453 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeZsEgsSeifeIwS2LvOLY7BpNT7rZsP9rx5NDnTxru-VJy6iU3Yk0rKg5eqpMLCAuzk_evQgT731B2l4x9YIJmif4OJm6UAhBW4AXVWkicrpMvl_pzTMMncuCJY5sEVi6af8a0FVsM1ATF84XR56aHoO9Oz5yOJ23OSpGE7MFB6ll9g Oct 08 21:07:01.713453 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:07:01.713453 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:07:01.713453 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:07:01.713453 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:07:01.713453 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:07:01.713453 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:07:01.713453 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: b96051fc89de47e1b636dcb23b6fdc30 Oct 08 21:07:01.713453 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-960839001 Oct 08 21:07:01.713453 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:07:01.713453 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:07:01.713453 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b96051fc89de47e1b636dcb23b6fdc30"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b96051fc89de47e1b636dcb23b6fdc30"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b96051fc89de47e1b636dcb23b6fdc30"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b96051fc89de47e1b636dcb23b6fdc30"}]}] Oct 08 21:07:01.713453 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-960839001 Oct 08 21:07:01.713453 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: b96051fc89de47e1b636dcb23b6fdc30 Oct 08 21:07:01.713453 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-960839001 Oct 08 21:07:01.713453 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-960839001-project Oct 08 21:07:01.713453 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:07:01.713453 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:07:01.713453 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 751127bd91a24297b248f59af3e069d4 Oct 08 21:07:01.713453 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-960839001-project Oct 08 21:07:01.713453 ncdv-master-1 devstack@n-api.service[140491]: Oct 08 21:07:01.713453 ncdv-master-1 devstack@n-api.service[140491]: {"security_group_rule": {"parent_group_id": "e43cf75b-8478-4e75-8e43-35c924ab8e7d", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Oct 08 21:07:01.713453 ncdv-master-1 devstack@n-api.service[140491]: method: Oct 08 21:07:01.713453 ncdv-master-1 devstack@n-api.service[140491]: exception: Invalid port range 22:21. Former value cannot be greater than the later Oct 08 21:07:01.713453 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'e43cf75b-8478-4e75-8e43-35c924ab8e7d', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Oct 08 21:07:01.713453 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:07:01.713453 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:07:01.713453 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 08 21:07:01.713453 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 08 21:07:01.713453 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 08 21:07:01.713453 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 08 21:07:01.713453 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 08 21:07:01.713453 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 08 21:07:01.713453 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Oct 08 21:07:01.713453 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 08 21:07:01.713453 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Oct 08 21:07:01.713453 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:07:01.713453 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:07:01.713453 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:07:01.713453 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:07:01.713453 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:07:01.713453 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:07:01.713453 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:07:01.713453 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:07:01.713453 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 08 21:07:01.713453 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 08 21:07:01.713453 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:07:01.713453 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:07:01.713453 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 08 21:07:01.713453 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 08 21:07:01.713453 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Oct 08 21:07:01.713453 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:07:01.719912 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:07:01.719912 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:07:01.719912 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:07:01.719912 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:07:01.719912 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:07:01.719912 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:07:01.719912 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:07:01.719912 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Oct 08 21:07:01.719912 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:07:01.719912 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-ea0f7de9-8697-4e05-930e-7d5029688e83 tempest-SecurityGroupRulesNegativeTestJSON-960839001 tempest-SecurityGroupRulesNegativeTestJSON-960839001-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:07:01.719912 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-ea0f7de9-8697-4e05-930e-7d5029688e83 tempest-SecurityGroupRulesNegativeTestJSON-960839001 tempest-SecurityGroupRulesNegativeTestJSON-960839001-project] 10.222.0.26 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.222770 Oct 08 21:07:01.725314 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1752/3595] 10.222.0.26 () {60 vars in 1195 bytes} [Sat Oct 8 21:07:01 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 236 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 08 21:07:01.737437 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-9424da84-5d4b-47b2-89fa-e51b0732ae7e tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:01.738351 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-9424da84-5d4b-47b2-89fa-e51b0732ae7e tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: a0a81300-bb0a-4528-96eb-43c422f9df2d] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:07:01.751891 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9424da84-5d4b-47b2-89fa-e51b0732ae7e tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:01.756143 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9424da84-5d4b-47b2-89fa-e51b0732ae7e tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:01.758342 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9424da84-5d4b-47b2-89fa-e51b0732ae7e tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:01.760360 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9424da84-5d4b-47b2-89fa-e51b0732ae7e tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:01.760950 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9424da84-5d4b-47b2-89fa-e51b0732ae7e tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:01.761743 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9424da84-5d4b-47b2-89fa-e51b0732ae7e tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:01.931173 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-57cc39d2-92f3-49ec-8625-3677129285c6 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc2bdd169daf4a1db830b1fa7f94f0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f2d56477794f8ab38b8e3535b3e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:01.954065 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-57cc39d2-92f3-49ec-8625-3677129285c6 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc2bdd169daf4a1db830b1fa7f94f0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f2d56477794f8ab38b8e3535b3e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:01.964509 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-57cc39d2-92f3-49ec-8625-3677129285c6 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc2bdd169daf4a1db830b1fa7f94f0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f2d56477794f8ab38b8e3535b3e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:01.967483 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-57cc39d2-92f3-49ec-8625-3677129285c6 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] 10.222.0.26 "GET /compute/v2.1/servers/4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21" status: 200 len: 1879 microversion: 2.32 time: 0.641928 Oct 08 21:07:01.970534 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1844/3596] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:07:01 2022] GET /compute/v2.1/servers/4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21 => generated 1879 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 08 21:07:01.989977 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-f1d8de38-9d83-45bc-8d6a-a69cad2acd02 tempest-SecurityGroupRulesNegativeTestJSON-960839001 tempest-SecurityGroupRulesNegativeTestJSON-960839001-project] Action: 'create', calling method: .version_select at 0x7f1a8c16a670>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1363045403", "description": "tempest-description-1747957654"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:07:02.056400 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-9424da84-5d4b-47b2-89fa-e51b0732ae7e tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06443b5728fb4d1e95d6245820e786bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ded993145b4eda9d6a33b994519012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:02.068634 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-9424da84-5d4b-47b2-89fa-e51b0732ae7e tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "GET /compute/v2.1/servers/a0a81300-bb0a-4528-96eb-43c422f9df2d" status: 200 len: 1327 microversion: 2.1 time: 0.341896 Oct 08 21:07:02.070390 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1753/3597] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:07:01 2022] GET /compute/v2.1/servers/a0a81300-bb0a-4528-96eb-43c422f9df2d => generated 1327 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:07:02.076437 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-883c35b5-dd02-4bbe-8c0e-483e075fdfc6 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:02.077461 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-883c35b5-dd02-4bbe-8c0e-483e075fdfc6 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] [instance: dbacaeed-a40b-4e05-9635-5073dfdd8621] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:07:02.085338 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-883c35b5-dd02-4bbe-8c0e-483e075fdfc6 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:02.086327 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-883c35b5-dd02-4bbe-8c0e-483e075fdfc6 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:02.086969 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-883c35b5-dd02-4bbe-8c0e-483e075fdfc6 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:02.088771 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-883c35b5-dd02-4bbe-8c0e-483e075fdfc6 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:02.091974 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-883c35b5-dd02-4bbe-8c0e-483e075fdfc6 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:02.092718 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-883c35b5-dd02-4bbe-8c0e-483e075fdfc6 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:02.337637 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-883c35b5-dd02-4bbe-8c0e-483e075fdfc6 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:02.352271 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-883c35b5-dd02-4bbe-8c0e-483e075fdfc6 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:02.359753 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-883c35b5-dd02-4bbe-8c0e-483e075fdfc6 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:02.362282 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-883c35b5-dd02-4bbe-8c0e-483e075fdfc6 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] 10.222.0.26 "GET /compute/v2.1/servers/dbacaeed-a40b-4e05-9635-5073dfdd8621" status: 200 len: 1724 microversion: 2.20 time: 0.289376 Oct 08 21:07:02.363087 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1754/3598] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:07:02 2022] GET /compute/v2.1/servers/dbacaeed-a40b-4e05-9635-5073dfdd8621 => generated 1724 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:07:02.378149 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-71b18c97-10ab-4d4c-8a83-e759348d5445 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:02.378782 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-71b18c97-10ab-4d4c-8a83-e759348d5445 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] [instance: ee440f9f-69e9-4d96-bab6-92f73d08b9dd] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:07:02.400550 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-71b18c97-10ab-4d4c-8a83-e759348d5445 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:02.401431 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-71b18c97-10ab-4d4c-8a83-e759348d5445 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:02.404152 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-71b18c97-10ab-4d4c-8a83-e759348d5445 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:02.405512 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-71b18c97-10ab-4d4c-8a83-e759348d5445 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:02.406168 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-71b18c97-10ab-4d4c-8a83-e759348d5445 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:02.407417 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-71b18c97-10ab-4d4c-8a83-e759348d5445 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:02.628315 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-71b18c97-10ab-4d4c-8a83-e759348d5445 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcad18d0243f492591808197ca3dcc81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169293c01bf047358ff870a36c7a1247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:02.640187 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-71b18c97-10ab-4d4c-8a83-e759348d5445 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] 10.222.0.26 "GET /compute/v2.1/servers/ee440f9f-69e9-4d96-bab6-92f73d08b9dd" status: 200 len: 1312 microversion: 2.1 time: 0.271301 Oct 08 21:07:02.640792 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1755/3599] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:07:02 2022] GET /compute/v2.1/servers/ee440f9f-69e9-4d96-bab6-92f73d08b9dd => generated 1312 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:07:02.650128 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-888fa9cd-e1d7-4c3b-bfe3-f6231779a6ea tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "31e209f5-1092-4499-a719-01507df30223"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:07:02.656332 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-888fa9cd-e1d7-4c3b-bfe3-f6231779a6ea tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] [instance: dbacaeed-a40b-4e05-9635-5073dfdd8621] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:07:02.667023 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-888fa9cd-e1d7-4c3b-bfe3-f6231779a6ea tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:02.667839 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-888fa9cd-e1d7-4c3b-bfe3-f6231779a6ea tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:02.668569 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-888fa9cd-e1d7-4c3b-bfe3-f6231779a6ea tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:02.670097 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-888fa9cd-e1d7-4c3b-bfe3-f6231779a6ea tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:02.670759 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-888fa9cd-e1d7-4c3b-bfe3-f6231779a6ea tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:02.671359 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-888fa9cd-e1d7-4c3b-bfe3-f6231779a6ea tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:02.809130 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-f1d8de38-9d83-45bc-8d6a-a69cad2acd02 tempest-SecurityGroupRulesNegativeTestJSON-960839001 tempest-SecurityGroupRulesNegativeTestJSON-960839001-project] 10.222.0.26 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.836456 Oct 08 21:07:02.810731 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1845/3600] 10.222.0.26 () {60 vars in 1180 bytes} [Sat Oct 8 21:07:01 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:07:02.832913 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-aae7f807-8a7f-408b-9372-34de8335150d tempest-SecurityGroupRulesNegativeTestJSON-960839001 tempest-SecurityGroupRulesNegativeTestJSON-960839001-project] Action: 'create', calling method: .version_select at 0x7f1a87e2fca0>, body: {"security_group_rule": {"parent_group_id": "2b81f2d7-3708-4596-b035-918d85d9b27f", "ip_protocol": "tcp", "from_port": 22, "to_port": 1951702244}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:07:02.976692 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=2 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:07:03.048044 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=6 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:07:03.225625 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-888fa9cd-e1d7-4c3b-bfe3-f6231779a6ea tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] 10.222.0.26 "POST /compute/v2.1/servers/dbacaeed-a40b-4e05-9635-5073dfdd8621/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.581456 Oct 08 21:07:03.232283 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1756/3601] 10.222.0.26 () {62 vars in 1364 bytes} [Sat Oct 8 21:07:02 2022] POST /compute/v2.1/servers/dbacaeed-a40b-4e05-9635-5073dfdd8621/os-volume_attachments => generated 188 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 08 21:07:03.240908 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-ee52fb8f-5a19-4597-861c-3ae8d98c714d tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:03.242590 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-ee52fb8f-5a19-4597-861c-3ae8d98c714d tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] [instance: 4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:07:03.256515 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-aae7f807-8a7f-408b-9372-34de8335150d tempest-SecurityGroupRulesNegativeTestJSON-960839001 tempest-SecurityGroupRulesNegativeTestJSON-960839001-project] HTTP exception thrown: Invalid port range 22:1951702244. Valid TCP ports should be between 1-65535 Oct 08 21:07:03.258951 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-aae7f807-8a7f-408b-9372-34de8335150d tempest-SecurityGroupRulesNegativeTestJSON-960839001 tempest-SecurityGroupRulesNegativeTestJSON-960839001-project] Request method failure captured: Oct 08 21:07:03.258951 ncdv-master-1 devstack@n-api.service[140492]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 08 21:07:03.258951 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:07:03.258951 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:07:03.258951 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:07:03.258951 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 146 Oct 08 21:07:03.258951 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:07:03.258951 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:07:03.258951 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:07:03.258951 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:07:03.258951 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeZsEgsSeifeIwS2LvOLY7BpNT7rZsP9rx5NDnTxru-VJy6iU3Yk0rKg5eqpMLCAuzk_evQgT731B2l4x9YIJmif4OJm6UAhBW4AXVWkicrpMvl_pzTMMncuCJY5sEVi6af8a0FVsM1ATF84XR56aHoO9Oz5yOJ23OSpGE7MFB6ll9g Oct 08 21:07:03.258951 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:07:03.258951 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:07:03.258951 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:07:03.258951 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:07:03.258951 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:07:03.258951 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:07:03.258951 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: b96051fc89de47e1b636dcb23b6fdc30 Oct 08 21:07:03.258951 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-960839001 Oct 08 21:07:03.258951 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:07:03.258951 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:07:03.258951 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b96051fc89de47e1b636dcb23b6fdc30"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b96051fc89de47e1b636dcb23b6fdc30"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b96051fc89de47e1b636dcb23b6fdc30"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b96051fc89de47e1b636dcb23b6fdc30"}]}] Oct 08 21:07:03.258951 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-960839001 Oct 08 21:07:03.258951 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: b96051fc89de47e1b636dcb23b6fdc30 Oct 08 21:07:03.258951 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-960839001 Oct 08 21:07:03.258951 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-960839001-project Oct 08 21:07:03.258951 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:07:03.258951 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:07:03.258951 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 751127bd91a24297b248f59af3e069d4 Oct 08 21:07:03.258951 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-960839001-project Oct 08 21:07:03.258951 ncdv-master-1 devstack@n-api.service[140492]: Oct 08 21:07:03.258951 ncdv-master-1 devstack@n-api.service[140492]: {"security_group_rule": {"parent_group_id": "2b81f2d7-3708-4596-b035-918d85d9b27f", "ip_protocol": "tcp", "from_port": 22, "to_port": 1951702244}} Oct 08 21:07:03.258951 ncdv-master-1 devstack@n-api.service[140492]: method: Oct 08 21:07:03.258951 ncdv-master-1 devstack@n-api.service[140492]: exception: Invalid port range 22:1951702244. Valid TCP ports should be between 1-65535 Oct 08 21:07:03.258951 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'body': {'security_group_rule': {'parent_group_id': '2b81f2d7-3708-4596-b035-918d85d9b27f', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 1951702244}}} Oct 08 21:07:03.258951 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:07:03.258951 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:07:03.258951 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 08 21:07:03.258951 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 08 21:07:03.258951 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 08 21:07:03.258951 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 08 21:07:03.258951 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 08 21:07:03.258951 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 08 21:07:03.258951 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Oct 08 21:07:03.258951 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 08 21:07:03.258951 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:1951702244. Valid TCP ports should be between 1-65535 Oct 08 21:07:03.258951 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:07:03.258951 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:07:03.258951 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:07:03.258951 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:07:03.258951 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:07:03.258951 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:07:03.258951 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:07:03.258951 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:07:03.258951 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 08 21:07:03.258951 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 08 21:07:03.258951 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:07:03.258951 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:07:03.258951 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 08 21:07:03.258951 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 08 21:07:03.258951 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:1951702244. Valid TCP ports should be between 1-65535 Oct 08 21:07:03.258951 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:07:03.263982 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:07:03.263982 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:07:03.263982 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:07:03.263982 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:07:03.263982 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:07:03.263982 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:07:03.263982 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:07:03.263982 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:1951702244. Valid TCP ports should be between 1-65535 Oct 08 21:07:03.263982 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:07:03.267803 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-aae7f807-8a7f-408b-9372-34de8335150d tempest-SecurityGroupRulesNegativeTestJSON-960839001 tempest-SecurityGroupRulesNegativeTestJSON-960839001-project] Returning 400 to user: Invalid port range 22:1951702244. Valid TCP ports should be between 1-65535 {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:07:03.268956 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-aae7f807-8a7f-408b-9372-34de8335150d tempest-SecurityGroupRulesNegativeTestJSON-960839001 tempest-SecurityGroupRulesNegativeTestJSON-960839001-project] 10.222.0.26 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 119 microversion: 2.1 time: 0.448210 Oct 08 21:07:03.270057 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1846/3602] 10.222.0.26 () {60 vars in 1195 bytes} [Sat Oct 8 21:07:02 2022] POST /compute/v2.1/os-security-group-rules => generated 119 bytes in 450 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 08 21:07:03.272621 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ee52fb8f-5a19-4597-861c-3ae8d98c714d tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:03.273525 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ee52fb8f-5a19-4597-861c-3ae8d98c714d tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:03.274209 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ee52fb8f-5a19-4597-861c-3ae8d98c714d tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:03.280229 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ee52fb8f-5a19-4597-861c-3ae8d98c714d tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:03.281272 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ee52fb8f-5a19-4597-861c-3ae8d98c714d tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:03.281741 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-f8d49608-5604-4dcb-8488-79508acaf51a tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:03.282379 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ee52fb8f-5a19-4597-861c-3ae8d98c714d tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:03.283396 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-f8d49608-5604-4dcb-8488-79508acaf51a tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: a0a81300-bb0a-4528-96eb-43c422f9df2d] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:07:03.311606 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f8d49608-5604-4dcb-8488-79508acaf51a tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:03.326889 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f8d49608-5604-4dcb-8488-79508acaf51a tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:03.329137 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f8d49608-5604-4dcb-8488-79508acaf51a tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:03.330795 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f8d49608-5604-4dcb-8488-79508acaf51a tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:03.332547 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f8d49608-5604-4dcb-8488-79508acaf51a tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:03.335920 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f8d49608-5604-4dcb-8488-79508acaf51a tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:03.570110 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-ee52fb8f-5a19-4597-861c-3ae8d98c714d tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc2bdd169daf4a1db830b1fa7f94f0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f2d56477794f8ab38b8e3535b3e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:03.580603 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-ee52fb8f-5a19-4597-861c-3ae8d98c714d tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc2bdd169daf4a1db830b1fa7f94f0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f2d56477794f8ab38b8e3535b3e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:03.582473 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-ee52fb8f-5a19-4597-861c-3ae8d98c714d tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc2bdd169daf4a1db830b1fa7f94f0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f2d56477794f8ab38b8e3535b3e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:03.583968 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-ee52fb8f-5a19-4597-861c-3ae8d98c714d tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] 10.222.0.26 "GET /compute/v2.1/servers/4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21" status: 200 len: 1879 microversion: 2.32 time: 0.350148 Oct 08 21:07:03.602923 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1757/3603] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:07:03 2022] GET /compute/v2.1/servers/4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21 => generated 1879 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:07:03.608717 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-747eadcf-dd02-4ee6-a3de-2f6ac63beba6 req-3d5e79d4-2837-48f1-b22a-e4e9b4bce8a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21", "name": "network-vif-plugged", "status": "completed", "tag": "5335fdc0-eb0a-483f-85b3-3278a5303d53"}, {"server_uuid": "4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21", "name": "network-vif-plugged", "status": "completed", "tag": "35b26276-a306-4edc-9bc3-3ed3302b5672"}, {"server_uuid": "4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21", "name": "network-vif-plugged", "status": "completed", "tag": "2a5f9012-714b-4b2f-b172-487879914396"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:07:03.627269 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-747eadcf-dd02-4ee6-a3de-2f6ac63beba6 req-3d5e79d4-2837-48f1-b22a-e4e9b4bce8a8 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:03.628462 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-747eadcf-dd02-4ee6-a3de-2f6ac63beba6 req-3d5e79d4-2837-48f1-b22a-e4e9b4bce8a8 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:03.629254 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-747eadcf-dd02-4ee6-a3de-2f6ac63beba6 req-3d5e79d4-2837-48f1-b22a-e4e9b4bce8a8 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:03.644730 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-747eadcf-dd02-4ee6-a3de-2f6ac63beba6 req-3d5e79d4-2837-48f1-b22a-e4e9b4bce8a8 service nova] Creating event network-vif-plugged:5335fdc0-eb0a-483f-85b3-3278a5303d53 for instance 4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21 on nch1-master-1 Oct 08 21:07:03.646439 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-747eadcf-dd02-4ee6-a3de-2f6ac63beba6 req-3d5e79d4-2837-48f1-b22a-e4e9b4bce8a8 service nova] Creating event network-vif-plugged:35b26276-a306-4edc-9bc3-3ed3302b5672 for instance 4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21 on nch1-master-1 Oct 08 21:07:03.647182 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-747eadcf-dd02-4ee6-a3de-2f6ac63beba6 req-3d5e79d4-2837-48f1-b22a-e4e9b4bce8a8 service nova] Creating event network-vif-plugged:2a5f9012-714b-4b2f-b172-487879914396 for instance 4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21 on nch1-master-1 Oct 08 21:07:03.659319 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-747eadcf-dd02-4ee6-a3de-2f6ac63beba6 req-3d5e79d4-2837-48f1-b22a-e4e9b4bce8a8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.060990 Oct 08 21:07:03.663941 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1758/3604] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:07:03 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:07:03.671176 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-ecb26368-f004-469a-bda1-e6bbda4a2be1 tempest-SecurityGroupRulesNegativeTestJSON-960839001 tempest-SecurityGroupRulesNegativeTestJSON-960839001-project] Action: 'create', calling method: .version_select at 0x7f1a87fe51f0>, body: {"security_group_rule": {"parent_group_id": "d70735d9-5bcf-4552-b5a6-2d7c06c0229a", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:07:03.702821 ncdv-master-1 devstack@n-api.service[140491]: DEBUG neutronclient.v2_0.client [None req-ecb26368-f004-469a-bda1-e6bbda4a2be1 tempest-SecurityGroupRulesNegativeTestJSON-960839001 tempest-SecurityGroupRulesNegativeTestJSON-960839001-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group d70735d9-5bcf-4552-b5a6-2d7c06c0229a does not exist", "detail": ""}} {{(pid=140491) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 08 21:07:03.703753 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.network.security_group_api [None req-ecb26368-f004-469a-bda1-e6bbda4a2be1 tempest-SecurityGroupRulesNegativeTestJSON-960839001 tempest-SecurityGroupRulesNegativeTestJSON-960839001-project] Neutron security group d70735d9-5bcf-4552-b5a6-2d7c06c0229a not found {{(pid=140491) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 08 21:07:03.704478 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-ecb26368-f004-469a-bda1-e6bbda4a2be1 tempest-SecurityGroupRulesNegativeTestJSON-960839001 tempest-SecurityGroupRulesNegativeTestJSON-960839001-project] HTTP exception thrown: Security group d70735d9-5bcf-4552-b5a6-2d7c06c0229a does not exist Oct 08 21:07:03.704478 ncdv-master-1 devstack@n-api.service[140491]: Neutron server returns request_ids: ['req-7b79fcc7-5623-492b-aa04-ecd63b2f21fc'] Oct 08 21:07:03.706679 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-ecb26368-f004-469a-bda1-e6bbda4a2be1 tempest-SecurityGroupRulesNegativeTestJSON-960839001 tempest-SecurityGroupRulesNegativeTestJSON-960839001-project] Request method failure captured: Oct 08 21:07:03.706679 ncdv-master-1 devstack@n-api.service[140491]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 08 21:07:03.706679 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:07:03.706679 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:07:03.706679 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:07:03.706679 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 138 Oct 08 21:07:03.706679 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:07:03.706679 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:07:03.706679 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:07:03.706679 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:07:03.706679 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeZsEgsSeifeIwS2LvOLY7BpNT7rZsP9rx5NDnTxru-VJy6iU3Yk0rKg5eqpMLCAuzk_evQgT731B2l4x9YIJmif4OJm6UAhBW4AXVWkicrpMvl_pzTMMncuCJY5sEVi6af8a0FVsM1ATF84XR56aHoO9Oz5yOJ23OSpGE7MFB6ll9g Oct 08 21:07:03.706679 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:07:03.706679 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:07:03.706679 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:07:03.706679 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:07:03.706679 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:07:03.706679 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:07:03.706679 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: b96051fc89de47e1b636dcb23b6fdc30 Oct 08 21:07:03.706679 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-960839001 Oct 08 21:07:03.706679 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:07:03.706679 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:07:03.706679 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b96051fc89de47e1b636dcb23b6fdc30"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b96051fc89de47e1b636dcb23b6fdc30"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b96051fc89de47e1b636dcb23b6fdc30"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b96051fc89de47e1b636dcb23b6fdc30"}]}] Oct 08 21:07:03.706679 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-960839001 Oct 08 21:07:03.706679 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: b96051fc89de47e1b636dcb23b6fdc30 Oct 08 21:07:03.706679 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-960839001 Oct 08 21:07:03.706679 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-960839001-project Oct 08 21:07:03.706679 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:07:03.706679 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:07:03.706679 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 751127bd91a24297b248f59af3e069d4 Oct 08 21:07:03.706679 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-960839001-project Oct 08 21:07:03.706679 ncdv-master-1 devstack@n-api.service[140491]: Oct 08 21:07:03.706679 ncdv-master-1 devstack@n-api.service[140491]: {"security_group_rule": {"parent_group_id": "d70735d9-5bcf-4552-b5a6-2d7c06c0229a", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 08 21:07:03.706679 ncdv-master-1 devstack@n-api.service[140491]: method: Oct 08 21:07:03.706679 ncdv-master-1 devstack@n-api.service[140491]: exception: Security group d70735d9-5bcf-4552-b5a6-2d7c06c0229a does not exist Oct 08 21:07:03.706679 ncdv-master-1 devstack@n-api.service[140491]: Neutron server returns request_ids: ['req-7b79fcc7-5623-492b-aa04-ecd63b2f21fc'] Oct 08 21:07:03.706679 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'd70735d9-5bcf-4552-b5a6-2d7c06c0229a', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 08 21:07:03.706679 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:07:03.706679 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:07:03.706679 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 08 21:07:03.706679 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 08 21:07:03.706679 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 08 21:07:03.706679 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 08 21:07:03.706679 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 08 21:07:03.706679 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 08 21:07:03.706679 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 08 21:07:03.706679 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 08 21:07:03.706679 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 08 21:07:03.706679 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 08 21:07:03.706679 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 08 21:07:03.706679 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 08 21:07:03.706679 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 08 21:07:03.706679 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 08 21:07:03.706679 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 08 21:07:03.706679 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 08 21:07:03.706679 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 08 21:07:03.706679 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 08 21:07:03.706679 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 08 21:07:03.706679 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 08 21:07:03.706679 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 08 21:07:03.706679 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 08 21:07:03.706679 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 08 21:07:03.712628 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 08 21:07:03.712628 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group d70735d9-5bcf-4552-b5a6-2d7c06c0229a does not exist Oct 08 21:07:03.712628 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7b79fcc7-5623-492b-aa04-ecd63b2f21fc'] Oct 08 21:07:03.712628 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:07:03.712628 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:07:03.712628 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:07:03.712628 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:07:03.712628 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Oct 08 21:07:03.712628 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Oct 08 21:07:03.712628 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 08 21:07:03.712628 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 08 21:07:03.712628 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group d70735d9-5bcf-4552-b5a6-2d7c06c0229a does not exist Oct 08 21:07:03.712628 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7b79fcc7-5623-492b-aa04-ecd63b2f21fc'] Oct 08 21:07:03.712628 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:07:03.712628 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:07:03.712628 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:07:03.712628 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:07:03.712628 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:07:03.712628 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:07:03.712628 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:07:03.712628 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:07:03.712628 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 08 21:07:03.712628 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 08 21:07:03.712628 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:07:03.712628 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:07:03.712628 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Oct 08 21:07:03.712628 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 08 21:07:03.712628 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group d70735d9-5bcf-4552-b5a6-2d7c06c0229a does not exist Oct 08 21:07:03.712628 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7b79fcc7-5623-492b-aa04-ecd63b2f21fc'] Oct 08 21:07:03.712628 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:07:03.712628 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:07:03.712628 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:07:03.712628 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:07:03.712628 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:07:03.712628 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:07:03.712628 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:07:03.712628 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:07:03.712628 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group d70735d9-5bcf-4552-b5a6-2d7c06c0229a does not exist Oct 08 21:07:03.712628 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7b79fcc7-5623-492b-aa04-ecd63b2f21fc'] Oct 08 21:07:03.712628 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:07:03.712628 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-ecb26368-f004-469a-bda1-e6bbda4a2be1 tempest-SecurityGroupRulesNegativeTestJSON-960839001 tempest-SecurityGroupRulesNegativeTestJSON-960839001-project] Returning 404 to user: Security group d70735d9-5bcf-4552-b5a6-2d7c06c0229a does not exist Oct 08 21:07:03.712628 ncdv-master-1 devstack@n-api.service[140491]: Neutron server returns request_ids: ['req-7b79fcc7-5623-492b-aa04-ecd63b2f21fc'] {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:07:03.712628 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-ecb26368-f004-469a-bda1-e6bbda4a2be1 tempest-SecurityGroupRulesNegativeTestJSON-960839001 tempest-SecurityGroupRulesNegativeTestJSON-960839001-project] 10.222.0.26 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.042590 Oct 08 21:07:03.712628 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1759/3605] 10.222.0.26 () {60 vars in 1195 bytes} [Sat Oct 8 21:07:03 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:07:03.722702 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-1fb4118c-78e0-4772-9c10-eaff6397658b tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:07:03.723215 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-1fb4118c-78e0-4772-9c10-eaff6397658b tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] [instance: dbacaeed-a40b-4e05-9635-5073dfdd8621] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:07:03.741227 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1fb4118c-78e0-4772-9c10-eaff6397658b tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:03.742126 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1fb4118c-78e0-4772-9c10-eaff6397658b tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:03.742974 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1fb4118c-78e0-4772-9c10-eaff6397658b tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:03.744404 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1fb4118c-78e0-4772-9c10-eaff6397658b tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:03.745655 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1fb4118c-78e0-4772-9c10-eaff6397658b tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:03.746334 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1fb4118c-78e0-4772-9c10-eaff6397658b tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:03.813840 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-1fb4118c-78e0-4772-9c10-eaff6397658b tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] [instance: dbacaeed-a40b-4e05-9635-5073dfdd8621] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=140491) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 08 21:07:03.965756 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-1fb4118c-78e0-4772-9c10-eaff6397658b tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] 10.222.0.26 "POST /compute/v2.1/servers/dbacaeed-a40b-4e05-9635-5073dfdd8621/action" status: 202 len: 0 microversion: 2.20 time: 0.255244 Oct 08 21:07:03.966655 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1760/3606] 10.222.0.26 () {62 vars in 1319 bytes} [Sat Oct 8 21:07:03 2022] POST /compute/v2.1/servers/dbacaeed-a40b-4e05-9635-5073dfdd8621/action => generated 0 bytes in 257 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 08 21:07:03.972494 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-e93244bd-6550-4c5a-96b4-20d1807f86f1 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:03.973414 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-e93244bd-6550-4c5a-96b4-20d1807f86f1 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] [instance: ee440f9f-69e9-4d96-bab6-92f73d08b9dd] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:07:03.988513 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e93244bd-6550-4c5a-96b4-20d1807f86f1 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:03.989023 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e93244bd-6550-4c5a-96b4-20d1807f86f1 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:03.989511 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e93244bd-6550-4c5a-96b4-20d1807f86f1 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:03.990225 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e93244bd-6550-4c5a-96b4-20d1807f86f1 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:03.990687 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e93244bd-6550-4c5a-96b4-20d1807f86f1 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:03.991114 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e93244bd-6550-4c5a-96b4-20d1807f86f1 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:04.144675 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=6 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:07:04.207398 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-e93244bd-6550-4c5a-96b4-20d1807f86f1 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcad18d0243f492591808197ca3dcc81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169293c01bf047358ff870a36c7a1247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:04.226324 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-e93244bd-6550-4c5a-96b4-20d1807f86f1 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] 10.222.0.26 "GET /compute/v2.1/servers/ee440f9f-69e9-4d96-bab6-92f73d08b9dd" status: 200 len: 1312 microversion: 2.1 time: 0.258083 Oct 08 21:07:04.228890 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1761/3607] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:07:03 2022] GET /compute/v2.1/servers/ee440f9f-69e9-4d96-bab6-92f73d08b9dd => generated 1312 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:07:04.247055 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-6f1f8087-293f-4253-bff6-1ff765109b63 tempest-SecurityGroupRulesNegativeTestJSON-960839001 tempest-SecurityGroupRulesNegativeTestJSON-960839001-project] Calling method '.version_select at 0x7f1a8776c310>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:04.275947 ncdv-master-1 devstack@n-api.service[140491]: DEBUG neutronclient.v2_0.client [None req-6f1f8087-293f-4253-bff6-1ff765109b63 tempest-SecurityGroupRulesNegativeTestJSON-960839001 tempest-SecurityGroupRulesNegativeTestJSON-960839001-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule 0fee6aed-20ff-4e02-ba87-b3969a81cea2 does not exist", "detail": ""}} {{(pid=140491) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 08 21:07:04.276883 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.network.security_group_api [None req-6f1f8087-293f-4253-bff6-1ff765109b63 tempest-SecurityGroupRulesNegativeTestJSON-960839001 tempest-SecurityGroupRulesNegativeTestJSON-960839001-project] Neutron security group rule 0fee6aed-20ff-4e02-ba87-b3969a81cea2 not found {{(pid=140491) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Oct 08 21:07:04.277556 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-6f1f8087-293f-4253-bff6-1ff765109b63 tempest-SecurityGroupRulesNegativeTestJSON-960839001 tempest-SecurityGroupRulesNegativeTestJSON-960839001-project] HTTP exception thrown: Security group rule 0fee6aed-20ff-4e02-ba87-b3969a81cea2 does not exist Oct 08 21:07:04.277556 ncdv-master-1 devstack@n-api.service[140491]: Neutron server returns request_ids: ['req-944b20e8-75a8-40d8-ba8d-bf1b88519d4f'] Oct 08 21:07:04.281043 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-6f1f8087-293f-4253-bff6-1ff765109b63 tempest-SecurityGroupRulesNegativeTestJSON-960839001 tempest-SecurityGroupRulesNegativeTestJSON-960839001-project] Request method failure captured: Oct 08 21:07:04.281043 ncdv-master-1 devstack@n-api.service[140491]: request: DELETE /compute/v2.1/os-security-group-rules/0fee6aed-20ff-4e02-ba87-b3969a81cea2 HTTP/1.1 Oct 08 21:07:04.281043 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:07:04.281043 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:07:04.281043 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:07:04.281043 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 21:07:04.281043 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:07:04.281043 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:07:04.281043 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:07:04.281043 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:07:04.281043 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeZsEgsSeifeIwS2LvOLY7BpNT7rZsP9rx5NDnTxru-VJy6iU3Yk0rKg5eqpMLCAuzk_evQgT731B2l4x9YIJmif4OJm6UAhBW4AXVWkicrpMvl_pzTMMncuCJY5sEVi6af8a0FVsM1ATF84XR56aHoO9Oz5yOJ23OSpGE7MFB6ll9g Oct 08 21:07:04.281043 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:07:04.281043 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:07:04.281043 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:07:04.281043 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:07:04.281043 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:07:04.281043 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:07:04.281043 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: b96051fc89de47e1b636dcb23b6fdc30 Oct 08 21:07:04.281043 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-960839001 Oct 08 21:07:04.281043 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:07:04.281043 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:07:04.281043 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b96051fc89de47e1b636dcb23b6fdc30"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b96051fc89de47e1b636dcb23b6fdc30"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b96051fc89de47e1b636dcb23b6fdc30"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b96051fc89de47e1b636dcb23b6fdc30"}]}] Oct 08 21:07:04.281043 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-960839001 Oct 08 21:07:04.281043 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: b96051fc89de47e1b636dcb23b6fdc30 Oct 08 21:07:04.281043 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-960839001 Oct 08 21:07:04.281043 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-960839001-project Oct 08 21:07:04.281043 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:07:04.281043 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:07:04.281043 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 751127bd91a24297b248f59af3e069d4 Oct 08 21:07:04.281043 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-960839001-project Oct 08 21:07:04.281043 ncdv-master-1 devstack@n-api.service[140491]: method: Oct 08 21:07:04.281043 ncdv-master-1 devstack@n-api.service[140491]: exception: Security group rule 0fee6aed-20ff-4e02-ba87-b3969a81cea2 does not exist Oct 08 21:07:04.281043 ncdv-master-1 devstack@n-api.service[140491]: Neutron server returns request_ids: ['req-944b20e8-75a8-40d8-ba8d-bf1b88519d4f'] Oct 08 21:07:04.281043 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': '0fee6aed-20ff-4e02-ba87-b3969a81cea2'} Oct 08 21:07:04.281043 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:07:04.281043 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:07:04.281043 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Oct 08 21:07:04.281043 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Oct 08 21:07:04.281043 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 08 21:07:04.281043 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 08 21:07:04.281043 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1092, in show_security_group_rule Oct 08 21:07:04.281043 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Oct 08 21:07:04.281043 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 08 21:07:04.281043 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 08 21:07:04.281043 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 08 21:07:04.281043 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 08 21:07:04.281043 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 08 21:07:04.281043 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 08 21:07:04.281043 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 08 21:07:04.281043 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 08 21:07:04.281043 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 08 21:07:04.281043 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 08 21:07:04.281043 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 08 21:07:04.281043 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 08 21:07:04.281043 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 08 21:07:04.281043 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 08 21:07:04.281043 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 08 21:07:04.281043 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 08 21:07:04.281043 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 08 21:07:04.281043 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 08 21:07:04.285591 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule 0fee6aed-20ff-4e02-ba87-b3969a81cea2 does not exist Oct 08 21:07:04.285591 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-944b20e8-75a8-40d8-ba8d-bf1b88519d4f'] Oct 08 21:07:04.285591 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:07:04.285591 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:07:04.285591 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:07:04.285591 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:07:04.285591 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Oct 08 21:07:04.285591 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Oct 08 21:07:04.285591 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Oct 08 21:07:04.285591 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 08 21:07:04.285591 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule 0fee6aed-20ff-4e02-ba87-b3969a81cea2 does not exist Oct 08 21:07:04.285591 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-944b20e8-75a8-40d8-ba8d-bf1b88519d4f'] Oct 08 21:07:04.285591 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:07:04.285591 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:07:04.285591 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:07:04.285591 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:07:04.285591 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:07:04.285591 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:07:04.285591 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:07:04.285591 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:07:04.285591 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 08 21:07:04.285591 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 08 21:07:04.285591 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:07:04.285591 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:07:04.285591 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Oct 08 21:07:04.285591 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 08 21:07:04.285591 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule 0fee6aed-20ff-4e02-ba87-b3969a81cea2 does not exist Oct 08 21:07:04.285591 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-944b20e8-75a8-40d8-ba8d-bf1b88519d4f'] Oct 08 21:07:04.285591 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:07:04.285591 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:07:04.285591 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:07:04.285591 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:07:04.285591 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:07:04.285591 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:07:04.285591 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:07:04.285591 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:07:04.285591 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule 0fee6aed-20ff-4e02-ba87-b3969a81cea2 does not exist Oct 08 21:07:04.285591 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-944b20e8-75a8-40d8-ba8d-bf1b88519d4f'] Oct 08 21:07:04.285591 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:07:04.292353 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-6f1f8087-293f-4253-bff6-1ff765109b63 tempest-SecurityGroupRulesNegativeTestJSON-960839001 tempest-SecurityGroupRulesNegativeTestJSON-960839001-project] Returning 404 to user: Security group rule 0fee6aed-20ff-4e02-ba87-b3969a81cea2 does not exist Oct 08 21:07:04.292353 ncdv-master-1 devstack@n-api.service[140491]: Neutron server returns request_ids: ['req-944b20e8-75a8-40d8-ba8d-bf1b88519d4f'] {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:07:04.294175 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-6f1f8087-293f-4253-bff6-1ff765109b63 tempest-SecurityGroupRulesNegativeTestJSON-960839001 tempest-SecurityGroupRulesNegativeTestJSON-960839001-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-group-rules/0fee6aed-20ff-4e02-ba87-b3969a81cea2" status: 404 len: 199 microversion: 2.1 time: 0.056760 Oct 08 21:07:04.295318 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1762/3608] 10.222.0.26 () {58 vars in 1287 bytes} [Sat Oct 8 21:07:04 2022] DELETE /compute/v2.1/os-security-group-rules/0fee6aed-20ff-4e02-ba87-b3969a81cea2 => generated 199 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:07:04.302140 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-691eca79-68d2-4254-95f5-f71baffccda4 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:04.303507 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-691eca79-68d2-4254-95f5-f71baffccda4 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] [instance: dbacaeed-a40b-4e05-9635-5073dfdd8621] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:07:04.313043 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-691eca79-68d2-4254-95f5-f71baffccda4 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:04.314001 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-691eca79-68d2-4254-95f5-f71baffccda4 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:04.314636 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-691eca79-68d2-4254-95f5-f71baffccda4 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:04.315358 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-691eca79-68d2-4254-95f5-f71baffccda4 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:04.316080 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-691eca79-68d2-4254-95f5-f71baffccda4 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:04.316678 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-691eca79-68d2-4254-95f5-f71baffccda4 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:04.351465 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-f8d49608-5604-4dcb-8488-79508acaf51a tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06443b5728fb4d1e95d6245820e786bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ded993145b4eda9d6a33b994519012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:04.365092 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-f8d49608-5604-4dcb-8488-79508acaf51a tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "GET /compute/v2.1/servers/a0a81300-bb0a-4528-96eb-43c422f9df2d" status: 200 len: 1327 microversion: 2.1 time: 1.093742 Oct 08 21:07:04.365726 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1847/3609] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:07:03 2022] GET /compute/v2.1/servers/a0a81300-bb0a-4528-96eb-43c422f9df2d => generated 1327 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:07:04.385299 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-af727a3e-7f6f-4402-8432-afa68f2a03ea tempest-SecurityGroupRulesNegativeTestJSON-960839001 tempest-SecurityGroupRulesNegativeTestJSON-960839001-project] Calling method '.version_select at 0x7f1a8d304af0>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:04.507328 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-691eca79-68d2-4254-95f5-f71baffccda4 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:04.519637 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-691eca79-68d2-4254-95f5-f71baffccda4 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:04.521273 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-691eca79-68d2-4254-95f5-f71baffccda4 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:04.522486 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-691eca79-68d2-4254-95f5-f71baffccda4 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] 10.222.0.26 "GET /compute/v2.1/servers/dbacaeed-a40b-4e05-9635-5073dfdd8621" status: 200 len: 1750 microversion: 2.20 time: 0.226052 Oct 08 21:07:04.533840 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1763/3610] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:07:04 2022] GET /compute/v2.1/servers/dbacaeed-a40b-4e05-9635-5073dfdd8621 => generated 1750 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:07:04.611970 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-12461b6a-a2c3-497b-a0a5-4138cf0db5cf tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:04.612720 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-12461b6a-a2c3-497b-a0a5-4138cf0db5cf tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] [instance: 4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:07:04.622505 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-12461b6a-a2c3-497b-a0a5-4138cf0db5cf tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:04.623500 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-12461b6a-a2c3-497b-a0a5-4138cf0db5cf tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:04.624411 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-12461b6a-a2c3-497b-a0a5-4138cf0db5cf tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:04.625718 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-12461b6a-a2c3-497b-a0a5-4138cf0db5cf tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:04.626467 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-12461b6a-a2c3-497b-a0a5-4138cf0db5cf tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:04.627170 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-12461b6a-a2c3-497b-a0a5-4138cf0db5cf tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:04.964970 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-12461b6a-a2c3-497b-a0a5-4138cf0db5cf tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc2bdd169daf4a1db830b1fa7f94f0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f2d56477794f8ab38b8e3535b3e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:04.975288 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-12461b6a-a2c3-497b-a0a5-4138cf0db5cf tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc2bdd169daf4a1db830b1fa7f94f0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f2d56477794f8ab38b8e3535b3e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:04.977101 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-12461b6a-a2c3-497b-a0a5-4138cf0db5cf tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc2bdd169daf4a1db830b1fa7f94f0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f2d56477794f8ab38b8e3535b3e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:04.978580 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-12461b6a-a2c3-497b-a0a5-4138cf0db5cf tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] 10.222.0.26 "GET /compute/v2.1/servers/4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21" status: 200 len: 1879 microversion: 2.32 time: 0.371906 Oct 08 21:07:04.992656 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1764/3611] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:07:04 2022] GET /compute/v2.1/servers/4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21 => generated 1879 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 08 21:07:05.008126 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-af727a3e-7f6f-4402-8432-afa68f2a03ea tempest-SecurityGroupRulesNegativeTestJSON-960839001 tempest-SecurityGroupRulesNegativeTestJSON-960839001-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/2b81f2d7-3708-4596-b035-918d85d9b27f" status: 202 len: 0 microversion: 2.1 time: 0.641305 Oct 08 21:07:05.009119 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1848/3612] 10.222.0.26 () {58 vars in 1272 bytes} [Sat Oct 8 21:07:04 2022] DELETE /compute/v2.1/os-security-groups/2b81f2d7-3708-4596-b035-918d85d9b27f => generated 0 bytes in 643 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 21:07:05.020041 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-4e9103d4-ba96-434a-a0fc-e19fbdef840f tempest-SecurityGroupRulesNegativeTestJSON-960839001 tempest-SecurityGroupRulesNegativeTestJSON-960839001-project] Calling method '.version_select at 0x7f1a9131cf70>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:05.253465 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e52b0ff9-ea87-4607-8f8f-c3d49251bf67 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:05.254837 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-e52b0ff9-ea87-4607-8f8f-c3d49251bf67 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] [instance: ee440f9f-69e9-4d96-bab6-92f73d08b9dd] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:07:05.266280 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e52b0ff9-ea87-4607-8f8f-c3d49251bf67 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:05.266978 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e52b0ff9-ea87-4607-8f8f-c3d49251bf67 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:05.268722 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e52b0ff9-ea87-4607-8f8f-c3d49251bf67 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:05.269500 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e52b0ff9-ea87-4607-8f8f-c3d49251bf67 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:05.272781 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e52b0ff9-ea87-4607-8f8f-c3d49251bf67 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:05.273433 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e52b0ff9-ea87-4607-8f8f-c3d49251bf67 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:05.406708 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-4e9103d4-ba96-434a-a0fc-e19fbdef840f tempest-SecurityGroupRulesNegativeTestJSON-960839001 tempest-SecurityGroupRulesNegativeTestJSON-960839001-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/e43cf75b-8478-4e75-8e43-35c924ab8e7d" status: 202 len: 0 microversion: 2.1 time: 0.391718 Oct 08 21:07:05.407364 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1765/3613] 10.222.0.26 () {58 vars in 1272 bytes} [Sat Oct 8 21:07:05 2022] DELETE /compute/v2.1/os-security-groups/e43cf75b-8478-4e75-8e43-35c924ab8e7d => generated 0 bytes in 393 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 21:07:05.420442 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-94365ad2-82aa-41fe-89b8-3abed6a0db2f tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:05.425514 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-94365ad2-82aa-41fe-89b8-3abed6a0db2f tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: a0a81300-bb0a-4528-96eb-43c422f9df2d] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:07:05.458530 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-94365ad2-82aa-41fe-89b8-3abed6a0db2f tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:05.460870 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-94365ad2-82aa-41fe-89b8-3abed6a0db2f tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:05.463804 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-94365ad2-82aa-41fe-89b8-3abed6a0db2f tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:05.465028 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-94365ad2-82aa-41fe-89b8-3abed6a0db2f tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:05.469147 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-94365ad2-82aa-41fe-89b8-3abed6a0db2f tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:05.469935 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-94365ad2-82aa-41fe-89b8-3abed6a0db2f tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:05.543174 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-e52b0ff9-ea87-4607-8f8f-c3d49251bf67 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcad18d0243f492591808197ca3dcc81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169293c01bf047358ff870a36c7a1247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:05.553000 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-e52b0ff9-ea87-4607-8f8f-c3d49251bf67 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] 10.222.0.26 "GET /compute/v2.1/servers/ee440f9f-69e9-4d96-bab6-92f73d08b9dd" status: 200 len: 1312 microversion: 2.1 time: 0.304101 Oct 08 21:07:05.553641 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1849/3614] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:07:05 2022] GET /compute/v2.1/servers/ee440f9f-69e9-4d96-bab6-92f73d08b9dd => generated 1312 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:07:05.561272 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-5ebbfebc-a444-41e3-8be6-134e72c0a569 tempest-SecurityGroupRulesNegativeTestJSON-960839001 tempest-SecurityGroupRulesNegativeTestJSON-960839001-project] Calling method '.version_select at 0x7f1a8d465430>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:05.717717 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-94365ad2-82aa-41fe-89b8-3abed6a0db2f tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06443b5728fb4d1e95d6245820e786bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ded993145b4eda9d6a33b994519012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:05.727935 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-94365ad2-82aa-41fe-89b8-3abed6a0db2f tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "GET /compute/v2.1/servers/a0a81300-bb0a-4528-96eb-43c422f9df2d" status: 200 len: 1327 microversion: 2.1 time: 0.315805 Oct 08 21:07:05.729613 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1766/3615] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:07:05 2022] GET /compute/v2.1/servers/a0a81300-bb0a-4528-96eb-43c422f9df2d => generated 1327 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:07:05.735147 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-de5db434-0bf3-4e82-9b94-579de9242c68 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:05.736664 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-de5db434-0bf3-4e82-9b94-579de9242c68 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] [instance: dbacaeed-a40b-4e05-9635-5073dfdd8621] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:07:05.743062 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-de5db434-0bf3-4e82-9b94-579de9242c68 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:05.744058 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-de5db434-0bf3-4e82-9b94-579de9242c68 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:05.744725 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-de5db434-0bf3-4e82-9b94-579de9242c68 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:05.745722 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-de5db434-0bf3-4e82-9b94-579de9242c68 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:05.746405 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-de5db434-0bf3-4e82-9b94-579de9242c68 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:05.747062 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-de5db434-0bf3-4e82-9b94-579de9242c68 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:05.993314 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-de5db434-0bf3-4e82-9b94-579de9242c68 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:05.996893 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:07:06.005620 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-de5db434-0bf3-4e82-9b94-579de9242c68 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:06.007246 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-de5db434-0bf3-4e82-9b94-579de9242c68 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:06.008527 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-de5db434-0bf3-4e82-9b94-579de9242c68 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] 10.222.0.26 "GET /compute/v2.1/servers/dbacaeed-a40b-4e05-9635-5073dfdd8621" status: 200 len: 1750 microversion: 2.20 time: 0.277817 Oct 08 21:07:06.009287 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1767/3616] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:07:05 2022] GET /compute/v2.1/servers/dbacaeed-a40b-4e05-9635-5073dfdd8621 => generated 1750 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:07:06.020376 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-c4af71d9-b993-477b-a37c-8bb128061d3b req-3e5be387-fd2b-45ee-b3d6-d72b19fc1d96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbacaeed-a40b-4e05-9635-5073dfdd8621", "name": "network-vif-unplugged", "status": "completed", "tag": "6fe657e1-039e-4549-b2d4-955cfbaed37d"}, {"server_uuid": "4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21", "name": "network-vif-plugged", "status": "completed", "tag": "66996fef-fc80-47b0-aada-eadf2921916d"}, {"server_uuid": "4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21", "name": "network-vif-plugged", "status": "completed", "tag": "394a1aae-3519-44f8-9e09-430c6dc79932"}, {"server_uuid": "ee440f9f-69e9-4d96-bab6-92f73d08b9dd", "name": "network-vif-plugged", "status": "completed", "tag": "0d491ec5-6d3e-49ad-95ec-23b25fbb1567"}, {"server_uuid": "4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21", "name": "network-vif-plugged", "status": "completed", "tag": "818a7d0e-582a-4f5d-902b-606c8c4608af"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:07:06.036048 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-c4af71d9-b993-477b-a37c-8bb128061d3b req-3e5be387-fd2b-45ee-b3d6-d72b19fc1d96 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:06.036646 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-c4af71d9-b993-477b-a37c-8bb128061d3b req-3e5be387-fd2b-45ee-b3d6-d72b19fc1d96 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:06.037468 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-c4af71d9-b993-477b-a37c-8bb128061d3b req-3e5be387-fd2b-45ee-b3d6-d72b19fc1d96 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:06.054541 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.compute.server_external_events [req-c4af71d9-b993-477b-a37c-8bb128061d3b req-3e5be387-fd2b-45ee-b3d6-d72b19fc1d96 service nova] Unable to find a host for instance dbacaeed-a40b-4e05-9635-5073dfdd8621. Dropping event network-vif-unplugged {{(pid=140491) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 08 21:07:06.055424 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-c4af71d9-b993-477b-a37c-8bb128061d3b req-3e5be387-fd2b-45ee-b3d6-d72b19fc1d96 service nova] Creating event network-vif-plugged:66996fef-fc80-47b0-aada-eadf2921916d for instance 4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21 on nch1-master-1 Oct 08 21:07:06.056879 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-c4af71d9-b993-477b-a37c-8bb128061d3b req-3e5be387-fd2b-45ee-b3d6-d72b19fc1d96 service nova] Creating event network-vif-plugged:394a1aae-3519-44f8-9e09-430c6dc79932 for instance 4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21 on nch1-master-1 Oct 08 21:07:06.057473 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-c4af71d9-b993-477b-a37c-8bb128061d3b req-3e5be387-fd2b-45ee-b3d6-d72b19fc1d96 service nova] Creating event network-vif-plugged:0d491ec5-6d3e-49ad-95ec-23b25fbb1567 for instance ee440f9f-69e9-4d96-bab6-92f73d08b9dd on nch1-master-1 Oct 08 21:07:06.057982 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-c4af71d9-b993-477b-a37c-8bb128061d3b req-3e5be387-fd2b-45ee-b3d6-d72b19fc1d96 service nova] Creating event network-vif-plugged:818a7d0e-582a-4f5d-902b-606c8c4608af for instance 4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21 on nch1-master-1 Oct 08 21:07:06.070591 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-c4af71d9-b993-477b-a37c-8bb128061d3b req-3e5be387-fd2b-45ee-b3d6-d72b19fc1d96 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 207 len: 866 microversion: 2.1 time: 0.056040 Oct 08 21:07:06.071453 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1768/3617] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:07:06 2022] POST /compute/v2.1/os-server-external-events => generated 866 bytes in 61 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 08 21:07:06.077316 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-e9842e4a-695f-416b-ab48-9fb15b190436 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:06.078013 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-e9842e4a-695f-416b-ab48-9fb15b190436 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] [instance: 4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:07:06.085076 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-5ebbfebc-a444-41e3-8be6-134e72c0a569 tempest-SecurityGroupRulesNegativeTestJSON-960839001 tempest-SecurityGroupRulesNegativeTestJSON-960839001-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/0ab12ec5-42e0-4803-a74e-0ecb4633d565" status: 202 len: 0 microversion: 2.1 time: 0.530357 Oct 08 21:07:06.085997 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1850/3618] 10.222.0.26 () {58 vars in 1272 bytes} [Sat Oct 8 21:07:05 2022] DELETE /compute/v2.1/os-security-groups/0ab12ec5-42e0-4803-a74e-0ecb4633d565 => generated 0 bytes in 532 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 21:07:06.093204 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e9842e4a-695f-416b-ab48-9fb15b190436 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:06.093493 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e9842e4a-695f-416b-ab48-9fb15b190436 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:06.093942 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e9842e4a-695f-416b-ab48-9fb15b190436 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:06.094679 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e9842e4a-695f-416b-ab48-9fb15b190436 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:06.095129 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e9842e4a-695f-416b-ab48-9fb15b190436 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:06.095558 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e9842e4a-695f-416b-ab48-9fb15b190436 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:06.095860 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-b7027fe5-1d00-4889-8a12-f6b3c96457e9 tempest-SecurityGroupRulesNegativeTestJSON-960839001 tempest-SecurityGroupRulesNegativeTestJSON-960839001-project] Calling method '.version_select at 0x7f1a8c0251f0>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:06.559318 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-e9842e4a-695f-416b-ab48-9fb15b190436 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc2bdd169daf4a1db830b1fa7f94f0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f2d56477794f8ab38b8e3535b3e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:06.592089 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-e9842e4a-695f-416b-ab48-9fb15b190436 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc2bdd169daf4a1db830b1fa7f94f0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f2d56477794f8ab38b8e3535b3e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:06.593749 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-e9842e4a-695f-416b-ab48-9fb15b190436 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc2bdd169daf4a1db830b1fa7f94f0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f2d56477794f8ab38b8e3535b3e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:06.595925 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-e9842e4a-695f-416b-ab48-9fb15b190436 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] 10.222.0.26 "GET /compute/v2.1/servers/4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21" status: 200 len: 1879 microversion: 2.32 time: 0.523339 Oct 08 21:07:06.596986 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1769/3619] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:07:06 2022] GET /compute/v2.1/servers/4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21 => generated 1879 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:07:06.605819 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-eee32dac-0019-4d8c-8f1c-a9ef27f43bbb tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:06.606917 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-eee32dac-0019-4d8c-8f1c-a9ef27f43bbb tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] [instance: ee440f9f-69e9-4d96-bab6-92f73d08b9dd] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:07:06.614074 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-eee32dac-0019-4d8c-8f1c-a9ef27f43bbb tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:06.615414 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-eee32dac-0019-4d8c-8f1c-a9ef27f43bbb tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:06.616044 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-eee32dac-0019-4d8c-8f1c-a9ef27f43bbb tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:06.617111 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-eee32dac-0019-4d8c-8f1c-a9ef27f43bbb tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:06.618299 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-eee32dac-0019-4d8c-8f1c-a9ef27f43bbb tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:06.618299 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-eee32dac-0019-4d8c-8f1c-a9ef27f43bbb tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:06.755142 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-b7027fe5-1d00-4889-8a12-f6b3c96457e9 tempest-SecurityGroupRulesNegativeTestJSON-960839001 tempest-SecurityGroupRulesNegativeTestJSON-960839001-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/dccd1123-0e09-4879-a9ed-09d57ea5cee0" status: 202 len: 0 microversion: 2.1 time: 0.664243 Oct 08 21:07:06.757004 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1851/3620] 10.222.0.26 () {58 vars in 1272 bytes} [Sat Oct 8 21:07:06 2022] DELETE /compute/v2.1/os-security-groups/dccd1123-0e09-4879-a9ed-09d57ea5cee0 => generated 0 bytes in 667 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 21:07:06.762616 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e3c5854b-8bba-42c7-b3f6-75d707f343f2 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:06.764128 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-e3c5854b-8bba-42c7-b3f6-75d707f343f2 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: a0a81300-bb0a-4528-96eb-43c422f9df2d] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:07:06.776618 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e3c5854b-8bba-42c7-b3f6-75d707f343f2 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:06.777631 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e3c5854b-8bba-42c7-b3f6-75d707f343f2 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:06.778356 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e3c5854b-8bba-42c7-b3f6-75d707f343f2 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:06.779481 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e3c5854b-8bba-42c7-b3f6-75d707f343f2 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:06.780635 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e3c5854b-8bba-42c7-b3f6-75d707f343f2 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:06.781491 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e3c5854b-8bba-42c7-b3f6-75d707f343f2 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:06.987134 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-e3c5854b-8bba-42c7-b3f6-75d707f343f2 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06443b5728fb4d1e95d6245820e786bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ded993145b4eda9d6a33b994519012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:06.997028 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-e3c5854b-8bba-42c7-b3f6-75d707f343f2 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "GET /compute/v2.1/servers/a0a81300-bb0a-4528-96eb-43c422f9df2d" status: 200 len: 1327 microversion: 2.1 time: 0.238772 Oct 08 21:07:07.014432 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1852/3621] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:07:06 2022] GET /compute/v2.1/servers/a0a81300-bb0a-4528-96eb-43c422f9df2d => generated 1327 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:07:07.024985 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-7a750e90-0fb9-40f5-9475-b7fa0a832df8 tempest-SecurityGroupRulesNegativeTestJSON-960839001 tempest-SecurityGroupRulesNegativeTestJSON-960839001-project] Calling method '.version_select at 0x7f1a8c90fc10>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:07.033815 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-eee32dac-0019-4d8c-8f1c-a9ef27f43bbb tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcad18d0243f492591808197ca3dcc81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169293c01bf047358ff870a36c7a1247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:07.053556 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-eee32dac-0019-4d8c-8f1c-a9ef27f43bbb tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] 10.222.0.26 "GET /compute/v2.1/servers/ee440f9f-69e9-4d96-bab6-92f73d08b9dd" status: 200 len: 1312 microversion: 2.1 time: 0.454718 Oct 08 21:07:07.088156 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1770/3622] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:07:06 2022] GET /compute/v2.1/servers/ee440f9f-69e9-4d96-bab6-92f73d08b9dd => generated 1312 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:07:07.108023 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-92d1955f-0a85-4c8d-a0c7-ce1c41441d8e tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:07.108866 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-92d1955f-0a85-4c8d-a0c7-ce1c41441d8e tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] [instance: dbacaeed-a40b-4e05-9635-5073dfdd8621] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:07:07.115464 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-92d1955f-0a85-4c8d-a0c7-ce1c41441d8e tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:07.116117 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-92d1955f-0a85-4c8d-a0c7-ce1c41441d8e tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:07.117054 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-92d1955f-0a85-4c8d-a0c7-ce1c41441d8e tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:07.118484 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-92d1955f-0a85-4c8d-a0c7-ce1c41441d8e tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:07.119048 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-92d1955f-0a85-4c8d-a0c7-ce1c41441d8e tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:07.119792 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-92d1955f-0a85-4c8d-a0c7-ce1c41441d8e tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:07.346565 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-7a750e90-0fb9-40f5-9475-b7fa0a832df8 tempest-SecurityGroupRulesNegativeTestJSON-960839001 tempest-SecurityGroupRulesNegativeTestJSON-960839001-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/f37a3a65-511a-437f-b853-8ec0c8d305c9" status: 202 len: 0 microversion: 2.1 time: 0.330495 Oct 08 21:07:07.347879 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1853/3623] 10.222.0.26 () {58 vars in 1272 bytes} [Sat Oct 8 21:07:07 2022] DELETE /compute/v2.1/os-security-groups/f37a3a65-511a-437f-b853-8ec0c8d305c9 => generated 0 bytes in 333 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 21:07:07.423446 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-92d1955f-0a85-4c8d-a0c7-ce1c41441d8e tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:07.437282 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-92d1955f-0a85-4c8d-a0c7-ce1c41441d8e tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:07.438999 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-92d1955f-0a85-4c8d-a0c7-ce1c41441d8e tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:07.440503 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-92d1955f-0a85-4c8d-a0c7-ce1c41441d8e tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] 10.222.0.26 "GET /compute/v2.1/servers/dbacaeed-a40b-4e05-9635-5073dfdd8621" status: 200 len: 1752 microversion: 2.20 time: 0.346761 Oct 08 21:07:07.441606 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1771/3624] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:07:07 2022] GET /compute/v2.1/servers/dbacaeed-a40b-4e05-9635-5073dfdd8621 => generated 1752 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:07:07.624214 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-ef185108-caa3-4304-8741-2248c47fdbf5 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:07.625546 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-ef185108-caa3-4304-8741-2248c47fdbf5 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] [instance: 4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:07:07.644645 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ef185108-caa3-4304-8741-2248c47fdbf5 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:07.645286 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ef185108-caa3-4304-8741-2248c47fdbf5 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:07.645818 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ef185108-caa3-4304-8741-2248c47fdbf5 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:07.646815 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ef185108-caa3-4304-8741-2248c47fdbf5 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:07.650200 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ef185108-caa3-4304-8741-2248c47fdbf5 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:07.651805 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ef185108-caa3-4304-8741-2248c47fdbf5 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:08.020229 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-a15999da-d1d8-4f9f-96fc-ce58ecba3e22 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:08.020860 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-a15999da-d1d8-4f9f-96fc-ce58ecba3e22 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: a0a81300-bb0a-4528-96eb-43c422f9df2d] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:07:08.034164 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a15999da-d1d8-4f9f-96fc-ce58ecba3e22 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:08.034789 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a15999da-d1d8-4f9f-96fc-ce58ecba3e22 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:08.035123 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a15999da-d1d8-4f9f-96fc-ce58ecba3e22 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:08.035855 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a15999da-d1d8-4f9f-96fc-ce58ecba3e22 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:08.048127 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a15999da-d1d8-4f9f-96fc-ce58ecba3e22 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:08.049044 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a15999da-d1d8-4f9f-96fc-ce58ecba3e22 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:08.067966 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-ef185108-caa3-4304-8741-2248c47fdbf5 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc2bdd169daf4a1db830b1fa7f94f0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f2d56477794f8ab38b8e3535b3e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:08.084315 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-ef185108-caa3-4304-8741-2248c47fdbf5 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc2bdd169daf4a1db830b1fa7f94f0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f2d56477794f8ab38b8e3535b3e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:08.090390 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-ef185108-caa3-4304-8741-2248c47fdbf5 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc2bdd169daf4a1db830b1fa7f94f0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f2d56477794f8ab38b8e3535b3e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:08.093890 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-ef185108-caa3-4304-8741-2248c47fdbf5 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] 10.222.0.26 "GET /compute/v2.1/servers/4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21" status: 200 len: 1879 microversion: 2.32 time: 0.475058 Oct 08 21:07:08.112727 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1854/3625] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:07:07 2022] GET /compute/v2.1/servers/4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21 => generated 1879 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:07:08.137772 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-11e70c00-b7a1-4cdd-b9ee-b80391cfb17e tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:08.139070 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-11e70c00-b7a1-4cdd-b9ee-b80391cfb17e tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] [instance: ee440f9f-69e9-4d96-bab6-92f73d08b9dd] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:07:08.149973 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-11e70c00-b7a1-4cdd-b9ee-b80391cfb17e tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:08.150916 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-11e70c00-b7a1-4cdd-b9ee-b80391cfb17e tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:08.151703 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-11e70c00-b7a1-4cdd-b9ee-b80391cfb17e tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:08.152705 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-11e70c00-b7a1-4cdd-b9ee-b80391cfb17e tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:08.154868 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-11e70c00-b7a1-4cdd-b9ee-b80391cfb17e tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:08.155568 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-11e70c00-b7a1-4cdd-b9ee-b80391cfb17e tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:08.427722 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-a15999da-d1d8-4f9f-96fc-ce58ecba3e22 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06443b5728fb4d1e95d6245820e786bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ded993145b4eda9d6a33b994519012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:08.440896 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-a15999da-d1d8-4f9f-96fc-ce58ecba3e22 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "GET /compute/v2.1/servers/a0a81300-bb0a-4528-96eb-43c422f9df2d" status: 200 len: 1327 microversion: 2.1 time: 0.424189 Oct 08 21:07:08.441985 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1772/3626] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:07:08 2022] GET /compute/v2.1/servers/a0a81300-bb0a-4528-96eb-43c422f9df2d => generated 1327 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:07:08.490304 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-ab4a8152-a963-480b-9ea5-01025384b525 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:08.496472 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-ab4a8152-a963-480b-9ea5-01025384b525 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] [instance: dbacaeed-a40b-4e05-9635-5073dfdd8621] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:07:08.514253 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ab4a8152-a963-480b-9ea5-01025384b525 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:08.515902 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ab4a8152-a963-480b-9ea5-01025384b525 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:08.516950 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ab4a8152-a963-480b-9ea5-01025384b525 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:08.518075 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ab4a8152-a963-480b-9ea5-01025384b525 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:08.518563 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ab4a8152-a963-480b-9ea5-01025384b525 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:08.519916 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ab4a8152-a963-480b-9ea5-01025384b525 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:08.617363 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-11e70c00-b7a1-4cdd-b9ee-b80391cfb17e tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcad18d0243f492591808197ca3dcc81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169293c01bf047358ff870a36c7a1247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:08.626903 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-11e70c00-b7a1-4cdd-b9ee-b80391cfb17e tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] 10.222.0.26 "GET /compute/v2.1/servers/ee440f9f-69e9-4d96-bab6-92f73d08b9dd" status: 200 len: 1497 microversion: 2.1 time: 0.494857 Oct 08 21:07:08.627495 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1855/3627] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:07:08 2022] GET /compute/v2.1/servers/ee440f9f-69e9-4d96-bab6-92f73d08b9dd => generated 1497 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:07:08.656490 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-2762b4c3-8b84-4938-b342-2cde64565f69 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:08.671342 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.compute.server_groups [None req-2762b4c3-8b84-4938-b342-2cde64565f69 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Querying cell 1a13ecad-3f87-496d-a2c5-ac44667fd176(cell1) for 1 instances {{(pid=140492) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 08 21:07:08.672372 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2762b4c3-8b84-4938-b342-2cde64565f69 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:08.673699 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2762b4c3-8b84-4938-b342-2cde64565f69 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:08.674497 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2762b4c3-8b84-4938-b342-2cde64565f69 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:08.696198 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-2762b4c3-8b84-4938-b342-2cde64565f69 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] 10.222.0.26 "GET /compute/v2.1/os-server-groups/62ebe1b7-fbe1-40bd-94c6-db26b37342d4" status: 200 len: 221 microversion: 2.1 time: 0.048562 Oct 08 21:07:08.696957 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1856/3628] 10.222.0.26 () {58 vars in 1263 bytes} [Sat Oct 8 21:07:08 2022] GET /compute/v2.1/os-server-groups/62ebe1b7-fbe1-40bd-94c6-db26b37342d4 => generated 221 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:07:08.708262 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-4e425c15-ba39-4410-af5a-71a73f588267 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:08.708847 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-4e425c15-ba39-4410-af5a-71a73f588267 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] [instance: ee440f9f-69e9-4d96-bab6-92f73d08b9dd] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:07:08.716581 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4e425c15-ba39-4410-af5a-71a73f588267 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:08.717259 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4e425c15-ba39-4410-af5a-71a73f588267 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:08.717712 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4e425c15-ba39-4410-af5a-71a73f588267 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:08.718451 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4e425c15-ba39-4410-af5a-71a73f588267 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:08.718913 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4e425c15-ba39-4410-af5a-71a73f588267 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:08.719482 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4e425c15-ba39-4410-af5a-71a73f588267 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:08.749349 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-4e425c15-ba39-4410-af5a-71a73f588267 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] [instance: ee440f9f-69e9-4d96-bab6-92f73d08b9dd] Going to try to terminate instance {{(pid=140492) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 21:07:08.882237 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-ab4a8152-a963-480b-9ea5-01025384b525 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:08.899600 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-ab4a8152-a963-480b-9ea5-01025384b525 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:08.901636 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-ab4a8152-a963-480b-9ea5-01025384b525 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:08.903154 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-ab4a8152-a963-480b-9ea5-01025384b525 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] 10.222.0.26 "GET /compute/v2.1/servers/dbacaeed-a40b-4e05-9635-5073dfdd8621" status: 200 len: 1808 microversion: 2.20 time: 0.438147 Oct 08 21:07:08.904302 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-4e425c15-ba39-4410-af5a-71a73f588267 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] 10.222.0.26 "DELETE /compute/v2.1/servers/ee440f9f-69e9-4d96-bab6-92f73d08b9dd" status: 204 len: 0 microversion: 2.1 time: 0.198682 Oct 08 21:07:08.904554 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1773/3629] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:07:08 2022] GET /compute/v2.1/servers/dbacaeed-a40b-4e05-9635-5073dfdd8621 => generated 1808 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:07:08.905144 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1857/3630] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:07:08 2022] DELETE /compute/v2.1/servers/ee440f9f-69e9-4d96-bab6-92f73d08b9dd => generated 0 bytes in 202 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 08 21:07:08.915045 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-989d86f5-a6ef-47ac-9502-045e2785457c tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:08.916775 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-989d86f5-a6ef-47ac-9502-045e2785457c tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] [instance: ee440f9f-69e9-4d96-bab6-92f73d08b9dd] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:07:08.924296 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-989d86f5-a6ef-47ac-9502-045e2785457c tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:08.929898 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-989d86f5-a6ef-47ac-9502-045e2785457c tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:08.930623 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-989d86f5-a6ef-47ac-9502-045e2785457c tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:08.933755 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-989d86f5-a6ef-47ac-9502-045e2785457c tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:08.934433 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-989d86f5-a6ef-47ac-9502-045e2785457c tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:08.935575 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-989d86f5-a6ef-47ac-9502-045e2785457c tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:09.131064 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-4aae2a1c-9f71-484b-814f-12e113016707 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:09.132485 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-4aae2a1c-9f71-484b-814f-12e113016707 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] [instance: 4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:07:09.150881 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4aae2a1c-9f71-484b-814f-12e113016707 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:09.152156 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4aae2a1c-9f71-484b-814f-12e113016707 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:09.155470 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4aae2a1c-9f71-484b-814f-12e113016707 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:09.156826 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4aae2a1c-9f71-484b-814f-12e113016707 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:09.158464 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4aae2a1c-9f71-484b-814f-12e113016707 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:09.161606 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4aae2a1c-9f71-484b-814f-12e113016707 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:09.567691 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-4aae2a1c-9f71-484b-814f-12e113016707 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc2bdd169daf4a1db830b1fa7f94f0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f2d56477794f8ab38b8e3535b3e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:09.579696 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-4aae2a1c-9f71-484b-814f-12e113016707 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc2bdd169daf4a1db830b1fa7f94f0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f2d56477794f8ab38b8e3535b3e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:09.581949 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-4aae2a1c-9f71-484b-814f-12e113016707 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc2bdd169daf4a1db830b1fa7f94f0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f2d56477794f8ab38b8e3535b3e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:09.584401 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-4aae2a1c-9f71-484b-814f-12e113016707 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] 10.222.0.26 "GET /compute/v2.1/servers/4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21" status: 200 len: 2831 microversion: 2.32 time: 0.457247 Oct 08 21:07:09.586706 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1858/3631] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:07:09 2022] GET /compute/v2.1/servers/4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21 => generated 2831 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 08 21:07:09.592226 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-10413295-96a1-4e69-bd54-7126525619c6 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:09.593317 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-10413295-96a1-4e69-bd54-7126525619c6 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: a0a81300-bb0a-4528-96eb-43c422f9df2d] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:07:09.600226 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-10413295-96a1-4e69-bd54-7126525619c6 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:09.601286 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-10413295-96a1-4e69-bd54-7126525619c6 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:09.602002 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-10413295-96a1-4e69-bd54-7126525619c6 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:09.602961 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-10413295-96a1-4e69-bd54-7126525619c6 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:09.603647 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-10413295-96a1-4e69-bd54-7126525619c6 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:09.604287 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-10413295-96a1-4e69-bd54-7126525619c6 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:09.787102 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-10413295-96a1-4e69-bd54-7126525619c6 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06443b5728fb4d1e95d6245820e786bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ded993145b4eda9d6a33b994519012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:09.791544 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-989d86f5-a6ef-47ac-9502-045e2785457c tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcad18d0243f492591808197ca3dcc81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169293c01bf047358ff870a36c7a1247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:09.797248 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-10413295-96a1-4e69-bd54-7126525619c6 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "GET /compute/v2.1/servers/a0a81300-bb0a-4528-96eb-43c422f9df2d" status: 200 len: 1327 microversion: 2.1 time: 0.208689 Oct 08 21:07:09.798492 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1859/3632] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:07:09 2022] GET /compute/v2.1/servers/a0a81300-bb0a-4528-96eb-43c422f9df2d => generated 1327 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:07:09.800371 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-989d86f5-a6ef-47ac-9502-045e2785457c tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] 10.222.0.26 "GET /compute/v2.1/servers/ee440f9f-69e9-4d96-bab6-92f73d08b9dd" status: 200 len: 1503 microversion: 2.1 time: 0.890657 Oct 08 21:07:09.817692 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-ef64da75-0924-4892-8507-59505afcbfa2 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:09.817692 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-ef64da75-0924-4892-8507-59505afcbfa2 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] [instance: 4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:07:09.818373 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1774/3633] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:07:08 2022] GET /compute/v2.1/servers/ee440f9f-69e9-4d96-bab6-92f73d08b9dd => generated 1503 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:07:09.818616 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ef64da75-0924-4892-8507-59505afcbfa2 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:09.818616 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ef64da75-0924-4892-8507-59505afcbfa2 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:09.818616 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ef64da75-0924-4892-8507-59505afcbfa2 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:09.818616 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ef64da75-0924-4892-8507-59505afcbfa2 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:09.818616 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ef64da75-0924-4892-8507-59505afcbfa2 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:09.819195 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ef64da75-0924-4892-8507-59505afcbfa2 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:09.934953 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-2894c84f-e1de-44ce-beee-319e64fa9faf tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:09.935634 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-2894c84f-e1de-44ce-beee-319e64fa9faf tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] [instance: dbacaeed-a40b-4e05-9635-5073dfdd8621] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:07:09.948235 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2894c84f-e1de-44ce-beee-319e64fa9faf tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:09.948762 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2894c84f-e1de-44ce-beee-319e64fa9faf tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:09.949246 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2894c84f-e1de-44ce-beee-319e64fa9faf tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:09.951059 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2894c84f-e1de-44ce-beee-319e64fa9faf tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:09.956009 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2894c84f-e1de-44ce-beee-319e64fa9faf tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:09.956504 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2894c84f-e1de-44ce-beee-319e64fa9faf tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:10.086575 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-ef64da75-0924-4892-8507-59505afcbfa2 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] 10.222.0.26 "GET /compute/v2.1/servers/4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21/os-interface" status: 200 len: 1831 microversion: 2.32 time: 0.286692 Oct 08 21:07:10.087287 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1860/3634] 10.222.0.26 () {60 vars in 1316 bytes} [Sat Oct 8 21:07:09 2022] GET /compute/v2.1/servers/4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21/os-interface => generated 1831 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:07:10.262410 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-2894c84f-e1de-44ce-beee-319e64fa9faf tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:10.287076 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-2894c84f-e1de-44ce-beee-319e64fa9faf tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:10.289610 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-2894c84f-e1de-44ce-beee-319e64fa9faf tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:10.290875 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-2894c84f-e1de-44ce-beee-319e64fa9faf tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] 10.222.0.26 "GET /compute/v2.1/servers/dbacaeed-a40b-4e05-9635-5073dfdd8621" status: 200 len: 1808 microversion: 2.20 time: 0.361679 Oct 08 21:07:10.291457 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1775/3635] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:07:09 2022] GET /compute/v2.1/servers/dbacaeed-a40b-4e05-9635-5073dfdd8621 => generated 1808 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 08 21:07:10.830610 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-6cd05388-941d-46d2-8fe6-44e842e054a4 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:10.832440 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-6cd05388-941d-46d2-8fe6-44e842e054a4 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: a0a81300-bb0a-4528-96eb-43c422f9df2d] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:07:10.836526 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-488abfdd-51f9-4707-97d7-a1cf66319db4 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:10.840017 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-488abfdd-51f9-4707-97d7-a1cf66319db4 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] [instance: ee440f9f-69e9-4d96-bab6-92f73d08b9dd] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:07:10.860776 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6cd05388-941d-46d2-8fe6-44e842e054a4 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:10.871077 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6cd05388-941d-46d2-8fe6-44e842e054a4 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:10.871609 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6cd05388-941d-46d2-8fe6-44e842e054a4 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:10.873769 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-488abfdd-51f9-4707-97d7-a1cf66319db4 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:10.874276 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-488abfdd-51f9-4707-97d7-a1cf66319db4 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:10.874725 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-488abfdd-51f9-4707-97d7-a1cf66319db4 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:10.875447 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-488abfdd-51f9-4707-97d7-a1cf66319db4 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:10.876967 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6cd05388-941d-46d2-8fe6-44e842e054a4 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:10.877492 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6cd05388-941d-46d2-8fe6-44e842e054a4 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:10.878045 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6cd05388-941d-46d2-8fe6-44e842e054a4 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:10.883028 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-488abfdd-51f9-4707-97d7-a1cf66319db4 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:10.883496 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-488abfdd-51f9-4707-97d7-a1cf66319db4 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:11.546423 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-488abfdd-51f9-4707-97d7-a1cf66319db4 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcad18d0243f492591808197ca3dcc81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169293c01bf047358ff870a36c7a1247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:11.560515 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-488abfdd-51f9-4707-97d7-a1cf66319db4 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] 10.222.0.26 "GET /compute/v2.1/servers/ee440f9f-69e9-4d96-bab6-92f73d08b9dd" status: 200 len: 1503 microversion: 2.1 time: 0.740371 Oct 08 21:07:11.561682 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1861/3636] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:07:10 2022] GET /compute/v2.1/servers/ee440f9f-69e9-4d96-bab6-92f73d08b9dd => generated 1503 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:07:11.592982 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-4f62d34f-6446-4589-8f0b-240e12bedd7e tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:11.594135 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-4f62d34f-6446-4589-8f0b-240e12bedd7e tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] [instance: dbacaeed-a40b-4e05-9635-5073dfdd8621] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:07:11.620453 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4f62d34f-6446-4589-8f0b-240e12bedd7e tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:11.628734 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4f62d34f-6446-4589-8f0b-240e12bedd7e tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:11.629501 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4f62d34f-6446-4589-8f0b-240e12bedd7e tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:11.630451 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4f62d34f-6446-4589-8f0b-240e12bedd7e tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:11.633694 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4f62d34f-6446-4589-8f0b-240e12bedd7e tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:11.634499 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4f62d34f-6446-4589-8f0b-240e12bedd7e tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:11.665401 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-6cd05388-941d-46d2-8fe6-44e842e054a4 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06443b5728fb4d1e95d6245820e786bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ded993145b4eda9d6a33b994519012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:11.678190 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-6cd05388-941d-46d2-8fe6-44e842e054a4 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "GET /compute/v2.1/servers/a0a81300-bb0a-4528-96eb-43c422f9df2d" status: 200 len: 1327 microversion: 2.1 time: 0.856081 Oct 08 21:07:11.683931 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1776/3637] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:07:10 2022] GET /compute/v2.1/servers/a0a81300-bb0a-4528-96eb-43c422f9df2d => generated 1327 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:07:11.707715 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-01aee6bb-bd66-448d-83b3-2fc1a89cb153 req-c5d8aad9-472d-409f-9135-a6edb7100120 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0a81300-bb0a-4528-96eb-43c422f9df2d", "name": "network-vif-plugged", "status": "completed", "tag": "21962079-10a4-45c9-895a-3c1a967155b3"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:07:11.717106 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:07:11.739000 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-01aee6bb-bd66-448d-83b3-2fc1a89cb153 req-c5d8aad9-472d-409f-9135-a6edb7100120 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:11.739506 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-01aee6bb-bd66-448d-83b3-2fc1a89cb153 req-c5d8aad9-472d-409f-9135-a6edb7100120 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:11.741986 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-01aee6bb-bd66-448d-83b3-2fc1a89cb153 req-c5d8aad9-472d-409f-9135-a6edb7100120 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:11.785574 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-01aee6bb-bd66-448d-83b3-2fc1a89cb153 req-c5d8aad9-472d-409f-9135-a6edb7100120 service nova] Creating event network-vif-plugged:21962079-10a4-45c9-895a-3c1a967155b3 for instance a0a81300-bb0a-4528-96eb-43c422f9df2d on nch2-master-1 Oct 08 21:07:11.820056 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-01aee6bb-bd66-448d-83b3-2fc1a89cb153 req-c5d8aad9-472d-409f-9135-a6edb7100120 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134610 Oct 08 21:07:11.836882 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1777/3638] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:07:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:07:12.588656 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-b2cfa097-6038-4bf4-9f87-d165905c1fa0 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:12.590112 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-b2cfa097-6038-4bf4-9f87-d165905c1fa0 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] [instance: ee440f9f-69e9-4d96-bab6-92f73d08b9dd] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:07:12.598697 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b2cfa097-6038-4bf4-9f87-d165905c1fa0 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:12.599681 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b2cfa097-6038-4bf4-9f87-d165905c1fa0 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:12.600596 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b2cfa097-6038-4bf4-9f87-d165905c1fa0 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:12.601565 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b2cfa097-6038-4bf4-9f87-d165905c1fa0 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:12.602975 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b2cfa097-6038-4bf4-9f87-d165905c1fa0 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:12.603659 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b2cfa097-6038-4bf4-9f87-d165905c1fa0 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:13.289417 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-4f62d34f-6446-4589-8f0b-240e12bedd7e tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:13.316716 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-4f62d34f-6446-4589-8f0b-240e12bedd7e tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:13.325702 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-4f62d34f-6446-4589-8f0b-240e12bedd7e tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:13.334313 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-4f62d34f-6446-4589-8f0b-240e12bedd7e tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] 10.222.0.26 "GET /compute/v2.1/servers/dbacaeed-a40b-4e05-9635-5073dfdd8621" status: 200 len: 1808 microversion: 2.20 time: 1.770226 Oct 08 21:07:13.341724 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1862/3639] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:07:11 2022] GET /compute/v2.1/servers/dbacaeed-a40b-4e05-9635-5073dfdd8621 => generated 1808 bytes in 1779 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:07:13.363014 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-79fe9cee-640c-4f20-9a04-103d5b1dc5ce tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:13.368182 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-79fe9cee-640c-4f20-9a04-103d5b1dc5ce tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: a0a81300-bb0a-4528-96eb-43c422f9df2d] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:07:13.370570 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-b2cfa097-6038-4bf4-9f87-d165905c1fa0 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcad18d0243f492591808197ca3dcc81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169293c01bf047358ff870a36c7a1247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:13.384153 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-b2cfa097-6038-4bf4-9f87-d165905c1fa0 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] 10.222.0.26 "GET /compute/v2.1/servers/ee440f9f-69e9-4d96-bab6-92f73d08b9dd" status: 200 len: 1503 microversion: 2.1 time: 0.803666 Oct 08 21:07:13.405917 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-79fe9cee-640c-4f20-9a04-103d5b1dc5ce tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:13.408271 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1778/3640] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:07:12 2022] GET /compute/v2.1/servers/ee440f9f-69e9-4d96-bab6-92f73d08b9dd => generated 1503 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:07:13.408897 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-79fe9cee-640c-4f20-9a04-103d5b1dc5ce tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:13.409446 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-79fe9cee-640c-4f20-9a04-103d5b1dc5ce tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:13.413272 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-79fe9cee-640c-4f20-9a04-103d5b1dc5ce tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:13.418211 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-79fe9cee-640c-4f20-9a04-103d5b1dc5ce tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:13.419702 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-79fe9cee-640c-4f20-9a04-103d5b1dc5ce tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:13.421542 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-73f3dd35-0485-4382-aa2e-d5ab714d1a75 req-d1b50bcf-17ec-4afd-bc4f-fd2d2bd67778 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee440f9f-69e9-4d96-bab6-92f73d08b9dd", "name": "network-vif-deleted", "tag": "0d491ec5-6d3e-49ad-95ec-23b25fbb1567"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:07:13.493217 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-73f3dd35-0485-4382-aa2e-d5ab714d1a75 req-d1b50bcf-17ec-4afd-bc4f-fd2d2bd67778 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:13.501529 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-73f3dd35-0485-4382-aa2e-d5ab714d1a75 req-d1b50bcf-17ec-4afd-bc4f-fd2d2bd67778 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:13.502627 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-73f3dd35-0485-4382-aa2e-d5ab714d1a75 req-d1b50bcf-17ec-4afd-bc4f-fd2d2bd67778 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:13.541763 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-73f3dd35-0485-4382-aa2e-d5ab714d1a75 req-d1b50bcf-17ec-4afd-bc4f-fd2d2bd67778 service nova] Creating event network-vif-deleted:0d491ec5-6d3e-49ad-95ec-23b25fbb1567 for instance ee440f9f-69e9-4d96-bab6-92f73d08b9dd on nch1-master-1 Oct 08 21:07:13.559028 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-73f3dd35-0485-4382-aa2e-d5ab714d1a75 req-d1b50bcf-17ec-4afd-bc4f-fd2d2bd67778 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.148635 Oct 08 21:07:13.560181 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1779/3641] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:07:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:07:13.811092 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-79fe9cee-640c-4f20-9a04-103d5b1dc5ce tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06443b5728fb4d1e95d6245820e786bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ded993145b4eda9d6a33b994519012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:13.822452 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-79fe9cee-640c-4f20-9a04-103d5b1dc5ce tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "GET /compute/v2.1/servers/a0a81300-bb0a-4528-96eb-43c422f9df2d" status: 200 len: 1327 microversion: 2.1 time: 0.479317 Oct 08 21:07:13.823055 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1863/3642] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:07:13 2022] GET /compute/v2.1/servers/a0a81300-bb0a-4528-96eb-43c422f9df2d => generated 1327 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:07:14.145897 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-f34e5f22-7514-4da9-bd7e-b600e9da35aa req-8a669ab1-8740-4c21-b5ac-31d9176a4876 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21", "tag": "35b26276-a306-4edc-9bc3-3ed3302b5672"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:07:14.170351 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-f34e5f22-7514-4da9-bd7e-b600e9da35aa req-8a669ab1-8740-4c21-b5ac-31d9176a4876 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:14.171176 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-f34e5f22-7514-4da9-bd7e-b600e9da35aa req-8a669ab1-8740-4c21-b5ac-31d9176a4876 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:14.171680 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-f34e5f22-7514-4da9-bd7e-b600e9da35aa req-8a669ab1-8740-4c21-b5ac-31d9176a4876 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:14.207909 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-f34e5f22-7514-4da9-bd7e-b600e9da35aa req-8a669ab1-8740-4c21-b5ac-31d9176a4876 service nova] Creating event network-changed:35b26276-a306-4edc-9bc3-3ed3302b5672 for instance 4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21 on nch1-master-1 Oct 08 21:07:14.232163 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-f34e5f22-7514-4da9-bd7e-b600e9da35aa req-8a669ab1-8740-4c21-b5ac-31d9176a4876 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.370411 Oct 08 21:07:14.232855 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1780/3643] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:07:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:07:14.372970 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-aa1eaca6-a25d-4653-892d-f8f981021965 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:14.374553 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-aa1eaca6-a25d-4653-892d-f8f981021965 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] [instance: dbacaeed-a40b-4e05-9635-5073dfdd8621] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:07:14.394162 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-aa1eaca6-a25d-4653-892d-f8f981021965 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:14.395132 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-aa1eaca6-a25d-4653-892d-f8f981021965 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:14.397072 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-aa1eaca6-a25d-4653-892d-f8f981021965 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:14.399500 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-aa1eaca6-a25d-4653-892d-f8f981021965 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:14.404715 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-aa1eaca6-a25d-4653-892d-f8f981021965 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:14.405967 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-aa1eaca6-a25d-4653-892d-f8f981021965 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:14.415687 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c94bfae3-b097-42a6-8141-68836cd33bb6 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:14.416702 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-c94bfae3-b097-42a6-8141-68836cd33bb6 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] [instance: ee440f9f-69e9-4d96-bab6-92f73d08b9dd] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:07:14.430218 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c94bfae3-b097-42a6-8141-68836cd33bb6 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:14.430742 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c94bfae3-b097-42a6-8141-68836cd33bb6 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:14.431197 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c94bfae3-b097-42a6-8141-68836cd33bb6 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:14.431955 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c94bfae3-b097-42a6-8141-68836cd33bb6 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:14.440343 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c94bfae3-b097-42a6-8141-68836cd33bb6 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:14.440878 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c94bfae3-b097-42a6-8141-68836cd33bb6 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:14.493346 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-c94bfae3-b097-42a6-8141-68836cd33bb6 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] HTTP exception thrown: Instance ee440f9f-69e9-4d96-bab6-92f73d08b9dd could not be found. Oct 08 21:07:14.495122 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c94bfae3-b097-42a6-8141-68836cd33bb6 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Request method failure captured: Oct 08 21:07:14.495122 ncdv-master-1 devstack@n-api.service[140491]: request: GET /compute/v2.1/servers/ee440f9f-69e9-4d96-bab6-92f73d08b9dd HTTP/1.1 Oct 08 21:07:14.495122 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:07:14.495122 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:07:14.495122 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:07:14.495122 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 21:07:14.495122 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:07:14.495122 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:07:14.495122 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:07:14.495122 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:07:14.495122 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeZYicrxfXnpkDmocvFFdE2ltgPLLVU3HrbbQvVlZf3AdfkBGQuiUMycoRkyhi196sUA3LbBHZtkHUjjbpbAxiT0U_q4jV5Dh5zKRUYDsZY44v7GzzJx8omyF6G-aAR-EvjagS5fIRUIz7sIdDT24-l_h3hZGEpcOFal5zZC6OQPfek Oct 08 21:07:14.495122 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:07:14.495122 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:07:14.495122 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:07:14.495122 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:07:14.495122 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:07:14.495122 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:07:14.495122 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 169293c01bf047358ff870a36c7a1247 Oct 08 21:07:14.495122 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-ServerGroupTestJSON-382452504 Oct 08 21:07:14.495122 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:07:14.495122 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:07:14.495122 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/169293c01bf047358ff870a36c7a1247"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/169293c01bf047358ff870a36c7a1247"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_169293c01bf047358ff870a36c7a1247"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/169293c01bf047358ff870a36c7a1247"}]}] Oct 08 21:07:14.495122 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-ServerGroupTestJSON-382452504 Oct 08 21:07:14.495122 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 169293c01bf047358ff870a36c7a1247 Oct 08 21:07:14.495122 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-ServerGroupTestJSON-382452504 Oct 08 21:07:14.495122 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-ServerGroupTestJSON-382452504-project Oct 08 21:07:14.495122 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:07:14.495122 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:07:14.495122 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: dcad18d0243f492591808197ca3dcc81 Oct 08 21:07:14.495122 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-ServerGroupTestJSON-382452504-project Oct 08 21:07:14.495122 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:07:14.495122 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance ee440f9f-69e9-4d96-bab6-92f73d08b9dd could not be found. Oct 08 21:07:14.495122 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': 'ee440f9f-69e9-4d96-bab6-92f73d08b9dd'} Oct 08 21:07:14.495122 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:07:14.495122 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:07:14.495122 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:07:14.495122 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:07:14.495122 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:07:14.495122 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:07:14.495122 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:07:14.495122 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:07:14.495122 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:07:14.495122 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:07:14.495122 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee440f9f-69e9-4d96-bab6-92f73d08b9dd could not be found. Oct 08 21:07:14.495122 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:07:14.495122 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:07:14.495122 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:07:14.495122 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:07:14.495122 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:07:14.495122 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:07:14.495122 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:07:14.495122 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:07:14.495122 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:07:14.495122 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:07:14.495122 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:07:14.495122 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:07:14.495122 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:07:14.495122 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:07:14.495122 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:07:14.495122 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:07:14.495122 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee440f9f-69e9-4d96-bab6-92f73d08b9dd could not be found. Oct 08 21:07:14.495122 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:07:14.495122 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:07:14.495122 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:07:14.500304 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:07:14.500304 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:07:14.500304 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:07:14.500304 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:07:14.500304 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:07:14.500304 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee440f9f-69e9-4d96-bab6-92f73d08b9dd could not be found. Oct 08 21:07:14.500304 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:07:14.507000 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c94bfae3-b097-42a6-8141-68836cd33bb6 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Returning 404 to user: Instance ee440f9f-69e9-4d96-bab6-92f73d08b9dd could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:07:14.507000 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-c94bfae3-b097-42a6-8141-68836cd33bb6 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] 10.222.0.26 "GET /compute/v2.1/servers/ee440f9f-69e9-4d96-bab6-92f73d08b9dd" status: 404 len: 111 microversion: 2.1 time: 0.092430 Oct 08 21:07:14.507000 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1781/3644] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:07:14 2022] GET /compute/v2.1/servers/ee440f9f-69e9-4d96-bab6-92f73d08b9dd => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:07:14.524935 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-639a8ef9-a9c9-4d8e-affb-a97d36cfb128 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:14.595281 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.compute.server_groups [None req-639a8ef9-a9c9-4d8e-affb-a97d36cfb128 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Querying cell 1a13ecad-3f87-496d-a2c5-ac44667fd176(cell1) for 1 instances {{(pid=140491) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 08 21:07:14.596060 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-639a8ef9-a9c9-4d8e-affb-a97d36cfb128 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:14.596531 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-639a8ef9-a9c9-4d8e-affb-a97d36cfb128 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:14.604350 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-639a8ef9-a9c9-4d8e-affb-a97d36cfb128 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:14.641392 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-639a8ef9-a9c9-4d8e-affb-a97d36cfb128 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] 10.222.0.26 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.127778 Oct 08 21:07:14.653911 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1782/3645] 10.222.0.26 () {58 vars in 1152 bytes} [Sat Oct 8 21:07:14 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:07:14.667036 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-2b924672-a489-46c0-8793-057d78db5365 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:14.700759 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.compute.server_groups [None req-2b924672-a489-46c0-8793-057d78db5365 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Querying cell 1a13ecad-3f87-496d-a2c5-ac44667fd176(cell1) for 1 instances {{(pid=140491) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 08 21:07:14.701555 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2b924672-a489-46c0-8793-057d78db5365 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:14.702261 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2b924672-a489-46c0-8793-057d78db5365 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:14.702897 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2b924672-a489-46c0-8793-057d78db5365 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:14.726330 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-2b924672-a489-46c0-8793-057d78db5365 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] 10.222.0.26 "GET /compute/v2.1/os-server-groups/62ebe1b7-fbe1-40bd-94c6-db26b37342d4" status: 200 len: 183 microversion: 2.1 time: 0.063894 Oct 08 21:07:14.727369 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1783/3646] 10.222.0.26 () {58 vars in 1263 bytes} [Sat Oct 8 21:07:14 2022] GET /compute/v2.1/os-server-groups/62ebe1b7-fbe1-40bd-94c6-db26b37342d4 => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 08 21:07:14.741323 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-abc2b98f-c5f7-4b6c-b249-0a3e92fea1cc tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:14.742201 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-abc2b98f-c5f7-4b6c-b249-0a3e92fea1cc tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] [instance: ee440f9f-69e9-4d96-bab6-92f73d08b9dd] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:07:14.750027 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-abc2b98f-c5f7-4b6c-b249-0a3e92fea1cc tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:14.750759 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-abc2b98f-c5f7-4b6c-b249-0a3e92fea1cc tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:14.751786 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-abc2b98f-c5f7-4b6c-b249-0a3e92fea1cc tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:14.753497 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-abc2b98f-c5f7-4b6c-b249-0a3e92fea1cc tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:14.754193 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-abc2b98f-c5f7-4b6c-b249-0a3e92fea1cc tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:14.754851 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-abc2b98f-c5f7-4b6c-b249-0a3e92fea1cc tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:14.781762 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-aa1eaca6-a25d-4653-892d-f8f981021965 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:14.794146 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-aa1eaca6-a25d-4653-892d-f8f981021965 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:14.796195 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-aa1eaca6-a25d-4653-892d-f8f981021965 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:14.796350 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-abc2b98f-c5f7-4b6c-b249-0a3e92fea1cc tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] HTTP exception thrown: Instance ee440f9f-69e9-4d96-bab6-92f73d08b9dd could not be found. Oct 08 21:07:14.798110 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-aa1eaca6-a25d-4653-892d-f8f981021965 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] 10.222.0.26 "GET /compute/v2.1/servers/dbacaeed-a40b-4e05-9635-5073dfdd8621" status: 200 len: 1808 microversion: 2.20 time: 0.430708 Oct 08 21:07:14.809212 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-abc2b98f-c5f7-4b6c-b249-0a3e92fea1cc tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Request method failure captured: Oct 08 21:07:14.809212 ncdv-master-1 devstack@n-api.service[140491]: request: DELETE /compute/v2.1/servers/ee440f9f-69e9-4d96-bab6-92f73d08b9dd HTTP/1.1 Oct 08 21:07:14.809212 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:07:14.809212 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:07:14.809212 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:07:14.809212 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 21:07:14.809212 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:07:14.809212 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:07:14.809212 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:07:14.809212 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:07:14.809212 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeZYicrxfXnpkDmocvFFdE2ltgPLLVU3HrbbQvVlZf3AdfkBGQuiUMycoRkyhi196sUA3LbBHZtkHUjjbpbAxiT0U_q4jV5Dh5zKRUYDsZY44v7GzzJx8omyF6G-aAR-EvjagS5fIRUIz7sIdDT24-l_h3hZGEpcOFal5zZC6OQPfek Oct 08 21:07:14.809212 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:07:14.809212 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:07:14.809212 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:07:14.809212 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:07:14.809212 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:07:14.809212 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:07:14.809212 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 169293c01bf047358ff870a36c7a1247 Oct 08 21:07:14.809212 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-ServerGroupTestJSON-382452504 Oct 08 21:07:14.809212 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:07:14.809212 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:07:14.809212 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/169293c01bf047358ff870a36c7a1247"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/169293c01bf047358ff870a36c7a1247"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_169293c01bf047358ff870a36c7a1247"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/169293c01bf047358ff870a36c7a1247"}]}] Oct 08 21:07:14.809212 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-ServerGroupTestJSON-382452504 Oct 08 21:07:14.809212 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 169293c01bf047358ff870a36c7a1247 Oct 08 21:07:14.809212 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-ServerGroupTestJSON-382452504 Oct 08 21:07:14.809212 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-ServerGroupTestJSON-382452504-project Oct 08 21:07:14.809212 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:07:14.809212 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:07:14.809212 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: dcad18d0243f492591808197ca3dcc81 Oct 08 21:07:14.809212 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-ServerGroupTestJSON-382452504-project Oct 08 21:07:14.809212 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:07:14.809212 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance ee440f9f-69e9-4d96-bab6-92f73d08b9dd could not be found. Oct 08 21:07:14.809212 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': 'ee440f9f-69e9-4d96-bab6-92f73d08b9dd'} Oct 08 21:07:14.809212 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:07:14.809212 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:07:14.809212 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:07:14.809212 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:07:14.809212 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:07:14.809212 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:07:14.809212 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:07:14.809212 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:07:14.809212 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:07:14.809212 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:07:14.809212 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee440f9f-69e9-4d96-bab6-92f73d08b9dd could not be found. Oct 08 21:07:14.809212 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:07:14.809212 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:07:14.809212 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:07:14.809212 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:07:14.809212 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:07:14.809212 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:07:14.809212 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:07:14.809212 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:07:14.809212 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:07:14.809212 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:07:14.809212 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 08 21:07:14.809212 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 08 21:07:14.809212 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 08 21:07:14.809212 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 08 21:07:14.809212 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:07:14.809212 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:07:14.809212 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:07:14.809212 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:07:14.821871 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee440f9f-69e9-4d96-bab6-92f73d08b9dd could not be found. Oct 08 21:07:14.821871 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:07:14.821871 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:07:14.821871 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:07:14.821871 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:07:14.821871 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:07:14.821871 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:07:14.821871 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:07:14.821871 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:07:14.821871 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee440f9f-69e9-4d96-bab6-92f73d08b9dd could not be found. Oct 08 21:07:14.821871 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:07:14.821871 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-abc2b98f-c5f7-4b6c-b249-0a3e92fea1cc tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Returning 404 to user: Instance ee440f9f-69e9-4d96-bab6-92f73d08b9dd could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:07:14.821871 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-abc2b98f-c5f7-4b6c-b249-0a3e92fea1cc tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] 10.222.0.26 "DELETE /compute/v2.1/servers/ee440f9f-69e9-4d96-bab6-92f73d08b9dd" status: 404 len: 111 microversion: 2.1 time: 0.063304 Oct 08 21:07:14.821871 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1784/3647] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:07:14 2022] DELETE /compute/v2.1/servers/ee440f9f-69e9-4d96-bab6-92f73d08b9dd => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:07:14.823886 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-5a4efd34-dcf6-497f-b01b-94d9faeb0eff tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:14.823886 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-5a4efd34-dcf6-497f-b01b-94d9faeb0eff tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] [instance: ee440f9f-69e9-4d96-bab6-92f73d08b9dd] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:07:14.826098 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1864/3648] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:07:14 2022] GET /compute/v2.1/servers/dbacaeed-a40b-4e05-9635-5073dfdd8621 => generated 1808 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:07:14.838954 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5a4efd34-dcf6-497f-b01b-94d9faeb0eff tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:14.839677 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5a4efd34-dcf6-497f-b01b-94d9faeb0eff tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:14.841754 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5a4efd34-dcf6-497f-b01b-94d9faeb0eff tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:14.844294 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5a4efd34-dcf6-497f-b01b-94d9faeb0eff tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:14.844817 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5a4efd34-dcf6-497f-b01b-94d9faeb0eff tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:14.845512 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5a4efd34-dcf6-497f-b01b-94d9faeb0eff tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:14.848563 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e0c44333-2ecd-41e6-b71c-ea0fe6b797dc tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:14.849563 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-e0c44333-2ecd-41e6-b71c-ea0fe6b797dc tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: a0a81300-bb0a-4528-96eb-43c422f9df2d] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:07:14.861281 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e0c44333-2ecd-41e6-b71c-ea0fe6b797dc tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:14.863890 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e0c44333-2ecd-41e6-b71c-ea0fe6b797dc tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:14.864532 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e0c44333-2ecd-41e6-b71c-ea0fe6b797dc tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:14.866707 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e0c44333-2ecd-41e6-b71c-ea0fe6b797dc tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:14.867706 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e0c44333-2ecd-41e6-b71c-ea0fe6b797dc tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:14.869910 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e0c44333-2ecd-41e6-b71c-ea0fe6b797dc tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:14.941534 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-5a4efd34-dcf6-497f-b01b-94d9faeb0eff tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] HTTP exception thrown: Instance ee440f9f-69e9-4d96-bab6-92f73d08b9dd could not be found. Oct 08 21:07:14.952650 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-5a4efd34-dcf6-497f-b01b-94d9faeb0eff tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Request method failure captured: Oct 08 21:07:14.952650 ncdv-master-1 devstack@n-api.service[140491]: request: GET /compute/v2.1/servers/ee440f9f-69e9-4d96-bab6-92f73d08b9dd HTTP/1.1 Oct 08 21:07:14.952650 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:07:14.952650 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:07:14.952650 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:07:14.952650 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 21:07:14.952650 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:07:14.952650 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:07:14.952650 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:07:14.952650 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:07:14.952650 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeZYicrxfXnpkDmocvFFdE2ltgPLLVU3HrbbQvVlZf3AdfkBGQuiUMycoRkyhi196sUA3LbBHZtkHUjjbpbAxiT0U_q4jV5Dh5zKRUYDsZY44v7GzzJx8omyF6G-aAR-EvjagS5fIRUIz7sIdDT24-l_h3hZGEpcOFal5zZC6OQPfek Oct 08 21:07:14.952650 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:07:14.952650 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:07:14.952650 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:07:14.952650 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:07:14.952650 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:07:14.952650 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:07:14.952650 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 169293c01bf047358ff870a36c7a1247 Oct 08 21:07:14.952650 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-ServerGroupTestJSON-382452504 Oct 08 21:07:14.952650 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:07:14.952650 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:07:14.952650 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/169293c01bf047358ff870a36c7a1247"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/169293c01bf047358ff870a36c7a1247"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_169293c01bf047358ff870a36c7a1247"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/169293c01bf047358ff870a36c7a1247"}]}] Oct 08 21:07:14.952650 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-ServerGroupTestJSON-382452504 Oct 08 21:07:14.952650 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 169293c01bf047358ff870a36c7a1247 Oct 08 21:07:14.952650 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-ServerGroupTestJSON-382452504 Oct 08 21:07:14.952650 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-ServerGroupTestJSON-382452504-project Oct 08 21:07:14.952650 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:07:14.952650 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:07:14.952650 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: dcad18d0243f492591808197ca3dcc81 Oct 08 21:07:14.952650 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-ServerGroupTestJSON-382452504-project Oct 08 21:07:14.952650 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:07:14.952650 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance ee440f9f-69e9-4d96-bab6-92f73d08b9dd could not be found. Oct 08 21:07:14.952650 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': 'ee440f9f-69e9-4d96-bab6-92f73d08b9dd'} Oct 08 21:07:14.952650 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:07:14.952650 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:07:14.952650 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:07:14.952650 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:07:14.952650 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:07:14.952650 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:07:14.952650 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:07:14.952650 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:07:14.952650 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:07:14.952650 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:07:14.952650 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee440f9f-69e9-4d96-bab6-92f73d08b9dd could not be found. Oct 08 21:07:14.952650 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:07:14.952650 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:07:14.952650 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:07:14.952650 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:07:14.952650 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:07:14.952650 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:07:14.952650 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:07:14.952650 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:07:14.952650 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:07:14.952650 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:07:14.952650 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:07:14.952650 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:07:14.952650 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:07:14.952650 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:07:14.952650 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:07:14.952650 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:07:14.952650 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee440f9f-69e9-4d96-bab6-92f73d08b9dd could not be found. Oct 08 21:07:14.952650 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:07:14.952650 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:07:14.952650 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:07:14.957146 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:07:14.957146 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:07:14.957146 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:07:14.957146 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:07:14.957146 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:07:14.957146 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee440f9f-69e9-4d96-bab6-92f73d08b9dd could not be found. Oct 08 21:07:14.957146 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:07:14.957146 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-5a4efd34-dcf6-497f-b01b-94d9faeb0eff tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Returning 404 to user: Instance ee440f9f-69e9-4d96-bab6-92f73d08b9dd could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:07:14.962383 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-5a4efd34-dcf6-497f-b01b-94d9faeb0eff tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] 10.222.0.26 "GET /compute/v2.1/servers/ee440f9f-69e9-4d96-bab6-92f73d08b9dd" status: 404 len: 111 microversion: 2.1 time: 0.144522 Oct 08 21:07:14.967989 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1785/3649] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:07:14 2022] GET /compute/v2.1/servers/ee440f9f-69e9-4d96-bab6-92f73d08b9dd => generated 111 bytes in 153 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:07:14.990046 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-ea948021-4c3e-419d-b352-3a3779c9b9bc tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:15.021518 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-ea948021-4c3e-419d-b352-3a3779c9b9bc tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] HTTP exception thrown: Instance group 74c48a4f-491d-4f7e-b52c-632952aba991 could not be found. Oct 08 21:07:15.033010 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-ea948021-4c3e-419d-b352-3a3779c9b9bc tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Request method failure captured: Oct 08 21:07:15.033010 ncdv-master-1 devstack@n-api.service[140491]: request: DELETE /compute/v2.1/os-server-groups/74c48a4f-491d-4f7e-b52c-632952aba991 HTTP/1.1 Oct 08 21:07:15.033010 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:07:15.033010 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:07:15.033010 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:07:15.033010 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 21:07:15.033010 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:07:15.033010 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:07:15.033010 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:07:15.033010 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:07:15.033010 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeZYicrxfXnpkDmocvFFdE2ltgPLLVU3HrbbQvVlZf3AdfkBGQuiUMycoRkyhi196sUA3LbBHZtkHUjjbpbAxiT0U_q4jV5Dh5zKRUYDsZY44v7GzzJx8omyF6G-aAR-EvjagS5fIRUIz7sIdDT24-l_h3hZGEpcOFal5zZC6OQPfek Oct 08 21:07:15.033010 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:07:15.033010 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:07:15.033010 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:07:15.033010 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:07:15.033010 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:07:15.033010 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:07:15.033010 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 169293c01bf047358ff870a36c7a1247 Oct 08 21:07:15.033010 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-ServerGroupTestJSON-382452504 Oct 08 21:07:15.033010 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:07:15.033010 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:07:15.033010 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/169293c01bf047358ff870a36c7a1247"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/169293c01bf047358ff870a36c7a1247"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_169293c01bf047358ff870a36c7a1247"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/169293c01bf047358ff870a36c7a1247"}]}] Oct 08 21:07:15.033010 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-ServerGroupTestJSON-382452504 Oct 08 21:07:15.033010 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 169293c01bf047358ff870a36c7a1247 Oct 08 21:07:15.033010 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-ServerGroupTestJSON-382452504 Oct 08 21:07:15.033010 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-ServerGroupTestJSON-382452504-project Oct 08 21:07:15.033010 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:07:15.033010 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:07:15.033010 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: dcad18d0243f492591808197ca3dcc81 Oct 08 21:07:15.033010 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-ServerGroupTestJSON-382452504-project Oct 08 21:07:15.033010 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:07:15.033010 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance group 74c48a4f-491d-4f7e-b52c-632952aba991 could not be found. Oct 08 21:07:15.033010 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': '74c48a4f-491d-4f7e-b52c-632952aba991'} Oct 08 21:07:15.033010 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:07:15.033010 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:07:15.033010 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 08 21:07:15.033010 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 08 21:07:15.033010 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 08 21:07:15.033010 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 08 21:07:15.033010 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 08 21:07:15.033010 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 08 21:07:15.033010 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 08 21:07:15.033010 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 08 21:07:15.033010 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 08 21:07:15.033010 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 08 21:07:15.033010 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 74c48a4f-491d-4f7e-b52c-632952aba991 could not be found. Oct 08 21:07:15.033010 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:07:15.033010 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:07:15.033010 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:07:15.033010 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:07:15.033010 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:07:15.033010 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:07:15.033010 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:07:15.033010 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:07:15.033010 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:07:15.033010 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:07:15.033010 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 08 21:07:15.033010 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:07:15.033010 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 74c48a4f-491d-4f7e-b52c-632952aba991 could not be found. Oct 08 21:07:15.033010 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:07:15.033010 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:07:15.033010 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:07:15.033010 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:07:15.040050 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:07:15.040050 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:07:15.040050 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:07:15.040050 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:07:15.040050 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 74c48a4f-491d-4f7e-b52c-632952aba991 could not be found. Oct 08 21:07:15.040050 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:07:15.040050 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-ea948021-4c3e-419d-b352-3a3779c9b9bc tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Returning 404 to user: Instance group 74c48a4f-491d-4f7e-b52c-632952aba991 could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:07:15.040050 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-ea948021-4c3e-419d-b352-3a3779c9b9bc tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] 10.222.0.26 "DELETE /compute/v2.1/os-server-groups/74c48a4f-491d-4f7e-b52c-632952aba991" status: 404 len: 117 microversion: 2.1 time: 0.065969 Oct 08 21:07:15.041372 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1786/3650] 10.222.0.26 () {58 vars in 1266 bytes} [Sat Oct 8 21:07:14 2022] DELETE /compute/v2.1/os-server-groups/74c48a4f-491d-4f7e-b52c-632952aba991 => generated 117 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:07:15.049538 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-eb3e11e7-21f2-4738-b2cb-3c572e4fb3a7 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:15.057325 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-eb3e11e7-21f2-4738-b2cb-3c572e4fb3a7 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] HTTP exception thrown: Instance group cde11d6e-d3f7-4b8f-b6dd-108d039faaaa could not be found. Oct 08 21:07:15.059302 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-eb3e11e7-21f2-4738-b2cb-3c572e4fb3a7 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Request method failure captured: Oct 08 21:07:15.059302 ncdv-master-1 devstack@n-api.service[140491]: request: DELETE /compute/v2.1/os-server-groups/cde11d6e-d3f7-4b8f-b6dd-108d039faaaa HTTP/1.1 Oct 08 21:07:15.059302 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:07:15.059302 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:07:15.059302 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:07:15.059302 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 21:07:15.059302 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:07:15.059302 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:07:15.059302 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:07:15.059302 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:07:15.059302 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeZYicrxfXnpkDmocvFFdE2ltgPLLVU3HrbbQvVlZf3AdfkBGQuiUMycoRkyhi196sUA3LbBHZtkHUjjbpbAxiT0U_q4jV5Dh5zKRUYDsZY44v7GzzJx8omyF6G-aAR-EvjagS5fIRUIz7sIdDT24-l_h3hZGEpcOFal5zZC6OQPfek Oct 08 21:07:15.059302 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:07:15.059302 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:07:15.059302 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:07:15.059302 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:07:15.059302 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:07:15.059302 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:07:15.059302 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 169293c01bf047358ff870a36c7a1247 Oct 08 21:07:15.059302 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-ServerGroupTestJSON-382452504 Oct 08 21:07:15.059302 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:07:15.059302 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:07:15.059302 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/169293c01bf047358ff870a36c7a1247"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/169293c01bf047358ff870a36c7a1247"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_169293c01bf047358ff870a36c7a1247"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/169293c01bf047358ff870a36c7a1247"}]}] Oct 08 21:07:15.059302 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-ServerGroupTestJSON-382452504 Oct 08 21:07:15.059302 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 169293c01bf047358ff870a36c7a1247 Oct 08 21:07:15.059302 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-ServerGroupTestJSON-382452504 Oct 08 21:07:15.059302 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-ServerGroupTestJSON-382452504-project Oct 08 21:07:15.059302 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:07:15.059302 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:07:15.059302 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: dcad18d0243f492591808197ca3dcc81 Oct 08 21:07:15.059302 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-ServerGroupTestJSON-382452504-project Oct 08 21:07:15.059302 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:07:15.059302 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance group cde11d6e-d3f7-4b8f-b6dd-108d039faaaa could not be found. Oct 08 21:07:15.059302 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': 'cde11d6e-d3f7-4b8f-b6dd-108d039faaaa'} Oct 08 21:07:15.059302 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:07:15.059302 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:07:15.059302 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 08 21:07:15.059302 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 08 21:07:15.059302 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 08 21:07:15.059302 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 08 21:07:15.059302 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 08 21:07:15.059302 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 08 21:07:15.059302 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 08 21:07:15.059302 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 08 21:07:15.059302 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 08 21:07:15.059302 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 08 21:07:15.059302 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group cde11d6e-d3f7-4b8f-b6dd-108d039faaaa could not be found. Oct 08 21:07:15.059302 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:07:15.059302 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:07:15.059302 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:07:15.059302 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:07:15.059302 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:07:15.059302 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:07:15.059302 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:07:15.059302 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:07:15.059302 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:07:15.059302 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:07:15.059302 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 08 21:07:15.059302 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:07:15.059302 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group cde11d6e-d3f7-4b8f-b6dd-108d039faaaa could not be found. Oct 08 21:07:15.059302 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:07:15.059302 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:07:15.059302 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:07:15.059302 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:07:15.064257 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:07:15.064257 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:07:15.064257 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:07:15.064257 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:07:15.064257 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group cde11d6e-d3f7-4b8f-b6dd-108d039faaaa could not be found. Oct 08 21:07:15.064257 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:07:15.066602 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-eb3e11e7-21f2-4738-b2cb-3c572e4fb3a7 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Returning 404 to user: Instance group cde11d6e-d3f7-4b8f-b6dd-108d039faaaa could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:07:15.067795 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-eb3e11e7-21f2-4738-b2cb-3c572e4fb3a7 tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] 10.222.0.26 "DELETE /compute/v2.1/os-server-groups/cde11d6e-d3f7-4b8f-b6dd-108d039faaaa" status: 404 len: 117 microversion: 2.1 time: 0.025291 Oct 08 21:07:15.072629 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1787/3651] 10.222.0.26 () {58 vars in 1266 bytes} [Sat Oct 8 21:07:15 2022] DELETE /compute/v2.1/os-server-groups/cde11d6e-d3f7-4b8f-b6dd-108d039faaaa => generated 117 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:07:15.079075 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-dc7f0631-d40d-437c-97fa-231c4201a60c tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:15.086593 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-dc7f0631-d40d-437c-97fa-231c4201a60c tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] HTTP exception thrown: Instance group 26da0580-a573-4f29-9da7-036f8b51180e could not be found. Oct 08 21:07:15.088411 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-dc7f0631-d40d-437c-97fa-231c4201a60c tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Request method failure captured: Oct 08 21:07:15.088411 ncdv-master-1 devstack@n-api.service[140491]: request: DELETE /compute/v2.1/os-server-groups/26da0580-a573-4f29-9da7-036f8b51180e HTTP/1.1 Oct 08 21:07:15.088411 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:07:15.088411 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:07:15.088411 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:07:15.088411 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 21:07:15.088411 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:07:15.088411 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:07:15.088411 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:07:15.088411 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:07:15.088411 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeZYicrxfXnpkDmocvFFdE2ltgPLLVU3HrbbQvVlZf3AdfkBGQuiUMycoRkyhi196sUA3LbBHZtkHUjjbpbAxiT0U_q4jV5Dh5zKRUYDsZY44v7GzzJx8omyF6G-aAR-EvjagS5fIRUIz7sIdDT24-l_h3hZGEpcOFal5zZC6OQPfek Oct 08 21:07:15.088411 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:07:15.088411 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:07:15.088411 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:07:15.088411 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:07:15.088411 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:07:15.088411 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:07:15.088411 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 169293c01bf047358ff870a36c7a1247 Oct 08 21:07:15.088411 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-ServerGroupTestJSON-382452504 Oct 08 21:07:15.088411 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:07:15.088411 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:07:15.088411 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/169293c01bf047358ff870a36c7a1247"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/169293c01bf047358ff870a36c7a1247"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_169293c01bf047358ff870a36c7a1247"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/169293c01bf047358ff870a36c7a1247"}]}] Oct 08 21:07:15.088411 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-ServerGroupTestJSON-382452504 Oct 08 21:07:15.088411 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 169293c01bf047358ff870a36c7a1247 Oct 08 21:07:15.088411 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-ServerGroupTestJSON-382452504 Oct 08 21:07:15.088411 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-ServerGroupTestJSON-382452504-project Oct 08 21:07:15.088411 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:07:15.088411 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:07:15.088411 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: dcad18d0243f492591808197ca3dcc81 Oct 08 21:07:15.088411 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-ServerGroupTestJSON-382452504-project Oct 08 21:07:15.088411 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:07:15.088411 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance group 26da0580-a573-4f29-9da7-036f8b51180e could not be found. Oct 08 21:07:15.088411 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': '26da0580-a573-4f29-9da7-036f8b51180e'} Oct 08 21:07:15.088411 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:07:15.088411 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:07:15.088411 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 08 21:07:15.088411 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 08 21:07:15.088411 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 08 21:07:15.088411 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 08 21:07:15.088411 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 08 21:07:15.088411 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 08 21:07:15.088411 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 08 21:07:15.088411 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 08 21:07:15.088411 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 08 21:07:15.088411 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 08 21:07:15.088411 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 26da0580-a573-4f29-9da7-036f8b51180e could not be found. Oct 08 21:07:15.088411 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:07:15.088411 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:07:15.088411 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:07:15.088411 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:07:15.088411 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:07:15.088411 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:07:15.088411 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:07:15.088411 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:07:15.088411 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:07:15.088411 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:07:15.088411 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 08 21:07:15.088411 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:07:15.088411 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 26da0580-a573-4f29-9da7-036f8b51180e could not be found. Oct 08 21:07:15.088411 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:07:15.088411 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:07:15.088411 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:07:15.088411 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:07:15.093886 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:07:15.093886 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:07:15.093886 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:07:15.093886 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:07:15.093886 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 26da0580-a573-4f29-9da7-036f8b51180e could not be found. Oct 08 21:07:15.093886 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:07:15.095523 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-dc7f0631-d40d-437c-97fa-231c4201a60c tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Returning 404 to user: Instance group 26da0580-a573-4f29-9da7-036f8b51180e could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:07:15.097967 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-dc7f0631-d40d-437c-97fa-231c4201a60c tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] 10.222.0.26 "DELETE /compute/v2.1/os-server-groups/26da0580-a573-4f29-9da7-036f8b51180e" status: 404 len: 117 microversion: 2.1 time: 0.024000 Oct 08 21:07:15.100159 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1788/3652] 10.222.0.26 () {58 vars in 1266 bytes} [Sat Oct 8 21:07:15 2022] DELETE /compute/v2.1/os-server-groups/26da0580-a573-4f29-9da7-036f8b51180e => generated 117 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:07:15.112694 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-a42243fc-38ac-4201-be41-584224bdee8c tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:15.130230 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-a42243fc-38ac-4201-be41-584224bdee8c tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] HTTP exception thrown: Instance group 51a1f4f5-424c-4345-9dce-1aebbaa3f72f could not be found. Oct 08 21:07:15.135778 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-a42243fc-38ac-4201-be41-584224bdee8c tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Request method failure captured: Oct 08 21:07:15.135778 ncdv-master-1 devstack@n-api.service[140491]: request: DELETE /compute/v2.1/os-server-groups/51a1f4f5-424c-4345-9dce-1aebbaa3f72f HTTP/1.1 Oct 08 21:07:15.135778 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:07:15.135778 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:07:15.135778 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:07:15.135778 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 21:07:15.135778 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:07:15.135778 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:07:15.135778 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:07:15.135778 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:07:15.135778 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeZYicrxfXnpkDmocvFFdE2ltgPLLVU3HrbbQvVlZf3AdfkBGQuiUMycoRkyhi196sUA3LbBHZtkHUjjbpbAxiT0U_q4jV5Dh5zKRUYDsZY44v7GzzJx8omyF6G-aAR-EvjagS5fIRUIz7sIdDT24-l_h3hZGEpcOFal5zZC6OQPfek Oct 08 21:07:15.135778 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:07:15.135778 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:07:15.135778 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:07:15.135778 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:07:15.135778 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:07:15.135778 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:07:15.135778 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 169293c01bf047358ff870a36c7a1247 Oct 08 21:07:15.135778 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-ServerGroupTestJSON-382452504 Oct 08 21:07:15.135778 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:07:15.135778 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:07:15.135778 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/169293c01bf047358ff870a36c7a1247"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/169293c01bf047358ff870a36c7a1247"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_169293c01bf047358ff870a36c7a1247"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/169293c01bf047358ff870a36c7a1247"}]}] Oct 08 21:07:15.135778 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-ServerGroupTestJSON-382452504 Oct 08 21:07:15.135778 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 169293c01bf047358ff870a36c7a1247 Oct 08 21:07:15.135778 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-ServerGroupTestJSON-382452504 Oct 08 21:07:15.135778 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-ServerGroupTestJSON-382452504-project Oct 08 21:07:15.135778 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:07:15.135778 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:07:15.135778 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: dcad18d0243f492591808197ca3dcc81 Oct 08 21:07:15.135778 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-ServerGroupTestJSON-382452504-project Oct 08 21:07:15.135778 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:07:15.135778 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance group 51a1f4f5-424c-4345-9dce-1aebbaa3f72f could not be found. Oct 08 21:07:15.135778 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': '51a1f4f5-424c-4345-9dce-1aebbaa3f72f'} Oct 08 21:07:15.135778 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:07:15.135778 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:07:15.135778 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 08 21:07:15.135778 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 08 21:07:15.135778 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 08 21:07:15.135778 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 08 21:07:15.135778 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 08 21:07:15.135778 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 08 21:07:15.135778 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 08 21:07:15.135778 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 08 21:07:15.135778 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 08 21:07:15.135778 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 08 21:07:15.135778 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 51a1f4f5-424c-4345-9dce-1aebbaa3f72f could not be found. Oct 08 21:07:15.135778 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:07:15.135778 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:07:15.135778 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:07:15.135778 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:07:15.135778 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:07:15.135778 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:07:15.135778 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:07:15.135778 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:07:15.135778 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:07:15.135778 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:07:15.135778 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 08 21:07:15.135778 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:07:15.135778 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 51a1f4f5-424c-4345-9dce-1aebbaa3f72f could not be found. Oct 08 21:07:15.135778 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:07:15.135778 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:07:15.135778 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:07:15.135778 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:07:15.141536 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:07:15.141536 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:07:15.141536 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:07:15.141536 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:07:15.141536 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 51a1f4f5-424c-4345-9dce-1aebbaa3f72f could not be found. Oct 08 21:07:15.141536 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:07:15.143858 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-a42243fc-38ac-4201-be41-584224bdee8c tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Returning 404 to user: Instance group 51a1f4f5-424c-4345-9dce-1aebbaa3f72f could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:07:15.146293 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-a42243fc-38ac-4201-be41-584224bdee8c tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] 10.222.0.26 "DELETE /compute/v2.1/os-server-groups/51a1f4f5-424c-4345-9dce-1aebbaa3f72f" status: 404 len: 117 microversion: 2.1 time: 0.041482 Oct 08 21:07:15.149495 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1789/3653] 10.222.0.26 () {58 vars in 1266 bytes} [Sat Oct 8 21:07:15 2022] DELETE /compute/v2.1/os-server-groups/51a1f4f5-424c-4345-9dce-1aebbaa3f72f => generated 117 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:07:15.161003 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-71aec791-aa9e-463c-82de-da7a505204dd tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:15.229963 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-71aec791-aa9e-463c-82de-da7a505204dd tempest-ServerGroupTestJSON-382452504 tempest-ServerGroupTestJSON-382452504-project] 10.222.0.26 "DELETE /compute/v2.1/os-server-groups/62ebe1b7-fbe1-40bd-94c6-db26b37342d4" status: 204 len: 0 microversion: 2.1 time: 0.077570 Oct 08 21:07:15.234471 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1790/3654] 10.222.0.26 () {58 vars in 1266 bytes} [Sat Oct 8 21:07:15 2022] DELETE /compute/v2.1/os-server-groups/62ebe1b7-fbe1-40bd-94c6-db26b37342d4 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 08 21:07:15.519649 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-e0c44333-2ecd-41e6-b71c-ea0fe6b797dc tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06443b5728fb4d1e95d6245820e786bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ded993145b4eda9d6a33b994519012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:15.539282 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-e0c44333-2ecd-41e6-b71c-ea0fe6b797dc tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "GET /compute/v2.1/servers/a0a81300-bb0a-4528-96eb-43c422f9df2d" status: 200 len: 1327 microversion: 2.1 time: 0.686529 Oct 08 21:07:15.541254 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1865/3655] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:07:14 2022] GET /compute/v2.1/servers/a0a81300-bb0a-4528-96eb-43c422f9df2d => generated 1327 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:07:15.832657 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-e05577f6-8993-4c70-9586-9ea021a2981b tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:15.833598 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-e05577f6-8993-4c70-9586-9ea021a2981b tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] [instance: dbacaeed-a40b-4e05-9635-5073dfdd8621] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:07:15.847764 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e05577f6-8993-4c70-9586-9ea021a2981b tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:15.848551 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e05577f6-8993-4c70-9586-9ea021a2981b tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:15.849111 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e05577f6-8993-4c70-9586-9ea021a2981b tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:15.850234 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e05577f6-8993-4c70-9586-9ea021a2981b tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:15.854821 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e05577f6-8993-4c70-9586-9ea021a2981b tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:15.855305 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e05577f6-8993-4c70-9586-9ea021a2981b tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:16.444352 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-e05577f6-8993-4c70-9586-9ea021a2981b tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:16.465000 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-e05577f6-8993-4c70-9586-9ea021a2981b tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:16.473624 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-e05577f6-8993-4c70-9586-9ea021a2981b tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:16.480573 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-e05577f6-8993-4c70-9586-9ea021a2981b tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] 10.222.0.26 "GET /compute/v2.1/servers/dbacaeed-a40b-4e05-9635-5073dfdd8621" status: 200 len: 1808 microversion: 2.20 time: 0.651330 Oct 08 21:07:16.514929 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1791/3656] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:07:15 2022] GET /compute/v2.1/servers/dbacaeed-a40b-4e05-9635-5073dfdd8621 => generated 1808 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 08 21:07:16.569277 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-b85d7d36-26b3-4b4c-9195-3a154ca88f6d tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:16.571164 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-b85d7d36-26b3-4b4c-9195-3a154ca88f6d tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: a0a81300-bb0a-4528-96eb-43c422f9df2d] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:07:16.605024 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b85d7d36-26b3-4b4c-9195-3a154ca88f6d tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:16.608431 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b85d7d36-26b3-4b4c-9195-3a154ca88f6d tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:16.609008 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b85d7d36-26b3-4b4c-9195-3a154ca88f6d tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:16.614715 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b85d7d36-26b3-4b4c-9195-3a154ca88f6d tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:16.616393 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b85d7d36-26b3-4b4c-9195-3a154ca88f6d tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:16.617581 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b85d7d36-26b3-4b4c-9195-3a154ca88f6d tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:17.545676 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-20db52d6-8362-4106-b80f-26acd656777e tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:17.547048 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-20db52d6-8362-4106-b80f-26acd656777e tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] [instance: dbacaeed-a40b-4e05-9635-5073dfdd8621] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:07:17.566943 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-20db52d6-8362-4106-b80f-26acd656777e tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:17.567927 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-20db52d6-8362-4106-b80f-26acd656777e tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:17.569172 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-20db52d6-8362-4106-b80f-26acd656777e tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:17.571908 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-20db52d6-8362-4106-b80f-26acd656777e tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:17.572834 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-20db52d6-8362-4106-b80f-26acd656777e tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:17.573715 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-20db52d6-8362-4106-b80f-26acd656777e tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:17.807591 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-b85d7d36-26b3-4b4c-9195-3a154ca88f6d tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06443b5728fb4d1e95d6245820e786bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ded993145b4eda9d6a33b994519012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:17.824426 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-b85d7d36-26b3-4b4c-9195-3a154ca88f6d tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "GET /compute/v2.1/servers/a0a81300-bb0a-4528-96eb-43c422f9df2d" status: 200 len: 1508 microversion: 2.1 time: 1.259385 Oct 08 21:07:17.826131 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1866/3657] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:07:16 2022] GET /compute/v2.1/servers/a0a81300-bb0a-4528-96eb-43c422f9df2d => generated 1508 bytes in 1263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:07:17.853806 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-96a06e85-ed65-4bcb-9d9c-993c0391529c tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:17.854843 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-96a06e85-ed65-4bcb-9d9c-993c0391529c tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: a0a81300-bb0a-4528-96eb-43c422f9df2d] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:07:17.868738 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-96a06e85-ed65-4bcb-9d9c-993c0391529c tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:17.869587 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-96a06e85-ed65-4bcb-9d9c-993c0391529c tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:17.876249 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-96a06e85-ed65-4bcb-9d9c-993c0391529c tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:17.877506 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-96a06e85-ed65-4bcb-9d9c-993c0391529c tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:17.878224 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-96a06e85-ed65-4bcb-9d9c-993c0391529c tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:17.878840 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-96a06e85-ed65-4bcb-9d9c-993c0391529c tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:18.413389 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-96a06e85-ed65-4bcb-9d9c-993c0391529c tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06443b5728fb4d1e95d6245820e786bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ded993145b4eda9d6a33b994519012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:18.436103 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-96a06e85-ed65-4bcb-9d9c-993c0391529c tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "GET /compute/v2.1/servers/a0a81300-bb0a-4528-96eb-43c422f9df2d" status: 200 len: 1508 microversion: 2.1 time: 0.587872 Oct 08 21:07:18.437054 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1867/3658] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:07:17 2022] GET /compute/v2.1/servers/a0a81300-bb0a-4528-96eb-43c422f9df2d => generated 1508 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:07:18.463294 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-efc73c37-6ead-4373-9f6d-a464d2d86980 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:18.464076 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-efc73c37-6ead-4373-9f6d-a464d2d86980 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: a0a81300-bb0a-4528-96eb-43c422f9df2d] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:07:18.478653 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-efc73c37-6ead-4373-9f6d-a464d2d86980 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:18.479648 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-efc73c37-6ead-4373-9f6d-a464d2d86980 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:18.480288 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-efc73c37-6ead-4373-9f6d-a464d2d86980 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:18.481260 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-efc73c37-6ead-4373-9f6d-a464d2d86980 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:18.490559 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-efc73c37-6ead-4373-9f6d-a464d2d86980 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:18.491361 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-efc73c37-6ead-4373-9f6d-a464d2d86980 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:18.557063 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-efc73c37-6ead-4373-9f6d-a464d2d86980 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: a0a81300-bb0a-4528-96eb-43c422f9df2d] Going to try to terminate instance {{(pid=140492) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 21:07:18.728044 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-efc73c37-6ead-4373-9f6d-a464d2d86980 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "DELETE /compute/v2.1/servers/a0a81300-bb0a-4528-96eb-43c422f9df2d" status: 204 len: 0 microversion: 2.1 time: 0.268449 Oct 08 21:07:18.732438 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1868/3659] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:07:18 2022] DELETE /compute/v2.1/servers/a0a81300-bb0a-4528-96eb-43c422f9df2d => generated 0 bytes in 270 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 21:07:18.738544 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-b960f6df-ff19-4c83-8713-1c728aaf716b tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:18.739577 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-b960f6df-ff19-4c83-8713-1c728aaf716b tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: a0a81300-bb0a-4528-96eb-43c422f9df2d] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:07:18.756634 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b960f6df-ff19-4c83-8713-1c728aaf716b tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:18.757719 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b960f6df-ff19-4c83-8713-1c728aaf716b tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:18.758437 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b960f6df-ff19-4c83-8713-1c728aaf716b tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:18.759428 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b960f6df-ff19-4c83-8713-1c728aaf716b tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:18.760120 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b960f6df-ff19-4c83-8713-1c728aaf716b tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:18.760776 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b960f6df-ff19-4c83-8713-1c728aaf716b tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:18.973627 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-20db52d6-8362-4106-b80f-26acd656777e tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:18.985412 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-20db52d6-8362-4106-b80f-26acd656777e tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:18.990718 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-20db52d6-8362-4106-b80f-26acd656777e tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:18.995007 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-20db52d6-8362-4106-b80f-26acd656777e tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] 10.222.0.26 "GET /compute/v2.1/servers/dbacaeed-a40b-4e05-9635-5073dfdd8621" status: 200 len: 1808 microversion: 2.20 time: 1.454858 Oct 08 21:07:19.002003 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1792/3660] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:07:17 2022] GET /compute/v2.1/servers/dbacaeed-a40b-4e05-9635-5073dfdd8621 => generated 1808 bytes in 1463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 08 21:07:19.543964 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-b960f6df-ff19-4c83-8713-1c728aaf716b tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06443b5728fb4d1e95d6245820e786bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ded993145b4eda9d6a33b994519012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:19.555401 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-b960f6df-ff19-4c83-8713-1c728aaf716b tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "GET /compute/v2.1/servers/a0a81300-bb0a-4528-96eb-43c422f9df2d" status: 200 len: 1514 microversion: 2.1 time: 0.821308 Oct 08 21:07:19.556750 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1869/3661] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:07:18 2022] GET /compute/v2.1/servers/a0a81300-bb0a-4528-96eb-43c422f9df2d => generated 1514 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:07:20.031671 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-1edc4f75-cb9f-4ed3-95a4-d0852a2aa60a tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:20.034224 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-1edc4f75-cb9f-4ed3-95a4-d0852a2aa60a tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] [instance: dbacaeed-a40b-4e05-9635-5073dfdd8621] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:07:20.062402 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1edc4f75-cb9f-4ed3-95a4-d0852a2aa60a tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:20.067916 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1edc4f75-cb9f-4ed3-95a4-d0852a2aa60a tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:20.068389 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1edc4f75-cb9f-4ed3-95a4-d0852a2aa60a tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:20.076133 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1edc4f75-cb9f-4ed3-95a4-d0852a2aa60a tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:20.078237 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1edc4f75-cb9f-4ed3-95a4-d0852a2aa60a tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:20.078715 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1edc4f75-cb9f-4ed3-95a4-d0852a2aa60a tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:20.584306 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-a4ec4ec8-0a54-4e0e-b934-68f690ebc484 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:20.586236 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-a4ec4ec8-0a54-4e0e-b934-68f690ebc484 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: a0a81300-bb0a-4528-96eb-43c422f9df2d] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:07:20.601256 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-1edc4f75-cb9f-4ed3-95a4-d0852a2aa60a tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:20.613823 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a4ec4ec8-0a54-4e0e-b934-68f690ebc484 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:20.617958 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a4ec4ec8-0a54-4e0e-b934-68f690ebc484 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:20.619353 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-1edc4f75-cb9f-4ed3-95a4-d0852a2aa60a tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:20.621367 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-1edc4f75-cb9f-4ed3-95a4-d0852a2aa60a tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:20.623678 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a4ec4ec8-0a54-4e0e-b934-68f690ebc484 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:20.624814 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a4ec4ec8-0a54-4e0e-b934-68f690ebc484 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:20.626919 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a4ec4ec8-0a54-4e0e-b934-68f690ebc484 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:20.627103 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-1edc4f75-cb9f-4ed3-95a4-d0852a2aa60a tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] 10.222.0.26 "GET /compute/v2.1/servers/dbacaeed-a40b-4e05-9635-5073dfdd8621" status: 200 len: 1808 microversion: 2.20 time: 0.602112 Oct 08 21:07:20.628085 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a4ec4ec8-0a54-4e0e-b934-68f690ebc484 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:20.630593 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1793/3662] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:07:20 2022] GET /compute/v2.1/servers/dbacaeed-a40b-4e05-9635-5073dfdd8621 => generated 1808 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:07:21.555737 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-a4ec4ec8-0a54-4e0e-b934-68f690ebc484 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06443b5728fb4d1e95d6245820e786bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ded993145b4eda9d6a33b994519012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:21.571458 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-a4ec4ec8-0a54-4e0e-b934-68f690ebc484 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "GET /compute/v2.1/servers/a0a81300-bb0a-4528-96eb-43c422f9df2d" status: 200 len: 1514 microversion: 2.1 time: 0.994635 Oct 08 21:07:21.575286 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1870/3663] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:07:20 2022] GET /compute/v2.1/servers/a0a81300-bb0a-4528-96eb-43c422f9df2d => generated 1514 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:07:21.663643 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-bb947d07-3ff5-45c2-a1ba-8a965430d7b7 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:21.669217 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-bb947d07-3ff5-45c2-a1ba-8a965430d7b7 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] [instance: dbacaeed-a40b-4e05-9635-5073dfdd8621] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:07:21.683296 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:DELETE=3 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:07:21.701988 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bb947d07-3ff5-45c2-a1ba-8a965430d7b7 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:21.702810 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bb947d07-3ff5-45c2-a1ba-8a965430d7b7 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:21.703846 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bb947d07-3ff5-45c2-a1ba-8a965430d7b7 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:21.704844 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bb947d07-3ff5-45c2-a1ba-8a965430d7b7 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:21.706951 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bb947d07-3ff5-45c2-a1ba-8a965430d7b7 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:21.708017 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bb947d07-3ff5-45c2-a1ba-8a965430d7b7 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:22.105859 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-bb947d07-3ff5-45c2-a1ba-8a965430d7b7 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:22.119950 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-bb947d07-3ff5-45c2-a1ba-8a965430d7b7 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:22.126034 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-bb947d07-3ff5-45c2-a1ba-8a965430d7b7 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:22.128885 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-bb947d07-3ff5-45c2-a1ba-8a965430d7b7 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] 10.222.0.26 "GET /compute/v2.1/servers/dbacaeed-a40b-4e05-9635-5073dfdd8621" status: 200 len: 1808 microversion: 2.20 time: 0.471257 Oct 08 21:07:22.130287 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1794/3664] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:07:21 2022] GET /compute/v2.1/servers/dbacaeed-a40b-4e05-9635-5073dfdd8621 => generated 1808 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:07:22.605762 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-973367c4-cc80-4551-bcb3-e590126b875b tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:22.606636 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-973367c4-cc80-4551-bcb3-e590126b875b tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: a0a81300-bb0a-4528-96eb-43c422f9df2d] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:07:22.624083 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-973367c4-cc80-4551-bcb3-e590126b875b tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:22.625157 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-973367c4-cc80-4551-bcb3-e590126b875b tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:22.625830 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-973367c4-cc80-4551-bcb3-e590126b875b tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:22.628596 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-973367c4-cc80-4551-bcb3-e590126b875b tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:22.630602 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-973367c4-cc80-4551-bcb3-e590126b875b tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:22.631254 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-973367c4-cc80-4551-bcb3-e590126b875b tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:22.912759 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-fe91f7cb-7747-4cbd-891d-21a0cca546e6 req-8c6ad6c7-e21c-4fa9-bd83-25ff840f0620 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0a81300-bb0a-4528-96eb-43c422f9df2d", "name": "network-vif-deleted", "tag": "21962079-10a4-45c9-895a-3c1a967155b3"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:07:22.935902 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-fe91f7cb-7747-4cbd-891d-21a0cca546e6 req-8c6ad6c7-e21c-4fa9-bd83-25ff840f0620 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:22.945915 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-fe91f7cb-7747-4cbd-891d-21a0cca546e6 req-8c6ad6c7-e21c-4fa9-bd83-25ff840f0620 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:22.946730 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-fe91f7cb-7747-4cbd-891d-21a0cca546e6 req-8c6ad6c7-e21c-4fa9-bd83-25ff840f0620 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:22.960738 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-973367c4-cc80-4551-bcb3-e590126b875b tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06443b5728fb4d1e95d6245820e786bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ded993145b4eda9d6a33b994519012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:22.973505 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-973367c4-cc80-4551-bcb3-e590126b875b tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "GET /compute/v2.1/servers/a0a81300-bb0a-4528-96eb-43c422f9df2d" status: 200 len: 1472 microversion: 2.1 time: 0.375441 Oct 08 21:07:22.981929 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1871/3665] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:07:22 2022] GET /compute/v2.1/servers/a0a81300-bb0a-4528-96eb-43c422f9df2d => generated 1472 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:07:23.004503 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-fe91f7cb-7747-4cbd-891d-21a0cca546e6 req-8c6ad6c7-e21c-4fa9-bd83-25ff840f0620 service nova] Creating event network-vif-deleted:21962079-10a4-45c9-895a-3c1a967155b3 for instance a0a81300-bb0a-4528-96eb-43c422f9df2d on nch2-master-1 Oct 08 21:07:23.021899 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-fe91f7cb-7747-4cbd-891d-21a0cca546e6 req-8c6ad6c7-e21c-4fa9-bd83-25ff840f0620 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112843 Oct 08 21:07:23.032717 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1795/3666] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:07:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:07:23.159409 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e79ceb49-7ca1-421f-9903-64ca2fe51280 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:23.160592 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-e79ceb49-7ca1-421f-9903-64ca2fe51280 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] [instance: dbacaeed-a40b-4e05-9635-5073dfdd8621] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:07:23.182037 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e79ceb49-7ca1-421f-9903-64ca2fe51280 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:23.186487 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e79ceb49-7ca1-421f-9903-64ca2fe51280 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:23.188381 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e79ceb49-7ca1-421f-9903-64ca2fe51280 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:23.190157 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e79ceb49-7ca1-421f-9903-64ca2fe51280 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:23.190854 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e79ceb49-7ca1-421f-9903-64ca2fe51280 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:23.194687 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e79ceb49-7ca1-421f-9903-64ca2fe51280 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:24.003957 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-e8392efe-c82a-455f-a549-9200a568a19b tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:24.005450 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-e8392efe-c82a-455f-a549-9200a568a19b tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: a0a81300-bb0a-4528-96eb-43c422f9df2d] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:07:24.029883 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e8392efe-c82a-455f-a549-9200a568a19b tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:24.030743 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e8392efe-c82a-455f-a549-9200a568a19b tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:24.032197 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e8392efe-c82a-455f-a549-9200a568a19b tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:24.034436 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e8392efe-c82a-455f-a549-9200a568a19b tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:24.036966 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e8392efe-c82a-455f-a549-9200a568a19b tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:24.037676 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e8392efe-c82a-455f-a549-9200a568a19b tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:24.051316 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=100 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:07:24.158780 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e8392efe-c82a-455f-a549-9200a568a19b tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:24.159564 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e8392efe-c82a-455f-a549-9200a568a19b tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:24.161764 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e8392efe-c82a-455f-a549-9200a568a19b tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:24.162512 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.objects.instance [None req-e8392efe-c82a-455f-a549-9200a568a19b tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lazy-loading 'fault' on Instance uuid a0a81300-bb0a-4528-96eb-43c422f9df2d {{(pid=140491) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 21:07:24.184306 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-e79ceb49-7ca1-421f-9903-64ca2fe51280 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:24.205547 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-e79ceb49-7ca1-421f-9903-64ca2fe51280 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:24.207601 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-e79ceb49-7ca1-421f-9903-64ca2fe51280 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:24.209470 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-e79ceb49-7ca1-421f-9903-64ca2fe51280 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] 10.222.0.26 "GET /compute/v2.1/servers/dbacaeed-a40b-4e05-9635-5073dfdd8621" status: 200 len: 1808 microversion: 2.20 time: 1.055617 Oct 08 21:07:24.228313 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1872/3667] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:07:23 2022] GET /compute/v2.1/servers/dbacaeed-a40b-4e05-9635-5073dfdd8621 => generated 1808 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:07:24.407544 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-e8392efe-c82a-455f-a549-9200a568a19b tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06443b5728fb4d1e95d6245820e786bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ded993145b4eda9d6a33b994519012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:24.415587 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-e8392efe-c82a-455f-a549-9200a568a19b tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "GET /compute/v2.1/servers/a0a81300-bb0a-4528-96eb-43c422f9df2d" status: 200 len: 1317 microversion: 2.1 time: 0.416019 Oct 08 21:07:24.433528 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1796/3668] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:07:23 2022] GET /compute/v2.1/servers/a0a81300-bb0a-4528-96eb-43c422f9df2d => generated 1317 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:07:25.237555 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-2431d43a-0402-42d7-9268-cc91765bb877 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:25.238337 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-2431d43a-0402-42d7-9268-cc91765bb877 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] [instance: dbacaeed-a40b-4e05-9635-5073dfdd8621] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:07:25.249915 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2431d43a-0402-42d7-9268-cc91765bb877 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:25.250570 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2431d43a-0402-42d7-9268-cc91765bb877 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:25.251116 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2431d43a-0402-42d7-9268-cc91765bb877 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:25.252036 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2431d43a-0402-42d7-9268-cc91765bb877 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:25.252584 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2431d43a-0402-42d7-9268-cc91765bb877 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:25.253121 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2431d43a-0402-42d7-9268-cc91765bb877 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:25.442524 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-0f34f44a-43d9-41ef-aab6-5cebade89071 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:25.443818 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-0f34f44a-43d9-41ef-aab6-5cebade89071 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: a0a81300-bb0a-4528-96eb-43c422f9df2d] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:07:25.457420 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0f34f44a-43d9-41ef-aab6-5cebade89071 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:25.461863 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0f34f44a-43d9-41ef-aab6-5cebade89071 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:25.462564 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0f34f44a-43d9-41ef-aab6-5cebade89071 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:25.468577 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0f34f44a-43d9-41ef-aab6-5cebade89071 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:25.470384 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0f34f44a-43d9-41ef-aab6-5cebade89071 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:25.471415 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0f34f44a-43d9-41ef-aab6-5cebade89071 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:25.505900 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-0f34f44a-43d9-41ef-aab6-5cebade89071 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] HTTP exception thrown: Instance a0a81300-bb0a-4528-96eb-43c422f9df2d could not be found. Oct 08 21:07:25.512053 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-0f34f44a-43d9-41ef-aab6-5cebade89071 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Request method failure captured: Oct 08 21:07:25.512053 ncdv-master-1 devstack@n-api.service[140491]: request: GET /compute/v2.1/servers/a0a81300-bb0a-4528-96eb-43c422f9df2d HTTP/1.1 Oct 08 21:07:25.512053 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:07:25.512053 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:07:25.512053 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:07:25.512053 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 21:07:25.512053 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:07:25.512053 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:07:25.512053 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:07:25.512053 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:07:25.512053 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeYsdf-NgsPUaUb78CUpk0vq18mlUqdb1er-CKgSGnwcxKYVDw5Br5ObGheB0PHKIrwGHgJ4op59IUcxCd3ChQqclxeYxKhK3ZwkXmw1AwIGXWjgktrsk6DH6ba1NMLmZ1pzBqcyvzB3CMIuC4HBXIHDILjU44EobGpdQQ8lNmKdDFM Oct 08 21:07:25.512053 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:07:25.512053 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:07:25.512053 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:07:25.512053 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:07:25.512053 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:07:25.512053 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:07:25.512053 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: e7ded993145b4eda9d6a33b994519012 Oct 08 21:07:25.512053 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-ServersTestJSON-68907085 Oct 08 21:07:25.512053 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:07:25.512053 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:07:25.512053 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/e7ded993145b4eda9d6a33b994519012"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e7ded993145b4eda9d6a33b994519012"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_e7ded993145b4eda9d6a33b994519012"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e7ded993145b4eda9d6a33b994519012"}]}] Oct 08 21:07:25.512053 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-ServersTestJSON-68907085 Oct 08 21:07:25.512053 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: e7ded993145b4eda9d6a33b994519012 Oct 08 21:07:25.512053 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-ServersTestJSON-68907085 Oct 08 21:07:25.512053 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-ServersTestJSON-68907085-project Oct 08 21:07:25.512053 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:07:25.512053 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:07:25.512053 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 06443b5728fb4d1e95d6245820e786bf Oct 08 21:07:25.512053 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-ServersTestJSON-68907085-project Oct 08 21:07:25.512053 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:07:25.512053 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance a0a81300-bb0a-4528-96eb-43c422f9df2d could not be found. Oct 08 21:07:25.512053 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': 'a0a81300-bb0a-4528-96eb-43c422f9df2d'} Oct 08 21:07:25.512053 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:07:25.512053 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:07:25.512053 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:07:25.512053 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:07:25.512053 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:07:25.512053 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:07:25.512053 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:07:25.512053 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:07:25.512053 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:07:25.512053 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:07:25.512053 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0a81300-bb0a-4528-96eb-43c422f9df2d could not be found. Oct 08 21:07:25.512053 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:07:25.512053 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:07:25.512053 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:07:25.512053 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:07:25.512053 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:07:25.512053 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:07:25.512053 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:07:25.512053 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:07:25.512053 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:07:25.512053 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:07:25.512053 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:07:25.512053 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:07:25.512053 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:07:25.512053 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:07:25.512053 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:07:25.512053 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:07:25.512053 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0a81300-bb0a-4528-96eb-43c422f9df2d could not be found. Oct 08 21:07:25.512053 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:07:25.512053 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:07:25.512053 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:07:25.512053 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:07:25.519143 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:07:25.519143 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:07:25.519143 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:07:25.519143 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:07:25.519143 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0a81300-bb0a-4528-96eb-43c422f9df2d could not be found. Oct 08 21:07:25.519143 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:07:25.523452 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-2431d43a-0402-42d7-9268-cc91765bb877 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:25.537917 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-0f34f44a-43d9-41ef-aab6-5cebade89071 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Returning 404 to user: Instance a0a81300-bb0a-4528-96eb-43c422f9df2d could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:07:25.539050 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-0f34f44a-43d9-41ef-aab6-5cebade89071 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "GET /compute/v2.1/servers/a0a81300-bb0a-4528-96eb-43c422f9df2d" status: 404 len: 111 microversion: 2.1 time: 0.101709 Oct 08 21:07:25.539269 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-2431d43a-0402-42d7-9268-cc91765bb877 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:25.541202 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-2431d43a-0402-42d7-9268-cc91765bb877 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:25.543493 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1797/3669] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:07:25 2022] GET /compute/v2.1/servers/a0a81300-bb0a-4528-96eb-43c422f9df2d => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 08 21:07:25.545075 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-2431d43a-0402-42d7-9268-cc91765bb877 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] 10.222.0.26 "GET /compute/v2.1/servers/dbacaeed-a40b-4e05-9635-5073dfdd8621" status: 200 len: 1808 microversion: 2.20 time: 0.312064 Oct 08 21:07:25.567122 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1873/3670] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:07:25 2022] GET /compute/v2.1/servers/dbacaeed-a40b-4e05-9635-5073dfdd8621 => generated 1808 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:07:25.569933 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-38f6f743-7939-4f22-a0ca-7af11fb19321 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '.version_select at 0x7f1a8786de50>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:25.593977 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-38f6f743-7939-4f22-a0ca-7af11fb19321 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-key-849184593" status: 202 len: 0 microversion: 2.1 time: 0.034657 Oct 08 21:07:25.596046 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1798/3671] 10.222.0.26 () {58 vars in 1206 bytes} [Sat Oct 8 21:07:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-849184593 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 21:07:25.794242 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-7c689d17-5ea4-42af-813b-11f070b459e6 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1953352793", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "networks": [{"uuid": "983c5654-1828-48da-a871-2028e691f4b0"}]}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:07:25.865816 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.network.neutron [None req-7c689d17-5ea4-42af-813b-11f070b459e6 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] validate_networks() for [('983c5654-1828-48da-a871-2028e691f4b0', None, None, None, None, None)] {{(pid=140492) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 21:07:26.582052 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-6b5ab25e-f78e-4205-976a-6573fab49894 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:26.583519 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-6b5ab25e-f78e-4205-976a-6573fab49894 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] [instance: dbacaeed-a40b-4e05-9635-5073dfdd8621] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:07:26.592812 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6b5ab25e-f78e-4205-976a-6573fab49894 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:26.610682 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6b5ab25e-f78e-4205-976a-6573fab49894 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:26.611497 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6b5ab25e-f78e-4205-976a-6573fab49894 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:26.612450 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6b5ab25e-f78e-4205-976a-6573fab49894 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:26.613106 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6b5ab25e-f78e-4205-976a-6573fab49894 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:26.614361 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6b5ab25e-f78e-4205-976a-6573fab49894 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:27.159707 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-7c689d17-5ea4-42af-813b-11f070b459e6 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Flavor limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 21:07:27.161800 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-7c689d17-5ea4-42af-813b-11f070b459e6 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Image limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 21:07:27.162522 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-7c689d17-5ea4-42af-813b-11f070b459e6 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Flavor pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 21:07:27.163217 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-7c689d17-5ea4-42af-813b-11f070b459e6 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Image pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 21:07:27.163986 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-7c689d17-5ea4-42af-813b-11f070b459e6 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 21:07:27.181406 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7c689d17-5ea4-42af-813b-11f070b459e6 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:27.182001 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7c689d17-5ea4-42af-813b-11f070b459e6 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:27.182696 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7c689d17-5ea4-42af-813b-11f070b459e6 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:27.183680 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7c689d17-5ea4-42af-813b-11f070b459e6 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:27.184441 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7c689d17-5ea4-42af-813b-11f070b459e6 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:27.185105 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7c689d17-5ea4-42af-813b-11f070b459e6 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:27.247804 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-7c689d17-5ea4-42af-813b-11f070b459e6 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Getting quotas for project e7ded993145b4eda9d6a33b994519012. Resources: {'cores', 'instances', 'ram'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:07:27.264962 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-7c689d17-5ea4-42af-813b-11f070b459e6 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Getting quotas for user 06443b5728fb4d1e95d6245820e786bf and project e7ded993145b4eda9d6a33b994519012. Resources: {'cores', 'instances', 'ram'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:07:27.305852 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-7c689d17-5ea4-42af-813b-11f070b459e6 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Going to run 1 instances... {{(pid=140492) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 21:07:27.309928 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-7c689d17-5ea4-42af-813b-11f070b459e6 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: c7e330f4-220e-4dce-b65e-0aedb3206dda] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c508bd7f-7db9-4b2c-af7c-be54a855c355',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140492) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 21:07:27.396020 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-7c689d17-5ea4-42af-813b-11f070b459e6 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.605557 Oct 08 21:07:27.399998 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1874/3672] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 21:07:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 1610 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 08 21:07:27.416438 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-9b91186c-bd74-4f0f-a6a3-63604a99d844 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:27.417170 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-9b91186c-bd74-4f0f-a6a3-63604a99d844 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: c7e330f4-220e-4dce-b65e-0aedb3206dda] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:07:27.522204 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-9b91186c-bd74-4f0f-a6a3-63604a99d844 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06443b5728fb4d1e95d6245820e786bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ded993145b4eda9d6a33b994519012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:27.541997 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-9b91186c-bd74-4f0f-a6a3-63604a99d844 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "GET /compute/v2.1/servers/c7e330f4-220e-4dce-b65e-0aedb3206dda" status: 200 len: 1209 microversion: 2.1 time: 0.133101 Oct 08 21:07:27.558858 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1875/3673] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:07:27 2022] GET /compute/v2.1/servers/c7e330f4-220e-4dce-b65e-0aedb3206dda => generated 1209 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:07:27.570480 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-6b5ab25e-f78e-4205-976a-6573fab49894 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:27.585985 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-6b5ab25e-f78e-4205-976a-6573fab49894 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:27.591406 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-6b5ab25e-f78e-4205-976a-6573fab49894 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:27.592776 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-6b5ab25e-f78e-4205-976a-6573fab49894 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] 10.222.0.26 "GET /compute/v2.1/servers/dbacaeed-a40b-4e05-9635-5073dfdd8621" status: 200 len: 1808 microversion: 2.20 time: 1.018196 Oct 08 21:07:27.596357 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1799/3674] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:07:26 2022] GET /compute/v2.1/servers/dbacaeed-a40b-4e05-9635-5073dfdd8621 => generated 1808 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:07:28.572078 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-00b4e1b8-b281-4971-ac6e-a0dc797a1af7 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:28.572761 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-00b4e1b8-b281-4971-ac6e-a0dc797a1af7 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: c7e330f4-220e-4dce-b65e-0aedb3206dda] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:07:28.626363 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-d78ba609-ef6a-495b-9596-0b17388d4c79 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:28.627116 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-d78ba609-ef6a-495b-9596-0b17388d4c79 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] [instance: dbacaeed-a40b-4e05-9635-5073dfdd8621] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:07:28.658648 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d78ba609-ef6a-495b-9596-0b17388d4c79 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:28.660741 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d78ba609-ef6a-495b-9596-0b17388d4c79 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:28.661626 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d78ba609-ef6a-495b-9596-0b17388d4c79 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:28.669234 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d78ba609-ef6a-495b-9596-0b17388d4c79 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:28.671972 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d78ba609-ef6a-495b-9596-0b17388d4c79 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:28.672433 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d78ba609-ef6a-495b-9596-0b17388d4c79 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:28.768057 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-00b4e1b8-b281-4971-ac6e-a0dc797a1af7 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06443b5728fb4d1e95d6245820e786bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ded993145b4eda9d6a33b994519012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:28.793929 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-00b4e1b8-b281-4971-ac6e-a0dc797a1af7 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "GET /compute/v2.1/servers/c7e330f4-220e-4dce-b65e-0aedb3206dda" status: 200 len: 1209 microversion: 2.1 time: 0.218762 Oct 08 21:07:28.796124 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1876/3675] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:07:28 2022] GET /compute/v2.1/servers/c7e330f4-220e-4dce-b65e-0aedb3206dda => generated 1209 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:07:29.636580 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-d78ba609-ef6a-495b-9596-0b17388d4c79 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:29.654723 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-d78ba609-ef6a-495b-9596-0b17388d4c79 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:29.657934 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-d78ba609-ef6a-495b-9596-0b17388d4c79 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:29.662169 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-d78ba609-ef6a-495b-9596-0b17388d4c79 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] 10.222.0.26 "GET /compute/v2.1/servers/dbacaeed-a40b-4e05-9635-5073dfdd8621" status: 200 len: 1808 microversion: 2.20 time: 1.040738 Oct 08 21:07:29.665654 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1800/3676] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:07:28 2022] GET /compute/v2.1/servers/dbacaeed-a40b-4e05-9635-5073dfdd8621 => generated 1808 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:07:29.822384 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-af31ad18-3ee6-48b9-9462-9bab8c87d7db tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:29.823698 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-af31ad18-3ee6-48b9-9462-9bab8c87d7db tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: c7e330f4-220e-4dce-b65e-0aedb3206dda] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:07:29.846280 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-af31ad18-3ee6-48b9-9462-9bab8c87d7db tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:29.847398 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-af31ad18-3ee6-48b9-9462-9bab8c87d7db tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:29.848169 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-af31ad18-3ee6-48b9-9462-9bab8c87d7db tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:29.849006 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-af31ad18-3ee6-48b9-9462-9bab8c87d7db tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:29.855028 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-af31ad18-3ee6-48b9-9462-9bab8c87d7db tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:29.855515 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-af31ad18-3ee6-48b9-9462-9bab8c87d7db tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:30.203422 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-af31ad18-3ee6-48b9-9462-9bab8c87d7db tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06443b5728fb4d1e95d6245820e786bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ded993145b4eda9d6a33b994519012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:30.216781 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-af31ad18-3ee6-48b9-9462-9bab8c87d7db tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "GET /compute/v2.1/servers/c7e330f4-220e-4dce-b65e-0aedb3206dda" status: 200 len: 1269 microversion: 2.1 time: 0.395389 Oct 08 21:07:30.217455 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1877/3677] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:07:29 2022] GET /compute/v2.1/servers/c7e330f4-220e-4dce-b65e-0aedb3206dda => generated 1269 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:07:30.703440 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-df4da564-7374-42fc-bd11-f6d7ef0535a8 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-1866234462", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "networks": "none"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:07:30.804038 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-df4da564-7374-42fc-bd11-f6d7ef0535a8 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Flavor limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 21:07:30.804472 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-df4da564-7374-42fc-bd11-f6d7ef0535a8 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Image limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 21:07:30.805098 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-df4da564-7374-42fc-bd11-f6d7ef0535a8 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Flavor pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 21:07:30.805669 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-df4da564-7374-42fc-bd11-f6d7ef0535a8 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Image pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 21:07:30.806137 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-df4da564-7374-42fc-bd11-f6d7ef0535a8 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 21:07:30.832273 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-df4da564-7374-42fc-bd11-f6d7ef0535a8 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:30.835552 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-d53133b3-f936-444a-9efc-ea2109e29f70 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1042877090", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "networks": [{"uuid": "76a3600a-da76-44b8-88b9-2779bd398388"}]}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:07:30.836064 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-df4da564-7374-42fc-bd11-f6d7ef0535a8 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:30.836384 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-df4da564-7374-42fc-bd11-f6d7ef0535a8 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:30.839430 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-df4da564-7374-42fc-bd11-f6d7ef0535a8 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:30.841003 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-df4da564-7374-42fc-bd11-f6d7ef0535a8 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:30.843057 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-df4da564-7374-42fc-bd11-f6d7ef0535a8 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:30.874521 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-df4da564-7374-42fc-bd11-f6d7ef0535a8 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Getting quotas for project 4acc59093f954b61ba9f3cd05e940c28. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:07:30.884896 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-df4da564-7374-42fc-bd11-f6d7ef0535a8 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Getting quotas for user b9cd61a0df164a9e9197022508adafbf and project 4acc59093f954b61ba9f3cd05e940c28. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:07:30.905068 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-df4da564-7374-42fc-bd11-f6d7ef0535a8 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Going to run 1 instances... {{(pid=140491) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 21:07:30.908483 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-df4da564-7374-42fc-bd11-f6d7ef0535a8 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] [instance: b1983b4c-4fd2-4ec8-9fb0-aa1f7fa51219] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c508bd7f-7db9-4b2c-af7c-be54a855c355',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140491) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 21:07:30.928913 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.network.neutron [None req-d53133b3-f936-444a-9efc-ea2109e29f70 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] validate_networks() for [('76a3600a-da76-44b8-88b9-2779bd398388', None, None, None, None, None)] {{(pid=140492) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 21:07:31.051518 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-df4da564-7374-42fc-bd11-f6d7ef0535a8 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.808196 Oct 08 21:07:31.056312 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1801/3678] 10.222.0.26 () {62 vars in 1188 bytes} [Sat Oct 8 21:07:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 813 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 08 21:07:31.079875 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-e048af7b-611d-4ffd-beca-af9460f4f497 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:31.080488 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-e048af7b-611d-4ffd-beca-af9460f4f497 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] [instance: dbacaeed-a40b-4e05-9635-5073dfdd8621] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:07:31.111582 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e048af7b-611d-4ffd-beca-af9460f4f497 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:31.112091 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e048af7b-611d-4ffd-beca-af9460f4f497 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:31.112537 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e048af7b-611d-4ffd-beca-af9460f4f497 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:31.120024 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e048af7b-611d-4ffd-beca-af9460f4f497 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:31.122587 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e048af7b-611d-4ffd-beca-af9460f4f497 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:31.123760 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e048af7b-611d-4ffd-beca-af9460f4f497 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:31.717352 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-e048af7b-611d-4ffd-beca-af9460f4f497 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:31.729092 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-e048af7b-611d-4ffd-beca-af9460f4f497 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:31.743560 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-e048af7b-611d-4ffd-beca-af9460f4f497 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:31.748636 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-e048af7b-611d-4ffd-beca-af9460f4f497 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] 10.222.0.26 "GET /compute/v2.1/servers/dbacaeed-a40b-4e05-9635-5073dfdd8621" status: 200 len: 1808 microversion: 2.20 time: 0.690253 Oct 08 21:07:31.758205 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1802/3679] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:07:31 2022] GET /compute/v2.1/servers/dbacaeed-a40b-4e05-9635-5073dfdd8621 => generated 1808 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:07:31.766791 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-41531e67-bb00-474b-a2cd-37bd17a73446 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:31.771529 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-41531e67-bb00-474b-a2cd-37bd17a73446 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] [instance: b1983b4c-4fd2-4ec8-9fb0-aa1f7fa51219] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:07:32.051023 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-41531e67-bb00-474b-a2cd-37bd17a73446 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9cd61a0df164a9e9197022508adafbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acc59093f954b61ba9f3cd05e940c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:32.079688 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-41531e67-bb00-474b-a2cd-37bd17a73446 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9cd61a0df164a9e9197022508adafbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acc59093f954b61ba9f3cd05e940c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:32.080970 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-41531e67-bb00-474b-a2cd-37bd17a73446 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9cd61a0df164a9e9197022508adafbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acc59093f954b61ba9f3cd05e940c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:32.082518 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-41531e67-bb00-474b-a2cd-37bd17a73446 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] 10.222.0.26 "GET /compute/v2.1/servers/b1983b4c-4fd2-4ec8-9fb0-aa1f7fa51219" status: 200 len: 1278 microversion: 2.54 time: 0.323053 Oct 08 21:07:32.083696 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1803/3680] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:07:31 2022] GET /compute/v2.1/servers/b1983b4c-4fd2-4ec8-9fb0-aa1f7fa51219 => generated 1278 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:07:32.088732 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-fb840a9d-5f89-4334-beff-671ae9dd9a30 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:32.090628 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-fb840a9d-5f89-4334-beff-671ae9dd9a30 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: c7e330f4-220e-4dce-b65e-0aedb3206dda] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:07:32.104360 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fb840a9d-5f89-4334-beff-671ae9dd9a30 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:32.105656 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fb840a9d-5f89-4334-beff-671ae9dd9a30 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:32.106442 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fb840a9d-5f89-4334-beff-671ae9dd9a30 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:32.107542 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fb840a9d-5f89-4334-beff-671ae9dd9a30 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:32.108267 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fb840a9d-5f89-4334-beff-671ae9dd9a30 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:32.108981 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fb840a9d-5f89-4334-beff-671ae9dd9a30 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:32.369324 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-d53133b3-f936-444a-9efc-ea2109e29f70 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Flavor limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 21:07:32.370703 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-d53133b3-f936-444a-9efc-ea2109e29f70 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Image limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 21:07:32.372145 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-d53133b3-f936-444a-9efc-ea2109e29f70 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Flavor pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 21:07:32.372803 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-d53133b3-f936-444a-9efc-ea2109e29f70 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Image pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 21:07:32.373502 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-d53133b3-f936-444a-9efc-ea2109e29f70 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 21:07:32.376805 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:07:32.434619 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d53133b3-f936-444a-9efc-ea2109e29f70 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:32.437448 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d53133b3-f936-444a-9efc-ea2109e29f70 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:32.439483 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d53133b3-f936-444a-9efc-ea2109e29f70 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:32.440582 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d53133b3-f936-444a-9efc-ea2109e29f70 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:32.441787 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d53133b3-f936-444a-9efc-ea2109e29f70 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:32.444504 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d53133b3-f936-444a-9efc-ea2109e29f70 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:32.534560 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-d53133b3-f936-444a-9efc-ea2109e29f70 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Getting quotas for project 6bcd0e7c24154409824f96e9e99da357. Resources: {'cores', 'instances', 'ram'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:07:32.550822 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-d53133b3-f936-444a-9efc-ea2109e29f70 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Getting quotas for user 30fe0e1ffa1040ec85d3c32d8b741c75 and project 6bcd0e7c24154409824f96e9e99da357. Resources: {'cores', 'instances', 'ram'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:07:32.620389 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-d53133b3-f936-444a-9efc-ea2109e29f70 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Going to run 1 instances... {{(pid=140492) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 21:07:32.624263 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-d53133b3-f936-444a-9efc-ea2109e29f70 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] [instance: f1b4faf3-0c03-4e0c-be81-be3305b8314f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c508bd7f-7db9-4b2c-af7c-be54a855c355',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140492) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 21:07:32.767004 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-d53133b3-f936-444a-9efc-ea2109e29f70 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.173125 Oct 08 21:07:32.769880 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1878/3681] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 21:07:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 2176 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 08 21:07:33.087247 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-3372ac98-cf49-4ead-8831-b9c9879ea006 req-b26ee18c-df50-4b32-a9bc-b5ba111271ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbacaeed-a40b-4e05-9635-5073dfdd8621", "name": "network-vif-plugged", "status": "completed", "tag": "6fe657e1-039e-4549-b2d4-955cfbaed37d"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:07:33.102744 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-3372ac98-cf49-4ead-8831-b9c9879ea006 req-b26ee18c-df50-4b32-a9bc-b5ba111271ae service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:33.103968 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-3372ac98-cf49-4ead-8831-b9c9879ea006 req-b26ee18c-df50-4b32-a9bc-b5ba111271ae service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:33.104846 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-3372ac98-cf49-4ead-8831-b9c9879ea006 req-b26ee18c-df50-4b32-a9bc-b5ba111271ae service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:33.127718 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-3372ac98-cf49-4ead-8831-b9c9879ea006 req-b26ee18c-df50-4b32-a9bc-b5ba111271ae service nova] Creating event network-vif-plugged:6fe657e1-039e-4549-b2d4-955cfbaed37d for instance dbacaeed-a40b-4e05-9635-5073dfdd8621 on nch2-master-1 Oct 08 21:07:33.140147 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-3372ac98-cf49-4ead-8831-b9c9879ea006 req-b26ee18c-df50-4b32-a9bc-b5ba111271ae service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.368019 Oct 08 21:07:33.144617 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1879/3682] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:07:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:07:33.179613 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-67fa61a5-cf98-4ad8-a5f5-a9d104e7e2ab tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:33.180290 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-67fa61a5-cf98-4ad8-a5f5-a9d104e7e2ab tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] [instance: f1b4faf3-0c03-4e0c-be81-be3305b8314f] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:07:33.509926 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-67fa61a5-cf98-4ad8-a5f5-a9d104e7e2ab tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30fe0e1ffa1040ec85d3c32d8b741c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd0e7c24154409824f96e9e99da357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:33.526238 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-67fa61a5-cf98-4ad8-a5f5-a9d104e7e2ab tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "GET /compute/v2.1/servers/f1b4faf3-0c03-4e0c-be81-be3305b8314f" status: 200 len: 1208 microversion: 2.1 time: 0.380323 Oct 08 21:07:33.528940 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1880/3683] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:07:33 2022] GET /compute/v2.1/servers/f1b4faf3-0c03-4e0c-be81-be3305b8314f => generated 1208 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:07:33.544871 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-cebbbaf3-c769-40e7-a7de-47ba5e18332b tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:33.546268 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-cebbbaf3-c769-40e7-a7de-47ba5e18332b tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] [instance: dbacaeed-a40b-4e05-9635-5073dfdd8621] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:07:33.559983 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cebbbaf3-c769-40e7-a7de-47ba5e18332b tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:33.561849 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cebbbaf3-c769-40e7-a7de-47ba5e18332b tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:33.569567 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cebbbaf3-c769-40e7-a7de-47ba5e18332b tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:33.572355 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cebbbaf3-c769-40e7-a7de-47ba5e18332b tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:33.574919 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cebbbaf3-c769-40e7-a7de-47ba5e18332b tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:33.575761 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cebbbaf3-c769-40e7-a7de-47ba5e18332b tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:33.831423 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-fb840a9d-5f89-4334-beff-671ae9dd9a30 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06443b5728fb4d1e95d6245820e786bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ded993145b4eda9d6a33b994519012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:33.841494 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-fb840a9d-5f89-4334-beff-671ae9dd9a30 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "GET /compute/v2.1/servers/c7e330f4-220e-4dce-b65e-0aedb3206dda" status: 200 len: 1309 microversion: 2.1 time: 1.756017 Oct 08 21:07:33.847370 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1804/3684] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:07:32 2022] GET /compute/v2.1/servers/c7e330f4-220e-4dce-b65e-0aedb3206dda => generated 1309 bytes in 1762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:07:33.854129 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-5a4ca08e-e52d-44a4-80ba-1e80530e1594 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:33.854946 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-5a4ca08e-e52d-44a4-80ba-1e80530e1594 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] [instance: b1983b4c-4fd2-4ec8-9fb0-aa1f7fa51219] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:07:33.875359 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5a4ca08e-e52d-44a4-80ba-1e80530e1594 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:33.877785 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5a4ca08e-e52d-44a4-80ba-1e80530e1594 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:33.878436 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5a4ca08e-e52d-44a4-80ba-1e80530e1594 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:33.886898 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5a4ca08e-e52d-44a4-80ba-1e80530e1594 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:33.887970 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5a4ca08e-e52d-44a4-80ba-1e80530e1594 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:33.888587 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5a4ca08e-e52d-44a4-80ba-1e80530e1594 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:34.093799 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-5a4ca08e-e52d-44a4-80ba-1e80530e1594 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9cd61a0df164a9e9197022508adafbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acc59093f954b61ba9f3cd05e940c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:34.107140 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-5a4ca08e-e52d-44a4-80ba-1e80530e1594 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9cd61a0df164a9e9197022508adafbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acc59093f954b61ba9f3cd05e940c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:34.108638 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-5a4ca08e-e52d-44a4-80ba-1e80530e1594 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9cd61a0df164a9e9197022508adafbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acc59093f954b61ba9f3cd05e940c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:34.110548 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-5a4ca08e-e52d-44a4-80ba-1e80530e1594 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] 10.222.0.26 "GET /compute/v2.1/servers/b1983b4c-4fd2-4ec8-9fb0-aa1f7fa51219" status: 200 len: 1336 microversion: 2.54 time: 0.261847 Oct 08 21:07:34.116060 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1805/3685] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:07:33 2022] GET /compute/v2.1/servers/b1983b4c-4fd2-4ec8-9fb0-aa1f7fa51219 => generated 1336 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:07:34.212759 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-cebbbaf3-c769-40e7-a7de-47ba5e18332b tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:34.227977 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-cebbbaf3-c769-40e7-a7de-47ba5e18332b tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:34.229469 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-cebbbaf3-c769-40e7-a7de-47ba5e18332b tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:34.242113 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-cebbbaf3-c769-40e7-a7de-47ba5e18332b tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] 10.222.0.26 "GET /compute/v2.1/servers/dbacaeed-a40b-4e05-9635-5073dfdd8621" status: 200 len: 1808 microversion: 2.20 time: 0.698430 Oct 08 21:07:34.243880 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1881/3686] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:07:33 2022] GET /compute/v2.1/servers/dbacaeed-a40b-4e05-9635-5073dfdd8621 => generated 1808 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:07:34.544343 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-bd4bb44f-53dc-4467-9ff7-54fc7ac2013e req-0ada96cc-3c98-4b0a-9af9-fd3eac947e97 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7e330f4-220e-4dce-b65e-0aedb3206dda", "tag": "7ff15e3c-6e54-4f77-99ea-ec095e513133"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:07:34.556499 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-346ab48e-c7ee-4d37-bc0c-51e55f942824 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:34.557337 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-346ab48e-c7ee-4d37-bc0c-51e55f942824 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] [instance: f1b4faf3-0c03-4e0c-be81-be3305b8314f] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:07:34.565474 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-346ab48e-c7ee-4d37-bc0c-51e55f942824 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:34.566360 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-346ab48e-c7ee-4d37-bc0c-51e55f942824 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:34.567032 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-346ab48e-c7ee-4d37-bc0c-51e55f942824 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:34.568289 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-346ab48e-c7ee-4d37-bc0c-51e55f942824 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:34.569003 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-346ab48e-c7ee-4d37-bc0c-51e55f942824 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:34.569979 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-346ab48e-c7ee-4d37-bc0c-51e55f942824 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:34.579218 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-bd4bb44f-53dc-4467-9ff7-54fc7ac2013e req-0ada96cc-3c98-4b0a-9af9-fd3eac947e97 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:34.579759 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-bd4bb44f-53dc-4467-9ff7-54fc7ac2013e req-0ada96cc-3c98-4b0a-9af9-fd3eac947e97 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:34.580219 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-bd4bb44f-53dc-4467-9ff7-54fc7ac2013e req-0ada96cc-3c98-4b0a-9af9-fd3eac947e97 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:34.595167 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-bd4bb44f-53dc-4467-9ff7-54fc7ac2013e req-0ada96cc-3c98-4b0a-9af9-fd3eac947e97 service nova] Creating event network-changed:7ff15e3c-6e54-4f77-99ea-ec095e513133 for instance c7e330f4-220e-4dce-b65e-0aedb3206dda on nch2-master-1 Oct 08 21:07:34.603395 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-bd4bb44f-53dc-4467-9ff7-54fc7ac2013e req-0ada96cc-3c98-4b0a-9af9-fd3eac947e97 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063868 Oct 08 21:07:34.604578 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1806/3687] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:07:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:07:34.611449 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-7aafab09-9ede-407d-ae9d-088ed03ace9a tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:34.612684 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-7aafab09-9ede-407d-ae9d-088ed03ace9a tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] [instance: ce4a2fbf-76f3-4577-a704-3b64ec30d84b] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:07:34.620176 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:07:34.623176 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7aafab09-9ede-407d-ae9d-088ed03ace9a tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:34.626226 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7aafab09-9ede-407d-ae9d-088ed03ace9a tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:34.627003 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7aafab09-9ede-407d-ae9d-088ed03ace9a tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:34.650201 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7aafab09-9ede-407d-ae9d-088ed03ace9a tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:34.650725 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7aafab09-9ede-407d-ae9d-088ed03ace9a tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:34.651337 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7aafab09-9ede-407d-ae9d-088ed03ace9a tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:34.700924 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-346ab48e-c7ee-4d37-bc0c-51e55f942824 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30fe0e1ffa1040ec85d3c32d8b741c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd0e7c24154409824f96e9e99da357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:34.712493 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-346ab48e-c7ee-4d37-bc0c-51e55f942824 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "GET /compute/v2.1/servers/f1b4faf3-0c03-4e0c-be81-be3305b8314f" status: 200 len: 1260 microversion: 2.1 time: 0.159874 Oct 08 21:07:34.713827 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1882/3688] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:07:34 2022] GET /compute/v2.1/servers/f1b4faf3-0c03-4e0c-be81-be3305b8314f => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:07:34.779414 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.objects.instance [None req-7aafab09-9ede-407d-ae9d-088ed03ace9a tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lazy-loading 'services' on Instance uuid ce4a2fbf-76f3-4577-a704-3b64ec30d84b {{(pid=140491) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 21:07:34.874077 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-32c7ac7b-1550-44bb-b5e9-1e1e72c630e6 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:34.874966 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-32c7ac7b-1550-44bb-b5e9-1e1e72c630e6 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: c7e330f4-220e-4dce-b65e-0aedb3206dda] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:07:34.886852 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-32c7ac7b-1550-44bb-b5e9-1e1e72c630e6 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:34.887645 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-32c7ac7b-1550-44bb-b5e9-1e1e72c630e6 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:34.893562 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-32c7ac7b-1550-44bb-b5e9-1e1e72c630e6 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:34.894755 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-32c7ac7b-1550-44bb-b5e9-1e1e72c630e6 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:34.895608 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-32c7ac7b-1550-44bb-b5e9-1e1e72c630e6 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:34.896289 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-32c7ac7b-1550-44bb-b5e9-1e1e72c630e6 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:34.929138 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-7aafab09-9ede-407d-ae9d-088ed03ace9a tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] 10.222.0.26 "DELETE /compute/v2.1/servers/ce4a2fbf-76f3-4577-a704-3b64ec30d84b/os-volume_attachments/2b9d2f56-8742-40d7-8421-fb2664f4d10e" status: 202 len: 0 microversion: 2.1 time: 0.322296 Oct 08 21:07:34.937954 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1807/3689] 10.222.0.26 () {58 vars in 1416 bytes} [Sat Oct 8 21:07:34 2022] DELETE /compute/v2.1/servers/ce4a2fbf-76f3-4577-a704-3b64ec30d84b/os-volume_attachments/2b9d2f56-8742-40d7-8421-fb2664f4d10e => generated 0 bytes in 333 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 21:07:35.149521 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-642c7441-e50f-416a-af74-06310676cc19 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:35.150254 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-642c7441-e50f-416a-af74-06310676cc19 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] [instance: b1983b4c-4fd2-4ec8-9fb0-aa1f7fa51219] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:07:35.159641 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-642c7441-e50f-416a-af74-06310676cc19 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:35.170216 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-642c7441-e50f-416a-af74-06310676cc19 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:35.170783 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-642c7441-e50f-416a-af74-06310676cc19 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:35.171567 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-642c7441-e50f-416a-af74-06310676cc19 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:35.172091 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-642c7441-e50f-416a-af74-06310676cc19 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:35.172480 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-642c7441-e50f-416a-af74-06310676cc19 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:35.629181 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-32c7ac7b-1550-44bb-b5e9-1e1e72c630e6 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06443b5728fb4d1e95d6245820e786bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ded993145b4eda9d6a33b994519012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:35.644480 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-32c7ac7b-1550-44bb-b5e9-1e1e72c630e6 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "GET /compute/v2.1/servers/c7e330f4-220e-4dce-b65e-0aedb3206dda" status: 200 len: 1309 microversion: 2.1 time: 0.774908 Oct 08 21:07:35.656272 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1883/3690] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:07:34 2022] GET /compute/v2.1/servers/c7e330f4-220e-4dce-b65e-0aedb3206dda => generated 1309 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:07:35.669883 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-39ca1c0a-fccc-433a-b47f-93aa29ef98c3 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:35.670519 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-39ca1c0a-fccc-433a-b47f-93aa29ef98c3 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] [instance: dbacaeed-a40b-4e05-9635-5073dfdd8621] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:07:35.688426 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-642c7441-e50f-416a-af74-06310676cc19 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9cd61a0df164a9e9197022508adafbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acc59093f954b61ba9f3cd05e940c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:35.704885 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-642c7441-e50f-416a-af74-06310676cc19 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9cd61a0df164a9e9197022508adafbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acc59093f954b61ba9f3cd05e940c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:35.707205 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-642c7441-e50f-416a-af74-06310676cc19 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9cd61a0df164a9e9197022508adafbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acc59093f954b61ba9f3cd05e940c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:35.712701 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-642c7441-e50f-416a-af74-06310676cc19 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] 10.222.0.26 "GET /compute/v2.1/servers/b1983b4c-4fd2-4ec8-9fb0-aa1f7fa51219" status: 200 len: 1336 microversion: 2.54 time: 0.568272 Oct 08 21:07:35.736165 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-39ca1c0a-fccc-433a-b47f-93aa29ef98c3 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:35.737285 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1808/3691] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:07:35 2022] GET /compute/v2.1/servers/b1983b4c-4fd2-4ec8-9fb0-aa1f7fa51219 => generated 1336 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 08 21:07:35.737543 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-39ca1c0a-fccc-433a-b47f-93aa29ef98c3 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:35.738389 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-39ca1c0a-fccc-433a-b47f-93aa29ef98c3 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:35.739334 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-39ca1c0a-fccc-433a-b47f-93aa29ef98c3 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:35.739984 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-39ca1c0a-fccc-433a-b47f-93aa29ef98c3 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:35.754288 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-39ca1c0a-fccc-433a-b47f-93aa29ef98c3 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:35.769358 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-833aa2f5-f562-4c2e-90e3-43753bdb09ff tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:35.770068 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-833aa2f5-f562-4c2e-90e3-43753bdb09ff tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] [instance: f1b4faf3-0c03-4e0c-be81-be3305b8314f] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:07:35.790886 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-833aa2f5-f562-4c2e-90e3-43753bdb09ff tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:35.799010 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-833aa2f5-f562-4c2e-90e3-43753bdb09ff tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:35.800033 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-833aa2f5-f562-4c2e-90e3-43753bdb09ff tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:35.800825 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-833aa2f5-f562-4c2e-90e3-43753bdb09ff tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:35.801339 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-833aa2f5-f562-4c2e-90e3-43753bdb09ff tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:35.802451 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-833aa2f5-f562-4c2e-90e3-43753bdb09ff tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:36.109216 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-833aa2f5-f562-4c2e-90e3-43753bdb09ff tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30fe0e1ffa1040ec85d3c32d8b741c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd0e7c24154409824f96e9e99da357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:36.131080 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-833aa2f5-f562-4c2e-90e3-43753bdb09ff tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "GET /compute/v2.1/servers/f1b4faf3-0c03-4e0c-be81-be3305b8314f" status: 200 len: 1278 microversion: 2.1 time: 0.392561 Oct 08 21:07:36.154753 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1809/3692] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:07:35 2022] GET /compute/v2.1/servers/f1b4faf3-0c03-4e0c-be81-be3305b8314f => generated 1278 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:07:36.513041 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-39ca1c0a-fccc-433a-b47f-93aa29ef98c3 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:36.536567 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-39ca1c0a-fccc-433a-b47f-93aa29ef98c3 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:36.538397 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-39ca1c0a-fccc-433a-b47f-93aa29ef98c3 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:36.542652 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-39ca1c0a-fccc-433a-b47f-93aa29ef98c3 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] 10.222.0.26 "GET /compute/v2.1/servers/dbacaeed-a40b-4e05-9635-5073dfdd8621" status: 200 len: 1808 microversion: 2.20 time: 0.885128 Oct 08 21:07:36.546477 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1884/3693] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:07:35 2022] GET /compute/v2.1/servers/dbacaeed-a40b-4e05-9635-5073dfdd8621 => generated 1808 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:07:36.681793 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-2554f2d4-ec3e-45a9-b74a-2e6bea703503 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:36.682613 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-2554f2d4-ec3e-45a9-b74a-2e6bea703503 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: c7e330f4-220e-4dce-b65e-0aedb3206dda] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:07:36.704151 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2554f2d4-ec3e-45a9-b74a-2e6bea703503 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:36.704657 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2554f2d4-ec3e-45a9-b74a-2e6bea703503 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:36.705112 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2554f2d4-ec3e-45a9-b74a-2e6bea703503 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:36.713993 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2554f2d4-ec3e-45a9-b74a-2e6bea703503 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:36.719665 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2554f2d4-ec3e-45a9-b74a-2e6bea703503 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:36.720309 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2554f2d4-ec3e-45a9-b74a-2e6bea703503 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:36.745653 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-36690eb0-58e2-412b-8673-ef1f45eb9477 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:36.746853 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-36690eb0-58e2-412b-8673-ef1f45eb9477 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] [instance: b1983b4c-4fd2-4ec8-9fb0-aa1f7fa51219] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:07:36.786432 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-36690eb0-58e2-412b-8673-ef1f45eb9477 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:36.787013 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-36690eb0-58e2-412b-8673-ef1f45eb9477 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:36.791885 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-36690eb0-58e2-412b-8673-ef1f45eb9477 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:36.794242 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-36690eb0-58e2-412b-8673-ef1f45eb9477 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:36.805242 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-36690eb0-58e2-412b-8673-ef1f45eb9477 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:36.806000 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-36690eb0-58e2-412b-8673-ef1f45eb9477 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:37.204067 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-2554f2d4-ec3e-45a9-b74a-2e6bea703503 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06443b5728fb4d1e95d6245820e786bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ded993145b4eda9d6a33b994519012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:37.222581 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-2554f2d4-ec3e-45a9-b74a-2e6bea703503 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "GET /compute/v2.1/servers/c7e330f4-220e-4dce-b65e-0aedb3206dda" status: 200 len: 1309 microversion: 2.1 time: 0.545592 Oct 08 21:07:37.226769 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1810/3694] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:07:36 2022] GET /compute/v2.1/servers/c7e330f4-220e-4dce-b65e-0aedb3206dda => generated 1309 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:07:37.558206 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-36690eb0-58e2-412b-8673-ef1f45eb9477 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9cd61a0df164a9e9197022508adafbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acc59093f954b61ba9f3cd05e940c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:37.574226 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-36690eb0-58e2-412b-8673-ef1f45eb9477 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9cd61a0df164a9e9197022508adafbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acc59093f954b61ba9f3cd05e940c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:37.576323 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-36690eb0-58e2-412b-8673-ef1f45eb9477 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9cd61a0df164a9e9197022508adafbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acc59093f954b61ba9f3cd05e940c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:37.583740 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-36690eb0-58e2-412b-8673-ef1f45eb9477 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] 10.222.0.26 "GET /compute/v2.1/servers/b1983b4c-4fd2-4ec8-9fb0-aa1f7fa51219" status: 200 len: 1336 microversion: 2.54 time: 0.843121 Oct 08 21:07:37.584584 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1885/3695] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:07:36 2022] GET /compute/v2.1/servers/b1983b4c-4fd2-4ec8-9fb0-aa1f7fa51219 => generated 1336 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 08 21:07:37.591728 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-fec8c6d8-693d-42a9-89b9-41c50e7fd152 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1519558606", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "networks": [{"uuid": "82d56471-f1e9-4dc0-935a-29f2f2d2c7c0"}]}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:07:37.596380 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e5fcbcff-b901-4abb-8d55-ed6f3d13639d tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:37.599928 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-e5fcbcff-b901-4abb-8d55-ed6f3d13639d tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] [instance: f1b4faf3-0c03-4e0c-be81-be3305b8314f] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:07:37.611412 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e5fcbcff-b901-4abb-8d55-ed6f3d13639d tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:37.613579 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e5fcbcff-b901-4abb-8d55-ed6f3d13639d tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:37.614651 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e5fcbcff-b901-4abb-8d55-ed6f3d13639d tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:37.616056 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e5fcbcff-b901-4abb-8d55-ed6f3d13639d tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:37.617434 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e5fcbcff-b901-4abb-8d55-ed6f3d13639d tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:37.619187 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e5fcbcff-b901-4abb-8d55-ed6f3d13639d tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:37.672952 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.network.neutron [None req-fec8c6d8-693d-42a9-89b9-41c50e7fd152 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] validate_networks() for [('82d56471-f1e9-4dc0-935a-29f2f2d2c7c0', None, None, None, None, None)] {{(pid=140491) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 21:07:37.798336 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-e5fcbcff-b901-4abb-8d55-ed6f3d13639d tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30fe0e1ffa1040ec85d3c32d8b741c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd0e7c24154409824f96e9e99da357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:37.813507 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-e5fcbcff-b901-4abb-8d55-ed6f3d13639d tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "GET /compute/v2.1/servers/f1b4faf3-0c03-4e0c-be81-be3305b8314f" status: 200 len: 1266 microversion: 2.1 time: 0.226581 Oct 08 21:07:37.814727 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1886/3696] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:07:37 2022] GET /compute/v2.1/servers/f1b4faf3-0c03-4e0c-be81-be3305b8314f => generated 1266 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:07:37.823343 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-99766819-2728-42c6-bbf1-0093765bb4dd tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:07:37.839046 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-99766819-2728-42c6-bbf1-0093765bb4dd tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:37.840536 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-99766819-2728-42c6-bbf1-0093765bb4dd tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:37.841265 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-99766819-2728-42c6-bbf1-0093765bb4dd tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:37.881035 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-99766819-2728-42c6-bbf1-0093765bb4dd tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] [instance: ce4a2fbf-76f3-4577-a704-3b64ec30d84b] Going to try to stop instance {{(pid=140492) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 08 21:07:37.964666 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-99766819-2728-42c6-bbf1-0093765bb4dd tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] 10.222.0.26 "POST /compute/v2.1/servers/ce4a2fbf-76f3-4577-a704-3b64ec30d84b/action" status: 202 len: 0 microversion: 2.1 time: 0.143767 Oct 08 21:07:37.966036 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1887/3697] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:07:37 2022] POST /compute/v2.1/servers/ce4a2fbf-76f3-4577-a704-3b64ec30d84b/action => generated 0 bytes in 151 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 21:07:38.009467 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-6693a190-934e-47da-9def-76377368c3b8 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:38.014868 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-6693a190-934e-47da-9def-76377368c3b8 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] [instance: dbacaeed-a40b-4e05-9635-5073dfdd8621] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:07:38.036490 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6693a190-934e-47da-9def-76377368c3b8 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:38.038260 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6693a190-934e-47da-9def-76377368c3b8 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:38.041790 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6693a190-934e-47da-9def-76377368c3b8 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:38.045713 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6693a190-934e-47da-9def-76377368c3b8 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:38.047343 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6693a190-934e-47da-9def-76377368c3b8 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:38.049160 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6693a190-934e-47da-9def-76377368c3b8 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:38.334099 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-6693a190-934e-47da-9def-76377368c3b8 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:38.352423 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-6693a190-934e-47da-9def-76377368c3b8 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:38.358825 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-6693a190-934e-47da-9def-76377368c3b8 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:38.361178 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-6693a190-934e-47da-9def-76377368c3b8 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] 10.222.0.26 "GET /compute/v2.1/servers/dbacaeed-a40b-4e05-9635-5073dfdd8621" status: 200 len: 1795 microversion: 2.20 time: 0.394031 Oct 08 21:07:38.363433 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1888/3698] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:07:37 2022] GET /compute/v2.1/servers/dbacaeed-a40b-4e05-9635-5073dfdd8621 => generated 1795 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:07:38.404891 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-11ed1187-1309-4cb8-bed0-2be13cb486e0 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:38.410665 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-11ed1187-1309-4cb8-bed0-2be13cb486e0 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] [instance: ce4a2fbf-76f3-4577-a704-3b64ec30d84b] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:07:38.427369 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-11ed1187-1309-4cb8-bed0-2be13cb486e0 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:38.429375 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-11ed1187-1309-4cb8-bed0-2be13cb486e0 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:38.430087 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-11ed1187-1309-4cb8-bed0-2be13cb486e0 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:38.431106 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-11ed1187-1309-4cb8-bed0-2be13cb486e0 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:38.433425 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-11ed1187-1309-4cb8-bed0-2be13cb486e0 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:38.436155 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-11ed1187-1309-4cb8-bed0-2be13cb486e0 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:38.558271 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-fec8c6d8-693d-42a9-89b9-41c50e7fd152 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Flavor limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 21:07:38.559958 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-fec8c6d8-693d-42a9-89b9-41c50e7fd152 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Image limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 21:07:38.560559 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-fec8c6d8-693d-42a9-89b9-41c50e7fd152 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Flavor pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 21:07:38.561090 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-fec8c6d8-693d-42a9-89b9-41c50e7fd152 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Image pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 21:07:38.561848 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-fec8c6d8-693d-42a9-89b9-41c50e7fd152 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 21:07:38.589496 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fec8c6d8-693d-42a9-89b9-41c50e7fd152 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:38.591489 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fec8c6d8-693d-42a9-89b9-41c50e7fd152 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:38.592070 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fec8c6d8-693d-42a9-89b9-41c50e7fd152 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:38.607552 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fec8c6d8-693d-42a9-89b9-41c50e7fd152 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:38.613037 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fec8c6d8-693d-42a9-89b9-41c50e7fd152 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:38.618482 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fec8c6d8-693d-42a9-89b9-41c50e7fd152 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:38.700319 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-fec8c6d8-693d-42a9-89b9-41c50e7fd152 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Getting quotas for project 765c62cac2ee4406b23a5baa85c52ff7. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:07:38.723508 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-fec8c6d8-693d-42a9-89b9-41c50e7fd152 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Getting quotas for user d78e9afd772c4de981cac8f5817ec356 and project 765c62cac2ee4406b23a5baa85c52ff7. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:07:38.763982 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-fec8c6d8-693d-42a9-89b9-41c50e7fd152 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Going to run 1 instances... {{(pid=140491) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 21:07:38.772570 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-fec8c6d8-693d-42a9-89b9-41c50e7fd152 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: 318ee24a-a78a-4b3b-b18b-64f5c5c3109a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c508bd7f-7db9-4b2c-af7c-be54a855c355',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140491) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 21:07:38.900818 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-fec8c6d8-693d-42a9-89b9-41c50e7fd152 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.672868 Oct 08 21:07:38.906813 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1811/3699] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 21:07:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1679 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 08 21:07:38.917517 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-04997d5a-231a-43a4-9346-e3182553960a tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:38.924793 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-04997d5a-231a-43a4-9346-e3182553960a tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: c7e330f4-220e-4dce-b65e-0aedb3206dda] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:07:38.936526 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-04997d5a-231a-43a4-9346-e3182553960a tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:38.944052 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-04997d5a-231a-43a4-9346-e3182553960a tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:38.947235 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-04997d5a-231a-43a4-9346-e3182553960a tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:38.948325 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-04997d5a-231a-43a4-9346-e3182553960a tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:38.952690 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-04997d5a-231a-43a4-9346-e3182553960a tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:38.955455 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-04997d5a-231a-43a4-9346-e3182553960a tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:38.989849 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-11ed1187-1309-4cb8-bed0-2be13cb486e0 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85abb492492343c58734564a2b26c8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68b14967e8249fd886f168d366f241f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:39.007589 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-11ed1187-1309-4cb8-bed0-2be13cb486e0 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] 10.222.0.26 "GET /compute/v2.1/servers/ce4a2fbf-76f3-4577-a704-3b64ec30d84b" status: 200 len: 1678 microversion: 2.1 time: 0.621992 Oct 08 21:07:39.008162 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1889/3700] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:07:38 2022] GET /compute/v2.1/servers/ce4a2fbf-76f3-4577-a704-3b64ec30d84b => generated 1678 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:07:39.013501 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-aa92bdb2-1f58-49fb-928a-d0a183a76b0d tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:39.014130 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-aa92bdb2-1f58-49fb-928a-d0a183a76b0d tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] [instance: b1983b4c-4fd2-4ec8-9fb0-aa1f7fa51219] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:07:39.031361 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-aa92bdb2-1f58-49fb-928a-d0a183a76b0d tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:39.031886 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-aa92bdb2-1f58-49fb-928a-d0a183a76b0d tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:39.032349 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-aa92bdb2-1f58-49fb-928a-d0a183a76b0d tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:39.033078 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-aa92bdb2-1f58-49fb-928a-d0a183a76b0d tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:39.036857 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-aa92bdb2-1f58-49fb-928a-d0a183a76b0d tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:39.039405 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-aa92bdb2-1f58-49fb-928a-d0a183a76b0d tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:39.186111 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-aa92bdb2-1f58-49fb-928a-d0a183a76b0d tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9cd61a0df164a9e9197022508adafbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acc59093f954b61ba9f3cd05e940c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:39.203866 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-aa92bdb2-1f58-49fb-928a-d0a183a76b0d tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9cd61a0df164a9e9197022508adafbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acc59093f954b61ba9f3cd05e940c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:39.205376 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-aa92bdb2-1f58-49fb-928a-d0a183a76b0d tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9cd61a0df164a9e9197022508adafbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acc59093f954b61ba9f3cd05e940c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:39.206574 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-aa92bdb2-1f58-49fb-928a-d0a183a76b0d tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] 10.222.0.26 "GET /compute/v2.1/servers/b1983b4c-4fd2-4ec8-9fb0-aa1f7fa51219" status: 200 len: 1357 microversion: 2.54 time: 0.197467 Oct 08 21:07:39.235634 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1890/3701] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:07:39 2022] GET /compute/v2.1/servers/b1983b4c-4fd2-4ec8-9fb0-aa1f7fa51219 => generated 1357 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:07:39.251207 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-c8c52c4b-29aa-41ef-8a95-90a65c88b15f tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:39.251758 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-c8c52c4b-29aa-41ef-8a95-90a65c88b15f tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] [instance: f1b4faf3-0c03-4e0c-be81-be3305b8314f] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:07:39.258750 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c8c52c4b-29aa-41ef-8a95-90a65c88b15f tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:39.259264 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c8c52c4b-29aa-41ef-8a95-90a65c88b15f tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:39.259719 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c8c52c4b-29aa-41ef-8a95-90a65c88b15f tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:39.261642 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c8c52c4b-29aa-41ef-8a95-90a65c88b15f tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:39.262650 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c8c52c4b-29aa-41ef-8a95-90a65c88b15f tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:39.273206 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c8c52c4b-29aa-41ef-8a95-90a65c88b15f tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:39.522178 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-04997d5a-231a-43a4-9346-e3182553960a tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06443b5728fb4d1e95d6245820e786bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ded993145b4eda9d6a33b994519012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:39.542337 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-04997d5a-231a-43a4-9346-e3182553960a tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "GET /compute/v2.1/servers/c7e330f4-220e-4dce-b65e-0aedb3206dda" status: 200 len: 1309 microversion: 2.1 time: 0.628257 Oct 08 21:07:39.542877 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1812/3702] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:07:38 2022] GET /compute/v2.1/servers/c7e330f4-220e-4dce-b65e-0aedb3206dda => generated 1309 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:07:39.552572 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-5e78b972-ad77-4c7f-b9d5-2751371b038d tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:39.555123 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-5e78b972-ad77-4c7f-b9d5-2751371b038d tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: 318ee24a-a78a-4b3b-b18b-64f5c5c3109a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:07:39.664732 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-5e78b972-ad77-4c7f-b9d5-2751371b038d tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78e9afd772c4de981cac8f5817ec356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765c62cac2ee4406b23a5baa85c52ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:39.679467 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-c8c52c4b-29aa-41ef-8a95-90a65c88b15f tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30fe0e1ffa1040ec85d3c32d8b741c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd0e7c24154409824f96e9e99da357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:39.679791 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-5e78b972-ad77-4c7f-b9d5-2751371b038d tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/318ee24a-a78a-4b3b-b18b-64f5c5c3109a" status: 200 len: 1215 microversion: 2.1 time: 0.134866 Oct 08 21:07:39.681167 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1813/3703] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:07:39 2022] GET /compute/v2.1/servers/318ee24a-a78a-4b3b-b18b-64f5c5c3109a => generated 1215 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:07:39.687765 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-dca441c1-7bc2-4bcd-b1e5-0dc558bc6a88 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Action: 'create', calling method: .version_select at 0x7f1a8d4b1550>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-2076284214", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAqJTneWp0OHwMAq6Rup4+RhvmDQlbhNY3cspJ2UyHnqlEkLem5YBwgxgVjAbMpxoWV9Aat/zV18jRX4lllrMLzGoIpPbDGtpNsnGM6HoQTTHM3cXAiGITtHA0Z2jM4QAw=="}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:07:39.691172 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-c8c52c4b-29aa-41ef-8a95-90a65c88b15f tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "GET /compute/v2.1/servers/f1b4faf3-0c03-4e0c-be81-be3305b8314f" status: 200 len: 1308 microversion: 2.1 time: 0.453653 Oct 08 21:07:39.705763 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1891/3704] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:07:39 2022] GET /compute/v2.1/servers/f1b4faf3-0c03-4e0c-be81-be3305b8314f => generated 1308 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:07:39.708786 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-dca441c1-7bc2-4bcd-b1e5-0dc558bc6a88 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Getting quotas for project 4acc59093f954b61ba9f3cd05e940c28. Resources: {'key_pairs'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:07:39.714512 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-dca441c1-7bc2-4bcd-b1e5-0dc558bc6a88 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Getting quotas for user b9cd61a0df164a9e9197022508adafbf and project 4acc59093f954b61ba9f3cd05e940c28. Resources: {'key_pairs'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:07:39.754641 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-dca441c1-7bc2-4bcd-b1e5-0dc558bc6a88 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.54 time: 0.071923 Oct 08 21:07:39.755307 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1814/3705] 10.222.0.26 () {62 vars in 1200 bytes} [Sat Oct 8 21:07:39 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 73 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 08 21:07:39.768395 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-aa053ad7-b7d3-4b6a-8c0f-cbc03cd7bcdc tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-2076284214", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:07:39.771747 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-aa053ad7-b7d3-4b6a-8c0f-cbc03cd7bcdc tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] [instance: b1983b4c-4fd2-4ec8-9fb0-aa1f7fa51219] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:07:39.796427 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-aa053ad7-b7d3-4b6a-8c0f-cbc03cd7bcdc tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:39.796951 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-aa053ad7-b7d3-4b6a-8c0f-cbc03cd7bcdc tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:39.797462 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-aa053ad7-b7d3-4b6a-8c0f-cbc03cd7bcdc tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:39.798201 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-aa053ad7-b7d3-4b6a-8c0f-cbc03cd7bcdc tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:39.801275 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-aa053ad7-b7d3-4b6a-8c0f-cbc03cd7bcdc tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:39.805996 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-aa053ad7-b7d3-4b6a-8c0f-cbc03cd7bcdc tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:39.954673 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-aa053ad7-b7d3-4b6a-8c0f-cbc03cd7bcdc tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Flavor limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 21:07:39.956094 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-aa053ad7-b7d3-4b6a-8c0f-cbc03cd7bcdc tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Image limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 21:07:39.958320 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-aa053ad7-b7d3-4b6a-8c0f-cbc03cd7bcdc tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Flavor pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 21:07:39.958862 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-aa053ad7-b7d3-4b6a-8c0f-cbc03cd7bcdc tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Image pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 21:07:39.960063 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-aa053ad7-b7d3-4b6a-8c0f-cbc03cd7bcdc tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 21:07:40.036685 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-ef7afe26-868a-4f4e-a3cb-8af0a9f29782 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:40.037638 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-ef7afe26-868a-4f4e-a3cb-8af0a9f29782 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] [instance: ce4a2fbf-76f3-4577-a704-3b64ec30d84b] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:07:40.069217 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ef7afe26-868a-4f4e-a3cb-8af0a9f29782 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:40.069813 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ef7afe26-868a-4f4e-a3cb-8af0a9f29782 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:40.071257 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ef7afe26-868a-4f4e-a3cb-8af0a9f29782 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:40.072698 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ef7afe26-868a-4f4e-a3cb-8af0a9f29782 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:40.074790 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ef7afe26-868a-4f4e-a3cb-8af0a9f29782 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:40.076149 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ef7afe26-868a-4f4e-a3cb-8af0a9f29782 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:40.173782 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-aa053ad7-b7d3-4b6a-8c0f-cbc03cd7bcdc tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] [instance: b1983b4c-4fd2-4ec8-9fb0-aa1f7fa51219] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:07:40.207043 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-aa053ad7-b7d3-4b6a-8c0f-cbc03cd7bcdc tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:40.207558 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-aa053ad7-b7d3-4b6a-8c0f-cbc03cd7bcdc tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:40.208048 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-aa053ad7-b7d3-4b6a-8c0f-cbc03cd7bcdc tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:40.217154 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-aa053ad7-b7d3-4b6a-8c0f-cbc03cd7bcdc tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:40.219300 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-aa053ad7-b7d3-4b6a-8c0f-cbc03cd7bcdc tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:40.219721 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-aa053ad7-b7d3-4b6a-8c0f-cbc03cd7bcdc tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:40.337808 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-aa053ad7-b7d3-4b6a-8c0f-cbc03cd7bcdc tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] 10.222.0.26 "POST /compute/v2.1/servers/b1983b4c-4fd2-4ec8-9fb0-aa1f7fa51219/action" status: 202 len: 1140 microversion: 2.54 time: 0.571466 Oct 08 21:07:40.341437 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1892/3706] 10.222.0.26 () {62 vars in 1320 bytes} [Sat Oct 8 21:07:39 2022] POST /compute/v2.1/servers/b1983b4c-4fd2-4ec8-9fb0-aa1f7fa51219/action => generated 1140 bytes in 579 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 08 21:07:40.364495 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-243fb411-e55a-44d3-af2b-80a41fdfe785 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:40.365833 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-243fb411-e55a-44d3-af2b-80a41fdfe785 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] [instance: b1983b4c-4fd2-4ec8-9fb0-aa1f7fa51219] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:07:40.382310 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-243fb411-e55a-44d3-af2b-80a41fdfe785 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:40.383782 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-243fb411-e55a-44d3-af2b-80a41fdfe785 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:40.386243 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-243fb411-e55a-44d3-af2b-80a41fdfe785 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:40.389879 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-243fb411-e55a-44d3-af2b-80a41fdfe785 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:40.391858 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-243fb411-e55a-44d3-af2b-80a41fdfe785 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:40.393870 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-243fb411-e55a-44d3-af2b-80a41fdfe785 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:40.401933 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-ef7afe26-868a-4f4e-a3cb-8af0a9f29782 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85abb492492343c58734564a2b26c8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68b14967e8249fd886f168d366f241f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:40.415439 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-ef7afe26-868a-4f4e-a3cb-8af0a9f29782 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] 10.222.0.26 "GET /compute/v2.1/servers/ce4a2fbf-76f3-4577-a704-3b64ec30d84b" status: 200 len: 1678 microversion: 2.1 time: 0.383267 Oct 08 21:07:40.432208 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1815/3707] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:07:40 2022] GET /compute/v2.1/servers/ce4a2fbf-76f3-4577-a704-3b64ec30d84b => generated 1678 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:07:40.518154 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-48871522-5453-4b54-9e2c-0fe2e16449b3 req-47bee565-260e-4239-9219-ed549dc2d939 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1b4faf3-0c03-4e0c-be81-be3305b8314f", "tag": "37642f8c-8e21-43fe-865f-09cc1bd6c431"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:07:40.538920 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-48871522-5453-4b54-9e2c-0fe2e16449b3 req-47bee565-260e-4239-9219-ed549dc2d939 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:40.539731 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-48871522-5453-4b54-9e2c-0fe2e16449b3 req-47bee565-260e-4239-9219-ed549dc2d939 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:40.545545 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-48871522-5453-4b54-9e2c-0fe2e16449b3 req-47bee565-260e-4239-9219-ed549dc2d939 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:40.562933 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-48871522-5453-4b54-9e2c-0fe2e16449b3 req-47bee565-260e-4239-9219-ed549dc2d939 service nova] Creating event network-changed:37642f8c-8e21-43fe-865f-09cc1bd6c431 for instance f1b4faf3-0c03-4e0c-be81-be3305b8314f on nch2-master-1 Oct 08 21:07:40.572806 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-48871522-5453-4b54-9e2c-0fe2e16449b3 req-47bee565-260e-4239-9219-ed549dc2d939 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057951 Oct 08 21:07:40.573623 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1816/3708] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:07:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:07:40.584475 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-12531f69-431a-41a3-85d2-934d56a39292 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:40.589424 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-12531f69-431a-41a3-85d2-934d56a39292 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: c7e330f4-220e-4dce-b65e-0aedb3206dda] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:07:40.595269 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-243fb411-e55a-44d3-af2b-80a41fdfe785 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9cd61a0df164a9e9197022508adafbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acc59093f954b61ba9f3cd05e940c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:40.599347 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-12531f69-431a-41a3-85d2-934d56a39292 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:40.602292 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-12531f69-431a-41a3-85d2-934d56a39292 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:40.603037 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-12531f69-431a-41a3-85d2-934d56a39292 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:40.604008 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-12531f69-431a-41a3-85d2-934d56a39292 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:40.606354 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-12531f69-431a-41a3-85d2-934d56a39292 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:40.607073 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-12531f69-431a-41a3-85d2-934d56a39292 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:40.616063 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-243fb411-e55a-44d3-af2b-80a41fdfe785 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9cd61a0df164a9e9197022508adafbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acc59093f954b61ba9f3cd05e940c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:40.619101 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-243fb411-e55a-44d3-af2b-80a41fdfe785 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9cd61a0df164a9e9197022508adafbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acc59093f954b61ba9f3cd05e940c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:40.622695 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-243fb411-e55a-44d3-af2b-80a41fdfe785 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] 10.222.0.26 "GET /compute/v2.1/servers/b1983b4c-4fd2-4ec8-9fb0-aa1f7fa51219" status: 200 len: 1409 microversion: 2.54 time: 0.263763 Oct 08 21:07:40.639529 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1893/3709] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:07:40 2022] GET /compute/v2.1/servers/b1983b4c-4fd2-4ec8-9fb0-aa1f7fa51219 => generated 1409 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:07:40.708808 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-04081c53-8efd-46bf-8213-9d84a8a75f55 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:40.709781 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-04081c53-8efd-46bf-8213-9d84a8a75f55 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: 318ee24a-a78a-4b3b-b18b-64f5c5c3109a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:07:40.728617 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-04081c53-8efd-46bf-8213-9d84a8a75f55 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:40.729270 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-04081c53-8efd-46bf-8213-9d84a8a75f55 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:40.734288 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-04081c53-8efd-46bf-8213-9d84a8a75f55 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:40.735226 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-04081c53-8efd-46bf-8213-9d84a8a75f55 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:40.735734 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-04081c53-8efd-46bf-8213-9d84a8a75f55 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:40.736195 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-04081c53-8efd-46bf-8213-9d84a8a75f55 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:40.901909 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-12531f69-431a-41a3-85d2-934d56a39292 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06443b5728fb4d1e95d6245820e786bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ded993145b4eda9d6a33b994519012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:40.941845 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-12531f69-431a-41a3-85d2-934d56a39292 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "GET /compute/v2.1/servers/c7e330f4-220e-4dce-b65e-0aedb3206dda" status: 200 len: 1309 microversion: 2.1 time: 0.361544 Oct 08 21:07:40.953999 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1817/3710] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:07:40 2022] GET /compute/v2.1/servers/c7e330f4-220e-4dce-b65e-0aedb3206dda => generated 1309 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:07:40.972445 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-b0dd4783-2015-4669-8749-b74107e6653f tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:40.973534 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-b0dd4783-2015-4669-8749-b74107e6653f tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] [instance: f1b4faf3-0c03-4e0c-be81-be3305b8314f] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:07:40.983762 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b0dd4783-2015-4669-8749-b74107e6653f tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:40.984815 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b0dd4783-2015-4669-8749-b74107e6653f tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:40.985629 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b0dd4783-2015-4669-8749-b74107e6653f tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:40.987101 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b0dd4783-2015-4669-8749-b74107e6653f tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:40.987972 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b0dd4783-2015-4669-8749-b74107e6653f tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:40.988930 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b0dd4783-2015-4669-8749-b74107e6653f tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:41.093981 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-04081c53-8efd-46bf-8213-9d84a8a75f55 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78e9afd772c4de981cac8f5817ec356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765c62cac2ee4406b23a5baa85c52ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:41.110096 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-04081c53-8efd-46bf-8213-9d84a8a75f55 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/318ee24a-a78a-4b3b-b18b-64f5c5c3109a" status: 200 len: 1267 microversion: 2.1 time: 0.405879 Oct 08 21:07:41.110742 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1894/3711] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:07:40 2022] GET /compute/v2.1/servers/318ee24a-a78a-4b3b-b18b-64f5c5c3109a => generated 1267 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:07:41.453506 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-1c5f2e7f-936d-4cbd-bd6f-7438b314928c tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:41.454402 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-1c5f2e7f-936d-4cbd-bd6f-7438b314928c tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] [instance: ce4a2fbf-76f3-4577-a704-3b64ec30d84b] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:07:41.468246 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1c5f2e7f-936d-4cbd-bd6f-7438b314928c tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:41.470442 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1c5f2e7f-936d-4cbd-bd6f-7438b314928c tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:41.471219 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1c5f2e7f-936d-4cbd-bd6f-7438b314928c tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:41.474114 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1c5f2e7f-936d-4cbd-bd6f-7438b314928c tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:41.475100 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1c5f2e7f-936d-4cbd-bd6f-7438b314928c tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:41.476693 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1c5f2e7f-936d-4cbd-bd6f-7438b314928c tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:41.600070 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-b0dd4783-2015-4669-8749-b74107e6653f tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30fe0e1ffa1040ec85d3c32d8b741c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd0e7c24154409824f96e9e99da357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:41.611012 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-b0dd4783-2015-4669-8749-b74107e6653f tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "GET /compute/v2.1/servers/f1b4faf3-0c03-4e0c-be81-be3305b8314f" status: 200 len: 1308 microversion: 2.1 time: 0.654809 Oct 08 21:07:41.624101 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1818/3712] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:07:40 2022] GET /compute/v2.1/servers/f1b4faf3-0c03-4e0c-be81-be3305b8314f => generated 1308 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:07:41.652065 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-ac3a61be-ef34-487f-8b22-5172e16b6dfb tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:41.653375 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-ac3a61be-ef34-487f-8b22-5172e16b6dfb tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] [instance: b1983b4c-4fd2-4ec8-9fb0-aa1f7fa51219] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:07:41.662801 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ac3a61be-ef34-487f-8b22-5172e16b6dfb tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:41.664027 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ac3a61be-ef34-487f-8b22-5172e16b6dfb tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:41.664684 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ac3a61be-ef34-487f-8b22-5172e16b6dfb tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:41.665622 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ac3a61be-ef34-487f-8b22-5172e16b6dfb tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:41.666259 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ac3a61be-ef34-487f-8b22-5172e16b6dfb tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:41.670478 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ac3a61be-ef34-487f-8b22-5172e16b6dfb tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:41.705718 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:07:41.751695 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-1c5f2e7f-936d-4cbd-bd6f-7438b314928c tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85abb492492343c58734564a2b26c8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68b14967e8249fd886f168d366f241f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:41.763857 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:07:41.767109 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-1c5f2e7f-936d-4cbd-bd6f-7438b314928c tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] 10.222.0.26 "GET /compute/v2.1/servers/ce4a2fbf-76f3-4577-a704-3b64ec30d84b" status: 200 len: 1678 microversion: 2.1 time: 0.325120 Oct 08 21:07:41.767921 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1895/3713] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:07:41 2022] GET /compute/v2.1/servers/ce4a2fbf-76f3-4577-a704-3b64ec30d84b => generated 1678 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:07:41.801327 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-ac3a61be-ef34-487f-8b22-5172e16b6dfb tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9cd61a0df164a9e9197022508adafbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acc59093f954b61ba9f3cd05e940c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:41.813103 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-ac3a61be-ef34-487f-8b22-5172e16b6dfb tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9cd61a0df164a9e9197022508adafbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acc59093f954b61ba9f3cd05e940c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:41.816930 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-ac3a61be-ef34-487f-8b22-5172e16b6dfb tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9cd61a0df164a9e9197022508adafbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acc59093f954b61ba9f3cd05e940c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:41.818212 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-ac3a61be-ef34-487f-8b22-5172e16b6dfb tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] 10.222.0.26 "GET /compute/v2.1/servers/b1983b4c-4fd2-4ec8-9fb0-aa1f7fa51219" status: 200 len: 1409 microversion: 2.54 time: 0.170164 Oct 08 21:07:41.818862 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1819/3714] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:07:41 2022] GET /compute/v2.1/servers/b1983b4c-4fd2-4ec8-9fb0-aa1f7fa51219 => generated 1409 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 08 21:07:41.979853 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e525224e-1417-42f5-93dc-31892b4b53e3 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:41.981905 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-e525224e-1417-42f5-93dc-31892b4b53e3 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: c7e330f4-220e-4dce-b65e-0aedb3206dda] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:07:41.997337 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e525224e-1417-42f5-93dc-31892b4b53e3 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:41.998202 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e525224e-1417-42f5-93dc-31892b4b53e3 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:41.999935 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e525224e-1417-42f5-93dc-31892b4b53e3 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:42.001096 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e525224e-1417-42f5-93dc-31892b4b53e3 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:42.002035 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e525224e-1417-42f5-93dc-31892b4b53e3 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:42.003463 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e525224e-1417-42f5-93dc-31892b4b53e3 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:42.151378 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c375c50d-5ce8-435e-8a15-80107fecf4ea tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:42.155589 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-c375c50d-5ce8-435e-8a15-80107fecf4ea tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: 318ee24a-a78a-4b3b-b18b-64f5c5c3109a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:07:42.172161 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c375c50d-5ce8-435e-8a15-80107fecf4ea tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:42.173067 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c375c50d-5ce8-435e-8a15-80107fecf4ea tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:42.173580 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c375c50d-5ce8-435e-8a15-80107fecf4ea tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:42.174510 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c375c50d-5ce8-435e-8a15-80107fecf4ea tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:42.174980 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c375c50d-5ce8-435e-8a15-80107fecf4ea tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:42.176353 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c375c50d-5ce8-435e-8a15-80107fecf4ea tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:42.228096 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-e525224e-1417-42f5-93dc-31892b4b53e3 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06443b5728fb4d1e95d6245820e786bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ded993145b4eda9d6a33b994519012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:42.240280 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-e525224e-1417-42f5-93dc-31892b4b53e3 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "GET /compute/v2.1/servers/c7e330f4-220e-4dce-b65e-0aedb3206dda" status: 200 len: 1309 microversion: 2.1 time: 0.269299 Oct 08 21:07:42.263677 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1896/3715] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:07:41 2022] GET /compute/v2.1/servers/c7e330f4-220e-4dce-b65e-0aedb3206dda => generated 1309 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:07:42.520974 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-c375c50d-5ce8-435e-8a15-80107fecf4ea tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78e9afd772c4de981cac8f5817ec356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765c62cac2ee4406b23a5baa85c52ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:42.534174 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-c375c50d-5ce8-435e-8a15-80107fecf4ea tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/318ee24a-a78a-4b3b-b18b-64f5c5c3109a" status: 200 len: 1315 microversion: 2.1 time: 0.402637 Oct 08 21:07:42.549785 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1820/3716] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:07:42 2022] GET /compute/v2.1/servers/318ee24a-a78a-4b3b-b18b-64f5c5c3109a => generated 1315 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:07:42.647548 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-4426db5a-3330-4ad0-9c4d-0321a40ff386 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:42.648787 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-4426db5a-3330-4ad0-9c4d-0321a40ff386 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] [instance: f1b4faf3-0c03-4e0c-be81-be3305b8314f] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:07:42.651520 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=4 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:07:42.670033 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4426db5a-3330-4ad0-9c4d-0321a40ff386 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:42.670801 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4426db5a-3330-4ad0-9c4d-0321a40ff386 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:42.673068 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4426db5a-3330-4ad0-9c4d-0321a40ff386 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:42.674104 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4426db5a-3330-4ad0-9c4d-0321a40ff386 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:42.675135 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4426db5a-3330-4ad0-9c4d-0321a40ff386 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:42.675783 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4426db5a-3330-4ad0-9c4d-0321a40ff386 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:42.793852 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-a1b7abeb-6d78-4a68-a3c3-b4ac02637ccc tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:42.794935 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-a1b7abeb-6d78-4a68-a3c3-b4ac02637ccc tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] [instance: ce4a2fbf-76f3-4577-a704-3b64ec30d84b] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:07:42.800194 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=1,nova_api:INSERT=7 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:07:42.805020 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a1b7abeb-6d78-4a68-a3c3-b4ac02637ccc tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:42.805863 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a1b7abeb-6d78-4a68-a3c3-b4ac02637ccc tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:42.806510 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a1b7abeb-6d78-4a68-a3c3-b4ac02637ccc tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:42.807492 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a1b7abeb-6d78-4a68-a3c3-b4ac02637ccc tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:42.808142 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a1b7abeb-6d78-4a68-a3c3-b4ac02637ccc tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:42.808960 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a1b7abeb-6d78-4a68-a3c3-b4ac02637ccc tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:43.128350 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-4426db5a-3330-4ad0-9c4d-0321a40ff386 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30fe0e1ffa1040ec85d3c32d8b741c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd0e7c24154409824f96e9e99da357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:43.139808 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-4426db5a-3330-4ad0-9c4d-0321a40ff386 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "GET /compute/v2.1/servers/f1b4faf3-0c03-4e0c-be81-be3305b8314f" status: 200 len: 1308 microversion: 2.1 time: 0.496810 Oct 08 21:07:43.141503 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1897/3717] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:07:42 2022] GET /compute/v2.1/servers/f1b4faf3-0c03-4e0c-be81-be3305b8314f => generated 1308 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:07:43.147293 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-0e970466-5f7f-4bd9-a3cd-eab802f119a2 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:43.148433 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-0e970466-5f7f-4bd9-a3cd-eab802f119a2 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] [instance: b1983b4c-4fd2-4ec8-9fb0-aa1f7fa51219] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:07:43.164264 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0e970466-5f7f-4bd9-a3cd-eab802f119a2 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:43.166400 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0e970466-5f7f-4bd9-a3cd-eab802f119a2 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:43.167734 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0e970466-5f7f-4bd9-a3cd-eab802f119a2 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:43.168960 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0e970466-5f7f-4bd9-a3cd-eab802f119a2 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:43.169721 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0e970466-5f7f-4bd9-a3cd-eab802f119a2 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:43.171121 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0e970466-5f7f-4bd9-a3cd-eab802f119a2 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:43.341547 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-a1b7abeb-6d78-4a68-a3c3-b4ac02637ccc tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85abb492492343c58734564a2b26c8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68b14967e8249fd886f168d366f241f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:43.358313 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-a1b7abeb-6d78-4a68-a3c3-b4ac02637ccc tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] 10.222.0.26 "GET /compute/v2.1/servers/ce4a2fbf-76f3-4577-a704-3b64ec30d84b" status: 200 len: 1678 microversion: 2.1 time: 0.569097 Oct 08 21:07:43.359513 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-0e970466-5f7f-4bd9-a3cd-eab802f119a2 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9cd61a0df164a9e9197022508adafbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acc59093f954b61ba9f3cd05e940c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:43.363264 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1821/3718] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:07:42 2022] GET /compute/v2.1/servers/ce4a2fbf-76f3-4577-a704-3b64ec30d84b => generated 1678 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:07:43.369569 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-f949b268-367a-4c70-9c6e-2bdedb69bb33 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:43.370204 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-f949b268-367a-4c70-9c6e-2bdedb69bb33 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: c7e330f4-220e-4dce-b65e-0aedb3206dda] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:07:43.378260 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f949b268-367a-4c70-9c6e-2bdedb69bb33 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:43.379277 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f949b268-367a-4c70-9c6e-2bdedb69bb33 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:43.380111 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f949b268-367a-4c70-9c6e-2bdedb69bb33 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:43.381869 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f949b268-367a-4c70-9c6e-2bdedb69bb33 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:43.382605 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f949b268-367a-4c70-9c6e-2bdedb69bb33 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:43.383448 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f949b268-367a-4c70-9c6e-2bdedb69bb33 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:43.384860 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-0e970466-5f7f-4bd9-a3cd-eab802f119a2 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9cd61a0df164a9e9197022508adafbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acc59093f954b61ba9f3cd05e940c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:43.386537 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-0e970466-5f7f-4bd9-a3cd-eab802f119a2 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9cd61a0df164a9e9197022508adafbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acc59093f954b61ba9f3cd05e940c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:43.388399 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-0e970466-5f7f-4bd9-a3cd-eab802f119a2 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] 10.222.0.26 "GET /compute/v2.1/servers/b1983b4c-4fd2-4ec8-9fb0-aa1f7fa51219" status: 200 len: 1409 microversion: 2.54 time: 0.245325 Oct 08 21:07:43.388978 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1898/3719] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:07:43 2022] GET /compute/v2.1/servers/b1983b4c-4fd2-4ec8-9fb0-aa1f7fa51219 => generated 1409 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:07:43.412387 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-21ad362d-28f7-4019-b711-a334fb87ae6c req-80946bc6-0ec5-4bd3-a84a-840f93062d54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7e330f4-220e-4dce-b65e-0aedb3206dda", "name": "network-vif-plugged", "status": "completed", "tag": "7ff15e3c-6e54-4f77-99ea-ec095e513133"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:07:43.432634 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-21ad362d-28f7-4019-b711-a334fb87ae6c req-80946bc6-0ec5-4bd3-a84a-840f93062d54 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:43.433985 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-21ad362d-28f7-4019-b711-a334fb87ae6c req-80946bc6-0ec5-4bd3-a84a-840f93062d54 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:43.444403 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-21ad362d-28f7-4019-b711-a334fb87ae6c req-80946bc6-0ec5-4bd3-a84a-840f93062d54 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:43.463443 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-21ad362d-28f7-4019-b711-a334fb87ae6c req-80946bc6-0ec5-4bd3-a84a-840f93062d54 service nova] Creating event network-vif-plugged:7ff15e3c-6e54-4f77-99ea-ec095e513133 for instance c7e330f4-220e-4dce-b65e-0aedb3206dda on nch2-master-1 Oct 08 21:07:43.469817 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-21ad362d-28f7-4019-b711-a334fb87ae6c req-80946bc6-0ec5-4bd3-a84a-840f93062d54 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061282 Oct 08 21:07:43.471750 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1899/3720] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:07:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 08 21:07:43.560367 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=18 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:07:43.564538 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-9528b164-ec0e-43e5-84e3-f3b5128d3d79 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:43.565338 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-9528b164-ec0e-43e5-84e3-f3b5128d3d79 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: 318ee24a-a78a-4b3b-b18b-64f5c5c3109a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:07:43.572819 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9528b164-ec0e-43e5-84e3-f3b5128d3d79 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:43.573667 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9528b164-ec0e-43e5-84e3-f3b5128d3d79 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:43.574913 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9528b164-ec0e-43e5-84e3-f3b5128d3d79 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:43.575848 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9528b164-ec0e-43e5-84e3-f3b5128d3d79 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:43.576522 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9528b164-ec0e-43e5-84e3-f3b5128d3d79 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:43.577178 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9528b164-ec0e-43e5-84e3-f3b5128d3d79 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:43.685680 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-f949b268-367a-4c70-9c6e-2bdedb69bb33 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06443b5728fb4d1e95d6245820e786bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ded993145b4eda9d6a33b994519012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:43.697255 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-f949b268-367a-4c70-9c6e-2bdedb69bb33 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "GET /compute/v2.1/servers/c7e330f4-220e-4dce-b65e-0aedb3206dda" status: 200 len: 1309 microversion: 2.1 time: 0.331538 Oct 08 21:07:43.697951 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1822/3721] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:07:43 2022] GET /compute/v2.1/servers/c7e330f4-220e-4dce-b65e-0aedb3206dda => generated 1309 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:07:43.968249 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-9528b164-ec0e-43e5-84e3-f3b5128d3d79 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78e9afd772c4de981cac8f5817ec356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765c62cac2ee4406b23a5baa85c52ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:43.982603 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-9528b164-ec0e-43e5-84e3-f3b5128d3d79 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/318ee24a-a78a-4b3b-b18b-64f5c5c3109a" status: 200 len: 1315 microversion: 2.1 time: 0.423285 Oct 08 21:07:43.983247 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1900/3722] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:07:43 2022] GET /compute/v2.1/servers/318ee24a-a78a-4b3b-b18b-64f5c5c3109a => generated 1315 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:07:44.166442 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-4772ca8f-5903-4248-bfa3-7d4f76e978e8 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:44.167129 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-4772ca8f-5903-4248-bfa3-7d4f76e978e8 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] [instance: f1b4faf3-0c03-4e0c-be81-be3305b8314f] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:07:44.180788 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4772ca8f-5903-4248-bfa3-7d4f76e978e8 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:44.184660 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4772ca8f-5903-4248-bfa3-7d4f76e978e8 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:44.185598 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4772ca8f-5903-4248-bfa3-7d4f76e978e8 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:44.186405 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4772ca8f-5903-4248-bfa3-7d4f76e978e8 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:44.187155 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4772ca8f-5903-4248-bfa3-7d4f76e978e8 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:44.187604 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4772ca8f-5903-4248-bfa3-7d4f76e978e8 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:44.268768 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-cf9aa5d0-82a3-420c-99ff-39b563b572b7 req-a1085d1e-9313-495d-a0fc-b7bc03fb9803 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "318ee24a-a78a-4b3b-b18b-64f5c5c3109a", "tag": "4120874b-f8cf-4afa-8edb-c279d3fa86ae"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:07:44.283471 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-cf9aa5d0-82a3-420c-99ff-39b563b572b7 req-a1085d1e-9313-495d-a0fc-b7bc03fb9803 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:44.283963 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-cf9aa5d0-82a3-420c-99ff-39b563b572b7 req-a1085d1e-9313-495d-a0fc-b7bc03fb9803 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:44.284689 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-cf9aa5d0-82a3-420c-99ff-39b563b572b7 req-a1085d1e-9313-495d-a0fc-b7bc03fb9803 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:44.298152 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-cf9aa5d0-82a3-420c-99ff-39b563b572b7 req-a1085d1e-9313-495d-a0fc-b7bc03fb9803 service nova] Creating event network-changed:4120874b-f8cf-4afa-8edb-c279d3fa86ae for instance 318ee24a-a78a-4b3b-b18b-64f5c5c3109a on nch1-master-1 Oct 08 21:07:44.303525 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-cf9aa5d0-82a3-420c-99ff-39b563b572b7 req-a1085d1e-9313-495d-a0fc-b7bc03fb9803 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.299644 Oct 08 21:07:44.305728 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1823/3723] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:07:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:07:44.396426 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-a7bae17a-5de7-4190-9b55-cbe999c2a631 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:44.398118 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-a7bae17a-5de7-4190-9b55-cbe999c2a631 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] [instance: ce4a2fbf-76f3-4577-a704-3b64ec30d84b] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:07:44.406717 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a7bae17a-5de7-4190-9b55-cbe999c2a631 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:44.415901 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a7bae17a-5de7-4190-9b55-cbe999c2a631 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:44.416854 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a7bae17a-5de7-4190-9b55-cbe999c2a631 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:44.417710 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a7bae17a-5de7-4190-9b55-cbe999c2a631 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:44.419238 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a7bae17a-5de7-4190-9b55-cbe999c2a631 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:44.420587 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a7bae17a-5de7-4190-9b55-cbe999c2a631 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:44.459583 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-4772ca8f-5903-4248-bfa3-7d4f76e978e8 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30fe0e1ffa1040ec85d3c32d8b741c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd0e7c24154409824f96e9e99da357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:44.470732 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-4772ca8f-5903-4248-bfa3-7d4f76e978e8 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "GET /compute/v2.1/servers/f1b4faf3-0c03-4e0c-be81-be3305b8314f" status: 200 len: 1308 microversion: 2.1 time: 0.308809 Oct 08 21:07:44.472952 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1901/3724] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:07:44 2022] GET /compute/v2.1/servers/f1b4faf3-0c03-4e0c-be81-be3305b8314f => generated 1308 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:07:44.498779 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-a88c4eb6-f029-4258-828b-765cdf6868b1 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:44.499721 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-a88c4eb6-f029-4258-828b-765cdf6868b1 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] [instance: b1983b4c-4fd2-4ec8-9fb0-aa1f7fa51219] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:07:44.512518 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a88c4eb6-f029-4258-828b-765cdf6868b1 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:44.514016 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a88c4eb6-f029-4258-828b-765cdf6868b1 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:44.514769 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a88c4eb6-f029-4258-828b-765cdf6868b1 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:44.518170 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a88c4eb6-f029-4258-828b-765cdf6868b1 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:44.519385 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a88c4eb6-f029-4258-828b-765cdf6868b1 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:44.520850 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a88c4eb6-f029-4258-828b-765cdf6868b1 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:44.684244 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-a88c4eb6-f029-4258-828b-765cdf6868b1 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9cd61a0df164a9e9197022508adafbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acc59093f954b61ba9f3cd05e940c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:44.699654 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-a88c4eb6-f029-4258-828b-765cdf6868b1 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9cd61a0df164a9e9197022508adafbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acc59093f954b61ba9f3cd05e940c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:44.701985 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-a88c4eb6-f029-4258-828b-765cdf6868b1 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9cd61a0df164a9e9197022508adafbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acc59093f954b61ba9f3cd05e940c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:44.703762 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-a88c4eb6-f029-4258-828b-765cdf6868b1 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] 10.222.0.26 "GET /compute/v2.1/servers/b1983b4c-4fd2-4ec8-9fb0-aa1f7fa51219" status: 200 len: 1409 microversion: 2.54 time: 0.229265 Oct 08 21:07:44.704971 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1902/3725] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:07:44 2022] GET /compute/v2.1/servers/b1983b4c-4fd2-4ec8-9fb0-aa1f7fa51219 => generated 1409 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:07:44.725215 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-a7bae17a-5de7-4190-9b55-cbe999c2a631 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85abb492492343c58734564a2b26c8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68b14967e8249fd886f168d366f241f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:44.727368 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-b5810a62-aa44-471a-a900-307abee34118 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:44.728995 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-b5810a62-aa44-471a-a900-307abee34118 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: c7e330f4-220e-4dce-b65e-0aedb3206dda] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:07:44.734073 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-a7bae17a-5de7-4190-9b55-cbe999c2a631 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] 10.222.0.26 "GET /compute/v2.1/servers/ce4a2fbf-76f3-4577-a704-3b64ec30d84b" status: 200 len: 1678 microversion: 2.1 time: 0.349913 Oct 08 21:07:44.735421 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1824/3726] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:07:44 2022] GET /compute/v2.1/servers/ce4a2fbf-76f3-4577-a704-3b64ec30d84b => generated 1678 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:07:44.752578 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b5810a62-aa44-471a-a900-307abee34118 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:44.753495 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b5810a62-aa44-471a-a900-307abee34118 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:44.754118 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b5810a62-aa44-471a-a900-307abee34118 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:44.754936 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b5810a62-aa44-471a-a900-307abee34118 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:44.755626 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b5810a62-aa44-471a-a900-307abee34118 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:44.756103 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b5810a62-aa44-471a-a900-307abee34118 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:44.950025 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-b5810a62-aa44-471a-a900-307abee34118 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06443b5728fb4d1e95d6245820e786bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ded993145b4eda9d6a33b994519012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:44.966257 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-b5810a62-aa44-471a-a900-307abee34118 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "GET /compute/v2.1/servers/c7e330f4-220e-4dce-b65e-0aedb3206dda" status: 200 len: 1309 microversion: 2.1 time: 0.243370 Oct 08 21:07:44.968293 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1903/3727] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:07:44 2022] GET /compute/v2.1/servers/c7e330f4-220e-4dce-b65e-0aedb3206dda => generated 1309 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:07:45.014273 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-d9ecfc7f-8ab4-4462-9d4e-a4d61b037947 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:45.015244 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-d9ecfc7f-8ab4-4462-9d4e-a4d61b037947 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: 318ee24a-a78a-4b3b-b18b-64f5c5c3109a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:07:45.029332 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d9ecfc7f-8ab4-4462-9d4e-a4d61b037947 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:45.030212 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d9ecfc7f-8ab4-4462-9d4e-a4d61b037947 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:45.030879 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d9ecfc7f-8ab4-4462-9d4e-a4d61b037947 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:45.032249 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d9ecfc7f-8ab4-4462-9d4e-a4d61b037947 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:45.033069 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d9ecfc7f-8ab4-4462-9d4e-a4d61b037947 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:45.033726 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d9ecfc7f-8ab4-4462-9d4e-a4d61b037947 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:45.248123 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-d9ecfc7f-8ab4-4462-9d4e-a4d61b037947 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78e9afd772c4de981cac8f5817ec356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765c62cac2ee4406b23a5baa85c52ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:45.260619 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-d9ecfc7f-8ab4-4462-9d4e-a4d61b037947 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/318ee24a-a78a-4b3b-b18b-64f5c5c3109a" status: 200 len: 1315 microversion: 2.1 time: 0.253823 Oct 08 21:07:45.262560 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1825/3728] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:07:45 2022] GET /compute/v2.1/servers/318ee24a-a78a-4b3b-b18b-64f5c5c3109a => generated 1315 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:07:45.501926 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-b7dd72dc-a59c-4852-9892-03dbfb39817b tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:45.502640 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-b7dd72dc-a59c-4852-9892-03dbfb39817b tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] [instance: f1b4faf3-0c03-4e0c-be81-be3305b8314f] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:07:45.510554 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b7dd72dc-a59c-4852-9892-03dbfb39817b tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:45.511065 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b7dd72dc-a59c-4852-9892-03dbfb39817b tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:45.512037 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b7dd72dc-a59c-4852-9892-03dbfb39817b tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:45.517590 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b7dd72dc-a59c-4852-9892-03dbfb39817b tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:45.518364 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b7dd72dc-a59c-4852-9892-03dbfb39817b tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:45.518824 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b7dd72dc-a59c-4852-9892-03dbfb39817b tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:45.732236 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-aef1acf8-c3a4-48dd-9034-d89f4c25908a tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:45.733907 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-aef1acf8-c3a4-48dd-9034-d89f4c25908a tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] [instance: b1983b4c-4fd2-4ec8-9fb0-aa1f7fa51219] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:07:45.752430 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-aef1acf8-c3a4-48dd-9034-d89f4c25908a tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:45.753036 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-aef1acf8-c3a4-48dd-9034-d89f4c25908a tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:45.755418 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-aef1acf8-c3a4-48dd-9034-d89f4c25908a tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:45.756261 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-aef1acf8-c3a4-48dd-9034-d89f4c25908a tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:45.756739 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-aef1acf8-c3a4-48dd-9034-d89f4c25908a tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:45.757407 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-aef1acf8-c3a4-48dd-9034-d89f4c25908a tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:45.868203 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-aef1acf8-c3a4-48dd-9034-d89f4c25908a tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9cd61a0df164a9e9197022508adafbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acc59093f954b61ba9f3cd05e940c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:45.885782 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-aef1acf8-c3a4-48dd-9034-d89f4c25908a tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9cd61a0df164a9e9197022508adafbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acc59093f954b61ba9f3cd05e940c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:45.888664 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-aef1acf8-c3a4-48dd-9034-d89f4c25908a tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9cd61a0df164a9e9197022508adafbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acc59093f954b61ba9f3cd05e940c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:45.890470 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-aef1acf8-c3a4-48dd-9034-d89f4c25908a tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] 10.222.0.26 "GET /compute/v2.1/servers/b1983b4c-4fd2-4ec8-9fb0-aa1f7fa51219" status: 200 len: 1409 microversion: 2.54 time: 0.163290 Oct 08 21:07:45.909680 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1826/3729] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:07:45 2022] GET /compute/v2.1/servers/b1983b4c-4fd2-4ec8-9fb0-aa1f7fa51219 => generated 1409 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:07:45.909680 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-7f1ce2c0-558a-415c-ab3c-e2e7d2c86bf7 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:45.909680 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-7f1ce2c0-558a-415c-ab3c-e2e7d2c86bf7 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] [instance: ce4a2fbf-76f3-4577-a704-3b64ec30d84b] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:07:45.909680 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7f1ce2c0-558a-415c-ab3c-e2e7d2c86bf7 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:45.909680 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7f1ce2c0-558a-415c-ab3c-e2e7d2c86bf7 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:45.909680 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7f1ce2c0-558a-415c-ab3c-e2e7d2c86bf7 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:45.909680 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7f1ce2c0-558a-415c-ab3c-e2e7d2c86bf7 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:45.909680 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7f1ce2c0-558a-415c-ab3c-e2e7d2c86bf7 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:45.909680 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7f1ce2c0-558a-415c-ab3c-e2e7d2c86bf7 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:46.015258 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-b7dd72dc-a59c-4852-9892-03dbfb39817b tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30fe0e1ffa1040ec85d3c32d8b741c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd0e7c24154409824f96e9e99da357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:46.035216 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-b7dd72dc-a59c-4852-9892-03dbfb39817b tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "GET /compute/v2.1/servers/f1b4faf3-0c03-4e0c-be81-be3305b8314f" status: 200 len: 1308 microversion: 2.1 time: 0.538070 Oct 08 21:07:46.039304 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1904/3730] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:07:45 2022] GET /compute/v2.1/servers/f1b4faf3-0c03-4e0c-be81-be3305b8314f => generated 1308 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:07:46.052505 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-8a60d7ae-b756-4597-858b-0c00cf069fcb tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:46.053299 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-8a60d7ae-b756-4597-858b-0c00cf069fcb tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: c7e330f4-220e-4dce-b65e-0aedb3206dda] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:07:46.060718 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8a60d7ae-b756-4597-858b-0c00cf069fcb tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:46.061340 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8a60d7ae-b756-4597-858b-0c00cf069fcb tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:46.062437 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8a60d7ae-b756-4597-858b-0c00cf069fcb tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:46.063310 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8a60d7ae-b756-4597-858b-0c00cf069fcb tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:46.064931 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8a60d7ae-b756-4597-858b-0c00cf069fcb tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:46.065463 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8a60d7ae-b756-4597-858b-0c00cf069fcb tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:46.295877 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-8a60d7ae-b756-4597-858b-0c00cf069fcb tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06443b5728fb4d1e95d6245820e786bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ded993145b4eda9d6a33b994519012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:46.309707 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-8a60d7ae-b756-4597-858b-0c00cf069fcb tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "GET /compute/v2.1/servers/c7e330f4-220e-4dce-b65e-0aedb3206dda" status: 200 len: 1491 microversion: 2.1 time: 0.264059 Oct 08 21:07:46.310691 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1905/3731] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:07:46 2022] GET /compute/v2.1/servers/c7e330f4-220e-4dce-b65e-0aedb3206dda => generated 1491 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:07:46.317476 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-7fb1a26d-6df0-4118-9e30-0350e22388c7 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:46.318167 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-7fb1a26d-6df0-4118-9e30-0350e22388c7 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: 318ee24a-a78a-4b3b-b18b-64f5c5c3109a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:07:46.328468 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-7f1ce2c0-558a-415c-ab3c-e2e7d2c86bf7 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85abb492492343c58734564a2b26c8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68b14967e8249fd886f168d366f241f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:46.328879 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7fb1a26d-6df0-4118-9e30-0350e22388c7 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:46.329781 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7fb1a26d-6df0-4118-9e30-0350e22388c7 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:46.347566 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7fb1a26d-6df0-4118-9e30-0350e22388c7 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:46.348596 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7fb1a26d-6df0-4118-9e30-0350e22388c7 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:46.349153 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7fb1a26d-6df0-4118-9e30-0350e22388c7 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:46.350059 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7fb1a26d-6df0-4118-9e30-0350e22388c7 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:46.356207 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-7f1ce2c0-558a-415c-ab3c-e2e7d2c86bf7 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] 10.222.0.26 "GET /compute/v2.1/servers/ce4a2fbf-76f3-4577-a704-3b64ec30d84b" status: 200 len: 1678 microversion: 2.1 time: 0.460910 Oct 08 21:07:46.356779 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1827/3732] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:07:45 2022] GET /compute/v2.1/servers/ce4a2fbf-76f3-4577-a704-3b64ec30d84b => generated 1678 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:07:46.524011 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-73b70658-7335-4ded-bd08-07473c67caa7 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1953352793", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "networks": [{"uuid": "983c5654-1828-48da-a871-2028e691f4b0"}]}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:07:46.604261 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.network.neutron [None req-73b70658-7335-4ded-bd08-07473c67caa7 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] validate_networks() for [('983c5654-1828-48da-a871-2028e691f4b0', None, None, None, None, None)] {{(pid=140491) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 21:07:47.059980 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-7fb1a26d-6df0-4118-9e30-0350e22388c7 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78e9afd772c4de981cac8f5817ec356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765c62cac2ee4406b23a5baa85c52ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:47.080236 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-7fb1a26d-6df0-4118-9e30-0350e22388c7 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/318ee24a-a78a-4b3b-b18b-64f5c5c3109a" status: 200 len: 1315 microversion: 2.1 time: 0.768718 Oct 08 21:07:47.080936 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1906/3733] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:07:46 2022] GET /compute/v2.1/servers/318ee24a-a78a-4b3b-b18b-64f5c5c3109a => generated 1315 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:07:47.101946 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-87246908-29ae-478c-b62c-72c06a837598 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:47.102572 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-87246908-29ae-478c-b62c-72c06a837598 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] [instance: b1983b4c-4fd2-4ec8-9fb0-aa1f7fa51219] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:07:47.108976 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-87246908-29ae-478c-b62c-72c06a837598 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:47.109752 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-87246908-29ae-478c-b62c-72c06a837598 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:47.110218 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-87246908-29ae-478c-b62c-72c06a837598 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:47.111147 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-87246908-29ae-478c-b62c-72c06a837598 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:47.111616 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-87246908-29ae-478c-b62c-72c06a837598 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:47.112235 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-87246908-29ae-478c-b62c-72c06a837598 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:47.198135 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-87246908-29ae-478c-b62c-72c06a837598 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9cd61a0df164a9e9197022508adafbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acc59093f954b61ba9f3cd05e940c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:47.208787 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-87246908-29ae-478c-b62c-72c06a837598 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9cd61a0df164a9e9197022508adafbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acc59093f954b61ba9f3cd05e940c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:47.210750 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-87246908-29ae-478c-b62c-72c06a837598 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9cd61a0df164a9e9197022508adafbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acc59093f954b61ba9f3cd05e940c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:47.211974 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-87246908-29ae-478c-b62c-72c06a837598 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] 10.222.0.26 "GET /compute/v2.1/servers/b1983b4c-4fd2-4ec8-9fb0-aa1f7fa51219" status: 200 len: 1409 microversion: 2.54 time: 0.117427 Oct 08 21:07:47.212727 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1907/3734] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:07:47 2022] GET /compute/v2.1/servers/b1983b4c-4fd2-4ec8-9fb0-aa1f7fa51219 => generated 1409 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:07:47.228679 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-201cd61e-7138-47ee-868b-5a8bb814815c tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:47.230850 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-201cd61e-7138-47ee-868b-5a8bb814815c tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] [instance: f1b4faf3-0c03-4e0c-be81-be3305b8314f] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:07:47.239122 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-201cd61e-7138-47ee-868b-5a8bb814815c tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:47.240240 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-201cd61e-7138-47ee-868b-5a8bb814815c tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:47.242315 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-201cd61e-7138-47ee-868b-5a8bb814815c tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:47.242315 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-201cd61e-7138-47ee-868b-5a8bb814815c tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:47.243269 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-201cd61e-7138-47ee-868b-5a8bb814815c tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:47.243736 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-201cd61e-7138-47ee-868b-5a8bb814815c tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:47.293669 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-73b70658-7335-4ded-bd08-07473c67caa7 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Flavor limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 21:07:47.294649 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-73b70658-7335-4ded-bd08-07473c67caa7 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Image limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 21:07:47.295995 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-73b70658-7335-4ded-bd08-07473c67caa7 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Flavor pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 21:07:47.299426 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-73b70658-7335-4ded-bd08-07473c67caa7 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Image pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 21:07:47.299978 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-73b70658-7335-4ded-bd08-07473c67caa7 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 21:07:47.335389 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-73b70658-7335-4ded-bd08-07473c67caa7 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:47.336490 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-73b70658-7335-4ded-bd08-07473c67caa7 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:47.338228 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-73b70658-7335-4ded-bd08-07473c67caa7 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:47.339379 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-73b70658-7335-4ded-bd08-07473c67caa7 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:47.340312 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-73b70658-7335-4ded-bd08-07473c67caa7 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:47.341571 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-73b70658-7335-4ded-bd08-07473c67caa7 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:47.375940 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-73b70658-7335-4ded-bd08-07473c67caa7 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Getting quotas for project e7ded993145b4eda9d6a33b994519012. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:07:47.385064 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-73b70658-7335-4ded-bd08-07473c67caa7 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Getting quotas for user 06443b5728fb4d1e95d6245820e786bf and project e7ded993145b4eda9d6a33b994519012. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:07:47.409291 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-73b70658-7335-4ded-bd08-07473c67caa7 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Going to run 1 instances... {{(pid=140491) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 21:07:47.411809 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-73b70658-7335-4ded-bd08-07473c67caa7 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: f182bee3-f292-4f22-b9a0-93228e1a5049] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c508bd7f-7db9-4b2c-af7c-be54a855c355',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140491) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 21:07:47.513281 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-73b70658-7335-4ded-bd08-07473c67caa7 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.995603 Oct 08 21:07:47.521333 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1828/3735] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 21:07:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 1005 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 08 21:07:47.527642 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-34429e2f-7407-4efa-879f-4ed3c56c0fd1 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:47.528126 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-201cd61e-7138-47ee-868b-5a8bb814815c tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30fe0e1ffa1040ec85d3c32d8b741c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd0e7c24154409824f96e9e99da357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:47.528883 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-34429e2f-7407-4efa-879f-4ed3c56c0fd1 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] [instance: ce4a2fbf-76f3-4577-a704-3b64ec30d84b] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:07:47.539927 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-34429e2f-7407-4efa-879f-4ed3c56c0fd1 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:47.540537 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-34429e2f-7407-4efa-879f-4ed3c56c0fd1 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:47.544137 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-34429e2f-7407-4efa-879f-4ed3c56c0fd1 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:47.544294 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-201cd61e-7138-47ee-868b-5a8bb814815c tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "GET /compute/v2.1/servers/f1b4faf3-0c03-4e0c-be81-be3305b8314f" status: 200 len: 1308 microversion: 2.1 time: 0.321967 Oct 08 21:07:47.544613 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-34429e2f-7407-4efa-879f-4ed3c56c0fd1 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:47.544613 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-34429e2f-7407-4efa-879f-4ed3c56c0fd1 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:47.544613 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-34429e2f-7407-4efa-879f-4ed3c56c0fd1 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:47.544891 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1908/3736] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:07:47 2022] GET /compute/v2.1/servers/f1b4faf3-0c03-4e0c-be81-be3305b8314f => generated 1308 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:07:47.556515 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-aa5c32aa-e2c2-4dfb-b61f-f8d2e2453694 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:47.558422 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-aa5c32aa-e2c2-4dfb-b61f-f8d2e2453694 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: f182bee3-f292-4f22-b9a0-93228e1a5049] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:07:47.649094 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-aa5c32aa-e2c2-4dfb-b61f-f8d2e2453694 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06443b5728fb4d1e95d6245820e786bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ded993145b4eda9d6a33b994519012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:47.660205 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-aa5c32aa-e2c2-4dfb-b61f-f8d2e2453694 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "GET /compute/v2.1/servers/f182bee3-f292-4f22-b9a0-93228e1a5049" status: 200 len: 1209 microversion: 2.1 time: 0.113267 Oct 08 21:07:47.663502 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1909/3737] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:07:47 2022] GET /compute/v2.1/servers/f182bee3-f292-4f22-b9a0-93228e1a5049 => generated 1209 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:07:47.791294 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-3643f17b-c7cf-445e-981b-5080e66eb3ab req-ed741fda-c559-4033-b3bc-f31d7a5200fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1b4faf3-0c03-4e0c-be81-be3305b8314f", "name": "network-vif-plugged", "status": "completed", "tag": "37642f8c-8e21-43fe-865f-09cc1bd6c431"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:07:47.810446 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-3643f17b-c7cf-445e-981b-5080e66eb3ab req-ed741fda-c559-4033-b3bc-f31d7a5200fa service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:47.811119 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-3643f17b-c7cf-445e-981b-5080e66eb3ab req-ed741fda-c559-4033-b3bc-f31d7a5200fa service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:47.811630 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-3643f17b-c7cf-445e-981b-5080e66eb3ab req-ed741fda-c559-4033-b3bc-f31d7a5200fa service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:47.828770 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-3643f17b-c7cf-445e-981b-5080e66eb3ab req-ed741fda-c559-4033-b3bc-f31d7a5200fa service nova] Creating event network-vif-plugged:37642f8c-8e21-43fe-865f-09cc1bd6c431 for instance f1b4faf3-0c03-4e0c-be81-be3305b8314f on nch2-master-1 Oct 08 21:07:47.845320 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-34429e2f-7407-4efa-879f-4ed3c56c0fd1 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85abb492492343c58734564a2b26c8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68b14967e8249fd886f168d366f241f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:47.846121 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-3643f17b-c7cf-445e-981b-5080e66eb3ab req-ed741fda-c559-4033-b3bc-f31d7a5200fa service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061229 Oct 08 21:07:47.847063 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1910/3738] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:07:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 08 21:07:47.859283 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-34429e2f-7407-4efa-879f-4ed3c56c0fd1 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] 10.222.0.26 "GET /compute/v2.1/servers/ce4a2fbf-76f3-4577-a704-3b64ec30d84b" status: 200 len: 1678 microversion: 2.1 time: 0.336181 Oct 08 21:07:47.862348 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1829/3739] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:07:47 2022] GET /compute/v2.1/servers/ce4a2fbf-76f3-4577-a704-3b64ec30d84b => generated 1678 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:07:48.111008 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-c2092691-e1f4-4af5-b911-efaf96f321dc tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:48.111922 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-c2092691-e1f4-4af5-b911-efaf96f321dc tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: 318ee24a-a78a-4b3b-b18b-64f5c5c3109a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:07:48.127695 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c2092691-e1f4-4af5-b911-efaf96f321dc tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:48.128257 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c2092691-e1f4-4af5-b911-efaf96f321dc tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:48.128871 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c2092691-e1f4-4af5-b911-efaf96f321dc tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:48.132771 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c2092691-e1f4-4af5-b911-efaf96f321dc tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:48.133077 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c2092691-e1f4-4af5-b911-efaf96f321dc tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:48.136205 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c2092691-e1f4-4af5-b911-efaf96f321dc tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:48.249564 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c36ada96-fd90-4704-afe5-09542f4be553 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:48.250666 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-c36ada96-fd90-4704-afe5-09542f4be553 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] [instance: b1983b4c-4fd2-4ec8-9fb0-aa1f7fa51219] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:07:48.271763 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c36ada96-fd90-4704-afe5-09542f4be553 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:48.273407 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c36ada96-fd90-4704-afe5-09542f4be553 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:48.274254 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c36ada96-fd90-4704-afe5-09542f4be553 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:48.275928 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c36ada96-fd90-4704-afe5-09542f4be553 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:48.276850 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c36ada96-fd90-4704-afe5-09542f4be553 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:48.278954 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c36ada96-fd90-4704-afe5-09542f4be553 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:48.405550 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-c2092691-e1f4-4af5-b911-efaf96f321dc tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78e9afd772c4de981cac8f5817ec356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765c62cac2ee4406b23a5baa85c52ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:48.418515 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-c2092691-e1f4-4af5-b911-efaf96f321dc tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/318ee24a-a78a-4b3b-b18b-64f5c5c3109a" status: 200 len: 1315 microversion: 2.1 time: 0.311053 Oct 08 21:07:48.434528 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1911/3740] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:07:48 2022] GET /compute/v2.1/servers/318ee24a-a78a-4b3b-b18b-64f5c5c3109a => generated 1315 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:07:48.445749 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-c36ada96-fd90-4704-afe5-09542f4be553 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9cd61a0df164a9e9197022508adafbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acc59093f954b61ba9f3cd05e940c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:48.472930 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-c36ada96-fd90-4704-afe5-09542f4be553 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9cd61a0df164a9e9197022508adafbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acc59093f954b61ba9f3cd05e940c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:48.482132 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-c36ada96-fd90-4704-afe5-09542f4be553 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9cd61a0df164a9e9197022508adafbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acc59093f954b61ba9f3cd05e940c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:48.483555 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-c36ada96-fd90-4704-afe5-09542f4be553 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] 10.222.0.26 "GET /compute/v2.1/servers/b1983b4c-4fd2-4ec8-9fb0-aa1f7fa51219" status: 200 len: 1409 microversion: 2.54 time: 0.246881 Oct 08 21:07:48.489946 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1830/3741] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:07:48 2022] GET /compute/v2.1/servers/b1983b4c-4fd2-4ec8-9fb0-aa1f7fa51219 => generated 1409 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:07:48.573159 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-45fc822d-0861-4f5a-a9dd-6e59924b09a3 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:48.574275 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-45fc822d-0861-4f5a-a9dd-6e59924b09a3 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] [instance: f1b4faf3-0c03-4e0c-be81-be3305b8314f] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:07:48.583131 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-45fc822d-0861-4f5a-a9dd-6e59924b09a3 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:48.584747 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-45fc822d-0861-4f5a-a9dd-6e59924b09a3 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:48.586220 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-45fc822d-0861-4f5a-a9dd-6e59924b09a3 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:48.587096 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-45fc822d-0861-4f5a-a9dd-6e59924b09a3 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:48.587725 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-45fc822d-0861-4f5a-a9dd-6e59924b09a3 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:48.588440 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-45fc822d-0861-4f5a-a9dd-6e59924b09a3 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:48.690316 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-1cd83c79-3e1a-4e3f-8c5c-fa4b0f24bfc6 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:48.692450 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-1cd83c79-3e1a-4e3f-8c5c-fa4b0f24bfc6 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: f182bee3-f292-4f22-b9a0-93228e1a5049] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:07:48.707295 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1cd83c79-3e1a-4e3f-8c5c-fa4b0f24bfc6 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:48.708150 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1cd83c79-3e1a-4e3f-8c5c-fa4b0f24bfc6 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:48.708820 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1cd83c79-3e1a-4e3f-8c5c-fa4b0f24bfc6 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:48.709887 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1cd83c79-3e1a-4e3f-8c5c-fa4b0f24bfc6 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:48.710792 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1cd83c79-3e1a-4e3f-8c5c-fa4b0f24bfc6 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:48.711401 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1cd83c79-3e1a-4e3f-8c5c-fa4b0f24bfc6 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:48.774207 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-45fc822d-0861-4f5a-a9dd-6e59924b09a3 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30fe0e1ffa1040ec85d3c32d8b741c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd0e7c24154409824f96e9e99da357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:48.783201 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-45fc822d-0861-4f5a-a9dd-6e59924b09a3 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "GET /compute/v2.1/servers/f1b4faf3-0c03-4e0c-be81-be3305b8314f" status: 200 len: 1308 microversion: 2.1 time: 0.215415 Oct 08 21:07:48.789625 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1912/3742] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:07:48 2022] GET /compute/v2.1/servers/f1b4faf3-0c03-4e0c-be81-be3305b8314f => generated 1308 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:07:48.860500 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-1cd83c79-3e1a-4e3f-8c5c-fa4b0f24bfc6 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06443b5728fb4d1e95d6245820e786bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ded993145b4eda9d6a33b994519012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:48.868984 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-1cd83c79-3e1a-4e3f-8c5c-fa4b0f24bfc6 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "GET /compute/v2.1/servers/f182bee3-f292-4f22-b9a0-93228e1a5049" status: 200 len: 1205 microversion: 2.1 time: 0.183575 Oct 08 21:07:48.869606 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1831/3743] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:07:48 2022] GET /compute/v2.1/servers/f182bee3-f292-4f22-b9a0-93228e1a5049 => generated 1205 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:07:48.892142 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-23cccd47-3cc5-401c-82d4-7677ce0f684f tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:48.892781 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-23cccd47-3cc5-401c-82d4-7677ce0f684f tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] [instance: ce4a2fbf-76f3-4577-a704-3b64ec30d84b] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:07:48.900105 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-23cccd47-3cc5-401c-82d4-7677ce0f684f tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:48.900750 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-23cccd47-3cc5-401c-82d4-7677ce0f684f tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:48.901257 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-23cccd47-3cc5-401c-82d4-7677ce0f684f tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:48.902118 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-23cccd47-3cc5-401c-82d4-7677ce0f684f tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:48.902599 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-23cccd47-3cc5-401c-82d4-7677ce0f684f tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:48.903039 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-23cccd47-3cc5-401c-82d4-7677ce0f684f tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:49.150517 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-23cccd47-3cc5-401c-82d4-7677ce0f684f tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85abb492492343c58734564a2b26c8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68b14967e8249fd886f168d366f241f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:49.159267 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-23cccd47-3cc5-401c-82d4-7677ce0f684f tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] 10.222.0.26 "GET /compute/v2.1/servers/ce4a2fbf-76f3-4577-a704-3b64ec30d84b" status: 200 len: 1655 microversion: 2.1 time: 0.270994 Oct 08 21:07:49.160393 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1913/3744] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:07:48 2022] GET /compute/v2.1/servers/ce4a2fbf-76f3-4577-a704-3b64ec30d84b => generated 1655 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:07:49.184303 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-273dfe9d-cec9-4ed7-aead-8043048ba70e tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:07:49.190444 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-273dfe9d-cec9-4ed7-aead-8043048ba70e tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:49.190940 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-273dfe9d-cec9-4ed7-aead-8043048ba70e tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:49.191385 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-273dfe9d-cec9-4ed7-aead-8043048ba70e tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:49.214549 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-273dfe9d-cec9-4ed7-aead-8043048ba70e tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] [instance: ce4a2fbf-76f3-4577-a704-3b64ec30d84b] Going to try to start instance {{(pid=140491) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 08 21:07:49.275651 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-273dfe9d-cec9-4ed7-aead-8043048ba70e tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] 10.222.0.26 "POST /compute/v2.1/servers/ce4a2fbf-76f3-4577-a704-3b64ec30d84b/action" status: 202 len: 0 microversion: 2.1 time: 0.095526 Oct 08 21:07:49.277300 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1832/3745] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:07:49 2022] POST /compute/v2.1/servers/ce4a2fbf-76f3-4577-a704-3b64ec30d84b/action => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 21:07:49.286799 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e05d268c-1b0b-44a8-80fb-4c593869fdfa tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:49.287993 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-e05d268c-1b0b-44a8-80fb-4c593869fdfa tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] [instance: ce4a2fbf-76f3-4577-a704-3b64ec30d84b] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:07:49.299552 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e05d268c-1b0b-44a8-80fb-4c593869fdfa tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:49.301908 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e05d268c-1b0b-44a8-80fb-4c593869fdfa tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:49.304113 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e05d268c-1b0b-44a8-80fb-4c593869fdfa tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:49.306197 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e05d268c-1b0b-44a8-80fb-4c593869fdfa tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:49.307276 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e05d268c-1b0b-44a8-80fb-4c593869fdfa tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:49.309076 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e05d268c-1b0b-44a8-80fb-4c593869fdfa tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:49.450526 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-2014d546-4b33-4e4b-870d-42a4571d9d3d tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:49.451899 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-2014d546-4b33-4e4b-870d-42a4571d9d3d tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: 318ee24a-a78a-4b3b-b18b-64f5c5c3109a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:07:49.463464 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2014d546-4b33-4e4b-870d-42a4571d9d3d tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:49.464632 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2014d546-4b33-4e4b-870d-42a4571d9d3d tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:49.465161 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2014d546-4b33-4e4b-870d-42a4571d9d3d tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:49.466194 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2014d546-4b33-4e4b-870d-42a4571d9d3d tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:49.466643 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2014d546-4b33-4e4b-870d-42a4571d9d3d tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:49.473557 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2014d546-4b33-4e4b-870d-42a4571d9d3d tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:49.631264 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-e05d268c-1b0b-44a8-80fb-4c593869fdfa tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85abb492492343c58734564a2b26c8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68b14967e8249fd886f168d366f241f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:49.633813 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=100 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:07:49.647282 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-e05d268c-1b0b-44a8-80fb-4c593869fdfa tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] 10.222.0.26 "GET /compute/v2.1/servers/ce4a2fbf-76f3-4577-a704-3b64ec30d84b" status: 200 len: 1664 microversion: 2.1 time: 0.365237 Oct 08 21:07:49.651685 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1914/3746] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:07:49 2022] GET /compute/v2.1/servers/ce4a2fbf-76f3-4577-a704-3b64ec30d84b => generated 1664 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:07:49.657260 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-d471c8bc-0273-486e-98b3-2ff035126fe4 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:49.658068 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-d471c8bc-0273-486e-98b3-2ff035126fe4 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] [instance: b1983b4c-4fd2-4ec8-9fb0-aa1f7fa51219] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:07:49.665744 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d471c8bc-0273-486e-98b3-2ff035126fe4 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:49.678732 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d471c8bc-0273-486e-98b3-2ff035126fe4 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:49.680668 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d471c8bc-0273-486e-98b3-2ff035126fe4 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:49.683107 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d471c8bc-0273-486e-98b3-2ff035126fe4 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:49.687040 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d471c8bc-0273-486e-98b3-2ff035126fe4 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:49.687634 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d471c8bc-0273-486e-98b3-2ff035126fe4 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:49.802285 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-2014d546-4b33-4e4b-870d-42a4571d9d3d tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78e9afd772c4de981cac8f5817ec356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765c62cac2ee4406b23a5baa85c52ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:49.816196 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-2014d546-4b33-4e4b-870d-42a4571d9d3d tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/318ee24a-a78a-4b3b-b18b-64f5c5c3109a" status: 200 len: 1315 microversion: 2.1 time: 0.371651 Oct 08 21:07:49.817063 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1833/3747] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:07:49 2022] GET /compute/v2.1/servers/318ee24a-a78a-4b3b-b18b-64f5c5c3109a => generated 1315 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:07:49.825035 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-9039e8f5-81a4-42aa-bac3-9bd6b0903ad4 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:49.825916 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-9039e8f5-81a4-42aa-bac3-9bd6b0903ad4 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] [instance: f1b4faf3-0c03-4e0c-be81-be3305b8314f] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:07:49.853305 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9039e8f5-81a4-42aa-bac3-9bd6b0903ad4 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:49.853903 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9039e8f5-81a4-42aa-bac3-9bd6b0903ad4 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:49.854298 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9039e8f5-81a4-42aa-bac3-9bd6b0903ad4 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:49.855071 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9039e8f5-81a4-42aa-bac3-9bd6b0903ad4 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:49.855656 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9039e8f5-81a4-42aa-bac3-9bd6b0903ad4 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:49.856103 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9039e8f5-81a4-42aa-bac3-9bd6b0903ad4 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:49.885987 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-d471c8bc-0273-486e-98b3-2ff035126fe4 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9cd61a0df164a9e9197022508adafbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acc59093f954b61ba9f3cd05e940c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:49.905685 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-d471c8bc-0273-486e-98b3-2ff035126fe4 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9cd61a0df164a9e9197022508adafbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acc59093f954b61ba9f3cd05e940c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:49.907140 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-d471c8bc-0273-486e-98b3-2ff035126fe4 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9cd61a0df164a9e9197022508adafbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acc59093f954b61ba9f3cd05e940c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:49.908337 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-d471c8bc-0273-486e-98b3-2ff035126fe4 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] 10.222.0.26 "GET /compute/v2.1/servers/b1983b4c-4fd2-4ec8-9fb0-aa1f7fa51219" status: 200 len: 1409 microversion: 2.54 time: 0.255338 Oct 08 21:07:49.909211 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1915/3748] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:07:49 2022] GET /compute/v2.1/servers/b1983b4c-4fd2-4ec8-9fb0-aa1f7fa51219 => generated 1409 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:07:49.936158 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-a2ba08d7-a6f5-4aae-947f-282a4e09edf5 req-984b4578-4c9d-4c01-9629-b3602cdcafd2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "318ee24a-a78a-4b3b-b18b-64f5c5c3109a", "name": "network-vif-plugged", "status": "completed", "tag": "4120874b-f8cf-4afa-8edb-c279d3fa86ae"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:07:49.952018 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-a2ba08d7-a6f5-4aae-947f-282a4e09edf5 req-984b4578-4c9d-4c01-9629-b3602cdcafd2 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:49.953438 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-a2ba08d7-a6f5-4aae-947f-282a4e09edf5 req-984b4578-4c9d-4c01-9629-b3602cdcafd2 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:49.954138 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-a2ba08d7-a6f5-4aae-947f-282a4e09edf5 req-984b4578-4c9d-4c01-9629-b3602cdcafd2 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:49.972048 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-a2ba08d7-a6f5-4aae-947f-282a4e09edf5 req-984b4578-4c9d-4c01-9629-b3602cdcafd2 service nova] Creating event network-vif-plugged:4120874b-f8cf-4afa-8edb-c279d3fa86ae for instance 318ee24a-a78a-4b3b-b18b-64f5c5c3109a on nch1-master-1 Oct 08 21:07:49.979666 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-a2ba08d7-a6f5-4aae-947f-282a4e09edf5 req-984b4578-4c9d-4c01-9629-b3602cdcafd2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064872 Oct 08 21:07:49.981941 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1916/3749] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:07:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:07:49.989315 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-519d0584-e7c3-4afc-8c6c-48a77d6c44e8 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:49.990709 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-519d0584-e7c3-4afc-8c6c-48a77d6c44e8 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: f182bee3-f292-4f22-b9a0-93228e1a5049] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:07:49.996607 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:07:50.000142 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-519d0584-e7c3-4afc-8c6c-48a77d6c44e8 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:50.000921 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-519d0584-e7c3-4afc-8c6c-48a77d6c44e8 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:50.002391 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-519d0584-e7c3-4afc-8c6c-48a77d6c44e8 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:50.004001 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-519d0584-e7c3-4afc-8c6c-48a77d6c44e8 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:50.004471 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-519d0584-e7c3-4afc-8c6c-48a77d6c44e8 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:50.005850 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-519d0584-e7c3-4afc-8c6c-48a77d6c44e8 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:50.126216 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-519d0584-e7c3-4afc-8c6c-48a77d6c44e8 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06443b5728fb4d1e95d6245820e786bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ded993145b4eda9d6a33b994519012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:50.134872 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-519d0584-e7c3-4afc-8c6c-48a77d6c44e8 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "GET /compute/v2.1/servers/f182bee3-f292-4f22-b9a0-93228e1a5049" status: 200 len: 1279 microversion: 2.1 time: 0.151531 Oct 08 21:07:50.136132 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1917/3750] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:07:49 2022] GET /compute/v2.1/servers/f182bee3-f292-4f22-b9a0-93228e1a5049 => generated 1279 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:07:50.166234 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-9039e8f5-81a4-42aa-bac3-9bd6b0903ad4 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30fe0e1ffa1040ec85d3c32d8b741c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd0e7c24154409824f96e9e99da357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:50.174991 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-9039e8f5-81a4-42aa-bac3-9bd6b0903ad4 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "GET /compute/v2.1/servers/f1b4faf3-0c03-4e0c-be81-be3305b8314f" status: 200 len: 1487 microversion: 2.1 time: 0.356039 Oct 08 21:07:50.189857 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1834/3751] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:07:49 2022] GET /compute/v2.1/servers/f1b4faf3-0c03-4e0c-be81-be3305b8314f => generated 1487 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:07:50.200234 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-250fd794-7805-4ad5-afe9-2748928cfbe1 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:07:50.201506 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-250fd794-7805-4ad5-afe9-2748928cfbe1 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] [instance: f1b4faf3-0c03-4e0c-be81-be3305b8314f] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:07:50.207942 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-250fd794-7805-4ad5-afe9-2748928cfbe1 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:50.208442 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-250fd794-7805-4ad5-afe9-2748928cfbe1 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:50.209156 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-250fd794-7805-4ad5-afe9-2748928cfbe1 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:50.210290 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-250fd794-7805-4ad5-afe9-2748928cfbe1 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:50.210935 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-250fd794-7805-4ad5-afe9-2748928cfbe1 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:50.211540 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-250fd794-7805-4ad5-afe9-2748928cfbe1 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:50.294939 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-250fd794-7805-4ad5-afe9-2748928cfbe1 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "POST /compute/v2.1/servers/f1b4faf3-0c03-4e0c-be81-be3305b8314f/action" status: 202 len: 0 microversion: 2.1 time: 0.099382 Oct 08 21:07:50.295706 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1918/3752] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:07:50 2022] POST /compute/v2.1/servers/f1b4faf3-0c03-4e0c-be81-be3305b8314f/action => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 21:07:50.304056 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-53171999-7760-43a1-af16-98a7828001bd tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:50.305005 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-53171999-7760-43a1-af16-98a7828001bd tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] [instance: f1b4faf3-0c03-4e0c-be81-be3305b8314f] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:07:50.313157 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-53171999-7760-43a1-af16-98a7828001bd tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:50.313970 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-53171999-7760-43a1-af16-98a7828001bd tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:50.314426 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-53171999-7760-43a1-af16-98a7828001bd tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:50.315198 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-53171999-7760-43a1-af16-98a7828001bd tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:50.315903 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-53171999-7760-43a1-af16-98a7828001bd tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:50.316348 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-53171999-7760-43a1-af16-98a7828001bd tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:50.524853 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-53171999-7760-43a1-af16-98a7828001bd tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30fe0e1ffa1040ec85d3c32d8b741c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd0e7c24154409824f96e9e99da357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:50.540617 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-53171999-7760-43a1-af16-98a7828001bd tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "GET /compute/v2.1/servers/f1b4faf3-0c03-4e0c-be81-be3305b8314f" status: 200 len: 1492 microversion: 2.1 time: 0.239519 Oct 08 21:07:50.541633 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1835/3753] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:07:50 2022] GET /compute/v2.1/servers/f1b4faf3-0c03-4e0c-be81-be3305b8314f => generated 1492 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:07:50.680318 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-60af1d76-72f5-4d55-861c-9719f9589b3d tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:50.681870 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-60af1d76-72f5-4d55-861c-9719f9589b3d tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] [instance: ce4a2fbf-76f3-4577-a704-3b64ec30d84b] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:07:50.692195 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-60af1d76-72f5-4d55-861c-9719f9589b3d tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:50.692697 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-60af1d76-72f5-4d55-861c-9719f9589b3d tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:50.694570 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-60af1d76-72f5-4d55-861c-9719f9589b3d tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:50.695316 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-60af1d76-72f5-4d55-861c-9719f9589b3d tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:50.695971 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-60af1d76-72f5-4d55-861c-9719f9589b3d tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:50.696415 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-60af1d76-72f5-4d55-861c-9719f9589b3d tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:50.840064 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-55739b8d-a18c-40cd-b271-49ae75efa1ed tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:50.840684 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-55739b8d-a18c-40cd-b271-49ae75efa1ed tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: 318ee24a-a78a-4b3b-b18b-64f5c5c3109a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:07:50.846885 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-55739b8d-a18c-40cd-b271-49ae75efa1ed tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:50.847378 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-55739b8d-a18c-40cd-b271-49ae75efa1ed tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:50.847820 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-55739b8d-a18c-40cd-b271-49ae75efa1ed tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:50.848525 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-55739b8d-a18c-40cd-b271-49ae75efa1ed tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:50.848986 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-55739b8d-a18c-40cd-b271-49ae75efa1ed tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:50.849452 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-55739b8d-a18c-40cd-b271-49ae75efa1ed tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:50.855322 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:07:50.994877 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-55739b8d-a18c-40cd-b271-49ae75efa1ed tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78e9afd772c4de981cac8f5817ec356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765c62cac2ee4406b23a5baa85c52ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:51.004836 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-55739b8d-a18c-40cd-b271-49ae75efa1ed tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/318ee24a-a78a-4b3b-b18b-64f5c5c3109a" status: 200 len: 1315 microversion: 2.1 time: 0.168675 Oct 08 21:07:51.005689 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1836/3754] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:07:50 2022] GET /compute/v2.1/servers/318ee24a-a78a-4b3b-b18b-64f5c5c3109a => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:07:51.010460 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-e9b525e1-aa67-437f-8510-5285b59d0fa2 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:51.011064 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-e9b525e1-aa67-437f-8510-5285b59d0fa2 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] [instance: b1983b4c-4fd2-4ec8-9fb0-aa1f7fa51219] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:07:51.018087 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e9b525e1-aa67-437f-8510-5285b59d0fa2 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:51.018587 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e9b525e1-aa67-437f-8510-5285b59d0fa2 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:51.019029 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e9b525e1-aa67-437f-8510-5285b59d0fa2 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:51.019941 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e9b525e1-aa67-437f-8510-5285b59d0fa2 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:51.020578 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e9b525e1-aa67-437f-8510-5285b59d0fa2 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:51.021011 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e9b525e1-aa67-437f-8510-5285b59d0fa2 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:51.035191 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-60af1d76-72f5-4d55-861c-9719f9589b3d tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85abb492492343c58734564a2b26c8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68b14967e8249fd886f168d366f241f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:51.045765 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-60af1d76-72f5-4d55-861c-9719f9589b3d tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] 10.222.0.26 "GET /compute/v2.1/servers/ce4a2fbf-76f3-4577-a704-3b64ec30d84b" status: 200 len: 1664 microversion: 2.1 time: 0.370742 Oct 08 21:07:51.046756 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1919/3755] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:07:50 2022] GET /compute/v2.1/servers/ce4a2fbf-76f3-4577-a704-3b64ec30d84b => generated 1664 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:07:51.099076 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-e9b525e1-aa67-437f-8510-5285b59d0fa2 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9cd61a0df164a9e9197022508adafbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acc59093f954b61ba9f3cd05e940c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:51.109259 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-e9b525e1-aa67-437f-8510-5285b59d0fa2 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9cd61a0df164a9e9197022508adafbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acc59093f954b61ba9f3cd05e940c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:51.110718 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-e9b525e1-aa67-437f-8510-5285b59d0fa2 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9cd61a0df164a9e9197022508adafbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acc59093f954b61ba9f3cd05e940c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:51.112016 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-e9b525e1-aa67-437f-8510-5285b59d0fa2 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] 10.222.0.26 "GET /compute/v2.1/servers/b1983b4c-4fd2-4ec8-9fb0-aa1f7fa51219" status: 200 len: 1409 microversion: 2.54 time: 0.105238 Oct 08 21:07:51.112791 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1837/3756] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:07:51 2022] GET /compute/v2.1/servers/b1983b4c-4fd2-4ec8-9fb0-aa1f7fa51219 => generated 1409 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:07:51.160011 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-82c4d495-fc95-4a0b-aed9-0c0667573544 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:51.160779 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-82c4d495-fc95-4a0b-aed9-0c0667573544 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: f182bee3-f292-4f22-b9a0-93228e1a5049] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:07:51.166928 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-82c4d495-fc95-4a0b-aed9-0c0667573544 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:51.167406 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-82c4d495-fc95-4a0b-aed9-0c0667573544 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:51.167882 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-82c4d495-fc95-4a0b-aed9-0c0667573544 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:51.168580 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-82c4d495-fc95-4a0b-aed9-0c0667573544 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:51.169045 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-82c4d495-fc95-4a0b-aed9-0c0667573544 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:51.169508 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-82c4d495-fc95-4a0b-aed9-0c0667573544 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:51.256306 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-82c4d495-fc95-4a0b-aed9-0c0667573544 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06443b5728fb4d1e95d6245820e786bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ded993145b4eda9d6a33b994519012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:51.266203 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-82c4d495-fc95-4a0b-aed9-0c0667573544 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "GET /compute/v2.1/servers/f182bee3-f292-4f22-b9a0-93228e1a5049" status: 200 len: 1267 microversion: 2.1 time: 0.109318 Oct 08 21:07:51.267293 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1920/3757] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:07:51 2022] GET /compute/v2.1/servers/f182bee3-f292-4f22-b9a0-93228e1a5049 => generated 1267 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:07:51.566780 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-6b060e6e-3605-4c98-b00e-f2e24563aac0 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:51.567403 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-6b060e6e-3605-4c98-b00e-f2e24563aac0 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] [instance: f1b4faf3-0c03-4e0c-be81-be3305b8314f] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:07:51.578753 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6b060e6e-3605-4c98-b00e-f2e24563aac0 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:51.579659 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6b060e6e-3605-4c98-b00e-f2e24563aac0 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:51.580339 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6b060e6e-3605-4c98-b00e-f2e24563aac0 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:51.581631 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6b060e6e-3605-4c98-b00e-f2e24563aac0 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:51.582331 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6b060e6e-3605-4c98-b00e-f2e24563aac0 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:51.582961 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6b060e6e-3605-4c98-b00e-f2e24563aac0 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:52.035317 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-bc59370a-b7cc-4c8f-8185-74d35f8ed1bf tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:52.035963 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-bc59370a-b7cc-4c8f-8185-74d35f8ed1bf tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: 318ee24a-a78a-4b3b-b18b-64f5c5c3109a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:07:52.046793 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bc59370a-b7cc-4c8f-8185-74d35f8ed1bf tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:52.048482 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bc59370a-b7cc-4c8f-8185-74d35f8ed1bf tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:52.049104 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bc59370a-b7cc-4c8f-8185-74d35f8ed1bf tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:52.050311 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bc59370a-b7cc-4c8f-8185-74d35f8ed1bf tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:52.052107 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bc59370a-b7cc-4c8f-8185-74d35f8ed1bf tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:52.052930 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bc59370a-b7cc-4c8f-8185-74d35f8ed1bf tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:52.120373 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-6b060e6e-3605-4c98-b00e-f2e24563aac0 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30fe0e1ffa1040ec85d3c32d8b741c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd0e7c24154409824f96e9e99da357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:52.129580 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-6b060e6e-3605-4c98-b00e-f2e24563aac0 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "GET /compute/v2.1/servers/f1b4faf3-0c03-4e0c-be81-be3305b8314f" status: 200 len: 1472 microversion: 2.1 time: 0.567035 Oct 08 21:07:52.130348 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1838/3758] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:07:51 2022] GET /compute/v2.1/servers/f1b4faf3-0c03-4e0c-be81-be3305b8314f => generated 1472 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:07:52.135133 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-11a8a6fb-6c8b-442f-8df1-b7e4722744dc tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:52.135801 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-11a8a6fb-6c8b-442f-8df1-b7e4722744dc tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] [instance: ce4a2fbf-76f3-4577-a704-3b64ec30d84b] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:07:52.144647 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-11a8a6fb-6c8b-442f-8df1-b7e4722744dc tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:52.145324 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-11a8a6fb-6c8b-442f-8df1-b7e4722744dc tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:52.145855 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-11a8a6fb-6c8b-442f-8df1-b7e4722744dc tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:52.146764 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-11a8a6fb-6c8b-442f-8df1-b7e4722744dc tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:52.147368 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-11a8a6fb-6c8b-442f-8df1-b7e4722744dc tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:52.148145 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-11a8a6fb-6c8b-442f-8df1-b7e4722744dc tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:52.282308 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-11a8a6fb-6c8b-442f-8df1-b7e4722744dc tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85abb492492343c58734564a2b26c8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68b14967e8249fd886f168d366f241f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:52.290953 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-11a8a6fb-6c8b-442f-8df1-b7e4722744dc tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] 10.222.0.26 "GET /compute/v2.1/servers/ce4a2fbf-76f3-4577-a704-3b64ec30d84b" status: 200 len: 1668 microversion: 2.1 time: 0.159403 Oct 08 21:07:52.291552 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1839/3759] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:07:52 2022] GET /compute/v2.1/servers/ce4a2fbf-76f3-4577-a704-3b64ec30d84b => generated 1668 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:07:52.296305 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-384259bf-bada-424e-821e-3f0cc5b6935d tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:52.296921 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-384259bf-bada-424e-821e-3f0cc5b6935d tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] [instance: b1983b4c-4fd2-4ec8-9fb0-aa1f7fa51219] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:07:52.302893 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-384259bf-bada-424e-821e-3f0cc5b6935d tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:52.303396 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-384259bf-bada-424e-821e-3f0cc5b6935d tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:52.303858 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-384259bf-bada-424e-821e-3f0cc5b6935d tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:52.304563 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-384259bf-bada-424e-821e-3f0cc5b6935d tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:52.305037 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-384259bf-bada-424e-821e-3f0cc5b6935d tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:52.305811 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-384259bf-bada-424e-821e-3f0cc5b6935d tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:52.378219 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-384259bf-bada-424e-821e-3f0cc5b6935d tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9cd61a0df164a9e9197022508adafbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acc59093f954b61ba9f3cd05e940c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:52.387298 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-384259bf-bada-424e-821e-3f0cc5b6935d tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9cd61a0df164a9e9197022508adafbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acc59093f954b61ba9f3cd05e940c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:52.388792 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-384259bf-bada-424e-821e-3f0cc5b6935d tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9cd61a0df164a9e9197022508adafbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acc59093f954b61ba9f3cd05e940c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:52.390037 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-384259bf-bada-424e-821e-3f0cc5b6935d tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] 10.222.0.26 "GET /compute/v2.1/servers/b1983b4c-4fd2-4ec8-9fb0-aa1f7fa51219" status: 200 len: 1409 microversion: 2.54 time: 0.097372 Oct 08 21:07:52.401721 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1840/3760] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:07:52 2022] GET /compute/v2.1/servers/b1983b4c-4fd2-4ec8-9fb0-aa1f7fa51219 => generated 1409 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:07:52.401721 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-d5a50d16-b9cb-4dc1-a201-b534cc7e9752 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1404273089"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:07:52.401721 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-d5a50d16-b9cb-4dc1-a201-b534cc7e9752 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] [instance: f1b4faf3-0c03-4e0c-be81-be3305b8314f] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:07:52.402241 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-bc59370a-b7cc-4c8f-8185-74d35f8ed1bf tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78e9afd772c4de981cac8f5817ec356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765c62cac2ee4406b23a5baa85c52ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:52.404298 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d5a50d16-b9cb-4dc1-a201-b534cc7e9752 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:52.405042 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d5a50d16-b9cb-4dc1-a201-b534cc7e9752 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:52.405876 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d5a50d16-b9cb-4dc1-a201-b534cc7e9752 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:52.406826 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d5a50d16-b9cb-4dc1-a201-b534cc7e9752 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:52.407516 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d5a50d16-b9cb-4dc1-a201-b534cc7e9752 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:52.408159 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d5a50d16-b9cb-4dc1-a201-b534cc7e9752 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:52.409344 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-bc59370a-b7cc-4c8f-8185-74d35f8ed1bf tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/318ee24a-a78a-4b3b-b18b-64f5c5c3109a" status: 200 len: 1502 microversion: 2.1 time: 0.382315 Oct 08 21:07:52.414095 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1921/3761] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:07:52 2022] GET /compute/v2.1/servers/318ee24a-a78a-4b3b-b18b-64f5c5c3109a => generated 1502 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:07:52.419195 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e1030680-f805-4818-a58c-72934a8f6d5f tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:52.428833 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-e1030680-f805-4818-a58c-72934a8f6d5f tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: f182bee3-f292-4f22-b9a0-93228e1a5049] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:07:52.436278 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e1030680-f805-4818-a58c-72934a8f6d5f tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:52.436792 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e1030680-f805-4818-a58c-72934a8f6d5f tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:52.437272 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e1030680-f805-4818-a58c-72934a8f6d5f tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:52.438005 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e1030680-f805-4818-a58c-72934a8f6d5f tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:52.438475 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e1030680-f805-4818-a58c-72934a8f6d5f tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:52.439398 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e1030680-f805-4818-a58c-72934a8f6d5f tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:52.634839 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-d5a50d16-b9cb-4dc1-a201-b534cc7e9752 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "POST /compute/v2.1/servers/f1b4faf3-0c03-4e0c-be81-be3305b8314f/action" status: 202 len: 0 microversion: 2.1 time: 0.242927 Oct 08 21:07:52.635915 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1841/3762] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:07:52 2022] POST /compute/v2.1/servers/f1b4faf3-0c03-4e0c-be81-be3305b8314f/action => generated 0 bytes in 245 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 08 21:07:52.642092 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-7075bc65-6e86-404e-8c95-6d3111d300d0 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:52.642732 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-7075bc65-6e86-404e-8c95-6d3111d300d0 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: 318ee24a-a78a-4b3b-b18b-64f5c5c3109a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:07:52.649247 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7075bc65-6e86-404e-8c95-6d3111d300d0 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:52.649784 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7075bc65-6e86-404e-8c95-6d3111d300d0 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:52.650251 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7075bc65-6e86-404e-8c95-6d3111d300d0 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:52.651006 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7075bc65-6e86-404e-8c95-6d3111d300d0 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:52.651501 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7075bc65-6e86-404e-8c95-6d3111d300d0 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:52.652092 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7075bc65-6e86-404e-8c95-6d3111d300d0 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:52.690958 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-7075bc65-6e86-404e-8c95-6d3111d300d0 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: 318ee24a-a78a-4b3b-b18b-64f5c5c3109a] Going to try to terminate instance {{(pid=140491) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 21:07:52.723809 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-e1030680-f805-4818-a58c-72934a8f6d5f tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06443b5728fb4d1e95d6245820e786bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ded993145b4eda9d6a33b994519012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:52.739576 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-e1030680-f805-4818-a58c-72934a8f6d5f tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "GET /compute/v2.1/servers/f182bee3-f292-4f22-b9a0-93228e1a5049" status: 200 len: 1309 microversion: 2.1 time: 0.324078 Oct 08 21:07:52.740434 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1922/3763] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:07:52 2022] GET /compute/v2.1/servers/f182bee3-f292-4f22-b9a0-93228e1a5049 => generated 1309 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:07:52.767256 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-ad80b8e0-d5cd-4b57-9c0d-9b9da83d1047 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Calling method '.version_select at 0x7f1a87d83280>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:52.854272 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-ad80b8e0-d5cd-4b57-9c0d-9b9da83d1047 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "GET /compute/v2.1/images/fa798238-0b05-4e9a-a4b3-2d47579804f6" status: 200 len: 1412 microversion: 2.1 time: 0.090820 Oct 08 21:07:52.854939 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-7075bc65-6e86-404e-8c95-6d3111d300d0 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "DELETE /compute/v2.1/servers/318ee24a-a78a-4b3b-b18b-64f5c5c3109a" status: 204 len: 0 microversion: 2.1 time: 0.216789 Oct 08 21:07:52.855471 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1923/3764] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:07:52 2022] GET /compute/v2.1/images/fa798238-0b05-4e9a-a4b3-2d47579804f6 => generated 1412 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:07:52.856091 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1842/3765] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:07:52 2022] DELETE /compute/v2.1/servers/318ee24a-a78a-4b3b-b18b-64f5c5c3109a => generated 0 bytes in 220 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 21:07:52.862034 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-f66e13f9-884c-4716-87b0-f99355170059 req-dce50f53-d285-48e8-8f3f-5a8b234a012f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f182bee3-f292-4f22-b9a0-93228e1a5049", "tag": "668c891e-a778-42d8-bc73-e74d3f038e32"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:07:52.875145 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-f66e13f9-884c-4716-87b0-f99355170059 req-dce50f53-d285-48e8-8f3f-5a8b234a012f service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:52.875695 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-f66e13f9-884c-4716-87b0-f99355170059 req-dce50f53-d285-48e8-8f3f-5a8b234a012f service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:52.876169 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-f66e13f9-884c-4716-87b0-f99355170059 req-dce50f53-d285-48e8-8f3f-5a8b234a012f service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:52.879990 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-2d662107-66a5-41ef-8e2b-4c1950942070 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:52.880838 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-2d662107-66a5-41ef-8e2b-4c1950942070 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: 318ee24a-a78a-4b3b-b18b-64f5c5c3109a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:07:52.889651 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2d662107-66a5-41ef-8e2b-4c1950942070 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:52.892161 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2d662107-66a5-41ef-8e2b-4c1950942070 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:52.892886 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2d662107-66a5-41ef-8e2b-4c1950942070 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:52.895009 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2d662107-66a5-41ef-8e2b-4c1950942070 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:52.895672 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2d662107-66a5-41ef-8e2b-4c1950942070 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:52.896288 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2d662107-66a5-41ef-8e2b-4c1950942070 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:52.904635 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-f66e13f9-884c-4716-87b0-f99355170059 req-dce50f53-d285-48e8-8f3f-5a8b234a012f service nova] Creating event network-changed:668c891e-a778-42d8-bc73-e74d3f038e32 for instance f182bee3-f292-4f22-b9a0-93228e1a5049 on nch2-master-1 Oct 08 21:07:52.910067 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-f66e13f9-884c-4716-87b0-f99355170059 req-dce50f53-d285-48e8-8f3f-5a8b234a012f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052573 Oct 08 21:07:52.910691 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1924/3766] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:07:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:07:53.061741 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-2d662107-66a5-41ef-8e2b-4c1950942070 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78e9afd772c4de981cac8f5817ec356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765c62cac2ee4406b23a5baa85c52ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:53.069155 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-2d662107-66a5-41ef-8e2b-4c1950942070 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/318ee24a-a78a-4b3b-b18b-64f5c5c3109a" status: 200 len: 1508 microversion: 2.1 time: 0.199155 Oct 08 21:07:53.085174 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1843/3767] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:07:52 2022] GET /compute/v2.1/servers/318ee24a-a78a-4b3b-b18b-64f5c5c3109a => generated 1508 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:07:53.419327 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-d13725f2-7928-4476-bc88-b6fc350509e8 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:53.421499 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-d13725f2-7928-4476-bc88-b6fc350509e8 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] [instance: b1983b4c-4fd2-4ec8-9fb0-aa1f7fa51219] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:07:53.430069 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d13725f2-7928-4476-bc88-b6fc350509e8 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:53.430690 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d13725f2-7928-4476-bc88-b6fc350509e8 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:53.431281 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d13725f2-7928-4476-bc88-b6fc350509e8 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:53.432153 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d13725f2-7928-4476-bc88-b6fc350509e8 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:53.432892 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d13725f2-7928-4476-bc88-b6fc350509e8 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:53.434101 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d13725f2-7928-4476-bc88-b6fc350509e8 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:53.531487 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-d13725f2-7928-4476-bc88-b6fc350509e8 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9cd61a0df164a9e9197022508adafbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acc59093f954b61ba9f3cd05e940c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:53.540040 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-d13725f2-7928-4476-bc88-b6fc350509e8 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9cd61a0df164a9e9197022508adafbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acc59093f954b61ba9f3cd05e940c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:53.541339 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-d13725f2-7928-4476-bc88-b6fc350509e8 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9cd61a0df164a9e9197022508adafbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acc59093f954b61ba9f3cd05e940c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:53.543076 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-d13725f2-7928-4476-bc88-b6fc350509e8 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] 10.222.0.26 "GET /compute/v2.1/servers/b1983b4c-4fd2-4ec8-9fb0-aa1f7fa51219" status: 200 len: 1409 microversion: 2.54 time: 0.127928 Oct 08 21:07:53.543675 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1925/3768] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:07:53 2022] GET /compute/v2.1/servers/b1983b4c-4fd2-4ec8-9fb0-aa1f7fa51219 => generated 1409 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:07:53.764726 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-8971798a-0813-416d-a3b9-c80b268cac48 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:53.766017 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-8971798a-0813-416d-a3b9-c80b268cac48 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: f182bee3-f292-4f22-b9a0-93228e1a5049] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:07:53.774076 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8971798a-0813-416d-a3b9-c80b268cac48 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:53.774582 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8971798a-0813-416d-a3b9-c80b268cac48 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:53.775032 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8971798a-0813-416d-a3b9-c80b268cac48 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:53.775758 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8971798a-0813-416d-a3b9-c80b268cac48 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:53.776223 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8971798a-0813-416d-a3b9-c80b268cac48 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:53.776663 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8971798a-0813-416d-a3b9-c80b268cac48 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:53.874935 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-25365113-3db7-4bee-891a-c33ecd144683 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Calling method '.version_select at 0x7f1a8c7f8670>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:53.925459 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-25365113-3db7-4bee-891a-c33ecd144683 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "GET /compute/v2.1/images/fa798238-0b05-4e9a-a4b3-2d47579804f6" status: 200 len: 1412 microversion: 2.1 time: 0.055002 Oct 08 21:07:53.926532 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1926/3769] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:07:53 2022] GET /compute/v2.1/images/fa798238-0b05-4e9a-a4b3-2d47579804f6 => generated 1412 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:07:54.036023 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-8971798a-0813-416d-a3b9-c80b268cac48 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06443b5728fb4d1e95d6245820e786bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ded993145b4eda9d6a33b994519012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:54.058042 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-8971798a-0813-416d-a3b9-c80b268cac48 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "GET /compute/v2.1/servers/f182bee3-f292-4f22-b9a0-93228e1a5049" status: 200 len: 1309 microversion: 2.1 time: 0.298167 Oct 08 21:07:54.059133 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1844/3770] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:07:53 2022] GET /compute/v2.1/servers/f182bee3-f292-4f22-b9a0-93228e1a5049 => generated 1309 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:07:54.093295 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-2b563363-67ee-4aaf-879c-a18af7e8e425 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:54.094457 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-2b563363-67ee-4aaf-879c-a18af7e8e425 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: 318ee24a-a78a-4b3b-b18b-64f5c5c3109a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:07:54.103961 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2b563363-67ee-4aaf-879c-a18af7e8e425 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:54.104759 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2b563363-67ee-4aaf-879c-a18af7e8e425 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:54.105677 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2b563363-67ee-4aaf-879c-a18af7e8e425 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:54.106965 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2b563363-67ee-4aaf-879c-a18af7e8e425 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:54.107521 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2b563363-67ee-4aaf-879c-a18af7e8e425 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:54.108430 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2b563363-67ee-4aaf-879c-a18af7e8e425 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:54.352893 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-2b563363-67ee-4aaf-879c-a18af7e8e425 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78e9afd772c4de981cac8f5817ec356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765c62cac2ee4406b23a5baa85c52ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:54.362628 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-2b563363-67ee-4aaf-879c-a18af7e8e425 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/318ee24a-a78a-4b3b-b18b-64f5c5c3109a" status: 200 len: 1508 microversion: 2.1 time: 0.273957 Oct 08 21:07:54.364344 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1927/3771] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:07:54 2022] GET /compute/v2.1/servers/318ee24a-a78a-4b3b-b18b-64f5c5c3109a => generated 1508 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:07:54.570623 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-580f38b1-6341-4bbb-9707-d2b466a887a0 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:54.571335 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-580f38b1-6341-4bbb-9707-d2b466a887a0 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] [instance: b1983b4c-4fd2-4ec8-9fb0-aa1f7fa51219] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:07:54.578116 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-580f38b1-6341-4bbb-9707-d2b466a887a0 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:54.578621 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-580f38b1-6341-4bbb-9707-d2b466a887a0 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:54.579067 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-580f38b1-6341-4bbb-9707-d2b466a887a0 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:54.579779 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-580f38b1-6341-4bbb-9707-d2b466a887a0 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:54.580248 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-580f38b1-6341-4bbb-9707-d2b466a887a0 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:54.580686 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-580f38b1-6341-4bbb-9707-d2b466a887a0 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:54.684118 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-580f38b1-6341-4bbb-9707-d2b466a887a0 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9cd61a0df164a9e9197022508adafbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acc59093f954b61ba9f3cd05e940c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:54.692954 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-580f38b1-6341-4bbb-9707-d2b466a887a0 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9cd61a0df164a9e9197022508adafbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acc59093f954b61ba9f3cd05e940c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:54.694528 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-580f38b1-6341-4bbb-9707-d2b466a887a0 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9cd61a0df164a9e9197022508adafbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acc59093f954b61ba9f3cd05e940c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:54.696014 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-580f38b1-6341-4bbb-9707-d2b466a887a0 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] 10.222.0.26 "GET /compute/v2.1/servers/b1983b4c-4fd2-4ec8-9fb0-aa1f7fa51219" status: 200 len: 1409 microversion: 2.54 time: 0.129313 Oct 08 21:07:54.696542 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1845/3772] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:07:54 2022] GET /compute/v2.1/servers/b1983b4c-4fd2-4ec8-9fb0-aa1f7fa51219 => generated 1409 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:07:54.941474 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-c7a07457-3404-4012-a445-4be6120bf068 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Calling method '.version_select at 0x7f1a87e2fdc0>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:54.986968 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-c7a07457-3404-4012-a445-4be6120bf068 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "GET /compute/v2.1/images/fa798238-0b05-4e9a-a4b3-2d47579804f6" status: 200 len: 1412 microversion: 2.1 time: 0.049408 Oct 08 21:07:54.995095 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1928/3773] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:07:54 2022] GET /compute/v2.1/images/fa798238-0b05-4e9a-a4b3-2d47579804f6 => generated 1412 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:07:55.083787 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-55b18d5c-d61f-4d08-84a1-ac6c867429ce tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:55.085395 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-55b18d5c-d61f-4d08-84a1-ac6c867429ce tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: f182bee3-f292-4f22-b9a0-93228e1a5049] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:07:55.095959 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-55b18d5c-d61f-4d08-84a1-ac6c867429ce tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:55.096904 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-55b18d5c-d61f-4d08-84a1-ac6c867429ce tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:55.097749 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-55b18d5c-d61f-4d08-84a1-ac6c867429ce tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:55.098737 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-55b18d5c-d61f-4d08-84a1-ac6c867429ce tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:55.099429 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-55b18d5c-d61f-4d08-84a1-ac6c867429ce tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:55.100503 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-55b18d5c-d61f-4d08-84a1-ac6c867429ce tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:55.144782 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-e6d08028-c18f-4f2a-b384-f5fa34476a7e req-099956a3-f20b-49c7-826c-04495d82c8e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "318ee24a-a78a-4b3b-b18b-64f5c5c3109a", "name": "network-vif-deleted", "tag": "4120874b-f8cf-4afa-8edb-c279d3fa86ae"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:07:55.188636 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-e6d08028-c18f-4f2a-b384-f5fa34476a7e req-099956a3-f20b-49c7-826c-04495d82c8e0 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:55.189461 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-e6d08028-c18f-4f2a-b384-f5fa34476a7e req-099956a3-f20b-49c7-826c-04495d82c8e0 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:55.190397 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-e6d08028-c18f-4f2a-b384-f5fa34476a7e req-099956a3-f20b-49c7-826c-04495d82c8e0 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:55.215329 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-e6d08028-c18f-4f2a-b384-f5fa34476a7e req-099956a3-f20b-49c7-826c-04495d82c8e0 service nova] Creating event network-vif-deleted:4120874b-f8cf-4afa-8edb-c279d3fa86ae for instance 318ee24a-a78a-4b3b-b18b-64f5c5c3109a on nch1-master-1 Oct 08 21:07:55.227900 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-e6d08028-c18f-4f2a-b384-f5fa34476a7e req-099956a3-f20b-49c7-826c-04495d82c8e0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092176 Oct 08 21:07:55.229235 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1929/3774] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:07:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:07:55.400427 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-3a5f3613-535c-4363-98d0-06ed21296adb tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:55.404592 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-3a5f3613-535c-4363-98d0-06ed21296adb tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: 318ee24a-a78a-4b3b-b18b-64f5c5c3109a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:07:55.415530 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3a5f3613-535c-4363-98d0-06ed21296adb tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:55.416302 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3a5f3613-535c-4363-98d0-06ed21296adb tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:55.417002 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3a5f3613-535c-4363-98d0-06ed21296adb tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:55.418231 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3a5f3613-535c-4363-98d0-06ed21296adb tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:55.418790 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3a5f3613-535c-4363-98d0-06ed21296adb tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:55.419503 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3a5f3613-535c-4363-98d0-06ed21296adb tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:55.470519 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-55b18d5c-d61f-4d08-84a1-ac6c867429ce tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06443b5728fb4d1e95d6245820e786bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ded993145b4eda9d6a33b994519012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:55.472512 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3a5f3613-535c-4363-98d0-06ed21296adb tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:55.473108 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3a5f3613-535c-4363-98d0-06ed21296adb tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:55.480281 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3a5f3613-535c-4363-98d0-06ed21296adb tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:55.480975 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.objects.instance [None req-3a5f3613-535c-4363-98d0-06ed21296adb tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lazy-loading 'fault' on Instance uuid 318ee24a-a78a-4b3b-b18b-64f5c5c3109a {{(pid=140492) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 21:07:55.499063 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-55b18d5c-d61f-4d08-84a1-ac6c867429ce tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "GET /compute/v2.1/servers/f182bee3-f292-4f22-b9a0-93228e1a5049" status: 200 len: 1309 microversion: 2.1 time: 0.420740 Oct 08 21:07:55.500415 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1846/3775] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:07:55 2022] GET /compute/v2.1/servers/f182bee3-f292-4f22-b9a0-93228e1a5049 => generated 1309 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:07:55.551883 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-3a5f3613-535c-4363-98d0-06ed21296adb tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78e9afd772c4de981cac8f5817ec356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765c62cac2ee4406b23a5baa85c52ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:55.562487 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-3a5f3613-535c-4363-98d0-06ed21296adb tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/318ee24a-a78a-4b3b-b18b-64f5c5c3109a" status: 200 len: 1305 microversion: 2.1 time: 0.176413 Oct 08 21:07:55.563640 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1930/3776] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:07:55 2022] GET /compute/v2.1/servers/318ee24a-a78a-4b3b-b18b-64f5c5c3109a => generated 1305 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:07:55.723163 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-20eaeb32-3889-45d8-b142-c754636fc7a5 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:55.724138 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-20eaeb32-3889-45d8-b142-c754636fc7a5 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] [instance: b1983b4c-4fd2-4ec8-9fb0-aa1f7fa51219] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:07:55.736003 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-20eaeb32-3889-45d8-b142-c754636fc7a5 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:55.736757 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-20eaeb32-3889-45d8-b142-c754636fc7a5 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:55.737533 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-20eaeb32-3889-45d8-b142-c754636fc7a5 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:55.738989 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-20eaeb32-3889-45d8-b142-c754636fc7a5 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:55.739464 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-20eaeb32-3889-45d8-b142-c754636fc7a5 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:55.739907 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-20eaeb32-3889-45d8-b142-c754636fc7a5 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:55.815456 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-20eaeb32-3889-45d8-b142-c754636fc7a5 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9cd61a0df164a9e9197022508adafbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acc59093f954b61ba9f3cd05e940c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:55.826670 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-20eaeb32-3889-45d8-b142-c754636fc7a5 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9cd61a0df164a9e9197022508adafbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acc59093f954b61ba9f3cd05e940c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:55.829301 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-20eaeb32-3889-45d8-b142-c754636fc7a5 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9cd61a0df164a9e9197022508adafbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acc59093f954b61ba9f3cd05e940c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:55.830827 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-20eaeb32-3889-45d8-b142-c754636fc7a5 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] 10.222.0.26 "GET /compute/v2.1/servers/b1983b4c-4fd2-4ec8-9fb0-aa1f7fa51219" status: 200 len: 1409 microversion: 2.54 time: 0.111914 Oct 08 21:07:55.831583 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1847/3777] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:07:55 2022] GET /compute/v2.1/servers/b1983b4c-4fd2-4ec8-9fb0-aa1f7fa51219 => generated 1409 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:07:56.003146 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-41b91712-0883-4a75-996b-fd4a529e649c tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Calling method '.version_select at 0x7f1a87cb6820>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:56.062455 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-41b91712-0883-4a75-996b-fd4a529e649c tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "GET /compute/v2.1/images/fa798238-0b05-4e9a-a4b3-2d47579804f6" status: 200 len: 1412 microversion: 2.1 time: 0.063469 Oct 08 21:07:56.071806 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1931/3778] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:07:55 2022] GET /compute/v2.1/images/fa798238-0b05-4e9a-a4b3-2d47579804f6 => generated 1412 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:07:56.525675 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c95c461c-b7f0-4b8e-81d0-4e7d3c3ecc94 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:56.526517 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-c95c461c-b7f0-4b8e-81d0-4e7d3c3ecc94 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: f182bee3-f292-4f22-b9a0-93228e1a5049] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:07:56.534347 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c95c461c-b7f0-4b8e-81d0-4e7d3c3ecc94 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:56.534955 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c95c461c-b7f0-4b8e-81d0-4e7d3c3ecc94 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:56.535662 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c95c461c-b7f0-4b8e-81d0-4e7d3c3ecc94 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:56.536458 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c95c461c-b7f0-4b8e-81d0-4e7d3c3ecc94 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:56.537144 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c95c461c-b7f0-4b8e-81d0-4e7d3c3ecc94 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:56.537674 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c95c461c-b7f0-4b8e-81d0-4e7d3c3ecc94 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:56.587714 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-75cc2dba-ec53-4407-9a98-fe7138c1aef4 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:56.588643 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-75cc2dba-ec53-4407-9a98-fe7138c1aef4 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: 318ee24a-a78a-4b3b-b18b-64f5c5c3109a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:07:56.596752 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-75cc2dba-ec53-4407-9a98-fe7138c1aef4 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:56.597604 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-75cc2dba-ec53-4407-9a98-fe7138c1aef4 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:56.598243 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-75cc2dba-ec53-4407-9a98-fe7138c1aef4 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:56.600502 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-75cc2dba-ec53-4407-9a98-fe7138c1aef4 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:56.601173 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-75cc2dba-ec53-4407-9a98-fe7138c1aef4 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:56.601807 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-75cc2dba-ec53-4407-9a98-fe7138c1aef4 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:56.630121 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-75cc2dba-ec53-4407-9a98-fe7138c1aef4 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] HTTP exception thrown: Instance 318ee24a-a78a-4b3b-b18b-64f5c5c3109a could not be found. Oct 08 21:07:56.631250 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-75cc2dba-ec53-4407-9a98-fe7138c1aef4 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Request method failure captured: Oct 08 21:07:56.631250 ncdv-master-1 devstack@n-api.service[140492]: request: GET /compute/v2.1/servers/318ee24a-a78a-4b3b-b18b-64f5c5c3109a HTTP/1.1 Oct 08 21:07:56.631250 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:07:56.631250 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:07:56.631250 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:07:56.631250 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 21:07:56.631250 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:07:56.631250 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:07:56.631250 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:07:56.631250 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:07:56.631250 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeaY45CCffIT40Amc9wEG1L3srTtCd58z19KxF0fYIwNPulOEB6B0U5KbwvP4xZlDymYa3r7NupuSBl7IoxTUgzZohPJnXbaXnL_FvPvzvmymW0IMjU5l88HUbi73sOE2TxCcEBd6artojZxtGFF9N7yzN3dTHpujcvoWiRD4lXAI28 Oct 08 21:07:56.631250 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:07:56.631250 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:07:56.631250 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:07:56.631250 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:07:56.631250 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:07:56.631250 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:07:56.631250 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 765c62cac2ee4406b23a5baa85c52ff7 Oct 08 21:07:56.631250 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-DeleteServersTestJSON-1423663413 Oct 08 21:07:56.631250 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:07:56.631250 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:07:56.631250 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/765c62cac2ee4406b23a5baa85c52ff7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/765c62cac2ee4406b23a5baa85c52ff7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_765c62cac2ee4406b23a5baa85c52ff7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/765c62cac2ee4406b23a5baa85c52ff7"}]}] Oct 08 21:07:56.631250 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-DeleteServersTestJSON-1423663413 Oct 08 21:07:56.631250 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 765c62cac2ee4406b23a5baa85c52ff7 Oct 08 21:07:56.631250 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-DeleteServersTestJSON-1423663413 Oct 08 21:07:56.631250 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-DeleteServersTestJSON-1423663413-project Oct 08 21:07:56.631250 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:07:56.631250 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:07:56.631250 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: d78e9afd772c4de981cac8f5817ec356 Oct 08 21:07:56.631250 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-DeleteServersTestJSON-1423663413-project Oct 08 21:07:56.631250 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 21:07:56.631250 ncdv-master-1 devstack@n-api.service[140492]: exception: Instance 318ee24a-a78a-4b3b-b18b-64f5c5c3109a could not be found. Oct 08 21:07:56.631250 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': '318ee24a-a78a-4b3b-b18b-64f5c5c3109a'} Oct 08 21:07:56.631250 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:07:56.631250 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:07:56.631250 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:07:56.631250 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:07:56.631250 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:07:56.631250 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:07:56.631250 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:07:56.631250 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:07:56.631250 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:07:56.631250 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:07:56.631250 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 318ee24a-a78a-4b3b-b18b-64f5c5c3109a could not be found. Oct 08 21:07:56.631250 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:07:56.631250 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:07:56.631250 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:07:56.631250 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:07:56.631250 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:07:56.631250 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:07:56.631250 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:07:56.631250 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:07:56.631250 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:07:56.631250 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:07:56.631250 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:07:56.631250 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:07:56.631250 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:07:56.631250 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:07:56.631250 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:07:56.631250 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:07:56.631250 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 318ee24a-a78a-4b3b-b18b-64f5c5c3109a could not be found. Oct 08 21:07:56.631250 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:07:56.631250 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:07:56.631250 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:07:56.637862 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:07:56.637862 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:07:56.637862 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:07:56.637862 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:07:56.637862 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:07:56.637862 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 318ee24a-a78a-4b3b-b18b-64f5c5c3109a could not be found. Oct 08 21:07:56.637862 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:07:56.641731 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-75cc2dba-ec53-4407-9a98-fe7138c1aef4 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Returning 404 to user: Instance 318ee24a-a78a-4b3b-b18b-64f5c5c3109a could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:07:56.650548 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-75cc2dba-ec53-4407-9a98-fe7138c1aef4 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/318ee24a-a78a-4b3b-b18b-64f5c5c3109a" status: 404 len: 111 microversion: 2.1 time: 0.066854 Oct 08 21:07:56.652992 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1932/3779] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:07:56 2022] GET /compute/v2.1/servers/318ee24a-a78a-4b3b-b18b-64f5c5c3109a => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:07:56.728462 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-c95c461c-b7f0-4b8e-81d0-4e7d3c3ecc94 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06443b5728fb4d1e95d6245820e786bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ded993145b4eda9d6a33b994519012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:56.751693 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-c95c461c-b7f0-4b8e-81d0-4e7d3c3ecc94 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "GET /compute/v2.1/servers/f182bee3-f292-4f22-b9a0-93228e1a5049" status: 200 len: 1309 microversion: 2.1 time: 0.222995 Oct 08 21:07:56.752979 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1848/3780] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:07:56 2022] GET /compute/v2.1/servers/f182bee3-f292-4f22-b9a0-93228e1a5049 => generated 1309 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:07:56.807747 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-0d3b1590-3e5d-48f1-b3bb-ec9377f28f26 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1990155062", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "networks": [{"uuid": "82d56471-f1e9-4dc0-935a-29f2f2d2c7c0"}]}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:07:56.865112 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-7f2533eb-124c-4291-83d4-4e0f953f1d25 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:56.865913 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-7f2533eb-124c-4291-83d4-4e0f953f1d25 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] [instance: b1983b4c-4fd2-4ec8-9fb0-aa1f7fa51219] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:07:56.877832 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.network.neutron [None req-0d3b1590-3e5d-48f1-b3bb-ec9377f28f26 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] validate_networks() for [('82d56471-f1e9-4dc0-935a-29f2f2d2c7c0', None, None, None, None, None)] {{(pid=140492) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 21:07:56.878438 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7f2533eb-124c-4291-83d4-4e0f953f1d25 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:56.879018 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7f2533eb-124c-4291-83d4-4e0f953f1d25 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:56.879710 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7f2533eb-124c-4291-83d4-4e0f953f1d25 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:56.880650 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7f2533eb-124c-4291-83d4-4e0f953f1d25 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:56.881355 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7f2533eb-124c-4291-83d4-4e0f953f1d25 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:56.883043 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7f2533eb-124c-4291-83d4-4e0f953f1d25 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:56.977592 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-7f2533eb-124c-4291-83d4-4e0f953f1d25 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9cd61a0df164a9e9197022508adafbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acc59093f954b61ba9f3cd05e940c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:56.981465 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:07:56.988736 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-7f2533eb-124c-4291-83d4-4e0f953f1d25 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9cd61a0df164a9e9197022508adafbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acc59093f954b61ba9f3cd05e940c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:56.990388 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-7f2533eb-124c-4291-83d4-4e0f953f1d25 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9cd61a0df164a9e9197022508adafbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acc59093f954b61ba9f3cd05e940c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:56.991602 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-7f2533eb-124c-4291-83d4-4e0f953f1d25 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] 10.222.0.26 "GET /compute/v2.1/servers/b1983b4c-4fd2-4ec8-9fb0-aa1f7fa51219" status: 200 len: 1409 microversion: 2.54 time: 0.132910 Oct 08 21:07:56.992498 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1849/3781] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:07:56 2022] GET /compute/v2.1/servers/b1983b4c-4fd2-4ec8-9fb0-aa1f7fa51219 => generated 1409 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:07:57.078978 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-241a66af-8471-4e40-92df-ad0dd02d1165 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Calling method '.version_select at 0x7f1a8c638a60>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:57.156545 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-241a66af-8471-4e40-92df-ad0dd02d1165 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "GET /compute/v2.1/images/fa798238-0b05-4e9a-a4b3-2d47579804f6" status: 200 len: 1412 microversion: 2.1 time: 0.082262 Oct 08 21:07:57.157165 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1850/3782] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:07:57 2022] GET /compute/v2.1/images/fa798238-0b05-4e9a-a4b3-2d47579804f6 => generated 1412 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:07:57.659718 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=2 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:07:57.776563 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=6 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:07:57.778434 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=26 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:07:57.794919 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-b738702c-80d9-4f64-98b7-1d0fff21bbe2 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:57.804372 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-b738702c-80d9-4f64-98b7-1d0fff21bbe2 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: f182bee3-f292-4f22-b9a0-93228e1a5049] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:07:57.827858 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b738702c-80d9-4f64-98b7-1d0fff21bbe2 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:57.829028 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b738702c-80d9-4f64-98b7-1d0fff21bbe2 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:57.829701 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b738702c-80d9-4f64-98b7-1d0fff21bbe2 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:57.830651 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b738702c-80d9-4f64-98b7-1d0fff21bbe2 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:57.831822 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b738702c-80d9-4f64-98b7-1d0fff21bbe2 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:57.832424 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b738702c-80d9-4f64-98b7-1d0fff21bbe2 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:57.857319 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-0d3b1590-3e5d-48f1-b3bb-ec9377f28f26 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Flavor limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 21:07:57.857990 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-0d3b1590-3e5d-48f1-b3bb-ec9377f28f26 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Image limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 21:07:57.858644 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-0d3b1590-3e5d-48f1-b3bb-ec9377f28f26 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Flavor pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 21:07:57.859243 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-0d3b1590-3e5d-48f1-b3bb-ec9377f28f26 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Image pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 21:07:57.860267 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-0d3b1590-3e5d-48f1-b3bb-ec9377f28f26 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 21:07:57.881710 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0d3b1590-3e5d-48f1-b3bb-ec9377f28f26 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:57.882474 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0d3b1590-3e5d-48f1-b3bb-ec9377f28f26 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:57.889854 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0d3b1590-3e5d-48f1-b3bb-ec9377f28f26 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:57.892122 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0d3b1590-3e5d-48f1-b3bb-ec9377f28f26 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:57.892778 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0d3b1590-3e5d-48f1-b3bb-ec9377f28f26 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:57.893427 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0d3b1590-3e5d-48f1-b3bb-ec9377f28f26 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:57.962486 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-0d3b1590-3e5d-48f1-b3bb-ec9377f28f26 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Getting quotas for project 765c62cac2ee4406b23a5baa85c52ff7. Resources: {'cores', 'instances', 'ram'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:07:57.981289 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-0d3b1590-3e5d-48f1-b3bb-ec9377f28f26 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Getting quotas for user d78e9afd772c4de981cac8f5817ec356 and project 765c62cac2ee4406b23a5baa85c52ff7. Resources: {'cores', 'instances', 'ram'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:07:58.037235 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-0d3b1590-3e5d-48f1-b3bb-ec9377f28f26 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Going to run 1 instances... {{(pid=140492) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 21:07:58.046272 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-0d3b1590-3e5d-48f1-b3bb-ec9377f28f26 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: 911394e0-0af3-4433-acfb-a4652d4e2e84] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c508bd7f-7db9-4b2c-af7c-be54a855c355',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140492) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 21:07:58.163429 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-b738702c-80d9-4f64-98b7-1d0fff21bbe2 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06443b5728fb4d1e95d6245820e786bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ded993145b4eda9d6a33b994519012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:58.178501 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-b738702c-80d9-4f64-98b7-1d0fff21bbe2 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "GET /compute/v2.1/servers/f182bee3-f292-4f22-b9a0-93228e1a5049" status: 200 len: 1309 microversion: 2.1 time: 0.402334 Oct 08 21:07:58.183348 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1851/3783] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:07:57 2022] GET /compute/v2.1/servers/f182bee3-f292-4f22-b9a0-93228e1a5049 => generated 1309 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:07:58.194541 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-0d3b1590-3e5d-48f1-b3bb-ec9377f28f26 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.399171 Oct 08 21:07:58.195831 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-4e0d64b3-25bb-46b2-aa1c-37711a6b4527 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:58.204251 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1933/3784] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 21:07:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 1409 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 08 21:07:58.206142 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-4e0d64b3-25bb-46b2-aa1c-37711a6b4527 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] [instance: b1983b4c-4fd2-4ec8-9fb0-aa1f7fa51219] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:07:58.223307 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-97763559-2776-41c0-a583-99a3ff8063dc tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Calling method '.version_select at 0x7f1a87cc25e0>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:58.227622 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4e0d64b3-25bb-46b2-aa1c-37711a6b4527 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:58.228683 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4e0d64b3-25bb-46b2-aa1c-37711a6b4527 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:58.229767 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4e0d64b3-25bb-46b2-aa1c-37711a6b4527 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:58.233755 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4e0d64b3-25bb-46b2-aa1c-37711a6b4527 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:58.235578 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4e0d64b3-25bb-46b2-aa1c-37711a6b4527 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:58.237123 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4e0d64b3-25bb-46b2-aa1c-37711a6b4527 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:58.326221 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-97763559-2776-41c0-a583-99a3ff8063dc tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "GET /compute/v2.1/images/fa798238-0b05-4e9a-a4b3-2d47579804f6" status: 200 len: 1412 microversion: 2.1 time: 0.117218 Oct 08 21:07:58.339005 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1934/3785] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:07:58 2022] GET /compute/v2.1/images/fa798238-0b05-4e9a-a4b3-2d47579804f6 => generated 1412 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:07:58.351720 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-82582775-a612-421b-9fd4-c46173e5868f tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:58.358398 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-82582775-a612-421b-9fd4-c46173e5868f tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: 911394e0-0af3-4433-acfb-a4652d4e2e84] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:07:58.552937 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-4e0d64b3-25bb-46b2-aa1c-37711a6b4527 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9cd61a0df164a9e9197022508adafbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acc59093f954b61ba9f3cd05e940c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:58.567267 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-4e0d64b3-25bb-46b2-aa1c-37711a6b4527 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9cd61a0df164a9e9197022508adafbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acc59093f954b61ba9f3cd05e940c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:58.573000 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-4e0d64b3-25bb-46b2-aa1c-37711a6b4527 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9cd61a0df164a9e9197022508adafbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acc59093f954b61ba9f3cd05e940c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:58.575373 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-4e0d64b3-25bb-46b2-aa1c-37711a6b4527 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] 10.222.0.26 "GET /compute/v2.1/servers/b1983b4c-4fd2-4ec8-9fb0-aa1f7fa51219" status: 200 len: 1409 microversion: 2.54 time: 0.390427 Oct 08 21:07:58.576255 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1852/3786] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:07:58 2022] GET /compute/v2.1/servers/b1983b4c-4fd2-4ec8-9fb0-aa1f7fa51219 => generated 1409 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:07:58.716606 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-82582775-a612-421b-9fd4-c46173e5868f tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78e9afd772c4de981cac8f5817ec356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765c62cac2ee4406b23a5baa85c52ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:58.728579 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-82582775-a612-421b-9fd4-c46173e5868f tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/911394e0-0af3-4433-acfb-a4652d4e2e84" status: 200 len: 1215 microversion: 2.1 time: 0.393060 Oct 08 21:07:58.748648 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1935/3787] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:07:58 2022] GET /compute/v2.1/servers/911394e0-0af3-4433-acfb-a4652d4e2e84 => generated 1215 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:07:59.213655 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-088d2d22-403b-414b-b1ee-496bea3e49a7 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:59.214895 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-088d2d22-403b-414b-b1ee-496bea3e49a7 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: f182bee3-f292-4f22-b9a0-93228e1a5049] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:07:59.235067 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-088d2d22-403b-414b-b1ee-496bea3e49a7 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:59.235609 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-088d2d22-403b-414b-b1ee-496bea3e49a7 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:59.237378 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-088d2d22-403b-414b-b1ee-496bea3e49a7 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:59.238939 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-088d2d22-403b-414b-b1ee-496bea3e49a7 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:59.239585 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-088d2d22-403b-414b-b1ee-496bea3e49a7 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:59.240322 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-088d2d22-403b-414b-b1ee-496bea3e49a7 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:59.351956 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-b06b3a3c-3060-40c3-a76d-d3def041b97d tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Calling method '.version_select at 0x7f1a8c062e50>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:59.493944 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-b06b3a3c-3060-40c3-a76d-d3def041b97d tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "GET /compute/v2.1/images/fa798238-0b05-4e9a-a4b3-2d47579804f6" status: 200 len: 1412 microversion: 2.1 time: 0.129464 Oct 08 21:07:59.496834 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1936/3788] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:07:59 2022] GET /compute/v2.1/images/fa798238-0b05-4e9a-a4b3-2d47579804f6 => generated 1412 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:07:59.557884 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-088d2d22-403b-414b-b1ee-496bea3e49a7 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06443b5728fb4d1e95d6245820e786bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ded993145b4eda9d6a33b994519012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:59.579971 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-088d2d22-403b-414b-b1ee-496bea3e49a7 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "GET /compute/v2.1/servers/f182bee3-f292-4f22-b9a0-93228e1a5049" status: 200 len: 1309 microversion: 2.1 time: 0.363568 Oct 08 21:07:59.593378 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1853/3789] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:07:59 2022] GET /compute/v2.1/servers/f182bee3-f292-4f22-b9a0-93228e1a5049 => generated 1309 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:07:59.605605 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-5d9b2339-c754-4228-af95-928709ab480f tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:59.607397 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-5d9b2339-c754-4228-af95-928709ab480f tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] [instance: b1983b4c-4fd2-4ec8-9fb0-aa1f7fa51219] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:07:59.626871 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5d9b2339-c754-4228-af95-928709ab480f tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:59.628018 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5d9b2339-c754-4228-af95-928709ab480f tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:59.628855 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5d9b2339-c754-4228-af95-928709ab480f tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:59.629978 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5d9b2339-c754-4228-af95-928709ab480f tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:59.631911 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5d9b2339-c754-4228-af95-928709ab480f tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:59.632687 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5d9b2339-c754-4228-af95-928709ab480f tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:59.760078 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-8bce587d-a4df-45f9-bb86-5de760e5379a tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:07:59.761861 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-8bce587d-a4df-45f9-bb86-5de760e5379a tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: 911394e0-0af3-4433-acfb-a4652d4e2e84] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:07:59.785545 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8bce587d-a4df-45f9-bb86-5de760e5379a tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:59.786597 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8bce587d-a4df-45f9-bb86-5de760e5379a tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:59.788137 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8bce587d-a4df-45f9-bb86-5de760e5379a tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:59.789641 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8bce587d-a4df-45f9-bb86-5de760e5379a tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:07:59.790759 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8bce587d-a4df-45f9-bb86-5de760e5379a tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:07:59.791654 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8bce587d-a4df-45f9-bb86-5de760e5379a tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:07:59.941324 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-8bce587d-a4df-45f9-bb86-5de760e5379a tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78e9afd772c4de981cac8f5817ec356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765c62cac2ee4406b23a5baa85c52ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:59.955341 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-8bce587d-a4df-45f9-bb86-5de760e5379a tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/911394e0-0af3-4433-acfb-a4652d4e2e84" status: 200 len: 1267 microversion: 2.1 time: 0.201423 Oct 08 21:07:59.966638 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1854/3790] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:07:59 2022] GET /compute/v2.1/servers/911394e0-0af3-4433-acfb-a4652d4e2e84 => generated 1267 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:07:59.984626 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-5d9b2339-c754-4228-af95-928709ab480f tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9cd61a0df164a9e9197022508adafbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acc59093f954b61ba9f3cd05e940c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:07:59.998410 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-5d9b2339-c754-4228-af95-928709ab480f tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9cd61a0df164a9e9197022508adafbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acc59093f954b61ba9f3cd05e940c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:00.001551 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-5d9b2339-c754-4228-af95-928709ab480f tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9cd61a0df164a9e9197022508adafbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acc59093f954b61ba9f3cd05e940c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:00.003231 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-5d9b2339-c754-4228-af95-928709ab480f tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] 10.222.0.26 "GET /compute/v2.1/servers/b1983b4c-4fd2-4ec8-9fb0-aa1f7fa51219" status: 200 len: 1409 microversion: 2.54 time: 0.402879 Oct 08 21:08:00.004746 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1937/3791] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:07:59 2022] GET /compute/v2.1/servers/b1983b4c-4fd2-4ec8-9fb0-aa1f7fa51219 => generated 1409 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:08:00.514945 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-22eb78ea-001c-4d84-b4ca-42876c49f193 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Calling method '.version_select at 0x7f1a914c94c0>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:00.607578 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-021e200d-c191-4297-83cd-09414d3197d0 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:00.609504 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-021e200d-c191-4297-83cd-09414d3197d0 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: f182bee3-f292-4f22-b9a0-93228e1a5049] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:00.620174 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-021e200d-c191-4297-83cd-09414d3197d0 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:00.629569 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-021e200d-c191-4297-83cd-09414d3197d0 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:00.632219 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-021e200d-c191-4297-83cd-09414d3197d0 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:00.635763 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-021e200d-c191-4297-83cd-09414d3197d0 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:00.639567 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-021e200d-c191-4297-83cd-09414d3197d0 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:00.640521 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-021e200d-c191-4297-83cd-09414d3197d0 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:00.891849 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-22eb78ea-001c-4d84-b4ca-42876c49f193 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "GET /compute/v2.1/images/fa798238-0b05-4e9a-a4b3-2d47579804f6" status: 200 len: 1412 microversion: 2.1 time: 0.382647 Oct 08 21:08:00.893316 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1855/3792] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:08:00 2022] GET /compute/v2.1/images/fa798238-0b05-4e9a-a4b3-2d47579804f6 => generated 1412 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:08:00.984013 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-89c5b54c-0e30-4520-a8a9-d75b1ad1a5af tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:00.985069 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-89c5b54c-0e30-4520-a8a9-d75b1ad1a5af tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: 911394e0-0af3-4433-acfb-a4652d4e2e84] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:01.003351 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-89c5b54c-0e30-4520-a8a9-d75b1ad1a5af tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:01.004054 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-89c5b54c-0e30-4520-a8a9-d75b1ad1a5af tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:01.004605 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-89c5b54c-0e30-4520-a8a9-d75b1ad1a5af tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:01.006807 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-89c5b54c-0e30-4520-a8a9-d75b1ad1a5af tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:01.008048 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-89c5b54c-0e30-4520-a8a9-d75b1ad1a5af tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:01.008606 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-89c5b54c-0e30-4520-a8a9-d75b1ad1a5af tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:01.138194 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-89c5b54c-0e30-4520-a8a9-d75b1ad1a5af tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78e9afd772c4de981cac8f5817ec356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765c62cac2ee4406b23a5baa85c52ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:01.150738 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-89c5b54c-0e30-4520-a8a9-d75b1ad1a5af tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/911394e0-0af3-4433-acfb-a4652d4e2e84" status: 200 len: 1273 microversion: 2.1 time: 0.173303 Oct 08 21:08:01.154953 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1856/3793] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:08:00 2022] GET /compute/v2.1/servers/911394e0-0af3-4433-acfb-a4652d4e2e84 => generated 1273 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:08:01.170019 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-3623a59c-65dd-4508-a36a-061b9e4dbece tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:01.171146 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-3623a59c-65dd-4508-a36a-061b9e4dbece tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] [instance: b1983b4c-4fd2-4ec8-9fb0-aa1f7fa51219] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:01.185515 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3623a59c-65dd-4508-a36a-061b9e4dbece tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:01.186058 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3623a59c-65dd-4508-a36a-061b9e4dbece tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:01.186517 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3623a59c-65dd-4508-a36a-061b9e4dbece tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:01.187271 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3623a59c-65dd-4508-a36a-061b9e4dbece tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:01.187802 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3623a59c-65dd-4508-a36a-061b9e4dbece tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:01.188160 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3623a59c-65dd-4508-a36a-061b9e4dbece tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:01.194166 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-021e200d-c191-4297-83cd-09414d3197d0 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06443b5728fb4d1e95d6245820e786bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ded993145b4eda9d6a33b994519012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:01.205980 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-021e200d-c191-4297-83cd-09414d3197d0 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "GET /compute/v2.1/servers/f182bee3-f292-4f22-b9a0-93228e1a5049" status: 200 len: 1309 microversion: 2.1 time: 0.604751 Oct 08 21:08:01.206621 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1938/3794] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:08:00 2022] GET /compute/v2.1/servers/f182bee3-f292-4f22-b9a0-93228e1a5049 => generated 1309 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:08:01.535906 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-3623a59c-65dd-4508-a36a-061b9e4dbece tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9cd61a0df164a9e9197022508adafbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acc59093f954b61ba9f3cd05e940c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:01.560804 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-3623a59c-65dd-4508-a36a-061b9e4dbece tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9cd61a0df164a9e9197022508adafbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acc59093f954b61ba9f3cd05e940c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:01.563972 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-3623a59c-65dd-4508-a36a-061b9e4dbece tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9cd61a0df164a9e9197022508adafbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acc59093f954b61ba9f3cd05e940c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:01.572284 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-3623a59c-65dd-4508-a36a-061b9e4dbece tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] 10.222.0.26 "GET /compute/v2.1/servers/b1983b4c-4fd2-4ec8-9fb0-aa1f7fa51219" status: 200 len: 1409 microversion: 2.54 time: 0.412533 Oct 08 21:08:01.576900 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1857/3795] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:08:01 2022] GET /compute/v2.1/servers/b1983b4c-4fd2-4ec8-9fb0-aa1f7fa51219 => generated 1409 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:08:01.588726 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-6ebeb8fc-c21d-44bc-9e25-fc9fb1817530 req-19924de3-564c-448f-b65e-f581057d7394 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f182bee3-f292-4f22-b9a0-93228e1a5049", "name": "network-vif-plugged", "status": "completed", "tag": "668c891e-a778-42d8-bc73-e74d3f038e32"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:08:01.607427 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-6ebeb8fc-c21d-44bc-9e25-fc9fb1817530 req-19924de3-564c-448f-b65e-f581057d7394 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:01.607938 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-6ebeb8fc-c21d-44bc-9e25-fc9fb1817530 req-19924de3-564c-448f-b65e-f581057d7394 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:01.608395 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-6ebeb8fc-c21d-44bc-9e25-fc9fb1817530 req-19924de3-564c-448f-b65e-f581057d7394 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:01.630882 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-6ebeb8fc-c21d-44bc-9e25-fc9fb1817530 req-19924de3-564c-448f-b65e-f581057d7394 service nova] Creating event network-vif-plugged:668c891e-a778-42d8-bc73-e74d3f038e32 for instance f182bee3-f292-4f22-b9a0-93228e1a5049 on nch2-master-1 Oct 08 21:08:01.638488 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-6ebeb8fc-c21d-44bc-9e25-fc9fb1817530 req-19924de3-564c-448f-b65e-f581057d7394 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053461 Oct 08 21:08:01.639835 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1939/3796] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:08:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 08 21:08:01.910908 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-452a2c98-5fc1-43ab-b5d4-b6de14e9947c tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Calling method '.version_select at 0x7f1a914d44c0>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:01.999083 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-452a2c98-5fc1-43ab-b5d4-b6de14e9947c tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "GET /compute/v2.1/images/fa798238-0b05-4e9a-a4b3-2d47579804f6" status: 200 len: 1412 microversion: 2.1 time: 0.092836 Oct 08 21:08:02.005394 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1858/3797] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:08:01 2022] GET /compute/v2.1/images/fa798238-0b05-4e9a-a4b3-2d47579804f6 => generated 1412 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:08:02.177138 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-2aaed9ae-dd62-4415-b147-6a666dad0031 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:02.177841 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-2aaed9ae-dd62-4415-b147-6a666dad0031 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: 911394e0-0af3-4433-acfb-a4652d4e2e84] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:02.188314 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2aaed9ae-dd62-4415-b147-6a666dad0031 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:02.194767 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2aaed9ae-dd62-4415-b147-6a666dad0031 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:02.196357 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2aaed9ae-dd62-4415-b147-6a666dad0031 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:02.197392 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2aaed9ae-dd62-4415-b147-6a666dad0031 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:02.198052 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2aaed9ae-dd62-4415-b147-6a666dad0031 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:02.198792 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2aaed9ae-dd62-4415-b147-6a666dad0031 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:02.235958 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-0b42357c-11cb-4f93-8021-a70ec07b1dea tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:02.236895 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-0b42357c-11cb-4f93-8021-a70ec07b1dea tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: f182bee3-f292-4f22-b9a0-93228e1a5049] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:02.252555 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0b42357c-11cb-4f93-8021-a70ec07b1dea tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:02.253144 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0b42357c-11cb-4f93-8021-a70ec07b1dea tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:02.254199 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0b42357c-11cb-4f93-8021-a70ec07b1dea tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:02.257980 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0b42357c-11cb-4f93-8021-a70ec07b1dea tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:02.258523 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0b42357c-11cb-4f93-8021-a70ec07b1dea tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:02.259055 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0b42357c-11cb-4f93-8021-a70ec07b1dea tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:02.676693 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-0b42357c-11cb-4f93-8021-a70ec07b1dea tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06443b5728fb4d1e95d6245820e786bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ded993145b4eda9d6a33b994519012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:02.692148 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-0b42357c-11cb-4f93-8021-a70ec07b1dea tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "GET /compute/v2.1/servers/f182bee3-f292-4f22-b9a0-93228e1a5049" status: 200 len: 1309 microversion: 2.1 time: 0.462718 Oct 08 21:08:02.693809 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1859/3798] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:08:02 2022] GET /compute/v2.1/servers/f182bee3-f292-4f22-b9a0-93228e1a5049 => generated 1309 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:08:02.700026 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-5c94c0f1-db2f-466f-bb9c-1ef50cd3837b tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:02.701594 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-5c94c0f1-db2f-466f-bb9c-1ef50cd3837b tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] [instance: b1983b4c-4fd2-4ec8-9fb0-aa1f7fa51219] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:02.715987 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5c94c0f1-db2f-466f-bb9c-1ef50cd3837b tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:02.716891 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5c94c0f1-db2f-466f-bb9c-1ef50cd3837b tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:02.717638 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5c94c0f1-db2f-466f-bb9c-1ef50cd3837b tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:02.718667 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5c94c0f1-db2f-466f-bb9c-1ef50cd3837b tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:02.719448 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5c94c0f1-db2f-466f-bb9c-1ef50cd3837b tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:02.720150 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5c94c0f1-db2f-466f-bb9c-1ef50cd3837b tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:02.859478 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-5c94c0f1-db2f-466f-bb9c-1ef50cd3837b tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9cd61a0df164a9e9197022508adafbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acc59093f954b61ba9f3cd05e940c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:02.876603 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-5c94c0f1-db2f-466f-bb9c-1ef50cd3837b tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9cd61a0df164a9e9197022508adafbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acc59093f954b61ba9f3cd05e940c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:02.879061 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-5c94c0f1-db2f-466f-bb9c-1ef50cd3837b tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9cd61a0df164a9e9197022508adafbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acc59093f954b61ba9f3cd05e940c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:02.881705 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-5c94c0f1-db2f-466f-bb9c-1ef50cd3837b tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] 10.222.0.26 "GET /compute/v2.1/servers/b1983b4c-4fd2-4ec8-9fb0-aa1f7fa51219" status: 200 len: 1409 microversion: 2.54 time: 0.185827 Oct 08 21:08:02.884946 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1860/3799] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:08:02 2022] GET /compute/v2.1/servers/b1983b4c-4fd2-4ec8-9fb0-aa1f7fa51219 => generated 1409 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:08:03.022276 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-2aaed9ae-dd62-4415-b147-6a666dad0031 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78e9afd772c4de981cac8f5817ec356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765c62cac2ee4406b23a5baa85c52ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:03.026046 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-e0a037d5-7e9a-4d87-8adc-d04dfbae37eb tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Calling method '.version_select at 0x7f1a8c642430>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:03.049215 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-2aaed9ae-dd62-4415-b147-6a666dad0031 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/911394e0-0af3-4433-acfb-a4652d4e2e84" status: 200 len: 1315 microversion: 2.1 time: 0.876751 Oct 08 21:08:03.051030 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1940/3800] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:08:02 2022] GET /compute/v2.1/servers/911394e0-0af3-4433-acfb-a4652d4e2e84 => generated 1315 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:08:03.108135 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-e0a037d5-7e9a-4d87-8adc-d04dfbae37eb tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "GET /compute/v2.1/images/fa798238-0b05-4e9a-a4b3-2d47579804f6" status: 200 len: 1412 microversion: 2.1 time: 0.091896 Oct 08 21:08:03.109796 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1861/3801] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:08:03 2022] GET /compute/v2.1/images/fa798238-0b05-4e9a-a4b3-2d47579804f6 => generated 1412 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:08:03.383047 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-1d6946e8-ce65-4cbc-a9c9-738c46105d9a req-7783eed5-87cf-4cc3-900a-2a2445ba5e13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "911394e0-0af3-4433-acfb-a4652d4e2e84", "tag": "7d57450d-660f-48ba-9c0d-c5b4d23d86db"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:08:03.421999 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-1d6946e8-ce65-4cbc-a9c9-738c46105d9a req-7783eed5-87cf-4cc3-900a-2a2445ba5e13 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:03.422892 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-1d6946e8-ce65-4cbc-a9c9-738c46105d9a req-7783eed5-87cf-4cc3-900a-2a2445ba5e13 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:03.424332 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-1d6946e8-ce65-4cbc-a9c9-738c46105d9a req-7783eed5-87cf-4cc3-900a-2a2445ba5e13 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:03.446400 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:08:03.474169 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-1d6946e8-ce65-4cbc-a9c9-738c46105d9a req-7783eed5-87cf-4cc3-900a-2a2445ba5e13 service nova] Creating event network-changed:7d57450d-660f-48ba-9c0d-c5b4d23d86db for instance 911394e0-0af3-4433-acfb-a4652d4e2e84 on nch1-master-1 Oct 08 21:08:03.484426 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-1d6946e8-ce65-4cbc-a9c9-738c46105d9a req-7783eed5-87cf-4cc3-900a-2a2445ba5e13 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112087 Oct 08 21:08:03.485682 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1941/3802] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:08:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:08:03.683500 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-44ece892-717c-4caa-af08-d462a77b7164 req-83da2714-db77-4c6d-a477-b4b53f1405ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1b4faf3-0c03-4e0c-be81-be3305b8314f", "name": "network-vif-plugged", "status": "completed", "tag": "37642f8c-8e21-43fe-865f-09cc1bd6c431"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:08:03.717605 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-8e54c030-6697-47ca-827d-f197aca2fa9e tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:03.718392 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-8e54c030-6697-47ca-827d-f197aca2fa9e tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: f182bee3-f292-4f22-b9a0-93228e1a5049] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:03.725657 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8e54c030-6697-47ca-827d-f197aca2fa9e tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:03.726162 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8e54c030-6697-47ca-827d-f197aca2fa9e tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:03.726609 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8e54c030-6697-47ca-827d-f197aca2fa9e tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:03.727334 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8e54c030-6697-47ca-827d-f197aca2fa9e tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:03.727794 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8e54c030-6697-47ca-827d-f197aca2fa9e tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:03.728229 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8e54c030-6697-47ca-827d-f197aca2fa9e tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:03.731474 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-44ece892-717c-4caa-af08-d462a77b7164 req-83da2714-db77-4c6d-a477-b4b53f1405ce service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:03.731964 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-44ece892-717c-4caa-af08-d462a77b7164 req-83da2714-db77-4c6d-a477-b4b53f1405ce service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:03.732406 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-44ece892-717c-4caa-af08-d462a77b7164 req-83da2714-db77-4c6d-a477-b4b53f1405ce service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:03.747639 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-44ece892-717c-4caa-af08-d462a77b7164 req-83da2714-db77-4c6d-a477-b4b53f1405ce service nova] Creating event network-vif-plugged:37642f8c-8e21-43fe-865f-09cc1bd6c431 for instance f1b4faf3-0c03-4e0c-be81-be3305b8314f on nch2-master-1 Oct 08 21:08:03.775650 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-44ece892-717c-4caa-af08-d462a77b7164 req-83da2714-db77-4c6d-a477-b4b53f1405ce service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098650 Oct 08 21:08:03.776291 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1862/3803] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:08:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 08 21:08:03.913974 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-712b04f5-b0f0-42de-8355-8f91a249c30d tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:03.915034 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-712b04f5-b0f0-42de-8355-8f91a249c30d tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] [instance: b1983b4c-4fd2-4ec8-9fb0-aa1f7fa51219] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:03.938064 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-712b04f5-b0f0-42de-8355-8f91a249c30d tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:03.952143 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-712b04f5-b0f0-42de-8355-8f91a249c30d tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:03.953113 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-712b04f5-b0f0-42de-8355-8f91a249c30d tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:03.953898 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-712b04f5-b0f0-42de-8355-8f91a249c30d tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:03.955738 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-712b04f5-b0f0-42de-8355-8f91a249c30d tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:03.956414 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-712b04f5-b0f0-42de-8355-8f91a249c30d tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:04.045231 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-8e54c030-6697-47ca-827d-f197aca2fa9e tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06443b5728fb4d1e95d6245820e786bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ded993145b4eda9d6a33b994519012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:04.066673 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-8e54c030-6697-47ca-827d-f197aca2fa9e tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "GET /compute/v2.1/servers/f182bee3-f292-4f22-b9a0-93228e1a5049" status: 200 len: 1309 microversion: 2.1 time: 0.353656 Oct 08 21:08:04.068022 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1942/3804] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:08:03 2022] GET /compute/v2.1/servers/f182bee3-f292-4f22-b9a0-93228e1a5049 => generated 1309 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:08:04.082194 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e5caa784-524c-4602-b1fb-14bcc7903dba tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:04.083635 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-e5caa784-524c-4602-b1fb-14bcc7903dba tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: 911394e0-0af3-4433-acfb-a4652d4e2e84] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:04.102929 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e5caa784-524c-4602-b1fb-14bcc7903dba tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:04.104166 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e5caa784-524c-4602-b1fb-14bcc7903dba tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:04.104634 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e5caa784-524c-4602-b1fb-14bcc7903dba tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:04.106654 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e5caa784-524c-4602-b1fb-14bcc7903dba tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:04.107754 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e5caa784-524c-4602-b1fb-14bcc7903dba tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:04.108380 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e5caa784-524c-4602-b1fb-14bcc7903dba tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:04.123776 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-712b04f5-b0f0-42de-8355-8f91a249c30d tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9cd61a0df164a9e9197022508adafbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acc59093f954b61ba9f3cd05e940c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:04.137036 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-712b04f5-b0f0-42de-8355-8f91a249c30d tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9cd61a0df164a9e9197022508adafbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acc59093f954b61ba9f3cd05e940c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:04.140923 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-712b04f5-b0f0-42de-8355-8f91a249c30d tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9cd61a0df164a9e9197022508adafbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acc59093f954b61ba9f3cd05e940c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:04.149434 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-712b04f5-b0f0-42de-8355-8f91a249c30d tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] 10.222.0.26 "GET /compute/v2.1/servers/b1983b4c-4fd2-4ec8-9fb0-aa1f7fa51219" status: 200 len: 1409 microversion: 2.54 time: 0.240283 Oct 08 21:08:04.150633 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1863/3805] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:08:03 2022] GET /compute/v2.1/servers/b1983b4c-4fd2-4ec8-9fb0-aa1f7fa51219 => generated 1409 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:08:04.157850 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-4440a4bc-9aac-458b-86dc-5760fa455a7e tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Calling method '.version_select at 0x7f1a8ca32160>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:04.306771 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-4440a4bc-9aac-458b-86dc-5760fa455a7e tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "GET /compute/v2.1/images/fa798238-0b05-4e9a-a4b3-2d47579804f6" status: 200 len: 1412 microversion: 2.1 time: 0.153477 Oct 08 21:08:04.313659 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1864/3806] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:08:04 2022] GET /compute/v2.1/images/fa798238-0b05-4e9a-a4b3-2d47579804f6 => generated 1412 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:08:04.429976 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-e5caa784-524c-4602-b1fb-14bcc7903dba tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78e9afd772c4de981cac8f5817ec356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765c62cac2ee4406b23a5baa85c52ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:04.440795 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-e5caa784-524c-4602-b1fb-14bcc7903dba tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/911394e0-0af3-4433-acfb-a4652d4e2e84" status: 200 len: 1315 microversion: 2.1 time: 0.369506 Oct 08 21:08:04.442795 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1943/3807] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:08:04 2022] GET /compute/v2.1/servers/911394e0-0af3-4433-acfb-a4652d4e2e84 => generated 1315 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:08:05.093559 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-244c826f-cf67-4f6f-b953-8ddbde3785de tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:05.094779 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-244c826f-cf67-4f6f-b953-8ddbde3785de tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: f182bee3-f292-4f22-b9a0-93228e1a5049] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:05.112249 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-244c826f-cf67-4f6f-b953-8ddbde3785de tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:05.115391 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-244c826f-cf67-4f6f-b953-8ddbde3785de tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:05.116204 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-244c826f-cf67-4f6f-b953-8ddbde3785de tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:05.117256 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-244c826f-cf67-4f6f-b953-8ddbde3785de tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:05.117983 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-244c826f-cf67-4f6f-b953-8ddbde3785de tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:05.119240 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-244c826f-cf67-4f6f-b953-8ddbde3785de tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:05.185649 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-51f956ab-9899-4b44-8564-d831f6e83b77 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:05.186639 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-51f956ab-9899-4b44-8564-d831f6e83b77 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] [instance: b1983b4c-4fd2-4ec8-9fb0-aa1f7fa51219] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:05.195294 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-51f956ab-9899-4b44-8564-d831f6e83b77 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:05.195787 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-51f956ab-9899-4b44-8564-d831f6e83b77 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:05.196229 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-51f956ab-9899-4b44-8564-d831f6e83b77 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:05.196936 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-51f956ab-9899-4b44-8564-d831f6e83b77 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:05.197657 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-51f956ab-9899-4b44-8564-d831f6e83b77 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:05.198472 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-51f956ab-9899-4b44-8564-d831f6e83b77 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:05.281795 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-51f956ab-9899-4b44-8564-d831f6e83b77 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9cd61a0df164a9e9197022508adafbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acc59093f954b61ba9f3cd05e940c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:05.302258 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-51f956ab-9899-4b44-8564-d831f6e83b77 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9cd61a0df164a9e9197022508adafbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acc59093f954b61ba9f3cd05e940c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:05.305743 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-51f956ab-9899-4b44-8564-d831f6e83b77 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9cd61a0df164a9e9197022508adafbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acc59093f954b61ba9f3cd05e940c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:05.307304 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-51f956ab-9899-4b44-8564-d831f6e83b77 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] 10.222.0.26 "GET /compute/v2.1/servers/b1983b4c-4fd2-4ec8-9fb0-aa1f7fa51219" status: 200 len: 1409 microversion: 2.54 time: 0.127164 Oct 08 21:08:05.308144 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1944/3808] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:08:05 2022] GET /compute/v2.1/servers/b1983b4c-4fd2-4ec8-9fb0-aa1f7fa51219 => generated 1409 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 08 21:08:05.334119 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-6ae338d7-5606-4d7f-b88c-e1ef6ce02dd7 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Calling method '.version_select at 0x7f1a87fd1550>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:05.387668 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-6ae338d7-5606-4d7f-b88c-e1ef6ce02dd7 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "GET /compute/v2.1/images/fa798238-0b05-4e9a-a4b3-2d47579804f6" status: 200 len: 1412 microversion: 2.1 time: 0.060943 Oct 08 21:08:05.388816 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1945/3809] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:08:05 2022] GET /compute/v2.1/images/fa798238-0b05-4e9a-a4b3-2d47579804f6 => generated 1412 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:08:05.459921 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-244c826f-cf67-4f6f-b953-8ddbde3785de tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06443b5728fb4d1e95d6245820e786bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ded993145b4eda9d6a33b994519012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:05.470700 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-b0382170-6d8a-42e6-92bb-63c38b2617e9 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:05.472546 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-b0382170-6d8a-42e6-92bb-63c38b2617e9 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: 911394e0-0af3-4433-acfb-a4652d4e2e84] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:05.473786 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-244c826f-cf67-4f6f-b953-8ddbde3785de tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "GET /compute/v2.1/servers/f182bee3-f292-4f22-b9a0-93228e1a5049" status: 200 len: 1490 microversion: 2.1 time: 0.386390 Oct 08 21:08:05.473933 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1865/3810] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:08:05 2022] GET /compute/v2.1/servers/f182bee3-f292-4f22-b9a0-93228e1a5049 => generated 1490 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:08:05.483545 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b0382170-6d8a-42e6-92bb-63c38b2617e9 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:05.484131 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b0382170-6d8a-42e6-92bb-63c38b2617e9 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:05.485119 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b0382170-6d8a-42e6-92bb-63c38b2617e9 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:05.486100 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b0382170-6d8a-42e6-92bb-63c38b2617e9 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:05.486849 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b0382170-6d8a-42e6-92bb-63c38b2617e9 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:05.487359 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b0382170-6d8a-42e6-92bb-63c38b2617e9 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:05.502015 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-46c5b767-cafc-4114-aca4-1e95f09bd7de tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:05.502756 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-46c5b767-cafc-4114-aca4-1e95f09bd7de tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: c7e330f4-220e-4dce-b65e-0aedb3206dda] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:05.509660 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:08:05.512440 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-46c5b767-cafc-4114-aca4-1e95f09bd7de tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:05.513738 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-46c5b767-cafc-4114-aca4-1e95f09bd7de tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:05.514291 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-46c5b767-cafc-4114-aca4-1e95f09bd7de tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:05.515096 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-46c5b767-cafc-4114-aca4-1e95f09bd7de tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:05.515644 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-46c5b767-cafc-4114-aca4-1e95f09bd7de tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:05.516314 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-46c5b767-cafc-4114-aca4-1e95f09bd7de tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:05.680487 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-b0382170-6d8a-42e6-92bb-63c38b2617e9 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78e9afd772c4de981cac8f5817ec356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765c62cac2ee4406b23a5baa85c52ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:05.695033 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-b0382170-6d8a-42e6-92bb-63c38b2617e9 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/911394e0-0af3-4433-acfb-a4652d4e2e84" status: 200 len: 1315 microversion: 2.1 time: 0.230764 Oct 08 21:08:05.696255 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1946/3811] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:08:05 2022] GET /compute/v2.1/servers/911394e0-0af3-4433-acfb-a4652d4e2e84 => generated 1315 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:08:05.908197 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-46c5b767-cafc-4114-aca4-1e95f09bd7de tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06443b5728fb4d1e95d6245820e786bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ded993145b4eda9d6a33b994519012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:05.932032 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-46c5b767-cafc-4114-aca4-1e95f09bd7de tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "GET /compute/v2.1/servers/c7e330f4-220e-4dce-b65e-0aedb3206dda" status: 200 len: 1491 microversion: 2.1 time: 0.436448 Oct 08 21:08:05.933552 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1866/3812] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:08:05 2022] GET /compute/v2.1/servers/c7e330f4-220e-4dce-b65e-0aedb3206dda => generated 1491 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:08:05.959635 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-c02c2ea0-890a-43f3-8240-592a831517be tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:05.960385 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-c02c2ea0-890a-43f3-8240-592a831517be tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: f182bee3-f292-4f22-b9a0-93228e1a5049] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:05.977233 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c02c2ea0-890a-43f3-8240-592a831517be tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:05.980622 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c02c2ea0-890a-43f3-8240-592a831517be tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:05.983043 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c02c2ea0-890a-43f3-8240-592a831517be tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:05.984302 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c02c2ea0-890a-43f3-8240-592a831517be tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:05.985029 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c02c2ea0-890a-43f3-8240-592a831517be tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:05.985744 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c02c2ea0-890a-43f3-8240-592a831517be tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:06.251802 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-c02c2ea0-890a-43f3-8240-592a831517be tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06443b5728fb4d1e95d6245820e786bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ded993145b4eda9d6a33b994519012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:06.267232 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-c02c2ea0-890a-43f3-8240-592a831517be tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "GET /compute/v2.1/servers/f182bee3-f292-4f22-b9a0-93228e1a5049" status: 200 len: 1490 microversion: 2.1 time: 0.311482 Oct 08 21:08:06.273418 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1947/3813] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:08:05 2022] GET /compute/v2.1/servers/f182bee3-f292-4f22-b9a0-93228e1a5049 => generated 1490 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:08:06.293920 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-6962b796-3d70-4519-b693-994aaa97c301 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:06.294532 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-6962b796-3d70-4519-b693-994aaa97c301 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: f182bee3-f292-4f22-b9a0-93228e1a5049] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:06.303366 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6962b796-3d70-4519-b693-994aaa97c301 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:06.303992 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6962b796-3d70-4519-b693-994aaa97c301 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:06.304510 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6962b796-3d70-4519-b693-994aaa97c301 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:06.305469 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6962b796-3d70-4519-b693-994aaa97c301 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:06.306026 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6962b796-3d70-4519-b693-994aaa97c301 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:06.306761 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6962b796-3d70-4519-b693-994aaa97c301 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:06.343610 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-9798e13c-00c5-4c2a-b365-febc9094a338 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:06.344813 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-9798e13c-00c5-4c2a-b365-febc9094a338 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] [instance: b1983b4c-4fd2-4ec8-9fb0-aa1f7fa51219] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:06.352488 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-6962b796-3d70-4519-b693-994aaa97c301 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: f182bee3-f292-4f22-b9a0-93228e1a5049] Going to try to terminate instance {{(pid=140491) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 21:08:06.367419 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9798e13c-00c5-4c2a-b365-febc9094a338 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:06.368041 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9798e13c-00c5-4c2a-b365-febc9094a338 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:06.369035 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9798e13c-00c5-4c2a-b365-febc9094a338 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:06.370000 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9798e13c-00c5-4c2a-b365-febc9094a338 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:06.372387 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9798e13c-00c5-4c2a-b365-febc9094a338 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:06.373672 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9798e13c-00c5-4c2a-b365-febc9094a338 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:06.529622 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-9798e13c-00c5-4c2a-b365-febc9094a338 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9cd61a0df164a9e9197022508adafbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acc59093f954b61ba9f3cd05e940c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:06.531720 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-6962b796-3d70-4519-b693-994aaa97c301 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "DELETE /compute/v2.1/servers/f182bee3-f292-4f22-b9a0-93228e1a5049" status: 204 len: 0 microversion: 2.1 time: 0.242069 Oct 08 21:08:06.537353 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1867/3814] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:08:06 2022] DELETE /compute/v2.1/servers/f182bee3-f292-4f22-b9a0-93228e1a5049 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 21:08:06.550593 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-9798e13c-00c5-4c2a-b365-febc9094a338 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9cd61a0df164a9e9197022508adafbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acc59093f954b61ba9f3cd05e940c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:06.551911 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-38d115b9-9278-440c-93e9-4c108fbac92a tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Calling method '.version_select at 0x7f1a8c63a700>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:06.554311 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-9798e13c-00c5-4c2a-b365-febc9094a338 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9cd61a0df164a9e9197022508adafbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acc59093f954b61ba9f3cd05e940c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:06.557044 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-9798e13c-00c5-4c2a-b365-febc9094a338 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] 10.222.0.26 "GET /compute/v2.1/servers/b1983b4c-4fd2-4ec8-9fb0-aa1f7fa51219" status: 200 len: 1409 microversion: 2.54 time: 0.220951 Oct 08 21:08:06.560264 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1948/3815] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:08:06 2022] GET /compute/v2.1/servers/b1983b4c-4fd2-4ec8-9fb0-aa1f7fa51219 => generated 1409 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 08 21:08:06.574915 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-76892f5b-bdc5-4917-8b80-62e54862febb tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:06.575800 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-76892f5b-bdc5-4917-8b80-62e54862febb tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: f182bee3-f292-4f22-b9a0-93228e1a5049] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:06.587149 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-76892f5b-bdc5-4917-8b80-62e54862febb tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:06.587888 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-76892f5b-bdc5-4917-8b80-62e54862febb tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:06.588506 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-76892f5b-bdc5-4917-8b80-62e54862febb tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:06.590491 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-76892f5b-bdc5-4917-8b80-62e54862febb tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:06.591862 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-76892f5b-bdc5-4917-8b80-62e54862febb tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:06.594449 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-76892f5b-bdc5-4917-8b80-62e54862febb tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:06.628144 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-38d115b9-9278-440c-93e9-4c108fbac92a tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "GET /compute/v2.1/images/fa798238-0b05-4e9a-a4b3-2d47579804f6" status: 200 len: 1412 microversion: 2.1 time: 0.088706 Oct 08 21:08:06.629671 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1868/3816] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:08:06 2022] GET /compute/v2.1/images/fa798238-0b05-4e9a-a4b3-2d47579804f6 => generated 1412 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:08:06.727464 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-1fe7cf8b-7007-42ec-aa6e-30a123beca20 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:06.728578 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-1fe7cf8b-7007-42ec-aa6e-30a123beca20 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: 911394e0-0af3-4433-acfb-a4652d4e2e84] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:06.747256 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1fe7cf8b-7007-42ec-aa6e-30a123beca20 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:06.747888 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1fe7cf8b-7007-42ec-aa6e-30a123beca20 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:06.748481 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1fe7cf8b-7007-42ec-aa6e-30a123beca20 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:06.750801 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1fe7cf8b-7007-42ec-aa6e-30a123beca20 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:06.751377 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1fe7cf8b-7007-42ec-aa6e-30a123beca20 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:06.751939 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1fe7cf8b-7007-42ec-aa6e-30a123beca20 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:06.821895 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-76892f5b-bdc5-4917-8b80-62e54862febb tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06443b5728fb4d1e95d6245820e786bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ded993145b4eda9d6a33b994519012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:06.832551 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-76892f5b-bdc5-4917-8b80-62e54862febb tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "GET /compute/v2.1/servers/f182bee3-f292-4f22-b9a0-93228e1a5049" status: 200 len: 1496 microversion: 2.1 time: 0.268779 Oct 08 21:08:06.836050 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1949/3817] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:08:06 2022] GET /compute/v2.1/servers/f182bee3-f292-4f22-b9a0-93228e1a5049 => generated 1496 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:08:07.074718 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-1fe7cf8b-7007-42ec-aa6e-30a123beca20 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78e9afd772c4de981cac8f5817ec356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765c62cac2ee4406b23a5baa85c52ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:07.086620 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-1fe7cf8b-7007-42ec-aa6e-30a123beca20 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/911394e0-0af3-4433-acfb-a4652d4e2e84" status: 200 len: 1315 microversion: 2.1 time: 0.370814 Oct 08 21:08:07.108340 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1869/3818] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:08:06 2022] GET /compute/v2.1/servers/911394e0-0af3-4433-acfb-a4652d4e2e84 => generated 1315 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:08:07.589633 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-b2f43cfd-43bb-4e4f-87f4-9ac82d47563a tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:07.591320 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-b2f43cfd-43bb-4e4f-87f4-9ac82d47563a tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] [instance: b1983b4c-4fd2-4ec8-9fb0-aa1f7fa51219] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:07.609726 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b2f43cfd-43bb-4e4f-87f4-9ac82d47563a tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:07.610666 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b2f43cfd-43bb-4e4f-87f4-9ac82d47563a tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:07.611373 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b2f43cfd-43bb-4e4f-87f4-9ac82d47563a tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:07.613642 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b2f43cfd-43bb-4e4f-87f4-9ac82d47563a tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:07.614426 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b2f43cfd-43bb-4e4f-87f4-9ac82d47563a tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:07.615086 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b2f43cfd-43bb-4e4f-87f4-9ac82d47563a tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:07.646032 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-a3e26cb3-ec69-4c10-a13f-61e5a1150898 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Calling method '.version_select at 0x7f1a914d7c10>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:07.741360 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-a3e26cb3-ec69-4c10-a13f-61e5a1150898 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "GET /compute/v2.1/images/fa798238-0b05-4e9a-a4b3-2d47579804f6" status: 200 len: 1412 microversion: 2.1 time: 0.099912 Oct 08 21:08:07.742349 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1870/3819] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:08:07 2022] GET /compute/v2.1/images/fa798238-0b05-4e9a-a4b3-2d47579804f6 => generated 1412 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:08:07.758913 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-b2f43cfd-43bb-4e4f-87f4-9ac82d47563a tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9cd61a0df164a9e9197022508adafbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acc59093f954b61ba9f3cd05e940c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:07.769870 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-b2f43cfd-43bb-4e4f-87f4-9ac82d47563a tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9cd61a0df164a9e9197022508adafbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acc59093f954b61ba9f3cd05e940c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:07.771600 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-b2f43cfd-43bb-4e4f-87f4-9ac82d47563a tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9cd61a0df164a9e9197022508adafbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acc59093f954b61ba9f3cd05e940c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:07.773565 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-b2f43cfd-43bb-4e4f-87f4-9ac82d47563a tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] 10.222.0.26 "GET /compute/v2.1/servers/b1983b4c-4fd2-4ec8-9fb0-aa1f7fa51219" status: 200 len: 1409 microversion: 2.54 time: 0.190184 Oct 08 21:08:07.774361 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1950/3820] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:08:07 2022] GET /compute/v2.1/servers/b1983b4c-4fd2-4ec8-9fb0-aa1f7fa51219 => generated 1409 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:08:07.862578 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-7146dd93-cdbb-44ad-b01e-cdc01941b766 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:07.863426 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-7146dd93-cdbb-44ad-b01e-cdc01941b766 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: f182bee3-f292-4f22-b9a0-93228e1a5049] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:07.874476 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7146dd93-cdbb-44ad-b01e-cdc01941b766 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:07.875163 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7146dd93-cdbb-44ad-b01e-cdc01941b766 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:07.875688 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7146dd93-cdbb-44ad-b01e-cdc01941b766 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:07.876489 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7146dd93-cdbb-44ad-b01e-cdc01941b766 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:07.877036 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7146dd93-cdbb-44ad-b01e-cdc01941b766 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:07.877577 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7146dd93-cdbb-44ad-b01e-cdc01941b766 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:08.121106 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-2023d17c-1a29-4165-96b7-6ea449d183f1 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:08.122161 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-2023d17c-1a29-4165-96b7-6ea449d183f1 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: 911394e0-0af3-4433-acfb-a4652d4e2e84] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:08.137239 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=2 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:08:08.150148 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2023d17c-1a29-4165-96b7-6ea449d183f1 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:08.150962 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2023d17c-1a29-4165-96b7-6ea449d183f1 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:08.152110 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2023d17c-1a29-4165-96b7-6ea449d183f1 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:08.155886 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2023d17c-1a29-4165-96b7-6ea449d183f1 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:08.156917 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2023d17c-1a29-4165-96b7-6ea449d183f1 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:08.159220 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2023d17c-1a29-4165-96b7-6ea449d183f1 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:08.172472 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-7146dd93-cdbb-44ad-b01e-cdc01941b766 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06443b5728fb4d1e95d6245820e786bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ded993145b4eda9d6a33b994519012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:08.186890 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-7146dd93-cdbb-44ad-b01e-cdc01941b766 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "GET /compute/v2.1/servers/f182bee3-f292-4f22-b9a0-93228e1a5049" status: 200 len: 1496 microversion: 2.1 time: 0.329727 Oct 08 21:08:08.188001 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1871/3821] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:08:07 2022] GET /compute/v2.1/servers/f182bee3-f292-4f22-b9a0-93228e1a5049 => generated 1496 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:08:08.500271 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-2023d17c-1a29-4165-96b7-6ea449d183f1 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78e9afd772c4de981cac8f5817ec356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765c62cac2ee4406b23a5baa85c52ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:08.511833 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-2023d17c-1a29-4165-96b7-6ea449d183f1 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/911394e0-0af3-4433-acfb-a4652d4e2e84" status: 200 len: 1315 microversion: 2.1 time: 0.401577 Oct 08 21:08:08.525729 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1951/3822] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:08:08 2022] GET /compute/v2.1/servers/911394e0-0af3-4433-acfb-a4652d4e2e84 => generated 1315 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:08:08.759579 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-8c1d6693-b36a-4abc-85d0-5da584a45e66 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Calling method '.version_select at 0x7f1a914d7c10>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:08.801767 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-04cd6960-853e-4d75-83ef-8a089f4b8e76 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:08.803703 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-04cd6960-853e-4d75-83ef-8a089f4b8e76 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] [instance: b1983b4c-4fd2-4ec8-9fb0-aa1f7fa51219] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:08.825324 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=8 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:08:08.842196 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-8c1d6693-b36a-4abc-85d0-5da584a45e66 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "GET /compute/v2.1/images/fa798238-0b05-4e9a-a4b3-2d47579804f6" status: 200 len: 1412 microversion: 2.1 time: 0.086260 Oct 08 21:08:08.843413 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-04cd6960-853e-4d75-83ef-8a089f4b8e76 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:08.843916 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-04cd6960-853e-4d75-83ef-8a089f4b8e76 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:08.844360 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-04cd6960-853e-4d75-83ef-8a089f4b8e76 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:08.854270 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1872/3823] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:08:08 2022] GET /compute/v2.1/images/fa798238-0b05-4e9a-a4b3-2d47579804f6 => generated 1412 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:08:08.856373 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-04cd6960-853e-4d75-83ef-8a089f4b8e76 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:08.857799 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-04cd6960-853e-4d75-83ef-8a089f4b8e76 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:08.858481 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-04cd6960-853e-4d75-83ef-8a089f4b8e76 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:09.183482 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-04cd6960-853e-4d75-83ef-8a089f4b8e76 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9cd61a0df164a9e9197022508adafbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acc59093f954b61ba9f3cd05e940c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:09.212606 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-fc1678c0-1a23-4aaf-a55e-26ea91aa9950 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:09.213434 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-04cd6960-853e-4d75-83ef-8a089f4b8e76 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9cd61a0df164a9e9197022508adafbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acc59093f954b61ba9f3cd05e940c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:09.213894 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-fc1678c0-1a23-4aaf-a55e-26ea91aa9950 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: f182bee3-f292-4f22-b9a0-93228e1a5049] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:09.219217 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-04cd6960-853e-4d75-83ef-8a089f4b8e76 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9cd61a0df164a9e9197022508adafbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acc59093f954b61ba9f3cd05e940c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:09.231203 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-04cd6960-853e-4d75-83ef-8a089f4b8e76 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] 10.222.0.26 "GET /compute/v2.1/servers/b1983b4c-4fd2-4ec8-9fb0-aa1f7fa51219" status: 200 len: 1409 microversion: 2.54 time: 0.429366 Oct 08 21:08:09.232760 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fc1678c0-1a23-4aaf-a55e-26ea91aa9950 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:09.233570 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fc1678c0-1a23-4aaf-a55e-26ea91aa9950 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:09.234253 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fc1678c0-1a23-4aaf-a55e-26ea91aa9950 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:09.235292 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fc1678c0-1a23-4aaf-a55e-26ea91aa9950 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:09.235946 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fc1678c0-1a23-4aaf-a55e-26ea91aa9950 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:09.236625 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fc1678c0-1a23-4aaf-a55e-26ea91aa9950 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:09.236987 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1952/3824] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:08:08 2022] GET /compute/v2.1/servers/b1983b4c-4fd2-4ec8-9fb0-aa1f7fa51219 => generated 1409 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 08 21:08:09.262281 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-d3764fe7-02f3-4e1a-bdff-a12768abbfa1 req-3263f359-525f-4d5a-88a9-1f25243491a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f182bee3-f292-4f22-b9a0-93228e1a5049", "name": "network-vif-deleted", "tag": "668c891e-a778-42d8-bc73-e74d3f038e32"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:08:09.295264 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-d3764fe7-02f3-4e1a-bdff-a12768abbfa1 req-3263f359-525f-4d5a-88a9-1f25243491a9 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:09.300125 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-d3764fe7-02f3-4e1a-bdff-a12768abbfa1 req-3263f359-525f-4d5a-88a9-1f25243491a9 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:09.301489 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-d3764fe7-02f3-4e1a-bdff-a12768abbfa1 req-3263f359-525f-4d5a-88a9-1f25243491a9 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:09.323301 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:08:09.339123 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-d3764fe7-02f3-4e1a-bdff-a12768abbfa1 req-3263f359-525f-4d5a-88a9-1f25243491a9 service nova] Creating event network-vif-deleted:668c891e-a778-42d8-bc73-e74d3f038e32 for instance f182bee3-f292-4f22-b9a0-93228e1a5049 on nch2-master-1 Oct 08 21:08:09.354878 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-d3764fe7-02f3-4e1a-bdff-a12768abbfa1 req-3263f359-525f-4d5a-88a9-1f25243491a9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115074 Oct 08 21:08:09.356498 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1953/3825] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:08:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:08:09.411156 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-fc1678c0-1a23-4aaf-a55e-26ea91aa9950 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06443b5728fb4d1e95d6245820e786bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ded993145b4eda9d6a33b994519012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:09.433053 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-fc1678c0-1a23-4aaf-a55e-26ea91aa9950 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "GET /compute/v2.1/servers/f182bee3-f292-4f22-b9a0-93228e1a5049" status: 200 len: 1294 microversion: 2.1 time: 0.225117 Oct 08 21:08:09.436752 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1873/3826] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:08:09 2022] GET /compute/v2.1/servers/f182bee3-f292-4f22-b9a0-93228e1a5049 => generated 1294 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:08:09.538434 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-d5dc7660-385a-40e5-9882-6159945a06e3 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:09.540766 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-d5dc7660-385a-40e5-9882-6159945a06e3 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: 911394e0-0af3-4433-acfb-a4652d4e2e84] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:09.557160 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d5dc7660-385a-40e5-9882-6159945a06e3 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:09.558600 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d5dc7660-385a-40e5-9882-6159945a06e3 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:09.559518 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d5dc7660-385a-40e5-9882-6159945a06e3 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:09.561907 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d5dc7660-385a-40e5-9882-6159945a06e3 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:09.562614 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d5dc7660-385a-40e5-9882-6159945a06e3 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:09.563600 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d5dc7660-385a-40e5-9882-6159945a06e3 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:09.795083 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-d5dc7660-385a-40e5-9882-6159945a06e3 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78e9afd772c4de981cac8f5817ec356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765c62cac2ee4406b23a5baa85c52ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:09.805628 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-d5dc7660-385a-40e5-9882-6159945a06e3 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/911394e0-0af3-4433-acfb-a4652d4e2e84" status: 200 len: 1315 microversion: 2.1 time: 0.272843 Oct 08 21:08:09.807267 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1954/3827] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:08:09 2022] GET /compute/v2.1/servers/911394e0-0af3-4433-acfb-a4652d4e2e84 => generated 1315 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:08:09.828928 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-14d99582-aa7c-48de-bce6-f96ae4d7ccd5 req-c238e3a2-6b17-459a-b049-8e0bc7b5bbd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "911394e0-0af3-4433-acfb-a4652d4e2e84", "name": "network-vif-plugged", "status": "completed", "tag": "7d57450d-660f-48ba-9c0d-c5b4d23d86db"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:08:09.840776 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-14d99582-aa7c-48de-bce6-f96ae4d7ccd5 req-c238e3a2-6b17-459a-b049-8e0bc7b5bbd3 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:09.841769 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-14d99582-aa7c-48de-bce6-f96ae4d7ccd5 req-c238e3a2-6b17-459a-b049-8e0bc7b5bbd3 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:09.842448 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-14d99582-aa7c-48de-bce6-f96ae4d7ccd5 req-c238e3a2-6b17-459a-b049-8e0bc7b5bbd3 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:09.860364 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-14d99582-aa7c-48de-bce6-f96ae4d7ccd5 req-c238e3a2-6b17-459a-b049-8e0bc7b5bbd3 service nova] Creating event network-vif-plugged:7d57450d-660f-48ba-9c0d-c5b4d23d86db for instance 911394e0-0af3-4433-acfb-a4652d4e2e84 on nch1-master-1 Oct 08 21:08:09.864404 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-ae769dcf-67c0-4095-b541-655ec06b9d3d tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Calling method '.version_select at 0x7f1a8c843700>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:09.874238 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-14d99582-aa7c-48de-bce6-f96ae4d7ccd5 req-c238e3a2-6b17-459a-b049-8e0bc7b5bbd3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049189 Oct 08 21:08:09.883376 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1874/3828] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:08:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:08:09.922568 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-ae769dcf-67c0-4095-b541-655ec06b9d3d tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "GET /compute/v2.1/images/fa798238-0b05-4e9a-a4b3-2d47579804f6" status: 200 len: 1412 microversion: 2.1 time: 0.064939 Oct 08 21:08:09.923951 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1955/3829] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:08:09 2022] GET /compute/v2.1/images/fa798238-0b05-4e9a-a4b3-2d47579804f6 => generated 1412 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:08:10.269468 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-50011aa7-c5a5-40d9-a6fc-8ce216ad01f4 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:10.270413 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-50011aa7-c5a5-40d9-a6fc-8ce216ad01f4 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] [instance: b1983b4c-4fd2-4ec8-9fb0-aa1f7fa51219] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:10.282272 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-50011aa7-c5a5-40d9-a6fc-8ce216ad01f4 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:10.283408 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-50011aa7-c5a5-40d9-a6fc-8ce216ad01f4 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:10.284052 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-50011aa7-c5a5-40d9-a6fc-8ce216ad01f4 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:10.284969 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-50011aa7-c5a5-40d9-a6fc-8ce216ad01f4 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:10.285636 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-50011aa7-c5a5-40d9-a6fc-8ce216ad01f4 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:10.286372 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-50011aa7-c5a5-40d9-a6fc-8ce216ad01f4 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:10.403605 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-50011aa7-c5a5-40d9-a6fc-8ce216ad01f4 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9cd61a0df164a9e9197022508adafbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acc59093f954b61ba9f3cd05e940c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:10.422583 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-50011aa7-c5a5-40d9-a6fc-8ce216ad01f4 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9cd61a0df164a9e9197022508adafbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acc59093f954b61ba9f3cd05e940c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:10.425153 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-50011aa7-c5a5-40d9-a6fc-8ce216ad01f4 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9cd61a0df164a9e9197022508adafbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acc59093f954b61ba9f3cd05e940c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:10.426700 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-50011aa7-c5a5-40d9-a6fc-8ce216ad01f4 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] 10.222.0.26 "GET /compute/v2.1/servers/b1983b4c-4fd2-4ec8-9fb0-aa1f7fa51219" status: 200 len: 1409 microversion: 2.54 time: 0.162289 Oct 08 21:08:10.428115 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1875/3830] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:08:10 2022] GET /compute/v2.1/servers/b1983b4c-4fd2-4ec8-9fb0-aa1f7fa51219 => generated 1409 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:08:10.458962 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-1d4d47ac-f9b1-43f6-aebd-42f8bf978e68 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:10.459924 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-1d4d47ac-f9b1-43f6-aebd-42f8bf978e68 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: f182bee3-f292-4f22-b9a0-93228e1a5049] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:10.468190 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1d4d47ac-f9b1-43f6-aebd-42f8bf978e68 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:10.468970 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1d4d47ac-f9b1-43f6-aebd-42f8bf978e68 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:10.469640 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1d4d47ac-f9b1-43f6-aebd-42f8bf978e68 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:10.470608 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1d4d47ac-f9b1-43f6-aebd-42f8bf978e68 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:10.471293 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1d4d47ac-f9b1-43f6-aebd-42f8bf978e68 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:10.471927 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1d4d47ac-f9b1-43f6-aebd-42f8bf978e68 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:10.492077 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-1d4d47ac-f9b1-43f6-aebd-42f8bf978e68 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] HTTP exception thrown: Instance f182bee3-f292-4f22-b9a0-93228e1a5049 could not be found. Oct 08 21:08:10.495004 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-1d4d47ac-f9b1-43f6-aebd-42f8bf978e68 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Request method failure captured: Oct 08 21:08:10.495004 ncdv-master-1 devstack@n-api.service[140492]: request: GET /compute/v2.1/servers/f182bee3-f292-4f22-b9a0-93228e1a5049 HTTP/1.1 Oct 08 21:08:10.495004 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:08:10.495004 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:08:10.495004 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:08:10.495004 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 21:08:10.495004 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:08:10.495004 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:08:10.495004 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:08:10.495004 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:08:10.495004 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeYsdf-NgsPUaUb78CUpk0vq18mlUqdb1er-CKgSGnwcxKYVDw5Br5ObGheB0PHKIrwGHgJ4op59IUcxCd3ChQqclxeYxKhK3ZwkXmw1AwIGXWjgktrsk6DH6ba1NMLmZ1pzBqcyvzB3CMIuC4HBXIHDILjU44EobGpdQQ8lNmKdDFM Oct 08 21:08:10.495004 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:08:10.495004 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:08:10.495004 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:08:10.495004 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:08:10.495004 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:08:10.495004 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:08:10.495004 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: e7ded993145b4eda9d6a33b994519012 Oct 08 21:08:10.495004 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-ServersTestJSON-68907085 Oct 08 21:08:10.495004 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:08:10.495004 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:08:10.495004 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/e7ded993145b4eda9d6a33b994519012"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e7ded993145b4eda9d6a33b994519012"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_e7ded993145b4eda9d6a33b994519012"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e7ded993145b4eda9d6a33b994519012"}]}] Oct 08 21:08:10.495004 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-ServersTestJSON-68907085 Oct 08 21:08:10.495004 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: e7ded993145b4eda9d6a33b994519012 Oct 08 21:08:10.495004 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-ServersTestJSON-68907085 Oct 08 21:08:10.495004 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-ServersTestJSON-68907085-project Oct 08 21:08:10.495004 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:08:10.495004 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:08:10.495004 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 06443b5728fb4d1e95d6245820e786bf Oct 08 21:08:10.495004 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-ServersTestJSON-68907085-project Oct 08 21:08:10.495004 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 21:08:10.495004 ncdv-master-1 devstack@n-api.service[140492]: exception: Instance f182bee3-f292-4f22-b9a0-93228e1a5049 could not be found. Oct 08 21:08:10.495004 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': 'f182bee3-f292-4f22-b9a0-93228e1a5049'} Oct 08 21:08:10.495004 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:08:10.495004 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:08:10.495004 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:08:10.495004 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:08:10.495004 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:08:10.495004 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:08:10.495004 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:08:10.495004 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:08:10.495004 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:08:10.495004 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:08:10.495004 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f182bee3-f292-4f22-b9a0-93228e1a5049 could not be found. Oct 08 21:08:10.495004 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:08:10.495004 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:08:10.495004 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:08:10.495004 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:08:10.495004 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:08:10.495004 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:08:10.495004 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:08:10.495004 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:08:10.495004 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:08:10.495004 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:08:10.495004 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:08:10.495004 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:08:10.495004 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:08:10.495004 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:08:10.495004 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:08:10.495004 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:08:10.495004 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f182bee3-f292-4f22-b9a0-93228e1a5049 could not be found. Oct 08 21:08:10.495004 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:08:10.495004 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:08:10.495004 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:08:10.495004 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:08:10.501629 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:08:10.501629 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:08:10.501629 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:08:10.501629 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:08:10.501629 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f182bee3-f292-4f22-b9a0-93228e1a5049 could not be found. Oct 08 21:08:10.501629 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:08:10.503247 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-1d4d47ac-f9b1-43f6-aebd-42f8bf978e68 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Returning 404 to user: Instance f182bee3-f292-4f22-b9a0-93228e1a5049 could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:08:10.504861 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-1d4d47ac-f9b1-43f6-aebd-42f8bf978e68 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "GET /compute/v2.1/servers/f182bee3-f292-4f22-b9a0-93228e1a5049" status: 404 len: 111 microversion: 2.1 time: 0.049212 Oct 08 21:08:10.505481 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1956/3831] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:08:10 2022] GET /compute/v2.1/servers/f182bee3-f292-4f22-b9a0-93228e1a5049 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 08 21:08:10.518823 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-76c4c5cf-c5aa-4618-9ca6-b003c9198974 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:10.519390 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-76c4c5cf-c5aa-4618-9ca6-b003c9198974 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: c7e330f4-220e-4dce-b65e-0aedb3206dda] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:10.527167 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-76c4c5cf-c5aa-4618-9ca6-b003c9198974 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:10.527967 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-76c4c5cf-c5aa-4618-9ca6-b003c9198974 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:10.528620 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-76c4c5cf-c5aa-4618-9ca6-b003c9198974 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:10.529766 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-76c4c5cf-c5aa-4618-9ca6-b003c9198974 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:10.530435 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-76c4c5cf-c5aa-4618-9ca6-b003c9198974 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:10.531075 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-76c4c5cf-c5aa-4618-9ca6-b003c9198974 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:10.568540 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-76c4c5cf-c5aa-4618-9ca6-b003c9198974 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: c7e330f4-220e-4dce-b65e-0aedb3206dda] Going to try to terminate instance {{(pid=140491) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 21:08:10.663169 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-76c4c5cf-c5aa-4618-9ca6-b003c9198974 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "DELETE /compute/v2.1/servers/c7e330f4-220e-4dce-b65e-0aedb3206dda" status: 204 len: 0 microversion: 2.1 time: 0.152257 Oct 08 21:08:10.665624 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1876/3832] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:08:10 2022] DELETE /compute/v2.1/servers/c7e330f4-220e-4dce-b65e-0aedb3206dda => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 21:08:10.676678 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-afe8a333-b53d-4f20-b39a-913ea6c26dc6 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:10.678006 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-afe8a333-b53d-4f20-b39a-913ea6c26dc6 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: c7e330f4-220e-4dce-b65e-0aedb3206dda] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:10.685382 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-afe8a333-b53d-4f20-b39a-913ea6c26dc6 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:10.686173 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-afe8a333-b53d-4f20-b39a-913ea6c26dc6 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:10.686839 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-afe8a333-b53d-4f20-b39a-913ea6c26dc6 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:10.687559 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-afe8a333-b53d-4f20-b39a-913ea6c26dc6 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:10.688276 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-afe8a333-b53d-4f20-b39a-913ea6c26dc6 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:10.688809 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-afe8a333-b53d-4f20-b39a-913ea6c26dc6 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:10.831767 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-e213b4ec-a260-41f2-93f7-b2bdb0746377 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:10.833235 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-e213b4ec-a260-41f2-93f7-b2bdb0746377 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: 911394e0-0af3-4433-acfb-a4652d4e2e84] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:10.845887 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e213b4ec-a260-41f2-93f7-b2bdb0746377 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:10.846719 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e213b4ec-a260-41f2-93f7-b2bdb0746377 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:10.848575 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e213b4ec-a260-41f2-93f7-b2bdb0746377 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:10.850982 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e213b4ec-a260-41f2-93f7-b2bdb0746377 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:10.852518 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e213b4ec-a260-41f2-93f7-b2bdb0746377 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:10.854574 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e213b4ec-a260-41f2-93f7-b2bdb0746377 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:11.049232 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-afe8a333-b53d-4f20-b39a-913ea6c26dc6 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06443b5728fb4d1e95d6245820e786bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ded993145b4eda9d6a33b994519012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:11.059233 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-afe8a333-b53d-4f20-b39a-913ea6c26dc6 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "GET /compute/v2.1/servers/c7e330f4-220e-4dce-b65e-0aedb3206dda" status: 200 len: 1497 microversion: 2.1 time: 0.390020 Oct 08 21:08:11.059873 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1957/3833] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:08:10 2022] GET /compute/v2.1/servers/c7e330f4-220e-4dce-b65e-0aedb3206dda => generated 1497 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:08:11.071257 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-951af3d3-db67-434d-b3cc-0371454d4870 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Calling method '.version_select at 0x7f1a8c0629d0>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:11.141984 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-951af3d3-db67-434d-b3cc-0371454d4870 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "GET /compute/v2.1/images/fa798238-0b05-4e9a-a4b3-2d47579804f6" status: 200 len: 1412 microversion: 2.1 time: 0.080638 Oct 08 21:08:11.143195 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1958/3834] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:08:11 2022] GET /compute/v2.1/images/fa798238-0b05-4e9a-a4b3-2d47579804f6 => generated 1412 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:08:11.173740 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-e213b4ec-a260-41f2-93f7-b2bdb0746377 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78e9afd772c4de981cac8f5817ec356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765c62cac2ee4406b23a5baa85c52ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:11.183295 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-e213b4ec-a260-41f2-93f7-b2bdb0746377 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/911394e0-0af3-4433-acfb-a4652d4e2e84" status: 200 len: 1315 microversion: 2.1 time: 0.355750 Oct 08 21:08:11.198022 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1877/3835] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:08:10 2022] GET /compute/v2.1/servers/911394e0-0af3-4433-acfb-a4652d4e2e84 => generated 1315 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:08:11.462373 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-aca5e33a-15c2-42d8-9ac4-5f94d08474f7 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:11.467421 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-aca5e33a-15c2-42d8-9ac4-5f94d08474f7 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] [instance: b1983b4c-4fd2-4ec8-9fb0-aa1f7fa51219] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:11.483450 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-aca5e33a-15c2-42d8-9ac4-5f94d08474f7 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:11.484180 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-aca5e33a-15c2-42d8-9ac4-5f94d08474f7 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:11.485790 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-aca5e33a-15c2-42d8-9ac4-5f94d08474f7 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:11.489107 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-aca5e33a-15c2-42d8-9ac4-5f94d08474f7 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:11.489865 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-aca5e33a-15c2-42d8-9ac4-5f94d08474f7 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:11.491605 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-aca5e33a-15c2-42d8-9ac4-5f94d08474f7 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:11.620034 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-aca5e33a-15c2-42d8-9ac4-5f94d08474f7 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9cd61a0df164a9e9197022508adafbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acc59093f954b61ba9f3cd05e940c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:11.632709 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-aca5e33a-15c2-42d8-9ac4-5f94d08474f7 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9cd61a0df164a9e9197022508adafbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acc59093f954b61ba9f3cd05e940c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:11.634833 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-aca5e33a-15c2-42d8-9ac4-5f94d08474f7 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9cd61a0df164a9e9197022508adafbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acc59093f954b61ba9f3cd05e940c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:11.637146 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-aca5e33a-15c2-42d8-9ac4-5f94d08474f7 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] 10.222.0.26 "GET /compute/v2.1/servers/b1983b4c-4fd2-4ec8-9fb0-aa1f7fa51219" status: 200 len: 1409 microversion: 2.54 time: 0.181803 Oct 08 21:08:11.649869 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1959/3836] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:08:11 2022] GET /compute/v2.1/servers/b1983b4c-4fd2-4ec8-9fb0-aa1f7fa51219 => generated 1409 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:08:11.817965 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-76a8cb1d-e0a0-4422-aaf3-6c7818e92631 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:11.818503 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-76a8cb1d-e0a0-4422-aaf3-6c7818e92631 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] [instance: dbacaeed-a40b-4e05-9635-5073dfdd8621] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:11.829944 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-76a8cb1d-e0a0-4422-aaf3-6c7818e92631 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:11.830445 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-76a8cb1d-e0a0-4422-aaf3-6c7818e92631 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:11.830857 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-76a8cb1d-e0a0-4422-aaf3-6c7818e92631 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:11.831712 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-76a8cb1d-e0a0-4422-aaf3-6c7818e92631 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:11.832054 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-76a8cb1d-e0a0-4422-aaf3-6c7818e92631 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:11.832686 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-76a8cb1d-e0a0-4422-aaf3-6c7818e92631 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:11.878489 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-76a8cb1d-e0a0-4422-aaf3-6c7818e92631 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] 10.222.0.26 "GET /compute/v2.1/servers/dbacaeed-a40b-4e05-9635-5073dfdd8621/os-volume_attachments/31e209f5-1092-4499-a719-01507df30223" status: 200 len: 194 microversion: 2.20 time: 0.064891 Oct 08 21:08:11.879727 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1878/3837] 10.222.0.26 () {60 vars in 1454 bytes} [Sat Oct 8 21:08:11 2022] GET /compute/v2.1/servers/dbacaeed-a40b-4e05-9635-5073dfdd8621/os-volume_attachments/31e209f5-1092-4499-a719-01507df30223 => generated 194 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 08 21:08:11.992322 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-cd40d284-0ca5-4bcb-9e2c-b2a5644fe2ba tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:11.993318 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-cd40d284-0ca5-4bcb-9e2c-b2a5644fe2ba tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] [instance: dbacaeed-a40b-4e05-9635-5073dfdd8621] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:12.013749 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cd40d284-0ca5-4bcb-9e2c-b2a5644fe2ba tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:12.014725 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cd40d284-0ca5-4bcb-9e2c-b2a5644fe2ba tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:12.015414 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cd40d284-0ca5-4bcb-9e2c-b2a5644fe2ba tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:12.016438 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cd40d284-0ca5-4bcb-9e2c-b2a5644fe2ba tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:12.017141 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cd40d284-0ca5-4bcb-9e2c-b2a5644fe2ba tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:12.017881 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cd40d284-0ca5-4bcb-9e2c-b2a5644fe2ba tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:12.085048 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-d9514168-fbf7-4c6a-bcc3-2b4beb16fdda tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:12.086479 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-d9514168-fbf7-4c6a-bcc3-2b4beb16fdda tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: c7e330f4-220e-4dce-b65e-0aedb3206dda] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:12.108002 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d9514168-fbf7-4c6a-bcc3-2b4beb16fdda tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:12.111019 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d9514168-fbf7-4c6a-bcc3-2b4beb16fdda tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:12.111463 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d9514168-fbf7-4c6a-bcc3-2b4beb16fdda tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:12.114720 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d9514168-fbf7-4c6a-bcc3-2b4beb16fdda tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:12.115225 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d9514168-fbf7-4c6a-bcc3-2b4beb16fdda tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:12.115690 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d9514168-fbf7-4c6a-bcc3-2b4beb16fdda tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:12.228515 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.objects.instance [None req-cd40d284-0ca5-4bcb-9e2c-b2a5644fe2ba tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lazy-loading 'services' on Instance uuid dbacaeed-a40b-4e05-9635-5073dfdd8621 {{(pid=140492) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 21:08:12.409644 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-cd40d284-0ca5-4bcb-9e2c-b2a5644fe2ba tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] 10.222.0.26 "DELETE /compute/v2.1/servers/dbacaeed-a40b-4e05-9635-5073dfdd8621/os-volume_attachments/31e209f5-1092-4499-a719-01507df30223" status: 202 len: 0 microversion: 2.20 time: 0.422126 Oct 08 21:08:12.410589 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1960/3838] 10.222.0.26 () {60 vars in 1457 bytes} [Sat Oct 8 21:08:11 2022] DELETE /compute/v2.1/servers/dbacaeed-a40b-4e05-9635-5073dfdd8621/os-volume_attachments/31e209f5-1092-4499-a719-01507df30223 => generated 0 bytes in 424 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 08 21:08:12.431890 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-5a8e84da-3e2c-4bfc-90bb-b03feec5edb6 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Calling method '.version_select at 0x7f1a87cc2f70>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:12.517892 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-5a8e84da-3e2c-4bfc-90bb-b03feec5edb6 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "GET /compute/v2.1/images/fa798238-0b05-4e9a-a4b3-2d47579804f6" status: 200 len: 1412 microversion: 2.1 time: 0.103092 Oct 08 21:08:12.528711 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1961/3839] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:08:12 2022] GET /compute/v2.1/images/fa798238-0b05-4e9a-a4b3-2d47579804f6 => generated 1412 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:08:12.538332 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-9c0adb58-7870-4bb7-a2bc-3559d97225ff tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:12.539579 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-9c0adb58-7870-4bb7-a2bc-3559d97225ff tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: 911394e0-0af3-4433-acfb-a4652d4e2e84] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:12.548336 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9c0adb58-7870-4bb7-a2bc-3559d97225ff tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:12.549230 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9c0adb58-7870-4bb7-a2bc-3559d97225ff tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:12.549918 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9c0adb58-7870-4bb7-a2bc-3559d97225ff tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:12.550876 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9c0adb58-7870-4bb7-a2bc-3559d97225ff tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:12.552040 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9c0adb58-7870-4bb7-a2bc-3559d97225ff tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:12.552706 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9c0adb58-7870-4bb7-a2bc-3559d97225ff tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:12.608433 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-d9514168-fbf7-4c6a-bcc3-2b4beb16fdda tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06443b5728fb4d1e95d6245820e786bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ded993145b4eda9d6a33b994519012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:12.628033 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-d9514168-fbf7-4c6a-bcc3-2b4beb16fdda tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "GET /compute/v2.1/servers/c7e330f4-220e-4dce-b65e-0aedb3206dda" status: 200 len: 1497 microversion: 2.1 time: 0.546678 Oct 08 21:08:12.631151 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1879/3840] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:08:12 2022] GET /compute/v2.1/servers/c7e330f4-220e-4dce-b65e-0aedb3206dda => generated 1497 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:08:12.643117 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-0db7b4f4-b87d-45ba-800d-148784e4ad9d tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:12.647862 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-0db7b4f4-b87d-45ba-800d-148784e4ad9d tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] [instance: dbacaeed-a40b-4e05-9635-5073dfdd8621] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:12.658192 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0db7b4f4-b87d-45ba-800d-148784e4ad9d tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:12.659270 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0db7b4f4-b87d-45ba-800d-148784e4ad9d tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:12.660367 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0db7b4f4-b87d-45ba-800d-148784e4ad9d tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:12.661509 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0db7b4f4-b87d-45ba-800d-148784e4ad9d tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:12.662376 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0db7b4f4-b87d-45ba-800d-148784e4ad9d tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:12.663062 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0db7b4f4-b87d-45ba-800d-148784e4ad9d tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:12.728200 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-0db7b4f4-b87d-45ba-800d-148784e4ad9d tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] 10.222.0.26 "GET /compute/v2.1/servers/dbacaeed-a40b-4e05-9635-5073dfdd8621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.095342 Oct 08 21:08:12.730602 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1880/3841] 10.222.0.26 () {60 vars in 1343 bytes} [Sat Oct 8 21:08:12 2022] GET /compute/v2.1/servers/dbacaeed-a40b-4e05-9635-5073dfdd8621/os-volume_attachments => generated 197 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 08 21:08:12.739191 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-295f83fb-2b37-41a4-9175-a7ab0e66ed04 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:12.744467 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-295f83fb-2b37-41a4-9175-a7ab0e66ed04 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] [instance: b1983b4c-4fd2-4ec8-9fb0-aa1f7fa51219] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:12.767122 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-295f83fb-2b37-41a4-9175-a7ab0e66ed04 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:12.767484 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-295f83fb-2b37-41a4-9175-a7ab0e66ed04 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:12.770477 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-295f83fb-2b37-41a4-9175-a7ab0e66ed04 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:12.771456 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-295f83fb-2b37-41a4-9175-a7ab0e66ed04 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:12.772136 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-295f83fb-2b37-41a4-9175-a7ab0e66ed04 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:12.773471 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-295f83fb-2b37-41a4-9175-a7ab0e66ed04 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:12.867409 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-9c0adb58-7870-4bb7-a2bc-3559d97225ff tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78e9afd772c4de981cac8f5817ec356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765c62cac2ee4406b23a5baa85c52ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:12.882629 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-9c0adb58-7870-4bb7-a2bc-3559d97225ff tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/911394e0-0af3-4433-acfb-a4652d4e2e84" status: 200 len: 1315 microversion: 2.1 time: 0.352086 Oct 08 21:08:12.883256 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1962/3842] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:08:12 2022] GET /compute/v2.1/servers/911394e0-0af3-4433-acfb-a4652d4e2e84 => generated 1315 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:08:12.969873 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-295f83fb-2b37-41a4-9175-a7ab0e66ed04 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9cd61a0df164a9e9197022508adafbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acc59093f954b61ba9f3cd05e940c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:12.983075 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-295f83fb-2b37-41a4-9175-a7ab0e66ed04 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9cd61a0df164a9e9197022508adafbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acc59093f954b61ba9f3cd05e940c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:12.998377 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-295f83fb-2b37-41a4-9175-a7ab0e66ed04 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9cd61a0df164a9e9197022508adafbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acc59093f954b61ba9f3cd05e940c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:13.003122 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-295f83fb-2b37-41a4-9175-a7ab0e66ed04 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] 10.222.0.26 "GET /compute/v2.1/servers/b1983b4c-4fd2-4ec8-9fb0-aa1f7fa51219" status: 200 len: 1427 microversion: 2.54 time: 0.270641 Oct 08 21:08:13.005944 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1881/3843] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:08:12 2022] GET /compute/v2.1/servers/b1983b4c-4fd2-4ec8-9fb0-aa1f7fa51219 => generated 1427 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:08:13.465001 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-aa4d6d74-7e6d-4b4f-8b5b-2cc5e55eb624 req-50c38a42-d1fe-4322-aade-a5379f3c5054 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7e330f4-220e-4dce-b65e-0aedb3206dda", "name": "network-vif-deleted", "tag": "7ff15e3c-6e54-4f77-99ea-ec095e513133"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:08:13.515882 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-aa4d6d74-7e6d-4b4f-8b5b-2cc5e55eb624 req-50c38a42-d1fe-4322-aade-a5379f3c5054 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:13.520166 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-aa4d6d74-7e6d-4b4f-8b5b-2cc5e55eb624 req-50c38a42-d1fe-4322-aade-a5379f3c5054 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:13.522347 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-aa4d6d74-7e6d-4b4f-8b5b-2cc5e55eb624 req-50c38a42-d1fe-4322-aade-a5379f3c5054 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:13.537747 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-52f67ca9-0783-4f20-ba80-ae9ca7b48403 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Calling method '.version_select at 0x7f1a8c61d790>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:13.542984 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:08:13.618089 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-aa4d6d74-7e6d-4b4f-8b5b-2cc5e55eb624 req-50c38a42-d1fe-4322-aade-a5379f3c5054 service nova] Creating event network-vif-deleted:7ff15e3c-6e54-4f77-99ea-ec095e513133 for instance c7e330f4-220e-4dce-b65e-0aedb3206dda on nch2-master-1 Oct 08 21:08:13.657675 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-aa4d6d74-7e6d-4b4f-8b5b-2cc5e55eb624 req-50c38a42-d1fe-4322-aade-a5379f3c5054 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.197614 Oct 08 21:08:13.661081 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1963/3844] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:08:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:08:13.684881 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-1ec0a910-3744-4731-acc4-83f35315793f tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:13.685817 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-1ec0a910-3744-4731-acc4-83f35315793f tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: c7e330f4-220e-4dce-b65e-0aedb3206dda] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:13.691929 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-52f67ca9-0783-4f20-ba80-ae9ca7b48403 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "GET /compute/v2.1/images/fa798238-0b05-4e9a-a4b3-2d47579804f6" status: 200 len: 1412 microversion: 2.1 time: 0.161130 Oct 08 21:08:13.697090 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1882/3845] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:08:13 2022] GET /compute/v2.1/images/fa798238-0b05-4e9a-a4b3-2d47579804f6 => generated 1412 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:08:13.722544 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1ec0a910-3744-4731-acc4-83f35315793f tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:13.723231 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1ec0a910-3744-4731-acc4-83f35315793f tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:13.723709 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1ec0a910-3744-4731-acc4-83f35315793f tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:13.724474 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1ec0a910-3744-4731-acc4-83f35315793f tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:13.725567 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1ec0a910-3744-4731-acc4-83f35315793f tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:13.726040 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1ec0a910-3744-4731-acc4-83f35315793f tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:13.744767 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-cc0cb4e5-4c8f-4eee-89f0-8be895e3929a tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:13.747704 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-cc0cb4e5-4c8f-4eee-89f0-8be895e3929a tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] [instance: dbacaeed-a40b-4e05-9635-5073dfdd8621] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:13.764126 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cc0cb4e5-4c8f-4eee-89f0-8be895e3929a tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:13.764880 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cc0cb4e5-4c8f-4eee-89f0-8be895e3929a tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:13.766091 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cc0cb4e5-4c8f-4eee-89f0-8be895e3929a tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:13.767240 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cc0cb4e5-4c8f-4eee-89f0-8be895e3929a tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:13.767892 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cc0cb4e5-4c8f-4eee-89f0-8be895e3929a tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:13.768672 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cc0cb4e5-4c8f-4eee-89f0-8be895e3929a tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:13.847161 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1ec0a910-3744-4731-acc4-83f35315793f tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:13.848730 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1ec0a910-3744-4731-acc4-83f35315793f tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:13.850830 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1ec0a910-3744-4731-acc4-83f35315793f tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:13.852531 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.objects.instance [None req-1ec0a910-3744-4731-acc4-83f35315793f tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lazy-loading 'fault' on Instance uuid c7e330f4-220e-4dce-b65e-0aedb3206dda {{(pid=140492) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 21:08:13.910276 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-cc0cb4e5-4c8f-4eee-89f0-8be895e3929a tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] 10.222.0.26 "GET /compute/v2.1/servers/dbacaeed-a40b-4e05-9635-5073dfdd8621/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.170919 Oct 08 21:08:13.911717 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1883/3846] 10.222.0.26 () {60 vars in 1343 bytes} [Sat Oct 8 21:08:13 2022] GET /compute/v2.1/servers/dbacaeed-a40b-4e05-9635-5073dfdd8621/os-volume_attachments => generated 25 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:08:13.921637 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-a9d6ce9a-cbfa-49ca-ae34-6fda1411e7e4 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:13.922752 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-a9d6ce9a-cbfa-49ca-ae34-6fda1411e7e4 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: 911394e0-0af3-4433-acfb-a4652d4e2e84] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:13.932152 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a9d6ce9a-cbfa-49ca-ae34-6fda1411e7e4 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:13.933522 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a9d6ce9a-cbfa-49ca-ae34-6fda1411e7e4 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:13.934686 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a9d6ce9a-cbfa-49ca-ae34-6fda1411e7e4 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:13.935786 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a9d6ce9a-cbfa-49ca-ae34-6fda1411e7e4 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:13.936424 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a9d6ce9a-cbfa-49ca-ae34-6fda1411e7e4 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:13.938421 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a9d6ce9a-cbfa-49ca-ae34-6fda1411e7e4 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:14.000185 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-1ec0a910-3744-4731-acc4-83f35315793f tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06443b5728fb4d1e95d6245820e786bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ded993145b4eda9d6a33b994519012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:14.035692 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-1ec0a910-3744-4731-acc4-83f35315793f tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "GET /compute/v2.1/servers/c7e330f4-220e-4dce-b65e-0aedb3206dda" status: 200 len: 1299 microversion: 2.1 time: 0.369353 Oct 08 21:08:14.048091 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1964/3847] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:08:13 2022] GET /compute/v2.1/servers/c7e330f4-220e-4dce-b65e-0aedb3206dda => generated 1299 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:08:14.069346 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-70be10fe-f8c8-4b42-a17f-e23d7df59e73 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:14.075126 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-70be10fe-f8c8-4b42-a17f-e23d7df59e73 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] [instance: b1983b4c-4fd2-4ec8-9fb0-aa1f7fa51219] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:14.095959 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-70be10fe-f8c8-4b42-a17f-e23d7df59e73 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:14.096691 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-70be10fe-f8c8-4b42-a17f-e23d7df59e73 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:14.097304 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-70be10fe-f8c8-4b42-a17f-e23d7df59e73 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:14.098369 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-70be10fe-f8c8-4b42-a17f-e23d7df59e73 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:14.099156 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-70be10fe-f8c8-4b42-a17f-e23d7df59e73 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:14.100550 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-70be10fe-f8c8-4b42-a17f-e23d7df59e73 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:14.266443 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-70be10fe-f8c8-4b42-a17f-e23d7df59e73 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9cd61a0df164a9e9197022508adafbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acc59093f954b61ba9f3cd05e940c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:14.286727 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-a9d6ce9a-cbfa-49ca-ae34-6fda1411e7e4 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78e9afd772c4de981cac8f5817ec356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765c62cac2ee4406b23a5baa85c52ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:14.301987 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-a9d6ce9a-cbfa-49ca-ae34-6fda1411e7e4 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/911394e0-0af3-4433-acfb-a4652d4e2e84" status: 200 len: 1501 microversion: 2.1 time: 0.387786 Oct 08 21:08:14.302623 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1884/3848] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:08:13 2022] GET /compute/v2.1/servers/911394e0-0af3-4433-acfb-a4652d4e2e84 => generated 1501 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:08:14.309743 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-aa57474e-6865-48f8-8796-d71c5ce059ce tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:14.310552 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-aa57474e-6865-48f8-8796-d71c5ce059ce tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] [instance: dbacaeed-a40b-4e05-9635-5073dfdd8621] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:14.319841 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-aa57474e-6865-48f8-8796-d71c5ce059ce tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:14.320664 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-aa57474e-6865-48f8-8796-d71c5ce059ce tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:14.321306 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-aa57474e-6865-48f8-8796-d71c5ce059ce tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:14.322264 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-aa57474e-6865-48f8-8796-d71c5ce059ce tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:14.322905 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-aa57474e-6865-48f8-8796-d71c5ce059ce tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:14.324489 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-aa57474e-6865-48f8-8796-d71c5ce059ce tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:14.335090 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-70be10fe-f8c8-4b42-a17f-e23d7df59e73 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9cd61a0df164a9e9197022508adafbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acc59093f954b61ba9f3cd05e940c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:14.356859 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-70be10fe-f8c8-4b42-a17f-e23d7df59e73 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9cd61a0df164a9e9197022508adafbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acc59093f954b61ba9f3cd05e940c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:14.361078 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-70be10fe-f8c8-4b42-a17f-e23d7df59e73 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] 10.222.0.26 "GET /compute/v2.1/servers/b1983b4c-4fd2-4ec8-9fb0-aa1f7fa51219" status: 200 len: 1415 microversion: 2.54 time: 0.304924 Oct 08 21:08:14.364450 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1965/3849] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:08:14 2022] GET /compute/v2.1/servers/b1983b4c-4fd2-4ec8-9fb0-aa1f7fa51219 => generated 1415 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:08:14.390944 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-aa57474e-6865-48f8-8796-d71c5ce059ce tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] [instance: dbacaeed-a40b-4e05-9635-5073dfdd8621] Going to try to terminate instance {{(pid=140491) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 21:08:14.603505 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-aa57474e-6865-48f8-8796-d71c5ce059ce tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] 10.222.0.26 "DELETE /compute/v2.1/servers/dbacaeed-a40b-4e05-9635-5073dfdd8621" status: 204 len: 0 microversion: 2.20 time: 0.299432 Oct 08 21:08:14.609293 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1885/3850] 10.222.0.26 () {60 vars in 1280 bytes} [Sat Oct 8 21:08:14 2022] DELETE /compute/v2.1/servers/dbacaeed-a40b-4e05-9635-5073dfdd8621 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 08 21:08:14.617567 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-8091041f-29a8-403b-9a3e-ec181301b4df tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:14.619010 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-8091041f-29a8-403b-9a3e-ec181301b4df tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] [instance: dbacaeed-a40b-4e05-9635-5073dfdd8621] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:14.628025 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8091041f-29a8-403b-9a3e-ec181301b4df tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:14.628978 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8091041f-29a8-403b-9a3e-ec181301b4df tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:14.629794 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8091041f-29a8-403b-9a3e-ec181301b4df tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:14.630797 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8091041f-29a8-403b-9a3e-ec181301b4df tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:14.631473 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8091041f-29a8-403b-9a3e-ec181301b4df tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:14.632189 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8091041f-29a8-403b-9a3e-ec181301b4df tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:14.749427 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-0800cf15-2c0b-4f8e-9936-fc1484a983c9 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Calling method '.version_select at 0x7f1a8c9d03a0>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:14.852403 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-0800cf15-2c0b-4f8e-9936-fc1484a983c9 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "GET /compute/v2.1/images/fa798238-0b05-4e9a-a4b3-2d47579804f6" status: 200 len: 1412 microversion: 2.1 time: 0.140008 Oct 08 21:08:14.853857 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1886/3851] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:08:14 2022] GET /compute/v2.1/images/fa798238-0b05-4e9a-a4b3-2d47579804f6 => generated 1412 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:08:15.013666 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-8091041f-29a8-403b-9a3e-ec181301b4df tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:15.027342 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-8091041f-29a8-403b-9a3e-ec181301b4df tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:15.029623 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-8091041f-29a8-403b-9a3e-ec181301b4df tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:15.030838 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-8091041f-29a8-403b-9a3e-ec181301b4df tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] 10.222.0.26 "GET /compute/v2.1/servers/dbacaeed-a40b-4e05-9635-5073dfdd8621" status: 200 len: 1723 microversion: 2.20 time: 0.421507 Oct 08 21:08:15.060352 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1966/3852] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:08:14 2022] GET /compute/v2.1/servers/dbacaeed-a40b-4e05-9635-5073dfdd8621 => generated 1723 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:08:15.070448 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-cb97b529-9b33-4928-9000-eae12ac79dcd tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:15.071737 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-cb97b529-9b33-4928-9000-eae12ac79dcd tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: c7e330f4-220e-4dce-b65e-0aedb3206dda] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:15.133093 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cb97b529-9b33-4928-9000-eae12ac79dcd tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:15.134330 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cb97b529-9b33-4928-9000-eae12ac79dcd tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:15.150605 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cb97b529-9b33-4928-9000-eae12ac79dcd tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:15.159820 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cb97b529-9b33-4928-9000-eae12ac79dcd tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:15.162657 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cb97b529-9b33-4928-9000-eae12ac79dcd tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:15.163217 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cb97b529-9b33-4928-9000-eae12ac79dcd tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:15.240306 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-cb97b529-9b33-4928-9000-eae12ac79dcd tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] HTTP exception thrown: Instance c7e330f4-220e-4dce-b65e-0aedb3206dda could not be found. Oct 08 21:08:15.245516 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-cb97b529-9b33-4928-9000-eae12ac79dcd tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Request method failure captured: Oct 08 21:08:15.245516 ncdv-master-1 devstack@n-api.service[140491]: request: GET /compute/v2.1/servers/c7e330f4-220e-4dce-b65e-0aedb3206dda HTTP/1.1 Oct 08 21:08:15.245516 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:08:15.245516 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:08:15.245516 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:08:15.245516 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 21:08:15.245516 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:08:15.245516 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:08:15.245516 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:08:15.245516 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:08:15.245516 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeYsdf-NgsPUaUb78CUpk0vq18mlUqdb1er-CKgSGnwcxKYVDw5Br5ObGheB0PHKIrwGHgJ4op59IUcxCd3ChQqclxeYxKhK3ZwkXmw1AwIGXWjgktrsk6DH6ba1NMLmZ1pzBqcyvzB3CMIuC4HBXIHDILjU44EobGpdQQ8lNmKdDFM Oct 08 21:08:15.245516 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:08:15.245516 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:08:15.245516 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:08:15.245516 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:08:15.245516 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:08:15.245516 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:08:15.245516 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: e7ded993145b4eda9d6a33b994519012 Oct 08 21:08:15.245516 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-ServersTestJSON-68907085 Oct 08 21:08:15.245516 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:08:15.245516 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:08:15.245516 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/e7ded993145b4eda9d6a33b994519012"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e7ded993145b4eda9d6a33b994519012"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_e7ded993145b4eda9d6a33b994519012"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e7ded993145b4eda9d6a33b994519012"}]}] Oct 08 21:08:15.245516 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-ServersTestJSON-68907085 Oct 08 21:08:15.245516 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: e7ded993145b4eda9d6a33b994519012 Oct 08 21:08:15.245516 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-ServersTestJSON-68907085 Oct 08 21:08:15.245516 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-ServersTestJSON-68907085-project Oct 08 21:08:15.245516 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:08:15.245516 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:08:15.245516 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 06443b5728fb4d1e95d6245820e786bf Oct 08 21:08:15.245516 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-ServersTestJSON-68907085-project Oct 08 21:08:15.245516 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:08:15.245516 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance c7e330f4-220e-4dce-b65e-0aedb3206dda could not be found. Oct 08 21:08:15.245516 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': 'c7e330f4-220e-4dce-b65e-0aedb3206dda'} Oct 08 21:08:15.245516 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:08:15.245516 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:08:15.245516 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:08:15.245516 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:08:15.245516 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:08:15.245516 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:08:15.245516 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:08:15.245516 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:08:15.245516 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:08:15.245516 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:08:15.245516 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7e330f4-220e-4dce-b65e-0aedb3206dda could not be found. Oct 08 21:08:15.245516 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:08:15.245516 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:08:15.245516 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:08:15.245516 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:08:15.245516 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:08:15.245516 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:08:15.245516 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:08:15.245516 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:08:15.245516 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:08:15.245516 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:08:15.245516 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:08:15.245516 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:08:15.245516 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:08:15.245516 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:08:15.245516 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:08:15.245516 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:08:15.245516 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7e330f4-220e-4dce-b65e-0aedb3206dda could not be found. Oct 08 21:08:15.245516 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:08:15.245516 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:08:15.245516 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:08:15.245516 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:08:15.251468 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:08:15.251468 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:08:15.251468 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:08:15.251468 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:08:15.251468 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7e330f4-220e-4dce-b65e-0aedb3206dda could not be found. Oct 08 21:08:15.251468 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:08:15.255224 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-cb97b529-9b33-4928-9000-eae12ac79dcd tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Returning 404 to user: Instance c7e330f4-220e-4dce-b65e-0aedb3206dda could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:08:15.258087 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-cb97b529-9b33-4928-9000-eae12ac79dcd tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "GET /compute/v2.1/servers/c7e330f4-220e-4dce-b65e-0aedb3206dda" status: 404 len: 111 microversion: 2.1 time: 0.194087 Oct 08 21:08:15.263522 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1887/3853] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:08:15 2022] GET /compute/v2.1/servers/c7e330f4-220e-4dce-b65e-0aedb3206dda => generated 111 bytes in 200 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:08:15.394756 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-372c3dba-7b7f-4b45-94ab-f419e1ccc050 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:15.396501 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-372c3dba-7b7f-4b45-94ab-f419e1ccc050 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] [instance: b1983b4c-4fd2-4ec8-9fb0-aa1f7fa51219] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:15.410438 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:08:15.424597 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-372c3dba-7b7f-4b45-94ab-f419e1ccc050 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:15.427880 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-372c3dba-7b7f-4b45-94ab-f419e1ccc050 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:15.429874 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-372c3dba-7b7f-4b45-94ab-f419e1ccc050 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:15.435826 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-372c3dba-7b7f-4b45-94ab-f419e1ccc050 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:15.436360 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-372c3dba-7b7f-4b45-94ab-f419e1ccc050 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:15.436844 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-372c3dba-7b7f-4b45-94ab-f419e1ccc050 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:15.546671 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-a605f2a1-0f41-4a1e-bc48-f3c57b57a160 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1726939458", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "networks": [{"uuid": "983c5654-1828-48da-a871-2028e691f4b0"}]}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:08:15.656489 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.network.neutron [None req-a605f2a1-0f41-4a1e-bc48-f3c57b57a160 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] validate_networks() for [('983c5654-1828-48da-a871-2028e691f4b0', None, None, None, None, None)] {{(pid=140491) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 21:08:15.744234 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-372c3dba-7b7f-4b45-94ab-f419e1ccc050 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9cd61a0df164a9e9197022508adafbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acc59093f954b61ba9f3cd05e940c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:15.764222 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-372c3dba-7b7f-4b45-94ab-f419e1ccc050 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9cd61a0df164a9e9197022508adafbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acc59093f954b61ba9f3cd05e940c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:15.768739 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-372c3dba-7b7f-4b45-94ab-f419e1ccc050 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9cd61a0df164a9e9197022508adafbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acc59093f954b61ba9f3cd05e940c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:15.773338 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-372c3dba-7b7f-4b45-94ab-f419e1ccc050 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] 10.222.0.26 "GET /compute/v2.1/servers/b1983b4c-4fd2-4ec8-9fb0-aa1f7fa51219" status: 200 len: 1400 microversion: 2.54 time: 0.382584 Oct 08 21:08:15.775054 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1967/3854] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:08:15 2022] GET /compute/v2.1/servers/b1983b4c-4fd2-4ec8-9fb0-aa1f7fa51219 => generated 1400 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:08:15.827475 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-2fd81e25-ceb2-4ab9-8329-1e2632c80f9e tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Calling method '.version_select at 0x7f1a87d22af0>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:15.902345 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-2fd81e25-ceb2-4ab9-8329-1e2632c80f9e tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-2076284214" status: 204 len: 0 microversion: 2.54 time: 0.092476 Oct 08 21:08:15.907914 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1968/3855] 10.222.0.26 () {60 vars in 1319 bytes} [Sat Oct 8 21:08:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-2076284214 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 08 21:08:15.916269 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-cabc0621-5819-4c77-b135-e3c940aaf043 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Calling method '.version_select at 0x7f1a87df2a60>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:16.011121 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-cabc0621-5819-4c77-b135-e3c940aaf043 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "GET /compute/v2.1/images/fa798238-0b05-4e9a-a4b3-2d47579804f6" status: 200 len: 1412 microversion: 2.1 time: 0.100588 Oct 08 21:08:16.015717 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1969/3856] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:08:15 2022] GET /compute/v2.1/images/fa798238-0b05-4e9a-a4b3-2d47579804f6 => generated 1412 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:08:16.023994 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-181fcc75-9598-403d-b491-4411d9621e13 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:16.024492 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-181fcc75-9598-403d-b491-4411d9621e13 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] [instance: b1983b4c-4fd2-4ec8-9fb0-aa1f7fa51219] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:16.037292 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-181fcc75-9598-403d-b491-4411d9621e13 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:16.037822 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-181fcc75-9598-403d-b491-4411d9621e13 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:16.038293 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-181fcc75-9598-403d-b491-4411d9621e13 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:16.039076 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-181fcc75-9598-403d-b491-4411d9621e13 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:16.039588 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-181fcc75-9598-403d-b491-4411d9621e13 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:16.039983 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-181fcc75-9598-403d-b491-4411d9621e13 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:16.085265 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-181fcc75-9598-403d-b491-4411d9621e13 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] [instance: b1983b4c-4fd2-4ec8-9fb0-aa1f7fa51219] Going to try to terminate instance {{(pid=140492) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 21:08:16.273376 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-181fcc75-9598-403d-b491-4411d9621e13 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] 10.222.0.26 "DELETE /compute/v2.1/servers/b1983b4c-4fd2-4ec8-9fb0-aa1f7fa51219" status: 204 len: 0 microversion: 2.54 time: 0.255156 Oct 08 21:08:16.274865 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1970/3857] 10.222.0.26 () {60 vars in 1280 bytes} [Sat Oct 8 21:08:16 2022] DELETE /compute/v2.1/servers/b1983b4c-4fd2-4ec8-9fb0-aa1f7fa51219 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 08 21:08:16.289864 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-47ac79e0-4b95-4660-9cb5-cceab7cba6b1 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:16.291555 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-47ac79e0-4b95-4660-9cb5-cceab7cba6b1 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] [instance: dbacaeed-a40b-4e05-9635-5073dfdd8621] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:16.301526 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-47ac79e0-4b95-4660-9cb5-cceab7cba6b1 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:16.302404 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-47ac79e0-4b95-4660-9cb5-cceab7cba6b1 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:16.303111 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-47ac79e0-4b95-4660-9cb5-cceab7cba6b1 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:16.304181 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-47ac79e0-4b95-4660-9cb5-cceab7cba6b1 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:16.304663 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-47ac79e0-4b95-4660-9cb5-cceab7cba6b1 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:16.305097 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-47ac79e0-4b95-4660-9cb5-cceab7cba6b1 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:16.428693 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-a605f2a1-0f41-4a1e-bc48-f3c57b57a160 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Flavor limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 21:08:16.429231 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-a605f2a1-0f41-4a1e-bc48-f3c57b57a160 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Image limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 21:08:16.429944 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-a605f2a1-0f41-4a1e-bc48-f3c57b57a160 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Flavor pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 21:08:16.430559 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-a605f2a1-0f41-4a1e-bc48-f3c57b57a160 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Image pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 21:08:16.431250 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-a605f2a1-0f41-4a1e-bc48-f3c57b57a160 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 21:08:16.441502 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a605f2a1-0f41-4a1e-bc48-f3c57b57a160 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:16.442192 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a605f2a1-0f41-4a1e-bc48-f3c57b57a160 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:16.442457 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a605f2a1-0f41-4a1e-bc48-f3c57b57a160 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:16.443179 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a605f2a1-0f41-4a1e-bc48-f3c57b57a160 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:16.443874 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a605f2a1-0f41-4a1e-bc48-f3c57b57a160 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:16.444269 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a605f2a1-0f41-4a1e-bc48-f3c57b57a160 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:16.469669 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-a605f2a1-0f41-4a1e-bc48-f3c57b57a160 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Getting quotas for project e7ded993145b4eda9d6a33b994519012. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:08:16.475736 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-a605f2a1-0f41-4a1e-bc48-f3c57b57a160 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Getting quotas for user 06443b5728fb4d1e95d6245820e786bf and project e7ded993145b4eda9d6a33b994519012. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:08:16.496063 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-a605f2a1-0f41-4a1e-bc48-f3c57b57a160 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Going to run 1 instances... {{(pid=140491) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 21:08:16.499096 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-a605f2a1-0f41-4a1e-bc48-f3c57b57a160 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: 4e630da9-7820-47ef-ac72-1c91af94ff64] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c508bd7f-7db9-4b2c-af7c-be54a855c355',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140491) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 21:08:16.571760 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-a605f2a1-0f41-4a1e-bc48-f3c57b57a160 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.032234 Oct 08 21:08:16.574381 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1888/3858] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 21:08:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 1036 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 08 21:08:16.582816 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-f6502122-982f-477e-9110-c349a43536d2 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:16.587316 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-f6502122-982f-477e-9110-c349a43536d2 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] [instance: b1983b4c-4fd2-4ec8-9fb0-aa1f7fa51219] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:16.617109 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f6502122-982f-477e-9110-c349a43536d2 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:16.617669 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f6502122-982f-477e-9110-c349a43536d2 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:16.618373 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f6502122-982f-477e-9110-c349a43536d2 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:16.620904 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f6502122-982f-477e-9110-c349a43536d2 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:16.622020 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f6502122-982f-477e-9110-c349a43536d2 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:16.623579 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f6502122-982f-477e-9110-c349a43536d2 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:16.733961 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-f6502122-982f-477e-9110-c349a43536d2 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9cd61a0df164a9e9197022508adafbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acc59093f954b61ba9f3cd05e940c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:16.743030 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-f6502122-982f-477e-9110-c349a43536d2 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9cd61a0df164a9e9197022508adafbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acc59093f954b61ba9f3cd05e940c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:16.744594 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-f6502122-982f-477e-9110-c349a43536d2 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9cd61a0df164a9e9197022508adafbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acc59093f954b61ba9f3cd05e940c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:16.746889 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-f6502122-982f-477e-9110-c349a43536d2 tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] 10.222.0.26 "GET /compute/v2.1/servers/b1983b4c-4fd2-4ec8-9fb0-aa1f7fa51219" status: 200 len: 1406 microversion: 2.54 time: 0.171109 Oct 08 21:08:16.747853 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1889/3859] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:08:16 2022] GET /compute/v2.1/servers/b1983b4c-4fd2-4ec8-9fb0-aa1f7fa51219 => generated 1406 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:08:16.753095 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-fbc152b7-f8f1-42a1-bfa7-0da5e143fec8 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d22df1a4-c142-4980-a855-4b5f1733fd4d"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:08:16.755729 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-fbc152b7-f8f1-42a1-bfa7-0da5e143fec8 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: 911394e0-0af3-4433-acfb-a4652d4e2e84] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:16.764167 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fbc152b7-f8f1-42a1-bfa7-0da5e143fec8 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:16.764779 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fbc152b7-f8f1-42a1-bfa7-0da5e143fec8 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:16.765271 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fbc152b7-f8f1-42a1-bfa7-0da5e143fec8 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:16.765964 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fbc152b7-f8f1-42a1-bfa7-0da5e143fec8 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:16.766432 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fbc152b7-f8f1-42a1-bfa7-0da5e143fec8 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:16.766878 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fbc152b7-f8f1-42a1-bfa7-0da5e143fec8 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:16.781962 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-47ac79e0-4b95-4660-9cb5-cceab7cba6b1 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:16.795333 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-47ac79e0-4b95-4660-9cb5-cceab7cba6b1 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:16.797052 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-47ac79e0-4b95-4660-9cb5-cceab7cba6b1 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:16.806784 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-47ac79e0-4b95-4660-9cb5-cceab7cba6b1 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] 10.222.0.26 "GET /compute/v2.1/servers/dbacaeed-a40b-4e05-9635-5073dfdd8621" status: 200 len: 1723 microversion: 2.20 time: 0.529880 Oct 08 21:08:16.807430 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1971/3860] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:08:16 2022] GET /compute/v2.1/servers/dbacaeed-a40b-4e05-9635-5073dfdd8621 => generated 1723 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:08:16.827416 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-3cccdcef-2671-482c-82c9-281bb2d3e40f tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:16.830714 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-3cccdcef-2671-482c-82c9-281bb2d3e40f tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: 4e630da9-7820-47ef-ac72-1c91af94ff64] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:16.913162 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:08:17.011675 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-3cccdcef-2671-482c-82c9-281bb2d3e40f tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06443b5728fb4d1e95d6245820e786bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ded993145b4eda9d6a33b994519012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:17.022908 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-3cccdcef-2671-482c-82c9-281bb2d3e40f tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "GET /compute/v2.1/servers/4e630da9-7820-47ef-ac72-1c91af94ff64" status: 200 len: 1209 microversion: 2.1 time: 0.212615 Oct 08 21:08:17.023829 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1972/3861] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:08:16 2022] GET /compute/v2.1/servers/4e630da9-7820-47ef-ac72-1c91af94ff64 => generated 1209 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:08:17.061053 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-a94cc7e5-7d64-463f-bfc6-95d564cc968e tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Calling method '.version_select at 0x7f1a8c096f70>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:17.145624 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-a94cc7e5-7d64-463f-bfc6-95d564cc968e tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "GET /compute/v2.1/images/fa798238-0b05-4e9a-a4b3-2d47579804f6" status: 200 len: 1421 microversion: 2.1 time: 0.103079 Oct 08 21:08:17.162671 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1973/3862] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:08:17 2022] GET /compute/v2.1/images/fa798238-0b05-4e9a-a4b3-2d47579804f6 => generated 1421 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:08:17.176221 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-8e1c3a89-fbdd-4df8-b409-1ec9fc391d11 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Calling method '.version_select at 0x7f1a87c560d0>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:17.275998 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-8e1c3a89-fbdd-4df8-b409-1ec9fc391d11 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "GET /compute/v2.1/images/fa798238-0b05-4e9a-a4b3-2d47579804f6" status: 200 len: 1421 microversion: 2.1 time: 0.108549 Oct 08 21:08:17.280139 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1974/3863] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:08:17 2022] GET /compute/v2.1/images/fa798238-0b05-4e9a-a4b3-2d47579804f6 => generated 1421 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:08:17.299108 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-14f0772d-6400-451e-ac06-83f9f94dca37 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Calling method '.version_select at 0x7f1a87d22820>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:18.149549 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-14f0772d-6400-451e-ac06-83f9f94dca37 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "DELETE /compute/v2.1/images/fa798238-0b05-4e9a-a4b3-2d47579804f6" status: 204 len: 0 microversion: 2.1 time: 0.858587 Oct 08 21:08:18.150219 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1975/3864] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:08:17 2022] DELETE /compute/v2.1/images/fa798238-0b05-4e9a-a4b3-2d47579804f6 => generated 0 bytes in 861 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 08 21:08:18.157159 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-adb6a6e8-c23c-48c7-a53d-cc4322fa2e5a tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:18.157910 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-adb6a6e8-c23c-48c7-a53d-cc4322fa2e5a tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] [instance: b1983b4c-4fd2-4ec8-9fb0-aa1f7fa51219] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:18.174979 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-adb6a6e8-c23c-48c7-a53d-cc4322fa2e5a tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:18.175558 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-adb6a6e8-c23c-48c7-a53d-cc4322fa2e5a tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:18.176084 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-adb6a6e8-c23c-48c7-a53d-cc4322fa2e5a tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:18.176909 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-adb6a6e8-c23c-48c7-a53d-cc4322fa2e5a tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:18.177409 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-adb6a6e8-c23c-48c7-a53d-cc4322fa2e5a tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:18.182284 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-adb6a6e8-c23c-48c7-a53d-cc4322fa2e5a tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:18.186736 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-fbc152b7-f8f1-42a1-bfa7-0da5e143fec8 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "POST /compute/v2.1/servers/911394e0-0af3-4433-acfb-a4652d4e2e84/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.437334 Oct 08 21:08:18.195059 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1890/3865] 10.222.0.26 () {60 vars in 1323 bytes} [Sat Oct 8 21:08:16 2022] POST /compute/v2.1/servers/911394e0-0af3-4433-acfb-a4652d4e2e84/os-volume_attachments => generated 194 bytes in 1446 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:08:18.215111 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-23a849eb-56ca-4a35-8695-2732417fa0d7 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:18.220002 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-23a849eb-56ca-4a35-8695-2732417fa0d7 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] [instance: dbacaeed-a40b-4e05-9635-5073dfdd8621] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:18.251410 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-23a849eb-56ca-4a35-8695-2732417fa0d7 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:18.251931 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-23a849eb-56ca-4a35-8695-2732417fa0d7 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:18.252397 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-23a849eb-56ca-4a35-8695-2732417fa0d7 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:18.253144 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-23a849eb-56ca-4a35-8695-2732417fa0d7 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:18.253650 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-23a849eb-56ca-4a35-8695-2732417fa0d7 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:18.263340 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-23a849eb-56ca-4a35-8695-2732417fa0d7 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:18.338089 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-adb6a6e8-c23c-48c7-a53d-cc4322fa2e5a tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:18.338574 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-adb6a6e8-c23c-48c7-a53d-cc4322fa2e5a tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:18.339118 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-adb6a6e8-c23c-48c7-a53d-cc4322fa2e5a tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:18.355634 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.objects.instance [None req-adb6a6e8-c23c-48c7-a53d-cc4322fa2e5a tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Lazy-loading 'fault' on Instance uuid b1983b4c-4fd2-4ec8-9fb0-aa1f7fa51219 {{(pid=140492) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 21:08:18.524140 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-adb6a6e8-c23c-48c7-a53d-cc4322fa2e5a tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9cd61a0df164a9e9197022508adafbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acc59093f954b61ba9f3cd05e940c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:18.536155 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-adb6a6e8-c23c-48c7-a53d-cc4322fa2e5a tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9cd61a0df164a9e9197022508adafbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acc59093f954b61ba9f3cd05e940c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:18.537920 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-adb6a6e8-c23c-48c7-a53d-cc4322fa2e5a tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9cd61a0df164a9e9197022508adafbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acc59093f954b61ba9f3cd05e940c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:18.539320 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-adb6a6e8-c23c-48c7-a53d-cc4322fa2e5a tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] 10.222.0.26 "GET /compute/v2.1/servers/b1983b4c-4fd2-4ec8-9fb0-aa1f7fa51219" status: 200 len: 1411 microversion: 2.54 time: 0.386850 Oct 08 21:08:18.541767 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1976/3866] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:08:18 2022] GET /compute/v2.1/servers/b1983b4c-4fd2-4ec8-9fb0-aa1f7fa51219 => generated 1411 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:08:18.549146 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e658cc63-6790-42bb-b7db-6bc3f3d2a076 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:18.556759 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-e658cc63-6790-42bb-b7db-6bc3f3d2a076 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: 4e630da9-7820-47ef-ac72-1c91af94ff64] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:18.573433 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-23a849eb-56ca-4a35-8695-2732417fa0d7 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:18.574948 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e658cc63-6790-42bb-b7db-6bc3f3d2a076 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:18.575670 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e658cc63-6790-42bb-b7db-6bc3f3d2a076 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:18.576498 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e658cc63-6790-42bb-b7db-6bc3f3d2a076 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:18.577503 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e658cc63-6790-42bb-b7db-6bc3f3d2a076 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:18.578705 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e658cc63-6790-42bb-b7db-6bc3f3d2a076 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:18.579451 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e658cc63-6790-42bb-b7db-6bc3f3d2a076 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:18.587051 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-23a849eb-56ca-4a35-8695-2732417fa0d7 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:18.589392 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-23a849eb-56ca-4a35-8695-2732417fa0d7 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:18.590569 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-23a849eb-56ca-4a35-8695-2732417fa0d7 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] 10.222.0.26 "GET /compute/v2.1/servers/dbacaeed-a40b-4e05-9635-5073dfdd8621" status: 200 len: 1657 microversion: 2.20 time: 0.393836 Oct 08 21:08:18.591179 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1891/3867] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:08:18 2022] GET /compute/v2.1/servers/dbacaeed-a40b-4e05-9635-5073dfdd8621 => generated 1657 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:08:18.615861 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-4da812af-aa0a-4ca8-bd44-b276b9e7eef9 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:18.616435 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-4da812af-aa0a-4ca8-bd44-b276b9e7eef9 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] [instance: f1b4faf3-0c03-4e0c-be81-be3305b8314f] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:18.633862 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4da812af-aa0a-4ca8-bd44-b276b9e7eef9 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:18.634368 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4da812af-aa0a-4ca8-bd44-b276b9e7eef9 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:18.644386 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4da812af-aa0a-4ca8-bd44-b276b9e7eef9 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:18.645374 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4da812af-aa0a-4ca8-bd44-b276b9e7eef9 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:18.645936 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4da812af-aa0a-4ca8-bd44-b276b9e7eef9 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:18.646382 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4da812af-aa0a-4ca8-bd44-b276b9e7eef9 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:18.741616 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-4da812af-aa0a-4ca8-bd44-b276b9e7eef9 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] [instance: f1b4faf3-0c03-4e0c-be81-be3305b8314f] Going to try to terminate instance {{(pid=140491) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 21:08:18.790668 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-e658cc63-6790-42bb-b7db-6bc3f3d2a076 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06443b5728fb4d1e95d6245820e786bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ded993145b4eda9d6a33b994519012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:18.803895 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-e658cc63-6790-42bb-b7db-6bc3f3d2a076 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "GET /compute/v2.1/servers/4e630da9-7820-47ef-ac72-1c91af94ff64" status: 200 len: 1261 microversion: 2.1 time: 0.256111 Oct 08 21:08:18.804734 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1977/3868] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:08:18 2022] GET /compute/v2.1/servers/4e630da9-7820-47ef-ac72-1c91af94ff64 => generated 1261 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:08:18.822230 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-a201d661-b54f-45f1-925f-0e192a933489 req-bce9642b-eb6d-4cd7-8267-882947fe6faf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbacaeed-a40b-4e05-9635-5073dfdd8621", "name": "network-vif-deleted", "tag": "6fe657e1-039e-4549-b2d4-955cfbaed37d"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:08:18.867498 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-a201d661-b54f-45f1-925f-0e192a933489 req-bce9642b-eb6d-4cd7-8267-882947fe6faf service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:18.869966 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-a201d661-b54f-45f1-925f-0e192a933489 req-bce9642b-eb6d-4cd7-8267-882947fe6faf service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:18.876621 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-a201d661-b54f-45f1-925f-0e192a933489 req-bce9642b-eb6d-4cd7-8267-882947fe6faf service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:18.930684 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-a201d661-b54f-45f1-925f-0e192a933489 req-bce9642b-eb6d-4cd7-8267-882947fe6faf service nova] Creating event network-vif-deleted:6fe657e1-039e-4549-b2d4-955cfbaed37d for instance dbacaeed-a40b-4e05-9635-5073dfdd8621 on nch2-master-1 Oct 08 21:08:18.951961 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-a201d661-b54f-45f1-925f-0e192a933489 req-bce9642b-eb6d-4cd7-8267-882947fe6faf service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143571 Oct 08 21:08:18.953342 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1978/3869] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:08:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:08:19.075951 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-4da812af-aa0a-4ca8-bd44-b276b9e7eef9 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "DELETE /compute/v2.1/servers/f1b4faf3-0c03-4e0c-be81-be3305b8314f" status: 204 len: 0 microversion: 2.1 time: 0.483411 Oct 08 21:08:19.078755 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1892/3870] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:08:18 2022] DELETE /compute/v2.1/servers/f1b4faf3-0c03-4e0c-be81-be3305b8314f => generated 0 bytes in 487 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 21:08:19.392347 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-6c78e87d-909c-4630-9be2-88765958ae4c tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-662587486", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "networks": [{"uuid": "76a3600a-da76-44b8-88b9-2779bd398388"}]}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:08:19.536689 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.network.neutron [None req-6c78e87d-909c-4630-9be2-88765958ae4c tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] validate_networks() for [('76a3600a-da76-44b8-88b9-2779bd398388', None, None, None, None, None)] {{(pid=140492) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 21:08:19.572147 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-623c1b4b-9dbb-4535-a107-50bb0e7521ae tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:19.573648 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-623c1b4b-9dbb-4535-a107-50bb0e7521ae tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] [instance: b1983b4c-4fd2-4ec8-9fb0-aa1f7fa51219] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:19.587474 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-623c1b4b-9dbb-4535-a107-50bb0e7521ae tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:19.588272 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-623c1b4b-9dbb-4535-a107-50bb0e7521ae tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:19.591933 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-623c1b4b-9dbb-4535-a107-50bb0e7521ae tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:19.592944 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-623c1b4b-9dbb-4535-a107-50bb0e7521ae tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:19.593636 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-623c1b4b-9dbb-4535-a107-50bb0e7521ae tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:19.595520 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-623c1b4b-9dbb-4535-a107-50bb0e7521ae tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:19.632846 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-623c1b4b-9dbb-4535-a107-50bb0e7521ae tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] HTTP exception thrown: Instance b1983b4c-4fd2-4ec8-9fb0-aa1f7fa51219 could not be found. Oct 08 21:08:19.634982 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-623c1b4b-9dbb-4535-a107-50bb0e7521ae tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Request method failure captured: Oct 08 21:08:19.634982 ncdv-master-1 devstack@n-api.service[140491]: request: GET /compute/v2.1/servers/b1983b4c-4fd2-4ec8-9fb0-aa1f7fa51219 HTTP/1.1 Oct 08 21:08:19.634982 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:08:19.634982 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:08:19.634982 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:08:19.634982 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 21:08:19.634982 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:08:19.634982 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:08:19.634982 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:08:19.634982 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:08:19.634982 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeaR9yP8cNwAQDVBzH-XKkyj7-Ft4cJZHLK1rDty5T--WTaX9GbzZ78sezwzRQ6iTb4K2w-EFn-ZHpavCp2wU8qFYX6cvb8S-bX8R24UuuW4LggVyUD2rK519iQk6zRQP9tuHanKyKl9IE900E6XmTAo0BA1hiuO3lZipwJBfrcpylc Oct 08 21:08:19.634982 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:08:19.634982 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:08:19.634982 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:08:19.634982 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:08:19.634982 ncdv-master-1 devstack@n-api.service[140491]: X-Openstack-Nova-Api-Version: 2.54 Oct 08 21:08:19.634982 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:08:19.634982 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:08:19.634982 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 4acc59093f954b61ba9f3cd05e940c28 Oct 08 21:08:19.634982 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-ServerShowV254Test-86056349 Oct 08 21:08:19.634982 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:08:19.634982 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:08:19.634982 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/4acc59093f954b61ba9f3cd05e940c28"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4acc59093f954b61ba9f3cd05e940c28"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_4acc59093f954b61ba9f3cd05e940c28"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4acc59093f954b61ba9f3cd05e940c28"}]}] Oct 08 21:08:19.634982 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-ServerShowV254Test-86056349 Oct 08 21:08:19.634982 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 4acc59093f954b61ba9f3cd05e940c28 Oct 08 21:08:19.634982 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-ServerShowV254Test-86056349 Oct 08 21:08:19.634982 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-ServerShowV254Test-86056349-project Oct 08 21:08:19.634982 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:08:19.634982 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:08:19.634982 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: b9cd61a0df164a9e9197022508adafbf Oct 08 21:08:19.634982 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-ServerShowV254Test-86056349-project Oct 08 21:08:19.634982 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:08:19.634982 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance b1983b4c-4fd2-4ec8-9fb0-aa1f7fa51219 could not be found. Oct 08 21:08:19.634982 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': 'b1983b4c-4fd2-4ec8-9fb0-aa1f7fa51219'} Oct 08 21:08:19.634982 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:08:19.634982 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:08:19.634982 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:08:19.634982 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:08:19.634982 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:08:19.634982 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:08:19.634982 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:08:19.634982 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:08:19.634982 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:08:19.634982 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:08:19.634982 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1983b4c-4fd2-4ec8-9fb0-aa1f7fa51219 could not be found. Oct 08 21:08:19.634982 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:08:19.634982 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:08:19.634982 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:08:19.634982 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:08:19.634982 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:08:19.634982 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:08:19.634982 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:08:19.634982 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:08:19.634982 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:08:19.634982 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:08:19.634982 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:08:19.634982 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:08:19.634982 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:08:19.634982 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:08:19.634982 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:08:19.634982 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:08:19.634982 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1983b4c-4fd2-4ec8-9fb0-aa1f7fa51219 could not be found. Oct 08 21:08:19.634982 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:08:19.634982 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:08:19.634982 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:08:19.641407 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:08:19.641407 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:08:19.641407 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:08:19.641407 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:08:19.641407 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:08:19.641407 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1983b4c-4fd2-4ec8-9fb0-aa1f7fa51219 could not be found. Oct 08 21:08:19.641407 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:08:19.643015 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-623c1b4b-9dbb-4535-a107-50bb0e7521ae tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] Returning 404 to user: Instance b1983b4c-4fd2-4ec8-9fb0-aa1f7fa51219 could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:08:19.644218 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-623c1b4b-9dbb-4535-a107-50bb0e7521ae tempest-ServerShowV254Test-86056349 tempest-ServerShowV254Test-86056349-project] 10.222.0.26 "GET /compute/v2.1/servers/b1983b4c-4fd2-4ec8-9fb0-aa1f7fa51219" status: 404 len: 111 microversion: 2.54 time: 0.077247 Oct 08 21:08:19.649858 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1893/3871] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:08:19 2022] GET /compute/v2.1/servers/b1983b4c-4fd2-4ec8-9fb0-aa1f7fa51219 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 08 21:08:19.658872 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-9162c30a-6ace-4d87-8205-4e2e486aec62 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:19.659977 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-9162c30a-6ace-4d87-8205-4e2e486aec62 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] [instance: dbacaeed-a40b-4e05-9635-5073dfdd8621] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:19.670025 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9162c30a-6ace-4d87-8205-4e2e486aec62 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:19.670890 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9162c30a-6ace-4d87-8205-4e2e486aec62 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:19.671794 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9162c30a-6ace-4d87-8205-4e2e486aec62 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:19.672744 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9162c30a-6ace-4d87-8205-4e2e486aec62 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:19.673714 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9162c30a-6ace-4d87-8205-4e2e486aec62 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:19.675256 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9162c30a-6ace-4d87-8205-4e2e486aec62 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:19.719131 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-9162c30a-6ace-4d87-8205-4e2e486aec62 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] HTTP exception thrown: Instance dbacaeed-a40b-4e05-9635-5073dfdd8621 could not be found. Oct 08 21:08:19.730797 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-9162c30a-6ace-4d87-8205-4e2e486aec62 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Request method failure captured: Oct 08 21:08:19.730797 ncdv-master-1 devstack@n-api.service[140491]: request: GET /compute/v2.1/servers/dbacaeed-a40b-4e05-9635-5073dfdd8621 HTTP/1.1 Oct 08 21:08:19.730797 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:08:19.730797 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:08:19.730797 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:08:19.730797 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 21:08:19.730797 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:08:19.730797 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:08:19.730797 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:08:19.730797 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:08:19.730797 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeX1dfwQ899XpdMOtOJMQSu2NCEUW1Pb5XFJGbsJ10nw2woET0bsgI1wyutFUVeqysRZ016ChL6jEuP45EW13v5vp5hTuexOnuurE60XhoiZG-IK_OZURtPPZ1scS6vLEbSYQ0RZ5FDf1lySiWu-17QEYpUcIEOBkGcy7PtayWblSoc Oct 08 21:08:19.730797 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:08:19.730797 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:08:19.730797 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:08:19.730797 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:08:19.730797 ncdv-master-1 devstack@n-api.service[140491]: X-Openstack-Nova-Api-Version: 2.20 Oct 08 21:08:19.730797 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:08:19.730797 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:08:19.730797 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 665f66e846c24a6db01274679100bdbf Oct 08 21:08:19.730797 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1179861839 Oct 08 21:08:19.730797 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:08:19.730797 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:08:19.730797 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/665f66e846c24a6db01274679100bdbf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/665f66e846c24a6db01274679100bdbf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_665f66e846c24a6db01274679100bdbf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/665f66e846c24a6db01274679100bdbf"}]}] Oct 08 21:08:19.730797 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1179861839 Oct 08 21:08:19.730797 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 665f66e846c24a6db01274679100bdbf Oct 08 21:08:19.730797 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1179861839 Oct 08 21:08:19.730797 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-AttachVolumeShelveTestJSON-1179861839-project Oct 08 21:08:19.730797 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:08:19.730797 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:08:19.730797 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 21870fe169dc42359d9bdb149d0016d7 Oct 08 21:08:19.730797 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1179861839-project Oct 08 21:08:19.730797 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:08:19.730797 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance dbacaeed-a40b-4e05-9635-5073dfdd8621 could not be found. Oct 08 21:08:19.730797 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': 'dbacaeed-a40b-4e05-9635-5073dfdd8621'} Oct 08 21:08:19.730797 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:08:19.730797 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:08:19.730797 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:08:19.730797 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:08:19.730797 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:08:19.730797 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:08:19.730797 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:08:19.730797 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:08:19.730797 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:08:19.730797 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:08:19.730797 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dbacaeed-a40b-4e05-9635-5073dfdd8621 could not be found. Oct 08 21:08:19.730797 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:08:19.730797 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:08:19.730797 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:08:19.730797 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:08:19.730797 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:08:19.730797 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:08:19.730797 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:08:19.730797 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:08:19.730797 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:08:19.730797 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:08:19.730797 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:08:19.730797 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:08:19.730797 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:08:19.730797 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:08:19.730797 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:08:19.730797 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:08:19.730797 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dbacaeed-a40b-4e05-9635-5073dfdd8621 could not be found. Oct 08 21:08:19.730797 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:08:19.730797 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:08:19.740947 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:08:19.740947 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:08:19.740947 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:08:19.740947 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:08:19.740947 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:08:19.740947 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:08:19.740947 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dbacaeed-a40b-4e05-9635-5073dfdd8621 could not be found. Oct 08 21:08:19.740947 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:08:19.740947 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-9162c30a-6ace-4d87-8205-4e2e486aec62 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Returning 404 to user: Instance dbacaeed-a40b-4e05-9635-5073dfdd8621 could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:08:19.740947 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-9162c30a-6ace-4d87-8205-4e2e486aec62 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] 10.222.0.26 "GET /compute/v2.1/servers/dbacaeed-a40b-4e05-9635-5073dfdd8621" status: 404 len: 111 microversion: 2.20 time: 0.081311 Oct 08 21:08:19.740947 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1894/3872] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:08:19 2022] GET /compute/v2.1/servers/dbacaeed-a40b-4e05-9635-5073dfdd8621 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 08 21:08:19.746835 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-99b438d5-d6e8-48f3-b772-dc9c7bbfc182 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Calling method '.version_select at 0x7f1a9136da60>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:19.774672 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-99b438d5-d6e8-48f3-b772-dc9c7bbfc182 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1680820787" status: 204 len: 0 microversion: 2.20 time: 0.034119 Oct 08 21:08:19.777703 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1895/3873] 10.222.0.26 () {60 vars in 1262 bytes} [Sat Oct 8 21:08:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1680820787 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 08 21:08:19.832613 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-b2d71f5f-d639-4635-9817-ac63c70926c7 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:19.834309 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-b2d71f5f-d639-4635-9817-ac63c70926c7 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: 4e630da9-7820-47ef-ac72-1c91af94ff64] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:19.865642 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b2d71f5f-d639-4635-9817-ac63c70926c7 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:19.867353 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b2d71f5f-d639-4635-9817-ac63c70926c7 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:19.869307 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b2d71f5f-d639-4635-9817-ac63c70926c7 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:19.871584 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b2d71f5f-d639-4635-9817-ac63c70926c7 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:19.874216 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b2d71f5f-d639-4635-9817-ac63c70926c7 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:19.878771 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b2d71f5f-d639-4635-9817-ac63c70926c7 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:20.090246 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-b2d71f5f-d639-4635-9817-ac63c70926c7 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06443b5728fb4d1e95d6245820e786bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ded993145b4eda9d6a33b994519012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:20.109462 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-b2d71f5f-d639-4635-9817-ac63c70926c7 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "GET /compute/v2.1/servers/4e630da9-7820-47ef-ac72-1c91af94ff64" status: 200 len: 1267 microversion: 2.1 time: 0.272313 Oct 08 21:08:20.112598 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1896/3874] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:08:19 2022] GET /compute/v2.1/servers/4e630da9-7820-47ef-ac72-1c91af94ff64 => generated 1267 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:08:21.076633 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-6c78e87d-909c-4630-9be2-88765958ae4c tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Flavor limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 21:08:21.078162 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-6c78e87d-909c-4630-9be2-88765958ae4c tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Image limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 21:08:21.079493 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-6c78e87d-909c-4630-9be2-88765958ae4c tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Flavor pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 21:08:21.080371 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-6c78e87d-909c-4630-9be2-88765958ae4c tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Image pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 21:08:21.081455 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-6c78e87d-909c-4630-9be2-88765958ae4c tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 21:08:21.099177 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6c78e87d-909c-4630-9be2-88765958ae4c tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:21.100526 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6c78e87d-909c-4630-9be2-88765958ae4c tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:21.101764 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6c78e87d-909c-4630-9be2-88765958ae4c tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:21.102850 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6c78e87d-909c-4630-9be2-88765958ae4c tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:21.103578 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6c78e87d-909c-4630-9be2-88765958ae4c tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:21.104468 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6c78e87d-909c-4630-9be2-88765958ae4c tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:21.143728 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-702bf0d2-c939-43b5-a591-118718320b47 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:21.144641 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-702bf0d2-c939-43b5-a591-118718320b47 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: 4e630da9-7820-47ef-ac72-1c91af94ff64] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:21.149070 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-6c78e87d-909c-4630-9be2-88765958ae4c tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Getting quotas for project 6bcd0e7c24154409824f96e9e99da357. Resources: {'cores', 'instances', 'ram'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:08:21.156854 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-6c78e87d-909c-4630-9be2-88765958ae4c tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Getting quotas for user 30fe0e1ffa1040ec85d3c32d8b741c75 and project 6bcd0e7c24154409824f96e9e99da357. Resources: {'cores', 'instances', 'ram'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:08:21.165588 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-702bf0d2-c939-43b5-a591-118718320b47 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:21.166419 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-702bf0d2-c939-43b5-a591-118718320b47 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:21.167136 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-702bf0d2-c939-43b5-a591-118718320b47 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:21.170224 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-702bf0d2-c939-43b5-a591-118718320b47 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:21.171016 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-702bf0d2-c939-43b5-a591-118718320b47 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:21.172111 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-702bf0d2-c939-43b5-a591-118718320b47 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:21.181604 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-6c78e87d-909c-4630-9be2-88765958ae4c tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Going to run 1 instances... {{(pid=140492) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 21:08:21.187103 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-6c78e87d-909c-4630-9be2-88765958ae4c tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] [instance: b9e77bd1-3ce0-4f0a-b5ac-8c0ba6caffbb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c508bd7f-7db9-4b2c-af7c-be54a855c355',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140492) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 21:08:21.265206 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-6c78e87d-909c-4630-9be2-88765958ae4c tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.878655 Oct 08 21:08:21.265954 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1979/3875] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 21:08:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 1881 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 08 21:08:21.297614 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-02768abc-cd32-44bf-9a95-79f4180e85e8 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:21.298417 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-02768abc-cd32-44bf-9a95-79f4180e85e8 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] [instance: b9e77bd1-3ce0-4f0a-b5ac-8c0ba6caffbb] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:21.368380 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-02768abc-cd32-44bf-9a95-79f4180e85e8 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30fe0e1ffa1040ec85d3c32d8b741c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd0e7c24154409824f96e9e99da357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:21.377064 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-02768abc-cd32-44bf-9a95-79f4180e85e8 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "GET /compute/v2.1/servers/b9e77bd1-3ce0-4f0a-b5ac-8c0ba6caffbb" status: 200 len: 1207 microversion: 2.1 time: 0.096313 Oct 08 21:08:21.380629 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1980/3876] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:08:21 2022] GET /compute/v2.1/servers/b9e77bd1-3ce0-4f0a-b5ac-8c0ba6caffbb => generated 1207 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:08:21.811234 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-3cacfac8-d0ba-4b97-b46b-6b90c2d43923 req-df1d19ac-3616-4688-9cf3-11628bdef952 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1b4faf3-0c03-4e0c-be81-be3305b8314f", "name": "network-vif-unplugged", "status": "completed", "tag": "37642f8c-8e21-43fe-865f-09cc1bd6c431"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:08:21.829755 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-3cacfac8-d0ba-4b97-b46b-6b90c2d43923 req-df1d19ac-3616-4688-9cf3-11628bdef952 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:21.830251 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-3cacfac8-d0ba-4b97-b46b-6b90c2d43923 req-df1d19ac-3616-4688-9cf3-11628bdef952 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:21.830692 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-3cacfac8-d0ba-4b97-b46b-6b90c2d43923 req-df1d19ac-3616-4688-9cf3-11628bdef952 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:21.865499 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-3cacfac8-d0ba-4b97-b46b-6b90c2d43923 req-df1d19ac-3616-4688-9cf3-11628bdef952 service nova] Creating event network-vif-unplugged:37642f8c-8e21-43fe-865f-09cc1bd6c431 for instance f1b4faf3-0c03-4e0c-be81-be3305b8314f on nch2-master-1 Oct 08 21:08:21.882878 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-3cacfac8-d0ba-4b97-b46b-6b90c2d43923 req-df1d19ac-3616-4688-9cf3-11628bdef952 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.072816 Oct 08 21:08:21.886750 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1981/3877] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:08:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:08:22.096466 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-98b19a2c-7089-4b69-abef-fd8d48bf5421 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Action: 'create', calling method: .version_select at 0x7f1a877270d0>, body: {"keypair": {"name": "tempest-keypair-2085381443", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPCFJ9CvT0mUlCvRDNOd/vHuikXkBQO0P+XhkKOR8nHaVInfGVol+Pia3Mr0wxiJZlFP67P+lvmiXp0YqfGbq8HaLWdh2wTFinM7n5qfJQguT//ff5DAvynVSad3y7DN6A=="}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:08:22.124540 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-98b19a2c-7089-4b69-abef-fd8d48bf5421 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Getting quotas for project 665f66e846c24a6db01274679100bdbf. Resources: {'key_pairs'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:08:22.136231 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-702bf0d2-c939-43b5-a591-118718320b47 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06443b5728fb4d1e95d6245820e786bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ded993145b4eda9d6a33b994519012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:22.138335 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-98b19a2c-7089-4b69-abef-fd8d48bf5421 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Getting quotas for user 21870fe169dc42359d9bdb149d0016d7 and project 665f66e846c24a6db01274679100bdbf. Resources: {'key_pairs'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:08:22.148399 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-702bf0d2-c939-43b5-a591-118718320b47 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "GET /compute/v2.1/servers/4e630da9-7820-47ef-ac72-1c91af94ff64" status: 200 len: 1309 microversion: 2.1 time: 1.013669 Oct 08 21:08:22.164233 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1897/3878] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:08:21 2022] GET /compute/v2.1/servers/4e630da9-7820-47ef-ac72-1c91af94ff64 => generated 1309 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:08:22.178596 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-98b19a2c-7089-4b69-abef-fd8d48bf5421 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.086483 Oct 08 21:08:22.179506 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1982/3879] 10.222.0.26 () {62 vars in 1200 bytes} [Sat Oct 8 21:08:22 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 88 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Oct 08 21:08:22.406201 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-bde531e3-55e2-4543-9ada-ed9ee12862e8 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:22.407724 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-bde531e3-55e2-4543-9ada-ed9ee12862e8 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] [instance: b9e77bd1-3ce0-4f0a-b5ac-8c0ba6caffbb] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:22.418297 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bde531e3-55e2-4543-9ada-ed9ee12862e8 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:22.418959 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bde531e3-55e2-4543-9ada-ed9ee12862e8 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:22.419540 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bde531e3-55e2-4543-9ada-ed9ee12862e8 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:22.420391 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bde531e3-55e2-4543-9ada-ed9ee12862e8 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:22.421073 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bde531e3-55e2-4543-9ada-ed9ee12862e8 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:22.422568 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bde531e3-55e2-4543-9ada-ed9ee12862e8 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:22.524185 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-bde531e3-55e2-4543-9ada-ed9ee12862e8 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30fe0e1ffa1040ec85d3c32d8b741c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd0e7c24154409824f96e9e99da357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:22.544997 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-bde531e3-55e2-4543-9ada-ed9ee12862e8 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "GET /compute/v2.1/servers/b9e77bd1-3ce0-4f0a-b5ac-8c0ba6caffbb" status: 200 len: 1259 microversion: 2.1 time: 0.144072 Oct 08 21:08:22.564308 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1898/3880] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:08:22 2022] GET /compute/v2.1/servers/b9e77bd1-3ce0-4f0a-b5ac-8c0ba6caffbb => generated 1259 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:08:22.655096 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-2d495388-3864-45ad-8a10-616c1c2cf872 req-3bb7dab1-d1d2-445f-bad7-df447474db61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1b4faf3-0c03-4e0c-be81-be3305b8314f", "name": "network-vif-deleted", "tag": "37642f8c-8e21-43fe-865f-09cc1bd6c431"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:08:22.667267 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-2d495388-3864-45ad-8a10-616c1c2cf872 req-3bb7dab1-d1d2-445f-bad7-df447474db61 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:22.667991 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-2d495388-3864-45ad-8a10-616c1c2cf872 req-3bb7dab1-d1d2-445f-bad7-df447474db61 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:22.668635 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-2d495388-3864-45ad-8a10-616c1c2cf872 req-3bb7dab1-d1d2-445f-bad7-df447474db61 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:22.682034 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-2d495388-3864-45ad-8a10-616c1c2cf872 req-3bb7dab1-d1d2-445f-bad7-df447474db61 service nova] Creating event network-vif-deleted:37642f8c-8e21-43fe-865f-09cc1bd6c431 for instance f1b4faf3-0c03-4e0c-be81-be3305b8314f on nch2-master-1 Oct 08 21:08:22.688772 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-2d495388-3864-45ad-8a10-616c1c2cf872 req-3bb7dab1-d1d2-445f-bad7-df447474db61 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037463 Oct 08 21:08:22.690010 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1983/3881] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:08:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:08:22.926129 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-3c31c560-aa37-4e2a-8da4-afc13da248a4 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:22.926833 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-3c31c560-aa37-4e2a-8da4-afc13da248a4 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: 911394e0-0af3-4433-acfb-a4652d4e2e84] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:22.937019 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3c31c560-aa37-4e2a-8da4-afc13da248a4 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:22.940374 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3c31c560-aa37-4e2a-8da4-afc13da248a4 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:22.940718 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3c31c560-aa37-4e2a-8da4-afc13da248a4 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:22.942905 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3c31c560-aa37-4e2a-8da4-afc13da248a4 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:22.943744 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3c31c560-aa37-4e2a-8da4-afc13da248a4 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:22.944357 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3c31c560-aa37-4e2a-8da4-afc13da248a4 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:22.974845 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-3c31c560-aa37-4e2a-8da4-afc13da248a4 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: 911394e0-0af3-4433-acfb-a4652d4e2e84] Going to try to terminate instance {{(pid=140491) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 21:08:23.119006 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=4,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:08:23.150408 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-3c31c560-aa37-4e2a-8da4-afc13da248a4 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "DELETE /compute/v2.1/servers/911394e0-0af3-4433-acfb-a4652d4e2e84" status: 204 len: 0 microversion: 2.1 time: 0.229571 Oct 08 21:08:23.152748 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1899/3882] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:08:22 2022] DELETE /compute/v2.1/servers/911394e0-0af3-4433-acfb-a4652d4e2e84 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 21:08:23.163238 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-8cfbb4fa-8124-4579-b069-a781f634ff08 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:23.164579 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-8cfbb4fa-8124-4579-b069-a781f634ff08 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: 911394e0-0af3-4433-acfb-a4652d4e2e84] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:23.194640 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c7d3e13c-09ed-4722-925d-32aaa64259f2 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:23.195514 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-c7d3e13c-09ed-4722-925d-32aaa64259f2 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: 4e630da9-7820-47ef-ac72-1c91af94ff64] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:23.196459 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8cfbb4fa-8124-4579-b069-a781f634ff08 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:23.198867 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8cfbb4fa-8124-4579-b069-a781f634ff08 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:23.199483 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8cfbb4fa-8124-4579-b069-a781f634ff08 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:23.200366 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8cfbb4fa-8124-4579-b069-a781f634ff08 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:23.211120 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8cfbb4fa-8124-4579-b069-a781f634ff08 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:23.211688 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8cfbb4fa-8124-4579-b069-a781f634ff08 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:23.218467 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c7d3e13c-09ed-4722-925d-32aaa64259f2 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:23.225960 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c7d3e13c-09ed-4722-925d-32aaa64259f2 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:23.226570 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c7d3e13c-09ed-4722-925d-32aaa64259f2 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:23.227533 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c7d3e13c-09ed-4722-925d-32aaa64259f2 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:23.228048 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c7d3e13c-09ed-4722-925d-32aaa64259f2 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:23.228714 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c7d3e13c-09ed-4722-925d-32aaa64259f2 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:23.582564 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-c7d3e13c-09ed-4722-925d-32aaa64259f2 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06443b5728fb4d1e95d6245820e786bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ded993145b4eda9d6a33b994519012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:23.597938 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-c7d3e13c-09ed-4722-925d-32aaa64259f2 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "GET /compute/v2.1/servers/4e630da9-7820-47ef-ac72-1c91af94ff64" status: 200 len: 1309 microversion: 2.1 time: 0.429082 Oct 08 21:08:23.610524 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1900/3883] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:08:23 2022] GET /compute/v2.1/servers/4e630da9-7820-47ef-ac72-1c91af94ff64 => generated 1309 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:08:23.623830 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-9a5a4e2e-e28d-484a-842c-1c4045b0edaf tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:23.624427 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-9a5a4e2e-e28d-484a-842c-1c4045b0edaf tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] [instance: b9e77bd1-3ce0-4f0a-b5ac-8c0ba6caffbb] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:23.642169 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9a5a4e2e-e28d-484a-842c-1c4045b0edaf tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:23.642727 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9a5a4e2e-e28d-484a-842c-1c4045b0edaf tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:23.643209 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9a5a4e2e-e28d-484a-842c-1c4045b0edaf tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:23.643963 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9a5a4e2e-e28d-484a-842c-1c4045b0edaf tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:23.644433 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9a5a4e2e-e28d-484a-842c-1c4045b0edaf tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:23.644866 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9a5a4e2e-e28d-484a-842c-1c4045b0edaf tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:23.756057 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-9a5a4e2e-e28d-484a-842c-1c4045b0edaf tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30fe0e1ffa1040ec85d3c32d8b741c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd0e7c24154409824f96e9e99da357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:23.770255 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-9a5a4e2e-e28d-484a-842c-1c4045b0edaf tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "GET /compute/v2.1/servers/b9e77bd1-3ce0-4f0a-b5ac-8c0ba6caffbb" status: 200 len: 1267 microversion: 2.1 time: 0.158358 Oct 08 21:08:23.771422 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1901/3884] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:08:23 2022] GET /compute/v2.1/servers/b9e77bd1-3ce0-4f0a-b5ac-8c0ba6caffbb => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:08:23.852777 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-8cfbb4fa-8124-4579-b069-a781f634ff08 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78e9afd772c4de981cac8f5817ec356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765c62cac2ee4406b23a5baa85c52ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:23.861841 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-8cfbb4fa-8124-4579-b069-a781f634ff08 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/911394e0-0af3-4433-acfb-a4652d4e2e84" status: 200 len: 1553 microversion: 2.1 time: 0.704771 Oct 08 21:08:23.881792 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1984/3885] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:08:23 2022] GET /compute/v2.1/servers/911394e0-0af3-4433-acfb-a4652d4e2e84 => generated 1553 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:08:24.315206 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-2c97917a-c50c-4b39-ac2f-1528c0bf5f65 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-466973711", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "12b33944-7c6a-4c51-871c-7288dba89654"}], "security_groups": [{"name": "tempest-securitygroup--577683272"}], "key_name": "tempest-keypair-2085381443", "user_data": "}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:08:24.562808 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.network.neutron [None req-2c97917a-c50c-4b39-ac2f-1528c0bf5f65 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] validate_networks() for [('12b33944-7c6a-4c51-871c-7288dba89654', None, None, None, None, None)] {{(pid=140491) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 21:08:24.628646 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-c6113521-91a9-4426-bb29-41b28650c7a8 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:24.629403 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-c6113521-91a9-4426-bb29-41b28650c7a8 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: 4e630da9-7820-47ef-ac72-1c91af94ff64] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:24.637682 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c6113521-91a9-4426-bb29-41b28650c7a8 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:24.638266 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c6113521-91a9-4426-bb29-41b28650c7a8 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:24.638784 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c6113521-91a9-4426-bb29-41b28650c7a8 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:24.639586 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c6113521-91a9-4426-bb29-41b28650c7a8 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:24.640115 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c6113521-91a9-4426-bb29-41b28650c7a8 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:24.640611 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c6113521-91a9-4426-bb29-41b28650c7a8 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:25.054584 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-c6113521-91a9-4426-bb29-41b28650c7a8 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06443b5728fb4d1e95d6245820e786bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ded993145b4eda9d6a33b994519012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:25.075936 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-c6113521-91a9-4426-bb29-41b28650c7a8 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "GET /compute/v2.1/servers/4e630da9-7820-47ef-ac72-1c91af94ff64" status: 200 len: 1309 microversion: 2.1 time: 0.449837 Oct 08 21:08:25.076571 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1985/3886] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:08:24 2022] GET /compute/v2.1/servers/4e630da9-7820-47ef-ac72-1c91af94ff64 => generated 1309 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:08:25.085575 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-fc69054f-051c-4a63-9d14-a9c89793bbe2 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:25.087777 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-fc69054f-051c-4a63-9d14-a9c89793bbe2 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] [instance: b9e77bd1-3ce0-4f0a-b5ac-8c0ba6caffbb] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:25.094751 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fc69054f-051c-4a63-9d14-a9c89793bbe2 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:25.095464 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fc69054f-051c-4a63-9d14-a9c89793bbe2 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:25.095910 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fc69054f-051c-4a63-9d14-a9c89793bbe2 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:25.096653 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fc69054f-051c-4a63-9d14-a9c89793bbe2 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:25.097247 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fc69054f-051c-4a63-9d14-a9c89793bbe2 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:25.097745 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fc69054f-051c-4a63-9d14-a9c89793bbe2 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:25.205882 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-fc69054f-051c-4a63-9d14-a9c89793bbe2 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30fe0e1ffa1040ec85d3c32d8b741c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd0e7c24154409824f96e9e99da357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:25.216013 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-fc69054f-051c-4a63-9d14-a9c89793bbe2 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "GET /compute/v2.1/servers/b9e77bd1-3ce0-4f0a-b5ac-8c0ba6caffbb" status: 200 len: 1265 microversion: 2.1 time: 0.134047 Oct 08 21:08:25.216869 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1986/3887] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:08:25 2022] GET /compute/v2.1/servers/b9e77bd1-3ce0-4f0a-b5ac-8c0ba6caffbb => generated 1265 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:08:25.222116 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-f6e06de9-e6b7-4048-9fdd-06dab1fa6bb8 req-f2a99956-5bf1-4909-9f29-8262788ed5d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e630da9-7820-47ef-ac72-1c91af94ff64", "tag": "226a8b36-ead5-4696-86c9-94037a55f634"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:08:25.233854 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-f6e06de9-e6b7-4048-9fdd-06dab1fa6bb8 req-f2a99956-5bf1-4909-9f29-8262788ed5d7 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:25.234462 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-f6e06de9-e6b7-4048-9fdd-06dab1fa6bb8 req-f2a99956-5bf1-4909-9f29-8262788ed5d7 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:25.235130 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-f6e06de9-e6b7-4048-9fdd-06dab1fa6bb8 req-f2a99956-5bf1-4909-9f29-8262788ed5d7 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:25.251561 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-f6e06de9-e6b7-4048-9fdd-06dab1fa6bb8 req-f2a99956-5bf1-4909-9f29-8262788ed5d7 service nova] Creating event network-changed:226a8b36-ead5-4696-86c9-94037a55f634 for instance 4e630da9-7820-47ef-ac72-1c91af94ff64 on nch2-master-1 Oct 08 21:08:25.258728 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-f6e06de9-e6b7-4048-9fdd-06dab1fa6bb8 req-f2a99956-5bf1-4909-9f29-8262788ed5d7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039854 Oct 08 21:08:25.259915 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1987/3888] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:08:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:08:25.266282 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-ce1015b2-c64e-4636-be4f-890725e4f565 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:25.267164 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-ce1015b2-c64e-4636-be4f-890725e4f565 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: 911394e0-0af3-4433-acfb-a4652d4e2e84] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:25.274507 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ce1015b2-c64e-4636-be4f-890725e4f565 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:25.275222 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ce1015b2-c64e-4636-be4f-890725e4f565 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:25.275895 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ce1015b2-c64e-4636-be4f-890725e4f565 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:25.276890 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ce1015b2-c64e-4636-be4f-890725e4f565 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:25.277523 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ce1015b2-c64e-4636-be4f-890725e4f565 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:25.278090 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ce1015b2-c64e-4636-be4f-890725e4f565 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:25.522254 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-ce1015b2-c64e-4636-be4f-890725e4f565 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78e9afd772c4de981cac8f5817ec356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765c62cac2ee4406b23a5baa85c52ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:25.531117 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-ce1015b2-c64e-4636-be4f-890725e4f565 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/911394e0-0af3-4433-acfb-a4652d4e2e84" status: 200 len: 1553 microversion: 2.1 time: 0.269814 Oct 08 21:08:25.531698 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1988/3889] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:08:25 2022] GET /compute/v2.1/servers/911394e0-0af3-4433-acfb-a4652d4e2e84 => generated 1553 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:08:25.952197 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-2c97917a-c50c-4b39-ac2f-1528c0bf5f65 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Flavor limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 21:08:25.953308 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-2c97917a-c50c-4b39-ac2f-1528c0bf5f65 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Image limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 21:08:25.954020 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-2c97917a-c50c-4b39-ac2f-1528c0bf5f65 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Flavor pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 21:08:25.954726 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-2c97917a-c50c-4b39-ac2f-1528c0bf5f65 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Image pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 21:08:25.955357 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-2c97917a-c50c-4b39-ac2f-1528c0bf5f65 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 21:08:25.967992 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2c97917a-c50c-4b39-ac2f-1528c0bf5f65 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:25.968918 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2c97917a-c50c-4b39-ac2f-1528c0bf5f65 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:25.969679 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2c97917a-c50c-4b39-ac2f-1528c0bf5f65 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:25.970699 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2c97917a-c50c-4b39-ac2f-1528c0bf5f65 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:25.971439 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2c97917a-c50c-4b39-ac2f-1528c0bf5f65 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:25.972136 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2c97917a-c50c-4b39-ac2f-1528c0bf5f65 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:26.005283 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-2c97917a-c50c-4b39-ac2f-1528c0bf5f65 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Getting quotas for project 665f66e846c24a6db01274679100bdbf. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:08:26.013395 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-2c97917a-c50c-4b39-ac2f-1528c0bf5f65 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Getting quotas for user 21870fe169dc42359d9bdb149d0016d7 and project 665f66e846c24a6db01274679100bdbf. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:08:26.033226 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-2c97917a-c50c-4b39-ac2f-1528c0bf5f65 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Going to run 1 instances... {{(pid=140491) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 21:08:26.036553 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-2c97917a-c50c-4b39-ac2f-1528c0bf5f65 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] [instance: 159e29dd-802c-4059-99f9-bb7c113d430b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c508bd7f-7db9-4b2c-af7c-be54a855c355',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140491) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 21:08:26.104396 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-2c97917a-c50c-4b39-ac2f-1528c0bf5f65 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.792928 Oct 08 21:08:26.106258 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1902/3890] 10.222.0.26 () {62 vars in 1188 bytes} [Sat Oct 8 21:08:24 2022] POST /compute/v2.1/servers => generated 401 bytes in 1796 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 08 21:08:26.119165 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-965f6416-3157-4220-8ac0-b0f723bbc74e tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:26.122863 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-965f6416-3157-4220-8ac0-b0f723bbc74e tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: 4e630da9-7820-47ef-ac72-1c91af94ff64] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:26.130001 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-313b81c5-478a-40f6-b252-c2e38b58fef2 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:26.131186 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-313b81c5-478a-40f6-b252-c2e38b58fef2 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] [instance: 159e29dd-802c-4059-99f9-bb7c113d430b] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:26.147085 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-965f6416-3157-4220-8ac0-b0f723bbc74e tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:26.148157 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-965f6416-3157-4220-8ac0-b0f723bbc74e tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:26.148807 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-965f6416-3157-4220-8ac0-b0f723bbc74e tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:26.151746 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-965f6416-3157-4220-8ac0-b0f723bbc74e tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:26.152452 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-965f6416-3157-4220-8ac0-b0f723bbc74e tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:26.155135 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-965f6416-3157-4220-8ac0-b0f723bbc74e tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:26.214166 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:08:26.374179 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-313b81c5-478a-40f6-b252-c2e38b58fef2 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:26.402243 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-313b81c5-478a-40f6-b252-c2e38b58fef2 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:26.407094 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-313b81c5-478a-40f6-b252-c2e38b58fef2 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:26.411474 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-313b81c5-478a-40f6-b252-c2e38b58fef2 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] 10.222.0.26 "GET /compute/v2.1/servers/159e29dd-802c-4059-99f9-bb7c113d430b" status: 200 len: 1281 microversion: 2.20 time: 0.293242 Oct 08 21:08:26.413483 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1903/3891] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:08:26 2022] GET /compute/v2.1/servers/159e29dd-802c-4059-99f9-bb7c113d430b => generated 1281 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:08:26.427954 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-5bf91ab1-ffd1-4d23-9c8c-65836e43447f tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:26.429374 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-5bf91ab1-ffd1-4d23-9c8c-65836e43447f tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] [instance: b9e77bd1-3ce0-4f0a-b5ac-8c0ba6caffbb] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:26.442969 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5bf91ab1-ffd1-4d23-9c8c-65836e43447f tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:26.444263 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5bf91ab1-ffd1-4d23-9c8c-65836e43447f tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:26.444871 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5bf91ab1-ffd1-4d23-9c8c-65836e43447f tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:26.446256 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5bf91ab1-ffd1-4d23-9c8c-65836e43447f tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:26.447061 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5bf91ab1-ffd1-4d23-9c8c-65836e43447f tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:26.447738 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5bf91ab1-ffd1-4d23-9c8c-65836e43447f tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:26.843491 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-965f6416-3157-4220-8ac0-b0f723bbc74e tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06443b5728fb4d1e95d6245820e786bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ded993145b4eda9d6a33b994519012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:26.859046 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-965f6416-3157-4220-8ac0-b0f723bbc74e tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "GET /compute/v2.1/servers/4e630da9-7820-47ef-ac72-1c91af94ff64" status: 200 len: 1309 microversion: 2.1 time: 0.761571 Oct 08 21:08:26.864852 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1989/3892] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:08:26 2022] GET /compute/v2.1/servers/4e630da9-7820-47ef-ac72-1c91af94ff64 => generated 1309 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:08:26.890427 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-3047fbb1-3dca-41c9-a9eb-acc8b321bd0e tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:26.892796 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-3047fbb1-3dca-41c9-a9eb-acc8b321bd0e tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: 911394e0-0af3-4433-acfb-a4652d4e2e84] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:26.914759 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3047fbb1-3dca-41c9-a9eb-acc8b321bd0e tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:26.916585 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3047fbb1-3dca-41c9-a9eb-acc8b321bd0e tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:26.918542 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3047fbb1-3dca-41c9-a9eb-acc8b321bd0e tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:26.920838 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3047fbb1-3dca-41c9-a9eb-acc8b321bd0e tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:26.922657 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3047fbb1-3dca-41c9-a9eb-acc8b321bd0e tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:26.924041 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3047fbb1-3dca-41c9-a9eb-acc8b321bd0e tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:27.136157 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-3047fbb1-3dca-41c9-a9eb-acc8b321bd0e tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78e9afd772c4de981cac8f5817ec356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765c62cac2ee4406b23a5baa85c52ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:27.158600 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-3047fbb1-3dca-41c9-a9eb-acc8b321bd0e tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/911394e0-0af3-4433-acfb-a4652d4e2e84" status: 200 len: 1511 microversion: 2.1 time: 0.291163 Oct 08 21:08:27.159229 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1990/3893] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:08:26 2022] GET /compute/v2.1/servers/911394e0-0af3-4433-acfb-a4652d4e2e84 => generated 1511 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:08:27.289053 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-5bf91ab1-ffd1-4d23-9c8c-65836e43447f tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30fe0e1ffa1040ec85d3c32d8b741c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd0e7c24154409824f96e9e99da357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:27.306873 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-5bf91ab1-ffd1-4d23-9c8c-65836e43447f tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "GET /compute/v2.1/servers/b9e77bd1-3ce0-4f0a-b5ac-8c0ba6caffbb" status: 200 len: 1307 microversion: 2.1 time: 0.888604 Oct 08 21:08:27.307905 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1904/3894] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:08:26 2022] GET /compute/v2.1/servers/b9e77bd1-3ce0-4f0a-b5ac-8c0ba6caffbb => generated 1307 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:08:27.445899 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-ce4ab3aa-f070-4e5e-8474-b58891555e03 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:27.446719 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-ce4ab3aa-f070-4e5e-8474-b58891555e03 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] [instance: 159e29dd-802c-4059-99f9-bb7c113d430b] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:27.470340 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ce4ab3aa-f070-4e5e-8474-b58891555e03 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:27.470854 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ce4ab3aa-f070-4e5e-8474-b58891555e03 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:27.471303 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ce4ab3aa-f070-4e5e-8474-b58891555e03 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:27.474093 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ce4ab3aa-f070-4e5e-8474-b58891555e03 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:27.480139 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ce4ab3aa-f070-4e5e-8474-b58891555e03 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:27.480794 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ce4ab3aa-f070-4e5e-8474-b58891555e03 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:27.486274 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-98d9adf3-52cb-4e01-9ccb-1ac57dd1999e req-8bb7b46a-b21e-430e-b98d-4540e11bc66e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "911394e0-0af3-4433-acfb-a4652d4e2e84", "name": "network-vif-deleted", "tag": "7d57450d-660f-48ba-9c0d-c5b4d23d86db"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:08:27.508423 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-98d9adf3-52cb-4e01-9ccb-1ac57dd1999e req-8bb7b46a-b21e-430e-b98d-4540e11bc66e service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:27.513462 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-98d9adf3-52cb-4e01-9ccb-1ac57dd1999e req-8bb7b46a-b21e-430e-b98d-4540e11bc66e service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:27.514145 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-98d9adf3-52cb-4e01-9ccb-1ac57dd1999e req-8bb7b46a-b21e-430e-b98d-4540e11bc66e service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:27.546659 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-98d9adf3-52cb-4e01-9ccb-1ac57dd1999e req-8bb7b46a-b21e-430e-b98d-4540e11bc66e service nova] Creating event network-vif-deleted:7d57450d-660f-48ba-9c0d-c5b4d23d86db for instance 911394e0-0af3-4433-acfb-a4652d4e2e84 on nch1-master-1 Oct 08 21:08:27.566932 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-98d9adf3-52cb-4e01-9ccb-1ac57dd1999e req-8bb7b46a-b21e-430e-b98d-4540e11bc66e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091176 Oct 08 21:08:27.568169 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1905/3895] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:08:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:08:27.771219 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-ce4ab3aa-f070-4e5e-8474-b58891555e03 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:27.788288 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-ce4ab3aa-f070-4e5e-8474-b58891555e03 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:27.793380 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-ce4ab3aa-f070-4e5e-8474-b58891555e03 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:27.798182 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-ce4ab3aa-f070-4e5e-8474-b58891555e03 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] 10.222.0.26 "GET /compute/v2.1/servers/159e29dd-802c-4059-99f9-bb7c113d430b" status: 200 len: 1333 microversion: 2.20 time: 0.355026 Oct 08 21:08:27.800090 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1991/3896] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:08:27 2022] GET /compute/v2.1/servers/159e29dd-802c-4059-99f9-bb7c113d430b => generated 1333 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:08:27.891113 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-8681339a-d149-45a4-85fe-d7491788e549 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:27.892450 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-8681339a-d149-45a4-85fe-d7491788e549 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: 4e630da9-7820-47ef-ac72-1c91af94ff64] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:27.915381 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8681339a-d149-45a4-85fe-d7491788e549 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:27.921655 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8681339a-d149-45a4-85fe-d7491788e549 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:27.922517 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8681339a-d149-45a4-85fe-d7491788e549 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:27.926601 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8681339a-d149-45a4-85fe-d7491788e549 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:27.927818 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8681339a-d149-45a4-85fe-d7491788e549 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:27.932326 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8681339a-d149-45a4-85fe-d7491788e549 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:28.193374 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-3f0625a8-467b-4634-a987-e01c75db28a8 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:28.194109 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-3f0625a8-467b-4634-a987-e01c75db28a8 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: 911394e0-0af3-4433-acfb-a4652d4e2e84] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:28.224251 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3f0625a8-467b-4634-a987-e01c75db28a8 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:28.231652 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3f0625a8-467b-4634-a987-e01c75db28a8 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:28.235978 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3f0625a8-467b-4634-a987-e01c75db28a8 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:28.241589 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3f0625a8-467b-4634-a987-e01c75db28a8 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:28.242703 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3f0625a8-467b-4634-a987-e01c75db28a8 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:28.246430 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3f0625a8-467b-4634-a987-e01c75db28a8 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:28.355017 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3f0625a8-467b-4634-a987-e01c75db28a8 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:28.357035 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3f0625a8-467b-4634-a987-e01c75db28a8 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:28.359210 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3f0625a8-467b-4634-a987-e01c75db28a8 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:28.360470 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.objects.instance [None req-3f0625a8-467b-4634-a987-e01c75db28a8 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lazy-loading 'fault' on Instance uuid 911394e0-0af3-4433-acfb-a4652d4e2e84 {{(pid=140492) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 21:08:28.373320 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-8681339a-d149-45a4-85fe-d7491788e549 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06443b5728fb4d1e95d6245820e786bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ded993145b4eda9d6a33b994519012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:28.393093 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-8681339a-d149-45a4-85fe-d7491788e549 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "GET /compute/v2.1/servers/4e630da9-7820-47ef-ac72-1c91af94ff64" status: 200 len: 1309 microversion: 2.1 time: 0.507457 Oct 08 21:08:28.397242 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1906/3897] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:08:27 2022] GET /compute/v2.1/servers/4e630da9-7820-47ef-ac72-1c91af94ff64 => generated 1309 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:08:28.404778 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-cc63e6f1-24dc-45d3-83c4-f322779b63e7 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:28.409254 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-cc63e6f1-24dc-45d3-83c4-f322779b63e7 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] [instance: b9e77bd1-3ce0-4f0a-b5ac-8c0ba6caffbb] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:28.426370 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cc63e6f1-24dc-45d3-83c4-f322779b63e7 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:28.428225 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cc63e6f1-24dc-45d3-83c4-f322779b63e7 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:28.433202 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cc63e6f1-24dc-45d3-83c4-f322779b63e7 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:28.434718 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cc63e6f1-24dc-45d3-83c4-f322779b63e7 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:28.435472 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cc63e6f1-24dc-45d3-83c4-f322779b63e7 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:28.436557 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cc63e6f1-24dc-45d3-83c4-f322779b63e7 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:28.508921 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:08:28.699235 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-3f0625a8-467b-4634-a987-e01c75db28a8 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78e9afd772c4de981cac8f5817ec356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765c62cac2ee4406b23a5baa85c52ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:28.712679 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-3f0625a8-467b-4634-a987-e01c75db28a8 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/911394e0-0af3-4433-acfb-a4652d4e2e84" status: 200 len: 1305 microversion: 2.1 time: 0.528526 Oct 08 21:08:28.717551 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1992/3898] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:08:28 2022] GET /compute/v2.1/servers/911394e0-0af3-4433-acfb-a4652d4e2e84 => generated 1305 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:08:28.796083 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-f8d5e58e-e078-43a2-8617-966c2679d5bb tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:28.796704 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-f8d5e58e-e078-43a2-8617-966c2679d5bb tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] [instance: 4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:28.827681 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f8d5e58e-e078-43a2-8617-966c2679d5bb tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:28.828885 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f8d5e58e-e078-43a2-8617-966c2679d5bb tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:28.829676 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f8d5e58e-e078-43a2-8617-966c2679d5bb tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:28.831137 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f8d5e58e-e078-43a2-8617-966c2679d5bb tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:28.832472 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f8d5e58e-e078-43a2-8617-966c2679d5bb tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:28.833143 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f8d5e58e-e078-43a2-8617-966c2679d5bb tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:28.848071 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-cc63e6f1-24dc-45d3-83c4-f322779b63e7 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30fe0e1ffa1040ec85d3c32d8b741c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd0e7c24154409824f96e9e99da357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:28.862269 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-cc63e6f1-24dc-45d3-83c4-f322779b63e7 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "GET /compute/v2.1/servers/b9e77bd1-3ce0-4f0a-b5ac-8c0ba6caffbb" status: 200 len: 1307 microversion: 2.1 time: 0.463720 Oct 08 21:08:28.863066 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1907/3899] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:08:28 2022] GET /compute/v2.1/servers/b9e77bd1-3ce0-4f0a-b5ac-8c0ba6caffbb => generated 1307 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:08:28.884645 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-92dcf886-4744-4563-b71b-9b6ea3d0bc35 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:28.885832 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-92dcf886-4744-4563-b71b-9b6ea3d0bc35 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] [instance: 159e29dd-802c-4059-99f9-bb7c113d430b] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:28.892926 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-92dcf886-4744-4563-b71b-9b6ea3d0bc35 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:28.893890 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-92dcf886-4744-4563-b71b-9b6ea3d0bc35 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:28.894835 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-92dcf886-4744-4563-b71b-9b6ea3d0bc35 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:28.895905 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-92dcf886-4744-4563-b71b-9b6ea3d0bc35 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:28.896576 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-92dcf886-4744-4563-b71b-9b6ea3d0bc35 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:28.897246 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-92dcf886-4744-4563-b71b-9b6ea3d0bc35 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:29.050487 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-92dcf886-4744-4563-b71b-9b6ea3d0bc35 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:29.070121 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-92dcf886-4744-4563-b71b-9b6ea3d0bc35 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:29.071972 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-92dcf886-4744-4563-b71b-9b6ea3d0bc35 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:29.073620 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-92dcf886-4744-4563-b71b-9b6ea3d0bc35 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] 10.222.0.26 "GET /compute/v2.1/servers/159e29dd-802c-4059-99f9-bb7c113d430b" status: 200 len: 1339 microversion: 2.20 time: 0.209567 Oct 08 21:08:29.114383 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1908/3900] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:08:28 2022] GET /compute/v2.1/servers/159e29dd-802c-4059-99f9-bb7c113d430b => generated 1339 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:08:29.227733 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-f8d5e58e-e078-43a2-8617-966c2679d5bb tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc2bdd169daf4a1db830b1fa7f94f0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f2d56477794f8ab38b8e3535b3e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:29.254747 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-f8d5e58e-e078-43a2-8617-966c2679d5bb tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc2bdd169daf4a1db830b1fa7f94f0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f2d56477794f8ab38b8e3535b3e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:29.258977 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-f8d5e58e-e078-43a2-8617-966c2679d5bb tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc2bdd169daf4a1db830b1fa7f94f0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f2d56477794f8ab38b8e3535b3e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:29.264790 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-f8d5e58e-e078-43a2-8617-966c2679d5bb tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] 10.222.0.26 "GET /compute/v2.1/servers/4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21" status: 200 len: 2950 microversion: 2.32 time: 0.470757 Oct 08 21:08:29.266436 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1993/3901] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:08:28 2022] GET /compute/v2.1/servers/4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21 => generated 2950 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 08 21:08:29.297325 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-af19e5b3-5b52-4e59-8320-213c4525c579 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:29.298094 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-af19e5b3-5b52-4e59-8320-213c4525c579 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] [instance: 4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:29.323684 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-af19e5b3-5b52-4e59-8320-213c4525c579 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:29.323684 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-af19e5b3-5b52-4e59-8320-213c4525c579 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:29.323684 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-af19e5b3-5b52-4e59-8320-213c4525c579 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:29.324465 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-af19e5b3-5b52-4e59-8320-213c4525c579 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:29.325785 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-af19e5b3-5b52-4e59-8320-213c4525c579 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:29.327290 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-af19e5b3-5b52-4e59-8320-213c4525c579 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:29.429441 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-f5a27f5a-8131-42d6-9dd9-bc23b2ba3155 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:29.431023 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-f5a27f5a-8131-42d6-9dd9-bc23b2ba3155 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: 4e630da9-7820-47ef-ac72-1c91af94ff64] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:29.439798 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f5a27f5a-8131-42d6-9dd9-bc23b2ba3155 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:29.440601 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f5a27f5a-8131-42d6-9dd9-bc23b2ba3155 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:29.441436 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f5a27f5a-8131-42d6-9dd9-bc23b2ba3155 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:29.443001 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f5a27f5a-8131-42d6-9dd9-bc23b2ba3155 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:29.447469 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f5a27f5a-8131-42d6-9dd9-bc23b2ba3155 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:29.453899 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f5a27f5a-8131-42d6-9dd9-bc23b2ba3155 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:29.585970 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-af19e5b3-5b52-4e59-8320-213c4525c579 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] 10.222.0.26 "GET /compute/v2.1/servers/4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21/os-interface" status: 200 len: 1831 microversion: 2.32 time: 0.293693 Oct 08 21:08:29.587933 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1909/3902] 10.222.0.26 () {60 vars in 1316 bytes} [Sat Oct 8 21:08:29 2022] GET /compute/v2.1/servers/4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21/os-interface => generated 1831 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:08:29.753662 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-62c08705-199d-484e-9219-1a3c5a72f281 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:29.754569 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-62c08705-199d-484e-9219-1a3c5a72f281 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: 911394e0-0af3-4433-acfb-a4652d4e2e84] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:29.774117 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-62c08705-199d-484e-9219-1a3c5a72f281 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:29.775428 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-62c08705-199d-484e-9219-1a3c5a72f281 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:29.781636 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-62c08705-199d-484e-9219-1a3c5a72f281 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:29.785256 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-62c08705-199d-484e-9219-1a3c5a72f281 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:29.785984 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-62c08705-199d-484e-9219-1a3c5a72f281 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:29.787283 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-62c08705-199d-484e-9219-1a3c5a72f281 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:29.845772 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-62c08705-199d-484e-9219-1a3c5a72f281 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] HTTP exception thrown: Instance 911394e0-0af3-4433-acfb-a4652d4e2e84 could not be found. Oct 08 21:08:29.852236 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-62c08705-199d-484e-9219-1a3c5a72f281 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Request method failure captured: Oct 08 21:08:29.852236 ncdv-master-1 devstack@n-api.service[140491]: request: GET /compute/v2.1/servers/911394e0-0af3-4433-acfb-a4652d4e2e84 HTTP/1.1 Oct 08 21:08:29.852236 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:08:29.852236 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:08:29.852236 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:08:29.852236 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 21:08:29.852236 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:08:29.852236 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:08:29.852236 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:08:29.852236 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:08:29.852236 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeaY45CCffIT40Amc9wEG1L3srTtCd58z19KxF0fYIwNPulOEB6B0U5KbwvP4xZlDymYa3r7NupuSBl7IoxTUgzZohPJnXbaXnL_FvPvzvmymW0IMjU5l88HUbi73sOE2TxCcEBd6artojZxtGFF9N7yzN3dTHpujcvoWiRD4lXAI28 Oct 08 21:08:29.852236 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:08:29.852236 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:08:29.852236 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:08:29.852236 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:08:29.852236 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:08:29.852236 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:08:29.852236 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 765c62cac2ee4406b23a5baa85c52ff7 Oct 08 21:08:29.852236 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-DeleteServersTestJSON-1423663413 Oct 08 21:08:29.852236 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:08:29.852236 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:08:29.852236 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/765c62cac2ee4406b23a5baa85c52ff7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/765c62cac2ee4406b23a5baa85c52ff7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_765c62cac2ee4406b23a5baa85c52ff7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/765c62cac2ee4406b23a5baa85c52ff7"}]}] Oct 08 21:08:29.852236 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-DeleteServersTestJSON-1423663413 Oct 08 21:08:29.852236 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 765c62cac2ee4406b23a5baa85c52ff7 Oct 08 21:08:29.852236 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-DeleteServersTestJSON-1423663413 Oct 08 21:08:29.852236 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-DeleteServersTestJSON-1423663413-project Oct 08 21:08:29.852236 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:08:29.852236 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:08:29.852236 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: d78e9afd772c4de981cac8f5817ec356 Oct 08 21:08:29.852236 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-DeleteServersTestJSON-1423663413-project Oct 08 21:08:29.852236 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:08:29.852236 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance 911394e0-0af3-4433-acfb-a4652d4e2e84 could not be found. Oct 08 21:08:29.852236 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': '911394e0-0af3-4433-acfb-a4652d4e2e84'} Oct 08 21:08:29.852236 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:08:29.852236 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:08:29.852236 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:08:29.852236 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:08:29.852236 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:08:29.852236 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:08:29.852236 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:08:29.852236 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:08:29.852236 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:08:29.852236 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:08:29.852236 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 911394e0-0af3-4433-acfb-a4652d4e2e84 could not be found. Oct 08 21:08:29.852236 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:08:29.852236 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:08:29.852236 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:08:29.852236 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:08:29.852236 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:08:29.852236 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:08:29.852236 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:08:29.852236 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:08:29.852236 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:08:29.852236 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:08:29.852236 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:08:29.852236 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:08:29.852236 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:08:29.852236 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:08:29.852236 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:08:29.852236 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:08:29.852236 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 911394e0-0af3-4433-acfb-a4652d4e2e84 could not be found. Oct 08 21:08:29.852236 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:08:29.852236 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:08:29.852236 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:08:29.856010 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:08:29.856010 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:08:29.856010 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:08:29.856010 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:08:29.856010 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:08:29.856010 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 911394e0-0af3-4433-acfb-a4652d4e2e84 could not be found. Oct 08 21:08:29.856010 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:08:29.856010 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-62c08705-199d-484e-9219-1a3c5a72f281 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Returning 404 to user: Instance 911394e0-0af3-4433-acfb-a4652d4e2e84 could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:08:29.858752 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-62c08705-199d-484e-9219-1a3c5a72f281 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/911394e0-0af3-4433-acfb-a4652d4e2e84" status: 404 len: 111 microversion: 2.1 time: 0.119414 Oct 08 21:08:29.859786 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1910/3903] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:08:29 2022] GET /compute/v2.1/servers/911394e0-0af3-4433-acfb-a4652d4e2e84 => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 08 21:08:29.872373 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-11dc3fba-23e9-4990-a81f-065a93be9823 req-4a5cc7dc-6e69-49c0-bc61-f2ea3249092b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9e77bd1-3ce0-4f0a-b5ac-8c0ba6caffbb", "tag": "d7fcb7de-d762-4c1b-b3d5-f613b5fc112a"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:08:29.896737 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-11dc3fba-23e9-4990-a81f-065a93be9823 req-4a5cc7dc-6e69-49c0-bc61-f2ea3249092b service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:29.900046 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-11dc3fba-23e9-4990-a81f-065a93be9823 req-4a5cc7dc-6e69-49c0-bc61-f2ea3249092b service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:29.903172 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-11dc3fba-23e9-4990-a81f-065a93be9823 req-4a5cc7dc-6e69-49c0-bc61-f2ea3249092b service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:29.952091 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-11dc3fba-23e9-4990-a81f-065a93be9823 req-4a5cc7dc-6e69-49c0-bc61-f2ea3249092b service nova] Creating event network-changed:d7fcb7de-d762-4c1b-b3d5-f613b5fc112a for instance b9e77bd1-3ce0-4f0a-b5ac-8c0ba6caffbb on nch1-master-1 Oct 08 21:08:29.986421 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-11dc3fba-23e9-4990-a81f-065a93be9823 req-4a5cc7dc-6e69-49c0-bc61-f2ea3249092b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120372 Oct 08 21:08:29.989856 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1911/3904] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:08:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:08:29.996951 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-f5a27f5a-8131-42d6-9dd9-bc23b2ba3155 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06443b5728fb4d1e95d6245820e786bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ded993145b4eda9d6a33b994519012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:30.006707 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-f5a27f5a-8131-42d6-9dd9-bc23b2ba3155 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "GET /compute/v2.1/servers/4e630da9-7820-47ef-ac72-1c91af94ff64" status: 200 len: 1309 microversion: 2.1 time: 0.586604 Oct 08 21:08:30.007865 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-7f5634a6-07ca-4ba0-9723-9c51904e00bd tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:30.010102 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-7f5634a6-07ca-4ba0-9723-9c51904e00bd tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] [instance: b9e77bd1-3ce0-4f0a-b5ac-8c0ba6caffbb] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:30.010599 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1994/3905] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:08:29 2022] GET /compute/v2.1/servers/4e630da9-7820-47ef-ac72-1c91af94ff64 => generated 1309 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:08:30.031955 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7f5634a6-07ca-4ba0-9723-9c51904e00bd tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:30.032678 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7f5634a6-07ca-4ba0-9723-9c51904e00bd tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:30.033369 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7f5634a6-07ca-4ba0-9723-9c51904e00bd tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:30.034304 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7f5634a6-07ca-4ba0-9723-9c51904e00bd tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:30.034942 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7f5634a6-07ca-4ba0-9723-9c51904e00bd tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:30.035524 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7f5634a6-07ca-4ba0-9723-9c51904e00bd tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:30.050238 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-7a40d1ff-bb71-4dbc-892c-fd54150d791b tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:30.061525 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-7a40d1ff-bb71-4dbc-892c-fd54150d791b tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: 911394e0-0af3-4433-acfb-a4652d4e2e84] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:30.073655 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7a40d1ff-bb71-4dbc-892c-fd54150d791b tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:30.074988 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7a40d1ff-bb71-4dbc-892c-fd54150d791b tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:30.075652 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7a40d1ff-bb71-4dbc-892c-fd54150d791b tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:30.076614 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7a40d1ff-bb71-4dbc-892c-fd54150d791b tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:30.078242 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7a40d1ff-bb71-4dbc-892c-fd54150d791b tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:30.078722 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7a40d1ff-bb71-4dbc-892c-fd54150d791b tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:30.098354 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-7a40d1ff-bb71-4dbc-892c-fd54150d791b tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] HTTP exception thrown: Instance 911394e0-0af3-4433-acfb-a4652d4e2e84 could not be found. Oct 08 21:08:30.100731 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-7a40d1ff-bb71-4dbc-892c-fd54150d791b tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Request method failure captured: Oct 08 21:08:30.100731 ncdv-master-1 devstack@n-api.service[140492]: request: GET /compute/v2.1/servers/911394e0-0af3-4433-acfb-a4652d4e2e84/os-volume_attachments HTTP/1.1 Oct 08 21:08:30.100731 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:08:30.100731 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:08:30.100731 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:08:30.100731 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 21:08:30.100731 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:08:30.100731 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:08:30.100731 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:08:30.100731 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:08:30.100731 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeaY45CCffIT40Amc9wEG1L3srTtCd58z19KxF0fYIwNPulOEB6B0U5KbwvP4xZlDymYa3r7NupuSBl7IoxTUgzZohPJnXbaXnL_FvPvzvmymW0IMjU5l88HUbi73sOE2TxCcEBd6artojZxtGFF9N7yzN3dTHpujcvoWiRD4lXAI28 Oct 08 21:08:30.100731 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:08:30.100731 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:08:30.100731 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:08:30.100731 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:08:30.100731 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:08:30.100731 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:08:30.100731 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 765c62cac2ee4406b23a5baa85c52ff7 Oct 08 21:08:30.100731 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-DeleteServersTestJSON-1423663413 Oct 08 21:08:30.100731 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:08:30.100731 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:08:30.100731 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/765c62cac2ee4406b23a5baa85c52ff7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/765c62cac2ee4406b23a5baa85c52ff7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_765c62cac2ee4406b23a5baa85c52ff7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/765c62cac2ee4406b23a5baa85c52ff7"}]}] Oct 08 21:08:30.100731 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-DeleteServersTestJSON-1423663413 Oct 08 21:08:30.100731 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 765c62cac2ee4406b23a5baa85c52ff7 Oct 08 21:08:30.100731 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-DeleteServersTestJSON-1423663413 Oct 08 21:08:30.100731 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-DeleteServersTestJSON-1423663413-project Oct 08 21:08:30.100731 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:08:30.100731 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:08:30.100731 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: d78e9afd772c4de981cac8f5817ec356 Oct 08 21:08:30.100731 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-DeleteServersTestJSON-1423663413-project Oct 08 21:08:30.100731 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 21:08:30.100731 ncdv-master-1 devstack@n-api.service[140492]: exception: Instance 911394e0-0af3-4433-acfb-a4652d4e2e84 could not be found. Oct 08 21:08:30.100731 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'server_id': '911394e0-0af3-4433-acfb-a4652d4e2e84'} Oct 08 21:08:30.100731 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:08:30.100731 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:08:30.100731 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:08:30.100731 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:08:30.100731 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:08:30.100731 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:08:30.100731 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:08:30.100731 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:08:30.100731 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:08:30.100731 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:08:30.100731 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 911394e0-0af3-4433-acfb-a4652d4e2e84 could not be found. Oct 08 21:08:30.100731 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:08:30.100731 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:08:30.100731 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:08:30.100731 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:08:30.100731 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:08:30.100731 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:08:30.100731 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:08:30.100731 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:08:30.100731 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:08:30.100731 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:08:30.100731 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 08 21:08:30.100731 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 21:08:30.100731 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 08 21:08:30.100731 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 21:08:30.100731 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 08 21:08:30.100731 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 08 21:08:30.100731 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:08:30.100731 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:08:30.105388 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 911394e0-0af3-4433-acfb-a4652d4e2e84 could not be found. Oct 08 21:08:30.105388 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:08:30.105388 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:08:30.105388 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:08:30.105388 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:08:30.105388 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:08:30.105388 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:08:30.105388 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:08:30.105388 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:08:30.105388 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 911394e0-0af3-4433-acfb-a4652d4e2e84 could not be found. Oct 08 21:08:30.105388 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:08:30.105388 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-7a40d1ff-bb71-4dbc-892c-fd54150d791b tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Returning 404 to user: Instance 911394e0-0af3-4433-acfb-a4652d4e2e84 could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:08:30.105388 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-7a40d1ff-bb71-4dbc-892c-fd54150d791b tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/911394e0-0af3-4433-acfb-a4652d4e2e84/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.059148 Oct 08 21:08:30.105388 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1995/3906] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Oct 8 21:08:30 2022] GET /compute/v2.1/servers/911394e0-0af3-4433-acfb-a4652d4e2e84/os-volume_attachments => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:08:30.109519 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-d71b880d-28fa-45e2-af96-cb3a7bb2c648 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:30.110157 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-d71b880d-28fa-45e2-af96-cb3a7bb2c648 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] [instance: 159e29dd-802c-4059-99f9-bb7c113d430b] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:30.118310 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d71b880d-28fa-45e2-af96-cb3a7bb2c648 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:30.118919 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d71b880d-28fa-45e2-af96-cb3a7bb2c648 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:30.120059 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d71b880d-28fa-45e2-af96-cb3a7bb2c648 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:30.120987 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d71b880d-28fa-45e2-af96-cb3a7bb2c648 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:30.121597 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d71b880d-28fa-45e2-af96-cb3a7bb2c648 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:30.122166 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d71b880d-28fa-45e2-af96-cb3a7bb2c648 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:30.253028 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-d71b880d-28fa-45e2-af96-cb3a7bb2c648 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:30.266041 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-d71b880d-28fa-45e2-af96-cb3a7bb2c648 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:30.267527 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-d71b880d-28fa-45e2-af96-cb3a7bb2c648 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:30.271600 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-d71b880d-28fa-45e2-af96-cb3a7bb2c648 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] 10.222.0.26 "GET /compute/v2.1/servers/159e29dd-802c-4059-99f9-bb7c113d430b" status: 200 len: 1339 microversion: 2.20 time: 0.166960 Oct 08 21:08:30.282939 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1996/3907] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:08:30 2022] GET /compute/v2.1/servers/159e29dd-802c-4059-99f9-bb7c113d430b => generated 1339 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:08:30.373731 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-fea306b6-c5c4-470e-8310-eabcc6abde92 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1239081454", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "networks": [{"uuid": "82d56471-f1e9-4dc0-935a-29f2f2d2c7c0"}]}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:08:30.441899 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.network.neutron [None req-fea306b6-c5c4-470e-8310-eabcc6abde92 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] validate_networks() for [('82d56471-f1e9-4dc0-935a-29f2f2d2c7c0', None, None, None, None, None)] {{(pid=140492) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 21:08:30.585684 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-7f5634a6-07ca-4ba0-9723-9c51904e00bd tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30fe0e1ffa1040ec85d3c32d8b741c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd0e7c24154409824f96e9e99da357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:30.609153 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-7f5634a6-07ca-4ba0-9723-9c51904e00bd tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "GET /compute/v2.1/servers/b9e77bd1-3ce0-4f0a-b5ac-8c0ba6caffbb" status: 200 len: 1307 microversion: 2.1 time: 0.616579 Oct 08 21:08:30.621639 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1912/3908] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:08:29 2022] GET /compute/v2.1/servers/b9e77bd1-3ce0-4f0a-b5ac-8c0ba6caffbb => generated 1307 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:08:30.857896 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-e0eaa9b2-8d2f-4757-899e-e0695076c0d9 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:30.860659 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-e0eaa9b2-8d2f-4757-899e-e0695076c0d9 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] [instance: ce4a2fbf-76f3-4577-a704-3b64ec30d84b] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:30.867678 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e0eaa9b2-8d2f-4757-899e-e0695076c0d9 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:30.868712 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e0eaa9b2-8d2f-4757-899e-e0695076c0d9 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:30.869424 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e0eaa9b2-8d2f-4757-899e-e0695076c0d9 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:30.870951 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e0eaa9b2-8d2f-4757-899e-e0695076c0d9 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:30.871644 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e0eaa9b2-8d2f-4757-899e-e0695076c0d9 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:30.872283 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e0eaa9b2-8d2f-4757-899e-e0695076c0d9 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:30.908380 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-e0eaa9b2-8d2f-4757-899e-e0695076c0d9 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] 10.222.0.26 "GET /compute/v2.1/servers/ce4a2fbf-76f3-4577-a704-3b64ec30d84b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054314 Oct 08 21:08:30.909911 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1913/3909] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Oct 8 21:08:30 2022] GET /compute/v2.1/servers/ce4a2fbf-76f3-4577-a704-3b64ec30d84b/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 08 21:08:30.995499 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-0f52a25a-8c8d-4011-9a01-4f863e7a9927 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:30.996326 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-0f52a25a-8c8d-4011-9a01-4f863e7a9927 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] [instance: ce4a2fbf-76f3-4577-a704-3b64ec30d84b] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:31.003568 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0f52a25a-8c8d-4011-9a01-4f863e7a9927 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:31.004366 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0f52a25a-8c8d-4011-9a01-4f863e7a9927 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:31.004997 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0f52a25a-8c8d-4011-9a01-4f863e7a9927 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:31.005943 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0f52a25a-8c8d-4011-9a01-4f863e7a9927 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:31.006622 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0f52a25a-8c8d-4011-9a01-4f863e7a9927 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:31.007240 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0f52a25a-8c8d-4011-9a01-4f863e7a9927 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:31.040732 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-0f52a25a-8c8d-4011-9a01-4f863e7a9927 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] [instance: ce4a2fbf-76f3-4577-a704-3b64ec30d84b] Going to try to terminate instance {{(pid=140491) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 21:08:31.129044 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=2 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:08:31.152251 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-0f52a25a-8c8d-4011-9a01-4f863e7a9927 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] 10.222.0.26 "DELETE /compute/v2.1/servers/ce4a2fbf-76f3-4577-a704-3b64ec30d84b" status: 204 len: 0 microversion: 2.1 time: 0.161083 Oct 08 21:08:31.153651 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1914/3910] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:08:30 2022] DELETE /compute/v2.1/servers/ce4a2fbf-76f3-4577-a704-3b64ec30d84b => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 08 21:08:31.161508 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-9020a324-fc17-41f0-a8ef-88512c6a76db tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:31.162544 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-9020a324-fc17-41f0-a8ef-88512c6a76db tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: 4e630da9-7820-47ef-ac72-1c91af94ff64] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:31.173010 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9020a324-fc17-41f0-a8ef-88512c6a76db tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:31.173699 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9020a324-fc17-41f0-a8ef-88512c6a76db tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:31.176820 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9020a324-fc17-41f0-a8ef-88512c6a76db tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:31.178001 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9020a324-fc17-41f0-a8ef-88512c6a76db tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:31.178482 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9020a324-fc17-41f0-a8ef-88512c6a76db tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:31.178936 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9020a324-fc17-41f0-a8ef-88512c6a76db tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:31.809512 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-9020a324-fc17-41f0-a8ef-88512c6a76db tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06443b5728fb4d1e95d6245820e786bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ded993145b4eda9d6a33b994519012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:31.826724 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-9020a324-fc17-41f0-a8ef-88512c6a76db tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "GET /compute/v2.1/servers/4e630da9-7820-47ef-ac72-1c91af94ff64" status: 200 len: 1309 microversion: 2.1 time: 0.670732 Oct 08 21:08:31.837452 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1915/3911] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:08:31 2022] GET /compute/v2.1/servers/4e630da9-7820-47ef-ac72-1c91af94ff64 => generated 1309 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:08:31.843416 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-33fa6aa5-683a-4b0d-bfe4-08f8522fed53 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:31.844263 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-33fa6aa5-683a-4b0d-bfe4-08f8522fed53 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] [instance: ce4a2fbf-76f3-4577-a704-3b64ec30d84b] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:31.853833 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-33fa6aa5-683a-4b0d-bfe4-08f8522fed53 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:31.854364 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-33fa6aa5-683a-4b0d-bfe4-08f8522fed53 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:31.855021 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-33fa6aa5-683a-4b0d-bfe4-08f8522fed53 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:31.855899 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-33fa6aa5-683a-4b0d-bfe4-08f8522fed53 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:31.856405 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-33fa6aa5-683a-4b0d-bfe4-08f8522fed53 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:31.857552 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-33fa6aa5-683a-4b0d-bfe4-08f8522fed53 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:31.882407 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-fea306b6-c5c4-470e-8310-eabcc6abde92 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Flavor limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 21:08:31.884279 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-fea306b6-c5c4-470e-8310-eabcc6abde92 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Image limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 21:08:31.886877 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-fea306b6-c5c4-470e-8310-eabcc6abde92 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Flavor pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 21:08:31.889299 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-fea306b6-c5c4-470e-8310-eabcc6abde92 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Image pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 21:08:31.890471 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-fea306b6-c5c4-470e-8310-eabcc6abde92 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 21:08:31.911058 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fea306b6-c5c4-470e-8310-eabcc6abde92 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:31.912592 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fea306b6-c5c4-470e-8310-eabcc6abde92 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:31.913990 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fea306b6-c5c4-470e-8310-eabcc6abde92 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:31.914985 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fea306b6-c5c4-470e-8310-eabcc6abde92 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:31.915650 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fea306b6-c5c4-470e-8310-eabcc6abde92 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:31.916768 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fea306b6-c5c4-470e-8310-eabcc6abde92 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:31.985363 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-fea306b6-c5c4-470e-8310-eabcc6abde92 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Getting quotas for project 765c62cac2ee4406b23a5baa85c52ff7. Resources: {'cores', 'instances', 'ram'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:08:31.999905 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-fea306b6-c5c4-470e-8310-eabcc6abde92 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Getting quotas for user d78e9afd772c4de981cac8f5817ec356 and project 765c62cac2ee4406b23a5baa85c52ff7. Resources: {'cores', 'instances', 'ram'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:08:32.006609 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:08:32.022995 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-fea306b6-c5c4-470e-8310-eabcc6abde92 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Going to run 1 instances... {{(pid=140492) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 21:08:32.026551 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-fea306b6-c5c4-470e-8310-eabcc6abde92 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: dbe20090-9878-4b39-8daf-c784b9721869] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c508bd7f-7db9-4b2c-af7c-be54a855c355',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140492) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 21:08:32.125586 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-fea306b6-c5c4-470e-8310-eabcc6abde92 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.755243 Oct 08 21:08:32.133626 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1997/3912] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 21:08:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1764 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 08 21:08:32.144254 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-c5fc8324-feea-447a-8b4b-912999418fe0 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:32.145793 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-c5fc8324-feea-447a-8b4b-912999418fe0 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] [instance: 159e29dd-802c-4059-99f9-bb7c113d430b] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:32.159421 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c5fc8324-feea-447a-8b4b-912999418fe0 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:32.160316 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c5fc8324-feea-447a-8b4b-912999418fe0 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:32.161457 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c5fc8324-feea-447a-8b4b-912999418fe0 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:32.162576 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c5fc8324-feea-447a-8b4b-912999418fe0 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:32.163481 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c5fc8324-feea-447a-8b4b-912999418fe0 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:32.165509 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c5fc8324-feea-447a-8b4b-912999418fe0 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:32.304698 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-33fa6aa5-683a-4b0d-bfe4-08f8522fed53 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85abb492492343c58734564a2b26c8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68b14967e8249fd886f168d366f241f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:32.320629 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-33fa6aa5-683a-4b0d-bfe4-08f8522fed53 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] 10.222.0.26 "GET /compute/v2.1/servers/ce4a2fbf-76f3-4577-a704-3b64ec30d84b" status: 200 len: 1674 microversion: 2.1 time: 0.487453 Oct 08 21:08:32.321555 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1916/3913] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:08:31 2022] GET /compute/v2.1/servers/ce4a2fbf-76f3-4577-a704-3b64ec30d84b => generated 1674 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:08:32.354307 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-3136ba6a-d15b-4f4b-b754-edd88a55f5d8 req-a27af0f5-1b93-465f-b4da-e9305fa39989 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e630da9-7820-47ef-ac72-1c91af94ff64", "name": "network-vif-plugged", "status": "completed", "tag": "226a8b36-ead5-4696-86c9-94037a55f634"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:08:32.377807 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-3136ba6a-d15b-4f4b-b754-edd88a55f5d8 req-a27af0f5-1b93-465f-b4da-e9305fa39989 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:32.378572 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-3136ba6a-d15b-4f4b-b754-edd88a55f5d8 req-a27af0f5-1b93-465f-b4da-e9305fa39989 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:32.379212 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-3136ba6a-d15b-4f4b-b754-edd88a55f5d8 req-a27af0f5-1b93-465f-b4da-e9305fa39989 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:32.394408 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-3136ba6a-d15b-4f4b-b754-edd88a55f5d8 req-a27af0f5-1b93-465f-b4da-e9305fa39989 service nova] Creating event network-vif-plugged:226a8b36-ead5-4696-86c9-94037a55f634 for instance 4e630da9-7820-47ef-ac72-1c91af94ff64 on nch2-master-1 Oct 08 21:08:32.400832 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-3136ba6a-d15b-4f4b-b754-edd88a55f5d8 req-a27af0f5-1b93-465f-b4da-e9305fa39989 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067507 Oct 08 21:08:32.402006 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1917/3914] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:08:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:08:32.410549 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-88b95db3-f49e-47e9-b787-513f30787c9c tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:32.413100 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-88b95db3-f49e-47e9-b787-513f30787c9c tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] [instance: b9e77bd1-3ce0-4f0a-b5ac-8c0ba6caffbb] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:32.446119 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-88b95db3-f49e-47e9-b787-513f30787c9c tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:32.449443 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-88b95db3-f49e-47e9-b787-513f30787c9c tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:32.452749 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-88b95db3-f49e-47e9-b787-513f30787c9c tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:32.454877 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-88b95db3-f49e-47e9-b787-513f30787c9c tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:32.456591 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-88b95db3-f49e-47e9-b787-513f30787c9c tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:32.457064 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-88b95db3-f49e-47e9-b787-513f30787c9c tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:32.717449 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-c5fc8324-feea-447a-8b4b-912999418fe0 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:32.727846 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-c5fc8324-feea-447a-8b4b-912999418fe0 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:32.729737 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-c5fc8324-feea-447a-8b4b-912999418fe0 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:32.732886 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-c5fc8324-feea-447a-8b4b-912999418fe0 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] 10.222.0.26 "GET /compute/v2.1/servers/159e29dd-802c-4059-99f9-bb7c113d430b" status: 200 len: 1406 microversion: 2.20 time: 0.596295 Oct 08 21:08:32.734065 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1998/3915] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:08:32 2022] GET /compute/v2.1/servers/159e29dd-802c-4059-99f9-bb7c113d430b => generated 1406 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:08:32.739079 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e0783c05-61a5-47a6-9772-9dd4aa91fb9f tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:32.739933 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-e0783c05-61a5-47a6-9772-9dd4aa91fb9f tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: dbe20090-9878-4b39-8daf-c784b9721869] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:32.800812 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-88b95db3-f49e-47e9-b787-513f30787c9c tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30fe0e1ffa1040ec85d3c32d8b741c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd0e7c24154409824f96e9e99da357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:32.818192 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-88b95db3-f49e-47e9-b787-513f30787c9c tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "GET /compute/v2.1/servers/b9e77bd1-3ce0-4f0a-b5ac-8c0ba6caffbb" status: 200 len: 1307 microversion: 2.1 time: 0.414191 Oct 08 21:08:32.819866 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1918/3916] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:08:32 2022] GET /compute/v2.1/servers/b9e77bd1-3ce0-4f0a-b5ac-8c0ba6caffbb => generated 1307 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:08:32.857435 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-251c15fb-7ece-4a5b-b84f-3ed880026b9e tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:32.858351 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-251c15fb-7ece-4a5b-b84f-3ed880026b9e tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: 4e630da9-7820-47ef-ac72-1c91af94ff64] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:32.869510 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-251c15fb-7ece-4a5b-b84f-3ed880026b9e tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:32.872404 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-251c15fb-7ece-4a5b-b84f-3ed880026b9e tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:32.873109 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-251c15fb-7ece-4a5b-b84f-3ed880026b9e tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:32.874078 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-251c15fb-7ece-4a5b-b84f-3ed880026b9e tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:32.878713 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-251c15fb-7ece-4a5b-b84f-3ed880026b9e tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:32.879497 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-251c15fb-7ece-4a5b-b84f-3ed880026b9e tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:33.077976 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-e0783c05-61a5-47a6-9772-9dd4aa91fb9f tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78e9afd772c4de981cac8f5817ec356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765c62cac2ee4406b23a5baa85c52ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:33.092452 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-e0783c05-61a5-47a6-9772-9dd4aa91fb9f tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/dbe20090-9878-4b39-8daf-c784b9721869" status: 200 len: 1215 microversion: 2.1 time: 0.356833 Oct 08 21:08:33.095113 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 1999/3917] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:08:32 2022] GET /compute/v2.1/servers/dbe20090-9878-4b39-8daf-c784b9721869 => generated 1215 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:08:33.120124 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e3aeec9d-8d4b-43c2-a9f2-8fdcaae4d458 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:33.121070 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-e3aeec9d-8d4b-43c2-a9f2-8fdcaae4d458 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: dbe20090-9878-4b39-8daf-c784b9721869] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:33.129583 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e3aeec9d-8d4b-43c2-a9f2-8fdcaae4d458 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:33.131195 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e3aeec9d-8d4b-43c2-a9f2-8fdcaae4d458 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:33.131928 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e3aeec9d-8d4b-43c2-a9f2-8fdcaae4d458 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:33.133484 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e3aeec9d-8d4b-43c2-a9f2-8fdcaae4d458 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:33.134259 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e3aeec9d-8d4b-43c2-a9f2-8fdcaae4d458 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:33.135948 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e3aeec9d-8d4b-43c2-a9f2-8fdcaae4d458 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:33.188989 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-251c15fb-7ece-4a5b-b84f-3ed880026b9e tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06443b5728fb4d1e95d6245820e786bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ded993145b4eda9d6a33b994519012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:33.191244 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-e3aeec9d-8d4b-43c2-a9f2-8fdcaae4d458 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: dbe20090-9878-4b39-8daf-c784b9721869] Going to try to terminate instance {{(pid=140492) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 21:08:33.208810 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-251c15fb-7ece-4a5b-b84f-3ed880026b9e tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "GET /compute/v2.1/servers/4e630da9-7820-47ef-ac72-1c91af94ff64" status: 200 len: 1309 microversion: 2.1 time: 0.357001 Oct 08 21:08:33.221227 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1919/3918] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:08:32 2022] GET /compute/v2.1/servers/4e630da9-7820-47ef-ac72-1c91af94ff64 => generated 1309 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:08:33.222793 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e3aeec9d-8d4b-43c2-a9f2-8fdcaae4d458 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:33.223731 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e3aeec9d-8d4b-43c2-a9f2-8fdcaae4d458 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:33.229974 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e3aeec9d-8d4b-43c2-a9f2-8fdcaae4d458 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:33.250790 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.objects.instance [None req-e3aeec9d-8d4b-43c2-a9f2-8fdcaae4d458 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lazy-loading 'flavor' on Instance uuid dbe20090-9878-4b39-8daf-c784b9721869 {{(pid=140492) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 21:08:33.282769 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.objects.instance [None req-e3aeec9d-8d4b-43c2-a9f2-8fdcaae4d458 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lazy-loading 'system_metadata' on Instance uuid dbe20090-9878-4b39-8daf-c784b9721869 {{(pid=140492) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 21:08:33.349410 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-8661e4bb-c425-4edb-b838-3e56c71b2d06 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:33.350524 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-8661e4bb-c425-4edb-b838-3e56c71b2d06 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] [instance: ce4a2fbf-76f3-4577-a704-3b64ec30d84b] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:33.364916 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8661e4bb-c425-4edb-b838-3e56c71b2d06 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:33.365620 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8661e4bb-c425-4edb-b838-3e56c71b2d06 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:33.368959 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8661e4bb-c425-4edb-b838-3e56c71b2d06 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:33.372063 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8661e4bb-c425-4edb-b838-3e56c71b2d06 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:33.372753 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8661e4bb-c425-4edb-b838-3e56c71b2d06 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:33.373637 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8661e4bb-c425-4edb-b838-3e56c71b2d06 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:33.403317 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.objects.instance [None req-e3aeec9d-8d4b-43c2-a9f2-8fdcaae4d458 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lazy-loading 'metadata' on Instance uuid dbe20090-9878-4b39-8daf-c784b9721869 {{(pid=140492) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 21:08:34.210225 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.scheduler.client.report [None req-e3aeec9d-8d4b-43c2-a9f2-8fdcaae4d458 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Deleted allocations for instance dbe20090-9878-4b39-8daf-c784b9721869 Oct 08 21:08:34.272223 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-e3aeec9d-8d4b-43c2-a9f2-8fdcaae4d458 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "DELETE /compute/v2.1/servers/dbe20090-9878-4b39-8daf-c784b9721869" status: 204 len: 0 microversion: 2.1 time: 1.157322 Oct 08 21:08:34.281838 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2000/3919] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:08:33 2022] DELETE /compute/v2.1/servers/dbe20090-9878-4b39-8daf-c784b9721869 => generated 0 bytes in 1168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 08 21:08:34.298077 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-3bf120e7-7ce8-4860-8197-21e127649976 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:34.298729 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-3bf120e7-7ce8-4860-8197-21e127649976 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] [instance: 159e29dd-802c-4059-99f9-bb7c113d430b] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:34.334885 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3bf120e7-7ce8-4860-8197-21e127649976 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:34.335416 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3bf120e7-7ce8-4860-8197-21e127649976 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:34.337681 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3bf120e7-7ce8-4860-8197-21e127649976 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:34.339709 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3bf120e7-7ce8-4860-8197-21e127649976 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:34.340735 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3bf120e7-7ce8-4860-8197-21e127649976 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:34.340925 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3bf120e7-7ce8-4860-8197-21e127649976 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:34.610077 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-8661e4bb-c425-4edb-b838-3e56c71b2d06 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85abb492492343c58734564a2b26c8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68b14967e8249fd886f168d366f241f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:34.626666 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-8661e4bb-c425-4edb-b838-3e56c71b2d06 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] 10.222.0.26 "GET /compute/v2.1/servers/ce4a2fbf-76f3-4577-a704-3b64ec30d84b" status: 200 len: 1674 microversion: 2.1 time: 1.279047 Oct 08 21:08:34.628697 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1920/3920] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:08:33 2022] GET /compute/v2.1/servers/ce4a2fbf-76f3-4577-a704-3b64ec30d84b => generated 1674 bytes in 1284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:08:34.645381 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-b44bd440-901c-4112-a87d-757d012eeb05 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:34.646978 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-b44bd440-901c-4112-a87d-757d012eeb05 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] [instance: b9e77bd1-3ce0-4f0a-b5ac-8c0ba6caffbb] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:34.655631 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b44bd440-901c-4112-a87d-757d012eeb05 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:34.656276 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b44bd440-901c-4112-a87d-757d012eeb05 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:34.661554 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b44bd440-901c-4112-a87d-757d012eeb05 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:34.662541 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b44bd440-901c-4112-a87d-757d012eeb05 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:34.666109 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b44bd440-901c-4112-a87d-757d012eeb05 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:34.666975 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b44bd440-901c-4112-a87d-757d012eeb05 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:34.997164 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-3bf120e7-7ce8-4860-8197-21e127649976 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:35.014604 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-3bf120e7-7ce8-4860-8197-21e127649976 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:35.022875 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-3bf120e7-7ce8-4860-8197-21e127649976 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:35.026702 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-3bf120e7-7ce8-4860-8197-21e127649976 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] 10.222.0.26 "GET /compute/v2.1/servers/159e29dd-802c-4059-99f9-bb7c113d430b" status: 200 len: 1406 microversion: 2.20 time: 0.741254 Oct 08 21:08:35.028069 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2001/3921] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:08:34 2022] GET /compute/v2.1/servers/159e29dd-802c-4059-99f9-bb7c113d430b => generated 1406 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:08:35.051573 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-02a06dc8-1cf1-403b-b6fa-b4fb88706831 req-5c61f52b-a226-418b-ab51-dcca4f18644b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "159e29dd-802c-4059-99f9-bb7c113d430b", "tag": "59479dc9-06cf-4a86-bedc-3998868989c8"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:08:35.071426 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-02a06dc8-1cf1-403b-b6fa-b4fb88706831 req-5c61f52b-a226-418b-ab51-dcca4f18644b service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:35.072987 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-02a06dc8-1cf1-403b-b6fa-b4fb88706831 req-5c61f52b-a226-418b-ab51-dcca4f18644b service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:35.073731 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-02a06dc8-1cf1-403b-b6fa-b4fb88706831 req-5c61f52b-a226-418b-ab51-dcca4f18644b service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:35.096358 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-02a06dc8-1cf1-403b-b6fa-b4fb88706831 req-5c61f52b-a226-418b-ab51-dcca4f18644b service nova] Creating event network-changed:59479dc9-06cf-4a86-bedc-3998868989c8 for instance 159e29dd-802c-4059-99f9-bb7c113d430b on nch2-master-1 Oct 08 21:08:35.112930 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-02a06dc8-1cf1-403b-b6fa-b4fb88706831 req-5c61f52b-a226-418b-ab51-dcca4f18644b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073906 Oct 08 21:08:35.117229 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2002/3922] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:08:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:08:35.123535 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-61d16b1c-5649-46d8-b9b7-6de75ca6c66c tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:35.124260 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-61d16b1c-5649-46d8-b9b7-6de75ca6c66c tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: 4e630da9-7820-47ef-ac72-1c91af94ff64] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:35.134738 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-61d16b1c-5649-46d8-b9b7-6de75ca6c66c tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:35.135353 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-61d16b1c-5649-46d8-b9b7-6de75ca6c66c tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:35.135889 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-61d16b1c-5649-46d8-b9b7-6de75ca6c66c tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:35.136650 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-61d16b1c-5649-46d8-b9b7-6de75ca6c66c tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:35.137119 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-61d16b1c-5649-46d8-b9b7-6de75ca6c66c tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:35.137715 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-61d16b1c-5649-46d8-b9b7-6de75ca6c66c tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:35.847340 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-61d16b1c-5649-46d8-b9b7-6de75ca6c66c tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06443b5728fb4d1e95d6245820e786bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ded993145b4eda9d6a33b994519012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:35.861356 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-61d16b1c-5649-46d8-b9b7-6de75ca6c66c tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "GET /compute/v2.1/servers/4e630da9-7820-47ef-ac72-1c91af94ff64" status: 200 len: 1491 microversion: 2.1 time: 0.742488 Oct 08 21:08:35.879234 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2003/3923] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:08:35 2022] GET /compute/v2.1/servers/4e630da9-7820-47ef-ac72-1c91af94ff64 => generated 1491 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:08:35.899235 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-76eeac33-d7a8-4a5c-9695-b181aac89480 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:35.900347 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-76eeac33-d7a8-4a5c-9695-b181aac89480 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: dbe20090-9878-4b39-8daf-c784b9721869] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:35.910044 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-76eeac33-d7a8-4a5c-9695-b181aac89480 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:35.910387 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-76eeac33-d7a8-4a5c-9695-b181aac89480 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:35.911261 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-76eeac33-d7a8-4a5c-9695-b181aac89480 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:35.912585 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-76eeac33-d7a8-4a5c-9695-b181aac89480 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:35.913382 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-76eeac33-d7a8-4a5c-9695-b181aac89480 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:35.914147 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-76eeac33-d7a8-4a5c-9695-b181aac89480 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:35.935335 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-76eeac33-d7a8-4a5c-9695-b181aac89480 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] HTTP exception thrown: Instance dbe20090-9878-4b39-8daf-c784b9721869 could not be found. Oct 08 21:08:35.937596 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-76eeac33-d7a8-4a5c-9695-b181aac89480 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Request method failure captured: Oct 08 21:08:35.937596 ncdv-master-1 devstack@n-api.service[140492]: request: GET /compute/v2.1/servers/dbe20090-9878-4b39-8daf-c784b9721869 HTTP/1.1 Oct 08 21:08:35.937596 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:08:35.937596 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:08:35.937596 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:08:35.937596 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 21:08:35.937596 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:08:35.937596 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:08:35.937596 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:08:35.937596 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:08:35.937596 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeaY45CCffIT40Amc9wEG1L3srTtCd58z19KxF0fYIwNPulOEB6B0U5KbwvP4xZlDymYa3r7NupuSBl7IoxTUgzZohPJnXbaXnL_FvPvzvmymW0IMjU5l88HUbi73sOE2TxCcEBd6artojZxtGFF9N7yzN3dTHpujcvoWiRD4lXAI28 Oct 08 21:08:35.937596 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:08:35.937596 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:08:35.937596 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:08:35.937596 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:08:35.937596 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:08:35.937596 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:08:35.937596 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 765c62cac2ee4406b23a5baa85c52ff7 Oct 08 21:08:35.937596 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-DeleteServersTestJSON-1423663413 Oct 08 21:08:35.937596 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:08:35.937596 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:08:35.937596 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/765c62cac2ee4406b23a5baa85c52ff7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/765c62cac2ee4406b23a5baa85c52ff7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_765c62cac2ee4406b23a5baa85c52ff7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/765c62cac2ee4406b23a5baa85c52ff7"}]}] Oct 08 21:08:35.937596 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-DeleteServersTestJSON-1423663413 Oct 08 21:08:35.937596 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 765c62cac2ee4406b23a5baa85c52ff7 Oct 08 21:08:35.937596 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-DeleteServersTestJSON-1423663413 Oct 08 21:08:35.937596 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-DeleteServersTestJSON-1423663413-project Oct 08 21:08:35.937596 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:08:35.937596 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:08:35.937596 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: d78e9afd772c4de981cac8f5817ec356 Oct 08 21:08:35.937596 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-DeleteServersTestJSON-1423663413-project Oct 08 21:08:35.937596 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 21:08:35.937596 ncdv-master-1 devstack@n-api.service[140492]: exception: Instance dbe20090-9878-4b39-8daf-c784b9721869 could not be found. Oct 08 21:08:35.937596 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': 'dbe20090-9878-4b39-8daf-c784b9721869'} Oct 08 21:08:35.937596 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:08:35.937596 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:08:35.937596 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:08:35.937596 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:08:35.937596 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:08:35.937596 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:08:35.937596 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:08:35.937596 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:08:35.937596 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:08:35.937596 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:08:35.937596 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dbe20090-9878-4b39-8daf-c784b9721869 could not be found. Oct 08 21:08:35.937596 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:08:35.937596 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:08:35.937596 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:08:35.937596 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:08:35.937596 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:08:35.937596 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:08:35.937596 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:08:35.937596 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:08:35.937596 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:08:35.937596 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:08:35.937596 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:08:35.937596 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:08:35.937596 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:08:35.937596 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:08:35.937596 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:08:35.937596 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:08:35.937596 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dbe20090-9878-4b39-8daf-c784b9721869 could not be found. Oct 08 21:08:35.937596 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:08:35.937596 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:08:35.937596 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:08:35.941923 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:08:35.941923 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:08:35.941923 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:08:35.941923 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:08:35.941923 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:08:35.941923 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dbe20090-9878-4b39-8daf-c784b9721869 could not be found. Oct 08 21:08:35.941923 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:08:35.944266 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-76eeac33-d7a8-4a5c-9695-b181aac89480 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Returning 404 to user: Instance dbe20090-9878-4b39-8daf-c784b9721869 could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:08:35.945348 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-76eeac33-d7a8-4a5c-9695-b181aac89480 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/dbe20090-9878-4b39-8daf-c784b9721869" status: 404 len: 111 microversion: 2.1 time: 0.064601 Oct 08 21:08:35.946070 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2004/3924] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:08:35 2022] GET /compute/v2.1/servers/dbe20090-9878-4b39-8daf-c784b9721869 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:08:35.952068 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-bdf554c7-d5ab-46b2-ad4a-c6a7724e8439 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:35.952986 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-bdf554c7-d5ab-46b2-ad4a-c6a7724e8439 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] [instance: ce4a2fbf-76f3-4577-a704-3b64ec30d84b] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:35.966517 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bdf554c7-d5ab-46b2-ad4a-c6a7724e8439 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:35.967718 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bdf554c7-d5ab-46b2-ad4a-c6a7724e8439 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:35.968700 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bdf554c7-d5ab-46b2-ad4a-c6a7724e8439 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:35.970216 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bdf554c7-d5ab-46b2-ad4a-c6a7724e8439 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:35.971091 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bdf554c7-d5ab-46b2-ad4a-c6a7724e8439 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:35.971874 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bdf554c7-d5ab-46b2-ad4a-c6a7724e8439 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:35.979329 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=11,nova_cell1:DELETE=2 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:08:35.990677 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=4 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:08:36.069591 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-b44bd440-901c-4112-a87d-757d012eeb05 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30fe0e1ffa1040ec85d3c32d8b741c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd0e7c24154409824f96e9e99da357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:36.086801 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-b44bd440-901c-4112-a87d-757d012eeb05 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "GET /compute/v2.1/servers/b9e77bd1-3ce0-4f0a-b5ac-8c0ba6caffbb" status: 200 len: 1307 microversion: 2.1 time: 1.455740 Oct 08 21:08:36.089990 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1921/3925] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:08:34 2022] GET /compute/v2.1/servers/b9e77bd1-3ce0-4f0a-b5ac-8c0ba6caffbb => generated 1307 bytes in 1461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:08:36.103330 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-7c7b39b6-d011-404f-81bd-c45fed62ca15 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:08:36.120537 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-7c7b39b6-d011-404f-81bd-c45fed62ca15 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: 4e630da9-7820-47ef-ac72-1c91af94ff64] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:36.140685 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7c7b39b6-d011-404f-81bd-c45fed62ca15 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:36.143558 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7c7b39b6-d011-404f-81bd-c45fed62ca15 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:36.144273 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7c7b39b6-d011-404f-81bd-c45fed62ca15 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:36.146156 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7c7b39b6-d011-404f-81bd-c45fed62ca15 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:36.146790 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7c7b39b6-d011-404f-81bd-c45fed62ca15 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:36.147432 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7c7b39b6-d011-404f-81bd-c45fed62ca15 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:36.233076 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-bdf554c7-d5ab-46b2-ad4a-c6a7724e8439 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85abb492492343c58734564a2b26c8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68b14967e8249fd886f168d366f241f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:36.247536 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-bdf554c7-d5ab-46b2-ad4a-c6a7724e8439 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] 10.222.0.26 "GET /compute/v2.1/servers/ce4a2fbf-76f3-4577-a704-3b64ec30d84b" status: 200 len: 1674 microversion: 2.1 time: 0.299879 Oct 08 21:08:36.248471 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2005/3926] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:08:35 2022] GET /compute/v2.1/servers/ce4a2fbf-76f3-4577-a704-3b64ec30d84b => generated 1674 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:08:36.270542 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-8d8c5678-9346-4ad3-8fd1-9089e91dcf58 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:36.271962 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-8d8c5678-9346-4ad3-8fd1-9089e91dcf58 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] [instance: 159e29dd-802c-4059-99f9-bb7c113d430b] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:36.284738 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8d8c5678-9346-4ad3-8fd1-9089e91dcf58 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:36.285359 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8d8c5678-9346-4ad3-8fd1-9089e91dcf58 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:36.286037 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8d8c5678-9346-4ad3-8fd1-9089e91dcf58 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:36.286824 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8d8c5678-9346-4ad3-8fd1-9089e91dcf58 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:36.287362 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8d8c5678-9346-4ad3-8fd1-9089e91dcf58 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:36.288063 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8d8c5678-9346-4ad3-8fd1-9089e91dcf58 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:36.290998 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-7c7b39b6-d011-404f-81bd-c45fed62ca15 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "PUT /compute/v2.1/servers/4e630da9-7820-47ef-ac72-1c91af94ff64" status: 200 len: 1086 microversion: 2.1 time: 0.197346 Oct 08 21:08:36.298506 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1922/3927] 10.222.0.26 () {60 vars in 1256 bytes} [Sat Oct 8 21:08:36 2022] PUT /compute/v2.1/servers/4e630da9-7820-47ef-ac72-1c91af94ff64 => generated 1086 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:08:36.304923 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-9ff32a26-87c7-44e7-95c5-4ab7fb631161 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-392490943", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "networks": [{"uuid": "82d56471-f1e9-4dc0-935a-29f2f2d2c7c0"}]}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:08:36.383883 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=14 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:08:36.410902 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.network.neutron [None req-9ff32a26-87c7-44e7-95c5-4ab7fb631161 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] validate_networks() for [('82d56471-f1e9-4dc0-935a-29f2f2d2c7c0', None, None, None, None, None)] {{(pid=140491) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 21:08:36.473706 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-8d8c5678-9346-4ad3-8fd1-9089e91dcf58 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:36.488327 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-8d8c5678-9346-4ad3-8fd1-9089e91dcf58 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:36.490664 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-8d8c5678-9346-4ad3-8fd1-9089e91dcf58 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:36.492030 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-8d8c5678-9346-4ad3-8fd1-9089e91dcf58 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] 10.222.0.26 "GET /compute/v2.1/servers/159e29dd-802c-4059-99f9-bb7c113d430b" status: 200 len: 1406 microversion: 2.20 time: 0.242335 Oct 08 21:08:36.493738 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2006/3928] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:08:36 2022] GET /compute/v2.1/servers/159e29dd-802c-4059-99f9-bb7c113d430b => generated 1406 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:08:36.499197 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-30ac6a32-b090-4b83-b430-e55c0628ed47 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:36.499992 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-30ac6a32-b090-4b83-b430-e55c0628ed47 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: 4e630da9-7820-47ef-ac72-1c91af94ff64] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:36.507321 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-30ac6a32-b090-4b83-b430-e55c0628ed47 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:36.508208 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-30ac6a32-b090-4b83-b430-e55c0628ed47 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:36.508964 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-30ac6a32-b090-4b83-b430-e55c0628ed47 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:36.510224 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-30ac6a32-b090-4b83-b430-e55c0628ed47 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:36.517375 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-30ac6a32-b090-4b83-b430-e55c0628ed47 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:36.518058 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-30ac6a32-b090-4b83-b430-e55c0628ed47 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:36.803985 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-30ac6a32-b090-4b83-b430-e55c0628ed47 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06443b5728fb4d1e95d6245820e786bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ded993145b4eda9d6a33b994519012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:36.812021 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-30ac6a32-b090-4b83-b430-e55c0628ed47 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "GET /compute/v2.1/servers/4e630da9-7820-47ef-ac72-1c91af94ff64" status: 200 len: 1512 microversion: 2.1 time: 0.316880 Oct 08 21:08:36.830299 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2007/3929] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:08:36 2022] GET /compute/v2.1/servers/4e630da9-7820-47ef-ac72-1c91af94ff64 => generated 1512 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:08:36.835233 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-a0218b52-8c40-445d-abf6-d1937c0089ba req-9a5620f3-3996-4f83-af26-6aa1caaa3896 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9e77bd1-3ce0-4f0a-b5ac-8c0ba6caffbb", "name": "network-vif-plugged", "status": "completed", "tag": "d7fcb7de-d762-4c1b-b3d5-f613b5fc112a"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:08:36.856001 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-a0218b52-8c40-445d-abf6-d1937c0089ba req-9a5620f3-3996-4f83-af26-6aa1caaa3896 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:36.857261 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-a0218b52-8c40-445d-abf6-d1937c0089ba req-9a5620f3-3996-4f83-af26-6aa1caaa3896 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:36.857847 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-a0218b52-8c40-445d-abf6-d1937c0089ba req-9a5620f3-3996-4f83-af26-6aa1caaa3896 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:36.871924 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-a0218b52-8c40-445d-abf6-d1937c0089ba req-9a5620f3-3996-4f83-af26-6aa1caaa3896 service nova] Creating event network-vif-plugged:d7fcb7de-d762-4c1b-b3d5-f613b5fc112a for instance b9e77bd1-3ce0-4f0a-b5ac-8c0ba6caffbb on nch1-master-1 Oct 08 21:08:36.877743 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-a0218b52-8c40-445d-abf6-d1937c0089ba req-9a5620f3-3996-4f83-af26-6aa1caaa3896 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046033 Oct 08 21:08:36.878959 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2008/3930] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:08:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:08:36.885467 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-7852d339-90e9-4379-b4a1-2cd4e05b8778 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:36.886792 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-7852d339-90e9-4379-b4a1-2cd4e05b8778 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: 4e630da9-7820-47ef-ac72-1c91af94ff64] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:36.895161 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7852d339-90e9-4379-b4a1-2cd4e05b8778 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:36.896015 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7852d339-90e9-4379-b4a1-2cd4e05b8778 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:36.896665 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7852d339-90e9-4379-b4a1-2cd4e05b8778 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:36.897640 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7852d339-90e9-4379-b4a1-2cd4e05b8778 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:36.898331 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7852d339-90e9-4379-b4a1-2cd4e05b8778 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:36.898963 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7852d339-90e9-4379-b4a1-2cd4e05b8778 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:37.454538 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-7852d339-90e9-4379-b4a1-2cd4e05b8778 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06443b5728fb4d1e95d6245820e786bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ded993145b4eda9d6a33b994519012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:37.467502 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-7852d339-90e9-4379-b4a1-2cd4e05b8778 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "GET /compute/v2.1/servers/4e630da9-7820-47ef-ac72-1c91af94ff64" status: 200 len: 1512 microversion: 2.1 time: 0.586716 Oct 08 21:08:37.468887 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2009/3931] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:08:36 2022] GET /compute/v2.1/servers/4e630da9-7820-47ef-ac72-1c91af94ff64 => generated 1512 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:08:37.492584 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e951dcac-8652-4e1c-85a5-cec014a9caf5 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:37.493431 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-e951dcac-8652-4e1c-85a5-cec014a9caf5 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] [instance: b9e77bd1-3ce0-4f0a-b5ac-8c0ba6caffbb] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:37.500755 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e951dcac-8652-4e1c-85a5-cec014a9caf5 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:37.501502 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e951dcac-8652-4e1c-85a5-cec014a9caf5 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:37.502125 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e951dcac-8652-4e1c-85a5-cec014a9caf5 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:37.502997 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e951dcac-8652-4e1c-85a5-cec014a9caf5 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:37.503625 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e951dcac-8652-4e1c-85a5-cec014a9caf5 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:37.504066 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e951dcac-8652-4e1c-85a5-cec014a9caf5 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:37.839703 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-e951dcac-8652-4e1c-85a5-cec014a9caf5 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30fe0e1ffa1040ec85d3c32d8b741c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd0e7c24154409824f96e9e99da357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:37.848914 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-e951dcac-8652-4e1c-85a5-cec014a9caf5 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "GET /compute/v2.1/servers/b9e77bd1-3ce0-4f0a-b5ac-8c0ba6caffbb" status: 200 len: 1307 microversion: 2.1 time: 0.362694 Oct 08 21:08:37.868247 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2010/3932] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:08:37 2022] GET /compute/v2.1/servers/b9e77bd1-3ce0-4f0a-b5ac-8c0ba6caffbb => generated 1307 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:08:37.868247 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-919ac84e-6a3f-4013-a5ac-791accecf5e4 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:37.868247 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-919ac84e-6a3f-4013-a5ac-791accecf5e4 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] [instance: ce4a2fbf-76f3-4577-a704-3b64ec30d84b] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:37.886112 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-919ac84e-6a3f-4013-a5ac-791accecf5e4 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:37.886640 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-919ac84e-6a3f-4013-a5ac-791accecf5e4 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:37.887228 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-919ac84e-6a3f-4013-a5ac-791accecf5e4 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:37.887990 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-919ac84e-6a3f-4013-a5ac-791accecf5e4 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:37.888439 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-919ac84e-6a3f-4013-a5ac-791accecf5e4 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:37.888874 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-919ac84e-6a3f-4013-a5ac-791accecf5e4 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:38.000021 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-919ac84e-6a3f-4013-a5ac-791accecf5e4 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85abb492492343c58734564a2b26c8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68b14967e8249fd886f168d366f241f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:38.009157 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-919ac84e-6a3f-4013-a5ac-791accecf5e4 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] 10.222.0.26 "GET /compute/v2.1/servers/ce4a2fbf-76f3-4577-a704-3b64ec30d84b" status: 200 len: 1606 microversion: 2.1 time: 0.151166 Oct 08 21:08:38.010214 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2011/3933] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:08:37 2022] GET /compute/v2.1/servers/ce4a2fbf-76f3-4577-a704-3b64ec30d84b => generated 1606 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:08:38.024241 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-cceda0f3-d03e-4a4e-b0a8-710e94afcec2 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:38.025334 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-cceda0f3-d03e-4a4e-b0a8-710e94afcec2 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: 4e630da9-7820-47ef-ac72-1c91af94ff64] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:38.033510 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cceda0f3-d03e-4a4e-b0a8-710e94afcec2 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:38.034573 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cceda0f3-d03e-4a4e-b0a8-710e94afcec2 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:38.035224 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cceda0f3-d03e-4a4e-b0a8-710e94afcec2 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:38.036320 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cceda0f3-d03e-4a4e-b0a8-710e94afcec2 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:38.037014 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cceda0f3-d03e-4a4e-b0a8-710e94afcec2 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:38.037693 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cceda0f3-d03e-4a4e-b0a8-710e94afcec2 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:38.081430 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-cceda0f3-d03e-4a4e-b0a8-710e94afcec2 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: 4e630da9-7820-47ef-ac72-1c91af94ff64] Going to try to terminate instance {{(pid=140492) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 21:08:38.182322 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-cceda0f3-d03e-4a4e-b0a8-710e94afcec2 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "DELETE /compute/v2.1/servers/4e630da9-7820-47ef-ac72-1c91af94ff64" status: 204 len: 0 microversion: 2.1 time: 0.169826 Oct 08 21:08:38.186098 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2012/3934] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:08:38 2022] DELETE /compute/v2.1/servers/4e630da9-7820-47ef-ac72-1c91af94ff64 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 21:08:38.194660 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-d9626d81-b761-4f46-b178-00efc2f84b46 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:38.195567 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-d9626d81-b761-4f46-b178-00efc2f84b46 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] [instance: 159e29dd-802c-4059-99f9-bb7c113d430b] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:38.203218 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d9626d81-b761-4f46-b178-00efc2f84b46 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:38.203816 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d9626d81-b761-4f46-b178-00efc2f84b46 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:38.204337 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d9626d81-b761-4f46-b178-00efc2f84b46 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:38.205548 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d9626d81-b761-4f46-b178-00efc2f84b46 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:38.206311 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d9626d81-b761-4f46-b178-00efc2f84b46 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:38.207561 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d9626d81-b761-4f46-b178-00efc2f84b46 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:38.401595 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-d9626d81-b761-4f46-b178-00efc2f84b46 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:38.413301 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-d9626d81-b761-4f46-b178-00efc2f84b46 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:38.415440 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-d9626d81-b761-4f46-b178-00efc2f84b46 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:38.417696 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-d9626d81-b761-4f46-b178-00efc2f84b46 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] 10.222.0.26 "GET /compute/v2.1/servers/159e29dd-802c-4059-99f9-bb7c113d430b" status: 200 len: 1406 microversion: 2.20 time: 0.233047 Oct 08 21:08:38.418466 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2013/3935] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:08:38 2022] GET /compute/v2.1/servers/159e29dd-802c-4059-99f9-bb7c113d430b => generated 1406 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:08:38.431960 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-598474c9-a0ce-4ff2-87da-824ab48d0a1d tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:38.433179 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-598474c9-a0ce-4ff2-87da-824ab48d0a1d tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: 4e630da9-7820-47ef-ac72-1c91af94ff64] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:38.442057 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-598474c9-a0ce-4ff2-87da-824ab48d0a1d tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:38.442689 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-598474c9-a0ce-4ff2-87da-824ab48d0a1d tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:38.443772 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-598474c9-a0ce-4ff2-87da-824ab48d0a1d tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:38.444583 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-598474c9-a0ce-4ff2-87da-824ab48d0a1d tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:38.445203 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-598474c9-a0ce-4ff2-87da-824ab48d0a1d tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:38.445819 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-598474c9-a0ce-4ff2-87da-824ab48d0a1d tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:38.602355 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-9ff32a26-87c7-44e7-95c5-4ab7fb631161 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Flavor limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 21:08:38.603602 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-9ff32a26-87c7-44e7-95c5-4ab7fb631161 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Image limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 21:08:38.606086 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-9ff32a26-87c7-44e7-95c5-4ab7fb631161 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Flavor pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 21:08:38.608485 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-9ff32a26-87c7-44e7-95c5-4ab7fb631161 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Image pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 21:08:38.609686 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-9ff32a26-87c7-44e7-95c5-4ab7fb631161 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 21:08:38.660517 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9ff32a26-87c7-44e7-95c5-4ab7fb631161 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:38.663312 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9ff32a26-87c7-44e7-95c5-4ab7fb631161 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:38.667280 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9ff32a26-87c7-44e7-95c5-4ab7fb631161 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:38.669207 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9ff32a26-87c7-44e7-95c5-4ab7fb631161 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:38.669936 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9ff32a26-87c7-44e7-95c5-4ab7fb631161 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:38.670599 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9ff32a26-87c7-44e7-95c5-4ab7fb631161 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:38.708445 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-9ff32a26-87c7-44e7-95c5-4ab7fb631161 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Getting quotas for project 765c62cac2ee4406b23a5baa85c52ff7. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:08:38.718163 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-9ff32a26-87c7-44e7-95c5-4ab7fb631161 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Getting quotas for user d78e9afd772c4de981cac8f5817ec356 and project 765c62cac2ee4406b23a5baa85c52ff7. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:08:38.739673 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-9ff32a26-87c7-44e7-95c5-4ab7fb631161 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Going to run 1 instances... {{(pid=140491) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 21:08:38.744233 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-9ff32a26-87c7-44e7-95c5-4ab7fb631161 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: 3c531611-396a-432b-b42f-dbf60a120a7a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c508bd7f-7db9-4b2c-af7c-be54a855c355',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140491) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 21:08:38.820471 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-9ff32a26-87c7-44e7-95c5-4ab7fb631161 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.520490 Oct 08 21:08:38.824321 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1923/3936] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 21:08:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 2525 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 08 21:08:38.850238 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-a25e8592-a7e4-4325-8623-b83cfc389bda tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:38.850900 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-a25e8592-a7e4-4325-8623-b83cfc389bda tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: 3c531611-396a-432b-b42f-dbf60a120a7a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:39.055922 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-a25e8592-a7e4-4325-8623-b83cfc389bda tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78e9afd772c4de981cac8f5817ec356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765c62cac2ee4406b23a5baa85c52ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:39.066860 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-a25e8592-a7e4-4325-8623-b83cfc389bda tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/3c531611-396a-432b-b42f-dbf60a120a7a" status: 200 len: 1214 microversion: 2.1 time: 0.235184 Oct 08 21:08:39.067877 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1924/3937] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:08:38 2022] GET /compute/v2.1/servers/3c531611-396a-432b-b42f-dbf60a120a7a => generated 1214 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:08:39.074268 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-1427a327-0f92-45d6-aa04-dd10d5ecbb69 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:39.075081 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-1427a327-0f92-45d6-aa04-dd10d5ecbb69 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] [instance: b9e77bd1-3ce0-4f0a-b5ac-8c0ba6caffbb] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:39.082045 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1427a327-0f92-45d6-aa04-dd10d5ecbb69 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:39.082725 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1427a327-0f92-45d6-aa04-dd10d5ecbb69 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:39.083745 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1427a327-0f92-45d6-aa04-dd10d5ecbb69 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:39.085432 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1427a327-0f92-45d6-aa04-dd10d5ecbb69 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:39.086118 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1427a327-0f92-45d6-aa04-dd10d5ecbb69 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:39.086762 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1427a327-0f92-45d6-aa04-dd10d5ecbb69 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:39.104441 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-598474c9-a0ce-4ff2-87da-824ab48d0a1d tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06443b5728fb4d1e95d6245820e786bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ded993145b4eda9d6a33b994519012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:39.113664 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-598474c9-a0ce-4ff2-87da-824ab48d0a1d tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "GET /compute/v2.1/servers/4e630da9-7820-47ef-ac72-1c91af94ff64" status: 200 len: 1518 microversion: 2.1 time: 0.687113 Oct 08 21:08:39.114440 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2014/3938] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:08:38 2022] GET /compute/v2.1/servers/4e630da9-7820-47ef-ac72-1c91af94ff64 => generated 1518 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:08:39.139000 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-85345161-497b-439e-a1f6-58e36e94dbbb req-3705617a-5b79-4606-99c7-833e57ad4006 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce4a2fbf-76f3-4577-a704-3b64ec30d84b", "name": "network-vif-unplugged", "status": "completed", "tag": "0ad7b806-8ee9-493c-a2da-3f9bc61bb980"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:08:39.149355 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-85345161-497b-439e-a1f6-58e36e94dbbb req-3705617a-5b79-4606-99c7-833e57ad4006 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:39.150301 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-85345161-497b-439e-a1f6-58e36e94dbbb req-3705617a-5b79-4606-99c7-833e57ad4006 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:39.151272 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-85345161-497b-439e-a1f6-58e36e94dbbb req-3705617a-5b79-4606-99c7-833e57ad4006 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:39.165029 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-85345161-497b-439e-a1f6-58e36e94dbbb req-3705617a-5b79-4606-99c7-833e57ad4006 service nova] Creating event network-vif-unplugged:0ad7b806-8ee9-493c-a2da-3f9bc61bb980 for instance ce4a2fbf-76f3-4577-a704-3b64ec30d84b on nch1-master-1 Oct 08 21:08:39.171372 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-85345161-497b-439e-a1f6-58e36e94dbbb req-3705617a-5b79-4606-99c7-833e57ad4006 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041330 Oct 08 21:08:39.172502 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2015/3939] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:08:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:08:39.485689 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-370623c6-873b-448a-8719-edcae596191e tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-955701168", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "networks": [{"uuid": "0af78ecb-f6e3-458a-ab57-630925a05ff0"}]}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:08:39.603257 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.network.neutron [None req-370623c6-873b-448a-8719-edcae596191e tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] validate_networks() for [('0af78ecb-f6e3-458a-ab57-630925a05ff0', None, None, None, None, None)] {{(pid=140492) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 21:08:40.055738 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-1427a327-0f92-45d6-aa04-dd10d5ecbb69 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30fe0e1ffa1040ec85d3c32d8b741c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd0e7c24154409824f96e9e99da357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:40.060613 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:08:40.065874 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-1427a327-0f92-45d6-aa04-dd10d5ecbb69 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "GET /compute/v2.1/servers/b9e77bd1-3ce0-4f0a-b5ac-8c0ba6caffbb" status: 200 len: 1487 microversion: 2.1 time: 0.996667 Oct 08 21:08:40.078026 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1925/3940] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:08:39 2022] GET /compute/v2.1/servers/b9e77bd1-3ce0-4f0a-b5ac-8c0ba6caffbb => generated 1487 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:08:40.083872 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-368540bd-1153-49ea-8044-66d1a2d753ff tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:40.086674 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-368540bd-1153-49ea-8044-66d1a2d753ff tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] [instance: ce4a2fbf-76f3-4577-a704-3b64ec30d84b] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:40.105811 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-368540bd-1153-49ea-8044-66d1a2d753ff tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:40.106613 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-368540bd-1153-49ea-8044-66d1a2d753ff tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:40.107285 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-368540bd-1153-49ea-8044-66d1a2d753ff tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:40.108787 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-368540bd-1153-49ea-8044-66d1a2d753ff tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:40.109546 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-368540bd-1153-49ea-8044-66d1a2d753ff tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:40.112125 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-368540bd-1153-49ea-8044-66d1a2d753ff tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:40.191279 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-368540bd-1153-49ea-8044-66d1a2d753ff tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:40.192242 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-368540bd-1153-49ea-8044-66d1a2d753ff tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:40.193719 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-368540bd-1153-49ea-8044-66d1a2d753ff tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:40.195383 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.objects.instance [None req-368540bd-1153-49ea-8044-66d1a2d753ff tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lazy-loading 'fault' on Instance uuid ce4a2fbf-76f3-4577-a704-3b64ec30d84b {{(pid=140491) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 21:08:40.323669 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-368540bd-1153-49ea-8044-66d1a2d753ff tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85abb492492343c58734564a2b26c8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68b14967e8249fd886f168d366f241f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:40.333749 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-368540bd-1153-49ea-8044-66d1a2d753ff tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] 10.222.0.26 "GET /compute/v2.1/servers/ce4a2fbf-76f3-4577-a704-3b64ec30d84b" status: 200 len: 1328 microversion: 2.1 time: 0.254149 Oct 08 21:08:40.343935 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1926/3941] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:08:40 2022] GET /compute/v2.1/servers/ce4a2fbf-76f3-4577-a704-3b64ec30d84b => generated 1328 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:08:40.348934 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-f4393b23-9fa1-45c8-930f-c431616bf973 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:40.349860 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-f4393b23-9fa1-45c8-930f-c431616bf973 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] [instance: 159e29dd-802c-4059-99f9-bb7c113d430b] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:40.352748 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:UPDATE=2,nova_api:SELECT=92,nova_api:INSERT=6 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:08:40.365316 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f4393b23-9fa1-45c8-930f-c431616bf973 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:40.366972 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f4393b23-9fa1-45c8-930f-c431616bf973 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:40.370138 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f4393b23-9fa1-45c8-930f-c431616bf973 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:40.371025 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f4393b23-9fa1-45c8-930f-c431616bf973 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:40.371550 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f4393b23-9fa1-45c8-930f-c431616bf973 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:40.371996 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f4393b23-9fa1-45c8-930f-c431616bf973 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:40.744404 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-370623c6-873b-448a-8719-edcae596191e tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Flavor limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 21:08:40.746112 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-370623c6-873b-448a-8719-edcae596191e tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Image limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 21:08:40.746800 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-370623c6-873b-448a-8719-edcae596191e tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Flavor pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 21:08:40.747424 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-370623c6-873b-448a-8719-edcae596191e tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Image pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 21:08:40.748078 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-370623c6-873b-448a-8719-edcae596191e tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 21:08:40.763466 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=23 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:08:40.769106 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-370623c6-873b-448a-8719-edcae596191e tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:40.769725 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-370623c6-873b-448a-8719-edcae596191e tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:40.770297 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-370623c6-873b-448a-8719-edcae596191e tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:40.771263 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-370623c6-873b-448a-8719-edcae596191e tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:40.772944 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-370623c6-873b-448a-8719-edcae596191e tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:40.777042 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-370623c6-873b-448a-8719-edcae596191e tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:40.805305 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-370623c6-873b-448a-8719-edcae596191e tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Getting quotas for project 0ae02675057e4f27bc1980348afc8ca1. Resources: {'cores', 'instances', 'ram'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:08:40.811685 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-370623c6-873b-448a-8719-edcae596191e tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Getting quotas for user 6a78d352c143483c8e4702d789d4c516 and project 0ae02675057e4f27bc1980348afc8ca1. Resources: {'cores', 'instances', 'ram'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:08:40.854172 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-370623c6-873b-448a-8719-edcae596191e tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Going to run 1 instances... {{(pid=140492) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 21:08:40.857072 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-370623c6-873b-448a-8719-edcae596191e tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c508bd7f-7db9-4b2c-af7c-be54a855c355',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140492) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 21:08:40.935244 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-370623c6-873b-448a-8719-edcae596191e tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.760943 Oct 08 21:08:40.942685 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2016/3942] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 21:08:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 1769 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 08 21:08:40.943900 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-f4393b23-9fa1-45c8-930f-c431616bf973 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:40.949462 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-22d9434d-8265-486a-9b06-10fedcb837ab req-880cae02-f672-49e9-b38d-4510dfcf0ba4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce4a2fbf-76f3-4577-a704-3b64ec30d84b", "name": "network-vif-deleted", "tag": "0ad7b806-8ee9-493c-a2da-3f9bc61bb980"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:08:40.961775 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-22d9434d-8265-486a-9b06-10fedcb837ab req-880cae02-f672-49e9-b38d-4510dfcf0ba4 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:40.962453 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-22d9434d-8265-486a-9b06-10fedcb837ab req-880cae02-f672-49e9-b38d-4510dfcf0ba4 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:40.963771 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-22d9434d-8265-486a-9b06-10fedcb837ab req-880cae02-f672-49e9-b38d-4510dfcf0ba4 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:40.965161 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-f4393b23-9fa1-45c8-930f-c431616bf973 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:40.967153 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-f4393b23-9fa1-45c8-930f-c431616bf973 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:40.972594 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-f4393b23-9fa1-45c8-930f-c431616bf973 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] 10.222.0.26 "GET /compute/v2.1/servers/159e29dd-802c-4059-99f9-bb7c113d430b" status: 200 len: 1406 microversion: 2.20 time: 0.627499 Oct 08 21:08:40.978604 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1927/3943] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:08:40 2022] GET /compute/v2.1/servers/159e29dd-802c-4059-99f9-bb7c113d430b => generated 1406 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:08:40.979279 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-22d9434d-8265-486a-9b06-10fedcb837ab req-880cae02-f672-49e9-b38d-4510dfcf0ba4 service nova] Creating event network-vif-deleted:0ad7b806-8ee9-493c-a2da-3f9bc61bb980 for instance ce4a2fbf-76f3-4577-a704-3b64ec30d84b on nch1-master-1 Oct 08 21:08:40.999033 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-22d9434d-8265-486a-9b06-10fedcb837ab req-880cae02-f672-49e9-b38d-4510dfcf0ba4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054926 Oct 08 21:08:41.001691 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-b67f7633-1fcf-4f54-b3cc-5c7253e31a7c tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:41.004085 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2017/3944] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:08:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:08:41.005343 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-b67f7633-1fcf-4f54-b3cc-5c7253e31a7c tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: 3c531611-396a-432b-b42f-dbf60a120a7a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:41.024406 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-f38df244-8ce8-4aaa-a477-5252ac5777a0 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:08:41.038946 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b67f7633-1fcf-4f54-b3cc-5c7253e31a7c tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:41.039462 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b67f7633-1fcf-4f54-b3cc-5c7253e31a7c tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:41.039904 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b67f7633-1fcf-4f54-b3cc-5c7253e31a7c tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:41.040625 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b67f7633-1fcf-4f54-b3cc-5c7253e31a7c tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:41.041091 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b67f7633-1fcf-4f54-b3cc-5c7253e31a7c tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:41.053841 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b67f7633-1fcf-4f54-b3cc-5c7253e31a7c tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:41.054905 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f38df244-8ce8-4aaa-a477-5252ac5777a0 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:41.055589 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f38df244-8ce8-4aaa-a477-5252ac5777a0 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:41.056266 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f38df244-8ce8-4aaa-a477-5252ac5777a0 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:41.144135 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-f38df244-8ce8-4aaa-a477-5252ac5777a0 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] [instance: b9e77bd1-3ce0-4f0a-b5ac-8c0ba6caffbb] Going to try to stop instance {{(pid=140492) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 08 21:08:41.237898 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-b67f7633-1fcf-4f54-b3cc-5c7253e31a7c tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78e9afd772c4de981cac8f5817ec356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765c62cac2ee4406b23a5baa85c52ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:41.247225 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-b67f7633-1fcf-4f54-b3cc-5c7253e31a7c tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/3c531611-396a-432b-b42f-dbf60a120a7a" status: 200 len: 1274 microversion: 2.1 time: 0.251738 Oct 08 21:08:41.269631 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1928/3945] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:08:40 2022] GET /compute/v2.1/servers/3c531611-396a-432b-b42f-dbf60a120a7a => generated 1274 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:08:41.277889 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-7c292c64-feb3-494c-9470-96c6333625ec tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:41.278977 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-7c292c64-feb3-494c-9470-96c6333625ec tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: 4e630da9-7820-47ef-ac72-1c91af94ff64] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:41.279254 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-f38df244-8ce8-4aaa-a477-5252ac5777a0 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "POST /compute/v2.1/servers/b9e77bd1-3ce0-4f0a-b5ac-8c0ba6caffbb/action" status: 202 len: 0 microversion: 2.1 time: 0.270430 Oct 08 21:08:41.280987 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2018/3946] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:08:41 2022] POST /compute/v2.1/servers/b9e77bd1-3ce0-4f0a-b5ac-8c0ba6caffbb/action => generated 0 bytes in 276 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 21:08:41.287759 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-24de93fe-f090-4b6e-958a-eb98d4c3a18d req-16af88da-b00a-4b37-8c31-a1d84154714d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e630da9-7820-47ef-ac72-1c91af94ff64", "name": "network-vif-deleted", "tag": "226a8b36-ead5-4696-86c9-94037a55f634"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:08:41.299200 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7c292c64-feb3-494c-9470-96c6333625ec tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:41.299704 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7c292c64-feb3-494c-9470-96c6333625ec tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:41.300154 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7c292c64-feb3-494c-9470-96c6333625ec tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:41.300871 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7c292c64-feb3-494c-9470-96c6333625ec tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:41.301365 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7c292c64-feb3-494c-9470-96c6333625ec tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:41.301958 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7c292c64-feb3-494c-9470-96c6333625ec tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:41.304365 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-24de93fe-f090-4b6e-958a-eb98d4c3a18d req-16af88da-b00a-4b37-8c31-a1d84154714d service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:41.305047 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-24de93fe-f090-4b6e-958a-eb98d4c3a18d req-16af88da-b00a-4b37-8c31-a1d84154714d service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:41.305541 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-24de93fe-f090-4b6e-958a-eb98d4c3a18d req-16af88da-b00a-4b37-8c31-a1d84154714d service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:41.321057 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-24de93fe-f090-4b6e-958a-eb98d4c3a18d req-16af88da-b00a-4b37-8c31-a1d84154714d service nova] Creating event network-vif-deleted:226a8b36-ead5-4696-86c9-94037a55f634 for instance 4e630da9-7820-47ef-ac72-1c91af94ff64 on nch2-master-1 Oct 08 21:08:41.327300 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-24de93fe-f090-4b6e-958a-eb98d4c3a18d req-16af88da-b00a-4b37-8c31-a1d84154714d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044304 Oct 08 21:08:41.328462 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2019/3947] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:08:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:08:41.334861 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-f3bf9de7-1c47-43a7-be2c-093afb7a2490 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:41.335625 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-f3bf9de7-1c47-43a7-be2c-093afb7a2490 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:41.391936 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7c292c64-feb3-494c-9470-96c6333625ec tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:41.394419 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7c292c64-feb3-494c-9470-96c6333625ec tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:41.402290 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7c292c64-feb3-494c-9470-96c6333625ec tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:41.402796 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.objects.instance [None req-7c292c64-feb3-494c-9470-96c6333625ec tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lazy-loading 'fault' on Instance uuid 4e630da9-7820-47ef-ac72-1c91af94ff64 {{(pid=140491) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 21:08:41.449077 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-f3bf9de7-1c47-43a7-be2c-093afb7a2490 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:41.456441 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-f3bf9de7-1c47-43a7-be2c-093afb7a2490 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 200 len: 1216 microversion: 2.1 time: 0.126431 Oct 08 21:08:41.457534 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2020/3948] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:08:41 2022] GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 1216 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:08:41.478264 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-9f5ddde2-c623-4ef7-822e-b2937027dfc2 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:41.479450 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-9f5ddde2-c623-4ef7-822e-b2937027dfc2 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] [instance: b9e77bd1-3ce0-4f0a-b5ac-8c0ba6caffbb] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:41.497088 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9f5ddde2-c623-4ef7-822e-b2937027dfc2 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:41.499113 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9f5ddde2-c623-4ef7-822e-b2937027dfc2 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:41.499575 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9f5ddde2-c623-4ef7-822e-b2937027dfc2 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:41.502134 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9f5ddde2-c623-4ef7-822e-b2937027dfc2 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:41.508316 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-7c292c64-feb3-494c-9470-96c6333625ec tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06443b5728fb4d1e95d6245820e786bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ded993145b4eda9d6a33b994519012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:41.511685 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9f5ddde2-c623-4ef7-822e-b2937027dfc2 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:41.512725 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9f5ddde2-c623-4ef7-822e-b2937027dfc2 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:41.518272 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-7c292c64-feb3-494c-9470-96c6333625ec tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "GET /compute/v2.1/servers/4e630da9-7820-47ef-ac72-1c91af94ff64" status: 200 len: 1320 microversion: 2.1 time: 0.247272 Oct 08 21:08:41.523392 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1929/3949] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:08:41 2022] GET /compute/v2.1/servers/4e630da9-7820-47ef-ac72-1c91af94ff64 => generated 1320 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:08:41.528491 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-e65d9b4f-d193-49e0-9009-e9e6abcc8a92 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:41.531223 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-e65d9b4f-d193-49e0-9009-e9e6abcc8a92 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] [instance: ce4a2fbf-76f3-4577-a704-3b64ec30d84b] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:41.553585 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e65d9b4f-d193-49e0-9009-e9e6abcc8a92 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:41.554097 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e65d9b4f-d193-49e0-9009-e9e6abcc8a92 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:41.554545 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e65d9b4f-d193-49e0-9009-e9e6abcc8a92 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:41.555285 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e65d9b4f-d193-49e0-9009-e9e6abcc8a92 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:41.555755 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e65d9b4f-d193-49e0-9009-e9e6abcc8a92 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:41.556219 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e65d9b4f-d193-49e0-9009-e9e6abcc8a92 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:41.627581 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e65d9b4f-d193-49e0-9009-e9e6abcc8a92 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:41.628078 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e65d9b4f-d193-49e0-9009-e9e6abcc8a92 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:41.628575 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e65d9b4f-d193-49e0-9009-e9e6abcc8a92 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:41.628982 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.objects.instance [None req-e65d9b4f-d193-49e0-9009-e9e6abcc8a92 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lazy-loading 'fault' on Instance uuid ce4a2fbf-76f3-4577-a704-3b64ec30d84b {{(pid=140491) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 21:08:41.843138 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-e65d9b4f-d193-49e0-9009-e9e6abcc8a92 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85abb492492343c58734564a2b26c8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68b14967e8249fd886f168d366f241f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:41.859791 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-e65d9b4f-d193-49e0-9009-e9e6abcc8a92 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] 10.222.0.26 "GET /compute/v2.1/servers/ce4a2fbf-76f3-4577-a704-3b64ec30d84b" status: 200 len: 1328 microversion: 2.1 time: 0.334327 Oct 08 21:08:41.862685 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1930/3950] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:08:41 2022] GET /compute/v2.1/servers/ce4a2fbf-76f3-4577-a704-3b64ec30d84b => generated 1328 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:08:41.882648 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-9f5ddde2-c623-4ef7-822e-b2937027dfc2 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30fe0e1ffa1040ec85d3c32d8b741c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd0e7c24154409824f96e9e99da357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:41.893580 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-9f5ddde2-c623-4ef7-822e-b2937027dfc2 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "GET /compute/v2.1/servers/b9e77bd1-3ce0-4f0a-b5ac-8c0ba6caffbb" status: 200 len: 1497 microversion: 2.1 time: 0.422012 Oct 08 21:08:41.894189 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2021/3951] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:08:41 2022] GET /compute/v2.1/servers/b9e77bd1-3ce0-4f0a-b5ac-8c0ba6caffbb => generated 1497 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:08:42.005073 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-5838c08b-2116-4935-b339-915bbfca4b57 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:42.006247 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-5838c08b-2116-4935-b339-915bbfca4b57 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] [instance: 159e29dd-802c-4059-99f9-bb7c113d430b] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:42.021306 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5838c08b-2116-4935-b339-915bbfca4b57 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:42.024121 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5838c08b-2116-4935-b339-915bbfca4b57 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:42.024887 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5838c08b-2116-4935-b339-915bbfca4b57 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:42.027572 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5838c08b-2116-4935-b339-915bbfca4b57 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:42.028107 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5838c08b-2116-4935-b339-915bbfca4b57 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:42.029089 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5838c08b-2116-4935-b339-915bbfca4b57 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:42.277861 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-b41acf7e-cc49-4766-abea-8127a68209a8 req-92693088-e370-4f2d-b0de-91f774662e81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "159e29dd-802c-4059-99f9-bb7c113d430b", "name": "network-vif-plugged", "status": "completed", "tag": "59479dc9-06cf-4a86-bedc-3998868989c8"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:08:42.288759 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-b41acf7e-cc49-4766-abea-8127a68209a8 req-92693088-e370-4f2d-b0de-91f774662e81 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:42.289597 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-b41acf7e-cc49-4766-abea-8127a68209a8 req-92693088-e370-4f2d-b0de-91f774662e81 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:42.290241 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-b41acf7e-cc49-4766-abea-8127a68209a8 req-92693088-e370-4f2d-b0de-91f774662e81 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:42.302980 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-b41acf7e-cc49-4766-abea-8127a68209a8 req-92693088-e370-4f2d-b0de-91f774662e81 service nova] Creating event network-vif-plugged:59479dc9-06cf-4a86-bedc-3998868989c8 for instance 159e29dd-802c-4059-99f9-bb7c113d430b on nch2-master-1 Oct 08 21:08:42.308752 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-b41acf7e-cc49-4766-abea-8127a68209a8 req-92693088-e370-4f2d-b0de-91f774662e81 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034555 Oct 08 21:08:42.309991 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2022/3952] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:08:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 08 21:08:42.315494 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-59c75ec6-1554-41d0-8973-edb716414f80 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:42.316520 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-59c75ec6-1554-41d0-8973-edb716414f80 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: 3c531611-396a-432b-b42f-dbf60a120a7a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:42.323805 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-59c75ec6-1554-41d0-8973-edb716414f80 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:42.324793 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-59c75ec6-1554-41d0-8973-edb716414f80 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:42.325479 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-59c75ec6-1554-41d0-8973-edb716414f80 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:42.326413 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-59c75ec6-1554-41d0-8973-edb716414f80 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:42.327147 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-59c75ec6-1554-41d0-8973-edb716414f80 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:42.327805 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-59c75ec6-1554-41d0-8973-edb716414f80 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:42.443473 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-59c75ec6-1554-41d0-8973-edb716414f80 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78e9afd772c4de981cac8f5817ec356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765c62cac2ee4406b23a5baa85c52ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:42.451843 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-59c75ec6-1554-41d0-8973-edb716414f80 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/3c531611-396a-432b-b42f-dbf60a120a7a" status: 200 len: 1272 microversion: 2.1 time: 0.140271 Oct 08 21:08:42.452446 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2023/3953] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:08:42 2022] GET /compute/v2.1/servers/3c531611-396a-432b-b42f-dbf60a120a7a => generated 1272 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:08:42.484123 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-1f533df3-65a9-4fa7-9f03-655cd997858b tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:42.484748 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-1f533df3-65a9-4fa7-9f03-655cd997858b tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:42.495519 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1f533df3-65a9-4fa7-9f03-655cd997858b tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:42.496022 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1f533df3-65a9-4fa7-9f03-655cd997858b tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:42.496462 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1f533df3-65a9-4fa7-9f03-655cd997858b tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:42.499152 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1f533df3-65a9-4fa7-9f03-655cd997858b tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:42.500622 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1f533df3-65a9-4fa7-9f03-655cd997858b tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:42.501688 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1f533df3-65a9-4fa7-9f03-655cd997858b tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:42.510582 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-5838c08b-2116-4935-b339-915bbfca4b57 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:42.521127 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-5838c08b-2116-4935-b339-915bbfca4b57 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:42.524274 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-5838c08b-2116-4935-b339-915bbfca4b57 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:42.532506 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-5838c08b-2116-4935-b339-915bbfca4b57 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] 10.222.0.26 "GET /compute/v2.1/servers/159e29dd-802c-4059-99f9-bb7c113d430b" status: 200 len: 1406 microversion: 2.20 time: 0.531924 Oct 08 21:08:42.549219 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1931/3954] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:08:41 2022] GET /compute/v2.1/servers/159e29dd-802c-4059-99f9-bb7c113d430b => generated 1406 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:08:42.551144 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:08:42.562388 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-ad2d51a3-b7e8-47ab-9998-9ff58d5f420b tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:42.564419 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-ad2d51a3-b7e8-47ab-9998-9ff58d5f420b tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: 4e630da9-7820-47ef-ac72-1c91af94ff64] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:42.579055 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ad2d51a3-b7e8-47ab-9998-9ff58d5f420b tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:42.581853 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ad2d51a3-b7e8-47ab-9998-9ff58d5f420b tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:42.582683 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ad2d51a3-b7e8-47ab-9998-9ff58d5f420b tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:42.583611 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ad2d51a3-b7e8-47ab-9998-9ff58d5f420b tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:42.584362 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ad2d51a3-b7e8-47ab-9998-9ff58d5f420b tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:42.584896 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ad2d51a3-b7e8-47ab-9998-9ff58d5f420b tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:42.610068 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-ad2d51a3-b7e8-47ab-9998-9ff58d5f420b tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] HTTP exception thrown: Instance 4e630da9-7820-47ef-ac72-1c91af94ff64 could not be found. Oct 08 21:08:42.611858 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-ad2d51a3-b7e8-47ab-9998-9ff58d5f420b tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Request method failure captured: Oct 08 21:08:42.611858 ncdv-master-1 devstack@n-api.service[140491]: request: GET /compute/v2.1/servers/4e630da9-7820-47ef-ac72-1c91af94ff64 HTTP/1.1 Oct 08 21:08:42.611858 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:08:42.611858 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:08:42.611858 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:08:42.611858 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 21:08:42.611858 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:08:42.611858 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:08:42.611858 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:08:42.611858 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:08:42.611858 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeYsdf-NgsPUaUb78CUpk0vq18mlUqdb1er-CKgSGnwcxKYVDw5Br5ObGheB0PHKIrwGHgJ4op59IUcxCd3ChQqclxeYxKhK3ZwkXmw1AwIGXWjgktrsk6DH6ba1NMLmZ1pzBqcyvzB3CMIuC4HBXIHDILjU44EobGpdQQ8lNmKdDFM Oct 08 21:08:42.611858 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:08:42.611858 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:08:42.611858 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:08:42.611858 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:08:42.611858 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:08:42.611858 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:08:42.611858 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: e7ded993145b4eda9d6a33b994519012 Oct 08 21:08:42.611858 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-ServersTestJSON-68907085 Oct 08 21:08:42.611858 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:08:42.611858 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:08:42.611858 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/e7ded993145b4eda9d6a33b994519012"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e7ded993145b4eda9d6a33b994519012"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_e7ded993145b4eda9d6a33b994519012"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e7ded993145b4eda9d6a33b994519012"}]}] Oct 08 21:08:42.611858 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-ServersTestJSON-68907085 Oct 08 21:08:42.611858 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: e7ded993145b4eda9d6a33b994519012 Oct 08 21:08:42.611858 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-ServersTestJSON-68907085 Oct 08 21:08:42.611858 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-ServersTestJSON-68907085-project Oct 08 21:08:42.611858 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:08:42.611858 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:08:42.611858 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 06443b5728fb4d1e95d6245820e786bf Oct 08 21:08:42.611858 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-ServersTestJSON-68907085-project Oct 08 21:08:42.611858 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:08:42.611858 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance 4e630da9-7820-47ef-ac72-1c91af94ff64 could not be found. Oct 08 21:08:42.611858 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': '4e630da9-7820-47ef-ac72-1c91af94ff64'} Oct 08 21:08:42.611858 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:08:42.611858 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:08:42.611858 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:08:42.611858 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:08:42.611858 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:08:42.611858 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:08:42.611858 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:08:42.611858 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:08:42.611858 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:08:42.611858 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:08:42.611858 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e630da9-7820-47ef-ac72-1c91af94ff64 could not be found. Oct 08 21:08:42.611858 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:08:42.611858 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:08:42.611858 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:08:42.611858 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:08:42.611858 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:08:42.611858 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:08:42.611858 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:08:42.611858 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:08:42.611858 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:08:42.611858 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:08:42.611858 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:08:42.611858 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:08:42.611858 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:08:42.611858 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:08:42.611858 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:08:42.611858 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:08:42.611858 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e630da9-7820-47ef-ac72-1c91af94ff64 could not be found. Oct 08 21:08:42.611858 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:08:42.611858 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:08:42.611858 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:08:42.611858 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:08:42.615104 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:08:42.615104 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:08:42.615104 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:08:42.615104 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:08:42.615104 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e630da9-7820-47ef-ac72-1c91af94ff64 could not be found. Oct 08 21:08:42.615104 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:08:42.615104 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-ad2d51a3-b7e8-47ab-9998-9ff58d5f420b tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Returning 404 to user: Instance 4e630da9-7820-47ef-ac72-1c91af94ff64 could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:08:42.615104 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-ad2d51a3-b7e8-47ab-9998-9ff58d5f420b tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "GET /compute/v2.1/servers/4e630da9-7820-47ef-ac72-1c91af94ff64" status: 404 len: 111 microversion: 2.1 time: 0.062987 Oct 08 21:08:42.617602 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-1f533df3-65a9-4fa7-9f03-655cd997858b tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:42.626381 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1932/3955] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:08:42 2022] GET /compute/v2.1/servers/4e630da9-7820-47ef-ac72-1c91af94ff64 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:08:42.637300 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-1f533df3-65a9-4fa7-9f03-655cd997858b tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 200 len: 1268 microversion: 2.1 time: 0.156481 Oct 08 21:08:42.638300 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2024/3956] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:08:42 2022] GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 1268 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:08:42.749277 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-faccf7ce-3c4e-411f-8f92-b0df8e41f856 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-29326653", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "networks": [{"uuid": "983c5654-1828-48da-a871-2028e691f4b0"}]}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:08:42.810336 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.network.neutron [None req-faccf7ce-3c4e-411f-8f92-b0df8e41f856 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] validate_networks() for [('983c5654-1828-48da-a871-2028e691f4b0', None, None, None, None, None)] {{(pid=140491) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 21:08:42.892687 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-3df07656-95d2-49ef-9e4c-474997c280b1 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:42.893350 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-3df07656-95d2-49ef-9e4c-474997c280b1 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] [instance: ce4a2fbf-76f3-4577-a704-3b64ec30d84b] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:42.906923 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3df07656-95d2-49ef-9e4c-474997c280b1 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:42.908835 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3df07656-95d2-49ef-9e4c-474997c280b1 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:42.910776 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3df07656-95d2-49ef-9e4c-474997c280b1 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:42.910776 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3df07656-95d2-49ef-9e4c-474997c280b1 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:42.910776 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3df07656-95d2-49ef-9e4c-474997c280b1 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:42.911117 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3df07656-95d2-49ef-9e4c-474997c280b1 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:42.954031 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-3df07656-95d2-49ef-9e4c-474997c280b1 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] HTTP exception thrown: Instance ce4a2fbf-76f3-4577-a704-3b64ec30d84b could not be found. Oct 08 21:08:42.957975 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-3df07656-95d2-49ef-9e4c-474997c280b1 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Request method failure captured: Oct 08 21:08:42.957975 ncdv-master-1 devstack@n-api.service[140492]: request: GET /compute/v2.1/servers/ce4a2fbf-76f3-4577-a704-3b64ec30d84b HTTP/1.1 Oct 08 21:08:42.957975 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:08:42.957975 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:08:42.957975 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:08:42.957975 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 21:08:42.957975 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:08:42.957975 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:08:42.957975 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:08:42.957975 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:08:42.957975 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeYKg_fOvGoQQXA8z7gm2w4cyuJ0uMIK2G7N_9Q-47BWuaRUxiqsYvHjRUWZzQ4elsXIfCQhXDpTqmCNSEHvpVVYOCENb-BczX2vL5u--FCy853fHyDsOQRHRhN4DudwmKHCBHo34cSeZY2dF-KcA3mSu3_PCb2iL8kKxjyVjDebpNQ Oct 08 21:08:42.957975 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:08:42.957975 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:08:42.957975 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:08:42.957975 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:08:42.957975 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:08:42.957975 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:08:42.957975 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: c68b14967e8249fd886f168d366f241f Oct 08 21:08:42.957975 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-AttachVolumeTestJSON-2043566449 Oct 08 21:08:42.957975 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:08:42.957975 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:08:42.957975 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/c68b14967e8249fd886f168d366f241f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c68b14967e8249fd886f168d366f241f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_c68b14967e8249fd886f168d366f241f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c68b14967e8249fd886f168d366f241f"}]}] Oct 08 21:08:42.957975 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-AttachVolumeTestJSON-2043566449 Oct 08 21:08:42.957975 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: c68b14967e8249fd886f168d366f241f Oct 08 21:08:42.957975 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2043566449 Oct 08 21:08:42.957975 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-AttachVolumeTestJSON-2043566449-project Oct 08 21:08:42.957975 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:08:42.957975 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:08:42.957975 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 85abb492492343c58734564a2b26c8f6 Oct 08 21:08:42.957975 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-AttachVolumeTestJSON-2043566449-project Oct 08 21:08:42.957975 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 21:08:42.957975 ncdv-master-1 devstack@n-api.service[140492]: exception: Instance ce4a2fbf-76f3-4577-a704-3b64ec30d84b could not be found. Oct 08 21:08:42.957975 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': 'ce4a2fbf-76f3-4577-a704-3b64ec30d84b'} Oct 08 21:08:42.957975 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:08:42.957975 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:08:42.957975 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:08:42.957975 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:08:42.957975 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:08:42.957975 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:08:42.957975 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:08:42.957975 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:08:42.957975 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:08:42.957975 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:08:42.957975 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce4a2fbf-76f3-4577-a704-3b64ec30d84b could not be found. Oct 08 21:08:42.957975 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:08:42.957975 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:08:42.957975 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:08:42.957975 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:08:42.957975 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:08:42.957975 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:08:42.957975 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:08:42.957975 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:08:42.957975 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:08:42.957975 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:08:42.957975 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:08:42.957975 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:08:42.957975 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:08:42.957975 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:08:42.957975 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:08:42.957975 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:08:42.957975 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce4a2fbf-76f3-4577-a704-3b64ec30d84b could not be found. Oct 08 21:08:42.957975 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:08:42.957975 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:08:42.957975 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:08:42.961438 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:08:42.961438 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:08:42.961438 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:08:42.961438 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:08:42.961438 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:08:42.961438 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce4a2fbf-76f3-4577-a704-3b64ec30d84b could not be found. Oct 08 21:08:42.961438 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:08:42.961438 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-3df07656-95d2-49ef-9e4c-474997c280b1 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Returning 404 to user: Instance ce4a2fbf-76f3-4577-a704-3b64ec30d84b could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:08:42.962002 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-3df07656-95d2-49ef-9e4c-474997c280b1 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] 10.222.0.26 "GET /compute/v2.1/servers/ce4a2fbf-76f3-4577-a704-3b64ec30d84b" status: 404 len: 111 microversion: 2.1 time: 0.074234 Oct 08 21:08:42.968783 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2025/3957] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:08:42 2022] GET /compute/v2.1/servers/ce4a2fbf-76f3-4577-a704-3b64ec30d84b => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:08:42.981048 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-1094a0c8-2920-482b-a9d2-873c200b4679 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:42.986791 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-1094a0c8-2920-482b-a9d2-873c200b4679 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] [instance: b9e77bd1-3ce0-4f0a-b5ac-8c0ba6caffbb] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:43.001622 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1094a0c8-2920-482b-a9d2-873c200b4679 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:43.002519 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1094a0c8-2920-482b-a9d2-873c200b4679 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:43.003057 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1094a0c8-2920-482b-a9d2-873c200b4679 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:43.003748 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1094a0c8-2920-482b-a9d2-873c200b4679 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:43.004214 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1094a0c8-2920-482b-a9d2-873c200b4679 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:43.004658 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1094a0c8-2920-482b-a9d2-873c200b4679 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:43.647954 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-1094a0c8-2920-482b-a9d2-873c200b4679 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30fe0e1ffa1040ec85d3c32d8b741c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd0e7c24154409824f96e9e99da357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:43.664202 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-1094a0c8-2920-482b-a9d2-873c200b4679 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "GET /compute/v2.1/servers/b9e77bd1-3ce0-4f0a-b5ac-8c0ba6caffbb" status: 200 len: 1497 microversion: 2.1 time: 0.693307 Oct 08 21:08:43.664959 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2026/3958] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:08:42 2022] GET /compute/v2.1/servers/b9e77bd1-3ce0-4f0a-b5ac-8c0ba6caffbb => generated 1497 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:08:43.686505 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-c1377679-6ff0-4061-a5f0-601689c928de tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Calling method '.version_select at 0x7f1a8773db80>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:43.703417 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:08:43.733649 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-c1377679-6ff0-4061-a5f0-601689c928de tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1643426037" status: 202 len: 0 microversion: 2.1 time: 0.051514 Oct 08 21:08:43.735911 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2027/3959] 10.222.0.26 () {58 vars in 1221 bytes} [Sat Oct 8 21:08:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1643426037 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 21:08:43.743953 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-7b4016d1-41c0-412b-b70c-4761cf9ba556 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:43.745650 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-7b4016d1-41c0-412b-b70c-4761cf9ba556 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: 3c531611-396a-432b-b42f-dbf60a120a7a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:43.754094 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7b4016d1-41c0-412b-b70c-4761cf9ba556 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:43.755098 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7b4016d1-41c0-412b-b70c-4761cf9ba556 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:43.755760 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7b4016d1-41c0-412b-b70c-4761cf9ba556 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:43.756880 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7b4016d1-41c0-412b-b70c-4761cf9ba556 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:43.757664 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7b4016d1-41c0-412b-b70c-4761cf9ba556 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:43.758464 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7b4016d1-41c0-412b-b70c-4761cf9ba556 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:43.971270 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-7b4016d1-41c0-412b-b70c-4761cf9ba556 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78e9afd772c4de981cac8f5817ec356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765c62cac2ee4406b23a5baa85c52ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:43.985622 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-7b4016d1-41c0-412b-b70c-4761cf9ba556 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/3c531611-396a-432b-b42f-dbf60a120a7a" status: 200 len: 1272 microversion: 2.1 time: 0.248070 Oct 08 21:08:43.986674 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2028/3960] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:08:43 2022] GET /compute/v2.1/servers/3c531611-396a-432b-b42f-dbf60a120a7a => generated 1272 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:08:44.006356 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-f6c65e63-ce8d-4523-8871-921e3baf4555 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:44.007774 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-f6c65e63-ce8d-4523-8871-921e3baf4555 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] [instance: 159e29dd-802c-4059-99f9-bb7c113d430b] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:44.016992 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f6c65e63-ce8d-4523-8871-921e3baf4555 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:44.017922 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f6c65e63-ce8d-4523-8871-921e3baf4555 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:44.018585 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f6c65e63-ce8d-4523-8871-921e3baf4555 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:44.019838 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f6c65e63-ce8d-4523-8871-921e3baf4555 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:44.020542 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f6c65e63-ce8d-4523-8871-921e3baf4555 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:44.021606 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f6c65e63-ce8d-4523-8871-921e3baf4555 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:44.542329 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-faccf7ce-3c4e-411f-8f92-b0df8e41f856 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Flavor limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 21:08:44.544394 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-faccf7ce-3c4e-411f-8f92-b0df8e41f856 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Image limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 21:08:44.547820 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-faccf7ce-3c4e-411f-8f92-b0df8e41f856 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Flavor pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 21:08:44.549623 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-faccf7ce-3c4e-411f-8f92-b0df8e41f856 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Image pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 21:08:44.553621 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-faccf7ce-3c4e-411f-8f92-b0df8e41f856 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 21:08:44.564388 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-f6c65e63-ce8d-4523-8871-921e3baf4555 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:44.586134 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-f6c65e63-ce8d-4523-8871-921e3baf4555 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:44.591915 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-f6c65e63-ce8d-4523-8871-921e3baf4555 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:44.595128 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-f6c65e63-ce8d-4523-8871-921e3baf4555 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] 10.222.0.26 "GET /compute/v2.1/servers/159e29dd-802c-4059-99f9-bb7c113d430b" status: 200 len: 1598 microversion: 2.20 time: 0.606323 Oct 08 21:08:44.596535 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2029/3961] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:08:43 2022] GET /compute/v2.1/servers/159e29dd-802c-4059-99f9-bb7c113d430b => generated 1598 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:08:44.643919 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-faccf7ce-3c4e-411f-8f92-b0df8e41f856 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:44.653852 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-0c1d51b4-9876-498f-9900-5fd57a296fa0 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:44.655575 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-0c1d51b4-9876-498f-9900-5fd57a296fa0 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:44.657386 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-faccf7ce-3c4e-411f-8f92-b0df8e41f856 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:44.657976 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-faccf7ce-3c4e-411f-8f92-b0df8e41f856 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:44.659495 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-faccf7ce-3c4e-411f-8f92-b0df8e41f856 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:44.660265 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-faccf7ce-3c4e-411f-8f92-b0df8e41f856 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:44.662047 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-faccf7ce-3c4e-411f-8f92-b0df8e41f856 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:44.679960 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0c1d51b4-9876-498f-9900-5fd57a296fa0 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:44.684566 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0c1d51b4-9876-498f-9900-5fd57a296fa0 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:44.690602 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0c1d51b4-9876-498f-9900-5fd57a296fa0 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:44.700381 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0c1d51b4-9876-498f-9900-5fd57a296fa0 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:44.730462 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0c1d51b4-9876-498f-9900-5fd57a296fa0 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:44.733122 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0c1d51b4-9876-498f-9900-5fd57a296fa0 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.032s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:44.749445 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-faccf7ce-3c4e-411f-8f92-b0df8e41f856 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Getting quotas for project e7ded993145b4eda9d6a33b994519012. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:08:44.781076 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-faccf7ce-3c4e-411f-8f92-b0df8e41f856 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Getting quotas for user 06443b5728fb4d1e95d6245820e786bf and project e7ded993145b4eda9d6a33b994519012. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:08:44.864697 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-faccf7ce-3c4e-411f-8f92-b0df8e41f856 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Going to run 1 instances... {{(pid=140491) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 21:08:44.880099 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-faccf7ce-3c4e-411f-8f92-b0df8e41f856 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: 99510c36-821a-41dd-9ffe-8955dda22dcf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c508bd7f-7db9-4b2c-af7c-be54a855c355',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140491) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 21:08:45.104131 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-0c1d51b4-9876-498f-9900-5fd57a296fa0 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:45.106889 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-faccf7ce-3c4e-411f-8f92-b0df8e41f856 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.362175 Oct 08 21:08:45.108419 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1933/3962] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 21:08:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 2368 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 08 21:08:45.138460 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-a684beb5-29c7-4658-a852-ae704b6260fb tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:45.142201 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-a684beb5-29c7-4658-a852-ae704b6260fb tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] [instance: 159e29dd-802c-4059-99f9-bb7c113d430b] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:45.162526 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a684beb5-29c7-4658-a852-ae704b6260fb tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:45.163848 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a684beb5-29c7-4658-a852-ae704b6260fb tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:45.164665 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a684beb5-29c7-4658-a852-ae704b6260fb tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:45.165913 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a684beb5-29c7-4658-a852-ae704b6260fb tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:45.167960 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a684beb5-29c7-4658-a852-ae704b6260fb tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:45.169633 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a684beb5-29c7-4658-a852-ae704b6260fb tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:45.182868 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-0c1d51b4-9876-498f-9900-5fd57a296fa0 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 200 len: 1274 microversion: 2.1 time: 0.523491 Oct 08 21:08:45.197332 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2030/3963] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:08:44 2022] GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 1274 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:08:45.213044 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-f8172ad7-2d2f-4bbe-ad39-08be3ec5bbf8 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:45.214220 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-f8172ad7-2d2f-4bbe-ad39-08be3ec5bbf8 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] [instance: b9e77bd1-3ce0-4f0a-b5ac-8c0ba6caffbb] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:45.252963 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f8172ad7-2d2f-4bbe-ad39-08be3ec5bbf8 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:45.253839 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f8172ad7-2d2f-4bbe-ad39-08be3ec5bbf8 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:45.253973 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f8172ad7-2d2f-4bbe-ad39-08be3ec5bbf8 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:45.254645 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f8172ad7-2d2f-4bbe-ad39-08be3ec5bbf8 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:45.255110 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f8172ad7-2d2f-4bbe-ad39-08be3ec5bbf8 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:45.255548 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f8172ad7-2d2f-4bbe-ad39-08be3ec5bbf8 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:45.427220 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-a684beb5-29c7-4658-a852-ae704b6260fb tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] 10.222.0.26 "GET /compute/v2.1/servers/159e29dd-802c-4059-99f9-bb7c113d430b/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.316846 Oct 08 21:08:45.427995 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1934/3964] 10.222.0.26 () {60 vars in 1316 bytes} [Sat Oct 8 21:08:45 2022] GET /compute/v2.1/servers/159e29dd-802c-4059-99f9-bb7c113d430b/os-interface => generated 284 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 08 21:08:45.449819 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-f5df8bda-6704-4548-8616-086f5b743be6 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:45.450642 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-f5df8bda-6704-4548-8616-086f5b743be6 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: 3c531611-396a-432b-b42f-dbf60a120a7a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:45.467119 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f5df8bda-6704-4548-8616-086f5b743be6 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:45.468116 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f5df8bda-6704-4548-8616-086f5b743be6 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:45.468991 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f5df8bda-6704-4548-8616-086f5b743be6 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:45.470200 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f5df8bda-6704-4548-8616-086f5b743be6 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:45.470798 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f5df8bda-6704-4548-8616-086f5b743be6 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:45.471367 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f5df8bda-6704-4548-8616-086f5b743be6 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:46.043191 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-f8172ad7-2d2f-4bbe-ad39-08be3ec5bbf8 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30fe0e1ffa1040ec85d3c32d8b741c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd0e7c24154409824f96e9e99da357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:46.053214 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-f8172ad7-2d2f-4bbe-ad39-08be3ec5bbf8 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "GET /compute/v2.1/servers/b9e77bd1-3ce0-4f0a-b5ac-8c0ba6caffbb" status: 200 len: 1497 microversion: 2.1 time: 0.853679 Oct 08 21:08:46.054830 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2031/3965] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:08:45 2022] GET /compute/v2.1/servers/b9e77bd1-3ce0-4f0a-b5ac-8c0ba6caffbb => generated 1497 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:08:46.068012 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-b934b7b5-581f-4420-bed2-967c43144dd1 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:46.068880 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-b934b7b5-581f-4420-bed2-967c43144dd1 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: 99510c36-821a-41dd-9ffe-8955dda22dcf] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:46.078371 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b934b7b5-581f-4420-bed2-967c43144dd1 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:46.079204 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b934b7b5-581f-4420-bed2-967c43144dd1 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:46.079847 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b934b7b5-581f-4420-bed2-967c43144dd1 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:46.080799 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b934b7b5-581f-4420-bed2-967c43144dd1 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:46.081506 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b934b7b5-581f-4420-bed2-967c43144dd1 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:46.082138 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b934b7b5-581f-4420-bed2-967c43144dd1 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:46.154872 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-f5df8bda-6704-4548-8616-086f5b743be6 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78e9afd772c4de981cac8f5817ec356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765c62cac2ee4406b23a5baa85c52ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:46.168431 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-f5df8bda-6704-4548-8616-086f5b743be6 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/3c531611-396a-432b-b42f-dbf60a120a7a" status: 200 len: 1314 microversion: 2.1 time: 0.727668 Oct 08 21:08:46.184333 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1935/3966] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:08:45 2022] GET /compute/v2.1/servers/3c531611-396a-432b-b42f-dbf60a120a7a => generated 1314 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:08:46.261112 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-77a1f8cf-c4b3-4a8b-b66b-86c17bd01ced tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:46.262626 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-77a1f8cf-c4b3-4a8b-b66b-86c17bd01ced tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:46.274104 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-77a1f8cf-c4b3-4a8b-b66b-86c17bd01ced tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:46.274642 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-77a1f8cf-c4b3-4a8b-b66b-86c17bd01ced tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:46.275126 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-77a1f8cf-c4b3-4a8b-b66b-86c17bd01ced tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:46.276685 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-77a1f8cf-c4b3-4a8b-b66b-86c17bd01ced tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:46.277250 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-77a1f8cf-c4b3-4a8b-b66b-86c17bd01ced tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:46.277697 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-77a1f8cf-c4b3-4a8b-b66b-86c17bd01ced tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:46.588026 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-b934b7b5-581f-4420-bed2-967c43144dd1 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06443b5728fb4d1e95d6245820e786bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ded993145b4eda9d6a33b994519012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:46.598284 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-b934b7b5-581f-4420-bed2-967c43144dd1 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "GET /compute/v2.1/servers/99510c36-821a-41dd-9ffe-8955dda22dcf" status: 200 len: 1203 microversion: 2.1 time: 0.542100 Oct 08 21:08:46.599362 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2032/3967] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:08:46 2022] GET /compute/v2.1/servers/99510c36-821a-41dd-9ffe-8955dda22dcf => generated 1203 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:08:46.615352 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-77a1f8cf-c4b3-4a8b-b66b-86c17bd01ced tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:46.627866 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-77a1f8cf-c4b3-4a8b-b66b-86c17bd01ced tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 200 len: 1316 microversion: 2.1 time: 0.388135 Oct 08 21:08:46.637354 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1936/3968] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:08:46 2022] GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 1316 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:08:47.081811 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-fb3581d7-0337-4971-8f0b-82b0c716033a tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:47.082670 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-fb3581d7-0337-4971-8f0b-82b0c716033a tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] [instance: b9e77bd1-3ce0-4f0a-b5ac-8c0ba6caffbb] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:47.090460 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fb3581d7-0337-4971-8f0b-82b0c716033a tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:47.091247 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fb3581d7-0337-4971-8f0b-82b0c716033a tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:47.091877 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fb3581d7-0337-4971-8f0b-82b0c716033a tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:47.092644 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fb3581d7-0337-4971-8f0b-82b0c716033a tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:47.093386 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fb3581d7-0337-4971-8f0b-82b0c716033a tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:47.093974 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fb3581d7-0337-4971-8f0b-82b0c716033a tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:47.127979 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-daafd0f3-47b7-4def-af8d-08d41dbaabbd tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Action: 'create', calling method: .version_select at 0x7f1a8cc630d0>, body: {"keypair": {"name": "tempest-keypair-1762501138", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPn12jmPh6PpuUIetPfW6knYicHHFRpI9E545UO+Sra4N/ZkhYR5M5xFGfUfeEJedOC0MDNX9xK/EMWcmXzMMhN0vH46G5n55qRzFXDgS80b/jDjq1I+xfIgxBN83u/FLA=="}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:08:47.163920 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-daafd0f3-47b7-4def-af8d-08d41dbaabbd tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Getting quotas for project c68b14967e8249fd886f168d366f241f. Resources: {'key_pairs'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:08:47.170759 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-daafd0f3-47b7-4def-af8d-08d41dbaabbd tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Getting quotas for user 85abb492492343c58734564a2b26c8f6 and project c68b14967e8249fd886f168d366f241f. Resources: {'key_pairs'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:08:47.201109 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-daafd0f3-47b7-4def-af8d-08d41dbaabbd tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.077786 Oct 08 21:08:47.201777 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1937/3969] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Oct 8 21:08:47 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:08:47.207131 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-0a7118b0-f38e-4471-aa5a-1c6cf054ad0e tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:47.208032 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-0a7118b0-f38e-4471-aa5a-1c6cf054ad0e tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: 3c531611-396a-432b-b42f-dbf60a120a7a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:47.215098 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0a7118b0-f38e-4471-aa5a-1c6cf054ad0e tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:47.215612 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0a7118b0-f38e-4471-aa5a-1c6cf054ad0e tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:47.216056 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0a7118b0-f38e-4471-aa5a-1c6cf054ad0e tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:47.216905 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0a7118b0-f38e-4471-aa5a-1c6cf054ad0e tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:47.217403 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0a7118b0-f38e-4471-aa5a-1c6cf054ad0e tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:47.217836 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0a7118b0-f38e-4471-aa5a-1c6cf054ad0e tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:47.595817 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-fb3581d7-0337-4971-8f0b-82b0c716033a tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30fe0e1ffa1040ec85d3c32d8b741c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd0e7c24154409824f96e9e99da357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:47.606833 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-fb3581d7-0337-4971-8f0b-82b0c716033a tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "GET /compute/v2.1/servers/b9e77bd1-3ce0-4f0a-b5ac-8c0ba6caffbb" status: 200 len: 1497 microversion: 2.1 time: 0.529007 Oct 08 21:08:47.617123 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2033/3970] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:08:47 2022] GET /compute/v2.1/servers/b9e77bd1-3ce0-4f0a-b5ac-8c0ba6caffbb => generated 1497 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:08:47.631478 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-3e11ffd4-0ac4-4a97-bc14-26d9de6db2b3 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:47.631478 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-3e11ffd4-0ac4-4a97-bc14-26d9de6db2b3 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: 99510c36-821a-41dd-9ffe-8955dda22dcf] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:47.641245 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3e11ffd4-0ac4-4a97-bc14-26d9de6db2b3 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:47.641714 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3e11ffd4-0ac4-4a97-bc14-26d9de6db2b3 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:47.642293 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3e11ffd4-0ac4-4a97-bc14-26d9de6db2b3 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:47.643733 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3e11ffd4-0ac4-4a97-bc14-26d9de6db2b3 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:47.644412 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3e11ffd4-0ac4-4a97-bc14-26d9de6db2b3 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:47.645387 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3e11ffd4-0ac4-4a97-bc14-26d9de6db2b3 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:47.789128 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-3e11ffd4-0ac4-4a97-bc14-26d9de6db2b3 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06443b5728fb4d1e95d6245820e786bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ded993145b4eda9d6a33b994519012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:47.804163 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-3e11ffd4-0ac4-4a97-bc14-26d9de6db2b3 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "GET /compute/v2.1/servers/99510c36-821a-41dd-9ffe-8955dda22dcf" status: 200 len: 1265 microversion: 2.1 time: 0.181107 Oct 08 21:08:47.805332 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2034/3971] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:08:47 2022] GET /compute/v2.1/servers/99510c36-821a-41dd-9ffe-8955dda22dcf => generated 1265 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:08:47.813379 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-96d54de2-cd8b-4b76-8694-6b153cb5ac85 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:47.814316 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-96d54de2-cd8b-4b76-8694-6b153cb5ac85 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:47.821979 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-96d54de2-cd8b-4b76-8694-6b153cb5ac85 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:47.822656 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-96d54de2-cd8b-4b76-8694-6b153cb5ac85 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:47.823263 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-96d54de2-cd8b-4b76-8694-6b153cb5ac85 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:47.824105 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-96d54de2-cd8b-4b76-8694-6b153cb5ac85 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:47.824887 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-96d54de2-cd8b-4b76-8694-6b153cb5ac85 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:47.825364 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-96d54de2-cd8b-4b76-8694-6b153cb5ac85 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:47.879306 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-0a7118b0-f38e-4471-aa5a-1c6cf054ad0e tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78e9afd772c4de981cac8f5817ec356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765c62cac2ee4406b23a5baa85c52ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:47.888397 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-0a7118b0-f38e-4471-aa5a-1c6cf054ad0e tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/3c531611-396a-432b-b42f-dbf60a120a7a" status: 200 len: 1314 microversion: 2.1 time: 0.685410 Oct 08 21:08:47.889292 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1938/3972] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:08:47 2022] GET /compute/v2.1/servers/3c531611-396a-432b-b42f-dbf60a120a7a => generated 1314 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:08:48.168238 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-96d54de2-cd8b-4b76-8694-6b153cb5ac85 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:48.182776 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-96d54de2-cd8b-4b76-8694-6b153cb5ac85 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 200 len: 1316 microversion: 2.1 time: 0.373887 Oct 08 21:08:48.183383 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2035/3973] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:08:47 2022] GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 1316 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:08:48.435385 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-0a8218f8-2b47-4dc4-8c8f-95f2255edcbb req-02e0066e-2d79-4a30-99f1-24b494823d11 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c531611-396a-432b-b42f-dbf60a120a7a", "tag": "f12e9484-4347-49a6-883f-9b6e9702db33"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:08:48.464222 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-0a8218f8-2b47-4dc4-8c8f-95f2255edcbb req-02e0066e-2d79-4a30-99f1-24b494823d11 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:48.464818 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-0a8218f8-2b47-4dc4-8c8f-95f2255edcbb req-02e0066e-2d79-4a30-99f1-24b494823d11 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:48.465698 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-0a8218f8-2b47-4dc4-8c8f-95f2255edcbb req-02e0066e-2d79-4a30-99f1-24b494823d11 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:48.490240 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-0a8218f8-2b47-4dc4-8c8f-95f2255edcbb req-02e0066e-2d79-4a30-99f1-24b494823d11 service nova] Creating event network-changed:f12e9484-4347-49a6-883f-9b6e9702db33 for instance 3c531611-396a-432b-b42f-dbf60a120a7a on nch1-master-1 Oct 08 21:08:48.499562 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-0a8218f8-2b47-4dc4-8c8f-95f2255edcbb req-02e0066e-2d79-4a30-99f1-24b494823d11 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069577 Oct 08 21:08:48.501111 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1939/3974] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:08:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:08:48.632520 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-87ed8cef-0b08-45f1-acb5-7288715363cd tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:48.633135 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-87ed8cef-0b08-45f1-acb5-7288715363cd tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] [instance: b9e77bd1-3ce0-4f0a-b5ac-8c0ba6caffbb] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:48.640138 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-87ed8cef-0b08-45f1-acb5-7288715363cd tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:48.640568 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-87ed8cef-0b08-45f1-acb5-7288715363cd tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:48.641013 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-87ed8cef-0b08-45f1-acb5-7288715363cd tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:48.641749 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-87ed8cef-0b08-45f1-acb5-7288715363cd tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:48.642209 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-87ed8cef-0b08-45f1-acb5-7288715363cd tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:48.642634 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-87ed8cef-0b08-45f1-acb5-7288715363cd tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:48.833089 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-f3b93759-1c2d-4022-8c97-dec055c8fe97 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:48.834242 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-f3b93759-1c2d-4022-8c97-dec055c8fe97 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: 99510c36-821a-41dd-9ffe-8955dda22dcf] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:48.844931 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f3b93759-1c2d-4022-8c97-dec055c8fe97 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:48.850132 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f3b93759-1c2d-4022-8c97-dec055c8fe97 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:48.850796 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f3b93759-1c2d-4022-8c97-dec055c8fe97 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:48.851792 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f3b93759-1c2d-4022-8c97-dec055c8fe97 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:48.852396 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f3b93759-1c2d-4022-8c97-dec055c8fe97 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:48.852973 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f3b93759-1c2d-4022-8c97-dec055c8fe97 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:49.204552 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-87ed8cef-0b08-45f1-acb5-7288715363cd tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30fe0e1ffa1040ec85d3c32d8b741c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd0e7c24154409824f96e9e99da357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:49.214139 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-87ed8cef-0b08-45f1-acb5-7288715363cd tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "GET /compute/v2.1/servers/b9e77bd1-3ce0-4f0a-b5ac-8c0ba6caffbb" status: 200 len: 1497 microversion: 2.1 time: 0.584862 Oct 08 21:08:49.224223 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2036/3975] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:08:48 2022] GET /compute/v2.1/servers/b9e77bd1-3ce0-4f0a-b5ac-8c0ba6caffbb => generated 1497 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:08:49.227264 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-f3b93759-1c2d-4022-8c97-dec055c8fe97 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06443b5728fb4d1e95d6245820e786bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ded993145b4eda9d6a33b994519012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:49.231148 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-3b7a73cc-a25f-4ff9-83b4-2afe259cd3ec tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:49.232054 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-3b7a73cc-a25f-4ff9-83b4-2afe259cd3ec tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: 3c531611-396a-432b-b42f-dbf60a120a7a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:49.241928 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-f3b93759-1c2d-4022-8c97-dec055c8fe97 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "GET /compute/v2.1/servers/99510c36-821a-41dd-9ffe-8955dda22dcf" status: 200 len: 1307 microversion: 2.1 time: 0.412765 Oct 08 21:08:49.243606 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3b7a73cc-a25f-4ff9-83b4-2afe259cd3ec tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:49.244172 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3b7a73cc-a25f-4ff9-83b4-2afe259cd3ec tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:49.245203 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3b7a73cc-a25f-4ff9-83b4-2afe259cd3ec tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:49.245766 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1940/3976] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:08:48 2022] GET /compute/v2.1/servers/99510c36-821a-41dd-9ffe-8955dda22dcf => generated 1307 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:08:49.245944 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3b7a73cc-a25f-4ff9-83b4-2afe259cd3ec tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:49.250901 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3b7a73cc-a25f-4ff9-83b4-2afe259cd3ec tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:49.253087 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3b7a73cc-a25f-4ff9-83b4-2afe259cd3ec tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:49.258366 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-11386d87-b08b-4011-adb9-491331f2524b req-27636465-b9bc-42ae-bbee-5468a0346d03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2548207-aa57-4e4c-876b-2027b59283d2", "tag": "1900770b-2820-49c0-af24-1c780eb5f1e0"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:08:49.302745 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-11386d87-b08b-4011-adb9-491331f2524b req-27636465-b9bc-42ae-bbee-5468a0346d03 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:49.304319 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-11386d87-b08b-4011-adb9-491331f2524b req-27636465-b9bc-42ae-bbee-5468a0346d03 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:49.306121 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-11386d87-b08b-4011-adb9-491331f2524b req-27636465-b9bc-42ae-bbee-5468a0346d03 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:49.350785 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-11386d87-b08b-4011-adb9-491331f2524b req-27636465-b9bc-42ae-bbee-5468a0346d03 service nova] Creating event network-changed:1900770b-2820-49c0-af24-1c780eb5f1e0 for instance e2548207-aa57-4e4c-876b-2027b59283d2 on nch2-master-1 Oct 08 21:08:49.356780 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-11386d87-b08b-4011-adb9-491331f2524b req-27636465-b9bc-42ae-bbee-5468a0346d03 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108391 Oct 08 21:08:49.358012 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1941/3977] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:08:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:08:49.364393 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-95d8c772-ccf1-40e6-a460-9bc7b05befe9 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:49.365631 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-95d8c772-ccf1-40e6-a460-9bc7b05befe9 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:49.375260 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-95d8c772-ccf1-40e6-a460-9bc7b05befe9 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:49.376161 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-95d8c772-ccf1-40e6-a460-9bc7b05befe9 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:49.386358 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-95d8c772-ccf1-40e6-a460-9bc7b05befe9 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:49.388302 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-95d8c772-ccf1-40e6-a460-9bc7b05befe9 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:49.389304 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-95d8c772-ccf1-40e6-a460-9bc7b05befe9 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:49.390135 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-95d8c772-ccf1-40e6-a460-9bc7b05befe9 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:50.149528 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-3b7a73cc-a25f-4ff9-83b4-2afe259cd3ec tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78e9afd772c4de981cac8f5817ec356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765c62cac2ee4406b23a5baa85c52ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:50.168642 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-3b7a73cc-a25f-4ff9-83b4-2afe259cd3ec tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/3c531611-396a-432b-b42f-dbf60a120a7a" status: 200 len: 1314 microversion: 2.1 time: 0.941885 Oct 08 21:08:50.170829 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2037/3978] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:08:49 2022] GET /compute/v2.1/servers/3c531611-396a-432b-b42f-dbf60a120a7a => generated 1314 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:08:50.218900 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-95d8c772-ccf1-40e6-a460-9bc7b05befe9 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:50.230963 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-95d8c772-ccf1-40e6-a460-9bc7b05befe9 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 200 len: 1316 microversion: 2.1 time: 0.871186 Oct 08 21:08:50.231800 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1942/3979] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:08:49 2022] GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 1316 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:08:50.269819 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-f03fc960-54e8-4791-bd65-ec16344ebb39 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:50.270045 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-2ba7668f-f043-4712-8cd8-3527a347b32f tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:50.270612 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-2ba7668f-f043-4712-8cd8-3527a347b32f tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: 99510c36-821a-41dd-9ffe-8955dda22dcf] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:50.270723 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-f03fc960-54e8-4791-bd65-ec16344ebb39 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] [instance: b9e77bd1-3ce0-4f0a-b5ac-8c0ba6caffbb] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:50.278298 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f03fc960-54e8-4791-bd65-ec16344ebb39 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:50.279111 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f03fc960-54e8-4791-bd65-ec16344ebb39 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:50.279783 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f03fc960-54e8-4791-bd65-ec16344ebb39 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:50.280600 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f03fc960-54e8-4791-bd65-ec16344ebb39 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:50.281201 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f03fc960-54e8-4791-bd65-ec16344ebb39 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:50.281870 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f03fc960-54e8-4791-bd65-ec16344ebb39 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:50.284343 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2ba7668f-f043-4712-8cd8-3527a347b32f tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:50.285963 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2ba7668f-f043-4712-8cd8-3527a347b32f tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:50.286604 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2ba7668f-f043-4712-8cd8-3527a347b32f tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:50.287511 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2ba7668f-f043-4712-8cd8-3527a347b32f tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:50.287989 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2ba7668f-f043-4712-8cd8-3527a347b32f tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:50.288427 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2ba7668f-f043-4712-8cd8-3527a347b32f tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:50.448853 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-f03fc960-54e8-4791-bd65-ec16344ebb39 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30fe0e1ffa1040ec85d3c32d8b741c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd0e7c24154409824f96e9e99da357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:50.458110 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-f03fc960-54e8-4791-bd65-ec16344ebb39 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "GET /compute/v2.1/servers/b9e77bd1-3ce0-4f0a-b5ac-8c0ba6caffbb" status: 200 len: 1497 microversion: 2.1 time: 0.192133 Oct 08 21:08:50.458807 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1943/3980] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:08:50 2022] GET /compute/v2.1/servers/b9e77bd1-3ce0-4f0a-b5ac-8c0ba6caffbb => generated 1497 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:08:50.534327 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-672b1d51-69e6-48f4-98b5-ef857af92685 req-2a1d6c10-43d5-4a8d-b7e0-cc6851b0b97d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "159e29dd-802c-4059-99f9-bb7c113d430b", "tag": "59479dc9-06cf-4a86-bedc-3998868989c8"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:08:50.546574 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-672b1d51-69e6-48f4-98b5-ef857af92685 req-2a1d6c10-43d5-4a8d-b7e0-cc6851b0b97d service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:50.547287 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-672b1d51-69e6-48f4-98b5-ef857af92685 req-2a1d6c10-43d5-4a8d-b7e0-cc6851b0b97d service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:50.548115 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-672b1d51-69e6-48f4-98b5-ef857af92685 req-2a1d6c10-43d5-4a8d-b7e0-cc6851b0b97d service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:50.561733 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-672b1d51-69e6-48f4-98b5-ef857af92685 req-2a1d6c10-43d5-4a8d-b7e0-cc6851b0b97d service nova] Creating event network-changed:59479dc9-06cf-4a86-bedc-3998868989c8 for instance 159e29dd-802c-4059-99f9-bb7c113d430b on nch2-master-1 Oct 08 21:08:50.567131 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-672b1d51-69e6-48f4-98b5-ef857af92685 req-2a1d6c10-43d5-4a8d-b7e0-cc6851b0b97d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037703 Oct 08 21:08:50.568683 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1944/3981] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:08:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:08:50.795916 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=4 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:08:50.963569 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-2ba7668f-f043-4712-8cd8-3527a347b32f tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06443b5728fb4d1e95d6245820e786bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ded993145b4eda9d6a33b994519012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:50.971558 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-2ba7668f-f043-4712-8cd8-3527a347b32f tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "GET /compute/v2.1/servers/99510c36-821a-41dd-9ffe-8955dda22dcf" status: 200 len: 1307 microversion: 2.1 time: 0.707494 Oct 08 21:08:50.972142 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2038/3982] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:08:50 2022] GET /compute/v2.1/servers/99510c36-821a-41dd-9ffe-8955dda22dcf => generated 1307 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:08:51.193920 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-f3c78b4b-77c8-418e-9efb-343d70c4cede tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:51.194636 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-f3c78b4b-77c8-418e-9efb-343d70c4cede tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: 3c531611-396a-432b-b42f-dbf60a120a7a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:51.203798 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f3c78b4b-77c8-418e-9efb-343d70c4cede tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:51.204622 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f3c78b4b-77c8-418e-9efb-343d70c4cede tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:51.205216 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f3c78b4b-77c8-418e-9efb-343d70c4cede tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:51.206170 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f3c78b4b-77c8-418e-9efb-343d70c4cede tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:51.206813 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f3c78b4b-77c8-418e-9efb-343d70c4cede tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:51.207418 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f3c78b4b-77c8-418e-9efb-343d70c4cede tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:51.255050 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e79e801b-b206-4a4f-a0f6-d3a7db8ea523 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:51.256349 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-e79e801b-b206-4a4f-a0f6-d3a7db8ea523 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:51.263827 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e79e801b-b206-4a4f-a0f6-d3a7db8ea523 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:51.264650 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e79e801b-b206-4a4f-a0f6-d3a7db8ea523 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:51.265369 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e79e801b-b206-4a4f-a0f6-d3a7db8ea523 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:51.266383 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e79e801b-b206-4a4f-a0f6-d3a7db8ea523 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:51.267061 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e79e801b-b206-4a4f-a0f6-d3a7db8ea523 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:51.267704 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e79e801b-b206-4a4f-a0f6-d3a7db8ea523 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:51.452231 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-f3c78b4b-77c8-418e-9efb-343d70c4cede tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78e9afd772c4de981cac8f5817ec356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765c62cac2ee4406b23a5baa85c52ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:51.453430 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=7 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:08:51.462360 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-f3c78b4b-77c8-418e-9efb-343d70c4cede tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/3c531611-396a-432b-b42f-dbf60a120a7a" status: 200 len: 1314 microversion: 2.1 time: 0.272745 Oct 08 21:08:51.464157 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1945/3983] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:08:51 2022] GET /compute/v2.1/servers/3c531611-396a-432b-b42f-dbf60a120a7a => generated 1314 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:08:51.486363 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-edacddf4-dd82-4bc4-a4cb-37bfb453b989 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:51.487219 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-edacddf4-dd82-4bc4-a4cb-37bfb453b989 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] [instance: b9e77bd1-3ce0-4f0a-b5ac-8c0ba6caffbb] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:51.496595 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-edacddf4-dd82-4bc4-a4cb-37bfb453b989 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:51.497104 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-edacddf4-dd82-4bc4-a4cb-37bfb453b989 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:51.497585 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-edacddf4-dd82-4bc4-a4cb-37bfb453b989 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:51.501881 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-edacddf4-dd82-4bc4-a4cb-37bfb453b989 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:51.502953 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-edacddf4-dd82-4bc4-a4cb-37bfb453b989 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:51.503656 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-edacddf4-dd82-4bc4-a4cb-37bfb453b989 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:51.510145 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=100 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:08:51.727782 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-edacddf4-dd82-4bc4-a4cb-37bfb453b989 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30fe0e1ffa1040ec85d3c32d8b741c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd0e7c24154409824f96e9e99da357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:51.732728 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-e79e801b-b206-4a4f-a0f6-d3a7db8ea523 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:51.739397 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-edacddf4-dd82-4bc4-a4cb-37bfb453b989 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "GET /compute/v2.1/servers/b9e77bd1-3ce0-4f0a-b5ac-8c0ba6caffbb" status: 200 len: 1497 microversion: 2.1 time: 0.257341 Oct 08 21:08:51.740673 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1946/3984] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:08:51 2022] GET /compute/v2.1/servers/b9e77bd1-3ce0-4f0a-b5ac-8c0ba6caffbb => generated 1497 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:08:51.745411 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-e79e801b-b206-4a4f-a0f6-d3a7db8ea523 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 200 len: 1316 microversion: 2.1 time: 0.494111 Oct 08 21:08:51.758593 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2039/3985] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:08:51 2022] GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 1316 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:08:51.994547 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-a142cb27-106d-4804-be1c-29647b5b0e49 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:51.995209 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-a142cb27-106d-4804-be1c-29647b5b0e49 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: 99510c36-821a-41dd-9ffe-8955dda22dcf] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:52.001602 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a142cb27-106d-4804-be1c-29647b5b0e49 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:52.002101 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a142cb27-106d-4804-be1c-29647b5b0e49 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:52.002614 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a142cb27-106d-4804-be1c-29647b5b0e49 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:52.003412 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a142cb27-106d-4804-be1c-29647b5b0e49 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:52.003887 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a142cb27-106d-4804-be1c-29647b5b0e49 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:52.004326 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a142cb27-106d-4804-be1c-29647b5b0e49 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:52.152880 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-a142cb27-106d-4804-be1c-29647b5b0e49 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06443b5728fb4d1e95d6245820e786bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ded993145b4eda9d6a33b994519012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:52.163171 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-a142cb27-106d-4804-be1c-29647b5b0e49 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "GET /compute/v2.1/servers/99510c36-821a-41dd-9ffe-8955dda22dcf" status: 200 len: 1307 microversion: 2.1 time: 0.172521 Oct 08 21:08:52.169240 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1947/3986] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:08:51 2022] GET /compute/v2.1/servers/99510c36-821a-41dd-9ffe-8955dda22dcf => generated 1307 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:08:52.488504 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-572b8901-530a-4ed8-aa07-e160e2d21e21 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:52.489342 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-572b8901-530a-4ed8-aa07-e160e2d21e21 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: 3c531611-396a-432b-b42f-dbf60a120a7a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:52.497232 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-572b8901-530a-4ed8-aa07-e160e2d21e21 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:52.497737 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-572b8901-530a-4ed8-aa07-e160e2d21e21 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:52.498186 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-572b8901-530a-4ed8-aa07-e160e2d21e21 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:52.498913 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-572b8901-530a-4ed8-aa07-e160e2d21e21 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:52.499377 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-572b8901-530a-4ed8-aa07-e160e2d21e21 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:52.499982 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-572b8901-530a-4ed8-aa07-e160e2d21e21 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:52.764853 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-01ac9ead-41dd-46a8-9f22-0b88b058bb41 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:52.765645 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-01ac9ead-41dd-46a8-9f22-0b88b058bb41 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] [instance: b9e77bd1-3ce0-4f0a-b5ac-8c0ba6caffbb] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:52.773291 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-01ac9ead-41dd-46a8-9f22-0b88b058bb41 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:52.773905 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-01ac9ead-41dd-46a8-9f22-0b88b058bb41 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:52.774615 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-01ac9ead-41dd-46a8-9f22-0b88b058bb41 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:52.775426 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-01ac9ead-41dd-46a8-9f22-0b88b058bb41 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:52.776015 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-01ac9ead-41dd-46a8-9f22-0b88b058bb41 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:52.776567 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-01ac9ead-41dd-46a8-9f22-0b88b058bb41 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:52.908105 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-01ac9ead-41dd-46a8-9f22-0b88b058bb41 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30fe0e1ffa1040ec85d3c32d8b741c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd0e7c24154409824f96e9e99da357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:52.916483 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-01ac9ead-41dd-46a8-9f22-0b88b058bb41 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "GET /compute/v2.1/servers/b9e77bd1-3ce0-4f0a-b5ac-8c0ba6caffbb" status: 200 len: 1497 microversion: 2.1 time: 0.156019 Oct 08 21:08:52.917063 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1948/3987] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:08:52 2022] GET /compute/v2.1/servers/b9e77bd1-3ce0-4f0a-b5ac-8c0ba6caffbb => generated 1497 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:08:52.937058 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-2bdbf063-c3c8-4975-9fce-afeae699169c tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:52.937706 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-2bdbf063-c3c8-4975-9fce-afeae699169c tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:52.943684 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2bdbf063-c3c8-4975-9fce-afeae699169c tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:52.944179 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2bdbf063-c3c8-4975-9fce-afeae699169c tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:52.944620 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2bdbf063-c3c8-4975-9fce-afeae699169c tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:52.945512 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2bdbf063-c3c8-4975-9fce-afeae699169c tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:52.946134 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2bdbf063-c3c8-4975-9fce-afeae699169c tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:52.946719 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2bdbf063-c3c8-4975-9fce-afeae699169c tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:53.083318 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-2bdbf063-c3c8-4975-9fce-afeae699169c tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:53.092037 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-2bdbf063-c3c8-4975-9fce-afeae699169c tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 200 len: 1316 microversion: 2.1 time: 0.158754 Oct 08 21:08:53.092740 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1949/3988] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:08:52 2022] GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 1316 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:08:53.187516 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-4bf707ba-428a-4705-a33d-8abc0252e3c8 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:53.188225 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-4bf707ba-428a-4705-a33d-8abc0252e3c8 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: 99510c36-821a-41dd-9ffe-8955dda22dcf] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:53.195910 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4bf707ba-428a-4705-a33d-8abc0252e3c8 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:53.196479 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4bf707ba-428a-4705-a33d-8abc0252e3c8 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:53.196992 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4bf707ba-428a-4705-a33d-8abc0252e3c8 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:53.197787 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4bf707ba-428a-4705-a33d-8abc0252e3c8 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:53.198263 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4bf707ba-428a-4705-a33d-8abc0252e3c8 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:53.198676 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4bf707ba-428a-4705-a33d-8abc0252e3c8 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:53.248681 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-572b8901-530a-4ed8-aa07-e160e2d21e21 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78e9afd772c4de981cac8f5817ec356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765c62cac2ee4406b23a5baa85c52ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:53.257262 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-572b8901-530a-4ed8-aa07-e160e2d21e21 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/3c531611-396a-432b-b42f-dbf60a120a7a" status: 200 len: 1314 microversion: 2.1 time: 0.772916 Oct 08 21:08:53.258004 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2040/3989] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:08:52 2022] GET /compute/v2.1/servers/3c531611-396a-432b-b42f-dbf60a120a7a => generated 1314 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:08:53.265972 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-a325f05c-e606-4a9e-b24e-f853e2c7ffe5 req-ea3eac76-59ea-4c93-9856-036a387804a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99510c36-821a-41dd-9ffe-8955dda22dcf", "tag": "cf2a7b00-139a-477e-aef9-793efed07ce1"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:08:53.281507 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-a325f05c-e606-4a9e-b24e-f853e2c7ffe5 req-ea3eac76-59ea-4c93-9856-036a387804a7 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:53.282352 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-a325f05c-e606-4a9e-b24e-f853e2c7ffe5 req-ea3eac76-59ea-4c93-9856-036a387804a7 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:53.286224 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-a325f05c-e606-4a9e-b24e-f853e2c7ffe5 req-ea3eac76-59ea-4c93-9856-036a387804a7 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:53.302427 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-a325f05c-e606-4a9e-b24e-f853e2c7ffe5 req-ea3eac76-59ea-4c93-9856-036a387804a7 service nova] Creating event network-changed:cf2a7b00-139a-477e-aef9-793efed07ce1 for instance 99510c36-821a-41dd-9ffe-8955dda22dcf on nch1-master-1 Oct 08 21:08:53.307504 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-a325f05c-e606-4a9e-b24e-f853e2c7ffe5 req-ea3eac76-59ea-4c93-9856-036a387804a7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047934 Oct 08 21:08:53.308649 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2041/3990] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:08:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:08:53.356063 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-4bf707ba-428a-4705-a33d-8abc0252e3c8 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06443b5728fb4d1e95d6245820e786bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ded993145b4eda9d6a33b994519012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:53.364105 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-4bf707ba-428a-4705-a33d-8abc0252e3c8 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "GET /compute/v2.1/servers/99510c36-821a-41dd-9ffe-8955dda22dcf" status: 200 len: 1307 microversion: 2.1 time: 0.180986 Oct 08 21:08:53.364687 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1950/3991] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:08:53 2022] GET /compute/v2.1/servers/99510c36-821a-41dd-9ffe-8955dda22dcf => generated 1307 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:08:53.721473 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-293ee6b7-d7b9-4b9f-b800-f2507f15e120 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-22653736", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b408a2cd-643c-40fc-91b9-deec142ef1f1"}], "security_groups": [{"name": "tempest-securitygroup--2099776729"}], "key_name": "tempest-keypair-1762501138", "user_data": "}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:08:53.939099 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-a9326ef1-c8f2-4497-8013-88817094fe75 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:53.940008 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-a9326ef1-c8f2-4497-8013-88817094fe75 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] [instance: b9e77bd1-3ce0-4f0a-b5ac-8c0ba6caffbb] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:53.948754 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a9326ef1-c8f2-4497-8013-88817094fe75 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:53.949289 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a9326ef1-c8f2-4497-8013-88817094fe75 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:53.949754 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a9326ef1-c8f2-4497-8013-88817094fe75 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:53.950487 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a9326ef1-c8f2-4497-8013-88817094fe75 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:53.951721 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a9326ef1-c8f2-4497-8013-88817094fe75 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:53.952428 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a9326ef1-c8f2-4497-8013-88817094fe75 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:53.967631 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.network.neutron [None req-293ee6b7-d7b9-4b9f-b800-f2507f15e120 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] validate_networks() for [('b408a2cd-643c-40fc-91b9-deec142ef1f1', None, None, None, None, None)] {{(pid=140492) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 21:08:54.092760 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-a9326ef1-c8f2-4497-8013-88817094fe75 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30fe0e1ffa1040ec85d3c32d8b741c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd0e7c24154409824f96e9e99da357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:54.105344 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-a9326ef1-c8f2-4497-8013-88817094fe75 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "GET /compute/v2.1/servers/b9e77bd1-3ce0-4f0a-b5ac-8c0ba6caffbb" status: 200 len: 1497 microversion: 2.1 time: 0.168321 Oct 08 21:08:54.106620 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1951/3992] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:08:53 2022] GET /compute/v2.1/servers/b9e77bd1-3ce0-4f0a-b5ac-8c0ba6caffbb => generated 1497 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:08:54.126022 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-d71b8313-d5ff-4bdb-9120-a4e235fc3a23 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:54.126939 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-d71b8313-d5ff-4bdb-9120-a4e235fc3a23 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:54.133404 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d71b8313-d5ff-4bdb-9120-a4e235fc3a23 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:54.134133 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d71b8313-d5ff-4bdb-9120-a4e235fc3a23 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:54.135403 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d71b8313-d5ff-4bdb-9120-a4e235fc3a23 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:54.136244 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d71b8313-d5ff-4bdb-9120-a4e235fc3a23 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:54.136780 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d71b8313-d5ff-4bdb-9120-a4e235fc3a23 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:54.138106 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d71b8313-d5ff-4bdb-9120-a4e235fc3a23 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:54.297352 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-d71b8313-d5ff-4bdb-9120-a4e235fc3a23 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:54.310923 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-d71b8313-d5ff-4bdb-9120-a4e235fc3a23 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 200 len: 1316 microversion: 2.1 time: 0.191592 Oct 08 21:08:54.336128 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1952/3993] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:08:54 2022] GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 1316 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:08:54.351625 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-3e27110d-1535-4e79-982f-c832eab62523 req-7384efcf-9a77-4585-9020-8ab6996892c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c531611-396a-432b-b42f-dbf60a120a7a", "name": "network-vif-plugged", "status": "completed", "tag": "f12e9484-4347-49a6-883f-9b6e9702db33"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:08:54.376767 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-3e27110d-1535-4e79-982f-c832eab62523 req-7384efcf-9a77-4585-9020-8ab6996892c6 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:54.377310 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-3e27110d-1535-4e79-982f-c832eab62523 req-7384efcf-9a77-4585-9020-8ab6996892c6 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:54.377760 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-3e27110d-1535-4e79-982f-c832eab62523 req-7384efcf-9a77-4585-9020-8ab6996892c6 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:54.394080 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-3e27110d-1535-4e79-982f-c832eab62523 req-7384efcf-9a77-4585-9020-8ab6996892c6 service nova] Creating event network-vif-plugged:f12e9484-4347-49a6-883f-9b6e9702db33 for instance 3c531611-396a-432b-b42f-dbf60a120a7a on nch1-master-1 Oct 08 21:08:54.399250 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-3e27110d-1535-4e79-982f-c832eab62523 req-7384efcf-9a77-4585-9020-8ab6996892c6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058446 Oct 08 21:08:54.400236 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1953/3994] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:08:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:08:54.406975 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c3063644-b1e6-4dea-9a2a-259cdde9daee tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:54.407484 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-c3063644-b1e6-4dea-9a2a-259cdde9daee tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: 3c531611-396a-432b-b42f-dbf60a120a7a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:54.415018 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c3063644-b1e6-4dea-9a2a-259cdde9daee tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:54.415529 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c3063644-b1e6-4dea-9a2a-259cdde9daee tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:54.416511 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c3063644-b1e6-4dea-9a2a-259cdde9daee tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:54.417269 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c3063644-b1e6-4dea-9a2a-259cdde9daee tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:54.417737 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c3063644-b1e6-4dea-9a2a-259cdde9daee tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:54.418789 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c3063644-b1e6-4dea-9a2a-259cdde9daee tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:54.607300 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-c3063644-b1e6-4dea-9a2a-259cdde9daee tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78e9afd772c4de981cac8f5817ec356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765c62cac2ee4406b23a5baa85c52ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:54.615184 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-c3063644-b1e6-4dea-9a2a-259cdde9daee tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/3c531611-396a-432b-b42f-dbf60a120a7a" status: 200 len: 1314 microversion: 2.1 time: 0.213205 Oct 08 21:08:54.615771 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1954/3995] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:08:54 2022] GET /compute/v2.1/servers/3c531611-396a-432b-b42f-dbf60a120a7a => generated 1314 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:08:54.620766 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-470a68b9-da1f-4ea1-8f6c-77694abfe650 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:54.621415 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-470a68b9-da1f-4ea1-8f6c-77694abfe650 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: 99510c36-821a-41dd-9ffe-8955dda22dcf] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:54.627206 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-470a68b9-da1f-4ea1-8f6c-77694abfe650 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:54.627703 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-470a68b9-da1f-4ea1-8f6c-77694abfe650 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:54.628159 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-470a68b9-da1f-4ea1-8f6c-77694abfe650 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:54.628862 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-470a68b9-da1f-4ea1-8f6c-77694abfe650 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:54.629367 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-470a68b9-da1f-4ea1-8f6c-77694abfe650 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:54.629808 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-470a68b9-da1f-4ea1-8f6c-77694abfe650 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:54.688720 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=4 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:08:54.762304 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-470a68b9-da1f-4ea1-8f6c-77694abfe650 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06443b5728fb4d1e95d6245820e786bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ded993145b4eda9d6a33b994519012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:54.771007 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-470a68b9-da1f-4ea1-8f6c-77694abfe650 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "GET /compute/v2.1/servers/99510c36-821a-41dd-9ffe-8955dda22dcf" status: 200 len: 1307 microversion: 2.1 time: 0.154097 Oct 08 21:08:54.771604 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1955/3996] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:08:54 2022] GET /compute/v2.1/servers/99510c36-821a-41dd-9ffe-8955dda22dcf => generated 1307 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:08:54.997266 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-293ee6b7-d7b9-4b9f-b800-f2507f15e120 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Flavor limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 21:08:54.997756 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-293ee6b7-d7b9-4b9f-b800-f2507f15e120 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Image limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 21:08:54.998181 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-293ee6b7-d7b9-4b9f-b800-f2507f15e120 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Flavor pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 21:08:54.998726 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-293ee6b7-d7b9-4b9f-b800-f2507f15e120 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Image pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 21:08:54.999157 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-293ee6b7-d7b9-4b9f-b800-f2507f15e120 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 21:08:55.008172 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-293ee6b7-d7b9-4b9f-b800-f2507f15e120 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:55.008698 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-293ee6b7-d7b9-4b9f-b800-f2507f15e120 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:55.009217 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-293ee6b7-d7b9-4b9f-b800-f2507f15e120 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:55.009988 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-293ee6b7-d7b9-4b9f-b800-f2507f15e120 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:55.010457 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-293ee6b7-d7b9-4b9f-b800-f2507f15e120 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:55.010894 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-293ee6b7-d7b9-4b9f-b800-f2507f15e120 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:55.028613 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-293ee6b7-d7b9-4b9f-b800-f2507f15e120 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Getting quotas for project c68b14967e8249fd886f168d366f241f. Resources: {'cores', 'instances', 'ram'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:08:55.033973 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-293ee6b7-d7b9-4b9f-b800-f2507f15e120 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Getting quotas for user 85abb492492343c58734564a2b26c8f6 and project c68b14967e8249fd886f168d366f241f. Resources: {'cores', 'instances', 'ram'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:08:55.047181 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-293ee6b7-d7b9-4b9f-b800-f2507f15e120 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Going to run 1 instances... {{(pid=140492) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 21:08:55.049680 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-293ee6b7-d7b9-4b9f-b800-f2507f15e120 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] [instance: 1b68ff0f-2dfe-4844-b7ce-556768c5d3e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c508bd7f-7db9-4b2c-af7c-be54a855c355',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140492) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 21:08:55.098312 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-293ee6b7-d7b9-4b9f-b800-f2507f15e120 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.382640 Oct 08 21:08:55.099163 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2042/3997] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 21:08:53 2022] POST /compute/v2.1/servers => generated 402 bytes in 1384 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 08 21:08:55.110962 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-dcff1e6b-44ee-449c-9922-4642cfc73297 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:55.111593 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-dcff1e6b-44ee-449c-9922-4642cfc73297 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] [instance: 1b68ff0f-2dfe-4844-b7ce-556768c5d3e2] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:55.131144 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-6e1d949b-88ed-4b49-aff1-58896adc1821 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:55.131771 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-6e1d949b-88ed-4b49-aff1-58896adc1821 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] [instance: b9e77bd1-3ce0-4f0a-b5ac-8c0ba6caffbb] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:55.138755 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6e1d949b-88ed-4b49-aff1-58896adc1821 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:55.139454 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6e1d949b-88ed-4b49-aff1-58896adc1821 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:55.139917 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6e1d949b-88ed-4b49-aff1-58896adc1821 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:55.140640 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6e1d949b-88ed-4b49-aff1-58896adc1821 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:55.141110 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6e1d949b-88ed-4b49-aff1-58896adc1821 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:55.141579 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6e1d949b-88ed-4b49-aff1-58896adc1821 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:55.193026 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-dcff1e6b-44ee-449c-9922-4642cfc73297 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85abb492492343c58734564a2b26c8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68b14967e8249fd886f168d366f241f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:55.200696 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-dcff1e6b-44ee-449c-9922-4642cfc73297 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] 10.222.0.26 "GET /compute/v2.1/servers/1b68ff0f-2dfe-4844-b7ce-556768c5d3e2" status: 200 len: 1236 microversion: 2.1 time: 0.093536 Oct 08 21:08:55.201464 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1956/3998] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:08:55 2022] GET /compute/v2.1/servers/1b68ff0f-2dfe-4844-b7ce-556768c5d3e2 => generated 1236 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:08:55.342238 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-6cad76b3-fd0b-4c3c-b25d-9d390afed823 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:55.342873 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-6cad76b3-fd0b-4c3c-b25d-9d390afed823 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:55.351124 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6cad76b3-fd0b-4c3c-b25d-9d390afed823 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:55.351634 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6cad76b3-fd0b-4c3c-b25d-9d390afed823 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:55.352088 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6cad76b3-fd0b-4c3c-b25d-9d390afed823 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:55.352823 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6cad76b3-fd0b-4c3c-b25d-9d390afed823 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:55.353377 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6cad76b3-fd0b-4c3c-b25d-9d390afed823 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:55.354372 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6cad76b3-fd0b-4c3c-b25d-9d390afed823 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:55.537173 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-6cad76b3-fd0b-4c3c-b25d-9d390afed823 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:55.546291 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-6cad76b3-fd0b-4c3c-b25d-9d390afed823 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 200 len: 1316 microversion: 2.1 time: 0.208584 Oct 08 21:08:55.550373 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1957/3999] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:08:55 2022] GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 1316 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:08:55.658516 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-331af655-f3c6-4df1-8736-cf6020d522af tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:55.660692 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-331af655-f3c6-4df1-8736-cf6020d522af tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: 3c531611-396a-432b-b42f-dbf60a120a7a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:55.671937 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-331af655-f3c6-4df1-8736-cf6020d522af tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:55.672463 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-331af655-f3c6-4df1-8736-cf6020d522af tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:55.673154 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-331af655-f3c6-4df1-8736-cf6020d522af tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:55.674627 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-331af655-f3c6-4df1-8736-cf6020d522af tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:55.675464 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-331af655-f3c6-4df1-8736-cf6020d522af tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:55.676159 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-331af655-f3c6-4df1-8736-cf6020d522af tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:55.748274 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-6e1d949b-88ed-4b49-aff1-58896adc1821 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30fe0e1ffa1040ec85d3c32d8b741c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd0e7c24154409824f96e9e99da357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:55.752671 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=100 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:08:55.764212 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-6e1d949b-88ed-4b49-aff1-58896adc1821 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "GET /compute/v2.1/servers/b9e77bd1-3ce0-4f0a-b5ac-8c0ba6caffbb" status: 200 len: 1497 microversion: 2.1 time: 0.632870 Oct 08 21:08:55.765104 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2043/4000] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:08:55 2022] GET /compute/v2.1/servers/b9e77bd1-3ce0-4f0a-b5ac-8c0ba6caffbb => generated 1497 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:08:55.797337 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-929c7acf-6e6f-4a92-b7e8-f15508e82c06 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:55.799646 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-929c7acf-6e6f-4a92-b7e8-f15508e82c06 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: 99510c36-821a-41dd-9ffe-8955dda22dcf] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:55.815975 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-929c7acf-6e6f-4a92-b7e8-f15508e82c06 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:55.825480 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-929c7acf-6e6f-4a92-b7e8-f15508e82c06 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:55.828339 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-929c7acf-6e6f-4a92-b7e8-f15508e82c06 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:55.830160 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-929c7acf-6e6f-4a92-b7e8-f15508e82c06 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:55.833511 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-929c7acf-6e6f-4a92-b7e8-f15508e82c06 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:55.836338 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-929c7acf-6e6f-4a92-b7e8-f15508e82c06 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:55.866801 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-331af655-f3c6-4df1-8736-cf6020d522af tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78e9afd772c4de981cac8f5817ec356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765c62cac2ee4406b23a5baa85c52ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:55.890751 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-331af655-f3c6-4df1-8736-cf6020d522af tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/3c531611-396a-432b-b42f-dbf60a120a7a" status: 200 len: 1314 microversion: 2.1 time: 0.255914 Oct 08 21:08:55.891919 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1958/4001] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:08:55 2022] GET /compute/v2.1/servers/3c531611-396a-432b-b42f-dbf60a120a7a => generated 1314 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:08:56.113242 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-929c7acf-6e6f-4a92-b7e8-f15508e82c06 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06443b5728fb4d1e95d6245820e786bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ded993145b4eda9d6a33b994519012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:56.122608 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-929c7acf-6e6f-4a92-b7e8-f15508e82c06 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "GET /compute/v2.1/servers/99510c36-821a-41dd-9ffe-8955dda22dcf" status: 200 len: 1307 microversion: 2.1 time: 0.332391 Oct 08 21:08:56.123606 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2044/4002] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:08:55 2022] GET /compute/v2.1/servers/99510c36-821a-41dd-9ffe-8955dda22dcf => generated 1307 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:08:56.224157 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-31d1f78f-5312-4d44-92ae-5f6e13d4e395 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:56.225032 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-31d1f78f-5312-4d44-92ae-5f6e13d4e395 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] [instance: 1b68ff0f-2dfe-4844-b7ce-556768c5d3e2] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:56.233536 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-31d1f78f-5312-4d44-92ae-5f6e13d4e395 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:56.234036 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-31d1f78f-5312-4d44-92ae-5f6e13d4e395 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:56.234481 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-31d1f78f-5312-4d44-92ae-5f6e13d4e395 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:56.235198 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-31d1f78f-5312-4d44-92ae-5f6e13d4e395 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:56.235662 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-31d1f78f-5312-4d44-92ae-5f6e13d4e395 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:56.236092 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-31d1f78f-5312-4d44-92ae-5f6e13d4e395 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:56.359702 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-31d1f78f-5312-4d44-92ae-5f6e13d4e395 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85abb492492343c58734564a2b26c8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68b14967e8249fd886f168d366f241f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:56.367995 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-31d1f78f-5312-4d44-92ae-5f6e13d4e395 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] 10.222.0.26 "GET /compute/v2.1/servers/1b68ff0f-2dfe-4844-b7ce-556768c5d3e2" status: 200 len: 1288 microversion: 2.1 time: 0.147770 Oct 08 21:08:56.376866 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1959/4003] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:08:56 2022] GET /compute/v2.1/servers/1b68ff0f-2dfe-4844-b7ce-556768c5d3e2 => generated 1288 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:08:56.573741 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-d27ac403-a5ab-468e-aed6-3c4d8ff9d2ad tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:56.574768 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-d27ac403-a5ab-468e-aed6-3c4d8ff9d2ad tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:56.582492 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d27ac403-a5ab-468e-aed6-3c4d8ff9d2ad tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:56.583334 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d27ac403-a5ab-468e-aed6-3c4d8ff9d2ad tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:56.583992 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d27ac403-a5ab-468e-aed6-3c4d8ff9d2ad tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:56.584938 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d27ac403-a5ab-468e-aed6-3c4d8ff9d2ad tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:56.585638 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d27ac403-a5ab-468e-aed6-3c4d8ff9d2ad tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:56.586927 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d27ac403-a5ab-468e-aed6-3c4d8ff9d2ad tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:56.791129 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-56b529ee-458a-4566-96f6-59700a688a6e tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:56.791773 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-56b529ee-458a-4566-96f6-59700a688a6e tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] [instance: b9e77bd1-3ce0-4f0a-b5ac-8c0ba6caffbb] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:56.798352 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-56b529ee-458a-4566-96f6-59700a688a6e tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:56.798859 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-56b529ee-458a-4566-96f6-59700a688a6e tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:56.809749 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-56b529ee-458a-4566-96f6-59700a688a6e tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:56.810603 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-56b529ee-458a-4566-96f6-59700a688a6e tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:56.811250 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-56b529ee-458a-4566-96f6-59700a688a6e tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:56.811706 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-56b529ee-458a-4566-96f6-59700a688a6e tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:56.906811 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-d27ac403-a5ab-468e-aed6-3c4d8ff9d2ad tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:56.916959 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-d27ac403-a5ab-468e-aed6-3c4d8ff9d2ad tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 200 len: 1316 microversion: 2.1 time: 0.347389 Oct 08 21:08:56.918180 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2045/4004] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:08:56 2022] GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 1316 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:08:56.923465 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-045d4417-e339-4394-af8e-7a40980e9421 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:56.924371 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-045d4417-e339-4394-af8e-7a40980e9421 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: 3c531611-396a-432b-b42f-dbf60a120a7a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:56.930622 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-045d4417-e339-4394-af8e-7a40980e9421 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:56.932174 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-045d4417-e339-4394-af8e-7a40980e9421 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:56.932863 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-045d4417-e339-4394-af8e-7a40980e9421 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:56.933857 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-045d4417-e339-4394-af8e-7a40980e9421 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:56.934580 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-045d4417-e339-4394-af8e-7a40980e9421 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:56.935305 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-045d4417-e339-4394-af8e-7a40980e9421 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:57.047204 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-56b529ee-458a-4566-96f6-59700a688a6e tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30fe0e1ffa1040ec85d3c32d8b741c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd0e7c24154409824f96e9e99da357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:57.056201 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-56b529ee-458a-4566-96f6-59700a688a6e tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "GET /compute/v2.1/servers/b9e77bd1-3ce0-4f0a-b5ac-8c0ba6caffbb" status: 200 len: 1497 microversion: 2.1 time: 0.269998 Oct 08 21:08:57.057791 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1960/4005] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:08:56 2022] GET /compute/v2.1/servers/b9e77bd1-3ce0-4f0a-b5ac-8c0ba6caffbb => generated 1497 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:08:57.149465 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-045d4417-e339-4394-af8e-7a40980e9421 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78e9afd772c4de981cac8f5817ec356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765c62cac2ee4406b23a5baa85c52ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:57.154250 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-80dca8a6-694a-41e7-9cd1-78715204fd6b tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:57.154909 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-80dca8a6-694a-41e7-9cd1-78715204fd6b tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: 99510c36-821a-41dd-9ffe-8955dda22dcf] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:57.175015 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-80dca8a6-694a-41e7-9cd1-78715204fd6b tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:57.176045 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-045d4417-e339-4394-af8e-7a40980e9421 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/3c531611-396a-432b-b42f-dbf60a120a7a" status: 200 len: 1501 microversion: 2.1 time: 0.256240 Oct 08 21:08:57.176753 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-80dca8a6-694a-41e7-9cd1-78715204fd6b tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:57.177359 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-80dca8a6-694a-41e7-9cd1-78715204fd6b tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:57.177711 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2046/4006] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:08:56 2022] GET /compute/v2.1/servers/3c531611-396a-432b-b42f-dbf60a120a7a => generated 1501 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:08:57.179536 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-80dca8a6-694a-41e7-9cd1-78715204fd6b tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:57.180993 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-80dca8a6-694a-41e7-9cd1-78715204fd6b tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:57.182824 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-80dca8a6-694a-41e7-9cd1-78715204fd6b tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:57.201512 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-fd46b7e2-a6e6-47cc-9b37-bc0f4340823c tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:08:57.202329 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-fd46b7e2-a6e6-47cc-9b37-bc0f4340823c tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: 3c531611-396a-432b-b42f-dbf60a120a7a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:57.209447 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fd46b7e2-a6e6-47cc-9b37-bc0f4340823c tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:57.210369 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fd46b7e2-a6e6-47cc-9b37-bc0f4340823c tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:57.211098 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fd46b7e2-a6e6-47cc-9b37-bc0f4340823c tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:57.212159 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fd46b7e2-a6e6-47cc-9b37-bc0f4340823c tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:57.213730 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fd46b7e2-a6e6-47cc-9b37-bc0f4340823c tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:57.215118 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fd46b7e2-a6e6-47cc-9b37-bc0f4340823c tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:57.299437 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-fd46b7e2-a6e6-47cc-9b37-bc0f4340823c tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "POST /compute/v2.1/servers/3c531611-396a-432b-b42f-dbf60a120a7a/action" status: 202 len: 0 microversion: 2.1 time: 0.103451 Oct 08 21:08:57.301277 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2047/4007] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:08:57 2022] POST /compute/v2.1/servers/3c531611-396a-432b-b42f-dbf60a120a7a/action => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 08 21:08:57.313101 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-fbae93f0-6326-4a3d-ba05-b06e7217a0d4 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:57.313953 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-fbae93f0-6326-4a3d-ba05-b06e7217a0d4 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: 3c531611-396a-432b-b42f-dbf60a120a7a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:57.324938 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fbae93f0-6326-4a3d-ba05-b06e7217a0d4 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:57.325800 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fbae93f0-6326-4a3d-ba05-b06e7217a0d4 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:57.326268 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fbae93f0-6326-4a3d-ba05-b06e7217a0d4 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:57.327533 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fbae93f0-6326-4a3d-ba05-b06e7217a0d4 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:57.328126 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fbae93f0-6326-4a3d-ba05-b06e7217a0d4 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:57.328802 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fbae93f0-6326-4a3d-ba05-b06e7217a0d4 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:57.597877 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-fbae93f0-6326-4a3d-ba05-b06e7217a0d4 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78e9afd772c4de981cac8f5817ec356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765c62cac2ee4406b23a5baa85c52ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:57.616702 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-fbae93f0-6326-4a3d-ba05-b06e7217a0d4 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/3c531611-396a-432b-b42f-dbf60a120a7a" status: 200 len: 1506 microversion: 2.1 time: 0.310579 Oct 08 21:08:57.617736 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2048/4008] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:08:57 2022] GET /compute/v2.1/servers/3c531611-396a-432b-b42f-dbf60a120a7a => generated 1506 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:08:57.625818 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-b8cf5ce6-6ba2-4dd7-b583-d52e325b3831 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:57.626830 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-b8cf5ce6-6ba2-4dd7-b583-d52e325b3831 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] [instance: 1b68ff0f-2dfe-4844-b7ce-556768c5d3e2] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:57.636228 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b8cf5ce6-6ba2-4dd7-b583-d52e325b3831 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:57.637759 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b8cf5ce6-6ba2-4dd7-b583-d52e325b3831 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:57.638433 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b8cf5ce6-6ba2-4dd7-b583-d52e325b3831 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:57.640071 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b8cf5ce6-6ba2-4dd7-b583-d52e325b3831 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:57.641145 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b8cf5ce6-6ba2-4dd7-b583-d52e325b3831 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:57.642950 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b8cf5ce6-6ba2-4dd7-b583-d52e325b3831 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:57.742633 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-b8cf5ce6-6ba2-4dd7-b583-d52e325b3831 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85abb492492343c58734564a2b26c8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68b14967e8249fd886f168d366f241f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:57.765282 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-b8cf5ce6-6ba2-4dd7-b583-d52e325b3831 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] 10.222.0.26 "GET /compute/v2.1/servers/1b68ff0f-2dfe-4844-b7ce-556768c5d3e2" status: 200 len: 1294 microversion: 2.1 time: 0.144786 Oct 08 21:08:57.767113 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2049/4009] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:08:57 2022] GET /compute/v2.1/servers/1b68ff0f-2dfe-4844-b7ce-556768c5d3e2 => generated 1294 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:08:57.787800 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-25db7e90-adbc-48c8-a913-f2c0d90be641 req-2cef8ac2-1d91-4133-9a5f-ed75b97b54b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2548207-aa57-4e4c-876b-2027b59283d2", "name": "network-vif-plugged", "status": "completed", "tag": "1900770b-2820-49c0-af24-1c780eb5f1e0"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:08:57.797471 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-80dca8a6-694a-41e7-9cd1-78715204fd6b tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06443b5728fb4d1e95d6245820e786bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ded993145b4eda9d6a33b994519012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:57.798781 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-25db7e90-adbc-48c8-a913-f2c0d90be641 req-2cef8ac2-1d91-4133-9a5f-ed75b97b54b5 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:57.799278 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-25db7e90-adbc-48c8-a913-f2c0d90be641 req-2cef8ac2-1d91-4133-9a5f-ed75b97b54b5 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:57.799729 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-25db7e90-adbc-48c8-a913-f2c0d90be641 req-2cef8ac2-1d91-4133-9a5f-ed75b97b54b5 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:57.808273 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-80dca8a6-694a-41e7-9cd1-78715204fd6b tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "GET /compute/v2.1/servers/99510c36-821a-41dd-9ffe-8955dda22dcf" status: 200 len: 1307 microversion: 2.1 time: 0.661015 Oct 08 21:08:57.824419 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1961/4010] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:08:57 2022] GET /compute/v2.1/servers/99510c36-821a-41dd-9ffe-8955dda22dcf => generated 1307 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:08:57.826667 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-25db7e90-adbc-48c8-a913-f2c0d90be641 req-2cef8ac2-1d91-4133-9a5f-ed75b97b54b5 service nova] Creating event network-vif-plugged:1900770b-2820-49c0-af24-1c780eb5f1e0 for instance e2548207-aa57-4e4c-876b-2027b59283d2 on nch2-master-1 Oct 08 21:08:57.839353 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-25db7e90-adbc-48c8-a913-f2c0d90be641 req-2cef8ac2-1d91-4133-9a5f-ed75b97b54b5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056216 Oct 08 21:08:57.840412 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2050/4011] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:08:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:08:57.941770 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-dc50cd70-21c8-4e67-add2-38dc73013c4b tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:57.942405 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-dc50cd70-21c8-4e67-add2-38dc73013c4b tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:57.945663 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:08:57.949830 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dc50cd70-21c8-4e67-add2-38dc73013c4b tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:57.950336 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dc50cd70-21c8-4e67-add2-38dc73013c4b tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:57.950789 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dc50cd70-21c8-4e67-add2-38dc73013c4b tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:57.951552 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dc50cd70-21c8-4e67-add2-38dc73013c4b tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:57.952022 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dc50cd70-21c8-4e67-add2-38dc73013c4b tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:57.955074 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dc50cd70-21c8-4e67-add2-38dc73013c4b tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:58.081839 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-9859d7ef-994f-4944-afce-d601a119e302 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:58.083067 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-9859d7ef-994f-4944-afce-d601a119e302 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] [instance: b9e77bd1-3ce0-4f0a-b5ac-8c0ba6caffbb] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:58.090798 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9859d7ef-994f-4944-afce-d601a119e302 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:58.091565 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9859d7ef-994f-4944-afce-d601a119e302 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:58.092083 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9859d7ef-994f-4944-afce-d601a119e302 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:58.092912 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9859d7ef-994f-4944-afce-d601a119e302 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:58.093482 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9859d7ef-994f-4944-afce-d601a119e302 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:58.094133 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9859d7ef-994f-4944-afce-d601a119e302 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:58.152289 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-dc50cd70-21c8-4e67-add2-38dc73013c4b tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:58.160416 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-dc50cd70-21c8-4e67-add2-38dc73013c4b tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 200 len: 1316 microversion: 2.1 time: 0.222731 Oct 08 21:08:58.178071 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1962/4012] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:08:57 2022] GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 1316 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:08:58.344493 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-9859d7ef-994f-4944-afce-d601a119e302 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30fe0e1ffa1040ec85d3c32d8b741c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd0e7c24154409824f96e9e99da357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:58.357895 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-9859d7ef-994f-4944-afce-d601a119e302 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "GET /compute/v2.1/servers/b9e77bd1-3ce0-4f0a-b5ac-8c0ba6caffbb" status: 200 len: 1497 microversion: 2.1 time: 0.280177 Oct 08 21:08:58.369486 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2051/4013] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:08:58 2022] GET /compute/v2.1/servers/b9e77bd1-3ce0-4f0a-b5ac-8c0ba6caffbb => generated 1497 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:08:58.640519 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-907ce258-0880-44a8-90f9-d544eac7adec tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:58.641138 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-907ce258-0880-44a8-90f9-d544eac7adec tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: 3c531611-396a-432b-b42f-dbf60a120a7a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:58.648091 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-907ce258-0880-44a8-90f9-d544eac7adec tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:58.648589 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-907ce258-0880-44a8-90f9-d544eac7adec tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:58.649034 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-907ce258-0880-44a8-90f9-d544eac7adec tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:58.649773 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-907ce258-0880-44a8-90f9-d544eac7adec tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:58.650295 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-907ce258-0880-44a8-90f9-d544eac7adec tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:58.650729 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-907ce258-0880-44a8-90f9-d544eac7adec tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:58.794397 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-8d92eceb-49d6-4ecc-bc5a-4b97ee863fe6 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:58.795447 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-8d92eceb-49d6-4ecc-bc5a-4b97ee863fe6 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] [instance: 1b68ff0f-2dfe-4844-b7ce-556768c5d3e2] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:58.808558 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8d92eceb-49d6-4ecc-bc5a-4b97ee863fe6 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:58.809479 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8d92eceb-49d6-4ecc-bc5a-4b97ee863fe6 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:58.810270 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8d92eceb-49d6-4ecc-bc5a-4b97ee863fe6 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:58.811551 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8d92eceb-49d6-4ecc-bc5a-4b97ee863fe6 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:58.812417 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8d92eceb-49d6-4ecc-bc5a-4b97ee863fe6 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:58.813418 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8d92eceb-49d6-4ecc-bc5a-4b97ee863fe6 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:58.913262 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-907ce258-0880-44a8-90f9-d544eac7adec tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78e9afd772c4de981cac8f5817ec356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765c62cac2ee4406b23a5baa85c52ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:58.921998 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-907ce258-0880-44a8-90f9-d544eac7adec tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/3c531611-396a-432b-b42f-dbf60a120a7a" status: 200 len: 1486 microversion: 2.1 time: 0.285330 Oct 08 21:08:58.922709 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1963/4014] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:08:58 2022] GET /compute/v2.1/servers/3c531611-396a-432b-b42f-dbf60a120a7a => generated 1486 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:08:58.927575 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-a81e4379-6b31-499a-99f7-26eb6f8fd416 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:58.928299 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-a81e4379-6b31-499a-99f7-26eb6f8fd416 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: 99510c36-821a-41dd-9ffe-8955dda22dcf] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:58.937996 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a81e4379-6b31-499a-99f7-26eb6f8fd416 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:58.938773 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a81e4379-6b31-499a-99f7-26eb6f8fd416 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:58.939421 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a81e4379-6b31-499a-99f7-26eb6f8fd416 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:58.940419 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a81e4379-6b31-499a-99f7-26eb6f8fd416 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:58.941073 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a81e4379-6b31-499a-99f7-26eb6f8fd416 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:58.941599 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a81e4379-6b31-499a-99f7-26eb6f8fd416 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:58.964118 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=100 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:08:59.044372 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-8d92eceb-49d6-4ecc-bc5a-4b97ee863fe6 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85abb492492343c58734564a2b26c8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68b14967e8249fd886f168d366f241f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:59.054101 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-8d92eceb-49d6-4ecc-bc5a-4b97ee863fe6 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] 10.222.0.26 "GET /compute/v2.1/servers/1b68ff0f-2dfe-4844-b7ce-556768c5d3e2" status: 200 len: 1362 microversion: 2.1 time: 0.263796 Oct 08 21:08:59.054707 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2052/4015] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:08:58 2022] GET /compute/v2.1/servers/1b68ff0f-2dfe-4844-b7ce-556768c5d3e2 => generated 1362 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:08:59.060383 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-613e8186-9263-44b9-b4c9-076978a2e507 req-371ec58d-f52f-4500-80cc-8b6eebaa415b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b68ff0f-2dfe-4844-b7ce-556768c5d3e2", "tag": "88154834-d566-47ce-bf02-2e28327ec781"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:08:59.072754 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-613e8186-9263-44b9-b4c9-076978a2e507 req-371ec58d-f52f-4500-80cc-8b6eebaa415b service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:59.073530 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-613e8186-9263-44b9-b4c9-076978a2e507 req-371ec58d-f52f-4500-80cc-8b6eebaa415b service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:59.074253 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-613e8186-9263-44b9-b4c9-076978a2e507 req-371ec58d-f52f-4500-80cc-8b6eebaa415b service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:59.109296 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-613e8186-9263-44b9-b4c9-076978a2e507 req-371ec58d-f52f-4500-80cc-8b6eebaa415b service nova] Creating event network-changed:88154834-d566-47ce-bf02-2e28327ec781 for instance 1b68ff0f-2dfe-4844-b7ce-556768c5d3e2 on nch2-master-1 Oct 08 21:08:59.115811 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-613e8186-9263-44b9-b4c9-076978a2e507 req-371ec58d-f52f-4500-80cc-8b6eebaa415b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059044 Oct 08 21:08:59.117024 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2053/4016] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:08:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:08:59.124421 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-bc0ea0ca-311d-4d8b-b29e-3896a4def957 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:59.125228 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-bc0ea0ca-311d-4d8b-b29e-3896a4def957 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: 3c531611-396a-432b-b42f-dbf60a120a7a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:59.133156 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bc0ea0ca-311d-4d8b-b29e-3896a4def957 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:59.134315 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bc0ea0ca-311d-4d8b-b29e-3896a4def957 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:59.135514 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bc0ea0ca-311d-4d8b-b29e-3896a4def957 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:59.136544 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bc0ea0ca-311d-4d8b-b29e-3896a4def957 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:59.137031 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bc0ea0ca-311d-4d8b-b29e-3896a4def957 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:59.137887 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bc0ea0ca-311d-4d8b-b29e-3896a4def957 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:59.152522 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-a81e4379-6b31-499a-99f7-26eb6f8fd416 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06443b5728fb4d1e95d6245820e786bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ded993145b4eda9d6a33b994519012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:59.163676 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-a81e4379-6b31-499a-99f7-26eb6f8fd416 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "GET /compute/v2.1/servers/99510c36-821a-41dd-9ffe-8955dda22dcf" status: 200 len: 1307 microversion: 2.1 time: 0.239700 Oct 08 21:08:59.164406 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1964/4017] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:08:58 2022] GET /compute/v2.1/servers/99510c36-821a-41dd-9ffe-8955dda22dcf => generated 1307 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:08:59.184147 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-bc0ea0ca-311d-4d8b-b29e-3896a4def957 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: 3c531611-396a-432b-b42f-dbf60a120a7a] Going to try to terminate instance {{(pid=140492) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 21:08:59.195580 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-1c8463ad-ab80-4655-977d-9e8ef8fe1d40 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:59.196214 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-1c8463ad-ab80-4655-977d-9e8ef8fe1d40 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:59.215808 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1c8463ad-ab80-4655-977d-9e8ef8fe1d40 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:59.216561 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1c8463ad-ab80-4655-977d-9e8ef8fe1d40 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:59.217161 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1c8463ad-ab80-4655-977d-9e8ef8fe1d40 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:59.218086 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1c8463ad-ab80-4655-977d-9e8ef8fe1d40 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:59.218744 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1c8463ad-ab80-4655-977d-9e8ef8fe1d40 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:59.219360 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1c8463ad-ab80-4655-977d-9e8ef8fe1d40 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:59.308708 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-bc0ea0ca-311d-4d8b-b29e-3896a4def957 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "DELETE /compute/v2.1/servers/3c531611-396a-432b-b42f-dbf60a120a7a" status: 204 len: 0 microversion: 2.1 time: 0.187234 Oct 08 21:08:59.309366 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2054/4018] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:08:59 2022] DELETE /compute/v2.1/servers/3c531611-396a-432b-b42f-dbf60a120a7a => generated 0 bytes in 191 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 21:08:59.324766 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-05c19151-361d-43b3-899d-7f575393a4f7 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:59.325621 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-05c19151-361d-43b3-899d-7f575393a4f7 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: 3c531611-396a-432b-b42f-dbf60a120a7a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:59.334320 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-05c19151-361d-43b3-899d-7f575393a4f7 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:59.334841 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-05c19151-361d-43b3-899d-7f575393a4f7 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:59.335270 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-05c19151-361d-43b3-899d-7f575393a4f7 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:59.335994 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-05c19151-361d-43b3-899d-7f575393a4f7 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:59.336454 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-05c19151-361d-43b3-899d-7f575393a4f7 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:59.336885 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-05c19151-361d-43b3-899d-7f575393a4f7 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:59.438177 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-1c8463ad-ab80-4655-977d-9e8ef8fe1d40 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:59.446598 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-1c8463ad-ab80-4655-977d-9e8ef8fe1d40 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 200 len: 1503 microversion: 2.1 time: 0.260432 Oct 08 21:08:59.447672 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1965/4019] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:08:59 2022] GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 1503 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:08:59.452619 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-e6f198d7-2304-4483-9e8e-bce7cdbd8c63 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:08:59.453308 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-e6f198d7-2304-4483-9e8e-bce7cdbd8c63 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] [instance: b9e77bd1-3ce0-4f0a-b5ac-8c0ba6caffbb] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:08:59.459696 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e6f198d7-2304-4483-9e8e-bce7cdbd8c63 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:59.460504 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e6f198d7-2304-4483-9e8e-bce7cdbd8c63 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:59.461119 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e6f198d7-2304-4483-9e8e-bce7cdbd8c63 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:59.461852 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e6f198d7-2304-4483-9e8e-bce7cdbd8c63 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:08:59.462311 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e6f198d7-2304-4483-9e8e-bce7cdbd8c63 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:08:59.462926 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e6f198d7-2304-4483-9e8e-bce7cdbd8c63 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:08:59.602651 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-e6f198d7-2304-4483-9e8e-bce7cdbd8c63 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30fe0e1ffa1040ec85d3c32d8b741c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd0e7c24154409824f96e9e99da357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:59.611471 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-e6f198d7-2304-4483-9e8e-bce7cdbd8c63 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "GET /compute/v2.1/servers/b9e77bd1-3ce0-4f0a-b5ac-8c0ba6caffbb" status: 200 len: 1497 microversion: 2.1 time: 0.162800 Oct 08 21:08:59.612061 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1966/4020] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:08:59 2022] GET /compute/v2.1/servers/b9e77bd1-3ce0-4f0a-b5ac-8c0ba6caffbb => generated 1497 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:08:59.616665 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-a83c63ac-071e-4008-aacf-5248f6d5057d tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1737463568", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "networks": [{"uuid": "0af78ecb-f6e3-458a-ab57-630925a05ff0"}]}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:08:59.674102 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.network.neutron [None req-a83c63ac-071e-4008-aacf-5248f6d5057d tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] validate_networks() for [('0af78ecb-f6e3-458a-ab57-630925a05ff0', None, None, None, None, None)] {{(pid=140491) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 21:08:59.677665 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-05c19151-361d-43b3-899d-7f575393a4f7 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78e9afd772c4de981cac8f5817ec356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765c62cac2ee4406b23a5baa85c52ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:08:59.689567 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-05c19151-361d-43b3-899d-7f575393a4f7 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/3c531611-396a-432b-b42f-dbf60a120a7a" status: 200 len: 1492 microversion: 2.1 time: 0.373525 Oct 08 21:08:59.693239 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2055/4021] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:08:59 2022] GET /compute/v2.1/servers/3c531611-396a-432b-b42f-dbf60a120a7a => generated 1492 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:09:00.071804 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-a83c63ac-071e-4008-aacf-5248f6d5057d tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Flavor limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 21:09:00.072308 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-a83c63ac-071e-4008-aacf-5248f6d5057d tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Image limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 21:09:00.072775 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-a83c63ac-071e-4008-aacf-5248f6d5057d tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Flavor pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 21:09:00.073220 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-a83c63ac-071e-4008-aacf-5248f6d5057d tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Image pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 21:09:00.073653 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-a83c63ac-071e-4008-aacf-5248f6d5057d tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 21:09:00.081481 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-2112e7ce-0c15-4993-b573-6526746b8530 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:00.082311 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-2112e7ce-0c15-4993-b573-6526746b8530 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] [instance: 1b68ff0f-2dfe-4844-b7ce-556768c5d3e2] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:00.084331 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a83c63ac-071e-4008-aacf-5248f6d5057d tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:00.085099 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a83c63ac-071e-4008-aacf-5248f6d5057d tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:00.085734 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a83c63ac-071e-4008-aacf-5248f6d5057d tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:00.088346 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a83c63ac-071e-4008-aacf-5248f6d5057d tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:00.089279 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a83c63ac-071e-4008-aacf-5248f6d5057d tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:00.090255 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a83c63ac-071e-4008-aacf-5248f6d5057d tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:00.091253 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2112e7ce-0c15-4993-b573-6526746b8530 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:00.091970 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2112e7ce-0c15-4993-b573-6526746b8530 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:00.092501 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2112e7ce-0c15-4993-b573-6526746b8530 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:00.093459 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2112e7ce-0c15-4993-b573-6526746b8530 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:00.094137 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2112e7ce-0c15-4993-b573-6526746b8530 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:00.094781 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2112e7ce-0c15-4993-b573-6526746b8530 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:00.114310 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-a83c63ac-071e-4008-aacf-5248f6d5057d tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Getting quotas for project 0ae02675057e4f27bc1980348afc8ca1. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:09:00.121097 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-a83c63ac-071e-4008-aacf-5248f6d5057d tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Getting quotas for user 6a78d352c143483c8e4702d789d4c516 and project 0ae02675057e4f27bc1980348afc8ca1. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:09:00.135995 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-a83c63ac-071e-4008-aacf-5248f6d5057d tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Going to run 1 instances... {{(pid=140491) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 21:09:00.138766 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-a83c63ac-071e-4008-aacf-5248f6d5057d tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: 89d969cd-5514-4a4d-9c3c-1b408fff2f44] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c508bd7f-7db9-4b2c-af7c-be54a855c355',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140491) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 21:09:00.190404 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-a83c63ac-071e-4008-aacf-5248f6d5057d tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.577265 Oct 08 21:09:00.191080 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1967/4022] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 21:08:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 578 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 08 21:09:00.191080 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-00082886-4a36-4c20-b58e-5dc604ec00cf tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:00.191080 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-00082886-4a36-4c20-b58e-5dc604ec00cf tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: 99510c36-821a-41dd-9ffe-8955dda22dcf] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:00.204884 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-00082886-4a36-4c20-b58e-5dc604ec00cf tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:00.205444 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-00082886-4a36-4c20-b58e-5dc604ec00cf tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:00.205898 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-00082886-4a36-4c20-b58e-5dc604ec00cf tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:00.206625 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-00082886-4a36-4c20-b58e-5dc604ec00cf tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:00.207352 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-00082886-4a36-4c20-b58e-5dc604ec00cf tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:00.207588 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-00082886-4a36-4c20-b58e-5dc604ec00cf tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:00.370002 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-00082886-4a36-4c20-b58e-5dc604ec00cf tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06443b5728fb4d1e95d6245820e786bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ded993145b4eda9d6a33b994519012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:00.380699 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-00082886-4a36-4c20-b58e-5dc604ec00cf tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "GET /compute/v2.1/servers/99510c36-821a-41dd-9ffe-8955dda22dcf" status: 200 len: 1307 microversion: 2.1 time: 0.188504 Oct 08 21:09:00.395239 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1968/4023] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:00 2022] GET /compute/v2.1/servers/99510c36-821a-41dd-9ffe-8955dda22dcf => generated 1307 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:09:00.401880 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-90927ed4-56b7-4f8d-85fe-48c2462cfef2 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:00.402446 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-90927ed4-56b7-4f8d-85fe-48c2462cfef2 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: 89d969cd-5514-4a4d-9c3c-1b408fff2f44] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:00.488749 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-90927ed4-56b7-4f8d-85fe-48c2462cfef2 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:00.500746 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-90927ed4-56b7-4f8d-85fe-48c2462cfef2 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/89d969cd-5514-4a4d-9c3c-1b408fff2f44" status: 200 len: 1217 microversion: 2.1 time: 0.103964 Oct 08 21:09:00.501750 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1969/4024] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:00 2022] GET /compute/v2.1/servers/89d969cd-5514-4a4d-9c3c-1b408fff2f44 => generated 1217 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:09:00.636158 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-e73f725a-a617-47de-8bec-95ba1fd5f684 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:00.636968 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-e73f725a-a617-47de-8bec-95ba1fd5f684 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] [instance: b9e77bd1-3ce0-4f0a-b5ac-8c0ba6caffbb] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:00.644453 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e73f725a-a617-47de-8bec-95ba1fd5f684 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:00.645354 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e73f725a-a617-47de-8bec-95ba1fd5f684 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:00.649768 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e73f725a-a617-47de-8bec-95ba1fd5f684 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:00.651602 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e73f725a-a617-47de-8bec-95ba1fd5f684 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:00.652292 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e73f725a-a617-47de-8bec-95ba1fd5f684 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:00.652959 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e73f725a-a617-47de-8bec-95ba1fd5f684 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:00.855265 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-2112e7ce-0c15-4993-b573-6526746b8530 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85abb492492343c58734564a2b26c8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68b14967e8249fd886f168d366f241f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:00.865022 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-e73f725a-a617-47de-8bec-95ba1fd5f684 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30fe0e1ffa1040ec85d3c32d8b741c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd0e7c24154409824f96e9e99da357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:00.874044 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-2112e7ce-0c15-4993-b573-6526746b8530 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] 10.222.0.26 "GET /compute/v2.1/servers/1b68ff0f-2dfe-4844-b7ce-556768c5d3e2" status: 200 len: 1362 microversion: 2.1 time: 0.796340 Oct 08 21:09:00.875200 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2056/4025] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:00 2022] GET /compute/v2.1/servers/1b68ff0f-2dfe-4844-b7ce-556768c5d3e2 => generated 1362 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:09:00.880254 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-3ef4c6e5-becd-4506-a6af-21dc8fbcfee6 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:00.881043 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-3ef4c6e5-becd-4506-a6af-21dc8fbcfee6 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: 3c531611-396a-432b-b42f-dbf60a120a7a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:00.887759 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3ef4c6e5-becd-4506-a6af-21dc8fbcfee6 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:00.888451 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3ef4c6e5-becd-4506-a6af-21dc8fbcfee6 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:00.889058 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3ef4c6e5-becd-4506-a6af-21dc8fbcfee6 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:00.889949 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3ef4c6e5-becd-4506-a6af-21dc8fbcfee6 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:00.890543 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3ef4c6e5-becd-4506-a6af-21dc8fbcfee6 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:00.891146 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3ef4c6e5-becd-4506-a6af-21dc8fbcfee6 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:00.898879 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-e73f725a-a617-47de-8bec-95ba1fd5f684 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "GET /compute/v2.1/servers/b9e77bd1-3ce0-4f0a-b5ac-8c0ba6caffbb" status: 200 len: 1497 microversion: 2.1 time: 0.266726 Oct 08 21:09:00.915245 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1970/4026] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:00 2022] GET /compute/v2.1/servers/b9e77bd1-3ce0-4f0a-b5ac-8c0ba6caffbb => generated 1497 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:09:00.924942 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-559be438-57fe-4ead-bcd1-edefd6d1cf88 req-1849310c-caef-46bc-abdc-9881f85a3adb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99510c36-821a-41dd-9ffe-8955dda22dcf", "name": "network-vif-plugged", "status": "completed", "tag": "cf2a7b00-139a-477e-aef9-793efed07ce1"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:09:00.935907 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-559be438-57fe-4ead-bcd1-edefd6d1cf88 req-1849310c-caef-46bc-abdc-9881f85a3adb service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:00.937132 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-559be438-57fe-4ead-bcd1-edefd6d1cf88 req-1849310c-caef-46bc-abdc-9881f85a3adb service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:00.937777 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-559be438-57fe-4ead-bcd1-edefd6d1cf88 req-1849310c-caef-46bc-abdc-9881f85a3adb service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:00.953978 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-559be438-57fe-4ead-bcd1-edefd6d1cf88 req-1849310c-caef-46bc-abdc-9881f85a3adb service nova] Creating event network-vif-plugged:cf2a7b00-139a-477e-aef9-793efed07ce1 for instance 99510c36-821a-41dd-9ffe-8955dda22dcf on nch1-master-1 Oct 08 21:09:00.960572 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-559be438-57fe-4ead-bcd1-edefd6d1cf88 req-1849310c-caef-46bc-abdc-9881f85a3adb service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043886 Oct 08 21:09:00.962617 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1971/4027] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:09:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:09:01.405948 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-d9436bb6-42cb-40f9-8dc1-fd46f31b16ba tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:01.407031 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-d9436bb6-42cb-40f9-8dc1-fd46f31b16ba tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: 99510c36-821a-41dd-9ffe-8955dda22dcf] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:01.414650 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d9436bb6-42cb-40f9-8dc1-fd46f31b16ba tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:01.415235 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d9436bb6-42cb-40f9-8dc1-fd46f31b16ba tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:01.415829 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d9436bb6-42cb-40f9-8dc1-fd46f31b16ba tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:01.417148 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d9436bb6-42cb-40f9-8dc1-fd46f31b16ba tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:01.417764 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d9436bb6-42cb-40f9-8dc1-fd46f31b16ba tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:01.418281 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d9436bb6-42cb-40f9-8dc1-fd46f31b16ba tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:01.443420 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-3ef4c6e5-becd-4506-a6af-21dc8fbcfee6 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78e9afd772c4de981cac8f5817ec356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765c62cac2ee4406b23a5baa85c52ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:01.467451 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-3ef4c6e5-becd-4506-a6af-21dc8fbcfee6 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/3c531611-396a-432b-b42f-dbf60a120a7a" status: 200 len: 1492 microversion: 2.1 time: 0.590610 Oct 08 21:09:01.486734 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2057/4028] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:00 2022] GET /compute/v2.1/servers/3c531611-396a-432b-b42f-dbf60a120a7a => generated 1492 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:09:01.527218 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-2eacc54e-b2c7-4026-a5b1-29b8cc4bb18d tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:01.528163 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-2eacc54e-b2c7-4026-a5b1-29b8cc4bb18d tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: 89d969cd-5514-4a4d-9c3c-1b408fff2f44] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:01.540618 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2eacc54e-b2c7-4026-a5b1-29b8cc4bb18d tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:01.542393 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2eacc54e-b2c7-4026-a5b1-29b8cc4bb18d tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:01.545067 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2eacc54e-b2c7-4026-a5b1-29b8cc4bb18d tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:01.546389 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2eacc54e-b2c7-4026-a5b1-29b8cc4bb18d tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:01.547067 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2eacc54e-b2c7-4026-a5b1-29b8cc4bb18d tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:01.547833 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2eacc54e-b2c7-4026-a5b1-29b8cc4bb18d tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:01.619705 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-d9436bb6-42cb-40f9-8dc1-fd46f31b16ba tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06443b5728fb4d1e95d6245820e786bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ded993145b4eda9d6a33b994519012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:01.627545 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-d9436bb6-42cb-40f9-8dc1-fd46f31b16ba tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "GET /compute/v2.1/servers/99510c36-821a-41dd-9ffe-8955dda22dcf" status: 200 len: 1307 microversion: 2.1 time: 0.227176 Oct 08 21:09:01.628130 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1972/4029] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:01 2022] GET /compute/v2.1/servers/99510c36-821a-41dd-9ffe-8955dda22dcf => generated 1307 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:09:01.675955 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-2eacc54e-b2c7-4026-a5b1-29b8cc4bb18d tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:01.684713 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-2eacc54e-b2c7-4026-a5b1-29b8cc4bb18d tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/89d969cd-5514-4a4d-9c3c-1b408fff2f44" status: 200 len: 1269 microversion: 2.1 time: 0.164661 Oct 08 21:09:01.685325 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2058/4030] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:01 2022] GET /compute/v2.1/servers/89d969cd-5514-4a4d-9c3c-1b408fff2f44 => generated 1269 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:09:01.902223 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-ef8b2dda-5688-46ff-87b2-73b1a791998d tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:01.903077 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-ef8b2dda-5688-46ff-87b2-73b1a791998d tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] [instance: 1b68ff0f-2dfe-4844-b7ce-556768c5d3e2] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:01.910222 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ef8b2dda-5688-46ff-87b2-73b1a791998d tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:01.911011 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ef8b2dda-5688-46ff-87b2-73b1a791998d tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:01.912343 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ef8b2dda-5688-46ff-87b2-73b1a791998d tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:01.913319 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ef8b2dda-5688-46ff-87b2-73b1a791998d tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:01.914080 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ef8b2dda-5688-46ff-87b2-73b1a791998d tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:01.914656 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ef8b2dda-5688-46ff-87b2-73b1a791998d tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:01.927643 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e05a266c-c3d3-4c9b-a2df-82875d8e6318 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:01.928259 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-e05a266c-c3d3-4c9b-a2df-82875d8e6318 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] [instance: b9e77bd1-3ce0-4f0a-b5ac-8c0ba6caffbb] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:01.935404 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e05a266c-c3d3-4c9b-a2df-82875d8e6318 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:01.936123 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e05a266c-c3d3-4c9b-a2df-82875d8e6318 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:01.936726 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e05a266c-c3d3-4c9b-a2df-82875d8e6318 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:01.937620 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e05a266c-c3d3-4c9b-a2df-82875d8e6318 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:01.938082 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e05a266c-c3d3-4c9b-a2df-82875d8e6318 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:01.938511 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e05a266c-c3d3-4c9b-a2df-82875d8e6318 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:01.942871 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:09:02.100030 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-ef8b2dda-5688-46ff-87b2-73b1a791998d tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85abb492492343c58734564a2b26c8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68b14967e8249fd886f168d366f241f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:02.110238 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-ef8b2dda-5688-46ff-87b2-73b1a791998d tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] 10.222.0.26 "GET /compute/v2.1/servers/1b68ff0f-2dfe-4844-b7ce-556768c5d3e2" status: 200 len: 1362 microversion: 2.1 time: 0.212535 Oct 08 21:09:02.110877 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1973/4031] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:01 2022] GET /compute/v2.1/servers/1b68ff0f-2dfe-4844-b7ce-556768c5d3e2 => generated 1362 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:09:02.448795 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-e05a266c-c3d3-4c9b-a2df-82875d8e6318 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30fe0e1ffa1040ec85d3c32d8b741c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd0e7c24154409824f96e9e99da357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:02.462177 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-e05a266c-c3d3-4c9b-a2df-82875d8e6318 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "GET /compute/v2.1/servers/b9e77bd1-3ce0-4f0a-b5ac-8c0ba6caffbb" status: 200 len: 1497 microversion: 2.1 time: 0.538812 Oct 08 21:09:02.483089 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2059/4032] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:01 2022] GET /compute/v2.1/servers/b9e77bd1-3ce0-4f0a-b5ac-8c0ba6caffbb => generated 1497 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:09:02.498096 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-9abbce10-ea4f-403b-9d57-da910c824a5e tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:02.499265 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-9abbce10-ea4f-403b-9d57-da910c824a5e tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: 3c531611-396a-432b-b42f-dbf60a120a7a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:02.515264 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9abbce10-ea4f-403b-9d57-da910c824a5e tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:02.517313 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9abbce10-ea4f-403b-9d57-da910c824a5e tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:02.519450 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9abbce10-ea4f-403b-9d57-da910c824a5e tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:02.523463 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9abbce10-ea4f-403b-9d57-da910c824a5e tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:02.524283 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9abbce10-ea4f-403b-9d57-da910c824a5e tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:02.525991 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9abbce10-ea4f-403b-9d57-da910c824a5e tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:02.556708 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-49bd0a4f-dfd1-4e74-b50e-60b1d01013a9 req-ed8041ad-1cf5-4b7c-bf02-8ae57b5b0466 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c531611-396a-432b-b42f-dbf60a120a7a", "name": "network-vif-deleted", "tag": "f12e9484-4347-49a6-883f-9b6e9702db33"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:09:02.571697 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-49bd0a4f-dfd1-4e74-b50e-60b1d01013a9 req-ed8041ad-1cf5-4b7c-bf02-8ae57b5b0466 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:02.573897 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-49bd0a4f-dfd1-4e74-b50e-60b1d01013a9 req-ed8041ad-1cf5-4b7c-bf02-8ae57b5b0466 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:02.576015 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-49bd0a4f-dfd1-4e74-b50e-60b1d01013a9 req-ed8041ad-1cf5-4b7c-bf02-8ae57b5b0466 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:02.602474 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-49bd0a4f-dfd1-4e74-b50e-60b1d01013a9 req-ed8041ad-1cf5-4b7c-bf02-8ae57b5b0466 service nova] Creating event network-vif-deleted:f12e9484-4347-49a6-883f-9b6e9702db33 for instance 3c531611-396a-432b-b42f-dbf60a120a7a on nch1-master-1 Oct 08 21:09:02.628194 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-49bd0a4f-dfd1-4e74-b50e-60b1d01013a9 req-ed8041ad-1cf5-4b7c-bf02-8ae57b5b0466 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078632 Oct 08 21:09:02.629595 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2060/4033] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:09:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Oct 08 21:09:02.654037 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-97f75de1-db08-41f5-a4ec-28e7415222c1 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:02.654992 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-97f75de1-db08-41f5-a4ec-28e7415222c1 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: 99510c36-821a-41dd-9ffe-8955dda22dcf] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:02.669417 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-9abbce10-ea4f-403b-9d57-da910c824a5e tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78e9afd772c4de981cac8f5817ec356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765c62cac2ee4406b23a5baa85c52ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:02.678576 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-9abbce10-ea4f-403b-9d57-da910c824a5e tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/3c531611-396a-432b-b42f-dbf60a120a7a" status: 200 len: 1450 microversion: 2.1 time: 0.185473 Oct 08 21:09:02.681222 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-97f75de1-db08-41f5-a4ec-28e7415222c1 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:02.682142 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1974/4034] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:02 2022] GET /compute/v2.1/servers/3c531611-396a-432b-b42f-dbf60a120a7a => generated 1450 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:09:02.695055 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-97f75de1-db08-41f5-a4ec-28e7415222c1 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:02.695742 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-97f75de1-db08-41f5-a4ec-28e7415222c1 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:02.700949 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-97f75de1-db08-41f5-a4ec-28e7415222c1 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:02.701856 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-97f75de1-db08-41f5-a4ec-28e7415222c1 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:02.702605 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-97f75de1-db08-41f5-a4ec-28e7415222c1 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:02.712492 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-4b1a8994-e77a-4685-a46a-50e0ffb4e5c9 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:02.713981 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-4b1a8994-e77a-4685-a46a-50e0ffb4e5c9 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: 89d969cd-5514-4a4d-9c3c-1b408fff2f44] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:02.726148 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4b1a8994-e77a-4685-a46a-50e0ffb4e5c9 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:02.726948 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4b1a8994-e77a-4685-a46a-50e0ffb4e5c9 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:02.729678 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4b1a8994-e77a-4685-a46a-50e0ffb4e5c9 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:02.730676 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4b1a8994-e77a-4685-a46a-50e0ffb4e5c9 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:02.736423 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4b1a8994-e77a-4685-a46a-50e0ffb4e5c9 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:02.737204 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4b1a8994-e77a-4685-a46a-50e0ffb4e5c9 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:02.830446 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-4b1a8994-e77a-4685-a46a-50e0ffb4e5c9 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:02.841773 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-4b1a8994-e77a-4685-a46a-50e0ffb4e5c9 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/89d969cd-5514-4a4d-9c3c-1b408fff2f44" status: 200 len: 1277 microversion: 2.1 time: 0.137007 Oct 08 21:09:02.842738 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1975/4035] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:02 2022] GET /compute/v2.1/servers/89d969cd-5514-4a4d-9c3c-1b408fff2f44 => generated 1277 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:09:03.091317 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-97f75de1-db08-41f5-a4ec-28e7415222c1 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06443b5728fb4d1e95d6245820e786bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ded993145b4eda9d6a33b994519012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:03.102342 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-97f75de1-db08-41f5-a4ec-28e7415222c1 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "GET /compute/v2.1/servers/99510c36-821a-41dd-9ffe-8955dda22dcf" status: 200 len: 1488 microversion: 2.1 time: 0.454713 Oct 08 21:09:03.104140 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2061/4036] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:02 2022] GET /compute/v2.1/servers/99510c36-821a-41dd-9ffe-8955dda22dcf => generated 1488 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:09:03.127964 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-6295e390-14b3-46b4-8ad8-27ff9f43046f tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-340858664"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:09:03.131179 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-6295e390-14b3-46b4-8ad8-27ff9f43046f tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: 99510c36-821a-41dd-9ffe-8955dda22dcf] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:03.134874 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-c9d70345-a2bb-4c63-bd1f-8412e38241ff tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:03.135741 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-c9d70345-a2bb-4c63-bd1f-8412e38241ff tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] [instance: 1b68ff0f-2dfe-4844-b7ce-556768c5d3e2] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:03.143188 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6295e390-14b3-46b4-8ad8-27ff9f43046f tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:03.143545 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c9d70345-a2bb-4c63-bd1f-8412e38241ff tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:03.143673 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6295e390-14b3-46b4-8ad8-27ff9f43046f tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:03.144127 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6295e390-14b3-46b4-8ad8-27ff9f43046f tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:03.144692 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c9d70345-a2bb-4c63-bd1f-8412e38241ff tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:03.144909 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6295e390-14b3-46b4-8ad8-27ff9f43046f tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:03.145566 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6295e390-14b3-46b4-8ad8-27ff9f43046f tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:03.146078 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c9d70345-a2bb-4c63-bd1f-8412e38241ff tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:03.146302 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6295e390-14b3-46b4-8ad8-27ff9f43046f tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:03.147210 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c9d70345-a2bb-4c63-bd1f-8412e38241ff tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:03.148637 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c9d70345-a2bb-4c63-bd1f-8412e38241ff tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:03.149317 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c9d70345-a2bb-4c63-bd1f-8412e38241ff tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:03.261260 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-6295e390-14b3-46b4-8ad8-27ff9f43046f tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "PUT /compute/v2.1/servers/99510c36-821a-41dd-9ffe-8955dda22dcf" status: 200 len: 1074 microversion: 2.1 time: 0.139228 Oct 08 21:09:03.273408 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1976/4037] 10.222.0.26 () {60 vars in 1256 bytes} [Sat Oct 8 21:09:03 2022] PUT /compute/v2.1/servers/99510c36-821a-41dd-9ffe-8955dda22dcf => generated 1074 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:09:03.282315 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-bb9c4e20-34da-4e73-80f6-4dc52a30c4aa tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:03.283093 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-bb9c4e20-34da-4e73-80f6-4dc52a30c4aa tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: 99510c36-821a-41dd-9ffe-8955dda22dcf] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:03.290819 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bb9c4e20-34da-4e73-80f6-4dc52a30c4aa tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:03.290819 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bb9c4e20-34da-4e73-80f6-4dc52a30c4aa tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:03.290819 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bb9c4e20-34da-4e73-80f6-4dc52a30c4aa tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:03.291668 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bb9c4e20-34da-4e73-80f6-4dc52a30c4aa tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:03.292145 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bb9c4e20-34da-4e73-80f6-4dc52a30c4aa tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:03.292588 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bb9c4e20-34da-4e73-80f6-4dc52a30c4aa tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:03.463724 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-bb9c4e20-34da-4e73-80f6-4dc52a30c4aa tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06443b5728fb4d1e95d6245820e786bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ded993145b4eda9d6a33b994519012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:03.472431 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-bb9c4e20-34da-4e73-80f6-4dc52a30c4aa tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "GET /compute/v2.1/servers/99510c36-821a-41dd-9ffe-8955dda22dcf" status: 200 len: 1500 microversion: 2.1 time: 0.194213 Oct 08 21:09:03.497721 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1977/4038] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:03 2022] GET /compute/v2.1/servers/99510c36-821a-41dd-9ffe-8955dda22dcf => generated 1500 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:09:03.504116 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-945b3ee2-9001-4d5a-a8bc-aedf86139732 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:03.505434 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-945b3ee2-9001-4d5a-a8bc-aedf86139732 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] [instance: b9e77bd1-3ce0-4f0a-b5ac-8c0ba6caffbb] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:03.507127 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-c9d70345-a2bb-4c63-bd1f-8412e38241ff tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85abb492492343c58734564a2b26c8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68b14967e8249fd886f168d366f241f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:03.516424 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-945b3ee2-9001-4d5a-a8bc-aedf86139732 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:03.517220 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-945b3ee2-9001-4d5a-a8bc-aedf86139732 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:03.518415 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-945b3ee2-9001-4d5a-a8bc-aedf86139732 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:03.519349 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-945b3ee2-9001-4d5a-a8bc-aedf86139732 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:03.520118 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-945b3ee2-9001-4d5a-a8bc-aedf86139732 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:03.520763 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-945b3ee2-9001-4d5a-a8bc-aedf86139732 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:03.522002 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-c9d70345-a2bb-4c63-bd1f-8412e38241ff tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] 10.222.0.26 "GET /compute/v2.1/servers/1b68ff0f-2dfe-4844-b7ce-556768c5d3e2" status: 200 len: 1362 microversion: 2.1 time: 0.392330 Oct 08 21:09:03.522613 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2062/4039] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:03 2022] GET /compute/v2.1/servers/1b68ff0f-2dfe-4844-b7ce-556768c5d3e2 => generated 1362 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:09:03.534193 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-a1319f95-cb73-4727-9bcc-92013a03a81a tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:03.534816 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-a1319f95-cb73-4727-9bcc-92013a03a81a tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: 99510c36-821a-41dd-9ffe-8955dda22dcf] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:03.543565 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a1319f95-cb73-4727-9bcc-92013a03a81a tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:03.544072 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a1319f95-cb73-4727-9bcc-92013a03a81a tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:03.546915 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a1319f95-cb73-4727-9bcc-92013a03a81a tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:03.548346 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a1319f95-cb73-4727-9bcc-92013a03a81a tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:03.548820 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a1319f95-cb73-4727-9bcc-92013a03a81a tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:03.549505 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a1319f95-cb73-4727-9bcc-92013a03a81a tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:03.683901 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-945b3ee2-9001-4d5a-a8bc-aedf86139732 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30fe0e1ffa1040ec85d3c32d8b741c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd0e7c24154409824f96e9e99da357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:03.694480 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-945b3ee2-9001-4d5a-a8bc-aedf86139732 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "GET /compute/v2.1/servers/b9e77bd1-3ce0-4f0a-b5ac-8c0ba6caffbb" status: 200 len: 1497 microversion: 2.1 time: 0.195395 Oct 08 21:09:03.707959 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1978/4040] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:03 2022] GET /compute/v2.1/servers/b9e77bd1-3ce0-4f0a-b5ac-8c0ba6caffbb => generated 1497 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:09:03.716545 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-9c0ce41e-850a-4d2a-bbfb-7f8cda781694 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:03.717301 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-9c0ce41e-850a-4d2a-bbfb-7f8cda781694 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: 3c531611-396a-432b-b42f-dbf60a120a7a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:03.726202 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9c0ce41e-850a-4d2a-bbfb-7f8cda781694 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:03.726781 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9c0ce41e-850a-4d2a-bbfb-7f8cda781694 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:03.727628 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9c0ce41e-850a-4d2a-bbfb-7f8cda781694 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:03.728872 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9c0ce41e-850a-4d2a-bbfb-7f8cda781694 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:03.729480 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9c0ce41e-850a-4d2a-bbfb-7f8cda781694 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:03.730009 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9c0ce41e-850a-4d2a-bbfb-7f8cda781694 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:03.747563 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-9c0ce41e-850a-4d2a-bbfb-7f8cda781694 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] HTTP exception thrown: Instance 3c531611-396a-432b-b42f-dbf60a120a7a could not be found. Oct 08 21:09:03.749496 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-9c0ce41e-850a-4d2a-bbfb-7f8cda781694 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Request method failure captured: Oct 08 21:09:03.749496 ncdv-master-1 devstack@n-api.service[140491]: request: GET /compute/v2.1/servers/3c531611-396a-432b-b42f-dbf60a120a7a HTTP/1.1 Oct 08 21:09:03.749496 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:09:03.749496 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:09:03.749496 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:09:03.749496 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 21:09:03.749496 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:09:03.749496 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:09:03.749496 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:09:03.749496 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:09:03.749496 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeaY45CCffIT40Amc9wEG1L3srTtCd58z19KxF0fYIwNPulOEB6B0U5KbwvP4xZlDymYa3r7NupuSBl7IoxTUgzZohPJnXbaXnL_FvPvzvmymW0IMjU5l88HUbi73sOE2TxCcEBd6artojZxtGFF9N7yzN3dTHpujcvoWiRD4lXAI28 Oct 08 21:09:03.749496 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:09:03.749496 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:09:03.749496 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:09:03.749496 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:09:03.749496 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:09:03.749496 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:09:03.749496 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 765c62cac2ee4406b23a5baa85c52ff7 Oct 08 21:09:03.749496 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-DeleteServersTestJSON-1423663413 Oct 08 21:09:03.749496 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:09:03.749496 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:09:03.749496 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/765c62cac2ee4406b23a5baa85c52ff7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/765c62cac2ee4406b23a5baa85c52ff7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_765c62cac2ee4406b23a5baa85c52ff7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/765c62cac2ee4406b23a5baa85c52ff7"}]}] Oct 08 21:09:03.749496 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-DeleteServersTestJSON-1423663413 Oct 08 21:09:03.749496 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 765c62cac2ee4406b23a5baa85c52ff7 Oct 08 21:09:03.749496 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-DeleteServersTestJSON-1423663413 Oct 08 21:09:03.749496 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-DeleteServersTestJSON-1423663413-project Oct 08 21:09:03.749496 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:09:03.749496 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:09:03.749496 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: d78e9afd772c4de981cac8f5817ec356 Oct 08 21:09:03.749496 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-DeleteServersTestJSON-1423663413-project Oct 08 21:09:03.749496 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:09:03.749496 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance 3c531611-396a-432b-b42f-dbf60a120a7a could not be found. Oct 08 21:09:03.749496 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': '3c531611-396a-432b-b42f-dbf60a120a7a'} Oct 08 21:09:03.749496 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:09:03.749496 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:09:03.749496 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:09:03.749496 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:09:03.749496 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:09:03.749496 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:09:03.749496 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:09:03.749496 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:09:03.749496 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:09:03.749496 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:09:03.749496 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c531611-396a-432b-b42f-dbf60a120a7a could not be found. Oct 08 21:09:03.749496 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:09:03.749496 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:09:03.749496 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:09:03.749496 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:09:03.749496 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:09:03.749496 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:09:03.749496 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:09:03.749496 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:09:03.749496 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:09:03.749496 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:09:03.749496 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:09:03.749496 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:09:03.749496 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:09:03.749496 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:09:03.749496 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:09:03.749496 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:09:03.749496 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c531611-396a-432b-b42f-dbf60a120a7a could not be found. Oct 08 21:09:03.749496 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:09:03.749496 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:09:03.749496 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:09:03.753048 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:09:03.753048 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:09:03.753048 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:09:03.753048 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:09:03.753048 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:09:03.753048 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c531611-396a-432b-b42f-dbf60a120a7a could not be found. Oct 08 21:09:03.753048 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:09:03.753048 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-9c0ce41e-850a-4d2a-bbfb-7f8cda781694 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Returning 404 to user: Instance 3c531611-396a-432b-b42f-dbf60a120a7a could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:09:03.753048 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-9c0ce41e-850a-4d2a-bbfb-7f8cda781694 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/3c531611-396a-432b-b42f-dbf60a120a7a" status: 404 len: 111 microversion: 2.1 time: 0.041177 Oct 08 21:09:03.755215 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1979/4041] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:03 2022] GET /compute/v2.1/servers/3c531611-396a-432b-b42f-dbf60a120a7a => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:09:03.814028 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-3b0725e0-7bf9-4c82-bb3a-9bc501b6e606 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-714690816", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "networks": [{"uuid": "82d56471-f1e9-4dc0-935a-29f2f2d2c7c0"}]}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:09:03.869362 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.network.neutron [None req-3b0725e0-7bf9-4c82-bb3a-9bc501b6e606 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] validate_networks() for [('82d56471-f1e9-4dc0-935a-29f2f2d2c7c0', None, None, None, None, None)] {{(pid=140491) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 21:09:03.917307 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-a1319f95-cb73-4727-9bcc-92013a03a81a tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06443b5728fb4d1e95d6245820e786bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ded993145b4eda9d6a33b994519012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:03.926008 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-a1319f95-cb73-4727-9bcc-92013a03a81a tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "GET /compute/v2.1/servers/99510c36-821a-41dd-9ffe-8955dda22dcf" status: 200 len: 1500 microversion: 2.1 time: 0.402372 Oct 08 21:09:03.926747 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2063/4042] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:03 2022] GET /compute/v2.1/servers/99510c36-821a-41dd-9ffe-8955dda22dcf => generated 1500 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:09:03.931930 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-7ad04b5a-b976-45ea-99a6-e1bf61fad03d tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:03.932902 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-7ad04b5a-b976-45ea-99a6-e1bf61fad03d tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: 89d969cd-5514-4a4d-9c3c-1b408fff2f44] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:03.940530 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7ad04b5a-b976-45ea-99a6-e1bf61fad03d tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:03.941162 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7ad04b5a-b976-45ea-99a6-e1bf61fad03d tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:03.941825 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7ad04b5a-b976-45ea-99a6-e1bf61fad03d tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:03.942807 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7ad04b5a-b976-45ea-99a6-e1bf61fad03d tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:03.943385 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7ad04b5a-b976-45ea-99a6-e1bf61fad03d tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:03.944108 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7ad04b5a-b976-45ea-99a6-e1bf61fad03d tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:04.059473 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-7ad04b5a-b976-45ea-99a6-e1bf61fad03d tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:04.088595 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-7ad04b5a-b976-45ea-99a6-e1bf61fad03d tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/89d969cd-5514-4a4d-9c3c-1b408fff2f44" status: 200 len: 1275 microversion: 2.1 time: 0.159350 Oct 08 21:09:04.089239 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2064/4043] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:03 2022] GET /compute/v2.1/servers/89d969cd-5514-4a4d-9c3c-1b408fff2f44 => generated 1275 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:09:04.115405 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-55a951f4-8d43-4839-9b71-1a0615a1948b tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:09:04.123506 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:09:04.125866 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-55a951f4-8d43-4839-9b71-1a0615a1948b tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:04.126625 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-55a951f4-8d43-4839-9b71-1a0615a1948b tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:04.127241 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-55a951f4-8d43-4839-9b71-1a0615a1948b tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:04.160682 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-55a951f4-8d43-4839-9b71-1a0615a1948b tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: 99510c36-821a-41dd-9ffe-8955dda22dcf] Going to try to stop instance {{(pid=140492) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 08 21:09:04.231421 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-55a951f4-8d43-4839-9b71-1a0615a1948b tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "POST /compute/v2.1/servers/99510c36-821a-41dd-9ffe-8955dda22dcf/action" status: 202 len: 0 microversion: 2.1 time: 0.124625 Oct 08 21:09:04.232032 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2065/4044] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:09:04 2022] POST /compute/v2.1/servers/99510c36-821a-41dd-9ffe-8955dda22dcf/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 21:09:04.257683 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-9a93a0d1-7712-4a95-b335-e3d3fe1be156 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:04.258753 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-9a93a0d1-7712-4a95-b335-e3d3fe1be156 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: 99510c36-821a-41dd-9ffe-8955dda22dcf] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:04.267181 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9a93a0d1-7712-4a95-b335-e3d3fe1be156 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:04.269438 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9a93a0d1-7712-4a95-b335-e3d3fe1be156 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:04.270268 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9a93a0d1-7712-4a95-b335-e3d3fe1be156 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:04.271178 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9a93a0d1-7712-4a95-b335-e3d3fe1be156 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:04.271854 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9a93a0d1-7712-4a95-b335-e3d3fe1be156 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:04.272443 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9a93a0d1-7712-4a95-b335-e3d3fe1be156 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:04.389119 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-3b0725e0-7bf9-4c82-bb3a-9bc501b6e606 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Flavor limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 21:09:04.389580 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-3b0725e0-7bf9-4c82-bb3a-9bc501b6e606 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Image limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 21:09:04.390059 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-3b0725e0-7bf9-4c82-bb3a-9bc501b6e606 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Flavor pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 21:09:04.390475 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-3b0725e0-7bf9-4c82-bb3a-9bc501b6e606 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Image pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 21:09:04.390895 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-3b0725e0-7bf9-4c82-bb3a-9bc501b6e606 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 21:09:04.400728 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3b0725e0-7bf9-4c82-bb3a-9bc501b6e606 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:04.401244 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3b0725e0-7bf9-4c82-bb3a-9bc501b6e606 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:04.401688 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3b0725e0-7bf9-4c82-bb3a-9bc501b6e606 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:04.402418 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3b0725e0-7bf9-4c82-bb3a-9bc501b6e606 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:04.402879 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3b0725e0-7bf9-4c82-bb3a-9bc501b6e606 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:04.403306 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3b0725e0-7bf9-4c82-bb3a-9bc501b6e606 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:04.421591 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-3b0725e0-7bf9-4c82-bb3a-9bc501b6e606 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Getting quotas for project 765c62cac2ee4406b23a5baa85c52ff7. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:09:04.427324 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-3b0725e0-7bf9-4c82-bb3a-9bc501b6e606 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Getting quotas for user d78e9afd772c4de981cac8f5817ec356 and project 765c62cac2ee4406b23a5baa85c52ff7. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:09:04.442393 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-3b0725e0-7bf9-4c82-bb3a-9bc501b6e606 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Going to run 1 instances... {{(pid=140491) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 21:09:04.444759 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-3b0725e0-7bf9-4c82-bb3a-9bc501b6e606 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: ba5cd412-0d20-4d2e-9f5e-de18f268008a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c508bd7f-7db9-4b2c-af7c-be54a855c355',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140491) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 21:09:04.495900 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-3b0725e0-7bf9-4c82-bb3a-9bc501b6e606 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.686025 Oct 08 21:09:04.496779 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1980/4045] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 21:09:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 688 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 08 21:09:04.508815 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-43a73c30-0bff-4f8f-9fd3-6271beba559b tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:04.509629 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-43a73c30-0bff-4f8f-9fd3-6271beba559b tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: ba5cd412-0d20-4d2e-9f5e-de18f268008a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:04.592250 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-43a73c30-0bff-4f8f-9fd3-6271beba559b tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78e9afd772c4de981cac8f5817ec356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765c62cac2ee4406b23a5baa85c52ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:04.600627 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-43a73c30-0bff-4f8f-9fd3-6271beba559b tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/ba5cd412-0d20-4d2e-9f5e-de18f268008a" status: 200 len: 1214 microversion: 2.1 time: 0.096273 Oct 08 21:09:04.609659 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1981/4046] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:04 2022] GET /compute/v2.1/servers/ba5cd412-0d20-4d2e-9f5e-de18f268008a => generated 1214 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:09:04.620402 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-eb44db2f-1d81-4d01-8979-7a2a6f1cf0fb tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:04.621307 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-eb44db2f-1d81-4d01-8979-7a2a6f1cf0fb tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] [instance: 1b68ff0f-2dfe-4844-b7ce-556768c5d3e2] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:04.630957 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-eb44db2f-1d81-4d01-8979-7a2a6f1cf0fb tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:04.631501 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-eb44db2f-1d81-4d01-8979-7a2a6f1cf0fb tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:04.631951 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-eb44db2f-1d81-4d01-8979-7a2a6f1cf0fb tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:04.632679 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-eb44db2f-1d81-4d01-8979-7a2a6f1cf0fb tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:04.633233 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-eb44db2f-1d81-4d01-8979-7a2a6f1cf0fb tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:04.633691 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-eb44db2f-1d81-4d01-8979-7a2a6f1cf0fb tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:04.695636 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-9a93a0d1-7712-4a95-b335-e3d3fe1be156 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06443b5728fb4d1e95d6245820e786bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ded993145b4eda9d6a33b994519012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:04.704300 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-9a93a0d1-7712-4a95-b335-e3d3fe1be156 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "GET /compute/v2.1/servers/99510c36-821a-41dd-9ffe-8955dda22dcf" status: 200 len: 1510 microversion: 2.1 time: 0.455888 Oct 08 21:09:04.704911 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2066/4047] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:04 2022] GET /compute/v2.1/servers/99510c36-821a-41dd-9ffe-8955dda22dcf => generated 1510 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:09:04.722443 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e97ca52c-ecca-46c2-873d-967228bfbe8a tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:04.723547 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-e97ca52c-ecca-46c2-873d-967228bfbe8a tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] [instance: b9e77bd1-3ce0-4f0a-b5ac-8c0ba6caffbb] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:04.734749 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e97ca52c-ecca-46c2-873d-967228bfbe8a tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:04.735193 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e97ca52c-ecca-46c2-873d-967228bfbe8a tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:04.735638 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e97ca52c-ecca-46c2-873d-967228bfbe8a tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:04.736356 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e97ca52c-ecca-46c2-873d-967228bfbe8a tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:04.736817 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e97ca52c-ecca-46c2-873d-967228bfbe8a tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:04.737267 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e97ca52c-ecca-46c2-873d-967228bfbe8a tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:04.872943 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-eb44db2f-1d81-4d01-8979-7a2a6f1cf0fb tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85abb492492343c58734564a2b26c8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68b14967e8249fd886f168d366f241f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:04.883347 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-eb44db2f-1d81-4d01-8979-7a2a6f1cf0fb tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] 10.222.0.26 "GET /compute/v2.1/servers/1b68ff0f-2dfe-4844-b7ce-556768c5d3e2" status: 200 len: 1362 microversion: 2.1 time: 0.270861 Oct 08 21:09:04.884169 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1982/4048] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:04 2022] GET /compute/v2.1/servers/1b68ff0f-2dfe-4844-b7ce-556768c5d3e2 => generated 1362 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:09:05.019763 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=2 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:09:05.041373 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=6 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:09:05.114960 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-2a79d6c2-d23a-4043-b17a-f8188b67d6f6 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:05.115607 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-2a79d6c2-d23a-4043-b17a-f8188b67d6f6 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: 89d969cd-5514-4a4d-9c3c-1b408fff2f44] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:05.128912 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2a79d6c2-d23a-4043-b17a-f8188b67d6f6 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:05.129535 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2a79d6c2-d23a-4043-b17a-f8188b67d6f6 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:05.129998 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2a79d6c2-d23a-4043-b17a-f8188b67d6f6 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:05.130726 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2a79d6c2-d23a-4043-b17a-f8188b67d6f6 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:05.131218 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2a79d6c2-d23a-4043-b17a-f8188b67d6f6 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:05.131662 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2a79d6c2-d23a-4043-b17a-f8188b67d6f6 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:05.133213 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-e97ca52c-ecca-46c2-873d-967228bfbe8a tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30fe0e1ffa1040ec85d3c32d8b741c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd0e7c24154409824f96e9e99da357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:05.146531 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-e97ca52c-ecca-46c2-873d-967228bfbe8a tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "GET /compute/v2.1/servers/b9e77bd1-3ce0-4f0a-b5ac-8c0ba6caffbb" status: 200 len: 1497 microversion: 2.1 time: 0.431092 Oct 08 21:09:05.167513 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2067/4049] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:04 2022] GET /compute/v2.1/servers/b9e77bd1-3ce0-4f0a-b5ac-8c0ba6caffbb => generated 1497 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:09:05.394548 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-2a79d6c2-d23a-4043-b17a-f8188b67d6f6 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:05.407937 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-2a79d6c2-d23a-4043-b17a-f8188b67d6f6 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/89d969cd-5514-4a4d-9c3c-1b408fff2f44" status: 200 len: 1317 microversion: 2.1 time: 0.296649 Oct 08 21:09:05.408914 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1983/4050] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:05 2022] GET /compute/v2.1/servers/89d969cd-5514-4a4d-9c3c-1b408fff2f44 => generated 1317 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:09:05.624333 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-62f02b47-a6ca-40b5-953c-0bb45fd5f885 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:05.624973 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-62f02b47-a6ca-40b5-953c-0bb45fd5f885 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: ba5cd412-0d20-4d2e-9f5e-de18f268008a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:05.639179 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-62f02b47-a6ca-40b5-953c-0bb45fd5f885 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:05.639913 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-62f02b47-a6ca-40b5-953c-0bb45fd5f885 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:05.640703 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-62f02b47-a6ca-40b5-953c-0bb45fd5f885 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:05.641932 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-62f02b47-a6ca-40b5-953c-0bb45fd5f885 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:05.642602 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-62f02b47-a6ca-40b5-953c-0bb45fd5f885 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:05.643296 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-62f02b47-a6ca-40b5-953c-0bb45fd5f885 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:05.726919 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-62f02b47-a6ca-40b5-953c-0bb45fd5f885 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78e9afd772c4de981cac8f5817ec356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765c62cac2ee4406b23a5baa85c52ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:05.731327 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-142944b9-73e0-4e15-a8ae-f5d6573405d0 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:05.731971 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-142944b9-73e0-4e15-a8ae-f5d6573405d0 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: 99510c36-821a-41dd-9ffe-8955dda22dcf] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:05.739329 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-62f02b47-a6ca-40b5-953c-0bb45fd5f885 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/ba5cd412-0d20-4d2e-9f5e-de18f268008a" status: 200 len: 1266 microversion: 2.1 time: 0.119450 Oct 08 21:09:05.740497 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-142944b9-73e0-4e15-a8ae-f5d6573405d0 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:05.741138 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-142944b9-73e0-4e15-a8ae-f5d6573405d0 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:05.741972 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2068/4051] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:05 2022] GET /compute/v2.1/servers/ba5cd412-0d20-4d2e-9f5e-de18f268008a => generated 1266 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:09:05.747010 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-142944b9-73e0-4e15-a8ae-f5d6573405d0 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:05.748021 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-142944b9-73e0-4e15-a8ae-f5d6573405d0 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:05.748661 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-142944b9-73e0-4e15-a8ae-f5d6573405d0 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:05.749288 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-142944b9-73e0-4e15-a8ae-f5d6573405d0 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:05.809786 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-718a27c2-82ed-4ddd-8ec6-c1a990a02a63 req-587e76e8-005c-4a77-9cf8-260906c6e9ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b68ff0f-2dfe-4844-b7ce-556768c5d3e2", "name": "network-vif-plugged", "status": "completed", "tag": "88154834-d566-47ce-bf02-2e28327ec781"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:09:05.826251 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-718a27c2-82ed-4ddd-8ec6-c1a990a02a63 req-587e76e8-005c-4a77-9cf8-260906c6e9ad service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:05.826994 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-718a27c2-82ed-4ddd-8ec6-c1a990a02a63 req-587e76e8-005c-4a77-9cf8-260906c6e9ad service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:05.827665 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-718a27c2-82ed-4ddd-8ec6-c1a990a02a63 req-587e76e8-005c-4a77-9cf8-260906c6e9ad service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:05.842724 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-718a27c2-82ed-4ddd-8ec6-c1a990a02a63 req-587e76e8-005c-4a77-9cf8-260906c6e9ad service nova] Creating event network-vif-plugged:88154834-d566-47ce-bf02-2e28327ec781 for instance 1b68ff0f-2dfe-4844-b7ce-556768c5d3e2 on nch2-master-1 Oct 08 21:09:05.851890 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-718a27c2-82ed-4ddd-8ec6-c1a990a02a63 req-587e76e8-005c-4a77-9cf8-260906c6e9ad service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048313 Oct 08 21:09:05.852745 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2069/4052] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:09:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 08 21:09:05.912747 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-c3d14047-3019-4e69-a50e-67feba56943d tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:05.913805 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-c3d14047-3019-4e69-a50e-67feba56943d tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] [instance: 1b68ff0f-2dfe-4844-b7ce-556768c5d3e2] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:05.928711 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c3d14047-3019-4e69-a50e-67feba56943d tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:05.929252 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c3d14047-3019-4e69-a50e-67feba56943d tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:05.929876 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c3d14047-3019-4e69-a50e-67feba56943d tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:05.930598 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c3d14047-3019-4e69-a50e-67feba56943d tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:05.931256 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c3d14047-3019-4e69-a50e-67feba56943d tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:05.931695 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c3d14047-3019-4e69-a50e-67feba56943d tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:06.017861 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-142944b9-73e0-4e15-a8ae-f5d6573405d0 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06443b5728fb4d1e95d6245820e786bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ded993145b4eda9d6a33b994519012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:06.029105 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-142944b9-73e0-4e15-a8ae-f5d6573405d0 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "GET /compute/v2.1/servers/99510c36-821a-41dd-9ffe-8955dda22dcf" status: 200 len: 1510 microversion: 2.1 time: 0.302135 Oct 08 21:09:06.031985 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1984/4053] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:05 2022] GET /compute/v2.1/servers/99510c36-821a-41dd-9ffe-8955dda22dcf => generated 1510 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:09:06.042187 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-c6cb3167-5f45-4b20-b47a-37eb38fa8028 req-6944e435-d274-4f04-8d8f-dd1919df90f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89d969cd-5514-4a4d-9c3c-1b408fff2f44", "tag": "96594cb2-dc29-4cce-9364-8fca3f454e94"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:09:06.066930 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-c6cb3167-5f45-4b20-b47a-37eb38fa8028 req-6944e435-d274-4f04-8d8f-dd1919df90f3 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:06.067433 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-c6cb3167-5f45-4b20-b47a-37eb38fa8028 req-6944e435-d274-4f04-8d8f-dd1919df90f3 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:06.070429 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-c6cb3167-5f45-4b20-b47a-37eb38fa8028 req-6944e435-d274-4f04-8d8f-dd1919df90f3 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:06.078781 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:09:06.087382 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-c6cb3167-5f45-4b20-b47a-37eb38fa8028 req-6944e435-d274-4f04-8d8f-dd1919df90f3 service nova] Creating event network-changed:96594cb2-dc29-4cce-9364-8fca3f454e94 for instance 89d969cd-5514-4a4d-9c3c-1b408fff2f44 on nch1-master-1 Oct 08 21:09:06.095633 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-c6cb3167-5f45-4b20-b47a-37eb38fa8028 req-6944e435-d274-4f04-8d8f-dd1919df90f3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062381 Oct 08 21:09:06.096645 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1985/4054] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:09:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:09:06.173729 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-6e26b3ff-758b-4143-a56c-bab343cd296c tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:06.174776 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-6e26b3ff-758b-4143-a56c-bab343cd296c tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] [instance: b9e77bd1-3ce0-4f0a-b5ac-8c0ba6caffbb] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:06.182046 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6e26b3ff-758b-4143-a56c-bab343cd296c tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:06.182545 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6e26b3ff-758b-4143-a56c-bab343cd296c tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:06.183167 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6e26b3ff-758b-4143-a56c-bab343cd296c tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:06.183891 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6e26b3ff-758b-4143-a56c-bab343cd296c tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:06.184357 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6e26b3ff-758b-4143-a56c-bab343cd296c tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:06.184800 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6e26b3ff-758b-4143-a56c-bab343cd296c tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:06.373598 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-c3d14047-3019-4e69-a50e-67feba56943d tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85abb492492343c58734564a2b26c8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68b14967e8249fd886f168d366f241f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:06.382880 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-c3d14047-3019-4e69-a50e-67feba56943d tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] 10.222.0.26 "GET /compute/v2.1/servers/1b68ff0f-2dfe-4844-b7ce-556768c5d3e2" status: 200 len: 1362 microversion: 2.1 time: 0.474989 Oct 08 21:09:06.393303 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2070/4055] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:05 2022] GET /compute/v2.1/servers/1b68ff0f-2dfe-4844-b7ce-556768c5d3e2 => generated 1362 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:09:06.432240 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-cd4b5c6f-803e-4b6b-80c7-97289c7b5f6f tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:06.432903 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-cd4b5c6f-803e-4b6b-80c7-97289c7b5f6f tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: 89d969cd-5514-4a4d-9c3c-1b408fff2f44] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:06.440188 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cd4b5c6f-803e-4b6b-80c7-97289c7b5f6f tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:06.440829 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cd4b5c6f-803e-4b6b-80c7-97289c7b5f6f tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:06.441323 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cd4b5c6f-803e-4b6b-80c7-97289c7b5f6f tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:06.442056 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cd4b5c6f-803e-4b6b-80c7-97289c7b5f6f tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:06.442579 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cd4b5c6f-803e-4b6b-80c7-97289c7b5f6f tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:06.443022 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cd4b5c6f-803e-4b6b-80c7-97289c7b5f6f tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:06.505458 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-6e26b3ff-758b-4143-a56c-bab343cd296c tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30fe0e1ffa1040ec85d3c32d8b741c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd0e7c24154409824f96e9e99da357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:06.514446 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-6e26b3ff-758b-4143-a56c-bab343cd296c tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "GET /compute/v2.1/servers/b9e77bd1-3ce0-4f0a-b5ac-8c0ba6caffbb" status: 200 len: 1497 microversion: 2.1 time: 0.345007 Oct 08 21:09:06.515039 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1986/4056] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:06 2022] GET /compute/v2.1/servers/b9e77bd1-3ce0-4f0a-b5ac-8c0ba6caffbb => generated 1497 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:09:06.685591 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-cd4b5c6f-803e-4b6b-80c7-97289c7b5f6f tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:06.699579 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-cd4b5c6f-803e-4b6b-80c7-97289c7b5f6f tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/89d969cd-5514-4a4d-9c3c-1b408fff2f44" status: 200 len: 1317 microversion: 2.1 time: 0.271634 Oct 08 21:09:06.717226 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2071/4057] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:06 2022] GET /compute/v2.1/servers/89d969cd-5514-4a4d-9c3c-1b408fff2f44 => generated 1317 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:09:06.764182 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-e4fb0c4c-19e4-488a-86fd-5d112f223023 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:06.764807 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-e4fb0c4c-19e4-488a-86fd-5d112f223023 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: ba5cd412-0d20-4d2e-9f5e-de18f268008a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:06.772726 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e4fb0c4c-19e4-488a-86fd-5d112f223023 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:06.773266 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e4fb0c4c-19e4-488a-86fd-5d112f223023 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:06.773724 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e4fb0c4c-19e4-488a-86fd-5d112f223023 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:06.774531 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e4fb0c4c-19e4-488a-86fd-5d112f223023 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:06.775997 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e4fb0c4c-19e4-488a-86fd-5d112f223023 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:06.776590 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e4fb0c4c-19e4-488a-86fd-5d112f223023 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:06.924621 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-e4fb0c4c-19e4-488a-86fd-5d112f223023 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78e9afd772c4de981cac8f5817ec356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765c62cac2ee4406b23a5baa85c52ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:06.934658 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-e4fb0c4c-19e4-488a-86fd-5d112f223023 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/ba5cd412-0d20-4d2e-9f5e-de18f268008a" status: 200 len: 1272 microversion: 2.1 time: 0.174419 Oct 08 21:09:06.935447 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1987/4058] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:06 2022] GET /compute/v2.1/servers/ba5cd412-0d20-4d2e-9f5e-de18f268008a => generated 1272 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:09:07.061995 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e0d68275-0724-41e0-9085-c85b6c45f6a1 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:07.062876 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-e0d68275-0724-41e0-9085-c85b6c45f6a1 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: 99510c36-821a-41dd-9ffe-8955dda22dcf] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:07.079007 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e0d68275-0724-41e0-9085-c85b6c45f6a1 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:07.082417 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e0d68275-0724-41e0-9085-c85b6c45f6a1 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:07.083222 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e0d68275-0724-41e0-9085-c85b6c45f6a1 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:07.084136 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e0d68275-0724-41e0-9085-c85b6c45f6a1 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:07.084763 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e0d68275-0724-41e0-9085-c85b6c45f6a1 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:07.085395 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e0d68275-0724-41e0-9085-c85b6c45f6a1 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:07.350038 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-e0d68275-0724-41e0-9085-c85b6c45f6a1 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06443b5728fb4d1e95d6245820e786bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ded993145b4eda9d6a33b994519012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:07.360797 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-e0d68275-0724-41e0-9085-c85b6c45f6a1 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "GET /compute/v2.1/servers/99510c36-821a-41dd-9ffe-8955dda22dcf" status: 200 len: 1510 microversion: 2.1 time: 0.303172 Oct 08 21:09:07.361716 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2072/4059] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:07 2022] GET /compute/v2.1/servers/99510c36-821a-41dd-9ffe-8955dda22dcf => generated 1510 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:09:07.409405 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-df4b4e72-c971-44e7-aa21-dd3cdf70dde4 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:07.410034 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-df4b4e72-c971-44e7-aa21-dd3cdf70dde4 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] [instance: 1b68ff0f-2dfe-4844-b7ce-556768c5d3e2] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:07.417461 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-df4b4e72-c971-44e7-aa21-dd3cdf70dde4 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:07.418064 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-df4b4e72-c971-44e7-aa21-dd3cdf70dde4 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:07.418917 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-df4b4e72-c971-44e7-aa21-dd3cdf70dde4 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:07.419920 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-df4b4e72-c971-44e7-aa21-dd3cdf70dde4 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:07.420616 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-df4b4e72-c971-44e7-aa21-dd3cdf70dde4 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:07.421283 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-df4b4e72-c971-44e7-aa21-dd3cdf70dde4 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:07.540012 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-89f7db37-3c13-4371-8fbf-7e8d568a2286 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:07.541560 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-89f7db37-3c13-4371-8fbf-7e8d568a2286 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] [instance: b9e77bd1-3ce0-4f0a-b5ac-8c0ba6caffbb] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:07.568891 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-89f7db37-3c13-4371-8fbf-7e8d568a2286 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:07.569907 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-89f7db37-3c13-4371-8fbf-7e8d568a2286 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:07.573774 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-89f7db37-3c13-4371-8fbf-7e8d568a2286 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:07.579740 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-89f7db37-3c13-4371-8fbf-7e8d568a2286 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:07.580691 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-89f7db37-3c13-4371-8fbf-7e8d568a2286 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:07.582279 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-89f7db37-3c13-4371-8fbf-7e8d568a2286 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:07.673428 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-df4b4e72-c971-44e7-aa21-dd3cdf70dde4 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85abb492492343c58734564a2b26c8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68b14967e8249fd886f168d366f241f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:07.682181 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-df4b4e72-c971-44e7-aa21-dd3cdf70dde4 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] 10.222.0.26 "GET /compute/v2.1/servers/1b68ff0f-2dfe-4844-b7ce-556768c5d3e2" status: 200 len: 1362 microversion: 2.1 time: 0.278125 Oct 08 21:09:07.682764 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1988/4060] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:07 2022] GET /compute/v2.1/servers/1b68ff0f-2dfe-4844-b7ce-556768c5d3e2 => generated 1362 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:09:07.725631 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-995f3f28-c40f-40fb-9fb7-6292fa2cfb9d tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:07.726339 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-995f3f28-c40f-40fb-9fb7-6292fa2cfb9d tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: 89d969cd-5514-4a4d-9c3c-1b408fff2f44] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:07.733141 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-995f3f28-c40f-40fb-9fb7-6292fa2cfb9d tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:07.733692 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-995f3f28-c40f-40fb-9fb7-6292fa2cfb9d tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:07.734255 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-995f3f28-c40f-40fb-9fb7-6292fa2cfb9d tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:07.735014 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-995f3f28-c40f-40fb-9fb7-6292fa2cfb9d tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:07.735484 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-995f3f28-c40f-40fb-9fb7-6292fa2cfb9d tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:07.735924 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-995f3f28-c40f-40fb-9fb7-6292fa2cfb9d tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:07.873834 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-89f7db37-3c13-4371-8fbf-7e8d568a2286 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30fe0e1ffa1040ec85d3c32d8b741c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd0e7c24154409824f96e9e99da357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:07.883139 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-89f7db37-3c13-4371-8fbf-7e8d568a2286 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "GET /compute/v2.1/servers/b9e77bd1-3ce0-4f0a-b5ac-8c0ba6caffbb" status: 200 len: 1474 microversion: 2.1 time: 0.347569 Oct 08 21:09:07.883844 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2073/4061] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:07 2022] GET /compute/v2.1/servers/b9e77bd1-3ce0-4f0a-b5ac-8c0ba6caffbb => generated 1474 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:09:07.907867 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-2afe3dbf-a617-4425-bf13-83c8437fca7f tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-332386207"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:09:07.910725 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-2afe3dbf-a617-4425-bf13-83c8437fca7f tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] [instance: b9e77bd1-3ce0-4f0a-b5ac-8c0ba6caffbb] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:07.919005 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2afe3dbf-a617-4425-bf13-83c8437fca7f tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:07.919859 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2afe3dbf-a617-4425-bf13-83c8437fca7f tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:07.920448 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2afe3dbf-a617-4425-bf13-83c8437fca7f tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:07.921340 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2afe3dbf-a617-4425-bf13-83c8437fca7f tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:07.921942 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2afe3dbf-a617-4425-bf13-83c8437fca7f tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:07.922906 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2afe3dbf-a617-4425-bf13-83c8437fca7f tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:08.039435 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-995f3f28-c40f-40fb-9fb7-6292fa2cfb9d tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:08.049789 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-995f3f28-c40f-40fb-9fb7-6292fa2cfb9d tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/89d969cd-5514-4a4d-9c3c-1b408fff2f44" status: 200 len: 1317 microversion: 2.1 time: 0.329129 Oct 08 21:09:08.050394 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1989/4062] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:07 2022] GET /compute/v2.1/servers/89d969cd-5514-4a4d-9c3c-1b408fff2f44 => generated 1317 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:09:08.059878 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-67737461-a6e8-447c-af7c-e376e3a98e9d tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:08.060473 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-67737461-a6e8-447c-af7c-e376e3a98e9d tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: ba5cd412-0d20-4d2e-9f5e-de18f268008a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:08.072657 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-67737461-a6e8-447c-af7c-e376e3a98e9d tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:08.073449 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-67737461-a6e8-447c-af7c-e376e3a98e9d tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:08.074050 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-67737461-a6e8-447c-af7c-e376e3a98e9d tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:08.074931 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-67737461-a6e8-447c-af7c-e376e3a98e9d tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:08.075572 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-67737461-a6e8-447c-af7c-e376e3a98e9d tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:08.076159 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-67737461-a6e8-447c-af7c-e376e3a98e9d tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:08.186330 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:09:08.205723 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-2afe3dbf-a617-4425-bf13-83c8437fca7f tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "POST /compute/v2.1/servers/b9e77bd1-3ce0-4f0a-b5ac-8c0ba6caffbb/action" status: 202 len: 0 microversion: 2.1 time: 0.301603 Oct 08 21:09:08.206472 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2074/4063] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:09:07 2022] POST /compute/v2.1/servers/b9e77bd1-3ce0-4f0a-b5ac-8c0ba6caffbb/action => generated 0 bytes in 304 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 08 21:09:08.218724 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-04408814-5c1c-4125-a28f-328d0c60f60c req-907773de-9a57-4668-b0a9-7eedfe8e33a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba5cd412-0d20-4d2e-9f5e-de18f268008a", "tag": "3c7983b1-4926-4db7-acf7-8d73050025e7"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:09:08.230682 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-04408814-5c1c-4125-a28f-328d0c60f60c req-907773de-9a57-4668-b0a9-7eedfe8e33a5 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:08.231296 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-04408814-5c1c-4125-a28f-328d0c60f60c req-907773de-9a57-4668-b0a9-7eedfe8e33a5 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:08.231814 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-04408814-5c1c-4125-a28f-328d0c60f60c req-907773de-9a57-4668-b0a9-7eedfe8e33a5 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:08.245842 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-04408814-5c1c-4125-a28f-328d0c60f60c req-907773de-9a57-4668-b0a9-7eedfe8e33a5 service nova] Creating event network-changed:3c7983b1-4926-4db7-acf7-8d73050025e7 for instance ba5cd412-0d20-4d2e-9f5e-de18f268008a on nch1-master-1 Oct 08 21:09:08.250950 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-04408814-5c1c-4125-a28f-328d0c60f60c req-907773de-9a57-4668-b0a9-7eedfe8e33a5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037076 Oct 08 21:09:08.251709 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2075/4064] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:09:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:09:08.259498 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-3f11801e-e236-4f2e-adf2-8ac73df3fea5 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Calling method '.version_select at 0x7f1a875a3700>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:08.308159 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-3f11801e-e236-4f2e-adf2-8ac73df3fea5 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "GET /compute/v2.1/images/ed86c272-4be6-4a44-bd79-2a964b0f06f7" status: 200 len: 1411 microversion: 2.1 time: 0.052314 Oct 08 21:09:08.309434 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2076/4065] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:09:08 2022] GET /compute/v2.1/images/ed86c272-4be6-4a44-bd79-2a964b0f06f7 => generated 1411 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:09:08.346423 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-67737461-a6e8-447c-af7c-e376e3a98e9d tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78e9afd772c4de981cac8f5817ec356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765c62cac2ee4406b23a5baa85c52ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:08.361363 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-67737461-a6e8-447c-af7c-e376e3a98e9d tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/ba5cd412-0d20-4d2e-9f5e-de18f268008a" status: 200 len: 1314 microversion: 2.1 time: 0.309673 Oct 08 21:09:08.362778 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1990/4066] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:08 2022] GET /compute/v2.1/servers/ba5cd412-0d20-4d2e-9f5e-de18f268008a => generated 1314 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:09:08.389077 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-c32ae769-7eea-402a-a47d-a00052e9f3c2 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:08.390139 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-c32ae769-7eea-402a-a47d-a00052e9f3c2 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: 99510c36-821a-41dd-9ffe-8955dda22dcf] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:08.398170 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c32ae769-7eea-402a-a47d-a00052e9f3c2 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:08.399100 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c32ae769-7eea-402a-a47d-a00052e9f3c2 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:08.401624 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c32ae769-7eea-402a-a47d-a00052e9f3c2 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:08.402590 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c32ae769-7eea-402a-a47d-a00052e9f3c2 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:08.403382 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c32ae769-7eea-402a-a47d-a00052e9f3c2 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:08.404066 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c32ae769-7eea-402a-a47d-a00052e9f3c2 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:08.706085 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-1a057992-f8b8-4dab-89d5-0fc9fae1a1e7 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:08.706713 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-1a057992-f8b8-4dab-89d5-0fc9fae1a1e7 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] [instance: 1b68ff0f-2dfe-4844-b7ce-556768c5d3e2] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:08.714049 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1a057992-f8b8-4dab-89d5-0fc9fae1a1e7 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:08.714548 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1a057992-f8b8-4dab-89d5-0fc9fae1a1e7 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:08.715173 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1a057992-f8b8-4dab-89d5-0fc9fae1a1e7 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:08.715906 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1a057992-f8b8-4dab-89d5-0fc9fae1a1e7 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:08.716369 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1a057992-f8b8-4dab-89d5-0fc9fae1a1e7 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:08.716808 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1a057992-f8b8-4dab-89d5-0fc9fae1a1e7 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:08.799681 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-c32ae769-7eea-402a-a47d-a00052e9f3c2 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06443b5728fb4d1e95d6245820e786bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ded993145b4eda9d6a33b994519012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:08.818292 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-c32ae769-7eea-402a-a47d-a00052e9f3c2 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "GET /compute/v2.1/servers/99510c36-821a-41dd-9ffe-8955dda22dcf" status: 200 len: 1510 microversion: 2.1 time: 0.434685 Oct 08 21:09:08.819796 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2077/4067] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:08 2022] GET /compute/v2.1/servers/99510c36-821a-41dd-9ffe-8955dda22dcf => generated 1510 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:09:08.972978 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-1a057992-f8b8-4dab-89d5-0fc9fae1a1e7 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85abb492492343c58734564a2b26c8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68b14967e8249fd886f168d366f241f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:08.985726 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-1a057992-f8b8-4dab-89d5-0fc9fae1a1e7 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] 10.222.0.26 "GET /compute/v2.1/servers/1b68ff0f-2dfe-4844-b7ce-556768c5d3e2" status: 200 len: 1549 microversion: 2.1 time: 0.283251 Oct 08 21:09:08.999026 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1991/4068] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:08 2022] GET /compute/v2.1/servers/1b68ff0f-2dfe-4844-b7ce-556768c5d3e2 => generated 1549 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:09:09.012204 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-b2d26e3b-fa3a-4e98-a3ff-5497d10e5815 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:09.012832 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-b2d26e3b-fa3a-4e98-a3ff-5497d10e5815 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] [instance: 1b68ff0f-2dfe-4844-b7ce-556768c5d3e2] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:09.023831 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b2d26e3b-fa3a-4e98-a3ff-5497d10e5815 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:09.024441 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b2d26e3b-fa3a-4e98-a3ff-5497d10e5815 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:09.025508 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b2d26e3b-fa3a-4e98-a3ff-5497d10e5815 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:09.026344 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b2d26e3b-fa3a-4e98-a3ff-5497d10e5815 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:09.026920 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b2d26e3b-fa3a-4e98-a3ff-5497d10e5815 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:09.027478 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b2d26e3b-fa3a-4e98-a3ff-5497d10e5815 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:09.075273 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-aa1bf1c1-a40f-49a6-b40d-bc321c953e40 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:09.077071 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-aa1bf1c1-a40f-49a6-b40d-bc321c953e40 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: 89d969cd-5514-4a4d-9c3c-1b408fff2f44] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:09.083633 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-aa1bf1c1-a40f-49a6-b40d-bc321c953e40 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:09.084368 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-aa1bf1c1-a40f-49a6-b40d-bc321c953e40 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:09.084818 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-aa1bf1c1-a40f-49a6-b40d-bc321c953e40 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:09.085564 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-aa1bf1c1-a40f-49a6-b40d-bc321c953e40 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:09.086207 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-aa1bf1c1-a40f-49a6-b40d-bc321c953e40 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:09.086669 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-aa1bf1c1-a40f-49a6-b40d-bc321c953e40 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:09.162882 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-b2d26e3b-fa3a-4e98-a3ff-5497d10e5815 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] 10.222.0.26 "GET /compute/v2.1/servers/1b68ff0f-2dfe-4844-b7ce-556768c5d3e2/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.155896 Oct 08 21:09:09.164203 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2078/4069] 10.222.0.26 () {58 vars in 1275 bytes} [Sat Oct 8 21:09:09 2022] GET /compute/v2.1/servers/1b68ff0f-2dfe-4844-b7ce-556768c5d3e2/os-interface => generated 285 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:09:09.314401 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-aa1bf1c1-a40f-49a6-b40d-bc321c953e40 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:09.324315 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-c9705f2e-6c86-4207-ad74-075b2acfc202 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Calling method '.version_select at 0x7f1a876144c0>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:09.324501 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-aa1bf1c1-a40f-49a6-b40d-bc321c953e40 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/89d969cd-5514-4a4d-9c3c-1b408fff2f44" status: 200 len: 1317 microversion: 2.1 time: 0.255005 Oct 08 21:09:09.325066 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1992/4070] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:09 2022] GET /compute/v2.1/servers/89d969cd-5514-4a4d-9c3c-1b408fff2f44 => generated 1317 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:09:09.387595 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-6a5f2115-afa6-4d35-bf34-36fdb3540826 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:09.388507 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-6a5f2115-afa6-4d35-bf34-36fdb3540826 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: ba5cd412-0d20-4d2e-9f5e-de18f268008a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:09.389812 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-c9705f2e-6c86-4207-ad74-075b2acfc202 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "GET /compute/v2.1/images/ed86c272-4be6-4a44-bd79-2a964b0f06f7" status: 200 len: 1411 microversion: 2.1 time: 0.069662 Oct 08 21:09:09.390500 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2079/4071] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:09:09 2022] GET /compute/v2.1/images/ed86c272-4be6-4a44-bd79-2a964b0f06f7 => generated 1411 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:09:09.397246 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6a5f2115-afa6-4d35-bf34-36fdb3540826 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:09.397804 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6a5f2115-afa6-4d35-bf34-36fdb3540826 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:09.398397 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6a5f2115-afa6-4d35-bf34-36fdb3540826 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:09.399124 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6a5f2115-afa6-4d35-bf34-36fdb3540826 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:09.399591 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6a5f2115-afa6-4d35-bf34-36fdb3540826 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:09.400655 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6a5f2115-afa6-4d35-bf34-36fdb3540826 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:09.543184 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-6a5f2115-afa6-4d35-bf34-36fdb3540826 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78e9afd772c4de981cac8f5817ec356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765c62cac2ee4406b23a5baa85c52ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:09.551318 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-6a5f2115-afa6-4d35-bf34-36fdb3540826 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/ba5cd412-0d20-4d2e-9f5e-de18f268008a" status: 200 len: 1314 microversion: 2.1 time: 0.171017 Oct 08 21:09:09.551917 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1993/4072] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:09 2022] GET /compute/v2.1/servers/ba5cd412-0d20-4d2e-9f5e-de18f268008a => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:09:09.843886 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-636fa669-eac7-4247-9b48-f56aafa5b7a3 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:09.844540 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-636fa669-eac7-4247-9b48-f56aafa5b7a3 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: 99510c36-821a-41dd-9ffe-8955dda22dcf] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:09.851001 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-636fa669-eac7-4247-9b48-f56aafa5b7a3 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:09.851509 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-636fa669-eac7-4247-9b48-f56aafa5b7a3 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:09.851955 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-636fa669-eac7-4247-9b48-f56aafa5b7a3 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:09.852950 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-636fa669-eac7-4247-9b48-f56aafa5b7a3 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:09.854000 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-636fa669-eac7-4247-9b48-f56aafa5b7a3 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:09.854440 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-636fa669-eac7-4247-9b48-f56aafa5b7a3 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:10.234561 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-636fa669-eac7-4247-9b48-f56aafa5b7a3 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06443b5728fb4d1e95d6245820e786bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ded993145b4eda9d6a33b994519012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:10.251636 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-636fa669-eac7-4247-9b48-f56aafa5b7a3 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "GET /compute/v2.1/servers/99510c36-821a-41dd-9ffe-8955dda22dcf" status: 200 len: 1510 microversion: 2.1 time: 0.409719 Oct 08 21:09:10.269149 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2080/4073] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:09 2022] GET /compute/v2.1/servers/99510c36-821a-41dd-9ffe-8955dda22dcf => generated 1510 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:09:10.348735 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-8c0182da-2b25-47c5-b8a9-d0c4429045a1 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:10.349798 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-8c0182da-2b25-47c5-b8a9-d0c4429045a1 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: 89d969cd-5514-4a4d-9c3c-1b408fff2f44] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:10.363381 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8c0182da-2b25-47c5-b8a9-d0c4429045a1 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:10.363899 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8c0182da-2b25-47c5-b8a9-d0c4429045a1 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:10.364356 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8c0182da-2b25-47c5-b8a9-d0c4429045a1 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:10.365089 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8c0182da-2b25-47c5-b8a9-d0c4429045a1 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:10.365603 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8c0182da-2b25-47c5-b8a9-d0c4429045a1 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:10.366096 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8c0182da-2b25-47c5-b8a9-d0c4429045a1 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:10.405443 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-653e3356-4187-4da0-be60-144849a6473e tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Calling method '.version_select at 0x7f1a875f0550>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:10.479063 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-653e3356-4187-4da0-be60-144849a6473e tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "GET /compute/v2.1/images/ed86c272-4be6-4a44-bd79-2a964b0f06f7" status: 200 len: 1411 microversion: 2.1 time: 0.077486 Oct 08 21:09:10.480252 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2081/4074] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:09:10 2022] GET /compute/v2.1/images/ed86c272-4be6-4a44-bd79-2a964b0f06f7 => generated 1411 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:09:10.575596 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-adc17799-499e-4217-b2c9-a47ccc3513af tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:10.576719 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-adc17799-499e-4217-b2c9-a47ccc3513af tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: ba5cd412-0d20-4d2e-9f5e-de18f268008a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:10.585101 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-adc17799-499e-4217-b2c9-a47ccc3513af tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:10.585867 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-adc17799-499e-4217-b2c9-a47ccc3513af tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:10.586531 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-adc17799-499e-4217-b2c9-a47ccc3513af tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:10.588031 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-adc17799-499e-4217-b2c9-a47ccc3513af tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:10.589213 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-adc17799-499e-4217-b2c9-a47ccc3513af tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:10.589861 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-adc17799-499e-4217-b2c9-a47ccc3513af tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:10.731474 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-8c0182da-2b25-47c5-b8a9-d0c4429045a1 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:10.741983 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-8c0182da-2b25-47c5-b8a9-d0c4429045a1 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/89d969cd-5514-4a4d-9c3c-1b408fff2f44" status: 200 len: 1317 microversion: 2.1 time: 0.397350 Oct 08 21:09:10.747099 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1994/4075] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:10 2022] GET /compute/v2.1/servers/89d969cd-5514-4a4d-9c3c-1b408fff2f44 => generated 1317 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:09:10.861895 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-adc17799-499e-4217-b2c9-a47ccc3513af tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78e9afd772c4de981cac8f5817ec356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765c62cac2ee4406b23a5baa85c52ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:10.873960 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-adc17799-499e-4217-b2c9-a47ccc3513af tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/ba5cd412-0d20-4d2e-9f5e-de18f268008a" status: 200 len: 1314 microversion: 2.1 time: 0.302271 Oct 08 21:09:10.876251 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2082/4076] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:10 2022] GET /compute/v2.1/servers/ba5cd412-0d20-4d2e-9f5e-de18f268008a => generated 1314 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:09:11.237583 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-880591ad-e16d-4f19-948a-ec3c667c62ef req-5c90c7b2-5c26-4a2f-b0ea-75d8c7e3fb2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b68ff0f-2dfe-4844-b7ce-556768c5d3e2", "tag": "88154834-d566-47ce-bf02-2e28327ec781"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:09:11.249141 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-880591ad-e16d-4f19-948a-ec3c667c62ef req-5c90c7b2-5c26-4a2f-b0ea-75d8c7e3fb2e service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:11.249979 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-880591ad-e16d-4f19-948a-ec3c667c62ef req-5c90c7b2-5c26-4a2f-b0ea-75d8c7e3fb2e service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:11.251928 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-880591ad-e16d-4f19-948a-ec3c667c62ef req-5c90c7b2-5c26-4a2f-b0ea-75d8c7e3fb2e service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:11.276790 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-880591ad-e16d-4f19-948a-ec3c667c62ef req-5c90c7b2-5c26-4a2f-b0ea-75d8c7e3fb2e service nova] Creating event network-changed:88154834-d566-47ce-bf02-2e28327ec781 for instance 1b68ff0f-2dfe-4844-b7ce-556768c5d3e2 on nch2-master-1 Oct 08 21:09:11.278649 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-457e8dd1-0ea0-4189-912c-ede29f7af457 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:11.279354 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-457e8dd1-0ea0-4189-912c-ede29f7af457 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: 99510c36-821a-41dd-9ffe-8955dda22dcf] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:11.289955 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-457e8dd1-0ea0-4189-912c-ede29f7af457 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:11.290487 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-457e8dd1-0ea0-4189-912c-ede29f7af457 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:11.291509 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-457e8dd1-0ea0-4189-912c-ede29f7af457 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:11.297363 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-457e8dd1-0ea0-4189-912c-ede29f7af457 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:11.298137 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-457e8dd1-0ea0-4189-912c-ede29f7af457 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:11.298884 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-457e8dd1-0ea0-4189-912c-ede29f7af457 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:11.301104 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-880591ad-e16d-4f19-948a-ec3c667c62ef req-5c90c7b2-5c26-4a2f-b0ea-75d8c7e3fb2e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067181 Oct 08 21:09:11.301987 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1995/4077] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:09:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:09:11.498427 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-6f5b174e-4b97-4118-bf6e-648f24562a26 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Calling method '.version_select at 0x7f1a8c68ca60>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:11.582839 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-6f5b174e-4b97-4118-bf6e-648f24562a26 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "GET /compute/v2.1/images/ed86c272-4be6-4a44-bd79-2a964b0f06f7" status: 200 len: 1411 microversion: 2.1 time: 0.090958 Oct 08 21:09:11.583970 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1996/4078] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:09:11 2022] GET /compute/v2.1/images/ed86c272-4be6-4a44-bd79-2a964b0f06f7 => generated 1411 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:09:11.730557 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-457e8dd1-0ea0-4189-912c-ede29f7af457 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06443b5728fb4d1e95d6245820e786bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ded993145b4eda9d6a33b994519012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:11.742361 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-457e8dd1-0ea0-4189-912c-ede29f7af457 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "GET /compute/v2.1/servers/99510c36-821a-41dd-9ffe-8955dda22dcf" status: 200 len: 1510 microversion: 2.1 time: 0.469843 Oct 08 21:09:11.746008 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2083/4079] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:11 2022] GET /compute/v2.1/servers/99510c36-821a-41dd-9ffe-8955dda22dcf => generated 1510 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:09:11.773995 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-2e31ffd3-7d35-4617-a150-5046aeeeaf66 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:11.775707 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-2e31ffd3-7d35-4617-a150-5046aeeeaf66 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: 89d969cd-5514-4a4d-9c3c-1b408fff2f44] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:11.788130 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:09:11.793770 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2e31ffd3-7d35-4617-a150-5046aeeeaf66 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:11.794569 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2e31ffd3-7d35-4617-a150-5046aeeeaf66 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:11.795203 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2e31ffd3-7d35-4617-a150-5046aeeeaf66 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:11.797391 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2e31ffd3-7d35-4617-a150-5046aeeeaf66 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:11.798029 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2e31ffd3-7d35-4617-a150-5046aeeeaf66 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:11.799878 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2e31ffd3-7d35-4617-a150-5046aeeeaf66 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:11.904246 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-ba9cb944-90ca-4488-b9f6-5d7e68cf28d9 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:11.906297 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-ba9cb944-90ca-4488-b9f6-5d7e68cf28d9 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: ba5cd412-0d20-4d2e-9f5e-de18f268008a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:11.917370 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ba9cb944-90ca-4488-b9f6-5d7e68cf28d9 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:11.919384 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ba9cb944-90ca-4488-b9f6-5d7e68cf28d9 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:11.919905 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ba9cb944-90ca-4488-b9f6-5d7e68cf28d9 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:11.922388 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ba9cb944-90ca-4488-b9f6-5d7e68cf28d9 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:11.923570 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ba9cb944-90ca-4488-b9f6-5d7e68cf28d9 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:11.927887 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ba9cb944-90ca-4488-b9f6-5d7e68cf28d9 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:12.217370 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-2e31ffd3-7d35-4617-a150-5046aeeeaf66 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:12.225860 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-2e31ffd3-7d35-4617-a150-5046aeeeaf66 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/89d969cd-5514-4a4d-9c3c-1b408fff2f44" status: 200 len: 1317 microversion: 2.1 time: 0.459602 Oct 08 21:09:12.246523 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1997/4080] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:11 2022] GET /compute/v2.1/servers/89d969cd-5514-4a4d-9c3c-1b408fff2f44 => generated 1317 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:09:12.280070 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-ba9cb944-90ca-4488-b9f6-5d7e68cf28d9 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78e9afd772c4de981cac8f5817ec356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765c62cac2ee4406b23a5baa85c52ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:12.307888 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-ba9cb944-90ca-4488-b9f6-5d7e68cf28d9 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/ba5cd412-0d20-4d2e-9f5e-de18f268008a" status: 200 len: 1314 microversion: 2.1 time: 0.408318 Oct 08 21:09:12.311742 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2084/4081] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:11 2022] GET /compute/v2.1/servers/ba5cd412-0d20-4d2e-9f5e-de18f268008a => generated 1314 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:09:12.601986 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-2432e823-c020-4c3e-8197-2ecd61ef4511 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Calling method '.version_select at 0x7f1a87de2d30>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:12.682831 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-2432e823-c020-4c3e-8197-2ecd61ef4511 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "GET /compute/v2.1/images/ed86c272-4be6-4a44-bd79-2a964b0f06f7" status: 200 len: 1411 microversion: 2.1 time: 0.087266 Oct 08 21:09:12.685764 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1998/4082] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:09:12 2022] GET /compute/v2.1/images/ed86c272-4be6-4a44-bd79-2a964b0f06f7 => generated 1411 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:09:12.777027 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-8fe7b5c6-e0f7-433f-a5bb-0dcec6795b5f tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:12.778149 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-8fe7b5c6-e0f7-433f-a5bb-0dcec6795b5f tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: 99510c36-821a-41dd-9ffe-8955dda22dcf] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:12.786150 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8fe7b5c6-e0f7-433f-a5bb-0dcec6795b5f tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:12.786990 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8fe7b5c6-e0f7-433f-a5bb-0dcec6795b5f tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:12.787654 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8fe7b5c6-e0f7-433f-a5bb-0dcec6795b5f tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:12.788576 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8fe7b5c6-e0f7-433f-a5bb-0dcec6795b5f tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:12.789457 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8fe7b5c6-e0f7-433f-a5bb-0dcec6795b5f tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:12.791053 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8fe7b5c6-e0f7-433f-a5bb-0dcec6795b5f tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:13.031462 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-8fe7b5c6-e0f7-433f-a5bb-0dcec6795b5f tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06443b5728fb4d1e95d6245820e786bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ded993145b4eda9d6a33b994519012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:13.042234 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-8fe7b5c6-e0f7-433f-a5bb-0dcec6795b5f tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "GET /compute/v2.1/servers/99510c36-821a-41dd-9ffe-8955dda22dcf" status: 200 len: 1510 microversion: 2.1 time: 0.273855 Oct 08 21:09:13.060266 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2085/4083] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:12 2022] GET /compute/v2.1/servers/99510c36-821a-41dd-9ffe-8955dda22dcf => generated 1510 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:09:13.253886 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c393513d-439d-4624-ae05-5efe8d8109fd tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:13.254616 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-c393513d-439d-4624-ae05-5efe8d8109fd tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: 89d969cd-5514-4a4d-9c3c-1b408fff2f44] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:13.274925 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c393513d-439d-4624-ae05-5efe8d8109fd tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:13.275727 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c393513d-439d-4624-ae05-5efe8d8109fd tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:13.276372 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c393513d-439d-4624-ae05-5efe8d8109fd tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:13.277297 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c393513d-439d-4624-ae05-5efe8d8109fd tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:13.277907 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c393513d-439d-4624-ae05-5efe8d8109fd tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:13.278561 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c393513d-439d-4624-ae05-5efe8d8109fd tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:13.333867 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-422e6541-312b-4ce0-bb7c-5d71b8296087 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:13.334491 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-422e6541-312b-4ce0-bb7c-5d71b8296087 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: ba5cd412-0d20-4d2e-9f5e-de18f268008a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:13.345688 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-422e6541-312b-4ce0-bb7c-5d71b8296087 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:13.346195 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-422e6541-312b-4ce0-bb7c-5d71b8296087 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:13.354466 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-422e6541-312b-4ce0-bb7c-5d71b8296087 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:13.355361 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-422e6541-312b-4ce0-bb7c-5d71b8296087 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:13.355858 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-422e6541-312b-4ce0-bb7c-5d71b8296087 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:13.359361 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-422e6541-312b-4ce0-bb7c-5d71b8296087 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:13.589931 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-422e6541-312b-4ce0-bb7c-5d71b8296087 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78e9afd772c4de981cac8f5817ec356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765c62cac2ee4406b23a5baa85c52ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:13.591315 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-c393513d-439d-4624-ae05-5efe8d8109fd tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:13.603511 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-c393513d-439d-4624-ae05-5efe8d8109fd tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/89d969cd-5514-4a4d-9c3c-1b408fff2f44" status: 200 len: 1317 microversion: 2.1 time: 0.352843 Oct 08 21:09:13.610691 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-422e6541-312b-4ce0-bb7c-5d71b8296087 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/ba5cd412-0d20-4d2e-9f5e-de18f268008a" status: 200 len: 1314 microversion: 2.1 time: 0.280585 Oct 08 21:09:13.611546 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2086/4085] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:13 2022] GET /compute/v2.1/servers/ba5cd412-0d20-4d2e-9f5e-de18f268008a => generated 1314 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:09:13.624915 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 1999/4085] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:13 2022] GET /compute/v2.1/servers/89d969cd-5514-4a4d-9c3c-1b408fff2f44 => generated 1317 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:09:13.702572 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-5be4ba8d-9279-4e76-89ec-d55ad178d2eb tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Calling method '.version_select at 0x7f1a8773d040>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:13.752812 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-ebc49670-391c-4247-82d7-1562c85dcea2 req-56b92ead-145c-435f-bf3b-f872e962e6c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9e77bd1-3ce0-4f0a-b5ac-8c0ba6caffbb", "name": "network-vif-plugged", "status": "completed", "tag": "d7fcb7de-d762-4c1b-b3d5-f613b5fc112a"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:09:13.783598 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-ebc49670-391c-4247-82d7-1562c85dcea2 req-56b92ead-145c-435f-bf3b-f872e962e6c1 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:13.784080 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-ebc49670-391c-4247-82d7-1562c85dcea2 req-56b92ead-145c-435f-bf3b-f872e962e6c1 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:13.784529 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-ebc49670-391c-4247-82d7-1562c85dcea2 req-56b92ead-145c-435f-bf3b-f872e962e6c1 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:13.816026 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-5be4ba8d-9279-4e76-89ec-d55ad178d2eb tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "GET /compute/v2.1/images/ed86c272-4be6-4a44-bd79-2a964b0f06f7" status: 200 len: 1411 microversion: 2.1 time: 0.119040 Oct 08 21:09:13.822645 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-ebc49670-391c-4247-82d7-1562c85dcea2 req-56b92ead-145c-435f-bf3b-f872e962e6c1 service nova] Creating event network-vif-plugged:d7fcb7de-d762-4c1b-b3d5-f613b5fc112a for instance b9e77bd1-3ce0-4f0a-b5ac-8c0ba6caffbb on nch1-master-1 Oct 08 21:09:13.825720 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2087/4086] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:09:13 2022] GET /compute/v2.1/images/ed86c272-4be6-4a44-bd79-2a964b0f06f7 => generated 1411 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:09:13.829701 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-ebc49670-391c-4247-82d7-1562c85dcea2 req-56b92ead-145c-435f-bf3b-f872e962e6c1 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081373 Oct 08 21:09:13.831492 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2000/4087] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:09:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:09:14.070796 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-861dfdbf-9834-4a4a-a6b6-98b618388612 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:14.072081 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-861dfdbf-9834-4a4a-a6b6-98b618388612 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: 99510c36-821a-41dd-9ffe-8955dda22dcf] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:14.084648 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-861dfdbf-9834-4a4a-a6b6-98b618388612 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:14.089276 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-861dfdbf-9834-4a4a-a6b6-98b618388612 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:14.099812 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-861dfdbf-9834-4a4a-a6b6-98b618388612 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:14.101102 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-861dfdbf-9834-4a4a-a6b6-98b618388612 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:14.104392 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-861dfdbf-9834-4a4a-a6b6-98b618388612 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:14.105103 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-861dfdbf-9834-4a4a-a6b6-98b618388612 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:14.387639 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-861dfdbf-9834-4a4a-a6b6-98b618388612 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06443b5728fb4d1e95d6245820e786bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ded993145b4eda9d6a33b994519012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:14.398075 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-861dfdbf-9834-4a4a-a6b6-98b618388612 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "GET /compute/v2.1/servers/99510c36-821a-41dd-9ffe-8955dda22dcf" status: 200 len: 1510 microversion: 2.1 time: 0.332195 Oct 08 21:09:14.399270 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2088/4088] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:14 2022] GET /compute/v2.1/servers/99510c36-821a-41dd-9ffe-8955dda22dcf => generated 1510 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:09:14.632861 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-3508a838-d350-45d0-bd33-b134e7955763 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:14.635427 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-3508a838-d350-45d0-bd33-b134e7955763 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: 89d969cd-5514-4a4d-9c3c-1b408fff2f44] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:14.637354 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-6eecd185-4021-43a6-8218-1c0e7a3de1da tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:14.638238 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-6eecd185-4021-43a6-8218-1c0e7a3de1da tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: ba5cd412-0d20-4d2e-9f5e-de18f268008a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:14.648194 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=4 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:09:14.655595 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=36 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:09:14.661585 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6eecd185-4021-43a6-8218-1c0e7a3de1da tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:14.662550 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6eecd185-4021-43a6-8218-1c0e7a3de1da tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:14.663278 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6eecd185-4021-43a6-8218-1c0e7a3de1da tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:14.666814 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6eecd185-4021-43a6-8218-1c0e7a3de1da tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:14.668552 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6eecd185-4021-43a6-8218-1c0e7a3de1da tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:14.669008 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6eecd185-4021-43a6-8218-1c0e7a3de1da tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:14.669707 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3508a838-d350-45d0-bd33-b134e7955763 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:14.670446 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3508a838-d350-45d0-bd33-b134e7955763 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:14.670942 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3508a838-d350-45d0-bd33-b134e7955763 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:14.675344 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3508a838-d350-45d0-bd33-b134e7955763 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:14.676051 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3508a838-d350-45d0-bd33-b134e7955763 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:14.676992 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3508a838-d350-45d0-bd33-b134e7955763 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:14.862844 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-6eecd185-4021-43a6-8218-1c0e7a3de1da tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78e9afd772c4de981cac8f5817ec356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765c62cac2ee4406b23a5baa85c52ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:14.872720 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-6eecd185-4021-43a6-8218-1c0e7a3de1da tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/ba5cd412-0d20-4d2e-9f5e-de18f268008a" status: 200 len: 1314 microversion: 2.1 time: 0.240762 Oct 08 21:09:14.874702 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2089/4089] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:14 2022] GET /compute/v2.1/servers/ba5cd412-0d20-4d2e-9f5e-de18f268008a => generated 1314 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:09:14.880020 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-d50e906a-b1b5-465e-910a-54fad0d6b6ae tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Calling method '.version_select at 0x7f1a876141f0>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:14.939537 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-d50e906a-b1b5-465e-910a-54fad0d6b6ae tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "GET /compute/v2.1/images/ed86c272-4be6-4a44-bd79-2a964b0f06f7" status: 200 len: 1411 microversion: 2.1 time: 0.063365 Oct 08 21:09:14.940475 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2090/4090] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:09:14 2022] GET /compute/v2.1/images/ed86c272-4be6-4a44-bd79-2a964b0f06f7 => generated 1411 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:09:15.409964 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-3508a838-d350-45d0-bd33-b134e7955763 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:15.424665 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e30a0140-b4fe-40e1-85e4-3af390e89ddc tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:15.425317 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-e30a0140-b4fe-40e1-85e4-3af390e89ddc tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: 99510c36-821a-41dd-9ffe-8955dda22dcf] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:15.433492 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-3508a838-d350-45d0-bd33-b134e7955763 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/89d969cd-5514-4a4d-9c3c-1b408fff2f44" status: 200 len: 1317 microversion: 2.1 time: 0.806214 Oct 08 21:09:15.441123 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e30a0140-b4fe-40e1-85e4-3af390e89ddc tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:15.457218 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2001/4091] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:14 2022] GET /compute/v2.1/servers/89d969cd-5514-4a4d-9c3c-1b408fff2f44 => generated 1317 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:09:15.457568 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e30a0140-b4fe-40e1-85e4-3af390e89ddc tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:15.457568 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e30a0140-b4fe-40e1-85e4-3af390e89ddc tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:15.457568 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e30a0140-b4fe-40e1-85e4-3af390e89ddc tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:15.457568 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e30a0140-b4fe-40e1-85e4-3af390e89ddc tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:15.457927 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e30a0140-b4fe-40e1-85e4-3af390e89ddc tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:15.758555 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-e30a0140-b4fe-40e1-85e4-3af390e89ddc tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06443b5728fb4d1e95d6245820e786bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ded993145b4eda9d6a33b994519012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:15.771143 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-e30a0140-b4fe-40e1-85e4-3af390e89ddc tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "GET /compute/v2.1/servers/99510c36-821a-41dd-9ffe-8955dda22dcf" status: 200 len: 1510 microversion: 2.1 time: 0.351521 Oct 08 21:09:15.783189 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2091/4092] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:15 2022] GET /compute/v2.1/servers/99510c36-821a-41dd-9ffe-8955dda22dcf => generated 1510 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:09:15.908276 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-cb6a5d8e-afd2-49c9-bcdd-99597a05e17a tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:15.908908 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-cb6a5d8e-afd2-49c9-bcdd-99597a05e17a tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: ba5cd412-0d20-4d2e-9f5e-de18f268008a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:15.909764 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-19523f66-ed46-407d-ae0d-9dc50ced98bb req-acedbb42-ea24-4a94-b310-386a9a11260e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89d969cd-5514-4a4d-9c3c-1b408fff2f44", "name": "network-vif-plugged", "status": "completed", "tag": "96594cb2-dc29-4cce-9364-8fca3f454e94"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:09:15.938287 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cb6a5d8e-afd2-49c9-bcdd-99597a05e17a tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:15.938917 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cb6a5d8e-afd2-49c9-bcdd-99597a05e17a tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:15.949011 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cb6a5d8e-afd2-49c9-bcdd-99597a05e17a tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:15.949948 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cb6a5d8e-afd2-49c9-bcdd-99597a05e17a tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:15.960346 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cb6a5d8e-afd2-49c9-bcdd-99597a05e17a tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:15.962415 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cb6a5d8e-afd2-49c9-bcdd-99597a05e17a tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:15.962752 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-19523f66-ed46-407d-ae0d-9dc50ced98bb req-acedbb42-ea24-4a94-b310-386a9a11260e service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:15.963446 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-19523f66-ed46-407d-ae0d-9dc50ced98bb req-acedbb42-ea24-4a94-b310-386a9a11260e service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:15.965830 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-19523f66-ed46-407d-ae0d-9dc50ced98bb req-acedbb42-ea24-4a94-b310-386a9a11260e service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:16.024089 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-19523f66-ed46-407d-ae0d-9dc50ced98bb req-acedbb42-ea24-4a94-b310-386a9a11260e service nova] Creating event network-vif-plugged:96594cb2-dc29-4cce-9364-8fca3f454e94 for instance 89d969cd-5514-4a4d-9c3c-1b408fff2f44 on nch1-master-1 Oct 08 21:09:16.043780 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-19523f66-ed46-407d-ae0d-9dc50ced98bb req-acedbb42-ea24-4a94-b310-386a9a11260e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.144659 Oct 08 21:09:16.050258 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2002/4093] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:09:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:09:16.083192 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-b697e797-3827-4888-ae3b-c1403e2bd887 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Calling method '.version_select at 0x7f1a8c113a60>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:16.203810 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-b697e797-3827-4888-ae3b-c1403e2bd887 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "GET /compute/v2.1/images/ed86c272-4be6-4a44-bd79-2a964b0f06f7" status: 200 len: 1411 microversion: 2.1 time: 0.138088 Oct 08 21:09:16.205872 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2003/4094] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:09:16 2022] GET /compute/v2.1/images/ed86c272-4be6-4a44-bd79-2a964b0f06f7 => generated 1411 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:09:16.332481 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-cb6a5d8e-afd2-49c9-bcdd-99597a05e17a tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78e9afd772c4de981cac8f5817ec356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765c62cac2ee4406b23a5baa85c52ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:16.347327 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-cb6a5d8e-afd2-49c9-bcdd-99597a05e17a tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/ba5cd412-0d20-4d2e-9f5e-de18f268008a" status: 200 len: 1314 microversion: 2.1 time: 0.444074 Oct 08 21:09:16.348535 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2092/4095] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:15 2022] GET /compute/v2.1/servers/ba5cd412-0d20-4d2e-9f5e-de18f268008a => generated 1314 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:09:16.474787 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-5ac1fe2d-1bd7-40a1-ab0a-e4ac630d85d1 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:16.475432 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-5ac1fe2d-1bd7-40a1-ab0a-e4ac630d85d1 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: 89d969cd-5514-4a4d-9c3c-1b408fff2f44] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:16.495974 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5ac1fe2d-1bd7-40a1-ab0a-e4ac630d85d1 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:16.497222 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5ac1fe2d-1bd7-40a1-ab0a-e4ac630d85d1 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:16.497808 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5ac1fe2d-1bd7-40a1-ab0a-e4ac630d85d1 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:16.499245 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5ac1fe2d-1bd7-40a1-ab0a-e4ac630d85d1 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:16.499856 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5ac1fe2d-1bd7-40a1-ab0a-e4ac630d85d1 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:16.500455 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5ac1fe2d-1bd7-40a1-ab0a-e4ac630d85d1 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:16.808694 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-ddabd371-da33-484c-8d84-b7c1e172ccf5 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:16.809369 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-ddabd371-da33-484c-8d84-b7c1e172ccf5 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: 99510c36-821a-41dd-9ffe-8955dda22dcf] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:16.825349 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ddabd371-da33-484c-8d84-b7c1e172ccf5 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:16.834438 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-5ac1fe2d-1bd7-40a1-ab0a-e4ac630d85d1 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:16.850884 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ddabd371-da33-484c-8d84-b7c1e172ccf5 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:16.854000 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ddabd371-da33-484c-8d84-b7c1e172ccf5 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:16.855954 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ddabd371-da33-484c-8d84-b7c1e172ccf5 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:16.856742 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ddabd371-da33-484c-8d84-b7c1e172ccf5 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:16.859059 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-5ac1fe2d-1bd7-40a1-ab0a-e4ac630d85d1 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/89d969cd-5514-4a4d-9c3c-1b408fff2f44" status: 200 len: 1317 microversion: 2.1 time: 0.385306 Oct 08 21:09:16.860208 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ddabd371-da33-484c-8d84-b7c1e172ccf5 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:16.863619 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2004/4096] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:16 2022] GET /compute/v2.1/servers/89d969cd-5514-4a4d-9c3c-1b408fff2f44 => generated 1317 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:09:17.220548 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-9a1b5de5-05b2-401a-91cb-29231a656f8b tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Calling method '.version_select at 0x7f1a8c686ca0>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:17.300578 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-9a1b5de5-05b2-401a-91cb-29231a656f8b tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "GET /compute/v2.1/images/ed86c272-4be6-4a44-bd79-2a964b0f06f7" status: 200 len: 1411 microversion: 2.1 time: 0.084229 Oct 08 21:09:17.305268 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2005/4097] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:09:17 2022] GET /compute/v2.1/images/ed86c272-4be6-4a44-bd79-2a964b0f06f7 => generated 1411 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:09:17.336668 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-ddabd371-da33-484c-8d84-b7c1e172ccf5 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06443b5728fb4d1e95d6245820e786bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ded993145b4eda9d6a33b994519012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:17.347762 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-ddabd371-da33-484c-8d84-b7c1e172ccf5 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "GET /compute/v2.1/servers/99510c36-821a-41dd-9ffe-8955dda22dcf" status: 200 len: 1510 microversion: 2.1 time: 0.545037 Oct 08 21:09:17.370850 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2093/4098] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:16 2022] GET /compute/v2.1/servers/99510c36-821a-41dd-9ffe-8955dda22dcf => generated 1510 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:09:17.383655 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c4391a34-9ca0-4f8b-bdbd-45438176d608 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:17.390204 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-c4391a34-9ca0-4f8b-bdbd-45438176d608 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: ba5cd412-0d20-4d2e-9f5e-de18f268008a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:17.407514 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c4391a34-9ca0-4f8b-bdbd-45438176d608 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:17.410096 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c4391a34-9ca0-4f8b-bdbd-45438176d608 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:17.413593 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c4391a34-9ca0-4f8b-bdbd-45438176d608 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:17.415308 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c4391a34-9ca0-4f8b-bdbd-45438176d608 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:17.422304 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c4391a34-9ca0-4f8b-bdbd-45438176d608 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:17.423665 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c4391a34-9ca0-4f8b-bdbd-45438176d608 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:17.766204 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-c4391a34-9ca0-4f8b-bdbd-45438176d608 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78e9afd772c4de981cac8f5817ec356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765c62cac2ee4406b23a5baa85c52ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:17.779302 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-c4391a34-9ca0-4f8b-bdbd-45438176d608 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/ba5cd412-0d20-4d2e-9f5e-de18f268008a" status: 200 len: 1314 microversion: 2.1 time: 0.405456 Oct 08 21:09:17.784102 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2006/4099] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:17 2022] GET /compute/v2.1/servers/ba5cd412-0d20-4d2e-9f5e-de18f268008a => generated 1314 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:09:17.895880 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-00ff261d-8d4c-4fe7-9a0a-e7eaffe4ffca tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:17.897293 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-00ff261d-8d4c-4fe7-9a0a-e7eaffe4ffca tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: 89d969cd-5514-4a4d-9c3c-1b408fff2f44] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:17.917898 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-00ff261d-8d4c-4fe7-9a0a-e7eaffe4ffca tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:17.922110 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-00ff261d-8d4c-4fe7-9a0a-e7eaffe4ffca tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:17.923231 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-00ff261d-8d4c-4fe7-9a0a-e7eaffe4ffca tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:17.926744 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-00ff261d-8d4c-4fe7-9a0a-e7eaffe4ffca tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:17.927562 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-00ff261d-8d4c-4fe7-9a0a-e7eaffe4ffca tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:17.932438 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-00ff261d-8d4c-4fe7-9a0a-e7eaffe4ffca tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:18.100362 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-48286494-24d7-4261-aa83-623295770aba req-fba176f3-e9d3-4e65-b6b5-32fd4aff73e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba5cd412-0d20-4d2e-9f5e-de18f268008a", "name": "network-vif-plugged", "status": "completed", "tag": "3c7983b1-4926-4db7-acf7-8d73050025e7"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:09:18.128426 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-48286494-24d7-4261-aa83-623295770aba req-fba176f3-e9d3-4e65-b6b5-32fd4aff73e9 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:18.157575 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-48286494-24d7-4261-aa83-623295770aba req-fba176f3-e9d3-4e65-b6b5-32fd4aff73e9 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:18.157575 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-48286494-24d7-4261-aa83-623295770aba req-fba176f3-e9d3-4e65-b6b5-32fd4aff73e9 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:18.186145 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-48286494-24d7-4261-aa83-623295770aba req-fba176f3-e9d3-4e65-b6b5-32fd4aff73e9 service nova] Creating event network-vif-plugged:3c7983b1-4926-4db7-acf7-8d73050025e7 for instance ba5cd412-0d20-4d2e-9f5e-de18f268008a on nch1-master-1 Oct 08 21:09:18.192715 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-48286494-24d7-4261-aa83-623295770aba req-fba176f3-e9d3-4e65-b6b5-32fd4aff73e9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097468 Oct 08 21:09:18.194123 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2007/4100] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:09:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 08 21:09:18.331367 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-80be3022-6655-45b8-9742-18f272c5b27f tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Calling method '.version_select at 0x7f1a87d8b5e0>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:18.439381 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-80be3022-6655-45b8-9742-18f272c5b27f tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "GET /compute/v2.1/images/ed86c272-4be6-4a44-bd79-2a964b0f06f7" status: 200 len: 1411 microversion: 2.1 time: 0.121958 Oct 08 21:09:18.441502 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2008/4101] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:09:18 2022] GET /compute/v2.1/images/ed86c272-4be6-4a44-bd79-2a964b0f06f7 => generated 1411 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:09:18.454631 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-908c3f00-2b0f-4bf3-8f5e-f13028973f17 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:18.455653 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-908c3f00-2b0f-4bf3-8f5e-f13028973f17 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: 99510c36-821a-41dd-9ffe-8955dda22dcf] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:18.464672 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-908c3f00-2b0f-4bf3-8f5e-f13028973f17 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:18.465634 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-908c3f00-2b0f-4bf3-8f5e-f13028973f17 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:18.466225 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-908c3f00-2b0f-4bf3-8f5e-f13028973f17 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:18.467295 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-908c3f00-2b0f-4bf3-8f5e-f13028973f17 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:18.468441 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-908c3f00-2b0f-4bf3-8f5e-f13028973f17 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:18.469353 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-908c3f00-2b0f-4bf3-8f5e-f13028973f17 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:18.550748 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-00ff261d-8d4c-4fe7-9a0a-e7eaffe4ffca tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:18.566957 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-00ff261d-8d4c-4fe7-9a0a-e7eaffe4ffca tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/89d969cd-5514-4a4d-9c3c-1b408fff2f44" status: 200 len: 1504 microversion: 2.1 time: 0.682233 Oct 08 21:09:18.567680 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2094/4102] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:17 2022] GET /compute/v2.1/servers/89d969cd-5514-4a4d-9c3c-1b408fff2f44 => generated 1504 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:09:18.597585 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-77b60003-2640-4505-93ba-5a38e979fde6 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:18.598644 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-77b60003-2640-4505-93ba-5a38e979fde6 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: 89d969cd-5514-4a4d-9c3c-1b408fff2f44] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:18.610897 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-77b60003-2640-4505-93ba-5a38e979fde6 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:18.617928 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-77b60003-2640-4505-93ba-5a38e979fde6 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:18.619199 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-77b60003-2640-4505-93ba-5a38e979fde6 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:18.620703 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-77b60003-2640-4505-93ba-5a38e979fde6 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:18.621421 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-77b60003-2640-4505-93ba-5a38e979fde6 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:18.622366 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-77b60003-2640-4505-93ba-5a38e979fde6 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:18.678219 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-77b60003-2640-4505-93ba-5a38e979fde6 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: 89d969cd-5514-4a4d-9c3c-1b408fff2f44] Going to try to terminate instance {{(pid=140492) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 21:09:18.713610 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-908c3f00-2b0f-4bf3-8f5e-f13028973f17 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06443b5728fb4d1e95d6245820e786bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ded993145b4eda9d6a33b994519012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:18.724253 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-908c3f00-2b0f-4bf3-8f5e-f13028973f17 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "GET /compute/v2.1/servers/99510c36-821a-41dd-9ffe-8955dda22dcf" status: 200 len: 1510 microversion: 2.1 time: 0.281501 Oct 08 21:09:18.737817 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2009/4103] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:18 2022] GET /compute/v2.1/servers/99510c36-821a-41dd-9ffe-8955dda22dcf => generated 1510 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:09:18.822856 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-7731afdf-1e6e-41ff-aee4-16c17bae8d85 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:18.823810 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-7731afdf-1e6e-41ff-aee4-16c17bae8d85 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: ba5cd412-0d20-4d2e-9f5e-de18f268008a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:18.844439 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7731afdf-1e6e-41ff-aee4-16c17bae8d85 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:18.847779 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7731afdf-1e6e-41ff-aee4-16c17bae8d85 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:18.848733 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7731afdf-1e6e-41ff-aee4-16c17bae8d85 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:18.850017 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7731afdf-1e6e-41ff-aee4-16c17bae8d85 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:18.850669 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7731afdf-1e6e-41ff-aee4-16c17bae8d85 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:18.851880 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7731afdf-1e6e-41ff-aee4-16c17bae8d85 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:18.859416 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:09:18.867232 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=100 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:09:18.918628 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-77b60003-2640-4505-93ba-5a38e979fde6 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "DELETE /compute/v2.1/servers/89d969cd-5514-4a4d-9c3c-1b408fff2f44" status: 204 len: 0 microversion: 2.1 time: 0.324717 Oct 08 21:09:18.920242 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2095/4104] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:09:18 2022] DELETE /compute/v2.1/servers/89d969cd-5514-4a4d-9c3c-1b408fff2f44 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 21:09:18.933453 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-4e29e487-9645-484e-becb-0bd28a527fe6 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:18.934548 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-4e29e487-9645-484e-becb-0bd28a527fe6 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: 89d969cd-5514-4a4d-9c3c-1b408fff2f44] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:18.955392 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4e29e487-9645-484e-becb-0bd28a527fe6 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:18.956410 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4e29e487-9645-484e-becb-0bd28a527fe6 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:18.957039 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4e29e487-9645-484e-becb-0bd28a527fe6 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:18.958075 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4e29e487-9645-484e-becb-0bd28a527fe6 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:18.958749 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4e29e487-9645-484e-becb-0bd28a527fe6 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:18.959508 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4e29e487-9645-484e-becb-0bd28a527fe6 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:19.114576 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-7731afdf-1e6e-41ff-aee4-16c17bae8d85 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78e9afd772c4de981cac8f5817ec356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765c62cac2ee4406b23a5baa85c52ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:19.140912 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-7731afdf-1e6e-41ff-aee4-16c17bae8d85 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/ba5cd412-0d20-4d2e-9f5e-de18f268008a" status: 200 len: 1314 microversion: 2.1 time: 0.323375 Oct 08 21:09:19.141592 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2010/4105] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:18 2022] GET /compute/v2.1/servers/ba5cd412-0d20-4d2e-9f5e-de18f268008a => generated 1314 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:09:19.315957 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-4e29e487-9645-484e-becb-0bd28a527fe6 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:19.325107 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-4e29e487-9645-484e-becb-0bd28a527fe6 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/89d969cd-5514-4a4d-9c3c-1b408fff2f44" status: 200 len: 1510 microversion: 2.1 time: 0.399200 Oct 08 21:09:19.330458 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2096/4106] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:18 2022] GET /compute/v2.1/servers/89d969cd-5514-4a4d-9c3c-1b408fff2f44 => generated 1510 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:09:19.457599 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-60ef5ee0-5774-4075-97be-31c3def43f07 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Calling method '.version_select at 0x7f1a8c9e6f70>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:19.520955 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-60ef5ee0-5774-4075-97be-31c3def43f07 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "GET /compute/v2.1/images/ed86c272-4be6-4a44-bd79-2a964b0f06f7" status: 200 len: 1411 microversion: 2.1 time: 0.067399 Oct 08 21:09:19.523501 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2011/4107] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:09:19 2022] GET /compute/v2.1/images/ed86c272-4be6-4a44-bd79-2a964b0f06f7 => generated 1411 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:09:19.753595 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-b2571dc8-c2cf-48cf-a238-b04c3441194d tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:19.754585 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-b2571dc8-c2cf-48cf-a238-b04c3441194d tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: 99510c36-821a-41dd-9ffe-8955dda22dcf] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:19.765314 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b2571dc8-c2cf-48cf-a238-b04c3441194d tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:19.768160 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b2571dc8-c2cf-48cf-a238-b04c3441194d tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:19.768949 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b2571dc8-c2cf-48cf-a238-b04c3441194d tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:19.773127 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b2571dc8-c2cf-48cf-a238-b04c3441194d tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:19.773748 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b2571dc8-c2cf-48cf-a238-b04c3441194d tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:19.775822 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b2571dc8-c2cf-48cf-a238-b04c3441194d tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:20.167809 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-578270aa-dbea-4236-88f8-0af8a8c165d8 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:20.168432 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-578270aa-dbea-4236-88f8-0af8a8c165d8 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: ba5cd412-0d20-4d2e-9f5e-de18f268008a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:20.176365 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-578270aa-dbea-4236-88f8-0af8a8c165d8 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:20.177106 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-578270aa-dbea-4236-88f8-0af8a8c165d8 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:20.177714 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-578270aa-dbea-4236-88f8-0af8a8c165d8 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:20.178580 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-578270aa-dbea-4236-88f8-0af8a8c165d8 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:20.179193 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-578270aa-dbea-4236-88f8-0af8a8c165d8 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:20.179762 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-578270aa-dbea-4236-88f8-0af8a8c165d8 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:20.369405 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-578270aa-dbea-4236-88f8-0af8a8c165d8 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78e9afd772c4de981cac8f5817ec356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765c62cac2ee4406b23a5baa85c52ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:20.386385 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-578270aa-dbea-4236-88f8-0af8a8c165d8 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/ba5cd412-0d20-4d2e-9f5e-de18f268008a" status: 200 len: 1314 microversion: 2.1 time: 0.219444 Oct 08 21:09:20.388307 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2012/4108] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:20 2022] GET /compute/v2.1/servers/ba5cd412-0d20-4d2e-9f5e-de18f268008a => generated 1314 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:09:20.401909 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-318f2b37-0091-4c5e-afa8-ad533e4dbfac tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:20.402718 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-318f2b37-0091-4c5e-afa8-ad533e4dbfac tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: 89d969cd-5514-4a4d-9c3c-1b408fff2f44] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:20.413140 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-318f2b37-0091-4c5e-afa8-ad533e4dbfac tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:20.414041 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-318f2b37-0091-4c5e-afa8-ad533e4dbfac tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:20.414699 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-318f2b37-0091-4c5e-afa8-ad533e4dbfac tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:20.416324 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-318f2b37-0091-4c5e-afa8-ad533e4dbfac tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:20.417177 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-318f2b37-0091-4c5e-afa8-ad533e4dbfac tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:20.417844 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-318f2b37-0091-4c5e-afa8-ad533e4dbfac tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:20.566238 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-b2571dc8-c2cf-48cf-a238-b04c3441194d tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06443b5728fb4d1e95d6245820e786bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ded993145b4eda9d6a33b994519012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:20.579958 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-b2571dc8-c2cf-48cf-a238-b04c3441194d tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "GET /compute/v2.1/servers/99510c36-821a-41dd-9ffe-8955dda22dcf" status: 200 len: 1510 microversion: 2.1 time: 0.827898 Oct 08 21:09:20.580847 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2097/4109] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:19 2022] GET /compute/v2.1/servers/99510c36-821a-41dd-9ffe-8955dda22dcf => generated 1510 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:09:20.590264 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-827a47e9-87fd-4c1e-a01b-5728fc0ddc73 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Calling method '.version_select at 0x7f1a87614ca0>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:20.655174 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-827a47e9-87fd-4c1e-a01b-5728fc0ddc73 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "GET /compute/v2.1/images/ed86c272-4be6-4a44-bd79-2a964b0f06f7" status: 200 len: 1411 microversion: 2.1 time: 0.071593 Oct 08 21:09:20.663793 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2098/4110] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:09:20 2022] GET /compute/v2.1/images/ed86c272-4be6-4a44-bd79-2a964b0f06f7 => generated 1411 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:09:20.664800 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-318f2b37-0091-4c5e-afa8-ad533e4dbfac tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:20.683188 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-318f2b37-0091-4c5e-afa8-ad533e4dbfac tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/89d969cd-5514-4a4d-9c3c-1b408fff2f44" status: 200 len: 1510 microversion: 2.1 time: 0.292207 Oct 08 21:09:20.683801 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2013/4111] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:20 2022] GET /compute/v2.1/servers/89d969cd-5514-4a4d-9c3c-1b408fff2f44 => generated 1510 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:09:21.413045 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-b3c274be-b38b-4121-acda-5b3b54be21fb tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:21.413980 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-b3c274be-b38b-4121-acda-5b3b54be21fb tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: ba5cd412-0d20-4d2e-9f5e-de18f268008a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:21.451384 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b3c274be-b38b-4121-acda-5b3b54be21fb tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:21.452475 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b3c274be-b38b-4121-acda-5b3b54be21fb tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:21.453177 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b3c274be-b38b-4121-acda-5b3b54be21fb tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:21.456320 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b3c274be-b38b-4121-acda-5b3b54be21fb tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:21.457214 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b3c274be-b38b-4121-acda-5b3b54be21fb tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:21.458399 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b3c274be-b38b-4121-acda-5b3b54be21fb tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:21.604908 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-1e1b4132-c536-4d91-956e-5723d83f6b9a tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:21.605607 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-1e1b4132-c536-4d91-956e-5723d83f6b9a tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: 99510c36-821a-41dd-9ffe-8955dda22dcf] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:21.616081 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1e1b4132-c536-4d91-956e-5723d83f6b9a tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:21.619720 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1e1b4132-c536-4d91-956e-5723d83f6b9a tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:21.621540 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1e1b4132-c536-4d91-956e-5723d83f6b9a tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:21.627374 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1e1b4132-c536-4d91-956e-5723d83f6b9a tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:21.628074 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1e1b4132-c536-4d91-956e-5723d83f6b9a tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:21.628694 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1e1b4132-c536-4d91-956e-5723d83f6b9a tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:21.842038 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-b3c274be-b38b-4121-acda-5b3b54be21fb tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78e9afd772c4de981cac8f5817ec356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765c62cac2ee4406b23a5baa85c52ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:21.861801 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-b3c274be-b38b-4121-acda-5b3b54be21fb tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/ba5cd412-0d20-4d2e-9f5e-de18f268008a" status: 200 len: 1500 microversion: 2.1 time: 0.446476 Oct 08 21:09:21.862853 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2099/4112] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:21 2022] GET /compute/v2.1/servers/ba5cd412-0d20-4d2e-9f5e-de18f268008a => generated 1500 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:09:21.869409 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-defcee9e-7335-44b9-b6df-0edad350cc9d tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Calling method '.version_select at 0x7f1a87591a60>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:21.958472 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-defcee9e-7335-44b9-b6df-0edad350cc9d tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "GET /compute/v2.1/images/ed86c272-4be6-4a44-bd79-2a964b0f06f7" status: 200 len: 1411 microversion: 2.1 time: 0.094421 Oct 08 21:09:21.967494 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2100/4113] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:09:21 2022] GET /compute/v2.1/images/ed86c272-4be6-4a44-bd79-2a964b0f06f7 => generated 1411 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:09:22.005903 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-337d9206-ffa8-432e-b7d2-f23e24f7859c tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:22.006830 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-337d9206-ffa8-432e-b7d2-f23e24f7859c tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: 89d969cd-5514-4a4d-9c3c-1b408fff2f44] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:22.017168 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-337d9206-ffa8-432e-b7d2-f23e24f7859c tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:22.019844 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-337d9206-ffa8-432e-b7d2-f23e24f7859c tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:22.020502 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-337d9206-ffa8-432e-b7d2-f23e24f7859c tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:22.021632 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-337d9206-ffa8-432e-b7d2-f23e24f7859c tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:22.022310 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-337d9206-ffa8-432e-b7d2-f23e24f7859c tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:22.022898 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-337d9206-ffa8-432e-b7d2-f23e24f7859c tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:22.065727 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-1e1b4132-c536-4d91-956e-5723d83f6b9a tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06443b5728fb4d1e95d6245820e786bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ded993145b4eda9d6a33b994519012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:22.078420 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-1e1b4132-c536-4d91-956e-5723d83f6b9a tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "GET /compute/v2.1/servers/99510c36-821a-41dd-9ffe-8955dda22dcf" status: 200 len: 1510 microversion: 2.1 time: 0.477299 Oct 08 21:09:22.080639 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2014/4114] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:21 2022] GET /compute/v2.1/servers/99510c36-821a-41dd-9ffe-8955dda22dcf => generated 1510 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:09:22.094896 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-4882c755-7b2a-4c3a-9b6e-b88c1406df41 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:09:22.095734 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-4882c755-7b2a-4c3a-9b6e-b88c1406df41 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: ba5cd412-0d20-4d2e-9f5e-de18f268008a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:22.105077 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4882c755-7b2a-4c3a-9b6e-b88c1406df41 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:22.106139 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4882c755-7b2a-4c3a-9b6e-b88c1406df41 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:22.106914 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4882c755-7b2a-4c3a-9b6e-b88c1406df41 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:22.108517 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4882c755-7b2a-4c3a-9b6e-b88c1406df41 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:22.109154 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4882c755-7b2a-4c3a-9b6e-b88c1406df41 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:22.109792 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4882c755-7b2a-4c3a-9b6e-b88c1406df41 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:22.151727 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.objects.instance [None req-4882c755-7b2a-4c3a-9b6e-b88c1406df41 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lazy-loading 'flavor' on Instance uuid ba5cd412-0d20-4d2e-9f5e-de18f268008a {{(pid=140491) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 21:09:22.161771 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-337d9206-ffa8-432e-b7d2-f23e24f7859c tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:22.177581 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-337d9206-ffa8-432e-b7d2-f23e24f7859c tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/89d969cd-5514-4a4d-9c3c-1b408fff2f44" status: 200 len: 1468 microversion: 2.1 time: 0.204555 Oct 08 21:09:22.182403 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2101/4115] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:21 2022] GET /compute/v2.1/servers/89d969cd-5514-4a4d-9c3c-1b408fff2f44 => generated 1468 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:09:22.345110 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-7951e2d8-7716-4670-876d-22781c9befc0 req-16d28928-1baf-4796-9070-24e4cc637134 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89d969cd-5514-4a4d-9c3c-1b408fff2f44", "name": "network-vif-deleted", "tag": "96594cb2-dc29-4cce-9364-8fca3f454e94"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:09:22.375490 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-7951e2d8-7716-4670-876d-22781c9befc0 req-16d28928-1baf-4796-9070-24e4cc637134 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:22.377520 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-7951e2d8-7716-4670-876d-22781c9befc0 req-16d28928-1baf-4796-9070-24e4cc637134 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:22.378068 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-7951e2d8-7716-4670-876d-22781c9befc0 req-16d28928-1baf-4796-9070-24e4cc637134 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:22.427369 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-7951e2d8-7716-4670-876d-22781c9befc0 req-16d28928-1baf-4796-9070-24e4cc637134 service nova] Creating event network-vif-deleted:96594cb2-dc29-4cce-9364-8fca3f454e94 for instance 89d969cd-5514-4a4d-9c3c-1b408fff2f44 on nch1-master-1 Oct 08 21:09:22.438070 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-7951e2d8-7716-4670-876d-22781c9befc0 req-16d28928-1baf-4796-9070-24e4cc637134 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106678 Oct 08 21:09:22.441570 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2102/4116] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:09:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:09:22.451995 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-fa57982c-94de-44e0-bd04-232268b06a9e tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:22.452598 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-fa57982c-94de-44e0-bd04-232268b06a9e tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] [instance: 159e29dd-802c-4059-99f9-bb7c113d430b] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:22.471226 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fa57982c-94de-44e0-bd04-232268b06a9e tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:22.471730 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fa57982c-94de-44e0-bd04-232268b06a9e tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:22.483035 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fa57982c-94de-44e0-bd04-232268b06a9e tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:22.485285 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fa57982c-94de-44e0-bd04-232268b06a9e tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:22.485963 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fa57982c-94de-44e0-bd04-232268b06a9e tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:22.486592 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fa57982c-94de-44e0-bd04-232268b06a9e tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:22.538369 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-fa57982c-94de-44e0-bd04-232268b06a9e tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] 10.222.0.26 "GET /compute/v2.1/servers/159e29dd-802c-4059-99f9-bb7c113d430b/ips" status: 200 len: 151 microversion: 2.20 time: 0.095293 Oct 08 21:09:22.540008 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2103/4117] 10.222.0.26 () {60 vars in 1289 bytes} [Sat Oct 8 21:09:22 2022] GET /compute/v2.1/servers/159e29dd-802c-4059-99f9-bb7c113d430b/ips => generated 151 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 08 21:09:22.704721 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-4882c755-7b2a-4c3a-9b6e-b88c1406df41 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "POST /compute/v2.1/servers/ba5cd412-0d20-4d2e-9f5e-de18f268008a/action" status: 202 len: 0 microversion: 2.1 time: 0.621152 Oct 08 21:09:22.735241 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-85dcc6c9-7892-4386-9ec0-0e3a1fff2cc8 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:22.735938 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-85dcc6c9-7892-4386-9ec0-0e3a1fff2cc8 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: ba5cd412-0d20-4d2e-9f5e-de18f268008a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:22.740123 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2015/4118] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:09:22 2022] POST /compute/v2.1/servers/ba5cd412-0d20-4d2e-9f5e-de18f268008a/action => generated 0 bytes in 641 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 21:09:22.751142 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-85dcc6c9-7892-4386-9ec0-0e3a1fff2cc8 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:22.752496 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-85dcc6c9-7892-4386-9ec0-0e3a1fff2cc8 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:22.753119 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-85dcc6c9-7892-4386-9ec0-0e3a1fff2cc8 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:22.754361 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-85dcc6c9-7892-4386-9ec0-0e3a1fff2cc8 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:22.756635 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-85dcc6c9-7892-4386-9ec0-0e3a1fff2cc8 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:22.757277 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-85dcc6c9-7892-4386-9ec0-0e3a1fff2cc8 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:22.982092 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-1c602156-f71b-4299-bdf7-7709929760c8 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Calling method '.version_select at 0x7f1a8c061670>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:23.085977 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-85dcc6c9-7892-4386-9ec0-0e3a1fff2cc8 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78e9afd772c4de981cac8f5817ec356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765c62cac2ee4406b23a5baa85c52ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:23.107235 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-1c602156-f71b-4299-bdf7-7709929760c8 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "GET /compute/v2.1/images/ed86c272-4be6-4a44-bd79-2a964b0f06f7" status: 200 len: 1411 microversion: 2.1 time: 0.135937 Oct 08 21:09:23.108468 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-85dcc6c9-7892-4386-9ec0-0e3a1fff2cc8 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/ba5cd412-0d20-4d2e-9f5e-de18f268008a" status: 200 len: 1506 microversion: 2.1 time: 0.367223 Oct 08 21:09:23.118776 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2016/4119] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:09:22 2022] GET /compute/v2.1/images/ed86c272-4be6-4a44-bd79-2a964b0f06f7 => generated 1411 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:09:23.119651 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2104/4120] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:22 2022] GET /compute/v2.1/servers/ba5cd412-0d20-4d2e-9f5e-de18f268008a => generated 1506 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:09:23.132859 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-3dfb08ab-0677-42b2-8c6a-8a271ac20881 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:23.134004 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-3dfb08ab-0677-42b2-8c6a-8a271ac20881 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: 99510c36-821a-41dd-9ffe-8955dda22dcf] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:23.145901 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3dfb08ab-0677-42b2-8c6a-8a271ac20881 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:23.149526 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3dfb08ab-0677-42b2-8c6a-8a271ac20881 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:23.151297 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3dfb08ab-0677-42b2-8c6a-8a271ac20881 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:23.153415 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3dfb08ab-0677-42b2-8c6a-8a271ac20881 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:23.155652 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3dfb08ab-0677-42b2-8c6a-8a271ac20881 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:23.156319 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3dfb08ab-0677-42b2-8c6a-8a271ac20881 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:23.201960 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-f1b930dc-0e19-4061-a903-f0cb1054a143 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:23.202612 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-f1b930dc-0e19-4061-a903-f0cb1054a143 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: 89d969cd-5514-4a4d-9c3c-1b408fff2f44] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:23.220250 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f1b930dc-0e19-4061-a903-f0cb1054a143 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:23.220822 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f1b930dc-0e19-4061-a903-f0cb1054a143 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:23.221226 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f1b930dc-0e19-4061-a903-f0cb1054a143 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:23.228604 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f1b930dc-0e19-4061-a903-f0cb1054a143 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:23.229113 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f1b930dc-0e19-4061-a903-f0cb1054a143 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:23.246212 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f1b930dc-0e19-4061-a903-f0cb1054a143 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:23.331684 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f1b930dc-0e19-4061-a903-f0cb1054a143 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:23.347176 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f1b930dc-0e19-4061-a903-f0cb1054a143 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:23.348273 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f1b930dc-0e19-4061-a903-f0cb1054a143 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:23.353906 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.objects.instance [None req-f1b930dc-0e19-4061-a903-f0cb1054a143 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lazy-loading 'fault' on Instance uuid 89d969cd-5514-4a4d-9c3c-1b408fff2f44 {{(pid=140492) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 21:09:23.440030 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-f1b930dc-0e19-4061-a903-f0cb1054a143 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:23.455186 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-f1b930dc-0e19-4061-a903-f0cb1054a143 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/89d969cd-5514-4a4d-9c3c-1b408fff2f44" status: 200 len: 1307 microversion: 2.1 time: 0.257536 Oct 08 21:09:23.461313 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2105/4121] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:23 2022] GET /compute/v2.1/servers/89d969cd-5514-4a4d-9c3c-1b408fff2f44 => generated 1307 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:09:23.619939 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-3dfb08ab-0677-42b2-8c6a-8a271ac20881 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06443b5728fb4d1e95d6245820e786bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ded993145b4eda9d6a33b994519012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:23.644154 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-3dfb08ab-0677-42b2-8c6a-8a271ac20881 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "GET /compute/v2.1/servers/99510c36-821a-41dd-9ffe-8955dda22dcf" status: 200 len: 1510 microversion: 2.1 time: 0.522304 Oct 08 21:09:23.644866 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2017/4122] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:23 2022] GET /compute/v2.1/servers/99510c36-821a-41dd-9ffe-8955dda22dcf => generated 1510 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:09:24.130840 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-d8767774-fd89-452b-a7d4-6314bce0f958 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Calling method '.version_select at 0x7f1a8760b550>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:24.136313 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-288760be-3726-43d5-854c-d1101bcb497c tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:24.139330 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-288760be-3726-43d5-854c-d1101bcb497c tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: ba5cd412-0d20-4d2e-9f5e-de18f268008a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:24.156718 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-288760be-3726-43d5-854c-d1101bcb497c tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:24.157246 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-288760be-3726-43d5-854c-d1101bcb497c tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:24.166354 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-288760be-3726-43d5-854c-d1101bcb497c tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:24.168274 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-288760be-3726-43d5-854c-d1101bcb497c tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:24.168274 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-288760be-3726-43d5-854c-d1101bcb497c tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:24.168668 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-288760be-3726-43d5-854c-d1101bcb497c tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:24.203420 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-d8767774-fd89-452b-a7d4-6314bce0f958 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "GET /compute/v2.1/images/ed86c272-4be6-4a44-bd79-2a964b0f06f7" status: 200 len: 1411 microversion: 2.1 time: 0.081258 Oct 08 21:09:24.204891 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2106/4123] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:09:24 2022] GET /compute/v2.1/images/ed86c272-4be6-4a44-bd79-2a964b0f06f7 => generated 1411 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:09:24.488902 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-c3dab302-9a42-412c-9cea-1e8f865230f1 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:24.489677 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-c3dab302-9a42-412c-9cea-1e8f865230f1 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: 89d969cd-5514-4a4d-9c3c-1b408fff2f44] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:24.497579 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c3dab302-9a42-412c-9cea-1e8f865230f1 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:24.498538 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c3dab302-9a42-412c-9cea-1e8f865230f1 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:24.499246 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c3dab302-9a42-412c-9cea-1e8f865230f1 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:24.500197 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c3dab302-9a42-412c-9cea-1e8f865230f1 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:24.500915 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c3dab302-9a42-412c-9cea-1e8f865230f1 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:24.501599 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c3dab302-9a42-412c-9cea-1e8f865230f1 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:24.502429 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-288760be-3726-43d5-854c-d1101bcb497c tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78e9afd772c4de981cac8f5817ec356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765c62cac2ee4406b23a5baa85c52ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:24.511840 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-288760be-3726-43d5-854c-d1101bcb497c tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/ba5cd412-0d20-4d2e-9f5e-de18f268008a" status: 200 len: 1506 microversion: 2.1 time: 0.379587 Oct 08 21:09:24.515542 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2018/4124] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:24 2022] GET /compute/v2.1/servers/ba5cd412-0d20-4d2e-9f5e-de18f268008a => generated 1506 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:09:24.532631 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-c3dab302-9a42-412c-9cea-1e8f865230f1 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] HTTP exception thrown: Instance 89d969cd-5514-4a4d-9c3c-1b408fff2f44 could not be found. Oct 08 21:09:24.535618 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-c3dab302-9a42-412c-9cea-1e8f865230f1 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Request method failure captured: Oct 08 21:09:24.535618 ncdv-master-1 devstack@n-api.service[140492]: request: GET /compute/v2.1/servers/89d969cd-5514-4a4d-9c3c-1b408fff2f44 HTTP/1.1 Oct 08 21:09:24.535618 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:09:24.535618 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:09:24.535618 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:09:24.535618 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 21:09:24.535618 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:09:24.535618 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:09:24.535618 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:09:24.535618 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:09:24.535618 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQebW09Z3m936-d3SrnQA9UQ3KXQvUYeQwL43ufWdoxmQhUwYBWv-JT053t_VYPo9wAVRoCqYQy8Hhh8zc2n570KpS0qNVLik822FjYabkSIZMA_ubWypXzSwo3J04zV1MoSSz79D-b8-ZvwYCEIbwpbfyn5opgOjnO6EXvq1UNPaSyQ Oct 08 21:09:24.535618 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:09:24.535618 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:09:24.535618 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:09:24.535618 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:09:24.535618 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:09:24.535618 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:09:24.535618 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 0ae02675057e4f27bc1980348afc8ca1 Oct 08 21:09:24.535618 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-ServersNegativeTestJSON-1441071354 Oct 08 21:09:24.535618 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:09:24.535618 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:09:24.535618 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0ae02675057e4f27bc1980348afc8ca1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0ae02675057e4f27bc1980348afc8ca1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0ae02675057e4f27bc1980348afc8ca1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0ae02675057e4f27bc1980348afc8ca1"}]}] Oct 08 21:09:24.535618 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-ServersNegativeTestJSON-1441071354 Oct 08 21:09:24.535618 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 0ae02675057e4f27bc1980348afc8ca1 Oct 08 21:09:24.535618 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1441071354 Oct 08 21:09:24.535618 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-ServersNegativeTestJSON-1441071354-project Oct 08 21:09:24.535618 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:09:24.535618 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:09:24.535618 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 6a78d352c143483c8e4702d789d4c516 Oct 08 21:09:24.535618 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-ServersNegativeTestJSON-1441071354-project Oct 08 21:09:24.535618 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 21:09:24.535618 ncdv-master-1 devstack@n-api.service[140492]: exception: Instance 89d969cd-5514-4a4d-9c3c-1b408fff2f44 could not be found. Oct 08 21:09:24.535618 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': '89d969cd-5514-4a4d-9c3c-1b408fff2f44'} Oct 08 21:09:24.535618 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:09:24.535618 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:09:24.535618 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:09:24.535618 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:09:24.535618 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:09:24.535618 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:09:24.535618 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:09:24.535618 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:09:24.535618 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:09:24.535618 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:09:24.535618 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89d969cd-5514-4a4d-9c3c-1b408fff2f44 could not be found. Oct 08 21:09:24.535618 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:09:24.535618 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:09:24.535618 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:09:24.535618 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:09:24.535618 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:09:24.535618 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:09:24.535618 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:09:24.535618 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:09:24.535618 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:09:24.535618 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:09:24.535618 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:09:24.535618 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:09:24.535618 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:09:24.535618 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:09:24.535618 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:09:24.535618 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:09:24.535618 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89d969cd-5514-4a4d-9c3c-1b408fff2f44 could not be found. Oct 08 21:09:24.535618 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:09:24.535618 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:09:24.535618 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:09:24.539151 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:09:24.539151 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:09:24.539151 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:09:24.539151 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:09:24.539151 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:09:24.539151 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89d969cd-5514-4a4d-9c3c-1b408fff2f44 could not be found. Oct 08 21:09:24.539151 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:09:24.541598 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-c3dab302-9a42-412c-9cea-1e8f865230f1 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Returning 404 to user: Instance 89d969cd-5514-4a4d-9c3c-1b408fff2f44 could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:09:24.543177 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-c3dab302-9a42-412c-9cea-1e8f865230f1 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/89d969cd-5514-4a4d-9c3c-1b408fff2f44" status: 404 len: 111 microversion: 2.1 time: 0.059763 Oct 08 21:09:24.544739 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2107/4125] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:24 2022] GET /compute/v2.1/servers/89d969cd-5514-4a4d-9c3c-1b408fff2f44 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 08 21:09:24.558066 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-ce31850f-f86f-4443-9a76-658a97056eca tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:24.559484 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-ce31850f-f86f-4443-9a76-658a97056eca tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:24.566762 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ce31850f-f86f-4443-9a76-658a97056eca tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:24.567508 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ce31850f-f86f-4443-9a76-658a97056eca tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:24.568140 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ce31850f-f86f-4443-9a76-658a97056eca tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:24.569024 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ce31850f-f86f-4443-9a76-658a97056eca tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:24.569670 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ce31850f-f86f-4443-9a76-658a97056eca tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:24.570258 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ce31850f-f86f-4443-9a76-658a97056eca tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:24.669508 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-d7552d00-3615-4229-bf58-106c9ec44f4e tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:24.670469 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-d7552d00-3615-4229-bf58-106c9ec44f4e tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: 99510c36-821a-41dd-9ffe-8955dda22dcf] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:24.683424 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d7552d00-3615-4229-bf58-106c9ec44f4e tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:24.684117 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d7552d00-3615-4229-bf58-106c9ec44f4e tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:24.691215 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d7552d00-3615-4229-bf58-106c9ec44f4e tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:24.692380 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d7552d00-3615-4229-bf58-106c9ec44f4e tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:24.693021 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d7552d00-3615-4229-bf58-106c9ec44f4e tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:24.693755 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d7552d00-3615-4229-bf58-106c9ec44f4e tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:24.902628 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-ce31850f-f86f-4443-9a76-658a97056eca tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:24.911957 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-ce31850f-f86f-4443-9a76-658a97056eca tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 200 len: 1503 microversion: 2.1 time: 0.362747 Oct 08 21:09:24.915137 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2019/4126] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:24 2022] GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 1503 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:09:24.926194 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-d7552d00-3615-4229-bf58-106c9ec44f4e tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06443b5728fb4d1e95d6245820e786bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ded993145b4eda9d6a33b994519012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:24.939658 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-d7552d00-3615-4229-bf58-106c9ec44f4e tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "GET /compute/v2.1/servers/99510c36-821a-41dd-9ffe-8955dda22dcf" status: 200 len: 1510 microversion: 2.1 time: 0.274947 Oct 08 21:09:24.940473 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2108/4127] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:24 2022] GET /compute/v2.1/servers/99510c36-821a-41dd-9ffe-8955dda22dcf => generated 1510 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:09:25.017679 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-4bd4afeb-9030-4a21-90ce-6d230dfed524 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "networks": [{"uuid": "0af78ecb-f6e3-458a-ab57-630925a05ff0"}]}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:09:25.026087 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-4bd4afeb-9030-4a21-90ce-6d230dfed524 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Request method failure captured: Oct 08 21:09:25.026087 ncdv-master-1 devstack@n-api.service[140491]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 08 21:09:25.026087 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:09:25.026087 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:09:25.026087 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:09:25.026087 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 163 Oct 08 21:09:25.026087 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:09:25.026087 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:09:25.026087 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:09:25.026087 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:09:25.026087 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQebW09Z3m936-d3SrnQA9UQ3KXQvUYeQwL43ufWdoxmQhUwYBWv-JT053t_VYPo9wAVRoCqYQy8Hhh8zc2n570KpS0qNVLik822FjYabkSIZMA_ubWypXzSwo3J04zV1MoSSz79D-b8-ZvwYCEIbwpbfyn5opgOjnO6EXvq1UNPaSyQ Oct 08 21:09:25.026087 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:09:25.026087 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:09:25.026087 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:09:25.026087 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:09:25.026087 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:09:25.026087 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:09:25.026087 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 0ae02675057e4f27bc1980348afc8ca1 Oct 08 21:09:25.026087 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-ServersNegativeTestJSON-1441071354 Oct 08 21:09:25.026087 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:09:25.026087 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:09:25.026087 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0ae02675057e4f27bc1980348afc8ca1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0ae02675057e4f27bc1980348afc8ca1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0ae02675057e4f27bc1980348afc8ca1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0ae02675057e4f27bc1980348afc8ca1"}]}] Oct 08 21:09:25.026087 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-ServersNegativeTestJSON-1441071354 Oct 08 21:09:25.026087 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 0ae02675057e4f27bc1980348afc8ca1 Oct 08 21:09:25.026087 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1441071354 Oct 08 21:09:25.026087 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-ServersNegativeTestJSON-1441071354-project Oct 08 21:09:25.026087 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:09:25.026087 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:09:25.026087 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 6a78d352c143483c8e4702d789d4c516 Oct 08 21:09:25.026087 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-ServersNegativeTestJSON-1441071354-project Oct 08 21:09:25.026087 ncdv-master-1 devstack@n-api.service[140491]: Oct 08 21:09:25.026087 ncdv-master-1 devstack@n-api.service[140491]: {"server": {"name": 12345, "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "networks": [{"uuid": "0af78ecb-f6e3-458a-ab57-630925a05ff0"}]}} Oct 08 21:09:25.026087 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:09:25.026087 ncdv-master-1 devstack@n-api.service[140491]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 08 21:09:25.026087 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'body': {'server': {'name': 12345, 'imageRef': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'flavorRef': '452', 'networks': [{'uuid': '0af78ecb-f6e3-458a-ab57-630925a05ff0'}]}}} Oct 08 21:09:25.026087 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:09:25.026087 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:09:25.026087 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 08 21:09:25.026087 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 08 21:09:25.026087 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 08 21:09:25.026087 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise error Oct 08 21:09:25.026087 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Oct 08 21:09:25.026087 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:09:25.026087 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Oct 08 21:09:25.026087 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 08 21:09:25.026087 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:09:25.026087 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 08 21:09:25.026087 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi 12345 Oct 08 21:09:25.026087 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:09:25.026087 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:09:25.026087 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:09:25.026087 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:09:25.026087 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:09:25.026087 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:09:25.026087 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:09:25.026087 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:09:25.026087 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:09:25.026087 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:09:25.026087 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 21:09:25.026087 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 21:09:25.026087 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 08 21:09:25.026087 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 08 21:09:25.026087 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 08 21:09:25.026087 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 08 21:09:25.026087 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 08 21:09:25.030298 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 08 21:09:25.030298 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 08 21:09:25.030298 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:09:25.030298 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:09:25.030298 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:09:25.030298 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:09:25.030298 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:09:25.030298 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:09:25.030298 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 08 21:09:25.030298 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 08 21:09:25.030298 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 08 21:09:25.030298 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:09:25.031923 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-4bd4afeb-9030-4a21-90ce-6d230dfed524 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:09:25.032951 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-4bd4afeb-9030-4a21-90ce-6d230dfed524 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.022339 Oct 08 21:09:25.034236 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2020/4128] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 21:09:25 2022] POST /compute/v2.1/servers => generated 127 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 08 21:09:25.043736 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-9c521fe9-fff7-4433-8d25-b714625f2c8f tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:25.044777 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-9c521fe9-fff7-4433-8d25-b714625f2c8f tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:25.055811 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-11764739-774b-46f9-811d-48b8b33fde45 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:09:25.057868 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-11764739-774b-46f9-811d-48b8b33fde45 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] [instance: 159e29dd-802c-4059-99f9-bb7c113d430b] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:25.069466 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9c521fe9-fff7-4433-8d25-b714625f2c8f tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:25.076100 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9c521fe9-fff7-4433-8d25-b714625f2c8f tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:25.076946 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9c521fe9-fff7-4433-8d25-b714625f2c8f tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:25.078041 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9c521fe9-fff7-4433-8d25-b714625f2c8f tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:25.080217 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9c521fe9-fff7-4433-8d25-b714625f2c8f tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:25.080870 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9c521fe9-fff7-4433-8d25-b714625f2c8f tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:25.122372 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-11764739-774b-46f9-811d-48b8b33fde45 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:25.123370 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-11764739-774b-46f9-811d-48b8b33fde45 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:25.124073 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-11764739-774b-46f9-811d-48b8b33fde45 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:25.125074 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-11764739-774b-46f9-811d-48b8b33fde45 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:25.130040 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-11764739-774b-46f9-811d-48b8b33fde45 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:25.132880 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-11764739-774b-46f9-811d-48b8b33fde45 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:25.203770 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.objects.instance [None req-11764739-774b-46f9-811d-48b8b33fde45 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lazy-loading 'flavor' on Instance uuid 159e29dd-802c-4059-99f9-bb7c113d430b {{(pid=140491) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 21:09:25.420659 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-9c521fe9-fff7-4433-8d25-b714625f2c8f tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:25.439848 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-9c521fe9-fff7-4433-8d25-b714625f2c8f tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 200 len: 1503 microversion: 2.1 time: 0.399986 Oct 08 21:09:25.441235 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2109/4129] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:25 2022] GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 1503 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:09:25.487305 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-33f3e34a-6b18-4af5-86b6-829c67dc752c tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Calling method '.version_select at 0x7f1a875a2160>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:25.666744 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-11764739-774b-46f9-811d-48b8b33fde45 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] 10.222.0.26 "POST /compute/v2.1/servers/159e29dd-802c-4059-99f9-bb7c113d430b/action" status: 202 len: 0 microversion: 2.20 time: 0.620224 Oct 08 21:09:25.667424 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2021/4130] 10.222.0.26 () {62 vars in 1319 bytes} [Sat Oct 8 21:09:25 2022] POST /compute/v2.1/servers/159e29dd-802c-4059-99f9-bb7c113d430b/action => generated 0 bytes in 622 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 08 21:09:25.709674 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-196a36f0-e7a5-46a9-a414-6234aca6bd9a tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:25.711280 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-196a36f0-e7a5-46a9-a414-6234aca6bd9a tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:25.730840 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-196a36f0-e7a5-46a9-a414-6234aca6bd9a tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:25.731855 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-196a36f0-e7a5-46a9-a414-6234aca6bd9a tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:25.732937 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-196a36f0-e7a5-46a9-a414-6234aca6bd9a tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:25.733970 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-196a36f0-e7a5-46a9-a414-6234aca6bd9a tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:25.734226 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-33f3e34a-6b18-4af5-86b6-829c67dc752c tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "GET /compute/v2.1/images/ed86c272-4be6-4a44-bd79-2a964b0f06f7" status: 200 len: 1411 microversion: 2.1 time: 0.290838 Oct 08 21:09:25.734949 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2110/4131] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:09:25 2022] GET /compute/v2.1/images/ed86c272-4be6-4a44-bd79-2a964b0f06f7 => generated 1411 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:09:25.744496 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-5fc30f05-3574-49ef-936e-138ee9e28c06 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:25.745218 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-196a36f0-e7a5-46a9-a414-6234aca6bd9a tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:25.745934 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-196a36f0-e7a5-46a9-a414-6234aca6bd9a tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:25.746701 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-5fc30f05-3574-49ef-936e-138ee9e28c06 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: ba5cd412-0d20-4d2e-9f5e-de18f268008a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:25.764760 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5fc30f05-3574-49ef-936e-138ee9e28c06 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:25.765498 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5fc30f05-3574-49ef-936e-138ee9e28c06 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:25.766106 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5fc30f05-3574-49ef-936e-138ee9e28c06 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:25.766911 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5fc30f05-3574-49ef-936e-138ee9e28c06 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:25.768501 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5fc30f05-3574-49ef-936e-138ee9e28c06 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:25.769019 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5fc30f05-3574-49ef-936e-138ee9e28c06 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:26.054370 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-5fc30f05-3574-49ef-936e-138ee9e28c06 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78e9afd772c4de981cac8f5817ec356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765c62cac2ee4406b23a5baa85c52ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:26.072849 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-5fc30f05-3574-49ef-936e-138ee9e28c06 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/ba5cd412-0d20-4d2e-9f5e-de18f268008a" status: 200 len: 1506 microversion: 2.1 time: 0.335935 Oct 08 21:09:26.074276 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2111/4132] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:25 2022] GET /compute/v2.1/servers/ba5cd412-0d20-4d2e-9f5e-de18f268008a => generated 1506 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:09:26.080090 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-eaef7648-547b-4eb2-af4f-f34bb22257f2 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:26.080992 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-eaef7648-547b-4eb2-af4f-f34bb22257f2 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] [instance: 159e29dd-802c-4059-99f9-bb7c113d430b] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:26.091163 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-eaef7648-547b-4eb2-af4f-f34bb22257f2 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:26.092043 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-eaef7648-547b-4eb2-af4f-f34bb22257f2 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:26.092724 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-eaef7648-547b-4eb2-af4f-f34bb22257f2 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:26.094425 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-eaef7648-547b-4eb2-af4f-f34bb22257f2 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:26.095528 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-eaef7648-547b-4eb2-af4f-f34bb22257f2 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:26.096199 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-eaef7648-547b-4eb2-af4f-f34bb22257f2 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:26.102336 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-196a36f0-e7a5-46a9-a414-6234aca6bd9a tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:26.112865 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-196a36f0-e7a5-46a9-a414-6234aca6bd9a tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 200 len: 1503 microversion: 2.1 time: 0.444062 Oct 08 21:09:26.128713 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2022/4133] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:25 2022] GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 1503 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:09:26.134443 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-2e3065ac-9343-469d-a682-a097cb5e3920 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:26.139626 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-2e3065ac-9343-469d-a682-a097cb5e3920 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: 99510c36-821a-41dd-9ffe-8955dda22dcf] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:26.162635 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2e3065ac-9343-469d-a682-a097cb5e3920 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:26.172593 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2e3065ac-9343-469d-a682-a097cb5e3920 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:26.178162 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2e3065ac-9343-469d-a682-a097cb5e3920 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:26.179529 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2e3065ac-9343-469d-a682-a097cb5e3920 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:26.184302 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2e3065ac-9343-469d-a682-a097cb5e3920 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:26.184766 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2e3065ac-9343-469d-a682-a097cb5e3920 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:26.313824 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-eaef7648-547b-4eb2-af4f-f34bb22257f2 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:26.350914 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-eaef7648-547b-4eb2-af4f-f34bb22257f2 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:26.356927 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-eaef7648-547b-4eb2-af4f-f34bb22257f2 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:26.368006 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-eaef7648-547b-4eb2-af4f-f34bb22257f2 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] 10.222.0.26 "GET /compute/v2.1/servers/159e29dd-802c-4059-99f9-bb7c113d430b" status: 200 len: 1722 microversion: 2.20 time: 0.290655 Oct 08 21:09:26.370879 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2112/4134] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:09:26 2022] GET /compute/v2.1/servers/159e29dd-802c-4059-99f9-bb7c113d430b => generated 1722 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:09:26.637444 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-2e3065ac-9343-469d-a682-a097cb5e3920 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06443b5728fb4d1e95d6245820e786bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ded993145b4eda9d6a33b994519012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:26.656242 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-2e3065ac-9343-469d-a682-a097cb5e3920 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "GET /compute/v2.1/servers/99510c36-821a-41dd-9ffe-8955dda22dcf" status: 200 len: 1510 microversion: 2.1 time: 0.526088 Oct 08 21:09:26.657148 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2023/4135] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:26 2022] GET /compute/v2.1/servers/99510c36-821a-41dd-9ffe-8955dda22dcf => generated 1510 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:09:26.756052 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-a2691f97-85b9-4b8a-b3ef-2a7982b4be4d tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Calling method '.version_select at 0x7f1a87614790>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:26.862045 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-a2691f97-85b9-4b8a-b3ef-2a7982b4be4d tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "GET /compute/v2.1/images/ed86c272-4be6-4a44-bd79-2a964b0f06f7" status: 200 len: 1411 microversion: 2.1 time: 0.115076 Oct 08 21:09:26.862747 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2113/4136] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:09:26 2022] GET /compute/v2.1/images/ed86c272-4be6-4a44-bd79-2a964b0f06f7 => generated 1411 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:09:27.101214 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-79421e6e-4c2c-43f5-a178-62c0a99c114f tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:27.102361 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-79421e6e-4c2c-43f5-a178-62c0a99c114f tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: ba5cd412-0d20-4d2e-9f5e-de18f268008a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:27.115790 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-79421e6e-4c2c-43f5-a178-62c0a99c114f tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:27.119530 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-79421e6e-4c2c-43f5-a178-62c0a99c114f tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:27.120166 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-79421e6e-4c2c-43f5-a178-62c0a99c114f tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:27.122462 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-79421e6e-4c2c-43f5-a178-62c0a99c114f tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:27.124333 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-79421e6e-4c2c-43f5-a178-62c0a99c114f tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:27.125360 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-79421e6e-4c2c-43f5-a178-62c0a99c114f tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:27.396646 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-f2f1a702-0c36-47ea-9f37-715ccf25e5ae tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:27.397318 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-f2f1a702-0c36-47ea-9f37-715ccf25e5ae tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] [instance: 159e29dd-802c-4059-99f9-bb7c113d430b] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:27.424898 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f2f1a702-0c36-47ea-9f37-715ccf25e5ae tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:27.425452 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f2f1a702-0c36-47ea-9f37-715ccf25e5ae tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:27.425910 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f2f1a702-0c36-47ea-9f37-715ccf25e5ae tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:27.435321 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f2f1a702-0c36-47ea-9f37-715ccf25e5ae tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:27.437847 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f2f1a702-0c36-47ea-9f37-715ccf25e5ae tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:27.439228 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f2f1a702-0c36-47ea-9f37-715ccf25e5ae tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:27.548624 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-79421e6e-4c2c-43f5-a178-62c0a99c114f tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78e9afd772c4de981cac8f5817ec356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765c62cac2ee4406b23a5baa85c52ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:27.564549 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-79421e6e-4c2c-43f5-a178-62c0a99c114f tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/ba5cd412-0d20-4d2e-9f5e-de18f268008a" status: 200 len: 1506 microversion: 2.1 time: 0.468541 Oct 08 21:09:27.566551 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2024/4137] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:27 2022] GET /compute/v2.1/servers/ba5cd412-0d20-4d2e-9f5e-de18f268008a => generated 1506 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:09:27.680790 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-63b1044e-07b5-4103-ab64-10e79a892bf3 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:27.682541 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-63b1044e-07b5-4103-ab64-10e79a892bf3 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: 99510c36-821a-41dd-9ffe-8955dda22dcf] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:27.692678 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-63b1044e-07b5-4103-ab64-10e79a892bf3 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:27.693504 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-63b1044e-07b5-4103-ab64-10e79a892bf3 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:27.694328 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-63b1044e-07b5-4103-ab64-10e79a892bf3 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:27.695551 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-63b1044e-07b5-4103-ab64-10e79a892bf3 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:27.696182 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-63b1044e-07b5-4103-ab64-10e79a892bf3 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:27.696998 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-63b1044e-07b5-4103-ab64-10e79a892bf3 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:27.869929 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-f2f1a702-0c36-47ea-9f37-715ccf25e5ae tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:27.880913 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-f2f1a702-0c36-47ea-9f37-715ccf25e5ae tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:27.882423 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-f2f1a702-0c36-47ea-9f37-715ccf25e5ae tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:27.893526 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-f2f1a702-0c36-47ea-9f37-715ccf25e5ae tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] 10.222.0.26 "GET /compute/v2.1/servers/159e29dd-802c-4059-99f9-bb7c113d430b" status: 200 len: 1722 microversion: 2.20 time: 0.501224 Oct 08 21:09:27.894367 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2114/4138] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:09:27 2022] GET /compute/v2.1/servers/159e29dd-802c-4059-99f9-bb7c113d430b => generated 1722 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:09:27.901619 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-a58bde64-7010-4805-9dfe-ef092e581623 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Calling method '.version_select at 0x7f1a875b4d30>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:28.008509 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-a58bde64-7010-4805-9dfe-ef092e581623 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "GET /compute/v2.1/images/ed86c272-4be6-4a44-bd79-2a964b0f06f7" status: 200 len: 1411 microversion: 2.1 time: 0.112846 Oct 08 21:09:28.022380 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2115/4139] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:09:27 2022] GET /compute/v2.1/images/ed86c272-4be6-4a44-bd79-2a964b0f06f7 => generated 1411 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:09:28.059785 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-63b1044e-07b5-4103-ab64-10e79a892bf3 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06443b5728fb4d1e95d6245820e786bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ded993145b4eda9d6a33b994519012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:28.064225 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:09:28.074189 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-63b1044e-07b5-4103-ab64-10e79a892bf3 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "GET /compute/v2.1/servers/99510c36-821a-41dd-9ffe-8955dda22dcf" status: 200 len: 1510 microversion: 2.1 time: 0.397832 Oct 08 21:09:28.088779 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2025/4140] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:27 2022] GET /compute/v2.1/servers/99510c36-821a-41dd-9ffe-8955dda22dcf => generated 1510 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:09:28.312699 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-4e21cfa6-42e4-425c-b600-d395b579a4e8 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-767997544", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "dba60c3d-e3db-4e3c-be55-9d95fad53c72", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "0af78ecb-f6e3-458a-ab57-630925a05ff0"}]}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:09:28.423574 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-4e21cfa6-42e4-425c-b600-d395b579a4e8 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] HTTP exception thrown: Block Device dba60c3d-e3db-4e3c-be55-9d95fad53c72 is not bootable. Oct 08 21:09:28.447219 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-4e21cfa6-42e4-425c-b600-d395b579a4e8 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Request method failure captured: Oct 08 21:09:28.447219 ncdv-master-1 devstack@n-api.service[140492]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 08 21:09:28.447219 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:09:28.447219 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:09:28.447219 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:09:28.447219 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 357 Oct 08 21:09:28.447219 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:09:28.447219 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:09:28.447219 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:09:28.447219 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:09:28.447219 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQebW09Z3m936-d3SrnQA9UQ3KXQvUYeQwL43ufWdoxmQhUwYBWv-JT053t_VYPo9wAVRoCqYQy8Hhh8zc2n570KpS0qNVLik822FjYabkSIZMA_ubWypXzSwo3J04zV1MoSSz79D-b8-ZvwYCEIbwpbfyn5opgOjnO6EXvq1UNPaSyQ Oct 08 21:09:28.447219 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:09:28.447219 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:09:28.447219 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:09:28.447219 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:09:28.447219 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:09:28.447219 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:09:28.447219 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 0ae02675057e4f27bc1980348afc8ca1 Oct 08 21:09:28.447219 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-ServersNegativeTestJSON-1441071354 Oct 08 21:09:28.447219 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:09:28.447219 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:09:28.447219 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0ae02675057e4f27bc1980348afc8ca1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0ae02675057e4f27bc1980348afc8ca1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0ae02675057e4f27bc1980348afc8ca1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0ae02675057e4f27bc1980348afc8ca1"}]}] Oct 08 21:09:28.447219 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-ServersNegativeTestJSON-1441071354 Oct 08 21:09:28.447219 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 0ae02675057e4f27bc1980348afc8ca1 Oct 08 21:09:28.447219 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1441071354 Oct 08 21:09:28.447219 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-ServersNegativeTestJSON-1441071354-project Oct 08 21:09:28.447219 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:09:28.447219 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:09:28.447219 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 6a78d352c143483c8e4702d789d4c516 Oct 08 21:09:28.447219 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-ServersNegativeTestJSON-1441071354-project Oct 08 21:09:28.447219 ncdv-master-1 devstack@n-api.service[140492]: Oct 08 21:09:28.447219 ncdv-master-1 devstack@n-api.service[140492]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-767997544", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "dba60c3d-e3db-4e3c-be55-9d95fad53c72", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "0af78ecb-f6e3-458a-ab57-630925a05ff0"}]}} Oct 08 21:09:28.447219 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 21:09:28.447219 ncdv-master-1 devstack@n-api.service[140492]: exception: Block Device dba60c3d-e3db-4e3c-be55-9d95fad53c72 is not bootable. Oct 08 21:09:28.447219 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-767997544', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': 'dba60c3d-e3db-4e3c-be55-9d95fad53c72'}], 'networks': [{'uuid': '0af78ecb-f6e3-458a-ab57-630925a05ff0'}]}}} Oct 08 21:09:28.447219 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:09:28.447219 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:09:28.447219 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 08 21:09:28.447219 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 08 21:09:28.447219 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 08 21:09:28.447219 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 08 21:09:28.447219 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1672, in _create_instance Oct 08 21:09:28.447219 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Oct 08 21:09:28.447219 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 664, in get_bdm_image_metadata Oct 08 21:09:28.447219 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Oct 08 21:09:28.447219 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device dba60c3d-e3db-4e3c-be55-9d95fad53c72 is not bootable. Oct 08 21:09:28.447219 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:09:28.447219 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:09:28.447219 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:09:28.447219 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:09:28.447219 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:09:28.447219 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:09:28.447219 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:09:28.447219 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:09:28.447219 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:09:28.447219 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:09:28.447219 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 21:09:28.447219 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 21:09:28.447219 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 21:09:28.451359 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 21:09:28.451359 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 21:09:28.451359 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 21:09:28.451359 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 08 21:09:28.451359 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 08 21:09:28.451359 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 08 21:09:28.451359 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device dba60c3d-e3db-4e3c-be55-9d95fad53c72 is not bootable. Oct 08 21:09:28.451359 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:09:28.451359 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:09:28.451359 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:09:28.451359 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:09:28.451359 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:09:28.451359 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:09:28.451359 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:09:28.451359 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:09:28.451359 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device dba60c3d-e3db-4e3c-be55-9d95fad53c72 is not bootable. Oct 08 21:09:28.451359 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:09:28.453655 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-4e21cfa6-42e4-425c-b600-d395b579a4e8 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Returning 400 to user: Block Device dba60c3d-e3db-4e3c-be55-9d95fad53c72 is not bootable. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:09:28.454870 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-4e21cfa6-42e4-425c-b600-d395b579a4e8 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.159076 Oct 08 21:09:28.455644 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2116/4141] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 21:09:28 2022] POST /compute/v2.1/servers => generated 110 bytes in 161 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 08 21:09:28.465215 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-2132d894-9590-4b71-9be0-9d0096a7d9f7 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:28.465850 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-2132d894-9590-4b71-9be0-9d0096a7d9f7 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:28.481077 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2132d894-9590-4b71-9be0-9d0096a7d9f7 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:28.481852 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2132d894-9590-4b71-9be0-9d0096a7d9f7 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:28.484945 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2132d894-9590-4b71-9be0-9d0096a7d9f7 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:28.485998 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2132d894-9590-4b71-9be0-9d0096a7d9f7 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:28.486636 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2132d894-9590-4b71-9be0-9d0096a7d9f7 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:28.488791 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2132d894-9590-4b71-9be0-9d0096a7d9f7 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:28.591986 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-9fc2a46d-66e2-4cb6-aa3c-a4b0ec8a70b4 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:28.593005 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-9fc2a46d-66e2-4cb6-aa3c-a4b0ec8a70b4 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: ba5cd412-0d20-4d2e-9f5e-de18f268008a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:28.604326 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9fc2a46d-66e2-4cb6-aa3c-a4b0ec8a70b4 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:28.605876 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9fc2a46d-66e2-4cb6-aa3c-a4b0ec8a70b4 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:28.607075 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9fc2a46d-66e2-4cb6-aa3c-a4b0ec8a70b4 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:28.609793 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9fc2a46d-66e2-4cb6-aa3c-a4b0ec8a70b4 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:28.611422 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9fc2a46d-66e2-4cb6-aa3c-a4b0ec8a70b4 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:28.614061 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9fc2a46d-66e2-4cb6-aa3c-a4b0ec8a70b4 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:28.846132 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-2132d894-9590-4b71-9be0-9d0096a7d9f7 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:28.857582 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-2132d894-9590-4b71-9be0-9d0096a7d9f7 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 200 len: 1503 microversion: 2.1 time: 0.397235 Oct 08 21:09:28.873133 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2026/4142] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:28 2022] GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 1503 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:09:28.881667 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-9dbbe606-d7c6-4043-b878-56e65a8cb0df tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:28.884501 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-9dbbe606-d7c6-4043-b878-56e65a8cb0df tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:28.890765 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9dbbe606-d7c6-4043-b878-56e65a8cb0df tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:28.891600 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9dbbe606-d7c6-4043-b878-56e65a8cb0df tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:28.892279 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9dbbe606-d7c6-4043-b878-56e65a8cb0df tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:28.893277 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9dbbe606-d7c6-4043-b878-56e65a8cb0df tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:28.893984 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9dbbe606-d7c6-4043-b878-56e65a8cb0df tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:28.894895 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9dbbe606-d7c6-4043-b878-56e65a8cb0df tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:29.150155 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-9dbbe606-d7c6-4043-b878-56e65a8cb0df tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:29.163362 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-9dbbe606-d7c6-4043-b878-56e65a8cb0df tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 200 len: 1503 microversion: 2.1 time: 0.285646 Oct 08 21:09:29.163977 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2027/4143] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:28 2022] GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 1503 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:09:29.185515 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-09dba042-a0f0-44ea-b512-9d3971325408 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:29.186150 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-09dba042-a0f0-44ea-b512-9d3971325408 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] [instance: 159e29dd-802c-4059-99f9-bb7c113d430b] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:29.215056 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-09dba042-a0f0-44ea-b512-9d3971325408 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:29.215899 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-09dba042-a0f0-44ea-b512-9d3971325408 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:29.216001 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-09dba042-a0f0-44ea-b512-9d3971325408 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:29.216811 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-09dba042-a0f0-44ea-b512-9d3971325408 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:29.217204 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-09dba042-a0f0-44ea-b512-9d3971325408 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:29.229368 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-09dba042-a0f0-44ea-b512-9d3971325408 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:29.323332 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-9fc2a46d-66e2-4cb6-aa3c-a4b0ec8a70b4 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78e9afd772c4de981cac8f5817ec356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765c62cac2ee4406b23a5baa85c52ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:29.336130 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-9fc2a46d-66e2-4cb6-aa3c-a4b0ec8a70b4 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/ba5cd412-0d20-4d2e-9f5e-de18f268008a" status: 200 len: 1506 microversion: 2.1 time: 0.747794 Oct 08 21:09:29.337999 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2117/4144] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:28 2022] GET /compute/v2.1/servers/ba5cd412-0d20-4d2e-9f5e-de18f268008a => generated 1506 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:09:29.346577 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-0403ac45-eee2-4ef1-b673-10dcbbd134c0 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Calling method '.version_select at 0x7f1a875a39d0>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:29.437792 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-0403ac45-eee2-4ef1-b673-10dcbbd134c0 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "GET /compute/v2.1/images/ed86c272-4be6-4a44-bd79-2a964b0f06f7" status: 200 len: 1411 microversion: 2.1 time: 0.095319 Oct 08 21:09:29.438744 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2118/4145] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:09:29 2022] GET /compute/v2.1/images/ed86c272-4be6-4a44-bd79-2a964b0f06f7 => generated 1411 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:09:29.444621 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-ba1fe4f6-cbc6-475e-be9a-3487fb5d2793 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:29.445608 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-ba1fe4f6-cbc6-475e-be9a-3487fb5d2793 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: 99510c36-821a-41dd-9ffe-8955dda22dcf] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:29.458118 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ba1fe4f6-cbc6-475e-be9a-3487fb5d2793 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:29.458917 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ba1fe4f6-cbc6-475e-be9a-3487fb5d2793 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:29.459535 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ba1fe4f6-cbc6-475e-be9a-3487fb5d2793 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:29.460437 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ba1fe4f6-cbc6-475e-be9a-3487fb5d2793 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:29.461463 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ba1fe4f6-cbc6-475e-be9a-3487fb5d2793 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:29.462238 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ba1fe4f6-cbc6-475e-be9a-3487fb5d2793 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:29.541027 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-09dba042-a0f0-44ea-b512-9d3971325408 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:29.552077 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-09dba042-a0f0-44ea-b512-9d3971325408 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:29.554232 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-09dba042-a0f0-44ea-b512-9d3971325408 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:29.556257 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-09dba042-a0f0-44ea-b512-9d3971325408 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] 10.222.0.26 "GET /compute/v2.1/servers/159e29dd-802c-4059-99f9-bb7c113d430b" status: 200 len: 1722 microversion: 2.20 time: 0.385266 Oct 08 21:09:29.569210 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2028/4146] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:09:29 2022] GET /compute/v2.1/servers/159e29dd-802c-4059-99f9-bb7c113d430b => generated 1722 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:09:30.075490 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-ba1fe4f6-cbc6-475e-be9a-3487fb5d2793 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06443b5728fb4d1e95d6245820e786bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ded993145b4eda9d6a33b994519012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:30.087481 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-ba1fe4f6-cbc6-475e-be9a-3487fb5d2793 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "GET /compute/v2.1/servers/99510c36-821a-41dd-9ffe-8955dda22dcf" status: 200 len: 1510 microversion: 2.1 time: 0.646971 Oct 08 21:09:30.089836 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2119/4147] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:29 2022] GET /compute/v2.1/servers/99510c36-821a-41dd-9ffe-8955dda22dcf => generated 1510 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:09:30.376817 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-aafdebeb-c59d-45f8-ae4d-9cb4f7d39b3d tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:30.377342 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-aafdebeb-c59d-45f8-ae4d-9cb4f7d39b3d tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: ba5cd412-0d20-4d2e-9f5e-de18f268008a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:30.402302 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-aafdebeb-c59d-45f8-ae4d-9cb4f7d39b3d tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:30.404193 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-aafdebeb-c59d-45f8-ae4d-9cb4f7d39b3d tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:30.404895 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-aafdebeb-c59d-45f8-ae4d-9cb4f7d39b3d tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:30.405941 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-aafdebeb-c59d-45f8-ae4d-9cb4f7d39b3d tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:30.411996 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-aafdebeb-c59d-45f8-ae4d-9cb4f7d39b3d tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:30.413872 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-aafdebeb-c59d-45f8-ae4d-9cb4f7d39b3d tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:30.457695 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-b345aec3-3599-4826-b6ff-a7482e937f47 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Calling method '.version_select at 0x7f1a87666160>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:30.552950 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-b345aec3-3599-4826-b6ff-a7482e937f47 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "GET /compute/v2.1/images/ed86c272-4be6-4a44-bd79-2a964b0f06f7" status: 200 len: 1411 microversion: 2.1 time: 0.100645 Oct 08 21:09:30.553860 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2120/4148] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:09:30 2022] GET /compute/v2.1/images/ed86c272-4be6-4a44-bd79-2a964b0f06f7 => generated 1411 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:09:30.587904 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-90ca8458-3f21-4de1-9869-32714a563790 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:30.588966 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-90ca8458-3f21-4de1-9869-32714a563790 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] [instance: 159e29dd-802c-4059-99f9-bb7c113d430b] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:30.605165 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-90ca8458-3f21-4de1-9869-32714a563790 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:30.606925 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-90ca8458-3f21-4de1-9869-32714a563790 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:30.608893 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-90ca8458-3f21-4de1-9869-32714a563790 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:30.610101 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-90ca8458-3f21-4de1-9869-32714a563790 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:30.610791 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-90ca8458-3f21-4de1-9869-32714a563790 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:30.611467 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-90ca8458-3f21-4de1-9869-32714a563790 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:30.643630 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-aafdebeb-c59d-45f8-ae4d-9cb4f7d39b3d tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78e9afd772c4de981cac8f5817ec356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765c62cac2ee4406b23a5baa85c52ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:30.652898 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-aafdebeb-c59d-45f8-ae4d-9cb4f7d39b3d tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/ba5cd412-0d20-4d2e-9f5e-de18f268008a" status: 200 len: 1506 microversion: 2.1 time: 0.280519 Oct 08 21:09:30.654243 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2029/4149] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:30 2022] GET /compute/v2.1/servers/ba5cd412-0d20-4d2e-9f5e-de18f268008a => generated 1506 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:09:30.878951 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-90ca8458-3f21-4de1-9869-32714a563790 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:30.891997 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-90ca8458-3f21-4de1-9869-32714a563790 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:30.895433 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-90ca8458-3f21-4de1-9869-32714a563790 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:30.900589 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-90ca8458-3f21-4de1-9869-32714a563790 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] 10.222.0.26 "GET /compute/v2.1/servers/159e29dd-802c-4059-99f9-bb7c113d430b" status: 200 len: 1722 microversion: 2.20 time: 0.319236 Oct 08 21:09:30.903379 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2121/4150] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:09:30 2022] GET /compute/v2.1/servers/159e29dd-802c-4059-99f9-bb7c113d430b => generated 1722 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:09:31.020463 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-67fe39f1-396d-4b88-9b2e-1a1d8118a081 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1325396761", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "destination_type": "local"}, {"source_type": "volume", "uuid": "0e7dcb6a-067d-4bd6-99c7-b38b6877dca2", "destination_type": "invalid"}], "networks": [{"uuid": "0af78ecb-f6e3-458a-ab57-630925a05ff0"}]}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:09:31.027315 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-67fe39f1-396d-4b88-9b2e-1a1d8118a081 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Request method failure captured: Oct 08 21:09:31.027315 ncdv-master-1 devstack@n-api.service[140491]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 08 21:09:31.027315 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:09:31.027315 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:09:31.027315 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:09:31.027315 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 495 Oct 08 21:09:31.027315 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:09:31.027315 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:09:31.027315 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:09:31.027315 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:09:31.027315 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQebW09Z3m936-d3SrnQA9UQ3KXQvUYeQwL43ufWdoxmQhUwYBWv-JT053t_VYPo9wAVRoCqYQy8Hhh8zc2n570KpS0qNVLik822FjYabkSIZMA_ubWypXzSwo3J04zV1MoSSz79D-b8-ZvwYCEIbwpbfyn5opgOjnO6EXvq1UNPaSyQ Oct 08 21:09:31.027315 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:09:31.027315 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:09:31.027315 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:09:31.027315 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:09:31.027315 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:09:31.027315 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:09:31.027315 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 0ae02675057e4f27bc1980348afc8ca1 Oct 08 21:09:31.027315 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-ServersNegativeTestJSON-1441071354 Oct 08 21:09:31.027315 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:09:31.027315 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:09:31.027315 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0ae02675057e4f27bc1980348afc8ca1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0ae02675057e4f27bc1980348afc8ca1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0ae02675057e4f27bc1980348afc8ca1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0ae02675057e4f27bc1980348afc8ca1"}]}] Oct 08 21:09:31.027315 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-ServersNegativeTestJSON-1441071354 Oct 08 21:09:31.027315 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 0ae02675057e4f27bc1980348afc8ca1 Oct 08 21:09:31.027315 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1441071354 Oct 08 21:09:31.027315 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-ServersNegativeTestJSON-1441071354-project Oct 08 21:09:31.027315 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:09:31.027315 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:09:31.027315 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 6a78d352c143483c8e4702d789d4c516 Oct 08 21:09:31.027315 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-ServersNegativeTestJSON-1441071354-project Oct 08 21:09:31.027315 ncdv-master-1 devstack@n-api.service[140491]: Oct 08 21:09:31.027315 ncdv-master-1 devstack@n-api.service[140491]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1325396761", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "destination_type": "local"}, {"source_type": "volume", "uuid": "0e7dcb6a-067d-4bd6-99c7-b38b6877dca2", "destination_type": "invalid"}], "networks": [{"uuid": "0af78ecb-f6e3-458a-ab57-630925a05ff0"}]}} Oct 08 21:09:31.027315 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:09:31.027315 ncdv-master-1 devstack@n-api.service[140491]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 08 21:09:31.027315 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1325396761', 'imageRef': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': '0e7dcb6a-067d-4bd6-99c7-b38b6877dca2', 'destination_type': 'invalid'}], 'networks': [{'uuid': '0af78ecb-f6e3-458a-ab57-630925a05ff0'}]}}} Oct 08 21:09:31.027315 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:09:31.027315 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:09:31.027315 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 08 21:09:31.027315 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 08 21:09:31.027315 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 08 21:09:31.027315 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise error Oct 08 21:09:31.027315 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Oct 08 21:09:31.027315 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:09:31.027315 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Oct 08 21:09:31.027315 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Oct 08 21:09:31.027315 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:09:31.027315 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Oct 08 21:09:31.027315 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi 'invalid' Oct 08 21:09:31.027315 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:09:31.027315 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:09:31.027315 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:09:31.027315 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:09:31.027315 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:09:31.027315 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:09:31.027315 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:09:31.027315 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:09:31.027315 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:09:31.030507 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:09:31.030507 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 21:09:31.030507 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 21:09:31.030507 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 08 21:09:31.030507 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 08 21:09:31.030507 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 08 21:09:31.030507 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 08 21:09:31.030507 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 08 21:09:31.030507 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 08 21:09:31.030507 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 08 21:09:31.030507 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:09:31.030507 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:09:31.030507 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:09:31.030507 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:09:31.030507 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:09:31.030507 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:09:31.030507 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 08 21:09:31.030507 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 08 21:09:31.030507 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 08 21:09:31.030507 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:09:31.035091 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-67fe39f1-396d-4b88-9b2e-1a1d8118a081 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:09:31.036221 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-67fe39f1-396d-4b88-9b2e-1a1d8118a081 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.020684 Oct 08 21:09:31.041132 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2030/4151] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 21:09:31 2022] POST /compute/v2.1/servers => generated 155 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 08 21:09:31.047654 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-d5c8c05e-8e89-4829-a368-92dda4ff104e tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:31.048284 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-d5c8c05e-8e89-4829-a368-92dda4ff104e tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:31.057499 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d5c8c05e-8e89-4829-a368-92dda4ff104e tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:31.058818 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d5c8c05e-8e89-4829-a368-92dda4ff104e tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:31.059426 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d5c8c05e-8e89-4829-a368-92dda4ff104e tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:31.061036 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d5c8c05e-8e89-4829-a368-92dda4ff104e tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:31.064510 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d5c8c05e-8e89-4829-a368-92dda4ff104e tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:31.065450 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d5c8c05e-8e89-4829-a368-92dda4ff104e tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:31.114142 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-fd6f1f22-05f8-4b2d-825c-35c055e3c64f tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:31.114791 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-fd6f1f22-05f8-4b2d-825c-35c055e3c64f tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: 99510c36-821a-41dd-9ffe-8955dda22dcf] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:31.128013 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fd6f1f22-05f8-4b2d-825c-35c055e3c64f tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:31.128837 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fd6f1f22-05f8-4b2d-825c-35c055e3c64f tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:31.129631 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fd6f1f22-05f8-4b2d-825c-35c055e3c64f tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:31.130533 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fd6f1f22-05f8-4b2d-825c-35c055e3c64f tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:31.131155 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fd6f1f22-05f8-4b2d-825c-35c055e3c64f tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:31.131744 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fd6f1f22-05f8-4b2d-825c-35c055e3c64f tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:31.348558 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-fd6f1f22-05f8-4b2d-825c-35c055e3c64f tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06443b5728fb4d1e95d6245820e786bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ded993145b4eda9d6a33b994519012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:31.357878 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-fd6f1f22-05f8-4b2d-825c-35c055e3c64f tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "GET /compute/v2.1/servers/99510c36-821a-41dd-9ffe-8955dda22dcf" status: 200 len: 1510 microversion: 2.1 time: 0.247453 Oct 08 21:09:31.375350 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2031/4152] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:31 2022] GET /compute/v2.1/servers/99510c36-821a-41dd-9ffe-8955dda22dcf => generated 1510 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:09:31.457681 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-d5c8c05e-8e89-4829-a368-92dda4ff104e tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:31.466583 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=100 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:09:31.476169 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-d5c8c05e-8e89-4829-a368-92dda4ff104e tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 200 len: 1503 microversion: 2.1 time: 0.433072 Oct 08 21:09:31.479555 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2122/4153] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:31 2022] GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 1503 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:09:31.511634 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-b0b1505b-1dc7-4e4e-8995-ce78f920f189 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:31.512267 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-b0b1505b-1dc7-4e4e-8995-ce78f920f189 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:31.523551 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b0b1505b-1dc7-4e4e-8995-ce78f920f189 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:31.530117 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b0b1505b-1dc7-4e4e-8995-ce78f920f189 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:31.530847 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b0b1505b-1dc7-4e4e-8995-ce78f920f189 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:31.531960 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b0b1505b-1dc7-4e4e-8995-ce78f920f189 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:31.532619 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b0b1505b-1dc7-4e4e-8995-ce78f920f189 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:31.533282 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b0b1505b-1dc7-4e4e-8995-ce78f920f189 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:31.569747 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-38cbc7d9-0fb1-4dd9-9fee-4974413f61c1 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Calling method '.version_select at 0x7f1a8758a4c0>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:31.667470 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-38cbc7d9-0fb1-4dd9-9fee-4974413f61c1 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "GET /compute/v2.1/images/ed86c272-4be6-4a44-bd79-2a964b0f06f7" status: 200 len: 1411 microversion: 2.1 time: 0.101876 Oct 08 21:09:31.669063 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2123/4154] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:09:31 2022] GET /compute/v2.1/images/ed86c272-4be6-4a44-bd79-2a964b0f06f7 => generated 1411 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:09:31.684677 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-09086643-710e-47ba-8c05-20067f244b36 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:31.685512 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-09086643-710e-47ba-8c05-20067f244b36 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: ba5cd412-0d20-4d2e-9f5e-de18f268008a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:31.692444 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-09086643-710e-47ba-8c05-20067f244b36 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:31.693402 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-09086643-710e-47ba-8c05-20067f244b36 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:31.694008 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-09086643-710e-47ba-8c05-20067f244b36 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:31.694830 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-09086643-710e-47ba-8c05-20067f244b36 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:31.695403 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-09086643-710e-47ba-8c05-20067f244b36 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:31.698275 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-09086643-710e-47ba-8c05-20067f244b36 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:31.776429 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-b0b1505b-1dc7-4e4e-8995-ce78f920f189 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:31.785631 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-b0b1505b-1dc7-4e4e-8995-ce78f920f189 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 200 len: 1503 microversion: 2.1 time: 0.281148 Oct 08 21:09:31.786546 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2032/4155] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:31 2022] GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 1503 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:09:31.871095 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-0700dd53-d409-4507-98d3-51208d3a737e tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-78433494", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "0af78ecb-f6e3-458a-ab57-630925a05ff0"}]}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:09:31.875926 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-0700dd53-d409-4507-98d3-51208d3a737e tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Request method failure captured: Oct 08 21:09:31.875926 ncdv-master-1 devstack@n-api.service[140491]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 08 21:09:31.875926 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:09:31.875926 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:09:31.875926 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:09:31.875926 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 490 Oct 08 21:09:31.875926 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:09:31.875926 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:09:31.875926 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:09:31.875926 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:09:31.875926 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQebW09Z3m936-d3SrnQA9UQ3KXQvUYeQwL43ufWdoxmQhUwYBWv-JT053t_VYPo9wAVRoCqYQy8Hhh8zc2n570KpS0qNVLik822FjYabkSIZMA_ubWypXzSwo3J04zV1MoSSz79D-b8-ZvwYCEIbwpbfyn5opgOjnO6EXvq1UNPaSyQ Oct 08 21:09:31.875926 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:09:31.875926 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:09:31.875926 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:09:31.875926 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:09:31.875926 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:09:31.875926 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:09:31.875926 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 0ae02675057e4f27bc1980348afc8ca1 Oct 08 21:09:31.875926 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-ServersNegativeTestJSON-1441071354 Oct 08 21:09:31.875926 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:09:31.875926 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:09:31.875926 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0ae02675057e4f27bc1980348afc8ca1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0ae02675057e4f27bc1980348afc8ca1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0ae02675057e4f27bc1980348afc8ca1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0ae02675057e4f27bc1980348afc8ca1"}]}] Oct 08 21:09:31.875926 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-ServersNegativeTestJSON-1441071354 Oct 08 21:09:31.875926 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 0ae02675057e4f27bc1980348afc8ca1 Oct 08 21:09:31.875926 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1441071354 Oct 08 21:09:31.875926 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-ServersNegativeTestJSON-1441071354-project Oct 08 21:09:31.875926 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:09:31.875926 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:09:31.875926 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 6a78d352c143483c8e4702d789d4c516 Oct 08 21:09:31.875926 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-ServersNegativeTestJSON-1441071354-project Oct 08 21:09:31.875926 ncdv-master-1 devstack@n-api.service[140491]: Oct 08 21:09:31.875926 ncdv-master-1 devstack@n-api.service[140491]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-78433494", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "0af78ecb-f6e3-458a-ab57-630925a05ff0"}]}} Oct 08 21:09:31.875926 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:09:31.875926 ncdv-master-1 devstack@n-api.service[140491]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 08 21:09:31.875926 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-78433494', 'imageRef': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': '0af78ecb-f6e3-458a-ab57-630925a05ff0'}]}}} Oct 08 21:09:31.875926 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:09:31.875926 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:09:31.875926 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 08 21:09:31.875926 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 08 21:09:31.875926 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 08 21:09:31.875926 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise error Oct 08 21:09:31.875926 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 08 21:09:31.875926 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:09:31.875926 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Oct 08 21:09:31.875926 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Oct 08 21:09:31.875926 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:09:31.875926 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Oct 08 21:09:31.878940 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Oct 08 21:09:31.878940 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:09:31.878940 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:09:31.878940 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:09:31.878940 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:09:31.878940 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:09:31.878940 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:09:31.878940 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:09:31.878940 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:09:31.878940 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:09:31.878940 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:09:31.878940 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 21:09:31.878940 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 21:09:31.878940 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 08 21:09:31.878940 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 08 21:09:31.878940 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 08 21:09:31.878940 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 08 21:09:31.878940 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 08 21:09:31.878940 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 08 21:09:31.878940 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 08 21:09:31.878940 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:09:31.878940 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:09:31.878940 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:09:31.878940 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:09:31.878940 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:09:31.878940 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:09:31.878940 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 08 21:09:31.878940 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 08 21:09:31.878940 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 08 21:09:31.878940 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:09:31.882861 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-0700dd53-d409-4507-98d3-51208d3a737e tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:09:31.884566 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-0700dd53-d409-4507-98d3-51208d3a737e tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.018643 Oct 08 21:09:31.885511 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2033/4156] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 21:09:31 2022] POST /compute/v2.1/servers => generated 624 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 08 21:09:31.895343 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-560ae791-8961-4e09-8831-f39b4bf3b8af tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:31.896140 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-560ae791-8961-4e09-8831-f39b4bf3b8af tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:31.904505 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-560ae791-8961-4e09-8831-f39b4bf3b8af tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:31.905331 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-560ae791-8961-4e09-8831-f39b4bf3b8af tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:31.906509 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-560ae791-8961-4e09-8831-f39b4bf3b8af tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:31.907571 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-560ae791-8961-4e09-8831-f39b4bf3b8af tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:31.908272 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-560ae791-8961-4e09-8831-f39b4bf3b8af tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:31.908917 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-560ae791-8961-4e09-8831-f39b4bf3b8af tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:31.966914 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-09086643-710e-47ba-8c05-20067f244b36 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78e9afd772c4de981cac8f5817ec356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765c62cac2ee4406b23a5baa85c52ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:31.986720 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-09086643-710e-47ba-8c05-20067f244b36 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/ba5cd412-0d20-4d2e-9f5e-de18f268008a" status: 200 len: 1506 microversion: 2.1 time: 0.307099 Oct 08 21:09:31.988021 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2124/4157] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:31 2022] GET /compute/v2.1/servers/ba5cd412-0d20-4d2e-9f5e-de18f268008a => generated 1506 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:09:31.993380 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-60cf857c-1500-4809-bb28-7bfd29fb3810 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:31.995314 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-60cf857c-1500-4809-bb28-7bfd29fb3810 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] [instance: 159e29dd-802c-4059-99f9-bb7c113d430b] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:32.001865 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:09:32.003608 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-60cf857c-1500-4809-bb28-7bfd29fb3810 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:32.004526 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-60cf857c-1500-4809-bb28-7bfd29fb3810 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:32.005354 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-60cf857c-1500-4809-bb28-7bfd29fb3810 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:32.006328 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-60cf857c-1500-4809-bb28-7bfd29fb3810 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:32.007088 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-60cf857c-1500-4809-bb28-7bfd29fb3810 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:32.007730 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-60cf857c-1500-4809-bb28-7bfd29fb3810 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:32.219422 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-60cf857c-1500-4809-bb28-7bfd29fb3810 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:32.232475 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-60cf857c-1500-4809-bb28-7bfd29fb3810 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:32.234394 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-60cf857c-1500-4809-bb28-7bfd29fb3810 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:32.235818 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-60cf857c-1500-4809-bb28-7bfd29fb3810 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] 10.222.0.26 "GET /compute/v2.1/servers/159e29dd-802c-4059-99f9-bb7c113d430b" status: 200 len: 1722 microversion: 2.20 time: 0.246490 Oct 08 21:09:32.237630 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2125/4158] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:09:31 2022] GET /compute/v2.1/servers/159e29dd-802c-4059-99f9-bb7c113d430b => generated 1722 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:09:32.388701 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-b9ae3f9b-10bc-43f3-af2a-6f826993c0c2 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:32.389709 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-b9ae3f9b-10bc-43f3-af2a-6f826993c0c2 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: 99510c36-821a-41dd-9ffe-8955dda22dcf] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:32.398799 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b9ae3f9b-10bc-43f3-af2a-6f826993c0c2 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:32.400143 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b9ae3f9b-10bc-43f3-af2a-6f826993c0c2 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:32.400826 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b9ae3f9b-10bc-43f3-af2a-6f826993c0c2 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:32.403313 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b9ae3f9b-10bc-43f3-af2a-6f826993c0c2 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:32.409290 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b9ae3f9b-10bc-43f3-af2a-6f826993c0c2 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:32.410430 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b9ae3f9b-10bc-43f3-af2a-6f826993c0c2 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:32.430419 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-560ae791-8961-4e09-8831-f39b4bf3b8af tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:32.441042 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-560ae791-8961-4e09-8831-f39b4bf3b8af tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 200 len: 1503 microversion: 2.1 time: 0.549536 Oct 08 21:09:32.444364 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2034/4159] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:31 2022] GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 1503 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:09:32.476341 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-ae67c813-7c58-4ed8-af06-519bb0a50efc tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:32.476966 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-ae67c813-7c58-4ed8-af06-519bb0a50efc tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:32.502879 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ae67c813-7c58-4ed8-af06-519bb0a50efc tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:32.503415 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ae67c813-7c58-4ed8-af06-519bb0a50efc tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:32.503871 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ae67c813-7c58-4ed8-af06-519bb0a50efc tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:32.504615 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ae67c813-7c58-4ed8-af06-519bb0a50efc tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:32.505352 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ae67c813-7c58-4ed8-af06-519bb0a50efc tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:32.505969 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ae67c813-7c58-4ed8-af06-519bb0a50efc tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:32.662270 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-b9ae3f9b-10bc-43f3-af2a-6f826993c0c2 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06443b5728fb4d1e95d6245820e786bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ded993145b4eda9d6a33b994519012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:32.675475 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-b9ae3f9b-10bc-43f3-af2a-6f826993c0c2 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "GET /compute/v2.1/servers/99510c36-821a-41dd-9ffe-8955dda22dcf" status: 200 len: 1510 microversion: 2.1 time: 0.294634 Oct 08 21:09:32.686895 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2126/4160] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:32 2022] GET /compute/v2.1/servers/99510c36-821a-41dd-9ffe-8955dda22dcf => generated 1510 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:09:32.693830 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-f9608088-5805-4158-b066-28e667e41761 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Calling method '.version_select at 0x7f1a87563430>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:32.763709 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-ae67c813-7c58-4ed8-af06-519bb0a50efc tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:32.775714 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-ae67c813-7c58-4ed8-af06-519bb0a50efc tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 200 len: 1503 microversion: 2.1 time: 0.303462 Oct 08 21:09:32.776492 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2035/4161] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:32 2022] GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 1503 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:09:32.781661 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-f9608088-5805-4158-b066-28e667e41761 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "GET /compute/v2.1/images/ed86c272-4be6-4a44-bd79-2a964b0f06f7" status: 200 len: 1420 microversion: 2.1 time: 0.093140 Oct 08 21:09:32.782503 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2127/4162] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:09:32 2022] GET /compute/v2.1/images/ed86c272-4be6-4a44-bd79-2a964b0f06f7 => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:09:32.806510 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-e05b5947-58c2-426a-8fca-1db76e3fb05c tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Calling method '.version_select at 0x7f1a8c061e50>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:32.870477 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-3d469cc2-c554-4873-b637-ec03cc5f4543 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "networks": [{"uuid": "0af78ecb-f6e3-458a-ab57-630925a05ff0"}]}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:09:32.877118 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-3d469cc2-c554-4873-b637-ec03cc5f4543 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Request method failure captured: Oct 08 21:09:32.877118 ncdv-master-1 devstack@n-api.service[140492]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 08 21:09:32.877118 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:09:32.877118 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:09:32.877118 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:09:32.877118 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 416 Oct 08 21:09:32.877118 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:09:32.877118 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:09:32.877118 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:09:32.877118 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:09:32.877118 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQebW09Z3m936-d3SrnQA9UQ3KXQvUYeQwL43ufWdoxmQhUwYBWv-JT053t_VYPo9wAVRoCqYQy8Hhh8zc2n570KpS0qNVLik822FjYabkSIZMA_ubWypXzSwo3J04zV1MoSSz79D-b8-ZvwYCEIbwpbfyn5opgOjnO6EXvq1UNPaSyQ Oct 08 21:09:32.877118 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:09:32.877118 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:09:32.877118 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:09:32.877118 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:09:32.877118 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:09:32.877118 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:09:32.877118 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 0ae02675057e4f27bc1980348afc8ca1 Oct 08 21:09:32.877118 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-ServersNegativeTestJSON-1441071354 Oct 08 21:09:32.877118 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:09:32.877118 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:09:32.877118 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0ae02675057e4f27bc1980348afc8ca1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0ae02675057e4f27bc1980348afc8ca1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0ae02675057e4f27bc1980348afc8ca1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0ae02675057e4f27bc1980348afc8ca1"}]}] Oct 08 21:09:32.877118 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-ServersNegativeTestJSON-1441071354 Oct 08 21:09:32.877118 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 0ae02675057e4f27bc1980348afc8ca1 Oct 08 21:09:32.877118 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1441071354 Oct 08 21:09:32.877118 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-ServersNegativeTestJSON-1441071354-project Oct 08 21:09:32.877118 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:09:32.877118 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:09:32.877118 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 6a78d352c143483c8e4702d789d4c516 Oct 08 21:09:32.877118 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-ServersNegativeTestJSON-1441071354-project Oct 08 21:09:32.877118 ncdv-master-1 devstack@n-api.service[140492]: Oct 08 21:09:32.877118 ncdv-master-1 devstack@n-api.service[140492]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "networks": [{"uuid": "0af78ecb-f6e3-458a-ab57-630925a05ff0"}]}} Oct 08 21:09:32.877118 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 21:09:32.877118 ncdv-master-1 devstack@n-api.service[140492]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 08 21:09:32.877118 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'flavorRef': '452', 'networks': [{'uuid': '0af78ecb-f6e3-458a-ab57-630925a05ff0'}]}}} Oct 08 21:09:32.877118 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:09:32.877118 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:09:32.877118 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 08 21:09:32.877118 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 08 21:09:32.877118 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 08 21:09:32.877118 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise error Oct 08 21:09:32.877118 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 08 21:09:32.877118 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:09:32.877118 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Oct 08 21:09:32.877118 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 08 21:09:32.877118 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:09:32.877118 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 08 21:09:32.877118 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 08 21:09:32.877118 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:09:32.877118 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:09:32.880267 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:09:32.880267 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:09:32.880267 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:09:32.880267 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:09:32.880267 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:09:32.880267 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:09:32.880267 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:09:32.880267 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:09:32.880267 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 21:09:32.880267 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 21:09:32.880267 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 08 21:09:32.880267 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 08 21:09:32.880267 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 08 21:09:32.880267 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 08 21:09:32.880267 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 08 21:09:32.880267 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 08 21:09:32.880267 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 08 21:09:32.880267 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:09:32.880267 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:09:32.880267 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:09:32.880267 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:09:32.880267 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:09:32.880267 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:09:32.880267 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 08 21:09:32.880267 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 08 21:09:32.880267 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 08 21:09:32.880267 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:09:32.880267 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-3d469cc2-c554-4873-b637-ec03cc5f4543 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:09:32.880267 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-3d469cc2-c554-4873-b637-ec03cc5f4543 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.014067 Oct 08 21:09:32.880267 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2128/4163] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 21:09:32 2022] POST /compute/v2.1/servers => generated 619 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 08 21:09:32.889946 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-39cdbc66-5211-4dc7-993c-978aeb47c61a tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:32.892623 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-e05b5947-58c2-426a-8fca-1db76e3fb05c tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "GET /compute/v2.1/images/ed86c272-4be6-4a44-bd79-2a964b0f06f7" status: 200 len: 1420 microversion: 2.1 time: 0.089510 Oct 08 21:09:32.894187 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-39cdbc66-5211-4dc7-993c-978aeb47c61a tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:32.895464 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2036/4164] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:09:32 2022] GET /compute/v2.1/images/ed86c272-4be6-4a44-bd79-2a964b0f06f7 => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:09:32.913988 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-46b433fc-5030-43da-9f58-49c0e4e73d3f tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Calling method '.version_select at 0x7f1a8c6861f0>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:32.931617 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-39cdbc66-5211-4dc7-993c-978aeb47c61a tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:32.932381 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-39cdbc66-5211-4dc7-993c-978aeb47c61a tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:32.933051 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-39cdbc66-5211-4dc7-993c-978aeb47c61a tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:32.934064 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-39cdbc66-5211-4dc7-993c-978aeb47c61a tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:32.934756 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-39cdbc66-5211-4dc7-993c-978aeb47c61a tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:32.935724 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-39cdbc66-5211-4dc7-993c-978aeb47c61a tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:33.159957 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-39cdbc66-5211-4dc7-993c-978aeb47c61a tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:33.173168 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-39cdbc66-5211-4dc7-993c-978aeb47c61a tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 200 len: 1503 microversion: 2.1 time: 0.289346 Oct 08 21:09:33.174430 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2129/4165] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:32 2022] GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 1503 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:09:33.179733 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-0d3eacee-a067-44a9-a441-1820eb6ddb35 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:33.181047 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-0d3eacee-a067-44a9-a441-1820eb6ddb35 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: ba5cd412-0d20-4d2e-9f5e-de18f268008a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:33.198822 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0d3eacee-a067-44a9-a441-1820eb6ddb35 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:33.199689 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0d3eacee-a067-44a9-a441-1820eb6ddb35 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:33.200294 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0d3eacee-a067-44a9-a441-1820eb6ddb35 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:33.201328 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0d3eacee-a067-44a9-a441-1820eb6ddb35 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:33.202550 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0d3eacee-a067-44a9-a441-1820eb6ddb35 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:33.203221 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0d3eacee-a067-44a9-a441-1820eb6ddb35 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:33.394605 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-0d3eacee-a067-44a9-a441-1820eb6ddb35 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78e9afd772c4de981cac8f5817ec356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765c62cac2ee4406b23a5baa85c52ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:33.412146 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-0d3eacee-a067-44a9-a441-1820eb6ddb35 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/ba5cd412-0d20-4d2e-9f5e-de18f268008a" status: 200 len: 1506 microversion: 2.1 time: 0.230649 Oct 08 21:09:33.412955 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2130/4166] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:33 2022] GET /compute/v2.1/servers/ba5cd412-0d20-4d2e-9f5e-de18f268008a => generated 1506 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:09:33.419949 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e8af2fb6-642d-4e95-83e3-7a7df7723e5d tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:33.420851 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-e8af2fb6-642d-4e95-83e3-7a7df7723e5d tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:33.429755 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e8af2fb6-642d-4e95-83e3-7a7df7723e5d tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:33.430609 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e8af2fb6-642d-4e95-83e3-7a7df7723e5d tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:33.431040 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e8af2fb6-642d-4e95-83e3-7a7df7723e5d tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:33.431781 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e8af2fb6-642d-4e95-83e3-7a7df7723e5d tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:33.432256 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e8af2fb6-642d-4e95-83e3-7a7df7723e5d tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:33.437305 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e8af2fb6-642d-4e95-83e3-7a7df7723e5d tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:33.645235 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-e8af2fb6-642d-4e95-83e3-7a7df7723e5d tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:33.657517 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-e8af2fb6-642d-4e95-83e3-7a7df7723e5d tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 200 len: 1503 microversion: 2.1 time: 0.242878 Oct 08 21:09:33.669691 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2131/4167] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:33 2022] GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 1503 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:09:33.673288 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-46b433fc-5030-43da-9f58-49c0e4e73d3f tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "DELETE /compute/v2.1/images/ed86c272-4be6-4a44-bd79-2a964b0f06f7" status: 204 len: 0 microversion: 2.1 time: 0.766331 Oct 08 21:09:33.674717 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2037/4168] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:32 2022] DELETE /compute/v2.1/images/ed86c272-4be6-4a44-bd79-2a964b0f06f7 => generated 0 bytes in 769 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 21:09:33.683541 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-01aee9ba-128a-4bd6-95da-0192c4ebb566 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:33.684314 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-01aee9ba-128a-4bd6-95da-0192c4ebb566 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] [instance: b9e77bd1-3ce0-4f0a-b5ac-8c0ba6caffbb] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:33.691158 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-3c730c16-6e17-4c7d-a234-5893437b6c64 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:33.691887 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-01aee9ba-128a-4bd6-95da-0192c4ebb566 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:33.692241 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-3c730c16-6e17-4c7d-a234-5893437b6c64 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] [instance: 159e29dd-802c-4059-99f9-bb7c113d430b] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:33.692887 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-01aee9ba-128a-4bd6-95da-0192c4ebb566 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:33.693951 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-01aee9ba-128a-4bd6-95da-0192c4ebb566 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:33.694915 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-01aee9ba-128a-4bd6-95da-0192c4ebb566 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:33.695603 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-01aee9ba-128a-4bd6-95da-0192c4ebb566 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:33.696897 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-01aee9ba-128a-4bd6-95da-0192c4ebb566 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:33.704559 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3c730c16-6e17-4c7d-a234-5893437b6c64 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:33.705078 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3c730c16-6e17-4c7d-a234-5893437b6c64 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:33.705730 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3c730c16-6e17-4c7d-a234-5893437b6c64 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:33.706494 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3c730c16-6e17-4c7d-a234-5893437b6c64 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:33.707567 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3c730c16-6e17-4c7d-a234-5893437b6c64 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:33.708205 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3c730c16-6e17-4c7d-a234-5893437b6c64 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:33.728145 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-01aee9ba-128a-4bd6-95da-0192c4ebb566 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] [instance: b9e77bd1-3ce0-4f0a-b5ac-8c0ba6caffbb] Going to try to terminate instance {{(pid=140491) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 21:09:33.863458 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-01aee9ba-128a-4bd6-95da-0192c4ebb566 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "DELETE /compute/v2.1/servers/b9e77bd1-3ce0-4f0a-b5ac-8c0ba6caffbb" status: 204 len: 0 microversion: 2.1 time: 0.183713 Oct 08 21:09:33.870263 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2038/4169] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:09:33 2022] DELETE /compute/v2.1/servers/b9e77bd1-3ce0-4f0a-b5ac-8c0ba6caffbb => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 21:09:33.878174 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-d68a2fa9-87b6-4c7d-97f4-9f0cf43cc6a3 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:33.879283 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-d68a2fa9-87b6-4c7d-97f4-9f0cf43cc6a3 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: 99510c36-821a-41dd-9ffe-8955dda22dcf] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:33.887894 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d68a2fa9-87b6-4c7d-97f4-9f0cf43cc6a3 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:33.888921 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d68a2fa9-87b6-4c7d-97f4-9f0cf43cc6a3 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:33.889661 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d68a2fa9-87b6-4c7d-97f4-9f0cf43cc6a3 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:33.891228 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d68a2fa9-87b6-4c7d-97f4-9f0cf43cc6a3 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:33.891932 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d68a2fa9-87b6-4c7d-97f4-9f0cf43cc6a3 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:33.892936 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d68a2fa9-87b6-4c7d-97f4-9f0cf43cc6a3 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:33.991304 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-3c730c16-6e17-4c7d-a234-5893437b6c64 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:34.000380 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-3c730c16-6e17-4c7d-a234-5893437b6c64 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:34.001889 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-3c730c16-6e17-4c7d-a234-5893437b6c64 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:34.003139 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-3c730c16-6e17-4c7d-a234-5893437b6c64 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] 10.222.0.26 "GET /compute/v2.1/servers/159e29dd-802c-4059-99f9-bb7c113d430b" status: 200 len: 1722 microversion: 2.20 time: 0.329458 Oct 08 21:09:34.009999 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2132/4170] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:09:33 2022] GET /compute/v2.1/servers/159e29dd-802c-4059-99f9-bb7c113d430b => generated 1722 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:09:34.021855 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-3a1e15d2-7069-47c1-a295-46b4b9284043 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1574092518", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": -1, "networks": [{"uuid": "0af78ecb-f6e3-458a-ab57-630925a05ff0"}]}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:09:34.048185 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-3a1e15d2-7069-47c1-a295-46b4b9284043 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] HTTP exception thrown: Flavor -1 could not be found. Oct 08 21:09:34.074077 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-3a1e15d2-7069-47c1-a295-46b4b9284043 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Request method failure captured: Oct 08 21:09:34.074077 ncdv-master-1 devstack@n-api.service[140492]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 08 21:09:34.074077 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:09:34.074077 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:09:34.074077 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:09:34.074077 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 206 Oct 08 21:09:34.074077 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:09:34.074077 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:09:34.074077 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:09:34.074077 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:09:34.074077 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQebW09Z3m936-d3SrnQA9UQ3KXQvUYeQwL43ufWdoxmQhUwYBWv-JT053t_VYPo9wAVRoCqYQy8Hhh8zc2n570KpS0qNVLik822FjYabkSIZMA_ubWypXzSwo3J04zV1MoSSz79D-b8-ZvwYCEIbwpbfyn5opgOjnO6EXvq1UNPaSyQ Oct 08 21:09:34.074077 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:09:34.074077 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:09:34.074077 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:09:34.074077 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:09:34.074077 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:09:34.074077 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:09:34.074077 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 0ae02675057e4f27bc1980348afc8ca1 Oct 08 21:09:34.074077 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-ServersNegativeTestJSON-1441071354 Oct 08 21:09:34.074077 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:09:34.074077 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:09:34.074077 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0ae02675057e4f27bc1980348afc8ca1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0ae02675057e4f27bc1980348afc8ca1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0ae02675057e4f27bc1980348afc8ca1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0ae02675057e4f27bc1980348afc8ca1"}]}] Oct 08 21:09:34.074077 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-ServersNegativeTestJSON-1441071354 Oct 08 21:09:34.074077 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 0ae02675057e4f27bc1980348afc8ca1 Oct 08 21:09:34.074077 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1441071354 Oct 08 21:09:34.074077 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-ServersNegativeTestJSON-1441071354-project Oct 08 21:09:34.074077 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:09:34.074077 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:09:34.074077 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 6a78d352c143483c8e4702d789d4c516 Oct 08 21:09:34.074077 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-ServersNegativeTestJSON-1441071354-project Oct 08 21:09:34.074077 ncdv-master-1 devstack@n-api.service[140492]: Oct 08 21:09:34.074077 ncdv-master-1 devstack@n-api.service[140492]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1574092518", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": -1, "networks": [{"uuid": "0af78ecb-f6e3-458a-ab57-630925a05ff0"}]}} Oct 08 21:09:34.074077 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 21:09:34.074077 ncdv-master-1 devstack@n-api.service[140492]: exception: Flavor -1 could not be found. Oct 08 21:09:34.074077 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1574092518', 'imageRef': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'flavorRef': -1, 'networks': [{'uuid': '0af78ecb-f6e3-458a-ab57-630925a05ff0'}]}}} Oct 08 21:09:34.074077 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:09:34.074077 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:09:34.074077 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Oct 08 21:09:34.074077 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Oct 08 21:09:34.074077 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 08 21:09:34.074077 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 08 21:09:34.074077 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 08 21:09:34.074077 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 08 21:09:34.074077 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 08 21:09:34.074077 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 08 21:09:34.074077 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 08 21:09:34.074077 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:09:34.074077 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 08 21:09:34.074077 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 08 21:09:34.074077 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Oct 08 21:09:34.074077 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:09:34.074077 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:09:34.074077 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:09:34.074077 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:09:34.074077 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:09:34.074077 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:09:34.074077 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:09:34.074077 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:09:34.074077 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:09:34.074077 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:09:34.074077 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 21:09:34.074077 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 21:09:34.079454 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 21:09:34.079454 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 21:09:34.079454 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 21:09:34.079454 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 21:09:34.079454 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 08 21:09:34.079454 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 08 21:09:34.079454 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 08 21:09:34.079454 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Oct 08 21:09:34.079454 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:09:34.079454 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:09:34.079454 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:09:34.079454 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:09:34.079454 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:09:34.079454 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:09:34.079454 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:09:34.079454 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:09:34.079454 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Oct 08 21:09:34.079454 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:09:34.079454 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-3a1e15d2-7069-47c1-a295-46b4b9284043 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:09:34.079454 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-3a1e15d2-7069-47c1-a295-46b4b9284043 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.058359 Oct 08 21:09:34.079454 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2133/4171] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 21:09:34 2022] POST /compute/v2.1/servers => generated 73 bytes in 59 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 08 21:09:34.083379 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-f8dfa460-ae3e-447c-a498-38035c70d3c6 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-2134233298", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "networks": [{"uuid": "76a3600a-da76-44b8-88b9-2779bd398388"}]}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:09:34.096247 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-d68a2fa9-87b6-4c7d-97f4-9f0cf43cc6a3 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06443b5728fb4d1e95d6245820e786bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ded993145b4eda9d6a33b994519012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:34.105561 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-d68a2fa9-87b6-4c7d-97f4-9f0cf43cc6a3 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "GET /compute/v2.1/servers/99510c36-821a-41dd-9ffe-8955dda22dcf" status: 200 len: 1510 microversion: 2.1 time: 0.233576 Oct 08 21:09:34.110131 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2039/4172] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:33 2022] GET /compute/v2.1/servers/99510c36-821a-41dd-9ffe-8955dda22dcf => generated 1510 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:09:34.128796 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-4bdd96f5-57f4-4c32-b4bd-84c8c6e6fb0d tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:34.129491 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-4bdd96f5-57f4-4c32-b4bd-84c8c6e6fb0d tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:34.136700 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4bdd96f5-57f4-4c32-b4bd-84c8c6e6fb0d tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:34.137233 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4bdd96f5-57f4-4c32-b4bd-84c8c6e6fb0d tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:34.138073 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4bdd96f5-57f4-4c32-b4bd-84c8c6e6fb0d tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:34.139215 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4bdd96f5-57f4-4c32-b4bd-84c8c6e6fb0d tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:34.139941 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4bdd96f5-57f4-4c32-b4bd-84c8c6e6fb0d tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:34.141305 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4bdd96f5-57f4-4c32-b4bd-84c8c6e6fb0d tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:34.152475 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.network.neutron [None req-f8dfa460-ae3e-447c-a498-38035c70d3c6 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] validate_networks() for [('76a3600a-da76-44b8-88b9-2779bd398388', None, None, None, None, None)] {{(pid=140492) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 21:09:34.464309 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-4bdd96f5-57f4-4c32-b4bd-84c8c6e6fb0d tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:34.484570 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-4bdd96f5-57f4-4c32-b4bd-84c8c6e6fb0d tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 200 len: 1503 microversion: 2.1 time: 0.365892 Oct 08 21:09:34.491583 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2040/4173] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:34 2022] GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 1503 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:09:34.498049 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-3d272471-3e7c-4307-9bea-2283b4be781f tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:34.501237 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-3d272471-3e7c-4307-9bea-2283b4be781f tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: ba5cd412-0d20-4d2e-9f5e-de18f268008a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:34.509492 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3d272471-3e7c-4307-9bea-2283b4be781f tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:34.510243 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3d272471-3e7c-4307-9bea-2283b4be781f tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:34.510835 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3d272471-3e7c-4307-9bea-2283b4be781f tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:34.511716 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3d272471-3e7c-4307-9bea-2283b4be781f tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:34.512325 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3d272471-3e7c-4307-9bea-2283b4be781f tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:34.512890 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3d272471-3e7c-4307-9bea-2283b4be781f tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:34.747906 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-f8dfa460-ae3e-447c-a498-38035c70d3c6 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Flavor limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 21:09:34.748358 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-f8dfa460-ae3e-447c-a498-38035c70d3c6 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Image limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 21:09:34.748813 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-f8dfa460-ae3e-447c-a498-38035c70d3c6 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Flavor pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 21:09:34.749328 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-f8dfa460-ae3e-447c-a498-38035c70d3c6 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Image pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 21:09:34.749781 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-f8dfa460-ae3e-447c-a498-38035c70d3c6 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 21:09:34.763712 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f8dfa460-ae3e-447c-a498-38035c70d3c6 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:34.765248 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f8dfa460-ae3e-447c-a498-38035c70d3c6 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:34.765707 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f8dfa460-ae3e-447c-a498-38035c70d3c6 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:34.767216 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f8dfa460-ae3e-447c-a498-38035c70d3c6 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:34.768296 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f8dfa460-ae3e-447c-a498-38035c70d3c6 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:34.769342 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f8dfa460-ae3e-447c-a498-38035c70d3c6 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:34.784062 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-3d272471-3e7c-4307-9bea-2283b4be781f tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78e9afd772c4de981cac8f5817ec356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765c62cac2ee4406b23a5baa85c52ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:34.793814 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-3d272471-3e7c-4307-9bea-2283b4be781f tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/ba5cd412-0d20-4d2e-9f5e-de18f268008a" status: 200 len: 1506 microversion: 2.1 time: 0.300812 Oct 08 21:09:34.797991 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2041/4174] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:34 2022] GET /compute/v2.1/servers/ba5cd412-0d20-4d2e-9f5e-de18f268008a => generated 1506 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:09:34.812358 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-a27a8431-066f-4910-9d44-49896141cb22 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:34.813820 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-a27a8431-066f-4910-9d44-49896141cb22 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:34.824456 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a27a8431-066f-4910-9d44-49896141cb22 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:34.828006 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a27a8431-066f-4910-9d44-49896141cb22 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:34.829666 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-f8dfa460-ae3e-447c-a498-38035c70d3c6 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Getting quotas for project 6bcd0e7c24154409824f96e9e99da357. Resources: {'cores', 'instances', 'ram'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:09:34.830134 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a27a8431-066f-4910-9d44-49896141cb22 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:34.831124 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a27a8431-066f-4910-9d44-49896141cb22 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:34.832414 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a27a8431-066f-4910-9d44-49896141cb22 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:34.834437 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a27a8431-066f-4910-9d44-49896141cb22 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:34.844580 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-f8dfa460-ae3e-447c-a498-38035c70d3c6 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Getting quotas for user 30fe0e1ffa1040ec85d3c32d8b741c75 and project 6bcd0e7c24154409824f96e9e99da357. Resources: {'cores', 'instances', 'ram'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:09:34.875118 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-f8dfa460-ae3e-447c-a498-38035c70d3c6 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Going to run 1 instances... {{(pid=140492) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 21:09:34.880437 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-f8dfa460-ae3e-447c-a498-38035c70d3c6 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] [instance: 3fed4df9-92ff-4040-8fa7-db370960dc06] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c508bd7f-7db9-4b2c-af7c-be54a855c355',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140492) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 21:09:34.950695 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-f8dfa460-ae3e-447c-a498-38035c70d3c6 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.872694 Oct 08 21:09:34.951682 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2134/4175] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 21:09:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 874 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 08 21:09:34.966557 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-35886469-d23f-492e-b99b-1aeae33d5780 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:34.967216 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-35886469-d23f-492e-b99b-1aeae33d5780 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] [instance: 3fed4df9-92ff-4040-8fa7-db370960dc06] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:35.183798 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-a27a8431-066f-4910-9d44-49896141cb22 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:35.200147 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-a27a8431-066f-4910-9d44-49896141cb22 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 200 len: 1503 microversion: 2.1 time: 0.397437 Oct 08 21:09:35.202459 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2042/4176] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:34 2022] GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 1503 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:09:35.208632 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-783b57c1-a5f0-4187-8c5a-27fdbd41f4db tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:35.209625 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-783b57c1-a5f0-4187-8c5a-27fdbd41f4db tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] [instance: 159e29dd-802c-4059-99f9-bb7c113d430b] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:35.219339 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-783b57c1-a5f0-4187-8c5a-27fdbd41f4db tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:35.220194 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-783b57c1-a5f0-4187-8c5a-27fdbd41f4db tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:35.221811 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-783b57c1-a5f0-4187-8c5a-27fdbd41f4db tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:35.223508 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-783b57c1-a5f0-4187-8c5a-27fdbd41f4db tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:35.225510 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-783b57c1-a5f0-4187-8c5a-27fdbd41f4db tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:35.226131 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-783b57c1-a5f0-4187-8c5a-27fdbd41f4db tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:35.556496 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-35886469-d23f-492e-b99b-1aeae33d5780 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30fe0e1ffa1040ec85d3c32d8b741c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd0e7c24154409824f96e9e99da357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:35.557968 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-783b57c1-a5f0-4187-8c5a-27fdbd41f4db tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:35.567140 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-35886469-d23f-492e-b99b-1aeae33d5780 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "GET /compute/v2.1/servers/3fed4df9-92ff-4040-8fa7-db370960dc06" status: 200 len: 1208 microversion: 2.1 time: 0.606339 Oct 08 21:09:35.569527 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2135/4177] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:34 2022] GET /compute/v2.1/servers/3fed4df9-92ff-4040-8fa7-db370960dc06 => generated 1208 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:09:35.571812 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-783b57c1-a5f0-4187-8c5a-27fdbd41f4db tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:35.574370 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-783b57c1-a5f0-4187-8c5a-27fdbd41f4db tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:35.575807 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-783b57c1-a5f0-4187-8c5a-27fdbd41f4db tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] 10.222.0.26 "GET /compute/v2.1/servers/159e29dd-802c-4059-99f9-bb7c113d430b" status: 200 len: 1722 microversion: 2.20 time: 0.371760 Oct 08 21:09:35.589223 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-69110801-61dd-4cbe-98ec-4cadf8d16dcd tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:35.589223 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-69110801-61dd-4cbe-98ec-4cadf8d16dcd tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: 99510c36-821a-41dd-9ffe-8955dda22dcf] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:35.589488 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2043/4178] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:09:35 2022] GET /compute/v2.1/servers/159e29dd-802c-4059-99f9-bb7c113d430b => generated 1722 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:09:35.597225 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-69110801-61dd-4cbe-98ec-4cadf8d16dcd tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:35.597225 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-69110801-61dd-4cbe-98ec-4cadf8d16dcd tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:35.597686 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-69110801-61dd-4cbe-98ec-4cadf8d16dcd tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:35.598595 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-69110801-61dd-4cbe-98ec-4cadf8d16dcd tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:35.601437 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-69110801-61dd-4cbe-98ec-4cadf8d16dcd tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:35.601992 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-69110801-61dd-4cbe-98ec-4cadf8d16dcd tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:35.606589 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-6f442991-528c-47bb-a15c-a2111837f3ce tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-811163887", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "0af78ecb-f6e3-458a-ab57-630925a05ff0"}]}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:09:35.622390 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-6f442991-528c-47bb-a15c-a2111837f3ce tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Request method failure captured: Oct 08 21:09:35.622390 ncdv-master-1 devstack@n-api.service[140491]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 08 21:09:35.622390 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:09:35.622390 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:09:35.622390 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:09:35.622390 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 172 Oct 08 21:09:35.622390 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:09:35.622390 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:09:35.622390 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:09:35.622390 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:09:35.622390 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQebW09Z3m936-d3SrnQA9UQ3KXQvUYeQwL43ufWdoxmQhUwYBWv-JT053t_VYPo9wAVRoCqYQy8Hhh8zc2n570KpS0qNVLik822FjYabkSIZMA_ubWypXzSwo3J04zV1MoSSz79D-b8-ZvwYCEIbwpbfyn5opgOjnO6EXvq1UNPaSyQ Oct 08 21:09:35.622390 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:09:35.622390 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:09:35.622390 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:09:35.622390 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:09:35.622390 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:09:35.622390 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:09:35.622390 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 0ae02675057e4f27bc1980348afc8ca1 Oct 08 21:09:35.622390 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-ServersNegativeTestJSON-1441071354 Oct 08 21:09:35.622390 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:09:35.622390 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:09:35.622390 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0ae02675057e4f27bc1980348afc8ca1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0ae02675057e4f27bc1980348afc8ca1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0ae02675057e4f27bc1980348afc8ca1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0ae02675057e4f27bc1980348afc8ca1"}]}] Oct 08 21:09:35.622390 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-ServersNegativeTestJSON-1441071354 Oct 08 21:09:35.622390 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 0ae02675057e4f27bc1980348afc8ca1 Oct 08 21:09:35.622390 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1441071354 Oct 08 21:09:35.622390 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-ServersNegativeTestJSON-1441071354-project Oct 08 21:09:35.622390 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:09:35.622390 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:09:35.622390 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 6a78d352c143483c8e4702d789d4c516 Oct 08 21:09:35.622390 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-ServersNegativeTestJSON-1441071354-project Oct 08 21:09:35.622390 ncdv-master-1 devstack@n-api.service[140491]: Oct 08 21:09:35.622390 ncdv-master-1 devstack@n-api.service[140491]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-811163887", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "0af78ecb-f6e3-458a-ab57-630925a05ff0"}]}} Oct 08 21:09:35.622390 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:09:35.622390 ncdv-master-1 devstack@n-api.service[140491]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 08 21:09:35.622390 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-811163887', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': '0af78ecb-f6e3-458a-ab57-630925a05ff0'}]}}} Oct 08 21:09:35.622390 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:09:35.622390 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:09:35.622390 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 08 21:09:35.622390 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 08 21:09:35.622390 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 08 21:09:35.622390 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise error Oct 08 21:09:35.622390 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Oct 08 21:09:35.622390 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:09:35.622390 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Oct 08 21:09:35.622390 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Oct 08 21:09:35.622390 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Oct 08 21:09:35.622390 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:09:35.622390 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 08 21:09:35.622390 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi -1 Oct 08 21:09:35.622390 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:09:35.622390 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:09:35.622390 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:09:35.622390 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:09:35.622390 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:09:35.622390 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:09:35.622390 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:09:35.622390 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:09:35.622390 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:09:35.622390 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:09:35.622390 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 21:09:35.622390 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 21:09:35.622390 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 08 21:09:35.622390 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 08 21:09:35.622390 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 08 21:09:35.628084 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 08 21:09:35.628084 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 08 21:09:35.628084 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 08 21:09:35.628084 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 08 21:09:35.628084 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:09:35.628084 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:09:35.628084 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:09:35.628084 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:09:35.628084 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:09:35.628084 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:09:35.628084 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 08 21:09:35.628084 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 08 21:09:35.628084 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 08 21:09:35.628084 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:09:35.632720 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-6f442991-528c-47bb-a15c-a2111837f3ce tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:09:35.636038 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-6f442991-528c-47bb-a15c-a2111837f3ce tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.051593 Oct 08 21:09:35.636858 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2044/4179] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 21:09:35 2022] POST /compute/v2.1/servers => generated 145 bytes in 53 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 08 21:09:35.646967 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-426a7f5e-7523-40bb-864d-cef8309581fb tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:35.647605 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-426a7f5e-7523-40bb-864d-cef8309581fb tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:35.657272 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-426a7f5e-7523-40bb-864d-cef8309581fb tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:35.657794 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-426a7f5e-7523-40bb-864d-cef8309581fb tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:35.658258 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-426a7f5e-7523-40bb-864d-cef8309581fb tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:35.659000 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-426a7f5e-7523-40bb-864d-cef8309581fb tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:35.659475 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-426a7f5e-7523-40bb-864d-cef8309581fb tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:35.659919 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-426a7f5e-7523-40bb-864d-cef8309581fb tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:35.968210 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-69110801-61dd-4cbe-98ec-4cadf8d16dcd tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06443b5728fb4d1e95d6245820e786bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ded993145b4eda9d6a33b994519012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:35.978574 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-69110801-61dd-4cbe-98ec-4cadf8d16dcd tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "GET /compute/v2.1/servers/99510c36-821a-41dd-9ffe-8955dda22dcf" status: 200 len: 1487 microversion: 2.1 time: 0.407537 Oct 08 21:09:35.980926 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2136/4180] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:35 2022] GET /compute/v2.1/servers/99510c36-821a-41dd-9ffe-8955dda22dcf => generated 1487 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:09:35.985539 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-6e0e6bf0-4ad5-4f97-a024-eb3a4bbbd624 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:35.986158 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-6e0e6bf0-4ad5-4f97-a024-eb3a4bbbd624 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: ba5cd412-0d20-4d2e-9f5e-de18f268008a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:35.996740 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-426a7f5e-7523-40bb-864d-cef8309581fb tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:36.000951 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:09:36.021978 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-426a7f5e-7523-40bb-864d-cef8309581fb tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 200 len: 1503 microversion: 2.1 time: 0.378937 Oct 08 21:09:36.024393 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6e0e6bf0-4ad5-4f97-a024-eb3a4bbbd624 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:36.025505 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6e0e6bf0-4ad5-4f97-a024-eb3a4bbbd624 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:36.028632 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2045/4181] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:35 2022] GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 1503 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:09:36.031039 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6e0e6bf0-4ad5-4f97-a024-eb3a4bbbd624 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:36.031911 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6e0e6bf0-4ad5-4f97-a024-eb3a4bbbd624 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:36.032471 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6e0e6bf0-4ad5-4f97-a024-eb3a4bbbd624 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:36.032833 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6e0e6bf0-4ad5-4f97-a024-eb3a4bbbd624 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:36.042506 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-20c12616-8f32-4770-b097-ecdf387323b2 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-2047345875"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:09:36.054193 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-20c12616-8f32-4770-b097-ecdf387323b2 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: 99510c36-821a-41dd-9ffe-8955dda22dcf] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:36.067094 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-20c12616-8f32-4770-b097-ecdf387323b2 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:36.067883 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-20c12616-8f32-4770-b097-ecdf387323b2 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:36.068649 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-20c12616-8f32-4770-b097-ecdf387323b2 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:36.070608 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-20c12616-8f32-4770-b097-ecdf387323b2 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:36.071933 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-20c12616-8f32-4770-b097-ecdf387323b2 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:36.072452 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-20c12616-8f32-4770-b097-ecdf387323b2 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:36.280348 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-20c12616-8f32-4770-b097-ecdf387323b2 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "PUT /compute/v2.1/servers/99510c36-821a-41dd-9ffe-8955dda22dcf" status: 200 len: 1061 microversion: 2.1 time: 0.250156 Oct 08 21:09:36.282113 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2046/4182] 10.222.0.26 () {60 vars in 1256 bytes} [Sat Oct 8 21:09:36 2022] PUT /compute/v2.1/servers/99510c36-821a-41dd-9ffe-8955dda22dcf => generated 1061 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:09:36.288599 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-d3b58623-0acc-4303-99c3-cdc11f5c5766 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:36.290282 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-d3b58623-0acc-4303-99c3-cdc11f5c5766 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:36.299376 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d3b58623-0acc-4303-99c3-cdc11f5c5766 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:36.300656 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d3b58623-0acc-4303-99c3-cdc11f5c5766 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:36.301802 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d3b58623-0acc-4303-99c3-cdc11f5c5766 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:36.302844 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d3b58623-0acc-4303-99c3-cdc11f5c5766 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:36.303507 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d3b58623-0acc-4303-99c3-cdc11f5c5766 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:36.304143 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d3b58623-0acc-4303-99c3-cdc11f5c5766 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:36.419217 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-6e0e6bf0-4ad5-4f97-a024-eb3a4bbbd624 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78e9afd772c4de981cac8f5817ec356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765c62cac2ee4406b23a5baa85c52ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:36.428950 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-6e0e6bf0-4ad5-4f97-a024-eb3a4bbbd624 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/ba5cd412-0d20-4d2e-9f5e-de18f268008a" status: 200 len: 1506 microversion: 2.1 time: 0.446906 Oct 08 21:09:36.429955 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2137/4183] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:35 2022] GET /compute/v2.1/servers/ba5cd412-0d20-4d2e-9f5e-de18f268008a => generated 1506 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:09:36.440789 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-6b96381c-4963-4d24-9765-39b5915a0e17 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:36.449631 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-6b96381c-4963-4d24-9765-39b5915a0e17 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: 99510c36-821a-41dd-9ffe-8955dda22dcf] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:36.456470 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6b96381c-4963-4d24-9765-39b5915a0e17 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:36.456992 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6b96381c-4963-4d24-9765-39b5915a0e17 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:36.457492 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6b96381c-4963-4d24-9765-39b5915a0e17 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:36.458251 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6b96381c-4963-4d24-9765-39b5915a0e17 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:36.458759 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6b96381c-4963-4d24-9765-39b5915a0e17 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:36.459198 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6b96381c-4963-4d24-9765-39b5915a0e17 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:36.803231 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-6b96381c-4963-4d24-9765-39b5915a0e17 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06443b5728fb4d1e95d6245820e786bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ded993145b4eda9d6a33b994519012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:36.821806 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-6b96381c-4963-4d24-9765-39b5915a0e17 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "GET /compute/v2.1/servers/99510c36-821a-41dd-9ffe-8955dda22dcf" status: 200 len: 1488 microversion: 2.1 time: 0.386970 Oct 08 21:09:36.823185 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2138/4184] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:36 2022] GET /compute/v2.1/servers/99510c36-821a-41dd-9ffe-8955dda22dcf => generated 1488 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:09:36.854512 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-1a6a1df6-d551-447b-a540-6945a7a731d5 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:36.859300 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-d3b58623-0acc-4303-99c3-cdc11f5c5766 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:36.860765 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-1a6a1df6-d551-447b-a540-6945a7a731d5 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] [instance: 3fed4df9-92ff-4040-8fa7-db370960dc06] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:36.880638 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1a6a1df6-d551-447b-a540-6945a7a731d5 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:36.881457 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1a6a1df6-d551-447b-a540-6945a7a731d5 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:36.882202 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1a6a1df6-d551-447b-a540-6945a7a731d5 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:36.882900 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-d3b58623-0acc-4303-99c3-cdc11f5c5766 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 200 len: 1503 microversion: 2.1 time: 0.599403 Oct 08 21:09:36.883427 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1a6a1df6-d551-447b-a540-6945a7a731d5 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:36.884757 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1a6a1df6-d551-447b-a540-6945a7a731d5 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:36.885337 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2047/4185] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:36 2022] GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 1503 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:09:36.885917 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1a6a1df6-d551-447b-a540-6945a7a731d5 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:36.908863 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-28f503af-60b7-439a-94f1-fa4e7d11cfe4 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:36.909083 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-28f503af-60b7-439a-94f1-fa4e7d11cfe4 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] [instance: 159e29dd-802c-4059-99f9-bb7c113d430b] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:36.941467 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-28f503af-60b7-439a-94f1-fa4e7d11cfe4 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:36.944920 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-28f503af-60b7-439a-94f1-fa4e7d11cfe4 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:36.945719 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-28f503af-60b7-439a-94f1-fa4e7d11cfe4 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:36.947979 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-28f503af-60b7-439a-94f1-fa4e7d11cfe4 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:36.950784 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-28f503af-60b7-439a-94f1-fa4e7d11cfe4 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:36.952041 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-28f503af-60b7-439a-94f1-fa4e7d11cfe4 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:36.980680 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-1a6a1df6-d551-447b-a540-6945a7a731d5 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30fe0e1ffa1040ec85d3c32d8b741c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd0e7c24154409824f96e9e99da357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:36.993644 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-1a6a1df6-d551-447b-a540-6945a7a731d5 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "GET /compute/v2.1/servers/3fed4df9-92ff-4040-8fa7-db370960dc06" status: 200 len: 1204 microversion: 2.1 time: 0.152640 Oct 08 21:09:37.004348 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2139/4186] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:36 2022] GET /compute/v2.1/servers/3fed4df9-92ff-4040-8fa7-db370960dc06 => generated 1204 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:09:37.010023 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-4b0231cf-3bb7-4e00-a381-1fdb1ca72ac4 req-95f9b4a8-fcd8-406a-bacb-2195209be7a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9e77bd1-3ce0-4f0a-b5ac-8c0ba6caffbb", "name": "network-vif-deleted", "tag": "d7fcb7de-d762-4c1b-b3d5-f613b5fc112a"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:09:37.037665 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-4b0231cf-3bb7-4e00-a381-1fdb1ca72ac4 req-95f9b4a8-fcd8-406a-bacb-2195209be7a5 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:37.038542 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-4b0231cf-3bb7-4e00-a381-1fdb1ca72ac4 req-95f9b4a8-fcd8-406a-bacb-2195209be7a5 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:37.039181 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-4b0231cf-3bb7-4e00-a381-1fdb1ca72ac4 req-95f9b4a8-fcd8-406a-bacb-2195209be7a5 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:37.068932 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-4b0231cf-3bb7-4e00-a381-1fdb1ca72ac4 req-95f9b4a8-fcd8-406a-bacb-2195209be7a5 service nova] Creating event network-vif-deleted:d7fcb7de-d762-4c1b-b3d5-f613b5fc112a for instance b9e77bd1-3ce0-4f0a-b5ac-8c0ba6caffbb on nch1-master-1 Oct 08 21:09:37.082347 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-4b0231cf-3bb7-4e00-a381-1fdb1ca72ac4 req-95f9b4a8-fcd8-406a-bacb-2195209be7a5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080713 Oct 08 21:09:37.083439 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2140/4187] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:09:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:09:37.091623 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-ae971df5-1e9c-4c14-aefc-af0f16875067 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:37.092739 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-ae971df5-1e9c-4c14-aefc-af0f16875067 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: 99510c36-821a-41dd-9ffe-8955dda22dcf] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:37.100381 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ae971df5-1e9c-4c14-aefc-af0f16875067 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:37.101170 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ae971df5-1e9c-4c14-aefc-af0f16875067 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:37.101857 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ae971df5-1e9c-4c14-aefc-af0f16875067 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:37.103605 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ae971df5-1e9c-4c14-aefc-af0f16875067 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:37.104299 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ae971df5-1e9c-4c14-aefc-af0f16875067 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:37.104952 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ae971df5-1e9c-4c14-aefc-af0f16875067 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:37.271623 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-ae971df5-1e9c-4c14-aefc-af0f16875067 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06443b5728fb4d1e95d6245820e786bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ded993145b4eda9d6a33b994519012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:37.275299 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-28f503af-60b7-439a-94f1-fa4e7d11cfe4 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:37.281661 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-ae971df5-1e9c-4c14-aefc-af0f16875067 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "GET /compute/v2.1/servers/99510c36-821a-41dd-9ffe-8955dda22dcf" status: 200 len: 1488 microversion: 2.1 time: 0.196421 Oct 08 21:09:37.282260 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2141/4188] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:37 2022] GET /compute/v2.1/servers/99510c36-821a-41dd-9ffe-8955dda22dcf => generated 1488 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:09:37.287823 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-725c7bdf-dd0f-471b-965c-db2a0bb5ce69 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1224341421", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:09:37.290672 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-28f503af-60b7-439a-94f1-fa4e7d11cfe4 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:37.292641 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-28f503af-60b7-439a-94f1-fa4e7d11cfe4 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:37.296825 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-28f503af-60b7-439a-94f1-fa4e7d11cfe4 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] 10.222.0.26 "GET /compute/v2.1/servers/159e29dd-802c-4059-99f9-bb7c113d430b" status: 200 len: 1722 microversion: 2.20 time: 0.410102 Oct 08 21:09:37.301679 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2048/4189] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:09:36 2022] GET /compute/v2.1/servers/159e29dd-802c-4059-99f9-bb7c113d430b => generated 1722 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:09:37.310802 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-725c7bdf-dd0f-471b-965c-db2a0bb5ce69 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 08 21:09:37.313884 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-725c7bdf-dd0f-471b-965c-db2a0bb5ce69 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Request method failure captured: Oct 08 21:09:37.313884 ncdv-master-1 devstack@n-api.service[140492]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 08 21:09:37.313884 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:09:37.313884 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:09:37.313884 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:09:37.313884 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 216 Oct 08 21:09:37.313884 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:09:37.313884 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:09:37.313884 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:09:37.313884 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:09:37.313884 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQebW09Z3m936-d3SrnQA9UQ3KXQvUYeQwL43ufWdoxmQhUwYBWv-JT053t_VYPo9wAVRoCqYQy8Hhh8zc2n570KpS0qNVLik822FjYabkSIZMA_ubWypXzSwo3J04zV1MoSSz79D-b8-ZvwYCEIbwpbfyn5opgOjnO6EXvq1UNPaSyQ Oct 08 21:09:37.313884 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:09:37.313884 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:09:37.313884 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:09:37.313884 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:09:37.313884 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:09:37.313884 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:09:37.313884 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 0ae02675057e4f27bc1980348afc8ca1 Oct 08 21:09:37.313884 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-ServersNegativeTestJSON-1441071354 Oct 08 21:09:37.313884 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:09:37.313884 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:09:37.313884 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0ae02675057e4f27bc1980348afc8ca1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0ae02675057e4f27bc1980348afc8ca1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0ae02675057e4f27bc1980348afc8ca1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0ae02675057e4f27bc1980348afc8ca1"}]}] Oct 08 21:09:37.313884 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-ServersNegativeTestJSON-1441071354 Oct 08 21:09:37.313884 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 0ae02675057e4f27bc1980348afc8ca1 Oct 08 21:09:37.313884 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1441071354 Oct 08 21:09:37.313884 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-ServersNegativeTestJSON-1441071354-project Oct 08 21:09:37.313884 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:09:37.313884 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:09:37.313884 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 6a78d352c143483c8e4702d789d4c516 Oct 08 21:09:37.313884 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-ServersNegativeTestJSON-1441071354-project Oct 08 21:09:37.313884 ncdv-master-1 devstack@n-api.service[140492]: Oct 08 21:09:37.313884 ncdv-master-1 devstack@n-api.service[140492]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1224341421", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Oct 08 21:09:37.313884 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 21:09:37.313884 ncdv-master-1 devstack@n-api.service[140492]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 08 21:09:37.313884 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1224341421', 'imageRef': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Oct 08 21:09:37.313884 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:09:37.313884 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:09:37.313884 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:09:37.313884 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:09:37.313884 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:09:37.313884 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:09:37.313884 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:09:37.313884 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:09:37.313884 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 21:09:37.313884 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 21:09:37.313884 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 21:09:37.313884 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 21:09:37.313884 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 21:09:37.313884 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 21:09:37.313884 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 08 21:09:37.313884 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Oct 08 21:09:37.313884 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Oct 08 21:09:37.313884 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Oct 08 21:09:37.313884 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Oct 08 21:09:37.313884 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Oct 08 21:09:37.313884 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi self._validate_network_id( Oct 08 21:09:37.313884 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Oct 08 21:09:37.313884 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 08 21:09:37.313884 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 08 21:09:37.313884 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:09:37.313884 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:09:37.317220 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:09:37.317220 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:09:37.317220 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:09:37.317220 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:09:37.317220 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:09:37.317220 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:09:37.317220 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 08 21:09:37.317220 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:09:37.317672 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-6da5ac7e-342b-4af7-bfe4-1210c176ae8c tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:37.317672 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-6da5ac7e-342b-4af7-bfe4-1210c176ae8c tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: 99510c36-821a-41dd-9ffe-8955dda22dcf] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:37.322029 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-725c7bdf-dd0f-471b-965c-db2a0bb5ce69 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:09:37.322886 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6da5ac7e-342b-4af7-bfe4-1210c176ae8c tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:37.323381 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6da5ac7e-342b-4af7-bfe4-1210c176ae8c tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:37.323820 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6da5ac7e-342b-4af7-bfe4-1210c176ae8c tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:37.324535 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6da5ac7e-342b-4af7-bfe4-1210c176ae8c tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:37.324993 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6da5ac7e-342b-4af7-bfe4-1210c176ae8c tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:37.325355 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-725c7bdf-dd0f-471b-965c-db2a0bb5ce69 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.040707 Oct 08 21:09:37.325465 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6da5ac7e-342b-4af7-bfe4-1210c176ae8c tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:37.332641 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2142/4190] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 21:09:37 2022] POST /compute/v2.1/servers => generated 123 bytes in 48 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 08 21:09:37.340309 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-09a25dd2-4e0e-4d2c-b767-fef6d3bddb12 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:37.341209 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-09a25dd2-4e0e-4d2c-b767-fef6d3bddb12 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:37.360041 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-6da5ac7e-342b-4af7-bfe4-1210c176ae8c tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: 99510c36-821a-41dd-9ffe-8955dda22dcf] Going to try to terminate instance {{(pid=140491) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 21:09:37.366342 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-09a25dd2-4e0e-4d2c-b767-fef6d3bddb12 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:37.368696 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-09a25dd2-4e0e-4d2c-b767-fef6d3bddb12 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:37.370962 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-09a25dd2-4e0e-4d2c-b767-fef6d3bddb12 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:37.371729 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-09a25dd2-4e0e-4d2c-b767-fef6d3bddb12 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:37.372208 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-09a25dd2-4e0e-4d2c-b767-fef6d3bddb12 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:37.374938 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-09a25dd2-4e0e-4d2c-b767-fef6d3bddb12 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:37.526457 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-6da5ac7e-342b-4af7-bfe4-1210c176ae8c tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "DELETE /compute/v2.1/servers/99510c36-821a-41dd-9ffe-8955dda22dcf" status: 204 len: 0 microversion: 2.1 time: 0.219331 Oct 08 21:09:37.529755 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2049/4191] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:09:37 2022] DELETE /compute/v2.1/servers/99510c36-821a-41dd-9ffe-8955dda22dcf => generated 0 bytes in 227 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 21:09:37.541688 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-42b28b52-59b9-469f-adca-e322c56e7f47 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:37.542785 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-42b28b52-59b9-469f-adca-e322c56e7f47 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: ba5cd412-0d20-4d2e-9f5e-de18f268008a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:37.550191 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-42b28b52-59b9-469f-adca-e322c56e7f47 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:37.551047 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-42b28b52-59b9-469f-adca-e322c56e7f47 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:37.551823 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-42b28b52-59b9-469f-adca-e322c56e7f47 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:37.552783 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-42b28b52-59b9-469f-adca-e322c56e7f47 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:37.553507 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-42b28b52-59b9-469f-adca-e322c56e7f47 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:37.554167 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-42b28b52-59b9-469f-adca-e322c56e7f47 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:37.587330 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-09a25dd2-4e0e-4d2c-b767-fef6d3bddb12 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:37.598114 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-09a25dd2-4e0e-4d2c-b767-fef6d3bddb12 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 200 len: 1503 microversion: 2.1 time: 0.263184 Oct 08 21:09:37.598930 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2143/4192] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:37 2022] GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 1503 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:09:37.605076 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-4a70bbde-33c9-42ad-9f4d-7602017f94ff tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:37.606001 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-4a70bbde-33c9-42ad-9f4d-7602017f94ff tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: 99510c36-821a-41dd-9ffe-8955dda22dcf] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:37.613876 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4a70bbde-33c9-42ad-9f4d-7602017f94ff tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:37.617926 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4a70bbde-33c9-42ad-9f4d-7602017f94ff tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:37.618925 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4a70bbde-33c9-42ad-9f4d-7602017f94ff tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:37.622794 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4a70bbde-33c9-42ad-9f4d-7602017f94ff tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:37.622794 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4a70bbde-33c9-42ad-9f4d-7602017f94ff tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:37.623301 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4a70bbde-33c9-42ad-9f4d-7602017f94ff tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:37.817750 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-4a70bbde-33c9-42ad-9f4d-7602017f94ff tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06443b5728fb4d1e95d6245820e786bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ded993145b4eda9d6a33b994519012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:37.836231 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-4a70bbde-33c9-42ad-9f4d-7602017f94ff tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "GET /compute/v2.1/servers/99510c36-821a-41dd-9ffe-8955dda22dcf" status: 200 len: 1494 microversion: 2.1 time: 0.235516 Oct 08 21:09:37.837464 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2144/4193] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:37 2022] GET /compute/v2.1/servers/99510c36-821a-41dd-9ffe-8955dda22dcf => generated 1494 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:09:37.853616 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-00a3990b-0f5e-4324-bd74-9c95244aba87 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:37.854261 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-00a3990b-0f5e-4324-bd74-9c95244aba87 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:37.862005 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-00a3990b-0f5e-4324-bd74-9c95244aba87 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:37.862645 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-00a3990b-0f5e-4324-bd74-9c95244aba87 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:37.863123 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-00a3990b-0f5e-4324-bd74-9c95244aba87 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:37.863845 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-00a3990b-0f5e-4324-bd74-9c95244aba87 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:37.864498 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-00a3990b-0f5e-4324-bd74-9c95244aba87 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:37.865094 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-00a3990b-0f5e-4324-bd74-9c95244aba87 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:38.088772 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-00a3990b-0f5e-4324-bd74-9c95244aba87 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:38.100695 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-00a3990b-0f5e-4324-bd74-9c95244aba87 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 200 len: 1503 microversion: 2.1 time: 0.262012 Oct 08 21:09:38.102265 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2145/4194] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:37 2022] GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 1503 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:09:38.108029 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-ce6c0c20-cdfd-4d9e-bd09-e93ee96dc8c5 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:38.109157 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-ce6c0c20-cdfd-4d9e-bd09-e93ee96dc8c5 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] [instance: 3fed4df9-92ff-4040-8fa7-db370960dc06] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:38.124823 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ce6c0c20-cdfd-4d9e-bd09-e93ee96dc8c5 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:38.126205 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ce6c0c20-cdfd-4d9e-bd09-e93ee96dc8c5 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:38.127519 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ce6c0c20-cdfd-4d9e-bd09-e93ee96dc8c5 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:38.129329 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ce6c0c20-cdfd-4d9e-bd09-e93ee96dc8c5 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:38.130082 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ce6c0c20-cdfd-4d9e-bd09-e93ee96dc8c5 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:38.131201 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ce6c0c20-cdfd-4d9e-bd09-e93ee96dc8c5 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:38.218760 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-ce6c0c20-cdfd-4d9e-bd09-e93ee96dc8c5 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30fe0e1ffa1040ec85d3c32d8b741c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd0e7c24154409824f96e9e99da357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:38.229766 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=100 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:09:38.234581 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-ce6c0c20-cdfd-4d9e-bd09-e93ee96dc8c5 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "GET /compute/v2.1/servers/3fed4df9-92ff-4040-8fa7-db370960dc06" status: 200 len: 1260 microversion: 2.1 time: 0.130485 Oct 08 21:09:38.235263 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2146/4195] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:38 2022] GET /compute/v2.1/servers/3fed4df9-92ff-4040-8fa7-db370960dc06 => generated 1260 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:09:38.241629 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-d3155c28-3acf-44d7-908b-c9f157d8c44c tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-262768040", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "key_name": "tempest-key-1507454887", "networks": [{"uuid": "0af78ecb-f6e3-458a-ab57-630925a05ff0"}]}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:09:38.308452 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.network.neutron [None req-d3155c28-3acf-44d7-908b-c9f157d8c44c tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] validate_networks() for [('0af78ecb-f6e3-458a-ab57-630925a05ff0', None, None, None, None, None)] {{(pid=140492) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 21:09:38.360484 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-42b28b52-59b9-469f-adca-e322c56e7f47 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78e9afd772c4de981cac8f5817ec356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765c62cac2ee4406b23a5baa85c52ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:38.371986 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-42b28b52-59b9-469f-adca-e322c56e7f47 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/ba5cd412-0d20-4d2e-9f5e-de18f268008a" status: 200 len: 1506 microversion: 2.1 time: 0.839568 Oct 08 21:09:38.373337 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2050/4196] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:37 2022] GET /compute/v2.1/servers/ba5cd412-0d20-4d2e-9f5e-de18f268008a => generated 1506 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:09:38.379826 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-12bb8f40-ba89-4df7-bf6c-63d367d426c0 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:38.381072 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-12bb8f40-ba89-4df7-bf6c-63d367d426c0 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] [instance: 159e29dd-802c-4059-99f9-bb7c113d430b] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:38.389644 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-12bb8f40-ba89-4df7-bf6c-63d367d426c0 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:38.390647 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-12bb8f40-ba89-4df7-bf6c-63d367d426c0 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:38.391213 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-12bb8f40-ba89-4df7-bf6c-63d367d426c0 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:38.392391 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-12bb8f40-ba89-4df7-bf6c-63d367d426c0 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:38.393153 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-12bb8f40-ba89-4df7-bf6c-63d367d426c0 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:38.393847 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-12bb8f40-ba89-4df7-bf6c-63d367d426c0 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:38.560921 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-d3155c28-3acf-44d7-908b-c9f157d8c44c tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] HTTP exception thrown: Invalid key_name provided. Oct 08 21:09:38.565556 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-d3155c28-3acf-44d7-908b-c9f157d8c44c tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Request method failure captured: Oct 08 21:09:38.565556 ncdv-master-1 devstack@n-api.service[140492]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 08 21:09:38.565556 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:09:38.565556 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:09:38.565556 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:09:38.565556 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 246 Oct 08 21:09:38.565556 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:09:38.565556 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:09:38.565556 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:09:38.565556 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:09:38.565556 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQebW09Z3m936-d3SrnQA9UQ3KXQvUYeQwL43ufWdoxmQhUwYBWv-JT053t_VYPo9wAVRoCqYQy8Hhh8zc2n570KpS0qNVLik822FjYabkSIZMA_ubWypXzSwo3J04zV1MoSSz79D-b8-ZvwYCEIbwpbfyn5opgOjnO6EXvq1UNPaSyQ Oct 08 21:09:38.565556 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:09:38.565556 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:09:38.565556 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:09:38.565556 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:09:38.565556 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:09:38.565556 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:09:38.565556 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 0ae02675057e4f27bc1980348afc8ca1 Oct 08 21:09:38.565556 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-ServersNegativeTestJSON-1441071354 Oct 08 21:09:38.565556 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:09:38.565556 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:09:38.565556 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0ae02675057e4f27bc1980348afc8ca1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0ae02675057e4f27bc1980348afc8ca1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0ae02675057e4f27bc1980348afc8ca1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0ae02675057e4f27bc1980348afc8ca1"}]}] Oct 08 21:09:38.565556 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-ServersNegativeTestJSON-1441071354 Oct 08 21:09:38.565556 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 0ae02675057e4f27bc1980348afc8ca1 Oct 08 21:09:38.565556 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1441071354 Oct 08 21:09:38.565556 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-ServersNegativeTestJSON-1441071354-project Oct 08 21:09:38.565556 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:09:38.565556 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:09:38.565556 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 6a78d352c143483c8e4702d789d4c516 Oct 08 21:09:38.565556 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-ServersNegativeTestJSON-1441071354-project Oct 08 21:09:38.565556 ncdv-master-1 devstack@n-api.service[140492]: Oct 08 21:09:38.565556 ncdv-master-1 devstack@n-api.service[140492]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-262768040", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "key_name": "tempest-key-1507454887", "networks": [{"uuid": "0af78ecb-f6e3-458a-ab57-630925a05ff0"}]}} Oct 08 21:09:38.565556 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 21:09:38.565556 ncdv-master-1 devstack@n-api.service[140492]: exception: Invalid key_name provided. Oct 08 21:09:38.565556 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-262768040', 'imageRef': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'flavorRef': '452', 'key_name': 'tempest-key-1507454887', 'networks': [{'uuid': '0af78ecb-f6e3-458a-ab57-630925a05ff0'}]}}} Oct 08 21:09:38.565556 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:09:38.565556 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:09:38.565556 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 08 21:09:38.565556 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 08 21:09:38.565556 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 08 21:09:38.565556 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 08 21:09:38.565556 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 08 21:09:38.565556 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 08 21:09:38.565556 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1089, in _validate_and_build_base_options Oct 08 21:09:38.565556 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Oct 08 21:09:38.565556 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 08 21:09:38.565556 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 08 21:09:38.565556 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Oct 08 21:09:38.565556 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Oct 08 21:09:38.565556 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Oct 08 21:09:38.565556 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Oct 08 21:09:38.565556 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 08 21:09:38.565556 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 08 21:09:38.565556 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Oct 08 21:09:38.565556 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Oct 08 21:09:38.565556 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-1507454887 not found for user 6a78d352c143483c8e4702d789d4c516 Oct 08 21:09:38.565556 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:09:38.565556 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:09:38.565556 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:09:38.565556 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:09:38.565556 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:09:38.569738 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:09:38.569738 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:09:38.569738 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:09:38.569738 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:09:38.569738 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:09:38.569738 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 21:09:38.569738 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 21:09:38.569738 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 21:09:38.569738 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 21:09:38.569738 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 21:09:38.569738 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 21:09:38.569738 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 08 21:09:38.569738 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Oct 08 21:09:38.569738 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 08 21:09:38.569738 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Oct 08 21:09:38.569738 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:09:38.569738 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:09:38.569738 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:09:38.569738 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:09:38.569738 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:09:38.569738 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:09:38.569738 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:09:38.569738 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:09:38.569738 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Oct 08 21:09:38.569738 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:09:38.569738 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-d3155c28-3acf-44d7-908b-c9f157d8c44c tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Returning 400 to user: Invalid key_name provided. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:09:38.569738 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-d3155c28-3acf-44d7-908b-c9f157d8c44c tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 0.332246 Oct 08 21:09:38.571537 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2147/4197] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 21:09:38 2022] POST /compute/v2.1/servers => generated 70 bytes in 335 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 08 21:09:38.578714 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-32c02fd9-e962-443e-b41b-d1cb5a52139a tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:38.579411 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-32c02fd9-e962-443e-b41b-d1cb5a52139a tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:38.585463 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-32c02fd9-e962-443e-b41b-d1cb5a52139a tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:38.586157 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-32c02fd9-e962-443e-b41b-d1cb5a52139a tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:38.586610 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-32c02fd9-e962-443e-b41b-d1cb5a52139a tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:38.587504 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-32c02fd9-e962-443e-b41b-d1cb5a52139a tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:38.587967 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-32c02fd9-e962-443e-b41b-d1cb5a52139a tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:38.588400 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-32c02fd9-e962-443e-b41b-d1cb5a52139a tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:38.658189 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-12bb8f40-ba89-4df7-bf6c-63d367d426c0 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:38.668952 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-12bb8f40-ba89-4df7-bf6c-63d367d426c0 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:38.670540 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-12bb8f40-ba89-4df7-bf6c-63d367d426c0 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:38.672034 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-12bb8f40-ba89-4df7-bf6c-63d367d426c0 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] 10.222.0.26 "GET /compute/v2.1/servers/159e29dd-802c-4059-99f9-bb7c113d430b" status: 200 len: 1722 microversion: 2.20 time: 0.297569 Oct 08 21:09:38.672778 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2051/4198] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:09:38 2022] GET /compute/v2.1/servers/159e29dd-802c-4059-99f9-bb7c113d430b => generated 1722 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:09:38.733329 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-32c02fd9-e962-443e-b41b-d1cb5a52139a tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:38.741367 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-32c02fd9-e962-443e-b41b-d1cb5a52139a tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 200 len: 1503 microversion: 2.1 time: 0.166192 Oct 08 21:09:38.742165 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2148/4199] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:38 2022] GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 1503 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:09:38.767254 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-bdf95f4e-02bf-493e-84ba-2d1b9c53f988 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:38.767947 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-bdf95f4e-02bf-493e-84ba-2d1b9c53f988 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:38.785106 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bdf95f4e-02bf-493e-84ba-2d1b9c53f988 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:38.785700 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bdf95f4e-02bf-493e-84ba-2d1b9c53f988 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:38.786114 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bdf95f4e-02bf-493e-84ba-2d1b9c53f988 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:38.786851 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bdf95f4e-02bf-493e-84ba-2d1b9c53f988 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:38.787320 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bdf95f4e-02bf-493e-84ba-2d1b9c53f988 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:38.787763 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bdf95f4e-02bf-493e-84ba-2d1b9c53f988 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:38.866572 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-731ab259-1224-4c65-8671-77486d47b151 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:38.867313 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-731ab259-1224-4c65-8671-77486d47b151 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: 99510c36-821a-41dd-9ffe-8955dda22dcf] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:38.874564 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-731ab259-1224-4c65-8671-77486d47b151 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:38.875199 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-731ab259-1224-4c65-8671-77486d47b151 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:38.875737 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-731ab259-1224-4c65-8671-77486d47b151 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:38.876526 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-731ab259-1224-4c65-8671-77486d47b151 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:38.877051 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-731ab259-1224-4c65-8671-77486d47b151 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:38.877701 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-731ab259-1224-4c65-8671-77486d47b151 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:39.049220 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-bdf95f4e-02bf-493e-84ba-2d1b9c53f988 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:39.062083 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-bdf95f4e-02bf-493e-84ba-2d1b9c53f988 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 200 len: 1503 microversion: 2.1 time: 0.298284 Oct 08 21:09:39.065671 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2052/4200] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:38 2022] GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 1503 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:09:39.073266 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-731ab259-1224-4c65-8671-77486d47b151 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06443b5728fb4d1e95d6245820e786bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ded993145b4eda9d6a33b994519012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:39.084718 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-731ab259-1224-4c65-8671-77486d47b151 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "GET /compute/v2.1/servers/99510c36-821a-41dd-9ffe-8955dda22dcf" status: 200 len: 1494 microversion: 2.1 time: 0.224475 Oct 08 21:09:39.088419 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2149/4201] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:38 2022] GET /compute/v2.1/servers/99510c36-821a-41dd-9ffe-8955dda22dcf => generated 1494 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:09:39.156285 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-7a71aa25-0dfa-4720-bc95-268ce2ef38af tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-821666718", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "0af78ecb-f6e3-458a-ab57-630925a05ff0"}]}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:09:39.169806 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:09:39.271226 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-880d30bf-3d82-462b-af8f-088178c34d2a tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:39.271723 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-880d30bf-3d82-462b-af8f-088178c34d2a tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] [instance: 3fed4df9-92ff-4040-8fa7-db370960dc06] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:39.290138 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-880d30bf-3d82-462b-af8f-088178c34d2a tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:39.295206 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-880d30bf-3d82-462b-af8f-088178c34d2a tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:39.295962 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-880d30bf-3d82-462b-af8f-088178c34d2a tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:39.300127 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-880d30bf-3d82-462b-af8f-088178c34d2a tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:39.300843 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-880d30bf-3d82-462b-af8f-088178c34d2a tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:39.306245 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-880d30bf-3d82-462b-af8f-088178c34d2a tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:39.449572 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-880d30bf-3d82-462b-af8f-088178c34d2a tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30fe0e1ffa1040ec85d3c32d8b741c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd0e7c24154409824f96e9e99da357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:39.452914 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.network.security_group_api [None req-7a71aa25-0dfa-4720-bc95-268ce2ef38af tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Neutron security group does_not_exist not found {{(pid=140491) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Oct 08 21:09:39.453854 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-7a71aa25-0dfa-4720-bc95-268ce2ef38af tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Oct 08 21:09:39.464880 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-880d30bf-3d82-462b-af8f-088178c34d2a tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "GET /compute/v2.1/servers/3fed4df9-92ff-4040-8fa7-db370960dc06" status: 200 len: 1278 microversion: 2.1 time: 0.206157 Oct 08 21:09:39.480795 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-7a71aa25-0dfa-4720-bc95-268ce2ef38af tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Request method failure captured: Oct 08 21:09:39.480795 ncdv-master-1 devstack@n-api.service[140491]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 08 21:09:39.480795 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:09:39.480795 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:09:39.480795 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:09:39.480795 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 257 Oct 08 21:09:39.480795 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:09:39.480795 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:09:39.480795 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:09:39.480795 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:09:39.480795 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQebW09Z3m936-d3SrnQA9UQ3KXQvUYeQwL43ufWdoxmQhUwYBWv-JT053t_VYPo9wAVRoCqYQy8Hhh8zc2n570KpS0qNVLik822FjYabkSIZMA_ubWypXzSwo3J04zV1MoSSz79D-b8-ZvwYCEIbwpbfyn5opgOjnO6EXvq1UNPaSyQ Oct 08 21:09:39.480795 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:09:39.480795 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:09:39.480795 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:09:39.480795 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:09:39.480795 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:09:39.480795 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:09:39.480795 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 0ae02675057e4f27bc1980348afc8ca1 Oct 08 21:09:39.480795 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-ServersNegativeTestJSON-1441071354 Oct 08 21:09:39.480795 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:09:39.480795 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:09:39.480795 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0ae02675057e4f27bc1980348afc8ca1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0ae02675057e4f27bc1980348afc8ca1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0ae02675057e4f27bc1980348afc8ca1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0ae02675057e4f27bc1980348afc8ca1"}]}] Oct 08 21:09:39.480795 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-ServersNegativeTestJSON-1441071354 Oct 08 21:09:39.480795 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 0ae02675057e4f27bc1980348afc8ca1 Oct 08 21:09:39.480795 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1441071354 Oct 08 21:09:39.480795 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-ServersNegativeTestJSON-1441071354-project Oct 08 21:09:39.480795 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:09:39.480795 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:09:39.480795 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 6a78d352c143483c8e4702d789d4c516 Oct 08 21:09:39.480795 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-ServersNegativeTestJSON-1441071354-project Oct 08 21:09:39.480795 ncdv-master-1 devstack@n-api.service[140491]: Oct 08 21:09:39.480795 ncdv-master-1 devstack@n-api.service[140491]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-821666718", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "0af78ecb-f6e3-458a-ab57-630925a05ff0"}]}} Oct 08 21:09:39.480795 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:09:39.480795 ncdv-master-1 devstack@n-api.service[140491]: exception: Unable to find security_group with name or id 'does_not_exist' Oct 08 21:09:39.480795 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-821666718', 'imageRef': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': '0af78ecb-f6e3-458a-ab57-630925a05ff0'}]}}} Oct 08 21:09:39.480795 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:09:39.480795 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:09:39.480795 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Oct 08 21:09:39.480795 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Oct 08 21:09:39.480795 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 08 21:09:39.480795 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 08 21:09:39.480795 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Oct 08 21:09:39.480795 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Oct 08 21:09:39.480795 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Oct 08 21:09:39.480795 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:09:39.480795 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:09:39.480795 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:09:39.480795 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:09:39.480795 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Oct 08 21:09:39.480795 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Oct 08 21:09:39.480795 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 08 21:09:39.480795 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 08 21:09:39.480795 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Oct 08 21:09:39.480795 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Oct 08 21:09:39.480795 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Oct 08 21:09:39.480795 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:09:39.480795 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:09:39.480795 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:09:39.480795 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:09:39.480795 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Oct 08 21:09:39.480795 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Oct 08 21:09:39.484816 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Oct 08 21:09:39.484816 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Oct 08 21:09:39.484816 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Oct 08 21:09:39.484816 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Oct 08 21:09:39.484816 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 08 21:09:39.484816 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 08 21:09:39.484816 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Oct 08 21:09:39.484816 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Oct 08 21:09:39.484816 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Oct 08 21:09:39.484816 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:09:39.484816 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:09:39.484816 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:09:39.484816 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:09:39.484816 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 08 21:09:39.484816 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 08 21:09:39.484816 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 08 21:09:39.484816 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 08 21:09:39.484816 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 08 21:09:39.484816 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 08 21:09:39.484816 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1074, in _validate_and_build_base_options Oct 08 21:09:39.484816 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Oct 08 21:09:39.484816 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 521, in _check_requested_secgroups Oct 08 21:09:39.484816 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Oct 08 21:09:39.484816 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Oct 08 21:09:39.484816 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 08 21:09:39.484816 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Oct 08 21:09:39.484816 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:09:39.484816 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:09:39.484816 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:09:39.484816 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:09:39.484816 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:09:39.484816 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:09:39.484816 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:09:39.484816 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:09:39.484816 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:09:39.484816 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:09:39.484816 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 21:09:39.484816 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 21:09:39.484816 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 21:09:39.484816 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 21:09:39.484816 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 21:09:39.484816 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 21:09:39.484816 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 08 21:09:39.484816 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 08 21:09:39.484816 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 08 21:09:39.484816 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Oct 08 21:09:39.484816 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:09:39.484816 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:09:39.484816 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:09:39.484816 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:09:39.484816 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:09:39.484816 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:09:39.484816 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:09:39.484816 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:09:39.484816 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Oct 08 21:09:39.484816 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:09:39.489159 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2150/4202] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:39 2022] GET /compute/v2.1/servers/3fed4df9-92ff-4040-8fa7-db370960dc06 => generated 1278 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:09:39.490633 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-7a71aa25-0dfa-4720-bc95-268ce2ef38af tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:09:39.491788 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-7a71aa25-0dfa-4720-bc95-268ce2ef38af tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.340347 Oct 08 21:09:39.492878 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2053/4203] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 21:09:39 2022] POST /compute/v2.1/servers => generated 106 bytes in 342 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 08 21:09:39.493469 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-b2e2f6eb-16bc-46fc-a635-be0faaaf8dc4 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:39.494193 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-b2e2f6eb-16bc-46fc-a635-be0faaaf8dc4 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: ba5cd412-0d20-4d2e-9f5e-de18f268008a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:39.501040 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b2e2f6eb-16bc-46fc-a635-be0faaaf8dc4 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:39.501733 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b2e2f6eb-16bc-46fc-a635-be0faaaf8dc4 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:39.501881 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-59c5eae9-66b8-4fb9-9e79-2a268fb3d5c9 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:39.502356 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b2e2f6eb-16bc-46fc-a635-be0faaaf8dc4 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:39.502489 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-59c5eae9-66b8-4fb9-9e79-2a268fb3d5c9 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:39.503386 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b2e2f6eb-16bc-46fc-a635-be0faaaf8dc4 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:39.503948 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b2e2f6eb-16bc-46fc-a635-be0faaaf8dc4 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:39.504466 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b2e2f6eb-16bc-46fc-a635-be0faaaf8dc4 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:39.512004 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-59c5eae9-66b8-4fb9-9e79-2a268fb3d5c9 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:39.512513 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-59c5eae9-66b8-4fb9-9e79-2a268fb3d5c9 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:39.513693 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-59c5eae9-66b8-4fb9-9e79-2a268fb3d5c9 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:39.514430 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-59c5eae9-66b8-4fb9-9e79-2a268fb3d5c9 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:39.514892 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-59c5eae9-66b8-4fb9-9e79-2a268fb3d5c9 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:39.515488 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-59c5eae9-66b8-4fb9-9e79-2a268fb3d5c9 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:40.033896 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-59c5eae9-66b8-4fb9-9e79-2a268fb3d5c9 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:40.050241 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-59c5eae9-66b8-4fb9-9e79-2a268fb3d5c9 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 200 len: 1503 microversion: 2.1 time: 0.553094 Oct 08 21:09:40.052617 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2054/4204] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:39 2022] GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 1503 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:09:40.058702 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-3fa3739b-53ac-4657-add4-4aa90751aef2 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:40.059540 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-3fa3739b-53ac-4657-add4-4aa90751aef2 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] [instance: 159e29dd-802c-4059-99f9-bb7c113d430b] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:40.066608 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3fa3739b-53ac-4657-add4-4aa90751aef2 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:40.071601 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3fa3739b-53ac-4657-add4-4aa90751aef2 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:40.072407 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3fa3739b-53ac-4657-add4-4aa90751aef2 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:40.074237 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3fa3739b-53ac-4657-add4-4aa90751aef2 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:40.074894 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3fa3739b-53ac-4657-add4-4aa90751aef2 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:40.075871 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3fa3739b-53ac-4657-add4-4aa90751aef2 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:40.144385 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-b2e2f6eb-16bc-46fc-a635-be0faaaf8dc4 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78e9afd772c4de981cac8f5817ec356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765c62cac2ee4406b23a5baa85c52ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:40.159866 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-b2e2f6eb-16bc-46fc-a635-be0faaaf8dc4 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/ba5cd412-0d20-4d2e-9f5e-de18f268008a" status: 200 len: 1506 microversion: 2.1 time: 0.670607 Oct 08 21:09:40.160742 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2151/4205] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:39 2022] GET /compute/v2.1/servers/ba5cd412-0d20-4d2e-9f5e-de18f268008a => generated 1506 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:09:40.166552 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-0752ffc7-a191-4025-b968-257f4780ad24 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:40.168754 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-0752ffc7-a191-4025-b968-257f4780ad24 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:40.175726 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0752ffc7-a191-4025-b968-257f4780ad24 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:40.176457 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0752ffc7-a191-4025-b968-257f4780ad24 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:40.177051 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0752ffc7-a191-4025-b968-257f4780ad24 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:40.178675 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0752ffc7-a191-4025-b968-257f4780ad24 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:40.179393 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0752ffc7-a191-4025-b968-257f4780ad24 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:40.180055 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0752ffc7-a191-4025-b968-257f4780ad24 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:40.397771 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-3fa3739b-53ac-4657-add4-4aa90751aef2 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:40.461485 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-3fa3739b-53ac-4657-add4-4aa90751aef2 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:40.463064 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-3fa3739b-53ac-4657-add4-4aa90751aef2 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:40.469012 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-3fa3739b-53ac-4657-add4-4aa90751aef2 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] 10.222.0.26 "GET /compute/v2.1/servers/159e29dd-802c-4059-99f9-bb7c113d430b" status: 200 len: 1722 microversion: 2.20 time: 0.413962 Oct 08 21:09:40.469657 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2055/4206] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:09:40 2022] GET /compute/v2.1/servers/159e29dd-802c-4059-99f9-bb7c113d430b => generated 1722 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:09:40.476287 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-cd743999-28f5-4886-a6fb-16eab7c73a25 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:40.477125 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-cd743999-28f5-4886-a6fb-16eab7c73a25 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: 99510c36-821a-41dd-9ffe-8955dda22dcf] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:40.490323 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cd743999-28f5-4886-a6fb-16eab7c73a25 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:40.491370 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cd743999-28f5-4886-a6fb-16eab7c73a25 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:40.491992 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cd743999-28f5-4886-a6fb-16eab7c73a25 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:40.493480 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cd743999-28f5-4886-a6fb-16eab7c73a25 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:40.494187 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cd743999-28f5-4886-a6fb-16eab7c73a25 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:40.494757 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cd743999-28f5-4886-a6fb-16eab7c73a25 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:40.630988 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-0752ffc7-a191-4025-b968-257f4780ad24 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:40.653775 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-0752ffc7-a191-4025-b968-257f4780ad24 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 200 len: 1503 microversion: 2.1 time: 0.479727 Oct 08 21:09:40.654727 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2152/4207] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:40 2022] GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 1503 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:09:40.669077 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-c1c86a3c-f3a8-4f11-a539-ff59fab6bcc3 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:40.669764 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-c1c86a3c-f3a8-4f11-a539-ff59fab6bcc3 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] [instance: 3fed4df9-92ff-4040-8fa7-db370960dc06] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:40.681704 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c1c86a3c-f3a8-4f11-a539-ff59fab6bcc3 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:40.682233 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c1c86a3c-f3a8-4f11-a539-ff59fab6bcc3 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:40.682683 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c1c86a3c-f3a8-4f11-a539-ff59fab6bcc3 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:40.684575 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c1c86a3c-f3a8-4f11-a539-ff59fab6bcc3 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:40.685125 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c1c86a3c-f3a8-4f11-a539-ff59fab6bcc3 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:40.685630 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c1c86a3c-f3a8-4f11-a539-ff59fab6bcc3 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:40.785533 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-cd743999-28f5-4886-a6fb-16eab7c73a25 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06443b5728fb4d1e95d6245820e786bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ded993145b4eda9d6a33b994519012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:40.797549 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-cd743999-28f5-4886-a6fb-16eab7c73a25 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "GET /compute/v2.1/servers/99510c36-821a-41dd-9ffe-8955dda22dcf" status: 200 len: 1494 microversion: 2.1 time: 0.325357 Oct 08 21:09:40.801272 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2056/4208] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:40 2022] GET /compute/v2.1/servers/99510c36-821a-41dd-9ffe-8955dda22dcf => generated 1494 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:09:40.809618 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-e58e4fc9-14a1-49eb-8e98-547185d7786f tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:40.813951 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-e58e4fc9-14a1-49eb-8e98-547185d7786f tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: f4ad4c88-4b5d-486a-94a8-d61fe9f9617c] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:40.829308 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-e58e4fc9-14a1-49eb-8e98-547185d7786f tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] HTTP exception thrown: Instance f4ad4c88-4b5d-486a-94a8-d61fe9f9617c could not be found. Oct 08 21:09:40.832100 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-e58e4fc9-14a1-49eb-8e98-547185d7786f tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Request method failure captured: Oct 08 21:09:40.832100 ncdv-master-1 devstack@n-api.service[140491]: request: DELETE /compute/v2.1/servers/f4ad4c88-4b5d-486a-94a8-d61fe9f9617c HTTP/1.1 Oct 08 21:09:40.832100 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:09:40.832100 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:09:40.832100 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:09:40.832100 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 21:09:40.832100 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:09:40.832100 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:09:40.832100 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:09:40.832100 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:09:40.832100 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQebW09Z3m936-d3SrnQA9UQ3KXQvUYeQwL43ufWdoxmQhUwYBWv-JT053t_VYPo9wAVRoCqYQy8Hhh8zc2n570KpS0qNVLik822FjYabkSIZMA_ubWypXzSwo3J04zV1MoSSz79D-b8-ZvwYCEIbwpbfyn5opgOjnO6EXvq1UNPaSyQ Oct 08 21:09:40.832100 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:09:40.832100 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:09:40.832100 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:09:40.832100 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:09:40.832100 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:09:40.832100 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:09:40.832100 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 0ae02675057e4f27bc1980348afc8ca1 Oct 08 21:09:40.832100 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-ServersNegativeTestJSON-1441071354 Oct 08 21:09:40.832100 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:09:40.832100 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:09:40.832100 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0ae02675057e4f27bc1980348afc8ca1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0ae02675057e4f27bc1980348afc8ca1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0ae02675057e4f27bc1980348afc8ca1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0ae02675057e4f27bc1980348afc8ca1"}]}] Oct 08 21:09:40.832100 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-ServersNegativeTestJSON-1441071354 Oct 08 21:09:40.832100 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 0ae02675057e4f27bc1980348afc8ca1 Oct 08 21:09:40.832100 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1441071354 Oct 08 21:09:40.832100 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-ServersNegativeTestJSON-1441071354-project Oct 08 21:09:40.832100 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:09:40.832100 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:09:40.832100 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 6a78d352c143483c8e4702d789d4c516 Oct 08 21:09:40.832100 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-ServersNegativeTestJSON-1441071354-project Oct 08 21:09:40.832100 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:09:40.832100 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance f4ad4c88-4b5d-486a-94a8-d61fe9f9617c could not be found. Oct 08 21:09:40.832100 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': 'f4ad4c88-4b5d-486a-94a8-d61fe9f9617c'} Oct 08 21:09:40.832100 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:09:40.832100 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:09:40.832100 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:09:40.832100 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:09:40.832100 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:09:40.832100 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:09:40.832100 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 08 21:09:40.832100 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 08 21:09:40.832100 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4ad4c88-4b5d-486a-94a8-d61fe9f9617c could not be found. Oct 08 21:09:40.832100 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:09:40.832100 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:09:40.832100 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:09:40.832100 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:09:40.832100 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:09:40.832100 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:09:40.832100 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:09:40.832100 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:09:40.832100 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:09:40.832100 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:09:40.832100 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 08 21:09:40.832100 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 08 21:09:40.832100 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 08 21:09:40.832100 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 08 21:09:40.832100 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:09:40.832100 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:09:40.832100 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:09:40.832100 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:09:40.832100 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4ad4c88-4b5d-486a-94a8-d61fe9f9617c could not be found. Oct 08 21:09:40.832100 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:09:40.832100 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:09:40.837453 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:09:40.837453 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:09:40.837453 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:09:40.837453 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:09:40.837453 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:09:40.837453 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:09:40.837453 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4ad4c88-4b5d-486a-94a8-d61fe9f9617c could not be found. Oct 08 21:09:40.837453 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:09:40.840978 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-e58e4fc9-14a1-49eb-8e98-547185d7786f tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Returning 404 to user: Instance f4ad4c88-4b5d-486a-94a8-d61fe9f9617c could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:09:40.842636 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-e58e4fc9-14a1-49eb-8e98-547185d7786f tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "DELETE /compute/v2.1/servers/f4ad4c88-4b5d-486a-94a8-d61fe9f9617c" status: 404 len: 111 microversion: 2.1 time: 0.040012 Oct 08 21:09:40.846730 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2057/4209] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:09:40 2022] DELETE /compute/v2.1/servers/f4ad4c88-4b5d-486a-94a8-d61fe9f9617c => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:09:40.856835 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-61e04896-9c01-47bf-930d-9a65e934d682 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:40.857571 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-61e04896-9c01-47bf-930d-9a65e934d682 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:40.880633 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-61e04896-9c01-47bf-930d-9a65e934d682 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:40.881294 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-61e04896-9c01-47bf-930d-9a65e934d682 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:40.881940 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-61e04896-9c01-47bf-930d-9a65e934d682 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:40.882104 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-c1c86a3c-f3a8-4f11-a539-ff59fab6bcc3 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30fe0e1ffa1040ec85d3c32d8b741c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd0e7c24154409824f96e9e99da357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:40.883160 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-61e04896-9c01-47bf-930d-9a65e934d682 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:40.887119 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-61e04896-9c01-47bf-930d-9a65e934d682 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:40.887850 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-61e04896-9c01-47bf-930d-9a65e934d682 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:40.896305 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-c1c86a3c-f3a8-4f11-a539-ff59fab6bcc3 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "GET /compute/v2.1/servers/3fed4df9-92ff-4040-8fa7-db370960dc06" status: 200 len: 1266 microversion: 2.1 time: 0.240282 Oct 08 21:09:40.899750 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2153/4210] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:40 2022] GET /compute/v2.1/servers/3fed4df9-92ff-4040-8fa7-db370960dc06 => generated 1266 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:09:41.023363 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-0acf9c17-6767-4c0d-b3a2-985a38081518 req-e9ab6d88-c88c-4cd7-a21f-fe166091fb6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99510c36-821a-41dd-9ffe-8955dda22dcf", "name": "network-vif-deleted", "tag": "cf2a7b00-139a-477e-aef9-793efed07ce1"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:09:41.042670 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-0acf9c17-6767-4c0d-b3a2-985a38081518 req-e9ab6d88-c88c-4cd7-a21f-fe166091fb6a service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:41.043755 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-0acf9c17-6767-4c0d-b3a2-985a38081518 req-e9ab6d88-c88c-4cd7-a21f-fe166091fb6a service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:41.043755 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-0acf9c17-6767-4c0d-b3a2-985a38081518 req-e9ab6d88-c88c-4cd7-a21f-fe166091fb6a service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:41.085969 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-0acf9c17-6767-4c0d-b3a2-985a38081518 req-e9ab6d88-c88c-4cd7-a21f-fe166091fb6a service nova] Creating event network-vif-deleted:cf2a7b00-139a-477e-aef9-793efed07ce1 for instance 99510c36-821a-41dd-9ffe-8955dda22dcf on nch1-master-1 Oct 08 21:09:41.094063 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-0acf9c17-6767-4c0d-b3a2-985a38081518 req-e9ab6d88-c88c-4cd7-a21f-fe166091fb6a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076066 Oct 08 21:09:41.095430 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2154/4211] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:09:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 08 21:09:41.189112 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-5e2830be-7778-41b0-9607-29d4a757ece4 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:41.190330 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-5e2830be-7778-41b0-9607-29d4a757ece4 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: ba5cd412-0d20-4d2e-9f5e-de18f268008a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:41.217467 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5e2830be-7778-41b0-9607-29d4a757ece4 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:41.234046 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5e2830be-7778-41b0-9607-29d4a757ece4 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:41.235230 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5e2830be-7778-41b0-9607-29d4a757ece4 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:41.236176 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5e2830be-7778-41b0-9607-29d4a757ece4 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:41.238909 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5e2830be-7778-41b0-9607-29d4a757ece4 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:41.241796 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5e2830be-7778-41b0-9607-29d4a757ece4 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:41.305612 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-61e04896-9c01-47bf-930d-9a65e934d682 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:41.316928 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-61e04896-9c01-47bf-930d-9a65e934d682 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 200 len: 1503 microversion: 2.1 time: 0.465130 Oct 08 21:09:41.318175 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2058/4212] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:40 2022] GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 1503 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:09:41.341893 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-4073ed4d-869e-46d8-bafd-0b9a5bc0eca9 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:41.342776 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-4073ed4d-869e-46d8-bafd-0b9a5bc0eca9 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:41.350114 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4073ed4d-869e-46d8-bafd-0b9a5bc0eca9 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:41.350993 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4073ed4d-869e-46d8-bafd-0b9a5bc0eca9 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:41.351671 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4073ed4d-869e-46d8-bafd-0b9a5bc0eca9 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:41.353168 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4073ed4d-869e-46d8-bafd-0b9a5bc0eca9 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:41.353820 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4073ed4d-869e-46d8-bafd-0b9a5bc0eca9 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:41.354408 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4073ed4d-869e-46d8-bafd-0b9a5bc0eca9 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:41.563086 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-5e2830be-7778-41b0-9607-29d4a757ece4 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78e9afd772c4de981cac8f5817ec356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765c62cac2ee4406b23a5baa85c52ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:41.576750 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-5e2830be-7778-41b0-9607-29d4a757ece4 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/ba5cd412-0d20-4d2e-9f5e-de18f268008a" status: 200 len: 1506 microversion: 2.1 time: 0.393651 Oct 08 21:09:41.588021 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2155/4213] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:41 2022] GET /compute/v2.1/servers/ba5cd412-0d20-4d2e-9f5e-de18f268008a => generated 1506 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:09:41.592389 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-4073ed4d-869e-46d8-bafd-0b9a5bc0eca9 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:41.601745 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-09ebacab-e8c2-4b4a-b957-cd5713f2a359 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:41.603419 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-09ebacab-e8c2-4b4a-b957-cd5713f2a359 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] [instance: 159e29dd-802c-4059-99f9-bb7c113d430b] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:41.607817 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-4073ed4d-869e-46d8-bafd-0b9a5bc0eca9 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 200 len: 1503 microversion: 2.1 time: 0.270091 Oct 08 21:09:41.608685 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2059/4214] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:41 2022] GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 1503 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:09:41.611642 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-09ebacab-e8c2-4b4a-b957-cd5713f2a359 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:41.612231 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-09ebacab-e8c2-4b4a-b957-cd5713f2a359 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:41.612864 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-09ebacab-e8c2-4b4a-b957-cd5713f2a359 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:41.613632 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-09ebacab-e8c2-4b4a-b957-cd5713f2a359 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:41.614264 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-09ebacab-e8c2-4b4a-b957-cd5713f2a359 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:41.614723 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-09ebacab-e8c2-4b4a-b957-cd5713f2a359 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:41.637383 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-ffe7772c-24dd-4340-99b9-459f3f9e7cfe tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:41.637383 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-ffe7772c-24dd-4340-99b9-459f3f9e7cfe tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Failed to fetch instance by id 9223372036854775808 {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 08 21:09:41.640116 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-ffe7772c-24dd-4340-99b9-459f3f9e7cfe tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Oct 08 21:09:41.652733 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-ffe7772c-24dd-4340-99b9-459f3f9e7cfe tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Request method failure captured: Oct 08 21:09:41.652733 ncdv-master-1 devstack@n-api.service[140491]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Oct 08 21:09:41.652733 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:09:41.652733 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:09:41.652733 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:09:41.652733 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 21:09:41.652733 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:09:41.652733 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:09:41.652733 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:09:41.652733 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:09:41.652733 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQebW09Z3m936-d3SrnQA9UQ3KXQvUYeQwL43ufWdoxmQhUwYBWv-JT053t_VYPo9wAVRoCqYQy8Hhh8zc2n570KpS0qNVLik822FjYabkSIZMA_ubWypXzSwo3J04zV1MoSSz79D-b8-ZvwYCEIbwpbfyn5opgOjnO6EXvq1UNPaSyQ Oct 08 21:09:41.652733 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:09:41.652733 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:09:41.652733 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:09:41.652733 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:09:41.652733 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:09:41.652733 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:09:41.652733 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 0ae02675057e4f27bc1980348afc8ca1 Oct 08 21:09:41.652733 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-ServersNegativeTestJSON-1441071354 Oct 08 21:09:41.652733 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:09:41.652733 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:09:41.652733 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0ae02675057e4f27bc1980348afc8ca1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0ae02675057e4f27bc1980348afc8ca1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0ae02675057e4f27bc1980348afc8ca1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0ae02675057e4f27bc1980348afc8ca1"}]}] Oct 08 21:09:41.652733 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-ServersNegativeTestJSON-1441071354 Oct 08 21:09:41.652733 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 0ae02675057e4f27bc1980348afc8ca1 Oct 08 21:09:41.652733 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1441071354 Oct 08 21:09:41.652733 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-ServersNegativeTestJSON-1441071354-project Oct 08 21:09:41.652733 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:09:41.652733 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:09:41.652733 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 6a78d352c143483c8e4702d789d4c516 Oct 08 21:09:41.652733 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-ServersNegativeTestJSON-1441071354-project Oct 08 21:09:41.652733 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:09:41.652733 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance 9223372036854775808 could not be found. Oct 08 21:09:41.652733 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': '9223372036854775808'} Oct 08 21:09:41.652733 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:09:41.652733 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:09:41.652733 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:09:41.652733 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:09:41.652733 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 08 21:09:41.652733 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 08 21:09:41.652733 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Oct 08 21:09:41.652733 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:09:41.652733 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:09:41.652733 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:09:41.652733 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:09:41.652733 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:09:41.652733 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:09:41.652733 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:09:41.652733 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:09:41.652733 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:09:41.652733 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:09:41.652733 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 08 21:09:41.652733 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 08 21:09:41.652733 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 08 21:09:41.652733 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 08 21:09:41.652733 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:09:41.652733 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:09:41.652733 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:09:41.652733 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:09:41.652733 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Oct 08 21:09:41.652733 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:09:41.652733 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:09:41.652733 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:09:41.652733 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:09:41.652733 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:09:41.656796 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:09:41.656796 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:09:41.656796 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:09:41.656796 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Oct 08 21:09:41.656796 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:09:41.659169 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-ffe7772c-24dd-4340-99b9-459f3f9e7cfe tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:09:41.660262 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-ffe7772c-24dd-4340-99b9-459f3f9e7cfe tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.030960 Oct 08 21:09:41.660851 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2060/4215] 10.222.0.26 () {58 vars in 1188 bytes} [Sat Oct 8 21:09:41 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 08 21:09:41.683748 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-003dd0b2-1a9c-40ca-aa1e-8d939f3b2e9d tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:41.684662 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-003dd0b2-1a9c-40ca-aa1e-8d939f3b2e9d tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:41.694026 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-003dd0b2-1a9c-40ca-aa1e-8d939f3b2e9d tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:41.695040 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-003dd0b2-1a9c-40ca-aa1e-8d939f3b2e9d tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:41.695609 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-003dd0b2-1a9c-40ca-aa1e-8d939f3b2e9d tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:41.699760 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-003dd0b2-1a9c-40ca-aa1e-8d939f3b2e9d tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:41.700475 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-003dd0b2-1a9c-40ca-aa1e-8d939f3b2e9d tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:41.701033 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-003dd0b2-1a9c-40ca-aa1e-8d939f3b2e9d tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:41.950537 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-09ebacab-e8c2-4b4a-b957-cd5713f2a359 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:41.965691 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-09ebacab-e8c2-4b4a-b957-cd5713f2a359 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:41.968362 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-09ebacab-e8c2-4b4a-b957-cd5713f2a359 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:41.970638 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-09ebacab-e8c2-4b4a-b957-cd5713f2a359 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] 10.222.0.26 "GET /compute/v2.1/servers/159e29dd-802c-4059-99f9-bb7c113d430b" status: 200 len: 1743 microversion: 2.20 time: 0.379827 Oct 08 21:09:41.984304 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2156/4216] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:09:41 2022] GET /compute/v2.1/servers/159e29dd-802c-4059-99f9-bb7c113d430b => generated 1743 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:09:41.990834 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-105d3e9f-e68e-48e7-a654-311f6217bed7 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:41.991785 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-105d3e9f-e68e-48e7-a654-311f6217bed7 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: 99510c36-821a-41dd-9ffe-8955dda22dcf] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:41.997886 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-003dd0b2-1a9c-40ca-aa1e-8d939f3b2e9d tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:42.002325 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-105d3e9f-e68e-48e7-a654-311f6217bed7 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:42.003492 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-105d3e9f-e68e-48e7-a654-311f6217bed7 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:42.004865 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-105d3e9f-e68e-48e7-a654-311f6217bed7 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:42.006299 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-105d3e9f-e68e-48e7-a654-311f6217bed7 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:42.007021 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-105d3e9f-e68e-48e7-a654-311f6217bed7 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:42.007738 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-105d3e9f-e68e-48e7-a654-311f6217bed7 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:42.009732 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-003dd0b2-1a9c-40ca-aa1e-8d939f3b2e9d tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 200 len: 1503 microversion: 2.1 time: 0.342900 Oct 08 21:09:42.010537 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2061/4217] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:41 2022] GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 1503 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:09:42.027917 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-abcbc988-69ad-4946-860b-11edb7d4ec5d tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:42.028885 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-abcbc988-69ad-4946-860b-11edb7d4ec5d tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] [instance: 3fed4df9-92ff-4040-8fa7-db370960dc06] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:42.031405 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-105d3e9f-e68e-48e7-a654-311f6217bed7 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] HTTP exception thrown: Instance 99510c36-821a-41dd-9ffe-8955dda22dcf could not be found. Oct 08 21:09:42.033447 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-105d3e9f-e68e-48e7-a654-311f6217bed7 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Request method failure captured: Oct 08 21:09:42.033447 ncdv-master-1 devstack@n-api.service[140492]: request: GET /compute/v2.1/servers/99510c36-821a-41dd-9ffe-8955dda22dcf HTTP/1.1 Oct 08 21:09:42.033447 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:09:42.033447 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:09:42.033447 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:09:42.033447 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 21:09:42.033447 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:09:42.033447 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:09:42.033447 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:09:42.033447 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:09:42.033447 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeYsdf-NgsPUaUb78CUpk0vq18mlUqdb1er-CKgSGnwcxKYVDw5Br5ObGheB0PHKIrwGHgJ4op59IUcxCd3ChQqclxeYxKhK3ZwkXmw1AwIGXWjgktrsk6DH6ba1NMLmZ1pzBqcyvzB3CMIuC4HBXIHDILjU44EobGpdQQ8lNmKdDFM Oct 08 21:09:42.033447 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:09:42.033447 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:09:42.033447 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:09:42.033447 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:09:42.033447 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:09:42.033447 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:09:42.033447 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: e7ded993145b4eda9d6a33b994519012 Oct 08 21:09:42.033447 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-ServersTestJSON-68907085 Oct 08 21:09:42.033447 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:09:42.033447 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:09:42.033447 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/e7ded993145b4eda9d6a33b994519012"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e7ded993145b4eda9d6a33b994519012"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_e7ded993145b4eda9d6a33b994519012"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e7ded993145b4eda9d6a33b994519012"}]}] Oct 08 21:09:42.033447 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-ServersTestJSON-68907085 Oct 08 21:09:42.033447 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: e7ded993145b4eda9d6a33b994519012 Oct 08 21:09:42.033447 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-ServersTestJSON-68907085 Oct 08 21:09:42.033447 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-ServersTestJSON-68907085-project Oct 08 21:09:42.033447 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:09:42.033447 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:09:42.033447 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 06443b5728fb4d1e95d6245820e786bf Oct 08 21:09:42.033447 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-ServersTestJSON-68907085-project Oct 08 21:09:42.033447 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 21:09:42.033447 ncdv-master-1 devstack@n-api.service[140492]: exception: Instance 99510c36-821a-41dd-9ffe-8955dda22dcf could not be found. Oct 08 21:09:42.033447 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': '99510c36-821a-41dd-9ffe-8955dda22dcf'} Oct 08 21:09:42.033447 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:09:42.033447 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:09:42.033447 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:09:42.033447 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:09:42.033447 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:09:42.033447 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:09:42.033447 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:09:42.033447 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:09:42.033447 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:09:42.033447 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:09:42.033447 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99510c36-821a-41dd-9ffe-8955dda22dcf could not be found. Oct 08 21:09:42.033447 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:09:42.033447 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:09:42.033447 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:09:42.033447 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:09:42.033447 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:09:42.033447 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:09:42.033447 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:09:42.033447 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:09:42.033447 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:09:42.033447 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:09:42.033447 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:09:42.033447 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:09:42.033447 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:09:42.033447 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:09:42.033447 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:09:42.033447 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:09:42.033447 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99510c36-821a-41dd-9ffe-8955dda22dcf could not be found. Oct 08 21:09:42.033447 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:09:42.033447 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:09:42.033447 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:09:42.033447 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:09:42.037901 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:09:42.037901 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:09:42.037901 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:09:42.037901 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:09:42.037901 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99510c36-821a-41dd-9ffe-8955dda22dcf could not be found. Oct 08 21:09:42.037901 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:09:42.037901 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-105d3e9f-e68e-48e7-a654-311f6217bed7 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Returning 404 to user: Instance 99510c36-821a-41dd-9ffe-8955dda22dcf could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:09:42.038978 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-105d3e9f-e68e-48e7-a654-311f6217bed7 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "GET /compute/v2.1/servers/99510c36-821a-41dd-9ffe-8955dda22dcf" status: 404 len: 111 microversion: 2.1 time: 0.052082 Oct 08 21:09:42.039135 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-abcbc988-69ad-4946-860b-11edb7d4ec5d tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:42.041381 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2157/4218] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:41 2022] GET /compute/v2.1/servers/99510c36-821a-41dd-9ffe-8955dda22dcf => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:09:42.044473 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-abcbc988-69ad-4946-860b-11edb7d4ec5d tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:42.045281 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-abcbc988-69ad-4946-860b-11edb7d4ec5d tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:42.046348 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-abcbc988-69ad-4946-860b-11edb7d4ec5d tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:42.047712 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-abcbc988-69ad-4946-860b-11edb7d4ec5d tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:42.048483 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-abcbc988-69ad-4946-860b-11edb7d4ec5d tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:42.056000 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-5f527beb-ecd3-4948-aa4e-bdae1722088f tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:42.057214 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-5f527beb-ecd3-4948-aa4e-bdae1722088f tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:42.066055 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5f527beb-ecd3-4948-aa4e-bdae1722088f tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:42.066881 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5f527beb-ecd3-4948-aa4e-bdae1722088f tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:42.067694 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5f527beb-ecd3-4948-aa4e-bdae1722088f tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:42.068633 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5f527beb-ecd3-4948-aa4e-bdae1722088f tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:42.069426 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5f527beb-ecd3-4948-aa4e-bdae1722088f tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:42.070911 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5f527beb-ecd3-4948-aa4e-bdae1722088f tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:42.297144 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-abcbc988-69ad-4946-860b-11edb7d4ec5d tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30fe0e1ffa1040ec85d3c32d8b741c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd0e7c24154409824f96e9e99da357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:42.307418 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-abcbc988-69ad-4946-860b-11edb7d4ec5d tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "GET /compute/v2.1/servers/3fed4df9-92ff-4040-8fa7-db370960dc06" status: 200 len: 1308 microversion: 2.1 time: 0.295514 Oct 08 21:09:42.308026 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2062/4219] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:42 2022] GET /compute/v2.1/servers/3fed4df9-92ff-4040-8fa7-db370960dc06 => generated 1308 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:09:42.312613 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-95656655-4557-4d13-9795-def1dcad8936 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:42.313095 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-95656655-4557-4d13-9795-def1dcad8936 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: 99510c36-821a-41dd-9ffe-8955dda22dcf] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:42.333086 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-95656655-4557-4d13-9795-def1dcad8936 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:42.334016 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-95656655-4557-4d13-9795-def1dcad8936 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:42.334552 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-95656655-4557-4d13-9795-def1dcad8936 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:42.335316 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-95656655-4557-4d13-9795-def1dcad8936 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:42.337366 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-95656655-4557-4d13-9795-def1dcad8936 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:42.338003 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-95656655-4557-4d13-9795-def1dcad8936 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:42.342913 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:09:42.345017 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-5f527beb-ecd3-4948-aa4e-bdae1722088f tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:42.357049 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-95656655-4557-4d13-9795-def1dcad8936 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] HTTP exception thrown: Instance 99510c36-821a-41dd-9ffe-8955dda22dcf could not be found. Oct 08 21:09:42.359755 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-95656655-4557-4d13-9795-def1dcad8936 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Request method failure captured: Oct 08 21:09:42.359755 ncdv-master-1 devstack@n-api.service[140491]: request: DELETE /compute/v2.1/servers/99510c36-821a-41dd-9ffe-8955dda22dcf HTTP/1.1 Oct 08 21:09:42.359755 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:09:42.359755 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:09:42.359755 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:09:42.359755 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 21:09:42.359755 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:09:42.359755 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:09:42.359755 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:09:42.359755 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:09:42.359755 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeYsdf-NgsPUaUb78CUpk0vq18mlUqdb1er-CKgSGnwcxKYVDw5Br5ObGheB0PHKIrwGHgJ4op59IUcxCd3ChQqclxeYxKhK3ZwkXmw1AwIGXWjgktrsk6DH6ba1NMLmZ1pzBqcyvzB3CMIuC4HBXIHDILjU44EobGpdQQ8lNmKdDFM Oct 08 21:09:42.359755 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:09:42.359755 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:09:42.359755 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:09:42.359755 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:09:42.359755 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:09:42.359755 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:09:42.359755 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: e7ded993145b4eda9d6a33b994519012 Oct 08 21:09:42.359755 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-ServersTestJSON-68907085 Oct 08 21:09:42.359755 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:09:42.359755 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:09:42.359755 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/e7ded993145b4eda9d6a33b994519012"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e7ded993145b4eda9d6a33b994519012"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_e7ded993145b4eda9d6a33b994519012"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e7ded993145b4eda9d6a33b994519012"}]}] Oct 08 21:09:42.359755 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-ServersTestJSON-68907085 Oct 08 21:09:42.359755 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: e7ded993145b4eda9d6a33b994519012 Oct 08 21:09:42.359755 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-ServersTestJSON-68907085 Oct 08 21:09:42.359755 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-ServersTestJSON-68907085-project Oct 08 21:09:42.359755 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:09:42.359755 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:09:42.359755 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 06443b5728fb4d1e95d6245820e786bf Oct 08 21:09:42.359755 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-ServersTestJSON-68907085-project Oct 08 21:09:42.359755 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:09:42.359755 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance 99510c36-821a-41dd-9ffe-8955dda22dcf could not be found. Oct 08 21:09:42.359755 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': '99510c36-821a-41dd-9ffe-8955dda22dcf'} Oct 08 21:09:42.359755 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:09:42.359755 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:09:42.359755 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:09:42.359755 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:09:42.359755 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:09:42.359755 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:09:42.359755 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:09:42.359755 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:09:42.359755 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:09:42.359755 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:09:42.359755 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99510c36-821a-41dd-9ffe-8955dda22dcf could not be found. Oct 08 21:09:42.359755 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:09:42.359755 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:09:42.359755 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:09:42.359755 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:09:42.359755 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:09:42.359755 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:09:42.359755 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:09:42.359755 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:09:42.359755 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:09:42.359755 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:09:42.359755 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 08 21:09:42.359755 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 08 21:09:42.359755 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 08 21:09:42.359755 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 08 21:09:42.359755 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:09:42.359755 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:09:42.359755 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:09:42.359755 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:09:42.359755 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99510c36-821a-41dd-9ffe-8955dda22dcf could not be found. Oct 08 21:09:42.363924 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:09:42.363924 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:09:42.363924 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:09:42.363924 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:09:42.363924 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:09:42.363924 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:09:42.363924 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:09:42.363924 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:09:42.363924 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99510c36-821a-41dd-9ffe-8955dda22dcf could not be found. Oct 08 21:09:42.363924 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:09:42.364634 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-5f527beb-ecd3-4948-aa4e-bdae1722088f tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 200 len: 1503 microversion: 2.1 time: 0.317575 Oct 08 21:09:42.364634 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2158/4220] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:42 2022] GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 1503 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:09:42.365916 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-95656655-4557-4d13-9795-def1dcad8936 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Returning 404 to user: Instance 99510c36-821a-41dd-9ffe-8955dda22dcf could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:09:42.367438 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-95656655-4557-4d13-9795-def1dcad8936 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "DELETE /compute/v2.1/servers/99510c36-821a-41dd-9ffe-8955dda22dcf" status: 404 len: 111 microversion: 2.1 time: 0.058478 Oct 08 21:09:42.368983 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2063/4221] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:09:42 2022] DELETE /compute/v2.1/servers/99510c36-821a-41dd-9ffe-8955dda22dcf => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:09:42.378925 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-bcc4a0df-4a6e-433b-8224-50ed3eb05717 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:42.379834 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-bcc4a0df-4a6e-433b-8224-50ed3eb05717 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: 99510c36-821a-41dd-9ffe-8955dda22dcf] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:42.387474 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-bdbe3c00-bdca-4640-8be8-7b78b9d6d0d1 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:42.387990 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-bdbe3c00-bdca-4640-8be8-7b78b9d6d0d1 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Failed to fetch instance by id -1 {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 08 21:09:42.388645 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bcc4a0df-4a6e-433b-8224-50ed3eb05717 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:42.389386 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bcc4a0df-4a6e-433b-8224-50ed3eb05717 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:42.390034 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bcc4a0df-4a6e-433b-8224-50ed3eb05717 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:42.390587 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-bdbe3c00-bdca-4640-8be8-7b78b9d6d0d1 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] HTTP exception thrown: Instance -1 could not be found. Oct 08 21:09:42.391092 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bcc4a0df-4a6e-433b-8224-50ed3eb05717 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:42.391902 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bcc4a0df-4a6e-433b-8224-50ed3eb05717 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:42.392743 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bcc4a0df-4a6e-433b-8224-50ed3eb05717 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:42.393080 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-bdbe3c00-bdca-4640-8be8-7b78b9d6d0d1 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Request method failure captured: Oct 08 21:09:42.393080 ncdv-master-1 devstack@n-api.service[140491]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Oct 08 21:09:42.393080 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:09:42.393080 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:09:42.393080 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:09:42.393080 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 21:09:42.393080 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:09:42.393080 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:09:42.393080 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:09:42.393080 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:09:42.393080 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQebW09Z3m936-d3SrnQA9UQ3KXQvUYeQwL43ufWdoxmQhUwYBWv-JT053t_VYPo9wAVRoCqYQy8Hhh8zc2n570KpS0qNVLik822FjYabkSIZMA_ubWypXzSwo3J04zV1MoSSz79D-b8-ZvwYCEIbwpbfyn5opgOjnO6EXvq1UNPaSyQ Oct 08 21:09:42.393080 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:09:42.393080 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:09:42.393080 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:09:42.393080 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:09:42.393080 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:09:42.393080 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:09:42.393080 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 0ae02675057e4f27bc1980348afc8ca1 Oct 08 21:09:42.393080 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-ServersNegativeTestJSON-1441071354 Oct 08 21:09:42.393080 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:09:42.393080 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:09:42.393080 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0ae02675057e4f27bc1980348afc8ca1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0ae02675057e4f27bc1980348afc8ca1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0ae02675057e4f27bc1980348afc8ca1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0ae02675057e4f27bc1980348afc8ca1"}]}] Oct 08 21:09:42.393080 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-ServersNegativeTestJSON-1441071354 Oct 08 21:09:42.393080 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 0ae02675057e4f27bc1980348afc8ca1 Oct 08 21:09:42.393080 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1441071354 Oct 08 21:09:42.393080 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-ServersNegativeTestJSON-1441071354-project Oct 08 21:09:42.393080 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:09:42.393080 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:09:42.393080 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 6a78d352c143483c8e4702d789d4c516 Oct 08 21:09:42.393080 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-ServersNegativeTestJSON-1441071354-project Oct 08 21:09:42.393080 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:09:42.393080 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance -1 could not be found. Oct 08 21:09:42.393080 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': '-1'} Oct 08 21:09:42.393080 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:09:42.393080 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:09:42.393080 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:09:42.393080 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:09:42.393080 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 08 21:09:42.393080 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 08 21:09:42.393080 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Oct 08 21:09:42.393080 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:09:42.393080 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:09:42.393080 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:09:42.393080 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:09:42.393080 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:09:42.393080 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:09:42.393080 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:09:42.393080 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:09:42.393080 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:09:42.393080 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:09:42.393080 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 08 21:09:42.393080 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 08 21:09:42.393080 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 08 21:09:42.393080 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 08 21:09:42.393080 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:09:42.393080 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:09:42.393080 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:09:42.393080 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:09:42.393080 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Oct 08 21:09:42.393080 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:09:42.393080 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:09:42.393080 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:09:42.393080 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:09:42.393080 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:09:42.393080 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:09:42.397505 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:09:42.397505 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:09:42.397505 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Oct 08 21:09:42.397505 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:09:42.398321 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-bdbe3c00-bdca-4640-8be8-7b78b9d6d0d1 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Returning 404 to user: Instance -1 could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:09:42.400224 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-bdbe3c00-bdca-4640-8be8-7b78b9d6d0d1 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.019930 Oct 08 21:09:42.405014 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2064/4222] 10.222.0.26 () {58 vars in 1137 bytes} [Sat Oct 8 21:09:42 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 08 21:09:42.410795 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-0085ebf7-978d-43fe-8cb6-5f1b22992c69 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:42.411548 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-0085ebf7-978d-43fe-8cb6-5f1b22992c69 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:42.418745 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-bcc4a0df-4a6e-433b-8224-50ed3eb05717 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] HTTP exception thrown: Instance 99510c36-821a-41dd-9ffe-8955dda22dcf could not be found. Oct 08 21:09:42.420905 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-bcc4a0df-4a6e-433b-8224-50ed3eb05717 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Request method failure captured: Oct 08 21:09:42.420905 ncdv-master-1 devstack@n-api.service[140492]: request: GET /compute/v2.1/servers/99510c36-821a-41dd-9ffe-8955dda22dcf HTTP/1.1 Oct 08 21:09:42.420905 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:09:42.420905 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:09:42.420905 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:09:42.420905 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 21:09:42.420905 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:09:42.420905 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:09:42.420905 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:09:42.420905 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:09:42.420905 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeYsdf-NgsPUaUb78CUpk0vq18mlUqdb1er-CKgSGnwcxKYVDw5Br5ObGheB0PHKIrwGHgJ4op59IUcxCd3ChQqclxeYxKhK3ZwkXmw1AwIGXWjgktrsk6DH6ba1NMLmZ1pzBqcyvzB3CMIuC4HBXIHDILjU44EobGpdQQ8lNmKdDFM Oct 08 21:09:42.420905 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:09:42.420905 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:09:42.420905 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:09:42.420905 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:09:42.420905 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:09:42.420905 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:09:42.420905 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: e7ded993145b4eda9d6a33b994519012 Oct 08 21:09:42.420905 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-ServersTestJSON-68907085 Oct 08 21:09:42.420905 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:09:42.420905 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:09:42.420905 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/e7ded993145b4eda9d6a33b994519012"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e7ded993145b4eda9d6a33b994519012"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_e7ded993145b4eda9d6a33b994519012"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e7ded993145b4eda9d6a33b994519012"}]}] Oct 08 21:09:42.420905 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-ServersTestJSON-68907085 Oct 08 21:09:42.420905 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: e7ded993145b4eda9d6a33b994519012 Oct 08 21:09:42.420905 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-ServersTestJSON-68907085 Oct 08 21:09:42.420905 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-ServersTestJSON-68907085-project Oct 08 21:09:42.420905 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:09:42.420905 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:09:42.420905 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 06443b5728fb4d1e95d6245820e786bf Oct 08 21:09:42.420905 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-ServersTestJSON-68907085-project Oct 08 21:09:42.420905 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 21:09:42.420905 ncdv-master-1 devstack@n-api.service[140492]: exception: Instance 99510c36-821a-41dd-9ffe-8955dda22dcf could not be found. Oct 08 21:09:42.420905 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': '99510c36-821a-41dd-9ffe-8955dda22dcf'} Oct 08 21:09:42.420905 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:09:42.420905 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:09:42.420905 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:09:42.420905 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:09:42.420905 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:09:42.420905 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:09:42.420905 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:09:42.420905 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:09:42.420905 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:09:42.420905 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:09:42.420905 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99510c36-821a-41dd-9ffe-8955dda22dcf could not be found. Oct 08 21:09:42.420905 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:09:42.420905 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:09:42.420905 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:09:42.420905 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:09:42.420905 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:09:42.420905 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:09:42.420905 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:09:42.420905 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:09:42.420905 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:09:42.420905 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:09:42.420905 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:09:42.420905 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:09:42.420905 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:09:42.420905 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:09:42.420905 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:09:42.420905 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:09:42.420905 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99510c36-821a-41dd-9ffe-8955dda22dcf could not be found. Oct 08 21:09:42.420905 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:09:42.420905 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:09:42.420905 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:09:42.420905 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:09:42.425206 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:09:42.425206 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:09:42.425206 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:09:42.425206 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:09:42.425206 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99510c36-821a-41dd-9ffe-8955dda22dcf could not be found. Oct 08 21:09:42.425206 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:09:42.426651 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-bcc4a0df-4a6e-433b-8224-50ed3eb05717 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Returning 404 to user: Instance 99510c36-821a-41dd-9ffe-8955dda22dcf could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:09:42.427529 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0085ebf7-978d-43fe-8cb6-5f1b22992c69 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:42.428296 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-bcc4a0df-4a6e-433b-8224-50ed3eb05717 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "GET /compute/v2.1/servers/99510c36-821a-41dd-9ffe-8955dda22dcf" status: 404 len: 111 microversion: 2.1 time: 0.055284 Oct 08 21:09:42.428404 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0085ebf7-978d-43fe-8cb6-5f1b22992c69 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:42.428906 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0085ebf7-978d-43fe-8cb6-5f1b22992c69 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:42.430004 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2159/4223] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:42 2022] GET /compute/v2.1/servers/99510c36-821a-41dd-9ffe-8955dda22dcf => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:09:42.430135 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0085ebf7-978d-43fe-8cb6-5f1b22992c69 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:42.430723 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0085ebf7-978d-43fe-8cb6-5f1b22992c69 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:42.431173 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0085ebf7-978d-43fe-8cb6-5f1b22992c69 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:42.439797 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-b679cd7a-aba9-4e01-9427-da31f49a6bdf tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:42.440539 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-b679cd7a-aba9-4e01-9427-da31f49a6bdf tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: 4e630da9-7820-47ef-ac72-1c91af94ff64] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:42.448532 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b679cd7a-aba9-4e01-9427-da31f49a6bdf tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:42.449634 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b679cd7a-aba9-4e01-9427-da31f49a6bdf tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:42.450387 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b679cd7a-aba9-4e01-9427-da31f49a6bdf tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:42.451837 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b679cd7a-aba9-4e01-9427-da31f49a6bdf tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:42.452460 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b679cd7a-aba9-4e01-9427-da31f49a6bdf tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:42.453046 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b679cd7a-aba9-4e01-9427-da31f49a6bdf tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:42.498251 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-b679cd7a-aba9-4e01-9427-da31f49a6bdf tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] HTTP exception thrown: Instance 4e630da9-7820-47ef-ac72-1c91af94ff64 could not be found. Oct 08 21:09:42.500376 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-b679cd7a-aba9-4e01-9427-da31f49a6bdf tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Request method failure captured: Oct 08 21:09:42.500376 ncdv-master-1 devstack@n-api.service[140492]: request: DELETE /compute/v2.1/servers/4e630da9-7820-47ef-ac72-1c91af94ff64 HTTP/1.1 Oct 08 21:09:42.500376 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:09:42.500376 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:09:42.500376 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:09:42.500376 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 21:09:42.500376 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:09:42.500376 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:09:42.500376 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:09:42.500376 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:09:42.500376 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeYsdf-NgsPUaUb78CUpk0vq18mlUqdb1er-CKgSGnwcxKYVDw5Br5ObGheB0PHKIrwGHgJ4op59IUcxCd3ChQqclxeYxKhK3ZwkXmw1AwIGXWjgktrsk6DH6ba1NMLmZ1pzBqcyvzB3CMIuC4HBXIHDILjU44EobGpdQQ8lNmKdDFM Oct 08 21:09:42.500376 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:09:42.500376 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:09:42.500376 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:09:42.500376 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:09:42.500376 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:09:42.500376 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:09:42.500376 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: e7ded993145b4eda9d6a33b994519012 Oct 08 21:09:42.500376 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-ServersTestJSON-68907085 Oct 08 21:09:42.500376 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:09:42.500376 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:09:42.500376 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/e7ded993145b4eda9d6a33b994519012"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e7ded993145b4eda9d6a33b994519012"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_e7ded993145b4eda9d6a33b994519012"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e7ded993145b4eda9d6a33b994519012"}]}] Oct 08 21:09:42.500376 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-ServersTestJSON-68907085 Oct 08 21:09:42.500376 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: e7ded993145b4eda9d6a33b994519012 Oct 08 21:09:42.500376 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-ServersTestJSON-68907085 Oct 08 21:09:42.500376 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-ServersTestJSON-68907085-project Oct 08 21:09:42.500376 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:09:42.500376 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:09:42.500376 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 06443b5728fb4d1e95d6245820e786bf Oct 08 21:09:42.500376 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-ServersTestJSON-68907085-project Oct 08 21:09:42.500376 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 21:09:42.500376 ncdv-master-1 devstack@n-api.service[140492]: exception: Instance 4e630da9-7820-47ef-ac72-1c91af94ff64 could not be found. Oct 08 21:09:42.500376 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': '4e630da9-7820-47ef-ac72-1c91af94ff64'} Oct 08 21:09:42.500376 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:09:42.500376 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:09:42.500376 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:09:42.500376 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:09:42.500376 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:09:42.500376 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:09:42.500376 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:09:42.500376 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:09:42.500376 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:09:42.500376 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:09:42.500376 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e630da9-7820-47ef-ac72-1c91af94ff64 could not be found. Oct 08 21:09:42.500376 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:09:42.500376 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:09:42.500376 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:09:42.500376 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:09:42.500376 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:09:42.500376 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:09:42.500376 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:09:42.500376 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:09:42.500376 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:09:42.500376 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:09:42.500376 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 08 21:09:42.500376 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 08 21:09:42.500376 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 08 21:09:42.500376 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 08 21:09:42.500376 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:09:42.500376 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:09:42.500376 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:09:42.500376 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:09:42.500376 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e630da9-7820-47ef-ac72-1c91af94ff64 could not be found. Oct 08 21:09:42.504404 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:09:42.504404 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:09:42.504404 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:09:42.504404 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:09:42.504404 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:09:42.504404 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:09:42.504404 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:09:42.504404 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:09:42.504404 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e630da9-7820-47ef-ac72-1c91af94ff64 could not be found. Oct 08 21:09:42.504404 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:09:42.505920 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-b679cd7a-aba9-4e01-9427-da31f49a6bdf tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Returning 404 to user: Instance 4e630da9-7820-47ef-ac72-1c91af94ff64 could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:09:42.507001 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-b679cd7a-aba9-4e01-9427-da31f49a6bdf tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "DELETE /compute/v2.1/servers/4e630da9-7820-47ef-ac72-1c91af94ff64" status: 404 len: 111 microversion: 2.1 time: 0.072983 Oct 08 21:09:42.507584 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2160/4224] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:09:42 2022] DELETE /compute/v2.1/servers/4e630da9-7820-47ef-ac72-1c91af94ff64 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:09:42.516932 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-773cbff9-9336-4bc7-ab16-87fb35373511 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:42.517805 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-773cbff9-9336-4bc7-ab16-87fb35373511 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: 4e630da9-7820-47ef-ac72-1c91af94ff64] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:42.525470 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-773cbff9-9336-4bc7-ab16-87fb35373511 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:42.526099 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-773cbff9-9336-4bc7-ab16-87fb35373511 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:42.526656 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-773cbff9-9336-4bc7-ab16-87fb35373511 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:42.527489 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-773cbff9-9336-4bc7-ab16-87fb35373511 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:42.528053 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-773cbff9-9336-4bc7-ab16-87fb35373511 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:42.528717 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-773cbff9-9336-4bc7-ab16-87fb35373511 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:42.545566 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-773cbff9-9336-4bc7-ab16-87fb35373511 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] HTTP exception thrown: Instance 4e630da9-7820-47ef-ac72-1c91af94ff64 could not be found. Oct 08 21:09:42.547329 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-773cbff9-9336-4bc7-ab16-87fb35373511 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Request method failure captured: Oct 08 21:09:42.547329 ncdv-master-1 devstack@n-api.service[140492]: request: GET /compute/v2.1/servers/4e630da9-7820-47ef-ac72-1c91af94ff64 HTTP/1.1 Oct 08 21:09:42.547329 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:09:42.547329 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:09:42.547329 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:09:42.547329 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 21:09:42.547329 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:09:42.547329 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:09:42.547329 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:09:42.547329 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:09:42.547329 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeYsdf-NgsPUaUb78CUpk0vq18mlUqdb1er-CKgSGnwcxKYVDw5Br5ObGheB0PHKIrwGHgJ4op59IUcxCd3ChQqclxeYxKhK3ZwkXmw1AwIGXWjgktrsk6DH6ba1NMLmZ1pzBqcyvzB3CMIuC4HBXIHDILjU44EobGpdQQ8lNmKdDFM Oct 08 21:09:42.547329 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:09:42.547329 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:09:42.547329 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:09:42.547329 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:09:42.547329 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:09:42.547329 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:09:42.547329 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: e7ded993145b4eda9d6a33b994519012 Oct 08 21:09:42.547329 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-ServersTestJSON-68907085 Oct 08 21:09:42.547329 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:09:42.547329 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:09:42.547329 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/e7ded993145b4eda9d6a33b994519012"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e7ded993145b4eda9d6a33b994519012"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_e7ded993145b4eda9d6a33b994519012"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e7ded993145b4eda9d6a33b994519012"}]}] Oct 08 21:09:42.547329 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-ServersTestJSON-68907085 Oct 08 21:09:42.547329 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: e7ded993145b4eda9d6a33b994519012 Oct 08 21:09:42.547329 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-ServersTestJSON-68907085 Oct 08 21:09:42.547329 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-ServersTestJSON-68907085-project Oct 08 21:09:42.547329 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:09:42.547329 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:09:42.547329 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 06443b5728fb4d1e95d6245820e786bf Oct 08 21:09:42.547329 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-ServersTestJSON-68907085-project Oct 08 21:09:42.547329 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 21:09:42.547329 ncdv-master-1 devstack@n-api.service[140492]: exception: Instance 4e630da9-7820-47ef-ac72-1c91af94ff64 could not be found. Oct 08 21:09:42.547329 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': '4e630da9-7820-47ef-ac72-1c91af94ff64'} Oct 08 21:09:42.547329 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:09:42.547329 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:09:42.547329 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:09:42.547329 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:09:42.547329 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:09:42.547329 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:09:42.547329 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:09:42.547329 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:09:42.547329 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:09:42.547329 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:09:42.547329 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e630da9-7820-47ef-ac72-1c91af94ff64 could not be found. Oct 08 21:09:42.547329 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:09:42.547329 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:09:42.547329 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:09:42.547329 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:09:42.547329 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:09:42.547329 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:09:42.547329 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:09:42.547329 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:09:42.547329 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:09:42.547329 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:09:42.547329 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:09:42.547329 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:09:42.547329 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:09:42.547329 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:09:42.547329 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:09:42.547329 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:09:42.547329 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e630da9-7820-47ef-ac72-1c91af94ff64 could not be found. Oct 08 21:09:42.547329 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:09:42.547329 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:09:42.547329 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:09:42.547329 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:09:42.551689 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:09:42.551689 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:09:42.551689 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:09:42.551689 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:09:42.551689 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e630da9-7820-47ef-ac72-1c91af94ff64 could not be found. Oct 08 21:09:42.551689 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:09:42.551689 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-773cbff9-9336-4bc7-ab16-87fb35373511 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Returning 404 to user: Instance 4e630da9-7820-47ef-ac72-1c91af94ff64 could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:09:42.551689 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-773cbff9-9336-4bc7-ab16-87fb35373511 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "GET /compute/v2.1/servers/4e630da9-7820-47ef-ac72-1c91af94ff64" status: 404 len: 111 microversion: 2.1 time: 0.037729 Oct 08 21:09:42.551689 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2161/4225] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:42 2022] GET /compute/v2.1/servers/4e630da9-7820-47ef-ac72-1c91af94ff64 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 08 21:09:42.559476 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-a0d8adab-6630-4831-a6e8-7161a86226bf tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:42.559977 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-a0d8adab-6630-4831-a6e8-7161a86226bf tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: f182bee3-f292-4f22-b9a0-93228e1a5049] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:42.567845 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a0d8adab-6630-4831-a6e8-7161a86226bf tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:42.568358 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a0d8adab-6630-4831-a6e8-7161a86226bf tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:42.568800 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a0d8adab-6630-4831-a6e8-7161a86226bf tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:42.569546 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a0d8adab-6630-4831-a6e8-7161a86226bf tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:42.570612 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a0d8adab-6630-4831-a6e8-7161a86226bf tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:42.571824 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a0d8adab-6630-4831-a6e8-7161a86226bf tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:42.586631 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-a0d8adab-6630-4831-a6e8-7161a86226bf tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] HTTP exception thrown: Instance f182bee3-f292-4f22-b9a0-93228e1a5049 could not be found. Oct 08 21:09:42.588362 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-a0d8adab-6630-4831-a6e8-7161a86226bf tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Request method failure captured: Oct 08 21:09:42.588362 ncdv-master-1 devstack@n-api.service[140492]: request: DELETE /compute/v2.1/servers/f182bee3-f292-4f22-b9a0-93228e1a5049 HTTP/1.1 Oct 08 21:09:42.588362 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:09:42.588362 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:09:42.588362 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:09:42.588362 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 21:09:42.588362 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:09:42.588362 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:09:42.588362 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:09:42.588362 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:09:42.588362 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeYsdf-NgsPUaUb78CUpk0vq18mlUqdb1er-CKgSGnwcxKYVDw5Br5ObGheB0PHKIrwGHgJ4op59IUcxCd3ChQqclxeYxKhK3ZwkXmw1AwIGXWjgktrsk6DH6ba1NMLmZ1pzBqcyvzB3CMIuC4HBXIHDILjU44EobGpdQQ8lNmKdDFM Oct 08 21:09:42.588362 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:09:42.588362 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:09:42.588362 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:09:42.588362 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:09:42.588362 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:09:42.588362 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:09:42.588362 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: e7ded993145b4eda9d6a33b994519012 Oct 08 21:09:42.588362 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-ServersTestJSON-68907085 Oct 08 21:09:42.588362 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:09:42.588362 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:09:42.588362 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/e7ded993145b4eda9d6a33b994519012"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e7ded993145b4eda9d6a33b994519012"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_e7ded993145b4eda9d6a33b994519012"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e7ded993145b4eda9d6a33b994519012"}]}] Oct 08 21:09:42.588362 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-ServersTestJSON-68907085 Oct 08 21:09:42.588362 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: e7ded993145b4eda9d6a33b994519012 Oct 08 21:09:42.588362 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-ServersTestJSON-68907085 Oct 08 21:09:42.588362 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-ServersTestJSON-68907085-project Oct 08 21:09:42.588362 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:09:42.588362 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:09:42.588362 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 06443b5728fb4d1e95d6245820e786bf Oct 08 21:09:42.588362 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-ServersTestJSON-68907085-project Oct 08 21:09:42.588362 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 21:09:42.588362 ncdv-master-1 devstack@n-api.service[140492]: exception: Instance f182bee3-f292-4f22-b9a0-93228e1a5049 could not be found. Oct 08 21:09:42.588362 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': 'f182bee3-f292-4f22-b9a0-93228e1a5049'} Oct 08 21:09:42.588362 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:09:42.588362 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:09:42.588362 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:09:42.588362 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:09:42.588362 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:09:42.588362 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:09:42.588362 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:09:42.588362 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:09:42.588362 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:09:42.588362 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:09:42.588362 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f182bee3-f292-4f22-b9a0-93228e1a5049 could not be found. Oct 08 21:09:42.588362 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:09:42.588362 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:09:42.588362 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:09:42.588362 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:09:42.588362 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:09:42.588362 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:09:42.588362 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:09:42.588362 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:09:42.588362 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:09:42.588362 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:09:42.588362 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 08 21:09:42.588362 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 08 21:09:42.588362 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 08 21:09:42.588362 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 08 21:09:42.588362 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:09:42.588362 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:09:42.588362 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:09:42.588362 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:09:42.588362 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f182bee3-f292-4f22-b9a0-93228e1a5049 could not be found. Oct 08 21:09:42.596104 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:09:42.596104 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:09:42.596104 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:09:42.596104 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:09:42.596104 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:09:42.596104 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:09:42.596104 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:09:42.596104 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:09:42.596104 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f182bee3-f292-4f22-b9a0-93228e1a5049 could not be found. Oct 08 21:09:42.596104 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:09:42.596104 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-a0d8adab-6630-4831-a6e8-7161a86226bf tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Returning 404 to user: Instance f182bee3-f292-4f22-b9a0-93228e1a5049 could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:09:42.596104 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-a0d8adab-6630-4831-a6e8-7161a86226bf tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "DELETE /compute/v2.1/servers/f182bee3-f292-4f22-b9a0-93228e1a5049" status: 404 len: 111 microversion: 2.1 time: 0.034792 Oct 08 21:09:42.596104 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2162/4226] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:09:42 2022] DELETE /compute/v2.1/servers/f182bee3-f292-4f22-b9a0-93228e1a5049 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:09:42.610904 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-85e4e804-70f4-4c82-90f4-30b9f0e7aba4 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:42.611671 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-85e4e804-70f4-4c82-90f4-30b9f0e7aba4 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: f182bee3-f292-4f22-b9a0-93228e1a5049] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:42.619845 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-85e4e804-70f4-4c82-90f4-30b9f0e7aba4 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:42.620516 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-85e4e804-70f4-4c82-90f4-30b9f0e7aba4 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:42.621066 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-85e4e804-70f4-4c82-90f4-30b9f0e7aba4 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:42.622048 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-85e4e804-70f4-4c82-90f4-30b9f0e7aba4 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:42.622999 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-85e4e804-70f4-4c82-90f4-30b9f0e7aba4 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:42.623921 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-85e4e804-70f4-4c82-90f4-30b9f0e7aba4 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:42.647965 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-85e4e804-70f4-4c82-90f4-30b9f0e7aba4 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] HTTP exception thrown: Instance f182bee3-f292-4f22-b9a0-93228e1a5049 could not be found. Oct 08 21:09:42.650004 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-85e4e804-70f4-4c82-90f4-30b9f0e7aba4 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Request method failure captured: Oct 08 21:09:42.650004 ncdv-master-1 devstack@n-api.service[140492]: request: GET /compute/v2.1/servers/f182bee3-f292-4f22-b9a0-93228e1a5049 HTTP/1.1 Oct 08 21:09:42.650004 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:09:42.650004 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:09:42.650004 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:09:42.650004 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 21:09:42.650004 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:09:42.650004 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:09:42.650004 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:09:42.650004 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:09:42.650004 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeYsdf-NgsPUaUb78CUpk0vq18mlUqdb1er-CKgSGnwcxKYVDw5Br5ObGheB0PHKIrwGHgJ4op59IUcxCd3ChQqclxeYxKhK3ZwkXmw1AwIGXWjgktrsk6DH6ba1NMLmZ1pzBqcyvzB3CMIuC4HBXIHDILjU44EobGpdQQ8lNmKdDFM Oct 08 21:09:42.650004 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:09:42.650004 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:09:42.650004 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:09:42.650004 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:09:42.650004 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:09:42.650004 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:09:42.650004 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: e7ded993145b4eda9d6a33b994519012 Oct 08 21:09:42.650004 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-ServersTestJSON-68907085 Oct 08 21:09:42.650004 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:09:42.650004 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:09:42.650004 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/e7ded993145b4eda9d6a33b994519012"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e7ded993145b4eda9d6a33b994519012"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_e7ded993145b4eda9d6a33b994519012"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e7ded993145b4eda9d6a33b994519012"}]}] Oct 08 21:09:42.650004 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-ServersTestJSON-68907085 Oct 08 21:09:42.650004 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: e7ded993145b4eda9d6a33b994519012 Oct 08 21:09:42.650004 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-ServersTestJSON-68907085 Oct 08 21:09:42.650004 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-ServersTestJSON-68907085-project Oct 08 21:09:42.650004 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:09:42.650004 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:09:42.650004 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 06443b5728fb4d1e95d6245820e786bf Oct 08 21:09:42.650004 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-ServersTestJSON-68907085-project Oct 08 21:09:42.650004 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 21:09:42.650004 ncdv-master-1 devstack@n-api.service[140492]: exception: Instance f182bee3-f292-4f22-b9a0-93228e1a5049 could not be found. Oct 08 21:09:42.650004 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': 'f182bee3-f292-4f22-b9a0-93228e1a5049'} Oct 08 21:09:42.650004 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:09:42.650004 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:09:42.650004 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:09:42.650004 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:09:42.650004 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:09:42.650004 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:09:42.650004 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:09:42.650004 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:09:42.650004 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:09:42.650004 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:09:42.650004 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f182bee3-f292-4f22-b9a0-93228e1a5049 could not be found. Oct 08 21:09:42.650004 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:09:42.650004 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:09:42.650004 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:09:42.650004 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:09:42.650004 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:09:42.650004 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:09:42.650004 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:09:42.650004 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:09:42.650004 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:09:42.650004 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:09:42.650004 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:09:42.650004 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:09:42.650004 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:09:42.650004 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:09:42.650004 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:09:42.650004 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:09:42.650004 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f182bee3-f292-4f22-b9a0-93228e1a5049 could not be found. Oct 08 21:09:42.650004 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:09:42.650004 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:09:42.650004 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:09:42.650004 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:09:42.653864 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:09:42.653864 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:09:42.653864 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:09:42.653864 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:09:42.653864 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f182bee3-f292-4f22-b9a0-93228e1a5049 could not be found. Oct 08 21:09:42.653864 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:09:42.656706 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-85e4e804-70f4-4c82-90f4-30b9f0e7aba4 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Returning 404 to user: Instance f182bee3-f292-4f22-b9a0-93228e1a5049 could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:09:42.657977 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-85e4e804-70f4-4c82-90f4-30b9f0e7aba4 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "GET /compute/v2.1/servers/f182bee3-f292-4f22-b9a0-93228e1a5049" status: 404 len: 111 microversion: 2.1 time: 0.051051 Oct 08 21:09:42.658679 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-0085ebf7-978d-43fe-8cb6-5f1b22992c69 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:42.659876 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2163/4227] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:42 2022] GET /compute/v2.1/servers/f182bee3-f292-4f22-b9a0-93228e1a5049 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 08 21:09:42.670798 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-0085ebf7-978d-43fe-8cb6-5f1b22992c69 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 200 len: 1503 microversion: 2.1 time: 0.264537 Oct 08 21:09:42.671176 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-83d2626f-6a7f-4527-aafe-84c61df8c8a0 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:42.671394 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2065/4228] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:42 2022] GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 1503 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:09:42.672274 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-83d2626f-6a7f-4527-aafe-84c61df8c8a0 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: ba5cd412-0d20-4d2e-9f5e-de18f268008a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:42.679742 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-83d2626f-6a7f-4527-aafe-84c61df8c8a0 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:42.681012 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-83d2626f-6a7f-4527-aafe-84c61df8c8a0 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:42.681660 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-83d2626f-6a7f-4527-aafe-84c61df8c8a0 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:42.682751 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-83d2626f-6a7f-4527-aafe-84c61df8c8a0 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:42.683664 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-83d2626f-6a7f-4527-aafe-84c61df8c8a0 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:42.684309 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-83d2626f-6a7f-4527-aafe-84c61df8c8a0 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:42.689207 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-b757559b-86b9-4ea1-8086-5d580dbce4b8 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:42.689719 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-b757559b-86b9-4ea1-8086-5d580dbce4b8 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: c7e330f4-220e-4dce-b65e-0aedb3206dda] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:42.697322 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b757559b-86b9-4ea1-8086-5d580dbce4b8 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:42.697872 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b757559b-86b9-4ea1-8086-5d580dbce4b8 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:42.698277 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b757559b-86b9-4ea1-8086-5d580dbce4b8 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:42.699301 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b757559b-86b9-4ea1-8086-5d580dbce4b8 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:42.700508 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b757559b-86b9-4ea1-8086-5d580dbce4b8 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:42.701108 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b757559b-86b9-4ea1-8086-5d580dbce4b8 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:42.718077 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-b757559b-86b9-4ea1-8086-5d580dbce4b8 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] HTTP exception thrown: Instance c7e330f4-220e-4dce-b65e-0aedb3206dda could not be found. Oct 08 21:09:42.719946 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-b757559b-86b9-4ea1-8086-5d580dbce4b8 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Request method failure captured: Oct 08 21:09:42.719946 ncdv-master-1 devstack@n-api.service[140491]: request: DELETE /compute/v2.1/servers/c7e330f4-220e-4dce-b65e-0aedb3206dda HTTP/1.1 Oct 08 21:09:42.719946 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:09:42.719946 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:09:42.719946 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:09:42.719946 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 21:09:42.719946 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:09:42.719946 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:09:42.719946 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:09:42.719946 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:09:42.719946 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeYsdf-NgsPUaUb78CUpk0vq18mlUqdb1er-CKgSGnwcxKYVDw5Br5ObGheB0PHKIrwGHgJ4op59IUcxCd3ChQqclxeYxKhK3ZwkXmw1AwIGXWjgktrsk6DH6ba1NMLmZ1pzBqcyvzB3CMIuC4HBXIHDILjU44EobGpdQQ8lNmKdDFM Oct 08 21:09:42.719946 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:09:42.719946 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:09:42.719946 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:09:42.719946 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:09:42.719946 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:09:42.719946 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:09:42.719946 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: e7ded993145b4eda9d6a33b994519012 Oct 08 21:09:42.719946 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-ServersTestJSON-68907085 Oct 08 21:09:42.719946 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:09:42.719946 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:09:42.719946 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/e7ded993145b4eda9d6a33b994519012"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e7ded993145b4eda9d6a33b994519012"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_e7ded993145b4eda9d6a33b994519012"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e7ded993145b4eda9d6a33b994519012"}]}] Oct 08 21:09:42.719946 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-ServersTestJSON-68907085 Oct 08 21:09:42.719946 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: e7ded993145b4eda9d6a33b994519012 Oct 08 21:09:42.719946 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-ServersTestJSON-68907085 Oct 08 21:09:42.719946 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-ServersTestJSON-68907085-project Oct 08 21:09:42.719946 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:09:42.719946 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:09:42.719946 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 06443b5728fb4d1e95d6245820e786bf Oct 08 21:09:42.719946 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-ServersTestJSON-68907085-project Oct 08 21:09:42.719946 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:09:42.719946 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance c7e330f4-220e-4dce-b65e-0aedb3206dda could not be found. Oct 08 21:09:42.719946 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': 'c7e330f4-220e-4dce-b65e-0aedb3206dda'} Oct 08 21:09:42.719946 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:09:42.719946 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:09:42.719946 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:09:42.719946 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:09:42.719946 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:09:42.719946 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:09:42.719946 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:09:42.719946 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:09:42.719946 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:09:42.719946 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:09:42.719946 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7e330f4-220e-4dce-b65e-0aedb3206dda could not be found. Oct 08 21:09:42.719946 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:09:42.719946 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:09:42.719946 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:09:42.719946 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:09:42.719946 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:09:42.719946 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:09:42.719946 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:09:42.719946 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:09:42.719946 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:09:42.719946 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:09:42.719946 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 08 21:09:42.719946 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 08 21:09:42.719946 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 08 21:09:42.719946 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 08 21:09:42.719946 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:09:42.719946 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:09:42.719946 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:09:42.719946 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:09:42.719946 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7e330f4-220e-4dce-b65e-0aedb3206dda could not be found. Oct 08 21:09:42.724159 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:09:42.724159 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:09:42.724159 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:09:42.724159 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:09:42.724159 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:09:42.724159 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:09:42.724159 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:09:42.724159 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:09:42.724159 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7e330f4-220e-4dce-b65e-0aedb3206dda could not be found. Oct 08 21:09:42.724159 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:09:42.724159 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-b757559b-86b9-4ea1-8086-5d580dbce4b8 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Returning 404 to user: Instance c7e330f4-220e-4dce-b65e-0aedb3206dda could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:09:42.724159 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-b757559b-86b9-4ea1-8086-5d580dbce4b8 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "DELETE /compute/v2.1/servers/c7e330f4-220e-4dce-b65e-0aedb3206dda" status: 404 len: 111 microversion: 2.1 time: 0.046499 Oct 08 21:09:42.724159 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2066/4229] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:09:42 2022] DELETE /compute/v2.1/servers/c7e330f4-220e-4dce-b65e-0aedb3206dda => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:09:42.738820 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-e936b605-fe01-4524-b6dd-09aa563d7e2f tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:42.739977 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-e936b605-fe01-4524-b6dd-09aa563d7e2f tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:42.757031 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e936b605-fe01-4524-b6dd-09aa563d7e2f tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:42.757574 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e936b605-fe01-4524-b6dd-09aa563d7e2f tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:42.758029 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e936b605-fe01-4524-b6dd-09aa563d7e2f tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:42.759400 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e936b605-fe01-4524-b6dd-09aa563d7e2f tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:42.760026 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e936b605-fe01-4524-b6dd-09aa563d7e2f tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:42.760689 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e936b605-fe01-4524-b6dd-09aa563d7e2f tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:42.934429 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-e936b605-fe01-4524-b6dd-09aa563d7e2f tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:42.942879 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-e936b605-fe01-4524-b6dd-09aa563d7e2f tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 200 len: 1503 microversion: 2.1 time: 0.211102 Oct 08 21:09:42.943464 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2067/4230] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:42 2022] GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 1503 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:09:42.946739 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-83d2626f-6a7f-4527-aafe-84c61df8c8a0 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78e9afd772c4de981cac8f5817ec356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765c62cac2ee4406b23a5baa85c52ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:42.949384 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-a253b721-b330-4c5c-b200-9dfc9077ec93 req-2c82860a-4ce4-4c6a-8633-970e0774ca1f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3fed4df9-92ff-4040-8fa7-db370960dc06", "tag": "25804709-1226-432d-bc34-f585676f5c93"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:09:42.959425 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-83d2626f-6a7f-4527-aafe-84c61df8c8a0 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/ba5cd412-0d20-4d2e-9f5e-de18f268008a" status: 200 len: 1506 microversion: 2.1 time: 0.298145 Oct 08 21:09:42.961840 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2164/4231] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:42 2022] GET /compute/v2.1/servers/ba5cd412-0d20-4d2e-9f5e-de18f268008a => generated 1506 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:09:42.964737 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-a253b721-b330-4c5c-b200-9dfc9077ec93 req-2c82860a-4ce4-4c6a-8633-970e0774ca1f service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:42.965560 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-a253b721-b330-4c5c-b200-9dfc9077ec93 req-2c82860a-4ce4-4c6a-8633-970e0774ca1f service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:42.966481 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-3fa34691-4932-48c2-a39e-ee959335a62d tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:42.966599 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-a253b721-b330-4c5c-b200-9dfc9077ec93 req-2c82860a-4ce4-4c6a-8633-970e0774ca1f service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:42.967080 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-3fa34691-4932-48c2-a39e-ee959335a62d tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: c7e330f4-220e-4dce-b65e-0aedb3206dda] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:42.978105 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3fa34691-4932-48c2-a39e-ee959335a62d tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:42.978985 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3fa34691-4932-48c2-a39e-ee959335a62d tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:42.979431 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3fa34691-4932-48c2-a39e-ee959335a62d tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:42.980214 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3fa34691-4932-48c2-a39e-ee959335a62d tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:42.980675 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3fa34691-4932-48c2-a39e-ee959335a62d tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:42.981104 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3fa34691-4932-48c2-a39e-ee959335a62d tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:42.984460 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-a253b721-b330-4c5c-b200-9dfc9077ec93 req-2c82860a-4ce4-4c6a-8633-970e0774ca1f service nova] Creating event network-changed:25804709-1226-432d-bc34-f585676f5c93 for instance 3fed4df9-92ff-4040-8fa7-db370960dc06 on nch1-master-1 Oct 08 21:09:42.990402 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-a253b721-b330-4c5c-b200-9dfc9077ec93 req-2c82860a-4ce4-4c6a-8633-970e0774ca1f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045244 Oct 08 21:09:42.991876 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2068/4232] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:09:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:09:43.000352 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-abf200ad-33a5-47ae-9e50-096031d90882 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:09:43.000627 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-3fa34691-4932-48c2-a39e-ee959335a62d tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] HTTP exception thrown: Instance c7e330f4-220e-4dce-b65e-0aedb3206dda could not be found. Oct 08 21:09:43.001009 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-abf200ad-33a5-47ae-9e50-096031d90882 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: b22e3b3a-00e4-4b18-8af9-a558dec8ae67] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:43.003202 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-3fa34691-4932-48c2-a39e-ee959335a62d tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Request method failure captured: Oct 08 21:09:43.003202 ncdv-master-1 devstack@n-api.service[140492]: request: GET /compute/v2.1/servers/c7e330f4-220e-4dce-b65e-0aedb3206dda HTTP/1.1 Oct 08 21:09:43.003202 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:09:43.003202 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:09:43.003202 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:09:43.003202 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 21:09:43.003202 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:09:43.003202 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:09:43.003202 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:09:43.003202 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:09:43.003202 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeYsdf-NgsPUaUb78CUpk0vq18mlUqdb1er-CKgSGnwcxKYVDw5Br5ObGheB0PHKIrwGHgJ4op59IUcxCd3ChQqclxeYxKhK3ZwkXmw1AwIGXWjgktrsk6DH6ba1NMLmZ1pzBqcyvzB3CMIuC4HBXIHDILjU44EobGpdQQ8lNmKdDFM Oct 08 21:09:43.003202 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:09:43.003202 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:09:43.003202 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:09:43.003202 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:09:43.003202 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:09:43.003202 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:09:43.003202 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: e7ded993145b4eda9d6a33b994519012 Oct 08 21:09:43.003202 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-ServersTestJSON-68907085 Oct 08 21:09:43.003202 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:09:43.003202 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:09:43.003202 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/e7ded993145b4eda9d6a33b994519012"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e7ded993145b4eda9d6a33b994519012"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_e7ded993145b4eda9d6a33b994519012"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e7ded993145b4eda9d6a33b994519012"}]}] Oct 08 21:09:43.003202 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-ServersTestJSON-68907085 Oct 08 21:09:43.003202 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: e7ded993145b4eda9d6a33b994519012 Oct 08 21:09:43.003202 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-ServersTestJSON-68907085 Oct 08 21:09:43.003202 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-ServersTestJSON-68907085-project Oct 08 21:09:43.003202 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:09:43.003202 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:09:43.003202 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 06443b5728fb4d1e95d6245820e786bf Oct 08 21:09:43.003202 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-ServersTestJSON-68907085-project Oct 08 21:09:43.003202 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 21:09:43.003202 ncdv-master-1 devstack@n-api.service[140492]: exception: Instance c7e330f4-220e-4dce-b65e-0aedb3206dda could not be found. Oct 08 21:09:43.003202 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': 'c7e330f4-220e-4dce-b65e-0aedb3206dda'} Oct 08 21:09:43.003202 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:09:43.003202 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:09:43.003202 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:09:43.003202 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:09:43.003202 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:09:43.003202 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:09:43.003202 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:09:43.003202 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:09:43.003202 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:09:43.003202 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:09:43.003202 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7e330f4-220e-4dce-b65e-0aedb3206dda could not be found. Oct 08 21:09:43.003202 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:09:43.003202 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:09:43.003202 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:09:43.003202 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:09:43.003202 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:09:43.003202 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:09:43.003202 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:09:43.003202 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:09:43.003202 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:09:43.003202 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:09:43.003202 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:09:43.003202 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:09:43.003202 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:09:43.003202 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:09:43.003202 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:09:43.003202 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:09:43.003202 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7e330f4-220e-4dce-b65e-0aedb3206dda could not be found. Oct 08 21:09:43.003202 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:09:43.003202 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:09:43.003202 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:09:43.003202 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:09:43.007040 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:09:43.007040 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:09:43.007040 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:09:43.007040 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:09:43.007040 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7e330f4-220e-4dce-b65e-0aedb3206dda could not be found. Oct 08 21:09:43.007040 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:09:43.007360 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-abf200ad-33a5-47ae-9e50-096031d90882 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] HTTP exception thrown: Instance b22e3b3a-00e4-4b18-8af9-a558dec8ae67 could not be found. Oct 08 21:09:43.009439 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-3fa34691-4932-48c2-a39e-ee959335a62d tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Returning 404 to user: Instance c7e330f4-220e-4dce-b65e-0aedb3206dda could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:09:43.010666 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-3fa34691-4932-48c2-a39e-ee959335a62d tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "GET /compute/v2.1/servers/c7e330f4-220e-4dce-b65e-0aedb3206dda" status: 404 len: 111 microversion: 2.1 time: 0.047759 Oct 08 21:09:43.011276 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2165/4233] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:42 2022] GET /compute/v2.1/servers/c7e330f4-220e-4dce-b65e-0aedb3206dda => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:09:43.015425 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-abf200ad-33a5-47ae-9e50-096031d90882 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Request method failure captured: Oct 08 21:09:43.015425 ncdv-master-1 devstack@n-api.service[140491]: request: POST /compute/v2.1/servers/b22e3b3a-00e4-4b18-8af9-a558dec8ae67/action HTTP/1.1 Oct 08 21:09:43.015425 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:09:43.015425 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:09:43.015425 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:09:43.015425 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 19 Oct 08 21:09:43.015425 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:09:43.015425 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:09:43.015425 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:09:43.015425 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:09:43.015425 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQebW09Z3m936-d3SrnQA9UQ3KXQvUYeQwL43ufWdoxmQhUwYBWv-JT053t_VYPo9wAVRoCqYQy8Hhh8zc2n570KpS0qNVLik822FjYabkSIZMA_ubWypXzSwo3J04zV1MoSSz79D-b8-ZvwYCEIbwpbfyn5opgOjnO6EXvq1UNPaSyQ Oct 08 21:09:43.015425 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:09:43.015425 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:09:43.015425 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:09:43.015425 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:09:43.015425 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:09:43.015425 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:09:43.015425 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 0ae02675057e4f27bc1980348afc8ca1 Oct 08 21:09:43.015425 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-ServersNegativeTestJSON-1441071354 Oct 08 21:09:43.015425 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:09:43.015425 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:09:43.015425 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0ae02675057e4f27bc1980348afc8ca1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0ae02675057e4f27bc1980348afc8ca1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0ae02675057e4f27bc1980348afc8ca1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0ae02675057e4f27bc1980348afc8ca1"}]}] Oct 08 21:09:43.015425 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-ServersNegativeTestJSON-1441071354 Oct 08 21:09:43.015425 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 0ae02675057e4f27bc1980348afc8ca1 Oct 08 21:09:43.015425 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1441071354 Oct 08 21:09:43.015425 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-ServersNegativeTestJSON-1441071354-project Oct 08 21:09:43.015425 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:09:43.015425 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:09:43.015425 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 6a78d352c143483c8e4702d789d4c516 Oct 08 21:09:43.015425 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-ServersNegativeTestJSON-1441071354-project Oct 08 21:09:43.015425 ncdv-master-1 devstack@n-api.service[140491]: Oct 08 21:09:43.015425 ncdv-master-1 devstack@n-api.service[140491]: {"forceDelete": {}} Oct 08 21:09:43.015425 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:09:43.015425 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance b22e3b3a-00e4-4b18-8af9-a558dec8ae67 could not be found. Oct 08 21:09:43.015425 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': 'b22e3b3a-00e4-4b18-8af9-a558dec8ae67', 'body': {'forceDelete': {}}} Oct 08 21:09:43.015425 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:09:43.015425 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:09:43.015425 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:09:43.015425 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:09:43.015425 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:09:43.015425 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:09:43.015425 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 08 21:09:43.015425 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 08 21:09:43.015425 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b22e3b3a-00e4-4b18-8af9-a558dec8ae67 could not be found. Oct 08 21:09:43.015425 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:09:43.015425 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:09:43.015425 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:09:43.015425 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:09:43.015425 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:09:43.015425 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:09:43.015425 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:09:43.015425 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:09:43.015425 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:09:43.015425 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:09:43.015425 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Oct 08 21:09:43.015425 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 08 21:09:43.015425 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:09:43.015425 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:09:43.015425 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b22e3b3a-00e4-4b18-8af9-a558dec8ae67 could not be found. Oct 08 21:09:43.015425 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:09:43.015425 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:09:43.015425 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:09:43.015425 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:09:43.015425 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:09:43.015425 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:09:43.019173 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:09:43.019173 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:09:43.019173 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b22e3b3a-00e4-4b18-8af9-a558dec8ae67 could not be found. Oct 08 21:09:43.019173 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:09:43.019173 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-abf200ad-33a5-47ae-9e50-096031d90882 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Returning 404 to user: Instance b22e3b3a-00e4-4b18-8af9-a558dec8ae67 could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:09:43.019173 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-abf200ad-33a5-47ae-9e50-096031d90882 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "POST /compute/v2.1/servers/b22e3b3a-00e4-4b18-8af9-a558dec8ae67/action" status: 404 len: 111 microversion: 2.1 time: 0.023925 Oct 08 21:09:43.019173 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2069/4234] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:09:42 2022] POST /compute/v2.1/servers/b22e3b3a-00e4-4b18-8af9-a558dec8ae67/action => generated 111 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:09:43.022551 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-85c80690-7d29-43bb-ac1e-eb192f240608 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:43.023430 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-85c80690-7d29-43bb-ac1e-eb192f240608 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] [instance: 159e29dd-802c-4059-99f9-bb7c113d430b] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:43.023744 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-55ad4e57-d001-47ab-9cb9-449e99a803e9 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:43.024285 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-55ad4e57-d001-47ab-9cb9-449e99a803e9 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: a0a81300-bb0a-4528-96eb-43c422f9df2d] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:43.030880 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-85c80690-7d29-43bb-ac1e-eb192f240608 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:43.032153 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-85c80690-7d29-43bb-ac1e-eb192f240608 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:43.032830 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-85c80690-7d29-43bb-ac1e-eb192f240608 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:43.033871 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-85c80690-7d29-43bb-ac1e-eb192f240608 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:43.033982 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-55ad4e57-d001-47ab-9cb9-449e99a803e9 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:43.034450 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-55ad4e57-d001-47ab-9cb9-449e99a803e9 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:43.034946 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-55ad4e57-d001-47ab-9cb9-449e99a803e9 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:43.035227 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-85c80690-7d29-43bb-ac1e-eb192f240608 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:43.035813 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-55ad4e57-d001-47ab-9cb9-449e99a803e9 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:43.036202 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-85c80690-7d29-43bb-ac1e-eb192f240608 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:43.036309 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-55ad4e57-d001-47ab-9cb9-449e99a803e9 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:43.036678 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-55ad4e57-d001-47ab-9cb9-449e99a803e9 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:43.054863 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-55ad4e57-d001-47ab-9cb9-449e99a803e9 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] HTTP exception thrown: Instance a0a81300-bb0a-4528-96eb-43c422f9df2d could not be found. Oct 08 21:09:43.057576 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-55ad4e57-d001-47ab-9cb9-449e99a803e9 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Request method failure captured: Oct 08 21:09:43.057576 ncdv-master-1 devstack@n-api.service[140491]: request: DELETE /compute/v2.1/servers/a0a81300-bb0a-4528-96eb-43c422f9df2d HTTP/1.1 Oct 08 21:09:43.057576 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:09:43.057576 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:09:43.057576 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:09:43.057576 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 21:09:43.057576 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:09:43.057576 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:09:43.057576 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:09:43.057576 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:09:43.057576 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeYsdf-NgsPUaUb78CUpk0vq18mlUqdb1er-CKgSGnwcxKYVDw5Br5ObGheB0PHKIrwGHgJ4op59IUcxCd3ChQqclxeYxKhK3ZwkXmw1AwIGXWjgktrsk6DH6ba1NMLmZ1pzBqcyvzB3CMIuC4HBXIHDILjU44EobGpdQQ8lNmKdDFM Oct 08 21:09:43.057576 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:09:43.057576 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:09:43.057576 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:09:43.057576 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:09:43.057576 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:09:43.057576 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:09:43.057576 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: e7ded993145b4eda9d6a33b994519012 Oct 08 21:09:43.057576 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-ServersTestJSON-68907085 Oct 08 21:09:43.057576 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:09:43.057576 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:09:43.057576 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/e7ded993145b4eda9d6a33b994519012"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e7ded993145b4eda9d6a33b994519012"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_e7ded993145b4eda9d6a33b994519012"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e7ded993145b4eda9d6a33b994519012"}]}] Oct 08 21:09:43.057576 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-ServersTestJSON-68907085 Oct 08 21:09:43.057576 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: e7ded993145b4eda9d6a33b994519012 Oct 08 21:09:43.057576 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-ServersTestJSON-68907085 Oct 08 21:09:43.057576 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-ServersTestJSON-68907085-project Oct 08 21:09:43.057576 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:09:43.057576 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:09:43.057576 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 06443b5728fb4d1e95d6245820e786bf Oct 08 21:09:43.057576 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-ServersTestJSON-68907085-project Oct 08 21:09:43.057576 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:09:43.057576 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance a0a81300-bb0a-4528-96eb-43c422f9df2d could not be found. Oct 08 21:09:43.057576 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': 'a0a81300-bb0a-4528-96eb-43c422f9df2d'} Oct 08 21:09:43.057576 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:09:43.057576 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:09:43.057576 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:09:43.057576 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:09:43.057576 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:09:43.057576 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:09:43.057576 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:09:43.057576 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:09:43.057576 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:09:43.057576 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:09:43.057576 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0a81300-bb0a-4528-96eb-43c422f9df2d could not be found. Oct 08 21:09:43.057576 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:09:43.057576 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:09:43.057576 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:09:43.057576 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:09:43.057576 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:09:43.057576 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:09:43.057576 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:09:43.057576 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:09:43.057576 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:09:43.057576 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:09:43.057576 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 08 21:09:43.057576 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 08 21:09:43.057576 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 08 21:09:43.057576 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 08 21:09:43.057576 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:09:43.057576 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:09:43.057576 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:09:43.057576 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:09:43.057576 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0a81300-bb0a-4528-96eb-43c422f9df2d could not be found. Oct 08 21:09:43.061067 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:09:43.061067 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:09:43.061067 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:09:43.061067 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:09:43.061067 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:09:43.061067 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:09:43.061067 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:09:43.061067 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:09:43.061067 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0a81300-bb0a-4528-96eb-43c422f9df2d could not be found. Oct 08 21:09:43.061067 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:09:43.063536 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-55ad4e57-d001-47ab-9cb9-449e99a803e9 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Returning 404 to user: Instance a0a81300-bb0a-4528-96eb-43c422f9df2d could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:09:43.064657 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-55ad4e57-d001-47ab-9cb9-449e99a803e9 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "DELETE /compute/v2.1/servers/a0a81300-bb0a-4528-96eb-43c422f9df2d" status: 404 len: 111 microversion: 2.1 time: 0.045829 Oct 08 21:09:43.065857 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2070/4235] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:09:43 2022] DELETE /compute/v2.1/servers/a0a81300-bb0a-4528-96eb-43c422f9df2d => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:09:43.071591 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-0942e1a0-f8cf-482f-82c2-ef8252c93434 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:43.072543 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-0942e1a0-f8cf-482f-82c2-ef8252c93434 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:43.079587 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0942e1a0-f8cf-482f-82c2-ef8252c93434 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:43.080424 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0942e1a0-f8cf-482f-82c2-ef8252c93434 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:43.081114 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0942e1a0-f8cf-482f-82c2-ef8252c93434 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:43.082125 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0942e1a0-f8cf-482f-82c2-ef8252c93434 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:43.082831 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0942e1a0-f8cf-482f-82c2-ef8252c93434 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:43.083871 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0942e1a0-f8cf-482f-82c2-ef8252c93434 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:43.329002 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-0942e1a0-f8cf-482f-82c2-ef8252c93434 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:43.338089 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-0942e1a0-f8cf-482f-82c2-ef8252c93434 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 200 len: 1503 microversion: 2.1 time: 0.270711 Oct 08 21:09:43.338874 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2071/4236] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:43 2022] GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 1503 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:09:43.351598 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-5491501d-60a6-4664-96f2-db4152e0b564 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:43.352888 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-5491501d-60a6-4664-96f2-db4152e0b564 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: a0a81300-bb0a-4528-96eb-43c422f9df2d] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:43.361752 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5491501d-60a6-4664-96f2-db4152e0b564 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:43.362496 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5491501d-60a6-4664-96f2-db4152e0b564 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:43.363010 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5491501d-60a6-4664-96f2-db4152e0b564 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:43.364032 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5491501d-60a6-4664-96f2-db4152e0b564 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:43.364570 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5491501d-60a6-4664-96f2-db4152e0b564 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:43.365349 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5491501d-60a6-4664-96f2-db4152e0b564 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:43.387564 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-5491501d-60a6-4664-96f2-db4152e0b564 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] HTTP exception thrown: Instance a0a81300-bb0a-4528-96eb-43c422f9df2d could not be found. Oct 08 21:09:43.389831 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-5491501d-60a6-4664-96f2-db4152e0b564 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Request method failure captured: Oct 08 21:09:43.389831 ncdv-master-1 devstack@n-api.service[140491]: request: GET /compute/v2.1/servers/a0a81300-bb0a-4528-96eb-43c422f9df2d HTTP/1.1 Oct 08 21:09:43.389831 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:09:43.389831 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:09:43.389831 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:09:43.389831 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 21:09:43.389831 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:09:43.389831 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:09:43.389831 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:09:43.389831 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:09:43.389831 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeYsdf-NgsPUaUb78CUpk0vq18mlUqdb1er-CKgSGnwcxKYVDw5Br5ObGheB0PHKIrwGHgJ4op59IUcxCd3ChQqclxeYxKhK3ZwkXmw1AwIGXWjgktrsk6DH6ba1NMLmZ1pzBqcyvzB3CMIuC4HBXIHDILjU44EobGpdQQ8lNmKdDFM Oct 08 21:09:43.389831 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:09:43.389831 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:09:43.389831 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:09:43.389831 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:09:43.389831 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:09:43.389831 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:09:43.389831 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: e7ded993145b4eda9d6a33b994519012 Oct 08 21:09:43.389831 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-ServersTestJSON-68907085 Oct 08 21:09:43.389831 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:09:43.389831 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:09:43.389831 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/e7ded993145b4eda9d6a33b994519012"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e7ded993145b4eda9d6a33b994519012"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_e7ded993145b4eda9d6a33b994519012"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e7ded993145b4eda9d6a33b994519012"}]}] Oct 08 21:09:43.389831 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-ServersTestJSON-68907085 Oct 08 21:09:43.389831 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: e7ded993145b4eda9d6a33b994519012 Oct 08 21:09:43.389831 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-ServersTestJSON-68907085 Oct 08 21:09:43.389831 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-ServersTestJSON-68907085-project Oct 08 21:09:43.389831 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:09:43.389831 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:09:43.389831 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 06443b5728fb4d1e95d6245820e786bf Oct 08 21:09:43.389831 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-ServersTestJSON-68907085-project Oct 08 21:09:43.389831 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:09:43.389831 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance a0a81300-bb0a-4528-96eb-43c422f9df2d could not be found. Oct 08 21:09:43.389831 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': 'a0a81300-bb0a-4528-96eb-43c422f9df2d'} Oct 08 21:09:43.389831 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:09:43.389831 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:09:43.389831 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:09:43.389831 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:09:43.389831 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:09:43.389831 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:09:43.389831 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:09:43.389831 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:09:43.389831 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:09:43.389831 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:09:43.389831 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0a81300-bb0a-4528-96eb-43c422f9df2d could not be found. Oct 08 21:09:43.389831 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:09:43.389831 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:09:43.389831 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:09:43.389831 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:09:43.389831 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:09:43.389831 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:09:43.389831 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:09:43.389831 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:09:43.389831 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:09:43.389831 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:09:43.389831 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:09:43.389831 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:09:43.389831 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:09:43.389831 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:09:43.389831 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:09:43.389831 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:09:43.389831 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0a81300-bb0a-4528-96eb-43c422f9df2d could not be found. Oct 08 21:09:43.389831 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:09:43.389831 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:09:43.389831 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:09:43.389831 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:09:43.395238 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:09:43.395238 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:09:43.395238 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:09:43.395238 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:09:43.395238 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0a81300-bb0a-4528-96eb-43c422f9df2d could not be found. Oct 08 21:09:43.395238 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:09:43.395238 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-5491501d-60a6-4664-96f2-db4152e0b564 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Returning 404 to user: Instance a0a81300-bb0a-4528-96eb-43c422f9df2d could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:09:43.395238 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-5491501d-60a6-4664-96f2-db4152e0b564 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "GET /compute/v2.1/servers/a0a81300-bb0a-4528-96eb-43c422f9df2d" status: 404 len: 111 microversion: 2.1 time: 0.047728 Oct 08 21:09:43.395964 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2072/4237] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:43 2022] GET /compute/v2.1/servers/a0a81300-bb0a-4528-96eb-43c422f9df2d => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:09:43.402532 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-35097548-7184-42d9-a09d-0a8dc37467fb tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:43.403275 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-35097548-7184-42d9-a09d-0a8dc37467fb tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] [instance: 3fed4df9-92ff-4040-8fa7-db370960dc06] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:43.423230 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-35097548-7184-42d9-a09d-0a8dc37467fb tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:43.424028 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-35097548-7184-42d9-a09d-0a8dc37467fb tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:43.424466 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-35097548-7184-42d9-a09d-0a8dc37467fb tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:43.425439 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-35097548-7184-42d9-a09d-0a8dc37467fb tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:43.425735 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-35097548-7184-42d9-a09d-0a8dc37467fb tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:43.426195 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-35097548-7184-42d9-a09d-0a8dc37467fb tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:43.623984 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-35097548-7184-42d9-a09d-0a8dc37467fb tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30fe0e1ffa1040ec85d3c32d8b741c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd0e7c24154409824f96e9e99da357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:43.636009 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-35097548-7184-42d9-a09d-0a8dc37467fb tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "GET /compute/v2.1/servers/3fed4df9-92ff-4040-8fa7-db370960dc06" status: 200 len: 1308 microversion: 2.1 time: 0.238867 Oct 08 21:09:43.646264 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2073/4238] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:43 2022] GET /compute/v2.1/servers/3fed4df9-92ff-4040-8fa7-db370960dc06 => generated 1308 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:09:43.656845 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-60c762b1-2441-4602-b806-378c519ed88c tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:43.659013 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-60c762b1-2441-4602-b806-378c519ed88c tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:43.671103 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-85c80690-7d29-43bb-ac1e-eb192f240608 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:43.673492 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-60c762b1-2441-4602-b806-378c519ed88c tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:43.674007 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-60c762b1-2441-4602-b806-378c519ed88c tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:43.674466 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-60c762b1-2441-4602-b806-378c519ed88c tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:43.675565 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-60c762b1-2441-4602-b806-378c519ed88c tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:43.676671 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-60c762b1-2441-4602-b806-378c519ed88c tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:43.677320 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-60c762b1-2441-4602-b806-378c519ed88c tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:43.680855 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-85c80690-7d29-43bb-ac1e-eb192f240608 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:43.682555 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-85c80690-7d29-43bb-ac1e-eb192f240608 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:43.683796 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-85c80690-7d29-43bb-ac1e-eb192f240608 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] 10.222.0.26 "GET /compute/v2.1/servers/159e29dd-802c-4059-99f9-bb7c113d430b" status: 200 len: 1743 microversion: 2.20 time: 0.671393 Oct 08 21:09:43.684506 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2166/4239] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:09:43 2022] GET /compute/v2.1/servers/159e29dd-802c-4059-99f9-bb7c113d430b => generated 1743 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:09:43.699456 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-5338c559-2a8e-40b4-8ef4-f6e635d163cf tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:43.700043 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-5338c559-2a8e-40b4-8ef4-f6e635d163cf tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: e1f1a2d9-92ff-4f2b-8f65-24cee7c6418d] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:43.707503 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5338c559-2a8e-40b4-8ef4-f6e635d163cf tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:43.709250 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5338c559-2a8e-40b4-8ef4-f6e635d163cf tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:43.709863 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5338c559-2a8e-40b4-8ef4-f6e635d163cf tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:43.710798 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5338c559-2a8e-40b4-8ef4-f6e635d163cf tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:43.711660 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5338c559-2a8e-40b4-8ef4-f6e635d163cf tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:43.712635 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5338c559-2a8e-40b4-8ef4-f6e635d163cf tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:43.739709 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-5338c559-2a8e-40b4-8ef4-f6e635d163cf tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] HTTP exception thrown: Instance e1f1a2d9-92ff-4f2b-8f65-24cee7c6418d could not be found. Oct 08 21:09:43.741752 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-5338c559-2a8e-40b4-8ef4-f6e635d163cf tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Request method failure captured: Oct 08 21:09:43.741752 ncdv-master-1 devstack@n-api.service[140492]: request: DELETE /compute/v2.1/servers/e1f1a2d9-92ff-4f2b-8f65-24cee7c6418d HTTP/1.1 Oct 08 21:09:43.741752 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:09:43.741752 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:09:43.741752 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:09:43.741752 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 21:09:43.741752 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:09:43.741752 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:09:43.741752 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:09:43.741752 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:09:43.741752 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeYsdf-NgsPUaUb78CUpk0vq18mlUqdb1er-CKgSGnwcxKYVDw5Br5ObGheB0PHKIrwGHgJ4op59IUcxCd3ChQqclxeYxKhK3ZwkXmw1AwIGXWjgktrsk6DH6ba1NMLmZ1pzBqcyvzB3CMIuC4HBXIHDILjU44EobGpdQQ8lNmKdDFM Oct 08 21:09:43.741752 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:09:43.741752 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:09:43.741752 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:09:43.741752 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:09:43.741752 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:09:43.741752 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:09:43.741752 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: e7ded993145b4eda9d6a33b994519012 Oct 08 21:09:43.741752 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-ServersTestJSON-68907085 Oct 08 21:09:43.741752 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:09:43.741752 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:09:43.741752 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/e7ded993145b4eda9d6a33b994519012"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e7ded993145b4eda9d6a33b994519012"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_e7ded993145b4eda9d6a33b994519012"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e7ded993145b4eda9d6a33b994519012"}]}] Oct 08 21:09:43.741752 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-ServersTestJSON-68907085 Oct 08 21:09:43.741752 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: e7ded993145b4eda9d6a33b994519012 Oct 08 21:09:43.741752 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-ServersTestJSON-68907085 Oct 08 21:09:43.741752 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-ServersTestJSON-68907085-project Oct 08 21:09:43.741752 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:09:43.741752 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:09:43.741752 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 06443b5728fb4d1e95d6245820e786bf Oct 08 21:09:43.741752 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-ServersTestJSON-68907085-project Oct 08 21:09:43.741752 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 21:09:43.741752 ncdv-master-1 devstack@n-api.service[140492]: exception: Instance e1f1a2d9-92ff-4f2b-8f65-24cee7c6418d could not be found. Oct 08 21:09:43.741752 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': 'e1f1a2d9-92ff-4f2b-8f65-24cee7c6418d'} Oct 08 21:09:43.741752 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:09:43.741752 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:09:43.741752 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:09:43.741752 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:09:43.741752 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:09:43.741752 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:09:43.741752 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:09:43.741752 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:09:43.741752 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:09:43.741752 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:09:43.741752 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1f1a2d9-92ff-4f2b-8f65-24cee7c6418d could not be found. Oct 08 21:09:43.741752 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:09:43.741752 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:09:43.741752 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:09:43.741752 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:09:43.741752 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:09:43.741752 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:09:43.741752 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:09:43.741752 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:09:43.741752 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:09:43.741752 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:09:43.741752 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 08 21:09:43.741752 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 08 21:09:43.741752 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 08 21:09:43.741752 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 08 21:09:43.741752 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:09:43.741752 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:09:43.741752 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:09:43.741752 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:09:43.741752 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1f1a2d9-92ff-4f2b-8f65-24cee7c6418d could not be found. Oct 08 21:09:43.747429 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:09:43.747429 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:09:43.747429 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:09:43.747429 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:09:43.747429 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:09:43.747429 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:09:43.747429 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:09:43.747429 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:09:43.747429 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1f1a2d9-92ff-4f2b-8f65-24cee7c6418d could not be found. Oct 08 21:09:43.747429 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:09:43.749111 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-5338c559-2a8e-40b4-8ef4-f6e635d163cf tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Returning 404 to user: Instance e1f1a2d9-92ff-4f2b-8f65-24cee7c6418d could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:09:43.749831 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-5338c559-2a8e-40b4-8ef4-f6e635d163cf tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "DELETE /compute/v2.1/servers/e1f1a2d9-92ff-4f2b-8f65-24cee7c6418d" status: 404 len: 111 microversion: 2.1 time: 0.064209 Oct 08 21:09:43.753949 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2167/4240] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:09:43 2022] DELETE /compute/v2.1/servers/e1f1a2d9-92ff-4f2b-8f65-24cee7c6418d => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:09:43.765349 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-0dde0ae9-6ee1-4d60-ac63-76f22fc15a3c tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:43.766581 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-0dde0ae9-6ee1-4d60-ac63-76f22fc15a3c tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: e1f1a2d9-92ff-4f2b-8f65-24cee7c6418d] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:43.777614 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0dde0ae9-6ee1-4d60-ac63-76f22fc15a3c tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:43.777956 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0dde0ae9-6ee1-4d60-ac63-76f22fc15a3c tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:43.778739 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0dde0ae9-6ee1-4d60-ac63-76f22fc15a3c tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:43.779738 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0dde0ae9-6ee1-4d60-ac63-76f22fc15a3c tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:43.780401 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0dde0ae9-6ee1-4d60-ac63-76f22fc15a3c tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:43.782291 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0dde0ae9-6ee1-4d60-ac63-76f22fc15a3c tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:43.802372 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-0dde0ae9-6ee1-4d60-ac63-76f22fc15a3c tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] HTTP exception thrown: Instance e1f1a2d9-92ff-4f2b-8f65-24cee7c6418d could not be found. Oct 08 21:09:43.804343 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-0dde0ae9-6ee1-4d60-ac63-76f22fc15a3c tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Request method failure captured: Oct 08 21:09:43.804343 ncdv-master-1 devstack@n-api.service[140492]: request: GET /compute/v2.1/servers/e1f1a2d9-92ff-4f2b-8f65-24cee7c6418d HTTP/1.1 Oct 08 21:09:43.804343 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:09:43.804343 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:09:43.804343 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:09:43.804343 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 21:09:43.804343 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:09:43.804343 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:09:43.804343 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:09:43.804343 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:09:43.804343 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeYsdf-NgsPUaUb78CUpk0vq18mlUqdb1er-CKgSGnwcxKYVDw5Br5ObGheB0PHKIrwGHgJ4op59IUcxCd3ChQqclxeYxKhK3ZwkXmw1AwIGXWjgktrsk6DH6ba1NMLmZ1pzBqcyvzB3CMIuC4HBXIHDILjU44EobGpdQQ8lNmKdDFM Oct 08 21:09:43.804343 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:09:43.804343 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:09:43.804343 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:09:43.804343 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:09:43.804343 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:09:43.804343 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:09:43.804343 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: e7ded993145b4eda9d6a33b994519012 Oct 08 21:09:43.804343 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-ServersTestJSON-68907085 Oct 08 21:09:43.804343 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:09:43.804343 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:09:43.804343 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/e7ded993145b4eda9d6a33b994519012"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e7ded993145b4eda9d6a33b994519012"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_e7ded993145b4eda9d6a33b994519012"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e7ded993145b4eda9d6a33b994519012"}]}] Oct 08 21:09:43.804343 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-ServersTestJSON-68907085 Oct 08 21:09:43.804343 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: e7ded993145b4eda9d6a33b994519012 Oct 08 21:09:43.804343 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-ServersTestJSON-68907085 Oct 08 21:09:43.804343 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-ServersTestJSON-68907085-project Oct 08 21:09:43.804343 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:09:43.804343 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:09:43.804343 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 06443b5728fb4d1e95d6245820e786bf Oct 08 21:09:43.804343 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-ServersTestJSON-68907085-project Oct 08 21:09:43.804343 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 21:09:43.804343 ncdv-master-1 devstack@n-api.service[140492]: exception: Instance e1f1a2d9-92ff-4f2b-8f65-24cee7c6418d could not be found. Oct 08 21:09:43.804343 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': 'e1f1a2d9-92ff-4f2b-8f65-24cee7c6418d'} Oct 08 21:09:43.804343 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:09:43.804343 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:09:43.804343 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:09:43.804343 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:09:43.804343 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:09:43.804343 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:09:43.804343 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:09:43.804343 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:09:43.804343 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:09:43.804343 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:09:43.804343 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1f1a2d9-92ff-4f2b-8f65-24cee7c6418d could not be found. Oct 08 21:09:43.804343 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:09:43.804343 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:09:43.804343 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:09:43.804343 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:09:43.804343 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:09:43.804343 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:09:43.804343 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:09:43.804343 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:09:43.804343 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:09:43.804343 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:09:43.804343 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:09:43.804343 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:09:43.804343 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:09:43.804343 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:09:43.804343 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:09:43.804343 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:09:43.804343 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1f1a2d9-92ff-4f2b-8f65-24cee7c6418d could not be found. Oct 08 21:09:43.804343 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:09:43.804343 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:09:43.804343 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:09:43.804343 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:09:43.809982 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:09:43.809982 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:09:43.809982 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:09:43.809982 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:09:43.809982 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1f1a2d9-92ff-4f2b-8f65-24cee7c6418d could not be found. Oct 08 21:09:43.809982 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:09:43.809982 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-0dde0ae9-6ee1-4d60-ac63-76f22fc15a3c tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Returning 404 to user: Instance e1f1a2d9-92ff-4f2b-8f65-24cee7c6418d could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:09:43.809982 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-0dde0ae9-6ee1-4d60-ac63-76f22fc15a3c tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "GET /compute/v2.1/servers/e1f1a2d9-92ff-4f2b-8f65-24cee7c6418d" status: 404 len: 111 microversion: 2.1 time: 0.051564 Oct 08 21:09:43.812050 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2168/4241] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:43 2022] GET /compute/v2.1/servers/e1f1a2d9-92ff-4f2b-8f65-24cee7c6418d => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:09:43.834065 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-193f20ce-6dcf-48e5-ac3b-9bd73a813a2d tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:43.836881 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-193f20ce-6dcf-48e5-ac3b-9bd73a813a2d tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: ba7e1478-4f49-4350-9ea9-06e23eb05c63] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:43.855079 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:09:43.856604 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-193f20ce-6dcf-48e5-ac3b-9bd73a813a2d tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] HTTP exception thrown: Instance ba7e1478-4f49-4350-9ea9-06e23eb05c63 could not be found. Oct 08 21:09:43.862568 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-193f20ce-6dcf-48e5-ac3b-9bd73a813a2d tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Request method failure captured: Oct 08 21:09:43.862568 ncdv-master-1 devstack@n-api.service[140492]: request: DELETE /compute/v2.1/servers/ba7e1478-4f49-4350-9ea9-06e23eb05c63 HTTP/1.1 Oct 08 21:09:43.862568 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:09:43.862568 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:09:43.862568 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:09:43.862568 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 21:09:43.862568 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:09:43.862568 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:09:43.862568 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:09:43.862568 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:09:43.862568 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeYsdf-NgsPUaUb78CUpk0vq18mlUqdb1er-CKgSGnwcxKYVDw5Br5ObGheB0PHKIrwGHgJ4op59IUcxCd3ChQqclxeYxKhK3ZwkXmw1AwIGXWjgktrsk6DH6ba1NMLmZ1pzBqcyvzB3CMIuC4HBXIHDILjU44EobGpdQQ8lNmKdDFM Oct 08 21:09:43.862568 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:09:43.862568 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:09:43.862568 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:09:43.862568 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:09:43.862568 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:09:43.862568 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:09:43.862568 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: e7ded993145b4eda9d6a33b994519012 Oct 08 21:09:43.862568 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-ServersTestJSON-68907085 Oct 08 21:09:43.862568 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:09:43.862568 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:09:43.862568 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/e7ded993145b4eda9d6a33b994519012"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e7ded993145b4eda9d6a33b994519012"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_e7ded993145b4eda9d6a33b994519012"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e7ded993145b4eda9d6a33b994519012"}]}] Oct 08 21:09:43.862568 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-ServersTestJSON-68907085 Oct 08 21:09:43.862568 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: e7ded993145b4eda9d6a33b994519012 Oct 08 21:09:43.862568 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-ServersTestJSON-68907085 Oct 08 21:09:43.862568 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-ServersTestJSON-68907085-project Oct 08 21:09:43.862568 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:09:43.862568 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:09:43.862568 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 06443b5728fb4d1e95d6245820e786bf Oct 08 21:09:43.862568 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-ServersTestJSON-68907085-project Oct 08 21:09:43.862568 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 21:09:43.862568 ncdv-master-1 devstack@n-api.service[140492]: exception: Instance ba7e1478-4f49-4350-9ea9-06e23eb05c63 could not be found. Oct 08 21:09:43.862568 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': 'ba7e1478-4f49-4350-9ea9-06e23eb05c63'} Oct 08 21:09:43.862568 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:09:43.862568 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:09:43.862568 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:09:43.862568 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:09:43.862568 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:09:43.862568 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:09:43.862568 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 08 21:09:43.862568 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 08 21:09:43.862568 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba7e1478-4f49-4350-9ea9-06e23eb05c63 could not be found. Oct 08 21:09:43.862568 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:09:43.862568 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:09:43.862568 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:09:43.862568 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:09:43.862568 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:09:43.862568 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:09:43.862568 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:09:43.862568 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:09:43.862568 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:09:43.862568 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:09:43.862568 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 08 21:09:43.862568 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 08 21:09:43.862568 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 08 21:09:43.862568 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 08 21:09:43.862568 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:09:43.862568 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:09:43.862568 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:09:43.862568 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:09:43.862568 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba7e1478-4f49-4350-9ea9-06e23eb05c63 could not be found. Oct 08 21:09:43.862568 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:09:43.862568 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:09:43.862568 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:09:43.868833 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:09:43.868833 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:09:43.868833 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:09:43.868833 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:09:43.868833 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:09:43.868833 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba7e1478-4f49-4350-9ea9-06e23eb05c63 could not be found. Oct 08 21:09:43.868833 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:09:43.868833 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-193f20ce-6dcf-48e5-ac3b-9bd73a813a2d tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Returning 404 to user: Instance ba7e1478-4f49-4350-9ea9-06e23eb05c63 could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:09:43.868833 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-193f20ce-6dcf-48e5-ac3b-9bd73a813a2d tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "DELETE /compute/v2.1/servers/ba7e1478-4f49-4350-9ea9-06e23eb05c63" status: 404 len: 111 microversion: 2.1 time: 0.051260 Oct 08 21:09:43.868833 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2169/4242] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:09:43 2022] DELETE /compute/v2.1/servers/ba7e1478-4f49-4350-9ea9-06e23eb05c63 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:09:43.883732 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-1c30d8ad-fc8a-4b35-bc0f-ff758168f21c tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:43.884769 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-1c30d8ad-fc8a-4b35-bc0f-ff758168f21c tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: ba7e1478-4f49-4350-9ea9-06e23eb05c63] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:43.904952 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-1c30d8ad-fc8a-4b35-bc0f-ff758168f21c tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] HTTP exception thrown: Instance ba7e1478-4f49-4350-9ea9-06e23eb05c63 could not be found. Oct 08 21:09:43.906925 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-1c30d8ad-fc8a-4b35-bc0f-ff758168f21c tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Request method failure captured: Oct 08 21:09:43.906925 ncdv-master-1 devstack@n-api.service[140492]: request: GET /compute/v2.1/servers/ba7e1478-4f49-4350-9ea9-06e23eb05c63 HTTP/1.1 Oct 08 21:09:43.906925 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:09:43.906925 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:09:43.906925 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:09:43.906925 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 21:09:43.906925 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:09:43.906925 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:09:43.906925 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:09:43.906925 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:09:43.906925 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeYsdf-NgsPUaUb78CUpk0vq18mlUqdb1er-CKgSGnwcxKYVDw5Br5ObGheB0PHKIrwGHgJ4op59IUcxCd3ChQqclxeYxKhK3ZwkXmw1AwIGXWjgktrsk6DH6ba1NMLmZ1pzBqcyvzB3CMIuC4HBXIHDILjU44EobGpdQQ8lNmKdDFM Oct 08 21:09:43.906925 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:09:43.906925 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:09:43.906925 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:09:43.906925 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:09:43.906925 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:09:43.906925 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:09:43.906925 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: e7ded993145b4eda9d6a33b994519012 Oct 08 21:09:43.906925 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-ServersTestJSON-68907085 Oct 08 21:09:43.906925 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:09:43.906925 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:09:43.906925 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/e7ded993145b4eda9d6a33b994519012"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e7ded993145b4eda9d6a33b994519012"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_e7ded993145b4eda9d6a33b994519012"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e7ded993145b4eda9d6a33b994519012"}]}] Oct 08 21:09:43.906925 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-ServersTestJSON-68907085 Oct 08 21:09:43.906925 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: e7ded993145b4eda9d6a33b994519012 Oct 08 21:09:43.906925 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-ServersTestJSON-68907085 Oct 08 21:09:43.906925 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-ServersTestJSON-68907085-project Oct 08 21:09:43.906925 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:09:43.906925 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:09:43.906925 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 06443b5728fb4d1e95d6245820e786bf Oct 08 21:09:43.906925 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-ServersTestJSON-68907085-project Oct 08 21:09:43.906925 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 21:09:43.906925 ncdv-master-1 devstack@n-api.service[140492]: exception: Instance ba7e1478-4f49-4350-9ea9-06e23eb05c63 could not be found. Oct 08 21:09:43.906925 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': 'ba7e1478-4f49-4350-9ea9-06e23eb05c63'} Oct 08 21:09:43.906925 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:09:43.906925 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:09:43.906925 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:09:43.906925 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:09:43.906925 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:09:43.906925 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:09:43.906925 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 08 21:09:43.906925 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 08 21:09:43.906925 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba7e1478-4f49-4350-9ea9-06e23eb05c63 could not be found. Oct 08 21:09:43.906925 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:09:43.906925 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:09:43.906925 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:09:43.906925 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:09:43.906925 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:09:43.906925 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:09:43.906925 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:09:43.906925 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:09:43.906925 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:09:43.906925 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:09:43.906925 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:09:43.906925 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:09:43.906925 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:09:43.906925 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:09:43.906925 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:09:43.906925 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:09:43.906925 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba7e1478-4f49-4350-9ea9-06e23eb05c63 could not be found. Oct 08 21:09:43.906925 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:09:43.906925 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:09:43.906925 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:09:43.906925 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:09:43.906925 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:09:43.906925 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:09:43.911981 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:09:43.911981 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:09:43.911981 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba7e1478-4f49-4350-9ea9-06e23eb05c63 could not be found. Oct 08 21:09:43.911981 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:09:43.911981 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-1c30d8ad-fc8a-4b35-bc0f-ff758168f21c tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Returning 404 to user: Instance ba7e1478-4f49-4350-9ea9-06e23eb05c63 could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:09:43.913870 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-1c30d8ad-fc8a-4b35-bc0f-ff758168f21c tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "GET /compute/v2.1/servers/ba7e1478-4f49-4350-9ea9-06e23eb05c63" status: 404 len: 111 microversion: 2.1 time: 0.042671 Oct 08 21:09:43.915619 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2170/4243] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:43 2022] GET /compute/v2.1/servers/ba7e1478-4f49-4350-9ea9-06e23eb05c63 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:09:43.934685 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-60c762b1-2441-4602-b806-378c519ed88c tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:43.949200 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-446f3df3-2b17-4dba-bed5-0e1f4e78bbab tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:43.951105 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-446f3df3-2b17-4dba-bed5-0e1f4e78bbab tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: edd393b3-ce87-41a9-a9c4-f3ad6a6f0130] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:43.953778 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-60c762b1-2441-4602-b806-378c519ed88c tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 200 len: 1503 microversion: 2.1 time: 0.300954 Oct 08 21:09:43.954430 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2074/4244] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:43 2022] GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 1503 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:09:43.961607 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-446f3df3-2b17-4dba-bed5-0e1f4e78bbab tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:43.963870 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-446f3df3-2b17-4dba-bed5-0e1f4e78bbab tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:43.964556 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-446f3df3-2b17-4dba-bed5-0e1f4e78bbab tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:43.965634 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-446f3df3-2b17-4dba-bed5-0e1f4e78bbab tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:43.966307 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-446f3df3-2b17-4dba-bed5-0e1f4e78bbab tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:43.966998 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-446f3df3-2b17-4dba-bed5-0e1f4e78bbab tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:43.979645 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-fd9f3a2e-43b1-43ec-a4f9-5b86f57b5829 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:09:43.982771 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-fd9f3a2e-43b1-43ec-a4f9-5b86f57b5829 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: f40e76d4-be48-4be7-be3d-113cf8ef03bf] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:43.990721 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-fd9f3a2e-43b1-43ec-a4f9-5b86f57b5829 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] HTTP exception thrown: Instance f40e76d4-be48-4be7-be3d-113cf8ef03bf could not be found. Oct 08 21:09:43.994203 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-fd9f3a2e-43b1-43ec-a4f9-5b86f57b5829 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Request method failure captured: Oct 08 21:09:43.994203 ncdv-master-1 devstack@n-api.service[140491]: request: POST /compute/v2.1/servers/f40e76d4-be48-4be7-be3d-113cf8ef03bf/action HTTP/1.1 Oct 08 21:09:43.994203 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:09:43.994203 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:09:43.994203 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:09:43.994203 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 39 Oct 08 21:09:43.994203 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:09:43.994203 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:09:43.994203 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:09:43.994203 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:09:43.994203 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQebW09Z3m936-d3SrnQA9UQ3KXQvUYeQwL43ufWdoxmQhUwYBWv-JT053t_VYPo9wAVRoCqYQy8Hhh8zc2n570KpS0qNVLik822FjYabkSIZMA_ubWypXzSwo3J04zV1MoSSz79D-b8-ZvwYCEIbwpbfyn5opgOjnO6EXvq1UNPaSyQ Oct 08 21:09:43.994203 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:09:43.994203 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:09:43.994203 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:09:43.994203 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:09:43.994203 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:09:43.994203 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:09:43.994203 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 0ae02675057e4f27bc1980348afc8ca1 Oct 08 21:09:43.994203 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-ServersNegativeTestJSON-1441071354 Oct 08 21:09:43.994203 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:09:43.994203 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:09:43.994203 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0ae02675057e4f27bc1980348afc8ca1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0ae02675057e4f27bc1980348afc8ca1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0ae02675057e4f27bc1980348afc8ca1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0ae02675057e4f27bc1980348afc8ca1"}]}] Oct 08 21:09:43.994203 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-ServersNegativeTestJSON-1441071354 Oct 08 21:09:43.994203 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 0ae02675057e4f27bc1980348afc8ca1 Oct 08 21:09:43.994203 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1441071354 Oct 08 21:09:43.994203 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-ServersNegativeTestJSON-1441071354-project Oct 08 21:09:43.994203 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:09:43.994203 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:09:43.994203 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 6a78d352c143483c8e4702d789d4c516 Oct 08 21:09:43.994203 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-ServersNegativeTestJSON-1441071354-project Oct 08 21:09:43.994203 ncdv-master-1 devstack@n-api.service[140491]: Oct 08 21:09:43.994203 ncdv-master-1 devstack@n-api.service[140491]: {"os-getConsoleOutput": {"length": 10}} Oct 08 21:09:43.994203 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:09:43.994203 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance f40e76d4-be48-4be7-be3d-113cf8ef03bf could not be found. Oct 08 21:09:43.994203 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': 'f40e76d4-be48-4be7-be3d-113cf8ef03bf', 'body': {'os-getConsoleOutput': {'length': 10}}} Oct 08 21:09:43.994203 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:09:43.994203 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:09:43.994203 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:09:43.994203 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:09:43.994203 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:09:43.994203 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:09:43.994203 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 08 21:09:43.994203 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 08 21:09:43.994203 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f40e76d4-be48-4be7-be3d-113cf8ef03bf could not be found. Oct 08 21:09:43.994203 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:09:43.994203 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:09:43.994203 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:09:43.994203 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:09:43.994203 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:09:43.994203 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:09:43.994203 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:09:43.994203 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:09:43.994203 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:09:43.994203 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:09:43.994203 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 21:09:43.994203 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 21:09:43.994203 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Oct 08 21:09:43.994203 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 08 21:09:43.994203 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:09:43.994203 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:09:43.994203 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f40e76d4-be48-4be7-be3d-113cf8ef03bf could not be found. Oct 08 21:09:43.994203 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:09:43.994203 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:09:43.994203 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:09:43.994203 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:09:44.003262 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:09:44.003262 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:09:44.003262 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:09:44.003262 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:09:44.003262 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f40e76d4-be48-4be7-be3d-113cf8ef03bf could not be found. Oct 08 21:09:44.003262 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:09:44.003262 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-fd9f3a2e-43b1-43ec-a4f9-5b86f57b5829 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Returning 404 to user: Instance f40e76d4-be48-4be7-be3d-113cf8ef03bf could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:09:44.003262 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-fd9f3a2e-43b1-43ec-a4f9-5b86f57b5829 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "POST /compute/v2.1/servers/f40e76d4-be48-4be7-be3d-113cf8ef03bf/action" status: 404 len: 111 microversion: 2.1 time: 0.023476 Oct 08 21:09:44.003262 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2075/4245] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:09:43 2022] POST /compute/v2.1/servers/f40e76d4-be48-4be7-be3d-113cf8ef03bf/action => generated 111 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:09:44.005478 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-fc58ba20-cc26-4394-b246-49ee8b3d084d tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:44.006299 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-fc58ba20-cc26-4394-b246-49ee8b3d084d tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: ba5cd412-0d20-4d2e-9f5e-de18f268008a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:44.016259 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fc58ba20-cc26-4394-b246-49ee8b3d084d tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:44.017227 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fc58ba20-cc26-4394-b246-49ee8b3d084d tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:44.017926 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fc58ba20-cc26-4394-b246-49ee8b3d084d tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:44.019231 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fc58ba20-cc26-4394-b246-49ee8b3d084d tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:44.019823 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-446f3df3-2b17-4dba-bed5-0e1f4e78bbab tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: edd393b3-ce87-41a9-a9c4-f3ad6a6f0130] Going to try to terminate instance {{(pid=140492) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 21:09:44.020173 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fc58ba20-cc26-4394-b246-49ee8b3d084d tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:44.020877 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fc58ba20-cc26-4394-b246-49ee8b3d084d tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:44.094331 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:09:44.164078 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-446f3df3-2b17-4dba-bed5-0e1f4e78bbab tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "DELETE /compute/v2.1/servers/edd393b3-ce87-41a9-a9c4-f3ad6a6f0130" status: 204 len: 0 microversion: 2.1 time: 0.241499 Oct 08 21:09:44.171014 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2171/4246] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:09:43 2022] DELETE /compute/v2.1/servers/edd393b3-ce87-41a9-a9c4-f3ad6a6f0130 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 21:09:44.183337 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-9882d7ef-9c81-4b24-b295-d8296d7c55c5 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:44.185092 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-9882d7ef-9c81-4b24-b295-d8296d7c55c5 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:44.205224 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9882d7ef-9c81-4b24-b295-d8296d7c55c5 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:44.205934 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9882d7ef-9c81-4b24-b295-d8296d7c55c5 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:44.207401 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9882d7ef-9c81-4b24-b295-d8296d7c55c5 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:44.210385 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9882d7ef-9c81-4b24-b295-d8296d7c55c5 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:44.211518 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9882d7ef-9c81-4b24-b295-d8296d7c55c5 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:44.212497 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9882d7ef-9c81-4b24-b295-d8296d7c55c5 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:44.286342 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-fc58ba20-cc26-4394-b246-49ee8b3d084d tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78e9afd772c4de981cac8f5817ec356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765c62cac2ee4406b23a5baa85c52ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:44.297658 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-fc58ba20-cc26-4394-b246-49ee8b3d084d tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/ba5cd412-0d20-4d2e-9f5e-de18f268008a" status: 200 len: 1506 microversion: 2.1 time: 0.297210 Oct 08 21:09:44.299207 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2076/4247] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:43 2022] GET /compute/v2.1/servers/ba5cd412-0d20-4d2e-9f5e-de18f268008a => generated 1506 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:09:44.305163 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-4fffc70a-b57b-4403-88dd-eb8275852317 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:44.306723 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-4fffc70a-b57b-4403-88dd-eb8275852317 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: edd393b3-ce87-41a9-a9c4-f3ad6a6f0130] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:44.323738 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4fffc70a-b57b-4403-88dd-eb8275852317 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:44.324332 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4fffc70a-b57b-4403-88dd-eb8275852317 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:44.325427 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4fffc70a-b57b-4403-88dd-eb8275852317 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:44.326451 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4fffc70a-b57b-4403-88dd-eb8275852317 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:44.327087 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4fffc70a-b57b-4403-88dd-eb8275852317 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:44.339390 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4fffc70a-b57b-4403-88dd-eb8275852317 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:44.562089 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-9882d7ef-9c81-4b24-b295-d8296d7c55c5 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:44.576737 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-9882d7ef-9c81-4b24-b295-d8296d7c55c5 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 200 len: 1503 microversion: 2.1 time: 0.403226 Oct 08 21:09:44.577426 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2172/4248] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:44 2022] GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 1503 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:09:44.609419 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-72c5bc1f-9392-482b-adb7-8f4f59a3b00c tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:44.610102 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-72c5bc1f-9392-482b-adb7-8f4f59a3b00c tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:44.625663 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-72c5bc1f-9392-482b-adb7-8f4f59a3b00c tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:44.628761 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-72c5bc1f-9392-482b-adb7-8f4f59a3b00c tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:44.631685 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-72c5bc1f-9392-482b-adb7-8f4f59a3b00c tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:44.635919 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-72c5bc1f-9392-482b-adb7-8f4f59a3b00c tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:44.637238 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-72c5bc1f-9392-482b-adb7-8f4f59a3b00c tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:44.640508 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-72c5bc1f-9392-482b-adb7-8f4f59a3b00c tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:44.779479 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=2 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:09:44.957094 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-72c5bc1f-9392-482b-adb7-8f4f59a3b00c tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:44.972815 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-72c5bc1f-9392-482b-adb7-8f4f59a3b00c tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 200 len: 1503 microversion: 2.1 time: 0.367525 Oct 08 21:09:44.975638 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2173/4249] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:44 2022] GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 1503 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:09:44.989784 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e64430b7-d086-439a-ae00-6bc23d3e2f32 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:44.990505 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-e64430b7-d086-439a-ae00-6bc23d3e2f32 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] [instance: 3fed4df9-92ff-4040-8fa7-db370960dc06] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:45.008098 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e64430b7-d086-439a-ae00-6bc23d3e2f32 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:45.009087 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e64430b7-d086-439a-ae00-6bc23d3e2f32 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:45.009584 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e64430b7-d086-439a-ae00-6bc23d3e2f32 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:45.010350 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e64430b7-d086-439a-ae00-6bc23d3e2f32 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:45.010834 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e64430b7-d086-439a-ae00-6bc23d3e2f32 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:45.011287 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e64430b7-d086-439a-ae00-6bc23d3e2f32 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:45.029483 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-4fffc70a-b57b-4403-88dd-eb8275852317 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06443b5728fb4d1e95d6245820e786bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ded993145b4eda9d6a33b994519012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:45.038055 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-4fffc70a-b57b-4403-88dd-eb8275852317 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "GET /compute/v2.1/servers/edd393b3-ce87-41a9-a9c4-f3ad6a6f0130" status: 200 len: 1480 microversion: 2.1 time: 0.737605 Oct 08 21:09:45.046372 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2077/4250] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:44 2022] GET /compute/v2.1/servers/edd393b3-ce87-41a9-a9c4-f3ad6a6f0130 => generated 1480 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:09:45.051530 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-324295c0-b598-49ee-9963-7f1c796a96ce tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:45.055967 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-324295c0-b598-49ee-9963-7f1c796a96ce tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] [instance: 159e29dd-802c-4059-99f9-bb7c113d430b] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:45.068230 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-324295c0-b598-49ee-9963-7f1c796a96ce tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:45.069011 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-324295c0-b598-49ee-9963-7f1c796a96ce tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:45.071914 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-324295c0-b598-49ee-9963-7f1c796a96ce tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:45.072852 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-324295c0-b598-49ee-9963-7f1c796a96ce tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:45.075752 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-324295c0-b598-49ee-9963-7f1c796a96ce tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:45.076418 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-324295c0-b598-49ee-9963-7f1c796a96ce tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:45.290674 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-e64430b7-d086-439a-ae00-6bc23d3e2f32 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30fe0e1ffa1040ec85d3c32d8b741c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd0e7c24154409824f96e9e99da357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:45.299902 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-e64430b7-d086-439a-ae00-6bc23d3e2f32 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "GET /compute/v2.1/servers/3fed4df9-92ff-4040-8fa7-db370960dc06" status: 200 len: 1308 microversion: 2.1 time: 0.322778 Oct 08 21:09:45.305600 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2174/4251] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:44 2022] GET /compute/v2.1/servers/3fed4df9-92ff-4040-8fa7-db370960dc06 => generated 1308 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:09:45.315262 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-47339aff-0e0e-4998-ada2-0a6153cc1205 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:45.317484 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-47339aff-0e0e-4998-ada2-0a6153cc1205 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: d7da1ae3-37ed-4f84-8d69-00e45b676773] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:45.331816 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-47339aff-0e0e-4998-ada2-0a6153cc1205 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] HTTP exception thrown: Instance d7da1ae3-37ed-4f84-8d69-00e45b676773 could not be found. Oct 08 21:09:45.337696 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-47339aff-0e0e-4998-ada2-0a6153cc1205 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Request method failure captured: Oct 08 21:09:45.337696 ncdv-master-1 devstack@n-api.service[140492]: request: GET /compute/v2.1/servers/d7da1ae3-37ed-4f84-8d69-00e45b676773 HTTP/1.1 Oct 08 21:09:45.337696 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:09:45.337696 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:09:45.337696 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:09:45.337696 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 21:09:45.337696 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:09:45.337696 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:09:45.337696 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:09:45.337696 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:09:45.337696 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQebW09Z3m936-d3SrnQA9UQ3KXQvUYeQwL43ufWdoxmQhUwYBWv-JT053t_VYPo9wAVRoCqYQy8Hhh8zc2n570KpS0qNVLik822FjYabkSIZMA_ubWypXzSwo3J04zV1MoSSz79D-b8-ZvwYCEIbwpbfyn5opgOjnO6EXvq1UNPaSyQ Oct 08 21:09:45.337696 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:09:45.337696 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:09:45.337696 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:09:45.337696 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:09:45.337696 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:09:45.337696 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:09:45.337696 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 0ae02675057e4f27bc1980348afc8ca1 Oct 08 21:09:45.337696 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-ServersNegativeTestJSON-1441071354 Oct 08 21:09:45.337696 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:09:45.337696 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:09:45.337696 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0ae02675057e4f27bc1980348afc8ca1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0ae02675057e4f27bc1980348afc8ca1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0ae02675057e4f27bc1980348afc8ca1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0ae02675057e4f27bc1980348afc8ca1"}]}] Oct 08 21:09:45.337696 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-ServersNegativeTestJSON-1441071354 Oct 08 21:09:45.337696 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 0ae02675057e4f27bc1980348afc8ca1 Oct 08 21:09:45.337696 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1441071354 Oct 08 21:09:45.337696 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-ServersNegativeTestJSON-1441071354-project Oct 08 21:09:45.337696 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:09:45.337696 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:09:45.337696 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 6a78d352c143483c8e4702d789d4c516 Oct 08 21:09:45.337696 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-ServersNegativeTestJSON-1441071354-project Oct 08 21:09:45.337696 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 21:09:45.337696 ncdv-master-1 devstack@n-api.service[140492]: exception: Instance d7da1ae3-37ed-4f84-8d69-00e45b676773 could not be found. Oct 08 21:09:45.337696 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': 'd7da1ae3-37ed-4f84-8d69-00e45b676773'} Oct 08 21:09:45.337696 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:09:45.337696 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:09:45.337696 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:09:45.337696 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:09:45.337696 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:09:45.337696 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:09:45.337696 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 08 21:09:45.337696 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 08 21:09:45.337696 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7da1ae3-37ed-4f84-8d69-00e45b676773 could not be found. Oct 08 21:09:45.337696 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:09:45.337696 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:09:45.337696 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:09:45.337696 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:09:45.337696 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:09:45.337696 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:09:45.337696 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:09:45.337696 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:09:45.337696 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:09:45.337696 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:09:45.337696 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:09:45.337696 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:09:45.337696 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:09:45.337696 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:09:45.337696 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:09:45.337696 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:09:45.337696 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7da1ae3-37ed-4f84-8d69-00e45b676773 could not be found. Oct 08 21:09:45.337696 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:09:45.337696 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:09:45.337696 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:09:45.337696 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:09:45.337696 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:09:45.341348 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:09:45.341348 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:09:45.341348 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:09:45.341348 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7da1ae3-37ed-4f84-8d69-00e45b676773 could not be found. Oct 08 21:09:45.341348 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:09:45.344105 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-47339aff-0e0e-4998-ada2-0a6153cc1205 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Returning 404 to user: Instance d7da1ae3-37ed-4f84-8d69-00e45b676773 could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:09:45.345302 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-47339aff-0e0e-4998-ada2-0a6153cc1205 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/d7da1ae3-37ed-4f84-8d69-00e45b676773" status: 404 len: 111 microversion: 2.1 time: 0.038417 Oct 08 21:09:45.346431 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2175/4252] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:45 2022] GET /compute/v2.1/servers/d7da1ae3-37ed-4f84-8d69-00e45b676773 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:09:45.364336 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-cea933f9-ae72-402c-873c-eeead9b90321 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:45.365430 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-cea933f9-ae72-402c-873c-eeead9b90321 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: ba5cd412-0d20-4d2e-9f5e-de18f268008a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:45.382686 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cea933f9-ae72-402c-873c-eeead9b90321 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:45.383573 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cea933f9-ae72-402c-873c-eeead9b90321 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:45.385140 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cea933f9-ae72-402c-873c-eeead9b90321 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:45.390712 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cea933f9-ae72-402c-873c-eeead9b90321 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:45.391673 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cea933f9-ae72-402c-873c-eeead9b90321 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:45.392330 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cea933f9-ae72-402c-873c-eeead9b90321 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:45.401674 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-324295c0-b598-49ee-9963-7f1c796a96ce tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:45.415116 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-324295c0-b598-49ee-9963-7f1c796a96ce tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:45.416855 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-324295c0-b598-49ee-9963-7f1c796a96ce tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:45.429458 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-324295c0-b598-49ee-9963-7f1c796a96ce tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] 10.222.0.26 "GET /compute/v2.1/servers/159e29dd-802c-4059-99f9-bb7c113d430b" status: 200 len: 1738 microversion: 2.20 time: 0.381642 Oct 08 21:09:45.451507 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2078/4253] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:09:45 2022] GET /compute/v2.1/servers/159e29dd-802c-4059-99f9-bb7c113d430b => generated 1738 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:09:45.457471 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-d22ef385-8361-440e-9e7d-ebdc12c9399c tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:45.458318 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-d22ef385-8361-440e-9e7d-ebdc12c9399c tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:45.465462 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d22ef385-8361-440e-9e7d-ebdc12c9399c tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:45.466155 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d22ef385-8361-440e-9e7d-ebdc12c9399c tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:45.466815 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d22ef385-8361-440e-9e7d-ebdc12c9399c tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:45.467736 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d22ef385-8361-440e-9e7d-ebdc12c9399c tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:45.468373 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d22ef385-8361-440e-9e7d-ebdc12c9399c tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:45.469022 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d22ef385-8361-440e-9e7d-ebdc12c9399c tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:45.564278 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=8 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:09:45.694065 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-cea933f9-ae72-402c-873c-eeead9b90321 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78e9afd772c4de981cac8f5817ec356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765c62cac2ee4406b23a5baa85c52ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:45.718253 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-cea933f9-ae72-402c-873c-eeead9b90321 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/ba5cd412-0d20-4d2e-9f5e-de18f268008a" status: 200 len: 1506 microversion: 2.1 time: 0.370292 Oct 08 21:09:45.737529 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2176/4254] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:45 2022] GET /compute/v2.1/servers/ba5cd412-0d20-4d2e-9f5e-de18f268008a => generated 1506 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:09:45.939593 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-d22ef385-8361-440e-9e7d-ebdc12c9399c tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:45.952112 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-d22ef385-8361-440e-9e7d-ebdc12c9399c tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 200 len: 1503 microversion: 2.1 time: 0.499012 Oct 08 21:09:45.973454 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2079/4255] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:45 2022] GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 1503 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:09:45.989055 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-868b74c1-9d7e-41e0-978c-3b52304afa5d tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:45.989869 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-868b74c1-9d7e-41e0-978c-3b52304afa5d tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:46.006267 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-868b74c1-9d7e-41e0-978c-3b52304afa5d tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:46.011472 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-868b74c1-9d7e-41e0-978c-3b52304afa5d tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:46.015133 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-868b74c1-9d7e-41e0-978c-3b52304afa5d tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:46.016217 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-868b74c1-9d7e-41e0-978c-3b52304afa5d tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:46.020494 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-868b74c1-9d7e-41e0-978c-3b52304afa5d tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:46.023509 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-868b74c1-9d7e-41e0-978c-3b52304afa5d tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:46.079538 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-a5bf9ff7-7a7a-48dc-b3db-50ac22f58b20 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:46.080853 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-a5bf9ff7-7a7a-48dc-b3db-50ac22f58b20 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: edd393b3-ce87-41a9-a9c4-f3ad6a6f0130] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:46.092928 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a5bf9ff7-7a7a-48dc-b3db-50ac22f58b20 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:46.096131 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a5bf9ff7-7a7a-48dc-b3db-50ac22f58b20 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:46.096782 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a5bf9ff7-7a7a-48dc-b3db-50ac22f58b20 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:46.100083 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a5bf9ff7-7a7a-48dc-b3db-50ac22f58b20 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:46.100793 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a5bf9ff7-7a7a-48dc-b3db-50ac22f58b20 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:46.101879 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a5bf9ff7-7a7a-48dc-b3db-50ac22f58b20 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:46.361218 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-868b74c1-9d7e-41e0-978c-3b52304afa5d tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:46.372984 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-868b74c1-9d7e-41e0-978c-3b52304afa5d tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 200 len: 1503 microversion: 2.1 time: 0.389417 Oct 08 21:09:46.391014 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2177/4256] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:45 2022] GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 1503 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:09:46.404661 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-b1b2bdbb-2fa7-4c63-a61a-389f80655da7 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:46.405650 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-b1b2bdbb-2fa7-4c63-a61a-389f80655da7 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] [instance: 3fed4df9-92ff-4040-8fa7-db370960dc06] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:46.429217 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b1b2bdbb-2fa7-4c63-a61a-389f80655da7 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:46.429217 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b1b2bdbb-2fa7-4c63-a61a-389f80655da7 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:46.429217 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b1b2bdbb-2fa7-4c63-a61a-389f80655da7 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:46.429941 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b1b2bdbb-2fa7-4c63-a61a-389f80655da7 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:46.431024 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b1b2bdbb-2fa7-4c63-a61a-389f80655da7 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:46.442294 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b1b2bdbb-2fa7-4c63-a61a-389f80655da7 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:46.682241 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-a5bf9ff7-7a7a-48dc-b3db-50ac22f58b20 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06443b5728fb4d1e95d6245820e786bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7ded993145b4eda9d6a33b994519012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:46.691551 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-a5bf9ff7-7a7a-48dc-b3db-50ac22f58b20 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "GET /compute/v2.1/servers/edd393b3-ce87-41a9-a9c4-f3ad6a6f0130" status: 200 len: 1480 microversion: 2.1 time: 0.620105 Oct 08 21:09:46.696271 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2080/4257] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:46 2022] GET /compute/v2.1/servers/edd393b3-ce87-41a9-a9c4-f3ad6a6f0130 => generated 1480 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:09:46.706172 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-59c372d4-69ac-4ad1-bdb7-a93e0f55951e req-41fd3451-0248-45f2-96cc-476b1ecd62a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "159e29dd-802c-4059-99f9-bb7c113d430b", "name": "network-vif-plugged", "status": "completed", "tag": "59479dc9-06cf-4a86-bedc-3998868989c8"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:09:46.737903 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-59c372d4-69ac-4ad1-bdb7-a93e0f55951e req-41fd3451-0248-45f2-96cc-476b1ecd62a6 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:46.738690 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-59c372d4-69ac-4ad1-bdb7-a93e0f55951e req-41fd3451-0248-45f2-96cc-476b1ecd62a6 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:46.739306 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-59c372d4-69ac-4ad1-bdb7-a93e0f55951e req-41fd3451-0248-45f2-96cc-476b1ecd62a6 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:46.759900 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-59c372d4-69ac-4ad1-bdb7-a93e0f55951e req-41fd3451-0248-45f2-96cc-476b1ecd62a6 service nova] Creating event network-vif-plugged:59479dc9-06cf-4a86-bedc-3998868989c8 for instance 159e29dd-802c-4059-99f9-bb7c113d430b on nch2-master-1 Oct 08 21:09:46.782055 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-59c372d4-69ac-4ad1-bdb7-a93e0f55951e req-41fd3451-0248-45f2-96cc-476b1ecd62a6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080120 Oct 08 21:09:46.790618 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2081/4258] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:09:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:09:46.800618 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-00684d4d-c213-46e2-b575-7317bf11a187 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:46.803514 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-00684d4d-c213-46e2-b575-7317bf11a187 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] [instance: 159e29dd-802c-4059-99f9-bb7c113d430b] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:46.826786 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-b1b2bdbb-2fa7-4c63-a61a-389f80655da7 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30fe0e1ffa1040ec85d3c32d8b741c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd0e7c24154409824f96e9e99da357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:46.829768 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-00684d4d-c213-46e2-b575-7317bf11a187 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:46.832457 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-00684d4d-c213-46e2-b575-7317bf11a187 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:46.833456 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-00684d4d-c213-46e2-b575-7317bf11a187 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:46.835063 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-00684d4d-c213-46e2-b575-7317bf11a187 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:46.835916 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-00684d4d-c213-46e2-b575-7317bf11a187 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:46.838064 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-00684d4d-c213-46e2-b575-7317bf11a187 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:46.840285 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-b1b2bdbb-2fa7-4c63-a61a-389f80655da7 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "GET /compute/v2.1/servers/3fed4df9-92ff-4040-8fa7-db370960dc06" status: 200 len: 1308 microversion: 2.1 time: 0.443835 Oct 08 21:09:46.840923 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2178/4259] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:46 2022] GET /compute/v2.1/servers/3fed4df9-92ff-4040-8fa7-db370960dc06 => generated 1308 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:09:46.865554 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-380e3f88-80c0-4cc5-b276-e2ca434a7644 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1197144564", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "0af78ecb-f6e3-458a-ab57-630925a05ff0"}]}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:09:46.907282 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-380e3f88-80c0-4cc5-b276-e2ca434a7644 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Request method failure captured: Oct 08 21:09:46.907282 ncdv-master-1 devstack@n-api.service[140492]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 08 21:09:46.907282 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:09:46.907282 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:09:46.907282 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:09:46.907282 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 238 Oct 08 21:09:46.907282 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:09:46.907282 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:09:46.907282 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:09:46.907282 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:09:46.907282 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQebW09Z3m936-d3SrnQA9UQ3KXQvUYeQwL43ufWdoxmQhUwYBWv-JT053t_VYPo9wAVRoCqYQy8Hhh8zc2n570KpS0qNVLik822FjYabkSIZMA_ubWypXzSwo3J04zV1MoSSz79D-b8-ZvwYCEIbwpbfyn5opgOjnO6EXvq1UNPaSyQ Oct 08 21:09:46.907282 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:09:46.907282 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:09:46.907282 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:09:46.907282 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:09:46.907282 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:09:46.907282 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:09:46.907282 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 0ae02675057e4f27bc1980348afc8ca1 Oct 08 21:09:46.907282 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-ServersNegativeTestJSON-1441071354 Oct 08 21:09:46.907282 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:09:46.907282 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:09:46.907282 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0ae02675057e4f27bc1980348afc8ca1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0ae02675057e4f27bc1980348afc8ca1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0ae02675057e4f27bc1980348afc8ca1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0ae02675057e4f27bc1980348afc8ca1"}]}] Oct 08 21:09:46.907282 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-ServersNegativeTestJSON-1441071354 Oct 08 21:09:46.907282 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 0ae02675057e4f27bc1980348afc8ca1 Oct 08 21:09:46.907282 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1441071354 Oct 08 21:09:46.907282 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-ServersNegativeTestJSON-1441071354-project Oct 08 21:09:46.907282 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:09:46.907282 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:09:46.907282 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 6a78d352c143483c8e4702d789d4c516 Oct 08 21:09:46.907282 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-ServersNegativeTestJSON-1441071354-project Oct 08 21:09:46.907282 ncdv-master-1 devstack@n-api.service[140492]: Oct 08 21:09:46.907282 ncdv-master-1 devstack@n-api.service[140492]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1197144564", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "0af78ecb-f6e3-458a-ab57-630925a05ff0"}]}} Oct 08 21:09:46.907282 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 21:09:46.907282 ncdv-master-1 devstack@n-api.service[140492]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 08 21:09:46.907282 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1197144564', 'imageRef': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': '0af78ecb-f6e3-458a-ab57-630925a05ff0'}]}}} Oct 08 21:09:46.907282 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:09:46.907282 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:09:46.907282 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 08 21:09:46.907282 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 08 21:09:46.907282 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 253, in is_ipv4 Oct 08 21:09:46.907282 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return bool(ipaddress.IPv4Address(instance)) Oct 08 21:09:46.907282 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1257, in __init__ Oct 08 21:09:46.907282 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Oct 08 21:09:46.907282 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1144, in _ip_int_from_string Oct 08 21:09:46.907282 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise AddressValueError("Expected 4 octets in %r" % ip_str) Oct 08 21:09:46.907282 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: Expected 4 octets in '1.1.1.1.1.1' Oct 08 21:09:46.907282 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:09:46.907282 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 08 21:09:46.907282 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:09:46.907282 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:09:46.907282 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 08 21:09:46.907282 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 08 21:09:46.907282 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 08 21:09:46.907282 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise error Oct 08 21:09:46.907282 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Oct 08 21:09:46.907282 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:09:46.907282 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Oct 08 21:09:46.907282 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Oct 08 21:09:46.907282 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:09:46.907282 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 08 21:09:46.907282 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Oct 08 21:09:46.907282 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:09:46.907282 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:09:46.907282 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:09:46.907282 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:09:46.913079 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:09:46.913079 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:09:46.913079 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:09:46.913079 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:09:46.913079 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:09:46.913079 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:09:46.913079 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 21:09:46.913079 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 21:09:46.913079 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 08 21:09:46.913079 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 08 21:09:46.913079 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 08 21:09:46.913079 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 08 21:09:46.913079 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 08 21:09:46.913079 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 08 21:09:46.913079 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 08 21:09:46.913079 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:09:46.913079 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:09:46.913079 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:09:46.913079 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:09:46.913079 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:09:46.913079 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:09:46.913079 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 08 21:09:46.913079 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 08 21:09:46.913079 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 08 21:09:46.913079 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:09:46.913079 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-380e3f88-80c0-4cc5-b276-e2ca434a7644 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:09:46.916306 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-380e3f88-80c0-4cc5-b276-e2ca434a7644 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.069039 Oct 08 21:09:46.923783 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2179/4260] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 21:09:46 2022] POST /compute/v2.1/servers => generated 139 bytes in 82 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 08 21:09:46.945406 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-7af4a879-cb33-4714-8e57-ec808371ae35 req-d0d58e2e-8fdd-40ca-8719-67522121bbd8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edd393b3-ce87-41a9-a9c4-f3ad6a6f0130", "name": "network-vif-deleted", "tag": "b640a121-8510-4189-8a0e-189da869d29e"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:09:46.991099 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-7af4a879-cb33-4714-8e57-ec808371ae35 req-d0d58e2e-8fdd-40ca-8719-67522121bbd8 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:46.993138 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-7af4a879-cb33-4714-8e57-ec808371ae35 req-d0d58e2e-8fdd-40ca-8719-67522121bbd8 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:46.993901 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-7af4a879-cb33-4714-8e57-ec808371ae35 req-d0d58e2e-8fdd-40ca-8719-67522121bbd8 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:47.011772 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-7af4a879-cb33-4714-8e57-ec808371ae35 req-d0d58e2e-8fdd-40ca-8719-67522121bbd8 service nova] Creating event network-vif-deleted:b640a121-8510-4189-8a0e-189da869d29e for instance edd393b3-ce87-41a9-a9c4-f3ad6a6f0130 on nch2-master-1 Oct 08 21:09:47.018088 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-7af4a879-cb33-4714-8e57-ec808371ae35 req-d0d58e2e-8fdd-40ca-8719-67522121bbd8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092580 Oct 08 21:09:47.020754 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2180/4261] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:09:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:09:47.029942 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-704b7048-e09c-45fb-bf00-9ffcac9c2715 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:47.031326 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-704b7048-e09c-45fb-bf00-9ffcac9c2715 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: ba5cd412-0d20-4d2e-9f5e-de18f268008a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:47.038787 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-704b7048-e09c-45fb-bf00-9ffcac9c2715 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:47.039979 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-704b7048-e09c-45fb-bf00-9ffcac9c2715 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:47.040665 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-704b7048-e09c-45fb-bf00-9ffcac9c2715 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:47.041942 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-704b7048-e09c-45fb-bf00-9ffcac9c2715 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:47.043297 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-704b7048-e09c-45fb-bf00-9ffcac9c2715 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:47.044272 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-704b7048-e09c-45fb-bf00-9ffcac9c2715 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:47.281066 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-00684d4d-c213-46e2-b575-7317bf11a187 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:47.299177 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-00684d4d-c213-46e2-b575-7317bf11a187 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:47.301889 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-00684d4d-c213-46e2-b575-7317bf11a187 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:47.303129 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-00684d4d-c213-46e2-b575-7317bf11a187 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] 10.222.0.26 "GET /compute/v2.1/servers/159e29dd-802c-4059-99f9-bb7c113d430b" status: 200 len: 1738 microversion: 2.20 time: 0.510819 Oct 08 21:09:47.314400 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2082/4262] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:09:46 2022] GET /compute/v2.1/servers/159e29dd-802c-4059-99f9-bb7c113d430b => generated 1738 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:09:47.314400 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-096d234b-314e-4abc-84a1-7c3ca33e75fb tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:47.314400 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-096d234b-314e-4abc-84a1-7c3ca33e75fb tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:47.333209 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-096d234b-314e-4abc-84a1-7c3ca33e75fb tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:47.333935 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-096d234b-314e-4abc-84a1-7c3ca33e75fb tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:47.337302 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-096d234b-314e-4abc-84a1-7c3ca33e75fb tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:47.337302 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-096d234b-314e-4abc-84a1-7c3ca33e75fb tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:47.337302 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-096d234b-314e-4abc-84a1-7c3ca33e75fb tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:47.337665 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-096d234b-314e-4abc-84a1-7c3ca33e75fb tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:47.504850 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-704b7048-e09c-45fb-bf00-9ffcac9c2715 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78e9afd772c4de981cac8f5817ec356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765c62cac2ee4406b23a5baa85c52ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:47.521977 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-704b7048-e09c-45fb-bf00-9ffcac9c2715 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/ba5cd412-0d20-4d2e-9f5e-de18f268008a" status: 200 len: 1506 microversion: 2.1 time: 0.498433 Oct 08 21:09:47.526022 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2181/4263] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:47 2022] GET /compute/v2.1/servers/ba5cd412-0d20-4d2e-9f5e-de18f268008a => generated 1506 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:09:47.563210 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-096d234b-314e-4abc-84a1-7c3ca33e75fb tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:47.584697 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-096d234b-314e-4abc-84a1-7c3ca33e75fb tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 200 len: 1503 microversion: 2.1 time: 0.278670 Oct 08 21:09:47.589134 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2083/4264] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:47 2022] GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 1503 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:09:47.618749 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-5c7bd990-599b-4e25-ae07-078f5b0139a6 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:47.619848 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-5c7bd990-599b-4e25-ae07-078f5b0139a6 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:47.630200 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5c7bd990-599b-4e25-ae07-078f5b0139a6 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:47.632255 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5c7bd990-599b-4e25-ae07-078f5b0139a6 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:47.633159 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5c7bd990-599b-4e25-ae07-078f5b0139a6 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:47.639661 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5c7bd990-599b-4e25-ae07-078f5b0139a6 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:47.640216 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5c7bd990-599b-4e25-ae07-078f5b0139a6 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:47.640901 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5c7bd990-599b-4e25-ae07-078f5b0139a6 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:47.721074 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-d1dbd8ef-7049-41b5-a617-22d674aa81e9 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:47.722102 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-d1dbd8ef-7049-41b5-a617-22d674aa81e9 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] [instance: edd393b3-ce87-41a9-a9c4-f3ad6a6f0130] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:47.733788 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d1dbd8ef-7049-41b5-a617-22d674aa81e9 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:47.734298 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d1dbd8ef-7049-41b5-a617-22d674aa81e9 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:47.734973 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d1dbd8ef-7049-41b5-a617-22d674aa81e9 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:47.735835 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d1dbd8ef-7049-41b5-a617-22d674aa81e9 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:47.736694 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d1dbd8ef-7049-41b5-a617-22d674aa81e9 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:47.737376 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d1dbd8ef-7049-41b5-a617-22d674aa81e9 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:47.759581 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-d1dbd8ef-7049-41b5-a617-22d674aa81e9 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] HTTP exception thrown: Instance edd393b3-ce87-41a9-a9c4-f3ad6a6f0130 could not be found. Oct 08 21:09:47.761842 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-d1dbd8ef-7049-41b5-a617-22d674aa81e9 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Request method failure captured: Oct 08 21:09:47.761842 ncdv-master-1 devstack@n-api.service[140491]: request: GET /compute/v2.1/servers/edd393b3-ce87-41a9-a9c4-f3ad6a6f0130 HTTP/1.1 Oct 08 21:09:47.761842 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:09:47.761842 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:09:47.761842 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:09:47.761842 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 21:09:47.761842 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:09:47.761842 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:09:47.761842 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:09:47.761842 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:09:47.761842 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeYsdf-NgsPUaUb78CUpk0vq18mlUqdb1er-CKgSGnwcxKYVDw5Br5ObGheB0PHKIrwGHgJ4op59IUcxCd3ChQqclxeYxKhK3ZwkXmw1AwIGXWjgktrsk6DH6ba1NMLmZ1pzBqcyvzB3CMIuC4HBXIHDILjU44EobGpdQQ8lNmKdDFM Oct 08 21:09:47.761842 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:09:47.761842 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:09:47.761842 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:09:47.761842 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:09:47.761842 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:09:47.761842 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:09:47.761842 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: e7ded993145b4eda9d6a33b994519012 Oct 08 21:09:47.761842 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-ServersTestJSON-68907085 Oct 08 21:09:47.761842 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:09:47.761842 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:09:47.761842 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/e7ded993145b4eda9d6a33b994519012"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e7ded993145b4eda9d6a33b994519012"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_e7ded993145b4eda9d6a33b994519012"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e7ded993145b4eda9d6a33b994519012"}]}] Oct 08 21:09:47.761842 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-ServersTestJSON-68907085 Oct 08 21:09:47.761842 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: e7ded993145b4eda9d6a33b994519012 Oct 08 21:09:47.761842 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-ServersTestJSON-68907085 Oct 08 21:09:47.761842 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-ServersTestJSON-68907085-project Oct 08 21:09:47.761842 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:09:47.761842 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:09:47.761842 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 06443b5728fb4d1e95d6245820e786bf Oct 08 21:09:47.761842 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-ServersTestJSON-68907085-project Oct 08 21:09:47.761842 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:09:47.761842 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance edd393b3-ce87-41a9-a9c4-f3ad6a6f0130 could not be found. Oct 08 21:09:47.761842 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': 'edd393b3-ce87-41a9-a9c4-f3ad6a6f0130'} Oct 08 21:09:47.761842 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:09:47.761842 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:09:47.761842 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:09:47.761842 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:09:47.761842 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:09:47.761842 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:09:47.761842 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:09:47.761842 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:09:47.761842 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:09:47.761842 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:09:47.761842 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance edd393b3-ce87-41a9-a9c4-f3ad6a6f0130 could not be found. Oct 08 21:09:47.761842 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:09:47.761842 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:09:47.761842 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:09:47.761842 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:09:47.761842 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:09:47.761842 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:09:47.761842 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:09:47.761842 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:09:47.761842 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:09:47.761842 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:09:47.761842 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:09:47.761842 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:09:47.761842 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:09:47.761842 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:09:47.761842 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:09:47.761842 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:09:47.761842 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance edd393b3-ce87-41a9-a9c4-f3ad6a6f0130 could not be found. Oct 08 21:09:47.761842 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:09:47.761842 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:09:47.761842 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:09:47.761842 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:09:47.768836 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:09:47.768836 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:09:47.768836 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:09:47.768836 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:09:47.768836 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance edd393b3-ce87-41a9-a9c4-f3ad6a6f0130 could not be found. Oct 08 21:09:47.768836 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:09:47.769806 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-d1dbd8ef-7049-41b5-a617-22d674aa81e9 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] Returning 404 to user: Instance edd393b3-ce87-41a9-a9c4-f3ad6a6f0130 could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:09:47.771289 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-d1dbd8ef-7049-41b5-a617-22d674aa81e9 tempest-ServersTestJSON-68907085 tempest-ServersTestJSON-68907085-project] 10.222.0.26 "GET /compute/v2.1/servers/edd393b3-ce87-41a9-a9c4-f3ad6a6f0130" status: 404 len: 111 microversion: 2.1 time: 0.055006 Oct 08 21:09:47.772253 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2084/4265] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:47 2022] GET /compute/v2.1/servers/edd393b3-ce87-41a9-a9c4-f3ad6a6f0130 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:09:47.871528 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-64f52a76-96b7-41d9-ae48-f5bc6d0e3761 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:47.874134 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-64f52a76-96b7-41d9-ae48-f5bc6d0e3761 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] [instance: 3fed4df9-92ff-4040-8fa7-db370960dc06] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:47.882957 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-64f52a76-96b7-41d9-ae48-f5bc6d0e3761 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:47.884235 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-64f52a76-96b7-41d9-ae48-f5bc6d0e3761 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:47.884710 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-64f52a76-96b7-41d9-ae48-f5bc6d0e3761 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:47.885570 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-64f52a76-96b7-41d9-ae48-f5bc6d0e3761 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:47.886302 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-64f52a76-96b7-41d9-ae48-f5bc6d0e3761 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:47.886962 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-64f52a76-96b7-41d9-ae48-f5bc6d0e3761 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:48.039343 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-5c7bd990-599b-4e25-ae07-078f5b0139a6 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:48.057424 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-5c7bd990-599b-4e25-ae07-078f5b0139a6 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 200 len: 1503 microversion: 2.1 time: 0.443167 Oct 08 21:09:48.060983 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2182/4266] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:47 2022] GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 1503 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:09:48.165245 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-b0cd3c93-0608-4688-b18b-3e00d90bd567 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1132609684", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "0af78ecb-f6e3-458a-ab57-630925a05ff0"}]}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:09:48.179945 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-b0cd3c93-0608-4688-b18b-3e00d90bd567 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Request method failure captured: Oct 08 21:09:48.179945 ncdv-master-1 devstack@n-api.service[140492]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 08 21:09:48.179945 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:09:48.179945 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:09:48.179945 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:09:48.179945 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 235 Oct 08 21:09:48.179945 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:09:48.179945 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:09:48.179945 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:09:48.179945 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:09:48.179945 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQebW09Z3m936-d3SrnQA9UQ3KXQvUYeQwL43ufWdoxmQhUwYBWv-JT053t_VYPo9wAVRoCqYQy8Hhh8zc2n570KpS0qNVLik822FjYabkSIZMA_ubWypXzSwo3J04zV1MoSSz79D-b8-ZvwYCEIbwpbfyn5opgOjnO6EXvq1UNPaSyQ Oct 08 21:09:48.179945 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:09:48.179945 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:09:48.179945 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:09:48.179945 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:09:48.179945 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:09:48.179945 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:09:48.179945 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 0ae02675057e4f27bc1980348afc8ca1 Oct 08 21:09:48.179945 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-ServersNegativeTestJSON-1441071354 Oct 08 21:09:48.179945 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:09:48.179945 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:09:48.179945 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0ae02675057e4f27bc1980348afc8ca1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0ae02675057e4f27bc1980348afc8ca1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0ae02675057e4f27bc1980348afc8ca1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0ae02675057e4f27bc1980348afc8ca1"}]}] Oct 08 21:09:48.179945 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-ServersNegativeTestJSON-1441071354 Oct 08 21:09:48.179945 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 0ae02675057e4f27bc1980348afc8ca1 Oct 08 21:09:48.179945 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1441071354 Oct 08 21:09:48.179945 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-ServersNegativeTestJSON-1441071354-project Oct 08 21:09:48.179945 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:09:48.179945 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:09:48.179945 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 6a78d352c143483c8e4702d789d4c516 Oct 08 21:09:48.179945 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-ServersNegativeTestJSON-1441071354-project Oct 08 21:09:48.179945 ncdv-master-1 devstack@n-api.service[140492]: Oct 08 21:09:48.179945 ncdv-master-1 devstack@n-api.service[140492]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1132609684", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "0af78ecb-f6e3-458a-ab57-630925a05ff0"}]}} Oct 08 21:09:48.179945 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 21:09:48.179945 ncdv-master-1 devstack@n-api.service[140492]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 08 21:09:48.179945 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1132609684', 'imageRef': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': '0af78ecb-f6e3-458a-ab57-630925a05ff0'}]}}} Oct 08 21:09:48.179945 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:09:48.179945 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:09:48.179945 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 08 21:09:48.179945 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 08 21:09:48.179945 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 260, in is_ipv6 Oct 08 21:09:48.179945 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi address = ipaddress.IPv6Address(instance) Oct 08 21:09:48.179945 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1844, in __init__ Oct 08 21:09:48.179945 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Oct 08 21:09:48.179945 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1581, in _ip_int_from_string Oct 08 21:09:48.179945 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise AddressValueError(msg) Oct 08 21:09:48.179945 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: At least 3 parts expected in 'notvalid' Oct 08 21:09:48.179945 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:09:48.179945 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 08 21:09:48.179945 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:09:48.179945 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:09:48.179945 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 08 21:09:48.179945 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 08 21:09:48.179945 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 08 21:09:48.179945 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise error Oct 08 21:09:48.179945 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Oct 08 21:09:48.179945 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:09:48.179945 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Oct 08 21:09:48.179945 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Oct 08 21:09:48.179945 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:09:48.179945 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 08 21:09:48.179945 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi 'notvalid' Oct 08 21:09:48.179945 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:09:48.179945 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:09:48.179945 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:09:48.179945 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:09:48.185424 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:09:48.185424 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:09:48.185424 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:09:48.185424 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:09:48.185424 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:09:48.185424 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:09:48.185424 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 21:09:48.185424 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 21:09:48.185424 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 08 21:09:48.185424 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 08 21:09:48.185424 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 08 21:09:48.185424 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 08 21:09:48.185424 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 08 21:09:48.185424 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 08 21:09:48.185424 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 08 21:09:48.185424 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:09:48.185424 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:09:48.185424 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:09:48.185424 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:09:48.185424 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:09:48.185424 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:09:48.185424 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 08 21:09:48.185424 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 08 21:09:48.185424 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 08 21:09:48.185424 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:09:48.185424 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-b0cd3c93-0608-4688-b18b-3e00d90bd567 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:09:48.188909 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-b0cd3c93-0608-4688-b18b-3e00d90bd567 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.026404 Oct 08 21:09:48.193903 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2183/4267] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 21:09:48 2022] POST /compute/v2.1/servers => generated 133 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 08 21:09:48.208600 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-437aa569-0b25-400b-a02a-c8e9301bbcec tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:48.216489 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-437aa569-0b25-400b-a02a-c8e9301bbcec tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:48.254630 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-437aa569-0b25-400b-a02a-c8e9301bbcec tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:48.265429 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-437aa569-0b25-400b-a02a-c8e9301bbcec tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:48.268532 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-437aa569-0b25-400b-a02a-c8e9301bbcec tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:48.274987 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-437aa569-0b25-400b-a02a-c8e9301bbcec tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:48.275961 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-437aa569-0b25-400b-a02a-c8e9301bbcec tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:48.276633 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-437aa569-0b25-400b-a02a-c8e9301bbcec tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:48.520073 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-64f52a76-96b7-41d9-ae48-f5bc6d0e3761 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30fe0e1ffa1040ec85d3c32d8b741c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd0e7c24154409824f96e9e99da357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:48.532673 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-64f52a76-96b7-41d9-ae48-f5bc6d0e3761 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "GET /compute/v2.1/servers/3fed4df9-92ff-4040-8fa7-db370960dc06" status: 200 len: 1308 microversion: 2.1 time: 0.670330 Oct 08 21:09:48.536195 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2085/4268] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:47 2022] GET /compute/v2.1/servers/3fed4df9-92ff-4040-8fa7-db370960dc06 => generated 1308 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:09:48.549853 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-9f9d4301-0b99-43db-8280-06a1ef611052 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:48.550691 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-9f9d4301-0b99-43db-8280-06a1ef611052 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] [instance: 159e29dd-802c-4059-99f9-bb7c113d430b] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:48.568288 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9f9d4301-0b99-43db-8280-06a1ef611052 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:48.573657 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9f9d4301-0b99-43db-8280-06a1ef611052 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:48.574193 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9f9d4301-0b99-43db-8280-06a1ef611052 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:48.575024 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9f9d4301-0b99-43db-8280-06a1ef611052 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:48.575553 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9f9d4301-0b99-43db-8280-06a1ef611052 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:48.576175 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9f9d4301-0b99-43db-8280-06a1ef611052 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:48.628175 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-437aa569-0b25-400b-a02a-c8e9301bbcec tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:48.649542 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-437aa569-0b25-400b-a02a-c8e9301bbcec tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 200 len: 1503 microversion: 2.1 time: 0.448699 Oct 08 21:09:48.653600 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2184/4269] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:48 2022] GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 1503 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:09:48.659307 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-fa6c5309-dcef-4224-a3bf-18b8efc86325 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:48.660074 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-fa6c5309-dcef-4224-a3bf-18b8efc86325 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] [instance: 1b68ff0f-2dfe-4844-b7ce-556768c5d3e2] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:48.668835 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fa6c5309-dcef-4224-a3bf-18b8efc86325 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:48.669918 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fa6c5309-dcef-4224-a3bf-18b8efc86325 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:48.670590 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fa6c5309-dcef-4224-a3bf-18b8efc86325 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:48.671534 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fa6c5309-dcef-4224-a3bf-18b8efc86325 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:48.672243 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fa6c5309-dcef-4224-a3bf-18b8efc86325 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:48.672946 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fa6c5309-dcef-4224-a3bf-18b8efc86325 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:48.718889 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-fa6c5309-dcef-4224-a3bf-18b8efc86325 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] 10.222.0.26 "GET /compute/v2.1/servers/1b68ff0f-2dfe-4844-b7ce-556768c5d3e2/ips" status: 200 len: 147 microversion: 2.1 time: 0.063463 Oct 08 21:09:48.728056 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2185/4270] 10.222.0.26 () {58 vars in 1248 bytes} [Sat Oct 8 21:09:48 2022] GET /compute/v2.1/servers/1b68ff0f-2dfe-4844-b7ce-556768c5d3e2/ips => generated 147 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:09:48.738890 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-5e92dae1-e2c1-4e93-b73c-281154f8c927 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:48.741444 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-5e92dae1-e2c1-4e93-b73c-281154f8c927 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: ba5cd412-0d20-4d2e-9f5e-de18f268008a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:48.752632 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5e92dae1-e2c1-4e93-b73c-281154f8c927 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:48.753235 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5e92dae1-e2c1-4e93-b73c-281154f8c927 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:48.753694 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5e92dae1-e2c1-4e93-b73c-281154f8c927 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:48.754490 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5e92dae1-e2c1-4e93-b73c-281154f8c927 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:48.754961 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5e92dae1-e2c1-4e93-b73c-281154f8c927 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:48.755395 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5e92dae1-e2c1-4e93-b73c-281154f8c927 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:49.151246 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-5e92dae1-e2c1-4e93-b73c-281154f8c927 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78e9afd772c4de981cac8f5817ec356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765c62cac2ee4406b23a5baa85c52ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:49.167330 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-9f9d4301-0b99-43db-8280-06a1ef611052 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:49.169745 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-5e92dae1-e2c1-4e93-b73c-281154f8c927 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/ba5cd412-0d20-4d2e-9f5e-de18f268008a" status: 200 len: 1506 microversion: 2.1 time: 0.438981 Oct 08 21:09:49.171090 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2186/4271] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:48 2022] GET /compute/v2.1/servers/ba5cd412-0d20-4d2e-9f5e-de18f268008a => generated 1506 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:09:49.188131 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-b31acbd6-1c60-458f-b8db-47de7eb85927 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:49.189106 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-b31acbd6-1c60-458f-b8db-47de7eb85927 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:49.190320 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-9f9d4301-0b99-43db-8280-06a1ef611052 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:49.197179 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-9f9d4301-0b99-43db-8280-06a1ef611052 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:49.202394 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-9f9d4301-0b99-43db-8280-06a1ef611052 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] 10.222.0.26 "GET /compute/v2.1/servers/159e29dd-802c-4059-99f9-bb7c113d430b" status: 200 len: 1738 microversion: 2.20 time: 0.661270 Oct 08 21:09:49.205576 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2086/4272] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:09:48 2022] GET /compute/v2.1/servers/159e29dd-802c-4059-99f9-bb7c113d430b => generated 1738 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:09:49.221969 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b31acbd6-1c60-458f-b8db-47de7eb85927 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:49.223993 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-285ec8fe-601b-46bd-9d8a-5dadb2eda800 req-1d6e6763-20e6-4d57-bcc8-6e1abeed2cc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fed4df9-92ff-4040-8fa7-db370960dc06", "name": "network-vif-plugged", "status": "completed", "tag": "25804709-1226-432d-bc34-f585676f5c93"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:09:49.225083 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b31acbd6-1c60-458f-b8db-47de7eb85927 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:49.227641 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b31acbd6-1c60-458f-b8db-47de7eb85927 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:49.228992 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b31acbd6-1c60-458f-b8db-47de7eb85927 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:49.229715 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b31acbd6-1c60-458f-b8db-47de7eb85927 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:49.230549 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b31acbd6-1c60-458f-b8db-47de7eb85927 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:49.271476 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-285ec8fe-601b-46bd-9d8a-5dadb2eda800 req-1d6e6763-20e6-4d57-bcc8-6e1abeed2cc3 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:49.271476 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-285ec8fe-601b-46bd-9d8a-5dadb2eda800 req-1d6e6763-20e6-4d57-bcc8-6e1abeed2cc3 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:49.271476 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-285ec8fe-601b-46bd-9d8a-5dadb2eda800 req-1d6e6763-20e6-4d57-bcc8-6e1abeed2cc3 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:49.303447 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-285ec8fe-601b-46bd-9d8a-5dadb2eda800 req-1d6e6763-20e6-4d57-bcc8-6e1abeed2cc3 service nova] Creating event network-vif-plugged:25804709-1226-432d-bc34-f585676f5c93 for instance 3fed4df9-92ff-4040-8fa7-db370960dc06 on nch1-master-1 Oct 08 21:09:49.314430 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-285ec8fe-601b-46bd-9d8a-5dadb2eda800 req-1d6e6763-20e6-4d57-bcc8-6e1abeed2cc3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103484 Oct 08 21:09:49.318251 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2087/4273] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:09:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:09:49.563121 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-f3620f87-b1e6-4ada-8fd7-ea29824bb839 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:49.564716 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-f3620f87-b1e6-4ada-8fd7-ea29824bb839 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] [instance: 3fed4df9-92ff-4040-8fa7-db370960dc06] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:49.577593 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f3620f87-b1e6-4ada-8fd7-ea29824bb839 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:49.589691 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f3620f87-b1e6-4ada-8fd7-ea29824bb839 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:49.590625 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f3620f87-b1e6-4ada-8fd7-ea29824bb839 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:49.591610 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f3620f87-b1e6-4ada-8fd7-ea29824bb839 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:49.592599 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f3620f87-b1e6-4ada-8fd7-ea29824bb839 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:49.593344 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f3620f87-b1e6-4ada-8fd7-ea29824bb839 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:49.642112 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=100 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:09:49.807207 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-b31acbd6-1c60-458f-b8db-47de7eb85927 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:49.819325 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-b31acbd6-1c60-458f-b8db-47de7eb85927 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 200 len: 1503 microversion: 2.1 time: 0.644144 Oct 08 21:09:49.825642 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2187/4274] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:49 2022] GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 1503 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:09:49.862629 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-79a351b4-f280-4f6d-9cf4-a98e00c9a75f tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:09:49.863260 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-79a351b4-f280-4f6d-9cf4-a98e00c9a75f tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: f9464638-36ee-4779-ab28-e9a56f3ea824] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:49.887971 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-79a351b4-f280-4f6d-9cf4-a98e00c9a75f tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] HTTP exception thrown: Instance f9464638-36ee-4779-ab28-e9a56f3ea824 could not be found. Oct 08 21:09:49.896170 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-79a351b4-f280-4f6d-9cf4-a98e00c9a75f tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Request method failure captured: Oct 08 21:09:49.896170 ncdv-master-1 devstack@n-api.service[140492]: request: POST /compute/v2.1/servers/f9464638-36ee-4779-ab28-e9a56f3ea824/action HTTP/1.1 Oct 08 21:09:49.896170 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:09:49.896170 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:09:49.896170 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:09:49.896170 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 13 Oct 08 21:09:49.896170 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:09:49.896170 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:09:49.896170 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:09:49.896170 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:09:49.896170 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQebW09Z3m936-d3SrnQA9UQ3KXQvUYeQwL43ufWdoxmQhUwYBWv-JT053t_VYPo9wAVRoCqYQy8Hhh8zc2n570KpS0qNVLik822FjYabkSIZMA_ubWypXzSwo3J04zV1MoSSz79D-b8-ZvwYCEIbwpbfyn5opgOjnO6EXvq1UNPaSyQ Oct 08 21:09:49.896170 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:09:49.896170 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:09:49.896170 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:09:49.896170 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:09:49.896170 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:09:49.896170 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:09:49.896170 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 0ae02675057e4f27bc1980348afc8ca1 Oct 08 21:09:49.896170 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-ServersNegativeTestJSON-1441071354 Oct 08 21:09:49.896170 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:09:49.896170 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:09:49.896170 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0ae02675057e4f27bc1980348afc8ca1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0ae02675057e4f27bc1980348afc8ca1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0ae02675057e4f27bc1980348afc8ca1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0ae02675057e4f27bc1980348afc8ca1"}]}] Oct 08 21:09:49.896170 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-ServersNegativeTestJSON-1441071354 Oct 08 21:09:49.896170 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 0ae02675057e4f27bc1980348afc8ca1 Oct 08 21:09:49.896170 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1441071354 Oct 08 21:09:49.896170 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-ServersNegativeTestJSON-1441071354-project Oct 08 21:09:49.896170 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:09:49.896170 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:09:49.896170 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 6a78d352c143483c8e4702d789d4c516 Oct 08 21:09:49.896170 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-ServersNegativeTestJSON-1441071354-project Oct 08 21:09:49.896170 ncdv-master-1 devstack@n-api.service[140492]: Oct 08 21:09:49.896170 ncdv-master-1 devstack@n-api.service[140492]: {"pause": {}} Oct 08 21:09:49.896170 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 21:09:49.896170 ncdv-master-1 devstack@n-api.service[140492]: exception: Instance f9464638-36ee-4779-ab28-e9a56f3ea824 could not be found. Oct 08 21:09:49.896170 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': 'f9464638-36ee-4779-ab28-e9a56f3ea824', 'body': {'pause': {}}} Oct 08 21:09:49.896170 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:09:49.896170 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:09:49.896170 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:09:49.896170 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:09:49.896170 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:09:49.896170 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:09:49.896170 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 08 21:09:49.896170 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 08 21:09:49.896170 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9464638-36ee-4779-ab28-e9a56f3ea824 could not be found. Oct 08 21:09:49.896170 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:09:49.896170 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:09:49.896170 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:09:49.896170 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:09:49.896170 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:09:49.896170 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:09:49.896170 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:09:49.896170 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:09:49.896170 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:09:49.896170 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:09:49.896170 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Oct 08 21:09:49.896170 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Oct 08 21:09:49.896170 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:09:49.896170 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:09:49.896170 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9464638-36ee-4779-ab28-e9a56f3ea824 could not be found. Oct 08 21:09:49.896170 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:09:49.896170 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:09:49.896170 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:09:49.896170 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:09:49.896170 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:09:49.896170 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:09:49.901503 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:09:49.901503 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:09:49.901503 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9464638-36ee-4779-ab28-e9a56f3ea824 could not be found. Oct 08 21:09:49.901503 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:09:49.901503 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-79a351b4-f280-4f6d-9cf4-a98e00c9a75f tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Returning 404 to user: Instance f9464638-36ee-4779-ab28-e9a56f3ea824 could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:09:49.901503 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-79a351b4-f280-4f6d-9cf4-a98e00c9a75f tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "POST /compute/v2.1/servers/f9464638-36ee-4779-ab28-e9a56f3ea824/action" status: 404 len: 111 microversion: 2.1 time: 0.056601 Oct 08 21:09:49.901503 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2188/4275] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:09:49 2022] POST /compute/v2.1/servers/f9464638-36ee-4779-ab28-e9a56f3ea824/action => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:09:49.916077 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-d6cdbb1c-8e3e-423a-acf7-7ce6c32788a4 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:49.916708 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-d6cdbb1c-8e3e-423a-acf7-7ce6c32788a4 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:49.928768 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d6cdbb1c-8e3e-423a-acf7-7ce6c32788a4 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:49.929421 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d6cdbb1c-8e3e-423a-acf7-7ce6c32788a4 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:49.933816 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d6cdbb1c-8e3e-423a-acf7-7ce6c32788a4 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:49.935030 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d6cdbb1c-8e3e-423a-acf7-7ce6c32788a4 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:49.935727 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d6cdbb1c-8e3e-423a-acf7-7ce6c32788a4 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:49.936407 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d6cdbb1c-8e3e-423a-acf7-7ce6c32788a4 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:50.030411 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-f3620f87-b1e6-4ada-8fd7-ea29824bb839 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30fe0e1ffa1040ec85d3c32d8b741c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd0e7c24154409824f96e9e99da357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:50.039482 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-f3620f87-b1e6-4ada-8fd7-ea29824bb839 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "GET /compute/v2.1/servers/3fed4df9-92ff-4040-8fa7-db370960dc06" status: 200 len: 1308 microversion: 2.1 time: 0.482644 Oct 08 21:09:50.040077 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2088/4276] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:49 2022] GET /compute/v2.1/servers/3fed4df9-92ff-4040-8fa7-db370960dc06 => generated 1308 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:09:50.198537 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-a383fca8-6533-4d11-b049-b5204b20ae4a tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:50.199433 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-a383fca8-6533-4d11-b049-b5204b20ae4a tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: ba5cd412-0d20-4d2e-9f5e-de18f268008a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:50.208099 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a383fca8-6533-4d11-b049-b5204b20ae4a tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:50.208823 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a383fca8-6533-4d11-b049-b5204b20ae4a tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:50.209961 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a383fca8-6533-4d11-b049-b5204b20ae4a tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:50.210965 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a383fca8-6533-4d11-b049-b5204b20ae4a tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:50.212777 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a383fca8-6533-4d11-b049-b5204b20ae4a tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:50.219645 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-d6cdbb1c-8e3e-423a-acf7-7ce6c32788a4 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:50.226152 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a383fca8-6533-4d11-b049-b5204b20ae4a tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:50.240818 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-d6cdbb1c-8e3e-423a-acf7-7ce6c32788a4 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 200 len: 1503 microversion: 2.1 time: 0.330956 Oct 08 21:09:50.243050 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2189/4277] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:49 2022] GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 1503 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:09:50.267617 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-dc867106-d706-4306-bf48-23c7c414f219 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:50.268643 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-dc867106-d706-4306-bf48-23c7c414f219 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] [instance: 159e29dd-802c-4059-99f9-bb7c113d430b] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:50.301701 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dc867106-d706-4306-bf48-23c7c414f219 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:50.302304 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dc867106-d706-4306-bf48-23c7c414f219 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:50.307286 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dc867106-d706-4306-bf48-23c7c414f219 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:50.317592 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dc867106-d706-4306-bf48-23c7c414f219 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:50.318414 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dc867106-d706-4306-bf48-23c7c414f219 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:50.319059 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dc867106-d706-4306-bf48-23c7c414f219 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:50.719479 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-a383fca8-6533-4d11-b049-b5204b20ae4a tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78e9afd772c4de981cac8f5817ec356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765c62cac2ee4406b23a5baa85c52ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:50.736449 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-a383fca8-6533-4d11-b049-b5204b20ae4a tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/ba5cd412-0d20-4d2e-9f5e-de18f268008a" status: 200 len: 1506 microversion: 2.1 time: 0.540569 Oct 08 21:09:50.739584 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2089/4278] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:50 2022] GET /compute/v2.1/servers/ba5cd412-0d20-4d2e-9f5e-de18f268008a => generated 1506 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:09:50.752362 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-0860154d-062f-47b0-b614-41d7247e7440 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:50.757394 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-0860154d-062f-47b0-b614-41d7247e7440 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:50.768942 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0860154d-062f-47b0-b614-41d7247e7440 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:50.770869 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0860154d-062f-47b0-b614-41d7247e7440 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:50.771320 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0860154d-062f-47b0-b614-41d7247e7440 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:50.773277 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0860154d-062f-47b0-b614-41d7247e7440 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:50.774600 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0860154d-062f-47b0-b614-41d7247e7440 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:50.777181 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0860154d-062f-47b0-b614-41d7247e7440 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:50.796079 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-dc867106-d706-4306-bf48-23c7c414f219 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:50.846637 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-dc867106-d706-4306-bf48-23c7c414f219 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:50.850376 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-dc867106-d706-4306-bf48-23c7c414f219 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:50.851895 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-dc867106-d706-4306-bf48-23c7c414f219 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] 10.222.0.26 "GET /compute/v2.1/servers/159e29dd-802c-4059-99f9-bb7c113d430b" status: 200 len: 1738 microversion: 2.20 time: 0.607207 Oct 08 21:09:50.873374 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2190/4279] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:09:50 2022] GET /compute/v2.1/servers/159e29dd-802c-4059-99f9-bb7c113d430b => generated 1738 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:09:50.895541 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-edf57666-0c6f-4074-bd83-ef7686cb6a1b tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1dddb5cf-401e-4276-b7d2-76b0ba48acc7"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:09:50.911780 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-edf57666-0c6f-4074-bd83-ef7686cb6a1b tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] [instance: 1b68ff0f-2dfe-4844-b7ce-556768c5d3e2] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:50.930767 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-edf57666-0c6f-4074-bd83-ef7686cb6a1b tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:50.931885 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-edf57666-0c6f-4074-bd83-ef7686cb6a1b tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:50.936231 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-edf57666-0c6f-4074-bd83-ef7686cb6a1b tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:50.937566 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-edf57666-0c6f-4074-bd83-ef7686cb6a1b tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:50.938651 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-edf57666-0c6f-4074-bd83-ef7686cb6a1b tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:50.940036 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-edf57666-0c6f-4074-bd83-ef7686cb6a1b tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:51.177588 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-0860154d-062f-47b0-b614-41d7247e7440 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:51.220658 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-0860154d-062f-47b0-b614-41d7247e7440 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 200 len: 1503 microversion: 2.1 time: 0.476064 Oct 08 21:09:51.224055 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2090/4280] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:50 2022] GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 1503 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:09:51.248775 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-69848faa-75f8-449c-85fd-2190ef768b3f tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:51.250983 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-69848faa-75f8-449c-85fd-2190ef768b3f tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] [instance: 3fed4df9-92ff-4040-8fa7-db370960dc06] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:51.276967 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-69848faa-75f8-449c-85fd-2190ef768b3f tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:51.278950 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-69848faa-75f8-449c-85fd-2190ef768b3f tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:51.280314 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-69848faa-75f8-449c-85fd-2190ef768b3f tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:51.285362 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-69848faa-75f8-449c-85fd-2190ef768b3f tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:51.287214 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-69848faa-75f8-449c-85fd-2190ef768b3f tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:51.291434 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-69848faa-75f8-449c-85fd-2190ef768b3f tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:51.574318 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:09:51.595417 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-edf57666-0c6f-4074-bd83-ef7686cb6a1b tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] 10.222.0.26 "POST /compute/v2.1/servers/1b68ff0f-2dfe-4844-b7ce-556768c5d3e2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.720525 Oct 08 21:09:51.596616 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2191/4281] 10.222.0.26 () {60 vars in 1323 bytes} [Sat Oct 8 21:09:50 2022] POST /compute/v2.1/servers/1b68ff0f-2dfe-4844-b7ce-556768c5d3e2/os-volume_attachments => generated 194 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:09:51.635555 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-f863d59c-9a63-41f9-8efd-0143fdc1af50 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:09:51.641918 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-f863d59c-9a63-41f9-8efd-0143fdc1af50 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:51.660216 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f863d59c-9a63-41f9-8efd-0143fdc1af50 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:51.660948 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f863d59c-9a63-41f9-8efd-0143fdc1af50 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:51.664375 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f863d59c-9a63-41f9-8efd-0143fdc1af50 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:51.665440 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f863d59c-9a63-41f9-8efd-0143fdc1af50 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:51.665931 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f863d59c-9a63-41f9-8efd-0143fdc1af50 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:51.666371 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f863d59c-9a63-41f9-8efd-0143fdc1af50 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:51.844325 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-69848faa-75f8-449c-85fd-2190ef768b3f tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30fe0e1ffa1040ec85d3c32d8b741c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd0e7c24154409824f96e9e99da357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:51.857527 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-69848faa-75f8-449c-85fd-2190ef768b3f tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "GET /compute/v2.1/servers/3fed4df9-92ff-4040-8fa7-db370960dc06" status: 200 len: 1308 microversion: 2.1 time: 0.630430 Oct 08 21:09:51.858288 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2091/4282] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:51 2022] GET /compute/v2.1/servers/3fed4df9-92ff-4040-8fa7-db370960dc06 => generated 1308 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:09:51.864177 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-bb5b4d11-b4d1-4d21-ab75-bbe14703f4b5 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:51.865423 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-bb5b4d11-b4d1-4d21-ab75-bbe14703f4b5 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: ba5cd412-0d20-4d2e-9f5e-de18f268008a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:51.874239 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bb5b4d11-b4d1-4d21-ab75-bbe14703f4b5 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:51.875419 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bb5b4d11-b4d1-4d21-ab75-bbe14703f4b5 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:51.876649 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bb5b4d11-b4d1-4d21-ab75-bbe14703f4b5 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:51.877778 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bb5b4d11-b4d1-4d21-ab75-bbe14703f4b5 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:51.878521 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bb5b4d11-b4d1-4d21-ab75-bbe14703f4b5 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:51.879177 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bb5b4d11-b4d1-4d21-ab75-bbe14703f4b5 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:51.898885 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-f863d59c-9a63-41f9-8efd-0143fdc1af50 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "POST /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2/action" status: 202 len: 0 microversion: 2.1 time: 0.288819 Oct 08 21:09:51.899953 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2192/4283] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:09:51 2022] POST /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2/action => generated 0 bytes in 302 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 21:09:51.919526 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-b03d1b5a-07d3-4bb9-ad39-e893a1678a3a tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:51.920411 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-b03d1b5a-07d3-4bb9-ad39-e893a1678a3a tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] [instance: 159e29dd-802c-4059-99f9-bb7c113d430b] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:51.964904 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b03d1b5a-07d3-4bb9-ad39-e893a1678a3a tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:51.967923 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b03d1b5a-07d3-4bb9-ad39-e893a1678a3a tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:51.968575 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b03d1b5a-07d3-4bb9-ad39-e893a1678a3a tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:51.973220 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b03d1b5a-07d3-4bb9-ad39-e893a1678a3a tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:51.995651 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b03d1b5a-07d3-4bb9-ad39-e893a1678a3a tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:51.998414 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b03d1b5a-07d3-4bb9-ad39-e893a1678a3a tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:52.448806 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-b03d1b5a-07d3-4bb9-ad39-e893a1678a3a tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:52.464129 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-b03d1b5a-07d3-4bb9-ad39-e893a1678a3a tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:52.477915 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-b03d1b5a-07d3-4bb9-ad39-e893a1678a3a tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:52.479553 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-b03d1b5a-07d3-4bb9-ad39-e893a1678a3a tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] 10.222.0.26 "GET /compute/v2.1/servers/159e29dd-802c-4059-99f9-bb7c113d430b" status: 200 len: 1738 microversion: 2.20 time: 0.575311 Oct 08 21:09:52.503364 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2193/4284] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:09:51 2022] GET /compute/v2.1/servers/159e29dd-802c-4059-99f9-bb7c113d430b => generated 1738 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:09:52.517929 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-245f7386-df89-43a7-a5a6-17b779d492ef tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:52.519508 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-245f7386-df89-43a7-a5a6-17b779d492ef tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:52.524980 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-bb5b4d11-b4d1-4d21-ab75-bbe14703f4b5 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78e9afd772c4de981cac8f5817ec356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765c62cac2ee4406b23a5baa85c52ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:52.545086 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-bb5b4d11-b4d1-4d21-ab75-bbe14703f4b5 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/ba5cd412-0d20-4d2e-9f5e-de18f268008a" status: 200 len: 1506 microversion: 2.1 time: 0.679521 Oct 08 21:09:52.548096 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2092/4285] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:51 2022] GET /compute/v2.1/servers/ba5cd412-0d20-4d2e-9f5e-de18f268008a => generated 1506 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:09:52.552138 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-245f7386-df89-43a7-a5a6-17b779d492ef tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:52.552795 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-245f7386-df89-43a7-a5a6-17b779d492ef tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:52.553427 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-245f7386-df89-43a7-a5a6-17b779d492ef tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:52.554266 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-245f7386-df89-43a7-a5a6-17b779d492ef tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:52.554839 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-245f7386-df89-43a7-a5a6-17b779d492ef tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:52.555994 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-245f7386-df89-43a7-a5a6-17b779d492ef tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:52.759180 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-245f7386-df89-43a7-a5a6-17b779d492ef tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:52.770424 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-245f7386-df89-43a7-a5a6-17b779d492ef tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 200 len: 1488 microversion: 2.1 time: 0.265697 Oct 08 21:09:52.771307 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2194/4286] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:52 2022] GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 1488 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:09:52.800339 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-02df07b3-d530-490b-baf1-0573eea99854 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:09:52.801118 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-02df07b3-d530-490b-baf1-0573eea99854 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:52.815007 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-02df07b3-d530-490b-baf1-0573eea99854 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:52.816695 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-02df07b3-d530-490b-baf1-0573eea99854 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:52.817538 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-02df07b3-d530-490b-baf1-0573eea99854 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:52.818469 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-02df07b3-d530-490b-baf1-0573eea99854 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:52.819129 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-02df07b3-d530-490b-baf1-0573eea99854 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:52.819751 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-02df07b3-d530-490b-baf1-0573eea99854 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:52.856490 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-02df07b3-d530-490b-baf1-0573eea99854 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] HTTP exception thrown: Cannot 'pause' instance e2548207-aa57-4e4c-876b-2027b59283d2 while it is in vm_state paused Oct 08 21:09:52.859103 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-02df07b3-d530-490b-baf1-0573eea99854 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Request method failure captured: Oct 08 21:09:52.859103 ncdv-master-1 devstack@n-api.service[140491]: request: POST /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2/action HTTP/1.1 Oct 08 21:09:52.859103 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:09:52.859103 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:09:52.859103 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:09:52.859103 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 13 Oct 08 21:09:52.859103 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:09:52.859103 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:09:52.859103 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:09:52.859103 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:09:52.859103 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQebW09Z3m936-d3SrnQA9UQ3KXQvUYeQwL43ufWdoxmQhUwYBWv-JT053t_VYPo9wAVRoCqYQy8Hhh8zc2n570KpS0qNVLik822FjYabkSIZMA_ubWypXzSwo3J04zV1MoSSz79D-b8-ZvwYCEIbwpbfyn5opgOjnO6EXvq1UNPaSyQ Oct 08 21:09:52.859103 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:09:52.859103 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:09:52.859103 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:09:52.859103 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:09:52.859103 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:09:52.859103 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:09:52.859103 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 0ae02675057e4f27bc1980348afc8ca1 Oct 08 21:09:52.859103 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-ServersNegativeTestJSON-1441071354 Oct 08 21:09:52.859103 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:09:52.859103 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:09:52.859103 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0ae02675057e4f27bc1980348afc8ca1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0ae02675057e4f27bc1980348afc8ca1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0ae02675057e4f27bc1980348afc8ca1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0ae02675057e4f27bc1980348afc8ca1"}]}] Oct 08 21:09:52.859103 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-ServersNegativeTestJSON-1441071354 Oct 08 21:09:52.859103 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 0ae02675057e4f27bc1980348afc8ca1 Oct 08 21:09:52.859103 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1441071354 Oct 08 21:09:52.859103 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-ServersNegativeTestJSON-1441071354-project Oct 08 21:09:52.859103 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:09:52.859103 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:09:52.859103 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 6a78d352c143483c8e4702d789d4c516 Oct 08 21:09:52.859103 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-ServersNegativeTestJSON-1441071354-project Oct 08 21:09:52.859103 ncdv-master-1 devstack@n-api.service[140491]: Oct 08 21:09:52.859103 ncdv-master-1 devstack@n-api.service[140491]: {"pause": {}} Oct 08 21:09:52.859103 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:09:52.859103 ncdv-master-1 devstack@n-api.service[140491]: exception: Cannot 'pause' instance e2548207-aa57-4e4c-876b-2027b59283d2 while it is in vm_state paused Oct 08 21:09:52.859103 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': 'e2548207-aa57-4e4c-876b-2027b59283d2', 'body': {'pause': {}}} Oct 08 21:09:52.859103 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:09:52.859103 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:09:52.859103 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Oct 08 21:09:52.859103 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Oct 08 21:09:52.859103 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 08 21:09:52.859103 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 08 21:09:52.859103 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 08 21:09:52.859103 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 08 21:09:52.859103 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e2548207-aa57-4e4c-876b-2027b59283d2 in vm_state paused. Cannot pause while the instance is in this state. Oct 08 21:09:52.859103 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:09:52.859103 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:09:52.859103 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:09:52.859103 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:09:52.859103 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:09:52.859103 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:09:52.859103 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:09:52.859103 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:09:52.859103 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:09:52.859103 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:09:52.859103 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Oct 08 21:09:52.859103 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 08 21:09:52.859103 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 08 21:09:52.859103 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 08 21:09:52.859103 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance e2548207-aa57-4e4c-876b-2027b59283d2 while it is in vm_state paused Oct 08 21:09:52.859103 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:09:52.859103 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:09:52.859103 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:09:52.859103 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:09:52.859103 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:09:52.863533 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:09:52.863533 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:09:52.863533 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:09:52.863533 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance e2548207-aa57-4e4c-876b-2027b59283d2 while it is in vm_state paused Oct 08 21:09:52.863533 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:09:52.864588 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-02df07b3-d530-490b-baf1-0573eea99854 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Returning 409 to user: Cannot 'pause' instance e2548207-aa57-4e4c-876b-2027b59283d2 while it is in vm_state paused {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:09:52.865656 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-02df07b3-d530-490b-baf1-0573eea99854 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "POST /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2/action" status: 409 len: 143 microversion: 2.1 time: 0.070292 Oct 08 21:09:52.867533 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2093/4287] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:09:52 2022] POST /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2/action => generated 143 bytes in 72 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 08 21:09:52.875646 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-17c5683e-3b89-4b27-b9ea-173a6dea9e47 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:09:52.876731 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-17c5683e-3b89-4b27-b9ea-173a6dea9e47 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:52.888204 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-17c5683e-3b89-4b27-b9ea-173a6dea9e47 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:52.905645 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-7957c408-ae66-48f0-8a2f-633025f32912 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:52.907006 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-17c5683e-3b89-4b27-b9ea-173a6dea9e47 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:52.907651 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-17c5683e-3b89-4b27-b9ea-173a6dea9e47 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:52.908716 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-17c5683e-3b89-4b27-b9ea-173a6dea9e47 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:52.909373 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-17c5683e-3b89-4b27-b9ea-173a6dea9e47 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:52.910036 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-17c5683e-3b89-4b27-b9ea-173a6dea9e47 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:52.910879 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-7957c408-ae66-48f0-8a2f-633025f32912 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] [instance: 3fed4df9-92ff-4040-8fa7-db370960dc06] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:52.929342 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7957c408-ae66-48f0-8a2f-633025f32912 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:52.930712 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7957c408-ae66-48f0-8a2f-633025f32912 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:52.932078 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7957c408-ae66-48f0-8a2f-633025f32912 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:52.934294 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7957c408-ae66-48f0-8a2f-633025f32912 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:52.937795 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7957c408-ae66-48f0-8a2f-633025f32912 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:52.939784 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7957c408-ae66-48f0-8a2f-633025f32912 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:53.079321 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-17c5683e-3b89-4b27-b9ea-173a6dea9e47 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "POST /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2/action" status: 202 len: 0 microversion: 2.1 time: 0.206680 Oct 08 21:09:53.081048 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2195/4288] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:09:52 2022] POST /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2/action => generated 0 bytes in 210 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 21:09:53.108629 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-643df3b1-a3ed-416f-9b41-d73ebe1f4824 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:53.111439 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-643df3b1-a3ed-416f-9b41-d73ebe1f4824 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:53.146405 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-643df3b1-a3ed-416f-9b41-d73ebe1f4824 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:53.148042 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-643df3b1-a3ed-416f-9b41-d73ebe1f4824 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:53.149996 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-643df3b1-a3ed-416f-9b41-d73ebe1f4824 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:53.150989 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-643df3b1-a3ed-416f-9b41-d73ebe1f4824 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:53.152625 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-643df3b1-a3ed-416f-9b41-d73ebe1f4824 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:53.153712 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-643df3b1-a3ed-416f-9b41-d73ebe1f4824 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:53.383864 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-7957c408-ae66-48f0-8a2f-633025f32912 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30fe0e1ffa1040ec85d3c32d8b741c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd0e7c24154409824f96e9e99da357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:53.399081 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-7957c408-ae66-48f0-8a2f-633025f32912 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "GET /compute/v2.1/servers/3fed4df9-92ff-4040-8fa7-db370960dc06" status: 200 len: 1488 microversion: 2.1 time: 0.512199 Oct 08 21:09:53.400102 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2094/4289] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:52 2022] GET /compute/v2.1/servers/3fed4df9-92ff-4040-8fa7-db370960dc06 => generated 1488 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:09:53.426670 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-372a9d1d-3689-47b8-92fc-ec3fbb1fc08e tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:09:53.427621 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-372a9d1d-3689-47b8-92fc-ec3fbb1fc08e tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] [instance: 3fed4df9-92ff-4040-8fa7-db370960dc06] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:53.439695 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-372a9d1d-3689-47b8-92fc-ec3fbb1fc08e tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:53.440317 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-372a9d1d-3689-47b8-92fc-ec3fbb1fc08e tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:53.441439 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-372a9d1d-3689-47b8-92fc-ec3fbb1fc08e tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:53.443011 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-372a9d1d-3689-47b8-92fc-ec3fbb1fc08e tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:53.443744 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-372a9d1d-3689-47b8-92fc-ec3fbb1fc08e tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:53.444631 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-372a9d1d-3689-47b8-92fc-ec3fbb1fc08e tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:53.480998 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.objects.instance [None req-372a9d1d-3689-47b8-92fc-ec3fbb1fc08e tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lazy-loading 'flavor' on Instance uuid 3fed4df9-92ff-4040-8fa7-db370960dc06 {{(pid=140491) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 21:09:53.608357 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-372a9d1d-3689-47b8-92fc-ec3fbb1fc08e tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "POST /compute/v2.1/servers/3fed4df9-92ff-4040-8fa7-db370960dc06/action" status: 202 len: 0 microversion: 2.1 time: 0.186995 Oct 08 21:09:53.609406 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2095/4290] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:09:53 2022] POST /compute/v2.1/servers/3fed4df9-92ff-4040-8fa7-db370960dc06/action => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 21:09:53.615754 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-643df3b1-a3ed-416f-9b41-d73ebe1f4824 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:53.625909 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-b93e956e-917b-4f39-9008-4acc8c386e67 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:53.629053 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-643df3b1-a3ed-416f-9b41-d73ebe1f4824 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 200 len: 1495 microversion: 2.1 time: 0.530231 Oct 08 21:09:53.635091 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2196/4291] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:53 2022] GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 1495 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:09:53.636861 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-b93e956e-917b-4f39-9008-4acc8c386e67 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] [instance: 159e29dd-802c-4059-99f9-bb7c113d430b] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:53.640515 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-31a2cfb8-0387-46d3-8ae9-3846c7e8b20c tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:53.648252 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b93e956e-917b-4f39-9008-4acc8c386e67 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:53.649166 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-31a2cfb8-0387-46d3-8ae9-3846c7e8b20c tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: ba5cd412-0d20-4d2e-9f5e-de18f268008a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:53.649493 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b93e956e-917b-4f39-9008-4acc8c386e67 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:53.650410 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b93e956e-917b-4f39-9008-4acc8c386e67 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:53.651963 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b93e956e-917b-4f39-9008-4acc8c386e67 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:53.655932 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b93e956e-917b-4f39-9008-4acc8c386e67 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:53.656986 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b93e956e-917b-4f39-9008-4acc8c386e67 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:53.660967 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-31a2cfb8-0387-46d3-8ae9-3846c7e8b20c tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:53.661728 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-31a2cfb8-0387-46d3-8ae9-3846c7e8b20c tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:53.662522 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-31a2cfb8-0387-46d3-8ae9-3846c7e8b20c tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:53.665881 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-31a2cfb8-0387-46d3-8ae9-3846c7e8b20c tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:53.666558 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-31a2cfb8-0387-46d3-8ae9-3846c7e8b20c tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:53.667232 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-31a2cfb8-0387-46d3-8ae9-3846c7e8b20c tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:54.005308 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-31a2cfb8-0387-46d3-8ae9-3846c7e8b20c tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78e9afd772c4de981cac8f5817ec356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765c62cac2ee4406b23a5baa85c52ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:54.025086 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-31a2cfb8-0387-46d3-8ae9-3846c7e8b20c tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/ba5cd412-0d20-4d2e-9f5e-de18f268008a" status: 200 len: 1527 microversion: 2.1 time: 0.385313 Oct 08 21:09:54.026543 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2197/4292] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:53 2022] GET /compute/v2.1/servers/ba5cd412-0d20-4d2e-9f5e-de18f268008a => generated 1527 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:09:54.037342 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-aaf86e09-c36c-4395-b52d-e55d71e079ce tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:54.039223 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-aaf86e09-c36c-4395-b52d-e55d71e079ce tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] [instance: 3fed4df9-92ff-4040-8fa7-db370960dc06] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:54.059619 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-aaf86e09-c36c-4395-b52d-e55d71e079ce tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:54.060668 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-aaf86e09-c36c-4395-b52d-e55d71e079ce tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:54.061601 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-aaf86e09-c36c-4395-b52d-e55d71e079ce tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:54.063630 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-aaf86e09-c36c-4395-b52d-e55d71e079ce tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:54.065762 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-aaf86e09-c36c-4395-b52d-e55d71e079ce tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:54.067024 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-aaf86e09-c36c-4395-b52d-e55d71e079ce tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:54.400193 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-aaf86e09-c36c-4395-b52d-e55d71e079ce tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30fe0e1ffa1040ec85d3c32d8b741c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd0e7c24154409824f96e9e99da357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:54.433293 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-aaf86e09-c36c-4395-b52d-e55d71e079ce tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "GET /compute/v2.1/servers/3fed4df9-92ff-4040-8fa7-db370960dc06" status: 200 len: 1496 microversion: 2.1 time: 0.405301 Oct 08 21:09:54.435910 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2198/4293] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:54 2022] GET /compute/v2.1/servers/3fed4df9-92ff-4040-8fa7-db370960dc06 => generated 1496 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:09:54.468142 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-b93e956e-917b-4f39-9008-4acc8c386e67 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:54.496750 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-b93e956e-917b-4f39-9008-4acc8c386e67 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:54.498615 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-b93e956e-917b-4f39-9008-4acc8c386e67 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:54.500062 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-b93e956e-917b-4f39-9008-4acc8c386e67 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] 10.222.0.26 "GET /compute/v2.1/servers/159e29dd-802c-4059-99f9-bb7c113d430b" status: 200 len: 1738 microversion: 2.20 time: 0.889308 Oct 08 21:09:54.518160 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2096/4294] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:09:53 2022] GET /compute/v2.1/servers/159e29dd-802c-4059-99f9-bb7c113d430b => generated 1738 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:09:54.663509 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-fd296922-649f-48c8-8b86-fb6ceb19c1a4 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:54.664145 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-fd296922-649f-48c8-8b86-fb6ceb19c1a4 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:54.670577 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fd296922-649f-48c8-8b86-fb6ceb19c1a4 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:54.671326 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fd296922-649f-48c8-8b86-fb6ceb19c1a4 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:54.671924 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fd296922-649f-48c8-8b86-fb6ceb19c1a4 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:54.672810 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fd296922-649f-48c8-8b86-fb6ceb19c1a4 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:54.673530 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fd296922-649f-48c8-8b86-fb6ceb19c1a4 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:54.673962 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fd296922-649f-48c8-8b86-fb6ceb19c1a4 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:54.865757 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-fd296922-649f-48c8-8b86-fb6ceb19c1a4 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:54.878480 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-fd296922-649f-48c8-8b86-fb6ceb19c1a4 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 200 len: 1503 microversion: 2.1 time: 0.218978 Oct 08 21:09:54.879880 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2199/4295] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:54 2022] GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 1503 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:09:54.904220 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-844d67a9-e072-4792-95b1-4190103afea2 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:54.904810 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-844d67a9-e072-4792-95b1-4190103afea2 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:54.912613 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-844d67a9-e072-4792-95b1-4190103afea2 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:54.913126 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-844d67a9-e072-4792-95b1-4190103afea2 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:54.913612 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-844d67a9-e072-4792-95b1-4190103afea2 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:54.914412 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-844d67a9-e072-4792-95b1-4190103afea2 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:54.915373 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-844d67a9-e072-4792-95b1-4190103afea2 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:54.915809 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-844d67a9-e072-4792-95b1-4190103afea2 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:55.053827 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-a95856a7-20a4-4285-9074-f19961ca0c00 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:55.054470 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-a95856a7-20a4-4285-9074-f19961ca0c00 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: ba5cd412-0d20-4d2e-9f5e-de18f268008a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:55.068760 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a95856a7-20a4-4285-9074-f19961ca0c00 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:55.069291 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a95856a7-20a4-4285-9074-f19961ca0c00 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:55.069739 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a95856a7-20a4-4285-9074-f19961ca0c00 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:55.070453 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a95856a7-20a4-4285-9074-f19961ca0c00 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:55.071450 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a95856a7-20a4-4285-9074-f19961ca0c00 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:55.071879 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a95856a7-20a4-4285-9074-f19961ca0c00 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:55.249451 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-a95856a7-20a4-4285-9074-f19961ca0c00 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78e9afd772c4de981cac8f5817ec356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765c62cac2ee4406b23a5baa85c52ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:55.258944 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-a95856a7-20a4-4285-9074-f19961ca0c00 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/ba5cd412-0d20-4d2e-9f5e-de18f268008a" status: 200 len: 1527 microversion: 2.1 time: 0.208284 Oct 08 21:09:55.259865 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2200/4296] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:55 2022] GET /compute/v2.1/servers/ba5cd412-0d20-4d2e-9f5e-de18f268008a => generated 1527 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:09:55.299412 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-844d67a9-e072-4792-95b1-4190103afea2 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:55.311291 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-844d67a9-e072-4792-95b1-4190103afea2 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 200 len: 1503 microversion: 2.1 time: 0.410975 Oct 08 21:09:55.331650 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2097/4297] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:54 2022] GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 1503 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:09:55.338540 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-5d484b90-b5b8-4c52-9155-28670a5640ef tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:09:55.341917 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-5d484b90-b5b8-4c52-9155-28670a5640ef tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: 89d969cd-5514-4a4d-9c3c-1b408fff2f44] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:55.352594 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5d484b90-b5b8-4c52-9155-28670a5640ef tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:55.353303 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5d484b90-b5b8-4c52-9155-28670a5640ef tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:55.353826 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5d484b90-b5b8-4c52-9155-28670a5640ef tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:55.354638 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5d484b90-b5b8-4c52-9155-28670a5640ef tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:55.355198 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5d484b90-b5b8-4c52-9155-28670a5640ef tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:55.355720 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5d484b90-b5b8-4c52-9155-28670a5640ef tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:55.373627 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-5d484b90-b5b8-4c52-9155-28670a5640ef tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] HTTP exception thrown: Instance 89d969cd-5514-4a4d-9c3c-1b408fff2f44 could not be found. Oct 08 21:09:55.377282 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-5d484b90-b5b8-4c52-9155-28670a5640ef tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Request method failure captured: Oct 08 21:09:55.377282 ncdv-master-1 devstack@n-api.service[140492]: request: POST /compute/v2.1/servers/89d969cd-5514-4a4d-9c3c-1b408fff2f44/action HTTP/1.1 Oct 08 21:09:55.377282 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:09:55.377282 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:09:55.377282 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:09:55.377282 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 28 Oct 08 21:09:55.377282 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:09:55.377282 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:09:55.377282 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:09:55.377282 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:09:55.377282 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQebW09Z3m936-d3SrnQA9UQ3KXQvUYeQwL43ufWdoxmQhUwYBWv-JT053t_VYPo9wAVRoCqYQy8Hhh8zc2n570KpS0qNVLik822FjYabkSIZMA_ubWypXzSwo3J04zV1MoSSz79D-b8-ZvwYCEIbwpbfyn5opgOjnO6EXvq1UNPaSyQ Oct 08 21:09:55.377282 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:09:55.377282 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:09:55.377282 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:09:55.377282 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:09:55.377282 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:09:55.377282 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:09:55.377282 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 0ae02675057e4f27bc1980348afc8ca1 Oct 08 21:09:55.377282 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-ServersNegativeTestJSON-1441071354 Oct 08 21:09:55.377282 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:09:55.377282 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:09:55.377282 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0ae02675057e4f27bc1980348afc8ca1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0ae02675057e4f27bc1980348afc8ca1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0ae02675057e4f27bc1980348afc8ca1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0ae02675057e4f27bc1980348afc8ca1"}]}] Oct 08 21:09:55.377282 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-ServersNegativeTestJSON-1441071354 Oct 08 21:09:55.377282 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 0ae02675057e4f27bc1980348afc8ca1 Oct 08 21:09:55.377282 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1441071354 Oct 08 21:09:55.377282 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-ServersNegativeTestJSON-1441071354-project Oct 08 21:09:55.377282 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:09:55.377282 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:09:55.377282 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 6a78d352c143483c8e4702d789d4c516 Oct 08 21:09:55.377282 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-ServersNegativeTestJSON-1441071354-project Oct 08 21:09:55.377282 ncdv-master-1 devstack@n-api.service[140492]: Oct 08 21:09:55.377282 ncdv-master-1 devstack@n-api.service[140492]: {"reboot": {"type": "SOFT"}} Oct 08 21:09:55.377282 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 21:09:55.377282 ncdv-master-1 devstack@n-api.service[140492]: exception: Instance 89d969cd-5514-4a4d-9c3c-1b408fff2f44 could not be found. Oct 08 21:09:55.377282 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': '89d969cd-5514-4a4d-9c3c-1b408fff2f44', 'body': {'reboot': {'type': 'SOFT'}}} Oct 08 21:09:55.377282 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:09:55.377282 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:09:55.377282 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:09:55.377282 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:09:55.377282 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:09:55.377282 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:09:55.377282 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:09:55.377282 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:09:55.377282 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:09:55.377282 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:09:55.377282 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89d969cd-5514-4a4d-9c3c-1b408fff2f44 could not be found. Oct 08 21:09:55.377282 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:09:55.377282 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:09:55.377282 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:09:55.377282 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:09:55.377282 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:09:55.377282 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:09:55.377282 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:09:55.377282 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:09:55.377282 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:09:55.377282 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:09:55.377282 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 21:09:55.377282 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 21:09:55.377282 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Oct 08 21:09:55.377282 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 08 21:09:55.377282 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:09:55.377282 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:09:55.377282 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:09:55.377282 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:09:55.383258 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89d969cd-5514-4a4d-9c3c-1b408fff2f44 could not be found. Oct 08 21:09:55.383258 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:09:55.383258 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:09:55.383258 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:09:55.383258 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:09:55.383258 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:09:55.383258 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:09:55.383258 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:09:55.383258 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:09:55.383258 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89d969cd-5514-4a4d-9c3c-1b408fff2f44 could not be found. Oct 08 21:09:55.383258 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:09:55.385475 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-5d484b90-b5b8-4c52-9155-28670a5640ef tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Returning 404 to user: Instance 89d969cd-5514-4a4d-9c3c-1b408fff2f44 could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:09:55.386621 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-5d484b90-b5b8-4c52-9155-28670a5640ef tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "POST /compute/v2.1/servers/89d969cd-5514-4a4d-9c3c-1b408fff2f44/action" status: 404 len: 111 microversion: 2.1 time: 0.053458 Oct 08 21:09:55.387845 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2201/4298] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:09:55 2022] POST /compute/v2.1/servers/89d969cd-5514-4a4d-9c3c-1b408fff2f44/action => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:09:55.397110 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-abfbb4c4-df41-447f-84a0-baff9aa83a3d tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:55.398262 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-abfbb4c4-df41-447f-84a0-baff9aa83a3d tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:55.408327 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-abfbb4c4-df41-447f-84a0-baff9aa83a3d tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:55.408916 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-abfbb4c4-df41-447f-84a0-baff9aa83a3d tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:55.409295 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-abfbb4c4-df41-447f-84a0-baff9aa83a3d tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:55.410093 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-abfbb4c4-df41-447f-84a0-baff9aa83a3d tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:55.410595 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-abfbb4c4-df41-447f-84a0-baff9aa83a3d tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:55.411028 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-abfbb4c4-df41-447f-84a0-baff9aa83a3d tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:55.459901 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-32486d82-e22f-4f74-8dfd-ec520d7e8692 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:55.460553 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-32486d82-e22f-4f74-8dfd-ec520d7e8692 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] [instance: 3fed4df9-92ff-4040-8fa7-db370960dc06] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:55.477668 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-32486d82-e22f-4f74-8dfd-ec520d7e8692 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:55.477900 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-32486d82-e22f-4f74-8dfd-ec520d7e8692 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:55.478250 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-32486d82-e22f-4f74-8dfd-ec520d7e8692 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:55.478996 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-32486d82-e22f-4f74-8dfd-ec520d7e8692 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:55.479452 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-32486d82-e22f-4f74-8dfd-ec520d7e8692 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:55.479891 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-32486d82-e22f-4f74-8dfd-ec520d7e8692 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:55.712812 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-32486d82-e22f-4f74-8dfd-ec520d7e8692 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30fe0e1ffa1040ec85d3c32d8b741c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd0e7c24154409824f96e9e99da357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:55.723281 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-32486d82-e22f-4f74-8dfd-ec520d7e8692 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "GET /compute/v2.1/servers/3fed4df9-92ff-4040-8fa7-db370960dc06" status: 200 len: 1479 microversion: 2.1 time: 0.266909 Oct 08 21:09:55.744157 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2202/4299] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:55 2022] GET /compute/v2.1/servers/3fed4df9-92ff-4040-8fa7-db370960dc06 => generated 1479 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:09:55.753133 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-d1163268-bd1f-4cda-b186-a4ef4e85e350 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:55.754268 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-d1163268-bd1f-4cda-b186-a4ef4e85e350 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] [instance: 159e29dd-802c-4059-99f9-bb7c113d430b] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:55.761420 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d1163268-bd1f-4cda-b186-a4ef4e85e350 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:55.762142 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d1163268-bd1f-4cda-b186-a4ef4e85e350 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:55.762740 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d1163268-bd1f-4cda-b186-a4ef4e85e350 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:55.763615 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d1163268-bd1f-4cda-b186-a4ef4e85e350 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:55.764526 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d1163268-bd1f-4cda-b186-a4ef4e85e350 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:55.765227 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d1163268-bd1f-4cda-b186-a4ef4e85e350 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:55.881241 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-abfbb4c4-df41-447f-84a0-baff9aa83a3d tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:55.895655 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-abfbb4c4-df41-447f-84a0-baff9aa83a3d tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 200 len: 1503 microversion: 2.1 time: 0.503531 Oct 08 21:09:55.905244 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2098/4300] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:55 2022] GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 1503 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:09:55.917392 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-0fbadf41-1a1a-4991-a900-c35c0b08b10c tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-178044971"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:09:55.921305 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-0fbadf41-1a1a-4991-a900-c35c0b08b10c tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] [instance: 3fed4df9-92ff-4040-8fa7-db370960dc06] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:55.977029 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0fbadf41-1a1a-4991-a900-c35c0b08b10c tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:55.977029 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0fbadf41-1a1a-4991-a900-c35c0b08b10c tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:55.977029 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0fbadf41-1a1a-4991-a900-c35c0b08b10c tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:55.977029 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0fbadf41-1a1a-4991-a900-c35c0b08b10c tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:55.983105 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0fbadf41-1a1a-4991-a900-c35c0b08b10c tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:55.984001 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0fbadf41-1a1a-4991-a900-c35c0b08b10c tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:56.524537 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-d1163268-bd1f-4cda-b186-a4ef4e85e350 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:56.536195 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-d1163268-bd1f-4cda-b186-a4ef4e85e350 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:56.543280 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-d1163268-bd1f-4cda-b186-a4ef4e85e350 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:56.546754 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-d1163268-bd1f-4cda-b186-a4ef4e85e350 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] 10.222.0.26 "GET /compute/v2.1/servers/159e29dd-802c-4059-99f9-bb7c113d430b" status: 200 len: 1738 microversion: 2.20 time: 0.800853 Oct 08 21:09:56.547281 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2203/4301] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:09:55 2022] GET /compute/v2.1/servers/159e29dd-802c-4059-99f9-bb7c113d430b => generated 1738 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:09:56.552259 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-d133df55-464a-43a3-a71a-789f274508d7 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:56.552961 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-d133df55-464a-43a3-a71a-789f274508d7 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:56.585404 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-0fbadf41-1a1a-4991-a900-c35c0b08b10c tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "POST /compute/v2.1/servers/3fed4df9-92ff-4040-8fa7-db370960dc06/action" status: 202 len: 0 microversion: 2.1 time: 0.685436 Oct 08 21:09:56.594001 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2099/4302] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:09:55 2022] POST /compute/v2.1/servers/3fed4df9-92ff-4040-8fa7-db370960dc06/action => generated 0 bytes in 697 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 08 21:09:56.605683 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-61a38e87-a826-4609-ac15-93f7de607386 req-e79a7b6e-3cda-48fa-9734-58718d55ff08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba5cd412-0d20-4d2e-9f5e-de18f268008a", "name": "network-vif-plugged", "status": "completed", "tag": "3c7983b1-4926-4db7-acf7-8d73050025e7"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:09:56.618913 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d133df55-464a-43a3-a71a-789f274508d7 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:56.619424 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d133df55-464a-43a3-a71a-789f274508d7 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:56.619899 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d133df55-464a-43a3-a71a-789f274508d7 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:56.620787 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d133df55-464a-43a3-a71a-789f274508d7 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:56.621140 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d133df55-464a-43a3-a71a-789f274508d7 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:56.640063 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d133df55-464a-43a3-a71a-789f274508d7 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:56.658634 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-61a38e87-a826-4609-ac15-93f7de607386 req-e79a7b6e-3cda-48fa-9734-58718d55ff08 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:56.659111 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-61a38e87-a826-4609-ac15-93f7de607386 req-e79a7b6e-3cda-48fa-9734-58718d55ff08 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:56.659551 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-61a38e87-a826-4609-ac15-93f7de607386 req-e79a7b6e-3cda-48fa-9734-58718d55ff08 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:56.700718 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-61a38e87-a826-4609-ac15-93f7de607386 req-e79a7b6e-3cda-48fa-9734-58718d55ff08 service nova] Creating event network-vif-plugged:3c7983b1-4926-4db7-acf7-8d73050025e7 for instance ba5cd412-0d20-4d2e-9f5e-de18f268008a on nch1-master-1 Oct 08 21:09:56.721339 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-61a38e87-a826-4609-ac15-93f7de607386 req-e79a7b6e-3cda-48fa-9734-58718d55ff08 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125514 Oct 08 21:09:56.722601 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2100/4303] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:09:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:09:56.736542 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-926d6350-4d39-4840-a9e0-3b440dd51e91 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:56.737307 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-926d6350-4d39-4840-a9e0-3b440dd51e91 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: ba5cd412-0d20-4d2e-9f5e-de18f268008a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:56.764362 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-926d6350-4d39-4840-a9e0-3b440dd51e91 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:56.765598 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-926d6350-4d39-4840-a9e0-3b440dd51e91 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:56.766408 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-926d6350-4d39-4840-a9e0-3b440dd51e91 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:56.768173 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-926d6350-4d39-4840-a9e0-3b440dd51e91 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:56.769142 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-926d6350-4d39-4840-a9e0-3b440dd51e91 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:56.769917 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-926d6350-4d39-4840-a9e0-3b440dd51e91 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:57.136342 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-d133df55-464a-43a3-a71a-789f274508d7 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:57.146778 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-d133df55-464a-43a3-a71a-789f274508d7 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 200 len: 1503 microversion: 2.1 time: 0.598402 Oct 08 21:09:57.162645 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2204/4304] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:56 2022] GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 1503 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:09:57.175858 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-bde977cf-7e37-42d1-93e0-353b2ef89ec8 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:57.178877 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-bde977cf-7e37-42d1-93e0-353b2ef89ec8 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] [instance: 1b68ff0f-2dfe-4844-b7ce-556768c5d3e2] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:57.188472 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bde977cf-7e37-42d1-93e0-353b2ef89ec8 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:57.189285 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bde977cf-7e37-42d1-93e0-353b2ef89ec8 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:57.190031 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bde977cf-7e37-42d1-93e0-353b2ef89ec8 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:57.191168 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bde977cf-7e37-42d1-93e0-353b2ef89ec8 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:57.191955 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bde977cf-7e37-42d1-93e0-353b2ef89ec8 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:57.192662 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bde977cf-7e37-42d1-93e0-353b2ef89ec8 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:57.232432 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-bde977cf-7e37-42d1-93e0-353b2ef89ec8 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] 10.222.0.26 "GET /compute/v2.1/servers/1b68ff0f-2dfe-4844-b7ce-556768c5d3e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067557 Oct 08 21:09:57.233329 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2205/4305] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Oct 8 21:09:57 2022] GET /compute/v2.1/servers/1b68ff0f-2dfe-4844-b7ce-556768c5d3e2/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:09:57.246145 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-a9987f93-bf90-4c43-b866-9e1e11ea480c tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Calling method '.version_select at 0x7f1a875331f0>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:57.388820 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-926d6350-4d39-4840-a9e0-3b440dd51e91 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78e9afd772c4de981cac8f5817ec356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765c62cac2ee4406b23a5baa85c52ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:57.398164 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-926d6350-4d39-4840-a9e0-3b440dd51e91 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/ba5cd412-0d20-4d2e-9f5e-de18f268008a" status: 200 len: 1522 microversion: 2.1 time: 0.674191 Oct 08 21:09:57.400539 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2101/4306] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:56 2022] GET /compute/v2.1/servers/ba5cd412-0d20-4d2e-9f5e-de18f268008a => generated 1522 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:09:57.405682 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-aa3d078b-0be1-430d-9680-249ebdf73f52 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:09:57.408240 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-aa3d078b-0be1-430d-9680-249ebdf73f52 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: bfdb5c36-f739-424b-b5d0-af52cb6d4b85] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:57.424946 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-aa3d078b-0be1-430d-9680-249ebdf73f52 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] HTTP exception thrown: Instance bfdb5c36-f739-424b-b5d0-af52cb6d4b85 could not be found. Oct 08 21:09:57.428662 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-aa3d078b-0be1-430d-9680-249ebdf73f52 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Request method failure captured: Oct 08 21:09:57.428662 ncdv-master-1 devstack@n-api.service[140491]: request: POST /compute/v2.1/servers/bfdb5c36-f739-424b-b5d0-af52cb6d4b85/action HTTP/1.1 Oct 08 21:09:57.428662 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:09:57.428662 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:09:57.428662 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:09:57.428662 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 28 Oct 08 21:09:57.428662 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:09:57.428662 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:09:57.428662 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:09:57.428662 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:09:57.428662 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQebW09Z3m936-d3SrnQA9UQ3KXQvUYeQwL43ufWdoxmQhUwYBWv-JT053t_VYPo9wAVRoCqYQy8Hhh8zc2n570KpS0qNVLik822FjYabkSIZMA_ubWypXzSwo3J04zV1MoSSz79D-b8-ZvwYCEIbwpbfyn5opgOjnO6EXvq1UNPaSyQ Oct 08 21:09:57.428662 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:09:57.428662 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:09:57.428662 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:09:57.428662 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:09:57.428662 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:09:57.428662 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:09:57.428662 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 0ae02675057e4f27bc1980348afc8ca1 Oct 08 21:09:57.428662 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-ServersNegativeTestJSON-1441071354 Oct 08 21:09:57.428662 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:09:57.428662 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:09:57.428662 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0ae02675057e4f27bc1980348afc8ca1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0ae02675057e4f27bc1980348afc8ca1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0ae02675057e4f27bc1980348afc8ca1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0ae02675057e4f27bc1980348afc8ca1"}]}] Oct 08 21:09:57.428662 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-ServersNegativeTestJSON-1441071354 Oct 08 21:09:57.428662 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 0ae02675057e4f27bc1980348afc8ca1 Oct 08 21:09:57.428662 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1441071354 Oct 08 21:09:57.428662 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-ServersNegativeTestJSON-1441071354-project Oct 08 21:09:57.428662 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:09:57.428662 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:09:57.428662 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 6a78d352c143483c8e4702d789d4c516 Oct 08 21:09:57.428662 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-ServersNegativeTestJSON-1441071354-project Oct 08 21:09:57.428662 ncdv-master-1 devstack@n-api.service[140491]: Oct 08 21:09:57.428662 ncdv-master-1 devstack@n-api.service[140491]: {"reboot": {"type": "SOFT"}} Oct 08 21:09:57.428662 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:09:57.428662 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance bfdb5c36-f739-424b-b5d0-af52cb6d4b85 could not be found. Oct 08 21:09:57.428662 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': 'bfdb5c36-f739-424b-b5d0-af52cb6d4b85', 'body': {'reboot': {'type': 'SOFT'}}} Oct 08 21:09:57.428662 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:09:57.428662 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:09:57.428662 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:09:57.428662 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:09:57.428662 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:09:57.428662 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:09:57.428662 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 08 21:09:57.428662 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 08 21:09:57.428662 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bfdb5c36-f739-424b-b5d0-af52cb6d4b85 could not be found. Oct 08 21:09:57.428662 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:09:57.428662 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:09:57.428662 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:09:57.428662 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:09:57.428662 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:09:57.428662 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:09:57.428662 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:09:57.428662 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:09:57.428662 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:09:57.428662 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:09:57.428662 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 21:09:57.428662 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 21:09:57.428662 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Oct 08 21:09:57.428662 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 08 21:09:57.428662 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:09:57.428662 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:09:57.428662 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:09:57.428662 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:09:57.428662 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bfdb5c36-f739-424b-b5d0-af52cb6d4b85 could not be found. Oct 08 21:09:57.428662 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:09:57.434173 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:09:57.434173 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:09:57.434173 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:09:57.434173 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:09:57.434173 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:09:57.434173 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:09:57.434173 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:09:57.434173 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bfdb5c36-f739-424b-b5d0-af52cb6d4b85 could not be found. Oct 08 21:09:57.434173 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:09:57.436394 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-aa3d078b-0be1-430d-9680-249ebdf73f52 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Returning 404 to user: Instance bfdb5c36-f739-424b-b5d0-af52cb6d4b85 could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:09:57.437636 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-aa3d078b-0be1-430d-9680-249ebdf73f52 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "POST /compute/v2.1/servers/bfdb5c36-f739-424b-b5d0-af52cb6d4b85/action" status: 404 len: 111 microversion: 2.1 time: 0.035829 Oct 08 21:09:57.438845 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2102/4307] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:09:57 2022] POST /compute/v2.1/servers/bfdb5c36-f739-424b-b5d0-af52cb6d4b85/action => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:09:57.446608 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-ae3bcc88-335b-480c-8fb6-2cc3f792e301 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:57.447394 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-ae3bcc88-335b-480c-8fb6-2cc3f792e301 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] [instance: 1b68ff0f-2dfe-4844-b7ce-556768c5d3e2] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:57.459939 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ae3bcc88-335b-480c-8fb6-2cc3f792e301 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:57.461025 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ae3bcc88-335b-480c-8fb6-2cc3f792e301 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:57.462420 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ae3bcc88-335b-480c-8fb6-2cc3f792e301 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:57.463350 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ae3bcc88-335b-480c-8fb6-2cc3f792e301 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:57.464186 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ae3bcc88-335b-480c-8fb6-2cc3f792e301 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:57.464823 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ae3bcc88-335b-480c-8fb6-2cc3f792e301 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:57.497282 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:09:57.502346 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-ae3bcc88-335b-480c-8fb6-2cc3f792e301 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] 10.222.0.26 "GET /compute/v2.1/servers/1b68ff0f-2dfe-4844-b7ce-556768c5d3e2/os-volume_attachments/1dddb5cf-401e-4276-b7d2-76b0ba48acc7" status: 200 len: 194 microversion: 2.1 time: 0.062219 Oct 08 21:09:57.509321 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2103/4308] 10.222.0.26 () {58 vars in 1413 bytes} [Sat Oct 8 21:09:57 2022] GET /compute/v2.1/servers/1b68ff0f-2dfe-4844-b7ce-556768c5d3e2/os-volume_attachments/1dddb5cf-401e-4276-b7d2-76b0ba48acc7 => generated 194 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:09:57.519258 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-157615cf-e719-4524-9965-2bfe01083338 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:57.519908 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-157615cf-e719-4524-9965-2bfe01083338 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:57.537988 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-157615cf-e719-4524-9965-2bfe01083338 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:57.538547 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-157615cf-e719-4524-9965-2bfe01083338 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:57.539170 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-157615cf-e719-4524-9965-2bfe01083338 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:57.540449 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-157615cf-e719-4524-9965-2bfe01083338 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:57.540923 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-157615cf-e719-4524-9965-2bfe01083338 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:57.543715 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-157615cf-e719-4524-9965-2bfe01083338 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:58.069641 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-157615cf-e719-4524-9965-2bfe01083338 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:58.095677 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-157615cf-e719-4524-9965-2bfe01083338 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 200 len: 1503 microversion: 2.1 time: 0.582439 Oct 08 21:09:58.100490 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2104/4309] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:57 2022] GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 1503 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:09:58.131842 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-5cb36410-34e5-4a87-b1e2-6b33cf6d36d0 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:58.132762 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-5cb36410-34e5-4a87-b1e2-6b33cf6d36d0 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] [instance: 159e29dd-802c-4059-99f9-bb7c113d430b] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:58.151156 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:SELECT=100 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:09:58.154436 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5cb36410-34e5-4a87-b1e2-6b33cf6d36d0 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:58.154954 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5cb36410-34e5-4a87-b1e2-6b33cf6d36d0 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:58.156849 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5cb36410-34e5-4a87-b1e2-6b33cf6d36d0 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:58.160023 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5cb36410-34e5-4a87-b1e2-6b33cf6d36d0 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:58.177850 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5cb36410-34e5-4a87-b1e2-6b33cf6d36d0 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:58.178595 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5cb36410-34e5-4a87-b1e2-6b33cf6d36d0 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:59.008466 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-5cb36410-34e5-4a87-b1e2-6b33cf6d36d0 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:59.027538 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-5cb36410-34e5-4a87-b1e2-6b33cf6d36d0 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:59.031157 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-5cb36410-34e5-4a87-b1e2-6b33cf6d36d0 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:59.037396 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-5cb36410-34e5-4a87-b1e2-6b33cf6d36d0 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] 10.222.0.26 "GET /compute/v2.1/servers/159e29dd-802c-4059-99f9-bb7c113d430b" status: 200 len: 1738 microversion: 2.20 time: 0.933589 Oct 08 21:09:59.057455 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2105/4310] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:09:58 2022] GET /compute/v2.1/servers/159e29dd-802c-4059-99f9-bb7c113d430b => generated 1738 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:09:59.070894 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-0cb0df3c-ed10-4bcb-8c50-9baa19b92fe8 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:59.071601 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-0cb0df3c-ed10-4bcb-8c50-9baa19b92fe8 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:59.100334 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0cb0df3c-ed10-4bcb-8c50-9baa19b92fe8 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:59.101526 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0cb0df3c-ed10-4bcb-8c50-9baa19b92fe8 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:59.109058 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0cb0df3c-ed10-4bcb-8c50-9baa19b92fe8 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:59.114616 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0cb0df3c-ed10-4bcb-8c50-9baa19b92fe8 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:59.117912 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0cb0df3c-ed10-4bcb-8c50-9baa19b92fe8 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:59.119137 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0cb0df3c-ed10-4bcb-8c50-9baa19b92fe8 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:59.458945 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-0cb0df3c-ed10-4bcb-8c50-9baa19b92fe8 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:59.468418 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-0cb0df3c-ed10-4bcb-8c50-9baa19b92fe8 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 200 len: 1503 microversion: 2.1 time: 0.421918 Oct 08 21:09:59.469009 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2106/4311] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:59 2022] GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 1503 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:09:59.515084 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-8dd29f2c-b4f8-4ad6-941c-8934396e2791 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:09:59.516004 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-8dd29f2c-b4f8-4ad6-941c-8934396e2791 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: ba5cd412-0d20-4d2e-9f5e-de18f268008a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:59.523312 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8dd29f2c-b4f8-4ad6-941c-8934396e2791 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:59.529385 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8dd29f2c-b4f8-4ad6-941c-8934396e2791 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:59.530161 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8dd29f2c-b4f8-4ad6-941c-8934396e2791 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:59.530694 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8dd29f2c-b4f8-4ad6-941c-8934396e2791 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:59.531337 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8dd29f2c-b4f8-4ad6-941c-8934396e2791 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:59.531920 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8dd29f2c-b4f8-4ad6-941c-8934396e2791 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:59.888236 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-8dd29f2c-b4f8-4ad6-941c-8934396e2791 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78e9afd772c4de981cac8f5817ec356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765c62cac2ee4406b23a5baa85c52ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:09:59.902159 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-8dd29f2c-b4f8-4ad6-941c-8934396e2791 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/ba5cd412-0d20-4d2e-9f5e-de18f268008a" status: 200 len: 1522 microversion: 2.1 time: 0.428000 Oct 08 21:09:59.906001 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2107/4312] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:09:59 2022] GET /compute/v2.1/servers/ba5cd412-0d20-4d2e-9f5e-de18f268008a => generated 1522 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:09:59.915374 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-10172c8e-5db4-475e-a942-da3c59530e9a tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:09:59.930603 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-10172c8e-5db4-475e-a942-da3c59530e9a tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: 89d969cd-5514-4a4d-9c3c-1b408fff2f44] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:09:59.944843 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-10172c8e-5db4-475e-a942-da3c59530e9a tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:59.947722 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-10172c8e-5db4-475e-a942-da3c59530e9a tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:59.948378 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-10172c8e-5db4-475e-a942-da3c59530e9a tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:59.949311 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-10172c8e-5db4-475e-a942-da3c59530e9a tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:09:59.952984 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-10172c8e-5db4-475e-a942-da3c59530e9a tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:09:59.953669 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-10172c8e-5db4-475e-a942-da3c59530e9a tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:09:59.999332 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-10172c8e-5db4-475e-a942-da3c59530e9a tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] HTTP exception thrown: Instance 89d969cd-5514-4a4d-9c3c-1b408fff2f44 could not be found. Oct 08 21:10:00.003063 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-10172c8e-5db4-475e-a942-da3c59530e9a tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Request method failure captured: Oct 08 21:10:00.003063 ncdv-master-1 devstack@n-api.service[140491]: request: POST /compute/v2.1/servers/89d969cd-5514-4a4d-9c3c-1b408fff2f44/action HTTP/1.1 Oct 08 21:10:00.003063 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:10:00.003063 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:10:00.003063 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:10:00.003063 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 65 Oct 08 21:10:00.003063 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:10:00.003063 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:10:00.003063 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:10:00.003063 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:10:00.003063 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQebW09Z3m936-d3SrnQA9UQ3KXQvUYeQwL43ufWdoxmQhUwYBWv-JT053t_VYPo9wAVRoCqYQy8Hhh8zc2n570KpS0qNVLik822FjYabkSIZMA_ubWypXzSwo3J04zV1MoSSz79D-b8-ZvwYCEIbwpbfyn5opgOjnO6EXvq1UNPaSyQ Oct 08 21:10:00.003063 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:10:00.003063 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:10:00.003063 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:10:00.003063 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:10:00.003063 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:10:00.003063 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:10:00.003063 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 0ae02675057e4f27bc1980348afc8ca1 Oct 08 21:10:00.003063 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-ServersNegativeTestJSON-1441071354 Oct 08 21:10:00.003063 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:10:00.003063 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:10:00.003063 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0ae02675057e4f27bc1980348afc8ca1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0ae02675057e4f27bc1980348afc8ca1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0ae02675057e4f27bc1980348afc8ca1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0ae02675057e4f27bc1980348afc8ca1"}]}] Oct 08 21:10:00.003063 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-ServersNegativeTestJSON-1441071354 Oct 08 21:10:00.003063 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 0ae02675057e4f27bc1980348afc8ca1 Oct 08 21:10:00.003063 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1441071354 Oct 08 21:10:00.003063 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-ServersNegativeTestJSON-1441071354-project Oct 08 21:10:00.003063 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:10:00.003063 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:10:00.003063 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 6a78d352c143483c8e4702d789d4c516 Oct 08 21:10:00.003063 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-ServersNegativeTestJSON-1441071354-project Oct 08 21:10:00.003063 ncdv-master-1 devstack@n-api.service[140491]: Oct 08 21:10:00.003063 ncdv-master-1 devstack@n-api.service[140491]: {"rebuild": {"imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355"}} Oct 08 21:10:00.003063 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:10:00.003063 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance 89d969cd-5514-4a4d-9c3c-1b408fff2f44 could not be found. Oct 08 21:10:00.003063 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': '89d969cd-5514-4a4d-9c3c-1b408fff2f44', 'body': {'rebuild': {'imageRef': 'c508bd7f-7db9-4b2c-af7c-be54a855c355'}}} Oct 08 21:10:00.003063 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:10:00.003063 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:10:00.003063 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:10:00.003063 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:10:00.003063 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:10:00.003063 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:10:00.003063 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:10:00.003063 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:10:00.003063 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:10:00.003063 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:10:00.003063 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89d969cd-5514-4a4d-9c3c-1b408fff2f44 could not be found. Oct 08 21:10:00.003063 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:10:00.003063 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:10:00.003063 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:10:00.003063 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:10:00.003063 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:10:00.003063 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:10:00.003063 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:10:00.003063 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:10:00.003063 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:10:00.003063 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:10:00.003063 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 21:10:00.003063 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 21:10:00.003063 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 21:10:00.003063 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 21:10:00.003063 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 21:10:00.003063 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 21:10:00.003063 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 08 21:10:00.003063 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Oct 08 21:10:00.006771 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 08 21:10:00.006771 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:10:00.006771 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:10:00.006771 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:10:00.006771 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:10:00.006771 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89d969cd-5514-4a4d-9c3c-1b408fff2f44 could not be found. Oct 08 21:10:00.006771 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:10:00.006771 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:10:00.006771 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:10:00.006771 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:10:00.006771 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:10:00.006771 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:10:00.006771 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:10:00.006771 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:10:00.006771 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89d969cd-5514-4a4d-9c3c-1b408fff2f44 could not be found. Oct 08 21:10:00.006771 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:10:00.009946 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-10172c8e-5db4-475e-a942-da3c59530e9a tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Returning 404 to user: Instance 89d969cd-5514-4a4d-9c3c-1b408fff2f44 could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:10:00.012122 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-10172c8e-5db4-475e-a942-da3c59530e9a tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "POST /compute/v2.1/servers/89d969cd-5514-4a4d-9c3c-1b408fff2f44/action" status: 404 len: 111 microversion: 2.1 time: 0.104892 Oct 08 21:10:00.013869 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2108/4313] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:09:59 2022] POST /compute/v2.1/servers/89d969cd-5514-4a4d-9c3c-1b408fff2f44/action => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:10:00.031855 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-82235410-caeb-4771-9441-9c56ae4fc35d tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ab61ecb6-055f-430c-913d-93288fd4b038"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:10:00.035883 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-82235410-caeb-4771-9441-9c56ae4fc35d tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] [instance: 1b68ff0f-2dfe-4844-b7ce-556768c5d3e2] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:10:00.046539 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-82235410-caeb-4771-9441-9c56ae4fc35d tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:00.047276 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-82235410-caeb-4771-9441-9c56ae4fc35d tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:00.047916 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-82235410-caeb-4771-9441-9c56ae4fc35d tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:00.049210 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-82235410-caeb-4771-9441-9c56ae4fc35d tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:00.049919 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-82235410-caeb-4771-9441-9c56ae4fc35d tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:00.050555 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-82235410-caeb-4771-9441-9c56ae4fc35d tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:00.659599 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-82235410-caeb-4771-9441-9c56ae4fc35d tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] 10.222.0.26 "POST /compute/v2.1/servers/1b68ff0f-2dfe-4844-b7ce-556768c5d3e2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.641578 Oct 08 21:10:00.660319 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2109/4314] 10.222.0.26 () {60 vars in 1323 bytes} [Sat Oct 8 21:10:00 2022] POST /compute/v2.1/servers/1b68ff0f-2dfe-4844-b7ce-556768c5d3e2/os-volume_attachments => generated 194 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:10:00.682756 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-68c0171f-31cf-4cf9-8808-922561b7fb81 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:10:00.684571 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-68c0171f-31cf-4cf9-8808-922561b7fb81 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:10:00.699546 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-68c0171f-31cf-4cf9-8808-922561b7fb81 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:00.700053 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-68c0171f-31cf-4cf9-8808-922561b7fb81 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:00.700596 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-68c0171f-31cf-4cf9-8808-922561b7fb81 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:00.701875 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-68c0171f-31cf-4cf9-8808-922561b7fb81 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:00.702231 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-68c0171f-31cf-4cf9-8808-922561b7fb81 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:00.702674 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-68c0171f-31cf-4cf9-8808-922561b7fb81 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:01.034706 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-68c0171f-31cf-4cf9-8808-922561b7fb81 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:01.045696 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-68c0171f-31cf-4cf9-8808-922561b7fb81 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 200 len: 1503 microversion: 2.1 time: 0.373182 Oct 08 21:10:01.046909 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2110/4315] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:10:00 2022] GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 1503 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:10:01.053820 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-4470877b-16a7-4914-aa9a-96d5fff73900 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:10:01.055058 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-4470877b-16a7-4914-aa9a-96d5fff73900 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] [instance: 159e29dd-802c-4059-99f9-bb7c113d430b] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:10:01.075372 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4470877b-16a7-4914-aa9a-96d5fff73900 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:01.077967 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4470877b-16a7-4914-aa9a-96d5fff73900 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:01.088686 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4470877b-16a7-4914-aa9a-96d5fff73900 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:01.091255 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4470877b-16a7-4914-aa9a-96d5fff73900 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:01.092224 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4470877b-16a7-4914-aa9a-96d5fff73900 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:01.092706 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4470877b-16a7-4914-aa9a-96d5fff73900 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:01.335044 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-4470877b-16a7-4914-aa9a-96d5fff73900 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:01.344613 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-4470877b-16a7-4914-aa9a-96d5fff73900 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:01.346105 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-4470877b-16a7-4914-aa9a-96d5fff73900 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:01.348324 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-4470877b-16a7-4914-aa9a-96d5fff73900 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] 10.222.0.26 "GET /compute/v2.1/servers/159e29dd-802c-4059-99f9-bb7c113d430b" status: 200 len: 1738 microversion: 2.20 time: 0.300226 Oct 08 21:10:01.361748 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2111/4316] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:10:01 2022] GET /compute/v2.1/servers/159e29dd-802c-4059-99f9-bb7c113d430b => generated 1738 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:10:01.373947 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-45ab03c9-6b27-450a-8c78-058b7414bd1d req-e3d2b61c-8f89-47dc-ac76-f6722560b6b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fed4df9-92ff-4040-8fa7-db370960dc06", "name": "network-vif-plugged", "status": "completed", "tag": "25804709-1226-432d-bc34-f585676f5c93"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:10:01.391592 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-45ab03c9-6b27-450a-8c78-058b7414bd1d req-e3d2b61c-8f89-47dc-ac76-f6722560b6b9 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:01.392282 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-45ab03c9-6b27-450a-8c78-058b7414bd1d req-e3d2b61c-8f89-47dc-ac76-f6722560b6b9 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:01.393284 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-45ab03c9-6b27-450a-8c78-058b7414bd1d req-e3d2b61c-8f89-47dc-ac76-f6722560b6b9 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:01.459479 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-45ab03c9-6b27-450a-8c78-058b7414bd1d req-e3d2b61c-8f89-47dc-ac76-f6722560b6b9 service nova] Creating event network-vif-plugged:25804709-1226-432d-bc34-f585676f5c93 for instance 3fed4df9-92ff-4040-8fa7-db370960dc06 on nch1-master-1 Oct 08 21:10:01.486170 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-45ab03c9-6b27-450a-8c78-058b7414bd1d req-e3d2b61c-8f89-47dc-ac76-f6722560b6b9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122813 Oct 08 21:10:01.505180 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2112/4317] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:10:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:10:01.529054 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-7b830c10-c32e-4300-93f5-5edbd78e29b6 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:10:01.542150 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-7b830c10-c32e-4300-93f5-5edbd78e29b6 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: ba5cd412-0d20-4d2e-9f5e-de18f268008a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:10:01.570077 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7b830c10-c32e-4300-93f5-5edbd78e29b6 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:01.576448 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7b830c10-c32e-4300-93f5-5edbd78e29b6 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:01.577937 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7b830c10-c32e-4300-93f5-5edbd78e29b6 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:01.581994 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7b830c10-c32e-4300-93f5-5edbd78e29b6 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:01.588971 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7b830c10-c32e-4300-93f5-5edbd78e29b6 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:01.593619 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7b830c10-c32e-4300-93f5-5edbd78e29b6 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:01.928218 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-7b830c10-c32e-4300-93f5-5edbd78e29b6 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78e9afd772c4de981cac8f5817ec356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765c62cac2ee4406b23a5baa85c52ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:01.940415 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-7b830c10-c32e-4300-93f5-5edbd78e29b6 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/ba5cd412-0d20-4d2e-9f5e-de18f268008a" status: 200 len: 1522 microversion: 2.1 time: 0.434017 Oct 08 21:10:01.941669 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2113/4318] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:10:01 2022] GET /compute/v2.1/servers/ba5cd412-0d20-4d2e-9f5e-de18f268008a => generated 1522 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:10:01.958265 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-2dd58e39-67ca-4995-9df5-87ab855a8931 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:10:01.959263 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-2dd58e39-67ca-4995-9df5-87ab855a8931 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:10:01.975450 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2dd58e39-67ca-4995-9df5-87ab855a8931 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:01.976157 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2dd58e39-67ca-4995-9df5-87ab855a8931 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:01.977029 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2dd58e39-67ca-4995-9df5-87ab855a8931 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:01.978090 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2dd58e39-67ca-4995-9df5-87ab855a8931 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:01.978694 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2dd58e39-67ca-4995-9df5-87ab855a8931 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:01.989346 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2dd58e39-67ca-4995-9df5-87ab855a8931 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:02.341034 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-2dd58e39-67ca-4995-9df5-87ab855a8931 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:02.359573 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-2dd58e39-67ca-4995-9df5-87ab855a8931 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 200 len: 1503 microversion: 2.1 time: 0.413706 Oct 08 21:10:02.377419 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2114/4319] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:10:01 2022] GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 1503 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:10:02.418754 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-b77ec414-6148-4400-a011-4ee4a2572f18 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:10:02.422880 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-b77ec414-6148-4400-a011-4ee4a2572f18 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] [instance: 159e29dd-802c-4059-99f9-bb7c113d430b] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:10:02.436154 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b77ec414-6148-4400-a011-4ee4a2572f18 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:02.436831 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b77ec414-6148-4400-a011-4ee4a2572f18 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:02.437108 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b77ec414-6148-4400-a011-4ee4a2572f18 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:02.437862 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b77ec414-6148-4400-a011-4ee4a2572f18 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:02.438329 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b77ec414-6148-4400-a011-4ee4a2572f18 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:02.438768 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b77ec414-6148-4400-a011-4ee4a2572f18 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:02.888566 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-b77ec414-6148-4400-a011-4ee4a2572f18 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:02.899820 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-b77ec414-6148-4400-a011-4ee4a2572f18 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:02.901734 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-b77ec414-6148-4400-a011-4ee4a2572f18 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:02.903403 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-b77ec414-6148-4400-a011-4ee4a2572f18 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] 10.222.0.26 "GET /compute/v2.1/servers/159e29dd-802c-4059-99f9-bb7c113d430b" status: 200 len: 1738 microversion: 2.20 time: 0.515547 Oct 08 21:10:02.905133 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2115/4320] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:10:02 2022] GET /compute/v2.1/servers/159e29dd-802c-4059-99f9-bb7c113d430b => generated 1738 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:10:02.911661 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-bf369958-5cc1-4678-b3cb-ea603648b465 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:10:02.915425 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-bf369958-5cc1-4678-b3cb-ea603648b465 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: 00fec1a9-de4d-452c-9d73-f23dce0f59f0] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:10:02.924326 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-bf369958-5cc1-4678-b3cb-ea603648b465 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] HTTP exception thrown: Instance 00fec1a9-de4d-452c-9d73-f23dce0f59f0 could not be found. Oct 08 21:10:02.933613 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-bf369958-5cc1-4678-b3cb-ea603648b465 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Request method failure captured: Oct 08 21:10:02.933613 ncdv-master-1 devstack@n-api.service[140491]: request: POST /compute/v2.1/servers/00fec1a9-de4d-452c-9d73-f23dce0f59f0/action HTTP/1.1 Oct 08 21:10:02.933613 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:10:02.933613 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:10:02.933613 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:10:02.933613 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 65 Oct 08 21:10:02.933613 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:10:02.933613 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:10:02.933613 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:10:02.933613 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:10:02.933613 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQebW09Z3m936-d3SrnQA9UQ3KXQvUYeQwL43ufWdoxmQhUwYBWv-JT053t_VYPo9wAVRoCqYQy8Hhh8zc2n570KpS0qNVLik822FjYabkSIZMA_ubWypXzSwo3J04zV1MoSSz79D-b8-ZvwYCEIbwpbfyn5opgOjnO6EXvq1UNPaSyQ Oct 08 21:10:02.933613 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:10:02.933613 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:10:02.933613 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:10:02.933613 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:10:02.933613 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:10:02.933613 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:10:02.933613 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 0ae02675057e4f27bc1980348afc8ca1 Oct 08 21:10:02.933613 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-ServersNegativeTestJSON-1441071354 Oct 08 21:10:02.933613 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:10:02.933613 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:10:02.933613 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0ae02675057e4f27bc1980348afc8ca1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0ae02675057e4f27bc1980348afc8ca1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0ae02675057e4f27bc1980348afc8ca1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0ae02675057e4f27bc1980348afc8ca1"}]}] Oct 08 21:10:02.933613 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-ServersNegativeTestJSON-1441071354 Oct 08 21:10:02.933613 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 0ae02675057e4f27bc1980348afc8ca1 Oct 08 21:10:02.933613 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1441071354 Oct 08 21:10:02.933613 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-ServersNegativeTestJSON-1441071354-project Oct 08 21:10:02.933613 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:10:02.933613 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:10:02.933613 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 6a78d352c143483c8e4702d789d4c516 Oct 08 21:10:02.933613 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-ServersNegativeTestJSON-1441071354-project Oct 08 21:10:02.933613 ncdv-master-1 devstack@n-api.service[140491]: Oct 08 21:10:02.933613 ncdv-master-1 devstack@n-api.service[140491]: {"rebuild": {"imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355"}} Oct 08 21:10:02.933613 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:10:02.933613 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance 00fec1a9-de4d-452c-9d73-f23dce0f59f0 could not be found. Oct 08 21:10:02.933613 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': '00fec1a9-de4d-452c-9d73-f23dce0f59f0', 'body': {'rebuild': {'imageRef': 'c508bd7f-7db9-4b2c-af7c-be54a855c355'}}} Oct 08 21:10:02.933613 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:10:02.933613 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:10:02.933613 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:10:02.933613 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:10:02.933613 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:10:02.933613 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:10:02.933613 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 08 21:10:02.933613 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 08 21:10:02.933613 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00fec1a9-de4d-452c-9d73-f23dce0f59f0 could not be found. Oct 08 21:10:02.933613 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:10:02.933613 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:10:02.933613 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:10:02.933613 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:10:02.933613 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:10:02.933613 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:10:02.933613 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:10:02.933613 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:10:02.933613 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:10:02.933613 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:10:02.933613 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 21:10:02.933613 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 21:10:02.933613 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 21:10:02.933613 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 21:10:02.933613 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 21:10:02.933613 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 21:10:02.933613 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 08 21:10:02.933613 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Oct 08 21:10:02.933613 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 08 21:10:02.933613 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:10:02.937921 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:10:02.937921 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:10:02.937921 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:10:02.937921 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00fec1a9-de4d-452c-9d73-f23dce0f59f0 could not be found. Oct 08 21:10:02.937921 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:10:02.937921 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:10:02.937921 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:10:02.937921 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:10:02.937921 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:10:02.937921 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:10:02.937921 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:10:02.937921 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:10:02.937921 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00fec1a9-de4d-452c-9d73-f23dce0f59f0 could not be found. Oct 08 21:10:02.937921 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:10:02.946470 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-bf369958-5cc1-4678-b3cb-ea603648b465 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Returning 404 to user: Instance 00fec1a9-de4d-452c-9d73-f23dce0f59f0 could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:10:02.947368 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-bf369958-5cc1-4678-b3cb-ea603648b465 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "POST /compute/v2.1/servers/00fec1a9-de4d-452c-9d73-f23dce0f59f0/action" status: 404 len: 111 microversion: 2.1 time: 0.040447 Oct 08 21:10:02.948445 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2116/4321] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:10:02 2022] POST /compute/v2.1/servers/00fec1a9-de4d-452c-9d73-f23dce0f59f0/action => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:10:02.969956 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-ddefef0a-5748-4256-bee3-6015ddcd5db9 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:10:02.970747 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-ddefef0a-5748-4256-bee3-6015ddcd5db9 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:10:02.985707 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ddefef0a-5748-4256-bee3-6015ddcd5db9 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:02.987936 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ddefef0a-5748-4256-bee3-6015ddcd5db9 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:02.988396 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ddefef0a-5748-4256-bee3-6015ddcd5db9 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:02.989123 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ddefef0a-5748-4256-bee3-6015ddcd5db9 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:02.989628 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ddefef0a-5748-4256-bee3-6015ddcd5db9 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:02.990066 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ddefef0a-5748-4256-bee3-6015ddcd5db9 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:03.305644 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-ddefef0a-5748-4256-bee3-6015ddcd5db9 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:03.328095 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-ddefef0a-5748-4256-bee3-6015ddcd5db9 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 200 len: 1503 microversion: 2.1 time: 0.370696 Oct 08 21:10:03.350556 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2117/4322] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:10:02 2022] GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 1503 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:10:03.357508 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-3ca09f88-357c-4118-89ce-dc17b2f4a6f7 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:10:03.358954 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-3ca09f88-357c-4118-89ce-dc17b2f4a6f7 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: ba5cd412-0d20-4d2e-9f5e-de18f268008a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:10:03.366974 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3ca09f88-357c-4118-89ce-dc17b2f4a6f7 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:03.367827 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3ca09f88-357c-4118-89ce-dc17b2f4a6f7 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:03.368533 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3ca09f88-357c-4118-89ce-dc17b2f4a6f7 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:03.370575 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3ca09f88-357c-4118-89ce-dc17b2f4a6f7 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:03.371294 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3ca09f88-357c-4118-89ce-dc17b2f4a6f7 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:03.371947 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3ca09f88-357c-4118-89ce-dc17b2f4a6f7 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:03.653664 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-3ca09f88-357c-4118-89ce-dc17b2f4a6f7 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78e9afd772c4de981cac8f5817ec356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765c62cac2ee4406b23a5baa85c52ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:03.664302 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-3ca09f88-357c-4118-89ce-dc17b2f4a6f7 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/ba5cd412-0d20-4d2e-9f5e-de18f268008a" status: 200 len: 1522 microversion: 2.1 time: 0.311612 Oct 08 21:10:03.665295 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2118/4323] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:10:03 2022] GET /compute/v2.1/servers/ba5cd412-0d20-4d2e-9f5e-de18f268008a => generated 1522 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:10:03.670455 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-571bf66b-f24a-4a6b-85f2-67c7f1987eb7 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:10:03.671076 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-571bf66b-f24a-4a6b-85f2-67c7f1987eb7 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:10:03.683015 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-571bf66b-f24a-4a6b-85f2-67c7f1987eb7 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:03.683929 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-571bf66b-f24a-4a6b-85f2-67c7f1987eb7 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:03.684381 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-571bf66b-f24a-4a6b-85f2-67c7f1987eb7 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:03.685148 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-571bf66b-f24a-4a6b-85f2-67c7f1987eb7 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:03.686237 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-571bf66b-f24a-4a6b-85f2-67c7f1987eb7 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:03.686686 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-571bf66b-f24a-4a6b-85f2-67c7f1987eb7 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:03.868652 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-571bf66b-f24a-4a6b-85f2-67c7f1987eb7 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:03.878447 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-571bf66b-f24a-4a6b-85f2-67c7f1987eb7 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 200 len: 1503 microversion: 2.1 time: 0.211590 Oct 08 21:10:03.903001 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2119/4324] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:10:03 2022] GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 1503 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:10:03.908727 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-9d8bb0c9-f929-4db4-befd-4b7bd057746c tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:10:03.909416 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-9d8bb0c9-f929-4db4-befd-4b7bd057746c tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e5f6ba32-5668-4337-ad2c-c45e5abcb9a6] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:10:03.916022 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-9d8bb0c9-f929-4db4-befd-4b7bd057746c tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] HTTP exception thrown: Instance e5f6ba32-5668-4337-ad2c-c45e5abcb9a6 could not be found. Oct 08 21:10:03.917923 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-9d8bb0c9-f929-4db4-befd-4b7bd057746c tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Request method failure captured: Oct 08 21:10:03.917923 ncdv-master-1 devstack@n-api.service[140491]: request: POST /compute/v2.1/servers/e5f6ba32-5668-4337-ad2c-c45e5abcb9a6/action HTTP/1.1 Oct 08 21:10:03.917923 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:10:03.917923 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:10:03.917923 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:10:03.917923 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 15 Oct 08 21:10:03.917923 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:10:03.917923 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:10:03.917923 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:10:03.917923 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:10:03.917923 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQebW09Z3m936-d3SrnQA9UQ3KXQvUYeQwL43ufWdoxmQhUwYBWv-JT053t_VYPo9wAVRoCqYQy8Hhh8zc2n570KpS0qNVLik822FjYabkSIZMA_ubWypXzSwo3J04zV1MoSSz79D-b8-ZvwYCEIbwpbfyn5opgOjnO6EXvq1UNPaSyQ Oct 08 21:10:03.917923 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:10:03.917923 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:10:03.917923 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:10:03.917923 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:10:03.917923 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:10:03.917923 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:10:03.917923 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 0ae02675057e4f27bc1980348afc8ca1 Oct 08 21:10:03.917923 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-ServersNegativeTestJSON-1441071354 Oct 08 21:10:03.917923 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:10:03.917923 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:10:03.917923 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0ae02675057e4f27bc1980348afc8ca1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0ae02675057e4f27bc1980348afc8ca1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0ae02675057e4f27bc1980348afc8ca1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0ae02675057e4f27bc1980348afc8ca1"}]}] Oct 08 21:10:03.917923 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-ServersNegativeTestJSON-1441071354 Oct 08 21:10:03.917923 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 0ae02675057e4f27bc1980348afc8ca1 Oct 08 21:10:03.917923 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1441071354 Oct 08 21:10:03.917923 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-ServersNegativeTestJSON-1441071354-project Oct 08 21:10:03.917923 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:10:03.917923 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:10:03.917923 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 6a78d352c143483c8e4702d789d4c516 Oct 08 21:10:03.917923 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-ServersNegativeTestJSON-1441071354-project Oct 08 21:10:03.917923 ncdv-master-1 devstack@n-api.service[140491]: Oct 08 21:10:03.917923 ncdv-master-1 devstack@n-api.service[140491]: {"restore": {}} Oct 08 21:10:03.917923 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:10:03.917923 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance e5f6ba32-5668-4337-ad2c-c45e5abcb9a6 could not be found. Oct 08 21:10:03.917923 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': 'e5f6ba32-5668-4337-ad2c-c45e5abcb9a6', 'body': {'restore': {}}} Oct 08 21:10:03.917923 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:10:03.917923 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:10:03.917923 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:10:03.917923 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:10:03.917923 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:10:03.917923 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:10:03.917923 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 08 21:10:03.917923 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 08 21:10:03.917923 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5f6ba32-5668-4337-ad2c-c45e5abcb9a6 could not be found. Oct 08 21:10:03.917923 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:10:03.917923 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:10:03.917923 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:10:03.917923 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:10:03.917923 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:10:03.917923 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:10:03.917923 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:10:03.917923 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:10:03.917923 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:10:03.917923 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:10:03.917923 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Oct 08 21:10:03.917923 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 08 21:10:03.917923 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:10:03.917923 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:10:03.917923 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5f6ba32-5668-4337-ad2c-c45e5abcb9a6 could not be found. Oct 08 21:10:03.917923 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:10:03.917923 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:10:03.917923 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:10:03.917923 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:10:03.917923 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:10:03.917923 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:10:03.924301 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:10:03.924301 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:10:03.924301 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5f6ba32-5668-4337-ad2c-c45e5abcb9a6 could not be found. Oct 08 21:10:03.924301 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:10:03.924301 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-9d8bb0c9-f929-4db4-befd-4b7bd057746c tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Returning 404 to user: Instance e5f6ba32-5668-4337-ad2c-c45e5abcb9a6 could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:10:03.924761 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-9d8bb0c9-f929-4db4-befd-4b7bd057746c tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "POST /compute/v2.1/servers/e5f6ba32-5668-4337-ad2c-c45e5abcb9a6/action" status: 404 len: 111 microversion: 2.1 time: 0.017746 Oct 08 21:10:03.931070 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2120/4325] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:10:03 2022] POST /compute/v2.1/servers/e5f6ba32-5668-4337-ad2c-c45e5abcb9a6/action => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:10:03.942231 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-1a84d60b-9e5b-4e71-9216-b3831ca083ef tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:10:03.946784 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-1a84d60b-9e5b-4e71-9216-b3831ca083ef tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] [instance: 159e29dd-802c-4059-99f9-bb7c113d430b] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:10:03.963513 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1a84d60b-9e5b-4e71-9216-b3831ca083ef tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:03.966379 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1a84d60b-9e5b-4e71-9216-b3831ca083ef tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:03.969061 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1a84d60b-9e5b-4e71-9216-b3831ca083ef tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:03.970164 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1a84d60b-9e5b-4e71-9216-b3831ca083ef tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:03.971270 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1a84d60b-9e5b-4e71-9216-b3831ca083ef tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:03.973801 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1a84d60b-9e5b-4e71-9216-b3831ca083ef tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:04.345895 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-1a84d60b-9e5b-4e71-9216-b3831ca083ef tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:04.375290 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-1a84d60b-9e5b-4e71-9216-b3831ca083ef tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:04.384916 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-1a84d60b-9e5b-4e71-9216-b3831ca083ef tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:04.389438 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-1a84d60b-9e5b-4e71-9216-b3831ca083ef tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] 10.222.0.26 "GET /compute/v2.1/servers/159e29dd-802c-4059-99f9-bb7c113d430b" status: 200 len: 1738 microversion: 2.20 time: 0.453210 Oct 08 21:10:04.396033 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2121/4326] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:10:03 2022] GET /compute/v2.1/servers/159e29dd-802c-4059-99f9-bb7c113d430b => generated 1738 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:10:04.411983 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-3360350b-24b9-4a5a-90cc-7d9c130890b0 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:10:04.415584 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-3360350b-24b9-4a5a-90cc-7d9c130890b0 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:10:04.430784 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3360350b-24b9-4a5a-90cc-7d9c130890b0 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:04.437274 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3360350b-24b9-4a5a-90cc-7d9c130890b0 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:04.438048 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3360350b-24b9-4a5a-90cc-7d9c130890b0 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:04.438984 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3360350b-24b9-4a5a-90cc-7d9c130890b0 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:04.439769 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3360350b-24b9-4a5a-90cc-7d9c130890b0 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:04.440380 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3360350b-24b9-4a5a-90cc-7d9c130890b0 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:04.490586 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:10:05.034260 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-3360350b-24b9-4a5a-90cc-7d9c130890b0 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:05.042573 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-3360350b-24b9-4a5a-90cc-7d9c130890b0 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 200 len: 1503 microversion: 2.1 time: 0.645137 Oct 08 21:10:05.043167 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2122/4327] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:10:04 2022] GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 1503 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:10:05.063393 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-12fe1d41-4f9b-400d-94ae-1a2a227b9613 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:10:05.064028 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-12fe1d41-4f9b-400d-94ae-1a2a227b9613 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: ba5cd412-0d20-4d2e-9f5e-de18f268008a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:10:05.090161 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-12fe1d41-4f9b-400d-94ae-1a2a227b9613 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:05.092357 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-12fe1d41-4f9b-400d-94ae-1a2a227b9613 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:05.093710 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-12fe1d41-4f9b-400d-94ae-1a2a227b9613 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:05.096483 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-12fe1d41-4f9b-400d-94ae-1a2a227b9613 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:05.099172 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-12fe1d41-4f9b-400d-94ae-1a2a227b9613 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:05.100255 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-12fe1d41-4f9b-400d-94ae-1a2a227b9613 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:05.548259 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-12fe1d41-4f9b-400d-94ae-1a2a227b9613 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78e9afd772c4de981cac8f5817ec356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765c62cac2ee4406b23a5baa85c52ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:05.565912 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-12fe1d41-4f9b-400d-94ae-1a2a227b9613 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/ba5cd412-0d20-4d2e-9f5e-de18f268008a" status: 200 len: 1522 microversion: 2.1 time: 0.521682 Oct 08 21:10:05.566675 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2123/4328] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:10:05 2022] GET /compute/v2.1/servers/ba5cd412-0d20-4d2e-9f5e-de18f268008a => generated 1522 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:10:05.571675 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-ca4b4a08-7c44-4f6e-987c-3d30721c29f5 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:10:05.572470 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-ca4b4a08-7c44-4f6e-987c-3d30721c29f5 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:10:05.579585 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ca4b4a08-7c44-4f6e-987c-3d30721c29f5 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:05.580510 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ca4b4a08-7c44-4f6e-987c-3d30721c29f5 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:05.581130 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ca4b4a08-7c44-4f6e-987c-3d30721c29f5 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:05.582226 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ca4b4a08-7c44-4f6e-987c-3d30721c29f5 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:05.582866 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ca4b4a08-7c44-4f6e-987c-3d30721c29f5 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:05.583469 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ca4b4a08-7c44-4f6e-987c-3d30721c29f5 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:05.877682 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-ca4b4a08-7c44-4f6e-987c-3d30721c29f5 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:05.890278 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-ca4b4a08-7c44-4f6e-987c-3d30721c29f5 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 200 len: 1503 microversion: 2.1 time: 0.322310 Oct 08 21:10:05.916801 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2124/4329] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:10:05 2022] GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 1503 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:10:05.923608 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-9b5fbbca-388e-4c1b-bf12-0cc2e230de4b tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:10:05.924573 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-9b5fbbca-388e-4c1b-bf12-0cc2e230de4b tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] [instance: 159e29dd-802c-4059-99f9-bb7c113d430b] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:10:05.937549 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9b5fbbca-388e-4c1b-bf12-0cc2e230de4b tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:05.938268 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9b5fbbca-388e-4c1b-bf12-0cc2e230de4b tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:05.938981 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9b5fbbca-388e-4c1b-bf12-0cc2e230de4b tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:05.939857 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9b5fbbca-388e-4c1b-bf12-0cc2e230de4b tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:05.940466 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9b5fbbca-388e-4c1b-bf12-0cc2e230de4b tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:05.941060 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9b5fbbca-388e-4c1b-bf12-0cc2e230de4b tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:06.182324 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-9b5fbbca-388e-4c1b-bf12-0cc2e230de4b tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:06.196197 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-9b5fbbca-388e-4c1b-bf12-0cc2e230de4b tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:06.199750 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-9b5fbbca-388e-4c1b-bf12-0cc2e230de4b tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:06.202182 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-9b5fbbca-388e-4c1b-bf12-0cc2e230de4b tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] 10.222.0.26 "GET /compute/v2.1/servers/159e29dd-802c-4059-99f9-bb7c113d430b" status: 200 len: 1738 microversion: 2.20 time: 0.282500 Oct 08 21:10:06.214359 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2125/4330] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:10:05 2022] GET /compute/v2.1/servers/159e29dd-802c-4059-99f9-bb7c113d430b => generated 1738 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:10:06.236097 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-42ac8b69-7031-415a-abc3-b822f0f07a30 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:10:06.239420 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-42ac8b69-7031-415a-abc3-b822f0f07a30 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] [instance: 1b68ff0f-2dfe-4844-b7ce-556768c5d3e2] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:10:06.251348 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-42ac8b69-7031-415a-abc3-b822f0f07a30 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:06.251868 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-42ac8b69-7031-415a-abc3-b822f0f07a30 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:06.254207 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-42ac8b69-7031-415a-abc3-b822f0f07a30 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:06.255135 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-42ac8b69-7031-415a-abc3-b822f0f07a30 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:06.256769 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-42ac8b69-7031-415a-abc3-b822f0f07a30 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:06.267012 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-42ac8b69-7031-415a-abc3-b822f0f07a30 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:06.311921 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-a9987f93-bf90-4c43-b866-9e1e11ea480c tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "GET /compute/v2.1/images/d1ab381b-0750-4a51-94cf-a046a286aaa9" status: 200 len: 1437 microversion: 2.1 time: 9.076869 Oct 08 21:10:06.313501 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2206/4331] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:09:57 2022] GET /compute/v2.1/images/d1ab381b-0750-4a51-94cf-a046a286aaa9 => generated 1437 bytes in 9079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:10:06.328228 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-a68c250e-e005-4b8f-a82b-58da339c3ebd tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:10:06.329061 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-a68c250e-e005-4b8f-a82b-58da339c3ebd tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:10:06.351323 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-42ac8b69-7031-415a-abc3-b822f0f07a30 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] 10.222.0.26 "GET /compute/v2.1/servers/1b68ff0f-2dfe-4844-b7ce-556768c5d3e2/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.135135 Oct 08 21:10:06.352014 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2126/4332] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Oct 8 21:10:06 2022] GET /compute/v2.1/servers/1b68ff0f-2dfe-4844-b7ce-556768c5d3e2/os-volume_attachments => generated 371 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:10:06.356738 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a68c250e-e005-4b8f-a82b-58da339c3ebd tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:06.357760 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a68c250e-e005-4b8f-a82b-58da339c3ebd tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:06.359320 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a68c250e-e005-4b8f-a82b-58da339c3ebd tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:06.360324 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a68c250e-e005-4b8f-a82b-58da339c3ebd tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:06.362132 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a68c250e-e005-4b8f-a82b-58da339c3ebd tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:06.364992 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a68c250e-e005-4b8f-a82b-58da339c3ebd tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:06.431680 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-a68c250e-e005-4b8f-a82b-58da339c3ebd tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] HTTP exception thrown: Cannot 'restore' instance e2548207-aa57-4e4c-876b-2027b59283d2 while it is in vm_state active Oct 08 21:10:06.433779 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-a68c250e-e005-4b8f-a82b-58da339c3ebd tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Request method failure captured: Oct 08 21:10:06.433779 ncdv-master-1 devstack@n-api.service[140492]: request: POST /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2/action HTTP/1.1 Oct 08 21:10:06.433779 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:10:06.433779 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:10:06.433779 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:10:06.433779 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 15 Oct 08 21:10:06.433779 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:10:06.433779 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:10:06.433779 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:10:06.433779 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:10:06.433779 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQebW09Z3m936-d3SrnQA9UQ3KXQvUYeQwL43ufWdoxmQhUwYBWv-JT053t_VYPo9wAVRoCqYQy8Hhh8zc2n570KpS0qNVLik822FjYabkSIZMA_ubWypXzSwo3J04zV1MoSSz79D-b8-ZvwYCEIbwpbfyn5opgOjnO6EXvq1UNPaSyQ Oct 08 21:10:06.433779 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:10:06.433779 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:10:06.433779 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:10:06.433779 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:10:06.433779 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:10:06.433779 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:10:06.433779 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 0ae02675057e4f27bc1980348afc8ca1 Oct 08 21:10:06.433779 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-ServersNegativeTestJSON-1441071354 Oct 08 21:10:06.433779 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:10:06.433779 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:10:06.433779 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0ae02675057e4f27bc1980348afc8ca1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0ae02675057e4f27bc1980348afc8ca1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0ae02675057e4f27bc1980348afc8ca1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0ae02675057e4f27bc1980348afc8ca1"}]}] Oct 08 21:10:06.433779 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-ServersNegativeTestJSON-1441071354 Oct 08 21:10:06.433779 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 0ae02675057e4f27bc1980348afc8ca1 Oct 08 21:10:06.433779 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1441071354 Oct 08 21:10:06.433779 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-ServersNegativeTestJSON-1441071354-project Oct 08 21:10:06.433779 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:10:06.433779 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:10:06.433779 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 6a78d352c143483c8e4702d789d4c516 Oct 08 21:10:06.433779 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-ServersNegativeTestJSON-1441071354-project Oct 08 21:10:06.433779 ncdv-master-1 devstack@n-api.service[140492]: Oct 08 21:10:06.433779 ncdv-master-1 devstack@n-api.service[140492]: {"restore": {}} Oct 08 21:10:06.433779 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 21:10:06.433779 ncdv-master-1 devstack@n-api.service[140492]: exception: Cannot 'restore' instance e2548207-aa57-4e4c-876b-2027b59283d2 while it is in vm_state active Oct 08 21:10:06.433779 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': 'e2548207-aa57-4e4c-876b-2027b59283d2', 'body': {'restore': {}}} Oct 08 21:10:06.433779 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:10:06.433779 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:10:06.433779 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Oct 08 21:10:06.433779 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Oct 08 21:10:06.433779 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 08 21:10:06.433779 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 08 21:10:06.433779 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 08 21:10:06.433779 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 08 21:10:06.433779 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e2548207-aa57-4e4c-876b-2027b59283d2 in vm_state active. Cannot restore while the instance is in this state. Oct 08 21:10:06.433779 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:10:06.433779 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:10:06.433779 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:10:06.433779 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:10:06.433779 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:10:06.433779 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:10:06.433779 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:10:06.433779 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:10:06.433779 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:10:06.433779 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:10:06.433779 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Oct 08 21:10:06.433779 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 08 21:10:06.433779 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 08 21:10:06.433779 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 08 21:10:06.433779 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance e2548207-aa57-4e4c-876b-2027b59283d2 while it is in vm_state active Oct 08 21:10:06.433779 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:10:06.433779 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:10:06.433779 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:10:06.433779 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:10:06.433779 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:10:06.438170 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:10:06.438170 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:10:06.438170 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:10:06.438170 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance e2548207-aa57-4e4c-876b-2027b59283d2 while it is in vm_state active Oct 08 21:10:06.438170 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:10:06.439471 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-a68c250e-e005-4b8f-a82b-58da339c3ebd tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Returning 409 to user: Cannot 'restore' instance e2548207-aa57-4e4c-876b-2027b59283d2 while it is in vm_state active {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:10:06.440581 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-a68c250e-e005-4b8f-a82b-58da339c3ebd tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "POST /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2/action" status: 409 len: 145 microversion: 2.1 time: 0.125980 Oct 08 21:10:06.441852 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2207/4333] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:10:06 2022] POST /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2/action => generated 145 bytes in 128 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 08 21:10:06.451438 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-cccd0069-6d37-4637-99c6-16122339a410 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:10:06.452066 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-cccd0069-6d37-4637-99c6-16122339a410 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:10:06.472282 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cccd0069-6d37-4637-99c6-16122339a410 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:06.472810 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cccd0069-6d37-4637-99c6-16122339a410 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:06.473295 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cccd0069-6d37-4637-99c6-16122339a410 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:06.483395 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cccd0069-6d37-4637-99c6-16122339a410 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:06.486179 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cccd0069-6d37-4637-99c6-16122339a410 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:06.486667 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cccd0069-6d37-4637-99c6-16122339a410 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:06.500835 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-ef14fee4-7ac0-425e-9680-2c2e8bb3c9ee tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:10:06.504746 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-ef14fee4-7ac0-425e-9680-2c2e8bb3c9ee tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] [instance: 1b68ff0f-2dfe-4844-b7ce-556768c5d3e2] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:10:06.510970 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ef14fee4-7ac0-425e-9680-2c2e8bb3c9ee tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:06.511485 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ef14fee4-7ac0-425e-9680-2c2e8bb3c9ee tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:06.511941 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ef14fee4-7ac0-425e-9680-2c2e8bb3c9ee tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:06.512676 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ef14fee4-7ac0-425e-9680-2c2e8bb3c9ee tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:06.513149 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ef14fee4-7ac0-425e-9680-2c2e8bb3c9ee tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:06.514670 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ef14fee4-7ac0-425e-9680-2c2e8bb3c9ee tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:06.578542 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:10:06.615815 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-ef14fee4-7ac0-425e-9680-2c2e8bb3c9ee tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] 10.222.0.26 "GET /compute/v2.1/servers/1b68ff0f-2dfe-4844-b7ce-556768c5d3e2/os-volume_attachments/1dddb5cf-401e-4276-b7d2-76b0ba48acc7" status: 200 len: 194 microversion: 2.1 time: 0.121042 Oct 08 21:10:06.622914 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2208/4334] 10.222.0.26 () {58 vars in 1413 bytes} [Sat Oct 8 21:10:06 2022] GET /compute/v2.1/servers/1b68ff0f-2dfe-4844-b7ce-556768c5d3e2/os-volume_attachments/1dddb5cf-401e-4276-b7d2-76b0ba48acc7 => generated 194 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:10:06.630801 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-f4c8f955-ab43-4e86-ba17-6bcf72f95f62 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:10:06.631438 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-f4c8f955-ab43-4e86-ba17-6bcf72f95f62 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: ba5cd412-0d20-4d2e-9f5e-de18f268008a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:10:06.652688 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f4c8f955-ab43-4e86-ba17-6bcf72f95f62 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:06.653253 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f4c8f955-ab43-4e86-ba17-6bcf72f95f62 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:06.653710 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f4c8f955-ab43-4e86-ba17-6bcf72f95f62 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:06.661874 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f4c8f955-ab43-4e86-ba17-6bcf72f95f62 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:06.662769 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f4c8f955-ab43-4e86-ba17-6bcf72f95f62 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:06.665173 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f4c8f955-ab43-4e86-ba17-6bcf72f95f62 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:06.890163 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-cccd0069-6d37-4637-99c6-16122339a410 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:06.906691 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-cccd0069-6d37-4637-99c6-16122339a410 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 200 len: 1503 microversion: 2.1 time: 0.459779 Oct 08 21:10:06.913822 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2127/4335] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:10:06 2022] GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 1503 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:10:06.919168 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-9bc8dd77-c059-47b1-aa24-640e13111600 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:10:06.919677 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-9bc8dd77-c059-47b1-aa24-640e13111600 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] [instance: 1b68ff0f-2dfe-4844-b7ce-556768c5d3e2] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:10:06.928904 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9bc8dd77-c059-47b1-aa24-640e13111600 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:06.930398 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9bc8dd77-c059-47b1-aa24-640e13111600 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:06.931067 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9bc8dd77-c059-47b1-aa24-640e13111600 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:06.932104 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9bc8dd77-c059-47b1-aa24-640e13111600 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:06.955520 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9bc8dd77-c059-47b1-aa24-640e13111600 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:06.956019 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9bc8dd77-c059-47b1-aa24-640e13111600 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:07.122113 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.objects.instance [None req-9bc8dd77-c059-47b1-aa24-640e13111600 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lazy-loading 'services' on Instance uuid 1b68ff0f-2dfe-4844-b7ce-556768c5d3e2 {{(pid=140491) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 21:10:07.211510 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-f4c8f955-ab43-4e86-ba17-6bcf72f95f62 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78e9afd772c4de981cac8f5817ec356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765c62cac2ee4406b23a5baa85c52ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:07.223339 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-f4c8f955-ab43-4e86-ba17-6bcf72f95f62 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/ba5cd412-0d20-4d2e-9f5e-de18f268008a" status: 200 len: 1522 microversion: 2.1 time: 0.602494 Oct 08 21:10:07.227358 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2209/4336] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:10:06 2022] GET /compute/v2.1/servers/ba5cd412-0d20-4d2e-9f5e-de18f268008a => generated 1522 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:10:07.234006 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-41778376-a041-4605-a6cc-bc18e6f065c5 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:10:07.237905 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-41778376-a041-4605-a6cc-bc18e6f065c5 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:10:07.248514 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-9bc8dd77-c059-47b1-aa24-640e13111600 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] 10.222.0.26 "DELETE /compute/v2.1/servers/1b68ff0f-2dfe-4844-b7ce-556768c5d3e2/os-volume_attachments/1dddb5cf-401e-4276-b7d2-76b0ba48acc7" status: 202 len: 0 microversion: 2.1 time: 0.332075 Oct 08 21:10:07.252349 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2128/4337] 10.222.0.26 () {58 vars in 1416 bytes} [Sat Oct 8 21:10:06 2022] DELETE /compute/v2.1/servers/1b68ff0f-2dfe-4844-b7ce-556768c5d3e2/os-volume_attachments/1dddb5cf-401e-4276-b7d2-76b0ba48acc7 => generated 0 bytes in 335 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 21:10:07.254170 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-41778376-a041-4605-a6cc-bc18e6f065c5 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:07.255186 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-41778376-a041-4605-a6cc-bc18e6f065c5 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:07.255855 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-41778376-a041-4605-a6cc-bc18e6f065c5 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:07.256999 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-41778376-a041-4605-a6cc-bc18e6f065c5 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:07.257821 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-41778376-a041-4605-a6cc-bc18e6f065c5 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:07.258505 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-41778376-a041-4605-a6cc-bc18e6f065c5 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:07.279219 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c7e90c31-2119-4ec1-9b70-5ccacfc7873a tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:10:07.279952 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-c7e90c31-2119-4ec1-9b70-5ccacfc7873a tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] [instance: 159e29dd-802c-4059-99f9-bb7c113d430b] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:10:07.304634 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c7e90c31-2119-4ec1-9b70-5ccacfc7873a tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:07.312268 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c7e90c31-2119-4ec1-9b70-5ccacfc7873a tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:07.312502 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c7e90c31-2119-4ec1-9b70-5ccacfc7873a tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:07.313671 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c7e90c31-2119-4ec1-9b70-5ccacfc7873a tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:07.314520 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c7e90c31-2119-4ec1-9b70-5ccacfc7873a tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:07.315146 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c7e90c31-2119-4ec1-9b70-5ccacfc7873a tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:07.595760 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-41778376-a041-4605-a6cc-bc18e6f065c5 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:07.604316 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-c7e90c31-2119-4ec1-9b70-5ccacfc7873a tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:07.605173 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-41778376-a041-4605-a6cc-bc18e6f065c5 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 200 len: 1503 microversion: 2.1 time: 0.374844 Oct 08 21:10:07.607513 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2210/4338] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:10:07 2022] GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 1503 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:10:07.614448 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-26a15c2c-837b-4480-9b2a-2b9b2937f159 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Calling method '.version_select at 0x7f1a87512d30>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:10:07.637608 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-c7e90c31-2119-4ec1-9b70-5ccacfc7873a tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:07.639533 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-c7e90c31-2119-4ec1-9b70-5ccacfc7873a tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:07.641228 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-c7e90c31-2119-4ec1-9b70-5ccacfc7873a tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] 10.222.0.26 "GET /compute/v2.1/servers/159e29dd-802c-4059-99f9-bb7c113d430b" status: 200 len: 1720 microversion: 2.20 time: 0.390553 Oct 08 21:10:07.641896 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2129/4339] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:10:07 2022] GET /compute/v2.1/servers/159e29dd-802c-4059-99f9-bb7c113d430b => generated 1720 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:10:07.660202 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c1335baa-ccae-446b-adec-4a73f6d2076f tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:10:07.661574 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-c1335baa-ccae-446b-adec-4a73f6d2076f tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: c84aeba6-080c-4fd0-bdb6-fbb9f76e8faf] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:10:07.669065 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-c1335baa-ccae-446b-adec-4a73f6d2076f tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] HTTP exception thrown: Instance c84aeba6-080c-4fd0-bdb6-fbb9f76e8faf could not be found. Oct 08 21:10:07.680873 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c1335baa-ccae-446b-adec-4a73f6d2076f tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Request method failure captured: Oct 08 21:10:07.680873 ncdv-master-1 devstack@n-api.service[140491]: request: POST /compute/v2.1/servers/c84aeba6-080c-4fd0-bdb6-fbb9f76e8faf/action HTTP/1.1 Oct 08 21:10:07.680873 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:10:07.680873 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:10:07.680873 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:10:07.680873 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 14 Oct 08 21:10:07.680873 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:10:07.680873 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:10:07.680873 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:10:07.680873 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:10:07.680873 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQebW09Z3m936-d3SrnQA9UQ3KXQvUYeQwL43ufWdoxmQhUwYBWv-JT053t_VYPo9wAVRoCqYQy8Hhh8zc2n570KpS0qNVLik822FjYabkSIZMA_ubWypXzSwo3J04zV1MoSSz79D-b8-ZvwYCEIbwpbfyn5opgOjnO6EXvq1UNPaSyQ Oct 08 21:10:07.680873 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:10:07.680873 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:10:07.680873 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:10:07.680873 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:10:07.680873 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:10:07.680873 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:10:07.680873 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 0ae02675057e4f27bc1980348afc8ca1 Oct 08 21:10:07.680873 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-ServersNegativeTestJSON-1441071354 Oct 08 21:10:07.680873 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:10:07.680873 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:10:07.680873 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0ae02675057e4f27bc1980348afc8ca1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0ae02675057e4f27bc1980348afc8ca1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0ae02675057e4f27bc1980348afc8ca1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0ae02675057e4f27bc1980348afc8ca1"}]}] Oct 08 21:10:07.680873 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-ServersNegativeTestJSON-1441071354 Oct 08 21:10:07.680873 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 0ae02675057e4f27bc1980348afc8ca1 Oct 08 21:10:07.680873 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1441071354 Oct 08 21:10:07.680873 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-ServersNegativeTestJSON-1441071354-project Oct 08 21:10:07.680873 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:10:07.680873 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:10:07.680873 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 6a78d352c143483c8e4702d789d4c516 Oct 08 21:10:07.680873 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-ServersNegativeTestJSON-1441071354-project Oct 08 21:10:07.680873 ncdv-master-1 devstack@n-api.service[140491]: Oct 08 21:10:07.680873 ncdv-master-1 devstack@n-api.service[140491]: {"resume": {}} Oct 08 21:10:07.680873 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:10:07.680873 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance c84aeba6-080c-4fd0-bdb6-fbb9f76e8faf could not be found. Oct 08 21:10:07.680873 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': 'c84aeba6-080c-4fd0-bdb6-fbb9f76e8faf', 'body': {'resume': {}}} Oct 08 21:10:07.680873 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:10:07.680873 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:10:07.680873 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:10:07.680873 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:10:07.680873 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:10:07.680873 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:10:07.680873 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 08 21:10:07.680873 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 08 21:10:07.680873 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c84aeba6-080c-4fd0-bdb6-fbb9f76e8faf could not be found. Oct 08 21:10:07.680873 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:10:07.680873 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:10:07.680873 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:10:07.680873 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:10:07.680873 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:10:07.680873 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:10:07.680873 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:10:07.680873 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:10:07.680873 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:10:07.680873 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:10:07.680873 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Oct 08 21:10:07.680873 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Oct 08 21:10:07.680873 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:10:07.680873 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:10:07.680873 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c84aeba6-080c-4fd0-bdb6-fbb9f76e8faf could not be found. Oct 08 21:10:07.680873 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:10:07.680873 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:10:07.680873 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:10:07.680873 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:10:07.680873 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:10:07.680873 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:10:07.684672 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:10:07.684672 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:10:07.684672 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c84aeba6-080c-4fd0-bdb6-fbb9f76e8faf could not be found. Oct 08 21:10:07.684672 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:10:07.684672 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c1335baa-ccae-446b-adec-4a73f6d2076f tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Returning 404 to user: Instance c84aeba6-080c-4fd0-bdb6-fbb9f76e8faf could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:10:07.684672 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-c1335baa-ccae-446b-adec-4a73f6d2076f tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "POST /compute/v2.1/servers/c84aeba6-080c-4fd0-bdb6-fbb9f76e8faf/action" status: 404 len: 111 microversion: 2.1 time: 0.039181 Oct 08 21:10:07.687860 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2130/4340] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:10:07 2022] POST /compute/v2.1/servers/c84aeba6-080c-4fd0-bdb6-fbb9f76e8faf/action => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:10:07.696019 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-972538ba-75a9-46b3-9462-786c389d90a7 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:10:07.697401 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-972538ba-75a9-46b3-9462-786c389d90a7 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:10:07.711794 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-972538ba-75a9-46b3-9462-786c389d90a7 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:07.712455 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-972538ba-75a9-46b3-9462-786c389d90a7 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:07.713865 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-972538ba-75a9-46b3-9462-786c389d90a7 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:07.714862 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-972538ba-75a9-46b3-9462-786c389d90a7 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:07.717420 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-972538ba-75a9-46b3-9462-786c389d90a7 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:07.718288 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-972538ba-75a9-46b3-9462-786c389d90a7 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:08.182319 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-972538ba-75a9-46b3-9462-786c389d90a7 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:08.216515 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-972538ba-75a9-46b3-9462-786c389d90a7 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 200 len: 1503 microversion: 2.1 time: 0.526186 Oct 08 21:10:08.218364 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2131/4341] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:10:07 2022] GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 1503 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:10:08.248924 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-9abcd8d9-cf96-48ca-bf49-92c0e6ff37c6 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:10:08.250094 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-9abcd8d9-cf96-48ca-bf49-92c0e6ff37c6 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:10:08.261116 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9abcd8d9-cf96-48ca-bf49-92c0e6ff37c6 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:08.262044 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9abcd8d9-cf96-48ca-bf49-92c0e6ff37c6 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:08.274341 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9abcd8d9-cf96-48ca-bf49-92c0e6ff37c6 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:08.275300 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9abcd8d9-cf96-48ca-bf49-92c0e6ff37c6 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:08.279694 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9abcd8d9-cf96-48ca-bf49-92c0e6ff37c6 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:08.281498 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9abcd8d9-cf96-48ca-bf49-92c0e6ff37c6 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:08.739662 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-9abcd8d9-cf96-48ca-bf49-92c0e6ff37c6 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:08.750495 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-9abcd8d9-cf96-48ca-bf49-92c0e6ff37c6 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 200 len: 1503 microversion: 2.1 time: 0.508428 Oct 08 21:10:08.760814 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2132/4342] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:10:08 2022] GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 1503 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:10:08.766826 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-0d87dd3d-86b7-4be7-922e-26a621f6f241 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:10:08.767825 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-0d87dd3d-86b7-4be7-922e-26a621f6f241 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: ba5cd412-0d20-4d2e-9f5e-de18f268008a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:10:08.775556 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0d87dd3d-86b7-4be7-922e-26a621f6f241 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:08.776283 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0d87dd3d-86b7-4be7-922e-26a621f6f241 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:08.778887 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0d87dd3d-86b7-4be7-922e-26a621f6f241 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:08.780176 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0d87dd3d-86b7-4be7-922e-26a621f6f241 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:08.781333 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0d87dd3d-86b7-4be7-922e-26a621f6f241 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:08.782135 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0d87dd3d-86b7-4be7-922e-26a621f6f241 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:09.067379 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-0d87dd3d-86b7-4be7-922e-26a621f6f241 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78e9afd772c4de981cac8f5817ec356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765c62cac2ee4406b23a5baa85c52ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:09.176538 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-0d87dd3d-86b7-4be7-922e-26a621f6f241 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/ba5cd412-0d20-4d2e-9f5e-de18f268008a" status: 200 len: 1522 microversion: 2.1 time: 0.405120 Oct 08 21:10:09.178977 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2133/4343] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:10:08 2022] GET /compute/v2.1/servers/ba5cd412-0d20-4d2e-9f5e-de18f268008a => generated 1522 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:10:09.208377 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-273bacf1-99df-4897-b7af-ec014a440875 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:10:09.212969 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-273bacf1-99df-4897-b7af-ec014a440875 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] [instance: 1b68ff0f-2dfe-4844-b7ce-556768c5d3e2] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:10:09.238576 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-273bacf1-99df-4897-b7af-ec014a440875 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:09.238576 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-273bacf1-99df-4897-b7af-ec014a440875 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:09.238576 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-273bacf1-99df-4897-b7af-ec014a440875 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:09.238576 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-273bacf1-99df-4897-b7af-ec014a440875 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:09.238576 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-273bacf1-99df-4897-b7af-ec014a440875 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:09.238576 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-273bacf1-99df-4897-b7af-ec014a440875 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:09.335503 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-273bacf1-99df-4897-b7af-ec014a440875 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] 10.222.0.26 "GET /compute/v2.1/servers/1b68ff0f-2dfe-4844-b7ce-556768c5d3e2/os-volume_attachments/ab61ecb6-055f-430c-913d-93288fd4b038" status: 200 len: 194 microversion: 2.1 time: 0.150661 Oct 08 21:10:09.336910 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2134/4344] 10.222.0.26 () {58 vars in 1413 bytes} [Sat Oct 8 21:10:09 2022] GET /compute/v2.1/servers/1b68ff0f-2dfe-4844-b7ce-556768c5d3e2/os-volume_attachments/ab61ecb6-055f-430c-913d-93288fd4b038 => generated 194 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:10:09.342391 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-e176c324-db49-407e-ae2b-2a8586af5e3a tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:10:09.349097 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-e176c324-db49-407e-ae2b-2a8586af5e3a tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] [instance: 159e29dd-802c-4059-99f9-bb7c113d430b] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:10:09.371032 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e176c324-db49-407e-ae2b-2a8586af5e3a tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:09.371984 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e176c324-db49-407e-ae2b-2a8586af5e3a tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:09.372553 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e176c324-db49-407e-ae2b-2a8586af5e3a tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:09.374256 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e176c324-db49-407e-ae2b-2a8586af5e3a tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:09.375240 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e176c324-db49-407e-ae2b-2a8586af5e3a tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:09.376123 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e176c324-db49-407e-ae2b-2a8586af5e3a tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:09.669905 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-e176c324-db49-407e-ae2b-2a8586af5e3a tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:09.680984 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-e176c324-db49-407e-ae2b-2a8586af5e3a tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:09.683079 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-e176c324-db49-407e-ae2b-2a8586af5e3a tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:09.698987 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-e176c324-db49-407e-ae2b-2a8586af5e3a tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] 10.222.0.26 "GET /compute/v2.1/servers/159e29dd-802c-4059-99f9-bb7c113d430b" status: 200 len: 1720 microversion: 2.20 time: 0.359689 Oct 08 21:10:09.705607 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2135/4345] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:10:09 2022] GET /compute/v2.1/servers/159e29dd-802c-4059-99f9-bb7c113d430b => generated 1720 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:10:09.717098 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-660bae4b-4141-41b0-a431-2502c859c9dd tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:10:09.720225 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-660bae4b-4141-41b0-a431-2502c859c9dd tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:10:09.730554 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-660bae4b-4141-41b0-a431-2502c859c9dd tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:09.731060 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-660bae4b-4141-41b0-a431-2502c859c9dd tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:09.731510 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-660bae4b-4141-41b0-a431-2502c859c9dd tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:09.736592 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-660bae4b-4141-41b0-a431-2502c859c9dd tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:09.737344 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-660bae4b-4141-41b0-a431-2502c859c9dd tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:09.738049 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-660bae4b-4141-41b0-a431-2502c859c9dd tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:09.803430 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-660bae4b-4141-41b0-a431-2502c859c9dd tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] HTTP exception thrown: Cannot 'resume' instance e2548207-aa57-4e4c-876b-2027b59283d2 while it is in vm_state active Oct 08 21:10:09.810797 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-660bae4b-4141-41b0-a431-2502c859c9dd tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Request method failure captured: Oct 08 21:10:09.810797 ncdv-master-1 devstack@n-api.service[140491]: request: POST /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2/action HTTP/1.1 Oct 08 21:10:09.810797 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:10:09.810797 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:10:09.810797 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:10:09.810797 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 14 Oct 08 21:10:09.810797 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:10:09.810797 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:10:09.810797 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:10:09.810797 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:10:09.810797 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQebW09Z3m936-d3SrnQA9UQ3KXQvUYeQwL43ufWdoxmQhUwYBWv-JT053t_VYPo9wAVRoCqYQy8Hhh8zc2n570KpS0qNVLik822FjYabkSIZMA_ubWypXzSwo3J04zV1MoSSz79D-b8-ZvwYCEIbwpbfyn5opgOjnO6EXvq1UNPaSyQ Oct 08 21:10:09.810797 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:10:09.810797 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:10:09.810797 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:10:09.810797 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:10:09.810797 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:10:09.810797 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:10:09.810797 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 0ae02675057e4f27bc1980348afc8ca1 Oct 08 21:10:09.810797 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-ServersNegativeTestJSON-1441071354 Oct 08 21:10:09.810797 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:10:09.810797 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:10:09.810797 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0ae02675057e4f27bc1980348afc8ca1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0ae02675057e4f27bc1980348afc8ca1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0ae02675057e4f27bc1980348afc8ca1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0ae02675057e4f27bc1980348afc8ca1"}]}] Oct 08 21:10:09.810797 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-ServersNegativeTestJSON-1441071354 Oct 08 21:10:09.810797 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 0ae02675057e4f27bc1980348afc8ca1 Oct 08 21:10:09.810797 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1441071354 Oct 08 21:10:09.810797 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-ServersNegativeTestJSON-1441071354-project Oct 08 21:10:09.810797 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:10:09.810797 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:10:09.810797 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 6a78d352c143483c8e4702d789d4c516 Oct 08 21:10:09.810797 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-ServersNegativeTestJSON-1441071354-project Oct 08 21:10:09.810797 ncdv-master-1 devstack@n-api.service[140491]: Oct 08 21:10:09.810797 ncdv-master-1 devstack@n-api.service[140491]: {"resume": {}} Oct 08 21:10:09.810797 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:10:09.810797 ncdv-master-1 devstack@n-api.service[140491]: exception: Cannot 'resume' instance e2548207-aa57-4e4c-876b-2027b59283d2 while it is in vm_state active Oct 08 21:10:09.810797 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': 'e2548207-aa57-4e4c-876b-2027b59283d2', 'body': {'resume': {}}} Oct 08 21:10:09.810797 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:10:09.810797 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:10:09.810797 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Oct 08 21:10:09.810797 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Oct 08 21:10:09.810797 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 08 21:10:09.810797 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 08 21:10:09.810797 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 08 21:10:09.810797 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 08 21:10:09.810797 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 08 21:10:09.810797 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 08 21:10:09.810797 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e2548207-aa57-4e4c-876b-2027b59283d2 in vm_state active. Cannot resume while the instance is in this state. Oct 08 21:10:09.810797 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:10:09.810797 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:10:09.810797 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:10:09.810797 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:10:09.810797 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:10:09.810797 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:10:09.810797 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:10:09.810797 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:10:09.810797 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:10:09.810797 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:10:09.810797 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Oct 08 21:10:09.810797 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 08 21:10:09.810797 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 08 21:10:09.810797 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 08 21:10:09.810797 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance e2548207-aa57-4e4c-876b-2027b59283d2 while it is in vm_state active Oct 08 21:10:09.810797 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:10:09.810797 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:10:09.810797 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:10:09.814442 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:10:09.814442 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:10:09.814442 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:10:09.814442 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:10:09.814442 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:10:09.814442 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance e2548207-aa57-4e4c-876b-2027b59283d2 while it is in vm_state active Oct 08 21:10:09.814442 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:10:09.816757 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-660bae4b-4141-41b0-a431-2502c859c9dd tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Returning 409 to user: Cannot 'resume' instance e2548207-aa57-4e4c-876b-2027b59283d2 while it is in vm_state active {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:10:09.818134 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-660bae4b-4141-41b0-a431-2502c859c9dd tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "POST /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2/action" status: 409 len: 144 microversion: 2.1 time: 0.109578 Oct 08 21:10:09.822360 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2136/4346] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:10:09 2022] POST /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2/action => generated 144 bytes in 116 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 08 21:10:09.849462 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-e1db3a2e-5dbf-4e6d-9133-f17eba1a5ea9 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:10:09.849462 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-e1db3a2e-5dbf-4e6d-9133-f17eba1a5ea9 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] [instance: 1b68ff0f-2dfe-4844-b7ce-556768c5d3e2] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:10:09.872161 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e1db3a2e-5dbf-4e6d-9133-f17eba1a5ea9 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:09.872660 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e1db3a2e-5dbf-4e6d-9133-f17eba1a5ea9 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:09.873100 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e1db3a2e-5dbf-4e6d-9133-f17eba1a5ea9 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:09.873838 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e1db3a2e-5dbf-4e6d-9133-f17eba1a5ea9 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:09.874297 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e1db3a2e-5dbf-4e6d-9133-f17eba1a5ea9 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:09.874726 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e1db3a2e-5dbf-4e6d-9133-f17eba1a5ea9 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:10.139742 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.objects.instance [None req-e1db3a2e-5dbf-4e6d-9133-f17eba1a5ea9 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lazy-loading 'services' on Instance uuid 1b68ff0f-2dfe-4844-b7ce-556768c5d3e2 {{(pid=140491) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 21:10:10.283109 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-e1db3a2e-5dbf-4e6d-9133-f17eba1a5ea9 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] 10.222.0.26 "DELETE /compute/v2.1/servers/1b68ff0f-2dfe-4844-b7ce-556768c5d3e2/os-volume_attachments/ab61ecb6-055f-430c-913d-93288fd4b038" status: 202 len: 0 microversion: 2.1 time: 0.457191 Oct 08 21:10:10.284570 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2137/4347] 10.222.0.26 () {58 vars in 1416 bytes} [Sat Oct 8 21:10:09 2022] DELETE /compute/v2.1/servers/1b68ff0f-2dfe-4844-b7ce-556768c5d3e2/os-volume_attachments/ab61ecb6-055f-430c-913d-93288fd4b038 => generated 0 bytes in 461 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 21:10:10.330235 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-89ee3266-6ce3-4673-97c4-798c5784c1ba tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:10:10.333316 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-89ee3266-6ce3-4673-97c4-798c5784c1ba tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:10:10.345966 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-89ee3266-6ce3-4673-97c4-798c5784c1ba tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:10.347224 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-89ee3266-6ce3-4673-97c4-798c5784c1ba tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:10.348019 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-89ee3266-6ce3-4673-97c4-798c5784c1ba tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:10.349879 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-89ee3266-6ce3-4673-97c4-798c5784c1ba tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:10.350744 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-89ee3266-6ce3-4673-97c4-798c5784c1ba tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:10.352132 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-89ee3266-6ce3-4673-97c4-798c5784c1ba tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:10.790974 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-89ee3266-6ce3-4673-97c4-798c5784c1ba tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:10.807613 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-89ee3266-6ce3-4673-97c4-798c5784c1ba tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 200 len: 1503 microversion: 2.1 time: 0.495397 Oct 08 21:10:10.822576 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2138/4348] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:10:10 2022] GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 1503 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:10:10.839661 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-75a28723-78e9-4911-ab6b-56922c9252e3 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:10:10.840566 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-75a28723-78e9-4911-ab6b-56922c9252e3 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: ba5cd412-0d20-4d2e-9f5e-de18f268008a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:10:10.849256 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-75a28723-78e9-4911-ab6b-56922c9252e3 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:10.850242 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-75a28723-78e9-4911-ab6b-56922c9252e3 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:10.850868 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-75a28723-78e9-4911-ab6b-56922c9252e3 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:10.852358 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-75a28723-78e9-4911-ab6b-56922c9252e3 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:10.868964 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-75a28723-78e9-4911-ab6b-56922c9252e3 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:10.871547 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-75a28723-78e9-4911-ab6b-56922c9252e3 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:10.881221 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:10:11.142219 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-75a28723-78e9-4911-ab6b-56922c9252e3 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78e9afd772c4de981cac8f5817ec356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765c62cac2ee4406b23a5baa85c52ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:11.158571 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-75a28723-78e9-4911-ab6b-56922c9252e3 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/ba5cd412-0d20-4d2e-9f5e-de18f268008a" status: 200 len: 1522 microversion: 2.1 time: 0.333578 Oct 08 21:10:11.158809 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2139/4349] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:10:10 2022] GET /compute/v2.1/servers/ba5cd412-0d20-4d2e-9f5e-de18f268008a => generated 1522 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:10:11.164716 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-0bfc5252-dac2-4ac2-b907-b59e2ac01f47 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:10:11.165808 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-0bfc5252-dac2-4ac2-b907-b59e2ac01f47 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] [instance: 159e29dd-802c-4059-99f9-bb7c113d430b] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:10:11.173688 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0bfc5252-dac2-4ac2-b907-b59e2ac01f47 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:11.174209 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0bfc5252-dac2-4ac2-b907-b59e2ac01f47 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:11.174658 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0bfc5252-dac2-4ac2-b907-b59e2ac01f47 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:11.175703 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0bfc5252-dac2-4ac2-b907-b59e2ac01f47 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:11.176453 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0bfc5252-dac2-4ac2-b907-b59e2ac01f47 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:11.177065 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0bfc5252-dac2-4ac2-b907-b59e2ac01f47 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:11.959214 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-0bfc5252-dac2-4ac2-b907-b59e2ac01f47 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:11.972851 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-0bfc5252-dac2-4ac2-b907-b59e2ac01f47 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:11.985895 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-0bfc5252-dac2-4ac2-b907-b59e2ac01f47 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:11.993729 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-0bfc5252-dac2-4ac2-b907-b59e2ac01f47 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] 10.222.0.26 "GET /compute/v2.1/servers/159e29dd-802c-4059-99f9-bb7c113d430b" status: 200 len: 1663 microversion: 2.20 time: 0.828035 Oct 08 21:10:12.015582 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2140/4350] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:10:11 2022] GET /compute/v2.1/servers/159e29dd-802c-4059-99f9-bb7c113d430b => generated 1663 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:10:12.024154 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-75569a4b-0b41-4e45-a38b-5c0ba913f61f tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:10:12.026141 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-75569a4b-0b41-4e45-a38b-5c0ba913f61f tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:10:12.032978 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-75569a4b-0b41-4e45-a38b-5c0ba913f61f tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:12.033856 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-75569a4b-0b41-4e45-a38b-5c0ba913f61f tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:12.034577 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-75569a4b-0b41-4e45-a38b-5c0ba913f61f tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:12.036668 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-75569a4b-0b41-4e45-a38b-5c0ba913f61f tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:12.037393 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-75569a4b-0b41-4e45-a38b-5c0ba913f61f tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:12.038066 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-75569a4b-0b41-4e45-a38b-5c0ba913f61f tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:12.305402 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-75569a4b-0b41-4e45-a38b-5c0ba913f61f tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:12.327340 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-75569a4b-0b41-4e45-a38b-5c0ba913f61f tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 200 len: 1503 microversion: 2.1 time: 0.310361 Oct 08 21:10:12.327963 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2141/4351] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:10:12 2022] GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 1503 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:10:12.332863 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-3f6f12de-6f9f-4183-920b-547f57479671 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:10:12.335196 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-3f6f12de-6f9f-4183-920b-547f57479671 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] [instance: 1b68ff0f-2dfe-4844-b7ce-556768c5d3e2] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:10:12.372478 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3f6f12de-6f9f-4183-920b-547f57479671 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:12.372935 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3f6f12de-6f9f-4183-920b-547f57479671 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:12.373411 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3f6f12de-6f9f-4183-920b-547f57479671 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:12.374141 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3f6f12de-6f9f-4183-920b-547f57479671 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:12.374604 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3f6f12de-6f9f-4183-920b-547f57479671 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:12.375039 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3f6f12de-6f9f-4183-920b-547f57479671 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:12.506025 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-3f6f12de-6f9f-4183-920b-547f57479671 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] 10.222.0.26 "GET /compute/v2.1/servers/1b68ff0f-2dfe-4844-b7ce-556768c5d3e2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.176960 Oct 08 21:10:12.526522 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2142/4352] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Oct 8 21:10:12 2022] GET /compute/v2.1/servers/1b68ff0f-2dfe-4844-b7ce-556768c5d3e2/os-volume_attachments => generated 25 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 08 21:10:12.537831 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-9f8b6d06-4805-42ab-9f1d-a1533453bb5c tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f4c6e466-2adb-4dc5-88bc-47c1969a8c8d"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:10:12.551862 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-9f8b6d06-4805-42ab-9f1d-a1533453bb5c tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] [instance: 159e29dd-802c-4059-99f9-bb7c113d430b] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:10:12.584119 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9f8b6d06-4805-42ab-9f1d-a1533453bb5c tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:12.585968 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9f8b6d06-4805-42ab-9f1d-a1533453bb5c tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:12.586444 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9f8b6d06-4805-42ab-9f1d-a1533453bb5c tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:12.598861 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9f8b6d06-4805-42ab-9f1d-a1533453bb5c tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:12.599925 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9f8b6d06-4805-42ab-9f1d-a1533453bb5c tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:12.600535 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9f8b6d06-4805-42ab-9f1d-a1533453bb5c tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:13.339559 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-9f8b6d06-4805-42ab-9f1d-a1533453bb5c tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] 10.222.0.26 "POST /compute/v2.1/servers/159e29dd-802c-4059-99f9-bb7c113d430b/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.811704 Oct 08 21:10:13.340602 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2143/4353] 10.222.0.26 () {62 vars in 1364 bytes} [Sat Oct 8 21:10:12 2022] POST /compute/v2.1/servers/159e29dd-802c-4059-99f9-bb7c113d430b/os-volume_attachments => generated 188 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 08 21:10:13.364204 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-a3a574be-58ca-4768-902b-64a95d58b57f tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:10:13.365909 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-a3a574be-58ca-4768-902b-64a95d58b57f tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: ba5cd412-0d20-4d2e-9f5e-de18f268008a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:10:13.408476 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a3a574be-58ca-4768-902b-64a95d58b57f tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:13.408476 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a3a574be-58ca-4768-902b-64a95d58b57f tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:13.408476 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a3a574be-58ca-4768-902b-64a95d58b57f tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:13.416349 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a3a574be-58ca-4768-902b-64a95d58b57f tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:13.416646 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a3a574be-58ca-4768-902b-64a95d58b57f tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:13.419370 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a3a574be-58ca-4768-902b-64a95d58b57f tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:13.888466 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-a3a574be-58ca-4768-902b-64a95d58b57f tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78e9afd772c4de981cac8f5817ec356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765c62cac2ee4406b23a5baa85c52ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:13.908561 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-a3a574be-58ca-4768-902b-64a95d58b57f tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/ba5cd412-0d20-4d2e-9f5e-de18f268008a" status: 200 len: 1522 microversion: 2.1 time: 0.564629 Oct 08 21:10:13.910210 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2144/4354] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:10:13 2022] GET /compute/v2.1/servers/ba5cd412-0d20-4d2e-9f5e-de18f268008a => generated 1522 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:10:13.916384 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-62576050-81b3-41f7-a7b9-ee833837257d req-312594c9-2ede-4bfc-a907-40aa6aceada7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "159e29dd-802c-4059-99f9-bb7c113d430b", "name": "network-vif-unplugged", "status": "completed", "tag": "59479dc9-06cf-4a86-bedc-3998868989c8"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:10:13.927930 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-62576050-81b3-41f7-a7b9-ee833837257d req-312594c9-2ede-4bfc-a907-40aa6aceada7 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:13.928857 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-62576050-81b3-41f7-a7b9-ee833837257d req-312594c9-2ede-4bfc-a907-40aa6aceada7 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:13.929612 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-62576050-81b3-41f7-a7b9-ee833837257d req-312594c9-2ede-4bfc-a907-40aa6aceada7 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:13.946832 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.compute.server_external_events [req-62576050-81b3-41f7-a7b9-ee833837257d req-312594c9-2ede-4bfc-a907-40aa6aceada7 service nova] Unable to find a host for instance 159e29dd-802c-4059-99f9-bb7c113d430b. Dropping event network-vif-unplugged {{(pid=140491) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 08 21:10:13.948089 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-62576050-81b3-41f7-a7b9-ee833837257d req-312594c9-2ede-4bfc-a907-40aa6aceada7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.036653 Oct 08 21:10:13.949322 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2145/4355] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:10:13 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 38 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 08 21:10:13.954237 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-7de05e26-c92b-4b6b-8f7e-663576f171fc tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "networks": [{"uuid": "0af78ecb-f6e3-458a-ab57-630925a05ff0"}]}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:10:13.958851 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-7de05e26-c92b-4b6b-8f7e-663576f171fc tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Request method failure captured: Oct 08 21:10:13.958851 ncdv-master-1 devstack@n-api.service[140491]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 08 21:10:13.958851 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:10:13.958851 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:10:13.958851 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:10:13.958851 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 160 Oct 08 21:10:13.958851 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:10:13.958851 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:10:13.958851 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:10:13.958851 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:10:13.958851 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQebW09Z3m936-d3SrnQA9UQ3KXQvUYeQwL43ufWdoxmQhUwYBWv-JT053t_VYPo9wAVRoCqYQy8Hhh8zc2n570KpS0qNVLik822FjYabkSIZMA_ubWypXzSwo3J04zV1MoSSz79D-b8-ZvwYCEIbwpbfyn5opgOjnO6EXvq1UNPaSyQ Oct 08 21:10:13.958851 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:10:13.958851 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:10:13.958851 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:10:13.958851 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:10:13.958851 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:10:13.958851 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:10:13.958851 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 0ae02675057e4f27bc1980348afc8ca1 Oct 08 21:10:13.958851 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-ServersNegativeTestJSON-1441071354 Oct 08 21:10:13.958851 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:10:13.958851 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:10:13.958851 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0ae02675057e4f27bc1980348afc8ca1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0ae02675057e4f27bc1980348afc8ca1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0ae02675057e4f27bc1980348afc8ca1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0ae02675057e4f27bc1980348afc8ca1"}]}] Oct 08 21:10:13.958851 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-ServersNegativeTestJSON-1441071354 Oct 08 21:10:13.958851 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 0ae02675057e4f27bc1980348afc8ca1 Oct 08 21:10:13.958851 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1441071354 Oct 08 21:10:13.958851 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-ServersNegativeTestJSON-1441071354-project Oct 08 21:10:13.958851 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:10:13.958851 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:10:13.958851 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 6a78d352c143483c8e4702d789d4c516 Oct 08 21:10:13.958851 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-ServersNegativeTestJSON-1441071354-project Oct 08 21:10:13.958851 ncdv-master-1 devstack@n-api.service[140491]: Oct 08 21:10:13.958851 ncdv-master-1 devstack@n-api.service[140491]: {"server": {"name": "", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "networks": [{"uuid": "0af78ecb-f6e3-458a-ab57-630925a05ff0"}]}} Oct 08 21:10:13.958851 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:10:13.958851 ncdv-master-1 devstack@n-api.service[140491]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 08 21:10:13.958851 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'body': {'server': {'name': '', 'imageRef': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'flavorRef': '452', 'networks': [{'uuid': '0af78ecb-f6e3-458a-ab57-630925a05ff0'}]}}} Oct 08 21:10:13.958851 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:10:13.958851 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:10:13.958851 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 08 21:10:13.958851 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 08 21:10:13.958851 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 08 21:10:13.958851 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise error Oct 08 21:10:13.958851 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 08 21:10:13.958851 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:10:13.958851 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Oct 08 21:10:13.958851 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 08 21:10:13.958851 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:10:13.958851 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 08 21:10:13.958851 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi '' Oct 08 21:10:13.958851 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:10:13.958851 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:10:13.958851 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:10:13.958851 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:10:13.958851 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:10:13.958851 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:10:13.958851 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:10:13.958851 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:10:13.958851 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:10:13.958851 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:10:13.958851 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 21:10:13.958851 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 21:10:13.958851 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 08 21:10:13.958851 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 08 21:10:13.958851 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 08 21:10:13.958851 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 08 21:10:13.958851 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 08 21:10:13.964946 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 08 21:10:13.964946 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 08 21:10:13.964946 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:10:13.964946 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:10:13.964946 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:10:13.964946 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:10:13.964946 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:10:13.964946 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:10:13.964946 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 08 21:10:13.964946 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 08 21:10:13.964946 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 08 21:10:13.964946 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:10:13.972323 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-7de05e26-c92b-4b6b-8f7e-663576f171fc tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:10:13.973544 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-7de05e26-c92b-4b6b-8f7e-663576f171fc tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.023016 Oct 08 21:10:13.974432 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2146/4356] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 21:10:13 2022] POST /compute/v2.1/servers => generated 108 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 08 21:10:13.980297 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-f6fb9c19-ab81-437d-950d-7ec760bb8b8f tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:10:13.983280 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-f6fb9c19-ab81-437d-950d-7ec760bb8b8f tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] [instance: 1b68ff0f-2dfe-4844-b7ce-556768c5d3e2] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:10:13.992789 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f6fb9c19-ab81-437d-950d-7ec760bb8b8f tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:13.993787 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f6fb9c19-ab81-437d-950d-7ec760bb8b8f tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:13.994511 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f6fb9c19-ab81-437d-950d-7ec760bb8b8f tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:13.996455 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f6fb9c19-ab81-437d-950d-7ec760bb8b8f tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:13.998027 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f6fb9c19-ab81-437d-950d-7ec760bb8b8f tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:13.999273 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f6fb9c19-ab81-437d-950d-7ec760bb8b8f tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:14.040186 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-f6fb9c19-ab81-437d-950d-7ec760bb8b8f tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] 10.222.0.26 "GET /compute/v2.1/servers/1b68ff0f-2dfe-4844-b7ce-556768c5d3e2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.064069 Oct 08 21:10:14.042122 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2147/4357] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Oct 8 21:10:13 2022] GET /compute/v2.1/servers/1b68ff0f-2dfe-4844-b7ce-556768c5d3e2/os-volume_attachments => generated 25 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 08 21:10:14.048891 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-52b9f34f-a4cb-4025-94aa-804d39033bb7 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:10:14.050569 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-52b9f34f-a4cb-4025-94aa-804d39033bb7 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] [instance: 159e29dd-802c-4059-99f9-bb7c113d430b] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:10:14.060944 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-52b9f34f-a4cb-4025-94aa-804d39033bb7 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:14.065625 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-52b9f34f-a4cb-4025-94aa-804d39033bb7 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:14.066519 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-52b9f34f-a4cb-4025-94aa-804d39033bb7 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:14.067930 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-52b9f34f-a4cb-4025-94aa-804d39033bb7 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:14.068962 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-52b9f34f-a4cb-4025-94aa-804d39033bb7 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:14.070219 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-52b9f34f-a4cb-4025-94aa-804d39033bb7 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:14.636713 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-52b9f34f-a4cb-4025-94aa-804d39033bb7 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] 10.222.0.26 "DELETE /compute/v2.1/servers/159e29dd-802c-4059-99f9-bb7c113d430b/os-volume_attachments/f4c6e466-2adb-4dc5-88bc-47c1969a8c8d" status: 202 len: 0 microversion: 2.20 time: 0.592975 Oct 08 21:10:14.638556 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2148/4358] 10.222.0.26 () {60 vars in 1457 bytes} [Sat Oct 8 21:10:14 2022] DELETE /compute/v2.1/servers/159e29dd-802c-4059-99f9-bb7c113d430b/os-volume_attachments/f4c6e466-2adb-4dc5-88bc-47c1969a8c8d => generated 0 bytes in 596 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 08 21:10:14.646498 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-e1e8e2d6-76e5-4a77-ba51-95b59b8d619e tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:10:14.647914 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-e1e8e2d6-76e5-4a77-ba51-95b59b8d619e tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:10:14.665789 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e1e8e2d6-76e5-4a77-ba51-95b59b8d619e tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:14.668673 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e1e8e2d6-76e5-4a77-ba51-95b59b8d619e tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:14.669650 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e1e8e2d6-76e5-4a77-ba51-95b59b8d619e tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:14.670750 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e1e8e2d6-76e5-4a77-ba51-95b59b8d619e tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:14.673100 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e1e8e2d6-76e5-4a77-ba51-95b59b8d619e tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:14.676379 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e1e8e2d6-76e5-4a77-ba51-95b59b8d619e tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:15.140230 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-e1e8e2d6-76e5-4a77-ba51-95b59b8d619e tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:15.151881 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-e1e8e2d6-76e5-4a77-ba51-95b59b8d619e tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 200 len: 1503 microversion: 2.1 time: 0.511757 Oct 08 21:10:15.165223 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2149/4359] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:10:14 2022] GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 1503 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:10:15.865735 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-fa1888d3-334e-4d68-9730-6f960464ee5c tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:10:15.867835 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-fa1888d3-334e-4d68-9730-6f960464ee5c tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] [instance: 1b68ff0f-2dfe-4844-b7ce-556768c5d3e2] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:10:15.891203 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fa1888d3-334e-4d68-9730-6f960464ee5c tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:15.891706 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fa1888d3-334e-4d68-9730-6f960464ee5c tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:15.892146 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fa1888d3-334e-4d68-9730-6f960464ee5c tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:15.895299 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fa1888d3-334e-4d68-9730-6f960464ee5c tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:15.896723 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fa1888d3-334e-4d68-9730-6f960464ee5c tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:15.900132 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fa1888d3-334e-4d68-9730-6f960464ee5c tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:15.998699 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-fa1888d3-334e-4d68-9730-6f960464ee5c tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] [instance: 1b68ff0f-2dfe-4844-b7ce-556768c5d3e2] Going to try to terminate instance {{(pid=140491) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 21:10:16.104051 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=86,nova_cell1:INSERT=5,nova_cell1:UPDATE=9 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:10:16.173890 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-fa1888d3-334e-4d68-9730-6f960464ee5c tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] 10.222.0.26 "DELETE /compute/v2.1/servers/1b68ff0f-2dfe-4844-b7ce-556768c5d3e2" status: 204 len: 0 microversion: 2.1 time: 1.015090 Oct 08 21:10:16.173890 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2150/4360] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:10:15 2022] DELETE /compute/v2.1/servers/1b68ff0f-2dfe-4844-b7ce-556768c5d3e2 => generated 0 bytes in 1017 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 21:10:16.183153 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-48a0de25-fd6f-4d79-b801-34628fa6dcc1 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:10:16.183860 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-48a0de25-fd6f-4d79-b801-34628fa6dcc1 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] [instance: 159e29dd-802c-4059-99f9-bb7c113d430b] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:10:16.210260 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-48a0de25-fd6f-4d79-b801-34628fa6dcc1 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:16.213637 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-48a0de25-fd6f-4d79-b801-34628fa6dcc1 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:16.216400 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-48a0de25-fd6f-4d79-b801-34628fa6dcc1 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:16.218951 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-48a0de25-fd6f-4d79-b801-34628fa6dcc1 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:16.219344 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-48a0de25-fd6f-4d79-b801-34628fa6dcc1 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:16.219988 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-48a0de25-fd6f-4d79-b801-34628fa6dcc1 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:16.355004 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-48a0de25-fd6f-4d79-b801-34628fa6dcc1 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] [instance: 159e29dd-802c-4059-99f9-bb7c113d430b] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=140491) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 08 21:10:16.398001 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:10:16.609405 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-48a0de25-fd6f-4d79-b801-34628fa6dcc1 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] 10.222.0.26 "POST /compute/v2.1/servers/159e29dd-802c-4059-99f9-bb7c113d430b/action" status: 202 len: 0 microversion: 2.20 time: 0.437527 Oct 08 21:10:16.612945 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2151/4361] 10.222.0.26 () {62 vars in 1319 bytes} [Sat Oct 8 21:10:16 2022] POST /compute/v2.1/servers/159e29dd-802c-4059-99f9-bb7c113d430b/action => generated 0 bytes in 439 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 08 21:10:16.621173 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-6c061269-5ffd-4ff9-b979-4a3804e45e43 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:10:16.621834 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-6c061269-5ffd-4ff9-b979-4a3804e45e43 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: ba5cd412-0d20-4d2e-9f5e-de18f268008a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:10:16.654733 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6c061269-5ffd-4ff9-b979-4a3804e45e43 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:16.657647 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6c061269-5ffd-4ff9-b979-4a3804e45e43 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:16.659470 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6c061269-5ffd-4ff9-b979-4a3804e45e43 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:16.662585 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6c061269-5ffd-4ff9-b979-4a3804e45e43 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:16.665532 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6c061269-5ffd-4ff9-b979-4a3804e45e43 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:16.667314 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6c061269-5ffd-4ff9-b979-4a3804e45e43 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:17.247525 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=1 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:10:17.249946 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-6c061269-5ffd-4ff9-b979-4a3804e45e43 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78e9afd772c4de981cac8f5817ec356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765c62cac2ee4406b23a5baa85c52ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:17.259820 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-6c061269-5ffd-4ff9-b979-4a3804e45e43 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/ba5cd412-0d20-4d2e-9f5e-de18f268008a" status: 200 len: 1522 microversion: 2.1 time: 0.648372 Oct 08 21:10:17.260582 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2152/4362] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:10:16 2022] GET /compute/v2.1/servers/ba5cd412-0d20-4d2e-9f5e-de18f268008a => generated 1522 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:10:17.268313 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-8971c650-266a-4e07-b972-491671e2a88c tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:10:17.268933 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-8971c650-266a-4e07-b972-491671e2a88c tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:10:17.287126 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8971c650-266a-4e07-b972-491671e2a88c tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:17.290121 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8971c650-266a-4e07-b972-491671e2a88c tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:17.293593 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8971c650-266a-4e07-b972-491671e2a88c tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:17.294851 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8971c650-266a-4e07-b972-491671e2a88c tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:17.295889 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8971c650-266a-4e07-b972-491671e2a88c tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:17.296855 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8971c650-266a-4e07-b972-491671e2a88c tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:17.600581 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=14 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:10:17.635246 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-8971c650-266a-4e07-b972-491671e2a88c tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:17.645295 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-8971c650-266a-4e07-b972-491671e2a88c tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 200 len: 1503 microversion: 2.1 time: 0.383606 Oct 08 21:10:17.646292 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2153/4363] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:10:17 2022] GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 1503 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:10:17.652370 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-b9c6ba3a-3111-4175-83cc-ac516a5d2808 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:10:17.652992 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-b9c6ba3a-3111-4175-83cc-ac516a5d2808 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] [instance: 1b68ff0f-2dfe-4844-b7ce-556768c5d3e2] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:10:17.664742 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b9c6ba3a-3111-4175-83cc-ac516a5d2808 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:17.665298 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b9c6ba3a-3111-4175-83cc-ac516a5d2808 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:17.665961 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b9c6ba3a-3111-4175-83cc-ac516a5d2808 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:17.669123 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b9c6ba3a-3111-4175-83cc-ac516a5d2808 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:17.669983 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b9c6ba3a-3111-4175-83cc-ac516a5d2808 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:17.670735 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b9c6ba3a-3111-4175-83cc-ac516a5d2808 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:18.045722 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-b9c6ba3a-3111-4175-83cc-ac516a5d2808 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85abb492492343c58734564a2b26c8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68b14967e8249fd886f168d366f241f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:18.058400 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-b9c6ba3a-3111-4175-83cc-ac516a5d2808 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] 10.222.0.26 "GET /compute/v2.1/servers/1b68ff0f-2dfe-4844-b7ce-556768c5d3e2" status: 200 len: 1674 microversion: 2.1 time: 0.410924 Oct 08 21:10:18.077876 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2154/4364] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:10:17 2022] GET /compute/v2.1/servers/1b68ff0f-2dfe-4844-b7ce-556768c5d3e2 => generated 1674 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:10:18.086943 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-d6de51ef-af03-494e-a2ef-5114e976c996 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:10:18.088002 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-d6de51ef-af03-494e-a2ef-5114e976c996 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] [instance: 159e29dd-802c-4059-99f9-bb7c113d430b] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:10:18.094660 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d6de51ef-af03-494e-a2ef-5114e976c996 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:18.095360 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d6de51ef-af03-494e-a2ef-5114e976c996 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:18.095966 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d6de51ef-af03-494e-a2ef-5114e976c996 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:18.096867 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d6de51ef-af03-494e-a2ef-5114e976c996 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:18.097751 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d6de51ef-af03-494e-a2ef-5114e976c996 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:18.098434 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d6de51ef-af03-494e-a2ef-5114e976c996 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:18.333010 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-d6de51ef-af03-494e-a2ef-5114e976c996 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:18.344237 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-d6de51ef-af03-494e-a2ef-5114e976c996 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:18.345744 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-d6de51ef-af03-494e-a2ef-5114e976c996 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:18.346944 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-d6de51ef-af03-494e-a2ef-5114e976c996 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] 10.222.0.26 "GET /compute/v2.1/servers/159e29dd-802c-4059-99f9-bb7c113d430b" status: 200 len: 1671 microversion: 2.20 time: 0.267388 Oct 08 21:10:18.347568 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2155/4365] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:10:18 2022] GET /compute/v2.1/servers/159e29dd-802c-4059-99f9-bb7c113d430b => generated 1671 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:10:18.353468 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-f4f3d077-a1e8-4061-83ff-a4335c86e19d tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:10:18.354009 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-f4f3d077-a1e8-4061-83ff-a4335c86e19d tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: 4aa629e4-0380-4856-bdfb-5cc07911dbd2] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:10:18.359576 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-f4f3d077-a1e8-4061-83ff-a4335c86e19d tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] HTTP exception thrown: Instance 4aa629e4-0380-4856-bdfb-5cc07911dbd2 could not be found. Oct 08 21:10:18.366141 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-f4f3d077-a1e8-4061-83ff-a4335c86e19d tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Request method failure captured: Oct 08 21:10:18.366141 ncdv-master-1 devstack@n-api.service[140491]: request: POST /compute/v2.1/servers/4aa629e4-0380-4856-bdfb-5cc07911dbd2/action HTTP/1.1 Oct 08 21:10:18.366141 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:10:18.366141 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:10:18.366141 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:10:18.366141 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 14 Oct 08 21:10:18.366141 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:10:18.366141 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:10:18.366141 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:10:18.366141 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:10:18.366141 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQebW09Z3m936-d3SrnQA9UQ3KXQvUYeQwL43ufWdoxmQhUwYBWv-JT053t_VYPo9wAVRoCqYQy8Hhh8zc2n570KpS0qNVLik822FjYabkSIZMA_ubWypXzSwo3J04zV1MoSSz79D-b8-ZvwYCEIbwpbfyn5opgOjnO6EXvq1UNPaSyQ Oct 08 21:10:18.366141 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:10:18.366141 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:10:18.366141 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:10:18.366141 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:10:18.366141 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:10:18.366141 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:10:18.366141 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 0ae02675057e4f27bc1980348afc8ca1 Oct 08 21:10:18.366141 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-ServersNegativeTestJSON-1441071354 Oct 08 21:10:18.366141 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:10:18.366141 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:10:18.366141 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0ae02675057e4f27bc1980348afc8ca1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0ae02675057e4f27bc1980348afc8ca1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0ae02675057e4f27bc1980348afc8ca1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0ae02675057e4f27bc1980348afc8ca1"}]}] Oct 08 21:10:18.366141 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-ServersNegativeTestJSON-1441071354 Oct 08 21:10:18.366141 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 0ae02675057e4f27bc1980348afc8ca1 Oct 08 21:10:18.366141 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1441071354 Oct 08 21:10:18.366141 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-ServersNegativeTestJSON-1441071354-project Oct 08 21:10:18.366141 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:10:18.366141 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:10:18.366141 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 6a78d352c143483c8e4702d789d4c516 Oct 08 21:10:18.366141 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-ServersNegativeTestJSON-1441071354-project Oct 08 21:10:18.366141 ncdv-master-1 devstack@n-api.service[140491]: Oct 08 21:10:18.366141 ncdv-master-1 devstack@n-api.service[140491]: {"shelve": {}} Oct 08 21:10:18.366141 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:10:18.366141 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance 4aa629e4-0380-4856-bdfb-5cc07911dbd2 could not be found. Oct 08 21:10:18.366141 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': '4aa629e4-0380-4856-bdfb-5cc07911dbd2', 'body': {'shelve': {}}} Oct 08 21:10:18.366141 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:10:18.366141 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:10:18.366141 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:10:18.366141 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:10:18.366141 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:10:18.366141 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:10:18.366141 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 08 21:10:18.366141 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 08 21:10:18.366141 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4aa629e4-0380-4856-bdfb-5cc07911dbd2 could not be found. Oct 08 21:10:18.366141 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:10:18.366141 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:10:18.366141 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:10:18.366141 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:10:18.366141 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:10:18.366141 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:10:18.366141 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:10:18.366141 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:10:18.366141 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:10:18.366141 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:10:18.366141 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Oct 08 21:10:18.366141 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 08 21:10:18.366141 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:10:18.366141 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:10:18.366141 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4aa629e4-0380-4856-bdfb-5cc07911dbd2 could not be found. Oct 08 21:10:18.366141 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:10:18.366141 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:10:18.366141 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:10:18.366141 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:10:18.366141 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:10:18.366141 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:10:18.369990 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:10:18.369990 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:10:18.369990 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4aa629e4-0380-4856-bdfb-5cc07911dbd2 could not be found. Oct 08 21:10:18.369990 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:10:18.369990 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-f4f3d077-a1e8-4061-83ff-a4335c86e19d tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Returning 404 to user: Instance 4aa629e4-0380-4856-bdfb-5cc07911dbd2 could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:10:18.370343 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-f4f3d077-a1e8-4061-83ff-a4335c86e19d tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "POST /compute/v2.1/servers/4aa629e4-0380-4856-bdfb-5cc07911dbd2/action" status: 404 len: 111 microversion: 2.1 time: 0.020928 Oct 08 21:10:18.372489 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2156/4366] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:10:18 2022] POST /compute/v2.1/servers/4aa629e4-0380-4856-bdfb-5cc07911dbd2/action => generated 111 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:10:18.379357 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-82ac4e82-0ebd-4d0d-b3eb-1d4eea60d200 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:10:18.387449 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-82ac4e82-0ebd-4d0d-b3eb-1d4eea60d200 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: ba5cd412-0d20-4d2e-9f5e-de18f268008a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:10:18.404202 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-82ac4e82-0ebd-4d0d-b3eb-1d4eea60d200 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:18.405354 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-82ac4e82-0ebd-4d0d-b3eb-1d4eea60d200 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:18.406112 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-82ac4e82-0ebd-4d0d-b3eb-1d4eea60d200 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:18.408150 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-82ac4e82-0ebd-4d0d-b3eb-1d4eea60d200 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:18.408867 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-82ac4e82-0ebd-4d0d-b3eb-1d4eea60d200 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:18.409491 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-82ac4e82-0ebd-4d0d-b3eb-1d4eea60d200 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:18.777243 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-82ac4e82-0ebd-4d0d-b3eb-1d4eea60d200 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78e9afd772c4de981cac8f5817ec356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765c62cac2ee4406b23a5baa85c52ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:18.790052 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-82ac4e82-0ebd-4d0d-b3eb-1d4eea60d200 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/ba5cd412-0d20-4d2e-9f5e-de18f268008a" status: 200 len: 1522 microversion: 2.1 time: 0.413804 Oct 08 21:10:18.810918 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2157/4367] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:10:18 2022] GET /compute/v2.1/servers/ba5cd412-0d20-4d2e-9f5e-de18f268008a => generated 1522 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:10:18.827951 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-63cfae38-d2cb-4481-aad5-d2328e6987b4 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:10:18.828594 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-63cfae38-d2cb-4481-aad5-d2328e6987b4 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:10:18.849452 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-63cfae38-d2cb-4481-aad5-d2328e6987b4 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:18.850222 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-63cfae38-d2cb-4481-aad5-d2328e6987b4 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:18.850672 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-63cfae38-d2cb-4481-aad5-d2328e6987b4 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:18.851510 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-63cfae38-d2cb-4481-aad5-d2328e6987b4 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:18.851981 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-63cfae38-d2cb-4481-aad5-d2328e6987b4 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:18.852427 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-63cfae38-d2cb-4481-aad5-d2328e6987b4 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:19.113648 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-26a15c2c-837b-4480-9b2a-2b9b2937f159 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "GET /compute/v2.1/images/d1ab381b-0750-4a51-94cf-a046a286aaa9" status: 200 len: 1437 microversion: 2.1 time: 11.504270 Oct 08 21:10:19.114149 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2211/4368] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:10:07 2022] GET /compute/v2.1/images/d1ab381b-0750-4a51-94cf-a046a286aaa9 => generated 1437 bytes in 11506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:10:19.137363 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-9d8b9159-416a-4ff7-8326-adf9d0d1879d tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:10:19.138015 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-9d8b9159-416a-4ff7-8326-adf9d0d1879d tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] [instance: 1b68ff0f-2dfe-4844-b7ce-556768c5d3e2] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:10:19.154593 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9d8b9159-416a-4ff7-8326-adf9d0d1879d tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:19.154593 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9d8b9159-416a-4ff7-8326-adf9d0d1879d tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:19.154593 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9d8b9159-416a-4ff7-8326-adf9d0d1879d tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:19.155655 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9d8b9159-416a-4ff7-8326-adf9d0d1879d tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:19.157299 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9d8b9159-416a-4ff7-8326-adf9d0d1879d tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:19.159519 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9d8b9159-416a-4ff7-8326-adf9d0d1879d tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:19.183276 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-63cfae38-d2cb-4481-aad5-d2328e6987b4 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:19.193624 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-63cfae38-d2cb-4481-aad5-d2328e6987b4 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 200 len: 1503 microversion: 2.1 time: 0.381245 Oct 08 21:10:19.208763 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2158/4369] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:10:18 2022] GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 1503 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:10:19.225811 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-1c412362-c781-4b05-831e-2cff28541d02 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:10:19.226978 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-1c412362-c781-4b05-831e-2cff28541d02 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:10:19.238846 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1c412362-c781-4b05-831e-2cff28541d02 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:19.239679 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1c412362-c781-4b05-831e-2cff28541d02 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:19.240340 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1c412362-c781-4b05-831e-2cff28541d02 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:19.241377 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1c412362-c781-4b05-831e-2cff28541d02 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:19.242087 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1c412362-c781-4b05-831e-2cff28541d02 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:19.242994 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1c412362-c781-4b05-831e-2cff28541d02 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:19.508856 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-1c412362-c781-4b05-831e-2cff28541d02 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:19.541860 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-1c412362-c781-4b05-831e-2cff28541d02 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 200 len: 1503 microversion: 2.1 time: 0.321306 Oct 08 21:10:19.542550 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2159/4370] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:10:19 2022] GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 1503 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:10:19.555118 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-832cf6dd-c4e7-4ad9-8042-3584a81dc1db tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:10:19.556117 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-832cf6dd-c4e7-4ad9-8042-3584a81dc1db tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] [instance: 159e29dd-802c-4059-99f9-bb7c113d430b] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:10:19.585308 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-832cf6dd-c4e7-4ad9-8042-3584a81dc1db tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:19.586195 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-832cf6dd-c4e7-4ad9-8042-3584a81dc1db tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:19.586816 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-832cf6dd-c4e7-4ad9-8042-3584a81dc1db tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:19.589073 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-832cf6dd-c4e7-4ad9-8042-3584a81dc1db tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:19.593660 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-832cf6dd-c4e7-4ad9-8042-3584a81dc1db tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:19.594936 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-832cf6dd-c4e7-4ad9-8042-3584a81dc1db tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:20.031863 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-832cf6dd-c4e7-4ad9-8042-3584a81dc1db tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:20.041133 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-832cf6dd-c4e7-4ad9-8042-3584a81dc1db tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:20.047379 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-832cf6dd-c4e7-4ad9-8042-3584a81dc1db tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:20.053471 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-832cf6dd-c4e7-4ad9-8042-3584a81dc1db tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] 10.222.0.26 "GET /compute/v2.1/servers/159e29dd-802c-4059-99f9-bb7c113d430b" status: 200 len: 1671 microversion: 2.20 time: 0.509604 Oct 08 21:10:20.056841 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2160/4371] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:10:19 2022] GET /compute/v2.1/servers/159e29dd-802c-4059-99f9-bb7c113d430b => generated 1671 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:10:20.083596 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-9d02055e-d2e3-45d5-9c10-6956d0254168 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:10:20.084384 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-9d02055e-d2e3-45d5-9c10-6956d0254168 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:10:20.104324 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9d02055e-d2e3-45d5-9c10-6956d0254168 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:20.107475 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9d02055e-d2e3-45d5-9c10-6956d0254168 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:20.108142 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9d02055e-d2e3-45d5-9c10-6956d0254168 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:20.108876 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9d02055e-d2e3-45d5-9c10-6956d0254168 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:20.109429 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9d02055e-d2e3-45d5-9c10-6956d0254168 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:20.109873 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9d02055e-d2e3-45d5-9c10-6956d0254168 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:20.156588 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.objects.instance [None req-9d02055e-d2e3-45d5-9c10-6956d0254168 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lazy-loading 'flavor' on Instance uuid e2548207-aa57-4e4c-876b-2027b59283d2 {{(pid=140491) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 21:10:20.566929 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-9d02055e-d2e3-45d5-9c10-6956d0254168 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "POST /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2/action" status: 202 len: 0 microversion: 2.1 time: 0.496999 Oct 08 21:10:20.570551 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2161/4372] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:10:20 2022] POST /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2/action => generated 0 bytes in 501 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 21:10:20.577807 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-75e445e2-70bc-43f9-9d0c-7ba00e869f8b tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:10:20.585327 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-75e445e2-70bc-43f9-9d0c-7ba00e869f8b tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: ba5cd412-0d20-4d2e-9f5e-de18f268008a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:10:20.600425 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-75e445e2-70bc-43f9-9d0c-7ba00e869f8b tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:20.603737 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-75e445e2-70bc-43f9-9d0c-7ba00e869f8b tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:20.605750 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-75e445e2-70bc-43f9-9d0c-7ba00e869f8b tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:20.607152 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-75e445e2-70bc-43f9-9d0c-7ba00e869f8b tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:20.615148 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-75e445e2-70bc-43f9-9d0c-7ba00e869f8b tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:20.616060 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-75e445e2-70bc-43f9-9d0c-7ba00e869f8b tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:20.821009 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-9d8b9159-416a-4ff7-8326-adf9d0d1879d tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85abb492492343c58734564a2b26c8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68b14967e8249fd886f168d366f241f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:20.833525 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-9d8b9159-416a-4ff7-8326-adf9d0d1879d tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] 10.222.0.26 "GET /compute/v2.1/servers/1b68ff0f-2dfe-4844-b7ce-556768c5d3e2" status: 200 len: 1674 microversion: 2.1 time: 1.718086 Oct 08 21:10:20.841052 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2212/4373] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:10:19 2022] GET /compute/v2.1/servers/1b68ff0f-2dfe-4844-b7ce-556768c5d3e2 => generated 1674 bytes in 1726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:10:20.858060 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-d907abed-4dce-477e-8502-d0fba8b54f36 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Calling method '.version_select at 0x7f1a875a2430>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:10:20.942135 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-d907abed-4dce-477e-8502-d0fba8b54f36 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "GET /compute/v2.1/images/d1ab381b-0750-4a51-94cf-a046a286aaa9" status: 200 len: 1437 microversion: 2.1 time: 0.099880 Oct 08 21:10:20.942732 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2213/4374] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:10:20 2022] GET /compute/v2.1/images/d1ab381b-0750-4a51-94cf-a046a286aaa9 => generated 1437 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:10:20.950766 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-5c703da7-fc1b-4223-9903-d511a283002b tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:10:20.950766 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-5c703da7-fc1b-4223-9903-d511a283002b tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:10:20.964873 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5c703da7-fc1b-4223-9903-d511a283002b tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:20.965434 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5c703da7-fc1b-4223-9903-d511a283002b tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:20.965890 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5c703da7-fc1b-4223-9903-d511a283002b tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:20.966659 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5c703da7-fc1b-4223-9903-d511a283002b tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:20.973658 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5c703da7-fc1b-4223-9903-d511a283002b tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:20.974153 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5c703da7-fc1b-4223-9903-d511a283002b tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:21.018311 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-75e445e2-70bc-43f9-9d0c-7ba00e869f8b tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78e9afd772c4de981cac8f5817ec356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765c62cac2ee4406b23a5baa85c52ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:21.029967 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-75e445e2-70bc-43f9-9d0c-7ba00e869f8b tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/ba5cd412-0d20-4d2e-9f5e-de18f268008a" status: 200 len: 1504 microversion: 2.1 time: 0.457879 Oct 08 21:10:21.030650 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2162/4375] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:10:20 2022] GET /compute/v2.1/servers/ba5cd412-0d20-4d2e-9f5e-de18f268008a => generated 1504 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:10:21.086558 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-fbd738ed-a5f1-48aa-8009-09dff1539578 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:10:21.087394 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-fbd738ed-a5f1-48aa-8009-09dff1539578 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] [instance: 159e29dd-802c-4059-99f9-bb7c113d430b] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:10:21.104705 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fbd738ed-a5f1-48aa-8009-09dff1539578 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:21.106535 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fbd738ed-a5f1-48aa-8009-09dff1539578 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:21.107228 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fbd738ed-a5f1-48aa-8009-09dff1539578 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:21.109461 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fbd738ed-a5f1-48aa-8009-09dff1539578 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:21.110958 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fbd738ed-a5f1-48aa-8009-09dff1539578 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:21.111950 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fbd738ed-a5f1-48aa-8009-09dff1539578 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:21.494550 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-fbd738ed-a5f1-48aa-8009-09dff1539578 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:21.515548 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-fbd738ed-a5f1-48aa-8009-09dff1539578 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:21.520277 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-fbd738ed-a5f1-48aa-8009-09dff1539578 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:21.523486 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-fbd738ed-a5f1-48aa-8009-09dff1539578 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] 10.222.0.26 "GET /compute/v2.1/servers/159e29dd-802c-4059-99f9-bb7c113d430b" status: 200 len: 1671 microversion: 2.20 time: 0.442651 Oct 08 21:10:21.525067 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2163/4376] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:10:21 2022] GET /compute/v2.1/servers/159e29dd-802c-4059-99f9-bb7c113d430b => generated 1671 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:10:21.858801 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-730e3b8a-a74d-4d2a-8091-fc5783645c2a tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:10:21.860217 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-730e3b8a-a74d-4d2a-8091-fc5783645c2a tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] [instance: 1b68ff0f-2dfe-4844-b7ce-556768c5d3e2] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:10:21.874434 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-730e3b8a-a74d-4d2a-8091-fc5783645c2a tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:21.886680 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-730e3b8a-a74d-4d2a-8091-fc5783645c2a tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:21.887568 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-730e3b8a-a74d-4d2a-8091-fc5783645c2a tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:21.888453 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-730e3b8a-a74d-4d2a-8091-fc5783645c2a tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:21.888823 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-730e3b8a-a74d-4d2a-8091-fc5783645c2a tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:21.889307 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-730e3b8a-a74d-4d2a-8091-fc5783645c2a tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:22.205349 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-730e3b8a-a74d-4d2a-8091-fc5783645c2a tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85abb492492343c58734564a2b26c8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68b14967e8249fd886f168d366f241f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:22.219766 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-730e3b8a-a74d-4d2a-8091-fc5783645c2a tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] 10.222.0.26 "GET /compute/v2.1/servers/1b68ff0f-2dfe-4844-b7ce-556768c5d3e2" status: 200 len: 1674 microversion: 2.1 time: 0.364706 Oct 08 21:10:22.240527 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2164/4377] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:10:21 2022] GET /compute/v2.1/servers/1b68ff0f-2dfe-4844-b7ce-556768c5d3e2 => generated 1674 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:10:22.249584 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-43036ffc-03d4-4ea0-8f2f-ae182a8a31b9 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Calling method '.version_select at 0x7f1a876cd160>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:10:22.349246 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-43036ffc-03d4-4ea0-8f2f-ae182a8a31b9 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "GET /compute/v2.1/images/d1ab381b-0750-4a51-94cf-a046a286aaa9" status: 200 len: 1437 microversion: 2.1 time: 0.107579 Oct 08 21:10:22.353379 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2165/4378] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:10:22 2022] GET /compute/v2.1/images/d1ab381b-0750-4a51-94cf-a046a286aaa9 => generated 1437 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:10:22.353547 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-5c703da7-fc1b-4223-9903-d511a283002b tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:22.364617 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-71cdfc64-55a0-4ba8-8837-9ff547facf5a tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:10:22.368174 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-5c703da7-fc1b-4223-9903-d511a283002b tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 200 len: 1509 microversion: 2.1 time: 1.424372 Oct 08 21:10:22.368854 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-71cdfc64-55a0-4ba8-8837-9ff547facf5a tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: ba5cd412-0d20-4d2e-9f5e-de18f268008a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:10:22.375707 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2214/4379] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:10:20 2022] GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 1509 bytes in 1432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:10:22.376985 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-71cdfc64-55a0-4ba8-8837-9ff547facf5a tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:22.377719 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-71cdfc64-55a0-4ba8-8837-9ff547facf5a tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:22.378343 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-71cdfc64-55a0-4ba8-8837-9ff547facf5a tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:22.379774 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-71cdfc64-55a0-4ba8-8837-9ff547facf5a tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:22.380394 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-71cdfc64-55a0-4ba8-8837-9ff547facf5a tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:22.381204 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-71cdfc64-55a0-4ba8-8837-9ff547facf5a tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:22.412537 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:INSERT=3,nova_cell1:SELECT=94,nova_cell1:UPDATE=3 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:10:22.559078 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-0ea5d57a-abed-46f9-96db-694351e6786f tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:10:22.559909 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-0ea5d57a-abed-46f9-96db-694351e6786f tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] [instance: 159e29dd-802c-4059-99f9-bb7c113d430b] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:10:22.593777 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0ea5d57a-abed-46f9-96db-694351e6786f tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:22.594559 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0ea5d57a-abed-46f9-96db-694351e6786f tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:22.595182 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0ea5d57a-abed-46f9-96db-694351e6786f tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:22.598654 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0ea5d57a-abed-46f9-96db-694351e6786f tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:22.599336 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0ea5d57a-abed-46f9-96db-694351e6786f tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:22.600761 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0ea5d57a-abed-46f9-96db-694351e6786f tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:22.733301 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-71cdfc64-55a0-4ba8-8837-9ff547facf5a tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78e9afd772c4de981cac8f5817ec356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765c62cac2ee4406b23a5baa85c52ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:22.742840 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-71cdfc64-55a0-4ba8-8837-9ff547facf5a tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/ba5cd412-0d20-4d2e-9f5e-de18f268008a" status: 200 len: 1504 microversion: 2.1 time: 0.387087 Oct 08 21:10:22.748957 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2166/4380] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:10:22 2022] GET /compute/v2.1/servers/ba5cd412-0d20-4d2e-9f5e-de18f268008a => generated 1504 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:10:22.910688 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-0f2a32c1-31ad-43cf-be69-bce502e866a0 req-5fa41bf1-c4fb-4935-8e84-c0326c5017e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b68ff0f-2dfe-4844-b7ce-556768c5d3e2", "name": "network-vif-unplugged", "status": "completed", "tag": "88154834-d566-47ce-bf02-2e28327ec781"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:10:22.940815 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-0f2a32c1-31ad-43cf-be69-bce502e866a0 req-5fa41bf1-c4fb-4935-8e84-c0326c5017e9 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:22.947483 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-0f2a32c1-31ad-43cf-be69-bce502e866a0 req-5fa41bf1-c4fb-4935-8e84-c0326c5017e9 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:22.949776 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-0f2a32c1-31ad-43cf-be69-bce502e866a0 req-5fa41bf1-c4fb-4935-8e84-c0326c5017e9 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:22.998407 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-0f2a32c1-31ad-43cf-be69-bce502e866a0 req-5fa41bf1-c4fb-4935-8e84-c0326c5017e9 service nova] Creating event network-vif-unplugged:88154834-d566-47ce-bf02-2e28327ec781 for instance 1b68ff0f-2dfe-4844-b7ce-556768c5d3e2 on nch2-master-1 Oct 08 21:10:23.006273 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-0f2a32c1-31ad-43cf-be69-bce502e866a0 req-5fa41bf1-c4fb-4935-8e84-c0326c5017e9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.099684 Oct 08 21:10:23.007225 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2167/4381] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:10:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:10:23.248947 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-43077a8d-88d2-43d6-9e48-7a1ed1de40ff tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:10:23.249905 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-43077a8d-88d2-43d6-9e48-7a1ed1de40ff tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] [instance: 1b68ff0f-2dfe-4844-b7ce-556768c5d3e2] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:10:23.260877 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-43077a8d-88d2-43d6-9e48-7a1ed1de40ff tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:23.266614 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-43077a8d-88d2-43d6-9e48-7a1ed1de40ff tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:23.267252 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-43077a8d-88d2-43d6-9e48-7a1ed1de40ff tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:23.268162 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-43077a8d-88d2-43d6-9e48-7a1ed1de40ff tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:23.268923 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-43077a8d-88d2-43d6-9e48-7a1ed1de40ff tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:23.269555 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-43077a8d-88d2-43d6-9e48-7a1ed1de40ff tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:23.665433 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-43077a8d-88d2-43d6-9e48-7a1ed1de40ff tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85abb492492343c58734564a2b26c8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68b14967e8249fd886f168d366f241f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:23.679039 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-43077a8d-88d2-43d6-9e48-7a1ed1de40ff tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] 10.222.0.26 "GET /compute/v2.1/servers/1b68ff0f-2dfe-4844-b7ce-556768c5d3e2" status: 200 len: 1674 microversion: 2.1 time: 0.434194 Oct 08 21:10:23.693282 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2168/4382] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:10:23 2022] GET /compute/v2.1/servers/1b68ff0f-2dfe-4844-b7ce-556768c5d3e2 => generated 1674 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:10:23.693282 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-80c3f5e8-a1b8-4514-9674-1be8fe1c26b2 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Calling method '.version_select at 0x7f1a876cd700>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:10:23.767661 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-80c3f5e8-a1b8-4514-9674-1be8fe1c26b2 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "GET /compute/v2.1/images/d1ab381b-0750-4a51-94cf-a046a286aaa9" status: 200 len: 1437 microversion: 2.1 time: 0.085691 Oct 08 21:10:23.777505 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2169/4383] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:10:23 2022] GET /compute/v2.1/images/d1ab381b-0750-4a51-94cf-a046a286aaa9 => generated 1437 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:10:23.778426 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-fd1ffc0e-7d23-46a1-952c-f17c9ab7cabf tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:10:23.779052 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-fd1ffc0e-7d23-46a1-952c-f17c9ab7cabf tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:10:23.809977 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fd1ffc0e-7d23-46a1-952c-f17c9ab7cabf tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:23.810587 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fd1ffc0e-7d23-46a1-952c-f17c9ab7cabf tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:23.811039 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fd1ffc0e-7d23-46a1-952c-f17c9ab7cabf tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:23.811971 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fd1ffc0e-7d23-46a1-952c-f17c9ab7cabf tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:23.812457 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fd1ffc0e-7d23-46a1-952c-f17c9ab7cabf tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:23.812871 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fd1ffc0e-7d23-46a1-952c-f17c9ab7cabf tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:23.826719 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-0ea5d57a-abed-46f9-96db-694351e6786f tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:23.837695 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-0ea5d57a-abed-46f9-96db-694351e6786f tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:23.850241 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-0ea5d57a-abed-46f9-96db-694351e6786f tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:23.862406 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-0ea5d57a-abed-46f9-96db-694351e6786f tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] 10.222.0.26 "GET /compute/v2.1/servers/159e29dd-802c-4059-99f9-bb7c113d430b" status: 200 len: 1729 microversion: 2.20 time: 1.302558 Oct 08 21:10:23.863485 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2215/4384] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:10:22 2022] GET /compute/v2.1/servers/159e29dd-802c-4059-99f9-bb7c113d430b => generated 1729 bytes in 1313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:10:23.874299 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-b4b919ea-3344-43dc-85ee-9f28996d63c6 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:10:23.880466 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-b4b919ea-3344-43dc-85ee-9f28996d63c6 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: ba5cd412-0d20-4d2e-9f5e-de18f268008a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:10:23.903375 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b4b919ea-3344-43dc-85ee-9f28996d63c6 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:23.909665 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b4b919ea-3344-43dc-85ee-9f28996d63c6 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:23.913706 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b4b919ea-3344-43dc-85ee-9f28996d63c6 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:23.916475 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b4b919ea-3344-43dc-85ee-9f28996d63c6 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:23.917642 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b4b919ea-3344-43dc-85ee-9f28996d63c6 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:23.928839 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b4b919ea-3344-43dc-85ee-9f28996d63c6 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:24.256935 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-fd1ffc0e-7d23-46a1-952c-f17c9ab7cabf tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:24.275276 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-fd1ffc0e-7d23-46a1-952c-f17c9ab7cabf tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 200 len: 1509 microversion: 2.1 time: 0.504310 Oct 08 21:10:24.276398 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2170/4385] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:10:23 2022] GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 1509 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:10:24.684774 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-b4b919ea-3344-43dc-85ee-9f28996d63c6 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78e9afd772c4de981cac8f5817ec356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765c62cac2ee4406b23a5baa85c52ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:24.704335 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-716405fc-974f-4b4d-9ebd-923ee4c3b071 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:10:24.705700 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-716405fc-974f-4b4d-9ebd-923ee4c3b071 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] [instance: 1b68ff0f-2dfe-4844-b7ce-556768c5d3e2] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:10:24.715223 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-b4b919ea-3344-43dc-85ee-9f28996d63c6 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/ba5cd412-0d20-4d2e-9f5e-de18f268008a" status: 200 len: 1507 microversion: 2.1 time: 0.850384 Oct 08 21:10:24.716184 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-716405fc-974f-4b4d-9ebd-923ee4c3b071 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:24.716756 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-716405fc-974f-4b4d-9ebd-923ee4c3b071 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:24.717336 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-716405fc-974f-4b4d-9ebd-923ee4c3b071 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:24.718088 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-716405fc-974f-4b4d-9ebd-923ee4c3b071 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:24.729884 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-716405fc-974f-4b4d-9ebd-923ee4c3b071 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:24.730863 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-716405fc-974f-4b4d-9ebd-923ee4c3b071 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:24.738875 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2216/4386] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:10:23 2022] GET /compute/v2.1/servers/ba5cd412-0d20-4d2e-9f5e-de18f268008a => generated 1507 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:10:24.746165 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-a487082b-8c33-4323-9d71-ac57c1156a9d tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:10:24.747337 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-a487082b-8c33-4323-9d71-ac57c1156a9d tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: ba5cd412-0d20-4d2e-9f5e-de18f268008a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:10:24.796774 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a487082b-8c33-4323-9d71-ac57c1156a9d tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:24.797643 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a487082b-8c33-4323-9d71-ac57c1156a9d tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:24.800046 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a487082b-8c33-4323-9d71-ac57c1156a9d tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:24.802249 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a487082b-8c33-4323-9d71-ac57c1156a9d tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:24.802943 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a487082b-8c33-4323-9d71-ac57c1156a9d tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:24.803755 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a487082b-8c33-4323-9d71-ac57c1156a9d tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:24.825832 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-716405fc-974f-4b4d-9ebd-923ee4c3b071 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85abb492492343c58734564a2b26c8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68b14967e8249fd886f168d366f241f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:24.854309 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-716405fc-974f-4b4d-9ebd-923ee4c3b071 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] 10.222.0.26 "GET /compute/v2.1/servers/1b68ff0f-2dfe-4844-b7ce-556768c5d3e2" status: 200 len: 1606 microversion: 2.1 time: 0.150871 Oct 08 21:10:24.872340 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2171/4387] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:10:24 2022] GET /compute/v2.1/servers/1b68ff0f-2dfe-4844-b7ce-556768c5d3e2 => generated 1606 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:10:24.881178 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-6e2e6776-519d-47c0-98a8-73b2b14f7b3c tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Calling method '.version_select at 0x7f1a87765700>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:10:24.961683 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-6e2e6776-519d-47c0-98a8-73b2b14f7b3c tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "GET /compute/v2.1/images/d1ab381b-0750-4a51-94cf-a046a286aaa9" status: 200 len: 1437 microversion: 2.1 time: 0.090687 Oct 08 21:10:24.962366 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2172/4388] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:10:24 2022] GET /compute/v2.1/images/d1ab381b-0750-4a51-94cf-a046a286aaa9 => generated 1437 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:10:24.978965 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-e0b545fe-7bcf-4fbe-9b11-1bba0e809ce8 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:10:24.981482 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-e0b545fe-7bcf-4fbe-9b11-1bba0e809ce8 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] [instance: 159e29dd-802c-4059-99f9-bb7c113d430b] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:10:25.028001 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e0b545fe-7bcf-4fbe-9b11-1bba0e809ce8 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:25.031322 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e0b545fe-7bcf-4fbe-9b11-1bba0e809ce8 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:25.037804 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e0b545fe-7bcf-4fbe-9b11-1bba0e809ce8 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:25.039462 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e0b545fe-7bcf-4fbe-9b11-1bba0e809ce8 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:25.041562 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e0b545fe-7bcf-4fbe-9b11-1bba0e809ce8 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:25.042454 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e0b545fe-7bcf-4fbe-9b11-1bba0e809ce8 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:25.441857 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-a487082b-8c33-4323-9d71-ac57c1156a9d tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: ba5cd412-0d20-4d2e-9f5e-de18f268008a] Going to try to terminate instance {{(pid=140492) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 21:10:25.462861 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.compute.api [None req-a487082b-8c33-4323-9d71-ac57c1156a9d tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: ba5cd412-0d20-4d2e-9f5e-de18f268008a] Working on deleting snapshot ee6a4beb-8d52-4453-9c55-9e7ba2daac48 from shelved instance... Oct 08 21:10:25.468770 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-e0b545fe-7bcf-4fbe-9b11-1bba0e809ce8 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:25.491501 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-e0b545fe-7bcf-4fbe-9b11-1bba0e809ce8 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:25.496750 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-e0b545fe-7bcf-4fbe-9b11-1bba0e809ce8 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:25.502188 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-e0b545fe-7bcf-4fbe-9b11-1bba0e809ce8 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] 10.222.0.26 "GET /compute/v2.1/servers/159e29dd-802c-4059-99f9-bb7c113d430b" status: 200 len: 1729 microversion: 2.20 time: 0.538676 Oct 08 21:10:25.526121 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2173/4389] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:10:24 2022] GET /compute/v2.1/servers/159e29dd-802c-4059-99f9-bb7c113d430b => generated 1729 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:10:25.540923 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-0022e706-5b00-4208-883e-6fe9d410e31e req-cbc67d70-6b47-4bbb-aad4-9c7b98c2f509 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba5cd412-0d20-4d2e-9f5e-de18f268008a", "name": "network-vif-unplugged", "status": "completed", "tag": "3c7983b1-4926-4db7-acf7-8d73050025e7"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:10:25.571879 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-0022e706-5b00-4208-883e-6fe9d410e31e req-cbc67d70-6b47-4bbb-aad4-9c7b98c2f509 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:25.579131 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-0022e706-5b00-4208-883e-6fe9d410e31e req-cbc67d70-6b47-4bbb-aad4-9c7b98c2f509 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:25.581374 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-0022e706-5b00-4208-883e-6fe9d410e31e req-cbc67d70-6b47-4bbb-aad4-9c7b98c2f509 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:25.625152 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.compute.server_external_events [req-0022e706-5b00-4208-883e-6fe9d410e31e req-cbc67d70-6b47-4bbb-aad4-9c7b98c2f509 service nova] Unable to find a host for instance ba5cd412-0d20-4d2e-9f5e-de18f268008a. Dropping event network-vif-unplugged {{(pid=140491) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 08 21:10:25.628580 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-0022e706-5b00-4208-883e-6fe9d410e31e req-cbc67d70-6b47-4bbb-aad4-9c7b98c2f509 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.100995 Oct 08 21:10:25.633417 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2174/4390] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:10:25 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 106 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 08 21:10:25.656206 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-6832b9d0-709b-47de-ada5-e455ac09e93c tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:10:25.658040 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-6832b9d0-709b-47de-ada5-e455ac09e93c tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:10:25.684816 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6832b9d0-709b-47de-ada5-e455ac09e93c tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:25.688788 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6832b9d0-709b-47de-ada5-e455ac09e93c tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:25.690420 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6832b9d0-709b-47de-ada5-e455ac09e93c tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:25.695964 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6832b9d0-709b-47de-ada5-e455ac09e93c tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:25.703334 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6832b9d0-709b-47de-ada5-e455ac09e93c tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:25.706659 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6832b9d0-709b-47de-ada5-e455ac09e93c tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:26.403315 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-6832b9d0-709b-47de-ada5-e455ac09e93c tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:26.415326 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-6832b9d0-709b-47de-ada5-e455ac09e93c tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 200 len: 1509 microversion: 2.1 time: 0.770102 Oct 08 21:10:26.417956 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2175/4391] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:10:25 2022] GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 1509 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:10:26.429753 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-a1978944-ebb5-42bc-aa07-2a13bb184c07 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:10:26.431267 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-a1978944-ebb5-42bc-aa07-2a13bb184c07 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] [instance: 1b68ff0f-2dfe-4844-b7ce-556768c5d3e2] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:10:26.447973 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a1978944-ebb5-42bc-aa07-2a13bb184c07 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:26.448735 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a1978944-ebb5-42bc-aa07-2a13bb184c07 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:26.452173 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a1978944-ebb5-42bc-aa07-2a13bb184c07 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:26.453127 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a1978944-ebb5-42bc-aa07-2a13bb184c07 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:26.453777 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a1978944-ebb5-42bc-aa07-2a13bb184c07 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:26.454368 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a1978944-ebb5-42bc-aa07-2a13bb184c07 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:26.551780 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a1978944-ebb5-42bc-aa07-2a13bb184c07 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:26.552399 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a1978944-ebb5-42bc-aa07-2a13bb184c07 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:26.552706 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a1978944-ebb5-42bc-aa07-2a13bb184c07 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:26.553166 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.objects.instance [None req-a1978944-ebb5-42bc-aa07-2a13bb184c07 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lazy-loading 'fault' on Instance uuid 1b68ff0f-2dfe-4844-b7ce-556768c5d3e2 {{(pid=140491) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 21:10:26.682750 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-a1978944-ebb5-42bc-aa07-2a13bb184c07 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85abb492492343c58734564a2b26c8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68b14967e8249fd886f168d366f241f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:26.691604 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-a1978944-ebb5-42bc-aa07-2a13bb184c07 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] 10.222.0.26 "GET /compute/v2.1/servers/1b68ff0f-2dfe-4844-b7ce-556768c5d3e2" status: 200 len: 1326 microversion: 2.1 time: 0.272366 Oct 08 21:10:26.692202 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2176/4392] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:10:26 2022] GET /compute/v2.1/servers/1b68ff0f-2dfe-4844-b7ce-556768c5d3e2 => generated 1326 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:10:26.713124 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-5ffa3002-a4b3-4b94-8331-dd051f495bbe req-e8e7f9af-fabd-41ca-8d25-05a7ba7cac0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b68ff0f-2dfe-4844-b7ce-556768c5d3e2", "name": "network-vif-deleted", "tag": "88154834-d566-47ce-bf02-2e28327ec781"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:10:26.739803 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-5ffa3002-a4b3-4b94-8331-dd051f495bbe req-e8e7f9af-fabd-41ca-8d25-05a7ba7cac0b service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:26.740338 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-5ffa3002-a4b3-4b94-8331-dd051f495bbe req-e8e7f9af-fabd-41ca-8d25-05a7ba7cac0b service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:26.740825 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-5ffa3002-a4b3-4b94-8331-dd051f495bbe req-e8e7f9af-fabd-41ca-8d25-05a7ba7cac0b service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:26.771684 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-5ffa3002-a4b3-4b94-8331-dd051f495bbe req-e8e7f9af-fabd-41ca-8d25-05a7ba7cac0b service nova] Creating event network-vif-deleted:88154834-d566-47ce-bf02-2e28327ec781 for instance 1b68ff0f-2dfe-4844-b7ce-556768c5d3e2 on nch2-master-1 Oct 08 21:10:26.779919 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-5ffa3002-a4b3-4b94-8331-dd051f495bbe req-e8e7f9af-fabd-41ca-8d25-05a7ba7cac0b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086001 Oct 08 21:10:26.780874 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2177/4393] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:10:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:10:26.786394 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-9536e138-3fce-4aeb-8aec-b96a26e66c31 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Calling method '.version_select at 0x7f1a877c3b80>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:10:27.664598 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-a487082b-8c33-4323-9d71-ac57c1156a9d tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: ba5cd412-0d20-4d2e-9f5e-de18f268008a] Doing local delete in cell 1a13ecad-3f87-496d-a2c5-ac44667fd176(cell1) {{(pid=140492) _delete /opt/stack/nova/nova/compute/api.py:2546}} Oct 08 21:10:27.667518 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a487082b-8c33-4323-9d71-ac57c1156a9d tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:27.668318 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a487082b-8c33-4323-9d71-ac57c1156a9d tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:27.670560 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a487082b-8c33-4323-9d71-ac57c1156a9d tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:27.671237 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.compute.api [None req-a487082b-8c33-4323-9d71-ac57c1156a9d tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: ba5cd412-0d20-4d2e-9f5e-de18f268008a] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Oct 08 21:10:27.687389 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.network.neutron [None req-a487082b-8c33-4323-9d71-ac57c1156a9d tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: ba5cd412-0d20-4d2e-9f5e-de18f268008a] deallocate_for_instance() {{(pid=140492) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Oct 08 21:10:29.331055 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.network.neutron [None req-a487082b-8c33-4323-9d71-ac57c1156a9d tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: ba5cd412-0d20-4d2e-9f5e-de18f268008a] Updating instance_info_cache with network_info: [] {{(pid=140492) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 08 21:10:29.664533 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-9536e138-3fce-4aeb-8aec-b96a26e66c31 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "GET /compute/v2.1/images/d1ab381b-0750-4a51-94cf-a046a286aaa9" status: 200 len: 1437 microversion: 2.1 time: 2.881618 Oct 08 21:10:29.665122 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2178/4394] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:10:26 2022] GET /compute/v2.1/images/d1ab381b-0750-4a51-94cf-a046a286aaa9 => generated 1437 bytes in 2884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:10:29.693264 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-8317e1f8-c09c-44a5-b252-56eb872d20c2 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:10:29.694202 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-8317e1f8-c09c-44a5-b252-56eb872d20c2 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] [instance: 159e29dd-802c-4059-99f9-bb7c113d430b] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:10:29.718700 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8317e1f8-c09c-44a5-b252-56eb872d20c2 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:29.719530 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8317e1f8-c09c-44a5-b252-56eb872d20c2 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:29.721143 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8317e1f8-c09c-44a5-b252-56eb872d20c2 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:29.721980 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8317e1f8-c09c-44a5-b252-56eb872d20c2 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:29.724931 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8317e1f8-c09c-44a5-b252-56eb872d20c2 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:29.729325 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-a487082b-8c33-4323-9d71-ac57c1156a9d tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "DELETE /compute/v2.1/servers/ba5cd412-0d20-4d2e-9f5e-de18f268008a" status: 204 len: 0 microversion: 2.1 time: 4.986922 Oct 08 21:10:29.730186 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8317e1f8-c09c-44a5-b252-56eb872d20c2 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:29.731478 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2217/4395] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:10:24 2022] DELETE /compute/v2.1/servers/ba5cd412-0d20-4d2e-9f5e-de18f268008a => generated 0 bytes in 4992 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 21:10:29.744601 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-ae499f40-9868-4391-a0fa-7977aee86c24 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:10:29.745676 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-ae499f40-9868-4391-a0fa-7977aee86c24 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:10:29.765012 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ae499f40-9868-4391-a0fa-7977aee86c24 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:29.766438 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ae499f40-9868-4391-a0fa-7977aee86c24 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:29.768559 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ae499f40-9868-4391-a0fa-7977aee86c24 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:29.769597 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ae499f40-9868-4391-a0fa-7977aee86c24 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:29.770685 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ae499f40-9868-4391-a0fa-7977aee86c24 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:29.772730 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ae499f40-9868-4391-a0fa-7977aee86c24 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:30.000911 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-ae499f40-9868-4391-a0fa-7977aee86c24 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:30.014625 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-ae499f40-9868-4391-a0fa-7977aee86c24 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 200 len: 1509 microversion: 2.1 time: 0.281715 Oct 08 21:10:30.015571 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2218/4396] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:10:29 2022] GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 1509 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:10:30.020510 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-937a0e34-0c5d-45e1-a8ad-5440dac02455 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:10:30.025938 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-937a0e34-0c5d-45e1-a8ad-5440dac02455 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] [instance: 1b68ff0f-2dfe-4844-b7ce-556768c5d3e2] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:10:30.042892 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-937a0e34-0c5d-45e1-a8ad-5440dac02455 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:30.043681 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-937a0e34-0c5d-45e1-a8ad-5440dac02455 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:30.044285 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-937a0e34-0c5d-45e1-a8ad-5440dac02455 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:30.045214 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-937a0e34-0c5d-45e1-a8ad-5440dac02455 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:30.045712 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-937a0e34-0c5d-45e1-a8ad-5440dac02455 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:30.046156 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-937a0e34-0c5d-45e1-a8ad-5440dac02455 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:30.066116 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-937a0e34-0c5d-45e1-a8ad-5440dac02455 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] HTTP exception thrown: Instance 1b68ff0f-2dfe-4844-b7ce-556768c5d3e2 could not be found. Oct 08 21:10:30.068288 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-937a0e34-0c5d-45e1-a8ad-5440dac02455 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Request method failure captured: Oct 08 21:10:30.068288 ncdv-master-1 devstack@n-api.service[140492]: request: GET /compute/v2.1/servers/1b68ff0f-2dfe-4844-b7ce-556768c5d3e2 HTTP/1.1 Oct 08 21:10:30.068288 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:10:30.068288 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:10:30.068288 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:10:30.068288 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 21:10:30.068288 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:10:30.068288 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:10:30.068288 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:10:30.068288 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:10:30.068288 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeYKg_fOvGoQQXA8z7gm2w4cyuJ0uMIK2G7N_9Q-47BWuaRUxiqsYvHjRUWZzQ4elsXIfCQhXDpTqmCNSEHvpVVYOCENb-BczX2vL5u--FCy853fHyDsOQRHRhN4DudwmKHCBHo34cSeZY2dF-KcA3mSu3_PCb2iL8kKxjyVjDebpNQ Oct 08 21:10:30.068288 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:10:30.068288 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:10:30.068288 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:10:30.068288 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:10:30.068288 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:10:30.068288 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:10:30.068288 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: c68b14967e8249fd886f168d366f241f Oct 08 21:10:30.068288 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-AttachVolumeTestJSON-2043566449 Oct 08 21:10:30.068288 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:10:30.068288 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:10:30.068288 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/c68b14967e8249fd886f168d366f241f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c68b14967e8249fd886f168d366f241f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_c68b14967e8249fd886f168d366f241f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c68b14967e8249fd886f168d366f241f"}]}] Oct 08 21:10:30.068288 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-AttachVolumeTestJSON-2043566449 Oct 08 21:10:30.068288 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: c68b14967e8249fd886f168d366f241f Oct 08 21:10:30.068288 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2043566449 Oct 08 21:10:30.068288 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-AttachVolumeTestJSON-2043566449-project Oct 08 21:10:30.068288 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:10:30.068288 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:10:30.068288 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 85abb492492343c58734564a2b26c8f6 Oct 08 21:10:30.068288 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-AttachVolumeTestJSON-2043566449-project Oct 08 21:10:30.068288 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 21:10:30.068288 ncdv-master-1 devstack@n-api.service[140492]: exception: Instance 1b68ff0f-2dfe-4844-b7ce-556768c5d3e2 could not be found. Oct 08 21:10:30.068288 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': '1b68ff0f-2dfe-4844-b7ce-556768c5d3e2'} Oct 08 21:10:30.068288 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:10:30.068288 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:10:30.068288 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:10:30.068288 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:10:30.068288 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:10:30.068288 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:10:30.068288 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:10:30.068288 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:10:30.068288 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:10:30.068288 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:10:30.068288 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b68ff0f-2dfe-4844-b7ce-556768c5d3e2 could not be found. Oct 08 21:10:30.068288 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:10:30.068288 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:10:30.068288 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:10:30.068288 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:10:30.068288 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:10:30.068288 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:10:30.068288 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:10:30.068288 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:10:30.068288 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:10:30.068288 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:10:30.068288 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:10:30.068288 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:10:30.068288 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:10:30.068288 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:10:30.068288 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:10:30.068288 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:10:30.068288 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b68ff0f-2dfe-4844-b7ce-556768c5d3e2 could not be found. Oct 08 21:10:30.068288 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:10:30.068288 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:10:30.068288 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:10:30.073327 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:10:30.073327 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:10:30.073327 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:10:30.073327 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:10:30.073327 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:10:30.073327 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b68ff0f-2dfe-4844-b7ce-556768c5d3e2 could not be found. Oct 08 21:10:30.073327 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:10:30.075124 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-937a0e34-0c5d-45e1-a8ad-5440dac02455 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Returning 404 to user: Instance 1b68ff0f-2dfe-4844-b7ce-556768c5d3e2 could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:10:30.076425 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-937a0e34-0c5d-45e1-a8ad-5440dac02455 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] 10.222.0.26 "GET /compute/v2.1/servers/1b68ff0f-2dfe-4844-b7ce-556768c5d3e2" status: 404 len: 111 microversion: 2.1 time: 0.059469 Oct 08 21:10:30.083105 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2219/4397] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:10:30 2022] GET /compute/v2.1/servers/1b68ff0f-2dfe-4844-b7ce-556768c5d3e2 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:10:30.090255 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-c622d23c-c8a9-4b98-bb5c-429260ea5314 req-c16a492e-21ec-45b4-aa4e-11f16ded1120 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba5cd412-0d20-4d2e-9f5e-de18f268008a", "name": "network-vif-deleted", "tag": "3c7983b1-4926-4db7-acf7-8d73050025e7"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:10:30.110202 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-c622d23c-c8a9-4b98-bb5c-429260ea5314 req-c16a492e-21ec-45b4-aa4e-11f16ded1120 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:30.113617 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-c622d23c-c8a9-4b98-bb5c-429260ea5314 req-c16a492e-21ec-45b4-aa4e-11f16ded1120 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:30.114906 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-c622d23c-c8a9-4b98-bb5c-429260ea5314 req-c16a492e-21ec-45b4-aa4e-11f16ded1120 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:30.143430 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.compute.server_external_events [req-c622d23c-c8a9-4b98-bb5c-429260ea5314 req-c16a492e-21ec-45b4-aa4e-11f16ded1120 service nova] Unable to find a host for instance ba5cd412-0d20-4d2e-9f5e-de18f268008a. Dropping event network-vif-deleted {{(pid=140492) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 08 21:10:30.150806 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-c622d23c-c8a9-4b98-bb5c-429260ea5314 req-c16a492e-21ec-45b4-aa4e-11f16ded1120 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.063756 Oct 08 21:10:30.152349 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2220/4398] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:10:30 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 68 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 08 21:10:30.160193 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-529071f3-a9b2-44a3-a469-a3face27f190 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:10:30.166593 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-529071f3-a9b2-44a3-a469-a3face27f190 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: ba5cd412-0d20-4d2e-9f5e-de18f268008a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:10:30.187214 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-529071f3-a9b2-44a3-a469-a3face27f190 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:30.187756 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-529071f3-a9b2-44a3-a469-a3face27f190 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:30.190805 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-529071f3-a9b2-44a3-a469-a3face27f190 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:30.191811 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-529071f3-a9b2-44a3-a469-a3face27f190 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:30.195493 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-529071f3-a9b2-44a3-a469-a3face27f190 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:30.196009 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-529071f3-a9b2-44a3-a469-a3face27f190 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:30.223983 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-529071f3-a9b2-44a3-a469-a3face27f190 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] HTTP exception thrown: Instance ba5cd412-0d20-4d2e-9f5e-de18f268008a could not be found. Oct 08 21:10:30.227259 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-529071f3-a9b2-44a3-a469-a3face27f190 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Request method failure captured: Oct 08 21:10:30.227259 ncdv-master-1 devstack@n-api.service[140492]: request: GET /compute/v2.1/servers/ba5cd412-0d20-4d2e-9f5e-de18f268008a HTTP/1.1 Oct 08 21:10:30.227259 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:10:30.227259 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:10:30.227259 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:10:30.227259 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 21:10:30.227259 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:10:30.227259 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:10:30.227259 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:10:30.227259 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:10:30.227259 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeaY45CCffIT40Amc9wEG1L3srTtCd58z19KxF0fYIwNPulOEB6B0U5KbwvP4xZlDymYa3r7NupuSBl7IoxTUgzZohPJnXbaXnL_FvPvzvmymW0IMjU5l88HUbi73sOE2TxCcEBd6artojZxtGFF9N7yzN3dTHpujcvoWiRD4lXAI28 Oct 08 21:10:30.227259 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:10:30.227259 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:10:30.227259 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:10:30.227259 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:10:30.227259 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:10:30.227259 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:10:30.227259 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 765c62cac2ee4406b23a5baa85c52ff7 Oct 08 21:10:30.227259 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-DeleteServersTestJSON-1423663413 Oct 08 21:10:30.227259 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:10:30.227259 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:10:30.227259 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/765c62cac2ee4406b23a5baa85c52ff7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/765c62cac2ee4406b23a5baa85c52ff7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_765c62cac2ee4406b23a5baa85c52ff7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/765c62cac2ee4406b23a5baa85c52ff7"}]}] Oct 08 21:10:30.227259 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-DeleteServersTestJSON-1423663413 Oct 08 21:10:30.227259 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 765c62cac2ee4406b23a5baa85c52ff7 Oct 08 21:10:30.227259 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-DeleteServersTestJSON-1423663413 Oct 08 21:10:30.227259 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-DeleteServersTestJSON-1423663413-project Oct 08 21:10:30.227259 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:10:30.227259 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:10:30.227259 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: d78e9afd772c4de981cac8f5817ec356 Oct 08 21:10:30.227259 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-DeleteServersTestJSON-1423663413-project Oct 08 21:10:30.227259 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 21:10:30.227259 ncdv-master-1 devstack@n-api.service[140492]: exception: Instance ba5cd412-0d20-4d2e-9f5e-de18f268008a could not be found. Oct 08 21:10:30.227259 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': 'ba5cd412-0d20-4d2e-9f5e-de18f268008a'} Oct 08 21:10:30.227259 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:10:30.227259 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:10:30.227259 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:10:30.227259 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:10:30.227259 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:10:30.227259 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:10:30.227259 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:10:30.227259 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:10:30.227259 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:10:30.227259 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:10:30.227259 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba5cd412-0d20-4d2e-9f5e-de18f268008a could not be found. Oct 08 21:10:30.227259 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:10:30.227259 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:10:30.227259 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:10:30.227259 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:10:30.227259 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:10:30.227259 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:10:30.227259 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:10:30.227259 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:10:30.227259 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:10:30.227259 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:10:30.227259 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:10:30.227259 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:10:30.227259 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:10:30.227259 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:10:30.227259 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:10:30.227259 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:10:30.227259 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba5cd412-0d20-4d2e-9f5e-de18f268008a could not be found. Oct 08 21:10:30.227259 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:10:30.227259 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:10:30.227259 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:10:30.231605 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:10:30.231605 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:10:30.231605 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:10:30.231605 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:10:30.231605 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:10:30.231605 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba5cd412-0d20-4d2e-9f5e-de18f268008a could not be found. Oct 08 21:10:30.231605 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:10:30.232766 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-529071f3-a9b2-44a3-a469-a3face27f190 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Returning 404 to user: Instance ba5cd412-0d20-4d2e-9f5e-de18f268008a could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:10:30.233829 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-529071f3-a9b2-44a3-a469-a3face27f190 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/ba5cd412-0d20-4d2e-9f5e-de18f268008a" status: 404 len: 111 microversion: 2.1 time: 0.077467 Oct 08 21:10:30.234906 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2221/4399] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:10:30 2022] GET /compute/v2.1/servers/ba5cd412-0d20-4d2e-9f5e-de18f268008a => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:10:30.256499 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-8317e1f8-c09c-44a5-b252-56eb872d20c2 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:30.260261 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-d8bb4445-6c87-4ecf-9fa4-2c8e29302f71 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Calling method '.version_select at 0x7f1a877189d0>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:10:30.266888 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-8317e1f8-c09c-44a5-b252-56eb872d20c2 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:30.272948 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-8317e1f8-c09c-44a5-b252-56eb872d20c2 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:30.274603 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-8317e1f8-c09c-44a5-b252-56eb872d20c2 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] 10.222.0.26 "GET /compute/v2.1/servers/159e29dd-802c-4059-99f9-bb7c113d430b" status: 200 len: 1729 microversion: 2.20 time: 0.597796 Oct 08 21:10:30.276985 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2179/4400] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:10:29 2022] GET /compute/v2.1/servers/159e29dd-802c-4059-99f9-bb7c113d430b => generated 1729 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:10:30.308465 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-d8bb4445-6c87-4ecf-9fa4-2c8e29302f71 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1762501138" status: 202 len: 0 microversion: 2.1 time: 0.071661 Oct 08 21:10:30.313710 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2222/4401] 10.222.0.26 () {58 vars in 1221 bytes} [Sat Oct 8 21:10:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1762501138 => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 21:10:30.607599 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-dddb740a-58c6-4444-ad48-fa290b7ef7a4 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-834208937", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "networks": [{"uuid": "82d56471-f1e9-4dc0-935a-29f2f2d2c7c0"}]}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:10:30.681536 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-000ff85d-089c-4169-a883-548ab65bba00 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Calling method '.version_select at 0x7f1a87727670>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:10:30.815013 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.network.neutron [None req-dddb740a-58c6-4444-ad48-fa290b7ef7a4 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] validate_networks() for [('82d56471-f1e9-4dc0-935a-29f2f2d2c7c0', None, None, None, None, None)] {{(pid=140491) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 21:10:30.832729 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-000ff85d-089c-4169-a883-548ab65bba00 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "GET /compute/v2.1/images/d1ab381b-0750-4a51-94cf-a046a286aaa9" status: 200 len: 1446 microversion: 2.1 time: 0.156538 Oct 08 21:10:30.833955 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2223/4402] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:10:30 2022] GET /compute/v2.1/images/d1ab381b-0750-4a51-94cf-a046a286aaa9 => generated 1446 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:10:30.847530 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-c080b51d-669f-4f2e-a92e-66f659d745a2 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Calling method '.version_select at 0x7f1a87718160>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:10:30.945374 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-c080b51d-669f-4f2e-a92e-66f659d745a2 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "GET /compute/v2.1/images/d1ab381b-0750-4a51-94cf-a046a286aaa9" status: 200 len: 1446 microversion: 2.1 time: 0.100945 Oct 08 21:10:30.955290 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2224/4403] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:10:30 2022] GET /compute/v2.1/images/d1ab381b-0750-4a51-94cf-a046a286aaa9 => generated 1446 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:10:30.960480 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-2c488028-4d51-46a6-bc41-99391d640ba8 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Calling method '.version_select at 0x7f1a87d223a0>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:10:31.859295 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-dddb740a-58c6-4444-ad48-fa290b7ef7a4 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Flavor limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 21:10:31.860384 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-dddb740a-58c6-4444-ad48-fa290b7ef7a4 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Image limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 21:10:31.861286 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-dddb740a-58c6-4444-ad48-fa290b7ef7a4 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Flavor pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 21:10:31.861938 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-dddb740a-58c6-4444-ad48-fa290b7ef7a4 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Image pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 21:10:31.862607 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-dddb740a-58c6-4444-ad48-fa290b7ef7a4 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 21:10:31.902755 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dddb740a-58c6-4444-ad48-fa290b7ef7a4 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:31.904961 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dddb740a-58c6-4444-ad48-fa290b7ef7a4 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:31.906834 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dddb740a-58c6-4444-ad48-fa290b7ef7a4 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:31.907832 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dddb740a-58c6-4444-ad48-fa290b7ef7a4 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:31.908308 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dddb740a-58c6-4444-ad48-fa290b7ef7a4 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:31.909014 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dddb740a-58c6-4444-ad48-fa290b7ef7a4 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:31.962508 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-dddb740a-58c6-4444-ad48-fa290b7ef7a4 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Getting quotas for project 765c62cac2ee4406b23a5baa85c52ff7. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:10:31.975388 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-dddb740a-58c6-4444-ad48-fa290b7ef7a4 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Getting quotas for user d78e9afd772c4de981cac8f5817ec356 and project 765c62cac2ee4406b23a5baa85c52ff7. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:10:32.010973 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-dddb740a-58c6-4444-ad48-fa290b7ef7a4 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Going to run 1 instances... {{(pid=140491) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 21:10:32.014207 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-dddb740a-58c6-4444-ad48-fa290b7ef7a4 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: 82b72e20-b9e2-45ce-9362-b248f6d47bda] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c508bd7f-7db9-4b2c-af7c-be54a855c355',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140491) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 21:10:32.169276 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-dddb740a-58c6-4444-ad48-fa290b7ef7a4 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.564647 Oct 08 21:10:32.182051 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2180/4404] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 21:10:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1573 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 08 21:10:32.187016 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-fb01e13a-f758-4cd4-9e74-d41c632aa638 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:10:32.190219 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-fb01e13a-f758-4cd4-9e74-d41c632aa638 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:10:32.210433 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fb01e13a-f758-4cd4-9e74-d41c632aa638 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:32.210882 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fb01e13a-f758-4cd4-9e74-d41c632aa638 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:32.211398 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fb01e13a-f758-4cd4-9e74-d41c632aa638 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:32.212072 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fb01e13a-f758-4cd4-9e74-d41c632aa638 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:32.212540 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fb01e13a-f758-4cd4-9e74-d41c632aa638 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:32.212984 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fb01e13a-f758-4cd4-9e74-d41c632aa638 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:32.577311 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-fb01e13a-f758-4cd4-9e74-d41c632aa638 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:32.602641 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-fb01e13a-f758-4cd4-9e74-d41c632aa638 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 200 len: 1509 microversion: 2.1 time: 0.421266 Oct 08 21:10:32.608198 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2181/4405] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:10:32 2022] GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 1509 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:10:32.634181 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-cf4b63e1-87f5-447e-a121-b144dd433338 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:10:32.639043 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-cf4b63e1-87f5-447e-a121-b144dd433338 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] [instance: 159e29dd-802c-4059-99f9-bb7c113d430b] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:10:32.676253 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cf4b63e1-87f5-447e-a121-b144dd433338 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:32.684607 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cf4b63e1-87f5-447e-a121-b144dd433338 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:32.688948 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cf4b63e1-87f5-447e-a121-b144dd433338 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:32.691136 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cf4b63e1-87f5-447e-a121-b144dd433338 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:32.698747 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cf4b63e1-87f5-447e-a121-b144dd433338 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:32.700111 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cf4b63e1-87f5-447e-a121-b144dd433338 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:32.832657 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-2c488028-4d51-46a6-bc41-99391d640ba8 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "DELETE /compute/v2.1/images/d1ab381b-0750-4a51-94cf-a046a286aaa9" status: 204 len: 0 microversion: 2.1 time: 1.876047 Oct 08 21:10:32.834130 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2225/4406] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:10:30 2022] DELETE /compute/v2.1/images/d1ab381b-0750-4a51-94cf-a046a286aaa9 => generated 0 bytes in 1878 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 08 21:10:32.840772 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e8573211-3f87-437f-9e1d-049ab700612d tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:10:32.841750 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-e8573211-3f87-437f-9e1d-049ab700612d tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: 82b72e20-b9e2-45ce-9362-b248f6d47bda] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:10:33.047353 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-cf4b63e1-87f5-447e-a121-b144dd433338 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:33.062675 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-cf4b63e1-87f5-447e-a121-b144dd433338 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:33.064639 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-cf4b63e1-87f5-447e-a121-b144dd433338 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:33.066809 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-cf4b63e1-87f5-447e-a121-b144dd433338 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] 10.222.0.26 "GET /compute/v2.1/servers/159e29dd-802c-4059-99f9-bb7c113d430b" status: 200 len: 1729 microversion: 2.20 time: 0.456744 Oct 08 21:10:33.069766 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2182/4407] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:10:32 2022] GET /compute/v2.1/servers/159e29dd-802c-4059-99f9-bb7c113d430b => generated 1729 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:10:33.075400 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-0bc0d80d-1d5d-45de-962d-8dde445b4ea0 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:10:33.076363 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-0bc0d80d-1d5d-45de-962d-8dde445b4ea0 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] [instance: 3fed4df9-92ff-4040-8fa7-db370960dc06] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:10:33.086469 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0bc0d80d-1d5d-45de-962d-8dde445b4ea0 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:33.087607 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0bc0d80d-1d5d-45de-962d-8dde445b4ea0 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:33.088218 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0bc0d80d-1d5d-45de-962d-8dde445b4ea0 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:33.089475 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0bc0d80d-1d5d-45de-962d-8dde445b4ea0 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:33.090991 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0bc0d80d-1d5d-45de-962d-8dde445b4ea0 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:33.091735 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0bc0d80d-1d5d-45de-962d-8dde445b4ea0 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:33.150728 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-0bc0d80d-1d5d-45de-962d-8dde445b4ea0 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] [instance: 3fed4df9-92ff-4040-8fa7-db370960dc06] Going to try to terminate instance {{(pid=140491) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 21:10:33.179621 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-e8573211-3f87-437f-9e1d-049ab700612d tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78e9afd772c4de981cac8f5817ec356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765c62cac2ee4406b23a5baa85c52ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:33.201539 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-e8573211-3f87-437f-9e1d-049ab700612d tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/82b72e20-b9e2-45ce-9362-b248f6d47bda" status: 200 len: 1214 microversion: 2.1 time: 0.365157 Oct 08 21:10:33.215592 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2226/4408] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:10:32 2022] GET /compute/v2.1/servers/82b72e20-b9e2-45ce-9362-b248f6d47bda => generated 1214 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:10:33.375287 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-0bc0d80d-1d5d-45de-962d-8dde445b4ea0 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "DELETE /compute/v2.1/servers/3fed4df9-92ff-4040-8fa7-db370960dc06" status: 204 len: 0 microversion: 2.1 time: 0.300508 Oct 08 21:10:33.387616 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2183/4409] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:10:33 2022] DELETE /compute/v2.1/servers/3fed4df9-92ff-4040-8fa7-db370960dc06 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 21:10:33.629281 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-c5403a9c-3bfe-4a84-9f22-144308bccda6 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:10:33.630086 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-c5403a9c-3bfe-4a84-9f22-144308bccda6 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:10:33.644998 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c5403a9c-3bfe-4a84-9f22-144308bccda6 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:33.648775 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c5403a9c-3bfe-4a84-9f22-144308bccda6 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:33.649456 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c5403a9c-3bfe-4a84-9f22-144308bccda6 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:33.659375 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c5403a9c-3bfe-4a84-9f22-144308bccda6 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:33.659375 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c5403a9c-3bfe-4a84-9f22-144308bccda6 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:33.659375 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c5403a9c-3bfe-4a84-9f22-144308bccda6 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:33.670686 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-a19560f9-778c-446e-a075-e714cc72eb8d tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1168958550", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "networks": [{"uuid": "76a3600a-da76-44b8-88b9-2779bd398388"}]}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:10:33.833659 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.network.neutron [None req-a19560f9-778c-446e-a075-e714cc72eb8d tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] validate_networks() for [('76a3600a-da76-44b8-88b9-2779bd398388', None, None, None, None, None)] {{(pid=140491) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 21:10:33.961753 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-c5403a9c-3bfe-4a84-9f22-144308bccda6 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:33.976851 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-c5403a9c-3bfe-4a84-9f22-144308bccda6 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 200 len: 1509 microversion: 2.1 time: 0.350528 Oct 08 21:10:33.982109 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2227/4410] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:10:33 2022] GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 1509 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:10:34.109058 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-4e2a8d15-8d94-420f-9cbf-239ee4b81788 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:10:34.109887 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-4e2a8d15-8d94-420f-9cbf-239ee4b81788 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] [instance: 159e29dd-802c-4059-99f9-bb7c113d430b] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:10:34.148020 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4e2a8d15-8d94-420f-9cbf-239ee4b81788 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:34.148562 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4e2a8d15-8d94-420f-9cbf-239ee4b81788 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:34.149033 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4e2a8d15-8d94-420f-9cbf-239ee4b81788 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:34.156737 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4e2a8d15-8d94-420f-9cbf-239ee4b81788 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:34.157645 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4e2a8d15-8d94-420f-9cbf-239ee4b81788 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:34.158290 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4e2a8d15-8d94-420f-9cbf-239ee4b81788 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:34.596534 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-4e2a8d15-8d94-420f-9cbf-239ee4b81788 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:34.614107 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-4e2a8d15-8d94-420f-9cbf-239ee4b81788 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:34.616047 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-4e2a8d15-8d94-420f-9cbf-239ee4b81788 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:34.627541 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-4e2a8d15-8d94-420f-9cbf-239ee4b81788 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] 10.222.0.26 "GET /compute/v2.1/servers/159e29dd-802c-4059-99f9-bb7c113d430b" status: 200 len: 1729 microversion: 2.20 time: 0.520713 Oct 08 21:10:34.628746 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2228/4411] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:10:34 2022] GET /compute/v2.1/servers/159e29dd-802c-4059-99f9-bb7c113d430b => generated 1729 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:10:34.642197 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-895563a1-a603-437d-8305-e302625f276b tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:10:34.648349 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-895563a1-a603-437d-8305-e302625f276b tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: 82b72e20-b9e2-45ce-9362-b248f6d47bda] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:10:34.666603 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-895563a1-a603-437d-8305-e302625f276b tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:34.670672 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-895563a1-a603-437d-8305-e302625f276b tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:34.671706 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-895563a1-a603-437d-8305-e302625f276b tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:34.672512 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-895563a1-a603-437d-8305-e302625f276b tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:34.673247 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-895563a1-a603-437d-8305-e302625f276b tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:34.673704 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-895563a1-a603-437d-8305-e302625f276b tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:34.842464 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-895563a1-a603-437d-8305-e302625f276b tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78e9afd772c4de981cac8f5817ec356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765c62cac2ee4406b23a5baa85c52ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:34.858661 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-895563a1-a603-437d-8305-e302625f276b tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/82b72e20-b9e2-45ce-9362-b248f6d47bda" status: 200 len: 1266 microversion: 2.1 time: 0.220105 Oct 08 21:10:34.874877 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2229/4412] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:10:34 2022] GET /compute/v2.1/servers/82b72e20-b9e2-45ce-9362-b248f6d47bda => generated 1266 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:10:34.916142 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-4688a356-7058-4f61-a2d5-3aeb5cef930b req-c2a9bee2-bac2-4280-be26-7f2560c0b681 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fed4df9-92ff-4040-8fa7-db370960dc06", "name": "network-vif-unplugged", "status": "completed", "tag": "25804709-1226-432d-bc34-f585676f5c93"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:10:34.943429 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-4688a356-7058-4f61-a2d5-3aeb5cef930b req-c2a9bee2-bac2-4280-be26-7f2560c0b681 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:34.946308 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-4688a356-7058-4f61-a2d5-3aeb5cef930b req-c2a9bee2-bac2-4280-be26-7f2560c0b681 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:34.947978 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-4688a356-7058-4f61-a2d5-3aeb5cef930b req-c2a9bee2-bac2-4280-be26-7f2560c0b681 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:34.958353 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=16,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:10:34.989999 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-4688a356-7058-4f61-a2d5-3aeb5cef930b req-c2a9bee2-bac2-4280-be26-7f2560c0b681 service nova] Creating event network-vif-unplugged:25804709-1226-432d-bc34-f585676f5c93 for instance 3fed4df9-92ff-4040-8fa7-db370960dc06 on nch1-master-1 Oct 08 21:10:35.009577 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-4688a356-7058-4f61-a2d5-3aeb5cef930b req-c2a9bee2-bac2-4280-be26-7f2560c0b681 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.129762 Oct 08 21:10:35.010337 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2230/4413] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:10:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:10:35.015758 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-f760b032-fbf9-49aa-99f8-1d7af86e0141 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:10:35.024269 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-f760b032-fbf9-49aa-99f8-1d7af86e0141 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:10:35.040309 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f760b032-fbf9-49aa-99f8-1d7af86e0141 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:35.041076 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f760b032-fbf9-49aa-99f8-1d7af86e0141 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:35.043823 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f760b032-fbf9-49aa-99f8-1d7af86e0141 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:35.044736 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f760b032-fbf9-49aa-99f8-1d7af86e0141 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:35.047605 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f760b032-fbf9-49aa-99f8-1d7af86e0141 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:35.048181 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f760b032-fbf9-49aa-99f8-1d7af86e0141 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:35.523327 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-f760b032-fbf9-49aa-99f8-1d7af86e0141 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:35.545967 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-f760b032-fbf9-49aa-99f8-1d7af86e0141 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 200 len: 1509 microversion: 2.1 time: 0.531252 Oct 08 21:10:35.549418 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2231/4414] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:10:35 2022] GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 1509 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:10:35.558681 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-870cf405-5948-4878-a7b0-f37dc50ae2f7 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:10:35.559437 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-870cf405-5948-4878-a7b0-f37dc50ae2f7 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] [instance: 1b68ff0f-2dfe-4844-b7ce-556768c5d3e2] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:10:35.582475 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-870cf405-5948-4878-a7b0-f37dc50ae2f7 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:35.583262 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-870cf405-5948-4878-a7b0-f37dc50ae2f7 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:35.583871 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-870cf405-5948-4878-a7b0-f37dc50ae2f7 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:35.584799 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-870cf405-5948-4878-a7b0-f37dc50ae2f7 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:35.587215 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-870cf405-5948-4878-a7b0-f37dc50ae2f7 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:35.589039 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-870cf405-5948-4878-a7b0-f37dc50ae2f7 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:35.623443 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-870cf405-5948-4878-a7b0-f37dc50ae2f7 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] HTTP exception thrown: Instance 1b68ff0f-2dfe-4844-b7ce-556768c5d3e2 could not be found. Oct 08 21:10:35.628607 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-870cf405-5948-4878-a7b0-f37dc50ae2f7 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Request method failure captured: Oct 08 21:10:35.628607 ncdv-master-1 devstack@n-api.service[140492]: request: DELETE /compute/v2.1/servers/1b68ff0f-2dfe-4844-b7ce-556768c5d3e2 HTTP/1.1 Oct 08 21:10:35.628607 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:10:35.628607 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:10:35.628607 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:10:35.628607 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 21:10:35.628607 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:10:35.628607 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:10:35.628607 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:10:35.628607 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:10:35.628607 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeYKg_fOvGoQQXA8z7gm2w4cyuJ0uMIK2G7N_9Q-47BWuaRUxiqsYvHjRUWZzQ4elsXIfCQhXDpTqmCNSEHvpVVYOCENb-BczX2vL5u--FCy853fHyDsOQRHRhN4DudwmKHCBHo34cSeZY2dF-KcA3mSu3_PCb2iL8kKxjyVjDebpNQ Oct 08 21:10:35.628607 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:10:35.628607 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:10:35.628607 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:10:35.628607 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:10:35.628607 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:10:35.628607 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:10:35.628607 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: c68b14967e8249fd886f168d366f241f Oct 08 21:10:35.628607 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-AttachVolumeTestJSON-2043566449 Oct 08 21:10:35.628607 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:10:35.628607 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:10:35.628607 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/c68b14967e8249fd886f168d366f241f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c68b14967e8249fd886f168d366f241f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_c68b14967e8249fd886f168d366f241f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c68b14967e8249fd886f168d366f241f"}]}] Oct 08 21:10:35.628607 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-AttachVolumeTestJSON-2043566449 Oct 08 21:10:35.628607 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: c68b14967e8249fd886f168d366f241f Oct 08 21:10:35.628607 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2043566449 Oct 08 21:10:35.628607 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-AttachVolumeTestJSON-2043566449-project Oct 08 21:10:35.628607 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:10:35.628607 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:10:35.628607 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 85abb492492343c58734564a2b26c8f6 Oct 08 21:10:35.628607 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-AttachVolumeTestJSON-2043566449-project Oct 08 21:10:35.628607 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 21:10:35.628607 ncdv-master-1 devstack@n-api.service[140492]: exception: Instance 1b68ff0f-2dfe-4844-b7ce-556768c5d3e2 could not be found. Oct 08 21:10:35.628607 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': '1b68ff0f-2dfe-4844-b7ce-556768c5d3e2'} Oct 08 21:10:35.628607 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:10:35.628607 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:10:35.628607 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:10:35.628607 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:10:35.628607 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:10:35.628607 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:10:35.628607 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:10:35.628607 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:10:35.628607 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:10:35.628607 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:10:35.628607 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b68ff0f-2dfe-4844-b7ce-556768c5d3e2 could not be found. Oct 08 21:10:35.628607 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:10:35.628607 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:10:35.628607 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:10:35.628607 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:10:35.628607 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:10:35.628607 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:10:35.628607 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:10:35.628607 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:10:35.628607 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:10:35.628607 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:10:35.628607 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 08 21:10:35.628607 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 08 21:10:35.628607 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 08 21:10:35.628607 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 08 21:10:35.628607 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:10:35.628607 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:10:35.628607 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:10:35.628607 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:10:35.633486 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b68ff0f-2dfe-4844-b7ce-556768c5d3e2 could not be found. Oct 08 21:10:35.633486 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:10:35.633486 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:10:35.633486 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:10:35.633486 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:10:35.633486 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:10:35.633486 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:10:35.633486 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:10:35.633486 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:10:35.633486 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b68ff0f-2dfe-4844-b7ce-556768c5d3e2 could not be found. Oct 08 21:10:35.633486 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:10:35.636191 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-870cf405-5948-4878-a7b0-f37dc50ae2f7 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Returning 404 to user: Instance 1b68ff0f-2dfe-4844-b7ce-556768c5d3e2 could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:10:35.640624 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-870cf405-5948-4878-a7b0-f37dc50ae2f7 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] 10.222.0.26 "DELETE /compute/v2.1/servers/1b68ff0f-2dfe-4844-b7ce-556768c5d3e2" status: 404 len: 111 microversion: 2.1 time: 0.089911 Oct 08 21:10:35.641494 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2232/4415] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:10:35 2022] DELETE /compute/v2.1/servers/1b68ff0f-2dfe-4844-b7ce-556768c5d3e2 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:10:35.987168 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-7d1a520d-3858-4961-949e-7eff0a578abd tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:10:35.988084 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-7d1a520d-3858-4961-949e-7eff0a578abd tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] [instance: 4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:10:36.002933 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7d1a520d-3858-4961-949e-7eff0a578abd tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:36.006642 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7d1a520d-3858-4961-949e-7eff0a578abd tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:36.007967 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7d1a520d-3858-4961-949e-7eff0a578abd tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:36.010460 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7d1a520d-3858-4961-949e-7eff0a578abd tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:36.013780 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7d1a520d-3858-4961-949e-7eff0a578abd tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:36.014799 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7d1a520d-3858-4961-949e-7eff0a578abd tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:36.056606 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-7d1a520d-3858-4961-949e-7eff0a578abd tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] [instance: 4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21] Going to try to terminate instance {{(pid=140492) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 21:10:36.223172 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-7d1a520d-3858-4961-949e-7eff0a578abd tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] 10.222.0.26 "DELETE /compute/v2.1/servers/4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21" status: 204 len: 0 microversion: 2.32 time: 0.573812 Oct 08 21:10:36.224238 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2233/4416] 10.222.0.26 () {60 vars in 1280 bytes} [Sat Oct 8 21:10:35 2022] DELETE /compute/v2.1/servers/4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21 => generated 0 bytes in 582 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 08 21:10:36.247922 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-26654929-7d4a-4be6-b269-6222fcc46d1b tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:10:36.251930 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-26654929-7d4a-4be6-b269-6222fcc46d1b tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] [instance: 1b68ff0f-2dfe-4844-b7ce-556768c5d3e2] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:10:36.292783 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-26654929-7d4a-4be6-b269-6222fcc46d1b tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:36.299690 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-26654929-7d4a-4be6-b269-6222fcc46d1b tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:36.303841 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-26654929-7d4a-4be6-b269-6222fcc46d1b tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:36.306123 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-26654929-7d4a-4be6-b269-6222fcc46d1b tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:36.310371 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-26654929-7d4a-4be6-b269-6222fcc46d1b tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:36.315332 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-26654929-7d4a-4be6-b269-6222fcc46d1b tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:36.373027 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-26654929-7d4a-4be6-b269-6222fcc46d1b tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] HTTP exception thrown: Instance 1b68ff0f-2dfe-4844-b7ce-556768c5d3e2 could not be found. Oct 08 21:10:36.381893 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-26654929-7d4a-4be6-b269-6222fcc46d1b tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Request method failure captured: Oct 08 21:10:36.381893 ncdv-master-1 devstack@n-api.service[140492]: request: GET /compute/v2.1/servers/1b68ff0f-2dfe-4844-b7ce-556768c5d3e2 HTTP/1.1 Oct 08 21:10:36.381893 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:10:36.381893 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:10:36.381893 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:10:36.381893 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 21:10:36.381893 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:10:36.381893 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:10:36.381893 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:10:36.381893 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:10:36.381893 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeYKg_fOvGoQQXA8z7gm2w4cyuJ0uMIK2G7N_9Q-47BWuaRUxiqsYvHjRUWZzQ4elsXIfCQhXDpTqmCNSEHvpVVYOCENb-BczX2vL5u--FCy853fHyDsOQRHRhN4DudwmKHCBHo34cSeZY2dF-KcA3mSu3_PCb2iL8kKxjyVjDebpNQ Oct 08 21:10:36.381893 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:10:36.381893 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:10:36.381893 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:10:36.381893 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:10:36.381893 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:10:36.381893 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:10:36.381893 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: c68b14967e8249fd886f168d366f241f Oct 08 21:10:36.381893 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-AttachVolumeTestJSON-2043566449 Oct 08 21:10:36.381893 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:10:36.381893 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:10:36.381893 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/c68b14967e8249fd886f168d366f241f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c68b14967e8249fd886f168d366f241f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_c68b14967e8249fd886f168d366f241f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c68b14967e8249fd886f168d366f241f"}]}] Oct 08 21:10:36.381893 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-AttachVolumeTestJSON-2043566449 Oct 08 21:10:36.381893 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: c68b14967e8249fd886f168d366f241f Oct 08 21:10:36.381893 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2043566449 Oct 08 21:10:36.381893 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-AttachVolumeTestJSON-2043566449-project Oct 08 21:10:36.381893 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:10:36.381893 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:10:36.381893 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 85abb492492343c58734564a2b26c8f6 Oct 08 21:10:36.381893 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-AttachVolumeTestJSON-2043566449-project Oct 08 21:10:36.381893 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 21:10:36.381893 ncdv-master-1 devstack@n-api.service[140492]: exception: Instance 1b68ff0f-2dfe-4844-b7ce-556768c5d3e2 could not be found. Oct 08 21:10:36.381893 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': '1b68ff0f-2dfe-4844-b7ce-556768c5d3e2'} Oct 08 21:10:36.381893 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:10:36.381893 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:10:36.381893 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:10:36.381893 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:10:36.381893 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:10:36.381893 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:10:36.381893 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:10:36.381893 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:10:36.381893 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:10:36.381893 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:10:36.381893 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b68ff0f-2dfe-4844-b7ce-556768c5d3e2 could not be found. Oct 08 21:10:36.381893 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:10:36.381893 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:10:36.381893 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:10:36.381893 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:10:36.381893 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:10:36.381893 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:10:36.381893 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:10:36.381893 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:10:36.381893 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:10:36.381893 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:10:36.381893 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:10:36.381893 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:10:36.381893 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:10:36.381893 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:10:36.381893 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:10:36.381893 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:10:36.381893 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b68ff0f-2dfe-4844-b7ce-556768c5d3e2 could not be found. Oct 08 21:10:36.381893 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:10:36.381893 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:10:36.381893 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:10:36.386837 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:10:36.386837 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:10:36.386837 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:10:36.386837 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:10:36.386837 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:10:36.386837 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b68ff0f-2dfe-4844-b7ce-556768c5d3e2 could not be found. Oct 08 21:10:36.386837 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:10:36.388352 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-26654929-7d4a-4be6-b269-6222fcc46d1b tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Returning 404 to user: Instance 1b68ff0f-2dfe-4844-b7ce-556768c5d3e2 could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:10:36.389418 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-26654929-7d4a-4be6-b269-6222fcc46d1b tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] 10.222.0.26 "GET /compute/v2.1/servers/1b68ff0f-2dfe-4844-b7ce-556768c5d3e2" status: 404 len: 111 microversion: 2.1 time: 0.158182 Oct 08 21:10:36.392556 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2234/4417] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:10:36 2022] GET /compute/v2.1/servers/1b68ff0f-2dfe-4844-b7ce-556768c5d3e2 => generated 111 bytes in 166 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:10:36.402686 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-3c1cf539-b23b-4fbd-8bc7-03ccaaf07431 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:10:36.405642 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-3c1cf539-b23b-4fbd-8bc7-03ccaaf07431 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] [instance: 159e29dd-802c-4059-99f9-bb7c113d430b] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:10:36.422177 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3c1cf539-b23b-4fbd-8bc7-03ccaaf07431 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:36.423721 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3c1cf539-b23b-4fbd-8bc7-03ccaaf07431 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:36.425935 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3c1cf539-b23b-4fbd-8bc7-03ccaaf07431 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:36.426886 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3c1cf539-b23b-4fbd-8bc7-03ccaaf07431 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:36.428481 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3c1cf539-b23b-4fbd-8bc7-03ccaaf07431 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:36.430867 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3c1cf539-b23b-4fbd-8bc7-03ccaaf07431 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:37.658475 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-a19560f9-778c-446e-a075-e714cc72eb8d tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Flavor limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 21:10:37.659209 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-a19560f9-778c-446e-a075-e714cc72eb8d tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Image limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 21:10:37.659305 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-a19560f9-778c-446e-a075-e714cc72eb8d tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Flavor pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 21:10:37.659689 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-a19560f9-778c-446e-a075-e714cc72eb8d tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Image pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 21:10:37.662609 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-a19560f9-778c-446e-a075-e714cc72eb8d tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 21:10:37.689274 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a19560f9-778c-446e-a075-e714cc72eb8d tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:37.689846 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a19560f9-778c-446e-a075-e714cc72eb8d tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:37.690347 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a19560f9-778c-446e-a075-e714cc72eb8d tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:37.698388 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a19560f9-778c-446e-a075-e714cc72eb8d tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:37.699192 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a19560f9-778c-446e-a075-e714cc72eb8d tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:37.699840 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a19560f9-778c-446e-a075-e714cc72eb8d tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:37.737417 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-a19560f9-778c-446e-a075-e714cc72eb8d tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Getting quotas for project 6bcd0e7c24154409824f96e9e99da357. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:10:37.749546 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-a19560f9-778c-446e-a075-e714cc72eb8d tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Getting quotas for user 30fe0e1ffa1040ec85d3c32d8b741c75 and project 6bcd0e7c24154409824f96e9e99da357. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:10:37.765464 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-a19560f9-778c-446e-a075-e714cc72eb8d tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Going to run 1 instances... {{(pid=140491) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 21:10:37.768651 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-a19560f9-778c-446e-a075-e714cc72eb8d tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] [instance: 8073b441-2650-4a77-9e97-9971a3f68282] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c508bd7f-7db9-4b2c-af7c-be54a855c355',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140491) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 21:10:37.828053 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-3c1cf539-b23b-4fbd-8bc7-03ccaaf07431 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:37.837508 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-3c1cf539-b23b-4fbd-8bc7-03ccaaf07431 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:37.850664 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-3c1cf539-b23b-4fbd-8bc7-03ccaaf07431 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:37.852633 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-3c1cf539-b23b-4fbd-8bc7-03ccaaf07431 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] 10.222.0.26 "GET /compute/v2.1/servers/159e29dd-802c-4059-99f9-bb7c113d430b" status: 200 len: 1729 microversion: 2.20 time: 1.458956 Oct 08 21:10:37.853686 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2235/4418] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:10:36 2022] GET /compute/v2.1/servers/159e29dd-802c-4059-99f9-bb7c113d430b => generated 1729 bytes in 1460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:10:37.858386 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-60d9100f-c632-4e14-9e45-ba95931afcda tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:10:37.858992 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-60d9100f-c632-4e14-9e45-ba95931afcda tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: 82b72e20-b9e2-45ce-9362-b248f6d47bda] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:10:37.870052 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-a19560f9-778c-446e-a075-e714cc72eb8d tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.209826 Oct 08 21:10:37.871270 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2184/4419] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 21:10:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 4212 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 08 21:10:37.879272 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-60d9100f-c632-4e14-9e45-ba95931afcda tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:37.879818 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-60d9100f-c632-4e14-9e45-ba95931afcda tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:37.880292 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-60d9100f-c632-4e14-9e45-ba95931afcda tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:37.881053 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-60d9100f-c632-4e14-9e45-ba95931afcda tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:37.881548 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-60d9100f-c632-4e14-9e45-ba95931afcda tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:37.882014 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-60d9100f-c632-4e14-9e45-ba95931afcda tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:37.884391 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-92664fa0-0693-43a7-b25f-1d937de7b38b tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:10:37.885607 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-92664fa0-0693-43a7-b25f-1d937de7b38b tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] [instance: 4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:10:37.906012 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-92664fa0-0693-43a7-b25f-1d937de7b38b tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:37.907939 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-92664fa0-0693-43a7-b25f-1d937de7b38b tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:37.911826 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-92664fa0-0693-43a7-b25f-1d937de7b38b tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:37.914360 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-92664fa0-0693-43a7-b25f-1d937de7b38b tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:37.916822 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-92664fa0-0693-43a7-b25f-1d937de7b38b tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:37.918974 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-92664fa0-0693-43a7-b25f-1d937de7b38b tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:38.014070 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-60d9100f-c632-4e14-9e45-ba95931afcda tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78e9afd772c4de981cac8f5817ec356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765c62cac2ee4406b23a5baa85c52ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:38.029231 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-60d9100f-c632-4e14-9e45-ba95931afcda tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/82b72e20-b9e2-45ce-9362-b248f6d47bda" status: 200 len: 1272 microversion: 2.1 time: 0.174223 Oct 08 21:10:38.032116 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2236/4420] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:10:37 2022] GET /compute/v2.1/servers/82b72e20-b9e2-45ce-9362-b248f6d47bda => generated 1272 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:10:38.056391 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-7584e3e1-5b2c-4f38-8e1e-a62821e7b9ac tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:10:38.056979 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-7584e3e1-5b2c-4f38-8e1e-a62821e7b9ac tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:10:38.087134 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7584e3e1-5b2c-4f38-8e1e-a62821e7b9ac tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:38.087675 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7584e3e1-5b2c-4f38-8e1e-a62821e7b9ac tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:38.088127 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7584e3e1-5b2c-4f38-8e1e-a62821e7b9ac tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:38.088856 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7584e3e1-5b2c-4f38-8e1e-a62821e7b9ac tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:38.089549 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7584e3e1-5b2c-4f38-8e1e-a62821e7b9ac tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:38.090350 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7584e3e1-5b2c-4f38-8e1e-a62821e7b9ac tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:39.145053 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-7584e3e1-5b2c-4f38-8e1e-a62821e7b9ac tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:39.174436 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-7584e3e1-5b2c-4f38-8e1e-a62821e7b9ac tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 200 len: 1509 microversion: 2.1 time: 1.130438 Oct 08 21:10:39.175255 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2237/4421] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:10:38 2022] GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 1509 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:10:39.210454 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-c5770ca6-815b-4d05-b2d2-b158ebc9a6da tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:10:39.214400 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-c5770ca6-815b-4d05-b2d2-b158ebc9a6da tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] [instance: ce4a2fbf-76f3-4577-a704-3b64ec30d84b] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:10:39.251439 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c5770ca6-815b-4d05-b2d2-b158ebc9a6da tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:39.255137 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c5770ca6-815b-4d05-b2d2-b158ebc9a6da tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:39.268666 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c5770ca6-815b-4d05-b2d2-b158ebc9a6da tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:39.277233 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c5770ca6-815b-4d05-b2d2-b158ebc9a6da tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:39.280423 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c5770ca6-815b-4d05-b2d2-b158ebc9a6da tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:39.281927 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c5770ca6-815b-4d05-b2d2-b158ebc9a6da tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:39.416517 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-c5770ca6-815b-4d05-b2d2-b158ebc9a6da tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] HTTP exception thrown: Instance ce4a2fbf-76f3-4577-a704-3b64ec30d84b could not be found. Oct 08 21:10:39.421174 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-c5770ca6-815b-4d05-b2d2-b158ebc9a6da tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Request method failure captured: Oct 08 21:10:39.421174 ncdv-master-1 devstack@n-api.service[140492]: request: DELETE /compute/v2.1/servers/ce4a2fbf-76f3-4577-a704-3b64ec30d84b HTTP/1.1 Oct 08 21:10:39.421174 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:10:39.421174 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:10:39.421174 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:10:39.421174 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 21:10:39.421174 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:10:39.421174 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:10:39.421174 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:10:39.421174 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:10:39.421174 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeYKg_fOvGoQQXA8z7gm2w4cyuJ0uMIK2G7N_9Q-47BWuaRUxiqsYvHjRUWZzQ4elsXIfCQhXDpTqmCNSEHvpVVYOCENb-BczX2vL5u--FCy853fHyDsOQRHRhN4DudwmKHCBHo34cSeZY2dF-KcA3mSu3_PCb2iL8kKxjyVjDebpNQ Oct 08 21:10:39.421174 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:10:39.421174 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:10:39.421174 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:10:39.421174 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:10:39.421174 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:10:39.421174 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:10:39.421174 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: c68b14967e8249fd886f168d366f241f Oct 08 21:10:39.421174 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-AttachVolumeTestJSON-2043566449 Oct 08 21:10:39.421174 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:10:39.421174 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:10:39.421174 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/c68b14967e8249fd886f168d366f241f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c68b14967e8249fd886f168d366f241f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_c68b14967e8249fd886f168d366f241f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c68b14967e8249fd886f168d366f241f"}]}] Oct 08 21:10:39.421174 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-AttachVolumeTestJSON-2043566449 Oct 08 21:10:39.421174 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: c68b14967e8249fd886f168d366f241f Oct 08 21:10:39.421174 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2043566449 Oct 08 21:10:39.421174 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-AttachVolumeTestJSON-2043566449-project Oct 08 21:10:39.421174 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:10:39.421174 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:10:39.421174 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 85abb492492343c58734564a2b26c8f6 Oct 08 21:10:39.421174 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-AttachVolumeTestJSON-2043566449-project Oct 08 21:10:39.421174 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 21:10:39.421174 ncdv-master-1 devstack@n-api.service[140492]: exception: Instance ce4a2fbf-76f3-4577-a704-3b64ec30d84b could not be found. Oct 08 21:10:39.421174 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': 'ce4a2fbf-76f3-4577-a704-3b64ec30d84b'} Oct 08 21:10:39.421174 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:10:39.421174 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:10:39.421174 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:10:39.421174 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:10:39.421174 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:10:39.421174 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:10:39.421174 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:10:39.421174 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:10:39.421174 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:10:39.421174 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:10:39.421174 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce4a2fbf-76f3-4577-a704-3b64ec30d84b could not be found. Oct 08 21:10:39.421174 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:10:39.421174 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:10:39.421174 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:10:39.421174 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:10:39.421174 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:10:39.421174 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:10:39.421174 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:10:39.421174 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:10:39.421174 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:10:39.421174 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:10:39.421174 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 08 21:10:39.421174 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 08 21:10:39.421174 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 08 21:10:39.421174 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 08 21:10:39.421174 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:10:39.421174 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:10:39.421174 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:10:39.421174 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:10:39.427983 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce4a2fbf-76f3-4577-a704-3b64ec30d84b could not be found. Oct 08 21:10:39.427983 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:10:39.427983 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:10:39.427983 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:10:39.427983 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:10:39.427983 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:10:39.427983 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:10:39.427983 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:10:39.427983 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:10:39.427983 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce4a2fbf-76f3-4577-a704-3b64ec30d84b could not be found. Oct 08 21:10:39.427983 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:10:39.427983 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-c5770ca6-815b-4d05-b2d2-b158ebc9a6da tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Returning 404 to user: Instance ce4a2fbf-76f3-4577-a704-3b64ec30d84b could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:10:39.427983 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-c5770ca6-815b-4d05-b2d2-b158ebc9a6da tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] 10.222.0.26 "DELETE /compute/v2.1/servers/ce4a2fbf-76f3-4577-a704-3b64ec30d84b" status: 404 len: 111 microversion: 2.1 time: 0.245102 Oct 08 21:10:39.430349 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2238/4422] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:10:39 2022] DELETE /compute/v2.1/servers/ce4a2fbf-76f3-4577-a704-3b64ec30d84b => generated 111 bytes in 254 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:10:39.439472 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-ea401067-3928-424c-8c56-b7ad8bbf15f3 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:10:39.455265 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-ea401067-3928-424c-8c56-b7ad8bbf15f3 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] [instance: 8073b441-2650-4a77-9e97-9971a3f68282] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:10:39.476928 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ea401067-3928-424c-8c56-b7ad8bbf15f3 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:39.479906 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ea401067-3928-424c-8c56-b7ad8bbf15f3 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:39.481748 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ea401067-3928-424c-8c56-b7ad8bbf15f3 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:39.483246 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ea401067-3928-424c-8c56-b7ad8bbf15f3 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:39.488005 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ea401067-3928-424c-8c56-b7ad8bbf15f3 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:39.488724 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ea401067-3928-424c-8c56-b7ad8bbf15f3 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:39.696498 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-92664fa0-0693-43a7-b25f-1d937de7b38b tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc2bdd169daf4a1db830b1fa7f94f0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f2d56477794f8ab38b8e3535b3e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:39.714181 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-92664fa0-0693-43a7-b25f-1d937de7b38b tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc2bdd169daf4a1db830b1fa7f94f0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f2d56477794f8ab38b8e3535b3e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:39.718138 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-92664fa0-0693-43a7-b25f-1d937de7b38b tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc2bdd169daf4a1db830b1fa7f94f0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f2d56477794f8ab38b8e3535b3e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:39.723064 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-92664fa0-0693-43a7-b25f-1d937de7b38b tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] 10.222.0.26 "GET /compute/v2.1/servers/4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21" status: 200 len: 2956 microversion: 2.32 time: 1.848699 Oct 08 21:10:39.727928 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2185/4423] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:10:37 2022] GET /compute/v2.1/servers/4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21 => generated 2956 bytes in 1856 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:10:39.747630 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-e037b3e7-91dd-4396-af0d-3afdf3b4fbe1 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:10:39.749315 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-e037b3e7-91dd-4396-af0d-3afdf3b4fbe1 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] [instance: 159e29dd-802c-4059-99f9-bb7c113d430b] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:10:39.759620 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-ea401067-3928-424c-8c56-b7ad8bbf15f3 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30fe0e1ffa1040ec85d3c32d8b741c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd0e7c24154409824f96e9e99da357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:39.765482 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e037b3e7-91dd-4396-af0d-3afdf3b4fbe1 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:39.766894 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e037b3e7-91dd-4396-af0d-3afdf3b4fbe1 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:39.768489 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e037b3e7-91dd-4396-af0d-3afdf3b4fbe1 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:39.770131 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e037b3e7-91dd-4396-af0d-3afdf3b4fbe1 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:39.772227 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e037b3e7-91dd-4396-af0d-3afdf3b4fbe1 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:39.773884 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e037b3e7-91dd-4396-af0d-3afdf3b4fbe1 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:39.784283 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-ea401067-3928-424c-8c56-b7ad8bbf15f3 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "GET /compute/v2.1/servers/8073b441-2650-4a77-9e97-9971a3f68282" status: 200 len: 1204 microversion: 2.1 time: 0.352698 Oct 08 21:10:39.785066 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2239/4424] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:10:39 2022] GET /compute/v2.1/servers/8073b441-2650-4a77-9e97-9971a3f68282 => generated 1204 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:10:39.795288 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-02afd11c-c037-492b-815f-7ed42648c639 req-e7056726-e2fe-4713-b828-b4c132e3542b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fed4df9-92ff-4040-8fa7-db370960dc06", "name": "network-vif-deleted", "tag": "25804709-1226-432d-bc34-f585676f5c93"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:10:39.840303 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-02afd11c-c037-492b-815f-7ed42648c639 req-e7056726-e2fe-4713-b828-b4c132e3542b service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:39.842990 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-02afd11c-c037-492b-815f-7ed42648c639 req-e7056726-e2fe-4713-b828-b4c132e3542b service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:39.844867 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-02afd11c-c037-492b-815f-7ed42648c639 req-e7056726-e2fe-4713-b828-b4c132e3542b service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:39.884721 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-02afd11c-c037-492b-815f-7ed42648c639 req-e7056726-e2fe-4713-b828-b4c132e3542b service nova] Creating event network-vif-deleted:25804709-1226-432d-bc34-f585676f5c93 for instance 3fed4df9-92ff-4040-8fa7-db370960dc06 on nch1-master-1 Oct 08 21:10:39.899938 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-02afd11c-c037-492b-815f-7ed42648c639 req-e7056726-e2fe-4713-b828-b4c132e3542b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111893 Oct 08 21:10:39.900898 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2240/4425] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:10:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:10:39.906659 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-11b02385-dfff-4532-be95-344be6cb2e81 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:10:39.920198 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-11b02385-dfff-4532-be95-344be6cb2e81 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: 82b72e20-b9e2-45ce-9362-b248f6d47bda] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:10:39.947549 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-11b02385-dfff-4532-be95-344be6cb2e81 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:39.948273 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-11b02385-dfff-4532-be95-344be6cb2e81 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:39.948892 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-11b02385-dfff-4532-be95-344be6cb2e81 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:39.949899 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-11b02385-dfff-4532-be95-344be6cb2e81 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:39.950588 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-11b02385-dfff-4532-be95-344be6cb2e81 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:39.951733 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-11b02385-dfff-4532-be95-344be6cb2e81 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:40.966527 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-11b02385-dfff-4532-be95-344be6cb2e81 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78e9afd772c4de981cac8f5817ec356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765c62cac2ee4406b23a5baa85c52ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:40.982109 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-11b02385-dfff-4532-be95-344be6cb2e81 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/82b72e20-b9e2-45ce-9362-b248f6d47bda" status: 200 len: 1314 microversion: 2.1 time: 1.079410 Oct 08 21:10:40.983229 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2241/4426] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:10:39 2022] GET /compute/v2.1/servers/82b72e20-b9e2-45ce-9362-b248f6d47bda => generated 1314 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:10:40.988127 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-75629110-3e95-47ae-9659-a9e215c9b167 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:10:41.000584 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-75629110-3e95-47ae-9659-a9e215c9b167 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] [instance: ce4a2fbf-76f3-4577-a704-3b64ec30d84b] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:10:41.036150 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-75629110-3e95-47ae-9659-a9e215c9b167 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:41.037544 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-75629110-3e95-47ae-9659-a9e215c9b167 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:41.039401 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-75629110-3e95-47ae-9659-a9e215c9b167 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:41.041830 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-75629110-3e95-47ae-9659-a9e215c9b167 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:41.044233 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-75629110-3e95-47ae-9659-a9e215c9b167 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:41.045166 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-75629110-3e95-47ae-9659-a9e215c9b167 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:41.075771 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-75629110-3e95-47ae-9659-a9e215c9b167 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] HTTP exception thrown: Instance ce4a2fbf-76f3-4577-a704-3b64ec30d84b could not be found. Oct 08 21:10:41.077790 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-75629110-3e95-47ae-9659-a9e215c9b167 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Request method failure captured: Oct 08 21:10:41.077790 ncdv-master-1 devstack@n-api.service[140492]: request: GET /compute/v2.1/servers/ce4a2fbf-76f3-4577-a704-3b64ec30d84b HTTP/1.1 Oct 08 21:10:41.077790 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:10:41.077790 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:10:41.077790 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:10:41.077790 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 21:10:41.077790 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:10:41.077790 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:10:41.077790 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:10:41.077790 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:10:41.077790 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeYKg_fOvGoQQXA8z7gm2w4cyuJ0uMIK2G7N_9Q-47BWuaRUxiqsYvHjRUWZzQ4elsXIfCQhXDpTqmCNSEHvpVVYOCENb-BczX2vL5u--FCy853fHyDsOQRHRhN4DudwmKHCBHo34cSeZY2dF-KcA3mSu3_PCb2iL8kKxjyVjDebpNQ Oct 08 21:10:41.077790 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:10:41.077790 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:10:41.077790 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:10:41.077790 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:10:41.077790 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:10:41.077790 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:10:41.077790 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: c68b14967e8249fd886f168d366f241f Oct 08 21:10:41.077790 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-AttachVolumeTestJSON-2043566449 Oct 08 21:10:41.077790 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:10:41.077790 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:10:41.077790 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/c68b14967e8249fd886f168d366f241f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c68b14967e8249fd886f168d366f241f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_c68b14967e8249fd886f168d366f241f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c68b14967e8249fd886f168d366f241f"}]}] Oct 08 21:10:41.077790 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-AttachVolumeTestJSON-2043566449 Oct 08 21:10:41.077790 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: c68b14967e8249fd886f168d366f241f Oct 08 21:10:41.077790 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2043566449 Oct 08 21:10:41.077790 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-AttachVolumeTestJSON-2043566449-project Oct 08 21:10:41.077790 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:10:41.077790 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:10:41.077790 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 85abb492492343c58734564a2b26c8f6 Oct 08 21:10:41.077790 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-AttachVolumeTestJSON-2043566449-project Oct 08 21:10:41.077790 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 21:10:41.077790 ncdv-master-1 devstack@n-api.service[140492]: exception: Instance ce4a2fbf-76f3-4577-a704-3b64ec30d84b could not be found. Oct 08 21:10:41.077790 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': 'ce4a2fbf-76f3-4577-a704-3b64ec30d84b'} Oct 08 21:10:41.077790 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:10:41.077790 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:10:41.077790 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:10:41.077790 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:10:41.077790 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:10:41.077790 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:10:41.077790 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:10:41.077790 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:10:41.077790 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:10:41.077790 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:10:41.077790 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce4a2fbf-76f3-4577-a704-3b64ec30d84b could not be found. Oct 08 21:10:41.077790 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:10:41.077790 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:10:41.077790 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:10:41.077790 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:10:41.077790 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:10:41.077790 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:10:41.077790 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:10:41.077790 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:10:41.077790 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:10:41.077790 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:10:41.077790 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:10:41.077790 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:10:41.077790 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:10:41.077790 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:10:41.077790 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:10:41.077790 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:10:41.077790 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce4a2fbf-76f3-4577-a704-3b64ec30d84b could not be found. Oct 08 21:10:41.077790 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:10:41.077790 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:10:41.077790 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:10:41.081870 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:10:41.081870 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:10:41.081870 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:10:41.081870 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:10:41.081870 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:10:41.081870 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce4a2fbf-76f3-4577-a704-3b64ec30d84b could not be found. Oct 08 21:10:41.081870 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:10:41.083966 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-75629110-3e95-47ae-9659-a9e215c9b167 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] Returning 404 to user: Instance ce4a2fbf-76f3-4577-a704-3b64ec30d84b could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:10:41.086141 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-75629110-3e95-47ae-9659-a9e215c9b167 tempest-AttachVolumeTestJSON-2043566449 tempest-AttachVolumeTestJSON-2043566449-project] 10.222.0.26 "GET /compute/v2.1/servers/ce4a2fbf-76f3-4577-a704-3b64ec30d84b" status: 404 len: 111 microversion: 2.1 time: 0.100696 Oct 08 21:10:41.087272 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2242/4427] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:10:40 2022] GET /compute/v2.1/servers/ce4a2fbf-76f3-4577-a704-3b64ec30d84b => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:10:41.092824 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-4ed3550d-f4a6-4443-a71d-1527824fd1cb tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:10:41.093864 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-4ed3550d-f4a6-4443-a71d-1527824fd1cb tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:10:41.101477 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4ed3550d-f4a6-4443-a71d-1527824fd1cb tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:41.102313 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4ed3550d-f4a6-4443-a71d-1527824fd1cb tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:41.102986 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4ed3550d-f4a6-4443-a71d-1527824fd1cb tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:41.104026 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4ed3550d-f4a6-4443-a71d-1527824fd1cb tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:41.104609 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4ed3550d-f4a6-4443-a71d-1527824fd1cb tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:41.105207 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4ed3550d-f4a6-4443-a71d-1527824fd1cb tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:41.114424 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-e037b3e7-91dd-4396-af0d-3afdf3b4fbe1 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:41.157526 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-e037b3e7-91dd-4396-af0d-3afdf3b4fbe1 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:41.167049 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-e037b3e7-91dd-4396-af0d-3afdf3b4fbe1 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:41.171588 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-e037b3e7-91dd-4396-af0d-3afdf3b4fbe1 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] 10.222.0.26 "GET /compute/v2.1/servers/159e29dd-802c-4059-99f9-bb7c113d430b" status: 200 len: 1729 microversion: 2.20 time: 1.440077 Oct 08 21:10:41.173539 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2186/4428] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:10:39 2022] GET /compute/v2.1/servers/159e29dd-802c-4059-99f9-bb7c113d430b => generated 1729 bytes in 1444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:10:41.187062 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-d925ca11-10b5-4e71-b937-f6f8d2bf8bd1 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:10:41.188852 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-d925ca11-10b5-4e71-b937-f6f8d2bf8bd1 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] [instance: 4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:10:41.205444 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:UPDATE=2,nova_api:SELECT=92,nova_api:INSERT=6 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:10:41.208959 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d925ca11-10b5-4e71-b937-f6f8d2bf8bd1 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:41.211862 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d925ca11-10b5-4e71-b937-f6f8d2bf8bd1 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:41.214716 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d925ca11-10b5-4e71-b937-f6f8d2bf8bd1 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:41.216033 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d925ca11-10b5-4e71-b937-f6f8d2bf8bd1 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:41.216763 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d925ca11-10b5-4e71-b937-f6f8d2bf8bd1 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:41.221868 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d925ca11-10b5-4e71-b937-f6f8d2bf8bd1 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:41.255416 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:10:41.772969 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-4ed3550d-f4a6-4443-a71d-1527824fd1cb tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:41.784877 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-4ed3550d-f4a6-4443-a71d-1527824fd1cb tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 200 len: 1509 microversion: 2.1 time: 0.696304 Oct 08 21:10:41.786066 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2243/4429] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:10:41 2022] GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 1509 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:10:41.793992 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-cb9a94da-45f7-4326-8476-dc9daa25cae5 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:10:41.794929 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-cb9a94da-45f7-4326-8476-dc9daa25cae5 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] [instance: 8073b441-2650-4a77-9e97-9971a3f68282] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:10:41.802775 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cb9a94da-45f7-4326-8476-dc9daa25cae5 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:41.803368 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cb9a94da-45f7-4326-8476-dc9daa25cae5 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:41.804552 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cb9a94da-45f7-4326-8476-dc9daa25cae5 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:41.805252 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cb9a94da-45f7-4326-8476-dc9daa25cae5 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:41.805810 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cb9a94da-45f7-4326-8476-dc9daa25cae5 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:41.806512 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cb9a94da-45f7-4326-8476-dc9daa25cae5 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:41.969371 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-cb9a94da-45f7-4326-8476-dc9daa25cae5 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30fe0e1ffa1040ec85d3c32d8b741c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd0e7c24154409824f96e9e99da357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:41.988677 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-cb9a94da-45f7-4326-8476-dc9daa25cae5 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "GET /compute/v2.1/servers/8073b441-2650-4a77-9e97-9971a3f68282" status: 200 len: 1266 microversion: 2.1 time: 0.200839 Oct 08 21:10:41.989744 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2244/4430] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:10:41 2022] GET /compute/v2.1/servers/8073b441-2650-4a77-9e97-9971a3f68282 => generated 1266 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:10:42.014215 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-5a8ef23c-261e-4970-90f6-d37487ad86de tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:10:42.015220 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-5a8ef23c-261e-4970-90f6-d37487ad86de tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: 82b72e20-b9e2-45ce-9362-b248f6d47bda] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:10:42.022199 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5a8ef23c-261e-4970-90f6-d37487ad86de tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:42.023111 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5a8ef23c-261e-4970-90f6-d37487ad86de tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:42.023763 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5a8ef23c-261e-4970-90f6-d37487ad86de tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:42.025067 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5a8ef23c-261e-4970-90f6-d37487ad86de tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:42.025750 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5a8ef23c-261e-4970-90f6-d37487ad86de tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:42.026573 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5a8ef23c-261e-4970-90f6-d37487ad86de tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:42.265072 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-d925ca11-10b5-4e71-b937-f6f8d2bf8bd1 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc2bdd169daf4a1db830b1fa7f94f0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f2d56477794f8ab38b8e3535b3e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:42.280801 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-d925ca11-10b5-4e71-b937-f6f8d2bf8bd1 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc2bdd169daf4a1db830b1fa7f94f0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f2d56477794f8ab38b8e3535b3e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:42.284082 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-d925ca11-10b5-4e71-b937-f6f8d2bf8bd1 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc2bdd169daf4a1db830b1fa7f94f0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f2d56477794f8ab38b8e3535b3e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:42.286696 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-d925ca11-10b5-4e71-b937-f6f8d2bf8bd1 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] 10.222.0.26 "GET /compute/v2.1/servers/4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21" status: 200 len: 2956 microversion: 2.32 time: 1.107383 Oct 08 21:10:42.304629 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2187/4431] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:10:41 2022] GET /compute/v2.1/servers/4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21 => generated 2956 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:10:42.323102 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c8cd50c1-2d78-4e8e-9aa8-35367ac589fc tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:10:42.326129 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-c8cd50c1-2d78-4e8e-9aa8-35367ac589fc tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] [instance: 159e29dd-802c-4059-99f9-bb7c113d430b] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:10:42.336145 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c8cd50c1-2d78-4e8e-9aa8-35367ac589fc tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:42.338129 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c8cd50c1-2d78-4e8e-9aa8-35367ac589fc tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:42.339234 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c8cd50c1-2d78-4e8e-9aa8-35367ac589fc tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:42.340277 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c8cd50c1-2d78-4e8e-9aa8-35367ac589fc tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:42.341425 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c8cd50c1-2d78-4e8e-9aa8-35367ac589fc tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:42.342808 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c8cd50c1-2d78-4e8e-9aa8-35367ac589fc tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:42.343903 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-5a8ef23c-261e-4970-90f6-d37487ad86de tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78e9afd772c4de981cac8f5817ec356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765c62cac2ee4406b23a5baa85c52ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:42.362871 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-5a8ef23c-261e-4970-90f6-d37487ad86de tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/82b72e20-b9e2-45ce-9362-b248f6d47bda" status: 200 len: 1314 microversion: 2.1 time: 0.349888 Oct 08 21:10:42.363783 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2245/4432] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:10:42 2022] GET /compute/v2.1/servers/82b72e20-b9e2-45ce-9362-b248f6d47bda => generated 1314 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:10:42.390498 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-af2c4615-a881-456f-b2f6-29d270cdd8b2 req-b74fe7c2-faed-4d14-9703-d891e86f7707 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82b72e20-b9e2-45ce-9362-b248f6d47bda", "tag": "5fd11ae9-08eb-4fb7-8f60-d383f7e46331"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:10:42.410694 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-af2c4615-a881-456f-b2f6-29d270cdd8b2 req-b74fe7c2-faed-4d14-9703-d891e86f7707 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:42.411795 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-af2c4615-a881-456f-b2f6-29d270cdd8b2 req-b74fe7c2-faed-4d14-9703-d891e86f7707 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:42.412447 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-af2c4615-a881-456f-b2f6-29d270cdd8b2 req-b74fe7c2-faed-4d14-9703-d891e86f7707 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:42.434080 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-af2c4615-a881-456f-b2f6-29d270cdd8b2 req-b74fe7c2-faed-4d14-9703-d891e86f7707 service nova] Creating event network-changed:5fd11ae9-08eb-4fb7-8f60-d383f7e46331 for instance 82b72e20-b9e2-45ce-9362-b248f6d47bda on nch2-master-1 Oct 08 21:10:42.444836 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-af2c4615-a881-456f-b2f6-29d270cdd8b2 req-b74fe7c2-faed-4d14-9703-d891e86f7707 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059496 Oct 08 21:10:42.446981 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2246/4433] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:10:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:10:42.811972 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-b0d475e5-6487-4b4e-b1b4-83243db3a8af tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:10:42.813137 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-b0d475e5-6487-4b4e-b1b4-83243db3a8af tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:10:42.828188 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b0d475e5-6487-4b4e-b1b4-83243db3a8af tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:42.829495 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b0d475e5-6487-4b4e-b1b4-83243db3a8af tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:42.829952 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b0d475e5-6487-4b4e-b1b4-83243db3a8af tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:42.832126 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b0d475e5-6487-4b4e-b1b4-83243db3a8af tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:42.832527 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b0d475e5-6487-4b4e-b1b4-83243db3a8af tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:42.833233 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b0d475e5-6487-4b4e-b1b4-83243db3a8af tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:42.899099 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-c8cd50c1-2d78-4e8e-9aa8-35367ac589fc tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:42.914142 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-c8cd50c1-2d78-4e8e-9aa8-35367ac589fc tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:42.916913 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-c8cd50c1-2d78-4e8e-9aa8-35367ac589fc tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:42.921545 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-c8cd50c1-2d78-4e8e-9aa8-35367ac589fc tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] 10.222.0.26 "GET /compute/v2.1/servers/159e29dd-802c-4059-99f9-bb7c113d430b" status: 200 len: 1729 microversion: 2.20 time: 0.609803 Oct 08 21:10:42.936778 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2188/4434] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:10:42 2022] GET /compute/v2.1/servers/159e29dd-802c-4059-99f9-bb7c113d430b => generated 1729 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:10:43.015333 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-663d210a-2bfc-472d-94d5-b497ca2233c9 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:10:43.016498 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-663d210a-2bfc-472d-94d5-b497ca2233c9 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] [instance: 8073b441-2650-4a77-9e97-9971a3f68282] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:10:43.025291 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-663d210a-2bfc-472d-94d5-b497ca2233c9 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:43.026264 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-663d210a-2bfc-472d-94d5-b497ca2233c9 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:43.027148 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-663d210a-2bfc-472d-94d5-b497ca2233c9 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:43.028224 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-663d210a-2bfc-472d-94d5-b497ca2233c9 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:43.029014 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-663d210a-2bfc-472d-94d5-b497ca2233c9 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:43.030123 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-663d210a-2bfc-472d-94d5-b497ca2233c9 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:43.194568 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=2 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:10:43.380594 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-663d210a-2bfc-472d-94d5-b497ca2233c9 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30fe0e1ffa1040ec85d3c32d8b741c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd0e7c24154409824f96e9e99da357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:43.400934 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-663d210a-2bfc-472d-94d5-b497ca2233c9 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "GET /compute/v2.1/servers/8073b441-2650-4a77-9e97-9971a3f68282" status: 200 len: 1308 microversion: 2.1 time: 0.390778 Oct 08 21:10:43.406546 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2189/4435] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:10:43 2022] GET /compute/v2.1/servers/8073b441-2650-4a77-9e97-9971a3f68282 => generated 1308 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:10:43.411421 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-6402ffe3-6d3c-4b0f-979d-5a118a48a4a0 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:10:43.415053 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-6402ffe3-6d3c-4b0f-979d-5a118a48a4a0 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] [instance: 4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:10:43.424825 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6402ffe3-6d3c-4b0f-979d-5a118a48a4a0 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:43.425766 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6402ffe3-6d3c-4b0f-979d-5a118a48a4a0 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:43.426297 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6402ffe3-6d3c-4b0f-979d-5a118a48a4a0 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:43.427530 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6402ffe3-6d3c-4b0f-979d-5a118a48a4a0 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:43.428374 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6402ffe3-6d3c-4b0f-979d-5a118a48a4a0 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:43.429588 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6402ffe3-6d3c-4b0f-979d-5a118a48a4a0 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:43.546398 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-b0d475e5-6487-4b4e-b1b4-83243db3a8af tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:43.557922 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-b0d475e5-6487-4b4e-b1b4-83243db3a8af tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 200 len: 1509 microversion: 2.1 time: 0.751913 Oct 08 21:10:43.573221 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2247/4436] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:10:42 2022] GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 1509 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:10:43.573221 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-a02d8f5c-1d30-4098-aa9f-ea8821c460d5 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:10:43.573221 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-a02d8f5c-1d30-4098-aa9f-ea8821c460d5 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: 82b72e20-b9e2-45ce-9362-b248f6d47bda] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:10:43.582928 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a02d8f5c-1d30-4098-aa9f-ea8821c460d5 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:43.584173 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a02d8f5c-1d30-4098-aa9f-ea8821c460d5 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:43.585452 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a02d8f5c-1d30-4098-aa9f-ea8821c460d5 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:43.586983 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a02d8f5c-1d30-4098-aa9f-ea8821c460d5 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:43.587884 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a02d8f5c-1d30-4098-aa9f-ea8821c460d5 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:43.588491 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a02d8f5c-1d30-4098-aa9f-ea8821c460d5 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:43.852489 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-6402ffe3-6d3c-4b0f-979d-5a118a48a4a0 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc2bdd169daf4a1db830b1fa7f94f0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f2d56477794f8ab38b8e3535b3e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:43.879617 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-6402ffe3-6d3c-4b0f-979d-5a118a48a4a0 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc2bdd169daf4a1db830b1fa7f94f0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f2d56477794f8ab38b8e3535b3e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:43.881476 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-6402ffe3-6d3c-4b0f-979d-5a118a48a4a0 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc2bdd169daf4a1db830b1fa7f94f0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f2d56477794f8ab38b8e3535b3e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:43.883087 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-6402ffe3-6d3c-4b0f-979d-5a118a48a4a0 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] 10.222.0.26 "GET /compute/v2.1/servers/4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21" status: 200 len: 2935 microversion: 2.32 time: 0.478796 Oct 08 21:10:43.884223 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2190/4437] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:10:43 2022] GET /compute/v2.1/servers/4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21 => generated 2935 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:10:43.958677 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-fdf6f0f4-b0f8-4e83-a63b-914ce4193e11 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:10:43.959683 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-fdf6f0f4-b0f8-4e83-a63b-914ce4193e11 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] [instance: 159e29dd-802c-4059-99f9-bb7c113d430b] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:10:43.977700 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fdf6f0f4-b0f8-4e83-a63b-914ce4193e11 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:43.978478 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fdf6f0f4-b0f8-4e83-a63b-914ce4193e11 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:43.979092 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fdf6f0f4-b0f8-4e83-a63b-914ce4193e11 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:43.980380 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fdf6f0f4-b0f8-4e83-a63b-914ce4193e11 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:43.981026 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fdf6f0f4-b0f8-4e83-a63b-914ce4193e11 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:43.981656 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fdf6f0f4-b0f8-4e83-a63b-914ce4193e11 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:44.388333 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-a02d8f5c-1d30-4098-aa9f-ea8821c460d5 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78e9afd772c4de981cac8f5817ec356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765c62cac2ee4406b23a5baa85c52ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:44.397084 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-a02d8f5c-1d30-4098-aa9f-ea8821c460d5 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/82b72e20-b9e2-45ce-9362-b248f6d47bda" status: 200 len: 1314 microversion: 2.1 time: 0.837068 Oct 08 21:10:44.401554 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-fdf6f0f4-b0f8-4e83-a63b-914ce4193e11 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:44.425251 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2248/4438] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:10:43 2022] GET /compute/v2.1/servers/82b72e20-b9e2-45ce-9362-b248f6d47bda => generated 1314 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:10:44.433632 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-fdf6f0f4-b0f8-4e83-a63b-914ce4193e11 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:44.438909 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-fdf6f0f4-b0f8-4e83-a63b-914ce4193e11 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:44.443495 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-fdf6f0f4-b0f8-4e83-a63b-914ce4193e11 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] 10.222.0.26 "GET /compute/v2.1/servers/159e29dd-802c-4059-99f9-bb7c113d430b" status: 200 len: 1729 microversion: 2.20 time: 0.491994 Oct 08 21:10:44.446253 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-9877cd9a-e160-47e5-854e-e2dfc777e991 req-01577cec-19c0-4f33-8cf0-86ff82dc7f5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21", "name": "network-vif-unplugged", "status": "completed", "tag": "818a7d0e-582a-4f5d-902b-606c8c4608af"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:10:44.448060 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2191/4439] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:10:43 2022] GET /compute/v2.1/servers/159e29dd-802c-4059-99f9-bb7c113d430b => generated 1729 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:10:44.475182 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-3f523566-54a9-42b5-93bb-5a555189308d tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:10:44.479144 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-3f523566-54a9-42b5-93bb-5a555189308d tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] [instance: 8073b441-2650-4a77-9e97-9971a3f68282] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:10:44.493653 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-9877cd9a-e160-47e5-854e-e2dfc777e991 req-01577cec-19c0-4f33-8cf0-86ff82dc7f5f service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:44.494707 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-9877cd9a-e160-47e5-854e-e2dfc777e991 req-01577cec-19c0-4f33-8cf0-86ff82dc7f5f service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:44.497819 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3f523566-54a9-42b5-93bb-5a555189308d tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:44.498694 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-9877cd9a-e160-47e5-854e-e2dfc777e991 req-01577cec-19c0-4f33-8cf0-86ff82dc7f5f service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:44.504328 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3f523566-54a9-42b5-93bb-5a555189308d tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:44.510188 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3f523566-54a9-42b5-93bb-5a555189308d tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:44.511467 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3f523566-54a9-42b5-93bb-5a555189308d tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:44.512230 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3f523566-54a9-42b5-93bb-5a555189308d tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:44.513484 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3f523566-54a9-42b5-93bb-5a555189308d tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:44.536237 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-9877cd9a-e160-47e5-854e-e2dfc777e991 req-01577cec-19c0-4f33-8cf0-86ff82dc7f5f service nova] Creating event network-vif-unplugged:818a7d0e-582a-4f5d-902b-606c8c4608af for instance 4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21 on nch1-master-1 Oct 08 21:10:44.547183 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-9877cd9a-e160-47e5-854e-e2dfc777e991 req-01577cec-19c0-4f33-8cf0-86ff82dc7f5f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.130777 Oct 08 21:10:44.548958 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2249/4440] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:10:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:10:44.591907 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-9a9e37c8-4ddf-4eed-93ac-c098e5ea368a tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:10:44.593403 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-9a9e37c8-4ddf-4eed-93ac-c098e5ea368a tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:10:44.608370 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9a9e37c8-4ddf-4eed-93ac-c098e5ea368a tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:44.615496 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9a9e37c8-4ddf-4eed-93ac-c098e5ea368a tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:44.617140 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9a9e37c8-4ddf-4eed-93ac-c098e5ea368a tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:44.624251 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9a9e37c8-4ddf-4eed-93ac-c098e5ea368a tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:44.624881 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9a9e37c8-4ddf-4eed-93ac-c098e5ea368a tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:44.625383 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9a9e37c8-4ddf-4eed-93ac-c098e5ea368a tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:44.678403 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:10:44.908302 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-3f523566-54a9-42b5-93bb-5a555189308d tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30fe0e1ffa1040ec85d3c32d8b741c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd0e7c24154409824f96e9e99da357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:44.923954 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-3f523566-54a9-42b5-93bb-5a555189308d tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "GET /compute/v2.1/servers/8073b441-2650-4a77-9e97-9971a3f68282" status: 200 len: 1308 microversion: 2.1 time: 0.473466 Oct 08 21:10:44.924634 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2192/4441] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:10:44 2022] GET /compute/v2.1/servers/8073b441-2650-4a77-9e97-9971a3f68282 => generated 1308 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:10:44.933433 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-bd19496f-0880-40fb-a5b8-adb2d8548bb0 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:10:44.934427 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-bd19496f-0880-40fb-a5b8-adb2d8548bb0 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] [instance: 4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:10:44.949061 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bd19496f-0880-40fb-a5b8-adb2d8548bb0 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:44.949708 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bd19496f-0880-40fb-a5b8-adb2d8548bb0 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:44.950211 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bd19496f-0880-40fb-a5b8-adb2d8548bb0 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:44.950944 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bd19496f-0880-40fb-a5b8-adb2d8548bb0 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:44.951414 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bd19496f-0880-40fb-a5b8-adb2d8548bb0 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:44.951856 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bd19496f-0880-40fb-a5b8-adb2d8548bb0 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:45.321677 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-9a9e37c8-4ddf-4eed-93ac-c098e5ea368a tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:45.344117 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-9a9e37c8-4ddf-4eed-93ac-c098e5ea368a tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 200 len: 1509 microversion: 2.1 time: 0.758501 Oct 08 21:10:45.362185 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2250/4442] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:10:44 2022] GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 1509 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:10:45.432922 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-bd19496f-0880-40fb-a5b8-adb2d8548bb0 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc2bdd169daf4a1db830b1fa7f94f0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f2d56477794f8ab38b8e3535b3e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:45.443334 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-9cbc9f11-83c8-4353-af54-578a8aa332f2 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:10:45.445990 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-9cbc9f11-83c8-4353-af54-578a8aa332f2 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: 82b72e20-b9e2-45ce-9362-b248f6d47bda] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:10:45.456304 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-bd19496f-0880-40fb-a5b8-adb2d8548bb0 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc2bdd169daf4a1db830b1fa7f94f0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f2d56477794f8ab38b8e3535b3e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:45.457821 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9cbc9f11-83c8-4353-af54-578a8aa332f2 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:45.458651 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9cbc9f11-83c8-4353-af54-578a8aa332f2 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:45.458974 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-bd19496f-0880-40fb-a5b8-adb2d8548bb0 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc2bdd169daf4a1db830b1fa7f94f0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f2d56477794f8ab38b8e3535b3e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:45.459521 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9cbc9f11-83c8-4353-af54-578a8aa332f2 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:45.462577 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9cbc9f11-83c8-4353-af54-578a8aa332f2 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:45.463755 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9cbc9f11-83c8-4353-af54-578a8aa332f2 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:45.464431 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9cbc9f11-83c8-4353-af54-578a8aa332f2 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:45.464669 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-bd19496f-0880-40fb-a5b8-adb2d8548bb0 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] 10.222.0.26 "GET /compute/v2.1/servers/4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21" status: 200 len: 2914 microversion: 2.32 time: 0.538591 Oct 08 21:10:45.465365 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2193/4443] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:10:44 2022] GET /compute/v2.1/servers/4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21 => generated 2914 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:10:45.499914 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-b234d78b-3854-405c-976f-fd6ea9f3e69c tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:10:45.502687 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-b234d78b-3854-405c-976f-fd6ea9f3e69c tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] [instance: 159e29dd-802c-4059-99f9-bb7c113d430b] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:10:45.515548 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b234d78b-3854-405c-976f-fd6ea9f3e69c tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:45.519915 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b234d78b-3854-405c-976f-fd6ea9f3e69c tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:45.521468 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b234d78b-3854-405c-976f-fd6ea9f3e69c tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:45.522270 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b234d78b-3854-405c-976f-fd6ea9f3e69c tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:45.523320 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b234d78b-3854-405c-976f-fd6ea9f3e69c tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:45.523777 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b234d78b-3854-405c-976f-fd6ea9f3e69c tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:45.911690 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-9cbc9f11-83c8-4353-af54-578a8aa332f2 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78e9afd772c4de981cac8f5817ec356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765c62cac2ee4406b23a5baa85c52ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:45.922041 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-9cbc9f11-83c8-4353-af54-578a8aa332f2 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/82b72e20-b9e2-45ce-9362-b248f6d47bda" status: 200 len: 1314 microversion: 2.1 time: 0.484235 Oct 08 21:10:45.923305 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2251/4444] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:10:45 2022] GET /compute/v2.1/servers/82b72e20-b9e2-45ce-9362-b248f6d47bda => generated 1314 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:10:45.955618 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-ca4738e8-a760-484a-8a92-102b601723b9 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:10:45.956362 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-ca4738e8-a760-484a-8a92-102b601723b9 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] [instance: 8073b441-2650-4a77-9e97-9971a3f68282] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:10:45.963556 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ca4738e8-a760-484a-8a92-102b601723b9 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:45.964060 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ca4738e8-a760-484a-8a92-102b601723b9 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:45.964507 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ca4738e8-a760-484a-8a92-102b601723b9 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:45.965248 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ca4738e8-a760-484a-8a92-102b601723b9 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:45.965720 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ca4738e8-a760-484a-8a92-102b601723b9 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:45.966151 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ca4738e8-a760-484a-8a92-102b601723b9 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:46.400233 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-b234d78b-3854-405c-976f-fd6ea9f3e69c tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:46.411465 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-b234d78b-3854-405c-976f-fd6ea9f3e69c tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:46.418644 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-b234d78b-3854-405c-976f-fd6ea9f3e69c tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:46.425876 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-b234d78b-3854-405c-976f-fd6ea9f3e69c tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] 10.222.0.26 "GET /compute/v2.1/servers/159e29dd-802c-4059-99f9-bb7c113d430b" status: 200 len: 1729 microversion: 2.20 time: 0.941147 Oct 08 21:10:46.441033 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2194/4445] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:10:45 2022] GET /compute/v2.1/servers/159e29dd-802c-4059-99f9-bb7c113d430b => generated 1729 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:10:46.454294 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-3e7f7a01-7093-4136-a0a7-f20c242324b3 req-0a05749c-1583-4d29-b342-693ff7413a52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8073b441-2650-4a77-9e97-9971a3f68282", "tag": "676c3848-0a48-4fe1-9081-833908787a16"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:10:46.467703 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-3e7f7a01-7093-4136-a0a7-f20c242324b3 req-0a05749c-1583-4d29-b342-693ff7413a52 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:46.468290 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-3e7f7a01-7093-4136-a0a7-f20c242324b3 req-0a05749c-1583-4d29-b342-693ff7413a52 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:46.468851 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-3e7f7a01-7093-4136-a0a7-f20c242324b3 req-0a05749c-1583-4d29-b342-693ff7413a52 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:46.484969 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-3e7f7a01-7093-4136-a0a7-f20c242324b3 req-0a05749c-1583-4d29-b342-693ff7413a52 service nova] Creating event network-changed:676c3848-0a48-4fe1-9081-833908787a16 for instance 8073b441-2650-4a77-9e97-9971a3f68282 on nch1-master-1 Oct 08 21:10:46.497244 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-3e7f7a01-7093-4136-a0a7-f20c242324b3 req-0a05749c-1583-4d29-b342-693ff7413a52 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047426 Oct 08 21:10:46.498272 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2195/4446] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:10:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:10:46.505619 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-9a60a12f-aa39-4a04-a32a-da0b8eb205bd tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:10:46.506430 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-9a60a12f-aa39-4a04-a32a-da0b8eb205bd tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:10:46.514636 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9a60a12f-aa39-4a04-a32a-da0b8eb205bd tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:46.515237 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9a60a12f-aa39-4a04-a32a-da0b8eb205bd tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:46.515780 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9a60a12f-aa39-4a04-a32a-da0b8eb205bd tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:46.516792 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9a60a12f-aa39-4a04-a32a-da0b8eb205bd tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:46.517586 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9a60a12f-aa39-4a04-a32a-da0b8eb205bd tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:46.518044 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9a60a12f-aa39-4a04-a32a-da0b8eb205bd tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:46.596727 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-ca4738e8-a760-484a-8a92-102b601723b9 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30fe0e1ffa1040ec85d3c32d8b741c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd0e7c24154409824f96e9e99da357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:46.608377 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-ca4738e8-a760-484a-8a92-102b601723b9 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "GET /compute/v2.1/servers/8073b441-2650-4a77-9e97-9971a3f68282" status: 200 len: 1308 microversion: 2.1 time: 0.661623 Oct 08 21:10:46.610081 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2252/4447] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:10:45 2022] GET /compute/v2.1/servers/8073b441-2650-4a77-9e97-9971a3f68282 => generated 1308 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:10:46.633257 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-1c98b8b6-0746-41eb-90d6-f96434ed6266 req-94e63ba6-1f8b-45d1-9593-075cc66accb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21", "name": "network-vif-deleted", "tag": "66996fef-fc80-47b0-aada-eadf2921916d"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:10:46.653132 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-1c98b8b6-0746-41eb-90d6-f96434ed6266 req-94e63ba6-1f8b-45d1-9593-075cc66accb3 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:46.654130 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-1c98b8b6-0746-41eb-90d6-f96434ed6266 req-94e63ba6-1f8b-45d1-9593-075cc66accb3 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:46.654949 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-1c98b8b6-0746-41eb-90d6-f96434ed6266 req-94e63ba6-1f8b-45d1-9593-075cc66accb3 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:46.690522 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-1c98b8b6-0746-41eb-90d6-f96434ed6266 req-94e63ba6-1f8b-45d1-9593-075cc66accb3 service nova] Creating event network-vif-deleted:66996fef-fc80-47b0-aada-eadf2921916d for instance 4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21 on nch1-master-1 Oct 08 21:10:46.697414 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-1c98b8b6-0746-41eb-90d6-f96434ed6266 req-94e63ba6-1f8b-45d1-9593-075cc66accb3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085037 Oct 08 21:10:46.698402 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2253/4448] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:10:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:10:46.705532 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-70b6bd65-cb48-4d77-abca-5cb8e4c880ab tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:10:46.707457 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-70b6bd65-cb48-4d77-abca-5cb8e4c880ab tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] [instance: 4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:10:46.721451 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-70b6bd65-cb48-4d77-abca-5cb8e4c880ab tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:46.722201 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-70b6bd65-cb48-4d77-abca-5cb8e4c880ab tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:46.722673 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-70b6bd65-cb48-4d77-abca-5cb8e4c880ab tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:46.723417 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-70b6bd65-cb48-4d77-abca-5cb8e4c880ab tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:46.728675 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-70b6bd65-cb48-4d77-abca-5cb8e4c880ab tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:46.729099 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-70b6bd65-cb48-4d77-abca-5cb8e4c880ab tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:47.001628 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-9a60a12f-aa39-4a04-a32a-da0b8eb205bd tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:47.015479 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-9a60a12f-aa39-4a04-a32a-da0b8eb205bd tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 200 len: 1530 microversion: 2.1 time: 0.515609 Oct 08 21:10:47.016847 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2196/4449] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:10:46 2022] GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 1530 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:10:47.023897 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-b0140999-45ec-4039-91ac-e695d1884a75 req-1dda6599-419c-4f0a-85b6-65f2b05665c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21", "name": "network-vif-unplugged", "status": "completed", "tag": "5335fdc0-eb0a-483f-85b3-3278a5303d53"}, {"server_uuid": "4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21", "name": "network-vif-unplugged", "status": "completed", "tag": "35b26276-a306-4edc-9bc3-3ed3302b5672"}, {"server_uuid": "4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21", "name": "network-vif-unplugged", "status": "completed", "tag": "66996fef-fc80-47b0-aada-eadf2921916d"}, {"server_uuid": "4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21", "name": "network-vif-unplugged", "status": "completed", "tag": "394a1aae-3519-44f8-9e09-430c6dc79932"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:10:47.039768 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-b0140999-45ec-4039-91ac-e695d1884a75 req-1dda6599-419c-4f0a-85b6-65f2b05665c2 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:47.040256 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-b0140999-45ec-4039-91ac-e695d1884a75 req-1dda6599-419c-4f0a-85b6-65f2b05665c2 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:47.040693 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-b0140999-45ec-4039-91ac-e695d1884a75 req-1dda6599-419c-4f0a-85b6-65f2b05665c2 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:47.055443 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-b0140999-45ec-4039-91ac-e695d1884a75 req-1dda6599-419c-4f0a-85b6-65f2b05665c2 service nova] Creating event network-vif-unplugged:5335fdc0-eb0a-483f-85b3-3278a5303d53 for instance 4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21 on nch1-master-1 Oct 08 21:10:47.056245 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-b0140999-45ec-4039-91ac-e695d1884a75 req-1dda6599-419c-4f0a-85b6-65f2b05665c2 service nova] Creating event network-vif-unplugged:35b26276-a306-4edc-9bc3-3ed3302b5672 for instance 4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21 on nch1-master-1 Oct 08 21:10:47.056981 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-b0140999-45ec-4039-91ac-e695d1884a75 req-1dda6599-419c-4f0a-85b6-65f2b05665c2 service nova] Creating event network-vif-unplugged:66996fef-fc80-47b0-aada-eadf2921916d for instance 4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21 on nch1-master-1 Oct 08 21:10:47.057583 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-b0140999-45ec-4039-91ac-e695d1884a75 req-1dda6599-419c-4f0a-85b6-65f2b05665c2 service nova] Creating event network-vif-unplugged:394a1aae-3519-44f8-9e09-430c6dc79932 for instance 4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21 on nch1-master-1 Oct 08 21:10:47.063375 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-b0140999-45ec-4039-91ac-e695d1884a75 req-1dda6599-419c-4f0a-85b6-65f2b05665c2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 704 microversion: 2.1 time: 0.044102 Oct 08 21:10:47.064072 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2197/4450] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:10:47 2022] POST /compute/v2.1/os-server-external-events => generated 704 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:10:47.070433 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-8ed2adf8-3907-4efe-bfd1-ea500b36a9a3 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:10:47.071191 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-8ed2adf8-3907-4efe-bfd1-ea500b36a9a3 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: 82b72e20-b9e2-45ce-9362-b248f6d47bda] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:10:47.077599 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8ed2adf8-3907-4efe-bfd1-ea500b36a9a3 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:47.078173 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8ed2adf8-3907-4efe-bfd1-ea500b36a9a3 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:47.078730 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8ed2adf8-3907-4efe-bfd1-ea500b36a9a3 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:47.079492 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8ed2adf8-3907-4efe-bfd1-ea500b36a9a3 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:47.080054 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8ed2adf8-3907-4efe-bfd1-ea500b36a9a3 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:47.080547 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8ed2adf8-3907-4efe-bfd1-ea500b36a9a3 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:47.266577 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-70b6bd65-cb48-4d77-abca-5cb8e4c880ab tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc2bdd169daf4a1db830b1fa7f94f0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f2d56477794f8ab38b8e3535b3e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:47.277464 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-70b6bd65-cb48-4d77-abca-5cb8e4c880ab tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc2bdd169daf4a1db830b1fa7f94f0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f2d56477794f8ab38b8e3535b3e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:47.279177 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-70b6bd65-cb48-4d77-abca-5cb8e4c880ab tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc2bdd169daf4a1db830b1fa7f94f0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f2d56477794f8ab38b8e3535b3e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:47.281004 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-70b6bd65-cb48-4d77-abca-5cb8e4c880ab tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] 10.222.0.26 "GET /compute/v2.1/servers/4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21" status: 200 len: 2867 microversion: 2.32 time: 0.580365 Oct 08 21:10:47.294511 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2254/4451] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:10:46 2022] GET /compute/v2.1/servers/4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21 => generated 2867 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:10:47.454136 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-940b5c43-f805-42b9-9b26-7cfa2f24287d tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:10:47.454787 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-940b5c43-f805-42b9-9b26-7cfa2f24287d tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] [instance: 159e29dd-802c-4059-99f9-bb7c113d430b] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:10:47.467835 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:10:47.467937 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-940b5c43-f805-42b9-9b26-7cfa2f24287d tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:47.468427 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-940b5c43-f805-42b9-9b26-7cfa2f24287d tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:47.469561 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-940b5c43-f805-42b9-9b26-7cfa2f24287d tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:47.470683 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-940b5c43-f805-42b9-9b26-7cfa2f24287d tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:47.472512 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-940b5c43-f805-42b9-9b26-7cfa2f24287d tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:47.486511 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-940b5c43-f805-42b9-9b26-7cfa2f24287d tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:47.568167 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-8ed2adf8-3907-4efe-bfd1-ea500b36a9a3 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78e9afd772c4de981cac8f5817ec356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765c62cac2ee4406b23a5baa85c52ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:47.578496 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-8ed2adf8-3907-4efe-bfd1-ea500b36a9a3 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/82b72e20-b9e2-45ce-9362-b248f6d47bda" status: 200 len: 1314 microversion: 2.1 time: 0.513050 Oct 08 21:10:47.582527 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2198/4452] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:10:47 2022] GET /compute/v2.1/servers/82b72e20-b9e2-45ce-9362-b248f6d47bda => generated 1314 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:10:47.634511 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-e1951ac5-d45b-44dc-95f0-0f6c57b61731 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:10:47.635584 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-e1951ac5-d45b-44dc-95f0-0f6c57b61731 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] [instance: 8073b441-2650-4a77-9e97-9971a3f68282] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:10:47.645339 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e1951ac5-d45b-44dc-95f0-0f6c57b61731 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:47.646713 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e1951ac5-d45b-44dc-95f0-0f6c57b61731 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:47.648247 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e1951ac5-d45b-44dc-95f0-0f6c57b61731 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:47.649265 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e1951ac5-d45b-44dc-95f0-0f6c57b61731 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:47.650799 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e1951ac5-d45b-44dc-95f0-0f6c57b61731 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:47.651473 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e1951ac5-d45b-44dc-95f0-0f6c57b61731 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:47.724511 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=4 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:10:47.758162 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=12 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:10:47.852886 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-940b5c43-f805-42b9-9b26-7cfa2f24287d tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:47.867009 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-940b5c43-f805-42b9-9b26-7cfa2f24287d tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:47.868702 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-940b5c43-f805-42b9-9b26-7cfa2f24287d tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:47.869955 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-940b5c43-f805-42b9-9b26-7cfa2f24287d tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] 10.222.0.26 "GET /compute/v2.1/servers/159e29dd-802c-4059-99f9-bb7c113d430b" status: 200 len: 1729 microversion: 2.20 time: 0.419872 Oct 08 21:10:47.880015 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2255/4453] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:10:47 2022] GET /compute/v2.1/servers/159e29dd-802c-4059-99f9-bb7c113d430b => generated 1729 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 08 21:10:47.974146 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-e1951ac5-d45b-44dc-95f0-0f6c57b61731 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30fe0e1ffa1040ec85d3c32d8b741c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd0e7c24154409824f96e9e99da357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:47.985012 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-e1951ac5-d45b-44dc-95f0-0f6c57b61731 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "GET /compute/v2.1/servers/8073b441-2650-4a77-9e97-9971a3f68282" status: 200 len: 1308 microversion: 2.1 time: 0.356218 Oct 08 21:10:47.985651 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2199/4454] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:10:47 2022] GET /compute/v2.1/servers/8073b441-2650-4a77-9e97-9971a3f68282 => generated 1308 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:10:48.042815 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-c54d7233-ab5c-4f0d-ad7a-e8aca85ff8cc tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:10:48.043511 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-c54d7233-ab5c-4f0d-ad7a-e8aca85ff8cc tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:10:48.053055 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c54d7233-ab5c-4f0d-ad7a-e8aca85ff8cc tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:48.053920 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c54d7233-ab5c-4f0d-ad7a-e8aca85ff8cc tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:48.054749 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c54d7233-ab5c-4f0d-ad7a-e8aca85ff8cc tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:48.055591 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c54d7233-ab5c-4f0d-ad7a-e8aca85ff8cc tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:48.058612 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c54d7233-ab5c-4f0d-ad7a-e8aca85ff8cc tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:48.060304 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c54d7233-ab5c-4f0d-ad7a-e8aca85ff8cc tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:48.312667 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-d80a0824-0e6e-4a99-83cc-b94385c9c6b8 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:10:48.313351 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-d80a0824-0e6e-4a99-83cc-b94385c9c6b8 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] [instance: 4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:10:48.327452 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d80a0824-0e6e-4a99-83cc-b94385c9c6b8 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:48.331714 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d80a0824-0e6e-4a99-83cc-b94385c9c6b8 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:48.332208 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d80a0824-0e6e-4a99-83cc-b94385c9c6b8 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:48.332977 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d80a0824-0e6e-4a99-83cc-b94385c9c6b8 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:48.337904 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d80a0824-0e6e-4a99-83cc-b94385c9c6b8 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:48.340789 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d80a0824-0e6e-4a99-83cc-b94385c9c6b8 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:48.381600 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-c54d7233-ab5c-4f0d-ad7a-e8aca85ff8cc tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:48.394662 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-c54d7233-ab5c-4f0d-ad7a-e8aca85ff8cc tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 200 len: 1530 microversion: 2.1 time: 0.358557 Oct 08 21:10:48.396912 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2256/4455] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:10:48 2022] GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 1530 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:10:48.608573 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-c374799f-30b9-4d6d-a0b3-658117dbb7f4 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:10:48.611530 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-c374799f-30b9-4d6d-a0b3-658117dbb7f4 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: 82b72e20-b9e2-45ce-9362-b248f6d47bda] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:10:48.633510 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c374799f-30b9-4d6d-a0b3-658117dbb7f4 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:48.634193 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c374799f-30b9-4d6d-a0b3-658117dbb7f4 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:48.638536 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c374799f-30b9-4d6d-a0b3-658117dbb7f4 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:48.639326 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c374799f-30b9-4d6d-a0b3-658117dbb7f4 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:48.640022 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c374799f-30b9-4d6d-a0b3-658117dbb7f4 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:48.640292 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c374799f-30b9-4d6d-a0b3-658117dbb7f4 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:48.801417 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-d80a0824-0e6e-4a99-83cc-b94385c9c6b8 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc2bdd169daf4a1db830b1fa7f94f0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f2d56477794f8ab38b8e3535b3e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:48.818964 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-d80a0824-0e6e-4a99-83cc-b94385c9c6b8 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc2bdd169daf4a1db830b1fa7f94f0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f2d56477794f8ab38b8e3535b3e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:48.821362 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-d80a0824-0e6e-4a99-83cc-b94385c9c6b8 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc2bdd169daf4a1db830b1fa7f94f0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f2d56477794f8ab38b8e3535b3e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:48.822698 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-d80a0824-0e6e-4a99-83cc-b94385c9c6b8 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] 10.222.0.26 "GET /compute/v2.1/servers/4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21" status: 200 len: 2706 microversion: 2.32 time: 0.516164 Oct 08 21:10:48.823294 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2200/4456] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:10:48 2022] GET /compute/v2.1/servers/4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21 => generated 2706 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:10:48.845844 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-9dbe4f95-e07a-49ee-a596-46847965753e req-710100a5-6bb0-41cd-8baf-ca6da1707645 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21", "name": "network-vif-deleted", "tag": "5335fdc0-eb0a-483f-85b3-3278a5303d53"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:10:48.874727 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-9dbe4f95-e07a-49ee-a596-46847965753e req-710100a5-6bb0-41cd-8baf-ca6da1707645 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:48.875622 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-9dbe4f95-e07a-49ee-a596-46847965753e req-710100a5-6bb0-41cd-8baf-ca6da1707645 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:48.876465 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-9dbe4f95-e07a-49ee-a596-46847965753e req-710100a5-6bb0-41cd-8baf-ca6da1707645 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:48.915031 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-9dbe4f95-e07a-49ee-a596-46847965753e req-710100a5-6bb0-41cd-8baf-ca6da1707645 service nova] Creating event network-vif-deleted:5335fdc0-eb0a-483f-85b3-3278a5303d53 for instance 4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21 on nch1-master-1 Oct 08 21:10:48.921934 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-9dbe4f95-e07a-49ee-a596-46847965753e req-710100a5-6bb0-41cd-8baf-ca6da1707645 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092291 Oct 08 21:10:48.927427 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2201/4457] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:10:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:10:48.994837 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-4daab28d-0e85-49e6-a1de-edfc172df824 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:10:49.000114 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-4daab28d-0e85-49e6-a1de-edfc172df824 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] [instance: 159e29dd-802c-4059-99f9-bb7c113d430b] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:10:49.026826 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4daab28d-0e85-49e6-a1de-edfc172df824 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:49.027938 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4daab28d-0e85-49e6-a1de-edfc172df824 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:49.029749 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4daab28d-0e85-49e6-a1de-edfc172df824 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:49.030800 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4daab28d-0e85-49e6-a1de-edfc172df824 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:49.031497 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4daab28d-0e85-49e6-a1de-edfc172df824 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:49.032184 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4daab28d-0e85-49e6-a1de-edfc172df824 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:49.451151 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-c374799f-30b9-4d6d-a0b3-658117dbb7f4 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78e9afd772c4de981cac8f5817ec356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765c62cac2ee4406b23a5baa85c52ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:49.485415 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-c374799f-30b9-4d6d-a0b3-658117dbb7f4 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/82b72e20-b9e2-45ce-9362-b248f6d47bda" status: 200 len: 1314 microversion: 2.1 time: 0.882953 Oct 08 21:10:49.488606 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2257/4458] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:10:48 2022] GET /compute/v2.1/servers/82b72e20-b9e2-45ce-9362-b248f6d47bda => generated 1314 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:10:49.504219 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-f9f0275d-3a1d-4bdd-a8df-6ffe7c160bd1 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:10:49.508079 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-f9f0275d-3a1d-4bdd-a8df-6ffe7c160bd1 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] [instance: 8073b441-2650-4a77-9e97-9971a3f68282] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:10:49.520400 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f9f0275d-3a1d-4bdd-a8df-6ffe7c160bd1 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:49.521292 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f9f0275d-3a1d-4bdd-a8df-6ffe7c160bd1 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:49.522069 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f9f0275d-3a1d-4bdd-a8df-6ffe7c160bd1 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:49.523186 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f9f0275d-3a1d-4bdd-a8df-6ffe7c160bd1 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:49.523824 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f9f0275d-3a1d-4bdd-a8df-6ffe7c160bd1 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:49.524423 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f9f0275d-3a1d-4bdd-a8df-6ffe7c160bd1 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:49.708064 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-4daab28d-0e85-49e6-a1de-edfc172df824 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:49.718197 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-4daab28d-0e85-49e6-a1de-edfc172df824 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:49.724329 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-4daab28d-0e85-49e6-a1de-edfc172df824 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:49.729620 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-4daab28d-0e85-49e6-a1de-edfc172df824 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] 10.222.0.26 "GET /compute/v2.1/servers/159e29dd-802c-4059-99f9-bb7c113d430b" status: 200 len: 1729 microversion: 2.20 time: 0.743019 Oct 08 21:10:49.733841 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2202/4459] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:10:48 2022] GET /compute/v2.1/servers/159e29dd-802c-4059-99f9-bb7c113d430b => generated 1729 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 08 21:10:49.749738 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-dfd59982-6076-4a55-9840-fac777bff5f3 req-d8262a14-c811-45dc-9577-f0f072643d5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "159e29dd-802c-4059-99f9-bb7c113d430b", "name": "network-vif-plugged", "status": "completed", "tag": "59479dc9-06cf-4a86-bedc-3998868989c8"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:10:49.771588 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-dfd59982-6076-4a55-9840-fac777bff5f3 req-d8262a14-c811-45dc-9577-f0f072643d5b service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:49.772082 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-dfd59982-6076-4a55-9840-fac777bff5f3 req-d8262a14-c811-45dc-9577-f0f072643d5b service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:49.773154 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-dfd59982-6076-4a55-9840-fac777bff5f3 req-d8262a14-c811-45dc-9577-f0f072643d5b service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:49.807974 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-dfd59982-6076-4a55-9840-fac777bff5f3 req-d8262a14-c811-45dc-9577-f0f072643d5b service nova] Creating event network-vif-plugged:59479dc9-06cf-4a86-bedc-3998868989c8 for instance 159e29dd-802c-4059-99f9-bb7c113d430b on nch2-master-1 Oct 08 21:10:49.814202 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-dfd59982-6076-4a55-9840-fac777bff5f3 req-d8262a14-c811-45dc-9577-f0f072643d5b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079095 Oct 08 21:10:49.814819 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2203/4460] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:10:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:10:49.837392 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-6888c22d-bda0-4233-8b5b-44965e90bf41 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:10:49.838285 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-6888c22d-bda0-4233-8b5b-44965e90bf41 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:10:49.878939 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6888c22d-bda0-4233-8b5b-44965e90bf41 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:49.879686 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6888c22d-bda0-4233-8b5b-44965e90bf41 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:49.880491 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6888c22d-bda0-4233-8b5b-44965e90bf41 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:49.881445 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6888c22d-bda0-4233-8b5b-44965e90bf41 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:49.882596 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6888c22d-bda0-4233-8b5b-44965e90bf41 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:49.885861 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6888c22d-bda0-4233-8b5b-44965e90bf41 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:49.973072 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-f9f0275d-3a1d-4bdd-a8df-6ffe7c160bd1 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30fe0e1ffa1040ec85d3c32d8b741c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd0e7c24154409824f96e9e99da357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:50.000001 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-f9f0275d-3a1d-4bdd-a8df-6ffe7c160bd1 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "GET /compute/v2.1/servers/8073b441-2650-4a77-9e97-9971a3f68282" status: 200 len: 1308 microversion: 2.1 time: 0.505084 Oct 08 21:10:50.000938 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2258/4461] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:10:49 2022] GET /compute/v2.1/servers/8073b441-2650-4a77-9e97-9971a3f68282 => generated 1308 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:10:50.027265 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-5b33d826-a270-4ba4-9b8d-d33527d997c2 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:10:50.028656 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-5b33d826-a270-4ba4-9b8d-d33527d997c2 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] [instance: 4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:10:50.049426 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5b33d826-a270-4ba4-9b8d-d33527d997c2 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:50.050796 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5b33d826-a270-4ba4-9b8d-d33527d997c2 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:50.051590 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5b33d826-a270-4ba4-9b8d-d33527d997c2 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:50.056577 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5b33d826-a270-4ba4-9b8d-d33527d997c2 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:50.057418 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5b33d826-a270-4ba4-9b8d-d33527d997c2 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:50.058095 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5b33d826-a270-4ba4-9b8d-d33527d997c2 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:50.658846 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-6888c22d-bda0-4233-8b5b-44965e90bf41 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:50.668146 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-6888c22d-bda0-4233-8b5b-44965e90bf41 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 200 len: 1525 microversion: 2.1 time: 0.852126 Oct 08 21:10:50.686712 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2204/4462] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:10:49 2022] GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 1525 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:10:50.700218 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-28431381-c831-415d-8cfc-8c4f0a86908a tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:10:50.701166 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-28431381-c831-415d-8cfc-8c4f0a86908a tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: 82b72e20-b9e2-45ce-9362-b248f6d47bda] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:10:50.718282 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-28431381-c831-415d-8cfc-8c4f0a86908a tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:50.719050 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-28431381-c831-415d-8cfc-8c4f0a86908a tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:50.719695 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-28431381-c831-415d-8cfc-8c4f0a86908a tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:50.720589 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-28431381-c831-415d-8cfc-8c4f0a86908a tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:50.721232 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-28431381-c831-415d-8cfc-8c4f0a86908a tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:50.721821 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-28431381-c831-415d-8cfc-8c4f0a86908a tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:51.093254 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-5b33d826-a270-4ba4-9b8d-d33527d997c2 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc2bdd169daf4a1db830b1fa7f94f0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f2d56477794f8ab38b8e3535b3e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:51.108031 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-5b33d826-a270-4ba4-9b8d-d33527d997c2 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc2bdd169daf4a1db830b1fa7f94f0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f2d56477794f8ab38b8e3535b3e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:51.113363 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-5b33d826-a270-4ba4-9b8d-d33527d997c2 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc2bdd169daf4a1db830b1fa7f94f0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f2d56477794f8ab38b8e3535b3e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:51.115156 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-5b33d826-a270-4ba4-9b8d-d33527d997c2 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] 10.222.0.26 "GET /compute/v2.1/servers/4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21" status: 200 len: 2593 microversion: 2.32 time: 1.103466 Oct 08 21:10:51.117257 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2259/4463] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:10:50 2022] GET /compute/v2.1/servers/4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21 => generated 2593 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:10:51.133932 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-f08aef38-af88-471a-89ad-47b110e68bf5 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:10:51.134627 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-f08aef38-af88-471a-89ad-47b110e68bf5 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] [instance: 159e29dd-802c-4059-99f9-bb7c113d430b] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:10:51.164600 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f08aef38-af88-471a-89ad-47b110e68bf5 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:51.165128 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f08aef38-af88-471a-89ad-47b110e68bf5 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:51.165637 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f08aef38-af88-471a-89ad-47b110e68bf5 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:51.166357 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f08aef38-af88-471a-89ad-47b110e68bf5 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:51.175459 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f08aef38-af88-471a-89ad-47b110e68bf5 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:51.178897 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f08aef38-af88-471a-89ad-47b110e68bf5 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:51.259083 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-28431381-c831-415d-8cfc-8c4f0a86908a tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78e9afd772c4de981cac8f5817ec356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765c62cac2ee4406b23a5baa85c52ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:51.277013 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-28431381-c831-415d-8cfc-8c4f0a86908a tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/82b72e20-b9e2-45ce-9362-b248f6d47bda" status: 200 len: 1314 microversion: 2.1 time: 0.578076 Oct 08 21:10:51.278208 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2205/4464] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:10:50 2022] GET /compute/v2.1/servers/82b72e20-b9e2-45ce-9362-b248f6d47bda => generated 1314 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:10:51.293476 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-26de3f42-dc75-41d8-add4-3b70f4c750d8 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:10:51.294465 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-26de3f42-dc75-41d8-add4-3b70f4c750d8 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] [instance: 8073b441-2650-4a77-9e97-9971a3f68282] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:10:51.305741 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-26de3f42-dc75-41d8-add4-3b70f4c750d8 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:51.314970 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-26de3f42-dc75-41d8-add4-3b70f4c750d8 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:51.318142 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-26de3f42-dc75-41d8-add4-3b70f4c750d8 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:51.319680 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-26de3f42-dc75-41d8-add4-3b70f4c750d8 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:51.321208 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-26de3f42-dc75-41d8-add4-3b70f4c750d8 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:51.322852 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-26de3f42-dc75-41d8-add4-3b70f4c750d8 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:51.764885 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-f08aef38-af88-471a-89ad-47b110e68bf5 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:51.779269 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-f08aef38-af88-471a-89ad-47b110e68bf5 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:51.783235 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-f08aef38-af88-471a-89ad-47b110e68bf5 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:51.788321 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-f08aef38-af88-471a-89ad-47b110e68bf5 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] 10.222.0.26 "GET /compute/v2.1/servers/159e29dd-802c-4059-99f9-bb7c113d430b" status: 200 len: 1729 microversion: 2.20 time: 0.666259 Oct 08 21:10:51.792788 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2260/4465] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:10:51 2022] GET /compute/v2.1/servers/159e29dd-802c-4059-99f9-bb7c113d430b => generated 1729 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:10:51.808186 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-98521877-af87-4f23-95d7-7d2085639d3e req-fde7e928-4f33-4bb1-b5a5-ee91e3680f5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21", "name": "network-vif-deleted", "tag": "394a1aae-3519-44f8-9e09-430c6dc79932"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:10:51.838719 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-98521877-af87-4f23-95d7-7d2085639d3e req-fde7e928-4f33-4bb1-b5a5-ee91e3680f5e service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:51.839258 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-98521877-af87-4f23-95d7-7d2085639d3e req-fde7e928-4f33-4bb1-b5a5-ee91e3680f5e service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:51.839912 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-98521877-af87-4f23-95d7-7d2085639d3e req-fde7e928-4f33-4bb1-b5a5-ee91e3680f5e service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:51.883333 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-98521877-af87-4f23-95d7-7d2085639d3e req-fde7e928-4f33-4bb1-b5a5-ee91e3680f5e service nova] Creating event network-vif-deleted:394a1aae-3519-44f8-9e09-430c6dc79932 for instance 4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21 on nch1-master-1 Oct 08 21:10:51.898726 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-98521877-af87-4f23-95d7-7d2085639d3e req-fde7e928-4f33-4bb1-b5a5-ee91e3680f5e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104304 Oct 08 21:10:51.903893 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2261/4466] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:10:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:10:51.915710 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-86184a15-388c-4bbb-b81e-6179ec451c26 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:10:51.918265 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-86184a15-388c-4bbb-b81e-6179ec451c26 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:10:51.933811 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-86184a15-388c-4bbb-b81e-6179ec451c26 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:51.934342 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-86184a15-388c-4bbb-b81e-6179ec451c26 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:51.938238 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-86184a15-388c-4bbb-b81e-6179ec451c26 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:51.940542 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-86184a15-388c-4bbb-b81e-6179ec451c26 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:51.941698 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-86184a15-388c-4bbb-b81e-6179ec451c26 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:51.942929 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-86184a15-388c-4bbb-b81e-6179ec451c26 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:51.980825 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-26de3f42-dc75-41d8-add4-3b70f4c750d8 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30fe0e1ffa1040ec85d3c32d8b741c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd0e7c24154409824f96e9e99da357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:51.984559 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=100 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:10:51.998383 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-26de3f42-dc75-41d8-add4-3b70f4c750d8 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "GET /compute/v2.1/servers/8073b441-2650-4a77-9e97-9971a3f68282" status: 200 len: 1308 microversion: 2.1 time: 0.718843 Oct 08 21:10:52.002145 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2206/4467] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:10:51 2022] GET /compute/v2.1/servers/8073b441-2650-4a77-9e97-9971a3f68282 => generated 1308 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:10:52.149825 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-bb3a3227-cdc1-4262-8ef7-eb42069d3d0f tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:10:52.150461 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-bb3a3227-cdc1-4262-8ef7-eb42069d3d0f tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] [instance: 4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:10:52.159039 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bb3a3227-cdc1-4262-8ef7-eb42069d3d0f tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:52.159486 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bb3a3227-cdc1-4262-8ef7-eb42069d3d0f tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:52.163682 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bb3a3227-cdc1-4262-8ef7-eb42069d3d0f tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:52.164651 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bb3a3227-cdc1-4262-8ef7-eb42069d3d0f tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:52.166650 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bb3a3227-cdc1-4262-8ef7-eb42069d3d0f tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:52.168192 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bb3a3227-cdc1-4262-8ef7-eb42069d3d0f tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:52.647586 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-86184a15-388c-4bbb-b81e-6179ec451c26 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:52.660287 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-86184a15-388c-4bbb-b81e-6179ec451c26 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 200 len: 1525 microversion: 2.1 time: 0.754969 Oct 08 21:10:52.662348 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2262/4468] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:10:51 2022] GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 1525 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:10:52.682332 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-c60f5f3d-ae97-4304-9928-705e52de81ad tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:10:52.683930 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-c60f5f3d-ae97-4304-9928-705e52de81ad tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: 82b72e20-b9e2-45ce-9362-b248f6d47bda] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:10:52.707177 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c60f5f3d-ae97-4304-9928-705e52de81ad tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:52.710438 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c60f5f3d-ae97-4304-9928-705e52de81ad tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:52.711078 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c60f5f3d-ae97-4304-9928-705e52de81ad tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:52.712892 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c60f5f3d-ae97-4304-9928-705e52de81ad tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:52.714539 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c60f5f3d-ae97-4304-9928-705e52de81ad tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:52.715399 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c60f5f3d-ae97-4304-9928-705e52de81ad tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:53.118707 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-c60f5f3d-ae97-4304-9928-705e52de81ad tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78e9afd772c4de981cac8f5817ec356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765c62cac2ee4406b23a5baa85c52ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:53.131287 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-c60f5f3d-ae97-4304-9928-705e52de81ad tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/82b72e20-b9e2-45ce-9362-b248f6d47bda" status: 200 len: 1314 microversion: 2.1 time: 0.464463 Oct 08 21:10:53.132953 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2263/4469] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:10:52 2022] GET /compute/v2.1/servers/82b72e20-b9e2-45ce-9362-b248f6d47bda => generated 1314 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:10:53.146118 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-69ffdb1b-5901-4be1-a0d7-9e9141f10f7e tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:10:53.148272 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-69ffdb1b-5901-4be1-a0d7-9e9141f10f7e tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] [instance: 159e29dd-802c-4059-99f9-bb7c113d430b] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:10:53.164402 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-69ffdb1b-5901-4be1-a0d7-9e9141f10f7e tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:53.167616 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-69ffdb1b-5901-4be1-a0d7-9e9141f10f7e tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:53.169693 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-69ffdb1b-5901-4be1-a0d7-9e9141f10f7e tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:53.171330 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-69ffdb1b-5901-4be1-a0d7-9e9141f10f7e tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:53.174107 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-69ffdb1b-5901-4be1-a0d7-9e9141f10f7e tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:53.176142 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-69ffdb1b-5901-4be1-a0d7-9e9141f10f7e tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:53.427223 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-bb3a3227-cdc1-4262-8ef7-eb42069d3d0f tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc2bdd169daf4a1db830b1fa7f94f0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f2d56477794f8ab38b8e3535b3e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:53.474848 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-bb3a3227-cdc1-4262-8ef7-eb42069d3d0f tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc2bdd169daf4a1db830b1fa7f94f0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f2d56477794f8ab38b8e3535b3e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:53.485544 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-bb3a3227-cdc1-4262-8ef7-eb42069d3d0f tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc2bdd169daf4a1db830b1fa7f94f0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f2d56477794f8ab38b8e3535b3e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:53.487127 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-bb3a3227-cdc1-4262-8ef7-eb42069d3d0f tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] 10.222.0.26 "GET /compute/v2.1/servers/4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21" status: 200 len: 2432 microversion: 2.32 time: 1.342022 Oct 08 21:10:53.496038 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2207/4470] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:10:52 2022] GET /compute/v2.1/servers/4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21 => generated 2432 bytes in 1351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 08 21:10:53.509341 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-e08aca68-bb42-4655-a7ea-9b4fff88a76b tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:10:53.517933 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-e08aca68-bb42-4655-a7ea-9b4fff88a76b tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] [instance: 8073b441-2650-4a77-9e97-9971a3f68282] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:10:53.544153 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e08aca68-bb42-4655-a7ea-9b4fff88a76b tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:53.549218 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e08aca68-bb42-4655-a7ea-9b4fff88a76b tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:53.567476 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e08aca68-bb42-4655-a7ea-9b4fff88a76b tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:53.574597 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e08aca68-bb42-4655-a7ea-9b4fff88a76b tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:53.579292 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e08aca68-bb42-4655-a7ea-9b4fff88a76b tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:53.585829 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e08aca68-bb42-4655-a7ea-9b4fff88a76b tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:53.733435 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-69ffdb1b-5901-4be1-a0d7-9e9141f10f7e tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:53.754475 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-69ffdb1b-5901-4be1-a0d7-9e9141f10f7e tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:53.758069 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-69ffdb1b-5901-4be1-a0d7-9e9141f10f7e tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:53.759581 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-69ffdb1b-5901-4be1-a0d7-9e9141f10f7e tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] 10.222.0.26 "GET /compute/v2.1/servers/159e29dd-802c-4059-99f9-bb7c113d430b" status: 200 len: 1729 microversion: 2.20 time: 0.624305 Oct 08 21:10:53.760748 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2264/4471] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:10:53 2022] GET /compute/v2.1/servers/159e29dd-802c-4059-99f9-bb7c113d430b => generated 1729 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:10:53.765818 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-4e84833e-1eec-4156-9a25-8ba51d537a54 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:10:53.766896 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-4e84833e-1eec-4156-9a25-8ba51d537a54 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:10:53.778313 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4e84833e-1eec-4156-9a25-8ba51d537a54 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:53.779108 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4e84833e-1eec-4156-9a25-8ba51d537a54 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:53.779772 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4e84833e-1eec-4156-9a25-8ba51d537a54 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:53.780924 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4e84833e-1eec-4156-9a25-8ba51d537a54 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:53.781708 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4e84833e-1eec-4156-9a25-8ba51d537a54 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:53.783733 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4e84833e-1eec-4156-9a25-8ba51d537a54 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:54.207345 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-4e84833e-1eec-4156-9a25-8ba51d537a54 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:54.230547 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-4e84833e-1eec-4156-9a25-8ba51d537a54 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 200 len: 1525 microversion: 2.1 time: 0.468429 Oct 08 21:10:54.233080 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2265/4472] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:10:53 2022] GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 1525 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:10:54.247064 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-65b9dc41-1ba1-4846-99b6-e42fd1fb2942 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:10:54.261514 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-65b9dc41-1ba1-4846-99b6-e42fd1fb2942 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: 82b72e20-b9e2-45ce-9362-b248f6d47bda] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:10:54.270934 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-65b9dc41-1ba1-4846-99b6-e42fd1fb2942 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:54.271801 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-65b9dc41-1ba1-4846-99b6-e42fd1fb2942 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:54.273593 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-65b9dc41-1ba1-4846-99b6-e42fd1fb2942 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:54.275260 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-65b9dc41-1ba1-4846-99b6-e42fd1fb2942 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:54.276212 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-65b9dc41-1ba1-4846-99b6-e42fd1fb2942 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:54.277574 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-65b9dc41-1ba1-4846-99b6-e42fd1fb2942 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:54.536199 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-65b9dc41-1ba1-4846-99b6-e42fd1fb2942 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78e9afd772c4de981cac8f5817ec356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765c62cac2ee4406b23a5baa85c52ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:54.547049 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-65b9dc41-1ba1-4846-99b6-e42fd1fb2942 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/82b72e20-b9e2-45ce-9362-b248f6d47bda" status: 200 len: 1314 microversion: 2.1 time: 0.308410 Oct 08 21:10:54.552137 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2266/4473] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:10:54 2022] GET /compute/v2.1/servers/82b72e20-b9e2-45ce-9362-b248f6d47bda => generated 1314 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:10:54.571089 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-633e368b-45b6-4fbc-90fa-fcc6c51b512d req-e0d6eac1-b33c-4532-b008-201ac127db62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82b72e20-b9e2-45ce-9362-b248f6d47bda", "name": "network-vif-plugged", "status": "completed", "tag": "5fd11ae9-08eb-4fb7-8f60-d383f7e46331"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:10:54.602625 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-633e368b-45b6-4fbc-90fa-fcc6c51b512d req-e0d6eac1-b33c-4532-b008-201ac127db62 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:54.603806 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-633e368b-45b6-4fbc-90fa-fcc6c51b512d req-e0d6eac1-b33c-4532-b008-201ac127db62 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:54.604258 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-633e368b-45b6-4fbc-90fa-fcc6c51b512d req-e0d6eac1-b33c-4532-b008-201ac127db62 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:54.614249 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-e08aca68-bb42-4655-a7ea-9b4fff88a76b tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30fe0e1ffa1040ec85d3c32d8b741c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd0e7c24154409824f96e9e99da357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:54.639794 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-e08aca68-bb42-4655-a7ea-9b4fff88a76b tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "GET /compute/v2.1/servers/8073b441-2650-4a77-9e97-9971a3f68282" status: 200 len: 1308 microversion: 2.1 time: 1.140562 Oct 08 21:10:54.658319 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2208/4474] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:10:53 2022] GET /compute/v2.1/servers/8073b441-2650-4a77-9e97-9971a3f68282 => generated 1308 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:10:54.658539 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-633e368b-45b6-4fbc-90fa-fcc6c51b512d req-e0d6eac1-b33c-4532-b008-201ac127db62 service nova] Creating event network-vif-plugged:5fd11ae9-08eb-4fb7-8f60-d383f7e46331 for instance 82b72e20-b9e2-45ce-9362-b248f6d47bda on nch2-master-1 Oct 08 21:10:54.663982 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-20f044ae-8ce7-452a-b33e-6cf0b183d959 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:10:54.666783 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-20f044ae-8ce7-452a-b33e-6cf0b183d959 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] [instance: 4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:10:54.673676 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-633e368b-45b6-4fbc-90fa-fcc6c51b512d req-e0d6eac1-b33c-4532-b008-201ac127db62 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119507 Oct 08 21:10:54.674466 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2267/4475] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:10:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:10:54.679784 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-20f044ae-8ce7-452a-b33e-6cf0b183d959 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:54.680952 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-20f044ae-8ce7-452a-b33e-6cf0b183d959 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:54.681619 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-20f044ae-8ce7-452a-b33e-6cf0b183d959 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:54.682540 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-20f044ae-8ce7-452a-b33e-6cf0b183d959 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:54.683174 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-20f044ae-8ce7-452a-b33e-6cf0b183d959 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:54.684383 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-20f044ae-8ce7-452a-b33e-6cf0b183d959 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:54.798719 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-7680a0df-e5fe-49df-b0bd-da3a55faa8f5 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:10:54.800095 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-7680a0df-e5fe-49df-b0bd-da3a55faa8f5 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] [instance: 159e29dd-802c-4059-99f9-bb7c113d430b] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:10:54.818803 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7680a0df-e5fe-49df-b0bd-da3a55faa8f5 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:54.819758 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7680a0df-e5fe-49df-b0bd-da3a55faa8f5 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:54.823989 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7680a0df-e5fe-49df-b0bd-da3a55faa8f5 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:54.824921 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7680a0df-e5fe-49df-b0bd-da3a55faa8f5 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:54.825307 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7680a0df-e5fe-49df-b0bd-da3a55faa8f5 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:54.825755 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7680a0df-e5fe-49df-b0bd-da3a55faa8f5 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:55.206625 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-7680a0df-e5fe-49df-b0bd-da3a55faa8f5 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:55.230035 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-7680a0df-e5fe-49df-b0bd-da3a55faa8f5 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:55.233829 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-7680a0df-e5fe-49df-b0bd-da3a55faa8f5 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:55.236246 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-7680a0df-e5fe-49df-b0bd-da3a55faa8f5 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] 10.222.0.26 "GET /compute/v2.1/servers/159e29dd-802c-4059-99f9-bb7c113d430b" status: 200 len: 1716 microversion: 2.20 time: 0.441887 Oct 08 21:10:55.237639 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2268/4476] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:10:54 2022] GET /compute/v2.1/servers/159e29dd-802c-4059-99f9-bb7c113d430b => generated 1716 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 08 21:10:55.263453 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-fc290afe-0481-468c-a55d-4e0ed598e464 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:10:55.264532 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-fc290afe-0481-468c-a55d-4e0ed598e464 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:10:55.277981 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fc290afe-0481-468c-a55d-4e0ed598e464 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:55.278633 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fc290afe-0481-468c-a55d-4e0ed598e464 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:55.279341 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fc290afe-0481-468c-a55d-4e0ed598e464 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:55.280760 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fc290afe-0481-468c-a55d-4e0ed598e464 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:55.281782 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fc290afe-0481-468c-a55d-4e0ed598e464 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:55.282788 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fc290afe-0481-468c-a55d-4e0ed598e464 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:55.312503 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=100 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:10:55.525745 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-fc290afe-0481-468c-a55d-4e0ed598e464 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:55.536177 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-fc290afe-0481-468c-a55d-4e0ed598e464 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 200 len: 1525 microversion: 2.1 time: 0.275832 Oct 08 21:10:55.539882 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2269/4477] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:10:55 2022] GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 1525 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:10:55.579378 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e2105615-2160-4a92-801f-227e495f2c7f tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:10:55.580009 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-e2105615-2160-4a92-801f-227e495f2c7f tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: 82b72e20-b9e2-45ce-9362-b248f6d47bda] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:10:55.588732 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e2105615-2160-4a92-801f-227e495f2c7f tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:55.593506 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e2105615-2160-4a92-801f-227e495f2c7f tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:55.594178 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e2105615-2160-4a92-801f-227e495f2c7f tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:55.594745 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e2105615-2160-4a92-801f-227e495f2c7f tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:55.595250 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e2105615-2160-4a92-801f-227e495f2c7f tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:55.595660 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e2105615-2160-4a92-801f-227e495f2c7f tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:55.675693 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-20f044ae-8ce7-452a-b33e-6cf0b183d959 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc2bdd169daf4a1db830b1fa7f94f0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f2d56477794f8ab38b8e3535b3e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:55.699098 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-20f044ae-8ce7-452a-b33e-6cf0b183d959 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc2bdd169daf4a1db830b1fa7f94f0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f2d56477794f8ab38b8e3535b3e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:55.705812 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-20f044ae-8ce7-452a-b33e-6cf0b183d959 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc2bdd169daf4a1db830b1fa7f94f0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f2d56477794f8ab38b8e3535b3e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:55.710584 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-20f044ae-8ce7-452a-b33e-6cf0b183d959 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] 10.222.0.26 "GET /compute/v2.1/servers/4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21" status: 200 len: 2385 microversion: 2.32 time: 1.055392 Oct 08 21:10:55.716162 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2209/4478] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:10:54 2022] GET /compute/v2.1/servers/4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21 => generated 2385 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:10:55.744793 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-29ca59fd-6e77-4de9-9303-e8ef85c76616 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:10:55.748186 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-29ca59fd-6e77-4de9-9303-e8ef85c76616 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] [instance: 8073b441-2650-4a77-9e97-9971a3f68282] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:10:55.767851 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-29ca59fd-6e77-4de9-9303-e8ef85c76616 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:55.771386 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-29ca59fd-6e77-4de9-9303-e8ef85c76616 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:55.772080 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-29ca59fd-6e77-4de9-9303-e8ef85c76616 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:55.775482 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-29ca59fd-6e77-4de9-9303-e8ef85c76616 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:55.776304 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-29ca59fd-6e77-4de9-9303-e8ef85c76616 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:55.778492 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-29ca59fd-6e77-4de9-9303-e8ef85c76616 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:56.013359 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-e2105615-2160-4a92-801f-227e495f2c7f tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78e9afd772c4de981cac8f5817ec356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765c62cac2ee4406b23a5baa85c52ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:56.023836 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-e2105615-2160-4a92-801f-227e495f2c7f tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/82b72e20-b9e2-45ce-9362-b248f6d47bda" status: 200 len: 1314 microversion: 2.1 time: 0.448545 Oct 08 21:10:56.027039 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2270/4479] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:10:55 2022] GET /compute/v2.1/servers/82b72e20-b9e2-45ce-9362-b248f6d47bda => generated 1314 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:10:56.090449 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-7e01ea35-bd04-452a-8c1e-9379c5e2b68f req-b17f047e-d69f-4fea-8b5a-05b40b23943d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21", "name": "network-vif-deleted", "tag": "35b26276-a306-4edc-9bc3-3ed3302b5672"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:10:56.108703 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-7e01ea35-bd04-452a-8c1e-9379c5e2b68f req-b17f047e-d69f-4fea-8b5a-05b40b23943d service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:56.109418 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-7e01ea35-bd04-452a-8c1e-9379c5e2b68f req-b17f047e-d69f-4fea-8b5a-05b40b23943d service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:56.112096 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-7e01ea35-bd04-452a-8c1e-9379c5e2b68f req-b17f047e-d69f-4fea-8b5a-05b40b23943d service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:56.143325 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-7e01ea35-bd04-452a-8c1e-9379c5e2b68f req-b17f047e-d69f-4fea-8b5a-05b40b23943d service nova] Creating event network-vif-deleted:35b26276-a306-4edc-9bc3-3ed3302b5672 for instance 4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21 on nch1-master-1 Oct 08 21:10:56.154553 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-7e01ea35-bd04-452a-8c1e-9379c5e2b68f req-b17f047e-d69f-4fea-8b5a-05b40b23943d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068185 Oct 08 21:10:56.159616 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2271/4480] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:10:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:10:56.509714 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-29ca59fd-6e77-4de9-9303-e8ef85c76616 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30fe0e1ffa1040ec85d3c32d8b741c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd0e7c24154409824f96e9e99da357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:56.525471 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-29ca59fd-6e77-4de9-9303-e8ef85c76616 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "GET /compute/v2.1/servers/8073b441-2650-4a77-9e97-9971a3f68282" status: 200 len: 1308 microversion: 2.1 time: 0.807787 Oct 08 21:10:56.526434 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2210/4481] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:10:55 2022] GET /compute/v2.1/servers/8073b441-2650-4a77-9e97-9971a3f68282 => generated 1308 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:10:56.572526 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-13303363-5e83-4c17-833c-b1539b3f7031 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:10:56.573286 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-13303363-5e83-4c17-833c-b1539b3f7031 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:10:56.584253 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-13303363-5e83-4c17-833c-b1539b3f7031 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:56.589490 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-13303363-5e83-4c17-833c-b1539b3f7031 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:56.590417 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-13303363-5e83-4c17-833c-b1539b3f7031 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:56.592087 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-13303363-5e83-4c17-833c-b1539b3f7031 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:56.593804 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-13303363-5e83-4c17-833c-b1539b3f7031 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:56.595169 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-13303363-5e83-4c17-833c-b1539b3f7031 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:56.835734 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-02513258-62e2-44f2-9291-7b1610f31481 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:10:56.836361 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-02513258-62e2-44f2-9291-7b1610f31481 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] [instance: 4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:10:56.848181 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-02513258-62e2-44f2-9291-7b1610f31481 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:56.855759 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-02513258-62e2-44f2-9291-7b1610f31481 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:56.859714 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-02513258-62e2-44f2-9291-7b1610f31481 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:56.863436 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-02513258-62e2-44f2-9291-7b1610f31481 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:56.868122 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-02513258-62e2-44f2-9291-7b1610f31481 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:56.870110 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-02513258-62e2-44f2-9291-7b1610f31481 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:57.025996 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-13303363-5e83-4c17-833c-b1539b3f7031 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:57.041935 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-13303363-5e83-4c17-833c-b1539b3f7031 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 200 len: 1525 microversion: 2.1 time: 0.473322 Oct 08 21:10:57.045973 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2272/4482] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:10:56 2022] GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 1525 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:10:57.064628 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-17e6f809-3a4e-4a10-b1b6-bf3ee3c09029 req-09e2a10e-813e-444c-9074-28d87b7aa66a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2548207-aa57-4e4c-876b-2027b59283d2", "name": "network-vif-plugged", "status": "completed", "tag": "1900770b-2820-49c0-af24-1c780eb5f1e0"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:10:57.105321 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-17e6f809-3a4e-4a10-b1b6-bf3ee3c09029 req-09e2a10e-813e-444c-9074-28d87b7aa66a service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:57.110548 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-17e6f809-3a4e-4a10-b1b6-bf3ee3c09029 req-09e2a10e-813e-444c-9074-28d87b7aa66a service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:57.117171 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-17e6f809-3a4e-4a10-b1b6-bf3ee3c09029 req-09e2a10e-813e-444c-9074-28d87b7aa66a service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:57.160471 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-17e6f809-3a4e-4a10-b1b6-bf3ee3c09029 req-09e2a10e-813e-444c-9074-28d87b7aa66a service nova] Creating event network-vif-plugged:1900770b-2820-49c0-af24-1c780eb5f1e0 for instance e2548207-aa57-4e4c-876b-2027b59283d2 on nch2-master-1 Oct 08 21:10:57.181963 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-17e6f809-3a4e-4a10-b1b6-bf3ee3c09029 req-09e2a10e-813e-444c-9074-28d87b7aa66a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134450 Oct 08 21:10:57.192078 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2273/4483] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:10:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:10:57.211962 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-47f209f7-9972-40bc-85aa-f7fc4a9cb6b1 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:10:57.213048 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-47f209f7-9972-40bc-85aa-f7fc4a9cb6b1 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: 82b72e20-b9e2-45ce-9362-b248f6d47bda] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:10:57.238775 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-47f209f7-9972-40bc-85aa-f7fc4a9cb6b1 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:57.239373 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-47f209f7-9972-40bc-85aa-f7fc4a9cb6b1 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:57.241544 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-47f209f7-9972-40bc-85aa-f7fc4a9cb6b1 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:57.244572 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-47f209f7-9972-40bc-85aa-f7fc4a9cb6b1 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:57.247268 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-47f209f7-9972-40bc-85aa-f7fc4a9cb6b1 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:57.248645 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-47f209f7-9972-40bc-85aa-f7fc4a9cb6b1 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:57.344278 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-02513258-62e2-44f2-9291-7b1610f31481 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc2bdd169daf4a1db830b1fa7f94f0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f2d56477794f8ab38b8e3535b3e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:57.367968 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-02513258-62e2-44f2-9291-7b1610f31481 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc2bdd169daf4a1db830b1fa7f94f0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f2d56477794f8ab38b8e3535b3e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:57.375489 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-02513258-62e2-44f2-9291-7b1610f31481 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc2bdd169daf4a1db830b1fa7f94f0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f2d56477794f8ab38b8e3535b3e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:57.383395 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-02513258-62e2-44f2-9291-7b1610f31481 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] 10.222.0.26 "GET /compute/v2.1/servers/4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21" status: 200 len: 2098 microversion: 2.32 time: 0.548520 Oct 08 21:10:57.386791 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2211/4484] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:10:56 2022] GET /compute/v2.1/servers/4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21 => generated 2098 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:10:57.630382 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-47f209f7-9972-40bc-85aa-f7fc4a9cb6b1 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78e9afd772c4de981cac8f5817ec356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765c62cac2ee4406b23a5baa85c52ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:57.640504 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-47f209f7-9972-40bc-85aa-f7fc4a9cb6b1 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/82b72e20-b9e2-45ce-9362-b248f6d47bda" status: 200 len: 1500 microversion: 2.1 time: 0.446857 Oct 08 21:10:57.646397 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2274/4485] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:10:57 2022] GET /compute/v2.1/servers/82b72e20-b9e2-45ce-9362-b248f6d47bda => generated 1500 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:10:57.661502 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-924e116d-249a-471e-9810-a72cd3eb5aef tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:10:57.664219 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-924e116d-249a-471e-9810-a72cd3eb5aef tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] [instance: 8073b441-2650-4a77-9e97-9971a3f68282] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:10:57.698688 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-924e116d-249a-471e-9810-a72cd3eb5aef tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:57.699584 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-924e116d-249a-471e-9810-a72cd3eb5aef tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:57.700370 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-924e116d-249a-471e-9810-a72cd3eb5aef tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:57.708453 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-924e116d-249a-471e-9810-a72cd3eb5aef tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:57.709486 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-924e116d-249a-471e-9810-a72cd3eb5aef tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:57.711866 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-924e116d-249a-471e-9810-a72cd3eb5aef tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:58.122089 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-924e116d-249a-471e-9810-a72cd3eb5aef tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30fe0e1ffa1040ec85d3c32d8b741c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd0e7c24154409824f96e9e99da357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:58.133800 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-924e116d-249a-471e-9810-a72cd3eb5aef tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "GET /compute/v2.1/servers/8073b441-2650-4a77-9e97-9971a3f68282" status: 200 len: 1308 microversion: 2.1 time: 0.481444 Oct 08 21:10:58.136990 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2275/4486] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:10:57 2022] GET /compute/v2.1/servers/8073b441-2650-4a77-9e97-9971a3f68282 => generated 1308 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:10:58.148189 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-8fd15198-c6c9-463f-9d7c-f9b86f4d4e25 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:10:58.167584 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8fd15198-c6c9-463f-9d7c-f9b86f4d4e25 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:58.168358 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8fd15198-c6c9-463f-9d7c-f9b86f4d4e25 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:58.170528 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8fd15198-c6c9-463f-9d7c-f9b86f4d4e25 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:58.224895 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c3fe3d42-6649-41bc-aa81-06bdca2b7b46 tempest-VolumesSnapshotsTestJSON-1481697256 tempest-VolumesSnapshotsTestJSON-1481697256-project] Action: 'create', calling method: .version_select at 0x7f1a876cc040>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-202033031"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:10:58.228658 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-8fd15198-c6c9-463f-9d7c-f9b86f4d4e25 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: 82b72e20-b9e2-45ce-9362-b248f6d47bda] Going to try to stop instance {{(pid=140492) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 08 21:10:58.344900 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-8fd15198-c6c9-463f-9d7c-f9b86f4d4e25 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "POST /compute/v2.1/servers/82b72e20-b9e2-45ce-9362-b248f6d47bda/action" status: 202 len: 0 microversion: 2.1 time: 0.192929 Oct 08 21:10:58.349999 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2276/4487] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:10:58 2022] POST /compute/v2.1/servers/82b72e20-b9e2-45ce-9362-b248f6d47bda/action => generated 0 bytes in 209 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 21:10:58.364806 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-cf6e19ca-e7a9-41d5-9120-b0ebc9306e36 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:10:58.366919 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-cf6e19ca-e7a9-41d5-9120-b0ebc9306e36 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:10:58.406680 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cf6e19ca-e7a9-41d5-9120-b0ebc9306e36 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:58.407555 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cf6e19ca-e7a9-41d5-9120-b0ebc9306e36 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:58.412148 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cf6e19ca-e7a9-41d5-9120-b0ebc9306e36 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:58.413180 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cf6e19ca-e7a9-41d5-9120-b0ebc9306e36 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:58.415141 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cf6e19ca-e7a9-41d5-9120-b0ebc9306e36 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:58.417054 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cf6e19ca-e7a9-41d5-9120-b0ebc9306e36 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:58.832619 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-cf6e19ca-e7a9-41d5-9120-b0ebc9306e36 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:58.842578 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-cf6e19ca-e7a9-41d5-9120-b0ebc9306e36 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 200 len: 1525 microversion: 2.1 time: 0.494593 Oct 08 21:10:58.854530 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2277/4488] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:10:58 2022] GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 1525 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:10:58.868691 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-59173579-4a23-4a26-9697-f372e0ff04b7 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:10:58.870295 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-59173579-4a23-4a26-9697-f372e0ff04b7 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: 82b72e20-b9e2-45ce-9362-b248f6d47bda] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:10:58.879945 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-59173579-4a23-4a26-9697-f372e0ff04b7 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:58.881223 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-59173579-4a23-4a26-9697-f372e0ff04b7 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:58.882428 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-59173579-4a23-4a26-9697-f372e0ff04b7 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:58.883619 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-59173579-4a23-4a26-9697-f372e0ff04b7 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:58.884827 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-59173579-4a23-4a26-9697-f372e0ff04b7 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:58.885643 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-59173579-4a23-4a26-9697-f372e0ff04b7 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:59.128253 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-c3fe3d42-6649-41bc-aa81-06bdca2b7b46 tempest-VolumesSnapshotsTestJSON-1481697256 tempest-VolumesSnapshotsTestJSON-1481697256-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 200 len: 337 microversion: 2.1 time: 1.660625 Oct 08 21:10:59.128886 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2212/4489] 10.222.0.26 () {60 vars in 1155 bytes} [Sat Oct 8 21:10:57 2022] POST /compute/v2.1/os-volumes => generated 337 bytes in 1662 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Oct 08 21:10:59.139305 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-4dfac60e-b8ea-4c15-afc2-129f49d02cb4 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:10:59.140715 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-4dfac60e-b8ea-4c15-afc2-129f49d02cb4 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] [instance: 4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:10:59.163670 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4dfac60e-b8ea-4c15-afc2-129f49d02cb4 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:59.167701 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4dfac60e-b8ea-4c15-afc2-129f49d02cb4 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:59.168388 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4dfac60e-b8ea-4c15-afc2-129f49d02cb4 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:59.170099 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4dfac60e-b8ea-4c15-afc2-129f49d02cb4 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:59.171753 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4dfac60e-b8ea-4c15-afc2-129f49d02cb4 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:59.176217 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4dfac60e-b8ea-4c15-afc2-129f49d02cb4 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:59.265067 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4dfac60e-b8ea-4c15-afc2-129f49d02cb4 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:59.266489 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4dfac60e-b8ea-4c15-afc2-129f49d02cb4 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:59.267019 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4dfac60e-b8ea-4c15-afc2-129f49d02cb4 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:59.268645 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.objects.instance [None req-4dfac60e-b8ea-4c15-afc2-129f49d02cb4 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lazy-loading 'fault' on Instance uuid 4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21 {{(pid=140491) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 21:10:59.273435 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-59173579-4a23-4a26-9697-f372e0ff04b7 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78e9afd772c4de981cac8f5817ec356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765c62cac2ee4406b23a5baa85c52ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:59.304161 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-59173579-4a23-4a26-9697-f372e0ff04b7 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/82b72e20-b9e2-45ce-9362-b248f6d47bda" status: 200 len: 1510 microversion: 2.1 time: 0.447099 Oct 08 21:10:59.307157 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2278/4490] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:10:58 2022] GET /compute/v2.1/servers/82b72e20-b9e2-45ce-9362-b248f6d47bda => generated 1510 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:10:59.327283 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-93f0f8dc-9bc5-4831-9f94-0f923b828639 req-3099f477-5302-49ff-9be0-744573b8ce00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21", "name": "network-vif-deleted", "tag": "818a7d0e-582a-4f5d-902b-606c8c4608af"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:10:59.347253 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-4dfac60e-b8ea-4c15-afc2-129f49d02cb4 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc2bdd169daf4a1db830b1fa7f94f0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f2d56477794f8ab38b8e3535b3e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:59.366689 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-4dfac60e-b8ea-4c15-afc2-129f49d02cb4 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc2bdd169daf4a1db830b1fa7f94f0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f2d56477794f8ab38b8e3535b3e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:59.368151 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-4dfac60e-b8ea-4c15-afc2-129f49d02cb4 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc2bdd169daf4a1db830b1fa7f94f0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f2d56477794f8ab38b8e3535b3e8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:10:59.369455 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-4dfac60e-b8ea-4c15-afc2-129f49d02cb4 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] 10.222.0.26 "GET /compute/v2.1/servers/4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21" status: 200 len: 1609 microversion: 2.32 time: 0.234257 Oct 08 21:10:59.372627 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-93f0f8dc-9bc5-4831-9f94-0f923b828639 req-3099f477-5302-49ff-9be0-744573b8ce00 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:59.373628 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-93f0f8dc-9bc5-4831-9f94-0f923b828639 req-3099f477-5302-49ff-9be0-744573b8ce00 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:59.374301 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-93f0f8dc-9bc5-4831-9f94-0f923b828639 req-3099f477-5302-49ff-9be0-744573b8ce00 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:59.382934 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2213/4491] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:10:59 2022] GET /compute/v2.1/servers/4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21 => generated 1609 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:10:59.395680 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-91c1cd43-b4e9-431f-814c-08e34347e068 tempest-VolumesSnapshotsTestJSON-1481697256 tempest-VolumesSnapshotsTestJSON-1481697256-project] Calling method '.version_select at 0x7f1a876f4700>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:10:59.412017 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-93f0f8dc-9bc5-4831-9f94-0f923b828639 req-3099f477-5302-49ff-9be0-744573b8ce00 service nova] Creating event network-vif-deleted:818a7d0e-582a-4f5d-902b-606c8c4608af for instance 4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21 on nch1-master-1 Oct 08 21:10:59.426183 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-93f0f8dc-9bc5-4831-9f94-0f923b828639 req-3099f477-5302-49ff-9be0-744573b8ce00 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116394 Oct 08 21:10:59.429627 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2279/4492] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:10:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:10:59.441163 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-a21b1457-9b4b-4f28-8b33-b87d604f4963 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:10:59.447873 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-a21b1457-9b4b-4f28-8b33-b87d604f4963 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] [instance: 8073b441-2650-4a77-9e97-9971a3f68282] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:10:59.489693 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a21b1457-9b4b-4f28-8b33-b87d604f4963 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:59.497998 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a21b1457-9b4b-4f28-8b33-b87d604f4963 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:59.498715 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a21b1457-9b4b-4f28-8b33-b87d604f4963 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:59.499595 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a21b1457-9b4b-4f28-8b33-b87d604f4963 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:59.500208 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a21b1457-9b4b-4f28-8b33-b87d604f4963 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:59.500757 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a21b1457-9b4b-4f28-8b33-b87d604f4963 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:59.588877 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-91c1cd43-b4e9-431f-814c-08e34347e068 tempest-VolumesSnapshotsTestJSON-1481697256 tempest-VolumesSnapshotsTestJSON-1481697256-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/e4d2f355-6afc-4651-bc07-038d2a3a157c" status: 200 len: 337 microversion: 2.1 time: 0.203179 Oct 08 21:10:59.589502 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2214/4493] 10.222.0.26 () {58 vars in 1245 bytes} [Sat Oct 8 21:10:59 2022] GET /compute/v2.1/os-volumes/e4d2f355-6afc-4651-bc07-038d2a3a157c => generated 337 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:10:59.594956 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-314b5ae7-01a3-4768-9bff-2f0773164c51 req-481c6b05-a597-4b6e-89b2-777512c3af3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8073b441-2650-4a77-9e97-9971a3f68282", "name": "network-vif-plugged", "status": "completed", "tag": "676c3848-0a48-4fe1-9081-833908787a16"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:10:59.632588 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-314b5ae7-01a3-4768-9bff-2f0773164c51 req-481c6b05-a597-4b6e-89b2-777512c3af3a service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:59.636009 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-314b5ae7-01a3-4768-9bff-2f0773164c51 req-481c6b05-a597-4b6e-89b2-777512c3af3a service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:59.636656 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-314b5ae7-01a3-4768-9bff-2f0773164c51 req-481c6b05-a597-4b6e-89b2-777512c3af3a service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:59.653611 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-314b5ae7-01a3-4768-9bff-2f0773164c51 req-481c6b05-a597-4b6e-89b2-777512c3af3a service nova] Creating event network-vif-plugged:676c3848-0a48-4fe1-9081-833908787a16 for instance 8073b441-2650-4a77-9e97-9971a3f68282 on nch1-master-1 Oct 08 21:10:59.660009 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-314b5ae7-01a3-4768-9bff-2f0773164c51 req-481c6b05-a597-4b6e-89b2-777512c3af3a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069340 Oct 08 21:10:59.663883 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2215/4494] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:10:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:10:59.871252 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c82c4f9d-204a-4355-ab17-68fc09487c77 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:10:59.873427 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-c82c4f9d-204a-4355-ab17-68fc09487c77 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:10:59.922719 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c82c4f9d-204a-4355-ab17-68fc09487c77 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:59.923216 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c82c4f9d-204a-4355-ab17-68fc09487c77 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:59.927057 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c82c4f9d-204a-4355-ab17-68fc09487c77 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:10:59.928012 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c82c4f9d-204a-4355-ab17-68fc09487c77 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:10:59.930341 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c82c4f9d-204a-4355-ab17-68fc09487c77 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:10:59.931798 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c82c4f9d-204a-4355-ab17-68fc09487c77 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:00.116983 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-a21b1457-9b4b-4f28-8b33-b87d604f4963 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30fe0e1ffa1040ec85d3c32d8b741c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd0e7c24154409824f96e9e99da357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:11:00.132633 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-a21b1457-9b4b-4f28-8b33-b87d604f4963 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "GET /compute/v2.1/servers/8073b441-2650-4a77-9e97-9971a3f68282" status: 200 len: 1308 microversion: 2.1 time: 0.700806 Oct 08 21:11:00.135917 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2280/4495] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:10:59 2022] GET /compute/v2.1/servers/8073b441-2650-4a77-9e97-9971a3f68282 => generated 1308 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:11:00.224183 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-c82c4f9d-204a-4355-ab17-68fc09487c77 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:11:00.234028 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-c82c4f9d-204a-4355-ab17-68fc09487c77 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 200 len: 1525 microversion: 2.1 time: 0.368230 Oct 08 21:11:00.235768 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2216/4496] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:10:59 2022] GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 1525 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:11:00.334164 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-32d56cec-c23b-427c-9441-08da56661a17 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:11:00.336130 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-32d56cec-c23b-427c-9441-08da56661a17 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: 82b72e20-b9e2-45ce-9362-b248f6d47bda] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:11:00.345249 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-32d56cec-c23b-427c-9441-08da56661a17 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:00.347165 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-32d56cec-c23b-427c-9441-08da56661a17 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:00.348301 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-32d56cec-c23b-427c-9441-08da56661a17 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:00.350216 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-32d56cec-c23b-427c-9441-08da56661a17 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:00.351430 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-32d56cec-c23b-427c-9441-08da56661a17 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:00.352080 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-32d56cec-c23b-427c-9441-08da56661a17 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:00.414715 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-3ad4b931-8f0c-4145-ba65-e0893d985bcc tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:11:00.416129 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-3ad4b931-8f0c-4145-ba65-e0893d985bcc tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] [instance: 4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:11:00.424802 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3ad4b931-8f0c-4145-ba65-e0893d985bcc tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:00.425727 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3ad4b931-8f0c-4145-ba65-e0893d985bcc tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:00.426325 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3ad4b931-8f0c-4145-ba65-e0893d985bcc tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:00.427203 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3ad4b931-8f0c-4145-ba65-e0893d985bcc tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:00.427815 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3ad4b931-8f0c-4145-ba65-e0893d985bcc tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:00.428475 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3ad4b931-8f0c-4145-ba65-e0893d985bcc tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:00.453134 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-3ad4b931-8f0c-4145-ba65-e0893d985bcc tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] HTTP exception thrown: Instance 4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21 could not be found. Oct 08 21:11:00.461587 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-3ad4b931-8f0c-4145-ba65-e0893d985bcc tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Request method failure captured: Oct 08 21:11:00.461587 ncdv-master-1 devstack@n-api.service[140491]: request: GET /compute/v2.1/servers/4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21 HTTP/1.1 Oct 08 21:11:00.461587 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:11:00.461587 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:11:00.461587 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:11:00.461587 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 21:11:00.461587 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:11:00.461587 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:11:00.461587 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:11:00.461587 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:11:00.461587 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeXs3uQktTLUU68l-aMFOnfcEjU01ko19gRFvNmYrg89zXQ1V4YEKxZJjlqyGh_cNGu78MH9EknZ76-4MVXnPhsf_6nvJ_Z7ApOy9zLG_T9_9z6ZcsaXJ3lBIZwdAGp5dF1MaYBcbspFTZA1qIwM6OZZhaC_4b83fo3SefEwtytK9Oo Oct 08 21:11:00.461587 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:11:00.461587 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:11:00.461587 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:11:00.461587 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:11:00.461587 ncdv-master-1 devstack@n-api.service[140491]: X-Openstack-Nova-Api-Version: 2.32 Oct 08 21:11:00.461587 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:11:00.461587 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:11:00.461587 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 22f2d56477794f8ab38b8e3535b3e8dc Oct 08 21:11:00.461587 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-TaggedBootDevicesTest-1568770669 Oct 08 21:11:00.461587 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:11:00.461587 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:11:00.461587 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/22f2d56477794f8ab38b8e3535b3e8dc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/22f2d56477794f8ab38b8e3535b3e8dc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_22f2d56477794f8ab38b8e3535b3e8dc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/22f2d56477794f8ab38b8e3535b3e8dc"}]}] Oct 08 21:11:00.461587 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-TaggedBootDevicesTest-1568770669 Oct 08 21:11:00.461587 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 22f2d56477794f8ab38b8e3535b3e8dc Oct 08 21:11:00.461587 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1568770669 Oct 08 21:11:00.461587 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-TaggedBootDevicesTest-1568770669-project Oct 08 21:11:00.461587 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:11:00.461587 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:11:00.461587 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: fc2bdd169daf4a1db830b1fa7f94f0b2 Oct 08 21:11:00.461587 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-TaggedBootDevicesTest-1568770669-project Oct 08 21:11:00.461587 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:11:00.461587 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance 4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21 could not be found. Oct 08 21:11:00.461587 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': '4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21'} Oct 08 21:11:00.461587 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:11:00.461587 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:11:00.461587 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:11:00.461587 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:11:00.461587 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:11:00.461587 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:11:00.461587 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:11:00.461587 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:11:00.461587 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:11:00.461587 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:11:00.461587 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21 could not be found. Oct 08 21:11:00.461587 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:11:00.461587 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:11:00.461587 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:11:00.461587 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:11:00.461587 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:11:00.461587 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:11:00.461587 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:11:00.461587 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:11:00.461587 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:11:00.461587 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:11:00.461587 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:11:00.461587 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:11:00.461587 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:11:00.461587 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:11:00.461587 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:11:00.461587 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:11:00.461587 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21 could not be found. Oct 08 21:11:00.461587 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:11:00.461587 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:11:00.466882 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:11:00.466882 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:11:00.466882 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:11:00.466882 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:11:00.466882 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:11:00.466882 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:11:00.466882 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21 could not be found. Oct 08 21:11:00.466882 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:11:00.468824 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-3ad4b931-8f0c-4145-ba65-e0893d985bcc tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Returning 404 to user: Instance 4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21 could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:11:00.470331 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-3ad4b931-8f0c-4145-ba65-e0893d985bcc tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] 10.222.0.26 "GET /compute/v2.1/servers/4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21" status: 404 len: 111 microversion: 2.32 time: 0.070019 Oct 08 21:11:00.476219 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2217/4497] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:11:00 2022] GET /compute/v2.1/servers/4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 08 21:11:00.513569 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-3ac8454e-23e2-4b9a-96a0-30581e05e45d tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Calling method '.version_select at 0x7f1a876cc310>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:11:00.572075 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-3ac8454e-23e2-4b9a-96a0-30581e05e45d tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-554567182" status: 204 len: 0 microversion: 2.32 time: 0.094440 Oct 08 21:11:00.577022 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2218/4498] 10.222.0.26 () {60 vars in 1259 bytes} [Sat Oct 8 21:11:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-554567182 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 08 21:11:00.580494 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-32d56cec-c23b-427c-9441-08da56661a17 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78e9afd772c4de981cac8f5817ec356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765c62cac2ee4406b23a5baa85c52ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:11:00.599466 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-32d56cec-c23b-427c-9441-08da56661a17 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/82b72e20-b9e2-45ce-9362-b248f6d47bda" status: 200 len: 1510 microversion: 2.1 time: 0.275423 Oct 08 21:11:00.606831 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-6a3d5798-29cd-4c74-9018-17dda651b06c tempest-VolumesSnapshotsTestJSON-1481697256 tempest-VolumesSnapshotsTestJSON-1481697256-project] Calling method '.version_select at 0x7f1a876fc550>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:11:00.618541 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2281/4499] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:11:00 2022] GET /compute/v2.1/servers/82b72e20-b9e2-45ce-9362-b248f6d47bda => generated 1510 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:11:00.678464 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-6a3d5798-29cd-4c74-9018-17dda651b06c tempest-VolumesSnapshotsTestJSON-1481697256 tempest-VolumesSnapshotsTestJSON-1481697256-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/e4d2f355-6afc-4651-bc07-038d2a3a157c" status: 200 len: 338 microversion: 2.1 time: 0.078955 Oct 08 21:11:00.679109 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2219/4500] 10.222.0.26 () {58 vars in 1245 bytes} [Sat Oct 8 21:11:00 2022] GET /compute/v2.1/os-volumes/e4d2f355-6afc-4651-bc07-038d2a3a157c => generated 338 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 08 21:11:00.695403 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-5ae3f4d8-db8b-497c-8201-8df429f8dbd1 tempest-VolumesSnapshotsTestJSON-1481697256 tempest-VolumesSnapshotsTestJSON-1481697256-project] Action: 'create', calling method: .version_select at 0x7f1a8c0969d0>, body: {"snapshot": {"volume_id": "e4d2f355-6afc-4651-bc07-038d2a3a157c", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-78468502"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:11:01.125490 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-5ae3f4d8-db8b-497c-8201-8df429f8dbd1 tempest-VolumesSnapshotsTestJSON-1481697256 tempest-VolumesSnapshotsTestJSON-1481697256-project] 10.222.0.26 "POST /compute/v2.1/os-snapshots" status: 200 len: 285 microversion: 2.1 time: 0.435913 Oct 08 21:11:01.126414 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2282/4501] 10.222.0.26 () {60 vars in 1162 bytes} [Sat Oct 8 21:11:00 2022] POST /compute/v2.1/os-snapshots => generated 285 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:11:01.141954 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-349c249c-585d-4945-bda8-bd34bfbc5aa3 tempest-VolumesSnapshotsTestJSON-1481697256 tempest-VolumesSnapshotsTestJSON-1481697256-project] Calling method '.version_select at 0x7f1a876f1790>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:11:01.165555 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-fc5d0bbf-8830-4ee2-ac9c-1c16252dc425 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:11:01.166895 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-fc5d0bbf-8830-4ee2-ac9c-1c16252dc425 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] [instance: 8073b441-2650-4a77-9e97-9971a3f68282] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:11:01.204160 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fc5d0bbf-8830-4ee2-ac9c-1c16252dc425 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:01.204703 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fc5d0bbf-8830-4ee2-ac9c-1c16252dc425 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:01.205178 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fc5d0bbf-8830-4ee2-ac9c-1c16252dc425 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:01.226861 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fc5d0bbf-8830-4ee2-ac9c-1c16252dc425 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:01.228789 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fc5d0bbf-8830-4ee2-ac9c-1c16252dc425 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:01.230533 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fc5d0bbf-8830-4ee2-ac9c-1c16252dc425 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:01.398663 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-349c249c-585d-4945-bda8-bd34bfbc5aa3 tempest-VolumesSnapshotsTestJSON-1481697256 tempest-VolumesSnapshotsTestJSON-1481697256-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/8a4a6545-b346-486f-a8c2-9b627f885d5b" status: 200 len: 285 microversion: 2.1 time: 0.263214 Oct 08 21:11:01.401325 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2220/4502] 10.222.0.26 () {58 vars in 1251 bytes} [Sat Oct 8 21:11:01 2022] GET /compute/v2.1/os-snapshots/8a4a6545-b346-486f-a8c2-9b627f885d5b => generated 285 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:11:01.408728 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-617b6d7a-7e07-4fbc-b170-f1f97750815a tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:11:01.409674 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-617b6d7a-7e07-4fbc-b170-f1f97750815a tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:11:01.420916 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-617b6d7a-7e07-4fbc-b170-f1f97750815a tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:01.423343 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-617b6d7a-7e07-4fbc-b170-f1f97750815a tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:01.424079 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-617b6d7a-7e07-4fbc-b170-f1f97750815a tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:01.424997 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-617b6d7a-7e07-4fbc-b170-f1f97750815a tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:01.425999 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-617b6d7a-7e07-4fbc-b170-f1f97750815a tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:01.427092 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-617b6d7a-7e07-4fbc-b170-f1f97750815a tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:01.595498 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-fc5d0bbf-8830-4ee2-ac9c-1c16252dc425 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30fe0e1ffa1040ec85d3c32d8b741c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd0e7c24154409824f96e9e99da357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:11:01.613840 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-fc5d0bbf-8830-4ee2-ac9c-1c16252dc425 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "GET /compute/v2.1/servers/8073b441-2650-4a77-9e97-9971a3f68282" status: 200 len: 1308 microversion: 2.1 time: 0.452938 Oct 08 21:11:01.622752 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2283/4503] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:11:01 2022] GET /compute/v2.1/servers/8073b441-2650-4a77-9e97-9971a3f68282 => generated 1308 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:11:01.628853 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-73811b06-2cc3-4931-89a6-277bd176031d tempest-VolumesSnapshotsTestJSON-1481697256 tempest-VolumesSnapshotsTestJSON-1481697256-project] Calling method '.version_select at 0x7f1a87718160>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:11:01.716138 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-73811b06-2cc3-4931-89a6-277bd176031d tempest-VolumesSnapshotsTestJSON-1481697256 tempest-VolumesSnapshotsTestJSON-1481697256-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots" status: 200 len: 288 microversion: 2.1 time: 0.091855 Oct 08 21:11:01.716982 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2284/4504] 10.222.0.26 () {58 vars in 1140 bytes} [Sat Oct 8 21:11:01 2022] GET /compute/v2.1/os-snapshots => generated 288 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:11:01.723031 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-2e3dec4c-196b-4ad1-9390-507e50b3f809 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:11:01.723930 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-2e3dec4c-196b-4ad1-9390-507e50b3f809 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: 82b72e20-b9e2-45ce-9362-b248f6d47bda] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:11:01.733599 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2e3dec4c-196b-4ad1-9390-507e50b3f809 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:01.734396 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2e3dec4c-196b-4ad1-9390-507e50b3f809 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:01.735018 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2e3dec4c-196b-4ad1-9390-507e50b3f809 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:01.735878 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2e3dec4c-196b-4ad1-9390-507e50b3f809 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:01.736506 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2e3dec4c-196b-4ad1-9390-507e50b3f809 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:01.737159 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2e3dec4c-196b-4ad1-9390-507e50b3f809 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:01.864581 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-617b6d7a-7e07-4fbc-b170-f1f97750815a tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:11:01.877709 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-617b6d7a-7e07-4fbc-b170-f1f97750815a tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 200 len: 1525 microversion: 2.1 time: 0.474189 Oct 08 21:11:01.879375 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2221/4505] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:11:01 2022] GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 1525 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:11:01.890614 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-52572747-563e-4c88-8970-9cef51fa28e3 tempest-VolumesSnapshotsTestJSON-1481697256 tempest-VolumesSnapshotsTestJSON-1481697256-project] Calling method '.version_select at 0x7f1a876fcdc0>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:11:01.952189 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-52572747-563e-4c88-8970-9cef51fa28e3 tempest-VolumesSnapshotsTestJSON-1481697256 tempest-VolumesSnapshotsTestJSON-1481697256-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/8a4a6545-b346-486f-a8c2-9b627f885d5b" status: 200 len: 285 microversion: 2.1 time: 0.068638 Oct 08 21:11:01.958716 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2222/4506] 10.222.0.26 () {58 vars in 1251 bytes} [Sat Oct 8 21:11:01 2022] GET /compute/v2.1/os-snapshots/8a4a6545-b346-486f-a8c2-9b627f885d5b => generated 285 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:11:01.997766 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-2e3dec4c-196b-4ad1-9390-507e50b3f809 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78e9afd772c4de981cac8f5817ec356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765c62cac2ee4406b23a5baa85c52ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:11:02.014111 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-2e3dec4c-196b-4ad1-9390-507e50b3f809 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/82b72e20-b9e2-45ce-9362-b248f6d47bda" status: 200 len: 1510 microversion: 2.1 time: 0.295502 Oct 08 21:11:02.042157 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2285/4507] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:11:01 2022] GET /compute/v2.1/servers/82b72e20-b9e2-45ce-9362-b248f6d47bda => generated 1510 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:11:02.642922 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-5d061d95-11bf-425d-8ea8-f107894a811f tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:11:02.644183 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-5d061d95-11bf-425d-8ea8-f107894a811f tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] [instance: 8073b441-2650-4a77-9e97-9971a3f68282] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:11:02.659933 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5d061d95-11bf-425d-8ea8-f107894a811f tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:02.666604 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5d061d95-11bf-425d-8ea8-f107894a811f tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:02.667275 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5d061d95-11bf-425d-8ea8-f107894a811f tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:02.668209 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5d061d95-11bf-425d-8ea8-f107894a811f tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:02.669173 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5d061d95-11bf-425d-8ea8-f107894a811f tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:02.669649 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5d061d95-11bf-425d-8ea8-f107894a811f tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:02.908277 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-f9a15d59-bacd-4c4a-a9aa-d3e667cbe378 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:11:02.909832 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-f9a15d59-bacd-4c4a-a9aa-d3e667cbe378 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:11:02.924695 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f9a15d59-bacd-4c4a-a9aa-d3e667cbe378 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:02.925802 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f9a15d59-bacd-4c4a-a9aa-d3e667cbe378 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:02.927890 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f9a15d59-bacd-4c4a-a9aa-d3e667cbe378 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:02.929808 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f9a15d59-bacd-4c4a-a9aa-d3e667cbe378 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:02.932134 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f9a15d59-bacd-4c4a-a9aa-d3e667cbe378 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:02.933638 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f9a15d59-bacd-4c4a-a9aa-d3e667cbe378 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:03.009316 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-5d061d95-11bf-425d-8ea8-f107894a811f tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30fe0e1ffa1040ec85d3c32d8b741c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd0e7c24154409824f96e9e99da357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:11:03.021371 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-5d061d95-11bf-425d-8ea8-f107894a811f tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "GET /compute/v2.1/servers/8073b441-2650-4a77-9e97-9971a3f68282" status: 200 len: 1488 microversion: 2.1 time: 0.382008 Oct 08 21:11:03.039729 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2223/4508] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:11:02 2022] GET /compute/v2.1/servers/8073b441-2650-4a77-9e97-9971a3f68282 => generated 1488 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:11:03.059043 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-dcc4fec4-899b-4a96-aeef-08519030eacc tempest-VolumesSnapshotsTestJSON-1481697256 tempest-VolumesSnapshotsTestJSON-1481697256-project] Calling method '.version_select at 0x7f1a914ce3a0>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:11:03.141143 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-dcc4fec4-899b-4a96-aeef-08519030eacc tempest-VolumesSnapshotsTestJSON-1481697256 tempest-VolumesSnapshotsTestJSON-1481697256-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/8a4a6545-b346-486f-a8c2-9b627f885d5b" status: 200 len: 286 microversion: 2.1 time: 0.093940 Oct 08 21:11:03.146221 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2224/4509] 10.222.0.26 () {58 vars in 1251 bytes} [Sat Oct 8 21:11:03 2022] GET /compute/v2.1/os-snapshots/8a4a6545-b346-486f-a8c2-9b627f885d5b => generated 286 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:11:03.154527 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c3e15ccf-a18d-4441-84d6-b4cbcd6a764c tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-308320773"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:11:03.164539 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-c3e15ccf-a18d-4441-84d6-b4cbcd6a764c tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] [instance: 8073b441-2650-4a77-9e97-9971a3f68282] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:11:03.196387 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c3e15ccf-a18d-4441-84d6-b4cbcd6a764c tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:03.199766 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c3e15ccf-a18d-4441-84d6-b4cbcd6a764c tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:03.200841 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c3e15ccf-a18d-4441-84d6-b4cbcd6a764c tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:03.204376 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c3e15ccf-a18d-4441-84d6-b4cbcd6a764c tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:03.204873 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c3e15ccf-a18d-4441-84d6-b4cbcd6a764c tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:03.205401 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c3e15ccf-a18d-4441-84d6-b4cbcd6a764c tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:03.544124 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-f9a15d59-bacd-4c4a-a9aa-d3e667cbe378 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:11:03.556738 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-f9a15d59-bacd-4c4a-a9aa-d3e667cbe378 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 200 len: 1525 microversion: 2.1 time: 0.652965 Oct 08 21:11:03.562280 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2286/4510] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:11:02 2022] GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 1525 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:11:03.576236 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-2e44466c-cca3-4e36-bd88-589d9a02f114 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:11:03.578602 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-2e44466c-cca3-4e36-bd88-589d9a02f114 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: 82b72e20-b9e2-45ce-9362-b248f6d47bda] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:11:03.592709 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2e44466c-cca3-4e36-bd88-589d9a02f114 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:03.593576 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2e44466c-cca3-4e36-bd88-589d9a02f114 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:03.595424 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2e44466c-cca3-4e36-bd88-589d9a02f114 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:03.596386 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2e44466c-cca3-4e36-bd88-589d9a02f114 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:03.597840 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2e44466c-cca3-4e36-bd88-589d9a02f114 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:03.598535 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2e44466c-cca3-4e36-bd88-589d9a02f114 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:03.700767 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-c3e15ccf-a18d-4441-84d6-b4cbcd6a764c tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "POST /compute/v2.1/servers/8073b441-2650-4a77-9e97-9971a3f68282/action" status: 202 len: 0 microversion: 2.1 time: 0.552072 Oct 08 21:11:03.707449 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2225/4511] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:11:03 2022] POST /compute/v2.1/servers/8073b441-2650-4a77-9e97-9971a3f68282/action => generated 0 bytes in 560 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 08 21:11:03.713877 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-accef256-1dbf-45aa-b678-333541688bb4 tempest-VolumesSnapshotsTestJSON-1481697256 tempest-VolumesSnapshotsTestJSON-1481697256-project] Calling method '.version_select at 0x7f1a876f10d0>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:11:03.849384 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-accef256-1dbf-45aa-b678-333541688bb4 tempest-VolumesSnapshotsTestJSON-1481697256 tempest-VolumesSnapshotsTestJSON-1481697256-project] 10.222.0.26 "DELETE /compute/v2.1/os-snapshots/8a4a6545-b346-486f-a8c2-9b627f885d5b" status: 202 len: 0 microversion: 2.1 time: 0.140349 Oct 08 21:11:03.850246 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2226/4512] 10.222.0.26 () {58 vars in 1254 bytes} [Sat Oct 8 21:11:03 2022] DELETE /compute/v2.1/os-snapshots/8a4a6545-b346-486f-a8c2-9b627f885d5b => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 21:11:03.855433 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-a7c9f62a-7ce8-4ed9-a205-70713d0252e6 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Calling method '.version_select at 0x7f1a876cc310>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:11:03.932160 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-2e44466c-cca3-4e36-bd88-589d9a02f114 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78e9afd772c4de981cac8f5817ec356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765c62cac2ee4406b23a5baa85c52ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:11:03.946775 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-a7c9f62a-7ce8-4ed9-a205-70713d0252e6 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "GET /compute/v2.1/images/be0ff98b-e818-49e6-ab17-1b9369c16404" status: 200 len: 1411 microversion: 2.1 time: 0.089068 Oct 08 21:11:03.947420 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2227/4513] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:11:03 2022] GET /compute/v2.1/images/be0ff98b-e818-49e6-ab17-1b9369c16404 => generated 1411 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:11:03.954744 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-2e44466c-cca3-4e36-bd88-589d9a02f114 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/82b72e20-b9e2-45ce-9362-b248f6d47bda" status: 200 len: 1510 microversion: 2.1 time: 0.390626 Oct 08 21:11:03.955337 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2287/4514] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:11:03 2022] GET /compute/v2.1/servers/82b72e20-b9e2-45ce-9362-b248f6d47bda => generated 1510 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:11:03.959081 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-180e780a-9fb2-4a18-bb92-2017b4b1e035 tempest-VolumesSnapshotsTestJSON-1481697256 tempest-VolumesSnapshotsTestJSON-1481697256-project] Calling method '.version_select at 0x7f1a87765af0>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:11:03.973692 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-d28849fa-1022-4173-805a-e12d15cdd572 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Calling method '.version_select at 0x7f1a87fd1ee0>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:11:04.024724 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-180e780a-9fb2-4a18-bb92-2017b4b1e035 tempest-VolumesSnapshotsTestJSON-1481697256 tempest-VolumesSnapshotsTestJSON-1481697256-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/8a4a6545-b346-486f-a8c2-9b627f885d5b" status: 200 len: 285 microversion: 2.1 time: 0.076230 Oct 08 21:11:04.025662 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2228/4515] 10.222.0.26 () {58 vars in 1251 bytes} [Sat Oct 8 21:11:03 2022] GET /compute/v2.1/os-snapshots/8a4a6545-b346-486f-a8c2-9b627f885d5b => generated 285 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:11:04.095884 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-d28849fa-1022-4173-805a-e12d15cdd572 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "GET /compute/v2.1/images/be0ff98b-e818-49e6-ab17-1b9369c16404" status: 200 len: 1411 microversion: 2.1 time: 0.127980 Oct 08 21:11:04.097306 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2288/4516] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:11:03 2022] GET /compute/v2.1/images/be0ff98b-e818-49e6-ab17-1b9369c16404 => generated 1411 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:11:04.113621 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-1461a96d-b7df-4814-87f4-9a7238ec4563 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Calling method '.version_select at 0x7f1a876dad30>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:11:04.380539 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-1461a96d-b7df-4814-87f4-9a7238ec4563 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "DELETE /compute/v2.1/images/be0ff98b-e818-49e6-ab17-1b9369c16404" status: 204 len: 0 microversion: 2.1 time: 0.271261 Oct 08 21:11:04.381136 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2229/4517] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:11:04 2022] DELETE /compute/v2.1/images/be0ff98b-e818-49e6-ab17-1b9369c16404 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 08 21:11:04.392334 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-ff0531b8-a290-4f25-864f-74fbd243db84 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Calling method '.version_select at 0x7f1a87e709d0>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:11:04.426614 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-ff0531b8-a290-4f25-864f-74fbd243db84 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] HTTP exception thrown: Image not found. Oct 08 21:11:04.430788 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-ff0531b8-a290-4f25-864f-74fbd243db84 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Request method failure captured: Oct 08 21:11:04.430788 ncdv-master-1 devstack@n-api.service[140492]: request: GET /compute/v2.1/images/be0ff98b-e818-49e6-ab17-1b9369c16404 HTTP/1.1 Oct 08 21:11:04.430788 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:11:04.430788 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:11:04.430788 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:11:04.430788 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 21:11:04.430788 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:11:04.430788 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:11:04.430788 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:11:04.430788 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:11:04.430788 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeaSKTe_Fou7Tynsshq4jmA96ac0QjSnZl8MRkWeLpbYWo7KTncUdf4zi0sVQcp1BUvWwa3324gOKsN8j-gh8b_nnvj8r1lMZwi8XCtH19IX2ZuTfA5HsF6Wv6gsXu8d2xT7eLqAE--DUlL114RxDAcH3m1wEtiDfwOrDWDUhiesqmw Oct 08 21:11:04.430788 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:11:04.430788 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:11:04.430788 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:11:04.430788 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:11:04.430788 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:11:04.430788 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:11:04.430788 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 6bcd0e7c24154409824f96e9e99da357 Oct 08 21:11:04.430788 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-ImagesTestJSON-278094929 Oct 08 21:11:04.430788 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:11:04.430788 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:11:04.430788 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6bcd0e7c24154409824f96e9e99da357"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6bcd0e7c24154409824f96e9e99da357"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6bcd0e7c24154409824f96e9e99da357"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6bcd0e7c24154409824f96e9e99da357"}]}] Oct 08 21:11:04.430788 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-ImagesTestJSON-278094929 Oct 08 21:11:04.430788 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 6bcd0e7c24154409824f96e9e99da357 Oct 08 21:11:04.430788 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-ImagesTestJSON-278094929 Oct 08 21:11:04.430788 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-ImagesTestJSON-278094929-project Oct 08 21:11:04.430788 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:11:04.430788 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:11:04.430788 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 30fe0e1ffa1040ec85d3c32d8b741c75 Oct 08 21:11:04.430788 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-ImagesTestJSON-278094929-project Oct 08 21:11:04.430788 ncdv-master-1 devstack@n-api.service[140492]: method: Oct 08 21:11:04.430788 ncdv-master-1 devstack@n-api.service[140492]: exception: Image not found. Oct 08 21:11:04.430788 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': 'be0ff98b-e818-49e6-ab17-1b9369c16404'} Oct 08 21:11:04.430788 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:11:04.430788 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:11:04.430788 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 08 21:11:04.430788 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 08 21:11:04.430788 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 08 21:11:04.430788 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 08 21:11:04.430788 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 08 21:11:04.430788 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 08 21:11:04.430788 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 08 21:11:04.430788 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 08 21:11:04.430788 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 08 21:11:04.430788 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 08 21:11:04.430788 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 08 21:11:04.430788 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 08 21:11:04.430788 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 08 21:11:04.430788 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 08 21:11:04.430788 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 08 21:11:04.430788 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 08 21:11:04.430788 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID be0ff98b-e818-49e6-ab17-1b9369c16404 Oct 08 21:11:04.430788 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:11:04.430788 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:11:04.430788 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:11:04.430788 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:11:04.430788 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 08 21:11:04.430788 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 08 21:11:04.430788 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 08 21:11:04.430788 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 08 21:11:04.430788 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 08 21:11:04.430788 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 08 21:11:04.430788 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 08 21:11:04.430788 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 08 21:11:04.435402 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 08 21:11:04.435402 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 08 21:11:04.435402 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 08 21:11:04.435402 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 08 21:11:04.435402 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 08 21:11:04.435402 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 08 21:11:04.435402 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 08 21:11:04.435402 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 08 21:11:04.435402 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 08 21:11:04.435402 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 08 21:11:04.435402 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 08 21:11:04.435402 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 08 21:11:04.435402 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 08 21:11:04.435402 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 08 21:11:04.435402 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 08 21:11:04.435402 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 08 21:11:04.435402 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image be0ff98b-e818-49e6-ab17-1b9369c16404 could not be found. Oct 08 21:11:04.435402 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:11:04.435402 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:11:04.435402 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:11:04.435402 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:11:04.435402 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:11:04.435402 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:11:04.435402 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:11:04.435402 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:11:04.435402 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 08 21:11:04.435402 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 08 21:11:04.435402 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:11:04.435402 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:11:04.435402 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 08 21:11:04.435402 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 08 21:11:04.435402 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 08 21:11:04.435402 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:11:04.435402 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:11:04.435402 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:11:04.435402 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:11:04.435402 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:11:04.435402 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:11:04.435402 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:11:04.435402 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:11:04.435402 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 08 21:11:04.435402 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:11:04.442709 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-ff0531b8-a290-4f25-864f-74fbd243db84 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Returning 404 to user: Image not found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:11:04.445838 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-ff0531b8-a290-4f25-864f-74fbd243db84 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "GET /compute/v2.1/images/be0ff98b-e818-49e6-ab17-1b9369c16404" status: 404 len: 62 microversion: 2.1 time: 0.058925 Oct 08 21:11:04.449104 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2289/4518] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:11:04 2022] GET /compute/v2.1/images/be0ff98b-e818-49e6-ab17-1b9369c16404 => generated 62 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 08 21:11:04.457839 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-947d1894-2ecc-4a98-9230-22a73514c8db tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:11:04.459621 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-947d1894-2ecc-4a98-9230-22a73514c8db tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] [instance: 8073b441-2650-4a77-9e97-9971a3f68282] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:11:04.477923 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-947d1894-2ecc-4a98-9230-22a73514c8db tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:04.478708 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-947d1894-2ecc-4a98-9230-22a73514c8db tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:04.481934 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-947d1894-2ecc-4a98-9230-22a73514c8db tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:04.483274 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-947d1894-2ecc-4a98-9230-22a73514c8db tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:04.488570 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-947d1894-2ecc-4a98-9230-22a73514c8db tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:04.490549 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-947d1894-2ecc-4a98-9230-22a73514c8db tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:04.584376 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-f3b0a279-7664-469f-b481-696dcacae207 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:11:04.585111 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-f3b0a279-7664-469f-b481-696dcacae207 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:11:04.599219 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f3b0a279-7664-469f-b481-696dcacae207 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:04.602977 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f3b0a279-7664-469f-b481-696dcacae207 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:04.604682 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f3b0a279-7664-469f-b481-696dcacae207 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:04.607269 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f3b0a279-7664-469f-b481-696dcacae207 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:04.608975 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f3b0a279-7664-469f-b481-696dcacae207 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:04.612016 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f3b0a279-7664-469f-b481-696dcacae207 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:04.776094 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-947d1894-2ecc-4a98-9230-22a73514c8db tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30fe0e1ffa1040ec85d3c32d8b741c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd0e7c24154409824f96e9e99da357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:11:04.787353 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-947d1894-2ecc-4a98-9230-22a73514c8db tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "GET /compute/v2.1/servers/8073b441-2650-4a77-9e97-9971a3f68282" status: 200 len: 1500 microversion: 2.1 time: 0.333525 Oct 08 21:11:04.811565 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2230/4519] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:11:04 2022] GET /compute/v2.1/servers/8073b441-2650-4a77-9e97-9971a3f68282 => generated 1500 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:11:04.839340 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-f3b0a279-7664-469f-b481-696dcacae207 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:11:04.843698 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:11:04.855042 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-f3b0a279-7664-469f-b481-696dcacae207 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 200 len: 1525 microversion: 2.1 time: 0.276541 Oct 08 21:11:04.860537 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2290/4520] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:11:04 2022] GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 1525 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:11:04.982858 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-b0d8c456-1701-48f8-9966-c18af0e7ef39 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:11:04.983447 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-b0d8c456-1701-48f8-9966-c18af0e7ef39 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: 82b72e20-b9e2-45ce-9362-b248f6d47bda] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:11:05.003186 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b0d8c456-1701-48f8-9966-c18af0e7ef39 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:05.005741 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b0d8c456-1701-48f8-9966-c18af0e7ef39 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:05.018410 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b0d8c456-1701-48f8-9966-c18af0e7ef39 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:05.020816 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b0d8c456-1701-48f8-9966-c18af0e7ef39 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:05.021652 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b0d8c456-1701-48f8-9966-c18af0e7ef39 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:05.023989 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b0d8c456-1701-48f8-9966-c18af0e7ef39 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:05.039398 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-6073c5c3-9bd7-4061-a114-3ad202ea4bb5 tempest-VolumesSnapshotsTestJSON-1481697256 tempest-VolumesSnapshotsTestJSON-1481697256-project] Calling method '.version_select at 0x7f1a87e70310>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:11:05.130341 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-6073c5c3-9bd7-4061-a114-3ad202ea4bb5 tempest-VolumesSnapshotsTestJSON-1481697256 tempest-VolumesSnapshotsTestJSON-1481697256-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/8a4a6545-b346-486f-a8c2-9b627f885d5b" status: 200 len: 285 microversion: 2.1 time: 0.095580 Oct 08 21:11:05.136055 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2291/4521] 10.222.0.26 () {58 vars in 1251 bytes} [Sat Oct 8 21:11:05 2022] GET /compute/v2.1/os-snapshots/8a4a6545-b346-486f-a8c2-9b627f885d5b => generated 285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:11:05.388618 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-b0d8c456-1701-48f8-9966-c18af0e7ef39 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78e9afd772c4de981cac8f5817ec356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765c62cac2ee4406b23a5baa85c52ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:11:05.399827 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-b0d8c456-1701-48f8-9966-c18af0e7ef39 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/82b72e20-b9e2-45ce-9362-b248f6d47bda" status: 200 len: 1510 microversion: 2.1 time: 0.424890 Oct 08 21:11:05.401572 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2231/4522] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:11:04 2022] GET /compute/v2.1/servers/82b72e20-b9e2-45ce-9362-b248f6d47bda => generated 1510 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:11:05.820822 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-f45a3bf3-805f-4801-bed6-219d2869e7db tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:11:05.821878 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-f45a3bf3-805f-4801-bed6-219d2869e7db tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] [instance: 8073b441-2650-4a77-9e97-9971a3f68282] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:11:05.838084 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f45a3bf3-805f-4801-bed6-219d2869e7db tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:05.838645 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f45a3bf3-805f-4801-bed6-219d2869e7db tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:05.839110 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f45a3bf3-805f-4801-bed6-219d2869e7db tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:05.839840 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f45a3bf3-805f-4801-bed6-219d2869e7db tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:05.841717 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f45a3bf3-805f-4801-bed6-219d2869e7db tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:05.844352 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f45a3bf3-805f-4801-bed6-219d2869e7db tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:05.883381 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-f02254ff-4c36-457e-a2f3-ef3156909055 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:11:05.884758 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-f02254ff-4c36-457e-a2f3-ef3156909055 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:11:05.908261 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f02254ff-4c36-457e-a2f3-ef3156909055 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:05.908870 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f02254ff-4c36-457e-a2f3-ef3156909055 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:05.909352 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f02254ff-4c36-457e-a2f3-ef3156909055 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:05.929584 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f02254ff-4c36-457e-a2f3-ef3156909055 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:05.930351 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f02254ff-4c36-457e-a2f3-ef3156909055 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:05.930984 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f02254ff-4c36-457e-a2f3-ef3156909055 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:06.274808 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-f45a3bf3-805f-4801-bed6-219d2869e7db tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30fe0e1ffa1040ec85d3c32d8b741c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd0e7c24154409824f96e9e99da357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:11:06.288638 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-f45a3bf3-805f-4801-bed6-219d2869e7db tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "GET /compute/v2.1/servers/8073b441-2650-4a77-9e97-9971a3f68282" status: 200 len: 1506 microversion: 2.1 time: 0.471326 Oct 08 21:11:06.298406 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2292/4523] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:11:05 2022] GET /compute/v2.1/servers/8073b441-2650-4a77-9e97-9971a3f68282 => generated 1506 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:11:06.310854 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e212d155-da85-475e-83eb-5c0c12a8e037 tempest-VolumesSnapshotsTestJSON-1481697256 tempest-VolumesSnapshotsTestJSON-1481697256-project] Calling method '.version_select at 0x7f1a8c062670>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:11:06.381993 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-e212d155-da85-475e-83eb-5c0c12a8e037 tempest-VolumesSnapshotsTestJSON-1481697256 tempest-VolumesSnapshotsTestJSON-1481697256-project] HTTP exception thrown: Snapshot 8a4a6545-b346-486f-a8c2-9b627f885d5b could not be found. Oct 08 21:11:06.401075 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e212d155-da85-475e-83eb-5c0c12a8e037 tempest-VolumesSnapshotsTestJSON-1481697256 tempest-VolumesSnapshotsTestJSON-1481697256-project] Request method failure captured: Oct 08 21:11:06.401075 ncdv-master-1 devstack@n-api.service[140492]: request: GET /compute/v2.1/os-snapshots/8a4a6545-b346-486f-a8c2-9b627f885d5b HTTP/1.1 Oct 08 21:11:06.401075 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:11:06.401075 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:11:06.401075 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:11:06.401075 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 21:11:06.401075 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:11:06.401075 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:11:06.401075 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:11:06.401075 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:11:06.401075 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQedhkn9CE8B2l1J8gtnM-2wOsq7HS1CVetOQE72GrRE2Nr6Zc6T6mXqmk9s8JWDmCjGfqqfSk31MV066kg0RBa8MECL-MO-MJYbVY8Qe2oe9MqD6ma1eYfTD9cBZbvIiPYIcpk186Ec2p5uTgd6DW5riHFhaNcl3I9Y8rgElP40C8Zg Oct 08 21:11:06.401075 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:11:06.401075 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:11:06.401075 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:11:06.401075 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:11:06.401075 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:11:06.401075 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:11:06.401075 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: c56b9280162d4a6b9bac0cc641147a24 Oct 08 21:11:06.401075 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1481697256 Oct 08 21:11:06.401075 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:11:06.401075 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:11:06.401075 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/c56b9280162d4a6b9bac0cc641147a24"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c56b9280162d4a6b9bac0cc641147a24"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_c56b9280162d4a6b9bac0cc641147a24"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c56b9280162d4a6b9bac0cc641147a24"}]}] Oct 08 21:11:06.401075 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1481697256 Oct 08 21:11:06.401075 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: c56b9280162d4a6b9bac0cc641147a24 Oct 08 21:11:06.401075 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1481697256 Oct 08 21:11:06.401075 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-VolumesSnapshotsTestJSON-1481697256-project Oct 08 21:11:06.401075 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:11:06.401075 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:11:06.401075 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 7b0248890c8c4da9a1c3d08bcd5742ad Oct 08 21:11:06.401075 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1481697256-project Oct 08 21:11:06.401075 ncdv-master-1 devstack@n-api.service[140492]: method: Oct 08 21:11:06.401075 ncdv-master-1 devstack@n-api.service[140492]: exception: Snapshot 8a4a6545-b346-486f-a8c2-9b627f885d5b could not be found. Oct 08 21:11:06.401075 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': '8a4a6545-b346-486f-a8c2-9b627f885d5b'} Oct 08 21:11:06.401075 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:11:06.401075 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:11:06.401075 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 08 21:11:06.401075 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 08 21:11:06.401075 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 08 21:11:06.401075 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 08 21:11:06.401075 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 08 21:11:06.401075 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 08 21:11:06.401075 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 08 21:11:06.401075 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 08 21:11:06.401075 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 08 21:11:06.401075 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 08 21:11:06.401075 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 08 21:11:06.401075 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 08 21:11:06.401075 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 08 21:11:06.401075 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 08 21:11:06.401075 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 8a4a6545-b346-486f-a8c2-9b627f885d5b could not be found. (HTTP 404) (Request-ID: req-ded64584-88d4-48af-b43b-0f6e81732ed1) Oct 08 21:11:06.401075 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:11:06.401075 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:11:06.401075 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:11:06.401075 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:11:06.401075 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Oct 08 21:11:06.401075 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Oct 08 21:11:06.401075 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 08 21:11:06.401075 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 08 21:11:06.401075 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Oct 08 21:11:06.401075 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Oct 08 21:11:06.401075 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 08 21:11:06.401075 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 08 21:11:06.406898 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 08 21:11:06.406898 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 08 21:11:06.406898 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 08 21:11:06.406898 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 08 21:11:06.406898 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 08 21:11:06.406898 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 08 21:11:06.406898 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 08 21:11:06.406898 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 08 21:11:06.406898 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 08 21:11:06.406898 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 08 21:11:06.406898 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 08 21:11:06.406898 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 08 21:11:06.406898 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 08 21:11:06.406898 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 08 21:11:06.406898 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 8a4a6545-b346-486f-a8c2-9b627f885d5b could not be found. Oct 08 21:11:06.406898 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:11:06.406898 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:11:06.406898 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:11:06.406898 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:11:06.406898 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:11:06.406898 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:11:06.406898 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:11:06.406898 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:11:06.406898 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 08 21:11:06.406898 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 08 21:11:06.406898 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:11:06.406898 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:11:06.406898 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Oct 08 21:11:06.406898 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:11:06.406898 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 8a4a6545-b346-486f-a8c2-9b627f885d5b could not be found. Oct 08 21:11:06.406898 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:11:06.406898 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:11:06.406898 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:11:06.406898 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:11:06.406898 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:11:06.406898 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:11:06.406898 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:11:06.406898 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:11:06.406898 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 8a4a6545-b346-486f-a8c2-9b627f885d5b could not be found. Oct 08 21:11:06.406898 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:11:06.411151 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e212d155-da85-475e-83eb-5c0c12a8e037 tempest-VolumesSnapshotsTestJSON-1481697256 tempest-VolumesSnapshotsTestJSON-1481697256-project] Returning 404 to user: Snapshot 8a4a6545-b346-486f-a8c2-9b627f885d5b could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:11:06.412301 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-e212d155-da85-475e-83eb-5c0c12a8e037 tempest-VolumesSnapshotsTestJSON-1481697256 tempest-VolumesSnapshotsTestJSON-1481697256-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/8a4a6545-b346-486f-a8c2-9b627f885d5b" status: 404 len: 111 microversion: 2.1 time: 0.112248 Oct 08 21:11:06.416684 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2293/4524] 10.222.0.26 () {58 vars in 1251 bytes} [Sat Oct 8 21:11:06 2022] GET /compute/v2.1/os-snapshots/8a4a6545-b346-486f-a8c2-9b627f885d5b => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:11:06.423346 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-6ba55b22-c45c-495e-ab18-d92a11b11b08 tempest-VolumesSnapshotsTestJSON-1481697256 tempest-VolumesSnapshotsTestJSON-1481697256-project] Calling method '.version_select at 0x7f1a8c7f8f70>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:11:06.594708 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-6ba55b22-c45c-495e-ab18-d92a11b11b08 tempest-VolumesSnapshotsTestJSON-1481697256 tempest-VolumesSnapshotsTestJSON-1481697256-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/e4d2f355-6afc-4651-bc07-038d2a3a157c" status: 202 len: 0 microversion: 2.1 time: 0.176308 Oct 08 21:11:06.595991 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2294/4525] 10.222.0.26 () {58 vars in 1248 bytes} [Sat Oct 8 21:11:06 2022] DELETE /compute/v2.1/os-volumes/e4d2f355-6afc-4651-bc07-038d2a3a157c => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 21:11:06.632254 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-f57798e3-9f83-4a6e-9680-7d6736d2c76a tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:11:06.632823 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-f57798e3-9f83-4a6e-9680-7d6736d2c76a tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: 82b72e20-b9e2-45ce-9362-b248f6d47bda] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:11:06.659718 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f57798e3-9f83-4a6e-9680-7d6736d2c76a tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:06.660232 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f57798e3-9f83-4a6e-9680-7d6736d2c76a tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:06.664946 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f57798e3-9f83-4a6e-9680-7d6736d2c76a tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:06.665757 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f57798e3-9f83-4a6e-9680-7d6736d2c76a tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:06.666249 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f57798e3-9f83-4a6e-9680-7d6736d2c76a tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:06.666686 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f57798e3-9f83-4a6e-9680-7d6736d2c76a tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:06.915566 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-f02254ff-4c36-457e-a2f3-ef3156909055 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:11:06.927813 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-f02254ff-4c36-457e-a2f3-ef3156909055 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 200 len: 1525 microversion: 2.1 time: 1.051030 Oct 08 21:11:06.943441 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2232/4526] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:11:05 2022] GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 1525 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:11:06.963163 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-09ded65f-44c7-491e-931c-cb8577ea9817 tempest-VolumesSnapshotsTestJSON-1481697256 tempest-VolumesSnapshotsTestJSON-1481697256-project] Calling method '.version_select at 0x7f1a876cca60>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:11:07.098485 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-09ded65f-44c7-491e-931c-cb8577ea9817 tempest-VolumesSnapshotsTestJSON-1481697256 tempest-VolumesSnapshotsTestJSON-1481697256-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/e4d2f355-6afc-4651-bc07-038d2a3a157c" status: 200 len: 337 microversion: 2.1 time: 0.163383 Oct 08 21:11:07.099110 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2233/4527] 10.222.0.26 () {58 vars in 1245 bytes} [Sat Oct 8 21:11:06 2022] GET /compute/v2.1/os-volumes/e4d2f355-6afc-4651-bc07-038d2a3a157c => generated 337 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:11:07.109557 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-f57798e3-9f83-4a6e-9680-7d6736d2c76a tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78e9afd772c4de981cac8f5817ec356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765c62cac2ee4406b23a5baa85c52ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:11:07.126739 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-f57798e3-9f83-4a6e-9680-7d6736d2c76a tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/82b72e20-b9e2-45ce-9362-b248f6d47bda" status: 200 len: 1510 microversion: 2.1 time: 0.529307 Oct 08 21:11:07.138087 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2295/4528] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:11:06 2022] GET /compute/v2.1/servers/82b72e20-b9e2-45ce-9362-b248f6d47bda => generated 1510 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:11:07.313458 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-4fba27e5-1be9-4700-82ee-f4897051054a tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:11:07.313996 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-4fba27e5-1be9-4700-82ee-f4897051054a tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] [instance: 8073b441-2650-4a77-9e97-9971a3f68282] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:11:07.328776 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4fba27e5-1be9-4700-82ee-f4897051054a tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:07.329462 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4fba27e5-1be9-4700-82ee-f4897051054a tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:07.329763 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4fba27e5-1be9-4700-82ee-f4897051054a tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:07.339555 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4fba27e5-1be9-4700-82ee-f4897051054a tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:07.340465 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4fba27e5-1be9-4700-82ee-f4897051054a tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:07.340838 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4fba27e5-1be9-4700-82ee-f4897051054a tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:07.539039 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-4fba27e5-1be9-4700-82ee-f4897051054a tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30fe0e1ffa1040ec85d3c32d8b741c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd0e7c24154409824f96e9e99da357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:11:07.558544 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-4fba27e5-1be9-4700-82ee-f4897051054a tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "GET /compute/v2.1/servers/8073b441-2650-4a77-9e97-9971a3f68282" status: 200 len: 1501 microversion: 2.1 time: 0.248517 Oct 08 21:11:07.559430 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2234/4529] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:11:07 2022] GET /compute/v2.1/servers/8073b441-2650-4a77-9e97-9971a3f68282 => generated 1501 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:11:07.840725 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e01b9925-711b-4210-82e8-918e342d4518 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:11:07.841288 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-e01b9925-711b-4210-82e8-918e342d4518 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] [instance: 4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:11:07.848787 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e01b9925-711b-4210-82e8-918e342d4518 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:07.849941 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e01b9925-711b-4210-82e8-918e342d4518 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:07.850653 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e01b9925-711b-4210-82e8-918e342d4518 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:07.851614 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e01b9925-711b-4210-82e8-918e342d4518 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:07.852487 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e01b9925-711b-4210-82e8-918e342d4518 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:07.853142 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e01b9925-711b-4210-82e8-918e342d4518 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:07.872555 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-e01b9925-711b-4210-82e8-918e342d4518 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] HTTP exception thrown: Instance 4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21 could not be found. Oct 08 21:11:07.877821 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e01b9925-711b-4210-82e8-918e342d4518 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Request method failure captured: Oct 08 21:11:07.877821 ncdv-master-1 devstack@n-api.service[140492]: request: DELETE /compute/v2.1/servers/4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21 HTTP/1.1 Oct 08 21:11:07.877821 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:11:07.877821 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:11:07.877821 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:11:07.877821 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 21:11:07.877821 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:11:07.877821 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:11:07.877821 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:11:07.877821 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:11:07.877821 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeXs3uQktTLUU68l-aMFOnfcEjU01ko19gRFvNmYrg89zXQ1V4YEKxZJjlqyGh_cNGu78MH9EknZ76-4MVXnPhsf_6nvJ_Z7ApOy9zLG_T9_9z6ZcsaXJ3lBIZwdAGp5dF1MaYBcbspFTZA1qIwM6OZZhaC_4b83fo3SefEwtytK9Oo Oct 08 21:11:07.877821 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:11:07.877821 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:11:07.877821 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:11:07.877821 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:11:07.877821 ncdv-master-1 devstack@n-api.service[140492]: X-Openstack-Nova-Api-Version: 2.32 Oct 08 21:11:07.877821 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:11:07.877821 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:11:07.877821 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 22f2d56477794f8ab38b8e3535b3e8dc Oct 08 21:11:07.877821 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-TaggedBootDevicesTest-1568770669 Oct 08 21:11:07.877821 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:11:07.877821 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:11:07.877821 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/22f2d56477794f8ab38b8e3535b3e8dc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/22f2d56477794f8ab38b8e3535b3e8dc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_22f2d56477794f8ab38b8e3535b3e8dc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/22f2d56477794f8ab38b8e3535b3e8dc"}]}] Oct 08 21:11:07.877821 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-TaggedBootDevicesTest-1568770669 Oct 08 21:11:07.877821 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 22f2d56477794f8ab38b8e3535b3e8dc Oct 08 21:11:07.877821 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1568770669 Oct 08 21:11:07.877821 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-TaggedBootDevicesTest-1568770669-project Oct 08 21:11:07.877821 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:11:07.877821 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:11:07.877821 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: fc2bdd169daf4a1db830b1fa7f94f0b2 Oct 08 21:11:07.877821 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-TaggedBootDevicesTest-1568770669-project Oct 08 21:11:07.877821 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 21:11:07.877821 ncdv-master-1 devstack@n-api.service[140492]: exception: Instance 4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21 could not be found. Oct 08 21:11:07.877821 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': '4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21'} Oct 08 21:11:07.877821 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:11:07.877821 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:11:07.877821 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:11:07.877821 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:11:07.877821 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:11:07.877821 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:11:07.877821 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:11:07.877821 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:11:07.877821 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:11:07.877821 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:11:07.877821 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21 could not be found. Oct 08 21:11:07.877821 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:11:07.877821 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:11:07.877821 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:11:07.877821 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:11:07.877821 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:11:07.877821 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:11:07.877821 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:11:07.877821 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:11:07.877821 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:11:07.877821 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:11:07.877821 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 08 21:11:07.877821 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 08 21:11:07.877821 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 08 21:11:07.877821 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 08 21:11:07.877821 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:11:07.877821 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:11:07.877821 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:11:07.877821 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:11:07.883588 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21 could not be found. Oct 08 21:11:07.883588 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:11:07.883588 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:11:07.883588 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:11:07.883588 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:11:07.883588 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:11:07.883588 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:11:07.883588 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:11:07.883588 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:11:07.883588 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21 could not be found. Oct 08 21:11:07.883588 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:11:07.883588 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e01b9925-711b-4210-82e8-918e342d4518 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Returning 404 to user: Instance 4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21 could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:11:07.883588 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-e01b9925-711b-4210-82e8-918e342d4518 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] 10.222.0.26 "DELETE /compute/v2.1/servers/4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21" status: 404 len: 111 microversion: 2.32 time: 0.039698 Oct 08 21:11:07.883588 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2296/4530] 10.222.0.26 () {60 vars in 1280 bytes} [Sat Oct 8 21:11:07 2022] DELETE /compute/v2.1/servers/4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 08 21:11:07.886006 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-1408578a-cca8-4f00-934c-8089b13d9d49 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:11:07.886153 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-1408578a-cca8-4f00-934c-8089b13d9d49 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] [instance: 4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:11:07.898971 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1408578a-cca8-4f00-934c-8089b13d9d49 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:07.899506 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1408578a-cca8-4f00-934c-8089b13d9d49 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:07.902517 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1408578a-cca8-4f00-934c-8089b13d9d49 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:07.905063 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1408578a-cca8-4f00-934c-8089b13d9d49 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:07.908303 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1408578a-cca8-4f00-934c-8089b13d9d49 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:07.908768 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1408578a-cca8-4f00-934c-8089b13d9d49 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:07.940005 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:11:07.952752 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-1408578a-cca8-4f00-934c-8089b13d9d49 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] HTTP exception thrown: Instance 4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21 could not be found. Oct 08 21:11:07.954881 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-f6867514-5220-4b04-a139-d3fe0607440b tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:11:07.955187 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-1408578a-cca8-4f00-934c-8089b13d9d49 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Request method failure captured: Oct 08 21:11:07.955187 ncdv-master-1 devstack@n-api.service[140491]: request: GET /compute/v2.1/servers/4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21 HTTP/1.1 Oct 08 21:11:07.955187 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:11:07.955187 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:11:07.955187 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:11:07.955187 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 21:11:07.955187 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:11:07.955187 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:11:07.955187 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:11:07.955187 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:11:07.955187 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeXs3uQktTLUU68l-aMFOnfcEjU01ko19gRFvNmYrg89zXQ1V4YEKxZJjlqyGh_cNGu78MH9EknZ76-4MVXnPhsf_6nvJ_Z7ApOy9zLG_T9_9z6ZcsaXJ3lBIZwdAGp5dF1MaYBcbspFTZA1qIwM6OZZhaC_4b83fo3SefEwtytK9Oo Oct 08 21:11:07.955187 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:11:07.955187 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:11:07.955187 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:11:07.955187 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:11:07.955187 ncdv-master-1 devstack@n-api.service[140491]: X-Openstack-Nova-Api-Version: 2.32 Oct 08 21:11:07.955187 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:11:07.955187 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:11:07.955187 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 22f2d56477794f8ab38b8e3535b3e8dc Oct 08 21:11:07.955187 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-TaggedBootDevicesTest-1568770669 Oct 08 21:11:07.955187 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:11:07.955187 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:11:07.955187 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/22f2d56477794f8ab38b8e3535b3e8dc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/22f2d56477794f8ab38b8e3535b3e8dc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_22f2d56477794f8ab38b8e3535b3e8dc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/22f2d56477794f8ab38b8e3535b3e8dc"}]}] Oct 08 21:11:07.955187 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-TaggedBootDevicesTest-1568770669 Oct 08 21:11:07.955187 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 22f2d56477794f8ab38b8e3535b3e8dc Oct 08 21:11:07.955187 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1568770669 Oct 08 21:11:07.955187 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-TaggedBootDevicesTest-1568770669-project Oct 08 21:11:07.955187 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:11:07.955187 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:11:07.955187 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: fc2bdd169daf4a1db830b1fa7f94f0b2 Oct 08 21:11:07.955187 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-TaggedBootDevicesTest-1568770669-project Oct 08 21:11:07.955187 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:11:07.955187 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance 4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21 could not be found. Oct 08 21:11:07.955187 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': '4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21'} Oct 08 21:11:07.955187 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:11:07.955187 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:11:07.955187 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:11:07.955187 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:11:07.955187 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:11:07.955187 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:11:07.955187 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:11:07.955187 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:11:07.955187 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:11:07.955187 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:11:07.955187 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21 could not be found. Oct 08 21:11:07.955187 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:11:07.955187 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:11:07.955187 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:11:07.955187 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:11:07.955187 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:11:07.955187 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:11:07.955187 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:11:07.955187 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:11:07.955187 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:11:07.955187 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:11:07.955187 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:11:07.955187 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:11:07.955187 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:11:07.955187 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:11:07.955187 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:11:07.955187 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:11:07.955187 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21 could not be found. Oct 08 21:11:07.955187 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:11:07.955187 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:11:07.959605 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:11:07.959605 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:11:07.959605 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:11:07.959605 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:11:07.959605 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:11:07.959605 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:11:07.959605 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21 could not be found. Oct 08 21:11:07.959605 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:11:07.960109 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-f6867514-5220-4b04-a139-d3fe0607440b tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:11:07.961700 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-1408578a-cca8-4f00-934c-8089b13d9d49 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] Returning 404 to user: Instance 4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21 could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:11:07.962840 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-1408578a-cca8-4f00-934c-8089b13d9d49 tempest-TaggedBootDevicesTest-1568770669 tempest-TaggedBootDevicesTest-1568770669-project] 10.222.0.26 "GET /compute/v2.1/servers/4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21" status: 404 len: 111 microversion: 2.32 time: 0.081856 Oct 08 21:11:07.963936 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2235/4531] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:11:07 2022] GET /compute/v2.1/servers/4ba58bd1-f13f-4f53-a65e-f2d1ff6f6c21 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 08 21:11:07.972871 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f6867514-5220-4b04-a139-d3fe0607440b tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:07.977399 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f6867514-5220-4b04-a139-d3fe0607440b tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:07.978027 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f6867514-5220-4b04-a139-d3fe0607440b tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:07.978942 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f6867514-5220-4b04-a139-d3fe0607440b tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:07.979560 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f6867514-5220-4b04-a139-d3fe0607440b tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:07.980181 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f6867514-5220-4b04-a139-d3fe0607440b tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:08.115927 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-13d0f7a5-6811-4d63-b5ff-5660f122a1bd tempest-VolumesSnapshotsTestJSON-1481697256 tempest-VolumesSnapshotsTestJSON-1481697256-project] Calling method '.version_select at 0x7f1a876f1790>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:11:08.185253 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-13d0f7a5-6811-4d63-b5ff-5660f122a1bd tempest-VolumesSnapshotsTestJSON-1481697256 tempest-VolumesSnapshotsTestJSON-1481697256-project] HTTP exception thrown: Volume e4d2f355-6afc-4651-bc07-038d2a3a157c could not be found. Oct 08 21:11:08.187251 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-13d0f7a5-6811-4d63-b5ff-5660f122a1bd tempest-VolumesSnapshotsTestJSON-1481697256 tempest-VolumesSnapshotsTestJSON-1481697256-project] Request method failure captured: Oct 08 21:11:08.187251 ncdv-master-1 devstack@n-api.service[140491]: request: GET /compute/v2.1/os-volumes/e4d2f355-6afc-4651-bc07-038d2a3a157c HTTP/1.1 Oct 08 21:11:08.187251 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:11:08.187251 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:11:08.187251 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:11:08.187251 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 21:11:08.187251 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:11:08.187251 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:11:08.187251 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:11:08.187251 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:11:08.187251 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQedhkn9CE8B2l1J8gtnM-2wOsq7HS1CVetOQE72GrRE2Nr6Zc6T6mXqmk9s8JWDmCjGfqqfSk31MV066kg0RBa8MECL-MO-MJYbVY8Qe2oe9MqD6ma1eYfTD9cBZbvIiPYIcpk186Ec2p5uTgd6DW5riHFhaNcl3I9Y8rgElP40C8Zg Oct 08 21:11:08.187251 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:11:08.187251 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:11:08.187251 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:11:08.187251 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:11:08.187251 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:11:08.187251 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:11:08.187251 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: c56b9280162d4a6b9bac0cc641147a24 Oct 08 21:11:08.187251 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1481697256 Oct 08 21:11:08.187251 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:11:08.187251 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:11:08.187251 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/c56b9280162d4a6b9bac0cc641147a24"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c56b9280162d4a6b9bac0cc641147a24"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_c56b9280162d4a6b9bac0cc641147a24"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c56b9280162d4a6b9bac0cc641147a24"}]}] Oct 08 21:11:08.187251 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1481697256 Oct 08 21:11:08.187251 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: c56b9280162d4a6b9bac0cc641147a24 Oct 08 21:11:08.187251 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1481697256 Oct 08 21:11:08.187251 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-VolumesSnapshotsTestJSON-1481697256-project Oct 08 21:11:08.187251 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:11:08.187251 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:11:08.187251 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 7b0248890c8c4da9a1c3d08bcd5742ad Oct 08 21:11:08.187251 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1481697256-project Oct 08 21:11:08.187251 ncdv-master-1 devstack@n-api.service[140491]: method: Oct 08 21:11:08.187251 ncdv-master-1 devstack@n-api.service[140491]: exception: Volume e4d2f355-6afc-4651-bc07-038d2a3a157c could not be found. Oct 08 21:11:08.187251 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': 'e4d2f355-6afc-4651-bc07-038d2a3a157c'} Oct 08 21:11:08.187251 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:11:08.187251 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:11:08.187251 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 08 21:11:08.187251 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 08 21:11:08.187251 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 08 21:11:08.187251 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 08 21:11:08.187251 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 08 21:11:08.187251 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 08 21:11:08.187251 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 08 21:11:08.187251 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 08 21:11:08.187251 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 08 21:11:08.187251 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 08 21:11:08.187251 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 08 21:11:08.187251 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 08 21:11:08.187251 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 08 21:11:08.187251 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 08 21:11:08.187251 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e4d2f355-6afc-4651-bc07-038d2a3a157c could not be found. (HTTP 404) (Request-ID: req-c7aae711-32ad-41b1-be91-ba3a81e92fd3) Oct 08 21:11:08.187251 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:11:08.187251 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:11:08.187251 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:11:08.187251 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:11:08.187251 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 08 21:11:08.187251 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 08 21:11:08.187251 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 08 21:11:08.187251 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 08 21:11:08.187251 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 08 21:11:08.187251 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 08 21:11:08.187251 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 08 21:11:08.187251 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 08 21:11:08.187251 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 08 21:11:08.190994 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 08 21:11:08.190994 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 08 21:11:08.190994 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 08 21:11:08.190994 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 08 21:11:08.190994 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 08 21:11:08.190994 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 08 21:11:08.190994 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 08 21:11:08.190994 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 08 21:11:08.190994 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 08 21:11:08.190994 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 08 21:11:08.190994 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 08 21:11:08.190994 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 08 21:11:08.190994 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 08 21:11:08.190994 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e4d2f355-6afc-4651-bc07-038d2a3a157c could not be found. Oct 08 21:11:08.190994 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:11:08.190994 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:11:08.190994 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:11:08.190994 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:11:08.190994 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:11:08.190994 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:11:08.190994 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:11:08.190994 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:11:08.190994 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 08 21:11:08.190994 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 08 21:11:08.190994 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:11:08.190994 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:11:08.190994 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 08 21:11:08.190994 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:11:08.190994 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e4d2f355-6afc-4651-bc07-038d2a3a157c could not be found. Oct 08 21:11:08.190994 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:11:08.190994 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:11:08.190994 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:11:08.190994 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:11:08.190994 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:11:08.190994 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:11:08.190994 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:11:08.190994 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:11:08.190994 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e4d2f355-6afc-4651-bc07-038d2a3a157c could not be found. Oct 08 21:11:08.190994 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:11:08.190994 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-13d0f7a5-6811-4d63-b5ff-5660f122a1bd tempest-VolumesSnapshotsTestJSON-1481697256 tempest-VolumesSnapshotsTestJSON-1481697256-project] Returning 404 to user: Volume e4d2f355-6afc-4651-bc07-038d2a3a157c could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:11:08.190994 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-13d0f7a5-6811-4d63-b5ff-5660f122a1bd tempest-VolumesSnapshotsTestJSON-1481697256 tempest-VolumesSnapshotsTestJSON-1481697256-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/e4d2f355-6afc-4651-bc07-038d2a3a157c" status: 404 len: 109 microversion: 2.1 time: 0.076910 Oct 08 21:11:08.193846 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2236/4532] 10.222.0.26 () {58 vars in 1245 bytes} [Sat Oct 8 21:11:08 2022] GET /compute/v2.1/os-volumes/e4d2f355-6afc-4651-bc07-038d2a3a157c => generated 109 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:11:08.198749 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-85155ad8-f95f-4c6a-8698-379c59bf6eec tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:11:08.205440 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-85155ad8-f95f-4c6a-8698-379c59bf6eec tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: 82b72e20-b9e2-45ce-9362-b248f6d47bda] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:11:08.223270 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-85155ad8-f95f-4c6a-8698-379c59bf6eec tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:08.229215 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-85155ad8-f95f-4c6a-8698-379c59bf6eec tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:08.229905 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-85155ad8-f95f-4c6a-8698-379c59bf6eec tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:08.231285 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-85155ad8-f95f-4c6a-8698-379c59bf6eec tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:08.233958 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-85155ad8-f95f-4c6a-8698-379c59bf6eec tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:08.234589 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-85155ad8-f95f-4c6a-8698-379c59bf6eec tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:08.317569 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-f6867514-5220-4b04-a139-d3fe0607440b tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:11:08.335710 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-f6867514-5220-4b04-a139-d3fe0607440b tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 200 len: 1525 microversion: 2.1 time: 0.384784 Oct 08 21:11:08.336407 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2297/4533] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:11:07 2022] GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 1525 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:11:08.349359 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-66f76436-c005-459f-bbb6-6930156bc006 tempest-VolumesSnapshotsTestJSON-1481697256 tempest-VolumesSnapshotsTestJSON-1481697256-project] Calling method '.version_select at 0x7f1a87718790>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:11:08.394493 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-66f76436-c005-459f-bbb6-6930156bc006 tempest-VolumesSnapshotsTestJSON-1481697256 tempest-VolumesSnapshotsTestJSON-1481697256-project] HTTP exception thrown: Volume e4d2f355-6afc-4651-bc07-038d2a3a157c could not be found. Oct 08 21:11:08.397518 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-66f76436-c005-459f-bbb6-6930156bc006 tempest-VolumesSnapshotsTestJSON-1481697256 tempest-VolumesSnapshotsTestJSON-1481697256-project] Request method failure captured: Oct 08 21:11:08.397518 ncdv-master-1 devstack@n-api.service[140492]: request: DELETE /compute/v2.1/os-volumes/e4d2f355-6afc-4651-bc07-038d2a3a157c HTTP/1.1 Oct 08 21:11:08.397518 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:11:08.397518 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:11:08.397518 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:11:08.397518 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 21:11:08.397518 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:11:08.397518 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:11:08.397518 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:11:08.397518 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:11:08.397518 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQedhkn9CE8B2l1J8gtnM-2wOsq7HS1CVetOQE72GrRE2Nr6Zc6T6mXqmk9s8JWDmCjGfqqfSk31MV066kg0RBa8MECL-MO-MJYbVY8Qe2oe9MqD6ma1eYfTD9cBZbvIiPYIcpk186Ec2p5uTgd6DW5riHFhaNcl3I9Y8rgElP40C8Zg Oct 08 21:11:08.397518 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:11:08.397518 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:11:08.397518 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:11:08.397518 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:11:08.397518 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:11:08.397518 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:11:08.397518 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: c56b9280162d4a6b9bac0cc641147a24 Oct 08 21:11:08.397518 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1481697256 Oct 08 21:11:08.397518 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:11:08.397518 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:11:08.397518 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/c56b9280162d4a6b9bac0cc641147a24"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c56b9280162d4a6b9bac0cc641147a24"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_c56b9280162d4a6b9bac0cc641147a24"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c56b9280162d4a6b9bac0cc641147a24"}]}] Oct 08 21:11:08.397518 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1481697256 Oct 08 21:11:08.397518 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: c56b9280162d4a6b9bac0cc641147a24 Oct 08 21:11:08.397518 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1481697256 Oct 08 21:11:08.397518 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-VolumesSnapshotsTestJSON-1481697256-project Oct 08 21:11:08.397518 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:11:08.397518 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:11:08.397518 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 7b0248890c8c4da9a1c3d08bcd5742ad Oct 08 21:11:08.397518 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1481697256-project Oct 08 21:11:08.397518 ncdv-master-1 devstack@n-api.service[140492]: method: Oct 08 21:11:08.397518 ncdv-master-1 devstack@n-api.service[140492]: exception: Volume e4d2f355-6afc-4651-bc07-038d2a3a157c could not be found. Oct 08 21:11:08.397518 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': 'e4d2f355-6afc-4651-bc07-038d2a3a157c'} Oct 08 21:11:08.397518 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:11:08.397518 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:11:08.397518 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 08 21:11:08.397518 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 08 21:11:08.397518 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 08 21:11:08.397518 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 08 21:11:08.397518 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 08 21:11:08.397518 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 08 21:11:08.397518 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 08 21:11:08.397518 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 08 21:11:08.397518 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 08 21:11:08.397518 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 08 21:11:08.397518 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 08 21:11:08.397518 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 08 21:11:08.397518 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 08 21:11:08.397518 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 08 21:11:08.397518 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e4d2f355-6afc-4651-bc07-038d2a3a157c could not be found. (HTTP 404) (Request-ID: req-244770d4-7171-494c-b618-d0b485cc2d7b) Oct 08 21:11:08.397518 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:11:08.397518 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:11:08.397518 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:11:08.397518 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:11:08.397518 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 08 21:11:08.397518 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 08 21:11:08.397518 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 08 21:11:08.397518 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 08 21:11:08.397518 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 08 21:11:08.397518 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 08 21:11:08.397518 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 08 21:11:08.397518 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 08 21:11:08.397518 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 08 21:11:08.403204 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 08 21:11:08.403204 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 08 21:11:08.403204 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 08 21:11:08.403204 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 08 21:11:08.403204 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 08 21:11:08.403204 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 08 21:11:08.403204 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 08 21:11:08.403204 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 08 21:11:08.403204 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 08 21:11:08.403204 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 08 21:11:08.403204 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 08 21:11:08.403204 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 08 21:11:08.403204 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 08 21:11:08.403204 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e4d2f355-6afc-4651-bc07-038d2a3a157c could not be found. Oct 08 21:11:08.403204 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:11:08.403204 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:11:08.403204 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:11:08.403204 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:11:08.403204 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:11:08.403204 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:11:08.403204 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:11:08.403204 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:11:08.403204 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 08 21:11:08.403204 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 08 21:11:08.403204 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:11:08.403204 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:11:08.403204 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 08 21:11:08.403204 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:11:08.403204 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e4d2f355-6afc-4651-bc07-038d2a3a157c could not be found. Oct 08 21:11:08.403204 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:11:08.403204 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:11:08.403204 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:11:08.403204 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:11:08.403204 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:11:08.403204 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:11:08.403204 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:11:08.403204 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:11:08.403204 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e4d2f355-6afc-4651-bc07-038d2a3a157c could not be found. Oct 08 21:11:08.403204 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:11:08.413819 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-66f76436-c005-459f-bbb6-6930156bc006 tempest-VolumesSnapshotsTestJSON-1481697256 tempest-VolumesSnapshotsTestJSON-1481697256-project] Returning 404 to user: Volume e4d2f355-6afc-4651-bc07-038d2a3a157c could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:11:08.413819 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-66f76436-c005-459f-bbb6-6930156bc006 tempest-VolumesSnapshotsTestJSON-1481697256 tempest-VolumesSnapshotsTestJSON-1481697256-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/e4d2f355-6afc-4651-bc07-038d2a3a157c" status: 404 len: 109 microversion: 2.1 time: 0.072289 Oct 08 21:11:08.413819 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2298/4534] 10.222.0.26 () {58 vars in 1248 bytes} [Sat Oct 8 21:11:08 2022] DELETE /compute/v2.1/os-volumes/e4d2f355-6afc-4651-bc07-038d2a3a157c => generated 109 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:11:08.418728 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-c53efeb0-9b55-4248-b599-e1dcae249c8e tempest-VolumesSnapshotsTestJSON-1481697256 tempest-VolumesSnapshotsTestJSON-1481697256-project] Calling method '.version_select at 0x7f1a8c7f8e50>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:11:08.522168 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-c53efeb0-9b55-4248-b599-e1dcae249c8e tempest-VolumesSnapshotsTestJSON-1481697256 tempest-VolumesSnapshotsTestJSON-1481697256-project] HTTP exception thrown: Volume e4d2f355-6afc-4651-bc07-038d2a3a157c could not be found. Oct 08 21:11:08.524305 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-c53efeb0-9b55-4248-b599-e1dcae249c8e tempest-VolumesSnapshotsTestJSON-1481697256 tempest-VolumesSnapshotsTestJSON-1481697256-project] Request method failure captured: Oct 08 21:11:08.524305 ncdv-master-1 devstack@n-api.service[140492]: request: GET /compute/v2.1/os-volumes/e4d2f355-6afc-4651-bc07-038d2a3a157c HTTP/1.1 Oct 08 21:11:08.524305 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:11:08.524305 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:11:08.524305 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:11:08.524305 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 21:11:08.524305 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:11:08.524305 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:11:08.524305 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:11:08.524305 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:11:08.524305 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQedhkn9CE8B2l1J8gtnM-2wOsq7HS1CVetOQE72GrRE2Nr6Zc6T6mXqmk9s8JWDmCjGfqqfSk31MV066kg0RBa8MECL-MO-MJYbVY8Qe2oe9MqD6ma1eYfTD9cBZbvIiPYIcpk186Ec2p5uTgd6DW5riHFhaNcl3I9Y8rgElP40C8Zg Oct 08 21:11:08.524305 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:11:08.524305 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:11:08.524305 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:11:08.524305 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:11:08.524305 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:11:08.524305 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:11:08.524305 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: c56b9280162d4a6b9bac0cc641147a24 Oct 08 21:11:08.524305 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1481697256 Oct 08 21:11:08.524305 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:11:08.524305 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:11:08.524305 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/c56b9280162d4a6b9bac0cc641147a24"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c56b9280162d4a6b9bac0cc641147a24"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_c56b9280162d4a6b9bac0cc641147a24"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c56b9280162d4a6b9bac0cc641147a24"}]}] Oct 08 21:11:08.524305 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1481697256 Oct 08 21:11:08.524305 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: c56b9280162d4a6b9bac0cc641147a24 Oct 08 21:11:08.524305 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1481697256 Oct 08 21:11:08.524305 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-VolumesSnapshotsTestJSON-1481697256-project Oct 08 21:11:08.524305 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:11:08.524305 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:11:08.524305 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 7b0248890c8c4da9a1c3d08bcd5742ad Oct 08 21:11:08.524305 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1481697256-project Oct 08 21:11:08.524305 ncdv-master-1 devstack@n-api.service[140492]: method: Oct 08 21:11:08.524305 ncdv-master-1 devstack@n-api.service[140492]: exception: Volume e4d2f355-6afc-4651-bc07-038d2a3a157c could not be found. Oct 08 21:11:08.524305 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': 'e4d2f355-6afc-4651-bc07-038d2a3a157c'} Oct 08 21:11:08.524305 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:11:08.524305 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:11:08.524305 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 08 21:11:08.524305 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 08 21:11:08.524305 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 08 21:11:08.524305 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 08 21:11:08.524305 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 08 21:11:08.524305 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 08 21:11:08.524305 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 08 21:11:08.524305 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 08 21:11:08.524305 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 08 21:11:08.524305 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 08 21:11:08.524305 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 08 21:11:08.524305 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 08 21:11:08.524305 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 08 21:11:08.524305 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 08 21:11:08.524305 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e4d2f355-6afc-4651-bc07-038d2a3a157c could not be found. (HTTP 404) (Request-ID: req-84ca8e2c-e718-431a-a79e-5995236410dc) Oct 08 21:11:08.524305 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:11:08.524305 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:11:08.524305 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:11:08.524305 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:11:08.524305 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 08 21:11:08.524305 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 08 21:11:08.524305 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 08 21:11:08.524305 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 08 21:11:08.524305 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 08 21:11:08.524305 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 08 21:11:08.524305 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 08 21:11:08.524305 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 08 21:11:08.524305 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 08 21:11:08.529039 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 08 21:11:08.529039 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 08 21:11:08.529039 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 08 21:11:08.529039 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 08 21:11:08.529039 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 08 21:11:08.529039 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 08 21:11:08.529039 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 08 21:11:08.529039 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 08 21:11:08.529039 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 08 21:11:08.529039 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 08 21:11:08.529039 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 08 21:11:08.529039 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 08 21:11:08.529039 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 08 21:11:08.529039 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e4d2f355-6afc-4651-bc07-038d2a3a157c could not be found. Oct 08 21:11:08.529039 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:11:08.529039 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:11:08.529039 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:11:08.529039 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:11:08.529039 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:11:08.529039 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:11:08.529039 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:11:08.529039 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:11:08.529039 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 08 21:11:08.529039 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 08 21:11:08.529039 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:11:08.529039 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:11:08.529039 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 08 21:11:08.529039 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:11:08.529039 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e4d2f355-6afc-4651-bc07-038d2a3a157c could not be found. Oct 08 21:11:08.529039 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:11:08.529039 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:11:08.529039 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:11:08.529039 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:11:08.529039 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:11:08.529039 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:11:08.529039 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:11:08.529039 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:11:08.529039 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e4d2f355-6afc-4651-bc07-038d2a3a157c could not be found. Oct 08 21:11:08.529039 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:11:08.532426 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-c53efeb0-9b55-4248-b599-e1dcae249c8e tempest-VolumesSnapshotsTestJSON-1481697256 tempest-VolumesSnapshotsTestJSON-1481697256-project] Returning 404 to user: Volume e4d2f355-6afc-4651-bc07-038d2a3a157c could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:11:08.534512 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-c53efeb0-9b55-4248-b599-e1dcae249c8e tempest-VolumesSnapshotsTestJSON-1481697256 tempest-VolumesSnapshotsTestJSON-1481697256-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/e4d2f355-6afc-4651-bc07-038d2a3a157c" status: 404 len: 109 microversion: 2.1 time: 0.119010 Oct 08 21:11:08.535545 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2299/4535] 10.222.0.26 () {58 vars in 1245 bytes} [Sat Oct 8 21:11:08 2022] GET /compute/v2.1/os-volumes/e4d2f355-6afc-4651-bc07-038d2a3a157c => generated 109 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:11:08.595929 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-dccb6d62-e111-456f-92d2-f1d9a2590aa9 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:11:08.596970 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-dccb6d62-e111-456f-92d2-f1d9a2590aa9 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] [instance: 8073b441-2650-4a77-9e97-9971a3f68282] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:11:08.613204 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dccb6d62-e111-456f-92d2-f1d9a2590aa9 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:08.614170 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dccb6d62-e111-456f-92d2-f1d9a2590aa9 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:08.618311 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dccb6d62-e111-456f-92d2-f1d9a2590aa9 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:08.621100 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dccb6d62-e111-456f-92d2-f1d9a2590aa9 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:08.622787 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dccb6d62-e111-456f-92d2-f1d9a2590aa9 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:08.624025 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dccb6d62-e111-456f-92d2-f1d9a2590aa9 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:08.929864 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-dccb6d62-e111-456f-92d2-f1d9a2590aa9 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30fe0e1ffa1040ec85d3c32d8b741c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd0e7c24154409824f96e9e99da357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:11:08.944707 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-dccb6d62-e111-456f-92d2-f1d9a2590aa9 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "GET /compute/v2.1/servers/8073b441-2650-4a77-9e97-9971a3f68282" status: 200 len: 1488 microversion: 2.1 time: 0.355953 Oct 08 21:11:08.947335 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2300/4536] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:11:08 2022] GET /compute/v2.1/servers/8073b441-2650-4a77-9e97-9971a3f68282 => generated 1488 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:11:08.971715 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-23313062-a077-4fc5-bb6f-3d5b159f883e tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:11:08.972269 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-23313062-a077-4fc5-bb6f-3d5b159f883e tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] [instance: 8073b441-2650-4a77-9e97-9971a3f68282] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:11:08.980711 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-23313062-a077-4fc5-bb6f-3d5b159f883e tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:08.981254 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-23313062-a077-4fc5-bb6f-3d5b159f883e tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:08.981705 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-23313062-a077-4fc5-bb6f-3d5b159f883e tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:08.982815 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-23313062-a077-4fc5-bb6f-3d5b159f883e tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:08.984358 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-23313062-a077-4fc5-bb6f-3d5b159f883e tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:08.985087 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-23313062-a077-4fc5-bb6f-3d5b159f883e tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:09.034564 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-23313062-a077-4fc5-bb6f-3d5b159f883e tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] [instance: 8073b441-2650-4a77-9e97-9971a3f68282] Going to try to terminate instance {{(pid=140492) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 21:11:09.233591 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-23313062-a077-4fc5-bb6f-3d5b159f883e tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "DELETE /compute/v2.1/servers/8073b441-2650-4a77-9e97-9971a3f68282" status: 204 len: 0 microversion: 2.1 time: 0.266822 Oct 08 21:11:09.242672 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2301/4537] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:11:08 2022] DELETE /compute/v2.1/servers/8073b441-2650-4a77-9e97-9971a3f68282 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 08 21:11:09.266428 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e7523fa7-e7a1-444f-b1c3-0d080ee7aa02 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Calling method '.version_select at 0x7f1a87d223a0>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:11:09.295671 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-e7523fa7-e7a1-444f-b1c3-0d080ee7aa02 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] HTTP exception thrown: Image not found. Oct 08 21:11:09.300805 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e7523fa7-e7a1-444f-b1c3-0d080ee7aa02 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Request method failure captured: Oct 08 21:11:09.300805 ncdv-master-1 devstack@n-api.service[140492]: request: DELETE /compute/v2.1/images/be0ff98b-e818-49e6-ab17-1b9369c16404 HTTP/1.1 Oct 08 21:11:09.300805 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:11:09.300805 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:11:09.300805 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:11:09.300805 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 21:11:09.300805 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:11:09.300805 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:11:09.300805 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:11:09.300805 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:11:09.300805 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeaSKTe_Fou7Tynsshq4jmA96ac0QjSnZl8MRkWeLpbYWo7KTncUdf4zi0sVQcp1BUvWwa3324gOKsN8j-gh8b_nnvj8r1lMZwi8XCtH19IX2ZuTfA5HsF6Wv6gsXu8d2xT7eLqAE--DUlL114RxDAcH3m1wEtiDfwOrDWDUhiesqmw Oct 08 21:11:09.300805 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:11:09.300805 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:11:09.300805 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:11:09.300805 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:11:09.300805 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:11:09.300805 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:11:09.300805 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 6bcd0e7c24154409824f96e9e99da357 Oct 08 21:11:09.300805 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-ImagesTestJSON-278094929 Oct 08 21:11:09.300805 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:11:09.300805 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:11:09.300805 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6bcd0e7c24154409824f96e9e99da357"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6bcd0e7c24154409824f96e9e99da357"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6bcd0e7c24154409824f96e9e99da357"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6bcd0e7c24154409824f96e9e99da357"}]}] Oct 08 21:11:09.300805 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-ImagesTestJSON-278094929 Oct 08 21:11:09.300805 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 6bcd0e7c24154409824f96e9e99da357 Oct 08 21:11:09.300805 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-ImagesTestJSON-278094929 Oct 08 21:11:09.300805 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-ImagesTestJSON-278094929-project Oct 08 21:11:09.300805 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:11:09.300805 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:11:09.300805 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 30fe0e1ffa1040ec85d3c32d8b741c75 Oct 08 21:11:09.300805 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-ImagesTestJSON-278094929-project Oct 08 21:11:09.300805 ncdv-master-1 devstack@n-api.service[140492]: method: Oct 08 21:11:09.300805 ncdv-master-1 devstack@n-api.service[140492]: exception: Image not found. Oct 08 21:11:09.300805 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': 'be0ff98b-e818-49e6-ab17-1b9369c16404'} Oct 08 21:11:09.300805 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:11:09.300805 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:11:09.300805 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 08 21:11:09.300805 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 08 21:11:09.300805 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 08 21:11:09.300805 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 08 21:11:09.300805 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 08 21:11:09.300805 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 08 21:11:09.300805 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 08 21:11:09.300805 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 08 21:11:09.300805 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 08 21:11:09.300805 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 08 21:11:09.300805 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 08 21:11:09.300805 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 08 21:11:09.300805 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 08 21:11:09.300805 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 08 21:11:09.300805 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image be0ff98b-e818-49e6-ab17-1b9369c16404 to delete Oct 08 21:11:09.300805 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:11:09.300805 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:11:09.300805 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:11:09.300805 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:11:09.300805 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 08 21:11:09.300805 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 08 21:11:09.300805 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 08 21:11:09.300805 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 08 21:11:09.300805 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 08 21:11:09.300805 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 08 21:11:09.300805 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image be0ff98b-e818-49e6-ab17-1b9369c16404 could not be found. Oct 08 21:11:09.300805 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:11:09.300805 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:11:09.300805 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:11:09.300805 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:11:09.305837 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:11:09.305837 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:11:09.305837 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:11:09.305837 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:11:09.305837 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 08 21:11:09.305837 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 08 21:11:09.305837 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:11:09.305837 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:11:09.305837 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 08 21:11:09.305837 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 08 21:11:09.305837 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 08 21:11:09.305837 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:11:09.305837 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:11:09.305837 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:11:09.305837 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:11:09.305837 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:11:09.305837 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:11:09.305837 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:11:09.305837 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:11:09.305837 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 08 21:11:09.305837 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:11:09.305837 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e7523fa7-e7a1-444f-b1c3-0d080ee7aa02 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Returning 404 to user: Image not found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:11:09.309397 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-e7523fa7-e7a1-444f-b1c3-0d080ee7aa02 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "DELETE /compute/v2.1/images/be0ff98b-e818-49e6-ab17-1b9369c16404" status: 404 len: 62 microversion: 2.1 time: 0.064209 Oct 08 21:11:09.310054 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2302/4538] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:11:09 2022] DELETE /compute/v2.1/images/be0ff98b-e818-49e6-ab17-1b9369c16404 => generated 62 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 08 21:11:09.319312 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e1cc9a78-61c5-4789-9126-d5390258c98b tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:11:09.325532 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-e1cc9a78-61c5-4789-9126-d5390258c98b tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] [instance: 8073b441-2650-4a77-9e97-9971a3f68282] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:11:09.344955 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e1cc9a78-61c5-4789-9126-d5390258c98b tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:09.345953 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e1cc9a78-61c5-4789-9126-d5390258c98b tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:09.346633 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e1cc9a78-61c5-4789-9126-d5390258c98b tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:09.347368 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e1cc9a78-61c5-4789-9126-d5390258c98b tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:09.347835 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e1cc9a78-61c5-4789-9126-d5390258c98b tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:09.348297 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e1cc9a78-61c5-4789-9126-d5390258c98b tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:09.435143 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-e1cc9a78-61c5-4789-9126-d5390258c98b tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] [instance: 8073b441-2650-4a77-9e97-9971a3f68282] Going to try to terminate instance {{(pid=140492) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 21:11:09.536417 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-85155ad8-f95f-4c6a-8698-379c59bf6eec tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78e9afd772c4de981cac8f5817ec356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765c62cac2ee4406b23a5baa85c52ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:11:09.549685 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-85155ad8-f95f-4c6a-8698-379c59bf6eec tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/82b72e20-b9e2-45ce-9362-b248f6d47bda" status: 200 len: 1510 microversion: 2.1 time: 1.350334 Oct 08 21:11:09.550071 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2237/4539] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:11:08 2022] GET /compute/v2.1/servers/82b72e20-b9e2-45ce-9362-b248f6d47bda => generated 1510 bytes in 1356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:11:09.594036 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-50840b1e-f9bb-40fa-b468-8dd0f5df9e54 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:11:09.594670 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-50840b1e-f9bb-40fa-b468-8dd0f5df9e54 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:11:09.609990 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.compute.api [None req-e1cc9a78-61c5-4789-9126-d5390258c98b tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] [instance: 8073b441-2650-4a77-9e97-9971a3f68282] Instance is already in deleting state, ignoring this request Oct 08 21:11:09.613130 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-e1cc9a78-61c5-4789-9126-d5390258c98b tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "DELETE /compute/v2.1/servers/8073b441-2650-4a77-9e97-9971a3f68282" status: 204 len: 0 microversion: 2.1 time: 0.296580 Oct 08 21:11:09.614825 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2303/4540] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:11:09 2022] DELETE /compute/v2.1/servers/8073b441-2650-4a77-9e97-9971a3f68282 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 21:11:09.641945 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-dcab14f4-cdd0-4ad2-aee7-275e91d8fb17 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:11:09.642889 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-dcab14f4-cdd0-4ad2-aee7-275e91d8fb17 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] [instance: 8073b441-2650-4a77-9e97-9971a3f68282] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:11:09.647362 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-50840b1e-f9bb-40fa-b468-8dd0f5df9e54 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:09.647895 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-50840b1e-f9bb-40fa-b468-8dd0f5df9e54 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:09.651898 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-50840b1e-f9bb-40fa-b468-8dd0f5df9e54 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:09.656836 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-50840b1e-f9bb-40fa-b468-8dd0f5df9e54 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:09.658595 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-50840b1e-f9bb-40fa-b468-8dd0f5df9e54 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:09.660850 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-50840b1e-f9bb-40fa-b468-8dd0f5df9e54 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:09.673797 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dcab14f4-cdd0-4ad2-aee7-275e91d8fb17 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:09.674364 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dcab14f4-cdd0-4ad2-aee7-275e91d8fb17 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:09.674822 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dcab14f4-cdd0-4ad2-aee7-275e91d8fb17 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:09.679979 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dcab14f4-cdd0-4ad2-aee7-275e91d8fb17 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:09.682269 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dcab14f4-cdd0-4ad2-aee7-275e91d8fb17 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:09.685966 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dcab14f4-cdd0-4ad2-aee7-275e91d8fb17 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:09.998683 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-dcab14f4-cdd0-4ad2-aee7-275e91d8fb17 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30fe0e1ffa1040ec85d3c32d8b741c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd0e7c24154409824f96e9e99da357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:11:10.014487 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-dcab14f4-cdd0-4ad2-aee7-275e91d8fb17 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "GET /compute/v2.1/servers/8073b441-2650-4a77-9e97-9971a3f68282" status: 200 len: 1494 microversion: 2.1 time: 0.390888 Oct 08 21:11:10.016988 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2304/4541] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:11:09 2022] GET /compute/v2.1/servers/8073b441-2650-4a77-9e97-9971a3f68282 => generated 1494 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:11:10.171655 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-50840b1e-f9bb-40fa-b468-8dd0f5df9e54 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:11:10.206065 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-50840b1e-f9bb-40fa-b468-8dd0f5df9e54 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 200 len: 1525 microversion: 2.1 time: 0.632040 Oct 08 21:11:10.211820 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2238/4542] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:11:09 2022] GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 1525 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:11:10.584368 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-6fc14b28-494a-4def-b51f-bef216bf8258 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:11:10.586622 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-6fc14b28-494a-4def-b51f-bef216bf8258 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: 82b72e20-b9e2-45ce-9362-b248f6d47bda] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:11:10.610965 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-793b72bc-54d1-49cb-b369-0f5259549b64 req-20b2fdb4-a98d-48f4-bc20-4c846367041c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8073b441-2650-4a77-9e97-9971a3f68282", "name": "network-vif-plugged", "status": "completed", "tag": "676c3848-0a48-4fe1-9081-833908787a16"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:11:10.619711 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6fc14b28-494a-4def-b51f-bef216bf8258 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:10.621220 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6fc14b28-494a-4def-b51f-bef216bf8258 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:10.623541 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6fc14b28-494a-4def-b51f-bef216bf8258 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:10.627099 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6fc14b28-494a-4def-b51f-bef216bf8258 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:10.627680 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6fc14b28-494a-4def-b51f-bef216bf8258 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:10.628101 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6fc14b28-494a-4def-b51f-bef216bf8258 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:10.646213 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-793b72bc-54d1-49cb-b369-0f5259549b64 req-20b2fdb4-a98d-48f4-bc20-4c846367041c service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:10.648751 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-793b72bc-54d1-49cb-b369-0f5259549b64 req-20b2fdb4-a98d-48f4-bc20-4c846367041c service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:10.650007 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-793b72bc-54d1-49cb-b369-0f5259549b64 req-20b2fdb4-a98d-48f4-bc20-4c846367041c service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:10.723446 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-793b72bc-54d1-49cb-b369-0f5259549b64 req-20b2fdb4-a98d-48f4-bc20-4c846367041c service nova] Creating event network-vif-plugged:676c3848-0a48-4fe1-9081-833908787a16 for instance 8073b441-2650-4a77-9e97-9971a3f68282 on nch1-master-1 Oct 08 21:11:10.747720 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-793b72bc-54d1-49cb-b369-0f5259549b64 req-20b2fdb4-a98d-48f4-bc20-4c846367041c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138800 Oct 08 21:11:10.750718 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2239/4543] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:11:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 08 21:11:11.043303 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-6a3ec3eb-8a82-480d-84d9-926a7cc583ad tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:11:11.044867 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-6a3ec3eb-8a82-480d-84d9-926a7cc583ad tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] [instance: 8073b441-2650-4a77-9e97-9971a3f68282] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:11:11.048373 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-6fc14b28-494a-4def-b51f-bef216bf8258 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78e9afd772c4de981cac8f5817ec356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765c62cac2ee4406b23a5baa85c52ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:11:11.070163 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-6fc14b28-494a-4def-b51f-bef216bf8258 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/82b72e20-b9e2-45ce-9362-b248f6d47bda" status: 200 len: 1510 microversion: 2.1 time: 0.493490 Oct 08 21:11:11.070611 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6a3ec3eb-8a82-480d-84d9-926a7cc583ad tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:11.070865 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2305/4544] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:11:10 2022] GET /compute/v2.1/servers/82b72e20-b9e2-45ce-9362-b248f6d47bda => generated 1510 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:11:11.072865 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6a3ec3eb-8a82-480d-84d9-926a7cc583ad tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:11.075569 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6a3ec3eb-8a82-480d-84d9-926a7cc583ad tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:11.076629 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6a3ec3eb-8a82-480d-84d9-926a7cc583ad tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:11.077248 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6a3ec3eb-8a82-480d-84d9-926a7cc583ad tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:11.079784 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6a3ec3eb-8a82-480d-84d9-926a7cc583ad tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:11.236839 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-fcafffae-1a1d-4b3a-93b2-866aeb015e75 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:11:11.237848 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-fcafffae-1a1d-4b3a-93b2-866aeb015e75 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:11:11.252025 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fcafffae-1a1d-4b3a-93b2-866aeb015e75 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:11.254544 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fcafffae-1a1d-4b3a-93b2-866aeb015e75 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:11.255385 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fcafffae-1a1d-4b3a-93b2-866aeb015e75 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:11.257352 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fcafffae-1a1d-4b3a-93b2-866aeb015e75 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:11.260374 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fcafffae-1a1d-4b3a-93b2-866aeb015e75 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:11.261060 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fcafffae-1a1d-4b3a-93b2-866aeb015e75 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:11.697322 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-fcafffae-1a1d-4b3a-93b2-866aeb015e75 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:11:11.712882 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-fcafffae-1a1d-4b3a-93b2-866aeb015e75 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 200 len: 1525 microversion: 2.1 time: 0.480554 Oct 08 21:11:11.728698 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2306/4545] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:11:11 2022] GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 1525 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:11:11.757140 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-6a3ec3eb-8a82-480d-84d9-926a7cc583ad tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30fe0e1ffa1040ec85d3c32d8b741c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd0e7c24154409824f96e9e99da357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:11:11.777064 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-6a3ec3eb-8a82-480d-84d9-926a7cc583ad tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "GET /compute/v2.1/servers/8073b441-2650-4a77-9e97-9971a3f68282" status: 200 len: 1494 microversion: 2.1 time: 0.739187 Oct 08 21:11:11.780398 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2240/4546] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:11:11 2022] GET /compute/v2.1/servers/8073b441-2650-4a77-9e97-9971a3f68282 => generated 1494 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:11:12.096417 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-a7d41b2d-5baf-4ed3-b7e0-6cc84dfe9acb tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:11:12.097804 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-a7d41b2d-5baf-4ed3-b7e0-6cc84dfe9acb tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: 82b72e20-b9e2-45ce-9362-b248f6d47bda] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:11:12.106343 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a7d41b2d-5baf-4ed3-b7e0-6cc84dfe9acb tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:12.107137 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a7d41b2d-5baf-4ed3-b7e0-6cc84dfe9acb tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:12.107883 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a7d41b2d-5baf-4ed3-b7e0-6cc84dfe9acb tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:12.108991 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a7d41b2d-5baf-4ed3-b7e0-6cc84dfe9acb tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:12.109890 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a7d41b2d-5baf-4ed3-b7e0-6cc84dfe9acb tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:12.122947 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a7d41b2d-5baf-4ed3-b7e0-6cc84dfe9acb tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:12.434719 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-a7d41b2d-5baf-4ed3-b7e0-6cc84dfe9acb tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78e9afd772c4de981cac8f5817ec356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765c62cac2ee4406b23a5baa85c52ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:11:12.447951 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-a7d41b2d-5baf-4ed3-b7e0-6cc84dfe9acb tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/82b72e20-b9e2-45ce-9362-b248f6d47bda" status: 200 len: 1510 microversion: 2.1 time: 0.355485 Oct 08 21:11:12.453299 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2307/4547] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:11:12 2022] GET /compute/v2.1/servers/82b72e20-b9e2-45ce-9362-b248f6d47bda => generated 1510 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:11:12.740277 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-af87f7c7-b651-4d21-83ba-02fa2521f1be tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:11:12.741471 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-af87f7c7-b651-4d21-83ba-02fa2521f1be tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:11:12.751710 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:SELECT=87,nova_api:DELETE=1 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:11:12.763859 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-af87f7c7-b651-4d21-83ba-02fa2521f1be tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:12.764503 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-af87f7c7-b651-4d21-83ba-02fa2521f1be tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:12.764817 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-af87f7c7-b651-4d21-83ba-02fa2521f1be tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:12.765592 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-af87f7c7-b651-4d21-83ba-02fa2521f1be tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:12.766131 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-af87f7c7-b651-4d21-83ba-02fa2521f1be tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:12.766471 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-af87f7c7-b651-4d21-83ba-02fa2521f1be tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:12.811743 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-cbf840d4-843f-44ea-9407-28c16bfb6a2a tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:11:12.812386 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-cbf840d4-843f-44ea-9407-28c16bfb6a2a tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] [instance: 8073b441-2650-4a77-9e97-9971a3f68282] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:11:12.827418 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cbf840d4-843f-44ea-9407-28c16bfb6a2a tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:12.828349 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cbf840d4-843f-44ea-9407-28c16bfb6a2a tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:12.829032 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cbf840d4-843f-44ea-9407-28c16bfb6a2a tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:12.830006 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cbf840d4-843f-44ea-9407-28c16bfb6a2a tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:12.832917 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cbf840d4-843f-44ea-9407-28c16bfb6a2a tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:12.833823 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cbf840d4-843f-44ea-9407-28c16bfb6a2a tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:13.056539 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-cbf840d4-843f-44ea-9407-28c16bfb6a2a tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30fe0e1ffa1040ec85d3c32d8b741c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd0e7c24154409824f96e9e99da357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:11:13.067918 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-cbf840d4-843f-44ea-9407-28c16bfb6a2a tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "GET /compute/v2.1/servers/8073b441-2650-4a77-9e97-9971a3f68282" status: 200 len: 1494 microversion: 2.1 time: 0.261816 Oct 08 21:11:13.069718 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2308/4548] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:11:12 2022] GET /compute/v2.1/servers/8073b441-2650-4a77-9e97-9971a3f68282 => generated 1494 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:11:13.419648 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-af87f7c7-b651-4d21-83ba-02fa2521f1be tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:11:13.433605 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-af87f7c7-b651-4d21-83ba-02fa2521f1be tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 200 len: 1525 microversion: 2.1 time: 0.695874 Oct 08 21:11:13.436170 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2241/4549] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:11:12 2022] GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 1525 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:11:13.492903 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-f485b7e6-e3c8-424b-a113-d20a0ec0663b tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:11:13.494264 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-f485b7e6-e3c8-424b-a113-d20a0ec0663b tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: 82b72e20-b9e2-45ce-9362-b248f6d47bda] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:11:13.506271 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f485b7e6-e3c8-424b-a113-d20a0ec0663b tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:13.525848 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f485b7e6-e3c8-424b-a113-d20a0ec0663b tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:13.527659 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f485b7e6-e3c8-424b-a113-d20a0ec0663b tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:13.533063 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f485b7e6-e3c8-424b-a113-d20a0ec0663b tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:13.533862 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f485b7e6-e3c8-424b-a113-d20a0ec0663b tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:13.534467 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f485b7e6-e3c8-424b-a113-d20a0ec0663b tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:13.948509 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-a6df45ed-628b-4a18-a974-b4d165036fb0 req-8c6fbf0a-c40f-431d-a17e-1e69a043230d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8073b441-2650-4a77-9e97-9971a3f68282", "name": "network-vif-deleted", "tag": "676c3848-0a48-4fe1-9081-833908787a16"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:11:14.005695 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-a6df45ed-628b-4a18-a974-b4d165036fb0 req-8c6fbf0a-c40f-431d-a17e-1e69a043230d service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:14.010361 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-a6df45ed-628b-4a18-a974-b4d165036fb0 req-8c6fbf0a-c40f-431d-a17e-1e69a043230d service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:14.011512 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-a6df45ed-628b-4a18-a974-b4d165036fb0 req-8c6fbf0a-c40f-431d-a17e-1e69a043230d service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:14.059813 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-a6df45ed-628b-4a18-a974-b4d165036fb0 req-8c6fbf0a-c40f-431d-a17e-1e69a043230d service nova] Creating event network-vif-deleted:676c3848-0a48-4fe1-9081-833908787a16 for instance 8073b441-2650-4a77-9e97-9971a3f68282 on nch1-master-1 Oct 08 21:11:14.081735 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-a6df45ed-628b-4a18-a974-b4d165036fb0 req-8c6fbf0a-c40f-431d-a17e-1e69a043230d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143490 Oct 08 21:11:14.102836 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2242/4550] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:11:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:11:14.129642 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-7eea68ef-c559-4476-ba4c-d405d6a0d554 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:11:14.133125 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-7eea68ef-c559-4476-ba4c-d405d6a0d554 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] [instance: 8073b441-2650-4a77-9e97-9971a3f68282] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:11:14.153445 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7eea68ef-c559-4476-ba4c-d405d6a0d554 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:14.154337 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7eea68ef-c559-4476-ba4c-d405d6a0d554 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:14.155109 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7eea68ef-c559-4476-ba4c-d405d6a0d554 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:14.156115 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7eea68ef-c559-4476-ba4c-d405d6a0d554 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:14.158992 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7eea68ef-c559-4476-ba4c-d405d6a0d554 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:14.160090 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7eea68ef-c559-4476-ba4c-d405d6a0d554 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:14.285047 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-f485b7e6-e3c8-424b-a113-d20a0ec0663b tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78e9afd772c4de981cac8f5817ec356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765c62cac2ee4406b23a5baa85c52ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:11:14.303796 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-f485b7e6-e3c8-424b-a113-d20a0ec0663b tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/82b72e20-b9e2-45ce-9362-b248f6d47bda" status: 200 len: 1510 microversion: 2.1 time: 0.819019 Oct 08 21:11:14.323755 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7eea68ef-c559-4476-ba4c-d405d6a0d554 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:14.329671 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7eea68ef-c559-4476-ba4c-d405d6a0d554 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:14.332155 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7eea68ef-c559-4476-ba4c-d405d6a0d554 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:14.333567 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2309/4551] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:11:13 2022] GET /compute/v2.1/servers/82b72e20-b9e2-45ce-9362-b248f6d47bda => generated 1510 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:11:14.334119 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.objects.instance [None req-7eea68ef-c559-4476-ba4c-d405d6a0d554 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lazy-loading 'fault' on Instance uuid 8073b441-2650-4a77-9e97-9971a3f68282 {{(pid=140491) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 21:11:14.439599 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-7eea68ef-c559-4476-ba4c-d405d6a0d554 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30fe0e1ffa1040ec85d3c32d8b741c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd0e7c24154409824f96e9e99da357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:11:14.453509 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-7eea68ef-c559-4476-ba4c-d405d6a0d554 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "GET /compute/v2.1/servers/8073b441-2650-4a77-9e97-9971a3f68282" status: 200 len: 1298 microversion: 2.1 time: 0.348833 Oct 08 21:11:14.455123 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2243/4552] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:11:14 2022] GET /compute/v2.1/servers/8073b441-2650-4a77-9e97-9971a3f68282 => generated 1298 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:11:14.459824 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-0e51c50a-ad9d-4fa9-94a4-db5c23e68399 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:11:14.460453 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-0e51c50a-ad9d-4fa9-94a4-db5c23e68399 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:11:14.472524 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0e51c50a-ad9d-4fa9-94a4-db5c23e68399 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:14.473044 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0e51c50a-ad9d-4fa9-94a4-db5c23e68399 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:14.511376 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0e51c50a-ad9d-4fa9-94a4-db5c23e68399 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:14.512212 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0e51c50a-ad9d-4fa9-94a4-db5c23e68399 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:14.513690 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0e51c50a-ad9d-4fa9-94a4-db5c23e68399 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:14.514788 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0e51c50a-ad9d-4fa9-94a4-db5c23e68399 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:15.313068 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-0e51c50a-ad9d-4fa9-94a4-db5c23e68399 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:11:15.323937 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-0e51c50a-ad9d-4fa9-94a4-db5c23e68399 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 200 len: 1525 microversion: 2.1 time: 0.868019 Oct 08 21:11:15.338644 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-4253b48d-ce98-4a44-bc71-b1e0a823f43d tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:11:15.339091 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2310/4553] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:11:14 2022] GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 1525 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:11:15.339387 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-4253b48d-ce98-4a44-bc71-b1e0a823f43d tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: 82b72e20-b9e2-45ce-9362-b248f6d47bda] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:11:15.358288 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4253b48d-ce98-4a44-bc71-b1e0a823f43d tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:15.361731 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4253b48d-ce98-4a44-bc71-b1e0a823f43d tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:15.365081 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4253b48d-ce98-4a44-bc71-b1e0a823f43d tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:15.370308 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4253b48d-ce98-4a44-bc71-b1e0a823f43d tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:15.373791 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4253b48d-ce98-4a44-bc71-b1e0a823f43d tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:15.376973 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4253b48d-ce98-4a44-bc71-b1e0a823f43d tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:15.499640 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-39706d8d-47b4-47cc-a745-61e33a58c6a5 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:11:15.500918 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-39706d8d-47b4-47cc-a745-61e33a58c6a5 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] [instance: 8073b441-2650-4a77-9e97-9971a3f68282] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:11:15.510023 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-39706d8d-47b4-47cc-a745-61e33a58c6a5 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:15.510635 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-39706d8d-47b4-47cc-a745-61e33a58c6a5 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:15.511067 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-39706d8d-47b4-47cc-a745-61e33a58c6a5 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:15.511713 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-39706d8d-47b4-47cc-a745-61e33a58c6a5 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:15.512274 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-39706d8d-47b4-47cc-a745-61e33a58c6a5 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:15.512603 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-39706d8d-47b4-47cc-a745-61e33a58c6a5 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:15.517553 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:11:15.530760 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-39706d8d-47b4-47cc-a745-61e33a58c6a5 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] HTTP exception thrown: Instance 8073b441-2650-4a77-9e97-9971a3f68282 could not be found. Oct 08 21:11:15.532518 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-39706d8d-47b4-47cc-a745-61e33a58c6a5 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Request method failure captured: Oct 08 21:11:15.532518 ncdv-master-1 devstack@n-api.service[140492]: request: GET /compute/v2.1/servers/8073b441-2650-4a77-9e97-9971a3f68282 HTTP/1.1 Oct 08 21:11:15.532518 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:11:15.532518 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:11:15.532518 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:11:15.532518 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 21:11:15.532518 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:11:15.532518 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:11:15.532518 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:11:15.532518 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:11:15.532518 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeaSKTe_Fou7Tynsshq4jmA96ac0QjSnZl8MRkWeLpbYWo7KTncUdf4zi0sVQcp1BUvWwa3324gOKsN8j-gh8b_nnvj8r1lMZwi8XCtH19IX2ZuTfA5HsF6Wv6gsXu8d2xT7eLqAE--DUlL114RxDAcH3m1wEtiDfwOrDWDUhiesqmw Oct 08 21:11:15.532518 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:11:15.532518 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:11:15.532518 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:11:15.532518 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:11:15.532518 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:11:15.532518 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:11:15.532518 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 6bcd0e7c24154409824f96e9e99da357 Oct 08 21:11:15.532518 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-ImagesTestJSON-278094929 Oct 08 21:11:15.532518 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:11:15.532518 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:11:15.532518 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6bcd0e7c24154409824f96e9e99da357"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6bcd0e7c24154409824f96e9e99da357"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6bcd0e7c24154409824f96e9e99da357"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6bcd0e7c24154409824f96e9e99da357"}]}] Oct 08 21:11:15.532518 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-ImagesTestJSON-278094929 Oct 08 21:11:15.532518 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 6bcd0e7c24154409824f96e9e99da357 Oct 08 21:11:15.532518 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-ImagesTestJSON-278094929 Oct 08 21:11:15.532518 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-ImagesTestJSON-278094929-project Oct 08 21:11:15.532518 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:11:15.532518 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:11:15.532518 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 30fe0e1ffa1040ec85d3c32d8b741c75 Oct 08 21:11:15.532518 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-ImagesTestJSON-278094929-project Oct 08 21:11:15.532518 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 21:11:15.532518 ncdv-master-1 devstack@n-api.service[140492]: exception: Instance 8073b441-2650-4a77-9e97-9971a3f68282 could not be found. Oct 08 21:11:15.532518 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': '8073b441-2650-4a77-9e97-9971a3f68282'} Oct 08 21:11:15.532518 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:11:15.532518 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:11:15.532518 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:11:15.532518 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:11:15.532518 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:11:15.532518 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:11:15.532518 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:11:15.532518 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:11:15.532518 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:11:15.532518 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:11:15.532518 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8073b441-2650-4a77-9e97-9971a3f68282 could not be found. Oct 08 21:11:15.532518 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:11:15.532518 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:11:15.532518 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:11:15.532518 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:11:15.532518 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:11:15.532518 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:11:15.532518 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:11:15.532518 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:11:15.532518 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:11:15.532518 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:11:15.532518 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:11:15.532518 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:11:15.532518 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:11:15.532518 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:11:15.532518 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:11:15.532518 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:11:15.532518 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8073b441-2650-4a77-9e97-9971a3f68282 could not be found. Oct 08 21:11:15.532518 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:11:15.532518 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:11:15.532518 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:11:15.532518 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:11:15.537895 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:11:15.537895 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:11:15.537895 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:11:15.537895 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:11:15.537895 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8073b441-2650-4a77-9e97-9971a3f68282 could not be found. Oct 08 21:11:15.537895 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:11:15.539166 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-39706d8d-47b4-47cc-a745-61e33a58c6a5 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Returning 404 to user: Instance 8073b441-2650-4a77-9e97-9971a3f68282 could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:11:15.540332 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-39706d8d-47b4-47cc-a745-61e33a58c6a5 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "GET /compute/v2.1/servers/8073b441-2650-4a77-9e97-9971a3f68282" status: 404 len: 111 microversion: 2.1 time: 0.057774 Oct 08 21:11:15.541384 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2311/4554] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:11:15 2022] GET /compute/v2.1/servers/8073b441-2650-4a77-9e97-9971a3f68282 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:11:15.558798 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-0d96747a-653b-4f6d-8ef6-61016d9b3656 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Calling method '.version_select at 0x7f1a87c564c0>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:11:15.596213 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-0d96747a-653b-4f6d-8ef6-61016d9b3656 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] HTTP exception thrown: Image not found. Oct 08 21:11:15.598695 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-0d96747a-653b-4f6d-8ef6-61016d9b3656 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Request method failure captured: Oct 08 21:11:15.598695 ncdv-master-1 devstack@n-api.service[140492]: request: DELETE /compute/v2.1/images/d1ab381b-0750-4a51-94cf-a046a286aaa9 HTTP/1.1 Oct 08 21:11:15.598695 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:11:15.598695 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:11:15.598695 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:11:15.598695 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 21:11:15.598695 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:11:15.598695 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:11:15.598695 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:11:15.598695 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:11:15.598695 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeaSKTe_Fou7Tynsshq4jmA96ac0QjSnZl8MRkWeLpbYWo7KTncUdf4zi0sVQcp1BUvWwa3324gOKsN8j-gh8b_nnvj8r1lMZwi8XCtH19IX2ZuTfA5HsF6Wv6gsXu8d2xT7eLqAE--DUlL114RxDAcH3m1wEtiDfwOrDWDUhiesqmw Oct 08 21:11:15.598695 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:11:15.598695 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:11:15.598695 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:11:15.598695 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:11:15.598695 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:11:15.598695 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:11:15.598695 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 6bcd0e7c24154409824f96e9e99da357 Oct 08 21:11:15.598695 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-ImagesTestJSON-278094929 Oct 08 21:11:15.598695 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:11:15.598695 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:11:15.598695 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6bcd0e7c24154409824f96e9e99da357"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6bcd0e7c24154409824f96e9e99da357"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6bcd0e7c24154409824f96e9e99da357"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6bcd0e7c24154409824f96e9e99da357"}]}] Oct 08 21:11:15.598695 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-ImagesTestJSON-278094929 Oct 08 21:11:15.598695 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 6bcd0e7c24154409824f96e9e99da357 Oct 08 21:11:15.598695 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-ImagesTestJSON-278094929 Oct 08 21:11:15.598695 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-ImagesTestJSON-278094929-project Oct 08 21:11:15.598695 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:11:15.598695 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:11:15.598695 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 30fe0e1ffa1040ec85d3c32d8b741c75 Oct 08 21:11:15.598695 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-ImagesTestJSON-278094929-project Oct 08 21:11:15.598695 ncdv-master-1 devstack@n-api.service[140492]: method: Oct 08 21:11:15.598695 ncdv-master-1 devstack@n-api.service[140492]: exception: Image not found. Oct 08 21:11:15.598695 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': 'd1ab381b-0750-4a51-94cf-a046a286aaa9'} Oct 08 21:11:15.598695 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:11:15.598695 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:11:15.598695 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 08 21:11:15.598695 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 08 21:11:15.598695 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 08 21:11:15.598695 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 08 21:11:15.598695 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 08 21:11:15.598695 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 08 21:11:15.598695 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 08 21:11:15.598695 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 08 21:11:15.598695 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 08 21:11:15.598695 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 08 21:11:15.598695 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 08 21:11:15.598695 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 08 21:11:15.598695 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 08 21:11:15.598695 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 08 21:11:15.598695 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image d1ab381b-0750-4a51-94cf-a046a286aaa9 to delete Oct 08 21:11:15.598695 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:11:15.598695 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:11:15.598695 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:11:15.598695 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:11:15.598695 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 08 21:11:15.598695 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 08 21:11:15.598695 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 08 21:11:15.598695 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 08 21:11:15.598695 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 08 21:11:15.598695 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 08 21:11:15.598695 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image d1ab381b-0750-4a51-94cf-a046a286aaa9 could not be found. Oct 08 21:11:15.598695 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:11:15.598695 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:11:15.598695 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:11:15.598695 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:11:15.604598 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:11:15.604598 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:11:15.604598 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:11:15.604598 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:11:15.604598 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 08 21:11:15.604598 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 08 21:11:15.604598 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:11:15.604598 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:11:15.604598 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 08 21:11:15.604598 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 08 21:11:15.604598 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 08 21:11:15.604598 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:11:15.604598 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:11:15.604598 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:11:15.604598 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:11:15.604598 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:11:15.604598 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:11:15.604598 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:11:15.604598 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:11:15.604598 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 08 21:11:15.604598 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:11:15.604598 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-0d96747a-653b-4f6d-8ef6-61016d9b3656 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Returning 404 to user: Image not found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:11:15.604598 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-0d96747a-653b-4f6d-8ef6-61016d9b3656 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "DELETE /compute/v2.1/images/d1ab381b-0750-4a51-94cf-a046a286aaa9" status: 404 len: 62 microversion: 2.1 time: 0.045641 Oct 08 21:11:15.607091 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2312/4555] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:11:15 2022] DELETE /compute/v2.1/images/d1ab381b-0750-4a51-94cf-a046a286aaa9 => generated 62 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 08 21:11:15.622685 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-32010834-1bc2-4bc8-80fd-65dc69bd7730 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:11:15.623870 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-32010834-1bc2-4bc8-80fd-65dc69bd7730 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] [instance: 3fed4df9-92ff-4040-8fa7-db370960dc06] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:11:15.628071 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:11:15.639483 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-32010834-1bc2-4bc8-80fd-65dc69bd7730 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:15.640925 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-32010834-1bc2-4bc8-80fd-65dc69bd7730 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:15.641605 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-32010834-1bc2-4bc8-80fd-65dc69bd7730 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:15.647736 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-32010834-1bc2-4bc8-80fd-65dc69bd7730 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:15.649783 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-32010834-1bc2-4bc8-80fd-65dc69bd7730 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:15.650445 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-32010834-1bc2-4bc8-80fd-65dc69bd7730 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:15.691694 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-32010834-1bc2-4bc8-80fd-65dc69bd7730 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] HTTP exception thrown: Instance 3fed4df9-92ff-4040-8fa7-db370960dc06 could not be found. Oct 08 21:11:15.695147 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-32010834-1bc2-4bc8-80fd-65dc69bd7730 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Request method failure captured: Oct 08 21:11:15.695147 ncdv-master-1 devstack@n-api.service[140492]: request: DELETE /compute/v2.1/servers/3fed4df9-92ff-4040-8fa7-db370960dc06 HTTP/1.1 Oct 08 21:11:15.695147 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:11:15.695147 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:11:15.695147 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:11:15.695147 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 21:11:15.695147 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:11:15.695147 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:11:15.695147 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:11:15.695147 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:11:15.695147 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeaSKTe_Fou7Tynsshq4jmA96ac0QjSnZl8MRkWeLpbYWo7KTncUdf4zi0sVQcp1BUvWwa3324gOKsN8j-gh8b_nnvj8r1lMZwi8XCtH19IX2ZuTfA5HsF6Wv6gsXu8d2xT7eLqAE--DUlL114RxDAcH3m1wEtiDfwOrDWDUhiesqmw Oct 08 21:11:15.695147 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:11:15.695147 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:11:15.695147 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:11:15.695147 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:11:15.695147 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:11:15.695147 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:11:15.695147 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 6bcd0e7c24154409824f96e9e99da357 Oct 08 21:11:15.695147 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-ImagesTestJSON-278094929 Oct 08 21:11:15.695147 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:11:15.695147 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:11:15.695147 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6bcd0e7c24154409824f96e9e99da357"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6bcd0e7c24154409824f96e9e99da357"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6bcd0e7c24154409824f96e9e99da357"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6bcd0e7c24154409824f96e9e99da357"}]}] Oct 08 21:11:15.695147 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-ImagesTestJSON-278094929 Oct 08 21:11:15.695147 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 6bcd0e7c24154409824f96e9e99da357 Oct 08 21:11:15.695147 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-ImagesTestJSON-278094929 Oct 08 21:11:15.695147 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-ImagesTestJSON-278094929-project Oct 08 21:11:15.695147 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:11:15.695147 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:11:15.695147 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 30fe0e1ffa1040ec85d3c32d8b741c75 Oct 08 21:11:15.695147 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-ImagesTestJSON-278094929-project Oct 08 21:11:15.695147 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 21:11:15.695147 ncdv-master-1 devstack@n-api.service[140492]: exception: Instance 3fed4df9-92ff-4040-8fa7-db370960dc06 could not be found. Oct 08 21:11:15.695147 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': '3fed4df9-92ff-4040-8fa7-db370960dc06'} Oct 08 21:11:15.695147 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:11:15.695147 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:11:15.695147 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:11:15.695147 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:11:15.695147 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:11:15.695147 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:11:15.695147 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:11:15.695147 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:11:15.695147 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:11:15.695147 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:11:15.695147 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3fed4df9-92ff-4040-8fa7-db370960dc06 could not be found. Oct 08 21:11:15.695147 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:11:15.695147 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:11:15.695147 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:11:15.695147 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:11:15.695147 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:11:15.695147 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:11:15.695147 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:11:15.695147 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:11:15.695147 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:11:15.695147 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:11:15.695147 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 08 21:11:15.695147 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 08 21:11:15.695147 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 08 21:11:15.695147 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 08 21:11:15.695147 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:11:15.695147 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:11:15.695147 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:11:15.695147 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:11:15.695147 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3fed4df9-92ff-4040-8fa7-db370960dc06 could not be found. Oct 08 21:11:15.701781 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:11:15.701781 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:11:15.701781 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:11:15.701781 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:11:15.701781 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:11:15.701781 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:11:15.701781 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:11:15.701781 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:11:15.701781 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3fed4df9-92ff-4040-8fa7-db370960dc06 could not be found. Oct 08 21:11:15.701781 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:11:15.701781 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-32010834-1bc2-4bc8-80fd-65dc69bd7730 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Returning 404 to user: Instance 3fed4df9-92ff-4040-8fa7-db370960dc06 could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:11:15.705319 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-32010834-1bc2-4bc8-80fd-65dc69bd7730 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "DELETE /compute/v2.1/servers/3fed4df9-92ff-4040-8fa7-db370960dc06" status: 404 len: 111 microversion: 2.1 time: 0.095328 Oct 08 21:11:15.705929 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2313/4556] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:11:15 2022] DELETE /compute/v2.1/servers/3fed4df9-92ff-4040-8fa7-db370960dc06 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:11:15.720273 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-aefcf7c2-3158-4a12-a612-a82376e42e84 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:11:15.725853 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-aefcf7c2-3158-4a12-a612-a82376e42e84 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] [instance: 3fed4df9-92ff-4040-8fa7-db370960dc06] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:11:15.739999 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-aefcf7c2-3158-4a12-a612-a82376e42e84 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:15.742040 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-aefcf7c2-3158-4a12-a612-a82376e42e84 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:15.742854 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-aefcf7c2-3158-4a12-a612-a82376e42e84 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:15.743869 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-aefcf7c2-3158-4a12-a612-a82376e42e84 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:15.744574 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-aefcf7c2-3158-4a12-a612-a82376e42e84 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:15.745276 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-aefcf7c2-3158-4a12-a612-a82376e42e84 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:15.755233 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-4253b48d-ce98-4a44-bc71-b1e0a823f43d tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78e9afd772c4de981cac8f5817ec356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765c62cac2ee4406b23a5baa85c52ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:11:15.784960 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-aefcf7c2-3158-4a12-a612-a82376e42e84 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] HTTP exception thrown: Instance 3fed4df9-92ff-4040-8fa7-db370960dc06 could not be found. Oct 08 21:11:15.789916 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-4253b48d-ce98-4a44-bc71-b1e0a823f43d tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/82b72e20-b9e2-45ce-9362-b248f6d47bda" status: 200 len: 1510 microversion: 2.1 time: 0.449648 Oct 08 21:11:15.790801 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-aefcf7c2-3158-4a12-a612-a82376e42e84 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Request method failure captured: Oct 08 21:11:15.790801 ncdv-master-1 devstack@n-api.service[140492]: request: GET /compute/v2.1/servers/3fed4df9-92ff-4040-8fa7-db370960dc06 HTTP/1.1 Oct 08 21:11:15.790801 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:11:15.790801 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:11:15.790801 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:11:15.790801 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 21:11:15.790801 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:11:15.790801 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:11:15.790801 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:11:15.790801 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:11:15.790801 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeaSKTe_Fou7Tynsshq4jmA96ac0QjSnZl8MRkWeLpbYWo7KTncUdf4zi0sVQcp1BUvWwa3324gOKsN8j-gh8b_nnvj8r1lMZwi8XCtH19IX2ZuTfA5HsF6Wv6gsXu8d2xT7eLqAE--DUlL114RxDAcH3m1wEtiDfwOrDWDUhiesqmw Oct 08 21:11:15.790801 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:11:15.790801 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:11:15.790801 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:11:15.790801 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:11:15.790801 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:11:15.790801 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:11:15.790801 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 6bcd0e7c24154409824f96e9e99da357 Oct 08 21:11:15.790801 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-ImagesTestJSON-278094929 Oct 08 21:11:15.790801 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:11:15.790801 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:11:15.790801 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6bcd0e7c24154409824f96e9e99da357"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6bcd0e7c24154409824f96e9e99da357"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6bcd0e7c24154409824f96e9e99da357"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6bcd0e7c24154409824f96e9e99da357"}]}] Oct 08 21:11:15.790801 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-ImagesTestJSON-278094929 Oct 08 21:11:15.790801 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 6bcd0e7c24154409824f96e9e99da357 Oct 08 21:11:15.790801 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-ImagesTestJSON-278094929 Oct 08 21:11:15.790801 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-ImagesTestJSON-278094929-project Oct 08 21:11:15.790801 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:11:15.790801 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:11:15.790801 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 30fe0e1ffa1040ec85d3c32d8b741c75 Oct 08 21:11:15.790801 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-ImagesTestJSON-278094929-project Oct 08 21:11:15.790801 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 21:11:15.790801 ncdv-master-1 devstack@n-api.service[140492]: exception: Instance 3fed4df9-92ff-4040-8fa7-db370960dc06 could not be found. Oct 08 21:11:15.790801 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': '3fed4df9-92ff-4040-8fa7-db370960dc06'} Oct 08 21:11:15.790801 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:11:15.790801 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:11:15.790801 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:11:15.790801 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:11:15.790801 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:11:15.790801 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:11:15.790801 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:11:15.790801 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:11:15.790801 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:11:15.790801 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:11:15.790801 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3fed4df9-92ff-4040-8fa7-db370960dc06 could not be found. Oct 08 21:11:15.790801 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:11:15.790801 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:11:15.790801 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:11:15.790801 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:11:15.790801 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:11:15.790801 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:11:15.790801 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:11:15.790801 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:11:15.790801 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:11:15.790801 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:11:15.790801 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:11:15.790801 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:11:15.790801 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:11:15.790801 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:11:15.790801 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:11:15.790801 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:11:15.790801 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3fed4df9-92ff-4040-8fa7-db370960dc06 could not be found. Oct 08 21:11:15.790801 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:11:15.790801 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:11:15.790801 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:11:15.790801 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:11:15.795003 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:11:15.795003 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:11:15.795003 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:11:15.795003 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:11:15.795003 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3fed4df9-92ff-4040-8fa7-db370960dc06 could not be found. Oct 08 21:11:15.795003 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:11:15.795373 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2244/4557] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:11:15 2022] GET /compute/v2.1/servers/82b72e20-b9e2-45ce-9362-b248f6d47bda => generated 1510 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:11:15.801575 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-aefcf7c2-3158-4a12-a612-a82376e42e84 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Returning 404 to user: Instance 3fed4df9-92ff-4040-8fa7-db370960dc06 could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:11:15.802761 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-aefcf7c2-3158-4a12-a612-a82376e42e84 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "GET /compute/v2.1/servers/3fed4df9-92ff-4040-8fa7-db370960dc06" status: 404 len: 111 microversion: 2.1 time: 0.089854 Oct 08 21:11:15.805734 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2314/4558] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:11:15 2022] GET /compute/v2.1/servers/3fed4df9-92ff-4040-8fa7-db370960dc06 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:11:15.815000 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-4da6e0b3-86dd-4e72-98c1-24f18ea14fb1 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Calling method '.version_select at 0x7f1a8c638940>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:11:15.843063 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-4da6e0b3-86dd-4e72-98c1-24f18ea14fb1 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] HTTP exception thrown: Image not found. Oct 08 21:11:15.845045 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-4da6e0b3-86dd-4e72-98c1-24f18ea14fb1 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Request method failure captured: Oct 08 21:11:15.845045 ncdv-master-1 devstack@n-api.service[140491]: request: DELETE /compute/v2.1/images/ed86c272-4be6-4a44-bd79-2a964b0f06f7 HTTP/1.1 Oct 08 21:11:15.845045 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:11:15.845045 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:11:15.845045 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:11:15.845045 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 21:11:15.845045 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:11:15.845045 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:11:15.845045 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:11:15.845045 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:11:15.845045 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeaSKTe_Fou7Tynsshq4jmA96ac0QjSnZl8MRkWeLpbYWo7KTncUdf4zi0sVQcp1BUvWwa3324gOKsN8j-gh8b_nnvj8r1lMZwi8XCtH19IX2ZuTfA5HsF6Wv6gsXu8d2xT7eLqAE--DUlL114RxDAcH3m1wEtiDfwOrDWDUhiesqmw Oct 08 21:11:15.845045 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:11:15.845045 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:11:15.845045 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:11:15.845045 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:11:15.845045 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:11:15.845045 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:11:15.845045 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 6bcd0e7c24154409824f96e9e99da357 Oct 08 21:11:15.845045 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-ImagesTestJSON-278094929 Oct 08 21:11:15.845045 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:11:15.845045 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:11:15.845045 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6bcd0e7c24154409824f96e9e99da357"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6bcd0e7c24154409824f96e9e99da357"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6bcd0e7c24154409824f96e9e99da357"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6bcd0e7c24154409824f96e9e99da357"}]}] Oct 08 21:11:15.845045 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-ImagesTestJSON-278094929 Oct 08 21:11:15.845045 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 6bcd0e7c24154409824f96e9e99da357 Oct 08 21:11:15.845045 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-ImagesTestJSON-278094929 Oct 08 21:11:15.845045 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-ImagesTestJSON-278094929-project Oct 08 21:11:15.845045 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:11:15.845045 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:11:15.845045 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 30fe0e1ffa1040ec85d3c32d8b741c75 Oct 08 21:11:15.845045 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-ImagesTestJSON-278094929-project Oct 08 21:11:15.845045 ncdv-master-1 devstack@n-api.service[140491]: method: Oct 08 21:11:15.845045 ncdv-master-1 devstack@n-api.service[140491]: exception: Image not found. Oct 08 21:11:15.845045 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': 'ed86c272-4be6-4a44-bd79-2a964b0f06f7'} Oct 08 21:11:15.845045 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:11:15.845045 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:11:15.845045 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 08 21:11:15.845045 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 08 21:11:15.845045 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 08 21:11:15.845045 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 08 21:11:15.845045 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 08 21:11:15.845045 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 08 21:11:15.845045 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 08 21:11:15.845045 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 08 21:11:15.845045 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 08 21:11:15.845045 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 08 21:11:15.845045 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 08 21:11:15.845045 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 08 21:11:15.845045 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 08 21:11:15.845045 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 08 21:11:15.845045 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image ed86c272-4be6-4a44-bd79-2a964b0f06f7 to delete Oct 08 21:11:15.845045 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:11:15.845045 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:11:15.845045 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:11:15.845045 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:11:15.845045 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 08 21:11:15.845045 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 08 21:11:15.845045 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 08 21:11:15.845045 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 08 21:11:15.845045 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 08 21:11:15.845045 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 08 21:11:15.845045 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image ed86c272-4be6-4a44-bd79-2a964b0f06f7 could not be found. Oct 08 21:11:15.845045 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:11:15.845045 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:11:15.845045 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:11:15.845045 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:11:15.850515 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:11:15.850515 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:11:15.850515 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:11:15.850515 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:11:15.850515 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 08 21:11:15.850515 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 08 21:11:15.850515 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:11:15.850515 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:11:15.850515 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 08 21:11:15.850515 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 08 21:11:15.850515 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 08 21:11:15.850515 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:11:15.850515 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:11:15.850515 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:11:15.850515 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:11:15.850515 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:11:15.850515 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:11:15.850515 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:11:15.850515 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:11:15.850515 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 08 21:11:15.850515 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:11:15.850515 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-4da6e0b3-86dd-4e72-98c1-24f18ea14fb1 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Returning 404 to user: Image not found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:11:15.850515 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-4da6e0b3-86dd-4e72-98c1-24f18ea14fb1 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "DELETE /compute/v2.1/images/ed86c272-4be6-4a44-bd79-2a964b0f06f7" status: 404 len: 62 microversion: 2.1 time: 0.035456 Oct 08 21:11:15.853784 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2245/4559] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:11:15 2022] DELETE /compute/v2.1/images/ed86c272-4be6-4a44-bd79-2a964b0f06f7 => generated 62 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 08 21:11:15.860767 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-6014123a-3789-461c-97d2-fa35c3bd90ea tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:11:15.861398 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-6014123a-3789-461c-97d2-fa35c3bd90ea tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] [instance: b9e77bd1-3ce0-4f0a-b5ac-8c0ba6caffbb] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:11:15.871577 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6014123a-3789-461c-97d2-fa35c3bd90ea tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:15.872229 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6014123a-3789-461c-97d2-fa35c3bd90ea tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:15.875989 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6014123a-3789-461c-97d2-fa35c3bd90ea tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:15.878729 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6014123a-3789-461c-97d2-fa35c3bd90ea tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:15.884829 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6014123a-3789-461c-97d2-fa35c3bd90ea tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:15.885868 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6014123a-3789-461c-97d2-fa35c3bd90ea tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:15.923861 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-6014123a-3789-461c-97d2-fa35c3bd90ea tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] HTTP exception thrown: Instance b9e77bd1-3ce0-4f0a-b5ac-8c0ba6caffbb could not be found. Oct 08 21:11:15.929054 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-6014123a-3789-461c-97d2-fa35c3bd90ea tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Request method failure captured: Oct 08 21:11:15.929054 ncdv-master-1 devstack@n-api.service[140492]: request: DELETE /compute/v2.1/servers/b9e77bd1-3ce0-4f0a-b5ac-8c0ba6caffbb HTTP/1.1 Oct 08 21:11:15.929054 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:11:15.929054 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:11:15.929054 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:11:15.929054 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 21:11:15.929054 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:11:15.929054 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:11:15.929054 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:11:15.929054 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:11:15.929054 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeaSKTe_Fou7Tynsshq4jmA96ac0QjSnZl8MRkWeLpbYWo7KTncUdf4zi0sVQcp1BUvWwa3324gOKsN8j-gh8b_nnvj8r1lMZwi8XCtH19IX2ZuTfA5HsF6Wv6gsXu8d2xT7eLqAE--DUlL114RxDAcH3m1wEtiDfwOrDWDUhiesqmw Oct 08 21:11:15.929054 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:11:15.929054 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:11:15.929054 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:11:15.929054 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:11:15.929054 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:11:15.929054 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:11:15.929054 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 6bcd0e7c24154409824f96e9e99da357 Oct 08 21:11:15.929054 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-ImagesTestJSON-278094929 Oct 08 21:11:15.929054 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:11:15.929054 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:11:15.929054 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6bcd0e7c24154409824f96e9e99da357"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6bcd0e7c24154409824f96e9e99da357"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6bcd0e7c24154409824f96e9e99da357"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6bcd0e7c24154409824f96e9e99da357"}]}] Oct 08 21:11:15.929054 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-ImagesTestJSON-278094929 Oct 08 21:11:15.929054 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 6bcd0e7c24154409824f96e9e99da357 Oct 08 21:11:15.929054 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-ImagesTestJSON-278094929 Oct 08 21:11:15.929054 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-ImagesTestJSON-278094929-project Oct 08 21:11:15.929054 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:11:15.929054 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:11:15.929054 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 30fe0e1ffa1040ec85d3c32d8b741c75 Oct 08 21:11:15.929054 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-ImagesTestJSON-278094929-project Oct 08 21:11:15.929054 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 21:11:15.929054 ncdv-master-1 devstack@n-api.service[140492]: exception: Instance b9e77bd1-3ce0-4f0a-b5ac-8c0ba6caffbb could not be found. Oct 08 21:11:15.929054 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': 'b9e77bd1-3ce0-4f0a-b5ac-8c0ba6caffbb'} Oct 08 21:11:15.929054 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:11:15.929054 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:11:15.929054 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:11:15.929054 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:11:15.929054 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:11:15.929054 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:11:15.929054 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:11:15.929054 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:11:15.929054 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:11:15.929054 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:11:15.929054 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9e77bd1-3ce0-4f0a-b5ac-8c0ba6caffbb could not be found. Oct 08 21:11:15.929054 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:11:15.929054 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:11:15.929054 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:11:15.929054 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:11:15.929054 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:11:15.929054 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:11:15.929054 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:11:15.929054 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:11:15.929054 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:11:15.929054 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:11:15.929054 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 08 21:11:15.929054 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 08 21:11:15.929054 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 08 21:11:15.929054 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 08 21:11:15.929054 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:11:15.929054 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:11:15.929054 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:11:15.929054 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:11:15.929054 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9e77bd1-3ce0-4f0a-b5ac-8c0ba6caffbb could not be found. Oct 08 21:11:15.932998 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:11:15.932998 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:11:15.932998 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:11:15.932998 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:11:15.932998 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:11:15.932998 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:11:15.932998 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:11:15.932998 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:11:15.932998 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9e77bd1-3ce0-4f0a-b5ac-8c0ba6caffbb could not be found. Oct 08 21:11:15.932998 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:11:15.939527 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-6014123a-3789-461c-97d2-fa35c3bd90ea tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Returning 404 to user: Instance b9e77bd1-3ce0-4f0a-b5ac-8c0ba6caffbb could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:11:15.939988 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-6014123a-3789-461c-97d2-fa35c3bd90ea tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "DELETE /compute/v2.1/servers/b9e77bd1-3ce0-4f0a-b5ac-8c0ba6caffbb" status: 404 len: 111 microversion: 2.1 time: 0.085834 Oct 08 21:11:15.944778 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2315/4560] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:11:15 2022] DELETE /compute/v2.1/servers/b9e77bd1-3ce0-4f0a-b5ac-8c0ba6caffbb => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:11:15.951004 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-9525e1f1-7e29-43a4-a42f-4ce1492544e9 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:11:15.951641 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-9525e1f1-7e29-43a4-a42f-4ce1492544e9 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] [instance: b9e77bd1-3ce0-4f0a-b5ac-8c0ba6caffbb] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:11:15.967928 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9525e1f1-7e29-43a4-a42f-4ce1492544e9 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:15.968780 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9525e1f1-7e29-43a4-a42f-4ce1492544e9 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:15.969480 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9525e1f1-7e29-43a4-a42f-4ce1492544e9 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:15.970422 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9525e1f1-7e29-43a4-a42f-4ce1492544e9 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:15.971244 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9525e1f1-7e29-43a4-a42f-4ce1492544e9 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:15.972331 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9525e1f1-7e29-43a4-a42f-4ce1492544e9 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:15.994779 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-9525e1f1-7e29-43a4-a42f-4ce1492544e9 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] HTTP exception thrown: Instance b9e77bd1-3ce0-4f0a-b5ac-8c0ba6caffbb could not be found. Oct 08 21:11:15.996532 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-9525e1f1-7e29-43a4-a42f-4ce1492544e9 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Request method failure captured: Oct 08 21:11:15.996532 ncdv-master-1 devstack@n-api.service[140491]: request: GET /compute/v2.1/servers/b9e77bd1-3ce0-4f0a-b5ac-8c0ba6caffbb HTTP/1.1 Oct 08 21:11:15.996532 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:11:15.996532 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:11:15.996532 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:11:15.996532 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 21:11:15.996532 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:11:15.996532 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:11:15.996532 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:11:15.996532 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:11:15.996532 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeaSKTe_Fou7Tynsshq4jmA96ac0QjSnZl8MRkWeLpbYWo7KTncUdf4zi0sVQcp1BUvWwa3324gOKsN8j-gh8b_nnvj8r1lMZwi8XCtH19IX2ZuTfA5HsF6Wv6gsXu8d2xT7eLqAE--DUlL114RxDAcH3m1wEtiDfwOrDWDUhiesqmw Oct 08 21:11:15.996532 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:11:15.996532 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:11:15.996532 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:11:15.996532 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:11:15.996532 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:11:15.996532 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:11:15.996532 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 6bcd0e7c24154409824f96e9e99da357 Oct 08 21:11:15.996532 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-ImagesTestJSON-278094929 Oct 08 21:11:15.996532 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:11:15.996532 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:11:15.996532 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6bcd0e7c24154409824f96e9e99da357"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6bcd0e7c24154409824f96e9e99da357"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6bcd0e7c24154409824f96e9e99da357"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6bcd0e7c24154409824f96e9e99da357"}]}] Oct 08 21:11:15.996532 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-ImagesTestJSON-278094929 Oct 08 21:11:15.996532 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 6bcd0e7c24154409824f96e9e99da357 Oct 08 21:11:15.996532 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-ImagesTestJSON-278094929 Oct 08 21:11:15.996532 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-ImagesTestJSON-278094929-project Oct 08 21:11:15.996532 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:11:15.996532 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:11:15.996532 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 30fe0e1ffa1040ec85d3c32d8b741c75 Oct 08 21:11:15.996532 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-ImagesTestJSON-278094929-project Oct 08 21:11:15.996532 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:11:15.996532 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance b9e77bd1-3ce0-4f0a-b5ac-8c0ba6caffbb could not be found. Oct 08 21:11:15.996532 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': 'b9e77bd1-3ce0-4f0a-b5ac-8c0ba6caffbb'} Oct 08 21:11:15.996532 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:11:15.996532 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:11:15.996532 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:11:15.996532 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:11:15.996532 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:11:15.996532 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:11:15.996532 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:11:15.996532 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:11:15.996532 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:11:15.996532 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:11:15.996532 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9e77bd1-3ce0-4f0a-b5ac-8c0ba6caffbb could not be found. Oct 08 21:11:15.996532 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:11:15.996532 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:11:15.996532 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:11:15.996532 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:11:15.996532 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:11:15.996532 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:11:15.996532 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:11:15.996532 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:11:15.996532 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:11:15.996532 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:11:15.996532 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:11:15.996532 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:11:15.996532 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:11:15.996532 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:11:15.996532 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:11:15.996532 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:11:15.996532 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9e77bd1-3ce0-4f0a-b5ac-8c0ba6caffbb could not be found. Oct 08 21:11:15.996532 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:11:15.996532 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:11:15.996532 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:11:15.996532 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:11:16.001385 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:11:16.001385 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:11:16.001385 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:11:16.001385 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:11:16.001385 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9e77bd1-3ce0-4f0a-b5ac-8c0ba6caffbb could not be found. Oct 08 21:11:16.001385 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:11:16.001385 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-9525e1f1-7e29-43a4-a42f-4ce1492544e9 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Returning 404 to user: Instance b9e77bd1-3ce0-4f0a-b5ac-8c0ba6caffbb could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:11:16.002703 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-9525e1f1-7e29-43a4-a42f-4ce1492544e9 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "GET /compute/v2.1/servers/b9e77bd1-3ce0-4f0a-b5ac-8c0ba6caffbb" status: 404 len: 111 microversion: 2.1 time: 0.056296 Oct 08 21:11:16.003804 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2246/4561] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:11:15 2022] GET /compute/v2.1/servers/b9e77bd1-3ce0-4f0a-b5ac-8c0ba6caffbb => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:11:16.012932 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e0e93543-7014-43ef-82ba-d638534c7b50 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Calling method '.version_select at 0x7f1a87e70280>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:11:16.045976 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-e0e93543-7014-43ef-82ba-d638534c7b50 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] HTTP exception thrown: Image not found. Oct 08 21:11:16.047903 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e0e93543-7014-43ef-82ba-d638534c7b50 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Request method failure captured: Oct 08 21:11:16.047903 ncdv-master-1 devstack@n-api.service[140492]: request: DELETE /compute/v2.1/images/fa798238-0b05-4e9a-a4b3-2d47579804f6 HTTP/1.1 Oct 08 21:11:16.047903 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:11:16.047903 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:11:16.047903 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:11:16.047903 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 21:11:16.047903 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:11:16.047903 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:11:16.047903 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:11:16.047903 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:11:16.047903 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeaSKTe_Fou7Tynsshq4jmA96ac0QjSnZl8MRkWeLpbYWo7KTncUdf4zi0sVQcp1BUvWwa3324gOKsN8j-gh8b_nnvj8r1lMZwi8XCtH19IX2ZuTfA5HsF6Wv6gsXu8d2xT7eLqAE--DUlL114RxDAcH3m1wEtiDfwOrDWDUhiesqmw Oct 08 21:11:16.047903 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:11:16.047903 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:11:16.047903 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:11:16.047903 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:11:16.047903 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:11:16.047903 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:11:16.047903 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 6bcd0e7c24154409824f96e9e99da357 Oct 08 21:11:16.047903 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-ImagesTestJSON-278094929 Oct 08 21:11:16.047903 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:11:16.047903 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:11:16.047903 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6bcd0e7c24154409824f96e9e99da357"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6bcd0e7c24154409824f96e9e99da357"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6bcd0e7c24154409824f96e9e99da357"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6bcd0e7c24154409824f96e9e99da357"}]}] Oct 08 21:11:16.047903 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-ImagesTestJSON-278094929 Oct 08 21:11:16.047903 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 6bcd0e7c24154409824f96e9e99da357 Oct 08 21:11:16.047903 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-ImagesTestJSON-278094929 Oct 08 21:11:16.047903 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-ImagesTestJSON-278094929-project Oct 08 21:11:16.047903 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:11:16.047903 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:11:16.047903 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 30fe0e1ffa1040ec85d3c32d8b741c75 Oct 08 21:11:16.047903 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-ImagesTestJSON-278094929-project Oct 08 21:11:16.047903 ncdv-master-1 devstack@n-api.service[140492]: method: Oct 08 21:11:16.047903 ncdv-master-1 devstack@n-api.service[140492]: exception: Image not found. Oct 08 21:11:16.047903 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': 'fa798238-0b05-4e9a-a4b3-2d47579804f6'} Oct 08 21:11:16.047903 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:11:16.047903 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:11:16.047903 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 08 21:11:16.047903 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 08 21:11:16.047903 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 08 21:11:16.047903 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 08 21:11:16.047903 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 08 21:11:16.047903 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 08 21:11:16.047903 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 08 21:11:16.047903 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 08 21:11:16.047903 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 08 21:11:16.047903 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 08 21:11:16.047903 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 08 21:11:16.047903 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 08 21:11:16.047903 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 08 21:11:16.047903 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 08 21:11:16.047903 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image fa798238-0b05-4e9a-a4b3-2d47579804f6 to delete Oct 08 21:11:16.047903 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:11:16.047903 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:11:16.047903 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:11:16.047903 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:11:16.047903 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 08 21:11:16.047903 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 08 21:11:16.047903 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 08 21:11:16.047903 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 08 21:11:16.047903 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 08 21:11:16.047903 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 08 21:11:16.047903 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image fa798238-0b05-4e9a-a4b3-2d47579804f6 could not be found. Oct 08 21:11:16.047903 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:11:16.047903 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:11:16.047903 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:11:16.047903 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:11:16.052451 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:11:16.052451 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:11:16.052451 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:11:16.052451 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:11:16.052451 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 08 21:11:16.052451 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 08 21:11:16.052451 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:11:16.052451 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:11:16.052451 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 08 21:11:16.052451 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 08 21:11:16.052451 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 08 21:11:16.052451 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:11:16.052451 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:11:16.052451 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:11:16.052451 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:11:16.052451 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:11:16.052451 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:11:16.052451 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:11:16.052451 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:11:16.052451 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 08 21:11:16.052451 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:11:16.052451 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e0e93543-7014-43ef-82ba-d638534c7b50 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Returning 404 to user: Image not found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:11:16.052451 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-e0e93543-7014-43ef-82ba-d638534c7b50 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "DELETE /compute/v2.1/images/fa798238-0b05-4e9a-a4b3-2d47579804f6" status: 404 len: 62 microversion: 2.1 time: 0.042359 Oct 08 21:11:16.052451 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2316/4562] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:11:16 2022] DELETE /compute/v2.1/images/fa798238-0b05-4e9a-a4b3-2d47579804f6 => generated 62 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 08 21:11:16.060783 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-23685973-452a-4e67-bc89-824d66436eb4 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:11:16.061537 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-23685973-452a-4e67-bc89-824d66436eb4 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] [instance: f1b4faf3-0c03-4e0c-be81-be3305b8314f] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:11:16.070608 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-23685973-452a-4e67-bc89-824d66436eb4 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:16.075751 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-23685973-452a-4e67-bc89-824d66436eb4 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:16.076214 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-23685973-452a-4e67-bc89-824d66436eb4 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:16.076988 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-23685973-452a-4e67-bc89-824d66436eb4 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:16.078148 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-23685973-452a-4e67-bc89-824d66436eb4 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:16.078148 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-23685973-452a-4e67-bc89-824d66436eb4 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:16.128842 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-23685973-452a-4e67-bc89-824d66436eb4 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] HTTP exception thrown: Instance f1b4faf3-0c03-4e0c-be81-be3305b8314f could not be found. Oct 08 21:11:16.134875 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-23685973-452a-4e67-bc89-824d66436eb4 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Request method failure captured: Oct 08 21:11:16.134875 ncdv-master-1 devstack@n-api.service[140491]: request: DELETE /compute/v2.1/servers/f1b4faf3-0c03-4e0c-be81-be3305b8314f HTTP/1.1 Oct 08 21:11:16.134875 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:11:16.134875 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:11:16.134875 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:11:16.134875 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 21:11:16.134875 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:11:16.134875 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:11:16.134875 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:11:16.134875 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:11:16.134875 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeaSKTe_Fou7Tynsshq4jmA96ac0QjSnZl8MRkWeLpbYWo7KTncUdf4zi0sVQcp1BUvWwa3324gOKsN8j-gh8b_nnvj8r1lMZwi8XCtH19IX2ZuTfA5HsF6Wv6gsXu8d2xT7eLqAE--DUlL114RxDAcH3m1wEtiDfwOrDWDUhiesqmw Oct 08 21:11:16.134875 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:11:16.134875 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:11:16.134875 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:11:16.134875 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:11:16.134875 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:11:16.134875 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:11:16.134875 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 6bcd0e7c24154409824f96e9e99da357 Oct 08 21:11:16.134875 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-ImagesTestJSON-278094929 Oct 08 21:11:16.134875 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:11:16.134875 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:11:16.134875 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6bcd0e7c24154409824f96e9e99da357"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6bcd0e7c24154409824f96e9e99da357"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6bcd0e7c24154409824f96e9e99da357"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6bcd0e7c24154409824f96e9e99da357"}]}] Oct 08 21:11:16.134875 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-ImagesTestJSON-278094929 Oct 08 21:11:16.134875 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 6bcd0e7c24154409824f96e9e99da357 Oct 08 21:11:16.134875 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-ImagesTestJSON-278094929 Oct 08 21:11:16.134875 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-ImagesTestJSON-278094929-project Oct 08 21:11:16.134875 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:11:16.134875 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:11:16.134875 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 30fe0e1ffa1040ec85d3c32d8b741c75 Oct 08 21:11:16.134875 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-ImagesTestJSON-278094929-project Oct 08 21:11:16.134875 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:11:16.134875 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance f1b4faf3-0c03-4e0c-be81-be3305b8314f could not be found. Oct 08 21:11:16.134875 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': 'f1b4faf3-0c03-4e0c-be81-be3305b8314f'} Oct 08 21:11:16.134875 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:11:16.134875 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:11:16.134875 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:11:16.134875 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:11:16.134875 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:11:16.134875 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:11:16.134875 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:11:16.134875 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:11:16.134875 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:11:16.134875 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:11:16.134875 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1b4faf3-0c03-4e0c-be81-be3305b8314f could not be found. Oct 08 21:11:16.134875 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:11:16.134875 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:11:16.134875 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:11:16.134875 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:11:16.134875 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:11:16.134875 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:11:16.134875 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:11:16.134875 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:11:16.134875 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:11:16.134875 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:11:16.134875 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 08 21:11:16.134875 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 08 21:11:16.134875 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 08 21:11:16.134875 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 08 21:11:16.134875 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:11:16.134875 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:11:16.134875 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:11:16.134875 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:11:16.134875 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1b4faf3-0c03-4e0c-be81-be3305b8314f could not be found. Oct 08 21:11:16.139016 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:11:16.139016 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:11:16.139016 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:11:16.139016 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:11:16.139016 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:11:16.139016 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:11:16.139016 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:11:16.139016 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:11:16.139016 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1b4faf3-0c03-4e0c-be81-be3305b8314f could not be found. Oct 08 21:11:16.139016 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:11:16.139016 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-23685973-452a-4e67-bc89-824d66436eb4 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Returning 404 to user: Instance f1b4faf3-0c03-4e0c-be81-be3305b8314f could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:11:16.139016 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-23685973-452a-4e67-bc89-824d66436eb4 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "DELETE /compute/v2.1/servers/f1b4faf3-0c03-4e0c-be81-be3305b8314f" status: 404 len: 111 microversion: 2.1 time: 0.081646 Oct 08 21:11:16.139801 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2247/4563] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:11:16 2022] DELETE /compute/v2.1/servers/f1b4faf3-0c03-4e0c-be81-be3305b8314f => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:11:16.149403 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-6ad21270-d29b-4d9d-9b16-90882c651ab8 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:11:16.150339 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-6ad21270-d29b-4d9d-9b16-90882c651ab8 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] [instance: f1b4faf3-0c03-4e0c-be81-be3305b8314f] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:11:16.164292 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6ad21270-d29b-4d9d-9b16-90882c651ab8 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:16.165699 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6ad21270-d29b-4d9d-9b16-90882c651ab8 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:16.168008 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6ad21270-d29b-4d9d-9b16-90882c651ab8 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:16.169799 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6ad21270-d29b-4d9d-9b16-90882c651ab8 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:16.170263 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6ad21270-d29b-4d9d-9b16-90882c651ab8 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:16.172448 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6ad21270-d29b-4d9d-9b16-90882c651ab8 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:16.205305 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-6ad21270-d29b-4d9d-9b16-90882c651ab8 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] HTTP exception thrown: Instance f1b4faf3-0c03-4e0c-be81-be3305b8314f could not be found. Oct 08 21:11:16.209237 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-6ad21270-d29b-4d9d-9b16-90882c651ab8 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Request method failure captured: Oct 08 21:11:16.209237 ncdv-master-1 devstack@n-api.service[140492]: request: GET /compute/v2.1/servers/f1b4faf3-0c03-4e0c-be81-be3305b8314f HTTP/1.1 Oct 08 21:11:16.209237 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:11:16.209237 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:11:16.209237 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:11:16.209237 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 21:11:16.209237 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:11:16.209237 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:11:16.209237 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:11:16.209237 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:11:16.209237 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeaSKTe_Fou7Tynsshq4jmA96ac0QjSnZl8MRkWeLpbYWo7KTncUdf4zi0sVQcp1BUvWwa3324gOKsN8j-gh8b_nnvj8r1lMZwi8XCtH19IX2ZuTfA5HsF6Wv6gsXu8d2xT7eLqAE--DUlL114RxDAcH3m1wEtiDfwOrDWDUhiesqmw Oct 08 21:11:16.209237 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:11:16.209237 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:11:16.209237 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:11:16.209237 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:11:16.209237 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:11:16.209237 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:11:16.209237 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 6bcd0e7c24154409824f96e9e99da357 Oct 08 21:11:16.209237 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-ImagesTestJSON-278094929 Oct 08 21:11:16.209237 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:11:16.209237 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:11:16.209237 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6bcd0e7c24154409824f96e9e99da357"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6bcd0e7c24154409824f96e9e99da357"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6bcd0e7c24154409824f96e9e99da357"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6bcd0e7c24154409824f96e9e99da357"}]}] Oct 08 21:11:16.209237 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-ImagesTestJSON-278094929 Oct 08 21:11:16.209237 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 6bcd0e7c24154409824f96e9e99da357 Oct 08 21:11:16.209237 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-ImagesTestJSON-278094929 Oct 08 21:11:16.209237 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-ImagesTestJSON-278094929-project Oct 08 21:11:16.209237 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:11:16.209237 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:11:16.209237 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 30fe0e1ffa1040ec85d3c32d8b741c75 Oct 08 21:11:16.209237 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-ImagesTestJSON-278094929-project Oct 08 21:11:16.209237 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 21:11:16.209237 ncdv-master-1 devstack@n-api.service[140492]: exception: Instance f1b4faf3-0c03-4e0c-be81-be3305b8314f could not be found. Oct 08 21:11:16.209237 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': 'f1b4faf3-0c03-4e0c-be81-be3305b8314f'} Oct 08 21:11:16.209237 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:11:16.209237 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:11:16.209237 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:11:16.209237 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:11:16.209237 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:11:16.209237 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:11:16.209237 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:11:16.209237 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:11:16.209237 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:11:16.209237 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:11:16.209237 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1b4faf3-0c03-4e0c-be81-be3305b8314f could not be found. Oct 08 21:11:16.209237 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:11:16.209237 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:11:16.209237 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:11:16.209237 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:11:16.209237 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:11:16.209237 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:11:16.209237 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:11:16.209237 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:11:16.209237 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:11:16.209237 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:11:16.209237 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:11:16.209237 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:11:16.209237 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:11:16.209237 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:11:16.209237 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:11:16.209237 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:11:16.209237 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1b4faf3-0c03-4e0c-be81-be3305b8314f could not be found. Oct 08 21:11:16.209237 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:11:16.209237 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:11:16.209237 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:11:16.209237 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:11:16.214064 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:11:16.214064 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:11:16.214064 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:11:16.214064 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:11:16.214064 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1b4faf3-0c03-4e0c-be81-be3305b8314f could not be found. Oct 08 21:11:16.214064 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:11:16.218197 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-6ad21270-d29b-4d9d-9b16-90882c651ab8 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] Returning 404 to user: Instance f1b4faf3-0c03-4e0c-be81-be3305b8314f could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:11:16.219937 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-6ad21270-d29b-4d9d-9b16-90882c651ab8 tempest-ImagesTestJSON-278094929 tempest-ImagesTestJSON-278094929-project] 10.222.0.26 "GET /compute/v2.1/servers/f1b4faf3-0c03-4e0c-be81-be3305b8314f" status: 404 len: 111 microversion: 2.1 time: 0.075764 Oct 08 21:11:16.226230 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2317/4564] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:11:16 2022] GET /compute/v2.1/servers/f1b4faf3-0c03-4e0c-be81-be3305b8314f => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:11:16.352894 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-fdb80155-6697-43ec-85ea-047531a21a88 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:11:16.354863 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-fdb80155-6697-43ec-85ea-047531a21a88 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:11:16.371812 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fdb80155-6697-43ec-85ea-047531a21a88 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:16.372583 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fdb80155-6697-43ec-85ea-047531a21a88 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:16.373245 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fdb80155-6697-43ec-85ea-047531a21a88 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:16.374201 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fdb80155-6697-43ec-85ea-047531a21a88 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:16.375535 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fdb80155-6697-43ec-85ea-047531a21a88 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:16.377277 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fdb80155-6697-43ec-85ea-047531a21a88 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:16.779598 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-fdb80155-6697-43ec-85ea-047531a21a88 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:11:16.788687 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-fdb80155-6697-43ec-85ea-047531a21a88 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 200 len: 1525 microversion: 2.1 time: 0.440532 Oct 08 21:11:16.802058 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2248/4565] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:11:16 2022] GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 1525 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:11:16.816529 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-0fd97569-5ebe-48e4-9bd1-37f885fdee7b tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:11:16.817163 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-0fd97569-5ebe-48e4-9bd1-37f885fdee7b tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: 82b72e20-b9e2-45ce-9362-b248f6d47bda] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:11:16.828848 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0fd97569-5ebe-48e4-9bd1-37f885fdee7b tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:16.829334 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0fd97569-5ebe-48e4-9bd1-37f885fdee7b tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:16.830047 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0fd97569-5ebe-48e4-9bd1-37f885fdee7b tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:16.831027 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0fd97569-5ebe-48e4-9bd1-37f885fdee7b tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:16.831864 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0fd97569-5ebe-48e4-9bd1-37f885fdee7b tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:16.832380 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0fd97569-5ebe-48e4-9bd1-37f885fdee7b tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:17.269984 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-0fd97569-5ebe-48e4-9bd1-37f885fdee7b tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78e9afd772c4de981cac8f5817ec356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765c62cac2ee4406b23a5baa85c52ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:11:17.279325 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-0fd97569-5ebe-48e4-9bd1-37f885fdee7b tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/82b72e20-b9e2-45ce-9362-b248f6d47bda" status: 200 len: 1510 microversion: 2.1 time: 0.468328 Oct 08 21:11:17.282243 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2318/4566] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:11:16 2022] GET /compute/v2.1/servers/82b72e20-b9e2-45ce-9362-b248f6d47bda => generated 1510 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:11:17.817691 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-7e904b00-9f88-4c7e-8c92-55d2fcaabdca tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:11:17.820223 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-7e904b00-9f88-4c7e-8c92-55d2fcaabdca tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:11:17.830138 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7e904b00-9f88-4c7e-8c92-55d2fcaabdca tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:17.831012 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7e904b00-9f88-4c7e-8c92-55d2fcaabdca tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:17.831478 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7e904b00-9f88-4c7e-8c92-55d2fcaabdca tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:17.832392 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7e904b00-9f88-4c7e-8c92-55d2fcaabdca tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:17.835270 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7e904b00-9f88-4c7e-8c92-55d2fcaabdca tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:17.836085 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7e904b00-9f88-4c7e-8c92-55d2fcaabdca tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:18.173833 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-7e904b00-9f88-4c7e-8c92-55d2fcaabdca tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:11:18.184017 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-7e904b00-9f88-4c7e-8c92-55d2fcaabdca tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 200 len: 1507 microversion: 2.1 time: 0.373374 Oct 08 21:11:18.207643 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2249/4567] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:11:17 2022] GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 1507 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:11:18.310756 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-eb151d42-f2ee-4457-bf9f-3332d94c2314 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:11:18.312128 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-eb151d42-f2ee-4457-bf9f-3332d94c2314 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: 82b72e20-b9e2-45ce-9362-b248f6d47bda] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:11:18.335771 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-eb151d42-f2ee-4457-bf9f-3332d94c2314 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:18.336592 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-eb151d42-f2ee-4457-bf9f-3332d94c2314 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:18.337565 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-eb151d42-f2ee-4457-bf9f-3332d94c2314 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:18.338821 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-eb151d42-f2ee-4457-bf9f-3332d94c2314 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:18.339512 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-eb151d42-f2ee-4457-bf9f-3332d94c2314 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:18.340189 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-eb151d42-f2ee-4457-bf9f-3332d94c2314 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:18.860794 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-eb151d42-f2ee-4457-bf9f-3332d94c2314 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78e9afd772c4de981cac8f5817ec356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765c62cac2ee4406b23a5baa85c52ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:11:18.882412 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-eb151d42-f2ee-4457-bf9f-3332d94c2314 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/82b72e20-b9e2-45ce-9362-b248f6d47bda" status: 200 len: 1510 microversion: 2.1 time: 0.578977 Oct 08 21:11:18.883224 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2319/4568] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:11:18 2022] GET /compute/v2.1/servers/82b72e20-b9e2-45ce-9362-b248f6d47bda => generated 1510 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:11:19.211647 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-d8dfc75a-8983-49de-8aa8-062d17bdef49 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:11:19.212853 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-d8dfc75a-8983-49de-8aa8-062d17bdef49 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:11:19.221132 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d8dfc75a-8983-49de-8aa8-062d17bdef49 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:19.221838 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d8dfc75a-8983-49de-8aa8-062d17bdef49 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:19.222437 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d8dfc75a-8983-49de-8aa8-062d17bdef49 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:19.226103 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d8dfc75a-8983-49de-8aa8-062d17bdef49 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:19.228421 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d8dfc75a-8983-49de-8aa8-062d17bdef49 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:19.229027 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d8dfc75a-8983-49de-8aa8-062d17bdef49 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:19.518675 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-d8dfc75a-8983-49de-8aa8-062d17bdef49 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:11:19.541629 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-d8dfc75a-8983-49de-8aa8-062d17bdef49 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 200 len: 1507 microversion: 2.1 time: 0.334326 Oct 08 21:11:19.543820 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2250/4569] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:11:19 2022] GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 1507 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:11:19.907424 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-fa3e93f8-dc48-4ad4-90ef-25fca2a05e0d tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:11:19.908050 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-fa3e93f8-dc48-4ad4-90ef-25fca2a05e0d tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: 82b72e20-b9e2-45ce-9362-b248f6d47bda] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:11:19.918316 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fa3e93f8-dc48-4ad4-90ef-25fca2a05e0d tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:19.922202 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fa3e93f8-dc48-4ad4-90ef-25fca2a05e0d tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:19.922921 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fa3e93f8-dc48-4ad4-90ef-25fca2a05e0d tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:19.925043 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fa3e93f8-dc48-4ad4-90ef-25fca2a05e0d tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:19.937607 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fa3e93f8-dc48-4ad4-90ef-25fca2a05e0d tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:19.938091 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fa3e93f8-dc48-4ad4-90ef-25fca2a05e0d tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:20.570026 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-5d826fa0-a74d-4f80-85c1-b0db2a9ae96d tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:11:20.571215 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-5d826fa0-a74d-4f80-85c1-b0db2a9ae96d tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:11:20.588956 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5d826fa0-a74d-4f80-85c1-b0db2a9ae96d tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:20.589946 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5d826fa0-a74d-4f80-85c1-b0db2a9ae96d tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:20.589946 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5d826fa0-a74d-4f80-85c1-b0db2a9ae96d tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:20.590679 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5d826fa0-a74d-4f80-85c1-b0db2a9ae96d tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:20.591172 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5d826fa0-a74d-4f80-85c1-b0db2a9ae96d tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:20.591533 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5d826fa0-a74d-4f80-85c1-b0db2a9ae96d tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:20.634652 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-fa3e93f8-dc48-4ad4-90ef-25fca2a05e0d tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78e9afd772c4de981cac8f5817ec356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765c62cac2ee4406b23a5baa85c52ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:11:20.644160 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-fa3e93f8-dc48-4ad4-90ef-25fca2a05e0d tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/82b72e20-b9e2-45ce-9362-b248f6d47bda" status: 200 len: 1510 microversion: 2.1 time: 0.740531 Oct 08 21:11:20.651400 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2320/4570] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:11:19 2022] GET /compute/v2.1/servers/82b72e20-b9e2-45ce-9362-b248f6d47bda => generated 1510 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:11:21.102558 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-ad968f38-bb5e-4b5a-96b4-4f04ca022437 req-dd3f1149-4cf7-409e-96de-d095cac20210 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2548207-aa57-4e4c-876b-2027b59283d2", "name": "network-vif-unplugged", "status": "completed", "tag": "1900770b-2820-49c0-af24-1c780eb5f1e0"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:11:21.124969 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-ad968f38-bb5e-4b5a-96b4-4f04ca022437 req-dd3f1149-4cf7-409e-96de-d095cac20210 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:21.124969 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-ad968f38-bb5e-4b5a-96b4-4f04ca022437 req-dd3f1149-4cf7-409e-96de-d095cac20210 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:21.124969 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-ad968f38-bb5e-4b5a-96b4-4f04ca022437 req-dd3f1149-4cf7-409e-96de-d095cac20210 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:21.152248 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-ad968f38-bb5e-4b5a-96b4-4f04ca022437 req-dd3f1149-4cf7-409e-96de-d095cac20210 service nova] Creating event network-vif-unplugged:1900770b-2820-49c0-af24-1c780eb5f1e0 for instance e2548207-aa57-4e4c-876b-2027b59283d2 on nch2-master-1 Oct 08 21:11:21.163195 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-5d826fa0-a74d-4f80-85c1-b0db2a9ae96d tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:11:21.163528 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-ad968f38-bb5e-4b5a-96b4-4f04ca022437 req-dd3f1149-4cf7-409e-96de-d095cac20210 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.064531 Oct 08 21:11:21.164157 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2321/4571] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:11:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 08 21:11:21.179414 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-5d826fa0-a74d-4f80-85c1-b0db2a9ae96d tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 200 len: 1507 microversion: 2.1 time: 0.613186 Oct 08 21:11:21.180011 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2251/4572] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:11:20 2022] GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 1507 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:11:21.679219 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-2b55710b-5601-483c-bbae-0bc1b3f0761f tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:11:21.680248 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-2b55710b-5601-483c-bbae-0bc1b3f0761f tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: 82b72e20-b9e2-45ce-9362-b248f6d47bda] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:11:21.696512 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2b55710b-5601-483c-bbae-0bc1b3f0761f tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:21.697037 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2b55710b-5601-483c-bbae-0bc1b3f0761f tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:21.697527 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2b55710b-5601-483c-bbae-0bc1b3f0761f tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:21.698330 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2b55710b-5601-483c-bbae-0bc1b3f0761f tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:21.698809 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2b55710b-5601-483c-bbae-0bc1b3f0761f tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:21.699252 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2b55710b-5601-483c-bbae-0bc1b3f0761f tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:22.106533 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-2b55710b-5601-483c-bbae-0bc1b3f0761f tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78e9afd772c4de981cac8f5817ec356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765c62cac2ee4406b23a5baa85c52ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:11:22.137236 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-2b55710b-5601-483c-bbae-0bc1b3f0761f tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/82b72e20-b9e2-45ce-9362-b248f6d47bda" status: 200 len: 1510 microversion: 2.1 time: 0.462433 Oct 08 21:11:22.153456 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2322/4573] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:11:21 2022] GET /compute/v2.1/servers/82b72e20-b9e2-45ce-9362-b248f6d47bda => generated 1510 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:11:22.207719 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-8274e680-6f0a-4a35-aa63-25431e544e3b tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:11:22.208943 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-8274e680-6f0a-4a35-aa63-25431e544e3b tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:11:22.220593 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8274e680-6f0a-4a35-aa63-25431e544e3b tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:22.220742 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8274e680-6f0a-4a35-aa63-25431e544e3b tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:22.221147 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8274e680-6f0a-4a35-aa63-25431e544e3b tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:22.237568 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8274e680-6f0a-4a35-aa63-25431e544e3b tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:22.238067 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8274e680-6f0a-4a35-aa63-25431e544e3b tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:22.238519 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8274e680-6f0a-4a35-aa63-25431e544e3b tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:22.675165 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-8274e680-6f0a-4a35-aa63-25431e544e3b tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:11:22.688588 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-8274e680-6f0a-4a35-aa63-25431e544e3b tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 200 len: 1450 microversion: 2.1 time: 0.484931 Oct 08 21:11:22.691820 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2252/4574] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:11:22 2022] GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 1450 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:11:22.716384 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-0fbbbe36-bc16-4c33-819c-8e2c91f08162 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:11:22.717051 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-0fbbbe36-bc16-4c33-819c-8e2c91f08162 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:11:22.728145 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0fbbbe36-bc16-4c33-819c-8e2c91f08162 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:22.730788 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0fbbbe36-bc16-4c33-819c-8e2c91f08162 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:22.731496 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0fbbbe36-bc16-4c33-819c-8e2c91f08162 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:22.732433 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0fbbbe36-bc16-4c33-819c-8e2c91f08162 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:22.735079 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0fbbbe36-bc16-4c33-819c-8e2c91f08162 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:22.735733 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0fbbbe36-bc16-4c33-819c-8e2c91f08162 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:23.060552 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-0fbbbe36-bc16-4c33-819c-8e2c91f08162 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:11:23.069133 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-0fbbbe36-bc16-4c33-819c-8e2c91f08162 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 200 len: 1450 microversion: 2.1 time: 0.357113 Oct 08 21:11:23.074694 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2323/4575] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:11:22 2022] GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 1450 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:11:23.167462 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-7ae1cd9b-a7cd-4c6d-9307-5e264b661647 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:11:23.171934 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c63e5eca-c662-4127-9ddd-09e65e990092 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:11:23.172970 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-c63e5eca-c662-4127-9ddd-09e65e990092 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: 82b72e20-b9e2-45ce-9362-b248f6d47bda] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:11:23.173994 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-7ae1cd9b-a7cd-4c6d-9307-5e264b661647 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:11:23.193145 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7ae1cd9b-a7cd-4c6d-9307-5e264b661647 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:23.193718 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c63e5eca-c662-4127-9ddd-09e65e990092 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:23.196027 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c63e5eca-c662-4127-9ddd-09e65e990092 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:23.196735 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c63e5eca-c662-4127-9ddd-09e65e990092 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:23.198406 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7ae1cd9b-a7cd-4c6d-9307-5e264b661647 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:23.199410 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c63e5eca-c662-4127-9ddd-09e65e990092 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:23.200468 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7ae1cd9b-a7cd-4c6d-9307-5e264b661647 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:23.201622 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c63e5eca-c662-4127-9ddd-09e65e990092 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:23.202639 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7ae1cd9b-a7cd-4c6d-9307-5e264b661647 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:23.203113 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c63e5eca-c662-4127-9ddd-09e65e990092 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:23.204894 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7ae1cd9b-a7cd-4c6d-9307-5e264b661647 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:23.206117 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7ae1cd9b-a7cd-4c6d-9307-5e264b661647 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:23.279165 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.objects.instance [None req-7ae1cd9b-a7cd-4c6d-9307-5e264b661647 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lazy-loading 'flavor' on Instance uuid e2548207-aa57-4e4c-876b-2027b59283d2 {{(pid=140492) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 21:11:23.326598 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-7ae1cd9b-a7cd-4c6d-9307-5e264b661647 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] HTTP exception thrown: Cannot 'shelve' instance e2548207-aa57-4e4c-876b-2027b59283d2 while it is in vm_state shelved_offloaded Oct 08 21:11:23.333057 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-7ae1cd9b-a7cd-4c6d-9307-5e264b661647 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Request method failure captured: Oct 08 21:11:23.333057 ncdv-master-1 devstack@n-api.service[140492]: request: POST /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2/action HTTP/1.1 Oct 08 21:11:23.333057 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:11:23.333057 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:11:23.333057 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:11:23.333057 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 14 Oct 08 21:11:23.333057 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:11:23.333057 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:11:23.333057 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:11:23.333057 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:11:23.333057 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQebW09Z3m936-d3SrnQA9UQ3KXQvUYeQwL43ufWdoxmQhUwYBWv-JT053t_VYPo9wAVRoCqYQy8Hhh8zc2n570KpS0qNVLik822FjYabkSIZMA_ubWypXzSwo3J04zV1MoSSz79D-b8-ZvwYCEIbwpbfyn5opgOjnO6EXvq1UNPaSyQ Oct 08 21:11:23.333057 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:11:23.333057 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:11:23.333057 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:11:23.333057 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:11:23.333057 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:11:23.333057 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:11:23.333057 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 0ae02675057e4f27bc1980348afc8ca1 Oct 08 21:11:23.333057 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-ServersNegativeTestJSON-1441071354 Oct 08 21:11:23.333057 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:11:23.333057 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:11:23.333057 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0ae02675057e4f27bc1980348afc8ca1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0ae02675057e4f27bc1980348afc8ca1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0ae02675057e4f27bc1980348afc8ca1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0ae02675057e4f27bc1980348afc8ca1"}]}] Oct 08 21:11:23.333057 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-ServersNegativeTestJSON-1441071354 Oct 08 21:11:23.333057 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 0ae02675057e4f27bc1980348afc8ca1 Oct 08 21:11:23.333057 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1441071354 Oct 08 21:11:23.333057 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-ServersNegativeTestJSON-1441071354-project Oct 08 21:11:23.333057 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:11:23.333057 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:11:23.333057 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 6a78d352c143483c8e4702d789d4c516 Oct 08 21:11:23.333057 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-ServersNegativeTestJSON-1441071354-project Oct 08 21:11:23.333057 ncdv-master-1 devstack@n-api.service[140492]: Oct 08 21:11:23.333057 ncdv-master-1 devstack@n-api.service[140492]: {"shelve": {}} Oct 08 21:11:23.333057 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 21:11:23.333057 ncdv-master-1 devstack@n-api.service[140492]: exception: Cannot 'shelve' instance e2548207-aa57-4e4c-876b-2027b59283d2 while it is in vm_state shelved_offloaded Oct 08 21:11:23.333057 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': 'e2548207-aa57-4e4c-876b-2027b59283d2', 'body': {'shelve': {}}} Oct 08 21:11:23.333057 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:11:23.333057 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:11:23.333057 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Oct 08 21:11:23.333057 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Oct 08 21:11:23.333057 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 08 21:11:23.333057 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 08 21:11:23.333057 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 08 21:11:23.333057 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 08 21:11:23.333057 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 08 21:11:23.333057 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 08 21:11:23.333057 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 08 21:11:23.333057 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 08 21:11:23.333057 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 08 21:11:23.333057 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 08 21:11:23.333057 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e2548207-aa57-4e4c-876b-2027b59283d2 in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Oct 08 21:11:23.333057 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:11:23.333057 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:11:23.333057 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:11:23.333057 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:11:23.333057 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:11:23.333057 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:11:23.333057 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:11:23.333057 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:11:23.333057 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:11:23.333057 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:11:23.333057 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Oct 08 21:11:23.333057 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 08 21:11:23.333057 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 08 21:11:23.341081 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 08 21:11:23.341081 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance e2548207-aa57-4e4c-876b-2027b59283d2 while it is in vm_state shelved_offloaded Oct 08 21:11:23.341081 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:11:23.341081 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:11:23.341081 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:11:23.341081 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:11:23.341081 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:11:23.341081 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:11:23.341081 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:11:23.341081 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:11:23.341081 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance e2548207-aa57-4e4c-876b-2027b59283d2 while it is in vm_state shelved_offloaded Oct 08 21:11:23.341081 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:11:23.345433 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-7ae1cd9b-a7cd-4c6d-9307-5e264b661647 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Returning 409 to user: Cannot 'shelve' instance e2548207-aa57-4e4c-876b-2027b59283d2 while it is in vm_state shelved_offloaded {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:11:23.346509 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-7ae1cd9b-a7cd-4c6d-9307-5e264b661647 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "POST /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2/action" status: 409 len: 155 microversion: 2.1 time: 0.183045 Oct 08 21:11:23.347597 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2324/4576] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:11:23 2022] POST /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2/action => generated 155 bytes in 185 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 08 21:11:23.356399 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-680c1d46-3a79-432b-959e-54a11a1680e5 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:11:23.357265 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-680c1d46-3a79-432b-959e-54a11a1680e5 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:11:23.364429 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-680c1d46-3a79-432b-959e-54a11a1680e5 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:23.365028 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-680c1d46-3a79-432b-959e-54a11a1680e5 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:23.366308 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-680c1d46-3a79-432b-959e-54a11a1680e5 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:23.367323 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-680c1d46-3a79-432b-959e-54a11a1680e5 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:23.367873 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-680c1d46-3a79-432b-959e-54a11a1680e5 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:23.368384 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-680c1d46-3a79-432b-959e-54a11a1680e5 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:23.457718 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-680c1d46-3a79-432b-959e-54a11a1680e5 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=140492) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 08 21:11:23.614639 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-680c1d46-3a79-432b-959e-54a11a1680e5 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "POST /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2/action" status: 202 len: 0 microversion: 2.1 time: 0.252956 Oct 08 21:11:23.621552 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2325/4577] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:11:23 2022] POST /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2/action => generated 0 bytes in 270 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 08 21:11:23.630408 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-af31ca60-6e41-4fdf-9377-97e041f1c3e6 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:11:23.641759 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-af31ca60-6e41-4fdf-9377-97e041f1c3e6 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:11:23.652028 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-af31ca60-6e41-4fdf-9377-97e041f1c3e6 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:23.652648 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-af31ca60-6e41-4fdf-9377-97e041f1c3e6 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:23.653145 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-af31ca60-6e41-4fdf-9377-97e041f1c3e6 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:23.654003 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-af31ca60-6e41-4fdf-9377-97e041f1c3e6 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:23.656921 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-af31ca60-6e41-4fdf-9377-97e041f1c3e6 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:23.657496 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-af31ca60-6e41-4fdf-9377-97e041f1c3e6 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:23.797012 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-c63e5eca-c662-4127-9ddd-09e65e990092 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78e9afd772c4de981cac8f5817ec356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765c62cac2ee4406b23a5baa85c52ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:11:23.817108 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-c63e5eca-c662-4127-9ddd-09e65e990092 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/82b72e20-b9e2-45ce-9362-b248f6d47bda" status: 200 len: 1510 microversion: 2.1 time: 0.655681 Oct 08 21:11:23.848492 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2253/4578] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:11:23 2022] GET /compute/v2.1/servers/82b72e20-b9e2-45ce-9362-b248f6d47bda => generated 1510 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:11:23.965149 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-af31ca60-6e41-4fdf-9377-97e041f1c3e6 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:11:23.980161 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-af31ca60-6e41-4fdf-9377-97e041f1c3e6 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 200 len: 1458 microversion: 2.1 time: 0.354727 Oct 08 21:11:23.985314 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2326/4579] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:11:23 2022] GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 1458 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:11:24.848179 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c5ca7f87-dde1-4239-b49e-7d39c7093e9e tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:11:24.850690 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-c5ca7f87-dde1-4239-b49e-7d39c7093e9e tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: 82b72e20-b9e2-45ce-9362-b248f6d47bda] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:11:24.862369 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c5ca7f87-dde1-4239-b49e-7d39c7093e9e tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:24.868329 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c5ca7f87-dde1-4239-b49e-7d39c7093e9e tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:24.869485 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c5ca7f87-dde1-4239-b49e-7d39c7093e9e tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:24.871011 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c5ca7f87-dde1-4239-b49e-7d39c7093e9e tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:24.871812 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c5ca7f87-dde1-4239-b49e-7d39c7093e9e tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:24.872609 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c5ca7f87-dde1-4239-b49e-7d39c7093e9e tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:25.004576 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-0f06c800-c8af-4118-bc5b-2f7533af12eb tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:11:25.005918 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-0f06c800-c8af-4118-bc5b-2f7533af12eb tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:11:25.020445 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0f06c800-c8af-4118-bc5b-2f7533af12eb tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:25.022919 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0f06c800-c8af-4118-bc5b-2f7533af12eb tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:25.024095 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0f06c800-c8af-4118-bc5b-2f7533af12eb tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:25.025296 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0f06c800-c8af-4118-bc5b-2f7533af12eb tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:25.025934 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0f06c800-c8af-4118-bc5b-2f7533af12eb tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:25.027179 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0f06c800-c8af-4118-bc5b-2f7533af12eb tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:25.310829 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-c5ca7f87-dde1-4239-b49e-7d39c7093e9e tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78e9afd772c4de981cac8f5817ec356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765c62cac2ee4406b23a5baa85c52ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:11:25.326310 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-c5ca7f87-dde1-4239-b49e-7d39c7093e9e tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/82b72e20-b9e2-45ce-9362-b248f6d47bda" status: 200 len: 1510 microversion: 2.1 time: 0.480391 Oct 08 21:11:25.341614 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2254/4580] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:11:24 2022] GET /compute/v2.1/servers/82b72e20-b9e2-45ce-9362-b248f6d47bda => generated 1510 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:11:25.423193 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-0f06c800-c8af-4118-bc5b-2f7533af12eb tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:11:25.435236 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-0f06c800-c8af-4118-bc5b-2f7533af12eb tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 200 len: 1458 microversion: 2.1 time: 0.434853 Oct 08 21:11:25.437261 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2327/4581] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:11:24 2022] GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 1458 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:11:26.352339 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-1d3c7378-c70c-46e5-9fdb-69e9b357d071 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:11:26.352978 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-1d3c7378-c70c-46e5-9fdb-69e9b357d071 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: 82b72e20-b9e2-45ce-9362-b248f6d47bda] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:11:26.371676 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1d3c7378-c70c-46e5-9fdb-69e9b357d071 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:26.372789 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1d3c7378-c70c-46e5-9fdb-69e9b357d071 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:26.373480 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1d3c7378-c70c-46e5-9fdb-69e9b357d071 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:26.374773 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1d3c7378-c70c-46e5-9fdb-69e9b357d071 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:26.375569 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1d3c7378-c70c-46e5-9fdb-69e9b357d071 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:26.376206 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1d3c7378-c70c-46e5-9fdb-69e9b357d071 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:26.464912 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-ede6e314-837d-4d36-a64a-28c7e50982bb tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:11:26.466356 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-ede6e314-837d-4d36-a64a-28c7e50982bb tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:11:26.481542 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ede6e314-837d-4d36-a64a-28c7e50982bb tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:26.487426 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ede6e314-837d-4d36-a64a-28c7e50982bb tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:26.488230 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ede6e314-837d-4d36-a64a-28c7e50982bb tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:26.489010 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ede6e314-837d-4d36-a64a-28c7e50982bb tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:26.489509 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ede6e314-837d-4d36-a64a-28c7e50982bb tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:26.489952 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ede6e314-837d-4d36-a64a-28c7e50982bb tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:26.832238 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-ede6e314-837d-4d36-a64a-28c7e50982bb tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:11:26.844466 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-ede6e314-837d-4d36-a64a-28c7e50982bb tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 200 len: 1516 microversion: 2.1 time: 0.385322 Oct 08 21:11:26.845801 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2328/4582] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:11:26 2022] GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 1516 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:11:27.341311 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-1d3c7378-c70c-46e5-9fdb-69e9b357d071 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78e9afd772c4de981cac8f5817ec356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765c62cac2ee4406b23a5baa85c52ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:11:27.354476 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-1d3c7378-c70c-46e5-9fdb-69e9b357d071 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/82b72e20-b9e2-45ce-9362-b248f6d47bda" status: 200 len: 1510 microversion: 2.1 time: 1.007377 Oct 08 21:11:27.357510 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2255/4583] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:11:26 2022] GET /compute/v2.1/servers/82b72e20-b9e2-45ce-9362-b248f6d47bda => generated 1510 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:11:27.589159 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-be75d86d-f54e-45e5-ae43-82ecddfac84b tempest-ListImagesTestJSON-1253781606 tempest-ListImagesTestJSON-1253781606-project] Calling method '.version_select at 0x7f1a87dd4dc0>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:11:27.659588 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-be75d86d-f54e-45e5-ae43-82ecddfac84b tempest-ListImagesTestJSON-1253781606 tempest-ListImagesTestJSON-1253781606-project] 10.222.0.26 "GET /compute/v2.1/images/c508bd7f-7db9-4b2c-af7c-be54a855c355" status: 200 len: 784 microversion: 2.1 time: 0.502436 Oct 08 21:11:27.672705 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2329/4584] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Oct 8 21:11:27 2022] GET /compute/v2.1/images/c508bd7f-7db9-4b2c-af7c-be54a855c355 => generated 784 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:11:27.680191 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-25902803-fb09-4e32-bb95-c254857bf414 tempest-ListImagesTestJSON-1253781606 tempest-ListImagesTestJSON-1253781606-project] Calling method '.version_select at 0x7f1a8c638940>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:11:27.774413 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-25902803-fb09-4e32-bb95-c254857bf414 tempest-ListImagesTestJSON-1253781606 tempest-ListImagesTestJSON-1253781606-project] 10.222.0.26 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.101023 Oct 08 21:11:27.775243 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2256/4585] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Oct 8 21:11:27 2022] GET /compute/v2.1/images => generated 445 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:11:27.789924 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-39258d33-7832-413d-aaee-300994e19620 tempest-ListImagesTestJSON-1253781606 tempest-ListImagesTestJSON-1253781606-project] Calling method '.version_select at 0x7f1a877180d0>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:11:27.872964 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-21f6bce2-8471-4d99-8c80-aca9d9dc57c2 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:11:27.874429 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-21f6bce2-8471-4d99-8c80-aca9d9dc57c2 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:11:27.880019 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-39258d33-7832-413d-aaee-300994e19620 tempest-ListImagesTestJSON-1253781606 tempest-ListImagesTestJSON-1253781606-project] 10.222.0.26 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.093418 Oct 08 21:11:27.893519 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2330/4586] 10.222.0.26 () {58 vars in 1143 bytes} [Sat Oct 8 21:11:27 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:11:27.901883 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-21f6bce2-8471-4d99-8c80-aca9d9dc57c2 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:27.902778 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-21f6bce2-8471-4d99-8c80-aca9d9dc57c2 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:27.903710 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-21f6bce2-8471-4d99-8c80-aca9d9dc57c2 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:27.904620 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-21f6bce2-8471-4d99-8c80-aca9d9dc57c2 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:27.905297 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-21f6bce2-8471-4d99-8c80-aca9d9dc57c2 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:27.906007 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-21f6bce2-8471-4d99-8c80-aca9d9dc57c2 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:28.329610 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-21f6bce2-8471-4d99-8c80-aca9d9dc57c2 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:11:28.333432 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=100 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:11:28.344340 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-21f6bce2-8471-4d99-8c80-aca9d9dc57c2 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 200 len: 1516 microversion: 2.1 time: 0.476369 Oct 08 21:11:28.345123 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2257/4587] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:11:27 2022] GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 1516 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:11:28.386211 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-67fe3802-d481-400a-a0e0-964f317fa311 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:11:28.386738 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-67fe3802-d481-400a-a0e0-964f317fa311 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: 82b72e20-b9e2-45ce-9362-b248f6d47bda] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:11:28.394837 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-04927a2a-d0ca-4639-9815-31ab28e1f0a0 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:11:28.399058 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-04927a2a-d0ca-4639-9815-31ab28e1f0a0 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] [instance: 159e29dd-802c-4059-99f9-bb7c113d430b] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:11:28.413897 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-67fe3802-d481-400a-a0e0-964f317fa311 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:28.416894 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-67fe3802-d481-400a-a0e0-964f317fa311 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:28.419924 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-67fe3802-d481-400a-a0e0-964f317fa311 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:28.421851 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-67fe3802-d481-400a-a0e0-964f317fa311 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:28.425863 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-67fe3802-d481-400a-a0e0-964f317fa311 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:28.430608 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-67fe3802-d481-400a-a0e0-964f317fa311 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:28.432346 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-04927a2a-d0ca-4639-9815-31ab28e1f0a0 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:28.435046 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-04927a2a-d0ca-4639-9815-31ab28e1f0a0 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:28.435947 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-04927a2a-d0ca-4639-9815-31ab28e1f0a0 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:28.446114 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-04927a2a-d0ca-4639-9815-31ab28e1f0a0 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:28.447593 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-04927a2a-d0ca-4639-9815-31ab28e1f0a0 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:28.451751 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-04927a2a-d0ca-4639-9815-31ab28e1f0a0 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:28.561369 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-04927a2a-d0ca-4639-9815-31ab28e1f0a0 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] 10.222.0.26 "GET /compute/v2.1/servers/159e29dd-802c-4059-99f9-bb7c113d430b/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.172983 Oct 08 21:11:28.565872 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2258/4588] 10.222.0.26 () {60 vars in 1343 bytes} [Sat Oct 8 21:11:28 2022] GET /compute/v2.1/servers/159e29dd-802c-4059-99f9-bb7c113d430b/os-volume_attachments => generated 25 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:11:28.668587 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-38eb2cae-b5de-4cd3-82bd-d7727c42955f tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:11:28.669085 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-38eb2cae-b5de-4cd3-82bd-d7727c42955f tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] [instance: 159e29dd-802c-4059-99f9-bb7c113d430b] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:11:28.678295 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-38eb2cae-b5de-4cd3-82bd-d7727c42955f tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:28.678803 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-38eb2cae-b5de-4cd3-82bd-d7727c42955f tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:28.679242 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-38eb2cae-b5de-4cd3-82bd-d7727c42955f tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:28.692211 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-38eb2cae-b5de-4cd3-82bd-d7727c42955f tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:28.694908 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-38eb2cae-b5de-4cd3-82bd-d7727c42955f tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:28.695340 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-38eb2cae-b5de-4cd3-82bd-d7727c42955f tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:28.809158 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-38eb2cae-b5de-4cd3-82bd-d7727c42955f tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] [instance: 159e29dd-802c-4059-99f9-bb7c113d430b] Going to try to terminate instance {{(pid=140491) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 21:11:28.901534 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-67fe3802-d481-400a-a0e0-964f317fa311 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78e9afd772c4de981cac8f5817ec356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765c62cac2ee4406b23a5baa85c52ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:11:28.914567 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-67fe3802-d481-400a-a0e0-964f317fa311 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/82b72e20-b9e2-45ce-9362-b248f6d47bda" status: 200 len: 1510 microversion: 2.1 time: 0.533416 Oct 08 21:11:28.916094 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2331/4589] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:11:28 2022] GET /compute/v2.1/servers/82b72e20-b9e2-45ce-9362-b248f6d47bda => generated 1510 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:11:28.932656 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-317ba1f3-f9f0-470f-be16-5181518e7a47 req-455e9286-a99c-4023-8cd9-6edc21788df2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2548207-aa57-4e4c-876b-2027b59283d2", "tag": "1900770b-2820-49c0-af24-1c780eb5f1e0"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:11:28.950225 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-317ba1f3-f9f0-470f-be16-5181518e7a47 req-455e9286-a99c-4023-8cd9-6edc21788df2 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:28.950897 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-317ba1f3-f9f0-470f-be16-5181518e7a47 req-455e9286-a99c-4023-8cd9-6edc21788df2 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:28.952994 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-317ba1f3-f9f0-470f-be16-5181518e7a47 req-455e9286-a99c-4023-8cd9-6edc21788df2 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:28.990990 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-317ba1f3-f9f0-470f-be16-5181518e7a47 req-455e9286-a99c-4023-8cd9-6edc21788df2 service nova] Creating event network-changed:1900770b-2820-49c0-af24-1c780eb5f1e0 for instance e2548207-aa57-4e4c-876b-2027b59283d2 on nch1-master-1 Oct 08 21:11:29.000022 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-317ba1f3-f9f0-470f-be16-5181518e7a47 req-455e9286-a99c-4023-8cd9-6edc21788df2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081944 Oct 08 21:11:29.000369 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2332/4590] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:11:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:11:29.116043 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-38eb2cae-b5de-4cd3-82bd-d7727c42955f tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] 10.222.0.26 "DELETE /compute/v2.1/servers/159e29dd-802c-4059-99f9-bb7c113d430b" status: 204 len: 0 microversion: 2.20 time: 0.450782 Oct 08 21:11:29.116648 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2259/4591] 10.222.0.26 () {60 vars in 1280 bytes} [Sat Oct 8 21:11:28 2022] DELETE /compute/v2.1/servers/159e29dd-802c-4059-99f9-bb7c113d430b => generated 0 bytes in 453 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 08 21:11:29.125762 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-070e97d6-a0c0-49df-abb7-42285be3cabe tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:11:29.126677 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-070e97d6-a0c0-49df-abb7-42285be3cabe tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] [instance: 159e29dd-802c-4059-99f9-bb7c113d430b] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:11:29.141005 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-070e97d6-a0c0-49df-abb7-42285be3cabe tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:29.141790 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-070e97d6-a0c0-49df-abb7-42285be3cabe tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:29.142415 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-070e97d6-a0c0-49df-abb7-42285be3cabe tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:29.143394 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-070e97d6-a0c0-49df-abb7-42285be3cabe tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:29.145460 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-070e97d6-a0c0-49df-abb7-42285be3cabe tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:29.148277 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-070e97d6-a0c0-49df-abb7-42285be3cabe tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:29.371710 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-a44a78f7-b1a0-439a-b013-b5f813145762 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:11:29.373389 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-a44a78f7-b1a0-439a-b013-b5f813145762 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:11:29.395476 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a44a78f7-b1a0-439a-b013-b5f813145762 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:29.396173 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a44a78f7-b1a0-439a-b013-b5f813145762 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:29.396725 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a44a78f7-b1a0-439a-b013-b5f813145762 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:29.397705 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a44a78f7-b1a0-439a-b013-b5f813145762 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:29.398432 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a44a78f7-b1a0-439a-b013-b5f813145762 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:29.399091 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a44a78f7-b1a0-439a-b013-b5f813145762 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:29.606265 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-070e97d6-a0c0-49df-abb7-42285be3cabe tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:11:29.626388 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-070e97d6-a0c0-49df-abb7-42285be3cabe tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:11:29.630298 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-070e97d6-a0c0-49df-abb7-42285be3cabe tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:11:29.636884 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-070e97d6-a0c0-49df-abb7-42285be3cabe tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] 10.222.0.26 "GET /compute/v2.1/servers/159e29dd-802c-4059-99f9-bb7c113d430b" status: 200 len: 1722 microversion: 2.20 time: 0.513784 Oct 08 21:11:29.655161 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2333/4592] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:11:29 2022] GET /compute/v2.1/servers/159e29dd-802c-4059-99f9-bb7c113d430b => generated 1722 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:11:29.776229 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-a44a78f7-b1a0-439a-b013-b5f813145762 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:11:29.786395 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-a44a78f7-b1a0-439a-b013-b5f813145762 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 200 len: 1516 microversion: 2.1 time: 0.420871 Oct 08 21:11:29.787857 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2260/4593] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:11:29 2022] GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 1516 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:11:29.944179 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-28ef4fbb-875a-4120-bc32-320b6055fb2e tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:11:29.945438 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-28ef4fbb-875a-4120-bc32-320b6055fb2e tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: 82b72e20-b9e2-45ce-9362-b248f6d47bda] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:11:29.954572 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-28ef4fbb-875a-4120-bc32-320b6055fb2e tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:29.955347 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-28ef4fbb-875a-4120-bc32-320b6055fb2e tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:29.955801 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-28ef4fbb-875a-4120-bc32-320b6055fb2e tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:29.956564 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-28ef4fbb-875a-4120-bc32-320b6055fb2e tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:29.957092 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-28ef4fbb-875a-4120-bc32-320b6055fb2e tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:29.957518 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-28ef4fbb-875a-4120-bc32-320b6055fb2e tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:30.420433 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-28ef4fbb-875a-4120-bc32-320b6055fb2e tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78e9afd772c4de981cac8f5817ec356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765c62cac2ee4406b23a5baa85c52ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:11:30.429402 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-28ef4fbb-875a-4120-bc32-320b6055fb2e tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/82b72e20-b9e2-45ce-9362-b248f6d47bda" status: 200 len: 1487 microversion: 2.1 time: 0.494019 Oct 08 21:11:30.429995 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2334/4594] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:11:29 2022] GET /compute/v2.1/servers/82b72e20-b9e2-45ce-9362-b248f6d47bda => generated 1487 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:11:30.461820 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-2d2546bf-6ed6-48a1-87a4-96330c86235d tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:11:30.462357 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-2d2546bf-6ed6-48a1-87a4-96330c86235d tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: 82b72e20-b9e2-45ce-9362-b248f6d47bda] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:11:30.480823 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2d2546bf-6ed6-48a1-87a4-96330c86235d tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:30.482379 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2d2546bf-6ed6-48a1-87a4-96330c86235d tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:30.483401 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2d2546bf-6ed6-48a1-87a4-96330c86235d tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:30.485470 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2d2546bf-6ed6-48a1-87a4-96330c86235d tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:30.486935 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2d2546bf-6ed6-48a1-87a4-96330c86235d tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:30.487835 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2d2546bf-6ed6-48a1-87a4-96330c86235d tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:30.605050 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-2d2546bf-6ed6-48a1-87a4-96330c86235d tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: 82b72e20-b9e2-45ce-9362-b248f6d47bda] Going to try to terminate instance {{(pid=140491) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 21:11:30.670217 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-26eac686-84a2-45fa-96ba-48653670aeed tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:11:30.671140 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-26eac686-84a2-45fa-96ba-48653670aeed tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] [instance: 159e29dd-802c-4059-99f9-bb7c113d430b] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:11:30.683977 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-26eac686-84a2-45fa-96ba-48653670aeed tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:30.685758 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-26eac686-84a2-45fa-96ba-48653670aeed tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:30.689649 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-26eac686-84a2-45fa-96ba-48653670aeed tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:30.690715 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-26eac686-84a2-45fa-96ba-48653670aeed tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:30.691535 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-26eac686-84a2-45fa-96ba-48653670aeed tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:30.698010 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-26eac686-84a2-45fa-96ba-48653670aeed tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:30.767351 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:11:30.847083 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-2d2546bf-6ed6-48a1-87a4-96330c86235d tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "DELETE /compute/v2.1/servers/82b72e20-b9e2-45ce-9362-b248f6d47bda" status: 204 len: 0 microversion: 2.1 time: 0.391494 Oct 08 21:11:30.847695 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2261/4595] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:11:30 2022] DELETE /compute/v2.1/servers/82b72e20-b9e2-45ce-9362-b248f6d47bda => generated 0 bytes in 394 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 21:11:30.859965 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-2fe655b0-fd59-4285-9c93-842504d85d7f tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:11:30.860974 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-2fe655b0-fd59-4285-9c93-842504d85d7f tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:11:30.872569 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2fe655b0-fd59-4285-9c93-842504d85d7f tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:30.875241 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2fe655b0-fd59-4285-9c93-842504d85d7f tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:30.877483 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2fe655b0-fd59-4285-9c93-842504d85d7f tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:30.879643 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2fe655b0-fd59-4285-9c93-842504d85d7f tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:30.881695 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2fe655b0-fd59-4285-9c93-842504d85d7f tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:30.882617 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2fe655b0-fd59-4285-9c93-842504d85d7f tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:31.317924 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-2fe655b0-fd59-4285-9c93-842504d85d7f tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:11:31.339719 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-2fe655b0-fd59-4285-9c93-842504d85d7f tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 200 len: 1516 microversion: 2.1 time: 0.488259 Oct 08 21:11:31.342229 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2262/4596] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:11:30 2022] GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 1516 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:11:31.358886 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-3c484d68-c3c5-4805-9f67-4975dd274f44 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:11:31.360080 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-3c484d68-c3c5-4805-9f67-4975dd274f44 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: 82b72e20-b9e2-45ce-9362-b248f6d47bda] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:11:31.374013 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3c484d68-c3c5-4805-9f67-4975dd274f44 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:31.374829 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3c484d68-c3c5-4805-9f67-4975dd274f44 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:31.378546 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3c484d68-c3c5-4805-9f67-4975dd274f44 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:31.379561 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3c484d68-c3c5-4805-9f67-4975dd274f44 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:31.380251 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3c484d68-c3c5-4805-9f67-4975dd274f44 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:31.381625 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3c484d68-c3c5-4805-9f67-4975dd274f44 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:31.761600 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-26eac686-84a2-45fa-96ba-48653670aeed tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:11:31.781228 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-26eac686-84a2-45fa-96ba-48653670aeed tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:11:31.784678 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-26eac686-84a2-45fa-96ba-48653670aeed tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:11:31.786118 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-26eac686-84a2-45fa-96ba-48653670aeed tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] 10.222.0.26 "GET /compute/v2.1/servers/159e29dd-802c-4059-99f9-bb7c113d430b" status: 200 len: 1722 microversion: 2.20 time: 1.120671 Oct 08 21:11:31.797516 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2335/4597] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:11:30 2022] GET /compute/v2.1/servers/159e29dd-802c-4059-99f9-bb7c113d430b => generated 1722 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:11:32.205457 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-3c484d68-c3c5-4805-9f67-4975dd274f44 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78e9afd772c4de981cac8f5817ec356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765c62cac2ee4406b23a5baa85c52ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:11:32.213560 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-3c484d68-c3c5-4805-9f67-4975dd274f44 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/82b72e20-b9e2-45ce-9362-b248f6d47bda" status: 200 len: 1493 microversion: 2.1 time: 0.869798 Oct 08 21:11:32.223880 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2263/4598] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:11:31 2022] GET /compute/v2.1/servers/82b72e20-b9e2-45ce-9362-b248f6d47bda => generated 1493 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:11:32.372425 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-38f705e0-3025-49d9-b3f0-6670781517be tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:11:32.373750 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-38f705e0-3025-49d9-b3f0-6670781517be tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:11:32.389403 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-38f705e0-3025-49d9-b3f0-6670781517be tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:32.389920 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-38f705e0-3025-49d9-b3f0-6670781517be tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:32.390378 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-38f705e0-3025-49d9-b3f0-6670781517be tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:32.391117 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-38f705e0-3025-49d9-b3f0-6670781517be tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:32.391587 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-38f705e0-3025-49d9-b3f0-6670781517be tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:32.392028 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-38f705e0-3025-49d9-b3f0-6670781517be tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:32.816409 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-b8af262d-e608-420d-8313-d10d691e90ea tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:11:32.817151 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-b8af262d-e608-420d-8313-d10d691e90ea tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] [instance: 159e29dd-802c-4059-99f9-bb7c113d430b] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:11:32.861018 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b8af262d-e608-420d-8313-d10d691e90ea tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:32.862655 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b8af262d-e608-420d-8313-d10d691e90ea tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:32.867987 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b8af262d-e608-420d-8313-d10d691e90ea tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:32.868779 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b8af262d-e608-420d-8313-d10d691e90ea tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:32.869289 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b8af262d-e608-420d-8313-d10d691e90ea tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:32.869721 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b8af262d-e608-420d-8313-d10d691e90ea tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:33.071931 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-b8af262d-e608-420d-8313-d10d691e90ea tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:11:33.101944 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-b8af262d-e608-420d-8313-d10d691e90ea tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:11:33.118171 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-b8af262d-e608-420d-8313-d10d691e90ea tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:11:33.124607 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-b8af262d-e608-420d-8313-d10d691e90ea tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] 10.222.0.26 "GET /compute/v2.1/servers/159e29dd-802c-4059-99f9-bb7c113d430b" status: 200 len: 1655 microversion: 2.20 time: 0.313540 Oct 08 21:11:33.127958 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2264/4599] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:11:32 2022] GET /compute/v2.1/servers/159e29dd-802c-4059-99f9-bb7c113d430b => generated 1655 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:11:33.251516 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-8be406e2-60a0-404f-8f25-9e473c9089d7 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:11:33.253327 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-8be406e2-60a0-404f-8f25-9e473c9089d7 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: 82b72e20-b9e2-45ce-9362-b248f6d47bda] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:11:33.266094 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8be406e2-60a0-404f-8f25-9e473c9089d7 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:33.268470 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8be406e2-60a0-404f-8f25-9e473c9089d7 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:33.274682 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8be406e2-60a0-404f-8f25-9e473c9089d7 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:33.276077 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-38f705e0-3025-49d9-b3f0-6670781517be tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:11:33.278169 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8be406e2-60a0-404f-8f25-9e473c9089d7 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:33.280830 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8be406e2-60a0-404f-8f25-9e473c9089d7 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:33.282725 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8be406e2-60a0-404f-8f25-9e473c9089d7 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:33.293673 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-38f705e0-3025-49d9-b3f0-6670781517be tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 200 len: 1516 microversion: 2.1 time: 0.927018 Oct 08 21:11:33.296369 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2336/4600] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:11:32 2022] GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 1516 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:11:33.726967 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-e36ec042-8a73-40cd-acf5-92503b91c4c3 req-d9238d87-f797-48f5-8262-133bae6d3fd6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "159e29dd-802c-4059-99f9-bb7c113d430b", "name": "network-vif-deleted", "tag": "59479dc9-06cf-4a86-bedc-3998868989c8"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:11:33.768700 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-e36ec042-8a73-40cd-acf5-92503b91c4c3 req-d9238d87-f797-48f5-8262-133bae6d3fd6 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:33.772068 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-e36ec042-8a73-40cd-acf5-92503b91c4c3 req-d9238d87-f797-48f5-8262-133bae6d3fd6 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:33.784356 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-e36ec042-8a73-40cd-acf5-92503b91c4c3 req-d9238d87-f797-48f5-8262-133bae6d3fd6 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:33.836225 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-e36ec042-8a73-40cd-acf5-92503b91c4c3 req-d9238d87-f797-48f5-8262-133bae6d3fd6 service nova] Creating event network-vif-deleted:59479dc9-06cf-4a86-bedc-3998868989c8 for instance 159e29dd-802c-4059-99f9-bb7c113d430b on nch2-master-1 Oct 08 21:11:33.850460 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-e36ec042-8a73-40cd-acf5-92503b91c4c3 req-d9238d87-f797-48f5-8262-133bae6d3fd6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129160 Oct 08 21:11:33.857268 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2337/4601] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:11:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 08 21:11:34.156981 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-26ec6237-6cd3-415c-adf7-a6588e74dfcf tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:11:34.157676 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-26ec6237-6cd3-415c-adf7-a6588e74dfcf tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] [instance: 159e29dd-802c-4059-99f9-bb7c113d430b] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:11:34.192116 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-26ec6237-6cd3-415c-adf7-a6588e74dfcf tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:34.192648 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-26ec6237-6cd3-415c-adf7-a6588e74dfcf tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:34.198462 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-26ec6237-6cd3-415c-adf7-a6588e74dfcf tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:34.199268 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-26ec6237-6cd3-415c-adf7-a6588e74dfcf tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:34.205318 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-26ec6237-6cd3-415c-adf7-a6588e74dfcf tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:34.206075 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-26ec6237-6cd3-415c-adf7-a6588e74dfcf tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:34.425217 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-26ec6237-6cd3-415c-adf7-a6588e74dfcf tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:34.430151 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-26ec6237-6cd3-415c-adf7-a6588e74dfcf tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:34.432611 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-26ec6237-6cd3-415c-adf7-a6588e74dfcf tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:34.433270 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.objects.instance [None req-26ec6237-6cd3-415c-adf7-a6588e74dfcf tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lazy-loading 'fault' on Instance uuid 159e29dd-802c-4059-99f9-bb7c113d430b {{(pid=140492) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 21:11:34.681803 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-26ec6237-6cd3-415c-adf7-a6588e74dfcf tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:11:34.697396 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-26ec6237-6cd3-415c-adf7-a6588e74dfcf tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:11:34.699854 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-26ec6237-6cd3-415c-adf7-a6588e74dfcf tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21870fe169dc42359d9bdb149d0016d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665f66e846c24a6db01274679100bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:11:34.720860 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-26ec6237-6cd3-415c-adf7-a6588e74dfcf tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] 10.222.0.26 "GET /compute/v2.1/servers/159e29dd-802c-4059-99f9-bb7c113d430b" status: 200 len: 1371 microversion: 2.20 time: 0.570030 Oct 08 21:11:34.723682 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2338/4602] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:11:34 2022] GET /compute/v2.1/servers/159e29dd-802c-4059-99f9-bb7c113d430b => generated 1371 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:11:34.752428 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-4671cc4f-169e-4fc0-a6ff-9a104b667483 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:11:34.754609 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-4671cc4f-169e-4fc0-a6ff-9a104b667483 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:11:34.788933 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4671cc4f-169e-4fc0-a6ff-9a104b667483 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:34.791801 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4671cc4f-169e-4fc0-a6ff-9a104b667483 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:34.793411 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4671cc4f-169e-4fc0-a6ff-9a104b667483 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:34.800078 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4671cc4f-169e-4fc0-a6ff-9a104b667483 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:34.800591 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4671cc4f-169e-4fc0-a6ff-9a104b667483 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:34.801106 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4671cc4f-169e-4fc0-a6ff-9a104b667483 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:34.976153 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-8be406e2-60a0-404f-8f25-9e473c9089d7 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78e9afd772c4de981cac8f5817ec356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765c62cac2ee4406b23a5baa85c52ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:11:35.015696 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-8be406e2-60a0-404f-8f25-9e473c9089d7 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/82b72e20-b9e2-45ce-9362-b248f6d47bda" status: 200 len: 1493 microversion: 2.1 time: 1.753126 Oct 08 21:11:35.017541 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2265/4603] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:11:33 2022] GET /compute/v2.1/servers/82b72e20-b9e2-45ce-9362-b248f6d47bda => generated 1493 bytes in 1770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:11:35.313706 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-4671cc4f-169e-4fc0-a6ff-9a104b667483 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:11:35.328705 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-4671cc4f-169e-4fc0-a6ff-9a104b667483 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 200 len: 1516 microversion: 2.1 time: 0.602744 Oct 08 21:11:35.330043 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2339/4604] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:11:34 2022] GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 1516 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:11:35.760807 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-812b0e2e-66bf-4951-91cc-336a012b394e tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:11:35.761871 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-812b0e2e-66bf-4951-91cc-336a012b394e tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] [instance: 159e29dd-802c-4059-99f9-bb7c113d430b] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:11:35.776162 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-812b0e2e-66bf-4951-91cc-336a012b394e tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:35.776921 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-812b0e2e-66bf-4951-91cc-336a012b394e tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:35.777638 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-812b0e2e-66bf-4951-91cc-336a012b394e tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:35.779862 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-812b0e2e-66bf-4951-91cc-336a012b394e tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:35.781558 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-812b0e2e-66bf-4951-91cc-336a012b394e tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:35.782666 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-812b0e2e-66bf-4951-91cc-336a012b394e tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:35.820788 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-812b0e2e-66bf-4951-91cc-336a012b394e tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] HTTP exception thrown: Instance 159e29dd-802c-4059-99f9-bb7c113d430b could not be found. Oct 08 21:11:35.822722 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-812b0e2e-66bf-4951-91cc-336a012b394e tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Request method failure captured: Oct 08 21:11:35.822722 ncdv-master-1 devstack@n-api.service[140491]: request: GET /compute/v2.1/servers/159e29dd-802c-4059-99f9-bb7c113d430b HTTP/1.1 Oct 08 21:11:35.822722 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:11:35.822722 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:11:35.822722 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:11:35.822722 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 21:11:35.822722 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:11:35.822722 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:11:35.822722 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:11:35.822722 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:11:35.822722 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeX1dfwQ899XpdMOtOJMQSu2NCEUW1Pb5XFJGbsJ10nw2woET0bsgI1wyutFUVeqysRZ016ChL6jEuP45EW13v5vp5hTuexOnuurE60XhoiZG-IK_OZURtPPZ1scS6vLEbSYQ0RZ5FDf1lySiWu-17QEYpUcIEOBkGcy7PtayWblSoc Oct 08 21:11:35.822722 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:11:35.822722 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:11:35.822722 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:11:35.822722 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:11:35.822722 ncdv-master-1 devstack@n-api.service[140491]: X-Openstack-Nova-Api-Version: 2.20 Oct 08 21:11:35.822722 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:11:35.822722 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:11:35.822722 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 665f66e846c24a6db01274679100bdbf Oct 08 21:11:35.822722 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1179861839 Oct 08 21:11:35.822722 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:11:35.822722 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:11:35.822722 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/665f66e846c24a6db01274679100bdbf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/665f66e846c24a6db01274679100bdbf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_665f66e846c24a6db01274679100bdbf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/665f66e846c24a6db01274679100bdbf"}]}] Oct 08 21:11:35.822722 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1179861839 Oct 08 21:11:35.822722 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 665f66e846c24a6db01274679100bdbf Oct 08 21:11:35.822722 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1179861839 Oct 08 21:11:35.822722 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-AttachVolumeShelveTestJSON-1179861839-project Oct 08 21:11:35.822722 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:11:35.822722 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:11:35.822722 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 21870fe169dc42359d9bdb149d0016d7 Oct 08 21:11:35.822722 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1179861839-project Oct 08 21:11:35.822722 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:11:35.822722 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance 159e29dd-802c-4059-99f9-bb7c113d430b could not be found. Oct 08 21:11:35.822722 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': '159e29dd-802c-4059-99f9-bb7c113d430b'} Oct 08 21:11:35.822722 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:11:35.822722 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:11:35.822722 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:11:35.822722 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:11:35.822722 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:11:35.822722 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:11:35.822722 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:11:35.822722 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:11:35.822722 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:11:35.822722 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:11:35.822722 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 159e29dd-802c-4059-99f9-bb7c113d430b could not be found. Oct 08 21:11:35.822722 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:11:35.822722 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:11:35.822722 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:11:35.822722 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:11:35.822722 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:11:35.822722 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:11:35.822722 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:11:35.822722 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:11:35.822722 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:11:35.822722 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:11:35.822722 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:11:35.822722 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:11:35.822722 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:11:35.822722 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:11:35.822722 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:11:35.822722 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:11:35.822722 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 159e29dd-802c-4059-99f9-bb7c113d430b could not be found. Oct 08 21:11:35.822722 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:11:35.822722 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:11:35.828568 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:11:35.828568 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:11:35.828568 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:11:35.828568 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:11:35.828568 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:11:35.828568 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:11:35.828568 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 159e29dd-802c-4059-99f9-bb7c113d430b could not be found. Oct 08 21:11:35.828568 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:11:35.828568 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-812b0e2e-66bf-4951-91cc-336a012b394e tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Returning 404 to user: Instance 159e29dd-802c-4059-99f9-bb7c113d430b could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:11:35.828568 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-812b0e2e-66bf-4951-91cc-336a012b394e tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] 10.222.0.26 "GET /compute/v2.1/servers/159e29dd-802c-4059-99f9-bb7c113d430b" status: 404 len: 111 microversion: 2.20 time: 0.067271 Oct 08 21:11:35.828568 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2266/4605] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:11:35 2022] GET /compute/v2.1/servers/159e29dd-802c-4059-99f9-bb7c113d430b => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 08 21:11:35.833493 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-230d55eb-0770-4e33-b86b-e7d332202389 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Calling method '.version_select at 0x7f1a87d83160>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:11:35.882576 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-230d55eb-0770-4e33-b86b-e7d332202389 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2085381443" status: 204 len: 0 microversion: 2.20 time: 0.052992 Oct 08 21:11:35.887697 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2340/4606] 10.222.0.26 () {60 vars in 1262 bytes} [Sat Oct 8 21:11:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2085381443 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 08 21:11:35.978377 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-f413fd0d-2889-4f05-a2ac-d1cfa5f612e0 req-180b1922-cb91-43de-94a6-b80e5a41e643 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82b72e20-b9e2-45ce-9362-b248f6d47bda", "name": "network-vif-deleted", "tag": "5fd11ae9-08eb-4fb7-8f60-d383f7e46331"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:11:36.012238 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-f413fd0d-2889-4f05-a2ac-d1cfa5f612e0 req-180b1922-cb91-43de-94a6-b80e5a41e643 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:36.012728 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-f413fd0d-2889-4f05-a2ac-d1cfa5f612e0 req-180b1922-cb91-43de-94a6-b80e5a41e643 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:36.019167 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-f413fd0d-2889-4f05-a2ac-d1cfa5f612e0 req-180b1922-cb91-43de-94a6-b80e5a41e643 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:36.044998 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-83d0d8a7-3b6e-494f-8fc3-ec6c93f9316a tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:11:36.045910 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-83d0d8a7-3b6e-494f-8fc3-ec6c93f9316a tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: 82b72e20-b9e2-45ce-9362-b248f6d47bda] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:11:36.056635 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-f413fd0d-2889-4f05-a2ac-d1cfa5f612e0 req-180b1922-cb91-43de-94a6-b80e5a41e643 service nova] Creating event network-vif-deleted:5fd11ae9-08eb-4fb7-8f60-d383f7e46331 for instance 82b72e20-b9e2-45ce-9362-b248f6d47bda on nch2-master-1 Oct 08 21:11:36.065023 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-83d0d8a7-3b6e-494f-8fc3-ec6c93f9316a tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:36.067917 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-83d0d8a7-3b6e-494f-8fc3-ec6c93f9316a tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:36.069150 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-83d0d8a7-3b6e-494f-8fc3-ec6c93f9316a tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:36.071136 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-83d0d8a7-3b6e-494f-8fc3-ec6c93f9316a tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:36.071716 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-83d0d8a7-3b6e-494f-8fc3-ec6c93f9316a tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:36.072956 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-83d0d8a7-3b6e-494f-8fc3-ec6c93f9316a tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:36.081323 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-f413fd0d-2889-4f05-a2ac-d1cfa5f612e0 req-180b1922-cb91-43de-94a6-b80e5a41e643 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107268 Oct 08 21:11:36.086700 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2267/4607] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:11:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:11:36.099918 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-83d0d8a7-3b6e-494f-8fc3-ec6c93f9316a tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] HTTP exception thrown: Instance 82b72e20-b9e2-45ce-9362-b248f6d47bda could not be found. Oct 08 21:11:36.103353 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-83d0d8a7-3b6e-494f-8fc3-ec6c93f9316a tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Request method failure captured: Oct 08 21:11:36.103353 ncdv-master-1 devstack@n-api.service[140492]: request: GET /compute/v2.1/servers/82b72e20-b9e2-45ce-9362-b248f6d47bda HTTP/1.1 Oct 08 21:11:36.103353 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:11:36.103353 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:11:36.103353 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:11:36.103353 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 21:11:36.103353 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:11:36.103353 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:11:36.103353 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:11:36.103353 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:11:36.103353 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeaY45CCffIT40Amc9wEG1L3srTtCd58z19KxF0fYIwNPulOEB6B0U5KbwvP4xZlDymYa3r7NupuSBl7IoxTUgzZohPJnXbaXnL_FvPvzvmymW0IMjU5l88HUbi73sOE2TxCcEBd6artojZxtGFF9N7yzN3dTHpujcvoWiRD4lXAI28 Oct 08 21:11:36.103353 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:11:36.103353 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:11:36.103353 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:11:36.103353 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:11:36.103353 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:11:36.103353 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:11:36.103353 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 765c62cac2ee4406b23a5baa85c52ff7 Oct 08 21:11:36.103353 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-DeleteServersTestJSON-1423663413 Oct 08 21:11:36.103353 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:11:36.103353 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:11:36.103353 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/765c62cac2ee4406b23a5baa85c52ff7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/765c62cac2ee4406b23a5baa85c52ff7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_765c62cac2ee4406b23a5baa85c52ff7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/765c62cac2ee4406b23a5baa85c52ff7"}]}] Oct 08 21:11:36.103353 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-DeleteServersTestJSON-1423663413 Oct 08 21:11:36.103353 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 765c62cac2ee4406b23a5baa85c52ff7 Oct 08 21:11:36.103353 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-DeleteServersTestJSON-1423663413 Oct 08 21:11:36.103353 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-DeleteServersTestJSON-1423663413-project Oct 08 21:11:36.103353 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:11:36.103353 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:11:36.103353 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: d78e9afd772c4de981cac8f5817ec356 Oct 08 21:11:36.103353 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-DeleteServersTestJSON-1423663413-project Oct 08 21:11:36.103353 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 21:11:36.103353 ncdv-master-1 devstack@n-api.service[140492]: exception: Instance 82b72e20-b9e2-45ce-9362-b248f6d47bda could not be found. Oct 08 21:11:36.103353 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': '82b72e20-b9e2-45ce-9362-b248f6d47bda'} Oct 08 21:11:36.103353 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:11:36.103353 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:11:36.103353 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:11:36.103353 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:11:36.103353 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:11:36.103353 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:11:36.103353 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:11:36.103353 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:11:36.103353 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:11:36.103353 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:11:36.103353 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82b72e20-b9e2-45ce-9362-b248f6d47bda could not be found. Oct 08 21:11:36.103353 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:11:36.103353 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:11:36.103353 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:11:36.103353 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:11:36.103353 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:11:36.103353 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:11:36.103353 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:11:36.103353 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:11:36.103353 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:11:36.103353 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:11:36.103353 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:11:36.103353 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:11:36.103353 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:11:36.103353 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:11:36.103353 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:11:36.103353 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:11:36.103353 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82b72e20-b9e2-45ce-9362-b248f6d47bda could not be found. Oct 08 21:11:36.103353 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:11:36.103353 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:11:36.103353 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:11:36.108865 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:11:36.108865 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:11:36.108865 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:11:36.108865 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:11:36.108865 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:11:36.108865 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82b72e20-b9e2-45ce-9362-b248f6d47bda could not be found. Oct 08 21:11:36.108865 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:11:36.118501 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-83d0d8a7-3b6e-494f-8fc3-ec6c93f9316a tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Returning 404 to user: Instance 82b72e20-b9e2-45ce-9362-b248f6d47bda could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:11:36.123747 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-83d0d8a7-3b6e-494f-8fc3-ec6c93f9316a tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/82b72e20-b9e2-45ce-9362-b248f6d47bda" status: 404 len: 111 microversion: 2.1 time: 0.086538 Oct 08 21:11:36.127614 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2341/4608] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:11:36 2022] GET /compute/v2.1/servers/82b72e20-b9e2-45ce-9362-b248f6d47bda => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:11:36.360557 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-5db438a5-c8c2-427c-93b6-44eb496373ba tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:11:36.361488 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-5db438a5-c8c2-427c-93b6-44eb496373ba tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:11:36.377672 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5db438a5-c8c2-427c-93b6-44eb496373ba tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:36.378210 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5db438a5-c8c2-427c-93b6-44eb496373ba tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:36.378668 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5db438a5-c8c2-427c-93b6-44eb496373ba tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:36.382956 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5db438a5-c8c2-427c-93b6-44eb496373ba tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:36.383874 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5db438a5-c8c2-427c-93b6-44eb496373ba tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:36.385821 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5db438a5-c8c2-427c-93b6-44eb496373ba tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:36.532814 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-d404470e-c9c7-4a02-9727-ef00e314617e tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1845142137", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "networks": [{"uuid": "82d56471-f1e9-4dc0-935a-29f2f2d2c7c0"}]}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:11:36.714416 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.network.neutron [None req-d404470e-c9c7-4a02-9727-ef00e314617e tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] validate_networks() for [('82d56471-f1e9-4dc0-935a-29f2f2d2c7c0', None, None, None, None, None)] {{(pid=140492) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 21:11:36.806718 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-5db438a5-c8c2-427c-93b6-44eb496373ba tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:11:36.819768 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-5db438a5-c8c2-427c-93b6-44eb496373ba tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 200 len: 1516 microversion: 2.1 time: 0.463497 Oct 08 21:11:36.820448 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2268/4609] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:11:36 2022] GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 1516 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:11:37.843896 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-e33681b7-4619-425f-a9ad-042a3ae0a53c tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:11:37.844726 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-e33681b7-4619-425f-a9ad-042a3ae0a53c tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:11:37.865736 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e33681b7-4619-425f-a9ad-042a3ae0a53c tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:37.866494 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e33681b7-4619-425f-a9ad-042a3ae0a53c tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:37.867105 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e33681b7-4619-425f-a9ad-042a3ae0a53c tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:37.868150 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e33681b7-4619-425f-a9ad-042a3ae0a53c tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:37.870295 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e33681b7-4619-425f-a9ad-042a3ae0a53c tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:37.871328 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e33681b7-4619-425f-a9ad-042a3ae0a53c tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:38.345973 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-e33681b7-4619-425f-a9ad-042a3ae0a53c tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:11:38.355312 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-e33681b7-4619-425f-a9ad-042a3ae0a53c tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 200 len: 1516 microversion: 2.1 time: 0.515369 Oct 08 21:11:38.374362 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2269/4610] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:11:37 2022] GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 1516 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:11:39.387180 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-35e94e18-525f-4a1f-bd85-c86f1ee58845 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:11:39.388018 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-35e94e18-525f-4a1f-bd85-c86f1ee58845 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:11:39.408718 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-35e94e18-525f-4a1f-bd85-c86f1ee58845 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:39.411173 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-35e94e18-525f-4a1f-bd85-c86f1ee58845 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:39.412455 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-35e94e18-525f-4a1f-bd85-c86f1ee58845 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:39.415562 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-35e94e18-525f-4a1f-bd85-c86f1ee58845 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:39.416206 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-35e94e18-525f-4a1f-bd85-c86f1ee58845 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:39.416859 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-35e94e18-525f-4a1f-bd85-c86f1ee58845 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:39.853069 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-35e94e18-525f-4a1f-bd85-c86f1ee58845 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:11:39.870497 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-35e94e18-525f-4a1f-bd85-c86f1ee58845 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 200 len: 1516 microversion: 2.1 time: 0.487306 Oct 08 21:11:39.872271 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2270/4611] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:11:39 2022] GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 1516 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:11:40.239172 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-d404470e-c9c7-4a02-9727-ef00e314617e tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Flavor limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 21:11:40.239692 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-d404470e-c9c7-4a02-9727-ef00e314617e tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Image limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 21:11:40.240272 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-d404470e-c9c7-4a02-9727-ef00e314617e tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Flavor pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 21:11:40.240625 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-d404470e-c9c7-4a02-9727-ef00e314617e tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Image pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 21:11:40.241035 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-d404470e-c9c7-4a02-9727-ef00e314617e tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 21:11:40.269322 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d404470e-c9c7-4a02-9727-ef00e314617e tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:40.269903 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d404470e-c9c7-4a02-9727-ef00e314617e tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:40.270565 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d404470e-c9c7-4a02-9727-ef00e314617e tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:40.271607 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d404470e-c9c7-4a02-9727-ef00e314617e tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:40.286114 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d404470e-c9c7-4a02-9727-ef00e314617e tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:40.286358 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d404470e-c9c7-4a02-9727-ef00e314617e tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:40.371485 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-d404470e-c9c7-4a02-9727-ef00e314617e tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Getting quotas for project 765c62cac2ee4406b23a5baa85c52ff7. Resources: {'cores', 'instances', 'ram'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:11:40.401658 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-d404470e-c9c7-4a02-9727-ef00e314617e tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Getting quotas for user d78e9afd772c4de981cac8f5817ec356 and project 765c62cac2ee4406b23a5baa85c52ff7. Resources: {'cores', 'instances', 'ram'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:11:40.457698 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-d404470e-c9c7-4a02-9727-ef00e314617e tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Going to run 1 instances... {{(pid=140492) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 21:11:40.466328 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-d404470e-c9c7-4a02-9727-ef00e314617e tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: 71182b09-915d-48cd-b56b-dc1ee940ade1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c508bd7f-7db9-4b2c-af7c-be54a855c355',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140492) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 21:11:40.517861 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-1270c04d-aedd-4a08-8303-845c75e53f9c tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:11:40.519766 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-1270c04d-aedd-4a08-8303-845c75e53f9c tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] [instance: 159e29dd-802c-4059-99f9-bb7c113d430b] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:11:40.537744 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1270c04d-aedd-4a08-8303-845c75e53f9c tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:40.538662 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1270c04d-aedd-4a08-8303-845c75e53f9c tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:40.540404 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1270c04d-aedd-4a08-8303-845c75e53f9c tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:40.542323 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1270c04d-aedd-4a08-8303-845c75e53f9c tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:40.546872 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1270c04d-aedd-4a08-8303-845c75e53f9c tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:40.547871 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1270c04d-aedd-4a08-8303-845c75e53f9c tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:40.589326 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-1270c04d-aedd-4a08-8303-845c75e53f9c tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] HTTP exception thrown: Instance 159e29dd-802c-4059-99f9-bb7c113d430b could not be found. Oct 08 21:11:40.594005 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-1270c04d-aedd-4a08-8303-845c75e53f9c tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Request method failure captured: Oct 08 21:11:40.594005 ncdv-master-1 devstack@n-api.service[140491]: request: DELETE /compute/v2.1/servers/159e29dd-802c-4059-99f9-bb7c113d430b HTTP/1.1 Oct 08 21:11:40.594005 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:11:40.594005 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:11:40.594005 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:11:40.594005 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 21:11:40.594005 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:11:40.594005 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:11:40.594005 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:11:40.594005 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:11:40.594005 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeX1dfwQ899XpdMOtOJMQSu2NCEUW1Pb5XFJGbsJ10nw2woET0bsgI1wyutFUVeqysRZ016ChL6jEuP45EW13v5vp5hTuexOnuurE60XhoiZG-IK_OZURtPPZ1scS6vLEbSYQ0RZ5FDf1lySiWu-17QEYpUcIEOBkGcy7PtayWblSoc Oct 08 21:11:40.594005 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:11:40.594005 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:11:40.594005 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:11:40.594005 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:11:40.594005 ncdv-master-1 devstack@n-api.service[140491]: X-Openstack-Nova-Api-Version: 2.20 Oct 08 21:11:40.594005 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:11:40.594005 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:11:40.594005 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 665f66e846c24a6db01274679100bdbf Oct 08 21:11:40.594005 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1179861839 Oct 08 21:11:40.594005 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:11:40.594005 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:11:40.594005 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/665f66e846c24a6db01274679100bdbf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/665f66e846c24a6db01274679100bdbf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_665f66e846c24a6db01274679100bdbf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/665f66e846c24a6db01274679100bdbf"}]}] Oct 08 21:11:40.594005 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1179861839 Oct 08 21:11:40.594005 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 665f66e846c24a6db01274679100bdbf Oct 08 21:11:40.594005 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1179861839 Oct 08 21:11:40.594005 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-AttachVolumeShelveTestJSON-1179861839-project Oct 08 21:11:40.594005 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:11:40.594005 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:11:40.594005 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 21870fe169dc42359d9bdb149d0016d7 Oct 08 21:11:40.594005 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1179861839-project Oct 08 21:11:40.594005 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:11:40.594005 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance 159e29dd-802c-4059-99f9-bb7c113d430b could not be found. Oct 08 21:11:40.594005 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': '159e29dd-802c-4059-99f9-bb7c113d430b'} Oct 08 21:11:40.594005 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:11:40.594005 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:11:40.594005 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:11:40.594005 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:11:40.594005 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:11:40.594005 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:11:40.594005 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:11:40.594005 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:11:40.594005 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:11:40.594005 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:11:40.594005 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 159e29dd-802c-4059-99f9-bb7c113d430b could not be found. Oct 08 21:11:40.594005 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:11:40.594005 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:11:40.594005 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:11:40.594005 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:11:40.594005 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:11:40.594005 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:11:40.594005 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:11:40.594005 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:11:40.594005 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:11:40.594005 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:11:40.594005 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 08 21:11:40.594005 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 08 21:11:40.594005 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 08 21:11:40.594005 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 08 21:11:40.594005 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:11:40.594005 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:11:40.594005 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:11:40.594005 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:11:40.598133 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 159e29dd-802c-4059-99f9-bb7c113d430b could not be found. Oct 08 21:11:40.598133 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:11:40.598133 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:11:40.598133 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:11:40.598133 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:11:40.598133 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:11:40.598133 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:11:40.598133 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:11:40.598133 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:11:40.598133 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 159e29dd-802c-4059-99f9-bb7c113d430b could not be found. Oct 08 21:11:40.598133 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:11:40.598133 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-1270c04d-aedd-4a08-8303-845c75e53f9c tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Returning 404 to user: Instance 159e29dd-802c-4059-99f9-bb7c113d430b could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:11:40.598895 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-1270c04d-aedd-4a08-8303-845c75e53f9c tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] 10.222.0.26 "DELETE /compute/v2.1/servers/159e29dd-802c-4059-99f9-bb7c113d430b" status: 404 len: 111 microversion: 2.20 time: 0.085091 Oct 08 21:11:40.601341 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2271/4612] 10.222.0.26 () {60 vars in 1280 bytes} [Sat Oct 8 21:11:40 2022] DELETE /compute/v2.1/servers/159e29dd-802c-4059-99f9-bb7c113d430b => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 08 21:11:40.612538 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-ee5977dd-ae78-43fa-9915-9b9762546db7 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:11:40.615988 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-ee5977dd-ae78-43fa-9915-9b9762546db7 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] [instance: 159e29dd-802c-4059-99f9-bb7c113d430b] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:11:40.626222 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ee5977dd-ae78-43fa-9915-9b9762546db7 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:40.626732 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ee5977dd-ae78-43fa-9915-9b9762546db7 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:40.627232 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ee5977dd-ae78-43fa-9915-9b9762546db7 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:40.628437 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ee5977dd-ae78-43fa-9915-9b9762546db7 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:40.629310 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ee5977dd-ae78-43fa-9915-9b9762546db7 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:40.630050 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ee5977dd-ae78-43fa-9915-9b9762546db7 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:40.648936 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-ee5977dd-ae78-43fa-9915-9b9762546db7 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] HTTP exception thrown: Instance 159e29dd-802c-4059-99f9-bb7c113d430b could not be found. Oct 08 21:11:40.650792 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-ee5977dd-ae78-43fa-9915-9b9762546db7 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Request method failure captured: Oct 08 21:11:40.650792 ncdv-master-1 devstack@n-api.service[140491]: request: GET /compute/v2.1/servers/159e29dd-802c-4059-99f9-bb7c113d430b HTTP/1.1 Oct 08 21:11:40.650792 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:11:40.650792 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:11:40.650792 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:11:40.650792 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 21:11:40.650792 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:11:40.650792 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:11:40.650792 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:11:40.650792 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:11:40.650792 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeX1dfwQ899XpdMOtOJMQSu2NCEUW1Pb5XFJGbsJ10nw2woET0bsgI1wyutFUVeqysRZ016ChL6jEuP45EW13v5vp5hTuexOnuurE60XhoiZG-IK_OZURtPPZ1scS6vLEbSYQ0RZ5FDf1lySiWu-17QEYpUcIEOBkGcy7PtayWblSoc Oct 08 21:11:40.650792 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:11:40.650792 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:11:40.650792 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:11:40.650792 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:11:40.650792 ncdv-master-1 devstack@n-api.service[140491]: X-Openstack-Nova-Api-Version: 2.20 Oct 08 21:11:40.650792 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:11:40.650792 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:11:40.650792 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 665f66e846c24a6db01274679100bdbf Oct 08 21:11:40.650792 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1179861839 Oct 08 21:11:40.650792 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:11:40.650792 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:11:40.650792 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/665f66e846c24a6db01274679100bdbf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/665f66e846c24a6db01274679100bdbf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_665f66e846c24a6db01274679100bdbf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/665f66e846c24a6db01274679100bdbf"}]}] Oct 08 21:11:40.650792 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1179861839 Oct 08 21:11:40.650792 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 665f66e846c24a6db01274679100bdbf Oct 08 21:11:40.650792 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1179861839 Oct 08 21:11:40.650792 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-AttachVolumeShelveTestJSON-1179861839-project Oct 08 21:11:40.650792 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:11:40.650792 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:11:40.650792 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 21870fe169dc42359d9bdb149d0016d7 Oct 08 21:11:40.650792 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1179861839-project Oct 08 21:11:40.650792 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:11:40.650792 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance 159e29dd-802c-4059-99f9-bb7c113d430b could not be found. Oct 08 21:11:40.650792 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': '159e29dd-802c-4059-99f9-bb7c113d430b'} Oct 08 21:11:40.650792 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:11:40.650792 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:11:40.650792 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:11:40.650792 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:11:40.650792 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:11:40.650792 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:11:40.650792 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:11:40.650792 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:11:40.650792 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:11:40.650792 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:11:40.650792 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 159e29dd-802c-4059-99f9-bb7c113d430b could not be found. Oct 08 21:11:40.650792 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:11:40.650792 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:11:40.650792 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:11:40.650792 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:11:40.650792 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:11:40.650792 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:11:40.650792 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:11:40.650792 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:11:40.650792 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:11:40.650792 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:11:40.650792 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:11:40.650792 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:11:40.650792 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:11:40.650792 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:11:40.650792 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:11:40.650792 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:11:40.650792 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 159e29dd-802c-4059-99f9-bb7c113d430b could not be found. Oct 08 21:11:40.650792 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:11:40.650792 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:11:40.654884 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:11:40.654884 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:11:40.654884 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:11:40.654884 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:11:40.654884 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:11:40.654884 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:11:40.654884 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 159e29dd-802c-4059-99f9-bb7c113d430b could not be found. Oct 08 21:11:40.654884 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:11:40.655363 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-d404470e-c9c7-4a02-9727-ef00e314617e tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.126330 Oct 08 21:11:40.657589 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-ee5977dd-ae78-43fa-9915-9b9762546db7 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Returning 404 to user: Instance 159e29dd-802c-4059-99f9-bb7c113d430b could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:11:40.660126 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-ee5977dd-ae78-43fa-9915-9b9762546db7 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] 10.222.0.26 "GET /compute/v2.1/servers/159e29dd-802c-4059-99f9-bb7c113d430b" status: 404 len: 111 microversion: 2.20 time: 0.055812 Oct 08 21:11:40.661693 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2272/4614] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:11:40 2022] GET /compute/v2.1/servers/159e29dd-802c-4059-99f9-bb7c113d430b => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 08 21:11:40.661881 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2342/4614] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 21:11:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 4135 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 08 21:11:40.667909 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-8093f0c1-1d20-4543-8a6d-ef0329dbe102 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:11:40.669082 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-8093f0c1-1d20-4543-8a6d-ef0329dbe102 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: 71182b09-915d-48cd-b56b-dc1ee940ade1] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:11:40.910622 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-d7a564d2-73a1-48e9-b8ff-df7d7ecba5d3 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:11:40.917512 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-d7a564d2-73a1-48e9-b8ff-df7d7ecba5d3 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:11:40.942874 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d7a564d2-73a1-48e9-b8ff-df7d7ecba5d3 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:40.947015 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d7a564d2-73a1-48e9-b8ff-df7d7ecba5d3 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:40.952694 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d7a564d2-73a1-48e9-b8ff-df7d7ecba5d3 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:40.954098 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d7a564d2-73a1-48e9-b8ff-df7d7ecba5d3 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:40.955878 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d7a564d2-73a1-48e9-b8ff-df7d7ecba5d3 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:40.959489 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d7a564d2-73a1-48e9-b8ff-df7d7ecba5d3 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:41.432493 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-8093f0c1-1d20-4543-8a6d-ef0329dbe102 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78e9afd772c4de981cac8f5817ec356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765c62cac2ee4406b23a5baa85c52ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:11:41.441022 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-8093f0c1-1d20-4543-8a6d-ef0329dbe102 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/71182b09-915d-48cd-b56b-dc1ee940ade1" status: 200 len: 1215 microversion: 2.1 time: 0.777386 Oct 08 21:11:41.446383 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2343/4615] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:11:40 2022] GET /compute/v2.1/servers/71182b09-915d-48cd-b56b-dc1ee940ade1 => generated 1215 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:11:42.341546 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-de3961f6-6024-4335-beca-bd741c9ac13c tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:11:42.342264 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-de3961f6-6024-4335-beca-bd741c9ac13c tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] [instance: dbacaeed-a40b-4e05-9635-5073dfdd8621] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:11:42.361153 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-de3961f6-6024-4335-beca-bd741c9ac13c tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:42.362423 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-de3961f6-6024-4335-beca-bd741c9ac13c tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:42.366724 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-de3961f6-6024-4335-beca-bd741c9ac13c tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:42.371346 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-de3961f6-6024-4335-beca-bd741c9ac13c tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:42.372833 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-de3961f6-6024-4335-beca-bd741c9ac13c tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:42.375783 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-de3961f6-6024-4335-beca-bd741c9ac13c tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:42.437612 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-de3961f6-6024-4335-beca-bd741c9ac13c tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] HTTP exception thrown: Instance dbacaeed-a40b-4e05-9635-5073dfdd8621 could not be found. Oct 08 21:11:42.446543 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-de3961f6-6024-4335-beca-bd741c9ac13c tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Request method failure captured: Oct 08 21:11:42.446543 ncdv-master-1 devstack@n-api.service[140492]: request: DELETE /compute/v2.1/servers/dbacaeed-a40b-4e05-9635-5073dfdd8621 HTTP/1.1 Oct 08 21:11:42.446543 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:11:42.446543 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:11:42.446543 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:11:42.446543 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 21:11:42.446543 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:11:42.446543 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:11:42.446543 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:11:42.446543 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:11:42.446543 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeX1dfwQ899XpdMOtOJMQSu2NCEUW1Pb5XFJGbsJ10nw2woET0bsgI1wyutFUVeqysRZ016ChL6jEuP45EW13v5vp5hTuexOnuurE60XhoiZG-IK_OZURtPPZ1scS6vLEbSYQ0RZ5FDf1lySiWu-17QEYpUcIEOBkGcy7PtayWblSoc Oct 08 21:11:42.446543 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:11:42.446543 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:11:42.446543 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:11:42.446543 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:11:42.446543 ncdv-master-1 devstack@n-api.service[140492]: X-Openstack-Nova-Api-Version: 2.20 Oct 08 21:11:42.446543 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:11:42.446543 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:11:42.446543 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 665f66e846c24a6db01274679100bdbf Oct 08 21:11:42.446543 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1179861839 Oct 08 21:11:42.446543 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:11:42.446543 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:11:42.446543 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/665f66e846c24a6db01274679100bdbf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/665f66e846c24a6db01274679100bdbf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_665f66e846c24a6db01274679100bdbf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/665f66e846c24a6db01274679100bdbf"}]}] Oct 08 21:11:42.446543 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1179861839 Oct 08 21:11:42.446543 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 665f66e846c24a6db01274679100bdbf Oct 08 21:11:42.446543 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1179861839 Oct 08 21:11:42.446543 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-AttachVolumeShelveTestJSON-1179861839-project Oct 08 21:11:42.446543 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:11:42.446543 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:11:42.446543 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 21870fe169dc42359d9bdb149d0016d7 Oct 08 21:11:42.446543 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1179861839-project Oct 08 21:11:42.446543 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 21:11:42.446543 ncdv-master-1 devstack@n-api.service[140492]: exception: Instance dbacaeed-a40b-4e05-9635-5073dfdd8621 could not be found. Oct 08 21:11:42.446543 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': 'dbacaeed-a40b-4e05-9635-5073dfdd8621'} Oct 08 21:11:42.446543 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:11:42.446543 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:11:42.446543 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:11:42.446543 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:11:42.446543 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:11:42.446543 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:11:42.446543 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:11:42.446543 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:11:42.446543 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:11:42.446543 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:11:42.446543 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dbacaeed-a40b-4e05-9635-5073dfdd8621 could not be found. Oct 08 21:11:42.446543 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:11:42.446543 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:11:42.446543 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:11:42.446543 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:11:42.446543 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:11:42.446543 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:11:42.446543 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:11:42.446543 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:11:42.446543 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:11:42.446543 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:11:42.446543 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 08 21:11:42.446543 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 08 21:11:42.446543 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 08 21:11:42.446543 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 08 21:11:42.446543 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:11:42.446543 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:11:42.446543 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:11:42.446543 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:11:42.450772 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dbacaeed-a40b-4e05-9635-5073dfdd8621 could not be found. Oct 08 21:11:42.450772 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:11:42.450772 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:11:42.450772 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:11:42.450772 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:11:42.450772 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:11:42.450772 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:11:42.450772 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:11:42.450772 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:11:42.450772 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dbacaeed-a40b-4e05-9635-5073dfdd8621 could not be found. Oct 08 21:11:42.450772 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:11:42.458221 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-de3961f6-6024-4335-beca-bd741c9ac13c tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Returning 404 to user: Instance dbacaeed-a40b-4e05-9635-5073dfdd8621 could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:11:42.465561 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-de3961f6-6024-4335-beca-bd741c9ac13c tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] 10.222.0.26 "DELETE /compute/v2.1/servers/dbacaeed-a40b-4e05-9635-5073dfdd8621" status: 404 len: 111 microversion: 2.20 time: 0.126929 Oct 08 21:11:42.468255 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2344/4616] 10.222.0.26 () {60 vars in 1280 bytes} [Sat Oct 8 21:11:42 2022] DELETE /compute/v2.1/servers/dbacaeed-a40b-4e05-9635-5073dfdd8621 => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 08 21:11:42.480181 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-15b3ed13-1914-412a-a856-bee0d42189d3 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:11:42.482245 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-15b3ed13-1914-412a-a856-bee0d42189d3 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: 71182b09-915d-48cd-b56b-dc1ee940ade1] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:11:42.516095 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-15b3ed13-1914-412a-a856-bee0d42189d3 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:42.520486 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-15b3ed13-1914-412a-a856-bee0d42189d3 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:42.521997 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-15b3ed13-1914-412a-a856-bee0d42189d3 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:42.524700 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-15b3ed13-1914-412a-a856-bee0d42189d3 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:42.527258 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-15b3ed13-1914-412a-a856-bee0d42189d3 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:42.528035 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-15b3ed13-1914-412a-a856-bee0d42189d3 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:42.788812 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-d7a564d2-73a1-48e9-b8ff-df7d7ecba5d3 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:11:42.798976 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:11:42.806264 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-d7a564d2-73a1-48e9-b8ff-df7d7ecba5d3 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 200 len: 1516 microversion: 2.1 time: 1.910836 Oct 08 21:11:42.810629 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2273/4617] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:11:40 2022] GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 1516 bytes in 1916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:11:42.826110 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c9bf5a4e-fbc0-4c2a-8768-69deb23ae433 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:11:42.831244 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-c9bf5a4e-fbc0-4c2a-8768-69deb23ae433 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] [instance: dbacaeed-a40b-4e05-9635-5073dfdd8621] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:11:42.842061 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=2 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:11:42.846124 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c9bf5a4e-fbc0-4c2a-8768-69deb23ae433 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:42.847867 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c9bf5a4e-fbc0-4c2a-8768-69deb23ae433 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:42.850078 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c9bf5a4e-fbc0-4c2a-8768-69deb23ae433 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:42.852607 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c9bf5a4e-fbc0-4c2a-8768-69deb23ae433 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:42.853972 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c9bf5a4e-fbc0-4c2a-8768-69deb23ae433 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:42.857215 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c9bf5a4e-fbc0-4c2a-8768-69deb23ae433 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:42.883965 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-15b3ed13-1914-412a-a856-bee0d42189d3 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78e9afd772c4de981cac8f5817ec356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765c62cac2ee4406b23a5baa85c52ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:11:42.911866 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-15b3ed13-1914-412a-a856-bee0d42189d3 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/71182b09-915d-48cd-b56b-dc1ee940ade1" status: 200 len: 1211 microversion: 2.1 time: 0.436377 Oct 08 21:11:42.914164 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-c9bf5a4e-fbc0-4c2a-8768-69deb23ae433 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] HTTP exception thrown: Instance dbacaeed-a40b-4e05-9635-5073dfdd8621 could not be found. Oct 08 21:11:42.917987 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2345/4618] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:11:42 2022] GET /compute/v2.1/servers/71182b09-915d-48cd-b56b-dc1ee940ade1 => generated 1211 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:11:42.920189 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c9bf5a4e-fbc0-4c2a-8768-69deb23ae433 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Request method failure captured: Oct 08 21:11:42.920189 ncdv-master-1 devstack@n-api.service[140491]: request: GET /compute/v2.1/servers/dbacaeed-a40b-4e05-9635-5073dfdd8621 HTTP/1.1 Oct 08 21:11:42.920189 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:11:42.920189 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:11:42.920189 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:11:42.920189 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 21:11:42.920189 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:11:42.920189 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:11:42.920189 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:11:42.920189 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:11:42.920189 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeX1dfwQ899XpdMOtOJMQSu2NCEUW1Pb5XFJGbsJ10nw2woET0bsgI1wyutFUVeqysRZ016ChL6jEuP45EW13v5vp5hTuexOnuurE60XhoiZG-IK_OZURtPPZ1scS6vLEbSYQ0RZ5FDf1lySiWu-17QEYpUcIEOBkGcy7PtayWblSoc Oct 08 21:11:42.920189 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:11:42.920189 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:11:42.920189 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:11:42.920189 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:11:42.920189 ncdv-master-1 devstack@n-api.service[140491]: X-Openstack-Nova-Api-Version: 2.20 Oct 08 21:11:42.920189 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:11:42.920189 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:11:42.920189 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 665f66e846c24a6db01274679100bdbf Oct 08 21:11:42.920189 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1179861839 Oct 08 21:11:42.920189 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:11:42.920189 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:11:42.920189 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/665f66e846c24a6db01274679100bdbf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/665f66e846c24a6db01274679100bdbf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_665f66e846c24a6db01274679100bdbf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/665f66e846c24a6db01274679100bdbf"}]}] Oct 08 21:11:42.920189 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1179861839 Oct 08 21:11:42.920189 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 665f66e846c24a6db01274679100bdbf Oct 08 21:11:42.920189 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1179861839 Oct 08 21:11:42.920189 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-AttachVolumeShelveTestJSON-1179861839-project Oct 08 21:11:42.920189 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:11:42.920189 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:11:42.920189 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 21870fe169dc42359d9bdb149d0016d7 Oct 08 21:11:42.920189 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1179861839-project Oct 08 21:11:42.920189 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:11:42.920189 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance dbacaeed-a40b-4e05-9635-5073dfdd8621 could not be found. Oct 08 21:11:42.920189 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': 'dbacaeed-a40b-4e05-9635-5073dfdd8621'} Oct 08 21:11:42.920189 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:11:42.920189 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:11:42.920189 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:11:42.920189 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:11:42.920189 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:11:42.920189 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:11:42.920189 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:11:42.920189 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:11:42.920189 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:11:42.920189 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:11:42.920189 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dbacaeed-a40b-4e05-9635-5073dfdd8621 could not be found. Oct 08 21:11:42.920189 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:11:42.920189 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:11:42.920189 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:11:42.920189 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:11:42.920189 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:11:42.920189 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:11:42.920189 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:11:42.920189 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:11:42.920189 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:11:42.920189 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:11:42.920189 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:11:42.920189 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:11:42.920189 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:11:42.920189 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:11:42.920189 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:11:42.920189 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:11:42.920189 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dbacaeed-a40b-4e05-9635-5073dfdd8621 could not be found. Oct 08 21:11:42.920189 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:11:42.920189 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:11:42.924572 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:11:42.924572 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:11:42.924572 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:11:42.924572 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:11:42.924572 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:11:42.924572 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:11:42.924572 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dbacaeed-a40b-4e05-9635-5073dfdd8621 could not be found. Oct 08 21:11:42.924572 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:11:42.927111 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c9bf5a4e-fbc0-4c2a-8768-69deb23ae433 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] Returning 404 to user: Instance dbacaeed-a40b-4e05-9635-5073dfdd8621 could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:11:42.928757 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-c9bf5a4e-fbc0-4c2a-8768-69deb23ae433 tempest-AttachVolumeShelveTestJSON-1179861839 tempest-AttachVolumeShelveTestJSON-1179861839-project] 10.222.0.26 "GET /compute/v2.1/servers/dbacaeed-a40b-4e05-9635-5073dfdd8621" status: 404 len: 111 microversion: 2.20 time: 0.112368 Oct 08 21:11:42.932041 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2274/4619] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:11:42 2022] GET /compute/v2.1/servers/dbacaeed-a40b-4e05-9635-5073dfdd8621 => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 08 21:11:43.836598 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-43be639b-1ee2-4a7a-a2e4-e8d577d78400 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:11:43.838337 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-43be639b-1ee2-4a7a-a2e4-e8d577d78400 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:11:43.875945 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-43be639b-1ee2-4a7a-a2e4-e8d577d78400 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:43.883371 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-43be639b-1ee2-4a7a-a2e4-e8d577d78400 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:43.894018 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-43be639b-1ee2-4a7a-a2e4-e8d577d78400 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:43.894018 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-43be639b-1ee2-4a7a-a2e4-e8d577d78400 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:43.894018 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-43be639b-1ee2-4a7a-a2e4-e8d577d78400 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:43.894018 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-43be639b-1ee2-4a7a-a2e4-e8d577d78400 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:43.944385 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-d94d9cbd-41d8-49b0-9ecd-833c15d8e35e tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:11:43.946050 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-d94d9cbd-41d8-49b0-9ecd-833c15d8e35e tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: 71182b09-915d-48cd-b56b-dc1ee940ade1] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:11:43.974570 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d94d9cbd-41d8-49b0-9ecd-833c15d8e35e tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:43.990071 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d94d9cbd-41d8-49b0-9ecd-833c15d8e35e tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:43.997495 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d94d9cbd-41d8-49b0-9ecd-833c15d8e35e tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:43.998467 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d94d9cbd-41d8-49b0-9ecd-833c15d8e35e tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:44.002109 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d94d9cbd-41d8-49b0-9ecd-833c15d8e35e tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:44.006814 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d94d9cbd-41d8-49b0-9ecd-833c15d8e35e tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:45.872627 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-d94d9cbd-41d8-49b0-9ecd-833c15d8e35e tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78e9afd772c4de981cac8f5817ec356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765c62cac2ee4406b23a5baa85c52ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:11:45.884687 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-d94d9cbd-41d8-49b0-9ecd-833c15d8e35e tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/71182b09-915d-48cd-b56b-dc1ee940ade1" status: 200 len: 1275 microversion: 2.1 time: 1.945012 Oct 08 21:11:45.890961 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2275/4620] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:11:43 2022] GET /compute/v2.1/servers/71182b09-915d-48cd-b56b-dc1ee940ade1 => generated 1275 bytes in 1952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:11:46.510380 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-43be639b-1ee2-4a7a-a2e4-e8d577d78400 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:11:46.528704 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-43be639b-1ee2-4a7a-a2e4-e8d577d78400 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 200 len: 1516 microversion: 2.1 time: 2.697076 Oct 08 21:11:46.533420 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2346/4621] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:11:43 2022] GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 1516 bytes in 2702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:11:46.916582 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c012df24-650c-4bac-8915-5a7698138f82 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:11:46.917216 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-c012df24-650c-4bac-8915-5a7698138f82 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: 71182b09-915d-48cd-b56b-dc1ee940ade1] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:11:46.955815 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c012df24-650c-4bac-8915-5a7698138f82 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:46.963214 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c012df24-650c-4bac-8915-5a7698138f82 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:46.963848 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c012df24-650c-4bac-8915-5a7698138f82 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:46.964634 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c012df24-650c-4bac-8915-5a7698138f82 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:46.965113 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c012df24-650c-4bac-8915-5a7698138f82 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:46.965580 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c012df24-650c-4bac-8915-5a7698138f82 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:47.158843 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-c012df24-650c-4bac-8915-5a7698138f82 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78e9afd772c4de981cac8f5817ec356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765c62cac2ee4406b23a5baa85c52ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:11:47.170589 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-c012df24-650c-4bac-8915-5a7698138f82 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/71182b09-915d-48cd-b56b-dc1ee940ade1" status: 200 len: 1273 microversion: 2.1 time: 0.258114 Oct 08 21:11:47.172464 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2276/4622] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:11:46 2022] GET /compute/v2.1/servers/71182b09-915d-48cd-b56b-dc1ee940ade1 => generated 1273 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:11:47.559236 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-c8641b39-58c1-4288-a1ca-28267529bae2 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:11:47.559833 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-c8641b39-58c1-4288-a1ca-28267529bae2 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:11:47.574824 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:11:47.581399 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c8641b39-58c1-4288-a1ca-28267529bae2 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:47.581908 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c8641b39-58c1-4288-a1ca-28267529bae2 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:47.582370 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c8641b39-58c1-4288-a1ca-28267529bae2 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:47.592597 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c8641b39-58c1-4288-a1ca-28267529bae2 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:47.595682 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c8641b39-58c1-4288-a1ca-28267529bae2 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:47.595682 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c8641b39-58c1-4288-a1ca-28267529bae2 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:48.198071 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-04afbe43-335e-4c66-b6ed-0c49b4cab4d9 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:11:48.198872 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-04afbe43-335e-4c66-b6ed-0c49b4cab4d9 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: 71182b09-915d-48cd-b56b-dc1ee940ade1] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:11:48.219186 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-04afbe43-335e-4c66-b6ed-0c49b4cab4d9 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:48.219995 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-04afbe43-335e-4c66-b6ed-0c49b4cab4d9 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:48.220741 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-04afbe43-335e-4c66-b6ed-0c49b4cab4d9 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:48.222014 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-04afbe43-335e-4c66-b6ed-0c49b4cab4d9 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:48.223527 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-04afbe43-335e-4c66-b6ed-0c49b4cab4d9 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:48.236542 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-04afbe43-335e-4c66-b6ed-0c49b4cab4d9 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:48.732807 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-04afbe43-335e-4c66-b6ed-0c49b4cab4d9 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78e9afd772c4de981cac8f5817ec356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765c62cac2ee4406b23a5baa85c52ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:11:48.746387 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-04afbe43-335e-4c66-b6ed-0c49b4cab4d9 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/71182b09-915d-48cd-b56b-dc1ee940ade1" status: 200 len: 1273 microversion: 2.1 time: 0.553216 Oct 08 21:11:48.747874 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2277/4623] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:11:48 2022] GET /compute/v2.1/servers/71182b09-915d-48cd-b56b-dc1ee940ade1 => generated 1273 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:11:48.876331 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-c8641b39-58c1-4288-a1ca-28267529bae2 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:11:48.898002 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-c8641b39-58c1-4288-a1ca-28267529bae2 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 200 len: 1516 microversion: 2.1 time: 1.340295 Oct 08 21:11:48.900015 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2347/4624] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:11:47 2022] GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 1516 bytes in 1345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:11:49.772416 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-84ce2640-9e0f-4251-bcae-809d4db40960 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:11:49.773768 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-84ce2640-9e0f-4251-bcae-809d4db40960 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: 71182b09-915d-48cd-b56b-dc1ee940ade1] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:11:49.786094 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-84ce2640-9e0f-4251-bcae-809d4db40960 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:49.787996 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-84ce2640-9e0f-4251-bcae-809d4db40960 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:49.789093 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-84ce2640-9e0f-4251-bcae-809d4db40960 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:49.790080 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-84ce2640-9e0f-4251-bcae-809d4db40960 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:49.790798 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-84ce2640-9e0f-4251-bcae-809d4db40960 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:49.791446 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-84ce2640-9e0f-4251-bcae-809d4db40960 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:49.926081 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-c050dc53-4379-4342-858c-156fee5c082b tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:11:49.926866 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-c050dc53-4379-4342-858c-156fee5c082b tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:11:49.941824 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c050dc53-4379-4342-858c-156fee5c082b tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:49.944789 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c050dc53-4379-4342-858c-156fee5c082b tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:49.945726 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c050dc53-4379-4342-858c-156fee5c082b tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:49.952811 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c050dc53-4379-4342-858c-156fee5c082b tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:49.953945 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c050dc53-4379-4342-858c-156fee5c082b tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:49.955461 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c050dc53-4379-4342-858c-156fee5c082b tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:50.190508 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-84ce2640-9e0f-4251-bcae-809d4db40960 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78e9afd772c4de981cac8f5817ec356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765c62cac2ee4406b23a5baa85c52ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:11:50.201778 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-84ce2640-9e0f-4251-bcae-809d4db40960 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/71182b09-915d-48cd-b56b-dc1ee940ade1" status: 200 len: 1315 microversion: 2.1 time: 0.433549 Oct 08 21:11:50.202459 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2278/4625] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:11:49 2022] GET /compute/v2.1/servers/71182b09-915d-48cd-b56b-dc1ee940ade1 => generated 1315 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:11:50.328060 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=2 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:11:50.751162 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-c050dc53-4379-4342-858c-156fee5c082b tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:11:50.767961 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-c050dc53-4379-4342-858c-156fee5c082b tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 200 len: 1516 microversion: 2.1 time: 0.846066 Oct 08 21:11:50.768590 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2348/4626] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:11:49 2022] GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 1516 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:11:51.229876 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-6e63abd5-3b47-437e-abfc-968945576500 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:11:51.231148 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-6e63abd5-3b47-437e-abfc-968945576500 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: 71182b09-915d-48cd-b56b-dc1ee940ade1] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:11:51.238384 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6e63abd5-3b47-437e-abfc-968945576500 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:51.245418 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6e63abd5-3b47-437e-abfc-968945576500 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:51.246421 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6e63abd5-3b47-437e-abfc-968945576500 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:51.249129 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6e63abd5-3b47-437e-abfc-968945576500 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:51.249891 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6e63abd5-3b47-437e-abfc-968945576500 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:51.253302 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6e63abd5-3b47-437e-abfc-968945576500 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:51.717799 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-6e63abd5-3b47-437e-abfc-968945576500 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78e9afd772c4de981cac8f5817ec356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765c62cac2ee4406b23a5baa85c52ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:11:51.730817 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-6e63abd5-3b47-437e-abfc-968945576500 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/71182b09-915d-48cd-b56b-dc1ee940ade1" status: 200 len: 1315 microversion: 2.1 time: 0.505985 Oct 08 21:11:51.731423 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2279/4627] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:11:51 2022] GET /compute/v2.1/servers/71182b09-915d-48cd-b56b-dc1ee940ade1 => generated 1315 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:11:51.796310 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-42d9e6c5-6ace-438c-8d50-3b3ae292fc25 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:11:51.796942 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-42d9e6c5-6ace-438c-8d50-3b3ae292fc25 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:11:51.803620 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=8 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:11:51.805154 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-42d9e6c5-6ace-438c-8d50-3b3ae292fc25 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:51.805973 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-42d9e6c5-6ace-438c-8d50-3b3ae292fc25 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:51.806640 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-42d9e6c5-6ace-438c-8d50-3b3ae292fc25 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:51.807595 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-42d9e6c5-6ace-438c-8d50-3b3ae292fc25 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:51.808247 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-42d9e6c5-6ace-438c-8d50-3b3ae292fc25 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:51.808866 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-42d9e6c5-6ace-438c-8d50-3b3ae292fc25 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:52.497129 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-42d9e6c5-6ace-438c-8d50-3b3ae292fc25 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:11:52.509932 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-42d9e6c5-6ace-438c-8d50-3b3ae292fc25 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 200 len: 1516 microversion: 2.1 time: 0.717442 Oct 08 21:11:52.510849 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2349/4628] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:11:51 2022] GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 1516 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:11:52.767199 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-a475b105-e314-4e16-8cc7-ea7adfa24643 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:11:52.767830 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-a475b105-e314-4e16-8cc7-ea7adfa24643 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: 71182b09-915d-48cd-b56b-dc1ee940ade1] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:11:52.787996 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a475b105-e314-4e16-8cc7-ea7adfa24643 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:52.788546 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a475b105-e314-4e16-8cc7-ea7adfa24643 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:52.789015 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a475b105-e314-4e16-8cc7-ea7adfa24643 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:52.790331 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a475b105-e314-4e16-8cc7-ea7adfa24643 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:52.790828 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a475b105-e314-4e16-8cc7-ea7adfa24643 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:52.791284 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a475b105-e314-4e16-8cc7-ea7adfa24643 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:53.113275 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-a475b105-e314-4e16-8cc7-ea7adfa24643 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78e9afd772c4de981cac8f5817ec356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765c62cac2ee4406b23a5baa85c52ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:11:53.125505 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-a475b105-e314-4e16-8cc7-ea7adfa24643 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/71182b09-915d-48cd-b56b-dc1ee940ade1" status: 200 len: 1315 microversion: 2.1 time: 0.370651 Oct 08 21:11:53.141372 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2280/4629] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:11:52 2022] GET /compute/v2.1/servers/71182b09-915d-48cd-b56b-dc1ee940ade1 => generated 1315 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:11:53.539269 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-00bd3aaf-f5de-48b6-95ba-45b43edbcdea tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:11:53.541159 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-0f5a7540-f1ac-436f-ae32-28e06a2b8679 req-541186d1-cfc2-4373-9fe6-6f16895974d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71182b09-915d-48cd-b56b-dc1ee940ade1", "tag": "920b1a5f-23dd-4250-8862-421852054ba1"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:11:53.545489 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-00bd3aaf-f5de-48b6-95ba-45b43edbcdea tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:11:53.560049 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-00bd3aaf-f5de-48b6-95ba-45b43edbcdea tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:53.560559 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-00bd3aaf-f5de-48b6-95ba-45b43edbcdea tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:53.561025 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-00bd3aaf-f5de-48b6-95ba-45b43edbcdea tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:53.569840 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-00bd3aaf-f5de-48b6-95ba-45b43edbcdea tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:53.571853 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-00bd3aaf-f5de-48b6-95ba-45b43edbcdea tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:53.573073 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-00bd3aaf-f5de-48b6-95ba-45b43edbcdea tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:53.580858 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-0f5a7540-f1ac-436f-ae32-28e06a2b8679 req-541186d1-cfc2-4373-9fe6-6f16895974d9 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:53.583423 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-0f5a7540-f1ac-436f-ae32-28e06a2b8679 req-541186d1-cfc2-4373-9fe6-6f16895974d9 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:53.584702 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-0f5a7540-f1ac-436f-ae32-28e06a2b8679 req-541186d1-cfc2-4373-9fe6-6f16895974d9 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:53.636063 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-0f5a7540-f1ac-436f-ae32-28e06a2b8679 req-541186d1-cfc2-4373-9fe6-6f16895974d9 service nova] Creating event network-changed:920b1a5f-23dd-4250-8862-421852054ba1 for instance 71182b09-915d-48cd-b56b-dc1ee940ade1 on nch1-master-1 Oct 08 21:11:53.654714 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-0f5a7540-f1ac-436f-ae32-28e06a2b8679 req-541186d1-cfc2-4373-9fe6-6f16895974d9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120800 Oct 08 21:11:53.655356 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2350/4630] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:11:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 08 21:11:54.150002 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-c3eebf92-9660-472e-8e1e-9e570dfd1558 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:11:54.150553 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-c3eebf92-9660-472e-8e1e-9e570dfd1558 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: 71182b09-915d-48cd-b56b-dc1ee940ade1] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:11:54.170433 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c3eebf92-9660-472e-8e1e-9e570dfd1558 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:54.170955 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c3eebf92-9660-472e-8e1e-9e570dfd1558 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:54.173896 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c3eebf92-9660-472e-8e1e-9e570dfd1558 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:54.174813 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c3eebf92-9660-472e-8e1e-9e570dfd1558 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:54.175494 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c3eebf92-9660-472e-8e1e-9e570dfd1558 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:54.176401 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c3eebf92-9660-472e-8e1e-9e570dfd1558 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:54.371434 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-00bd3aaf-f5de-48b6-95ba-45b43edbcdea tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:11:54.380010 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-00bd3aaf-f5de-48b6-95ba-45b43edbcdea tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 200 len: 1516 microversion: 2.1 time: 0.849022 Oct 08 21:11:54.388662 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2281/4631] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:11:53 2022] GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 1516 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:11:54.984388 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-1f5d4236-2c79-42ab-bed9-9ed47950be3e req-1dbb86ef-1a14-4f59-999d-e34f6fc7ad08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2548207-aa57-4e4c-876b-2027b59283d2", "name": "network-vif-plugged", "status": "completed", "tag": "1900770b-2820-49c0-af24-1c780eb5f1e0"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:11:55.024620 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-1f5d4236-2c79-42ab-bed9-9ed47950be3e req-1dbb86ef-1a14-4f59-999d-e34f6fc7ad08 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:55.029860 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-1f5d4236-2c79-42ab-bed9-9ed47950be3e req-1dbb86ef-1a14-4f59-999d-e34f6fc7ad08 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:55.033814 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-1f5d4236-2c79-42ab-bed9-9ed47950be3e req-1dbb86ef-1a14-4f59-999d-e34f6fc7ad08 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:55.102231 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-1f5d4236-2c79-42ab-bed9-9ed47950be3e req-1dbb86ef-1a14-4f59-999d-e34f6fc7ad08 service nova] Creating event network-vif-plugged:1900770b-2820-49c0-af24-1c780eb5f1e0 for instance e2548207-aa57-4e4c-876b-2027b59283d2 on nch1-master-1 Oct 08 21:11:55.124628 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-1f5d4236-2c79-42ab-bed9-9ed47950be3e req-1dbb86ef-1a14-4f59-999d-e34f6fc7ad08 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142096 Oct 08 21:11:55.127344 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2282/4632] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:11:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:11:55.414733 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-51d6a111-9c9c-478c-a7bf-a0a93a56df76 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:11:55.416239 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-51d6a111-9c9c-478c-a7bf-a0a93a56df76 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:11:55.431262 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-51d6a111-9c9c-478c-a7bf-a0a93a56df76 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:55.433905 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-51d6a111-9c9c-478c-a7bf-a0a93a56df76 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:55.439531 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-51d6a111-9c9c-478c-a7bf-a0a93a56df76 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:55.440628 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-51d6a111-9c9c-478c-a7bf-a0a93a56df76 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:55.441391 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-51d6a111-9c9c-478c-a7bf-a0a93a56df76 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:55.442407 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-51d6a111-9c9c-478c-a7bf-a0a93a56df76 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:55.850202 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-51d6a111-9c9c-478c-a7bf-a0a93a56df76 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:11:55.867045 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-51d6a111-9c9c-478c-a7bf-a0a93a56df76 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 200 len: 1516 microversion: 2.1 time: 0.457057 Oct 08 21:11:55.881867 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2283/4633] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:11:55 2022] GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 1516 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:11:56.134404 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-c3eebf92-9660-472e-8e1e-9e570dfd1558 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78e9afd772c4de981cac8f5817ec356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765c62cac2ee4406b23a5baa85c52ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:11:56.142431 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-c3eebf92-9660-472e-8e1e-9e570dfd1558 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/71182b09-915d-48cd-b56b-dc1ee940ade1" status: 200 len: 1315 microversion: 2.1 time: 1.997988 Oct 08 21:11:56.148528 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2351/4634] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:11:54 2022] GET /compute/v2.1/servers/71182b09-915d-48cd-b56b-dc1ee940ade1 => generated 1315 bytes in 2005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:11:56.910022 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c95d26d2-fdf4-4d91-a8f4-9ce4c33adb4c tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:11:56.910657 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-c95d26d2-fdf4-4d91-a8f4-9ce4c33adb4c tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:11:56.947115 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c95d26d2-fdf4-4d91-a8f4-9ce4c33adb4c tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:56.951605 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c95d26d2-fdf4-4d91-a8f4-9ce4c33adb4c tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:56.952132 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c95d26d2-fdf4-4d91-a8f4-9ce4c33adb4c tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:56.959624 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c95d26d2-fdf4-4d91-a8f4-9ce4c33adb4c tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:56.960422 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c95d26d2-fdf4-4d91-a8f4-9ce4c33adb4c tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:56.963454 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c95d26d2-fdf4-4d91-a8f4-9ce4c33adb4c tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:57.172531 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-114baa20-f7f6-4884-a3dd-267b140e74a4 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:11:57.173171 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-114baa20-f7f6-4884-a3dd-267b140e74a4 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: 71182b09-915d-48cd-b56b-dc1ee940ade1] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:11:57.188736 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-114baa20-f7f6-4884-a3dd-267b140e74a4 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:57.193984 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-114baa20-f7f6-4884-a3dd-267b140e74a4 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:57.196646 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-114baa20-f7f6-4884-a3dd-267b140e74a4 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:57.197815 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-114baa20-f7f6-4884-a3dd-267b140e74a4 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:57.200930 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-114baa20-f7f6-4884-a3dd-267b140e74a4 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:57.201439 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-114baa20-f7f6-4884-a3dd-267b140e74a4 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:57.544600 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-114baa20-f7f6-4884-a3dd-267b140e74a4 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78e9afd772c4de981cac8f5817ec356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765c62cac2ee4406b23a5baa85c52ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:11:57.558843 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-114baa20-f7f6-4884-a3dd-267b140e74a4 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/71182b09-915d-48cd-b56b-dc1ee940ade1" status: 200 len: 1315 microversion: 2.1 time: 0.393708 Oct 08 21:11:57.563363 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2352/4635] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:11:57 2022] GET /compute/v2.1/servers/71182b09-915d-48cd-b56b-dc1ee940ade1 => generated 1315 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:11:57.702530 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-c95d26d2-fdf4-4d91-a8f4-9ce4c33adb4c tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:11:57.717354 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-c95d26d2-fdf4-4d91-a8f4-9ce4c33adb4c tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 200 len: 1516 microversion: 2.1 time: 0.810836 Oct 08 21:11:57.733697 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2284/4636] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:11:56 2022] GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 1516 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:11:58.586592 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e1e583a6-d2bc-486b-b1c6-ff40b2392726 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:11:58.587925 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-e1e583a6-d2bc-486b-b1c6-ff40b2392726 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: 71182b09-915d-48cd-b56b-dc1ee940ade1] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:11:58.605146 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e1e583a6-d2bc-486b-b1c6-ff40b2392726 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:58.607749 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e1e583a6-d2bc-486b-b1c6-ff40b2392726 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:58.608574 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e1e583a6-d2bc-486b-b1c6-ff40b2392726 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:58.609953 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e1e583a6-d2bc-486b-b1c6-ff40b2392726 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:58.611741 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e1e583a6-d2bc-486b-b1c6-ff40b2392726 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:58.613013 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e1e583a6-d2bc-486b-b1c6-ff40b2392726 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:58.743665 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-3858f638-3ce4-48c5-bf9e-27e38d51da8c tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:11:58.745137 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-3858f638-3ce4-48c5-bf9e-27e38d51da8c tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:11:58.758444 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3858f638-3ce4-48c5-bf9e-27e38d51da8c tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:58.759505 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3858f638-3ce4-48c5-bf9e-27e38d51da8c tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:58.764308 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3858f638-3ce4-48c5-bf9e-27e38d51da8c tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:58.771503 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3858f638-3ce4-48c5-bf9e-27e38d51da8c tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:58.772205 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3858f638-3ce4-48c5-bf9e-27e38d51da8c tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:58.774577 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3858f638-3ce4-48c5-bf9e-27e38d51da8c tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:59.191604 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-3858f638-3ce4-48c5-bf9e-27e38d51da8c tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:11:59.214426 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-3858f638-3ce4-48c5-bf9e-27e38d51da8c tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 200 len: 1503 microversion: 2.1 time: 0.476138 Oct 08 21:11:59.233474 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2285/4637] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:11:58 2022] GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 1503 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:11:59.243432 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-6fde4277-d70d-446d-8368-56972f48bbbd tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:11:59.244060 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-6fde4277-d70d-446d-8368-56972f48bbbd tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:11:59.264517 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6fde4277-d70d-446d-8368-56972f48bbbd tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:59.265442 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6fde4277-d70d-446d-8368-56972f48bbbd tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:59.266142 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6fde4277-d70d-446d-8368-56972f48bbbd tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:59.271794 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6fde4277-d70d-446d-8368-56972f48bbbd tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:59.272620 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6fde4277-d70d-446d-8368-56972f48bbbd tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:59.273341 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6fde4277-d70d-446d-8368-56972f48bbbd tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:59.549810 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-e1e583a6-d2bc-486b-b1c6-ff40b2392726 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78e9afd772c4de981cac8f5817ec356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765c62cac2ee4406b23a5baa85c52ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:11:59.564980 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-6fde4277-d70d-446d-8368-56972f48bbbd tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:11:59.576450 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-6fde4277-d70d-446d-8368-56972f48bbbd tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 200 len: 1503 microversion: 2.1 time: 0.337006 Oct 08 21:11:59.576792 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-e1e583a6-d2bc-486b-b1c6-ff40b2392726 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/71182b09-915d-48cd-b56b-dc1ee940ade1" status: 200 len: 1315 microversion: 2.1 time: 0.994338 Oct 08 21:11:59.577046 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2286/4638] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:11:59 2022] GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 1503 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:11:59.589371 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2353/4639] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:11:58 2022] GET /compute/v2.1/servers/71182b09-915d-48cd-b56b-dc1ee940ade1 => generated 1315 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:11:59.624742 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-77696e35-2f77-4a51-aaec-42ea42c001cd tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:11:59.625498 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-77696e35-2f77-4a51-aaec-42ea42c001cd tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:11:59.647216 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-77696e35-2f77-4a51-aaec-42ea42c001cd tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:59.648628 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-77696e35-2f77-4a51-aaec-42ea42c001cd tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:59.652191 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-77696e35-2f77-4a51-aaec-42ea42c001cd tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:11:59.654622 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-77696e35-2f77-4a51-aaec-42ea42c001cd tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:11:59.656347 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-77696e35-2f77-4a51-aaec-42ea42c001cd tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:11:59.656861 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-77696e35-2f77-4a51-aaec-42ea42c001cd tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:00.117408 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-77696e35-2f77-4a51-aaec-42ea42c001cd tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:12:00.130100 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-77696e35-2f77-4a51-aaec-42ea42c001cd tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 200 len: 1503 microversion: 2.1 time: 0.509989 Oct 08 21:12:00.130953 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2354/4640] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:11:59 2022] GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 1503 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:12:00.166069 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-1e7cfc1c-4469-4ccd-a6df-0fe084df7baf tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:12:00.177427 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-1e7cfc1c-4469-4ccd-a6df-0fe084df7baf tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] HTTP exception thrown: Instance e1abb7a9-a6be-43fd-a324-82f046e05838 has no mapping to a cell. Oct 08 21:12:00.196988 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-1e7cfc1c-4469-4ccd-a6df-0fe084df7baf tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Request method failure captured: Oct 08 21:12:00.196988 ncdv-master-1 devstack@n-api.service[140492]: request: POST /compute/v2.1/servers/e1abb7a9-a6be-43fd-a324-82f046e05838/action HTTP/1.1 Oct 08 21:12:00.196988 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:12:00.196988 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:12:00.196988 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:12:00.196988 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 15 Oct 08 21:12:00.196988 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:12:00.196988 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:12:00.196988 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:12:00.196988 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:12:00.196988 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQebW09Z3m936-d3SrnQA9UQ3KXQvUYeQwL43ufWdoxmQhUwYBWv-JT053t_VYPo9wAVRoCqYQy8Hhh8zc2n570KpS0qNVLik822FjYabkSIZMA_ubWypXzSwo3J04zV1MoSSz79D-b8-ZvwYCEIbwpbfyn5opgOjnO6EXvq1UNPaSyQ Oct 08 21:12:00.196988 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:12:00.196988 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:12:00.196988 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:12:00.196988 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:12:00.196988 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:12:00.196988 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:12:00.196988 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 0ae02675057e4f27bc1980348afc8ca1 Oct 08 21:12:00.196988 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-ServersNegativeTestJSON-1441071354 Oct 08 21:12:00.196988 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:12:00.196988 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:12:00.196988 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0ae02675057e4f27bc1980348afc8ca1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0ae02675057e4f27bc1980348afc8ca1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0ae02675057e4f27bc1980348afc8ca1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0ae02675057e4f27bc1980348afc8ca1"}]}] Oct 08 21:12:00.196988 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-ServersNegativeTestJSON-1441071354 Oct 08 21:12:00.196988 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 0ae02675057e4f27bc1980348afc8ca1 Oct 08 21:12:00.196988 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1441071354 Oct 08 21:12:00.196988 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-ServersNegativeTestJSON-1441071354-project Oct 08 21:12:00.196988 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:12:00.196988 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:12:00.196988 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 6a78d352c143483c8e4702d789d4c516 Oct 08 21:12:00.196988 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-ServersNegativeTestJSON-1441071354-project Oct 08 21:12:00.196988 ncdv-master-1 devstack@n-api.service[140492]: Oct 08 21:12:00.196988 ncdv-master-1 devstack@n-api.service[140492]: {"os-stop": {}} Oct 08 21:12:00.196988 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 21:12:00.196988 ncdv-master-1 devstack@n-api.service[140492]: exception: Instance e1abb7a9-a6be-43fd-a324-82f046e05838 has no mapping to a cell. Oct 08 21:12:00.196988 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': 'e1abb7a9-a6be-43fd-a324-82f046e05838', 'body': {'os-stop': {}}} Oct 08 21:12:00.196988 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:12:00.196988 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:12:00.196988 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1411, in _get_instance Oct 08 21:12:00.196988 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Oct 08 21:12:00.196988 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 08 21:12:00.196988 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 08 21:12:00.196988 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Oct 08 21:12:00.196988 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Oct 08 21:12:00.196988 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 08 21:12:00.196988 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 08 21:12:00.196988 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Oct 08 21:12:00.196988 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Oct 08 21:12:00.196988 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance e1abb7a9-a6be-43fd-a324-82f046e05838 has no mapping to a cell. Oct 08 21:12:00.196988 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:12:00.196988 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:12:00.196988 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:12:00.196988 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:12:00.196988 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:12:00.196988 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:12:00.196988 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:12:00.196988 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:12:00.196988 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:12:00.196988 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:12:00.196988 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1444, in _stop_server Oct 08 21:12:00.196988 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Oct 08 21:12:00.196988 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1418, in _get_instance Oct 08 21:12:00.196988 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:12:00.196988 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1abb7a9-a6be-43fd-a324-82f046e05838 has no mapping to a cell. Oct 08 21:12:00.202152 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:12:00.202152 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:12:00.202152 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:12:00.202152 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:12:00.202152 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:12:00.202152 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:12:00.202152 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:12:00.202152 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:12:00.202152 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1abb7a9-a6be-43fd-a324-82f046e05838 has no mapping to a cell. Oct 08 21:12:00.202152 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:12:00.202152 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-1e7cfc1c-4469-4ccd-a6df-0fe084df7baf tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Returning 404 to user: Instance e1abb7a9-a6be-43fd-a324-82f046e05838 has no mapping to a cell. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:12:00.202152 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-1e7cfc1c-4469-4ccd-a6df-0fe084df7baf tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "POST /compute/v2.1/servers/e1abb7a9-a6be-43fd-a324-82f046e05838/action" status: 404 len: 117 microversion: 2.1 time: 0.044006 Oct 08 21:12:00.202152 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2355/4641] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:12:00 2022] POST /compute/v2.1/servers/e1abb7a9-a6be-43fd-a324-82f046e05838/action => generated 117 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:12:00.209330 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-82ae80b7-7546-4824-b166-a36baef37a67 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:12:00.210297 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-82ae80b7-7546-4824-b166-a36baef37a67 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:12:00.218062 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-82ae80b7-7546-4824-b166-a36baef37a67 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:00.218903 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-82ae80b7-7546-4824-b166-a36baef37a67 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:00.219584 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-82ae80b7-7546-4824-b166-a36baef37a67 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:00.220562 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-82ae80b7-7546-4824-b166-a36baef37a67 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:00.221253 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-82ae80b7-7546-4824-b166-a36baef37a67 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:00.221897 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-82ae80b7-7546-4824-b166-a36baef37a67 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:00.772329 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-0198a8fc-8b52-407e-99f9-2e71a689a457 tempest-SecurityGroupRulesTestJSON-2076505162 tempest-SecurityGroupRulesTestJSON-2076505162-project] Action: 'create', calling method: .version_select at 0x7f1a87641280>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1356908590", "description": "tempest-description-231470475"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:12:00.869589 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-82ae80b7-7546-4824-b166-a36baef37a67 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:12:00.872591 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=91 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:12:00.886475 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-82ae80b7-7546-4824-b166-a36baef37a67 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 200 len: 1503 microversion: 2.1 time: 0.682085 Oct 08 21:12:00.895393 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2356/4642] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:12:00 2022] GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 1503 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:12:00.900670 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-b1e50877-29f6-4860-b5d9-3e34d01e4a3b tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:12:00.911026 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-b1e50877-29f6-4860-b5d9-3e34d01e4a3b tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: 71182b09-915d-48cd-b56b-dc1ee940ade1] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:12:00.935531 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b1e50877-29f6-4860-b5d9-3e34d01e4a3b tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:00.939805 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b1e50877-29f6-4860-b5d9-3e34d01e4a3b tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:00.943864 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b1e50877-29f6-4860-b5d9-3e34d01e4a3b tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:00.948456 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b1e50877-29f6-4860-b5d9-3e34d01e4a3b tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:00.957887 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b1e50877-29f6-4860-b5d9-3e34d01e4a3b tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:00.958766 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b1e50877-29f6-4860-b5d9-3e34d01e4a3b tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:01.187992 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-0198a8fc-8b52-407e-99f9-2e71a689a457 tempest-SecurityGroupRulesTestJSON-2076505162 tempest-SecurityGroupRulesTestJSON-2076505162-project] 10.222.0.26 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 1.168622 Oct 08 21:12:01.189351 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2287/4643] 10.222.0.26 () {60 vars in 1180 bytes} [Sat Oct 8 21:12:00 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:12:01.203804 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-167cd40a-eae2-4908-affd-b64bae4bff08 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:12:01.205637 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-167cd40a-eae2-4908-affd-b64bae4bff08 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:12:01.234881 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-167cd40a-eae2-4908-affd-b64bae4bff08 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:01.235536 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-167cd40a-eae2-4908-affd-b64bae4bff08 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:01.236001 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-167cd40a-eae2-4908-affd-b64bae4bff08 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:01.237026 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-167cd40a-eae2-4908-affd-b64bae4bff08 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:01.240105 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-167cd40a-eae2-4908-affd-b64bae4bff08 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:01.243444 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-167cd40a-eae2-4908-affd-b64bae4bff08 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:01.553161 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-b1e50877-29f6-4860-b5d9-3e34d01e4a3b tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78e9afd772c4de981cac8f5817ec356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765c62cac2ee4406b23a5baa85c52ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:12:01.582738 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-b1e50877-29f6-4860-b5d9-3e34d01e4a3b tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/71182b09-915d-48cd-b56b-dc1ee940ade1" status: 200 len: 1315 microversion: 2.1 time: 0.685861 Oct 08 21:12:01.592123 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2357/4644] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:12:00 2022] GET /compute/v2.1/servers/71182b09-915d-48cd-b56b-dc1ee940ade1 => generated 1315 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:12:01.599590 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-51df3d76-ea84-4063-84b6-6b22561d844a tempest-SecurityGroupRulesTestJSON-2076505162 tempest-SecurityGroupRulesTestJSON-2076505162-project] Action: 'create', calling method: .version_select at 0x7f1a877184c0>, body: {"security_group_rule": {"parent_group_id": "5f869aa9-20c3-44a8-8581-c97ac1a41da2", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:12:01.888329 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-167cd40a-eae2-4908-affd-b64bae4bff08 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:12:01.904155 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-167cd40a-eae2-4908-affd-b64bae4bff08 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 200 len: 1503 microversion: 2.1 time: 0.704768 Oct 08 21:12:01.904756 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2288/4645] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:12:01 2022] GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 1503 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:12:01.932735 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-60602c46-7ad7-4412-9eb9-414c9fa22147 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:12:01.933343 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-60602c46-7ad7-4412-9eb9-414c9fa22147 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: 501100ad-fb81-4371-9680-b6e24a0f314f] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:12:01.945126 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-60602c46-7ad7-4412-9eb9-414c9fa22147 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] HTTP exception thrown: Instance 501100ad-fb81-4371-9680-b6e24a0f314f could not be found. Oct 08 21:12:01.959536 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-60602c46-7ad7-4412-9eb9-414c9fa22147 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Request method failure captured: Oct 08 21:12:01.959536 ncdv-master-1 devstack@n-api.service[140491]: request: POST /compute/v2.1/servers/501100ad-fb81-4371-9680-b6e24a0f314f/action HTTP/1.1 Oct 08 21:12:01.959536 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:12:01.959536 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:12:01.959536 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:12:01.959536 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 15 Oct 08 21:12:01.959536 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:12:01.959536 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:12:01.959536 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:12:01.959536 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:12:01.959536 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQebW09Z3m936-d3SrnQA9UQ3KXQvUYeQwL43ufWdoxmQhUwYBWv-JT053t_VYPo9wAVRoCqYQy8Hhh8zc2n570KpS0qNVLik822FjYabkSIZMA_ubWypXzSwo3J04zV1MoSSz79D-b8-ZvwYCEIbwpbfyn5opgOjnO6EXvq1UNPaSyQ Oct 08 21:12:01.959536 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:12:01.959536 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:12:01.959536 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:12:01.959536 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:12:01.959536 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:12:01.959536 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:12:01.959536 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 0ae02675057e4f27bc1980348afc8ca1 Oct 08 21:12:01.959536 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-ServersNegativeTestJSON-1441071354 Oct 08 21:12:01.959536 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:12:01.959536 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:12:01.959536 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0ae02675057e4f27bc1980348afc8ca1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0ae02675057e4f27bc1980348afc8ca1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0ae02675057e4f27bc1980348afc8ca1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0ae02675057e4f27bc1980348afc8ca1"}]}] Oct 08 21:12:01.959536 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-ServersNegativeTestJSON-1441071354 Oct 08 21:12:01.959536 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 0ae02675057e4f27bc1980348afc8ca1 Oct 08 21:12:01.959536 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1441071354 Oct 08 21:12:01.959536 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-ServersNegativeTestJSON-1441071354-project Oct 08 21:12:01.959536 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:12:01.959536 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:12:01.959536 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 6a78d352c143483c8e4702d789d4c516 Oct 08 21:12:01.959536 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-ServersNegativeTestJSON-1441071354-project Oct 08 21:12:01.959536 ncdv-master-1 devstack@n-api.service[140491]: Oct 08 21:12:01.959536 ncdv-master-1 devstack@n-api.service[140491]: {"suspend": {}} Oct 08 21:12:01.959536 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:12:01.959536 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance 501100ad-fb81-4371-9680-b6e24a0f314f could not be found. Oct 08 21:12:01.959536 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': '501100ad-fb81-4371-9680-b6e24a0f314f', 'body': {'suspend': {}}} Oct 08 21:12:01.959536 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:12:01.959536 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:12:01.959536 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:12:01.959536 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:12:01.959536 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:12:01.959536 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:12:01.959536 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 08 21:12:01.959536 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 08 21:12:01.959536 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 501100ad-fb81-4371-9680-b6e24a0f314f could not be found. Oct 08 21:12:01.959536 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:12:01.959536 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:12:01.959536 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:12:01.959536 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:12:01.959536 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:12:01.959536 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:12:01.959536 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:12:01.959536 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:12:01.959536 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:12:01.959536 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:12:01.959536 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Oct 08 21:12:01.959536 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Oct 08 21:12:01.959536 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:12:01.959536 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:12:01.959536 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 501100ad-fb81-4371-9680-b6e24a0f314f could not be found. Oct 08 21:12:01.959536 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:12:01.959536 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:12:01.959536 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:12:01.959536 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:12:01.959536 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:12:01.959536 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:12:01.967559 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:12:01.967559 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:12:01.967559 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 501100ad-fb81-4371-9680-b6e24a0f314f could not be found. Oct 08 21:12:01.967559 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:12:01.967559 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-60602c46-7ad7-4412-9eb9-414c9fa22147 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Returning 404 to user: Instance 501100ad-fb81-4371-9680-b6e24a0f314f could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:12:01.967559 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-60602c46-7ad7-4412-9eb9-414c9fa22147 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "POST /compute/v2.1/servers/501100ad-fb81-4371-9680-b6e24a0f314f/action" status: 404 len: 111 microversion: 2.1 time: 0.032752 Oct 08 21:12:01.967559 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2289/4646] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:12:01 2022] POST /compute/v2.1/servers/501100ad-fb81-4371-9680-b6e24a0f314f/action => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 08 21:12:01.974517 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-46fb88fd-b9d7-4862-a572-6d6934fca0c5 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:12:01.975400 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-46fb88fd-b9d7-4862-a572-6d6934fca0c5 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:12:02.010793 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-46fb88fd-b9d7-4862-a572-6d6934fca0c5 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:02.011317 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-46fb88fd-b9d7-4862-a572-6d6934fca0c5 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:02.011761 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-46fb88fd-b9d7-4862-a572-6d6934fca0c5 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:02.012488 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-46fb88fd-b9d7-4862-a572-6d6934fca0c5 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:02.012948 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-46fb88fd-b9d7-4862-a572-6d6934fca0c5 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:02.013414 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-46fb88fd-b9d7-4862-a572-6d6934fca0c5 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:02.358132 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-46fb88fd-b9d7-4862-a572-6d6934fca0c5 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:12:02.367752 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-46fb88fd-b9d7-4862-a572-6d6934fca0c5 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 200 len: 1503 microversion: 2.1 time: 0.401460 Oct 08 21:12:02.368363 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2290/4647] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:12:01 2022] GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 1503 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:12:02.391587 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-a255fd39-85c2-4f39-ba65-8b80935c724d tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:12:02.392209 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-a255fd39-85c2-4f39-ba65-8b80935c724d tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:12:02.399328 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a255fd39-85c2-4f39-ba65-8b80935c724d tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:02.400054 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a255fd39-85c2-4f39-ba65-8b80935c724d tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:02.400680 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a255fd39-85c2-4f39-ba65-8b80935c724d tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:02.401812 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a255fd39-85c2-4f39-ba65-8b80935c724d tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:02.402769 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a255fd39-85c2-4f39-ba65-8b80935c724d tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:02.403520 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a255fd39-85c2-4f39-ba65-8b80935c724d tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:02.681478 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-51df3d76-ea84-4063-84b6-6b22561d844a tempest-SecurityGroupRulesTestJSON-2076505162 tempest-SecurityGroupRulesTestJSON-2076505162-project] 10.222.0.26 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.087261 Oct 08 21:12:02.687763 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2358/4648] 10.222.0.26 () {60 vars in 1195 bytes} [Sat Oct 8 21:12:01 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:12:02.697121 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-d1fd48b2-9a6c-400c-a652-35e6eec7d8c6 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:12:02.699848 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-d1fd48b2-9a6c-400c-a652-35e6eec7d8c6 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: 71182b09-915d-48cd-b56b-dc1ee940ade1] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:12:02.730688 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d1fd48b2-9a6c-400c-a652-35e6eec7d8c6 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:02.733575 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d1fd48b2-9a6c-400c-a652-35e6eec7d8c6 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:02.735513 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d1fd48b2-9a6c-400c-a652-35e6eec7d8c6 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:02.739272 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d1fd48b2-9a6c-400c-a652-35e6eec7d8c6 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:02.741383 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d1fd48b2-9a6c-400c-a652-35e6eec7d8c6 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:02.743167 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d1fd48b2-9a6c-400c-a652-35e6eec7d8c6 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:03.120730 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-d1fd48b2-9a6c-400c-a652-35e6eec7d8c6 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78e9afd772c4de981cac8f5817ec356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765c62cac2ee4406b23a5baa85c52ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:12:03.129591 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-d1fd48b2-9a6c-400c-a652-35e6eec7d8c6 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/71182b09-915d-48cd-b56b-dc1ee940ade1" status: 200 len: 1315 microversion: 2.1 time: 0.439686 Oct 08 21:12:03.154745 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2359/4649] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:12:02 2022] GET /compute/v2.1/servers/71182b09-915d-48cd-b56b-dc1ee940ade1 => generated 1315 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:12:03.173109 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-0e04b0c4-288a-467f-806f-5a107450076d tempest-SecurityGroupRulesTestJSON-2076505162 tempest-SecurityGroupRulesTestJSON-2076505162-project] Action: 'create', calling method: .version_select at 0x7f1a8c1104c0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-800434885", "description": "tempest-description-124476346"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:12:03.404714 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-a255fd39-85c2-4f39-ba65-8b80935c724d tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:12:03.416078 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-a255fd39-85c2-4f39-ba65-8b80935c724d tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 200 len: 1503 microversion: 2.1 time: 1.028234 Oct 08 21:12:03.416744 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2291/4650] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:12:02 2022] GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 1503 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:12:03.705271 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-0e04b0c4-288a-467f-806f-5a107450076d tempest-SecurityGroupRulesTestJSON-2076505162 tempest-SecurityGroupRulesTestJSON-2076505162-project] 10.222.0.26 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.549225 Oct 08 21:12:03.716246 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2360/4651] 10.222.0.26 () {60 vars in 1180 bytes} [Sat Oct 8 21:12:03 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:12:03.722287 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-5416de52-680c-4e5f-83a6-968999de271b tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:12:03.723147 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-5416de52-680c-4e5f-83a6-968999de271b tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:12:03.731576 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5416de52-680c-4e5f-83a6-968999de271b tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:03.732906 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5416de52-680c-4e5f-83a6-968999de271b tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:03.734060 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5416de52-680c-4e5f-83a6-968999de271b tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:03.735007 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5416de52-680c-4e5f-83a6-968999de271b tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:03.741360 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5416de52-680c-4e5f-83a6-968999de271b tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:03.742235 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5416de52-680c-4e5f-83a6-968999de271b tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:03.838274 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.objects.instance [None req-5416de52-680c-4e5f-83a6-968999de271b tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lazy-loading 'flavor' on Instance uuid e2548207-aa57-4e4c-876b-2027b59283d2 {{(pid=140492) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 21:12:03.925447 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-cbc17e08-5c81-47ea-83d0-1eb565d4159c tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-1382063619", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "networks": [{"uuid": "e4204ce7-db38-4621-aeef-ac73cc126b1e"}]}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:12:04.011878 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-5416de52-680c-4e5f-83a6-968999de271b tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "POST /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2/action" status: 202 len: 0 microversion: 2.1 time: 0.271720 Oct 08 21:12:04.021459 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2361/4652] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:12:03 2022] POST /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2/action => generated 0 bytes in 303 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 21:12:04.031654 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-fed060c4-f2c6-4190-9e2c-7173b5dcbb29 req-b059f63c-4ecc-4fd5-9aae-76e4b02caf87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71182b09-915d-48cd-b56b-dc1ee940ade1", "name": "network-vif-plugged", "status": "completed", "tag": "920b1a5f-23dd-4250-8862-421852054ba1"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:12:04.050551 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-fed060c4-f2c6-4190-9e2c-7173b5dcbb29 req-b059f63c-4ecc-4fd5-9aae-76e4b02caf87 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:04.051271 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-fed060c4-f2c6-4190-9e2c-7173b5dcbb29 req-b059f63c-4ecc-4fd5-9aae-76e4b02caf87 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:04.052690 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-fed060c4-f2c6-4190-9e2c-7173b5dcbb29 req-b059f63c-4ecc-4fd5-9aae-76e4b02caf87 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:04.067000 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.network.neutron [None req-cbc17e08-5c81-47ea-83d0-1eb565d4159c tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] validate_networks() for [('e4204ce7-db38-4621-aeef-ac73cc126b1e', None, None, None, None, None)] {{(pid=140491) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 21:12:04.071253 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-fed060c4-f2c6-4190-9e2c-7173b5dcbb29 req-b059f63c-4ecc-4fd5-9aae-76e4b02caf87 service nova] Creating event network-vif-plugged:920b1a5f-23dd-4250-8862-421852054ba1 for instance 71182b09-915d-48cd-b56b-dc1ee940ade1 on nch1-master-1 Oct 08 21:12:04.080138 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-fed060c4-f2c6-4190-9e2c-7173b5dcbb29 req-b059f63c-4ecc-4fd5-9aae-76e4b02caf87 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056805 Oct 08 21:12:04.082409 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2362/4653] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:12:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:12:04.123591 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-4b8f591e-4cd8-41a4-a89b-ec84223a190c tempest-SecurityGroupRulesTestJSON-2076505162 tempest-SecurityGroupRulesTestJSON-2076505162-project] Action: 'create', calling method: .version_select at 0x7f1a9149fca0>, body: {"security_group_rule": {"parent_group_id": "92c44042-4bd2-4acc-ae46-886a8efeb633", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:12:04.900626 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-4b8f591e-4cd8-41a4-a89b-ec84223a190c tempest-SecurityGroupRulesTestJSON-2076505162 tempest-SecurityGroupRulesTestJSON-2076505162-project] 10.222.0.26 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 0.815758 Oct 08 21:12:04.901372 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2363/4654] 10.222.0.26 () {60 vars in 1195 bytes} [Sat Oct 8 21:12:04 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:12:04.914709 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-4565d44f-de39-4fc1-9357-5af5bb6962d3 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:12:04.915557 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-4565d44f-de39-4fc1-9357-5af5bb6962d3 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:12:04.929228 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4565d44f-de39-4fc1-9357-5af5bb6962d3 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:04.944804 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4565d44f-de39-4fc1-9357-5af5bb6962d3 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:04.945299 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4565d44f-de39-4fc1-9357-5af5bb6962d3 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:04.946397 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4565d44f-de39-4fc1-9357-5af5bb6962d3 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:04.946879 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4565d44f-de39-4fc1-9357-5af5bb6962d3 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:04.948405 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4565d44f-de39-4fc1-9357-5af5bb6962d3 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:05.057928 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-cbc17e08-5c81-47ea-83d0-1eb565d4159c tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Flavor limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 21:12:05.058392 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-cbc17e08-5c81-47ea-83d0-1eb565d4159c tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Image limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 21:12:05.059502 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-cbc17e08-5c81-47ea-83d0-1eb565d4159c tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Flavor pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 21:12:05.059936 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-cbc17e08-5c81-47ea-83d0-1eb565d4159c tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Image pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 21:12:05.060365 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-cbc17e08-5c81-47ea-83d0-1eb565d4159c tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 21:12:05.079718 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cbc17e08-5c81-47ea-83d0-1eb565d4159c tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:05.082092 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cbc17e08-5c81-47ea-83d0-1eb565d4159c tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:05.082822 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cbc17e08-5c81-47ea-83d0-1eb565d4159c tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:05.084317 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cbc17e08-5c81-47ea-83d0-1eb565d4159c tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:05.086181 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cbc17e08-5c81-47ea-83d0-1eb565d4159c tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:05.088049 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cbc17e08-5c81-47ea-83d0-1eb565d4159c tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:05.149131 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-cbc17e08-5c81-47ea-83d0-1eb565d4159c tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Getting quotas for project b0a53484c6ab4ea4be7acb5ac53acaa0. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:12:05.158796 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-cbc17e08-5c81-47ea-83d0-1eb565d4159c tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Getting quotas for user f77129c9ce5149748c6bd39c69307f76 and project b0a53484c6ab4ea4be7acb5ac53acaa0. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:12:05.200679 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-cbc17e08-5c81-47ea-83d0-1eb565d4159c tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Going to run 1 instances... {{(pid=140491) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 21:12:05.200823 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-4565d44f-de39-4fc1-9357-5af5bb6962d3 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:12:05.204737 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-cbc17e08-5c81-47ea-83d0-1eb565d4159c tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] [instance: 84f33d6e-ddf3-4b77-b83d-595c7f75de55] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c508bd7f-7db9-4b2c-af7c-be54a855c355',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140491) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 21:12:05.216542 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-4565d44f-de39-4fc1-9357-5af5bb6962d3 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 200 len: 1494 microversion: 2.1 time: 0.304130 Oct 08 21:12:05.218369 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2364/4655] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:12:04 2022] GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 1494 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:12:05.233840 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-52280f61-2c06-4e20-9024-a1950b6491ce tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:12:05.234527 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-52280f61-2c06-4e20-9024-a1950b6491ce tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: 71182b09-915d-48cd-b56b-dc1ee940ade1] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:12:05.249925 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-52280f61-2c06-4e20-9024-a1950b6491ce tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:05.250150 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-52280f61-2c06-4e20-9024-a1950b6491ce tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:05.250601 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-52280f61-2c06-4e20-9024-a1950b6491ce tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:05.251345 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-52280f61-2c06-4e20-9024-a1950b6491ce tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:05.251829 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-52280f61-2c06-4e20-9024-a1950b6491ce tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:05.252626 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-52280f61-2c06-4e20-9024-a1950b6491ce tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:05.284632 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-cbc17e08-5c81-47ea-83d0-1eb565d4159c tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.845384 Oct 08 21:12:05.288402 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2292/4656] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 21:12:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 1871 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 08 21:12:05.303096 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-d75936fc-b044-41db-998b-d08945ed3c90 tempest-SecurityGroupRulesTestJSON-2076505162 tempest-SecurityGroupRulesTestJSON-2076505162-project] Action: 'create', calling method: .version_select at 0x7f1a876fe550>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1451749515", "description": "tempest-description-1903408224"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:12:05.455504 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-52280f61-2c06-4e20-9024-a1950b6491ce tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78e9afd772c4de981cac8f5817ec356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765c62cac2ee4406b23a5baa85c52ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:12:05.482592 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-52280f61-2c06-4e20-9024-a1950b6491ce tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/71182b09-915d-48cd-b56b-dc1ee940ade1" status: 200 len: 1315 microversion: 2.1 time: 0.247652 Oct 08 21:12:05.486546 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2365/4657] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:12:05 2022] GET /compute/v2.1/servers/71182b09-915d-48cd-b56b-dc1ee940ade1 => generated 1315 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:12:05.496095 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-a4049aba-0ecd-4aec-b4a9-4b197422353f tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:12:05.496676 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-a4049aba-0ecd-4aec-b4a9-4b197422353f tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:12:05.523359 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a4049aba-0ecd-4aec-b4a9-4b197422353f tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:05.525057 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a4049aba-0ecd-4aec-b4a9-4b197422353f tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:05.525562 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a4049aba-0ecd-4aec-b4a9-4b197422353f tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:05.526303 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a4049aba-0ecd-4aec-b4a9-4b197422353f tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:05.526772 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a4049aba-0ecd-4aec-b4a9-4b197422353f tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:05.527208 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a4049aba-0ecd-4aec-b4a9-4b197422353f tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:05.588332 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.objects.instance [None req-a4049aba-0ecd-4aec-b4a9-4b197422353f tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lazy-loading 'flavor' on Instance uuid e2548207-aa57-4e4c-876b-2027b59283d2 {{(pid=140492) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 21:12:05.616318 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-a4049aba-0ecd-4aec-b4a9-4b197422353f tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] HTTP exception thrown: Cannot 'suspend' instance e2548207-aa57-4e4c-876b-2027b59283d2 while it is in vm_state suspended Oct 08 21:12:05.633380 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-a4049aba-0ecd-4aec-b4a9-4b197422353f tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Request method failure captured: Oct 08 21:12:05.633380 ncdv-master-1 devstack@n-api.service[140492]: request: POST /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2/action HTTP/1.1 Oct 08 21:12:05.633380 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:12:05.633380 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:12:05.633380 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:12:05.633380 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 15 Oct 08 21:12:05.633380 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:12:05.633380 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:12:05.633380 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:12:05.633380 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:12:05.633380 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQebW09Z3m936-d3SrnQA9UQ3KXQvUYeQwL43ufWdoxmQhUwYBWv-JT053t_VYPo9wAVRoCqYQy8Hhh8zc2n570KpS0qNVLik822FjYabkSIZMA_ubWypXzSwo3J04zV1MoSSz79D-b8-ZvwYCEIbwpbfyn5opgOjnO6EXvq1UNPaSyQ Oct 08 21:12:05.633380 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:12:05.633380 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:12:05.633380 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:12:05.633380 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:12:05.633380 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:12:05.633380 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:12:05.633380 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 0ae02675057e4f27bc1980348afc8ca1 Oct 08 21:12:05.633380 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-ServersNegativeTestJSON-1441071354 Oct 08 21:12:05.633380 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:12:05.633380 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:12:05.633380 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0ae02675057e4f27bc1980348afc8ca1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0ae02675057e4f27bc1980348afc8ca1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0ae02675057e4f27bc1980348afc8ca1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0ae02675057e4f27bc1980348afc8ca1"}]}] Oct 08 21:12:05.633380 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-ServersNegativeTestJSON-1441071354 Oct 08 21:12:05.633380 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 0ae02675057e4f27bc1980348afc8ca1 Oct 08 21:12:05.633380 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1441071354 Oct 08 21:12:05.633380 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-ServersNegativeTestJSON-1441071354-project Oct 08 21:12:05.633380 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:12:05.633380 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:12:05.633380 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 6a78d352c143483c8e4702d789d4c516 Oct 08 21:12:05.633380 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-ServersNegativeTestJSON-1441071354-project Oct 08 21:12:05.633380 ncdv-master-1 devstack@n-api.service[140492]: Oct 08 21:12:05.633380 ncdv-master-1 devstack@n-api.service[140492]: {"suspend": {}} Oct 08 21:12:05.633380 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 21:12:05.633380 ncdv-master-1 devstack@n-api.service[140492]: exception: Cannot 'suspend' instance e2548207-aa57-4e4c-876b-2027b59283d2 while it is in vm_state suspended Oct 08 21:12:05.633380 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': 'e2548207-aa57-4e4c-876b-2027b59283d2', 'body': {'suspend': {}}} Oct 08 21:12:05.633380 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:12:05.633380 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:12:05.633380 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Oct 08 21:12:05.633380 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Oct 08 21:12:05.633380 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 08 21:12:05.633380 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 08 21:12:05.633380 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 08 21:12:05.633380 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 08 21:12:05.633380 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 08 21:12:05.633380 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 08 21:12:05.633380 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 08 21:12:05.633380 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 08 21:12:05.633380 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 08 21:12:05.633380 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 08 21:12:05.633380 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 08 21:12:05.633380 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 08 21:12:05.633380 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e2548207-aa57-4e4c-876b-2027b59283d2 in vm_state suspended. Cannot suspend while the instance is in this state. Oct 08 21:12:05.633380 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:12:05.633380 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:12:05.633380 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:12:05.633380 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:12:05.633380 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:12:05.633380 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:12:05.633380 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:12:05.633380 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:12:05.633380 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:12:05.633380 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:12:05.633380 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Oct 08 21:12:05.633380 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 08 21:12:05.637481 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 08 21:12:05.637481 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 08 21:12:05.637481 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance e2548207-aa57-4e4c-876b-2027b59283d2 while it is in vm_state suspended Oct 08 21:12:05.637481 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:12:05.637481 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:12:05.637481 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:12:05.637481 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:12:05.637481 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:12:05.637481 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:12:05.637481 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:12:05.637481 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:12:05.637481 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance e2548207-aa57-4e4c-876b-2027b59283d2 while it is in vm_state suspended Oct 08 21:12:05.637481 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:12:05.641046 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-a4049aba-0ecd-4aec-b4a9-4b197422353f tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Returning 409 to user: Cannot 'suspend' instance e2548207-aa57-4e4c-876b-2027b59283d2 while it is in vm_state suspended {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:12:05.643390 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-a4049aba-0ecd-4aec-b4a9-4b197422353f tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "POST /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2/action" status: 409 len: 148 microversion: 2.1 time: 0.154177 Oct 08 21:12:05.644476 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2366/4658] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:12:05 2022] POST /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2/action => generated 148 bytes in 157 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 08 21:12:05.651424 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-b81cda19-037d-4203-9253-cfe2137111ba tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:12:05.653068 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-b81cda19-037d-4203-9253-cfe2137111ba tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] [instance: 84f33d6e-ddf3-4b77-b83d-595c7f75de55] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:12:05.816105 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-b81cda19-037d-4203-9253-cfe2137111ba tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77129c9ce5149748c6bd39c69307f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a53484c6ab4ea4be7acb5ac53acaa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:12:05.857907 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-b81cda19-037d-4203-9253-cfe2137111ba tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] 10.222.0.26 "GET /compute/v2.1/servers/84f33d6e-ddf3-4b77-b83d-595c7f75de55" status: 200 len: 1217 microversion: 2.1 time: 0.193601 Oct 08 21:12:05.860806 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2367/4659] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:12:05 2022] GET /compute/v2.1/servers/84f33d6e-ddf3-4b77-b83d-595c7f75de55 => generated 1217 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:12:05.912477 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-9ccc555e-039d-4938-8bda-43d717865942 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:12:05.913321 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-9ccc555e-039d-4938-8bda-43d717865942 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:12:05.942032 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9ccc555e-039d-4938-8bda-43d717865942 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:05.953589 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9ccc555e-039d-4938-8bda-43d717865942 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:05.955310 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9ccc555e-039d-4938-8bda-43d717865942 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:05.967467 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9ccc555e-039d-4938-8bda-43d717865942 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:05.971172 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9ccc555e-039d-4938-8bda-43d717865942 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:05.971665 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9ccc555e-039d-4938-8bda-43d717865942 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:06.189737 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-9ccc555e-039d-4938-8bda-43d717865942 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "POST /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2/action" status: 202 len: 0 microversion: 2.1 time: 0.327025 Oct 08 21:12:06.208098 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2368/4660] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:12:05 2022] POST /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2/action => generated 0 bytes in 346 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 21:12:06.230708 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-4ec4c11a-8601-4785-b396-2d7d0dde98ca tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:12:06.233446 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-4ec4c11a-8601-4785-b396-2d7d0dde98ca tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:12:06.274679 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4ec4c11a-8601-4785-b396-2d7d0dde98ca tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:06.276568 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4ec4c11a-8601-4785-b396-2d7d0dde98ca tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:06.277051 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4ec4c11a-8601-4785-b396-2d7d0dde98ca tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:06.277904 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4ec4c11a-8601-4785-b396-2d7d0dde98ca tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:06.278327 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4ec4c11a-8601-4785-b396-2d7d0dde98ca tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:06.278775 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4ec4c11a-8601-4785-b396-2d7d0dde98ca tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:06.843369 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-4ec4c11a-8601-4785-b396-2d7d0dde98ca tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:12:06.861065 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-4ec4c11a-8601-4785-b396-2d7d0dde98ca tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 200 len: 1500 microversion: 2.1 time: 0.638998 Oct 08 21:12:06.877157 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2369/4661] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:12:06 2022] GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 1500 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:12:06.877157 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-899c3ee2-1c41-42c6-b1e7-d2159284bb6d tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:12:06.877157 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-899c3ee2-1c41-42c6-b1e7-d2159284bb6d tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: 71182b09-915d-48cd-b56b-dc1ee940ade1] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:12:06.888593 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-d75936fc-b044-41db-998b-d08945ed3c90 tempest-SecurityGroupRulesTestJSON-2076505162 tempest-SecurityGroupRulesTestJSON-2076505162-project] 10.222.0.26 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 1.598831 Oct 08 21:12:06.890732 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2293/4662] 10.222.0.26 () {60 vars in 1180 bytes} [Sat Oct 8 21:12:05 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 1601 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:12:06.900433 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-899c3ee2-1c41-42c6-b1e7-d2159284bb6d tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:06.900946 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-899c3ee2-1c41-42c6-b1e7-d2159284bb6d tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:06.903519 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-f60f80d2-a14f-4a49-8407-0b0079e0c009 tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:12:06.904684 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-f60f80d2-a14f-4a49-8407-0b0079e0c009 tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] [instance: 84f33d6e-ddf3-4b77-b83d-595c7f75de55] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:12:06.904809 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-899c3ee2-1c41-42c6-b1e7-d2159284bb6d tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:06.905548 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-899c3ee2-1c41-42c6-b1e7-d2159284bb6d tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:06.906060 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-899c3ee2-1c41-42c6-b1e7-d2159284bb6d tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:06.906501 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-899c3ee2-1c41-42c6-b1e7-d2159284bb6d tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:06.921396 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f60f80d2-a14f-4a49-8407-0b0079e0c009 tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:06.922423 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f60f80d2-a14f-4a49-8407-0b0079e0c009 tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:06.925172 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f60f80d2-a14f-4a49-8407-0b0079e0c009 tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:06.930254 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f60f80d2-a14f-4a49-8407-0b0079e0c009 tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:06.932374 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f60f80d2-a14f-4a49-8407-0b0079e0c009 tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:06.935351 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f60f80d2-a14f-4a49-8407-0b0079e0c009 tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:07.258364 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-f60f80d2-a14f-4a49-8407-0b0079e0c009 tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77129c9ce5149748c6bd39c69307f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a53484c6ab4ea4be7acb5ac53acaa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:12:07.274293 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-f60f80d2-a14f-4a49-8407-0b0079e0c009 tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] 10.222.0.26 "GET /compute/v2.1/servers/84f33d6e-ddf3-4b77-b83d-595c7f75de55" status: 200 len: 1269 microversion: 2.1 time: 0.382248 Oct 08 21:12:07.279281 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2294/4663] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:12:06 2022] GET /compute/v2.1/servers/84f33d6e-ddf3-4b77-b83d-595c7f75de55 => generated 1269 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:12:07.288712 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-e253bf63-882f-434e-9302-258747578528 tempest-SecurityGroupRulesTestJSON-2076505162 tempest-SecurityGroupRulesTestJSON-2076505162-project] Action: 'create', calling method: .version_select at 0x7f1a876ccaf0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1334847220", "description": "tempest-description-671385472"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:12:07.304396 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-899c3ee2-1c41-42c6-b1e7-d2159284bb6d tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78e9afd772c4de981cac8f5817ec356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765c62cac2ee4406b23a5baa85c52ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:12:07.322029 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-899c3ee2-1c41-42c6-b1e7-d2159284bb6d tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/71182b09-915d-48cd-b56b-dc1ee940ade1" status: 200 len: 1502 microversion: 2.1 time: 0.457593 Oct 08 21:12:07.323495 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2370/4664] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:12:06 2022] GET /compute/v2.1/servers/71182b09-915d-48cd-b56b-dc1ee940ade1 => generated 1502 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:12:07.353832 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-58805433-075b-4b79-8e23-c8b977a974e3 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:12:07.354872 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-58805433-075b-4b79-8e23-c8b977a974e3 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: 71182b09-915d-48cd-b56b-dc1ee940ade1] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:12:07.368833 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-58805433-075b-4b79-8e23-c8b977a974e3 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:07.369721 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-58805433-075b-4b79-8e23-c8b977a974e3 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:07.370806 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-58805433-075b-4b79-8e23-c8b977a974e3 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:07.372479 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-58805433-075b-4b79-8e23-c8b977a974e3 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:07.373181 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-58805433-075b-4b79-8e23-c8b977a974e3 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:07.375661 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-58805433-075b-4b79-8e23-c8b977a974e3 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:07.439811 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.objects.instance [None req-58805433-075b-4b79-8e23-c8b977a974e3 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lazy-loading 'flavor' on Instance uuid 71182b09-915d-48cd-b56b-dc1ee940ade1 {{(pid=140492) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 21:12:07.617796 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-58805433-075b-4b79-8e23-c8b977a974e3 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "POST /compute/v2.1/servers/71182b09-915d-48cd-b56b-dc1ee940ade1/action" status: 202 len: 0 microversion: 2.1 time: 0.268792 Oct 08 21:12:07.618445 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2371/4665] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:12:07 2022] POST /compute/v2.1/servers/71182b09-915d-48cd-b56b-dc1ee940ade1/action => generated 0 bytes in 270 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 08 21:12:07.638303 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-283ca6c8-1114-4eff-b217-be281c995739 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:12:07.646868 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-283ca6c8-1114-4eff-b217-be281c995739 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: 71182b09-915d-48cd-b56b-dc1ee940ade1] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:12:07.658274 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-283ca6c8-1114-4eff-b217-be281c995739 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:07.658794 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-283ca6c8-1114-4eff-b217-be281c995739 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:07.664175 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-283ca6c8-1114-4eff-b217-be281c995739 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:07.664970 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-283ca6c8-1114-4eff-b217-be281c995739 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:07.665494 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-283ca6c8-1114-4eff-b217-be281c995739 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:07.665952 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-283ca6c8-1114-4eff-b217-be281c995739 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:07.921336 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-e253bf63-882f-434e-9302-258747578528 tempest-SecurityGroupRulesTestJSON-2076505162 tempest-SecurityGroupRulesTestJSON-2076505162-project] 10.222.0.26 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.640198 Oct 08 21:12:07.922236 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2295/4666] 10.222.0.26 () {60 vars in 1180 bytes} [Sat Oct 8 21:12:07 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:12:07.939370 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-cdbb931e-4351-4282-ab36-323080c0ab50 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:12:07.940011 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-cdbb931e-4351-4282-ab36-323080c0ab50 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:12:07.969775 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cdbb931e-4351-4282-ab36-323080c0ab50 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:07.974335 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cdbb931e-4351-4282-ab36-323080c0ab50 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:07.975537 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cdbb931e-4351-4282-ab36-323080c0ab50 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:07.975942 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cdbb931e-4351-4282-ab36-323080c0ab50 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:07.984861 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cdbb931e-4351-4282-ab36-323080c0ab50 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:07.987584 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cdbb931e-4351-4282-ab36-323080c0ab50 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:08.028151 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=100 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:12:08.121148 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-283ca6c8-1114-4eff-b217-be281c995739 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78e9afd772c4de981cac8f5817ec356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765c62cac2ee4406b23a5baa85c52ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:12:08.133651 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-283ca6c8-1114-4eff-b217-be281c995739 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/71182b09-915d-48cd-b56b-dc1ee940ade1" status: 200 len: 1510 microversion: 2.1 time: 0.505976 Oct 08 21:12:08.135156 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2372/4667] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:12:07 2022] GET /compute/v2.1/servers/71182b09-915d-48cd-b56b-dc1ee940ade1 => generated 1510 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:12:08.148560 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-202a642a-6a34-487a-b0e1-0ceabb5bb8cf tempest-SecurityGroupRulesTestJSON-2076505162 tempest-SecurityGroupRulesTestJSON-2076505162-project] Action: 'create', calling method: .version_select at 0x7f1a87e55430>, body: {"security_group_rule": {"parent_group_id": "6ec0201d-53ed-4a9e-8e2d-3acdf81c63cb", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "0bd6f060-cbae-48ac-80ae-48a22350cb7b"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:12:08.383525 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-cdbb931e-4351-4282-ab36-323080c0ab50 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:12:08.395778 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-cdbb931e-4351-4282-ab36-323080c0ab50 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 200 len: 1500 microversion: 2.1 time: 0.471819 Oct 08 21:12:08.411758 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2296/4668] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:12:07 2022] GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 1500 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:12:08.411758 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-25df6ef6-9788-4216-ba59-1b428271b3ce tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:12:08.411758 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-25df6ef6-9788-4216-ba59-1b428271b3ce tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] [instance: 84f33d6e-ddf3-4b77-b83d-595c7f75de55] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:12:08.419882 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-25df6ef6-9788-4216-ba59-1b428271b3ce tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:08.420382 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-25df6ef6-9788-4216-ba59-1b428271b3ce tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:08.421082 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-25df6ef6-9788-4216-ba59-1b428271b3ce tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:08.423320 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-25df6ef6-9788-4216-ba59-1b428271b3ce tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:08.424065 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-25df6ef6-9788-4216-ba59-1b428271b3ce tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:08.424711 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-25df6ef6-9788-4216-ba59-1b428271b3ce tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:08.544278 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-25df6ef6-9788-4216-ba59-1b428271b3ce tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77129c9ce5149748c6bd39c69307f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a53484c6ab4ea4be7acb5ac53acaa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:12:08.555042 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-25df6ef6-9788-4216-ba59-1b428271b3ce tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] 10.222.0.26 "GET /compute/v2.1/servers/84f33d6e-ddf3-4b77-b83d-595c7f75de55" status: 200 len: 1275 microversion: 2.1 time: 0.149314 Oct 08 21:12:08.555644 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2297/4669] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:12:08 2022] GET /compute/v2.1/servers/84f33d6e-ddf3-4b77-b83d-595c7f75de55 => generated 1275 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:12:09.009905 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-202a642a-6a34-487a-b0e1-0ceabb5bb8cf tempest-SecurityGroupRulesTestJSON-2076505162 tempest-SecurityGroupRulesTestJSON-2076505162-project] 10.222.0.26 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 0.873435 Oct 08 21:12:09.010650 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2373/4670] 10.222.0.26 () {60 vars in 1195 bytes} [Sat Oct 8 21:12:08 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:12:09.025254 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-7d8e2c0c-5c99-4b89-a41e-dfc0a82bb398 tempest-SecurityGroupRulesTestJSON-2076505162 tempest-SecurityGroupRulesTestJSON-2076505162-project] Action: 'create', calling method: .version_select at 0x7f1a87733af0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1769931329", "description": "tempest-description-1445189104"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:12:09.160719 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-2e94dd17-04c3-4db6-aa5c-78c4d1920b7f tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:12:09.162374 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-2e94dd17-04c3-4db6-aa5c-78c4d1920b7f tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: 71182b09-915d-48cd-b56b-dc1ee940ade1] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:12:09.175478 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2e94dd17-04c3-4db6-aa5c-78c4d1920b7f tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:09.176159 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2e94dd17-04c3-4db6-aa5c-78c4d1920b7f tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:09.178303 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2e94dd17-04c3-4db6-aa5c-78c4d1920b7f tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:09.179159 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2e94dd17-04c3-4db6-aa5c-78c4d1920b7f tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:09.182624 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2e94dd17-04c3-4db6-aa5c-78c4d1920b7f tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:09.183329 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2e94dd17-04c3-4db6-aa5c-78c4d1920b7f tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:09.556662 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-7d8e2c0c-5c99-4b89-a41e-dfc0a82bb398 tempest-SecurityGroupRulesTestJSON-2076505162 tempest-SecurityGroupRulesTestJSON-2076505162-project] 10.222.0.26 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.535832 Oct 08 21:12:09.557915 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2298/4671] 10.222.0.26 () {60 vars in 1180 bytes} [Sat Oct 8 21:12:09 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:12:09.568410 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-4cf1621d-8c13-4e9a-a6ab-1940875519d6 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:12:09.569222 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-4cf1621d-8c13-4e9a-a6ab-1940875519d6 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:12:09.579988 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4cf1621d-8c13-4e9a-a6ab-1940875519d6 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:09.580778 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4cf1621d-8c13-4e9a-a6ab-1940875519d6 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:09.581621 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4cf1621d-8c13-4e9a-a6ab-1940875519d6 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:09.582640 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4cf1621d-8c13-4e9a-a6ab-1940875519d6 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:09.583430 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4cf1621d-8c13-4e9a-a6ab-1940875519d6 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:09.584425 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4cf1621d-8c13-4e9a-a6ab-1940875519d6 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:09.694325 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-2e94dd17-04c3-4db6-aa5c-78c4d1920b7f tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78e9afd772c4de981cac8f5817ec356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765c62cac2ee4406b23a5baa85c52ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:12:09.696961 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:12:09.713729 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-2e94dd17-04c3-4db6-aa5c-78c4d1920b7f tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/71182b09-915d-48cd-b56b-dc1ee940ade1" status: 200 len: 1493 microversion: 2.1 time: 0.556724 Oct 08 21:12:09.714370 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2374/4672] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:12:09 2022] GET /compute/v2.1/servers/71182b09-915d-48cd-b56b-dc1ee940ade1 => generated 1493 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:12:09.727869 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-f58a0e44-306d-41db-a2dc-b038013b1460 tempest-SecurityGroupRulesTestJSON-2076505162 tempest-SecurityGroupRulesTestJSON-2076505162-project] Action: 'create', calling method: .version_select at 0x7f1a8c7aa700>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-170456137", "description": "tempest-description-1368551399"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:12:09.809214 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-4cf1621d-8c13-4e9a-a6ab-1940875519d6 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:12:09.823854 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-4cf1621d-8c13-4e9a-a6ab-1940875519d6 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 200 len: 1503 microversion: 2.1 time: 0.264462 Oct 08 21:12:09.827028 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2299/4673] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:12:09 2022] GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 1503 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:12:09.847225 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-3418ae90-95e8-48a4-8224-bdfa337321df tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:12:09.848031 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-3418ae90-95e8-48a4-8224-bdfa337321df tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] [instance: 84f33d6e-ddf3-4b77-b83d-595c7f75de55] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:12:09.855405 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3418ae90-95e8-48a4-8224-bdfa337321df tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:09.856120 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3418ae90-95e8-48a4-8224-bdfa337321df tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:09.857337 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3418ae90-95e8-48a4-8224-bdfa337321df tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:09.858463 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3418ae90-95e8-48a4-8224-bdfa337321df tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:09.863159 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3418ae90-95e8-48a4-8224-bdfa337321df tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:09.863818 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3418ae90-95e8-48a4-8224-bdfa337321df tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:10.062044 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-3418ae90-95e8-48a4-8224-bdfa337321df tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77129c9ce5149748c6bd39c69307f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a53484c6ab4ea4be7acb5ac53acaa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:12:10.076480 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-3418ae90-95e8-48a4-8224-bdfa337321df tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] 10.222.0.26 "GET /compute/v2.1/servers/84f33d6e-ddf3-4b77-b83d-595c7f75de55" status: 200 len: 1317 microversion: 2.1 time: 0.248197 Oct 08 21:12:10.078026 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2300/4674] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:12:09 2022] GET /compute/v2.1/servers/84f33d6e-ddf3-4b77-b83d-595c7f75de55 => generated 1317 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:12:10.085107 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-b4542ea0-c26b-42c1-9b19-1b61dde0638d tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:12:10.086125 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-b4542ea0-c26b-42c1-9b19-1b61dde0638d tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: 71182b09-915d-48cd-b56b-dc1ee940ade1] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:12:10.093171 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b4542ea0-c26b-42c1-9b19-1b61dde0638d tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:10.094141 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b4542ea0-c26b-42c1-9b19-1b61dde0638d tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:10.095208 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b4542ea0-c26b-42c1-9b19-1b61dde0638d tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:10.096411 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b4542ea0-c26b-42c1-9b19-1b61dde0638d tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:10.097475 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b4542ea0-c26b-42c1-9b19-1b61dde0638d tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:10.097921 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b4542ea0-c26b-42c1-9b19-1b61dde0638d tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:10.137590 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-b4542ea0-c26b-42c1-9b19-1b61dde0638d tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: 71182b09-915d-48cd-b56b-dc1ee940ade1] Going to try to terminate instance {{(pid=140491) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 21:12:10.289093 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-b4542ea0-c26b-42c1-9b19-1b61dde0638d tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "DELETE /compute/v2.1/servers/71182b09-915d-48cd-b56b-dc1ee940ade1" status: 204 len: 0 microversion: 2.1 time: 0.205961 Oct 08 21:12:10.289093 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2301/4675] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:12:10 2022] DELETE /compute/v2.1/servers/71182b09-915d-48cd-b56b-dc1ee940ade1 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 21:12:10.291843 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-f58a0e44-306d-41db-a2dc-b038013b1460 tempest-SecurityGroupRulesTestJSON-2076505162 tempest-SecurityGroupRulesTestJSON-2076505162-project] 10.222.0.26 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.574069 Oct 08 21:12:10.292446 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2375/4676] 10.222.0.26 () {60 vars in 1180 bytes} [Sat Oct 8 21:12:09 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:12:10.298750 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-cde6a9ca-570a-463a-9df9-b4558b8c5ff2 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:12:10.299449 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-cde6a9ca-570a-463a-9df9-b4558b8c5ff2 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: 71182b09-915d-48cd-b56b-dc1ee940ade1] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:12:10.311208 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-e875c02d-25f4-41a5-85ff-59e494597d0d tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:12:10.313049 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cde6a9ca-570a-463a-9df9-b4558b8c5ff2 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:10.313590 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cde6a9ca-570a-463a-9df9-b4558b8c5ff2 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:10.314044 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cde6a9ca-570a-463a-9df9-b4558b8c5ff2 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:10.315308 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-e875c02d-25f4-41a5-85ff-59e494597d0d tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:12:10.317837 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cde6a9ca-570a-463a-9df9-b4558b8c5ff2 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:10.318523 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cde6a9ca-570a-463a-9df9-b4558b8c5ff2 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:10.319170 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cde6a9ca-570a-463a-9df9-b4558b8c5ff2 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:10.330709 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e875c02d-25f4-41a5-85ff-59e494597d0d tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:10.331227 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e875c02d-25f4-41a5-85ff-59e494597d0d tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:10.331669 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e875c02d-25f4-41a5-85ff-59e494597d0d tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:10.346182 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e875c02d-25f4-41a5-85ff-59e494597d0d tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:10.346799 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e875c02d-25f4-41a5-85ff-59e494597d0d tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:10.347253 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e875c02d-25f4-41a5-85ff-59e494597d0d tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:10.590029 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-e875c02d-25f4-41a5-85ff-59e494597d0d tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:12:10.603829 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-e875c02d-25f4-41a5-85ff-59e494597d0d tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 200 len: 1503 microversion: 2.1 time: 0.313815 Oct 08 21:12:10.619556 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2302/4677] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:12:10 2022] GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 1503 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:12:10.631021 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c9cae7d5-9699-4653-a6aa-d1dc7d1a32f6 tempest-SecurityGroupRulesTestJSON-2076505162 tempest-SecurityGroupRulesTestJSON-2076505162-project] Action: 'create', calling method: .version_select at 0x7f1a876a6dc0>, body: {"security_group_rule": {"parent_group_id": "2fc85a8d-b611-48eb-a84a-78297b2a820b", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "bd9e83e0-0295-41bf-b381-e9edeff1b7ad"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:12:10.899827 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-cde6a9ca-570a-463a-9df9-b4558b8c5ff2 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78e9afd772c4de981cac8f5817ec356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765c62cac2ee4406b23a5baa85c52ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:12:10.912111 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-cde6a9ca-570a-463a-9df9-b4558b8c5ff2 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/71182b09-915d-48cd-b56b-dc1ee940ade1" status: 200 len: 1499 microversion: 2.1 time: 0.617038 Oct 08 21:12:10.912974 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2376/4678] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:12:10 2022] GET /compute/v2.1/servers/71182b09-915d-48cd-b56b-dc1ee940ade1 => generated 1499 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:12:10.922364 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-536e3017-1314-498f-82db-50e589ac8c19 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:12:10.925579 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-536e3017-1314-498f-82db-50e589ac8c19 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: f68ea345-883b-416f-b141-b8504fdb2293] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:12:10.953679 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-536e3017-1314-498f-82db-50e589ac8c19 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] HTTP exception thrown: Instance f68ea345-883b-416f-b141-b8504fdb2293 could not be found. Oct 08 21:12:10.962372 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-536e3017-1314-498f-82db-50e589ac8c19 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Request method failure captured: Oct 08 21:12:10.962372 ncdv-master-1 devstack@n-api.service[140492]: request: POST /compute/v2.1/servers/f68ea345-883b-416f-b141-b8504fdb2293/action HTTP/1.1 Oct 08 21:12:10.962372 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:12:10.962372 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:12:10.962372 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:12:10.962372 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 15 Oct 08 21:12:10.962372 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:12:10.962372 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:12:10.962372 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:12:10.962372 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:12:10.962372 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQebW09Z3m936-d3SrnQA9UQ3KXQvUYeQwL43ufWdoxmQhUwYBWv-JT053t_VYPo9wAVRoCqYQy8Hhh8zc2n570KpS0qNVLik822FjYabkSIZMA_ubWypXzSwo3J04zV1MoSSz79D-b8-ZvwYCEIbwpbfyn5opgOjnO6EXvq1UNPaSyQ Oct 08 21:12:10.962372 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:12:10.962372 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:12:10.962372 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:12:10.962372 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:12:10.962372 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:12:10.962372 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:12:10.962372 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 0ae02675057e4f27bc1980348afc8ca1 Oct 08 21:12:10.962372 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-ServersNegativeTestJSON-1441071354 Oct 08 21:12:10.962372 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:12:10.962372 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:12:10.962372 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0ae02675057e4f27bc1980348afc8ca1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0ae02675057e4f27bc1980348afc8ca1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0ae02675057e4f27bc1980348afc8ca1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0ae02675057e4f27bc1980348afc8ca1"}]}] Oct 08 21:12:10.962372 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-ServersNegativeTestJSON-1441071354 Oct 08 21:12:10.962372 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 0ae02675057e4f27bc1980348afc8ca1 Oct 08 21:12:10.962372 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1441071354 Oct 08 21:12:10.962372 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-ServersNegativeTestJSON-1441071354-project Oct 08 21:12:10.962372 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:12:10.962372 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:12:10.962372 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 6a78d352c143483c8e4702d789d4c516 Oct 08 21:12:10.962372 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-ServersNegativeTestJSON-1441071354-project Oct 08 21:12:10.962372 ncdv-master-1 devstack@n-api.service[140492]: Oct 08 21:12:10.962372 ncdv-master-1 devstack@n-api.service[140492]: {"unpause": {}} Oct 08 21:12:10.962372 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 21:12:10.962372 ncdv-master-1 devstack@n-api.service[140492]: exception: Instance f68ea345-883b-416f-b141-b8504fdb2293 could not be found. Oct 08 21:12:10.962372 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': 'f68ea345-883b-416f-b141-b8504fdb2293', 'body': {'unpause': {}}} Oct 08 21:12:10.962372 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:12:10.962372 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:12:10.962372 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:12:10.962372 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:12:10.962372 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:12:10.962372 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:12:10.962372 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 08 21:12:10.962372 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 08 21:12:10.962372 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f68ea345-883b-416f-b141-b8504fdb2293 could not be found. Oct 08 21:12:10.962372 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:12:10.962372 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:12:10.962372 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:12:10.962372 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:12:10.962372 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:12:10.962372 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:12:10.962372 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:12:10.962372 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:12:10.962372 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:12:10.962372 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:12:10.962372 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Oct 08 21:12:10.962372 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Oct 08 21:12:10.962372 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:12:10.962372 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:12:10.962372 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f68ea345-883b-416f-b141-b8504fdb2293 could not be found. Oct 08 21:12:10.962372 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:12:10.962372 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:12:10.962372 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:12:10.962372 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:12:10.962372 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:12:10.962372 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:12:10.968515 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:12:10.968515 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:12:10.968515 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f68ea345-883b-416f-b141-b8504fdb2293 could not be found. Oct 08 21:12:10.968515 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:12:10.970985 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-536e3017-1314-498f-82db-50e589ac8c19 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Returning 404 to user: Instance f68ea345-883b-416f-b141-b8504fdb2293 could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:12:10.977014 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-536e3017-1314-498f-82db-50e589ac8c19 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "POST /compute/v2.1/servers/f68ea345-883b-416f-b141-b8504fdb2293/action" status: 404 len: 111 microversion: 2.1 time: 0.059536 Oct 08 21:12:10.978714 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2377/4679] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:12:10 2022] POST /compute/v2.1/servers/f68ea345-883b-416f-b141-b8504fdb2293/action => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:12:10.987656 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-8a088300-4999-42e8-8ed6-28dd664ac7f6 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:12:10.994877 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-8a088300-4999-42e8-8ed6-28dd664ac7f6 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:12:11.015451 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8a088300-4999-42e8-8ed6-28dd664ac7f6 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:11.018893 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8a088300-4999-42e8-8ed6-28dd664ac7f6 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:11.020131 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8a088300-4999-42e8-8ed6-28dd664ac7f6 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:11.022750 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8a088300-4999-42e8-8ed6-28dd664ac7f6 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:11.023446 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8a088300-4999-42e8-8ed6-28dd664ac7f6 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:11.024539 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-c9cae7d5-9699-4653-a6aa-d1dc7d1a32f6 tempest-SecurityGroupRulesTestJSON-2076505162 tempest-SecurityGroupRulesTestJSON-2076505162-project] 10.222.0.26 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 330 microversion: 2.1 time: 0.403681 Oct 08 21:12:11.025280 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8a088300-4999-42e8-8ed6-28dd664ac7f6 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:11.025720 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2303/4680] 10.222.0.26 () {60 vars in 1195 bytes} [Sat Oct 8 21:12:10 2022] POST /compute/v2.1/os-security-group-rules => generated 330 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:12:11.039652 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-6f38ca8b-6a17-47b3-a156-5ae310475ea1 tempest-SecurityGroupRulesTestJSON-2076505162 tempest-SecurityGroupRulesTestJSON-2076505162-project] Calling method '.version_select at 0x7f1a876f43a0>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:12:11.339582 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-6f38ca8b-6a17-47b3-a156-5ae310475ea1 tempest-SecurityGroupRulesTestJSON-2076505162 tempest-SecurityGroupRulesTestJSON-2076505162-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/bd9e83e0-0295-41bf-b381-e9edeff1b7ad" status: 202 len: 0 microversion: 2.1 time: 0.305645 Oct 08 21:12:11.347629 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2304/4681] 10.222.0.26 () {58 vars in 1272 bytes} [Sat Oct 8 21:12:11 2022] DELETE /compute/v2.1/os-security-groups/bd9e83e0-0295-41bf-b381-e9edeff1b7ad => generated 0 bytes in 314 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 21:12:11.375029 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-2676e9f2-4940-4e0d-9b5a-70a74256877c tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:12:11.376221 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-2676e9f2-4940-4e0d-9b5a-70a74256877c tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] [instance: 84f33d6e-ddf3-4b77-b83d-595c7f75de55] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:12:11.392435 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2676e9f2-4940-4e0d-9b5a-70a74256877c tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:11.393171 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2676e9f2-4940-4e0d-9b5a-70a74256877c tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:11.394379 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2676e9f2-4940-4e0d-9b5a-70a74256877c tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:11.396971 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2676e9f2-4940-4e0d-9b5a-70a74256877c tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:11.403085 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2676e9f2-4940-4e0d-9b5a-70a74256877c tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:11.404530 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2676e9f2-4940-4e0d-9b5a-70a74256877c tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:11.548830 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-8a088300-4999-42e8-8ed6-28dd664ac7f6 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:12:11.566497 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-8a088300-4999-42e8-8ed6-28dd664ac7f6 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 200 len: 1503 microversion: 2.1 time: 0.582677 Oct 08 21:12:11.567174 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2378/4682] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:12:10 2022] GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 1503 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:12:11.601247 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-a304bddd-aff3-4d7b-8f4e-cbbe1dbbc4c4 tempest-SecurityGroupRulesTestJSON-2076505162 tempest-SecurityGroupRulesTestJSON-2076505162-project] Calling method '.version_select at 0x7f1a8c20f940>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:12:11.692920 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-2676e9f2-4940-4e0d-9b5a-70a74256877c tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77129c9ce5149748c6bd39c69307f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a53484c6ab4ea4be7acb5ac53acaa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:12:11.706369 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-2676e9f2-4940-4e0d-9b5a-70a74256877c tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] 10.222.0.26 "GET /compute/v2.1/servers/84f33d6e-ddf3-4b77-b83d-595c7f75de55" status: 200 len: 1317 microversion: 2.1 time: 0.354969 Oct 08 21:12:11.707332 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2305/4683] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:12:11 2022] GET /compute/v2.1/servers/84f33d6e-ddf3-4b77-b83d-595c7f75de55 => generated 1317 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:12:11.747216 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-d6e864b0-6f10-4d79-becd-065260a2ea92 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:12:11.751021 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-d6e864b0-6f10-4d79-becd-065260a2ea92 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:12:11.765775 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d6e864b0-6f10-4d79-becd-065260a2ea92 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:11.766515 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d6e864b0-6f10-4d79-becd-065260a2ea92 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:11.767647 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d6e864b0-6f10-4d79-becd-065260a2ea92 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:11.768863 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d6e864b0-6f10-4d79-becd-065260a2ea92 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:11.769805 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d6e864b0-6f10-4d79-becd-065260a2ea92 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:11.771883 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d6e864b0-6f10-4d79-becd-065260a2ea92 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:11.876715 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-a304bddd-aff3-4d7b-8f4e-cbbe1dbbc4c4 tempest-SecurityGroupRulesTestJSON-2076505162 tempest-SecurityGroupRulesTestJSON-2076505162-project] 10.222.0.26 "GET /compute/v2.1/os-security-groups/2fc85a8d-b611-48eb-a84a-78297b2a820b" status: 200 len: 248 microversion: 2.1 time: 0.293139 Oct 08 21:12:11.878480 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2379/4684] 10.222.0.26 () {58 vars in 1269 bytes} [Sat Oct 8 21:12:11 2022] GET /compute/v2.1/os-security-groups/2fc85a8d-b611-48eb-a84a-78297b2a820b => generated 248 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:12:11.894405 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e248a985-7660-41be-9958-b1cecd9f795e tempest-SecurityGroupRulesTestJSON-2076505162 tempest-SecurityGroupRulesTestJSON-2076505162-project] Action: 'create', calling method: .version_select at 0x7f1a8c961a60>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1355721587", "description": "tempest-description-183571438"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:12:12.091115 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-d6e864b0-6f10-4d79-becd-065260a2ea92 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:12:12.102116 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-d6e864b0-6f10-4d79-becd-065260a2ea92 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 200 len: 1503 microversion: 2.1 time: 0.373593 Oct 08 21:12:12.105690 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2306/4685] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:12:11 2022] GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 1503 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:12:12.117712 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-92cab17e-72c8-4f26-b487-468e97473f21 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:12:12.118990 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-92cab17e-72c8-4f26-b487-468e97473f21 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: 71182b09-915d-48cd-b56b-dc1ee940ade1] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:12:12.128203 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-92cab17e-72c8-4f26-b487-468e97473f21 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:12.128711 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-92cab17e-72c8-4f26-b487-468e97473f21 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:12.129245 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-92cab17e-72c8-4f26-b487-468e97473f21 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:12.130124 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-92cab17e-72c8-4f26-b487-468e97473f21 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:12.131013 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-92cab17e-72c8-4f26-b487-468e97473f21 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:12.131464 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-92cab17e-72c8-4f26-b487-468e97473f21 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:12.407656 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-92cab17e-72c8-4f26-b487-468e97473f21 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78e9afd772c4de981cac8f5817ec356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765c62cac2ee4406b23a5baa85c52ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:12:12.429033 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-92cab17e-72c8-4f26-b487-468e97473f21 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/71182b09-915d-48cd-b56b-dc1ee940ade1" status: 200 len: 1499 microversion: 2.1 time: 0.321522 Oct 08 21:12:12.430397 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2307/4686] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:12:12 2022] GET /compute/v2.1/servers/71182b09-915d-48cd-b56b-dc1ee940ade1 => generated 1499 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:12:12.437726 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-1fc7653c-3a0e-4286-b968-b26f5dbe8673 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:12:12.438889 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-1fc7653c-3a0e-4286-b968-b26f5dbe8673 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:12:12.461743 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1fc7653c-3a0e-4286-b968-b26f5dbe8673 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:12.462620 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1fc7653c-3a0e-4286-b968-b26f5dbe8673 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:12.463580 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1fc7653c-3a0e-4286-b968-b26f5dbe8673 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:12.464719 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1fc7653c-3a0e-4286-b968-b26f5dbe8673 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:12.465586 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1fc7653c-3a0e-4286-b968-b26f5dbe8673 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:12.466334 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1fc7653c-3a0e-4286-b968-b26f5dbe8673 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:12.497612 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-1fc7653c-3a0e-4286-b968-b26f5dbe8673 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] HTTP exception thrown: Cannot 'unpause' instance e2548207-aa57-4e4c-876b-2027b59283d2 while it is in vm_state active Oct 08 21:12:12.502125 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-1fc7653c-3a0e-4286-b968-b26f5dbe8673 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Request method failure captured: Oct 08 21:12:12.502125 ncdv-master-1 devstack@n-api.service[140491]: request: POST /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2/action HTTP/1.1 Oct 08 21:12:12.502125 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:12:12.502125 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:12:12.502125 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:12:12.502125 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 15 Oct 08 21:12:12.502125 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:12:12.502125 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:12:12.502125 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:12:12.502125 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:12:12.502125 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQebW09Z3m936-d3SrnQA9UQ3KXQvUYeQwL43ufWdoxmQhUwYBWv-JT053t_VYPo9wAVRoCqYQy8Hhh8zc2n570KpS0qNVLik822FjYabkSIZMA_ubWypXzSwo3J04zV1MoSSz79D-b8-ZvwYCEIbwpbfyn5opgOjnO6EXvq1UNPaSyQ Oct 08 21:12:12.502125 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:12:12.502125 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:12:12.502125 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:12:12.502125 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:12:12.502125 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:12:12.502125 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:12:12.502125 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 0ae02675057e4f27bc1980348afc8ca1 Oct 08 21:12:12.502125 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-ServersNegativeTestJSON-1441071354 Oct 08 21:12:12.502125 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:12:12.502125 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:12:12.502125 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0ae02675057e4f27bc1980348afc8ca1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0ae02675057e4f27bc1980348afc8ca1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0ae02675057e4f27bc1980348afc8ca1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0ae02675057e4f27bc1980348afc8ca1"}]}] Oct 08 21:12:12.502125 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-ServersNegativeTestJSON-1441071354 Oct 08 21:12:12.502125 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 0ae02675057e4f27bc1980348afc8ca1 Oct 08 21:12:12.502125 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1441071354 Oct 08 21:12:12.502125 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-ServersNegativeTestJSON-1441071354-project Oct 08 21:12:12.502125 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:12:12.502125 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:12:12.502125 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 6a78d352c143483c8e4702d789d4c516 Oct 08 21:12:12.502125 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-ServersNegativeTestJSON-1441071354-project Oct 08 21:12:12.502125 ncdv-master-1 devstack@n-api.service[140491]: Oct 08 21:12:12.502125 ncdv-master-1 devstack@n-api.service[140491]: {"unpause": {}} Oct 08 21:12:12.502125 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:12:12.502125 ncdv-master-1 devstack@n-api.service[140491]: exception: Cannot 'unpause' instance e2548207-aa57-4e4c-876b-2027b59283d2 while it is in vm_state active Oct 08 21:12:12.502125 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': 'e2548207-aa57-4e4c-876b-2027b59283d2', 'body': {'unpause': {}}} Oct 08 21:12:12.502125 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:12:12.502125 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:12:12.502125 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Oct 08 21:12:12.502125 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Oct 08 21:12:12.502125 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 08 21:12:12.502125 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 08 21:12:12.502125 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 08 21:12:12.502125 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 08 21:12:12.502125 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e2548207-aa57-4e4c-876b-2027b59283d2 in vm_state active. Cannot unpause while the instance is in this state. Oct 08 21:12:12.502125 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:12:12.502125 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:12:12.502125 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:12:12.502125 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:12:12.502125 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:12:12.502125 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:12:12.502125 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:12:12.502125 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:12:12.502125 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:12:12.502125 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:12:12.502125 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Oct 08 21:12:12.502125 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 08 21:12:12.502125 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 08 21:12:12.502125 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 08 21:12:12.502125 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance e2548207-aa57-4e4c-876b-2027b59283d2 while it is in vm_state active Oct 08 21:12:12.502125 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:12:12.502125 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:12:12.502125 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:12:12.502125 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:12:12.502125 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:12:12.507413 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:12:12.507413 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:12:12.507413 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:12:12.507413 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance e2548207-aa57-4e4c-876b-2027b59283d2 while it is in vm_state active Oct 08 21:12:12.507413 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:12:12.512401 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-1fc7653c-3a0e-4286-b968-b26f5dbe8673 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Returning 409 to user: Cannot 'unpause' instance e2548207-aa57-4e4c-876b-2027b59283d2 while it is in vm_state active {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:12:12.514295 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-1fc7653c-3a0e-4286-b968-b26f5dbe8673 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "POST /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2/action" status: 409 len: 145 microversion: 2.1 time: 0.082065 Oct 08 21:12:12.518523 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2308/4687] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:12:12 2022] POST /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2/action => generated 145 bytes in 87 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 08 21:12:12.525753 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-033e365b-c18c-448e-ad2d-a806e5f806e0 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:12:12.526816 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-033e365b-c18c-448e-ad2d-a806e5f806e0 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:12:12.534322 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-033e365b-c18c-448e-ad2d-a806e5f806e0 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:12.535123 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-033e365b-c18c-448e-ad2d-a806e5f806e0 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:12.535829 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-033e365b-c18c-448e-ad2d-a806e5f806e0 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:12.536631 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-033e365b-c18c-448e-ad2d-a806e5f806e0 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:12.537266 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-033e365b-c18c-448e-ad2d-a806e5f806e0 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:12.545695 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-033e365b-c18c-448e-ad2d-a806e5f806e0 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:12.746237 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-033e365b-c18c-448e-ad2d-a806e5f806e0 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:12:12.756180 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-033e365b-c18c-448e-ad2d-a806e5f806e0 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 200 len: 1503 microversion: 2.1 time: 0.236194 Oct 08 21:12:12.756765 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2309/4688] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:12:12 2022] GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 1503 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:12:12.773274 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-efa296e8-4c95-40a2-b7df-b832c522ae9a tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:12:12.781697 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-efa296e8-4c95-40a2-b7df-b832c522ae9a tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] [instance: 84f33d6e-ddf3-4b77-b83d-595c7f75de55] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:12:12.797343 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-efa296e8-4c95-40a2-b7df-b832c522ae9a tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:12.798198 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-efa296e8-4c95-40a2-b7df-b832c522ae9a tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:12.798877 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-efa296e8-4c95-40a2-b7df-b832c522ae9a tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:12.799857 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-efa296e8-4c95-40a2-b7df-b832c522ae9a tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:12.800501 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-efa296e8-4c95-40a2-b7df-b832c522ae9a tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:12.801480 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-efa296e8-4c95-40a2-b7df-b832c522ae9a tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:13.024699 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-efa296e8-4c95-40a2-b7df-b832c522ae9a tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77129c9ce5149748c6bd39c69307f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a53484c6ab4ea4be7acb5ac53acaa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:12:13.039050 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-efa296e8-4c95-40a2-b7df-b832c522ae9a tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] 10.222.0.26 "GET /compute/v2.1/servers/84f33d6e-ddf3-4b77-b83d-595c7f75de55" status: 200 len: 1317 microversion: 2.1 time: 0.280191 Oct 08 21:12:13.060583 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2310/4689] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:12:12 2022] GET /compute/v2.1/servers/84f33d6e-ddf3-4b77-b83d-595c7f75de55 => generated 1317 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:12:13.080477 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-6a9d2813-f8df-47aa-975e-90a6c1b67c36 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:12:13.084909 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-6a9d2813-f8df-47aa-975e-90a6c1b67c36 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:12:13.096958 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:12:13.099026 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6a9d2813-f8df-47aa-975e-90a6c1b67c36 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:13.106036 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6a9d2813-f8df-47aa-975e-90a6c1b67c36 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:13.106776 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6a9d2813-f8df-47aa-975e-90a6c1b67c36 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:13.107959 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6a9d2813-f8df-47aa-975e-90a6c1b67c36 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:13.108863 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6a9d2813-f8df-47aa-975e-90a6c1b67c36 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:13.109432 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6a9d2813-f8df-47aa-975e-90a6c1b67c36 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:13.195822 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-e248a985-7660-41be-9958-b1cecd9f795e tempest-SecurityGroupRulesTestJSON-2076505162 tempest-SecurityGroupRulesTestJSON-2076505162-project] 10.222.0.26 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 1.304130 Oct 08 21:12:13.197269 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2380/4690] 10.222.0.26 () {60 vars in 1180 bytes} [Sat Oct 8 21:12:11 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 1308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:12:13.210247 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-9d964d13-18fa-4bfd-8482-bb0abb5f229e req-80b97cb8-7585-4026-a3da-535c4ca922d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84f33d6e-ddf3-4b77-b83d-595c7f75de55", "tag": "4dafcfde-8e70-4b8a-9a65-16bcd9c3e23d"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:12:13.238584 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-9d964d13-18fa-4bfd-8482-bb0abb5f229e req-80b97cb8-7585-4026-a3da-535c4ca922d6 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:13.239447 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-9d964d13-18fa-4bfd-8482-bb0abb5f229e req-80b97cb8-7585-4026-a3da-535c4ca922d6 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:13.239989 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-9d964d13-18fa-4bfd-8482-bb0abb5f229e req-80b97cb8-7585-4026-a3da-535c4ca922d6 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:13.278523 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-9d964d13-18fa-4bfd-8482-bb0abb5f229e req-80b97cb8-7585-4026-a3da-535c4ca922d6 service nova] Creating event network-changed:4dafcfde-8e70-4b8a-9a65-16bcd9c3e23d for instance 84f33d6e-ddf3-4b77-b83d-595c7f75de55 on nch2-master-1 Oct 08 21:12:13.288665 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-9d964d13-18fa-4bfd-8482-bb0abb5f229e req-80b97cb8-7585-4026-a3da-535c4ca922d6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088028 Oct 08 21:12:13.289881 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2381/4691] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:12:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:12:13.298841 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-ac1369ec-2b7a-49ee-bed9-281e8bd4ac72 tempest-SecurityGroupRulesTestJSON-2076505162 tempest-SecurityGroupRulesTestJSON-2076505162-project] Action: 'create', calling method: .version_select at 0x7f1a9149faf0>, body: {"security_group_rule": {"parent_group_id": "021c3cfc-f99d-42df-8d14-89c20bcbb479", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:12:13.336224 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-6a9d2813-f8df-47aa-975e-90a6c1b67c36 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:12:13.353785 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-6a9d2813-f8df-47aa-975e-90a6c1b67c36 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 200 len: 1503 microversion: 2.1 time: 0.289342 Oct 08 21:12:13.354679 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2311/4692] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:12:13 2022] GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 1503 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:12:13.379162 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-6944ccc5-b000-4249-98e0-9cd679647c1a tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:12:13.380471 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-6944ccc5-b000-4249-98e0-9cd679647c1a tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: 20ec082f-9571-4631-bc76-46f1090d429a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:12:13.386729 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-6944ccc5-b000-4249-98e0-9cd679647c1a tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] HTTP exception thrown: Instance 20ec082f-9571-4631-bc76-46f1090d429a could not be found. Oct 08 21:12:13.389490 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-6944ccc5-b000-4249-98e0-9cd679647c1a tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Request method failure captured: Oct 08 21:12:13.389490 ncdv-master-1 devstack@n-api.service[140491]: request: POST /compute/v2.1/servers/20ec082f-9571-4631-bc76-46f1090d429a/action HTTP/1.1 Oct 08 21:12:13.389490 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:12:13.389490 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:12:13.389490 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:12:13.389490 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 18 Oct 08 21:12:13.389490 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:12:13.389490 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:12:13.389490 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:12:13.389490 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:12:13.389490 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQebW09Z3m936-d3SrnQA9UQ3KXQvUYeQwL43ufWdoxmQhUwYBWv-JT053t_VYPo9wAVRoCqYQy8Hhh8zc2n570KpS0qNVLik822FjYabkSIZMA_ubWypXzSwo3J04zV1MoSSz79D-b8-ZvwYCEIbwpbfyn5opgOjnO6EXvq1UNPaSyQ Oct 08 21:12:13.389490 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:12:13.389490 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:12:13.389490 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:12:13.389490 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:12:13.389490 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:12:13.389490 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:12:13.389490 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 0ae02675057e4f27bc1980348afc8ca1 Oct 08 21:12:13.389490 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-ServersNegativeTestJSON-1441071354 Oct 08 21:12:13.389490 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:12:13.389490 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:12:13.389490 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0ae02675057e4f27bc1980348afc8ca1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0ae02675057e4f27bc1980348afc8ca1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0ae02675057e4f27bc1980348afc8ca1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0ae02675057e4f27bc1980348afc8ca1"}]}] Oct 08 21:12:13.389490 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-ServersNegativeTestJSON-1441071354 Oct 08 21:12:13.389490 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 0ae02675057e4f27bc1980348afc8ca1 Oct 08 21:12:13.389490 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1441071354 Oct 08 21:12:13.389490 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-ServersNegativeTestJSON-1441071354-project Oct 08 21:12:13.389490 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:12:13.389490 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:12:13.389490 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 6a78d352c143483c8e4702d789d4c516 Oct 08 21:12:13.389490 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-ServersNegativeTestJSON-1441071354-project Oct 08 21:12:13.389490 ncdv-master-1 devstack@n-api.service[140491]: Oct 08 21:12:13.389490 ncdv-master-1 devstack@n-api.service[140491]: {"unshelve": null} Oct 08 21:12:13.389490 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:12:13.389490 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance 20ec082f-9571-4631-bc76-46f1090d429a could not be found. Oct 08 21:12:13.389490 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': '20ec082f-9571-4631-bc76-46f1090d429a', 'body': {'unshelve': None}} Oct 08 21:12:13.389490 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:12:13.389490 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:12:13.389490 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:12:13.389490 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:12:13.389490 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:12:13.389490 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:12:13.389490 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 08 21:12:13.389490 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 08 21:12:13.389490 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20ec082f-9571-4631-bc76-46f1090d429a could not be found. Oct 08 21:12:13.389490 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:12:13.389490 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:12:13.389490 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:12:13.389490 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:12:13.389490 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:12:13.389490 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:12:13.389490 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:12:13.389490 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:12:13.389490 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:12:13.389490 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:12:13.389490 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 21:12:13.389490 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 21:12:13.389490 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 21:12:13.389490 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 21:12:13.389490 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 102, in _unshelve Oct 08 21:12:13.389490 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 08 21:12:13.389490 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:12:13.389490 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:12:13.389490 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20ec082f-9571-4631-bc76-46f1090d429a could not be found. Oct 08 21:12:13.389490 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:12:13.389490 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:12:13.394927 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:12:13.394927 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:12:13.394927 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:12:13.394927 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:12:13.394927 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:12:13.394927 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:12:13.394927 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20ec082f-9571-4631-bc76-46f1090d429a could not be found. Oct 08 21:12:13.394927 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:12:13.394927 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-6944ccc5-b000-4249-98e0-9cd679647c1a tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Returning 404 to user: Instance 20ec082f-9571-4631-bc76-46f1090d429a could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:12:13.394927 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-6944ccc5-b000-4249-98e0-9cd679647c1a tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "POST /compute/v2.1/servers/20ec082f-9571-4631-bc76-46f1090d429a/action" status: 404 len: 111 microversion: 2.1 time: 0.017779 Oct 08 21:12:13.394927 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2312/4693] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:12:13 2022] POST /compute/v2.1/servers/20ec082f-9571-4631-bc76-46f1090d429a/action => generated 111 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 08 21:12:13.401517 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-4aa540ab-4c23-4d87-9250-e208f6d47c3e tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:12:13.402381 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-4aa540ab-4c23-4d87-9250-e208f6d47c3e tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:12:13.412452 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4aa540ab-4c23-4d87-9250-e208f6d47c3e tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:13.413754 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4aa540ab-4c23-4d87-9250-e208f6d47c3e tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:13.414452 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4aa540ab-4c23-4d87-9250-e208f6d47c3e tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:13.415474 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4aa540ab-4c23-4d87-9250-e208f6d47c3e tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:13.416148 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4aa540ab-4c23-4d87-9250-e208f6d47c3e tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:13.416802 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4aa540ab-4c23-4d87-9250-e208f6d47c3e tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:13.642934 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-4aa540ab-4c23-4d87-9250-e208f6d47c3e tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:12:13.653905 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-4aa540ab-4c23-4d87-9250-e208f6d47c3e tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 200 len: 1503 microversion: 2.1 time: 0.257000 Oct 08 21:12:13.660166 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2313/4694] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:12:13 2022] GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 1503 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:12:13.668108 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-a55bf620-d4d0-46fb-8d42-6345b8c5b7d7 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:12:13.669135 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-a55bf620-d4d0-46fb-8d42-6345b8c5b7d7 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: 71182b09-915d-48cd-b56b-dc1ee940ade1] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:12:13.687882 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a55bf620-d4d0-46fb-8d42-6345b8c5b7d7 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:13.689330 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a55bf620-d4d0-46fb-8d42-6345b8c5b7d7 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:13.690053 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a55bf620-d4d0-46fb-8d42-6345b8c5b7d7 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:13.691016 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a55bf620-d4d0-46fb-8d42-6345b8c5b7d7 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:13.692033 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a55bf620-d4d0-46fb-8d42-6345b8c5b7d7 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:13.693581 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a55bf620-d4d0-46fb-8d42-6345b8c5b7d7 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:13.912806 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-a55bf620-d4d0-46fb-8d42-6345b8c5b7d7 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78e9afd772c4de981cac8f5817ec356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765c62cac2ee4406b23a5baa85c52ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:12:13.922211 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-a55bf620-d4d0-46fb-8d42-6345b8c5b7d7 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/71182b09-915d-48cd-b56b-dc1ee940ade1" status: 200 len: 1499 microversion: 2.1 time: 0.259915 Oct 08 21:12:13.923440 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2314/4695] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:12:13 2022] GET /compute/v2.1/servers/71182b09-915d-48cd-b56b-dc1ee940ade1 => generated 1499 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:12:13.929052 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-ee1cb3d0-1712-41b6-a623-83e29cd4564f tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:12:13.929942 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-ee1cb3d0-1712-41b6-a623-83e29cd4564f tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:12:13.938385 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ee1cb3d0-1712-41b6-a623-83e29cd4564f tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:13.939419 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ee1cb3d0-1712-41b6-a623-83e29cd4564f tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:13.940090 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ee1cb3d0-1712-41b6-a623-83e29cd4564f tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:13.941170 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ee1cb3d0-1712-41b6-a623-83e29cd4564f tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:13.941881 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ee1cb3d0-1712-41b6-a623-83e29cd4564f tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:13.942827 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ee1cb3d0-1712-41b6-a623-83e29cd4564f tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:14.218158 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-ee1cb3d0-1712-41b6-a623-83e29cd4564f tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:12:14.220648 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:12:14.252666 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-ee1cb3d0-1712-41b6-a623-83e29cd4564f tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 200 len: 1503 microversion: 2.1 time: 0.327849 Oct 08 21:12:14.267153 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2315/4696] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:12:13 2022] GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 1503 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:12:14.282415 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-95244cc4-e07e-4062-925e-4ac2bc45fe62 tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:12:14.283805 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-95244cc4-e07e-4062-925e-4ac2bc45fe62 tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] [instance: 84f33d6e-ddf3-4b77-b83d-595c7f75de55] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:12:14.293777 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-95244cc4-e07e-4062-925e-4ac2bc45fe62 tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:14.294376 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-95244cc4-e07e-4062-925e-4ac2bc45fe62 tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:14.295467 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-95244cc4-e07e-4062-925e-4ac2bc45fe62 tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:14.296474 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-95244cc4-e07e-4062-925e-4ac2bc45fe62 tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:14.297253 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-95244cc4-e07e-4062-925e-4ac2bc45fe62 tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:14.299005 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-95244cc4-e07e-4062-925e-4ac2bc45fe62 tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:14.538674 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-ac1369ec-2b7a-49ee-bed9-281e8bd4ac72 tempest-SecurityGroupRulesTestJSON-2076505162 tempest-SecurityGroupRulesTestJSON-2076505162-project] 10.222.0.26 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.247081 Oct 08 21:12:14.539854 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2382/4697] 10.222.0.26 () {60 vars in 1195 bytes} [Sat Oct 8 21:12:13 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:12:14.545970 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-b43920c4-8e29-4d55-882f-6bbe02c9bbe1 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:12:14.547460 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-b43920c4-8e29-4d55-882f-6bbe02c9bbe1 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:12:14.578842 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b43920c4-8e29-4d55-882f-6bbe02c9bbe1 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:14.581692 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b43920c4-8e29-4d55-882f-6bbe02c9bbe1 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:14.582163 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b43920c4-8e29-4d55-882f-6bbe02c9bbe1 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:14.586085 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b43920c4-8e29-4d55-882f-6bbe02c9bbe1 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:14.586636 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b43920c4-8e29-4d55-882f-6bbe02c9bbe1 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:14.587683 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b43920c4-8e29-4d55-882f-6bbe02c9bbe1 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:14.691837 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-b43920c4-8e29-4d55-882f-6bbe02c9bbe1 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] HTTP exception thrown: Cannot 'unshelve' instance e2548207-aa57-4e4c-876b-2027b59283d2 while it is in vm_state active Oct 08 21:12:14.692675 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-95244cc4-e07e-4062-925e-4ac2bc45fe62 tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77129c9ce5149748c6bd39c69307f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a53484c6ab4ea4be7acb5ac53acaa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:12:14.695260 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-b43920c4-8e29-4d55-882f-6bbe02c9bbe1 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Request method failure captured: Oct 08 21:12:14.695260 ncdv-master-1 devstack@n-api.service[140492]: request: POST /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2/action HTTP/1.1 Oct 08 21:12:14.695260 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:12:14.695260 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:12:14.695260 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:12:14.695260 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 18 Oct 08 21:12:14.695260 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:12:14.695260 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:12:14.695260 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:12:14.695260 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:12:14.695260 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQebW09Z3m936-d3SrnQA9UQ3KXQvUYeQwL43ufWdoxmQhUwYBWv-JT053t_VYPo9wAVRoCqYQy8Hhh8zc2n570KpS0qNVLik822FjYabkSIZMA_ubWypXzSwo3J04zV1MoSSz79D-b8-ZvwYCEIbwpbfyn5opgOjnO6EXvq1UNPaSyQ Oct 08 21:12:14.695260 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:12:14.695260 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:12:14.695260 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:12:14.695260 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:12:14.695260 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:12:14.695260 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:12:14.695260 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 0ae02675057e4f27bc1980348afc8ca1 Oct 08 21:12:14.695260 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-ServersNegativeTestJSON-1441071354 Oct 08 21:12:14.695260 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:12:14.695260 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:12:14.695260 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0ae02675057e4f27bc1980348afc8ca1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0ae02675057e4f27bc1980348afc8ca1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0ae02675057e4f27bc1980348afc8ca1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0ae02675057e4f27bc1980348afc8ca1"}]}] Oct 08 21:12:14.695260 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-ServersNegativeTestJSON-1441071354 Oct 08 21:12:14.695260 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 0ae02675057e4f27bc1980348afc8ca1 Oct 08 21:12:14.695260 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1441071354 Oct 08 21:12:14.695260 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-ServersNegativeTestJSON-1441071354-project Oct 08 21:12:14.695260 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:12:14.695260 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:12:14.695260 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 6a78d352c143483c8e4702d789d4c516 Oct 08 21:12:14.695260 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-ServersNegativeTestJSON-1441071354-project Oct 08 21:12:14.695260 ncdv-master-1 devstack@n-api.service[140492]: Oct 08 21:12:14.695260 ncdv-master-1 devstack@n-api.service[140492]: {"unshelve": null} Oct 08 21:12:14.695260 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 21:12:14.695260 ncdv-master-1 devstack@n-api.service[140492]: exception: Cannot 'unshelve' instance e2548207-aa57-4e4c-876b-2027b59283d2 while it is in vm_state active Oct 08 21:12:14.695260 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': 'e2548207-aa57-4e4c-876b-2027b59283d2', 'body': {'unshelve': None}} Oct 08 21:12:14.695260 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:12:14.695260 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:12:14.695260 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 124, in _unshelve Oct 08 21:12:14.695260 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve( Oct 08 21:12:14.695260 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 08 21:12:14.695260 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 08 21:12:14.695260 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 08 21:12:14.695260 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 08 21:12:14.695260 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 08 21:12:14.695260 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 08 21:12:14.695260 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e2548207-aa57-4e4c-876b-2027b59283d2 in vm_state active. Cannot unshelve while the instance is in this state. Oct 08 21:12:14.695260 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:12:14.695260 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:12:14.695260 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:12:14.695260 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:12:14.695260 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:12:14.695260 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:12:14.695260 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:12:14.695260 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:12:14.695260 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:12:14.695260 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:12:14.695260 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 21:12:14.695260 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 21:12:14.695260 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 21:12:14.695260 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 21:12:14.695260 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 137, in _unshelve Oct 08 21:12:14.695260 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Oct 08 21:12:14.695260 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 08 21:12:14.695260 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 08 21:12:14.702757 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance e2548207-aa57-4e4c-876b-2027b59283d2 while it is in vm_state active Oct 08 21:12:14.702757 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:12:14.702757 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:12:14.702757 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:12:14.702757 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:12:14.702757 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:12:14.702757 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:12:14.702757 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:12:14.702757 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:12:14.702757 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance e2548207-aa57-4e4c-876b-2027b59283d2 while it is in vm_state active Oct 08 21:12:14.702757 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:12:14.711666 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-b43920c4-8e29-4d55-882f-6bbe02c9bbe1 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Returning 409 to user: Cannot 'unshelve' instance e2548207-aa57-4e4c-876b-2027b59283d2 while it is in vm_state active {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:12:14.713469 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-b43920c4-8e29-4d55-882f-6bbe02c9bbe1 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "POST /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2/action" status: 409 len: 146 microversion: 2.1 time: 0.172005 Oct 08 21:12:14.714516 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2383/4698] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:12:14 2022] POST /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2/action => generated 146 bytes in 174 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 08 21:12:14.721484 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-32efb2c0-c592-4280-bf9c-75fd20cad896 tempest-SecurityGroupRulesTestJSON-2076505162 tempest-SecurityGroupRulesTestJSON-2076505162-project] Action: 'create', calling method: .version_select at 0x7f1a87e68b80>, body: {"security_group_rule": {"parent_group_id": "021c3cfc-f99d-42df-8d14-89c20bcbb479", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:12:14.733524 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-95244cc4-e07e-4062-925e-4ac2bc45fe62 tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] 10.222.0.26 "GET /compute/v2.1/servers/84f33d6e-ddf3-4b77-b83d-595c7f75de55" status: 200 len: 1317 microversion: 2.1 time: 0.464943 Oct 08 21:12:14.747671 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2316/4699] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:12:14 2022] GET /compute/v2.1/servers/84f33d6e-ddf3-4b77-b83d-595c7f75de55 => generated 1317 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:12:14.757380 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-9828b364-1764-4115-90d4-8dddecfa33ad tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:12:14.758561 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-9828b364-1764-4115-90d4-8dddecfa33ad tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:12:14.766015 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9828b364-1764-4115-90d4-8dddecfa33ad tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:14.766754 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9828b364-1764-4115-90d4-8dddecfa33ad tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:14.767216 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9828b364-1764-4115-90d4-8dddecfa33ad tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:14.768102 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9828b364-1764-4115-90d4-8dddecfa33ad tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:14.768571 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9828b364-1764-4115-90d4-8dddecfa33ad tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:14.769252 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9828b364-1764-4115-90d4-8dddecfa33ad tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:14.962592 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-9828b364-1764-4115-90d4-8dddecfa33ad tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:12:14.973129 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-9828b364-1764-4115-90d4-8dddecfa33ad tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 200 len: 1503 microversion: 2.1 time: 0.223753 Oct 08 21:12:14.991688 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2317/4700] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:12:14 2022] GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 1503 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:12:14.997980 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-ef50c22f-3b4e-4295-b821-266951cec277 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:12:14.998616 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-ef50c22f-3b4e-4295-b821-266951cec277 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: 71182b09-915d-48cd-b56b-dc1ee940ade1] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:12:15.013748 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ef50c22f-3b4e-4295-b821-266951cec277 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:15.017343 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ef50c22f-3b4e-4295-b821-266951cec277 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:15.018283 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ef50c22f-3b4e-4295-b821-266951cec277 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:15.020074 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ef50c22f-3b4e-4295-b821-266951cec277 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:15.021483 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ef50c22f-3b4e-4295-b821-266951cec277 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:15.022144 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ef50c22f-3b4e-4295-b821-266951cec277 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:15.081958 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ef50c22f-3b4e-4295-b821-266951cec277 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:15.082619 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ef50c22f-3b4e-4295-b821-266951cec277 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:15.083948 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ef50c22f-3b4e-4295-b821-266951cec277 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:15.084680 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.objects.instance [None req-ef50c22f-3b4e-4295-b821-266951cec277 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lazy-loading 'fault' on Instance uuid 71182b09-915d-48cd-b56b-dc1ee940ade1 {{(pid=140491) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 21:12:15.120365 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=2 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:12:15.150226 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-ef50c22f-3b4e-4295-b821-266951cec277 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78e9afd772c4de981cac8f5817ec356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765c62cac2ee4406b23a5baa85c52ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:12:15.163198 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-ef50c22f-3b4e-4295-b821-266951cec277 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/71182b09-915d-48cd-b56b-dc1ee940ade1" status: 200 len: 1305 microversion: 2.1 time: 0.174199 Oct 08 21:12:15.163871 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2318/4701] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:12:14 2022] GET /compute/v2.1/servers/71182b09-915d-48cd-b56b-dc1ee940ade1 => generated 1305 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:12:15.168630 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-d4b181b7-c55e-4340-8dea-b1384e499c24 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:12:15.169271 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-d4b181b7-c55e-4340-8dea-b1384e499c24 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:12:15.175670 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d4b181b7-c55e-4340-8dea-b1384e499c24 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:15.176498 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d4b181b7-c55e-4340-8dea-b1384e499c24 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:15.177338 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d4b181b7-c55e-4340-8dea-b1384e499c24 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:15.178232 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d4b181b7-c55e-4340-8dea-b1384e499c24 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:15.178955 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d4b181b7-c55e-4340-8dea-b1384e499c24 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:15.179620 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d4b181b7-c55e-4340-8dea-b1384e499c24 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:15.185081 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=6 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:12:15.353854 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-d4b181b7-c55e-4340-8dea-b1384e499c24 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:12:15.367366 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-d4b181b7-c55e-4340-8dea-b1384e499c24 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 200 len: 1503 microversion: 2.1 time: 0.201607 Oct 08 21:12:15.374184 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2319/4702] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:12:15 2022] GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 1503 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:12:15.391546 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-32efb2c0-c592-4280-bf9c-75fd20cad896 tempest-SecurityGroupRulesTestJSON-2076505162 tempest-SecurityGroupRulesTestJSON-2076505162-project] 10.222.0.26 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.675406 Oct 08 21:12:15.393599 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2384/4703] 10.222.0.26 () {60 vars in 1195 bytes} [Sat Oct 8 21:12:14 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:12:15.399819 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-4180af8a-0610-4e95-8163-cbfc29c070f6 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-642798209_updated"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:12:15.404642 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-4180af8a-0610-4e95-8163-cbfc29c070f6 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: 8d062330-f442-4e15-8223-1041249d6379] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:12:15.412198 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-4180af8a-0610-4e95-8163-cbfc29c070f6 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] HTTP exception thrown: Instance 8d062330-f442-4e15-8223-1041249d6379 could not be found. Oct 08 21:12:15.415009 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-4180af8a-0610-4e95-8163-cbfc29c070f6 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Request method failure captured: Oct 08 21:12:15.415009 ncdv-master-1 devstack@n-api.service[140492]: request: PUT /compute/v2.1/servers/8d062330-f442-4e15-8223-1041249d6379 HTTP/1.1 Oct 08 21:12:15.415009 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:12:15.415009 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:12:15.415009 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:12:15.415009 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 80 Oct 08 21:12:15.415009 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:12:15.415009 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:12:15.415009 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:12:15.415009 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:12:15.415009 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQebW09Z3m936-d3SrnQA9UQ3KXQvUYeQwL43ufWdoxmQhUwYBWv-JT053t_VYPo9wAVRoCqYQy8Hhh8zc2n570KpS0qNVLik822FjYabkSIZMA_ubWypXzSwo3J04zV1MoSSz79D-b8-ZvwYCEIbwpbfyn5opgOjnO6EXvq1UNPaSyQ Oct 08 21:12:15.415009 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:12:15.415009 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:12:15.415009 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:12:15.415009 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:12:15.415009 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:12:15.415009 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:12:15.415009 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 0ae02675057e4f27bc1980348afc8ca1 Oct 08 21:12:15.415009 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-ServersNegativeTestJSON-1441071354 Oct 08 21:12:15.415009 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:12:15.415009 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:12:15.415009 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0ae02675057e4f27bc1980348afc8ca1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0ae02675057e4f27bc1980348afc8ca1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0ae02675057e4f27bc1980348afc8ca1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0ae02675057e4f27bc1980348afc8ca1"}]}] Oct 08 21:12:15.415009 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-ServersNegativeTestJSON-1441071354 Oct 08 21:12:15.415009 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 0ae02675057e4f27bc1980348afc8ca1 Oct 08 21:12:15.415009 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1441071354 Oct 08 21:12:15.415009 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-ServersNegativeTestJSON-1441071354-project Oct 08 21:12:15.415009 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:12:15.415009 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:12:15.415009 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 6a78d352c143483c8e4702d789d4c516 Oct 08 21:12:15.415009 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-ServersNegativeTestJSON-1441071354-project Oct 08 21:12:15.415009 ncdv-master-1 devstack@n-api.service[140492]: Oct 08 21:12:15.415009 ncdv-master-1 devstack@n-api.service[140492]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-642798209_updated"}} Oct 08 21:12:15.415009 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 21:12:15.415009 ncdv-master-1 devstack@n-api.service[140492]: exception: Instance 8d062330-f442-4e15-8223-1041249d6379 could not be found. Oct 08 21:12:15.415009 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': '8d062330-f442-4e15-8223-1041249d6379', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-642798209_updated'}}} Oct 08 21:12:15.415009 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:12:15.415009 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:12:15.415009 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:12:15.415009 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:12:15.415009 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:12:15.415009 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:12:15.415009 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 08 21:12:15.415009 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 08 21:12:15.415009 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d062330-f442-4e15-8223-1041249d6379 could not be found. Oct 08 21:12:15.415009 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:12:15.415009 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:12:15.415009 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:12:15.415009 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:12:15.415009 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:12:15.415009 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:12:15.415009 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:12:15.415009 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:12:15.415009 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:12:15.415009 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:12:15.415009 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 21:12:15.415009 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 21:12:15.415009 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 21:12:15.415009 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 21:12:15.415009 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 21:12:15.415009 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 21:12:15.415009 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 08 21:12:15.415009 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Oct 08 21:12:15.415009 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Oct 08 21:12:15.415009 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:12:15.419486 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:12:15.419486 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:12:15.419486 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:12:15.419486 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d062330-f442-4e15-8223-1041249d6379 could not be found. Oct 08 21:12:15.419486 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:12:15.419486 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:12:15.419486 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:12:15.419486 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:12:15.419486 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:12:15.419486 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:12:15.419486 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:12:15.419486 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:12:15.419486 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d062330-f442-4e15-8223-1041249d6379 could not be found. Oct 08 21:12:15.419486 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:12:15.422849 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-4180af8a-0610-4e95-8163-cbfc29c070f6 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Returning 404 to user: Instance 8d062330-f442-4e15-8223-1041249d6379 could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:12:15.426172 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-4180af8a-0610-4e95-8163-cbfc29c070f6 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "PUT /compute/v2.1/servers/8d062330-f442-4e15-8223-1041249d6379" status: 404 len: 111 microversion: 2.1 time: 0.031258 Oct 08 21:12:15.431373 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2385/4704] 10.222.0.26 () {60 vars in 1256 bytes} [Sat Oct 8 21:12:15 2022] PUT /compute/v2.1/servers/8d062330-f442-4e15-8223-1041249d6379 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:12:15.445417 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-46f0793d-1742-400d-b36d-155ae87cf657 tempest-SecurityGroupRulesTestJSON-2076505162 tempest-SecurityGroupRulesTestJSON-2076505162-project] Calling method '.version_select at 0x7f1a8c0b4f70>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:12:15.631467 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-16c010c7-4b57-43b0-9f10-7f7e31a1c8be req-25847257-d98a-495a-8525-47b59f77d1fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71182b09-915d-48cd-b56b-dc1ee940ade1", "name": "network-vif-deleted", "tag": "920b1a5f-23dd-4250-8862-421852054ba1"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:12:15.651768 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-16c010c7-4b57-43b0-9f10-7f7e31a1c8be req-25847257-d98a-495a-8525-47b59f77d1fc service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:15.653070 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-16c010c7-4b57-43b0-9f10-7f7e31a1c8be req-25847257-d98a-495a-8525-47b59f77d1fc service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:15.654239 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-16c010c7-4b57-43b0-9f10-7f7e31a1c8be req-25847257-d98a-495a-8525-47b59f77d1fc service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:15.670337 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-46f0793d-1742-400d-b36d-155ae87cf657 tempest-SecurityGroupRulesTestJSON-2076505162 tempest-SecurityGroupRulesTestJSON-2076505162-project] 10.222.0.26 "GET /compute/v2.1/os-security-groups/021c3cfc-f99d-42df-8d14-89c20bcbb479" status: 200 len: 664 microversion: 2.1 time: 0.236240 Oct 08 21:12:15.672797 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2386/4705] 10.222.0.26 () {58 vars in 1269 bytes} [Sat Oct 8 21:12:15 2022] GET /compute/v2.1/os-security-groups/021c3cfc-f99d-42df-8d14-89c20bcbb479 => generated 664 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:12:15.678339 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-16c010c7-4b57-43b0-9f10-7f7e31a1c8be req-25847257-d98a-495a-8525-47b59f77d1fc service nova] Creating event network-vif-deleted:920b1a5f-23dd-4250-8862-421852054ba1 for instance 71182b09-915d-48cd-b56b-dc1ee940ade1 on nch1-master-1 Oct 08 21:12:15.680974 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-4ab1d9b1-388f-4060-a58c-d4730c54bf93 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:12:15.681821 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-4ab1d9b1-388f-4060-a58c-d4730c54bf93 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:12:15.685467 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-16c010c7-4b57-43b0-9f10-7f7e31a1c8be req-25847257-d98a-495a-8525-47b59f77d1fc service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.309620 Oct 08 21:12:15.687180 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2320/4706] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:12:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:12:15.701363 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-b88b1886-ae56-4a35-95a9-bcb5c1d653eb tempest-SecurityGroupRulesTestJSON-2076505162 tempest-SecurityGroupRulesTestJSON-2076505162-project] Calling method '.version_select at 0x7f1a876fe4c0>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:12:15.702151 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4ab1d9b1-388f-4060-a58c-d4730c54bf93 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:15.703199 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4ab1d9b1-388f-4060-a58c-d4730c54bf93 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:15.704248 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4ab1d9b1-388f-4060-a58c-d4730c54bf93 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:15.708636 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4ab1d9b1-388f-4060-a58c-d4730c54bf93 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:15.709445 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4ab1d9b1-388f-4060-a58c-d4730c54bf93 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:15.714656 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4ab1d9b1-388f-4060-a58c-d4730c54bf93 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:15.829131 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=2 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:12:16.453519 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-b88b1886-ae56-4a35-95a9-bcb5c1d653eb tempest-SecurityGroupRulesTestJSON-2076505162 tempest-SecurityGroupRulesTestJSON-2076505162-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-group-rules/4ab42c62-9815-40c5-8154-10e37b07f042" status: 202 len: 0 microversion: 2.1 time: 0.764812 Oct 08 21:12:16.454056 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2321/4707] 10.222.0.26 () {58 vars in 1287 bytes} [Sat Oct 8 21:12:15 2022] DELETE /compute/v2.1/os-security-group-rules/4ab42c62-9815-40c5-8154-10e37b07f042 => generated 0 bytes in 766 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 21:12:16.461977 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-f052fe50-bb4c-4ff5-b762-e1d834ea6137 tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:12:16.462625 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-4ab1d9b1-388f-4060-a58c-d4730c54bf93 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:12:16.463080 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-f052fe50-bb4c-4ff5-b762-e1d834ea6137 tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] [instance: 84f33d6e-ddf3-4b77-b83d-595c7f75de55] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:12:16.484157 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f052fe50-bb4c-4ff5-b762-e1d834ea6137 tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:16.484157 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f052fe50-bb4c-4ff5-b762-e1d834ea6137 tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:16.484157 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f052fe50-bb4c-4ff5-b762-e1d834ea6137 tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:16.484645 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f052fe50-bb4c-4ff5-b762-e1d834ea6137 tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:16.485066 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f052fe50-bb4c-4ff5-b762-e1d834ea6137 tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:16.485737 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f052fe50-bb4c-4ff5-b762-e1d834ea6137 tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:16.494389 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-4ab1d9b1-388f-4060-a58c-d4730c54bf93 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 200 len: 1503 microversion: 2.1 time: 0.820162 Oct 08 21:12:16.494963 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2387/4708] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:12:15 2022] GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 1503 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:12:16.501150 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-8739f3ab-da7f-4fbf-82b0-ffed5202ee95 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:12:16.504361 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-8739f3ab-da7f-4fbf-82b0-ffed5202ee95 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: 71182b09-915d-48cd-b56b-dc1ee940ade1] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:12:16.533832 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8739f3ab-da7f-4fbf-82b0-ffed5202ee95 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:16.536151 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8739f3ab-da7f-4fbf-82b0-ffed5202ee95 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:16.538050 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8739f3ab-da7f-4fbf-82b0-ffed5202ee95 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:16.540518 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8739f3ab-da7f-4fbf-82b0-ffed5202ee95 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:16.541860 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8739f3ab-da7f-4fbf-82b0-ffed5202ee95 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:16.545603 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8739f3ab-da7f-4fbf-82b0-ffed5202ee95 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:16.600637 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-8739f3ab-da7f-4fbf-82b0-ffed5202ee95 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] HTTP exception thrown: Instance 71182b09-915d-48cd-b56b-dc1ee940ade1 could not be found. Oct 08 21:12:16.605421 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-8739f3ab-da7f-4fbf-82b0-ffed5202ee95 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Request method failure captured: Oct 08 21:12:16.605421 ncdv-master-1 devstack@n-api.service[140492]: request: GET /compute/v2.1/servers/71182b09-915d-48cd-b56b-dc1ee940ade1 HTTP/1.1 Oct 08 21:12:16.605421 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:12:16.605421 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:12:16.605421 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:12:16.605421 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 21:12:16.605421 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:12:16.605421 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:12:16.605421 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:12:16.605421 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:12:16.605421 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeaY45CCffIT40Amc9wEG1L3srTtCd58z19KxF0fYIwNPulOEB6B0U5KbwvP4xZlDymYa3r7NupuSBl7IoxTUgzZohPJnXbaXnL_FvPvzvmymW0IMjU5l88HUbi73sOE2TxCcEBd6artojZxtGFF9N7yzN3dTHpujcvoWiRD4lXAI28 Oct 08 21:12:16.605421 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:12:16.605421 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:12:16.605421 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:12:16.605421 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:12:16.605421 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:12:16.605421 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:12:16.605421 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 765c62cac2ee4406b23a5baa85c52ff7 Oct 08 21:12:16.605421 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-DeleteServersTestJSON-1423663413 Oct 08 21:12:16.605421 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:12:16.605421 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:12:16.605421 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/765c62cac2ee4406b23a5baa85c52ff7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/765c62cac2ee4406b23a5baa85c52ff7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_765c62cac2ee4406b23a5baa85c52ff7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/765c62cac2ee4406b23a5baa85c52ff7"}]}] Oct 08 21:12:16.605421 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-DeleteServersTestJSON-1423663413 Oct 08 21:12:16.605421 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 765c62cac2ee4406b23a5baa85c52ff7 Oct 08 21:12:16.605421 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-DeleteServersTestJSON-1423663413 Oct 08 21:12:16.605421 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-DeleteServersTestJSON-1423663413-project Oct 08 21:12:16.605421 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:12:16.605421 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:12:16.605421 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: d78e9afd772c4de981cac8f5817ec356 Oct 08 21:12:16.605421 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-DeleteServersTestJSON-1423663413-project Oct 08 21:12:16.605421 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 21:12:16.605421 ncdv-master-1 devstack@n-api.service[140492]: exception: Instance 71182b09-915d-48cd-b56b-dc1ee940ade1 could not be found. Oct 08 21:12:16.605421 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': '71182b09-915d-48cd-b56b-dc1ee940ade1'} Oct 08 21:12:16.605421 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:12:16.605421 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:12:16.605421 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:12:16.605421 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:12:16.605421 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:12:16.605421 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:12:16.605421 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:12:16.605421 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:12:16.605421 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:12:16.605421 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:12:16.605421 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71182b09-915d-48cd-b56b-dc1ee940ade1 could not be found. Oct 08 21:12:16.605421 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:12:16.605421 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:12:16.605421 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:12:16.605421 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:12:16.605421 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:12:16.605421 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:12:16.605421 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:12:16.605421 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:12:16.605421 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:12:16.605421 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:12:16.605421 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:12:16.605421 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:12:16.605421 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:12:16.605421 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:12:16.605421 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:12:16.605421 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:12:16.605421 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71182b09-915d-48cd-b56b-dc1ee940ade1 could not be found. Oct 08 21:12:16.605421 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:12:16.605421 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:12:16.605421 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:12:16.612185 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:12:16.612185 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:12:16.612185 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:12:16.612185 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:12:16.612185 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:12:16.612185 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71182b09-915d-48cd-b56b-dc1ee940ade1 could not be found. Oct 08 21:12:16.612185 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:12:16.612185 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-8739f3ab-da7f-4fbf-82b0-ffed5202ee95 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Returning 404 to user: Instance 71182b09-915d-48cd-b56b-dc1ee940ade1 could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:12:16.612185 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-8739f3ab-da7f-4fbf-82b0-ffed5202ee95 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/71182b09-915d-48cd-b56b-dc1ee940ade1" status: 404 len: 111 microversion: 2.1 time: 0.112745 Oct 08 21:12:16.612185 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2388/4709] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:12:16 2022] GET /compute/v2.1/servers/71182b09-915d-48cd-b56b-dc1ee940ade1 => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:12:16.624841 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-8f4f4ed9-02f6-4a26-80a3-953d68d539be tempest-SecurityGroupRulesTestJSON-2076505162 tempest-SecurityGroupRulesTestJSON-2076505162-project] Calling method '.version_select at 0x7f1a87718160>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:12:16.713257 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-f052fe50-bb4c-4ff5-b762-e1d834ea6137 tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77129c9ce5149748c6bd39c69307f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a53484c6ab4ea4be7acb5ac53acaa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:12:16.725691 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-f052fe50-bb4c-4ff5-b762-e1d834ea6137 tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] 10.222.0.26 "GET /compute/v2.1/servers/84f33d6e-ddf3-4b77-b83d-595c7f75de55" status: 200 len: 1317 microversion: 2.1 time: 0.270301 Oct 08 21:12:16.749594 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2322/4710] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:12:16 2022] GET /compute/v2.1/servers/84f33d6e-ddf3-4b77-b83d-595c7f75de55 => generated 1317 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:12:16.770970 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-d2d52177-d86d-4386-960b-8d7b810a627a tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:12:16.772050 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-d2d52177-d86d-4386-960b-8d7b810a627a tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:12:16.789671 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d2d52177-d86d-4386-960b-8d7b810a627a tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:16.790130 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d2d52177-d86d-4386-960b-8d7b810a627a tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:16.792356 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d2d52177-d86d-4386-960b-8d7b810a627a tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:16.797081 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d2d52177-d86d-4386-960b-8d7b810a627a tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:16.798754 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d2d52177-d86d-4386-960b-8d7b810a627a tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:16.800835 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d2d52177-d86d-4386-960b-8d7b810a627a tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:17.055290 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-d2d52177-d86d-4386-960b-8d7b810a627a tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:12:17.066547 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-d2d52177-d86d-4386-960b-8d7b810a627a tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 200 len: 1503 microversion: 2.1 time: 0.313736 Oct 08 21:12:17.067823 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2323/4711] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:12:16 2022] GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 1503 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:12:17.073967 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-66e6b5f5-f767-4e0a-9034-f11b68be1a10 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:12:17.074705 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-66e6b5f5-f767-4e0a-9034-f11b68be1a10 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: 71182b09-915d-48cd-b56b-dc1ee940ade1] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:12:17.082724 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-66e6b5f5-f767-4e0a-9034-f11b68be1a10 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:17.084013 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-66e6b5f5-f767-4e0a-9034-f11b68be1a10 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:17.084907 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-66e6b5f5-f767-4e0a-9034-f11b68be1a10 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:17.085676 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-66e6b5f5-f767-4e0a-9034-f11b68be1a10 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:17.086276 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-66e6b5f5-f767-4e0a-9034-f11b68be1a10 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:17.087143 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-66e6b5f5-f767-4e0a-9034-f11b68be1a10 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:17.106574 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-66e6b5f5-f767-4e0a-9034-f11b68be1a10 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] HTTP exception thrown: Instance 71182b09-915d-48cd-b56b-dc1ee940ade1 could not be found. Oct 08 21:12:17.108961 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-66e6b5f5-f767-4e0a-9034-f11b68be1a10 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Request method failure captured: Oct 08 21:12:17.108961 ncdv-master-1 devstack@n-api.service[140491]: request: DELETE /compute/v2.1/servers/71182b09-915d-48cd-b56b-dc1ee940ade1 HTTP/1.1 Oct 08 21:12:17.108961 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:12:17.108961 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:12:17.108961 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:12:17.108961 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 21:12:17.108961 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:12:17.108961 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:12:17.108961 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:12:17.108961 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:12:17.108961 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeaY45CCffIT40Amc9wEG1L3srTtCd58z19KxF0fYIwNPulOEB6B0U5KbwvP4xZlDymYa3r7NupuSBl7IoxTUgzZohPJnXbaXnL_FvPvzvmymW0IMjU5l88HUbi73sOE2TxCcEBd6artojZxtGFF9N7yzN3dTHpujcvoWiRD4lXAI28 Oct 08 21:12:17.108961 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:12:17.108961 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:12:17.108961 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:12:17.108961 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:12:17.108961 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:12:17.108961 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:12:17.108961 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 765c62cac2ee4406b23a5baa85c52ff7 Oct 08 21:12:17.108961 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-DeleteServersTestJSON-1423663413 Oct 08 21:12:17.108961 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:12:17.108961 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:12:17.108961 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/765c62cac2ee4406b23a5baa85c52ff7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/765c62cac2ee4406b23a5baa85c52ff7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_765c62cac2ee4406b23a5baa85c52ff7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/765c62cac2ee4406b23a5baa85c52ff7"}]}] Oct 08 21:12:17.108961 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-DeleteServersTestJSON-1423663413 Oct 08 21:12:17.108961 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 765c62cac2ee4406b23a5baa85c52ff7 Oct 08 21:12:17.108961 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-DeleteServersTestJSON-1423663413 Oct 08 21:12:17.108961 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-DeleteServersTestJSON-1423663413-project Oct 08 21:12:17.108961 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:12:17.108961 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:12:17.108961 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: d78e9afd772c4de981cac8f5817ec356 Oct 08 21:12:17.108961 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-DeleteServersTestJSON-1423663413-project Oct 08 21:12:17.108961 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:12:17.108961 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance 71182b09-915d-48cd-b56b-dc1ee940ade1 could not be found. Oct 08 21:12:17.108961 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': '71182b09-915d-48cd-b56b-dc1ee940ade1'} Oct 08 21:12:17.108961 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:12:17.108961 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:12:17.108961 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:12:17.108961 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:12:17.108961 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:12:17.108961 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:12:17.108961 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:12:17.108961 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:12:17.108961 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:12:17.108961 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:12:17.108961 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71182b09-915d-48cd-b56b-dc1ee940ade1 could not be found. Oct 08 21:12:17.108961 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:12:17.108961 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:12:17.108961 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:12:17.108961 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:12:17.108961 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:12:17.108961 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:12:17.108961 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:12:17.108961 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:12:17.108961 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:12:17.108961 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:12:17.108961 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 08 21:12:17.108961 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 08 21:12:17.108961 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 08 21:12:17.108961 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 08 21:12:17.108961 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:12:17.108961 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:12:17.108961 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:12:17.108961 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:12:17.113209 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71182b09-915d-48cd-b56b-dc1ee940ade1 could not be found. Oct 08 21:12:17.113209 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:12:17.113209 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:12:17.113209 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:12:17.113209 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:12:17.113209 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:12:17.113209 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:12:17.113209 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:12:17.113209 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:12:17.113209 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71182b09-915d-48cd-b56b-dc1ee940ade1 could not be found. Oct 08 21:12:17.113209 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:12:17.117279 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-66e6b5f5-f767-4e0a-9034-f11b68be1a10 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Returning 404 to user: Instance 71182b09-915d-48cd-b56b-dc1ee940ade1 could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:12:17.118571 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-66e6b5f5-f767-4e0a-9034-f11b68be1a10 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "DELETE /compute/v2.1/servers/71182b09-915d-48cd-b56b-dc1ee940ade1" status: 404 len: 111 microversion: 2.1 time: 0.049436 Oct 08 21:12:17.122555 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2324/4712] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:12:17 2022] DELETE /compute/v2.1/servers/71182b09-915d-48cd-b56b-dc1ee940ade1 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:12:17.128851 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-f05bd1eb-cdf7-45c4-a980-394aeb4b8617 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:12:17.135010 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-f05bd1eb-cdf7-45c4-a980-394aeb4b8617 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Request method failure captured: Oct 08 21:12:17.135010 ncdv-master-1 devstack@n-api.service[140491]: request: PUT /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 HTTP/1.1 Oct 08 21:12:17.135010 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:12:17.135010 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:12:17.135010 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:12:17.135010 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 280 Oct 08 21:12:17.135010 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:12:17.135010 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:12:17.135010 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:12:17.135010 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:12:17.135010 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQebW09Z3m936-d3SrnQA9UQ3KXQvUYeQwL43ufWdoxmQhUwYBWv-JT053t_VYPo9wAVRoCqYQy8Hhh8zc2n570KpS0qNVLik822FjYabkSIZMA_ubWypXzSwo3J04zV1MoSSz79D-b8-ZvwYCEIbwpbfyn5opgOjnO6EXvq1UNPaSyQ Oct 08 21:12:17.135010 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:12:17.135010 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:12:17.135010 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:12:17.135010 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:12:17.135010 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:12:17.135010 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:12:17.135010 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 0ae02675057e4f27bc1980348afc8ca1 Oct 08 21:12:17.135010 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-ServersNegativeTestJSON-1441071354 Oct 08 21:12:17.135010 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:12:17.135010 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:12:17.135010 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0ae02675057e4f27bc1980348afc8ca1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0ae02675057e4f27bc1980348afc8ca1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0ae02675057e4f27bc1980348afc8ca1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0ae02675057e4f27bc1980348afc8ca1"}]}] Oct 08 21:12:17.135010 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-ServersNegativeTestJSON-1441071354 Oct 08 21:12:17.135010 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 0ae02675057e4f27bc1980348afc8ca1 Oct 08 21:12:17.135010 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1441071354 Oct 08 21:12:17.135010 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-ServersNegativeTestJSON-1441071354-project Oct 08 21:12:17.135010 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:12:17.135010 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:12:17.135010 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 6a78d352c143483c8e4702d789d4c516 Oct 08 21:12:17.135010 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-ServersNegativeTestJSON-1441071354-project Oct 08 21:12:17.135010 ncdv-master-1 devstack@n-api.service[140491]: Oct 08 21:12:17.135010 ncdv-master-1 devstack@n-api.service[140491]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 08 21:12:17.135010 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:12:17.135010 ncdv-master-1 devstack@n-api.service[140491]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 08 21:12:17.135010 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': 'e2548207-aa57-4e4c-876b-2027b59283d2', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 08 21:12:17.135010 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:12:17.135010 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:12:17.135010 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 08 21:12:17.135010 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 08 21:12:17.135010 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 08 21:12:17.135010 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise error Oct 08 21:12:17.135010 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 08 21:12:17.135010 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:12:17.135010 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Oct 08 21:12:17.135010 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 08 21:12:17.135010 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:12:17.135010 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 08 21:12:17.135010 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 08 21:12:17.135010 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:12:17.135010 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:12:17.135010 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:12:17.135010 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:12:17.138412 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:12:17.138412 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:12:17.138412 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:12:17.138412 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:12:17.138412 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:12:17.138412 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:12:17.138412 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 21:12:17.138412 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 21:12:17.138412 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 08 21:12:17.138412 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 08 21:12:17.138412 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 08 21:12:17.138412 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 08 21:12:17.138412 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 08 21:12:17.138412 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 08 21:12:17.138412 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 08 21:12:17.138412 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:12:17.138412 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:12:17.138412 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:12:17.138412 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:12:17.138412 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:12:17.138412 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:12:17.138412 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 08 21:12:17.138412 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 08 21:12:17.138412 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 08 21:12:17.138412 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:12:17.138412 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-f05bd1eb-cdf7-45c4-a980-394aeb4b8617 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:12:17.138412 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-f05bd1eb-cdf7-45c4-a980-394aeb4b8617 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "PUT /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 400 len: 619 microversion: 2.1 time: 0.012631 Oct 08 21:12:17.138412 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2325/4713] 10.222.0.26 () {60 vars in 1257 bytes} [Sat Oct 8 21:12:17 2022] PUT /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 619 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 08 21:12:17.152992 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-4a2c5dc2-057f-42cf-8fce-0ba736c22b90 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:12:17.154779 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-4a2c5dc2-057f-42cf-8fce-0ba736c22b90 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: 71182b09-915d-48cd-b56b-dc1ee940ade1] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:12:17.178008 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4a2c5dc2-057f-42cf-8fce-0ba736c22b90 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:17.178529 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4a2c5dc2-057f-42cf-8fce-0ba736c22b90 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:17.179093 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4a2c5dc2-057f-42cf-8fce-0ba736c22b90 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:17.179764 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4a2c5dc2-057f-42cf-8fce-0ba736c22b90 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:17.180241 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4a2c5dc2-057f-42cf-8fce-0ba736c22b90 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:17.180797 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4a2c5dc2-057f-42cf-8fce-0ba736c22b90 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:17.201697 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-4a2c5dc2-057f-42cf-8fce-0ba736c22b90 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] HTTP exception thrown: Instance 71182b09-915d-48cd-b56b-dc1ee940ade1 could not be found. Oct 08 21:12:17.203938 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-4a2c5dc2-057f-42cf-8fce-0ba736c22b90 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Request method failure captured: Oct 08 21:12:17.203938 ncdv-master-1 devstack@n-api.service[140491]: request: GET /compute/v2.1/servers/71182b09-915d-48cd-b56b-dc1ee940ade1 HTTP/1.1 Oct 08 21:12:17.203938 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:12:17.203938 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:12:17.203938 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:12:17.203938 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 21:12:17.203938 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:12:17.203938 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:12:17.203938 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:12:17.203938 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:12:17.203938 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeaY45CCffIT40Amc9wEG1L3srTtCd58z19KxF0fYIwNPulOEB6B0U5KbwvP4xZlDymYa3r7NupuSBl7IoxTUgzZohPJnXbaXnL_FvPvzvmymW0IMjU5l88HUbi73sOE2TxCcEBd6artojZxtGFF9N7yzN3dTHpujcvoWiRD4lXAI28 Oct 08 21:12:17.203938 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:12:17.203938 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:12:17.203938 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:12:17.203938 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:12:17.203938 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:12:17.203938 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:12:17.203938 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 765c62cac2ee4406b23a5baa85c52ff7 Oct 08 21:12:17.203938 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-DeleteServersTestJSON-1423663413 Oct 08 21:12:17.203938 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:12:17.203938 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:12:17.203938 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/765c62cac2ee4406b23a5baa85c52ff7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/765c62cac2ee4406b23a5baa85c52ff7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_765c62cac2ee4406b23a5baa85c52ff7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/765c62cac2ee4406b23a5baa85c52ff7"}]}] Oct 08 21:12:17.203938 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-DeleteServersTestJSON-1423663413 Oct 08 21:12:17.203938 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 765c62cac2ee4406b23a5baa85c52ff7 Oct 08 21:12:17.203938 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-DeleteServersTestJSON-1423663413 Oct 08 21:12:17.203938 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-DeleteServersTestJSON-1423663413-project Oct 08 21:12:17.203938 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:12:17.203938 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:12:17.203938 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: d78e9afd772c4de981cac8f5817ec356 Oct 08 21:12:17.203938 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-DeleteServersTestJSON-1423663413-project Oct 08 21:12:17.203938 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:12:17.203938 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance 71182b09-915d-48cd-b56b-dc1ee940ade1 could not be found. Oct 08 21:12:17.203938 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': '71182b09-915d-48cd-b56b-dc1ee940ade1'} Oct 08 21:12:17.203938 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:12:17.203938 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:12:17.203938 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:12:17.203938 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:12:17.203938 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:12:17.203938 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:12:17.203938 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:12:17.203938 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:12:17.203938 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:12:17.203938 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:12:17.203938 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71182b09-915d-48cd-b56b-dc1ee940ade1 could not be found. Oct 08 21:12:17.203938 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:12:17.203938 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:12:17.203938 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:12:17.203938 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:12:17.203938 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:12:17.203938 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:12:17.203938 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:12:17.203938 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:12:17.203938 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:12:17.203938 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:12:17.203938 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:12:17.203938 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:12:17.203938 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:12:17.203938 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:12:17.203938 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:12:17.203938 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:12:17.203938 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71182b09-915d-48cd-b56b-dc1ee940ade1 could not be found. Oct 08 21:12:17.203938 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:12:17.203938 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:12:17.203938 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:12:17.209292 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:12:17.209292 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:12:17.209292 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:12:17.209292 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:12:17.209292 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:12:17.209292 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71182b09-915d-48cd-b56b-dc1ee940ade1 could not be found. Oct 08 21:12:17.209292 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:12:17.212218 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-4a2c5dc2-057f-42cf-8fce-0ba736c22b90 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Returning 404 to user: Instance 71182b09-915d-48cd-b56b-dc1ee940ade1 could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:12:17.214359 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-4a2c5dc2-057f-42cf-8fce-0ba736c22b90 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/71182b09-915d-48cd-b56b-dc1ee940ade1" status: 404 len: 111 microversion: 2.1 time: 0.075703 Oct 08 21:12:17.215696 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2326/4714] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:12:17 2022] GET /compute/v2.1/servers/71182b09-915d-48cd-b56b-dc1ee940ade1 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:12:17.221373 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-35caf48d-1091-4a51-8ae4-97fe51987b11 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:12:17.222008 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-35caf48d-1091-4a51-8ae4-97fe51987b11 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:12:17.226825 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-8f4f4ed9-02f6-4a26-80a3-953d68d539be tempest-SecurityGroupRulesTestJSON-2076505162 tempest-SecurityGroupRulesTestJSON-2076505162-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/021c3cfc-f99d-42df-8d14-89c20bcbb479" status: 202 len: 0 microversion: 2.1 time: 0.613825 Oct 08 21:12:17.227417 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2389/4715] 10.222.0.26 () {58 vars in 1272 bytes} [Sat Oct 8 21:12:16 2022] DELETE /compute/v2.1/os-security-groups/021c3cfc-f99d-42df-8d14-89c20bcbb479 => generated 0 bytes in 615 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 21:12:17.232656 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-35caf48d-1091-4a51-8ae4-97fe51987b11 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:17.234979 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-35caf48d-1091-4a51-8ae4-97fe51987b11 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:17.235853 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-35caf48d-1091-4a51-8ae4-97fe51987b11 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:17.236790 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-35caf48d-1091-4a51-8ae4-97fe51987b11 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:17.237324 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-35caf48d-1091-4a51-8ae4-97fe51987b11 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:17.237772 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-35caf48d-1091-4a51-8ae4-97fe51987b11 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:17.241028 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-cfb1bda5-dd3f-492b-a3a5-900464537697 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:12:17.241594 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-cfb1bda5-dd3f-492b-a3a5-900464537697 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: 82b72e20-b9e2-45ce-9362-b248f6d47bda] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:12:17.265725 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cfb1bda5-dd3f-492b-a3a5-900464537697 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:17.266886 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cfb1bda5-dd3f-492b-a3a5-900464537697 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:17.267349 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cfb1bda5-dd3f-492b-a3a5-900464537697 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:17.268098 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cfb1bda5-dd3f-492b-a3a5-900464537697 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:17.268576 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cfb1bda5-dd3f-492b-a3a5-900464537697 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:17.269020 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cfb1bda5-dd3f-492b-a3a5-900464537697 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:17.306880 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-cfb1bda5-dd3f-492b-a3a5-900464537697 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] HTTP exception thrown: Instance 82b72e20-b9e2-45ce-9362-b248f6d47bda could not be found. Oct 08 21:12:17.308590 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-cfb1bda5-dd3f-492b-a3a5-900464537697 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Request method failure captured: Oct 08 21:12:17.308590 ncdv-master-1 devstack@n-api.service[140492]: request: DELETE /compute/v2.1/servers/82b72e20-b9e2-45ce-9362-b248f6d47bda HTTP/1.1 Oct 08 21:12:17.308590 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:12:17.308590 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:12:17.308590 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:12:17.308590 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 21:12:17.308590 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:12:17.308590 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:12:17.308590 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:12:17.308590 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:12:17.308590 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeaY45CCffIT40Amc9wEG1L3srTtCd58z19KxF0fYIwNPulOEB6B0U5KbwvP4xZlDymYa3r7NupuSBl7IoxTUgzZohPJnXbaXnL_FvPvzvmymW0IMjU5l88HUbi73sOE2TxCcEBd6artojZxtGFF9N7yzN3dTHpujcvoWiRD4lXAI28 Oct 08 21:12:17.308590 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:12:17.308590 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:12:17.308590 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:12:17.308590 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:12:17.308590 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:12:17.308590 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:12:17.308590 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 765c62cac2ee4406b23a5baa85c52ff7 Oct 08 21:12:17.308590 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-DeleteServersTestJSON-1423663413 Oct 08 21:12:17.308590 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:12:17.308590 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:12:17.308590 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/765c62cac2ee4406b23a5baa85c52ff7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/765c62cac2ee4406b23a5baa85c52ff7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_765c62cac2ee4406b23a5baa85c52ff7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/765c62cac2ee4406b23a5baa85c52ff7"}]}] Oct 08 21:12:17.308590 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-DeleteServersTestJSON-1423663413 Oct 08 21:12:17.308590 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 765c62cac2ee4406b23a5baa85c52ff7 Oct 08 21:12:17.308590 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-DeleteServersTestJSON-1423663413 Oct 08 21:12:17.308590 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-DeleteServersTestJSON-1423663413-project Oct 08 21:12:17.308590 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:12:17.308590 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:12:17.308590 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: d78e9afd772c4de981cac8f5817ec356 Oct 08 21:12:17.308590 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-DeleteServersTestJSON-1423663413-project Oct 08 21:12:17.308590 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 21:12:17.308590 ncdv-master-1 devstack@n-api.service[140492]: exception: Instance 82b72e20-b9e2-45ce-9362-b248f6d47bda could not be found. Oct 08 21:12:17.308590 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': '82b72e20-b9e2-45ce-9362-b248f6d47bda'} Oct 08 21:12:17.308590 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:12:17.308590 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:12:17.308590 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:12:17.308590 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:12:17.308590 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:12:17.308590 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:12:17.308590 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:12:17.308590 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:12:17.308590 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:12:17.308590 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:12:17.308590 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82b72e20-b9e2-45ce-9362-b248f6d47bda could not be found. Oct 08 21:12:17.308590 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:12:17.308590 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:12:17.308590 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:12:17.308590 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:12:17.308590 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:12:17.308590 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:12:17.308590 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:12:17.308590 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:12:17.308590 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:12:17.308590 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:12:17.308590 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 08 21:12:17.308590 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 08 21:12:17.308590 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 08 21:12:17.308590 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 08 21:12:17.308590 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:12:17.308590 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:12:17.308590 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:12:17.308590 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:12:17.313741 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82b72e20-b9e2-45ce-9362-b248f6d47bda could not be found. Oct 08 21:12:17.313741 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:12:17.313741 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:12:17.313741 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:12:17.313741 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:12:17.313741 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:12:17.313741 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:12:17.313741 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:12:17.313741 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:12:17.313741 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82b72e20-b9e2-45ce-9362-b248f6d47bda could not be found. Oct 08 21:12:17.313741 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:12:17.313741 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-cfb1bda5-dd3f-492b-a3a5-900464537697 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Returning 404 to user: Instance 82b72e20-b9e2-45ce-9362-b248f6d47bda could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:12:17.324012 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-cfb1bda5-dd3f-492b-a3a5-900464537697 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "DELETE /compute/v2.1/servers/82b72e20-b9e2-45ce-9362-b248f6d47bda" status: 404 len: 111 microversion: 2.1 time: 0.090218 Oct 08 21:12:17.326447 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2390/4716] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:12:17 2022] DELETE /compute/v2.1/servers/82b72e20-b9e2-45ce-9362-b248f6d47bda => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:12:17.336915 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-dfda80ea-a449-4a47-b95c-06a04d105b45 tempest-SecurityGroupRulesTestJSON-2076505162 tempest-SecurityGroupRulesTestJSON-2076505162-project] Calling method '.version_select at 0x7f1a87cefee0>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:12:17.377575 ncdv-master-1 devstack@n-api.service[140492]: DEBUG neutronclient.v2_0.client [None req-dfda80ea-a449-4a47-b95c-06a04d105b45 tempest-SecurityGroupRulesTestJSON-2076505162 tempest-SecurityGroupRulesTestJSON-2076505162-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group bd9e83e0-0295-41bf-b381-e9edeff1b7ad does not exist", "detail": ""}} {{(pid=140492) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 08 21:12:17.378204 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.network.security_group_api [None req-dfda80ea-a449-4a47-b95c-06a04d105b45 tempest-SecurityGroupRulesTestJSON-2076505162 tempest-SecurityGroupRulesTestJSON-2076505162-project] Neutron security group bd9e83e0-0295-41bf-b381-e9edeff1b7ad not found {{(pid=140492) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 08 21:12:17.378967 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-dfda80ea-a449-4a47-b95c-06a04d105b45 tempest-SecurityGroupRulesTestJSON-2076505162 tempest-SecurityGroupRulesTestJSON-2076505162-project] HTTP exception thrown: Security group bd9e83e0-0295-41bf-b381-e9edeff1b7ad does not exist Oct 08 21:12:17.378967 ncdv-master-1 devstack@n-api.service[140492]: Neutron server returns request_ids: ['req-bb0fd630-d23d-44b5-9a2a-0f00398b4159'] Oct 08 21:12:17.381957 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-dfda80ea-a449-4a47-b95c-06a04d105b45 tempest-SecurityGroupRulesTestJSON-2076505162 tempest-SecurityGroupRulesTestJSON-2076505162-project] Request method failure captured: Oct 08 21:12:17.381957 ncdv-master-1 devstack@n-api.service[140492]: request: DELETE /compute/v2.1/os-security-groups/bd9e83e0-0295-41bf-b381-e9edeff1b7ad HTTP/1.1 Oct 08 21:12:17.381957 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:12:17.381957 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:12:17.381957 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:12:17.381957 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 21:12:17.381957 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:12:17.381957 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:12:17.381957 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:12:17.381957 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:12:17.381957 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeefrMFMfh12YGS9bznpFSI5PTjnhXq3TuipZZbwa92XmSelMv8lV8p7zRlSQSbolXWt4WCbT1hZ437bU9KmLvqQl23FrjD84KwFI8YPwxqzVvQjRA0fQlIO-qqA5J-kZ0Fbyq2qCcULrSWw-6gZXBA3Ko0nupNUejNFLs5lbgbZkTw Oct 08 21:12:17.381957 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:12:17.381957 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:12:17.381957 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:12:17.381957 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:12:17.381957 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:12:17.381957 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:12:17.381957 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 85daf8b3ee684e01a414941e7b7c768b Oct 08 21:12:17.381957 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-2076505162 Oct 08 21:12:17.381957 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:12:17.381957 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:12:17.381957 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/85daf8b3ee684e01a414941e7b7c768b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/85daf8b3ee684e01a414941e7b7c768b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_85daf8b3ee684e01a414941e7b7c768b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/85daf8b3ee684e01a414941e7b7c768b"}]}] Oct 08 21:12:17.381957 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-SecurityGroupRulesTestJSON-2076505162 Oct 08 21:12:17.381957 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 85daf8b3ee684e01a414941e7b7c768b Oct 08 21:12:17.381957 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-2076505162 Oct 08 21:12:17.381957 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-SecurityGroupRulesTestJSON-2076505162-project Oct 08 21:12:17.381957 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:12:17.381957 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:12:17.381957 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 84b9968c1dd3411ca4e8232709346400 Oct 08 21:12:17.381957 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-SecurityGroupRulesTestJSON-2076505162-project Oct 08 21:12:17.381957 ncdv-master-1 devstack@n-api.service[140492]: method: Oct 08 21:12:17.381957 ncdv-master-1 devstack@n-api.service[140492]: exception: Security group bd9e83e0-0295-41bf-b381-e9edeff1b7ad does not exist Oct 08 21:12:17.381957 ncdv-master-1 devstack@n-api.service[140492]: Neutron server returns request_ids: ['req-bb0fd630-d23d-44b5-9a2a-0f00398b4159'] Oct 08 21:12:17.381957 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': 'bd9e83e0-0295-41bf-b381-e9edeff1b7ad'} Oct 08 21:12:17.381957 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:12:17.381957 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:12:17.381957 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 08 21:12:17.381957 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 08 21:12:17.381957 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 08 21:12:17.381957 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 08 21:12:17.381957 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 08 21:12:17.381957 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 08 21:12:17.381957 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 08 21:12:17.381957 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 08 21:12:17.381957 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 08 21:12:17.381957 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 08 21:12:17.381957 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 08 21:12:17.381957 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 08 21:12:17.381957 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 08 21:12:17.381957 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 08 21:12:17.381957 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 08 21:12:17.381957 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 08 21:12:17.381957 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 08 21:12:17.381957 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 08 21:12:17.381957 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 08 21:12:17.381957 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 08 21:12:17.381957 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 08 21:12:17.381957 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 08 21:12:17.381957 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 08 21:12:17.381957 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 08 21:12:17.381957 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group bd9e83e0-0295-41bf-b381-e9edeff1b7ad does not exist Oct 08 21:12:17.387972 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bb0fd630-d23d-44b5-9a2a-0f00398b4159'] Oct 08 21:12:17.387972 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:12:17.387972 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:12:17.387972 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:12:17.387972 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:12:17.387972 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 08 21:12:17.387972 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 08 21:12:17.387972 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 08 21:12:17.387972 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 08 21:12:17.387972 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group bd9e83e0-0295-41bf-b381-e9edeff1b7ad does not exist Oct 08 21:12:17.387972 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bb0fd630-d23d-44b5-9a2a-0f00398b4159'] Oct 08 21:12:17.387972 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:12:17.387972 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:12:17.387972 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:12:17.387972 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:12:17.387972 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:12:17.387972 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:12:17.387972 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:12:17.387972 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:12:17.387972 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 08 21:12:17.387972 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 08 21:12:17.387972 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:12:17.387972 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:12:17.387972 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 08 21:12:17.387972 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 08 21:12:17.387972 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group bd9e83e0-0295-41bf-b381-e9edeff1b7ad does not exist Oct 08 21:12:17.387972 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bb0fd630-d23d-44b5-9a2a-0f00398b4159'] Oct 08 21:12:17.387972 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:12:17.387972 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:12:17.387972 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:12:17.387972 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:12:17.387972 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:12:17.387972 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:12:17.387972 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:12:17.387972 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:12:17.387972 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group bd9e83e0-0295-41bf-b381-e9edeff1b7ad does not exist Oct 08 21:12:17.387972 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bb0fd630-d23d-44b5-9a2a-0f00398b4159'] Oct 08 21:12:17.387972 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:12:17.392800 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-dfda80ea-a449-4a47-b95c-06a04d105b45 tempest-SecurityGroupRulesTestJSON-2076505162 tempest-SecurityGroupRulesTestJSON-2076505162-project] Returning 404 to user: Security group bd9e83e0-0295-41bf-b381-e9edeff1b7ad does not exist Oct 08 21:12:17.392800 ncdv-master-1 devstack@n-api.service[140492]: Neutron server returns request_ids: ['req-bb0fd630-d23d-44b5-9a2a-0f00398b4159'] {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:12:17.394242 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-dfda80ea-a449-4a47-b95c-06a04d105b45 tempest-SecurityGroupRulesTestJSON-2076505162 tempest-SecurityGroupRulesTestJSON-2076505162-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/bd9e83e0-0295-41bf-b381-e9edeff1b7ad" status: 404 len: 194 microversion: 2.1 time: 0.064005 Oct 08 21:12:17.395269 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2391/4717] 10.222.0.26 () {58 vars in 1272 bytes} [Sat Oct 8 21:12:17 2022] DELETE /compute/v2.1/os-security-groups/bd9e83e0-0295-41bf-b381-e9edeff1b7ad => generated 194 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:12:17.402716 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-d75f4374-def2-4d3e-96bb-096c0e076ab8 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:12:17.403340 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-d75f4374-def2-4d3e-96bb-096c0e076ab8 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: 82b72e20-b9e2-45ce-9362-b248f6d47bda] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:12:17.427452 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d75f4374-def2-4d3e-96bb-096c0e076ab8 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:17.428473 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d75f4374-def2-4d3e-96bb-096c0e076ab8 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:17.429711 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d75f4374-def2-4d3e-96bb-096c0e076ab8 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:17.431700 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d75f4374-def2-4d3e-96bb-096c0e076ab8 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:17.432382 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d75f4374-def2-4d3e-96bb-096c0e076ab8 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:17.433467 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d75f4374-def2-4d3e-96bb-096c0e076ab8 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:17.450083 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-d75f4374-def2-4d3e-96bb-096c0e076ab8 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] HTTP exception thrown: Instance 82b72e20-b9e2-45ce-9362-b248f6d47bda could not be found. Oct 08 21:12:17.453960 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-d75f4374-def2-4d3e-96bb-096c0e076ab8 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Request method failure captured: Oct 08 21:12:17.453960 ncdv-master-1 devstack@n-api.service[140492]: request: GET /compute/v2.1/servers/82b72e20-b9e2-45ce-9362-b248f6d47bda HTTP/1.1 Oct 08 21:12:17.453960 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:12:17.453960 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:12:17.453960 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:12:17.453960 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 21:12:17.453960 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:12:17.453960 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:12:17.453960 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:12:17.453960 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:12:17.453960 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeaY45CCffIT40Amc9wEG1L3srTtCd58z19KxF0fYIwNPulOEB6B0U5KbwvP4xZlDymYa3r7NupuSBl7IoxTUgzZohPJnXbaXnL_FvPvzvmymW0IMjU5l88HUbi73sOE2TxCcEBd6artojZxtGFF9N7yzN3dTHpujcvoWiRD4lXAI28 Oct 08 21:12:17.453960 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:12:17.453960 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:12:17.453960 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:12:17.453960 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:12:17.453960 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:12:17.453960 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:12:17.453960 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 765c62cac2ee4406b23a5baa85c52ff7 Oct 08 21:12:17.453960 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-DeleteServersTestJSON-1423663413 Oct 08 21:12:17.453960 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:12:17.453960 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:12:17.453960 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/765c62cac2ee4406b23a5baa85c52ff7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/765c62cac2ee4406b23a5baa85c52ff7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_765c62cac2ee4406b23a5baa85c52ff7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/765c62cac2ee4406b23a5baa85c52ff7"}]}] Oct 08 21:12:17.453960 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-DeleteServersTestJSON-1423663413 Oct 08 21:12:17.453960 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 765c62cac2ee4406b23a5baa85c52ff7 Oct 08 21:12:17.453960 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-DeleteServersTestJSON-1423663413 Oct 08 21:12:17.453960 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-DeleteServersTestJSON-1423663413-project Oct 08 21:12:17.453960 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:12:17.453960 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:12:17.453960 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: d78e9afd772c4de981cac8f5817ec356 Oct 08 21:12:17.453960 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-DeleteServersTestJSON-1423663413-project Oct 08 21:12:17.453960 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 21:12:17.453960 ncdv-master-1 devstack@n-api.service[140492]: exception: Instance 82b72e20-b9e2-45ce-9362-b248f6d47bda could not be found. Oct 08 21:12:17.453960 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': '82b72e20-b9e2-45ce-9362-b248f6d47bda'} Oct 08 21:12:17.453960 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:12:17.453960 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:12:17.453960 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:12:17.453960 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:12:17.453960 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:12:17.453960 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:12:17.453960 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:12:17.453960 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:12:17.453960 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:12:17.453960 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:12:17.453960 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82b72e20-b9e2-45ce-9362-b248f6d47bda could not be found. Oct 08 21:12:17.453960 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:12:17.453960 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:12:17.453960 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:12:17.453960 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:12:17.453960 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:12:17.453960 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:12:17.453960 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:12:17.453960 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:12:17.453960 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:12:17.453960 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:12:17.453960 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:12:17.453960 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:12:17.453960 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:12:17.453960 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:12:17.453960 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:12:17.453960 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:12:17.453960 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82b72e20-b9e2-45ce-9362-b248f6d47bda could not be found. Oct 08 21:12:17.453960 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:12:17.453960 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:12:17.453960 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:12:17.457853 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:12:17.457853 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:12:17.457853 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:12:17.457853 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:12:17.457853 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:12:17.457853 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82b72e20-b9e2-45ce-9362-b248f6d47bda could not be found. Oct 08 21:12:17.457853 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:12:17.457853 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-d75f4374-def2-4d3e-96bb-096c0e076ab8 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Returning 404 to user: Instance 82b72e20-b9e2-45ce-9362-b248f6d47bda could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:12:17.457853 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-d75f4374-def2-4d3e-96bb-096c0e076ab8 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/82b72e20-b9e2-45ce-9362-b248f6d47bda" status: 404 len: 111 microversion: 2.1 time: 0.056571 Oct 08 21:12:17.459725 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2392/4718] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:12:17 2022] GET /compute/v2.1/servers/82b72e20-b9e2-45ce-9362-b248f6d47bda => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:12:17.466348 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-2075c150-eb52-4778-9bdb-7d756e3a9404 tempest-SecurityGroupRulesTestJSON-2076505162 tempest-SecurityGroupRulesTestJSON-2076505162-project] Calling method '.version_select at 0x7f1a87d83d30>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:12:17.751371 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-35caf48d-1091-4a51-8ae4-97fe51987b11 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:12:17.760681 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-35caf48d-1091-4a51-8ae4-97fe51987b11 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 200 len: 1503 microversion: 2.1 time: 0.543923 Oct 08 21:12:17.764053 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2327/4719] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:12:17 2022] GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 1503 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:12:17.776143 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-bf07ec22-f320-4e9f-b877-abecba6d3f2e tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:12:17.777022 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-bf07ec22-f320-4e9f-b877-abecba6d3f2e tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: ba5cd412-0d20-4d2e-9f5e-de18f268008a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:12:17.787973 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bf07ec22-f320-4e9f-b877-abecba6d3f2e tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:17.793130 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bf07ec22-f320-4e9f-b877-abecba6d3f2e tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:17.793903 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bf07ec22-f320-4e9f-b877-abecba6d3f2e tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:17.797683 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bf07ec22-f320-4e9f-b877-abecba6d3f2e tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:17.798984 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bf07ec22-f320-4e9f-b877-abecba6d3f2e tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:17.799670 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bf07ec22-f320-4e9f-b877-abecba6d3f2e tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:17.833062 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-bf07ec22-f320-4e9f-b877-abecba6d3f2e tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] HTTP exception thrown: Instance ba5cd412-0d20-4d2e-9f5e-de18f268008a could not be found. Oct 08 21:12:17.838160 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-bf07ec22-f320-4e9f-b877-abecba6d3f2e tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Request method failure captured: Oct 08 21:12:17.838160 ncdv-master-1 devstack@n-api.service[140491]: request: DELETE /compute/v2.1/servers/ba5cd412-0d20-4d2e-9f5e-de18f268008a HTTP/1.1 Oct 08 21:12:17.838160 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:12:17.838160 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:12:17.838160 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:12:17.838160 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 21:12:17.838160 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:12:17.838160 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:12:17.838160 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:12:17.838160 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:12:17.838160 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeaY45CCffIT40Amc9wEG1L3srTtCd58z19KxF0fYIwNPulOEB6B0U5KbwvP4xZlDymYa3r7NupuSBl7IoxTUgzZohPJnXbaXnL_FvPvzvmymW0IMjU5l88HUbi73sOE2TxCcEBd6artojZxtGFF9N7yzN3dTHpujcvoWiRD4lXAI28 Oct 08 21:12:17.838160 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:12:17.838160 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:12:17.838160 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:12:17.838160 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:12:17.838160 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:12:17.838160 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:12:17.838160 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 765c62cac2ee4406b23a5baa85c52ff7 Oct 08 21:12:17.838160 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-DeleteServersTestJSON-1423663413 Oct 08 21:12:17.838160 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:12:17.838160 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:12:17.838160 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/765c62cac2ee4406b23a5baa85c52ff7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/765c62cac2ee4406b23a5baa85c52ff7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_765c62cac2ee4406b23a5baa85c52ff7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/765c62cac2ee4406b23a5baa85c52ff7"}]}] Oct 08 21:12:17.838160 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-DeleteServersTestJSON-1423663413 Oct 08 21:12:17.838160 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 765c62cac2ee4406b23a5baa85c52ff7 Oct 08 21:12:17.838160 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-DeleteServersTestJSON-1423663413 Oct 08 21:12:17.838160 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-DeleteServersTestJSON-1423663413-project Oct 08 21:12:17.838160 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:12:17.838160 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:12:17.838160 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: d78e9afd772c4de981cac8f5817ec356 Oct 08 21:12:17.838160 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-DeleteServersTestJSON-1423663413-project Oct 08 21:12:17.838160 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:12:17.838160 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance ba5cd412-0d20-4d2e-9f5e-de18f268008a could not be found. Oct 08 21:12:17.838160 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': 'ba5cd412-0d20-4d2e-9f5e-de18f268008a'} Oct 08 21:12:17.838160 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:12:17.838160 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:12:17.838160 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:12:17.838160 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:12:17.838160 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:12:17.838160 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:12:17.838160 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:12:17.838160 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:12:17.838160 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:12:17.838160 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:12:17.838160 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba5cd412-0d20-4d2e-9f5e-de18f268008a could not be found. Oct 08 21:12:17.838160 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:12:17.838160 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:12:17.838160 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:12:17.838160 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:12:17.838160 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:12:17.838160 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:12:17.838160 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:12:17.838160 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:12:17.838160 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:12:17.838160 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:12:17.838160 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 08 21:12:17.838160 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 08 21:12:17.838160 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 08 21:12:17.838160 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 08 21:12:17.838160 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:12:17.838160 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:12:17.838160 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:12:17.838160 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:12:17.842232 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba5cd412-0d20-4d2e-9f5e-de18f268008a could not be found. Oct 08 21:12:17.842232 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:12:17.842232 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:12:17.842232 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:12:17.842232 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:12:17.842232 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:12:17.842232 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:12:17.842232 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:12:17.842232 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:12:17.842232 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba5cd412-0d20-4d2e-9f5e-de18f268008a could not be found. Oct 08 21:12:17.842232 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:12:17.842904 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-bf07ec22-f320-4e9f-b877-abecba6d3f2e tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Returning 404 to user: Instance ba5cd412-0d20-4d2e-9f5e-de18f268008a could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:12:17.843652 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-bf07ec22-f320-4e9f-b877-abecba6d3f2e tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "DELETE /compute/v2.1/servers/ba5cd412-0d20-4d2e-9f5e-de18f268008a" status: 404 len: 111 microversion: 2.1 time: 0.076760 Oct 08 21:12:17.844465 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2328/4720] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:12:17 2022] DELETE /compute/v2.1/servers/ba5cd412-0d20-4d2e-9f5e-de18f268008a => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:12:17.849554 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-39c4525a-c2ac-4424-ba38-6bcc0c61f0d1 tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:12:17.850431 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-39c4525a-c2ac-4424-ba38-6bcc0c61f0d1 tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] [instance: 84f33d6e-ddf3-4b77-b83d-595c7f75de55] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:12:17.871306 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-39c4525a-c2ac-4424-ba38-6bcc0c61f0d1 tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:17.871805 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-39c4525a-c2ac-4424-ba38-6bcc0c61f0d1 tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:17.874850 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-39c4525a-c2ac-4424-ba38-6bcc0c61f0d1 tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:17.875819 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-39c4525a-c2ac-4424-ba38-6bcc0c61f0d1 tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:17.876573 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-39c4525a-c2ac-4424-ba38-6bcc0c61f0d1 tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:17.877085 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-39c4525a-c2ac-4424-ba38-6bcc0c61f0d1 tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:17.989583 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-2075c150-eb52-4778-9bdb-7d756e3a9404 tempest-SecurityGroupRulesTestJSON-2076505162 tempest-SecurityGroupRulesTestJSON-2076505162-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/2fc85a8d-b611-48eb-a84a-78297b2a820b" status: 202 len: 0 microversion: 2.1 time: 0.528224 Oct 08 21:12:17.994116 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2393/4721] 10.222.0.26 () {58 vars in 1272 bytes} [Sat Oct 8 21:12:17 2022] DELETE /compute/v2.1/os-security-groups/2fc85a8d-b611-48eb-a84a-78297b2a820b => generated 0 bytes in 533 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 21:12:17.999777 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-7221551a-c729-4d83-a012-852f398fc1cb tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:12:18.000423 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-7221551a-c729-4d83-a012-852f398fc1cb tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:12:18.011232 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=70 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:12:18.041328 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7221551a-c729-4d83-a012-852f398fc1cb tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:18.041847 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7221551a-c729-4d83-a012-852f398fc1cb tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:18.042503 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7221551a-c729-4d83-a012-852f398fc1cb tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:18.043454 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7221551a-c729-4d83-a012-852f398fc1cb tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:18.047878 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7221551a-c729-4d83-a012-852f398fc1cb tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:18.048589 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7221551a-c729-4d83-a012-852f398fc1cb tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:18.291311 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-39c4525a-c2ac-4424-ba38-6bcc0c61f0d1 tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77129c9ce5149748c6bd39c69307f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a53484c6ab4ea4be7acb5ac53acaa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:12:18.300987 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-39c4525a-c2ac-4424-ba38-6bcc0c61f0d1 tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] 10.222.0.26 "GET /compute/v2.1/servers/84f33d6e-ddf3-4b77-b83d-595c7f75de55" status: 200 len: 1317 microversion: 2.1 time: 0.455338 Oct 08 21:12:18.304504 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2329/4722] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:12:17 2022] GET /compute/v2.1/servers/84f33d6e-ddf3-4b77-b83d-595c7f75de55 => generated 1317 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:12:18.320218 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-f7eaae19-a7d1-4d82-af69-6e9b063ea267 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:12:18.321048 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-f7eaae19-a7d1-4d82-af69-6e9b063ea267 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: ba5cd412-0d20-4d2e-9f5e-de18f268008a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:12:18.339169 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f7eaae19-a7d1-4d82-af69-6e9b063ea267 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:18.342492 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f7eaae19-a7d1-4d82-af69-6e9b063ea267 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:18.343159 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f7eaae19-a7d1-4d82-af69-6e9b063ea267 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:18.344099 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f7eaae19-a7d1-4d82-af69-6e9b063ea267 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:18.345877 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f7eaae19-a7d1-4d82-af69-6e9b063ea267 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:18.347302 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f7eaae19-a7d1-4d82-af69-6e9b063ea267 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:18.358157 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-7221551a-c729-4d83-a012-852f398fc1cb tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:12:18.378237 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-f7eaae19-a7d1-4d82-af69-6e9b063ea267 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] HTTP exception thrown: Instance ba5cd412-0d20-4d2e-9f5e-de18f268008a could not be found. Oct 08 21:12:18.380954 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-f7eaae19-a7d1-4d82-af69-6e9b063ea267 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Request method failure captured: Oct 08 21:12:18.380954 ncdv-master-1 devstack@n-api.service[140491]: request: GET /compute/v2.1/servers/ba5cd412-0d20-4d2e-9f5e-de18f268008a HTTP/1.1 Oct 08 21:12:18.380954 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:12:18.380954 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:12:18.380954 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:12:18.380954 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 21:12:18.380954 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:12:18.380954 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:12:18.380954 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:12:18.380954 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:12:18.380954 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeaY45CCffIT40Amc9wEG1L3srTtCd58z19KxF0fYIwNPulOEB6B0U5KbwvP4xZlDymYa3r7NupuSBl7IoxTUgzZohPJnXbaXnL_FvPvzvmymW0IMjU5l88HUbi73sOE2TxCcEBd6artojZxtGFF9N7yzN3dTHpujcvoWiRD4lXAI28 Oct 08 21:12:18.380954 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:12:18.380954 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:12:18.380954 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:12:18.380954 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:12:18.380954 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:12:18.380954 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:12:18.380954 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 765c62cac2ee4406b23a5baa85c52ff7 Oct 08 21:12:18.380954 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-DeleteServersTestJSON-1423663413 Oct 08 21:12:18.380954 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:12:18.380954 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:12:18.380954 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/765c62cac2ee4406b23a5baa85c52ff7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/765c62cac2ee4406b23a5baa85c52ff7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_765c62cac2ee4406b23a5baa85c52ff7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/765c62cac2ee4406b23a5baa85c52ff7"}]}] Oct 08 21:12:18.380954 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-DeleteServersTestJSON-1423663413 Oct 08 21:12:18.380954 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 765c62cac2ee4406b23a5baa85c52ff7 Oct 08 21:12:18.380954 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-DeleteServersTestJSON-1423663413 Oct 08 21:12:18.380954 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-DeleteServersTestJSON-1423663413-project Oct 08 21:12:18.380954 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:12:18.380954 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:12:18.380954 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: d78e9afd772c4de981cac8f5817ec356 Oct 08 21:12:18.380954 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-DeleteServersTestJSON-1423663413-project Oct 08 21:12:18.380954 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:12:18.380954 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance ba5cd412-0d20-4d2e-9f5e-de18f268008a could not be found. Oct 08 21:12:18.380954 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': 'ba5cd412-0d20-4d2e-9f5e-de18f268008a'} Oct 08 21:12:18.380954 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:12:18.380954 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:12:18.380954 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:12:18.380954 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:12:18.380954 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:12:18.380954 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:12:18.380954 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:12:18.380954 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:12:18.380954 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:12:18.380954 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:12:18.380954 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba5cd412-0d20-4d2e-9f5e-de18f268008a could not be found. Oct 08 21:12:18.380954 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:12:18.380954 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:12:18.380954 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:12:18.380954 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:12:18.380954 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:12:18.380954 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:12:18.380954 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:12:18.380954 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:12:18.380954 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:12:18.380954 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:12:18.380954 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:12:18.380954 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:12:18.380954 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:12:18.380954 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:12:18.380954 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:12:18.380954 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:12:18.380954 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba5cd412-0d20-4d2e-9f5e-de18f268008a could not be found. Oct 08 21:12:18.380954 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:12:18.380954 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:12:18.380954 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:12:18.399310 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:12:18.399310 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:12:18.399310 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:12:18.399310 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:12:18.399310 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:12:18.399310 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba5cd412-0d20-4d2e-9f5e-de18f268008a could not be found. Oct 08 21:12:18.399310 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:12:18.399755 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-7221551a-c729-4d83-a012-852f398fc1cb tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 200 len: 1503 microversion: 2.1 time: 0.379445 Oct 08 21:12:18.399755 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2394/4723] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:12:17 2022] GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 1503 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:12:18.401022 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-4c7bdf88-19c7-4b4b-9825-2c53c098dbb1 tempest-SecurityGroupRulesTestJSON-2076505162 tempest-SecurityGroupRulesTestJSON-2076505162-project] Calling method '.version_select at 0x7f1a8caf4940>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:12:18.401231 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-f7eaae19-a7d1-4d82-af69-6e9b063ea267 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Returning 404 to user: Instance ba5cd412-0d20-4d2e-9f5e-de18f268008a could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:12:18.405352 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-f7eaae19-a7d1-4d82-af69-6e9b063ea267 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/ba5cd412-0d20-4d2e-9f5e-de18f268008a" status: 404 len: 111 microversion: 2.1 time: 0.099046 Oct 08 21:12:18.411368 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2330/4724] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:12:18 2022] GET /compute/v2.1/servers/ba5cd412-0d20-4d2e-9f5e-de18f268008a => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:12:18.417363 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-5d17e4fa-bb5f-4231-94c8-0e0ceb031002 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:12:18.421321 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-5d17e4fa-bb5f-4231-94c8-0e0ceb031002 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Request method failure captured: Oct 08 21:12:18.421321 ncdv-master-1 devstack@n-api.service[140491]: request: PUT /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 HTTP/1.1 Oct 08 21:12:18.421321 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:12:18.421321 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:12:18.421321 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:12:18.421321 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 24 Oct 08 21:12:18.421321 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:12:18.421321 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:12:18.421321 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:12:18.421321 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:12:18.421321 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQebW09Z3m936-d3SrnQA9UQ3KXQvUYeQwL43ufWdoxmQhUwYBWv-JT053t_VYPo9wAVRoCqYQy8Hhh8zc2n570KpS0qNVLik822FjYabkSIZMA_ubWypXzSwo3J04zV1MoSSz79D-b8-ZvwYCEIbwpbfyn5opgOjnO6EXvq1UNPaSyQ Oct 08 21:12:18.421321 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:12:18.421321 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:12:18.421321 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:12:18.421321 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:12:18.421321 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:12:18.421321 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:12:18.421321 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 0ae02675057e4f27bc1980348afc8ca1 Oct 08 21:12:18.421321 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-ServersNegativeTestJSON-1441071354 Oct 08 21:12:18.421321 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:12:18.421321 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:12:18.421321 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0ae02675057e4f27bc1980348afc8ca1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0ae02675057e4f27bc1980348afc8ca1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0ae02675057e4f27bc1980348afc8ca1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0ae02675057e4f27bc1980348afc8ca1"}]}] Oct 08 21:12:18.421321 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-ServersNegativeTestJSON-1441071354 Oct 08 21:12:18.421321 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 0ae02675057e4f27bc1980348afc8ca1 Oct 08 21:12:18.421321 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1441071354 Oct 08 21:12:18.421321 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-ServersNegativeTestJSON-1441071354-project Oct 08 21:12:18.421321 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:12:18.421321 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:12:18.421321 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 6a78d352c143483c8e4702d789d4c516 Oct 08 21:12:18.421321 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-ServersNegativeTestJSON-1441071354-project Oct 08 21:12:18.421321 ncdv-master-1 devstack@n-api.service[140491]: Oct 08 21:12:18.421321 ncdv-master-1 devstack@n-api.service[140491]: {"server": {"name": ""}} Oct 08 21:12:18.421321 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:12:18.421321 ncdv-master-1 devstack@n-api.service[140491]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 08 21:12:18.421321 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': 'e2548207-aa57-4e4c-876b-2027b59283d2', 'body': {'server': {'name': ''}}} Oct 08 21:12:18.421321 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:12:18.421321 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:12:18.421321 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 08 21:12:18.421321 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 08 21:12:18.421321 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 08 21:12:18.421321 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise error Oct 08 21:12:18.421321 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 08 21:12:18.421321 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:12:18.421321 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Oct 08 21:12:18.421321 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 08 21:12:18.421321 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:12:18.421321 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 08 21:12:18.421321 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi '' Oct 08 21:12:18.421321 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:12:18.421321 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:12:18.421321 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:12:18.421321 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:12:18.421321 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:12:18.421321 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:12:18.421321 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:12:18.421321 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:12:18.421321 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:12:18.421321 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:12:18.421321 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 21:12:18.421321 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 21:12:18.421321 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 08 21:12:18.421321 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 08 21:12:18.421321 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 08 21:12:18.421321 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 08 21:12:18.421321 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 08 21:12:18.421321 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 08 21:12:18.425497 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 08 21:12:18.425497 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:12:18.425497 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:12:18.425497 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:12:18.425497 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:12:18.425497 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:12:18.425497 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:12:18.425497 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 08 21:12:18.425497 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 08 21:12:18.425497 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 08 21:12:18.425497 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:12:18.427779 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-5d17e4fa-bb5f-4231-94c8-0e0ceb031002 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:12:18.429147 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-5d17e4fa-bb5f-4231-94c8-0e0ceb031002 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "PUT /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 400 len: 108 microversion: 2.1 time: 0.016053 Oct 08 21:12:18.431782 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2331/4725] 10.222.0.26 () {60 vars in 1256 bytes} [Sat Oct 8 21:12:18 2022] PUT /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 108 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 08 21:12:18.439070 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-3393c39f-a002-4da0-8430-efaf03009fc0 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:12:18.439828 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-3393c39f-a002-4da0-8430-efaf03009fc0 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: 3c531611-396a-432b-b42f-dbf60a120a7a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:12:18.448566 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3393c39f-a002-4da0-8430-efaf03009fc0 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:18.449591 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3393c39f-a002-4da0-8430-efaf03009fc0 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:18.450324 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3393c39f-a002-4da0-8430-efaf03009fc0 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:18.451382 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3393c39f-a002-4da0-8430-efaf03009fc0 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:18.452078 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3393c39f-a002-4da0-8430-efaf03009fc0 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:18.452839 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3393c39f-a002-4da0-8430-efaf03009fc0 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:18.471706 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-3393c39f-a002-4da0-8430-efaf03009fc0 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] HTTP exception thrown: Instance 3c531611-396a-432b-b42f-dbf60a120a7a could not be found. Oct 08 21:12:18.473999 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-3393c39f-a002-4da0-8430-efaf03009fc0 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Request method failure captured: Oct 08 21:12:18.473999 ncdv-master-1 devstack@n-api.service[140491]: request: DELETE /compute/v2.1/servers/3c531611-396a-432b-b42f-dbf60a120a7a HTTP/1.1 Oct 08 21:12:18.473999 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:12:18.473999 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:12:18.473999 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:12:18.473999 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 21:12:18.473999 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:12:18.473999 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:12:18.473999 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:12:18.473999 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:12:18.473999 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeaY45CCffIT40Amc9wEG1L3srTtCd58z19KxF0fYIwNPulOEB6B0U5KbwvP4xZlDymYa3r7NupuSBl7IoxTUgzZohPJnXbaXnL_FvPvzvmymW0IMjU5l88HUbi73sOE2TxCcEBd6artojZxtGFF9N7yzN3dTHpujcvoWiRD4lXAI28 Oct 08 21:12:18.473999 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:12:18.473999 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:12:18.473999 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:12:18.473999 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:12:18.473999 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:12:18.473999 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:12:18.473999 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 765c62cac2ee4406b23a5baa85c52ff7 Oct 08 21:12:18.473999 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-DeleteServersTestJSON-1423663413 Oct 08 21:12:18.473999 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:12:18.473999 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:12:18.473999 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/765c62cac2ee4406b23a5baa85c52ff7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/765c62cac2ee4406b23a5baa85c52ff7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_765c62cac2ee4406b23a5baa85c52ff7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/765c62cac2ee4406b23a5baa85c52ff7"}]}] Oct 08 21:12:18.473999 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-DeleteServersTestJSON-1423663413 Oct 08 21:12:18.473999 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 765c62cac2ee4406b23a5baa85c52ff7 Oct 08 21:12:18.473999 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-DeleteServersTestJSON-1423663413 Oct 08 21:12:18.473999 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-DeleteServersTestJSON-1423663413-project Oct 08 21:12:18.473999 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:12:18.473999 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:12:18.473999 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: d78e9afd772c4de981cac8f5817ec356 Oct 08 21:12:18.473999 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-DeleteServersTestJSON-1423663413-project Oct 08 21:12:18.473999 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:12:18.473999 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance 3c531611-396a-432b-b42f-dbf60a120a7a could not be found. Oct 08 21:12:18.473999 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': '3c531611-396a-432b-b42f-dbf60a120a7a'} Oct 08 21:12:18.473999 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:12:18.473999 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:12:18.473999 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:12:18.473999 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:12:18.473999 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:12:18.473999 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:12:18.473999 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:12:18.473999 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:12:18.473999 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:12:18.473999 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:12:18.473999 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c531611-396a-432b-b42f-dbf60a120a7a could not be found. Oct 08 21:12:18.473999 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:12:18.473999 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:12:18.473999 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:12:18.473999 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:12:18.473999 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:12:18.473999 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:12:18.473999 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:12:18.473999 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:12:18.473999 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:12:18.473999 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:12:18.473999 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 08 21:12:18.473999 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 08 21:12:18.473999 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 08 21:12:18.473999 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 08 21:12:18.473999 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:12:18.473999 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:12:18.473999 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:12:18.473999 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:12:18.478993 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c531611-396a-432b-b42f-dbf60a120a7a could not be found. Oct 08 21:12:18.478993 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:12:18.478993 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:12:18.478993 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:12:18.478993 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:12:18.478993 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:12:18.478993 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:12:18.478993 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:12:18.478993 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:12:18.478993 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c531611-396a-432b-b42f-dbf60a120a7a could not be found. Oct 08 21:12:18.478993 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:12:18.482504 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-3393c39f-a002-4da0-8430-efaf03009fc0 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Returning 404 to user: Instance 3c531611-396a-432b-b42f-dbf60a120a7a could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:12:18.483648 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-3393c39f-a002-4da0-8430-efaf03009fc0 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "DELETE /compute/v2.1/servers/3c531611-396a-432b-b42f-dbf60a120a7a" status: 404 len: 111 microversion: 2.1 time: 0.048938 Oct 08 21:12:18.484448 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2332/4726] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:12:18 2022] DELETE /compute/v2.1/servers/3c531611-396a-432b-b42f-dbf60a120a7a => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:12:18.492585 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-2d3d8af7-aed2-49bc-a95b-fa5c5bbde9d3 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:12:18.493758 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-2d3d8af7-aed2-49bc-a95b-fa5c5bbde9d3 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:12:18.502900 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2d3d8af7-aed2-49bc-a95b-fa5c5bbde9d3 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:18.503727 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2d3d8af7-aed2-49bc-a95b-fa5c5bbde9d3 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:18.504561 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2d3d8af7-aed2-49bc-a95b-fa5c5bbde9d3 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:18.506055 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2d3d8af7-aed2-49bc-a95b-fa5c5bbde9d3 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:18.506689 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2d3d8af7-aed2-49bc-a95b-fa5c5bbde9d3 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:18.507465 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2d3d8af7-aed2-49bc-a95b-fa5c5bbde9d3 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:18.823413 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-2d3d8af7-aed2-49bc-a95b-fa5c5bbde9d3 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:12:18.835466 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-2d3d8af7-aed2-49bc-a95b-fa5c5bbde9d3 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 200 len: 1503 microversion: 2.1 time: 0.349546 Oct 08 21:12:18.836657 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2333/4727] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:12:18 2022] GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 1503 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:12:18.847612 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-80d6a0ac-3853-4bc0-ae1e-e9c56b23220f tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:12:18.848409 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-80d6a0ac-3853-4bc0-ae1e-e9c56b23220f tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: 3c531611-396a-432b-b42f-dbf60a120a7a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:12:18.872763 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-80d6a0ac-3853-4bc0-ae1e-e9c56b23220f tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:18.876869 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-80d6a0ac-3853-4bc0-ae1e-e9c56b23220f tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:18.886587 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-80d6a0ac-3853-4bc0-ae1e-e9c56b23220f tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:18.892073 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-4c7bdf88-19c7-4b4b-9825-2c53c098dbb1 tempest-SecurityGroupRulesTestJSON-2076505162 tempest-SecurityGroupRulesTestJSON-2076505162-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/0bd6f060-cbae-48ac-80ae-48a22350cb7b" status: 202 len: 0 microversion: 2.1 time: 0.503219 Oct 08 21:12:18.892418 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-80d6a0ac-3853-4bc0-ae1e-e9c56b23220f tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:18.893180 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-80d6a0ac-3853-4bc0-ae1e-e9c56b23220f tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:18.894090 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-80d6a0ac-3853-4bc0-ae1e-e9c56b23220f tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:18.896295 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2395/4728] 10.222.0.26 () {58 vars in 1272 bytes} [Sat Oct 8 21:12:18 2022] DELETE /compute/v2.1/os-security-groups/0bd6f060-cbae-48ac-80ae-48a22350cb7b => generated 0 bytes in 508 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 21:12:18.901732 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-26d49cbf-95b1-4a8b-bcee-d8e40e504e90 tempest-SecurityGroupRulesTestJSON-2076505162 tempest-SecurityGroupRulesTestJSON-2076505162-project] Calling method '.version_select at 0x7f1a87cefee0>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:12:18.922648 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-80d6a0ac-3853-4bc0-ae1e-e9c56b23220f tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] HTTP exception thrown: Instance 3c531611-396a-432b-b42f-dbf60a120a7a could not be found. Oct 08 21:12:18.924222 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-80d6a0ac-3853-4bc0-ae1e-e9c56b23220f tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Request method failure captured: Oct 08 21:12:18.924222 ncdv-master-1 devstack@n-api.service[140491]: request: GET /compute/v2.1/servers/3c531611-396a-432b-b42f-dbf60a120a7a HTTP/1.1 Oct 08 21:12:18.924222 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:12:18.924222 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:12:18.924222 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:12:18.924222 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 21:12:18.924222 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:12:18.924222 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:12:18.924222 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:12:18.924222 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:12:18.924222 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeaY45CCffIT40Amc9wEG1L3srTtCd58z19KxF0fYIwNPulOEB6B0U5KbwvP4xZlDymYa3r7NupuSBl7IoxTUgzZohPJnXbaXnL_FvPvzvmymW0IMjU5l88HUbi73sOE2TxCcEBd6artojZxtGFF9N7yzN3dTHpujcvoWiRD4lXAI28 Oct 08 21:12:18.924222 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:12:18.924222 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:12:18.924222 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:12:18.924222 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:12:18.924222 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:12:18.924222 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:12:18.924222 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 765c62cac2ee4406b23a5baa85c52ff7 Oct 08 21:12:18.924222 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-DeleteServersTestJSON-1423663413 Oct 08 21:12:18.924222 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:12:18.924222 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:12:18.924222 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/765c62cac2ee4406b23a5baa85c52ff7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/765c62cac2ee4406b23a5baa85c52ff7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_765c62cac2ee4406b23a5baa85c52ff7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/765c62cac2ee4406b23a5baa85c52ff7"}]}] Oct 08 21:12:18.924222 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-DeleteServersTestJSON-1423663413 Oct 08 21:12:18.924222 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 765c62cac2ee4406b23a5baa85c52ff7 Oct 08 21:12:18.924222 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-DeleteServersTestJSON-1423663413 Oct 08 21:12:18.924222 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-DeleteServersTestJSON-1423663413-project Oct 08 21:12:18.924222 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:12:18.924222 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:12:18.924222 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: d78e9afd772c4de981cac8f5817ec356 Oct 08 21:12:18.924222 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-DeleteServersTestJSON-1423663413-project Oct 08 21:12:18.924222 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:12:18.924222 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance 3c531611-396a-432b-b42f-dbf60a120a7a could not be found. Oct 08 21:12:18.924222 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': '3c531611-396a-432b-b42f-dbf60a120a7a'} Oct 08 21:12:18.924222 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:12:18.924222 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:12:18.924222 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:12:18.924222 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:12:18.924222 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:12:18.924222 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:12:18.924222 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:12:18.924222 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:12:18.924222 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:12:18.924222 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:12:18.924222 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c531611-396a-432b-b42f-dbf60a120a7a could not be found. Oct 08 21:12:18.924222 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:12:18.924222 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:12:18.924222 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:12:18.924222 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:12:18.924222 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:12:18.924222 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:12:18.924222 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:12:18.924222 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:12:18.924222 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:12:18.924222 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:12:18.924222 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:12:18.924222 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:12:18.924222 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:12:18.924222 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:12:18.924222 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:12:18.924222 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:12:18.924222 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c531611-396a-432b-b42f-dbf60a120a7a could not be found. Oct 08 21:12:18.924222 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:12:18.924222 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:12:18.924222 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:12:18.928827 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:12:18.928827 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:12:18.928827 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:12:18.928827 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:12:18.928827 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:12:18.928827 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c531611-396a-432b-b42f-dbf60a120a7a could not be found. Oct 08 21:12:18.928827 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:12:18.928827 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-80d6a0ac-3853-4bc0-ae1e-e9c56b23220f tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Returning 404 to user: Instance 3c531611-396a-432b-b42f-dbf60a120a7a could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:12:18.933152 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-80d6a0ac-3853-4bc0-ae1e-e9c56b23220f tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/3c531611-396a-432b-b42f-dbf60a120a7a" status: 404 len: 111 microversion: 2.1 time: 0.095152 Oct 08 21:12:18.936240 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2334/4729] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:12:18 2022] GET /compute/v2.1/servers/3c531611-396a-432b-b42f-dbf60a120a7a => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:12:18.950105 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-b74f27e1-eb65-4fee-b9eb-71e6cf557e46 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:12:18.951668 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-b74f27e1-eb65-4fee-b9eb-71e6cf557e46 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: dbe20090-9878-4b39-8daf-c784b9721869] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:12:18.962126 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b74f27e1-eb65-4fee-b9eb-71e6cf557e46 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:18.962898 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b74f27e1-eb65-4fee-b9eb-71e6cf557e46 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:18.964249 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b74f27e1-eb65-4fee-b9eb-71e6cf557e46 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:18.965093 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b74f27e1-eb65-4fee-b9eb-71e6cf557e46 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:18.965737 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b74f27e1-eb65-4fee-b9eb-71e6cf557e46 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:18.966556 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b74f27e1-eb65-4fee-b9eb-71e6cf557e46 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:19.019997 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-b74f27e1-eb65-4fee-b9eb-71e6cf557e46 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] HTTP exception thrown: Instance dbe20090-9878-4b39-8daf-c784b9721869 could not be found. Oct 08 21:12:19.033254 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-b74f27e1-eb65-4fee-b9eb-71e6cf557e46 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Request method failure captured: Oct 08 21:12:19.033254 ncdv-master-1 devstack@n-api.service[140491]: request: DELETE /compute/v2.1/servers/dbe20090-9878-4b39-8daf-c784b9721869 HTTP/1.1 Oct 08 21:12:19.033254 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:12:19.033254 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:12:19.033254 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:12:19.033254 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 21:12:19.033254 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:12:19.033254 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:12:19.033254 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:12:19.033254 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:12:19.033254 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeaY45CCffIT40Amc9wEG1L3srTtCd58z19KxF0fYIwNPulOEB6B0U5KbwvP4xZlDymYa3r7NupuSBl7IoxTUgzZohPJnXbaXnL_FvPvzvmymW0IMjU5l88HUbi73sOE2TxCcEBd6artojZxtGFF9N7yzN3dTHpujcvoWiRD4lXAI28 Oct 08 21:12:19.033254 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:12:19.033254 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:12:19.033254 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:12:19.033254 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:12:19.033254 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:12:19.033254 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:12:19.033254 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 765c62cac2ee4406b23a5baa85c52ff7 Oct 08 21:12:19.033254 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-DeleteServersTestJSON-1423663413 Oct 08 21:12:19.033254 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:12:19.033254 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:12:19.033254 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/765c62cac2ee4406b23a5baa85c52ff7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/765c62cac2ee4406b23a5baa85c52ff7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_765c62cac2ee4406b23a5baa85c52ff7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/765c62cac2ee4406b23a5baa85c52ff7"}]}] Oct 08 21:12:19.033254 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-DeleteServersTestJSON-1423663413 Oct 08 21:12:19.033254 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 765c62cac2ee4406b23a5baa85c52ff7 Oct 08 21:12:19.033254 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-DeleteServersTestJSON-1423663413 Oct 08 21:12:19.033254 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-DeleteServersTestJSON-1423663413-project Oct 08 21:12:19.033254 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:12:19.033254 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:12:19.033254 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: d78e9afd772c4de981cac8f5817ec356 Oct 08 21:12:19.033254 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-DeleteServersTestJSON-1423663413-project Oct 08 21:12:19.033254 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:12:19.033254 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance dbe20090-9878-4b39-8daf-c784b9721869 could not be found. Oct 08 21:12:19.033254 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': 'dbe20090-9878-4b39-8daf-c784b9721869'} Oct 08 21:12:19.033254 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:12:19.033254 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:12:19.033254 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:12:19.033254 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:12:19.033254 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:12:19.033254 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:12:19.033254 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:12:19.033254 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:12:19.033254 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:12:19.033254 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:12:19.033254 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dbe20090-9878-4b39-8daf-c784b9721869 could not be found. Oct 08 21:12:19.033254 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:12:19.033254 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:12:19.033254 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:12:19.033254 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:12:19.033254 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:12:19.033254 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:12:19.033254 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:12:19.033254 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:12:19.033254 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:12:19.033254 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:12:19.033254 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 08 21:12:19.033254 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 08 21:12:19.033254 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 08 21:12:19.033254 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 08 21:12:19.033254 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:12:19.033254 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:12:19.033254 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:12:19.033254 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:12:19.038506 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dbe20090-9878-4b39-8daf-c784b9721869 could not be found. Oct 08 21:12:19.038506 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:12:19.038506 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:12:19.038506 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:12:19.038506 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:12:19.038506 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:12:19.038506 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:12:19.038506 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:12:19.038506 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:12:19.038506 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dbe20090-9878-4b39-8daf-c784b9721869 could not be found. Oct 08 21:12:19.038506 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:12:19.039668 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-b74f27e1-eb65-4fee-b9eb-71e6cf557e46 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Returning 404 to user: Instance dbe20090-9878-4b39-8daf-c784b9721869 could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:12:19.042050 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-b74f27e1-eb65-4fee-b9eb-71e6cf557e46 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "DELETE /compute/v2.1/servers/dbe20090-9878-4b39-8daf-c784b9721869" status: 404 len: 111 microversion: 2.1 time: 0.101751 Oct 08 21:12:19.044709 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2335/4730] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:12:18 2022] DELETE /compute/v2.1/servers/dbe20090-9878-4b39-8daf-c784b9721869 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:12:19.054324 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-1058cac1-c86d-4c40-b39c-56c8db09e94d tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:12:19.062051 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-1058cac1-c86d-4c40-b39c-56c8db09e94d tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: dbe20090-9878-4b39-8daf-c784b9721869] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:12:19.076022 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1058cac1-c86d-4c40-b39c-56c8db09e94d tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:19.076720 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1058cac1-c86d-4c40-b39c-56c8db09e94d tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:19.078069 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1058cac1-c86d-4c40-b39c-56c8db09e94d tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:19.078831 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1058cac1-c86d-4c40-b39c-56c8db09e94d tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:19.079388 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1058cac1-c86d-4c40-b39c-56c8db09e94d tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:19.093507 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1058cac1-c86d-4c40-b39c-56c8db09e94d tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:19.109958 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-1058cac1-c86d-4c40-b39c-56c8db09e94d tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] HTTP exception thrown: Instance dbe20090-9878-4b39-8daf-c784b9721869 could not be found. Oct 08 21:12:19.112670 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-1058cac1-c86d-4c40-b39c-56c8db09e94d tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Request method failure captured: Oct 08 21:12:19.112670 ncdv-master-1 devstack@n-api.service[140491]: request: GET /compute/v2.1/servers/dbe20090-9878-4b39-8daf-c784b9721869 HTTP/1.1 Oct 08 21:12:19.112670 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:12:19.112670 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:12:19.112670 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:12:19.112670 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 21:12:19.112670 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:12:19.112670 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:12:19.112670 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:12:19.112670 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:12:19.112670 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeaY45CCffIT40Amc9wEG1L3srTtCd58z19KxF0fYIwNPulOEB6B0U5KbwvP4xZlDymYa3r7NupuSBl7IoxTUgzZohPJnXbaXnL_FvPvzvmymW0IMjU5l88HUbi73sOE2TxCcEBd6artojZxtGFF9N7yzN3dTHpujcvoWiRD4lXAI28 Oct 08 21:12:19.112670 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:12:19.112670 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:12:19.112670 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:12:19.112670 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:12:19.112670 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:12:19.112670 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:12:19.112670 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 765c62cac2ee4406b23a5baa85c52ff7 Oct 08 21:12:19.112670 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-DeleteServersTestJSON-1423663413 Oct 08 21:12:19.112670 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:12:19.112670 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:12:19.112670 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/765c62cac2ee4406b23a5baa85c52ff7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/765c62cac2ee4406b23a5baa85c52ff7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_765c62cac2ee4406b23a5baa85c52ff7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/765c62cac2ee4406b23a5baa85c52ff7"}]}] Oct 08 21:12:19.112670 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-DeleteServersTestJSON-1423663413 Oct 08 21:12:19.112670 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 765c62cac2ee4406b23a5baa85c52ff7 Oct 08 21:12:19.112670 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-DeleteServersTestJSON-1423663413 Oct 08 21:12:19.112670 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-DeleteServersTestJSON-1423663413-project Oct 08 21:12:19.112670 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:12:19.112670 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:12:19.112670 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: d78e9afd772c4de981cac8f5817ec356 Oct 08 21:12:19.112670 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-DeleteServersTestJSON-1423663413-project Oct 08 21:12:19.112670 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:12:19.112670 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance dbe20090-9878-4b39-8daf-c784b9721869 could not be found. Oct 08 21:12:19.112670 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': 'dbe20090-9878-4b39-8daf-c784b9721869'} Oct 08 21:12:19.112670 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:12:19.112670 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:12:19.112670 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:12:19.112670 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:12:19.112670 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:12:19.112670 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:12:19.112670 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:12:19.112670 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:12:19.112670 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:12:19.112670 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:12:19.112670 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dbe20090-9878-4b39-8daf-c784b9721869 could not be found. Oct 08 21:12:19.112670 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:12:19.112670 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:12:19.112670 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:12:19.112670 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:12:19.112670 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:12:19.112670 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:12:19.112670 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:12:19.112670 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:12:19.112670 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:12:19.112670 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:12:19.112670 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:12:19.112670 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:12:19.112670 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:12:19.112670 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:12:19.112670 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:12:19.112670 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:12:19.112670 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dbe20090-9878-4b39-8daf-c784b9721869 could not be found. Oct 08 21:12:19.112670 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:12:19.112670 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:12:19.112670 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:12:19.117378 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:12:19.117378 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:12:19.117378 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:12:19.117378 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:12:19.117378 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:12:19.117378 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dbe20090-9878-4b39-8daf-c784b9721869 could not be found. Oct 08 21:12:19.117378 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:12:19.117378 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-1058cac1-c86d-4c40-b39c-56c8db09e94d tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Returning 404 to user: Instance dbe20090-9878-4b39-8daf-c784b9721869 could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:12:19.117378 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-1058cac1-c86d-4c40-b39c-56c8db09e94d tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/dbe20090-9878-4b39-8daf-c784b9721869" status: 404 len: 111 microversion: 2.1 time: 0.067049 Oct 08 21:12:19.117378 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2336/4731] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:12:19 2022] GET /compute/v2.1/servers/dbe20090-9878-4b39-8daf-c784b9721869 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:12:19.329085 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-f3e9158a-f990-483f-b557-988bc37da72a tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:12:19.330653 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-f3e9158a-f990-483f-b557-988bc37da72a tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] [instance: 84f33d6e-ddf3-4b77-b83d-595c7f75de55] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:12:19.345340 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f3e9158a-f990-483f-b557-988bc37da72a tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:19.346305 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f3e9158a-f990-483f-b557-988bc37da72a tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:19.351843 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f3e9158a-f990-483f-b557-988bc37da72a tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:19.352655 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f3e9158a-f990-483f-b557-988bc37da72a tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:19.353178 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f3e9158a-f990-483f-b557-988bc37da72a tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:19.361255 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f3e9158a-f990-483f-b557-988bc37da72a tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:19.750398 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-26d49cbf-95b1-4a8b-bcee-d8e40e504e90 tempest-SecurityGroupRulesTestJSON-2076505162 tempest-SecurityGroupRulesTestJSON-2076505162-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/6ec0201d-53ed-4a9e-8e2d-3acdf81c63cb" status: 202 len: 0 microversion: 2.1 time: 0.852897 Oct 08 21:12:19.750976 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2396/4732] 10.222.0.26 () {58 vars in 1272 bytes} [Sat Oct 8 21:12:18 2022] DELETE /compute/v2.1/os-security-groups/6ec0201d-53ed-4a9e-8e2d-3acdf81c63cb => generated 0 bytes in 854 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 21:12:19.759923 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-d7c8516a-a122-4d24-92c9-415f35337677 tempest-SecurityGroupRulesTestJSON-2076505162 tempest-SecurityGroupRulesTestJSON-2076505162-project] Calling method '.version_select at 0x7f1a87cb6160>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:12:20.276608 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-f3e9158a-f990-483f-b557-988bc37da72a tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77129c9ce5149748c6bd39c69307f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a53484c6ab4ea4be7acb5ac53acaa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:12:20.294129 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-f3e9158a-f990-483f-b557-988bc37da72a tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] 10.222.0.26 "GET /compute/v2.1/servers/84f33d6e-ddf3-4b77-b83d-595c7f75de55" status: 200 len: 1317 microversion: 2.1 time: 0.971133 Oct 08 21:12:20.308428 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2337/4733] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:12:19 2022] GET /compute/v2.1/servers/84f33d6e-ddf3-4b77-b83d-595c7f75de55 => generated 1317 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:12:20.329809 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-d7c8516a-a122-4d24-92c9-415f35337677 tempest-SecurityGroupRulesTestJSON-2076505162 tempest-SecurityGroupRulesTestJSON-2076505162-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/92c44042-4bd2-4acc-ae46-886a8efeb633" status: 202 len: 0 microversion: 2.1 time: 0.574126 Oct 08 21:12:20.331505 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2397/4734] 10.222.0.26 () {58 vars in 1272 bytes} [Sat Oct 8 21:12:19 2022] DELETE /compute/v2.1/os-security-groups/92c44042-4bd2-4acc-ae46-886a8efeb633 => generated 0 bytes in 577 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 08 21:12:20.347420 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-2cd7a984-ab3c-4bd9-bfcc-b75f1db4be59 tempest-SecurityGroupRulesTestJSON-2076505162 tempest-SecurityGroupRulesTestJSON-2076505162-project] Calling method '.version_select at 0x7f1a876fef70>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:12:20.425510 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-b495e4ea-9dd0-4e8a-8c7e-d1a8a5e98399 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:12:20.426286 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-b495e4ea-9dd0-4e8a-8c7e-d1a8a5e98399 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: 911394e0-0af3-4433-acfb-a4652d4e2e84] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:12:20.446295 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b495e4ea-9dd0-4e8a-8c7e-d1a8a5e98399 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:20.448749 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b495e4ea-9dd0-4e8a-8c7e-d1a8a5e98399 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:20.451534 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b495e4ea-9dd0-4e8a-8c7e-d1a8a5e98399 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:20.462689 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b495e4ea-9dd0-4e8a-8c7e-d1a8a5e98399 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:20.466267 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b495e4ea-9dd0-4e8a-8c7e-d1a8a5e98399 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:20.467907 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b495e4ea-9dd0-4e8a-8c7e-d1a8a5e98399 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:20.520030 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-b495e4ea-9dd0-4e8a-8c7e-d1a8a5e98399 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] HTTP exception thrown: Instance 911394e0-0af3-4433-acfb-a4652d4e2e84 could not be found. Oct 08 21:12:20.523909 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-b495e4ea-9dd0-4e8a-8c7e-d1a8a5e98399 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Request method failure captured: Oct 08 21:12:20.523909 ncdv-master-1 devstack@n-api.service[140492]: request: DELETE /compute/v2.1/servers/911394e0-0af3-4433-acfb-a4652d4e2e84 HTTP/1.1 Oct 08 21:12:20.523909 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:12:20.523909 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:12:20.523909 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:12:20.523909 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 21:12:20.523909 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:12:20.523909 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:12:20.523909 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:12:20.523909 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:12:20.523909 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeaY45CCffIT40Amc9wEG1L3srTtCd58z19KxF0fYIwNPulOEB6B0U5KbwvP4xZlDymYa3r7NupuSBl7IoxTUgzZohPJnXbaXnL_FvPvzvmymW0IMjU5l88HUbi73sOE2TxCcEBd6artojZxtGFF9N7yzN3dTHpujcvoWiRD4lXAI28 Oct 08 21:12:20.523909 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:12:20.523909 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:12:20.523909 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:12:20.523909 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:12:20.523909 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:12:20.523909 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:12:20.523909 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 765c62cac2ee4406b23a5baa85c52ff7 Oct 08 21:12:20.523909 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-DeleteServersTestJSON-1423663413 Oct 08 21:12:20.523909 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:12:20.523909 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:12:20.523909 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/765c62cac2ee4406b23a5baa85c52ff7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/765c62cac2ee4406b23a5baa85c52ff7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_765c62cac2ee4406b23a5baa85c52ff7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/765c62cac2ee4406b23a5baa85c52ff7"}]}] Oct 08 21:12:20.523909 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-DeleteServersTestJSON-1423663413 Oct 08 21:12:20.523909 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 765c62cac2ee4406b23a5baa85c52ff7 Oct 08 21:12:20.523909 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-DeleteServersTestJSON-1423663413 Oct 08 21:12:20.523909 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-DeleteServersTestJSON-1423663413-project Oct 08 21:12:20.523909 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:12:20.523909 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:12:20.523909 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: d78e9afd772c4de981cac8f5817ec356 Oct 08 21:12:20.523909 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-DeleteServersTestJSON-1423663413-project Oct 08 21:12:20.523909 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 21:12:20.523909 ncdv-master-1 devstack@n-api.service[140492]: exception: Instance 911394e0-0af3-4433-acfb-a4652d4e2e84 could not be found. Oct 08 21:12:20.523909 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': '911394e0-0af3-4433-acfb-a4652d4e2e84'} Oct 08 21:12:20.523909 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:12:20.523909 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:12:20.523909 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:12:20.523909 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:12:20.523909 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:12:20.523909 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:12:20.523909 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:12:20.523909 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:12:20.523909 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:12:20.523909 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:12:20.523909 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 911394e0-0af3-4433-acfb-a4652d4e2e84 could not be found. Oct 08 21:12:20.523909 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:12:20.523909 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:12:20.523909 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:12:20.523909 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:12:20.523909 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:12:20.523909 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:12:20.523909 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:12:20.523909 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:12:20.523909 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:12:20.523909 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:12:20.523909 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 08 21:12:20.523909 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 08 21:12:20.523909 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 08 21:12:20.523909 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 08 21:12:20.523909 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:12:20.523909 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:12:20.523909 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:12:20.523909 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:12:20.527795 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 911394e0-0af3-4433-acfb-a4652d4e2e84 could not be found. Oct 08 21:12:20.527795 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:12:20.527795 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:12:20.527795 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:12:20.527795 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:12:20.527795 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:12:20.527795 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:12:20.527795 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:12:20.527795 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:12:20.527795 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 911394e0-0af3-4433-acfb-a4652d4e2e84 could not be found. Oct 08 21:12:20.527795 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:12:20.527795 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-b495e4ea-9dd0-4e8a-8c7e-d1a8a5e98399 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Returning 404 to user: Instance 911394e0-0af3-4433-acfb-a4652d4e2e84 could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:12:20.529734 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-b495e4ea-9dd0-4e8a-8c7e-d1a8a5e98399 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "DELETE /compute/v2.1/servers/911394e0-0af3-4433-acfb-a4652d4e2e84" status: 404 len: 111 microversion: 2.1 time: 0.106071 Oct 08 21:12:20.530366 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2398/4735] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:12:20 2022] DELETE /compute/v2.1/servers/911394e0-0af3-4433-acfb-a4652d4e2e84 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:12:20.543228 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-021f2b3c-e379-4cfb-830e-0112ee3066dc tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:12:20.545120 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-021f2b3c-e379-4cfb-830e-0112ee3066dc tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: 911394e0-0af3-4433-acfb-a4652d4e2e84] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:12:20.554594 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-021f2b3c-e379-4cfb-830e-0112ee3066dc tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:20.555526 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-021f2b3c-e379-4cfb-830e-0112ee3066dc tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:20.556296 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-021f2b3c-e379-4cfb-830e-0112ee3066dc tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:20.557798 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-021f2b3c-e379-4cfb-830e-0112ee3066dc tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:20.558443 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-021f2b3c-e379-4cfb-830e-0112ee3066dc tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:20.559788 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-021f2b3c-e379-4cfb-830e-0112ee3066dc tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:20.578885 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-021f2b3c-e379-4cfb-830e-0112ee3066dc tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] HTTP exception thrown: Instance 911394e0-0af3-4433-acfb-a4652d4e2e84 could not be found. Oct 08 21:12:20.580440 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-021f2b3c-e379-4cfb-830e-0112ee3066dc tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Request method failure captured: Oct 08 21:12:20.580440 ncdv-master-1 devstack@n-api.service[140492]: request: GET /compute/v2.1/servers/911394e0-0af3-4433-acfb-a4652d4e2e84 HTTP/1.1 Oct 08 21:12:20.580440 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:12:20.580440 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:12:20.580440 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:12:20.580440 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 21:12:20.580440 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:12:20.580440 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:12:20.580440 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:12:20.580440 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:12:20.580440 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeaY45CCffIT40Amc9wEG1L3srTtCd58z19KxF0fYIwNPulOEB6B0U5KbwvP4xZlDymYa3r7NupuSBl7IoxTUgzZohPJnXbaXnL_FvPvzvmymW0IMjU5l88HUbi73sOE2TxCcEBd6artojZxtGFF9N7yzN3dTHpujcvoWiRD4lXAI28 Oct 08 21:12:20.580440 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:12:20.580440 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:12:20.580440 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:12:20.580440 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:12:20.580440 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:12:20.580440 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:12:20.580440 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 765c62cac2ee4406b23a5baa85c52ff7 Oct 08 21:12:20.580440 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-DeleteServersTestJSON-1423663413 Oct 08 21:12:20.580440 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:12:20.580440 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:12:20.580440 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/765c62cac2ee4406b23a5baa85c52ff7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/765c62cac2ee4406b23a5baa85c52ff7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_765c62cac2ee4406b23a5baa85c52ff7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/765c62cac2ee4406b23a5baa85c52ff7"}]}] Oct 08 21:12:20.580440 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-DeleteServersTestJSON-1423663413 Oct 08 21:12:20.580440 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 765c62cac2ee4406b23a5baa85c52ff7 Oct 08 21:12:20.580440 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-DeleteServersTestJSON-1423663413 Oct 08 21:12:20.580440 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-DeleteServersTestJSON-1423663413-project Oct 08 21:12:20.580440 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:12:20.580440 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:12:20.580440 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: d78e9afd772c4de981cac8f5817ec356 Oct 08 21:12:20.580440 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-DeleteServersTestJSON-1423663413-project Oct 08 21:12:20.580440 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 21:12:20.580440 ncdv-master-1 devstack@n-api.service[140492]: exception: Instance 911394e0-0af3-4433-acfb-a4652d4e2e84 could not be found. Oct 08 21:12:20.580440 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': '911394e0-0af3-4433-acfb-a4652d4e2e84'} Oct 08 21:12:20.580440 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:12:20.580440 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:12:20.580440 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:12:20.580440 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:12:20.580440 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:12:20.580440 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:12:20.580440 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:12:20.580440 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:12:20.580440 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:12:20.580440 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:12:20.580440 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 911394e0-0af3-4433-acfb-a4652d4e2e84 could not be found. Oct 08 21:12:20.580440 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:12:20.580440 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:12:20.580440 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:12:20.580440 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:12:20.580440 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:12:20.580440 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:12:20.580440 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:12:20.580440 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:12:20.580440 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:12:20.580440 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:12:20.580440 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:12:20.580440 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:12:20.580440 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:12:20.580440 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:12:20.580440 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:12:20.580440 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:12:20.580440 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 911394e0-0af3-4433-acfb-a4652d4e2e84 could not be found. Oct 08 21:12:20.580440 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:12:20.580440 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:12:20.580440 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:12:20.587957 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:12:20.587957 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:12:20.587957 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:12:20.587957 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:12:20.587957 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:12:20.587957 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 911394e0-0af3-4433-acfb-a4652d4e2e84 could not be found. Oct 08 21:12:20.587957 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:12:20.587957 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-021f2b3c-e379-4cfb-830e-0112ee3066dc tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Returning 404 to user: Instance 911394e0-0af3-4433-acfb-a4652d4e2e84 could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:12:20.587957 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-021f2b3c-e379-4cfb-830e-0112ee3066dc tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/911394e0-0af3-4433-acfb-a4652d4e2e84" status: 404 len: 111 microversion: 2.1 time: 0.048621 Oct 08 21:12:20.587957 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2399/4736] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:12:20 2022] GET /compute/v2.1/servers/911394e0-0af3-4433-acfb-a4652d4e2e84 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 08 21:12:20.596902 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-213995d7-beb6-4ddf-8af6-e4a7d93ed6cb tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:12:20.597805 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-213995d7-beb6-4ddf-8af6-e4a7d93ed6cb tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: 318ee24a-a78a-4b3b-b18b-64f5c5c3109a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:12:20.608629 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-213995d7-beb6-4ddf-8af6-e4a7d93ed6cb tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:20.609858 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-213995d7-beb6-4ddf-8af6-e4a7d93ed6cb tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:20.610696 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-213995d7-beb6-4ddf-8af6-e4a7d93ed6cb tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:20.612779 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-213995d7-beb6-4ddf-8af6-e4a7d93ed6cb tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:20.613595 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-213995d7-beb6-4ddf-8af6-e4a7d93ed6cb tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:20.614422 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-213995d7-beb6-4ddf-8af6-e4a7d93ed6cb tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:20.663389 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-213995d7-beb6-4ddf-8af6-e4a7d93ed6cb tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] HTTP exception thrown: Instance 318ee24a-a78a-4b3b-b18b-64f5c5c3109a could not be found. Oct 08 21:12:20.669069 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-213995d7-beb6-4ddf-8af6-e4a7d93ed6cb tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Request method failure captured: Oct 08 21:12:20.669069 ncdv-master-1 devstack@n-api.service[140492]: request: DELETE /compute/v2.1/servers/318ee24a-a78a-4b3b-b18b-64f5c5c3109a HTTP/1.1 Oct 08 21:12:20.669069 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:12:20.669069 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:12:20.669069 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:12:20.669069 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 21:12:20.669069 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:12:20.669069 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:12:20.669069 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:12:20.669069 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:12:20.669069 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeaY45CCffIT40Amc9wEG1L3srTtCd58z19KxF0fYIwNPulOEB6B0U5KbwvP4xZlDymYa3r7NupuSBl7IoxTUgzZohPJnXbaXnL_FvPvzvmymW0IMjU5l88HUbi73sOE2TxCcEBd6artojZxtGFF9N7yzN3dTHpujcvoWiRD4lXAI28 Oct 08 21:12:20.669069 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:12:20.669069 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:12:20.669069 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:12:20.669069 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:12:20.669069 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:12:20.669069 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:12:20.669069 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 765c62cac2ee4406b23a5baa85c52ff7 Oct 08 21:12:20.669069 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-DeleteServersTestJSON-1423663413 Oct 08 21:12:20.669069 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:12:20.669069 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:12:20.669069 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/765c62cac2ee4406b23a5baa85c52ff7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/765c62cac2ee4406b23a5baa85c52ff7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_765c62cac2ee4406b23a5baa85c52ff7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/765c62cac2ee4406b23a5baa85c52ff7"}]}] Oct 08 21:12:20.669069 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-DeleteServersTestJSON-1423663413 Oct 08 21:12:20.669069 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 765c62cac2ee4406b23a5baa85c52ff7 Oct 08 21:12:20.669069 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-DeleteServersTestJSON-1423663413 Oct 08 21:12:20.669069 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-DeleteServersTestJSON-1423663413-project Oct 08 21:12:20.669069 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:12:20.669069 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:12:20.669069 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: d78e9afd772c4de981cac8f5817ec356 Oct 08 21:12:20.669069 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-DeleteServersTestJSON-1423663413-project Oct 08 21:12:20.669069 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 21:12:20.669069 ncdv-master-1 devstack@n-api.service[140492]: exception: Instance 318ee24a-a78a-4b3b-b18b-64f5c5c3109a could not be found. Oct 08 21:12:20.669069 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': '318ee24a-a78a-4b3b-b18b-64f5c5c3109a'} Oct 08 21:12:20.669069 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:12:20.669069 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:12:20.669069 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:12:20.669069 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:12:20.669069 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:12:20.669069 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:12:20.669069 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:12:20.669069 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:12:20.669069 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:12:20.669069 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:12:20.669069 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 318ee24a-a78a-4b3b-b18b-64f5c5c3109a could not be found. Oct 08 21:12:20.669069 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:12:20.669069 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:12:20.669069 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:12:20.669069 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:12:20.669069 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:12:20.669069 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:12:20.669069 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:12:20.669069 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:12:20.669069 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:12:20.669069 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:12:20.669069 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 08 21:12:20.669069 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 08 21:12:20.669069 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 08 21:12:20.669069 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 08 21:12:20.669069 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:12:20.669069 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:12:20.669069 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:12:20.669069 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:12:20.674727 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 318ee24a-a78a-4b3b-b18b-64f5c5c3109a could not be found. Oct 08 21:12:20.674727 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:12:20.674727 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:12:20.674727 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:12:20.674727 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:12:20.674727 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:12:20.674727 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:12:20.674727 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:12:20.674727 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:12:20.674727 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 318ee24a-a78a-4b3b-b18b-64f5c5c3109a could not be found. Oct 08 21:12:20.674727 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:12:20.674727 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-213995d7-beb6-4ddf-8af6-e4a7d93ed6cb tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Returning 404 to user: Instance 318ee24a-a78a-4b3b-b18b-64f5c5c3109a could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:12:20.678503 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-213995d7-beb6-4ddf-8af6-e4a7d93ed6cb tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "DELETE /compute/v2.1/servers/318ee24a-a78a-4b3b-b18b-64f5c5c3109a" status: 404 len: 111 microversion: 2.1 time: 0.088167 Oct 08 21:12:20.682086 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2400/4737] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:12:20 2022] DELETE /compute/v2.1/servers/318ee24a-a78a-4b3b-b18b-64f5c5c3109a => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:12:20.688650 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-8bd2fb6b-8a8c-4e89-b74c-98a11ac675a1 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:12:20.691515 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-8bd2fb6b-8a8c-4e89-b74c-98a11ac675a1 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] [instance: 318ee24a-a78a-4b3b-b18b-64f5c5c3109a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:12:20.708011 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8bd2fb6b-8a8c-4e89-b74c-98a11ac675a1 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:20.708529 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8bd2fb6b-8a8c-4e89-b74c-98a11ac675a1 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:20.709510 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8bd2fb6b-8a8c-4e89-b74c-98a11ac675a1 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:20.710266 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8bd2fb6b-8a8c-4e89-b74c-98a11ac675a1 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:20.712620 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8bd2fb6b-8a8c-4e89-b74c-98a11ac675a1 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:20.714573 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8bd2fb6b-8a8c-4e89-b74c-98a11ac675a1 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:20.752683 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-8bd2fb6b-8a8c-4e89-b74c-98a11ac675a1 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] HTTP exception thrown: Instance 318ee24a-a78a-4b3b-b18b-64f5c5c3109a could not be found. Oct 08 21:12:20.755250 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-8bd2fb6b-8a8c-4e89-b74c-98a11ac675a1 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Request method failure captured: Oct 08 21:12:20.755250 ncdv-master-1 devstack@n-api.service[140492]: request: GET /compute/v2.1/servers/318ee24a-a78a-4b3b-b18b-64f5c5c3109a HTTP/1.1 Oct 08 21:12:20.755250 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:12:20.755250 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:12:20.755250 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:12:20.755250 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 21:12:20.755250 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:12:20.755250 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:12:20.755250 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:12:20.755250 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:12:20.755250 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeaY45CCffIT40Amc9wEG1L3srTtCd58z19KxF0fYIwNPulOEB6B0U5KbwvP4xZlDymYa3r7NupuSBl7IoxTUgzZohPJnXbaXnL_FvPvzvmymW0IMjU5l88HUbi73sOE2TxCcEBd6artojZxtGFF9N7yzN3dTHpujcvoWiRD4lXAI28 Oct 08 21:12:20.755250 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:12:20.755250 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:12:20.755250 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:12:20.755250 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:12:20.755250 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:12:20.755250 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:12:20.755250 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 765c62cac2ee4406b23a5baa85c52ff7 Oct 08 21:12:20.755250 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-DeleteServersTestJSON-1423663413 Oct 08 21:12:20.755250 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:12:20.755250 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:12:20.755250 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/765c62cac2ee4406b23a5baa85c52ff7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/765c62cac2ee4406b23a5baa85c52ff7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_765c62cac2ee4406b23a5baa85c52ff7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/765c62cac2ee4406b23a5baa85c52ff7"}]}] Oct 08 21:12:20.755250 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-DeleteServersTestJSON-1423663413 Oct 08 21:12:20.755250 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 765c62cac2ee4406b23a5baa85c52ff7 Oct 08 21:12:20.755250 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-DeleteServersTestJSON-1423663413 Oct 08 21:12:20.755250 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-DeleteServersTestJSON-1423663413-project Oct 08 21:12:20.755250 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:12:20.755250 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:12:20.755250 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: d78e9afd772c4de981cac8f5817ec356 Oct 08 21:12:20.755250 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-DeleteServersTestJSON-1423663413-project Oct 08 21:12:20.755250 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 21:12:20.755250 ncdv-master-1 devstack@n-api.service[140492]: exception: Instance 318ee24a-a78a-4b3b-b18b-64f5c5c3109a could not be found. Oct 08 21:12:20.755250 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': '318ee24a-a78a-4b3b-b18b-64f5c5c3109a'} Oct 08 21:12:20.755250 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:12:20.755250 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:12:20.755250 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:12:20.755250 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:12:20.755250 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:12:20.755250 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:12:20.755250 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:12:20.755250 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:12:20.755250 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:12:20.755250 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:12:20.755250 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 318ee24a-a78a-4b3b-b18b-64f5c5c3109a could not be found. Oct 08 21:12:20.755250 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:12:20.755250 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:12:20.755250 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:12:20.755250 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:12:20.755250 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:12:20.755250 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:12:20.755250 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:12:20.755250 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:12:20.755250 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:12:20.755250 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:12:20.755250 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:12:20.755250 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:12:20.755250 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:12:20.755250 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:12:20.755250 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:12:20.755250 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:12:20.755250 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 318ee24a-a78a-4b3b-b18b-64f5c5c3109a could not be found. Oct 08 21:12:20.755250 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:12:20.755250 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:12:20.755250 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:12:20.760508 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:12:20.760508 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:12:20.760508 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:12:20.760508 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:12:20.760508 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:12:20.760508 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 318ee24a-a78a-4b3b-b18b-64f5c5c3109a could not be found. Oct 08 21:12:20.760508 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:12:20.762446 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-8bd2fb6b-8a8c-4e89-b74c-98a11ac675a1 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] Returning 404 to user: Instance 318ee24a-a78a-4b3b-b18b-64f5c5c3109a could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:12:20.765722 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-8bd2fb6b-8a8c-4e89-b74c-98a11ac675a1 tempest-DeleteServersTestJSON-1423663413 tempest-DeleteServersTestJSON-1423663413-project] 10.222.0.26 "GET /compute/v2.1/servers/318ee24a-a78a-4b3b-b18b-64f5c5c3109a" status: 404 len: 111 microversion: 2.1 time: 0.079869 Oct 08 21:12:20.766805 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2401/4738] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:12:20 2022] GET /compute/v2.1/servers/318ee24a-a78a-4b3b-b18b-64f5c5c3109a => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 08 21:12:21.278191 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-05ec1d78-ae2d-456d-8ef6-a0caebf7054b req-871713e6-b4a1-427c-9303-e5df8de2fcab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84f33d6e-ddf3-4b77-b83d-595c7f75de55", "name": "network-vif-plugged", "status": "completed", "tag": "4dafcfde-8e70-4b8a-9a65-16bcd9c3e23d"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:12:21.310629 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-05ec1d78-ae2d-456d-8ef6-a0caebf7054b req-871713e6-b4a1-427c-9303-e5df8de2fcab service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:21.311415 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-05ec1d78-ae2d-456d-8ef6-a0caebf7054b req-871713e6-b4a1-427c-9303-e5df8de2fcab service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:21.315325 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-05ec1d78-ae2d-456d-8ef6-a0caebf7054b req-871713e6-b4a1-427c-9303-e5df8de2fcab service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:21.345369 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-05ec1d78-ae2d-456d-8ef6-a0caebf7054b req-871713e6-b4a1-427c-9303-e5df8de2fcab service nova] Creating event network-vif-plugged:4dafcfde-8e70-4b8a-9a65-16bcd9c3e23d for instance 84f33d6e-ddf3-4b77-b83d-595c7f75de55 on nch2-master-1 Oct 08 21:12:21.357542 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-05ec1d78-ae2d-456d-8ef6-a0caebf7054b req-871713e6-b4a1-427c-9303-e5df8de2fcab service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082715 Oct 08 21:12:21.362221 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2402/4739] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:12:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 08 21:12:21.377520 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-694c726e-7c45-451c-a373-8e076e500879 tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:12:21.378860 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-694c726e-7c45-451c-a373-8e076e500879 tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] [instance: 84f33d6e-ddf3-4b77-b83d-595c7f75de55] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:12:21.400930 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-694c726e-7c45-451c-a373-8e076e500879 tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:21.403564 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-694c726e-7c45-451c-a373-8e076e500879 tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:21.404066 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-694c726e-7c45-451c-a373-8e076e500879 tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:21.404832 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-694c726e-7c45-451c-a373-8e076e500879 tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:21.406782 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-694c726e-7c45-451c-a373-8e076e500879 tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:21.407265 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-694c726e-7c45-451c-a373-8e076e500879 tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:21.647488 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-2cd7a984-ab3c-4bd9-bfcc-b75f1db4be59 tempest-SecurityGroupRulesTestJSON-2076505162 tempest-SecurityGroupRulesTestJSON-2076505162-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/5f869aa9-20c3-44a8-8581-c97ac1a41da2" status: 202 len: 0 microversion: 2.1 time: 1.311452 Oct 08 21:12:21.648658 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2338/4740] 10.222.0.26 () {58 vars in 1272 bytes} [Sat Oct 8 21:12:20 2022] DELETE /compute/v2.1/os-security-groups/5f869aa9-20c3-44a8-8581-c97ac1a41da2 => generated 0 bytes in 1313 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 21:12:21.658257 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-aff0d775-d764-4d04-b806-439ab9fbbf01 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:12:21.658855 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-aff0d775-d764-4d04-b806-439ab9fbbf01 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: 89d969cd-5514-4a4d-9c3c-1b408fff2f44] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:12:21.717019 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-aff0d775-d764-4d04-b806-439ab9fbbf01 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:21.718092 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-aff0d775-d764-4d04-b806-439ab9fbbf01 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:21.720170 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-aff0d775-d764-4d04-b806-439ab9fbbf01 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:21.722957 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-aff0d775-d764-4d04-b806-439ab9fbbf01 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:21.726697 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-aff0d775-d764-4d04-b806-439ab9fbbf01 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:21.728451 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-aff0d775-d764-4d04-b806-439ab9fbbf01 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:21.764458 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-aff0d775-d764-4d04-b806-439ab9fbbf01 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] HTTP exception thrown: Instance 89d969cd-5514-4a4d-9c3c-1b408fff2f44 could not be found. Oct 08 21:12:21.769632 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-aff0d775-d764-4d04-b806-439ab9fbbf01 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Request method failure captured: Oct 08 21:12:21.769632 ncdv-master-1 devstack@n-api.service[140491]: request: DELETE /compute/v2.1/servers/89d969cd-5514-4a4d-9c3c-1b408fff2f44 HTTP/1.1 Oct 08 21:12:21.769632 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:12:21.769632 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:12:21.769632 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:12:21.769632 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 21:12:21.769632 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:12:21.769632 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:12:21.769632 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:12:21.769632 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:12:21.769632 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQebW09Z3m936-d3SrnQA9UQ3KXQvUYeQwL43ufWdoxmQhUwYBWv-JT053t_VYPo9wAVRoCqYQy8Hhh8zc2n570KpS0qNVLik822FjYabkSIZMA_ubWypXzSwo3J04zV1MoSSz79D-b8-ZvwYCEIbwpbfyn5opgOjnO6EXvq1UNPaSyQ Oct 08 21:12:21.769632 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:12:21.769632 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:12:21.769632 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:12:21.769632 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:12:21.769632 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:12:21.769632 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:12:21.769632 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 0ae02675057e4f27bc1980348afc8ca1 Oct 08 21:12:21.769632 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-ServersNegativeTestJSON-1441071354 Oct 08 21:12:21.769632 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:12:21.769632 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:12:21.769632 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0ae02675057e4f27bc1980348afc8ca1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0ae02675057e4f27bc1980348afc8ca1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0ae02675057e4f27bc1980348afc8ca1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0ae02675057e4f27bc1980348afc8ca1"}]}] Oct 08 21:12:21.769632 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-ServersNegativeTestJSON-1441071354 Oct 08 21:12:21.769632 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 0ae02675057e4f27bc1980348afc8ca1 Oct 08 21:12:21.769632 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1441071354 Oct 08 21:12:21.769632 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-ServersNegativeTestJSON-1441071354-project Oct 08 21:12:21.769632 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:12:21.769632 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:12:21.769632 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 6a78d352c143483c8e4702d789d4c516 Oct 08 21:12:21.769632 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-ServersNegativeTestJSON-1441071354-project Oct 08 21:12:21.769632 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:12:21.769632 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance 89d969cd-5514-4a4d-9c3c-1b408fff2f44 could not be found. Oct 08 21:12:21.769632 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': '89d969cd-5514-4a4d-9c3c-1b408fff2f44'} Oct 08 21:12:21.769632 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:12:21.769632 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:12:21.769632 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:12:21.769632 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:12:21.769632 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:12:21.769632 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:12:21.769632 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:12:21.769632 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:12:21.769632 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:12:21.769632 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:12:21.769632 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89d969cd-5514-4a4d-9c3c-1b408fff2f44 could not be found. Oct 08 21:12:21.769632 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:12:21.769632 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:12:21.769632 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:12:21.769632 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:12:21.769632 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:12:21.769632 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:12:21.769632 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:12:21.769632 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:12:21.769632 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:12:21.769632 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:12:21.769632 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 08 21:12:21.769632 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 08 21:12:21.769632 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 08 21:12:21.769632 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 08 21:12:21.769632 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:12:21.769632 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:12:21.769632 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:12:21.769632 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:12:21.773723 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89d969cd-5514-4a4d-9c3c-1b408fff2f44 could not be found. Oct 08 21:12:21.773723 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:12:21.773723 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:12:21.773723 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:12:21.773723 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:12:21.773723 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:12:21.773723 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:12:21.773723 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:12:21.773723 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:12:21.773723 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89d969cd-5514-4a4d-9c3c-1b408fff2f44 could not be found. Oct 08 21:12:21.773723 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:12:21.773723 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-aff0d775-d764-4d04-b806-439ab9fbbf01 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Returning 404 to user: Instance 89d969cd-5514-4a4d-9c3c-1b408fff2f44 could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:12:21.774903 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-aff0d775-d764-4d04-b806-439ab9fbbf01 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "DELETE /compute/v2.1/servers/89d969cd-5514-4a4d-9c3c-1b408fff2f44" status: 404 len: 111 microversion: 2.1 time: 0.121419 Oct 08 21:12:21.776254 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2339/4741] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:12:21 2022] DELETE /compute/v2.1/servers/89d969cd-5514-4a4d-9c3c-1b408fff2f44 => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:12:21.787690 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-a6b5ca54-a367-4ee7-b584-b237dad2080a tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:12:21.790483 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-a6b5ca54-a367-4ee7-b584-b237dad2080a tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: 89d969cd-5514-4a4d-9c3c-1b408fff2f44] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:12:21.805003 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a6b5ca54-a367-4ee7-b584-b237dad2080a tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:21.805556 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a6b5ca54-a367-4ee7-b584-b237dad2080a tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:21.806166 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a6b5ca54-a367-4ee7-b584-b237dad2080a tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:21.806890 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a6b5ca54-a367-4ee7-b584-b237dad2080a tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:21.807341 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a6b5ca54-a367-4ee7-b584-b237dad2080a tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:21.810807 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a6b5ca54-a367-4ee7-b584-b237dad2080a tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:21.848660 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-a6b5ca54-a367-4ee7-b584-b237dad2080a tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] HTTP exception thrown: Instance 89d969cd-5514-4a4d-9c3c-1b408fff2f44 could not be found. Oct 08 21:12:21.854352 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-a6b5ca54-a367-4ee7-b584-b237dad2080a tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Request method failure captured: Oct 08 21:12:21.854352 ncdv-master-1 devstack@n-api.service[140491]: request: GET /compute/v2.1/servers/89d969cd-5514-4a4d-9c3c-1b408fff2f44 HTTP/1.1 Oct 08 21:12:21.854352 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:12:21.854352 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:12:21.854352 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:12:21.854352 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 21:12:21.854352 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:12:21.854352 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:12:21.854352 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:12:21.854352 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:12:21.854352 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQebW09Z3m936-d3SrnQA9UQ3KXQvUYeQwL43ufWdoxmQhUwYBWv-JT053t_VYPo9wAVRoCqYQy8Hhh8zc2n570KpS0qNVLik822FjYabkSIZMA_ubWypXzSwo3J04zV1MoSSz79D-b8-ZvwYCEIbwpbfyn5opgOjnO6EXvq1UNPaSyQ Oct 08 21:12:21.854352 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:12:21.854352 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:12:21.854352 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:12:21.854352 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:12:21.854352 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:12:21.854352 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:12:21.854352 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 0ae02675057e4f27bc1980348afc8ca1 Oct 08 21:12:21.854352 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-ServersNegativeTestJSON-1441071354 Oct 08 21:12:21.854352 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:12:21.854352 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:12:21.854352 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0ae02675057e4f27bc1980348afc8ca1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0ae02675057e4f27bc1980348afc8ca1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0ae02675057e4f27bc1980348afc8ca1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0ae02675057e4f27bc1980348afc8ca1"}]}] Oct 08 21:12:21.854352 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-ServersNegativeTestJSON-1441071354 Oct 08 21:12:21.854352 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 0ae02675057e4f27bc1980348afc8ca1 Oct 08 21:12:21.854352 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1441071354 Oct 08 21:12:21.854352 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-ServersNegativeTestJSON-1441071354-project Oct 08 21:12:21.854352 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:12:21.854352 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:12:21.854352 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 6a78d352c143483c8e4702d789d4c516 Oct 08 21:12:21.854352 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-ServersNegativeTestJSON-1441071354-project Oct 08 21:12:21.854352 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:12:21.854352 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance 89d969cd-5514-4a4d-9c3c-1b408fff2f44 could not be found. Oct 08 21:12:21.854352 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': '89d969cd-5514-4a4d-9c3c-1b408fff2f44'} Oct 08 21:12:21.854352 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:12:21.854352 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:12:21.854352 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:12:21.854352 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:12:21.854352 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:12:21.854352 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:12:21.854352 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:12:21.854352 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:12:21.854352 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:12:21.854352 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:12:21.854352 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89d969cd-5514-4a4d-9c3c-1b408fff2f44 could not be found. Oct 08 21:12:21.854352 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:12:21.854352 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:12:21.854352 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:12:21.854352 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:12:21.854352 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:12:21.854352 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:12:21.854352 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:12:21.854352 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:12:21.854352 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:12:21.854352 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:12:21.854352 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:12:21.854352 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:12:21.854352 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:12:21.854352 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:12:21.854352 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:12:21.854352 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:12:21.854352 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89d969cd-5514-4a4d-9c3c-1b408fff2f44 could not be found. Oct 08 21:12:21.854352 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:12:21.854352 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:12:21.854352 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:12:21.858598 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:12:21.858598 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:12:21.858598 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:12:21.858598 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:12:21.858598 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:12:21.858598 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89d969cd-5514-4a4d-9c3c-1b408fff2f44 could not be found. Oct 08 21:12:21.858598 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:12:21.858598 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-a6b5ca54-a367-4ee7-b584-b237dad2080a tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Returning 404 to user: Instance 89d969cd-5514-4a4d-9c3c-1b408fff2f44 could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:12:21.859496 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-a6b5ca54-a367-4ee7-b584-b237dad2080a tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/89d969cd-5514-4a4d-9c3c-1b408fff2f44" status: 404 len: 111 microversion: 2.1 time: 0.078474 Oct 08 21:12:21.865275 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2340/4742] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:12:21 2022] GET /compute/v2.1/servers/89d969cd-5514-4a4d-9c3c-1b408fff2f44 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:12:21.877823 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-dcf895d0-3b15-43ab-a9b3-d050a1b53a3d tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:12:21.880978 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-dcf895d0-3b15-43ab-a9b3-d050a1b53a3d tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:12:21.895389 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dcf895d0-3b15-43ab-a9b3-d050a1b53a3d tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:21.897714 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dcf895d0-3b15-43ab-a9b3-d050a1b53a3d tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:21.898957 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dcf895d0-3b15-43ab-a9b3-d050a1b53a3d tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:21.900920 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dcf895d0-3b15-43ab-a9b3-d050a1b53a3d tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:21.902192 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dcf895d0-3b15-43ab-a9b3-d050a1b53a3d tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:21.902638 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dcf895d0-3b15-43ab-a9b3-d050a1b53a3d tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:21.964120 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-dcf895d0-3b15-43ab-a9b3-d050a1b53a3d tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Going to try to terminate instance {{(pid=140491) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 21:12:22.119156 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:12:22.173700 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-694c726e-7c45-451c-a373-8e076e500879 tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77129c9ce5149748c6bd39c69307f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a53484c6ab4ea4be7acb5ac53acaa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:12:22.189602 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-694c726e-7c45-451c-a373-8e076e500879 tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] 10.222.0.26 "GET /compute/v2.1/servers/84f33d6e-ddf3-4b77-b83d-595c7f75de55" status: 200 len: 1317 microversion: 2.1 time: 0.823668 Oct 08 21:12:22.191747 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2403/4743] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:12:21 2022] GET /compute/v2.1/servers/84f33d6e-ddf3-4b77-b83d-595c7f75de55 => generated 1317 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:12:22.219323 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-dcf895d0-3b15-43ab-a9b3-d050a1b53a3d tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "DELETE /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 204 len: 0 microversion: 2.1 time: 0.348703 Oct 08 21:12:22.220019 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2341/4744] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:12:21 2022] DELETE /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 08 21:12:22.234573 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-db843513-0ef1-41d8-9504-1f1f3dd84ab4 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:12:22.235522 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-db843513-0ef1-41d8-9504-1f1f3dd84ab4 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:12:22.243990 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-db843513-0ef1-41d8-9504-1f1f3dd84ab4 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:22.244831 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-db843513-0ef1-41d8-9504-1f1f3dd84ab4 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:22.245501 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-db843513-0ef1-41d8-9504-1f1f3dd84ab4 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:22.246776 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-db843513-0ef1-41d8-9504-1f1f3dd84ab4 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:22.247446 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-db843513-0ef1-41d8-9504-1f1f3dd84ab4 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:22.248076 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-db843513-0ef1-41d8-9504-1f1f3dd84ab4 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:22.887485 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-db843513-0ef1-41d8-9504-1f1f3dd84ab4 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:12:22.897994 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-db843513-0ef1-41d8-9504-1f1f3dd84ab4 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 200 len: 1509 microversion: 2.1 time: 0.672814 Oct 08 21:12:22.902344 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2404/4745] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:12:22 2022] GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 1509 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:12:23.219607 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-1ed597dc-209b-466f-921f-344df35a6ca0 tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:12:23.221404 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-1ed597dc-209b-466f-921f-344df35a6ca0 tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] [instance: 84f33d6e-ddf3-4b77-b83d-595c7f75de55] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:12:23.245175 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1ed597dc-209b-466f-921f-344df35a6ca0 tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:23.245769 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1ed597dc-209b-466f-921f-344df35a6ca0 tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:23.246222 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1ed597dc-209b-466f-921f-344df35a6ca0 tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:23.251156 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1ed597dc-209b-466f-921f-344df35a6ca0 tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:23.251647 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1ed597dc-209b-466f-921f-344df35a6ca0 tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:23.259030 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1ed597dc-209b-466f-921f-344df35a6ca0 tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:23.663873 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-1ed597dc-209b-466f-921f-344df35a6ca0 tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77129c9ce5149748c6bd39c69307f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a53484c6ab4ea4be7acb5ac53acaa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:12:23.680528 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-1ed597dc-209b-466f-921f-344df35a6ca0 tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] 10.222.0.26 "GET /compute/v2.1/servers/84f33d6e-ddf3-4b77-b83d-595c7f75de55" status: 200 len: 1317 microversion: 2.1 time: 0.468292 Oct 08 21:12:23.682638 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2342/4746] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:12:23 2022] GET /compute/v2.1/servers/84f33d6e-ddf3-4b77-b83d-595c7f75de55 => generated 1317 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:12:23.918425 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-f5e94832-79b4-4c90-8910-281842844584 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1939784928 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1939784928-project-admin] Calling method '.version_select at 0x7f1a8c20f940>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:12:23.923366 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f5e94832-79b4-4c90-8910-281842844584 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1939784928 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1939784928-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:23.924837 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f5e94832-79b4-4c90-8910-281842844584 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1939784928 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1939784928-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:23.925735 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f5e94832-79b4-4c90-8910-281842844584 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1939784928 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1939784928-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:23.935051 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-a2ffda39-4101-44cc-bbc3-bc2d3e3d4ebf tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:12:23.946070 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-a2ffda39-4101-44cc-bbc3-bc2d3e3d4ebf tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:12:23.955439 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f5e94832-79b4-4c90-8910-281842844584 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1939784928 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1939784928-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:23.956378 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f5e94832-79b4-4c90-8910-281842844584 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1939784928 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1939784928-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:23.957088 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f5e94832-79b4-4c90-8910-281842844584 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1939784928 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1939784928-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:23.965203 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a2ffda39-4101-44cc-bbc3-bc2d3e3d4ebf tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:23.965934 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a2ffda39-4101-44cc-bbc3-bc2d3e3d4ebf tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:23.966545 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a2ffda39-4101-44cc-bbc3-bc2d3e3d4ebf tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:23.967418 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a2ffda39-4101-44cc-bbc3-bc2d3e3d4ebf tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:23.967888 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a2ffda39-4101-44cc-bbc3-bc2d3e3d4ebf tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:23.968323 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a2ffda39-4101-44cc-bbc3-bc2d3e3d4ebf tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:23.976205 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f5e94832-79b4-4c90-8910-281842844584 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1939784928 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1939784928-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:23.978131 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f5e94832-79b4-4c90-8910-281842844584 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1939784928 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1939784928-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:23.979826 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f5e94832-79b4-4c90-8910-281842844584 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1939784928 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1939784928-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:23.990084 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-f5e94832-79b4-4c90-8910-281842844584 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1939784928 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1939784928-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.561559 Oct 08 21:12:23.999333 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2405/4747] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Oct 8 21:12:23 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:12:24.666260 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-a2ffda39-4101-44cc-bbc3-bc2d3e3d4ebf tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:12:24.680080 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-a2ffda39-4101-44cc-bbc3-bc2d3e3d4ebf tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 200 len: 1509 microversion: 2.1 time: 0.757078 Oct 08 21:12:24.681632 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2343/4748] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:12:23 2022] GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 1509 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:12:24.709545 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-11498504-ad3a-42e7-8a5f-24610118e519 tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:12:24.710444 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-11498504-ad3a-42e7-8a5f-24610118e519 tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] [instance: 84f33d6e-ddf3-4b77-b83d-595c7f75de55] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:12:24.718451 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-11498504-ad3a-42e7-8a5f-24610118e519 tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:24.719520 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-11498504-ad3a-42e7-8a5f-24610118e519 tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:24.720135 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-11498504-ad3a-42e7-8a5f-24610118e519 tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:24.721306 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-11498504-ad3a-42e7-8a5f-24610118e519 tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:24.722326 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-11498504-ad3a-42e7-8a5f-24610118e519 tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:24.722929 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-11498504-ad3a-42e7-8a5f-24610118e519 tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:25.207065 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-11498504-ad3a-42e7-8a5f-24610118e519 tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77129c9ce5149748c6bd39c69307f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a53484c6ab4ea4be7acb5ac53acaa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:12:25.221572 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-11498504-ad3a-42e7-8a5f-24610118e519 tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] 10.222.0.26 "GET /compute/v2.1/servers/84f33d6e-ddf3-4b77-b83d-595c7f75de55" status: 200 len: 1506 microversion: 2.1 time: 0.515892 Oct 08 21:12:25.222310 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2406/4749] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:12:24 2022] GET /compute/v2.1/servers/84f33d6e-ddf3-4b77-b83d-595c7f75de55 => generated 1506 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:12:25.249416 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-6945219c-8c0a-4c67-b63b-026bdbf932c8 tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:12:25.250096 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-6945219c-8c0a-4c67-b63b-026bdbf932c8 tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] [instance: 84f33d6e-ddf3-4b77-b83d-595c7f75de55] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:12:25.262388 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6945219c-8c0a-4c67-b63b-026bdbf932c8 tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:25.263610 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6945219c-8c0a-4c67-b63b-026bdbf932c8 tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:25.264327 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6945219c-8c0a-4c67-b63b-026bdbf932c8 tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:25.266310 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6945219c-8c0a-4c67-b63b-026bdbf932c8 tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:25.266878 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6945219c-8c0a-4c67-b63b-026bdbf932c8 tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:25.267463 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6945219c-8c0a-4c67-b63b-026bdbf932c8 tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:25.331242 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-6945219c-8c0a-4c67-b63b-026bdbf932c8 tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': 'f77129c9ce5149748c6bd39c69307f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a53484c6ab4ea4be7acb5ac53acaa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:12:25.333049 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-6945219c-8c0a-4c67-b63b-026bdbf932c8 tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] 10.222.0.26 "GET /compute/v2.1/servers/84f33d6e-ddf3-4b77-b83d-595c7f75de55/os-instance-actions/req-cbc17e08-5c81-47ea-83d0-1eb565d4159c" status: 200 len: 313 microversion: 2.1 time: 0.088639 Oct 08 21:12:25.333849 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2344/4750] 10.222.0.26 () {58 vars in 1419 bytes} [Sat Oct 8 21:12:25 2022] GET /compute/v2.1/servers/84f33d6e-ddf3-4b77-b83d-595c7f75de55/os-instance-actions/req-cbc17e08-5c81-47ea-83d0-1eb565d4159c => generated 313 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:12:25.369942 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-8b480f90-aab8-4b90-8374-5b696de84352 tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:12:25.375016 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-8b480f90-aab8-4b90-8374-5b696de84352 tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] [instance: 84f33d6e-ddf3-4b77-b83d-595c7f75de55] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:12:25.384078 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8b480f90-aab8-4b90-8374-5b696de84352 tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:25.384861 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8b480f90-aab8-4b90-8374-5b696de84352 tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:25.385506 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8b480f90-aab8-4b90-8374-5b696de84352 tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:25.388144 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8b480f90-aab8-4b90-8374-5b696de84352 tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:25.389563 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8b480f90-aab8-4b90-8374-5b696de84352 tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:25.391841 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8b480f90-aab8-4b90-8374-5b696de84352 tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:25.546160 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-8b480f90-aab8-4b90-8374-5b696de84352 tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] 10.222.0.26 "POST /compute/v2.1/servers/84f33d6e-ddf3-4b77-b83d-595c7f75de55/action" status: 202 len: 0 microversion: 2.1 time: 0.196029 Oct 08 21:12:25.549254 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2407/4751] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:12:25 2022] POST /compute/v2.1/servers/84f33d6e-ddf3-4b77-b83d-595c7f75de55/action => generated 0 bytes in 199 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 21:12:25.555179 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-ec77f5ee-aafb-4d7b-81d0-5cded10b31ec tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:12:25.555717 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-ec77f5ee-aafb-4d7b-81d0-5cded10b31ec tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] [instance: 84f33d6e-ddf3-4b77-b83d-595c7f75de55] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:12:25.563355 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ec77f5ee-aafb-4d7b-81d0-5cded10b31ec tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:25.565437 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ec77f5ee-aafb-4d7b-81d0-5cded10b31ec tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:25.566489 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ec77f5ee-aafb-4d7b-81d0-5cded10b31ec tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:25.567281 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ec77f5ee-aafb-4d7b-81d0-5cded10b31ec tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:25.568091 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ec77f5ee-aafb-4d7b-81d0-5cded10b31ec tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:25.569120 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ec77f5ee-aafb-4d7b-81d0-5cded10b31ec tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:25.706263 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-7e744728-0d1b-4a68-b5da-844b1c3d50f5 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:12:25.707210 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-7e744728-0d1b-4a68-b5da-844b1c3d50f5 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:12:25.720438 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7e744728-0d1b-4a68-b5da-844b1c3d50f5 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:25.720969 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7e744728-0d1b-4a68-b5da-844b1c3d50f5 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:25.722397 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7e744728-0d1b-4a68-b5da-844b1c3d50f5 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:25.725105 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7e744728-0d1b-4a68-b5da-844b1c3d50f5 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:25.726884 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7e744728-0d1b-4a68-b5da-844b1c3d50f5 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:25.727348 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7e744728-0d1b-4a68-b5da-844b1c3d50f5 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:26.011774 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-7e744728-0d1b-4a68-b5da-844b1c3d50f5 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a78d352c143483c8e4702d789d4c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae02675057e4f27bc1980348afc8ca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:12:26.028758 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-7e744728-0d1b-4a68-b5da-844b1c3d50f5 tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 200 len: 1467 microversion: 2.1 time: 0.326854 Oct 08 21:12:26.029434 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2408/4752] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:12:25 2022] GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 1467 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:12:26.068734 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-ec77f5ee-aafb-4d7b-81d0-5cded10b31ec tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77129c9ce5149748c6bd39c69307f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a53484c6ab4ea4be7acb5ac53acaa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:12:26.078637 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-ec77f5ee-aafb-4d7b-81d0-5cded10b31ec tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] 10.222.0.26 "GET /compute/v2.1/servers/84f33d6e-ddf3-4b77-b83d-595c7f75de55" status: 200 len: 1508 microversion: 2.1 time: 0.527347 Oct 08 21:12:26.094358 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2345/4753] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:12:25 2022] GET /compute/v2.1/servers/84f33d6e-ddf3-4b77-b83d-595c7f75de55 => generated 1508 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:12:26.361176 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-b3e4d89e-7834-4edb-afe8-7f6e8a5a525f req-e4f512c8-5d20-4247-b61c-019f3440382f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2548207-aa57-4e4c-876b-2027b59283d2", "name": "network-vif-deleted", "tag": "1900770b-2820-49c0-af24-1c780eb5f1e0"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:12:26.393344 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-b3e4d89e-7834-4edb-afe8-7f6e8a5a525f req-e4f512c8-5d20-4247-b61c-019f3440382f service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:26.394501 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-b3e4d89e-7834-4edb-afe8-7f6e8a5a525f req-e4f512c8-5d20-4247-b61c-019f3440382f service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:26.397095 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-b3e4d89e-7834-4edb-afe8-7f6e8a5a525f req-e4f512c8-5d20-4247-b61c-019f3440382f service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:26.436436 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-b3e4d89e-7834-4edb-afe8-7f6e8a5a525f req-e4f512c8-5d20-4247-b61c-019f3440382f service nova] Creating event network-vif-deleted:1900770b-2820-49c0-af24-1c780eb5f1e0 for instance e2548207-aa57-4e4c-876b-2027b59283d2 on nch1-master-1 Oct 08 21:12:26.446850 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-b3e4d89e-7834-4edb-afe8-7f6e8a5a525f req-e4f512c8-5d20-4247-b61c-019f3440382f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090172 Oct 08 21:12:26.448151 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2409/4754] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:12:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:12:27.056635 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-1a9de543-16a8-488c-8f89-a26f0c0a555c tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:12:27.057654 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-1a9de543-16a8-488c-8f89-a26f0c0a555c tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] [instance: e2548207-aa57-4e4c-876b-2027b59283d2] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:12:27.066688 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1a9de543-16a8-488c-8f89-a26f0c0a555c tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:27.068160 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1a9de543-16a8-488c-8f89-a26f0c0a555c tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:27.070509 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1a9de543-16a8-488c-8f89-a26f0c0a555c tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:27.071959 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1a9de543-16a8-488c-8f89-a26f0c0a555c tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:27.073061 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1a9de543-16a8-488c-8f89-a26f0c0a555c tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:27.073995 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1a9de543-16a8-488c-8f89-a26f0c0a555c tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:27.089710 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-1a9de543-16a8-488c-8f89-a26f0c0a555c tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] HTTP exception thrown: Instance e2548207-aa57-4e4c-876b-2027b59283d2 could not be found. Oct 08 21:12:27.091903 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-1a9de543-16a8-488c-8f89-a26f0c0a555c tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Request method failure captured: Oct 08 21:12:27.091903 ncdv-master-1 devstack@n-api.service[140491]: request: GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 HTTP/1.1 Oct 08 21:12:27.091903 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:12:27.091903 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:12:27.091903 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:12:27.091903 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 21:12:27.091903 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:12:27.091903 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:12:27.091903 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:12:27.091903 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:12:27.091903 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQebW09Z3m936-d3SrnQA9UQ3KXQvUYeQwL43ufWdoxmQhUwYBWv-JT053t_VYPo9wAVRoCqYQy8Hhh8zc2n570KpS0qNVLik822FjYabkSIZMA_ubWypXzSwo3J04zV1MoSSz79D-b8-ZvwYCEIbwpbfyn5opgOjnO6EXvq1UNPaSyQ Oct 08 21:12:27.091903 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:12:27.091903 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:12:27.091903 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:12:27.091903 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:12:27.091903 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:12:27.091903 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:12:27.091903 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 0ae02675057e4f27bc1980348afc8ca1 Oct 08 21:12:27.091903 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-ServersNegativeTestJSON-1441071354 Oct 08 21:12:27.091903 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:12:27.091903 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:12:27.091903 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0ae02675057e4f27bc1980348afc8ca1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0ae02675057e4f27bc1980348afc8ca1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0ae02675057e4f27bc1980348afc8ca1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0ae02675057e4f27bc1980348afc8ca1"}]}] Oct 08 21:12:27.091903 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-ServersNegativeTestJSON-1441071354 Oct 08 21:12:27.091903 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 0ae02675057e4f27bc1980348afc8ca1 Oct 08 21:12:27.091903 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1441071354 Oct 08 21:12:27.091903 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-ServersNegativeTestJSON-1441071354-project Oct 08 21:12:27.091903 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:12:27.091903 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:12:27.091903 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 6a78d352c143483c8e4702d789d4c516 Oct 08 21:12:27.091903 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-ServersNegativeTestJSON-1441071354-project Oct 08 21:12:27.091903 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:12:27.091903 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance e2548207-aa57-4e4c-876b-2027b59283d2 could not be found. Oct 08 21:12:27.091903 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': 'e2548207-aa57-4e4c-876b-2027b59283d2'} Oct 08 21:12:27.091903 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:12:27.091903 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:12:27.091903 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:12:27.091903 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:12:27.091903 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:12:27.091903 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:12:27.091903 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:12:27.091903 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:12:27.091903 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:12:27.091903 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:12:27.091903 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2548207-aa57-4e4c-876b-2027b59283d2 could not be found. Oct 08 21:12:27.091903 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:12:27.091903 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:12:27.091903 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:12:27.091903 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:12:27.091903 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:12:27.091903 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:12:27.091903 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:12:27.091903 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:12:27.091903 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:12:27.091903 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:12:27.091903 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:12:27.091903 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:12:27.091903 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:12:27.091903 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:12:27.091903 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:12:27.091903 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:12:27.091903 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2548207-aa57-4e4c-876b-2027b59283d2 could not be found. Oct 08 21:12:27.091903 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:12:27.091903 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:12:27.091903 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:12:27.096639 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:12:27.096639 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:12:27.096639 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:12:27.096639 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:12:27.096639 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:12:27.096639 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2548207-aa57-4e4c-876b-2027b59283d2 could not be found. Oct 08 21:12:27.096639 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:12:27.101229 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-1a9de543-16a8-488c-8f89-a26f0c0a555c tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] Returning 404 to user: Instance e2548207-aa57-4e4c-876b-2027b59283d2 could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:12:27.102372 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-1a9de543-16a8-488c-8f89-a26f0c0a555c tempest-ServersNegativeTestJSON-1441071354 tempest-ServersNegativeTestJSON-1441071354-project] 10.222.0.26 "GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2" status: 404 len: 111 microversion: 2.1 time: 0.049885 Oct 08 21:12:27.107722 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2346/4755] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:12:27 2022] GET /compute/v2.1/servers/e2548207-aa57-4e4c-876b-2027b59283d2 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:12:27.124322 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-bd9e5798-501e-4f80-a320-899d2b2e6635 tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:12:27.126014 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-bd9e5798-501e-4f80-a320-899d2b2e6635 tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] [instance: 84f33d6e-ddf3-4b77-b83d-595c7f75de55] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:12:27.138893 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bd9e5798-501e-4f80-a320-899d2b2e6635 tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:27.139929 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bd9e5798-501e-4f80-a320-899d2b2e6635 tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:27.140778 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bd9e5798-501e-4f80-a320-899d2b2e6635 tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:27.142029 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bd9e5798-501e-4f80-a320-899d2b2e6635 tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:27.143108 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bd9e5798-501e-4f80-a320-899d2b2e6635 tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:27.143875 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bd9e5798-501e-4f80-a320-899d2b2e6635 tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:28.357610 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-bd9e5798-501e-4f80-a320-899d2b2e6635 tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77129c9ce5149748c6bd39c69307f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a53484c6ab4ea4be7acb5ac53acaa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:12:28.374729 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-bd9e5798-501e-4f80-a320-899d2b2e6635 tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] 10.222.0.26 "GET /compute/v2.1/servers/84f33d6e-ddf3-4b77-b83d-595c7f75de55" status: 200 len: 1508 microversion: 2.1 time: 1.256578 Oct 08 21:12:28.376180 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2410/4756] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:12:27 2022] GET /compute/v2.1/servers/84f33d6e-ddf3-4b77-b83d-595c7f75de55 => generated 1508 bytes in 1259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:12:29.399770 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-5cb4aea2-1f60-44a1-ae47-7f3fac8ccfad tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:12:29.400528 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-5cb4aea2-1f60-44a1-ae47-7f3fac8ccfad tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] [instance: 84f33d6e-ddf3-4b77-b83d-595c7f75de55] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:12:29.416955 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5cb4aea2-1f60-44a1-ae47-7f3fac8ccfad tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:29.417605 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5cb4aea2-1f60-44a1-ae47-7f3fac8ccfad tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:29.418690 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5cb4aea2-1f60-44a1-ae47-7f3fac8ccfad tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:29.419526 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5cb4aea2-1f60-44a1-ae47-7f3fac8ccfad tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:29.421919 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5cb4aea2-1f60-44a1-ae47-7f3fac8ccfad tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:29.422453 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5cb4aea2-1f60-44a1-ae47-7f3fac8ccfad tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:30.364656 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-d1d65235-e0b1-4a59-b453-44b2a5e788be tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-596656269", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "networks": [{"uuid": "bc8068b6-6237-46ca-a24a-568b2da0ba69"}]}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:12:30.397916 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-5cb4aea2-1f60-44a1-ae47-7f3fac8ccfad tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77129c9ce5149748c6bd39c69307f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a53484c6ab4ea4be7acb5ac53acaa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:12:30.411443 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-5cb4aea2-1f60-44a1-ae47-7f3fac8ccfad tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] 10.222.0.26 "GET /compute/v2.1/servers/84f33d6e-ddf3-4b77-b83d-595c7f75de55" status: 200 len: 1506 microversion: 2.1 time: 1.015574 Oct 08 21:12:30.414025 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2347/4757] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:12:29 2022] GET /compute/v2.1/servers/84f33d6e-ddf3-4b77-b83d-595c7f75de55 => generated 1506 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:12:30.442799 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-b9af2189-069d-4128-8500-b8e5794773f9 tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Calling method '.version_select at 0x7f1a87724940>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:12:30.443379 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-b9af2189-069d-4128-8500-b8e5794773f9 tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] [instance: 84f33d6e-ddf3-4b77-b83d-595c7f75de55] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:12:30.445478 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.network.neutron [None req-d1d65235-e0b1-4a59-b453-44b2a5e788be tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] validate_networks() for [('bc8068b6-6237-46ca-a24a-568b2da0ba69', None, None, None, None, None)] {{(pid=140492) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 21:12:30.454508 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b9af2189-069d-4128-8500-b8e5794773f9 tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:30.471478 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b9af2189-069d-4128-8500-b8e5794773f9 tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:30.472466 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b9af2189-069d-4128-8500-b8e5794773f9 tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:30.473715 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b9af2189-069d-4128-8500-b8e5794773f9 tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:30.483686 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b9af2189-069d-4128-8500-b8e5794773f9 tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:30.484223 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b9af2189-069d-4128-8500-b8e5794773f9 tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:30.566274 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-b9af2189-069d-4128-8500-b8e5794773f9 tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] 10.222.0.26 "GET /compute/v2.1/servers/84f33d6e-ddf3-4b77-b83d-595c7f75de55/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.130135 Oct 08 21:12:30.567641 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2348/4758] 10.222.0.26 () {58 vars in 1296 bytes} [Sat Oct 8 21:12:30 2022] GET /compute/v2.1/servers/84f33d6e-ddf3-4b77-b83d-595c7f75de55/os-instance-actions => generated 611 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:12:30.592352 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-e2b4a59f-6813-4d97-b244-fdf4639f4502 tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:12:30.593535 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-e2b4a59f-6813-4d97-b244-fdf4639f4502 tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] [instance: 84f33d6e-ddf3-4b77-b83d-595c7f75de55] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:12:30.601573 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e2b4a59f-6813-4d97-b244-fdf4639f4502 tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:30.601854 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e2b4a59f-6813-4d97-b244-fdf4639f4502 tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:30.602576 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e2b4a59f-6813-4d97-b244-fdf4639f4502 tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:30.603597 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e2b4a59f-6813-4d97-b244-fdf4639f4502 tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:30.604284 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e2b4a59f-6813-4d97-b244-fdf4639f4502 tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:30.604974 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e2b4a59f-6813-4d97-b244-fdf4639f4502 tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:30.635069 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-e2b4a59f-6813-4d97-b244-fdf4639f4502 tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] [instance: 84f33d6e-ddf3-4b77-b83d-595c7f75de55] Going to try to terminate instance {{(pid=140491) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 21:12:30.776630 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-e2b4a59f-6813-4d97-b244-fdf4639f4502 tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] 10.222.0.26 "DELETE /compute/v2.1/servers/84f33d6e-ddf3-4b77-b83d-595c7f75de55" status: 204 len: 0 microversion: 2.1 time: 0.191958 Oct 08 21:12:30.779725 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2349/4759] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:12:30 2022] DELETE /compute/v2.1/servers/84f33d6e-ddf3-4b77-b83d-595c7f75de55 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 21:12:30.794424 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-6849e02d-25f0-43ae-bc94-4b73ab350c6b tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:12:30.795774 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-6849e02d-25f0-43ae-bc94-4b73ab350c6b tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] [instance: 84f33d6e-ddf3-4b77-b83d-595c7f75de55] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:12:30.803211 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6849e02d-25f0-43ae-bc94-4b73ab350c6b tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:30.803719 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6849e02d-25f0-43ae-bc94-4b73ab350c6b tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:30.804172 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6849e02d-25f0-43ae-bc94-4b73ab350c6b tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:30.804904 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6849e02d-25f0-43ae-bc94-4b73ab350c6b tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:30.805414 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6849e02d-25f0-43ae-bc94-4b73ab350c6b tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:30.805853 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6849e02d-25f0-43ae-bc94-4b73ab350c6b tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:31.100253 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-6849e02d-25f0-43ae-bc94-4b73ab350c6b tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77129c9ce5149748c6bd39c69307f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a53484c6ab4ea4be7acb5ac53acaa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:12:31.111683 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-6849e02d-25f0-43ae-bc94-4b73ab350c6b tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] 10.222.0.26 "GET /compute/v2.1/servers/84f33d6e-ddf3-4b77-b83d-595c7f75de55" status: 200 len: 1512 microversion: 2.1 time: 0.325264 Oct 08 21:12:31.112508 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2350/4760] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:12:30 2022] GET /compute/v2.1/servers/84f33d6e-ddf3-4b77-b83d-595c7f75de55 => generated 1512 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:12:31.994818 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-d1d65235-e0b1-4a59-b453-44b2a5e788be tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Flavor limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 21:12:31.995264 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-d1d65235-e0b1-4a59-b453-44b2a5e788be tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Image limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 21:12:31.995726 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-d1d65235-e0b1-4a59-b453-44b2a5e788be tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Flavor pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 21:12:31.996149 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-d1d65235-e0b1-4a59-b453-44b2a5e788be tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Image pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 21:12:31.996695 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-d1d65235-e0b1-4a59-b453-44b2a5e788be tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 21:12:32.015755 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d1d65235-e0b1-4a59-b453-44b2a5e788be tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:32.016754 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d1d65235-e0b1-4a59-b453-44b2a5e788be tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:32.017465 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d1d65235-e0b1-4a59-b453-44b2a5e788be tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:32.018757 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d1d65235-e0b1-4a59-b453-44b2a5e788be tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:32.022536 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d1d65235-e0b1-4a59-b453-44b2a5e788be tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:32.027164 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d1d65235-e0b1-4a59-b453-44b2a5e788be tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:32.126331 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-d1d65235-e0b1-4a59-b453-44b2a5e788be tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Getting quotas for project d75970c62311417eada44e0270dade81. Resources: {'cores', 'instances', 'ram'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:12:32.127156 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-d1d65235-e0b1-4a59-b453-44b2a5e788be tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Getting quotas for user 71e546b55bd1475782e5863ed50b6f01 and project d75970c62311417eada44e0270dade81. Resources: {'cores', 'instances', 'ram'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:12:32.137092 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-b85084d5-1b52-4dd1-8235-95c9a4b87e57 tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:12:32.137767 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-b85084d5-1b52-4dd1-8235-95c9a4b87e57 tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] [instance: 84f33d6e-ddf3-4b77-b83d-595c7f75de55] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:12:32.154583 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b85084d5-1b52-4dd1-8235-95c9a4b87e57 tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:32.155111 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b85084d5-1b52-4dd1-8235-95c9a4b87e57 tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:32.155647 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b85084d5-1b52-4dd1-8235-95c9a4b87e57 tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:32.156300 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b85084d5-1b52-4dd1-8235-95c9a4b87e57 tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:32.156774 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b85084d5-1b52-4dd1-8235-95c9a4b87e57 tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:32.156885 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-d1d65235-e0b1-4a59-b453-44b2a5e788be tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Going to run 1 instances... {{(pid=140492) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 21:12:32.157246 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b85084d5-1b52-4dd1-8235-95c9a4b87e57 tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:32.159620 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-d1d65235-e0b1-4a59-b453-44b2a5e788be tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] [instance: 8529883c-3fdd-4af4-b295-c17e6c149072] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c508bd7f-7db9-4b2c-af7c-be54a855c355',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140492) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 21:12:32.248539 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-d1d65235-e0b1-4a59-b453-44b2a5e788be tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.051229 Oct 08 21:12:32.256248 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2411/4761] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 21:12:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 2064 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 08 21:12:32.269078 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-975caf9d-3194-4835-9f0f-f3b03f258843 tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:12:32.270451 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-975caf9d-3194-4835-9f0f-f3b03f258843 tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] [instance: 8529883c-3fdd-4af4-b295-c17e6c149072] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:12:32.459347 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-b85084d5-1b52-4dd1-8235-95c9a4b87e57 tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77129c9ce5149748c6bd39c69307f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a53484c6ab4ea4be7acb5ac53acaa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:12:32.503053 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-b85084d5-1b52-4dd1-8235-95c9a4b87e57 tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] 10.222.0.26 "GET /compute/v2.1/servers/84f33d6e-ddf3-4b77-b83d-595c7f75de55" status: 200 len: 1512 microversion: 2.1 time: 0.364213 Oct 08 21:12:32.507837 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2351/4762] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:12:32 2022] GET /compute/v2.1/servers/84f33d6e-ddf3-4b77-b83d-595c7f75de55 => generated 1512 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:12:32.510589 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-975caf9d-3194-4835-9f0f-f3b03f258843 tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e546b55bd1475782e5863ed50b6f01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75970c62311417eada44e0270dade81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:12:32.529865 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-975caf9d-3194-4835-9f0f-f3b03f258843 tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] 10.222.0.26 "GET /compute/v2.1/servers/8529883c-3fdd-4af4-b295-c17e6c149072" status: 200 len: 1213 microversion: 2.1 time: 0.265172 Oct 08 21:12:32.532047 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2412/4763] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:12:32 2022] GET /compute/v2.1/servers/8529883c-3fdd-4af4-b295-c17e6c149072 => generated 1213 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:12:33.530565 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c48aa983-f273-4d90-94f7-53f026e13236 tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:12:33.531799 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-c48aa983-f273-4d90-94f7-53f026e13236 tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] [instance: 84f33d6e-ddf3-4b77-b83d-595c7f75de55] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:12:33.554708 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c48aa983-f273-4d90-94f7-53f026e13236 tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:33.556795 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c48aa983-f273-4d90-94f7-53f026e13236 tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:33.557619 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c48aa983-f273-4d90-94f7-53f026e13236 tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:33.558609 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c48aa983-f273-4d90-94f7-53f026e13236 tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:33.559309 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c48aa983-f273-4d90-94f7-53f026e13236 tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:33.559959 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c48aa983-f273-4d90-94f7-53f026e13236 tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:33.563878 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-6c176a50-2cca-4c73-a6aa-53900640afbe tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:12:33.566330 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-6c176a50-2cca-4c73-a6aa-53900640afbe tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] [instance: 8529883c-3fdd-4af4-b295-c17e6c149072] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:12:33.576735 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6c176a50-2cca-4c73-a6aa-53900640afbe tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:33.577325 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6c176a50-2cca-4c73-a6aa-53900640afbe tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:33.578206 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6c176a50-2cca-4c73-a6aa-53900640afbe tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:33.579306 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6c176a50-2cca-4c73-a6aa-53900640afbe tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:33.580171 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6c176a50-2cca-4c73-a6aa-53900640afbe tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:33.581445 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6c176a50-2cca-4c73-a6aa-53900640afbe tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:33.589245 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:12:33.792736 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-c48aa983-f273-4d90-94f7-53f026e13236 tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77129c9ce5149748c6bd39c69307f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a53484c6ab4ea4be7acb5ac53acaa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:12:33.805632 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-c48aa983-f273-4d90-94f7-53f026e13236 tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] 10.222.0.26 "GET /compute/v2.1/servers/84f33d6e-ddf3-4b77-b83d-595c7f75de55" status: 200 len: 1512 microversion: 2.1 time: 0.278803 Oct 08 21:12:33.807340 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2352/4764] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:12:33 2022] GET /compute/v2.1/servers/84f33d6e-ddf3-4b77-b83d-595c7f75de55 => generated 1512 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:12:33.847810 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-6c176a50-2cca-4c73-a6aa-53900640afbe tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e546b55bd1475782e5863ed50b6f01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75970c62311417eada44e0270dade81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:12:33.872916 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-6c176a50-2cca-4c73-a6aa-53900640afbe tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] 10.222.0.26 "GET /compute/v2.1/servers/8529883c-3fdd-4af4-b295-c17e6c149072" status: 200 len: 1265 microversion: 2.1 time: 0.316219 Oct 08 21:12:33.885241 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2413/4765] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:12:33 2022] GET /compute/v2.1/servers/8529883c-3fdd-4af4-b295-c17e6c149072 => generated 1265 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:12:34.831118 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-a066443d-a51c-4ded-8d21-a65c768ce419 tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:12:34.833432 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-a066443d-a51c-4ded-8d21-a65c768ce419 tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] [instance: 84f33d6e-ddf3-4b77-b83d-595c7f75de55] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:12:34.841756 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a066443d-a51c-4ded-8d21-a65c768ce419 tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:34.842592 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a066443d-a51c-4ded-8d21-a65c768ce419 tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:34.843276 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a066443d-a51c-4ded-8d21-a65c768ce419 tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:34.844219 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a066443d-a51c-4ded-8d21-a65c768ce419 tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:34.844894 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a066443d-a51c-4ded-8d21-a65c768ce419 tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:34.845576 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a066443d-a51c-4ded-8d21-a65c768ce419 tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:34.900222 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-0229c6ac-4c26-48d4-9e95-9b874f5ca02d tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:12:34.901688 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-0229c6ac-4c26-48d4-9e95-9b874f5ca02d tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] [instance: 8529883c-3fdd-4af4-b295-c17e6c149072] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:12:34.912819 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0229c6ac-4c26-48d4-9e95-9b874f5ca02d tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:34.914239 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0229c6ac-4c26-48d4-9e95-9b874f5ca02d tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:34.915020 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0229c6ac-4c26-48d4-9e95-9b874f5ca02d tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:34.916114 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0229c6ac-4c26-48d4-9e95-9b874f5ca02d tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:34.917255 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0229c6ac-4c26-48d4-9e95-9b874f5ca02d tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:34.918185 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0229c6ac-4c26-48d4-9e95-9b874f5ca02d tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:35.242284 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-0229c6ac-4c26-48d4-9e95-9b874f5ca02d tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e546b55bd1475782e5863ed50b6f01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75970c62311417eada44e0270dade81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:12:35.258378 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-0229c6ac-4c26-48d4-9e95-9b874f5ca02d tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] 10.222.0.26 "GET /compute/v2.1/servers/8529883c-3fdd-4af4-b295-c17e6c149072" status: 200 len: 1271 microversion: 2.1 time: 0.362286 Oct 08 21:12:35.259240 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2414/4766] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:12:34 2022] GET /compute/v2.1/servers/8529883c-3fdd-4af4-b295-c17e6c149072 => generated 1271 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:12:35.278617 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-4dc21266-6388-4994-95a9-e4d5b5deb418 req-02f8fb6e-dcd8-49bf-a7a6-18c64b660cdc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84f33d6e-ddf3-4b77-b83d-595c7f75de55", "name": "network-vif-deleted", "tag": "4dafcfde-8e70-4b8a-9a65-16bcd9c3e23d"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:12:35.291480 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-4dc21266-6388-4994-95a9-e4d5b5deb418 req-02f8fb6e-dcd8-49bf-a7a6-18c64b660cdc service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:35.292213 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-4dc21266-6388-4994-95a9-e4d5b5deb418 req-02f8fb6e-dcd8-49bf-a7a6-18c64b660cdc service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:35.292843 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-4dc21266-6388-4994-95a9-e4d5b5deb418 req-02f8fb6e-dcd8-49bf-a7a6-18c64b660cdc service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:35.306829 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-a066443d-a51c-4ded-8d21-a65c768ce419 tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77129c9ce5149748c6bd39c69307f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a53484c6ab4ea4be7acb5ac53acaa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:12:35.311508 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-4dc21266-6388-4994-95a9-e4d5b5deb418 req-02f8fb6e-dcd8-49bf-a7a6-18c64b660cdc service nova] Creating event network-vif-deleted:4dafcfde-8e70-4b8a-9a65-16bcd9c3e23d for instance 84f33d6e-ddf3-4b77-b83d-595c7f75de55 on nch2-master-1 Oct 08 21:12:35.316298 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-a066443d-a51c-4ded-8d21-a65c768ce419 tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] 10.222.0.26 "GET /compute/v2.1/servers/84f33d6e-ddf3-4b77-b83d-595c7f75de55" status: 200 len: 1470 microversion: 2.1 time: 0.488961 Oct 08 21:12:35.317226 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-4dc21266-6388-4994-95a9-e4d5b5deb418 req-02f8fb6e-dcd8-49bf-a7a6-18c64b660cdc service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055963 Oct 08 21:12:35.318115 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2415/4767] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:12:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:12:35.319833 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2353/4768] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:12:34 2022] GET /compute/v2.1/servers/84f33d6e-ddf3-4b77-b83d-595c7f75de55 => generated 1470 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:12:36.285761 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-327d96a8-1bf4-4a96-8ec1-a9d957579cd1 tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:12:36.287860 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-327d96a8-1bf4-4a96-8ec1-a9d957579cd1 tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] [instance: 8529883c-3fdd-4af4-b295-c17e6c149072] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:12:36.304688 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-327d96a8-1bf4-4a96-8ec1-a9d957579cd1 tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:36.305239 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-327d96a8-1bf4-4a96-8ec1-a9d957579cd1 tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:36.305987 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-327d96a8-1bf4-4a96-8ec1-a9d957579cd1 tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:36.306845 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-327d96a8-1bf4-4a96-8ec1-a9d957579cd1 tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:36.307471 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-327d96a8-1bf4-4a96-8ec1-a9d957579cd1 tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:36.307923 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-327d96a8-1bf4-4a96-8ec1-a9d957579cd1 tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:36.344371 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-46bbf57d-eba5-4871-bc6f-5c8f6ba4c34f tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:12:36.345592 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-46bbf57d-eba5-4871-bc6f-5c8f6ba4c34f tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] [instance: 84f33d6e-ddf3-4b77-b83d-595c7f75de55] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:12:36.357104 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-46bbf57d-eba5-4871-bc6f-5c8f6ba4c34f tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:36.357909 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-46bbf57d-eba5-4871-bc6f-5c8f6ba4c34f tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:36.360050 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-46bbf57d-eba5-4871-bc6f-5c8f6ba4c34f tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:36.361327 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-46bbf57d-eba5-4871-bc6f-5c8f6ba4c34f tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:36.363272 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-46bbf57d-eba5-4871-bc6f-5c8f6ba4c34f tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:36.364120 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-46bbf57d-eba5-4871-bc6f-5c8f6ba4c34f tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:36.390071 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-46bbf57d-eba5-4871-bc6f-5c8f6ba4c34f tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] HTTP exception thrown: Instance 84f33d6e-ddf3-4b77-b83d-595c7f75de55 could not be found. Oct 08 21:12:36.391942 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-46bbf57d-eba5-4871-bc6f-5c8f6ba4c34f tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Request method failure captured: Oct 08 21:12:36.391942 ncdv-master-1 devstack@n-api.service[140491]: request: GET /compute/v2.1/servers/84f33d6e-ddf3-4b77-b83d-595c7f75de55 HTTP/1.1 Oct 08 21:12:36.391942 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:12:36.391942 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:12:36.391942 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:12:36.391942 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 21:12:36.391942 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:12:36.391942 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:12:36.391942 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:12:36.391942 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:12:36.391942 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeeiGZ1l4svd96eqxBD-DSEpVs2YE4QuAtQkgGYFfyONf-pjmg34Mm5zuYxnZd_24e3YTZKs36XPhkYd8EdIcnl1E0eIz8afthOnEzDDT6DzTJUGkO1Z_3iENc4_cZAGpenxXkkFcgSzwVj35tAhzjXoePqNjqpK85tAcTxYH4RpcEg Oct 08 21:12:36.391942 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:12:36.391942 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:12:36.391942 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:12:36.391942 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:12:36.391942 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:12:36.391942 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:12:36.391942 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: b0a53484c6ab4ea4be7acb5ac53acaa0 Oct 08 21:12:36.391942 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-InstanceActionsTestJSON-240921837 Oct 08 21:12:36.391942 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:12:36.391942 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:12:36.391942 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b0a53484c6ab4ea4be7acb5ac53acaa0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b0a53484c6ab4ea4be7acb5ac53acaa0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b0a53484c6ab4ea4be7acb5ac53acaa0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b0a53484c6ab4ea4be7acb5ac53acaa0"}]}] Oct 08 21:12:36.391942 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-InstanceActionsTestJSON-240921837 Oct 08 21:12:36.391942 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: b0a53484c6ab4ea4be7acb5ac53acaa0 Oct 08 21:12:36.391942 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-InstanceActionsTestJSON-240921837 Oct 08 21:12:36.391942 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-InstanceActionsTestJSON-240921837-project Oct 08 21:12:36.391942 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:12:36.391942 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:12:36.391942 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: f77129c9ce5149748c6bd39c69307f76 Oct 08 21:12:36.391942 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-InstanceActionsTestJSON-240921837-project Oct 08 21:12:36.391942 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:12:36.391942 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance 84f33d6e-ddf3-4b77-b83d-595c7f75de55 could not be found. Oct 08 21:12:36.391942 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': '84f33d6e-ddf3-4b77-b83d-595c7f75de55'} Oct 08 21:12:36.391942 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:12:36.391942 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:12:36.391942 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:12:36.391942 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:12:36.391942 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:12:36.391942 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:12:36.391942 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:12:36.391942 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:12:36.391942 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:12:36.391942 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:12:36.391942 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84f33d6e-ddf3-4b77-b83d-595c7f75de55 could not be found. Oct 08 21:12:36.391942 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:12:36.391942 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:12:36.391942 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:12:36.391942 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:12:36.391942 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:12:36.391942 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:12:36.391942 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:12:36.391942 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:12:36.391942 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:12:36.391942 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:12:36.391942 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:12:36.391942 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:12:36.391942 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:12:36.391942 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:12:36.391942 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:12:36.391942 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:12:36.391942 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84f33d6e-ddf3-4b77-b83d-595c7f75de55 could not be found. Oct 08 21:12:36.391942 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:12:36.391942 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:12:36.391942 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:12:36.398298 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:12:36.398298 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:12:36.398298 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:12:36.398298 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:12:36.398298 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:12:36.398298 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84f33d6e-ddf3-4b77-b83d-595c7f75de55 could not be found. Oct 08 21:12:36.398298 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:12:36.398298 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-46bbf57d-eba5-4871-bc6f-5c8f6ba4c34f tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] Returning 404 to user: Instance 84f33d6e-ddf3-4b77-b83d-595c7f75de55 could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:12:36.399984 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-46bbf57d-eba5-4871-bc6f-5c8f6ba4c34f tempest-InstanceActionsTestJSON-240921837 tempest-InstanceActionsTestJSON-240921837-project] 10.222.0.26 "GET /compute/v2.1/servers/84f33d6e-ddf3-4b77-b83d-595c7f75de55" status: 404 len: 111 microversion: 2.1 time: 0.061078 Oct 08 21:12:36.406124 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2354/4769] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:12:36 2022] GET /compute/v2.1/servers/84f33d6e-ddf3-4b77-b83d-595c7f75de55 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 08 21:12:37.402490 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-327d96a8-1bf4-4a96-8ec1-a9d957579cd1 tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e546b55bd1475782e5863ed50b6f01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75970c62311417eada44e0270dade81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:12:37.414724 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-327d96a8-1bf4-4a96-8ec1-a9d957579cd1 tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] 10.222.0.26 "GET /compute/v2.1/servers/8529883c-3fdd-4af4-b295-c17e6c149072" status: 200 len: 1313 microversion: 2.1 time: 1.134995 Oct 08 21:12:37.416023 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2416/4770] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:12:36 2022] GET /compute/v2.1/servers/8529883c-3fdd-4af4-b295-c17e6c149072 => generated 1313 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:12:38.438577 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-e27b9215-849f-4f36-8119-cb7ae65999f2 tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:12:38.439206 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-e27b9215-849f-4f36-8119-cb7ae65999f2 tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] [instance: 8529883c-3fdd-4af4-b295-c17e6c149072] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:12:38.455503 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e27b9215-849f-4f36-8119-cb7ae65999f2 tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:38.456580 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e27b9215-849f-4f36-8119-cb7ae65999f2 tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:38.457299 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e27b9215-849f-4f36-8119-cb7ae65999f2 tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:38.459523 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e27b9215-849f-4f36-8119-cb7ae65999f2 tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:38.460277 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e27b9215-849f-4f36-8119-cb7ae65999f2 tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:38.460970 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e27b9215-849f-4f36-8119-cb7ae65999f2 tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:39.055733 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-e27b9215-849f-4f36-8119-cb7ae65999f2 tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e546b55bd1475782e5863ed50b6f01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75970c62311417eada44e0270dade81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:12:39.084840 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-e27b9215-849f-4f36-8119-cb7ae65999f2 tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] 10.222.0.26 "GET /compute/v2.1/servers/8529883c-3fdd-4af4-b295-c17e6c149072" status: 200 len: 1313 microversion: 2.1 time: 0.649977 Oct 08 21:12:39.085469 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2355/4771] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:12:38 2022] GET /compute/v2.1/servers/8529883c-3fdd-4af4-b295-c17e6c149072 => generated 1313 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:12:40.110279 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-09d660b6-b644-4126-88a2-fae988ebbdff tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:12:40.110896 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-09d660b6-b644-4126-88a2-fae988ebbdff tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] [instance: 8529883c-3fdd-4af4-b295-c17e6c149072] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:12:40.118571 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-78c587c4-871d-422c-8dca-0fb4afa44544 req-17193da4-5bdb-4743-b6d0-307e4f22037d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8529883c-3fdd-4af4-b295-c17e6c149072", "tag": "1077a95f-c117-4933-b297-0e53fb85cadf"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:12:40.123096 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-09d660b6-b644-4126-88a2-fae988ebbdff tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:40.126884 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-09d660b6-b644-4126-88a2-fae988ebbdff tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:40.130379 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-09d660b6-b644-4126-88a2-fae988ebbdff tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:40.132454 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-09d660b6-b644-4126-88a2-fae988ebbdff tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:40.132937 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-09d660b6-b644-4126-88a2-fae988ebbdff tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:40.142410 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-09d660b6-b644-4126-88a2-fae988ebbdff tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:40.157523 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-78c587c4-871d-422c-8dca-0fb4afa44544 req-17193da4-5bdb-4743-b6d0-307e4f22037d service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:40.158014 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-78c587c4-871d-422c-8dca-0fb4afa44544 req-17193da4-5bdb-4743-b6d0-307e4f22037d service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:40.158665 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-78c587c4-871d-422c-8dca-0fb4afa44544 req-17193da4-5bdb-4743-b6d0-307e4f22037d service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:40.182707 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-78c587c4-871d-422c-8dca-0fb4afa44544 req-17193da4-5bdb-4743-b6d0-307e4f22037d service nova] Creating event network-changed:1077a95f-c117-4933-b297-0e53fb85cadf for instance 8529883c-3fdd-4af4-b295-c17e6c149072 on nch1-master-1 Oct 08 21:12:40.189507 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-78c587c4-871d-422c-8dca-0fb4afa44544 req-17193da4-5bdb-4743-b6d0-307e4f22037d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074336 Oct 08 21:12:40.190530 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2356/4772] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:12:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 08 21:12:41.257959 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-09d660b6-b644-4126-88a2-fae988ebbdff tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e546b55bd1475782e5863ed50b6f01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75970c62311417eada44e0270dade81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:12:41.278426 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-09d660b6-b644-4126-88a2-fae988ebbdff tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] 10.222.0.26 "GET /compute/v2.1/servers/8529883c-3fdd-4af4-b295-c17e6c149072" status: 200 len: 1313 microversion: 2.1 time: 1.172057 Oct 08 21:12:41.279048 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2417/4773] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:12:40 2022] GET /compute/v2.1/servers/8529883c-3fdd-4af4-b295-c17e6c149072 => generated 1313 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:12:42.305097 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-045fcbc5-aac4-406a-9d65-4585fad84354 tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:12:42.305847 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-045fcbc5-aac4-406a-9d65-4585fad84354 tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] [instance: 8529883c-3fdd-4af4-b295-c17e6c149072] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:12:42.324400 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-045fcbc5-aac4-406a-9d65-4585fad84354 tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:42.324919 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-045fcbc5-aac4-406a-9d65-4585fad84354 tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:42.325406 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-045fcbc5-aac4-406a-9d65-4585fad84354 tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:42.336780 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-045fcbc5-aac4-406a-9d65-4585fad84354 tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:42.337365 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-045fcbc5-aac4-406a-9d65-4585fad84354 tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:42.337829 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-045fcbc5-aac4-406a-9d65-4585fad84354 tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:43.248596 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-045fcbc5-aac4-406a-9d65-4585fad84354 tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e546b55bd1475782e5863ed50b6f01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75970c62311417eada44e0270dade81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:12:43.260925 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-045fcbc5-aac4-406a-9d65-4585fad84354 tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] 10.222.0.26 "GET /compute/v2.1/servers/8529883c-3fdd-4af4-b295-c17e6c149072" status: 200 len: 1313 microversion: 2.1 time: 0.958579 Oct 08 21:12:43.262113 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2357/4774] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:12:42 2022] GET /compute/v2.1/servers/8529883c-3fdd-4af4-b295-c17e6c149072 => generated 1313 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:12:44.284266 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-5ca794d7-092d-4992-9ae0-1b10ffcbd18a tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:12:44.284913 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-5ca794d7-092d-4992-9ae0-1b10ffcbd18a tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] [instance: 8529883c-3fdd-4af4-b295-c17e6c149072] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:12:44.290856 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=2 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:12:44.295210 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=8 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:12:44.304154 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5ca794d7-092d-4992-9ae0-1b10ffcbd18a tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:44.304663 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5ca794d7-092d-4992-9ae0-1b10ffcbd18a tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:44.305109 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5ca794d7-092d-4992-9ae0-1b10ffcbd18a tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:44.314715 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5ca794d7-092d-4992-9ae0-1b10ffcbd18a tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:44.314715 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5ca794d7-092d-4992-9ae0-1b10ffcbd18a tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:44.315764 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5ca794d7-092d-4992-9ae0-1b10ffcbd18a tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:44.861022 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-5ca794d7-092d-4992-9ae0-1b10ffcbd18a tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e546b55bd1475782e5863ed50b6f01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75970c62311417eada44e0270dade81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:12:44.873080 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-5ca794d7-092d-4992-9ae0-1b10ffcbd18a tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] 10.222.0.26 "GET /compute/v2.1/servers/8529883c-3fdd-4af4-b295-c17e6c149072" status: 200 len: 1313 microversion: 2.1 time: 0.592568 Oct 08 21:12:44.874487 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2418/4775] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:12:44 2022] GET /compute/v2.1/servers/8529883c-3fdd-4af4-b295-c17e6c149072 => generated 1313 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:12:45.913277 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-eaebeb37-69d9-4561-9568-5fae9984199e tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:12:45.917028 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-eaebeb37-69d9-4561-9568-5fae9984199e tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] [instance: 8529883c-3fdd-4af4-b295-c17e6c149072] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:12:45.927199 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:12:45.930317 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-eaebeb37-69d9-4561-9568-5fae9984199e tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:45.931619 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-eaebeb37-69d9-4561-9568-5fae9984199e tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:45.932308 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-eaebeb37-69d9-4561-9568-5fae9984199e tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:45.933232 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-eaebeb37-69d9-4561-9568-5fae9984199e tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:45.933937 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-eaebeb37-69d9-4561-9568-5fae9984199e tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:45.934573 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-eaebeb37-69d9-4561-9568-5fae9984199e tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:46.427515 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-eaebeb37-69d9-4561-9568-5fae9984199e tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e546b55bd1475782e5863ed50b6f01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75970c62311417eada44e0270dade81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:12:46.432560 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:12:46.447799 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-eaebeb37-69d9-4561-9568-5fae9984199e tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] 10.222.0.26 "GET /compute/v2.1/servers/8529883c-3fdd-4af4-b295-c17e6c149072" status: 200 len: 1313 microversion: 2.1 time: 0.549052 Oct 08 21:12:46.449989 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2358/4776] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:12:45 2022] GET /compute/v2.1/servers/8529883c-3fdd-4af4-b295-c17e6c149072 => generated 1313 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:12:47.479858 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e60de581-3b96-423d-b052-3bbbaf06bae4 tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:12:47.482642 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-e60de581-3b96-423d-b052-3bbbaf06bae4 tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] [instance: 8529883c-3fdd-4af4-b295-c17e6c149072] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:12:47.502344 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e60de581-3b96-423d-b052-3bbbaf06bae4 tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:47.503281 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e60de581-3b96-423d-b052-3bbbaf06bae4 tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:47.504054 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e60de581-3b96-423d-b052-3bbbaf06bae4 tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:47.506041 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e60de581-3b96-423d-b052-3bbbaf06bae4 tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:47.514073 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e60de581-3b96-423d-b052-3bbbaf06bae4 tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:47.518222 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e60de581-3b96-423d-b052-3bbbaf06bae4 tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:48.275602 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-e60de581-3b96-423d-b052-3bbbaf06bae4 tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e546b55bd1475782e5863ed50b6f01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75970c62311417eada44e0270dade81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:12:48.284861 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-e60de581-3b96-423d-b052-3bbbaf06bae4 tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] 10.222.0.26 "GET /compute/v2.1/servers/8529883c-3fdd-4af4-b295-c17e6c149072" status: 200 len: 1313 microversion: 2.1 time: 0.813443 Oct 08 21:12:48.289777 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2419/4777] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:12:47 2022] GET /compute/v2.1/servers/8529883c-3fdd-4af4-b295-c17e6c149072 => generated 1313 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:12:49.317427 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-0280995e-3633-4196-8730-f93089085f8e tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:12:49.319323 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-0280995e-3633-4196-8730-f93089085f8e tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] [instance: 8529883c-3fdd-4af4-b295-c17e6c149072] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:12:49.337010 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0280995e-3633-4196-8730-f93089085f8e tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:49.338122 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0280995e-3633-4196-8730-f93089085f8e tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:49.339265 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0280995e-3633-4196-8730-f93089085f8e tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:49.340727 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0280995e-3633-4196-8730-f93089085f8e tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:49.341531 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0280995e-3633-4196-8730-f93089085f8e tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:49.343243 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0280995e-3633-4196-8730-f93089085f8e tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:49.908397 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-0280995e-3633-4196-8730-f93089085f8e tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e546b55bd1475782e5863ed50b6f01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75970c62311417eada44e0270dade81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:12:49.922224 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-0280995e-3633-4196-8730-f93089085f8e tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] 10.222.0.26 "GET /compute/v2.1/servers/8529883c-3fdd-4af4-b295-c17e6c149072" status: 200 len: 1313 microversion: 2.1 time: 0.607787 Oct 08 21:12:49.938149 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2359/4778] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:12:49 2022] GET /compute/v2.1/servers/8529883c-3fdd-4af4-b295-c17e6c149072 => generated 1313 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:12:50.952961 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c3859777-4848-4293-b38b-557d7f1fab07 tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:12:50.953621 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-c3859777-4848-4293-b38b-557d7f1fab07 tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] [instance: 8529883c-3fdd-4af4-b295-c17e6c149072] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:12:50.963634 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c3859777-4848-4293-b38b-557d7f1fab07 tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:50.967729 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c3859777-4848-4293-b38b-557d7f1fab07 tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:50.968414 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c3859777-4848-4293-b38b-557d7f1fab07 tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:50.969468 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c3859777-4848-4293-b38b-557d7f1fab07 tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:50.970106 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c3859777-4848-4293-b38b-557d7f1fab07 tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:50.972295 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c3859777-4848-4293-b38b-557d7f1fab07 tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:51.024177 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-b7459296-13ac-40b4-b3dc-815f5683ecb6 req-a78855d1-5ead-4576-9557-30a7000a37a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8529883c-3fdd-4af4-b295-c17e6c149072", "name": "network-vif-plugged", "status": "completed", "tag": "1077a95f-c117-4933-b297-0e53fb85cadf"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:12:51.033583 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:12:51.057548 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-b7459296-13ac-40b4-b3dc-815f5683ecb6 req-a78855d1-5ead-4576-9557-30a7000a37a9 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:51.058047 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-b7459296-13ac-40b4-b3dc-815f5683ecb6 req-a78855d1-5ead-4576-9557-30a7000a37a9 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:51.058424 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-b7459296-13ac-40b4-b3dc-815f5683ecb6 req-a78855d1-5ead-4576-9557-30a7000a37a9 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:51.102745 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-b7459296-13ac-40b4-b3dc-815f5683ecb6 req-a78855d1-5ead-4576-9557-30a7000a37a9 service nova] Creating event network-vif-plugged:1077a95f-c117-4933-b297-0e53fb85cadf for instance 8529883c-3fdd-4af4-b295-c17e6c149072 on nch1-master-1 Oct 08 21:12:51.117975 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-b7459296-13ac-40b4-b3dc-815f5683ecb6 req-a78855d1-5ead-4576-9557-30a7000a37a9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.610295 Oct 08 21:12:51.119291 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2420/4779] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:12:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:12:51.715380 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-c3859777-4848-4293-b38b-557d7f1fab07 tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e546b55bd1475782e5863ed50b6f01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75970c62311417eada44e0270dade81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:12:51.728995 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-c3859777-4848-4293-b38b-557d7f1fab07 tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] 10.222.0.26 "GET /compute/v2.1/servers/8529883c-3fdd-4af4-b295-c17e6c149072" status: 200 len: 1313 microversion: 2.1 time: 0.779999 Oct 08 21:12:51.737650 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2360/4780] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:12:50 2022] GET /compute/v2.1/servers/8529883c-3fdd-4af4-b295-c17e6c149072 => generated 1313 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:12:52.314111 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-309356dc-0594-452c-ac8f-32fc7ce65a49 tempest-VolumesNegativeTest-1559607197 tempest-VolumesNegativeTest-1559607197-project] Action: 'create', calling method: .version_select at 0x7f1a8c20f9d0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-780749799", "metadata": {"Type": "work"}}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:12:52.318274 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-309356dc-0594-452c-ac8f-32fc7ce65a49 tempest-VolumesNegativeTest-1559607197 tempest-VolumesNegativeTest-1559607197-project] Request method failure captured: Oct 08 21:12:52.318274 ncdv-master-1 devstack@n-api.service[140492]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 08 21:12:52.318274 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:12:52.318274 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:12:52.318274 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:12:52.318274 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 121 Oct 08 21:12:52.318274 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:12:52.318274 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:12:52.318274 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:12:52.318274 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:12:52.318274 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQefTHAAJuAykFTUg5ADHGTq1wOVxe9JKL8IiBlkrbjDArzHuBo3sxvMkOWf-vgLBGk8J8AY_ra7-w30d_j_yVjr4sQf_QFeTJCt6iv3xEOiVk1XPOWsVTxP1tuP8N4QiTfWdwSMuLSvkl7KWvJmwFlLoQNCT5sA-bCTpQrEmaXCjhok Oct 08 21:12:52.318274 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:12:52.318274 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:12:52.318274 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:12:52.318274 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:12:52.318274 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:12:52.318274 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:12:52.318274 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 3b59e98c081f4f04a1589910813079f9 Oct 08 21:12:52.318274 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-VolumesNegativeTest-1559607197 Oct 08 21:12:52.318274 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:12:52.318274 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:12:52.318274 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3b59e98c081f4f04a1589910813079f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3b59e98c081f4f04a1589910813079f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3b59e98c081f4f04a1589910813079f9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3b59e98c081f4f04a1589910813079f9"}]}] Oct 08 21:12:52.318274 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-VolumesNegativeTest-1559607197 Oct 08 21:12:52.318274 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 3b59e98c081f4f04a1589910813079f9 Oct 08 21:12:52.318274 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-VolumesNegativeTest-1559607197 Oct 08 21:12:52.318274 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-VolumesNegativeTest-1559607197-project Oct 08 21:12:52.318274 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:12:52.318274 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:12:52.318274 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: f8a400a004b849798b5b87853f6f5327 Oct 08 21:12:52.318274 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-VolumesNegativeTest-1559607197-project Oct 08 21:12:52.318274 ncdv-master-1 devstack@n-api.service[140492]: Oct 08 21:12:52.318274 ncdv-master-1 devstack@n-api.service[140492]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-780749799", "metadata": {"Type": "work"}}} Oct 08 21:12:52.318274 ncdv-master-1 devstack@n-api.service[140492]: method: Oct 08 21:12:52.318274 ncdv-master-1 devstack@n-api.service[140492]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 08 21:12:52.318274 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-780749799', 'metadata': {'Type': 'work'}}}} Oct 08 21:12:52.318274 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:12:52.318274 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:12:52.318274 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 08 21:12:52.318274 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 08 21:12:52.318274 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 08 21:12:52.318274 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise error Oct 08 21:12:52.318274 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Oct 08 21:12:52.318274 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:12:52.318274 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 08 21:12:52.318274 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 08 21:12:52.318274 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:12:52.318274 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 08 21:12:52.318274 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi '#$%' Oct 08 21:12:52.318274 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:12:52.318274 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:12:52.318274 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:12:52.318274 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:12:52.318274 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:12:52.318274 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:12:52.318274 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:12:52.318274 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:12:52.318274 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 08 21:12:52.318274 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 08 21:12:52.318274 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:12:52.318274 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:12:52.318274 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 08 21:12:52.318274 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 08 21:12:52.318274 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 08 21:12:52.318274 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 08 21:12:52.318274 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 08 21:12:52.318274 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 08 21:12:52.322789 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 08 21:12:52.322789 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:12:52.322789 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:12:52.322789 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:12:52.322789 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:12:52.322789 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:12:52.322789 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:12:52.322789 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 08 21:12:52.322789 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 08 21:12:52.322789 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 08 21:12:52.322789 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:12:52.325361 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-309356dc-0594-452c-ac8f-32fc7ce65a49 tempest-VolumesNegativeTest-1559607197 tempest-VolumesNegativeTest-1559607197-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:12:52.326525 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-309356dc-0594-452c-ac8f-32fc7ce65a49 tempest-VolumesNegativeTest-1559607197 tempest-VolumesNegativeTest-1559607197-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.287891 Oct 08 21:12:52.330148 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2421/4781] 10.222.0.26 () {60 vars in 1156 bytes} [Sat Oct 8 21:12:52 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 292 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 08 21:12:52.341425 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-2c298b6b-1ba3-40c5-aad0-f99618640940 tempest-VolumesNegativeTest-1559607197 tempest-VolumesNegativeTest-1559607197-project] Action: 'create', calling method: .version_select at 0x7f1a8766e040>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1103981728", "metadata": {"Type": "work"}}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:12:52.345479 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-2c298b6b-1ba3-40c5-aad0-f99618640940 tempest-VolumesNegativeTest-1559607197 tempest-VolumesNegativeTest-1559607197-project] Request method failure captured: Oct 08 21:12:52.345479 ncdv-master-1 devstack@n-api.service[140491]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 08 21:12:52.345479 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:12:52.345479 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:12:52.345479 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:12:52.345479 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 120 Oct 08 21:12:52.345479 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:12:52.345479 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:12:52.345479 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:12:52.345479 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:12:52.345479 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQefTHAAJuAykFTUg5ADHGTq1wOVxe9JKL8IiBlkrbjDArzHuBo3sxvMkOWf-vgLBGk8J8AY_ra7-w30d_j_yVjr4sQf_QFeTJCt6iv3xEOiVk1XPOWsVTxP1tuP8N4QiTfWdwSMuLSvkl7KWvJmwFlLoQNCT5sA-bCTpQrEmaXCjhok Oct 08 21:12:52.345479 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:12:52.345479 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:12:52.345479 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:12:52.345479 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:12:52.345479 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:12:52.345479 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:12:52.345479 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 3b59e98c081f4f04a1589910813079f9 Oct 08 21:12:52.345479 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-VolumesNegativeTest-1559607197 Oct 08 21:12:52.345479 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:12:52.345479 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:12:52.345479 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3b59e98c081f4f04a1589910813079f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3b59e98c081f4f04a1589910813079f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3b59e98c081f4f04a1589910813079f9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3b59e98c081f4f04a1589910813079f9"}]}] Oct 08 21:12:52.345479 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-VolumesNegativeTest-1559607197 Oct 08 21:12:52.345479 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 3b59e98c081f4f04a1589910813079f9 Oct 08 21:12:52.345479 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-VolumesNegativeTest-1559607197 Oct 08 21:12:52.345479 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-VolumesNegativeTest-1559607197-project Oct 08 21:12:52.345479 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:12:52.345479 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:12:52.345479 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: f8a400a004b849798b5b87853f6f5327 Oct 08 21:12:52.345479 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-VolumesNegativeTest-1559607197-project Oct 08 21:12:52.345479 ncdv-master-1 devstack@n-api.service[140491]: Oct 08 21:12:52.345479 ncdv-master-1 devstack@n-api.service[140491]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1103981728", "metadata": {"Type": "work"}}} Oct 08 21:12:52.345479 ncdv-master-1 devstack@n-api.service[140491]: method: Oct 08 21:12:52.345479 ncdv-master-1 devstack@n-api.service[140491]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 08 21:12:52.345479 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1103981728', 'metadata': {'Type': 'work'}}}} Oct 08 21:12:52.345479 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:12:52.345479 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:12:52.345479 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 08 21:12:52.345479 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 08 21:12:52.345479 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 08 21:12:52.345479 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise error Oct 08 21:12:52.345479 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 08 21:12:52.345479 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:12:52.345479 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Oct 08 21:12:52.345479 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 08 21:12:52.345479 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:12:52.345479 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 08 21:12:52.345479 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi '0' Oct 08 21:12:52.345479 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:12:52.345479 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:12:52.345479 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:12:52.345479 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:12:52.345479 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:12:52.345479 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:12:52.345479 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:12:52.345479 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:12:52.345479 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 08 21:12:52.345479 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 08 21:12:52.345479 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:12:52.345479 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:12:52.345479 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 08 21:12:52.345479 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 08 21:12:52.345479 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 08 21:12:52.345479 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 08 21:12:52.345479 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 08 21:12:52.345479 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 08 21:12:52.351422 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 08 21:12:52.351422 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:12:52.351422 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:12:52.351422 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:12:52.351422 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:12:52.351422 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:12:52.351422 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:12:52.351422 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 08 21:12:52.351422 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 08 21:12:52.351422 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 08 21:12:52.351422 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:12:52.351422 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-2c298b6b-1ba3-40c5-aad0-f99618640940 tempest-VolumesNegativeTest-1559607197 tempest-VolumesNegativeTest-1559607197-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:12:52.351422 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-2c298b6b-1ba3-40c5-aad0-f99618640940 tempest-VolumesNegativeTest-1559607197 tempest-VolumesNegativeTest-1559607197-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.009645 Oct 08 21:12:52.357572 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2361/4782] 10.222.0.26 () {60 vars in 1156 bytes} [Sat Oct 8 21:12:52 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 08 21:12:52.360074 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-ffc0005f-1730-42ce-a8f9-9b21e07be464 tempest-VolumesNegativeTest-1559607197 tempest-VolumesNegativeTest-1559607197-project] Action: 'create', calling method: .version_select at 0x7f1a8c9615e0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1667729851", "metadata": {"Type": "work"}}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:12:52.371749 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-ffc0005f-1730-42ce-a8f9-9b21e07be464 tempest-VolumesNegativeTest-1559607197 tempest-VolumesNegativeTest-1559607197-project] Request method failure captured: Oct 08 21:12:52.371749 ncdv-master-1 devstack@n-api.service[140492]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 08 21:12:52.371749 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:12:52.371749 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:12:52.371749 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:12:52.371749 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 119 Oct 08 21:12:52.371749 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:12:52.371749 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:12:52.371749 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:12:52.371749 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:12:52.371749 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQefTHAAJuAykFTUg5ADHGTq1wOVxe9JKL8IiBlkrbjDArzHuBo3sxvMkOWf-vgLBGk8J8AY_ra7-w30d_j_yVjr4sQf_QFeTJCt6iv3xEOiVk1XPOWsVTxP1tuP8N4QiTfWdwSMuLSvkl7KWvJmwFlLoQNCT5sA-bCTpQrEmaXCjhok Oct 08 21:12:52.371749 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:12:52.371749 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:12:52.371749 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:12:52.371749 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:12:52.371749 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:12:52.371749 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:12:52.371749 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 3b59e98c081f4f04a1589910813079f9 Oct 08 21:12:52.371749 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-VolumesNegativeTest-1559607197 Oct 08 21:12:52.371749 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:12:52.371749 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:12:52.371749 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3b59e98c081f4f04a1589910813079f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3b59e98c081f4f04a1589910813079f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3b59e98c081f4f04a1589910813079f9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3b59e98c081f4f04a1589910813079f9"}]}] Oct 08 21:12:52.371749 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-VolumesNegativeTest-1559607197 Oct 08 21:12:52.371749 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 3b59e98c081f4f04a1589910813079f9 Oct 08 21:12:52.371749 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-VolumesNegativeTest-1559607197 Oct 08 21:12:52.371749 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-VolumesNegativeTest-1559607197-project Oct 08 21:12:52.371749 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:12:52.371749 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:12:52.371749 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: f8a400a004b849798b5b87853f6f5327 Oct 08 21:12:52.371749 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-VolumesNegativeTest-1559607197-project Oct 08 21:12:52.371749 ncdv-master-1 devstack@n-api.service[140492]: Oct 08 21:12:52.371749 ncdv-master-1 devstack@n-api.service[140492]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1667729851", "metadata": {"Type": "work"}}} Oct 08 21:12:52.371749 ncdv-master-1 devstack@n-api.service[140492]: method: Oct 08 21:12:52.371749 ncdv-master-1 devstack@n-api.service[140492]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 08 21:12:52.371749 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1667729851', 'metadata': {'Type': 'work'}}}} Oct 08 21:12:52.371749 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:12:52.371749 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:12:52.371749 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 08 21:12:52.371749 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 08 21:12:52.371749 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 08 21:12:52.371749 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise error Oct 08 21:12:52.371749 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Oct 08 21:12:52.371749 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:12:52.371749 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 08 21:12:52.371749 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 08 21:12:52.371749 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:12:52.371749 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 08 21:12:52.371749 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi '' Oct 08 21:12:52.371749 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:12:52.371749 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:12:52.371749 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:12:52.371749 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:12:52.371749 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:12:52.371749 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:12:52.371749 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:12:52.371749 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:12:52.371749 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 08 21:12:52.371749 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 08 21:12:52.371749 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:12:52.371749 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:12:52.371749 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 08 21:12:52.371749 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 08 21:12:52.371749 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 08 21:12:52.371749 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 08 21:12:52.371749 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 08 21:12:52.371749 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 08 21:12:52.376189 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 08 21:12:52.376189 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:12:52.376189 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:12:52.376189 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:12:52.376189 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:12:52.376189 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:12:52.376189 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:12:52.376189 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 08 21:12:52.376189 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 08 21:12:52.376189 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 08 21:12:52.376189 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:12:52.378555 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-ffc0005f-1730-42ce-a8f9-9b21e07be464 tempest-VolumesNegativeTest-1559607197 tempest-VolumesNegativeTest-1559607197-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:12:52.380217 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-ffc0005f-1730-42ce-a8f9-9b21e07be464 tempest-VolumesNegativeTest-1559607197 tempest-VolumesNegativeTest-1559607197-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.024681 Oct 08 21:12:52.381040 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2422/4783] 10.222.0.26 () {60 vars in 1156 bytes} [Sat Oct 8 21:12:52 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 08 21:12:52.392938 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-6d63ef1a-87a2-4db5-8832-b06dc05da767 tempest-VolumesNegativeTest-1559607197 tempest-VolumesNegativeTest-1559607197-project] Calling method '.version_select at 0x7f1a8761c160>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:12:52.458302 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-6d63ef1a-87a2-4db5-8832-b06dc05da767 tempest-VolumesNegativeTest-1559607197 tempest-VolumesNegativeTest-1559607197-project] HTTP exception thrown: Volume tempest-invalid-823618638 could not be found. Oct 08 21:12:52.460300 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-6d63ef1a-87a2-4db5-8832-b06dc05da767 tempest-VolumesNegativeTest-1559607197 tempest-VolumesNegativeTest-1559607197-project] Request method failure captured: Oct 08 21:12:52.460300 ncdv-master-1 devstack@n-api.service[140491]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-823618638 HTTP/1.1 Oct 08 21:12:52.460300 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:12:52.460300 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:12:52.460300 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:12:52.460300 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 21:12:52.460300 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:12:52.460300 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:12:52.460300 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:12:52.460300 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:12:52.460300 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQefTHAAJuAykFTUg5ADHGTq1wOVxe9JKL8IiBlkrbjDArzHuBo3sxvMkOWf-vgLBGk8J8AY_ra7-w30d_j_yVjr4sQf_QFeTJCt6iv3xEOiVk1XPOWsVTxP1tuP8N4QiTfWdwSMuLSvkl7KWvJmwFlLoQNCT5sA-bCTpQrEmaXCjhok Oct 08 21:12:52.460300 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:12:52.460300 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:12:52.460300 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:12:52.460300 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:12:52.460300 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:12:52.460300 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:12:52.460300 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 3b59e98c081f4f04a1589910813079f9 Oct 08 21:12:52.460300 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-VolumesNegativeTest-1559607197 Oct 08 21:12:52.460300 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:12:52.460300 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:12:52.460300 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3b59e98c081f4f04a1589910813079f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3b59e98c081f4f04a1589910813079f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3b59e98c081f4f04a1589910813079f9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3b59e98c081f4f04a1589910813079f9"}]}] Oct 08 21:12:52.460300 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-VolumesNegativeTest-1559607197 Oct 08 21:12:52.460300 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 3b59e98c081f4f04a1589910813079f9 Oct 08 21:12:52.460300 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-VolumesNegativeTest-1559607197 Oct 08 21:12:52.460300 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-VolumesNegativeTest-1559607197-project Oct 08 21:12:52.460300 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:12:52.460300 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:12:52.460300 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: f8a400a004b849798b5b87853f6f5327 Oct 08 21:12:52.460300 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-VolumesNegativeTest-1559607197-project Oct 08 21:12:52.460300 ncdv-master-1 devstack@n-api.service[140491]: method: Oct 08 21:12:52.460300 ncdv-master-1 devstack@n-api.service[140491]: exception: Volume tempest-invalid-823618638 could not be found. Oct 08 21:12:52.460300 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': 'tempest-invalid-823618638'} Oct 08 21:12:52.460300 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:12:52.460300 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:12:52.460300 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 08 21:12:52.460300 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 08 21:12:52.460300 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 08 21:12:52.460300 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 08 21:12:52.460300 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 08 21:12:52.460300 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 08 21:12:52.460300 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 08 21:12:52.460300 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 08 21:12:52.460300 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 08 21:12:52.460300 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 08 21:12:52.460300 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 08 21:12:52.460300 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 08 21:12:52.460300 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 08 21:12:52.460300 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 08 21:12:52.460300 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-823618638 could not be found. (HTTP 404) (Request-ID: req-aed79a43-ce97-4b2d-9dcc-525a999d2090) Oct 08 21:12:52.460300 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:12:52.460300 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:12:52.460300 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:12:52.460300 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:12:52.460300 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 08 21:12:52.460300 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 08 21:12:52.460300 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 08 21:12:52.460300 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 08 21:12:52.460300 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 08 21:12:52.460300 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 08 21:12:52.460300 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 08 21:12:52.460300 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 08 21:12:52.460300 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 08 21:12:52.464393 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 08 21:12:52.464393 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 08 21:12:52.464393 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 08 21:12:52.464393 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 08 21:12:52.464393 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 08 21:12:52.464393 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 08 21:12:52.464393 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 08 21:12:52.464393 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 08 21:12:52.464393 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 08 21:12:52.464393 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 08 21:12:52.464393 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 08 21:12:52.464393 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 08 21:12:52.464393 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 08 21:12:52.464393 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-823618638 could not be found. Oct 08 21:12:52.464393 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:12:52.464393 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:12:52.464393 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:12:52.464393 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:12:52.464393 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:12:52.464393 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:12:52.464393 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:12:52.464393 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:12:52.464393 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 08 21:12:52.464393 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 08 21:12:52.464393 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:12:52.464393 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:12:52.464393 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 08 21:12:52.464393 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:12:52.464393 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-823618638 could not be found. Oct 08 21:12:52.464393 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:12:52.464393 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:12:52.464393 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:12:52.464393 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:12:52.464393 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:12:52.464393 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:12:52.464393 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:12:52.464393 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:12:52.464393 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-823618638 could not be found. Oct 08 21:12:52.464393 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:12:52.464393 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-6d63ef1a-87a2-4db5-8832-b06dc05da767 tempest-VolumesNegativeTest-1559607197 tempest-VolumesNegativeTest-1559607197-project] Returning 404 to user: Volume tempest-invalid-823618638 could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:12:52.464393 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-6d63ef1a-87a2-4db5-8832-b06dc05da767 tempest-VolumesNegativeTest-1559607197 tempest-VolumesNegativeTest-1559607197-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/tempest-invalid-823618638" status: 404 len: 98 microversion: 2.1 time: 0.073767 Oct 08 21:12:52.464393 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2362/4784] 10.222.0.26 () {58 vars in 1215 bytes} [Sat Oct 8 21:12:52 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-823618638 => generated 98 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 08 21:12:52.475648 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-b067dd2c-4497-4202-8f2b-a8d536aba691 tempest-VolumesNegativeTest-1559607197 tempest-VolumesNegativeTest-1559607197-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005408 Oct 08 21:12:52.477304 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2423/4785] 10.222.0.26 () {58 vars in 1140 bytes} [Sat Oct 8 21:12:52 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 08 21:12:52.497825 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-feea65f0-046b-4bfa-ab9a-5e4bf34273ce tempest-VolumesNegativeTest-1559607197 tempest-VolumesNegativeTest-1559607197-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003953 Oct 08 21:12:52.498366 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2363/4786] 10.222.0.26 () {58 vars in 1137 bytes} [Sat Oct 8 21:12:52 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 08 21:12:52.525682 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-6ede2203-d6de-47a7-901f-c843b8c01f99 tempest-VolumesNegativeTest-1559607197 tempest-VolumesNegativeTest-1559607197-project] Calling method '.version_select at 0x7f1a8c087b80>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:12:52.560034 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-6ede2203-d6de-47a7-901f-c843b8c01f99 tempest-VolumesNegativeTest-1559607197 tempest-VolumesNegativeTest-1559607197-project] HTTP exception thrown: Volume 1d3b41d8-6a3b-43f7-984f-de41e5e48496 could not be found. Oct 08 21:12:52.562072 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-6ede2203-d6de-47a7-901f-c843b8c01f99 tempest-VolumesNegativeTest-1559607197 tempest-VolumesNegativeTest-1559607197-project] Request method failure captured: Oct 08 21:12:52.562072 ncdv-master-1 devstack@n-api.service[140492]: request: DELETE /compute/v2.1/os-volumes/1d3b41d8-6a3b-43f7-984f-de41e5e48496 HTTP/1.1 Oct 08 21:12:52.562072 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:12:52.562072 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:12:52.562072 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:12:52.562072 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 21:12:52.562072 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:12:52.562072 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:12:52.562072 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:12:52.562072 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:12:52.562072 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQefTHAAJuAykFTUg5ADHGTq1wOVxe9JKL8IiBlkrbjDArzHuBo3sxvMkOWf-vgLBGk8J8AY_ra7-w30d_j_yVjr4sQf_QFeTJCt6iv3xEOiVk1XPOWsVTxP1tuP8N4QiTfWdwSMuLSvkl7KWvJmwFlLoQNCT5sA-bCTpQrEmaXCjhok Oct 08 21:12:52.562072 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:12:52.562072 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:12:52.562072 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:12:52.562072 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:12:52.562072 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:12:52.562072 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:12:52.562072 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 3b59e98c081f4f04a1589910813079f9 Oct 08 21:12:52.562072 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-VolumesNegativeTest-1559607197 Oct 08 21:12:52.562072 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:12:52.562072 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:12:52.562072 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3b59e98c081f4f04a1589910813079f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3b59e98c081f4f04a1589910813079f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3b59e98c081f4f04a1589910813079f9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3b59e98c081f4f04a1589910813079f9"}]}] Oct 08 21:12:52.562072 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-VolumesNegativeTest-1559607197 Oct 08 21:12:52.562072 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 3b59e98c081f4f04a1589910813079f9 Oct 08 21:12:52.562072 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-VolumesNegativeTest-1559607197 Oct 08 21:12:52.562072 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-VolumesNegativeTest-1559607197-project Oct 08 21:12:52.562072 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:12:52.562072 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:12:52.562072 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: f8a400a004b849798b5b87853f6f5327 Oct 08 21:12:52.562072 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-VolumesNegativeTest-1559607197-project Oct 08 21:12:52.562072 ncdv-master-1 devstack@n-api.service[140492]: method: Oct 08 21:12:52.562072 ncdv-master-1 devstack@n-api.service[140492]: exception: Volume 1d3b41d8-6a3b-43f7-984f-de41e5e48496 could not be found. Oct 08 21:12:52.562072 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': '1d3b41d8-6a3b-43f7-984f-de41e5e48496'} Oct 08 21:12:52.562072 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:12:52.562072 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:12:52.562072 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 08 21:12:52.562072 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 08 21:12:52.562072 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 08 21:12:52.562072 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 08 21:12:52.562072 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 08 21:12:52.562072 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 08 21:12:52.562072 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 08 21:12:52.562072 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 08 21:12:52.562072 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 08 21:12:52.562072 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 08 21:12:52.562072 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 08 21:12:52.562072 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 08 21:12:52.562072 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 08 21:12:52.562072 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 08 21:12:52.562072 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1d3b41d8-6a3b-43f7-984f-de41e5e48496 could not be found. (HTTP 404) (Request-ID: req-92ec6344-9118-484b-b7c0-feb213a6e543) Oct 08 21:12:52.562072 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:12:52.562072 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:12:52.562072 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:12:52.562072 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:12:52.562072 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 08 21:12:52.562072 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 08 21:12:52.562072 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 08 21:12:52.562072 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 08 21:12:52.562072 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 08 21:12:52.562072 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 08 21:12:52.562072 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 08 21:12:52.562072 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 08 21:12:52.562072 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 08 21:12:52.569600 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 08 21:12:52.569600 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 08 21:12:52.569600 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 08 21:12:52.569600 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 08 21:12:52.569600 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 08 21:12:52.569600 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 08 21:12:52.569600 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 08 21:12:52.569600 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 08 21:12:52.569600 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 08 21:12:52.569600 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 08 21:12:52.569600 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 08 21:12:52.569600 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 08 21:12:52.569600 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 08 21:12:52.569600 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1d3b41d8-6a3b-43f7-984f-de41e5e48496 could not be found. Oct 08 21:12:52.569600 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:12:52.569600 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:12:52.569600 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:12:52.569600 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:12:52.569600 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:12:52.569600 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:12:52.569600 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:12:52.569600 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:12:52.569600 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 08 21:12:52.569600 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 08 21:12:52.569600 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:12:52.569600 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:12:52.569600 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 08 21:12:52.569600 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:12:52.569600 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1d3b41d8-6a3b-43f7-984f-de41e5e48496 could not be found. Oct 08 21:12:52.569600 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:12:52.569600 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:12:52.569600 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:12:52.569600 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:12:52.569600 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:12:52.569600 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:12:52.569600 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:12:52.569600 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:12:52.569600 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1d3b41d8-6a3b-43f7-984f-de41e5e48496 could not be found. Oct 08 21:12:52.569600 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:12:52.569600 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-6ede2203-d6de-47a7-901f-c843b8c01f99 tempest-VolumesNegativeTest-1559607197 tempest-VolumesNegativeTest-1559607197-project] Returning 404 to user: Volume 1d3b41d8-6a3b-43f7-984f-de41e5e48496 could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:12:52.569600 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-6ede2203-d6de-47a7-901f-c843b8c01f99 tempest-VolumesNegativeTest-1559607197 tempest-VolumesNegativeTest-1559607197-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/1d3b41d8-6a3b-43f7-984f-de41e5e48496" status: 404 len: 109 microversion: 2.1 time: 0.059340 Oct 08 21:12:52.576805 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-1bbebbf9-0a6a-4f8b-aceb-1667aacc9b43 tempest-VolumesNegativeTest-1559607197 tempest-VolumesNegativeTest-1559607197-project] Calling method '.version_select at 0x7f1a8769c940>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:12:52.577574 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2424/4787] 10.222.0.26 () {58 vars in 1248 bytes} [Sat Oct 8 21:12:52 2022] DELETE /compute/v2.1/os-volumes/1d3b41d8-6a3b-43f7-984f-de41e5e48496 => generated 109 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 08 21:12:52.628424 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-1bbebbf9-0a6a-4f8b-aceb-1667aacc9b43 tempest-VolumesNegativeTest-1559607197 tempest-VolumesNegativeTest-1559607197-project] HTTP exception thrown: Volume b0bd9de5-b3c4-47a9-8957-17b71bcc3da1 could not be found. Oct 08 21:12:52.630983 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-1bbebbf9-0a6a-4f8b-aceb-1667aacc9b43 tempest-VolumesNegativeTest-1559607197 tempest-VolumesNegativeTest-1559607197-project] Request method failure captured: Oct 08 21:12:52.630983 ncdv-master-1 devstack@n-api.service[140491]: request: GET /compute/v2.1/os-volumes/b0bd9de5-b3c4-47a9-8957-17b71bcc3da1 HTTP/1.1 Oct 08 21:12:52.630983 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:12:52.630983 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:12:52.630983 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:12:52.630983 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 21:12:52.630983 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:12:52.630983 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:12:52.630983 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:12:52.630983 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:12:52.630983 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQefTHAAJuAykFTUg5ADHGTq1wOVxe9JKL8IiBlkrbjDArzHuBo3sxvMkOWf-vgLBGk8J8AY_ra7-w30d_j_yVjr4sQf_QFeTJCt6iv3xEOiVk1XPOWsVTxP1tuP8N4QiTfWdwSMuLSvkl7KWvJmwFlLoQNCT5sA-bCTpQrEmaXCjhok Oct 08 21:12:52.630983 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:12:52.630983 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:12:52.630983 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:12:52.630983 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:12:52.630983 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:12:52.630983 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:12:52.630983 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 3b59e98c081f4f04a1589910813079f9 Oct 08 21:12:52.630983 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-VolumesNegativeTest-1559607197 Oct 08 21:12:52.630983 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:12:52.630983 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:12:52.630983 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3b59e98c081f4f04a1589910813079f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3b59e98c081f4f04a1589910813079f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3b59e98c081f4f04a1589910813079f9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3b59e98c081f4f04a1589910813079f9"}]}] Oct 08 21:12:52.630983 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-VolumesNegativeTest-1559607197 Oct 08 21:12:52.630983 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 3b59e98c081f4f04a1589910813079f9 Oct 08 21:12:52.630983 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-VolumesNegativeTest-1559607197 Oct 08 21:12:52.630983 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-VolumesNegativeTest-1559607197-project Oct 08 21:12:52.630983 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:12:52.630983 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:12:52.630983 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: f8a400a004b849798b5b87853f6f5327 Oct 08 21:12:52.630983 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-VolumesNegativeTest-1559607197-project Oct 08 21:12:52.630983 ncdv-master-1 devstack@n-api.service[140491]: method: Oct 08 21:12:52.630983 ncdv-master-1 devstack@n-api.service[140491]: exception: Volume b0bd9de5-b3c4-47a9-8957-17b71bcc3da1 could not be found. Oct 08 21:12:52.630983 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': 'b0bd9de5-b3c4-47a9-8957-17b71bcc3da1'} Oct 08 21:12:52.630983 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:12:52.630983 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:12:52.630983 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 08 21:12:52.630983 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 08 21:12:52.630983 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 08 21:12:52.630983 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 08 21:12:52.630983 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 08 21:12:52.630983 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 08 21:12:52.630983 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 08 21:12:52.630983 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 08 21:12:52.630983 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 08 21:12:52.630983 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 08 21:12:52.630983 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 08 21:12:52.630983 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 08 21:12:52.630983 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 08 21:12:52.630983 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 08 21:12:52.630983 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b0bd9de5-b3c4-47a9-8957-17b71bcc3da1 could not be found. (HTTP 404) (Request-ID: req-13360c34-05c0-43b7-a9db-a4a9946e5068) Oct 08 21:12:52.630983 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:12:52.630983 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:12:52.630983 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:12:52.630983 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:12:52.630983 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 08 21:12:52.630983 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 08 21:12:52.630983 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 08 21:12:52.630983 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 08 21:12:52.630983 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 08 21:12:52.630983 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 08 21:12:52.630983 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 08 21:12:52.630983 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 08 21:12:52.630983 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 08 21:12:52.635846 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 08 21:12:52.635846 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 08 21:12:52.635846 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 08 21:12:52.635846 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 08 21:12:52.635846 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 08 21:12:52.635846 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 08 21:12:52.635846 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 08 21:12:52.635846 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 08 21:12:52.635846 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 08 21:12:52.635846 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 08 21:12:52.635846 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 08 21:12:52.635846 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 08 21:12:52.635846 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 08 21:12:52.635846 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b0bd9de5-b3c4-47a9-8957-17b71bcc3da1 could not be found. Oct 08 21:12:52.635846 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:12:52.635846 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:12:52.635846 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:12:52.635846 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:12:52.635846 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:12:52.635846 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:12:52.635846 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:12:52.635846 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:12:52.635846 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 08 21:12:52.635846 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 08 21:12:52.635846 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:12:52.635846 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:12:52.635846 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 08 21:12:52.635846 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:12:52.635846 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b0bd9de5-b3c4-47a9-8957-17b71bcc3da1 could not be found. Oct 08 21:12:52.635846 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:12:52.635846 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:12:52.635846 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:12:52.635846 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:12:52.635846 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:12:52.635846 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:12:52.635846 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:12:52.635846 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:12:52.635846 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b0bd9de5-b3c4-47a9-8957-17b71bcc3da1 could not be found. Oct 08 21:12:52.635846 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:12:52.645000 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-1bbebbf9-0a6a-4f8b-aceb-1667aacc9b43 tempest-VolumesNegativeTest-1559607197 tempest-VolumesNegativeTest-1559607197-project] Returning 404 to user: Volume b0bd9de5-b3c4-47a9-8957-17b71bcc3da1 could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:12:52.645000 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-1bbebbf9-0a6a-4f8b-aceb-1667aacc9b43 tempest-VolumesNegativeTest-1559607197 tempest-VolumesNegativeTest-1559607197-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/b0bd9de5-b3c4-47a9-8957-17b71bcc3da1" status: 404 len: 109 microversion: 2.1 time: 0.070440 Oct 08 21:12:52.645633 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2364/4788] 10.222.0.26 () {58 vars in 1245 bytes} [Sat Oct 8 21:12:52 2022] GET /compute/v2.1/os-volumes/b0bd9de5-b3c4-47a9-8957-17b71bcc3da1 => generated 109 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:12:52.761304 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-6a22b43b-bbf2-4667-b58b-67a676dc512a tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:12:52.762249 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-6a22b43b-bbf2-4667-b58b-67a676dc512a tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] [instance: 8529883c-3fdd-4af4-b295-c17e6c149072] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:12:52.776448 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6a22b43b-bbf2-4667-b58b-67a676dc512a tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:52.781912 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6a22b43b-bbf2-4667-b58b-67a676dc512a tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:52.782607 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6a22b43b-bbf2-4667-b58b-67a676dc512a tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:52.783600 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6a22b43b-bbf2-4667-b58b-67a676dc512a tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:52.784235 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6a22b43b-bbf2-4667-b58b-67a676dc512a tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:52.784865 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6a22b43b-bbf2-4667-b58b-67a676dc512a tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:53.898687 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-6a22b43b-bbf2-4667-b58b-67a676dc512a tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e546b55bd1475782e5863ed50b6f01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75970c62311417eada44e0270dade81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:12:53.909807 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-6a22b43b-bbf2-4667-b58b-67a676dc512a tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] 10.222.0.26 "GET /compute/v2.1/servers/8529883c-3fdd-4af4-b295-c17e6c149072" status: 200 len: 1313 microversion: 2.1 time: 1.153046 Oct 08 21:12:53.917048 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2425/4789] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:12:52 2022] GET /compute/v2.1/servers/8529883c-3fdd-4af4-b295-c17e6c149072 => generated 1313 bytes in 1161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:12:54.947991 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-bb280ee1-8271-4158-843c-b08b66a377e5 tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:12:54.948633 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-bb280ee1-8271-4158-843c-b08b66a377e5 tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] [instance: 8529883c-3fdd-4af4-b295-c17e6c149072] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:12:54.960815 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bb280ee1-8271-4158-843c-b08b66a377e5 tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:54.961354 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bb280ee1-8271-4158-843c-b08b66a377e5 tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:54.961805 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bb280ee1-8271-4158-843c-b08b66a377e5 tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:54.962525 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bb280ee1-8271-4158-843c-b08b66a377e5 tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:12:54.962991 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bb280ee1-8271-4158-843c-b08b66a377e5 tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:12:54.965506 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bb280ee1-8271-4158-843c-b08b66a377e5 tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:12:55.994492 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-bb280ee1-8271-4158-843c-b08b66a377e5 tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e546b55bd1475782e5863ed50b6f01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75970c62311417eada44e0270dade81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:12:56.009975 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-bb280ee1-8271-4158-843c-b08b66a377e5 tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] 10.222.0.26 "GET /compute/v2.1/servers/8529883c-3fdd-4af4-b295-c17e6c149072" status: 200 len: 1497 microversion: 2.1 time: 1.068458 Oct 08 21:12:56.010848 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2365/4790] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:12:54 2022] GET /compute/v2.1/servers/8529883c-3fdd-4af4-b295-c17e6c149072 => generated 1497 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:13:00.333208 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-00e429b0-46d1-4bc3-9f53-3fdf6caaaf4f tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:13:00.335731 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-00e429b0-46d1-4bc3-9f53-3fdf6caaaf4f tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] [instance: 8529883c-3fdd-4af4-b295-c17e6c149072] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:13:00.352936 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-00e429b0-46d1-4bc3-9f53-3fdf6caaaf4f tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:13:00.357068 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-00e429b0-46d1-4bc3-9f53-3fdf6caaaf4f tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:13:00.358333 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-00e429b0-46d1-4bc3-9f53-3fdf6caaaf4f tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:13:00.362378 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-00e429b0-46d1-4bc3-9f53-3fdf6caaaf4f tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:13:00.364787 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-00e429b0-46d1-4bc3-9f53-3fdf6caaaf4f tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:13:00.365938 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-00e429b0-46d1-4bc3-9f53-3fdf6caaaf4f tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:13:00.446269 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-00e429b0-46d1-4bc3-9f53-3fdf6caaaf4f tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] [instance: 8529883c-3fdd-4af4-b295-c17e6c149072] Going to try to terminate instance {{(pid=140492) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 21:13:00.636522 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-00e429b0-46d1-4bc3-9f53-3fdf6caaaf4f tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] 10.222.0.26 "DELETE /compute/v2.1/servers/8529883c-3fdd-4af4-b295-c17e6c149072" status: 204 len: 0 microversion: 2.1 time: 0.306687 Oct 08 21:13:00.637775 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2426/4791] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:13:00 2022] DELETE /compute/v2.1/servers/8529883c-3fdd-4af4-b295-c17e6c149072 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 21:13:00.646475 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-5f8f2635-313c-4fdd-a6e5-60ffdb85c8ab tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:13:00.647088 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-5f8f2635-313c-4fdd-a6e5-60ffdb85c8ab tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] [instance: 8529883c-3fdd-4af4-b295-c17e6c149072] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:13:00.654368 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5f8f2635-313c-4fdd-a6e5-60ffdb85c8ab tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:13:00.655131 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5f8f2635-313c-4fdd-a6e5-60ffdb85c8ab tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:13:00.655772 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5f8f2635-313c-4fdd-a6e5-60ffdb85c8ab tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:13:00.656668 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5f8f2635-313c-4fdd-a6e5-60ffdb85c8ab tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:13:00.659517 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5f8f2635-313c-4fdd-a6e5-60ffdb85c8ab tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:13:00.661070 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5f8f2635-313c-4fdd-a6e5-60ffdb85c8ab tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:13:01.233589 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-5f8f2635-313c-4fdd-a6e5-60ffdb85c8ab tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e546b55bd1475782e5863ed50b6f01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75970c62311417eada44e0270dade81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:13:01.249827 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-5f8f2635-313c-4fdd-a6e5-60ffdb85c8ab tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] 10.222.0.26 "GET /compute/v2.1/servers/8529883c-3fdd-4af4-b295-c17e6c149072" status: 200 len: 1503 microversion: 2.1 time: 0.607705 Oct 08 21:13:01.257562 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2366/4792] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:13:00 2022] GET /compute/v2.1/servers/8529883c-3fdd-4af4-b295-c17e6c149072 => generated 1503 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:13:02.284618 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-0daac79c-4f98-4d02-ad6f-c8a5b6538861 tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:13:02.287179 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-0daac79c-4f98-4d02-ad6f-c8a5b6538861 tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] [instance: 8529883c-3fdd-4af4-b295-c17e6c149072] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:13:02.309001 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0daac79c-4f98-4d02-ad6f-c8a5b6538861 tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:13:02.312341 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0daac79c-4f98-4d02-ad6f-c8a5b6538861 tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:13:02.313209 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0daac79c-4f98-4d02-ad6f-c8a5b6538861 tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:13:02.320138 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0daac79c-4f98-4d02-ad6f-c8a5b6538861 tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:13:02.320935 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0daac79c-4f98-4d02-ad6f-c8a5b6538861 tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:13:02.321719 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0daac79c-4f98-4d02-ad6f-c8a5b6538861 tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:13:03.307322 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-0daac79c-4f98-4d02-ad6f-c8a5b6538861 tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e546b55bd1475782e5863ed50b6f01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75970c62311417eada44e0270dade81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:13:03.318946 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-0daac79c-4f98-4d02-ad6f-c8a5b6538861 tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] 10.222.0.26 "GET /compute/v2.1/servers/8529883c-3fdd-4af4-b295-c17e6c149072" status: 200 len: 1503 microversion: 2.1 time: 1.045516 Oct 08 21:13:03.325937 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2427/4793] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:13:02 2022] GET /compute/v2.1/servers/8529883c-3fdd-4af4-b295-c17e6c149072 => generated 1503 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:13:03.601311 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-53c65dcb-a88d-4999-b0ec-6d39ea90db9c tempest-SecurityGroupsNegativeTestJSON-1722676008 tempest-SecurityGroupsNegativeTestJSON-1722676008-project] Calling method '.version_select at 0x7f1a87610d30>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:13:03.912738 ncdv-master-1 devstack@n-api.service[140491]: DEBUG neutronclient.v2_0.client [None req-53c65dcb-a88d-4999-b0ec-6d39ea90db9c tempest-SecurityGroupsNegativeTestJSON-1722676008 tempest-SecurityGroupsNegativeTestJSON-1722676008-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 5fc50485-fa88-44a6-994e-2668e7d01947 does not exist", "detail": ""}} {{(pid=140491) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 08 21:13:03.913646 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.network.security_group_api [None req-53c65dcb-a88d-4999-b0ec-6d39ea90db9c tempest-SecurityGroupsNegativeTestJSON-1722676008 tempest-SecurityGroupsNegativeTestJSON-1722676008-project] Neutron security group 5fc50485-fa88-44a6-994e-2668e7d01947 not found {{(pid=140491) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 08 21:13:03.914465 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-53c65dcb-a88d-4999-b0ec-6d39ea90db9c tempest-SecurityGroupsNegativeTestJSON-1722676008 tempest-SecurityGroupsNegativeTestJSON-1722676008-project] HTTP exception thrown: Security group 5fc50485-fa88-44a6-994e-2668e7d01947 does not exist Oct 08 21:13:03.914465 ncdv-master-1 devstack@n-api.service[140491]: Neutron server returns request_ids: ['req-4b022ff1-585d-4424-b847-798929f5cde2'] Oct 08 21:13:03.918505 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-53c65dcb-a88d-4999-b0ec-6d39ea90db9c tempest-SecurityGroupsNegativeTestJSON-1722676008 tempest-SecurityGroupsNegativeTestJSON-1722676008-project] Request method failure captured: Oct 08 21:13:03.918505 ncdv-master-1 devstack@n-api.service[140491]: request: DELETE /compute/v2.1/os-security-groups/5fc50485-fa88-44a6-994e-2668e7d01947 HTTP/1.1 Oct 08 21:13:03.918505 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:13:03.918505 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:13:03.918505 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:13:03.918505 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 21:13:03.918505 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:13:03.918505 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:13:03.918505 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:13:03.918505 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:13:03.918505 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeff07eqGGaN0LWg2Ji-icOxv0ohL6SDBvPHCFh-xRSwYYkDaxh3O7njRJVkg-OF2sY1OgcttGrze4R1z4tRKynSCpA0BqIF7dr5AMYIth0QZjP6jI3u7gNtrTrvKz0RltYDJfgg1xI2aMj_-bd1lscsV9Z9r3uzWYugYhCS0k6pFew Oct 08 21:13:03.918505 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:13:03.918505 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:13:03.918505 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:13:03.918505 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:13:03.918505 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:13:03.918505 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:13:03.918505 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 3207efb3c2484385b24e40119d1bb71a Oct 08 21:13:03.918505 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1722676008 Oct 08 21:13:03.918505 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:13:03.918505 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:13:03.918505 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3207efb3c2484385b24e40119d1bb71a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3207efb3c2484385b24e40119d1bb71a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3207efb3c2484385b24e40119d1bb71a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3207efb3c2484385b24e40119d1bb71a"}]}] Oct 08 21:13:03.918505 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1722676008 Oct 08 21:13:03.918505 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 3207efb3c2484385b24e40119d1bb71a Oct 08 21:13:03.918505 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1722676008 Oct 08 21:13:03.918505 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-SecurityGroupsNegativeTestJSON-1722676008-project Oct 08 21:13:03.918505 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:13:03.918505 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:13:03.918505 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 345fc5b62ae34cdc8323d5afb75a8a34 Oct 08 21:13:03.918505 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1722676008-project Oct 08 21:13:03.918505 ncdv-master-1 devstack@n-api.service[140491]: method: Oct 08 21:13:03.918505 ncdv-master-1 devstack@n-api.service[140491]: exception: Security group 5fc50485-fa88-44a6-994e-2668e7d01947 does not exist Oct 08 21:13:03.918505 ncdv-master-1 devstack@n-api.service[140491]: Neutron server returns request_ids: ['req-4b022ff1-585d-4424-b847-798929f5cde2'] Oct 08 21:13:03.918505 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': '5fc50485-fa88-44a6-994e-2668e7d01947'} Oct 08 21:13:03.918505 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:13:03.918505 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:13:03.918505 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 08 21:13:03.918505 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 08 21:13:03.918505 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 08 21:13:03.918505 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 08 21:13:03.918505 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 08 21:13:03.918505 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 08 21:13:03.918505 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 08 21:13:03.918505 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 08 21:13:03.918505 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 08 21:13:03.918505 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 08 21:13:03.918505 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 08 21:13:03.918505 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 08 21:13:03.918505 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 08 21:13:03.918505 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 08 21:13:03.918505 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 08 21:13:03.918505 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 08 21:13:03.918505 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 08 21:13:03.918505 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 08 21:13:03.918505 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 08 21:13:03.918505 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 08 21:13:03.918505 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 08 21:13:03.918505 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 08 21:13:03.918505 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 08 21:13:03.918505 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 08 21:13:03.918505 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 5fc50485-fa88-44a6-994e-2668e7d01947 does not exist Oct 08 21:13:03.922422 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4b022ff1-585d-4424-b847-798929f5cde2'] Oct 08 21:13:03.922422 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:13:03.922422 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:13:03.922422 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:13:03.922422 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:13:03.922422 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 08 21:13:03.922422 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 08 21:13:03.922422 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 08 21:13:03.922422 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 08 21:13:03.922422 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 5fc50485-fa88-44a6-994e-2668e7d01947 does not exist Oct 08 21:13:03.922422 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4b022ff1-585d-4424-b847-798929f5cde2'] Oct 08 21:13:03.922422 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:13:03.922422 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:13:03.922422 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:13:03.922422 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:13:03.922422 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:13:03.922422 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:13:03.922422 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:13:03.922422 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:13:03.922422 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 08 21:13:03.922422 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 08 21:13:03.922422 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:13:03.922422 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:13:03.922422 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 08 21:13:03.922422 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 08 21:13:03.922422 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 5fc50485-fa88-44a6-994e-2668e7d01947 does not exist Oct 08 21:13:03.922422 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4b022ff1-585d-4424-b847-798929f5cde2'] Oct 08 21:13:03.922422 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:13:03.922422 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:13:03.922422 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:13:03.922422 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:13:03.922422 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:13:03.922422 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:13:03.922422 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:13:03.922422 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:13:03.922422 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 5fc50485-fa88-44a6-994e-2668e7d01947 does not exist Oct 08 21:13:03.922422 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4b022ff1-585d-4424-b847-798929f5cde2'] Oct 08 21:13:03.922422 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:13:03.922422 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-53c65dcb-a88d-4999-b0ec-6d39ea90db9c tempest-SecurityGroupsNegativeTestJSON-1722676008 tempest-SecurityGroupsNegativeTestJSON-1722676008-project] Returning 404 to user: Security group 5fc50485-fa88-44a6-994e-2668e7d01947 does not exist Oct 08 21:13:03.922422 ncdv-master-1 devstack@n-api.service[140491]: Neutron server returns request_ids: ['req-4b022ff1-585d-4424-b847-798929f5cde2'] {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:13:03.922422 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-53c65dcb-a88d-4999-b0ec-6d39ea90db9c tempest-SecurityGroupsNegativeTestJSON-1722676008 tempest-SecurityGroupsNegativeTestJSON-1722676008-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/5fc50485-fa88-44a6-994e-2668e7d01947" status: 404 len: 194 microversion: 2.1 time: 0.475926 Oct 08 21:13:03.931199 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2367/4794] 10.222.0.26 () {58 vars in 1272 bytes} [Sat Oct 8 21:13:03 2022] DELETE /compute/v2.1/os-security-groups/5fc50485-fa88-44a6-994e-2668e7d01947 => generated 194 bytes in 487 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:13:03.933799 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-efcfbbe1-3ffa-4c57-bf39-52388420b1fc tempest-SecurityGroupsNegativeTestJSON-1722676008 tempest-SecurityGroupsNegativeTestJSON-1722676008-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.004246 Oct 08 21:13:03.934456 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2428/4795] 10.222.0.26 () {58 vars in 1164 bytes} [Sat Oct 8 21:13:03 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Oct 08 21:13:03.947218 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-ca5d0661-7f15-4623-946e-494ea96af97e tempest-SecurityGroupsNegativeTestJSON-1722676008 tempest-SecurityGroupsNegativeTestJSON-1722676008-project] Calling method '.version_select at 0x7f1a87617dc0>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:13:04.350318 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e332b788-e428-44f7-847f-71ceb55395ba tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:13:04.351526 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-e332b788-e428-44f7-847f-71ceb55395ba tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] [instance: 8529883c-3fdd-4af4-b295-c17e6c149072] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:13:04.371973 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e332b788-e428-44f7-847f-71ceb55395ba tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:13:04.378079 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e332b788-e428-44f7-847f-71ceb55395ba tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:13:04.379473 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e332b788-e428-44f7-847f-71ceb55395ba tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:13:04.380429 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e332b788-e428-44f7-847f-71ceb55395ba tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:13:04.381115 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e332b788-e428-44f7-847f-71ceb55395ba tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:13:04.381721 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e332b788-e428-44f7-847f-71ceb55395ba tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:13:04.451644 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:13:04.973774 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-e332b788-e428-44f7-847f-71ceb55395ba tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e546b55bd1475782e5863ed50b6f01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75970c62311417eada44e0270dade81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:13:04.982043 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-e332b788-e428-44f7-847f-71ceb55395ba tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] 10.222.0.26 "GET /compute/v2.1/servers/8529883c-3fdd-4af4-b295-c17e6c149072" status: 200 len: 1503 microversion: 2.1 time: 0.636676 Oct 08 21:13:04.998427 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2429/4796] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:13:04 2022] GET /compute/v2.1/servers/8529883c-3fdd-4af4-b295-c17e6c149072 => generated 1503 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:13:05.005460 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-58d6852b-86de-40ee-a9fb-0990ced268ea req-72db53d3-e3fc-4a5d-a022-b2a16b0f9ca8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8529883c-3fdd-4af4-b295-c17e6c149072", "name": "network-vif-deleted", "tag": "1077a95f-c117-4933-b297-0e53fb85cadf"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:13:05.016086 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-58d6852b-86de-40ee-a9fb-0990ced268ea req-72db53d3-e3fc-4a5d-a022-b2a16b0f9ca8 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:13:05.016827 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-58d6852b-86de-40ee-a9fb-0990ced268ea req-72db53d3-e3fc-4a5d-a022-b2a16b0f9ca8 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:13:05.017460 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-58d6852b-86de-40ee-a9fb-0990ced268ea req-72db53d3-e3fc-4a5d-a022-b2a16b0f9ca8 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:13:05.032161 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-58d6852b-86de-40ee-a9fb-0990ced268ea req-72db53d3-e3fc-4a5d-a022-b2a16b0f9ca8 service nova] Creating event network-vif-deleted:1077a95f-c117-4933-b297-0e53fb85cadf for instance 8529883c-3fdd-4af4-b295-c17e6c149072 on nch1-master-1 Oct 08 21:13:05.038097 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-58d6852b-86de-40ee-a9fb-0990ced268ea req-72db53d3-e3fc-4a5d-a022-b2a16b0f9ca8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037910 Oct 08 21:13:05.039390 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2430/4797] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:13:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:13:05.856415 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-5a7ae5e7-255c-486a-aae0-08bc132a46cf tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-831628042", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "networks": [{"uuid": "a0e46c11-625b-4c0f-8df1-deaf5b32373b"}]}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:13:05.978971 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.network.neutron [None req-5a7ae5e7-255c-486a-aae0-08bc132a46cf tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] validate_networks() for [('a0e46c11-625b-4c0f-8df1-deaf5b32373b', None, None, None, None, None)] {{(pid=140492) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 21:13:06.036611 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-ca5d0661-7f15-4623-946e-494ea96af97e tempest-SecurityGroupsNegativeTestJSON-1722676008 tempest-SecurityGroupsNegativeTestJSON-1722676008-project] 10.222.0.26 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 2.093790 Oct 08 21:13:06.037770 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2368/4798] 10.222.0.26 () {58 vars in 1158 bytes} [Sat Oct 8 21:13:03 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 2097 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:13:06.060879 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-6aced440-8299-4943-9cd8-65a0bc29753c tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:13:06.062952 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-6aced440-8299-4943-9cd8-65a0bc29753c tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] [instance: 8529883c-3fdd-4af4-b295-c17e6c149072] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:13:06.092933 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6aced440-8299-4943-9cd8-65a0bc29753c tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:13:06.096959 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6aced440-8299-4943-9cd8-65a0bc29753c tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:13:06.101440 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6aced440-8299-4943-9cd8-65a0bc29753c tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:13:06.103940 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6aced440-8299-4943-9cd8-65a0bc29753c tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:13:06.106878 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6aced440-8299-4943-9cd8-65a0bc29753c tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:13:06.124655 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6aced440-8299-4943-9cd8-65a0bc29753c tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:13:06.150077 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-6aced440-8299-4943-9cd8-65a0bc29753c tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] HTTP exception thrown: Instance 8529883c-3fdd-4af4-b295-c17e6c149072 could not be found. Oct 08 21:13:06.152652 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-6aced440-8299-4943-9cd8-65a0bc29753c tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Request method failure captured: Oct 08 21:13:06.152652 ncdv-master-1 devstack@n-api.service[140491]: request: GET /compute/v2.1/servers/8529883c-3fdd-4af4-b295-c17e6c149072 HTTP/1.1 Oct 08 21:13:06.152652 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:13:06.152652 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:13:06.152652 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:13:06.152652 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 21:13:06.152652 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:13:06.152652 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:13:06.152652 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:13:06.152652 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:13:06.152652 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQee5M1Y6ZiS19slkvBKYKfn9oc1rY7w-Y516AiVP1VTXc_jku73ru1D5v8iKiMxwqSR0B4-xbksQZcPCM0NscqKmxLFNzCSsk_gYkIGuLRzD5ks5jcegsln608WCMBcaZUwGpXlmkKwVI2YmbaoYo0lBU5TpGfntbBw7Ss_pkZinlYU Oct 08 21:13:06.152652 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:13:06.152652 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:13:06.152652 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:13:06.152652 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:13:06.152652 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:13:06.152652 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:13:06.152652 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: d75970c62311417eada44e0270dade81 Oct 08 21:13:06.152652 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-VolumesActionsTest-1575257702 Oct 08 21:13:06.152652 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:13:06.152652 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:13:06.152652 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d75970c62311417eada44e0270dade81"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d75970c62311417eada44e0270dade81"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d75970c62311417eada44e0270dade81"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d75970c62311417eada44e0270dade81"}]}] Oct 08 21:13:06.152652 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-VolumesActionsTest-1575257702 Oct 08 21:13:06.152652 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: d75970c62311417eada44e0270dade81 Oct 08 21:13:06.152652 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-VolumesActionsTest-1575257702 Oct 08 21:13:06.152652 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-VolumesActionsTest-1575257702-project Oct 08 21:13:06.152652 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:13:06.152652 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:13:06.152652 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 71e546b55bd1475782e5863ed50b6f01 Oct 08 21:13:06.152652 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-VolumesActionsTest-1575257702-project Oct 08 21:13:06.152652 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:13:06.152652 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance 8529883c-3fdd-4af4-b295-c17e6c149072 could not be found. Oct 08 21:13:06.152652 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': '8529883c-3fdd-4af4-b295-c17e6c149072'} Oct 08 21:13:06.152652 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:13:06.152652 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:13:06.152652 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:13:06.152652 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:13:06.152652 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:13:06.152652 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:13:06.152652 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:13:06.152652 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:13:06.152652 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:13:06.152652 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:13:06.152652 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8529883c-3fdd-4af4-b295-c17e6c149072 could not be found. Oct 08 21:13:06.152652 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:13:06.152652 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:13:06.152652 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:13:06.152652 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:13:06.152652 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:13:06.152652 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:13:06.152652 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:13:06.152652 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:13:06.152652 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:13:06.152652 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:13:06.152652 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:13:06.152652 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:13:06.152652 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:13:06.152652 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:13:06.152652 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:13:06.152652 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:13:06.152652 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8529883c-3fdd-4af4-b295-c17e6c149072 could not be found. Oct 08 21:13:06.152652 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:13:06.152652 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:13:06.152652 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:13:06.156987 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:13:06.156987 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:13:06.156987 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:13:06.156987 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:13:06.156987 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:13:06.156987 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8529883c-3fdd-4af4-b295-c17e6c149072 could not be found. Oct 08 21:13:06.156987 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:13:06.162849 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-6aced440-8299-4943-9cd8-65a0bc29753c tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] Returning 404 to user: Instance 8529883c-3fdd-4af4-b295-c17e6c149072 could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:13:06.164894 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-6aced440-8299-4943-9cd8-65a0bc29753c tempest-VolumesActionsTest-1575257702 tempest-VolumesActionsTest-1575257702-project] 10.222.0.26 "GET /compute/v2.1/servers/8529883c-3fdd-4af4-b295-c17e6c149072" status: 404 len: 111 microversion: 2.1 time: 0.112764 Oct 08 21:13:06.165795 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2369/4799] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:13:06 2022] GET /compute/v2.1/servers/8529883c-3fdd-4af4-b295-c17e6c149072 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:13:06.180295 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-33079642-0dc1-487c-a650-16a9492c8bf2 tempest-SecurityGroupsNegativeTestJSON-1722676008 tempest-SecurityGroupsNegativeTestJSON-1722676008-project] Calling method '.version_select at 0x7f1a8766e160>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:13:07.173314 ncdv-master-1 devstack@n-api.service[140491]: DEBUG neutronclient.v2_0.client [None req-33079642-0dc1-487c-a650-16a9492c8bf2 tempest-SecurityGroupsNegativeTestJSON-1722676008 tempest-SecurityGroupsNegativeTestJSON-1722676008-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=140491) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 08 21:13:07.174725 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-33079642-0dc1-487c-a650-16a9492c8bf2 tempest-SecurityGroupsNegativeTestJSON-1722676008 tempest-SecurityGroupsNegativeTestJSON-1722676008-project] HTTP exception thrown: Insufficient rights for removing default security group. Oct 08 21:13:07.174725 ncdv-master-1 devstack@n-api.service[140491]: Neutron server returns request_ids: ['req-8f31b457-39fd-4906-9780-f07a972aca15'] Oct 08 21:13:07.176941 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-33079642-0dc1-487c-a650-16a9492c8bf2 tempest-SecurityGroupsNegativeTestJSON-1722676008 tempest-SecurityGroupsNegativeTestJSON-1722676008-project] Request method failure captured: Oct 08 21:13:07.176941 ncdv-master-1 devstack@n-api.service[140491]: request: DELETE /compute/v2.1/os-security-groups/7d7606fc-85ea-4c04-ada1-a18bcb1d643b HTTP/1.1 Oct 08 21:13:07.176941 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:13:07.176941 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:13:07.176941 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:13:07.176941 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 21:13:07.176941 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:13:07.176941 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:13:07.176941 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:13:07.176941 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:13:07.176941 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeff07eqGGaN0LWg2Ji-icOxv0ohL6SDBvPHCFh-xRSwYYkDaxh3O7njRJVkg-OF2sY1OgcttGrze4R1z4tRKynSCpA0BqIF7dr5AMYIth0QZjP6jI3u7gNtrTrvKz0RltYDJfgg1xI2aMj_-bd1lscsV9Z9r3uzWYugYhCS0k6pFew Oct 08 21:13:07.176941 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:13:07.176941 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:13:07.176941 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:13:07.176941 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:13:07.176941 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:13:07.176941 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:13:07.176941 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 3207efb3c2484385b24e40119d1bb71a Oct 08 21:13:07.176941 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1722676008 Oct 08 21:13:07.176941 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:13:07.176941 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:13:07.176941 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3207efb3c2484385b24e40119d1bb71a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3207efb3c2484385b24e40119d1bb71a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3207efb3c2484385b24e40119d1bb71a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3207efb3c2484385b24e40119d1bb71a"}]}] Oct 08 21:13:07.176941 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1722676008 Oct 08 21:13:07.176941 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 3207efb3c2484385b24e40119d1bb71a Oct 08 21:13:07.176941 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1722676008 Oct 08 21:13:07.176941 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-SecurityGroupsNegativeTestJSON-1722676008-project Oct 08 21:13:07.176941 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:13:07.176941 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:13:07.176941 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 345fc5b62ae34cdc8323d5afb75a8a34 Oct 08 21:13:07.176941 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1722676008-project Oct 08 21:13:07.176941 ncdv-master-1 devstack@n-api.service[140491]: method: Oct 08 21:13:07.176941 ncdv-master-1 devstack@n-api.service[140491]: exception: Insufficient rights for removing default security group. Oct 08 21:13:07.176941 ncdv-master-1 devstack@n-api.service[140491]: Neutron server returns request_ids: ['req-8f31b457-39fd-4906-9780-f07a972aca15'] Oct 08 21:13:07.176941 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': '7d7606fc-85ea-4c04-ada1-a18bcb1d643b'} Oct 08 21:13:07.176941 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:13:07.176941 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:13:07.176941 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 08 21:13:07.176941 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 08 21:13:07.176941 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 08 21:13:07.176941 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 08 21:13:07.176941 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 08 21:13:07.176941 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 08 21:13:07.176941 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 08 21:13:07.176941 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 08 21:13:07.176941 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 08 21:13:07.176941 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 08 21:13:07.176941 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 08 21:13:07.176941 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 08 21:13:07.176941 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 08 21:13:07.176941 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 08 21:13:07.176941 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 08 21:13:07.176941 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 08 21:13:07.176941 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 08 21:13:07.176941 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 08 21:13:07.176941 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 08 21:13:07.176941 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 08 21:13:07.176941 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 08 21:13:07.176941 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 08 21:13:07.176941 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 08 21:13:07.176941 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 08 21:13:07.176941 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Oct 08 21:13:07.181529 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8f31b457-39fd-4906-9780-f07a972aca15'] Oct 08 21:13:07.181529 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:13:07.181529 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:13:07.181529 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:13:07.181529 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:13:07.181529 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 08 21:13:07.181529 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 08 21:13:07.181529 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 08 21:13:07.181529 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 08 21:13:07.181529 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Oct 08 21:13:07.181529 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8f31b457-39fd-4906-9780-f07a972aca15'] Oct 08 21:13:07.181529 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:13:07.181529 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:13:07.181529 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:13:07.181529 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:13:07.181529 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:13:07.181529 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:13:07.181529 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:13:07.181529 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:13:07.181529 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 08 21:13:07.181529 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 08 21:13:07.181529 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:13:07.181529 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:13:07.181529 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 08 21:13:07.181529 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 08 21:13:07.181529 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Oct 08 21:13:07.181529 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8f31b457-39fd-4906-9780-f07a972aca15'] Oct 08 21:13:07.181529 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:13:07.181529 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:13:07.181529 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:13:07.181529 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:13:07.181529 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:13:07.181529 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:13:07.181529 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:13:07.181529 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:13:07.181529 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Oct 08 21:13:07.181529 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8f31b457-39fd-4906-9780-f07a972aca15'] Oct 08 21:13:07.181529 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:13:07.186253 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-33079642-0dc1-487c-a650-16a9492c8bf2 tempest-SecurityGroupsNegativeTestJSON-1722676008 tempest-SecurityGroupsNegativeTestJSON-1722676008-project] Returning 400 to user: Insufficient rights for removing default security group. Oct 08 21:13:07.186253 ncdv-master-1 devstack@n-api.service[140491]: Neutron server returns request_ids: ['req-8f31b457-39fd-4906-9780-f07a972aca15'] {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:13:07.187840 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-33079642-0dc1-487c-a650-16a9492c8bf2 tempest-SecurityGroupsNegativeTestJSON-1722676008 tempest-SecurityGroupsNegativeTestJSON-1722676008-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/7d7606fc-85ea-4c04-ada1-a18bcb1d643b" status: 400 len: 182 microversion: 2.1 time: 1.020775 Oct 08 21:13:07.188485 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2370/4800] 10.222.0.26 () {58 vars in 1272 bytes} [Sat Oct 8 21:13:06 2022] DELETE /compute/v2.1/os-security-groups/7d7606fc-85ea-4c04-ada1-a18bcb1d643b => generated 182 bytes in 1022 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 08 21:13:07.211789 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-17c62ee0-2af9-4d77-8696-62abc0c6cf2a tempest-SecurityGroupsNegativeTestJSON-1722676008 tempest-SecurityGroupsNegativeTestJSON-1722676008-project] Calling method '.version_select at 0x7f1a87617550>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:13:07.313901 ncdv-master-1 devstack@n-api.service[140491]: DEBUG neutronclient.v2_0.client [None req-17c62ee0-2af9-4d77-8696-62abc0c6cf2a tempest-SecurityGroupsNegativeTestJSON-1722676008 tempest-SecurityGroupsNegativeTestJSON-1722676008-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group d2da48a4-ec7a-4de3-ab27-041ef12d91f7 does not exist", "detail": ""}} {{(pid=140491) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 08 21:13:07.316071 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.network.security_group_api [None req-17c62ee0-2af9-4d77-8696-62abc0c6cf2a tempest-SecurityGroupsNegativeTestJSON-1722676008 tempest-SecurityGroupsNegativeTestJSON-1722676008-project] Neutron security group d2da48a4-ec7a-4de3-ab27-041ef12d91f7 not found {{(pid=140491) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 08 21:13:07.316717 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-17c62ee0-2af9-4d77-8696-62abc0c6cf2a tempest-SecurityGroupsNegativeTestJSON-1722676008 tempest-SecurityGroupsNegativeTestJSON-1722676008-project] HTTP exception thrown: Security group d2da48a4-ec7a-4de3-ab27-041ef12d91f7 does not exist Oct 08 21:13:07.316717 ncdv-master-1 devstack@n-api.service[140491]: Neutron server returns request_ids: ['req-0358f7fe-5994-4247-96be-3c446e0d4493'] Oct 08 21:13:07.319678 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-17c62ee0-2af9-4d77-8696-62abc0c6cf2a tempest-SecurityGroupsNegativeTestJSON-1722676008 tempest-SecurityGroupsNegativeTestJSON-1722676008-project] Request method failure captured: Oct 08 21:13:07.319678 ncdv-master-1 devstack@n-api.service[140491]: request: GET /compute/v2.1/os-security-groups/d2da48a4-ec7a-4de3-ab27-041ef12d91f7 HTTP/1.1 Oct 08 21:13:07.319678 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:13:07.319678 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:13:07.319678 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:13:07.319678 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 21:13:07.319678 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:13:07.319678 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:13:07.319678 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:13:07.319678 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:13:07.319678 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeff07eqGGaN0LWg2Ji-icOxv0ohL6SDBvPHCFh-xRSwYYkDaxh3O7njRJVkg-OF2sY1OgcttGrze4R1z4tRKynSCpA0BqIF7dr5AMYIth0QZjP6jI3u7gNtrTrvKz0RltYDJfgg1xI2aMj_-bd1lscsV9Z9r3uzWYugYhCS0k6pFew Oct 08 21:13:07.319678 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:13:07.319678 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:13:07.319678 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:13:07.319678 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:13:07.319678 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:13:07.319678 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:13:07.319678 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 3207efb3c2484385b24e40119d1bb71a Oct 08 21:13:07.319678 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1722676008 Oct 08 21:13:07.319678 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:13:07.319678 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:13:07.319678 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3207efb3c2484385b24e40119d1bb71a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3207efb3c2484385b24e40119d1bb71a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3207efb3c2484385b24e40119d1bb71a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3207efb3c2484385b24e40119d1bb71a"}]}] Oct 08 21:13:07.319678 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1722676008 Oct 08 21:13:07.319678 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 3207efb3c2484385b24e40119d1bb71a Oct 08 21:13:07.319678 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1722676008 Oct 08 21:13:07.319678 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-SecurityGroupsNegativeTestJSON-1722676008-project Oct 08 21:13:07.319678 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:13:07.319678 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:13:07.319678 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 345fc5b62ae34cdc8323d5afb75a8a34 Oct 08 21:13:07.319678 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1722676008-project Oct 08 21:13:07.319678 ncdv-master-1 devstack@n-api.service[140491]: method: Oct 08 21:13:07.319678 ncdv-master-1 devstack@n-api.service[140491]: exception: Security group d2da48a4-ec7a-4de3-ab27-041ef12d91f7 does not exist Oct 08 21:13:07.319678 ncdv-master-1 devstack@n-api.service[140491]: Neutron server returns request_ids: ['req-0358f7fe-5994-4247-96be-3c446e0d4493'] Oct 08 21:13:07.319678 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': 'd2da48a4-ec7a-4de3-ab27-041ef12d91f7'} Oct 08 21:13:07.319678 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:13:07.319678 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:13:07.319678 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 08 21:13:07.319678 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 08 21:13:07.319678 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 08 21:13:07.319678 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 08 21:13:07.319678 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 08 21:13:07.319678 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 08 21:13:07.319678 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 08 21:13:07.319678 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 08 21:13:07.319678 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 08 21:13:07.319678 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 08 21:13:07.319678 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 08 21:13:07.319678 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 08 21:13:07.319678 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 08 21:13:07.319678 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 08 21:13:07.319678 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 08 21:13:07.319678 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 08 21:13:07.319678 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 08 21:13:07.319678 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 08 21:13:07.319678 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 08 21:13:07.319678 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 08 21:13:07.319678 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 08 21:13:07.319678 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 08 21:13:07.319678 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 08 21:13:07.319678 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 08 21:13:07.319678 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group d2da48a4-ec7a-4de3-ab27-041ef12d91f7 does not exist Oct 08 21:13:07.323552 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0358f7fe-5994-4247-96be-3c446e0d4493'] Oct 08 21:13:07.323552 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:13:07.323552 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:13:07.323552 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:13:07.323552 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:13:07.323552 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 08 21:13:07.323552 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 08 21:13:07.323552 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 08 21:13:07.323552 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 08 21:13:07.323552 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group d2da48a4-ec7a-4de3-ab27-041ef12d91f7 does not exist Oct 08 21:13:07.323552 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0358f7fe-5994-4247-96be-3c446e0d4493'] Oct 08 21:13:07.323552 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:13:07.323552 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:13:07.323552 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:13:07.323552 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:13:07.323552 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:13:07.323552 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:13:07.323552 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:13:07.323552 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:13:07.323552 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 08 21:13:07.323552 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 08 21:13:07.323552 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:13:07.323552 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:13:07.323552 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 08 21:13:07.323552 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 08 21:13:07.323552 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group d2da48a4-ec7a-4de3-ab27-041ef12d91f7 does not exist Oct 08 21:13:07.323552 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0358f7fe-5994-4247-96be-3c446e0d4493'] Oct 08 21:13:07.323552 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:13:07.323552 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:13:07.323552 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:13:07.323552 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:13:07.323552 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:13:07.323552 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:13:07.323552 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:13:07.323552 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:13:07.323552 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group d2da48a4-ec7a-4de3-ab27-041ef12d91f7 does not exist Oct 08 21:13:07.323552 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0358f7fe-5994-4247-96be-3c446e0d4493'] Oct 08 21:13:07.323552 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:13:07.323552 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-17c62ee0-2af9-4d77-8696-62abc0c6cf2a tempest-SecurityGroupsNegativeTestJSON-1722676008 tempest-SecurityGroupsNegativeTestJSON-1722676008-project] Returning 404 to user: Security group d2da48a4-ec7a-4de3-ab27-041ef12d91f7 does not exist Oct 08 21:13:07.323552 ncdv-master-1 devstack@n-api.service[140491]: Neutron server returns request_ids: ['req-0358f7fe-5994-4247-96be-3c446e0d4493'] {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:13:07.323552 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-17c62ee0-2af9-4d77-8696-62abc0c6cf2a tempest-SecurityGroupsNegativeTestJSON-1722676008 tempest-SecurityGroupsNegativeTestJSON-1722676008-project] 10.222.0.26 "GET /compute/v2.1/os-security-groups/d2da48a4-ec7a-4de3-ab27-041ef12d91f7" status: 404 len: 194 microversion: 2.1 time: 0.115484 Oct 08 21:13:07.323552 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2371/4801] 10.222.0.26 () {58 vars in 1269 bytes} [Sat Oct 8 21:13:07 2022] GET /compute/v2.1/os-security-groups/d2da48a4-ec7a-4de3-ab27-041ef12d91f7 => generated 194 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 08 21:13:07.333037 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-b6e9c986-32af-48ab-9570-eded2d95a579 tempest-SecurityGroupsNegativeTestJSON-1722676008 tempest-SecurityGroupsNegativeTestJSON-1722676008-project] Action: 'update', calling method: .version_select at 0x7f1a8766eb80>, body: {"security_group": {"name": "tempest-sg-1013581633", "description": "tempest-description-1458123857"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:13:07.482723 ncdv-master-1 devstack@n-api.service[140491]: DEBUG neutronclient.v2_0.client [None req-b6e9c986-32af-48ab-9570-eded2d95a579 tempest-SecurityGroupsNegativeTestJSON-1722676008 tempest-SecurityGroupsNegativeTestJSON-1722676008-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 23adbda5-51e0-46b6-a8ee-5a517019994b does not exist", "detail": ""}} {{(pid=140491) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 08 21:13:07.483549 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.network.security_group_api [None req-b6e9c986-32af-48ab-9570-eded2d95a579 tempest-SecurityGroupsNegativeTestJSON-1722676008 tempest-SecurityGroupsNegativeTestJSON-1722676008-project] Neutron security group 23adbda5-51e0-46b6-a8ee-5a517019994b not found {{(pid=140491) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 08 21:13:07.485020 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-b6e9c986-32af-48ab-9570-eded2d95a579 tempest-SecurityGroupsNegativeTestJSON-1722676008 tempest-SecurityGroupsNegativeTestJSON-1722676008-project] HTTP exception thrown: Security group 23adbda5-51e0-46b6-a8ee-5a517019994b does not exist Oct 08 21:13:07.485020 ncdv-master-1 devstack@n-api.service[140491]: Neutron server returns request_ids: ['req-6d3ef536-78fb-4bdc-aca8-9e165580f4c5'] Oct 08 21:13:07.489282 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-b6e9c986-32af-48ab-9570-eded2d95a579 tempest-SecurityGroupsNegativeTestJSON-1722676008 tempest-SecurityGroupsNegativeTestJSON-1722676008-project] Request method failure captured: Oct 08 21:13:07.489282 ncdv-master-1 devstack@n-api.service[140491]: request: PUT /compute/v2.1/os-security-groups/23adbda5-51e0-46b6-a8ee-5a517019994b HTTP/1.1 Oct 08 21:13:07.489282 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:13:07.489282 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:13:07.489282 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:13:07.489282 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 102 Oct 08 21:13:07.489282 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:13:07.489282 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:13:07.489282 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:13:07.489282 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:13:07.489282 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeff07eqGGaN0LWg2Ji-icOxv0ohL6SDBvPHCFh-xRSwYYkDaxh3O7njRJVkg-OF2sY1OgcttGrze4R1z4tRKynSCpA0BqIF7dr5AMYIth0QZjP6jI3u7gNtrTrvKz0RltYDJfgg1xI2aMj_-bd1lscsV9Z9r3uzWYugYhCS0k6pFew Oct 08 21:13:07.489282 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:13:07.489282 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:13:07.489282 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:13:07.489282 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:13:07.489282 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:13:07.489282 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:13:07.489282 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 3207efb3c2484385b24e40119d1bb71a Oct 08 21:13:07.489282 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1722676008 Oct 08 21:13:07.489282 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:13:07.489282 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:13:07.489282 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3207efb3c2484385b24e40119d1bb71a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3207efb3c2484385b24e40119d1bb71a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3207efb3c2484385b24e40119d1bb71a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3207efb3c2484385b24e40119d1bb71a"}]}] Oct 08 21:13:07.489282 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1722676008 Oct 08 21:13:07.489282 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 3207efb3c2484385b24e40119d1bb71a Oct 08 21:13:07.489282 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1722676008 Oct 08 21:13:07.489282 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-SecurityGroupsNegativeTestJSON-1722676008-project Oct 08 21:13:07.489282 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:13:07.489282 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:13:07.489282 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 345fc5b62ae34cdc8323d5afb75a8a34 Oct 08 21:13:07.489282 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1722676008-project Oct 08 21:13:07.489282 ncdv-master-1 devstack@n-api.service[140491]: Oct 08 21:13:07.489282 ncdv-master-1 devstack@n-api.service[140491]: {"security_group": {"name": "tempest-sg-1013581633", "description": "tempest-description-1458123857"}} Oct 08 21:13:07.489282 ncdv-master-1 devstack@n-api.service[140491]: method: Oct 08 21:13:07.489282 ncdv-master-1 devstack@n-api.service[140491]: exception: Security group 23adbda5-51e0-46b6-a8ee-5a517019994b does not exist Oct 08 21:13:07.489282 ncdv-master-1 devstack@n-api.service[140491]: Neutron server returns request_ids: ['req-6d3ef536-78fb-4bdc-aca8-9e165580f4c5'] Oct 08 21:13:07.489282 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': '23adbda5-51e0-46b6-a8ee-5a517019994b', 'body': {'security_group': {'name': 'tempest-sg-1013581633', 'description': 'tempest-description-1458123857'}}} Oct 08 21:13:07.489282 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:13:07.489282 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:13:07.489282 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 08 21:13:07.489282 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 08 21:13:07.489282 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 08 21:13:07.489282 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 08 21:13:07.489282 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 08 21:13:07.489282 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 08 21:13:07.489282 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 08 21:13:07.489282 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 08 21:13:07.489282 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 08 21:13:07.489282 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 08 21:13:07.489282 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 08 21:13:07.489282 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 08 21:13:07.489282 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 08 21:13:07.489282 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 08 21:13:07.489282 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 08 21:13:07.489282 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 08 21:13:07.489282 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 08 21:13:07.489282 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 08 21:13:07.489282 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 08 21:13:07.489282 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 08 21:13:07.489282 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 08 21:13:07.489282 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 08 21:13:07.489282 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 08 21:13:07.494985 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 08 21:13:07.494985 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 23adbda5-51e0-46b6-a8ee-5a517019994b does not exist Oct 08 21:13:07.494985 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6d3ef536-78fb-4bdc-aca8-9e165580f4c5'] Oct 08 21:13:07.494985 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:13:07.494985 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:13:07.494985 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:13:07.494985 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:13:07.494985 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Oct 08 21:13:07.494985 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 08 21:13:07.494985 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 08 21:13:07.494985 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 08 21:13:07.494985 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 23adbda5-51e0-46b6-a8ee-5a517019994b does not exist Oct 08 21:13:07.494985 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6d3ef536-78fb-4bdc-aca8-9e165580f4c5'] Oct 08 21:13:07.494985 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:13:07.494985 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:13:07.494985 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:13:07.494985 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:13:07.494985 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:13:07.494985 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:13:07.494985 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:13:07.494985 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:13:07.494985 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 08 21:13:07.494985 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 08 21:13:07.494985 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:13:07.494985 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:13:07.494985 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Oct 08 21:13:07.494985 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 08 21:13:07.494985 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 23adbda5-51e0-46b6-a8ee-5a517019994b does not exist Oct 08 21:13:07.494985 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6d3ef536-78fb-4bdc-aca8-9e165580f4c5'] Oct 08 21:13:07.494985 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:13:07.494985 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:13:07.494985 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:13:07.494985 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:13:07.494985 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:13:07.494985 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:13:07.494985 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:13:07.494985 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:13:07.494985 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 23adbda5-51e0-46b6-a8ee-5a517019994b does not exist Oct 08 21:13:07.494985 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6d3ef536-78fb-4bdc-aca8-9e165580f4c5'] Oct 08 21:13:07.494985 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:13:07.501902 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-b6e9c986-32af-48ab-9570-eded2d95a579 tempest-SecurityGroupsNegativeTestJSON-1722676008 tempest-SecurityGroupsNegativeTestJSON-1722676008-project] Returning 404 to user: Security group 23adbda5-51e0-46b6-a8ee-5a517019994b does not exist Oct 08 21:13:07.501902 ncdv-master-1 devstack@n-api.service[140491]: Neutron server returns request_ids: ['req-6d3ef536-78fb-4bdc-aca8-9e165580f4c5'] {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:13:07.501902 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-b6e9c986-32af-48ab-9570-eded2d95a579 tempest-SecurityGroupsNegativeTestJSON-1722676008 tempest-SecurityGroupsNegativeTestJSON-1722676008-project] 10.222.0.26 "PUT /compute/v2.1/os-security-groups/23adbda5-51e0-46b6-a8ee-5a517019994b" status: 404 len: 194 microversion: 2.1 time: 0.172627 Oct 08 21:13:07.501902 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2372/4802] 10.222.0.26 () {60 vars in 1290 bytes} [Sat Oct 8 21:13:07 2022] PUT /compute/v2.1/os-security-groups/23adbda5-51e0-46b6-a8ee-5a517019994b => generated 194 bytes in 174 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:13:07.676028 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-5a7ae5e7-255c-486a-aae0-08bc132a46cf tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Flavor limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 21:13:07.676627 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-5a7ae5e7-255c-486a-aae0-08bc132a46cf tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Image limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 21:13:07.677217 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-5a7ae5e7-255c-486a-aae0-08bc132a46cf tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Flavor pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 21:13:07.677720 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-5a7ae5e7-255c-486a-aae0-08bc132a46cf tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Image pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 21:13:07.678581 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-5a7ae5e7-255c-486a-aae0-08bc132a46cf tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 21:13:07.708081 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5a7ae5e7-255c-486a-aae0-08bc132a46cf tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:13:07.711957 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5a7ae5e7-255c-486a-aae0-08bc132a46cf tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:13:07.712638 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5a7ae5e7-255c-486a-aae0-08bc132a46cf tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:13:07.713703 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5a7ae5e7-255c-486a-aae0-08bc132a46cf tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:13:07.716086 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5a7ae5e7-255c-486a-aae0-08bc132a46cf tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:13:07.716755 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5a7ae5e7-255c-486a-aae0-08bc132a46cf tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:13:07.768346 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-5a7ae5e7-255c-486a-aae0-08bc132a46cf tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Getting quotas for project 7994439815e0416180c95158033ae3f2. Resources: {'cores', 'instances', 'ram'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:13:07.793179 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-5a7ae5e7-255c-486a-aae0-08bc132a46cf tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Getting quotas for user de71b64a2e1c4b6aaa15b5ee75003add and project 7994439815e0416180c95158033ae3f2. Resources: {'cores', 'instances', 'ram'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:13:07.831109 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-5a7ae5e7-255c-486a-aae0-08bc132a46cf tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Going to run 1 instances... {{(pid=140492) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 21:13:07.838564 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-5a7ae5e7-255c-486a-aae0-08bc132a46cf tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] [instance: 64039cd8-bbfa-4797-9e3c-acf4715c67a4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c508bd7f-7db9-4b2c-af7c-be54a855c355',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140492) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 21:13:07.960263 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-5a7ae5e7-255c-486a-aae0-08bc132a46cf tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.435286 Oct 08 21:13:07.960894 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2431/4803] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 21:13:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 2438 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 08 21:13:07.973838 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-86b504ba-746a-4f67-89a7-6e45de43e972 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:13:07.975419 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-86b504ba-746a-4f67-89a7-6e45de43e972 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] [instance: 64039cd8-bbfa-4797-9e3c-acf4715c67a4] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:13:08.397478 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-86b504ba-746a-4f67-89a7-6e45de43e972 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de71b64a2e1c4b6aaa15b5ee75003add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994439815e0416180c95158033ae3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:13:08.405072 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-86b504ba-746a-4f67-89a7-6e45de43e972 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] 10.222.0.26 "GET /compute/v2.1/servers/64039cd8-bbfa-4797-9e3c-acf4715c67a4" status: 200 len: 1217 microversion: 2.1 time: 0.435645 Oct 08 21:13:08.406078 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2373/4804] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:13:07 2022] GET /compute/v2.1/servers/64039cd8-bbfa-4797-9e3c-acf4715c67a4 => generated 1217 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:13:09.442030 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-aa908abf-8cca-4003-af91-74aae2960189 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:13:09.442448 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-aa908abf-8cca-4003-af91-74aae2960189 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] [instance: 64039cd8-bbfa-4797-9e3c-acf4715c67a4] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:13:09.461767 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-aa908abf-8cca-4003-af91-74aae2960189 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:13:09.462287 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-aa908abf-8cca-4003-af91-74aae2960189 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:13:09.464635 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-aa908abf-8cca-4003-af91-74aae2960189 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:13:09.465437 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-aa908abf-8cca-4003-af91-74aae2960189 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:13:09.468935 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-aa908abf-8cca-4003-af91-74aae2960189 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:13:09.472000 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-aa908abf-8cca-4003-af91-74aae2960189 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:13:09.714907 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-aa908abf-8cca-4003-af91-74aae2960189 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de71b64a2e1c4b6aaa15b5ee75003add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994439815e0416180c95158033ae3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:13:09.732704 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-aa908abf-8cca-4003-af91-74aae2960189 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] 10.222.0.26 "GET /compute/v2.1/servers/64039cd8-bbfa-4797-9e3c-acf4715c67a4" status: 200 len: 1269 microversion: 2.1 time: 0.297074 Oct 08 21:13:09.737326 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2432/4805] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:13:09 2022] GET /compute/v2.1/servers/64039cd8-bbfa-4797-9e3c-acf4715c67a4 => generated 1269 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:13:10.770878 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-fc57397c-f031-4599-9bbb-c6954339a18e tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:13:10.773339 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-fc57397c-f031-4599-9bbb-c6954339a18e tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] [instance: 64039cd8-bbfa-4797-9e3c-acf4715c67a4] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:13:10.794618 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fc57397c-f031-4599-9bbb-c6954339a18e tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:13:10.801987 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fc57397c-f031-4599-9bbb-c6954339a18e tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:13:10.804071 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fc57397c-f031-4599-9bbb-c6954339a18e tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:13:10.806722 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fc57397c-f031-4599-9bbb-c6954339a18e tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:13:10.807225 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fc57397c-f031-4599-9bbb-c6954339a18e tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:13:10.807683 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fc57397c-f031-4599-9bbb-c6954339a18e tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:13:11.039233 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-fc57397c-f031-4599-9bbb-c6954339a18e tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de71b64a2e1c4b6aaa15b5ee75003add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994439815e0416180c95158033ae3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:13:11.056496 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-fc57397c-f031-4599-9bbb-c6954339a18e tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] 10.222.0.26 "GET /compute/v2.1/servers/64039cd8-bbfa-4797-9e3c-acf4715c67a4" status: 200 len: 1275 microversion: 2.1 time: 0.295430 Oct 08 21:13:11.060486 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2374/4806] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:13:10 2022] GET /compute/v2.1/servers/64039cd8-bbfa-4797-9e3c-acf4715c67a4 => generated 1275 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:13:12.087909 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-b2ac4295-058f-4d22-ac3b-4836785f4926 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:13:12.089448 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-b2ac4295-058f-4d22-ac3b-4836785f4926 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] [instance: 64039cd8-bbfa-4797-9e3c-acf4715c67a4] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:13:12.114835 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b2ac4295-058f-4d22-ac3b-4836785f4926 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:13:12.115535 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b2ac4295-058f-4d22-ac3b-4836785f4926 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:13:12.116878 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b2ac4295-058f-4d22-ac3b-4836785f4926 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:13:12.118779 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b2ac4295-058f-4d22-ac3b-4836785f4926 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:13:12.119814 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b2ac4295-058f-4d22-ac3b-4836785f4926 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:13:12.120608 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b2ac4295-058f-4d22-ac3b-4836785f4926 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:13:12.656155 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-b2ac4295-058f-4d22-ac3b-4836785f4926 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de71b64a2e1c4b6aaa15b5ee75003add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994439815e0416180c95158033ae3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:13:12.687390 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-b2ac4295-058f-4d22-ac3b-4836785f4926 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] 10.222.0.26 "GET /compute/v2.1/servers/64039cd8-bbfa-4797-9e3c-acf4715c67a4" status: 200 len: 1275 microversion: 2.1 time: 0.607694 Oct 08 21:13:12.688010 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2433/4807] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:13:12 2022] GET /compute/v2.1/servers/64039cd8-bbfa-4797-9e3c-acf4715c67a4 => generated 1275 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:13:13.711809 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-432189c4-c027-443a-9f1c-d21de453b095 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:13:13.713527 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-432189c4-c027-443a-9f1c-d21de453b095 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] [instance: 64039cd8-bbfa-4797-9e3c-acf4715c67a4] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:13:13.723421 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-432189c4-c027-443a-9f1c-d21de453b095 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:13:13.727176 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-432189c4-c027-443a-9f1c-d21de453b095 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:13:13.727822 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-432189c4-c027-443a-9f1c-d21de453b095 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:13:13.728773 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-432189c4-c027-443a-9f1c-d21de453b095 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:13:13.729483 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-432189c4-c027-443a-9f1c-d21de453b095 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:13:13.731223 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-432189c4-c027-443a-9f1c-d21de453b095 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:13:14.905489 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-432189c4-c027-443a-9f1c-d21de453b095 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de71b64a2e1c4b6aaa15b5ee75003add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994439815e0416180c95158033ae3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:13:14.913461 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-432189c4-c027-443a-9f1c-d21de453b095 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] 10.222.0.26 "GET /compute/v2.1/servers/64039cd8-bbfa-4797-9e3c-acf4715c67a4" status: 200 len: 1317 microversion: 2.1 time: 1.205734 Oct 08 21:13:14.918815 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2375/4808] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:13:13 2022] GET /compute/v2.1/servers/64039cd8-bbfa-4797-9e3c-acf4715c67a4 => generated 1317 bytes in 1212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:13:15.938377 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-d4d09270-c308-40b2-b98f-ae8642269201 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:13:15.939791 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-d4d09270-c308-40b2-b98f-ae8642269201 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] [instance: 64039cd8-bbfa-4797-9e3c-acf4715c67a4] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:13:15.962321 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d4d09270-c308-40b2-b98f-ae8642269201 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:13:15.965610 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d4d09270-c308-40b2-b98f-ae8642269201 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:13:15.966832 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d4d09270-c308-40b2-b98f-ae8642269201 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:13:15.970863 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d4d09270-c308-40b2-b98f-ae8642269201 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:13:15.971679 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d4d09270-c308-40b2-b98f-ae8642269201 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:13:15.974017 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d4d09270-c308-40b2-b98f-ae8642269201 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:13:16.459645 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-d4d09270-c308-40b2-b98f-ae8642269201 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de71b64a2e1c4b6aaa15b5ee75003add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994439815e0416180c95158033ae3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:13:16.494784 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-d4d09270-c308-40b2-b98f-ae8642269201 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] 10.222.0.26 "GET /compute/v2.1/servers/64039cd8-bbfa-4797-9e3c-acf4715c67a4" status: 200 len: 1317 microversion: 2.1 time: 0.538480 Oct 08 21:13:16.500120 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2434/4809] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:13:15 2022] GET /compute/v2.1/servers/64039cd8-bbfa-4797-9e3c-acf4715c67a4 => generated 1317 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:13:17.527157 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-ac358dda-3f6e-4786-9e9a-735f894f6c82 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:13:17.527793 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-ac358dda-3f6e-4786-9e9a-735f894f6c82 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] [instance: 64039cd8-bbfa-4797-9e3c-acf4715c67a4] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:13:17.531070 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:SELECT=20 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:13:17.540980 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ac358dda-3f6e-4786-9e9a-735f894f6c82 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:13:17.541473 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ac358dda-3f6e-4786-9e9a-735f894f6c82 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:13:17.542036 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ac358dda-3f6e-4786-9e9a-735f894f6c82 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:13:17.548833 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ac358dda-3f6e-4786-9e9a-735f894f6c82 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:13:17.549565 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ac358dda-3f6e-4786-9e9a-735f894f6c82 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:13:17.550049 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ac358dda-3f6e-4786-9e9a-735f894f6c82 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:13:18.401732 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=2 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:13:18.626626 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-285adca3-2d65-4bb3-a205-1d1bce77cf2e req-752e9135-23bd-473e-8175-3dc8d6fadc60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64039cd8-bbfa-4797-9e3c-acf4715c67a4", "tag": "ac63c755-9e73-4f6f-89f2-d960044116e3"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:13:18.638235 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=2 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:13:18.640052 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=6 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:13:18.659815 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-285adca3-2d65-4bb3-a205-1d1bce77cf2e req-752e9135-23bd-473e-8175-3dc8d6fadc60 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:13:18.660308 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-285adca3-2d65-4bb3-a205-1d1bce77cf2e req-752e9135-23bd-473e-8175-3dc8d6fadc60 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:13:18.660750 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-285adca3-2d65-4bb3-a205-1d1bce77cf2e req-752e9135-23bd-473e-8175-3dc8d6fadc60 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:13:18.683989 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-285adca3-2d65-4bb3-a205-1d1bce77cf2e req-752e9135-23bd-473e-8175-3dc8d6fadc60 service nova] Creating event network-changed:ac63c755-9e73-4f6f-89f2-d960044116e3 for instance 64039cd8-bbfa-4797-9e3c-acf4715c67a4 on nch1-master-1 Oct 08 21:13:18.689877 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-285adca3-2d65-4bb3-a205-1d1bce77cf2e req-752e9135-23bd-473e-8175-3dc8d6fadc60 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067031 Oct 08 21:13:18.692813 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2435/4810] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:13:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:13:18.693938 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-ac358dda-3f6e-4786-9e9a-735f894f6c82 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de71b64a2e1c4b6aaa15b5ee75003add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994439815e0416180c95158033ae3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:13:18.715637 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-ac358dda-3f6e-4786-9e9a-735f894f6c82 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] 10.222.0.26 "GET /compute/v2.1/servers/64039cd8-bbfa-4797-9e3c-acf4715c67a4" status: 200 len: 1317 microversion: 2.1 time: 1.193451 Oct 08 21:13:18.716548 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2376/4811] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:13:17 2022] GET /compute/v2.1/servers/64039cd8-bbfa-4797-9e3c-acf4715c67a4 => generated 1317 bytes in 1195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:13:19.743293 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-44f604ae-0bf8-4b85-a13e-0a682f698806 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:13:19.744843 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-44f604ae-0bf8-4b85-a13e-0a682f698806 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] [instance: 64039cd8-bbfa-4797-9e3c-acf4715c67a4] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:13:19.763401 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-44f604ae-0bf8-4b85-a13e-0a682f698806 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:13:19.765167 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-44f604ae-0bf8-4b85-a13e-0a682f698806 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:13:19.766732 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-44f604ae-0bf8-4b85-a13e-0a682f698806 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:13:19.768733 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-44f604ae-0bf8-4b85-a13e-0a682f698806 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:13:19.770935 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-44f604ae-0bf8-4b85-a13e-0a682f698806 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:13:19.772197 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-44f604ae-0bf8-4b85-a13e-0a682f698806 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:13:20.506343 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-44f604ae-0bf8-4b85-a13e-0a682f698806 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de71b64a2e1c4b6aaa15b5ee75003add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994439815e0416180c95158033ae3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:13:20.520873 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-44f604ae-0bf8-4b85-a13e-0a682f698806 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] 10.222.0.26 "GET /compute/v2.1/servers/64039cd8-bbfa-4797-9e3c-acf4715c67a4" status: 200 len: 1317 microversion: 2.1 time: 0.783736 Oct 08 21:13:20.529656 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2436/4812] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:13:19 2022] GET /compute/v2.1/servers/64039cd8-bbfa-4797-9e3c-acf4715c67a4 => generated 1317 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:13:21.545775 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-13be6be2-43ef-41b4-9c8f-b06143e49d4a tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:13:21.547234 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-13be6be2-43ef-41b4-9c8f-b06143e49d4a tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] [instance: 64039cd8-bbfa-4797-9e3c-acf4715c67a4] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:13:21.580348 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-13be6be2-43ef-41b4-9c8f-b06143e49d4a tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:13:21.586667 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-13be6be2-43ef-41b4-9c8f-b06143e49d4a tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:13:21.586667 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-13be6be2-43ef-41b4-9c8f-b06143e49d4a tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:13:21.586667 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-13be6be2-43ef-41b4-9c8f-b06143e49d4a tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:13:21.588210 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-13be6be2-43ef-41b4-9c8f-b06143e49d4a tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:13:21.589036 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-13be6be2-43ef-41b4-9c8f-b06143e49d4a tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:13:21.599598 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=46 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:13:22.116802 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-13be6be2-43ef-41b4-9c8f-b06143e49d4a tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de71b64a2e1c4b6aaa15b5ee75003add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994439815e0416180c95158033ae3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:13:22.125844 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-13be6be2-43ef-41b4-9c8f-b06143e49d4a tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] 10.222.0.26 "GET /compute/v2.1/servers/64039cd8-bbfa-4797-9e3c-acf4715c67a4" status: 200 len: 1317 microversion: 2.1 time: 0.585854 Oct 08 21:13:22.139944 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2377/4813] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:13:21 2022] GET /compute/v2.1/servers/64039cd8-bbfa-4797-9e3c-acf4715c67a4 => generated 1317 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:13:23.161751 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-97416b1d-e14c-4690-ba32-a6aa40eacf56 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:13:23.163312 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-97416b1d-e14c-4690-ba32-a6aa40eacf56 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] [instance: 64039cd8-bbfa-4797-9e3c-acf4715c67a4] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:13:23.171752 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:13:23.215132 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-97416b1d-e14c-4690-ba32-a6aa40eacf56 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:13:23.216648 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-97416b1d-e14c-4690-ba32-a6aa40eacf56 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:13:23.220187 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-97416b1d-e14c-4690-ba32-a6aa40eacf56 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:13:23.223287 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-97416b1d-e14c-4690-ba32-a6aa40eacf56 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:13:23.224050 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-97416b1d-e14c-4690-ba32-a6aa40eacf56 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:13:23.226743 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-97416b1d-e14c-4690-ba32-a6aa40eacf56 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:13:24.351053 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-97416b1d-e14c-4690-ba32-a6aa40eacf56 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de71b64a2e1c4b6aaa15b5ee75003add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994439815e0416180c95158033ae3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:13:24.393304 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-97416b1d-e14c-4690-ba32-a6aa40eacf56 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] 10.222.0.26 "GET /compute/v2.1/servers/64039cd8-bbfa-4797-9e3c-acf4715c67a4" status: 200 len: 1317 microversion: 2.1 time: 1.229149 Oct 08 21:13:24.395842 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2437/4814] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:13:23 2022] GET /compute/v2.1/servers/64039cd8-bbfa-4797-9e3c-acf4715c67a4 => generated 1317 bytes in 1241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:13:25.427339 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-17255081-2c88-42f8-b84a-dcbd394ea192 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:13:25.428625 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-17255081-2c88-42f8-b84a-dcbd394ea192 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] [instance: 64039cd8-bbfa-4797-9e3c-acf4715c67a4] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:13:25.444539 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-17255081-2c88-42f8-b84a-dcbd394ea192 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:13:25.452012 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-17255081-2c88-42f8-b84a-dcbd394ea192 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:13:25.452946 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-17255081-2c88-42f8-b84a-dcbd394ea192 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:13:25.454109 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-17255081-2c88-42f8-b84a-dcbd394ea192 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:13:25.455750 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-17255081-2c88-42f8-b84a-dcbd394ea192 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:13:25.460758 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-17255081-2c88-42f8-b84a-dcbd394ea192 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:13:25.684917 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-f9cf1387-3872-4551-8feb-44033c34ff3e req-59b9ad76-0edf-4473-a1ab-df4b10e936e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64039cd8-bbfa-4797-9e3c-acf4715c67a4", "name": "network-vif-plugged", "status": "completed", "tag": "ac63c755-9e73-4f6f-89f2-d960044116e3"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:13:25.710534 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-f9cf1387-3872-4551-8feb-44033c34ff3e req-59b9ad76-0edf-4473-a1ab-df4b10e936e3 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:13:25.711515 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-f9cf1387-3872-4551-8feb-44033c34ff3e req-59b9ad76-0edf-4473-a1ab-df4b10e936e3 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:13:25.714345 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-f9cf1387-3872-4551-8feb-44033c34ff3e req-59b9ad76-0edf-4473-a1ab-df4b10e936e3 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:13:25.745876 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-f9cf1387-3872-4551-8feb-44033c34ff3e req-59b9ad76-0edf-4473-a1ab-df4b10e936e3 service nova] Creating event network-vif-plugged:ac63c755-9e73-4f6f-89f2-d960044116e3 for instance 64039cd8-bbfa-4797-9e3c-acf4715c67a4 on nch1-master-1 Oct 08 21:13:25.754909 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-f9cf1387-3872-4551-8feb-44033c34ff3e req-59b9ad76-0edf-4473-a1ab-df4b10e936e3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074382 Oct 08 21:13:25.755534 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2438/4815] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:13:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:13:26.073645 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-17255081-2c88-42f8-b84a-dcbd394ea192 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de71b64a2e1c4b6aaa15b5ee75003add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994439815e0416180c95158033ae3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:13:26.088051 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-17255081-2c88-42f8-b84a-dcbd394ea192 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] 10.222.0.26 "GET /compute/v2.1/servers/64039cd8-bbfa-4797-9e3c-acf4715c67a4" status: 200 len: 1317 microversion: 2.1 time: 0.666228 Oct 08 21:13:26.089523 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2378/4816] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:13:25 2022] GET /compute/v2.1/servers/64039cd8-bbfa-4797-9e3c-acf4715c67a4 => generated 1317 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:13:27.113087 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-f0d4c0bb-89a3-4ef4-93e9-489a732af1f6 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:13:27.113834 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-f0d4c0bb-89a3-4ef4-93e9-489a732af1f6 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] [instance: 64039cd8-bbfa-4797-9e3c-acf4715c67a4] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:13:27.137723 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f0d4c0bb-89a3-4ef4-93e9-489a732af1f6 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:13:27.138228 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f0d4c0bb-89a3-4ef4-93e9-489a732af1f6 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:13:27.138690 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f0d4c0bb-89a3-4ef4-93e9-489a732af1f6 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:13:27.139447 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f0d4c0bb-89a3-4ef4-93e9-489a732af1f6 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:13:27.140430 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f0d4c0bb-89a3-4ef4-93e9-489a732af1f6 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:13:27.140430 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f0d4c0bb-89a3-4ef4-93e9-489a732af1f6 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:13:27.657909 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-f0d4c0bb-89a3-4ef4-93e9-489a732af1f6 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de71b64a2e1c4b6aaa15b5ee75003add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994439815e0416180c95158033ae3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:13:27.680993 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-f0d4c0bb-89a3-4ef4-93e9-489a732af1f6 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] 10.222.0.26 "GET /compute/v2.1/servers/64039cd8-bbfa-4797-9e3c-acf4715c67a4" status: 200 len: 1317 microversion: 2.1 time: 0.572917 Oct 08 21:13:27.684108 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2439/4817] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:13:27 2022] GET /compute/v2.1/servers/64039cd8-bbfa-4797-9e3c-acf4715c67a4 => generated 1317 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:13:28.714358 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-3410e820-9adb-4dbe-9371-04dbfeb6127a tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:13:28.715208 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-3410e820-9adb-4dbe-9371-04dbfeb6127a tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] [instance: 64039cd8-bbfa-4797-9e3c-acf4715c67a4] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:13:28.737228 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3410e820-9adb-4dbe-9371-04dbfeb6127a tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:13:28.742141 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3410e820-9adb-4dbe-9371-04dbfeb6127a tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:13:28.742612 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3410e820-9adb-4dbe-9371-04dbfeb6127a tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:13:28.745517 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3410e820-9adb-4dbe-9371-04dbfeb6127a tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:13:28.746005 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3410e820-9adb-4dbe-9371-04dbfeb6127a tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:13:28.749555 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3410e820-9adb-4dbe-9371-04dbfeb6127a tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:13:29.231071 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-57e54e64-fab2-42ec-be5c-ca0ecb89390b tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-1225468207", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "networks": [{"uuid": "59cb9a74-8d67-4170-9155-e7c2f4397ec0"}]}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:13:29.326654 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.network.neutron [None req-57e54e64-fab2-42ec-be5c-ca0ecb89390b tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] validate_networks() for [('59cb9a74-8d67-4170-9155-e7c2f4397ec0', None, None, None, None, None)] {{(pid=140491) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 21:13:29.802614 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-3410e820-9adb-4dbe-9371-04dbfeb6127a tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de71b64a2e1c4b6aaa15b5ee75003add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994439815e0416180c95158033ae3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:13:29.813643 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-3410e820-9adb-4dbe-9371-04dbfeb6127a tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] 10.222.0.26 "GET /compute/v2.1/servers/64039cd8-bbfa-4797-9e3c-acf4715c67a4" status: 200 len: 1505 microversion: 2.1 time: 1.105596 Oct 08 21:13:29.819136 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2440/4818] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:13:28 2022] GET /compute/v2.1/servers/64039cd8-bbfa-4797-9e3c-acf4715c67a4 => generated 1505 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:13:29.843358 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-31d4c0d0-0f6f-4d82-a4ce-7ad17f7cca18 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:13:29.845106 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-31d4c0d0-0f6f-4d82-a4ce-7ad17f7cca18 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] [instance: 64039cd8-bbfa-4797-9e3c-acf4715c67a4] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:13:29.869593 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-31d4c0d0-0f6f-4d82-a4ce-7ad17f7cca18 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:13:29.870026 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-31d4c0d0-0f6f-4d82-a4ce-7ad17f7cca18 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:13:29.870489 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-31d4c0d0-0f6f-4d82-a4ce-7ad17f7cca18 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:13:29.875196 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-31d4c0d0-0f6f-4d82-a4ce-7ad17f7cca18 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:13:29.875705 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-31d4c0d0-0f6f-4d82-a4ce-7ad17f7cca18 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:13:29.876154 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-31d4c0d0-0f6f-4d82-a4ce-7ad17f7cca18 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:13:30.371507 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-31d4c0d0-0f6f-4d82-a4ce-7ad17f7cca18 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de71b64a2e1c4b6aaa15b5ee75003add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994439815e0416180c95158033ae3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:13:30.383885 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-31d4c0d0-0f6f-4d82-a4ce-7ad17f7cca18 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] 10.222.0.26 "GET /compute/v2.1/servers/64039cd8-bbfa-4797-9e3c-acf4715c67a4" status: 200 len: 1505 microversion: 2.1 time: 0.544496 Oct 08 21:13:30.393637 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2441/4819] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:13:29 2022] GET /compute/v2.1/servers/64039cd8-bbfa-4797-9e3c-acf4715c67a4 => generated 1505 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:13:30.410971 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-ff90e107-ccb1-44e3-99e0-c2da16a899f7 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "OS-DCF:diskConfig": "AUTO"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:13:30.422752 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-ff90e107-ccb1-44e3-99e0-c2da16a899f7 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] [instance: 64039cd8-bbfa-4797-9e3c-acf4715c67a4] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:13:30.437082 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ff90e107-ccb1-44e3-99e0-c2da16a899f7 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:13:30.441117 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ff90e107-ccb1-44e3-99e0-c2da16a899f7 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:13:30.441117 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ff90e107-ccb1-44e3-99e0-c2da16a899f7 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:13:30.441117 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ff90e107-ccb1-44e3-99e0-c2da16a899f7 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:13:30.441373 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ff90e107-ccb1-44e3-99e0-c2da16a899f7 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:13:30.441800 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ff90e107-ccb1-44e3-99e0-c2da16a899f7 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:13:30.603229 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-ff90e107-ccb1-44e3-99e0-c2da16a899f7 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Flavor limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 21:13:30.604088 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-ff90e107-ccb1-44e3-99e0-c2da16a899f7 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Image limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 21:13:30.604804 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-ff90e107-ccb1-44e3-99e0-c2da16a899f7 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Flavor pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 21:13:30.606896 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-ff90e107-ccb1-44e3-99e0-c2da16a899f7 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Image pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 21:13:30.607637 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-ff90e107-ccb1-44e3-99e0-c2da16a899f7 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 21:13:30.739952 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-ff90e107-ccb1-44e3-99e0-c2da16a899f7 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] [instance: 64039cd8-bbfa-4797-9e3c-acf4715c67a4] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:13:30.761901 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ff90e107-ccb1-44e3-99e0-c2da16a899f7 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:13:30.762451 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ff90e107-ccb1-44e3-99e0-c2da16a899f7 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:13:30.762909 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ff90e107-ccb1-44e3-99e0-c2da16a899f7 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:13:30.766106 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ff90e107-ccb1-44e3-99e0-c2da16a899f7 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:13:30.766811 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ff90e107-ccb1-44e3-99e0-c2da16a899f7 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:13:30.768091 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ff90e107-ccb1-44e3-99e0-c2da16a899f7 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:13:30.887103 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-ff90e107-ccb1-44e3-99e0-c2da16a899f7 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] 10.222.0.26 "POST /compute/v2.1/servers/64039cd8-bbfa-4797-9e3c-acf4715c67a4/action" status: 202 len: 1107 microversion: 2.1 time: 0.480679 Oct 08 21:13:30.890859 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2442/4820] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:13:30 2022] POST /compute/v2.1/servers/64039cd8-bbfa-4797-9e3c-acf4715c67a4/action => generated 1107 bytes in 485 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Oct 08 21:13:30.910915 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-29a21149-c612-4497-9548-a0f2ba79b6c3 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:13:30.911855 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-29a21149-c612-4497-9548-a0f2ba79b6c3 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] [instance: 64039cd8-bbfa-4797-9e3c-acf4715c67a4] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:13:30.918827 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-29a21149-c612-4497-9548-a0f2ba79b6c3 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:13:30.919795 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-29a21149-c612-4497-9548-a0f2ba79b6c3 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:13:30.920703 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-29a21149-c612-4497-9548-a0f2ba79b6c3 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:13:30.921689 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-29a21149-c612-4497-9548-a0f2ba79b6c3 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:13:30.922380 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-29a21149-c612-4497-9548-a0f2ba79b6c3 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:13:30.923624 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-29a21149-c612-4497-9548-a0f2ba79b6c3 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:13:31.039213 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-57e54e64-fab2-42ec-be5c-ca0ecb89390b tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Flavor limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 21:13:31.039765 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-57e54e64-fab2-42ec-be5c-ca0ecb89390b tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Image limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 21:13:31.040146 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-57e54e64-fab2-42ec-be5c-ca0ecb89390b tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Flavor pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 21:13:31.040567 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-57e54e64-fab2-42ec-be5c-ca0ecb89390b tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Image pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 21:13:31.041056 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-57e54e64-fab2-42ec-be5c-ca0ecb89390b tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 21:13:31.067904 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-57e54e64-fab2-42ec-be5c-ca0ecb89390b tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:13:31.069480 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-57e54e64-fab2-42ec-be5c-ca0ecb89390b tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:13:31.070914 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-57e54e64-fab2-42ec-be5c-ca0ecb89390b tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:13:31.074299 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-57e54e64-fab2-42ec-be5c-ca0ecb89390b tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:13:31.074920 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-57e54e64-fab2-42ec-be5c-ca0ecb89390b tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:13:31.075456 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-57e54e64-fab2-42ec-be5c-ca0ecb89390b tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:13:31.135139 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-57e54e64-fab2-42ec-be5c-ca0ecb89390b tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Getting quotas for project 195ea87b43684ed59b1b1c048b0584b3. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:13:31.148544 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-57e54e64-fab2-42ec-be5c-ca0ecb89390b tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Getting quotas for user 0a6b3f4cefa94e269186f9d9e5aff559 and project 195ea87b43684ed59b1b1c048b0584b3. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:13:31.182159 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-57e54e64-fab2-42ec-be5c-ca0ecb89390b tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Going to run 1 instances... {{(pid=140491) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 21:13:31.193871 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-57e54e64-fab2-42ec-be5c-ca0ecb89390b tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] [instance: d66d3500-8ca0-439d-b982-fab393d0187c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c508bd7f-7db9-4b2c-af7c-be54a855c355',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140491) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 21:13:31.340337 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-57e54e64-fab2-42ec-be5c-ca0ecb89390b tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.744659 Oct 08 21:13:31.343218 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2379/4821] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 21:13:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 2748 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 08 21:13:31.362939 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-e2d34933-6e87-49fe-9074-cc4b527689a6 tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:13:31.365008 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-e2d34933-6e87-49fe-9074-cc4b527689a6 tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] [instance: d66d3500-8ca0-439d-b982-fab393d0187c] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:13:31.641776 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-e2d34933-6e87-49fe-9074-cc4b527689a6 tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6b3f4cefa94e269186f9d9e5aff559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195ea87b43684ed59b1b1c048b0584b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:13:31.651508 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-e2d34933-6e87-49fe-9074-cc4b527689a6 tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] 10.222.0.26 "GET /compute/v2.1/servers/d66d3500-8ca0-439d-b982-fab393d0187c" status: 200 len: 1228 microversion: 2.1 time: 0.299958 Oct 08 21:13:31.660465 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2380/4822] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:13:31 2022] GET /compute/v2.1/servers/d66d3500-8ca0-439d-b982-fab393d0187c => generated 1228 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:13:32.503775 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-29a21149-c612-4497-9548-a0f2ba79b6c3 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de71b64a2e1c4b6aaa15b5ee75003add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994439815e0416180c95158033ae3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:13:32.562685 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-29a21149-c612-4497-9548-a0f2ba79b6c3 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] 10.222.0.26 "GET /compute/v2.1/servers/64039cd8-bbfa-4797-9e3c-acf4715c67a4" status: 200 len: 1512 microversion: 2.1 time: 1.656214 Oct 08 21:13:32.564965 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2443/4823] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:13:30 2022] GET /compute/v2.1/servers/64039cd8-bbfa-4797-9e3c-acf4715c67a4 => generated 1512 bytes in 1659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:13:32.686484 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-dce02998-7a14-4519-a112-0cd71090506e tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:13:32.687121 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-dce02998-7a14-4519-a112-0cd71090506e tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] [instance: d66d3500-8ca0-439d-b982-fab393d0187c] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:13:32.711955 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dce02998-7a14-4519-a112-0cd71090506e tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:13:32.712838 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dce02998-7a14-4519-a112-0cd71090506e tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:13:32.716464 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dce02998-7a14-4519-a112-0cd71090506e tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:13:32.718328 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dce02998-7a14-4519-a112-0cd71090506e tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:13:32.719558 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dce02998-7a14-4519-a112-0cd71090506e tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:13:32.724715 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dce02998-7a14-4519-a112-0cd71090506e tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:13:33.033500 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-dce02998-7a14-4519-a112-0cd71090506e tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6b3f4cefa94e269186f9d9e5aff559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195ea87b43684ed59b1b1c048b0584b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:13:33.057794 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-dce02998-7a14-4519-a112-0cd71090506e tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] 10.222.0.26 "GET /compute/v2.1/servers/d66d3500-8ca0-439d-b982-fab393d0187c" status: 200 len: 1224 microversion: 2.1 time: 0.377499 Oct 08 21:13:33.063454 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2381/4824] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:13:32 2022] GET /compute/v2.1/servers/d66d3500-8ca0-439d-b982-fab393d0187c => generated 1224 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:13:33.591327 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-7a046e4f-372e-4656-9ea6-345e9264443d tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:13:33.592621 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-7a046e4f-372e-4656-9ea6-345e9264443d tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] [instance: 64039cd8-bbfa-4797-9e3c-acf4715c67a4] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:13:33.622130 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7a046e4f-372e-4656-9ea6-345e9264443d tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:13:33.622921 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7a046e4f-372e-4656-9ea6-345e9264443d tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:13:33.625488 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7a046e4f-372e-4656-9ea6-345e9264443d tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:13:33.629154 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7a046e4f-372e-4656-9ea6-345e9264443d tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:13:33.630112 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7a046e4f-372e-4656-9ea6-345e9264443d tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:13:33.631048 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7a046e4f-372e-4656-9ea6-345e9264443d tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:13:34.086383 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-fe38af1e-4038-41bb-a6e1-d2014eee7945 tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:13:34.087677 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-fe38af1e-4038-41bb-a6e1-d2014eee7945 tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] [instance: d66d3500-8ca0-439d-b982-fab393d0187c] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:13:34.102155 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fe38af1e-4038-41bb-a6e1-d2014eee7945 tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:13:34.102889 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fe38af1e-4038-41bb-a6e1-d2014eee7945 tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:13:34.104094 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fe38af1e-4038-41bb-a6e1-d2014eee7945 tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:13:34.106107 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fe38af1e-4038-41bb-a6e1-d2014eee7945 tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:13:34.106773 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fe38af1e-4038-41bb-a6e1-d2014eee7945 tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:13:34.112020 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fe38af1e-4038-41bb-a6e1-d2014eee7945 tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:13:34.372953 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-7a046e4f-372e-4656-9ea6-345e9264443d tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de71b64a2e1c4b6aaa15b5ee75003add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994439815e0416180c95158033ae3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:13:34.384274 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-7a046e4f-372e-4656-9ea6-345e9264443d tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] 10.222.0.26 "GET /compute/v2.1/servers/64039cd8-bbfa-4797-9e3c-acf4715c67a4" status: 200 len: 1512 microversion: 2.1 time: 0.797235 Oct 08 21:13:34.390485 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2444/4825] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:13:33 2022] GET /compute/v2.1/servers/64039cd8-bbfa-4797-9e3c-acf4715c67a4 => generated 1512 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:13:34.703468 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-fe38af1e-4038-41bb-a6e1-d2014eee7945 tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6b3f4cefa94e269186f9d9e5aff559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195ea87b43684ed59b1b1c048b0584b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:13:34.719716 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-fe38af1e-4038-41bb-a6e1-d2014eee7945 tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] 10.222.0.26 "GET /compute/v2.1/servers/d66d3500-8ca0-439d-b982-fab393d0187c" status: 200 len: 1286 microversion: 2.1 time: 0.637177 Oct 08 21:13:34.720908 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2382/4826] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:13:34 2022] GET /compute/v2.1/servers/d66d3500-8ca0-439d-b982-fab393d0187c => generated 1286 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:13:35.416603 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-ff66a8ff-0f18-4cfa-9f6f-7972bcdffa8b tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:13:35.417507 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-ff66a8ff-0f18-4cfa-9f6f-7972bcdffa8b tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] [instance: 64039cd8-bbfa-4797-9e3c-acf4715c67a4] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:13:35.431429 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ff66a8ff-0f18-4cfa-9f6f-7972bcdffa8b tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:13:35.431942 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ff66a8ff-0f18-4cfa-9f6f-7972bcdffa8b tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:13:35.432409 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ff66a8ff-0f18-4cfa-9f6f-7972bcdffa8b tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:13:35.433147 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ff66a8ff-0f18-4cfa-9f6f-7972bcdffa8b tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:13:35.433675 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ff66a8ff-0f18-4cfa-9f6f-7972bcdffa8b tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:13:35.434117 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ff66a8ff-0f18-4cfa-9f6f-7972bcdffa8b tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:13:35.461220 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:13:35.748741 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-9fedcc13-6421-4521-91f6-9afd25207f62 tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:13:35.751541 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-9fedcc13-6421-4521-91f6-9afd25207f62 tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] [instance: d66d3500-8ca0-439d-b982-fab393d0187c] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:13:35.767362 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9fedcc13-6421-4521-91f6-9afd25207f62 tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:13:35.770286 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9fedcc13-6421-4521-91f6-9afd25207f62 tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:13:35.770923 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9fedcc13-6421-4521-91f6-9afd25207f62 tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:13:35.773473 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9fedcc13-6421-4521-91f6-9afd25207f62 tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:13:35.774162 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9fedcc13-6421-4521-91f6-9afd25207f62 tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:13:35.776020 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9fedcc13-6421-4521-91f6-9afd25207f62 tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:13:36.102497 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-9fedcc13-6421-4521-91f6-9afd25207f62 tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6b3f4cefa94e269186f9d9e5aff559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195ea87b43684ed59b1b1c048b0584b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:13:36.115589 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-9fedcc13-6421-4521-91f6-9afd25207f62 tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] 10.222.0.26 "GET /compute/v2.1/servers/d66d3500-8ca0-439d-b982-fab393d0187c" status: 200 len: 1286 microversion: 2.1 time: 0.371841 Oct 08 21:13:36.117884 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2383/4827] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:13:35 2022] GET /compute/v2.1/servers/d66d3500-8ca0-439d-b982-fab393d0187c => generated 1286 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:13:36.329726 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-ff66a8ff-0f18-4cfa-9f6f-7972bcdffa8b tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de71b64a2e1c4b6aaa15b5ee75003add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994439815e0416180c95158033ae3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:13:36.347401 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-ff66a8ff-0f18-4cfa-9f6f-7972bcdffa8b tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] 10.222.0.26 "GET /compute/v2.1/servers/64039cd8-bbfa-4797-9e3c-acf4715c67a4" status: 200 len: 1512 microversion: 2.1 time: 0.933478 Oct 08 21:13:36.350076 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2445/4828] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:13:35 2022] GET /compute/v2.1/servers/64039cd8-bbfa-4797-9e3c-acf4715c67a4 => generated 1512 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:13:37.146634 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c8bb4975-6efe-4420-8f00-06c34633a7b1 tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:13:37.148028 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-c8bb4975-6efe-4420-8f00-06c34633a7b1 tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] [instance: d66d3500-8ca0-439d-b982-fab393d0187c] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:13:37.171627 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c8bb4975-6efe-4420-8f00-06c34633a7b1 tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:13:37.172136 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c8bb4975-6efe-4420-8f00-06c34633a7b1 tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:13:37.177682 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c8bb4975-6efe-4420-8f00-06c34633a7b1 tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:13:37.180694 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c8bb4975-6efe-4420-8f00-06c34633a7b1 tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:13:37.182061 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c8bb4975-6efe-4420-8f00-06c34633a7b1 tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:13:37.182778 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c8bb4975-6efe-4420-8f00-06c34633a7b1 tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:13:37.375638 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-73b77e7e-ec14-4898-af6b-2066b61ffb9f tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:13:37.376265 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-73b77e7e-ec14-4898-af6b-2066b61ffb9f tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] [instance: 64039cd8-bbfa-4797-9e3c-acf4715c67a4] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:13:37.390500 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-73b77e7e-ec14-4898-af6b-2066b61ffb9f tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:13:37.402447 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-73b77e7e-ec14-4898-af6b-2066b61ffb9f tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:13:37.403982 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-73b77e7e-ec14-4898-af6b-2066b61ffb9f tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:13:37.405109 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-73b77e7e-ec14-4898-af6b-2066b61ffb9f tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:13:37.405776 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-73b77e7e-ec14-4898-af6b-2066b61ffb9f tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:13:37.406377 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-73b77e7e-ec14-4898-af6b-2066b61ffb9f tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:13:37.791779 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-c8bb4975-6efe-4420-8f00-06c34633a7b1 tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6b3f4cefa94e269186f9d9e5aff559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195ea87b43684ed59b1b1c048b0584b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:13:37.813883 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-c8bb4975-6efe-4420-8f00-06c34633a7b1 tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] 10.222.0.26 "GET /compute/v2.1/servers/d66d3500-8ca0-439d-b982-fab393d0187c" status: 200 len: 1328 microversion: 2.1 time: 0.670778 Oct 08 21:13:37.821884 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2384/4829] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:13:37 2022] GET /compute/v2.1/servers/d66d3500-8ca0-439d-b982-fab393d0187c => generated 1328 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:13:38.086804 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-73b77e7e-ec14-4898-af6b-2066b61ffb9f tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de71b64a2e1c4b6aaa15b5ee75003add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994439815e0416180c95158033ae3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:13:38.102301 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-73b77e7e-ec14-4898-af6b-2066b61ffb9f tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] 10.222.0.26 "GET /compute/v2.1/servers/64039cd8-bbfa-4797-9e3c-acf4715c67a4" status: 200 len: 1512 microversion: 2.1 time: 0.728309 Oct 08 21:13:38.104779 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2446/4830] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:13:37 2022] GET /compute/v2.1/servers/64039cd8-bbfa-4797-9e3c-acf4715c67a4 => generated 1512 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:13:38.859872 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-bacb00f7-40b0-4a02-8caa-9b9db76711ca tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:13:38.861129 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-bacb00f7-40b0-4a02-8caa-9b9db76711ca tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] [instance: d66d3500-8ca0-439d-b982-fab393d0187c] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:13:38.880737 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bacb00f7-40b0-4a02-8caa-9b9db76711ca tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:13:38.881654 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bacb00f7-40b0-4a02-8caa-9b9db76711ca tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:13:38.882501 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bacb00f7-40b0-4a02-8caa-9b9db76711ca tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:13:38.883483 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bacb00f7-40b0-4a02-8caa-9b9db76711ca tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:13:38.884179 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bacb00f7-40b0-4a02-8caa-9b9db76711ca tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:13:38.884859 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bacb00f7-40b0-4a02-8caa-9b9db76711ca tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:13:39.128025 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-1d30f225-30e4-457a-87d2-2c68b4139710 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:13:39.129258 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-1d30f225-30e4-457a-87d2-2c68b4139710 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] [instance: 64039cd8-bbfa-4797-9e3c-acf4715c67a4] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:13:39.142143 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1d30f225-30e4-457a-87d2-2c68b4139710 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:13:39.148353 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1d30f225-30e4-457a-87d2-2c68b4139710 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:13:39.149228 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1d30f225-30e4-457a-87d2-2c68b4139710 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:13:39.152565 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1d30f225-30e4-457a-87d2-2c68b4139710 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:13:39.152735 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1d30f225-30e4-457a-87d2-2c68b4139710 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:13:39.153106 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1d30f225-30e4-457a-87d2-2c68b4139710 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:13:39.465778 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-bacb00f7-40b0-4a02-8caa-9b9db76711ca tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6b3f4cefa94e269186f9d9e5aff559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195ea87b43684ed59b1b1c048b0584b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:13:39.476652 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-bacb00f7-40b0-4a02-8caa-9b9db76711ca tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] 10.222.0.26 "GET /compute/v2.1/servers/d66d3500-8ca0-439d-b982-fab393d0187c" status: 200 len: 1328 microversion: 2.1 time: 0.621360 Oct 08 21:13:39.477281 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2385/4831] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:13:38 2022] GET /compute/v2.1/servers/d66d3500-8ca0-439d-b982-fab393d0187c => generated 1328 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:13:39.885105 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-1d30f225-30e4-457a-87d2-2c68b4139710 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de71b64a2e1c4b6aaa15b5ee75003add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994439815e0416180c95158033ae3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:13:39.896596 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-1d30f225-30e4-457a-87d2-2c68b4139710 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] 10.222.0.26 "GET /compute/v2.1/servers/64039cd8-bbfa-4797-9e3c-acf4715c67a4" status: 200 len: 1512 microversion: 2.1 time: 0.772447 Oct 08 21:13:39.898259 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2447/4832] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:13:39 2022] GET /compute/v2.1/servers/64039cd8-bbfa-4797-9e3c-acf4715c67a4 => generated 1512 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:13:40.503965 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-f8a6d85e-f890-4855-96c7-e5d68895b7e5 tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:13:40.505490 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-f8a6d85e-f890-4855-96c7-e5d68895b7e5 tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] [instance: d66d3500-8ca0-439d-b982-fab393d0187c] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:13:40.537437 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f8a6d85e-f890-4855-96c7-e5d68895b7e5 tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:13:40.538283 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f8a6d85e-f890-4855-96c7-e5d68895b7e5 tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:13:40.538924 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f8a6d85e-f890-4855-96c7-e5d68895b7e5 tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:13:40.542625 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f8a6d85e-f890-4855-96c7-e5d68895b7e5 tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:13:40.545318 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f8a6d85e-f890-4855-96c7-e5d68895b7e5 tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:13:40.546251 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f8a6d85e-f890-4855-96c7-e5d68895b7e5 tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:13:40.902303 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-0810f5eb-28a5-481d-9cf3-6cb8a71cd923 req-6aef1e52-8498-45a6-9260-2a1479876642 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d66d3500-8ca0-439d-b982-fab393d0187c", "tag": "4d682d03-d010-429e-935b-2f067a1ca62b"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:13:40.924503 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-0810f5eb-28a5-481d-9cf3-6cb8a71cd923 req-6aef1e52-8498-45a6-9260-2a1479876642 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:13:40.925058 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-0810f5eb-28a5-481d-9cf3-6cb8a71cd923 req-6aef1e52-8498-45a6-9260-2a1479876642 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:13:40.928063 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-0810f5eb-28a5-481d-9cf3-6cb8a71cd923 req-6aef1e52-8498-45a6-9260-2a1479876642 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:13:40.971862 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-0810f5eb-28a5-481d-9cf3-6cb8a71cd923 req-6aef1e52-8498-45a6-9260-2a1479876642 service nova] Creating event network-changed:4d682d03-d010-429e-935b-2f067a1ca62b for instance d66d3500-8ca0-439d-b982-fab393d0187c on nch2-master-1 Oct 08 21:13:40.993723 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-0810f5eb-28a5-481d-9cf3-6cb8a71cd923 req-6aef1e52-8498-45a6-9260-2a1479876642 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094662 Oct 08 21:13:40.995489 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2448/4833] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:13:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 08 21:13:41.012125 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-ebc4a2c3-4d42-4ab7-b6e7-2ffbe4e86224 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:13:41.013253 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-ebc4a2c3-4d42-4ab7-b6e7-2ffbe4e86224 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] [instance: 64039cd8-bbfa-4797-9e3c-acf4715c67a4] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:13:41.032309 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ebc4a2c3-4d42-4ab7-b6e7-2ffbe4e86224 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:13:41.034976 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ebc4a2c3-4d42-4ab7-b6e7-2ffbe4e86224 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:13:41.035640 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ebc4a2c3-4d42-4ab7-b6e7-2ffbe4e86224 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:13:41.042318 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ebc4a2c3-4d42-4ab7-b6e7-2ffbe4e86224 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:13:41.043610 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ebc4a2c3-4d42-4ab7-b6e7-2ffbe4e86224 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:13:41.044662 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ebc4a2c3-4d42-4ab7-b6e7-2ffbe4e86224 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:13:41.081841 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-f8a6d85e-f890-4855-96c7-e5d68895b7e5 tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6b3f4cefa94e269186f9d9e5aff559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195ea87b43684ed59b1b1c048b0584b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:13:41.091292 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-f8a6d85e-f890-4855-96c7-e5d68895b7e5 tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] 10.222.0.26 "GET /compute/v2.1/servers/d66d3500-8ca0-439d-b982-fab393d0187c" status: 200 len: 1328 microversion: 2.1 time: 0.593374 Oct 08 21:13:41.100894 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2386/4834] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:13:40 2022] GET /compute/v2.1/servers/d66d3500-8ca0-439d-b982-fab393d0187c => generated 1328 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:13:41.571076 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-ebc4a2c3-4d42-4ab7-b6e7-2ffbe4e86224 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de71b64a2e1c4b6aaa15b5ee75003add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994439815e0416180c95158033ae3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:13:41.582395 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-ebc4a2c3-4d42-4ab7-b6e7-2ffbe4e86224 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] 10.222.0.26 "GET /compute/v2.1/servers/64039cd8-bbfa-4797-9e3c-acf4715c67a4" status: 200 len: 1512 microversion: 2.1 time: 0.585473 Oct 08 21:13:41.583935 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2449/4835] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:13:40 2022] GET /compute/v2.1/servers/64039cd8-bbfa-4797-9e3c-acf4715c67a4 => generated 1512 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:13:42.118454 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-74a8d169-15e3-46dd-841b-d53fe7b7ac2c tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:13:42.119226 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-74a8d169-15e3-46dd-841b-d53fe7b7ac2c tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] [instance: d66d3500-8ca0-439d-b982-fab393d0187c] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:13:42.122753 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=2 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:13:42.132622 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=8 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:13:42.144280 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-74a8d169-15e3-46dd-841b-d53fe7b7ac2c tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:13:42.145105 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-74a8d169-15e3-46dd-841b-d53fe7b7ac2c tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:13:42.145888 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-74a8d169-15e3-46dd-841b-d53fe7b7ac2c tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:13:42.147103 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-74a8d169-15e3-46dd-841b-d53fe7b7ac2c tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:13:42.147734 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-74a8d169-15e3-46dd-841b-d53fe7b7ac2c tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:13:42.148399 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-74a8d169-15e3-46dd-841b-d53fe7b7ac2c tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:13:42.564909 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-74a8d169-15e3-46dd-841b-d53fe7b7ac2c tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6b3f4cefa94e269186f9d9e5aff559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195ea87b43684ed59b1b1c048b0584b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:13:42.576061 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-74a8d169-15e3-46dd-841b-d53fe7b7ac2c tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] 10.222.0.26 "GET /compute/v2.1/servers/d66d3500-8ca0-439d-b982-fab393d0187c" status: 200 len: 1328 microversion: 2.1 time: 0.463790 Oct 08 21:13:42.577596 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2387/4836] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:13:42 2022] GET /compute/v2.1/servers/d66d3500-8ca0-439d-b982-fab393d0187c => generated 1328 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:13:42.608914 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-aaebf91a-d9f3-4e1a-ac3d-0ef4122e62d3 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:13:42.610419 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-aaebf91a-d9f3-4e1a-ac3d-0ef4122e62d3 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] [instance: 64039cd8-bbfa-4797-9e3c-acf4715c67a4] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:13:42.622699 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-aaebf91a-d9f3-4e1a-ac3d-0ef4122e62d3 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:13:42.623985 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-aaebf91a-d9f3-4e1a-ac3d-0ef4122e62d3 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:13:42.626524 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-aaebf91a-d9f3-4e1a-ac3d-0ef4122e62d3 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:13:42.629855 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-aaebf91a-d9f3-4e1a-ac3d-0ef4122e62d3 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:13:42.631575 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-aaebf91a-d9f3-4e1a-ac3d-0ef4122e62d3 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:13:42.633891 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-aaebf91a-d9f3-4e1a-ac3d-0ef4122e62d3 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:13:43.177904 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-aaebf91a-d9f3-4e1a-ac3d-0ef4122e62d3 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de71b64a2e1c4b6aaa15b5ee75003add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994439815e0416180c95158033ae3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:13:43.195144 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-aaebf91a-d9f3-4e1a-ac3d-0ef4122e62d3 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] 10.222.0.26 "GET /compute/v2.1/servers/64039cd8-bbfa-4797-9e3c-acf4715c67a4" status: 200 len: 1512 microversion: 2.1 time: 0.590952 Oct 08 21:13:43.205284 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2450/4837] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:13:42 2022] GET /compute/v2.1/servers/64039cd8-bbfa-4797-9e3c-acf4715c67a4 => generated 1512 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:13:43.604391 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-19e64934-d1ad-45f2-8612-3e25a90a3dfb tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:13:43.605079 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-19e64934-d1ad-45f2-8612-3e25a90a3dfb tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] [instance: d66d3500-8ca0-439d-b982-fab393d0187c] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:13:43.615670 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-19e64934-d1ad-45f2-8612-3e25a90a3dfb tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:13:43.616328 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-19e64934-d1ad-45f2-8612-3e25a90a3dfb tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:13:43.616801 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-19e64934-d1ad-45f2-8612-3e25a90a3dfb tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:13:43.617561 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-19e64934-d1ad-45f2-8612-3e25a90a3dfb tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:13:43.618121 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-19e64934-d1ad-45f2-8612-3e25a90a3dfb tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:13:43.618787 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-19e64934-d1ad-45f2-8612-3e25a90a3dfb tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:13:44.212591 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-19e64934-d1ad-45f2-8612-3e25a90a3dfb tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6b3f4cefa94e269186f9d9e5aff559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195ea87b43684ed59b1b1c048b0584b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:13:44.227962 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-19e64934-d1ad-45f2-8612-3e25a90a3dfb tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] 10.222.0.26 "GET /compute/v2.1/servers/d66d3500-8ca0-439d-b982-fab393d0187c" status: 200 len: 1328 microversion: 2.1 time: 0.628019 Oct 08 21:13:44.229165 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2388/4838] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:13:43 2022] GET /compute/v2.1/servers/d66d3500-8ca0-439d-b982-fab393d0187c => generated 1328 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:13:44.251322 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-75ade73e-7d6a-4a3c-abaa-e6b38e81439f tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:13:44.252237 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-75ade73e-7d6a-4a3c-abaa-e6b38e81439f tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] [instance: 64039cd8-bbfa-4797-9e3c-acf4715c67a4] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:13:44.264898 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-75ade73e-7d6a-4a3c-abaa-e6b38e81439f tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:13:44.265690 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-75ade73e-7d6a-4a3c-abaa-e6b38e81439f tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:13:44.265891 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-75ade73e-7d6a-4a3c-abaa-e6b38e81439f tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:13:44.266622 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-75ade73e-7d6a-4a3c-abaa-e6b38e81439f tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:13:44.267095 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-75ade73e-7d6a-4a3c-abaa-e6b38e81439f tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:13:44.267538 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-75ade73e-7d6a-4a3c-abaa-e6b38e81439f tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:13:44.511825 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-c0d72ea9-2fd5-490f-b4aa-9cd63a4148f7 tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1886933954", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "586b7f19-9a7b-4937-9a72-8261845b5f1b"}]}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:13:44.631798 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.network.neutron [None req-c0d72ea9-2fd5-490f-b4aa-9cd63a4148f7 tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] validate_networks() for [('586b7f19-9a7b-4937-9a72-8261845b5f1b', None, None, None, None, None)] {{(pid=140492) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 21:13:44.858932 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-75ade73e-7d6a-4a3c-abaa-e6b38e81439f tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de71b64a2e1c4b6aaa15b5ee75003add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994439815e0416180c95158033ae3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:13:44.872093 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-75ade73e-7d6a-4a3c-abaa-e6b38e81439f tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] 10.222.0.26 "GET /compute/v2.1/servers/64039cd8-bbfa-4797-9e3c-acf4715c67a4" status: 200 len: 1512 microversion: 2.1 time: 0.641511 Oct 08 21:13:44.872981 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2389/4839] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:13:44 2022] GET /compute/v2.1/servers/64039cd8-bbfa-4797-9e3c-acf4715c67a4 => generated 1512 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:13:45.263112 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-f93ea56b-62ad-4367-8f61-962362293cf3 tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:13:45.264110 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-f93ea56b-62ad-4367-8f61-962362293cf3 tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] [instance: d66d3500-8ca0-439d-b982-fab393d0187c] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:13:45.275696 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f93ea56b-62ad-4367-8f61-962362293cf3 tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:13:45.282538 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f93ea56b-62ad-4367-8f61-962362293cf3 tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:13:45.283021 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f93ea56b-62ad-4367-8f61-962362293cf3 tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:13:45.283756 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f93ea56b-62ad-4367-8f61-962362293cf3 tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:13:45.284750 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f93ea56b-62ad-4367-8f61-962362293cf3 tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:13:45.285233 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f93ea56b-62ad-4367-8f61-962362293cf3 tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:13:45.868495 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-f93ea56b-62ad-4367-8f61-962362293cf3 tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6b3f4cefa94e269186f9d9e5aff559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195ea87b43684ed59b1b1c048b0584b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:13:45.877826 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-f93ea56b-62ad-4367-8f61-962362293cf3 tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] 10.222.0.26 "GET /compute/v2.1/servers/d66d3500-8ca0-439d-b982-fab393d0187c" status: 200 len: 1328 microversion: 2.1 time: 0.619600 Oct 08 21:13:45.881509 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2390/4840] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:13:45 2022] GET /compute/v2.1/servers/d66d3500-8ca0-439d-b982-fab393d0187c => generated 1328 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:13:45.896379 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-6d693b01-c978-4ed5-9935-fbd3fb24dd61 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:13:45.897277 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-6d693b01-c978-4ed5-9935-fbd3fb24dd61 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] [instance: 64039cd8-bbfa-4797-9e3c-acf4715c67a4] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:13:45.910352 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6d693b01-c978-4ed5-9935-fbd3fb24dd61 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:13:45.910946 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6d693b01-c978-4ed5-9935-fbd3fb24dd61 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:13:45.911449 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6d693b01-c978-4ed5-9935-fbd3fb24dd61 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:13:45.912202 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6d693b01-c978-4ed5-9935-fbd3fb24dd61 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:13:45.912673 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6d693b01-c978-4ed5-9935-fbd3fb24dd61 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:13:45.913116 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6d693b01-c978-4ed5-9935-fbd3fb24dd61 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:13:46.011933 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-c0d72ea9-2fd5-490f-b4aa-9cd63a4148f7 tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] Flavor limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 21:13:46.012504 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-c0d72ea9-2fd5-490f-b4aa-9cd63a4148f7 tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] Image limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 21:13:46.013387 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-c0d72ea9-2fd5-490f-b4aa-9cd63a4148f7 tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] Flavor pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 21:13:46.013829 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-c0d72ea9-2fd5-490f-b4aa-9cd63a4148f7 tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] Image pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 21:13:46.017842 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-c0d72ea9-2fd5-490f-b4aa-9cd63a4148f7 tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 21:13:46.046670 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c0d72ea9-2fd5-490f-b4aa-9cd63a4148f7 tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:13:46.049467 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c0d72ea9-2fd5-490f-b4aa-9cd63a4148f7 tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:13:46.051176 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c0d72ea9-2fd5-490f-b4aa-9cd63a4148f7 tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:13:46.053049 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c0d72ea9-2fd5-490f-b4aa-9cd63a4148f7 tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:13:46.054025 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c0d72ea9-2fd5-490f-b4aa-9cd63a4148f7 tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:13:46.058755 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c0d72ea9-2fd5-490f-b4aa-9cd63a4148f7 tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:13:46.121625 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-c0d72ea9-2fd5-490f-b4aa-9cd63a4148f7 tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] Getting quotas for project 38ddedd2c2754cdb8c60acf585f86f2a. Resources: {'cores', 'instances', 'ram'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:13:46.142834 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-c0d72ea9-2fd5-490f-b4aa-9cd63a4148f7 tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] Getting quotas for user b6300eee278b4fad9561ebea03c2eeaa and project 38ddedd2c2754cdb8c60acf585f86f2a. Resources: {'cores', 'instances', 'ram'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:13:46.189485 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-c0d72ea9-2fd5-490f-b4aa-9cd63a4148f7 tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] Going to run 1 instances... {{(pid=140492) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 21:13:46.189485 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-c0d72ea9-2fd5-490f-b4aa-9cd63a4148f7 tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] [instance: 93243a48-4c42-4748-80ca-b990a85e0e3a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c508bd7f-7db9-4b2c-af7c-be54a855c355',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140492) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 21:13:46.323354 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-c0d72ea9-2fd5-490f-b4aa-9cd63a4148f7 tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.421324 Oct 08 21:13:46.333413 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2451/4841] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 21:13:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 2432 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 08 21:13:46.379805 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-16dd954a-2ce9-4282-b2ff-9e6047381003 tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:13:46.382755 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-16dd954a-2ce9-4282-b2ff-9e6047381003 tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] [instance: 93243a48-4c42-4748-80ca-b990a85e0e3a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:13:46.654535 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-16dd954a-2ce9-4282-b2ff-9e6047381003 tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6300eee278b4fad9561ebea03c2eeaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38ddedd2c2754cdb8c60acf585f86f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:13:46.664799 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-16dd954a-2ce9-4282-b2ff-9e6047381003 tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] 10.222.0.26 "GET /compute/v2.1/servers/93243a48-4c42-4748-80ca-b990a85e0e3a" status: 200 len: 1224 microversion: 2.1 time: 0.328559 Oct 08 21:13:46.668035 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2452/4842] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:13:46 2022] GET /compute/v2.1/servers/93243a48-4c42-4748-80ca-b990a85e0e3a => generated 1224 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:13:46.742345 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-6d693b01-c978-4ed5-9935-fbd3fb24dd61 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de71b64a2e1c4b6aaa15b5ee75003add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994439815e0416180c95158033ae3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:13:46.765516 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-6d693b01-c978-4ed5-9935-fbd3fb24dd61 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] 10.222.0.26 "GET /compute/v2.1/servers/64039cd8-bbfa-4797-9e3c-acf4715c67a4" status: 200 len: 1512 microversion: 2.1 time: 0.872854 Oct 08 21:13:46.770687 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2391/4843] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:13:45 2022] GET /compute/v2.1/servers/64039cd8-bbfa-4797-9e3c-acf4715c67a4 => generated 1512 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:13:46.903814 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-383efaf1-63c0-4701-81c0-b6cf81c1d730 tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:13:46.904545 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-383efaf1-63c0-4701-81c0-b6cf81c1d730 tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] [instance: d66d3500-8ca0-439d-b982-fab393d0187c] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:13:46.921793 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-383efaf1-63c0-4701-81c0-b6cf81c1d730 tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:13:46.922316 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-383efaf1-63c0-4701-81c0-b6cf81c1d730 tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:13:46.933978 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-383efaf1-63c0-4701-81c0-b6cf81c1d730 tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:13:46.936376 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-383efaf1-63c0-4701-81c0-b6cf81c1d730 tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:13:46.936902 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-383efaf1-63c0-4701-81c0-b6cf81c1d730 tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:13:46.942123 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-383efaf1-63c0-4701-81c0-b6cf81c1d730 tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:13:47.279127 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-383efaf1-63c0-4701-81c0-b6cf81c1d730 tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6b3f4cefa94e269186f9d9e5aff559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195ea87b43684ed59b1b1c048b0584b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:13:47.292330 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-383efaf1-63c0-4701-81c0-b6cf81c1d730 tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] 10.222.0.26 "GET /compute/v2.1/servers/d66d3500-8ca0-439d-b982-fab393d0187c" status: 200 len: 1328 microversion: 2.1 time: 0.393882 Oct 08 21:13:47.292930 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2453/4844] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:13:46 2022] GET /compute/v2.1/servers/d66d3500-8ca0-439d-b982-fab393d0187c => generated 1328 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:13:47.699943 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-33f16b4a-2127-4934-a3a0-b21bbdfad618 tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:13:47.701245 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-33f16b4a-2127-4934-a3a0-b21bbdfad618 tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] [instance: 93243a48-4c42-4748-80ca-b990a85e0e3a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:13:47.713057 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:13:47.718094 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-33f16b4a-2127-4934-a3a0-b21bbdfad618 tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:13:47.720086 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-33f16b4a-2127-4934-a3a0-b21bbdfad618 tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:13:47.721331 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-33f16b4a-2127-4934-a3a0-b21bbdfad618 tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:13:47.724498 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-33f16b4a-2127-4934-a3a0-b21bbdfad618 tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:13:47.726359 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-33f16b4a-2127-4934-a3a0-b21bbdfad618 tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:13:47.727276 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-33f16b4a-2127-4934-a3a0-b21bbdfad618 tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:13:47.796213 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-dfd014b5-1fd7-4096-8482-19b63debefa0 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:13:47.796950 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-dfd014b5-1fd7-4096-8482-19b63debefa0 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] [instance: 64039cd8-bbfa-4797-9e3c-acf4715c67a4] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:13:47.812868 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dfd014b5-1fd7-4096-8482-19b63debefa0 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:13:47.813231 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dfd014b5-1fd7-4096-8482-19b63debefa0 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:13:47.813690 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dfd014b5-1fd7-4096-8482-19b63debefa0 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:13:47.821633 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dfd014b5-1fd7-4096-8482-19b63debefa0 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:13:47.823724 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dfd014b5-1fd7-4096-8482-19b63debefa0 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:13:47.824195 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dfd014b5-1fd7-4096-8482-19b63debefa0 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:13:47.979279 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-33f16b4a-2127-4934-a3a0-b21bbdfad618 tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6300eee278b4fad9561ebea03c2eeaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38ddedd2c2754cdb8c60acf585f86f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:13:47.995639 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-33f16b4a-2127-4934-a3a0-b21bbdfad618 tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] 10.222.0.26 "GET /compute/v2.1/servers/93243a48-4c42-4748-80ca-b990a85e0e3a" status: 200 len: 1276 microversion: 2.1 time: 0.298819 Oct 08 21:13:48.010182 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2392/4845] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:13:47 2022] GET /compute/v2.1/servers/93243a48-4c42-4748-80ca-b990a85e0e3a => generated 1276 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:13:48.317969 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-213cd9d4-daa2-4de7-ba90-d988785c1a87 tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:13:48.318727 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-213cd9d4-daa2-4de7-ba90-d988785c1a87 tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] [instance: d66d3500-8ca0-439d-b982-fab393d0187c] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:13:48.328466 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-213cd9d4-daa2-4de7-ba90-d988785c1a87 tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:13:48.332290 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-213cd9d4-daa2-4de7-ba90-d988785c1a87 tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:13:48.334159 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-213cd9d4-daa2-4de7-ba90-d988785c1a87 tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:13:48.336687 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-213cd9d4-daa2-4de7-ba90-d988785c1a87 tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:13:48.338546 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-213cd9d4-daa2-4de7-ba90-d988785c1a87 tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:13:48.340541 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-213cd9d4-daa2-4de7-ba90-d988785c1a87 tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:13:48.667865 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-dfd014b5-1fd7-4096-8482-19b63debefa0 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de71b64a2e1c4b6aaa15b5ee75003add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994439815e0416180c95158033ae3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:13:48.673530 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-213cd9d4-daa2-4de7-ba90-d988785c1a87 tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6b3f4cefa94e269186f9d9e5aff559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195ea87b43684ed59b1b1c048b0584b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:13:48.678978 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-dfd014b5-1fd7-4096-8482-19b63debefa0 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] 10.222.0.26 "GET /compute/v2.1/servers/64039cd8-bbfa-4797-9e3c-acf4715c67a4" status: 200 len: 1512 microversion: 2.1 time: 0.887477 Oct 08 21:13:48.693613 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-213cd9d4-daa2-4de7-ba90-d988785c1a87 tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] 10.222.0.26 "GET /compute/v2.1/servers/d66d3500-8ca0-439d-b982-fab393d0187c" status: 200 len: 1328 microversion: 2.1 time: 0.373459 Oct 08 21:13:48.693613 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2393/4846] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:13:48 2022] GET /compute/v2.1/servers/d66d3500-8ca0-439d-b982-fab393d0187c => generated 1328 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:13:48.695093 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2454/4847] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:13:47 2022] GET /compute/v2.1/servers/64039cd8-bbfa-4797-9e3c-acf4715c67a4 => generated 1512 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:13:49.020487 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-ec09669d-6162-4c3c-bf79-e5844445d34e tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:13:49.021911 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-ec09669d-6162-4c3c-bf79-e5844445d34e tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] [instance: 93243a48-4c42-4748-80ca-b990a85e0e3a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:13:49.031715 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ec09669d-6162-4c3c-bf79-e5844445d34e tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:13:49.042069 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ec09669d-6162-4c3c-bf79-e5844445d34e tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:13:49.042927 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ec09669d-6162-4c3c-bf79-e5844445d34e tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:13:49.043937 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ec09669d-6162-4c3c-bf79-e5844445d34e tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:13:49.044636 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ec09669d-6162-4c3c-bf79-e5844445d34e tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:13:49.045340 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ec09669d-6162-4c3c-bf79-e5844445d34e tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:13:49.250796 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-ec09669d-6162-4c3c-bf79-e5844445d34e tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6300eee278b4fad9561ebea03c2eeaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38ddedd2c2754cdb8c60acf585f86f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:13:49.262881 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-ec09669d-6162-4c3c-bf79-e5844445d34e tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] 10.222.0.26 "GET /compute/v2.1/servers/93243a48-4c42-4748-80ca-b990a85e0e3a" status: 200 len: 1282 microversion: 2.1 time: 0.246112 Oct 08 21:13:49.265180 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2394/4848] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:13:49 2022] GET /compute/v2.1/servers/93243a48-4c42-4748-80ca-b990a85e0e3a => generated 1282 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:13:49.712156 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-3b9c2bd9-54fb-48c1-b75c-977e4253c26d tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:13:49.712798 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-3b9c2bd9-54fb-48c1-b75c-977e4253c26d tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] [instance: 64039cd8-bbfa-4797-9e3c-acf4715c67a4] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:13:49.724546 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-566dfdb4-b9af-4773-af5d-7e1b66eea6cc tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:13:49.725029 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-566dfdb4-b9af-4773-af5d-7e1b66eea6cc tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] [instance: d66d3500-8ca0-439d-b982-fab393d0187c] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:13:49.746660 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3b9c2bd9-54fb-48c1-b75c-977e4253c26d tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:13:49.748944 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-566dfdb4-b9af-4773-af5d-7e1b66eea6cc tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:13:49.749487 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-566dfdb4-b9af-4773-af5d-7e1b66eea6cc tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:13:49.749937 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-566dfdb4-b9af-4773-af5d-7e1b66eea6cc tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:13:49.750826 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3b9c2bd9-54fb-48c1-b75c-977e4253c26d tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:13:49.751476 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3b9c2bd9-54fb-48c1-b75c-977e4253c26d tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:13:49.752420 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3b9c2bd9-54fb-48c1-b75c-977e4253c26d tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:13:49.754663 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3b9c2bd9-54fb-48c1-b75c-977e4253c26d tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:13:49.755714 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-566dfdb4-b9af-4773-af5d-7e1b66eea6cc tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:13:49.756169 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-566dfdb4-b9af-4773-af5d-7e1b66eea6cc tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:13:49.756612 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-566dfdb4-b9af-4773-af5d-7e1b66eea6cc tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:13:49.762761 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3b9c2bd9-54fb-48c1-b75c-977e4253c26d tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:13:49.842495 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=100 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:13:50.218504 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-3b9c2bd9-54fb-48c1-b75c-977e4253c26d tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de71b64a2e1c4b6aaa15b5ee75003add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994439815e0416180c95158033ae3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:13:50.241454 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-3b9c2bd9-54fb-48c1-b75c-977e4253c26d tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] 10.222.0.26 "GET /compute/v2.1/servers/64039cd8-bbfa-4797-9e3c-acf4715c67a4" status: 200 len: 1512 microversion: 2.1 time: 0.533100 Oct 08 21:13:50.257215 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2455/4849] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:13:49 2022] GET /compute/v2.1/servers/64039cd8-bbfa-4797-9e3c-acf4715c67a4 => generated 1512 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:13:50.263739 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-c07ecb15-3d1b-4dd3-996d-ca0a2c6e3805 req-7a552c39-49db-4a7c-a6cf-7f27bdafefde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d66d3500-8ca0-439d-b982-fab393d0187c", "name": "network-vif-plugged", "status": "completed", "tag": "4d682d03-d010-429e-935b-2f067a1ca62b"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:13:50.301045 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-c07ecb15-3d1b-4dd3-996d-ca0a2c6e3805 req-7a552c39-49db-4a7c-a6cf-7f27bdafefde service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:13:50.303312 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-c07ecb15-3d1b-4dd3-996d-ca0a2c6e3805 req-7a552c39-49db-4a7c-a6cf-7f27bdafefde service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:13:50.307208 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-c07ecb15-3d1b-4dd3-996d-ca0a2c6e3805 req-7a552c39-49db-4a7c-a6cf-7f27bdafefde service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:13:50.356614 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-c07ecb15-3d1b-4dd3-996d-ca0a2c6e3805 req-7a552c39-49db-4a7c-a6cf-7f27bdafefde service nova] Creating event network-vif-plugged:4d682d03-d010-429e-935b-2f067a1ca62b for instance d66d3500-8ca0-439d-b982-fab393d0187c on nch2-master-1 Oct 08 21:13:50.372954 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-c07ecb15-3d1b-4dd3-996d-ca0a2c6e3805 req-7a552c39-49db-4a7c-a6cf-7f27bdafefde service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126198 Oct 08 21:13:50.374707 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2456/4850] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:13:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:13:50.391148 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e76c1b0d-d48a-4f9e-9f1b-eba0769eab26 tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:13:50.395360 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-e76c1b0d-d48a-4f9e-9f1b-eba0769eab26 tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] [instance: 93243a48-4c42-4748-80ca-b990a85e0e3a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:13:50.427680 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e76c1b0d-d48a-4f9e-9f1b-eba0769eab26 tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:13:50.428808 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e76c1b0d-d48a-4f9e-9f1b-eba0769eab26 tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:13:50.429320 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e76c1b0d-d48a-4f9e-9f1b-eba0769eab26 tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:13:50.430089 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e76c1b0d-d48a-4f9e-9f1b-eba0769eab26 tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:13:50.430574 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e76c1b0d-d48a-4f9e-9f1b-eba0769eab26 tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:13:50.434396 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e76c1b0d-d48a-4f9e-9f1b-eba0769eab26 tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:13:50.584423 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-566dfdb4-b9af-4773-af5d-7e1b66eea6cc tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6b3f4cefa94e269186f9d9e5aff559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195ea87b43684ed59b1b1c048b0584b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:13:50.608156 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-566dfdb4-b9af-4773-af5d-7e1b66eea6cc tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] 10.222.0.26 "GET /compute/v2.1/servers/d66d3500-8ca0-439d-b982-fab393d0187c" status: 200 len: 1328 microversion: 2.1 time: 0.878866 Oct 08 21:13:50.609442 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2395/4851] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:13:49 2022] GET /compute/v2.1/servers/d66d3500-8ca0-439d-b982-fab393d0187c => generated 1328 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:13:50.807532 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-e76c1b0d-d48a-4f9e-9f1b-eba0769eab26 tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6300eee278b4fad9561ebea03c2eeaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38ddedd2c2754cdb8c60acf585f86f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:13:50.823532 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-e76c1b0d-d48a-4f9e-9f1b-eba0769eab26 tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] 10.222.0.26 "GET /compute/v2.1/servers/93243a48-4c42-4748-80ca-b990a85e0e3a" status: 200 len: 1282 microversion: 2.1 time: 0.446659 Oct 08 21:13:50.824427 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2457/4852] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:13:50 2022] GET /compute/v2.1/servers/93243a48-4c42-4748-80ca-b990a85e0e3a => generated 1282 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:13:51.275353 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-42e88449-9587-46da-9be8-9392c9e128a2 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:13:51.276304 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-42e88449-9587-46da-9be8-9392c9e128a2 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] [instance: 64039cd8-bbfa-4797-9e3c-acf4715c67a4] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:13:51.301844 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-42e88449-9587-46da-9be8-9392c9e128a2 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:13:51.302361 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-42e88449-9587-46da-9be8-9392c9e128a2 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:13:51.302811 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-42e88449-9587-46da-9be8-9392c9e128a2 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:13:51.303539 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-42e88449-9587-46da-9be8-9392c9e128a2 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:13:51.303984 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-42e88449-9587-46da-9be8-9392c9e128a2 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:13:51.304426 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-42e88449-9587-46da-9be8-9392c9e128a2 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:13:51.637222 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-3d8524cc-a083-4a5f-8a01-cc5e29576a22 tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:13:51.638333 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-3d8524cc-a083-4a5f-8a01-cc5e29576a22 tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] [instance: d66d3500-8ca0-439d-b982-fab393d0187c] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:13:51.658180 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3d8524cc-a083-4a5f-8a01-cc5e29576a22 tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:13:51.661704 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3d8524cc-a083-4a5f-8a01-cc5e29576a22 tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:13:51.662676 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3d8524cc-a083-4a5f-8a01-cc5e29576a22 tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:13:51.666018 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3d8524cc-a083-4a5f-8a01-cc5e29576a22 tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:13:51.668516 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3d8524cc-a083-4a5f-8a01-cc5e29576a22 tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:13:51.669676 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3d8524cc-a083-4a5f-8a01-cc5e29576a22 tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:13:52.351693 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-3d8524cc-a083-4a5f-8a01-cc5e29576a22 tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6b3f4cefa94e269186f9d9e5aff559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195ea87b43684ed59b1b1c048b0584b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:13:52.370286 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-3d8524cc-a083-4a5f-8a01-cc5e29576a22 tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] 10.222.0.26 "GET /compute/v2.1/servers/d66d3500-8ca0-439d-b982-fab393d0187c" status: 200 len: 1328 microversion: 2.1 time: 0.740105 Oct 08 21:13:52.374536 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2458/4853] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:13:51 2022] GET /compute/v2.1/servers/d66d3500-8ca0-439d-b982-fab393d0187c => generated 1328 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:13:52.393125 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-19511dda-b72f-401b-9eef-a1f197167da6 tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:13:52.395332 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-19511dda-b72f-401b-9eef-a1f197167da6 tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] [instance: 93243a48-4c42-4748-80ca-b990a85e0e3a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:13:52.411871 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-19511dda-b72f-401b-9eef-a1f197167da6 tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:13:52.415434 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-19511dda-b72f-401b-9eef-a1f197167da6 tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:13:52.415937 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-19511dda-b72f-401b-9eef-a1f197167da6 tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:13:52.419790 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-19511dda-b72f-401b-9eef-a1f197167da6 tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:13:52.420324 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-19511dda-b72f-401b-9eef-a1f197167da6 tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:13:52.427247 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-19511dda-b72f-401b-9eef-a1f197167da6 tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:13:52.459662 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-42e88449-9587-46da-9be8-9392c9e128a2 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de71b64a2e1c4b6aaa15b5ee75003add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994439815e0416180c95158033ae3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:13:52.468175 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-42e88449-9587-46da-9be8-9392c9e128a2 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] 10.222.0.26 "GET /compute/v2.1/servers/64039cd8-bbfa-4797-9e3c-acf4715c67a4" status: 200 len: 1512 microversion: 2.1 time: 1.198868 Oct 08 21:13:52.484918 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2396/4854] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:13:51 2022] GET /compute/v2.1/servers/64039cd8-bbfa-4797-9e3c-acf4715c67a4 => generated 1512 bytes in 1204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:13:52.819453 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-19511dda-b72f-401b-9eef-a1f197167da6 tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6300eee278b4fad9561ebea03c2eeaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38ddedd2c2754cdb8c60acf585f86f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:13:52.835161 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-19511dda-b72f-401b-9eef-a1f197167da6 tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] 10.222.0.26 "GET /compute/v2.1/servers/93243a48-4c42-4748-80ca-b990a85e0e3a" status: 200 len: 1324 microversion: 2.1 time: 0.459165 Oct 08 21:13:52.852414 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2459/4855] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:13:52 2022] GET /compute/v2.1/servers/93243a48-4c42-4748-80ca-b990a85e0e3a => generated 1324 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:13:53.261505 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-7a12cf37-f2ef-4a58-b0ac-47220307aa37 req-0ce51c45-e064-48e0-9055-1a841eb5bd49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93243a48-4c42-4748-80ca-b990a85e0e3a", "tag": "f2f37509-c382-47d0-9abc-83be6717987a"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:13:53.279150 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-7a12cf37-f2ef-4a58-b0ac-47220307aa37 req-0ce51c45-e064-48e0-9055-1a841eb5bd49 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:13:53.280045 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-7a12cf37-f2ef-4a58-b0ac-47220307aa37 req-0ce51c45-e064-48e0-9055-1a841eb5bd49 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:13:53.281326 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-7a12cf37-f2ef-4a58-b0ac-47220307aa37 req-0ce51c45-e064-48e0-9055-1a841eb5bd49 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:13:53.317562 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-7a12cf37-f2ef-4a58-b0ac-47220307aa37 req-0ce51c45-e064-48e0-9055-1a841eb5bd49 service nova] Creating event network-changed:f2f37509-c382-47d0-9abc-83be6717987a for instance 93243a48-4c42-4748-80ca-b990a85e0e3a on nch2-master-1 Oct 08 21:13:53.345914 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-7a12cf37-f2ef-4a58-b0ac-47220307aa37 req-0ce51c45-e064-48e0-9055-1a841eb5bd49 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089392 Oct 08 21:13:53.351665 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2397/4856] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:13:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 08 21:13:53.400397 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-92038bcd-2eac-4c44-83eb-3056571fd976 tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:13:53.401366 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-92038bcd-2eac-4c44-83eb-3056571fd976 tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] [instance: d66d3500-8ca0-439d-b982-fab393d0187c] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:13:53.407386 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:13:53.409662 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-92038bcd-2eac-4c44-83eb-3056571fd976 tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:13:53.410171 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-92038bcd-2eac-4c44-83eb-3056571fd976 tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:13:53.410836 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-92038bcd-2eac-4c44-83eb-3056571fd976 tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:13:53.412385 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-92038bcd-2eac-4c44-83eb-3056571fd976 tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:13:53.415337 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-92038bcd-2eac-4c44-83eb-3056571fd976 tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:13:53.415990 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-92038bcd-2eac-4c44-83eb-3056571fd976 tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:13:53.493746 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c88ce0dc-9b11-48ac-9419-f1f7e03929ae tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:13:53.495360 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-c88ce0dc-9b11-48ac-9419-f1f7e03929ae tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] [instance: 64039cd8-bbfa-4797-9e3c-acf4715c67a4] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:13:53.517679 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c88ce0dc-9b11-48ac-9419-f1f7e03929ae tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:13:53.518839 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c88ce0dc-9b11-48ac-9419-f1f7e03929ae tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:13:53.519595 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c88ce0dc-9b11-48ac-9419-f1f7e03929ae tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:13:53.522106 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c88ce0dc-9b11-48ac-9419-f1f7e03929ae tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:13:53.523700 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c88ce0dc-9b11-48ac-9419-f1f7e03929ae tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:13:53.524236 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c88ce0dc-9b11-48ac-9419-f1f7e03929ae tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:13:53.828041 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-92038bcd-2eac-4c44-83eb-3056571fd976 tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6b3f4cefa94e269186f9d9e5aff559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195ea87b43684ed59b1b1c048b0584b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:13:53.847197 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-92038bcd-2eac-4c44-83eb-3056571fd976 tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] 10.222.0.26 "GET /compute/v2.1/servers/d66d3500-8ca0-439d-b982-fab393d0187c" status: 200 len: 1529 microversion: 2.1 time: 0.451203 Oct 08 21:13:53.857214 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2460/4857] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:13:53 2022] GET /compute/v2.1/servers/d66d3500-8ca0-439d-b982-fab393d0187c => generated 1529 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:13:53.876544 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-62bbf9ae-a327-4a09-9b05-bc831f48203a tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:13:53.877378 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-62bbf9ae-a327-4a09-9b05-bc831f48203a tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] [instance: 93243a48-4c42-4748-80ca-b990a85e0e3a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:13:53.887941 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-62bbf9ae-a327-4a09-9b05-bc831f48203a tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:13:53.888907 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-62bbf9ae-a327-4a09-9b05-bc831f48203a tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:13:53.889504 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-62bbf9ae-a327-4a09-9b05-bc831f48203a tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:13:53.890977 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-62bbf9ae-a327-4a09-9b05-bc831f48203a tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:13:53.891646 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-62bbf9ae-a327-4a09-9b05-bc831f48203a tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:13:53.892290 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-62bbf9ae-a327-4a09-9b05-bc831f48203a tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:13:54.138677 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-c88ce0dc-9b11-48ac-9419-f1f7e03929ae tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de71b64a2e1c4b6aaa15b5ee75003add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994439815e0416180c95158033ae3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:13:54.149532 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-c88ce0dc-9b11-48ac-9419-f1f7e03929ae tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] 10.222.0.26 "GET /compute/v2.1/servers/64039cd8-bbfa-4797-9e3c-acf4715c67a4" status: 200 len: 1512 microversion: 2.1 time: 0.660846 Oct 08 21:13:54.152895 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2398/4858] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:13:53 2022] GET /compute/v2.1/servers/64039cd8-bbfa-4797-9e3c-acf4715c67a4 => generated 1512 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:13:54.163114 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-f6a86b0f-1637-4611-a008-961eda5e4e22 tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:13:54.164214 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-f6a86b0f-1637-4611-a008-961eda5e4e22 tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] [instance: d66d3500-8ca0-439d-b982-fab393d0187c] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:13:54.182622 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f6a86b0f-1637-4611-a008-961eda5e4e22 tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:13:54.183140 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f6a86b0f-1637-4611-a008-961eda5e4e22 tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:13:54.183595 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f6a86b0f-1637-4611-a008-961eda5e4e22 tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:13:54.184351 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f6a86b0f-1637-4611-a008-961eda5e4e22 tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:13:54.185447 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f6a86b0f-1637-4611-a008-961eda5e4e22 tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:13:54.189362 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f6a86b0f-1637-4611-a008-961eda5e4e22 tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:13:54.467548 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-62bbf9ae-a327-4a09-9b05-bc831f48203a tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6300eee278b4fad9561ebea03c2eeaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38ddedd2c2754cdb8c60acf585f86f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:13:54.476320 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-62bbf9ae-a327-4a09-9b05-bc831f48203a tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] 10.222.0.26 "GET /compute/v2.1/servers/93243a48-4c42-4748-80ca-b990a85e0e3a" status: 200 len: 1324 microversion: 2.1 time: 0.611804 Oct 08 21:13:54.477388 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2461/4859] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:13:53 2022] GET /compute/v2.1/servers/93243a48-4c42-4748-80ca-b990a85e0e3a => generated 1324 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:13:54.527307 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-f6a86b0f-1637-4611-a008-961eda5e4e22 tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6b3f4cefa94e269186f9d9e5aff559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195ea87b43684ed59b1b1c048b0584b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:13:54.541709 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-f6a86b0f-1637-4611-a008-961eda5e4e22 tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] 10.222.0.26 "GET /compute/v2.1/servers/d66d3500-8ca0-439d-b982-fab393d0187c" status: 200 len: 1529 microversion: 2.1 time: 0.386348 Oct 08 21:13:54.544187 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2399/4860] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:13:54 2022] GET /compute/v2.1/servers/d66d3500-8ca0-439d-b982-fab393d0187c => generated 1529 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:13:54.857263 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-36ef34bd-5aab-45e0-ad85-c93dd514d228 tempest-ServersNegativeTestMultiTenantJSON-1612330779 tempest-ServersNegativeTestMultiTenantJSON-1612330779-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:13:54.857952 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-36ef34bd-5aab-45e0-ad85-c93dd514d228 tempest-ServersNegativeTestMultiTenantJSON-1612330779 tempest-ServersNegativeTestMultiTenantJSON-1612330779-project] [instance: d66d3500-8ca0-439d-b982-fab393d0187c] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:13:54.867609 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-36ef34bd-5aab-45e0-ad85-c93dd514d228 tempest-ServersNegativeTestMultiTenantJSON-1612330779 tempest-ServersNegativeTestMultiTenantJSON-1612330779-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:13:54.872627 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-36ef34bd-5aab-45e0-ad85-c93dd514d228 tempest-ServersNegativeTestMultiTenantJSON-1612330779 tempest-ServersNegativeTestMultiTenantJSON-1612330779-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:13:54.873109 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-36ef34bd-5aab-45e0-ad85-c93dd514d228 tempest-ServersNegativeTestMultiTenantJSON-1612330779 tempest-ServersNegativeTestMultiTenantJSON-1612330779-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:13:54.879035 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-36ef34bd-5aab-45e0-ad85-c93dd514d228 tempest-ServersNegativeTestMultiTenantJSON-1612330779 tempest-ServersNegativeTestMultiTenantJSON-1612330779-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:13:54.879532 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-36ef34bd-5aab-45e0-ad85-c93dd514d228 tempest-ServersNegativeTestMultiTenantJSON-1612330779 tempest-ServersNegativeTestMultiTenantJSON-1612330779-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:13:54.879981 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-36ef34bd-5aab-45e0-ad85-c93dd514d228 tempest-ServersNegativeTestMultiTenantJSON-1612330779 tempest-ServersNegativeTestMultiTenantJSON-1612330779-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:13:54.905888 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-36ef34bd-5aab-45e0-ad85-c93dd514d228 tempest-ServersNegativeTestMultiTenantJSON-1612330779 tempest-ServersNegativeTestMultiTenantJSON-1612330779-project] HTTP exception thrown: Instance d66d3500-8ca0-439d-b982-fab393d0187c could not be found. Oct 08 21:13:54.910340 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-36ef34bd-5aab-45e0-ad85-c93dd514d228 tempest-ServersNegativeTestMultiTenantJSON-1612330779 tempest-ServersNegativeTestMultiTenantJSON-1612330779-project] Request method failure captured: Oct 08 21:13:54.910340 ncdv-master-1 devstack@n-api.service[140492]: request: DELETE /compute/v2.1/servers/d66d3500-8ca0-439d-b982-fab393d0187c HTTP/1.1 Oct 08 21:13:54.910340 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:13:54.910340 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:13:54.910340 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:13:54.910340 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 21:13:54.910340 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:13:54.910340 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:13:54.910340 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:13:54.910340 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:13:54.910340 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQef4GfFie_Usg9onbXqxsc-nd1hvl2GLhpDDlciESdqXkfSc92fauL3YAxW9mk-I8RrxFvxC8e-ERiGt3o3X9jL89-XOpeSACjHKgH8fDT2KJEcJRgT5g8xgdkFk0YIGtnIeu5um43DSl1Impb6LI_h2nl5z7SnNKJhsE6EfIclOixM Oct 08 21:13:54.910340 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:13:54.910340 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:13:54.910340 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:13:54.910340 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:13:54.910340 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:13:54.910340 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:13:54.910340 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 0a006f4c3b3647d6989274bbdfad0049 Oct 08 21:13:54.910340 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1612330779 Oct 08 21:13:54.910340 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:13:54.910340 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:13:54.910340 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0a006f4c3b3647d6989274bbdfad0049"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0a006f4c3b3647d6989274bbdfad0049"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0a006f4c3b3647d6989274bbdfad0049"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0a006f4c3b3647d6989274bbdfad0049"}]}] Oct 08 21:13:54.910340 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1612330779 Oct 08 21:13:54.910340 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 0a006f4c3b3647d6989274bbdfad0049 Oct 08 21:13:54.910340 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1612330779 Oct 08 21:13:54.910340 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1612330779-project Oct 08 21:13:54.910340 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:13:54.910340 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:13:54.910340 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 6aef5df0d6004b968d4280a94e1847da Oct 08 21:13:54.910340 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1612330779-project Oct 08 21:13:54.910340 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 21:13:54.910340 ncdv-master-1 devstack@n-api.service[140492]: exception: Instance d66d3500-8ca0-439d-b982-fab393d0187c could not be found. Oct 08 21:13:54.910340 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': 'd66d3500-8ca0-439d-b982-fab393d0187c'} Oct 08 21:13:54.910340 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:13:54.910340 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:13:54.910340 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:13:54.910340 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:13:54.910340 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:13:54.910340 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:13:54.910340 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:13:54.910340 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:13:54.910340 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:13:54.910340 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:13:54.910340 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d66d3500-8ca0-439d-b982-fab393d0187c could not be found. Oct 08 21:13:54.910340 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:13:54.910340 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:13:54.910340 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:13:54.910340 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:13:54.910340 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:13:54.910340 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:13:54.910340 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:13:54.910340 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:13:54.910340 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:13:54.910340 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:13:54.910340 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 08 21:13:54.910340 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 08 21:13:54.910340 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 08 21:13:54.910340 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 08 21:13:54.910340 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:13:54.910340 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:13:54.910340 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:13:54.910340 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:13:54.920116 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d66d3500-8ca0-439d-b982-fab393d0187c could not be found. Oct 08 21:13:54.920116 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:13:54.920116 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:13:54.920116 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:13:54.920116 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:13:54.920116 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:13:54.920116 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:13:54.920116 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:13:54.920116 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:13:54.920116 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d66d3500-8ca0-439d-b982-fab393d0187c could not be found. Oct 08 21:13:54.920116 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:13:54.920116 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-36ef34bd-5aab-45e0-ad85-c93dd514d228 tempest-ServersNegativeTestMultiTenantJSON-1612330779 tempest-ServersNegativeTestMultiTenantJSON-1612330779-project] Returning 404 to user: Instance d66d3500-8ca0-439d-b982-fab393d0187c could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:13:54.920116 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-36ef34bd-5aab-45e0-ad85-c93dd514d228 tempest-ServersNegativeTestMultiTenantJSON-1612330779 tempest-ServersNegativeTestMultiTenantJSON-1612330779-project] 10.222.0.26 "DELETE /compute/v2.1/servers/d66d3500-8ca0-439d-b982-fab393d0187c" status: 404 len: 111 microversion: 2.1 time: 0.351750 Oct 08 21:13:54.923923 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-f51b717b-01aa-4f07-b084-f05c6ed6fc75 tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:13:54.925104 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-f51b717b-01aa-4f07-b084-f05c6ed6fc75 tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] [instance: d66d3500-8ca0-439d-b982-fab393d0187c] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:13:54.929867 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2462/4861] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:13:54 2022] DELETE /compute/v2.1/servers/d66d3500-8ca0-439d-b982-fab393d0187c => generated 111 bytes in 357 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:13:54.931749 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f51b717b-01aa-4f07-b084-f05c6ed6fc75 tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:13:54.932259 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f51b717b-01aa-4f07-b084-f05c6ed6fc75 tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:13:54.932704 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f51b717b-01aa-4f07-b084-f05c6ed6fc75 tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:13:54.938535 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f51b717b-01aa-4f07-b084-f05c6ed6fc75 tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:13:54.939081 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f51b717b-01aa-4f07-b084-f05c6ed6fc75 tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:13:54.939543 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f51b717b-01aa-4f07-b084-f05c6ed6fc75 tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:13:55.180458 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-2b0956bb-d9ec-416b-88a2-86ab92953736 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:13:55.181079 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-2b0956bb-d9ec-416b-88a2-86ab92953736 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] [instance: 64039cd8-bbfa-4797-9e3c-acf4715c67a4] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:13:55.197941 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2b0956bb-d9ec-416b-88a2-86ab92953736 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:13:55.198437 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2b0956bb-d9ec-416b-88a2-86ab92953736 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:13:55.198891 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2b0956bb-d9ec-416b-88a2-86ab92953736 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:13:55.199972 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2b0956bb-d9ec-416b-88a2-86ab92953736 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:13:55.200065 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2b0956bb-d9ec-416b-88a2-86ab92953736 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:13:55.200496 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2b0956bb-d9ec-416b-88a2-86ab92953736 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:13:55.376598 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-f51b717b-01aa-4f07-b084-f05c6ed6fc75 tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6b3f4cefa94e269186f9d9e5aff559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195ea87b43684ed59b1b1c048b0584b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:13:55.397314 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-f51b717b-01aa-4f07-b084-f05c6ed6fc75 tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] 10.222.0.26 "GET /compute/v2.1/servers/d66d3500-8ca0-439d-b982-fab393d0187c" status: 200 len: 1529 microversion: 2.1 time: 0.477276 Oct 08 21:13:55.401919 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2400/4862] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:13:54 2022] GET /compute/v2.1/servers/d66d3500-8ca0-439d-b982-fab393d0187c => generated 1529 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:13:55.432868 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-99b4b58d-c058-4eb4-a21b-9d1589ca0f27 tempest-ServersNegativeTestMultiTenantJSON-1612330779 tempest-ServersNegativeTestMultiTenantJSON-1612330779-project] Action: 'update', calling method: >, body: {"server": {"name": "d66d3500-8ca0-439d-b982-fab393d0187c_new"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:13:55.449805 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-99b4b58d-c058-4eb4-a21b-9d1589ca0f27 tempest-ServersNegativeTestMultiTenantJSON-1612330779 tempest-ServersNegativeTestMultiTenantJSON-1612330779-project] [instance: d66d3500-8ca0-439d-b982-fab393d0187c] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:13:55.465861 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-99b4b58d-c058-4eb4-a21b-9d1589ca0f27 tempest-ServersNegativeTestMultiTenantJSON-1612330779 tempest-ServersNegativeTestMultiTenantJSON-1612330779-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:13:55.466298 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-99b4b58d-c058-4eb4-a21b-9d1589ca0f27 tempest-ServersNegativeTestMultiTenantJSON-1612330779 tempest-ServersNegativeTestMultiTenantJSON-1612330779-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:13:55.466753 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-99b4b58d-c058-4eb4-a21b-9d1589ca0f27 tempest-ServersNegativeTestMultiTenantJSON-1612330779 tempest-ServersNegativeTestMultiTenantJSON-1612330779-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:13:55.468338 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-99b4b58d-c058-4eb4-a21b-9d1589ca0f27 tempest-ServersNegativeTestMultiTenantJSON-1612330779 tempest-ServersNegativeTestMultiTenantJSON-1612330779-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:13:55.468812 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-99b4b58d-c058-4eb4-a21b-9d1589ca0f27 tempest-ServersNegativeTestMultiTenantJSON-1612330779 tempest-ServersNegativeTestMultiTenantJSON-1612330779-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:13:55.469295 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-99b4b58d-c058-4eb4-a21b-9d1589ca0f27 tempest-ServersNegativeTestMultiTenantJSON-1612330779 tempest-ServersNegativeTestMultiTenantJSON-1612330779-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:13:55.537956 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-99b4b58d-c058-4eb4-a21b-9d1589ca0f27 tempest-ServersNegativeTestMultiTenantJSON-1612330779 tempest-ServersNegativeTestMultiTenantJSON-1612330779-project] HTTP exception thrown: Instance d66d3500-8ca0-439d-b982-fab393d0187c could not be found. Oct 08 21:13:55.540772 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-99b4b58d-c058-4eb4-a21b-9d1589ca0f27 tempest-ServersNegativeTestMultiTenantJSON-1612330779 tempest-ServersNegativeTestMultiTenantJSON-1612330779-project] Request method failure captured: Oct 08 21:13:55.540772 ncdv-master-1 devstack@n-api.service[140491]: request: PUT /compute/v2.1/servers/d66d3500-8ca0-439d-b982-fab393d0187c HTTP/1.1 Oct 08 21:13:55.540772 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:13:55.540772 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:13:55.540772 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:13:55.540772 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 64 Oct 08 21:13:55.540772 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:13:55.540772 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:13:55.540772 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:13:55.540772 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:13:55.540772 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQef4GfFie_Usg9onbXqxsc-nd1hvl2GLhpDDlciESdqXkfSc92fauL3YAxW9mk-I8RrxFvxC8e-ERiGt3o3X9jL89-XOpeSACjHKgH8fDT2KJEcJRgT5g8xgdkFk0YIGtnIeu5um43DSl1Impb6LI_h2nl5z7SnNKJhsE6EfIclOixM Oct 08 21:13:55.540772 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:13:55.540772 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:13:55.540772 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:13:55.540772 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:13:55.540772 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:13:55.540772 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:13:55.540772 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 0a006f4c3b3647d6989274bbdfad0049 Oct 08 21:13:55.540772 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1612330779 Oct 08 21:13:55.540772 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:13:55.540772 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:13:55.540772 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0a006f4c3b3647d6989274bbdfad0049"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0a006f4c3b3647d6989274bbdfad0049"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0a006f4c3b3647d6989274bbdfad0049"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0a006f4c3b3647d6989274bbdfad0049"}]}] Oct 08 21:13:55.540772 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1612330779 Oct 08 21:13:55.540772 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 0a006f4c3b3647d6989274bbdfad0049 Oct 08 21:13:55.540772 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1612330779 Oct 08 21:13:55.540772 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1612330779-project Oct 08 21:13:55.540772 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:13:55.540772 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:13:55.540772 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 6aef5df0d6004b968d4280a94e1847da Oct 08 21:13:55.540772 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1612330779-project Oct 08 21:13:55.540772 ncdv-master-1 devstack@n-api.service[140491]: Oct 08 21:13:55.540772 ncdv-master-1 devstack@n-api.service[140491]: {"server": {"name": "d66d3500-8ca0-439d-b982-fab393d0187c_new"}} Oct 08 21:13:55.540772 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:13:55.540772 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance d66d3500-8ca0-439d-b982-fab393d0187c could not be found. Oct 08 21:13:55.540772 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': 'd66d3500-8ca0-439d-b982-fab393d0187c', 'body': {'server': {'name': 'd66d3500-8ca0-439d-b982-fab393d0187c_new'}}} Oct 08 21:13:55.540772 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:13:55.540772 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:13:55.540772 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:13:55.540772 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:13:55.540772 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:13:55.540772 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:13:55.540772 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:13:55.540772 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:13:55.540772 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:13:55.540772 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:13:55.540772 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d66d3500-8ca0-439d-b982-fab393d0187c could not be found. Oct 08 21:13:55.540772 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:13:55.540772 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:13:55.540772 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:13:55.540772 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:13:55.540772 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:13:55.540772 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:13:55.540772 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:13:55.540772 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:13:55.540772 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:13:55.540772 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:13:55.540772 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 21:13:55.540772 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 21:13:55.540772 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 21:13:55.540772 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 21:13:55.540772 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 21:13:55.540772 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 21:13:55.540772 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 08 21:13:55.545801 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Oct 08 21:13:55.545801 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Oct 08 21:13:55.545801 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:13:55.545801 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:13:55.545801 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:13:55.545801 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:13:55.545801 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d66d3500-8ca0-439d-b982-fab393d0187c could not be found. Oct 08 21:13:55.545801 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:13:55.545801 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:13:55.545801 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:13:55.545801 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:13:55.545801 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:13:55.545801 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:13:55.545801 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:13:55.545801 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:13:55.545801 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d66d3500-8ca0-439d-b982-fab393d0187c could not be found. Oct 08 21:13:55.545801 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:13:55.549635 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-99b4b58d-c058-4eb4-a21b-9d1589ca0f27 tempest-ServersNegativeTestMultiTenantJSON-1612330779 tempest-ServersNegativeTestMultiTenantJSON-1612330779-project] Returning 404 to user: Instance d66d3500-8ca0-439d-b982-fab393d0187c could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:13:55.555580 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-99b4b58d-c058-4eb4-a21b-9d1589ca0f27 tempest-ServersNegativeTestMultiTenantJSON-1612330779 tempest-ServersNegativeTestMultiTenantJSON-1612330779-project] 10.222.0.26 "PUT /compute/v2.1/servers/d66d3500-8ca0-439d-b982-fab393d0187c" status: 404 len: 111 microversion: 2.1 time: 0.134822 Oct 08 21:13:55.556758 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2401/4863] 10.222.0.26 () {60 vars in 1256 bytes} [Sat Oct 8 21:13:55 2022] PUT /compute/v2.1/servers/d66d3500-8ca0-439d-b982-fab393d0187c => generated 111 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:13:55.569468 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-89ed1bf7-f5ec-4963-a875-f75c7aaa208b tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:13:55.571357 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-89ed1bf7-f5ec-4963-a875-f75c7aaa208b tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] [instance: 93243a48-4c42-4748-80ca-b990a85e0e3a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:13:55.591437 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-89ed1bf7-f5ec-4963-a875-f75c7aaa208b tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:13:55.597232 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-89ed1bf7-f5ec-4963-a875-f75c7aaa208b tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:13:55.598782 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-89ed1bf7-f5ec-4963-a875-f75c7aaa208b tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:13:55.600700 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-89ed1bf7-f5ec-4963-a875-f75c7aaa208b tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:13:55.602108 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-89ed1bf7-f5ec-4963-a875-f75c7aaa208b tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:13:55.603009 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-89ed1bf7-f5ec-4963-a875-f75c7aaa208b tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:13:55.924920 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-89ed1bf7-f5ec-4963-a875-f75c7aaa208b tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6300eee278b4fad9561ebea03c2eeaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38ddedd2c2754cdb8c60acf585f86f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:13:55.948622 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-89ed1bf7-f5ec-4963-a875-f75c7aaa208b tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] 10.222.0.26 "GET /compute/v2.1/servers/93243a48-4c42-4748-80ca-b990a85e0e3a" status: 200 len: 1324 microversion: 2.1 time: 0.389864 Oct 08 21:13:55.962576 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2402/4864] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:13:55 2022] GET /compute/v2.1/servers/93243a48-4c42-4748-80ca-b990a85e0e3a => generated 1324 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:13:55.968144 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-36a68256-1af2-4373-90ae-c2a7b67408e6 tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:13:55.969385 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-36a68256-1af2-4373-90ae-c2a7b67408e6 tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] [instance: d66d3500-8ca0-439d-b982-fab393d0187c] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:13:55.995443 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-36a68256-1af2-4373-90ae-c2a7b67408e6 tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:13:55.996270 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-36a68256-1af2-4373-90ae-c2a7b67408e6 tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:13:55.996934 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-36a68256-1af2-4373-90ae-c2a7b67408e6 tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:13:55.998035 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-36a68256-1af2-4373-90ae-c2a7b67408e6 tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:13:55.998694 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-36a68256-1af2-4373-90ae-c2a7b67408e6 tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:13:56.000516 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-36a68256-1af2-4373-90ae-c2a7b67408e6 tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:13:56.058989 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-36a68256-1af2-4373-90ae-c2a7b67408e6 tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] [instance: d66d3500-8ca0-439d-b982-fab393d0187c] Going to try to terminate instance {{(pid=140491) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 21:13:56.088038 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=2 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:13:56.256423 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-36a68256-1af2-4373-90ae-c2a7b67408e6 tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] 10.222.0.26 "DELETE /compute/v2.1/servers/d66d3500-8ca0-439d-b982-fab393d0187c" status: 204 len: 0 microversion: 2.1 time: 0.291813 Oct 08 21:13:56.257095 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2403/4865] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:13:55 2022] DELETE /compute/v2.1/servers/d66d3500-8ca0-439d-b982-fab393d0187c => generated 0 bytes in 294 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 21:13:56.270040 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-6de848ce-aa44-47d8-ba6c-45418381fc47 tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:13:56.271041 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-6de848ce-aa44-47d8-ba6c-45418381fc47 tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] [instance: d66d3500-8ca0-439d-b982-fab393d0187c] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:13:56.287477 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6de848ce-aa44-47d8-ba6c-45418381fc47 tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:13:56.289167 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6de848ce-aa44-47d8-ba6c-45418381fc47 tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:13:56.289756 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6de848ce-aa44-47d8-ba6c-45418381fc47 tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:13:56.291684 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6de848ce-aa44-47d8-ba6c-45418381fc47 tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:13:56.301427 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6de848ce-aa44-47d8-ba6c-45418381fc47 tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:13:56.302004 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6de848ce-aa44-47d8-ba6c-45418381fc47 tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:13:56.639700 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-6de848ce-aa44-47d8-ba6c-45418381fc47 tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6b3f4cefa94e269186f9d9e5aff559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195ea87b43684ed59b1b1c048b0584b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:13:56.653537 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-6de848ce-aa44-47d8-ba6c-45418381fc47 tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] 10.222.0.26 "GET /compute/v2.1/servers/d66d3500-8ca0-439d-b982-fab393d0187c" status: 200 len: 1535 microversion: 2.1 time: 0.392041 Oct 08 21:13:56.654186 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2404/4866] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:13:56 2022] GET /compute/v2.1/servers/d66d3500-8ca0-439d-b982-fab393d0187c => generated 1535 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:13:56.656643 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-2b0956bb-d9ec-416b-88a2-86ab92953736 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de71b64a2e1c4b6aaa15b5ee75003add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994439815e0416180c95158033ae3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:13:56.676519 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=8 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:13:56.691818 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-2b0956bb-d9ec-416b-88a2-86ab92953736 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] 10.222.0.26 "GET /compute/v2.1/servers/64039cd8-bbfa-4797-9e3c-acf4715c67a4" status: 200 len: 1512 microversion: 2.1 time: 1.507161 Oct 08 21:13:56.692904 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2463/4867] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:13:55 2022] GET /compute/v2.1/servers/64039cd8-bbfa-4797-9e3c-acf4715c67a4 => generated 1512 bytes in 1517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:13:56.984038 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-1a1a3d15-248e-426d-9c9e-41e40a8296a5 tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:13:56.984964 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-1a1a3d15-248e-426d-9c9e-41e40a8296a5 tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] [instance: 93243a48-4c42-4748-80ca-b990a85e0e3a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:13:57.000190 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1a1a3d15-248e-426d-9c9e-41e40a8296a5 tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:13:57.000944 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1a1a3d15-248e-426d-9c9e-41e40a8296a5 tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:13:57.001787 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1a1a3d15-248e-426d-9c9e-41e40a8296a5 tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:13:57.002963 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1a1a3d15-248e-426d-9c9e-41e40a8296a5 tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:13:57.003953 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1a1a3d15-248e-426d-9c9e-41e40a8296a5 tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:13:57.004618 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1a1a3d15-248e-426d-9c9e-41e40a8296a5 tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:13:57.645249 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-1a1a3d15-248e-426d-9c9e-41e40a8296a5 tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6300eee278b4fad9561ebea03c2eeaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38ddedd2c2754cdb8c60acf585f86f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:13:57.658828 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-1a1a3d15-248e-426d-9c9e-41e40a8296a5 tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] 10.222.0.26 "GET /compute/v2.1/servers/93243a48-4c42-4748-80ca-b990a85e0e3a" status: 200 len: 1324 microversion: 2.1 time: 0.678559 Oct 08 21:13:57.660420 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2405/4868] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:13:56 2022] GET /compute/v2.1/servers/93243a48-4c42-4748-80ca-b990a85e0e3a => generated 1324 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:13:57.690848 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-1d3b1826-5cd2-46cb-ab8d-fe24c6fdd680 tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:13:57.691476 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-1d3b1826-5cd2-46cb-ab8d-fe24c6fdd680 tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] [instance: d66d3500-8ca0-439d-b982-fab393d0187c] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:13:57.708971 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1d3b1826-5cd2-46cb-ab8d-fe24c6fdd680 tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:13:57.716722 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-d60f2d0a-4057-4485-85e5-696cca7cdbd8 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:13:57.717996 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-d60f2d0a-4057-4485-85e5-696cca7cdbd8 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] [instance: 64039cd8-bbfa-4797-9e3c-acf4715c67a4] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:13:57.739701 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d60f2d0a-4057-4485-85e5-696cca7cdbd8 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:13:57.741643 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1d3b1826-5cd2-46cb-ab8d-fe24c6fdd680 tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.033s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:13:57.751080 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d60f2d0a-4057-4485-85e5-696cca7cdbd8 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:13:57.753301 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1d3b1826-5cd2-46cb-ab8d-fe24c6fdd680 tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:13:57.754348 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1d3b1826-5cd2-46cb-ab8d-fe24c6fdd680 tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:13:57.756021 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d60f2d0a-4057-4485-85e5-696cca7cdbd8 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:13:57.757454 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1d3b1826-5cd2-46cb-ab8d-fe24c6fdd680 tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:13:57.758175 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d60f2d0a-4057-4485-85e5-696cca7cdbd8 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:13:57.760675 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d60f2d0a-4057-4485-85e5-696cca7cdbd8 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:13:57.761517 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1d3b1826-5cd2-46cb-ab8d-fe24c6fdd680 tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:13:57.768362 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d60f2d0a-4057-4485-85e5-696cca7cdbd8 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:13:58.584667 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-d60f2d0a-4057-4485-85e5-696cca7cdbd8 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de71b64a2e1c4b6aaa15b5ee75003add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994439815e0416180c95158033ae3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:13:58.598169 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-d60f2d0a-4057-4485-85e5-696cca7cdbd8 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] 10.222.0.26 "GET /compute/v2.1/servers/64039cd8-bbfa-4797-9e3c-acf4715c67a4" status: 200 len: 1512 microversion: 2.1 time: 0.885951 Oct 08 21:13:58.598734 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2406/4869] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:13:57 2022] GET /compute/v2.1/servers/64039cd8-bbfa-4797-9e3c-acf4715c67a4 => generated 1512 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:13:58.638489 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-1d3b1826-5cd2-46cb-ab8d-fe24c6fdd680 tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6b3f4cefa94e269186f9d9e5aff559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195ea87b43684ed59b1b1c048b0584b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:13:58.650898 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-1d3b1826-5cd2-46cb-ab8d-fe24c6fdd680 tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] 10.222.0.26 "GET /compute/v2.1/servers/d66d3500-8ca0-439d-b982-fab393d0187c" status: 200 len: 1535 microversion: 2.1 time: 0.964628 Oct 08 21:13:58.651728 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2464/4870] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:13:57 2022] GET /compute/v2.1/servers/d66d3500-8ca0-439d-b982-fab393d0187c => generated 1535 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:13:58.689109 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-2dadb59a-775b-4434-803f-f03a4de58c14 tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:13:58.691127 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-2dadb59a-775b-4434-803f-f03a4de58c14 tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] [instance: 93243a48-4c42-4748-80ca-b990a85e0e3a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:13:58.699661 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2dadb59a-775b-4434-803f-f03a4de58c14 tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:13:58.718618 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2dadb59a-775b-4434-803f-f03a4de58c14 tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:13:58.719406 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2dadb59a-775b-4434-803f-f03a4de58c14 tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:13:58.723959 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2dadb59a-775b-4434-803f-f03a4de58c14 tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:13:58.724969 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2dadb59a-775b-4434-803f-f03a4de58c14 tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:13:58.724969 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2dadb59a-775b-4434-803f-f03a4de58c14 tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:13:59.046615 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-2dadb59a-775b-4434-803f-f03a4de58c14 tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6300eee278b4fad9561ebea03c2eeaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38ddedd2c2754cdb8c60acf585f86f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:13:59.058282 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-2dadb59a-775b-4434-803f-f03a4de58c14 tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] 10.222.0.26 "GET /compute/v2.1/servers/93243a48-4c42-4748-80ca-b990a85e0e3a" status: 200 len: 1324 microversion: 2.1 time: 0.373483 Oct 08 21:13:59.074716 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2407/4871] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:13:58 2022] GET /compute/v2.1/servers/93243a48-4c42-4748-80ca-b990a85e0e3a => generated 1324 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:13:59.527597 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-df9106fe-8e36-44ea-9fa9-52fe86295c6e req-1df74aa6-b653-4f50-a95a-74e8408e78e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d66d3500-8ca0-439d-b982-fab393d0187c", "name": "network-vif-deleted", "tag": "4d682d03-d010-429e-935b-2f067a1ca62b"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:13:59.558422 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-df9106fe-8e36-44ea-9fa9-52fe86295c6e req-1df74aa6-b653-4f50-a95a-74e8408e78e5 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:13:59.563629 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-df9106fe-8e36-44ea-9fa9-52fe86295c6e req-1df74aa6-b653-4f50-a95a-74e8408e78e5 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:13:59.565519 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-df9106fe-8e36-44ea-9fa9-52fe86295c6e req-1df74aa6-b653-4f50-a95a-74e8408e78e5 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:13:59.593136 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-df9106fe-8e36-44ea-9fa9-52fe86295c6e req-1df74aa6-b653-4f50-a95a-74e8408e78e5 service nova] Creating event network-vif-deleted:4d682d03-d010-429e-935b-2f067a1ca62b for instance d66d3500-8ca0-439d-b982-fab393d0187c on nch2-master-1 Oct 08 21:13:59.605015 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-df9106fe-8e36-44ea-9fa9-52fe86295c6e req-1df74aa6-b653-4f50-a95a-74e8408e78e5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081013 Oct 08 21:13:59.609593 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2465/4872] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:13:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:13:59.623224 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-002910be-e899-412d-bb80-cd1e5078b081 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:13:59.623860 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-002910be-e899-412d-bb80-cd1e5078b081 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] [instance: 64039cd8-bbfa-4797-9e3c-acf4715c67a4] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:13:59.635433 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-002910be-e899-412d-bb80-cd1e5078b081 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:13:59.635951 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-002910be-e899-412d-bb80-cd1e5078b081 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:13:59.636402 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-002910be-e899-412d-bb80-cd1e5078b081 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:13:59.637126 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-002910be-e899-412d-bb80-cd1e5078b081 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:13:59.637643 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-002910be-e899-412d-bb80-cd1e5078b081 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:13:59.638063 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-002910be-e899-412d-bb80-cd1e5078b081 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:13:59.683628 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-96948c5e-4621-461e-a7cc-4f10641bfd11 tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:13:59.689354 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-96948c5e-4621-461e-a7cc-4f10641bfd11 tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] [instance: d66d3500-8ca0-439d-b982-fab393d0187c] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:13:59.737974 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-96948c5e-4621-461e-a7cc-4f10641bfd11 tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:13:59.739402 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-96948c5e-4621-461e-a7cc-4f10641bfd11 tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:13:59.740146 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-96948c5e-4621-461e-a7cc-4f10641bfd11 tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:13:59.742371 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-96948c5e-4621-461e-a7cc-4f10641bfd11 tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:13:59.743129 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-96948c5e-4621-461e-a7cc-4f10641bfd11 tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:13:59.744790 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-96948c5e-4621-461e-a7cc-4f10641bfd11 tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:13:59.753287 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=100 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:13:59.828075 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-96948c5e-4621-461e-a7cc-4f10641bfd11 tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:13:59.828912 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-96948c5e-4621-461e-a7cc-4f10641bfd11 tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:13:59.829601 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-96948c5e-4621-461e-a7cc-4f10641bfd11 tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:13:59.830372 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.objects.instance [None req-96948c5e-4621-461e-a7cc-4f10641bfd11 tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Lazy-loading 'fault' on Instance uuid d66d3500-8ca0-439d-b982-fab393d0187c {{(pid=140492) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 21:13:59.905915 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-96948c5e-4621-461e-a7cc-4f10641bfd11 tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6b3f4cefa94e269186f9d9e5aff559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195ea87b43684ed59b1b1c048b0584b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:13:59.917137 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-96948c5e-4621-461e-a7cc-4f10641bfd11 tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] 10.222.0.26 "GET /compute/v2.1/servers/d66d3500-8ca0-439d-b982-fab393d0187c" status: 200 len: 1318 microversion: 2.1 time: 0.237669 Oct 08 21:13:59.918046 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2466/4873] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:13:59 2022] GET /compute/v2.1/servers/d66d3500-8ca0-439d-b982-fab393d0187c => generated 1318 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:13:59.929607 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-182862ec-4bcc-4a7e-88c9-05406dc7cf7c req-ccc8505b-9191-42c1-bed4-d6016d15ce5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93243a48-4c42-4748-80ca-b990a85e0e3a", "name": "network-vif-plugged", "status": "completed", "tag": "f2f37509-c382-47d0-9abc-83be6717987a"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:13:59.946974 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-182862ec-4bcc-4a7e-88c9-05406dc7cf7c req-ccc8505b-9191-42c1-bed4-d6016d15ce5a service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:13:59.948003 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-182862ec-4bcc-4a7e-88c9-05406dc7cf7c req-ccc8505b-9191-42c1-bed4-d6016d15ce5a service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:13:59.948630 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-182862ec-4bcc-4a7e-88c9-05406dc7cf7c req-ccc8505b-9191-42c1-bed4-d6016d15ce5a service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:13:59.993302 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-182862ec-4bcc-4a7e-88c9-05406dc7cf7c req-ccc8505b-9191-42c1-bed4-d6016d15ce5a service nova] Creating event network-vif-plugged:f2f37509-c382-47d0-9abc-83be6717987a for instance 93243a48-4c42-4748-80ca-b990a85e0e3a on nch2-master-1 Oct 08 21:14:00.000869 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-182862ec-4bcc-4a7e-88c9-05406dc7cf7c req-ccc8505b-9191-42c1-bed4-d6016d15ce5a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080361 Oct 08 21:14:00.002287 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2467/4874] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:13:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:14:00.112056 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-fcbb0a58-58d0-48a2-8b2f-b7eae8420b0e tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:14:00.115001 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-fcbb0a58-58d0-48a2-8b2f-b7eae8420b0e tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] [instance: 93243a48-4c42-4748-80ca-b990a85e0e3a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:14:00.129499 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fcbb0a58-58d0-48a2-8b2f-b7eae8420b0e tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:14:00.130532 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fcbb0a58-58d0-48a2-8b2f-b7eae8420b0e tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:14:00.131250 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fcbb0a58-58d0-48a2-8b2f-b7eae8420b0e tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:14:00.132209 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fcbb0a58-58d0-48a2-8b2f-b7eae8420b0e tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:14:00.137351 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fcbb0a58-58d0-48a2-8b2f-b7eae8420b0e tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:14:00.139377 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fcbb0a58-58d0-48a2-8b2f-b7eae8420b0e tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:14:00.212280 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-002910be-e899-412d-bb80-cd1e5078b081 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de71b64a2e1c4b6aaa15b5ee75003add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994439815e0416180c95158033ae3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:14:00.231287 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-002910be-e899-412d-bb80-cd1e5078b081 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] 10.222.0.26 "GET /compute/v2.1/servers/64039cd8-bbfa-4797-9e3c-acf4715c67a4" status: 200 len: 1518 microversion: 2.1 time: 0.612894 Oct 08 21:14:00.232055 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2408/4875] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:13:59 2022] GET /compute/v2.1/servers/64039cd8-bbfa-4797-9e3c-acf4715c67a4 => generated 1518 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:14:00.573379 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-fcbb0a58-58d0-48a2-8b2f-b7eae8420b0e tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6300eee278b4fad9561ebea03c2eeaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38ddedd2c2754cdb8c60acf585f86f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:14:00.581682 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-fcbb0a58-58d0-48a2-8b2f-b7eae8420b0e tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] 10.222.0.26 "GET /compute/v2.1/servers/93243a48-4c42-4748-80ca-b990a85e0e3a" status: 200 len: 1324 microversion: 2.1 time: 0.485005 Oct 08 21:14:00.594211 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2468/4876] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:14:00 2022] GET /compute/v2.1/servers/93243a48-4c42-4748-80ca-b990a85e0e3a => generated 1324 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:14:00.945677 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-a2570d9e-ad25-401d-8ce9-721eabe9098b tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:14:00.946607 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-a2570d9e-ad25-401d-8ce9-721eabe9098b tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] [instance: d66d3500-8ca0-439d-b982-fab393d0187c] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:14:00.963478 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a2570d9e-ad25-401d-8ce9-721eabe9098b tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:14:00.964405 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a2570d9e-ad25-401d-8ce9-721eabe9098b tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:14:00.965018 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a2570d9e-ad25-401d-8ce9-721eabe9098b tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:14:00.975571 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a2570d9e-ad25-401d-8ce9-721eabe9098b tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:14:00.976085 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a2570d9e-ad25-401d-8ce9-721eabe9098b tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:14:00.976539 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a2570d9e-ad25-401d-8ce9-721eabe9098b tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:14:01.032665 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-a2570d9e-ad25-401d-8ce9-721eabe9098b tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] HTTP exception thrown: Instance d66d3500-8ca0-439d-b982-fab393d0187c could not be found. Oct 08 21:14:01.037586 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-a2570d9e-ad25-401d-8ce9-721eabe9098b tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Request method failure captured: Oct 08 21:14:01.037586 ncdv-master-1 devstack@n-api.service[140491]: request: GET /compute/v2.1/servers/d66d3500-8ca0-439d-b982-fab393d0187c HTTP/1.1 Oct 08 21:14:01.037586 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:14:01.037586 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:14:01.037586 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:14:01.037586 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 21:14:01.037586 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:14:01.037586 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:14:01.037586 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:14:01.037586 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:14:01.037586 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQefh8DsyTT5YALp9JckDeqOKdexrf2vZB3i_eS8Cx31h-Q7JnKZKm9xIgWC9kmlkyrMOpqhvJjUsBoV6wHtY_aZFP7dk8u3QFdzlG8mKqPzKJsCH5xjfeGFlFGlY6mpwaGbQ_625O7i4EGzvZuNGqOg-aiIpwc_zHRPBHF-M4YJnBd8 Oct 08 21:14:01.037586 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:14:01.037586 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:14:01.037586 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:14:01.037586 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:14:01.037586 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:14:01.037586 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:14:01.037586 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 195ea87b43684ed59b1b1c048b0584b3 Oct 08 21:14:01.037586 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-893073143 Oct 08 21:14:01.037586 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:14:01.037586 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:14:01.037586 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/195ea87b43684ed59b1b1c048b0584b3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/195ea87b43684ed59b1b1c048b0584b3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_195ea87b43684ed59b1b1c048b0584b3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/195ea87b43684ed59b1b1c048b0584b3"}]}] Oct 08 21:14:01.037586 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-893073143 Oct 08 21:14:01.037586 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 195ea87b43684ed59b1b1c048b0584b3 Oct 08 21:14:01.037586 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-893073143 Oct 08 21:14:01.037586 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-ServersNegativeTestMultiTenantJSON-893073143-project Oct 08 21:14:01.037586 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:14:01.037586 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:14:01.037586 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 0a6b3f4cefa94e269186f9d9e5aff559 Oct 08 21:14:01.037586 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-893073143-project Oct 08 21:14:01.037586 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:14:01.037586 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance d66d3500-8ca0-439d-b982-fab393d0187c could not be found. Oct 08 21:14:01.037586 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': 'd66d3500-8ca0-439d-b982-fab393d0187c'} Oct 08 21:14:01.037586 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:14:01.037586 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:14:01.037586 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:14:01.037586 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:14:01.037586 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:14:01.037586 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:14:01.037586 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:14:01.037586 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:14:01.037586 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:14:01.037586 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:14:01.037586 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d66d3500-8ca0-439d-b982-fab393d0187c could not be found. Oct 08 21:14:01.037586 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:14:01.037586 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:14:01.037586 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:14:01.037586 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:14:01.037586 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:14:01.037586 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:14:01.037586 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:14:01.037586 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:14:01.037586 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:14:01.037586 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:14:01.037586 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:14:01.037586 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:14:01.037586 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:14:01.037586 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:14:01.037586 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:14:01.037586 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:14:01.037586 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d66d3500-8ca0-439d-b982-fab393d0187c could not be found. Oct 08 21:14:01.037586 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:14:01.041986 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:14:01.041986 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:14:01.041986 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:14:01.041986 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:14:01.041986 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:14:01.041986 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:14:01.041986 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:14:01.041986 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d66d3500-8ca0-439d-b982-fab393d0187c could not be found. Oct 08 21:14:01.041986 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:14:01.044761 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-a2570d9e-ad25-401d-8ce9-721eabe9098b tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] Returning 404 to user: Instance d66d3500-8ca0-439d-b982-fab393d0187c could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:14:01.046840 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-a2570d9e-ad25-401d-8ce9-721eabe9098b tempest-ServersNegativeTestMultiTenantJSON-893073143 tempest-ServersNegativeTestMultiTenantJSON-893073143-project] 10.222.0.26 "GET /compute/v2.1/servers/d66d3500-8ca0-439d-b982-fab393d0187c" status: 404 len: 111 microversion: 2.1 time: 0.106730 Oct 08 21:14:01.050495 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2409/4877] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:14:00 2022] GET /compute/v2.1/servers/d66d3500-8ca0-439d-b982-fab393d0187c => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:14:01.255984 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-ce794138-e18f-45df-b064-5b7acb0c939f tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:14:01.261827 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-ce794138-e18f-45df-b064-5b7acb0c939f tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] [instance: 64039cd8-bbfa-4797-9e3c-acf4715c67a4] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:14:01.276385 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ce794138-e18f-45df-b064-5b7acb0c939f tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:14:01.280661 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ce794138-e18f-45df-b064-5b7acb0c939f tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:14:01.281790 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ce794138-e18f-45df-b064-5b7acb0c939f tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:14:01.282726 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ce794138-e18f-45df-b064-5b7acb0c939f tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:14:01.287491 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ce794138-e18f-45df-b064-5b7acb0c939f tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:14:01.287955 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ce794138-e18f-45df-b064-5b7acb0c939f tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:14:01.606716 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-151537da-715c-4853-98b9-8683fc5e9bc2 tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:14:01.607918 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-151537da-715c-4853-98b9-8683fc5e9bc2 tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] [instance: 93243a48-4c42-4748-80ca-b990a85e0e3a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:14:01.615357 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-151537da-715c-4853-98b9-8683fc5e9bc2 tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:14:01.626009 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-151537da-715c-4853-98b9-8683fc5e9bc2 tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:14:01.626816 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-151537da-715c-4853-98b9-8683fc5e9bc2 tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:14:01.628328 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-151537da-715c-4853-98b9-8683fc5e9bc2 tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:14:01.628964 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-151537da-715c-4853-98b9-8683fc5e9bc2 tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:14:01.629737 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-151537da-715c-4853-98b9-8683fc5e9bc2 tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:14:01.890690 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-ce794138-e18f-45df-b064-5b7acb0c939f tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de71b64a2e1c4b6aaa15b5ee75003add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994439815e0416180c95158033ae3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:14:01.913824 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-ce794138-e18f-45df-b064-5b7acb0c939f tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] 10.222.0.26 "GET /compute/v2.1/servers/64039cd8-bbfa-4797-9e3c-acf4715c67a4" status: 200 len: 1518 microversion: 2.1 time: 0.661111 Oct 08 21:14:01.914820 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2469/4878] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:14:01 2022] GET /compute/v2.1/servers/64039cd8-bbfa-4797-9e3c-acf4715c67a4 => generated 1518 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:14:02.340369 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-151537da-715c-4853-98b9-8683fc5e9bc2 tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6300eee278b4fad9561ebea03c2eeaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38ddedd2c2754cdb8c60acf585f86f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:14:02.379659 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-8d9afa53-7429-4b5e-975c-cf378c0540da req-e435a362-4a7d-48e5-9332-ace91fecfc27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64039cd8-bbfa-4797-9e3c-acf4715c67a4", "name": "network-vif-unplugged", "status": "completed", "tag": "ac63c755-9e73-4f6f-89f2-d960044116e3"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:14:02.389313 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-151537da-715c-4853-98b9-8683fc5e9bc2 tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] 10.222.0.26 "GET /compute/v2.1/servers/93243a48-4c42-4748-80ca-b990a85e0e3a" status: 200 len: 1521 microversion: 2.1 time: 0.784160 Oct 08 21:14:02.393836 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2410/4879] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:14:01 2022] GET /compute/v2.1/servers/93243a48-4c42-4748-80ca-b990a85e0e3a => generated 1521 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:14:02.409466 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-8d9afa53-7429-4b5e-975c-cf378c0540da req-e435a362-4a7d-48e5-9332-ace91fecfc27 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:14:02.423300 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-8d9afa53-7429-4b5e-975c-cf378c0540da req-e435a362-4a7d-48e5-9332-ace91fecfc27 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:14:02.424017 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-8d9afa53-7429-4b5e-975c-cf378c0540da req-e435a362-4a7d-48e5-9332-ace91fecfc27 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:14:02.465979 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-8d9afa53-7429-4b5e-975c-cf378c0540da req-e435a362-4a7d-48e5-9332-ace91fecfc27 service nova] Creating event network-vif-unplugged:ac63c755-9e73-4f6f-89f2-d960044116e3 for instance 64039cd8-bbfa-4797-9e3c-acf4715c67a4 on nch1-master-1 Oct 08 21:14:02.477253 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-8d9afa53-7429-4b5e-975c-cf378c0540da req-e435a362-4a7d-48e5-9332-ace91fecfc27 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.103852 Oct 08 21:14:02.477916 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2470/4880] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:14:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:14:02.596757 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-a1ed9764-fd97-42f3-86c0-a3b32ce4bf0c tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-651594937", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "586b7f19-9a7b-4937-9a72-8261845b5f1b"}]}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:14:02.602650 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-a1ed9764-fd97-42f3-86c0-a3b32ce4bf0c tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] Request method failure captured: Oct 08 21:14:02.602650 ncdv-master-1 devstack@n-api.service[140491]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 08 21:14:02.602650 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:14:02.602650 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:14:02.602650 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:14:02.602650 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 242 Oct 08 21:14:02.602650 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:14:02.602650 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:14:02.602650 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:14:02.602650 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:14:02.602650 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQegHxudDolvAP8bmi-gJC_e7NOyusPumOj1pU2BLGaXWFCvVIxAAyEzwZt9fP1HzUcHJY1kjOXSn62vzIQ8cieYmL5s1KdQUM3aDASVpiJ9uz5v2CO8KSz-hAg1zoIhmGWtGAzxsDJSPUphbiGwot-VsJDjTwjhmX3l9SpakgOIDvKM Oct 08 21:14:02.602650 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:14:02.602650 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:14:02.602650 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:14:02.602650 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:14:02.602650 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:14:02.602650 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:14:02.602650 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 38ddedd2c2754cdb8c60acf585f86f2a Oct 08 21:14:02.602650 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-149654808 Oct 08 21:14:02.602650 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:14:02.602650 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:14:02.602650 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/38ddedd2c2754cdb8c60acf585f86f2a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/38ddedd2c2754cdb8c60acf585f86f2a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_38ddedd2c2754cdb8c60acf585f86f2a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/38ddedd2c2754cdb8c60acf585f86f2a"}]}] Oct 08 21:14:02.602650 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-149654808 Oct 08 21:14:02.602650 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 38ddedd2c2754cdb8c60acf585f86f2a Oct 08 21:14:02.602650 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-149654808 Oct 08 21:14:02.602650 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-ServerMetadataNegativeTestJSON-149654808-project Oct 08 21:14:02.602650 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:14:02.602650 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:14:02.602650 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: b6300eee278b4fad9561ebea03c2eeaa Oct 08 21:14:02.602650 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-149654808-project Oct 08 21:14:02.602650 ncdv-master-1 devstack@n-api.service[140491]: Oct 08 21:14:02.602650 ncdv-master-1 devstack@n-api.service[140491]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-651594937", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "586b7f19-9a7b-4937-9a72-8261845b5f1b"}]}} Oct 08 21:14:02.602650 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:14:02.602650 ncdv-master-1 devstack@n-api.service[140491]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 08 21:14:02.602650 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-651594937', 'imageRef': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': '586b7f19-9a7b-4937-9a72-8261845b5f1b'}]}}} Oct 08 21:14:02.602650 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:14:02.602650 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:14:02.602650 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 08 21:14:02.602650 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 08 21:14:02.602650 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 08 21:14:02.602650 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise error Oct 08 21:14:02.602650 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 08 21:14:02.602650 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:14:02.602650 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 08 21:14:02.602650 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 08 21:14:02.602650 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 08 21:14:02.602650 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 08 21:14:02.602650 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 08 21:14:02.602650 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:14:02.602650 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 08 21:14:02.602650 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi {'': 'data1'} Oct 08 21:14:02.602650 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:14:02.602650 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:14:02.602650 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:14:02.602650 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:14:02.602650 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:14:02.602650 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:14:02.602650 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:14:02.602650 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:14:02.602650 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:14:02.602650 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:14:02.602650 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 21:14:02.602650 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 21:14:02.608201 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 08 21:14:02.608201 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 08 21:14:02.608201 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 08 21:14:02.608201 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 08 21:14:02.608201 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 08 21:14:02.608201 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 08 21:14:02.608201 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 08 21:14:02.608201 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:14:02.608201 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:14:02.608201 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:14:02.608201 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:14:02.608201 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:14:02.608201 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:14:02.608201 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 08 21:14:02.608201 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 08 21:14:02.608201 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 08 21:14:02.608201 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:14:02.611405 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-a1ed9764-fd97-42f3-86c0-a3b32ce4bf0c tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:14:02.619054 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-a1ed9764-fd97-42f3-86c0-a3b32ce4bf0c tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.026171 Oct 08 21:14:02.620200 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2411/4881] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 21:14:02 2022] POST /compute/v2.1/servers => generated 175 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 08 21:14:02.635056 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-1d94701a-4870-4e80-88d3-3b21500700b3 tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:14:02.635908 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-1d94701a-4870-4e80-88d3-3b21500700b3 tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] [instance: a228065a-d746-41ca-84d5-bd806d880497] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:14:02.653170 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-1d94701a-4870-4e80-88d3-3b21500700b3 tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] HTTP exception thrown: Instance a228065a-d746-41ca-84d5-bd806d880497 could not be found. Oct 08 21:14:02.662328 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-1d94701a-4870-4e80-88d3-3b21500700b3 tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] Request method failure captured: Oct 08 21:14:02.662328 ncdv-master-1 devstack@n-api.service[140492]: request: GET /compute/v2.1/servers/a228065a-d746-41ca-84d5-bd806d880497/metadata HTTP/1.1 Oct 08 21:14:02.662328 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:14:02.662328 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:14:02.662328 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:14:02.662328 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 21:14:02.662328 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:14:02.662328 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:14:02.662328 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:14:02.662328 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:14:02.662328 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQegHxudDolvAP8bmi-gJC_e7NOyusPumOj1pU2BLGaXWFCvVIxAAyEzwZt9fP1HzUcHJY1kjOXSn62vzIQ8cieYmL5s1KdQUM3aDASVpiJ9uz5v2CO8KSz-hAg1zoIhmGWtGAzxsDJSPUphbiGwot-VsJDjTwjhmX3l9SpakgOIDvKM Oct 08 21:14:02.662328 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:14:02.662328 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:14:02.662328 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:14:02.662328 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:14:02.662328 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:14:02.662328 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:14:02.662328 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 38ddedd2c2754cdb8c60acf585f86f2a Oct 08 21:14:02.662328 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-149654808 Oct 08 21:14:02.662328 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:14:02.662328 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:14:02.662328 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/38ddedd2c2754cdb8c60acf585f86f2a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/38ddedd2c2754cdb8c60acf585f86f2a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_38ddedd2c2754cdb8c60acf585f86f2a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/38ddedd2c2754cdb8c60acf585f86f2a"}]}] Oct 08 21:14:02.662328 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-149654808 Oct 08 21:14:02.662328 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 38ddedd2c2754cdb8c60acf585f86f2a Oct 08 21:14:02.662328 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-149654808 Oct 08 21:14:02.662328 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-ServerMetadataNegativeTestJSON-149654808-project Oct 08 21:14:02.662328 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:14:02.662328 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:14:02.662328 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: b6300eee278b4fad9561ebea03c2eeaa Oct 08 21:14:02.662328 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-149654808-project Oct 08 21:14:02.662328 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 21:14:02.662328 ncdv-master-1 devstack@n-api.service[140492]: exception: Instance a228065a-d746-41ca-84d5-bd806d880497 could not be found. Oct 08 21:14:02.662328 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'server_id': 'a228065a-d746-41ca-84d5-bd806d880497'} Oct 08 21:14:02.662328 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:14:02.662328 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:14:02.662328 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:14:02.662328 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:14:02.662328 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:14:02.662328 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:14:02.662328 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 08 21:14:02.662328 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 08 21:14:02.662328 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a228065a-d746-41ca-84d5-bd806d880497 could not be found. Oct 08 21:14:02.662328 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:14:02.662328 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:14:02.662328 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:14:02.662328 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:14:02.662328 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:14:02.662328 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:14:02.662328 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:14:02.662328 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:14:02.662328 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:14:02.662328 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:14:02.662328 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Oct 08 21:14:02.662328 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Oct 08 21:14:02.662328 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:14:02.662328 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:14:02.662328 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a228065a-d746-41ca-84d5-bd806d880497 could not be found. Oct 08 21:14:02.662328 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:14:02.662328 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:14:02.662328 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:14:02.662328 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:14:02.662328 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:14:02.662328 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:14:02.667139 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:14:02.667139 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:14:02.667139 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a228065a-d746-41ca-84d5-bd806d880497 could not be found. Oct 08 21:14:02.667139 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:14:02.667139 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-1d94701a-4870-4e80-88d3-3b21500700b3 tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] Returning 404 to user: Instance a228065a-d746-41ca-84d5-bd806d880497 could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:14:02.667139 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-1d94701a-4870-4e80-88d3-3b21500700b3 tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] 10.222.0.26 "GET /compute/v2.1/servers/a228065a-d746-41ca-84d5-bd806d880497/metadata" status: 404 len: 111 microversion: 2.1 time: 0.036792 Oct 08 21:14:02.667139 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2471/4882] 10.222.0.26 () {58 vars in 1263 bytes} [Sat Oct 8 21:14:02 2022] GET /compute/v2.1/servers/a228065a-d746-41ca-84d5-bd806d880497/metadata => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:14:02.901664 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-539eb350-9502-4b2e-82b2-003a58caa506 tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1629323043", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "586b7f19-9a7b-4937-9a72-8261845b5f1b"}]}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:14:02.910431 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-539eb350-9502-4b2e-82b2-003a58caa506 tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] Request method failure captured: Oct 08 21:14:02.910431 ncdv-master-1 devstack@n-api.service[140491]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 08 21:14:02.910431 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:14:02.910431 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:14:02.910431 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:14:02.910431 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 499 Oct 08 21:14:02.910431 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:14:02.910431 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:14:02.910431 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:14:02.910431 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:14:02.910431 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQegHxudDolvAP8bmi-gJC_e7NOyusPumOj1pU2BLGaXWFCvVIxAAyEzwZt9fP1HzUcHJY1kjOXSn62vzIQ8cieYmL5s1KdQUM3aDASVpiJ9uz5v2CO8KSz-hAg1zoIhmGWtGAzxsDJSPUphbiGwot-VsJDjTwjhmX3l9SpakgOIDvKM Oct 08 21:14:02.910431 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:14:02.910431 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:14:02.910431 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:14:02.910431 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:14:02.910431 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:14:02.910431 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:14:02.910431 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 38ddedd2c2754cdb8c60acf585f86f2a Oct 08 21:14:02.910431 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-149654808 Oct 08 21:14:02.910431 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:14:02.910431 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:14:02.910431 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/38ddedd2c2754cdb8c60acf585f86f2a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/38ddedd2c2754cdb8c60acf585f86f2a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_38ddedd2c2754cdb8c60acf585f86f2a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/38ddedd2c2754cdb8c60acf585f86f2a"}]}] Oct 08 21:14:02.910431 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-149654808 Oct 08 21:14:02.910431 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 38ddedd2c2754cdb8c60acf585f86f2a Oct 08 21:14:02.910431 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-149654808 Oct 08 21:14:02.910431 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-ServerMetadataNegativeTestJSON-149654808-project Oct 08 21:14:02.910431 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:14:02.910431 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:14:02.910431 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: b6300eee278b4fad9561ebea03c2eeaa Oct 08 21:14:02.910431 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-149654808-project Oct 08 21:14:02.910431 ncdv-master-1 devstack@n-api.service[140491]: Oct 08 21:14:02.910431 ncdv-master-1 devstack@n-api.service[140491]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1629323043", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "586b7f19-9a7b-4937-9a72-8261845b5f1b"}]}} Oct 08 21:14:02.910431 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:14:02.910431 ncdv-master-1 devstack@n-api.service[140491]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 08 21:14:02.910431 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1629323043', 'imageRef': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '586b7f19-9a7b-4937-9a72-8261845b5f1b'}]}}} Oct 08 21:14:02.910431 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:14:02.910431 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:14:02.910431 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 08 21:14:02.910431 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 08 21:14:02.910431 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 08 21:14:02.910431 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise error Oct 08 21:14:02.910431 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 08 21:14:02.910431 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:14:02.910431 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 08 21:14:02.910431 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 08 21:14:02.910431 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 08 21:14:02.910431 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 08 21:14:02.913735 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 08 21:14:02.913735 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:14:02.913735 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 08 21:14:02.913735 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 08 21:14:02.913735 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:14:02.913735 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:14:02.913735 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:14:02.913735 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:14:02.913735 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:14:02.913735 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:14:02.913735 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:14:02.913735 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:14:02.913735 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:14:02.913735 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:14:02.913735 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 21:14:02.913735 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 21:14:02.913735 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 08 21:14:02.913735 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 08 21:14:02.913735 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 08 21:14:02.913735 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 08 21:14:02.913735 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 08 21:14:02.913735 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 08 21:14:02.913735 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 08 21:14:02.913735 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:14:02.913735 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:14:02.913735 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:14:02.913735 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:14:02.913735 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:14:02.913735 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:14:02.913735 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 08 21:14:02.913735 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 08 21:14:02.913735 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 08 21:14:02.913735 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:14:02.921024 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-539eb350-9502-4b2e-82b2-003a58caa506 tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:14:02.922129 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-539eb350-9502-4b2e-82b2-003a58caa506 tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.025572 Oct 08 21:14:02.922926 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2412/4883] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 21:14:02 2022] POST /compute/v2.1/servers => generated 687 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 08 21:14:02.943403 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-a7f59096-a95d-43a0-b1a6-971535714f22 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:14:02.944310 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-a7f59096-a95d-43a0-b1a6-971535714f22 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] [instance: 64039cd8-bbfa-4797-9e3c-acf4715c67a4] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:14:02.959047 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a7f59096-a95d-43a0-b1a6-971535714f22 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:14:02.959548 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a7f59096-a95d-43a0-b1a6-971535714f22 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:14:02.959991 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a7f59096-a95d-43a0-b1a6-971535714f22 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:14:02.960736 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a7f59096-a95d-43a0-b1a6-971535714f22 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:14:02.961465 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a7f59096-a95d-43a0-b1a6-971535714f22 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:14:02.975470 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a7f59096-a95d-43a0-b1a6-971535714f22 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:14:03.155398 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-acc24535-17f4-4583-85d7-f2c7cd5553a6 tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-434267890", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "586b7f19-9a7b-4937-9a72-8261845b5f1b"}]}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:14:03.160855 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-acc24535-17f4-4583-85d7-f2c7cd5553a6 tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] Request method failure captured: Oct 08 21:14:03.160855 ncdv-master-1 devstack@n-api.service[140491]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 08 21:14:03.160855 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:14:03.160855 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:14:03.160855 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:14:03.160855 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 499 Oct 08 21:14:03.160855 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:14:03.160855 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:14:03.160855 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:14:03.160855 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:14:03.160855 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQegHxudDolvAP8bmi-gJC_e7NOyusPumOj1pU2BLGaXWFCvVIxAAyEzwZt9fP1HzUcHJY1kjOXSn62vzIQ8cieYmL5s1KdQUM3aDASVpiJ9uz5v2CO8KSz-hAg1zoIhmGWtGAzxsDJSPUphbiGwot-VsJDjTwjhmX3l9SpakgOIDvKM Oct 08 21:14:03.160855 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:14:03.160855 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:14:03.160855 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:14:03.160855 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:14:03.160855 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:14:03.160855 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:14:03.160855 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 38ddedd2c2754cdb8c60acf585f86f2a Oct 08 21:14:03.160855 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-149654808 Oct 08 21:14:03.160855 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:14:03.160855 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:14:03.160855 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/38ddedd2c2754cdb8c60acf585f86f2a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/38ddedd2c2754cdb8c60acf585f86f2a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_38ddedd2c2754cdb8c60acf585f86f2a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/38ddedd2c2754cdb8c60acf585f86f2a"}]}] Oct 08 21:14:03.160855 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-149654808 Oct 08 21:14:03.160855 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 38ddedd2c2754cdb8c60acf585f86f2a Oct 08 21:14:03.160855 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-149654808 Oct 08 21:14:03.160855 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-ServerMetadataNegativeTestJSON-149654808-project Oct 08 21:14:03.160855 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:14:03.160855 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:14:03.160855 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: b6300eee278b4fad9561ebea03c2eeaa Oct 08 21:14:03.160855 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-149654808-project Oct 08 21:14:03.160855 ncdv-master-1 devstack@n-api.service[140491]: Oct 08 21:14:03.160855 ncdv-master-1 devstack@n-api.service[140491]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-434267890", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "586b7f19-9a7b-4937-9a72-8261845b5f1b"}]}} Oct 08 21:14:03.160855 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:14:03.160855 ncdv-master-1 devstack@n-api.service[140491]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 08 21:14:03.160855 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-434267890', 'imageRef': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '586b7f19-9a7b-4937-9a72-8261845b5f1b'}]}}} Oct 08 21:14:03.160855 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:14:03.160855 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:14:03.160855 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 08 21:14:03.160855 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 08 21:14:03.160855 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 08 21:14:03.160855 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise error Oct 08 21:14:03.160855 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 08 21:14:03.160855 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:14:03.160855 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 08 21:14:03.160855 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 08 21:14:03.160855 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 08 21:14:03.160855 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 08 21:14:03.164901 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 08 21:14:03.164901 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:14:03.164901 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 08 21:14:03.164901 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 08 21:14:03.164901 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:14:03.164901 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:14:03.164901 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:14:03.164901 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:14:03.164901 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:14:03.164901 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:14:03.164901 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:14:03.164901 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:14:03.164901 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:14:03.164901 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:14:03.164901 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 21:14:03.164901 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 21:14:03.164901 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 08 21:14:03.164901 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 08 21:14:03.164901 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 08 21:14:03.164901 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 08 21:14:03.164901 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 08 21:14:03.164901 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 08 21:14:03.164901 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 08 21:14:03.164901 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:14:03.164901 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:14:03.164901 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:14:03.164901 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:14:03.164901 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:14:03.164901 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:14:03.164901 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 08 21:14:03.164901 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 08 21:14:03.164901 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 08 21:14:03.164901 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:14:03.179012 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-acc24535-17f4-4583-85d7-f2c7cd5553a6 tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:14:03.192054 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-acc24535-17f4-4583-85d7-f2c7cd5553a6 tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.046495 Oct 08 21:14:03.192923 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2413/4884] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 21:14:03 2022] POST /compute/v2.1/servers => generated 689 bytes in 48 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 08 21:14:03.332279 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-a7f59096-a95d-43a0-b1a6-971535714f22 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de71b64a2e1c4b6aaa15b5ee75003add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994439815e0416180c95158033ae3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:14:03.349986 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-a7f59096-a95d-43a0-b1a6-971535714f22 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] 10.222.0.26 "GET /compute/v2.1/servers/64039cd8-bbfa-4797-9e3c-acf4715c67a4" status: 200 len: 1518 microversion: 2.1 time: 0.413610 Oct 08 21:14:03.350896 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2472/4885] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:14:02 2022] GET /compute/v2.1/servers/64039cd8-bbfa-4797-9e3c-acf4715c67a4 => generated 1518 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:14:03.447271 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-671ba4d7-bf43-43b3-8cf9-36539885400b tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-577620864", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "586b7f19-9a7b-4937-9a72-8261845b5f1b"}]}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:14:03.454080 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-671ba4d7-bf43-43b3-8cf9-36539885400b tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] Request method failure captured: Oct 08 21:14:03.454080 ncdv-master-1 devstack@n-api.service[140491]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 08 21:14:03.454080 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:14:03.454080 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:14:03.454080 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:14:03.454080 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 753 Oct 08 21:14:03.454080 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:14:03.454080 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:14:03.454080 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:14:03.454080 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:14:03.454080 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQegHxudDolvAP8bmi-gJC_e7NOyusPumOj1pU2BLGaXWFCvVIxAAyEzwZt9fP1HzUcHJY1kjOXSn62vzIQ8cieYmL5s1KdQUM3aDASVpiJ9uz5v2CO8KSz-hAg1zoIhmGWtGAzxsDJSPUphbiGwot-VsJDjTwjhmX3l9SpakgOIDvKM Oct 08 21:14:03.454080 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:14:03.454080 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:14:03.454080 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:14:03.454080 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:14:03.454080 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:14:03.454080 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:14:03.454080 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 38ddedd2c2754cdb8c60acf585f86f2a Oct 08 21:14:03.454080 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-149654808 Oct 08 21:14:03.454080 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:14:03.454080 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:14:03.454080 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/38ddedd2c2754cdb8c60acf585f86f2a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/38ddedd2c2754cdb8c60acf585f86f2a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_38ddedd2c2754cdb8c60acf585f86f2a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/38ddedd2c2754cdb8c60acf585f86f2a"}]}] Oct 08 21:14:03.454080 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-149654808 Oct 08 21:14:03.454080 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 38ddedd2c2754cdb8c60acf585f86f2a Oct 08 21:14:03.454080 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-149654808 Oct 08 21:14:03.454080 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-ServerMetadataNegativeTestJSON-149654808-project Oct 08 21:14:03.454080 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:14:03.454080 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:14:03.454080 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: b6300eee278b4fad9561ebea03c2eeaa Oct 08 21:14:03.454080 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-149654808-project Oct 08 21:14:03.454080 ncdv-master-1 devstack@n-api.service[140491]: Oct 08 21:14:03.454080 ncdv-master-1 devstack@n-api.service[140491]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-577620864", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "586b7f19-9a7b-4937-9a72-8261845b5f1b"}]}} Oct 08 21:14:03.454080 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:14:03.454080 ncdv-master-1 devstack@n-api.service[140491]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 08 21:14:03.454080 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-577620864', 'imageRef': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '586b7f19-9a7b-4937-9a72-8261845b5f1b'}]}}} Oct 08 21:14:03.454080 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:14:03.454080 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:14:03.454080 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 08 21:14:03.454080 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 08 21:14:03.454080 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 08 21:14:03.456838 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise error Oct 08 21:14:03.456838 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 08 21:14:03.456838 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:14:03.456838 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 08 21:14:03.456838 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 08 21:14:03.456838 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 08 21:14:03.456838 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 08 21:14:03.456838 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 08 21:14:03.456838 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:14:03.456838 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 08 21:14:03.456838 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 08 21:14:03.456838 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:14:03.456838 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:14:03.456838 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:14:03.456838 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:14:03.456838 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:14:03.456838 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:14:03.456838 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:14:03.456838 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:14:03.456838 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:14:03.456838 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:14:03.456838 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 21:14:03.456838 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 21:14:03.456838 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 08 21:14:03.456838 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 08 21:14:03.456838 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 08 21:14:03.456838 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 08 21:14:03.456838 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 08 21:14:03.456838 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 08 21:14:03.456838 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 08 21:14:03.456838 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:14:03.456838 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:14:03.456838 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:14:03.456838 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:14:03.456838 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:14:03.456838 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:14:03.456838 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 08 21:14:03.456838 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 08 21:14:03.460504 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 08 21:14:03.460504 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:14:03.464334 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-671ba4d7-bf43-43b3-8cf9-36539885400b tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:14:03.465564 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-671ba4d7-bf43-43b3-8cf9-36539885400b tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.022516 Oct 08 21:14:03.469421 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2414/4886] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 21:14:03 2022] POST /compute/v2.1/servers => generated 1197 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Oct 08 21:14:03.569221 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e302a613-b448-45c6-932f-dcf682251f41 tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-955759557", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "586b7f19-9a7b-4937-9a72-8261845b5f1b"}]}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:14:03.576278 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e302a613-b448-45c6-932f-dcf682251f41 tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] Request method failure captured: Oct 08 21:14:03.576278 ncdv-master-1 devstack@n-api.service[140492]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 08 21:14:03.576278 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:14:03.576278 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:14:03.576278 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:14:03.576278 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 1265 Oct 08 21:14:03.576278 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:14:03.576278 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:14:03.576278 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:14:03.576278 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:14:03.576278 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQegHxudDolvAP8bmi-gJC_e7NOyusPumOj1pU2BLGaXWFCvVIxAAyEzwZt9fP1HzUcHJY1kjOXSn62vzIQ8cieYmL5s1KdQUM3aDASVpiJ9uz5v2CO8KSz-hAg1zoIhmGWtGAzxsDJSPUphbiGwot-VsJDjTwjhmX3l9SpakgOIDvKM Oct 08 21:14:03.576278 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:14:03.576278 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:14:03.576278 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:14:03.576278 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:14:03.576278 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:14:03.576278 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:14:03.576278 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 38ddedd2c2754cdb8c60acf585f86f2a Oct 08 21:14:03.576278 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-149654808 Oct 08 21:14:03.576278 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:14:03.576278 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:14:03.576278 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/38ddedd2c2754cdb8c60acf585f86f2a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/38ddedd2c2754cdb8c60acf585f86f2a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_38ddedd2c2754cdb8c60acf585f86f2a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/38ddedd2c2754cdb8c60acf585f86f2a"}]}] Oct 08 21:14:03.576278 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-149654808 Oct 08 21:14:03.576278 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 38ddedd2c2754cdb8c60acf585f86f2a Oct 08 21:14:03.576278 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-149654808 Oct 08 21:14:03.576278 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-ServerMetadataNegativeTestJSON-149654808-project Oct 08 21:14:03.576278 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:14:03.576278 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:14:03.576278 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: b6300eee278b4fad9561ebea03c2eeaa Oct 08 21:14:03.576278 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-149654808-project Oct 08 21:14:03.576278 ncdv-master-1 devstack@n-api.service[140492]: Oct 08 21:14:03.576278 ncdv-master-1 devstack@n-api.service[140492]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-955759557", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "586b7f19-9a7b-4937-9a72-8261845b5f1b"}]}} Oct 08 21:14:03.576278 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 21:14:03.578753 ncdv-master-1 devstack@n-api.service[140492]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 08 21:14:03.578753 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-955759557', 'imageRef': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '586b7f19-9a7b-4937-9a72-8261845b5f1b'}]}}} Oct 08 21:14:03.578753 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:14:03.578753 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:14:03.578753 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 08 21:14:03.578753 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 08 21:14:03.578753 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 08 21:14:03.578753 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise error Oct 08 21:14:03.578753 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 08 21:14:03.578753 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:14:03.578753 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 08 21:14:03.578753 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 08 21:14:03.578753 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 08 21:14:03.578753 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 08 21:14:03.578753 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 08 21:14:03.578753 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:14:03.578753 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 08 21:14:03.579909 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 08 21:14:03.579909 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:14:03.579909 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:14:03.579909 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:14:03.579909 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:14:03.579909 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:14:03.579909 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:14:03.579909 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:14:03.579909 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:14:03.579909 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:14:03.579909 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:14:03.579909 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 21:14:03.579909 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 21:14:03.579909 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 08 21:14:03.579909 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 08 21:14:03.579909 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 08 21:14:03.579909 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 08 21:14:03.579909 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 08 21:14:03.579909 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 08 21:14:03.579909 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 08 21:14:03.579909 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:14:03.579909 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:14:03.579909 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:14:03.579909 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:14:03.579909 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:14:03.579909 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:14:03.579909 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 08 21:14:03.579909 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 08 21:14:03.585840 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 08 21:14:03.585840 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:14:03.587526 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e302a613-b448-45c6-932f-dcf682251f41 tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:14:03.588815 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-e302a613-b448-45c6-932f-dcf682251f41 tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.024780 Oct 08 21:14:03.602159 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c8fbd737-c44f-4419-b974-41ee017e91ee tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:14:03.602625 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-c8fbd737-c44f-4419-b974-41ee017e91ee tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] [instance: ef27ceda-5cb8-4989-98c3-a8c2253e10c9] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:14:03.605422 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2473/4887] 10.222.0.26 () {60 vars in 1148 bytes} [Sat Oct 8 21:14:03 2022] POST /compute/v2.1/servers => generated 2221 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Oct 08 21:14:03.611088 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-c8fbd737-c44f-4419-b974-41ee017e91ee tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] HTTP exception thrown: Instance ef27ceda-5cb8-4989-98c3-a8c2253e10c9 could not be found. Oct 08 21:14:03.614191 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c8fbd737-c44f-4419-b974-41ee017e91ee tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] Request method failure captured: Oct 08 21:14:03.614191 ncdv-master-1 devstack@n-api.service[140491]: request: GET /compute/v2.1/servers/ef27ceda-5cb8-4989-98c3-a8c2253e10c9/metadata/test2 HTTP/1.1 Oct 08 21:14:03.614191 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:14:03.614191 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:14:03.614191 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:14:03.614191 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 21:14:03.614191 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:14:03.614191 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:14:03.614191 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:14:03.614191 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:14:03.614191 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQegHxudDolvAP8bmi-gJC_e7NOyusPumOj1pU2BLGaXWFCvVIxAAyEzwZt9fP1HzUcHJY1kjOXSn62vzIQ8cieYmL5s1KdQUM3aDASVpiJ9uz5v2CO8KSz-hAg1zoIhmGWtGAzxsDJSPUphbiGwot-VsJDjTwjhmX3l9SpakgOIDvKM Oct 08 21:14:03.614191 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:14:03.614191 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:14:03.614191 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:14:03.614191 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:14:03.614191 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:14:03.614191 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:14:03.614191 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 38ddedd2c2754cdb8c60acf585f86f2a Oct 08 21:14:03.614191 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-149654808 Oct 08 21:14:03.614191 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:14:03.614191 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:14:03.614191 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/38ddedd2c2754cdb8c60acf585f86f2a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/38ddedd2c2754cdb8c60acf585f86f2a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_38ddedd2c2754cdb8c60acf585f86f2a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/38ddedd2c2754cdb8c60acf585f86f2a"}]}] Oct 08 21:14:03.614191 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-149654808 Oct 08 21:14:03.614191 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 38ddedd2c2754cdb8c60acf585f86f2a Oct 08 21:14:03.614191 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-149654808 Oct 08 21:14:03.614191 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-ServerMetadataNegativeTestJSON-149654808-project Oct 08 21:14:03.614191 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:14:03.614191 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:14:03.614191 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: b6300eee278b4fad9561ebea03c2eeaa Oct 08 21:14:03.614191 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-149654808-project Oct 08 21:14:03.614191 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:14:03.614191 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance ef27ceda-5cb8-4989-98c3-a8c2253e10c9 could not be found. Oct 08 21:14:03.614191 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'server_id': 'ef27ceda-5cb8-4989-98c3-a8c2253e10c9', 'id': 'test2'} Oct 08 21:14:03.614191 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:14:03.614191 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:14:03.614191 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:14:03.614191 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:14:03.614191 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:14:03.614191 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:14:03.614191 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 08 21:14:03.614191 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 08 21:14:03.614191 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef27ceda-5cb8-4989-98c3-a8c2253e10c9 could not be found. Oct 08 21:14:03.614191 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:14:03.614191 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:14:03.614191 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:14:03.614191 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:14:03.614191 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:14:03.614191 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:14:03.614191 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:14:03.614191 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:14:03.614191 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:14:03.614191 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:14:03.614191 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Oct 08 21:14:03.614191 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Oct 08 21:14:03.614191 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:14:03.614191 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:14:03.614191 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef27ceda-5cb8-4989-98c3-a8c2253e10c9 could not be found. Oct 08 21:14:03.614191 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:14:03.614191 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:14:03.614191 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:14:03.614191 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:14:03.614191 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:14:03.614191 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:14:03.619530 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:14:03.619530 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:14:03.619530 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef27ceda-5cb8-4989-98c3-a8c2253e10c9 could not be found. Oct 08 21:14:03.619530 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:14:03.619530 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c8fbd737-c44f-4419-b974-41ee017e91ee tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] Returning 404 to user: Instance ef27ceda-5cb8-4989-98c3-a8c2253e10c9 could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:14:03.619530 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-c8fbd737-c44f-4419-b974-41ee017e91ee tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] 10.222.0.26 "GET /compute/v2.1/servers/ef27ceda-5cb8-4989-98c3-a8c2253e10c9/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.019543 Oct 08 21:14:03.634892 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-a4364d70-9966-4392-b7eb-762b35644f27 tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:14:03.635451 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-a4364d70-9966-4392-b7eb-762b35644f27 tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] [instance: 93243a48-4c42-4748-80ca-b990a85e0e3a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:14:03.639747 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2415/4888] 10.222.0.26 () {58 vars in 1281 bytes} [Sat Oct 8 21:14:03 2022] GET /compute/v2.1/servers/ef27ceda-5cb8-4989-98c3-a8c2253e10c9/metadata/test2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:14:03.648719 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a4364d70-9966-4392-b7eb-762b35644f27 tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:14:03.649393 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a4364d70-9966-4392-b7eb-762b35644f27 tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:14:03.650279 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a4364d70-9966-4392-b7eb-762b35644f27 tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:14:03.651403 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a4364d70-9966-4392-b7eb-762b35644f27 tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:14:03.652026 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a4364d70-9966-4392-b7eb-762b35644f27 tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:14:03.652571 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a4364d70-9966-4392-b7eb-762b35644f27 tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:14:03.683425 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-a4364d70-9966-4392-b7eb-762b35644f27 tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] [instance: 93243a48-4c42-4748-80ca-b990a85e0e3a] Going to try to terminate instance {{(pid=140492) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 21:14:03.819285 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-a4364d70-9966-4392-b7eb-762b35644f27 tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] 10.222.0.26 "DELETE /compute/v2.1/servers/93243a48-4c42-4748-80ca-b990a85e0e3a" status: 204 len: 0 microversion: 2.1 time: 0.189854 Oct 08 21:14:03.820309 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2474/4889] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:14:03 2022] DELETE /compute/v2.1/servers/93243a48-4c42-4748-80ca-b990a85e0e3a => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 21:14:03.830284 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-15a557c7-5b77-484c-bc2c-9c576cfd6d6a tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:14:03.831689 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-15a557c7-5b77-484c-bc2c-9c576cfd6d6a tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] [instance: 93243a48-4c42-4748-80ca-b990a85e0e3a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:14:03.841968 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-15a557c7-5b77-484c-bc2c-9c576cfd6d6a tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:14:03.842517 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-15a557c7-5b77-484c-bc2c-9c576cfd6d6a tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:14:03.843368 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-15a557c7-5b77-484c-bc2c-9c576cfd6d6a tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:14:03.844440 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-15a557c7-5b77-484c-bc2c-9c576cfd6d6a tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:14:03.845063 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-15a557c7-5b77-484c-bc2c-9c576cfd6d6a tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:14:03.845732 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-15a557c7-5b77-484c-bc2c-9c576cfd6d6a tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:14:04.379149 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-0c88c8ec-435e-471c-b2b8-3724e8e7c587 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:14:04.379901 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-0c88c8ec-435e-471c-b2b8-3724e8e7c587 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] [instance: 64039cd8-bbfa-4797-9e3c-acf4715c67a4] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:14:04.392525 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0c88c8ec-435e-471c-b2b8-3724e8e7c587 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:14:04.393347 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0c88c8ec-435e-471c-b2b8-3724e8e7c587 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:14:04.393966 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0c88c8ec-435e-471c-b2b8-3724e8e7c587 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:14:04.394851 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0c88c8ec-435e-471c-b2b8-3724e8e7c587 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:14:04.395514 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0c88c8ec-435e-471c-b2b8-3724e8e7c587 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:14:04.396118 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0c88c8ec-435e-471c-b2b8-3724e8e7c587 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:14:04.653724 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-15a557c7-5b77-484c-bc2c-9c576cfd6d6a tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6300eee278b4fad9561ebea03c2eeaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38ddedd2c2754cdb8c60acf585f86f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:14:04.688732 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-15a557c7-5b77-484c-bc2c-9c576cfd6d6a tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] 10.222.0.26 "GET /compute/v2.1/servers/93243a48-4c42-4748-80ca-b990a85e0e3a" status: 200 len: 1527 microversion: 2.1 time: 0.863139 Oct 08 21:14:04.715849 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2416/4890] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:14:03 2022] GET /compute/v2.1/servers/93243a48-4c42-4748-80ca-b990a85e0e3a => generated 1527 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:14:04.751840 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-0c88c8ec-435e-471c-b2b8-3724e8e7c587 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de71b64a2e1c4b6aaa15b5ee75003add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994439815e0416180c95158033ae3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:14:04.761599 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-0c88c8ec-435e-471c-b2b8-3724e8e7c587 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] 10.222.0.26 "GET /compute/v2.1/servers/64039cd8-bbfa-4797-9e3c-acf4715c67a4" status: 200 len: 1518 microversion: 2.1 time: 0.390291 Oct 08 21:14:04.762841 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2475/4891] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:14:04 2022] GET /compute/v2.1/servers/64039cd8-bbfa-4797-9e3c-acf4715c67a4 => generated 1518 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:14:05.713844 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-8d6257ec-bf68-479e-ac34-24c6e2dec212 tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:14:05.714530 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-8d6257ec-bf68-479e-ac34-24c6e2dec212 tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] [instance: 93243a48-4c42-4748-80ca-b990a85e0e3a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:14:05.741050 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8d6257ec-bf68-479e-ac34-24c6e2dec212 tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:14:05.741702 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8d6257ec-bf68-479e-ac34-24c6e2dec212 tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:14:05.742172 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8d6257ec-bf68-479e-ac34-24c6e2dec212 tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:14:05.742952 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8d6257ec-bf68-479e-ac34-24c6e2dec212 tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:14:05.743431 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8d6257ec-bf68-479e-ac34-24c6e2dec212 tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:14:05.743860 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8d6257ec-bf68-479e-ac34-24c6e2dec212 tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:14:05.785885 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-0ee7acae-d5e0-48e8-939b-2c9ab8fb1502 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:14:05.787026 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-0ee7acae-d5e0-48e8-939b-2c9ab8fb1502 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] [instance: 64039cd8-bbfa-4797-9e3c-acf4715c67a4] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:14:05.795287 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0ee7acae-d5e0-48e8-939b-2c9ab8fb1502 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:14:05.795927 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0ee7acae-d5e0-48e8-939b-2c9ab8fb1502 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:14:05.796889 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0ee7acae-d5e0-48e8-939b-2c9ab8fb1502 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:14:05.797894 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0ee7acae-d5e0-48e8-939b-2c9ab8fb1502 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:14:05.798581 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0ee7acae-d5e0-48e8-939b-2c9ab8fb1502 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:14:05.800229 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0ee7acae-d5e0-48e8-939b-2c9ab8fb1502 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:14:05.802413 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:14:06.081436 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-8d6257ec-bf68-479e-ac34-24c6e2dec212 tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6300eee278b4fad9561ebea03c2eeaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38ddedd2c2754cdb8c60acf585f86f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:14:06.101750 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-8d6257ec-bf68-479e-ac34-24c6e2dec212 tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] 10.222.0.26 "GET /compute/v2.1/servers/93243a48-4c42-4748-80ca-b990a85e0e3a" status: 200 len: 1485 microversion: 2.1 time: 0.391604 Oct 08 21:14:06.117009 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2417/4892] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:14:05 2022] GET /compute/v2.1/servers/93243a48-4c42-4748-80ca-b990a85e0e3a => generated 1485 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:14:06.140167 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-7af665e2-9a2a-4898-b1b1-5261c93ba207 req-5678cac2-b2d5-4120-866b-6ddad9127bb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93243a48-4c42-4748-80ca-b990a85e0e3a", "name": "network-vif-deleted", "tag": "f2f37509-c382-47d0-9abc-83be6717987a"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:14:06.153617 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-7af665e2-9a2a-4898-b1b1-5261c93ba207 req-5678cac2-b2d5-4120-866b-6ddad9127bb7 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:14:06.154108 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-7af665e2-9a2a-4898-b1b1-5261c93ba207 req-5678cac2-b2d5-4120-866b-6ddad9127bb7 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:14:06.154744 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-7af665e2-9a2a-4898-b1b1-5261c93ba207 req-5678cac2-b2d5-4120-866b-6ddad9127bb7 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:14:06.169924 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-7af665e2-9a2a-4898-b1b1-5261c93ba207 req-5678cac2-b2d5-4120-866b-6ddad9127bb7 service nova] Creating event network-vif-deleted:f2f37509-c382-47d0-9abc-83be6717987a for instance 93243a48-4c42-4748-80ca-b990a85e0e3a on nch2-master-1 Oct 08 21:14:06.178690 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-7af665e2-9a2a-4898-b1b1-5261c93ba207 req-5678cac2-b2d5-4120-866b-6ddad9127bb7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042514 Oct 08 21:14:06.179745 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2418/4893] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:14:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 08 21:14:06.247068 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-0ee7acae-d5e0-48e8-939b-2c9ab8fb1502 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de71b64a2e1c4b6aaa15b5ee75003add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994439815e0416180c95158033ae3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:14:06.257515 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-0ee7acae-d5e0-48e8-939b-2c9ab8fb1502 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] 10.222.0.26 "GET /compute/v2.1/servers/64039cd8-bbfa-4797-9e3c-acf4715c67a4" status: 200 len: 1518 microversion: 2.1 time: 0.476313 Oct 08 21:14:06.269984 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2476/4894] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:14:05 2022] GET /compute/v2.1/servers/64039cd8-bbfa-4797-9e3c-acf4715c67a4 => generated 1518 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:14:07.012930 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-b6f66222-a0e6-4244-bb47-bd8197b5b00a req-a585fea1-b344-4e2a-96bc-bae40137f718 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64039cd8-bbfa-4797-9e3c-acf4715c67a4", "name": "network-vif-plugged", "status": "completed", "tag": "ac63c755-9e73-4f6f-89f2-d960044116e3"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:14:07.034005 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-b6f66222-a0e6-4244-bb47-bd8197b5b00a req-a585fea1-b344-4e2a-96bc-bae40137f718 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:14:07.034813 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-b6f66222-a0e6-4244-bb47-bd8197b5b00a req-a585fea1-b344-4e2a-96bc-bae40137f718 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:14:07.035430 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-b6f66222-a0e6-4244-bb47-bd8197b5b00a req-a585fea1-b344-4e2a-96bc-bae40137f718 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:14:07.063367 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-b6f66222-a0e6-4244-bb47-bd8197b5b00a req-a585fea1-b344-4e2a-96bc-bae40137f718 service nova] Creating event network-vif-plugged:ac63c755-9e73-4f6f-89f2-d960044116e3 for instance 64039cd8-bbfa-4797-9e3c-acf4715c67a4 on nch1-master-1 Oct 08 21:14:07.073658 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-b6f66222-a0e6-4244-bb47-bd8197b5b00a req-a585fea1-b344-4e2a-96bc-bae40137f718 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066105 Oct 08 21:14:07.075951 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2419/4895] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:14:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:14:07.141669 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-264039ba-3755-4f30-8a23-a1ad47361dcb tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:14:07.143713 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-264039ba-3755-4f30-8a23-a1ad47361dcb tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] [instance: 93243a48-4c42-4748-80ca-b990a85e0e3a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:14:07.173990 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-264039ba-3755-4f30-8a23-a1ad47361dcb tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:14:07.174805 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-264039ba-3755-4f30-8a23-a1ad47361dcb tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:14:07.176350 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-264039ba-3755-4f30-8a23-a1ad47361dcb tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:14:07.177831 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-264039ba-3755-4f30-8a23-a1ad47361dcb tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:14:07.181429 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-264039ba-3755-4f30-8a23-a1ad47361dcb tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:14:07.182120 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-264039ba-3755-4f30-8a23-a1ad47361dcb tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:14:07.248170 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-264039ba-3755-4f30-8a23-a1ad47361dcb tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] HTTP exception thrown: Instance 93243a48-4c42-4748-80ca-b990a85e0e3a could not be found. Oct 08 21:14:07.251712 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-264039ba-3755-4f30-8a23-a1ad47361dcb tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] Request method failure captured: Oct 08 21:14:07.251712 ncdv-master-1 devstack@n-api.service[140492]: request: GET /compute/v2.1/servers/93243a48-4c42-4748-80ca-b990a85e0e3a HTTP/1.1 Oct 08 21:14:07.251712 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:14:07.251712 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:14:07.251712 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:14:07.251712 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 21:14:07.251712 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:14:07.251712 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:14:07.251712 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:14:07.251712 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:14:07.251712 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQegHxudDolvAP8bmi-gJC_e7NOyusPumOj1pU2BLGaXWFCvVIxAAyEzwZt9fP1HzUcHJY1kjOXSn62vzIQ8cieYmL5s1KdQUM3aDASVpiJ9uz5v2CO8KSz-hAg1zoIhmGWtGAzxsDJSPUphbiGwot-VsJDjTwjhmX3l9SpakgOIDvKM Oct 08 21:14:07.251712 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:14:07.251712 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:14:07.251712 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:14:07.251712 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:14:07.251712 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:14:07.251712 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:14:07.251712 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 38ddedd2c2754cdb8c60acf585f86f2a Oct 08 21:14:07.251712 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-149654808 Oct 08 21:14:07.251712 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:14:07.251712 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:14:07.251712 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/38ddedd2c2754cdb8c60acf585f86f2a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/38ddedd2c2754cdb8c60acf585f86f2a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_38ddedd2c2754cdb8c60acf585f86f2a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/38ddedd2c2754cdb8c60acf585f86f2a"}]}] Oct 08 21:14:07.251712 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-149654808 Oct 08 21:14:07.251712 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 38ddedd2c2754cdb8c60acf585f86f2a Oct 08 21:14:07.251712 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-149654808 Oct 08 21:14:07.251712 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-ServerMetadataNegativeTestJSON-149654808-project Oct 08 21:14:07.251712 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:14:07.251712 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:14:07.251712 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: b6300eee278b4fad9561ebea03c2eeaa Oct 08 21:14:07.251712 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-149654808-project Oct 08 21:14:07.251712 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 21:14:07.251712 ncdv-master-1 devstack@n-api.service[140492]: exception: Instance 93243a48-4c42-4748-80ca-b990a85e0e3a could not be found. Oct 08 21:14:07.251712 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': '93243a48-4c42-4748-80ca-b990a85e0e3a'} Oct 08 21:14:07.251712 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:14:07.251712 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:14:07.251712 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:14:07.251712 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:14:07.251712 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:14:07.251712 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:14:07.251712 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:14:07.251712 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:14:07.251712 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:14:07.251712 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:14:07.251712 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93243a48-4c42-4748-80ca-b990a85e0e3a could not be found. Oct 08 21:14:07.251712 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:14:07.251712 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:14:07.251712 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:14:07.251712 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:14:07.251712 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:14:07.251712 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:14:07.251712 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:14:07.251712 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:14:07.251712 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:14:07.251712 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:14:07.251712 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:14:07.251712 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:14:07.251712 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:14:07.251712 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:14:07.251712 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:14:07.251712 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:14:07.251712 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93243a48-4c42-4748-80ca-b990a85e0e3a could not be found. Oct 08 21:14:07.251712 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:14:07.251712 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:14:07.259142 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:14:07.259142 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:14:07.259142 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:14:07.259142 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:14:07.259142 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:14:07.259142 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:14:07.259142 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93243a48-4c42-4748-80ca-b990a85e0e3a could not be found. Oct 08 21:14:07.259142 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:14:07.259142 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-264039ba-3755-4f30-8a23-a1ad47361dcb tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] Returning 404 to user: Instance 93243a48-4c42-4748-80ca-b990a85e0e3a could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:14:07.259142 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-264039ba-3755-4f30-8a23-a1ad47361dcb tempest-ServerMetadataNegativeTestJSON-149654808 tempest-ServerMetadataNegativeTestJSON-149654808-project] 10.222.0.26 "GET /compute/v2.1/servers/93243a48-4c42-4748-80ca-b990a85e0e3a" status: 404 len: 111 microversion: 2.1 time: 0.124395 Oct 08 21:14:07.259142 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2477/4896] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:14:07 2022] GET /compute/v2.1/servers/93243a48-4c42-4748-80ca-b990a85e0e3a => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:14:07.282012 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-580b476f-59d9-4953-a192-a026f3d58c60 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:14:07.282745 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-580b476f-59d9-4953-a192-a026f3d58c60 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] [instance: 64039cd8-bbfa-4797-9e3c-acf4715c67a4] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:14:07.295523 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-580b476f-59d9-4953-a192-a026f3d58c60 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:14:07.296261 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-580b476f-59d9-4953-a192-a026f3d58c60 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:14:07.299178 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-580b476f-59d9-4953-a192-a026f3d58c60 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:14:07.300161 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-580b476f-59d9-4953-a192-a026f3d58c60 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:14:07.300795 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-580b476f-59d9-4953-a192-a026f3d58c60 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:14:07.301422 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-580b476f-59d9-4953-a192-a026f3d58c60 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:14:08.198832 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-580b476f-59d9-4953-a192-a026f3d58c60 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de71b64a2e1c4b6aaa15b5ee75003add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994439815e0416180c95158033ae3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:14:08.211607 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-580b476f-59d9-4953-a192-a026f3d58c60 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] 10.222.0.26 "GET /compute/v2.1/servers/64039cd8-bbfa-4797-9e3c-acf4715c67a4" status: 200 len: 1518 microversion: 2.1 time: 0.933818 Oct 08 21:14:08.212373 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2420/4897] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:14:07 2022] GET /compute/v2.1/servers/64039cd8-bbfa-4797-9e3c-acf4715c67a4 => generated 1518 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:14:09.235904 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-49f88ccf-5683-4a94-ad94-814d5f8d48bb tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:14:09.237945 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-49f88ccf-5683-4a94-ad94-814d5f8d48bb tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] [instance: 64039cd8-bbfa-4797-9e3c-acf4715c67a4] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:14:09.252680 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-49f88ccf-5683-4a94-ad94-814d5f8d48bb tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:14:09.254067 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-49f88ccf-5683-4a94-ad94-814d5f8d48bb tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:14:09.259787 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-49f88ccf-5683-4a94-ad94-814d5f8d48bb tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:14:09.262267 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-49f88ccf-5683-4a94-ad94-814d5f8d48bb tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:14:09.262924 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-49f88ccf-5683-4a94-ad94-814d5f8d48bb tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:14:09.263440 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-49f88ccf-5683-4a94-ad94-814d5f8d48bb tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:14:09.838956 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-49f88ccf-5683-4a94-ad94-814d5f8d48bb tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de71b64a2e1c4b6aaa15b5ee75003add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994439815e0416180c95158033ae3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:14:09.855828 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-49f88ccf-5683-4a94-ad94-814d5f8d48bb tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] 10.222.0.26 "GET /compute/v2.1/servers/64039cd8-bbfa-4797-9e3c-acf4715c67a4" status: 200 len: 1503 microversion: 2.1 time: 0.620848 Oct 08 21:14:09.858250 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2478/4898] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:14:09 2022] GET /compute/v2.1/servers/64039cd8-bbfa-4797-9e3c-acf4715c67a4 => generated 1503 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:14:09.886911 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-2bff5e80-363f-4eb6-a3a1-fdf8247d3d87 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:14:09.888387 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-2bff5e80-363f-4eb6-a3a1-fdf8247d3d87 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] [instance: 64039cd8-bbfa-4797-9e3c-acf4715c67a4] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:14:09.903260 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2bff5e80-363f-4eb6-a3a1-fdf8247d3d87 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:14:09.904140 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2bff5e80-363f-4eb6-a3a1-fdf8247d3d87 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:14:09.904937 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2bff5e80-363f-4eb6-a3a1-fdf8247d3d87 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:14:09.905952 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2bff5e80-363f-4eb6-a3a1-fdf8247d3d87 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:14:09.906649 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2bff5e80-363f-4eb6-a3a1-fdf8247d3d87 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:14:09.907310 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2bff5e80-363f-4eb6-a3a1-fdf8247d3d87 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:14:10.998892 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-2bff5e80-363f-4eb6-a3a1-fdf8247d3d87 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de71b64a2e1c4b6aaa15b5ee75003add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994439815e0416180c95158033ae3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:14:11.017369 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-2bff5e80-363f-4eb6-a3a1-fdf8247d3d87 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] 10.222.0.26 "GET /compute/v2.1/servers/64039cd8-bbfa-4797-9e3c-acf4715c67a4" status: 200 len: 1503 microversion: 2.1 time: 1.136072 Oct 08 21:14:11.021165 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2421/4899] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:14:09 2022] GET /compute/v2.1/servers/64039cd8-bbfa-4797-9e3c-acf4715c67a4 => generated 1503 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:14:11.052481 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-98c7bd5d-ecf6-423c-a7bb-cb5173a6cb46 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:14:11.053431 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-98c7bd5d-ecf6-423c-a7bb-cb5173a6cb46 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] [instance: 64039cd8-bbfa-4797-9e3c-acf4715c67a4] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:14:11.069563 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-98c7bd5d-ecf6-423c-a7bb-cb5173a6cb46 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:14:11.070377 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-98c7bd5d-ecf6-423c-a7bb-cb5173a6cb46 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:14:11.070870 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-98c7bd5d-ecf6-423c-a7bb-cb5173a6cb46 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:14:11.071750 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-98c7bd5d-ecf6-423c-a7bb-cb5173a6cb46 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:14:11.072507 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-98c7bd5d-ecf6-423c-a7bb-cb5173a6cb46 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:14:11.072950 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-98c7bd5d-ecf6-423c-a7bb-cb5173a6cb46 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:14:11.149315 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-98c7bd5d-ecf6-423c-a7bb-cb5173a6cb46 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] [instance: 64039cd8-bbfa-4797-9e3c-acf4715c67a4] Going to try to terminate instance {{(pid=140492) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 21:14:11.267356 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-98c7bd5d-ecf6-423c-a7bb-cb5173a6cb46 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] 10.222.0.26 "DELETE /compute/v2.1/servers/64039cd8-bbfa-4797-9e3c-acf4715c67a4" status: 204 len: 0 microversion: 2.1 time: 0.220503 Oct 08 21:14:11.269424 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2479/4900] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:14:11 2022] DELETE /compute/v2.1/servers/64039cd8-bbfa-4797-9e3c-acf4715c67a4 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 21:14:11.549989 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-ea327ed7-1fad-4174-8277-d599d4dcb3fa tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-246463152", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "networks": [{"uuid": "a0e46c11-625b-4c0f-8df1-deaf5b32373b"}]}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:14:11.679309 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.network.neutron [None req-ea327ed7-1fad-4174-8277-d599d4dcb3fa tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] validate_networks() for [('a0e46c11-625b-4c0f-8df1-deaf5b32373b', None, None, None, None, None)] {{(pid=140491) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 21:14:13.711864 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-ea327ed7-1fad-4174-8277-d599d4dcb3fa tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Flavor limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 21:14:13.713290 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-ea327ed7-1fad-4174-8277-d599d4dcb3fa tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Image limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 21:14:13.714280 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-ea327ed7-1fad-4174-8277-d599d4dcb3fa tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Flavor pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 21:14:13.715080 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-ea327ed7-1fad-4174-8277-d599d4dcb3fa tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Image pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 21:14:13.715736 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-ea327ed7-1fad-4174-8277-d599d4dcb3fa tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 21:14:13.738405 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ea327ed7-1fad-4174-8277-d599d4dcb3fa tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:14:13.739491 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ea327ed7-1fad-4174-8277-d599d4dcb3fa tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:14:13.740783 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ea327ed7-1fad-4174-8277-d599d4dcb3fa tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:14:13.742178 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ea327ed7-1fad-4174-8277-d599d4dcb3fa tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:14:13.742889 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ea327ed7-1fad-4174-8277-d599d4dcb3fa tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:14:13.746214 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ea327ed7-1fad-4174-8277-d599d4dcb3fa tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:14:13.808963 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-ea327ed7-1fad-4174-8277-d599d4dcb3fa tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Getting quotas for project 7994439815e0416180c95158033ae3f2. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:14:13.819022 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-ea327ed7-1fad-4174-8277-d599d4dcb3fa tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Getting quotas for user de71b64a2e1c4b6aaa15b5ee75003add and project 7994439815e0416180c95158033ae3f2. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:14:13.854036 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-ea327ed7-1fad-4174-8277-d599d4dcb3fa tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Going to run 1 instances... {{(pid=140491) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 21:14:13.859149 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-ea327ed7-1fad-4174-8277-d599d4dcb3fa tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] [instance: 4e33d129-543f-479f-86bf-4638cb153321] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c508bd7f-7db9-4b2c-af7c-be54a855c355',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140491) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 21:14:13.970714 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-ea327ed7-1fad-4174-8277-d599d4dcb3fa tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.433774 Oct 08 21:14:13.978221 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2422/4901] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 21:14:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 2442 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 08 21:14:13.988366 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-41ccd4e8-c1fe-450d-900e-67fe7e87f274 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:14:13.989094 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-41ccd4e8-c1fe-450d-900e-67fe7e87f274 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] [instance: 4e33d129-543f-479f-86bf-4638cb153321] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:14:14.243029 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-41ccd4e8-c1fe-450d-900e-67fe7e87f274 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de71b64a2e1c4b6aaa15b5ee75003add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994439815e0416180c95158033ae3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:14:14.252753 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-41ccd4e8-c1fe-450d-900e-67fe7e87f274 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] 10.222.0.26 "GET /compute/v2.1/servers/4e33d129-543f-479f-86bf-4638cb153321" status: 200 len: 1217 microversion: 2.1 time: 0.273342 Oct 08 21:14:14.257623 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2480/4902] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:14:13 2022] GET /compute/v2.1/servers/4e33d129-543f-479f-86bf-4638cb153321 => generated 1217 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:14:15.295782 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-4604a2c8-ac43-4c3c-95c7-579072f68f48 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:14:15.296495 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-4604a2c8-ac43-4c3c-95c7-579072f68f48 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] [instance: 4e33d129-543f-479f-86bf-4638cb153321] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:14:15.326013 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4604a2c8-ac43-4c3c-95c7-579072f68f48 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:14:15.329483 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4604a2c8-ac43-4c3c-95c7-579072f68f48 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:14:15.331664 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4604a2c8-ac43-4c3c-95c7-579072f68f48 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:14:15.333032 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4604a2c8-ac43-4c3c-95c7-579072f68f48 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:14:15.337502 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4604a2c8-ac43-4c3c-95c7-579072f68f48 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:14:15.339370 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4604a2c8-ac43-4c3c-95c7-579072f68f48 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:14:15.691761 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-8110f2fc-7ade-4f19-ae39-daaeb9e92ddc req-d7f42813-99a7-4d81-8226-4b638ea059d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64039cd8-bbfa-4797-9e3c-acf4715c67a4", "name": "network-vif-deleted", "tag": "ac63c755-9e73-4f6f-89f2-d960044116e3"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:14:15.722494 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-8110f2fc-7ade-4f19-ae39-daaeb9e92ddc req-d7f42813-99a7-4d81-8226-4b638ea059d5 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:14:15.723313 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-8110f2fc-7ade-4f19-ae39-daaeb9e92ddc req-d7f42813-99a7-4d81-8226-4b638ea059d5 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:14:15.723934 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-8110f2fc-7ade-4f19-ae39-daaeb9e92ddc req-d7f42813-99a7-4d81-8226-4b638ea059d5 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:14:15.729959 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-4604a2c8-ac43-4c3c-95c7-579072f68f48 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de71b64a2e1c4b6aaa15b5ee75003add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994439815e0416180c95158033ae3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:14:15.743235 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-4604a2c8-ac43-4c3c-95c7-579072f68f48 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] 10.222.0.26 "GET /compute/v2.1/servers/4e33d129-543f-479f-86bf-4638cb153321" status: 200 len: 1269 microversion: 2.1 time: 0.458376 Oct 08 21:14:15.747867 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2423/4903] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:14:15 2022] GET /compute/v2.1/servers/4e33d129-543f-479f-86bf-4638cb153321 => generated 1269 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:14:15.755763 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-8110f2fc-7ade-4f19-ae39-daaeb9e92ddc req-d7f42813-99a7-4d81-8226-4b638ea059d5 service nova] Creating event network-vif-deleted:ac63c755-9e73-4f6f-89f2-d960044116e3 for instance 64039cd8-bbfa-4797-9e3c-acf4715c67a4 on nch1-master-1 Oct 08 21:14:15.768324 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-8110f2fc-7ade-4f19-ae39-daaeb9e92ddc req-d7f42813-99a7-4d81-8226-4b638ea059d5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079578 Oct 08 21:14:15.772246 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2481/4904] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:14:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 08 21:14:16.779385 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-6de92e84-ff56-488a-b240-ee7c175cb04e tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:14:16.780811 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-6de92e84-ff56-488a-b240-ee7c175cb04e tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] [instance: 4e33d129-543f-479f-86bf-4638cb153321] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:14:16.796934 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6de92e84-ff56-488a-b240-ee7c175cb04e tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:14:16.797699 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6de92e84-ff56-488a-b240-ee7c175cb04e tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:14:16.804220 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6de92e84-ff56-488a-b240-ee7c175cb04e tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:14:16.805594 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6de92e84-ff56-488a-b240-ee7c175cb04e tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:14:16.806262 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6de92e84-ff56-488a-b240-ee7c175cb04e tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:14:16.807129 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6de92e84-ff56-488a-b240-ee7c175cb04e tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:14:17.218674 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-6de92e84-ff56-488a-b240-ee7c175cb04e tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de71b64a2e1c4b6aaa15b5ee75003add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994439815e0416180c95158033ae3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:14:17.253312 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-6de92e84-ff56-488a-b240-ee7c175cb04e tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] 10.222.0.26 "GET /compute/v2.1/servers/4e33d129-543f-479f-86bf-4638cb153321" status: 200 len: 1275 microversion: 2.1 time: 0.477495 Oct 08 21:14:17.255871 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2424/4905] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:14:16 2022] GET /compute/v2.1/servers/4e33d129-543f-479f-86bf-4638cb153321 => generated 1275 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:14:18.283375 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-abcfc8e8-b659-4e22-a6f3-903ed9ec28f5 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:14:18.284113 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-abcfc8e8-b659-4e22-a6f3-903ed9ec28f5 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] [instance: 4e33d129-543f-479f-86bf-4638cb153321] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:14:18.295715 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-abcfc8e8-b659-4e22-a6f3-903ed9ec28f5 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:14:18.296230 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-abcfc8e8-b659-4e22-a6f3-903ed9ec28f5 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:14:18.296691 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-abcfc8e8-b659-4e22-a6f3-903ed9ec28f5 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:14:18.300929 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-abcfc8e8-b659-4e22-a6f3-903ed9ec28f5 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:14:18.301480 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-abcfc8e8-b659-4e22-a6f3-903ed9ec28f5 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:14:18.301936 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-abcfc8e8-b659-4e22-a6f3-903ed9ec28f5 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:14:19.060279 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-abcfc8e8-b659-4e22-a6f3-903ed9ec28f5 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de71b64a2e1c4b6aaa15b5ee75003add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994439815e0416180c95158033ae3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:14:19.072257 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-abcfc8e8-b659-4e22-a6f3-903ed9ec28f5 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] 10.222.0.26 "GET /compute/v2.1/servers/4e33d129-543f-479f-86bf-4638cb153321" status: 200 len: 1317 microversion: 2.1 time: 0.793168 Oct 08 21:14:19.076262 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2482/4906] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:14:18 2022] GET /compute/v2.1/servers/4e33d129-543f-479f-86bf-4638cb153321 => generated 1317 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:14:20.101029 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-d64d9e88-7c7c-4283-a4e8-ac113fc15526 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:14:20.103386 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-d64d9e88-7c7c-4283-a4e8-ac113fc15526 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] [instance: 4e33d129-543f-479f-86bf-4638cb153321] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:14:20.126188 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:14:20.137654 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d64d9e88-7c7c-4283-a4e8-ac113fc15526 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:14:20.139654 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d64d9e88-7c7c-4283-a4e8-ac113fc15526 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:14:20.141918 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d64d9e88-7c7c-4283-a4e8-ac113fc15526 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:14:20.145916 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d64d9e88-7c7c-4283-a4e8-ac113fc15526 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:14:20.146486 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d64d9e88-7c7c-4283-a4e8-ac113fc15526 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:14:20.149673 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d64d9e88-7c7c-4283-a4e8-ac113fc15526 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:14:21.003349 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-5c455d4d-ae0b-4690-9a9c-c34e624f8bdb req-99b28592-0a67-4fe5-be71-5f7ca4565c4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e33d129-543f-479f-86bf-4638cb153321", "tag": "778906c1-21bc-4637-97d7-0ea6988950f3"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:14:21.052497 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-5c455d4d-ae0b-4690-9a9c-c34e624f8bdb req-99b28592-0a67-4fe5-be71-5f7ca4565c4a service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:14:21.057031 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-5c455d4d-ae0b-4690-9a9c-c34e624f8bdb req-99b28592-0a67-4fe5-be71-5f7ca4565c4a service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:14:21.057599 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-5c455d4d-ae0b-4690-9a9c-c34e624f8bdb req-99b28592-0a67-4fe5-be71-5f7ca4565c4a service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:14:21.077732 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-5c455d4d-ae0b-4690-9a9c-c34e624f8bdb req-99b28592-0a67-4fe5-be71-5f7ca4565c4a service nova] Creating event network-changed:778906c1-21bc-4637-97d7-0ea6988950f3 for instance 4e33d129-543f-479f-86bf-4638cb153321 on nch2-master-1 Oct 08 21:14:21.095070 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-5c455d4d-ae0b-4690-9a9c-c34e624f8bdb req-99b28592-0a67-4fe5-be71-5f7ca4565c4a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098401 Oct 08 21:14:21.097101 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2483/4907] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:14:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 08 21:14:21.233477 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-d64d9e88-7c7c-4283-a4e8-ac113fc15526 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de71b64a2e1c4b6aaa15b5ee75003add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994439815e0416180c95158033ae3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:14:21.254535 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-d64d9e88-7c7c-4283-a4e8-ac113fc15526 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] 10.222.0.26 "GET /compute/v2.1/servers/4e33d129-543f-479f-86bf-4638cb153321" status: 200 len: 1317 microversion: 2.1 time: 1.158877 Oct 08 21:14:21.255129 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2425/4908] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:14:20 2022] GET /compute/v2.1/servers/4e33d129-543f-479f-86bf-4638cb153321 => generated 1317 bytes in 1160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:14:22.281120 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-acc34b3e-b314-4da4-a888-134ae5fe872d tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:14:22.282105 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-acc34b3e-b314-4da4-a888-134ae5fe872d tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] [instance: 4e33d129-543f-479f-86bf-4638cb153321] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:14:22.294309 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-acc34b3e-b314-4da4-a888-134ae5fe872d tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:14:22.295277 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-acc34b3e-b314-4da4-a888-134ae5fe872d tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:14:22.295845 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-acc34b3e-b314-4da4-a888-134ae5fe872d tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:14:22.296696 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-acc34b3e-b314-4da4-a888-134ae5fe872d tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:14:22.297508 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-acc34b3e-b314-4da4-a888-134ae5fe872d tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:14:22.298247 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-acc34b3e-b314-4da4-a888-134ae5fe872d tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:14:22.664613 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-acc34b3e-b314-4da4-a888-134ae5fe872d tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de71b64a2e1c4b6aaa15b5ee75003add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994439815e0416180c95158033ae3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:14:22.671191 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-acc34b3e-b314-4da4-a888-134ae5fe872d tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] 10.222.0.26 "GET /compute/v2.1/servers/4e33d129-543f-479f-86bf-4638cb153321" status: 200 len: 1317 microversion: 2.1 time: 0.395755 Oct 08 21:14:22.672005 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2484/4909] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:14:22 2022] GET /compute/v2.1/servers/4e33d129-543f-479f-86bf-4638cb153321 => generated 1317 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:14:23.697448 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-cb7ff910-6bec-4d0b-b1e2-79fa616991f5 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:14:23.698109 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-cb7ff910-6bec-4d0b-b1e2-79fa616991f5 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] [instance: 4e33d129-543f-479f-86bf-4638cb153321] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:14:23.711974 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cb7ff910-6bec-4d0b-b1e2-79fa616991f5 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:14:23.712612 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cb7ff910-6bec-4d0b-b1e2-79fa616991f5 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:14:23.713065 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cb7ff910-6bec-4d0b-b1e2-79fa616991f5 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:14:23.714099 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cb7ff910-6bec-4d0b-b1e2-79fa616991f5 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:14:23.718059 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cb7ff910-6bec-4d0b-b1e2-79fa616991f5 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:14:23.718760 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cb7ff910-6bec-4d0b-b1e2-79fa616991f5 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:14:23.787399 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=2 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:14:23.839153 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=6 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:14:24.169696 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-9c2d2f1a-7d0c-4fb2-8ef2-5c459a4e845c tempest-ComputeTenantNetworksTest-437746017 tempest-ComputeTenantNetworksTest-437746017-project] Calling method '.version_select at 0x7f1a8ca76700>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:14:24.247602 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=2 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:14:24.411641 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-cb7ff910-6bec-4d0b-b1e2-79fa616991f5 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de71b64a2e1c4b6aaa15b5ee75003add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994439815e0416180c95158033ae3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:14:24.427149 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-cb7ff910-6bec-4d0b-b1e2-79fa616991f5 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] 10.222.0.26 "GET /compute/v2.1/servers/4e33d129-543f-479f-86bf-4638cb153321" status: 200 len: 1317 microversion: 2.1 time: 0.733949 Oct 08 21:14:24.433648 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2426/4910] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:14:23 2022] GET /compute/v2.1/servers/4e33d129-543f-479f-86bf-4638cb153321 => generated 1317 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:14:24.741360 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-9c2d2f1a-7d0c-4fb2-8ef2-5c459a4e845c tempest-ComputeTenantNetworksTest-437746017 tempest-ComputeTenantNetworksTest-437746017-project] 10.222.0.26 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 309 microversion: 2.1 time: 0.782876 Oct 08 21:14:24.743053 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2485/4911] 10.222.0.26 () {58 vars in 1158 bytes} [Sat Oct 8 21:14:23 2022] GET /compute/v2.1/os-tenant-networks => generated 309 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:14:24.755028 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-cb6ebdaa-3d3b-45aa-a81e-4aa027ea6859 tempest-ComputeTenantNetworksTest-437746017 tempest-ComputeTenantNetworksTest-437746017-project] Calling method '.version_select at 0x7f1a914cc670>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:14:24.985932 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-cb6ebdaa-3d3b-45aa-a81e-4aa027ea6859 tempest-ComputeTenantNetworksTest-437746017 tempest-ComputeTenantNetworksTest-437746017-project] 10.222.0.26 "GET /compute/v2.1/os-tenant-networks/14ea6887-8f46-444b-99a0-f0eb83e16dc0" status: 200 len: 140 microversion: 2.1 time: 0.235749 Oct 08 21:14:24.986795 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2427/4912] 10.222.0.26 () {58 vars in 1269 bytes} [Sat Oct 8 21:14:24 2022] GET /compute/v2.1/os-tenant-networks/14ea6887-8f46-444b-99a0-f0eb83e16dc0 => generated 140 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:14:25.465622 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-1c5deb68-9a2d-4c52-b6f0-07488ded14b1 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:14:25.466317 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-1c5deb68-9a2d-4c52-b6f0-07488ded14b1 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] [instance: 4e33d129-543f-479f-86bf-4638cb153321] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:14:25.470188 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=2 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:14:25.509441 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1c5deb68-9a2d-4c52-b6f0-07488ded14b1 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:14:25.519673 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1c5deb68-9a2d-4c52-b6f0-07488ded14b1 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:14:25.520716 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1c5deb68-9a2d-4c52-b6f0-07488ded14b1 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:14:25.524665 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1c5deb68-9a2d-4c52-b6f0-07488ded14b1 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:14:25.525399 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1c5deb68-9a2d-4c52-b6f0-07488ded14b1 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:14:25.526003 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1c5deb68-9a2d-4c52-b6f0-07488ded14b1 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:14:25.595911 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:14:25.987409 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-1c5deb68-9a2d-4c52-b6f0-07488ded14b1 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de71b64a2e1c4b6aaa15b5ee75003add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994439815e0416180c95158033ae3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:14:25.999286 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-1c5deb68-9a2d-4c52-b6f0-07488ded14b1 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] 10.222.0.26 "GET /compute/v2.1/servers/4e33d129-543f-479f-86bf-4638cb153321" status: 200 len: 1317 microversion: 2.1 time: 0.542230 Oct 08 21:14:26.014793 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2486/4913] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:14:25 2022] GET /compute/v2.1/servers/4e33d129-543f-479f-86bf-4638cb153321 => generated 1317 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:14:27.038431 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-2fe4ba92-8900-4f46-85ca-c3cfd4030a54 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:14:27.039122 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-2fe4ba92-8900-4f46-85ca-c3cfd4030a54 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] [instance: 4e33d129-543f-479f-86bf-4638cb153321] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:14:27.056780 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2fe4ba92-8900-4f46-85ca-c3cfd4030a54 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:14:27.057362 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2fe4ba92-8900-4f46-85ca-c3cfd4030a54 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:14:27.059382 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2fe4ba92-8900-4f46-85ca-c3cfd4030a54 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:14:27.065316 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2fe4ba92-8900-4f46-85ca-c3cfd4030a54 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:14:27.066720 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2fe4ba92-8900-4f46-85ca-c3cfd4030a54 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:14:27.066896 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2fe4ba92-8900-4f46-85ca-c3cfd4030a54 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:14:27.705171 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-2fe4ba92-8900-4f46-85ca-c3cfd4030a54 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de71b64a2e1c4b6aaa15b5ee75003add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994439815e0416180c95158033ae3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:14:27.718670 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-2fe4ba92-8900-4f46-85ca-c3cfd4030a54 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] 10.222.0.26 "GET /compute/v2.1/servers/4e33d129-543f-479f-86bf-4638cb153321" status: 200 len: 1317 microversion: 2.1 time: 0.684981 Oct 08 21:14:27.722294 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2428/4914] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:14:27 2022] GET /compute/v2.1/servers/4e33d129-543f-479f-86bf-4638cb153321 => generated 1317 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:14:28.750372 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-b6a09a6c-d93e-4aef-ba79-b787784bc04b tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:14:28.751617 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-b6a09a6c-d93e-4aef-ba79-b787784bc04b tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] [instance: 4e33d129-543f-479f-86bf-4638cb153321] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:14:28.764540 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b6a09a6c-d93e-4aef-ba79-b787784bc04b tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:14:28.765524 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b6a09a6c-d93e-4aef-ba79-b787784bc04b tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:14:28.766323 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b6a09a6c-d93e-4aef-ba79-b787784bc04b tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:14:28.768931 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b6a09a6c-d93e-4aef-ba79-b787784bc04b tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:14:28.773363 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b6a09a6c-d93e-4aef-ba79-b787784bc04b tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:14:28.776343 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b6a09a6c-d93e-4aef-ba79-b787784bc04b tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:14:29.146101 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-54958234-6e02-447f-b48b-15e803b86bea req-5b89b469-caf1-42f0-9cda-b8226e97a534 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e33d129-543f-479f-86bf-4638cb153321", "name": "network-vif-plugged", "status": "completed", "tag": "778906c1-21bc-4637-97d7-0ea6988950f3"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:14:29.177527 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-54958234-6e02-447f-b48b-15e803b86bea req-5b89b469-caf1-42f0-9cda-b8226e97a534 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:14:29.178443 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-54958234-6e02-447f-b48b-15e803b86bea req-5b89b469-caf1-42f0-9cda-b8226e97a534 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:14:29.179606 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-54958234-6e02-447f-b48b-15e803b86bea req-5b89b469-caf1-42f0-9cda-b8226e97a534 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:14:29.213505 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-54958234-6e02-447f-b48b-15e803b86bea req-5b89b469-caf1-42f0-9cda-b8226e97a534 service nova] Creating event network-vif-plugged:778906c1-21bc-4637-97d7-0ea6988950f3 for instance 4e33d129-543f-479f-86bf-4638cb153321 on nch2-master-1 Oct 08 21:14:29.230921 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-54958234-6e02-447f-b48b-15e803b86bea req-5b89b469-caf1-42f0-9cda-b8226e97a534 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087621 Oct 08 21:14:29.232685 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2429/4915] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:14:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 08 21:14:29.860511 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-b6a09a6c-d93e-4aef-ba79-b787784bc04b tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de71b64a2e1c4b6aaa15b5ee75003add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994439815e0416180c95158033ae3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:14:29.876690 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-b6a09a6c-d93e-4aef-ba79-b787784bc04b tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] 10.222.0.26 "GET /compute/v2.1/servers/4e33d129-543f-479f-86bf-4638cb153321" status: 200 len: 1317 microversion: 2.1 time: 1.131712 Oct 08 21:14:29.877861 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2487/4916] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:14:28 2022] GET /compute/v2.1/servers/4e33d129-543f-479f-86bf-4638cb153321 => generated 1317 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:14:30.909644 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-3bc70f0c-f916-426b-8833-715c27f93335 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:14:30.911036 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-3bc70f0c-f916-426b-8833-715c27f93335 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] [instance: 4e33d129-543f-479f-86bf-4638cb153321] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:14:30.923320 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3bc70f0c-f916-426b-8833-715c27f93335 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:14:30.924340 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3bc70f0c-f916-426b-8833-715c27f93335 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:14:30.933969 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3bc70f0c-f916-426b-8833-715c27f93335 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:14:30.935118 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3bc70f0c-f916-426b-8833-715c27f93335 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:14:30.936120 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3bc70f0c-f916-426b-8833-715c27f93335 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:14:30.936825 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3bc70f0c-f916-426b-8833-715c27f93335 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:14:31.677062 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-3bc70f0c-f916-426b-8833-715c27f93335 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de71b64a2e1c4b6aaa15b5ee75003add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994439815e0416180c95158033ae3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:14:31.728413 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-3bc70f0c-f916-426b-8833-715c27f93335 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] 10.222.0.26 "GET /compute/v2.1/servers/4e33d129-543f-479f-86bf-4638cb153321" status: 200 len: 1317 microversion: 2.1 time: 0.825183 Oct 08 21:14:31.729921 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2430/4917] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:14:30 2022] GET /compute/v2.1/servers/4e33d129-543f-479f-86bf-4638cb153321 => generated 1317 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:14:32.753945 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-fadbfeca-cea5-44cd-9b2e-00c5f1a89a0e tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:14:32.759309 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-fadbfeca-cea5-44cd-9b2e-00c5f1a89a0e tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] [instance: 4e33d129-543f-479f-86bf-4638cb153321] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:14:32.792598 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fadbfeca-cea5-44cd-9b2e-00c5f1a89a0e tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:14:32.795686 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fadbfeca-cea5-44cd-9b2e-00c5f1a89a0e tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:14:32.799477 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fadbfeca-cea5-44cd-9b2e-00c5f1a89a0e tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:14:32.810195 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fadbfeca-cea5-44cd-9b2e-00c5f1a89a0e tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:14:32.813095 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fadbfeca-cea5-44cd-9b2e-00c5f1a89a0e tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:14:32.826506 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fadbfeca-cea5-44cd-9b2e-00c5f1a89a0e tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:14:33.318510 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-fadbfeca-cea5-44cd-9b2e-00c5f1a89a0e tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de71b64a2e1c4b6aaa15b5ee75003add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994439815e0416180c95158033ae3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:14:33.329829 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-fadbfeca-cea5-44cd-9b2e-00c5f1a89a0e tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] 10.222.0.26 "GET /compute/v2.1/servers/4e33d129-543f-479f-86bf-4638cb153321" status: 200 len: 1505 microversion: 2.1 time: 0.580461 Oct 08 21:14:33.332754 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2488/4918] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:14:32 2022] GET /compute/v2.1/servers/4e33d129-543f-479f-86bf-4638cb153321 => generated 1505 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:14:33.358280 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-f59deaa2-db9f-4dde-8284-0371ec1e2cf3 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:14:33.358959 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-f59deaa2-db9f-4dde-8284-0371ec1e2cf3 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] [instance: 4e33d129-543f-479f-86bf-4638cb153321] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:14:33.368522 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f59deaa2-db9f-4dde-8284-0371ec1e2cf3 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:14:33.369218 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f59deaa2-db9f-4dde-8284-0371ec1e2cf3 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:14:33.371445 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f59deaa2-db9f-4dde-8284-0371ec1e2cf3 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:14:33.372667 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f59deaa2-db9f-4dde-8284-0371ec1e2cf3 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:14:33.373548 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f59deaa2-db9f-4dde-8284-0371ec1e2cf3 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:14:33.374220 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f59deaa2-db9f-4dde-8284-0371ec1e2cf3 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:14:34.233098 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-fadbfeca-cea5-44cd-9b2e-00c5f1a89a0e tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:14:34.234325 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-f59deaa2-db9f-4dde-8284-0371ec1e2cf3 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de71b64a2e1c4b6aaa15b5ee75003add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994439815e0416180c95158033ae3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:14:34.234801 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-fadbfeca-cea5-44cd-9b2e-00c5f1a89a0e tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] 10.222.0.26 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002034 Oct 08 21:14:34.235929 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2489/4919] 10.222.0.26 () {56 vars in 886 bytes} [Sat Oct 8 21:14:34 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 08 21:14:34.243852 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-fadbfeca-cea5-44cd-9b2e-00c5f1a89a0e tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:14:34.245057 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-fadbfeca-cea5-44cd-9b2e-00c5f1a89a0e tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] 10.222.0.26 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.001701 Oct 08 21:14:34.245862 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2490/4920] 10.222.0.26 () {54 vars in 1035 bytes} [Sat Oct 8 21:14:34 2022] GET /compute/v2/ => generated 379 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 221 bytes (1 switches on core 0) Oct 08 21:14:34.250087 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-f59deaa2-db9f-4dde-8284-0371ec1e2cf3 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] 10.222.0.26 "GET /compute/v2.1/servers/4e33d129-543f-479f-86bf-4638cb153321" status: 200 len: 1505 microversion: 2.1 time: 0.896222 Oct 08 21:14:34.251070 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2431/4921] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:14:33 2022] GET /compute/v2.1/servers/4e33d129-543f-479f-86bf-4638cb153321 => generated 1505 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:14:34.266615 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-fadbfeca-cea5-44cd-9b2e-00c5f1a89a0e tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:14:34.268358 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-fadbfeca-cea5-44cd-9b2e-00c5f1a89a0e tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] 10.222.0.26 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002284 Oct 08 21:14:34.269270 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2491/4922] 10.222.0.26 () {54 vars in 1041 bytes} [Sat Oct 8 21:14:34 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:14:34.279855 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-fadbfeca-cea5-44cd-9b2e-00c5f1a89a0e tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:14:34.280848 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-fadbfeca-cea5-44cd-9b2e-00c5f1a89a0e tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] 10.222.0.26 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001389 Oct 08 21:14:34.281275 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2492/4923] 10.222.0.26 () {56 vars in 886 bytes} [Sat Oct 8 21:14:34 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 08 21:14:34.281523 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-f4ea650d-7182-4d96-9b0e-784eb51f417e tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:14:34.285217 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-f4ea650d-7182-4d96-9b0e-784eb51f417e tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] [instance: 4e33d129-543f-479f-86bf-4638cb153321] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:14:34.316694 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f4ea650d-7182-4d96-9b0e-784eb51f417e tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:14:34.318548 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f4ea650d-7182-4d96-9b0e-784eb51f417e tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:14:34.319410 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f4ea650d-7182-4d96-9b0e-784eb51f417e tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:14:34.320274 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f4ea650d-7182-4d96-9b0e-784eb51f417e tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:14:34.321281 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f4ea650d-7182-4d96-9b0e-784eb51f417e tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:14:34.323867 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f4ea650d-7182-4d96-9b0e-784eb51f417e tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:14:34.442998 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-f4ea650d-7182-4d96-9b0e-784eb51f417e tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] 10.222.0.26 "PUT /compute/v2.1/servers/4e33d129-543f-479f-86bf-4638cb153321" status: 200 len: 1077 microversion: 2.1 time: 0.166582 Oct 08 21:14:34.443979 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2432/4924] 10.222.0.26 () {60 vars in 1256 bytes} [Sat Oct 8 21:14:34 2022] PUT /compute/v2.1/servers/4e33d129-543f-479f-86bf-4638cb153321 => generated 1077 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:14:34.468370 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-99a47290-95bd-4273-b675-d62ccfb4f5f3 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:14:34.468999 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-99a47290-95bd-4273-b675-d62ccfb4f5f3 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] [instance: 4e33d129-543f-479f-86bf-4638cb153321] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:14:34.483642 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-99a47290-95bd-4273-b675-d62ccfb4f5f3 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:14:34.499819 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-99a47290-95bd-4273-b675-d62ccfb4f5f3 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:14:34.500410 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-99a47290-95bd-4273-b675-d62ccfb4f5f3 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:14:34.506019 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-99a47290-95bd-4273-b675-d62ccfb4f5f3 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:14:34.506595 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-99a47290-95bd-4273-b675-d62ccfb4f5f3 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:14:34.507111 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-99a47290-95bd-4273-b675-d62ccfb4f5f3 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:14:35.198504 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-99a47290-95bd-4273-b675-d62ccfb4f5f3 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de71b64a2e1c4b6aaa15b5ee75003add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994439815e0416180c95158033ae3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:14:35.210419 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-99a47290-95bd-4273-b675-d62ccfb4f5f3 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] 10.222.0.26 "GET /compute/v2.1/servers/4e33d129-543f-479f-86bf-4638cb153321" status: 200 len: 1503 microversion: 2.1 time: 0.751775 Oct 08 21:14:35.211362 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2493/4925] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:14:34 2022] GET /compute/v2.1/servers/4e33d129-543f-479f-86bf-4638cb153321 => generated 1503 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:14:35.233719 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-abc41880-ef9f-49d1-a637-b88c1341e76a tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:14:35.234762 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-abc41880-ef9f-49d1-a637-b88c1341e76a tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] [instance: 4e33d129-543f-479f-86bf-4638cb153321] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:14:35.241775 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-abc41880-ef9f-49d1-a637-b88c1341e76a tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:14:35.242672 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-abc41880-ef9f-49d1-a637-b88c1341e76a tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:14:35.243399 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-abc41880-ef9f-49d1-a637-b88c1341e76a tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:14:35.244394 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-abc41880-ef9f-49d1-a637-b88c1341e76a tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:14:35.245119 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-abc41880-ef9f-49d1-a637-b88c1341e76a tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:14:35.245816 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-abc41880-ef9f-49d1-a637-b88c1341e76a tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:14:36.067929 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-abc41880-ef9f-49d1-a637-b88c1341e76a tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de71b64a2e1c4b6aaa15b5ee75003add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994439815e0416180c95158033ae3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:14:36.070429 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=1 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:14:36.078045 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-abc41880-ef9f-49d1-a637-b88c1341e76a tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] 10.222.0.26 "GET /compute/v2.1/servers/4e33d129-543f-479f-86bf-4638cb153321" status: 200 len: 1503 microversion: 2.1 time: 0.848906 Oct 08 21:14:36.081955 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2433/4926] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:14:35 2022] GET /compute/v2.1/servers/4e33d129-543f-479f-86bf-4638cb153321 => generated 1503 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:14:36.106597 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-6332736e-275a-4ae9-ba6f-fc4bd3e6d042 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:14:36.110515 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-6332736e-275a-4ae9-ba6f-fc4bd3e6d042 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] [instance: 4e33d129-543f-479f-86bf-4638cb153321] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:14:36.122699 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6332736e-275a-4ae9-ba6f-fc4bd3e6d042 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:14:36.130492 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6332736e-275a-4ae9-ba6f-fc4bd3e6d042 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:14:36.131150 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6332736e-275a-4ae9-ba6f-fc4bd3e6d042 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:14:36.132085 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6332736e-275a-4ae9-ba6f-fc4bd3e6d042 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:14:36.132710 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6332736e-275a-4ae9-ba6f-fc4bd3e6d042 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:14:36.136475 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6332736e-275a-4ae9-ba6f-fc4bd3e6d042 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:14:36.292956 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-6332736e-275a-4ae9-ba6f-fc4bd3e6d042 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Flavor limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 21:14:36.294992 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-6332736e-275a-4ae9-ba6f-fc4bd3e6d042 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Image limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 21:14:36.296879 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-6332736e-275a-4ae9-ba6f-fc4bd3e6d042 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Flavor pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 21:14:36.297561 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-6332736e-275a-4ae9-ba6f-fc4bd3e6d042 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Image pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 21:14:36.298168 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-6332736e-275a-4ae9-ba6f-fc4bd3e6d042 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 21:14:36.431548 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-6332736e-275a-4ae9-ba6f-fc4bd3e6d042 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] [instance: 4e33d129-543f-479f-86bf-4638cb153321] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:14:36.450059 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6332736e-275a-4ae9-ba6f-fc4bd3e6d042 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:14:36.450573 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6332736e-275a-4ae9-ba6f-fc4bd3e6d042 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:14:36.451027 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6332736e-275a-4ae9-ba6f-fc4bd3e6d042 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:14:36.451863 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6332736e-275a-4ae9-ba6f-fc4bd3e6d042 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:14:36.452385 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6332736e-275a-4ae9-ba6f-fc4bd3e6d042 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:14:36.452832 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6332736e-275a-4ae9-ba6f-fc4bd3e6d042 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:14:36.528947 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-6332736e-275a-4ae9-ba6f-fc4bd3e6d042 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] 10.222.0.26 "POST /compute/v2.1/servers/4e33d129-543f-479f-86bf-4638cb153321/action" status: 202 len: 1109 microversion: 2.1 time: 0.421574 Oct 08 21:14:36.549071 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-aa57ac95-dfb7-4b10-ac98-f32f396ff4dd tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:14:36.549995 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-aa57ac95-dfb7-4b10-ac98-f32f396ff4dd tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] [instance: 4e33d129-543f-479f-86bf-4638cb153321] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:14:36.557413 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2494/4927] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:14:36 2022] POST /compute/v2.1/servers/4e33d129-543f-479f-86bf-4638cb153321/action => generated 1109 bytes in 456 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 08 21:14:36.570971 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-aa57ac95-dfb7-4b10-ac98-f32f396ff4dd tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:14:36.571700 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-aa57ac95-dfb7-4b10-ac98-f32f396ff4dd tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:14:36.572339 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-aa57ac95-dfb7-4b10-ac98-f32f396ff4dd tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:14:36.573267 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-aa57ac95-dfb7-4b10-ac98-f32f396ff4dd tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:14:36.573902 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-aa57ac95-dfb7-4b10-ac98-f32f396ff4dd tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:14:36.574509 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-aa57ac95-dfb7-4b10-ac98-f32f396ff4dd tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:14:37.777052 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-aa57ac95-dfb7-4b10-ac98-f32f396ff4dd tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de71b64a2e1c4b6aaa15b5ee75003add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994439815e0416180c95158033ae3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:14:37.786952 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-aa57ac95-dfb7-4b10-ac98-f32f396ff4dd tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] 10.222.0.26 "GET /compute/v2.1/servers/4e33d129-543f-479f-86bf-4638cb153321" status: 200 len: 1514 microversion: 2.1 time: 1.242369 Oct 08 21:14:37.787551 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2434/4928] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:14:36 2022] GET /compute/v2.1/servers/4e33d129-543f-479f-86bf-4638cb153321 => generated 1514 bytes in 1244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:14:38.810152 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-729b3b80-bb1c-466f-ad24-413b80633589 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:14:38.810785 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-729b3b80-bb1c-466f-ad24-413b80633589 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] [instance: 4e33d129-543f-479f-86bf-4638cb153321] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:14:38.818955 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-729b3b80-bb1c-466f-ad24-413b80633589 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:14:38.819456 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-729b3b80-bb1c-466f-ad24-413b80633589 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:14:38.830654 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-729b3b80-bb1c-466f-ad24-413b80633589 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:14:38.833317 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-729b3b80-bb1c-466f-ad24-413b80633589 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:14:38.837263 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-729b3b80-bb1c-466f-ad24-413b80633589 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:14:38.841177 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-729b3b80-bb1c-466f-ad24-413b80633589 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:14:39.748354 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-729b3b80-bb1c-466f-ad24-413b80633589 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de71b64a2e1c4b6aaa15b5ee75003add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994439815e0416180c95158033ae3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:14:39.761000 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-729b3b80-bb1c-466f-ad24-413b80633589 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] 10.222.0.26 "GET /compute/v2.1/servers/4e33d129-543f-479f-86bf-4638cb153321" status: 200 len: 1514 microversion: 2.1 time: 0.954900 Oct 08 21:14:39.777716 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2495/4929] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:14:38 2022] GET /compute/v2.1/servers/4e33d129-543f-479f-86bf-4638cb153321 => generated 1514 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:14:40.791543 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-50eb34c1-262b-47df-9b72-306e92e87fbd tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:14:40.791543 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-50eb34c1-262b-47df-9b72-306e92e87fbd tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] [instance: 4e33d129-543f-479f-86bf-4638cb153321] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:14:40.808838 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-50eb34c1-262b-47df-9b72-306e92e87fbd tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:14:40.809376 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-50eb34c1-262b-47df-9b72-306e92e87fbd tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:14:40.809835 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-50eb34c1-262b-47df-9b72-306e92e87fbd tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:14:40.810568 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-50eb34c1-262b-47df-9b72-306e92e87fbd tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:14:40.811179 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-50eb34c1-262b-47df-9b72-306e92e87fbd tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:14:40.811455 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-50eb34c1-262b-47df-9b72-306e92e87fbd tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:14:41.532201 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-50eb34c1-262b-47df-9b72-306e92e87fbd tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de71b64a2e1c4b6aaa15b5ee75003add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994439815e0416180c95158033ae3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:14:41.544928 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-50eb34c1-262b-47df-9b72-306e92e87fbd tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] 10.222.0.26 "GET /compute/v2.1/servers/4e33d129-543f-479f-86bf-4638cb153321" status: 200 len: 1514 microversion: 2.1 time: 0.758827 Oct 08 21:14:41.545558 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2435/4930] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:14:40 2022] GET /compute/v2.1/servers/4e33d129-543f-479f-86bf-4638cb153321 => generated 1514 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:14:42.577910 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-34a30eb8-6a62-4d2c-8a69-a852e372c3ae tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:14:42.580100 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-34a30eb8-6a62-4d2c-8a69-a852e372c3ae tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] [instance: 4e33d129-543f-479f-86bf-4638cb153321] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:14:42.594623 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-34a30eb8-6a62-4d2c-8a69-a852e372c3ae tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:14:42.599234 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-34a30eb8-6a62-4d2c-8a69-a852e372c3ae tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:14:42.599896 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-34a30eb8-6a62-4d2c-8a69-a852e372c3ae tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:14:42.601095 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-34a30eb8-6a62-4d2c-8a69-a852e372c3ae tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:14:42.603159 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-34a30eb8-6a62-4d2c-8a69-a852e372c3ae tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:14:42.604227 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-34a30eb8-6a62-4d2c-8a69-a852e372c3ae tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:14:42.946895 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-34a30eb8-6a62-4d2c-8a69-a852e372c3ae tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de71b64a2e1c4b6aaa15b5ee75003add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994439815e0416180c95158033ae3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:14:42.957700 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-34a30eb8-6a62-4d2c-8a69-a852e372c3ae tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] 10.222.0.26 "GET /compute/v2.1/servers/4e33d129-543f-479f-86bf-4638cb153321" status: 200 len: 1514 microversion: 2.1 time: 0.387798 Oct 08 21:14:42.959030 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2496/4931] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:14:42 2022] GET /compute/v2.1/servers/4e33d129-543f-479f-86bf-4638cb153321 => generated 1514 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:14:43.985734 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-f5688cf3-11c1-4080-9cc4-eccfc1c1df7c tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:14:43.987606 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-f5688cf3-11c1-4080-9cc4-eccfc1c1df7c tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] [instance: 4e33d129-543f-479f-86bf-4638cb153321] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:14:44.001147 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f5688cf3-11c1-4080-9cc4-eccfc1c1df7c tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:14:44.003809 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f5688cf3-11c1-4080-9cc4-eccfc1c1df7c tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:14:44.015555 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f5688cf3-11c1-4080-9cc4-eccfc1c1df7c tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:14:44.016881 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f5688cf3-11c1-4080-9cc4-eccfc1c1df7c tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:14:44.017599 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f5688cf3-11c1-4080-9cc4-eccfc1c1df7c tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:14:44.018206 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f5688cf3-11c1-4080-9cc4-eccfc1c1df7c tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:14:44.574893 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-f5688cf3-11c1-4080-9cc4-eccfc1c1df7c tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de71b64a2e1c4b6aaa15b5ee75003add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994439815e0416180c95158033ae3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:14:44.592857 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-f5688cf3-11c1-4080-9cc4-eccfc1c1df7c tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] 10.222.0.26 "GET /compute/v2.1/servers/4e33d129-543f-479f-86bf-4638cb153321" status: 200 len: 1514 microversion: 2.1 time: 0.610540 Oct 08 21:14:44.594853 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2436/4932] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:14:43 2022] GET /compute/v2.1/servers/4e33d129-543f-479f-86bf-4638cb153321 => generated 1514 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:14:45.619061 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-a1f3e114-ad31-48b1-980f-54131b6a9ef6 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:14:45.626066 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-a1f3e114-ad31-48b1-980f-54131b6a9ef6 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] [instance: 4e33d129-543f-479f-86bf-4638cb153321] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:14:45.634060 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a1f3e114-ad31-48b1-980f-54131b6a9ef6 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:14:45.646936 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a1f3e114-ad31-48b1-980f-54131b6a9ef6 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:14:45.647915 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a1f3e114-ad31-48b1-980f-54131b6a9ef6 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:14:45.650394 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a1f3e114-ad31-48b1-980f-54131b6a9ef6 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:14:45.651980 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a1f3e114-ad31-48b1-980f-54131b6a9ef6 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:14:45.657162 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a1f3e114-ad31-48b1-980f-54131b6a9ef6 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:14:46.027889 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-e8d8a701-069e-44f6-9017-4bf8d60c58a0 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Action: 'create', calling method: .version_select at 0x7f1a877c3790>, body: {"keypair": {"name": "tempest-keypair-88701933", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKj491Kq9c1rkvuamAdw5FN2CIKvU+6h+LehFORMq3hOLryrFvaj5Kt2S6YDwqJ8SHK8s+G0DbOOPgLZWDOMEcsHVg1nerkeyXumN/8ezh8Y5j99SCufJjL74jMCCMNzWg=="}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:14:46.083398 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-e8d8a701-069e-44f6-9017-4bf8d60c58a0 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Getting quotas for project 3d9d29b90ab34abbadd21edbca637d2e. Resources: {'key_pairs'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:14:46.098467 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-e8d8a701-069e-44f6-9017-4bf8d60c58a0 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Getting quotas for user 8957041987c8487099f0d89f4c64af66 and project 3d9d29b90ab34abbadd21edbca637d2e. Resources: {'key_pairs'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:14:46.161812 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-e8d8a701-069e-44f6-9017-4bf8d60c58a0 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.379265 Oct 08 21:14:46.163116 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2437/4933] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Oct 8 21:14:45 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 08 21:14:46.597880 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-a1f3e114-ad31-48b1-980f-54131b6a9ef6 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de71b64a2e1c4b6aaa15b5ee75003add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994439815e0416180c95158033ae3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:14:46.616375 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-a1f3e114-ad31-48b1-980f-54131b6a9ef6 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] 10.222.0.26 "GET /compute/v2.1/servers/4e33d129-543f-479f-86bf-4638cb153321" status: 200 len: 1514 microversion: 2.1 time: 1.001199 Oct 08 21:14:46.621035 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2497/4934] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:14:45 2022] GET /compute/v2.1/servers/4e33d129-543f-479f-86bf-4638cb153321 => generated 1514 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:14:47.648760 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-6f191064-3ded-4939-85b2-431e8e54c6c4 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:14:47.650715 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-6f191064-3ded-4939-85b2-431e8e54c6c4 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] [instance: 4e33d129-543f-479f-86bf-4638cb153321] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:14:47.679012 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6f191064-3ded-4939-85b2-431e8e54c6c4 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:14:47.680773 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6f191064-3ded-4939-85b2-431e8e54c6c4 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:14:47.681304 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6f191064-3ded-4939-85b2-431e8e54c6c4 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:14:47.682097 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6f191064-3ded-4939-85b2-431e8e54c6c4 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:14:47.692915 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6f191064-3ded-4939-85b2-431e8e54c6c4 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:14:47.693459 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6f191064-3ded-4939-85b2-431e8e54c6c4 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:14:48.891829 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-6f191064-3ded-4939-85b2-431e8e54c6c4 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de71b64a2e1c4b6aaa15b5ee75003add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994439815e0416180c95158033ae3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:14:48.901564 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-6f191064-3ded-4939-85b2-431e8e54c6c4 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] 10.222.0.26 "GET /compute/v2.1/servers/4e33d129-543f-479f-86bf-4638cb153321" status: 200 len: 1514 microversion: 2.1 time: 1.260180 Oct 08 21:14:48.908273 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2438/4935] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:14:47 2022] GET /compute/v2.1/servers/4e33d129-543f-479f-86bf-4638cb153321 => generated 1514 bytes in 1267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:14:49.929847 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-92329004-1c5a-4500-a520-69427809a982 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:14:49.931624 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-92329004-1c5a-4500-a520-69427809a982 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] [instance: 4e33d129-543f-479f-86bf-4638cb153321] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:14:49.974920 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-92329004-1c5a-4500-a520-69427809a982 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:14:49.978711 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-92329004-1c5a-4500-a520-69427809a982 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:14:49.979286 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-92329004-1c5a-4500-a520-69427809a982 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:14:49.984942 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-92329004-1c5a-4500-a520-69427809a982 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:14:49.988755 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-92329004-1c5a-4500-a520-69427809a982 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:14:49.989531 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-92329004-1c5a-4500-a520-69427809a982 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:14:50.858915 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-92329004-1c5a-4500-a520-69427809a982 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de71b64a2e1c4b6aaa15b5ee75003add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994439815e0416180c95158033ae3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:14:50.873006 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-92329004-1c5a-4500-a520-69427809a982 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] 10.222.0.26 "GET /compute/v2.1/servers/4e33d129-543f-479f-86bf-4638cb153321" status: 200 len: 1514 microversion: 2.1 time: 0.950584 Oct 08 21:14:50.875072 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2498/4936] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:14:49 2022] GET /compute/v2.1/servers/4e33d129-543f-479f-86bf-4638cb153321 => generated 1514 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:14:51.351514 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-04bcb930-dab3-4b73-b495-89635d795df3 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1356795086", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3bac7a36-9cfd-41c8-b181-a7db0bd13b90"}], "security_groups": [{"name": "tempest-securitygroup--2094085830"}], "key_name": "tempest-keypair-88701933", "user_data": "}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:14:51.386162 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:14:51.900606 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-b2ab462b-e373-45dc-9a4b-d0c11a8b3828 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:14:51.901441 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-b2ab462b-e373-45dc-9a4b-d0c11a8b3828 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] [instance: 4e33d129-543f-479f-86bf-4638cb153321] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:14:51.915764 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b2ab462b-e373-45dc-9a4b-d0c11a8b3828 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:14:51.916597 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b2ab462b-e373-45dc-9a4b-d0c11a8b3828 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:14:51.917265 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b2ab462b-e373-45dc-9a4b-d0c11a8b3828 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:14:51.919607 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b2ab462b-e373-45dc-9a4b-d0c11a8b3828 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:14:51.920322 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b2ab462b-e373-45dc-9a4b-d0c11a8b3828 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:14:51.923943 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b2ab462b-e373-45dc-9a4b-d0c11a8b3828 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:14:51.935740 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.network.neutron [None req-04bcb930-dab3-4b73-b495-89635d795df3 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] validate_networks() for [('3bac7a36-9cfd-41c8-b181-a7db0bd13b90', None, None, None, None, None)] {{(pid=140491) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 21:14:52.586904 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-b2ab462b-e373-45dc-9a4b-d0c11a8b3828 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de71b64a2e1c4b6aaa15b5ee75003add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994439815e0416180c95158033ae3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:14:52.605036 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-b2ab462b-e373-45dc-9a4b-d0c11a8b3828 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] 10.222.0.26 "GET /compute/v2.1/servers/4e33d129-543f-479f-86bf-4638cb153321" status: 200 len: 1514 microversion: 2.1 time: 0.708445 Oct 08 21:14:52.605677 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2499/4937] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:14:51 2022] GET /compute/v2.1/servers/4e33d129-543f-479f-86bf-4638cb153321 => generated 1514 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:14:53.635913 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-149e01e0-2648-4f0d-bce6-6e71e3ced2b4 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:14:53.637041 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-149e01e0-2648-4f0d-bce6-6e71e3ced2b4 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] [instance: 4e33d129-543f-479f-86bf-4638cb153321] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:14:53.651928 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-149e01e0-2648-4f0d-bce6-6e71e3ced2b4 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:14:53.665019 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-149e01e0-2648-4f0d-bce6-6e71e3ced2b4 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:14:53.667437 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-149e01e0-2648-4f0d-bce6-6e71e3ced2b4 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:14:53.673970 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-149e01e0-2648-4f0d-bce6-6e71e3ced2b4 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:14:53.679635 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-149e01e0-2648-4f0d-bce6-6e71e3ced2b4 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:14:53.680303 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-149e01e0-2648-4f0d-bce6-6e71e3ced2b4 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:14:54.327210 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-04bcb930-dab3-4b73-b495-89635d795df3 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Flavor limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 21:14:54.327793 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-04bcb930-dab3-4b73-b495-89635d795df3 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Image limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 21:14:54.328116 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-04bcb930-dab3-4b73-b495-89635d795df3 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Flavor pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 21:14:54.328536 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-04bcb930-dab3-4b73-b495-89635d795df3 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Image pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 21:14:54.328959 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-04bcb930-dab3-4b73-b495-89635d795df3 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 21:14:54.336818 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-149e01e0-2648-4f0d-bce6-6e71e3ced2b4 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de71b64a2e1c4b6aaa15b5ee75003add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994439815e0416180c95158033ae3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:14:54.348027 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-04bcb930-dab3-4b73-b495-89635d795df3 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:14:54.349116 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-04bcb930-dab3-4b73-b495-89635d795df3 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:14:54.349862 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-04bcb930-dab3-4b73-b495-89635d795df3 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:14:54.351055 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-149e01e0-2648-4f0d-bce6-6e71e3ced2b4 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] 10.222.0.26 "GET /compute/v2.1/servers/4e33d129-543f-479f-86bf-4638cb153321" status: 200 len: 1520 microversion: 2.1 time: 0.716016 Oct 08 21:14:54.351665 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-04bcb930-dab3-4b73-b495-89635d795df3 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:14:54.351809 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2500/4938] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:14:53 2022] GET /compute/v2.1/servers/4e33d129-543f-479f-86bf-4638cb153321 => generated 1520 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:14:54.353087 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-04bcb930-dab3-4b73-b495-89635d795df3 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:14:54.355361 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-04bcb930-dab3-4b73-b495-89635d795df3 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:14:54.402269 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-04bcb930-dab3-4b73-b495-89635d795df3 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Getting quotas for project 3d9d29b90ab34abbadd21edbca637d2e. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:14:54.411458 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-04bcb930-dab3-4b73-b495-89635d795df3 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Getting quotas for user 8957041987c8487099f0d89f4c64af66 and project 3d9d29b90ab34abbadd21edbca637d2e. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:14:54.456635 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-04bcb930-dab3-4b73-b495-89635d795df3 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Going to run 1 instances... {{(pid=140491) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 21:14:54.459813 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-04bcb930-dab3-4b73-b495-89635d795df3 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] [instance: aadddbb1-e053-420e-afd2-9412c6137504] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c508bd7f-7db9-4b2c-af7c-be54a855c355',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140491) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 21:14:54.568643 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-04bcb930-dab3-4b73-b495-89635d795df3 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.224714 Oct 08 21:14:54.570019 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2439/4939] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 21:14:51 2022] POST /compute/v2.1/servers => generated 402 bytes in 3227 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 08 21:14:54.581487 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-0f118946-2c7e-49b9-aba3-7e8044177acc tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:14:54.582172 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-0f118946-2c7e-49b9-aba3-7e8044177acc tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] [instance: aadddbb1-e053-420e-afd2-9412c6137504] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:14:54.707329 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-0f118946-2c7e-49b9-aba3-7e8044177acc tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8957041987c8487099f0d89f4c64af66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9d29b90ab34abbadd21edbca637d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:14:54.729826 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-0f118946-2c7e-49b9-aba3-7e8044177acc tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] 10.222.0.26 "GET /compute/v2.1/servers/aadddbb1-e053-420e-afd2-9412c6137504" status: 200 len: 1240 microversion: 2.1 time: 0.151479 Oct 08 21:14:54.730469 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2501/4940] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:14:54 2022] GET /compute/v2.1/servers/aadddbb1-e053-420e-afd2-9412c6137504 => generated 1240 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:14:55.380921 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-36a859ec-c583-4019-8e01-705a9542edf7 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:14:55.382437 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-36a859ec-c583-4019-8e01-705a9542edf7 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] [instance: 4e33d129-543f-479f-86bf-4638cb153321] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:14:55.395483 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-36a859ec-c583-4019-8e01-705a9542edf7 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:14:55.395999 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-36a859ec-c583-4019-8e01-705a9542edf7 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:14:55.397019 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-36a859ec-c583-4019-8e01-705a9542edf7 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:14:55.397796 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-36a859ec-c583-4019-8e01-705a9542edf7 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:14:55.398969 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-36a859ec-c583-4019-8e01-705a9542edf7 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:14:55.400798 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-36a859ec-c583-4019-8e01-705a9542edf7 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:14:55.754375 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-822ae4b1-260d-4c99-86fd-025306870bc3 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:14:55.755028 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-822ae4b1-260d-4c99-86fd-025306870bc3 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] [instance: aadddbb1-e053-420e-afd2-9412c6137504] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:14:55.757820 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=30 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:14:55.764467 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-822ae4b1-260d-4c99-86fd-025306870bc3 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:14:55.765244 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-822ae4b1-260d-4c99-86fd-025306870bc3 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:14:55.766425 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-822ae4b1-260d-4c99-86fd-025306870bc3 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:14:55.767464 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-822ae4b1-260d-4c99-86fd-025306870bc3 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:14:55.768163 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-822ae4b1-260d-4c99-86fd-025306870bc3 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:14:55.768828 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-822ae4b1-260d-4c99-86fd-025306870bc3 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:14:55.818985 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:14:55.914184 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-36a859ec-c583-4019-8e01-705a9542edf7 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de71b64a2e1c4b6aaa15b5ee75003add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994439815e0416180c95158033ae3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:14:55.924476 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-36a859ec-c583-4019-8e01-705a9542edf7 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] 10.222.0.26 "GET /compute/v2.1/servers/4e33d129-543f-479f-86bf-4638cb153321" status: 200 len: 1520 microversion: 2.1 time: 0.549392 Oct 08 21:14:55.928206 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2440/4941] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:14:55 2022] GET /compute/v2.1/servers/4e33d129-543f-479f-86bf-4638cb153321 => generated 1520 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:14:55.999327 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-822ae4b1-260d-4c99-86fd-025306870bc3 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8957041987c8487099f0d89f4c64af66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9d29b90ab34abbadd21edbca637d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:14:56.015881 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-822ae4b1-260d-4c99-86fd-025306870bc3 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] 10.222.0.26 "GET /compute/v2.1/servers/aadddbb1-e053-420e-afd2-9412c6137504" status: 200 len: 1292 microversion: 2.1 time: 0.263948 Oct 08 21:14:56.018305 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2502/4942] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:14:55 2022] GET /compute/v2.1/servers/aadddbb1-e053-420e-afd2-9412c6137504 => generated 1292 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:14:56.951587 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-6283c320-2a5b-4511-a6c9-78c41f3c72eb tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:14:56.952199 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-6283c320-2a5b-4511-a6c9-78c41f3c72eb tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] [instance: 4e33d129-543f-479f-86bf-4638cb153321] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:14:56.964068 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6283c320-2a5b-4511-a6c9-78c41f3c72eb tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:14:56.967212 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6283c320-2a5b-4511-a6c9-78c41f3c72eb tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:14:56.972651 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6283c320-2a5b-4511-a6c9-78c41f3c72eb tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:14:56.973698 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6283c320-2a5b-4511-a6c9-78c41f3c72eb tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:14:56.974394 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6283c320-2a5b-4511-a6c9-78c41f3c72eb tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:14:56.975068 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6283c320-2a5b-4511-a6c9-78c41f3c72eb tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:14:57.044720 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-a5eef291-05b8-44bd-ae6f-37bb03870562 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:14:57.045422 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-a5eef291-05b8-44bd-ae6f-37bb03870562 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] [instance: aadddbb1-e053-420e-afd2-9412c6137504] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:14:57.058288 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a5eef291-05b8-44bd-ae6f-37bb03870562 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:14:57.058799 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a5eef291-05b8-44bd-ae6f-37bb03870562 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:14:57.059253 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a5eef291-05b8-44bd-ae6f-37bb03870562 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:14:57.059980 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a5eef291-05b8-44bd-ae6f-37bb03870562 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:14:57.067668 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a5eef291-05b8-44bd-ae6f-37bb03870562 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:14:57.068400 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a5eef291-05b8-44bd-ae6f-37bb03870562 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:14:57.158005 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-a5eef291-05b8-44bd-ae6f-37bb03870562 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8957041987c8487099f0d89f4c64af66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9d29b90ab34abbadd21edbca637d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:14:57.170736 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-a5eef291-05b8-44bd-ae6f-37bb03870562 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] 10.222.0.26 "GET /compute/v2.1/servers/aadddbb1-e053-420e-afd2-9412c6137504" status: 200 len: 1298 microversion: 2.1 time: 0.131654 Oct 08 21:14:57.171949 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2503/4943] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:14:57 2022] GET /compute/v2.1/servers/aadddbb1-e053-420e-afd2-9412c6137504 => generated 1298 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:14:57.976479 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-6283c320-2a5b-4511-a6c9-78c41f3c72eb tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de71b64a2e1c4b6aaa15b5ee75003add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994439815e0416180c95158033ae3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:14:58.006496 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-6283c320-2a5b-4511-a6c9-78c41f3c72eb tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] 10.222.0.26 "GET /compute/v2.1/servers/4e33d129-543f-479f-86bf-4638cb153321" status: 200 len: 1520 microversion: 2.1 time: 1.053066 Oct 08 21:14:58.020236 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2441/4944] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:14:56 2022] GET /compute/v2.1/servers/4e33d129-543f-479f-86bf-4638cb153321 => generated 1520 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:14:58.172274 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-92b5c7d8-f3dd-4b9f-89ea-7fdbc0ef9d3d req-2306569a-689b-459d-be71-bee0bfa76955 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e33d129-543f-479f-86bf-4638cb153321", "name": "network-vif-unplugged", "status": "completed", "tag": "778906c1-21bc-4637-97d7-0ea6988950f3"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:14:58.185385 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-92b5c7d8-f3dd-4b9f-89ea-7fdbc0ef9d3d req-2306569a-689b-459d-be71-bee0bfa76955 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:14:58.186232 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-92b5c7d8-f3dd-4b9f-89ea-7fdbc0ef9d3d req-2306569a-689b-459d-be71-bee0bfa76955 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:14:58.186895 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-92b5c7d8-f3dd-4b9f-89ea-7fdbc0ef9d3d req-2306569a-689b-459d-be71-bee0bfa76955 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:14:58.195599 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-1935db8e-5038-4519-a61e-98cbcf82206d tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:14:58.196559 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-1935db8e-5038-4519-a61e-98cbcf82206d tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] [instance: aadddbb1-e053-420e-afd2-9412c6137504] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:14:58.207622 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-92b5c7d8-f3dd-4b9f-89ea-7fdbc0ef9d3d req-2306569a-689b-459d-be71-bee0bfa76955 service nova] Creating event network-vif-unplugged:778906c1-21bc-4637-97d7-0ea6988950f3 for instance 4e33d129-543f-479f-86bf-4638cb153321 on nch2-master-1 Oct 08 21:14:58.209939 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1935db8e-5038-4519-a61e-98cbcf82206d tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:14:58.212200 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1935db8e-5038-4519-a61e-98cbcf82206d tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:14:58.213444 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1935db8e-5038-4519-a61e-98cbcf82206d tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:14:58.217047 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1935db8e-5038-4519-a61e-98cbcf82206d tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:14:58.219868 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1935db8e-5038-4519-a61e-98cbcf82206d tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:14:58.221982 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1935db8e-5038-4519-a61e-98cbcf82206d tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:14:58.223103 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-92b5c7d8-f3dd-4b9f-89ea-7fdbc0ef9d3d req-2306569a-689b-459d-be71-bee0bfa76955 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.054140 Oct 08 21:14:58.226339 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2504/4945] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:14:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:14:58.929877 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-66b1649b-a9c7-4aed-9981-c5af99824a14 req-adae6942-cbcb-49d8-ac43-9c203b2ed3e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aadddbb1-e053-420e-afd2-9412c6137504", "tag": "e0674cb1-a68b-451f-b3bb-a6e7770eb93e"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:14:58.944075 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-1935db8e-5038-4519-a61e-98cbcf82206d tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8957041987c8487099f0d89f4c64af66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9d29b90ab34abbadd21edbca637d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:14:58.949307 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-66b1649b-a9c7-4aed-9981-c5af99824a14 req-adae6942-cbcb-49d8-ac43-9c203b2ed3e5 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:14:58.950671 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-66b1649b-a9c7-4aed-9981-c5af99824a14 req-adae6942-cbcb-49d8-ac43-9c203b2ed3e5 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:14:58.951356 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-66b1649b-a9c7-4aed-9981-c5af99824a14 req-adae6942-cbcb-49d8-ac43-9c203b2ed3e5 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:14:58.965731 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-1935db8e-5038-4519-a61e-98cbcf82206d tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] 10.222.0.26 "GET /compute/v2.1/servers/aadddbb1-e053-420e-afd2-9412c6137504" status: 200 len: 1366 microversion: 2.1 time: 0.773059 Oct 08 21:14:58.973034 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-66b1649b-a9c7-4aed-9981-c5af99824a14 req-adae6942-cbcb-49d8-ac43-9c203b2ed3e5 service nova] Creating event network-changed:e0674cb1-a68b-451f-b3bb-a6e7770eb93e for instance aadddbb1-e053-420e-afd2-9412c6137504 on nch1-master-1 Oct 08 21:14:58.977859 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2442/4946] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:14:58 2022] GET /compute/v2.1/servers/aadddbb1-e053-420e-afd2-9412c6137504 => generated 1366 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:14:58.984595 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-66b1649b-a9c7-4aed-9981-c5af99824a14 req-adae6942-cbcb-49d8-ac43-9c203b2ed3e5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064789 Oct 08 21:14:58.986979 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2505/4947] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:14:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:14:59.045512 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-70dd7651-aecf-4080-a467-a88f957f93cf tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:14:59.046388 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-70dd7651-aecf-4080-a467-a88f957f93cf tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] [instance: 4e33d129-543f-479f-86bf-4638cb153321] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:14:59.058471 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-70dd7651-aecf-4080-a467-a88f957f93cf tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:14:59.059327 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-70dd7651-aecf-4080-a467-a88f957f93cf tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:14:59.060405 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-70dd7651-aecf-4080-a467-a88f957f93cf tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:14:59.061507 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-70dd7651-aecf-4080-a467-a88f957f93cf tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:14:59.062549 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-70dd7651-aecf-4080-a467-a88f957f93cf tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:14:59.063212 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-70dd7651-aecf-4080-a467-a88f957f93cf tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:14:59.713641 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-70dd7651-aecf-4080-a467-a88f957f93cf tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de71b64a2e1c4b6aaa15b5ee75003add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994439815e0416180c95158033ae3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:14:59.725130 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-70dd7651-aecf-4080-a467-a88f957f93cf tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] 10.222.0.26 "GET /compute/v2.1/servers/4e33d129-543f-479f-86bf-4638cb153321" status: 200 len: 1520 microversion: 2.1 time: 0.685333 Oct 08 21:14:59.726007 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2443/4948] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:14:59 2022] GET /compute/v2.1/servers/4e33d129-543f-479f-86bf-4638cb153321 => generated 1520 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:14:59.993819 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-41fd9d74-dd5a-4487-96c0-818ba422266a tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:14:59.994631 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-41fd9d74-dd5a-4487-96c0-818ba422266a tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] [instance: aadddbb1-e053-420e-afd2-9412c6137504] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:15:00.003651 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-41fd9d74-dd5a-4487-96c0-818ba422266a tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:15:00.004415 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-41fd9d74-dd5a-4487-96c0-818ba422266a tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:15:00.004973 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-41fd9d74-dd5a-4487-96c0-818ba422266a tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:15:00.005838 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-41fd9d74-dd5a-4487-96c0-818ba422266a tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:15:00.006421 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-41fd9d74-dd5a-4487-96c0-818ba422266a tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:15:00.006969 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-41fd9d74-dd5a-4487-96c0-818ba422266a tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:15:00.155965 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-41fd9d74-dd5a-4487-96c0-818ba422266a tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8957041987c8487099f0d89f4c64af66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9d29b90ab34abbadd21edbca637d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:15:00.164253 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-41fd9d74-dd5a-4487-96c0-818ba422266a tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] 10.222.0.26 "GET /compute/v2.1/servers/aadddbb1-e053-420e-afd2-9412c6137504" status: 200 len: 1366 microversion: 2.1 time: 0.176517 Oct 08 21:15:00.164838 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2506/4949] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:14:59 2022] GET /compute/v2.1/servers/aadddbb1-e053-420e-afd2-9412c6137504 => generated 1366 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:15:00.290778 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-3d923c76-d5f0-4282-9fe7-02534d92165c req-a75e1e01-de80-450f-8c20-e108bc816eb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e33d129-543f-479f-86bf-4638cb153321", "name": "network-vif-plugged", "status": "completed", "tag": "778906c1-21bc-4637-97d7-0ea6988950f3"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:15:00.305495 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-3d923c76-d5f0-4282-9fe7-02534d92165c req-a75e1e01-de80-450f-8c20-e108bc816eb6 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:15:00.306255 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-3d923c76-d5f0-4282-9fe7-02534d92165c req-a75e1e01-de80-450f-8c20-e108bc816eb6 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:15:00.306938 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-3d923c76-d5f0-4282-9fe7-02534d92165c req-a75e1e01-de80-450f-8c20-e108bc816eb6 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:15:00.337136 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-3d923c76-d5f0-4282-9fe7-02534d92165c req-a75e1e01-de80-450f-8c20-e108bc816eb6 service nova] Creating event network-vif-plugged:778906c1-21bc-4637-97d7-0ea6988950f3 for instance 4e33d129-543f-479f-86bf-4638cb153321 on nch2-master-1 Oct 08 21:15:00.348119 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-3d923c76-d5f0-4282-9fe7-02534d92165c req-a75e1e01-de80-450f-8c20-e108bc816eb6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061097 Oct 08 21:15:00.352166 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2444/4950] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:15:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:15:00.754125 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-47a15b68-0fe7-408f-81e6-e0ec9bf56dce tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:15:00.754980 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-47a15b68-0fe7-408f-81e6-e0ec9bf56dce tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] [instance: 4e33d129-543f-479f-86bf-4638cb153321] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:15:00.771855 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-47a15b68-0fe7-408f-81e6-e0ec9bf56dce tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:15:00.773463 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-47a15b68-0fe7-408f-81e6-e0ec9bf56dce tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:15:00.775876 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-47a15b68-0fe7-408f-81e6-e0ec9bf56dce tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:15:00.781872 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-47a15b68-0fe7-408f-81e6-e0ec9bf56dce tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:15:00.783606 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-47a15b68-0fe7-408f-81e6-e0ec9bf56dce tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:15:00.784185 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-47a15b68-0fe7-408f-81e6-e0ec9bf56dce tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:15:01.189762 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-247cee98-4df4-480e-931d-90d8f21660d2 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:15:01.190849 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-247cee98-4df4-480e-931d-90d8f21660d2 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] [instance: aadddbb1-e053-420e-afd2-9412c6137504] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:15:01.207518 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-247cee98-4df4-480e-931d-90d8f21660d2 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:15:01.208432 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-247cee98-4df4-480e-931d-90d8f21660d2 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:15:01.209253 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-247cee98-4df4-480e-931d-90d8f21660d2 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:15:01.210841 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-247cee98-4df4-480e-931d-90d8f21660d2 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:15:01.212646 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-247cee98-4df4-480e-931d-90d8f21660d2 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:15:01.216760 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-247cee98-4df4-480e-931d-90d8f21660d2 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:15:01.645492 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-47a15b68-0fe7-408f-81e6-e0ec9bf56dce tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de71b64a2e1c4b6aaa15b5ee75003add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994439815e0416180c95158033ae3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:15:01.658462 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-47a15b68-0fe7-408f-81e6-e0ec9bf56dce tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] 10.222.0.26 "GET /compute/v2.1/servers/4e33d129-543f-479f-86bf-4638cb153321" status: 200 len: 1520 microversion: 2.1 time: 0.909265 Oct 08 21:15:01.666167 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2507/4951] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:15:00 2022] GET /compute/v2.1/servers/4e33d129-543f-479f-86bf-4638cb153321 => generated 1520 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:15:01.874024 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-247cee98-4df4-480e-931d-90d8f21660d2 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8957041987c8487099f0d89f4c64af66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9d29b90ab34abbadd21edbca637d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:15:01.884929 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-247cee98-4df4-480e-931d-90d8f21660d2 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] 10.222.0.26 "GET /compute/v2.1/servers/aadddbb1-e053-420e-afd2-9412c6137504" status: 200 len: 1366 microversion: 2.1 time: 0.700695 Oct 08 21:15:01.889328 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2445/4952] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:15:01 2022] GET /compute/v2.1/servers/aadddbb1-e053-420e-afd2-9412c6137504 => generated 1366 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:15:02.684065 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-8b9c7629-7ff8-480f-950b-c8e40b054dea tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:15:02.685313 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-8b9c7629-7ff8-480f-950b-c8e40b054dea tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] [instance: 4e33d129-543f-479f-86bf-4638cb153321] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:15:02.698560 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8b9c7629-7ff8-480f-950b-c8e40b054dea tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:15:02.700811 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8b9c7629-7ff8-480f-950b-c8e40b054dea tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:15:02.702562 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8b9c7629-7ff8-480f-950b-c8e40b054dea tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:15:02.703529 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8b9c7629-7ff8-480f-950b-c8e40b054dea tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:15:02.706494 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8b9c7629-7ff8-480f-950b-c8e40b054dea tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:15:02.712548 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8b9c7629-7ff8-480f-950b-c8e40b054dea tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:15:02.913786 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-214d968b-029b-4e2e-8337-53e99614b571 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:15:02.915166 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-214d968b-029b-4e2e-8337-53e99614b571 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] [instance: aadddbb1-e053-420e-afd2-9412c6137504] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:15:02.922506 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-214d968b-029b-4e2e-8337-53e99614b571 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:15:02.923900 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-214d968b-029b-4e2e-8337-53e99614b571 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:15:02.924551 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-214d968b-029b-4e2e-8337-53e99614b571 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:15:02.925586 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-214d968b-029b-4e2e-8337-53e99614b571 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:15:02.926255 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-214d968b-029b-4e2e-8337-53e99614b571 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:15:02.926886 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-214d968b-029b-4e2e-8337-53e99614b571 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:15:03.177312 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-8b9c7629-7ff8-480f-950b-c8e40b054dea tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de71b64a2e1c4b6aaa15b5ee75003add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994439815e0416180c95158033ae3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:15:03.180658 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-214d968b-029b-4e2e-8337-53e99614b571 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8957041987c8487099f0d89f4c64af66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9d29b90ab34abbadd21edbca637d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:15:03.194664 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-214d968b-029b-4e2e-8337-53e99614b571 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] 10.222.0.26 "GET /compute/v2.1/servers/aadddbb1-e053-420e-afd2-9412c6137504" status: 200 len: 1366 microversion: 2.1 time: 0.284984 Oct 08 21:15:03.214598 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-8b9c7629-7ff8-480f-950b-c8e40b054dea tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] 10.222.0.26 "GET /compute/v2.1/servers/4e33d129-543f-479f-86bf-4638cb153321" status: 200 len: 1505 microversion: 2.1 time: 0.532110 Oct 08 21:15:03.215746 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2446/4953] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:15:02 2022] GET /compute/v2.1/servers/aadddbb1-e053-420e-afd2-9412c6137504 => generated 1366 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:15:03.230294 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2508/4954] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:15:02 2022] GET /compute/v2.1/servers/4e33d129-543f-479f-86bf-4638cb153321 => generated 1505 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:15:03.242123 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-f90168bf-398f-4f20-a028-c476a42e0ab5 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:15:03.243099 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-f90168bf-398f-4f20-a028-c476a42e0ab5 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] [instance: 4e33d129-543f-479f-86bf-4638cb153321] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:15:03.250417 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f90168bf-398f-4f20-a028-c476a42e0ab5 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:15:03.251372 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f90168bf-398f-4f20-a028-c476a42e0ab5 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:15:03.252081 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f90168bf-398f-4f20-a028-c476a42e0ab5 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:15:03.253108 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f90168bf-398f-4f20-a028-c476a42e0ab5 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:15:03.254009 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f90168bf-398f-4f20-a028-c476a42e0ab5 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:15:03.254715 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f90168bf-398f-4f20-a028-c476a42e0ab5 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:15:03.499409 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-6a765e73-c438-455f-a95f-41984be227d4 req-a339c611-a284-4e44-bb87-d4b976a9655e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aadddbb1-e053-420e-afd2-9412c6137504", "name": "network-vif-plugged", "status": "completed", "tag": "e0674cb1-a68b-451f-b3bb-a6e7770eb93e"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:15:03.517071 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-6a765e73-c438-455f-a95f-41984be227d4 req-a339c611-a284-4e44-bb87-d4b976a9655e service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:15:03.517844 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-6a765e73-c438-455f-a95f-41984be227d4 req-a339c611-a284-4e44-bb87-d4b976a9655e service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:15:03.518828 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-6a765e73-c438-455f-a95f-41984be227d4 req-a339c611-a284-4e44-bb87-d4b976a9655e service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:15:03.539352 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-6a765e73-c438-455f-a95f-41984be227d4 req-a339c611-a284-4e44-bb87-d4b976a9655e service nova] Creating event network-vif-plugged:e0674cb1-a68b-451f-b3bb-a6e7770eb93e for instance aadddbb1-e053-420e-afd2-9412c6137504 on nch1-master-1 Oct 08 21:15:03.547569 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-6a765e73-c438-455f-a95f-41984be227d4 req-a339c611-a284-4e44-bb87-d4b976a9655e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073506 Oct 08 21:15:03.551261 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2509/4955] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:15:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 08 21:15:03.861130 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-f90168bf-398f-4f20-a028-c476a42e0ab5 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de71b64a2e1c4b6aaa15b5ee75003add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994439815e0416180c95158033ae3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:15:03.870589 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-f90168bf-398f-4f20-a028-c476a42e0ab5 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] 10.222.0.26 "GET /compute/v2.1/servers/4e33d129-543f-479f-86bf-4638cb153321" status: 200 len: 1505 microversion: 2.1 time: 0.633143 Oct 08 21:15:03.886027 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2447/4956] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:15:03 2022] GET /compute/v2.1/servers/4e33d129-543f-479f-86bf-4638cb153321 => generated 1505 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:15:03.896438 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-d985a6c6-4823-4f1b-8a47-0174f423db34 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:15:03.897822 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-d985a6c6-4823-4f1b-8a47-0174f423db34 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] [instance: 4e33d129-543f-479f-86bf-4638cb153321] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:15:03.906812 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d985a6c6-4823-4f1b-8a47-0174f423db34 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:15:03.907799 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d985a6c6-4823-4f1b-8a47-0174f423db34 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:15:03.908475 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d985a6c6-4823-4f1b-8a47-0174f423db34 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:15:03.909515 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d985a6c6-4823-4f1b-8a47-0174f423db34 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:15:03.910218 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d985a6c6-4823-4f1b-8a47-0174f423db34 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:15:03.910919 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d985a6c6-4823-4f1b-8a47-0174f423db34 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:15:03.948109 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-d985a6c6-4823-4f1b-8a47-0174f423db34 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] [instance: 4e33d129-543f-479f-86bf-4638cb153321] Going to try to terminate instance {{(pid=140492) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 21:15:04.076895 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-d985a6c6-4823-4f1b-8a47-0174f423db34 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] 10.222.0.26 "DELETE /compute/v2.1/servers/4e33d129-543f-479f-86bf-4638cb153321" status: 204 len: 0 microversion: 2.1 time: 0.184373 Oct 08 21:15:04.079591 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2510/4957] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:15:03 2022] DELETE /compute/v2.1/servers/4e33d129-543f-479f-86bf-4638cb153321 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 21:15:04.224390 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-4b15fdb6-55f1-4e0d-8854-d19455c2c7cc tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:15:04.225877 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-4b15fdb6-55f1-4e0d-8854-d19455c2c7cc tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] [instance: aadddbb1-e053-420e-afd2-9412c6137504] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:15:04.239392 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4b15fdb6-55f1-4e0d-8854-d19455c2c7cc tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:15:04.240219 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4b15fdb6-55f1-4e0d-8854-d19455c2c7cc tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:15:04.240695 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4b15fdb6-55f1-4e0d-8854-d19455c2c7cc tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:15:04.241461 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4b15fdb6-55f1-4e0d-8854-d19455c2c7cc tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:15:04.241955 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4b15fdb6-55f1-4e0d-8854-d19455c2c7cc tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:15:04.242408 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4b15fdb6-55f1-4e0d-8854-d19455c2c7cc tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:15:04.257762 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-1786caa3-582c-4f1c-9627-4be9819a568d tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1347584151", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "networks": [{"uuid": "a0e46c11-625b-4c0f-8df1-deaf5b32373b"}]}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:15:04.369250 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.network.neutron [None req-1786caa3-582c-4f1c-9627-4be9819a568d tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] validate_networks() for [('a0e46c11-625b-4c0f-8df1-deaf5b32373b', None, None, None, None, None)] {{(pid=140492) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 21:15:04.370296 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=2 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:15:04.426941 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=10 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:15:04.712653 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=2 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:15:04.805496 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-4b15fdb6-55f1-4e0d-8854-d19455c2c7cc tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8957041987c8487099f0d89f4c64af66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9d29b90ab34abbadd21edbca637d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:15:04.816356 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-4b15fdb6-55f1-4e0d-8854-d19455c2c7cc tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] 10.222.0.26 "GET /compute/v2.1/servers/aadddbb1-e053-420e-afd2-9412c6137504" status: 200 len: 1366 microversion: 2.1 time: 0.597818 Oct 08 21:15:04.816963 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2448/4958] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:15:04 2022] GET /compute/v2.1/servers/aadddbb1-e053-420e-afd2-9412c6137504 => generated 1366 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:15:05.840101 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-12f850f0-e5ba-4047-9a40-22d5ced15b7c tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:15:05.840728 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-12f850f0-e5ba-4047-9a40-22d5ced15b7c tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] [instance: aadddbb1-e053-420e-afd2-9412c6137504] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:15:05.856790 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-12f850f0-e5ba-4047-9a40-22d5ced15b7c tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:15:05.857393 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-12f850f0-e5ba-4047-9a40-22d5ced15b7c tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:15:05.857866 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-12f850f0-e5ba-4047-9a40-22d5ced15b7c tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:15:05.858782 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-12f850f0-e5ba-4047-9a40-22d5ced15b7c tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:15:05.859247 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-12f850f0-e5ba-4047-9a40-22d5ced15b7c tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:15:05.859876 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-12f850f0-e5ba-4047-9a40-22d5ced15b7c tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:15:06.245045 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-12f850f0-e5ba-4047-9a40-22d5ced15b7c tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8957041987c8487099f0d89f4c64af66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9d29b90ab34abbadd21edbca637d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:15:06.253292 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-12f850f0-e5ba-4047-9a40-22d5ced15b7c tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] 10.222.0.26 "GET /compute/v2.1/servers/aadddbb1-e053-420e-afd2-9412c6137504" status: 200 len: 1557 microversion: 2.1 time: 0.417034 Oct 08 21:15:06.270123 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2449/4959] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:15:05 2022] GET /compute/v2.1/servers/aadddbb1-e053-420e-afd2-9412c6137504 => generated 1557 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:15:06.280707 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-f896efbd-e9f6-4646-891c-d00a9a9dc2d6 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:15:06.281240 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-f896efbd-e9f6-4646-891c-d00a9a9dc2d6 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] [instance: aadddbb1-e053-420e-afd2-9412c6137504] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:15:06.303234 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f896efbd-e9f6-4646-891c-d00a9a9dc2d6 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:15:06.309333 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f896efbd-e9f6-4646-891c-d00a9a9dc2d6 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:15:06.310451 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f896efbd-e9f6-4646-891c-d00a9a9dc2d6 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:15:06.311236 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f896efbd-e9f6-4646-891c-d00a9a9dc2d6 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:15:06.311742 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f896efbd-e9f6-4646-891c-d00a9a9dc2d6 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:15:06.312224 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f896efbd-e9f6-4646-891c-d00a9a9dc2d6 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:15:06.498220 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-f896efbd-e9f6-4646-891c-d00a9a9dc2d6 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] 10.222.0.26 "GET /compute/v2.1/servers/aadddbb1-e053-420e-afd2-9412c6137504/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.221704 Oct 08 21:15:06.499266 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2450/4960] 10.222.0.26 () {58 vars in 1275 bytes} [Sat Oct 8 21:15:06 2022] GET /compute/v2.1/servers/aadddbb1-e053-420e-afd2-9412c6137504/os-interface => generated 285 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:15:06.865366 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-1786caa3-582c-4f1c-9627-4be9819a568d tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Flavor limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 21:15:06.865892 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-1786caa3-582c-4f1c-9627-4be9819a568d tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Image limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 21:15:06.866366 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-1786caa3-582c-4f1c-9627-4be9819a568d tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Flavor pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 21:15:06.866856 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-1786caa3-582c-4f1c-9627-4be9819a568d tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Image pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 21:15:06.867852 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-1786caa3-582c-4f1c-9627-4be9819a568d tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 21:15:06.888271 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1786caa3-582c-4f1c-9627-4be9819a568d tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:15:06.889671 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1786caa3-582c-4f1c-9627-4be9819a568d tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:15:06.890003 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1786caa3-582c-4f1c-9627-4be9819a568d tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:15:06.890767 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1786caa3-582c-4f1c-9627-4be9819a568d tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:15:06.891232 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1786caa3-582c-4f1c-9627-4be9819a568d tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:15:06.893302 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1786caa3-582c-4f1c-9627-4be9819a568d tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:15:06.930693 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-1786caa3-582c-4f1c-9627-4be9819a568d tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Getting quotas for project 7994439815e0416180c95158033ae3f2. Resources: {'cores', 'instances', 'ram'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:15:06.940011 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-1786caa3-582c-4f1c-9627-4be9819a568d tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Getting quotas for user de71b64a2e1c4b6aaa15b5ee75003add and project 7994439815e0416180c95158033ae3f2. Resources: {'cores', 'instances', 'ram'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:15:06.960027 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-1786caa3-582c-4f1c-9627-4be9819a568d tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Going to run 1 instances... {{(pid=140492) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 21:15:06.964569 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-1786caa3-582c-4f1c-9627-4be9819a568d tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] [instance: d6b05dbd-88a3-4e6a-9213-dc3facf93388] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c508bd7f-7db9-4b2c-af7c-be54a855c355',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140492) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 21:15:07.029728 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-1786caa3-582c-4f1c-9627-4be9819a568d tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.775655 Oct 08 21:15:07.037686 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2511/4961] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 21:15:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 2781 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 08 21:15:07.046949 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-4d4011ce-32e6-48c5-b566-f0e07f9c7ff1 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:15:07.049421 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-4d4011ce-32e6-48c5-b566-f0e07f9c7ff1 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] [instance: d6b05dbd-88a3-4e6a-9213-dc3facf93388] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:15:07.248030 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-4d4011ce-32e6-48c5-b566-f0e07f9c7ff1 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de71b64a2e1c4b6aaa15b5ee75003add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994439815e0416180c95158033ae3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:15:07.261555 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-4d4011ce-32e6-48c5-b566-f0e07f9c7ff1 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] 10.222.0.26 "GET /compute/v2.1/servers/d6b05dbd-88a3-4e6a-9213-dc3facf93388" status: 200 len: 1218 microversion: 2.1 time: 0.220575 Oct 08 21:15:07.263536 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2451/4962] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:15:07 2022] GET /compute/v2.1/servers/d6b05dbd-88a3-4e6a-9213-dc3facf93388 => generated 1218 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:15:08.108529 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-8b9ad05e-9c68-4160-ba09-52e97100d223 req-7468717d-31a7-4141-bcdb-81e4c2520e75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e33d129-543f-479f-86bf-4638cb153321", "name": "network-vif-deleted", "tag": "778906c1-21bc-4637-97d7-0ea6988950f3"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:15:08.150357 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-8b9ad05e-9c68-4160-ba09-52e97100d223 req-7468717d-31a7-4141-bcdb-81e4c2520e75 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:15:08.153658 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-8b9ad05e-9c68-4160-ba09-52e97100d223 req-7468717d-31a7-4141-bcdb-81e4c2520e75 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:15:08.154126 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-8b9ad05e-9c68-4160-ba09-52e97100d223 req-7468717d-31a7-4141-bcdb-81e4c2520e75 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:15:08.203405 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-8b9ad05e-9c68-4160-ba09-52e97100d223 req-7468717d-31a7-4141-bcdb-81e4c2520e75 service nova] Creating event network-vif-deleted:778906c1-21bc-4637-97d7-0ea6988950f3 for instance 4e33d129-543f-479f-86bf-4638cb153321 on nch2-master-1 Oct 08 21:15:08.219355 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-8b9ad05e-9c68-4160-ba09-52e97100d223 req-7468717d-31a7-4141-bcdb-81e4c2520e75 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120883 Oct 08 21:15:08.222934 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2512/4963] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:15:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:15:08.290680 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-be9fec6f-a19e-4134-9097-83217df66d7f tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:15:08.291269 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-be9fec6f-a19e-4134-9097-83217df66d7f tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] [instance: d6b05dbd-88a3-4e6a-9213-dc3facf93388] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:15:08.318393 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-be9fec6f-a19e-4134-9097-83217df66d7f tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:15:08.322439 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-be9fec6f-a19e-4134-9097-83217df66d7f tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:15:08.323046 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-be9fec6f-a19e-4134-9097-83217df66d7f tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:15:08.325260 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-be9fec6f-a19e-4134-9097-83217df66d7f tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:15:08.327497 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-be9fec6f-a19e-4134-9097-83217df66d7f tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:15:08.328234 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-be9fec6f-a19e-4134-9097-83217df66d7f tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:15:08.336834 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=88 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:15:08.765349 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-be9fec6f-a19e-4134-9097-83217df66d7f tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de71b64a2e1c4b6aaa15b5ee75003add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994439815e0416180c95158033ae3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:15:08.792429 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-be9fec6f-a19e-4134-9097-83217df66d7f tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] 10.222.0.26 "GET /compute/v2.1/servers/d6b05dbd-88a3-4e6a-9213-dc3facf93388" status: 200 len: 1270 microversion: 2.1 time: 0.501375 Oct 08 21:15:08.795986 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2452/4964] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:15:08 2022] GET /compute/v2.1/servers/d6b05dbd-88a3-4e6a-9213-dc3facf93388 => generated 1270 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:15:09.820540 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-33988216-8979-4085-b467-958f252a2a98 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:15:09.822190 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-33988216-8979-4085-b467-958f252a2a98 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] [instance: d6b05dbd-88a3-4e6a-9213-dc3facf93388] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:15:09.843758 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-33988216-8979-4085-b467-958f252a2a98 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:15:09.847870 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-33988216-8979-4085-b467-958f252a2a98 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:15:09.848602 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-33988216-8979-4085-b467-958f252a2a98 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:15:09.851924 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-33988216-8979-4085-b467-958f252a2a98 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:15:09.852608 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-33988216-8979-4085-b467-958f252a2a98 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:15:09.853277 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-33988216-8979-4085-b467-958f252a2a98 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:15:10.145265 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-33988216-8979-4085-b467-958f252a2a98 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de71b64a2e1c4b6aaa15b5ee75003add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994439815e0416180c95158033ae3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:15:10.163472 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-33988216-8979-4085-b467-958f252a2a98 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] 10.222.0.26 "GET /compute/v2.1/servers/d6b05dbd-88a3-4e6a-9213-dc3facf93388" status: 200 len: 1276 microversion: 2.1 time: 0.338884 Oct 08 21:15:10.164146 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2513/4965] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:15:09 2022] GET /compute/v2.1/servers/d6b05dbd-88a3-4e6a-9213-dc3facf93388 => generated 1276 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:15:10.713940 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-c050f355-ecdd-48d1-870e-e0bf4401f1aa req-741851fc-02ca-4ce5-a2f9-1faed4a391ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aadddbb1-e053-420e-afd2-9412c6137504", "tag": "e0674cb1-a68b-451f-b3bb-a6e7770eb93e"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:15:10.735249 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-c050f355-ecdd-48d1-870e-e0bf4401f1aa req-741851fc-02ca-4ce5-a2f9-1faed4a391ee service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:15:10.735769 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-c050f355-ecdd-48d1-870e-e0bf4401f1aa req-741851fc-02ca-4ce5-a2f9-1faed4a391ee service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:15:10.741463 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-c050f355-ecdd-48d1-870e-e0bf4401f1aa req-741851fc-02ca-4ce5-a2f9-1faed4a391ee service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:15:10.778185 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-c050f355-ecdd-48d1-870e-e0bf4401f1aa req-741851fc-02ca-4ce5-a2f9-1faed4a391ee service nova] Creating event network-changed:e0674cb1-a68b-451f-b3bb-a6e7770eb93e for instance aadddbb1-e053-420e-afd2-9412c6137504 on nch1-master-1 Oct 08 21:15:10.796479 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-c050f355-ecdd-48d1-870e-e0bf4401f1aa req-741851fc-02ca-4ce5-a2f9-1faed4a391ee service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.521057 Oct 08 21:15:10.800864 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2453/4966] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:15:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:15:11.188041 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-eaf9340b-1403-48ce-bc15-ee3138c942cc tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:15:11.205729 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-eaf9340b-1403-48ce-bc15-ee3138c942cc tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] [instance: d6b05dbd-88a3-4e6a-9213-dc3facf93388] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:15:11.236271 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-eaf9340b-1403-48ce-bc15-ee3138c942cc tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:15:11.241821 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-eaf9340b-1403-48ce-bc15-ee3138c942cc tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:15:11.246050 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-eaf9340b-1403-48ce-bc15-ee3138c942cc tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:15:11.247133 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-eaf9340b-1403-48ce-bc15-ee3138c942cc tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:15:11.247671 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-eaf9340b-1403-48ce-bc15-ee3138c942cc tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:15:11.248185 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-eaf9340b-1403-48ce-bc15-ee3138c942cc tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:15:12.070222 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-eaf9340b-1403-48ce-bc15-ee3138c942cc tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de71b64a2e1c4b6aaa15b5ee75003add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994439815e0416180c95158033ae3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:15:12.081073 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-eaf9340b-1403-48ce-bc15-ee3138c942cc tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] 10.222.0.26 "GET /compute/v2.1/servers/d6b05dbd-88a3-4e6a-9213-dc3facf93388" status: 200 len: 1318 microversion: 2.1 time: 0.896814 Oct 08 21:15:12.082068 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2514/4967] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:15:11 2022] GET /compute/v2.1/servers/d6b05dbd-88a3-4e6a-9213-dc3facf93388 => generated 1318 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:15:13.105863 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-9f2afc9c-373a-4c69-bd9d-c9651d4e5840 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:15:13.106582 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-9f2afc9c-373a-4c69-bd9d-c9651d4e5840 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] [instance: d6b05dbd-88a3-4e6a-9213-dc3facf93388] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:15:13.123587 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9f2afc9c-373a-4c69-bd9d-c9651d4e5840 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:15:13.124147 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9f2afc9c-373a-4c69-bd9d-c9651d4e5840 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:15:13.124612 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9f2afc9c-373a-4c69-bd9d-c9651d4e5840 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:15:13.125419 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9f2afc9c-373a-4c69-bd9d-c9651d4e5840 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:15:13.125914 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9f2afc9c-373a-4c69-bd9d-c9651d4e5840 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:15:13.126558 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9f2afc9c-373a-4c69-bd9d-c9651d4e5840 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:15:14.718112 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-9f2afc9c-373a-4c69-bd9d-c9651d4e5840 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de71b64a2e1c4b6aaa15b5ee75003add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994439815e0416180c95158033ae3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:15:14.730323 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-9f2afc9c-373a-4c69-bd9d-c9651d4e5840 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] 10.222.0.26 "GET /compute/v2.1/servers/d6b05dbd-88a3-4e6a-9213-dc3facf93388" status: 200 len: 1318 microversion: 2.1 time: 1.628627 Oct 08 21:15:14.739255 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2454/4968] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:15:13 2022] GET /compute/v2.1/servers/d6b05dbd-88a3-4e6a-9213-dc3facf93388 => generated 1318 bytes in 1639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:15:15.358967 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-6c23fa03-768b-4302-be91-11e2beaa8c84 req-8103975e-048b-4289-9f7f-e06ae352e716 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6b05dbd-88a3-4e6a-9213-dc3facf93388", "tag": "53e77978-9454-433c-b790-20e375ca0fee"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:15:15.389071 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-6c23fa03-768b-4302-be91-11e2beaa8c84 req-8103975e-048b-4289-9f7f-e06ae352e716 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:15:15.392281 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-6c23fa03-768b-4302-be91-11e2beaa8c84 req-8103975e-048b-4289-9f7f-e06ae352e716 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:15:15.392922 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-6c23fa03-768b-4302-be91-11e2beaa8c84 req-8103975e-048b-4289-9f7f-e06ae352e716 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:15:15.430716 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-6c23fa03-768b-4302-be91-11e2beaa8c84 req-8103975e-048b-4289-9f7f-e06ae352e716 service nova] Creating event network-changed:53e77978-9454-433c-b790-20e375ca0fee for instance d6b05dbd-88a3-4e6a-9213-dc3facf93388 on nch1-master-1 Oct 08 21:15:15.448405 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-6c23fa03-768b-4302-be91-11e2beaa8c84 req-8103975e-048b-4289-9f7f-e06ae352e716 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105383 Oct 08 21:15:15.449554 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2515/4969] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:15:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:15:15.761441 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-cfd47f20-520a-45c7-9c49-cce044a45fc6 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:15:15.762069 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-cfd47f20-520a-45c7-9c49-cce044a45fc6 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] [instance: d6b05dbd-88a3-4e6a-9213-dc3facf93388] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:15:15.793891 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cfd47f20-520a-45c7-9c49-cce044a45fc6 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:15:15.794403 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cfd47f20-520a-45c7-9c49-cce044a45fc6 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:15:15.794859 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cfd47f20-520a-45c7-9c49-cce044a45fc6 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:15:15.795622 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cfd47f20-520a-45c7-9c49-cce044a45fc6 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:15:15.803040 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cfd47f20-520a-45c7-9c49-cce044a45fc6 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:15:15.803771 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cfd47f20-520a-45c7-9c49-cce044a45fc6 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:15:16.174044 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-cfd47f20-520a-45c7-9c49-cce044a45fc6 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de71b64a2e1c4b6aaa15b5ee75003add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994439815e0416180c95158033ae3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:15:16.184115 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-cfd47f20-520a-45c7-9c49-cce044a45fc6 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] 10.222.0.26 "GET /compute/v2.1/servers/d6b05dbd-88a3-4e6a-9213-dc3facf93388" status: 200 len: 1318 microversion: 2.1 time: 0.426439 Oct 08 21:15:16.184928 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2455/4970] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:15:15 2022] GET /compute/v2.1/servers/d6b05dbd-88a3-4e6a-9213-dc3facf93388 => generated 1318 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:15:17.209226 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=2 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:15:17.210592 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=6 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:15:17.214997 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-8aee2172-a413-493d-82df-0f4b47b6665e tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:15:17.215928 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-8aee2172-a413-493d-82df-0f4b47b6665e tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] [instance: d6b05dbd-88a3-4e6a-9213-dc3facf93388] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:15:17.234471 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8aee2172-a413-493d-82df-0f4b47b6665e tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:15:17.234982 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8aee2172-a413-493d-82df-0f4b47b6665e tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:15:17.235466 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8aee2172-a413-493d-82df-0f4b47b6665e tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:15:17.236198 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8aee2172-a413-493d-82df-0f4b47b6665e tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:15:17.236669 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8aee2172-a413-493d-82df-0f4b47b6665e tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:15:17.237108 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8aee2172-a413-493d-82df-0f4b47b6665e tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:15:17.724823 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-8aee2172-a413-493d-82df-0f4b47b6665e tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de71b64a2e1c4b6aaa15b5ee75003add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994439815e0416180c95158033ae3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:15:17.733153 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-8aee2172-a413-493d-82df-0f4b47b6665e tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] 10.222.0.26 "GET /compute/v2.1/servers/d6b05dbd-88a3-4e6a-9213-dc3facf93388" status: 200 len: 1318 microversion: 2.1 time: 0.525693 Oct 08 21:15:17.745568 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2516/4971] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:15:17 2022] GET /compute/v2.1/servers/d6b05dbd-88a3-4e6a-9213-dc3facf93388 => generated 1318 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:15:18.756477 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-cfc109b0-8b44-44db-9125-36c6e544f4b9 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:15:18.757744 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-cfc109b0-8b44-44db-9125-36c6e544f4b9 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] [instance: d6b05dbd-88a3-4e6a-9213-dc3facf93388] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:15:18.764073 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=2 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:15:18.765955 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cfc109b0-8b44-44db-9125-36c6e544f4b9 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:15:18.767907 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cfc109b0-8b44-44db-9125-36c6e544f4b9 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:15:18.768591 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cfc109b0-8b44-44db-9125-36c6e544f4b9 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:15:18.769592 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cfc109b0-8b44-44db-9125-36c6e544f4b9 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:15:18.770313 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cfc109b0-8b44-44db-9125-36c6e544f4b9 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:15:18.771030 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cfc109b0-8b44-44db-9125-36c6e544f4b9 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:15:19.069412 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-cfc109b0-8b44-44db-9125-36c6e544f4b9 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de71b64a2e1c4b6aaa15b5ee75003add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994439815e0416180c95158033ae3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:15:19.079765 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-cfc109b0-8b44-44db-9125-36c6e544f4b9 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] 10.222.0.26 "GET /compute/v2.1/servers/d6b05dbd-88a3-4e6a-9213-dc3facf93388" status: 200 len: 1318 microversion: 2.1 time: 0.327018 Oct 08 21:15:19.081115 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2456/4972] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:15:18 2022] GET /compute/v2.1/servers/d6b05dbd-88a3-4e6a-9213-dc3facf93388 => generated 1318 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:15:20.105479 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-ce8e0248-228e-4df8-92c4-bd05f8d25a74 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:15:20.106166 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-ce8e0248-228e-4df8-92c4-bd05f8d25a74 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] [instance: d6b05dbd-88a3-4e6a-9213-dc3facf93388] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:15:20.127786 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ce8e0248-228e-4df8-92c4-bd05f8d25a74 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:15:20.128801 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ce8e0248-228e-4df8-92c4-bd05f8d25a74 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:15:20.133565 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ce8e0248-228e-4df8-92c4-bd05f8d25a74 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:15:20.135822 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ce8e0248-228e-4df8-92c4-bd05f8d25a74 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:15:20.137875 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ce8e0248-228e-4df8-92c4-bd05f8d25a74 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:15:20.138535 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ce8e0248-228e-4df8-92c4-bd05f8d25a74 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:15:20.489732 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-ce8e0248-228e-4df8-92c4-bd05f8d25a74 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de71b64a2e1c4b6aaa15b5ee75003add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994439815e0416180c95158033ae3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:15:20.516443 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-ce8e0248-228e-4df8-92c4-bd05f8d25a74 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] 10.222.0.26 "GET /compute/v2.1/servers/d6b05dbd-88a3-4e6a-9213-dc3facf93388" status: 200 len: 1318 microversion: 2.1 time: 0.408603 Oct 08 21:15:20.518461 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2517/4973] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:15:20 2022] GET /compute/v2.1/servers/d6b05dbd-88a3-4e6a-9213-dc3facf93388 => generated 1318 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:15:21.546633 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-b7234615-c3b8-428f-be18-ba06bc7fc4b7 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:15:21.548627 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-b7234615-c3b8-428f-be18-ba06bc7fc4b7 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] [instance: d6b05dbd-88a3-4e6a-9213-dc3facf93388] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:15:21.558651 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:15:21.560275 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b7234615-c3b8-428f-be18-ba06bc7fc4b7 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:15:21.565900 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b7234615-c3b8-428f-be18-ba06bc7fc4b7 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:15:21.566523 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b7234615-c3b8-428f-be18-ba06bc7fc4b7 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:15:21.567729 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b7234615-c3b8-428f-be18-ba06bc7fc4b7 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:15:21.568446 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b7234615-c3b8-428f-be18-ba06bc7fc4b7 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:15:21.572528 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b7234615-c3b8-428f-be18-ba06bc7fc4b7 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:15:21.596584 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-a2012f51-97b8-4d72-802d-ddd9059a5927 req-a468887f-776b-4ad7-8416-b813da137b17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6b05dbd-88a3-4e6a-9213-dc3facf93388", "name": "network-vif-plugged", "status": "completed", "tag": "53e77978-9454-433c-b790-20e375ca0fee"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:15:21.636821 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-a2012f51-97b8-4d72-802d-ddd9059a5927 req-a468887f-776b-4ad7-8416-b813da137b17 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:15:21.638482 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-a2012f51-97b8-4d72-802d-ddd9059a5927 req-a468887f-776b-4ad7-8416-b813da137b17 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:15:21.642538 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-a2012f51-97b8-4d72-802d-ddd9059a5927 req-a468887f-776b-4ad7-8416-b813da137b17 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:15:21.692103 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-a2012f51-97b8-4d72-802d-ddd9059a5927 req-a468887f-776b-4ad7-8416-b813da137b17 service nova] Creating event network-vif-plugged:53e77978-9454-433c-b790-20e375ca0fee for instance d6b05dbd-88a3-4e6a-9213-dc3facf93388 on nch1-master-1 Oct 08 21:15:21.692103 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-a2012f51-97b8-4d72-802d-ddd9059a5927 req-a468887f-776b-4ad7-8416-b813da137b17 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099255 Oct 08 21:15:21.692103 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2518/4974] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:15:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:15:22.091702 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-b7234615-c3b8-428f-be18-ba06bc7fc4b7 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de71b64a2e1c4b6aaa15b5ee75003add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994439815e0416180c95158033ae3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:15:22.113360 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-b7234615-c3b8-428f-be18-ba06bc7fc4b7 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] 10.222.0.26 "GET /compute/v2.1/servers/d6b05dbd-88a3-4e6a-9213-dc3facf93388" status: 200 len: 1318 microversion: 2.1 time: 0.567994 Oct 08 21:15:22.117933 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2457/4975] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:15:21 2022] GET /compute/v2.1/servers/d6b05dbd-88a3-4e6a-9213-dc3facf93388 => generated 1318 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:15:23.146116 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-3416e99e-874c-4b86-87fe-5dd542a5da18 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:15:23.147856 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-3416e99e-874c-4b86-87fe-5dd542a5da18 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] [instance: d6b05dbd-88a3-4e6a-9213-dc3facf93388] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:15:23.167684 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3416e99e-874c-4b86-87fe-5dd542a5da18 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:15:23.168708 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3416e99e-874c-4b86-87fe-5dd542a5da18 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:15:23.169337 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3416e99e-874c-4b86-87fe-5dd542a5da18 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:15:23.170261 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3416e99e-874c-4b86-87fe-5dd542a5da18 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:15:23.175452 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3416e99e-874c-4b86-87fe-5dd542a5da18 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:15:23.176118 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3416e99e-874c-4b86-87fe-5dd542a5da18 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:15:24.407246 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-3416e99e-874c-4b86-87fe-5dd542a5da18 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de71b64a2e1c4b6aaa15b5ee75003add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994439815e0416180c95158033ae3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:15:24.416767 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-3416e99e-874c-4b86-87fe-5dd542a5da18 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] 10.222.0.26 "GET /compute/v2.1/servers/d6b05dbd-88a3-4e6a-9213-dc3facf93388" status: 200 len: 1318 microversion: 2.1 time: 1.277671 Oct 08 21:15:24.420573 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2519/4976] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:15:23 2022] GET /compute/v2.1/servers/d6b05dbd-88a3-4e6a-9213-dc3facf93388 => generated 1318 bytes in 1283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:15:25.445677 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-f7724f7c-2da6-4078-9d0d-290380e1fa0e tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:15:25.446908 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-f7724f7c-2da6-4078-9d0d-290380e1fa0e tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] [instance: d6b05dbd-88a3-4e6a-9213-dc3facf93388] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:15:25.458950 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f7724f7c-2da6-4078-9d0d-290380e1fa0e tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:15:25.461276 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f7724f7c-2da6-4078-9d0d-290380e1fa0e tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:15:25.461959 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f7724f7c-2da6-4078-9d0d-290380e1fa0e tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:15:25.463791 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f7724f7c-2da6-4078-9d0d-290380e1fa0e tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:15:25.467437 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f7724f7c-2da6-4078-9d0d-290380e1fa0e tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:15:25.468081 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f7724f7c-2da6-4078-9d0d-290380e1fa0e tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:15:26.094503 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-f7724f7c-2da6-4078-9d0d-290380e1fa0e tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de71b64a2e1c4b6aaa15b5ee75003add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994439815e0416180c95158033ae3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:15:26.123524 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-f7724f7c-2da6-4078-9d0d-290380e1fa0e tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] 10.222.0.26 "GET /compute/v2.1/servers/d6b05dbd-88a3-4e6a-9213-dc3facf93388" status: 200 len: 1506 microversion: 2.1 time: 0.682691 Oct 08 21:15:26.126663 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2458/4977] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:15:25 2022] GET /compute/v2.1/servers/d6b05dbd-88a3-4e6a-9213-dc3facf93388 => generated 1506 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:15:26.149833 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-0700e253-60bd-4020-8d0c-e7add1bac629 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:15:26.151234 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-0700e253-60bd-4020-8d0c-e7add1bac629 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] [instance: d6b05dbd-88a3-4e6a-9213-dc3facf93388] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:15:26.158691 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:15:26.160696 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0700e253-60bd-4020-8d0c-e7add1bac629 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:15:26.161957 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0700e253-60bd-4020-8d0c-e7add1bac629 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:15:26.162684 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0700e253-60bd-4020-8d0c-e7add1bac629 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:15:26.163793 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0700e253-60bd-4020-8d0c-e7add1bac629 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:15:26.164490 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0700e253-60bd-4020-8d0c-e7add1bac629 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:15:26.165154 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0700e253-60bd-4020-8d0c-e7add1bac629 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:15:26.195299 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:15:26.510131 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-0700e253-60bd-4020-8d0c-e7add1bac629 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de71b64a2e1c4b6aaa15b5ee75003add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994439815e0416180c95158033ae3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:15:26.527022 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-0700e253-60bd-4020-8d0c-e7add1bac629 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] 10.222.0.26 "GET /compute/v2.1/servers/d6b05dbd-88a3-4e6a-9213-dc3facf93388" status: 200 len: 1506 microversion: 2.1 time: 0.381007 Oct 08 21:15:26.528012 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2520/4978] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:15:26 2022] GET /compute/v2.1/servers/d6b05dbd-88a3-4e6a-9213-dc3facf93388 => generated 1506 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:15:26.551166 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-9ebfd53b-d659-4557-89a0-f1f6de5e812d tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:15:26.555316 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-9ebfd53b-d659-4557-89a0-f1f6de5e812d tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] [instance: d6b05dbd-88a3-4e6a-9213-dc3facf93388] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:15:26.564572 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9ebfd53b-d659-4557-89a0-f1f6de5e812d tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:15:26.565526 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9ebfd53b-d659-4557-89a0-f1f6de5e812d tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:15:26.566271 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9ebfd53b-d659-4557-89a0-f1f6de5e812d tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:15:26.567324 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9ebfd53b-d659-4557-89a0-f1f6de5e812d tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:15:26.568180 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9ebfd53b-d659-4557-89a0-f1f6de5e812d tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:15:26.569038 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9ebfd53b-d659-4557-89a0-f1f6de5e812d tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:15:26.647540 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-9ebfd53b-d659-4557-89a0-f1f6de5e812d tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] 10.222.0.26 "PUT /compute/v2.1/servers/d6b05dbd-88a3-4e6a-9213-dc3facf93388" status: 200 len: 1078 microversion: 2.1 time: 0.100856 Oct 08 21:15:26.664341 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2459/4979] 10.222.0.26 () {60 vars in 1256 bytes} [Sat Oct 8 21:15:26 2022] PUT /compute/v2.1/servers/d6b05dbd-88a3-4e6a-9213-dc3facf93388 => generated 1078 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:15:26.668179 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-67648b74-a17d-4a64-8dd5-90b08d933f51 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:15:26.668969 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-67648b74-a17d-4a64-8dd5-90b08d933f51 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] [instance: d6b05dbd-88a3-4e6a-9213-dc3facf93388] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:15:26.676426 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-67648b74-a17d-4a64-8dd5-90b08d933f51 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:15:26.677083 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-67648b74-a17d-4a64-8dd5-90b08d933f51 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:15:26.677678 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-67648b74-a17d-4a64-8dd5-90b08d933f51 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:15:26.678554 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-67648b74-a17d-4a64-8dd5-90b08d933f51 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:15:26.679272 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-67648b74-a17d-4a64-8dd5-90b08d933f51 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:15:26.679955 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-67648b74-a17d-4a64-8dd5-90b08d933f51 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:15:26.957105 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-67648b74-a17d-4a64-8dd5-90b08d933f51 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de71b64a2e1c4b6aaa15b5ee75003add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994439815e0416180c95158033ae3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:15:26.973719 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-67648b74-a17d-4a64-8dd5-90b08d933f51 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] 10.222.0.26 "GET /compute/v2.1/servers/d6b05dbd-88a3-4e6a-9213-dc3facf93388" status: 200 len: 1504 microversion: 2.1 time: 0.310064 Oct 08 21:15:26.977323 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2521/4980] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:15:26 2022] GET /compute/v2.1/servers/d6b05dbd-88a3-4e6a-9213-dc3facf93388 => generated 1504 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:15:27.002073 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-8513805f-ca16-4c4d-82fb-3fe0fe0fd5b2 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:15:27.002754 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-8513805f-ca16-4c4d-82fb-3fe0fe0fd5b2 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] [instance: d6b05dbd-88a3-4e6a-9213-dc3facf93388] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:15:27.019643 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8513805f-ca16-4c4d-82fb-3fe0fe0fd5b2 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:15:27.020259 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8513805f-ca16-4c4d-82fb-3fe0fe0fd5b2 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:15:27.020602 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8513805f-ca16-4c4d-82fb-3fe0fe0fd5b2 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:15:27.021378 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8513805f-ca16-4c4d-82fb-3fe0fe0fd5b2 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:15:27.021849 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8513805f-ca16-4c4d-82fb-3fe0fe0fd5b2 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:15:27.033831 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8513805f-ca16-4c4d-82fb-3fe0fe0fd5b2 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:15:27.561631 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-8513805f-ca16-4c4d-82fb-3fe0fe0fd5b2 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de71b64a2e1c4b6aaa15b5ee75003add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994439815e0416180c95158033ae3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:15:27.574407 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-8513805f-ca16-4c4d-82fb-3fe0fe0fd5b2 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] 10.222.0.26 "GET /compute/v2.1/servers/d6b05dbd-88a3-4e6a-9213-dc3facf93388" status: 200 len: 1504 microversion: 2.1 time: 0.576600 Oct 08 21:15:27.594290 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2460/4981] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:15:26 2022] GET /compute/v2.1/servers/d6b05dbd-88a3-4e6a-9213-dc3facf93388 => generated 1504 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:15:27.617609 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-8b94b73f-8e76-4878-ab5a-51a49ad40c63 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:15:27.621675 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-8b94b73f-8e76-4878-ab5a-51a49ad40c63 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] [instance: d6b05dbd-88a3-4e6a-9213-dc3facf93388] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:15:27.629890 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8b94b73f-8e76-4878-ab5a-51a49ad40c63 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:15:27.630480 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8b94b73f-8e76-4878-ab5a-51a49ad40c63 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:15:27.630961 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8b94b73f-8e76-4878-ab5a-51a49ad40c63 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:15:27.631766 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8b94b73f-8e76-4878-ab5a-51a49ad40c63 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:15:27.632862 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8b94b73f-8e76-4878-ab5a-51a49ad40c63 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:15:27.633519 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8b94b73f-8e76-4878-ab5a-51a49ad40c63 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:15:27.753128 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-8b94b73f-8e76-4878-ab5a-51a49ad40c63 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] 10.222.0.26 "PUT /compute/v2.1/servers/d6b05dbd-88a3-4e6a-9213-dc3facf93388" status: 200 len: 1080 microversion: 2.1 time: 0.139537 Oct 08 21:15:27.754570 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2522/4982] 10.222.0.26 () {60 vars in 1256 bytes} [Sat Oct 8 21:15:27 2022] PUT /compute/v2.1/servers/d6b05dbd-88a3-4e6a-9213-dc3facf93388 => generated 1080 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:15:27.781525 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-d74c073c-0785-435a-ac42-adfaebe2c7f2 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:15:27.781525 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-d74c073c-0785-435a-ac42-adfaebe2c7f2 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] [instance: d6b05dbd-88a3-4e6a-9213-dc3facf93388] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:15:27.792033 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d74c073c-0785-435a-ac42-adfaebe2c7f2 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:15:27.792615 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d74c073c-0785-435a-ac42-adfaebe2c7f2 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:15:27.793288 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d74c073c-0785-435a-ac42-adfaebe2c7f2 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:15:27.794205 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d74c073c-0785-435a-ac42-adfaebe2c7f2 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:15:27.797201 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d74c073c-0785-435a-ac42-adfaebe2c7f2 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:15:27.797976 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d74c073c-0785-435a-ac42-adfaebe2c7f2 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:15:28.059016 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-d74c073c-0785-435a-ac42-adfaebe2c7f2 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de71b64a2e1c4b6aaa15b5ee75003add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994439815e0416180c95158033ae3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:15:28.077417 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-d74c073c-0785-435a-ac42-adfaebe2c7f2 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] 10.222.0.26 "GET /compute/v2.1/servers/d6b05dbd-88a3-4e6a-9213-dc3facf93388" status: 200 len: 1506 microversion: 2.1 time: 0.303275 Oct 08 21:15:28.078313 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2461/4983] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:15:27 2022] GET /compute/v2.1/servers/d6b05dbd-88a3-4e6a-9213-dc3facf93388 => generated 1506 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:15:28.107109 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-a8409b31-380a-4001-9fd5-a480b08b707f tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:15:28.110830 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-a8409b31-380a-4001-9fd5-a480b08b707f tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] [instance: d6b05dbd-88a3-4e6a-9213-dc3facf93388] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:15:28.129794 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a8409b31-380a-4001-9fd5-a480b08b707f tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:15:28.130852 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a8409b31-380a-4001-9fd5-a480b08b707f tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:15:28.132368 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a8409b31-380a-4001-9fd5-a480b08b707f tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:15:28.133522 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a8409b31-380a-4001-9fd5-a480b08b707f tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:15:28.135448 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a8409b31-380a-4001-9fd5-a480b08b707f tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:15:28.138812 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a8409b31-380a-4001-9fd5-a480b08b707f tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:15:28.600265 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-a8409b31-380a-4001-9fd5-a480b08b707f tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de71b64a2e1c4b6aaa15b5ee75003add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994439815e0416180c95158033ae3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:15:28.617485 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-a8409b31-380a-4001-9fd5-a480b08b707f tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] 10.222.0.26 "GET /compute/v2.1/servers/d6b05dbd-88a3-4e6a-9213-dc3facf93388" status: 200 len: 1506 microversion: 2.1 time: 0.508009 Oct 08 21:15:28.617485 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2523/4984] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:15:28 2022] GET /compute/v2.1/servers/d6b05dbd-88a3-4e6a-9213-dc3facf93388 => generated 1506 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:15:28.634820 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-ff654f09-0249-4c05-bf2d-b987fa28cf10 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:15:28.635903 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-ff654f09-0249-4c05-bf2d-b987fa28cf10 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] [instance: d6b05dbd-88a3-4e6a-9213-dc3facf93388] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:15:28.659503 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ff654f09-0249-4c05-bf2d-b987fa28cf10 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:15:28.661837 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ff654f09-0249-4c05-bf2d-b987fa28cf10 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:15:28.662552 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ff654f09-0249-4c05-bf2d-b987fa28cf10 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:15:28.663477 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ff654f09-0249-4c05-bf2d-b987fa28cf10 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:15:28.664107 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ff654f09-0249-4c05-bf2d-b987fa28cf10 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:15:28.665727 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ff654f09-0249-4c05-bf2d-b987fa28cf10 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:15:28.728790 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-ff654f09-0249-4c05-bf2d-b987fa28cf10 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] [instance: d6b05dbd-88a3-4e6a-9213-dc3facf93388] Going to try to terminate instance {{(pid=140491) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 21:15:28.871507 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-ff654f09-0249-4c05-bf2d-b987fa28cf10 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] 10.222.0.26 "DELETE /compute/v2.1/servers/d6b05dbd-88a3-4e6a-9213-dc3facf93388" status: 204 len: 0 microversion: 2.1 time: 0.241313 Oct 08 21:15:28.871985 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2462/4985] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:15:28 2022] DELETE /compute/v2.1/servers/d6b05dbd-88a3-4e6a-9213-dc3facf93388 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 21:15:28.882598 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-8d9488a0-9b63-4162-aaf2-0c9c48272dc2 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:15:28.883253 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-8d9488a0-9b63-4162-aaf2-0c9c48272dc2 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] [instance: d6b05dbd-88a3-4e6a-9213-dc3facf93388] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:15:28.900259 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8d9488a0-9b63-4162-aaf2-0c9c48272dc2 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:15:28.902326 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8d9488a0-9b63-4162-aaf2-0c9c48272dc2 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:15:28.903588 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8d9488a0-9b63-4162-aaf2-0c9c48272dc2 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:15:28.904737 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8d9488a0-9b63-4162-aaf2-0c9c48272dc2 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:15:28.905740 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8d9488a0-9b63-4162-aaf2-0c9c48272dc2 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:15:28.909863 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8d9488a0-9b63-4162-aaf2-0c9c48272dc2 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:15:28.952750 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-8d9488a0-9b63-4162-aaf2-0c9c48272dc2 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] [instance: d6b05dbd-88a3-4e6a-9213-dc3facf93388] Going to try to terminate instance {{(pid=140492) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 21:15:29.061422 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.compute.api [None req-8d9488a0-9b63-4162-aaf2-0c9c48272dc2 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] [instance: d6b05dbd-88a3-4e6a-9213-dc3facf93388] Instance is already in deleting state, ignoring this request Oct 08 21:15:29.064068 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-8d9488a0-9b63-4162-aaf2-0c9c48272dc2 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] 10.222.0.26 "DELETE /compute/v2.1/servers/d6b05dbd-88a3-4e6a-9213-dc3facf93388" status: 204 len: 0 microversion: 2.1 time: 0.185200 Oct 08 21:15:29.070443 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2524/4986] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:15:28 2022] DELETE /compute/v2.1/servers/d6b05dbd-88a3-4e6a-9213-dc3facf93388 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 21:15:29.090930 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-da2c9909-42a9-4b9d-98f7-ce23a106df73 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:15:29.091824 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-da2c9909-42a9-4b9d-98f7-ce23a106df73 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] [instance: d6b05dbd-88a3-4e6a-9213-dc3facf93388] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:15:29.112535 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-da2c9909-42a9-4b9d-98f7-ce23a106df73 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:15:29.115633 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-da2c9909-42a9-4b9d-98f7-ce23a106df73 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:15:29.116537 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-da2c9909-42a9-4b9d-98f7-ce23a106df73 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:15:29.120186 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-da2c9909-42a9-4b9d-98f7-ce23a106df73 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:15:29.120902 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-da2c9909-42a9-4b9d-98f7-ce23a106df73 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:15:29.121714 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-da2c9909-42a9-4b9d-98f7-ce23a106df73 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:15:29.685453 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-da2c9909-42a9-4b9d-98f7-ce23a106df73 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de71b64a2e1c4b6aaa15b5ee75003add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994439815e0416180c95158033ae3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:15:29.701882 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-da2c9909-42a9-4b9d-98f7-ce23a106df73 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] 10.222.0.26 "GET /compute/v2.1/servers/d6b05dbd-88a3-4e6a-9213-dc3facf93388" status: 200 len: 1512 microversion: 2.1 time: 0.626750 Oct 08 21:15:29.702885 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2463/4987] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:15:29 2022] GET /compute/v2.1/servers/d6b05dbd-88a3-4e6a-9213-dc3facf93388 => generated 1512 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:15:30.731423 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-9f9f1cb5-2e14-4555-ba72-ed802dd575c5 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:15:30.736248 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-9f9f1cb5-2e14-4555-ba72-ed802dd575c5 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] [instance: d6b05dbd-88a3-4e6a-9213-dc3facf93388] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:15:30.745608 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9f9f1cb5-2e14-4555-ba72-ed802dd575c5 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:15:30.746518 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9f9f1cb5-2e14-4555-ba72-ed802dd575c5 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:15:30.750438 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9f9f1cb5-2e14-4555-ba72-ed802dd575c5 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:15:30.752441 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9f9f1cb5-2e14-4555-ba72-ed802dd575c5 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:15:30.753167 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9f9f1cb5-2e14-4555-ba72-ed802dd575c5 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:15:30.753906 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9f9f1cb5-2e14-4555-ba72-ed802dd575c5 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:15:31.638687 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-9f9f1cb5-2e14-4555-ba72-ed802dd575c5 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de71b64a2e1c4b6aaa15b5ee75003add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994439815e0416180c95158033ae3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:15:31.648255 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-9f9f1cb5-2e14-4555-ba72-ed802dd575c5 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] 10.222.0.26 "GET /compute/v2.1/servers/d6b05dbd-88a3-4e6a-9213-dc3facf93388" status: 200 len: 1512 microversion: 2.1 time: 0.920779 Oct 08 21:15:31.648916 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2525/4988] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:15:30 2022] GET /compute/v2.1/servers/d6b05dbd-88a3-4e6a-9213-dc3facf93388 => generated 1512 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:15:32.172480 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-419263f7-f821-44b3-ad72-c8d624878ff0 req-7c4fa512-08b3-4026-beb7-2f73faab8095 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6b05dbd-88a3-4e6a-9213-dc3facf93388", "name": "network-vif-deleted", "tag": "53e77978-9454-433c-b790-20e375ca0fee"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:15:32.222703 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-419263f7-f821-44b3-ad72-c8d624878ff0 req-7c4fa512-08b3-4026-beb7-2f73faab8095 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:15:32.226856 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-419263f7-f821-44b3-ad72-c8d624878ff0 req-7c4fa512-08b3-4026-beb7-2f73faab8095 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:15:32.227897 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-419263f7-f821-44b3-ad72-c8d624878ff0 req-7c4fa512-08b3-4026-beb7-2f73faab8095 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:15:32.308878 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-419263f7-f821-44b3-ad72-c8d624878ff0 req-7c4fa512-08b3-4026-beb7-2f73faab8095 service nova] Creating event network-vif-deleted:53e77978-9454-433c-b790-20e375ca0fee for instance d6b05dbd-88a3-4e6a-9213-dc3facf93388 on nch1-master-1 Oct 08 21:15:32.321660 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-419263f7-f821-44b3-ad72-c8d624878ff0 req-7c4fa512-08b3-4026-beb7-2f73faab8095 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.160800 Oct 08 21:15:32.325608 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2464/4989] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:15:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:15:32.682797 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-d91b9118-a243-4a1d-9cd9-d893038e1e9b tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:15:32.684877 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-d91b9118-a243-4a1d-9cd9-d893038e1e9b tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] [instance: d6b05dbd-88a3-4e6a-9213-dc3facf93388] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:15:32.694756 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d91b9118-a243-4a1d-9cd9-d893038e1e9b tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:15:32.699015 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d91b9118-a243-4a1d-9cd9-d893038e1e9b tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:15:32.702046 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d91b9118-a243-4a1d-9cd9-d893038e1e9b tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:15:32.703207 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d91b9118-a243-4a1d-9cd9-d893038e1e9b tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:15:32.704081 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d91b9118-a243-4a1d-9cd9-d893038e1e9b tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:15:32.704721 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d91b9118-a243-4a1d-9cd9-d893038e1e9b tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:15:32.779598 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d91b9118-a243-4a1d-9cd9-d893038e1e9b tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:15:32.780398 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d91b9118-a243-4a1d-9cd9-d893038e1e9b tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:15:32.783051 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d91b9118-a243-4a1d-9cd9-d893038e1e9b tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:15:32.783807 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.objects.instance [None req-d91b9118-a243-4a1d-9cd9-d893038e1e9b tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lazy-loading 'fault' on Instance uuid d6b05dbd-88a3-4e6a-9213-dc3facf93388 {{(pid=140492) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 21:15:33.009589 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-d91b9118-a243-4a1d-9cd9-d893038e1e9b tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de71b64a2e1c4b6aaa15b5ee75003add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994439815e0416180c95158033ae3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:15:33.019334 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-d91b9118-a243-4a1d-9cd9-d893038e1e9b tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] 10.222.0.26 "GET /compute/v2.1/servers/d6b05dbd-88a3-4e6a-9213-dc3facf93388" status: 200 len: 1308 microversion: 2.1 time: 0.347262 Oct 08 21:15:33.019941 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2526/4990] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:15:32 2022] GET /compute/v2.1/servers/d6b05dbd-88a3-4e6a-9213-dc3facf93388 => generated 1308 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:15:34.045091 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-bf7767f8-c083-4df2-a3db-532fc3e296a9 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:15:34.048105 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-bf7767f8-c083-4df2-a3db-532fc3e296a9 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] [instance: d6b05dbd-88a3-4e6a-9213-dc3facf93388] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:15:34.084190 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bf7767f8-c083-4df2-a3db-532fc3e296a9 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:15:34.084719 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bf7767f8-c083-4df2-a3db-532fc3e296a9 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:15:34.085204 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bf7767f8-c083-4df2-a3db-532fc3e296a9 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:15:34.086117 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bf7767f8-c083-4df2-a3db-532fc3e296a9 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:15:34.086592 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bf7767f8-c083-4df2-a3db-532fc3e296a9 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:15:34.087038 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bf7767f8-c083-4df2-a3db-532fc3e296a9 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:15:34.124371 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-bf7767f8-c083-4df2-a3db-532fc3e296a9 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] HTTP exception thrown: Instance d6b05dbd-88a3-4e6a-9213-dc3facf93388 could not be found. Oct 08 21:15:34.126796 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-bf7767f8-c083-4df2-a3db-532fc3e296a9 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Request method failure captured: Oct 08 21:15:34.126796 ncdv-master-1 devstack@n-api.service[140491]: request: GET /compute/v2.1/servers/d6b05dbd-88a3-4e6a-9213-dc3facf93388 HTTP/1.1 Oct 08 21:15:34.126796 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:15:34.126796 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:15:34.126796 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:15:34.126796 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 21:15:34.126796 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:15:34.126796 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:15:34.126796 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:15:34.126796 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:15:34.126796 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQefhBHZHBHO4VxZHSsyk8d9uDlzW_1-xi2ZFl-ZIZG8h1bMfWVXvVOOR8dOQMkmssgWlx0L6h_5xLjeuCbIAKIJ4XMxm_ZeQ2_R3xWw1VhkcqTH64L8eS-yPy2gpKlQBxDiVPeL42eSoIK1bVrgaaZO1fV61hTfeoKLoiJ2cvnZEiy8 Oct 08 21:15:34.126796 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:15:34.126796 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:15:34.126796 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:15:34.126796 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:15:34.126796 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:15:34.126796 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:15:34.126796 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 7994439815e0416180c95158033ae3f2 Oct 08 21:15:34.126796 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-ServerDiskConfigTestJSON-581980631 Oct 08 21:15:34.126796 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:15:34.126796 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:15:34.126796 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/7994439815e0416180c95158033ae3f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7994439815e0416180c95158033ae3f2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_7994439815e0416180c95158033ae3f2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7994439815e0416180c95158033ae3f2"}]}] Oct 08 21:15:34.126796 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-ServerDiskConfigTestJSON-581980631 Oct 08 21:15:34.126796 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 7994439815e0416180c95158033ae3f2 Oct 08 21:15:34.126796 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-581980631 Oct 08 21:15:34.126796 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-ServerDiskConfigTestJSON-581980631-project Oct 08 21:15:34.126796 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:15:34.126796 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:15:34.126796 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: de71b64a2e1c4b6aaa15b5ee75003add Oct 08 21:15:34.126796 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-ServerDiskConfigTestJSON-581980631-project Oct 08 21:15:34.126796 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:15:34.126796 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance d6b05dbd-88a3-4e6a-9213-dc3facf93388 could not be found. Oct 08 21:15:34.126796 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': 'd6b05dbd-88a3-4e6a-9213-dc3facf93388'} Oct 08 21:15:34.126796 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:15:34.126796 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:15:34.126796 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:15:34.126796 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:15:34.126796 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:15:34.126796 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:15:34.126796 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:15:34.126796 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:15:34.126796 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:15:34.126796 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:15:34.126796 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6b05dbd-88a3-4e6a-9213-dc3facf93388 could not be found. Oct 08 21:15:34.126796 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:15:34.126796 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:15:34.126796 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:15:34.126796 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:15:34.126796 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:15:34.126796 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:15:34.126796 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:15:34.126796 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:15:34.126796 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:15:34.126796 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:15:34.126796 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:15:34.126796 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:15:34.126796 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:15:34.126796 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:15:34.126796 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:15:34.126796 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:15:34.126796 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6b05dbd-88a3-4e6a-9213-dc3facf93388 could not be found. Oct 08 21:15:34.126796 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:15:34.126796 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:15:34.126796 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:15:34.132818 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:15:34.132818 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:15:34.132818 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:15:34.132818 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:15:34.132818 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:15:34.132818 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6b05dbd-88a3-4e6a-9213-dc3facf93388 could not be found. Oct 08 21:15:34.132818 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:15:34.132818 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-bf7767f8-c083-4df2-a3db-532fc3e296a9 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Returning 404 to user: Instance d6b05dbd-88a3-4e6a-9213-dc3facf93388 could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:15:34.132818 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-bf7767f8-c083-4df2-a3db-532fc3e296a9 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] 10.222.0.26 "GET /compute/v2.1/servers/d6b05dbd-88a3-4e6a-9213-dc3facf93388" status: 404 len: 111 microversion: 2.1 time: 0.089051 Oct 08 21:15:34.134588 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2465/4991] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:15:34 2022] GET /compute/v2.1/servers/d6b05dbd-88a3-4e6a-9213-dc3facf93388 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:15:34.137752 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-82f51c8e-dcb8-4eca-9c4a-ae9c2878f373 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:15:34.138477 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-82f51c8e-dcb8-4eca-9c4a-ae9c2878f373 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] [instance: 4e33d129-543f-479f-86bf-4638cb153321] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:15:34.151910 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-82f51c8e-dcb8-4eca-9c4a-ae9c2878f373 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:15:34.156191 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-82f51c8e-dcb8-4eca-9c4a-ae9c2878f373 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:15:34.157360 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-82f51c8e-dcb8-4eca-9c4a-ae9c2878f373 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:15:34.158160 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-82f51c8e-dcb8-4eca-9c4a-ae9c2878f373 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:15:34.165782 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-82f51c8e-dcb8-4eca-9c4a-ae9c2878f373 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:15:34.168490 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-82f51c8e-dcb8-4eca-9c4a-ae9c2878f373 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:15:34.207303 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-82f51c8e-dcb8-4eca-9c4a-ae9c2878f373 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] HTTP exception thrown: Instance 4e33d129-543f-479f-86bf-4638cb153321 could not be found. Oct 08 21:15:34.209122 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-82f51c8e-dcb8-4eca-9c4a-ae9c2878f373 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Request method failure captured: Oct 08 21:15:34.209122 ncdv-master-1 devstack@n-api.service[140492]: request: DELETE /compute/v2.1/servers/4e33d129-543f-479f-86bf-4638cb153321 HTTP/1.1 Oct 08 21:15:34.209122 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:15:34.209122 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:15:34.209122 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:15:34.209122 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 21:15:34.209122 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:15:34.209122 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:15:34.209122 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:15:34.209122 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:15:34.209122 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQefhBHZHBHO4VxZHSsyk8d9uDlzW_1-xi2ZFl-ZIZG8h1bMfWVXvVOOR8dOQMkmssgWlx0L6h_5xLjeuCbIAKIJ4XMxm_ZeQ2_R3xWw1VhkcqTH64L8eS-yPy2gpKlQBxDiVPeL42eSoIK1bVrgaaZO1fV61hTfeoKLoiJ2cvnZEiy8 Oct 08 21:15:34.209122 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:15:34.209122 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:15:34.209122 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:15:34.209122 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:15:34.209122 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:15:34.209122 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:15:34.209122 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 7994439815e0416180c95158033ae3f2 Oct 08 21:15:34.209122 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-ServerDiskConfigTestJSON-581980631 Oct 08 21:15:34.209122 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:15:34.209122 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:15:34.209122 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/7994439815e0416180c95158033ae3f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7994439815e0416180c95158033ae3f2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_7994439815e0416180c95158033ae3f2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7994439815e0416180c95158033ae3f2"}]}] Oct 08 21:15:34.209122 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-ServerDiskConfigTestJSON-581980631 Oct 08 21:15:34.209122 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 7994439815e0416180c95158033ae3f2 Oct 08 21:15:34.209122 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-581980631 Oct 08 21:15:34.209122 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-ServerDiskConfigTestJSON-581980631-project Oct 08 21:15:34.209122 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:15:34.209122 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:15:34.209122 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: de71b64a2e1c4b6aaa15b5ee75003add Oct 08 21:15:34.209122 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-ServerDiskConfigTestJSON-581980631-project Oct 08 21:15:34.209122 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 21:15:34.209122 ncdv-master-1 devstack@n-api.service[140492]: exception: Instance 4e33d129-543f-479f-86bf-4638cb153321 could not be found. Oct 08 21:15:34.209122 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': '4e33d129-543f-479f-86bf-4638cb153321'} Oct 08 21:15:34.209122 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:15:34.209122 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:15:34.209122 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:15:34.209122 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:15:34.209122 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:15:34.209122 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:15:34.209122 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:15:34.209122 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:15:34.209122 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:15:34.209122 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:15:34.209122 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e33d129-543f-479f-86bf-4638cb153321 could not be found. Oct 08 21:15:34.209122 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:15:34.209122 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:15:34.209122 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:15:34.209122 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:15:34.209122 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:15:34.209122 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:15:34.209122 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:15:34.209122 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:15:34.209122 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:15:34.209122 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:15:34.209122 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 08 21:15:34.209122 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 08 21:15:34.209122 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 08 21:15:34.209122 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 08 21:15:34.209122 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:15:34.209122 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:15:34.209122 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:15:34.209122 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:15:34.215101 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e33d129-543f-479f-86bf-4638cb153321 could not be found. Oct 08 21:15:34.215101 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:15:34.215101 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:15:34.215101 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:15:34.215101 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:15:34.215101 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:15:34.215101 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:15:34.215101 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:15:34.215101 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:15:34.215101 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e33d129-543f-479f-86bf-4638cb153321 could not be found. Oct 08 21:15:34.215101 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:15:34.215101 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-82f51c8e-dcb8-4eca-9c4a-ae9c2878f373 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Returning 404 to user: Instance 4e33d129-543f-479f-86bf-4638cb153321 could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:15:34.217775 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-82f51c8e-dcb8-4eca-9c4a-ae9c2878f373 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] 10.222.0.26 "DELETE /compute/v2.1/servers/4e33d129-543f-479f-86bf-4638cb153321" status: 404 len: 111 microversion: 2.1 time: 0.083226 Oct 08 21:15:34.218580 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2527/4992] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:15:34 2022] DELETE /compute/v2.1/servers/4e33d129-543f-479f-86bf-4638cb153321 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:15:34.227968 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-ecb6973e-eb01-4f11-8249-a4a4c4295b15 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:15:34.228218 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-ecb6973e-eb01-4f11-8249-a4a4c4295b15 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] [instance: 4e33d129-543f-479f-86bf-4638cb153321] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:15:34.239376 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ecb6973e-eb01-4f11-8249-a4a4c4295b15 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:15:34.240018 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ecb6973e-eb01-4f11-8249-a4a4c4295b15 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:15:34.242754 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ecb6973e-eb01-4f11-8249-a4a4c4295b15 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:15:34.243775 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ecb6973e-eb01-4f11-8249-a4a4c4295b15 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:15:34.244110 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ecb6973e-eb01-4f11-8249-a4a4c4295b15 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:15:34.244570 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ecb6973e-eb01-4f11-8249-a4a4c4295b15 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:15:34.277661 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-ecb6973e-eb01-4f11-8249-a4a4c4295b15 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] HTTP exception thrown: Instance 4e33d129-543f-479f-86bf-4638cb153321 could not be found. Oct 08 21:15:34.283569 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-ecb6973e-eb01-4f11-8249-a4a4c4295b15 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Request method failure captured: Oct 08 21:15:34.283569 ncdv-master-1 devstack@n-api.service[140491]: request: GET /compute/v2.1/servers/4e33d129-543f-479f-86bf-4638cb153321 HTTP/1.1 Oct 08 21:15:34.283569 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:15:34.283569 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:15:34.283569 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:15:34.283569 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 21:15:34.283569 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:15:34.283569 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:15:34.283569 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:15:34.283569 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:15:34.283569 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQefhBHZHBHO4VxZHSsyk8d9uDlzW_1-xi2ZFl-ZIZG8h1bMfWVXvVOOR8dOQMkmssgWlx0L6h_5xLjeuCbIAKIJ4XMxm_ZeQ2_R3xWw1VhkcqTH64L8eS-yPy2gpKlQBxDiVPeL42eSoIK1bVrgaaZO1fV61hTfeoKLoiJ2cvnZEiy8 Oct 08 21:15:34.283569 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:15:34.283569 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:15:34.283569 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:15:34.283569 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:15:34.283569 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:15:34.283569 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:15:34.283569 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 7994439815e0416180c95158033ae3f2 Oct 08 21:15:34.283569 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-ServerDiskConfigTestJSON-581980631 Oct 08 21:15:34.283569 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:15:34.283569 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:15:34.283569 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/7994439815e0416180c95158033ae3f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7994439815e0416180c95158033ae3f2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_7994439815e0416180c95158033ae3f2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7994439815e0416180c95158033ae3f2"}]}] Oct 08 21:15:34.283569 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-ServerDiskConfigTestJSON-581980631 Oct 08 21:15:34.283569 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 7994439815e0416180c95158033ae3f2 Oct 08 21:15:34.283569 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-581980631 Oct 08 21:15:34.283569 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-ServerDiskConfigTestJSON-581980631-project Oct 08 21:15:34.283569 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:15:34.283569 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:15:34.283569 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: de71b64a2e1c4b6aaa15b5ee75003add Oct 08 21:15:34.283569 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-ServerDiskConfigTestJSON-581980631-project Oct 08 21:15:34.283569 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:15:34.283569 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance 4e33d129-543f-479f-86bf-4638cb153321 could not be found. Oct 08 21:15:34.283569 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': '4e33d129-543f-479f-86bf-4638cb153321'} Oct 08 21:15:34.283569 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:15:34.283569 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:15:34.283569 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:15:34.283569 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:15:34.283569 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:15:34.283569 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:15:34.283569 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:15:34.283569 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:15:34.283569 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:15:34.283569 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:15:34.283569 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e33d129-543f-479f-86bf-4638cb153321 could not be found. Oct 08 21:15:34.283569 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:15:34.283569 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:15:34.283569 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:15:34.283569 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:15:34.283569 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:15:34.283569 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:15:34.283569 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:15:34.283569 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:15:34.283569 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:15:34.283569 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:15:34.283569 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:15:34.283569 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:15:34.283569 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:15:34.283569 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:15:34.283569 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:15:34.283569 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:15:34.283569 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e33d129-543f-479f-86bf-4638cb153321 could not be found. Oct 08 21:15:34.283569 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:15:34.283569 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:15:34.283569 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:15:34.289220 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:15:34.289220 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:15:34.289220 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:15:34.289220 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:15:34.289220 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:15:34.289220 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e33d129-543f-479f-86bf-4638cb153321 could not be found. Oct 08 21:15:34.289220 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:15:34.289220 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-ecb6973e-eb01-4f11-8249-a4a4c4295b15 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Returning 404 to user: Instance 4e33d129-543f-479f-86bf-4638cb153321 could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:15:34.289220 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-ecb6973e-eb01-4f11-8249-a4a4c4295b15 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] 10.222.0.26 "GET /compute/v2.1/servers/4e33d129-543f-479f-86bf-4638cb153321" status: 404 len: 111 microversion: 2.1 time: 0.062696 Oct 08 21:15:34.289220 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2466/4993] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:15:34 2022] GET /compute/v2.1/servers/4e33d129-543f-479f-86bf-4638cb153321 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:15:34.297640 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-8c4301ac-c50a-4546-bb7f-84c37551cce3 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:15:34.298187 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-8c4301ac-c50a-4546-bb7f-84c37551cce3 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] [instance: 64039cd8-bbfa-4797-9e3c-acf4715c67a4] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:15:34.307100 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8c4301ac-c50a-4546-bb7f-84c37551cce3 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:15:34.307644 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8c4301ac-c50a-4546-bb7f-84c37551cce3 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:15:34.308074 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8c4301ac-c50a-4546-bb7f-84c37551cce3 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:15:34.308815 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8c4301ac-c50a-4546-bb7f-84c37551cce3 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:15:34.311253 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8c4301ac-c50a-4546-bb7f-84c37551cce3 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:15:34.315090 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8c4301ac-c50a-4546-bb7f-84c37551cce3 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:15:34.349935 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-8c4301ac-c50a-4546-bb7f-84c37551cce3 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] HTTP exception thrown: Instance 64039cd8-bbfa-4797-9e3c-acf4715c67a4 could not be found. Oct 08 21:15:34.351785 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-8c4301ac-c50a-4546-bb7f-84c37551cce3 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Request method failure captured: Oct 08 21:15:34.351785 ncdv-master-1 devstack@n-api.service[140492]: request: DELETE /compute/v2.1/servers/64039cd8-bbfa-4797-9e3c-acf4715c67a4 HTTP/1.1 Oct 08 21:15:34.351785 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:15:34.351785 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:15:34.351785 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:15:34.351785 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 21:15:34.351785 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:15:34.351785 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:15:34.351785 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:15:34.351785 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:15:34.351785 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQefhBHZHBHO4VxZHSsyk8d9uDlzW_1-xi2ZFl-ZIZG8h1bMfWVXvVOOR8dOQMkmssgWlx0L6h_5xLjeuCbIAKIJ4XMxm_ZeQ2_R3xWw1VhkcqTH64L8eS-yPy2gpKlQBxDiVPeL42eSoIK1bVrgaaZO1fV61hTfeoKLoiJ2cvnZEiy8 Oct 08 21:15:34.351785 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:15:34.351785 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:15:34.351785 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:15:34.351785 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:15:34.351785 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:15:34.351785 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:15:34.351785 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 7994439815e0416180c95158033ae3f2 Oct 08 21:15:34.351785 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-ServerDiskConfigTestJSON-581980631 Oct 08 21:15:34.351785 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:15:34.351785 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:15:34.351785 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/7994439815e0416180c95158033ae3f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7994439815e0416180c95158033ae3f2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_7994439815e0416180c95158033ae3f2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7994439815e0416180c95158033ae3f2"}]}] Oct 08 21:15:34.351785 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-ServerDiskConfigTestJSON-581980631 Oct 08 21:15:34.351785 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 7994439815e0416180c95158033ae3f2 Oct 08 21:15:34.351785 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-581980631 Oct 08 21:15:34.351785 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-ServerDiskConfigTestJSON-581980631-project Oct 08 21:15:34.351785 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:15:34.351785 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:15:34.351785 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: de71b64a2e1c4b6aaa15b5ee75003add Oct 08 21:15:34.351785 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-ServerDiskConfigTestJSON-581980631-project Oct 08 21:15:34.351785 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 21:15:34.351785 ncdv-master-1 devstack@n-api.service[140492]: exception: Instance 64039cd8-bbfa-4797-9e3c-acf4715c67a4 could not be found. Oct 08 21:15:34.351785 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': '64039cd8-bbfa-4797-9e3c-acf4715c67a4'} Oct 08 21:15:34.351785 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:15:34.351785 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:15:34.351785 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:15:34.351785 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:15:34.351785 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:15:34.351785 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:15:34.351785 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:15:34.351785 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:15:34.351785 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:15:34.351785 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:15:34.351785 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64039cd8-bbfa-4797-9e3c-acf4715c67a4 could not be found. Oct 08 21:15:34.351785 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:15:34.351785 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:15:34.351785 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:15:34.351785 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:15:34.351785 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:15:34.351785 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:15:34.351785 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:15:34.351785 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:15:34.351785 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:15:34.351785 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:15:34.351785 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 08 21:15:34.351785 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 08 21:15:34.351785 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 08 21:15:34.351785 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 08 21:15:34.351785 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:15:34.351785 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:15:34.351785 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:15:34.351785 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:15:34.357584 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64039cd8-bbfa-4797-9e3c-acf4715c67a4 could not be found. Oct 08 21:15:34.357584 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:15:34.357584 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:15:34.357584 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:15:34.357584 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:15:34.357584 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:15:34.357584 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:15:34.357584 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:15:34.357584 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:15:34.357584 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64039cd8-bbfa-4797-9e3c-acf4715c67a4 could not be found. Oct 08 21:15:34.357584 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:15:34.358774 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-8c4301ac-c50a-4546-bb7f-84c37551cce3 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Returning 404 to user: Instance 64039cd8-bbfa-4797-9e3c-acf4715c67a4 could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:15:34.359686 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-8c4301ac-c50a-4546-bb7f-84c37551cce3 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] 10.222.0.26 "DELETE /compute/v2.1/servers/64039cd8-bbfa-4797-9e3c-acf4715c67a4" status: 404 len: 111 microversion: 2.1 time: 0.066375 Oct 08 21:15:34.362544 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2528/4994] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:15:34 2022] DELETE /compute/v2.1/servers/64039cd8-bbfa-4797-9e3c-acf4715c67a4 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:15:34.370851 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-8b4ca4a6-2bc4-44f3-8f74-52e82c7ba167 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:15:34.371689 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-8b4ca4a6-2bc4-44f3-8f74-52e82c7ba167 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] [instance: 64039cd8-bbfa-4797-9e3c-acf4715c67a4] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:15:34.388383 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8b4ca4a6-2bc4-44f3-8f74-52e82c7ba167 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:15:34.392384 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8b4ca4a6-2bc4-44f3-8f74-52e82c7ba167 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:15:34.394152 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8b4ca4a6-2bc4-44f3-8f74-52e82c7ba167 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:15:34.396185 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8b4ca4a6-2bc4-44f3-8f74-52e82c7ba167 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:15:34.398004 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8b4ca4a6-2bc4-44f3-8f74-52e82c7ba167 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:15:34.398892 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8b4ca4a6-2bc4-44f3-8f74-52e82c7ba167 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:15:34.450518 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-8b4ca4a6-2bc4-44f3-8f74-52e82c7ba167 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] HTTP exception thrown: Instance 64039cd8-bbfa-4797-9e3c-acf4715c67a4 could not be found. Oct 08 21:15:34.457225 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-8b4ca4a6-2bc4-44f3-8f74-52e82c7ba167 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Request method failure captured: Oct 08 21:15:34.457225 ncdv-master-1 devstack@n-api.service[140491]: request: GET /compute/v2.1/servers/64039cd8-bbfa-4797-9e3c-acf4715c67a4 HTTP/1.1 Oct 08 21:15:34.457225 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:15:34.457225 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:15:34.457225 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:15:34.457225 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 21:15:34.457225 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:15:34.457225 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:15:34.457225 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:15:34.457225 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:15:34.457225 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQefhBHZHBHO4VxZHSsyk8d9uDlzW_1-xi2ZFl-ZIZG8h1bMfWVXvVOOR8dOQMkmssgWlx0L6h_5xLjeuCbIAKIJ4XMxm_ZeQ2_R3xWw1VhkcqTH64L8eS-yPy2gpKlQBxDiVPeL42eSoIK1bVrgaaZO1fV61hTfeoKLoiJ2cvnZEiy8 Oct 08 21:15:34.457225 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:15:34.457225 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:15:34.457225 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:15:34.457225 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:15:34.457225 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:15:34.457225 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:15:34.457225 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 7994439815e0416180c95158033ae3f2 Oct 08 21:15:34.457225 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-ServerDiskConfigTestJSON-581980631 Oct 08 21:15:34.457225 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:15:34.457225 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:15:34.457225 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/7994439815e0416180c95158033ae3f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7994439815e0416180c95158033ae3f2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_7994439815e0416180c95158033ae3f2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7994439815e0416180c95158033ae3f2"}]}] Oct 08 21:15:34.457225 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-ServerDiskConfigTestJSON-581980631 Oct 08 21:15:34.457225 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 7994439815e0416180c95158033ae3f2 Oct 08 21:15:34.457225 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-581980631 Oct 08 21:15:34.457225 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-ServerDiskConfigTestJSON-581980631-project Oct 08 21:15:34.457225 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:15:34.457225 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:15:34.457225 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: de71b64a2e1c4b6aaa15b5ee75003add Oct 08 21:15:34.457225 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-ServerDiskConfigTestJSON-581980631-project Oct 08 21:15:34.457225 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:15:34.457225 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance 64039cd8-bbfa-4797-9e3c-acf4715c67a4 could not be found. Oct 08 21:15:34.457225 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': '64039cd8-bbfa-4797-9e3c-acf4715c67a4'} Oct 08 21:15:34.457225 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:15:34.457225 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:15:34.457225 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:15:34.457225 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:15:34.457225 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:15:34.457225 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:15:34.457225 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:15:34.457225 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:15:34.457225 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:15:34.457225 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:15:34.457225 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64039cd8-bbfa-4797-9e3c-acf4715c67a4 could not be found. Oct 08 21:15:34.457225 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:15:34.457225 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:15:34.457225 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:15:34.457225 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:15:34.457225 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:15:34.457225 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:15:34.457225 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:15:34.457225 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:15:34.457225 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:15:34.457225 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:15:34.457225 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:15:34.457225 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:15:34.457225 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:15:34.457225 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:15:34.457225 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:15:34.457225 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:15:34.457225 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64039cd8-bbfa-4797-9e3c-acf4715c67a4 could not be found. Oct 08 21:15:34.457225 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:15:34.457225 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:15:34.457225 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:15:34.461929 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:15:34.461929 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:15:34.461929 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:15:34.461929 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:15:34.461929 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:15:34.461929 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64039cd8-bbfa-4797-9e3c-acf4715c67a4 could not be found. Oct 08 21:15:34.461929 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:15:34.461929 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-8b4ca4a6-2bc4-44f3-8f74-52e82c7ba167 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] Returning 404 to user: Instance 64039cd8-bbfa-4797-9e3c-acf4715c67a4 could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:15:34.461929 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-8b4ca4a6-2bc4-44f3-8f74-52e82c7ba167 tempest-ServerDiskConfigTestJSON-581980631 tempest-ServerDiskConfigTestJSON-581980631-project] 10.222.0.26 "GET /compute/v2.1/servers/64039cd8-bbfa-4797-9e3c-acf4715c67a4" status: 404 len: 111 microversion: 2.1 time: 0.094184 Oct 08 21:15:34.470985 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2467/4995] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:15:34 2022] GET /compute/v2.1/servers/64039cd8-bbfa-4797-9e3c-acf4715c67a4 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:15:43.017820 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-edfdde61-6fde-458d-a1f0-52c415e530d4 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:15:43.019250 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-edfdde61-6fde-458d-a1f0-52c415e530d4 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] [instance: aadddbb1-e053-420e-afd2-9412c6137504] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:15:43.030213 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-edfdde61-6fde-458d-a1f0-52c415e530d4 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:15:43.034686 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-edfdde61-6fde-458d-a1f0-52c415e530d4 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:15:43.034686 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-edfdde61-6fde-458d-a1f0-52c415e530d4 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:15:43.034988 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-edfdde61-6fde-458d-a1f0-52c415e530d4 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:15:43.035630 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-edfdde61-6fde-458d-a1f0-52c415e530d4 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:15:43.038390 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-edfdde61-6fde-458d-a1f0-52c415e530d4 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:15:43.094361 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-edfdde61-6fde-458d-a1f0-52c415e530d4 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] 10.222.0.26 "GET /compute/v2.1/servers/aadddbb1-e053-420e-afd2-9412c6137504/ips" status: 200 len: 150 microversion: 2.1 time: 0.080917 Oct 08 21:15:43.107914 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2529/4996] 10.222.0.26 () {58 vars in 1248 bytes} [Sat Oct 8 21:15:43 2022] GET /compute/v2.1/servers/aadddbb1-e053-420e-afd2-9412c6137504/ips => generated 150 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:15:44.894580 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-91d45c9f-1da8-4b88-804e-8adab470c4d2 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "71c4c902-18fd-4291-83f7-50d37cc1baef"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:15:44.897120 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-91d45c9f-1da8-4b88-804e-8adab470c4d2 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] [instance: aadddbb1-e053-420e-afd2-9412c6137504] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:15:44.902700 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:15:44.905322 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:15:44.914827 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-91d45c9f-1da8-4b88-804e-8adab470c4d2 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:15:44.915820 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-91d45c9f-1da8-4b88-804e-8adab470c4d2 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:15:44.916555 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-91d45c9f-1da8-4b88-804e-8adab470c4d2 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:15:44.917695 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-91d45c9f-1da8-4b88-804e-8adab470c4d2 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:15:44.918407 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-91d45c9f-1da8-4b88-804e-8adab470c4d2 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:15:44.919122 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-91d45c9f-1da8-4b88-804e-8adab470c4d2 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:15:45.299401 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-91d45c9f-1da8-4b88-804e-8adab470c4d2 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] 10.222.0.26 "POST /compute/v2.1/servers/aadddbb1-e053-420e-afd2-9412c6137504/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.409026 Oct 08 21:15:45.300803 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2468/4997] 10.222.0.26 () {60 vars in 1323 bytes} [Sat Oct 8 21:15:44 2022] POST /compute/v2.1/servers/aadddbb1-e053-420e-afd2-9412c6137504/os-volume_attachments => generated 194 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:15:50.209480 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-7dd72b3d-3a13-49f2-bfce-a87822c4aa01 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Action: 'create', calling method: .version_select at 0x7f1a8c1bce50>, body: {"keypair": {"name": "tempest-keypair-1761368687", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPrbG1t3WgzsVEbv/VRhhpZef0EKjGgCPt/PvJZHE5xKw8GpoYV3rMeVs+hPsq42lb2ljwkGhzn0B7wODNRvwm3NZoXVNY0wyC9Tjgwhpm7ehqxYOJraM/UwTnVeysQTaQ=="}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:15:50.264264 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-7dd72b3d-3a13-49f2-bfce-a87822c4aa01 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Getting quotas for project 3d9d29b90ab34abbadd21edbca637d2e. Resources: {'key_pairs'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:15:50.281367 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-7dd72b3d-3a13-49f2-bfce-a87822c4aa01 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Getting quotas for user 8957041987c8487099f0d89f4c64af66 and project 3d9d29b90ab34abbadd21edbca637d2e. Resources: {'key_pairs'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:15:50.319998 ncdv-master-1 devstack@n-api.service[140492]: ERROR oslo.messaging._drivers.impl_rabbit [None req-7dd72b3d-3a13-49f2-bfce-a87822c4aa01 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] [5fcdee35-d871-45f0-9c1c-8af37a842be3] AMQP server on 10.222.0.26:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 08 21:15:51.330184 ncdv-master-1 devstack@n-api.service[140492]: INFO oslo.messaging._drivers.impl_rabbit [None req-7dd72b3d-3a13-49f2-bfce-a87822c4aa01 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] [5fcdee35-d871-45f0-9c1c-8af37a842be3] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 39660. Oct 08 21:15:51.355633 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-7dd72b3d-3a13-49f2-bfce-a87822c4aa01 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.155432 Oct 08 21:15:51.358109 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2530/4998] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Oct 8 21:15:50 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:15:58.774835 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-fdeface1-92ea-4709-96a5-3a634bd76b44 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-199221467", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3bac7a36-9cfd-41c8-b181-a7db0bd13b90"}], "security_groups": [{"name": "tempest-securitygroup--2093282205"}], "key_name": "tempest-keypair-1761368687", "user_data": "}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:15:58.832430 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:SELECT=2 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:15:58.833900 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:15:59.045999 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.network.neutron [None req-fdeface1-92ea-4709-96a5-3a634bd76b44 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] validate_networks() for [('3bac7a36-9cfd-41c8-b181-a7db0bd13b90', None, None, None, None, None)] {{(pid=140491) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 21:16:01.976161 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-fdeface1-92ea-4709-96a5-3a634bd76b44 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Flavor limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 21:16:01.977338 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-fdeface1-92ea-4709-96a5-3a634bd76b44 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Image limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 21:16:01.978003 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-fdeface1-92ea-4709-96a5-3a634bd76b44 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Flavor pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 21:16:01.978616 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-fdeface1-92ea-4709-96a5-3a634bd76b44 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Image pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 21:16:01.979220 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-fdeface1-92ea-4709-96a5-3a634bd76b44 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 21:16:01.996025 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fdeface1-92ea-4709-96a5-3a634bd76b44 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:16:01.999519 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fdeface1-92ea-4709-96a5-3a634bd76b44 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:16:02.000758 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fdeface1-92ea-4709-96a5-3a634bd76b44 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:16:02.004330 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fdeface1-92ea-4709-96a5-3a634bd76b44 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:16:02.005120 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fdeface1-92ea-4709-96a5-3a634bd76b44 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:16:02.005838 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fdeface1-92ea-4709-96a5-3a634bd76b44 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:16:02.052413 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-fdeface1-92ea-4709-96a5-3a634bd76b44 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Getting quotas for project 3d9d29b90ab34abbadd21edbca637d2e. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:16:02.068090 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-fdeface1-92ea-4709-96a5-3a634bd76b44 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Getting quotas for user 8957041987c8487099f0d89f4c64af66 and project 3d9d29b90ab34abbadd21edbca637d2e. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:16:02.095335 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-fdeface1-92ea-4709-96a5-3a634bd76b44 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Going to run 1 instances... {{(pid=140491) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 21:16:02.102426 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-fdeface1-92ea-4709-96a5-3a634bd76b44 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] [instance: bbd1c1d7-13a9-4c6f-b651-c1017efd922e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c508bd7f-7db9-4b2c-af7c-be54a855c355',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140491) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 21:16:02.222709 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-fdeface1-92ea-4709-96a5-3a634bd76b44 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.459585 Oct 08 21:16:02.223661 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2469/4999] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 21:15:58 2022] POST /compute/v2.1/servers => generated 402 bytes in 3461 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 08 21:16:02.234168 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=2 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:16:02.235895 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=4 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:16:02.236893 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=1 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:16:02.245112 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-4b2596c5-7196-4292-93f0-33fab4097db1 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:16:02.246392 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-4b2596c5-7196-4292-93f0-33fab4097db1 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] [instance: bbd1c1d7-13a9-4c6f-b651-c1017efd922e] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:16:02.560353 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-4b2596c5-7196-4292-93f0-33fab4097db1 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8957041987c8487099f0d89f4c64af66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9d29b90ab34abbadd21edbca637d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:16:02.600599 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-4b2596c5-7196-4292-93f0-33fab4097db1 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] 10.222.0.26 "GET /compute/v2.1/servers/bbd1c1d7-13a9-4c6f-b651-c1017efd922e" status: 200 len: 1241 microversion: 2.1 time: 0.368736 Oct 08 21:16:02.605230 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2531/5000] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:16:02 2022] GET /compute/v2.1/servers/bbd1c1d7-13a9-4c6f-b651-c1017efd922e => generated 1241 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:16:03.633904 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-b99e4614-6b47-41bf-912c-b7d071fe7370 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:16:03.634774 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-b99e4614-6b47-41bf-912c-b7d071fe7370 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] [instance: bbd1c1d7-13a9-4c6f-b651-c1017efd922e] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:16:03.662526 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b99e4614-6b47-41bf-912c-b7d071fe7370 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:16:03.663393 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b99e4614-6b47-41bf-912c-b7d071fe7370 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:16:03.664090 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b99e4614-6b47-41bf-912c-b7d071fe7370 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:16:03.665120 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b99e4614-6b47-41bf-912c-b7d071fe7370 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:16:03.672701 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b99e4614-6b47-41bf-912c-b7d071fe7370 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:16:03.673625 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b99e4614-6b47-41bf-912c-b7d071fe7370 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:16:03.962956 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-b99e4614-6b47-41bf-912c-b7d071fe7370 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8957041987c8487099f0d89f4c64af66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9d29b90ab34abbadd21edbca637d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:16:03.973473 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-b99e4614-6b47-41bf-912c-b7d071fe7370 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] 10.222.0.26 "GET /compute/v2.1/servers/bbd1c1d7-13a9-4c6f-b651-c1017efd922e" status: 200 len: 1293 microversion: 2.1 time: 0.344989 Oct 08 21:16:03.985824 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2470/5001] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:16:03 2022] GET /compute/v2.1/servers/bbd1c1d7-13a9-4c6f-b651-c1017efd922e => generated 1293 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:16:05.002395 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-3a5a0c51-fc99-45d7-ae5a-0a59a8c1166e tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:16:05.003042 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-3a5a0c51-fc99-45d7-ae5a-0a59a8c1166e tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] [instance: bbd1c1d7-13a9-4c6f-b651-c1017efd922e] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:16:05.018366 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3a5a0c51-fc99-45d7-ae5a-0a59a8c1166e tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:16:05.022050 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3a5a0c51-fc99-45d7-ae5a-0a59a8c1166e tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:16:05.024046 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3a5a0c51-fc99-45d7-ae5a-0a59a8c1166e tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:16:05.036678 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3a5a0c51-fc99-45d7-ae5a-0a59a8c1166e tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:16:05.038195 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3a5a0c51-fc99-45d7-ae5a-0a59a8c1166e tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:16:05.039041 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3a5a0c51-fc99-45d7-ae5a-0a59a8c1166e tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:16:05.423228 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-3a5a0c51-fc99-45d7-ae5a-0a59a8c1166e tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8957041987c8487099f0d89f4c64af66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9d29b90ab34abbadd21edbca637d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:16:05.458125 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-3a5a0c51-fc99-45d7-ae5a-0a59a8c1166e tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] 10.222.0.26 "GET /compute/v2.1/servers/bbd1c1d7-13a9-4c6f-b651-c1017efd922e" status: 200 len: 1299 microversion: 2.1 time: 0.461541 Oct 08 21:16:05.459948 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2532/5002] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:16:04 2022] GET /compute/v2.1/servers/bbd1c1d7-13a9-4c6f-b651-c1017efd922e => generated 1299 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:16:06.494053 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-50c7d9ef-ae9e-4e88-a6d5-c2991a907c91 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:16:06.494685 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-50c7d9ef-ae9e-4e88-a6d5-c2991a907c91 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] [instance: bbd1c1d7-13a9-4c6f-b651-c1017efd922e] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:16:06.534817 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-50c7d9ef-ae9e-4e88-a6d5-c2991a907c91 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:16:06.535429 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-50c7d9ef-ae9e-4e88-a6d5-c2991a907c91 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:16:06.535907 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-50c7d9ef-ae9e-4e88-a6d5-c2991a907c91 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:16:06.536692 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-50c7d9ef-ae9e-4e88-a6d5-c2991a907c91 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:16:06.537157 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-50c7d9ef-ae9e-4e88-a6d5-c2991a907c91 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:16:06.537693 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-50c7d9ef-ae9e-4e88-a6d5-c2991a907c91 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:16:06.854042 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-50c7d9ef-ae9e-4e88-a6d5-c2991a907c91 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8957041987c8487099f0d89f4c64af66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9d29b90ab34abbadd21edbca637d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:16:06.866808 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-50c7d9ef-ae9e-4e88-a6d5-c2991a907c91 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] 10.222.0.26 "GET /compute/v2.1/servers/bbd1c1d7-13a9-4c6f-b651-c1017efd922e" status: 200 len: 1299 microversion: 2.1 time: 0.383719 Oct 08 21:16:06.889933 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2471/5003] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:16:06 2022] GET /compute/v2.1/servers/bbd1c1d7-13a9-4c6f-b651-c1017efd922e => generated 1299 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:16:07.894242 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-19086a19-5944-45ea-8ff9-c4adcd22cd52 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:16:07.895038 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-19086a19-5944-45ea-8ff9-c4adcd22cd52 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] [instance: bbd1c1d7-13a9-4c6f-b651-c1017efd922e] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:16:07.904445 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-19086a19-5944-45ea-8ff9-c4adcd22cd52 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:16:07.909839 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-19086a19-5944-45ea-8ff9-c4adcd22cd52 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:16:07.914438 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-19086a19-5944-45ea-8ff9-c4adcd22cd52 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:16:07.915465 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-19086a19-5944-45ea-8ff9-c4adcd22cd52 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:16:07.916196 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-19086a19-5944-45ea-8ff9-c4adcd22cd52 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:16:07.916700 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-19086a19-5944-45ea-8ff9-c4adcd22cd52 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:16:08.445828 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-19086a19-5944-45ea-8ff9-c4adcd22cd52 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8957041987c8487099f0d89f4c64af66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9d29b90ab34abbadd21edbca637d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:16:08.461051 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-19086a19-5944-45ea-8ff9-c4adcd22cd52 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] 10.222.0.26 "GET /compute/v2.1/servers/bbd1c1d7-13a9-4c6f-b651-c1017efd922e" status: 200 len: 1299 microversion: 2.1 time: 0.571042 Oct 08 21:16:08.463418 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2533/5004] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:16:07 2022] GET /compute/v2.1/servers/bbd1c1d7-13a9-4c6f-b651-c1017efd922e => generated 1299 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:16:09.490139 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-2cc0c181-48fe-491d-902c-ed9ce0e225a3 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:16:09.492353 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-2cc0c181-48fe-491d-902c-ed9ce0e225a3 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] [instance: bbd1c1d7-13a9-4c6f-b651-c1017efd922e] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:16:09.507970 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2cc0c181-48fe-491d-902c-ed9ce0e225a3 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:16:09.509783 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2cc0c181-48fe-491d-902c-ed9ce0e225a3 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:16:09.511422 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2cc0c181-48fe-491d-902c-ed9ce0e225a3 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:16:09.516247 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2cc0c181-48fe-491d-902c-ed9ce0e225a3 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:16:09.517586 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2cc0c181-48fe-491d-902c-ed9ce0e225a3 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:16:09.518345 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2cc0c181-48fe-491d-902c-ed9ce0e225a3 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:16:09.851435 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-2cc0c181-48fe-491d-902c-ed9ce0e225a3 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8957041987c8487099f0d89f4c64af66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9d29b90ab34abbadd21edbca637d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:16:09.862037 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-2cc0c181-48fe-491d-902c-ed9ce0e225a3 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] 10.222.0.26 "GET /compute/v2.1/servers/bbd1c1d7-13a9-4c6f-b651-c1017efd922e" status: 200 len: 1367 microversion: 2.1 time: 0.379338 Oct 08 21:16:09.879559 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2472/5005] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:16:09 2022] GET /compute/v2.1/servers/bbd1c1d7-13a9-4c6f-b651-c1017efd922e => generated 1367 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:16:10.889605 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-b5e79a58-7579-4ac5-881b-ecd0fe34dab6 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:16:10.890234 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-b5e79a58-7579-4ac5-881b-ecd0fe34dab6 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] [instance: bbd1c1d7-13a9-4c6f-b651-c1017efd922e] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:16:10.909582 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b5e79a58-7579-4ac5-881b-ecd0fe34dab6 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:16:10.910486 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b5e79a58-7579-4ac5-881b-ecd0fe34dab6 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:16:10.911157 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b5e79a58-7579-4ac5-881b-ecd0fe34dab6 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:16:10.912108 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b5e79a58-7579-4ac5-881b-ecd0fe34dab6 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:16:10.912798 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b5e79a58-7579-4ac5-881b-ecd0fe34dab6 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:16:10.913485 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b5e79a58-7579-4ac5-881b-ecd0fe34dab6 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:16:12.084685 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-b5e79a58-7579-4ac5-881b-ecd0fe34dab6 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8957041987c8487099f0d89f4c64af66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9d29b90ab34abbadd21edbca637d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:16:12.093035 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-b5e79a58-7579-4ac5-881b-ecd0fe34dab6 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] 10.222.0.26 "GET /compute/v2.1/servers/bbd1c1d7-13a9-4c6f-b651-c1017efd922e" status: 200 len: 1367 microversion: 2.1 time: 1.207305 Oct 08 21:16:12.093724 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2534/5006] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:16:10 2022] GET /compute/v2.1/servers/bbd1c1d7-13a9-4c6f-b651-c1017efd922e => generated 1367 bytes in 1209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:16:12.938559 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=2 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:16:12.939970 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=6 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:16:13.117041 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e080011a-381a-48e1-898e-b2a262702b65 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:16:13.118089 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-e080011a-381a-48e1-898e-b2a262702b65 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] [instance: bbd1c1d7-13a9-4c6f-b651-c1017efd922e] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:16:13.120066 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=2 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:16:13.135007 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e080011a-381a-48e1-898e-b2a262702b65 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:16:13.136784 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e080011a-381a-48e1-898e-b2a262702b65 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:16:13.137390 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e080011a-381a-48e1-898e-b2a262702b65 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:16:13.139428 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e080011a-381a-48e1-898e-b2a262702b65 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:16:13.141980 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e080011a-381a-48e1-898e-b2a262702b65 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:16:13.142704 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e080011a-381a-48e1-898e-b2a262702b65 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:16:13.164765 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-fd4cbeb1-e279-4226-8c9b-2a7fb4a66e16 tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-613265224", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "networks": [{"uuid": "603e9315-7ed8-41bc-9564-2b90b0e77d7b"}]}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:16:13.276988 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.network.neutron [None req-fd4cbeb1-e279-4226-8c9b-2a7fb4a66e16 tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] validate_networks() for [('603e9315-7ed8-41bc-9564-2b90b0e77d7b', None, None, None, None, None)] {{(pid=140491) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 21:16:13.939520 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-e080011a-381a-48e1-898e-b2a262702b65 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8957041987c8487099f0d89f4c64af66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9d29b90ab34abbadd21edbca637d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:16:13.958195 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-e080011a-381a-48e1-898e-b2a262702b65 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] 10.222.0.26 "GET /compute/v2.1/servers/bbd1c1d7-13a9-4c6f-b651-c1017efd922e" status: 200 len: 1367 microversion: 2.1 time: 0.845092 Oct 08 21:16:13.986283 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2535/5007] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:16:13 2022] GET /compute/v2.1/servers/bbd1c1d7-13a9-4c6f-b651-c1017efd922e => generated 1367 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:16:14.004411 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-4a276f9e-3482-43bc-8ab2-31777f3a7b47 req-960575dd-62bb-4dd5-9eca-9ac234e14d0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbd1c1d7-13a9-4c6f-b651-c1017efd922e", "tag": "970d0412-0e67-4602-ab4e-c38b70f22b0a"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:16:14.034612 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-4a276f9e-3482-43bc-8ab2-31777f3a7b47 req-960575dd-62bb-4dd5-9eca-9ac234e14d0f service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:16:14.036373 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-4a276f9e-3482-43bc-8ab2-31777f3a7b47 req-960575dd-62bb-4dd5-9eca-9ac234e14d0f service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:16:14.037011 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-4a276f9e-3482-43bc-8ab2-31777f3a7b47 req-960575dd-62bb-4dd5-9eca-9ac234e14d0f service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:16:14.054953 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-4a276f9e-3482-43bc-8ab2-31777f3a7b47 req-960575dd-62bb-4dd5-9eca-9ac234e14d0f service nova] Creating event network-changed:970d0412-0e67-4602-ab4e-c38b70f22b0a for instance bbd1c1d7-13a9-4c6f-b651-c1017efd922e on nch2-master-1 Oct 08 21:16:14.072297 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-4a276f9e-3482-43bc-8ab2-31777f3a7b47 req-960575dd-62bb-4dd5-9eca-9ac234e14d0f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082168 Oct 08 21:16:14.073528 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2536/5008] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:16:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:16:14.994152 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-993e970b-835d-4cc3-96d3-1040ef08ac2e tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:16:14.995606 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-993e970b-835d-4cc3-96d3-1040ef08ac2e tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] [instance: bbd1c1d7-13a9-4c6f-b651-c1017efd922e] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:16:15.013229 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-993e970b-835d-4cc3-96d3-1040ef08ac2e tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:16:15.013782 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-993e970b-835d-4cc3-96d3-1040ef08ac2e tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:16:15.014244 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-993e970b-835d-4cc3-96d3-1040ef08ac2e tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:16:15.023184 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-993e970b-835d-4cc3-96d3-1040ef08ac2e tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:16:15.024035 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-993e970b-835d-4cc3-96d3-1040ef08ac2e tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:16:15.026564 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-993e970b-835d-4cc3-96d3-1040ef08ac2e tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:16:15.252290 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-993e970b-835d-4cc3-96d3-1040ef08ac2e tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8957041987c8487099f0d89f4c64af66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9d29b90ab34abbadd21edbca637d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:16:15.266544 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-993e970b-835d-4cc3-96d3-1040ef08ac2e tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] 10.222.0.26 "GET /compute/v2.1/servers/bbd1c1d7-13a9-4c6f-b651-c1017efd922e" status: 200 len: 1367 microversion: 2.1 time: 0.279712 Oct 08 21:16:15.281724 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2537/5009] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:16:14 2022] GET /compute/v2.1/servers/bbd1c1d7-13a9-4c6f-b651-c1017efd922e => generated 1367 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:16:16.291890 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-dcd9f648-624e-4064-96cf-1f8f7df2b788 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:16:16.294079 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-dcd9f648-624e-4064-96cf-1f8f7df2b788 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] [instance: bbd1c1d7-13a9-4c6f-b651-c1017efd922e] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:16:16.302569 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dcd9f648-624e-4064-96cf-1f8f7df2b788 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:16:16.303732 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dcd9f648-624e-4064-96cf-1f8f7df2b788 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:16:16.304472 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dcd9f648-624e-4064-96cf-1f8f7df2b788 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:16:16.305470 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dcd9f648-624e-4064-96cf-1f8f7df2b788 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:16:16.306285 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dcd9f648-624e-4064-96cf-1f8f7df2b788 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:16:16.307456 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dcd9f648-624e-4064-96cf-1f8f7df2b788 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:16:16.386033 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-fd4cbeb1-e279-4226-8c9b-2a7fb4a66e16 tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Flavor limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 21:16:16.387679 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-fd4cbeb1-e279-4226-8c9b-2a7fb4a66e16 tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Image limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 21:16:16.388352 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-fd4cbeb1-e279-4226-8c9b-2a7fb4a66e16 tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Flavor pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 21:16:16.388983 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-fd4cbeb1-e279-4226-8c9b-2a7fb4a66e16 tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Image pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 21:16:16.389635 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-fd4cbeb1-e279-4226-8c9b-2a7fb4a66e16 tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 21:16:16.412449 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fd4cbeb1-e279-4226-8c9b-2a7fb4a66e16 tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:16:16.413361 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fd4cbeb1-e279-4226-8c9b-2a7fb4a66e16 tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:16:16.414065 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fd4cbeb1-e279-4226-8c9b-2a7fb4a66e16 tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:16:16.416208 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fd4cbeb1-e279-4226-8c9b-2a7fb4a66e16 tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:16:16.416936 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fd4cbeb1-e279-4226-8c9b-2a7fb4a66e16 tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:16:16.417622 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fd4cbeb1-e279-4226-8c9b-2a7fb4a66e16 tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:16:16.446445 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-fd4cbeb1-e279-4226-8c9b-2a7fb4a66e16 tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Getting quotas for project 173beeb5bce346eabf2a2d19f4c381d6. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:16:16.452533 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-fd4cbeb1-e279-4226-8c9b-2a7fb4a66e16 tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Getting quotas for user 1af17546ab4745d8b92eab4f5c3ebb14 and project 173beeb5bce346eabf2a2d19f4c381d6. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:16:16.466035 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-fd4cbeb1-e279-4226-8c9b-2a7fb4a66e16 tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Going to run 1 instances... {{(pid=140491) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 21:16:16.469452 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-fd4cbeb1-e279-4226-8c9b-2a7fb4a66e16 tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] [instance: 3633db12-958e-4062-879a-609e160649fc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c508bd7f-7db9-4b2c-af7c-be54a855c355',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140491) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 21:16:16.542604 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-fd4cbeb1-e279-4226-8c9b-2a7fb4a66e16 tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 3.609989 Oct 08 21:16:16.543559 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2473/5010] 10.222.0.26 () {62 vars in 1188 bytes} [Sat Oct 8 21:16:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 3612 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 08 21:16:16.561743 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-caf44317-a154-4499-b681-c2155718bb56 tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:16:16.563749 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-caf44317-a154-4499-b681-c2155718bb56 tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] [instance: 3633db12-958e-4062-879a-609e160649fc] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:16:16.690935 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-caf44317-a154-4499-b681-c2155718bb56 tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af17546ab4745d8b92eab4f5c3ebb14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173beeb5bce346eabf2a2d19f4c381d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:16:16.708696 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-caf44317-a154-4499-b681-c2155718bb56 tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af17546ab4745d8b92eab4f5c3ebb14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173beeb5bce346eabf2a2d19f4c381d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:16:16.711076 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-caf44317-a154-4499-b681-c2155718bb56 tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af17546ab4745d8b92eab4f5c3ebb14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173beeb5bce346eabf2a2d19f4c381d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:16:16.714820 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-caf44317-a154-4499-b681-c2155718bb56 tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] 10.222.0.26 "GET /compute/v2.1/servers/3633db12-958e-4062-879a-609e160649fc" status: 200 len: 1258 microversion: 2.21 time: 0.162002 Oct 08 21:16:16.720638 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2474/5011] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:16:16 2022] GET /compute/v2.1/servers/3633db12-958e-4062-879a-609e160649fc => generated 1258 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:16:16.845095 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-dcd9f648-624e-4064-96cf-1f8f7df2b788 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8957041987c8487099f0d89f4c64af66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9d29b90ab34abbadd21edbca637d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:16:16.855347 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-dcd9f648-624e-4064-96cf-1f8f7df2b788 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] 10.222.0.26 "GET /compute/v2.1/servers/bbd1c1d7-13a9-4c6f-b651-c1017efd922e" status: 200 len: 1367 microversion: 2.1 time: 0.568661 Oct 08 21:16:16.863888 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2538/5012] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:16:16 2022] GET /compute/v2.1/servers/bbd1c1d7-13a9-4c6f-b651-c1017efd922e => generated 1367 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:16:17.754447 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-2a66b38a-9ea7-443a-9938-c6a619dab4b9 tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:16:17.755254 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-2a66b38a-9ea7-443a-9938-c6a619dab4b9 tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] [instance: 3633db12-958e-4062-879a-609e160649fc] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:16:17.783778 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2a66b38a-9ea7-443a-9938-c6a619dab4b9 tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:16:17.786082 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2a66b38a-9ea7-443a-9938-c6a619dab4b9 tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:16:17.786563 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2a66b38a-9ea7-443a-9938-c6a619dab4b9 tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:16:17.787339 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2a66b38a-9ea7-443a-9938-c6a619dab4b9 tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:16:17.787921 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2a66b38a-9ea7-443a-9938-c6a619dab4b9 tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:16:17.795146 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2a66b38a-9ea7-443a-9938-c6a619dab4b9 tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:16:17.888041 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-fbc19899-c7d2-437d-bb55-5c02dfe89520 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:16:17.889394 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-fbc19899-c7d2-437d-bb55-5c02dfe89520 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] [instance: bbd1c1d7-13a9-4c6f-b651-c1017efd922e] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:16:17.905125 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fbc19899-c7d2-437d-bb55-5c02dfe89520 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:16:17.913037 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fbc19899-c7d2-437d-bb55-5c02dfe89520 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:16:17.913773 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fbc19899-c7d2-437d-bb55-5c02dfe89520 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:16:17.915162 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fbc19899-c7d2-437d-bb55-5c02dfe89520 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:16:17.916684 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fbc19899-c7d2-437d-bb55-5c02dfe89520 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:16:17.917370 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fbc19899-c7d2-437d-bb55-5c02dfe89520 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:16:18.080396 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-2a66b38a-9ea7-443a-9938-c6a619dab4b9 tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af17546ab4745d8b92eab4f5c3ebb14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173beeb5bce346eabf2a2d19f4c381d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:16:18.089855 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-2a66b38a-9ea7-443a-9938-c6a619dab4b9 tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af17546ab4745d8b92eab4f5c3ebb14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173beeb5bce346eabf2a2d19f4c381d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:16:18.091596 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-2a66b38a-9ea7-443a-9938-c6a619dab4b9 tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af17546ab4745d8b92eab4f5c3ebb14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173beeb5bce346eabf2a2d19f4c381d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:16:18.092928 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-2a66b38a-9ea7-443a-9938-c6a619dab4b9 tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] 10.222.0.26 "GET /compute/v2.1/servers/3633db12-958e-4062-879a-609e160649fc" status: 200 len: 1254 microversion: 2.21 time: 0.343631 Oct 08 21:16:18.095225 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2475/5013] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:16:17 2022] GET /compute/v2.1/servers/3633db12-958e-4062-879a-609e160649fc => generated 1254 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:16:18.410417 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-fbc19899-c7d2-437d-bb55-5c02dfe89520 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8957041987c8487099f0d89f4c64af66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9d29b90ab34abbadd21edbca637d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:16:18.419211 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-fbc19899-c7d2-437d-bb55-5c02dfe89520 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] 10.222.0.26 "GET /compute/v2.1/servers/bbd1c1d7-13a9-4c6f-b651-c1017efd922e" status: 200 len: 1367 microversion: 2.1 time: 0.535447 Oct 08 21:16:18.420361 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2539/5014] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:16:17 2022] GET /compute/v2.1/servers/bbd1c1d7-13a9-4c6f-b651-c1017efd922e => generated 1367 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:16:19.123792 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-f0682faa-5e0b-4382-a23f-09a29fb9857d tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:16:19.125919 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-f0682faa-5e0b-4382-a23f-09a29fb9857d tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] [instance: 3633db12-958e-4062-879a-609e160649fc] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:16:19.138119 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f0682faa-5e0b-4382-a23f-09a29fb9857d tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:16:19.141503 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f0682faa-5e0b-4382-a23f-09a29fb9857d tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:16:19.144290 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f0682faa-5e0b-4382-a23f-09a29fb9857d tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:16:19.145545 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f0682faa-5e0b-4382-a23f-09a29fb9857d tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:16:19.146040 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f0682faa-5e0b-4382-a23f-09a29fb9857d tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:16:19.146521 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f0682faa-5e0b-4382-a23f-09a29fb9857d tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:16:19.444266 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-1ee016eb-6200-40b6-afc2-3f3edd2558a0 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:16:19.445688 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-1ee016eb-6200-40b6-afc2-3f3edd2558a0 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] [instance: bbd1c1d7-13a9-4c6f-b651-c1017efd922e] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:16:19.456238 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1ee016eb-6200-40b6-afc2-3f3edd2558a0 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:16:19.461949 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1ee016eb-6200-40b6-afc2-3f3edd2558a0 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:16:19.462419 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1ee016eb-6200-40b6-afc2-3f3edd2558a0 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:16:19.463180 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1ee016eb-6200-40b6-afc2-3f3edd2558a0 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:16:19.463647 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1ee016eb-6200-40b6-afc2-3f3edd2558a0 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:16:19.464493 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1ee016eb-6200-40b6-afc2-3f3edd2558a0 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:16:19.497682 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-f0682faa-5e0b-4382-a23f-09a29fb9857d tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af17546ab4745d8b92eab4f5c3ebb14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173beeb5bce346eabf2a2d19f4c381d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:16:19.526968 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-f0682faa-5e0b-4382-a23f-09a29fb9857d tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af17546ab4745d8b92eab4f5c3ebb14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173beeb5bce346eabf2a2d19f4c381d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:16:19.528928 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-f0682faa-5e0b-4382-a23f-09a29fb9857d tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af17546ab4745d8b92eab4f5c3ebb14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173beeb5bce346eabf2a2d19f4c381d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:16:19.530423 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-f0682faa-5e0b-4382-a23f-09a29fb9857d tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] 10.222.0.26 "GET /compute/v2.1/servers/3633db12-958e-4062-879a-609e160649fc" status: 200 len: 1316 microversion: 2.21 time: 0.411187 Oct 08 21:16:19.532216 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2476/5015] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:16:19 2022] GET /compute/v2.1/servers/3633db12-958e-4062-879a-609e160649fc => generated 1316 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:16:19.972049 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-1ee016eb-6200-40b6-afc2-3f3edd2558a0 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8957041987c8487099f0d89f4c64af66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9d29b90ab34abbadd21edbca637d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:16:19.986538 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-1ee016eb-6200-40b6-afc2-3f3edd2558a0 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] 10.222.0.26 "GET /compute/v2.1/servers/bbd1c1d7-13a9-4c6f-b651-c1017efd922e" status: 200 len: 1367 microversion: 2.1 time: 0.546147 Oct 08 21:16:19.989556 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2540/5016] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:16:19 2022] GET /compute/v2.1/servers/bbd1c1d7-13a9-4c6f-b651-c1017efd922e => generated 1367 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:16:20.561289 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-d84d2e98-ad94-4550-9ee2-1c7dd0c3beed tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:16:20.563030 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-d84d2e98-ad94-4550-9ee2-1c7dd0c3beed tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] [instance: 3633db12-958e-4062-879a-609e160649fc] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:16:20.589871 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d84d2e98-ad94-4550-9ee2-1c7dd0c3beed tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:16:20.592171 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d84d2e98-ad94-4550-9ee2-1c7dd0c3beed tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:16:20.592809 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d84d2e98-ad94-4550-9ee2-1c7dd0c3beed tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:16:20.594131 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d84d2e98-ad94-4550-9ee2-1c7dd0c3beed tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:16:20.602374 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d84d2e98-ad94-4550-9ee2-1c7dd0c3beed tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:16:20.610224 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d84d2e98-ad94-4550-9ee2-1c7dd0c3beed tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:16:20.625788 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-e4c1b282-2260-4249-8e08-bde9a39bb702 req-db89462f-f1c3-46f0-b601-2fc09fa1b23e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbd1c1d7-13a9-4c6f-b651-c1017efd922e", "name": "network-vif-plugged", "status": "completed", "tag": "970d0412-0e67-4602-ab4e-c38b70f22b0a"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:16:20.653054 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-e4c1b282-2260-4249-8e08-bde9a39bb702 req-db89462f-f1c3-46f0-b601-2fc09fa1b23e service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:16:20.654319 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-e4c1b282-2260-4249-8e08-bde9a39bb702 req-db89462f-f1c3-46f0-b601-2fc09fa1b23e service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:16:20.657047 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-e4c1b282-2260-4249-8e08-bde9a39bb702 req-db89462f-f1c3-46f0-b601-2fc09fa1b23e service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:16:20.699709 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-e4c1b282-2260-4249-8e08-bde9a39bb702 req-db89462f-f1c3-46f0-b601-2fc09fa1b23e service nova] Creating event network-vif-plugged:970d0412-0e67-4602-ab4e-c38b70f22b0a for instance bbd1c1d7-13a9-4c6f-b651-c1017efd922e on nch2-master-1 Oct 08 21:16:20.707583 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-e4c1b282-2260-4249-8e08-bde9a39bb702 req-db89462f-f1c3-46f0-b601-2fc09fa1b23e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086185 Oct 08 21:16:20.708424 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2541/5017] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:16:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 08 21:16:20.895740 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-d84d2e98-ad94-4550-9ee2-1c7dd0c3beed tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af17546ab4745d8b92eab4f5c3ebb14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173beeb5bce346eabf2a2d19f4c381d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:16:20.920818 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-d84d2e98-ad94-4550-9ee2-1c7dd0c3beed tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af17546ab4745d8b92eab4f5c3ebb14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173beeb5bce346eabf2a2d19f4c381d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:16:20.924362 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-d84d2e98-ad94-4550-9ee2-1c7dd0c3beed tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af17546ab4745d8b92eab4f5c3ebb14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173beeb5bce346eabf2a2d19f4c381d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:16:20.926606 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-d84d2e98-ad94-4550-9ee2-1c7dd0c3beed tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] 10.222.0.26 "GET /compute/v2.1/servers/3633db12-958e-4062-879a-609e160649fc" status: 200 len: 1316 microversion: 2.21 time: 0.370078 Oct 08 21:16:20.927758 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2477/5018] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:16:20 2022] GET /compute/v2.1/servers/3633db12-958e-4062-879a-609e160649fc => generated 1316 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:16:21.014882 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-d67209a5-ec5b-4fc8-ab6e-6ae02b03691c tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:16:21.016584 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-d67209a5-ec5b-4fc8-ab6e-6ae02b03691c tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] [instance: bbd1c1d7-13a9-4c6f-b651-c1017efd922e] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:16:21.026303 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d67209a5-ec5b-4fc8-ab6e-6ae02b03691c tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:16:21.027218 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d67209a5-ec5b-4fc8-ab6e-6ae02b03691c tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:16:21.027833 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d67209a5-ec5b-4fc8-ab6e-6ae02b03691c tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:16:21.028730 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d67209a5-ec5b-4fc8-ab6e-6ae02b03691c tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:16:21.029401 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d67209a5-ec5b-4fc8-ab6e-6ae02b03691c tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:16:21.031907 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d67209a5-ec5b-4fc8-ab6e-6ae02b03691c tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:16:21.491456 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-d67209a5-ec5b-4fc8-ab6e-6ae02b03691c tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8957041987c8487099f0d89f4c64af66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9d29b90ab34abbadd21edbca637d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:16:21.502422 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-d67209a5-ec5b-4fc8-ab6e-6ae02b03691c tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] 10.222.0.26 "GET /compute/v2.1/servers/bbd1c1d7-13a9-4c6f-b651-c1017efd922e" status: 200 len: 1367 microversion: 2.1 time: 0.492651 Oct 08 21:16:21.504038 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2542/5019] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:16:21 2022] GET /compute/v2.1/servers/bbd1c1d7-13a9-4c6f-b651-c1017efd922e => generated 1367 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:16:21.953441 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-235dcbbb-828e-4b12-8096-99c0baf51a43 tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:16:21.954211 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-235dcbbb-828e-4b12-8096-99c0baf51a43 tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] [instance: 3633db12-958e-4062-879a-609e160649fc] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:16:21.969065 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-235dcbbb-828e-4b12-8096-99c0baf51a43 tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:16:21.969603 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-235dcbbb-828e-4b12-8096-99c0baf51a43 tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:16:21.971742 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-235dcbbb-828e-4b12-8096-99c0baf51a43 tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:16:21.975511 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-235dcbbb-828e-4b12-8096-99c0baf51a43 tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:16:21.976609 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-235dcbbb-828e-4b12-8096-99c0baf51a43 tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:16:21.979188 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-235dcbbb-828e-4b12-8096-99c0baf51a43 tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:16:22.528580 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-08aa5f0f-1e26-48fb-8f7a-86cd607e3a1c tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:16:22.529234 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-08aa5f0f-1e26-48fb-8f7a-86cd607e3a1c tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] [instance: bbd1c1d7-13a9-4c6f-b651-c1017efd922e] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:16:22.547804 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-08aa5f0f-1e26-48fb-8f7a-86cd607e3a1c tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:16:22.548552 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-08aa5f0f-1e26-48fb-8f7a-86cd607e3a1c tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:16:22.549151 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-08aa5f0f-1e26-48fb-8f7a-86cd607e3a1c tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:16:22.550056 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-08aa5f0f-1e26-48fb-8f7a-86cd607e3a1c tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:16:22.550699 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-08aa5f0f-1e26-48fb-8f7a-86cd607e3a1c tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:16:22.551140 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-08aa5f0f-1e26-48fb-8f7a-86cd607e3a1c tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:16:22.628394 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-235dcbbb-828e-4b12-8096-99c0baf51a43 tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af17546ab4745d8b92eab4f5c3ebb14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173beeb5bce346eabf2a2d19f4c381d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:16:22.665826 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-235dcbbb-828e-4b12-8096-99c0baf51a43 tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af17546ab4745d8b92eab4f5c3ebb14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173beeb5bce346eabf2a2d19f4c381d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:16:22.668317 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-235dcbbb-828e-4b12-8096-99c0baf51a43 tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af17546ab4745d8b92eab4f5c3ebb14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173beeb5bce346eabf2a2d19f4c381d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:16:22.671075 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-235dcbbb-828e-4b12-8096-99c0baf51a43 tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] 10.222.0.26 "GET /compute/v2.1/servers/3633db12-958e-4062-879a-609e160649fc" status: 200 len: 1358 microversion: 2.21 time: 0.723284 Oct 08 21:16:22.672944 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2478/5020] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:16:21 2022] GET /compute/v2.1/servers/3633db12-958e-4062-879a-609e160649fc => generated 1358 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:16:23.144420 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-08aa5f0f-1e26-48fb-8f7a-86cd607e3a1c tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8957041987c8487099f0d89f4c64af66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9d29b90ab34abbadd21edbca637d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:16:23.153944 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-08aa5f0f-1e26-48fb-8f7a-86cd607e3a1c tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] 10.222.0.26 "GET /compute/v2.1/servers/bbd1c1d7-13a9-4c6f-b651-c1017efd922e" status: 200 len: 1558 microversion: 2.1 time: 0.629765 Oct 08 21:16:23.170591 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2543/5021] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:16:22 2022] GET /compute/v2.1/servers/bbd1c1d7-13a9-4c6f-b651-c1017efd922e => generated 1558 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:16:23.182777 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-acebf62d-e5c7-4b24-9ee1-f29b7160aeaa tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:16:23.184132 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-acebf62d-e5c7-4b24-9ee1-f29b7160aeaa tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] [instance: bbd1c1d7-13a9-4c6f-b651-c1017efd922e] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:16:23.195772 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-acebf62d-e5c7-4b24-9ee1-f29b7160aeaa tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:16:23.196631 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-acebf62d-e5c7-4b24-9ee1-f29b7160aeaa tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:16:23.197547 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-acebf62d-e5c7-4b24-9ee1-f29b7160aeaa tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:16:23.199213 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-acebf62d-e5c7-4b24-9ee1-f29b7160aeaa tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:16:23.200052 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-acebf62d-e5c7-4b24-9ee1-f29b7160aeaa tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:16:23.201139 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-acebf62d-e5c7-4b24-9ee1-f29b7160aeaa tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:16:23.329770 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-acebf62d-e5c7-4b24-9ee1-f29b7160aeaa tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] 10.222.0.26 "GET /compute/v2.1/servers/bbd1c1d7-13a9-4c6f-b651-c1017efd922e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.151964 Oct 08 21:16:23.331191 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2479/5022] 10.222.0.26 () {58 vars in 1275 bytes} [Sat Oct 8 21:16:23 2022] GET /compute/v2.1/servers/bbd1c1d7-13a9-4c6f-b651-c1017efd922e/os-interface => generated 285 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:16:23.709830 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-00d03293-1662-4287-bedf-084cbb56534c tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:16:23.712764 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-00d03293-1662-4287-bedf-084cbb56534c tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] [instance: 3633db12-958e-4062-879a-609e160649fc] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:16:23.729003 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-00d03293-1662-4287-bedf-084cbb56534c tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:16:23.730598 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-00d03293-1662-4287-bedf-084cbb56534c tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:16:23.731236 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-00d03293-1662-4287-bedf-084cbb56534c tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:16:23.732387 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-00d03293-1662-4287-bedf-084cbb56534c tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:16:23.733138 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-00d03293-1662-4287-bedf-084cbb56534c tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:16:23.733794 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-00d03293-1662-4287-bedf-084cbb56534c tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:16:24.840014 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-00d03293-1662-4287-bedf-084cbb56534c tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af17546ab4745d8b92eab4f5c3ebb14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173beeb5bce346eabf2a2d19f4c381d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:16:24.871609 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-00d03293-1662-4287-bedf-084cbb56534c tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af17546ab4745d8b92eab4f5c3ebb14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173beeb5bce346eabf2a2d19f4c381d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:16:24.892406 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-00d03293-1662-4287-bedf-084cbb56534c tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af17546ab4745d8b92eab4f5c3ebb14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173beeb5bce346eabf2a2d19f4c381d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:16:24.906924 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-00d03293-1662-4287-bedf-084cbb56534c tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] 10.222.0.26 "GET /compute/v2.1/servers/3633db12-958e-4062-879a-609e160649fc" status: 200 len: 1358 microversion: 2.21 time: 1.208035 Oct 08 21:16:24.907536 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2544/5023] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:16:23 2022] GET /compute/v2.1/servers/3633db12-958e-4062-879a-609e160649fc => generated 1358 bytes in 1209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:16:25.943243 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-99605b9c-a78e-4c50-bd3f-55a967b87dd7 tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:16:25.944024 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-99605b9c-a78e-4c50-bd3f-55a967b87dd7 tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] [instance: 3633db12-958e-4062-879a-609e160649fc] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:16:25.960683 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-99605b9c-a78e-4c50-bd3f-55a967b87dd7 tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:16:25.961567 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-99605b9c-a78e-4c50-bd3f-55a967b87dd7 tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:16:25.962294 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-99605b9c-a78e-4c50-bd3f-55a967b87dd7 tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:16:25.963554 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-99605b9c-a78e-4c50-bd3f-55a967b87dd7 tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:16:25.964307 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-99605b9c-a78e-4c50-bd3f-55a967b87dd7 tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:16:25.965073 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-99605b9c-a78e-4c50-bd3f-55a967b87dd7 tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:16:26.382036 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-755c531a-39b6-4912-8517-cde1cfb064ee req-83c385f0-a440-45ae-9398-4191ef1ad214 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3633db12-958e-4062-879a-609e160649fc", "tag": "298eda5e-080a-4d84-8330-ed0c82261057"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:16:26.410877 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-755c531a-39b6-4912-8517-cde1cfb064ee req-83c385f0-a440-45ae-9398-4191ef1ad214 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:16:26.413175 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-755c531a-39b6-4912-8517-cde1cfb064ee req-83c385f0-a440-45ae-9398-4191ef1ad214 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:16:26.414289 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-755c531a-39b6-4912-8517-cde1cfb064ee req-83c385f0-a440-45ae-9398-4191ef1ad214 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:16:26.429239 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-755c531a-39b6-4912-8517-cde1cfb064ee req-83c385f0-a440-45ae-9398-4191ef1ad214 service nova] Creating event network-changed:298eda5e-080a-4d84-8330-ed0c82261057 for instance 3633db12-958e-4062-879a-609e160649fc on nch1-master-1 Oct 08 21:16:26.432994 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=2 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:16:26.441428 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-755c531a-39b6-4912-8517-cde1cfb064ee req-83c385f0-a440-45ae-9398-4191ef1ad214 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065191 Oct 08 21:16:26.442982 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2545/5024] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:16:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 08 21:16:26.602925 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-99605b9c-a78e-4c50-bd3f-55a967b87dd7 tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af17546ab4745d8b92eab4f5c3ebb14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173beeb5bce346eabf2a2d19f4c381d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:16:26.617033 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-99605b9c-a78e-4c50-bd3f-55a967b87dd7 tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af17546ab4745d8b92eab4f5c3ebb14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173beeb5bce346eabf2a2d19f4c381d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:16:26.619880 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-99605b9c-a78e-4c50-bd3f-55a967b87dd7 tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af17546ab4745d8b92eab4f5c3ebb14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173beeb5bce346eabf2a2d19f4c381d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:16:26.626803 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-99605b9c-a78e-4c50-bd3f-55a967b87dd7 tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] 10.222.0.26 "GET /compute/v2.1/servers/3633db12-958e-4062-879a-609e160649fc" status: 200 len: 1358 microversion: 2.21 time: 0.689338 Oct 08 21:16:26.627526 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2480/5025] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:16:25 2022] GET /compute/v2.1/servers/3633db12-958e-4062-879a-609e160649fc => generated 1358 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:16:27.658645 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-9220ea8e-0e6d-491a-97ff-9cbf92f37507 tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:16:27.659582 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-9220ea8e-0e6d-491a-97ff-9cbf92f37507 tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] [instance: 3633db12-958e-4062-879a-609e160649fc] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:16:27.677420 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9220ea8e-0e6d-491a-97ff-9cbf92f37507 tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:16:27.678418 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9220ea8e-0e6d-491a-97ff-9cbf92f37507 tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:16:27.679365 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9220ea8e-0e6d-491a-97ff-9cbf92f37507 tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:16:27.680832 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9220ea8e-0e6d-491a-97ff-9cbf92f37507 tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:16:27.682060 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9220ea8e-0e6d-491a-97ff-9cbf92f37507 tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:16:27.683302 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9220ea8e-0e6d-491a-97ff-9cbf92f37507 tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:16:28.695852 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-9220ea8e-0e6d-491a-97ff-9cbf92f37507 tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af17546ab4745d8b92eab4f5c3ebb14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173beeb5bce346eabf2a2d19f4c381d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:16:28.707115 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-9220ea8e-0e6d-491a-97ff-9cbf92f37507 tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af17546ab4745d8b92eab4f5c3ebb14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173beeb5bce346eabf2a2d19f4c381d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:16:28.715420 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-9220ea8e-0e6d-491a-97ff-9cbf92f37507 tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af17546ab4745d8b92eab4f5c3ebb14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173beeb5bce346eabf2a2d19f4c381d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:16:28.716988 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-9220ea8e-0e6d-491a-97ff-9cbf92f37507 tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] 10.222.0.26 "GET /compute/v2.1/servers/3633db12-958e-4062-879a-609e160649fc" status: 200 len: 1358 microversion: 2.21 time: 1.065225 Oct 08 21:16:28.721045 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2546/5026] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:16:27 2022] GET /compute/v2.1/servers/3633db12-958e-4062-879a-609e160649fc => generated 1358 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:16:28.941252 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-f2f10a34-b844-4e7c-b5a2-9113023056d2 req-9f5d5657-9352-4675-955f-d2dc7952cdd8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbd1c1d7-13a9-4c6f-b651-c1017efd922e", "tag": "970d0412-0e67-4602-ab4e-c38b70f22b0a"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:16:28.975797 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=8 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:16:28.978508 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=6 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:16:28.981626 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-f2f10a34-b844-4e7c-b5a2-9113023056d2 req-9f5d5657-9352-4675-955f-d2dc7952cdd8 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:16:28.982463 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-f2f10a34-b844-4e7c-b5a2-9113023056d2 req-9f5d5657-9352-4675-955f-d2dc7952cdd8 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:16:29.013210 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-f2f10a34-b844-4e7c-b5a2-9113023056d2 req-9f5d5657-9352-4675-955f-d2dc7952cdd8 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:16:29.079020 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=57 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:16:29.081766 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-f2f10a34-b844-4e7c-b5a2-9113023056d2 req-9f5d5657-9352-4675-955f-d2dc7952cdd8 service nova] Creating event network-changed:970d0412-0e67-4602-ab4e-c38b70f22b0a for instance bbd1c1d7-13a9-4c6f-b651-c1017efd922e on nch2-master-1 Oct 08 21:16:29.089721 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-f2f10a34-b844-4e7c-b5a2-9113023056d2 req-9f5d5657-9352-4675-955f-d2dc7952cdd8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.151476 Oct 08 21:16:29.090974 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2481/5027] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:16:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:16:29.752367 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e209e57b-785b-4e4d-95f8-3aa7762d24af tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:16:29.753304 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-e209e57b-785b-4e4d-95f8-3aa7762d24af tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] [instance: 3633db12-958e-4062-879a-609e160649fc] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:16:29.764020 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e209e57b-785b-4e4d-95f8-3aa7762d24af tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:16:29.766928 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e209e57b-785b-4e4d-95f8-3aa7762d24af tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:16:29.769052 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e209e57b-785b-4e4d-95f8-3aa7762d24af tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:16:29.770145 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e209e57b-785b-4e4d-95f8-3aa7762d24af tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:16:29.777486 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e209e57b-785b-4e4d-95f8-3aa7762d24af tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:16:29.778278 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e209e57b-785b-4e4d-95f8-3aa7762d24af tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:16:30.910691 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-e209e57b-785b-4e4d-95f8-3aa7762d24af tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af17546ab4745d8b92eab4f5c3ebb14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173beeb5bce346eabf2a2d19f4c381d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:16:30.920221 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-e209e57b-785b-4e4d-95f8-3aa7762d24af tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af17546ab4745d8b92eab4f5c3ebb14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173beeb5bce346eabf2a2d19f4c381d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:16:30.921758 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-e209e57b-785b-4e4d-95f8-3aa7762d24af tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af17546ab4745d8b92eab4f5c3ebb14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173beeb5bce346eabf2a2d19f4c381d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:16:30.922904 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-e209e57b-785b-4e4d-95f8-3aa7762d24af tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] 10.222.0.26 "GET /compute/v2.1/servers/3633db12-958e-4062-879a-609e160649fc" status: 200 len: 1358 microversion: 2.21 time: 1.175088 Oct 08 21:16:30.937913 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2547/5028] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:16:29 2022] GET /compute/v2.1/servers/3633db12-958e-4062-879a-609e160649fc => generated 1358 bytes in 1176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:16:31.948898 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-88b1bb62-81ed-4efc-9af2-811cf936a1ac tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:16:31.949666 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-88b1bb62-81ed-4efc-9af2-811cf936a1ac tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] [instance: 3633db12-958e-4062-879a-609e160649fc] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:16:31.960063 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-88b1bb62-81ed-4efc-9af2-811cf936a1ac tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:16:31.967913 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-88b1bb62-81ed-4efc-9af2-811cf936a1ac tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:16:31.971471 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-88b1bb62-81ed-4efc-9af2-811cf936a1ac tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:16:31.972912 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-88b1bb62-81ed-4efc-9af2-811cf936a1ac tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:16:31.973584 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-88b1bb62-81ed-4efc-9af2-811cf936a1ac tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:16:31.974182 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-88b1bb62-81ed-4efc-9af2-811cf936a1ac tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:16:32.413454 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-88b1bb62-81ed-4efc-9af2-811cf936a1ac tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af17546ab4745d8b92eab4f5c3ebb14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173beeb5bce346eabf2a2d19f4c381d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:16:32.431874 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-88b1bb62-81ed-4efc-9af2-811cf936a1ac tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af17546ab4745d8b92eab4f5c3ebb14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173beeb5bce346eabf2a2d19f4c381d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:16:32.436082 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-88b1bb62-81ed-4efc-9af2-811cf936a1ac tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af17546ab4745d8b92eab4f5c3ebb14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173beeb5bce346eabf2a2d19f4c381d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:16:32.438450 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-88b1bb62-81ed-4efc-9af2-811cf936a1ac tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] 10.222.0.26 "GET /compute/v2.1/servers/3633db12-958e-4062-879a-609e160649fc" status: 200 len: 1358 microversion: 2.21 time: 0.493952 Oct 08 21:16:32.440226 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2482/5029] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:16:31 2022] GET /compute/v2.1/servers/3633db12-958e-4062-879a-609e160649fc => generated 1358 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:16:33.475446 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-89a5f6c8-5f0d-4d9b-b4cd-afb246cf70b5 tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:16:33.476542 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-89a5f6c8-5f0d-4d9b-b4cd-afb246cf70b5 tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] [instance: 3633db12-958e-4062-879a-609e160649fc] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:16:33.495199 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=37 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:16:33.504209 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-89a5f6c8-5f0d-4d9b-b4cd-afb246cf70b5 tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:16:33.519671 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-89a5f6c8-5f0d-4d9b-b4cd-afb246cf70b5 tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:16:33.522676 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-89a5f6c8-5f0d-4d9b-b4cd-afb246cf70b5 tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:16:33.523556 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-89a5f6c8-5f0d-4d9b-b4cd-afb246cf70b5 tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:16:33.525727 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-89a5f6c8-5f0d-4d9b-b4cd-afb246cf70b5 tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:16:33.526386 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-89a5f6c8-5f0d-4d9b-b4cd-afb246cf70b5 tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:16:33.618876 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=85 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:16:33.925419 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-89a5f6c8-5f0d-4d9b-b4cd-afb246cf70b5 tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af17546ab4745d8b92eab4f5c3ebb14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173beeb5bce346eabf2a2d19f4c381d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:16:33.940465 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-89a5f6c8-5f0d-4d9b-b4cd-afb246cf70b5 tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af17546ab4745d8b92eab4f5c3ebb14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173beeb5bce346eabf2a2d19f4c381d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:16:33.942115 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-89a5f6c8-5f0d-4d9b-b4cd-afb246cf70b5 tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af17546ab4745d8b92eab4f5c3ebb14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173beeb5bce346eabf2a2d19f4c381d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:16:33.943276 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-89a5f6c8-5f0d-4d9b-b4cd-afb246cf70b5 tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] 10.222.0.26 "GET /compute/v2.1/servers/3633db12-958e-4062-879a-609e160649fc" status: 200 len: 1358 microversion: 2.21 time: 0.472476 Oct 08 21:16:33.945589 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2548/5030] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:16:33 2022] GET /compute/v2.1/servers/3633db12-958e-4062-879a-609e160649fc => generated 1358 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:16:34.613129 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-5dc67aa9-3800-4534-95db-f0481028bdc7 req-29f47bb2-5441-4ba0-afe5-907de006756b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3633db12-958e-4062-879a-609e160649fc", "name": "network-vif-plugged", "status": "completed", "tag": "298eda5e-080a-4d84-8330-ed0c82261057"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:16:34.643556 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-5dc67aa9-3800-4534-95db-f0481028bdc7 req-29f47bb2-5441-4ba0-afe5-907de006756b service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:16:34.645095 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-5dc67aa9-3800-4534-95db-f0481028bdc7 req-29f47bb2-5441-4ba0-afe5-907de006756b service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:16:34.645870 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-5dc67aa9-3800-4534-95db-f0481028bdc7 req-29f47bb2-5441-4ba0-afe5-907de006756b service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:16:34.755507 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-5dc67aa9-3800-4534-95db-f0481028bdc7 req-29f47bb2-5441-4ba0-afe5-907de006756b service nova] Creating event network-vif-plugged:298eda5e-080a-4d84-8330-ed0c82261057 for instance 3633db12-958e-4062-879a-609e160649fc on nch1-master-1 Oct 08 21:16:34.779457 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-5dc67aa9-3800-4534-95db-f0481028bdc7 req-29f47bb2-5441-4ba0-afe5-907de006756b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.182512 Oct 08 21:16:34.799628 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2483/5031] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:16:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:16:34.974183 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-26dd1ba6-1f65-47e5-9508-40f8e7830c54 tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:16:34.976067 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-26dd1ba6-1f65-47e5-9508-40f8e7830c54 tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] [instance: 3633db12-958e-4062-879a-609e160649fc] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:16:34.996618 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-26dd1ba6-1f65-47e5-9508-40f8e7830c54 tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:16:34.997528 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-26dd1ba6-1f65-47e5-9508-40f8e7830c54 tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:16:34.998516 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-26dd1ba6-1f65-47e5-9508-40f8e7830c54 tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:16:35.005958 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-26dd1ba6-1f65-47e5-9508-40f8e7830c54 tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:16:35.008490 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-26dd1ba6-1f65-47e5-9508-40f8e7830c54 tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:16:35.014005 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-26dd1ba6-1f65-47e5-9508-40f8e7830c54 tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:16:35.735025 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-26dd1ba6-1f65-47e5-9508-40f8e7830c54 tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af17546ab4745d8b92eab4f5c3ebb14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173beeb5bce346eabf2a2d19f4c381d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:16:35.748944 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-26dd1ba6-1f65-47e5-9508-40f8e7830c54 tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af17546ab4745d8b92eab4f5c3ebb14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173beeb5bce346eabf2a2d19f4c381d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:16:35.751453 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-26dd1ba6-1f65-47e5-9508-40f8e7830c54 tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af17546ab4745d8b92eab4f5c3ebb14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173beeb5bce346eabf2a2d19f4c381d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:16:35.752892 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-26dd1ba6-1f65-47e5-9508-40f8e7830c54 tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] 10.222.0.26 "GET /compute/v2.1/servers/3633db12-958e-4062-879a-609e160649fc" status: 200 len: 1358 microversion: 2.21 time: 0.782954 Oct 08 21:16:35.754556 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2549/5032] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:16:34 2022] GET /compute/v2.1/servers/3633db12-958e-4062-879a-609e160649fc => generated 1358 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:16:36.785045 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-7d3c3dec-c4be-4fa7-a660-3afda56d396b tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:16:36.785799 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-7d3c3dec-c4be-4fa7-a660-3afda56d396b tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] [instance: 3633db12-958e-4062-879a-609e160649fc] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:16:36.810862 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7d3c3dec-c4be-4fa7-a660-3afda56d396b tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:16:36.812244 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7d3c3dec-c4be-4fa7-a660-3afda56d396b tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:16:36.813003 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7d3c3dec-c4be-4fa7-a660-3afda56d396b tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:16:36.813982 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7d3c3dec-c4be-4fa7-a660-3afda56d396b tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:16:36.814691 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7d3c3dec-c4be-4fa7-a660-3afda56d396b tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:16:36.815356 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7d3c3dec-c4be-4fa7-a660-3afda56d396b tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:16:37.213094 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-7d3c3dec-c4be-4fa7-a660-3afda56d396b tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af17546ab4745d8b92eab4f5c3ebb14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173beeb5bce346eabf2a2d19f4c381d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:16:37.234921 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-7d3c3dec-c4be-4fa7-a660-3afda56d396b tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af17546ab4745d8b92eab4f5c3ebb14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173beeb5bce346eabf2a2d19f4c381d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:16:37.236359 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-7d3c3dec-c4be-4fa7-a660-3afda56d396b tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af17546ab4745d8b92eab4f5c3ebb14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173beeb5bce346eabf2a2d19f4c381d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:16:37.244702 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-7d3c3dec-c4be-4fa7-a660-3afda56d396b tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] 10.222.0.26 "GET /compute/v2.1/servers/3633db12-958e-4062-879a-609e160649fc" status: 200 len: 1358 microversion: 2.21 time: 0.464250 Oct 08 21:16:37.245369 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2484/5033] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:16:36 2022] GET /compute/v2.1/servers/3633db12-958e-4062-879a-609e160649fc => generated 1358 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:16:38.272025 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-bbf091f7-d397-43ad-9f82-bd797dadc51a tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:16:38.276296 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-bbf091f7-d397-43ad-9f82-bd797dadc51a tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] [instance: 3633db12-958e-4062-879a-609e160649fc] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:16:38.284467 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bbf091f7-d397-43ad-9f82-bd797dadc51a tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:16:38.285231 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bbf091f7-d397-43ad-9f82-bd797dadc51a tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:16:38.285898 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bbf091f7-d397-43ad-9f82-bd797dadc51a tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:16:38.287079 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bbf091f7-d397-43ad-9f82-bd797dadc51a tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:16:38.287742 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bbf091f7-d397-43ad-9f82-bd797dadc51a tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:16:38.292317 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bbf091f7-d397-43ad-9f82-bd797dadc51a tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:16:38.809033 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-bbf091f7-d397-43ad-9f82-bd797dadc51a tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af17546ab4745d8b92eab4f5c3ebb14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173beeb5bce346eabf2a2d19f4c381d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:16:38.823208 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-bbf091f7-d397-43ad-9f82-bd797dadc51a tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af17546ab4745d8b92eab4f5c3ebb14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173beeb5bce346eabf2a2d19f4c381d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:16:38.825285 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-bbf091f7-d397-43ad-9f82-bd797dadc51a tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af17546ab4745d8b92eab4f5c3ebb14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173beeb5bce346eabf2a2d19f4c381d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:16:38.828667 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-bbf091f7-d397-43ad-9f82-bd797dadc51a tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] 10.222.0.26 "GET /compute/v2.1/servers/3633db12-958e-4062-879a-609e160649fc" status: 200 len: 1550 microversion: 2.21 time: 0.560789 Oct 08 21:16:38.832630 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2550/5034] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:16:38 2022] GET /compute/v2.1/servers/3633db12-958e-4062-879a-609e160649fc => generated 1550 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:16:38.866096 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-3b95d021-1043-49ff-941f-0dd2f19609c0 tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:16:38.867320 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-3b95d021-1043-49ff-941f-0dd2f19609c0 tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] [instance: 3633db12-958e-4062-879a-609e160649fc] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:16:38.900580 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3b95d021-1043-49ff-941f-0dd2f19609c0 tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:16:38.901316 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3b95d021-1043-49ff-941f-0dd2f19609c0 tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:16:38.901778 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3b95d021-1043-49ff-941f-0dd2f19609c0 tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:16:38.903249 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3b95d021-1043-49ff-941f-0dd2f19609c0 tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:16:38.904124 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3b95d021-1043-49ff-941f-0dd2f19609c0 tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:16:38.904758 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3b95d021-1043-49ff-941f-0dd2f19609c0 tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:16:38.971350 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-3b95d021-1043-49ff-941f-0dd2f19609c0 tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] [instance: 3633db12-958e-4062-879a-609e160649fc] Going to try to terminate instance {{(pid=140491) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 21:16:39.162628 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-3b95d021-1043-49ff-941f-0dd2f19609c0 tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] 10.222.0.26 "DELETE /compute/v2.1/servers/3633db12-958e-4062-879a-609e160649fc" status: 204 len: 0 microversion: 2.21 time: 0.307262 Oct 08 21:16:39.167191 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2485/5035] 10.222.0.26 () {60 vars in 1280 bytes} [Sat Oct 8 21:16:38 2022] DELETE /compute/v2.1/servers/3633db12-958e-4062-879a-609e160649fc => generated 0 bytes in 311 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 08 21:16:39.177587 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-f16396ad-fe76-4d69-91ba-071ce80feee3 tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:16:39.178630 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-f16396ad-fe76-4d69-91ba-071ce80feee3 tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] [instance: 3633db12-958e-4062-879a-609e160649fc] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:16:39.191498 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f16396ad-fe76-4d69-91ba-071ce80feee3 tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:16:39.192353 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f16396ad-fe76-4d69-91ba-071ce80feee3 tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:16:39.194075 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f16396ad-fe76-4d69-91ba-071ce80feee3 tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:16:39.195399 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f16396ad-fe76-4d69-91ba-071ce80feee3 tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:16:39.195963 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f16396ad-fe76-4d69-91ba-071ce80feee3 tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:16:39.201848 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f16396ad-fe76-4d69-91ba-071ce80feee3 tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:16:39.830888 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-f16396ad-fe76-4d69-91ba-071ce80feee3 tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af17546ab4745d8b92eab4f5c3ebb14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173beeb5bce346eabf2a2d19f4c381d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:16:39.867676 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-f16396ad-fe76-4d69-91ba-071ce80feee3 tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af17546ab4745d8b92eab4f5c3ebb14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173beeb5bce346eabf2a2d19f4c381d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:16:39.869817 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-f16396ad-fe76-4d69-91ba-071ce80feee3 tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af17546ab4745d8b92eab4f5c3ebb14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173beeb5bce346eabf2a2d19f4c381d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:16:39.873735 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-f16396ad-fe76-4d69-91ba-071ce80feee3 tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] 10.222.0.26 "GET /compute/v2.1/servers/3633db12-958e-4062-879a-609e160649fc" status: 200 len: 1556 microversion: 2.21 time: 0.704101 Oct 08 21:16:39.892507 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2551/5036] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:16:39 2022] GET /compute/v2.1/servers/3633db12-958e-4062-879a-609e160649fc => generated 1556 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:16:40.911190 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-6a7ac996-3655-4e6a-adc7-2b1fb9ec2f62 tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:16:40.912555 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-6a7ac996-3655-4e6a-adc7-2b1fb9ec2f62 tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] [instance: 3633db12-958e-4062-879a-609e160649fc] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:16:40.922713 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6a7ac996-3655-4e6a-adc7-2b1fb9ec2f62 tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:16:40.923599 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6a7ac996-3655-4e6a-adc7-2b1fb9ec2f62 tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:16:40.924483 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6a7ac996-3655-4e6a-adc7-2b1fb9ec2f62 tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:16:40.925529 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6a7ac996-3655-4e6a-adc7-2b1fb9ec2f62 tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:16:40.927003 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6a7ac996-3655-4e6a-adc7-2b1fb9ec2f62 tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:16:40.927689 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6a7ac996-3655-4e6a-adc7-2b1fb9ec2f62 tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:16:41.247132 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-6a7ac996-3655-4e6a-adc7-2b1fb9ec2f62 tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af17546ab4745d8b92eab4f5c3ebb14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173beeb5bce346eabf2a2d19f4c381d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:16:41.264036 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-6a7ac996-3655-4e6a-adc7-2b1fb9ec2f62 tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af17546ab4745d8b92eab4f5c3ebb14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173beeb5bce346eabf2a2d19f4c381d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:16:41.266502 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-6a7ac996-3655-4e6a-adc7-2b1fb9ec2f62 tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af17546ab4745d8b92eab4f5c3ebb14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173beeb5bce346eabf2a2d19f4c381d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:16:41.268375 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-6a7ac996-3655-4e6a-adc7-2b1fb9ec2f62 tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] 10.222.0.26 "GET /compute/v2.1/servers/3633db12-958e-4062-879a-609e160649fc" status: 200 len: 1556 microversion: 2.21 time: 0.361548 Oct 08 21:16:41.268929 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2486/5037] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:16:40 2022] GET /compute/v2.1/servers/3633db12-958e-4062-879a-609e160649fc => generated 1556 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:16:42.310311 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-15acee57-26ed-44af-8fc9-ea201238400d tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:16:42.310975 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-15acee57-26ed-44af-8fc9-ea201238400d tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] [instance: 3633db12-958e-4062-879a-609e160649fc] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:16:42.331183 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-15acee57-26ed-44af-8fc9-ea201238400d tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:16:42.333521 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-15acee57-26ed-44af-8fc9-ea201238400d tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:16:42.356734 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-15acee57-26ed-44af-8fc9-ea201238400d tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:16:42.358168 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-15acee57-26ed-44af-8fc9-ea201238400d tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:16:42.361723 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-15acee57-26ed-44af-8fc9-ea201238400d tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:16:42.362934 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-15acee57-26ed-44af-8fc9-ea201238400d tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:16:43.084736 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-15acee57-26ed-44af-8fc9-ea201238400d tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af17546ab4745d8b92eab4f5c3ebb14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173beeb5bce346eabf2a2d19f4c381d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:16:43.126323 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-15acee57-26ed-44af-8fc9-ea201238400d tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af17546ab4745d8b92eab4f5c3ebb14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173beeb5bce346eabf2a2d19f4c381d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:16:43.132315 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-15acee57-26ed-44af-8fc9-ea201238400d tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af17546ab4745d8b92eab4f5c3ebb14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173beeb5bce346eabf2a2d19f4c381d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:16:43.134465 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-15acee57-26ed-44af-8fc9-ea201238400d tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] 10.222.0.26 "GET /compute/v2.1/servers/3633db12-958e-4062-879a-609e160649fc" status: 200 len: 1556 microversion: 2.21 time: 0.841872 Oct 08 21:16:43.152147 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2552/5038] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:16:42 2022] GET /compute/v2.1/servers/3633db12-958e-4062-879a-609e160649fc => generated 1556 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:16:43.776117 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-22dff22a-bfd9-4941-a8ec-548fdcd226c7 req-42f1fa70-1b78-430b-aa9f-86ffd03d9671 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3633db12-958e-4062-879a-609e160649fc", "name": "network-vif-deleted", "tag": "298eda5e-080a-4d84-8330-ed0c82261057"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:16:43.888037 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-22dff22a-bfd9-4941-a8ec-548fdcd226c7 req-42f1fa70-1b78-430b-aa9f-86ffd03d9671 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:16:43.890126 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-22dff22a-bfd9-4941-a8ec-548fdcd226c7 req-42f1fa70-1b78-430b-aa9f-86ffd03d9671 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:16:43.891402 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-22dff22a-bfd9-4941-a8ec-548fdcd226c7 req-42f1fa70-1b78-430b-aa9f-86ffd03d9671 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:16:43.943277 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-22dff22a-bfd9-4941-a8ec-548fdcd226c7 req-42f1fa70-1b78-430b-aa9f-86ffd03d9671 service nova] Creating event network-vif-deleted:298eda5e-080a-4d84-8330-ed0c82261057 for instance 3633db12-958e-4062-879a-609e160649fc on nch1-master-1 Oct 08 21:16:43.962613 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-22dff22a-bfd9-4941-a8ec-548fdcd226c7 req-42f1fa70-1b78-430b-aa9f-86ffd03d9671 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.194810 Oct 08 21:16:43.970590 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2487/5039] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:16:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:16:44.168676 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-ef66b630-d324-4cc4-bbc8-ebf37af6523a tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:16:44.169088 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-ef66b630-d324-4cc4-bbc8-ebf37af6523a tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] [instance: 3633db12-958e-4062-879a-609e160649fc] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:16:44.186494 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ef66b630-d324-4cc4-bbc8-ebf37af6523a tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:16:44.190582 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ef66b630-d324-4cc4-bbc8-ebf37af6523a tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:16:44.191315 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ef66b630-d324-4cc4-bbc8-ebf37af6523a tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:16:44.192329 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ef66b630-d324-4cc4-bbc8-ebf37af6523a tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:16:44.195508 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ef66b630-d324-4cc4-bbc8-ebf37af6523a tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:16:44.195508 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ef66b630-d324-4cc4-bbc8-ebf37af6523a tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:16:44.310665 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ef66b630-d324-4cc4-bbc8-ebf37af6523a tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:16:44.311172 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ef66b630-d324-4cc4-bbc8-ebf37af6523a tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:16:44.312133 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ef66b630-d324-4cc4-bbc8-ebf37af6523a tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:16:44.312614 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.objects.instance [None req-ef66b630-d324-4cc4-bbc8-ebf37af6523a tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Lazy-loading 'fault' on Instance uuid 3633db12-958e-4062-879a-609e160649fc {{(pid=140492) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 21:16:44.571871 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-ef66b630-d324-4cc4-bbc8-ebf37af6523a tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af17546ab4745d8b92eab4f5c3ebb14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173beeb5bce346eabf2a2d19f4c381d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:16:44.585990 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-ef66b630-d324-4cc4-bbc8-ebf37af6523a tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af17546ab4745d8b92eab4f5c3ebb14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173beeb5bce346eabf2a2d19f4c381d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:16:44.587833 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-ef66b630-d324-4cc4-bbc8-ebf37af6523a tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af17546ab4745d8b92eab4f5c3ebb14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173beeb5bce346eabf2a2d19f4c381d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:16:44.593047 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-ef66b630-d324-4cc4-bbc8-ebf37af6523a tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] 10.222.0.26 "GET /compute/v2.1/servers/3633db12-958e-4062-879a-609e160649fc" status: 200 len: 1348 microversion: 2.21 time: 0.430237 Oct 08 21:16:44.598704 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2553/5040] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:16:44 2022] GET /compute/v2.1/servers/3633db12-958e-4062-879a-609e160649fc => generated 1348 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 08 21:16:45.632501 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-5d831f1d-9432-4c38-88f8-064a988c989b tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:16:45.633852 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-5d831f1d-9432-4c38-88f8-064a988c989b tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] [instance: 3633db12-958e-4062-879a-609e160649fc] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:16:45.647550 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5d831f1d-9432-4c38-88f8-064a988c989b tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:16:45.660022 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5d831f1d-9432-4c38-88f8-064a988c989b tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:16:45.660851 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5d831f1d-9432-4c38-88f8-064a988c989b tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:16:45.661807 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5d831f1d-9432-4c38-88f8-064a988c989b tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:16:45.663384 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5d831f1d-9432-4c38-88f8-064a988c989b tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:16:45.664657 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5d831f1d-9432-4c38-88f8-064a988c989b tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:16:45.707479 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-5d831f1d-9432-4c38-88f8-064a988c989b tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] HTTP exception thrown: Instance 3633db12-958e-4062-879a-609e160649fc could not be found. Oct 08 21:16:45.712987 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-5d831f1d-9432-4c38-88f8-064a988c989b tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Request method failure captured: Oct 08 21:16:45.712987 ncdv-master-1 devstack@n-api.service[140491]: request: GET /compute/v2.1/servers/3633db12-958e-4062-879a-609e160649fc HTTP/1.1 Oct 08 21:16:45.712987 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:16:45.712987 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:16:45.712987 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:16:45.712987 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 21:16:45.712987 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:16:45.712987 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:16:45.712987 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:16:45.712987 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:16:45.712987 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeicFYJsOzBeIVr8zGlX_HjG6fOU7d5HDVy3q-hgFGNLc1bstyyzV8p0KjRQCIPQJcYVESClPhKbhMc-4lrIG7b3hZE6TdPRdwcfaRSBvkQaT0tD88XnogGZXPSheLL8OLKk9U3Yg5nxYM2nbdKyw6bGARfvP1rdZFoa69_17iaPSaE Oct 08 21:16:45.712987 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:16:45.712987 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:16:45.712987 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:16:45.712987 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:16:45.712987 ncdv-master-1 devstack@n-api.service[140491]: X-Openstack-Nova-Api-Version: 2.21 Oct 08 21:16:45.712987 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:16:45.712987 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:16:45.712987 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 173beeb5bce346eabf2a2d19f4c381d6 Oct 08 21:16:45.712987 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1007002786 Oct 08 21:16:45.712987 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:16:45.712987 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:16:45.712987 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/173beeb5bce346eabf2a2d19f4c381d6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/173beeb5bce346eabf2a2d19f4c381d6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_173beeb5bce346eabf2a2d19f4c381d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/173beeb5bce346eabf2a2d19f4c381d6"}]}] Oct 08 21:16:45.712987 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-InstanceActionsV221TestJSON-1007002786 Oct 08 21:16:45.712987 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 173beeb5bce346eabf2a2d19f4c381d6 Oct 08 21:16:45.712987 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1007002786 Oct 08 21:16:45.712987 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-InstanceActionsV221TestJSON-1007002786-project Oct 08 21:16:45.712987 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:16:45.712987 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:16:45.712987 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 1af17546ab4745d8b92eab4f5c3ebb14 Oct 08 21:16:45.712987 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-InstanceActionsV221TestJSON-1007002786-project Oct 08 21:16:45.712987 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:16:45.712987 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance 3633db12-958e-4062-879a-609e160649fc could not be found. Oct 08 21:16:45.712987 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': '3633db12-958e-4062-879a-609e160649fc'} Oct 08 21:16:45.712987 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:16:45.712987 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:16:45.712987 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:16:45.712987 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:16:45.712987 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:16:45.712987 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:16:45.712987 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:16:45.712987 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:16:45.712987 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:16:45.712987 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:16:45.712987 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3633db12-958e-4062-879a-609e160649fc could not be found. Oct 08 21:16:45.712987 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:16:45.712987 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:16:45.712987 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:16:45.712987 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:16:45.712987 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:16:45.712987 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:16:45.712987 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:16:45.712987 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:16:45.712987 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:16:45.712987 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:16:45.712987 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:16:45.712987 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:16:45.712987 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:16:45.712987 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:16:45.712987 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:16:45.712987 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:16:45.712987 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3633db12-958e-4062-879a-609e160649fc could not be found. Oct 08 21:16:45.712987 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:16:45.712987 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:16:45.716612 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:16:45.716612 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:16:45.716612 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:16:45.716612 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:16:45.716612 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:16:45.716612 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:16:45.716612 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3633db12-958e-4062-879a-609e160649fc could not be found. Oct 08 21:16:45.716612 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:16:45.719499 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-5d831f1d-9432-4c38-88f8-064a988c989b tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Returning 404 to user: Instance 3633db12-958e-4062-879a-609e160649fc could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:16:45.721534 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-5d831f1d-9432-4c38-88f8-064a988c989b tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] 10.222.0.26 "GET /compute/v2.1/servers/3633db12-958e-4062-879a-609e160649fc" status: 404 len: 111 microversion: 2.21 time: 0.099079 Oct 08 21:16:45.724818 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2488/5041] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:16:45 2022] GET /compute/v2.1/servers/3633db12-958e-4062-879a-609e160649fc => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 08 21:16:45.731421 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-ea5c5d1d-08e9-4fde-96d3-b12551f87b02 tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Calling method '.version_select at 0x7f1a8c156160>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:16:45.732028 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-ea5c5d1d-08e9-4fde-96d3-b12551f87b02 tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] [instance: 3633db12-958e-4062-879a-609e160649fc] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:16:45.742292 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ea5c5d1d-08e9-4fde-96d3-b12551f87b02 tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:16:45.744710 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ea5c5d1d-08e9-4fde-96d3-b12551f87b02 tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:16:45.745927 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ea5c5d1d-08e9-4fde-96d3-b12551f87b02 tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:16:45.746683 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ea5c5d1d-08e9-4fde-96d3-b12551f87b02 tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:16:45.747151 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ea5c5d1d-08e9-4fde-96d3-b12551f87b02 tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:16:45.747582 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ea5c5d1d-08e9-4fde-96d3-b12551f87b02 tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:16:45.960321 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-ea5c5d1d-08e9-4fde-96d3-b12551f87b02 tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] 10.222.0.26 "GET /compute/v2.1/servers/3633db12-958e-4062-879a-609e160649fc/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.233085 Oct 08 21:16:45.978909 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-2cf558d3-e12b-431b-8606-adc4363dfe64 tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:16:45.979617 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-2cf558d3-e12b-431b-8606-adc4363dfe64 tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] [instance: 3633db12-958e-4062-879a-609e160649fc] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:16:45.985075 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2554/5042] 10.222.0.26 () {60 vars in 1337 bytes} [Sat Oct 8 21:16:45 2022] GET /compute/v2.1/servers/3633db12-958e-4062-879a-609e160649fc/os-instance-actions => generated 611 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 08 21:16:45.995859 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2cf558d3-e12b-431b-8606-adc4363dfe64 tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:16:45.997662 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2cf558d3-e12b-431b-8606-adc4363dfe64 tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:16:46.001167 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2cf558d3-e12b-431b-8606-adc4363dfe64 tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:16:46.002852 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2cf558d3-e12b-431b-8606-adc4363dfe64 tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:16:46.003446 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2cf558d3-e12b-431b-8606-adc4363dfe64 tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:16:46.004722 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2cf558d3-e12b-431b-8606-adc4363dfe64 tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:16:46.039141 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-2cf558d3-e12b-431b-8606-adc4363dfe64 tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] HTTP exception thrown: Instance 3633db12-958e-4062-879a-609e160649fc could not be found. Oct 08 21:16:46.048652 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-2cf558d3-e12b-431b-8606-adc4363dfe64 tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Request method failure captured: Oct 08 21:16:46.048652 ncdv-master-1 devstack@n-api.service[140491]: request: DELETE /compute/v2.1/servers/3633db12-958e-4062-879a-609e160649fc HTTP/1.1 Oct 08 21:16:46.048652 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:16:46.048652 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:16:46.048652 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:16:46.048652 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 21:16:46.048652 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:16:46.048652 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:16:46.048652 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:16:46.048652 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:16:46.048652 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeicFYJsOzBeIVr8zGlX_HjG6fOU7d5HDVy3q-hgFGNLc1bstyyzV8p0KjRQCIPQJcYVESClPhKbhMc-4lrIG7b3hZE6TdPRdwcfaRSBvkQaT0tD88XnogGZXPSheLL8OLKk9U3Yg5nxYM2nbdKyw6bGARfvP1rdZFoa69_17iaPSaE Oct 08 21:16:46.048652 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:16:46.048652 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:16:46.048652 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:16:46.048652 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:16:46.048652 ncdv-master-1 devstack@n-api.service[140491]: X-Openstack-Nova-Api-Version: 2.21 Oct 08 21:16:46.048652 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:16:46.048652 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:16:46.048652 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 173beeb5bce346eabf2a2d19f4c381d6 Oct 08 21:16:46.048652 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1007002786 Oct 08 21:16:46.048652 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:16:46.048652 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:16:46.048652 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/173beeb5bce346eabf2a2d19f4c381d6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/173beeb5bce346eabf2a2d19f4c381d6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_173beeb5bce346eabf2a2d19f4c381d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/173beeb5bce346eabf2a2d19f4c381d6"}]}] Oct 08 21:16:46.048652 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-InstanceActionsV221TestJSON-1007002786 Oct 08 21:16:46.048652 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 173beeb5bce346eabf2a2d19f4c381d6 Oct 08 21:16:46.048652 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1007002786 Oct 08 21:16:46.048652 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-InstanceActionsV221TestJSON-1007002786-project Oct 08 21:16:46.048652 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:16:46.048652 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:16:46.048652 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 1af17546ab4745d8b92eab4f5c3ebb14 Oct 08 21:16:46.048652 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-InstanceActionsV221TestJSON-1007002786-project Oct 08 21:16:46.048652 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:16:46.048652 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance 3633db12-958e-4062-879a-609e160649fc could not be found. Oct 08 21:16:46.048652 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': '3633db12-958e-4062-879a-609e160649fc'} Oct 08 21:16:46.048652 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:16:46.048652 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:16:46.048652 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:16:46.048652 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:16:46.048652 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:16:46.048652 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:16:46.048652 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:16:46.048652 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:16:46.048652 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:16:46.048652 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:16:46.048652 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3633db12-958e-4062-879a-609e160649fc could not be found. Oct 08 21:16:46.048652 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:16:46.048652 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:16:46.048652 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:16:46.048652 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:16:46.048652 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:16:46.048652 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:16:46.048652 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:16:46.048652 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:16:46.048652 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:16:46.048652 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:16:46.048652 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 08 21:16:46.048652 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 08 21:16:46.048652 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 08 21:16:46.048652 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 08 21:16:46.048652 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:16:46.048652 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:16:46.048652 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:16:46.048652 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:16:46.051957 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3633db12-958e-4062-879a-609e160649fc could not be found. Oct 08 21:16:46.051957 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:16:46.051957 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:16:46.051957 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:16:46.051957 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:16:46.051957 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:16:46.051957 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:16:46.051957 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:16:46.051957 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:16:46.051957 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3633db12-958e-4062-879a-609e160649fc could not be found. Oct 08 21:16:46.051957 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:16:46.051957 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-2cf558d3-e12b-431b-8606-adc4363dfe64 tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Returning 404 to user: Instance 3633db12-958e-4062-879a-609e160649fc could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:16:46.058166 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-2cf558d3-e12b-431b-8606-adc4363dfe64 tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] 10.222.0.26 "DELETE /compute/v2.1/servers/3633db12-958e-4062-879a-609e160649fc" status: 404 len: 111 microversion: 2.21 time: 0.076578 Oct 08 21:16:46.069570 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-60917fcd-026c-4baf-859e-392e6064ed9c tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:16:46.070416 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-60917fcd-026c-4baf-859e-392e6064ed9c tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] [instance: 3633db12-958e-4062-879a-609e160649fc] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:16:46.076807 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2489/5043] 10.222.0.26 () {60 vars in 1280 bytes} [Sat Oct 8 21:16:45 2022] DELETE /compute/v2.1/servers/3633db12-958e-4062-879a-609e160649fc => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 08 21:16:46.079404 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-60917fcd-026c-4baf-859e-392e6064ed9c tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:16:46.079913 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-60917fcd-026c-4baf-859e-392e6064ed9c tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:16:46.080358 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-60917fcd-026c-4baf-859e-392e6064ed9c tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:16:46.086736 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-60917fcd-026c-4baf-859e-392e6064ed9c tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:16:46.087393 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-60917fcd-026c-4baf-859e-392e6064ed9c tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:16:46.088075 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-60917fcd-026c-4baf-859e-392e6064ed9c tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:16:46.121828 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-60917fcd-026c-4baf-859e-392e6064ed9c tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] HTTP exception thrown: Instance 3633db12-958e-4062-879a-609e160649fc could not be found. Oct 08 21:16:46.131624 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-60917fcd-026c-4baf-859e-392e6064ed9c tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Request method failure captured: Oct 08 21:16:46.131624 ncdv-master-1 devstack@n-api.service[140492]: request: GET /compute/v2.1/servers/3633db12-958e-4062-879a-609e160649fc HTTP/1.1 Oct 08 21:16:46.131624 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:16:46.131624 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:16:46.131624 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:16:46.131624 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 21:16:46.131624 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:16:46.131624 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:16:46.131624 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:16:46.131624 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:16:46.131624 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeicFYJsOzBeIVr8zGlX_HjG6fOU7d5HDVy3q-hgFGNLc1bstyyzV8p0KjRQCIPQJcYVESClPhKbhMc-4lrIG7b3hZE6TdPRdwcfaRSBvkQaT0tD88XnogGZXPSheLL8OLKk9U3Yg5nxYM2nbdKyw6bGARfvP1rdZFoa69_17iaPSaE Oct 08 21:16:46.131624 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:16:46.131624 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:16:46.131624 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:16:46.131624 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:16:46.131624 ncdv-master-1 devstack@n-api.service[140492]: X-Openstack-Nova-Api-Version: 2.21 Oct 08 21:16:46.131624 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:16:46.131624 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:16:46.131624 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 173beeb5bce346eabf2a2d19f4c381d6 Oct 08 21:16:46.131624 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1007002786 Oct 08 21:16:46.131624 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:16:46.131624 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:16:46.131624 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/173beeb5bce346eabf2a2d19f4c381d6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/173beeb5bce346eabf2a2d19f4c381d6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_173beeb5bce346eabf2a2d19f4c381d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/173beeb5bce346eabf2a2d19f4c381d6"}]}] Oct 08 21:16:46.131624 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-InstanceActionsV221TestJSON-1007002786 Oct 08 21:16:46.131624 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 173beeb5bce346eabf2a2d19f4c381d6 Oct 08 21:16:46.131624 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1007002786 Oct 08 21:16:46.131624 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-InstanceActionsV221TestJSON-1007002786-project Oct 08 21:16:46.131624 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:16:46.131624 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:16:46.131624 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 1af17546ab4745d8b92eab4f5c3ebb14 Oct 08 21:16:46.131624 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-InstanceActionsV221TestJSON-1007002786-project Oct 08 21:16:46.131624 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 21:16:46.131624 ncdv-master-1 devstack@n-api.service[140492]: exception: Instance 3633db12-958e-4062-879a-609e160649fc could not be found. Oct 08 21:16:46.131624 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': '3633db12-958e-4062-879a-609e160649fc'} Oct 08 21:16:46.131624 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:16:46.131624 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:16:46.131624 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:16:46.131624 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:16:46.131624 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:16:46.131624 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:16:46.131624 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:16:46.131624 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:16:46.131624 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:16:46.131624 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:16:46.131624 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3633db12-958e-4062-879a-609e160649fc could not be found. Oct 08 21:16:46.131624 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:16:46.131624 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:16:46.131624 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:16:46.131624 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:16:46.131624 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:16:46.131624 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:16:46.131624 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:16:46.131624 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:16:46.131624 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:16:46.131624 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:16:46.131624 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:16:46.131624 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:16:46.131624 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:16:46.131624 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:16:46.131624 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:16:46.131624 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:16:46.131624 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3633db12-958e-4062-879a-609e160649fc could not be found. Oct 08 21:16:46.131624 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:16:46.131624 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:16:46.136460 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:16:46.136460 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:16:46.136460 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:16:46.136460 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:16:46.136460 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:16:46.136460 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:16:46.136460 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3633db12-958e-4062-879a-609e160649fc could not be found. Oct 08 21:16:46.136460 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:16:46.194503 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-60917fcd-026c-4baf-859e-392e6064ed9c tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] Returning 404 to user: Instance 3633db12-958e-4062-879a-609e160649fc could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:16:46.219348 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-60917fcd-026c-4baf-859e-392e6064ed9c tempest-InstanceActionsV221TestJSON-1007002786 tempest-InstanceActionsV221TestJSON-1007002786-project] 10.222.0.26 "GET /compute/v2.1/servers/3633db12-958e-4062-879a-609e160649fc" status: 404 len: 111 microversion: 2.21 time: 0.148961 Oct 08 21:16:46.220457 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2555/5044] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:16:46 2022] GET /compute/v2.1/servers/3633db12-958e-4062-879a-609e160649fc => generated 111 bytes in 157 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 08 21:16:51.103467 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-afd0af77-fcc2-40d7-bd08-62ea2393da00 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-920073972", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "networks": [{"uuid": "be27d1d5-9d06-4c17-b807-a0d071b49ca7"}]}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:16:51.494040 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.network.neutron [None req-afd0af77-fcc2-40d7-bd08-62ea2393da00 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] validate_networks() for [('be27d1d5-9d06-4c17-b807-a0d071b49ca7', None, None, None, None, None)] {{(pid=140491) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 21:16:53.179847 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-afd0af77-fcc2-40d7-bd08-62ea2393da00 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Flavor limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 21:16:53.181105 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-afd0af77-fcc2-40d7-bd08-62ea2393da00 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Image limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 21:16:53.181872 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-afd0af77-fcc2-40d7-bd08-62ea2393da00 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Flavor pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 21:16:53.184416 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-afd0af77-fcc2-40d7-bd08-62ea2393da00 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Image pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 21:16:53.185299 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-afd0af77-fcc2-40d7-bd08-62ea2393da00 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 21:16:53.221456 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-afd0af77-fcc2-40d7-bd08-62ea2393da00 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:16:53.234648 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-afd0af77-fcc2-40d7-bd08-62ea2393da00 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:16:53.235473 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-afd0af77-fcc2-40d7-bd08-62ea2393da00 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:16:53.236660 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-afd0af77-fcc2-40d7-bd08-62ea2393da00 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:16:53.237980 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-afd0af77-fcc2-40d7-bd08-62ea2393da00 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:16:53.238767 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-afd0af77-fcc2-40d7-bd08-62ea2393da00 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:16:53.307753 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-afd0af77-fcc2-40d7-bd08-62ea2393da00 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Getting quotas for project 6fdea37d91ed431aa0dc780148174e5b. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:16:53.326853 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-afd0af77-fcc2-40d7-bd08-62ea2393da00 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Getting quotas for user 3a292ffe2c5c41ef8d281fa525792b16 and project 6fdea37d91ed431aa0dc780148174e5b. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:16:53.357875 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-afd0af77-fcc2-40d7-bd08-62ea2393da00 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Going to run 1 instances... {{(pid=140491) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 21:16:53.372240 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-afd0af77-fcc2-40d7-bd08-62ea2393da00 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] [instance: c9f0e8ec-d9e4-453f-ab5e-4b0d95a6a7cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c508bd7f-7db9-4b2c-af7c-be54a855c355',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140491) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 21:16:53.513084 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-afd0af77-fcc2-40d7-bd08-62ea2393da00 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.414546 Oct 08 21:16:53.520920 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2490/5045] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 21:16:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 2422 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 08 21:16:53.536796 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-1592a010-3d4b-45f3-99f3-2eed863db6ec tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:16:53.538281 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-1592a010-3d4b-45f3-99f3-2eed863db6ec tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] [instance: c9f0e8ec-d9e4-453f-ab5e-4b0d95a6a7cd] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:16:53.939104 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-1592a010-3d4b-45f3-99f3-2eed863db6ec tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a292ffe2c5c41ef8d281fa525792b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdea37d91ed431aa0dc780148174e5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:16:53.975878 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-1592a010-3d4b-45f3-99f3-2eed863db6ec tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] 10.222.0.26 "GET /compute/v2.1/servers/c9f0e8ec-d9e4-453f-ab5e-4b0d95a6a7cd" status: 200 len: 1218 microversion: 2.1 time: 0.449258 Oct 08 21:16:53.995353 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2556/5046] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:16:53 2022] GET /compute/v2.1/servers/c9f0e8ec-d9e4-453f-ab5e-4b0d95a6a7cd => generated 1218 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:16:55.008739 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-e1a51289-1dd8-4d2d-bab5-4dde46be696e tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:16:55.010107 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-e1a51289-1dd8-4d2d-bab5-4dde46be696e tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] [instance: c9f0e8ec-d9e4-453f-ab5e-4b0d95a6a7cd] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:16:55.024850 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e1a51289-1dd8-4d2d-bab5-4dde46be696e tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:16:55.027787 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e1a51289-1dd8-4d2d-bab5-4dde46be696e tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:16:55.028261 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e1a51289-1dd8-4d2d-bab5-4dde46be696e tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:16:55.029069 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e1a51289-1dd8-4d2d-bab5-4dde46be696e tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:16:55.029598 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e1a51289-1dd8-4d2d-bab5-4dde46be696e tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:16:55.031883 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e1a51289-1dd8-4d2d-bab5-4dde46be696e tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:16:55.136631 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-e1a51289-1dd8-4d2d-bab5-4dde46be696e tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a292ffe2c5c41ef8d281fa525792b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdea37d91ed431aa0dc780148174e5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:16:55.154036 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-e1a51289-1dd8-4d2d-bab5-4dde46be696e tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] 10.222.0.26 "GET /compute/v2.1/servers/c9f0e8ec-d9e4-453f-ab5e-4b0d95a6a7cd" status: 200 len: 1270 microversion: 2.1 time: 0.155508 Oct 08 21:16:55.154999 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2491/5047] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:16:54 2022] GET /compute/v2.1/servers/c9f0e8ec-d9e4-453f-ab5e-4b0d95a6a7cd => generated 1270 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:16:56.082748 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e49ce48f-ff19-4c05-8321-f9b39bc8e04c tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:16:56.083321 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-e49ce48f-ff19-4c05-8321-f9b39bc8e04c tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] [instance: bbd1c1d7-13a9-4c6f-b651-c1017efd922e] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:16:56.103367 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e49ce48f-ff19-4c05-8321-f9b39bc8e04c tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:16:56.103879 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e49ce48f-ff19-4c05-8321-f9b39bc8e04c tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:16:56.104320 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e49ce48f-ff19-4c05-8321-f9b39bc8e04c tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:16:56.105264 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e49ce48f-ff19-4c05-8321-f9b39bc8e04c tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:16:56.105872 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e49ce48f-ff19-4c05-8321-f9b39bc8e04c tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:16:56.106449 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e49ce48f-ff19-4c05-8321-f9b39bc8e04c tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:16:56.143795 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-e49ce48f-ff19-4c05-8321-f9b39bc8e04c tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] 10.222.0.26 "GET /compute/v2.1/servers/bbd1c1d7-13a9-4c6f-b651-c1017efd922e/ips" status: 200 len: 150 microversion: 2.1 time: 0.067477 Oct 08 21:16:56.144772 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2557/5048] 10.222.0.26 () {58 vars in 1248 bytes} [Sat Oct 8 21:16:56 2022] GET /compute/v2.1/servers/bbd1c1d7-13a9-4c6f-b651-c1017efd922e/ips => generated 150 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:16:56.159217 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-40f0db3a-de56-4403-9093-9f0561666f04 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "71c4c902-18fd-4291-83f7-50d37cc1baef"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:16:56.162976 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-40f0db3a-de56-4403-9093-9f0561666f04 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] [instance: bbd1c1d7-13a9-4c6f-b651-c1017efd922e] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:16:56.171774 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-40f0db3a-de56-4403-9093-9f0561666f04 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:16:56.177921 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-63a8d355-89f8-43a3-bf81-54ba6256d2c8 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:16:56.178812 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-63a8d355-89f8-43a3-bf81-54ba6256d2c8 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] [instance: c9f0e8ec-d9e4-453f-ab5e-4b0d95a6a7cd] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:16:56.181112 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-40f0db3a-de56-4403-9093-9f0561666f04 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:16:56.183234 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-40f0db3a-de56-4403-9093-9f0561666f04 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:16:56.186227 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-40f0db3a-de56-4403-9093-9f0561666f04 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:16:56.187457 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-40f0db3a-de56-4403-9093-9f0561666f04 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:16:56.190540 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-40f0db3a-de56-4403-9093-9f0561666f04 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:16:56.193543 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-63a8d355-89f8-43a3-bf81-54ba6256d2c8 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:16:56.194206 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-63a8d355-89f8-43a3-bf81-54ba6256d2c8 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:16:56.194794 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-63a8d355-89f8-43a3-bf81-54ba6256d2c8 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:16:56.195756 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-63a8d355-89f8-43a3-bf81-54ba6256d2c8 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:16:56.196461 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-63a8d355-89f8-43a3-bf81-54ba6256d2c8 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:16:56.197096 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-63a8d355-89f8-43a3-bf81-54ba6256d2c8 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:16:56.343767 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-40f0db3a-de56-4403-9093-9f0561666f04 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] HTTP exception thrown: Invalid volume: volume 71c4c902-18fd-4291-83f7-50d37cc1baef is already attached to instances: aadddbb1-e053-420e-afd2-9412c6137504 Oct 08 21:16:56.347903 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-40f0db3a-de56-4403-9093-9f0561666f04 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Request method failure captured: Oct 08 21:16:56.347903 ncdv-master-1 devstack@n-api.service[140491]: request: POST /compute/v2.1/servers/bbd1c1d7-13a9-4c6f-b651-c1017efd922e/os-volume_attachments HTTP/1.1 Oct 08 21:16:56.347903 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:16:56.347903 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:16:56.347903 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:16:56.347903 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 74 Oct 08 21:16:56.347903 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:16:56.347903 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:16:56.347903 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:16:56.347903 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:16:56.347903 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQehFIbXs-DGbS_kPUTJMTrUq-WofUYY6ZRyx81bX8dlJ1znB-Icd1X0JZVfoU0lBZbBMu1x5OyOchM7_W_m4wVb0RC5emVnYRQT_LfKB9ZNZm3xjiiSMGa29vJwyibC7NFwQ_T90TzXkiQ39iaomvdVhCKn_tsPv5ogwGAe_Atzwiz8 Oct 08 21:16:56.347903 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:16:56.347903 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:16:56.347903 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:16:56.347903 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:16:56.347903 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:16:56.347903 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:16:56.347903 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 3d9d29b90ab34abbadd21edbca637d2e Oct 08 21:16:56.347903 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-AttachVolumeNegativeTest-1956575659 Oct 08 21:16:56.347903 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:16:56.347903 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:16:56.347903 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3d9d29b90ab34abbadd21edbca637d2e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3d9d29b90ab34abbadd21edbca637d2e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3d9d29b90ab34abbadd21edbca637d2e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3d9d29b90ab34abbadd21edbca637d2e"}]}] Oct 08 21:16:56.347903 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-AttachVolumeNegativeTest-1956575659 Oct 08 21:16:56.347903 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 3d9d29b90ab34abbadd21edbca637d2e Oct 08 21:16:56.347903 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1956575659 Oct 08 21:16:56.347903 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-AttachVolumeNegativeTest-1956575659-project Oct 08 21:16:56.347903 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:16:56.347903 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:16:56.347903 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 8957041987c8487099f0d89f4c64af66 Oct 08 21:16:56.347903 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-AttachVolumeNegativeTest-1956575659-project Oct 08 21:16:56.347903 ncdv-master-1 devstack@n-api.service[140491]: Oct 08 21:16:56.347903 ncdv-master-1 devstack@n-api.service[140491]: {"volumeAttachment": {"volumeId": "71c4c902-18fd-4291-83f7-50d37cc1baef"}} Oct 08 21:16:56.347903 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:16:56.347903 ncdv-master-1 devstack@n-api.service[140491]: exception: Invalid volume: volume 71c4c902-18fd-4291-83f7-50d37cc1baef is already attached to instances: aadddbb1-e053-420e-afd2-9412c6137504 Oct 08 21:16:56.347903 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'server_id': 'bbd1c1d7-13a9-4c6f-b651-c1017efd922e', 'body': {'volumeAttachment': {'volumeId': '71c4c902-18fd-4291-83f7-50d37cc1baef'}}} Oct 08 21:16:56.347903 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:16:56.347903 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:16:56.347903 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 08 21:16:56.347903 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 08 21:16:56.347903 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 08 21:16:56.347903 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 08 21:16:56.347903 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 08 21:16:56.347903 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 08 21:16:56.347903 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 08 21:16:56.347903 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 08 21:16:56.347903 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 08 21:16:56.347903 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 08 21:16:56.347903 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 71c4c902-18fd-4291-83f7-50d37cc1baef is already attached to instances: aadddbb1-e053-420e-afd2-9412c6137504 Oct 08 21:16:56.347903 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:16:56.347903 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:16:56.347903 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:16:56.347903 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:16:56.347903 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:16:56.347903 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:16:56.347903 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:16:56.347903 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:16:56.347903 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:16:56.347903 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:16:56.347903 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 21:16:56.347903 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 21:16:56.347903 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 21:16:56.347903 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 21:16:56.354088 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 21:16:56.354088 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 21:16:56.354088 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 08 21:16:56.354088 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 08 21:16:56.354088 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 71c4c902-18fd-4291-83f7-50d37cc1baef is already attached to instances: aadddbb1-e053-420e-afd2-9412c6137504 Oct 08 21:16:56.354088 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:16:56.354088 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:16:56.354088 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:16:56.354088 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:16:56.354088 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:16:56.354088 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:16:56.354088 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:16:56.354088 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:16:56.354088 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 71c4c902-18fd-4291-83f7-50d37cc1baef is already attached to instances: aadddbb1-e053-420e-afd2-9412c6137504 Oct 08 21:16:56.354088 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:16:56.354088 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-40f0db3a-de56-4403-9093-9f0561666f04 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Returning 400 to user: Invalid volume: volume 71c4c902-18fd-4291-83f7-50d37cc1baef is already attached to instances: aadddbb1-e053-420e-afd2-9412c6137504 {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:16:56.358063 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-40f0db3a-de56-4403-9093-9f0561666f04 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] 10.222.0.26 "POST /compute/v2.1/servers/bbd1c1d7-13a9-4c6f-b651-c1017efd922e/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.201649 Oct 08 21:16:56.358673 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-63a8d355-89f8-43a3-bf81-54ba6256d2c8 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a292ffe2c5c41ef8d281fa525792b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdea37d91ed431aa0dc780148174e5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:16:56.361493 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2492/5049] 10.222.0.26 () {60 vars in 1323 bytes} [Sat Oct 8 21:16:56 2022] POST /compute/v2.1/servers/bbd1c1d7-13a9-4c6f-b651-c1017efd922e/os-volume_attachments => generated 174 bytes in 208 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 08 21:16:56.369069 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-3bada7a1-0ad4-4655-8f7c-5734cf026eed tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:16:56.369804 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-3bada7a1-0ad4-4655-8f7c-5734cf026eed tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] [instance: bbd1c1d7-13a9-4c6f-b651-c1017efd922e] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:16:56.371544 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-63a8d355-89f8-43a3-bf81-54ba6256d2c8 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] 10.222.0.26 "GET /compute/v2.1/servers/c9f0e8ec-d9e4-453f-ab5e-4b0d95a6a7cd" status: 200 len: 1276 microversion: 2.1 time: 0.195720 Oct 08 21:16:56.378945 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2558/5050] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:16:56 2022] GET /compute/v2.1/servers/c9f0e8ec-d9e4-453f-ab5e-4b0d95a6a7cd => generated 1276 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:16:56.388904 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3bada7a1-0ad4-4655-8f7c-5734cf026eed tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:16:56.389469 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3bada7a1-0ad4-4655-8f7c-5734cf026eed tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:16:56.390473 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3bada7a1-0ad4-4655-8f7c-5734cf026eed tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:16:56.391212 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3bada7a1-0ad4-4655-8f7c-5734cf026eed tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:16:56.394920 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3bada7a1-0ad4-4655-8f7c-5734cf026eed tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:16:56.395658 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3bada7a1-0ad4-4655-8f7c-5734cf026eed tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:16:56.473288 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-3bada7a1-0ad4-4655-8f7c-5734cf026eed tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] [instance: bbd1c1d7-13a9-4c6f-b651-c1017efd922e] Going to try to terminate instance {{(pid=140491) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 21:16:56.663669 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-3bada7a1-0ad4-4655-8f7c-5734cf026eed tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] 10.222.0.26 "DELETE /compute/v2.1/servers/bbd1c1d7-13a9-4c6f-b651-c1017efd922e" status: 204 len: 0 microversion: 2.1 time: 0.298237 Oct 08 21:16:56.668404 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2493/5051] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:16:56 2022] DELETE /compute/v2.1/servers/bbd1c1d7-13a9-4c6f-b651-c1017efd922e => generated 0 bytes in 301 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 21:16:56.676639 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-de175ead-9e72-4f25-a29b-91d058f7e3ab tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:16:56.677774 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-de175ead-9e72-4f25-a29b-91d058f7e3ab tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] [instance: bbd1c1d7-13a9-4c6f-b651-c1017efd922e] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:16:56.689086 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-de175ead-9e72-4f25-a29b-91d058f7e3ab tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:16:56.690164 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-de175ead-9e72-4f25-a29b-91d058f7e3ab tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:16:56.690916 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-de175ead-9e72-4f25-a29b-91d058f7e3ab tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:16:56.692101 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-de175ead-9e72-4f25-a29b-91d058f7e3ab tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:16:56.693813 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-de175ead-9e72-4f25-a29b-91d058f7e3ab tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:16:56.693813 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-de175ead-9e72-4f25-a29b-91d058f7e3ab tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:16:57.028903 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-de175ead-9e72-4f25-a29b-91d058f7e3ab tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8957041987c8487099f0d89f4c64af66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9d29b90ab34abbadd21edbca637d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:16:57.040056 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-de175ead-9e72-4f25-a29b-91d058f7e3ab tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] 10.222.0.26 "GET /compute/v2.1/servers/bbd1c1d7-13a9-4c6f-b651-c1017efd922e" status: 200 len: 1682 microversion: 2.1 time: 0.370540 Oct 08 21:16:57.040860 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2559/5052] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:16:56 2022] GET /compute/v2.1/servers/bbd1c1d7-13a9-4c6f-b651-c1017efd922e => generated 1682 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:16:57.403518 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c8d3d260-f776-4eeb-bf45-72bb381896d0 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:16:57.404242 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-c8d3d260-f776-4eeb-bf45-72bb381896d0 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] [instance: c9f0e8ec-d9e4-453f-ab5e-4b0d95a6a7cd] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:16:57.411092 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c8d3d260-f776-4eeb-bf45-72bb381896d0 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:16:57.411608 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c8d3d260-f776-4eeb-bf45-72bb381896d0 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:16:57.412063 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c8d3d260-f776-4eeb-bf45-72bb381896d0 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:16:57.412795 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c8d3d260-f776-4eeb-bf45-72bb381896d0 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:16:57.437517 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c8d3d260-f776-4eeb-bf45-72bb381896d0 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:16:57.438096 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c8d3d260-f776-4eeb-bf45-72bb381896d0 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:16:58.065010 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-faa6280d-ccac-474d-9b92-6edbb95f48e7 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:16:58.067135 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-faa6280d-ccac-474d-9b92-6edbb95f48e7 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] [instance: bbd1c1d7-13a9-4c6f-b651-c1017efd922e] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:16:58.100281 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-faa6280d-ccac-474d-9b92-6edbb95f48e7 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:16:58.100749 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-faa6280d-ccac-474d-9b92-6edbb95f48e7 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:16:58.101628 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-faa6280d-ccac-474d-9b92-6edbb95f48e7 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:16:58.114182 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-faa6280d-ccac-474d-9b92-6edbb95f48e7 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:16:58.121888 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-faa6280d-ccac-474d-9b92-6edbb95f48e7 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:16:58.122630 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-faa6280d-ccac-474d-9b92-6edbb95f48e7 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:16:58.189328 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-c8d3d260-f776-4eeb-bf45-72bb381896d0 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a292ffe2c5c41ef8d281fa525792b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdea37d91ed431aa0dc780148174e5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:16:58.202743 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-c8d3d260-f776-4eeb-bf45-72bb381896d0 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] 10.222.0.26 "GET /compute/v2.1/servers/c9f0e8ec-d9e4-453f-ab5e-4b0d95a6a7cd" status: 200 len: 1318 microversion: 2.1 time: 0.803030 Oct 08 21:16:58.203710 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2494/5053] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:16:57 2022] GET /compute/v2.1/servers/c9f0e8ec-d9e4-453f-ab5e-4b0d95a6a7cd => generated 1318 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:16:59.168755 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-faa6280d-ccac-474d-9b92-6edbb95f48e7 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8957041987c8487099f0d89f4c64af66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9d29b90ab34abbadd21edbca637d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:16:59.180516 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-faa6280d-ccac-474d-9b92-6edbb95f48e7 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] 10.222.0.26 "GET /compute/v2.1/servers/bbd1c1d7-13a9-4c6f-b651-c1017efd922e" status: 200 len: 1682 microversion: 2.1 time: 1.120655 Oct 08 21:16:59.181129 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2560/5054] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:16:58 2022] GET /compute/v2.1/servers/bbd1c1d7-13a9-4c6f-b651-c1017efd922e => generated 1682 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:16:59.229692 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-fdbadab8-0d49-4ce8-bf86-20cd2615f35e tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:16:59.229692 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-fdbadab8-0d49-4ce8-bf86-20cd2615f35e tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] [instance: c9f0e8ec-d9e4-453f-ab5e-4b0d95a6a7cd] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:16:59.251208 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fdbadab8-0d49-4ce8-bf86-20cd2615f35e tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:16:59.253318 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fdbadab8-0d49-4ce8-bf86-20cd2615f35e tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:16:59.254615 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fdbadab8-0d49-4ce8-bf86-20cd2615f35e tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:16:59.255665 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fdbadab8-0d49-4ce8-bf86-20cd2615f35e tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:16:59.256439 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fdbadab8-0d49-4ce8-bf86-20cd2615f35e tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:16:59.259215 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fdbadab8-0d49-4ce8-bf86-20cd2615f35e tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:16:59.817291 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-fdbadab8-0d49-4ce8-bf86-20cd2615f35e tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a292ffe2c5c41ef8d281fa525792b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdea37d91ed431aa0dc780148174e5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:16:59.845765 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-fdbadab8-0d49-4ce8-bf86-20cd2615f35e tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] 10.222.0.26 "GET /compute/v2.1/servers/c9f0e8ec-d9e4-453f-ab5e-4b0d95a6a7cd" status: 200 len: 1318 microversion: 2.1 time: 0.621436 Oct 08 21:16:59.846249 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2495/5055] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:16:59 2022] GET /compute/v2.1/servers/c9f0e8ec-d9e4-453f-ab5e-4b0d95a6a7cd => generated 1318 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:17:00.206539 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-daa9876e-7088-4e24-a8e6-2dad293f8d8a tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:17:00.207313 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-daa9876e-7088-4e24-a8e6-2dad293f8d8a tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] [instance: bbd1c1d7-13a9-4c6f-b651-c1017efd922e] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:17:00.223163 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-daa9876e-7088-4e24-a8e6-2dad293f8d8a tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:17:00.223847 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-daa9876e-7088-4e24-a8e6-2dad293f8d8a tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:17:00.224472 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-daa9876e-7088-4e24-a8e6-2dad293f8d8a tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:17:00.225415 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-daa9876e-7088-4e24-a8e6-2dad293f8d8a tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:17:00.226033 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-daa9876e-7088-4e24-a8e6-2dad293f8d8a tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:17:00.227179 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-daa9876e-7088-4e24-a8e6-2dad293f8d8a tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:17:00.872053 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-3a7f30c9-3ef8-4144-87d3-a26e0ecbe638 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:17:00.872769 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-3a7f30c9-3ef8-4144-87d3-a26e0ecbe638 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] [instance: c9f0e8ec-d9e4-453f-ab5e-4b0d95a6a7cd] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:17:00.890065 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3a7f30c9-3ef8-4144-87d3-a26e0ecbe638 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:17:00.890612 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3a7f30c9-3ef8-4144-87d3-a26e0ecbe638 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:17:00.891075 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3a7f30c9-3ef8-4144-87d3-a26e0ecbe638 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:17:00.891821 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3a7f30c9-3ef8-4144-87d3-a26e0ecbe638 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:17:00.892297 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3a7f30c9-3ef8-4144-87d3-a26e0ecbe638 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:17:00.892739 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3a7f30c9-3ef8-4144-87d3-a26e0ecbe638 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:17:01.058941 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-daa9876e-7088-4e24-a8e6-2dad293f8d8a tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8957041987c8487099f0d89f4c64af66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9d29b90ab34abbadd21edbca637d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:17:01.075170 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-daa9876e-7088-4e24-a8e6-2dad293f8d8a tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] 10.222.0.26 "GET /compute/v2.1/servers/bbd1c1d7-13a9-4c6f-b651-c1017efd922e" status: 200 len: 1682 microversion: 2.1 time: 0.872200 Oct 08 21:17:01.090640 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2561/5056] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:17:00 2022] GET /compute/v2.1/servers/bbd1c1d7-13a9-4c6f-b651-c1017efd922e => generated 1682 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:17:01.403702 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-3a7f30c9-3ef8-4144-87d3-a26e0ecbe638 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a292ffe2c5c41ef8d281fa525792b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdea37d91ed431aa0dc780148174e5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:17:01.415653 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-3a7f30c9-3ef8-4144-87d3-a26e0ecbe638 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] 10.222.0.26 "GET /compute/v2.1/servers/c9f0e8ec-d9e4-453f-ab5e-4b0d95a6a7cd" status: 200 len: 1318 microversion: 2.1 time: 0.548097 Oct 08 21:17:01.426868 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2496/5057] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:17:00 2022] GET /compute/v2.1/servers/c9f0e8ec-d9e4-453f-ab5e-4b0d95a6a7cd => generated 1318 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:17:02.105808 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-10687162-5052-44eb-a6d8-471e0bce9ca4 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:17:02.107471 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-10687162-5052-44eb-a6d8-471e0bce9ca4 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] [instance: bbd1c1d7-13a9-4c6f-b651-c1017efd922e] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:17:02.139598 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-10687162-5052-44eb-a6d8-471e0bce9ca4 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:17:02.139837 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-10687162-5052-44eb-a6d8-471e0bce9ca4 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:17:02.140125 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-10687162-5052-44eb-a6d8-471e0bce9ca4 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:17:02.145509 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-10687162-5052-44eb-a6d8-471e0bce9ca4 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:17:02.146026 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-10687162-5052-44eb-a6d8-471e0bce9ca4 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:17:02.146483 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-10687162-5052-44eb-a6d8-471e0bce9ca4 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:17:02.445082 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-6b017538-d71b-440e-a5aa-2b5a84651904 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:17:02.445833 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-6b017538-d71b-440e-a5aa-2b5a84651904 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] [instance: c9f0e8ec-d9e4-453f-ab5e-4b0d95a6a7cd] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:17:02.455961 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:17:02.471097 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6b017538-d71b-440e-a5aa-2b5a84651904 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:17:02.472181 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6b017538-d71b-440e-a5aa-2b5a84651904 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:17:02.481618 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6b017538-d71b-440e-a5aa-2b5a84651904 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:17:02.482776 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6b017538-d71b-440e-a5aa-2b5a84651904 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:17:02.484247 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6b017538-d71b-440e-a5aa-2b5a84651904 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:17:02.491844 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6b017538-d71b-440e-a5aa-2b5a84651904 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:17:02.503578 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:17:02.650258 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-10687162-5052-44eb-a6d8-471e0bce9ca4 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8957041987c8487099f0d89f4c64af66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9d29b90ab34abbadd21edbca637d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:17:02.660843 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-10687162-5052-44eb-a6d8-471e0bce9ca4 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] 10.222.0.26 "GET /compute/v2.1/servers/bbd1c1d7-13a9-4c6f-b651-c1017efd922e" status: 200 len: 1614 microversion: 2.1 time: 0.560691 Oct 08 21:17:02.663121 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2562/5058] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:17:02 2022] GET /compute/v2.1/servers/bbd1c1d7-13a9-4c6f-b651-c1017efd922e => generated 1614 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:17:02.734512 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-6b017538-d71b-440e-a5aa-2b5a84651904 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a292ffe2c5c41ef8d281fa525792b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdea37d91ed431aa0dc780148174e5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:17:02.746302 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-6b017538-d71b-440e-a5aa-2b5a84651904 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] 10.222.0.26 "GET /compute/v2.1/servers/c9f0e8ec-d9e4-453f-ab5e-4b0d95a6a7cd" status: 200 len: 1318 microversion: 2.1 time: 0.307431 Oct 08 21:17:02.747350 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2497/5059] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:17:02 2022] GET /compute/v2.1/servers/c9f0e8ec-d9e4-453f-ab5e-4b0d95a6a7cd => generated 1318 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:17:02.928893 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-baf2c368-a65f-4907-bb8e-f8a7bfff2c5a tempest-MultipleCreateNegativeTestJSON-1576031157 tempest-MultipleCreateNegativeTestJSON-1576031157-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-417147912", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:17:02.933779 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-baf2c368-a65f-4907-bb8e-f8a7bfff2c5a tempest-MultipleCreateNegativeTestJSON-1576031157 tempest-MultipleCreateNegativeTestJSON-1576031157-project] HTTP exception thrown: min_count must be <= max_count Oct 08 21:17:02.935468 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-baf2c368-a65f-4907-bb8e-f8a7bfff2c5a tempest-MultipleCreateNegativeTestJSON-1576031157 tempest-MultipleCreateNegativeTestJSON-1576031157-project] Request method failure captured: Oct 08 21:17:02.935468 ncdv-master-1 devstack@n-api.service[140492]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 08 21:17:02.935468 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:17:02.935468 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:17:02.935468 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:17:02.935468 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 183 Oct 08 21:17:02.935468 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:17:02.935468 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:17:02.935468 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:17:02.935468 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:17:02.935468 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQejOHFJWFZbw43lX_t2OKu5BRPIqkUZ9Tzc9u5qAtfoWwyBb7RReLqMykpsY36Eb_BLYfywhSqduMk-_ws0HQIttr4bpe8TZao1Iw3CW78kpQxZwa82WLnyAK42aijXUQHeFNfvx3hr5Vu1VD2nVnArUaf_p8o9NLjs28XrvEVX1lcU Oct 08 21:17:02.935468 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:17:02.935468 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:17:02.935468 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:17:02.935468 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:17:02.935468 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:17:02.935468 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:17:02.935468 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 601b7d01a1044882ab0935fadcc65449 Oct 08 21:17:02.935468 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1576031157 Oct 08 21:17:02.935468 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:17:02.935468 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:17:02.935468 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/601b7d01a1044882ab0935fadcc65449"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/601b7d01a1044882ab0935fadcc65449"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_601b7d01a1044882ab0935fadcc65449"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/601b7d01a1044882ab0935fadcc65449"}]}] Oct 08 21:17:02.935468 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1576031157 Oct 08 21:17:02.935468 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 601b7d01a1044882ab0935fadcc65449 Oct 08 21:17:02.935468 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1576031157 Oct 08 21:17:02.935468 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-MultipleCreateNegativeTestJSON-1576031157-project Oct 08 21:17:02.935468 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:17:02.935468 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:17:02.935468 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 5ba12893b3764aae950d7e38ff22322e Oct 08 21:17:02.935468 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1576031157-project Oct 08 21:17:02.935468 ncdv-master-1 devstack@n-api.service[140492]: Oct 08 21:17:02.935468 ncdv-master-1 devstack@n-api.service[140492]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-417147912", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "min_count": 3, "max_count": 2}} Oct 08 21:17:02.935468 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 21:17:02.935468 ncdv-master-1 devstack@n-api.service[140492]: exception: min_count must be <= max_count Oct 08 21:17:02.935468 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-417147912', 'imageRef': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Oct 08 21:17:02.935468 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:17:02.935468 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:17:02.935468 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:17:02.935468 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:17:02.935468 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:17:02.935468 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:17:02.935468 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:17:02.935468 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:17:02.935468 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 21:17:02.935468 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 21:17:02.935468 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 21:17:02.935468 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 21:17:02.935468 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 21:17:02.935468 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 21:17:02.935468 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 08 21:17:02.935468 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Oct 08 21:17:02.935468 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 08 21:17:02.935468 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Oct 08 21:17:02.935468 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:17:02.935468 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:17:02.935468 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:17:02.935468 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:17:02.935468 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:17:02.935468 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:17:02.935468 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:17:02.935468 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:17:02.935468 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Oct 08 21:17:02.935468 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:17:02.940518 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-baf2c368-a65f-4907-bb8e-f8a7bfff2c5a tempest-MultipleCreateNegativeTestJSON-1576031157 tempest-MultipleCreateNegativeTestJSON-1576031157-project] Returning 400 to user: min_count must be <= max_count {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:17:02.941592 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-baf2c368-a65f-4907-bb8e-f8a7bfff2c5a tempest-MultipleCreateNegativeTestJSON-1576031157 tempest-MultipleCreateNegativeTestJSON-1576031157-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.277178 Oct 08 21:17:02.942328 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2563/5060] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 21:17:02 2022] POST /compute/v2.1/servers => generated 74 bytes in 278 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 08 21:17:03.022943 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-d56879fe-5156-42ac-967a-97e10988a6f9 tempest-MultipleCreateNegativeTestJSON-1576031157 tempest-MultipleCreateNegativeTestJSON-1576031157-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1961069617", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "max_count": 0}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:17:03.029832 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-d56879fe-5156-42ac-967a-97e10988a6f9 tempest-MultipleCreateNegativeTestJSON-1576031157 tempest-MultipleCreateNegativeTestJSON-1576031157-project] Request method failure captured: Oct 08 21:17:03.029832 ncdv-master-1 devstack@n-api.service[140491]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 08 21:17:03.029832 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:17:03.029832 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:17:03.029832 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:17:03.029832 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 168 Oct 08 21:17:03.029832 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:17:03.029832 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:17:03.029832 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:17:03.029832 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:17:03.029832 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQejOHFJWFZbw43lX_t2OKu5BRPIqkUZ9Tzc9u5qAtfoWwyBb7RReLqMykpsY36Eb_BLYfywhSqduMk-_ws0HQIttr4bpe8TZao1Iw3CW78kpQxZwa82WLnyAK42aijXUQHeFNfvx3hr5Vu1VD2nVnArUaf_p8o9NLjs28XrvEVX1lcU Oct 08 21:17:03.029832 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:17:03.029832 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:17:03.029832 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:17:03.029832 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:17:03.029832 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:17:03.029832 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:17:03.029832 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 601b7d01a1044882ab0935fadcc65449 Oct 08 21:17:03.029832 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1576031157 Oct 08 21:17:03.029832 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:17:03.029832 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:17:03.029832 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/601b7d01a1044882ab0935fadcc65449"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/601b7d01a1044882ab0935fadcc65449"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_601b7d01a1044882ab0935fadcc65449"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/601b7d01a1044882ab0935fadcc65449"}]}] Oct 08 21:17:03.029832 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1576031157 Oct 08 21:17:03.029832 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 601b7d01a1044882ab0935fadcc65449 Oct 08 21:17:03.029832 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1576031157 Oct 08 21:17:03.029832 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-MultipleCreateNegativeTestJSON-1576031157-project Oct 08 21:17:03.029832 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:17:03.029832 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:17:03.029832 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 5ba12893b3764aae950d7e38ff22322e Oct 08 21:17:03.029832 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1576031157-project Oct 08 21:17:03.029832 ncdv-master-1 devstack@n-api.service[140491]: Oct 08 21:17:03.029832 ncdv-master-1 devstack@n-api.service[140491]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1961069617", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "max_count": 0}} Oct 08 21:17:03.029832 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:17:03.029832 ncdv-master-1 devstack@n-api.service[140491]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 08 21:17:03.029832 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1961069617', 'imageRef': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'flavorRef': '452', 'max_count': 0}}} Oct 08 21:17:03.029832 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:17:03.029832 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:17:03.029832 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 08 21:17:03.029832 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 08 21:17:03.029832 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 08 21:17:03.029832 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise error Oct 08 21:17:03.029832 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 08 21:17:03.029832 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:17:03.029832 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Oct 08 21:17:03.029832 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 08 21:17:03.029832 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 08 21:17:03.029832 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 08 21:17:03.029832 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 08 21:17:03.029832 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:17:03.029832 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 08 21:17:03.029832 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi 0 Oct 08 21:17:03.029832 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:17:03.029832 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:17:03.029832 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:17:03.029832 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:17:03.029832 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:17:03.029832 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:17:03.029832 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:17:03.029832 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:17:03.029832 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:17:03.029832 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:17:03.029832 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 21:17:03.029832 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 21:17:03.029832 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 08 21:17:03.029832 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 08 21:17:03.034441 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 08 21:17:03.034441 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 08 21:17:03.034441 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 08 21:17:03.034441 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 08 21:17:03.034441 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 08 21:17:03.034441 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:17:03.034441 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:17:03.034441 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:17:03.034441 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:17:03.034441 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:17:03.034441 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:17:03.034441 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 08 21:17:03.034441 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 08 21:17:03.034441 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 08 21:17:03.034441 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:17:03.036726 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-d56879fe-5156-42ac-967a-97e10988a6f9 tempest-MultipleCreateNegativeTestJSON-1576031157 tempest-MultipleCreateNegativeTestJSON-1576031157-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:17:03.038072 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-d56879fe-5156-42ac-967a-97e10988a6f9 tempest-MultipleCreateNegativeTestJSON-1576031157 tempest-MultipleCreateNegativeTestJSON-1576031157-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.019957 Oct 08 21:17:03.039473 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2498/5061] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 21:17:03 2022] POST /compute/v2.1/servers => generated 130 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 08 21:17:03.105828 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-b1b26e36-a731-4ce5-9a36-514c069e5ac8 tempest-MultipleCreateNegativeTestJSON-1576031157 tempest-MultipleCreateNegativeTestJSON-1576031157-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-724864114", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "max_count": 2.5}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:17:03.112597 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-b1b26e36-a731-4ce5-9a36-514c069e5ac8 tempest-MultipleCreateNegativeTestJSON-1576031157 tempest-MultipleCreateNegativeTestJSON-1576031157-project] Request method failure captured: Oct 08 21:17:03.112597 ncdv-master-1 devstack@n-api.service[140492]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 08 21:17:03.112597 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:17:03.112597 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:17:03.112597 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:17:03.112597 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 169 Oct 08 21:17:03.112597 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:17:03.112597 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:17:03.112597 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:17:03.112597 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:17:03.112597 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQejOHFJWFZbw43lX_t2OKu5BRPIqkUZ9Tzc9u5qAtfoWwyBb7RReLqMykpsY36Eb_BLYfywhSqduMk-_ws0HQIttr4bpe8TZao1Iw3CW78kpQxZwa82WLnyAK42aijXUQHeFNfvx3hr5Vu1VD2nVnArUaf_p8o9NLjs28XrvEVX1lcU Oct 08 21:17:03.112597 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:17:03.112597 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:17:03.112597 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:17:03.112597 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:17:03.112597 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:17:03.112597 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:17:03.112597 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 601b7d01a1044882ab0935fadcc65449 Oct 08 21:17:03.112597 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1576031157 Oct 08 21:17:03.112597 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:17:03.112597 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:17:03.112597 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/601b7d01a1044882ab0935fadcc65449"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/601b7d01a1044882ab0935fadcc65449"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_601b7d01a1044882ab0935fadcc65449"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/601b7d01a1044882ab0935fadcc65449"}]}] Oct 08 21:17:03.112597 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1576031157 Oct 08 21:17:03.112597 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 601b7d01a1044882ab0935fadcc65449 Oct 08 21:17:03.112597 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1576031157 Oct 08 21:17:03.112597 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-MultipleCreateNegativeTestJSON-1576031157-project Oct 08 21:17:03.112597 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:17:03.112597 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:17:03.112597 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 5ba12893b3764aae950d7e38ff22322e Oct 08 21:17:03.112597 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1576031157-project Oct 08 21:17:03.112597 ncdv-master-1 devstack@n-api.service[140492]: Oct 08 21:17:03.112597 ncdv-master-1 devstack@n-api.service[140492]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-724864114", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "max_count": 2.5}} Oct 08 21:17:03.112597 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 21:17:03.112597 ncdv-master-1 devstack@n-api.service[140492]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 08 21:17:03.112597 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-724864114', 'imageRef': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'flavorRef': '452', 'max_count': 2.5}}} Oct 08 21:17:03.112597 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:17:03.112597 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:17:03.112597 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 08 21:17:03.112597 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 08 21:17:03.112597 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 08 21:17:03.112597 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise error Oct 08 21:17:03.112597 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Oct 08 21:17:03.112597 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:17:03.112597 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Oct 08 21:17:03.112597 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 08 21:17:03.112597 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 08 21:17:03.112597 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 08 21:17:03.112597 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 08 21:17:03.112597 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:17:03.112597 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 08 21:17:03.112597 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi 2.5 Oct 08 21:17:03.112597 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:17:03.112597 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:17:03.112597 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:17:03.112597 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:17:03.112597 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:17:03.112597 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:17:03.112597 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:17:03.112597 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:17:03.112597 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:17:03.112597 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:17:03.112597 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 21:17:03.112597 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 21:17:03.112597 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 08 21:17:03.112597 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 08 21:17:03.116337 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 08 21:17:03.116337 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 08 21:17:03.116337 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 08 21:17:03.116337 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 08 21:17:03.116337 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 08 21:17:03.116337 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:17:03.116337 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:17:03.116337 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:17:03.116337 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:17:03.116337 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:17:03.116337 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:17:03.116337 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 08 21:17:03.116337 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 08 21:17:03.116337 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 08 21:17:03.116337 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:17:03.116337 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-b1b26e36-a731-4ce5-9a36-514c069e5ac8 tempest-MultipleCreateNegativeTestJSON-1576031157 tempest-MultipleCreateNegativeTestJSON-1576031157-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:17:03.116337 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-b1b26e36-a731-4ce5-9a36-514c069e5ac8 tempest-MultipleCreateNegativeTestJSON-1576031157 tempest-MultipleCreateNegativeTestJSON-1576031157-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.012285 Oct 08 21:17:03.125538 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2564/5062] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 21:17:03 2022] POST /compute/v2.1/servers => generated 139 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 08 21:17:03.199137 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-8985926f-c5ca-4219-821b-8e8232047d0c tempest-MultipleCreateNegativeTestJSON-1576031157 tempest-MultipleCreateNegativeTestJSON-1576031157-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-203662787", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "min_count": 0}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:17:03.210670 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-8985926f-c5ca-4219-821b-8e8232047d0c tempest-MultipleCreateNegativeTestJSON-1576031157 tempest-MultipleCreateNegativeTestJSON-1576031157-project] Request method failure captured: Oct 08 21:17:03.210670 ncdv-master-1 devstack@n-api.service[140491]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 08 21:17:03.210670 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:17:03.210670 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:17:03.210670 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:17:03.210670 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 167 Oct 08 21:17:03.210670 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:17:03.210670 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:17:03.210670 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:17:03.210670 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:17:03.210670 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQejOHFJWFZbw43lX_t2OKu5BRPIqkUZ9Tzc9u5qAtfoWwyBb7RReLqMykpsY36Eb_BLYfywhSqduMk-_ws0HQIttr4bpe8TZao1Iw3CW78kpQxZwa82WLnyAK42aijXUQHeFNfvx3hr5Vu1VD2nVnArUaf_p8o9NLjs28XrvEVX1lcU Oct 08 21:17:03.210670 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:17:03.210670 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:17:03.210670 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:17:03.210670 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:17:03.210670 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:17:03.210670 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:17:03.210670 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 601b7d01a1044882ab0935fadcc65449 Oct 08 21:17:03.210670 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1576031157 Oct 08 21:17:03.210670 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:17:03.210670 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:17:03.210670 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/601b7d01a1044882ab0935fadcc65449"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/601b7d01a1044882ab0935fadcc65449"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_601b7d01a1044882ab0935fadcc65449"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/601b7d01a1044882ab0935fadcc65449"}]}] Oct 08 21:17:03.210670 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1576031157 Oct 08 21:17:03.210670 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 601b7d01a1044882ab0935fadcc65449 Oct 08 21:17:03.210670 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1576031157 Oct 08 21:17:03.210670 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-MultipleCreateNegativeTestJSON-1576031157-project Oct 08 21:17:03.210670 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:17:03.210670 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:17:03.210670 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 5ba12893b3764aae950d7e38ff22322e Oct 08 21:17:03.210670 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1576031157-project Oct 08 21:17:03.210670 ncdv-master-1 devstack@n-api.service[140491]: Oct 08 21:17:03.210670 ncdv-master-1 devstack@n-api.service[140491]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-203662787", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "min_count": 0}} Oct 08 21:17:03.210670 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:17:03.210670 ncdv-master-1 devstack@n-api.service[140491]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 08 21:17:03.210670 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-203662787', 'imageRef': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'flavorRef': '452', 'min_count': 0}}} Oct 08 21:17:03.210670 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:17:03.210670 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:17:03.210670 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 08 21:17:03.210670 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 08 21:17:03.210670 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 08 21:17:03.210670 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise error Oct 08 21:17:03.210670 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 08 21:17:03.210670 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:17:03.210670 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Oct 08 21:17:03.210670 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 08 21:17:03.210670 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 08 21:17:03.210670 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 08 21:17:03.210670 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 08 21:17:03.210670 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:17:03.210670 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 08 21:17:03.210670 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi 0 Oct 08 21:17:03.210670 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:17:03.210670 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:17:03.210670 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:17:03.210670 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:17:03.210670 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:17:03.210670 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:17:03.210670 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:17:03.210670 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:17:03.210670 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:17:03.210670 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:17:03.210670 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 21:17:03.210670 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 21:17:03.210670 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 08 21:17:03.210670 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 08 21:17:03.214645 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 08 21:17:03.214645 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 08 21:17:03.214645 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 08 21:17:03.214645 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 08 21:17:03.214645 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 08 21:17:03.214645 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:17:03.214645 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:17:03.214645 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:17:03.214645 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:17:03.214645 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:17:03.214645 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:17:03.214645 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 08 21:17:03.214645 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 08 21:17:03.214645 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 08 21:17:03.214645 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:17:03.218380 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-8985926f-c5ca-4219-821b-8e8232047d0c tempest-MultipleCreateNegativeTestJSON-1576031157 tempest-MultipleCreateNegativeTestJSON-1576031157-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:17:03.223020 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-8985926f-c5ca-4219-821b-8e8232047d0c tempest-MultipleCreateNegativeTestJSON-1576031157 tempest-MultipleCreateNegativeTestJSON-1576031157-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.025726 Oct 08 21:17:03.224326 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2499/5063] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 21:17:03 2022] POST /compute/v2.1/servers => generated 130 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 08 21:17:03.306077 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-13155294-910c-48c6-ad87-46da8ae2da92 tempest-MultipleCreateNegativeTestJSON-1576031157 tempest-MultipleCreateNegativeTestJSON-1576031157-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-653586096", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "min_count": 2.5}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:17:03.312007 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-13155294-910c-48c6-ad87-46da8ae2da92 tempest-MultipleCreateNegativeTestJSON-1576031157 tempest-MultipleCreateNegativeTestJSON-1576031157-project] Request method failure captured: Oct 08 21:17:03.312007 ncdv-master-1 devstack@n-api.service[140492]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 08 21:17:03.312007 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:17:03.312007 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:17:03.312007 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:17:03.312007 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 169 Oct 08 21:17:03.312007 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:17:03.312007 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:17:03.312007 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:17:03.312007 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:17:03.312007 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQejOHFJWFZbw43lX_t2OKu5BRPIqkUZ9Tzc9u5qAtfoWwyBb7RReLqMykpsY36Eb_BLYfywhSqduMk-_ws0HQIttr4bpe8TZao1Iw3CW78kpQxZwa82WLnyAK42aijXUQHeFNfvx3hr5Vu1VD2nVnArUaf_p8o9NLjs28XrvEVX1lcU Oct 08 21:17:03.312007 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:17:03.312007 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:17:03.312007 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:17:03.312007 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:17:03.312007 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:17:03.312007 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:17:03.312007 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 601b7d01a1044882ab0935fadcc65449 Oct 08 21:17:03.312007 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1576031157 Oct 08 21:17:03.312007 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:17:03.312007 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:17:03.312007 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/601b7d01a1044882ab0935fadcc65449"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/601b7d01a1044882ab0935fadcc65449"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_601b7d01a1044882ab0935fadcc65449"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/601b7d01a1044882ab0935fadcc65449"}]}] Oct 08 21:17:03.312007 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1576031157 Oct 08 21:17:03.312007 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 601b7d01a1044882ab0935fadcc65449 Oct 08 21:17:03.312007 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1576031157 Oct 08 21:17:03.312007 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-MultipleCreateNegativeTestJSON-1576031157-project Oct 08 21:17:03.312007 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:17:03.312007 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:17:03.312007 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 5ba12893b3764aae950d7e38ff22322e Oct 08 21:17:03.312007 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1576031157-project Oct 08 21:17:03.312007 ncdv-master-1 devstack@n-api.service[140492]: Oct 08 21:17:03.312007 ncdv-master-1 devstack@n-api.service[140492]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-653586096", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "min_count": 2.5}} Oct 08 21:17:03.312007 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 21:17:03.312007 ncdv-master-1 devstack@n-api.service[140492]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 08 21:17:03.312007 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-653586096', 'imageRef': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'flavorRef': '452', 'min_count': 2.5}}} Oct 08 21:17:03.312007 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:17:03.312007 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:17:03.312007 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 08 21:17:03.312007 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 08 21:17:03.312007 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 08 21:17:03.312007 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise error Oct 08 21:17:03.312007 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Oct 08 21:17:03.312007 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:17:03.312007 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Oct 08 21:17:03.312007 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 08 21:17:03.312007 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 08 21:17:03.312007 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 08 21:17:03.312007 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 08 21:17:03.312007 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:17:03.312007 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 08 21:17:03.312007 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi 2.5 Oct 08 21:17:03.312007 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:17:03.312007 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:17:03.312007 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:17:03.312007 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:17:03.312007 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:17:03.312007 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:17:03.312007 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:17:03.312007 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:17:03.312007 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:17:03.312007 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:17:03.312007 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 21:17:03.312007 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 21:17:03.312007 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 08 21:17:03.312007 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 08 21:17:03.319957 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 08 21:17:03.319957 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 08 21:17:03.319957 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 08 21:17:03.319957 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 08 21:17:03.319957 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 08 21:17:03.319957 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:17:03.319957 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:17:03.319957 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:17:03.319957 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:17:03.319957 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:17:03.319957 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:17:03.319957 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 08 21:17:03.319957 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 08 21:17:03.319957 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 08 21:17:03.319957 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:17:03.319957 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-13155294-910c-48c6-ad87-46da8ae2da92 tempest-MultipleCreateNegativeTestJSON-1576031157 tempest-MultipleCreateNegativeTestJSON-1576031157-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:17:03.319957 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-13155294-910c-48c6-ad87-46da8ae2da92 tempest-MultipleCreateNegativeTestJSON-1576031157 tempest-MultipleCreateNegativeTestJSON-1576031157-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.011245 Oct 08 21:17:03.319957 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2565/5064] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 21:17:03 2022] POST /compute/v2.1/servers => generated 139 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 08 21:17:03.651396 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=2 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:17:03.652789 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=6 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:17:03.659098 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-abbc5777-c3e3-4f09-92b1-ef0134c33c2c req-32a8c20b-8081-4010-8361-71fdc6f3add7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9f0e8ec-d9e4-453f-ab5e-4b0d95a6a7cd", "tag": "5c162195-694a-4d23-b4c1-2eb5a6713b41"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:17:03.686138 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-422c84b3-754e-485a-bd64-eeb79c3994bb tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:17:03.687781 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-422c84b3-754e-485a-bd64-eeb79c3994bb tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] [instance: bbd1c1d7-13a9-4c6f-b651-c1017efd922e] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:17:03.691916 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=34 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:17:03.696661 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-abbc5777-c3e3-4f09-92b1-ef0134c33c2c req-32a8c20b-8081-4010-8361-71fdc6f3add7 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:17:03.697208 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-abbc5777-c3e3-4f09-92b1-ef0134c33c2c req-32a8c20b-8081-4010-8361-71fdc6f3add7 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:17:03.705708 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-abbc5777-c3e3-4f09-92b1-ef0134c33c2c req-32a8c20b-8081-4010-8361-71fdc6f3add7 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:17:03.711430 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-422c84b3-754e-485a-bd64-eeb79c3994bb tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:17:03.712200 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-422c84b3-754e-485a-bd64-eeb79c3994bb tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:17:03.712388 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-422c84b3-754e-485a-bd64-eeb79c3994bb tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:17:03.713127 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-422c84b3-754e-485a-bd64-eeb79c3994bb tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:17:03.713644 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-422c84b3-754e-485a-bd64-eeb79c3994bb tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:17:03.714066 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-422c84b3-754e-485a-bd64-eeb79c3994bb tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:17:03.726171 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-abbc5777-c3e3-4f09-92b1-ef0134c33c2c req-32a8c20b-8081-4010-8361-71fdc6f3add7 service nova] Creating event network-changed:5c162195-694a-4d23-b4c1-2eb5a6713b41 for instance c9f0e8ec-d9e4-453f-ab5e-4b0d95a6a7cd on nch1-master-1 Oct 08 21:17:03.733227 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=80 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:17:03.740190 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-abbc5777-c3e3-4f09-92b1-ef0134c33c2c req-32a8c20b-8081-4010-8361-71fdc6f3add7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090100 Oct 08 21:17:03.750307 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2500/5065] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:17:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 08 21:17:03.772935 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-01823210-dea5-4395-b115-0c50aa399692 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:17:03.773938 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-01823210-dea5-4395-b115-0c50aa399692 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] [instance: c9f0e8ec-d9e4-453f-ab5e-4b0d95a6a7cd] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:17:03.786591 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-01823210-dea5-4395-b115-0c50aa399692 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:17:03.787339 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-01823210-dea5-4395-b115-0c50aa399692 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:17:03.787965 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-01823210-dea5-4395-b115-0c50aa399692 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:17:03.790821 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-01823210-dea5-4395-b115-0c50aa399692 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:17:03.791467 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-01823210-dea5-4395-b115-0c50aa399692 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:17:03.792054 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-01823210-dea5-4395-b115-0c50aa399692 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:17:03.903079 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-422c84b3-754e-485a-bd64-eeb79c3994bb tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8957041987c8487099f0d89f4c64af66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9d29b90ab34abbadd21edbca637d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:17:03.916576 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-422c84b3-754e-485a-bd64-eeb79c3994bb tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] 10.222.0.26 "GET /compute/v2.1/servers/bbd1c1d7-13a9-4c6f-b651-c1017efd922e" status: 200 len: 1614 microversion: 2.1 time: 0.234086 Oct 08 21:17:03.928417 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2566/5066] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:17:03 2022] GET /compute/v2.1/servers/bbd1c1d7-13a9-4c6f-b651-c1017efd922e => generated 1614 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:17:04.148860 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-01823210-dea5-4395-b115-0c50aa399692 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a292ffe2c5c41ef8d281fa525792b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdea37d91ed431aa0dc780148174e5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:17:04.158613 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-01823210-dea5-4395-b115-0c50aa399692 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] 10.222.0.26 "GET /compute/v2.1/servers/c9f0e8ec-d9e4-453f-ab5e-4b0d95a6a7cd" status: 200 len: 1318 microversion: 2.1 time: 0.390854 Oct 08 21:17:04.159219 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2501/5067] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:17:03 2022] GET /compute/v2.1/servers/c9f0e8ec-d9e4-453f-ab5e-4b0d95a6a7cd => generated 1318 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:17:04.948603 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-f7eeb1a9-055f-41c3-b9f9-b3477273cbb0 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:17:04.949418 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-f7eeb1a9-055f-41c3-b9f9-b3477273cbb0 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] [instance: bbd1c1d7-13a9-4c6f-b651-c1017efd922e] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:17:04.955398 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=2 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:17:04.957897 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f7eeb1a9-055f-41c3-b9f9-b3477273cbb0 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:17:04.958665 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f7eeb1a9-055f-41c3-b9f9-b3477273cbb0 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:17:04.959325 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f7eeb1a9-055f-41c3-b9f9-b3477273cbb0 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:17:04.960274 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f7eeb1a9-055f-41c3-b9f9-b3477273cbb0 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:17:04.960966 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f7eeb1a9-055f-41c3-b9f9-b3477273cbb0 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:17:04.961660 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f7eeb1a9-055f-41c3-b9f9-b3477273cbb0 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:17:05.004374 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f7eeb1a9-055f-41c3-b9f9-b3477273cbb0 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:17:05.005650 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f7eeb1a9-055f-41c3-b9f9-b3477273cbb0 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:17:05.006322 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f7eeb1a9-055f-41c3-b9f9-b3477273cbb0 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:17:05.007212 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.objects.instance [None req-f7eeb1a9-055f-41c3-b9f9-b3477273cbb0 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lazy-loading 'fault' on Instance uuid bbd1c1d7-13a9-4c6f-b651-c1017efd922e {{(pid=140492) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 21:17:05.188626 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c82b43b6-d625-4b43-aa9b-3153e3725451 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:17:05.190254 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-c82b43b6-d625-4b43-aa9b-3153e3725451 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] [instance: c9f0e8ec-d9e4-453f-ab5e-4b0d95a6a7cd] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:17:05.201171 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c82b43b6-d625-4b43-aa9b-3153e3725451 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:17:05.204702 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c82b43b6-d625-4b43-aa9b-3153e3725451 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:17:05.208554 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c82b43b6-d625-4b43-aa9b-3153e3725451 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:17:05.209602 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c82b43b6-d625-4b43-aa9b-3153e3725451 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:17:05.211943 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c82b43b6-d625-4b43-aa9b-3153e3725451 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:17:05.212601 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c82b43b6-d625-4b43-aa9b-3153e3725451 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:17:05.259329 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-f7eeb1a9-055f-41c3-b9f9-b3477273cbb0 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8957041987c8487099f0d89f4c64af66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9d29b90ab34abbadd21edbca637d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:17:05.273388 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-f7eeb1a9-055f-41c3-b9f9-b3477273cbb0 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] 10.222.0.26 "GET /compute/v2.1/servers/bbd1c1d7-13a9-4c6f-b651-c1017efd922e" status: 200 len: 1331 microversion: 2.1 time: 0.329642 Oct 08 21:17:05.289223 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2567/5068] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:17:04 2022] GET /compute/v2.1/servers/bbd1c1d7-13a9-4c6f-b651-c1017efd922e => generated 1331 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:17:05.861096 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-6b3ee343-a602-4974-a5a7-73240103ce68 req-af8e6ca3-fdbd-4dc5-94bc-2306ec9a5db7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbd1c1d7-13a9-4c6f-b651-c1017efd922e", "name": "network-vif-deleted", "tag": "970d0412-0e67-4602-ab4e-c38b70f22b0a"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:17:05.883378 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-6b3ee343-a602-4974-a5a7-73240103ce68 req-af8e6ca3-fdbd-4dc5-94bc-2306ec9a5db7 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:17:05.884075 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-6b3ee343-a602-4974-a5a7-73240103ce68 req-af8e6ca3-fdbd-4dc5-94bc-2306ec9a5db7 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:17:05.884923 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-6b3ee343-a602-4974-a5a7-73240103ce68 req-af8e6ca3-fdbd-4dc5-94bc-2306ec9a5db7 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:17:05.916575 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-6b3ee343-a602-4974-a5a7-73240103ce68 req-af8e6ca3-fdbd-4dc5-94bc-2306ec9a5db7 service nova] Creating event network-vif-deleted:970d0412-0e67-4602-ab4e-c38b70f22b0a for instance bbd1c1d7-13a9-4c6f-b651-c1017efd922e on nch2-master-1 Oct 08 21:17:05.932172 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-6b3ee343-a602-4974-a5a7-73240103ce68 req-af8e6ca3-fdbd-4dc5-94bc-2306ec9a5db7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076338 Oct 08 21:17:05.933864 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2568/5069] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:17:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:17:06.310067 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-7ac93404-997e-40d2-b47d-dd0218f1976f tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:17:06.310888 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-7ac93404-997e-40d2-b47d-dd0218f1976f tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] [instance: bbd1c1d7-13a9-4c6f-b651-c1017efd922e] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:17:06.330067 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7ac93404-997e-40d2-b47d-dd0218f1976f tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:17:06.331427 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7ac93404-997e-40d2-b47d-dd0218f1976f tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:17:06.332069 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7ac93404-997e-40d2-b47d-dd0218f1976f tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:17:06.332988 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7ac93404-997e-40d2-b47d-dd0218f1976f tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:17:06.333683 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7ac93404-997e-40d2-b47d-dd0218f1976f tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:17:06.334326 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7ac93404-997e-40d2-b47d-dd0218f1976f tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:17:06.365256 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-7ac93404-997e-40d2-b47d-dd0218f1976f tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] HTTP exception thrown: Instance bbd1c1d7-13a9-4c6f-b651-c1017efd922e could not be found. Oct 08 21:17:06.365256 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-7ac93404-997e-40d2-b47d-dd0218f1976f tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Request method failure captured: Oct 08 21:17:06.365256 ncdv-master-1 devstack@n-api.service[140492]: request: GET /compute/v2.1/servers/bbd1c1d7-13a9-4c6f-b651-c1017efd922e HTTP/1.1 Oct 08 21:17:06.365256 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:17:06.365256 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:17:06.365256 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:17:06.365256 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 21:17:06.365256 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:17:06.365256 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:17:06.365256 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:17:06.365256 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:17:06.365256 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQehFIbXs-DGbS_kPUTJMTrUq-WofUYY6ZRyx81bX8dlJ1znB-Icd1X0JZVfoU0lBZbBMu1x5OyOchM7_W_m4wVb0RC5emVnYRQT_LfKB9ZNZm3xjiiSMGa29vJwyibC7NFwQ_T90TzXkiQ39iaomvdVhCKn_tsPv5ogwGAe_Atzwiz8 Oct 08 21:17:06.365256 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:17:06.365256 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:17:06.365256 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:17:06.365256 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:17:06.365256 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:17:06.365256 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:17:06.365256 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 3d9d29b90ab34abbadd21edbca637d2e Oct 08 21:17:06.365256 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-AttachVolumeNegativeTest-1956575659 Oct 08 21:17:06.365256 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:17:06.365256 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:17:06.365256 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3d9d29b90ab34abbadd21edbca637d2e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3d9d29b90ab34abbadd21edbca637d2e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3d9d29b90ab34abbadd21edbca637d2e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3d9d29b90ab34abbadd21edbca637d2e"}]}] Oct 08 21:17:06.365256 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-AttachVolumeNegativeTest-1956575659 Oct 08 21:17:06.365256 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 3d9d29b90ab34abbadd21edbca637d2e Oct 08 21:17:06.365256 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1956575659 Oct 08 21:17:06.365256 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-AttachVolumeNegativeTest-1956575659-project Oct 08 21:17:06.365256 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:17:06.365256 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:17:06.365256 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 8957041987c8487099f0d89f4c64af66 Oct 08 21:17:06.365256 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-AttachVolumeNegativeTest-1956575659-project Oct 08 21:17:06.365256 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 21:17:06.365256 ncdv-master-1 devstack@n-api.service[140492]: exception: Instance bbd1c1d7-13a9-4c6f-b651-c1017efd922e could not be found. Oct 08 21:17:06.365256 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': 'bbd1c1d7-13a9-4c6f-b651-c1017efd922e'} Oct 08 21:17:06.365256 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:17:06.365256 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:17:06.365256 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:17:06.365256 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:17:06.365256 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:17:06.365256 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:17:06.365256 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:17:06.365256 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:17:06.365256 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:17:06.365256 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:17:06.365256 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbd1c1d7-13a9-4c6f-b651-c1017efd922e could not be found. Oct 08 21:17:06.365256 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:17:06.365256 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:17:06.365256 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:17:06.365256 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:17:06.365256 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:17:06.365256 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:17:06.365256 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:17:06.365256 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:17:06.365256 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:17:06.365256 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:17:06.365256 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:17:06.365256 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:17:06.365256 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:17:06.365256 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:17:06.365256 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:17:06.365256 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:17:06.369095 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbd1c1d7-13a9-4c6f-b651-c1017efd922e could not be found. Oct 08 21:17:06.369095 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:17:06.369095 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:17:06.369095 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:17:06.369095 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:17:06.369095 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:17:06.369095 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:17:06.369095 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:17:06.369095 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:17:06.369095 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbd1c1d7-13a9-4c6f-b651-c1017efd922e could not be found. Oct 08 21:17:06.369095 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:17:06.369095 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-7ac93404-997e-40d2-b47d-dd0218f1976f tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Returning 404 to user: Instance bbd1c1d7-13a9-4c6f-b651-c1017efd922e could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:17:06.370619 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-7ac93404-997e-40d2-b47d-dd0218f1976f tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] 10.222.0.26 "GET /compute/v2.1/servers/bbd1c1d7-13a9-4c6f-b651-c1017efd922e" status: 404 len: 111 microversion: 2.1 time: 0.065224 Oct 08 21:17:06.371771 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2569/5070] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:17:06 2022] GET /compute/v2.1/servers/bbd1c1d7-13a9-4c6f-b651-c1017efd922e => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:17:06.382013 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-365a489b-59ab-4fb7-a832-32d3cbf25b2f tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Calling method '.version_select at 0x7f1a8c070d30>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:17:06.398823 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-c82b43b6-d625-4b43-aa9b-3153e3725451 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a292ffe2c5c41ef8d281fa525792b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdea37d91ed431aa0dc780148174e5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:17:06.411913 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-365a489b-59ab-4fb7-a832-32d3cbf25b2f tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1761368687" status: 202 len: 0 microversion: 2.1 time: 0.035200 Oct 08 21:17:06.413320 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2570/5071] 10.222.0.26 () {58 vars in 1221 bytes} [Sat Oct 8 21:17:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1761368687 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 21:17:06.417678 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-c82b43b6-d625-4b43-aa9b-3153e3725451 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] 10.222.0.26 "GET /compute/v2.1/servers/c9f0e8ec-d9e4-453f-ab5e-4b0d95a6a7cd" status: 200 len: 1318 microversion: 2.1 time: 1.230977 Oct 08 21:17:06.418435 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2502/5072] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:17:05 2022] GET /compute/v2.1/servers/c9f0e8ec-d9e4-453f-ab5e-4b0d95a6a7cd => generated 1318 bytes in 1238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:17:07.444097 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-c7a97af5-3eed-4d98-ae10-04d63f8e22cb tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:17:07.444716 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-c7a97af5-3eed-4d98-ae10-04d63f8e22cb tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] [instance: c9f0e8ec-d9e4-453f-ab5e-4b0d95a6a7cd] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:17:07.463621 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c7a97af5-3eed-4d98-ae10-04d63f8e22cb tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:17:07.464128 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c7a97af5-3eed-4d98-ae10-04d63f8e22cb tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:17:07.464580 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c7a97af5-3eed-4d98-ae10-04d63f8e22cb tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:17:07.465329 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c7a97af5-3eed-4d98-ae10-04d63f8e22cb tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:17:07.465962 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c7a97af5-3eed-4d98-ae10-04d63f8e22cb tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:17:07.466547 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c7a97af5-3eed-4d98-ae10-04d63f8e22cb tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:17:08.122187 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-c7a97af5-3eed-4d98-ae10-04d63f8e22cb tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a292ffe2c5c41ef8d281fa525792b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdea37d91ed431aa0dc780148174e5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:17:08.131384 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-c7a97af5-3eed-4d98-ae10-04d63f8e22cb tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] 10.222.0.26 "GET /compute/v2.1/servers/c9f0e8ec-d9e4-453f-ab5e-4b0d95a6a7cd" status: 200 len: 1318 microversion: 2.1 time: 0.691929 Oct 08 21:17:08.131970 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2571/5073] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:17:07 2022] GET /compute/v2.1/servers/c9f0e8ec-d9e4-453f-ab5e-4b0d95a6a7cd => generated 1318 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:17:08.416488 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-5c320055-6188-4cee-bab4-b8bf04df5f24 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:17:08.417588 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-5c320055-6188-4cee-bab4-b8bf04df5f24 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] [instance: aadddbb1-e053-420e-afd2-9412c6137504] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:17:08.437480 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5c320055-6188-4cee-bab4-b8bf04df5f24 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:17:08.438186 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5c320055-6188-4cee-bab4-b8bf04df5f24 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:17:08.438788 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5c320055-6188-4cee-bab4-b8bf04df5f24 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:17:08.439680 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5c320055-6188-4cee-bab4-b8bf04df5f24 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:17:08.440326 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5c320055-6188-4cee-bab4-b8bf04df5f24 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:17:08.440902 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5c320055-6188-4cee-bab4-b8bf04df5f24 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:17:08.569527 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.objects.instance [None req-5c320055-6188-4cee-bab4-b8bf04df5f24 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lazy-loading 'services' on Instance uuid aadddbb1-e053-420e-afd2-9412c6137504 {{(pid=140491) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 21:17:08.697905 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-5c320055-6188-4cee-bab4-b8bf04df5f24 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] 10.222.0.26 "DELETE /compute/v2.1/servers/aadddbb1-e053-420e-afd2-9412c6137504/os-volume_attachments/71c4c902-18fd-4291-83f7-50d37cc1baef" status: 202 len: 0 microversion: 2.1 time: 0.286131 Oct 08 21:17:08.698809 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2503/5074] 10.222.0.26 () {58 vars in 1416 bytes} [Sat Oct 8 21:17:08 2022] DELETE /compute/v2.1/servers/aadddbb1-e053-420e-afd2-9412c6137504/os-volume_attachments/71c4c902-18fd-4291-83f7-50d37cc1baef => generated 0 bytes in 288 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 21:17:08.710787 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-0d855976-d2bb-45a1-883a-2b67f8b74855 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:17:08.713880 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-0d855976-d2bb-45a1-883a-2b67f8b74855 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] [instance: aadddbb1-e053-420e-afd2-9412c6137504] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:17:08.725439 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0d855976-d2bb-45a1-883a-2b67f8b74855 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:17:08.726937 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0d855976-d2bb-45a1-883a-2b67f8b74855 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:17:08.728752 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0d855976-d2bb-45a1-883a-2b67f8b74855 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:17:08.730930 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0d855976-d2bb-45a1-883a-2b67f8b74855 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:17:08.731775 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0d855976-d2bb-45a1-883a-2b67f8b74855 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:17:08.732488 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0d855976-d2bb-45a1-883a-2b67f8b74855 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:17:08.794514 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-0d855976-d2bb-45a1-883a-2b67f8b74855 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] 10.222.0.26 "GET /compute/v2.1/servers/aadddbb1-e053-420e-afd2-9412c6137504/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091312 Oct 08 21:17:08.803909 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2572/5075] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Oct 8 21:17:08 2022] GET /compute/v2.1/servers/aadddbb1-e053-420e-afd2-9412c6137504/os-volume_attachments => generated 197 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:17:09.169860 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-9ce2f9e4-6eaa-4643-91b2-f60b7ad1b140 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:17:09.172515 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-9ce2f9e4-6eaa-4643-91b2-f60b7ad1b140 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] [instance: c9f0e8ec-d9e4-453f-ab5e-4b0d95a6a7cd] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:17:09.200652 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9ce2f9e4-6eaa-4643-91b2-f60b7ad1b140 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:17:09.201444 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9ce2f9e4-6eaa-4643-91b2-f60b7ad1b140 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:17:09.202607 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9ce2f9e4-6eaa-4643-91b2-f60b7ad1b140 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:17:09.204607 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9ce2f9e4-6eaa-4643-91b2-f60b7ad1b140 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:17:09.206417 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9ce2f9e4-6eaa-4643-91b2-f60b7ad1b140 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:17:09.207109 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9ce2f9e4-6eaa-4643-91b2-f60b7ad1b140 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:17:09.494387 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-9ce2f9e4-6eaa-4643-91b2-f60b7ad1b140 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a292ffe2c5c41ef8d281fa525792b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdea37d91ed431aa0dc780148174e5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:17:09.506474 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-9ce2f9e4-6eaa-4643-91b2-f60b7ad1b140 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] 10.222.0.26 "GET /compute/v2.1/servers/c9f0e8ec-d9e4-453f-ab5e-4b0d95a6a7cd" status: 200 len: 1318 microversion: 2.1 time: 0.353618 Oct 08 21:17:09.510874 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2504/5076] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:17:09 2022] GET /compute/v2.1/servers/c9f0e8ec-d9e4-453f-ab5e-4b0d95a6a7cd => generated 1318 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:17:09.810862 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e9af99fd-784d-4132-b0a4-ce96a6a3e7be tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:17:09.813201 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-e9af99fd-784d-4132-b0a4-ce96a6a3e7be tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] [instance: aadddbb1-e053-420e-afd2-9412c6137504] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:17:09.825692 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e9af99fd-784d-4132-b0a4-ce96a6a3e7be tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:17:09.826191 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e9af99fd-784d-4132-b0a4-ce96a6a3e7be tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:17:09.826721 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e9af99fd-784d-4132-b0a4-ce96a6a3e7be tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:17:09.827881 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e9af99fd-784d-4132-b0a4-ce96a6a3e7be tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:17:09.828888 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e9af99fd-784d-4132-b0a4-ce96a6a3e7be tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:17:09.829565 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e9af99fd-784d-4132-b0a4-ce96a6a3e7be tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:17:09.885010 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-e9af99fd-784d-4132-b0a4-ce96a6a3e7be tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] 10.222.0.26 "GET /compute/v2.1/servers/aadddbb1-e053-420e-afd2-9412c6137504/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.077480 Oct 08 21:17:09.886460 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2573/5077] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Oct 8 21:17:09 2022] GET /compute/v2.1/servers/aadddbb1-e053-420e-afd2-9412c6137504/os-volume_attachments => generated 25 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 08 21:17:10.000550 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-635ef3bb-9171-4003-a2e1-6ebb833c1ca1 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:17:10.001345 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-635ef3bb-9171-4003-a2e1-6ebb833c1ca1 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] [instance: aadddbb1-e053-420e-afd2-9412c6137504] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:17:10.015597 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-635ef3bb-9171-4003-a2e1-6ebb833c1ca1 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:17:10.016526 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-635ef3bb-9171-4003-a2e1-6ebb833c1ca1 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:17:10.017685 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-635ef3bb-9171-4003-a2e1-6ebb833c1ca1 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:17:10.019389 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-635ef3bb-9171-4003-a2e1-6ebb833c1ca1 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:17:10.019877 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-635ef3bb-9171-4003-a2e1-6ebb833c1ca1 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:17:10.020360 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-635ef3bb-9171-4003-a2e1-6ebb833c1ca1 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:17:10.092867 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-635ef3bb-9171-4003-a2e1-6ebb833c1ca1 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] [instance: aadddbb1-e053-420e-afd2-9412c6137504] Going to try to terminate instance {{(pid=140491) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 21:17:10.268263 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-635ef3bb-9171-4003-a2e1-6ebb833c1ca1 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] 10.222.0.26 "DELETE /compute/v2.1/servers/aadddbb1-e053-420e-afd2-9412c6137504" status: 204 len: 0 microversion: 2.1 time: 0.276461 Oct 08 21:17:10.269783 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2505/5078] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:17:09 2022] DELETE /compute/v2.1/servers/aadddbb1-e053-420e-afd2-9412c6137504 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 08 21:17:10.289878 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-ed1e2352-b5dc-4b00-9aea-96601f6c809e tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:17:10.290605 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-ed1e2352-b5dc-4b00-9aea-96601f6c809e tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] [instance: aadddbb1-e053-420e-afd2-9412c6137504] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:17:10.301843 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ed1e2352-b5dc-4b00-9aea-96601f6c809e tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:17:10.302455 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ed1e2352-b5dc-4b00-9aea-96601f6c809e tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:17:10.303015 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ed1e2352-b5dc-4b00-9aea-96601f6c809e tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:17:10.304756 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ed1e2352-b5dc-4b00-9aea-96601f6c809e tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:17:10.305384 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ed1e2352-b5dc-4b00-9aea-96601f6c809e tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:17:10.309092 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ed1e2352-b5dc-4b00-9aea-96601f6c809e tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:17:10.452664 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-9512b711-0db4-48b7-a91d-4e9ff37b68b7 req-0c4826ff-ed68-4431-ba0a-34c6316a64d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9f0e8ec-d9e4-453f-ab5e-4b0d95a6a7cd", "name": "network-vif-plugged", "status": "completed", "tag": "5c162195-694a-4d23-b4c1-2eb5a6713b41"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:17:10.465942 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-9512b711-0db4-48b7-a91d-4e9ff37b68b7 req-0c4826ff-ed68-4431-ba0a-34c6316a64d4 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:17:10.474367 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-9512b711-0db4-48b7-a91d-4e9ff37b68b7 req-0c4826ff-ed68-4431-ba0a-34c6316a64d4 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:17:10.477370 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-9512b711-0db4-48b7-a91d-4e9ff37b68b7 req-0c4826ff-ed68-4431-ba0a-34c6316a64d4 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:17:10.495318 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-9512b711-0db4-48b7-a91d-4e9ff37b68b7 req-0c4826ff-ed68-4431-ba0a-34c6316a64d4 service nova] Creating event network-vif-plugged:5c162195-694a-4d23-b4c1-2eb5a6713b41 for instance c9f0e8ec-d9e4-453f-ab5e-4b0d95a6a7cd on nch1-master-1 Oct 08 21:17:10.509418 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-9512b711-0db4-48b7-a91d-4e9ff37b68b7 req-0c4826ff-ed68-4431-ba0a-34c6316a64d4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062991 Oct 08 21:17:10.510327 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2506/5079] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:17:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:17:10.547133 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-cfa38352-245a-43fd-84cb-683234210499 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:17:10.547929 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-cfa38352-245a-43fd-84cb-683234210499 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] [instance: c9f0e8ec-d9e4-453f-ab5e-4b0d95a6a7cd] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:17:10.569277 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cfa38352-245a-43fd-84cb-683234210499 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:17:10.569800 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cfa38352-245a-43fd-84cb-683234210499 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:17:10.570260 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cfa38352-245a-43fd-84cb-683234210499 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:17:10.578024 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cfa38352-245a-43fd-84cb-683234210499 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:17:10.578628 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cfa38352-245a-43fd-84cb-683234210499 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:17:10.579088 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cfa38352-245a-43fd-84cb-683234210499 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:17:10.790728 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-cfa38352-245a-43fd-84cb-683234210499 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a292ffe2c5c41ef8d281fa525792b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdea37d91ed431aa0dc780148174e5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:17:10.800554 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-cfa38352-245a-43fd-84cb-683234210499 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] 10.222.0.26 "GET /compute/v2.1/servers/c9f0e8ec-d9e4-453f-ab5e-4b0d95a6a7cd" status: 200 len: 1318 microversion: 2.1 time: 0.259482 Oct 08 21:17:10.801698 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2507/5080] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:17:10 2022] GET /compute/v2.1/servers/c9f0e8ec-d9e4-453f-ab5e-4b0d95a6a7cd => generated 1318 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:17:11.485413 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-ed1e2352-b5dc-4b00-9aea-96601f6c809e tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8957041987c8487099f0d89f4c64af66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9d29b90ab34abbadd21edbca637d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:17:11.499421 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-ed1e2352-b5dc-4b00-9aea-96601f6c809e tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] 10.222.0.26 "GET /compute/v2.1/servers/aadddbb1-e053-420e-afd2-9412c6137504" status: 200 len: 1681 microversion: 2.1 time: 1.222434 Oct 08 21:17:11.521327 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2574/5081] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:17:10 2022] GET /compute/v2.1/servers/aadddbb1-e053-420e-afd2-9412c6137504 => generated 1681 bytes in 1237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:17:11.827540 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-89165686-712c-4af4-8630-f436699b0ff0 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:17:11.828999 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-89165686-712c-4af4-8630-f436699b0ff0 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] [instance: c9f0e8ec-d9e4-453f-ab5e-4b0d95a6a7cd] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:17:11.837781 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-89165686-712c-4af4-8630-f436699b0ff0 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:17:11.838640 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-89165686-712c-4af4-8630-f436699b0ff0 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:17:11.839293 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-89165686-712c-4af4-8630-f436699b0ff0 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:17:11.840157 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-89165686-712c-4af4-8630-f436699b0ff0 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:17:11.841169 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-89165686-712c-4af4-8630-f436699b0ff0 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:17:11.841668 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-89165686-712c-4af4-8630-f436699b0ff0 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:17:12.535186 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-6cbbc253-374b-4f98-bcb7-55703a577187 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:17:12.535813 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-6cbbc253-374b-4f98-bcb7-55703a577187 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] [instance: aadddbb1-e053-420e-afd2-9412c6137504] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:17:12.554816 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6cbbc253-374b-4f98-bcb7-55703a577187 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:17:12.555337 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6cbbc253-374b-4f98-bcb7-55703a577187 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:17:12.555798 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6cbbc253-374b-4f98-bcb7-55703a577187 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:17:12.556538 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6cbbc253-374b-4f98-bcb7-55703a577187 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:17:12.557006 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6cbbc253-374b-4f98-bcb7-55703a577187 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:17:12.557504 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6cbbc253-374b-4f98-bcb7-55703a577187 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:17:12.709137 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-89165686-712c-4af4-8630-f436699b0ff0 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a292ffe2c5c41ef8d281fa525792b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdea37d91ed431aa0dc780148174e5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:17:12.721586 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-89165686-712c-4af4-8630-f436699b0ff0 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] 10.222.0.26 "GET /compute/v2.1/servers/c9f0e8ec-d9e4-453f-ab5e-4b0d95a6a7cd" status: 200 len: 1318 microversion: 2.1 time: 0.899510 Oct 08 21:17:12.723123 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2508/5082] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:17:11 2022] GET /compute/v2.1/servers/c9f0e8ec-d9e4-453f-ab5e-4b0d95a6a7cd => generated 1318 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:17:12.905853 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-6cbbc253-374b-4f98-bcb7-55703a577187 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8957041987c8487099f0d89f4c64af66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9d29b90ab34abbadd21edbca637d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:17:12.915063 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-6cbbc253-374b-4f98-bcb7-55703a577187 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] 10.222.0.26 "GET /compute/v2.1/servers/aadddbb1-e053-420e-afd2-9412c6137504" status: 200 len: 1681 microversion: 2.1 time: 0.383569 Oct 08 21:17:12.929871 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2575/5083] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:17:12 2022] GET /compute/v2.1/servers/aadddbb1-e053-420e-afd2-9412c6137504 => generated 1681 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:17:13.746767 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-b2fc0c33-dd67-44f4-813f-6a5a5966a32c tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:17:13.747400 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-b2fc0c33-dd67-44f4-813f-6a5a5966a32c tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] [instance: c9f0e8ec-d9e4-453f-ab5e-4b0d95a6a7cd] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:17:13.759109 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b2fc0c33-dd67-44f4-813f-6a5a5966a32c tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:17:13.761424 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b2fc0c33-dd67-44f4-813f-6a5a5966a32c tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:17:13.761953 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b2fc0c33-dd67-44f4-813f-6a5a5966a32c tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:17:13.762773 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b2fc0c33-dd67-44f4-813f-6a5a5966a32c tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:17:13.765107 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b2fc0c33-dd67-44f4-813f-6a5a5966a32c tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:17:13.765867 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b2fc0c33-dd67-44f4-813f-6a5a5966a32c tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:17:13.942395 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-d5b0cf89-fb7f-46a3-805f-6af1f3880dfb tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:17:13.943023 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-d5b0cf89-fb7f-46a3-805f-6af1f3880dfb tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] [instance: aadddbb1-e053-420e-afd2-9412c6137504] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:17:13.956548 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d5b0cf89-fb7f-46a3-805f-6af1f3880dfb tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:17:13.961426 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d5b0cf89-fb7f-46a3-805f-6af1f3880dfb tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:17:13.962050 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d5b0cf89-fb7f-46a3-805f-6af1f3880dfb tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:17:13.963405 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d5b0cf89-fb7f-46a3-805f-6af1f3880dfb tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:17:13.970644 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d5b0cf89-fb7f-46a3-805f-6af1f3880dfb tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:17:13.971344 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d5b0cf89-fb7f-46a3-805f-6af1f3880dfb tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:17:14.079969 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-b2fc0c33-dd67-44f4-813f-6a5a5966a32c tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a292ffe2c5c41ef8d281fa525792b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdea37d91ed431aa0dc780148174e5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:17:14.100359 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-b2fc0c33-dd67-44f4-813f-6a5a5966a32c tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] 10.222.0.26 "GET /compute/v2.1/servers/c9f0e8ec-d9e4-453f-ab5e-4b0d95a6a7cd" status: 200 len: 1506 microversion: 2.1 time: 0.354081 Oct 08 21:17:14.102024 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2509/5084] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:17:13 2022] GET /compute/v2.1/servers/c9f0e8ec-d9e4-453f-ab5e-4b0d95a6a7cd => generated 1506 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:17:14.548140 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-d5b0cf89-fb7f-46a3-805f-6af1f3880dfb tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8957041987c8487099f0d89f4c64af66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9d29b90ab34abbadd21edbca637d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:17:14.562711 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-d5b0cf89-fb7f-46a3-805f-6af1f3880dfb tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] 10.222.0.26 "GET /compute/v2.1/servers/aadddbb1-e053-420e-afd2-9412c6137504" status: 200 len: 1681 microversion: 2.1 time: 0.624181 Oct 08 21:17:14.566707 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2576/5085] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:17:13 2022] GET /compute/v2.1/servers/aadddbb1-e053-420e-afd2-9412c6137504 => generated 1681 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:17:15.588241 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-73d5767b-89a1-47be-a594-a9ba48d6fa69 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:17:15.589463 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-73d5767b-89a1-47be-a594-a9ba48d6fa69 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] [instance: aadddbb1-e053-420e-afd2-9412c6137504] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:17:15.598723 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-73d5767b-89a1-47be-a594-a9ba48d6fa69 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:17:15.599511 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-73d5767b-89a1-47be-a594-a9ba48d6fa69 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:17:15.600958 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-73d5767b-89a1-47be-a594-a9ba48d6fa69 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:17:15.602115 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-73d5767b-89a1-47be-a594-a9ba48d6fa69 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:17:15.602747 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-73d5767b-89a1-47be-a594-a9ba48d6fa69 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:17:15.603328 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-73d5767b-89a1-47be-a594-a9ba48d6fa69 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:17:15.842060 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-60db4510-09d8-4d70-b517-7a67749cb870 req-28f4911b-1f25-48ab-ae6e-f16de60dda33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aadddbb1-e053-420e-afd2-9412c6137504", "name": "network-vif-deleted", "tag": "e0674cb1-a68b-451f-b3bb-a6e7770eb93e"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:17:15.844287 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-73d5767b-89a1-47be-a594-a9ba48d6fa69 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8957041987c8487099f0d89f4c64af66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9d29b90ab34abbadd21edbca637d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:17:15.860913 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-73d5767b-89a1-47be-a594-a9ba48d6fa69 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] 10.222.0.26 "GET /compute/v2.1/servers/aadddbb1-e053-420e-afd2-9412c6137504" status: 200 len: 1613 microversion: 2.1 time: 0.275400 Oct 08 21:17:15.864268 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2510/5086] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:17:15 2022] GET /compute/v2.1/servers/aadddbb1-e053-420e-afd2-9412c6137504 => generated 1613 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:17:15.869357 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-60db4510-09d8-4d70-b517-7a67749cb870 req-28f4911b-1f25-48ab-ae6e-f16de60dda33 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:17:15.877917 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-60db4510-09d8-4d70-b517-7a67749cb870 req-28f4911b-1f25-48ab-ae6e-f16de60dda33 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:17:15.886162 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-60db4510-09d8-4d70-b517-7a67749cb870 req-28f4911b-1f25-48ab-ae6e-f16de60dda33 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:17:15.912647 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-60db4510-09d8-4d70-b517-7a67749cb870 req-28f4911b-1f25-48ab-ae6e-f16de60dda33 service nova] Creating event network-vif-deleted:e0674cb1-a68b-451f-b3bb-a6e7770eb93e for instance aadddbb1-e053-420e-afd2-9412c6137504 on nch1-master-1 Oct 08 21:17:15.931749 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-60db4510-09d8-4d70-b517-7a67749cb870 req-28f4911b-1f25-48ab-ae6e-f16de60dda33 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094548 Oct 08 21:17:15.936733 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2577/5087] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:17:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:17:16.887838 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-93cae235-41e1-474b-a673-b66880588548 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:17:16.888469 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-93cae235-41e1-474b-a673-b66880588548 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] [instance: aadddbb1-e053-420e-afd2-9412c6137504] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:17:16.907027 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-93cae235-41e1-474b-a673-b66880588548 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:17:16.907778 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-93cae235-41e1-474b-a673-b66880588548 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:17:16.910876 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-93cae235-41e1-474b-a673-b66880588548 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:17:16.911837 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-93cae235-41e1-474b-a673-b66880588548 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:17:16.913740 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-93cae235-41e1-474b-a673-b66880588548 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:17:16.915368 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-93cae235-41e1-474b-a673-b66880588548 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:17:16.969292 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-93cae235-41e1-474b-a673-b66880588548 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] HTTP exception thrown: Instance aadddbb1-e053-420e-afd2-9412c6137504 could not be found. Oct 08 21:17:16.971520 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-93cae235-41e1-474b-a673-b66880588548 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Request method failure captured: Oct 08 21:17:16.971520 ncdv-master-1 devstack@n-api.service[140491]: request: GET /compute/v2.1/servers/aadddbb1-e053-420e-afd2-9412c6137504 HTTP/1.1 Oct 08 21:17:16.971520 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:17:16.971520 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:17:16.971520 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:17:16.971520 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 21:17:16.971520 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:17:16.971520 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:17:16.971520 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:17:16.971520 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:17:16.971520 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQehFIbXs-DGbS_kPUTJMTrUq-WofUYY6ZRyx81bX8dlJ1znB-Icd1X0JZVfoU0lBZbBMu1x5OyOchM7_W_m4wVb0RC5emVnYRQT_LfKB9ZNZm3xjiiSMGa29vJwyibC7NFwQ_T90TzXkiQ39iaomvdVhCKn_tsPv5ogwGAe_Atzwiz8 Oct 08 21:17:16.971520 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:17:16.971520 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:17:16.971520 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:17:16.971520 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:17:16.971520 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:17:16.971520 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:17:16.971520 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 3d9d29b90ab34abbadd21edbca637d2e Oct 08 21:17:16.971520 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-AttachVolumeNegativeTest-1956575659 Oct 08 21:17:16.971520 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:17:16.971520 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:17:16.971520 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3d9d29b90ab34abbadd21edbca637d2e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3d9d29b90ab34abbadd21edbca637d2e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3d9d29b90ab34abbadd21edbca637d2e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3d9d29b90ab34abbadd21edbca637d2e"}]}] Oct 08 21:17:16.971520 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-AttachVolumeNegativeTest-1956575659 Oct 08 21:17:16.971520 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 3d9d29b90ab34abbadd21edbca637d2e Oct 08 21:17:16.971520 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1956575659 Oct 08 21:17:16.971520 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-AttachVolumeNegativeTest-1956575659-project Oct 08 21:17:16.971520 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:17:16.971520 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:17:16.971520 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 8957041987c8487099f0d89f4c64af66 Oct 08 21:17:16.971520 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-AttachVolumeNegativeTest-1956575659-project Oct 08 21:17:16.971520 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:17:16.971520 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance aadddbb1-e053-420e-afd2-9412c6137504 could not be found. Oct 08 21:17:16.971520 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': 'aadddbb1-e053-420e-afd2-9412c6137504'} Oct 08 21:17:16.971520 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:17:16.971520 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:17:16.971520 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:17:16.971520 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:17:16.971520 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:17:16.971520 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:17:16.971520 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:17:16.971520 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:17:16.971520 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:17:16.971520 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:17:16.971520 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aadddbb1-e053-420e-afd2-9412c6137504 could not be found. Oct 08 21:17:16.971520 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:17:16.971520 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:17:16.971520 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:17:16.971520 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:17:16.971520 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:17:16.971520 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:17:16.971520 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:17:16.971520 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:17:16.971520 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:17:16.971520 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:17:16.971520 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:17:16.971520 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:17:16.971520 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:17:16.971520 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:17:16.971520 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:17:16.971520 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:17:16.971520 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aadddbb1-e053-420e-afd2-9412c6137504 could not be found. Oct 08 21:17:16.971520 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:17:16.971520 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:17:16.971520 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:17:16.975794 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:17:16.975794 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:17:16.975794 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:17:16.975794 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:17:16.975794 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:17:16.975794 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aadddbb1-e053-420e-afd2-9412c6137504 could not be found. Oct 08 21:17:16.975794 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:17:16.985540 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-93cae235-41e1-474b-a673-b66880588548 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Returning 404 to user: Instance aadddbb1-e053-420e-afd2-9412c6137504 could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:17:16.987221 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-93cae235-41e1-474b-a673-b66880588548 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] 10.222.0.26 "GET /compute/v2.1/servers/aadddbb1-e053-420e-afd2-9412c6137504" status: 404 len: 111 microversion: 2.1 time: 0.106044 Oct 08 21:17:16.988208 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2511/5088] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:17:16 2022] GET /compute/v2.1/servers/aadddbb1-e053-420e-afd2-9412c6137504 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:17:16.999673 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-a096e9d8-cb11-49fd-9d45-f2e9ac02de68 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Calling method '.version_select at 0x7f1a874e1820>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:17:17.036385 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-a096e9d8-cb11-49fd-9d45-f2e9ac02de68 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-88701933" status: 202 len: 0 microversion: 2.1 time: 0.035171 Oct 08 21:17:17.038094 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2578/5089] 10.222.0.26 () {58 vars in 1215 bytes} [Sat Oct 8 21:17:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-88701933 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 21:17:17.085651 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-3530d036-0992-4224-87a3-4500de7bc026 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "345abd03-d885-42f6-826d-f0d74c528f9c", "device": "/dev/sdb"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:17:17.088152 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-3530d036-0992-4224-87a3-4500de7bc026 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] [instance: c9f0e8ec-d9e4-453f-ab5e-4b0d95a6a7cd] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:17:17.113323 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3530d036-0992-4224-87a3-4500de7bc026 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:17:17.114731 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3530d036-0992-4224-87a3-4500de7bc026 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:17:17.117148 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3530d036-0992-4224-87a3-4500de7bc026 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:17:17.121911 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3530d036-0992-4224-87a3-4500de7bc026 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:17:17.122499 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3530d036-0992-4224-87a3-4500de7bc026 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:17:17.122957 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3530d036-0992-4224-87a3-4500de7bc026 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:17:17.747762 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-3530d036-0992-4224-87a3-4500de7bc026 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] 10.222.0.26 "POST /compute/v2.1/servers/c9f0e8ec-d9e4-453f-ab5e-4b0d95a6a7cd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.668355 Oct 08 21:17:17.749310 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2512/5090] 10.222.0.26 () {60 vars in 1323 bytes} [Sat Oct 8 21:17:17 2022] POST /compute/v2.1/servers/c9f0e8ec-d9e4-453f-ab5e-4b0d95a6a7cd/os-volume_attachments => generated 194 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:17:19.927299 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e19189cb-45c1-4e21-8762-95474282345e tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Action: 'create', calling method: .version_select at 0x7f1a8c09f4c0>, body: {"keypair": {"name": "tempest-keypair-655169559", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGkCARPr6tQ86oAi+Up1BywYCN8xB36tE6V6PzZ65pP2Xkrbxsa0LJsURgjOOmWuEi3MiQXo2r27gFdwfSPonPn8SdZgZrLnPr59sRd+SU1fOYEw6h1sSYXcTplHb6+m+Q=="}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:17:20.008042 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-e19189cb-45c1-4e21-8762-95474282345e tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Getting quotas for project 3d9d29b90ab34abbadd21edbca637d2e. Resources: {'key_pairs'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:17:20.014810 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-e19189cb-45c1-4e21-8762-95474282345e tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Getting quotas for user 8957041987c8487099f0d89f4c64af66 and project 3d9d29b90ab34abbadd21edbca637d2e. Resources: {'key_pairs'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:17:20.109267 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-e19189cb-45c1-4e21-8762-95474282345e tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.194235 Oct 08 21:17:20.113525 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2579/5091] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Oct 8 21:17:19 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:17:22.953938 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-b3161450-a428-4bc1-b5dd-1f8386a290f0 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Action: 'create', calling method: .version_select at 0x7f1a87df9ca0>, body: {"keypair": {"name": "tempest-keypair-1238908508", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFywA3Xv/wv5cPyuzHXySw1DbV6L+8OnhMhglPtTALSvWjSJEctT9+pKGc5TuN/VxmwrAYThpW3qnYn2R1jutqBDjguA4v72S3h9+PbtcNeKDJRA+UYXzbJdpR6bgrbnCQ=="}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:17:23.001108 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-b3161450-a428-4bc1-b5dd-1f8386a290f0 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Getting quotas for project bd563fa73afb42c6b26eca3737d7a355. Resources: {'key_pairs'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:17:23.019921 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-b3161450-a428-4bc1-b5dd-1f8386a290f0 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Getting quotas for user 2f98e01cab6b49c7a5d239aee95f4a64 and project bd563fa73afb42c6b26eca3737d7a355. Resources: {'key_pairs'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:17:23.081590 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-b3161450-a428-4bc1-b5dd-1f8386a290f0 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.388408 Oct 08 21:17:23.082208 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2513/5092] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Oct 8 21:17:22 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:17:28.448222 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-7f4c6d55-a0c9-4d8d-8c25-c9c72bf176c7 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1565939365", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3bac7a36-9cfd-41c8-b181-a7db0bd13b90"}], "security_groups": [{"name": "tempest-securitygroup--109679871"}], "key_name": "tempest-keypair-655169559", "user_data": "}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:17:28.509949 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=55 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:17:29.125348 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.network.neutron [None req-7f4c6d55-a0c9-4d8d-8c25-c9c72bf176c7 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] validate_networks() for [('3bac7a36-9cfd-41c8-b181-a7db0bd13b90', None, None, None, None, None)] {{(pid=140492) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 21:17:29.353075 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:17:29.362378 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-664f03ea-7b86-4c9a-ad98-95e2b4fd9823 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1485292995", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f6f1b01d-e3ee-45fc-896d-218868fb9293"}], "security_groups": [{"name": "tempest-securitygroup--2084537866"}], "key_name": "tempest-keypair-1238908508", "user_data": "}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:17:29.755900 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-7f4c6d55-a0c9-4d8d-8c25-c9c72bf176c7 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Flavor limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 21:17:29.757790 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-7f4c6d55-a0c9-4d8d-8c25-c9c72bf176c7 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Image limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 21:17:29.758521 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-7f4c6d55-a0c9-4d8d-8c25-c9c72bf176c7 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Flavor pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 21:17:29.759328 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-7f4c6d55-a0c9-4d8d-8c25-c9c72bf176c7 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Image pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 21:17:29.759770 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-7f4c6d55-a0c9-4d8d-8c25-c9c72bf176c7 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 21:17:29.775553 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7f4c6d55-a0c9-4d8d-8c25-c9c72bf176c7 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:17:29.776286 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7f4c6d55-a0c9-4d8d-8c25-c9c72bf176c7 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:17:29.776919 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7f4c6d55-a0c9-4d8d-8c25-c9c72bf176c7 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:17:29.778794 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7f4c6d55-a0c9-4d8d-8c25-c9c72bf176c7 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:17:29.779420 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7f4c6d55-a0c9-4d8d-8c25-c9c72bf176c7 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:17:29.780043 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7f4c6d55-a0c9-4d8d-8c25-c9c72bf176c7 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:17:29.804573 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-7f4c6d55-a0c9-4d8d-8c25-c9c72bf176c7 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Getting quotas for project 3d9d29b90ab34abbadd21edbca637d2e. Resources: {'cores', 'instances', 'ram'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:17:29.811689 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-7f4c6d55-a0c9-4d8d-8c25-c9c72bf176c7 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Getting quotas for user 8957041987c8487099f0d89f4c64af66 and project 3d9d29b90ab34abbadd21edbca637d2e. Resources: {'cores', 'instances', 'ram'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:17:29.826946 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.network.neutron [None req-664f03ea-7b86-4c9a-ad98-95e2b4fd9823 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] validate_networks() for [('f6f1b01d-e3ee-45fc-896d-218868fb9293', None, None, None, None, None)] {{(pid=140491) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 21:17:29.832387 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-7f4c6d55-a0c9-4d8d-8c25-c9c72bf176c7 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Going to run 1 instances... {{(pid=140492) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 21:17:29.838609 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-7f4c6d55-a0c9-4d8d-8c25-c9c72bf176c7 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] [instance: 17c182d5-d3c8-4e7e-babc-46af1f466f00] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c508bd7f-7db9-4b2c-af7c-be54a855c355',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140492) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 21:17:29.954872 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-7f4c6d55-a0c9-4d8d-8c25-c9c72bf176c7 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.514359 Oct 08 21:17:29.961855 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2580/5093] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 21:17:28 2022] POST /compute/v2.1/servers => generated 401 bytes in 1516 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 08 21:17:29.973535 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-7324964e-98e3-4052-a9d6-0747e4986c85 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:17:29.975247 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-7324964e-98e3-4052-a9d6-0747e4986c85 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] [instance: 17c182d5-d3c8-4e7e-babc-46af1f466f00] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:17:30.111361 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-7324964e-98e3-4052-a9d6-0747e4986c85 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8957041987c8487099f0d89f4c64af66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9d29b90ab34abbadd21edbca637d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:17:30.125758 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-7324964e-98e3-4052-a9d6-0747e4986c85 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] 10.222.0.26 "GET /compute/v2.1/servers/17c182d5-d3c8-4e7e-babc-46af1f466f00" status: 200 len: 1241 microversion: 2.1 time: 0.158021 Oct 08 21:17:30.126679 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2581/5094] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:17:29 2022] GET /compute/v2.1/servers/17c182d5-d3c8-4e7e-babc-46af1f466f00 => generated 1241 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:17:31.153037 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-6ea57a7a-e64e-4d16-988c-871271aadab8 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:17:31.153688 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-6ea57a7a-e64e-4d16-988c-871271aadab8 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] [instance: 17c182d5-d3c8-4e7e-babc-46af1f466f00] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:17:31.173966 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6ea57a7a-e64e-4d16-988c-871271aadab8 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:17:31.174629 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6ea57a7a-e64e-4d16-988c-871271aadab8 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:17:31.175168 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6ea57a7a-e64e-4d16-988c-871271aadab8 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:17:31.176000 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6ea57a7a-e64e-4d16-988c-871271aadab8 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:17:31.177609 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6ea57a7a-e64e-4d16-988c-871271aadab8 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:17:31.179892 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6ea57a7a-e64e-4d16-988c-871271aadab8 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:17:31.471345 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-6ea57a7a-e64e-4d16-988c-871271aadab8 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8957041987c8487099f0d89f4c64af66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9d29b90ab34abbadd21edbca637d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:17:31.509444 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-6ea57a7a-e64e-4d16-988c-871271aadab8 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] 10.222.0.26 "GET /compute/v2.1/servers/17c182d5-d3c8-4e7e-babc-46af1f466f00" status: 200 len: 1293 microversion: 2.1 time: 0.358919 Oct 08 21:17:31.521923 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2582/5095] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:17:31 2022] GET /compute/v2.1/servers/17c182d5-d3c8-4e7e-babc-46af1f466f00 => generated 1293 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:17:31.588793 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-664f03ea-7b86-4c9a-ad98-95e2b4fd9823 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Flavor limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 21:17:31.589274 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-664f03ea-7b86-4c9a-ad98-95e2b4fd9823 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Image limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 21:17:31.589774 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-664f03ea-7b86-4c9a-ad98-95e2b4fd9823 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Flavor pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 21:17:31.590292 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-664f03ea-7b86-4c9a-ad98-95e2b4fd9823 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Image pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 21:17:31.590764 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-664f03ea-7b86-4c9a-ad98-95e2b4fd9823 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 21:17:31.629793 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-664f03ea-7b86-4c9a-ad98-95e2b4fd9823 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:17:31.630636 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-664f03ea-7b86-4c9a-ad98-95e2b4fd9823 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:17:31.631270 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-664f03ea-7b86-4c9a-ad98-95e2b4fd9823 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:17:31.632512 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-664f03ea-7b86-4c9a-ad98-95e2b4fd9823 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:17:31.633696 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-664f03ea-7b86-4c9a-ad98-95e2b4fd9823 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:17:31.634434 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-664f03ea-7b86-4c9a-ad98-95e2b4fd9823 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:17:31.667073 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-664f03ea-7b86-4c9a-ad98-95e2b4fd9823 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Getting quotas for project bd563fa73afb42c6b26eca3737d7a355. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:17:31.689622 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-664f03ea-7b86-4c9a-ad98-95e2b4fd9823 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Getting quotas for user 2f98e01cab6b49c7a5d239aee95f4a64 and project bd563fa73afb42c6b26eca3737d7a355. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:17:31.721660 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-664f03ea-7b86-4c9a-ad98-95e2b4fd9823 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Going to run 1 instances... {{(pid=140491) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 21:17:31.724931 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-664f03ea-7b86-4c9a-ad98-95e2b4fd9823 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 2a61f287-652b-487f-9ecd-fb4d2d1eee62] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c508bd7f-7db9-4b2c-af7c-be54a855c355',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140491) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 21:17:31.923490 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-664f03ea-7b86-4c9a-ad98-95e2b4fd9823 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 2.565971 Oct 08 21:17:31.948490 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-d0854752-f8d1-4a6a-aff8-4b811c1da689 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:17:31.949246 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-d0854752-f8d1-4a6a-aff8-4b811c1da689 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 2a61f287-652b-487f-9ecd-fb4d2d1eee62] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:17:31.959563 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2514/5096] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 21:17:29 2022] POST /compute/v2.1/servers => generated 409 bytes in 2617 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 08 21:17:32.451084 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-d0854752-f8d1-4a6a-aff8-4b811c1da689 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:17:32.459570 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-d0854752-f8d1-4a6a-aff8-4b811c1da689 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62" status: 200 len: 1239 microversion: 2.1 time: 0.525076 Oct 08 21:17:32.466381 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2583/5097] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:17:31 2022] GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62 => generated 1239 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:17:32.557168 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-a5ffefbf-1c2a-4ea9-a7ac-9715ecd6bc6c tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:17:32.558748 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-a5ffefbf-1c2a-4ea9-a7ac-9715ecd6bc6c tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] [instance: 17c182d5-d3c8-4e7e-babc-46af1f466f00] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:17:32.578208 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:17:32.635666 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a5ffefbf-1c2a-4ea9-a7ac-9715ecd6bc6c tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:17:32.637068 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a5ffefbf-1c2a-4ea9-a7ac-9715ecd6bc6c tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:17:32.638584 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a5ffefbf-1c2a-4ea9-a7ac-9715ecd6bc6c tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:17:32.640267 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a5ffefbf-1c2a-4ea9-a7ac-9715ecd6bc6c tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:17:32.646084 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a5ffefbf-1c2a-4ea9-a7ac-9715ecd6bc6c tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:17:32.647546 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a5ffefbf-1c2a-4ea9-a7ac-9715ecd6bc6c tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:17:32.836478 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-a5ffefbf-1c2a-4ea9-a7ac-9715ecd6bc6c tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8957041987c8487099f0d89f4c64af66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9d29b90ab34abbadd21edbca637d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:17:32.858638 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-a5ffefbf-1c2a-4ea9-a7ac-9715ecd6bc6c tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] 10.222.0.26 "GET /compute/v2.1/servers/17c182d5-d3c8-4e7e-babc-46af1f466f00" status: 200 len: 1299 microversion: 2.1 time: 0.313082 Oct 08 21:17:32.859809 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2515/5098] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:17:32 2022] GET /compute/v2.1/servers/17c182d5-d3c8-4e7e-babc-46af1f466f00 => generated 1299 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:17:33.496583 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-8b8416e0-9393-4aa9-aa71-e0630a7a7ba4 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:17:33.497887 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-8b8416e0-9393-4aa9-aa71-e0630a7a7ba4 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 2a61f287-652b-487f-9ecd-fb4d2d1eee62] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:17:33.510695 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8b8416e0-9393-4aa9-aa71-e0630a7a7ba4 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:17:33.514258 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8b8416e0-9393-4aa9-aa71-e0630a7a7ba4 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:17:33.514902 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8b8416e0-9393-4aa9-aa71-e0630a7a7ba4 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:17:33.516669 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8b8416e0-9393-4aa9-aa71-e0630a7a7ba4 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:17:33.529174 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8b8416e0-9393-4aa9-aa71-e0630a7a7ba4 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:17:33.533014 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8b8416e0-9393-4aa9-aa71-e0630a7a7ba4 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:17:33.777507 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-8b8416e0-9393-4aa9-aa71-e0630a7a7ba4 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:17:33.804244 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-8b8416e0-9393-4aa9-aa71-e0630a7a7ba4 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62" status: 200 len: 1291 microversion: 2.1 time: 0.309332 Oct 08 21:17:33.805293 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2584/5099] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:17:33 2022] GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62 => generated 1291 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:17:33.896811 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-cc837727-6090-47d6-8f01-78e943092b08 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:17:33.905619 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-cc837727-6090-47d6-8f01-78e943092b08 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] [instance: 17c182d5-d3c8-4e7e-babc-46af1f466f00] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:17:33.941853 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cc837727-6090-47d6-8f01-78e943092b08 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:17:33.942962 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cc837727-6090-47d6-8f01-78e943092b08 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:17:33.946536 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cc837727-6090-47d6-8f01-78e943092b08 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:17:33.955244 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cc837727-6090-47d6-8f01-78e943092b08 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:17:33.956376 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cc837727-6090-47d6-8f01-78e943092b08 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:17:33.957096 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cc837727-6090-47d6-8f01-78e943092b08 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:17:34.838589 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-5d8794fe-f345-45c7-9dff-24969480f0a0 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:17:34.839962 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-5d8794fe-f345-45c7-9dff-24969480f0a0 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 2a61f287-652b-487f-9ecd-fb4d2d1eee62] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:17:34.861446 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=68,nova_api:DELETE=2,nova_api:INSERT=4 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:17:34.886918 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5d8794fe-f345-45c7-9dff-24969480f0a0 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:17:34.891457 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5d8794fe-f345-45c7-9dff-24969480f0a0 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:17:34.892338 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5d8794fe-f345-45c7-9dff-24969480f0a0 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:17:34.893387 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5d8794fe-f345-45c7-9dff-24969480f0a0 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:17:34.896190 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5d8794fe-f345-45c7-9dff-24969480f0a0 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:17:34.896959 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5d8794fe-f345-45c7-9dff-24969480f0a0 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:17:35.265442 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-cc837727-6090-47d6-8f01-78e943092b08 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8957041987c8487099f0d89f4c64af66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9d29b90ab34abbadd21edbca637d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:17:35.270854 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-5d8794fe-f345-45c7-9dff-24969480f0a0 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:17:35.274313 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-cc837727-6090-47d6-8f01-78e943092b08 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] 10.222.0.26 "GET /compute/v2.1/servers/17c182d5-d3c8-4e7e-babc-46af1f466f00" status: 200 len: 1366 microversion: 2.1 time: 1.382553 Oct 08 21:17:35.281930 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2516/5100] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:17:33 2022] GET /compute/v2.1/servers/17c182d5-d3c8-4e7e-babc-46af1f466f00 => generated 1366 bytes in 1391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:17:35.299195 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-5d8794fe-f345-45c7-9dff-24969480f0a0 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62" status: 200 len: 1297 microversion: 2.1 time: 0.463541 Oct 08 21:17:35.302641 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2585/5101] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:17:34 2022] GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62 => generated 1297 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:17:36.303462 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-33979f31-bcfd-445f-99ea-5fb282c6cb6b tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:17:36.304796 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-33979f31-bcfd-445f-99ea-5fb282c6cb6b tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] [instance: 17c182d5-d3c8-4e7e-babc-46af1f466f00] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:17:36.323205 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-5eb34b19-3860-49da-9f5d-6dade93b9ac9 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:17:36.324611 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-5eb34b19-3860-49da-9f5d-6dade93b9ac9 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 2a61f287-652b-487f-9ecd-fb4d2d1eee62] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:17:36.337875 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-33979f31-bcfd-445f-99ea-5fb282c6cb6b tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:17:36.338388 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-33979f31-bcfd-445f-99ea-5fb282c6cb6b tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:17:36.338945 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-33979f31-bcfd-445f-99ea-5fb282c6cb6b tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:17:36.339555 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-33979f31-bcfd-445f-99ea-5fb282c6cb6b tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:17:36.345749 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5eb34b19-3860-49da-9f5d-6dade93b9ac9 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:17:36.346336 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5eb34b19-3860-49da-9f5d-6dade93b9ac9 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:17:36.346803 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5eb34b19-3860-49da-9f5d-6dade93b9ac9 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:17:36.347571 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5eb34b19-3860-49da-9f5d-6dade93b9ac9 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:17:36.348048 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5eb34b19-3860-49da-9f5d-6dade93b9ac9 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:17:36.348491 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5eb34b19-3860-49da-9f5d-6dade93b9ac9 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:17:36.359695 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-33979f31-bcfd-445f-99ea-5fb282c6cb6b tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:17:36.360362 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-33979f31-bcfd-445f-99ea-5fb282c6cb6b tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:17:36.895365 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-33979f31-bcfd-445f-99ea-5fb282c6cb6b tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8957041987c8487099f0d89f4c64af66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9d29b90ab34abbadd21edbca637d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:17:36.914028 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-33979f31-bcfd-445f-99ea-5fb282c6cb6b tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] 10.222.0.26 "GET /compute/v2.1/servers/17c182d5-d3c8-4e7e-babc-46af1f466f00" status: 200 len: 1366 microversion: 2.1 time: 0.610714 Oct 08 21:17:36.919042 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2517/5102] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:17:36 2022] GET /compute/v2.1/servers/17c182d5-d3c8-4e7e-babc-46af1f466f00 => generated 1366 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:17:37.220448 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-5eb34b19-3860-49da-9f5d-6dade93b9ac9 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:17:37.234492 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-5eb34b19-3860-49da-9f5d-6dade93b9ac9 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62" status: 200 len: 1365 microversion: 2.1 time: 0.914455 Oct 08 21:17:37.238056 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2586/5103] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:17:36 2022] GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62 => generated 1365 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:17:37.942090 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-44890e7b-ee33-40b5-aade-becd81843cc0 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:17:37.943444 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-44890e7b-ee33-40b5-aade-becd81843cc0 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] [instance: 17c182d5-d3c8-4e7e-babc-46af1f466f00] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:17:37.959336 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-44890e7b-ee33-40b5-aade-becd81843cc0 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:17:37.961418 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-44890e7b-ee33-40b5-aade-becd81843cc0 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:17:37.962087 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-44890e7b-ee33-40b5-aade-becd81843cc0 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:17:37.969097 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-44890e7b-ee33-40b5-aade-becd81843cc0 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:17:37.969806 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-44890e7b-ee33-40b5-aade-becd81843cc0 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:17:37.970494 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-44890e7b-ee33-40b5-aade-becd81843cc0 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:17:38.095977 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-0b6126c5-9c3f-4db6-a779-3c7729601af7 req-dc7989e2-2081-4ddf-bc06-ad5fa64eb260 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17c182d5-d3c8-4e7e-babc-46af1f466f00", "tag": "ab6505ab-132c-43a4-ac9d-087f44752486"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:17:38.123721 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-0b6126c5-9c3f-4db6-a779-3c7729601af7 req-dc7989e2-2081-4ddf-bc06-ad5fa64eb260 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:17:38.124264 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-0b6126c5-9c3f-4db6-a779-3c7729601af7 req-dc7989e2-2081-4ddf-bc06-ad5fa64eb260 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:17:38.124712 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-0b6126c5-9c3f-4db6-a779-3c7729601af7 req-dc7989e2-2081-4ddf-bc06-ad5fa64eb260 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:17:38.160880 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-0b6126c5-9c3f-4db6-a779-3c7729601af7 req-dc7989e2-2081-4ddf-bc06-ad5fa64eb260 service nova] Creating event network-changed:ab6505ab-132c-43a4-ac9d-087f44752486 for instance 17c182d5-d3c8-4e7e-babc-46af1f466f00 on nch2-master-1 Oct 08 21:17:38.173906 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-0b6126c5-9c3f-4db6-a779-3c7729601af7 req-dc7989e2-2081-4ddf-bc06-ad5fa64eb260 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.368588 Oct 08 21:17:38.174914 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2518/5104] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:17:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:17:38.263241 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-4b844858-85f8-46a4-ae3a-7041830ac7a9 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:17:38.264399 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-4b844858-85f8-46a4-ae3a-7041830ac7a9 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 2a61f287-652b-487f-9ecd-fb4d2d1eee62] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:17:38.290611 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4b844858-85f8-46a4-ae3a-7041830ac7a9 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:17:38.292373 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4b844858-85f8-46a4-ae3a-7041830ac7a9 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:17:38.293631 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4b844858-85f8-46a4-ae3a-7041830ac7a9 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:17:38.297499 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4b844858-85f8-46a4-ae3a-7041830ac7a9 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:17:38.298025 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4b844858-85f8-46a4-ae3a-7041830ac7a9 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:17:38.300072 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4b844858-85f8-46a4-ae3a-7041830ac7a9 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:17:38.694633 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-44890e7b-ee33-40b5-aade-becd81843cc0 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8957041987c8487099f0d89f4c64af66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9d29b90ab34abbadd21edbca637d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:17:38.714582 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-44890e7b-ee33-40b5-aade-becd81843cc0 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] 10.222.0.26 "GET /compute/v2.1/servers/17c182d5-d3c8-4e7e-babc-46af1f466f00" status: 200 len: 1366 microversion: 2.1 time: 0.776209 Oct 08 21:17:38.729328 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2587/5105] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:17:37 2022] GET /compute/v2.1/servers/17c182d5-d3c8-4e7e-babc-46af1f466f00 => generated 1366 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:17:39.597931 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-4b844858-85f8-46a4-ae3a-7041830ac7a9 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:17:39.624191 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-4b844858-85f8-46a4-ae3a-7041830ac7a9 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62" status: 200 len: 1365 microversion: 2.1 time: 1.355595 Oct 08 21:17:39.625780 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2519/5106] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:17:38 2022] GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62 => generated 1365 bytes in 1371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:17:39.753626 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-c3c2513d-ed1f-4312-9882-99618d1895a0 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:17:39.754893 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-c3c2513d-ed1f-4312-9882-99618d1895a0 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] [instance: 17c182d5-d3c8-4e7e-babc-46af1f466f00] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:17:39.776041 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c3c2513d-ed1f-4312-9882-99618d1895a0 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:17:39.777205 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c3c2513d-ed1f-4312-9882-99618d1895a0 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:17:39.777864 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c3c2513d-ed1f-4312-9882-99618d1895a0 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:17:39.778796 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c3c2513d-ed1f-4312-9882-99618d1895a0 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:17:39.779489 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c3c2513d-ed1f-4312-9882-99618d1895a0 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:17:39.780148 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c3c2513d-ed1f-4312-9882-99618d1895a0 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:17:39.817910 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=2 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:17:40.652568 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-d617dc27-2859-4aa0-a51e-b3f5a5f64091 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:17:40.653833 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-d617dc27-2859-4aa0-a51e-b3f5a5f64091 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 2a61f287-652b-487f-9ecd-fb4d2d1eee62] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:17:40.686078 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d617dc27-2859-4aa0-a51e-b3f5a5f64091 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:17:40.688024 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d617dc27-2859-4aa0-a51e-b3f5a5f64091 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:17:40.688651 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d617dc27-2859-4aa0-a51e-b3f5a5f64091 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:17:40.689592 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d617dc27-2859-4aa0-a51e-b3f5a5f64091 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:17:40.690248 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d617dc27-2859-4aa0-a51e-b3f5a5f64091 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:17:40.690847 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d617dc27-2859-4aa0-a51e-b3f5a5f64091 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:17:40.890246 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-c3c2513d-ed1f-4312-9882-99618d1895a0 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8957041987c8487099f0d89f4c64af66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9d29b90ab34abbadd21edbca637d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:17:40.908009 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-c3c2513d-ed1f-4312-9882-99618d1895a0 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] 10.222.0.26 "GET /compute/v2.1/servers/17c182d5-d3c8-4e7e-babc-46af1f466f00" status: 200 len: 1366 microversion: 2.1 time: 1.159718 Oct 08 21:17:40.912906 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2588/5107] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:17:39 2022] GET /compute/v2.1/servers/17c182d5-d3c8-4e7e-babc-46af1f466f00 => generated 1366 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:17:40.923240 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-a845a9a9-f5b4-41e5-9074-51aaf52b8f06 req-545e69bc-7f3d-4751-9f23-9948b7c39981 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a61f287-652b-487f-9ecd-fb4d2d1eee62", "tag": "960ff13a-d0c5-4f5c-af4b-44aec29e7c23"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:17:40.955137 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-a845a9a9-f5b4-41e5-9074-51aaf52b8f06 req-545e69bc-7f3d-4751-9f23-9948b7c39981 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:17:40.956504 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-a845a9a9-f5b4-41e5-9074-51aaf52b8f06 req-545e69bc-7f3d-4751-9f23-9948b7c39981 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:17:40.959314 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-a845a9a9-f5b4-41e5-9074-51aaf52b8f06 req-545e69bc-7f3d-4751-9f23-9948b7c39981 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:17:41.007231 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-a845a9a9-f5b4-41e5-9074-51aaf52b8f06 req-545e69bc-7f3d-4751-9f23-9948b7c39981 service nova] Creating event network-changed:960ff13a-d0c5-4f5c-af4b-44aec29e7c23 for instance 2a61f287-652b-487f-9ecd-fb4d2d1eee62 on nch1-master-1 Oct 08 21:17:41.028311 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-a845a9a9-f5b4-41e5-9074-51aaf52b8f06 req-545e69bc-7f3d-4751-9f23-9948b7c39981 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114053 Oct 08 21:17:41.035379 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2589/5108] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:17:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:17:41.323775 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-d617dc27-2859-4aa0-a51e-b3f5a5f64091 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:17:41.361524 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-d617dc27-2859-4aa0-a51e-b3f5a5f64091 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62" status: 200 len: 1365 microversion: 2.1 time: 0.693197 Oct 08 21:17:41.364848 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2520/5109] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:17:40 2022] GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62 => generated 1365 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:17:41.939554 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-5055b314-097d-48b5-8104-160116022323 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:17:41.940865 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-5055b314-097d-48b5-8104-160116022323 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] [instance: 17c182d5-d3c8-4e7e-babc-46af1f466f00] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:17:41.959807 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5055b314-097d-48b5-8104-160116022323 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:17:41.961234 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5055b314-097d-48b5-8104-160116022323 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:17:41.961940 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5055b314-097d-48b5-8104-160116022323 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:17:41.962892 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5055b314-097d-48b5-8104-160116022323 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:17:41.963651 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5055b314-097d-48b5-8104-160116022323 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:17:41.964299 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5055b314-097d-48b5-8104-160116022323 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:17:42.388170 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-ca1fdecf-ed13-4e3b-8451-f478174102a6 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:17:42.391511 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-ca1fdecf-ed13-4e3b-8451-f478174102a6 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 2a61f287-652b-487f-9ecd-fb4d2d1eee62] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:17:42.408191 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=2 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:17:42.412722 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=10 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:17:42.414581 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ca1fdecf-ed13-4e3b-8451-f478174102a6 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:17:42.417988 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ca1fdecf-ed13-4e3b-8451-f478174102a6 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:17:42.418514 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ca1fdecf-ed13-4e3b-8451-f478174102a6 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:17:42.419343 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ca1fdecf-ed13-4e3b-8451-f478174102a6 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:17:42.422737 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ca1fdecf-ed13-4e3b-8451-f478174102a6 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:17:42.424728 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ca1fdecf-ed13-4e3b-8451-f478174102a6 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:17:42.459276 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=14 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:17:42.523018 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-5055b314-097d-48b5-8104-160116022323 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8957041987c8487099f0d89f4c64af66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9d29b90ab34abbadd21edbca637d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:17:42.549200 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-5055b314-097d-48b5-8104-160116022323 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] 10.222.0.26 "GET /compute/v2.1/servers/17c182d5-d3c8-4e7e-babc-46af1f466f00" status: 200 len: 1366 microversion: 2.1 time: 0.609500 Oct 08 21:17:42.550583 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2590/5110] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:17:41 2022] GET /compute/v2.1/servers/17c182d5-d3c8-4e7e-babc-46af1f466f00 => generated 1366 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:17:42.919607 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-ca1fdecf-ed13-4e3b-8451-f478174102a6 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:17:42.934840 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-ca1fdecf-ed13-4e3b-8451-f478174102a6 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62" status: 200 len: 1365 microversion: 2.1 time: 0.550589 Oct 08 21:17:42.939428 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2521/5111] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:17:42 2022] GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62 => generated 1365 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:17:43.573130 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-0f2cc2e6-069b-419e-b05f-73c71731a7dc tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:17:43.573818 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-0f2cc2e6-069b-419e-b05f-73c71731a7dc tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] [instance: 17c182d5-d3c8-4e7e-babc-46af1f466f00] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:17:43.601239 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0f2cc2e6-069b-419e-b05f-73c71731a7dc tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:17:43.602363 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0f2cc2e6-069b-419e-b05f-73c71731a7dc tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:17:43.603042 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0f2cc2e6-069b-419e-b05f-73c71731a7dc tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:17:43.603935 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0f2cc2e6-069b-419e-b05f-73c71731a7dc tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:17:43.608822 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0f2cc2e6-069b-419e-b05f-73c71731a7dc tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:17:43.609714 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0f2cc2e6-069b-419e-b05f-73c71731a7dc tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:17:43.966945 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-01848043-ec2e-4810-ad3c-e2ddc777cd89 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:17:43.968557 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-01848043-ec2e-4810-ad3c-e2ddc777cd89 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 2a61f287-652b-487f-9ecd-fb4d2d1eee62] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:17:43.979105 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-01848043-ec2e-4810-ad3c-e2ddc777cd89 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:17:43.981274 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-01848043-ec2e-4810-ad3c-e2ddc777cd89 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:17:43.981889 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-01848043-ec2e-4810-ad3c-e2ddc777cd89 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:17:43.985992 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-01848043-ec2e-4810-ad3c-e2ddc777cd89 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:17:43.987261 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-01848043-ec2e-4810-ad3c-e2ddc777cd89 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:17:43.987861 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-01848043-ec2e-4810-ad3c-e2ddc777cd89 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:17:44.647560 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-0f2cc2e6-069b-419e-b05f-73c71731a7dc tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8957041987c8487099f0d89f4c64af66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9d29b90ab34abbadd21edbca637d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:17:44.651744 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-01848043-ec2e-4810-ad3c-e2ddc777cd89 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:17:44.682626 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-01848043-ec2e-4810-ad3c-e2ddc777cd89 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62" status: 200 len: 1365 microversion: 2.1 time: 0.720113 Oct 08 21:17:44.698511 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2522/5112] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:17:43 2022] GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62 => generated 1365 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:17:44.698678 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-0f2cc2e6-069b-419e-b05f-73c71731a7dc tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] 10.222.0.26 "GET /compute/v2.1/servers/17c182d5-d3c8-4e7e-babc-46af1f466f00" status: 200 len: 1366 microversion: 2.1 time: 1.111561 Oct 08 21:17:44.698678 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2591/5113] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:17:43 2022] GET /compute/v2.1/servers/17c182d5-d3c8-4e7e-babc-46af1f466f00 => generated 1366 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:17:45.037497 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-6b7a7017-b5a4-4bf8-ad1f-9d00cd468cf7 req-c3fbee3b-90c2-4e1a-a983-30e2fd3fc1c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17c182d5-d3c8-4e7e-babc-46af1f466f00", "name": "network-vif-plugged", "status": "completed", "tag": "ab6505ab-132c-43a4-ac9d-087f44752486"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:17:45.054388 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-6b7a7017-b5a4-4bf8-ad1f-9d00cd468cf7 req-c3fbee3b-90c2-4e1a-a983-30e2fd3fc1c8 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:17:45.055061 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-6b7a7017-b5a4-4bf8-ad1f-9d00cd468cf7 req-c3fbee3b-90c2-4e1a-a983-30e2fd3fc1c8 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:17:45.059653 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-6b7a7017-b5a4-4bf8-ad1f-9d00cd468cf7 req-c3fbee3b-90c2-4e1a-a983-30e2fd3fc1c8 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:17:45.083841 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-6b7a7017-b5a4-4bf8-ad1f-9d00cd468cf7 req-c3fbee3b-90c2-4e1a-a983-30e2fd3fc1c8 service nova] Creating event network-vif-plugged:ab6505ab-132c-43a4-ac9d-087f44752486 for instance 17c182d5-d3c8-4e7e-babc-46af1f466f00 on nch2-master-1 Oct 08 21:17:45.098027 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-6b7a7017-b5a4-4bf8-ad1f-9d00cd468cf7 req-c3fbee3b-90c2-4e1a-a983-30e2fd3fc1c8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066956 Oct 08 21:17:45.099257 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2523/5114] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:17:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:17:45.718665 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-7ea750a0-79a0-456d-83db-1044e812e32c tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:17:45.719508 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-f1cfdab7-9884-4fc3-bc1a-eedfea30f266 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:17:45.721313 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-f1cfdab7-9884-4fc3-bc1a-eedfea30f266 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] [instance: 17c182d5-d3c8-4e7e-babc-46af1f466f00] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:17:45.724118 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-7ea750a0-79a0-456d-83db-1044e812e32c tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 2a61f287-652b-487f-9ecd-fb4d2d1eee62] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:17:45.742935 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f1cfdab7-9884-4fc3-bc1a-eedfea30f266 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:17:45.744152 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f1cfdab7-9884-4fc3-bc1a-eedfea30f266 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:17:45.752093 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7ea750a0-79a0-456d-83db-1044e812e32c tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:17:45.752902 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f1cfdab7-9884-4fc3-bc1a-eedfea30f266 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:17:45.754286 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7ea750a0-79a0-456d-83db-1044e812e32c tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:17:45.754838 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f1cfdab7-9884-4fc3-bc1a-eedfea30f266 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:17:45.755944 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7ea750a0-79a0-456d-83db-1044e812e32c tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:17:45.756635 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f1cfdab7-9884-4fc3-bc1a-eedfea30f266 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:17:45.758143 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f1cfdab7-9884-4fc3-bc1a-eedfea30f266 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:17:45.758556 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7ea750a0-79a0-456d-83db-1044e812e32c tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:17:45.759322 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7ea750a0-79a0-456d-83db-1044e812e32c tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:17:45.762248 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7ea750a0-79a0-456d-83db-1044e812e32c tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:17:46.246101 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-f1cfdab7-9884-4fc3-bc1a-eedfea30f266 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8957041987c8487099f0d89f4c64af66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9d29b90ab34abbadd21edbca637d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:17:46.255485 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-f1cfdab7-9884-4fc3-bc1a-eedfea30f266 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] 10.222.0.26 "GET /compute/v2.1/servers/17c182d5-d3c8-4e7e-babc-46af1f466f00" status: 200 len: 1366 microversion: 2.1 time: 0.551306 Oct 08 21:17:46.257756 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2592/5115] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:17:45 2022] GET /compute/v2.1/servers/17c182d5-d3c8-4e7e-babc-46af1f466f00 => generated 1366 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:17:46.414412 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-7ea750a0-79a0-456d-83db-1044e812e32c tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:17:46.426759 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-7ea750a0-79a0-456d-83db-1044e812e32c tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62" status: 200 len: 1365 microversion: 2.1 time: 0.718675 Oct 08 21:17:46.446880 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2524/5116] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:17:45 2022] GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62 => generated 1365 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:17:47.283096 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-7d902f6d-3fb1-4851-a39b-20c61e801e04 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:17:47.284750 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-7d902f6d-3fb1-4851-a39b-20c61e801e04 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] [instance: 17c182d5-d3c8-4e7e-babc-46af1f466f00] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:17:47.302261 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7d902f6d-3fb1-4851-a39b-20c61e801e04 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:17:47.302774 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7d902f6d-3fb1-4851-a39b-20c61e801e04 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:17:47.303223 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7d902f6d-3fb1-4851-a39b-20c61e801e04 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:17:47.304173 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7d902f6d-3fb1-4851-a39b-20c61e801e04 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:17:47.304638 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7d902f6d-3fb1-4851-a39b-20c61e801e04 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:17:47.305067 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7d902f6d-3fb1-4851-a39b-20c61e801e04 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:17:47.453458 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-fc663e81-5240-44d6-b148-f5fd2c926c2d tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:17:47.454276 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-fc663e81-5240-44d6-b148-f5fd2c926c2d tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 2a61f287-652b-487f-9ecd-fb4d2d1eee62] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:17:47.469690 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fc663e81-5240-44d6-b148-f5fd2c926c2d tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:17:47.477690 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fc663e81-5240-44d6-b148-f5fd2c926c2d tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:17:47.480579 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fc663e81-5240-44d6-b148-f5fd2c926c2d tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:17:47.499529 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fc663e81-5240-44d6-b148-f5fd2c926c2d tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:17:47.500662 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fc663e81-5240-44d6-b148-f5fd2c926c2d tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:17:47.502349 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fc663e81-5240-44d6-b148-f5fd2c926c2d tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:17:47.818709 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-7d902f6d-3fb1-4851-a39b-20c61e801e04 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8957041987c8487099f0d89f4c64af66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9d29b90ab34abbadd21edbca637d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:17:47.835088 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-7d902f6d-3fb1-4851-a39b-20c61e801e04 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] 10.222.0.26 "GET /compute/v2.1/servers/17c182d5-d3c8-4e7e-babc-46af1f466f00" status: 200 len: 1557 microversion: 2.1 time: 0.557211 Oct 08 21:17:47.837692 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2593/5117] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:17:47 2022] GET /compute/v2.1/servers/17c182d5-d3c8-4e7e-babc-46af1f466f00 => generated 1557 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:17:47.865797 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-941853c9-2f02-49c3-97a9-ab093a729b34 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:17:47.866822 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-941853c9-2f02-49c3-97a9-ab093a729b34 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] [instance: 17c182d5-d3c8-4e7e-babc-46af1f466f00] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:17:47.878742 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-941853c9-2f02-49c3-97a9-ab093a729b34 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:17:47.880883 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-941853c9-2f02-49c3-97a9-ab093a729b34 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:17:47.881566 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-941853c9-2f02-49c3-97a9-ab093a729b34 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:17:47.887549 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-fc663e81-5240-44d6-b148-f5fd2c926c2d tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:17:47.895096 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-941853c9-2f02-49c3-97a9-ab093a729b34 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:17:47.896984 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-941853c9-2f02-49c3-97a9-ab093a729b34 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:17:47.899715 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-941853c9-2f02-49c3-97a9-ab093a729b34 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:17:47.903649 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-fc663e81-5240-44d6-b148-f5fd2c926c2d tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62" status: 200 len: 1365 microversion: 2.1 time: 0.454916 Oct 08 21:17:47.909215 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2525/5118] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:17:47 2022] GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62 => generated 1365 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:17:48.161317 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-941853c9-2f02-49c3-97a9-ab093a729b34 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] 10.222.0.26 "GET /compute/v2.1/servers/17c182d5-d3c8-4e7e-babc-46af1f466f00/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.300133 Oct 08 21:17:48.162105 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2594/5119] 10.222.0.26 () {58 vars in 1275 bytes} [Sat Oct 8 21:17:47 2022] GET /compute/v2.1/servers/17c182d5-d3c8-4e7e-babc-46af1f466f00/os-interface => generated 285 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:17:48.848410 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-93823b68-6bbb-4339-8920-ebae5dd36deb req-ad1cf812-4a6e-4287-ba03-958fc5fbda50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a61f287-652b-487f-9ecd-fb4d2d1eee62", "name": "network-vif-plugged", "status": "completed", "tag": "960ff13a-d0c5-4f5c-af4b-44aec29e7c23"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:17:48.895872 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-93823b68-6bbb-4339-8920-ebae5dd36deb req-ad1cf812-4a6e-4287-ba03-958fc5fbda50 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:17:48.897599 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-93823b68-6bbb-4339-8920-ebae5dd36deb req-ad1cf812-4a6e-4287-ba03-958fc5fbda50 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:17:48.898212 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-93823b68-6bbb-4339-8920-ebae5dd36deb req-ad1cf812-4a6e-4287-ba03-958fc5fbda50 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:17:48.935897 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-f6a691e6-dd94-4039-a4e6-abbf72af13f3 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:17:48.936503 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-f6a691e6-dd94-4039-a4e6-abbf72af13f3 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 2a61f287-652b-487f-9ecd-fb4d2d1eee62] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:17:48.937597 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-93823b68-6bbb-4339-8920-ebae5dd36deb req-ad1cf812-4a6e-4287-ba03-958fc5fbda50 service nova] Creating event network-vif-plugged:960ff13a-d0c5-4f5c-af4b-44aec29e7c23 for instance 2a61f287-652b-487f-9ecd-fb4d2d1eee62 on nch1-master-1 Oct 08 21:17:48.950676 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-93823b68-6bbb-4339-8920-ebae5dd36deb req-ad1cf812-4a6e-4287-ba03-958fc5fbda50 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106118 Oct 08 21:17:48.952528 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2526/5120] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:17:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:17:48.972323 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f6a691e6-dd94-4039-a4e6-abbf72af13f3 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:17:48.977699 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f6a691e6-dd94-4039-a4e6-abbf72af13f3 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:17:48.978381 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f6a691e6-dd94-4039-a4e6-abbf72af13f3 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:17:48.979359 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f6a691e6-dd94-4039-a4e6-abbf72af13f3 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:17:48.981234 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f6a691e6-dd94-4039-a4e6-abbf72af13f3 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:17:48.982894 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f6a691e6-dd94-4039-a4e6-abbf72af13f3 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:17:49.279915 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-f6a691e6-dd94-4039-a4e6-abbf72af13f3 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:17:49.288403 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-f6a691e6-dd94-4039-a4e6-abbf72af13f3 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62" status: 200 len: 1365 microversion: 2.1 time: 0.357190 Oct 08 21:17:49.290247 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2595/5121] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:17:48 2022] GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62 => generated 1365 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:17:50.315461 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c6b6d4d5-eb1f-4b13-8c35-32b8ecac8bc1 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:17:50.316183 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-c6b6d4d5-eb1f-4b13-8c35-32b8ecac8bc1 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 2a61f287-652b-487f-9ecd-fb4d2d1eee62] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:17:50.335996 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c6b6d4d5-eb1f-4b13-8c35-32b8ecac8bc1 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:17:50.336905 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c6b6d4d5-eb1f-4b13-8c35-32b8ecac8bc1 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:17:50.337569 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c6b6d4d5-eb1f-4b13-8c35-32b8ecac8bc1 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:17:50.339552 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c6b6d4d5-eb1f-4b13-8c35-32b8ecac8bc1 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:17:50.342410 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c6b6d4d5-eb1f-4b13-8c35-32b8ecac8bc1 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:17:50.343653 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c6b6d4d5-eb1f-4b13-8c35-32b8ecac8bc1 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:17:50.854260 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-c6b6d4d5-eb1f-4b13-8c35-32b8ecac8bc1 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:17:50.866959 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-c6b6d4d5-eb1f-4b13-8c35-32b8ecac8bc1 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62" status: 200 len: 1365 microversion: 2.1 time: 0.556731 Oct 08 21:17:50.885286 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2527/5122] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:17:50 2022] GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62 => generated 1365 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:17:51.187556 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-38ca26a7-0550-4269-a21a-dffc94a3df34 req-67ee6a17-a706-426d-b498-0ff7f12ffd81 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17c182d5-d3c8-4e7e-babc-46af1f466f00", "tag": "ab6505ab-132c-43a4-ac9d-087f44752486"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:17:51.225428 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-38ca26a7-0550-4269-a21a-dffc94a3df34 req-67ee6a17-a706-426d-b498-0ff7f12ffd81 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:17:51.230588 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-38ca26a7-0550-4269-a21a-dffc94a3df34 req-67ee6a17-a706-426d-b498-0ff7f12ffd81 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:17:51.235513 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-38ca26a7-0550-4269-a21a-dffc94a3df34 req-67ee6a17-a706-426d-b498-0ff7f12ffd81 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:17:51.274810 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-38ca26a7-0550-4269-a21a-dffc94a3df34 req-67ee6a17-a706-426d-b498-0ff7f12ffd81 service nova] Creating event network-changed:ab6505ab-132c-43a4-ac9d-087f44752486 for instance 17c182d5-d3c8-4e7e-babc-46af1f466f00 on nch2-master-1 Oct 08 21:17:51.282131 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-38ca26a7-0550-4269-a21a-dffc94a3df34 req-67ee6a17-a706-426d-b498-0ff7f12ffd81 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099717 Oct 08 21:17:51.283147 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2596/5123] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:17:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 08 21:17:51.892448 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-5dacef6f-223b-4fa9-bf06-55e04d6e356b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:17:51.893078 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-5dacef6f-223b-4fa9-bf06-55e04d6e356b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 2a61f287-652b-487f-9ecd-fb4d2d1eee62] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:17:51.902800 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5dacef6f-223b-4fa9-bf06-55e04d6e356b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:17:51.903566 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5dacef6f-223b-4fa9-bf06-55e04d6e356b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:17:51.904646 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5dacef6f-223b-4fa9-bf06-55e04d6e356b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:17:51.905619 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5dacef6f-223b-4fa9-bf06-55e04d6e356b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:17:51.906332 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5dacef6f-223b-4fa9-bf06-55e04d6e356b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:17:51.906941 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5dacef6f-223b-4fa9-bf06-55e04d6e356b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:17:52.331083 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-5dacef6f-223b-4fa9-bf06-55e04d6e356b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:17:52.346938 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-5dacef6f-223b-4fa9-bf06-55e04d6e356b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62" status: 200 len: 1552 microversion: 2.1 time: 0.460064 Oct 08 21:17:52.350945 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2528/5124] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:17:51 2022] GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62 => generated 1552 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:17:52.380827 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-ec2ad147-eed9-49d1-9a72-78584a9f3450 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:17:52.381544 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-ec2ad147-eed9-49d1-9a72-78584a9f3450 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 2a61f287-652b-487f-9ecd-fb4d2d1eee62] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:17:52.394231 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ec2ad147-eed9-49d1-9a72-78584a9f3450 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:17:52.394736 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ec2ad147-eed9-49d1-9a72-78584a9f3450 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:17:52.399167 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ec2ad147-eed9-49d1-9a72-78584a9f3450 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:17:52.400278 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ec2ad147-eed9-49d1-9a72-78584a9f3450 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:17:52.400973 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ec2ad147-eed9-49d1-9a72-78584a9f3450 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:17:52.401663 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ec2ad147-eed9-49d1-9a72-78584a9f3450 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:17:52.605091 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-ec2ad147-eed9-49d1-9a72-78584a9f3450 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.229890 Oct 08 21:17:52.605736 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2597/5125] 10.222.0.26 () {58 vars in 1275 bytes} [Sat Oct 8 21:17:52 2022] GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62/os-interface => generated 285 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:17:55.337705 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-18ed5c92-49d8-46db-9161-64c9113bff30 req-b8ea34ea-5663-472f-a802-54add7098d9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a61f287-652b-487f-9ecd-fb4d2d1eee62", "tag": "960ff13a-d0c5-4f5c-af4b-44aec29e7c23"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:17:55.358372 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-18ed5c92-49d8-46db-9161-64c9113bff30 req-b8ea34ea-5663-472f-a802-54add7098d9b service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:17:55.359874 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-18ed5c92-49d8-46db-9161-64c9113bff30 req-b8ea34ea-5663-472f-a802-54add7098d9b service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:17:55.360994 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-18ed5c92-49d8-46db-9161-64c9113bff30 req-b8ea34ea-5663-472f-a802-54add7098d9b service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:17:55.383228 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-18ed5c92-49d8-46db-9161-64c9113bff30 req-b8ea34ea-5663-472f-a802-54add7098d9b service nova] Creating event network-changed:960ff13a-d0c5-4f5c-af4b-44aec29e7c23 for instance 2a61f287-652b-487f-9ecd-fb4d2d1eee62 on nch1-master-1 Oct 08 21:17:55.393983 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-18ed5c92-49d8-46db-9161-64c9113bff30 req-b8ea34ea-5663-472f-a802-54add7098d9b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060500 Oct 08 21:17:55.395372 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2529/5126] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:17:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:18:10.429017 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=25 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:18:10.429835 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=80 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:18:10.434733 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-ef7b92f0-0933-4a7e-acc3-ceb040ec7120 tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1001423824", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:18:10.537159 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.network.neutron [None req-ef7b92f0-0933-4a7e-acc3-ceb040ec7120 tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] validate_networks() for None {{(pid=140492) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 21:18:11.024105 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-ef7b92f0-0933-4a7e-acc3-ceb040ec7120 tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] Flavor limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 21:18:11.030273 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-ef7b92f0-0933-4a7e-acc3-ceb040ec7120 tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] Image limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 21:18:11.031006 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-ef7b92f0-0933-4a7e-acc3-ceb040ec7120 tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] Flavor pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 21:18:11.031820 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-ef7b92f0-0933-4a7e-acc3-ceb040ec7120 tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] Image pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 21:18:11.032412 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-ef7b92f0-0933-4a7e-acc3-ceb040ec7120 tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 21:18:11.047824 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ef7b92f0-0933-4a7e-acc3-ceb040ec7120 tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:18:11.048813 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ef7b92f0-0933-4a7e-acc3-ceb040ec7120 tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:18:11.050461 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ef7b92f0-0933-4a7e-acc3-ceb040ec7120 tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:18:11.051896 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ef7b92f0-0933-4a7e-acc3-ceb040ec7120 tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:18:11.052552 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ef7b92f0-0933-4a7e-acc3-ceb040ec7120 tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:18:11.053153 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ef7b92f0-0933-4a7e-acc3-ceb040ec7120 tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:18:11.079916 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-ef7b92f0-0933-4a7e-acc3-ceb040ec7120 tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] Getting quotas for project 9e8fbf829e45416b8d40ff3a9e512fe8. Resources: {'cores', 'instances', 'ram'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:18:11.089330 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-ef7b92f0-0933-4a7e-acc3-ceb040ec7120 tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] Getting quotas for user 0405dc39ca524c87ae5a99db8d85e615 and project 9e8fbf829e45416b8d40ff3a9e512fe8. Resources: {'cores', 'instances', 'ram'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:18:11.110273 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-ef7b92f0-0933-4a7e-acc3-ceb040ec7120 tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] Going to run 1 instances... {{(pid=140492) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 21:18:11.112825 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-ef7b92f0-0933-4a7e-acc3-ceb040ec7120 tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] [instance: 782fe6d2-1cc1-4748-8da9-f06fb9350288] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c508bd7f-7db9-4b2c-af7c-be54a855c355',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140492) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 21:18:11.173799 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-ef7b92f0-0933-4a7e-acc3-ceb040ec7120 tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.747550 Oct 08 21:18:11.175044 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2598/5127] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 21:18:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 750 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 08 21:18:11.184756 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:SELECT=29 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:18:11.186150 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=76 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:18:11.194395 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-d9be5150-11b7-45e1-b223-dd97127e5185 tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:18:11.195654 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-d9be5150-11b7-45e1-b223-dd97127e5185 tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] [instance: 782fe6d2-1cc1-4748-8da9-f06fb9350288] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:18:11.339127 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-d9be5150-11b7-45e1-b223-dd97127e5185 tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0405dc39ca524c87ae5a99db8d85e615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e8fbf829e45416b8d40ff3a9e512fe8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:18:11.349272 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-d9be5150-11b7-45e1-b223-dd97127e5185 tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] 10.222.0.26 "GET /compute/v2.1/servers/782fe6d2-1cc1-4748-8da9-f06fb9350288" status: 200 len: 1215 microversion: 2.1 time: 0.166505 Oct 08 21:18:11.363431 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2530/5128] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:18:11 2022] GET /compute/v2.1/servers/782fe6d2-1cc1-4748-8da9-f06fb9350288 => generated 1215 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:18:12.374090 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-59d69529-b991-42fc-aa44-a76832dadc8d tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:18:12.374748 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-59d69529-b991-42fc-aa44-a76832dadc8d tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] [instance: 782fe6d2-1cc1-4748-8da9-f06fb9350288] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:18:12.389428 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-59d69529-b991-42fc-aa44-a76832dadc8d tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:18:12.390263 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-59d69529-b991-42fc-aa44-a76832dadc8d tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:18:12.392118 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-59d69529-b991-42fc-aa44-a76832dadc8d tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:18:12.393370 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-59d69529-b991-42fc-aa44-a76832dadc8d tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:18:12.394057 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-59d69529-b991-42fc-aa44-a76832dadc8d tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:18:12.395144 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-59d69529-b991-42fc-aa44-a76832dadc8d tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:18:12.510655 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-59d69529-b991-42fc-aa44-a76832dadc8d tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0405dc39ca524c87ae5a99db8d85e615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e8fbf829e45416b8d40ff3a9e512fe8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:18:12.534952 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-59d69529-b991-42fc-aa44-a76832dadc8d tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] 10.222.0.26 "GET /compute/v2.1/servers/782fe6d2-1cc1-4748-8da9-f06fb9350288" status: 200 len: 1267 microversion: 2.1 time: 0.165448 Oct 08 21:18:12.545399 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2599/5129] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:18:12 2022] GET /compute/v2.1/servers/782fe6d2-1cc1-4748-8da9-f06fb9350288 => generated 1267 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:18:13.561530 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-412fa5a8-592d-44bc-a4d0-0a22326a8768 tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:18:13.562163 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-412fa5a8-592d-44bc-a4d0-0a22326a8768 tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] [instance: 782fe6d2-1cc1-4748-8da9-f06fb9350288] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:18:13.576557 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-412fa5a8-592d-44bc-a4d0-0a22326a8768 tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:18:13.577937 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-412fa5a8-592d-44bc-a4d0-0a22326a8768 tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:18:13.578619 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-412fa5a8-592d-44bc-a4d0-0a22326a8768 tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:18:13.579600 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-412fa5a8-592d-44bc-a4d0-0a22326a8768 tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:18:13.580197 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-412fa5a8-592d-44bc-a4d0-0a22326a8768 tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:18:13.580705 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-412fa5a8-592d-44bc-a4d0-0a22326a8768 tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:18:13.682255 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-412fa5a8-592d-44bc-a4d0-0a22326a8768 tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0405dc39ca524c87ae5a99db8d85e615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e8fbf829e45416b8d40ff3a9e512fe8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:18:13.692096 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-412fa5a8-592d-44bc-a4d0-0a22326a8768 tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] 10.222.0.26 "GET /compute/v2.1/servers/782fe6d2-1cc1-4748-8da9-f06fb9350288" status: 200 len: 1273 microversion: 2.1 time: 0.135813 Oct 08 21:18:13.693738 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2531/5130] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:18:13 2022] GET /compute/v2.1/servers/782fe6d2-1cc1-4748-8da9-f06fb9350288 => generated 1273 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:18:14.716066 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-8e033677-1fb9-425a-9d56-352e041d59e8 tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:18:14.716926 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-8e033677-1fb9-425a-9d56-352e041d59e8 tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] [instance: 782fe6d2-1cc1-4748-8da9-f06fb9350288] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:18:14.725238 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8e033677-1fb9-425a-9d56-352e041d59e8 tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:18:14.726118 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8e033677-1fb9-425a-9d56-352e041d59e8 tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:18:14.726770 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8e033677-1fb9-425a-9d56-352e041d59e8 tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:18:14.727957 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8e033677-1fb9-425a-9d56-352e041d59e8 tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:18:14.728626 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8e033677-1fb9-425a-9d56-352e041d59e8 tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:18:14.729315 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8e033677-1fb9-425a-9d56-352e041d59e8 tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:18:15.466581 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-8e033677-1fb9-425a-9d56-352e041d59e8 tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0405dc39ca524c87ae5a99db8d85e615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e8fbf829e45416b8d40ff3a9e512fe8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:18:15.479706 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-8e033677-1fb9-425a-9d56-352e041d59e8 tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] 10.222.0.26 "GET /compute/v2.1/servers/782fe6d2-1cc1-4748-8da9-f06fb9350288" status: 200 len: 1315 microversion: 2.1 time: 0.766263 Oct 08 21:18:15.481492 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2600/5131] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:18:14 2022] GET /compute/v2.1/servers/782fe6d2-1cc1-4748-8da9-f06fb9350288 => generated 1315 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:18:16.399513 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-e13b6585-d388-4f3f-bfe8-50b4cf42604a req-f7d2e3cf-3d28-4361-a487-3996c414f153 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "782fe6d2-1cc1-4748-8da9-f06fb9350288", "tag": "90e23bd9-e554-41fb-890b-1c5a3228286b"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:18:16.424659 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-e13b6585-d388-4f3f-bfe8-50b4cf42604a req-f7d2e3cf-3d28-4361-a487-3996c414f153 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:18:16.425939 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-e13b6585-d388-4f3f-bfe8-50b4cf42604a req-f7d2e3cf-3d28-4361-a487-3996c414f153 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:18:16.426457 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-e13b6585-d388-4f3f-bfe8-50b4cf42604a req-f7d2e3cf-3d28-4361-a487-3996c414f153 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:18:16.445283 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-e13b6585-d388-4f3f-bfe8-50b4cf42604a req-f7d2e3cf-3d28-4361-a487-3996c414f153 service nova] Creating event network-changed:90e23bd9-e554-41fb-890b-1c5a3228286b for instance 782fe6d2-1cc1-4748-8da9-f06fb9350288 on nch2-master-1 Oct 08 21:18:16.452605 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-e13b6585-d388-4f3f-bfe8-50b4cf42604a req-f7d2e3cf-3d28-4361-a487-3996c414f153 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068026 Oct 08 21:18:16.454196 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2532/5132] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:18:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:18:16.505722 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-ddd4ead1-c87d-498d-8592-663d3c8729e7 tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:18:16.507048 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-ddd4ead1-c87d-498d-8592-663d3c8729e7 tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] [instance: 782fe6d2-1cc1-4748-8da9-f06fb9350288] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:18:16.516816 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ddd4ead1-c87d-498d-8592-663d3c8729e7 tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:18:16.517343 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ddd4ead1-c87d-498d-8592-663d3c8729e7 tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:18:16.517967 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ddd4ead1-c87d-498d-8592-663d3c8729e7 tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:18:16.518847 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ddd4ead1-c87d-498d-8592-663d3c8729e7 tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:18:16.519563 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ddd4ead1-c87d-498d-8592-663d3c8729e7 tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:18:16.520173 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ddd4ead1-c87d-498d-8592-663d3c8729e7 tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:18:16.745026 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-ddd4ead1-c87d-498d-8592-663d3c8729e7 tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0405dc39ca524c87ae5a99db8d85e615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e8fbf829e45416b8d40ff3a9e512fe8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:18:16.753611 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-ddd4ead1-c87d-498d-8592-663d3c8729e7 tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] 10.222.0.26 "GET /compute/v2.1/servers/782fe6d2-1cc1-4748-8da9-f06fb9350288" status: 200 len: 1315 microversion: 2.1 time: 0.252491 Oct 08 21:18:16.754642 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2601/5133] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:18:16 2022] GET /compute/v2.1/servers/782fe6d2-1cc1-4748-8da9-f06fb9350288 => generated 1315 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:18:17.778035 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-2ef0798b-df03-42b3-b6dd-d0e197cbef0b tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:18:17.779782 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-2ef0798b-df03-42b3-b6dd-d0e197cbef0b tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] [instance: 782fe6d2-1cc1-4748-8da9-f06fb9350288] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:18:17.796115 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2ef0798b-df03-42b3-b6dd-d0e197cbef0b tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:18:17.796115 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2ef0798b-df03-42b3-b6dd-d0e197cbef0b tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:18:17.796115 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2ef0798b-df03-42b3-b6dd-d0e197cbef0b tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:18:17.796115 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2ef0798b-df03-42b3-b6dd-d0e197cbef0b tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:18:17.796115 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2ef0798b-df03-42b3-b6dd-d0e197cbef0b tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:18:17.796115 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2ef0798b-df03-42b3-b6dd-d0e197cbef0b tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:18:17.962626 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-2ef0798b-df03-42b3-b6dd-d0e197cbef0b tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0405dc39ca524c87ae5a99db8d85e615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e8fbf829e45416b8d40ff3a9e512fe8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:18:17.971603 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-2ef0798b-df03-42b3-b6dd-d0e197cbef0b tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] 10.222.0.26 "GET /compute/v2.1/servers/782fe6d2-1cc1-4748-8da9-f06fb9350288" status: 200 len: 1315 microversion: 2.1 time: 0.197969 Oct 08 21:18:17.972199 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2533/5134] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:18:17 2022] GET /compute/v2.1/servers/782fe6d2-1cc1-4748-8da9-f06fb9350288 => generated 1315 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:18:18.995903 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-70a13869-85b7-43a7-85b8-fcafe779aab2 tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:18:18.999686 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-70a13869-85b7-43a7-85b8-fcafe779aab2 tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] [instance: 782fe6d2-1cc1-4748-8da9-f06fb9350288] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:18:19.008086 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-70a13869-85b7-43a7-85b8-fcafe779aab2 tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:18:19.009137 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-70a13869-85b7-43a7-85b8-fcafe779aab2 tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:18:19.009866 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-70a13869-85b7-43a7-85b8-fcafe779aab2 tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:18:19.010691 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-70a13869-85b7-43a7-85b8-fcafe779aab2 tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:18:19.011273 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-70a13869-85b7-43a7-85b8-fcafe779aab2 tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:18:19.011906 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-70a13869-85b7-43a7-85b8-fcafe779aab2 tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:18:19.245483 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-70a13869-85b7-43a7-85b8-fcafe779aab2 tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0405dc39ca524c87ae5a99db8d85e615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e8fbf829e45416b8d40ff3a9e512fe8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:18:19.253589 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-70a13869-85b7-43a7-85b8-fcafe779aab2 tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] 10.222.0.26 "GET /compute/v2.1/servers/782fe6d2-1cc1-4748-8da9-f06fb9350288" status: 200 len: 1315 microversion: 2.1 time: 0.262423 Oct 08 21:18:19.254218 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2602/5135] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:18:18 2022] GET /compute/v2.1/servers/782fe6d2-1cc1-4748-8da9-f06fb9350288 => generated 1315 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:18:20.282401 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-290eb7b2-21be-42fb-bd68-50d5c124bdb8 tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:18:20.290677 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-290eb7b2-21be-42fb-bd68-50d5c124bdb8 tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] [instance: 782fe6d2-1cc1-4748-8da9-f06fb9350288] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:18:20.299522 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-290eb7b2-21be-42fb-bd68-50d5c124bdb8 tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:18:20.300029 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-290eb7b2-21be-42fb-bd68-50d5c124bdb8 tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:18:20.300962 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-290eb7b2-21be-42fb-bd68-50d5c124bdb8 tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:18:20.301829 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-290eb7b2-21be-42fb-bd68-50d5c124bdb8 tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:18:20.302485 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-290eb7b2-21be-42fb-bd68-50d5c124bdb8 tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:18:20.303276 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-290eb7b2-21be-42fb-bd68-50d5c124bdb8 tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:18:20.636959 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-290eb7b2-21be-42fb-bd68-50d5c124bdb8 tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0405dc39ca524c87ae5a99db8d85e615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e8fbf829e45416b8d40ff3a9e512fe8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:18:20.645261 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-290eb7b2-21be-42fb-bd68-50d5c124bdb8 tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] 10.222.0.26 "GET /compute/v2.1/servers/782fe6d2-1cc1-4748-8da9-f06fb9350288" status: 200 len: 1315 microversion: 2.1 time: 0.371792 Oct 08 21:18:20.645854 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2534/5136] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:18:20 2022] GET /compute/v2.1/servers/782fe6d2-1cc1-4748-8da9-f06fb9350288 => generated 1315 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:18:21.764778 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-1a4b7b20-eef5-46e5-b56e-2c23e5f8f8c2 tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:18:21.765431 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-1a4b7b20-eef5-46e5-b56e-2c23e5f8f8c2 tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] [instance: 782fe6d2-1cc1-4748-8da9-f06fb9350288] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:18:21.768160 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=2 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:18:21.770095 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=6 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:18:21.776863 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1a4b7b20-eef5-46e5-b56e-2c23e5f8f8c2 tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:18:21.777598 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1a4b7b20-eef5-46e5-b56e-2c23e5f8f8c2 tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:18:21.778268 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1a4b7b20-eef5-46e5-b56e-2c23e5f8f8c2 tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:18:21.779244 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1a4b7b20-eef5-46e5-b56e-2c23e5f8f8c2 tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:18:21.780783 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1a4b7b20-eef5-46e5-b56e-2c23e5f8f8c2 tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:18:21.781437 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1a4b7b20-eef5-46e5-b56e-2c23e5f8f8c2 tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:18:22.385769 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-1a4b7b20-eef5-46e5-b56e-2c23e5f8f8c2 tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0405dc39ca524c87ae5a99db8d85e615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e8fbf829e45416b8d40ff3a9e512fe8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:18:22.396280 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-1a4b7b20-eef5-46e5-b56e-2c23e5f8f8c2 tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] 10.222.0.26 "GET /compute/v2.1/servers/782fe6d2-1cc1-4748-8da9-f06fb9350288" status: 200 len: 1315 microversion: 2.1 time: 0.635951 Oct 08 21:18:22.409211 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2603/5137] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:18:21 2022] GET /compute/v2.1/servers/782fe6d2-1cc1-4748-8da9-f06fb9350288 => generated 1315 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:18:22.904571 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-3f773fb0-3264-4f17-8572-4394bc26061a tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:18:22.905797 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-3f773fb0-3264-4f17-8572-4394bc26061a tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] [instance: 17c182d5-d3c8-4e7e-babc-46af1f466f00] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:18:22.910795 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=2 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:18:22.921742 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3f773fb0-3264-4f17-8572-4394bc26061a tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:18:22.927019 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3f773fb0-3264-4f17-8572-4394bc26061a tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:18:22.928749 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3f773fb0-3264-4f17-8572-4394bc26061a tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:18:22.929778 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3f773fb0-3264-4f17-8572-4394bc26061a tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:18:22.930451 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3f773fb0-3264-4f17-8572-4394bc26061a tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:18:22.932276 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3f773fb0-3264-4f17-8572-4394bc26061a tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:18:22.987389 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-3f773fb0-3264-4f17-8572-4394bc26061a tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] 10.222.0.26 "GET /compute/v2.1/servers/17c182d5-d3c8-4e7e-babc-46af1f466f00/ips" status: 200 len: 151 microversion: 2.1 time: 0.065113 Oct 08 21:18:22.999094 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2535/5138] 10.222.0.26 () {58 vars in 1248 bytes} [Sat Oct 8 21:18:22 2022] GET /compute/v2.1/servers/17c182d5-d3c8-4e7e-babc-46af1f466f00/ips => generated 151 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:18:23.268287 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-7f91b4ee-b54d-4f60-9d0e-98ef6e2e4709 req-5238feef-d492-4e55-ac13-ab5f995f309b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "782fe6d2-1cc1-4748-8da9-f06fb9350288", "name": "network-vif-plugged", "status": "completed", "tag": "90e23bd9-e554-41fb-890b-1c5a3228286b"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:18:23.282757 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-7f91b4ee-b54d-4f60-9d0e-98ef6e2e4709 req-5238feef-d492-4e55-ac13-ab5f995f309b service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:18:23.283438 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-7f91b4ee-b54d-4f60-9d0e-98ef6e2e4709 req-5238feef-d492-4e55-ac13-ab5f995f309b service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:18:23.283954 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-7f91b4ee-b54d-4f60-9d0e-98ef6e2e4709 req-5238feef-d492-4e55-ac13-ab5f995f309b service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:18:23.306987 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-7f91b4ee-b54d-4f60-9d0e-98ef6e2e4709 req-5238feef-d492-4e55-ac13-ab5f995f309b service nova] Creating event network-vif-plugged:90e23bd9-e554-41fb-890b-1c5a3228286b for instance 782fe6d2-1cc1-4748-8da9-f06fb9350288 on nch2-master-1 Oct 08 21:18:23.314137 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-7f91b4ee-b54d-4f60-9d0e-98ef6e2e4709 req-5238feef-d492-4e55-ac13-ab5f995f309b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.348302 Oct 08 21:18:23.314883 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2604/5139] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:18:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 08 21:18:23.435457 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-0d84914a-f88a-4406-baf3-f7941cd72c5f tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:18:23.436383 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-0d84914a-f88a-4406-baf3-f7941cd72c5f tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] [instance: 782fe6d2-1cc1-4748-8da9-f06fb9350288] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:18:23.455732 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0d84914a-f88a-4406-baf3-f7941cd72c5f tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:18:23.456572 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0d84914a-f88a-4406-baf3-f7941cd72c5f tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:18:23.458383 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0d84914a-f88a-4406-baf3-f7941cd72c5f tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:18:23.460255 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0d84914a-f88a-4406-baf3-f7941cd72c5f tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:18:23.460942 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0d84914a-f88a-4406-baf3-f7941cd72c5f tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:18:23.463832 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0d84914a-f88a-4406-baf3-f7941cd72c5f tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:18:23.694149 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-0d84914a-f88a-4406-baf3-f7941cd72c5f tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0405dc39ca524c87ae5a99db8d85e615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e8fbf829e45416b8d40ff3a9e512fe8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:18:23.704363 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-0d84914a-f88a-4406-baf3-f7941cd72c5f tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] 10.222.0.26 "GET /compute/v2.1/servers/782fe6d2-1cc1-4748-8da9-f06fb9350288" status: 200 len: 1315 microversion: 2.1 time: 0.285865 Oct 08 21:18:23.709827 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2536/5140] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:18:23 2022] GET /compute/v2.1/servers/782fe6d2-1cc1-4748-8da9-f06fb9350288 => generated 1315 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:18:24.604376 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-6bbf01d7-403f-49ae-97eb-ebba97e355cc tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "846bd1eb-e484-4b7e-aa01-8cf22106cec3"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:18:24.607138 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-6bbf01d7-403f-49ae-97eb-ebba97e355cc tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] [instance: 17c182d5-d3c8-4e7e-babc-46af1f466f00] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:18:24.613761 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6bbf01d7-403f-49ae-97eb-ebba97e355cc tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:18:24.614267 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6bbf01d7-403f-49ae-97eb-ebba97e355cc tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:18:24.614715 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6bbf01d7-403f-49ae-97eb-ebba97e355cc tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:18:24.615459 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6bbf01d7-403f-49ae-97eb-ebba97e355cc tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:18:24.615924 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6bbf01d7-403f-49ae-97eb-ebba97e355cc tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:18:24.616352 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6bbf01d7-403f-49ae-97eb-ebba97e355cc tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:18:24.732657 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-a60a1dac-b9bc-4097-88ee-b98bd52ad14a tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:18:24.733844 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-a60a1dac-b9bc-4097-88ee-b98bd52ad14a tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] [instance: 782fe6d2-1cc1-4748-8da9-f06fb9350288] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:18:24.741942 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a60a1dac-b9bc-4097-88ee-b98bd52ad14a tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:18:24.742671 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a60a1dac-b9bc-4097-88ee-b98bd52ad14a tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:18:24.748781 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a60a1dac-b9bc-4097-88ee-b98bd52ad14a tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:18:24.752995 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a60a1dac-b9bc-4097-88ee-b98bd52ad14a tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:18:24.753538 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a60a1dac-b9bc-4097-88ee-b98bd52ad14a tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:18:24.766495 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a60a1dac-b9bc-4097-88ee-b98bd52ad14a tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:18:24.961520 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-a60a1dac-b9bc-4097-88ee-b98bd52ad14a tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0405dc39ca524c87ae5a99db8d85e615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e8fbf829e45416b8d40ff3a9e512fe8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:18:24.964691 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-6bbf01d7-403f-49ae-97eb-ebba97e355cc tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] 10.222.0.26 "POST /compute/v2.1/servers/17c182d5-d3c8-4e7e-babc-46af1f466f00/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.366011 Oct 08 21:18:24.971325 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2605/5141] 10.222.0.26 () {60 vars in 1323 bytes} [Sat Oct 8 21:18:24 2022] POST /compute/v2.1/servers/17c182d5-d3c8-4e7e-babc-46af1f466f00/os-volume_attachments => generated 194 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:18:24.991641 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-a60a1dac-b9bc-4097-88ee-b98bd52ad14a tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] 10.222.0.26 "GET /compute/v2.1/servers/782fe6d2-1cc1-4748-8da9-f06fb9350288" status: 200 len: 1464 microversion: 2.1 time: 0.266775 Oct 08 21:18:24.996635 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2537/5142] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:18:24 2022] GET /compute/v2.1/servers/782fe6d2-1cc1-4748-8da9-f06fb9350288 => generated 1464 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:18:25.092806 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-22b8aa11-11e4-4201-992b-231bb8be5bee tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:18:25.093765 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-22b8aa11-11e4-4201-992b-231bb8be5bee tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] [instance: 782fe6d2-1cc1-4748-8da9-f06fb9350288] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:18:25.108955 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-22b8aa11-11e4-4201-992b-231bb8be5bee tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:18:25.110961 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-22b8aa11-11e4-4201-992b-231bb8be5bee tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:18:25.111451 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-22b8aa11-11e4-4201-992b-231bb8be5bee tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:18:25.113235 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-22b8aa11-11e4-4201-992b-231bb8be5bee tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:18:25.113800 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-22b8aa11-11e4-4201-992b-231bb8be5bee tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:18:25.114450 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-22b8aa11-11e4-4201-992b-231bb8be5bee tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:18:25.152048 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-22b8aa11-11e4-4201-992b-231bb8be5bee tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] [instance: 782fe6d2-1cc1-4748-8da9-f06fb9350288] Going to try to terminate instance {{(pid=140492) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 21:18:25.258045 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-22b8aa11-11e4-4201-992b-231bb8be5bee tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] 10.222.0.26 "DELETE /compute/v2.1/servers/782fe6d2-1cc1-4748-8da9-f06fb9350288" status: 204 len: 0 microversion: 2.1 time: 0.170372 Oct 08 21:18:25.259063 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2606/5143] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:18:25 2022] DELETE /compute/v2.1/servers/782fe6d2-1cc1-4748-8da9-f06fb9350288 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 21:18:25.268239 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-e2cef6b5-fd4b-47e9-9b0c-d2eb925e1e4f tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:18:25.269860 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-e2cef6b5-fd4b-47e9-9b0c-d2eb925e1e4f tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] [instance: 782fe6d2-1cc1-4748-8da9-f06fb9350288] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:18:25.276735 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e2cef6b5-fd4b-47e9-9b0c-d2eb925e1e4f tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:18:25.277359 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e2cef6b5-fd4b-47e9-9b0c-d2eb925e1e4f tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:18:25.277885 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e2cef6b5-fd4b-47e9-9b0c-d2eb925e1e4f tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:18:25.279245 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e2cef6b5-fd4b-47e9-9b0c-d2eb925e1e4f tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:18:25.279926 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e2cef6b5-fd4b-47e9-9b0c-d2eb925e1e4f tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:18:25.280434 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e2cef6b5-fd4b-47e9-9b0c-d2eb925e1e4f tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:18:25.535074 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-e2cef6b5-fd4b-47e9-9b0c-d2eb925e1e4f tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0405dc39ca524c87ae5a99db8d85e615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e8fbf829e45416b8d40ff3a9e512fe8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:18:25.545838 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-e2cef6b5-fd4b-47e9-9b0c-d2eb925e1e4f tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] 10.222.0.26 "GET /compute/v2.1/servers/782fe6d2-1cc1-4748-8da9-f06fb9350288" status: 200 len: 1470 microversion: 2.1 time: 0.282464 Oct 08 21:18:25.546756 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2538/5144] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:18:25 2022] GET /compute/v2.1/servers/782fe6d2-1cc1-4748-8da9-f06fb9350288 => generated 1470 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:18:26.575843 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-ab14f3d5-6be8-4e62-aa97-c3ad7a63912e tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:18:26.578060 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-ab14f3d5-6be8-4e62-aa97-c3ad7a63912e tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] [instance: 782fe6d2-1cc1-4748-8da9-f06fb9350288] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:18:26.587213 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ab14f3d5-6be8-4e62-aa97-c3ad7a63912e tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:18:26.587770 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ab14f3d5-6be8-4e62-aa97-c3ad7a63912e tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:18:26.588399 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ab14f3d5-6be8-4e62-aa97-c3ad7a63912e tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:18:26.589124 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ab14f3d5-6be8-4e62-aa97-c3ad7a63912e tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:18:26.589609 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ab14f3d5-6be8-4e62-aa97-c3ad7a63912e tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:18:26.590088 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ab14f3d5-6be8-4e62-aa97-c3ad7a63912e tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:18:27.001180 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-ab14f3d5-6be8-4e62-aa97-c3ad7a63912e tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0405dc39ca524c87ae5a99db8d85e615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e8fbf829e45416b8d40ff3a9e512fe8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:18:27.010038 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-ab14f3d5-6be8-4e62-aa97-c3ad7a63912e tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] 10.222.0.26 "GET /compute/v2.1/servers/782fe6d2-1cc1-4748-8da9-f06fb9350288" status: 200 len: 1470 microversion: 2.1 time: 0.439921 Oct 08 21:18:27.010836 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2607/5145] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:18:26 2022] GET /compute/v2.1/servers/782fe6d2-1cc1-4748-8da9-f06fb9350288 => generated 1470 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:18:27.485613 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-eea2577f-b605-4b89-bd3c-3ca02c277c4c req-1f168b9e-0a35-43e4-a780-2714b6119b4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "782fe6d2-1cc1-4748-8da9-f06fb9350288", "name": "network-vif-deleted", "tag": "90e23bd9-e554-41fb-890b-1c5a3228286b"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:18:27.499159 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-eea2577f-b605-4b89-bd3c-3ca02c277c4c req-1f168b9e-0a35-43e4-a780-2714b6119b4b service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:18:27.499929 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-eea2577f-b605-4b89-bd3c-3ca02c277c4c req-1f168b9e-0a35-43e4-a780-2714b6119b4b service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:18:27.500530 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-eea2577f-b605-4b89-bd3c-3ca02c277c4c req-1f168b9e-0a35-43e4-a780-2714b6119b4b service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:18:27.514101 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-eea2577f-b605-4b89-bd3c-3ca02c277c4c req-1f168b9e-0a35-43e4-a780-2714b6119b4b service nova] Creating event network-vif-deleted:90e23bd9-e554-41fb-890b-1c5a3228286b for instance 782fe6d2-1cc1-4748-8da9-f06fb9350288 on nch2-master-1 Oct 08 21:18:27.520098 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-eea2577f-b605-4b89-bd3c-3ca02c277c4c req-1f168b9e-0a35-43e4-a780-2714b6119b4b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038997 Oct 08 21:18:27.524093 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2539/5146] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:18:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:18:28.041487 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-a33c06cd-68f1-49db-a1b5-aa06b212c579 tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:18:28.044030 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-a33c06cd-68f1-49db-a1b5-aa06b212c579 tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] [instance: 782fe6d2-1cc1-4748-8da9-f06fb9350288] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:18:28.063588 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a33c06cd-68f1-49db-a1b5-aa06b212c579 tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:18:28.064104 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a33c06cd-68f1-49db-a1b5-aa06b212c579 tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:18:28.064558 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a33c06cd-68f1-49db-a1b5-aa06b212c579 tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:18:28.065315 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a33c06cd-68f1-49db-a1b5-aa06b212c579 tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:18:28.065790 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a33c06cd-68f1-49db-a1b5-aa06b212c579 tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:18:28.066232 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a33c06cd-68f1-49db-a1b5-aa06b212c579 tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:18:28.110657 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a33c06cd-68f1-49db-a1b5-aa06b212c579 tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:18:28.111458 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a33c06cd-68f1-49db-a1b5-aa06b212c579 tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:18:28.112060 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a33c06cd-68f1-49db-a1b5-aa06b212c579 tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:18:28.112717 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.objects.instance [None req-a33c06cd-68f1-49db-a1b5-aa06b212c579 tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] Lazy-loading 'fault' on Instance uuid 782fe6d2-1cc1-4748-8da9-f06fb9350288 {{(pid=140492) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 21:18:28.158322 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-a33c06cd-68f1-49db-a1b5-aa06b212c579 tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0405dc39ca524c87ae5a99db8d85e615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e8fbf829e45416b8d40ff3a9e512fe8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:18:28.166275 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-a33c06cd-68f1-49db-a1b5-aa06b212c579 tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] 10.222.0.26 "GET /compute/v2.1/servers/782fe6d2-1cc1-4748-8da9-f06fb9350288" status: 200 len: 1305 microversion: 2.1 time: 0.133531 Oct 08 21:18:28.167233 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2608/5147] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:18:28 2022] GET /compute/v2.1/servers/782fe6d2-1cc1-4748-8da9-f06fb9350288 => generated 1305 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:18:28.378520 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-2928d6af-fde8-4a9a-9cce-50a491097c5d tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "846bd1eb-e484-4b7e-aa01-8cf22106cec3"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:18:28.382751 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-2928d6af-fde8-4a9a-9cce-50a491097c5d tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] [instance: 17c182d5-d3c8-4e7e-babc-46af1f466f00] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:18:28.390893 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2928d6af-fde8-4a9a-9cce-50a491097c5d tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:18:28.391777 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2928d6af-fde8-4a9a-9cce-50a491097c5d tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:18:28.392422 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2928d6af-fde8-4a9a-9cce-50a491097c5d tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:18:28.393245 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2928d6af-fde8-4a9a-9cce-50a491097c5d tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:18:28.393946 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2928d6af-fde8-4a9a-9cce-50a491097c5d tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:18:28.394480 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2928d6af-fde8-4a9a-9cce-50a491097c5d tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:18:28.504338 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-2928d6af-fde8-4a9a-9cce-50a491097c5d tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] HTTP exception thrown: Invalid volume: volume 846bd1eb-e484-4b7e-aa01-8cf22106cec3 is already attached to instances: 17c182d5-d3c8-4e7e-babc-46af1f466f00 Oct 08 21:18:28.508749 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-2928d6af-fde8-4a9a-9cce-50a491097c5d tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Request method failure captured: Oct 08 21:18:28.508749 ncdv-master-1 devstack@n-api.service[140491]: request: POST /compute/v2.1/servers/17c182d5-d3c8-4e7e-babc-46af1f466f00/os-volume_attachments HTTP/1.1 Oct 08 21:18:28.508749 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:18:28.508749 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:18:28.508749 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:18:28.508749 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 74 Oct 08 21:18:28.508749 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:18:28.508749 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:18:28.508749 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:18:28.508749 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:18:28.508749 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQehFIbXs-DGbS_kPUTJMTrUq-WofUYY6ZRyx81bX8dlJ1znB-Icd1X0JZVfoU0lBZbBMu1x5OyOchM7_W_m4wVb0RC5emVnYRQT_LfKB9ZNZm3xjiiSMGa29vJwyibC7NFwQ_T90TzXkiQ39iaomvdVhCKn_tsPv5ogwGAe_Atzwiz8 Oct 08 21:18:28.508749 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:18:28.508749 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:18:28.508749 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:18:28.508749 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:18:28.508749 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:18:28.508749 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:18:28.508749 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 3d9d29b90ab34abbadd21edbca637d2e Oct 08 21:18:28.508749 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-AttachVolumeNegativeTest-1956575659 Oct 08 21:18:28.508749 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:18:28.508749 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:18:28.508749 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3d9d29b90ab34abbadd21edbca637d2e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3d9d29b90ab34abbadd21edbca637d2e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3d9d29b90ab34abbadd21edbca637d2e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3d9d29b90ab34abbadd21edbca637d2e"}]}] Oct 08 21:18:28.508749 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-AttachVolumeNegativeTest-1956575659 Oct 08 21:18:28.508749 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 3d9d29b90ab34abbadd21edbca637d2e Oct 08 21:18:28.508749 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1956575659 Oct 08 21:18:28.508749 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-AttachVolumeNegativeTest-1956575659-project Oct 08 21:18:28.508749 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:18:28.508749 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:18:28.508749 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 8957041987c8487099f0d89f4c64af66 Oct 08 21:18:28.508749 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-AttachVolumeNegativeTest-1956575659-project Oct 08 21:18:28.508749 ncdv-master-1 devstack@n-api.service[140491]: Oct 08 21:18:28.508749 ncdv-master-1 devstack@n-api.service[140491]: {"volumeAttachment": {"volumeId": "846bd1eb-e484-4b7e-aa01-8cf22106cec3"}} Oct 08 21:18:28.508749 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:18:28.508749 ncdv-master-1 devstack@n-api.service[140491]: exception: Invalid volume: volume 846bd1eb-e484-4b7e-aa01-8cf22106cec3 is already attached to instances: 17c182d5-d3c8-4e7e-babc-46af1f466f00 Oct 08 21:18:28.508749 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'server_id': '17c182d5-d3c8-4e7e-babc-46af1f466f00', 'body': {'volumeAttachment': {'volumeId': '846bd1eb-e484-4b7e-aa01-8cf22106cec3'}}} Oct 08 21:18:28.508749 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:18:28.508749 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:18:28.508749 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 08 21:18:28.508749 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 08 21:18:28.508749 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 08 21:18:28.508749 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 08 21:18:28.508749 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 08 21:18:28.508749 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 08 21:18:28.508749 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 08 21:18:28.508749 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 08 21:18:28.508749 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 08 21:18:28.508749 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 08 21:18:28.508749 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 846bd1eb-e484-4b7e-aa01-8cf22106cec3 is already attached to instances: 17c182d5-d3c8-4e7e-babc-46af1f466f00 Oct 08 21:18:28.508749 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:18:28.508749 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:18:28.508749 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:18:28.508749 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:18:28.508749 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:18:28.508749 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:18:28.508749 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:18:28.508749 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:18:28.508749 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:18:28.508749 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:18:28.508749 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 21:18:28.508749 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 21:18:28.508749 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 21:18:28.508749 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 21:18:28.512757 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 21:18:28.512757 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 21:18:28.512757 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 08 21:18:28.512757 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 08 21:18:28.512757 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 846bd1eb-e484-4b7e-aa01-8cf22106cec3 is already attached to instances: 17c182d5-d3c8-4e7e-babc-46af1f466f00 Oct 08 21:18:28.512757 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:18:28.512757 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:18:28.512757 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:18:28.512757 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:18:28.512757 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:18:28.512757 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:18:28.512757 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:18:28.512757 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:18:28.512757 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 846bd1eb-e484-4b7e-aa01-8cf22106cec3 is already attached to instances: 17c182d5-d3c8-4e7e-babc-46af1f466f00 Oct 08 21:18:28.512757 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:18:28.515545 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-2928d6af-fde8-4a9a-9cce-50a491097c5d tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Returning 400 to user: Invalid volume: volume 846bd1eb-e484-4b7e-aa01-8cf22106cec3 is already attached to instances: 17c182d5-d3c8-4e7e-babc-46af1f466f00 {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:18:28.517670 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-2928d6af-fde8-4a9a-9cce-50a491097c5d tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] 10.222.0.26 "POST /compute/v2.1/servers/17c182d5-d3c8-4e7e-babc-46af1f466f00/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.144785 Oct 08 21:18:28.522023 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2540/5148] 10.222.0.26 () {60 vars in 1323 bytes} [Sat Oct 8 21:18:28 2022] POST /compute/v2.1/servers/17c182d5-d3c8-4e7e-babc-46af1f466f00/os-volume_attachments => generated 174 bytes in 151 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 08 21:18:28.587499 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-7be17418-3f54-40f7-aba6-1e234db6c2a3 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:18:28.588009 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-7be17418-3f54-40f7-aba6-1e234db6c2a3 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] [instance: 17c182d5-d3c8-4e7e-babc-46af1f466f00] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:18:28.594377 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7be17418-3f54-40f7-aba6-1e234db6c2a3 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:18:28.594867 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7be17418-3f54-40f7-aba6-1e234db6c2a3 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:18:28.595311 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7be17418-3f54-40f7-aba6-1e234db6c2a3 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:18:28.596014 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7be17418-3f54-40f7-aba6-1e234db6c2a3 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:18:28.596475 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7be17418-3f54-40f7-aba6-1e234db6c2a3 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:18:28.596903 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7be17418-3f54-40f7-aba6-1e234db6c2a3 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:18:28.680390 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.objects.instance [None req-7be17418-3f54-40f7-aba6-1e234db6c2a3 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lazy-loading 'services' on Instance uuid 17c182d5-d3c8-4e7e-babc-46af1f466f00 {{(pid=140492) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 21:18:28.759274 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-7be17418-3f54-40f7-aba6-1e234db6c2a3 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] 10.222.0.26 "DELETE /compute/v2.1/servers/17c182d5-d3c8-4e7e-babc-46af1f466f00/os-volume_attachments/846bd1eb-e484-4b7e-aa01-8cf22106cec3" status: 202 len: 0 microversion: 2.1 time: 0.175626 Oct 08 21:18:28.770975 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-cf0fb3e0-0341-4ec0-a962-9390a1ddeed6 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:18:28.773299 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-cf0fb3e0-0341-4ec0-a962-9390a1ddeed6 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] [instance: 17c182d5-d3c8-4e7e-babc-46af1f466f00] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:18:28.775685 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2609/5149] 10.222.0.26 () {58 vars in 1416 bytes} [Sat Oct 8 21:18:28 2022] DELETE /compute/v2.1/servers/17c182d5-d3c8-4e7e-babc-46af1f466f00/os-volume_attachments/846bd1eb-e484-4b7e-aa01-8cf22106cec3 => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 21:18:28.781523 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cf0fb3e0-0341-4ec0-a962-9390a1ddeed6 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:18:28.782025 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cf0fb3e0-0341-4ec0-a962-9390a1ddeed6 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:18:28.782486 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cf0fb3e0-0341-4ec0-a962-9390a1ddeed6 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:18:28.783225 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cf0fb3e0-0341-4ec0-a962-9390a1ddeed6 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:18:28.783850 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cf0fb3e0-0341-4ec0-a962-9390a1ddeed6 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:18:28.784308 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cf0fb3e0-0341-4ec0-a962-9390a1ddeed6 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:18:28.821616 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-cf0fb3e0-0341-4ec0-a962-9390a1ddeed6 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] 10.222.0.26 "GET /compute/v2.1/servers/17c182d5-d3c8-4e7e-babc-46af1f466f00/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056843 Oct 08 21:18:28.822766 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2541/5150] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Oct 8 21:18:28 2022] GET /compute/v2.1/servers/17c182d5-d3c8-4e7e-babc-46af1f466f00/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:18:29.201257 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-3c13e2e7-76b6-4492-843c-5ad3e0316fc9 tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:18:29.202855 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-3c13e2e7-76b6-4492-843c-5ad3e0316fc9 tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] [instance: 782fe6d2-1cc1-4748-8da9-f06fb9350288] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:18:29.212115 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3c13e2e7-76b6-4492-843c-5ad3e0316fc9 tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:18:29.212825 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3c13e2e7-76b6-4492-843c-5ad3e0316fc9 tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:18:29.214854 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3c13e2e7-76b6-4492-843c-5ad3e0316fc9 tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:18:29.215788 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3c13e2e7-76b6-4492-843c-5ad3e0316fc9 tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:18:29.216508 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3c13e2e7-76b6-4492-843c-5ad3e0316fc9 tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:18:29.217113 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3c13e2e7-76b6-4492-843c-5ad3e0316fc9 tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:18:29.241415 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-3c13e2e7-76b6-4492-843c-5ad3e0316fc9 tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] HTTP exception thrown: Instance 782fe6d2-1cc1-4748-8da9-f06fb9350288 could not be found. Oct 08 21:18:29.244259 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-3c13e2e7-76b6-4492-843c-5ad3e0316fc9 tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] Request method failure captured: Oct 08 21:18:29.244259 ncdv-master-1 devstack@n-api.service[140492]: request: GET /compute/v2.1/servers/782fe6d2-1cc1-4748-8da9-f06fb9350288 HTTP/1.1 Oct 08 21:18:29.244259 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:18:29.244259 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:18:29.244259 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:18:29.244259 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 21:18:29.244259 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:18:29.244259 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:18:29.244259 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:18:29.244259 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:18:29.244259 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQekQ0dAJMD5MQVjM1j72XwawsS0IbgKeo1i0nwrVHxQsOFDhKt1Rc2Urp0Kj2I2SHH2dzWHOEE-aEEJwrBOf48_WcnVy72rKI0S5k63kx-4vYxKvL629oz7eo60udNnZ-_tBf7-QDsgkrkOYaro_L_qetTjEiwTuUDV_n-CQ0Dma3HY Oct 08 21:18:29.244259 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:18:29.244259 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:18:29.244259 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:18:29.244259 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:18:29.244259 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:18:29.244259 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:18:29.244259 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 9e8fbf829e45416b8d40ff3a9e512fe8 Oct 08 21:18:29.244259 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-VolumesNegativeTest-1526929498 Oct 08 21:18:29.244259 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:18:29.244259 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:18:29.244259 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9e8fbf829e45416b8d40ff3a9e512fe8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9e8fbf829e45416b8d40ff3a9e512fe8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9e8fbf829e45416b8d40ff3a9e512fe8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9e8fbf829e45416b8d40ff3a9e512fe8"}]}] Oct 08 21:18:29.244259 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-VolumesNegativeTest-1526929498 Oct 08 21:18:29.244259 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 9e8fbf829e45416b8d40ff3a9e512fe8 Oct 08 21:18:29.244259 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-VolumesNegativeTest-1526929498 Oct 08 21:18:29.244259 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-VolumesNegativeTest-1526929498-project Oct 08 21:18:29.244259 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:18:29.244259 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:18:29.244259 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 0405dc39ca524c87ae5a99db8d85e615 Oct 08 21:18:29.244259 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-VolumesNegativeTest-1526929498-project Oct 08 21:18:29.244259 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 21:18:29.244259 ncdv-master-1 devstack@n-api.service[140492]: exception: Instance 782fe6d2-1cc1-4748-8da9-f06fb9350288 could not be found. Oct 08 21:18:29.244259 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': '782fe6d2-1cc1-4748-8da9-f06fb9350288'} Oct 08 21:18:29.244259 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:18:29.244259 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:18:29.244259 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:18:29.244259 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:18:29.244259 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:18:29.244259 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:18:29.244259 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:18:29.244259 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:18:29.244259 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:18:29.244259 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:18:29.244259 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 782fe6d2-1cc1-4748-8da9-f06fb9350288 could not be found. Oct 08 21:18:29.244259 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:18:29.244259 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:18:29.244259 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:18:29.244259 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:18:29.244259 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:18:29.244259 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:18:29.244259 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:18:29.244259 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:18:29.244259 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:18:29.244259 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:18:29.244259 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:18:29.244259 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:18:29.244259 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:18:29.244259 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:18:29.244259 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:18:29.244259 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:18:29.244259 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 782fe6d2-1cc1-4748-8da9-f06fb9350288 could not be found. Oct 08 21:18:29.244259 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:18:29.244259 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:18:29.244259 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:18:29.250966 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:18:29.250966 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:18:29.250966 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:18:29.250966 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:18:29.250966 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:18:29.250966 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 782fe6d2-1cc1-4748-8da9-f06fb9350288 could not be found. Oct 08 21:18:29.250966 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:18:29.253926 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-3c13e2e7-76b6-4492-843c-5ad3e0316fc9 tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] Returning 404 to user: Instance 782fe6d2-1cc1-4748-8da9-f06fb9350288 could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:18:29.255365 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-3c13e2e7-76b6-4492-843c-5ad3e0316fc9 tempest-VolumesNegativeTest-1526929498 tempest-VolumesNegativeTest-1526929498-project] 10.222.0.26 "GET /compute/v2.1/servers/782fe6d2-1cc1-4748-8da9-f06fb9350288" status: 404 len: 111 microversion: 2.1 time: 0.064398 Oct 08 21:18:29.256664 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2610/5151] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:18:29 2022] GET /compute/v2.1/servers/782fe6d2-1cc1-4748-8da9-f06fb9350288 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:18:29.835289 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c99da56d-4b68-432c-bc9c-482a849445f7 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:18:29.837995 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-c99da56d-4b68-432c-bc9c-482a849445f7 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] [instance: 17c182d5-d3c8-4e7e-babc-46af1f466f00] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:18:29.847861 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c99da56d-4b68-432c-bc9c-482a849445f7 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:18:29.848624 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c99da56d-4b68-432c-bc9c-482a849445f7 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:18:29.849409 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c99da56d-4b68-432c-bc9c-482a849445f7 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:18:29.850191 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c99da56d-4b68-432c-bc9c-482a849445f7 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:18:29.850661 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c99da56d-4b68-432c-bc9c-482a849445f7 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:18:29.851301 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c99da56d-4b68-432c-bc9c-482a849445f7 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:18:29.899518 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-c99da56d-4b68-432c-bc9c-482a849445f7 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] 10.222.0.26 "GET /compute/v2.1/servers/17c182d5-d3c8-4e7e-babc-46af1f466f00/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.068465 Oct 08 21:18:29.900130 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2542/5152] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Oct 8 21:18:29 2022] GET /compute/v2.1/servers/17c182d5-d3c8-4e7e-babc-46af1f466f00/os-volume_attachments => generated 25 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 08 21:18:29.998080 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-3f1bb435-d602-4f06-a2a7-8736191352a0 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:18:29.998705 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-3f1bb435-d602-4f06-a2a7-8736191352a0 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] [instance: 17c182d5-d3c8-4e7e-babc-46af1f466f00] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:18:30.007522 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3f1bb435-d602-4f06-a2a7-8736191352a0 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:18:30.007522 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3f1bb435-d602-4f06-a2a7-8736191352a0 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:18:30.007522 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3f1bb435-d602-4f06-a2a7-8736191352a0 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:18:30.008286 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3f1bb435-d602-4f06-a2a7-8736191352a0 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:18:30.008857 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3f1bb435-d602-4f06-a2a7-8736191352a0 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:18:30.009653 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3f1bb435-d602-4f06-a2a7-8736191352a0 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:18:30.051996 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-3f1bb435-d602-4f06-a2a7-8736191352a0 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] [instance: 17c182d5-d3c8-4e7e-babc-46af1f466f00] Going to try to terminate instance {{(pid=140492) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 21:18:30.088597 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:18:30.159672 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-3f1bb435-d602-4f06-a2a7-8736191352a0 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] 10.222.0.26 "DELETE /compute/v2.1/servers/17c182d5-d3c8-4e7e-babc-46af1f466f00" status: 204 len: 0 microversion: 2.1 time: 0.165403 Oct 08 21:18:30.160570 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2611/5153] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:18:29 2022] DELETE /compute/v2.1/servers/17c182d5-d3c8-4e7e-babc-46af1f466f00 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 21:18:30.171620 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-7556e6aa-2856-4304-8780-258b945ce9ee tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:18:30.172484 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-7556e6aa-2856-4304-8780-258b945ce9ee tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] [instance: 17c182d5-d3c8-4e7e-babc-46af1f466f00] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:18:30.182083 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7556e6aa-2856-4304-8780-258b945ce9ee tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:18:30.182083 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7556e6aa-2856-4304-8780-258b945ce9ee tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:18:30.182083 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7556e6aa-2856-4304-8780-258b945ce9ee tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:18:30.182778 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7556e6aa-2856-4304-8780-258b945ce9ee tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:18:30.183405 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7556e6aa-2856-4304-8780-258b945ce9ee tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:18:30.184215 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7556e6aa-2856-4304-8780-258b945ce9ee tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:18:30.411956 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-7556e6aa-2856-4304-8780-258b945ce9ee tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8957041987c8487099f0d89f4c64af66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9d29b90ab34abbadd21edbca637d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:18:30.428538 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-7556e6aa-2856-4304-8780-258b945ce9ee tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] 10.222.0.26 "GET /compute/v2.1/servers/17c182d5-d3c8-4e7e-babc-46af1f466f00" status: 200 len: 1682 microversion: 2.1 time: 0.263379 Oct 08 21:18:30.429643 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2543/5154] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:18:30 2022] GET /compute/v2.1/servers/17c182d5-d3c8-4e7e-babc-46af1f466f00 => generated 1682 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:18:30.800061 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-132afb33-1729-496e-8acd-7f8edaac98ae tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:18:30.801065 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-132afb33-1729-496e-8acd-7f8edaac98ae tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 2a61f287-652b-487f-9ecd-fb4d2d1eee62] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:18:30.808774 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-132afb33-1729-496e-8acd-7f8edaac98ae tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:18:30.809307 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-132afb33-1729-496e-8acd-7f8edaac98ae tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:18:30.810404 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-132afb33-1729-496e-8acd-7f8edaac98ae tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:18:30.811139 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-132afb33-1729-496e-8acd-7f8edaac98ae tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:18:30.811609 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-132afb33-1729-496e-8acd-7f8edaac98ae tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:18:30.812048 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-132afb33-1729-496e-8acd-7f8edaac98ae tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:18:31.037091 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-132afb33-1729-496e-8acd-7f8edaac98ae tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:18:31.047260 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-132afb33-1729-496e-8acd-7f8edaac98ae tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62" status: 200 len: 1670 microversion: 2.1 time: 0.251394 Oct 08 21:18:31.048626 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2612/5155] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:18:30 2022] GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62 => generated 1670 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:18:31.078809 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-5532fc91-6a44-4131-8790-b8d867c05c87 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:18:31.079438 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-5532fc91-6a44-4131-8790-b8d867c05c87 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 2a61f287-652b-487f-9ecd-fb4d2d1eee62] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:18:31.099990 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5532fc91-6a44-4131-8790-b8d867c05c87 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:18:31.100502 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5532fc91-6a44-4131-8790-b8d867c05c87 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:18:31.103335 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5532fc91-6a44-4131-8790-b8d867c05c87 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:18:31.104437 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5532fc91-6a44-4131-8790-b8d867c05c87 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:18:31.105113 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5532fc91-6a44-4131-8790-b8d867c05c87 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:18:31.105871 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5532fc91-6a44-4131-8790-b8d867c05c87 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:18:31.329261 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-5532fc91-6a44-4131-8790-b8d867c05c87 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:18:31.338483 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-5532fc91-6a44-4131-8790-b8d867c05c87 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62" status: 200 len: 1670 microversion: 2.1 time: 0.267965 Oct 08 21:18:31.339075 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2544/5156] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:18:31 2022] GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62 => generated 1670 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:18:31.362176 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-3b8957cd-ff62-4b8c-be50-c277f226c8e0 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:18:31.362956 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-3b8957cd-ff62-4b8c-be50-c277f226c8e0 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 2a61f287-652b-487f-9ecd-fb4d2d1eee62] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:18:31.371545 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3b8957cd-ff62-4b8c-be50-c277f226c8e0 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:18:31.372056 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3b8957cd-ff62-4b8c-be50-c277f226c8e0 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:18:31.374777 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3b8957cd-ff62-4b8c-be50-c277f226c8e0 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:18:31.376580 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3b8957cd-ff62-4b8c-be50-c277f226c8e0 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:18:31.377071 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3b8957cd-ff62-4b8c-be50-c277f226c8e0 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:18:31.377558 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3b8957cd-ff62-4b8c-be50-c277f226c8e0 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:18:31.454601 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-93eb57ca-58f8-4d5a-add7-4589ed59d02d tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:18:31.455753 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-93eb57ca-58f8-4d5a-add7-4589ed59d02d tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] [instance: 17c182d5-d3c8-4e7e-babc-46af1f466f00] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:18:31.463495 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-93eb57ca-58f8-4d5a-add7-4589ed59d02d tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:18:31.464974 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-93eb57ca-58f8-4d5a-add7-4589ed59d02d tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:18:31.465628 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-93eb57ca-58f8-4d5a-add7-4589ed59d02d tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:18:31.466906 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-93eb57ca-58f8-4d5a-add7-4589ed59d02d tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:18:31.467547 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-93eb57ca-58f8-4d5a-add7-4589ed59d02d tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:18:31.468145 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-93eb57ca-58f8-4d5a-add7-4589ed59d02d tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:18:31.655582 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-93eb57ca-58f8-4d5a-add7-4589ed59d02d tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8957041987c8487099f0d89f4c64af66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9d29b90ab34abbadd21edbca637d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:18:31.666606 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-93eb57ca-58f8-4d5a-add7-4589ed59d02d tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] 10.222.0.26 "GET /compute/v2.1/servers/17c182d5-d3c8-4e7e-babc-46af1f466f00" status: 200 len: 1682 microversion: 2.1 time: 0.216565 Oct 08 21:18:31.667987 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2545/5157] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:18:31 2022] GET /compute/v2.1/servers/17c182d5-d3c8-4e7e-babc-46af1f466f00 => generated 1682 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:18:32.160381 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-3b8957cd-ff62-4b8c-be50-c277f226c8e0 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:18:32.179613 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-3b8957cd-ff62-4b8c-be50-c277f226c8e0 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62" status: 200 len: 1670 microversion: 2.1 time: 0.821192 Oct 08 21:18:32.183959 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2613/5158] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:18:31 2022] GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62 => generated 1670 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:18:32.219957 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-e383f461-85fe-47fc-a926-4484f82f6b15 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1891877526"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:18:32.224236 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-e383f461-85fe-47fc-a926-4484f82f6b15 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 2a61f287-652b-487f-9ecd-fb4d2d1eee62] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:18:32.248045 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e383f461-85fe-47fc-a926-4484f82f6b15 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:18:32.248740 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e383f461-85fe-47fc-a926-4484f82f6b15 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:18:32.249550 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e383f461-85fe-47fc-a926-4484f82f6b15 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:18:32.250822 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e383f461-85fe-47fc-a926-4484f82f6b15 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:18:32.251466 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e383f461-85fe-47fc-a926-4484f82f6b15 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:18:32.258555 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e383f461-85fe-47fc-a926-4484f82f6b15 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:18:32.585342 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-e383f461-85fe-47fc-a926-4484f82f6b15 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "POST /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62/action" status: 202 len: 0 microversion: 2.1 time: 0.375665 Oct 08 21:18:32.599146 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2546/5159] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:18:32 2022] POST /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62/action => generated 0 bytes in 390 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 08 21:18:32.692611 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-176e1d0b-ada4-46ed-85bf-af7ad5b4a7e6 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:18:32.693596 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-176e1d0b-ada4-46ed-85bf-af7ad5b4a7e6 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] [instance: 17c182d5-d3c8-4e7e-babc-46af1f466f00] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:18:32.705717 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-176e1d0b-ada4-46ed-85bf-af7ad5b4a7e6 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:18:32.706613 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-176e1d0b-ada4-46ed-85bf-af7ad5b4a7e6 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:18:32.707457 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-176e1d0b-ada4-46ed-85bf-af7ad5b4a7e6 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:18:32.708490 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-176e1d0b-ada4-46ed-85bf-af7ad5b4a7e6 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:18:32.709270 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-176e1d0b-ada4-46ed-85bf-af7ad5b4a7e6 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:18:32.709996 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-176e1d0b-ada4-46ed-85bf-af7ad5b4a7e6 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:18:33.074517 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-176e1d0b-ada4-46ed-85bf-af7ad5b4a7e6 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8957041987c8487099f0d89f4c64af66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9d29b90ab34abbadd21edbca637d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:18:33.084157 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-176e1d0b-ada4-46ed-85bf-af7ad5b4a7e6 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] 10.222.0.26 "GET /compute/v2.1/servers/17c182d5-d3c8-4e7e-babc-46af1f466f00" status: 200 len: 1682 microversion: 2.1 time: 0.395495 Oct 08 21:18:33.084755 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2614/5160] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:18:32 2022] GET /compute/v2.1/servers/17c182d5-d3c8-4e7e-babc-46af1f466f00 => generated 1682 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:18:34.111326 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c08c12ad-663e-421d-9d71-c8601cde1350 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:18:34.112221 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-c08c12ad-663e-421d-9d71-c8601cde1350 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] [instance: 17c182d5-d3c8-4e7e-babc-46af1f466f00] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:18:34.119435 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c08c12ad-663e-421d-9d71-c8601cde1350 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:18:34.120105 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c08c12ad-663e-421d-9d71-c8601cde1350 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:18:34.120947 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c08c12ad-663e-421d-9d71-c8601cde1350 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:18:34.122722 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c08c12ad-663e-421d-9d71-c8601cde1350 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:18:34.123428 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c08c12ad-663e-421d-9d71-c8601cde1350 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:18:34.124186 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c08c12ad-663e-421d-9d71-c8601cde1350 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:18:34.239905 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-c08c12ad-663e-421d-9d71-c8601cde1350 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8957041987c8487099f0d89f4c64af66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9d29b90ab34abbadd21edbca637d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:18:34.244539 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:18:34.251375 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-c08c12ad-663e-421d-9d71-c8601cde1350 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] 10.222.0.26 "GET /compute/v2.1/servers/17c182d5-d3c8-4e7e-babc-46af1f466f00" status: 200 len: 1615 microversion: 2.1 time: 0.146715 Oct 08 21:18:34.252431 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2547/5161] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:18:34 2022] GET /compute/v2.1/servers/17c182d5-d3c8-4e7e-babc-46af1f466f00 => generated 1615 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:18:34.277127 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-328771e7-4684-4569-9561-22efab827932 req-36ca38a4-7553-442f-a7a9-8e9a1b41092f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17c182d5-d3c8-4e7e-babc-46af1f466f00", "name": "network-vif-deleted", "tag": "ab6505ab-132c-43a4-ac9d-087f44752486"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:18:34.294879 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-328771e7-4684-4569-9561-22efab827932 req-36ca38a4-7553-442f-a7a9-8e9a1b41092f service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:18:34.296459 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-328771e7-4684-4569-9561-22efab827932 req-36ca38a4-7553-442f-a7a9-8e9a1b41092f service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:18:34.297365 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-328771e7-4684-4569-9561-22efab827932 req-36ca38a4-7553-442f-a7a9-8e9a1b41092f service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:18:34.318428 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-328771e7-4684-4569-9561-22efab827932 req-36ca38a4-7553-442f-a7a9-8e9a1b41092f service nova] Creating event network-vif-deleted:ab6505ab-132c-43a4-ac9d-087f44752486 for instance 17c182d5-d3c8-4e7e-babc-46af1f466f00 on nch2-master-1 Oct 08 21:18:34.327787 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-328771e7-4684-4569-9561-22efab827932 req-36ca38a4-7553-442f-a7a9-8e9a1b41092f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056928 Oct 08 21:18:34.329178 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2615/5162] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:18:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:18:35.275089 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-485cc53e-a83c-4d3c-aef1-48f33f5e6212 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:18:35.275711 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-485cc53e-a83c-4d3c-aef1-48f33f5e6212 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] [instance: 17c182d5-d3c8-4e7e-babc-46af1f466f00] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:18:35.285655 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-485cc53e-a83c-4d3c-aef1-48f33f5e6212 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:18:35.286817 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-485cc53e-a83c-4d3c-aef1-48f33f5e6212 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:18:35.287623 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-485cc53e-a83c-4d3c-aef1-48f33f5e6212 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:18:35.288830 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-485cc53e-a83c-4d3c-aef1-48f33f5e6212 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:18:35.289645 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-485cc53e-a83c-4d3c-aef1-48f33f5e6212 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:18:35.290410 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-485cc53e-a83c-4d3c-aef1-48f33f5e6212 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:18:35.309152 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-485cc53e-a83c-4d3c-aef1-48f33f5e6212 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] HTTP exception thrown: Instance 17c182d5-d3c8-4e7e-babc-46af1f466f00 could not be found. Oct 08 21:18:35.311847 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-485cc53e-a83c-4d3c-aef1-48f33f5e6212 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Request method failure captured: Oct 08 21:18:35.311847 ncdv-master-1 devstack@n-api.service[140491]: request: GET /compute/v2.1/servers/17c182d5-d3c8-4e7e-babc-46af1f466f00 HTTP/1.1 Oct 08 21:18:35.311847 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:18:35.311847 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:18:35.311847 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:18:35.311847 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 21:18:35.311847 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:18:35.311847 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:18:35.311847 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:18:35.311847 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:18:35.311847 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQehFIbXs-DGbS_kPUTJMTrUq-WofUYY6ZRyx81bX8dlJ1znB-Icd1X0JZVfoU0lBZbBMu1x5OyOchM7_W_m4wVb0RC5emVnYRQT_LfKB9ZNZm3xjiiSMGa29vJwyibC7NFwQ_T90TzXkiQ39iaomvdVhCKn_tsPv5ogwGAe_Atzwiz8 Oct 08 21:18:35.311847 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:18:35.311847 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:18:35.311847 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:18:35.311847 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:18:35.311847 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:18:35.311847 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:18:35.311847 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 3d9d29b90ab34abbadd21edbca637d2e Oct 08 21:18:35.311847 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-AttachVolumeNegativeTest-1956575659 Oct 08 21:18:35.311847 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:18:35.311847 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:18:35.311847 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3d9d29b90ab34abbadd21edbca637d2e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3d9d29b90ab34abbadd21edbca637d2e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3d9d29b90ab34abbadd21edbca637d2e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3d9d29b90ab34abbadd21edbca637d2e"}]}] Oct 08 21:18:35.311847 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-AttachVolumeNegativeTest-1956575659 Oct 08 21:18:35.311847 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 3d9d29b90ab34abbadd21edbca637d2e Oct 08 21:18:35.311847 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1956575659 Oct 08 21:18:35.311847 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-AttachVolumeNegativeTest-1956575659-project Oct 08 21:18:35.311847 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:18:35.311847 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:18:35.311847 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 8957041987c8487099f0d89f4c64af66 Oct 08 21:18:35.311847 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-AttachVolumeNegativeTest-1956575659-project Oct 08 21:18:35.311847 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:18:35.311847 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance 17c182d5-d3c8-4e7e-babc-46af1f466f00 could not be found. Oct 08 21:18:35.311847 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': '17c182d5-d3c8-4e7e-babc-46af1f466f00'} Oct 08 21:18:35.311847 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:18:35.311847 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:18:35.311847 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:18:35.311847 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:18:35.311847 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:18:35.311847 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:18:35.311847 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:18:35.311847 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:18:35.311847 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:18:35.311847 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:18:35.311847 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17c182d5-d3c8-4e7e-babc-46af1f466f00 could not be found. Oct 08 21:18:35.311847 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:18:35.311847 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:18:35.311847 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:18:35.311847 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:18:35.311847 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:18:35.311847 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:18:35.311847 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:18:35.311847 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:18:35.311847 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:18:35.311847 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:18:35.311847 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:18:35.311847 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:18:35.311847 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:18:35.311847 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:18:35.311847 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:18:35.311847 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:18:35.311847 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17c182d5-d3c8-4e7e-babc-46af1f466f00 could not be found. Oct 08 21:18:35.311847 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:18:35.311847 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:18:35.311847 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:18:35.316334 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:18:35.316334 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:18:35.316334 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:18:35.316334 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:18:35.316334 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:18:35.316334 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17c182d5-d3c8-4e7e-babc-46af1f466f00 could not be found. Oct 08 21:18:35.316334 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:18:35.318370 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-485cc53e-a83c-4d3c-aef1-48f33f5e6212 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Returning 404 to user: Instance 17c182d5-d3c8-4e7e-babc-46af1f466f00 could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:18:35.319603 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-485cc53e-a83c-4d3c-aef1-48f33f5e6212 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] 10.222.0.26 "GET /compute/v2.1/servers/17c182d5-d3c8-4e7e-babc-46af1f466f00" status: 404 len: 111 microversion: 2.1 time: 0.048338 Oct 08 21:18:35.320334 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2548/5163] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:18:35 2022] GET /compute/v2.1/servers/17c182d5-d3c8-4e7e-babc-46af1f466f00 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 08 21:18:35.331907 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-cdebc79c-c34c-4f05-9dfd-560979f2b327 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Calling method '.version_select at 0x7f1a8c0fadc0>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:18:35.392472 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-cdebc79c-c34c-4f05-9dfd-560979f2b327 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-655169559" status: 202 len: 0 microversion: 2.1 time: 0.065377 Oct 08 21:18:35.393493 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2616/5164] 10.222.0.26 () {58 vars in 1218 bytes} [Sat Oct 8 21:18:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-655169559 => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 21:18:37.334018 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-50f074cc-684a-4f5e-8f1b-f37e26f07bad tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Action: 'create', calling method: .version_select at 0x7f1a8c8475e0>, body: {"keypair": {"name": "tempest-keypair-683419627", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO7jfZuj3VA/JqaKuK9UTtU5aSS8JMcLIIPmuEq2EvvLjl2u7FX0L+Frir+m6BUx4ZlD33Ufy1MSCQEu9UFfSCsmhn1Uh23WcIAnSJtvtQzpxGFIR1B5BkmpzGXZCkiHIw=="}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:18:37.354547 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-50f074cc-684a-4f5e-8f1b-f37e26f07bad tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Getting quotas for project 3d9d29b90ab34abbadd21edbca637d2e. Resources: {'key_pairs'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:18:37.363068 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-50f074cc-684a-4f5e-8f1b-f37e26f07bad tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Getting quotas for user 8957041987c8487099f0d89f4c64af66 and project 3d9d29b90ab34abbadd21edbca637d2e. Resources: {'key_pairs'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:18:37.402420 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-50f074cc-684a-4f5e-8f1b-f37e26f07bad tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.071215 Oct 08 21:18:37.403484 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2549/5165] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Oct 8 21:18:37 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:18:38.274132 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-f72e302b-cc11-46ae-bfc5-d1780e0b232e req-33e54669-7f34-4b3d-8b28-cd17ee71766b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a61f287-652b-487f-9ecd-fb4d2d1eee62", "name": "network-vif-plugged", "status": "completed", "tag": "960ff13a-d0c5-4f5c-af4b-44aec29e7c23"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:18:38.329415 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-f72e302b-cc11-46ae-bfc5-d1780e0b232e req-33e54669-7f34-4b3d-8b28-cd17ee71766b service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:18:38.336929 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-f72e302b-cc11-46ae-bfc5-d1780e0b232e req-33e54669-7f34-4b3d-8b28-cd17ee71766b service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:18:38.338584 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-f72e302b-cc11-46ae-bfc5-d1780e0b232e req-33e54669-7f34-4b3d-8b28-cd17ee71766b service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:18:38.386434 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-f72e302b-cc11-46ae-bfc5-d1780e0b232e req-33e54669-7f34-4b3d-8b28-cd17ee71766b service nova] Creating event network-vif-plugged:960ff13a-d0c5-4f5c-af4b-44aec29e7c23 for instance 2a61f287-652b-487f-9ecd-fb4d2d1eee62 on nch1-master-1 Oct 08 21:18:38.402226 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-f72e302b-cc11-46ae-bfc5-d1780e0b232e req-33e54669-7f34-4b3d-8b28-cd17ee71766b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132391 Oct 08 21:18:38.404723 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2617/5166] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:18:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:18:41.495182 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-019ade9e-1e23-49fd-8aa2-5148f180771b tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1819831266", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3bac7a36-9cfd-41c8-b181-a7db0bd13b90"}], "security_groups": [{"name": "tempest-securitygroup--160785425"}], "key_name": "tempest-keypair-683419627", "user_data": "}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:18:41.524000 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=1 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:18:41.651506 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.network.neutron [None req-019ade9e-1e23-49fd-8aa2-5148f180771b tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] validate_networks() for [('3bac7a36-9cfd-41c8-b181-a7db0bd13b90', None, None, None, None, None)] {{(pid=140491) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 21:18:42.464162 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-019ade9e-1e23-49fd-8aa2-5148f180771b tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Flavor limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 21:18:42.464591 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-019ade9e-1e23-49fd-8aa2-5148f180771b tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Image limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 21:18:42.465074 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-019ade9e-1e23-49fd-8aa2-5148f180771b tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Flavor pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 21:18:42.465516 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-019ade9e-1e23-49fd-8aa2-5148f180771b tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Image pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 21:18:42.466491 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-019ade9e-1e23-49fd-8aa2-5148f180771b tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 21:18:42.498236 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-019ade9e-1e23-49fd-8aa2-5148f180771b tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:18:42.499407 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-019ade9e-1e23-49fd-8aa2-5148f180771b tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:18:42.500082 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-019ade9e-1e23-49fd-8aa2-5148f180771b tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:18:42.501026 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-019ade9e-1e23-49fd-8aa2-5148f180771b tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:18:42.501665 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-019ade9e-1e23-49fd-8aa2-5148f180771b tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:18:42.502251 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-019ade9e-1e23-49fd-8aa2-5148f180771b tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:18:42.530268 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-019ade9e-1e23-49fd-8aa2-5148f180771b tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Getting quotas for project 3d9d29b90ab34abbadd21edbca637d2e. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:18:42.538045 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-019ade9e-1e23-49fd-8aa2-5148f180771b tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Getting quotas for user 8957041987c8487099f0d89f4c64af66 and project 3d9d29b90ab34abbadd21edbca637d2e. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:18:42.556906 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-019ade9e-1e23-49fd-8aa2-5148f180771b tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Going to run 1 instances... {{(pid=140491) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 21:18:42.560124 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-019ade9e-1e23-49fd-8aa2-5148f180771b tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] [instance: 629522c2-4765-4e35-a6a6-9c3554b1c8c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c508bd7f-7db9-4b2c-af7c-be54a855c355',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140491) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 21:18:42.619264 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-019ade9e-1e23-49fd-8aa2-5148f180771b tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.129361 Oct 08 21:18:42.619924 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2550/5167] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 21:18:41 2022] POST /compute/v2.1/servers => generated 401 bytes in 1131 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 08 21:18:42.633324 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-a32246d7-cdfe-4abc-b87f-d28fb3798fed tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:18:42.634041 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-a32246d7-cdfe-4abc-b87f-d28fb3798fed tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] [instance: 629522c2-4765-4e35-a6a6-9c3554b1c8c4] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:18:42.636055 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=3,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:18:42.838258 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-a32246d7-cdfe-4abc-b87f-d28fb3798fed tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8957041987c8487099f0d89f4c64af66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9d29b90ab34abbadd21edbca637d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:18:42.850568 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-a32246d7-cdfe-4abc-b87f-d28fb3798fed tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] 10.222.0.26 "GET /compute/v2.1/servers/629522c2-4765-4e35-a6a6-9c3554b1c8c4" status: 200 len: 1241 microversion: 2.1 time: 0.222018 Oct 08 21:18:42.851892 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2618/5168] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:18:42 2022] GET /compute/v2.1/servers/629522c2-4765-4e35-a6a6-9c3554b1c8c4 => generated 1241 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:18:43.881261 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-27739b43-2312-4144-a436-a4775c49917c tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:18:43.882683 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-27739b43-2312-4144-a436-a4775c49917c tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] [instance: 629522c2-4765-4e35-a6a6-9c3554b1c8c4] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:18:43.893200 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-27739b43-2312-4144-a436-a4775c49917c tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:18:43.894139 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-27739b43-2312-4144-a436-a4775c49917c tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:18:43.894798 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-27739b43-2312-4144-a436-a4775c49917c tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:18:43.896786 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-27739b43-2312-4144-a436-a4775c49917c tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:18:43.910735 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-27739b43-2312-4144-a436-a4775c49917c tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:18:43.911646 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-27739b43-2312-4144-a436-a4775c49917c tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:18:44.069448 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-27739b43-2312-4144-a436-a4775c49917c tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8957041987c8487099f0d89f4c64af66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9d29b90ab34abbadd21edbca637d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:18:44.085881 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-27739b43-2312-4144-a436-a4775c49917c tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] 10.222.0.26 "GET /compute/v2.1/servers/629522c2-4765-4e35-a6a6-9c3554b1c8c4" status: 200 len: 1293 microversion: 2.1 time: 0.213931 Oct 08 21:18:44.087089 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2551/5169] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:18:43 2022] GET /compute/v2.1/servers/629522c2-4765-4e35-a6a6-9c3554b1c8c4 => generated 1293 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:18:45.114191 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-dd9f8b3b-37cc-48e1-8c3d-82fedf24bd94 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:18:45.115459 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-dd9f8b3b-37cc-48e1-8c3d-82fedf24bd94 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] [instance: 629522c2-4765-4e35-a6a6-9c3554b1c8c4] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:18:45.139304 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dd9f8b3b-37cc-48e1-8c3d-82fedf24bd94 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:18:45.139839 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dd9f8b3b-37cc-48e1-8c3d-82fedf24bd94 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:18:45.140519 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dd9f8b3b-37cc-48e1-8c3d-82fedf24bd94 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:18:45.141741 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dd9f8b3b-37cc-48e1-8c3d-82fedf24bd94 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:18:45.142835 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dd9f8b3b-37cc-48e1-8c3d-82fedf24bd94 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:18:45.143881 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dd9f8b3b-37cc-48e1-8c3d-82fedf24bd94 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:18:45.348924 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-dd9f8b3b-37cc-48e1-8c3d-82fedf24bd94 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8957041987c8487099f0d89f4c64af66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9d29b90ab34abbadd21edbca637d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:18:45.362669 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-dd9f8b3b-37cc-48e1-8c3d-82fedf24bd94 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] 10.222.0.26 "GET /compute/v2.1/servers/629522c2-4765-4e35-a6a6-9c3554b1c8c4" status: 200 len: 1299 microversion: 2.1 time: 0.254143 Oct 08 21:18:45.369706 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2619/5170] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:18:45 2022] GET /compute/v2.1/servers/629522c2-4765-4e35-a6a6-9c3554b1c8c4 => generated 1299 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:18:46.394594 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-e29f6599-a6fa-4bbf-8e80-6dac3ae44dab tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:18:46.395225 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-e29f6599-a6fa-4bbf-8e80-6dac3ae44dab tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] [instance: 629522c2-4765-4e35-a6a6-9c3554b1c8c4] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:18:46.422258 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e29f6599-a6fa-4bbf-8e80-6dac3ae44dab tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:18:46.422802 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e29f6599-a6fa-4bbf-8e80-6dac3ae44dab tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:18:46.423258 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e29f6599-a6fa-4bbf-8e80-6dac3ae44dab tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:18:46.430982 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e29f6599-a6fa-4bbf-8e80-6dac3ae44dab tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:18:46.432049 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e29f6599-a6fa-4bbf-8e80-6dac3ae44dab tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:18:46.442615 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e29f6599-a6fa-4bbf-8e80-6dac3ae44dab tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:18:47.047766 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-e29f6599-a6fa-4bbf-8e80-6dac3ae44dab tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8957041987c8487099f0d89f4c64af66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9d29b90ab34abbadd21edbca637d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:18:47.069294 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-e29f6599-a6fa-4bbf-8e80-6dac3ae44dab tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] 10.222.0.26 "GET /compute/v2.1/servers/629522c2-4765-4e35-a6a6-9c3554b1c8c4" status: 200 len: 1366 microversion: 2.1 time: 0.678391 Oct 08 21:18:47.071334 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2552/5171] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:18:46 2022] GET /compute/v2.1/servers/629522c2-4765-4e35-a6a6-9c3554b1c8c4 => generated 1366 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:18:47.785169 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-32608509-046e-4bf3-8228-7489427e8edf req-976c5bbd-753e-4224-b3e8-e5b65de00c83 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "629522c2-4765-4e35-a6a6-9c3554b1c8c4", "tag": "b5e9b8d7-841b-4cc1-9d4e-eaa7852df9d5"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:18:47.807823 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-32608509-046e-4bf3-8228-7489427e8edf req-976c5bbd-753e-4224-b3e8-e5b65de00c83 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:18:47.808702 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-32608509-046e-4bf3-8228-7489427e8edf req-976c5bbd-753e-4224-b3e8-e5b65de00c83 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:18:47.811353 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-32608509-046e-4bf3-8228-7489427e8edf req-976c5bbd-753e-4224-b3e8-e5b65de00c83 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:18:47.842959 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-32608509-046e-4bf3-8228-7489427e8edf req-976c5bbd-753e-4224-b3e8-e5b65de00c83 service nova] Creating event network-changed:b5e9b8d7-841b-4cc1-9d4e-eaa7852df9d5 for instance 629522c2-4765-4e35-a6a6-9c3554b1c8c4 on nch2-master-1 Oct 08 21:18:47.851880 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-32608509-046e-4bf3-8228-7489427e8edf req-976c5bbd-753e-4224-b3e8-e5b65de00c83 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071727 Oct 08 21:18:47.866085 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2620/5172] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:18:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:18:48.094818 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-4735877e-97af-4199-82a3-ce44e9af1ff5 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:18:48.097080 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-4735877e-97af-4199-82a3-ce44e9af1ff5 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] [instance: 629522c2-4765-4e35-a6a6-9c3554b1c8c4] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:18:48.112756 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4735877e-97af-4199-82a3-ce44e9af1ff5 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:18:48.113309 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4735877e-97af-4199-82a3-ce44e9af1ff5 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:18:48.122562 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4735877e-97af-4199-82a3-ce44e9af1ff5 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:18:48.126523 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4735877e-97af-4199-82a3-ce44e9af1ff5 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:18:48.128142 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4735877e-97af-4199-82a3-ce44e9af1ff5 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:18:48.128808 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4735877e-97af-4199-82a3-ce44e9af1ff5 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:18:48.784157 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-4735877e-97af-4199-82a3-ce44e9af1ff5 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8957041987c8487099f0d89f4c64af66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9d29b90ab34abbadd21edbca637d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:18:48.814122 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-4735877e-97af-4199-82a3-ce44e9af1ff5 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] 10.222.0.26 "GET /compute/v2.1/servers/629522c2-4765-4e35-a6a6-9c3554b1c8c4" status: 200 len: 1366 microversion: 2.1 time: 0.706195 Oct 08 21:18:48.833428 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2553/5173] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:18:48 2022] GET /compute/v2.1/servers/629522c2-4765-4e35-a6a6-9c3554b1c8c4 => generated 1366 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:18:49.857102 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-91375378-1e3f-4032-910f-4cb750d880de tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:18:49.858090 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-91375378-1e3f-4032-910f-4cb750d880de tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] [instance: 629522c2-4765-4e35-a6a6-9c3554b1c8c4] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:18:49.876607 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-91375378-1e3f-4032-910f-4cb750d880de tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:18:49.877114 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-91375378-1e3f-4032-910f-4cb750d880de tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:18:49.877594 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-91375378-1e3f-4032-910f-4cb750d880de tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:18:49.881474 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-91375378-1e3f-4032-910f-4cb750d880de tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:18:49.882100 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-91375378-1e3f-4032-910f-4cb750d880de tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:18:49.883924 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-91375378-1e3f-4032-910f-4cb750d880de tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:18:50.275008 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-91375378-1e3f-4032-910f-4cb750d880de tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8957041987c8487099f0d89f4c64af66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9d29b90ab34abbadd21edbca637d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:18:50.298173 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-91375378-1e3f-4032-910f-4cb750d880de tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] 10.222.0.26 "GET /compute/v2.1/servers/629522c2-4765-4e35-a6a6-9c3554b1c8c4" status: 200 len: 1366 microversion: 2.1 time: 0.447382 Oct 08 21:18:50.299915 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2621/5174] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:18:49 2022] GET /compute/v2.1/servers/629522c2-4765-4e35-a6a6-9c3554b1c8c4 => generated 1366 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:18:51.330808 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-8c70ef02-e10e-405c-8ea0-9c92729483a8 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:18:51.332080 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-8c70ef02-e10e-405c-8ea0-9c92729483a8 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] [instance: 629522c2-4765-4e35-a6a6-9c3554b1c8c4] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:18:51.345764 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8c70ef02-e10e-405c-8ea0-9c92729483a8 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:18:51.348046 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8c70ef02-e10e-405c-8ea0-9c92729483a8 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:18:51.348863 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8c70ef02-e10e-405c-8ea0-9c92729483a8 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:18:51.349794 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8c70ef02-e10e-405c-8ea0-9c92729483a8 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:18:51.351358 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8c70ef02-e10e-405c-8ea0-9c92729483a8 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:18:51.352447 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8c70ef02-e10e-405c-8ea0-9c92729483a8 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:18:51.764547 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-8c70ef02-e10e-405c-8ea0-9c92729483a8 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8957041987c8487099f0d89f4c64af66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9d29b90ab34abbadd21edbca637d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:18:51.778925 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-8c70ef02-e10e-405c-8ea0-9c92729483a8 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] 10.222.0.26 "GET /compute/v2.1/servers/629522c2-4765-4e35-a6a6-9c3554b1c8c4" status: 200 len: 1366 microversion: 2.1 time: 0.453665 Oct 08 21:18:51.781488 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2554/5175] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:18:51 2022] GET /compute/v2.1/servers/629522c2-4765-4e35-a6a6-9c3554b1c8c4 => generated 1366 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:18:52.805532 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-f3c9119e-2dde-44c7-ab17-b6c3488b6364 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:18:52.806798 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-f3c9119e-2dde-44c7-ab17-b6c3488b6364 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] [instance: 629522c2-4765-4e35-a6a6-9c3554b1c8c4] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:18:52.820065 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f3c9119e-2dde-44c7-ab17-b6c3488b6364 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:18:52.820860 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f3c9119e-2dde-44c7-ab17-b6c3488b6364 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:18:52.821544 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f3c9119e-2dde-44c7-ab17-b6c3488b6364 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:18:52.822526 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f3c9119e-2dde-44c7-ab17-b6c3488b6364 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:18:52.823232 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f3c9119e-2dde-44c7-ab17-b6c3488b6364 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:18:52.823859 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f3c9119e-2dde-44c7-ab17-b6c3488b6364 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:18:52.856548 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=2 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:18:53.148437 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-f3c9119e-2dde-44c7-ab17-b6c3488b6364 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8957041987c8487099f0d89f4c64af66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9d29b90ab34abbadd21edbca637d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:18:53.161301 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-f3c9119e-2dde-44c7-ab17-b6c3488b6364 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] 10.222.0.26 "GET /compute/v2.1/servers/629522c2-4765-4e35-a6a6-9c3554b1c8c4" status: 200 len: 1366 microversion: 2.1 time: 0.359004 Oct 08 21:18:53.162328 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2622/5176] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:18:52 2022] GET /compute/v2.1/servers/629522c2-4765-4e35-a6a6-9c3554b1c8c4 => generated 1366 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:18:53.317015 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-ee09a764-d0ff-4d36-8397-477eec67cf0f req-31afb1ef-3236-4f43-a8a9-eff64666053c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "629522c2-4765-4e35-a6a6-9c3554b1c8c4", "name": "network-vif-plugged", "status": "completed", "tag": "b5e9b8d7-841b-4cc1-9d4e-eaa7852df9d5"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:18:53.338429 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=2 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:18:53.339683 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=10 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:18:53.348315 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-ee09a764-d0ff-4d36-8397-477eec67cf0f req-31afb1ef-3236-4f43-a8a9-eff64666053c service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:18:53.349213 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-ee09a764-d0ff-4d36-8397-477eec67cf0f req-31afb1ef-3236-4f43-a8a9-eff64666053c service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:18:53.349896 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-ee09a764-d0ff-4d36-8397-477eec67cf0f req-31afb1ef-3236-4f43-a8a9-eff64666053c service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:18:53.399929 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-ee09a764-d0ff-4d36-8397-477eec67cf0f req-31afb1ef-3236-4f43-a8a9-eff64666053c service nova] Creating event network-vif-plugged:b5e9b8d7-841b-4cc1-9d4e-eaa7852df9d5 for instance 629522c2-4765-4e35-a6a6-9c3554b1c8c4 on nch2-master-1 Oct 08 21:18:53.415742 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-ee09a764-d0ff-4d36-8397-477eec67cf0f req-31afb1ef-3236-4f43-a8a9-eff64666053c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103239 Oct 08 21:18:53.421519 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2555/5177] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:18:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:18:54.202754 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-463f0a8d-20c5-4205-a103-3f3475350e5b tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:18:54.203577 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-463f0a8d-20c5-4205-a103-3f3475350e5b tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] [instance: 629522c2-4765-4e35-a6a6-9c3554b1c8c4] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:18:54.235176 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-463f0a8d-20c5-4205-a103-3f3475350e5b tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:18:54.235761 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-463f0a8d-20c5-4205-a103-3f3475350e5b tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:18:54.239018 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-463f0a8d-20c5-4205-a103-3f3475350e5b tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:18:54.240893 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-463f0a8d-20c5-4205-a103-3f3475350e5b tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:18:54.242711 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-463f0a8d-20c5-4205-a103-3f3475350e5b tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:18:54.244586 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-463f0a8d-20c5-4205-a103-3f3475350e5b tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:18:54.756432 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-463f0a8d-20c5-4205-a103-3f3475350e5b tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8957041987c8487099f0d89f4c64af66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9d29b90ab34abbadd21edbca637d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:18:54.768743 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-463f0a8d-20c5-4205-a103-3f3475350e5b tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] 10.222.0.26 "GET /compute/v2.1/servers/629522c2-4765-4e35-a6a6-9c3554b1c8c4" status: 200 len: 1366 microversion: 2.1 time: 0.579771 Oct 08 21:18:54.770123 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2623/5178] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:18:54 2022] GET /compute/v2.1/servers/629522c2-4765-4e35-a6a6-9c3554b1c8c4 => generated 1366 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:18:55.795294 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-35e9919c-8be3-4b2e-8929-a5aa83cc6262 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:18:55.798099 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-35e9919c-8be3-4b2e-8929-a5aa83cc6262 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] [instance: 629522c2-4765-4e35-a6a6-9c3554b1c8c4] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:18:55.806643 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-35e9919c-8be3-4b2e-8929-a5aa83cc6262 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:18:55.807660 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-35e9919c-8be3-4b2e-8929-a5aa83cc6262 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:18:55.808810 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-35e9919c-8be3-4b2e-8929-a5aa83cc6262 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:18:55.810206 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-35e9919c-8be3-4b2e-8929-a5aa83cc6262 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:18:55.811016 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-35e9919c-8be3-4b2e-8929-a5aa83cc6262 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:18:55.811826 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-35e9919c-8be3-4b2e-8929-a5aa83cc6262 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:18:56.123092 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-35e9919c-8be3-4b2e-8929-a5aa83cc6262 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8957041987c8487099f0d89f4c64af66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9d29b90ab34abbadd21edbca637d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:18:56.136835 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-35e9919c-8be3-4b2e-8929-a5aa83cc6262 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] 10.222.0.26 "GET /compute/v2.1/servers/629522c2-4765-4e35-a6a6-9c3554b1c8c4" status: 200 len: 1556 microversion: 2.1 time: 0.342949 Oct 08 21:18:56.156513 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2556/5179] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:18:55 2022] GET /compute/v2.1/servers/629522c2-4765-4e35-a6a6-9c3554b1c8c4 => generated 1556 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:18:56.164560 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-13c131b7-73d1-49b0-b75d-24df0878c1d6 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:18:56.165131 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-13c131b7-73d1-49b0-b75d-24df0878c1d6 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] [instance: 629522c2-4765-4e35-a6a6-9c3554b1c8c4] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:18:56.187442 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-13c131b7-73d1-49b0-b75d-24df0878c1d6 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:18:56.189644 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-13c131b7-73d1-49b0-b75d-24df0878c1d6 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:18:56.190305 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-13c131b7-73d1-49b0-b75d-24df0878c1d6 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:18:56.191843 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-13c131b7-73d1-49b0-b75d-24df0878c1d6 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:18:56.192537 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-13c131b7-73d1-49b0-b75d-24df0878c1d6 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:18:56.193409 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-13c131b7-73d1-49b0-b75d-24df0878c1d6 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:18:56.464438 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-13c131b7-73d1-49b0-b75d-24df0878c1d6 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] 10.222.0.26 "GET /compute/v2.1/servers/629522c2-4765-4e35-a6a6-9c3554b1c8c4/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.304126 Oct 08 21:18:56.465095 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2624/5180] 10.222.0.26 () {58 vars in 1275 bytes} [Sat Oct 8 21:18:56 2022] GET /compute/v2.1/servers/629522c2-4765-4e35-a6a6-9c3554b1c8c4/os-interface => generated 284 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:18:57.692260 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-bf79bb7f-a1a2-473c-8637-9a29ee6c5e32 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:18:57.692891 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-bf79bb7f-a1a2-473c-8637-9a29ee6c5e32 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 2a61f287-652b-487f-9ecd-fb4d2d1eee62] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:18:57.705469 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bf79bb7f-a1a2-473c-8637-9a29ee6c5e32 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:18:57.705974 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bf79bb7f-a1a2-473c-8637-9a29ee6c5e32 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:18:57.706462 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bf79bb7f-a1a2-473c-8637-9a29ee6c5e32 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:18:57.707561 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bf79bb7f-a1a2-473c-8637-9a29ee6c5e32 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:18:57.707680 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bf79bb7f-a1a2-473c-8637-9a29ee6c5e32 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:18:57.722980 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bf79bb7f-a1a2-473c-8637-9a29ee6c5e32 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:18:58.042494 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-bd903d2a-f3ee-4d6b-a62d-d976b31fb69a req-3698d5a8-8afc-414d-8688-ea6d87735a2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "629522c2-4765-4e35-a6a6-9c3554b1c8c4", "tag": "b5e9b8d7-841b-4cc1-9d4e-eaa7852df9d5"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:18:58.064727 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-bd903d2a-f3ee-4d6b-a62d-d976b31fb69a req-3698d5a8-8afc-414d-8688-ea6d87735a2c service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:18:58.065252 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-bd903d2a-f3ee-4d6b-a62d-d976b31fb69a req-3698d5a8-8afc-414d-8688-ea6d87735a2c service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:18:58.072856 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-bd903d2a-f3ee-4d6b-a62d-d976b31fb69a req-3698d5a8-8afc-414d-8688-ea6d87735a2c service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:18:58.084079 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-bf79bb7f-a1a2-473c-8637-9a29ee6c5e32 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:18:58.095470 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-bd903d2a-f3ee-4d6b-a62d-d976b31fb69a req-3698d5a8-8afc-414d-8688-ea6d87735a2c service nova] Creating event network-changed:b5e9b8d7-841b-4cc1-9d4e-eaa7852df9d5 for instance 629522c2-4765-4e35-a6a6-9c3554b1c8c4 on nch2-master-1 Oct 08 21:18:58.101068 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-bd903d2a-f3ee-4d6b-a62d-d976b31fb69a req-3698d5a8-8afc-414d-8688-ea6d87735a2c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063405 Oct 08 21:18:58.102001 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2625/5181] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:18:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 08 21:18:58.103686 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-bf79bb7f-a1a2-473c-8637-9a29ee6c5e32 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62" status: 200 len: 1670 microversion: 2.1 time: 0.415559 Oct 08 21:18:58.117664 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2557/5182] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:18:57 2022] GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62 => generated 1670 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:18:58.133095 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-14352e4b-1da0-4267-8108-3b40f2aac66a tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-1189703466"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:18:58.137977 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-14352e4b-1da0-4267-8108-3b40f2aac66a tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 2a61f287-652b-487f-9ecd-fb4d2d1eee62] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:18:58.148092 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-14352e4b-1da0-4267-8108-3b40f2aac66a tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:18:58.148745 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-14352e4b-1da0-4267-8108-3b40f2aac66a tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:18:58.149221 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-14352e4b-1da0-4267-8108-3b40f2aac66a tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:18:58.150094 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-14352e4b-1da0-4267-8108-3b40f2aac66a tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:18:58.150562 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-14352e4b-1da0-4267-8108-3b40f2aac66a tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:18:58.151185 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-14352e4b-1da0-4267-8108-3b40f2aac66a tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:18:58.462331 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-14352e4b-1da0-4267-8108-3b40f2aac66a tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "POST /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62/action" status: 202 len: 0 microversion: 2.1 time: 0.334463 Oct 08 21:18:58.463040 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2626/5183] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:18:58 2022] POST /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62/action => generated 0 bytes in 336 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 08 21:19:01.276695 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-78e6f639-3ee7-4d41-9a65-cb66923d8985 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:19:01.279877 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-78e6f639-3ee7-4d41-9a65-cb66923d8985 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] [instance: c9f0e8ec-d9e4-453f-ab5e-4b0d95a6a7cd] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:19:01.287471 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-78e6f639-3ee7-4d41-9a65-cb66923d8985 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:01.288142 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-78e6f639-3ee7-4d41-9a65-cb66923d8985 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:01.288826 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-78e6f639-3ee7-4d41-9a65-cb66923d8985 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:01.290285 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-78e6f639-3ee7-4d41-9a65-cb66923d8985 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:01.291132 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-78e6f639-3ee7-4d41-9a65-cb66923d8985 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:01.291736 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-78e6f639-3ee7-4d41-9a65-cb66923d8985 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:01.420504 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.objects.instance [None req-78e6f639-3ee7-4d41-9a65-cb66923d8985 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lazy-loading 'services' on Instance uuid c9f0e8ec-d9e4-453f-ab5e-4b0d95a6a7cd {{(pid=140491) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 21:19:01.530839 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-78e6f639-3ee7-4d41-9a65-cb66923d8985 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] 10.222.0.26 "DELETE /compute/v2.1/servers/c9f0e8ec-d9e4-453f-ab5e-4b0d95a6a7cd/os-volume_attachments/345abd03-d885-42f6-826d-f0d74c528f9c" status: 202 len: 0 microversion: 2.1 time: 0.258151 Oct 08 21:19:01.532428 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2558/5184] 10.222.0.26 () {58 vars in 1416 bytes} [Sat Oct 8 21:19:01 2022] DELETE /compute/v2.1/servers/c9f0e8ec-d9e4-453f-ab5e-4b0d95a6a7cd/os-volume_attachments/345abd03-d885-42f6-826d-f0d74c528f9c => generated 0 bytes in 261 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 21:19:02.238126 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-3dbfe411-ba40-4a20-aad9-9cac14e4ae72 req-42b74a9a-4a16-47f1-9763-16315e43ebbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a61f287-652b-487f-9ecd-fb4d2d1eee62", "name": "network-vif-unplugged", "status": "completed", "tag": "960ff13a-d0c5-4f5c-af4b-44aec29e7c23"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:19:02.257353 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-3dbfe411-ba40-4a20-aad9-9cac14e4ae72 req-42b74a9a-4a16-47f1-9763-16315e43ebbf service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:02.266196 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-3dbfe411-ba40-4a20-aad9-9cac14e4ae72 req-42b74a9a-4a16-47f1-9763-16315e43ebbf service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:02.267543 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-3dbfe411-ba40-4a20-aad9-9cac14e4ae72 req-42b74a9a-4a16-47f1-9763-16315e43ebbf service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:02.278775 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=71,nova_cell1:INSERT=2 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:19:02.301779 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-3dbfe411-ba40-4a20-aad9-9cac14e4ae72 req-42b74a9a-4a16-47f1-9763-16315e43ebbf service nova] Creating event network-vif-unplugged:960ff13a-d0c5-4f5c-af4b-44aec29e7c23 for instance 2a61f287-652b-487f-9ecd-fb4d2d1eee62 on nch1-master-1 Oct 08 21:19:02.319726 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-3dbfe411-ba40-4a20-aad9-9cac14e4ae72 req-42b74a9a-4a16-47f1-9763-16315e43ebbf service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.079455 Oct 08 21:19:02.321640 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2627/5185] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:19:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 08 21:19:02.736358 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-40dd2be7-899e-470b-b6f5-bdbc80e5c414 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:19:02.737816 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-40dd2be7-899e-470b-b6f5-bdbc80e5c414 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] [instance: c9f0e8ec-d9e4-453f-ab5e-4b0d95a6a7cd] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:19:02.750624 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-40dd2be7-899e-470b-b6f5-bdbc80e5c414 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:02.751152 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-40dd2be7-899e-470b-b6f5-bdbc80e5c414 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:02.751623 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-40dd2be7-899e-470b-b6f5-bdbc80e5c414 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:02.752360 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-40dd2be7-899e-470b-b6f5-bdbc80e5c414 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:02.752836 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-40dd2be7-899e-470b-b6f5-bdbc80e5c414 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:02.753309 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-40dd2be7-899e-470b-b6f5-bdbc80e5c414 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:02.793994 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-40dd2be7-899e-470b-b6f5-bdbc80e5c414 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] [instance: c9f0e8ec-d9e4-453f-ab5e-4b0d95a6a7cd] Going to try to terminate instance {{(pid=140491) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 21:19:02.964350 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-40dd2be7-899e-470b-b6f5-bdbc80e5c414 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] 10.222.0.26 "DELETE /compute/v2.1/servers/c9f0e8ec-d9e4-453f-ab5e-4b0d95a6a7cd" status: 204 len: 0 microversion: 2.1 time: 0.234183 Oct 08 21:19:02.968570 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2559/5186] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:19:02 2022] DELETE /compute/v2.1/servers/c9f0e8ec-d9e4-453f-ab5e-4b0d95a6a7cd => generated 0 bytes in 236 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 21:19:02.975701 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-dcb910d1-a4ce-44de-baf5-2c9d1a07e754 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:19:02.976338 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-dcb910d1-a4ce-44de-baf5-2c9d1a07e754 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] [instance: c9f0e8ec-d9e4-453f-ab5e-4b0d95a6a7cd] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:19:02.988999 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dcb910d1-a4ce-44de-baf5-2c9d1a07e754 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:02.989908 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dcb910d1-a4ce-44de-baf5-2c9d1a07e754 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:02.990365 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dcb910d1-a4ce-44de-baf5-2c9d1a07e754 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:02.991087 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dcb910d1-a4ce-44de-baf5-2c9d1a07e754 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:02.991709 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dcb910d1-a4ce-44de-baf5-2c9d1a07e754 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:02.992294 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dcb910d1-a4ce-44de-baf5-2c9d1a07e754 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:03.224856 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-dcb910d1-a4ce-44de-baf5-2c9d1a07e754 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a292ffe2c5c41ef8d281fa525792b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdea37d91ed431aa0dc780148174e5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:19:03.238207 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-dcb910d1-a4ce-44de-baf5-2c9d1a07e754 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] 10.222.0.26 "GET /compute/v2.1/servers/c9f0e8ec-d9e4-453f-ab5e-4b0d95a6a7cd" status: 200 len: 1512 microversion: 2.1 time: 0.268402 Oct 08 21:19:03.263054 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2628/5187] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:19:02 2022] GET /compute/v2.1/servers/c9f0e8ec-d9e4-453f-ab5e-4b0d95a6a7cd => generated 1512 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:19:04.268238 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-cd94b35a-15f4-499a-9724-fdf444dcb194 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:19:04.268975 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-cd94b35a-15f4-499a-9724-fdf444dcb194 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] [instance: c9f0e8ec-d9e4-453f-ab5e-4b0d95a6a7cd] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:19:04.276582 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cd94b35a-15f4-499a-9724-fdf444dcb194 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:04.277077 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cd94b35a-15f4-499a-9724-fdf444dcb194 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:04.277548 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cd94b35a-15f4-499a-9724-fdf444dcb194 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:04.279036 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cd94b35a-15f4-499a-9724-fdf444dcb194 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:04.283375 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cd94b35a-15f4-499a-9724-fdf444dcb194 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:04.283903 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cd94b35a-15f4-499a-9724-fdf444dcb194 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:04.390683 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-de677ea3-02c7-4ecc-9bb1-b28434bfe64f req-510c17b4-ae16-43a0-b24f-f979d5e304cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a61f287-652b-487f-9ecd-fb4d2d1eee62", "name": "network-vif-plugged", "status": "completed", "tag": "960ff13a-d0c5-4f5c-af4b-44aec29e7c23"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:19:04.415740 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-de677ea3-02c7-4ecc-9bb1-b28434bfe64f req-510c17b4-ae16-43a0-b24f-f979d5e304cd service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:04.417784 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-de677ea3-02c7-4ecc-9bb1-b28434bfe64f req-510c17b4-ae16-43a0-b24f-f979d5e304cd service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:04.419402 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-de677ea3-02c7-4ecc-9bb1-b28434bfe64f req-510c17b4-ae16-43a0-b24f-f979d5e304cd service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:04.443715 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-de677ea3-02c7-4ecc-9bb1-b28434bfe64f req-510c17b4-ae16-43a0-b24f-f979d5e304cd service nova] Creating event network-vif-plugged:960ff13a-d0c5-4f5c-af4b-44aec29e7c23 for instance 2a61f287-652b-487f-9ecd-fb4d2d1eee62 on nch1-master-1 Oct 08 21:19:04.450952 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-de677ea3-02c7-4ecc-9bb1-b28434bfe64f req-510c17b4-ae16-43a0-b24f-f979d5e304cd service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065721 Oct 08 21:19:04.458815 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2629/5188] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:19:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 08 21:19:04.575112 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-cd94b35a-15f4-499a-9724-fdf444dcb194 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a292ffe2c5c41ef8d281fa525792b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdea37d91ed431aa0dc780148174e5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:19:04.584977 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-cd94b35a-15f4-499a-9724-fdf444dcb194 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] 10.222.0.26 "GET /compute/v2.1/servers/c9f0e8ec-d9e4-453f-ab5e-4b0d95a6a7cd" status: 200 len: 1512 microversion: 2.1 time: 0.320776 Oct 08 21:19:04.591245 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2560/5189] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:19:04 2022] GET /compute/v2.1/servers/c9f0e8ec-d9e4-453f-ab5e-4b0d95a6a7cd => generated 1512 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:19:05.438403 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-95c354c9-7339-4426-b357-f293a9747aad req-63b4e1c7-e082-46f8-ad89-a66ab3b19489 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9f0e8ec-d9e4-453f-ab5e-4b0d95a6a7cd", "name": "network-vif-deleted", "tag": "5c162195-694a-4d23-b4c1-2eb5a6713b41"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:19:05.463506 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-95c354c9-7339-4426-b357-f293a9747aad req-63b4e1c7-e082-46f8-ad89-a66ab3b19489 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:05.468020 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-95c354c9-7339-4426-b357-f293a9747aad req-63b4e1c7-e082-46f8-ad89-a66ab3b19489 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:05.468749 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-95c354c9-7339-4426-b357-f293a9747aad req-63b4e1c7-e082-46f8-ad89-a66ab3b19489 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:05.499105 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-95c354c9-7339-4426-b357-f293a9747aad req-63b4e1c7-e082-46f8-ad89-a66ab3b19489 service nova] Creating event network-vif-deleted:5c162195-694a-4d23-b4c1-2eb5a6713b41 for instance c9f0e8ec-d9e4-453f-ab5e-4b0d95a6a7cd on nch1-master-1 Oct 08 21:19:05.514349 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-95c354c9-7339-4426-b357-f293a9747aad req-63b4e1c7-e082-46f8-ad89-a66ab3b19489 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081169 Oct 08 21:19:05.517838 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2630/5190] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:19:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:19:05.611678 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-13b19c24-4f9f-4248-a0f1-b4cadf247514 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:19:05.612306 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-13b19c24-4f9f-4248-a0f1-b4cadf247514 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] [instance: c9f0e8ec-d9e4-453f-ab5e-4b0d95a6a7cd] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:19:05.625525 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-13b19c24-4f9f-4248-a0f1-b4cadf247514 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:05.626043 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-13b19c24-4f9f-4248-a0f1-b4cadf247514 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:05.626517 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-13b19c24-4f9f-4248-a0f1-b4cadf247514 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:05.627215 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-13b19c24-4f9f-4248-a0f1-b4cadf247514 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:05.627685 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-13b19c24-4f9f-4248-a0f1-b4cadf247514 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:05.628119 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-13b19c24-4f9f-4248-a0f1-b4cadf247514 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:05.673694 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=72,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:19:05.730470 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-13b19c24-4f9f-4248-a0f1-b4cadf247514 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:05.731508 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-13b19c24-4f9f-4248-a0f1-b4cadf247514 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:05.732113 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-13b19c24-4f9f-4248-a0f1-b4cadf247514 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:05.732753 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.objects.instance [None req-13b19c24-4f9f-4248-a0f1-b4cadf247514 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lazy-loading 'fault' on Instance uuid c9f0e8ec-d9e4-453f-ab5e-4b0d95a6a7cd {{(pid=140491) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 21:19:05.815646 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-13b19c24-4f9f-4248-a0f1-b4cadf247514 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a292ffe2c5c41ef8d281fa525792b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdea37d91ed431aa0dc780148174e5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:19:05.828844 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-13b19c24-4f9f-4248-a0f1-b4cadf247514 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] 10.222.0.26 "GET /compute/v2.1/servers/c9f0e8ec-d9e4-453f-ab5e-4b0d95a6a7cd" status: 200 len: 1308 microversion: 2.1 time: 0.220932 Oct 08 21:19:05.830637 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2561/5191] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:19:05 2022] GET /compute/v2.1/servers/c9f0e8ec-d9e4-453f-ab5e-4b0d95a6a7cd => generated 1308 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:19:06.862337 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-040730fa-5c7c-48ac-b0de-ec497d79b059 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:19:06.865488 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-040730fa-5c7c-48ac-b0de-ec497d79b059 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] [instance: c9f0e8ec-d9e4-453f-ab5e-4b0d95a6a7cd] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:19:06.888715 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-040730fa-5c7c-48ac-b0de-ec497d79b059 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:06.890444 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-040730fa-5c7c-48ac-b0de-ec497d79b059 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:06.892267 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-040730fa-5c7c-48ac-b0de-ec497d79b059 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:06.893251 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-040730fa-5c7c-48ac-b0de-ec497d79b059 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:06.893890 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-040730fa-5c7c-48ac-b0de-ec497d79b059 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:06.894500 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-040730fa-5c7c-48ac-b0de-ec497d79b059 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:06.912338 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-040730fa-5c7c-48ac-b0de-ec497d79b059 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] HTTP exception thrown: Instance c9f0e8ec-d9e4-453f-ab5e-4b0d95a6a7cd could not be found. Oct 08 21:19:06.914435 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-040730fa-5c7c-48ac-b0de-ec497d79b059 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Request method failure captured: Oct 08 21:19:06.914435 ncdv-master-1 devstack@n-api.service[140492]: request: GET /compute/v2.1/servers/c9f0e8ec-d9e4-453f-ab5e-4b0d95a6a7cd HTTP/1.1 Oct 08 21:19:06.914435 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:19:06.914435 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:19:06.914435 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:19:06.914435 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 21:19:06.914435 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:19:06.914435 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:19:06.914435 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:19:06.914435 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:19:06.914435 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeiekdWLa9yWg81OrVrEM0Ycv6Ob6kaMB5aEifVq8rp8uyJBCpsdjoCAvS0mrofHdYcQnD4XeYmmHBliIKYMdIbQjAJ0wRy7HLjKWlc1YLf7TFrBv4DtQV64TapSU-jR1A3JBkat9vt39cjCpR-7pxJkUSO0tLNnnfzz3o2gycrBxcE Oct 08 21:19:06.914435 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:19:06.914435 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:19:06.914435 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:19:06.914435 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:19:06.914435 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:19:06.914435 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:19:06.914435 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 6fdea37d91ed431aa0dc780148174e5b Oct 08 21:19:06.914435 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-VolumesSnapshotTestJSON-547814895 Oct 08 21:19:06.914435 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:19:06.914435 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:19:06.914435 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6fdea37d91ed431aa0dc780148174e5b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6fdea37d91ed431aa0dc780148174e5b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6fdea37d91ed431aa0dc780148174e5b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6fdea37d91ed431aa0dc780148174e5b"}]}] Oct 08 21:19:06.914435 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-VolumesSnapshotTestJSON-547814895 Oct 08 21:19:06.914435 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 6fdea37d91ed431aa0dc780148174e5b Oct 08 21:19:06.914435 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-547814895 Oct 08 21:19:06.914435 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-VolumesSnapshotTestJSON-547814895-project Oct 08 21:19:06.914435 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:19:06.914435 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:19:06.914435 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 3a292ffe2c5c41ef8d281fa525792b16 Oct 08 21:19:06.914435 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-VolumesSnapshotTestJSON-547814895-project Oct 08 21:19:06.914435 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 21:19:06.914435 ncdv-master-1 devstack@n-api.service[140492]: exception: Instance c9f0e8ec-d9e4-453f-ab5e-4b0d95a6a7cd could not be found. Oct 08 21:19:06.914435 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': 'c9f0e8ec-d9e4-453f-ab5e-4b0d95a6a7cd'} Oct 08 21:19:06.914435 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:19:06.914435 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:19:06.914435 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:19:06.914435 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:19:06.914435 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:19:06.914435 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:19:06.914435 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:19:06.914435 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:19:06.914435 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:19:06.914435 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:19:06.914435 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9f0e8ec-d9e4-453f-ab5e-4b0d95a6a7cd could not be found. Oct 08 21:19:06.914435 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:19:06.914435 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:19:06.914435 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:19:06.914435 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:19:06.914435 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:19:06.914435 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:19:06.914435 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:19:06.914435 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:19:06.914435 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:19:06.914435 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:19:06.914435 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:19:06.914435 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:19:06.914435 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:19:06.914435 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:19:06.914435 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:19:06.914435 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:19:06.914435 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9f0e8ec-d9e4-453f-ab5e-4b0d95a6a7cd could not be found. Oct 08 21:19:06.914435 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:19:06.914435 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:19:06.914435 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:19:06.918398 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:19:06.918398 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:19:06.918398 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:19:06.918398 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:19:06.918398 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:19:06.918398 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9f0e8ec-d9e4-453f-ab5e-4b0d95a6a7cd could not be found. Oct 08 21:19:06.918398 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:19:06.920820 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-040730fa-5c7c-48ac-b0de-ec497d79b059 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Returning 404 to user: Instance c9f0e8ec-d9e4-453f-ab5e-4b0d95a6a7cd could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:19:06.921968 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-040730fa-5c7c-48ac-b0de-ec497d79b059 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] 10.222.0.26 "GET /compute/v2.1/servers/c9f0e8ec-d9e4-453f-ab5e-4b0d95a6a7cd" status: 404 len: 111 microversion: 2.1 time: 0.073070 Oct 08 21:19:06.923066 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2631/5192] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:19:06 2022] GET /compute/v2.1/servers/c9f0e8ec-d9e4-453f-ab5e-4b0d95a6a7cd => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:19:12.307983 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-1318a387-0ad4-4508-839a-ad6ba67262b0 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-514354038", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "networks": [{"uuid": "be27d1d5-9d06-4c17-b807-a0d071b49ca7"}]}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:19:12.334167 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:19:12.419601 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.network.neutron [None req-1318a387-0ad4-4508-839a-ad6ba67262b0 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] validate_networks() for [('be27d1d5-9d06-4c17-b807-a0d071b49ca7', None, None, None, None, None)] {{(pid=140491) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 21:19:13.514217 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-1318a387-0ad4-4508-839a-ad6ba67262b0 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Flavor limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 21:19:13.515468 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-1318a387-0ad4-4508-839a-ad6ba67262b0 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Image limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 21:19:13.518776 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-1318a387-0ad4-4508-839a-ad6ba67262b0 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Flavor pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 21:19:13.519572 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-1318a387-0ad4-4508-839a-ad6ba67262b0 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Image pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 21:19:13.520178 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-1318a387-0ad4-4508-839a-ad6ba67262b0 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 21:19:13.558769 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1318a387-0ad4-4508-839a-ad6ba67262b0 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:13.561082 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1318a387-0ad4-4508-839a-ad6ba67262b0 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:13.564942 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1318a387-0ad4-4508-839a-ad6ba67262b0 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:13.565924 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1318a387-0ad4-4508-839a-ad6ba67262b0 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:13.569398 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1318a387-0ad4-4508-839a-ad6ba67262b0 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:13.570066 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1318a387-0ad4-4508-839a-ad6ba67262b0 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:13.639652 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-1318a387-0ad4-4508-839a-ad6ba67262b0 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Getting quotas for project 6fdea37d91ed431aa0dc780148174e5b. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:19:13.646351 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-1318a387-0ad4-4508-839a-ad6ba67262b0 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Getting quotas for user 3a292ffe2c5c41ef8d281fa525792b16 and project 6fdea37d91ed431aa0dc780148174e5b. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:19:13.666699 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-1318a387-0ad4-4508-839a-ad6ba67262b0 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Going to run 1 instances... {{(pid=140491) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 21:19:13.670286 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-1318a387-0ad4-4508-839a-ad6ba67262b0 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] [instance: 9f900981-d52d-48dd-8357-e4a950e600f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c508bd7f-7db9-4b2c-af7c-be54a855c355',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140491) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 21:19:13.778629 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-1318a387-0ad4-4508-839a-ad6ba67262b0 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.475682 Oct 08 21:19:13.780672 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2562/5193] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 21:19:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1482 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 08 21:19:13.793917 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-7ceeedc7-9482-4b94-b014-c1fb0353d5dc tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:19:13.794638 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-7ceeedc7-9482-4b94-b014-c1fb0353d5dc tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] [instance: 9f900981-d52d-48dd-8357-e4a950e600f7] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:19:13.807413 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=30 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:19:13.915972 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-7ceeedc7-9482-4b94-b014-c1fb0353d5dc tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a292ffe2c5c41ef8d281fa525792b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdea37d91ed431aa0dc780148174e5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:19:13.931906 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-7ceeedc7-9482-4b94-b014-c1fb0353d5dc tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] 10.222.0.26 "GET /compute/v2.1/servers/9f900981-d52d-48dd-8357-e4a950e600f7" status: 200 len: 1218 microversion: 2.1 time: 0.143508 Oct 08 21:19:13.933778 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2632/5194] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:19:13 2022] GET /compute/v2.1/servers/9f900981-d52d-48dd-8357-e4a950e600f7 => generated 1218 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:19:14.958902 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-14ba853d-aeab-4bec-aa5a-a56a9ee13769 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:19:14.959672 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-14ba853d-aeab-4bec-aa5a-a56a9ee13769 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] [instance: 9f900981-d52d-48dd-8357-e4a950e600f7] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:19:14.980181 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-14ba853d-aeab-4bec-aa5a-a56a9ee13769 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:14.980729 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-14ba853d-aeab-4bec-aa5a-a56a9ee13769 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:14.981228 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-14ba853d-aeab-4bec-aa5a-a56a9ee13769 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:14.985855 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-14ba853d-aeab-4bec-aa5a-a56a9ee13769 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:14.986346 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-14ba853d-aeab-4bec-aa5a-a56a9ee13769 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:14.986982 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-14ba853d-aeab-4bec-aa5a-a56a9ee13769 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:15.179106 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-14ba853d-aeab-4bec-aa5a-a56a9ee13769 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a292ffe2c5c41ef8d281fa525792b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdea37d91ed431aa0dc780148174e5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:19:15.191425 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-14ba853d-aeab-4bec-aa5a-a56a9ee13769 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] 10.222.0.26 "GET /compute/v2.1/servers/9f900981-d52d-48dd-8357-e4a950e600f7" status: 200 len: 1270 microversion: 2.1 time: 0.236844 Oct 08 21:19:15.193457 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2563/5195] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:19:14 2022] GET /compute/v2.1/servers/9f900981-d52d-48dd-8357-e4a950e600f7 => generated 1270 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:19:16.216356 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-aac8c040-604c-4e22-bc58-3f45cdc31300 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:19:16.216986 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-aac8c040-604c-4e22-bc58-3f45cdc31300 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] [instance: 9f900981-d52d-48dd-8357-e4a950e600f7] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:19:16.230003 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-aac8c040-604c-4e22-bc58-3f45cdc31300 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:16.230522 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-aac8c040-604c-4e22-bc58-3f45cdc31300 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:16.231525 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-aac8c040-604c-4e22-bc58-3f45cdc31300 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:16.232266 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-aac8c040-604c-4e22-bc58-3f45cdc31300 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:16.238936 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-aac8c040-604c-4e22-bc58-3f45cdc31300 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:16.242092 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-aac8c040-604c-4e22-bc58-3f45cdc31300 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:16.363110 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-aac8c040-604c-4e22-bc58-3f45cdc31300 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a292ffe2c5c41ef8d281fa525792b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdea37d91ed431aa0dc780148174e5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:19:16.379700 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-aac8c040-604c-4e22-bc58-3f45cdc31300 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] 10.222.0.26 "GET /compute/v2.1/servers/9f900981-d52d-48dd-8357-e4a950e600f7" status: 200 len: 1276 microversion: 2.1 time: 0.167520 Oct 08 21:19:16.380677 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2633/5196] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:19:16 2022] GET /compute/v2.1/servers/9f900981-d52d-48dd-8357-e4a950e600f7 => generated 1276 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:19:17.408184 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-a9f48766-e480-414f-bb59-5c03ac0ad484 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:19:17.409743 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-a9f48766-e480-414f-bb59-5c03ac0ad484 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] [instance: 9f900981-d52d-48dd-8357-e4a950e600f7] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:19:17.432620 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a9f48766-e480-414f-bb59-5c03ac0ad484 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:17.433500 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a9f48766-e480-414f-bb59-5c03ac0ad484 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:17.434306 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a9f48766-e480-414f-bb59-5c03ac0ad484 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:17.435475 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a9f48766-e480-414f-bb59-5c03ac0ad484 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:17.436063 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a9f48766-e480-414f-bb59-5c03ac0ad484 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:17.437296 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a9f48766-e480-414f-bb59-5c03ac0ad484 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:17.700136 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-a9f48766-e480-414f-bb59-5c03ac0ad484 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a292ffe2c5c41ef8d281fa525792b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdea37d91ed431aa0dc780148174e5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:19:17.713770 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-a9f48766-e480-414f-bb59-5c03ac0ad484 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] 10.222.0.26 "GET /compute/v2.1/servers/9f900981-d52d-48dd-8357-e4a950e600f7" status: 200 len: 1318 microversion: 2.1 time: 0.313139 Oct 08 21:19:17.732071 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2564/5197] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:19:17 2022] GET /compute/v2.1/servers/9f900981-d52d-48dd-8357-e4a950e600f7 => generated 1318 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:19:18.206817 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-aaa4b9db-81f5-4e5d-aec6-93b771b233f2 req-679d2fef-d33e-4a34-a9f6-37c925a80ca3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f900981-d52d-48dd-8357-e4a950e600f7", "tag": "0b66715e-2ae0-43dc-8b6d-8c6e44c12f2f"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:19:18.239178 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-aaa4b9db-81f5-4e5d-aec6-93b771b233f2 req-679d2fef-d33e-4a34-a9f6-37c925a80ca3 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:18.240099 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-aaa4b9db-81f5-4e5d-aec6-93b771b233f2 req-679d2fef-d33e-4a34-a9f6-37c925a80ca3 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:18.240861 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-aaa4b9db-81f5-4e5d-aec6-93b771b233f2 req-679d2fef-d33e-4a34-a9f6-37c925a80ca3 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:18.272522 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-aaa4b9db-81f5-4e5d-aec6-93b771b233f2 req-679d2fef-d33e-4a34-a9f6-37c925a80ca3 service nova] Creating event network-changed:0b66715e-2ae0-43dc-8b6d-8c6e44c12f2f for instance 9f900981-d52d-48dd-8357-e4a950e600f7 on nch1-master-1 Oct 08 21:19:18.283662 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-aaa4b9db-81f5-4e5d-aec6-93b771b233f2 req-679d2fef-d33e-4a34-a9f6-37c925a80ca3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077360 Oct 08 21:19:18.284464 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2634/5198] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:19:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 08 21:19:18.742694 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-b9cb4ffc-cbb0-4d9e-9a57-b2a40067f060 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:19:18.744042 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-b9cb4ffc-cbb0-4d9e-9a57-b2a40067f060 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] [instance: 9f900981-d52d-48dd-8357-e4a950e600f7] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:19:18.756358 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b9cb4ffc-cbb0-4d9e-9a57-b2a40067f060 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:18.763747 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b9cb4ffc-cbb0-4d9e-9a57-b2a40067f060 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:18.764333 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b9cb4ffc-cbb0-4d9e-9a57-b2a40067f060 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:18.765227 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b9cb4ffc-cbb0-4d9e-9a57-b2a40067f060 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:18.765951 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b9cb4ffc-cbb0-4d9e-9a57-b2a40067f060 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:18.768143 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b9cb4ffc-cbb0-4d9e-9a57-b2a40067f060 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:18.987926 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-b9cb4ffc-cbb0-4d9e-9a57-b2a40067f060 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a292ffe2c5c41ef8d281fa525792b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdea37d91ed431aa0dc780148174e5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:19:19.003209 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-b9cb4ffc-cbb0-4d9e-9a57-b2a40067f060 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] 10.222.0.26 "GET /compute/v2.1/servers/9f900981-d52d-48dd-8357-e4a950e600f7" status: 200 len: 1318 microversion: 2.1 time: 0.266674 Oct 08 21:19:19.003807 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2565/5199] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:19:18 2022] GET /compute/v2.1/servers/9f900981-d52d-48dd-8357-e4a950e600f7 => generated 1318 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:19:20.033255 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-ffbda1dd-c2af-429d-85b6-c3d52bfab8dd tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:19:20.033978 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-ffbda1dd-c2af-429d-85b6-c3d52bfab8dd tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] [instance: 9f900981-d52d-48dd-8357-e4a950e600f7] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:19:20.054689 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ffbda1dd-c2af-429d-85b6-c3d52bfab8dd tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:20.055191 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ffbda1dd-c2af-429d-85b6-c3d52bfab8dd tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:20.057861 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ffbda1dd-c2af-429d-85b6-c3d52bfab8dd tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:20.058610 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ffbda1dd-c2af-429d-85b6-c3d52bfab8dd tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:20.059606 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ffbda1dd-c2af-429d-85b6-c3d52bfab8dd tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:20.062451 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ffbda1dd-c2af-429d-85b6-c3d52bfab8dd tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:21.127734 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-ffbda1dd-c2af-429d-85b6-c3d52bfab8dd tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a292ffe2c5c41ef8d281fa525792b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdea37d91ed431aa0dc780148174e5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:19:21.138806 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-ffbda1dd-c2af-429d-85b6-c3d52bfab8dd tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] 10.222.0.26 "GET /compute/v2.1/servers/9f900981-d52d-48dd-8357-e4a950e600f7" status: 200 len: 1318 microversion: 2.1 time: 1.111915 Oct 08 21:19:21.144729 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2635/5200] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:19:20 2022] GET /compute/v2.1/servers/9f900981-d52d-48dd-8357-e4a950e600f7 => generated 1318 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:19:22.167804 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-ac2f4abb-479c-41c2-b917-ffd466a32b83 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:19:22.169238 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-ac2f4abb-479c-41c2-b917-ffd466a32b83 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] [instance: 9f900981-d52d-48dd-8357-e4a950e600f7] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:19:22.180983 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ac2f4abb-479c-41c2-b917-ffd466a32b83 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:22.182538 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ac2f4abb-479c-41c2-b917-ffd466a32b83 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:22.185780 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ac2f4abb-479c-41c2-b917-ffd466a32b83 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:22.188352 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ac2f4abb-479c-41c2-b917-ffd466a32b83 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:22.189477 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ac2f4abb-479c-41c2-b917-ffd466a32b83 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:22.195219 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ac2f4abb-479c-41c2-b917-ffd466a32b83 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:22.513585 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-ac2f4abb-479c-41c2-b917-ffd466a32b83 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a292ffe2c5c41ef8d281fa525792b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdea37d91ed431aa0dc780148174e5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:19:22.523009 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-ac2f4abb-479c-41c2-b917-ffd466a32b83 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] 10.222.0.26 "GET /compute/v2.1/servers/9f900981-d52d-48dd-8357-e4a950e600f7" status: 200 len: 1318 microversion: 2.1 time: 0.358987 Oct 08 21:19:22.526703 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2566/5201] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:19:22 2022] GET /compute/v2.1/servers/9f900981-d52d-48dd-8357-e4a950e600f7 => generated 1318 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:19:23.560990 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-253e88d9-24bd-49cf-84fb-ec327dcfaa00 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:19:23.561711 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-253e88d9-24bd-49cf-84fb-ec327dcfaa00 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] [instance: 9f900981-d52d-48dd-8357-e4a950e600f7] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:19:23.582340 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-253e88d9-24bd-49cf-84fb-ec327dcfaa00 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:23.582943 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-253e88d9-24bd-49cf-84fb-ec327dcfaa00 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:23.583667 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-253e88d9-24bd-49cf-84fb-ec327dcfaa00 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:23.584728 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-253e88d9-24bd-49cf-84fb-ec327dcfaa00 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:23.586023 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-253e88d9-24bd-49cf-84fb-ec327dcfaa00 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:23.586633 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-253e88d9-24bd-49cf-84fb-ec327dcfaa00 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:23.711482 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c5581645-834d-4d15-a0e5-918ca6c9f76f tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:19:23.713482 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-c5581645-834d-4d15-a0e5-918ca6c9f76f tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 2a61f287-652b-487f-9ecd-fb4d2d1eee62] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:19:23.718757 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=2 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:19:23.720789 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=6 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:19:23.757507 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c5581645-834d-4d15-a0e5-918ca6c9f76f tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:23.758898 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c5581645-834d-4d15-a0e5-918ca6c9f76f tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:23.760208 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c5581645-834d-4d15-a0e5-918ca6c9f76f tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:23.761323 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c5581645-834d-4d15-a0e5-918ca6c9f76f tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:23.766420 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c5581645-834d-4d15-a0e5-918ca6c9f76f tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:23.767287 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c5581645-834d-4d15-a0e5-918ca6c9f76f tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:23.930769 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=2 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:19:23.998349 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-253e88d9-24bd-49cf-84fb-ec327dcfaa00 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a292ffe2c5c41ef8d281fa525792b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdea37d91ed431aa0dc780148174e5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:19:24.023689 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-253e88d9-24bd-49cf-84fb-ec327dcfaa00 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] 10.222.0.26 "GET /compute/v2.1/servers/9f900981-d52d-48dd-8357-e4a950e600f7" status: 200 len: 1318 microversion: 2.1 time: 0.479179 Oct 08 21:19:24.025501 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2636/5202] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:19:23 2022] GET /compute/v2.1/servers/9f900981-d52d-48dd-8357-e4a950e600f7 => generated 1318 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:19:24.071319 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-c5581645-834d-4d15-a0e5-918ca6c9f76f tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:19:24.080884 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-c5581645-834d-4d15-a0e5-918ca6c9f76f tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62" status: 200 len: 1670 microversion: 2.1 time: 0.373429 Oct 08 21:19:24.081525 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2567/5203] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:19:23 2022] GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62 => generated 1670 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:19:24.107464 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-0c54f914-25e4-4b04-9b91-5b2b97384f50 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-1665035956"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:19:24.111350 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-0c54f914-25e4-4b04-9b91-5b2b97384f50 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 2a61f287-652b-487f-9ecd-fb4d2d1eee62] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:19:24.123492 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0c54f914-25e4-4b04-9b91-5b2b97384f50 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:24.124358 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0c54f914-25e4-4b04-9b91-5b2b97384f50 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:24.124999 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0c54f914-25e4-4b04-9b91-5b2b97384f50 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:24.126011 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0c54f914-25e4-4b04-9b91-5b2b97384f50 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:24.127111 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0c54f914-25e4-4b04-9b91-5b2b97384f50 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:24.127821 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0c54f914-25e4-4b04-9b91-5b2b97384f50 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:24.266022 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-a7a03eb5-0632-4a54-9ab8-876444c3f404 req-3443d567-d5fe-4b3f-ad46-53dfc1a09808 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f900981-d52d-48dd-8357-e4a950e600f7", "name": "network-vif-plugged", "status": "completed", "tag": "0b66715e-2ae0-43dc-8b6d-8c6e44c12f2f"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:19:24.286797 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-a7a03eb5-0632-4a54-9ab8-876444c3f404 req-3443d567-d5fe-4b3f-ad46-53dfc1a09808 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:24.289311 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-a7a03eb5-0632-4a54-9ab8-876444c3f404 req-3443d567-d5fe-4b3f-ad46-53dfc1a09808 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:24.289770 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-a7a03eb5-0632-4a54-9ab8-876444c3f404 req-3443d567-d5fe-4b3f-ad46-53dfc1a09808 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:24.331872 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-a7a03eb5-0632-4a54-9ab8-876444c3f404 req-3443d567-d5fe-4b3f-ad46-53dfc1a09808 service nova] Creating event network-vif-plugged:0b66715e-2ae0-43dc-8b6d-8c6e44c12f2f for instance 9f900981-d52d-48dd-8357-e4a950e600f7 on nch1-master-1 Oct 08 21:19:24.345132 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-a7a03eb5-0632-4a54-9ab8-876444c3f404 req-3443d567-d5fe-4b3f-ad46-53dfc1a09808 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083759 Oct 08 21:19:24.347685 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2568/5204] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:19:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 08 21:19:24.503288 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-0c54f914-25e4-4b04-9b91-5b2b97384f50 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "POST /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62/action" status: 202 len: 0 microversion: 2.1 time: 0.400568 Oct 08 21:19:24.504096 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2637/5205] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:19:24 2022] POST /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62/action => generated 0 bytes in 404 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 08 21:19:24.515040 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-98e9c57f-7107-43c0-b26b-0f5e2c8a40fc tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:19:24.515882 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-98e9c57f-7107-43c0-b26b-0f5e2c8a40fc tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 2a61f287-652b-487f-9ecd-fb4d2d1eee62] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:19:24.523602 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-98e9c57f-7107-43c0-b26b-0f5e2c8a40fc tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:24.524445 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-98e9c57f-7107-43c0-b26b-0f5e2c8a40fc tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:24.524992 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-98e9c57f-7107-43c0-b26b-0f5e2c8a40fc tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:24.525998 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-98e9c57f-7107-43c0-b26b-0f5e2c8a40fc tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:24.526719 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-98e9c57f-7107-43c0-b26b-0f5e2c8a40fc tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:24.528029 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-98e9c57f-7107-43c0-b26b-0f5e2c8a40fc tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:24.727790 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-98e9c57f-7107-43c0-b26b-0f5e2c8a40fc tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:19:24.740099 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-98e9c57f-7107-43c0-b26b-0f5e2c8a40fc tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62" status: 200 len: 1680 microversion: 2.1 time: 0.230741 Oct 08 21:19:24.741095 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2569/5206] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:19:24 2022] GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62 => generated 1680 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:19:25.049473 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-169bca75-9d2f-4808-afa6-8b152b49da6e tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:19:25.050418 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-169bca75-9d2f-4808-afa6-8b152b49da6e tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] [instance: 9f900981-d52d-48dd-8357-e4a950e600f7] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:19:25.062471 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-169bca75-9d2f-4808-afa6-8b152b49da6e tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:25.068114 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-169bca75-9d2f-4808-afa6-8b152b49da6e tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:25.068571 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-169bca75-9d2f-4808-afa6-8b152b49da6e tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:25.070206 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-169bca75-9d2f-4808-afa6-8b152b49da6e tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:25.070795 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-169bca75-9d2f-4808-afa6-8b152b49da6e tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:25.072164 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-169bca75-9d2f-4808-afa6-8b152b49da6e tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:25.245371 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-169bca75-9d2f-4808-afa6-8b152b49da6e tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a292ffe2c5c41ef8d281fa525792b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdea37d91ed431aa0dc780148174e5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:19:25.272533 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-169bca75-9d2f-4808-afa6-8b152b49da6e tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] 10.222.0.26 "GET /compute/v2.1/servers/9f900981-d52d-48dd-8357-e4a950e600f7" status: 200 len: 1318 microversion: 2.1 time: 0.227807 Oct 08 21:19:25.276122 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2638/5207] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:19:25 2022] GET /compute/v2.1/servers/9f900981-d52d-48dd-8357-e4a950e600f7 => generated 1318 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:19:25.765555 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-45add9ab-b400-42f8-9987-a0db479e9a36 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:19:25.766264 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-45add9ab-b400-42f8-9987-a0db479e9a36 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 2a61f287-652b-487f-9ecd-fb4d2d1eee62] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:19:25.774388 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-45add9ab-b400-42f8-9987-a0db479e9a36 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:25.774898 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-45add9ab-b400-42f8-9987-a0db479e9a36 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:25.775486 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-45add9ab-b400-42f8-9987-a0db479e9a36 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:25.776225 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-45add9ab-b400-42f8-9987-a0db479e9a36 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:25.776774 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-45add9ab-b400-42f8-9987-a0db479e9a36 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:25.777918 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-45add9ab-b400-42f8-9987-a0db479e9a36 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:25.919796 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-45add9ab-b400-42f8-9987-a0db479e9a36 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:19:25.929675 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-45add9ab-b400-42f8-9987-a0db479e9a36 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62" status: 200 len: 1680 microversion: 2.1 time: 0.168254 Oct 08 21:19:25.940675 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2570/5208] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:19:25 2022] GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62 => generated 1680 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:19:26.301352 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-07c6902a-dc25-48c8-b70b-d29bcca3f6cc tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:19:26.302382 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-07c6902a-dc25-48c8-b70b-d29bcca3f6cc tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] [instance: 9f900981-d52d-48dd-8357-e4a950e600f7] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:19:26.310221 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-07c6902a-dc25-48c8-b70b-d29bcca3f6cc tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:26.310875 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-07c6902a-dc25-48c8-b70b-d29bcca3f6cc tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:26.311509 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-07c6902a-dc25-48c8-b70b-d29bcca3f6cc tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:26.312924 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-07c6902a-dc25-48c8-b70b-d29bcca3f6cc tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:26.313560 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-07c6902a-dc25-48c8-b70b-d29bcca3f6cc tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:26.314248 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-07c6902a-dc25-48c8-b70b-d29bcca3f6cc tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:26.477683 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-07c6902a-dc25-48c8-b70b-d29bcca3f6cc tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a292ffe2c5c41ef8d281fa525792b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdea37d91ed431aa0dc780148174e5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:19:26.487704 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-07c6902a-dc25-48c8-b70b-d29bcca3f6cc tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] 10.222.0.26 "GET /compute/v2.1/servers/9f900981-d52d-48dd-8357-e4a950e600f7" status: 200 len: 1507 microversion: 2.1 time: 0.192798 Oct 08 21:19:26.488710 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2639/5209] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:19:26 2022] GET /compute/v2.1/servers/9f900981-d52d-48dd-8357-e4a950e600f7 => generated 1507 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:19:26.516902 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-b25eac38-e0d8-49c7-85a0-a35af98d9ae9 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e6e294ba-6781-4b55-bc1c-d34d92ef1ea3", "device": "/dev/sdb"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:19:26.520208 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-b25eac38-e0d8-49c7-85a0-a35af98d9ae9 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] [instance: 9f900981-d52d-48dd-8357-e4a950e600f7] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:19:26.526738 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b25eac38-e0d8-49c7-85a0-a35af98d9ae9 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:26.527247 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b25eac38-e0d8-49c7-85a0-a35af98d9ae9 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:26.527736 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b25eac38-e0d8-49c7-85a0-a35af98d9ae9 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:26.528622 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b25eac38-e0d8-49c7-85a0-a35af98d9ae9 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:26.529104 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b25eac38-e0d8-49c7-85a0-a35af98d9ae9 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:26.529574 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b25eac38-e0d8-49c7-85a0-a35af98d9ae9 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:26.912820 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-b25eac38-e0d8-49c7-85a0-a35af98d9ae9 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] 10.222.0.26 "POST /compute/v2.1/servers/9f900981-d52d-48dd-8357-e4a950e600f7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.400672 Oct 08 21:19:26.914007 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2571/5210] 10.222.0.26 () {60 vars in 1323 bytes} [Sat Oct 8 21:19:26 2022] POST /compute/v2.1/servers/9f900981-d52d-48dd-8357-e4a950e600f7/os-volume_attachments => generated 194 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:19:26.954111 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-96764866-ed51-41ef-b92d-7bfafe7680d1 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:19:26.955426 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-96764866-ed51-41ef-b92d-7bfafe7680d1 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 2a61f287-652b-487f-9ecd-fb4d2d1eee62] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:19:26.962913 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-96764866-ed51-41ef-b92d-7bfafe7680d1 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:26.963611 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-96764866-ed51-41ef-b92d-7bfafe7680d1 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:26.963933 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-96764866-ed51-41ef-b92d-7bfafe7680d1 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:26.965102 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-96764866-ed51-41ef-b92d-7bfafe7680d1 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:26.966083 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-96764866-ed51-41ef-b92d-7bfafe7680d1 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:26.966893 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-96764866-ed51-41ef-b92d-7bfafe7680d1 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:27.174843 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-96764866-ed51-41ef-b92d-7bfafe7680d1 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:19:27.186271 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-96764866-ed51-41ef-b92d-7bfafe7680d1 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62" status: 200 len: 1688 microversion: 2.1 time: 0.237700 Oct 08 21:19:27.186865 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2640/5211] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:19:26 2022] GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62 => generated 1688 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:19:28.212677 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-b1fbb686-7221-47bf-b98e-b196fead2724 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:19:28.214173 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-b1fbb686-7221-47bf-b98e-b196fead2724 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 2a61f287-652b-487f-9ecd-fb4d2d1eee62] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:19:28.234568 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b1fbb686-7221-47bf-b98e-b196fead2724 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:28.235510 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b1fbb686-7221-47bf-b98e-b196fead2724 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:28.236486 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b1fbb686-7221-47bf-b98e-b196fead2724 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:28.244512 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b1fbb686-7221-47bf-b98e-b196fead2724 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:28.245888 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b1fbb686-7221-47bf-b98e-b196fead2724 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:28.248149 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b1fbb686-7221-47bf-b98e-b196fead2724 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:28.302961 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-2a901e6b-4f49-4a53-9b66-7a224a658589 req-462a9b2c-7fa9-46f9-85a3-dec4b736c3b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a61f287-652b-487f-9ecd-fb4d2d1eee62", "name": "network-vif-unplugged", "status": "completed", "tag": "960ff13a-d0c5-4f5c-af4b-44aec29e7c23"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:19:28.326300 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-2a901e6b-4f49-4a53-9b66-7a224a658589 req-462a9b2c-7fa9-46f9-85a3-dec4b736c3b8 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:28.327904 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-2a901e6b-4f49-4a53-9b66-7a224a658589 req-462a9b2c-7fa9-46f9-85a3-dec4b736c3b8 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:28.329578 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-2a901e6b-4f49-4a53-9b66-7a224a658589 req-462a9b2c-7fa9-46f9-85a3-dec4b736c3b8 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:28.346463 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-2a901e6b-4f49-4a53-9b66-7a224a658589 req-462a9b2c-7fa9-46f9-85a3-dec4b736c3b8 service nova] Creating event network-vif-unplugged:960ff13a-d0c5-4f5c-af4b-44aec29e7c23 for instance 2a61f287-652b-487f-9ecd-fb4d2d1eee62 on nch1-master-1 Oct 08 21:19:28.355045 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-2a901e6b-4f49-4a53-9b66-7a224a658589 req-462a9b2c-7fa9-46f9-85a3-dec4b736c3b8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.058325 Oct 08 21:19:28.356758 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2641/5212] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:19:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 08 21:19:28.545162 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-b1fbb686-7221-47bf-b98e-b196fead2724 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:19:28.553995 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-b1fbb686-7221-47bf-b98e-b196fead2724 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62" status: 200 len: 1688 microversion: 2.1 time: 0.346383 Oct 08 21:19:28.555030 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2572/5213] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:19:28 2022] GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62 => generated 1688 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:19:29.584502 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-07108797-6da9-46b8-823d-0f57a02e86e2 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:19:29.587404 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-07108797-6da9-46b8-823d-0f57a02e86e2 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 2a61f287-652b-487f-9ecd-fb4d2d1eee62] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:19:29.611751 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-07108797-6da9-46b8-823d-0f57a02e86e2 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:29.612472 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-07108797-6da9-46b8-823d-0f57a02e86e2 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:29.613168 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-07108797-6da9-46b8-823d-0f57a02e86e2 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:29.615967 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-07108797-6da9-46b8-823d-0f57a02e86e2 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:29.617216 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-07108797-6da9-46b8-823d-0f57a02e86e2 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:29.618992 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-07108797-6da9-46b8-823d-0f57a02e86e2 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:29.960457 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-07108797-6da9-46b8-823d-0f57a02e86e2 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:19:29.974549 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-07108797-6da9-46b8-823d-0f57a02e86e2 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62" status: 200 len: 1683 microversion: 2.1 time: 0.397193 Oct 08 21:19:29.987969 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2642/5214] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:19:29 2022] GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62 => generated 1683 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:19:30.478574 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-ecff6cab-1d31-4e19-8ced-b02f15b0d117 req-99e94eab-f53a-43ed-b77c-97620e194ca8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a61f287-652b-487f-9ecd-fb4d2d1eee62", "name": "network-vif-plugged", "status": "completed", "tag": "960ff13a-d0c5-4f5c-af4b-44aec29e7c23"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:19:30.513551 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-ecff6cab-1d31-4e19-8ced-b02f15b0d117 req-99e94eab-f53a-43ed-b77c-97620e194ca8 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:30.521391 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-ecff6cab-1d31-4e19-8ced-b02f15b0d117 req-99e94eab-f53a-43ed-b77c-97620e194ca8 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:30.523344 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-ecff6cab-1d31-4e19-8ced-b02f15b0d117 req-99e94eab-f53a-43ed-b77c-97620e194ca8 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:30.577981 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-ecff6cab-1d31-4e19-8ced-b02f15b0d117 req-99e94eab-f53a-43ed-b77c-97620e194ca8 service nova] Creating event network-vif-plugged:960ff13a-d0c5-4f5c-af4b-44aec29e7c23 for instance 2a61f287-652b-487f-9ecd-fb4d2d1eee62 on nch1-master-1 Oct 08 21:19:30.597884 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-ecff6cab-1d31-4e19-8ced-b02f15b0d117 req-99e94eab-f53a-43ed-b77c-97620e194ca8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128456 Oct 08 21:19:30.599833 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2573/5215] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:19:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:19:31.010982 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-1e1298e0-5131-4cd8-941f-b7ac5dc74471 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:19:31.011746 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-1e1298e0-5131-4cd8-941f-b7ac5dc74471 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 2a61f287-652b-487f-9ecd-fb4d2d1eee62] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:19:31.024158 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1e1298e0-5131-4cd8-941f-b7ac5dc74471 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:31.024895 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1e1298e0-5131-4cd8-941f-b7ac5dc74471 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:31.025527 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1e1298e0-5131-4cd8-941f-b7ac5dc74471 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:31.026407 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1e1298e0-5131-4cd8-941f-b7ac5dc74471 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:31.030063 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1e1298e0-5131-4cd8-941f-b7ac5dc74471 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:31.030513 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1e1298e0-5131-4cd8-941f-b7ac5dc74471 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:31.347801 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-1e1298e0-5131-4cd8-941f-b7ac5dc74471 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:19:31.370198 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-1e1298e0-5131-4cd8-941f-b7ac5dc74471 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62" status: 200 len: 1683 microversion: 2.1 time: 0.361390 Oct 08 21:19:31.376283 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2643/5216] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:19:31 2022] GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62 => generated 1683 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:19:31.704712 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-43eb684c-afa8-434d-a6df-fdc29826aa56 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:19:31.705265 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-43eb684c-afa8-434d-a6df-fdc29826aa56 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] [instance: 629522c2-4765-4e35-a6a6-9c3554b1c8c4] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:19:31.715483 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-43eb684c-afa8-434d-a6df-fdc29826aa56 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:31.716364 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-43eb684c-afa8-434d-a6df-fdc29826aa56 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:31.717315 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-43eb684c-afa8-434d-a6df-fdc29826aa56 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:31.718256 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-43eb684c-afa8-434d-a6df-fdc29826aa56 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:31.718939 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-43eb684c-afa8-434d-a6df-fdc29826aa56 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:31.719607 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-43eb684c-afa8-434d-a6df-fdc29826aa56 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:31.751702 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-43eb684c-afa8-434d-a6df-fdc29826aa56 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] 10.222.0.26 "GET /compute/v2.1/servers/629522c2-4765-4e35-a6a6-9c3554b1c8c4/ips" status: 200 len: 149 microversion: 2.1 time: 0.052206 Oct 08 21:19:31.753770 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2574/5217] 10.222.0.26 () {58 vars in 1248 bytes} [Sat Oct 8 21:19:31 2022] GET /compute/v2.1/servers/629522c2-4765-4e35-a6a6-9c3554b1c8c4/ips => generated 149 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:19:32.403900 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-eb04a683-b1a0-4ac9-8af0-f99dfee416c1 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:19:32.406020 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-eb04a683-b1a0-4ac9-8af0-f99dfee416c1 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 2a61f287-652b-487f-9ecd-fb4d2d1eee62] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:19:32.421581 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-eb04a683-b1a0-4ac9-8af0-f99dfee416c1 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:32.423537 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-eb04a683-b1a0-4ac9-8af0-f99dfee416c1 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:32.424128 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-eb04a683-b1a0-4ac9-8af0-f99dfee416c1 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:32.424991 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-eb04a683-b1a0-4ac9-8af0-f99dfee416c1 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:32.427797 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-eb04a683-b1a0-4ac9-8af0-f99dfee416c1 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:32.428373 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-eb04a683-b1a0-4ac9-8af0-f99dfee416c1 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:32.766639 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-eb04a683-b1a0-4ac9-8af0-f99dfee416c1 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:19:32.779828 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-eb04a683-b1a0-4ac9-8af0-f99dfee416c1 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62" status: 200 len: 1683 microversion: 2.1 time: 0.381052 Oct 08 21:19:32.785142 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2644/5218] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:19:32 2022] GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62 => generated 1683 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:19:33.582839 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-50367f4d-57ad-43f7-88d9-c510b973704b tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d458bc31-f884-43a4-91ca-db2ca3bc5e66"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:19:33.585357 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-50367f4d-57ad-43f7-88d9-c510b973704b tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] [instance: 629522c2-4765-4e35-a6a6-9c3554b1c8c4] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:19:33.599227 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-50367f4d-57ad-43f7-88d9-c510b973704b tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:33.600656 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-50367f4d-57ad-43f7-88d9-c510b973704b tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:33.601731 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-50367f4d-57ad-43f7-88d9-c510b973704b tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:33.604851 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-50367f4d-57ad-43f7-88d9-c510b973704b tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:33.605916 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-50367f4d-57ad-43f7-88d9-c510b973704b tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:33.606601 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-50367f4d-57ad-43f7-88d9-c510b973704b tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:33.804878 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-115f2976-4180-49ee-9c0e-9749376318f7 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:19:33.806153 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-115f2976-4180-49ee-9c0e-9749376318f7 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 2a61f287-652b-487f-9ecd-fb4d2d1eee62] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:19:33.826745 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-115f2976-4180-49ee-9c0e-9749376318f7 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:33.828195 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-115f2976-4180-49ee-9c0e-9749376318f7 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:33.828684 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-115f2976-4180-49ee-9c0e-9749376318f7 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:33.829953 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-115f2976-4180-49ee-9c0e-9749376318f7 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:33.830433 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-115f2976-4180-49ee-9c0e-9749376318f7 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:33.830881 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-115f2976-4180-49ee-9c0e-9749376318f7 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:33.834034 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:19:34.134733 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-115f2976-4180-49ee-9c0e-9749376318f7 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:19:34.145789 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-115f2976-4180-49ee-9c0e-9749376318f7 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62" status: 200 len: 1683 microversion: 2.1 time: 0.344714 Oct 08 21:19:34.148059 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2645/5219] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:19:33 2022] GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62 => generated 1683 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:19:34.150003 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-50367f4d-57ad-43f7-88d9-c510b973704b tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] 10.222.0.26 "POST /compute/v2.1/servers/629522c2-4765-4e35-a6a6-9c3554b1c8c4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.569050 Oct 08 21:19:34.172203 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2575/5220] 10.222.0.26 () {60 vars in 1323 bytes} [Sat Oct 8 21:19:33 2022] POST /compute/v2.1/servers/629522c2-4765-4e35-a6a6-9c3554b1c8c4/os-volume_attachments => generated 194 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:19:35.171303 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-64f25450-b812-47a2-9dcc-bb92b779f557 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:19:35.172032 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-64f25450-b812-47a2-9dcc-bb92b779f557 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 2a61f287-652b-487f-9ecd-fb4d2d1eee62] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:19:35.196782 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-64f25450-b812-47a2-9dcc-bb92b779f557 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:35.204858 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-64f25450-b812-47a2-9dcc-bb92b779f557 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:35.205587 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-64f25450-b812-47a2-9dcc-bb92b779f557 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:35.211327 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-64f25450-b812-47a2-9dcc-bb92b779f557 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:35.213027 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-64f25450-b812-47a2-9dcc-bb92b779f557 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:35.213653 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-64f25450-b812-47a2-9dcc-bb92b779f557 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:35.528027 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-64f25450-b812-47a2-9dcc-bb92b779f557 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:19:35.537470 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-64f25450-b812-47a2-9dcc-bb92b779f557 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62" status: 200 len: 1683 microversion: 2.1 time: 0.370783 Oct 08 21:19:35.540476 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2646/5221] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:19:35 2022] GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62 => generated 1683 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:19:36.567749 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-0eb95a68-9da5-449e-bf61-392e432e765a tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:19:36.569322 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-0eb95a68-9da5-449e-bf61-392e432e765a tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 2a61f287-652b-487f-9ecd-fb4d2d1eee62] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:19:36.585046 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0eb95a68-9da5-449e-bf61-392e432e765a tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:36.587867 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0eb95a68-9da5-449e-bf61-392e432e765a tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:36.589247 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0eb95a68-9da5-449e-bf61-392e432e765a tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:36.592010 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0eb95a68-9da5-449e-bf61-392e432e765a tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:36.592611 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0eb95a68-9da5-449e-bf61-392e432e765a tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:36.594417 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0eb95a68-9da5-449e-bf61-392e432e765a tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:36.608229 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:19:36.798418 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-0eb95a68-9da5-449e-bf61-392e432e765a tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:19:36.808729 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-0eb95a68-9da5-449e-bf61-392e432e765a tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62" status: 200 len: 1683 microversion: 2.1 time: 0.246494 Oct 08 21:19:36.810356 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2576/5222] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:19:36 2022] GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62 => generated 1683 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:19:37.706796 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-8ccbe1d9-4f2f-4a0f-828d-fdf26b363017 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1004001551", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "networks": [{"uuid": "2b27d72e-40c0-426d-b750-7dc0631117e4"}]}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:19:37.798005 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.network.neutron [None req-8ccbe1d9-4f2f-4a0f-828d-fdf26b363017 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] validate_networks() for [('2b27d72e-40c0-426d-b750-7dc0631117e4', None, None, None, None, None)] {{(pid=140492) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 21:19:37.838657 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-6fb841c0-c4a1-41d7-9d40-c0196fa5d451 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:19:37.840039 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-6fb841c0-c4a1-41d7-9d40-c0196fa5d451 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 2a61f287-652b-487f-9ecd-fb4d2d1eee62] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:19:37.850618 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6fb841c0-c4a1-41d7-9d40-c0196fa5d451 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:37.851487 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6fb841c0-c4a1-41d7-9d40-c0196fa5d451 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:37.852338 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6fb841c0-c4a1-41d7-9d40-c0196fa5d451 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:37.855269 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6fb841c0-c4a1-41d7-9d40-c0196fa5d451 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:37.857454 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6fb841c0-c4a1-41d7-9d40-c0196fa5d451 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:37.858312 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6fb841c0-c4a1-41d7-9d40-c0196fa5d451 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:38.205456 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-6fb841c0-c4a1-41d7-9d40-c0196fa5d451 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:19:38.217329 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-6fb841c0-c4a1-41d7-9d40-c0196fa5d451 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62" status: 200 len: 1683 microversion: 2.1 time: 0.385634 Oct 08 21:19:38.227050 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2577/5223] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:19:37 2022] GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62 => generated 1683 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:19:38.469928 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-8ccbe1d9-4f2f-4a0f-828d-fdf26b363017 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Flavor limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 21:19:38.471561 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-8ccbe1d9-4f2f-4a0f-828d-fdf26b363017 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Image limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 21:19:38.472061 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-8ccbe1d9-4f2f-4a0f-828d-fdf26b363017 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Flavor pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 21:19:38.472483 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-8ccbe1d9-4f2f-4a0f-828d-fdf26b363017 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Image pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 21:19:38.473060 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-8ccbe1d9-4f2f-4a0f-828d-fdf26b363017 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 21:19:38.491762 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8ccbe1d9-4f2f-4a0f-828d-fdf26b363017 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:38.492265 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8ccbe1d9-4f2f-4a0f-828d-fdf26b363017 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:38.492707 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8ccbe1d9-4f2f-4a0f-828d-fdf26b363017 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:38.497043 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8ccbe1d9-4f2f-4a0f-828d-fdf26b363017 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:38.497567 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8ccbe1d9-4f2f-4a0f-828d-fdf26b363017 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:38.498015 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8ccbe1d9-4f2f-4a0f-828d-fdf26b363017 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:38.534747 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-8ccbe1d9-4f2f-4a0f-828d-fdf26b363017 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Getting quotas for project 2f564837d8eb4b3192109d0dfc9a6fab. Resources: {'cores', 'instances', 'ram'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:19:38.560410 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-8ccbe1d9-4f2f-4a0f-828d-fdf26b363017 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Getting quotas for user 537b77eca97d4c1395eeb164bc5e7205 and project 2f564837d8eb4b3192109d0dfc9a6fab. Resources: {'cores', 'instances', 'ram'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:19:38.577509 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-8ccbe1d9-4f2f-4a0f-828d-fdf26b363017 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Going to run 1 instances... {{(pid=140492) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 21:19:38.580635 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-8ccbe1d9-4f2f-4a0f-828d-fdf26b363017 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] [instance: b7ffbec5-a184-4436-a26c-2188339770cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c508bd7f-7db9-4b2c-af7c-be54a855c355',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140492) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 21:19:38.689894 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-8ccbe1d9-4f2f-4a0f-828d-fdf26b363017 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.986918 Oct 08 21:19:38.691267 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2647/5224] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 21:19:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 990 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 08 21:19:38.702933 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-42dfb1a8-68e8-453a-ace1-3684c428ca81 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:19:38.704383 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-42dfb1a8-68e8-453a-ace1-3684c428ca81 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] [instance: b7ffbec5-a184-4436-a26c-2188339770cd] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:19:38.764474 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-f0410730-db9a-4a76-b723-9641ba3998da tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:19:38.765626 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-f0410730-db9a-4a76-b723-9641ba3998da tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] [instance: 629522c2-4765-4e35-a6a6-9c3554b1c8c4] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:19:38.773779 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f0410730-db9a-4a76-b723-9641ba3998da tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:38.780801 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f0410730-db9a-4a76-b723-9641ba3998da tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:38.781951 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f0410730-db9a-4a76-b723-9641ba3998da tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:38.783158 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f0410730-db9a-4a76-b723-9641ba3998da tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:38.783845 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f0410730-db9a-4a76-b723-9641ba3998da tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:38.784504 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f0410730-db9a-4a76-b723-9641ba3998da tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:38.869649 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-42dfb1a8-68e8-453a-ace1-3684c428ca81 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537b77eca97d4c1395eeb164bc5e7205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f564837d8eb4b3192109d0dfc9a6fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:19:38.885473 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-42dfb1a8-68e8-453a-ace1-3684c428ca81 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] 10.222.0.26 "GET /compute/v2.1/servers/b7ffbec5-a184-4436-a26c-2188339770cd" status: 200 len: 1214 microversion: 2.1 time: 0.187114 Oct 08 21:19:38.886388 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2578/5225] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:19:38 2022] GET /compute/v2.1/servers/b7ffbec5-a184-4436-a26c-2188339770cd => generated 1214 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:19:39.009805 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.objects.instance [None req-f0410730-db9a-4a76-b723-9641ba3998da tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lazy-loading 'services' on Instance uuid 629522c2-4765-4e35-a6a6-9c3554b1c8c4 {{(pid=140492) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 21:19:39.200852 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-f0410730-db9a-4a76-b723-9641ba3998da tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] 10.222.0.26 "DELETE /compute/v2.1/servers/629522c2-4765-4e35-a6a6-9c3554b1c8c4/os-volume_attachments/d458bc31-f884-43a4-91ca-db2ca3bc5e66" status: 202 len: 0 microversion: 2.1 time: 0.440634 Oct 08 21:19:39.201933 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2648/5226] 10.222.0.26 () {58 vars in 1416 bytes} [Sat Oct 8 21:19:38 2022] DELETE /compute/v2.1/servers/629522c2-4765-4e35-a6a6-9c3554b1c8c4/os-volume_attachments/d458bc31-f884-43a4-91ca-db2ca3bc5e66 => generated 0 bytes in 443 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 21:19:39.212324 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-aa7f5228-43ed-4e38-98f6-fbaafab8eb42 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:19:39.216013 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-aa7f5228-43ed-4e38-98f6-fbaafab8eb42 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] [instance: 629522c2-4765-4e35-a6a6-9c3554b1c8c4] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:19:39.224614 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-aa7f5228-43ed-4e38-98f6-fbaafab8eb42 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:39.224614 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-aa7f5228-43ed-4e38-98f6-fbaafab8eb42 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:39.224614 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-aa7f5228-43ed-4e38-98f6-fbaafab8eb42 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:39.226085 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-aa7f5228-43ed-4e38-98f6-fbaafab8eb42 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:39.226853 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-aa7f5228-43ed-4e38-98f6-fbaafab8eb42 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:39.227836 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-aa7f5228-43ed-4e38-98f6-fbaafab8eb42 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:39.270372 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-1da48b5b-5a7e-4d37-8bcf-fc529c82d079 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:19:39.272203 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-1da48b5b-5a7e-4d37-8bcf-fc529c82d079 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 2a61f287-652b-487f-9ecd-fb4d2d1eee62] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:19:39.299064 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1da48b5b-5a7e-4d37-8bcf-fc529c82d079 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:39.300606 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1da48b5b-5a7e-4d37-8bcf-fc529c82d079 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:39.306327 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1da48b5b-5a7e-4d37-8bcf-fc529c82d079 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:39.307721 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1da48b5b-5a7e-4d37-8bcf-fc529c82d079 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:39.309630 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1da48b5b-5a7e-4d37-8bcf-fc529c82d079 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:39.310324 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1da48b5b-5a7e-4d37-8bcf-fc529c82d079 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:39.360379 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-aa7f5228-43ed-4e38-98f6-fbaafab8eb42 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] 10.222.0.26 "GET /compute/v2.1/servers/629522c2-4765-4e35-a6a6-9c3554b1c8c4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.153439 Oct 08 21:19:39.362076 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2579/5227] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Oct 8 21:19:39 2022] GET /compute/v2.1/servers/629522c2-4765-4e35-a6a6-9c3554b1c8c4/os-volume_attachments => generated 197 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:19:39.614896 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-1da48b5b-5a7e-4d37-8bcf-fc529c82d079 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:19:39.624925 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-1da48b5b-5a7e-4d37-8bcf-fc529c82d079 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62" status: 200 len: 1683 microversion: 2.1 time: 0.383538 Oct 08 21:19:39.636405 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2649/5228] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:19:39 2022] GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62 => generated 1683 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:19:39.910060 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-b25242ef-2751-4923-9b6e-9cd2ee306ff2 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:19:39.911422 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-b25242ef-2751-4923-9b6e-9cd2ee306ff2 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] [instance: b7ffbec5-a184-4436-a26c-2188339770cd] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:19:39.942823 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b25242ef-2751-4923-9b6e-9cd2ee306ff2 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:39.945516 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b25242ef-2751-4923-9b6e-9cd2ee306ff2 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:39.946229 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b25242ef-2751-4923-9b6e-9cd2ee306ff2 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:39.948645 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b25242ef-2751-4923-9b6e-9cd2ee306ff2 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:39.949408 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b25242ef-2751-4923-9b6e-9cd2ee306ff2 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:39.952062 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b25242ef-2751-4923-9b6e-9cd2ee306ff2 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:40.132849 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-b25242ef-2751-4923-9b6e-9cd2ee306ff2 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537b77eca97d4c1395eeb164bc5e7205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f564837d8eb4b3192109d0dfc9a6fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:19:40.153379 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-b25242ef-2751-4923-9b6e-9cd2ee306ff2 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] 10.222.0.26 "GET /compute/v2.1/servers/b7ffbec5-a184-4436-a26c-2188339770cd" status: 200 len: 1218 microversion: 2.1 time: 0.244878 Oct 08 21:19:40.174505 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2580/5229] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:19:39 2022] GET /compute/v2.1/servers/b7ffbec5-a184-4436-a26c-2188339770cd => generated 1218 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:19:40.375516 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-4de81e55-1159-4be9-98bd-de29d48fdf4e tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:19:40.379260 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-4de81e55-1159-4be9-98bd-de29d48fdf4e tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] [instance: 629522c2-4765-4e35-a6a6-9c3554b1c8c4] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:19:40.398459 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4de81e55-1159-4be9-98bd-de29d48fdf4e tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:40.399011 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4de81e55-1159-4be9-98bd-de29d48fdf4e tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:40.399466 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4de81e55-1159-4be9-98bd-de29d48fdf4e tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:40.402693 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4de81e55-1159-4be9-98bd-de29d48fdf4e tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:40.403198 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4de81e55-1159-4be9-98bd-de29d48fdf4e tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:40.403661 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4de81e55-1159-4be9-98bd-de29d48fdf4e tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:40.447059 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-4de81e55-1159-4be9-98bd-de29d48fdf4e tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] 10.222.0.26 "GET /compute/v2.1/servers/629522c2-4765-4e35-a6a6-9c3554b1c8c4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.077655 Oct 08 21:19:40.448261 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2650/5230] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Oct 8 21:19:40 2022] GET /compute/v2.1/servers/629522c2-4765-4e35-a6a6-9c3554b1c8c4/os-volume_attachments => generated 25 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 08 21:19:40.593411 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-602ac697-6136-48f6-aba0-c27b96f10c7b tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:19:40.594505 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-602ac697-6136-48f6-aba0-c27b96f10c7b tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] [instance: 629522c2-4765-4e35-a6a6-9c3554b1c8c4] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:19:40.605034 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-602ac697-6136-48f6-aba0-c27b96f10c7b tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:40.605581 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-602ac697-6136-48f6-aba0-c27b96f10c7b tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:40.606144 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-602ac697-6136-48f6-aba0-c27b96f10c7b tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:40.606790 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-602ac697-6136-48f6-aba0-c27b96f10c7b tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:40.608016 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-602ac697-6136-48f6-aba0-c27b96f10c7b tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:40.608627 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-602ac697-6136-48f6-aba0-c27b96f10c7b tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:40.651670 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-602ac697-6136-48f6-aba0-c27b96f10c7b tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] [instance: 629522c2-4765-4e35-a6a6-9c3554b1c8c4] Going to try to terminate instance {{(pid=140491) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 21:19:40.661733 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-df853afd-fb0a-4b80-853b-9977e0aa034a tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:19:40.662655 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-df853afd-fb0a-4b80-853b-9977e0aa034a tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 2a61f287-652b-487f-9ecd-fb4d2d1eee62] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:19:40.673176 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-df853afd-fb0a-4b80-853b-9977e0aa034a tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:40.673903 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-df853afd-fb0a-4b80-853b-9977e0aa034a tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:40.676219 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-df853afd-fb0a-4b80-853b-9977e0aa034a tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:40.677353 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-df853afd-fb0a-4b80-853b-9977e0aa034a tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:40.680724 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-df853afd-fb0a-4b80-853b-9977e0aa034a tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:40.681386 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-df853afd-fb0a-4b80-853b-9977e0aa034a tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:40.875708 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-602ac697-6136-48f6-aba0-c27b96f10c7b tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] 10.222.0.26 "DELETE /compute/v2.1/servers/629522c2-4765-4e35-a6a6-9c3554b1c8c4" status: 204 len: 0 microversion: 2.1 time: 0.287968 Oct 08 21:19:40.876630 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2581/5231] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:19:40 2022] DELETE /compute/v2.1/servers/629522c2-4765-4e35-a6a6-9c3554b1c8c4 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 21:19:40.887020 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-b758fba7-ff2d-4a78-bd25-ef4928de498e tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:19:40.887734 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-b758fba7-ff2d-4a78-bd25-ef4928de498e tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] [instance: 629522c2-4765-4e35-a6a6-9c3554b1c8c4] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:19:40.900208 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b758fba7-ff2d-4a78-bd25-ef4928de498e tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:40.901877 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b758fba7-ff2d-4a78-bd25-ef4928de498e tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:40.903455 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b758fba7-ff2d-4a78-bd25-ef4928de498e tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:40.908200 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b758fba7-ff2d-4a78-bd25-ef4928de498e tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:40.909074 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b758fba7-ff2d-4a78-bd25-ef4928de498e tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:40.909960 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b758fba7-ff2d-4a78-bd25-ef4928de498e tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:41.002118 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-df853afd-fb0a-4b80-853b-9977e0aa034a tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:19:41.018497 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-df853afd-fb0a-4b80-853b-9977e0aa034a tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62" status: 200 len: 1683 microversion: 2.1 time: 0.362417 Oct 08 21:19:41.020416 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2651/5232] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:19:40 2022] GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62 => generated 1683 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:19:41.154689 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-b758fba7-ff2d-4a78-bd25-ef4928de498e tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8957041987c8487099f0d89f4c64af66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9d29b90ab34abbadd21edbca637d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:19:41.165026 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-b758fba7-ff2d-4a78-bd25-ef4928de498e tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] 10.222.0.26 "GET /compute/v2.1/servers/629522c2-4765-4e35-a6a6-9c3554b1c8c4" status: 200 len: 1680 microversion: 2.1 time: 0.283957 Oct 08 21:19:41.165837 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2582/5233] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:19:40 2022] GET /compute/v2.1/servers/629522c2-4765-4e35-a6a6-9c3554b1c8c4 => generated 1680 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:19:41.188901 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-4963fc43-99ca-4477-b494-bcd461fc5fab tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:19:41.189567 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-4963fc43-99ca-4477-b494-bcd461fc5fab tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] [instance: b7ffbec5-a184-4436-a26c-2188339770cd] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:19:41.196256 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4963fc43-99ca-4477-b494-bcd461fc5fab tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:41.196779 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4963fc43-99ca-4477-b494-bcd461fc5fab tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:41.197257 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4963fc43-99ca-4477-b494-bcd461fc5fab tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:41.197989 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4963fc43-99ca-4477-b494-bcd461fc5fab tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:41.198466 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4963fc43-99ca-4477-b494-bcd461fc5fab tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:41.198906 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4963fc43-99ca-4477-b494-bcd461fc5fab tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:41.280265 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-4963fc43-99ca-4477-b494-bcd461fc5fab tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537b77eca97d4c1395eeb164bc5e7205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f564837d8eb4b3192109d0dfc9a6fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:19:41.289556 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-4963fc43-99ca-4477-b494-bcd461fc5fab tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] 10.222.0.26 "GET /compute/v2.1/servers/b7ffbec5-a184-4436-a26c-2188339770cd" status: 200 len: 1284 microversion: 2.1 time: 0.105070 Oct 08 21:19:41.290640 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2652/5234] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:19:41 2022] GET /compute/v2.1/servers/b7ffbec5-a184-4436-a26c-2188339770cd => generated 1284 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:19:42.050360 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-b7fb128d-40cd-4dbb-916c-ab41a74565fc tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:19:42.051732 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-b7fb128d-40cd-4dbb-916c-ab41a74565fc tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 2a61f287-652b-487f-9ecd-fb4d2d1eee62] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:19:42.059718 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b7fb128d-40cd-4dbb-916c-ab41a74565fc tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:42.060496 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b7fb128d-40cd-4dbb-916c-ab41a74565fc tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:42.061125 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b7fb128d-40cd-4dbb-916c-ab41a74565fc tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:42.062102 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b7fb128d-40cd-4dbb-916c-ab41a74565fc tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:42.062731 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b7fb128d-40cd-4dbb-916c-ab41a74565fc tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:42.063508 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b7fb128d-40cd-4dbb-916c-ab41a74565fc tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:42.190829 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-b063d915-d1fd-4d8c-9fae-bb90071278f3 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:19:42.191714 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-b063d915-d1fd-4d8c-9fae-bb90071278f3 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] [instance: 629522c2-4765-4e35-a6a6-9c3554b1c8c4] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:19:42.198352 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b063d915-d1fd-4d8c-9fae-bb90071278f3 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:42.199093 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b063d915-d1fd-4d8c-9fae-bb90071278f3 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:42.199710 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b063d915-d1fd-4d8c-9fae-bb90071278f3 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:42.200605 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b063d915-d1fd-4d8c-9fae-bb90071278f3 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:42.201331 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b063d915-d1fd-4d8c-9fae-bb90071278f3 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:42.202067 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b063d915-d1fd-4d8c-9fae-bb90071278f3 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:42.281464 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-b7fb128d-40cd-4dbb-916c-ab41a74565fc tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:19:42.291951 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-b7fb128d-40cd-4dbb-916c-ab41a74565fc tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62" status: 200 len: 1683 microversion: 2.1 time: 0.248657 Oct 08 21:19:42.295043 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2583/5235] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:19:42 2022] GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62 => generated 1683 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:19:42.316335 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-fd8e1b28-1323-45ee-98c7-1288f3459824 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:19:42.319814 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-fd8e1b28-1323-45ee-98c7-1288f3459824 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] [instance: b7ffbec5-a184-4436-a26c-2188339770cd] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:19:42.328785 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fd8e1b28-1323-45ee-98c7-1288f3459824 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:42.329840 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fd8e1b28-1323-45ee-98c7-1288f3459824 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:42.330662 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fd8e1b28-1323-45ee-98c7-1288f3459824 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:42.331886 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fd8e1b28-1323-45ee-98c7-1288f3459824 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:42.332514 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fd8e1b28-1323-45ee-98c7-1288f3459824 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:42.333105 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fd8e1b28-1323-45ee-98c7-1288f3459824 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:42.421463 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-fd8e1b28-1323-45ee-98c7-1288f3459824 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537b77eca97d4c1395eeb164bc5e7205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f564837d8eb4b3192109d0dfc9a6fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:19:42.436654 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-fd8e1b28-1323-45ee-98c7-1288f3459824 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] 10.222.0.26 "GET /compute/v2.1/servers/b7ffbec5-a184-4436-a26c-2188339770cd" status: 200 len: 1272 microversion: 2.1 time: 0.124432 Oct 08 21:19:42.439141 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2584/5236] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:19:42 2022] GET /compute/v2.1/servers/b7ffbec5-a184-4436-a26c-2188339770cd => generated 1272 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:19:42.989740 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-b063d915-d1fd-4d8c-9fae-bb90071278f3 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8957041987c8487099f0d89f4c64af66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9d29b90ab34abbadd21edbca637d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:19:43.002948 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-b063d915-d1fd-4d8c-9fae-bb90071278f3 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] 10.222.0.26 "GET /compute/v2.1/servers/629522c2-4765-4e35-a6a6-9c3554b1c8c4" status: 200 len: 1680 microversion: 2.1 time: 0.814628 Oct 08 21:19:43.004833 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2653/5237] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:19:42 2022] GET /compute/v2.1/servers/629522c2-4765-4e35-a6a6-9c3554b1c8c4 => generated 1680 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:19:43.319339 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-08247bce-8ab9-49ba-ad0a-1a26b4a1968e tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:19:43.319968 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-08247bce-8ab9-49ba-ad0a-1a26b4a1968e tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 2a61f287-652b-487f-9ecd-fb4d2d1eee62] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:19:43.324478 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:19:43.333867 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-08247bce-8ab9-49ba-ad0a-1a26b4a1968e tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:43.335418 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-08247bce-8ab9-49ba-ad0a-1a26b4a1968e tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:43.336107 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-08247bce-8ab9-49ba-ad0a-1a26b4a1968e tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:43.337080 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-08247bce-8ab9-49ba-ad0a-1a26b4a1968e tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:43.337855 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-08247bce-8ab9-49ba-ad0a-1a26b4a1968e tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:43.338381 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-08247bce-8ab9-49ba-ad0a-1a26b4a1968e tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:43.464373 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-d090b17e-fa61-4909-8a48-e16de8d01829 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:19:43.464898 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-d090b17e-fa61-4909-8a48-e16de8d01829 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] [instance: b7ffbec5-a184-4436-a26c-2188339770cd] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:19:43.480668 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d090b17e-fa61-4909-8a48-e16de8d01829 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:43.481584 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d090b17e-fa61-4909-8a48-e16de8d01829 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:43.482210 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d090b17e-fa61-4909-8a48-e16de8d01829 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:43.487156 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d090b17e-fa61-4909-8a48-e16de8d01829 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:43.489161 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d090b17e-fa61-4909-8a48-e16de8d01829 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:43.492661 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d090b17e-fa61-4909-8a48-e16de8d01829 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:43.560440 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-08247bce-8ab9-49ba-ad0a-1a26b4a1968e tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:19:43.572227 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-08247bce-8ab9-49ba-ad0a-1a26b4a1968e tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62" status: 200 len: 1683 microversion: 2.1 time: 0.256641 Oct 08 21:19:43.572962 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2585/5238] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:19:43 2022] GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62 => generated 1683 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:19:43.718702 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-d090b17e-fa61-4909-8a48-e16de8d01829 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537b77eca97d4c1395eeb164bc5e7205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f564837d8eb4b3192109d0dfc9a6fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:19:43.735812 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-d090b17e-fa61-4909-8a48-e16de8d01829 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] 10.222.0.26 "GET /compute/v2.1/servers/b7ffbec5-a184-4436-a26c-2188339770cd" status: 200 len: 1272 microversion: 2.1 time: 0.272314 Oct 08 21:19:43.736610 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2654/5239] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:19:43 2022] GET /compute/v2.1/servers/b7ffbec5-a184-4436-a26c-2188339770cd => generated 1272 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:19:44.045966 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-16cbdcee-0c33-4c4e-9da3-f60c5a7ba882 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:19:44.047122 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-16cbdcee-0c33-4c4e-9da3-f60c5a7ba882 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] [instance: 629522c2-4765-4e35-a6a6-9c3554b1c8c4] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:19:44.059375 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-16cbdcee-0c33-4c4e-9da3-f60c5a7ba882 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:44.060452 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-16cbdcee-0c33-4c4e-9da3-f60c5a7ba882 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:44.061079 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-16cbdcee-0c33-4c4e-9da3-f60c5a7ba882 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:44.062050 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-16cbdcee-0c33-4c4e-9da3-f60c5a7ba882 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:44.067736 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-16cbdcee-0c33-4c4e-9da3-f60c5a7ba882 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:44.068584 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-16cbdcee-0c33-4c4e-9da3-f60c5a7ba882 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:44.415249 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-16cbdcee-0c33-4c4e-9da3-f60c5a7ba882 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8957041987c8487099f0d89f4c64af66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9d29b90ab34abbadd21edbca637d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:19:44.433844 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-16cbdcee-0c33-4c4e-9da3-f60c5a7ba882 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] 10.222.0.26 "GET /compute/v2.1/servers/629522c2-4765-4e35-a6a6-9c3554b1c8c4" status: 200 len: 1680 microversion: 2.1 time: 0.403184 Oct 08 21:19:44.433844 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2586/5240] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:19:44 2022] GET /compute/v2.1/servers/629522c2-4765-4e35-a6a6-9c3554b1c8c4 => generated 1680 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:19:44.597363 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-9eaf76ba-92c0-4e73-b59b-a9620ef37218 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:19:44.598725 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-9eaf76ba-92c0-4e73-b59b-a9620ef37218 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 2a61f287-652b-487f-9ecd-fb4d2d1eee62] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:19:44.602350 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=3 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:19:44.613721 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9eaf76ba-92c0-4e73-b59b-a9620ef37218 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:44.615226 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9eaf76ba-92c0-4e73-b59b-a9620ef37218 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:44.618407 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9eaf76ba-92c0-4e73-b59b-a9620ef37218 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:44.619349 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9eaf76ba-92c0-4e73-b59b-a9620ef37218 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:44.623879 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9eaf76ba-92c0-4e73-b59b-a9620ef37218 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:44.624545 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9eaf76ba-92c0-4e73-b59b-a9620ef37218 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:44.763650 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-8c0f5299-c522-471d-8d90-7e108e333a74 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:19:44.764292 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-8c0f5299-c522-471d-8d90-7e108e333a74 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] [instance: b7ffbec5-a184-4436-a26c-2188339770cd] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:19:44.774127 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8c0f5299-c522-471d-8d90-7e108e333a74 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:44.774901 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8c0f5299-c522-471d-8d90-7e108e333a74 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:44.775519 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8c0f5299-c522-471d-8d90-7e108e333a74 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:44.776684 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8c0f5299-c522-471d-8d90-7e108e333a74 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:44.777881 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8c0f5299-c522-471d-8d90-7e108e333a74 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:44.778614 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8c0f5299-c522-471d-8d90-7e108e333a74 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:45.063117 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-8c0f5299-c522-471d-8d90-7e108e333a74 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537b77eca97d4c1395eeb164bc5e7205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f564837d8eb4b3192109d0dfc9a6fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:19:45.081700 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-8c0f5299-c522-471d-8d90-7e108e333a74 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] 10.222.0.26 "GET /compute/v2.1/servers/b7ffbec5-a184-4436-a26c-2188339770cd" status: 200 len: 1314 microversion: 2.1 time: 0.323022 Oct 08 21:19:45.085540 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2587/5241] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:19:44 2022] GET /compute/v2.1/servers/b7ffbec5-a184-4436-a26c-2188339770cd => generated 1314 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:19:45.112120 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-9eaf76ba-92c0-4e73-b59b-a9620ef37218 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:19:45.127928 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-9eaf76ba-92c0-4e73-b59b-a9620ef37218 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62" status: 200 len: 1683 microversion: 2.1 time: 0.535431 Oct 08 21:19:45.150456 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2655/5242] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:19:44 2022] GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62 => generated 1683 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:19:45.619857 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-c8f400a8-e0d8-4443-834b-338559f1a5ce req-5886d0af-4e1b-44c4-a223-c239bd178953 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "629522c2-4765-4e35-a6a6-9c3554b1c8c4", "name": "network-vif-deleted", "tag": "b5e9b8d7-841b-4cc1-9d4e-eaa7852df9d5"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:19:45.661979 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-c8f400a8-e0d8-4443-834b-338559f1a5ce req-5886d0af-4e1b-44c4-a223-c239bd178953 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:45.675884 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-c8f400a8-e0d8-4443-834b-338559f1a5ce req-5886d0af-4e1b-44c4-a223-c239bd178953 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:45.676373 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-c8f400a8-e0d8-4443-834b-338559f1a5ce req-5886d0af-4e1b-44c4-a223-c239bd178953 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:45.725060 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-c8f400a8-e0d8-4443-834b-338559f1a5ce req-5886d0af-4e1b-44c4-a223-c239bd178953 service nova] Creating event network-vif-deleted:b5e9b8d7-841b-4cc1-9d4e-eaa7852df9d5 for instance 629522c2-4765-4e35-a6a6-9c3554b1c8c4 on nch2-master-1 Oct 08 21:19:45.746808 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-c8f400a8-e0d8-4443-834b-338559f1a5ce req-5886d0af-4e1b-44c4-a223-c239bd178953 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138705 Oct 08 21:19:45.757622 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2656/5243] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:19:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:19:46.113400 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-288ab7d8-0191-488b-805c-7e25ad13f70b tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:19:46.115781 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-288ab7d8-0191-488b-805c-7e25ad13f70b tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] [instance: b7ffbec5-a184-4436-a26c-2188339770cd] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:19:46.146623 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-288ab7d8-0191-488b-805c-7e25ad13f70b tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:46.147736 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-288ab7d8-0191-488b-805c-7e25ad13f70b tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:46.152588 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-288ab7d8-0191-488b-805c-7e25ad13f70b tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:46.153752 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-288ab7d8-0191-488b-805c-7e25ad13f70b tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:46.155745 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-288ab7d8-0191-488b-805c-7e25ad13f70b tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:46.156405 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-288ab7d8-0191-488b-805c-7e25ad13f70b tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:46.223373 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-7d185dfd-c3fd-43b5-8939-e57a58c5bc48 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:19:46.224609 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-7d185dfd-c3fd-43b5-8939-e57a58c5bc48 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] [instance: 629522c2-4765-4e35-a6a6-9c3554b1c8c4] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:19:46.234363 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7d185dfd-c3fd-43b5-8939-e57a58c5bc48 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:46.247566 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7d185dfd-c3fd-43b5-8939-e57a58c5bc48 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:46.251482 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7d185dfd-c3fd-43b5-8939-e57a58c5bc48 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:46.252466 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7d185dfd-c3fd-43b5-8939-e57a58c5bc48 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:46.256547 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7d185dfd-c3fd-43b5-8939-e57a58c5bc48 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:46.257383 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7d185dfd-c3fd-43b5-8939-e57a58c5bc48 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:46.350689 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7d185dfd-c3fd-43b5-8939-e57a58c5bc48 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:46.351678 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7d185dfd-c3fd-43b5-8939-e57a58c5bc48 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:46.354136 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7d185dfd-c3fd-43b5-8939-e57a58c5bc48 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:46.354639 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.objects.instance [None req-7d185dfd-c3fd-43b5-8939-e57a58c5bc48 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lazy-loading 'fault' on Instance uuid 629522c2-4765-4e35-a6a6-9c3554b1c8c4 {{(pid=140491) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 21:19:46.421043 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-7d185dfd-c3fd-43b5-8939-e57a58c5bc48 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8957041987c8487099f0d89f4c64af66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9d29b90ab34abbadd21edbca637d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:19:46.437995 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-7d185dfd-c3fd-43b5-8939-e57a58c5bc48 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] 10.222.0.26 "GET /compute/v2.1/servers/629522c2-4765-4e35-a6a6-9c3554b1c8c4" status: 200 len: 1331 microversion: 2.1 time: 0.979426 Oct 08 21:19:46.439345 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2588/5244] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:19:45 2022] GET /compute/v2.1/servers/629522c2-4765-4e35-a6a6-9c3554b1c8c4 => generated 1331 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:19:46.449022 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-11b8b6ee-acbb-4eeb-b43f-80186d536948 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:19:46.449750 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-11b8b6ee-acbb-4eeb-b43f-80186d536948 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 2a61f287-652b-487f-9ecd-fb4d2d1eee62] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:19:46.471228 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-11b8b6ee-acbb-4eeb-b43f-80186d536948 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:46.471796 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-11b8b6ee-acbb-4eeb-b43f-80186d536948 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:46.473387 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-11b8b6ee-acbb-4eeb-b43f-80186d536948 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:46.476310 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-11b8b6ee-acbb-4eeb-b43f-80186d536948 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:46.479412 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-11b8b6ee-acbb-4eeb-b43f-80186d536948 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:46.480822 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-11b8b6ee-acbb-4eeb-b43f-80186d536948 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:46.721054 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-288ab7d8-0191-488b-805c-7e25ad13f70b tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537b77eca97d4c1395eeb164bc5e7205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f564837d8eb4b3192109d0dfc9a6fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:19:46.739809 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-288ab7d8-0191-488b-805c-7e25ad13f70b tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] 10.222.0.26 "GET /compute/v2.1/servers/b7ffbec5-a184-4436-a26c-2188339770cd" status: 200 len: 1314 microversion: 2.1 time: 0.633554 Oct 08 21:19:46.741765 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2657/5245] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:19:46 2022] GET /compute/v2.1/servers/b7ffbec5-a184-4436-a26c-2188339770cd => generated 1314 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:19:46.868312 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-11b8b6ee-acbb-4eeb-b43f-80186d536948 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:19:46.885817 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-11b8b6ee-acbb-4eeb-b43f-80186d536948 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62" status: 200 len: 1683 microversion: 2.1 time: 0.445282 Oct 08 21:19:46.886481 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2589/5246] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:19:46 2022] GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62 => generated 1683 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:19:47.501301 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-a75746e4-3299-4388-88a8-feeac43b333d tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:19:47.501945 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-a75746e4-3299-4388-88a8-feeac43b333d tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] [instance: 629522c2-4765-4e35-a6a6-9c3554b1c8c4] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:19:47.521379 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a75746e4-3299-4388-88a8-feeac43b333d tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:47.521910 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a75746e4-3299-4388-88a8-feeac43b333d tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:47.522352 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a75746e4-3299-4388-88a8-feeac43b333d tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:47.525703 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a75746e4-3299-4388-88a8-feeac43b333d tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:47.528957 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a75746e4-3299-4388-88a8-feeac43b333d tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:47.531212 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a75746e4-3299-4388-88a8-feeac43b333d tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:47.588580 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-a75746e4-3299-4388-88a8-feeac43b333d tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] HTTP exception thrown: Instance 629522c2-4765-4e35-a6a6-9c3554b1c8c4 could not be found. Oct 08 21:19:47.593067 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-a75746e4-3299-4388-88a8-feeac43b333d tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Request method failure captured: Oct 08 21:19:47.593067 ncdv-master-1 devstack@n-api.service[140492]: request: GET /compute/v2.1/servers/629522c2-4765-4e35-a6a6-9c3554b1c8c4 HTTP/1.1 Oct 08 21:19:47.593067 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:19:47.593067 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:19:47.593067 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:19:47.593067 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 21:19:47.593067 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:19:47.593067 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:19:47.593067 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:19:47.593067 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:19:47.593067 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQehFIbXs-DGbS_kPUTJMTrUq-WofUYY6ZRyx81bX8dlJ1znB-Icd1X0JZVfoU0lBZbBMu1x5OyOchM7_W_m4wVb0RC5emVnYRQT_LfKB9ZNZm3xjiiSMGa29vJwyibC7NFwQ_T90TzXkiQ39iaomvdVhCKn_tsPv5ogwGAe_Atzwiz8 Oct 08 21:19:47.593067 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:19:47.593067 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:19:47.593067 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:19:47.593067 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:19:47.593067 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:19:47.593067 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:19:47.593067 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 3d9d29b90ab34abbadd21edbca637d2e Oct 08 21:19:47.593067 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-AttachVolumeNegativeTest-1956575659 Oct 08 21:19:47.593067 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:19:47.593067 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:19:47.593067 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3d9d29b90ab34abbadd21edbca637d2e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3d9d29b90ab34abbadd21edbca637d2e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3d9d29b90ab34abbadd21edbca637d2e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3d9d29b90ab34abbadd21edbca637d2e"}]}] Oct 08 21:19:47.593067 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-AttachVolumeNegativeTest-1956575659 Oct 08 21:19:47.593067 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 3d9d29b90ab34abbadd21edbca637d2e Oct 08 21:19:47.593067 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1956575659 Oct 08 21:19:47.593067 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-AttachVolumeNegativeTest-1956575659-project Oct 08 21:19:47.593067 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:19:47.593067 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:19:47.593067 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 8957041987c8487099f0d89f4c64af66 Oct 08 21:19:47.593067 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-AttachVolumeNegativeTest-1956575659-project Oct 08 21:19:47.593067 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 21:19:47.593067 ncdv-master-1 devstack@n-api.service[140492]: exception: Instance 629522c2-4765-4e35-a6a6-9c3554b1c8c4 could not be found. Oct 08 21:19:47.593067 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': '629522c2-4765-4e35-a6a6-9c3554b1c8c4'} Oct 08 21:19:47.593067 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:19:47.593067 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:19:47.593067 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:19:47.593067 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:19:47.593067 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:19:47.593067 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:19:47.593067 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:19:47.593067 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:19:47.593067 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:19:47.593067 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:19:47.593067 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 629522c2-4765-4e35-a6a6-9c3554b1c8c4 could not be found. Oct 08 21:19:47.593067 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:19:47.593067 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:19:47.593067 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:19:47.593067 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:19:47.593067 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:19:47.593067 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:19:47.593067 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:19:47.593067 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:19:47.593067 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:19:47.593067 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:19:47.593067 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:19:47.593067 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:19:47.593067 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:19:47.593067 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:19:47.593067 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:19:47.593067 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:19:47.593067 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 629522c2-4765-4e35-a6a6-9c3554b1c8c4 could not be found. Oct 08 21:19:47.593067 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:19:47.593067 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:19:47.593067 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:19:47.598954 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:19:47.598954 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:19:47.598954 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:19:47.598954 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:19:47.598954 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:19:47.598954 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 629522c2-4765-4e35-a6a6-9c3554b1c8c4 could not be found. Oct 08 21:19:47.598954 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:19:47.598954 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-a75746e4-3299-4388-88a8-feeac43b333d tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Returning 404 to user: Instance 629522c2-4765-4e35-a6a6-9c3554b1c8c4 could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:19:47.600358 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-a75746e4-3299-4388-88a8-feeac43b333d tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] 10.222.0.26 "GET /compute/v2.1/servers/629522c2-4765-4e35-a6a6-9c3554b1c8c4" status: 404 len: 111 microversion: 2.1 time: 0.128152 Oct 08 21:19:47.601014 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2658/5247] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:19:47 2022] GET /compute/v2.1/servers/629522c2-4765-4e35-a6a6-9c3554b1c8c4 => generated 111 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:19:47.613360 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-3d490544-6159-46e3-8c3b-c3fecf15ff52 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Calling method '.version_select at 0x7f1a8ca9a430>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:19:47.658202 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-3d490544-6159-46e3-8c3b-c3fecf15ff52 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-683419627" status: 202 len: 0 microversion: 2.1 time: 0.050112 Oct 08 21:19:47.660413 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2590/5248] 10.222.0.26 () {58 vars in 1218 bytes} [Sat Oct 8 21:19:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-683419627 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 21:19:47.794581 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-3ebe37a0-1368-431b-95f2-8f2f49900435 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:19:47.795522 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-3ebe37a0-1368-431b-95f2-8f2f49900435 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] [instance: b7ffbec5-a184-4436-a26c-2188339770cd] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:19:47.803239 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-a1df45a6-1bda-4c93-9dbe-992cde2874a5 req-613c1d74-4d3c-4fc3-8e3b-a01c8358d874 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7ffbec5-a184-4436-a26c-2188339770cd", "tag": "6f474ff9-590b-4669-af6c-f47947d9c740"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:19:47.812858 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3ebe37a0-1368-431b-95f2-8f2f49900435 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:47.813406 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3ebe37a0-1368-431b-95f2-8f2f49900435 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:47.816385 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3ebe37a0-1368-431b-95f2-8f2f49900435 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:47.817254 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3ebe37a0-1368-431b-95f2-8f2f49900435 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:47.817724 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3ebe37a0-1368-431b-95f2-8f2f49900435 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:47.818202 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3ebe37a0-1368-431b-95f2-8f2f49900435 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:47.877755 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-a1df45a6-1bda-4c93-9dbe-992cde2874a5 req-613c1d74-4d3c-4fc3-8e3b-a01c8358d874 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:47.880188 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-a1df45a6-1bda-4c93-9dbe-992cde2874a5 req-613c1d74-4d3c-4fc3-8e3b-a01c8358d874 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:47.883095 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-a1df45a6-1bda-4c93-9dbe-992cde2874a5 req-613c1d74-4d3c-4fc3-8e3b-a01c8358d874 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:47.920075 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-a1df45a6-1bda-4c93-9dbe-992cde2874a5 req-613c1d74-4d3c-4fc3-8e3b-a01c8358d874 service nova] Creating event network-changed:6f474ff9-590b-4669-af6c-f47947d9c740 for instance b7ffbec5-a184-4436-a26c-2188339770cd on nch2-master-1 Oct 08 21:19:47.945798 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-a1df45a6-1bda-4c93-9dbe-992cde2874a5 req-613c1d74-4d3c-4fc3-8e3b-a01c8358d874 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.152473 Oct 08 21:19:47.946626 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2591/5249] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:19:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:19:47.953375 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-e263130f-0b65-4733-bbf0-36f26d5b83ed tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:19:47.954353 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-e263130f-0b65-4733-bbf0-36f26d5b83ed tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 2a61f287-652b-487f-9ecd-fb4d2d1eee62] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:19:47.974991 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e263130f-0b65-4733-bbf0-36f26d5b83ed tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:47.975912 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e263130f-0b65-4733-bbf0-36f26d5b83ed tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:47.976414 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e263130f-0b65-4733-bbf0-36f26d5b83ed tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:47.977259 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e263130f-0b65-4733-bbf0-36f26d5b83ed tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:47.977996 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e263130f-0b65-4733-bbf0-36f26d5b83ed tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:47.978436 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e263130f-0b65-4733-bbf0-36f26d5b83ed tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:48.131071 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-3ebe37a0-1368-431b-95f2-8f2f49900435 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537b77eca97d4c1395eeb164bc5e7205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f564837d8eb4b3192109d0dfc9a6fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:19:48.140614 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-3ebe37a0-1368-431b-95f2-8f2f49900435 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] 10.222.0.26 "GET /compute/v2.1/servers/b7ffbec5-a184-4436-a26c-2188339770cd" status: 200 len: 1314 microversion: 2.1 time: 0.374247 Oct 08 21:19:48.141611 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2659/5250] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:19:47 2022] GET /compute/v2.1/servers/b7ffbec5-a184-4436-a26c-2188339770cd => generated 1314 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:19:48.306438 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-e263130f-0b65-4733-bbf0-36f26d5b83ed tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:19:48.338943 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-e263130f-0b65-4733-bbf0-36f26d5b83ed tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62" status: 200 len: 1670 microversion: 2.1 time: 0.390855 Oct 08 21:19:48.345645 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2592/5251] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:19:47 2022] GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62 => generated 1670 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:19:48.469287 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e157d523-6cab-4a97-88da-46f1ec62097a tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:19:48.469919 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-e157d523-6cab-4a97-88da-46f1ec62097a tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 2a61f287-652b-487f-9ecd-fb4d2d1eee62] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:19:48.477202 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e157d523-6cab-4a97-88da-46f1ec62097a tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:48.478223 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e157d523-6cab-4a97-88da-46f1ec62097a tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:48.478827 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e157d523-6cab-4a97-88da-46f1ec62097a tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:48.479702 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e157d523-6cab-4a97-88da-46f1ec62097a tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:48.480452 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e157d523-6cab-4a97-88da-46f1ec62097a tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:48.481128 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e157d523-6cab-4a97-88da-46f1ec62097a tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:48.519564 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=2 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:19:48.570340 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=6 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:19:48.771065 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-e157d523-6cab-4a97-88da-46f1ec62097a tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:19:48.783412 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-e157d523-6cab-4a97-88da-46f1ec62097a tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62" status: 200 len: 1670 microversion: 2.1 time: 0.317904 Oct 08 21:19:48.784516 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2660/5252] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:19:48 2022] GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62 => generated 1670 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:19:49.172977 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-1d73cd11-a940-407c-af18-cfed85048140 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:19:49.173684 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-1d73cd11-a940-407c-af18-cfed85048140 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] [instance: b7ffbec5-a184-4436-a26c-2188339770cd] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:19:49.189846 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=2 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:19:49.192316 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1d73cd11-a940-407c-af18-cfed85048140 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:49.193285 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1d73cd11-a940-407c-af18-cfed85048140 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:49.194420 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1d73cd11-a940-407c-af18-cfed85048140 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:49.196747 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1d73cd11-a940-407c-af18-cfed85048140 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:49.197937 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1d73cd11-a940-407c-af18-cfed85048140 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:49.199243 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1d73cd11-a940-407c-af18-cfed85048140 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:49.247653 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:19:49.612410 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-1d73cd11-a940-407c-af18-cfed85048140 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537b77eca97d4c1395eeb164bc5e7205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f564837d8eb4b3192109d0dfc9a6fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:19:49.627260 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-1d73cd11-a940-407c-af18-cfed85048140 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] 10.222.0.26 "GET /compute/v2.1/servers/b7ffbec5-a184-4436-a26c-2188339770cd" status: 200 len: 1314 microversion: 2.1 time: 0.462579 Oct 08 21:19:49.628271 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2593/5253] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:19:49 2022] GET /compute/v2.1/servers/b7ffbec5-a184-4436-a26c-2188339770cd => generated 1314 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:19:50.049657 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-2b9f67fe-638a-4681-a9f7-a66fa34b3933 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:19:50.050287 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-2b9f67fe-638a-4681-a9f7-a66fa34b3933 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 2a61f287-652b-487f-9ecd-fb4d2d1eee62] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:19:50.057476 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2b9f67fe-638a-4681-a9f7-a66fa34b3933 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:50.057984 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2b9f67fe-638a-4681-a9f7-a66fa34b3933 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:50.059046 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2b9f67fe-638a-4681-a9f7-a66fa34b3933 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:50.059763 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2b9f67fe-638a-4681-a9f7-a66fa34b3933 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:50.060236 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2b9f67fe-638a-4681-a9f7-a66fa34b3933 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:50.060676 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2b9f67fe-638a-4681-a9f7-a66fa34b3933 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:50.252112 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-2b9f67fe-638a-4681-a9f7-a66fa34b3933 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:19:50.261572 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-2b9f67fe-638a-4681-a9f7-a66fa34b3933 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62" status: 200 len: 1670 microversion: 2.1 time: 0.215782 Oct 08 21:19:50.262476 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2661/5254] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:19:50 2022] GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62 => generated 1670 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:19:50.287227 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-9bb1f1d4-8cb5-4437-a6b2-cc440ee60fbc tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:19:50.288013 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-9bb1f1d4-8cb5-4437-a6b2-cc440ee60fbc tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 2a61f287-652b-487f-9ecd-fb4d2d1eee62] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:19:50.293823 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-3834f328-4078-43bd-8507-1387d90705ac req-e361c12a-534a-43e2-9445-593f8da74b90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a61f287-652b-487f-9ecd-fb4d2d1eee62", "name": "network-vif-unplugged", "status": "completed", "tag": "960ff13a-d0c5-4f5c-af4b-44aec29e7c23"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:19:50.317740 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9bb1f1d4-8cb5-4437-a6b2-cc440ee60fbc tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:50.317740 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9bb1f1d4-8cb5-4437-a6b2-cc440ee60fbc tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:50.317740 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9bb1f1d4-8cb5-4437-a6b2-cc440ee60fbc tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:50.317740 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9bb1f1d4-8cb5-4437-a6b2-cc440ee60fbc tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:50.317740 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9bb1f1d4-8cb5-4437-a6b2-cc440ee60fbc tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:50.318247 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9bb1f1d4-8cb5-4437-a6b2-cc440ee60fbc tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:50.323522 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-3834f328-4078-43bd-8507-1387d90705ac req-e361c12a-534a-43e2-9445-593f8da74b90 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:50.324980 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-3834f328-4078-43bd-8507-1387d90705ac req-e361c12a-534a-43e2-9445-593f8da74b90 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:50.325468 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-3834f328-4078-43bd-8507-1387d90705ac req-e361c12a-534a-43e2-9445-593f8da74b90 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:50.347226 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-3834f328-4078-43bd-8507-1387d90705ac req-e361c12a-534a-43e2-9445-593f8da74b90 service nova] Creating event network-vif-unplugged:960ff13a-d0c5-4f5c-af4b-44aec29e7c23 for instance 2a61f287-652b-487f-9ecd-fb4d2d1eee62 on nch1-master-1 Oct 08 21:19:50.362940 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-3834f328-4078-43bd-8507-1387d90705ac req-e361c12a-534a-43e2-9445-593f8da74b90 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.069282 Oct 08 21:19:50.363729 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2662/5255] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:19:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:19:50.469934 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-a1b5d7da-0712-4af3-9d7d-cee8b7e0596f tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:19:50.470841 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-a1b5d7da-0712-4af3-9d7d-cee8b7e0596f tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] [instance: 629522c2-4765-4e35-a6a6-9c3554b1c8c4] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:19:50.478001 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a1b5d7da-0712-4af3-9d7d-cee8b7e0596f tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:50.478583 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a1b5d7da-0712-4af3-9d7d-cee8b7e0596f tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:50.479141 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a1b5d7da-0712-4af3-9d7d-cee8b7e0596f tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:50.479890 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a1b5d7da-0712-4af3-9d7d-cee8b7e0596f tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:50.481634 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a1b5d7da-0712-4af3-9d7d-cee8b7e0596f tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:50.481634 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a1b5d7da-0712-4af3-9d7d-cee8b7e0596f tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:50.490052 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-9bb1f1d4-8cb5-4437-a6b2-cc440ee60fbc tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:19:50.497240 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-a1b5d7da-0712-4af3-9d7d-cee8b7e0596f tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] HTTP exception thrown: Instance 629522c2-4765-4e35-a6a6-9c3554b1c8c4 could not be found. Oct 08 21:19:50.499218 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-a1b5d7da-0712-4af3-9d7d-cee8b7e0596f tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Request method failure captured: Oct 08 21:19:50.499218 ncdv-master-1 devstack@n-api.service[140492]: request: DELETE /compute/v2.1/servers/629522c2-4765-4e35-a6a6-9c3554b1c8c4 HTTP/1.1 Oct 08 21:19:50.499218 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:19:50.499218 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:19:50.499218 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:19:50.499218 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 21:19:50.499218 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:19:50.499218 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:19:50.499218 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:19:50.499218 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:19:50.499218 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQehFIbXs-DGbS_kPUTJMTrUq-WofUYY6ZRyx81bX8dlJ1znB-Icd1X0JZVfoU0lBZbBMu1x5OyOchM7_W_m4wVb0RC5emVnYRQT_LfKB9ZNZm3xjiiSMGa29vJwyibC7NFwQ_T90TzXkiQ39iaomvdVhCKn_tsPv5ogwGAe_Atzwiz8 Oct 08 21:19:50.499218 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:19:50.499218 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:19:50.499218 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:19:50.499218 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:19:50.499218 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:19:50.499218 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:19:50.499218 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 3d9d29b90ab34abbadd21edbca637d2e Oct 08 21:19:50.499218 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-AttachVolumeNegativeTest-1956575659 Oct 08 21:19:50.499218 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:19:50.499218 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:19:50.499218 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3d9d29b90ab34abbadd21edbca637d2e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3d9d29b90ab34abbadd21edbca637d2e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3d9d29b90ab34abbadd21edbca637d2e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3d9d29b90ab34abbadd21edbca637d2e"}]}] Oct 08 21:19:50.499218 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-AttachVolumeNegativeTest-1956575659 Oct 08 21:19:50.499218 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 3d9d29b90ab34abbadd21edbca637d2e Oct 08 21:19:50.499218 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1956575659 Oct 08 21:19:50.499218 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-AttachVolumeNegativeTest-1956575659-project Oct 08 21:19:50.499218 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:19:50.499218 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:19:50.499218 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 8957041987c8487099f0d89f4c64af66 Oct 08 21:19:50.499218 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-AttachVolumeNegativeTest-1956575659-project Oct 08 21:19:50.499218 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 21:19:50.499218 ncdv-master-1 devstack@n-api.service[140492]: exception: Instance 629522c2-4765-4e35-a6a6-9c3554b1c8c4 could not be found. Oct 08 21:19:50.499218 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': '629522c2-4765-4e35-a6a6-9c3554b1c8c4'} Oct 08 21:19:50.499218 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:19:50.499218 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:19:50.499218 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:19:50.499218 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:19:50.499218 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:19:50.499218 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:19:50.499218 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:19:50.499218 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:19:50.499218 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:19:50.499218 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:19:50.499218 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 629522c2-4765-4e35-a6a6-9c3554b1c8c4 could not be found. Oct 08 21:19:50.499218 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:19:50.499218 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:19:50.499218 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:19:50.499218 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:19:50.499218 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:19:50.499218 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:19:50.499218 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:19:50.499218 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:19:50.499218 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:19:50.499218 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:19:50.499218 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 08 21:19:50.499218 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 08 21:19:50.499218 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 08 21:19:50.499218 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 08 21:19:50.499218 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:19:50.499218 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:19:50.499218 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:19:50.499218 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:19:50.519280 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 629522c2-4765-4e35-a6a6-9c3554b1c8c4 could not be found. Oct 08 21:19:50.519280 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:19:50.519280 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:19:50.519280 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:19:50.519280 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:19:50.519280 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:19:50.519280 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:19:50.519280 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:19:50.519280 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:19:50.519280 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 629522c2-4765-4e35-a6a6-9c3554b1c8c4 could not be found. Oct 08 21:19:50.519280 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:19:50.520341 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-9bb1f1d4-8cb5-4437-a6b2-cc440ee60fbc tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62" status: 200 len: 1670 microversion: 2.1 time: 0.217924 Oct 08 21:19:50.520341 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2594/5256] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:19:50 2022] GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62 => generated 1670 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:19:50.520514 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-a1b5d7da-0712-4af3-9d7d-cee8b7e0596f tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Returning 404 to user: Instance 629522c2-4765-4e35-a6a6-9c3554b1c8c4 could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:19:50.520514 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-a1b5d7da-0712-4af3-9d7d-cee8b7e0596f tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] 10.222.0.26 "DELETE /compute/v2.1/servers/629522c2-4765-4e35-a6a6-9c3554b1c8c4" status: 404 len: 111 microversion: 2.1 time: 0.038184 Oct 08 21:19:50.520514 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2663/5257] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:19:50 2022] DELETE /compute/v2.1/servers/629522c2-4765-4e35-a6a6-9c3554b1c8c4 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:19:50.520722 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-e8fd0840-f8c3-4a68-bb43-bc476bdb9362 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:19:50.520722 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-e8fd0840-f8c3-4a68-bb43-bc476bdb9362 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] [instance: 629522c2-4765-4e35-a6a6-9c3554b1c8c4] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:19:50.523369 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e8fd0840-f8c3-4a68-bb43-bc476bdb9362 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:50.523997 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e8fd0840-f8c3-4a68-bb43-bc476bdb9362 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:50.524590 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e8fd0840-f8c3-4a68-bb43-bc476bdb9362 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:50.525441 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e8fd0840-f8c3-4a68-bb43-bc476bdb9362 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:50.526005 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e8fd0840-f8c3-4a68-bb43-bc476bdb9362 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:50.526200 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-61e17194-7c6b-41cd-899d-2ad22bb1baea tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:19:50.526617 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e8fd0840-f8c3-4a68-bb43-bc476bdb9362 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:50.526826 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-61e17194-7c6b-41cd-899d-2ad22bb1baea tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 2a61f287-652b-487f-9ecd-fb4d2d1eee62] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:19:50.536633 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-61e17194-7c6b-41cd-899d-2ad22bb1baea tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:50.537285 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-61e17194-7c6b-41cd-899d-2ad22bb1baea tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:50.537808 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-61e17194-7c6b-41cd-899d-2ad22bb1baea tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:50.538541 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-61e17194-7c6b-41cd-899d-2ad22bb1baea tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:50.539007 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-61e17194-7c6b-41cd-899d-2ad22bb1baea tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:50.539440 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-61e17194-7c6b-41cd-899d-2ad22bb1baea tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:50.553371 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-e8fd0840-f8c3-4a68-bb43-bc476bdb9362 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] HTTP exception thrown: Instance 629522c2-4765-4e35-a6a6-9c3554b1c8c4 could not be found. Oct 08 21:19:50.555038 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-e8fd0840-f8c3-4a68-bb43-bc476bdb9362 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Request method failure captured: Oct 08 21:19:50.555038 ncdv-master-1 devstack@n-api.service[140491]: request: GET /compute/v2.1/servers/629522c2-4765-4e35-a6a6-9c3554b1c8c4 HTTP/1.1 Oct 08 21:19:50.555038 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:19:50.555038 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:19:50.555038 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:19:50.555038 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 21:19:50.555038 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:19:50.555038 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:19:50.555038 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:19:50.555038 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:19:50.555038 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQehFIbXs-DGbS_kPUTJMTrUq-WofUYY6ZRyx81bX8dlJ1znB-Icd1X0JZVfoU0lBZbBMu1x5OyOchM7_W_m4wVb0RC5emVnYRQT_LfKB9ZNZm3xjiiSMGa29vJwyibC7NFwQ_T90TzXkiQ39iaomvdVhCKn_tsPv5ogwGAe_Atzwiz8 Oct 08 21:19:50.555038 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:19:50.555038 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:19:50.555038 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:19:50.555038 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:19:50.555038 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:19:50.555038 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:19:50.555038 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 3d9d29b90ab34abbadd21edbca637d2e Oct 08 21:19:50.555038 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-AttachVolumeNegativeTest-1956575659 Oct 08 21:19:50.555038 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:19:50.555038 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:19:50.555038 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3d9d29b90ab34abbadd21edbca637d2e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3d9d29b90ab34abbadd21edbca637d2e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3d9d29b90ab34abbadd21edbca637d2e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3d9d29b90ab34abbadd21edbca637d2e"}]}] Oct 08 21:19:50.555038 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-AttachVolumeNegativeTest-1956575659 Oct 08 21:19:50.555038 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 3d9d29b90ab34abbadd21edbca637d2e Oct 08 21:19:50.555038 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1956575659 Oct 08 21:19:50.555038 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-AttachVolumeNegativeTest-1956575659-project Oct 08 21:19:50.555038 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:19:50.555038 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:19:50.555038 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 8957041987c8487099f0d89f4c64af66 Oct 08 21:19:50.555038 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-AttachVolumeNegativeTest-1956575659-project Oct 08 21:19:50.555038 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:19:50.555038 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance 629522c2-4765-4e35-a6a6-9c3554b1c8c4 could not be found. Oct 08 21:19:50.555038 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': '629522c2-4765-4e35-a6a6-9c3554b1c8c4'} Oct 08 21:19:50.555038 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:19:50.555038 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:19:50.555038 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:19:50.555038 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:19:50.555038 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:19:50.555038 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:19:50.555038 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:19:50.555038 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:19:50.555038 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:19:50.555038 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:19:50.555038 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 629522c2-4765-4e35-a6a6-9c3554b1c8c4 could not be found. Oct 08 21:19:50.555038 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:19:50.555038 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:19:50.555038 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:19:50.555038 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:19:50.555038 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:19:50.555038 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:19:50.555038 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:19:50.555038 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:19:50.555038 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:19:50.555038 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:19:50.555038 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:19:50.555038 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:19:50.555038 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:19:50.555038 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:19:50.555038 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:19:50.555038 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:19:50.555038 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 629522c2-4765-4e35-a6a6-9c3554b1c8c4 could not be found. Oct 08 21:19:50.555038 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:19:50.555038 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:19:50.555038 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:19:50.560093 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:19:50.560093 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:19:50.560093 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:19:50.560093 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:19:50.560093 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:19:50.560093 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 629522c2-4765-4e35-a6a6-9c3554b1c8c4 could not be found. Oct 08 21:19:50.560093 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:19:50.560093 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-e8fd0840-f8c3-4a68-bb43-bc476bdb9362 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Returning 404 to user: Instance 629522c2-4765-4e35-a6a6-9c3554b1c8c4 could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:19:50.560093 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-e8fd0840-f8c3-4a68-bb43-bc476bdb9362 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] 10.222.0.26 "GET /compute/v2.1/servers/629522c2-4765-4e35-a6a6-9c3554b1c8c4" status: 404 len: 111 microversion: 2.1 time: 0.049136 Oct 08 21:19:50.561262 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2595/5258] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:19:50 2022] GET /compute/v2.1/servers/629522c2-4765-4e35-a6a6-9c3554b1c8c4 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:19:50.565077 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:19:50.655753 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-1272d599-9b8a-4232-a23c-83e70b223073 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:19:50.656374 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-1272d599-9b8a-4232-a23c-83e70b223073 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] [instance: b7ffbec5-a184-4436-a26c-2188339770cd] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:19:50.663265 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1272d599-9b8a-4232-a23c-83e70b223073 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:50.664226 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1272d599-9b8a-4232-a23c-83e70b223073 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:50.665435 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1272d599-9b8a-4232-a23c-83e70b223073 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:50.666956 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1272d599-9b8a-4232-a23c-83e70b223073 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:50.668422 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1272d599-9b8a-4232-a23c-83e70b223073 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:50.669438 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1272d599-9b8a-4232-a23c-83e70b223073 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:50.756575 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-61e17194-7c6b-41cd-899d-2ad22bb1baea tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:19:50.766223 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-61e17194-7c6b-41cd-899d-2ad22bb1baea tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62" status: 200 len: 1670 microversion: 2.1 time: 0.243918 Oct 08 21:19:50.767293 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2664/5259] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:19:50 2022] GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62 => generated 1670 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:19:50.790000 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-1a3a7776-834d-4223-a248-02171f2d31cc tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:19:50.793138 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-1a3a7776-834d-4223-a248-02171f2d31cc tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 2a61f287-652b-487f-9ecd-fb4d2d1eee62] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:19:50.802505 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1a3a7776-834d-4223-a248-02171f2d31cc tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:50.804786 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1a3a7776-834d-4223-a248-02171f2d31cc tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:50.805288 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1a3a7776-834d-4223-a248-02171f2d31cc tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:50.806113 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1a3a7776-834d-4223-a248-02171f2d31cc tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:50.806631 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1a3a7776-834d-4223-a248-02171f2d31cc tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:50.810127 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1a3a7776-834d-4223-a248-02171f2d31cc tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:50.876753 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-1272d599-9b8a-4232-a23c-83e70b223073 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537b77eca97d4c1395eeb164bc5e7205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f564837d8eb4b3192109d0dfc9a6fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:19:50.888846 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-1272d599-9b8a-4232-a23c-83e70b223073 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] 10.222.0.26 "GET /compute/v2.1/servers/b7ffbec5-a184-4436-a26c-2188339770cd" status: 200 len: 1314 microversion: 2.1 time: 0.236986 Oct 08 21:19:50.890012 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2596/5260] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:19:50 2022] GET /compute/v2.1/servers/b7ffbec5-a184-4436-a26c-2188339770cd => generated 1314 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:19:50.922989 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-1a3a7776-834d-4223-a248-02171f2d31cc tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "POST /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62/action" status: 202 len: 0 microversion: 2.1 time: 0.136205 Oct 08 21:19:50.923941 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2665/5261] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:19:50 2022] POST /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62/action => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 08 21:19:50.932831 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-14b48dec-2b04-4166-b2fd-633ef803b48b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:19:50.934595 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-14b48dec-2b04-4166-b2fd-633ef803b48b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 2a61f287-652b-487f-9ecd-fb4d2d1eee62] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:19:50.942089 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-14b48dec-2b04-4166-b2fd-633ef803b48b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:50.942835 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-14b48dec-2b04-4166-b2fd-633ef803b48b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:50.943475 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-14b48dec-2b04-4166-b2fd-633ef803b48b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:50.944284 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-14b48dec-2b04-4166-b2fd-633ef803b48b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:50.944848 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-14b48dec-2b04-4166-b2fd-633ef803b48b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:50.945557 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-14b48dec-2b04-4166-b2fd-633ef803b48b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:51.135197 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-14b48dec-2b04-4166-b2fd-633ef803b48b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:19:51.148067 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-14b48dec-2b04-4166-b2fd-633ef803b48b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62" status: 200 len: 1672 microversion: 2.1 time: 0.219475 Oct 08 21:19:51.148972 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2597/5262] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:19:50 2022] GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62 => generated 1672 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:19:51.773960 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-484012fc-39ef-4e8c-9a71-9b6a70cfd032 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:19:51.774557 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-484012fc-39ef-4e8c-9a71-9b6a70cfd032 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] [instance: 17c182d5-d3c8-4e7e-babc-46af1f466f00] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:19:51.783305 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-484012fc-39ef-4e8c-9a71-9b6a70cfd032 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:51.784043 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-484012fc-39ef-4e8c-9a71-9b6a70cfd032 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:51.784863 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-484012fc-39ef-4e8c-9a71-9b6a70cfd032 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:51.785786 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-484012fc-39ef-4e8c-9a71-9b6a70cfd032 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:51.786479 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-484012fc-39ef-4e8c-9a71-9b6a70cfd032 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:51.787109 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-484012fc-39ef-4e8c-9a71-9b6a70cfd032 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:51.803297 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-484012fc-39ef-4e8c-9a71-9b6a70cfd032 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] HTTP exception thrown: Instance 17c182d5-d3c8-4e7e-babc-46af1f466f00 could not be found. Oct 08 21:19:51.805218 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-484012fc-39ef-4e8c-9a71-9b6a70cfd032 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Request method failure captured: Oct 08 21:19:51.805218 ncdv-master-1 devstack@n-api.service[140492]: request: DELETE /compute/v2.1/servers/17c182d5-d3c8-4e7e-babc-46af1f466f00 HTTP/1.1 Oct 08 21:19:51.805218 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:19:51.805218 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:19:51.805218 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:19:51.805218 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 21:19:51.805218 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:19:51.805218 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:19:51.805218 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:19:51.805218 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:19:51.805218 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQehFIbXs-DGbS_kPUTJMTrUq-WofUYY6ZRyx81bX8dlJ1znB-Icd1X0JZVfoU0lBZbBMu1x5OyOchM7_W_m4wVb0RC5emVnYRQT_LfKB9ZNZm3xjiiSMGa29vJwyibC7NFwQ_T90TzXkiQ39iaomvdVhCKn_tsPv5ogwGAe_Atzwiz8 Oct 08 21:19:51.805218 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:19:51.805218 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:19:51.805218 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:19:51.805218 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:19:51.805218 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:19:51.805218 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:19:51.805218 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 3d9d29b90ab34abbadd21edbca637d2e Oct 08 21:19:51.805218 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-AttachVolumeNegativeTest-1956575659 Oct 08 21:19:51.805218 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:19:51.805218 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:19:51.805218 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3d9d29b90ab34abbadd21edbca637d2e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3d9d29b90ab34abbadd21edbca637d2e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3d9d29b90ab34abbadd21edbca637d2e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3d9d29b90ab34abbadd21edbca637d2e"}]}] Oct 08 21:19:51.805218 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-AttachVolumeNegativeTest-1956575659 Oct 08 21:19:51.805218 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 3d9d29b90ab34abbadd21edbca637d2e Oct 08 21:19:51.805218 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1956575659 Oct 08 21:19:51.805218 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-AttachVolumeNegativeTest-1956575659-project Oct 08 21:19:51.805218 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:19:51.805218 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:19:51.805218 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 8957041987c8487099f0d89f4c64af66 Oct 08 21:19:51.805218 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-AttachVolumeNegativeTest-1956575659-project Oct 08 21:19:51.805218 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 21:19:51.805218 ncdv-master-1 devstack@n-api.service[140492]: exception: Instance 17c182d5-d3c8-4e7e-babc-46af1f466f00 could not be found. Oct 08 21:19:51.805218 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': '17c182d5-d3c8-4e7e-babc-46af1f466f00'} Oct 08 21:19:51.805218 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:19:51.805218 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:19:51.805218 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:19:51.805218 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:19:51.805218 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:19:51.805218 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:19:51.805218 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:19:51.805218 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:19:51.805218 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:19:51.805218 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:19:51.805218 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17c182d5-d3c8-4e7e-babc-46af1f466f00 could not be found. Oct 08 21:19:51.805218 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:19:51.805218 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:19:51.805218 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:19:51.805218 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:19:51.805218 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:19:51.805218 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:19:51.805218 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:19:51.805218 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:19:51.805218 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:19:51.805218 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:19:51.805218 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 08 21:19:51.805218 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 08 21:19:51.805218 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 08 21:19:51.805218 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 08 21:19:51.805218 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:19:51.805218 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:19:51.805218 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:19:51.805218 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:19:51.810509 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17c182d5-d3c8-4e7e-babc-46af1f466f00 could not be found. Oct 08 21:19:51.810509 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:19:51.810509 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:19:51.810509 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:19:51.810509 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:19:51.810509 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:19:51.810509 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:19:51.810509 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:19:51.810509 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:19:51.810509 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17c182d5-d3c8-4e7e-babc-46af1f466f00 could not be found. Oct 08 21:19:51.810509 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:19:51.810509 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-484012fc-39ef-4e8c-9a71-9b6a70cfd032 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Returning 404 to user: Instance 17c182d5-d3c8-4e7e-babc-46af1f466f00 could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:19:51.812203 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-484012fc-39ef-4e8c-9a71-9b6a70cfd032 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] 10.222.0.26 "DELETE /compute/v2.1/servers/17c182d5-d3c8-4e7e-babc-46af1f466f00" status: 404 len: 111 microversion: 2.1 time: 0.043739 Oct 08 21:19:51.812863 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2666/5263] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:19:51 2022] DELETE /compute/v2.1/servers/17c182d5-d3c8-4e7e-babc-46af1f466f00 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:19:51.821306 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-60ac5e11-7ec8-4fd1-89d0-a8b2e00ca282 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:19:51.821951 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-60ac5e11-7ec8-4fd1-89d0-a8b2e00ca282 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] [instance: 17c182d5-d3c8-4e7e-babc-46af1f466f00] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:19:51.834730 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-60ac5e11-7ec8-4fd1-89d0-a8b2e00ca282 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:51.835557 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-60ac5e11-7ec8-4fd1-89d0-a8b2e00ca282 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:51.836189 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-60ac5e11-7ec8-4fd1-89d0-a8b2e00ca282 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:51.837254 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-60ac5e11-7ec8-4fd1-89d0-a8b2e00ca282 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:51.837977 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-60ac5e11-7ec8-4fd1-89d0-a8b2e00ca282 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:51.838771 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-60ac5e11-7ec8-4fd1-89d0-a8b2e00ca282 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:51.879279 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-60ac5e11-7ec8-4fd1-89d0-a8b2e00ca282 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] HTTP exception thrown: Instance 17c182d5-d3c8-4e7e-babc-46af1f466f00 could not be found. Oct 08 21:19:51.880978 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-60ac5e11-7ec8-4fd1-89d0-a8b2e00ca282 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Request method failure captured: Oct 08 21:19:51.880978 ncdv-master-1 devstack@n-api.service[140491]: request: GET /compute/v2.1/servers/17c182d5-d3c8-4e7e-babc-46af1f466f00 HTTP/1.1 Oct 08 21:19:51.880978 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:19:51.880978 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:19:51.880978 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:19:51.880978 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 21:19:51.880978 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:19:51.880978 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:19:51.880978 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:19:51.880978 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:19:51.880978 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQehFIbXs-DGbS_kPUTJMTrUq-WofUYY6ZRyx81bX8dlJ1znB-Icd1X0JZVfoU0lBZbBMu1x5OyOchM7_W_m4wVb0RC5emVnYRQT_LfKB9ZNZm3xjiiSMGa29vJwyibC7NFwQ_T90TzXkiQ39iaomvdVhCKn_tsPv5ogwGAe_Atzwiz8 Oct 08 21:19:51.880978 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:19:51.880978 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:19:51.880978 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:19:51.880978 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:19:51.880978 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:19:51.880978 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:19:51.880978 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 3d9d29b90ab34abbadd21edbca637d2e Oct 08 21:19:51.880978 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-AttachVolumeNegativeTest-1956575659 Oct 08 21:19:51.880978 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:19:51.880978 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:19:51.880978 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3d9d29b90ab34abbadd21edbca637d2e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3d9d29b90ab34abbadd21edbca637d2e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3d9d29b90ab34abbadd21edbca637d2e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3d9d29b90ab34abbadd21edbca637d2e"}]}] Oct 08 21:19:51.880978 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-AttachVolumeNegativeTest-1956575659 Oct 08 21:19:51.880978 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 3d9d29b90ab34abbadd21edbca637d2e Oct 08 21:19:51.880978 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1956575659 Oct 08 21:19:51.880978 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-AttachVolumeNegativeTest-1956575659-project Oct 08 21:19:51.880978 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:19:51.880978 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:19:51.880978 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 8957041987c8487099f0d89f4c64af66 Oct 08 21:19:51.880978 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-AttachVolumeNegativeTest-1956575659-project Oct 08 21:19:51.880978 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:19:51.880978 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance 17c182d5-d3c8-4e7e-babc-46af1f466f00 could not be found. Oct 08 21:19:51.880978 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': '17c182d5-d3c8-4e7e-babc-46af1f466f00'} Oct 08 21:19:51.880978 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:19:51.880978 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:19:51.880978 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:19:51.880978 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:19:51.880978 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:19:51.880978 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:19:51.880978 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:19:51.880978 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:19:51.880978 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:19:51.880978 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:19:51.880978 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17c182d5-d3c8-4e7e-babc-46af1f466f00 could not be found. Oct 08 21:19:51.880978 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:19:51.880978 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:19:51.880978 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:19:51.880978 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:19:51.880978 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:19:51.880978 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:19:51.880978 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:19:51.880978 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:19:51.880978 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:19:51.880978 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:19:51.880978 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:19:51.880978 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:19:51.880978 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:19:51.880978 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:19:51.880978 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:19:51.880978 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:19:51.880978 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17c182d5-d3c8-4e7e-babc-46af1f466f00 could not be found. Oct 08 21:19:51.880978 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:19:51.880978 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:19:51.880978 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:19:51.888397 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:19:51.888397 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:19:51.888397 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:19:51.888397 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:19:51.888397 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:19:51.888397 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17c182d5-d3c8-4e7e-babc-46af1f466f00 could not be found. Oct 08 21:19:51.888397 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:19:51.888397 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-60ac5e11-7ec8-4fd1-89d0-a8b2e00ca282 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Returning 404 to user: Instance 17c182d5-d3c8-4e7e-babc-46af1f466f00 could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:19:51.888397 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-60ac5e11-7ec8-4fd1-89d0-a8b2e00ca282 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] 10.222.0.26 "GET /compute/v2.1/servers/17c182d5-d3c8-4e7e-babc-46af1f466f00" status: 404 len: 111 microversion: 2.1 time: 0.065953 Oct 08 21:19:51.888397 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2598/5264] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:19:51 2022] GET /compute/v2.1/servers/17c182d5-d3c8-4e7e-babc-46af1f466f00 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:19:51.892506 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-815e7ec5-83e4-417e-a47e-2fd9f4813d97 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:19:51.893039 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-815e7ec5-83e4-417e-a47e-2fd9f4813d97 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] [instance: bbd1c1d7-13a9-4c6f-b651-c1017efd922e] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:19:51.900383 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-815e7ec5-83e4-417e-a47e-2fd9f4813d97 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:51.900900 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-815e7ec5-83e4-417e-a47e-2fd9f4813d97 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:51.901389 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-815e7ec5-83e4-417e-a47e-2fd9f4813d97 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:51.902795 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-815e7ec5-83e4-417e-a47e-2fd9f4813d97 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:51.903280 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-815e7ec5-83e4-417e-a47e-2fd9f4813d97 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:51.903725 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-815e7ec5-83e4-417e-a47e-2fd9f4813d97 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:51.916454 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c55ffa64-1d43-4841-9b8c-783ca882e67a tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:19:51.917178 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-c55ffa64-1d43-4841-9b8c-783ca882e67a tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] [instance: b7ffbec5-a184-4436-a26c-2188339770cd] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:19:51.923874 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-815e7ec5-83e4-417e-a47e-2fd9f4813d97 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] HTTP exception thrown: Instance bbd1c1d7-13a9-4c6f-b651-c1017efd922e could not be found. Oct 08 21:19:51.925153 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c55ffa64-1d43-4841-9b8c-783ca882e67a tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:51.925939 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c55ffa64-1d43-4841-9b8c-783ca882e67a tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:51.926379 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-815e7ec5-83e4-417e-a47e-2fd9f4813d97 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Request method failure captured: Oct 08 21:19:51.926379 ncdv-master-1 devstack@n-api.service[140492]: request: DELETE /compute/v2.1/servers/bbd1c1d7-13a9-4c6f-b651-c1017efd922e HTTP/1.1 Oct 08 21:19:51.926379 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:19:51.926379 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:19:51.926379 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:19:51.926379 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 21:19:51.926379 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:19:51.926379 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:19:51.926379 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:19:51.926379 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:19:51.926379 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQehFIbXs-DGbS_kPUTJMTrUq-WofUYY6ZRyx81bX8dlJ1znB-Icd1X0JZVfoU0lBZbBMu1x5OyOchM7_W_m4wVb0RC5emVnYRQT_LfKB9ZNZm3xjiiSMGa29vJwyibC7NFwQ_T90TzXkiQ39iaomvdVhCKn_tsPv5ogwGAe_Atzwiz8 Oct 08 21:19:51.926379 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:19:51.926379 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:19:51.926379 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:19:51.926379 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:19:51.926379 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:19:51.926379 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:19:51.926379 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 3d9d29b90ab34abbadd21edbca637d2e Oct 08 21:19:51.926379 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-AttachVolumeNegativeTest-1956575659 Oct 08 21:19:51.926379 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:19:51.926379 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:19:51.926379 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3d9d29b90ab34abbadd21edbca637d2e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3d9d29b90ab34abbadd21edbca637d2e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3d9d29b90ab34abbadd21edbca637d2e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3d9d29b90ab34abbadd21edbca637d2e"}]}] Oct 08 21:19:51.926379 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-AttachVolumeNegativeTest-1956575659 Oct 08 21:19:51.926379 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 3d9d29b90ab34abbadd21edbca637d2e Oct 08 21:19:51.926379 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1956575659 Oct 08 21:19:51.926379 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-AttachVolumeNegativeTest-1956575659-project Oct 08 21:19:51.926379 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:19:51.926379 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:19:51.926379 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 8957041987c8487099f0d89f4c64af66 Oct 08 21:19:51.926379 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-AttachVolumeNegativeTest-1956575659-project Oct 08 21:19:51.926379 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 21:19:51.926379 ncdv-master-1 devstack@n-api.service[140492]: exception: Instance bbd1c1d7-13a9-4c6f-b651-c1017efd922e could not be found. Oct 08 21:19:51.926379 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': 'bbd1c1d7-13a9-4c6f-b651-c1017efd922e'} Oct 08 21:19:51.926379 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:19:51.926379 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:19:51.926379 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:19:51.926379 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:19:51.926379 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:19:51.926379 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:19:51.926379 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:19:51.926379 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:19:51.926379 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:19:51.926379 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:19:51.926379 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbd1c1d7-13a9-4c6f-b651-c1017efd922e could not be found. Oct 08 21:19:51.926379 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:19:51.926379 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:19:51.926379 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:19:51.926379 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:19:51.926379 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:19:51.926379 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:19:51.926379 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:19:51.926379 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:19:51.926379 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:19:51.926379 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:19:51.926379 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 08 21:19:51.926379 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 08 21:19:51.926379 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 08 21:19:51.926379 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 08 21:19:51.926379 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:19:51.926379 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:19:51.926379 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:19:51.926379 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:19:51.930577 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbd1c1d7-13a9-4c6f-b651-c1017efd922e could not be found. Oct 08 21:19:51.930577 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:19:51.930577 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:19:51.930577 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:19:51.930577 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:19:51.930577 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:19:51.930577 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:19:51.930577 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:19:51.930577 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:19:51.930577 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbd1c1d7-13a9-4c6f-b651-c1017efd922e could not be found. Oct 08 21:19:51.930577 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:19:51.930577 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-815e7ec5-83e4-417e-a47e-2fd9f4813d97 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Returning 404 to user: Instance bbd1c1d7-13a9-4c6f-b651-c1017efd922e could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:19:51.930577 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-815e7ec5-83e4-417e-a47e-2fd9f4813d97 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] 10.222.0.26 "DELETE /compute/v2.1/servers/bbd1c1d7-13a9-4c6f-b651-c1017efd922e" status: 404 len: 111 microversion: 2.1 time: 0.039991 Oct 08 21:19:51.930577 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2667/5265] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:19:51 2022] DELETE /compute/v2.1/servers/bbd1c1d7-13a9-4c6f-b651-c1017efd922e => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:19:51.932517 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c55ffa64-1d43-4841-9b8c-783ca882e67a tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:51.932517 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c55ffa64-1d43-4841-9b8c-783ca882e67a tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:51.934423 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c55ffa64-1d43-4841-9b8c-783ca882e67a tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:51.937233 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c55ffa64-1d43-4841-9b8c-783ca882e67a tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:51.950632 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-3fd92395-55ff-4b47-9497-d87134c7d27e tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:19:51.951731 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-3fd92395-55ff-4b47-9497-d87134c7d27e tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] [instance: bbd1c1d7-13a9-4c6f-b651-c1017efd922e] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:19:51.959588 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3fd92395-55ff-4b47-9497-d87134c7d27e tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:51.960177 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3fd92395-55ff-4b47-9497-d87134c7d27e tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:51.960746 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3fd92395-55ff-4b47-9497-d87134c7d27e tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:51.961900 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3fd92395-55ff-4b47-9497-d87134c7d27e tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:51.962555 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3fd92395-55ff-4b47-9497-d87134c7d27e tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:51.963073 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3fd92395-55ff-4b47-9497-d87134c7d27e tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:51.982327 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-3fd92395-55ff-4b47-9497-d87134c7d27e tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] HTTP exception thrown: Instance bbd1c1d7-13a9-4c6f-b651-c1017efd922e could not be found. Oct 08 21:19:51.984212 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-3fd92395-55ff-4b47-9497-d87134c7d27e tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Request method failure captured: Oct 08 21:19:51.984212 ncdv-master-1 devstack@n-api.service[140492]: request: GET /compute/v2.1/servers/bbd1c1d7-13a9-4c6f-b651-c1017efd922e HTTP/1.1 Oct 08 21:19:51.984212 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:19:51.984212 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:19:51.984212 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:19:51.984212 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 21:19:51.984212 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:19:51.984212 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:19:51.984212 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:19:51.984212 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:19:51.984212 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQehFIbXs-DGbS_kPUTJMTrUq-WofUYY6ZRyx81bX8dlJ1znB-Icd1X0JZVfoU0lBZbBMu1x5OyOchM7_W_m4wVb0RC5emVnYRQT_LfKB9ZNZm3xjiiSMGa29vJwyibC7NFwQ_T90TzXkiQ39iaomvdVhCKn_tsPv5ogwGAe_Atzwiz8 Oct 08 21:19:51.984212 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:19:51.984212 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:19:51.984212 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:19:51.984212 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:19:51.984212 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:19:51.984212 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:19:51.984212 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 3d9d29b90ab34abbadd21edbca637d2e Oct 08 21:19:51.984212 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-AttachVolumeNegativeTest-1956575659 Oct 08 21:19:51.984212 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:19:51.984212 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:19:51.984212 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3d9d29b90ab34abbadd21edbca637d2e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3d9d29b90ab34abbadd21edbca637d2e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3d9d29b90ab34abbadd21edbca637d2e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3d9d29b90ab34abbadd21edbca637d2e"}]}] Oct 08 21:19:51.984212 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-AttachVolumeNegativeTest-1956575659 Oct 08 21:19:51.984212 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 3d9d29b90ab34abbadd21edbca637d2e Oct 08 21:19:51.984212 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1956575659 Oct 08 21:19:51.984212 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-AttachVolumeNegativeTest-1956575659-project Oct 08 21:19:51.984212 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:19:51.984212 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:19:51.984212 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 8957041987c8487099f0d89f4c64af66 Oct 08 21:19:51.984212 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-AttachVolumeNegativeTest-1956575659-project Oct 08 21:19:51.984212 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 21:19:51.984212 ncdv-master-1 devstack@n-api.service[140492]: exception: Instance bbd1c1d7-13a9-4c6f-b651-c1017efd922e could not be found. Oct 08 21:19:51.984212 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': 'bbd1c1d7-13a9-4c6f-b651-c1017efd922e'} Oct 08 21:19:51.984212 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:19:51.984212 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:19:51.984212 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:19:51.984212 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:19:51.984212 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:19:51.984212 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:19:51.984212 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:19:51.984212 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:19:51.984212 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:19:51.984212 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:19:51.984212 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbd1c1d7-13a9-4c6f-b651-c1017efd922e could not be found. Oct 08 21:19:51.984212 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:19:51.984212 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:19:51.984212 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:19:51.984212 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:19:51.984212 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:19:51.984212 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:19:51.984212 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:19:51.984212 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:19:51.984212 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:19:51.984212 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:19:51.984212 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:19:51.984212 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:19:51.984212 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:19:51.984212 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:19:51.984212 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:19:51.984212 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:19:51.984212 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbd1c1d7-13a9-4c6f-b651-c1017efd922e could not be found. Oct 08 21:19:51.984212 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:19:51.984212 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:19:51.984212 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:19:51.988064 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:19:51.988064 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:19:51.988064 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:19:51.988064 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:19:51.988064 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:19:51.988064 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbd1c1d7-13a9-4c6f-b651-c1017efd922e could not be found. Oct 08 21:19:51.988064 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:19:51.988064 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-3fd92395-55ff-4b47-9497-d87134c7d27e tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Returning 404 to user: Instance bbd1c1d7-13a9-4c6f-b651-c1017efd922e could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:19:51.990098 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-3fd92395-55ff-4b47-9497-d87134c7d27e tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] 10.222.0.26 "GET /compute/v2.1/servers/bbd1c1d7-13a9-4c6f-b651-c1017efd922e" status: 404 len: 111 microversion: 2.1 time: 0.056565 Oct 08 21:19:51.990677 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2668/5266] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:19:51 2022] GET /compute/v2.1/servers/bbd1c1d7-13a9-4c6f-b651-c1017efd922e => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:19:52.150451 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-c55ffa64-1d43-4841-9b8c-783ca882e67a tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537b77eca97d4c1395eeb164bc5e7205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f564837d8eb4b3192109d0dfc9a6fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:19:52.159241 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-c55ffa64-1d43-4841-9b8c-783ca882e67a tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] 10.222.0.26 "GET /compute/v2.1/servers/b7ffbec5-a184-4436-a26c-2188339770cd" status: 200 len: 1314 microversion: 2.1 time: 0.247491 Oct 08 21:19:52.161412 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2599/5267] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:19:51 2022] GET /compute/v2.1/servers/b7ffbec5-a184-4436-a26c-2188339770cd => generated 1314 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:19:52.172668 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-6cb92b4e-efb8-43bd-b883-0a9a11c3ca57 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:19:52.173445 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-6cb92b4e-efb8-43bd-b883-0a9a11c3ca57 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 2a61f287-652b-487f-9ecd-fb4d2d1eee62] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:19:52.182369 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6cb92b4e-efb8-43bd-b883-0a9a11c3ca57 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:52.183166 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6cb92b4e-efb8-43bd-b883-0a9a11c3ca57 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:52.183630 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6cb92b4e-efb8-43bd-b883-0a9a11c3ca57 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:52.184674 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6cb92b4e-efb8-43bd-b883-0a9a11c3ca57 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:52.185440 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6cb92b4e-efb8-43bd-b883-0a9a11c3ca57 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:52.186037 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6cb92b4e-efb8-43bd-b883-0a9a11c3ca57 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:52.513328 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-6cb92b4e-efb8-43bd-b883-0a9a11c3ca57 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:19:52.524533 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-6cb92b4e-efb8-43bd-b883-0a9a11c3ca57 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62" status: 200 len: 1672 microversion: 2.1 time: 0.356487 Oct 08 21:19:52.525133 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2669/5268] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:19:52 2022] GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62 => generated 1672 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:19:53.185804 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-3cfa4ce9-40df-4697-85c2-00777501c3f4 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:19:53.187035 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-3cfa4ce9-40df-4697-85c2-00777501c3f4 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] [instance: b7ffbec5-a184-4436-a26c-2188339770cd] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:19:53.207059 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3cfa4ce9-40df-4697-85c2-00777501c3f4 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:53.207572 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3cfa4ce9-40df-4697-85c2-00777501c3f4 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:53.208024 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3cfa4ce9-40df-4697-85c2-00777501c3f4 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:53.208759 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3cfa4ce9-40df-4697-85c2-00777501c3f4 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:53.209256 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3cfa4ce9-40df-4697-85c2-00777501c3f4 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:53.209690 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3cfa4ce9-40df-4697-85c2-00777501c3f4 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:53.285127 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-2b14dfea-89b6-43b0-9f92-f90a4867fd06 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:19:53.285836 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-2b14dfea-89b6-43b0-9f92-f90a4867fd06 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] [instance: aadddbb1-e053-420e-afd2-9412c6137504] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:19:53.307697 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2b14dfea-89b6-43b0-9f92-f90a4867fd06 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:53.310649 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2b14dfea-89b6-43b0-9f92-f90a4867fd06 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:53.312166 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2b14dfea-89b6-43b0-9f92-f90a4867fd06 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:53.314631 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2b14dfea-89b6-43b0-9f92-f90a4867fd06 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:53.316210 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2b14dfea-89b6-43b0-9f92-f90a4867fd06 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:53.317662 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2b14dfea-89b6-43b0-9f92-f90a4867fd06 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:53.343109 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-2b14dfea-89b6-43b0-9f92-f90a4867fd06 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] HTTP exception thrown: Instance aadddbb1-e053-420e-afd2-9412c6137504 could not be found. Oct 08 21:19:53.346168 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-2b14dfea-89b6-43b0-9f92-f90a4867fd06 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Request method failure captured: Oct 08 21:19:53.346168 ncdv-master-1 devstack@n-api.service[140492]: request: DELETE /compute/v2.1/servers/aadddbb1-e053-420e-afd2-9412c6137504 HTTP/1.1 Oct 08 21:19:53.346168 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:19:53.346168 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:19:53.346168 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:19:53.346168 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 21:19:53.346168 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:19:53.346168 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:19:53.346168 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:19:53.346168 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:19:53.346168 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQehFIbXs-DGbS_kPUTJMTrUq-WofUYY6ZRyx81bX8dlJ1znB-Icd1X0JZVfoU0lBZbBMu1x5OyOchM7_W_m4wVb0RC5emVnYRQT_LfKB9ZNZm3xjiiSMGa29vJwyibC7NFwQ_T90TzXkiQ39iaomvdVhCKn_tsPv5ogwGAe_Atzwiz8 Oct 08 21:19:53.346168 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:19:53.346168 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:19:53.346168 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:19:53.346168 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:19:53.346168 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:19:53.346168 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:19:53.346168 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 3d9d29b90ab34abbadd21edbca637d2e Oct 08 21:19:53.346168 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-AttachVolumeNegativeTest-1956575659 Oct 08 21:19:53.346168 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:19:53.346168 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:19:53.346168 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3d9d29b90ab34abbadd21edbca637d2e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3d9d29b90ab34abbadd21edbca637d2e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3d9d29b90ab34abbadd21edbca637d2e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3d9d29b90ab34abbadd21edbca637d2e"}]}] Oct 08 21:19:53.346168 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-AttachVolumeNegativeTest-1956575659 Oct 08 21:19:53.346168 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 3d9d29b90ab34abbadd21edbca637d2e Oct 08 21:19:53.346168 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1956575659 Oct 08 21:19:53.346168 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-AttachVolumeNegativeTest-1956575659-project Oct 08 21:19:53.346168 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:19:53.346168 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:19:53.346168 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 8957041987c8487099f0d89f4c64af66 Oct 08 21:19:53.346168 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-AttachVolumeNegativeTest-1956575659-project Oct 08 21:19:53.346168 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 21:19:53.346168 ncdv-master-1 devstack@n-api.service[140492]: exception: Instance aadddbb1-e053-420e-afd2-9412c6137504 could not be found. Oct 08 21:19:53.346168 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': 'aadddbb1-e053-420e-afd2-9412c6137504'} Oct 08 21:19:53.346168 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:19:53.346168 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:19:53.346168 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:19:53.346168 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:19:53.346168 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:19:53.346168 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:19:53.346168 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:19:53.346168 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:19:53.346168 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:19:53.346168 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:19:53.346168 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aadddbb1-e053-420e-afd2-9412c6137504 could not be found. Oct 08 21:19:53.346168 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:19:53.346168 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:19:53.346168 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:19:53.346168 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:19:53.346168 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:19:53.346168 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:19:53.346168 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:19:53.346168 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:19:53.346168 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:19:53.346168 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:19:53.346168 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 08 21:19:53.346168 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 08 21:19:53.346168 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 08 21:19:53.346168 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 08 21:19:53.346168 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:19:53.346168 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:19:53.346168 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:19:53.346168 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:19:53.354008 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aadddbb1-e053-420e-afd2-9412c6137504 could not be found. Oct 08 21:19:53.354008 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:19:53.354008 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:19:53.354008 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:19:53.354008 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:19:53.354008 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:19:53.354008 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:19:53.354008 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:19:53.354008 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:19:53.354008 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aadddbb1-e053-420e-afd2-9412c6137504 could not be found. Oct 08 21:19:53.354008 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:19:53.358037 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-2b14dfea-89b6-43b0-9f92-f90a4867fd06 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Returning 404 to user: Instance aadddbb1-e053-420e-afd2-9412c6137504 could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:19:53.360670 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-2b14dfea-89b6-43b0-9f92-f90a4867fd06 tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] 10.222.0.26 "DELETE /compute/v2.1/servers/aadddbb1-e053-420e-afd2-9412c6137504" status: 404 len: 111 microversion: 2.1 time: 0.079193 Oct 08 21:19:53.362420 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2670/5269] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:19:53 2022] DELETE /compute/v2.1/servers/aadddbb1-e053-420e-afd2-9412c6137504 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 08 21:19:53.370068 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-5f0876e7-1545-4a45-9f13-fb9d7f13508f req-c9eafe1e-1f6d-43f1-b5e4-b720aac41cd5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7ffbec5-a184-4436-a26c-2188339770cd", "name": "network-vif-plugged", "status": "completed", "tag": "6f474ff9-590b-4669-af6c-f47947d9c740"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:19:53.382981 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-5f0876e7-1545-4a45-9f13-fb9d7f13508f req-c9eafe1e-1f6d-43f1-b5e4-b720aac41cd5 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:53.383745 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-5f0876e7-1545-4a45-9f13-fb9d7f13508f req-c9eafe1e-1f6d-43f1-b5e4-b720aac41cd5 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:53.384693 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-5f0876e7-1545-4a45-9f13-fb9d7f13508f req-c9eafe1e-1f6d-43f1-b5e4-b720aac41cd5 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:53.402146 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-5f0876e7-1545-4a45-9f13-fb9d7f13508f req-c9eafe1e-1f6d-43f1-b5e4-b720aac41cd5 service nova] Creating event network-vif-plugged:6f474ff9-590b-4669-af6c-f47947d9c740 for instance b7ffbec5-a184-4436-a26c-2188339770cd on nch2-master-1 Oct 08 21:19:53.408451 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-5f0876e7-1545-4a45-9f13-fb9d7f13508f req-c9eafe1e-1f6d-43f1-b5e4-b720aac41cd5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044388 Oct 08 21:19:53.412240 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2671/5270] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:19:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:19:53.421877 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-77cf039a-8052-42f7-89f1-ea7cd1f2cb7f tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:19:53.423948 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-77cf039a-8052-42f7-89f1-ea7cd1f2cb7f tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] [instance: aadddbb1-e053-420e-afd2-9412c6137504] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:19:53.434466 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-77cf039a-8052-42f7-89f1-ea7cd1f2cb7f tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:53.434973 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-77cf039a-8052-42f7-89f1-ea7cd1f2cb7f tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:53.435613 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-77cf039a-8052-42f7-89f1-ea7cd1f2cb7f tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:53.436761 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-77cf039a-8052-42f7-89f1-ea7cd1f2cb7f tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:53.437439 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-77cf039a-8052-42f7-89f1-ea7cd1f2cb7f tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:53.438309 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-77cf039a-8052-42f7-89f1-ea7cd1f2cb7f tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:53.456451 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-77cf039a-8052-42f7-89f1-ea7cd1f2cb7f tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] HTTP exception thrown: Instance aadddbb1-e053-420e-afd2-9412c6137504 could not be found. Oct 08 21:19:53.459334 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-77cf039a-8052-42f7-89f1-ea7cd1f2cb7f tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Request method failure captured: Oct 08 21:19:53.459334 ncdv-master-1 devstack@n-api.service[140492]: request: GET /compute/v2.1/servers/aadddbb1-e053-420e-afd2-9412c6137504 HTTP/1.1 Oct 08 21:19:53.459334 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:19:53.459334 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:19:53.459334 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:19:53.459334 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 21:19:53.459334 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:19:53.459334 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:19:53.459334 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:19:53.459334 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:19:53.459334 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQehFIbXs-DGbS_kPUTJMTrUq-WofUYY6ZRyx81bX8dlJ1znB-Icd1X0JZVfoU0lBZbBMu1x5OyOchM7_W_m4wVb0RC5emVnYRQT_LfKB9ZNZm3xjiiSMGa29vJwyibC7NFwQ_T90TzXkiQ39iaomvdVhCKn_tsPv5ogwGAe_Atzwiz8 Oct 08 21:19:53.459334 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:19:53.459334 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:19:53.459334 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:19:53.459334 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:19:53.459334 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:19:53.459334 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:19:53.459334 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 3d9d29b90ab34abbadd21edbca637d2e Oct 08 21:19:53.459334 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-AttachVolumeNegativeTest-1956575659 Oct 08 21:19:53.459334 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:19:53.459334 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:19:53.459334 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3d9d29b90ab34abbadd21edbca637d2e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3d9d29b90ab34abbadd21edbca637d2e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3d9d29b90ab34abbadd21edbca637d2e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3d9d29b90ab34abbadd21edbca637d2e"}]}] Oct 08 21:19:53.459334 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-AttachVolumeNegativeTest-1956575659 Oct 08 21:19:53.459334 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 3d9d29b90ab34abbadd21edbca637d2e Oct 08 21:19:53.459334 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1956575659 Oct 08 21:19:53.459334 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-AttachVolumeNegativeTest-1956575659-project Oct 08 21:19:53.459334 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:19:53.459334 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:19:53.459334 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 8957041987c8487099f0d89f4c64af66 Oct 08 21:19:53.459334 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-AttachVolumeNegativeTest-1956575659-project Oct 08 21:19:53.459334 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 21:19:53.459334 ncdv-master-1 devstack@n-api.service[140492]: exception: Instance aadddbb1-e053-420e-afd2-9412c6137504 could not be found. Oct 08 21:19:53.459334 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': 'aadddbb1-e053-420e-afd2-9412c6137504'} Oct 08 21:19:53.459334 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:19:53.459334 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:19:53.459334 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:19:53.459334 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:19:53.459334 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:19:53.459334 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:19:53.459334 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:19:53.459334 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:19:53.459334 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:19:53.459334 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:19:53.459334 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aadddbb1-e053-420e-afd2-9412c6137504 could not be found. Oct 08 21:19:53.459334 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:19:53.459334 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:19:53.459334 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:19:53.459334 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:19:53.459334 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:19:53.459334 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:19:53.459334 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:19:53.459334 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:19:53.459334 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:19:53.459334 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:19:53.459334 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:19:53.459334 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:19:53.459334 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:19:53.459334 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:19:53.459334 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:19:53.459334 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:19:53.459334 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aadddbb1-e053-420e-afd2-9412c6137504 could not be found. Oct 08 21:19:53.459334 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:19:53.459334 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:19:53.459334 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:19:53.463355 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:19:53.463355 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:19:53.463355 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:19:53.463355 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:19:53.463355 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:19:53.463355 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aadddbb1-e053-420e-afd2-9412c6137504 could not be found. Oct 08 21:19:53.463355 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:19:53.466272 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-77cf039a-8052-42f7-89f1-ea7cd1f2cb7f tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] Returning 404 to user: Instance aadddbb1-e053-420e-afd2-9412c6137504 could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:19:53.467447 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-77cf039a-8052-42f7-89f1-ea7cd1f2cb7f tempest-AttachVolumeNegativeTest-1956575659 tempest-AttachVolumeNegativeTest-1956575659-project] 10.222.0.26 "GET /compute/v2.1/servers/aadddbb1-e053-420e-afd2-9412c6137504" status: 404 len: 111 microversion: 2.1 time: 0.056032 Oct 08 21:19:53.472421 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2672/5271] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:19:53 2022] GET /compute/v2.1/servers/aadddbb1-e053-420e-afd2-9412c6137504 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:19:53.479043 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-3cfa4ce9-40df-4697-85c2-00777501c3f4 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537b77eca97d4c1395eeb164bc5e7205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f564837d8eb4b3192109d0dfc9a6fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:19:53.498009 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-3cfa4ce9-40df-4697-85c2-00777501c3f4 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] 10.222.0.26 "GET /compute/v2.1/servers/b7ffbec5-a184-4436-a26c-2188339770cd" status: 200 len: 1314 microversion: 2.1 time: 0.316170 Oct 08 21:19:53.499462 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2600/5272] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:19:53 2022] GET /compute/v2.1/servers/b7ffbec5-a184-4436-a26c-2188339770cd => generated 1314 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:19:53.548417 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-50f4ca50-ca37-460d-9072-92e0e391f4fd tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:19:53.549332 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-50f4ca50-ca37-460d-9072-92e0e391f4fd tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 2a61f287-652b-487f-9ecd-fb4d2d1eee62] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:19:53.555778 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-50f4ca50-ca37-460d-9072-92e0e391f4fd tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:53.556680 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-50f4ca50-ca37-460d-9072-92e0e391f4fd tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:53.557386 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-50f4ca50-ca37-460d-9072-92e0e391f4fd tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:53.558583 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-50f4ca50-ca37-460d-9072-92e0e391f4fd tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:53.559243 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-50f4ca50-ca37-460d-9072-92e0e391f4fd tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:53.559874 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-50f4ca50-ca37-460d-9072-92e0e391f4fd tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:53.810255 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-50f4ca50-ca37-460d-9072-92e0e391f4fd tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:19:53.828161 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-50f4ca50-ca37-460d-9072-92e0e391f4fd tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62" status: 200 len: 1670 microversion: 2.1 time: 0.283377 Oct 08 21:19:53.829278 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2673/5273] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:19:53 2022] GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62 => generated 1670 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:19:53.853071 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-3d88e71e-5488-4922-ad55-10637a5d1281 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:19:53.856876 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-3d88e71e-5488-4922-ad55-10637a5d1281 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 2a61f287-652b-487f-9ecd-fb4d2d1eee62] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:19:53.877633 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3d88e71e-5488-4922-ad55-10637a5d1281 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:53.878435 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3d88e71e-5488-4922-ad55-10637a5d1281 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:53.879324 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3d88e71e-5488-4922-ad55-10637a5d1281 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:53.880337 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3d88e71e-5488-4922-ad55-10637a5d1281 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:53.881324 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3d88e71e-5488-4922-ad55-10637a5d1281 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:53.882010 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3d88e71e-5488-4922-ad55-10637a5d1281 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:53.946237 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-3d88e71e-5488-4922-ad55-10637a5d1281 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "POST /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62/action" status: 200 len: 322 microversion: 2.1 time: 0.097475 Oct 08 21:19:53.947607 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2601/5274] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:19:53 2022] POST /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62/action => generated 322 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:19:53.959216 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-b0850154-11cb-4324-842f-728e2adda08c tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:19:53.961448 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-b0850154-11cb-4324-842f-728e2adda08c tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 2a61f287-652b-487f-9ecd-fb4d2d1eee62] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:19:53.971634 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b0850154-11cb-4324-842f-728e2adda08c tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:53.972406 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b0850154-11cb-4324-842f-728e2adda08c tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:53.973105 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b0850154-11cb-4324-842f-728e2adda08c tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:53.975072 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b0850154-11cb-4324-842f-728e2adda08c tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:53.975920 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b0850154-11cb-4324-842f-728e2adda08c tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:53.976470 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b0850154-11cb-4324-842f-728e2adda08c tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:54.182679 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-b0850154-11cb-4324-842f-728e2adda08c tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:19:54.197490 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-b0850154-11cb-4324-842f-728e2adda08c tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62" status: 200 len: 1670 microversion: 2.1 time: 0.243865 Oct 08 21:19:54.201669 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2674/5275] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:19:53 2022] GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62 => generated 1670 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:19:54.225257 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-2f1790a1-dab6-4348-bd99-81bca3381a7d tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:19:54.226995 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-2f1790a1-dab6-4348-bd99-81bca3381a7d tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 2a61f287-652b-487f-9ecd-fb4d2d1eee62] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:19:54.235270 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2f1790a1-dab6-4348-bd99-81bca3381a7d tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:54.235989 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2f1790a1-dab6-4348-bd99-81bca3381a7d tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:54.236679 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2f1790a1-dab6-4348-bd99-81bca3381a7d tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:54.237793 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2f1790a1-dab6-4348-bd99-81bca3381a7d tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:54.238511 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2f1790a1-dab6-4348-bd99-81bca3381a7d tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:54.239046 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2f1790a1-dab6-4348-bd99-81bca3381a7d tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:54.525061 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-390f8214-5003-4558-8503-a24c6a5d85a5 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:19:54.525729 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-390f8214-5003-4558-8503-a24c6a5d85a5 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] [instance: b7ffbec5-a184-4436-a26c-2188339770cd] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:19:54.540281 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-390f8214-5003-4558-8503-a24c6a5d85a5 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:54.541076 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-390f8214-5003-4558-8503-a24c6a5d85a5 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:54.541570 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-390f8214-5003-4558-8503-a24c6a5d85a5 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:54.542493 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-390f8214-5003-4558-8503-a24c6a5d85a5 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:54.542913 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-390f8214-5003-4558-8503-a24c6a5d85a5 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:54.543351 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-390f8214-5003-4558-8503-a24c6a5d85a5 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:54.548319 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-2f1790a1-dab6-4348-bd99-81bca3381a7d tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:19:54.559753 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-2f1790a1-dab6-4348-bd99-81bca3381a7d tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62" status: 200 len: 1670 microversion: 2.1 time: 0.339032 Oct 08 21:19:54.562017 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2602/5276] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:19:54 2022] GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62 => generated 1670 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:19:54.586232 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-0ae87a84-2e1f-487d-b2ff-3687ed0f91c0 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:19:54.587395 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-0ae87a84-2e1f-487d-b2ff-3687ed0f91c0 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 2a61f287-652b-487f-9ecd-fb4d2d1eee62] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:19:54.598902 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0ae87a84-2e1f-487d-b2ff-3687ed0f91c0 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:54.599809 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0ae87a84-2e1f-487d-b2ff-3687ed0f91c0 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:54.602105 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0ae87a84-2e1f-487d-b2ff-3687ed0f91c0 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:54.603316 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0ae87a84-2e1f-487d-b2ff-3687ed0f91c0 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:54.604941 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0ae87a84-2e1f-487d-b2ff-3687ed0f91c0 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:54.622733 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0ae87a84-2e1f-487d-b2ff-3687ed0f91c0 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:54.849640 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-390f8214-5003-4558-8503-a24c6a5d85a5 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537b77eca97d4c1395eeb164bc5e7205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f564837d8eb4b3192109d0dfc9a6fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:19:54.859696 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-390f8214-5003-4558-8503-a24c6a5d85a5 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] 10.222.0.26 "GET /compute/v2.1/servers/b7ffbec5-a184-4436-a26c-2188339770cd" status: 200 len: 1314 microversion: 2.1 time: 0.338341 Oct 08 21:19:54.860291 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2675/5277] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:19:54 2022] GET /compute/v2.1/servers/b7ffbec5-a184-4436-a26c-2188339770cd => generated 1314 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:19:54.884369 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-0ae87a84-2e1f-487d-b2ff-3687ed0f91c0 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:19:54.894019 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-0ae87a84-2e1f-487d-b2ff-3687ed0f91c0 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62" status: 200 len: 1670 microversion: 2.1 time: 0.312198 Oct 08 21:19:54.894952 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2603/5278] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:19:54 2022] GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62 => generated 1670 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:19:54.916645 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-43e5742d-2634-4fbd-afea-e145ec29b5f4 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:19:54.918184 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-43e5742d-2634-4fbd-afea-e145ec29b5f4 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 2a61f287-652b-487f-9ecd-fb4d2d1eee62] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:19:54.925421 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-43e5742d-2634-4fbd-afea-e145ec29b5f4 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:54.926121 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-43e5742d-2634-4fbd-afea-e145ec29b5f4 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:54.926574 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-43e5742d-2634-4fbd-afea-e145ec29b5f4 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:54.927411 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-43e5742d-2634-4fbd-afea-e145ec29b5f4 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:54.927917 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-43e5742d-2634-4fbd-afea-e145ec29b5f4 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:54.928472 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-43e5742d-2634-4fbd-afea-e145ec29b5f4 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:55.125796 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-43e5742d-2634-4fbd-afea-e145ec29b5f4 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:19:55.136459 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-43e5742d-2634-4fbd-afea-e145ec29b5f4 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62" status: 200 len: 1670 microversion: 2.1 time: 0.222368 Oct 08 21:19:55.143797 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2676/5279] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:19:54 2022] GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62 => generated 1670 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:19:55.317408 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-559c71ee-2cdf-4a7f-885d-c4cbba7440c3 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1122565410", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "networks": [{"uuid": "f6f1b01d-e3ee-45fc-896d-218868fb9293"}]}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:19:55.399253 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.network.neutron [None req-559c71ee-2cdf-4a7f-885d-c4cbba7440c3 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] validate_networks() for [('f6f1b01d-e3ee-45fc-896d-218868fb9293', None, None, None, None, None)] {{(pid=140491) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 21:19:55.885515 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-d83d49b6-7dfb-4883-a249-e93a65671191 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:19:55.887459 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-d83d49b6-7dfb-4883-a249-e93a65671191 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] [instance: b7ffbec5-a184-4436-a26c-2188339770cd] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:19:55.894797 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d83d49b6-7dfb-4883-a249-e93a65671191 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:55.896713 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d83d49b6-7dfb-4883-a249-e93a65671191 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:55.897444 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d83d49b6-7dfb-4883-a249-e93a65671191 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:55.898498 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d83d49b6-7dfb-4883-a249-e93a65671191 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:55.899130 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d83d49b6-7dfb-4883-a249-e93a65671191 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:55.899745 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d83d49b6-7dfb-4883-a249-e93a65671191 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:56.075690 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-d83d49b6-7dfb-4883-a249-e93a65671191 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537b77eca97d4c1395eeb164bc5e7205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f564837d8eb4b3192109d0dfc9a6fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:19:56.090683 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-d83d49b6-7dfb-4883-a249-e93a65671191 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] 10.222.0.26 "GET /compute/v2.1/servers/b7ffbec5-a184-4436-a26c-2188339770cd" status: 200 len: 1499 microversion: 2.1 time: 0.208672 Oct 08 21:19:56.107162 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2677/5280] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:19:55 2022] GET /compute/v2.1/servers/b7ffbec5-a184-4436-a26c-2188339770cd => generated 1499 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:19:56.174822 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-559c71ee-2cdf-4a7f-885d-c4cbba7440c3 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Flavor limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 21:19:56.175612 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-559c71ee-2cdf-4a7f-885d-c4cbba7440c3 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Image limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 21:19:56.177071 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-559c71ee-2cdf-4a7f-885d-c4cbba7440c3 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Flavor pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 21:19:56.177818 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-559c71ee-2cdf-4a7f-885d-c4cbba7440c3 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Image pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 21:19:56.179874 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-559c71ee-2cdf-4a7f-885d-c4cbba7440c3 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 21:19:56.194260 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-559c71ee-2cdf-4a7f-885d-c4cbba7440c3 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:56.194761 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-559c71ee-2cdf-4a7f-885d-c4cbba7440c3 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:56.195514 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-559c71ee-2cdf-4a7f-885d-c4cbba7440c3 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:56.197061 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-559c71ee-2cdf-4a7f-885d-c4cbba7440c3 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:56.197776 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-559c71ee-2cdf-4a7f-885d-c4cbba7440c3 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:56.201267 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-559c71ee-2cdf-4a7f-885d-c4cbba7440c3 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:56.267587 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-559c71ee-2cdf-4a7f-885d-c4cbba7440c3 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Getting quotas for project bd563fa73afb42c6b26eca3737d7a355. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:19:56.284152 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-559c71ee-2cdf-4a7f-885d-c4cbba7440c3 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Getting quotas for user 2f98e01cab6b49c7a5d239aee95f4a64 and project bd563fa73afb42c6b26eca3737d7a355. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:19:56.307813 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-559c71ee-2cdf-4a7f-885d-c4cbba7440c3 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Going to run 1 instances... {{(pid=140491) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 21:19:56.311706 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-559c71ee-2cdf-4a7f-885d-c4cbba7440c3 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: e2ddf0fe-e190-4867-8257-539427de8de4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c508bd7f-7db9-4b2c-af7c-be54a855c355',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140491) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 21:19:56.446080 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-559c71ee-2cdf-4a7f-885d-c4cbba7440c3 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.132673 Oct 08 21:19:56.452158 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2604/5281] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 21:19:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1141 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 08 21:19:56.470728 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-b1d07007-5855-4225-a06b-49dd13aabd8e tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:19:56.470728 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-b1d07007-5855-4225-a06b-49dd13aabd8e tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: e2ddf0fe-e190-4867-8257-539427de8de4] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:19:56.611497 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-b1d07007-5855-4225-a06b-49dd13aabd8e tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:19:56.624085 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-b1d07007-5855-4225-a06b-49dd13aabd8e tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/e2ddf0fe-e190-4867-8257-539427de8de4" status: 200 len: 1215 microversion: 2.1 time: 0.162912 Oct 08 21:19:56.635543 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2678/5282] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:19:56 2022] GET /compute/v2.1/servers/e2ddf0fe-e190-4867-8257-539427de8de4 => generated 1215 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:19:56.863094 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-bbcc1b33-ef73-406a-b1b4-f0cfd30b27a2 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:19:56.864590 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-bbcc1b33-ef73-406a-b1b4-f0cfd30b27a2 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] [instance: b7ffbec5-a184-4436-a26c-2188339770cd] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:19:56.881802 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bbcc1b33-ef73-406a-b1b4-f0cfd30b27a2 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:56.882353 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bbcc1b33-ef73-406a-b1b4-f0cfd30b27a2 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:56.882770 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bbcc1b33-ef73-406a-b1b4-f0cfd30b27a2 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:56.884727 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bbcc1b33-ef73-406a-b1b4-f0cfd30b27a2 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:56.885306 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bbcc1b33-ef73-406a-b1b4-f0cfd30b27a2 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:56.885759 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bbcc1b33-ef73-406a-b1b4-f0cfd30b27a2 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:56.919879 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-bbcc1b33-ef73-406a-b1b4-f0cfd30b27a2 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] [instance: b7ffbec5-a184-4436-a26c-2188339770cd] Going to try to terminate instance {{(pid=140491) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 21:19:57.072246 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-bbcc1b33-ef73-406a-b1b4-f0cfd30b27a2 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] 10.222.0.26 "DELETE /compute/v2.1/servers/b7ffbec5-a184-4436-a26c-2188339770cd" status: 204 len: 0 microversion: 2.1 time: 0.214406 Oct 08 21:19:57.077897 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2605/5283] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:19:56 2022] DELETE /compute/v2.1/servers/b7ffbec5-a184-4436-a26c-2188339770cd => generated 0 bytes in 217 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 21:19:57.089478 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-cc8958ba-d690-4313-a63d-e749b1e4e4ac tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:19:57.090268 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-cc8958ba-d690-4313-a63d-e749b1e4e4ac tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] [instance: b7ffbec5-a184-4436-a26c-2188339770cd] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:19:57.100282 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cc8958ba-d690-4313-a63d-e749b1e4e4ac tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:57.102285 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cc8958ba-d690-4313-a63d-e749b1e4e4ac tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:57.103295 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cc8958ba-d690-4313-a63d-e749b1e4e4ac tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:57.104759 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cc8958ba-d690-4313-a63d-e749b1e4e4ac tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:57.106038 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cc8958ba-d690-4313-a63d-e749b1e4e4ac tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:57.106750 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cc8958ba-d690-4313-a63d-e749b1e4e4ac tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:57.497145 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-cc8958ba-d690-4313-a63d-e749b1e4e4ac tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537b77eca97d4c1395eeb164bc5e7205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f564837d8eb4b3192109d0dfc9a6fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:19:57.508856 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-cc8958ba-d690-4313-a63d-e749b1e4e4ac tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] 10.222.0.26 "GET /compute/v2.1/servers/b7ffbec5-a184-4436-a26c-2188339770cd" status: 200 len: 1505 microversion: 2.1 time: 0.425264 Oct 08 21:19:57.509713 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2679/5284] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:19:57 2022] GET /compute/v2.1/servers/b7ffbec5-a184-4436-a26c-2188339770cd => generated 1505 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:19:57.655625 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-ec8a20dd-c619-40f6-9cd3-65961b446e51 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:19:57.656423 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-ec8a20dd-c619-40f6-9cd3-65961b446e51 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: e2ddf0fe-e190-4867-8257-539427de8de4] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:19:57.698533 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ec8a20dd-c619-40f6-9cd3-65961b446e51 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:57.699303 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ec8a20dd-c619-40f6-9cd3-65961b446e51 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:57.701357 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ec8a20dd-c619-40f6-9cd3-65961b446e51 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:57.713794 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ec8a20dd-c619-40f6-9cd3-65961b446e51 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:57.714383 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ec8a20dd-c619-40f6-9cd3-65961b446e51 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:57.714894 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ec8a20dd-c619-40f6-9cd3-65961b446e51 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:57.839174 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-ec8a20dd-c619-40f6-9cd3-65961b446e51 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:19:57.851143 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-ec8a20dd-c619-40f6-9cd3-65961b446e51 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/e2ddf0fe-e190-4867-8257-539427de8de4" status: 200 len: 1267 microversion: 2.1 time: 0.203332 Oct 08 21:19:57.853659 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2606/5285] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:19:57 2022] GET /compute/v2.1/servers/e2ddf0fe-e190-4867-8257-539427de8de4 => generated 1267 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:19:58.536435 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-f56d2720-563e-4db4-939f-203e0e3d65fc tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:19:58.537696 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-f56d2720-563e-4db4-939f-203e0e3d65fc tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] [instance: b7ffbec5-a184-4436-a26c-2188339770cd] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:19:58.563608 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f56d2720-563e-4db4-939f-203e0e3d65fc tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:58.565023 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f56d2720-563e-4db4-939f-203e0e3d65fc tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:58.565937 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f56d2720-563e-4db4-939f-203e0e3d65fc tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:58.568466 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f56d2720-563e-4db4-939f-203e0e3d65fc tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:58.568960 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f56d2720-563e-4db4-939f-203e0e3d65fc tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:58.572401 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f56d2720-563e-4db4-939f-203e0e3d65fc tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:58.880170 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-4a733ecc-986d-44de-ac25-e312f4d4bae8 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:19:58.880932 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-4a733ecc-986d-44de-ac25-e312f4d4bae8 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: e2ddf0fe-e190-4867-8257-539427de8de4] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:19:58.899738 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4a733ecc-986d-44de-ac25-e312f4d4bae8 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:58.900246 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4a733ecc-986d-44de-ac25-e312f4d4bae8 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:58.904516 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4a733ecc-986d-44de-ac25-e312f4d4bae8 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:58.906557 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4a733ecc-986d-44de-ac25-e312f4d4bae8 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:58.907065 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4a733ecc-986d-44de-ac25-e312f4d4bae8 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:58.907521 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4a733ecc-986d-44de-ac25-e312f4d4bae8 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:59.048498 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-f56d2720-563e-4db4-939f-203e0e3d65fc tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537b77eca97d4c1395eeb164bc5e7205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f564837d8eb4b3192109d0dfc9a6fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:19:59.052121 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-4a733ecc-986d-44de-ac25-e312f4d4bae8 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:19:59.060754 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-4a733ecc-986d-44de-ac25-e312f4d4bae8 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/e2ddf0fe-e190-4867-8257-539427de8de4" status: 200 len: 1273 microversion: 2.1 time: 0.188154 Oct 08 21:19:59.061369 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2607/5286] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:19:58 2022] GET /compute/v2.1/servers/e2ddf0fe-e190-4867-8257-539427de8de4 => generated 1273 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:19:59.078562 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-f56d2720-563e-4db4-939f-203e0e3d65fc tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] 10.222.0.26 "GET /compute/v2.1/servers/b7ffbec5-a184-4436-a26c-2188339770cd" status: 200 len: 1505 microversion: 2.1 time: 0.547806 Oct 08 21:19:59.097277 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2680/5287] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:19:58 2022] GET /compute/v2.1/servers/b7ffbec5-a184-4436-a26c-2188339770cd => generated 1505 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:19:59.554082 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-0c2d2712-5513-423e-a744-05214b39eaab req-c683877e-efc8-409f-90e0-d651c96aba9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7ffbec5-a184-4436-a26c-2188339770cd", "name": "network-vif-deleted", "tag": "6f474ff9-590b-4669-af6c-f47947d9c740"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:19:59.569590 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-0c2d2712-5513-423e-a744-05214b39eaab req-c683877e-efc8-409f-90e0-d651c96aba9e service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:19:59.570437 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-0c2d2712-5513-423e-a744-05214b39eaab req-c683877e-efc8-409f-90e0-d651c96aba9e service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:19:59.571651 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-0c2d2712-5513-423e-a744-05214b39eaab req-c683877e-efc8-409f-90e0-d651c96aba9e service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:19:59.588215 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-0c2d2712-5513-423e-a744-05214b39eaab req-c683877e-efc8-409f-90e0-d651c96aba9e service nova] Creating event network-vif-deleted:6f474ff9-590b-4669-af6c-f47947d9c740 for instance b7ffbec5-a184-4436-a26c-2188339770cd on nch2-master-1 Oct 08 21:19:59.600456 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-0c2d2712-5513-423e-a744-05214b39eaab req-c683877e-efc8-409f-90e0-d651c96aba9e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057312 Oct 08 21:19:59.602064 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2608/5288] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:19:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:20:00.083971 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-29a7ab02-2591-4b15-8df2-4656662ece5b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:20:00.084727 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-29a7ab02-2591-4b15-8df2-4656662ece5b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: e2ddf0fe-e190-4867-8257-539427de8de4] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:20:00.101367 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-29a7ab02-2591-4b15-8df2-4656662ece5b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:00.101826 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-29a7ab02-2591-4b15-8df2-4656662ece5b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:00.111869 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-29a7ab02-2591-4b15-8df2-4656662ece5b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:00.112895 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-29a7ab02-2591-4b15-8df2-4656662ece5b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:00.113436 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-29a7ab02-2591-4b15-8df2-4656662ece5b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:00.113905 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-29a7ab02-2591-4b15-8df2-4656662ece5b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:00.117992 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-46b72e17-1aa8-4fbd-bd4d-f1fba7bea53a tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:20:00.122902 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-46b72e17-1aa8-4fbd-bd4d-f1fba7bea53a tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] [instance: b7ffbec5-a184-4436-a26c-2188339770cd] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:20:00.149522 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-46b72e17-1aa8-4fbd-bd4d-f1fba7bea53a tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:00.152461 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-46b72e17-1aa8-4fbd-bd4d-f1fba7bea53a tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:00.153742 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-46b72e17-1aa8-4fbd-bd4d-f1fba7bea53a tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:00.156648 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-46b72e17-1aa8-4fbd-bd4d-f1fba7bea53a tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:00.157676 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-46b72e17-1aa8-4fbd-bd4d-f1fba7bea53a tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:00.158131 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-46b72e17-1aa8-4fbd-bd4d-f1fba7bea53a tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:00.303827 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-46b72e17-1aa8-4fbd-bd4d-f1fba7bea53a tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:00.307619 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-46b72e17-1aa8-4fbd-bd4d-f1fba7bea53a tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:00.308917 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-46b72e17-1aa8-4fbd-bd4d-f1fba7bea53a tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:00.309835 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.objects.instance [None req-46b72e17-1aa8-4fbd-bd4d-f1fba7bea53a tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Lazy-loading 'fault' on Instance uuid b7ffbec5-a184-4436-a26c-2188339770cd {{(pid=140491) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 21:20:00.404498 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-46b72e17-1aa8-4fbd-bd4d-f1fba7bea53a tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537b77eca97d4c1395eeb164bc5e7205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f564837d8eb4b3192109d0dfc9a6fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:20:00.416078 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-46b72e17-1aa8-4fbd-bd4d-f1fba7bea53a tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] 10.222.0.26 "GET /compute/v2.1/servers/b7ffbec5-a184-4436-a26c-2188339770cd" status: 200 len: 1304 microversion: 2.1 time: 0.316634 Oct 08 21:20:00.417600 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2609/5289] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:20:00 2022] GET /compute/v2.1/servers/b7ffbec5-a184-4436-a26c-2188339770cd => generated 1304 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:20:00.550218 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-29a7ab02-2591-4b15-8df2-4656662ece5b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:20:00.561348 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-29a7ab02-2591-4b15-8df2-4656662ece5b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/e2ddf0fe-e190-4867-8257-539427de8de4" status: 200 len: 1315 microversion: 2.1 time: 0.480412 Oct 08 21:20:00.562613 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2681/5290] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:20:00 2022] GET /compute/v2.1/servers/e2ddf0fe-e190-4867-8257-539427de8de4 => generated 1315 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:20:01.309568 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-f1e3eb33-99af-492f-8978-b644b94aba4d tempest-VolumesGetTestJSON-606081357 tempest-VolumesGetTestJSON-606081357-project] Action: 'create', calling method: .version_select at 0x7f1a914c9430>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-498815044", "metadata": {"Type": "work"}}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:20:01.444006 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-31c5f677-7edf-41af-9819-761ce4aa07e0 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:20:01.445719 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-31c5f677-7edf-41af-9819-761ce4aa07e0 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] [instance: b7ffbec5-a184-4436-a26c-2188339770cd] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:20:01.480488 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-31c5f677-7edf-41af-9819-761ce4aa07e0 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:01.486109 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-31c5f677-7edf-41af-9819-761ce4aa07e0 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:01.486820 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-31c5f677-7edf-41af-9819-761ce4aa07e0 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:01.491071 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-31c5f677-7edf-41af-9819-761ce4aa07e0 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:01.492447 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-31c5f677-7edf-41af-9819-761ce4aa07e0 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:01.495001 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-31c5f677-7edf-41af-9819-761ce4aa07e0 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:01.520137 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-31c5f677-7edf-41af-9819-761ce4aa07e0 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] HTTP exception thrown: Instance b7ffbec5-a184-4436-a26c-2188339770cd could not be found. Oct 08 21:20:01.522471 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-31c5f677-7edf-41af-9819-761ce4aa07e0 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Request method failure captured: Oct 08 21:20:01.522471 ncdv-master-1 devstack@n-api.service[140492]: request: GET /compute/v2.1/servers/b7ffbec5-a184-4436-a26c-2188339770cd HTTP/1.1 Oct 08 21:20:01.522471 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:20:01.522471 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:20:01.522471 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:20:01.522471 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 21:20:01.522471 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:20:01.522471 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:20:01.522471 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:20:01.522471 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:20:01.522471 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQelnbr7r5WAd0lFjTfuyUYOqjAHFJU24PBK3aZp2wCGbNrMq0ti-YN2KNNQCVl9VdThEqFaQsHLHueqQo6IH7dbd3LMSY2Pulf0Iyqc-15FIOl3RsXDarIVVLBA20UlWTl0UcGI33gjV5_qdApJiDiFI4l8ked2vhhsUoll_Ci5U7Us Oct 08 21:20:01.522471 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:20:01.522471 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:20:01.522471 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:20:01.522471 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:20:01.522471 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:20:01.522471 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:20:01.522471 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 2f564837d8eb4b3192109d0dfc9a6fab Oct 08 21:20:01.522471 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-VolumesActionsTest-42924472 Oct 08 21:20:01.522471 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:20:01.522471 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:20:01.522471 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/2f564837d8eb4b3192109d0dfc9a6fab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2f564837d8eb4b3192109d0dfc9a6fab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_2f564837d8eb4b3192109d0dfc9a6fab"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2f564837d8eb4b3192109d0dfc9a6fab"}]}] Oct 08 21:20:01.522471 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-VolumesActionsTest-42924472 Oct 08 21:20:01.522471 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 2f564837d8eb4b3192109d0dfc9a6fab Oct 08 21:20:01.522471 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-VolumesActionsTest-42924472 Oct 08 21:20:01.522471 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-VolumesActionsTest-42924472-project Oct 08 21:20:01.522471 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:20:01.522471 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:20:01.522471 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 537b77eca97d4c1395eeb164bc5e7205 Oct 08 21:20:01.522471 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-VolumesActionsTest-42924472-project Oct 08 21:20:01.522471 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 21:20:01.522471 ncdv-master-1 devstack@n-api.service[140492]: exception: Instance b7ffbec5-a184-4436-a26c-2188339770cd could not be found. Oct 08 21:20:01.522471 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': 'b7ffbec5-a184-4436-a26c-2188339770cd'} Oct 08 21:20:01.522471 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:20:01.522471 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:20:01.522471 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:20:01.522471 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:20:01.522471 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:20:01.522471 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:20:01.522471 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:20:01.522471 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:20:01.522471 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:20:01.522471 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:20:01.522471 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7ffbec5-a184-4436-a26c-2188339770cd could not be found. Oct 08 21:20:01.522471 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:20:01.522471 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:20:01.522471 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:20:01.522471 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:20:01.522471 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:20:01.522471 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:20:01.522471 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:20:01.522471 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:20:01.522471 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:20:01.522471 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:20:01.522471 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:20:01.522471 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:20:01.522471 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:20:01.522471 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:20:01.522471 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:20:01.522471 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:20:01.522471 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7ffbec5-a184-4436-a26c-2188339770cd could not be found. Oct 08 21:20:01.522471 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:20:01.522471 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:20:01.522471 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:20:01.528359 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:20:01.528359 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:20:01.528359 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:20:01.528359 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:20:01.528359 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:20:01.528359 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7ffbec5-a184-4436-a26c-2188339770cd could not be found. Oct 08 21:20:01.528359 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:20:01.528359 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-31c5f677-7edf-41af-9819-761ce4aa07e0 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Returning 404 to user: Instance b7ffbec5-a184-4436-a26c-2188339770cd could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:20:01.528359 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-31c5f677-7edf-41af-9819-761ce4aa07e0 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] 10.222.0.26 "GET /compute/v2.1/servers/b7ffbec5-a184-4436-a26c-2188339770cd" status: 404 len: 111 microversion: 2.1 time: 0.086405 Oct 08 21:20:01.528359 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2682/5291] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:20:01 2022] GET /compute/v2.1/servers/b7ffbec5-a184-4436-a26c-2188339770cd => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 08 21:20:01.587360 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-5fdb8960-a256-4c18-8d71-66cc09b787a1 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:20:01.588009 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-5fdb8960-a256-4c18-8d71-66cc09b787a1 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: e2ddf0fe-e190-4867-8257-539427de8de4] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:20:01.601446 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5fdb8960-a256-4c18-8d71-66cc09b787a1 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:01.602576 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5fdb8960-a256-4c18-8d71-66cc09b787a1 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:01.605318 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5fdb8960-a256-4c18-8d71-66cc09b787a1 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:01.608399 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5fdb8960-a256-4c18-8d71-66cc09b787a1 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:01.608965 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5fdb8960-a256-4c18-8d71-66cc09b787a1 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:01.609521 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5fdb8960-a256-4c18-8d71-66cc09b787a1 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:01.695509 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-f1e3eb33-99af-492f-8978-b644b94aba4d tempest-VolumesGetTestJSON-606081357 tempest-VolumesGetTestJSON-606081357-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.523015 Oct 08 21:20:01.696302 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2610/5292] 10.222.0.26 () {60 vars in 1156 bytes} [Sat Oct 8 21:20:01 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 525 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Oct 08 21:20:01.702252 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-a1fa1095-469a-4f7f-80b1-bacb566288da tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-231073655", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "networks": [{"uuid": "2b27d72e-40c0-426d-b750-7dc0631117e4"}]}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:20:01.770528 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.network.neutron [None req-a1fa1095-469a-4f7f-80b1-bacb566288da tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] validate_networks() for [('2b27d72e-40c0-426d-b750-7dc0631117e4', None, None, None, None, None)] {{(pid=140491) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 21:20:01.905670 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-5fdb8960-a256-4c18-8d71-66cc09b787a1 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:20:01.916567 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-5fdb8960-a256-4c18-8d71-66cc09b787a1 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/e2ddf0fe-e190-4867-8257-539427de8de4" status: 200 len: 1315 microversion: 2.1 time: 0.333416 Oct 08 21:20:01.917450 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2683/5293] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:20:01 2022] GET /compute/v2.1/servers/e2ddf0fe-e190-4867-8257-539427de8de4 => generated 1315 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:20:01.926305 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-670d7be8-d7f2-4c67-9ede-bbdce8346bff req-b227e491-ff5a-427d-87fd-3cd6f529a4f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2ddf0fe-e190-4867-8257-539427de8de4", "tag": "434860eb-1a99-46b8-bac3-60a6c7233da4"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:20:01.951447 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-670d7be8-d7f2-4c67-9ede-bbdce8346bff req-b227e491-ff5a-427d-87fd-3cd6f529a4f4 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:01.951943 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-670d7be8-d7f2-4c67-9ede-bbdce8346bff req-b227e491-ff5a-427d-87fd-3cd6f529a4f4 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:01.952387 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-670d7be8-d7f2-4c67-9ede-bbdce8346bff req-b227e491-ff5a-427d-87fd-3cd6f529a4f4 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:01.971473 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-670d7be8-d7f2-4c67-9ede-bbdce8346bff req-b227e491-ff5a-427d-87fd-3cd6f529a4f4 service nova] Creating event network-changed:434860eb-1a99-46b8-bac3-60a6c7233da4 for instance e2ddf0fe-e190-4867-8257-539427de8de4 on nch1-master-1 Oct 08 21:20:01.978866 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-670d7be8-d7f2-4c67-9ede-bbdce8346bff req-b227e491-ff5a-427d-87fd-3cd6f529a4f4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059715 Oct 08 21:20:01.979892 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2684/5294] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:20:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:20:01.986813 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-67299735-10be-457a-82bc-fcf712a0b011 tempest-VolumesGetTestJSON-606081357 tempest-VolumesGetTestJSON-606081357-project] Calling method '.version_select at 0x7f1a91429430>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:20:02.061686 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-67299735-10be-457a-82bc-fcf712a0b011 tempest-VolumesGetTestJSON-606081357 tempest-VolumesGetTestJSON-606081357-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/07729230-57f6-425c-b3ef-80f8fd199654" status: 200 len: 345 microversion: 2.1 time: 0.079960 Oct 08 21:20:02.062264 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2685/5295] 10.222.0.26 () {58 vars in 1245 bytes} [Sat Oct 8 21:20:01 2022] GET /compute/v2.1/os-volumes/07729230-57f6-425c-b3ef-80f8fd199654 => generated 345 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:20:02.496440 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-a1fa1095-469a-4f7f-80b1-bacb566288da tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Flavor limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 21:20:02.496944 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-a1fa1095-469a-4f7f-80b1-bacb566288da tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Image limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 21:20:02.497386 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-a1fa1095-469a-4f7f-80b1-bacb566288da tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Flavor pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 21:20:02.497809 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-a1fa1095-469a-4f7f-80b1-bacb566288da tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Image pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 21:20:02.498232 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-a1fa1095-469a-4f7f-80b1-bacb566288da tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 21:20:02.507329 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a1fa1095-469a-4f7f-80b1-bacb566288da tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:02.507814 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a1fa1095-469a-4f7f-80b1-bacb566288da tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:02.508254 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a1fa1095-469a-4f7f-80b1-bacb566288da tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:02.508998 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a1fa1095-469a-4f7f-80b1-bacb566288da tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:02.509483 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a1fa1095-469a-4f7f-80b1-bacb566288da tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:02.509916 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a1fa1095-469a-4f7f-80b1-bacb566288da tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:02.528812 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-a1fa1095-469a-4f7f-80b1-bacb566288da tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Getting quotas for project 2f564837d8eb4b3192109d0dfc9a6fab. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:20:02.534198 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-a1fa1095-469a-4f7f-80b1-bacb566288da tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Getting quotas for user 537b77eca97d4c1395eeb164bc5e7205 and project 2f564837d8eb4b3192109d0dfc9a6fab. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:20:02.547354 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-a1fa1095-469a-4f7f-80b1-bacb566288da tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Going to run 1 instances... {{(pid=140491) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 21:20:02.549713 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-a1fa1095-469a-4f7f-80b1-bacb566288da tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] [instance: e314b928-e335-46f8-ac03-75310c970284] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c508bd7f-7db9-4b2c-af7c-be54a855c355',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140491) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 21:20:02.594625 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-a1fa1095-469a-4f7f-80b1-bacb566288da tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.897207 Oct 08 21:20:02.595201 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2611/5296] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 21:20:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 898 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 08 21:20:02.606917 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e20e9233-e8a5-4195-8365-aa1e846a463a tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:20:02.607682 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-e20e9233-e8a5-4195-8365-aa1e846a463a tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] [instance: e314b928-e335-46f8-ac03-75310c970284] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:20:02.662613 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-e20e9233-e8a5-4195-8365-aa1e846a463a tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537b77eca97d4c1395eeb164bc5e7205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f564837d8eb4b3192109d0dfc9a6fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:20:02.670203 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-e20e9233-e8a5-4195-8365-aa1e846a463a tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] 10.222.0.26 "GET /compute/v2.1/servers/e314b928-e335-46f8-ac03-75310c970284" status: 200 len: 1213 microversion: 2.1 time: 0.067948 Oct 08 21:20:02.670891 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2686/5297] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:20:02 2022] GET /compute/v2.1/servers/e314b928-e335-46f8-ac03-75310c970284 => generated 1213 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:20:02.939625 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c550fd14-989c-4eab-b83b-f107ac756627 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:20:02.940249 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-c550fd14-989c-4eab-b83b-f107ac756627 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: e2ddf0fe-e190-4867-8257-539427de8de4] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:20:02.946493 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c550fd14-989c-4eab-b83b-f107ac756627 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:02.946987 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c550fd14-989c-4eab-b83b-f107ac756627 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:02.947434 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c550fd14-989c-4eab-b83b-f107ac756627 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:02.948141 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c550fd14-989c-4eab-b83b-f107ac756627 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:02.949152 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c550fd14-989c-4eab-b83b-f107ac756627 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:02.949558 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c550fd14-989c-4eab-b83b-f107ac756627 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:03.076582 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-f296f5af-918c-41c2-adbc-1eef29d67008 tempest-VolumesGetTestJSON-606081357 tempest-VolumesGetTestJSON-606081357-project] Calling method '.version_select at 0x7f1a87480160>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:20:03.091468 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-c550fd14-989c-4eab-b83b-f107ac756627 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:20:03.094636 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:20:03.102600 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-c550fd14-989c-4eab-b83b-f107ac756627 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/e2ddf0fe-e190-4867-8257-539427de8de4" status: 200 len: 1315 microversion: 2.1 time: 0.166902 Oct 08 21:20:03.103685 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2612/5298] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:20:02 2022] GET /compute/v2.1/servers/e2ddf0fe-e190-4867-8257-539427de8de4 => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:20:03.143948 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-f296f5af-918c-41c2-adbc-1eef29d67008 tempest-VolumesGetTestJSON-606081357 tempest-VolumesGetTestJSON-606081357-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/07729230-57f6-425c-b3ef-80f8fd199654" status: 200 len: 346 microversion: 2.1 time: 0.071656 Oct 08 21:20:03.144522 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2687/5299] 10.222.0.26 () {58 vars in 1245 bytes} [Sat Oct 8 21:20:03 2022] GET /compute/v2.1/os-volumes/07729230-57f6-425c-b3ef-80f8fd199654 => generated 346 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 08 21:20:03.157984 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-9791579c-5ca1-4b2a-bb0d-8674565a32e9 tempest-VolumesGetTestJSON-606081357 tempest-VolumesGetTestJSON-606081357-project] Calling method '.version_select at 0x7f1a914c9160>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:20:03.229265 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-9791579c-5ca1-4b2a-bb0d-8674565a32e9 tempest-VolumesGetTestJSON-606081357 tempest-VolumesGetTestJSON-606081357-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/07729230-57f6-425c-b3ef-80f8fd199654" status: 200 len: 346 microversion: 2.1 time: 0.074474 Oct 08 21:20:03.230463 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2613/5300] 10.222.0.26 () {58 vars in 1245 bytes} [Sat Oct 8 21:20:03 2022] GET /compute/v2.1/os-volumes/07729230-57f6-425c-b3ef-80f8fd199654 => generated 346 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:20:03.246033 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-d17404e7-02d8-4bd4-9f67-879d3a28fe9b tempest-VolumesGetTestJSON-606081357 tempest-VolumesGetTestJSON-606081357-project] Calling method '.version_select at 0x7f1a91429040>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:20:03.323224 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-d17404e7-02d8-4bd4-9f67-879d3a28fe9b tempest-VolumesGetTestJSON-606081357 tempest-VolumesGetTestJSON-606081357-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/07729230-57f6-425c-b3ef-80f8fd199654" status: 202 len: 0 microversion: 2.1 time: 0.081962 Oct 08 21:20:03.324365 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2688/5301] 10.222.0.26 () {58 vars in 1248 bytes} [Sat Oct 8 21:20:03 2022] DELETE /compute/v2.1/os-volumes/07729230-57f6-425c-b3ef-80f8fd199654 => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 21:20:03.333428 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-d2d6878c-f7b8-46af-ae14-0863e2582f40 tempest-VolumesGetTestJSON-606081357 tempest-VolumesGetTestJSON-606081357-project] Calling method '.version_select at 0x7f1a8c642160>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:20:03.398071 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-d2d6878c-f7b8-46af-ae14-0863e2582f40 tempest-VolumesGetTestJSON-606081357 tempest-VolumesGetTestJSON-606081357-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/07729230-57f6-425c-b3ef-80f8fd199654" status: 200 len: 345 microversion: 2.1 time: 0.069138 Oct 08 21:20:03.398849 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2614/5302] 10.222.0.26 () {58 vars in 1245 bytes} [Sat Oct 8 21:20:03 2022] GET /compute/v2.1/os-volumes/07729230-57f6-425c-b3ef-80f8fd199654 => generated 345 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:20:03.694920 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-2fa1e923-4639-4d2b-8c96-d3ef911b7338 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:20:03.696134 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-2fa1e923-4639-4d2b-8c96-d3ef911b7338 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] [instance: e314b928-e335-46f8-ac03-75310c970284] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:20:03.716623 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2fa1e923-4639-4d2b-8c96-d3ef911b7338 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:03.717618 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2fa1e923-4639-4d2b-8c96-d3ef911b7338 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:03.718231 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2fa1e923-4639-4d2b-8c96-d3ef911b7338 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:03.719730 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2fa1e923-4639-4d2b-8c96-d3ef911b7338 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:03.725820 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2fa1e923-4639-4d2b-8c96-d3ef911b7338 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:03.726317 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2fa1e923-4639-4d2b-8c96-d3ef911b7338 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:03.832457 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-2fa1e923-4639-4d2b-8c96-d3ef911b7338 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537b77eca97d4c1395eeb164bc5e7205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f564837d8eb4b3192109d0dfc9a6fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:20:03.850194 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-2fa1e923-4639-4d2b-8c96-d3ef911b7338 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] 10.222.0.26 "GET /compute/v2.1/servers/e314b928-e335-46f8-ac03-75310c970284" status: 200 len: 1273 microversion: 2.1 time: 0.159964 Oct 08 21:20:03.851108 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2689/5303] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:20:03 2022] GET /compute/v2.1/servers/e314b928-e335-46f8-ac03-75310c970284 => generated 1273 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:20:04.127913 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-861a7ed2-882e-4ceb-8575-855ba2e9188b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:20:04.128616 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-861a7ed2-882e-4ceb-8575-855ba2e9188b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: e2ddf0fe-e190-4867-8257-539427de8de4] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:20:04.135639 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-861a7ed2-882e-4ceb-8575-855ba2e9188b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:04.136801 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-861a7ed2-882e-4ceb-8575-855ba2e9188b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:04.137345 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-861a7ed2-882e-4ceb-8575-855ba2e9188b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:04.137976 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-861a7ed2-882e-4ceb-8575-855ba2e9188b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:04.138436 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-861a7ed2-882e-4ceb-8575-855ba2e9188b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:04.139093 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-861a7ed2-882e-4ceb-8575-855ba2e9188b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:04.292923 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-861a7ed2-882e-4ceb-8575-855ba2e9188b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:20:04.301293 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-861a7ed2-882e-4ceb-8575-855ba2e9188b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/e2ddf0fe-e190-4867-8257-539427de8de4" status: 200 len: 1315 microversion: 2.1 time: 0.177145 Oct 08 21:20:04.302032 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2615/5304] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:20:04 2022] GET /compute/v2.1/servers/e2ddf0fe-e190-4867-8257-539427de8de4 => generated 1315 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:20:04.413654 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-a2ef2d13-91dd-4d3e-8395-cf0f4590af3d tempest-VolumesGetTestJSON-606081357 tempest-VolumesGetTestJSON-606081357-project] Calling method '.version_select at 0x7f1a91429040>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:20:04.443827 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-a2ef2d13-91dd-4d3e-8395-cf0f4590af3d tempest-VolumesGetTestJSON-606081357 tempest-VolumesGetTestJSON-606081357-project] HTTP exception thrown: Volume 07729230-57f6-425c-b3ef-80f8fd199654 could not be found. Oct 08 21:20:04.445950 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-a2ef2d13-91dd-4d3e-8395-cf0f4590af3d tempest-VolumesGetTestJSON-606081357 tempest-VolumesGetTestJSON-606081357-project] Request method failure captured: Oct 08 21:20:04.445950 ncdv-master-1 devstack@n-api.service[140492]: request: GET /compute/v2.1/os-volumes/07729230-57f6-425c-b3ef-80f8fd199654 HTTP/1.1 Oct 08 21:20:04.445950 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:20:04.445950 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:20:04.445950 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:20:04.445950 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 21:20:04.445950 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:20:04.445950 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:20:04.445950 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:20:04.445950 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:20:04.445950 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQemB781ysNxbuGvrF3yq6lrWcVgLmSwToHJRQj8GpM4empg2Xock6_Q7rcQTEhXtWDq9jwY_-J-EZwyqIuAQRuaL9PzLpsPpBE5qJT3CpEhkDzHTpxxEf4zpKFB6GekR161AvjONQRg7JO7toGa_8F7701Ut8paqpRslRu18UAoHV1E Oct 08 21:20:04.445950 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:20:04.445950 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:20:04.445950 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:20:04.445950 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:20:04.445950 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:20:04.445950 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:20:04.445950 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 0ba0c1d321704635930a5017713e75b1 Oct 08 21:20:04.445950 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-VolumesGetTestJSON-606081357 Oct 08 21:20:04.445950 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:20:04.445950 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:20:04.445950 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0ba0c1d321704635930a5017713e75b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0ba0c1d321704635930a5017713e75b1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0ba0c1d321704635930a5017713e75b1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0ba0c1d321704635930a5017713e75b1"}]}] Oct 08 21:20:04.445950 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-VolumesGetTestJSON-606081357 Oct 08 21:20:04.445950 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 0ba0c1d321704635930a5017713e75b1 Oct 08 21:20:04.445950 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-VolumesGetTestJSON-606081357 Oct 08 21:20:04.445950 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-VolumesGetTestJSON-606081357-project Oct 08 21:20:04.445950 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:20:04.445950 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:20:04.445950 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 41b81a1fe7a245a5bd454b97e7365dfa Oct 08 21:20:04.445950 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-VolumesGetTestJSON-606081357-project Oct 08 21:20:04.445950 ncdv-master-1 devstack@n-api.service[140492]: method: Oct 08 21:20:04.445950 ncdv-master-1 devstack@n-api.service[140492]: exception: Volume 07729230-57f6-425c-b3ef-80f8fd199654 could not be found. Oct 08 21:20:04.445950 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': '07729230-57f6-425c-b3ef-80f8fd199654'} Oct 08 21:20:04.445950 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:20:04.445950 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:20:04.445950 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 08 21:20:04.445950 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 08 21:20:04.445950 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 08 21:20:04.445950 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 08 21:20:04.445950 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 08 21:20:04.445950 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 08 21:20:04.445950 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 08 21:20:04.445950 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 08 21:20:04.445950 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 08 21:20:04.445950 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 08 21:20:04.445950 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 08 21:20:04.445950 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 08 21:20:04.445950 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 08 21:20:04.445950 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 08 21:20:04.445950 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 07729230-57f6-425c-b3ef-80f8fd199654 could not be found. (HTTP 404) (Request-ID: req-22245dbd-5b4f-4001-b104-816bea14b1c4) Oct 08 21:20:04.445950 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:20:04.445950 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:20:04.445950 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:20:04.445950 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:20:04.445950 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 08 21:20:04.445950 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 08 21:20:04.445950 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 08 21:20:04.445950 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 08 21:20:04.445950 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 08 21:20:04.445950 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 08 21:20:04.445950 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 08 21:20:04.445950 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 08 21:20:04.445950 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 08 21:20:04.449865 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 08 21:20:04.449865 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 08 21:20:04.449865 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 08 21:20:04.449865 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 08 21:20:04.449865 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 08 21:20:04.449865 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 08 21:20:04.449865 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 08 21:20:04.449865 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 08 21:20:04.449865 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 08 21:20:04.449865 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 08 21:20:04.449865 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 08 21:20:04.449865 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 08 21:20:04.449865 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 08 21:20:04.449865 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 07729230-57f6-425c-b3ef-80f8fd199654 could not be found. Oct 08 21:20:04.449865 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:20:04.449865 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:20:04.449865 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:20:04.449865 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:20:04.449865 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:20:04.449865 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:20:04.449865 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:20:04.449865 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:20:04.449865 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 08 21:20:04.449865 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 08 21:20:04.449865 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:20:04.449865 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:20:04.449865 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 08 21:20:04.449865 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:20:04.449865 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 07729230-57f6-425c-b3ef-80f8fd199654 could not be found. Oct 08 21:20:04.449865 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:20:04.449865 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:20:04.449865 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:20:04.449865 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:20:04.449865 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:20:04.449865 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:20:04.449865 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:20:04.449865 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:20:04.449865 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 07729230-57f6-425c-b3ef-80f8fd199654 could not be found. Oct 08 21:20:04.449865 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:20:04.449865 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-a2ef2d13-91dd-4d3e-8395-cf0f4590af3d tempest-VolumesGetTestJSON-606081357 tempest-VolumesGetTestJSON-606081357-project] Returning 404 to user: Volume 07729230-57f6-425c-b3ef-80f8fd199654 could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:20:04.449865 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-a2ef2d13-91dd-4d3e-8395-cf0f4590af3d tempest-VolumesGetTestJSON-606081357 tempest-VolumesGetTestJSON-606081357-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/07729230-57f6-425c-b3ef-80f8fd199654" status: 404 len: 109 microversion: 2.1 time: 0.037837 Oct 08 21:20:04.449865 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2690/5305] 10.222.0.26 () {58 vars in 1245 bytes} [Sat Oct 8 21:20:04 2022] GET /compute/v2.1/os-volumes/07729230-57f6-425c-b3ef-80f8fd199654 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:20:04.879387 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-357def22-b6b7-4550-81dd-aa153b6dffc4 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:20:04.880372 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-357def22-b6b7-4550-81dd-aa153b6dffc4 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] [instance: e314b928-e335-46f8-ac03-75310c970284] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:20:04.888732 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-357def22-b6b7-4550-81dd-aa153b6dffc4 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:04.889362 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-357def22-b6b7-4550-81dd-aa153b6dffc4 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:04.890373 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-357def22-b6b7-4550-81dd-aa153b6dffc4 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:04.891206 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-357def22-b6b7-4550-81dd-aa153b6dffc4 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:04.891907 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-357def22-b6b7-4550-81dd-aa153b6dffc4 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:04.892567 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-357def22-b6b7-4550-81dd-aa153b6dffc4 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:05.124369 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-357def22-b6b7-4550-81dd-aa153b6dffc4 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537b77eca97d4c1395eeb164bc5e7205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f564837d8eb4b3192109d0dfc9a6fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:20:05.147196 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-357def22-b6b7-4550-81dd-aa153b6dffc4 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] 10.222.0.26 "GET /compute/v2.1/servers/e314b928-e335-46f8-ac03-75310c970284" status: 200 len: 1313 microversion: 2.1 time: 0.275361 Oct 08 21:20:05.150275 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2616/5306] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:20:04 2022] GET /compute/v2.1/servers/e314b928-e335-46f8-ac03-75310c970284 => generated 1313 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:20:05.211380 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-4f847936-d149-4ca2-bdd2-0aa6062e43d7 req-fe1b488a-34b1-4153-83a7-3e792cdfe4bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e314b928-e335-46f8-ac03-75310c970284", "tag": "bfe7801b-a599-4125-9e2f-121b01d116e4"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:20:05.241944 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-4f847936-d149-4ca2-bdd2-0aa6062e43d7 req-fe1b488a-34b1-4153-83a7-3e792cdfe4bf service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:05.242788 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-4f847936-d149-4ca2-bdd2-0aa6062e43d7 req-fe1b488a-34b1-4153-83a7-3e792cdfe4bf service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:05.243403 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-4f847936-d149-4ca2-bdd2-0aa6062e43d7 req-fe1b488a-34b1-4153-83a7-3e792cdfe4bf service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:05.262044 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-4f847936-d149-4ca2-bdd2-0aa6062e43d7 req-fe1b488a-34b1-4153-83a7-3e792cdfe4bf service nova] Creating event network-changed:bfe7801b-a599-4125-9e2f-121b01d116e4 for instance e314b928-e335-46f8-ac03-75310c970284 on nch2-master-1 Oct 08 21:20:05.267834 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-4f847936-d149-4ca2-bdd2-0aa6062e43d7 req-fe1b488a-34b1-4153-83a7-3e792cdfe4bf service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061837 Oct 08 21:20:05.269029 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2691/5307] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:20:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:20:05.327403 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-7b826848-fb8c-419f-9e86-29d3c94556ec tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:20:05.328135 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-7b826848-fb8c-419f-9e86-29d3c94556ec tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: e2ddf0fe-e190-4867-8257-539427de8de4] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:20:05.343848 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7b826848-fb8c-419f-9e86-29d3c94556ec tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:05.344387 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7b826848-fb8c-419f-9e86-29d3c94556ec tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:05.345070 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7b826848-fb8c-419f-9e86-29d3c94556ec tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:05.346024 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7b826848-fb8c-419f-9e86-29d3c94556ec tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:05.346496 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7b826848-fb8c-419f-9e86-29d3c94556ec tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:05.347017 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7b826848-fb8c-419f-9e86-29d3c94556ec tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:05.504736 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-7b826848-fb8c-419f-9e86-29d3c94556ec tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:20:05.514443 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-7b826848-fb8c-419f-9e86-29d3c94556ec tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/e2ddf0fe-e190-4867-8257-539427de8de4" status: 200 len: 1315 microversion: 2.1 time: 0.194164 Oct 08 21:20:05.515186 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2617/5308] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:20:05 2022] GET /compute/v2.1/servers/e2ddf0fe-e190-4867-8257-539427de8de4 => generated 1315 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:20:06.175260 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-490e55b4-6590-4683-96aa-91c51f8061e3 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:20:06.175976 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-490e55b4-6590-4683-96aa-91c51f8061e3 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] [instance: e314b928-e335-46f8-ac03-75310c970284] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:20:06.182280 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-490e55b4-6590-4683-96aa-91c51f8061e3 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:06.182776 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-490e55b4-6590-4683-96aa-91c51f8061e3 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:06.183772 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-490e55b4-6590-4683-96aa-91c51f8061e3 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:06.184476 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-490e55b4-6590-4683-96aa-91c51f8061e3 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:06.184942 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-490e55b4-6590-4683-96aa-91c51f8061e3 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:06.185399 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-490e55b4-6590-4683-96aa-91c51f8061e3 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:06.189657 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:20:06.349670 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-490e55b4-6590-4683-96aa-91c51f8061e3 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537b77eca97d4c1395eeb164bc5e7205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f564837d8eb4b3192109d0dfc9a6fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:20:06.360086 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-490e55b4-6590-4683-96aa-91c51f8061e3 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] 10.222.0.26 "GET /compute/v2.1/servers/e314b928-e335-46f8-ac03-75310c970284" status: 200 len: 1313 microversion: 2.1 time: 0.189060 Oct 08 21:20:06.365228 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2692/5309] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:20:06 2022] GET /compute/v2.1/servers/e314b928-e335-46f8-ac03-75310c970284 => generated 1313 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:20:06.537113 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-b10f0a5c-38ba-4350-90c1-c374ea2565b1 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:20:06.537769 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-b10f0a5c-38ba-4350-90c1-c374ea2565b1 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: e2ddf0fe-e190-4867-8257-539427de8de4] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:20:06.542154 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=1,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:20:06.552563 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b10f0a5c-38ba-4350-90c1-c374ea2565b1 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:06.553077 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b10f0a5c-38ba-4350-90c1-c374ea2565b1 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:06.558083 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b10f0a5c-38ba-4350-90c1-c374ea2565b1 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:06.558860 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b10f0a5c-38ba-4350-90c1-c374ea2565b1 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:06.559343 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b10f0a5c-38ba-4350-90c1-c374ea2565b1 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:06.559779 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b10f0a5c-38ba-4350-90c1-c374ea2565b1 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:06.765378 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-b10f0a5c-38ba-4350-90c1-c374ea2565b1 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:20:06.779650 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-b10f0a5c-38ba-4350-90c1-c374ea2565b1 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/e2ddf0fe-e190-4867-8257-539427de8de4" status: 200 len: 1315 microversion: 2.1 time: 0.243871 Oct 08 21:20:06.784515 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2618/5310] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:20:06 2022] GET /compute/v2.1/servers/e2ddf0fe-e190-4867-8257-539427de8de4 => generated 1315 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:20:07.383993 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-4e2a25fc-cc8c-4148-99eb-708202f669f2 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:20:07.384653 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-4e2a25fc-cc8c-4148-99eb-708202f669f2 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] [instance: e314b928-e335-46f8-ac03-75310c970284] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:20:07.391964 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4e2a25fc-cc8c-4148-99eb-708202f669f2 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:07.392474 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4e2a25fc-cc8c-4148-99eb-708202f669f2 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:07.392927 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4e2a25fc-cc8c-4148-99eb-708202f669f2 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:07.393678 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4e2a25fc-cc8c-4148-99eb-708202f669f2 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:07.394151 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4e2a25fc-cc8c-4148-99eb-708202f669f2 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:07.394592 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4e2a25fc-cc8c-4148-99eb-708202f669f2 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:07.537785 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-4e2a25fc-cc8c-4148-99eb-708202f669f2 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537b77eca97d4c1395eeb164bc5e7205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f564837d8eb4b3192109d0dfc9a6fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:20:07.546578 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-4e2a25fc-cc8c-4148-99eb-708202f669f2 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] 10.222.0.26 "GET /compute/v2.1/servers/e314b928-e335-46f8-ac03-75310c970284" status: 200 len: 1313 microversion: 2.1 time: 0.166418 Oct 08 21:20:07.547273 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2693/5311] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:20:07 2022] GET /compute/v2.1/servers/e314b928-e335-46f8-ac03-75310c970284 => generated 1313 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:20:07.808739 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-d474cce9-3f64-48be-8683-8ab17f161aac tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:20:07.809643 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-d474cce9-3f64-48be-8683-8ab17f161aac tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: e2ddf0fe-e190-4867-8257-539427de8de4] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:20:07.817347 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d474cce9-3f64-48be-8683-8ab17f161aac tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:07.817729 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d474cce9-3f64-48be-8683-8ab17f161aac tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:07.818181 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d474cce9-3f64-48be-8683-8ab17f161aac tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:07.818902 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d474cce9-3f64-48be-8683-8ab17f161aac tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:07.819397 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d474cce9-3f64-48be-8683-8ab17f161aac tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:07.819816 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d474cce9-3f64-48be-8683-8ab17f161aac tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:07.975813 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-d474cce9-3f64-48be-8683-8ab17f161aac tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:20:07.984369 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-d474cce9-3f64-48be-8683-8ab17f161aac tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/e2ddf0fe-e190-4867-8257-539427de8de4" status: 200 len: 1315 microversion: 2.1 time: 0.179940 Oct 08 21:20:07.984982 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2619/5312] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:20:07 2022] GET /compute/v2.1/servers/e2ddf0fe-e190-4867-8257-539427de8de4 => generated 1315 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:20:08.440695 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-a0f8a5dd-3b71-4fbf-9ad0-5bca34068d7c req-5755f669-a454-4edb-b851-96548026922f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2ddf0fe-e190-4867-8257-539427de8de4", "name": "network-vif-plugged", "status": "completed", "tag": "434860eb-1a99-46b8-bac3-60a6c7233da4"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:20:08.452148 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-a0f8a5dd-3b71-4fbf-9ad0-5bca34068d7c req-5755f669-a454-4edb-b851-96548026922f service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:08.452628 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-a0f8a5dd-3b71-4fbf-9ad0-5bca34068d7c req-5755f669-a454-4edb-b851-96548026922f service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:08.453386 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-a0f8a5dd-3b71-4fbf-9ad0-5bca34068d7c req-5755f669-a454-4edb-b851-96548026922f service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:08.466462 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-a0f8a5dd-3b71-4fbf-9ad0-5bca34068d7c req-5755f669-a454-4edb-b851-96548026922f service nova] Creating event network-vif-plugged:434860eb-1a99-46b8-bac3-60a6c7233da4 for instance e2ddf0fe-e190-4867-8257-539427de8de4 on nch1-master-1 Oct 08 21:20:08.472290 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-a0f8a5dd-3b71-4fbf-9ad0-5bca34068d7c req-5755f669-a454-4edb-b851-96548026922f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035278 Oct 08 21:20:08.473227 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2694/5313] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:20:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:20:08.569761 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-eab83f6c-7d55-40af-a20b-899b33a0877c tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:20:08.570382 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-eab83f6c-7d55-40af-a20b-899b33a0877c tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] [instance: e314b928-e335-46f8-ac03-75310c970284] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:20:08.577303 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-eab83f6c-7d55-40af-a20b-899b33a0877c tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:08.577707 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-eab83f6c-7d55-40af-a20b-899b33a0877c tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:08.578224 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-eab83f6c-7d55-40af-a20b-899b33a0877c tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:08.579132 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-eab83f6c-7d55-40af-a20b-899b33a0877c tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:08.579595 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-eab83f6c-7d55-40af-a20b-899b33a0877c tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:08.579951 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-eab83f6c-7d55-40af-a20b-899b33a0877c tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:08.733493 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-eab83f6c-7d55-40af-a20b-899b33a0877c tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537b77eca97d4c1395eeb164bc5e7205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f564837d8eb4b3192109d0dfc9a6fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:20:08.741148 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-eab83f6c-7d55-40af-a20b-899b33a0877c tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] 10.222.0.26 "GET /compute/v2.1/servers/e314b928-e335-46f8-ac03-75310c970284" status: 200 len: 1313 microversion: 2.1 time: 0.175289 Oct 08 21:20:08.741754 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2620/5314] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:20:08 2022] GET /compute/v2.1/servers/e314b928-e335-46f8-ac03-75310c970284 => generated 1313 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:20:09.008527 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-492e23a9-20b3-4027-912b-c370e7aef088 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:20:09.009528 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-492e23a9-20b3-4027-912b-c370e7aef088 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: e2ddf0fe-e190-4867-8257-539427de8de4] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:20:09.016805 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-492e23a9-20b3-4027-912b-c370e7aef088 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:09.018460 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-492e23a9-20b3-4027-912b-c370e7aef088 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:09.019316 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-492e23a9-20b3-4027-912b-c370e7aef088 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:09.020240 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-492e23a9-20b3-4027-912b-c370e7aef088 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:09.020932 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-492e23a9-20b3-4027-912b-c370e7aef088 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:09.021620 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-492e23a9-20b3-4027-912b-c370e7aef088 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:09.200864 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-492e23a9-20b3-4027-912b-c370e7aef088 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:20:09.209810 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-492e23a9-20b3-4027-912b-c370e7aef088 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/e2ddf0fe-e190-4867-8257-539427de8de4" status: 200 len: 1315 microversion: 2.1 time: 0.205911 Oct 08 21:20:09.210791 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2695/5315] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:20:09 2022] GET /compute/v2.1/servers/e2ddf0fe-e190-4867-8257-539427de8de4 => generated 1315 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:20:09.769462 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-aea0a79c-db49-4109-bd10-e035f817f00e tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:20:09.771337 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-aea0a79c-db49-4109-bd10-e035f817f00e tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] [instance: e314b928-e335-46f8-ac03-75310c970284] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:20:09.783345 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-aea0a79c-db49-4109-bd10-e035f817f00e tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:09.784072 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-aea0a79c-db49-4109-bd10-e035f817f00e tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:09.784675 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-aea0a79c-db49-4109-bd10-e035f817f00e tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:09.785596 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-aea0a79c-db49-4109-bd10-e035f817f00e tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:09.786766 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-aea0a79c-db49-4109-bd10-e035f817f00e tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:09.787445 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-aea0a79c-db49-4109-bd10-e035f817f00e tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:09.950007 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-aea0a79c-db49-4109-bd10-e035f817f00e tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537b77eca97d4c1395eeb164bc5e7205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f564837d8eb4b3192109d0dfc9a6fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:20:09.958015 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-aea0a79c-db49-4109-bd10-e035f817f00e tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] 10.222.0.26 "GET /compute/v2.1/servers/e314b928-e335-46f8-ac03-75310c970284" status: 200 len: 1313 microversion: 2.1 time: 0.197709 Oct 08 21:20:09.958803 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2621/5316] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:20:09 2022] GET /compute/v2.1/servers/e314b928-e335-46f8-ac03-75310c970284 => generated 1313 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:20:10.233860 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-0c0506f4-46af-4c4d-8a10-dacc4f21654d tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:20:10.234481 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-0c0506f4-46af-4c4d-8a10-dacc4f21654d tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: e2ddf0fe-e190-4867-8257-539427de8de4] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:20:10.241103 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0c0506f4-46af-4c4d-8a10-dacc4f21654d tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:10.241619 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0c0506f4-46af-4c4d-8a10-dacc4f21654d tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:10.242366 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0c0506f4-46af-4c4d-8a10-dacc4f21654d tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:10.242766 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0c0506f4-46af-4c4d-8a10-dacc4f21654d tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:10.243237 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0c0506f4-46af-4c4d-8a10-dacc4f21654d tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:10.243672 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0c0506f4-46af-4c4d-8a10-dacc4f21654d tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:10.384686 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-0c0506f4-46af-4c4d-8a10-dacc4f21654d tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:20:10.395006 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-0c0506f4-46af-4c4d-8a10-dacc4f21654d tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/e2ddf0fe-e190-4867-8257-539427de8de4" status: 200 len: 1502 microversion: 2.1 time: 0.164665 Oct 08 21:20:10.395605 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2696/5317] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:20:10 2022] GET /compute/v2.1/servers/e2ddf0fe-e190-4867-8257-539427de8de4 => generated 1502 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:20:10.420411 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-506d7376-3481-4796-ac05-6c3c8806c8e6 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:20:10.430437 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-506d7376-3481-4796-ac05-6c3c8806c8e6 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:10.430938 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-506d7376-3481-4796-ac05-6c3c8806c8e6 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:10.431403 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-506d7376-3481-4796-ac05-6c3c8806c8e6 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:10.455132 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-506d7376-3481-4796-ac05-6c3c8806c8e6 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: e2ddf0fe-e190-4867-8257-539427de8de4] Going to try to stop instance {{(pid=140491) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 08 21:20:10.506247 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-506d7376-3481-4796-ac05-6c3c8806c8e6 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "POST /compute/v2.1/servers/e2ddf0fe-e190-4867-8257-539427de8de4/action" status: 202 len: 0 microversion: 2.1 time: 0.090283 Oct 08 21:20:10.507169 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2622/5318] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:20:10 2022] POST /compute/v2.1/servers/e2ddf0fe-e190-4867-8257-539427de8de4/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 21:20:10.516800 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-8e629644-af9c-4fa3-ae6d-6b02cc830d78 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:20:10.517883 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-8e629644-af9c-4fa3-ae6d-6b02cc830d78 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: e2ddf0fe-e190-4867-8257-539427de8de4] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:20:10.524587 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8e629644-af9c-4fa3-ae6d-6b02cc830d78 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:10.525534 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8e629644-af9c-4fa3-ae6d-6b02cc830d78 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:10.526280 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8e629644-af9c-4fa3-ae6d-6b02cc830d78 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:10.527214 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8e629644-af9c-4fa3-ae6d-6b02cc830d78 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:10.527782 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8e629644-af9c-4fa3-ae6d-6b02cc830d78 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:10.528364 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8e629644-af9c-4fa3-ae6d-6b02cc830d78 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:10.681179 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-8e629644-af9c-4fa3-ae6d-6b02cc830d78 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:20:10.689735 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-8e629644-af9c-4fa3-ae6d-6b02cc830d78 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/e2ddf0fe-e190-4867-8257-539427de8de4" status: 200 len: 1512 microversion: 2.1 time: 0.178227 Oct 08 21:20:10.690371 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2697/5319] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:20:10 2022] GET /compute/v2.1/servers/e2ddf0fe-e190-4867-8257-539427de8de4 => generated 1512 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:20:10.985762 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-d785d8c7-1fe2-41f4-bfe3-944ae4fbcea9 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:20:10.986475 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-d785d8c7-1fe2-41f4-bfe3-944ae4fbcea9 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] [instance: e314b928-e335-46f8-ac03-75310c970284] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:20:10.993727 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d785d8c7-1fe2-41f4-bfe3-944ae4fbcea9 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:10.994223 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d785d8c7-1fe2-41f4-bfe3-944ae4fbcea9 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:10.994673 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d785d8c7-1fe2-41f4-bfe3-944ae4fbcea9 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:10.996028 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d785d8c7-1fe2-41f4-bfe3-944ae4fbcea9 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:10.996358 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d785d8c7-1fe2-41f4-bfe3-944ae4fbcea9 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:10.996788 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d785d8c7-1fe2-41f4-bfe3-944ae4fbcea9 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:11.150688 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-d785d8c7-1fe2-41f4-bfe3-944ae4fbcea9 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537b77eca97d4c1395eeb164bc5e7205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f564837d8eb4b3192109d0dfc9a6fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:20:11.162541 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-d785d8c7-1fe2-41f4-bfe3-944ae4fbcea9 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] 10.222.0.26 "GET /compute/v2.1/servers/e314b928-e335-46f8-ac03-75310c970284" status: 200 len: 1313 microversion: 2.1 time: 0.184836 Oct 08 21:20:11.163354 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2623/5320] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:20:10 2022] GET /compute/v2.1/servers/e314b928-e335-46f8-ac03-75310c970284 => generated 1313 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:20:11.413543 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-47342edc-ed61-4913-b2d1-7e7383834cd1 req-3dccf3f5-0622-4fc5-afa5-0051aea36fe9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e314b928-e335-46f8-ac03-75310c970284", "name": "network-vif-plugged", "status": "completed", "tag": "bfe7801b-a599-4125-9e2f-121b01d116e4"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:20:11.428945 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-47342edc-ed61-4913-b2d1-7e7383834cd1 req-3dccf3f5-0622-4fc5-afa5-0051aea36fe9 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:11.429803 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-47342edc-ed61-4913-b2d1-7e7383834cd1 req-3dccf3f5-0622-4fc5-afa5-0051aea36fe9 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:11.430643 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-47342edc-ed61-4913-b2d1-7e7383834cd1 req-3dccf3f5-0622-4fc5-afa5-0051aea36fe9 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:11.447959 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-47342edc-ed61-4913-b2d1-7e7383834cd1 req-3dccf3f5-0622-4fc5-afa5-0051aea36fe9 service nova] Creating event network-vif-plugged:bfe7801b-a599-4125-9e2f-121b01d116e4 for instance e314b928-e335-46f8-ac03-75310c970284 on nch2-master-1 Oct 08 21:20:11.453703 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-47342edc-ed61-4913-b2d1-7e7383834cd1 req-3dccf3f5-0622-4fc5-afa5-0051aea36fe9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044447 Oct 08 21:20:11.454595 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2698/5321] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:20:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:20:11.713901 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-298298d0-e640-44b4-816b-edfb42d45631 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:20:11.715285 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-298298d0-e640-44b4-816b-edfb42d45631 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: e2ddf0fe-e190-4867-8257-539427de8de4] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:20:11.721664 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-298298d0-e640-44b4-816b-edfb42d45631 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:11.722379 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-298298d0-e640-44b4-816b-edfb42d45631 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:11.723542 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-298298d0-e640-44b4-816b-edfb42d45631 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:11.724338 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-298298d0-e640-44b4-816b-edfb42d45631 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:11.725110 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-298298d0-e640-44b4-816b-edfb42d45631 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:11.725639 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-298298d0-e640-44b4-816b-edfb42d45631 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:11.887052 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-298298d0-e640-44b4-816b-edfb42d45631 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:20:11.897804 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-298298d0-e640-44b4-816b-edfb42d45631 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/e2ddf0fe-e190-4867-8257-539427de8de4" status: 200 len: 1512 microversion: 2.1 time: 0.187562 Oct 08 21:20:11.920445 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2624/5322] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:20:11 2022] GET /compute/v2.1/servers/e2ddf0fe-e190-4867-8257-539427de8de4 => generated 1512 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:20:12.190686 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-27edcc69-652c-4941-9814-1f9b74ed144b tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:20:12.191575 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-27edcc69-652c-4941-9814-1f9b74ed144b tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] [instance: e314b928-e335-46f8-ac03-75310c970284] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:20:12.198287 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-27edcc69-652c-4941-9814-1f9b74ed144b tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:12.199330 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-27edcc69-652c-4941-9814-1f9b74ed144b tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:12.199954 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-27edcc69-652c-4941-9814-1f9b74ed144b tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:12.200675 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-27edcc69-652c-4941-9814-1f9b74ed144b tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:12.201133 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-27edcc69-652c-4941-9814-1f9b74ed144b tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:12.201750 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-27edcc69-652c-4941-9814-1f9b74ed144b tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:12.361921 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-27edcc69-652c-4941-9814-1f9b74ed144b tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537b77eca97d4c1395eeb164bc5e7205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f564837d8eb4b3192109d0dfc9a6fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:20:12.370940 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-27edcc69-652c-4941-9814-1f9b74ed144b tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] 10.222.0.26 "GET /compute/v2.1/servers/e314b928-e335-46f8-ac03-75310c970284" status: 200 len: 1313 microversion: 2.1 time: 0.184035 Oct 08 21:20:12.371744 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2699/5323] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:20:12 2022] GET /compute/v2.1/servers/e314b928-e335-46f8-ac03-75310c970284 => generated 1313 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:20:12.921771 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-d1b44c7d-c682-4246-a279-10ca7145d5d3 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:20:12.922961 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-d1b44c7d-c682-4246-a279-10ca7145d5d3 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: e2ddf0fe-e190-4867-8257-539427de8de4] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:20:12.926941 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=4 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:20:12.928407 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=12 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:20:12.933757 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d1b44c7d-c682-4246-a279-10ca7145d5d3 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:12.934223 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d1b44c7d-c682-4246-a279-10ca7145d5d3 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:12.934795 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d1b44c7d-c682-4246-a279-10ca7145d5d3 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:12.935664 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d1b44c7d-c682-4246-a279-10ca7145d5d3 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:12.936152 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d1b44c7d-c682-4246-a279-10ca7145d5d3 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:12.936581 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d1b44c7d-c682-4246-a279-10ca7145d5d3 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:13.103265 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-d1b44c7d-c682-4246-a279-10ca7145d5d3 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:20:13.116239 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-d1b44c7d-c682-4246-a279-10ca7145d5d3 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/e2ddf0fe-e190-4867-8257-539427de8de4" status: 200 len: 1512 microversion: 2.1 time: 0.198903 Oct 08 21:20:13.116827 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2625/5324] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:20:12 2022] GET /compute/v2.1/servers/e2ddf0fe-e190-4867-8257-539427de8de4 => generated 1512 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:20:13.400071 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-a8f23aac-8f3c-4971-b4a7-bfd5662db257 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:20:13.400859 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-a8f23aac-8f3c-4971-b4a7-bfd5662db257 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] [instance: e314b928-e335-46f8-ac03-75310c970284] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:20:13.405688 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=4 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:20:13.412669 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a8f23aac-8f3c-4971-b4a7-bfd5662db257 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:13.413401 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a8f23aac-8f3c-4971-b4a7-bfd5662db257 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:13.414175 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a8f23aac-8f3c-4971-b4a7-bfd5662db257 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:13.414895 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a8f23aac-8f3c-4971-b4a7-bfd5662db257 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:13.415359 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a8f23aac-8f3c-4971-b4a7-bfd5662db257 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:13.415794 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a8f23aac-8f3c-4971-b4a7-bfd5662db257 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:13.582965 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-a8f23aac-8f3c-4971-b4a7-bfd5662db257 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537b77eca97d4c1395eeb164bc5e7205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f564837d8eb4b3192109d0dfc9a6fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:20:13.591603 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-a8f23aac-8f3c-4971-b4a7-bfd5662db257 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] 10.222.0.26 "GET /compute/v2.1/servers/e314b928-e335-46f8-ac03-75310c970284" status: 200 len: 1498 microversion: 2.1 time: 0.196376 Oct 08 21:20:13.592626 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2700/5325] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:20:13 2022] GET /compute/v2.1/servers/e314b928-e335-46f8-ac03-75310c970284 => generated 1498 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:20:14.106169 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c94bdf17-cde3-408f-a0f8-21207cdc417b tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:20:14.106726 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-c94bdf17-cde3-408f-a0f8-21207cdc417b tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] [instance: e314b928-e335-46f8-ac03-75310c970284] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:20:14.117127 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c94bdf17-cde3-408f-a0f8-21207cdc417b tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:14.117898 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c94bdf17-cde3-408f-a0f8-21207cdc417b tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:14.118914 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c94bdf17-cde3-408f-a0f8-21207cdc417b tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:14.121113 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c94bdf17-cde3-408f-a0f8-21207cdc417b tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:14.121757 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c94bdf17-cde3-408f-a0f8-21207cdc417b tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:14.122545 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c94bdf17-cde3-408f-a0f8-21207cdc417b tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:14.139780 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-b7d3c4fa-0ebb-444c-94e8-a96fcd4c802d tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:20:14.140910 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-b7d3c4fa-0ebb-444c-94e8-a96fcd4c802d tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: e2ddf0fe-e190-4867-8257-539427de8de4] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:20:14.152638 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b7d3c4fa-0ebb-444c-94e8-a96fcd4c802d tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:14.153151 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b7d3c4fa-0ebb-444c-94e8-a96fcd4c802d tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:14.155253 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b7d3c4fa-0ebb-444c-94e8-a96fcd4c802d tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:14.156519 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b7d3c4fa-0ebb-444c-94e8-a96fcd4c802d tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:14.157006 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b7d3c4fa-0ebb-444c-94e8-a96fcd4c802d tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:14.157549 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b7d3c4fa-0ebb-444c-94e8-a96fcd4c802d tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:14.166142 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-c94bdf17-cde3-408f-a0f8-21207cdc417b tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] [instance: e314b928-e335-46f8-ac03-75310c970284] Going to try to terminate instance {{(pid=140491) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 21:20:14.267084 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-c94bdf17-cde3-408f-a0f8-21207cdc417b tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] 10.222.0.26 "DELETE /compute/v2.1/servers/e314b928-e335-46f8-ac03-75310c970284" status: 204 len: 0 microversion: 2.1 time: 0.164814 Oct 08 21:20:14.272299 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2626/5326] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:20:14 2022] DELETE /compute/v2.1/servers/e314b928-e335-46f8-ac03-75310c970284 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 21:20:14.291556 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-86eb0c83-a0ba-4c49-bf95-200f7ab7e0cd tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:20:14.294894 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-86eb0c83-a0ba-4c49-bf95-200f7ab7e0cd tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] [instance: e314b928-e335-46f8-ac03-75310c970284] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:20:14.304687 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-86eb0c83-a0ba-4c49-bf95-200f7ab7e0cd tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:14.309311 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-86eb0c83-a0ba-4c49-bf95-200f7ab7e0cd tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:14.309969 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-86eb0c83-a0ba-4c49-bf95-200f7ab7e0cd tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:14.311006 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-86eb0c83-a0ba-4c49-bf95-200f7ab7e0cd tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:14.311677 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-86eb0c83-a0ba-4c49-bf95-200f7ab7e0cd tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:14.313019 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-86eb0c83-a0ba-4c49-bf95-200f7ab7e0cd tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:14.340071 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-b7d3c4fa-0ebb-444c-94e8-a96fcd4c802d tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:20:14.348173 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-b7d3c4fa-0ebb-444c-94e8-a96fcd4c802d tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/e2ddf0fe-e190-4867-8257-539427de8de4" status: 200 len: 1512 microversion: 2.1 time: 0.212718 Oct 08 21:20:14.349732 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2701/5327] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:20:14 2022] GET /compute/v2.1/servers/e2ddf0fe-e190-4867-8257-539427de8de4 => generated 1512 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:20:14.474629 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-86eb0c83-a0ba-4c49-bf95-200f7ab7e0cd tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537b77eca97d4c1395eeb164bc5e7205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f564837d8eb4b3192109d0dfc9a6fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:20:14.489097 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-86eb0c83-a0ba-4c49-bf95-200f7ab7e0cd tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] 10.222.0.26 "GET /compute/v2.1/servers/e314b928-e335-46f8-ac03-75310c970284" status: 200 len: 1504 microversion: 2.1 time: 0.214989 Oct 08 21:20:14.489859 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2627/5328] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:20:14 2022] GET /compute/v2.1/servers/e314b928-e335-46f8-ac03-75310c970284 => generated 1504 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:20:15.376061 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-dc326dac-742e-48fd-b2f8-e32fb1aa416b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:20:15.376680 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-dc326dac-742e-48fd-b2f8-e32fb1aa416b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: e2ddf0fe-e190-4867-8257-539427de8de4] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:20:15.385308 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=90 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:20:15.390387 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dc326dac-742e-48fd-b2f8-e32fb1aa416b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:15.390899 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dc326dac-742e-48fd-b2f8-e32fb1aa416b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:15.391350 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dc326dac-742e-48fd-b2f8-e32fb1aa416b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:15.392076 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dc326dac-742e-48fd-b2f8-e32fb1aa416b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:15.392547 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dc326dac-742e-48fd-b2f8-e32fb1aa416b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:15.392985 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dc326dac-742e-48fd-b2f8-e32fb1aa416b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:15.519293 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-059ca062-3d07-497f-8514-9b0d71b92b5b tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:20:15.520249 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-059ca062-3d07-497f-8514-9b0d71b92b5b tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] [instance: e314b928-e335-46f8-ac03-75310c970284] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:20:15.529461 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-059ca062-3d07-497f-8514-9b0d71b92b5b tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:15.530350 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-059ca062-3d07-497f-8514-9b0d71b92b5b tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:15.531087 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-059ca062-3d07-497f-8514-9b0d71b92b5b tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:15.531987 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-059ca062-3d07-497f-8514-9b0d71b92b5b tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:15.532726 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-059ca062-3d07-497f-8514-9b0d71b92b5b tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:15.533487 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-059ca062-3d07-497f-8514-9b0d71b92b5b tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:15.551491 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-dc326dac-742e-48fd-b2f8-e32fb1aa416b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:20:15.564993 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-dc326dac-742e-48fd-b2f8-e32fb1aa416b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/e2ddf0fe-e190-4867-8257-539427de8de4" status: 200 len: 1512 microversion: 2.1 time: 0.194162 Oct 08 21:20:15.566318 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2702/5329] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:20:15 2022] GET /compute/v2.1/servers/e2ddf0fe-e190-4867-8257-539427de8de4 => generated 1512 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:20:15.714511 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-059ca062-3d07-497f-8514-9b0d71b92b5b tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537b77eca97d4c1395eeb164bc5e7205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f564837d8eb4b3192109d0dfc9a6fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:20:15.717255 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:20:15.728232 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-059ca062-3d07-497f-8514-9b0d71b92b5b tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] 10.222.0.26 "GET /compute/v2.1/servers/e314b928-e335-46f8-ac03-75310c970284" status: 200 len: 1504 microversion: 2.1 time: 0.218385 Oct 08 21:20:15.729400 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2628/5330] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:20:15 2022] GET /compute/v2.1/servers/e314b928-e335-46f8-ac03-75310c970284 => generated 1504 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:20:16.220231 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-b145d6cc-c907-4e55-abda-4012eb155445 req-36a981c7-d352-465f-b3c2-d42224d8f9b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e314b928-e335-46f8-ac03-75310c970284", "name": "network-vif-deleted", "tag": "bfe7801b-a599-4125-9e2f-121b01d116e4"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:20:16.232952 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-b145d6cc-c907-4e55-abda-4012eb155445 req-36a981c7-d352-465f-b3c2-d42224d8f9b8 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:16.234573 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-b145d6cc-c907-4e55-abda-4012eb155445 req-36a981c7-d352-465f-b3c2-d42224d8f9b8 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:16.235232 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-b145d6cc-c907-4e55-abda-4012eb155445 req-36a981c7-d352-465f-b3c2-d42224d8f9b8 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:16.249290 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-b145d6cc-c907-4e55-abda-4012eb155445 req-36a981c7-d352-465f-b3c2-d42224d8f9b8 service nova] Creating event network-vif-deleted:bfe7801b-a599-4125-9e2f-121b01d116e4 for instance e314b928-e335-46f8-ac03-75310c970284 on nch2-master-1 Oct 08 21:20:16.256135 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-b145d6cc-c907-4e55-abda-4012eb155445 req-36a981c7-d352-465f-b3c2-d42224d8f9b8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042284 Oct 08 21:20:16.257340 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2703/5331] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:20:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:20:16.590253 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-17f2a40b-0c49-4f0b-844d-3e147fe125c6 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:20:16.591675 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-17f2a40b-0c49-4f0b-844d-3e147fe125c6 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: e2ddf0fe-e190-4867-8257-539427de8de4] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:20:16.599639 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-17f2a40b-0c49-4f0b-844d-3e147fe125c6 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:16.600141 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-17f2a40b-0c49-4f0b-844d-3e147fe125c6 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:16.600600 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-17f2a40b-0c49-4f0b-844d-3e147fe125c6 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:16.601388 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-17f2a40b-0c49-4f0b-844d-3e147fe125c6 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:16.602038 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-17f2a40b-0c49-4f0b-844d-3e147fe125c6 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:16.602657 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-17f2a40b-0c49-4f0b-844d-3e147fe125c6 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:16.754680 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-ee091669-214f-4c2c-a9c3-db16a3b9f566 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:20:16.755404 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-ee091669-214f-4c2c-a9c3-db16a3b9f566 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] [instance: e314b928-e335-46f8-ac03-75310c970284] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:20:16.769367 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ee091669-214f-4c2c-a9c3-db16a3b9f566 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:16.770114 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ee091669-214f-4c2c-a9c3-db16a3b9f566 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:16.770778 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ee091669-214f-4c2c-a9c3-db16a3b9f566 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:16.771540 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ee091669-214f-4c2c-a9c3-db16a3b9f566 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:16.772018 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ee091669-214f-4c2c-a9c3-db16a3b9f566 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:16.775029 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ee091669-214f-4c2c-a9c3-db16a3b9f566 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:16.794733 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-17f2a40b-0c49-4f0b-844d-3e147fe125c6 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:20:16.806365 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-17f2a40b-0c49-4f0b-844d-3e147fe125c6 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/e2ddf0fe-e190-4867-8257-539427de8de4" status: 200 len: 1512 microversion: 2.1 time: 0.218884 Oct 08 21:20:16.807133 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2629/5332] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:20:16 2022] GET /compute/v2.1/servers/e2ddf0fe-e190-4867-8257-539427de8de4 => generated 1512 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:20:16.815450 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ee091669-214f-4c2c-a9c3-db16a3b9f566 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:16.815949 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ee091669-214f-4c2c-a9c3-db16a3b9f566 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:16.816402 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ee091669-214f-4c2c-a9c3-db16a3b9f566 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:16.816862 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.objects.instance [None req-ee091669-214f-4c2c-a9c3-db16a3b9f566 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Lazy-loading 'fault' on Instance uuid e314b928-e335-46f8-ac03-75310c970284 {{(pid=140492) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 21:20:16.861810 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-ee091669-214f-4c2c-a9c3-db16a3b9f566 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537b77eca97d4c1395eeb164bc5e7205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f564837d8eb4b3192109d0dfc9a6fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:20:16.869555 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-ee091669-214f-4c2c-a9c3-db16a3b9f566 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] 10.222.0.26 "GET /compute/v2.1/servers/e314b928-e335-46f8-ac03-75310c970284" status: 200 len: 1303 microversion: 2.1 time: 0.121297 Oct 08 21:20:16.870914 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2704/5333] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:20:16 2022] GET /compute/v2.1/servers/e314b928-e335-46f8-ac03-75310c970284 => generated 1303 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:20:17.835005 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-9d7c7444-c0d3-4bd2-ab4d-0dfff48fe2b6 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:20:17.835629 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-9d7c7444-c0d3-4bd2-ab4d-0dfff48fe2b6 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: e2ddf0fe-e190-4867-8257-539427de8de4] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:20:17.843487 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9d7c7444-c0d3-4bd2-ab4d-0dfff48fe2b6 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:17.843983 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9d7c7444-c0d3-4bd2-ab4d-0dfff48fe2b6 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:17.844432 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9d7c7444-c0d3-4bd2-ab4d-0dfff48fe2b6 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:17.845173 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9d7c7444-c0d3-4bd2-ab4d-0dfff48fe2b6 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:17.845638 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9d7c7444-c0d3-4bd2-ab4d-0dfff48fe2b6 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:17.846070 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9d7c7444-c0d3-4bd2-ab4d-0dfff48fe2b6 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:17.896436 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e1df302e-eed3-41eb-ac41-72534931b5f4 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:20:17.897066 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-e1df302e-eed3-41eb-ac41-72534931b5f4 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] [instance: e314b928-e335-46f8-ac03-75310c970284] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:20:17.907460 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e1df302e-eed3-41eb-ac41-72534931b5f4 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:17.908326 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e1df302e-eed3-41eb-ac41-72534931b5f4 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:17.909455 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e1df302e-eed3-41eb-ac41-72534931b5f4 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:17.910673 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e1df302e-eed3-41eb-ac41-72534931b5f4 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:17.912509 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e1df302e-eed3-41eb-ac41-72534931b5f4 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:17.913714 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e1df302e-eed3-41eb-ac41-72534931b5f4 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:17.941495 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-e1df302e-eed3-41eb-ac41-72534931b5f4 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] HTTP exception thrown: Instance e314b928-e335-46f8-ac03-75310c970284 could not be found. Oct 08 21:20:17.943778 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e1df302e-eed3-41eb-ac41-72534931b5f4 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Request method failure captured: Oct 08 21:20:17.943778 ncdv-master-1 devstack@n-api.service[140492]: request: GET /compute/v2.1/servers/e314b928-e335-46f8-ac03-75310c970284 HTTP/1.1 Oct 08 21:20:17.943778 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:20:17.943778 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:20:17.943778 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:20:17.943778 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 21:20:17.943778 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:20:17.943778 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:20:17.943778 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:20:17.943778 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:20:17.943778 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQelnbr7r5WAd0lFjTfuyUYOqjAHFJU24PBK3aZp2wCGbNrMq0ti-YN2KNNQCVl9VdThEqFaQsHLHueqQo6IH7dbd3LMSY2Pulf0Iyqc-15FIOl3RsXDarIVVLBA20UlWTl0UcGI33gjV5_qdApJiDiFI4l8ked2vhhsUoll_Ci5U7Us Oct 08 21:20:17.943778 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:20:17.943778 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:20:17.943778 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:20:17.943778 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:20:17.943778 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:20:17.943778 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:20:17.943778 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 2f564837d8eb4b3192109d0dfc9a6fab Oct 08 21:20:17.943778 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-VolumesActionsTest-42924472 Oct 08 21:20:17.943778 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:20:17.943778 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:20:17.943778 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/2f564837d8eb4b3192109d0dfc9a6fab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2f564837d8eb4b3192109d0dfc9a6fab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_2f564837d8eb4b3192109d0dfc9a6fab"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2f564837d8eb4b3192109d0dfc9a6fab"}]}] Oct 08 21:20:17.943778 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-VolumesActionsTest-42924472 Oct 08 21:20:17.943778 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 2f564837d8eb4b3192109d0dfc9a6fab Oct 08 21:20:17.943778 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-VolumesActionsTest-42924472 Oct 08 21:20:17.943778 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-VolumesActionsTest-42924472-project Oct 08 21:20:17.943778 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:20:17.943778 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:20:17.943778 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 537b77eca97d4c1395eeb164bc5e7205 Oct 08 21:20:17.943778 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-VolumesActionsTest-42924472-project Oct 08 21:20:17.943778 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 21:20:17.943778 ncdv-master-1 devstack@n-api.service[140492]: exception: Instance e314b928-e335-46f8-ac03-75310c970284 could not be found. Oct 08 21:20:17.943778 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': 'e314b928-e335-46f8-ac03-75310c970284'} Oct 08 21:20:17.943778 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:20:17.943778 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:20:17.943778 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:20:17.943778 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:20:17.943778 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:20:17.943778 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:20:17.943778 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:20:17.943778 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:20:17.943778 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:20:17.943778 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:20:17.943778 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e314b928-e335-46f8-ac03-75310c970284 could not be found. Oct 08 21:20:17.943778 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:20:17.943778 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:20:17.943778 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:20:17.943778 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:20:17.943778 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:20:17.943778 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:20:17.943778 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:20:17.943778 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:20:17.943778 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:20:17.943778 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:20:17.943778 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:20:17.943778 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:20:17.943778 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:20:17.943778 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:20:17.943778 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:20:17.943778 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:20:17.943778 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e314b928-e335-46f8-ac03-75310c970284 could not be found. Oct 08 21:20:17.943778 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:20:17.943778 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:20:17.943778 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:20:17.948001 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:20:17.948001 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:20:17.948001 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:20:17.948001 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:20:17.948001 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:20:17.948001 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e314b928-e335-46f8-ac03-75310c970284 could not be found. Oct 08 21:20:17.948001 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:20:17.948001 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e1df302e-eed3-41eb-ac41-72534931b5f4 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] Returning 404 to user: Instance e314b928-e335-46f8-ac03-75310c970284 could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:20:17.948001 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-e1df302e-eed3-41eb-ac41-72534931b5f4 tempest-VolumesActionsTest-42924472 tempest-VolumesActionsTest-42924472-project] 10.222.0.26 "GET /compute/v2.1/servers/e314b928-e335-46f8-ac03-75310c970284" status: 404 len: 111 microversion: 2.1 time: 0.054001 Oct 08 21:20:17.948001 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2705/5334] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:20:17 2022] GET /compute/v2.1/servers/e314b928-e335-46f8-ac03-75310c970284 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 08 21:20:18.007127 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-9d7c7444-c0d3-4bd2-ab4d-0dfff48fe2b6 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:20:18.018262 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-9d7c7444-c0d3-4bd2-ab4d-0dfff48fe2b6 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/e2ddf0fe-e190-4867-8257-539427de8de4" status: 200 len: 1512 microversion: 2.1 time: 0.190104 Oct 08 21:20:18.020970 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2630/5335] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:20:17 2022] GET /compute/v2.1/servers/e2ddf0fe-e190-4867-8257-539427de8de4 => generated 1512 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:20:19.045801 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-bbf3c643-0283-4ad0-bef6-ac2b765ac6e3 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:20:19.046474 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-bbf3c643-0283-4ad0-bef6-ac2b765ac6e3 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: e2ddf0fe-e190-4867-8257-539427de8de4] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:20:19.055041 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bbf3c643-0283-4ad0-bef6-ac2b765ac6e3 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:19.055777 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bbf3c643-0283-4ad0-bef6-ac2b765ac6e3 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:19.056655 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bbf3c643-0283-4ad0-bef6-ac2b765ac6e3 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:19.057895 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bbf3c643-0283-4ad0-bef6-ac2b765ac6e3 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:19.058574 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bbf3c643-0283-4ad0-bef6-ac2b765ac6e3 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:19.059211 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bbf3c643-0283-4ad0-bef6-ac2b765ac6e3 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:19.306788 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-bbf3c643-0283-4ad0-bef6-ac2b765ac6e3 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:20:19.326293 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-bbf3c643-0283-4ad0-bef6-ac2b765ac6e3 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/e2ddf0fe-e190-4867-8257-539427de8de4" status: 200 len: 1512 microversion: 2.1 time: 0.285039 Oct 08 21:20:19.327198 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2706/5336] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:20:19 2022] GET /compute/v2.1/servers/e2ddf0fe-e190-4867-8257-539427de8de4 => generated 1512 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:20:20.351335 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-3fbdbe3d-c609-4013-be37-f8a0fad7b7e5 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:20:20.352008 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-3fbdbe3d-c609-4013-be37-f8a0fad7b7e5 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: e2ddf0fe-e190-4867-8257-539427de8de4] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:20:20.361620 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3fbdbe3d-c609-4013-be37-f8a0fad7b7e5 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:20.362546 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3fbdbe3d-c609-4013-be37-f8a0fad7b7e5 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:20.363376 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3fbdbe3d-c609-4013-be37-f8a0fad7b7e5 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:20.364323 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3fbdbe3d-c609-4013-be37-f8a0fad7b7e5 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:20.364997 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3fbdbe3d-c609-4013-be37-f8a0fad7b7e5 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:20.365938 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3fbdbe3d-c609-4013-be37-f8a0fad7b7e5 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:20.535177 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-3fbdbe3d-c609-4013-be37-f8a0fad7b7e5 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:20:20.544580 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-3fbdbe3d-c609-4013-be37-f8a0fad7b7e5 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/e2ddf0fe-e190-4867-8257-539427de8de4" status: 200 len: 1512 microversion: 2.1 time: 0.197200 Oct 08 21:20:20.554950 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2631/5337] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:20:20 2022] GET /compute/v2.1/servers/e2ddf0fe-e190-4867-8257-539427de8de4 => generated 1512 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:20:21.571714 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-d10a0cff-5655-4e1c-b4e3-23e685412f13 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:20:21.572348 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-d10a0cff-5655-4e1c-b4e3-23e685412f13 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: e2ddf0fe-e190-4867-8257-539427de8de4] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:20:21.587445 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d10a0cff-5655-4e1c-b4e3-23e685412f13 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:21.588274 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d10a0cff-5655-4e1c-b4e3-23e685412f13 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:21.589644 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d10a0cff-5655-4e1c-b4e3-23e685412f13 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:21.590644 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d10a0cff-5655-4e1c-b4e3-23e685412f13 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:21.592300 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d10a0cff-5655-4e1c-b4e3-23e685412f13 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:21.593958 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d10a0cff-5655-4e1c-b4e3-23e685412f13 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:21.800143 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-d10a0cff-5655-4e1c-b4e3-23e685412f13 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:20:21.809595 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-d10a0cff-5655-4e1c-b4e3-23e685412f13 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/e2ddf0fe-e190-4867-8257-539427de8de4" status: 200 len: 1512 microversion: 2.1 time: 0.244388 Oct 08 21:20:21.810427 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2707/5338] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:20:21 2022] GET /compute/v2.1/servers/e2ddf0fe-e190-4867-8257-539427de8de4 => generated 1512 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:20:22.836008 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-9bab5411-d0a6-4111-b9cc-3049d30555eb tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:20:22.839123 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-9bab5411-d0a6-4111-b9cc-3049d30555eb tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: e2ddf0fe-e190-4867-8257-539427de8de4] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:20:22.851696 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9bab5411-d0a6-4111-b9cc-3049d30555eb tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:22.853699 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9bab5411-d0a6-4111-b9cc-3049d30555eb tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:22.855153 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9bab5411-d0a6-4111-b9cc-3049d30555eb tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:22.857333 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9bab5411-d0a6-4111-b9cc-3049d30555eb tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:22.858978 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9bab5411-d0a6-4111-b9cc-3049d30555eb tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:22.860275 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9bab5411-d0a6-4111-b9cc-3049d30555eb tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:23.106072 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-9bab5411-d0a6-4111-b9cc-3049d30555eb tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:20:23.114696 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-9bab5411-d0a6-4111-b9cc-3049d30555eb tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/e2ddf0fe-e190-4867-8257-539427de8de4" status: 200 len: 1512 microversion: 2.1 time: 0.283823 Oct 08 21:20:23.116144 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2632/5339] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:20:22 2022] GET /compute/v2.1/servers/e2ddf0fe-e190-4867-8257-539427de8de4 => generated 1512 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:20:24.144028 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-0e61b8bd-3db0-45da-ba23-5cf91cb196c5 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:20:24.145770 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-0e61b8bd-3db0-45da-ba23-5cf91cb196c5 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: e2ddf0fe-e190-4867-8257-539427de8de4] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:20:24.155612 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0e61b8bd-3db0-45da-ba23-5cf91cb196c5 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:24.156434 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0e61b8bd-3db0-45da-ba23-5cf91cb196c5 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:24.157045 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0e61b8bd-3db0-45da-ba23-5cf91cb196c5 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:24.157996 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0e61b8bd-3db0-45da-ba23-5cf91cb196c5 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:24.158459 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0e61b8bd-3db0-45da-ba23-5cf91cb196c5 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:24.162366 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0e61b8bd-3db0-45da-ba23-5cf91cb196c5 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:24.390692 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-0e61b8bd-3db0-45da-ba23-5cf91cb196c5 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:20:24.399944 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-0e61b8bd-3db0-45da-ba23-5cf91cb196c5 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/e2ddf0fe-e190-4867-8257-539427de8de4" status: 200 len: 1512 microversion: 2.1 time: 0.261621 Oct 08 21:20:24.407119 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2708/5340] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:20:24 2022] GET /compute/v2.1/servers/e2ddf0fe-e190-4867-8257-539427de8de4 => generated 1512 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:20:25.427257 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-73052912-9ded-4b09-8d1f-097d2b67acd3 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:20:25.429745 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-73052912-9ded-4b09-8d1f-097d2b67acd3 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: e2ddf0fe-e190-4867-8257-539427de8de4] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:20:25.445247 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-73052912-9ded-4b09-8d1f-097d2b67acd3 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:25.450197 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-73052912-9ded-4b09-8d1f-097d2b67acd3 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:25.450662 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-73052912-9ded-4b09-8d1f-097d2b67acd3 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:25.452728 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-73052912-9ded-4b09-8d1f-097d2b67acd3 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:25.454189 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-73052912-9ded-4b09-8d1f-097d2b67acd3 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:25.455290 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-73052912-9ded-4b09-8d1f-097d2b67acd3 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:25.701598 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-73052912-9ded-4b09-8d1f-097d2b67acd3 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:20:25.712612 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-73052912-9ded-4b09-8d1f-097d2b67acd3 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/e2ddf0fe-e190-4867-8257-539427de8de4" status: 200 len: 1512 microversion: 2.1 time: 0.292606 Oct 08 21:20:25.732202 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2633/5341] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:20:25 2022] GET /compute/v2.1/servers/e2ddf0fe-e190-4867-8257-539427de8de4 => generated 1512 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:20:26.739914 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-7873144b-6a67-4c98-9fb5-dc33b8f37283 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:20:26.740652 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-7873144b-6a67-4c98-9fb5-dc33b8f37283 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: e2ddf0fe-e190-4867-8257-539427de8de4] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:20:26.756618 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7873144b-6a67-4c98-9fb5-dc33b8f37283 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:26.757143 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7873144b-6a67-4c98-9fb5-dc33b8f37283 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:26.758000 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7873144b-6a67-4c98-9fb5-dc33b8f37283 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:26.758755 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7873144b-6a67-4c98-9fb5-dc33b8f37283 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:26.759235 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7873144b-6a67-4c98-9fb5-dc33b8f37283 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:26.759680 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7873144b-6a67-4c98-9fb5-dc33b8f37283 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:26.978234 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-7873144b-6a67-4c98-9fb5-dc33b8f37283 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:20:26.987158 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-7873144b-6a67-4c98-9fb5-dc33b8f37283 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/e2ddf0fe-e190-4867-8257-539427de8de4" status: 200 len: 1512 microversion: 2.1 time: 0.251562 Oct 08 21:20:26.989820 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2709/5342] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:20:26 2022] GET /compute/v2.1/servers/e2ddf0fe-e190-4867-8257-539427de8de4 => generated 1512 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:20:28.012991 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-2f38fe06-997d-45b0-9633-59bec450047b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:20:28.014047 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-2f38fe06-997d-45b0-9633-59bec450047b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: e2ddf0fe-e190-4867-8257-539427de8de4] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:20:28.025801 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2f38fe06-997d-45b0-9633-59bec450047b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:28.029624 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2f38fe06-997d-45b0-9633-59bec450047b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:28.029624 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2f38fe06-997d-45b0-9633-59bec450047b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:28.029624 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2f38fe06-997d-45b0-9633-59bec450047b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:28.029624 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2f38fe06-997d-45b0-9633-59bec450047b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:28.029978 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2f38fe06-997d-45b0-9633-59bec450047b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:28.361222 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-2f38fe06-997d-45b0-9633-59bec450047b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:20:28.369974 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-2f38fe06-997d-45b0-9633-59bec450047b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/e2ddf0fe-e190-4867-8257-539427de8de4" status: 200 len: 1512 microversion: 2.1 time: 0.363007 Oct 08 21:20:28.387011 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2634/5343] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:20:28 2022] GET /compute/v2.1/servers/e2ddf0fe-e190-4867-8257-539427de8de4 => generated 1512 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:20:29.397666 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-c6e26a67-9e0f-4587-b68b-9628c1fe0c88 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:20:29.399055 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-c6e26a67-9e0f-4587-b68b-9628c1fe0c88 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: e2ddf0fe-e190-4867-8257-539427de8de4] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:20:29.412522 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c6e26a67-9e0f-4587-b68b-9628c1fe0c88 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:29.412971 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c6e26a67-9e0f-4587-b68b-9628c1fe0c88 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:29.413454 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c6e26a67-9e0f-4587-b68b-9628c1fe0c88 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:29.423621 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c6e26a67-9e0f-4587-b68b-9628c1fe0c88 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:29.424153 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c6e26a67-9e0f-4587-b68b-9628c1fe0c88 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:29.424908 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c6e26a67-9e0f-4587-b68b-9628c1fe0c88 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:29.652045 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-c6e26a67-9e0f-4587-b68b-9628c1fe0c88 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:20:29.662932 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-c6e26a67-9e0f-4587-b68b-9628c1fe0c88 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/e2ddf0fe-e190-4867-8257-539427de8de4" status: 200 len: 1512 microversion: 2.1 time: 0.268912 Oct 08 21:20:29.674090 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2710/5344] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:20:29 2022] GET /compute/v2.1/servers/e2ddf0fe-e190-4867-8257-539427de8de4 => generated 1512 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:20:30.715397 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-a0d03bab-a967-4759-8c4d-7a3aa66b629e tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:20:30.724470 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-a0d03bab-a967-4759-8c4d-7a3aa66b629e tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: e2ddf0fe-e190-4867-8257-539427de8de4] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:20:30.750542 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a0d03bab-a967-4759-8c4d-7a3aa66b629e tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:30.751054 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a0d03bab-a967-4759-8c4d-7a3aa66b629e tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:30.751508 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a0d03bab-a967-4759-8c4d-7a3aa66b629e tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:30.752266 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a0d03bab-a967-4759-8c4d-7a3aa66b629e tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:30.752717 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a0d03bab-a967-4759-8c4d-7a3aa66b629e tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:30.753156 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a0d03bab-a967-4759-8c4d-7a3aa66b629e tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:31.019689 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-a0d03bab-a967-4759-8c4d-7a3aa66b629e tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:20:31.030169 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-a0d03bab-a967-4759-8c4d-7a3aa66b629e tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/e2ddf0fe-e190-4867-8257-539427de8de4" status: 200 len: 1512 microversion: 2.1 time: 0.345304 Oct 08 21:20:31.041466 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2635/5345] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:20:30 2022] GET /compute/v2.1/servers/e2ddf0fe-e190-4867-8257-539427de8de4 => generated 1512 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:20:32.056554 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-58926c6c-8aa5-4c02-9c15-42717a2013f6 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:20:32.057250 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-58926c6c-8aa5-4c02-9c15-42717a2013f6 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: e2ddf0fe-e190-4867-8257-539427de8de4] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:20:32.081026 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-58926c6c-8aa5-4c02-9c15-42717a2013f6 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:32.082293 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-58926c6c-8aa5-4c02-9c15-42717a2013f6 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:32.085225 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-58926c6c-8aa5-4c02-9c15-42717a2013f6 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:32.086300 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-58926c6c-8aa5-4c02-9c15-42717a2013f6 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:32.087050 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-58926c6c-8aa5-4c02-9c15-42717a2013f6 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:32.087722 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-58926c6c-8aa5-4c02-9c15-42717a2013f6 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:32.101275 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=100 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:20:32.330962 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-58926c6c-8aa5-4c02-9c15-42717a2013f6 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:20:32.352466 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-58926c6c-8aa5-4c02-9c15-42717a2013f6 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/e2ddf0fe-e190-4867-8257-539427de8de4" status: 200 len: 1512 microversion: 2.1 time: 0.298373 Oct 08 21:20:32.361446 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2711/5346] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:20:32 2022] GET /compute/v2.1/servers/e2ddf0fe-e190-4867-8257-539427de8de4 => generated 1512 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:20:33.381548 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-cd573b1f-bce6-4846-854b-c612551e1194 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:20:33.382186 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-cd573b1f-bce6-4846-854b-c612551e1194 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: e2ddf0fe-e190-4867-8257-539427de8de4] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:20:33.393331 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cd573b1f-bce6-4846-854b-c612551e1194 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:33.394111 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cd573b1f-bce6-4846-854b-c612551e1194 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:33.394859 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cd573b1f-bce6-4846-854b-c612551e1194 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:33.396062 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cd573b1f-bce6-4846-854b-c612551e1194 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:33.396951 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cd573b1f-bce6-4846-854b-c612551e1194 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:33.397587 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cd573b1f-bce6-4846-854b-c612551e1194 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:33.631659 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-cd573b1f-bce6-4846-854b-c612551e1194 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:20:33.645038 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-cd573b1f-bce6-4846-854b-c612551e1194 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/e2ddf0fe-e190-4867-8257-539427de8de4" status: 200 len: 1512 microversion: 2.1 time: 0.270209 Oct 08 21:20:33.647126 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2636/5347] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:20:33 2022] GET /compute/v2.1/servers/e2ddf0fe-e190-4867-8257-539427de8de4 => generated 1512 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:20:34.679428 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-89eaf6b6-aaf2-411b-9258-a12307f81c6e tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:20:34.680083 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-89eaf6b6-aaf2-411b-9258-a12307f81c6e tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: e2ddf0fe-e190-4867-8257-539427de8de4] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:20:34.702950 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-89eaf6b6-aaf2-411b-9258-a12307f81c6e tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:34.703460 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-89eaf6b6-aaf2-411b-9258-a12307f81c6e tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:34.703906 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-89eaf6b6-aaf2-411b-9258-a12307f81c6e tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:34.704626 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-89eaf6b6-aaf2-411b-9258-a12307f81c6e tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:34.705089 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-89eaf6b6-aaf2-411b-9258-a12307f81c6e tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:34.705617 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-89eaf6b6-aaf2-411b-9258-a12307f81c6e tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:34.941690 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-89eaf6b6-aaf2-411b-9258-a12307f81c6e tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:20:34.968166 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-89eaf6b6-aaf2-411b-9258-a12307f81c6e tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/e2ddf0fe-e190-4867-8257-539427de8de4" status: 200 len: 1512 microversion: 2.1 time: 0.290226 Oct 08 21:20:34.970831 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2712/5348] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:20:34 2022] GET /compute/v2.1/servers/e2ddf0fe-e190-4867-8257-539427de8de4 => generated 1512 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:20:35.996363 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-03a4f83a-48bf-45e7-8d91-3383862067c8 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:20:35.998248 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-03a4f83a-48bf-45e7-8d91-3383862067c8 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: e2ddf0fe-e190-4867-8257-539427de8de4] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:20:36.010037 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-03a4f83a-48bf-45e7-8d91-3383862067c8 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:36.010620 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-03a4f83a-48bf-45e7-8d91-3383862067c8 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:36.011358 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-03a4f83a-48bf-45e7-8d91-3383862067c8 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:36.012037 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-03a4f83a-48bf-45e7-8d91-3383862067c8 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:36.012500 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-03a4f83a-48bf-45e7-8d91-3383862067c8 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:36.013361 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-03a4f83a-48bf-45e7-8d91-3383862067c8 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:36.208116 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-03a4f83a-48bf-45e7-8d91-3383862067c8 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:20:36.219964 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-03a4f83a-48bf-45e7-8d91-3383862067c8 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/e2ddf0fe-e190-4867-8257-539427de8de4" status: 200 len: 1512 microversion: 2.1 time: 0.230211 Oct 08 21:20:36.220967 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2637/5349] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:20:35 2022] GET /compute/v2.1/servers/e2ddf0fe-e190-4867-8257-539427de8de4 => generated 1512 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:20:37.248263 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-131c0f06-46da-452a-a40d-62bc97257018 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:20:37.249576 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-131c0f06-46da-452a-a40d-62bc97257018 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: e2ddf0fe-e190-4867-8257-539427de8de4] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:20:37.260004 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-131c0f06-46da-452a-a40d-62bc97257018 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:37.260512 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-131c0f06-46da-452a-a40d-62bc97257018 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:37.260962 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-131c0f06-46da-452a-a40d-62bc97257018 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:37.263850 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-131c0f06-46da-452a-a40d-62bc97257018 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:37.264791 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-131c0f06-46da-452a-a40d-62bc97257018 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:37.266766 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-131c0f06-46da-452a-a40d-62bc97257018 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:37.497473 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-131c0f06-46da-452a-a40d-62bc97257018 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:20:37.508376 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-131c0f06-46da-452a-a40d-62bc97257018 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/e2ddf0fe-e190-4867-8257-539427de8de4" status: 200 len: 1512 microversion: 2.1 time: 0.263774 Oct 08 21:20:37.509119 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2713/5350] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:20:37 2022] GET /compute/v2.1/servers/e2ddf0fe-e190-4867-8257-539427de8de4 => generated 1512 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:20:38.543971 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-001b1df6-311e-45e8-bc57-5e34b82100b1 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:20:38.545544 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-001b1df6-311e-45e8-bc57-5e34b82100b1 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: e2ddf0fe-e190-4867-8257-539427de8de4] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:20:38.575333 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:20:38.577433 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-001b1df6-311e-45e8-bc57-5e34b82100b1 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:38.578584 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-001b1df6-311e-45e8-bc57-5e34b82100b1 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:38.579543 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-001b1df6-311e-45e8-bc57-5e34b82100b1 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:38.580766 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-001b1df6-311e-45e8-bc57-5e34b82100b1 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:38.582222 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-001b1df6-311e-45e8-bc57-5e34b82100b1 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:38.582840 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-001b1df6-311e-45e8-bc57-5e34b82100b1 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:38.814592 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-001b1df6-311e-45e8-bc57-5e34b82100b1 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:20:38.827039 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-001b1df6-311e-45e8-bc57-5e34b82100b1 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/e2ddf0fe-e190-4867-8257-539427de8de4" status: 200 len: 1512 microversion: 2.1 time: 0.298457 Oct 08 21:20:38.842161 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2638/5351] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:20:38 2022] GET /compute/v2.1/servers/e2ddf0fe-e190-4867-8257-539427de8de4 => generated 1512 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:20:39.851354 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-1b769d4e-3b56-46c4-be6b-7df76d2cdca8 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:20:39.851985 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-1b769d4e-3b56-46c4-be6b-7df76d2cdca8 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: e2ddf0fe-e190-4867-8257-539427de8de4] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:20:39.867114 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1b769d4e-3b56-46c4-be6b-7df76d2cdca8 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:39.867643 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1b769d4e-3b56-46c4-be6b-7df76d2cdca8 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:39.868176 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1b769d4e-3b56-46c4-be6b-7df76d2cdca8 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:39.868932 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1b769d4e-3b56-46c4-be6b-7df76d2cdca8 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:39.869437 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1b769d4e-3b56-46c4-be6b-7df76d2cdca8 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:39.870516 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1b769d4e-3b56-46c4-be6b-7df76d2cdca8 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:40.113044 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-1b769d4e-3b56-46c4-be6b-7df76d2cdca8 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:20:40.123347 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-1b769d4e-3b56-46c4-be6b-7df76d2cdca8 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/e2ddf0fe-e190-4867-8257-539427de8de4" status: 200 len: 1512 microversion: 2.1 time: 0.276058 Oct 08 21:20:40.126829 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2714/5352] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:20:39 2022] GET /compute/v2.1/servers/e2ddf0fe-e190-4867-8257-539427de8de4 => generated 1512 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:20:41.149846 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-8c5c2cd8-eb3f-49cb-8a9a-2704d59783ac tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:20:41.150784 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-8c5c2cd8-eb3f-49cb-8a9a-2704d59783ac tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: e2ddf0fe-e190-4867-8257-539427de8de4] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:20:41.157909 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8c5c2cd8-eb3f-49cb-8a9a-2704d59783ac tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:41.158506 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8c5c2cd8-eb3f-49cb-8a9a-2704d59783ac tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:41.159030 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8c5c2cd8-eb3f-49cb-8a9a-2704d59783ac tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:41.159813 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8c5c2cd8-eb3f-49cb-8a9a-2704d59783ac tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:41.160595 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8c5c2cd8-eb3f-49cb-8a9a-2704d59783ac tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:41.161041 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8c5c2cd8-eb3f-49cb-8a9a-2704d59783ac tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:41.301827 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-8c5c2cd8-eb3f-49cb-8a9a-2704d59783ac tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:20:41.310480 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-8c5c2cd8-eb3f-49cb-8a9a-2704d59783ac tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/e2ddf0fe-e190-4867-8257-539427de8de4" status: 200 len: 1489 microversion: 2.1 time: 0.164920 Oct 08 21:20:41.311152 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2639/5353] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:20:41 2022] GET /compute/v2.1/servers/e2ddf0fe-e190-4867-8257-539427de8de4 => generated 1489 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:20:41.333033 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e52d9218-03dd-4544-99ad-41a02f41248d tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:20:41.335407 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-e52d9218-03dd-4544-99ad-41a02f41248d tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 2a61f287-652b-487f-9ecd-fb4d2d1eee62] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:20:41.342919 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e52d9218-03dd-4544-99ad-41a02f41248d tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:41.343440 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e52d9218-03dd-4544-99ad-41a02f41248d tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:41.343892 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e52d9218-03dd-4544-99ad-41a02f41248d tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:41.344782 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e52d9218-03dd-4544-99ad-41a02f41248d tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:41.345078 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e52d9218-03dd-4544-99ad-41a02f41248d tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:41.345519 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e52d9218-03dd-4544-99ad-41a02f41248d tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:41.413248 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-e52d9218-03dd-4544-99ad-41a02f41248d tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "POST /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62/action" status: 200 len: 141 microversion: 2.1 time: 0.083834 Oct 08 21:20:41.414179 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2715/5354] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:20:41 2022] POST /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62/action => generated 141 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:20:41.425135 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-a889217b-5b98-4c7b-9dcb-5708692144ba tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:20:41.425925 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-a889217b-5b98-4c7b-9dcb-5708692144ba tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 2a61f287-652b-487f-9ecd-fb4d2d1eee62] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:20:41.433299 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a889217b-5b98-4c7b-9dcb-5708692144ba tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:41.433837 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a889217b-5b98-4c7b-9dcb-5708692144ba tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:41.434284 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a889217b-5b98-4c7b-9dcb-5708692144ba tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:41.435333 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a889217b-5b98-4c7b-9dcb-5708692144ba tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:41.435663 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a889217b-5b98-4c7b-9dcb-5708692144ba tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:41.436094 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a889217b-5b98-4c7b-9dcb-5708692144ba tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:41.630687 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-a889217b-5b98-4c7b-9dcb-5708692144ba tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:20:41.640859 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-a889217b-5b98-4c7b-9dcb-5708692144ba tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62" status: 200 len: 1670 microversion: 2.1 time: 0.220197 Oct 08 21:20:41.641470 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2640/5355] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:20:41 2022] GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62 => generated 1670 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:20:41.680773 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-c6f82491-5b68-4826-b9c3-1601198afb9e tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:20:41.683943 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-c6f82491-5b68-4826-b9c3-1601198afb9e tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 2a61f287-652b-487f-9ecd-fb4d2d1eee62] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:20:41.691663 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c6f82491-5b68-4826-b9c3-1601198afb9e tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:41.692239 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c6f82491-5b68-4826-b9c3-1601198afb9e tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:41.692747 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c6f82491-5b68-4826-b9c3-1601198afb9e tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:41.693565 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c6f82491-5b68-4826-b9c3-1601198afb9e tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:41.694093 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c6f82491-5b68-4826-b9c3-1601198afb9e tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:41.694598 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c6f82491-5b68-4826-b9c3-1601198afb9e tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:41.889881 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-c6f82491-5b68-4826-b9c3-1601198afb9e tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:20:41.902176 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-c6f82491-5b68-4826-b9c3-1601198afb9e tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62" status: 200 len: 1670 microversion: 2.1 time: 0.227818 Oct 08 21:20:41.903657 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2716/5356] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:20:41 2022] GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62 => generated 1670 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:20:41.934088 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-80895f1b-a1a1-484c-a862-0233df0bd168 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:20:41.935534 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-80895f1b-a1a1-484c-a862-0233df0bd168 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 2a61f287-652b-487f-9ecd-fb4d2d1eee62] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:20:41.950107 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-80895f1b-a1a1-484c-a862-0233df0bd168 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:41.950107 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-80895f1b-a1a1-484c-a862-0233df0bd168 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:41.950107 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-80895f1b-a1a1-484c-a862-0233df0bd168 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:41.950744 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-80895f1b-a1a1-484c-a862-0233df0bd168 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:41.951834 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-80895f1b-a1a1-484c-a862-0233df0bd168 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:41.952289 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-80895f1b-a1a1-484c-a862-0233df0bd168 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:42.134238 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-80895f1b-a1a1-484c-a862-0233df0bd168 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:20:42.152146 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-80895f1b-a1a1-484c-a862-0233df0bd168 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62" status: 200 len: 1670 microversion: 2.1 time: 0.216884 Oct 08 21:20:42.154253 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2641/5357] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:20:41 2022] GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62 => generated 1670 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:20:42.176952 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-516657da-c59f-4ff4-8944-7de918156c41 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:20:42.177599 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-516657da-c59f-4ff4-8944-7de918156c41 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 2a61f287-652b-487f-9ecd-fb4d2d1eee62] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:20:42.184607 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-516657da-c59f-4ff4-8944-7de918156c41 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:42.185110 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-516657da-c59f-4ff4-8944-7de918156c41 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:42.185653 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-516657da-c59f-4ff4-8944-7de918156c41 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:42.186297 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-516657da-c59f-4ff4-8944-7de918156c41 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:42.186908 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-516657da-c59f-4ff4-8944-7de918156c41 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:42.187470 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-516657da-c59f-4ff4-8944-7de918156c41 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:42.338310 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-516657da-c59f-4ff4-8944-7de918156c41 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:20:42.347625 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-516657da-c59f-4ff4-8944-7de918156c41 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62" status: 200 len: 1670 microversion: 2.1 time: 0.174444 Oct 08 21:20:42.348266 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2717/5358] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:20:42 2022] GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62 => generated 1670 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:20:42.495424 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-26b6bba2-3a40-4a94-bc42-910c4c9a2fb6 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-634299859", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "networks": [{"uuid": "f6f1b01d-e3ee-45fc-896d-218868fb9293"}]}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:20:42.563808 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.network.neutron [None req-26b6bba2-3a40-4a94-bc42-910c4c9a2fb6 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] validate_networks() for [('f6f1b01d-e3ee-45fc-896d-218868fb9293', None, None, None, None, None)] {{(pid=140491) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 21:20:42.970801 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-26b6bba2-3a40-4a94-bc42-910c4c9a2fb6 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Flavor limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 21:20:42.971304 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-26b6bba2-3a40-4a94-bc42-910c4c9a2fb6 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Image limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 21:20:42.971796 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-26b6bba2-3a40-4a94-bc42-910c4c9a2fb6 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Flavor pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 21:20:42.972254 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-26b6bba2-3a40-4a94-bc42-910c4c9a2fb6 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Image pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 21:20:42.972690 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-26b6bba2-3a40-4a94-bc42-910c4c9a2fb6 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 21:20:42.984438 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-26b6bba2-3a40-4a94-bc42-910c4c9a2fb6 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:42.985018 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-26b6bba2-3a40-4a94-bc42-910c4c9a2fb6 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:42.985787 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-26b6bba2-3a40-4a94-bc42-910c4c9a2fb6 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:42.986544 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-26b6bba2-3a40-4a94-bc42-910c4c9a2fb6 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:42.987015 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-26b6bba2-3a40-4a94-bc42-910c4c9a2fb6 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:42.988512 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-26b6bba2-3a40-4a94-bc42-910c4c9a2fb6 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:43.009267 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-26b6bba2-3a40-4a94-bc42-910c4c9a2fb6 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Getting quotas for project bd563fa73afb42c6b26eca3737d7a355. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:20:43.016916 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-26b6bba2-3a40-4a94-bc42-910c4c9a2fb6 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Getting quotas for user 2f98e01cab6b49c7a5d239aee95f4a64 and project bd563fa73afb42c6b26eca3737d7a355. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:20:43.036873 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-26b6bba2-3a40-4a94-bc42-910c4c9a2fb6 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Going to run 1 instances... {{(pid=140491) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 21:20:43.041274 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-26b6bba2-3a40-4a94-bc42-910c4c9a2fb6 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 4ae315ed-e587-4aec-b3bb-4b76f8b89331] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c508bd7f-7db9-4b2c-af7c-be54a855c355',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140491) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 21:20:43.121977 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-26b6bba2-3a40-4a94-bc42-910c4c9a2fb6 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.631862 Oct 08 21:20:43.130805 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2642/5359] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 21:20:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 642 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 08 21:20:43.136429 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-3dc65d7b-38db-4b33-90cb-f0c999086cf1 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:20:43.137373 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-3dc65d7b-38db-4b33-90cb-f0c999086cf1 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 4ae315ed-e587-4aec-b3bb-4b76f8b89331] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:20:43.247525 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-3dc65d7b-38db-4b33-90cb-f0c999086cf1 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:20:43.257617 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-3dc65d7b-38db-4b33-90cb-f0c999086cf1 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/4ae315ed-e587-4aec-b3bb-4b76f8b89331" status: 200 len: 1214 microversion: 2.1 time: 0.126471 Oct 08 21:20:43.261825 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2718/5360] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:20:43 2022] GET /compute/v2.1/servers/4ae315ed-e587-4aec-b3bb-4b76f8b89331 => generated 1214 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:20:44.284732 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-142337b8-25dd-4fa2-9767-18ae1fa35dde tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:20:44.286108 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-142337b8-25dd-4fa2-9767-18ae1fa35dde tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 4ae315ed-e587-4aec-b3bb-4b76f8b89331] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:20:44.293616 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-142337b8-25dd-4fa2-9767-18ae1fa35dde tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:44.294253 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-142337b8-25dd-4fa2-9767-18ae1fa35dde tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:44.294785 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-142337b8-25dd-4fa2-9767-18ae1fa35dde tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:44.295781 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-142337b8-25dd-4fa2-9767-18ae1fa35dde tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:44.296253 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-142337b8-25dd-4fa2-9767-18ae1fa35dde tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:44.296693 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-142337b8-25dd-4fa2-9767-18ae1fa35dde tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:44.400317 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-142337b8-25dd-4fa2-9767-18ae1fa35dde tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:20:44.412632 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-142337b8-25dd-4fa2-9767-18ae1fa35dde tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/4ae315ed-e587-4aec-b3bb-4b76f8b89331" status: 200 len: 1266 microversion: 2.1 time: 0.133311 Oct 08 21:20:44.429402 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2643/5361] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:20:44 2022] GET /compute/v2.1/servers/4ae315ed-e587-4aec-b3bb-4b76f8b89331 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:20:45.440899 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-d6bf3aea-eaa7-40a9-8feb-66b9f059cb2b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:20:45.442239 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-d6bf3aea-eaa7-40a9-8feb-66b9f059cb2b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 4ae315ed-e587-4aec-b3bb-4b76f8b89331] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:20:45.453707 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=38 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:20:45.456895 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d6bf3aea-eaa7-40a9-8feb-66b9f059cb2b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:45.457787 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d6bf3aea-eaa7-40a9-8feb-66b9f059cb2b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:45.458423 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d6bf3aea-eaa7-40a9-8feb-66b9f059cb2b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:45.459368 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d6bf3aea-eaa7-40a9-8feb-66b9f059cb2b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:45.459985 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d6bf3aea-eaa7-40a9-8feb-66b9f059cb2b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:45.460572 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d6bf3aea-eaa7-40a9-8feb-66b9f059cb2b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:45.646371 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-d6bf3aea-eaa7-40a9-8feb-66b9f059cb2b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:20:45.659826 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-d6bf3aea-eaa7-40a9-8feb-66b9f059cb2b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/4ae315ed-e587-4aec-b3bb-4b76f8b89331" status: 200 len: 1272 microversion: 2.1 time: 0.223034 Oct 08 21:20:45.681990 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2719/5362] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:20:45 2022] GET /compute/v2.1/servers/4ae315ed-e587-4aec-b3bb-4b76f8b89331 => generated 1272 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:20:46.688249 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-eff42e4a-e1c5-4365-8b5d-f33fde0892da tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:20:46.689932 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-eff42e4a-e1c5-4365-8b5d-f33fde0892da tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 4ae315ed-e587-4aec-b3bb-4b76f8b89331] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:20:46.697921 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-eff42e4a-e1c5-4365-8b5d-f33fde0892da tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:46.698670 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-eff42e4a-e1c5-4365-8b5d-f33fde0892da tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:46.700069 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-eff42e4a-e1c5-4365-8b5d-f33fde0892da tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:46.701006 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-eff42e4a-e1c5-4365-8b5d-f33fde0892da tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:46.701667 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-eff42e4a-e1c5-4365-8b5d-f33fde0892da tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:46.702604 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-eff42e4a-e1c5-4365-8b5d-f33fde0892da tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:46.711583 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=88 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:20:47.015001 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-eff42e4a-e1c5-4365-8b5d-f33fde0892da tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:20:47.017963 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-df86d6b0-0ccf-4bcd-b585-0639508bcfbc req-4ee46d90-6e1d-4dc0-8ff6-cecfdd73eb7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ae315ed-e587-4aec-b3bb-4b76f8b89331", "tag": "c22673d8-05e8-4489-99a5-50aecd305e93"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:20:47.040563 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-eff42e4a-e1c5-4365-8b5d-f33fde0892da tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/4ae315ed-e587-4aec-b3bb-4b76f8b89331" status: 200 len: 1314 microversion: 2.1 time: 0.356366 Oct 08 21:20:47.043154 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2644/5363] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:20:46 2022] GET /compute/v2.1/servers/4ae315ed-e587-4aec-b3bb-4b76f8b89331 => generated 1314 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:20:47.045691 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-df86d6b0-0ccf-4bcd-b585-0639508bcfbc req-4ee46d90-6e1d-4dc0-8ff6-cecfdd73eb7b service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:47.045691 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-df86d6b0-0ccf-4bcd-b585-0639508bcfbc req-4ee46d90-6e1d-4dc0-8ff6-cecfdd73eb7b service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:47.045691 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-df86d6b0-0ccf-4bcd-b585-0639508bcfbc req-4ee46d90-6e1d-4dc0-8ff6-cecfdd73eb7b service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:47.080174 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-df86d6b0-0ccf-4bcd-b585-0639508bcfbc req-4ee46d90-6e1d-4dc0-8ff6-cecfdd73eb7b service nova] Creating event network-changed:c22673d8-05e8-4489-99a5-50aecd305e93 for instance 4ae315ed-e587-4aec-b3bb-4b76f8b89331 on nch2-master-1 Oct 08 21:20:47.087048 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-df86d6b0-0ccf-4bcd-b585-0639508bcfbc req-4ee46d90-6e1d-4dc0-8ff6-cecfdd73eb7b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072629 Oct 08 21:20:47.088276 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2720/5364] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:20:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 08 21:20:48.067919 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-96c656ec-9f3c-4aac-9921-26d3b572c1a9 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:20:48.068536 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-96c656ec-9f3c-4aac-9921-26d3b572c1a9 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 4ae315ed-e587-4aec-b3bb-4b76f8b89331] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:20:48.079975 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-96c656ec-9f3c-4aac-9921-26d3b572c1a9 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:48.080489 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-96c656ec-9f3c-4aac-9921-26d3b572c1a9 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:48.080946 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-96c656ec-9f3c-4aac-9921-26d3b572c1a9 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:48.081699 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-96c656ec-9f3c-4aac-9921-26d3b572c1a9 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:48.082168 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-96c656ec-9f3c-4aac-9921-26d3b572c1a9 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:48.082607 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-96c656ec-9f3c-4aac-9921-26d3b572c1a9 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:48.331091 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-96c656ec-9f3c-4aac-9921-26d3b572c1a9 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:20:48.342401 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-96c656ec-9f3c-4aac-9921-26d3b572c1a9 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/4ae315ed-e587-4aec-b3bb-4b76f8b89331" status: 200 len: 1314 microversion: 2.1 time: 0.278150 Oct 08 21:20:48.343666 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2645/5365] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:20:48 2022] GET /compute/v2.1/servers/4ae315ed-e587-4aec-b3bb-4b76f8b89331 => generated 1314 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:20:49.373665 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-f7b14351-e635-4350-bca9-9bed3394617f tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:20:49.374981 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-f7b14351-e635-4350-bca9-9bed3394617f tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 4ae315ed-e587-4aec-b3bb-4b76f8b89331] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:20:49.382421 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f7b14351-e635-4350-bca9-9bed3394617f tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:49.383392 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f7b14351-e635-4350-bca9-9bed3394617f tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:49.384048 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f7b14351-e635-4350-bca9-9bed3394617f tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:49.384984 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f7b14351-e635-4350-bca9-9bed3394617f tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:49.386453 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f7b14351-e635-4350-bca9-9bed3394617f tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:49.387120 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f7b14351-e635-4350-bca9-9bed3394617f tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:49.419576 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-fe3c66b1-3dbd-4a81-b520-8ae47cc54bb3 tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-1089266301", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:20:49.497972 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.network.neutron [None req-fe3c66b1-3dbd-4a81-b520-8ae47cc54bb3 tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] validate_networks() for None {{(pid=140491) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 21:20:49.660142 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-f7b14351-e635-4350-bca9-9bed3394617f tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:20:49.669901 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-f7b14351-e635-4350-bca9-9bed3394617f tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/4ae315ed-e587-4aec-b3bb-4b76f8b89331" status: 200 len: 1314 microversion: 2.1 time: 0.301339 Oct 08 21:20:49.687469 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2721/5366] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:20:49 2022] GET /compute/v2.1/servers/4ae315ed-e587-4aec-b3bb-4b76f8b89331 => generated 1314 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:20:49.934578 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-fe3c66b1-3dbd-4a81-b520-8ae47cc54bb3 tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Flavor limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 21:20:49.935016 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-fe3c66b1-3dbd-4a81-b520-8ae47cc54bb3 tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Image limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 21:20:49.935506 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-fe3c66b1-3dbd-4a81-b520-8ae47cc54bb3 tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Flavor pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 21:20:49.935926 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-fe3c66b1-3dbd-4a81-b520-8ae47cc54bb3 tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Image pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 21:20:49.936374 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-fe3c66b1-3dbd-4a81-b520-8ae47cc54bb3 tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 21:20:49.945248 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fe3c66b1-3dbd-4a81-b520-8ae47cc54bb3 tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:49.945971 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fe3c66b1-3dbd-4a81-b520-8ae47cc54bb3 tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:49.946420 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fe3c66b1-3dbd-4a81-b520-8ae47cc54bb3 tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:49.947168 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fe3c66b1-3dbd-4a81-b520-8ae47cc54bb3 tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:49.947631 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fe3c66b1-3dbd-4a81-b520-8ae47cc54bb3 tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:49.948623 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fe3c66b1-3dbd-4a81-b520-8ae47cc54bb3 tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:49.965783 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-fe3c66b1-3dbd-4a81-b520-8ae47cc54bb3 tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Getting quotas for project fd238ac8ac5e4e7793c1ebb53a85eaef. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:20:49.971152 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-fe3c66b1-3dbd-4a81-b520-8ae47cc54bb3 tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Getting quotas for user a009ac77727640de9becf6a61c8f1662 and project fd238ac8ac5e4e7793c1ebb53a85eaef. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:20:49.984732 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-fe3c66b1-3dbd-4a81-b520-8ae47cc54bb3 tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Going to run 1 instances... {{(pid=140491) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 21:20:49.987004 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-fe3c66b1-3dbd-4a81-b520-8ae47cc54bb3 tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] [instance: 1c8a0a0f-8250-4837-9dde-7a09bb570243] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c508bd7f-7db9-4b2c-af7c-be54a855c355',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140491) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 21:20:50.034503 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-fe3c66b1-3dbd-4a81-b520-8ae47cc54bb3 tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.618742 Oct 08 21:20:50.035485 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2646/5367] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 21:20:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 620 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 08 21:20:50.047002 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-db78ddef-64cb-46fc-a58e-00068543efd6 tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:20:50.047899 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-db78ddef-64cb-46fc-a58e-00068543efd6 tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] [instance: 1c8a0a0f-8250-4837-9dde-7a09bb570243] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:20:50.124675 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-db78ddef-64cb-46fc-a58e-00068543efd6 tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a009ac77727640de9becf6a61c8f1662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd238ac8ac5e4e7793c1ebb53a85eaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:20:50.133717 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-db78ddef-64cb-46fc-a58e-00068543efd6 tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] 10.222.0.26 "GET /compute/v2.1/servers/1c8a0a0f-8250-4837-9dde-7a09bb570243" status: 200 len: 1214 microversion: 2.1 time: 0.090635 Oct 08 21:20:50.134764 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2722/5368] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:20:50 2022] GET /compute/v2.1/servers/1c8a0a0f-8250-4837-9dde-7a09bb570243 => generated 1214 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:20:50.696733 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-bf531460-1c20-4f2b-9a04-1e1689733cfc tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:20:50.697394 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-bf531460-1c20-4f2b-9a04-1e1689733cfc tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 4ae315ed-e587-4aec-b3bb-4b76f8b89331] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:20:50.712228 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bf531460-1c20-4f2b-9a04-1e1689733cfc tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:50.714715 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bf531460-1c20-4f2b-9a04-1e1689733cfc tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:50.715982 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bf531460-1c20-4f2b-9a04-1e1689733cfc tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:50.717036 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bf531460-1c20-4f2b-9a04-1e1689733cfc tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:50.718123 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bf531460-1c20-4f2b-9a04-1e1689733cfc tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:50.718788 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bf531460-1c20-4f2b-9a04-1e1689733cfc tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:50.908570 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-bf531460-1c20-4f2b-9a04-1e1689733cfc tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:20:50.920415 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-bf531460-1c20-4f2b-9a04-1e1689733cfc tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/4ae315ed-e587-4aec-b3bb-4b76f8b89331" status: 200 len: 1314 microversion: 2.1 time: 0.229012 Oct 08 21:20:50.922127 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2647/5369] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:20:50 2022] GET /compute/v2.1/servers/4ae315ed-e587-4aec-b3bb-4b76f8b89331 => generated 1314 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:20:51.158459 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-b6e17547-9996-4247-9bc7-279e937a6c64 tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:20:51.159876 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-b6e17547-9996-4247-9bc7-279e937a6c64 tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] [instance: 1c8a0a0f-8250-4837-9dde-7a09bb570243] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:20:51.170316 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b6e17547-9996-4247-9bc7-279e937a6c64 tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:51.171233 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b6e17547-9996-4247-9bc7-279e937a6c64 tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:51.172212 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b6e17547-9996-4247-9bc7-279e937a6c64 tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:51.173127 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b6e17547-9996-4247-9bc7-279e937a6c64 tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:51.173616 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b6e17547-9996-4247-9bc7-279e937a6c64 tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:51.174039 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b6e17547-9996-4247-9bc7-279e937a6c64 tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:51.282491 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-b6e17547-9996-4247-9bc7-279e937a6c64 tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a009ac77727640de9becf6a61c8f1662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd238ac8ac5e4e7793c1ebb53a85eaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:20:51.291888 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-b6e17547-9996-4247-9bc7-279e937a6c64 tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] 10.222.0.26 "GET /compute/v2.1/servers/1c8a0a0f-8250-4837-9dde-7a09bb570243" status: 200 len: 1266 microversion: 2.1 time: 0.137786 Oct 08 21:20:51.292885 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2723/5370] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:20:51 2022] GET /compute/v2.1/servers/1c8a0a0f-8250-4837-9dde-7a09bb570243 => generated 1266 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:20:51.702718 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-b8690c52-38b2-4b99-92a1-788339908e68 req-3073f9d8-62ab-4ae0-bf93-20172dfa5bfb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ae315ed-e587-4aec-b3bb-4b76f8b89331", "name": "network-vif-plugged", "status": "completed", "tag": "c22673d8-05e8-4489-99a5-50aecd305e93"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:20:51.719087 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-b8690c52-38b2-4b99-92a1-788339908e68 req-3073f9d8-62ab-4ae0-bf93-20172dfa5bfb service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:51.720065 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-b8690c52-38b2-4b99-92a1-788339908e68 req-3073f9d8-62ab-4ae0-bf93-20172dfa5bfb service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:51.720607 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-b8690c52-38b2-4b99-92a1-788339908e68 req-3073f9d8-62ab-4ae0-bf93-20172dfa5bfb service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:51.733449 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-b8690c52-38b2-4b99-92a1-788339908e68 req-3073f9d8-62ab-4ae0-bf93-20172dfa5bfb service nova] Creating event network-vif-plugged:c22673d8-05e8-4489-99a5-50aecd305e93 for instance 4ae315ed-e587-4aec-b3bb-4b76f8b89331 on nch2-master-1 Oct 08 21:20:51.740432 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-b8690c52-38b2-4b99-92a1-788339908e68 req-3073f9d8-62ab-4ae0-bf93-20172dfa5bfb service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041975 Oct 08 21:20:51.742305 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2648/5371] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:20:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:20:51.943983 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-9c355b72-8307-4500-8531-7b08b4928afd tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:20:51.944610 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-9c355b72-8307-4500-8531-7b08b4928afd tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 4ae315ed-e587-4aec-b3bb-4b76f8b89331] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:20:51.951398 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9c355b72-8307-4500-8531-7b08b4928afd tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:51.951902 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9c355b72-8307-4500-8531-7b08b4928afd tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:51.952356 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9c355b72-8307-4500-8531-7b08b4928afd tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:51.953072 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9c355b72-8307-4500-8531-7b08b4928afd tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:51.953568 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9c355b72-8307-4500-8531-7b08b4928afd tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:51.954009 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9c355b72-8307-4500-8531-7b08b4928afd tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:52.236011 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-9c355b72-8307-4500-8531-7b08b4928afd tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:20:52.247488 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-9c355b72-8307-4500-8531-7b08b4928afd tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/4ae315ed-e587-4aec-b3bb-4b76f8b89331" status: 200 len: 1314 microversion: 2.1 time: 0.307091 Oct 08 21:20:52.261855 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2724/5372] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:20:51 2022] GET /compute/v2.1/servers/4ae315ed-e587-4aec-b3bb-4b76f8b89331 => generated 1314 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:20:52.324061 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-204d5ba3-b5bb-41f7-b45d-ba6cc568adc8 tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:20:52.325013 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-204d5ba3-b5bb-41f7-b45d-ba6cc568adc8 tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] [instance: 1c8a0a0f-8250-4837-9dde-7a09bb570243] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:20:52.332581 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-204d5ba3-b5bb-41f7-b45d-ba6cc568adc8 tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:52.333692 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-204d5ba3-b5bb-41f7-b45d-ba6cc568adc8 tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:52.334434 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-204d5ba3-b5bb-41f7-b45d-ba6cc568adc8 tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:52.334874 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-204d5ba3-b5bb-41f7-b45d-ba6cc568adc8 tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:52.335942 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-204d5ba3-b5bb-41f7-b45d-ba6cc568adc8 tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:52.336534 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-204d5ba3-b5bb-41f7-b45d-ba6cc568adc8 tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:52.442809 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-204d5ba3-b5bb-41f7-b45d-ba6cc568adc8 tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a009ac77727640de9becf6a61c8f1662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd238ac8ac5e4e7793c1ebb53a85eaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:20:52.451603 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-204d5ba3-b5bb-41f7-b45d-ba6cc568adc8 tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] 10.222.0.26 "GET /compute/v2.1/servers/1c8a0a0f-8250-4837-9dde-7a09bb570243" status: 200 len: 1272 microversion: 2.1 time: 0.133686 Oct 08 21:20:52.452467 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2649/5373] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:20:52 2022] GET /compute/v2.1/servers/1c8a0a0f-8250-4837-9dde-7a09bb570243 => generated 1272 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:20:53.273795 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-342c61ce-3130-43a9-98c5-e1e458a35808 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:20:53.274433 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-342c61ce-3130-43a9-98c5-e1e458a35808 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 4ae315ed-e587-4aec-b3bb-4b76f8b89331] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:20:53.282945 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-342c61ce-3130-43a9-98c5-e1e458a35808 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:53.283451 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-342c61ce-3130-43a9-98c5-e1e458a35808 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:53.283896 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-342c61ce-3130-43a9-98c5-e1e458a35808 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:53.284614 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-342c61ce-3130-43a9-98c5-e1e458a35808 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:53.285096 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-342c61ce-3130-43a9-98c5-e1e458a35808 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:53.290262 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-342c61ce-3130-43a9-98c5-e1e458a35808 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:53.486477 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-521875f9-d26d-4e6d-ac14-a015702ca4cd tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:20:53.487709 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-521875f9-d26d-4e6d-ac14-a015702ca4cd tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] [instance: 1c8a0a0f-8250-4837-9dde-7a09bb570243] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:20:53.511783 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-521875f9-d26d-4e6d-ac14-a015702ca4cd tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:53.513318 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-521875f9-d26d-4e6d-ac14-a015702ca4cd tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:53.513991 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-521875f9-d26d-4e6d-ac14-a015702ca4cd tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:53.514929 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-521875f9-d26d-4e6d-ac14-a015702ca4cd tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:53.515748 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-521875f9-d26d-4e6d-ac14-a015702ca4cd tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:53.516380 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-521875f9-d26d-4e6d-ac14-a015702ca4cd tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:53.731746 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-342c61ce-3130-43a9-98c5-e1e458a35808 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:20:53.742525 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-342c61ce-3130-43a9-98c5-e1e458a35808 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/4ae315ed-e587-4aec-b3bb-4b76f8b89331" status: 200 len: 1501 microversion: 2.1 time: 0.472569 Oct 08 21:20:53.744552 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2725/5374] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:20:53 2022] GET /compute/v2.1/servers/4ae315ed-e587-4aec-b3bb-4b76f8b89331 => generated 1501 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:20:53.769095 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-82c76586-7f30-4cc0-9f3e-0868f3ab2681 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:20:53.771651 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-82c76586-7f30-4cc0-9f3e-0868f3ab2681 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 4ae315ed-e587-4aec-b3bb-4b76f8b89331] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:20:53.778048 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-82c76586-7f30-4cc0-9f3e-0868f3ab2681 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:53.778330 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-82c76586-7f30-4cc0-9f3e-0868f3ab2681 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:53.778977 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-82c76586-7f30-4cc0-9f3e-0868f3ab2681 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:53.779852 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-82c76586-7f30-4cc0-9f3e-0868f3ab2681 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:53.780500 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-82c76586-7f30-4cc0-9f3e-0868f3ab2681 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:53.780930 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-82c76586-7f30-4cc0-9f3e-0868f3ab2681 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:53.788147 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-521875f9-d26d-4e6d-ac14-a015702ca4cd tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a009ac77727640de9becf6a61c8f1662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd238ac8ac5e4e7793c1ebb53a85eaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:20:53.798891 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-521875f9-d26d-4e6d-ac14-a015702ca4cd tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] 10.222.0.26 "GET /compute/v2.1/servers/1c8a0a0f-8250-4837-9dde-7a09bb570243" status: 200 len: 1314 microversion: 2.1 time: 0.326275 Oct 08 21:20:53.799587 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2650/5375] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:20:53 2022] GET /compute/v2.1/servers/1c8a0a0f-8250-4837-9dde-7a09bb570243 => generated 1314 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:20:53.842549 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-82c76586-7f30-4cc0-9f3e-0868f3ab2681 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "POST /compute/v2.1/servers/4ae315ed-e587-4aec-b3bb-4b76f8b89331/action" status: 200 len: 14 microversion: 2.1 time: 0.076496 Oct 08 21:20:53.845251 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2726/5376] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:20:53 2022] POST /compute/v2.1/servers/4ae315ed-e587-4aec-b3bb-4b76f8b89331/action => generated 14 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 08 21:20:54.211804 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-ae4a3b73-222b-4422-a565-617e7f66fbaf req-2a6fb438-eed0-4f35-8289-79ea551a53de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c8a0a0f-8250-4837-9dde-7a09bb570243", "tag": "8f8b6027-0f07-4328-ab14-df3e7c2a9205"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:20:54.223730 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-ae4a3b73-222b-4422-a565-617e7f66fbaf req-2a6fb438-eed0-4f35-8289-79ea551a53de service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:54.224394 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-ae4a3b73-222b-4422-a565-617e7f66fbaf req-2a6fb438-eed0-4f35-8289-79ea551a53de service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:54.224982 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-ae4a3b73-222b-4422-a565-617e7f66fbaf req-2a6fb438-eed0-4f35-8289-79ea551a53de service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:54.244001 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-ae4a3b73-222b-4422-a565-617e7f66fbaf req-2a6fb438-eed0-4f35-8289-79ea551a53de service nova] Creating event network-changed:8f8b6027-0f07-4328-ab14-df3e7c2a9205 for instance 1c8a0a0f-8250-4837-9dde-7a09bb570243 on nch1-master-1 Oct 08 21:20:54.251149 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-ae4a3b73-222b-4422-a565-617e7f66fbaf req-2a6fb438-eed0-4f35-8289-79ea551a53de service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043540 Oct 08 21:20:54.252411 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2651/5377] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:20:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:20:54.824052 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-1098435f-4b6f-4501-8984-d46bef23edd9 tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:20:54.824925 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-1098435f-4b6f-4501-8984-d46bef23edd9 tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] [instance: 1c8a0a0f-8250-4837-9dde-7a09bb570243] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:20:54.833225 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1098435f-4b6f-4501-8984-d46bef23edd9 tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:54.834552 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1098435f-4b6f-4501-8984-d46bef23edd9 tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:54.835364 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1098435f-4b6f-4501-8984-d46bef23edd9 tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:54.836192 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1098435f-4b6f-4501-8984-d46bef23edd9 tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:54.836767 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1098435f-4b6f-4501-8984-d46bef23edd9 tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:54.837338 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1098435f-4b6f-4501-8984-d46bef23edd9 tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:54.856410 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-7c0ade46-3ed3-4bf0-a16b-9aaba4e62037 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:20:54.858797 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-7c0ade46-3ed3-4bf0-a16b-9aaba4e62037 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 4ae315ed-e587-4aec-b3bb-4b76f8b89331] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:20:54.872979 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7c0ade46-3ed3-4bf0-a16b-9aaba4e62037 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:54.874476 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7c0ade46-3ed3-4bf0-a16b-9aaba4e62037 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:54.875031 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7c0ade46-3ed3-4bf0-a16b-9aaba4e62037 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:54.878899 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7c0ade46-3ed3-4bf0-a16b-9aaba4e62037 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:54.878899 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7c0ade46-3ed3-4bf0-a16b-9aaba4e62037 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:54.878899 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7c0ade46-3ed3-4bf0-a16b-9aaba4e62037 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:54.921953 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-7c0ade46-3ed3-4bf0-a16b-9aaba4e62037 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "POST /compute/v2.1/servers/4ae315ed-e587-4aec-b3bb-4b76f8b89331/action" status: 200 len: 14 microversion: 2.1 time: 0.071313 Oct 08 21:20:54.922624 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2652/5378] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:20:54 2022] POST /compute/v2.1/servers/4ae315ed-e587-4aec-b3bb-4b76f8b89331/action => generated 14 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 08 21:20:55.005636 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-1098435f-4b6f-4501-8984-d46bef23edd9 tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a009ac77727640de9becf6a61c8f1662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd238ac8ac5e4e7793c1ebb53a85eaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:20:55.013444 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-1098435f-4b6f-4501-8984-d46bef23edd9 tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] 10.222.0.26 "GET /compute/v2.1/servers/1c8a0a0f-8250-4837-9dde-7a09bb570243" status: 200 len: 1314 microversion: 2.1 time: 0.194456 Oct 08 21:20:55.014006 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2727/5379] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:20:54 2022] GET /compute/v2.1/servers/1c8a0a0f-8250-4837-9dde-7a09bb570243 => generated 1314 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:20:55.934553 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-3800a16d-a1a3-4e16-8ab3-d251895cf441 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:20:55.937474 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-3800a16d-a1a3-4e16-8ab3-d251895cf441 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 4ae315ed-e587-4aec-b3bb-4b76f8b89331] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:20:55.947001 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3800a16d-a1a3-4e16-8ab3-d251895cf441 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:55.947749 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3800a16d-a1a3-4e16-8ab3-d251895cf441 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:55.948901 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3800a16d-a1a3-4e16-8ab3-d251895cf441 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:55.950014 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3800a16d-a1a3-4e16-8ab3-d251895cf441 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:55.950662 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3800a16d-a1a3-4e16-8ab3-d251895cf441 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:55.951275 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3800a16d-a1a3-4e16-8ab3-d251895cf441 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:55.995361 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-3800a16d-a1a3-4e16-8ab3-d251895cf441 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "POST /compute/v2.1/servers/4ae315ed-e587-4aec-b3bb-4b76f8b89331/action" status: 200 len: 14 microversion: 2.1 time: 0.064958 Oct 08 21:20:55.998958 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2653/5380] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:20:55 2022] POST /compute/v2.1/servers/4ae315ed-e587-4aec-b3bb-4b76f8b89331/action => generated 14 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 08 21:20:56.036721 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-8ff17538-f70d-4c45-8ad6-202d63fa09c6 tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:20:56.037572 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-8ff17538-f70d-4c45-8ad6-202d63fa09c6 tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] [instance: 1c8a0a0f-8250-4837-9dde-7a09bb570243] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:20:56.044642 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8ff17538-f70d-4c45-8ad6-202d63fa09c6 tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:56.045337 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8ff17538-f70d-4c45-8ad6-202d63fa09c6 tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:56.046066 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8ff17538-f70d-4c45-8ad6-202d63fa09c6 tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:56.047172 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8ff17538-f70d-4c45-8ad6-202d63fa09c6 tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:56.047867 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8ff17538-f70d-4c45-8ad6-202d63fa09c6 tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:56.048535 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8ff17538-f70d-4c45-8ad6-202d63fa09c6 tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:56.381082 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-8ff17538-f70d-4c45-8ad6-202d63fa09c6 tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a009ac77727640de9becf6a61c8f1662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd238ac8ac5e4e7793c1ebb53a85eaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:20:56.389717 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-8ff17538-f70d-4c45-8ad6-202d63fa09c6 tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] 10.222.0.26 "GET /compute/v2.1/servers/1c8a0a0f-8250-4837-9dde-7a09bb570243" status: 200 len: 1314 microversion: 2.1 time: 0.357003 Oct 08 21:20:56.390290 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2728/5381] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:20:56 2022] GET /compute/v2.1/servers/1c8a0a0f-8250-4837-9dde-7a09bb570243 => generated 1314 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:20:57.006887 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-421f9cd4-47bc-4694-955f-9071d3f3a655 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:20:57.009754 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-421f9cd4-47bc-4694-955f-9071d3f3a655 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 4ae315ed-e587-4aec-b3bb-4b76f8b89331] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:20:57.016296 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-421f9cd4-47bc-4694-955f-9071d3f3a655 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:57.016752 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-421f9cd4-47bc-4694-955f-9071d3f3a655 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:57.017378 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-421f9cd4-47bc-4694-955f-9071d3f3a655 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:57.018611 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-421f9cd4-47bc-4694-955f-9071d3f3a655 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:57.019417 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-421f9cd4-47bc-4694-955f-9071d3f3a655 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:57.020032 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-421f9cd4-47bc-4694-955f-9071d3f3a655 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:57.063747 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-421f9cd4-47bc-4694-955f-9071d3f3a655 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "POST /compute/v2.1/servers/4ae315ed-e587-4aec-b3bb-4b76f8b89331/action" status: 200 len: 14 microversion: 2.1 time: 0.060311 Oct 08 21:20:57.065140 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2729/5382] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:20:57 2022] POST /compute/v2.1/servers/4ae315ed-e587-4aec-b3bb-4b76f8b89331/action => generated 14 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 08 21:20:57.124986 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-91ad0db0-5c94-4c91-ae51-a56974b2a7a8 tempest-PortsAdminExtendedAttrsTestJSON-1945865660 tempest-PortsAdminExtendedAttrsTestJSON-1945865660-project-admin] Calling method '.version_select at 0x7f1a913c68b0>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:20:57.126861 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-91ad0db0-5c94-4c91-ae51-a56974b2a7a8 tempest-PortsAdminExtendedAttrsTestJSON-1945865660 tempest-PortsAdminExtendedAttrsTestJSON-1945865660-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:57.127353 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-91ad0db0-5c94-4c91-ae51-a56974b2a7a8 tempest-PortsAdminExtendedAttrsTestJSON-1945865660 tempest-PortsAdminExtendedAttrsTestJSON-1945865660-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:57.127802 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-91ad0db0-5c94-4c91-ae51-a56974b2a7a8 tempest-PortsAdminExtendedAttrsTestJSON-1945865660 tempest-PortsAdminExtendedAttrsTestJSON-1945865660-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:57.142774 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-91ad0db0-5c94-4c91-ae51-a56974b2a7a8 tempest-PortsAdminExtendedAttrsTestJSON-1945865660 tempest-PortsAdminExtendedAttrsTestJSON-1945865660-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:57.143268 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-91ad0db0-5c94-4c91-ae51-a56974b2a7a8 tempest-PortsAdminExtendedAttrsTestJSON-1945865660 tempest-PortsAdminExtendedAttrsTestJSON-1945865660-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:57.143728 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-91ad0db0-5c94-4c91-ae51-a56974b2a7a8 tempest-PortsAdminExtendedAttrsTestJSON-1945865660 tempest-PortsAdminExtendedAttrsTestJSON-1945865660-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:57.154644 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-91ad0db0-5c94-4c91-ae51-a56974b2a7a8 tempest-PortsAdminExtendedAttrsTestJSON-1945865660 tempest-PortsAdminExtendedAttrsTestJSON-1945865660-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:57.155144 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-91ad0db0-5c94-4c91-ae51-a56974b2a7a8 tempest-PortsAdminExtendedAttrsTestJSON-1945865660 tempest-PortsAdminExtendedAttrsTestJSON-1945865660-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:57.155591 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-91ad0db0-5c94-4c91-ae51-a56974b2a7a8 tempest-PortsAdminExtendedAttrsTestJSON-1945865660 tempest-PortsAdminExtendedAttrsTestJSON-1945865660-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:57.162064 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-91ad0db0-5c94-4c91-ae51-a56974b2a7a8 tempest-PortsAdminExtendedAttrsTestJSON-1945865660 tempest-PortsAdminExtendedAttrsTestJSON-1945865660-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.295758 Oct 08 21:20:57.162869 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2654/5383] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Oct 8 21:20:56 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:20:57.414296 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-4595cb51-6657-4204-9ba1-d9539e2e6a4b tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:20:57.415285 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-4595cb51-6657-4204-9ba1-d9539e2e6a4b tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] [instance: 1c8a0a0f-8250-4837-9dde-7a09bb570243] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:20:57.423389 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4595cb51-6657-4204-9ba1-d9539e2e6a4b tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:57.424113 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4595cb51-6657-4204-9ba1-d9539e2e6a4b tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:57.424720 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4595cb51-6657-4204-9ba1-d9539e2e6a4b tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:57.425632 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4595cb51-6657-4204-9ba1-d9539e2e6a4b tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:57.426259 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4595cb51-6657-4204-9ba1-d9539e2e6a4b tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:57.426840 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4595cb51-6657-4204-9ba1-d9539e2e6a4b tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:57.595761 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-4595cb51-6657-4204-9ba1-d9539e2e6a4b tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a009ac77727640de9becf6a61c8f1662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd238ac8ac5e4e7793c1ebb53a85eaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:20:57.607691 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-4595cb51-6657-4204-9ba1-d9539e2e6a4b tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] 10.222.0.26 "GET /compute/v2.1/servers/1c8a0a0f-8250-4837-9dde-7a09bb570243" status: 200 len: 1314 microversion: 2.1 time: 0.197702 Oct 08 21:20:57.608388 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2730/5384] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:20:57 2022] GET /compute/v2.1/servers/1c8a0a0f-8250-4837-9dde-7a09bb570243 => generated 1314 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:20:58.077246 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-60fac375-eccf-44a0-85c9-e267c239be79 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:20:58.080250 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-60fac375-eccf-44a0-85c9-e267c239be79 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 4ae315ed-e587-4aec-b3bb-4b76f8b89331] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:20:58.087991 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-60fac375-eccf-44a0-85c9-e267c239be79 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:58.089082 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-60fac375-eccf-44a0-85c9-e267c239be79 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:58.089572 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-60fac375-eccf-44a0-85c9-e267c239be79 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:58.090353 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-60fac375-eccf-44a0-85c9-e267c239be79 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:58.090824 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-60fac375-eccf-44a0-85c9-e267c239be79 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:58.091255 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-60fac375-eccf-44a0-85c9-e267c239be79 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:58.138115 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-60fac375-eccf-44a0-85c9-e267c239be79 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "POST /compute/v2.1/servers/4ae315ed-e587-4aec-b3bb-4b76f8b89331/action" status: 200 len: 14 microversion: 2.1 time: 0.065777 Oct 08 21:20:58.138972 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2655/5385] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:20:58 2022] POST /compute/v2.1/servers/4ae315ed-e587-4aec-b3bb-4b76f8b89331/action => generated 14 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 08 21:20:58.634727 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-c33b7191-db35-4906-b5fb-d7fecceae8f0 tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:20:58.635682 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-c33b7191-db35-4906-b5fb-d7fecceae8f0 tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] [instance: 1c8a0a0f-8250-4837-9dde-7a09bb570243] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:20:58.643484 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c33b7191-db35-4906-b5fb-d7fecceae8f0 tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:58.644269 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c33b7191-db35-4906-b5fb-d7fecceae8f0 tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:58.644832 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c33b7191-db35-4906-b5fb-d7fecceae8f0 tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:58.646637 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c33b7191-db35-4906-b5fb-d7fecceae8f0 tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:58.647230 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c33b7191-db35-4906-b5fb-d7fecceae8f0 tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:58.648513 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c33b7191-db35-4906-b5fb-d7fecceae8f0 tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:58.673405 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=100 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:20:58.943444 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-c33b7191-db35-4906-b5fb-d7fecceae8f0 tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a009ac77727640de9becf6a61c8f1662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd238ac8ac5e4e7793c1ebb53a85eaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:20:58.953499 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-c33b7191-db35-4906-b5fb-d7fecceae8f0 tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] 10.222.0.26 "GET /compute/v2.1/servers/1c8a0a0f-8250-4837-9dde-7a09bb570243" status: 200 len: 1314 microversion: 2.1 time: 0.324126 Oct 08 21:20:58.954302 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2731/5386] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:20:58 2022] GET /compute/v2.1/servers/1c8a0a0f-8250-4837-9dde-7a09bb570243 => generated 1314 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:20:59.151042 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-7af9ff26-a10a-495e-a154-6194760ee457 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:20:59.154148 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-7af9ff26-a10a-495e-a154-6194760ee457 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 4ae315ed-e587-4aec-b3bb-4b76f8b89331] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:20:59.162764 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7af9ff26-a10a-495e-a154-6194760ee457 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:59.163503 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7af9ff26-a10a-495e-a154-6194760ee457 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:59.164149 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7af9ff26-a10a-495e-a154-6194760ee457 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:59.165053 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7af9ff26-a10a-495e-a154-6194760ee457 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:59.166176 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7af9ff26-a10a-495e-a154-6194760ee457 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:59.167840 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7af9ff26-a10a-495e-a154-6194760ee457 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:59.215804 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-7af9ff26-a10a-495e-a154-6194760ee457 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "POST /compute/v2.1/servers/4ae315ed-e587-4aec-b3bb-4b76f8b89331/action" status: 200 len: 14 microversion: 2.1 time: 0.069424 Oct 08 21:20:59.216729 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2656/5387] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:20:59 2022] POST /compute/v2.1/servers/4ae315ed-e587-4aec-b3bb-4b76f8b89331/action => generated 14 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 08 21:20:59.977485 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-450bff4d-626d-4ccd-af3f-af18c046f603 tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:20:59.978712 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-450bff4d-626d-4ccd-af3f-af18c046f603 tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] [instance: 1c8a0a0f-8250-4837-9dde-7a09bb570243] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:20:59.987366 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-450bff4d-626d-4ccd-af3f-af18c046f603 tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:59.988055 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-450bff4d-626d-4ccd-af3f-af18c046f603 tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:59.988641 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-450bff4d-626d-4ccd-af3f-af18c046f603 tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:20:59.989399 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-450bff4d-626d-4ccd-af3f-af18c046f603 tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:20:59.990618 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-450bff4d-626d-4ccd-af3f-af18c046f603 tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:20:59.991071 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-450bff4d-626d-4ccd-af3f-af18c046f603 tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:21:00.133536 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=4 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:21:00.178809 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-450bff4d-626d-4ccd-af3f-af18c046f603 tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a009ac77727640de9becf6a61c8f1662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd238ac8ac5e4e7793c1ebb53a85eaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:21:00.189544 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-450bff4d-626d-4ccd-af3f-af18c046f603 tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] 10.222.0.26 "GET /compute/v2.1/servers/1c8a0a0f-8250-4837-9dde-7a09bb570243" status: 200 len: 1314 microversion: 2.1 time: 0.217073 Oct 08 21:21:00.190237 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2732/5388] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:20:59 2022] GET /compute/v2.1/servers/1c8a0a0f-8250-4837-9dde-7a09bb570243 => generated 1314 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:21:00.228783 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-a34a28e8-b6dd-44ab-b932-c3d3adeb834f tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:21:00.233164 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-a34a28e8-b6dd-44ab-b932-c3d3adeb834f tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 4ae315ed-e587-4aec-b3bb-4b76f8b89331] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:21:00.244025 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=4 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:21:00.250923 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=12 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:21:00.254281 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a34a28e8-b6dd-44ab-b932-c3d3adeb834f tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:21:00.254792 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a34a28e8-b6dd-44ab-b932-c3d3adeb834f tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:21:00.255246 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a34a28e8-b6dd-44ab-b932-c3d3adeb834f tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:21:00.256004 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a34a28e8-b6dd-44ab-b932-c3d3adeb834f tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:21:00.256479 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a34a28e8-b6dd-44ab-b932-c3d3adeb834f tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:21:00.256921 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a34a28e8-b6dd-44ab-b932-c3d3adeb834f tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:21:00.310689 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-a34a28e8-b6dd-44ab-b932-c3d3adeb834f tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "POST /compute/v2.1/servers/4ae315ed-e587-4aec-b3bb-4b76f8b89331/action" status: 200 len: 14 microversion: 2.1 time: 0.086826 Oct 08 21:21:00.311654 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2657/5389] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:21:00 2022] POST /compute/v2.1/servers/4ae315ed-e587-4aec-b3bb-4b76f8b89331/action => generated 14 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 08 21:21:00.743982 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-19eb8d4d-9d1f-44d8-beae-2a19656b9581 req-09eac78b-9345-4dd1-b578-55a1e8e348ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c8a0a0f-8250-4837-9dde-7a09bb570243", "name": "network-vif-plugged", "status": "completed", "tag": "8f8b6027-0f07-4328-ab14-df3e7c2a9205"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:21:00.756931 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-19eb8d4d-9d1f-44d8-beae-2a19656b9581 req-09eac78b-9345-4dd1-b578-55a1e8e348ff service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:21:00.758058 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-19eb8d4d-9d1f-44d8-beae-2a19656b9581 req-09eac78b-9345-4dd1-b578-55a1e8e348ff service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:21:00.758668 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-19eb8d4d-9d1f-44d8-beae-2a19656b9581 req-09eac78b-9345-4dd1-b578-55a1e8e348ff service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:21:00.770638 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-19eb8d4d-9d1f-44d8-beae-2a19656b9581 req-09eac78b-9345-4dd1-b578-55a1e8e348ff service nova] Creating event network-vif-plugged:8f8b6027-0f07-4328-ab14-df3e7c2a9205 for instance 1c8a0a0f-8250-4837-9dde-7a09bb570243 on nch1-master-1 Oct 08 21:21:00.775587 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-19eb8d4d-9d1f-44d8-beae-2a19656b9581 req-09eac78b-9345-4dd1-b578-55a1e8e348ff service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035712 Oct 08 21:21:00.776210 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2733/5390] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:21:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:21:01.215476 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-73732ec4-de53-4ada-9621-efa898f47839 tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:21:01.216656 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-73732ec4-de53-4ada-9621-efa898f47839 tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] [instance: 1c8a0a0f-8250-4837-9dde-7a09bb570243] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:21:01.224380 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-73732ec4-de53-4ada-9621-efa898f47839 tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:21:01.224877 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-73732ec4-de53-4ada-9621-efa898f47839 tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:21:01.225595 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-73732ec4-de53-4ada-9621-efa898f47839 tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:21:01.226327 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-73732ec4-de53-4ada-9621-efa898f47839 tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:21:01.226942 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-73732ec4-de53-4ada-9621-efa898f47839 tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:21:01.227381 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-73732ec4-de53-4ada-9621-efa898f47839 tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:21:01.324179 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-1814924b-8754-429c-8db2-b6e3c3dc0cfb tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:21:01.327140 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-1814924b-8754-429c-8db2-b6e3c3dc0cfb tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 4ae315ed-e587-4aec-b3bb-4b76f8b89331] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:21:01.342934 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1814924b-8754-429c-8db2-b6e3c3dc0cfb tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:21:01.344934 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1814924b-8754-429c-8db2-b6e3c3dc0cfb tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:21:01.345469 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1814924b-8754-429c-8db2-b6e3c3dc0cfb tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:21:01.346742 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1814924b-8754-429c-8db2-b6e3c3dc0cfb tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:21:01.347493 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1814924b-8754-429c-8db2-b6e3c3dc0cfb tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:21:01.348236 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1814924b-8754-429c-8db2-b6e3c3dc0cfb tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:21:01.397213 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-1814924b-8754-429c-8db2-b6e3c3dc0cfb tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "POST /compute/v2.1/servers/4ae315ed-e587-4aec-b3bb-4b76f8b89331/action" status: 200 len: 14 microversion: 2.1 time: 0.078263 Oct 08 21:21:01.398047 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2734/5391] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:21:01 2022] POST /compute/v2.1/servers/4ae315ed-e587-4aec-b3bb-4b76f8b89331/action => generated 14 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 08 21:21:01.494265 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-73732ec4-de53-4ada-9621-efa898f47839 tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a009ac77727640de9becf6a61c8f1662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd238ac8ac5e4e7793c1ebb53a85eaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:21:01.503147 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-73732ec4-de53-4ada-9621-efa898f47839 tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] 10.222.0.26 "GET /compute/v2.1/servers/1c8a0a0f-8250-4837-9dde-7a09bb570243" status: 200 len: 1314 microversion: 2.1 time: 0.292544 Oct 08 21:21:01.503828 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2658/5392] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:21:01 2022] GET /compute/v2.1/servers/1c8a0a0f-8250-4837-9dde-7a09bb570243 => generated 1314 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:21:02.410361 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-248f708e-a7a5-4e74-8930-a6675b8dc2b5 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:21:02.412922 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-248f708e-a7a5-4e74-8930-a6675b8dc2b5 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 4ae315ed-e587-4aec-b3bb-4b76f8b89331] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:21:02.422864 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-248f708e-a7a5-4e74-8930-a6675b8dc2b5 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:21:02.423463 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-248f708e-a7a5-4e74-8930-a6675b8dc2b5 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:21:02.424719 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-248f708e-a7a5-4e74-8930-a6675b8dc2b5 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:21:02.425559 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-248f708e-a7a5-4e74-8930-a6675b8dc2b5 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:21:02.426041 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-248f708e-a7a5-4e74-8930-a6675b8dc2b5 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:21:02.426547 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-248f708e-a7a5-4e74-8930-a6675b8dc2b5 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:21:02.476679 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-248f708e-a7a5-4e74-8930-a6675b8dc2b5 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "POST /compute/v2.1/servers/4ae315ed-e587-4aec-b3bb-4b76f8b89331/action" status: 200 len: 14 microversion: 2.1 time: 0.070816 Oct 08 21:21:02.482010 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2735/5393] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:21:02 2022] POST /compute/v2.1/servers/4ae315ed-e587-4aec-b3bb-4b76f8b89331/action => generated 14 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 08 21:21:02.528427 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-46048a95-00ba-4963-9d8a-2763aee496dc tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:21:02.529451 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-46048a95-00ba-4963-9d8a-2763aee496dc tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] [instance: 1c8a0a0f-8250-4837-9dde-7a09bb570243] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:21:02.540524 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-46048a95-00ba-4963-9d8a-2763aee496dc tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:21:02.541022 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-46048a95-00ba-4963-9d8a-2763aee496dc tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:21:02.542138 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-46048a95-00ba-4963-9d8a-2763aee496dc tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:21:02.542855 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-46048a95-00ba-4963-9d8a-2763aee496dc tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:21:02.543315 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-46048a95-00ba-4963-9d8a-2763aee496dc tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:21:02.543746 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-46048a95-00ba-4963-9d8a-2763aee496dc tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:21:02.706880 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-46048a95-00ba-4963-9d8a-2763aee496dc tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a009ac77727640de9becf6a61c8f1662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd238ac8ac5e4e7793c1ebb53a85eaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:21:02.720852 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-46048a95-00ba-4963-9d8a-2763aee496dc tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] 10.222.0.26 "GET /compute/v2.1/servers/1c8a0a0f-8250-4837-9dde-7a09bb570243" status: 200 len: 1464 microversion: 2.1 time: 0.197716 Oct 08 21:21:02.721488 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2659/5394] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:21:02 2022] GET /compute/v2.1/servers/1c8a0a0f-8250-4837-9dde-7a09bb570243 => generated 1464 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:21:02.745503 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-289485ba-e412-42bd-9ecd-db7ad41d048b tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d763bbc7-78ba-482f-883e-5cbff5953069", "device": "/dev/sdb"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:21:02.748042 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-289485ba-e412-42bd-9ecd-db7ad41d048b tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] [instance: 1c8a0a0f-8250-4837-9dde-7a09bb570243] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:21:02.755278 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-289485ba-e412-42bd-9ecd-db7ad41d048b tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:21:02.755777 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-289485ba-e412-42bd-9ecd-db7ad41d048b tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:21:02.756225 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-289485ba-e412-42bd-9ecd-db7ad41d048b tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:21:02.756937 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-289485ba-e412-42bd-9ecd-db7ad41d048b tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:21:02.757444 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-289485ba-e412-42bd-9ecd-db7ad41d048b tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:21:02.758218 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-289485ba-e412-42bd-9ecd-db7ad41d048b tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:21:03.059006 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-289485ba-e412-42bd-9ecd-db7ad41d048b tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] 10.222.0.26 "POST /compute/v2.1/servers/1c8a0a0f-8250-4837-9dde-7a09bb570243/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.318278 Oct 08 21:21:03.059681 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2736/5395] 10.222.0.26 () {60 vars in 1323 bytes} [Sat Oct 8 21:21:02 2022] POST /compute/v2.1/servers/1c8a0a0f-8250-4837-9dde-7a09bb570243/os-volume_attachments => generated 194 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 08 21:21:03.489004 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-e789d604-8da0-4399-8adf-975952edf319 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:21:03.491539 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-e789d604-8da0-4399-8adf-975952edf319 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 4ae315ed-e587-4aec-b3bb-4b76f8b89331] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:21:03.499095 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e789d604-8da0-4399-8adf-975952edf319 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:21:03.499694 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e789d604-8da0-4399-8adf-975952edf319 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:21:03.500221 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e789d604-8da0-4399-8adf-975952edf319 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:21:03.501019 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e789d604-8da0-4399-8adf-975952edf319 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:21:03.501512 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e789d604-8da0-4399-8adf-975952edf319 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:21:03.501953 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e789d604-8da0-4399-8adf-975952edf319 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:21:03.541767 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-e789d604-8da0-4399-8adf-975952edf319 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "POST /compute/v2.1/servers/4ae315ed-e587-4aec-b3bb-4b76f8b89331/action" status: 200 len: 14 microversion: 2.1 time: 0.056495 Oct 08 21:21:03.545180 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2660/5396] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:21:03 2022] POST /compute/v2.1/servers/4ae315ed-e587-4aec-b3bb-4b76f8b89331/action => generated 14 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 08 21:21:04.557819 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-0f5bdda4-38e7-4878-a6a7-347edb459595 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:21:04.558869 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-0f5bdda4-38e7-4878-a6a7-347edb459595 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 4ae315ed-e587-4aec-b3bb-4b76f8b89331] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:21:04.565632 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0f5bdda4-38e7-4878-a6a7-347edb459595 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:21:04.566154 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0f5bdda4-38e7-4878-a6a7-347edb459595 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:21:04.566596 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0f5bdda4-38e7-4878-a6a7-347edb459595 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:21:04.567301 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0f5bdda4-38e7-4878-a6a7-347edb459595 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:21:04.567762 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0f5bdda4-38e7-4878-a6a7-347edb459595 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:21:04.568194 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0f5bdda4-38e7-4878-a6a7-347edb459595 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:21:04.609587 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-0f5bdda4-38e7-4878-a6a7-347edb459595 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "POST /compute/v2.1/servers/4ae315ed-e587-4aec-b3bb-4b76f8b89331/action" status: 200 len: 14 microversion: 2.1 time: 0.060660 Oct 08 21:21:04.613374 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2737/5397] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:21:04 2022] POST /compute/v2.1/servers/4ae315ed-e587-4aec-b3bb-4b76f8b89331/action => generated 14 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 08 21:21:05.622198 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-f982726f-93ec-41c6-bae0-7dbe83c7abe1 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:21:05.624817 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-f982726f-93ec-41c6-bae0-7dbe83c7abe1 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 4ae315ed-e587-4aec-b3bb-4b76f8b89331] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:21:05.632960 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f982726f-93ec-41c6-bae0-7dbe83c7abe1 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:21:05.633614 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f982726f-93ec-41c6-bae0-7dbe83c7abe1 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:21:05.634333 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f982726f-93ec-41c6-bae0-7dbe83c7abe1 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:21:05.636459 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f982726f-93ec-41c6-bae0-7dbe83c7abe1 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:21:05.637119 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f982726f-93ec-41c6-bae0-7dbe83c7abe1 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:21:05.637772 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f982726f-93ec-41c6-bae0-7dbe83c7abe1 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:21:05.694700 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-f982726f-93ec-41c6-bae0-7dbe83c7abe1 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "POST /compute/v2.1/servers/4ae315ed-e587-4aec-b3bb-4b76f8b89331/action" status: 200 len: 8204 microversion: 2.1 time: 0.077710 Oct 08 21:21:05.701692 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2661/5398] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:21:05 2022] POST /compute/v2.1/servers/4ae315ed-e587-4aec-b3bb-4b76f8b89331/action => generated 8204 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:21:05.710753 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-617a03df-56c5-42ae-898b-7c947947a150 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:21:05.711585 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-617a03df-56c5-42ae-898b-7c947947a150 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 2a61f287-652b-487f-9ecd-fb4d2d1eee62] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:21:05.722411 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-617a03df-56c5-42ae-898b-7c947947a150 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:21:05.723028 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-617a03df-56c5-42ae-898b-7c947947a150 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:21:05.723530 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-617a03df-56c5-42ae-898b-7c947947a150 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:21:05.724405 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-617a03df-56c5-42ae-898b-7c947947a150 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:21:05.724973 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-617a03df-56c5-42ae-898b-7c947947a150 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:21:05.725602 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-617a03df-56c5-42ae-898b-7c947947a150 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:21:05.886729 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-617a03df-56c5-42ae-898b-7c947947a150 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:21:05.894720 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-617a03df-56c5-42ae-898b-7c947947a150 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62" status: 200 len: 1670 microversion: 2.1 time: 0.191566 Oct 08 21:21:05.895294 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2738/5399] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:21:05 2022] GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62 => generated 1670 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:21:05.921043 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-bd9adf82-f5ec-4e04-b2ab-65bce6748342 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:21:05.921845 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-bd9adf82-f5ec-4e04-b2ab-65bce6748342 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 2a61f287-652b-487f-9ecd-fb4d2d1eee62] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:21:05.929450 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bd9adf82-f5ec-4e04-b2ab-65bce6748342 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:21:05.929947 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bd9adf82-f5ec-4e04-b2ab-65bce6748342 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:21:05.930496 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bd9adf82-f5ec-4e04-b2ab-65bce6748342 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:21:05.931106 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bd9adf82-f5ec-4e04-b2ab-65bce6748342 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:21:05.931596 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bd9adf82-f5ec-4e04-b2ab-65bce6748342 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:21:05.932662 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bd9adf82-f5ec-4e04-b2ab-65bce6748342 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:21:06.106484 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-bd9adf82-f5ec-4e04-b2ab-65bce6748342 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:21:06.114779 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-bd9adf82-f5ec-4e04-b2ab-65bce6748342 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62" status: 200 len: 1670 microversion: 2.1 time: 0.198619 Oct 08 21:21:06.115397 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2662/5400] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:21:05 2022] GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62 => generated 1670 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:21:06.139651 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-8c2ca4d4-6647-4c5d-b883-4cfdec5788fc tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:21:06.140127 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-8c2ca4d4-6647-4c5d-b883-4cfdec5788fc tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 2a61f287-652b-487f-9ecd-fb4d2d1eee62] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:21:06.148342 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8c2ca4d4-6647-4c5d-b883-4cfdec5788fc tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:21:06.149235 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8c2ca4d4-6647-4c5d-b883-4cfdec5788fc tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:21:06.149924 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8c2ca4d4-6647-4c5d-b883-4cfdec5788fc tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:21:06.151291 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8c2ca4d4-6647-4c5d-b883-4cfdec5788fc tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:21:06.152085 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8c2ca4d4-6647-4c5d-b883-4cfdec5788fc tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:21:06.152612 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8c2ca4d4-6647-4c5d-b883-4cfdec5788fc tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:21:06.641731 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-8c2ca4d4-6647-4c5d-b883-4cfdec5788fc tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:21:06.650085 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-8c2ca4d4-6647-4c5d-b883-4cfdec5788fc tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62" status: 200 len: 1670 microversion: 2.1 time: 0.515510 Oct 08 21:21:06.650929 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2739/5401] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:21:06 2022] GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62 => generated 1670 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:21:06.672378 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-ada3d9d3-dda3-4806-89c5-04dc3921a2a8 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:21:06.672995 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-ada3d9d3-dda3-4806-89c5-04dc3921a2a8 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 2a61f287-652b-487f-9ecd-fb4d2d1eee62] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:21:06.680286 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ada3d9d3-dda3-4806-89c5-04dc3921a2a8 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:21:06.680788 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ada3d9d3-dda3-4806-89c5-04dc3921a2a8 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:21:06.681256 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ada3d9d3-dda3-4806-89c5-04dc3921a2a8 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:21:06.682741 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ada3d9d3-dda3-4806-89c5-04dc3921a2a8 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:21:06.683200 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ada3d9d3-dda3-4806-89c5-04dc3921a2a8 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:21:06.683799 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ada3d9d3-dda3-4806-89c5-04dc3921a2a8 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:21:06.832130 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-ada3d9d3-dda3-4806-89c5-04dc3921a2a8 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:21:06.841037 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-ada3d9d3-dda3-4806-89c5-04dc3921a2a8 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62" status: 200 len: 1670 microversion: 2.1 time: 0.172338 Oct 08 21:21:06.857597 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2663/5402] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:21:06 2022] GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62 => generated 1670 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:21:06.864382 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-029fc434-e1e3-44d7-b620-b231724f304e tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:21:06.864963 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-029fc434-e1e3-44d7-b620-b231724f304e tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 2a61f287-652b-487f-9ecd-fb4d2d1eee62] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:21:06.872662 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-029fc434-e1e3-44d7-b620-b231724f304e tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:21:06.873171 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-029fc434-e1e3-44d7-b620-b231724f304e tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:21:06.873643 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-029fc434-e1e3-44d7-b620-b231724f304e tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:21:06.874367 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-029fc434-e1e3-44d7-b620-b231724f304e tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:21:06.875025 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-029fc434-e1e3-44d7-b620-b231724f304e tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:21:06.875801 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-029fc434-e1e3-44d7-b620-b231724f304e tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:21:06.943912 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-029fc434-e1e3-44d7-b620-b231724f304e tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 2a61f287-652b-487f-9ecd-fb4d2d1eee62] Locking {{(pid=140492) lock /opt/stack/nova/nova/compute/api.py:4845}} Oct 08 21:21:07.002516 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-029fc434-e1e3-44d7-b620-b231724f304e tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "POST /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62/action" status: 202 len: 0 microversion: 2.1 time: 0.142032 Oct 08 21:21:07.003183 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2740/5403] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:21:06 2022] POST /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62/action => generated 0 bytes in 143 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 21:21:07.011633 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c3231095-cb6e-4be5-a4d7-a98161c71bad tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:21:07.012254 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-c3231095-cb6e-4be5-a4d7-a98161c71bad tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 2a61f287-652b-487f-9ecd-fb4d2d1eee62] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:21:07.019631 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c3231095-cb6e-4be5-a4d7-a98161c71bad tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:21:07.020164 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c3231095-cb6e-4be5-a4d7-a98161c71bad tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:21:07.020616 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c3231095-cb6e-4be5-a4d7-a98161c71bad tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:21:07.021444 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c3231095-cb6e-4be5-a4d7-a98161c71bad tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:21:07.021841 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c3231095-cb6e-4be5-a4d7-a98161c71bad tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:21:07.022946 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c3231095-cb6e-4be5-a4d7-a98161c71bad tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:21:07.173049 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-c3231095-cb6e-4be5-a4d7-a98161c71bad tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:21:07.181638 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-c3231095-cb6e-4be5-a4d7-a98161c71bad tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62" status: 200 len: 1670 microversion: 2.1 time: 0.174238 Oct 08 21:21:07.182861 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2664/5404] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:21:07 2022] GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62 => generated 1670 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:21:07.207129 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-76222b34-b7cd-4d88-8dda-7ab2afd22189 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:21:07.213927 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-76222b34-b7cd-4d88-8dda-7ab2afd22189 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:21:07.214575 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-76222b34-b7cd-4d88-8dda-7ab2afd22189 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:21:07.215128 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-76222b34-b7cd-4d88-8dda-7ab2afd22189 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:21:07.239259 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-76222b34-b7cd-4d88-8dda-7ab2afd22189 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] HTTP exception thrown: Instance 2a61f287-652b-487f-9ecd-fb4d2d1eee62 is locked Oct 08 21:21:07.240451 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-76222b34-b7cd-4d88-8dda-7ab2afd22189 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Request method failure captured: Oct 08 21:21:07.240451 ncdv-master-1 devstack@n-api.service[140492]: request: POST /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62/action HTTP/1.1 Oct 08 21:21:07.240451 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:21:07.240451 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:21:07.240451 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:21:07.240451 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 15 Oct 08 21:21:07.240451 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:21:07.240451 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:21:07.240451 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:21:07.240451 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:21:07.240451 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQejiYlaPI-JtqvK14aYdk5AJQZ9Rj0WfXfezm3HghOQHCqDAnzzaGqHnmcxTg9_bQH8N_IiErrzdvkHM9CcLpkI8dflyFrbZJ8oohauamjv0z3cmdzo6PpuDpJEm2ViNPKrmyHelDYEhGxb7y4b1zyM2T-OENcW1NDh2QOCLmS2DfCA Oct 08 21:21:07.240451 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:21:07.240451 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:21:07.240451 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:21:07.240451 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:21:07.240451 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:21:07.240451 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:21:07.240451 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: bd563fa73afb42c6b26eca3737d7a355 Oct 08 21:21:07.240451 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-ServerActionsTestJSON-1611357772 Oct 08 21:21:07.240451 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:21:07.240451 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:21:07.240451 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/bd563fa73afb42c6b26eca3737d7a355"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/bd563fa73afb42c6b26eca3737d7a355"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_bd563fa73afb42c6b26eca3737d7a355"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/bd563fa73afb42c6b26eca3737d7a355"}]}] Oct 08 21:21:07.240451 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-ServerActionsTestJSON-1611357772 Oct 08 21:21:07.240451 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: bd563fa73afb42c6b26eca3737d7a355 Oct 08 21:21:07.240451 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-ServerActionsTestJSON-1611357772 Oct 08 21:21:07.240451 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-ServerActionsTestJSON-1611357772-project Oct 08 21:21:07.240451 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:21:07.240451 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:21:07.240451 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 2f98e01cab6b49c7a5d239aee95f4a64 Oct 08 21:21:07.240451 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-ServerActionsTestJSON-1611357772-project Oct 08 21:21:07.240451 ncdv-master-1 devstack@n-api.service[140492]: Oct 08 21:21:07.240451 ncdv-master-1 devstack@n-api.service[140492]: {"os-stop": {}} Oct 08 21:21:07.240451 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 21:21:07.240451 ncdv-master-1 devstack@n-api.service[140492]: exception: Instance 2a61f287-652b-487f-9ecd-fb4d2d1eee62 is locked Oct 08 21:21:07.240451 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': '2a61f287-652b-487f-9ecd-fb4d2d1eee62', 'body': {'os-stop': {}}} Oct 08 21:21:07.240451 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:21:07.240451 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:21:07.240451 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1449, in _stop_server Oct 08 21:21:07.240451 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Oct 08 21:21:07.240451 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 240, in inner Oct 08 21:21:07.240451 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Oct 08 21:21:07.240451 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance 2a61f287-652b-487f-9ecd-fb4d2d1eee62 is locked Oct 08 21:21:07.240451 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:21:07.240451 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:21:07.240451 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:21:07.240451 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:21:07.240451 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:21:07.240451 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:21:07.240451 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:21:07.240451 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:21:07.240451 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:21:07.240451 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:21:07.240451 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1451, in _stop_server Oct 08 21:21:07.240451 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Oct 08 21:21:07.240451 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance 2a61f287-652b-487f-9ecd-fb4d2d1eee62 is locked Oct 08 21:21:07.240451 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:21:07.240451 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:21:07.240451 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:21:07.240451 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:21:07.240451 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:21:07.240451 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:21:07.240451 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:21:07.240451 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:21:07.240451 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a61f287-652b-487f-9ecd-fb4d2d1eee62 is locked Oct 08 21:21:07.240451 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:21:07.245124 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-76222b34-b7cd-4d88-8dda-7ab2afd22189 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Returning 409 to user: Instance 2a61f287-652b-487f-9ecd-fb4d2d1eee62 is locked {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:21:07.245124 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-76222b34-b7cd-4d88-8dda-7ab2afd22189 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "POST /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62/action" status: 409 len: 107 microversion: 2.1 time: 0.038942 Oct 08 21:21:07.245124 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2741/5405] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:21:07 2022] POST /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62/action => generated 107 bytes in 41 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 08 21:21:07.252703 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-0c81eb12-3018-4b99-83ff-ce05b2d573f0 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:21:07.253145 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-0c81eb12-3018-4b99-83ff-ce05b2d573f0 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 2a61f287-652b-487f-9ecd-fb4d2d1eee62] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:21:07.263549 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0c81eb12-3018-4b99-83ff-ce05b2d573f0 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:21:07.264021 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0c81eb12-3018-4b99-83ff-ce05b2d573f0 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:21:07.264477 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0c81eb12-3018-4b99-83ff-ce05b2d573f0 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:21:07.265259 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0c81eb12-3018-4b99-83ff-ce05b2d573f0 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:21:07.265692 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0c81eb12-3018-4b99-83ff-ce05b2d573f0 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:21:07.266335 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0c81eb12-3018-4b99-83ff-ce05b2d573f0 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:21:07.270648 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=100 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:21:07.315370 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-0c81eb12-3018-4b99-83ff-ce05b2d573f0 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 2a61f287-652b-487f-9ecd-fb4d2d1eee62] Unlocking {{(pid=140491) unlock /opt/stack/nova/nova/compute/api.py:4874}} Oct 08 21:21:07.332202 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-a1cfefdd-02b5-418c-8ab9-16b047f7d7e3 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:21:07.332709 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-a1cfefdd-02b5-418c-8ab9-16b047f7d7e3 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] [instance: 9f900981-d52d-48dd-8357-e4a950e600f7] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:21:07.339332 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a1cfefdd-02b5-418c-8ab9-16b047f7d7e3 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:21:07.339838 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a1cfefdd-02b5-418c-8ab9-16b047f7d7e3 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:21:07.340372 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a1cfefdd-02b5-418c-8ab9-16b047f7d7e3 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:21:07.341455 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a1cfefdd-02b5-418c-8ab9-16b047f7d7e3 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:21:07.341971 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a1cfefdd-02b5-418c-8ab9-16b047f7d7e3 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:21:07.342556 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a1cfefdd-02b5-418c-8ab9-16b047f7d7e3 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:21:07.385057 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-0c81eb12-3018-4b99-83ff-ce05b2d573f0 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "POST /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62/action" status: 202 len: 0 microversion: 2.1 time: 0.136263 Oct 08 21:21:07.389740 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2665/5406] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:21:07 2022] POST /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62/action => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 21:21:07.407113 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-108b3681-91f1-48b5-ac07-6333753494ca tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:21:07.420398 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-108b3681-91f1-48b5-ac07-6333753494ca tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:21:07.420967 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-108b3681-91f1-48b5-ac07-6333753494ca tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:21:07.421393 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-108b3681-91f1-48b5-ac07-6333753494ca tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:21:07.453154 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.objects.instance [None req-a1cfefdd-02b5-418c-8ab9-16b047f7d7e3 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lazy-loading 'services' on Instance uuid 9f900981-d52d-48dd-8357-e4a950e600f7 {{(pid=140492) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 21:21:07.467264 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-108b3681-91f1-48b5-ac07-6333753494ca tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 2a61f287-652b-487f-9ecd-fb4d2d1eee62] Going to try to stop instance {{(pid=140491) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 08 21:21:07.561161 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-a1cfefdd-02b5-418c-8ab9-16b047f7d7e3 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] 10.222.0.26 "DELETE /compute/v2.1/servers/9f900981-d52d-48dd-8357-e4a950e600f7/os-volume_attachments/e6e294ba-6781-4b55-bc1c-d34d92ef1ea3" status: 202 len: 0 microversion: 2.1 time: 0.232583 Oct 08 21:21:07.562449 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2742/5407] 10.222.0.26 () {58 vars in 1416 bytes} [Sat Oct 8 21:21:07 2022] DELETE /compute/v2.1/servers/9f900981-d52d-48dd-8357-e4a950e600f7/os-volume_attachments/e6e294ba-6781-4b55-bc1c-d34d92ef1ea3 => generated 0 bytes in 235 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 08 21:21:07.579644 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-108b3681-91f1-48b5-ac07-6333753494ca tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "POST /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62/action" status: 202 len: 0 microversion: 2.1 time: 0.182642 Oct 08 21:21:07.585467 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2666/5408] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:21:07 2022] POST /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62/action => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 21:21:07.599208 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-853b9ed1-66c5-49da-919d-e9e96512ec0c tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:21:07.600350 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-853b9ed1-66c5-49da-919d-e9e96512ec0c tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 2a61f287-652b-487f-9ecd-fb4d2d1eee62] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:21:07.613867 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-853b9ed1-66c5-49da-919d-e9e96512ec0c tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:21:07.614854 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-853b9ed1-66c5-49da-919d-e9e96512ec0c tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:21:07.615675 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-853b9ed1-66c5-49da-919d-e9e96512ec0c tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:21:07.617524 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-853b9ed1-66c5-49da-919d-e9e96512ec0c tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:21:07.618341 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-853b9ed1-66c5-49da-919d-e9e96512ec0c tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:21:07.619070 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-853b9ed1-66c5-49da-919d-e9e96512ec0c tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:21:07.920874 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-853b9ed1-66c5-49da-919d-e9e96512ec0c tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:21:07.937152 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-853b9ed1-66c5-49da-919d-e9e96512ec0c tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62" status: 200 len: 1680 microversion: 2.1 time: 0.341846 Oct 08 21:21:07.938242 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2743/5409] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:21:07 2022] GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62 => generated 1680 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:21:08.737756 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-3d0087f0-8993-4a29-ad0e-9f9e2a1168fa tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:21:08.739143 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-3d0087f0-8993-4a29-ad0e-9f9e2a1168fa tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] [instance: 9f900981-d52d-48dd-8357-e4a950e600f7] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:21:08.741616 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=6 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:21:08.747826 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3d0087f0-8993-4a29-ad0e-9f9e2a1168fa tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:21:08.748556 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3d0087f0-8993-4a29-ad0e-9f9e2a1168fa tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:21:08.749178 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3d0087f0-8993-4a29-ad0e-9f9e2a1168fa tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:21:08.750020 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3d0087f0-8993-4a29-ad0e-9f9e2a1168fa tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:21:08.750692 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3d0087f0-8993-4a29-ad0e-9f9e2a1168fa tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:21:08.751111 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3d0087f0-8993-4a29-ad0e-9f9e2a1168fa tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:21:08.781036 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-3d0087f0-8993-4a29-ad0e-9f9e2a1168fa tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] [instance: 9f900981-d52d-48dd-8357-e4a950e600f7] Going to try to terminate instance {{(pid=140491) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 21:21:08.881493 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-3d0087f0-8993-4a29-ad0e-9f9e2a1168fa tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] 10.222.0.26 "DELETE /compute/v2.1/servers/9f900981-d52d-48dd-8357-e4a950e600f7" status: 204 len: 0 microversion: 2.1 time: 0.148913 Oct 08 21:21:08.882563 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2667/5410] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:21:08 2022] DELETE /compute/v2.1/servers/9f900981-d52d-48dd-8357-e4a950e600f7 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 21:21:08.891030 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-2799a675-340e-424b-b2db-754f635023d3 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:21:08.891805 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-2799a675-340e-424b-b2db-754f635023d3 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] [instance: 9f900981-d52d-48dd-8357-e4a950e600f7] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:21:08.899469 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2799a675-340e-424b-b2db-754f635023d3 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:21:08.900187 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2799a675-340e-424b-b2db-754f635023d3 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:21:08.901283 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2799a675-340e-424b-b2db-754f635023d3 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:21:08.902027 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2799a675-340e-424b-b2db-754f635023d3 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:21:08.902492 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2799a675-340e-424b-b2db-754f635023d3 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:21:08.903014 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2799a675-340e-424b-b2db-754f635023d3 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:21:08.963825 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-50e220fc-b786-42c3-a513-eb0a00e4606f tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:21:08.964610 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-50e220fc-b786-42c3-a513-eb0a00e4606f tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 2a61f287-652b-487f-9ecd-fb4d2d1eee62] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:21:08.971760 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-50e220fc-b786-42c3-a513-eb0a00e4606f tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:21:08.972272 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-50e220fc-b786-42c3-a513-eb0a00e4606f tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:21:08.972781 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-50e220fc-b786-42c3-a513-eb0a00e4606f tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:21:08.973542 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-50e220fc-b786-42c3-a513-eb0a00e4606f tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:21:08.974019 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-50e220fc-b786-42c3-a513-eb0a00e4606f tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:21:08.974456 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-50e220fc-b786-42c3-a513-eb0a00e4606f tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:21:09.083552 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-2799a675-340e-424b-b2db-754f635023d3 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a292ffe2c5c41ef8d281fa525792b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdea37d91ed431aa0dc780148174e5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:21:09.092085 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-2799a675-340e-424b-b2db-754f635023d3 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] 10.222.0.26 "GET /compute/v2.1/servers/9f900981-d52d-48dd-8357-e4a950e600f7" status: 200 len: 1513 microversion: 2.1 time: 0.205005 Oct 08 21:21:09.092683 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2744/5411] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:21:08 2022] GET /compute/v2.1/servers/9f900981-d52d-48dd-8357-e4a950e600f7 => generated 1513 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:21:09.180626 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-50e220fc-b786-42c3-a513-eb0a00e4606f tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:21:09.191108 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-50e220fc-b786-42c3-a513-eb0a00e4606f tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62" status: 200 len: 1680 microversion: 2.1 time: 0.232514 Oct 08 21:21:09.191981 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2668/5412] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:21:08 2022] GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62 => generated 1680 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:21:10.116507 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-39b5a9e4-57f2-4695-a624-9dc139ec68b1 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:21:10.117077 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-39b5a9e4-57f2-4695-a624-9dc139ec68b1 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] [instance: 9f900981-d52d-48dd-8357-e4a950e600f7] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:21:10.124366 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-39b5a9e4-57f2-4695-a624-9dc139ec68b1 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:21:10.125044 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-39b5a9e4-57f2-4695-a624-9dc139ec68b1 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:21:10.125928 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-39b5a9e4-57f2-4695-a624-9dc139ec68b1 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:21:10.126802 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-39b5a9e4-57f2-4695-a624-9dc139ec68b1 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:21:10.127415 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-39b5a9e4-57f2-4695-a624-9dc139ec68b1 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:21:10.127976 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-39b5a9e4-57f2-4695-a624-9dc139ec68b1 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:21:10.155625 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:21:10.221252 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-db9a6c99-201e-4cd4-907d-89577382de9f tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:21:10.223204 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-db9a6c99-201e-4cd4-907d-89577382de9f tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 2a61f287-652b-487f-9ecd-fb4d2d1eee62] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:21:10.232779 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-db9a6c99-201e-4cd4-907d-89577382de9f tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:21:10.233633 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-db9a6c99-201e-4cd4-907d-89577382de9f tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:21:10.234455 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-db9a6c99-201e-4cd4-907d-89577382de9f tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:21:10.235848 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-db9a6c99-201e-4cd4-907d-89577382de9f tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:21:10.236481 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-db9a6c99-201e-4cd4-907d-89577382de9f tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:21:10.237084 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-db9a6c99-201e-4cd4-907d-89577382de9f tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:21:10.305944 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-39b5a9e4-57f2-4695-a624-9dc139ec68b1 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a292ffe2c5c41ef8d281fa525792b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdea37d91ed431aa0dc780148174e5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:21:10.314982 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-39b5a9e4-57f2-4695-a624-9dc139ec68b1 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] 10.222.0.26 "GET /compute/v2.1/servers/9f900981-d52d-48dd-8357-e4a950e600f7" status: 200 len: 1513 microversion: 2.1 time: 0.202842 Oct 08 21:21:10.316882 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2745/5413] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:21:10 2022] GET /compute/v2.1/servers/9f900981-d52d-48dd-8357-e4a950e600f7 => generated 1513 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:21:10.436872 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-db9a6c99-201e-4cd4-907d-89577382de9f tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:21:10.450240 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-db9a6c99-201e-4cd4-907d-89577382de9f tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62" status: 200 len: 1680 microversion: 2.1 time: 0.239201 Oct 08 21:21:10.451081 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2669/5414] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:21:10 2022] GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62 => generated 1680 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:21:11.036070 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-92fad2d2-bbdd-4a65-ba2c-0242d7903e19 req-b76376a4-8c15-4925-86e2-fa5be3562e93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f900981-d52d-48dd-8357-e4a950e600f7", "name": "network-vif-deleted", "tag": "0b66715e-2ae0-43dc-8b6d-8c6e44c12f2f"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:21:11.055708 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-92fad2d2-bbdd-4a65-ba2c-0242d7903e19 req-b76376a4-8c15-4925-86e2-fa5be3562e93 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:21:11.056289 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-92fad2d2-bbdd-4a65-ba2c-0242d7903e19 req-b76376a4-8c15-4925-86e2-fa5be3562e93 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:21:11.056831 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-92fad2d2-bbdd-4a65-ba2c-0242d7903e19 req-b76376a4-8c15-4925-86e2-fa5be3562e93 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:21:11.070189 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-92fad2d2-bbdd-4a65-ba2c-0242d7903e19 req-b76376a4-8c15-4925-86e2-fa5be3562e93 service nova] Creating event network-vif-deleted:0b66715e-2ae0-43dc-8b6d-8c6e44c12f2f for instance 9f900981-d52d-48dd-8357-e4a950e600f7 on nch1-master-1 Oct 08 21:21:11.079956 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-92fad2d2-bbdd-4a65-ba2c-0242d7903e19 req-b76376a4-8c15-4925-86e2-fa5be3562e93 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047642 Oct 08 21:21:11.080718 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2746/5415] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:21:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:21:11.342316 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-e06ee17e-2090-42b2-a085-e7e1ab83cba2 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:21:11.343059 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-e06ee17e-2090-42b2-a085-e7e1ab83cba2 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] [instance: 9f900981-d52d-48dd-8357-e4a950e600f7] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:21:11.353860 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e06ee17e-2090-42b2-a085-e7e1ab83cba2 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:21:11.354612 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e06ee17e-2090-42b2-a085-e7e1ab83cba2 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:21:11.355315 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e06ee17e-2090-42b2-a085-e7e1ab83cba2 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:21:11.356646 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e06ee17e-2090-42b2-a085-e7e1ab83cba2 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:21:11.357477 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e06ee17e-2090-42b2-a085-e7e1ab83cba2 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:21:11.358170 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e06ee17e-2090-42b2-a085-e7e1ab83cba2 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:21:11.419165 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e06ee17e-2090-42b2-a085-e7e1ab83cba2 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:21:11.419817 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e06ee17e-2090-42b2-a085-e7e1ab83cba2 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:21:11.420910 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e06ee17e-2090-42b2-a085-e7e1ab83cba2 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:21:11.421913 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.objects.instance [None req-e06ee17e-2090-42b2-a085-e7e1ab83cba2 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lazy-loading 'fault' on Instance uuid 9f900981-d52d-48dd-8357-e4a950e600f7 {{(pid=140491) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 21:21:11.483677 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-ac3da2e6-488c-4848-bbaa-33a8164251e1 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:21:11.486023 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-ac3da2e6-488c-4848-bbaa-33a8164251e1 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 2a61f287-652b-487f-9ecd-fb4d2d1eee62] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:21:11.498895 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-e06ee17e-2090-42b2-a085-e7e1ab83cba2 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a292ffe2c5c41ef8d281fa525792b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdea37d91ed431aa0dc780148174e5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:21:11.503356 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ac3da2e6-488c-4848-bbaa-33a8164251e1 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:21:11.504949 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ac3da2e6-488c-4848-bbaa-33a8164251e1 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:21:11.505832 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ac3da2e6-488c-4848-bbaa-33a8164251e1 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:21:11.507781 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ac3da2e6-488c-4848-bbaa-33a8164251e1 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:21:11.508995 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ac3da2e6-488c-4848-bbaa-33a8164251e1 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:21:11.511965 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ac3da2e6-488c-4848-bbaa-33a8164251e1 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:21:11.514430 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-e06ee17e-2090-42b2-a085-e7e1ab83cba2 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] 10.222.0.26 "GET /compute/v2.1/servers/9f900981-d52d-48dd-8357-e4a950e600f7" status: 200 len: 1308 microversion: 2.1 time: 0.177859 Oct 08 21:21:11.515230 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2670/5416] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:21:11 2022] GET /compute/v2.1/servers/9f900981-d52d-48dd-8357-e4a950e600f7 => generated 1308 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:21:11.669618 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-ac3da2e6-488c-4848-bbaa-33a8164251e1 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:21:11.678495 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-ac3da2e6-488c-4848-bbaa-33a8164251e1 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62" status: 200 len: 1680 microversion: 2.1 time: 0.204580 Oct 08 21:21:11.693489 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2747/5417] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:21:11 2022] GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62 => generated 1680 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:21:12.059213 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-0615cffd-6830-42c2-b2e8-86da0770f1cf tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:21:12.059955 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-0615cffd-6830-42c2-b2e8-86da0770f1cf tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] [instance: 1c8a0a0f-8250-4837-9dde-7a09bb570243] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:21:12.073930 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0615cffd-6830-42c2-b2e8-86da0770f1cf tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:21:12.076377 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0615cffd-6830-42c2-b2e8-86da0770f1cf tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:21:12.078935 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0615cffd-6830-42c2-b2e8-86da0770f1cf tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:21:12.083819 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0615cffd-6830-42c2-b2e8-86da0770f1cf tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:21:12.084670 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0615cffd-6830-42c2-b2e8-86da0770f1cf tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:21:12.089148 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0615cffd-6830-42c2-b2e8-86da0770f1cf tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:21:12.194952 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.objects.instance [None req-0615cffd-6830-42c2-b2e8-86da0770f1cf tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Lazy-loading 'services' on Instance uuid 1c8a0a0f-8250-4837-9dde-7a09bb570243 {{(pid=140491) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 21:21:12.285070 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-0615cffd-6830-42c2-b2e8-86da0770f1cf tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] 10.222.0.26 "DELETE /compute/v2.1/servers/1c8a0a0f-8250-4837-9dde-7a09bb570243/os-volume_attachments/d763bbc7-78ba-482f-883e-5cbff5953069" status: 202 len: 0 microversion: 2.1 time: 0.231332 Oct 08 21:21:12.286774 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2671/5418] 10.222.0.26 () {58 vars in 1416 bytes} [Sat Oct 8 21:21:12 2022] DELETE /compute/v2.1/servers/1c8a0a0f-8250-4837-9dde-7a09bb570243/os-volume_attachments/d763bbc7-78ba-482f-883e-5cbff5953069 => generated 0 bytes in 234 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 21:21:12.538353 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-afccff25-5ef6-4e88-8a0a-5481313cba54 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:21:12.538988 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-afccff25-5ef6-4e88-8a0a-5481313cba54 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] [instance: 9f900981-d52d-48dd-8357-e4a950e600f7] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:21:12.546721 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-afccff25-5ef6-4e88-8a0a-5481313cba54 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:21:12.547547 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-afccff25-5ef6-4e88-8a0a-5481313cba54 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:21:12.547998 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-afccff25-5ef6-4e88-8a0a-5481313cba54 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:21:12.549008 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-afccff25-5ef6-4e88-8a0a-5481313cba54 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:21:12.549756 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-afccff25-5ef6-4e88-8a0a-5481313cba54 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:21:12.550443 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-afccff25-5ef6-4e88-8a0a-5481313cba54 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:21:12.568171 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-afccff25-5ef6-4e88-8a0a-5481313cba54 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] HTTP exception thrown: Instance 9f900981-d52d-48dd-8357-e4a950e600f7 could not be found. Oct 08 21:21:12.570354 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-afccff25-5ef6-4e88-8a0a-5481313cba54 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Request method failure captured: Oct 08 21:21:12.570354 ncdv-master-1 devstack@n-api.service[140492]: request: GET /compute/v2.1/servers/9f900981-d52d-48dd-8357-e4a950e600f7 HTTP/1.1 Oct 08 21:21:12.570354 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:21:12.570354 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:21:12.570354 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:21:12.570354 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 21:21:12.570354 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:21:12.570354 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:21:12.570354 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:21:12.570354 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:21:12.570354 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeiekdWLa9yWg81OrVrEM0Ycv6Ob6kaMB5aEifVq8rp8uyJBCpsdjoCAvS0mrofHdYcQnD4XeYmmHBliIKYMdIbQjAJ0wRy7HLjKWlc1YLf7TFrBv4DtQV64TapSU-jR1A3JBkat9vt39cjCpR-7pxJkUSO0tLNnnfzz3o2gycrBxcE Oct 08 21:21:12.570354 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:21:12.570354 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:21:12.570354 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:21:12.570354 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:21:12.570354 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:21:12.570354 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:21:12.570354 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 6fdea37d91ed431aa0dc780148174e5b Oct 08 21:21:12.570354 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-VolumesSnapshotTestJSON-547814895 Oct 08 21:21:12.570354 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:21:12.570354 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:21:12.570354 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6fdea37d91ed431aa0dc780148174e5b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6fdea37d91ed431aa0dc780148174e5b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6fdea37d91ed431aa0dc780148174e5b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6fdea37d91ed431aa0dc780148174e5b"}]}] Oct 08 21:21:12.570354 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-VolumesSnapshotTestJSON-547814895 Oct 08 21:21:12.570354 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 6fdea37d91ed431aa0dc780148174e5b Oct 08 21:21:12.570354 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-547814895 Oct 08 21:21:12.570354 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-VolumesSnapshotTestJSON-547814895-project Oct 08 21:21:12.570354 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:21:12.570354 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:21:12.570354 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 3a292ffe2c5c41ef8d281fa525792b16 Oct 08 21:21:12.570354 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-VolumesSnapshotTestJSON-547814895-project Oct 08 21:21:12.570354 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 21:21:12.570354 ncdv-master-1 devstack@n-api.service[140492]: exception: Instance 9f900981-d52d-48dd-8357-e4a950e600f7 could not be found. Oct 08 21:21:12.570354 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': '9f900981-d52d-48dd-8357-e4a950e600f7'} Oct 08 21:21:12.570354 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:21:12.570354 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:21:12.570354 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:21:12.570354 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:21:12.570354 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:21:12.570354 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:21:12.570354 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:21:12.570354 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:21:12.570354 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:21:12.570354 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:21:12.570354 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f900981-d52d-48dd-8357-e4a950e600f7 could not be found. Oct 08 21:21:12.570354 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:21:12.570354 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:21:12.570354 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:21:12.570354 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:21:12.570354 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:21:12.570354 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:21:12.570354 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:21:12.570354 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:21:12.570354 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:21:12.570354 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:21:12.570354 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:21:12.570354 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:21:12.570354 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:21:12.570354 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:21:12.570354 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:21:12.570354 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:21:12.570354 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f900981-d52d-48dd-8357-e4a950e600f7 could not be found. Oct 08 21:21:12.570354 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:21:12.570354 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:21:12.570354 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:21:12.578289 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:21:12.578289 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:21:12.578289 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:21:12.578289 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:21:12.578289 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:21:12.578289 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f900981-d52d-48dd-8357-e4a950e600f7 could not be found. Oct 08 21:21:12.578289 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:21:12.578289 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-afccff25-5ef6-4e88-8a0a-5481313cba54 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] Returning 404 to user: Instance 9f900981-d52d-48dd-8357-e4a950e600f7 could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:21:12.578289 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-afccff25-5ef6-4e88-8a0a-5481313cba54 tempest-VolumesSnapshotTestJSON-547814895 tempest-VolumesSnapshotTestJSON-547814895-project] 10.222.0.26 "GET /compute/v2.1/servers/9f900981-d52d-48dd-8357-e4a950e600f7" status: 404 len: 111 microversion: 2.1 time: 0.037439 Oct 08 21:21:12.578289 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2748/5419] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:21:12 2022] GET /compute/v2.1/servers/9f900981-d52d-48dd-8357-e4a950e600f7 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:21:12.705569 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c811ef03-5f76-433b-a380-e6c5ab4e9afd tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:21:12.706291 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-c811ef03-5f76-433b-a380-e6c5ab4e9afd tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 2a61f287-652b-487f-9ecd-fb4d2d1eee62] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:21:12.712852 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c811ef03-5f76-433b-a380-e6c5ab4e9afd tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:21:12.713798 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c811ef03-5f76-433b-a380-e6c5ab4e9afd tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:21:12.714447 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c811ef03-5f76-433b-a380-e6c5ab4e9afd tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:21:12.715175 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c811ef03-5f76-433b-a380-e6c5ab4e9afd tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:21:12.715807 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c811ef03-5f76-433b-a380-e6c5ab4e9afd tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:21:12.716417 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c811ef03-5f76-433b-a380-e6c5ab4e9afd tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:21:12.983700 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-c811ef03-5f76-433b-a380-e6c5ab4e9afd tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:21:12.997109 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-c811ef03-5f76-433b-a380-e6c5ab4e9afd tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62" status: 200 len: 1680 microversion: 2.1 time: 0.297356 Oct 08 21:21:12.998586 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2672/5420] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:21:12 2022] GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62 => generated 1680 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:21:13.526604 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-1f411b15-2f61-4c9c-ab00-3c27ff505739 tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:21:13.527431 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-1f411b15-2f61-4c9c-ab00-3c27ff505739 tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] [instance: 1c8a0a0f-8250-4837-9dde-7a09bb570243] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:21:13.536881 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1f411b15-2f61-4c9c-ab00-3c27ff505739 tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:21:13.537792 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1f411b15-2f61-4c9c-ab00-3c27ff505739 tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:21:13.538528 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1f411b15-2f61-4c9c-ab00-3c27ff505739 tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:21:13.540304 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1f411b15-2f61-4c9c-ab00-3c27ff505739 tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:21:13.540968 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1f411b15-2f61-4c9c-ab00-3c27ff505739 tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:21:13.542218 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1f411b15-2f61-4c9c-ab00-3c27ff505739 tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:21:13.581935 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-1f411b15-2f61-4c9c-ab00-3c27ff505739 tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] [instance: 1c8a0a0f-8250-4837-9dde-7a09bb570243] Going to try to terminate instance {{(pid=140492) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 21:21:13.721705 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-1f411b15-2f61-4c9c-ab00-3c27ff505739 tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] 10.222.0.26 "DELETE /compute/v2.1/servers/1c8a0a0f-8250-4837-9dde-7a09bb570243" status: 204 len: 0 microversion: 2.1 time: 0.201773 Oct 08 21:21:13.729735 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2749/5421] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:21:13 2022] DELETE /compute/v2.1/servers/1c8a0a0f-8250-4837-9dde-7a09bb570243 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 21:21:13.743589 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-63efb756-23d5-4872-aca4-990dc4c7ff2e tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:21:13.745008 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-63efb756-23d5-4872-aca4-990dc4c7ff2e tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] [instance: 1c8a0a0f-8250-4837-9dde-7a09bb570243] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:21:13.766605 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-63efb756-23d5-4872-aca4-990dc4c7ff2e tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:21:13.767128 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-63efb756-23d5-4872-aca4-990dc4c7ff2e tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:21:13.767590 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-63efb756-23d5-4872-aca4-990dc4c7ff2e tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:21:13.770582 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-63efb756-23d5-4872-aca4-990dc4c7ff2e tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:21:13.771096 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-63efb756-23d5-4872-aca4-990dc4c7ff2e tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:21:13.771558 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-63efb756-23d5-4872-aca4-990dc4c7ff2e tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:21:13.941047 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-63efb756-23d5-4872-aca4-990dc4c7ff2e tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a009ac77727640de9becf6a61c8f1662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd238ac8ac5e4e7793c1ebb53a85eaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:21:13.951433 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-63efb756-23d5-4872-aca4-990dc4c7ff2e tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] 10.222.0.26 "GET /compute/v2.1/servers/1c8a0a0f-8250-4837-9dde-7a09bb570243" status: 200 len: 1470 microversion: 2.1 time: 0.216281 Oct 08 21:21:13.952681 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2673/5422] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:21:13 2022] GET /compute/v2.1/servers/1c8a0a0f-8250-4837-9dde-7a09bb570243 => generated 1470 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:21:14.025638 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-3a994a10-3845-4253-9ff4-60ed03773efa tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:21:14.027858 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-3a994a10-3845-4253-9ff4-60ed03773efa tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 2a61f287-652b-487f-9ecd-fb4d2d1eee62] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:21:14.042745 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3a994a10-3845-4253-9ff4-60ed03773efa tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:21:14.043262 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3a994a10-3845-4253-9ff4-60ed03773efa tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:21:14.043713 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3a994a10-3845-4253-9ff4-60ed03773efa tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:21:14.046203 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3a994a10-3845-4253-9ff4-60ed03773efa tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:21:14.046879 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3a994a10-3845-4253-9ff4-60ed03773efa tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:21:14.047417 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3a994a10-3845-4253-9ff4-60ed03773efa tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:21:14.328500 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-3a994a10-3845-4253-9ff4-60ed03773efa tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:21:14.336946 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-3a994a10-3845-4253-9ff4-60ed03773efa tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62" status: 200 len: 1680 microversion: 2.1 time: 0.315719 Oct 08 21:21:14.337681 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2750/5423] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:21:14 2022] GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62 => generated 1680 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:21:14.987032 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-b5599975-ecd8-4403-acde-72c594b13d73 tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:21:14.989392 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-b5599975-ecd8-4403-acde-72c594b13d73 tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] [instance: 1c8a0a0f-8250-4837-9dde-7a09bb570243] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:21:14.998494 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b5599975-ecd8-4403-acde-72c594b13d73 tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:21:14.999127 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b5599975-ecd8-4403-acde-72c594b13d73 tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:21:14.999640 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b5599975-ecd8-4403-acde-72c594b13d73 tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:21:15.000537 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b5599975-ecd8-4403-acde-72c594b13d73 tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:21:15.001158 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b5599975-ecd8-4403-acde-72c594b13d73 tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:21:15.002008 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b5599975-ecd8-4403-acde-72c594b13d73 tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:21:15.171246 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-b5599975-ecd8-4403-acde-72c594b13d73 tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a009ac77727640de9becf6a61c8f1662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd238ac8ac5e4e7793c1ebb53a85eaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:21:15.180952 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-b5599975-ecd8-4403-acde-72c594b13d73 tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] 10.222.0.26 "GET /compute/v2.1/servers/1c8a0a0f-8250-4837-9dde-7a09bb570243" status: 200 len: 1470 microversion: 2.1 time: 0.204901 Oct 08 21:21:15.181970 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2674/5424] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:21:14 2022] GET /compute/v2.1/servers/1c8a0a0f-8250-4837-9dde-7a09bb570243 => generated 1470 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:21:15.364980 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-241ba256-103e-461d-afbe-2cb9d1839654 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:21:15.365909 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-241ba256-103e-461d-afbe-2cb9d1839654 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 2a61f287-652b-487f-9ecd-fb4d2d1eee62] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:21:15.393684 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-241ba256-103e-461d-afbe-2cb9d1839654 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:21:15.394191 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-241ba256-103e-461d-afbe-2cb9d1839654 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:21:15.394637 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-241ba256-103e-461d-afbe-2cb9d1839654 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:21:15.395363 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-241ba256-103e-461d-afbe-2cb9d1839654 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:21:15.395829 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-241ba256-103e-461d-afbe-2cb9d1839654 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:21:15.396263 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-241ba256-103e-461d-afbe-2cb9d1839654 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:21:15.790695 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-241ba256-103e-461d-afbe-2cb9d1839654 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:21:15.826380 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-241ba256-103e-461d-afbe-2cb9d1839654 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62" status: 200 len: 1680 microversion: 2.1 time: 0.446227 Oct 08 21:21:15.827064 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2751/5425] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:21:15 2022] GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62 => generated 1680 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:21:16.205290 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-30f20d89-e6ac-4177-8979-a756bf3db81f tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:21:16.206157 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-30f20d89-e6ac-4177-8979-a756bf3db81f tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] [instance: 1c8a0a0f-8250-4837-9dde-7a09bb570243] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:21:16.215948 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-30f20d89-e6ac-4177-8979-a756bf3db81f tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:21:16.216550 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-30f20d89-e6ac-4177-8979-a756bf3db81f tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:21:16.217248 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-30f20d89-e6ac-4177-8979-a756bf3db81f tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:21:16.218219 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-30f20d89-e6ac-4177-8979-a756bf3db81f tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:21:16.218787 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-30f20d89-e6ac-4177-8979-a756bf3db81f tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:21:16.219377 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-30f20d89-e6ac-4177-8979-a756bf3db81f tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:21:16.242874 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=5,nova_cell1:UPDATE=6 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:21:16.386079 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-30f20d89-e6ac-4177-8979-a756bf3db81f tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a009ac77727640de9becf6a61c8f1662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd238ac8ac5e4e7793c1ebb53a85eaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:21:16.398211 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-30f20d89-e6ac-4177-8979-a756bf3db81f tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] 10.222.0.26 "GET /compute/v2.1/servers/1c8a0a0f-8250-4837-9dde-7a09bb570243" status: 200 len: 1470 microversion: 2.1 time: 0.197916 Oct 08 21:21:16.400798 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2675/5426] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:21:16 2022] GET /compute/v2.1/servers/1c8a0a0f-8250-4837-9dde-7a09bb570243 => generated 1470 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:21:16.856128 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-63051fe4-7712-46c5-aa02-4611ba2ffaea tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:21:16.857504 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-63051fe4-7712-46c5-aa02-4611ba2ffaea tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 2a61f287-652b-487f-9ecd-fb4d2d1eee62] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:21:16.861254 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=1 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:21:16.870717 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-63051fe4-7712-46c5-aa02-4611ba2ffaea tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:21:16.871753 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-63051fe4-7712-46c5-aa02-4611ba2ffaea tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:21:16.872475 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-63051fe4-7712-46c5-aa02-4611ba2ffaea tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:21:16.873999 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-63051fe4-7712-46c5-aa02-4611ba2ffaea tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:21:16.874771 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-63051fe4-7712-46c5-aa02-4611ba2ffaea tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:21:16.876137 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-63051fe4-7712-46c5-aa02-4611ba2ffaea tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:21:17.029461 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-14874712-6454-4e10-b40c-1fc146084a40 req-a54ae414-b37f-4ce5-9964-39f9081d3fe0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c8a0a0f-8250-4837-9dde-7a09bb570243", "name": "network-vif-deleted", "tag": "8f8b6027-0f07-4328-ab14-df3e7c2a9205"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:21:17.044353 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-14874712-6454-4e10-b40c-1fc146084a40 req-a54ae414-b37f-4ce5-9964-39f9081d3fe0 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:21:17.045336 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-14874712-6454-4e10-b40c-1fc146084a40 req-a54ae414-b37f-4ce5-9964-39f9081d3fe0 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:21:17.045998 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-14874712-6454-4e10-b40c-1fc146084a40 req-a54ae414-b37f-4ce5-9964-39f9081d3fe0 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:21:17.081476 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-14874712-6454-4e10-b40c-1fc146084a40 req-a54ae414-b37f-4ce5-9964-39f9081d3fe0 service nova] Creating event network-vif-deleted:8f8b6027-0f07-4328-ab14-df3e7c2a9205 for instance 1c8a0a0f-8250-4837-9dde-7a09bb570243 on nch1-master-1 Oct 08 21:21:17.095684 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-14874712-6454-4e10-b40c-1fc146084a40 req-a54ae414-b37f-4ce5-9964-39f9081d3fe0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070343 Oct 08 21:21:17.097068 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2676/5427] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:21:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:21:17.334119 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-63051fe4-7712-46c5-aa02-4611ba2ffaea tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:21:17.344910 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-63051fe4-7712-46c5-aa02-4611ba2ffaea tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62" status: 200 len: 1680 microversion: 2.1 time: 0.491733 Oct 08 21:21:17.359752 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2752/5428] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:21:16 2022] GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62 => generated 1680 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:21:17.424300 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-8cb8be77-2f25-4286-9601-f81790c09b03 tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:21:17.426282 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-8cb8be77-2f25-4286-9601-f81790c09b03 tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] [instance: 1c8a0a0f-8250-4837-9dde-7a09bb570243] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:21:17.444981 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8cb8be77-2f25-4286-9601-f81790c09b03 tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:21:17.448049 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8cb8be77-2f25-4286-9601-f81790c09b03 tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:21:17.448695 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8cb8be77-2f25-4286-9601-f81790c09b03 tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:21:17.449851 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8cb8be77-2f25-4286-9601-f81790c09b03 tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:21:17.452593 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8cb8be77-2f25-4286-9601-f81790c09b03 tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:21:17.453240 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8cb8be77-2f25-4286-9601-f81790c09b03 tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:21:17.523120 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8cb8be77-2f25-4286-9601-f81790c09b03 tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:21:17.523628 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8cb8be77-2f25-4286-9601-f81790c09b03 tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:21:17.524075 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8cb8be77-2f25-4286-9601-f81790c09b03 tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:21:17.524541 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.objects.instance [None req-8cb8be77-2f25-4286-9601-f81790c09b03 tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Lazy-loading 'fault' on Instance uuid 1c8a0a0f-8250-4837-9dde-7a09bb570243 {{(pid=140491) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 21:21:17.589222 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-8cb8be77-2f25-4286-9601-f81790c09b03 tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a009ac77727640de9becf6a61c8f1662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd238ac8ac5e4e7793c1ebb53a85eaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:21:17.602408 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-8cb8be77-2f25-4286-9601-f81790c09b03 tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] 10.222.0.26 "GET /compute/v2.1/servers/1c8a0a0f-8250-4837-9dde-7a09bb570243" status: 200 len: 1304 microversion: 2.1 time: 0.184080 Oct 08 21:21:17.606300 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2677/5429] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:21:17 2022] GET /compute/v2.1/servers/1c8a0a0f-8250-4837-9dde-7a09bb570243 => generated 1304 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:21:18.376491 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-8650babd-8476-47d6-95b6-69133bd8206d tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:21:18.378493 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-8650babd-8476-47d6-95b6-69133bd8206d tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 2a61f287-652b-487f-9ecd-fb4d2d1eee62] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:21:18.391287 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8650babd-8476-47d6-95b6-69133bd8206d tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:21:18.394153 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8650babd-8476-47d6-95b6-69133bd8206d tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:21:18.394814 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8650babd-8476-47d6-95b6-69133bd8206d tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:21:18.395737 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8650babd-8476-47d6-95b6-69133bd8206d tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:21:18.397292 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8650babd-8476-47d6-95b6-69133bd8206d tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:21:18.398264 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8650babd-8476-47d6-95b6-69133bd8206d tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:21:18.628938 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-25e3d01c-ab1a-4f24-93ab-b50a1c83b6c2 tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:21:18.629604 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-25e3d01c-ab1a-4f24-93ab-b50a1c83b6c2 tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] [instance: 1c8a0a0f-8250-4837-9dde-7a09bb570243] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:21:18.641589 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-25e3d01c-ab1a-4f24-93ab-b50a1c83b6c2 tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:21:18.642170 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-25e3d01c-ab1a-4f24-93ab-b50a1c83b6c2 tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:21:18.642630 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-25e3d01c-ab1a-4f24-93ab-b50a1c83b6c2 tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:21:18.643489 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-25e3d01c-ab1a-4f24-93ab-b50a1c83b6c2 tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:21:18.643969 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-25e3d01c-ab1a-4f24-93ab-b50a1c83b6c2 tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:21:18.644435 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-25e3d01c-ab1a-4f24-93ab-b50a1c83b6c2 tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:21:18.654010 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-8650babd-8476-47d6-95b6-69133bd8206d tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:21:18.674448 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-8650babd-8476-47d6-95b6-69133bd8206d tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62" status: 200 len: 1657 microversion: 2.1 time: 0.306637 Oct 08 21:21:18.678441 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2753/5430] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:21:18 2022] GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62 => generated 1657 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:21:18.688719 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-25e3d01c-ab1a-4f24-93ab-b50a1c83b6c2 tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] HTTP exception thrown: Instance 1c8a0a0f-8250-4837-9dde-7a09bb570243 could not be found. Oct 08 21:21:18.697020 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-25e3d01c-ab1a-4f24-93ab-b50a1c83b6c2 tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Request method failure captured: Oct 08 21:21:18.697020 ncdv-master-1 devstack@n-api.service[140491]: request: GET /compute/v2.1/servers/1c8a0a0f-8250-4837-9dde-7a09bb570243 HTTP/1.1 Oct 08 21:21:18.697020 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:21:18.697020 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:21:18.697020 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:21:18.697020 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 21:21:18.697020 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:21:18.697020 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:21:18.697020 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:21:18.697020 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:21:18.697020 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQemvm1UShhe0eezqKxlHF34i-UMbY8UBYEFPEQIsi5zcptv1ian_zC8rtxTw5G6Urff6nbvGW8CSPw-7OFkGeczM08Qi-B5ROXgjK6vMrDf6XER_Vb_jRSHHdUIqRyP-6dfjEYSIuvkhQzjPwPeKIRpPzvmZAkUEjHlrsOyLUs6vE4o Oct 08 21:21:18.697020 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:21:18.697020 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:21:18.697020 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:21:18.697020 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:21:18.697020 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:21:18.697020 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:21:18.697020 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: fd238ac8ac5e4e7793c1ebb53a85eaef Oct 08 21:21:18.697020 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-VolumesBackupsTest-825618197 Oct 08 21:21:18.697020 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:21:18.697020 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:21:18.697020 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/fd238ac8ac5e4e7793c1ebb53a85eaef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/fd238ac8ac5e4e7793c1ebb53a85eaef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_fd238ac8ac5e4e7793c1ebb53a85eaef"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/fd238ac8ac5e4e7793c1ebb53a85eaef"}]}] Oct 08 21:21:18.697020 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-VolumesBackupsTest-825618197 Oct 08 21:21:18.697020 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: fd238ac8ac5e4e7793c1ebb53a85eaef Oct 08 21:21:18.697020 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-VolumesBackupsTest-825618197 Oct 08 21:21:18.697020 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-VolumesBackupsTest-825618197-project Oct 08 21:21:18.697020 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:21:18.697020 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:21:18.697020 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: a009ac77727640de9becf6a61c8f1662 Oct 08 21:21:18.697020 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-VolumesBackupsTest-825618197-project Oct 08 21:21:18.697020 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:21:18.697020 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance 1c8a0a0f-8250-4837-9dde-7a09bb570243 could not be found. Oct 08 21:21:18.697020 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': '1c8a0a0f-8250-4837-9dde-7a09bb570243'} Oct 08 21:21:18.697020 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:21:18.697020 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:21:18.697020 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:21:18.697020 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:21:18.697020 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:21:18.697020 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:21:18.697020 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:21:18.697020 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:21:18.697020 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:21:18.697020 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:21:18.697020 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c8a0a0f-8250-4837-9dde-7a09bb570243 could not be found. Oct 08 21:21:18.697020 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:21:18.697020 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:21:18.697020 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:21:18.697020 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:21:18.697020 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:21:18.697020 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:21:18.697020 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:21:18.697020 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:21:18.697020 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:21:18.697020 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:21:18.697020 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:21:18.697020 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:21:18.697020 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:21:18.697020 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:21:18.697020 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:21:18.697020 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:21:18.697020 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c8a0a0f-8250-4837-9dde-7a09bb570243 could not be found. Oct 08 21:21:18.697020 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:21:18.697020 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:21:18.697020 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:21:18.702615 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:21:18.702615 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:21:18.702615 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:21:18.702615 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:21:18.702615 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:21:18.702615 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c8a0a0f-8250-4837-9dde-7a09bb570243 could not be found. Oct 08 21:21:18.702615 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:21:18.704191 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-25e3d01c-ab1a-4f24-93ab-b50a1c83b6c2 tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] Returning 404 to user: Instance 1c8a0a0f-8250-4837-9dde-7a09bb570243 could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:21:18.705080 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-c80ed8df-8c60-49c3-b8e0-f05893f8b031 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:21:18.705283 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-25e3d01c-ab1a-4f24-93ab-b50a1c83b6c2 tempest-VolumesBackupsTest-825618197 tempest-VolumesBackupsTest-825618197-project] 10.222.0.26 "GET /compute/v2.1/servers/1c8a0a0f-8250-4837-9dde-7a09bb570243" status: 404 len: 111 microversion: 2.1 time: 0.081200 Oct 08 21:21:18.705852 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2678/5431] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:21:18 2022] GET /compute/v2.1/servers/1c8a0a0f-8250-4837-9dde-7a09bb570243 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:21:18.719765 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c80ed8df-8c60-49c3-b8e0-f05893f8b031 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:21:18.720392 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c80ed8df-8c60-49c3-b8e0-f05893f8b031 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:21:18.722457 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c80ed8df-8c60-49c3-b8e0-f05893f8b031 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:21:18.800677 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-c80ed8df-8c60-49c3-b8e0-f05893f8b031 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 2a61f287-652b-487f-9ecd-fb4d2d1eee62] Going to try to start instance {{(pid=140492) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 08 21:21:18.945367 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-c80ed8df-8c60-49c3-b8e0-f05893f8b031 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "POST /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62/action" status: 202 len: 0 microversion: 2.1 time: 0.246315 Oct 08 21:21:18.946759 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2754/5432] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:21:18 2022] POST /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62/action => generated 0 bytes in 252 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 21:21:18.955882 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-570c6423-13fc-4fad-a42a-09cef2ce43ca tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:21:18.956759 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-570c6423-13fc-4fad-a42a-09cef2ce43ca tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 2a61f287-652b-487f-9ecd-fb4d2d1eee62] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:21:18.964288 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-570c6423-13fc-4fad-a42a-09cef2ce43ca tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:21:18.965314 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-570c6423-13fc-4fad-a42a-09cef2ce43ca tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:21:18.965979 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-570c6423-13fc-4fad-a42a-09cef2ce43ca tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:21:18.966876 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-570c6423-13fc-4fad-a42a-09cef2ce43ca tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:21:18.967552 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-570c6423-13fc-4fad-a42a-09cef2ce43ca tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:21:18.968903 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-570c6423-13fc-4fad-a42a-09cef2ce43ca tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:21:19.196180 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-570c6423-13fc-4fad-a42a-09cef2ce43ca tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:21:19.208401 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-570c6423-13fc-4fad-a42a-09cef2ce43ca tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62" status: 200 len: 1666 microversion: 2.1 time: 0.256318 Oct 08 21:21:19.209680 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2679/5433] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:21:18 2022] GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62 => generated 1666 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:21:20.233699 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-1d3e0183-26c3-4d6c-99c3-0d36d3bcf0d4 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:21:20.234410 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-1d3e0183-26c3-4d6c-99c3-0d36d3bcf0d4 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 2a61f287-652b-487f-9ecd-fb4d2d1eee62] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:21:20.253574 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1d3e0183-26c3-4d6c-99c3-0d36d3bcf0d4 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:21:20.254426 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1d3e0183-26c3-4d6c-99c3-0d36d3bcf0d4 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:21:20.255218 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1d3e0183-26c3-4d6c-99c3-0d36d3bcf0d4 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:21:20.256118 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1d3e0183-26c3-4d6c-99c3-0d36d3bcf0d4 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:21:20.256752 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1d3e0183-26c3-4d6c-99c3-0d36d3bcf0d4 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:21:20.258185 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1d3e0183-26c3-4d6c-99c3-0d36d3bcf0d4 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:21:20.579021 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-1d3e0183-26c3-4d6c-99c3-0d36d3bcf0d4 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:21:20.610562 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-1d3e0183-26c3-4d6c-99c3-0d36d3bcf0d4 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62" status: 200 len: 1666 microversion: 2.1 time: 0.377915 Oct 08 21:21:20.613576 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2755/5434] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:21:20 2022] GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62 => generated 1666 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:21:21.637985 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-fa8c2dd7-7398-489a-a076-39ba974e74ca tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:21:21.638732 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-fa8c2dd7-7398-489a-a076-39ba974e74ca tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 2a61f287-652b-487f-9ecd-fb4d2d1eee62] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:21:21.646055 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fa8c2dd7-7398-489a-a076-39ba974e74ca tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:21:21.646635 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fa8c2dd7-7398-489a-a076-39ba974e74ca tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:21:21.647114 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fa8c2dd7-7398-489a-a076-39ba974e74ca tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:21:21.647827 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fa8c2dd7-7398-489a-a076-39ba974e74ca tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:21:21.648294 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fa8c2dd7-7398-489a-a076-39ba974e74ca tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:21:21.648733 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fa8c2dd7-7398-489a-a076-39ba974e74ca tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:21:21.922891 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-fa8c2dd7-7398-489a-a076-39ba974e74ca tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:21:21.938460 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-fa8c2dd7-7398-489a-a076-39ba974e74ca tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62" status: 200 len: 1670 microversion: 2.1 time: 0.304448 Oct 08 21:21:21.939874 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2680/5435] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:21:21 2022] GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62 => generated 1670 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:21:21.964718 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-eb6540b5-e4f5-4dba-bfb7-37cc0800a8fd tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:21:21.967542 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-eb6540b5-e4f5-4dba-bfb7-37cc0800a8fd tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 2a61f287-652b-487f-9ecd-fb4d2d1eee62] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:21:21.986445 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-eb6540b5-e4f5-4dba-bfb7-37cc0800a8fd tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:21:21.988027 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-eb6540b5-e4f5-4dba-bfb7-37cc0800a8fd tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:21:21.988523 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-eb6540b5-e4f5-4dba-bfb7-37cc0800a8fd tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:21:21.989548 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-eb6540b5-e4f5-4dba-bfb7-37cc0800a8fd tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:21:21.990314 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-eb6540b5-e4f5-4dba-bfb7-37cc0800a8fd tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:21:21.990939 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-eb6540b5-e4f5-4dba-bfb7-37cc0800a8fd tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:21:22.258573 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-eb6540b5-e4f5-4dba-bfb7-37cc0800a8fd tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:21:22.269104 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-eb6540b5-e4f5-4dba-bfb7-37cc0800a8fd tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62" status: 200 len: 1670 microversion: 2.1 time: 0.310971 Oct 08 21:21:22.269993 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2756/5436] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:21:21 2022] GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62 => generated 1670 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:21:22.297254 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-5f5cebd7-7f88-477e-be0f-063b6980c5d2 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:21:22.298103 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-5f5cebd7-7f88-477e-be0f-063b6980c5d2 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 2a61f287-652b-487f-9ecd-fb4d2d1eee62] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:21:22.305702 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5f5cebd7-7f88-477e-be0f-063b6980c5d2 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:21:22.307491 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5f5cebd7-7f88-477e-be0f-063b6980c5d2 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:21:22.308109 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5f5cebd7-7f88-477e-be0f-063b6980c5d2 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:21:22.308980 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5f5cebd7-7f88-477e-be0f-063b6980c5d2 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:21:22.310625 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5f5cebd7-7f88-477e-be0f-063b6980c5d2 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:21:22.317859 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5f5cebd7-7f88-477e-be0f-063b6980c5d2 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:21:22.448689 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-5f5cebd7-7f88-477e-be0f-063b6980c5d2 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 2a61f287-652b-487f-9ecd-fb4d2d1eee62] Unlocking {{(pid=140491) unlock /opt/stack/nova/nova/compute/api.py:4874}} Oct 08 21:21:22.524784 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-5f5cebd7-7f88-477e-be0f-063b6980c5d2 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "POST /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62/action" status: 202 len: 0 microversion: 2.1 time: 0.231269 Oct 08 21:21:22.528394 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2681/5437] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:21:22 2022] POST /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62/action => generated 0 bytes in 236 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 21:21:22.538003 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-84f60683-f22a-4dd2-bd57-8410e8a5f79b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:21:22.538624 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-84f60683-f22a-4dd2-bd57-8410e8a5f79b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 2a61f287-652b-487f-9ecd-fb4d2d1eee62] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:21:22.546044 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-84f60683-f22a-4dd2-bd57-8410e8a5f79b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:21:22.546790 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-84f60683-f22a-4dd2-bd57-8410e8a5f79b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:21:22.547240 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-84f60683-f22a-4dd2-bd57-8410e8a5f79b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:21:22.547970 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-84f60683-f22a-4dd2-bd57-8410e8a5f79b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:21:22.548439 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-84f60683-f22a-4dd2-bd57-8410e8a5f79b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:21:22.548876 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-84f60683-f22a-4dd2-bd57-8410e8a5f79b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:21:22.691147 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-84f60683-f22a-4dd2-bd57-8410e8a5f79b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:21:22.700938 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-84f60683-f22a-4dd2-bd57-8410e8a5f79b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62" status: 200 len: 1670 microversion: 2.1 time: 0.166774 Oct 08 21:21:22.701981 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2757/5438] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:21:22 2022] GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62 => generated 1670 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:21:22.725124 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-63ea304c-200f-4be6-9207-372467c503bf tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:21:22.725893 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-63ea304c-200f-4be6-9207-372467c503bf tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 2a61f287-652b-487f-9ecd-fb4d2d1eee62] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:21:22.761994 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-63ea304c-200f-4be6-9207-372467c503bf tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:21:22.762719 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-63ea304c-200f-4be6-9207-372467c503bf tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:21:22.763194 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-63ea304c-200f-4be6-9207-372467c503bf tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:21:22.764088 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-63ea304c-200f-4be6-9207-372467c503bf tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:21:22.764885 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-63ea304c-200f-4be6-9207-372467c503bf tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:21:22.765431 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-63ea304c-200f-4be6-9207-372467c503bf tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:21:23.059874 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-63ea304c-200f-4be6-9207-372467c503bf tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:21:23.074120 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-63ea304c-200f-4be6-9207-372467c503bf tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62" status: 200 len: 1670 microversion: 2.1 time: 0.351854 Oct 08 21:21:23.074863 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2682/5439] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:21:22 2022] GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62 => generated 1670 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:21:23.100598 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-5b85c9ee-b6e9-472c-903d-01917e5055ad tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:21:23.101642 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-5b85c9ee-b6e9-472c-903d-01917e5055ad tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 2a61f287-652b-487f-9ecd-fb4d2d1eee62] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:21:23.122502 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5b85c9ee-b6e9-472c-903d-01917e5055ad tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:21:23.125481 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5b85c9ee-b6e9-472c-903d-01917e5055ad tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:21:23.127398 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5b85c9ee-b6e9-472c-903d-01917e5055ad tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:21:23.129694 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5b85c9ee-b6e9-472c-903d-01917e5055ad tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:21:23.130977 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5b85c9ee-b6e9-472c-903d-01917e5055ad tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:21:23.131621 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5b85c9ee-b6e9-472c-903d-01917e5055ad tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:21:23.343498 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-5b85c9ee-b6e9-472c-903d-01917e5055ad tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:21:23.352135 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-5b85c9ee-b6e9-472c-903d-01917e5055ad tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62" status: 200 len: 1670 microversion: 2.1 time: 0.257457 Oct 08 21:21:23.354754 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2758/5440] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:21:23 2022] GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62 => generated 1670 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:21:23.376724 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-9e08ff4e-d3b3-4ff9-961a-964e75921d15 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:21:23.377592 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-9e08ff4e-d3b3-4ff9-961a-964e75921d15 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 2a61f287-652b-487f-9ecd-fb4d2d1eee62] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:21:23.384219 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9e08ff4e-d3b3-4ff9-961a-964e75921d15 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:21:23.384755 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9e08ff4e-d3b3-4ff9-961a-964e75921d15 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:21:23.385224 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9e08ff4e-d3b3-4ff9-961a-964e75921d15 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:21:23.385942 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9e08ff4e-d3b3-4ff9-961a-964e75921d15 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:21:23.386408 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9e08ff4e-d3b3-4ff9-961a-964e75921d15 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:21:23.386840 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9e08ff4e-d3b3-4ff9-961a-964e75921d15 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:21:23.515092 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-9e08ff4e-d3b3-4ff9-961a-964e75921d15 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "POST /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62/action" status: 202 len: 0 microversion: 2.1 time: 0.141968 Oct 08 21:21:23.519010 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2683/5441] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:21:23 2022] POST /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62/action => generated 0 bytes in 147 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 21:21:23.529107 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-7c0924f1-19a3-43dc-ab04-4be1be5ff8bf tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:21:23.531507 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-7c0924f1-19a3-43dc-ab04-4be1be5ff8bf tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 2a61f287-652b-487f-9ecd-fb4d2d1eee62] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:21:23.540531 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7c0924f1-19a3-43dc-ab04-4be1be5ff8bf tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:21:23.577352 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7c0924f1-19a3-43dc-ab04-4be1be5ff8bf tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:21:23.578484 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7c0924f1-19a3-43dc-ab04-4be1be5ff8bf tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.037s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:21:23.579639 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7c0924f1-19a3-43dc-ab04-4be1be5ff8bf tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:21:23.580703 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7c0924f1-19a3-43dc-ab04-4be1be5ff8bf tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:21:23.581495 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7c0924f1-19a3-43dc-ab04-4be1be5ff8bf tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:21:23.893104 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-7c0924f1-19a3-43dc-ab04-4be1be5ff8bf tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:21:23.906964 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-7c0924f1-19a3-43dc-ab04-4be1be5ff8bf tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62" status: 200 len: 1675 microversion: 2.1 time: 0.379660 Oct 08 21:21:23.908039 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2759/5442] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:21:23 2022] GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62 => generated 1675 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:21:24.932792 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-879e9020-64de-46cf-aa5b-32d1a9f9dee8 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:21:24.933791 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-879e9020-64de-46cf-aa5b-32d1a9f9dee8 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 2a61f287-652b-487f-9ecd-fb4d2d1eee62] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:21:24.947356 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-879e9020-64de-46cf-aa5b-32d1a9f9dee8 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:21:24.948082 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-879e9020-64de-46cf-aa5b-32d1a9f9dee8 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:21:24.948910 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-879e9020-64de-46cf-aa5b-32d1a9f9dee8 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:21:24.949935 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-879e9020-64de-46cf-aa5b-32d1a9f9dee8 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:21:24.951066 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-879e9020-64de-46cf-aa5b-32d1a9f9dee8 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:21:24.951868 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-879e9020-64de-46cf-aa5b-32d1a9f9dee8 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:21:25.143557 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-879e9020-64de-46cf-aa5b-32d1a9f9dee8 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:21:25.152575 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-879e9020-64de-46cf-aa5b-32d1a9f9dee8 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62" status: 200 len: 1655 microversion: 2.1 time: 0.224947 Oct 08 21:21:25.153163 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2684/5443] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:21:24 2022] GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62 => generated 1655 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:21:25.175307 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-5f452178-7325-43dc-95ea-1b8ae9fdf9e9 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:21:25.175956 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-5f452178-7325-43dc-95ea-1b8ae9fdf9e9 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 2a61f287-652b-487f-9ecd-fb4d2d1eee62] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:21:25.184099 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5f452178-7325-43dc-95ea-1b8ae9fdf9e9 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:21:25.184711 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5f452178-7325-43dc-95ea-1b8ae9fdf9e9 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:21:25.185281 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5f452178-7325-43dc-95ea-1b8ae9fdf9e9 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:21:25.186067 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5f452178-7325-43dc-95ea-1b8ae9fdf9e9 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:21:25.186608 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5f452178-7325-43dc-95ea-1b8ae9fdf9e9 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:21:25.190193 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5f452178-7325-43dc-95ea-1b8ae9fdf9e9 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:21:25.221660 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:21:25.284422 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-5f452178-7325-43dc-95ea-1b8ae9fdf9e9 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "POST /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62/action" status: 202 len: 0 microversion: 2.1 time: 0.112836 Oct 08 21:21:25.285317 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2760/5444] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:21:25 2022] POST /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 21:21:25.304199 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c2b1070d-e45a-42bb-8cfa-4124a6679bc6 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:21:25.305171 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-c2b1070d-e45a-42bb-8cfa-4124a6679bc6 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 2a61f287-652b-487f-9ecd-fb4d2d1eee62] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:21:25.313077 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c2b1070d-e45a-42bb-8cfa-4124a6679bc6 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:21:25.313967 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c2b1070d-e45a-42bb-8cfa-4124a6679bc6 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:21:25.314589 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c2b1070d-e45a-42bb-8cfa-4124a6679bc6 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:21:25.315798 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c2b1070d-e45a-42bb-8cfa-4124a6679bc6 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:21:25.316499 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c2b1070d-e45a-42bb-8cfa-4124a6679bc6 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:21:25.317120 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c2b1070d-e45a-42bb-8cfa-4124a6679bc6 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:21:25.571334 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-c2b1070d-e45a-42bb-8cfa-4124a6679bc6 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:21:25.579870 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-c2b1070d-e45a-42bb-8cfa-4124a6679bc6 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62" status: 200 len: 1662 microversion: 2.1 time: 0.289908 Oct 08 21:21:25.584032 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2685/5445] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:21:25 2022] GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62 => generated 1662 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:21:26.624109 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-dc442179-0dcb-4ff2-a295-55317a22da72 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:21:26.626412 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-dc442179-0dcb-4ff2-a295-55317a22da72 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 2a61f287-652b-487f-9ecd-fb4d2d1eee62] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:21:26.644006 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dc442179-0dcb-4ff2-a295-55317a22da72 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:21:26.645918 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dc442179-0dcb-4ff2-a295-55317a22da72 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:21:26.645918 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dc442179-0dcb-4ff2-a295-55317a22da72 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:21:26.646354 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dc442179-0dcb-4ff2-a295-55317a22da72 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:21:26.648461 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dc442179-0dcb-4ff2-a295-55317a22da72 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:21:26.649670 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dc442179-0dcb-4ff2-a295-55317a22da72 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:21:26.891348 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-dc442179-0dcb-4ff2-a295-55317a22da72 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:21:26.899165 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-dc442179-0dcb-4ff2-a295-55317a22da72 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62" status: 200 len: 1670 microversion: 2.1 time: 0.295285 Oct 08 21:21:26.899943 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2761/5446] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:21:26 2022] GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62 => generated 1670 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:21:26.923797 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-32abda7b-932b-4fcd-9de8-3e0e68dd76f6 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:21:26.924512 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-32abda7b-932b-4fcd-9de8-3e0e68dd76f6 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 2a61f287-652b-487f-9ecd-fb4d2d1eee62] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:21:26.931743 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-32abda7b-932b-4fcd-9de8-3e0e68dd76f6 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:21:26.932243 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-32abda7b-932b-4fcd-9de8-3e0e68dd76f6 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:21:26.932693 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-32abda7b-932b-4fcd-9de8-3e0e68dd76f6 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:21:26.933508 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-32abda7b-932b-4fcd-9de8-3e0e68dd76f6 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:21:26.933903 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-32abda7b-932b-4fcd-9de8-3e0e68dd76f6 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:21:26.934335 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-32abda7b-932b-4fcd-9de8-3e0e68dd76f6 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:21:27.217801 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-32abda7b-932b-4fcd-9de8-3e0e68dd76f6 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:21:27.228996 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-32abda7b-932b-4fcd-9de8-3e0e68dd76f6 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62" status: 200 len: 1670 microversion: 2.1 time: 0.308882 Oct 08 21:21:27.229795 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2686/5447] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:21:26 2022] GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62 => generated 1670 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:21:27.259013 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-64048da5-1446-4408-8eaa-97bb1a999565 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:21:27.261385 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-64048da5-1446-4408-8eaa-97bb1a999565 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 2a61f287-652b-487f-9ecd-fb4d2d1eee62] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:21:27.272627 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-64048da5-1446-4408-8eaa-97bb1a999565 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:21:27.273347 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-64048da5-1446-4408-8eaa-97bb1a999565 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:21:27.276528 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-64048da5-1446-4408-8eaa-97bb1a999565 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:21:27.281038 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-64048da5-1446-4408-8eaa-97bb1a999565 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:21:27.295496 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-64048da5-1446-4408-8eaa-97bb1a999565 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:21:27.295963 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-64048da5-1446-4408-8eaa-97bb1a999565 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:21:27.549376 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-64048da5-1446-4408-8eaa-97bb1a999565 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:21:27.559374 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-64048da5-1446-4408-8eaa-97bb1a999565 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62" status: 200 len: 1670 microversion: 2.1 time: 0.305950 Oct 08 21:21:27.560748 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2762/5448] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:21:27 2022] GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62 => generated 1670 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:21:27.583715 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-fa43e70b-a0e7-4e69-9149-383ffdde0fce tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:21:27.584726 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-fa43e70b-a0e7-4e69-9149-383ffdde0fce tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 2a61f287-652b-487f-9ecd-fb4d2d1eee62] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:21:27.592022 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fa43e70b-a0e7-4e69-9149-383ffdde0fce tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:21:27.593110 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fa43e70b-a0e7-4e69-9149-383ffdde0fce tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:21:27.593659 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fa43e70b-a0e7-4e69-9149-383ffdde0fce tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:21:27.594694 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fa43e70b-a0e7-4e69-9149-383ffdde0fce tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:21:27.595393 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fa43e70b-a0e7-4e69-9149-383ffdde0fce tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:21:27.596057 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fa43e70b-a0e7-4e69-9149-383ffdde0fce tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:21:27.827778 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-fa43e70b-a0e7-4e69-9149-383ffdde0fce tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:21:27.840203 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-fa43e70b-a0e7-4e69-9149-383ffdde0fce tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62" status: 200 len: 1670 microversion: 2.1 time: 0.260669 Oct 08 21:21:27.841968 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2687/5449] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:21:27 2022] GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62 => generated 1670 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:21:27.868816 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-74459766-d861-49e6-a84a-6ece84225ee9 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:21:27.871754 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-74459766-d861-49e6-a84a-6ece84225ee9 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 2a61f287-652b-487f-9ecd-fb4d2d1eee62] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:21:27.879563 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-74459766-d861-49e6-a84a-6ece84225ee9 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:21:27.880955 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-74459766-d861-49e6-a84a-6ece84225ee9 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:21:27.881689 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-74459766-d861-49e6-a84a-6ece84225ee9 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:21:27.882457 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-74459766-d861-49e6-a84a-6ece84225ee9 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:21:27.883063 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-74459766-d861-49e6-a84a-6ece84225ee9 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:21:27.883506 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-74459766-d861-49e6-a84a-6ece84225ee9 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:21:28.187908 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-74459766-d861-49e6-a84a-6ece84225ee9 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:21:28.209697 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-74459766-d861-49e6-a84a-6ece84225ee9 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62" status: 200 len: 1670 microversion: 2.1 time: 0.345646 Oct 08 21:21:28.211067 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2763/5450] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:21:27 2022] GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62 => generated 1670 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:21:28.240634 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-a1dded74-15e2-4227-9768-2c633560f42b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:21:28.241589 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-a1dded74-15e2-4227-9768-2c633560f42b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 2a61f287-652b-487f-9ecd-fb4d2d1eee62] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:21:28.282694 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a1dded74-15e2-4227-9768-2c633560f42b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:21:28.287531 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a1dded74-15e2-4227-9768-2c633560f42b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:21:28.292598 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a1dded74-15e2-4227-9768-2c633560f42b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:21:28.294870 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a1dded74-15e2-4227-9768-2c633560f42b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:21:28.303602 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a1dded74-15e2-4227-9768-2c633560f42b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:21:28.307170 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a1dded74-15e2-4227-9768-2c633560f42b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:21:28.599319 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-a1dded74-15e2-4227-9768-2c633560f42b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:21:28.613158 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-a1dded74-15e2-4227-9768-2c633560f42b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62" status: 200 len: 1670 microversion: 2.1 time: 0.376931 Oct 08 21:21:28.626429 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2688/5451] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:21:28 2022] GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62 => generated 1670 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:21:58.990504 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-b9b7d41a-580d-4e6f-ac08-982dead32e6d tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:21:58.993976 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-b9b7d41a-580d-4e6f-ac08-982dead32e6d tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 2a61f287-652b-487f-9ecd-fb4d2d1eee62] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:21:58.996681 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=23 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:21:58.997771 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:21:59.000570 ncdv-master-1 devstack@n-api.service[140492]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 08 21:21:59.028956 ncdv-master-1 devstack@n-api.service[140492]: Sat Oct 8 21:21:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62/action (ip 10.222.0.26) !!! Oct 08 21:21:59.059692 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b9b7d41a-580d-4e6f-ac08-982dead32e6d tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:21:59.060211 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b9b7d41a-580d-4e6f-ac08-982dead32e6d tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:21:59.060654 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b9b7d41a-580d-4e6f-ac08-982dead32e6d tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:21:59.063654 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b9b7d41a-580d-4e6f-ac08-982dead32e6d tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:21:59.064155 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b9b7d41a-580d-4e6f-ac08-982dead32e6d tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:21:59.064752 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b9b7d41a-580d-4e6f-ac08-982dead32e6d tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:21:59.244883 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-b9b7d41a-580d-4e6f-ac08-982dead32e6d tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "POST /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62/action" status: 202 len: 0 microversion: 2.1 time: 0.257596 Oct 08 21:21:59.248848 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2764/5452] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:21:58 2022] POST /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62/action => generated 0 bytes in 260 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 21:21:59.254728 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c3ede23f-5bb9-438a-a883-0c83a458de19 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:21:59.255354 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-c3ede23f-5bb9-438a-a883-0c83a458de19 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 2a61f287-652b-487f-9ecd-fb4d2d1eee62] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:21:59.266747 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:21:59.268430 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:21:59.274521 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c3ede23f-5bb9-438a-a883-0c83a458de19 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:21:59.275469 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c3ede23f-5bb9-438a-a883-0c83a458de19 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:21:59.276648 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c3ede23f-5bb9-438a-a883-0c83a458de19 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:21:59.280090 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c3ede23f-5bb9-438a-a883-0c83a458de19 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:21:59.280642 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c3ede23f-5bb9-438a-a883-0c83a458de19 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:21:59.281067 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c3ede23f-5bb9-438a-a883-0c83a458de19 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:21:59.902809 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-c3ede23f-5bb9-438a-a883-0c83a458de19 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:21:59.915154 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-c3ede23f-5bb9-438a-a883-0c83a458de19 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62" status: 200 len: 1672 microversion: 2.1 time: 0.664756 Oct 08 21:21:59.932142 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2689/5453] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:21:59 2022] GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62 => generated 1672 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:22:00.944171 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-faa1d828-c1cc-4b43-88e0-fdb208af2be6 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:22:00.945037 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-faa1d828-c1cc-4b43-88e0-fdb208af2be6 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 2a61f287-652b-487f-9ecd-fb4d2d1eee62] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:22:00.961519 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-faa1d828-c1cc-4b43-88e0-fdb208af2be6 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:22:00.963495 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-faa1d828-c1cc-4b43-88e0-fdb208af2be6 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:22:00.964104 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-faa1d828-c1cc-4b43-88e0-fdb208af2be6 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:22:00.967666 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-faa1d828-c1cc-4b43-88e0-fdb208af2be6 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:22:00.970352 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-faa1d828-c1cc-4b43-88e0-fdb208af2be6 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:22:00.972218 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-faa1d828-c1cc-4b43-88e0-fdb208af2be6 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:22:02.043925 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-faa1d828-c1cc-4b43-88e0-fdb208af2be6 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:22:02.058253 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-faa1d828-c1cc-4b43-88e0-fdb208af2be6 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62" status: 200 len: 1677 microversion: 2.1 time: 1.120401 Oct 08 21:22:02.059195 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2765/5454] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:22:00 2022] GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62 => generated 1677 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:22:03.084720 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-256a5e0f-5a60-46d6-9dd0-94386f86849b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:22:03.085420 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-256a5e0f-5a60-46d6-9dd0-94386f86849b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 2a61f287-652b-487f-9ecd-fb4d2d1eee62] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:22:03.094342 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-256a5e0f-5a60-46d6-9dd0-94386f86849b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:22:03.096843 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-256a5e0f-5a60-46d6-9dd0-94386f86849b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:22:03.099273 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-256a5e0f-5a60-46d6-9dd0-94386f86849b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:22:03.106457 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-256a5e0f-5a60-46d6-9dd0-94386f86849b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:22:03.107350 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-256a5e0f-5a60-46d6-9dd0-94386f86849b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:22:03.109878 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-256a5e0f-5a60-46d6-9dd0-94386f86849b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:22:04.216458 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-256a5e0f-5a60-46d6-9dd0-94386f86849b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:22:04.236380 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-256a5e0f-5a60-46d6-9dd0-94386f86849b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62" status: 200 len: 1670 microversion: 2.1 time: 1.154259 Oct 08 21:22:04.260669 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2690/5455] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:22:03 2022] GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62 => generated 1670 bytes in 1181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:22:11.059125 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=4 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:22:11.240657 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-506294e2-9ed8-4467-887b-59fcb8c12f7c tempest-TestAggregatesBasicOps-1771122617 tempest-TestAggregatesBasicOps-1771122617-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-1994814357", "availability_zone": "foo_zone"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:22:11.244671 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.objects.aggregate [None req-506294e2-9ed8-4467-887b-59fcb8c12f7c tempest-TestAggregatesBasicOps-1771122617 tempest-TestAggregatesBasicOps-1771122617-project-admin] Generated uuid e7206786-07fd-495a-9648-b40a0382e355 for aggregate {{(pid=140492) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 08 21:22:11.315402 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-506294e2-9ed8-4467-887b-59fcb8c12f7c tempest-TestAggregatesBasicOps-1771122617 tempest-TestAggregatesBasicOps-1771122617-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates" status: 200 len: 209 microversion: 2.1 time: 0.262874 Oct 08 21:22:11.316251 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2766/5456] 10.222.0.26 () {60 vars in 1164 bytes} [Sat Oct 8 21:22:11 2022] POST /compute/v2.1/os-aggregates => generated 209 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:22:11.330061 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c8ee4b1d-cdfc-4fce-a47d-e9af6008e4d4 tempest-TestAggregatesBasicOps-1771122617 tempest-TestAggregatesBasicOps-1771122617-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:22:11.377163 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-c8ee4b1d-cdfc-4fce-a47d-e9af6008e4d4 tempest-TestAggregatesBasicOps-1771122617 tempest-TestAggregatesBasicOps-1771122617-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 319 microversion: 2.1 time: 0.051676 Oct 08 21:22:11.386095 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2691/5457] 10.222.0.26 () {60 vars in 1194 bytes} [Sat Oct 8 21:22:11 2022] POST /compute/v2.1/os-aggregates/19/action => generated 319 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:22:11.398152 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-8e59e5a7-3aa0-4633-ba56-131b31a74a0c tempest-TestAggregatesBasicOps-1771122617 tempest-TestAggregatesBasicOps-1771122617-project-admin] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:22:11.409653 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8e59e5a7-3aa0-4633-ba56-131b31a74a0c tempest-TestAggregatesBasicOps-1771122617 tempest-TestAggregatesBasicOps-1771122617-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:22:11.410311 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8e59e5a7-3aa0-4633-ba56-131b31a74a0c tempest-TestAggregatesBasicOps-1771122617 tempest-TestAggregatesBasicOps-1771122617-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:22:11.411003 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8e59e5a7-3aa0-4633-ba56-131b31a74a0c tempest-TestAggregatesBasicOps-1771122617 tempest-TestAggregatesBasicOps-1771122617-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:22:11.412252 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8e59e5a7-3aa0-4633-ba56-131b31a74a0c tempest-TestAggregatesBasicOps-1771122617 tempest-TestAggregatesBasicOps-1771122617-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:22:11.414187 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8e59e5a7-3aa0-4633-ba56-131b31a74a0c tempest-TestAggregatesBasicOps-1771122617 tempest-TestAggregatesBasicOps-1771122617-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:22:11.414867 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8e59e5a7-3aa0-4633-ba56-131b31a74a0c tempest-TestAggregatesBasicOps-1771122617 tempest-TestAggregatesBasicOps-1771122617-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:22:11.467905 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-8e59e5a7-3aa0-4633-ba56-131b31a74a0c tempest-TestAggregatesBasicOps-1771122617 tempest-TestAggregatesBasicOps-1771122617-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.073976 Oct 08 21:22:11.484272 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2767/5458] 10.222.0.26 () {58 vars in 1176 bytes} [Sat Oct 8 21:22:11 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 08 21:22:11.497427 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-9e1ead3b-4315-4ba1-946a-0d4428997457 tempest-TestAggregatesBasicOps-1771122617 tempest-TestAggregatesBasicOps-1771122617-project-admin] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:22:11.516780 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-9e1ead3b-4315-4ba1-946a-0d4428997457 tempest-TestAggregatesBasicOps-1771122617 tempest-TestAggregatesBasicOps-1771122617-project-admin] 10.222.0.26 "GET /compute/v2.1/os-aggregates" status: 200 len: 298 microversion: 2.1 time: 0.024323 Oct 08 21:22:11.518218 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2692/5459] 10.222.0.26 () {58 vars in 1143 bytes} [Sat Oct 8 21:22:11 2022] GET /compute/v2.1/os-aggregates => generated 298 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:22:11.531381 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-ebdecd1c-1ccb-43f7-b153-f96026761d96 tempest-TestAggregatesBasicOps-1771122617 tempest-TestAggregatesBasicOps-1771122617-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:22:11.554002 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ebdecd1c-1ccb-43f7-b153-f96026761d96 tempest-TestAggregatesBasicOps-1771122617 tempest-TestAggregatesBasicOps-1771122617-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:22:11.557221 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ebdecd1c-1ccb-43f7-b153-f96026761d96 tempest-TestAggregatesBasicOps-1771122617 tempest-TestAggregatesBasicOps-1771122617-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:22:11.558015 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ebdecd1c-1ccb-43f7-b153-f96026761d96 tempest-TestAggregatesBasicOps-1771122617 tempest-TestAggregatesBasicOps-1771122617-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:22:12.245605 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-ebdecd1c-1ccb-43f7-b153-f96026761d96 tempest-TestAggregatesBasicOps-1771122617 tempest-TestAggregatesBasicOps-1771122617-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 310 microversion: 2.1 time: 0.717951 Oct 08 21:22:12.248461 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2768/5460] 10.222.0.26 () {60 vars in 1194 bytes} [Sat Oct 8 21:22:11 2022] POST /compute/v2.1/os-aggregates/19/action => generated 310 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:22:12.270088 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-50938f5c-5e8c-4df6-b03b-8432c1ab982e tempest-TestAggregatesBasicOps-1771122617 tempest-TestAggregatesBasicOps-1771122617-project-admin] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:22:12.295853 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-50938f5c-5e8c-4df6-b03b-8432c1ab982e tempest-TestAggregatesBasicOps-1771122617 tempest-TestAggregatesBasicOps-1771122617-project-admin] 10.222.0.26 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 310 microversion: 2.1 time: 0.035435 Oct 08 21:22:12.297048 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2693/5461] 10.222.0.26 () {58 vars in 1152 bytes} [Sat Oct 8 21:22:12 2022] GET /compute/v2.1/os-aggregates/19 => generated 310 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:22:12.313963 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-3168987f-0c4b-4dfa-b922-ac29f2579399 tempest-TestAggregatesBasicOps-1771122617 tempest-TestAggregatesBasicOps-1771122617-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-539709244", "availability_zone": "foo_zone"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:22:12.473715 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-3168987f-0c4b-4dfa-b922-ac29f2579399 tempest-TestAggregatesBasicOps-1771122617 tempest-TestAggregatesBasicOps-1771122617-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 341 microversion: 2.1 time: 0.168558 Oct 08 21:22:12.487038 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2769/5462] 10.222.0.26 () {60 vars in 1173 bytes} [Sat Oct 8 21:22:12 2022] PUT /compute/v2.1/os-aggregates/19 => generated 341 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:22:12.488593 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-07e86001-595f-4e60-b0ca-ef0e0f0765c6 tempest-TestAggregatesBasicOps-1771122617 tempest-TestAggregatesBasicOps-1771122617-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:22:12.575385 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-07e86001-595f-4e60-b0ca-ef0e0f0765c6 tempest-TestAggregatesBasicOps-1771122617 tempest-TestAggregatesBasicOps-1771122617-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 355 microversion: 2.1 time: 0.091552 Oct 08 21:22:12.576345 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2694/5463] 10.222.0.26 () {60 vars in 1194 bytes} [Sat Oct 8 21:22:12 2022] POST /compute/v2.1/os-aggregates/19/action => generated 355 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:22:12.592750 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-02736c9d-2f22-4a5c-8c50-05823fb1dad7 tempest-TestAggregatesBasicOps-1771122617 tempest-TestAggregatesBasicOps-1771122617-project-admin] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:22:12.608048 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-02736c9d-2f22-4a5c-8c50-05823fb1dad7 tempest-TestAggregatesBasicOps-1771122617 tempest-TestAggregatesBasicOps-1771122617-project-admin] 10.222.0.26 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 355 microversion: 2.1 time: 0.018986 Oct 08 21:22:12.608952 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2770/5464] 10.222.0.26 () {58 vars in 1152 bytes} [Sat Oct 8 21:22:12 2022] GET /compute/v2.1/os-aggregates/19 => generated 355 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:22:12.627358 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-7d80fe77-2ff3-4bec-bf6f-b3e87209016c tempest-TestAggregatesBasicOps-1771122617 tempest-TestAggregatesBasicOps-1771122617-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:22:12.652557 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7d80fe77-2ff3-4bec-bf6f-b3e87209016c tempest-TestAggregatesBasicOps-1771122617 tempest-TestAggregatesBasicOps-1771122617-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:22:12.653158 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7d80fe77-2ff3-4bec-bf6f-b3e87209016c tempest-TestAggregatesBasicOps-1771122617 tempest-TestAggregatesBasicOps-1771122617-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:22:12.653705 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7d80fe77-2ff3-4bec-bf6f-b3e87209016c tempest-TestAggregatesBasicOps-1771122617 tempest-TestAggregatesBasicOps-1771122617-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:22:13.076224 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e7afc946-9a59-4e2b-aa70-d961215d9b77 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Action: 'create', calling method: .version_select at 0x7f1a874ea700>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-180191898", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBi+hbmXjSLtXizC7GD3d29U2gbi6dgi9QAp6OivYRVlUHe7z4uxcYysSbwYbzTO9f49GZd3iRkNDadW0qoCtzIiXXpVr+xrwuUVHOxlFbfKD0ARk2stdVjspnwX/jYnbA=="}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:22:13.148356 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-e7afc946-9a59-4e2b-aa70-d961215d9b77 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Getting quotas for project 9b37e8634ac448ea9a86aff144098dd4. Resources: {'key_pairs'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:22:13.160979 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-e7afc946-9a59-4e2b-aa70-d961215d9b77 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Getting quotas for user e28f7acd53094828a7863ce2fd775cdf and project 9b37e8634ac448ea9a86aff144098dd4. Resources: {'key_pairs'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:22:13.232055 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-e7afc946-9a59-4e2b-aa70-d961215d9b77 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.155636 Oct 08 21:22:13.233075 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2771/5465] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Oct 8 21:22:13 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:22:13.288261 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-7d80fe77-2ff3-4bec-bf6f-b3e87209016c tempest-TestAggregatesBasicOps-1771122617 tempest-TestAggregatesBasicOps-1771122617-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 340 microversion: 2.1 time: 0.667490 Oct 08 21:22:13.290304 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2695/5466] 10.222.0.26 () {60 vars in 1194 bytes} [Sat Oct 8 21:22:12 2022] POST /compute/v2.1/os-aggregates/19/action => generated 340 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:22:13.301438 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-a277e683-d6e9-4f12-a573-65bb280bee57 tempest-TestAggregatesBasicOps-1771122617 tempest-TestAggregatesBasicOps-1771122617-project-admin] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:22:13.345854 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-a277e683-d6e9-4f12-a573-65bb280bee57 tempest-TestAggregatesBasicOps-1771122617 tempest-TestAggregatesBasicOps-1771122617-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.047199 Oct 08 21:22:13.347292 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2772/5467] 10.222.0.26 () {58 vars in 1155 bytes} [Sat Oct 8 21:22:13 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 08 21:22:18.550394 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-2d5b0e0d-79e6-4441-8382-6f2c82addcc2 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-2098887762", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "networks": [{"uuid": "29e13d9d-7633-4ebd-af37-3d65dc5eaf82"}], "key_name": "tempest-TestNetworkBasicOps-180191898", "security_groups": [{"name": "tempest-secgroup-smoke-994294774"}]}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:22:18.776092 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.network.neutron [None req-2d5b0e0d-79e6-4441-8382-6f2c82addcc2 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] validate_networks() for [('29e13d9d-7633-4ebd-af37-3d65dc5eaf82', None, None, None, None, None)] {{(pid=140491) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 21:22:20.025295 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-2d5b0e0d-79e6-4441-8382-6f2c82addcc2 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Flavor limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 21:22:20.025881 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-2d5b0e0d-79e6-4441-8382-6f2c82addcc2 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Image limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 21:22:20.026849 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-2d5b0e0d-79e6-4441-8382-6f2c82addcc2 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Flavor pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 21:22:20.027289 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-2d5b0e0d-79e6-4441-8382-6f2c82addcc2 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Image pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 21:22:20.027718 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-2d5b0e0d-79e6-4441-8382-6f2c82addcc2 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 21:22:20.040378 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2d5b0e0d-79e6-4441-8382-6f2c82addcc2 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:22:20.041163 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2d5b0e0d-79e6-4441-8382-6f2c82addcc2 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:22:20.042562 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2d5b0e0d-79e6-4441-8382-6f2c82addcc2 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:22:20.043503 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2d5b0e0d-79e6-4441-8382-6f2c82addcc2 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:22:20.044160 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2d5b0e0d-79e6-4441-8382-6f2c82addcc2 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:22:20.044598 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2d5b0e0d-79e6-4441-8382-6f2c82addcc2 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:22:20.075252 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-2d5b0e0d-79e6-4441-8382-6f2c82addcc2 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Getting quotas for project 9b37e8634ac448ea9a86aff144098dd4. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:22:20.085365 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-2d5b0e0d-79e6-4441-8382-6f2c82addcc2 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Getting quotas for user e28f7acd53094828a7863ce2fd775cdf and project 9b37e8634ac448ea9a86aff144098dd4. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:22:20.105377 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-2d5b0e0d-79e6-4441-8382-6f2c82addcc2 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Going to run 1 instances... {{(pid=140491) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 21:22:20.108017 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-2d5b0e0d-79e6-4441-8382-6f2c82addcc2 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] [instance: 9fc4f8d8-fd9e-4513-8d3b-6ec7622db95f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c508bd7f-7db9-4b2c-af7c-be54a855c355',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140491) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 21:22:20.226934 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-2d5b0e0d-79e6-4441-8382-6f2c82addcc2 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.681210 Oct 08 21:22:20.232056 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2696/5468] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 21:22:18 2022] POST /compute/v2.1/servers => generated 405 bytes in 1687 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 08 21:22:20.253668 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-a8de2284-0fd4-4ed3-86db-91d68720ed5f tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:22:20.254859 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-a8de2284-0fd4-4ed3-86db-91d68720ed5f tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] [instance: 9fc4f8d8-fd9e-4513-8d3b-6ec7622db95f] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:22:20.397326 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-a8de2284-0fd4-4ed3-86db-91d68720ed5f tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e28f7acd53094828a7863ce2fd775cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b37e8634ac448ea9a86aff144098dd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:22:20.409178 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-a8de2284-0fd4-4ed3-86db-91d68720ed5f tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] 10.222.0.26 "GET /compute/v2.1/servers/9fc4f8d8-fd9e-4513-8d3b-6ec7622db95f" status: 200 len: 1248 microversion: 2.1 time: 0.166613 Oct 08 21:22:20.413102 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2773/5469] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:22:20 2022] GET /compute/v2.1/servers/9fc4f8d8-fd9e-4513-8d3b-6ec7622db95f => generated 1248 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:22:21.433967 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-bccf8da0-7a5f-4c2f-b453-0912d101581f tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:22:21.438879 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-bccf8da0-7a5f-4c2f-b453-0912d101581f tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] [instance: 9fc4f8d8-fd9e-4513-8d3b-6ec7622db95f] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:22:21.455198 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bccf8da0-7a5f-4c2f-b453-0912d101581f tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:22:21.455741 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bccf8da0-7a5f-4c2f-b453-0912d101581f tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:22:21.461788 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bccf8da0-7a5f-4c2f-b453-0912d101581f tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:22:21.465873 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bccf8da0-7a5f-4c2f-b453-0912d101581f tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:22:21.468030 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bccf8da0-7a5f-4c2f-b453-0912d101581f tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:22:21.468733 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bccf8da0-7a5f-4c2f-b453-0912d101581f tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:22:21.590097 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-bccf8da0-7a5f-4c2f-b453-0912d101581f tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e28f7acd53094828a7863ce2fd775cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b37e8634ac448ea9a86aff144098dd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:22:21.602362 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-bccf8da0-7a5f-4c2f-b453-0912d101581f tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] 10.222.0.26 "GET /compute/v2.1/servers/9fc4f8d8-fd9e-4513-8d3b-6ec7622db95f" status: 200 len: 1300 microversion: 2.1 time: 0.174104 Oct 08 21:22:21.605296 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2697/5470] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:22:21 2022] GET /compute/v2.1/servers/9fc4f8d8-fd9e-4513-8d3b-6ec7622db95f => generated 1300 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:22:22.630330 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-cec7900d-c58f-45f2-8d5a-e46766d01136 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:22:22.631296 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-cec7900d-c58f-45f2-8d5a-e46766d01136 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] [instance: 9fc4f8d8-fd9e-4513-8d3b-6ec7622db95f] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:22:22.635277 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=2 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:22:22.639730 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:22:22.662153 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cec7900d-c58f-45f2-8d5a-e46766d01136 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:22:22.662759 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cec7900d-c58f-45f2-8d5a-e46766d01136 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:22:22.663457 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cec7900d-c58f-45f2-8d5a-e46766d01136 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:22:22.664374 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cec7900d-c58f-45f2-8d5a-e46766d01136 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:22:22.664847 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cec7900d-c58f-45f2-8d5a-e46766d01136 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:22:22.666258 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cec7900d-c58f-45f2-8d5a-e46766d01136 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:22:22.875053 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-cec7900d-c58f-45f2-8d5a-e46766d01136 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e28f7acd53094828a7863ce2fd775cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b37e8634ac448ea9a86aff144098dd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:22:22.887110 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-cec7900d-c58f-45f2-8d5a-e46766d01136 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] 10.222.0.26 "GET /compute/v2.1/servers/9fc4f8d8-fd9e-4513-8d3b-6ec7622db95f" status: 200 len: 1306 microversion: 2.1 time: 0.260806 Oct 08 21:22:22.888630 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2774/5471] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:22:22 2022] GET /compute/v2.1/servers/9fc4f8d8-fd9e-4513-8d3b-6ec7622db95f => generated 1306 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:22:23.914112 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-807671b8-7a69-4b58-bc70-d7d3853d9464 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:22:23.915547 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-807671b8-7a69-4b58-bc70-d7d3853d9464 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] [instance: 9fc4f8d8-fd9e-4513-8d3b-6ec7622db95f] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:22:23.925809 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-807671b8-7a69-4b58-bc70-d7d3853d9464 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:22:23.926745 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-807671b8-7a69-4b58-bc70-d7d3853d9464 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:22:23.927420 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-807671b8-7a69-4b58-bc70-d7d3853d9464 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:22:23.928682 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-807671b8-7a69-4b58-bc70-d7d3853d9464 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:22:23.929457 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-807671b8-7a69-4b58-bc70-d7d3853d9464 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:22:23.930128 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-807671b8-7a69-4b58-bc70-d7d3853d9464 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:22:24.159201 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-807671b8-7a69-4b58-bc70-d7d3853d9464 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e28f7acd53094828a7863ce2fd775cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b37e8634ac448ea9a86aff144098dd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:22:24.168621 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-807671b8-7a69-4b58-bc70-d7d3853d9464 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] 10.222.0.26 "GET /compute/v2.1/servers/9fc4f8d8-fd9e-4513-8d3b-6ec7622db95f" status: 200 len: 1373 microversion: 2.1 time: 0.259683 Oct 08 21:22:24.180085 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2698/5472] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:22:23 2022] GET /compute/v2.1/servers/9fc4f8d8-fd9e-4513-8d3b-6ec7622db95f => generated 1373 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:22:25.193031 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-dcdbbe3b-33f2-458a-addc-f1b9d5f97581 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:22:25.193772 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-dcdbbe3b-33f2-458a-addc-f1b9d5f97581 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] [instance: 9fc4f8d8-fd9e-4513-8d3b-6ec7622db95f] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:22:25.207089 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dcdbbe3b-33f2-458a-addc-f1b9d5f97581 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:22:25.208275 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dcdbbe3b-33f2-458a-addc-f1b9d5f97581 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:22:25.210417 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dcdbbe3b-33f2-458a-addc-f1b9d5f97581 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:22:25.212406 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dcdbbe3b-33f2-458a-addc-f1b9d5f97581 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:22:25.214809 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dcdbbe3b-33f2-458a-addc-f1b9d5f97581 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:22:25.215521 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dcdbbe3b-33f2-458a-addc-f1b9d5f97581 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:22:25.742510 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-dcdbbe3b-33f2-458a-addc-f1b9d5f97581 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e28f7acd53094828a7863ce2fd775cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b37e8634ac448ea9a86aff144098dd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:22:25.752210 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-dcdbbe3b-33f2-458a-addc-f1b9d5f97581 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] 10.222.0.26 "GET /compute/v2.1/servers/9fc4f8d8-fd9e-4513-8d3b-6ec7622db95f" status: 200 len: 1373 microversion: 2.1 time: 0.564120 Oct 08 21:22:25.752926 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2775/5473] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:22:25 2022] GET /compute/v2.1/servers/9fc4f8d8-fd9e-4513-8d3b-6ec7622db95f => generated 1373 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:22:25.946822 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-863e7ed8-9426-4d90-8abc-7e8301940b76 req-f5286e48-eecb-4746-b47c-e4b26a269a25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9fc4f8d8-fd9e-4513-8d3b-6ec7622db95f", "tag": "0ccd085b-0f6f-4475-aa7b-1c6c9fb6de41"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:22:25.964368 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-863e7ed8-9426-4d90-8abc-7e8301940b76 req-f5286e48-eecb-4746-b47c-e4b26a269a25 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:22:25.965527 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-863e7ed8-9426-4d90-8abc-7e8301940b76 req-f5286e48-eecb-4746-b47c-e4b26a269a25 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:22:25.966564 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-863e7ed8-9426-4d90-8abc-7e8301940b76 req-f5286e48-eecb-4746-b47c-e4b26a269a25 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:22:25.983931 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-863e7ed8-9426-4d90-8abc-7e8301940b76 req-f5286e48-eecb-4746-b47c-e4b26a269a25 service nova] Creating event network-changed:0ccd085b-0f6f-4475-aa7b-1c6c9fb6de41 for instance 9fc4f8d8-fd9e-4513-8d3b-6ec7622db95f on nch2-master-1 Oct 08 21:22:25.996988 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-863e7ed8-9426-4d90-8abc-7e8301940b76 req-f5286e48-eecb-4746-b47c-e4b26a269a25 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061059 Oct 08 21:22:25.998931 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2699/5474] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:22:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:22:26.776353 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-f625d7c7-ca39-4b32-8183-df9e9cb992a9 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:22:26.777655 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-f625d7c7-ca39-4b32-8183-df9e9cb992a9 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] [instance: 9fc4f8d8-fd9e-4513-8d3b-6ec7622db95f] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:22:26.790507 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f625d7c7-ca39-4b32-8183-df9e9cb992a9 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:22:26.791541 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f625d7c7-ca39-4b32-8183-df9e9cb992a9 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:22:26.792090 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f625d7c7-ca39-4b32-8183-df9e9cb992a9 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:22:26.793017 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f625d7c7-ca39-4b32-8183-df9e9cb992a9 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:22:26.793383 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f625d7c7-ca39-4b32-8183-df9e9cb992a9 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:22:26.794082 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f625d7c7-ca39-4b32-8183-df9e9cb992a9 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:22:27.061647 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-f625d7c7-ca39-4b32-8183-df9e9cb992a9 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e28f7acd53094828a7863ce2fd775cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b37e8634ac448ea9a86aff144098dd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:22:27.077536 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-f625d7c7-ca39-4b32-8183-df9e9cb992a9 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] 10.222.0.26 "GET /compute/v2.1/servers/9fc4f8d8-fd9e-4513-8d3b-6ec7622db95f" status: 200 len: 1373 microversion: 2.1 time: 0.303273 Oct 08 21:22:27.079488 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2776/5475] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:22:26 2022] GET /compute/v2.1/servers/9fc4f8d8-fd9e-4513-8d3b-6ec7622db95f => generated 1373 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:22:28.107192 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-d6ab46ce-ad1d-4a75-83f3-b69191a07509 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:22:28.108856 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-d6ab46ce-ad1d-4a75-83f3-b69191a07509 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] [instance: 9fc4f8d8-fd9e-4513-8d3b-6ec7622db95f] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:22:28.127385 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d6ab46ce-ad1d-4a75-83f3-b69191a07509 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:22:28.133571 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d6ab46ce-ad1d-4a75-83f3-b69191a07509 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:22:28.135129 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d6ab46ce-ad1d-4a75-83f3-b69191a07509 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:22:28.138536 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d6ab46ce-ad1d-4a75-83f3-b69191a07509 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:22:28.140071 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d6ab46ce-ad1d-4a75-83f3-b69191a07509 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:22:28.142264 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d6ab46ce-ad1d-4a75-83f3-b69191a07509 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:22:28.369302 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-d6ab46ce-ad1d-4a75-83f3-b69191a07509 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e28f7acd53094828a7863ce2fd775cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b37e8634ac448ea9a86aff144098dd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:22:28.378411 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-d6ab46ce-ad1d-4a75-83f3-b69191a07509 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] 10.222.0.26 "GET /compute/v2.1/servers/9fc4f8d8-fd9e-4513-8d3b-6ec7622db95f" status: 200 len: 1373 microversion: 2.1 time: 0.278362 Oct 08 21:22:28.379016 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2700/5476] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:22:28 2022] GET /compute/v2.1/servers/9fc4f8d8-fd9e-4513-8d3b-6ec7622db95f => generated 1373 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:22:28.890043 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-2859f18e-0afb-4106-8c5e-b5d3a6c67766 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Action: 'create', calling method: .version_select at 0x7f1a87390280>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-133867488", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ3JKcCCAPqjgT54yrcqN9RtqgTO6FtKNLyENs8TKbZs/xxp9wAoVD5y9juBuF0KLx3YAEzLS3yzN6H9ac3LAInonF5DzmwDbNGJuz/w6djrUwK2m19TGMlDyB1zDSjdQA=="}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:22:28.905602 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-2859f18e-0afb-4106-8c5e-b5d3a6c67766 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Getting quotas for project e5fd83b3bdef4ba18ba56a9385e26d01. Resources: {'key_pairs'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:22:28.910705 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-2859f18e-0afb-4106-8c5e-b5d3a6c67766 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Getting quotas for user 33a0d81fb2dd4891901f27890ce7688e and project e5fd83b3bdef4ba18ba56a9385e26d01. Resources: {'key_pairs'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:22:28.937963 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-2859f18e-0afb-4106-8c5e-b5d3a6c67766 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.221681 Oct 08 21:22:28.938581 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2777/5477] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Oct 8 21:22:28 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:22:29.405006 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c26bf283-244e-4c41-93e2-c3c78fa2d273 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:22:29.406360 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-c26bf283-244e-4c41-93e2-c3c78fa2d273 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] [instance: 9fc4f8d8-fd9e-4513-8d3b-6ec7622db95f] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:22:29.409884 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=5,nova_api:DELETE=1 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:22:29.416955 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c26bf283-244e-4c41-93e2-c3c78fa2d273 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:22:29.417503 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c26bf283-244e-4c41-93e2-c3c78fa2d273 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:22:29.417952 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c26bf283-244e-4c41-93e2-c3c78fa2d273 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:22:29.418674 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c26bf283-244e-4c41-93e2-c3c78fa2d273 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:22:29.419288 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c26bf283-244e-4c41-93e2-c3c78fa2d273 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:22:29.420003 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c26bf283-244e-4c41-93e2-c3c78fa2d273 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:22:29.423608 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=39 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:22:29.740198 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-c26bf283-244e-4c41-93e2-c3c78fa2d273 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e28f7acd53094828a7863ce2fd775cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b37e8634ac448ea9a86aff144098dd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:22:29.754125 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-c26bf283-244e-4c41-93e2-c3c78fa2d273 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] 10.222.0.26 "GET /compute/v2.1/servers/9fc4f8d8-fd9e-4513-8d3b-6ec7622db95f" status: 200 len: 1373 microversion: 2.1 time: 0.353529 Oct 08 21:22:29.754880 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2701/5478] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:22:29 2022] GET /compute/v2.1/servers/9fc4f8d8-fd9e-4513-8d3b-6ec7622db95f => generated 1373 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:22:30.782949 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-490409f6-0197-4e75-9152-c2470aa5b99b tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:22:30.784353 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-490409f6-0197-4e75-9152-c2470aa5b99b tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] [instance: 9fc4f8d8-fd9e-4513-8d3b-6ec7622db95f] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:22:30.795730 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-490409f6-0197-4e75-9152-c2470aa5b99b tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:22:30.796257 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-490409f6-0197-4e75-9152-c2470aa5b99b tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:22:30.801323 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-490409f6-0197-4e75-9152-c2470aa5b99b tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:22:30.802121 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-490409f6-0197-4e75-9152-c2470aa5b99b tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:22:30.802603 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-490409f6-0197-4e75-9152-c2470aa5b99b tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:22:30.803043 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-490409f6-0197-4e75-9152-c2470aa5b99b tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:22:31.042577 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-490409f6-0197-4e75-9152-c2470aa5b99b tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e28f7acd53094828a7863ce2fd775cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b37e8634ac448ea9a86aff144098dd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:22:31.051804 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-490409f6-0197-4e75-9152-c2470aa5b99b tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] 10.222.0.26 "GET /compute/v2.1/servers/9fc4f8d8-fd9e-4513-8d3b-6ec7622db95f" status: 200 len: 1373 microversion: 2.1 time: 0.274485 Oct 08 21:22:31.066267 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2778/5479] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:22:30 2022] GET /compute/v2.1/servers/9fc4f8d8-fd9e-4513-8d3b-6ec7622db95f => generated 1373 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:22:32.076507 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-669b986f-beb5-4e52-a5c7-b98d5f2b497c tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:22:32.078100 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-669b986f-beb5-4e52-a5c7-b98d5f2b497c tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] [instance: 9fc4f8d8-fd9e-4513-8d3b-6ec7622db95f] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:22:32.080547 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=2 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:22:32.081926 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=6 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:22:32.090513 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-669b986f-beb5-4e52-a5c7-b98d5f2b497c tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:22:32.091425 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-669b986f-beb5-4e52-a5c7-b98d5f2b497c tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:22:32.092104 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-669b986f-beb5-4e52-a5c7-b98d5f2b497c tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:22:32.093111 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-669b986f-beb5-4e52-a5c7-b98d5f2b497c tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:22:32.094098 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-669b986f-beb5-4e52-a5c7-b98d5f2b497c tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:22:32.094907 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-669b986f-beb5-4e52-a5c7-b98d5f2b497c tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:22:32.486521 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-7853e92c-0281-405a-87e4-bfa32ecaaaca req-d934f63c-8da6-4cad-b013-a3f8294c4212 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fc4f8d8-fd9e-4513-8d3b-6ec7622db95f", "name": "network-vif-plugged", "status": "completed", "tag": "0ccd085b-0f6f-4475-aa7b-1c6c9fb6de41"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:22:32.506762 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-7853e92c-0281-405a-87e4-bfa32ecaaaca req-d934f63c-8da6-4cad-b013-a3f8294c4212 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:22:32.507667 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-7853e92c-0281-405a-87e4-bfa32ecaaaca req-d934f63c-8da6-4cad-b013-a3f8294c4212 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:22:32.508340 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-7853e92c-0281-405a-87e4-bfa32ecaaaca req-d934f63c-8da6-4cad-b013-a3f8294c4212 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:22:32.522270 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-7853e92c-0281-405a-87e4-bfa32ecaaaca req-d934f63c-8da6-4cad-b013-a3f8294c4212 service nova] Creating event network-vif-plugged:0ccd085b-0f6f-4475-aa7b-1c6c9fb6de41 for instance 9fc4f8d8-fd9e-4513-8d3b-6ec7622db95f on nch2-master-1 Oct 08 21:22:32.530696 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-7853e92c-0281-405a-87e4-bfa32ecaaaca req-d934f63c-8da6-4cad-b013-a3f8294c4212 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056597 Oct 08 21:22:32.531583 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2779/5480] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:22:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:22:32.552875 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-669b986f-beb5-4e52-a5c7-b98d5f2b497c tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e28f7acd53094828a7863ce2fd775cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b37e8634ac448ea9a86aff144098dd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:22:32.574233 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-669b986f-beb5-4e52-a5c7-b98d5f2b497c tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] 10.222.0.26 "GET /compute/v2.1/servers/9fc4f8d8-fd9e-4513-8d3b-6ec7622db95f" status: 200 len: 1373 microversion: 2.1 time: 0.501475 Oct 08 21:22:32.590802 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2702/5481] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:22:32 2022] GET /compute/v2.1/servers/9fc4f8d8-fd9e-4513-8d3b-6ec7622db95f => generated 1373 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:22:33.604355 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-d0224a3f-a84d-483e-a044-0bdd28b8edad tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:22:33.606401 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-d0224a3f-a84d-483e-a044-0bdd28b8edad tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] [instance: 9fc4f8d8-fd9e-4513-8d3b-6ec7622db95f] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:22:33.618683 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d0224a3f-a84d-483e-a044-0bdd28b8edad tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:22:33.623692 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d0224a3f-a84d-483e-a044-0bdd28b8edad tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:22:33.626357 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d0224a3f-a84d-483e-a044-0bdd28b8edad tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:22:33.627714 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d0224a3f-a84d-483e-a044-0bdd28b8edad tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:22:33.628515 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d0224a3f-a84d-483e-a044-0bdd28b8edad tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:22:33.631936 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d0224a3f-a84d-483e-a044-0bdd28b8edad tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:22:33.873227 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-d0224a3f-a84d-483e-a044-0bdd28b8edad tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e28f7acd53094828a7863ce2fd775cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b37e8634ac448ea9a86aff144098dd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:22:33.881833 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-d0224a3f-a84d-483e-a044-0bdd28b8edad tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] 10.222.0.26 "GET /compute/v2.1/servers/9fc4f8d8-fd9e-4513-8d3b-6ec7622db95f" status: 200 len: 1373 microversion: 2.1 time: 0.285038 Oct 08 21:22:33.883989 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2780/5482] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:22:33 2022] GET /compute/v2.1/servers/9fc4f8d8-fd9e-4513-8d3b-6ec7622db95f => generated 1373 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:22:34.916408 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-54d86f75-2dd5-498f-a377-eae0015471e0 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:22:34.918505 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-54d86f75-2dd5-498f-a377-eae0015471e0 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] [instance: 9fc4f8d8-fd9e-4513-8d3b-6ec7622db95f] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:22:34.926929 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-54d86f75-2dd5-498f-a377-eae0015471e0 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:22:34.927688 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-54d86f75-2dd5-498f-a377-eae0015471e0 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:22:34.928394 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-54d86f75-2dd5-498f-a377-eae0015471e0 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:22:34.929381 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-54d86f75-2dd5-498f-a377-eae0015471e0 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:22:34.930017 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-54d86f75-2dd5-498f-a377-eae0015471e0 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:22:34.931167 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-54d86f75-2dd5-498f-a377-eae0015471e0 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:22:35.332486 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-54d86f75-2dd5-498f-a377-eae0015471e0 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e28f7acd53094828a7863ce2fd775cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b37e8634ac448ea9a86aff144098dd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:22:35.341683 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-54d86f75-2dd5-498f-a377-eae0015471e0 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] 10.222.0.26 "GET /compute/v2.1/servers/9fc4f8d8-fd9e-4513-8d3b-6ec7622db95f" status: 200 len: 1545 microversion: 2.1 time: 0.438668 Oct 08 21:22:35.363847 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2703/5483] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:22:34 2022] GET /compute/v2.1/servers/9fc4f8d8-fd9e-4513-8d3b-6ec7622db95f => generated 1545 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:22:35.369756 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-91829bc7-8368-490f-a3ee-1b2646d73a0f tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:22:35.371049 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-91829bc7-8368-490f-a3ee-1b2646d73a0f tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] [instance: 9fc4f8d8-fd9e-4513-8d3b-6ec7622db95f] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:22:35.382915 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-91829bc7-8368-490f-a3ee-1b2646d73a0f tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:22:35.386217 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-91829bc7-8368-490f-a3ee-1b2646d73a0f tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:22:35.388635 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-91829bc7-8368-490f-a3ee-1b2646d73a0f tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:22:35.390340 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-91829bc7-8368-490f-a3ee-1b2646d73a0f tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:22:35.391647 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-91829bc7-8368-490f-a3ee-1b2646d73a0f tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:22:35.392288 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-91829bc7-8368-490f-a3ee-1b2646d73a0f tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:22:35.769386 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-91829bc7-8368-490f-a3ee-1b2646d73a0f tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e28f7acd53094828a7863ce2fd775cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b37e8634ac448ea9a86aff144098dd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:22:35.786238 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-91829bc7-8368-490f-a3ee-1b2646d73a0f tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] 10.222.0.26 "GET /compute/v2.1/servers/9fc4f8d8-fd9e-4513-8d3b-6ec7622db95f" status: 200 len: 1545 microversion: 2.1 time: 0.416145 Oct 08 21:22:35.786867 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2781/5484] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:22:35 2022] GET /compute/v2.1/servers/9fc4f8d8-fd9e-4513-8d3b-6ec7622db95f => generated 1545 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:22:36.832787 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-89f3526b-c0cf-4ed3-a22d-25c4cdede218 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:22:36.833515 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-89f3526b-c0cf-4ed3-a22d-25c4cdede218 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 2a61f287-652b-487f-9ecd-fb4d2d1eee62] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:22:36.852162 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-89f3526b-c0cf-4ed3-a22d-25c4cdede218 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:22:36.853277 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-89f3526b-c0cf-4ed3-a22d-25c4cdede218 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:22:36.853727 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-89f3526b-c0cf-4ed3-a22d-25c4cdede218 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:22:36.854705 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-89f3526b-c0cf-4ed3-a22d-25c4cdede218 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:22:36.855164 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-89f3526b-c0cf-4ed3-a22d-25c4cdede218 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:22:36.855606 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-89f3526b-c0cf-4ed3-a22d-25c4cdede218 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:22:37.361863 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-89f3526b-c0cf-4ed3-a22d-25c4cdede218 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:22:37.382134 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-89f3526b-c0cf-4ed3-a22d-25c4cdede218 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62" status: 200 len: 1670 microversion: 2.1 time: 0.813473 Oct 08 21:22:37.390380 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2704/5485] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:22:36 2022] GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62 => generated 1670 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:22:37.420101 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-cc3fb638-ffcf-4cf8-99a0-0bda3ca1dfb2 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:22:37.420731 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-cc3fb638-ffcf-4cf8-99a0-0bda3ca1dfb2 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 2a61f287-652b-487f-9ecd-fb4d2d1eee62] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:22:37.437011 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cc3fb638-ffcf-4cf8-99a0-0bda3ca1dfb2 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:22:37.437859 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cc3fb638-ffcf-4cf8-99a0-0bda3ca1dfb2 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:22:37.438323 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cc3fb638-ffcf-4cf8-99a0-0bda3ca1dfb2 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:22:37.439080 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cc3fb638-ffcf-4cf8-99a0-0bda3ca1dfb2 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:22:37.439550 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cc3fb638-ffcf-4cf8-99a0-0bda3ca1dfb2 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:22:37.439991 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cc3fb638-ffcf-4cf8-99a0-0bda3ca1dfb2 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:22:37.739461 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-cc3fb638-ffcf-4cf8-99a0-0bda3ca1dfb2 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:22:37.749297 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-cc3fb638-ffcf-4cf8-99a0-0bda3ca1dfb2 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62" status: 200 len: 1670 microversion: 2.1 time: 0.334399 Oct 08 21:22:37.751328 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2782/5486] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:22:37 2022] GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62 => generated 1670 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:22:37.774459 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-99a2bc5e-82c4-485c-979d-d513828c00a7 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:22:37.775365 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-99a2bc5e-82c4-485c-979d-d513828c00a7 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 2a61f287-652b-487f-9ecd-fb4d2d1eee62] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:22:37.785595 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-99a2bc5e-82c4-485c-979d-d513828c00a7 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:22:37.786392 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-99a2bc5e-82c4-485c-979d-d513828c00a7 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:22:37.787680 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-99a2bc5e-82c4-485c-979d-d513828c00a7 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:22:37.789047 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-99a2bc5e-82c4-485c-979d-d513828c00a7 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:22:37.789838 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-99a2bc5e-82c4-485c-979d-d513828c00a7 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:22:37.790836 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-99a2bc5e-82c4-485c-979d-d513828c00a7 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:22:38.508526 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-99a2bc5e-82c4-485c-979d-d513828c00a7 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:22:38.525459 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-99a2bc5e-82c4-485c-979d-d513828c00a7 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62" status: 200 len: 1670 microversion: 2.1 time: 0.755850 Oct 08 21:22:38.531252 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2705/5487] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:22:37 2022] GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62 => generated 1670 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:22:38.548223 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-ec355335-7480-4f8e-8c2f-0321309f4723 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:22:38.548908 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-ec355335-7480-4f8e-8c2f-0321309f4723 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 2a61f287-652b-487f-9ecd-fb4d2d1eee62] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:22:38.569050 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-b01c609f-989c-4a02-8485-4ea9f743d981 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-1247845187-access_point-1479170148", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "networks": [{"uuid": "cf3c4b00-5bc6-414c-8893-f32b59e1d6db"}], "key_name": "tempest-TestSecurityGroupsBasicOps-133867488", "security_groups": [{"name": "tempest-secgroup_access--532683830"}, {"name": "tempest-secgroup_general--2088648892"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:22:38.575595 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ec355335-7480-4f8e-8c2f-0321309f4723 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:22:38.576218 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ec355335-7480-4f8e-8c2f-0321309f4723 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:22:38.576686 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ec355335-7480-4f8e-8c2f-0321309f4723 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:22:38.577475 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ec355335-7480-4f8e-8c2f-0321309f4723 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:22:38.577951 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ec355335-7480-4f8e-8c2f-0321309f4723 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:22:38.578388 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ec355335-7480-4f8e-8c2f-0321309f4723 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:22:38.876054 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-ec355335-7480-4f8e-8c2f-0321309f4723 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:22:38.899824 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-ec355335-7480-4f8e-8c2f-0321309f4723 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62" status: 200 len: 1670 microversion: 2.1 time: 0.355674 Oct 08 21:22:38.901415 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2783/5488] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:22:38 2022] GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62 => generated 1670 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:22:38.975232 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-3df7b1af-7e6b-44e0-9d46-4018f546b213 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1173627559", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "networks": [{"uuid": "f6f1b01d-e3ee-45fc-896d-218868fb9293"}]}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:22:38.995042 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=10 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:22:39.206299 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.network.neutron [None req-b01c609f-989c-4a02-8485-4ea9f743d981 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] validate_networks() for [('cf3c4b00-5bc6-414c-8893-f32b59e1d6db', None, None, None, None, None)] {{(pid=140491) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 21:22:39.436424 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.network.neutron [None req-3df7b1af-7e6b-44e0-9d46-4018f546b213 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] validate_networks() for [('f6f1b01d-e3ee-45fc-896d-218868fb9293', None, None, None, None, None)] {{(pid=140492) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 21:22:40.050153 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-3df7b1af-7e6b-44e0-9d46-4018f546b213 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Flavor limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 21:22:40.051547 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-3df7b1af-7e6b-44e0-9d46-4018f546b213 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Image limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 21:22:40.052264 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-3df7b1af-7e6b-44e0-9d46-4018f546b213 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Flavor pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 21:22:40.052760 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-3df7b1af-7e6b-44e0-9d46-4018f546b213 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Image pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 21:22:40.053503 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-3df7b1af-7e6b-44e0-9d46-4018f546b213 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 21:22:40.064956 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3df7b1af-7e6b-44e0-9d46-4018f546b213 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:22:40.065907 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3df7b1af-7e6b-44e0-9d46-4018f546b213 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:22:40.066528 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3df7b1af-7e6b-44e0-9d46-4018f546b213 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:22:40.067413 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3df7b1af-7e6b-44e0-9d46-4018f546b213 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:22:40.068134 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3df7b1af-7e6b-44e0-9d46-4018f546b213 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:22:40.068678 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3df7b1af-7e6b-44e0-9d46-4018f546b213 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:22:40.094927 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-3df7b1af-7e6b-44e0-9d46-4018f546b213 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Getting quotas for project bd563fa73afb42c6b26eca3737d7a355. Resources: {'cores', 'instances', 'ram'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:22:40.113043 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-3df7b1af-7e6b-44e0-9d46-4018f546b213 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Getting quotas for user 2f98e01cab6b49c7a5d239aee95f4a64 and project bd563fa73afb42c6b26eca3737d7a355. Resources: {'cores', 'instances', 'ram'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:22:40.141095 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-3df7b1af-7e6b-44e0-9d46-4018f546b213 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Going to run 1 instances... {{(pid=140492) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 21:22:40.144650 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-3df7b1af-7e6b-44e0-9d46-4018f546b213 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: b55b87f6-54c7-4ae0-a7e3-15755f63ff57] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c508bd7f-7db9-4b2c-af7c-be54a855c355',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140492) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 21:22:40.188942 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:22:40.265014 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-3df7b1af-7e6b-44e0-9d46-4018f546b213 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.295115 Oct 08 21:22:40.266369 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2784/5489] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 21:22:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1297 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 08 21:22:40.277630 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-d9ff217a-6507-40fd-bcd3-4c7f7b0e56b8 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:22:40.278541 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-d9ff217a-6507-40fd-bcd3-4c7f7b0e56b8 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: b55b87f6-54c7-4ae0-a7e3-15755f63ff57] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:22:40.380292 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-d9ff217a-6507-40fd-bcd3-4c7f7b0e56b8 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:22:40.389540 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-d9ff217a-6507-40fd-bcd3-4c7f7b0e56b8 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/b55b87f6-54c7-4ae0-a7e3-15755f63ff57" status: 200 len: 1215 microversion: 2.1 time: 0.116350 Oct 08 21:22:40.390709 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2785/5490] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:22:40 2022] GET /compute/v2.1/servers/b55b87f6-54c7-4ae0-a7e3-15755f63ff57 => generated 1215 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:22:40.847301 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-b01c609f-989c-4a02-8485-4ea9f743d981 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Flavor limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 21:22:40.847804 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-b01c609f-989c-4a02-8485-4ea9f743d981 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Image limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 21:22:40.850409 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-b01c609f-989c-4a02-8485-4ea9f743d981 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Flavor pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 21:22:40.851637 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-b01c609f-989c-4a02-8485-4ea9f743d981 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Image pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 21:22:40.853597 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-b01c609f-989c-4a02-8485-4ea9f743d981 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 21:22:40.870022 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b01c609f-989c-4a02-8485-4ea9f743d981 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:22:40.870866 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b01c609f-989c-4a02-8485-4ea9f743d981 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:22:40.871505 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b01c609f-989c-4a02-8485-4ea9f743d981 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:22:40.872642 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b01c609f-989c-4a02-8485-4ea9f743d981 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:22:40.874993 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b01c609f-989c-4a02-8485-4ea9f743d981 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:22:40.875623 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b01c609f-989c-4a02-8485-4ea9f743d981 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:22:40.912878 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-b01c609f-989c-4a02-8485-4ea9f743d981 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Getting quotas for project e5fd83b3bdef4ba18ba56a9385e26d01. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:22:40.922611 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-b01c609f-989c-4a02-8485-4ea9f743d981 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Getting quotas for user 33a0d81fb2dd4891901f27890ce7688e and project e5fd83b3bdef4ba18ba56a9385e26d01. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:22:40.944129 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-b01c609f-989c-4a02-8485-4ea9f743d981 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Going to run 1 instances... {{(pid=140491) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 21:22:40.948059 ncdv-master-1 devstack@n-api.service[140491]: WARNING nova.utils [None req-b01c609f-989c-4a02-8485-4ea9f743d981 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-1247845187-access_point-1479170148 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-1247845187-ac Oct 08 21:22:40.949255 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-b01c609f-989c-4a02-8485-4ea9f743d981 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] [instance: 9f0543d4-5a51-4c40-8b2e-fbd2a393c903] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c508bd7f-7db9-4b2c-af7c-be54a855c355',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140491) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 21:22:41.036960 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-b01c609f-989c-4a02-8485-4ea9f743d981 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 457 microversion: 2.1 time: 2.466918 Oct 08 21:22:41.038155 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2706/5491] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 21:22:38 2022] POST /compute/v2.1/servers => generated 457 bytes in 2474 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 08 21:22:41.050185 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-efaf5355-5fe8-4af6-9fd7-6292df9e9403 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:22:41.050815 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-efaf5355-5fe8-4af6-9fd7-6292df9e9403 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] [instance: 9f0543d4-5a51-4c40-8b2e-fbd2a393c903] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:22:41.213544 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-efaf5355-5fe8-4af6-9fd7-6292df9e9403 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a0d81fb2dd4891901f27890ce7688e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fd83b3bdef4ba18ba56a9385e26d01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:22:41.233782 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-e4062b1b-32fd-41b3-97e0-af8819d088d2 req-c53eed7f-c8ff-47b4-993b-b52b3a0cf22a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9fc4f8d8-fd9e-4513-8d3b-6ec7622db95f", "tag": "0ccd085b-0f6f-4475-aa7b-1c6c9fb6de41"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:22:41.237525 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-efaf5355-5fe8-4af6-9fd7-6292df9e9403 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] 10.222.0.26 "GET /compute/v2.1/servers/9f0543d4-5a51-4c40-8b2e-fbd2a393c903" status: 200 len: 1294 microversion: 2.1 time: 0.186809 Oct 08 21:22:41.237525 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2707/5492] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:22:41 2022] GET /compute/v2.1/servers/9f0543d4-5a51-4c40-8b2e-fbd2a393c903 => generated 1294 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:22:41.257013 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-e4062b1b-32fd-41b3-97e0-af8819d088d2 req-c53eed7f-c8ff-47b4-993b-b52b3a0cf22a service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:22:41.261686 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-e4062b1b-32fd-41b3-97e0-af8819d088d2 req-c53eed7f-c8ff-47b4-993b-b52b3a0cf22a service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:22:41.264875 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-e4062b1b-32fd-41b3-97e0-af8819d088d2 req-c53eed7f-c8ff-47b4-993b-b52b3a0cf22a service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:22:41.296773 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-e4062b1b-32fd-41b3-97e0-af8819d088d2 req-c53eed7f-c8ff-47b4-993b-b52b3a0cf22a service nova] Creating event network-changed:0ccd085b-0f6f-4475-aa7b-1c6c9fb6de41 for instance 9fc4f8d8-fd9e-4513-8d3b-6ec7622db95f on nch2-master-1 Oct 08 21:22:41.303867 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-e4062b1b-32fd-41b3-97e0-af8819d088d2 req-c53eed7f-c8ff-47b4-993b-b52b3a0cf22a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.405673 Oct 08 21:22:41.306283 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2786/5493] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:22:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:22:41.416568 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-e6e27dc8-f859-42ba-bad4-6723f00317fb tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:22:41.417562 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-e6e27dc8-f859-42ba-bad4-6723f00317fb tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: b55b87f6-54c7-4ae0-a7e3-15755f63ff57] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:22:41.424751 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e6e27dc8-f859-42ba-bad4-6723f00317fb tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:22:41.425279 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e6e27dc8-f859-42ba-bad4-6723f00317fb tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:22:41.425735 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e6e27dc8-f859-42ba-bad4-6723f00317fb tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:22:41.426458 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e6e27dc8-f859-42ba-bad4-6723f00317fb tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:22:41.442157 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e6e27dc8-f859-42ba-bad4-6723f00317fb tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:22:41.442864 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e6e27dc8-f859-42ba-bad4-6723f00317fb tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:22:41.697023 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-e6e27dc8-f859-42ba-bad4-6723f00317fb tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:22:41.708025 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-e6e27dc8-f859-42ba-bad4-6723f00317fb tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/b55b87f6-54c7-4ae0-a7e3-15755f63ff57" status: 200 len: 1267 microversion: 2.1 time: 0.296216 Oct 08 21:22:41.710271 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2708/5494] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:22:41 2022] GET /compute/v2.1/servers/b55b87f6-54c7-4ae0-a7e3-15755f63ff57 => generated 1267 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:22:42.262829 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-fa04ee2e-1e35-4cb6-b597-b1e02175bf51 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:22:42.263550 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-fa04ee2e-1e35-4cb6-b597-b1e02175bf51 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] [instance: 9f0543d4-5a51-4c40-8b2e-fbd2a393c903] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:22:42.276941 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fa04ee2e-1e35-4cb6-b597-b1e02175bf51 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:22:42.282347 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fa04ee2e-1e35-4cb6-b597-b1e02175bf51 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:22:42.284590 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fa04ee2e-1e35-4cb6-b597-b1e02175bf51 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:22:42.285573 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fa04ee2e-1e35-4cb6-b597-b1e02175bf51 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:22:42.287557 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fa04ee2e-1e35-4cb6-b597-b1e02175bf51 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:22:42.288224 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fa04ee2e-1e35-4cb6-b597-b1e02175bf51 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:22:42.449342 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-fa04ee2e-1e35-4cb6-b597-b1e02175bf51 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a0d81fb2dd4891901f27890ce7688e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fd83b3bdef4ba18ba56a9385e26d01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:22:42.462482 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-fa04ee2e-1e35-4cb6-b597-b1e02175bf51 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] 10.222.0.26 "GET /compute/v2.1/servers/9f0543d4-5a51-4c40-8b2e-fbd2a393c903" status: 200 len: 1290 microversion: 2.1 time: 0.207178 Oct 08 21:22:42.466316 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2787/5495] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:22:42 2022] GET /compute/v2.1/servers/9f0543d4-5a51-4c40-8b2e-fbd2a393c903 => generated 1290 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:22:42.738574 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-d2e75181-a91a-480e-b23c-9c70505796fa tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:22:42.739833 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-d2e75181-a91a-480e-b23c-9c70505796fa tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: b55b87f6-54c7-4ae0-a7e3-15755f63ff57] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:22:42.752452 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d2e75181-a91a-480e-b23c-9c70505796fa tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:22:42.753226 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d2e75181-a91a-480e-b23c-9c70505796fa tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:22:42.753920 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d2e75181-a91a-480e-b23c-9c70505796fa tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:22:42.754923 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d2e75181-a91a-480e-b23c-9c70505796fa tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:22:42.755591 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d2e75181-a91a-480e-b23c-9c70505796fa tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:22:42.756375 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d2e75181-a91a-480e-b23c-9c70505796fa tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:22:42.925498 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-d2e75181-a91a-480e-b23c-9c70505796fa tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:22:42.937022 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-d2e75181-a91a-480e-b23c-9c70505796fa tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/b55b87f6-54c7-4ae0-a7e3-15755f63ff57" status: 200 len: 1273 microversion: 2.1 time: 0.203773 Oct 08 21:22:42.938162 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2709/5496] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:22:42 2022] GET /compute/v2.1/servers/b55b87f6-54c7-4ae0-a7e3-15755f63ff57 => generated 1273 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:22:43.496269 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-de3b7daf-70cf-4a67-b74b-a26f45bb4571 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:22:43.497600 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-de3b7daf-70cf-4a67-b74b-a26f45bb4571 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] [instance: 9f0543d4-5a51-4c40-8b2e-fbd2a393c903] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:22:43.510730 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-de3b7daf-70cf-4a67-b74b-a26f45bb4571 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:22:43.511426 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-de3b7daf-70cf-4a67-b74b-a26f45bb4571 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:22:43.515110 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-de3b7daf-70cf-4a67-b74b-a26f45bb4571 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:22:43.516976 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-de3b7daf-70cf-4a67-b74b-a26f45bb4571 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:22:43.517837 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-de3b7daf-70cf-4a67-b74b-a26f45bb4571 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:22:43.518448 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-de3b7daf-70cf-4a67-b74b-a26f45bb4571 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:22:43.642978 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-de3b7daf-70cf-4a67-b74b-a26f45bb4571 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a0d81fb2dd4891901f27890ce7688e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fd83b3bdef4ba18ba56a9385e26d01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:22:43.656771 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-de3b7daf-70cf-4a67-b74b-a26f45bb4571 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] 10.222.0.26 "GET /compute/v2.1/servers/9f0543d4-5a51-4c40-8b2e-fbd2a393c903" status: 200 len: 1352 microversion: 2.1 time: 0.165614 Oct 08 21:22:43.659095 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2788/5497] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:22:43 2022] GET /compute/v2.1/servers/9f0543d4-5a51-4c40-8b2e-fbd2a393c903 => generated 1352 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:22:43.960367 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-753cd5c1-2a10-48ca-bdaf-ad0812fb2356 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:22:43.961026 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-753cd5c1-2a10-48ca-bdaf-ad0812fb2356 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: b55b87f6-54c7-4ae0-a7e3-15755f63ff57] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:22:43.975155 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-753cd5c1-2a10-48ca-bdaf-ad0812fb2356 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:22:43.977526 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-753cd5c1-2a10-48ca-bdaf-ad0812fb2356 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:22:43.978069 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-753cd5c1-2a10-48ca-bdaf-ad0812fb2356 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:22:43.978824 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-753cd5c1-2a10-48ca-bdaf-ad0812fb2356 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:22:43.979559 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-753cd5c1-2a10-48ca-bdaf-ad0812fb2356 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:22:43.979995 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-753cd5c1-2a10-48ca-bdaf-ad0812fb2356 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:22:44.686153 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-94335be6-b2e5-4823-8f90-593406725cc4 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:22:44.686952 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-94335be6-b2e5-4823-8f90-593406725cc4 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] [instance: 9f0543d4-5a51-4c40-8b2e-fbd2a393c903] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:22:44.701034 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-94335be6-b2e5-4823-8f90-593406725cc4 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:22:44.702229 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-94335be6-b2e5-4823-8f90-593406725cc4 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:22:44.703549 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-94335be6-b2e5-4823-8f90-593406725cc4 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:22:44.704483 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-94335be6-b2e5-4823-8f90-593406725cc4 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:22:44.705269 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-94335be6-b2e5-4823-8f90-593406725cc4 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:22:44.706940 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-94335be6-b2e5-4823-8f90-593406725cc4 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:22:44.721980 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-753cd5c1-2a10-48ca-bdaf-ad0812fb2356 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:22:44.738580 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-753cd5c1-2a10-48ca-bdaf-ad0812fb2356 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/b55b87f6-54c7-4ae0-a7e3-15755f63ff57" status: 200 len: 1315 microversion: 2.1 time: 0.781784 Oct 08 21:22:44.738909 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2710/5498] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:22:43 2022] GET /compute/v2.1/servers/b55b87f6-54c7-4ae0-a7e3-15755f63ff57 => generated 1315 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:22:44.898872 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-94335be6-b2e5-4823-8f90-593406725cc4 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a0d81fb2dd4891901f27890ce7688e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fd83b3bdef4ba18ba56a9385e26d01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:22:44.917821 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-94335be6-b2e5-4823-8f90-593406725cc4 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] 10.222.0.26 "GET /compute/v2.1/servers/9f0543d4-5a51-4c40-8b2e-fbd2a393c903" status: 200 len: 1352 microversion: 2.1 time: 0.235256 Oct 08 21:22:44.925217 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2789/5499] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:22:44 2022] GET /compute/v2.1/servers/9f0543d4-5a51-4c40-8b2e-fbd2a393c903 => generated 1352 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:22:45.763686 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-75e7adf7-931f-462b-8020-6ad430566a13 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:22:45.765068 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-75e7adf7-931f-462b-8020-6ad430566a13 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: b55b87f6-54c7-4ae0-a7e3-15755f63ff57] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:22:45.778679 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-75e7adf7-931f-462b-8020-6ad430566a13 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:22:45.779501 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-75e7adf7-931f-462b-8020-6ad430566a13 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:22:45.780134 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-75e7adf7-931f-462b-8020-6ad430566a13 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:22:45.780859 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-75e7adf7-931f-462b-8020-6ad430566a13 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:22:45.781351 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-75e7adf7-931f-462b-8020-6ad430566a13 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:22:45.781970 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-75e7adf7-931f-462b-8020-6ad430566a13 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:22:45.944048 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-703c6ca1-df7b-4b09-8e9b-1c06349f0380 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:22:45.945843 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-703c6ca1-df7b-4b09-8e9b-1c06349f0380 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] [instance: 9f0543d4-5a51-4c40-8b2e-fbd2a393c903] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:22:45.963664 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-703c6ca1-df7b-4b09-8e9b-1c06349f0380 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:22:45.964204 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-703c6ca1-df7b-4b09-8e9b-1c06349f0380 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:22:45.964682 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-703c6ca1-df7b-4b09-8e9b-1c06349f0380 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:22:45.965492 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-703c6ca1-df7b-4b09-8e9b-1c06349f0380 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:22:45.965976 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-703c6ca1-df7b-4b09-8e9b-1c06349f0380 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:22:45.966428 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-703c6ca1-df7b-4b09-8e9b-1c06349f0380 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:22:46.255123 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-75e7adf7-931f-462b-8020-6ad430566a13 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:22:46.263874 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-75e7adf7-931f-462b-8020-6ad430566a13 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/b55b87f6-54c7-4ae0-a7e3-15755f63ff57" status: 200 len: 1315 microversion: 2.1 time: 0.504019 Oct 08 21:22:46.277909 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2711/5500] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:22:45 2022] GET /compute/v2.1/servers/b55b87f6-54c7-4ae0-a7e3-15755f63ff57 => generated 1315 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:22:46.526932 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-703c6ca1-df7b-4b09-8e9b-1c06349f0380 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a0d81fb2dd4891901f27890ce7688e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fd83b3bdef4ba18ba56a9385e26d01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:22:46.548398 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-703c6ca1-df7b-4b09-8e9b-1c06349f0380 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] 10.222.0.26 "GET /compute/v2.1/servers/9f0543d4-5a51-4c40-8b2e-fbd2a393c903" status: 200 len: 1471 microversion: 2.1 time: 0.608220 Oct 08 21:22:46.578868 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2790/5501] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:22:45 2022] GET /compute/v2.1/servers/9f0543d4-5a51-4c40-8b2e-fbd2a393c903 => generated 1471 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:22:46.699935 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-04272520-0ad8-47a1-83b7-c7b69c64d6d7 req-35151ead-7c13-498d-91e9-74046213b32f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f0543d4-5a51-4c40-8b2e-fbd2a393c903", "tag": "a4edc924-cba8-42e2-9312-80f470865159"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:22:46.717067 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-04272520-0ad8-47a1-83b7-c7b69c64d6d7 req-35151ead-7c13-498d-91e9-74046213b32f service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:22:46.718653 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-04272520-0ad8-47a1-83b7-c7b69c64d6d7 req-35151ead-7c13-498d-91e9-74046213b32f service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:22:46.720508 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-04272520-0ad8-47a1-83b7-c7b69c64d6d7 req-35151ead-7c13-498d-91e9-74046213b32f service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:22:46.782988 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-04272520-0ad8-47a1-83b7-c7b69c64d6d7 req-35151ead-7c13-498d-91e9-74046213b32f service nova] Creating event network-changed:a4edc924-cba8-42e2-9312-80f470865159 for instance 9f0543d4-5a51-4c40-8b2e-fbd2a393c903 on nch1-master-1 Oct 08 21:22:46.799791 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-04272520-0ad8-47a1-83b7-c7b69c64d6d7 req-35151ead-7c13-498d-91e9-74046213b32f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106920 Oct 08 21:22:46.803860 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2712/5502] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:22:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:22:47.292659 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-d98f48a1-2276-434d-8920-6140447bf077 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:22:47.293463 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-d98f48a1-2276-434d-8920-6140447bf077 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: b55b87f6-54c7-4ae0-a7e3-15755f63ff57] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:22:47.310783 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d98f48a1-2276-434d-8920-6140447bf077 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:22:47.311408 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d98f48a1-2276-434d-8920-6140447bf077 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:22:47.311880 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d98f48a1-2276-434d-8920-6140447bf077 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:22:47.313827 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d98f48a1-2276-434d-8920-6140447bf077 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:22:47.314875 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d98f48a1-2276-434d-8920-6140447bf077 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:22:47.315801 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d98f48a1-2276-434d-8920-6140447bf077 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:22:47.410727 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-9978a9bc-2b9b-43b7-a6d3-a6dc37ecfecd req-2b996701-e28b-4017-b6ac-43da2a670a8f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b55b87f6-54c7-4ae0-a7e3-15755f63ff57", "tag": "05df99ed-71f0-4c34-acfd-7058cfaf30c4"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:22:47.420740 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-9978a9bc-2b9b-43b7-a6d3-a6dc37ecfecd req-2b996701-e28b-4017-b6ac-43da2a670a8f service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:22:47.421609 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-9978a9bc-2b9b-43b7-a6d3-a6dc37ecfecd req-2b996701-e28b-4017-b6ac-43da2a670a8f service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:22:47.422245 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-9978a9bc-2b9b-43b7-a6d3-a6dc37ecfecd req-2b996701-e28b-4017-b6ac-43da2a670a8f service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:22:47.436761 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-9978a9bc-2b9b-43b7-a6d3-a6dc37ecfecd req-2b996701-e28b-4017-b6ac-43da2a670a8f service nova] Creating event network-changed:05df99ed-71f0-4c34-acfd-7058cfaf30c4 for instance b55b87f6-54c7-4ae0-a7e3-15755f63ff57 on nch1-master-1 Oct 08 21:22:47.443233 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-9978a9bc-2b9b-43b7-a6d3-a6dc37ecfecd req-2b996701-e28b-4017-b6ac-43da2a670a8f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.212300 Oct 08 21:22:47.444028 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2791/5503] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:22:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 08 21:22:47.516519 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-d98f48a1-2276-434d-8920-6140447bf077 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:22:47.526322 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-d98f48a1-2276-434d-8920-6140447bf077 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/b55b87f6-54c7-4ae0-a7e3-15755f63ff57" status: 200 len: 1315 microversion: 2.1 time: 0.241574 Oct 08 21:22:47.526919 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2713/5504] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:22:47 2022] GET /compute/v2.1/servers/b55b87f6-54c7-4ae0-a7e3-15755f63ff57 => generated 1315 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:22:47.584150 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-63270d5c-42f9-4acf-9594-03e804e6097e tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:22:47.585438 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-63270d5c-42f9-4acf-9594-03e804e6097e tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] [instance: 9f0543d4-5a51-4c40-8b2e-fbd2a393c903] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:22:47.592342 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-63270d5c-42f9-4acf-9594-03e804e6097e tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:22:47.593221 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-63270d5c-42f9-4acf-9594-03e804e6097e tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:22:47.593868 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-63270d5c-42f9-4acf-9594-03e804e6097e tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:22:47.595057 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-63270d5c-42f9-4acf-9594-03e804e6097e tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:22:47.595828 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-63270d5c-42f9-4acf-9594-03e804e6097e tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:22:47.596345 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-63270d5c-42f9-4acf-9594-03e804e6097e tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:22:48.319279 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-63270d5c-42f9-4acf-9594-03e804e6097e tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a0d81fb2dd4891901f27890ce7688e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fd83b3bdef4ba18ba56a9385e26d01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:22:48.332905 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-63270d5c-42f9-4acf-9594-03e804e6097e tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] 10.222.0.26 "GET /compute/v2.1/servers/9f0543d4-5a51-4c40-8b2e-fbd2a393c903" status: 200 len: 1471 microversion: 2.1 time: 0.751109 Oct 08 21:22:48.333863 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2792/5505] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:22:47 2022] GET /compute/v2.1/servers/9f0543d4-5a51-4c40-8b2e-fbd2a393c903 => generated 1471 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:22:48.557775 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-2f4d2f0d-7d72-48cd-8620-8aa3380dac91 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:22:48.559557 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-2f4d2f0d-7d72-48cd-8620-8aa3380dac91 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: b55b87f6-54c7-4ae0-a7e3-15755f63ff57] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:22:48.590011 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2f4d2f0d-7d72-48cd-8620-8aa3380dac91 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:22:48.591472 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2f4d2f0d-7d72-48cd-8620-8aa3380dac91 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:22:48.592144 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2f4d2f0d-7d72-48cd-8620-8aa3380dac91 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:22:48.593175 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2f4d2f0d-7d72-48cd-8620-8aa3380dac91 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:22:48.595296 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2f4d2f0d-7d72-48cd-8620-8aa3380dac91 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:22:48.596549 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2f4d2f0d-7d72-48cd-8620-8aa3380dac91 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:22:49.044336 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-2f4d2f0d-7d72-48cd-8620-8aa3380dac91 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:22:49.058883 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-2f4d2f0d-7d72-48cd-8620-8aa3380dac91 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/b55b87f6-54c7-4ae0-a7e3-15755f63ff57" status: 200 len: 1315 microversion: 2.1 time: 0.508844 Oct 08 21:22:49.059646 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2714/5506] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:22:48 2022] GET /compute/v2.1/servers/b55b87f6-54c7-4ae0-a7e3-15755f63ff57 => generated 1315 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:22:49.360751 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-bcbc284c-9b1c-4737-892d-0fa8b8c9652d tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:22:49.361428 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-bcbc284c-9b1c-4737-892d-0fa8b8c9652d tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] [instance: 9f0543d4-5a51-4c40-8b2e-fbd2a393c903] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:22:49.374415 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bcbc284c-9b1c-4737-892d-0fa8b8c9652d tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:22:49.375772 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bcbc284c-9b1c-4737-892d-0fa8b8c9652d tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:22:49.376598 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bcbc284c-9b1c-4737-892d-0fa8b8c9652d tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:22:49.377640 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bcbc284c-9b1c-4737-892d-0fa8b8c9652d tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:22:49.378330 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bcbc284c-9b1c-4737-892d-0fa8b8c9652d tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:22:49.379068 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bcbc284c-9b1c-4737-892d-0fa8b8c9652d tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:22:49.673748 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-bcbc284c-9b1c-4737-892d-0fa8b8c9652d tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a0d81fb2dd4891901f27890ce7688e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fd83b3bdef4ba18ba56a9385e26d01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:22:49.684054 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-bcbc284c-9b1c-4737-892d-0fa8b8c9652d tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] 10.222.0.26 "GET /compute/v2.1/servers/9f0543d4-5a51-4c40-8b2e-fbd2a393c903" status: 200 len: 1471 microversion: 2.1 time: 0.328737 Oct 08 21:22:49.684646 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2793/5507] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:22:49 2022] GET /compute/v2.1/servers/9f0543d4-5a51-4c40-8b2e-fbd2a393c903 => generated 1471 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:22:50.083190 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-ee9abeac-aa10-4639-b176-c155c75e186c tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:22:50.084437 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-ee9abeac-aa10-4639-b176-c155c75e186c tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: b55b87f6-54c7-4ae0-a7e3-15755f63ff57] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:22:50.103946 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ee9abeac-aa10-4639-b176-c155c75e186c tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:22:50.106892 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ee9abeac-aa10-4639-b176-c155c75e186c tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:22:50.109569 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ee9abeac-aa10-4639-b176-c155c75e186c tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:22:50.110681 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ee9abeac-aa10-4639-b176-c155c75e186c tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:22:50.116171 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ee9abeac-aa10-4639-b176-c155c75e186c tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:22:50.116656 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ee9abeac-aa10-4639-b176-c155c75e186c tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:22:50.643051 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-ee9abeac-aa10-4639-b176-c155c75e186c tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:22:50.659120 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-ee9abeac-aa10-4639-b176-c155c75e186c tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/b55b87f6-54c7-4ae0-a7e3-15755f63ff57" status: 200 len: 1315 microversion: 2.1 time: 0.580054 Oct 08 21:22:50.659713 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2715/5508] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:22:50 2022] GET /compute/v2.1/servers/b55b87f6-54c7-4ae0-a7e3-15755f63ff57 => generated 1315 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:22:50.710731 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-a25ac5d2-8ebb-49a1-9382-327dae12e989 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:22:50.712413 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-a25ac5d2-8ebb-49a1-9382-327dae12e989 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] [instance: 9f0543d4-5a51-4c40-8b2e-fbd2a393c903] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:22:50.716358 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=2 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:22:50.721010 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=8 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:22:50.731828 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a25ac5d2-8ebb-49a1-9382-327dae12e989 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:22:50.732603 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a25ac5d2-8ebb-49a1-9382-327dae12e989 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:22:50.733251 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a25ac5d2-8ebb-49a1-9382-327dae12e989 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:22:50.734187 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a25ac5d2-8ebb-49a1-9382-327dae12e989 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:22:50.734834 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a25ac5d2-8ebb-49a1-9382-327dae12e989 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:22:50.735698 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a25ac5d2-8ebb-49a1-9382-327dae12e989 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:22:51.416806 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-a25ac5d2-8ebb-49a1-9382-327dae12e989 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a0d81fb2dd4891901f27890ce7688e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fd83b3bdef4ba18ba56a9385e26d01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:22:51.424871 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-a25ac5d2-8ebb-49a1-9382-327dae12e989 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] 10.222.0.26 "GET /compute/v2.1/servers/9f0543d4-5a51-4c40-8b2e-fbd2a393c903" status: 200 len: 1471 microversion: 2.1 time: 0.720464 Oct 08 21:22:51.426456 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2794/5509] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:22:50 2022] GET /compute/v2.1/servers/9f0543d4-5a51-4c40-8b2e-fbd2a393c903 => generated 1471 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:22:51.455788 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-4a2eec3f-8685-4726-b33f-0f7d9219f975 req-d1c1ebff-cb23-4b8d-8f2b-7aaf9bf97c2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f0543d4-5a51-4c40-8b2e-fbd2a393c903", "name": "network-vif-plugged", "status": "completed", "tag": "a4edc924-cba8-42e2-9312-80f470865159"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:22:51.463895 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=2 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:22:51.467127 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=8 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:22:51.475750 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-4a2eec3f-8685-4726-b33f-0f7d9219f975 req-d1c1ebff-cb23-4b8d-8f2b-7aaf9bf97c2d service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:22:51.476612 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-4a2eec3f-8685-4726-b33f-0f7d9219f975 req-d1c1ebff-cb23-4b8d-8f2b-7aaf9bf97c2d service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:22:51.477295 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-4a2eec3f-8685-4726-b33f-0f7d9219f975 req-d1c1ebff-cb23-4b8d-8f2b-7aaf9bf97c2d service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:22:51.497699 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-4a2eec3f-8685-4726-b33f-0f7d9219f975 req-d1c1ebff-cb23-4b8d-8f2b-7aaf9bf97c2d service nova] Creating event network-vif-plugged:a4edc924-cba8-42e2-9312-80f470865159 for instance 9f0543d4-5a51-4c40-8b2e-fbd2a393c903 on nch1-master-1 Oct 08 21:22:51.505631 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-4a2eec3f-8685-4726-b33f-0f7d9219f975 req-d1c1ebff-cb23-4b8d-8f2b-7aaf9bf97c2d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056689 Oct 08 21:22:51.511100 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2716/5510] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:22:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:22:51.686569 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-a6d02b34-a151-4ad7-981c-3d1c74c4c562 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:22:51.687595 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-a6d02b34-a151-4ad7-981c-3d1c74c4c562 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: b55b87f6-54c7-4ae0-a7e3-15755f63ff57] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:22:51.694710 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a6d02b34-a151-4ad7-981c-3d1c74c4c562 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:22:51.695574 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a6d02b34-a151-4ad7-981c-3d1c74c4c562 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:22:51.697065 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a6d02b34-a151-4ad7-981c-3d1c74c4c562 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:22:51.698067 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a6d02b34-a151-4ad7-981c-3d1c74c4c562 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:22:51.698847 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a6d02b34-a151-4ad7-981c-3d1c74c4c562 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:22:51.699540 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a6d02b34-a151-4ad7-981c-3d1c74c4c562 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:22:51.704679 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=100 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:22:52.228878 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-a6d02b34-a151-4ad7-981c-3d1c74c4c562 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:22:52.243231 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-a6d02b34-a151-4ad7-981c-3d1c74c4c562 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/b55b87f6-54c7-4ae0-a7e3-15755f63ff57" status: 200 len: 1315 microversion: 2.1 time: 0.560713 Oct 08 21:22:52.244980 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2795/5511] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:22:51 2022] GET /compute/v2.1/servers/b55b87f6-54c7-4ae0-a7e3-15755f63ff57 => generated 1315 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:22:52.452128 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-5eebfc52-5d9d-4449-b32c-853962161382 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:22:52.455829 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-5eebfc52-5d9d-4449-b32c-853962161382 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] [instance: 9f0543d4-5a51-4c40-8b2e-fbd2a393c903] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:22:52.464741 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5eebfc52-5d9d-4449-b32c-853962161382 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:22:52.465547 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5eebfc52-5d9d-4449-b32c-853962161382 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:22:52.466201 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5eebfc52-5d9d-4449-b32c-853962161382 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:22:52.467091 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5eebfc52-5d9d-4449-b32c-853962161382 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:22:52.467715 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5eebfc52-5d9d-4449-b32c-853962161382 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:22:52.468308 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5eebfc52-5d9d-4449-b32c-853962161382 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:22:52.724349 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-5eebfc52-5d9d-4449-b32c-853962161382 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a0d81fb2dd4891901f27890ce7688e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fd83b3bdef4ba18ba56a9385e26d01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:22:52.747712 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-5eebfc52-5d9d-4449-b32c-853962161382 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] 10.222.0.26 "GET /compute/v2.1/servers/9f0543d4-5a51-4c40-8b2e-fbd2a393c903" status: 200 len: 1471 microversion: 2.1 time: 0.292778 Oct 08 21:22:52.751918 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2717/5512] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:22:52 2022] GET /compute/v2.1/servers/9f0543d4-5a51-4c40-8b2e-fbd2a393c903 => generated 1471 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:22:53.272196 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-2ff47de6-5ac4-4639-8f0b-65b8abc99dc3 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:22:53.273482 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-2ff47de6-5ac4-4639-8f0b-65b8abc99dc3 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: b55b87f6-54c7-4ae0-a7e3-15755f63ff57] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:22:53.284688 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2ff47de6-5ac4-4639-8f0b-65b8abc99dc3 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:22:53.287829 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2ff47de6-5ac4-4639-8f0b-65b8abc99dc3 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:22:53.288364 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2ff47de6-5ac4-4639-8f0b-65b8abc99dc3 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:22:53.292463 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2ff47de6-5ac4-4639-8f0b-65b8abc99dc3 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:22:53.292972 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2ff47de6-5ac4-4639-8f0b-65b8abc99dc3 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:22:53.293479 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2ff47de6-5ac4-4639-8f0b-65b8abc99dc3 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:22:53.552221 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-29d95014-b5f0-447d-a86b-e3c13ef57ffd req-37f2bb89-28fe-4acf-baa7-6250c994fdb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b55b87f6-54c7-4ae0-a7e3-15755f63ff57", "name": "network-vif-plugged", "status": "completed", "tag": "05df99ed-71f0-4c34-acfd-7058cfaf30c4"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:22:53.572369 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-29d95014-b5f0-447d-a86b-e3c13ef57ffd req-37f2bb89-28fe-4acf-baa7-6250c994fdb8 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:22:53.572369 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-29d95014-b5f0-447d-a86b-e3c13ef57ffd req-37f2bb89-28fe-4acf-baa7-6250c994fdb8 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:22:53.572369 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-29d95014-b5f0-447d-a86b-e3c13ef57ffd req-37f2bb89-28fe-4acf-baa7-6250c994fdb8 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:22:53.605657 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-29d95014-b5f0-447d-a86b-e3c13ef57ffd req-37f2bb89-28fe-4acf-baa7-6250c994fdb8 service nova] Creating event network-vif-plugged:05df99ed-71f0-4c34-acfd-7058cfaf30c4 for instance b55b87f6-54c7-4ae0-a7e3-15755f63ff57 on nch1-master-1 Oct 08 21:22:53.610690 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-29d95014-b5f0-447d-a86b-e3c13ef57ffd req-37f2bb89-28fe-4acf-baa7-6250c994fdb8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062261 Oct 08 21:22:53.612019 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2718/5513] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:22:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 08 21:22:53.664122 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-2ff47de6-5ac4-4639-8f0b-65b8abc99dc3 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:22:53.680781 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-2ff47de6-5ac4-4639-8f0b-65b8abc99dc3 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/b55b87f6-54c7-4ae0-a7e3-15755f63ff57" status: 200 len: 1315 microversion: 2.1 time: 0.413765 Oct 08 21:22:53.682878 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2796/5514] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:22:53 2022] GET /compute/v2.1/servers/b55b87f6-54c7-4ae0-a7e3-15755f63ff57 => generated 1315 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:22:53.776709 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-782d9681-7eec-4f4c-bc05-932225a3587f tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:22:53.777447 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-782d9681-7eec-4f4c-bc05-932225a3587f tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] [instance: 9f0543d4-5a51-4c40-8b2e-fbd2a393c903] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:22:53.784755 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-782d9681-7eec-4f4c-bc05-932225a3587f tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:22:53.785704 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-782d9681-7eec-4f4c-bc05-932225a3587f tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:22:53.786409 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-782d9681-7eec-4f4c-bc05-932225a3587f tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:22:53.787383 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-782d9681-7eec-4f4c-bc05-932225a3587f tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:22:53.788048 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-782d9681-7eec-4f4c-bc05-932225a3587f tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:22:53.788631 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-782d9681-7eec-4f4c-bc05-932225a3587f tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:22:54.110882 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-782d9681-7eec-4f4c-bc05-932225a3587f tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a0d81fb2dd4891901f27890ce7688e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fd83b3bdef4ba18ba56a9385e26d01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:22:54.127274 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-782d9681-7eec-4f4c-bc05-932225a3587f tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] 10.222.0.26 "GET /compute/v2.1/servers/9f0543d4-5a51-4c40-8b2e-fbd2a393c903" status: 200 len: 1643 microversion: 2.1 time: 0.355341 Oct 08 21:22:54.128180 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2719/5515] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:22:53 2022] GET /compute/v2.1/servers/9f0543d4-5a51-4c40-8b2e-fbd2a393c903 => generated 1643 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:22:54.152136 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-8d7beadc-4498-4d5c-8e00-80ac49ab8f57 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:22:54.152771 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-8d7beadc-4498-4d5c-8e00-80ac49ab8f57 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] [instance: 9f0543d4-5a51-4c40-8b2e-fbd2a393c903] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:22:54.159046 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8d7beadc-4498-4d5c-8e00-80ac49ab8f57 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:22:54.159749 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8d7beadc-4498-4d5c-8e00-80ac49ab8f57 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:22:54.160395 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8d7beadc-4498-4d5c-8e00-80ac49ab8f57 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:22:54.161348 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8d7beadc-4498-4d5c-8e00-80ac49ab8f57 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:22:54.162172 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8d7beadc-4498-4d5c-8e00-80ac49ab8f57 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:22:54.162783 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8d7beadc-4498-4d5c-8e00-80ac49ab8f57 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:22:54.375010 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-8d7beadc-4498-4d5c-8e00-80ac49ab8f57 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a0d81fb2dd4891901f27890ce7688e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fd83b3bdef4ba18ba56a9385e26d01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:22:54.384824 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-8d7beadc-4498-4d5c-8e00-80ac49ab8f57 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] 10.222.0.26 "GET /compute/v2.1/servers/9f0543d4-5a51-4c40-8b2e-fbd2a393c903" status: 200 len: 1643 microversion: 2.1 time: 0.237743 Oct 08 21:22:54.388944 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2797/5516] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:22:54 2022] GET /compute/v2.1/servers/9f0543d4-5a51-4c40-8b2e-fbd2a393c903 => generated 1643 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:22:54.412277 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-72393503-c00f-4149-9903-2b1005afef3d tempest-TestSecurityGroupsBasicOps-167120437 tempest-TestSecurityGroupsBasicOps-167120437-project-admin] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:22:54.413119 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-72393503-c00f-4149-9903-2b1005afef3d tempest-TestSecurityGroupsBasicOps-167120437 tempest-TestSecurityGroupsBasicOps-167120437-project-admin] [instance: 9f0543d4-5a51-4c40-8b2e-fbd2a393c903] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:22:54.423485 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-72393503-c00f-4149-9903-2b1005afef3d tempest-TestSecurityGroupsBasicOps-167120437 tempest-TestSecurityGroupsBasicOps-167120437-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:22:54.428730 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-72393503-c00f-4149-9903-2b1005afef3d tempest-TestSecurityGroupsBasicOps-167120437 tempest-TestSecurityGroupsBasicOps-167120437-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:22:54.429479 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-72393503-c00f-4149-9903-2b1005afef3d tempest-TestSecurityGroupsBasicOps-167120437 tempest-TestSecurityGroupsBasicOps-167120437-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:22:54.430929 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-72393503-c00f-4149-9903-2b1005afef3d tempest-TestSecurityGroupsBasicOps-167120437 tempest-TestSecurityGroupsBasicOps-167120437-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:22:54.431582 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-72393503-c00f-4149-9903-2b1005afef3d tempest-TestSecurityGroupsBasicOps-167120437 tempest-TestSecurityGroupsBasicOps-167120437-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:22:54.432189 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-72393503-c00f-4149-9903-2b1005afef3d tempest-TestSecurityGroupsBasicOps-167120437 tempest-TestSecurityGroupsBasicOps-167120437-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:22:54.707984 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-d3c1afaf-3a27-45b8-9af6-77e24b8351b9 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:22:54.708621 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-d3c1afaf-3a27-45b8-9af6-77e24b8351b9 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: b55b87f6-54c7-4ae0-a7e3-15755f63ff57] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:22:54.716522 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d3c1afaf-3a27-45b8-9af6-77e24b8351b9 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:22:54.717031 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d3c1afaf-3a27-45b8-9af6-77e24b8351b9 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:22:54.717511 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d3c1afaf-3a27-45b8-9af6-77e24b8351b9 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:22:54.718234 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d3c1afaf-3a27-45b8-9af6-77e24b8351b9 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:22:54.718702 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d3c1afaf-3a27-45b8-9af6-77e24b8351b9 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:22:54.719221 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d3c1afaf-3a27-45b8-9af6-77e24b8351b9 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:22:54.960344 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-72393503-c00f-4149-9903-2b1005afef3d tempest-TestSecurityGroupsBasicOps-167120437 tempest-TestSecurityGroupsBasicOps-167120437-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/9f0543d4-5a51-4c40-8b2e-fbd2a393c903" status: 200 len: 1794 microversion: 2.1 time: 0.552540 Oct 08 21:22:54.983835 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2720/5517] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:22:54 2022] GET /compute/v2.1/servers/9f0543d4-5a51-4c40-8b2e-fbd2a393c903 => generated 1794 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:22:55.098996 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-d3c1afaf-3a27-45b8-9af6-77e24b8351b9 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:22:55.137302 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-d3c1afaf-3a27-45b8-9af6-77e24b8351b9 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/b55b87f6-54c7-4ae0-a7e3-15755f63ff57" status: 200 len: 1315 microversion: 2.1 time: 0.432737 Oct 08 21:22:55.138504 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2798/5518] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:22:54 2022] GET /compute/v2.1/servers/b55b87f6-54c7-4ae0-a7e3-15755f63ff57 => generated 1315 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:22:56.163774 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-5db3e79e-5851-4a64-9858-dc67ce21e095 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:22:56.166591 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-5db3e79e-5851-4a64-9858-dc67ce21e095 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: b55b87f6-54c7-4ae0-a7e3-15755f63ff57] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:22:56.204030 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5db3e79e-5851-4a64-9858-dc67ce21e095 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:22:56.205484 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5db3e79e-5851-4a64-9858-dc67ce21e095 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:22:56.206141 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5db3e79e-5851-4a64-9858-dc67ce21e095 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:22:56.207100 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5db3e79e-5851-4a64-9858-dc67ce21e095 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:22:56.207918 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5db3e79e-5851-4a64-9858-dc67ce21e095 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:22:56.208537 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5db3e79e-5851-4a64-9858-dc67ce21e095 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:22:56.247828 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=100 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:22:57.041225 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-5db3e79e-5851-4a64-9858-dc67ce21e095 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:22:57.049370 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-5db3e79e-5851-4a64-9858-dc67ce21e095 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/b55b87f6-54c7-4ae0-a7e3-15755f63ff57" status: 200 len: 1501 microversion: 2.1 time: 0.889742 Oct 08 21:22:57.065451 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2721/5519] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:22:56 2022] GET /compute/v2.1/servers/b55b87f6-54c7-4ae0-a7e3-15755f63ff57 => generated 1501 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:22:57.080697 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-36f4620d-6420-4777-9b28-5b3fcb9b3c03 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:22:57.081485 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-36f4620d-6420-4777-9b28-5b3fcb9b3c03 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: b55b87f6-54c7-4ae0-a7e3-15755f63ff57] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:22:57.088881 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-36f4620d-6420-4777-9b28-5b3fcb9b3c03 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:22:57.089840 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-36f4620d-6420-4777-9b28-5b3fcb9b3c03 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:22:57.090551 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-36f4620d-6420-4777-9b28-5b3fcb9b3c03 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:22:57.091522 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-36f4620d-6420-4777-9b28-5b3fcb9b3c03 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:22:57.092217 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-36f4620d-6420-4777-9b28-5b3fcb9b3c03 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:22:57.092882 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-36f4620d-6420-4777-9b28-5b3fcb9b3c03 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:22:57.345081 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.network.security_group_api [None req-36f4620d-6420-4777-9b28-5b3fcb9b3c03 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Removing security group 17c83e51-15b1-4882-89e8-ab6515c376a6 from port 05df99ed-71f0-4c34-acfd-7058cfaf30c4 Oct 08 21:22:58.149396 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-36f4620d-6420-4777-9b28-5b3fcb9b3c03 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "POST /compute/v2.1/servers/b55b87f6-54c7-4ae0-a7e3-15755f63ff57/action" status: 202 len: 0 microversion: 2.1 time: 1.072360 Oct 08 21:22:58.150334 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2799/5520] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:22:57 2022] POST /compute/v2.1/servers/b55b87f6-54c7-4ae0-a7e3-15755f63ff57/action => generated 0 bytes in 1075 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 21:22:58.158401 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-b7e2b3a1-a3fb-49ee-9122-6e2ef6bab83b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:22:58.159034 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-b7e2b3a1-a3fb-49ee-9122-6e2ef6bab83b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: b55b87f6-54c7-4ae0-a7e3-15755f63ff57] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:22:58.172915 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b7e2b3a1-a3fb-49ee-9122-6e2ef6bab83b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:22:58.173484 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b7e2b3a1-a3fb-49ee-9122-6e2ef6bab83b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:22:58.173939 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b7e2b3a1-a3fb-49ee-9122-6e2ef6bab83b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:22:58.181550 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b7e2b3a1-a3fb-49ee-9122-6e2ef6bab83b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:22:58.182089 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b7e2b3a1-a3fb-49ee-9122-6e2ef6bab83b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:22:58.182574 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b7e2b3a1-a3fb-49ee-9122-6e2ef6bab83b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:22:58.182747 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-5a3a8ecb-fa76-419e-9b22-944584dcc2b6 req-1760afce-25b3-4358-8558-3aae132c8a57 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b55b87f6-54c7-4ae0-a7e3-15755f63ff57", "tag": "05df99ed-71f0-4c34-acfd-7058cfaf30c4"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:22:58.199875 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-5a3a8ecb-fa76-419e-9b22-944584dcc2b6 req-1760afce-25b3-4358-8558-3aae132c8a57 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:22:58.200370 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-5a3a8ecb-fa76-419e-9b22-944584dcc2b6 req-1760afce-25b3-4358-8558-3aae132c8a57 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:22:58.201432 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-5a3a8ecb-fa76-419e-9b22-944584dcc2b6 req-1760afce-25b3-4358-8558-3aae132c8a57 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:22:58.219921 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-5a3a8ecb-fa76-419e-9b22-944584dcc2b6 req-1760afce-25b3-4358-8558-3aae132c8a57 service nova] Creating event network-changed:05df99ed-71f0-4c34-acfd-7058cfaf30c4 for instance b55b87f6-54c7-4ae0-a7e3-15755f63ff57 on nch1-master-1 Oct 08 21:22:58.236978 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-5a3a8ecb-fa76-419e-9b22-944584dcc2b6 req-1760afce-25b3-4358-8558-3aae132c8a57 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058880 Oct 08 21:22:58.243218 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2800/5521] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:22:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 08 21:22:58.601118 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-b7e2b3a1-a3fb-49ee-9122-6e2ef6bab83b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:22:58.610690 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-b7e2b3a1-a3fb-49ee-9122-6e2ef6bab83b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/b55b87f6-54c7-4ae0-a7e3-15755f63ff57" status: 200 len: 1459 microversion: 2.1 time: 0.456521 Oct 08 21:22:58.611857 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2722/5522] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:22:58 2022] GET /compute/v2.1/servers/b55b87f6-54c7-4ae0-a7e3-15755f63ff57 => generated 1459 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:22:58.635807 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-63f5abff-f3de-4cd0-86b7-cea6e8d337cb tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:22:58.636540 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-63f5abff-f3de-4cd0-86b7-cea6e8d337cb tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 2a61f287-652b-487f-9ecd-fb4d2d1eee62] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:22:58.650486 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-63f5abff-f3de-4cd0-86b7-cea6e8d337cb tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:22:58.650999 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-63f5abff-f3de-4cd0-86b7-cea6e8d337cb tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:22:58.651452 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-63f5abff-f3de-4cd0-86b7-cea6e8d337cb tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:22:58.652183 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-63f5abff-f3de-4cd0-86b7-cea6e8d337cb tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:22:58.652650 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-63f5abff-f3de-4cd0-86b7-cea6e8d337cb tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:22:58.657104 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-63f5abff-f3de-4cd0-86b7-cea6e8d337cb tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:22:58.981570 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-4b0670f8-309e-444d-8275-c980e550c7bd tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:22:58.984118 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-4b0670f8-309e-444d-8275-c980e550c7bd tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] [instance: 9fc4f8d8-fd9e-4513-8d3b-6ec7622db95f] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:22:58.990949 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4b0670f8-309e-444d-8275-c980e550c7bd tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:22:58.991752 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4b0670f8-309e-444d-8275-c980e550c7bd tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:22:58.992375 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4b0670f8-309e-444d-8275-c980e550c7bd tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:22:58.993360 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4b0670f8-309e-444d-8275-c980e550c7bd tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:22:58.995302 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4b0670f8-309e-444d-8275-c980e550c7bd tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:22:58.995922 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4b0670f8-309e-444d-8275-c980e550c7bd tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:22:59.050727 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-63f5abff-f3de-4cd0-86b7-cea6e8d337cb tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:22:59.063487 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-63f5abff-f3de-4cd0-86b7-cea6e8d337cb tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62" status: 200 len: 1670 microversion: 2.1 time: 0.433180 Oct 08 21:22:59.066798 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2801/5523] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:22:58 2022] GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62 => generated 1670 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:22:59.067204 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-4b0670f8-309e-444d-8275-c980e550c7bd tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] 10.222.0.26 "POST /compute/v2.1/servers/9fc4f8d8-fd9e-4513-8d3b-6ec7622db95f/action" status: 200 len: 24567 microversion: 2.1 time: 0.089244 Oct 08 21:22:59.068446 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2723/5524] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:22:58 2022] POST /compute/v2.1/servers/9fc4f8d8-fd9e-4513-8d3b-6ec7622db95f/action => generated 24567 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 08 21:22:59.099666 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-3e257611-cc12-474d-906f-7f404e63b3ea tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:22:59.101316 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-3e257611-cc12-474d-906f-7f404e63b3ea tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 2a61f287-652b-487f-9ecd-fb4d2d1eee62] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:22:59.110988 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3e257611-cc12-474d-906f-7f404e63b3ea tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:22:59.111723 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3e257611-cc12-474d-906f-7f404e63b3ea tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:22:59.112343 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3e257611-cc12-474d-906f-7f404e63b3ea tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:22:59.113890 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3e257611-cc12-474d-906f-7f404e63b3ea tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:22:59.114531 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3e257611-cc12-474d-906f-7f404e63b3ea tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:22:59.115142 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3e257611-cc12-474d-906f-7f404e63b3ea tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:22:59.294595 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-cb4a4c3f-29f9-4b85-ac79-9f173399cd47 req-a029ca17-98eb-4076-b0ca-d89be8e9b516 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f0543d4-5a51-4c40-8b2e-fbd2a393c903", "tag": "a4edc924-cba8-42e2-9312-80f470865159"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:22:59.319131 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-cb4a4c3f-29f9-4b85-ac79-9f173399cd47 req-a029ca17-98eb-4076-b0ca-d89be8e9b516 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:22:59.321698 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-cb4a4c3f-29f9-4b85-ac79-9f173399cd47 req-a029ca17-98eb-4076-b0ca-d89be8e9b516 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:22:59.322206 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-cb4a4c3f-29f9-4b85-ac79-9f173399cd47 req-a029ca17-98eb-4076-b0ca-d89be8e9b516 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:22:59.356662 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-cb4a4c3f-29f9-4b85-ac79-9f173399cd47 req-a029ca17-98eb-4076-b0ca-d89be8e9b516 service nova] Creating event network-changed:a4edc924-cba8-42e2-9312-80f470865159 for instance 9f0543d4-5a51-4c40-8b2e-fbd2a393c903 on nch1-master-1 Oct 08 21:22:59.370067 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-cb4a4c3f-29f9-4b85-ac79-9f173399cd47 req-a029ca17-98eb-4076-b0ca-d89be8e9b516 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081272 Oct 08 21:22:59.373174 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2724/5525] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:22:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 08 21:22:59.654044 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-3e257611-cc12-474d-906f-7f404e63b3ea tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:22:59.665840 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-3e257611-cc12-474d-906f-7f404e63b3ea tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62" status: 200 len: 1670 microversion: 2.1 time: 0.571217 Oct 08 21:22:59.687116 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2802/5526] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:22:59 2022] GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62 => generated 1670 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:22:59.694493 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-f4eeb47b-2d76-428b-a4a6-391ee8e6db91 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:22:59.695272 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-f4eeb47b-2d76-428b-a4a6-391ee8e6db91 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 2a61f287-652b-487f-9ecd-fb4d2d1eee62] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:22:59.698857 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:22:59.719735 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f4eeb47b-2d76-428b-a4a6-391ee8e6db91 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:22:59.720316 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f4eeb47b-2d76-428b-a4a6-391ee8e6db91 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:22:59.720775 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f4eeb47b-2d76-428b-a4a6-391ee8e6db91 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:22:59.721786 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f4eeb47b-2d76-428b-a4a6-391ee8e6db91 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:22:59.722255 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f4eeb47b-2d76-428b-a4a6-391ee8e6db91 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:22:59.724226 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f4eeb47b-2d76-428b-a4a6-391ee8e6db91 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:00.977476 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-f4eeb47b-2d76-428b-a4a6-391ee8e6db91 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:23:00.991664 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-f4eeb47b-2d76-428b-a4a6-391ee8e6db91 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62" status: 200 len: 1670 microversion: 2.1 time: 1.299390 Oct 08 21:23:00.992722 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2725/5527] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:22:59 2022] GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62 => generated 1670 bytes in 1305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:23:01.016421 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-5172dc1f-bf55-4ffa-b19b-60c90c231bb0 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:23:01.018332 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-5172dc1f-bf55-4ffa-b19b-60c90c231bb0 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 2a61f287-652b-487f-9ecd-fb4d2d1eee62] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:23:01.032379 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5172dc1f-bf55-4ffa-b19b-60c90c231bb0 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:01.034176 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5172dc1f-bf55-4ffa-b19b-60c90c231bb0 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:01.034863 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5172dc1f-bf55-4ffa-b19b-60c90c231bb0 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:01.035805 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5172dc1f-bf55-4ffa-b19b-60c90c231bb0 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:01.036737 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5172dc1f-bf55-4ffa-b19b-60c90c231bb0 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:01.041046 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5172dc1f-bf55-4ffa-b19b-60c90c231bb0 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:01.419958 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-5172dc1f-bf55-4ffa-b19b-60c90c231bb0 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:23:01.443833 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-5172dc1f-bf55-4ffa-b19b-60c90c231bb0 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62" status: 200 len: 1670 microversion: 2.1 time: 0.431198 Oct 08 21:23:01.449527 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2803/5528] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:23:01 2022] GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62 => generated 1670 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:23:01.696775 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-cbdbb7dd-1c09-4f30-9c7e-af0926605af3 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-281219799", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "networks": [{"uuid": "f6f1b01d-e3ee-45fc-896d-218868fb9293"}]}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:23:01.831917 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.network.neutron [None req-cbdbb7dd-1c09-4f30-9c7e-af0926605af3 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] validate_networks() for [('f6f1b01d-e3ee-45fc-896d-218868fb9293', None, None, None, None, None)] {{(pid=140491) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 21:23:03.058261 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-cbdbb7dd-1c09-4f30-9c7e-af0926605af3 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Flavor limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 21:23:03.059004 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-cbdbb7dd-1c09-4f30-9c7e-af0926605af3 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Image limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 21:23:03.059431 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-cbdbb7dd-1c09-4f30-9c7e-af0926605af3 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Flavor pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 21:23:03.060965 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-cbdbb7dd-1c09-4f30-9c7e-af0926605af3 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Image pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 21:23:03.060965 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-cbdbb7dd-1c09-4f30-9c7e-af0926605af3 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 21:23:03.089322 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cbdbb7dd-1c09-4f30-9c7e-af0926605af3 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:03.090268 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cbdbb7dd-1c09-4f30-9c7e-af0926605af3 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:03.090984 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cbdbb7dd-1c09-4f30-9c7e-af0926605af3 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:03.092357 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cbdbb7dd-1c09-4f30-9c7e-af0926605af3 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:03.093340 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cbdbb7dd-1c09-4f30-9c7e-af0926605af3 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:03.094024 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cbdbb7dd-1c09-4f30-9c7e-af0926605af3 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:03.134078 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-cbdbb7dd-1c09-4f30-9c7e-af0926605af3 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Getting quotas for project bd563fa73afb42c6b26eca3737d7a355. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:23:03.143593 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-cbdbb7dd-1c09-4f30-9c7e-af0926605af3 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Getting quotas for user 2f98e01cab6b49c7a5d239aee95f4a64 and project bd563fa73afb42c6b26eca3737d7a355. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:23:03.173572 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-cbdbb7dd-1c09-4f30-9c7e-af0926605af3 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Going to run 1 instances... {{(pid=140491) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 21:23:03.176199 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-cbdbb7dd-1c09-4f30-9c7e-af0926605af3 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: e13ba2a1-731c-4fc7-b8d2-db3ce6199eb6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c508bd7f-7db9-4b2c-af7c-be54a855c355',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140491) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 21:23:03.258067 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-cbdbb7dd-1c09-4f30-9c7e-af0926605af3 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.566453 Oct 08 21:23:03.262147 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2726/5529] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 21:23:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1573 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 08 21:23:03.280877 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-60c813c7-c20f-4902-9190-afea6046dca5 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:23:03.281830 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-60c813c7-c20f-4902-9190-afea6046dca5 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: e13ba2a1-731c-4fc7-b8d2-db3ce6199eb6] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:23:03.400347 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-60c813c7-c20f-4902-9190-afea6046dca5 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:23:03.408944 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-60c813c7-c20f-4902-9190-afea6046dca5 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/e13ba2a1-731c-4fc7-b8d2-db3ce6199eb6" status: 200 len: 1214 microversion: 2.1 time: 0.133932 Oct 08 21:23:03.410569 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2804/5530] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:23:03 2022] GET /compute/v2.1/servers/e13ba2a1-731c-4fc7-b8d2-db3ce6199eb6 => generated 1214 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:23:04.434016 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-00aa46ba-aa61-42e7-9c92-ccbed140b189 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:23:04.434829 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-00aa46ba-aa61-42e7-9c92-ccbed140b189 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: e13ba2a1-731c-4fc7-b8d2-db3ce6199eb6] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:23:04.444086 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-00aa46ba-aa61-42e7-9c92-ccbed140b189 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:04.445057 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-00aa46ba-aa61-42e7-9c92-ccbed140b189 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:04.446274 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-00aa46ba-aa61-42e7-9c92-ccbed140b189 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:04.447398 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-00aa46ba-aa61-42e7-9c92-ccbed140b189 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:04.448087 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-00aa46ba-aa61-42e7-9c92-ccbed140b189 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:04.448744 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-00aa46ba-aa61-42e7-9c92-ccbed140b189 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:04.543598 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-00aa46ba-aa61-42e7-9c92-ccbed140b189 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:23:04.567163 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-00aa46ba-aa61-42e7-9c92-ccbed140b189 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/e13ba2a1-731c-4fc7-b8d2-db3ce6199eb6" status: 200 len: 1266 microversion: 2.1 time: 0.134017 Oct 08 21:23:04.569739 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2727/5531] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:23:04 2022] GET /compute/v2.1/servers/e13ba2a1-731c-4fc7-b8d2-db3ce6199eb6 => generated 1266 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:23:05.592886 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-824fcc74-74a6-48f7-828f-517838d55250 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:23:05.594665 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-824fcc74-74a6-48f7-828f-517838d55250 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: e13ba2a1-731c-4fc7-b8d2-db3ce6199eb6] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:23:05.606844 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-824fcc74-74a6-48f7-828f-517838d55250 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:05.607546 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-824fcc74-74a6-48f7-828f-517838d55250 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:05.608090 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-824fcc74-74a6-48f7-828f-517838d55250 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:05.608917 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-824fcc74-74a6-48f7-828f-517838d55250 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:05.609628 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-824fcc74-74a6-48f7-828f-517838d55250 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:05.610174 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-824fcc74-74a6-48f7-828f-517838d55250 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:05.710551 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-824fcc74-74a6-48f7-828f-517838d55250 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:23:05.720563 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-824fcc74-74a6-48f7-828f-517838d55250 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/e13ba2a1-731c-4fc7-b8d2-db3ce6199eb6" status: 200 len: 1272 microversion: 2.1 time: 0.134234 Oct 08 21:23:05.736756 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2805/5532] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:23:05 2022] GET /compute/v2.1/servers/e13ba2a1-731c-4fc7-b8d2-db3ce6199eb6 => generated 1272 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:23:06.744271 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-174df4a7-262d-4254-8899-394a954e5889 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:23:06.745141 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-174df4a7-262d-4254-8899-394a954e5889 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: e13ba2a1-731c-4fc7-b8d2-db3ce6199eb6] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:23:06.752774 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-174df4a7-262d-4254-8899-394a954e5889 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:06.753424 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-174df4a7-262d-4254-8899-394a954e5889 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:06.754351 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-174df4a7-262d-4254-8899-394a954e5889 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:06.755160 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-174df4a7-262d-4254-8899-394a954e5889 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:06.755862 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-174df4a7-262d-4254-8899-394a954e5889 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:06.756385 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-174df4a7-262d-4254-8899-394a954e5889 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:06.908523 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-174df4a7-262d-4254-8899-394a954e5889 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:23:06.923328 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-174df4a7-262d-4254-8899-394a954e5889 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/e13ba2a1-731c-4fc7-b8d2-db3ce6199eb6" status: 200 len: 1314 microversion: 2.1 time: 0.183080 Oct 08 21:23:06.928289 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2728/5533] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:23:06 2022] GET /compute/v2.1/servers/e13ba2a1-731c-4fc7-b8d2-db3ce6199eb6 => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:23:07.906311 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-ec9905ab-932d-4608-a9dc-8c34ded089c7 req-a826cc9c-d3f0-4663-abf7-a4cb6aca222d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e13ba2a1-731c-4fc7-b8d2-db3ce6199eb6", "tag": "25d82e2d-1449-4722-9702-e6ba8fcc3322"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:23:07.919558 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-ec9905ab-932d-4608-a9dc-8c34ded089c7 req-a826cc9c-d3f0-4663-abf7-a4cb6aca222d service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:07.920919 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-ec9905ab-932d-4608-a9dc-8c34ded089c7 req-a826cc9c-d3f0-4663-abf7-a4cb6aca222d service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:07.921434 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-ec9905ab-932d-4608-a9dc-8c34ded089c7 req-a826cc9c-d3f0-4663-abf7-a4cb6aca222d service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:07.950382 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-f4cdd66a-d7e2-4d74-a48e-ea343d065a7d tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:23:07.950997 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-f4cdd66a-d7e2-4d74-a48e-ea343d065a7d tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: e13ba2a1-731c-4fc7-b8d2-db3ce6199eb6] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:23:07.955229 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-ec9905ab-932d-4608-a9dc-8c34ded089c7 req-a826cc9c-d3f0-4663-abf7-a4cb6aca222d service nova] Creating event network-changed:25d82e2d-1449-4722-9702-e6ba8fcc3322 for instance e13ba2a1-731c-4fc7-b8d2-db3ce6199eb6 on nch2-master-1 Oct 08 21:23:07.961832 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-ec9905ab-932d-4608-a9dc-8c34ded089c7 req-a826cc9c-d3f0-4663-abf7-a4cb6aca222d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060887 Oct 08 21:23:07.963081 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2806/5534] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:23:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:23:07.967665 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f4cdd66a-d7e2-4d74-a48e-ea343d065a7d tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:07.968163 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f4cdd66a-d7e2-4d74-a48e-ea343d065a7d tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:07.968613 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f4cdd66a-d7e2-4d74-a48e-ea343d065a7d tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:07.969363 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f4cdd66a-d7e2-4d74-a48e-ea343d065a7d tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:07.969823 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f4cdd66a-d7e2-4d74-a48e-ea343d065a7d tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:07.970252 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f4cdd66a-d7e2-4d74-a48e-ea343d065a7d tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:08.204483 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-f4cdd66a-d7e2-4d74-a48e-ea343d065a7d tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:23:08.219749 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-f4cdd66a-d7e2-4d74-a48e-ea343d065a7d tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/e13ba2a1-731c-4fc7-b8d2-db3ce6199eb6" status: 200 len: 1314 microversion: 2.1 time: 0.273749 Oct 08 21:23:08.230944 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2729/5535] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:23:07 2022] GET /compute/v2.1/servers/e13ba2a1-731c-4fc7-b8d2-db3ce6199eb6 => generated 1314 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:23:09.250820 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-0ed32ee5-cb09-40a3-94bc-f400668b7a74 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:23:09.251595 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-0ed32ee5-cb09-40a3-94bc-f400668b7a74 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: e13ba2a1-731c-4fc7-b8d2-db3ce6199eb6] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:23:09.259599 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0ed32ee5-cb09-40a3-94bc-f400668b7a74 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:09.260397 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0ed32ee5-cb09-40a3-94bc-f400668b7a74 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:09.261046 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0ed32ee5-cb09-40a3-94bc-f400668b7a74 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:09.262217 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0ed32ee5-cb09-40a3-94bc-f400668b7a74 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:09.262919 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0ed32ee5-cb09-40a3-94bc-f400668b7a74 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:09.263604 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0ed32ee5-cb09-40a3-94bc-f400668b7a74 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:09.497142 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-0ed32ee5-cb09-40a3-94bc-f400668b7a74 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:23:09.511699 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-0ed32ee5-cb09-40a3-94bc-f400668b7a74 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/e13ba2a1-731c-4fc7-b8d2-db3ce6199eb6" status: 200 len: 1314 microversion: 2.1 time: 0.266827 Oct 08 21:23:09.512673 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2807/5536] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:23:09 2022] GET /compute/v2.1/servers/e13ba2a1-731c-4fc7-b8d2-db3ce6199eb6 => generated 1314 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:23:10.538319 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-bc5e21fd-7939-4289-98e0-480438bf6bd9 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:23:10.538926 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-bc5e21fd-7939-4289-98e0-480438bf6bd9 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: e13ba2a1-731c-4fc7-b8d2-db3ce6199eb6] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:23:10.554369 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bc5e21fd-7939-4289-98e0-480438bf6bd9 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:10.555407 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bc5e21fd-7939-4289-98e0-480438bf6bd9 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:10.556141 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bc5e21fd-7939-4289-98e0-480438bf6bd9 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:10.558884 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bc5e21fd-7939-4289-98e0-480438bf6bd9 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:10.559437 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bc5e21fd-7939-4289-98e0-480438bf6bd9 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:10.564271 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bc5e21fd-7939-4289-98e0-480438bf6bd9 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:10.812750 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-bc5e21fd-7939-4289-98e0-480438bf6bd9 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:23:10.837940 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-bc5e21fd-7939-4289-98e0-480438bf6bd9 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/e13ba2a1-731c-4fc7-b8d2-db3ce6199eb6" status: 200 len: 1314 microversion: 2.1 time: 0.298655 Oct 08 21:23:10.846976 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2730/5537] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:23:10 2022] GET /compute/v2.1/servers/e13ba2a1-731c-4fc7-b8d2-db3ce6199eb6 => generated 1314 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:23:11.863104 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-c718013d-ca15-4e3c-9abc-f7e8e43828a8 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:23:11.864887 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-c718013d-ca15-4e3c-9abc-f7e8e43828a8 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: e13ba2a1-731c-4fc7-b8d2-db3ce6199eb6] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:23:11.875463 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=51 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:23:11.879163 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c718013d-ca15-4e3c-9abc-f7e8e43828a8 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:11.879958 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c718013d-ca15-4e3c-9abc-f7e8e43828a8 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:11.881241 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c718013d-ca15-4e3c-9abc-f7e8e43828a8 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:11.882219 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c718013d-ca15-4e3c-9abc-f7e8e43828a8 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:11.883134 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c718013d-ca15-4e3c-9abc-f7e8e43828a8 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:11.883830 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c718013d-ca15-4e3c-9abc-f7e8e43828a8 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:12.119865 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-c718013d-ca15-4e3c-9abc-f7e8e43828a8 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:23:12.129832 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-c718013d-ca15-4e3c-9abc-f7e8e43828a8 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/e13ba2a1-731c-4fc7-b8d2-db3ce6199eb6" status: 200 len: 1314 microversion: 2.1 time: 0.271639 Oct 08 21:23:12.131174 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2808/5538] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:23:11 2022] GET /compute/v2.1/servers/e13ba2a1-731c-4fc7-b8d2-db3ce6199eb6 => generated 1314 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:23:13.154059 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-94f6f424-315a-47d5-a0b1-a4c9f3f8ba68 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:23:13.154932 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-94f6f424-315a-47d5-a0b1-a4c9f3f8ba68 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: e13ba2a1-731c-4fc7-b8d2-db3ce6199eb6] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:23:13.162115 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=2 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:23:13.163879 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-94f6f424-315a-47d5-a0b1-a4c9f3f8ba68 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:13.164815 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-94f6f424-315a-47d5-a0b1-a4c9f3f8ba68 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:13.165461 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-94f6f424-315a-47d5-a0b1-a4c9f3f8ba68 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:13.166475 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-94f6f424-315a-47d5-a0b1-a4c9f3f8ba68 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:13.167041 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-94f6f424-315a-47d5-a0b1-a4c9f3f8ba68 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:13.167904 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-94f6f424-315a-47d5-a0b1-a4c9f3f8ba68 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:13.169059 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=6 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:23:13.487057 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-94f6f424-315a-47d5-a0b1-a4c9f3f8ba68 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:23:13.499352 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-94f6f424-315a-47d5-a0b1-a4c9f3f8ba68 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/e13ba2a1-731c-4fc7-b8d2-db3ce6199eb6" status: 200 len: 1314 microversion: 2.1 time: 0.349315 Oct 08 21:23:13.500372 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2731/5539] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:23:13 2022] GET /compute/v2.1/servers/e13ba2a1-731c-4fc7-b8d2-db3ce6199eb6 => generated 1314 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:23:14.328489 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-ef4e2efc-118e-4892-9cb4-78c9775b5e05 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Action: 'create', calling method: .version_select at 0x7f1a8746f4c0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-60361384", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFkQz1f1qZfaMGwyjZ1BKESaVmyN+WRWaXyPO7X4Z9/1XdnkI8gnmVb6FlAa6SZfIALt4y9JrQEISgEgJ5IvPJzsA7kPZ7LSx0dKUsqAWuAzUlETTaRq0hNj/aEvEa/9pQ=="}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:23:14.335292 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=2 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:23:14.348723 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-ef4e2efc-118e-4892-9cb4-78c9775b5e05 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Getting quotas for project 9b37e8634ac448ea9a86aff144098dd4. Resources: {'key_pairs'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:23:14.356181 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-ef4e2efc-118e-4892-9cb4-78c9775b5e05 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Getting quotas for user e28f7acd53094828a7863ce2fd775cdf and project 9b37e8634ac448ea9a86aff144098dd4. Resources: {'key_pairs'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:23:14.392610 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-ef4e2efc-118e-4892-9cb4-78c9775b5e05 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.068268 Oct 08 21:23:14.393599 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2809/5540] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Oct 8 21:23:14 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:23:14.526824 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-601de010-d41d-44de-8c0a-449a7241ac7d tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:23:14.528850 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-601de010-d41d-44de-8c0a-449a7241ac7d tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: e13ba2a1-731c-4fc7-b8d2-db3ce6199eb6] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:23:14.541989 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-601de010-d41d-44de-8c0a-449a7241ac7d tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:14.543037 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-601de010-d41d-44de-8c0a-449a7241ac7d tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:14.544086 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-601de010-d41d-44de-8c0a-449a7241ac7d tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:14.545475 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-601de010-d41d-44de-8c0a-449a7241ac7d tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:14.546273 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-601de010-d41d-44de-8c0a-449a7241ac7d tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:14.546935 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-601de010-d41d-44de-8c0a-449a7241ac7d tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:14.887487 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-601de010-d41d-44de-8c0a-449a7241ac7d tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:23:14.896381 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-601de010-d41d-44de-8c0a-449a7241ac7d tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/e13ba2a1-731c-4fc7-b8d2-db3ce6199eb6" status: 200 len: 1314 microversion: 2.1 time: 0.376206 Oct 08 21:23:14.920337 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2732/5541] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:23:14 2022] GET /compute/v2.1/servers/e13ba2a1-731c-4fc7-b8d2-db3ce6199eb6 => generated 1314 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:23:15.256595 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-cce396aa-f58d-4c04-948e-3579fb38acd1 req-6488e53c-e4be-4340-b31b-59eaf57e77fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e13ba2a1-731c-4fc7-b8d2-db3ce6199eb6", "name": "network-vif-plugged", "status": "completed", "tag": "25d82e2d-1449-4722-9702-e6ba8fcc3322"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:23:15.277564 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-cce396aa-f58d-4c04-948e-3579fb38acd1 req-6488e53c-e4be-4340-b31b-59eaf57e77fd service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:15.278729 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-cce396aa-f58d-4c04-948e-3579fb38acd1 req-6488e53c-e4be-4340-b31b-59eaf57e77fd service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:15.279196 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-cce396aa-f58d-4c04-948e-3579fb38acd1 req-6488e53c-e4be-4340-b31b-59eaf57e77fd service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:15.298220 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-cce396aa-f58d-4c04-948e-3579fb38acd1 req-6488e53c-e4be-4340-b31b-59eaf57e77fd service nova] Creating event network-vif-plugged:25d82e2d-1449-4722-9702-e6ba8fcc3322 for instance e13ba2a1-731c-4fc7-b8d2-db3ce6199eb6 on nch2-master-1 Oct 08 21:23:15.306920 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-cce396aa-f58d-4c04-948e-3579fb38acd1 req-6488e53c-e4be-4340-b31b-59eaf57e77fd service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055040 Oct 08 21:23:15.307842 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2810/5542] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:23:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:23:15.921753 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-72e40e48-6fb4-48a7-9f09-b7ada9141f45 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:23:15.922497 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-72e40e48-6fb4-48a7-9f09-b7ada9141f45 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: e13ba2a1-731c-4fc7-b8d2-db3ce6199eb6] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:23:15.936926 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-72e40e48-6fb4-48a7-9f09-b7ada9141f45 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:15.938610 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-72e40e48-6fb4-48a7-9f09-b7ada9141f45 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:15.942537 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-72e40e48-6fb4-48a7-9f09-b7ada9141f45 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:15.943638 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-72e40e48-6fb4-48a7-9f09-b7ada9141f45 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:15.950819 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-72e40e48-6fb4-48a7-9f09-b7ada9141f45 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:15.951710 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-72e40e48-6fb4-48a7-9f09-b7ada9141f45 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:16.653540 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-72e40e48-6fb4-48a7-9f09-b7ada9141f45 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:23:16.662549 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-72e40e48-6fb4-48a7-9f09-b7ada9141f45 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/e13ba2a1-731c-4fc7-b8d2-db3ce6199eb6" status: 200 len: 1314 microversion: 2.1 time: 0.745939 Oct 08 21:23:16.663826 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2733/5543] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:23:15 2022] GET /compute/v2.1/servers/e13ba2a1-731c-4fc7-b8d2-db3ce6199eb6 => generated 1314 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:23:17.263472 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-802c2ac7-89b3-4ed1-a6b0-3c89db07f7df tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1370635651", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "networks": [{"uuid": "81e4af7a-1855-4941-90cf-cc53861bdb51"}], "key_name": "tempest-TestNetworkBasicOps-60361384", "security_groups": [{"name": "tempest-secgroup-smoke-1694915012"}]}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:23:17.390641 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.network.neutron [None req-802c2ac7-89b3-4ed1-a6b0-3c89db07f7df tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] validate_networks() for [('81e4af7a-1855-4941-90cf-cc53861bdb51', None, None, None, None, None)] {{(pid=140492) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 21:23:17.686681 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-7ace453a-cdfd-4ba8-b536-d054df263765 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:23:17.687894 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-7ace453a-cdfd-4ba8-b536-d054df263765 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: e13ba2a1-731c-4fc7-b8d2-db3ce6199eb6] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:23:17.702938 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7ace453a-cdfd-4ba8-b536-d054df263765 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:17.703261 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7ace453a-cdfd-4ba8-b536-d054df263765 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:17.703723 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7ace453a-cdfd-4ba8-b536-d054df263765 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:17.704453 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7ace453a-cdfd-4ba8-b536-d054df263765 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:17.708213 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7ace453a-cdfd-4ba8-b536-d054df263765 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:17.708981 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7ace453a-cdfd-4ba8-b536-d054df263765 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:17.937168 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-802c2ac7-89b3-4ed1-a6b0-3c89db07f7df tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Flavor limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 21:23:17.949671 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-802c2ac7-89b3-4ed1-a6b0-3c89db07f7df tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Image limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 21:23:17.950445 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-802c2ac7-89b3-4ed1-a6b0-3c89db07f7df tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Flavor pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 21:23:17.952334 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-802c2ac7-89b3-4ed1-a6b0-3c89db07f7df tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Image pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 21:23:17.952798 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-802c2ac7-89b3-4ed1-a6b0-3c89db07f7df tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 21:23:17.970188 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-802c2ac7-89b3-4ed1-a6b0-3c89db07f7df tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:17.970961 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-802c2ac7-89b3-4ed1-a6b0-3c89db07f7df tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:17.971593 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-802c2ac7-89b3-4ed1-a6b0-3c89db07f7df tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:17.972494 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-802c2ac7-89b3-4ed1-a6b0-3c89db07f7df tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:17.973137 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-802c2ac7-89b3-4ed1-a6b0-3c89db07f7df tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:17.973767 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-802c2ac7-89b3-4ed1-a6b0-3c89db07f7df tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:18.014060 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-802c2ac7-89b3-4ed1-a6b0-3c89db07f7df tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Getting quotas for project 9b37e8634ac448ea9a86aff144098dd4. Resources: {'cores', 'instances', 'ram'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:23:18.029678 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-7ace453a-cdfd-4ba8-b536-d054df263765 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:23:18.037505 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-802c2ac7-89b3-4ed1-a6b0-3c89db07f7df tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Getting quotas for user e28f7acd53094828a7863ce2fd775cdf and project 9b37e8634ac448ea9a86aff144098dd4. Resources: {'cores', 'instances', 'ram'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:23:18.048715 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-7ace453a-cdfd-4ba8-b536-d054df263765 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/e13ba2a1-731c-4fc7-b8d2-db3ce6199eb6" status: 200 len: 1500 microversion: 2.1 time: 0.365766 Oct 08 21:23:18.056916 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2734/5544] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:23:17 2022] GET /compute/v2.1/servers/e13ba2a1-731c-4fc7-b8d2-db3ce6199eb6 => generated 1500 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:23:18.059651 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-802c2ac7-89b3-4ed1-a6b0-3c89db07f7df tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Going to run 1 instances... {{(pid=140492) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 21:23:18.062426 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-802c2ac7-89b3-4ed1-a6b0-3c89db07f7df tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] [instance: 3395e57f-ceb7-4984-940c-d9ee3c93b370] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c508bd7f-7db9-4b2c-af7c-be54a855c355',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140492) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 21:23:18.084705 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-ab1720a1-02e9-420f-ab02-9525564a6de3 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:23:18.085640 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-ab1720a1-02e9-420f-ab02-9525564a6de3 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: e13ba2a1-731c-4fc7-b8d2-db3ce6199eb6] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:23:18.097775 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ab1720a1-02e9-420f-ab02-9525564a6de3 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:18.100088 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ab1720a1-02e9-420f-ab02-9525564a6de3 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:18.101431 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ab1720a1-02e9-420f-ab02-9525564a6de3 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:18.108212 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ab1720a1-02e9-420f-ab02-9525564a6de3 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:18.108759 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ab1720a1-02e9-420f-ab02-9525564a6de3 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:18.109230 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ab1720a1-02e9-420f-ab02-9525564a6de3 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:18.128078 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-802c2ac7-89b3-4ed1-a6b0-3c89db07f7df tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.871702 Oct 08 21:23:18.129469 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2811/5545] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 21:23:17 2022] POST /compute/v2.1/servers => generated 406 bytes in 874 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 08 21:23:18.142978 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-51ae446a-7fb5-46ab-9fbf-a6a8416a3077 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:23:18.144402 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-51ae446a-7fb5-46ab-9fbf-a6a8416a3077 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] [instance: 3395e57f-ceb7-4984-940c-d9ee3c93b370] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:23:18.254684 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-51ae446a-7fb5-46ab-9fbf-a6a8416a3077 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e28f7acd53094828a7863ce2fd775cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b37e8634ac448ea9a86aff144098dd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:23:18.259306 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-ab1720a1-02e9-420f-ab02-9525564a6de3 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "POST /compute/v2.1/servers/e13ba2a1-731c-4fc7-b8d2-db3ce6199eb6/action" status: 202 len: 0 microversion: 2.1 time: 0.178960 Oct 08 21:23:18.261105 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2735/5546] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:23:18 2022] POST /compute/v2.1/servers/e13ba2a1-731c-4fc7-b8d2-db3ce6199eb6/action => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 21:23:18.267469 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-51ae446a-7fb5-46ab-9fbf-a6a8416a3077 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] 10.222.0.26 "GET /compute/v2.1/servers/3395e57f-ceb7-4984-940c-d9ee3c93b370" status: 200 len: 1247 microversion: 2.1 time: 0.129465 Oct 08 21:23:18.279828 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2812/5547] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:23:18 2022] GET /compute/v2.1/servers/3395e57f-ceb7-4984-940c-d9ee3c93b370 => generated 1247 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:23:18.286313 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-50149044-c0a6-42a3-ac64-3b00e20d9859 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:23:18.287170 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-50149044-c0a6-42a3-ac64-3b00e20d9859 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: e13ba2a1-731c-4fc7-b8d2-db3ce6199eb6] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:23:18.296091 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-50149044-c0a6-42a3-ac64-3b00e20d9859 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:18.296821 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-50149044-c0a6-42a3-ac64-3b00e20d9859 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:18.297507 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-50149044-c0a6-42a3-ac64-3b00e20d9859 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:18.298422 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-50149044-c0a6-42a3-ac64-3b00e20d9859 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:18.298949 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-50149044-c0a6-42a3-ac64-3b00e20d9859 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:18.299645 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-50149044-c0a6-42a3-ac64-3b00e20d9859 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:18.560938 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-50149044-c0a6-42a3-ac64-3b00e20d9859 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:23:18.575022 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-50149044-c0a6-42a3-ac64-3b00e20d9859 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/e13ba2a1-731c-4fc7-b8d2-db3ce6199eb6" status: 200 len: 1505 microversion: 2.1 time: 0.298487 Oct 08 21:23:18.585375 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2736/5548] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:23:18 2022] GET /compute/v2.1/servers/e13ba2a1-731c-4fc7-b8d2-db3ce6199eb6 => generated 1505 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:23:19.292670 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-fd5b1d8e-d24e-4132-ad3e-3954ab257311 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:23:19.293367 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-fd5b1d8e-d24e-4132-ad3e-3954ab257311 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] [instance: 3395e57f-ceb7-4984-940c-d9ee3c93b370] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:23:19.304198 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fd5b1d8e-d24e-4132-ad3e-3954ab257311 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:19.305442 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fd5b1d8e-d24e-4132-ad3e-3954ab257311 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:19.305892 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fd5b1d8e-d24e-4132-ad3e-3954ab257311 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:19.306818 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fd5b1d8e-d24e-4132-ad3e-3954ab257311 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:19.307164 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fd5b1d8e-d24e-4132-ad3e-3954ab257311 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:19.307545 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fd5b1d8e-d24e-4132-ad3e-3954ab257311 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:19.384362 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-fd5b1d8e-d24e-4132-ad3e-3954ab257311 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e28f7acd53094828a7863ce2fd775cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b37e8634ac448ea9a86aff144098dd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:23:19.394459 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-fd5b1d8e-d24e-4132-ad3e-3954ab257311 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] 10.222.0.26 "GET /compute/v2.1/servers/3395e57f-ceb7-4984-940c-d9ee3c93b370" status: 200 len: 1299 microversion: 2.1 time: 0.106303 Oct 08 21:23:19.395248 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2813/5549] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:23:19 2022] GET /compute/v2.1/servers/3395e57f-ceb7-4984-940c-d9ee3c93b370 => generated 1299 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:23:19.599201 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-ca6cbfa3-cc81-4d0a-aac6-4400bf2e9f53 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:23:19.599815 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-ca6cbfa3-cc81-4d0a-aac6-4400bf2e9f53 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: e13ba2a1-731c-4fc7-b8d2-db3ce6199eb6] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:23:19.608262 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ca6cbfa3-cc81-4d0a-aac6-4400bf2e9f53 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:19.611894 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ca6cbfa3-cc81-4d0a-aac6-4400bf2e9f53 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:19.612571 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ca6cbfa3-cc81-4d0a-aac6-4400bf2e9f53 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:19.614180 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ca6cbfa3-cc81-4d0a-aac6-4400bf2e9f53 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:19.615058 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ca6cbfa3-cc81-4d0a-aac6-4400bf2e9f53 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:19.615622 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ca6cbfa3-cc81-4d0a-aac6-4400bf2e9f53 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:19.784566 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-ca6cbfa3-cc81-4d0a-aac6-4400bf2e9f53 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:23:19.793139 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-ca6cbfa3-cc81-4d0a-aac6-4400bf2e9f53 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/e13ba2a1-731c-4fc7-b8d2-db3ce6199eb6" status: 200 len: 1485 microversion: 2.1 time: 0.197909 Oct 08 21:23:19.793751 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2737/5550] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:23:19 2022] GET /compute/v2.1/servers/e13ba2a1-731c-4fc7-b8d2-db3ce6199eb6 => generated 1485 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:23:19.815489 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-49929576-c093-4711-a05c-8e7837cd1a17 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:23:19.816345 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-49929576-c093-4711-a05c-8e7837cd1a17 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: e13ba2a1-731c-4fc7-b8d2-db3ce6199eb6] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:23:19.822451 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-49929576-c093-4711-a05c-8e7837cd1a17 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:19.822949 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-49929576-c093-4711-a05c-8e7837cd1a17 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:19.823392 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-49929576-c093-4711-a05c-8e7837cd1a17 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:19.824102 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-49929576-c093-4711-a05c-8e7837cd1a17 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:19.824565 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-49929576-c093-4711-a05c-8e7837cd1a17 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:19.824997 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-49929576-c093-4711-a05c-8e7837cd1a17 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:19.849742 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.objects.instance [None req-49929576-c093-4711-a05c-8e7837cd1a17 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lazy-loading 'flavor' on Instance uuid e13ba2a1-731c-4fc7-b8d2-db3ce6199eb6 {{(pid=140492) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 21:23:20.074927 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-49929576-c093-4711-a05c-8e7837cd1a17 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "POST /compute/v2.1/servers/e13ba2a1-731c-4fc7-b8d2-db3ce6199eb6/action" status: 202 len: 0 microversion: 2.1 time: 0.263235 Oct 08 21:23:20.075547 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2814/5551] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:23:19 2022] POST /compute/v2.1/servers/e13ba2a1-731c-4fc7-b8d2-db3ce6199eb6/action => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 21:23:20.083958 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-613ed165-726c-448c-830d-fd89419da5b6 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:23:20.084580 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-613ed165-726c-448c-830d-fd89419da5b6 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: e13ba2a1-731c-4fc7-b8d2-db3ce6199eb6] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:23:20.091437 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-613ed165-726c-448c-830d-fd89419da5b6 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:20.092185 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-613ed165-726c-448c-830d-fd89419da5b6 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:20.092641 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-613ed165-726c-448c-830d-fd89419da5b6 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:20.093406 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-613ed165-726c-448c-830d-fd89419da5b6 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:20.093891 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-613ed165-726c-448c-830d-fd89419da5b6 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:20.094334 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-613ed165-726c-448c-830d-fd89419da5b6 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:20.246358 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-613ed165-726c-448c-830d-fd89419da5b6 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:23:20.249020 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:23:20.276080 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-613ed165-726c-448c-830d-fd89419da5b6 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/e13ba2a1-731c-4fc7-b8d2-db3ce6199eb6" status: 200 len: 1491 microversion: 2.1 time: 0.196060 Oct 08 21:23:20.276916 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2738/5552] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:23:20 2022] GET /compute/v2.1/servers/e13ba2a1-731c-4fc7-b8d2-db3ce6199eb6 => generated 1491 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:23:20.419796 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-c83cb326-a129-4123-adaf-2371ceeb7efe tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:23:20.421219 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-c83cb326-a129-4123-adaf-2371ceeb7efe tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] [instance: 3395e57f-ceb7-4984-940c-d9ee3c93b370] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:23:20.431985 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c83cb326-a129-4123-adaf-2371ceeb7efe tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:20.433145 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c83cb326-a129-4123-adaf-2371ceeb7efe tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:20.433869 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c83cb326-a129-4123-adaf-2371ceeb7efe tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:20.434867 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c83cb326-a129-4123-adaf-2371ceeb7efe tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:20.435596 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c83cb326-a129-4123-adaf-2371ceeb7efe tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:20.436284 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c83cb326-a129-4123-adaf-2371ceeb7efe tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:20.538320 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-c83cb326-a129-4123-adaf-2371ceeb7efe tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e28f7acd53094828a7863ce2fd775cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b37e8634ac448ea9a86aff144098dd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:23:20.547648 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:23:20.558016 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-c83cb326-a129-4123-adaf-2371ceeb7efe tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] 10.222.0.26 "GET /compute/v2.1/servers/3395e57f-ceb7-4984-940c-d9ee3c93b370" status: 200 len: 1305 microversion: 2.1 time: 0.143521 Oct 08 21:23:20.569115 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2815/5553] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:23:20 2022] GET /compute/v2.1/servers/3395e57f-ceb7-4984-940c-d9ee3c93b370 => generated 1305 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:23:21.304283 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-a1a6d8b7-f0b0-4642-863d-606857744022 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:23:21.305688 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-a1a6d8b7-f0b0-4642-863d-606857744022 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: e13ba2a1-731c-4fc7-b8d2-db3ce6199eb6] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:23:21.316165 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a1a6d8b7-f0b0-4642-863d-606857744022 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:21.316677 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a1a6d8b7-f0b0-4642-863d-606857744022 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:21.318572 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a1a6d8b7-f0b0-4642-863d-606857744022 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:21.320289 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a1a6d8b7-f0b0-4642-863d-606857744022 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:21.321541 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a1a6d8b7-f0b0-4642-863d-606857744022 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:21.322217 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a1a6d8b7-f0b0-4642-863d-606857744022 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:21.585947 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-f9dae3c8-6875-4d5e-940f-0e88005f0255 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:23:21.586898 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-f9dae3c8-6875-4d5e-940f-0e88005f0255 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] [instance: 3395e57f-ceb7-4984-940c-d9ee3c93b370] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:23:21.607011 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f9dae3c8-6875-4d5e-940f-0e88005f0255 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:21.610065 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f9dae3c8-6875-4d5e-940f-0e88005f0255 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:21.610763 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f9dae3c8-6875-4d5e-940f-0e88005f0255 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:21.611749 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f9dae3c8-6875-4d5e-940f-0e88005f0255 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:21.612717 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f9dae3c8-6875-4d5e-940f-0e88005f0255 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:21.613631 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f9dae3c8-6875-4d5e-940f-0e88005f0255 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:21.636467 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-a1a6d8b7-f0b0-4642-863d-606857744022 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:23:21.652204 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-a1a6d8b7-f0b0-4642-863d-606857744022 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/e13ba2a1-731c-4fc7-b8d2-db3ce6199eb6" status: 200 len: 1512 microversion: 2.1 time: 0.351978 Oct 08 21:23:21.653467 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2739/5554] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:23:21 2022] GET /compute/v2.1/servers/e13ba2a1-731c-4fc7-b8d2-db3ce6199eb6 => generated 1512 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:23:21.803959 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-076bbc4f-042b-44cb-b816-bc17e3ecbb20 req-0d9075ba-a838-4dae-a20b-aeee80791e1f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3395e57f-ceb7-4984-940c-d9ee3c93b370", "tag": "acf8150a-ade0-4204-8e17-ea175dcb345a"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:23:21.827214 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-076bbc4f-042b-44cb-b816-bc17e3ecbb20 req-0d9075ba-a838-4dae-a20b-aeee80791e1f service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:21.827715 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-076bbc4f-042b-44cb-b816-bc17e3ecbb20 req-0d9075ba-a838-4dae-a20b-aeee80791e1f service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:21.828362 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-076bbc4f-042b-44cb-b816-bc17e3ecbb20 req-0d9075ba-a838-4dae-a20b-aeee80791e1f service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:21.843447 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-076bbc4f-042b-44cb-b816-bc17e3ecbb20 req-0d9075ba-a838-4dae-a20b-aeee80791e1f service nova] Creating event network-changed:acf8150a-ade0-4204-8e17-ea175dcb345a for instance 3395e57f-ceb7-4984-940c-d9ee3c93b370 on nch2-master-1 Oct 08 21:23:21.849278 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-076bbc4f-042b-44cb-b816-bc17e3ecbb20 req-0d9075ba-a838-4dae-a20b-aeee80791e1f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049322 Oct 08 21:23:21.850596 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2740/5555] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:23:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:23:21.910902 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-f9dae3c8-6875-4d5e-940f-0e88005f0255 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e28f7acd53094828a7863ce2fd775cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b37e8634ac448ea9a86aff144098dd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:23:21.930044 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-f9dae3c8-6875-4d5e-940f-0e88005f0255 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] 10.222.0.26 "GET /compute/v2.1/servers/3395e57f-ceb7-4984-940c-d9ee3c93b370" status: 200 len: 1373 microversion: 2.1 time: 0.349507 Oct 08 21:23:21.930967 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2816/5556] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:23:21 2022] GET /compute/v2.1/servers/3395e57f-ceb7-4984-940c-d9ee3c93b370 => generated 1373 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:23:22.677106 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-38a3414b-cce9-41f3-a5fa-7710a7e6785b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:23:22.678481 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-38a3414b-cce9-41f3-a5fa-7710a7e6785b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: e13ba2a1-731c-4fc7-b8d2-db3ce6199eb6] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:23:22.692125 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-38a3414b-cce9-41f3-a5fa-7710a7e6785b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:22.695524 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-38a3414b-cce9-41f3-a5fa-7710a7e6785b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:22.696061 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-38a3414b-cce9-41f3-a5fa-7710a7e6785b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:22.697010 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-38a3414b-cce9-41f3-a5fa-7710a7e6785b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:22.701084 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-38a3414b-cce9-41f3-a5fa-7710a7e6785b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:22.701807 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-38a3414b-cce9-41f3-a5fa-7710a7e6785b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:22.953822 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-0ff96991-2f06-428b-be00-71e95b9d988a tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:23:22.954631 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-0ff96991-2f06-428b-be00-71e95b9d988a tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] [instance: 3395e57f-ceb7-4984-940c-d9ee3c93b370] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:23:22.962436 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0ff96991-2f06-428b-be00-71e95b9d988a tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:22.962938 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0ff96991-2f06-428b-be00-71e95b9d988a tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:22.963390 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0ff96991-2f06-428b-be00-71e95b9d988a tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:22.964271 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0ff96991-2f06-428b-be00-71e95b9d988a tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:22.964794 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0ff96991-2f06-428b-be00-71e95b9d988a tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:22.965499 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0ff96991-2f06-428b-be00-71e95b9d988a tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:23.003090 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-38a3414b-cce9-41f3-a5fa-7710a7e6785b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:23:23.018195 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-38a3414b-cce9-41f3-a5fa-7710a7e6785b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/e13ba2a1-731c-4fc7-b8d2-db3ce6199eb6" status: 200 len: 1507 microversion: 2.1 time: 0.344640 Oct 08 21:23:23.019582 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2741/5557] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:23:22 2022] GET /compute/v2.1/servers/e13ba2a1-731c-4fc7-b8d2-db3ce6199eb6 => generated 1507 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:23:23.155771 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-0ff96991-2f06-428b-be00-71e95b9d988a tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e28f7acd53094828a7863ce2fd775cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b37e8634ac448ea9a86aff144098dd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:23:23.164624 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-0ff96991-2f06-428b-be00-71e95b9d988a tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] 10.222.0.26 "GET /compute/v2.1/servers/3395e57f-ceb7-4984-940c-d9ee3c93b370" status: 200 len: 1373 microversion: 2.1 time: 0.214442 Oct 08 21:23:23.166148 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2817/5558] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:23:22 2022] GET /compute/v2.1/servers/3395e57f-ceb7-4984-940c-d9ee3c93b370 => generated 1373 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:23:24.055116 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-7b57e553-e066-4ae8-b857-0779e4c3e80b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:23:24.057670 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-7b57e553-e066-4ae8-b857-0779e4c3e80b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: e13ba2a1-731c-4fc7-b8d2-db3ce6199eb6] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:23:24.089797 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7b57e553-e066-4ae8-b857-0779e4c3e80b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:24.091301 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7b57e553-e066-4ae8-b857-0779e4c3e80b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:24.092060 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7b57e553-e066-4ae8-b857-0779e4c3e80b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:24.093579 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7b57e553-e066-4ae8-b857-0779e4c3e80b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:24.094223 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7b57e553-e066-4ae8-b857-0779e4c3e80b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:24.095347 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7b57e553-e066-4ae8-b857-0779e4c3e80b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:24.189090 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-fb5900ee-0af5-437d-98ac-852225f488b7 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:23:24.190004 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-fb5900ee-0af5-437d-98ac-852225f488b7 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] [instance: 3395e57f-ceb7-4984-940c-d9ee3c93b370] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:23:24.203468 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fb5900ee-0af5-437d-98ac-852225f488b7 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:24.204385 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fb5900ee-0af5-437d-98ac-852225f488b7 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:24.205067 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fb5900ee-0af5-437d-98ac-852225f488b7 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:24.206095 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fb5900ee-0af5-437d-98ac-852225f488b7 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:24.206830 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fb5900ee-0af5-437d-98ac-852225f488b7 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:24.207493 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fb5900ee-0af5-437d-98ac-852225f488b7 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:24.429434 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-7b57e553-e066-4ae8-b857-0779e4c3e80b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:23:24.438574 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-7b57e553-e066-4ae8-b857-0779e4c3e80b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/e13ba2a1-731c-4fc7-b8d2-db3ce6199eb6" status: 200 len: 1507 microversion: 2.1 time: 0.398756 Oct 08 21:23:24.438693 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2742/5559] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:23:24 2022] GET /compute/v2.1/servers/e13ba2a1-731c-4fc7-b8d2-db3ce6199eb6 => generated 1507 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:23:24.701321 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-fb5900ee-0af5-437d-98ac-852225f488b7 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e28f7acd53094828a7863ce2fd775cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b37e8634ac448ea9a86aff144098dd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:23:24.711825 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-fb5900ee-0af5-437d-98ac-852225f488b7 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] 10.222.0.26 "GET /compute/v2.1/servers/3395e57f-ceb7-4984-940c-d9ee3c93b370" status: 200 len: 1373 microversion: 2.1 time: 0.526038 Oct 08 21:23:24.726011 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2818/5560] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:23:24 2022] GET /compute/v2.1/servers/3395e57f-ceb7-4984-940c-d9ee3c93b370 => generated 1373 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:23:25.063873 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-bf4c653b-493a-4729-b4da-27e37c222730 req-c208b8f5-bf75-4102-ba44-7342b6da245a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e13ba2a1-731c-4fc7-b8d2-db3ce6199eb6", "name": "network-vif-plugged", "status": "completed", "tag": "25d82e2d-1449-4722-9702-e6ba8fcc3322"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:23:25.077506 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-bf4c653b-493a-4729-b4da-27e37c222730 req-c208b8f5-bf75-4102-ba44-7342b6da245a service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:25.079213 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-bf4c653b-493a-4729-b4da-27e37c222730 req-c208b8f5-bf75-4102-ba44-7342b6da245a service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:25.079510 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-bf4c653b-493a-4729-b4da-27e37c222730 req-c208b8f5-bf75-4102-ba44-7342b6da245a service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:25.099931 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-bf4c653b-493a-4729-b4da-27e37c222730 req-c208b8f5-bf75-4102-ba44-7342b6da245a service nova] Creating event network-vif-plugged:25d82e2d-1449-4722-9702-e6ba8fcc3322 for instance e13ba2a1-731c-4fc7-b8d2-db3ce6199eb6 on nch2-master-1 Oct 08 21:23:25.109883 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-bf4c653b-493a-4729-b4da-27e37c222730 req-c208b8f5-bf75-4102-ba44-7342b6da245a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.281775 Oct 08 21:23:25.112977 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2743/5561] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:23:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:23:25.521079 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-1da3d3ad-975d-482a-b2c7-a26ac736da9b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:23:25.522502 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-1da3d3ad-975d-482a-b2c7-a26ac736da9b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: e13ba2a1-731c-4fc7-b8d2-db3ce6199eb6] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:23:25.537791 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1da3d3ad-975d-482a-b2c7-a26ac736da9b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:25.538636 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1da3d3ad-975d-482a-b2c7-a26ac736da9b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:25.539824 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1da3d3ad-975d-482a-b2c7-a26ac736da9b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:25.540593 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1da3d3ad-975d-482a-b2c7-a26ac736da9b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:25.541077 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1da3d3ad-975d-482a-b2c7-a26ac736da9b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:25.546386 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1da3d3ad-975d-482a-b2c7-a26ac736da9b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:25.741786 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-1da3d3ad-975d-482a-b2c7-a26ac736da9b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:23:25.751313 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c327e857-c256-4fb8-accc-5bb95be55fbb tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:23:25.751757 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-1da3d3ad-975d-482a-b2c7-a26ac736da9b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/e13ba2a1-731c-4fc7-b8d2-db3ce6199eb6" status: 200 len: 1507 microversion: 2.1 time: 0.244316 Oct 08 21:23:25.752444 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-c327e857-c256-4fb8-accc-5bb95be55fbb tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] [instance: 3395e57f-ceb7-4984-940c-d9ee3c93b370] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:23:25.768788 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2819/5562] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:23:25 2022] GET /compute/v2.1/servers/e13ba2a1-731c-4fc7-b8d2-db3ce6199eb6 => generated 1507 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:23:25.778274 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c327e857-c256-4fb8-accc-5bb95be55fbb tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:25.780498 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c327e857-c256-4fb8-accc-5bb95be55fbb tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:25.781727 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c327e857-c256-4fb8-accc-5bb95be55fbb tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:25.782670 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c327e857-c256-4fb8-accc-5bb95be55fbb tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:25.783312 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c327e857-c256-4fb8-accc-5bb95be55fbb tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:25.783939 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c327e857-c256-4fb8-accc-5bb95be55fbb tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:26.020327 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-c327e857-c256-4fb8-accc-5bb95be55fbb tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e28f7acd53094828a7863ce2fd775cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b37e8634ac448ea9a86aff144098dd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:23:26.029894 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-c327e857-c256-4fb8-accc-5bb95be55fbb tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] 10.222.0.26 "GET /compute/v2.1/servers/3395e57f-ceb7-4984-940c-d9ee3c93b370" status: 200 len: 1373 microversion: 2.1 time: 0.284250 Oct 08 21:23:26.031309 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2744/5563] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:23:25 2022] GET /compute/v2.1/servers/3395e57f-ceb7-4984-940c-d9ee3c93b370 => generated 1373 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:23:26.776814 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-90ef6bf5-78eb-4226-8b17-3f4b037a9720 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:23:26.779002 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-90ef6bf5-78eb-4226-8b17-3f4b037a9720 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: e13ba2a1-731c-4fc7-b8d2-db3ce6199eb6] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:23:26.787579 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-90ef6bf5-78eb-4226-8b17-3f4b037a9720 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:26.788462 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-90ef6bf5-78eb-4226-8b17-3f4b037a9720 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:26.789171 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-90ef6bf5-78eb-4226-8b17-3f4b037a9720 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:26.790127 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-90ef6bf5-78eb-4226-8b17-3f4b037a9720 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:26.790601 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-90ef6bf5-78eb-4226-8b17-3f4b037a9720 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:26.791233 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-90ef6bf5-78eb-4226-8b17-3f4b037a9720 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:27.055984 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-8df4775e-f397-4cee-9fed-73d88b9864d3 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:23:27.058467 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-8df4775e-f397-4cee-9fed-73d88b9864d3 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] [instance: 3395e57f-ceb7-4984-940c-d9ee3c93b370] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:23:27.063078 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-90ef6bf5-78eb-4226-8b17-3f4b037a9720 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:23:27.070484 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8df4775e-f397-4cee-9fed-73d88b9864d3 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:27.071381 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8df4775e-f397-4cee-9fed-73d88b9864d3 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:27.072202 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8df4775e-f397-4cee-9fed-73d88b9864d3 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:27.073141 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8df4775e-f397-4cee-9fed-73d88b9864d3 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:27.073860 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8df4775e-f397-4cee-9fed-73d88b9864d3 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:27.074767 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8df4775e-f397-4cee-9fed-73d88b9864d3 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:27.077121 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-90ef6bf5-78eb-4226-8b17-3f4b037a9720 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/e13ba2a1-731c-4fc7-b8d2-db3ce6199eb6" status: 200 len: 1507 microversion: 2.1 time: 0.304263 Oct 08 21:23:27.089242 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2820/5564] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:23:26 2022] GET /compute/v2.1/servers/e13ba2a1-731c-4fc7-b8d2-db3ce6199eb6 => generated 1507 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:23:27.156570 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-d53dd0c2-a06b-48d5-b9cf-d2248234a10f req-c2bf3448-d308-4304-888d-9e06ba109bbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3395e57f-ceb7-4984-940c-d9ee3c93b370", "name": "network-vif-plugged", "status": "completed", "tag": "acf8150a-ade0-4204-8e17-ea175dcb345a"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:23:27.184286 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-d53dd0c2-a06b-48d5-b9cf-d2248234a10f req-c2bf3448-d308-4304-888d-9e06ba109bbc service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:27.188611 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-d53dd0c2-a06b-48d5-b9cf-d2248234a10f req-c2bf3448-d308-4304-888d-9e06ba109bbc service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:27.192444 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-d53dd0c2-a06b-48d5-b9cf-d2248234a10f req-c2bf3448-d308-4304-888d-9e06ba109bbc service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:27.208775 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-d53dd0c2-a06b-48d5-b9cf-d2248234a10f req-c2bf3448-d308-4304-888d-9e06ba109bbc service nova] Creating event network-vif-plugged:acf8150a-ade0-4204-8e17-ea175dcb345a for instance 3395e57f-ceb7-4984-940c-d9ee3c93b370 on nch2-master-1 Oct 08 21:23:27.220336 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-d53dd0c2-a06b-48d5-b9cf-d2248234a10f req-c2bf3448-d308-4304-888d-9e06ba109bbc service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070562 Oct 08 21:23:27.221999 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2821/5565] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:23:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 08 21:23:27.296171 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-8df4775e-f397-4cee-9fed-73d88b9864d3 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e28f7acd53094828a7863ce2fd775cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b37e8634ac448ea9a86aff144098dd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:23:27.305525 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-8df4775e-f397-4cee-9fed-73d88b9864d3 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] 10.222.0.26 "GET /compute/v2.1/servers/3395e57f-ceb7-4984-940c-d9ee3c93b370" status: 200 len: 1373 microversion: 2.1 time: 0.254872 Oct 08 21:23:27.307507 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2745/5566] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:23:27 2022] GET /compute/v2.1/servers/3395e57f-ceb7-4984-940c-d9ee3c93b370 => generated 1373 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:23:28.111063 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-9f0501fb-04ac-40a6-9b06-9f1eb6d42691 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:23:28.111784 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-9f0501fb-04ac-40a6-9b06-9f1eb6d42691 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: e13ba2a1-731c-4fc7-b8d2-db3ce6199eb6] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:23:28.123666 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=2 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:23:28.128074 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9f0501fb-04ac-40a6-9b06-9f1eb6d42691 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:28.129836 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9f0501fb-04ac-40a6-9b06-9f1eb6d42691 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:28.131135 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9f0501fb-04ac-40a6-9b06-9f1eb6d42691 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:28.132380 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9f0501fb-04ac-40a6-9b06-9f1eb6d42691 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:28.133592 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9f0501fb-04ac-40a6-9b06-9f1eb6d42691 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:28.134291 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9f0501fb-04ac-40a6-9b06-9f1eb6d42691 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:28.266927 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=12 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:23:28.309546 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-9f0501fb-04ac-40a6-9b06-9f1eb6d42691 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:23:28.322832 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-9f0501fb-04ac-40a6-9b06-9f1eb6d42691 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/e13ba2a1-731c-4fc7-b8d2-db3ce6199eb6" status: 200 len: 1507 microversion: 2.1 time: 0.216368 Oct 08 21:23:28.323437 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2822/5567] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:23:28 2022] GET /compute/v2.1/servers/e13ba2a1-731c-4fc7-b8d2-db3ce6199eb6 => generated 1507 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:23:28.343823 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-479ad20f-4b2d-4a72-b2c4-e62a8f48c67c tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:23:28.344489 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-479ad20f-4b2d-4a72-b2c4-e62a8f48c67c tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] [instance: 3395e57f-ceb7-4984-940c-d9ee3c93b370] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:23:28.363397 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-479ad20f-4b2d-4a72-b2c4-e62a8f48c67c tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:28.363918 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-479ad20f-4b2d-4a72-b2c4-e62a8f48c67c tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:28.364884 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-479ad20f-4b2d-4a72-b2c4-e62a8f48c67c tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:28.365660 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-479ad20f-4b2d-4a72-b2c4-e62a8f48c67c tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:28.366614 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-479ad20f-4b2d-4a72-b2c4-e62a8f48c67c tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:28.369674 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-479ad20f-4b2d-4a72-b2c4-e62a8f48c67c tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:28.693761 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-479ad20f-4b2d-4a72-b2c4-e62a8f48c67c tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e28f7acd53094828a7863ce2fd775cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b37e8634ac448ea9a86aff144098dd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:23:28.706691 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-479ad20f-4b2d-4a72-b2c4-e62a8f48c67c tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] 10.222.0.26 "GET /compute/v2.1/servers/3395e57f-ceb7-4984-940c-d9ee3c93b370" status: 200 len: 1373 microversion: 2.1 time: 0.365823 Oct 08 21:23:28.708016 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2746/5568] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:23:28 2022] GET /compute/v2.1/servers/3395e57f-ceb7-4984-940c-d9ee3c93b370 => generated 1373 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:23:29.353098 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-46203368-fd16-4f4b-b034-49fd68b91df3 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:23:29.355169 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-46203368-fd16-4f4b-b034-49fd68b91df3 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: e13ba2a1-731c-4fc7-b8d2-db3ce6199eb6] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:23:29.370731 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-46203368-fd16-4f4b-b034-49fd68b91df3 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:29.373210 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-46203368-fd16-4f4b-b034-49fd68b91df3 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:29.375167 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-46203368-fd16-4f4b-b034-49fd68b91df3 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:29.376133 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-46203368-fd16-4f4b-b034-49fd68b91df3 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:29.377340 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-46203368-fd16-4f4b-b034-49fd68b91df3 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:29.380753 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-46203368-fd16-4f4b-b034-49fd68b91df3 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:29.607242 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-46203368-fd16-4f4b-b034-49fd68b91df3 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:23:29.619870 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-46203368-fd16-4f4b-b034-49fd68b91df3 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/e13ba2a1-731c-4fc7-b8d2-db3ce6199eb6" status: 200 len: 1507 microversion: 2.1 time: 0.269662 Oct 08 21:23:29.625345 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2823/5569] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:23:29 2022] GET /compute/v2.1/servers/e13ba2a1-731c-4fc7-b8d2-db3ce6199eb6 => generated 1507 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:23:29.731485 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-57033913-1ba5-4b9b-aa73-18e953b72b54 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:23:29.732317 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-57033913-1ba5-4b9b-aa73-18e953b72b54 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] [instance: 3395e57f-ceb7-4984-940c-d9ee3c93b370] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:23:29.745434 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:23:29.747421 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-57033913-1ba5-4b9b-aa73-18e953b72b54 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:29.749789 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-57033913-1ba5-4b9b-aa73-18e953b72b54 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:29.750349 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-57033913-1ba5-4b9b-aa73-18e953b72b54 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:29.751173 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-57033913-1ba5-4b9b-aa73-18e953b72b54 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:29.761894 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-57033913-1ba5-4b9b-aa73-18e953b72b54 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:29.762486 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-57033913-1ba5-4b9b-aa73-18e953b72b54 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:30.027726 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-57033913-1ba5-4b9b-aa73-18e953b72b54 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e28f7acd53094828a7863ce2fd775cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b37e8634ac448ea9a86aff144098dd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:23:30.037153 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-57033913-1ba5-4b9b-aa73-18e953b72b54 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] 10.222.0.26 "GET /compute/v2.1/servers/3395e57f-ceb7-4984-940c-d9ee3c93b370" status: 200 len: 1545 microversion: 2.1 time: 0.310474 Oct 08 21:23:30.051314 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2747/5570] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:23:29 2022] GET /compute/v2.1/servers/3395e57f-ceb7-4984-940c-d9ee3c93b370 => generated 1545 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:23:30.061044 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-fefec0ba-4978-401f-8fd6-f6126d61f437 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:23:30.061742 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-fefec0ba-4978-401f-8fd6-f6126d61f437 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] [instance: 3395e57f-ceb7-4984-940c-d9ee3c93b370] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:23:30.075594 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fefec0ba-4978-401f-8fd6-f6126d61f437 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:30.076340 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fefec0ba-4978-401f-8fd6-f6126d61f437 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:30.077724 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fefec0ba-4978-401f-8fd6-f6126d61f437 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:30.079667 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fefec0ba-4978-401f-8fd6-f6126d61f437 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:30.080527 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fefec0ba-4978-401f-8fd6-f6126d61f437 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:30.081481 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fefec0ba-4978-401f-8fd6-f6126d61f437 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:30.279627 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-fefec0ba-4978-401f-8fd6-f6126d61f437 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e28f7acd53094828a7863ce2fd775cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b37e8634ac448ea9a86aff144098dd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:23:30.294371 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-fefec0ba-4978-401f-8fd6-f6126d61f437 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] 10.222.0.26 "GET /compute/v2.1/servers/3395e57f-ceb7-4984-940c-d9ee3c93b370" status: 200 len: 1545 microversion: 2.1 time: 0.236388 Oct 08 21:23:30.296129 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2824/5571] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:23:30 2022] GET /compute/v2.1/servers/3395e57f-ceb7-4984-940c-d9ee3c93b370 => generated 1545 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:23:30.662245 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-1213e706-be54-4ace-9336-48f51096356b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:23:30.662801 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-1213e706-be54-4ace-9336-48f51096356b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: e13ba2a1-731c-4fc7-b8d2-db3ce6199eb6] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:23:30.669737 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1213e706-be54-4ace-9336-48f51096356b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:30.670358 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1213e706-be54-4ace-9336-48f51096356b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:30.670910 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1213e706-be54-4ace-9336-48f51096356b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:30.672211 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1213e706-be54-4ace-9336-48f51096356b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:30.672702 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1213e706-be54-4ace-9336-48f51096356b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:30.673151 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1213e706-be54-4ace-9336-48f51096356b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:31.082060 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-1213e706-be54-4ace-9336-48f51096356b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:23:31.112595 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-1213e706-be54-4ace-9336-48f51096356b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/e13ba2a1-731c-4fc7-b8d2-db3ce6199eb6" status: 200 len: 1507 microversion: 2.1 time: 0.455017 Oct 08 21:23:31.130906 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2748/5572] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:23:30 2022] GET /compute/v2.1/servers/e13ba2a1-731c-4fc7-b8d2-db3ce6199eb6 => generated 1507 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:23:32.139429 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-973495ca-a96a-4a9e-b8a5-dfa624372789 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:23:32.140056 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-973495ca-a96a-4a9e-b8a5-dfa624372789 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: e13ba2a1-731c-4fc7-b8d2-db3ce6199eb6] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:23:32.149166 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-973495ca-a96a-4a9e-b8a5-dfa624372789 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:32.149892 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-973495ca-a96a-4a9e-b8a5-dfa624372789 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:32.150510 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-973495ca-a96a-4a9e-b8a5-dfa624372789 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:32.151412 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-973495ca-a96a-4a9e-b8a5-dfa624372789 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:32.152067 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-973495ca-a96a-4a9e-b8a5-dfa624372789 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:32.152686 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-973495ca-a96a-4a9e-b8a5-dfa624372789 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:32.340349 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-973495ca-a96a-4a9e-b8a5-dfa624372789 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:23:32.351905 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-973495ca-a96a-4a9e-b8a5-dfa624372789 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/e13ba2a1-731c-4fc7-b8d2-db3ce6199eb6" status: 200 len: 1507 microversion: 2.1 time: 0.215244 Oct 08 21:23:32.366181 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2825/5573] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:23:32 2022] GET /compute/v2.1/servers/e13ba2a1-731c-4fc7-b8d2-db3ce6199eb6 => generated 1507 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:23:33.377767 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-8f690a9d-8a90-4315-88cc-7493edbc3689 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:23:33.378398 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-8f690a9d-8a90-4315-88cc-7493edbc3689 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: e13ba2a1-731c-4fc7-b8d2-db3ce6199eb6] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:23:33.389981 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8f690a9d-8a90-4315-88cc-7493edbc3689 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:33.392198 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8f690a9d-8a90-4315-88cc-7493edbc3689 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:33.393506 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8f690a9d-8a90-4315-88cc-7493edbc3689 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:33.394303 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8f690a9d-8a90-4315-88cc-7493edbc3689 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:33.395140 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8f690a9d-8a90-4315-88cc-7493edbc3689 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:33.396753 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8f690a9d-8a90-4315-88cc-7493edbc3689 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:33.694922 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-8f690a9d-8a90-4315-88cc-7493edbc3689 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:23:33.703888 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-8f690a9d-8a90-4315-88cc-7493edbc3689 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/e13ba2a1-731c-4fc7-b8d2-db3ce6199eb6" status: 200 len: 1507 microversion: 2.1 time: 0.330216 Oct 08 21:23:33.705335 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2749/5574] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:23:33 2022] GET /compute/v2.1/servers/e13ba2a1-731c-4fc7-b8d2-db3ce6199eb6 => generated 1507 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:23:34.731581 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-738454ce-9f08-4aa6-8997-bf6f08ae594b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:23:34.732404 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-738454ce-9f08-4aa6-8997-bf6f08ae594b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: e13ba2a1-731c-4fc7-b8d2-db3ce6199eb6] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:23:34.749995 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-738454ce-9f08-4aa6-8997-bf6f08ae594b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:34.749995 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-738454ce-9f08-4aa6-8997-bf6f08ae594b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:34.749995 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-738454ce-9f08-4aa6-8997-bf6f08ae594b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:34.749995 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-738454ce-9f08-4aa6-8997-bf6f08ae594b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:34.754799 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-738454ce-9f08-4aa6-8997-bf6f08ae594b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:34.755804 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-738454ce-9f08-4aa6-8997-bf6f08ae594b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:35.195167 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-738454ce-9f08-4aa6-8997-bf6f08ae594b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:23:35.206970 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-738454ce-9f08-4aa6-8997-bf6f08ae594b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/e13ba2a1-731c-4fc7-b8d2-db3ce6199eb6" status: 200 len: 1507 microversion: 2.1 time: 0.480175 Oct 08 21:23:35.210455 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2826/5575] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:23:34 2022] GET /compute/v2.1/servers/e13ba2a1-731c-4fc7-b8d2-db3ce6199eb6 => generated 1507 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:23:36.231937 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-60e86b32-a85a-491c-81bc-674f09344984 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:23:36.237562 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-60e86b32-a85a-491c-81bc-674f09344984 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: e13ba2a1-731c-4fc7-b8d2-db3ce6199eb6] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:23:36.248076 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-60e86b32-a85a-491c-81bc-674f09344984 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:36.249457 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-60e86b32-a85a-491c-81bc-674f09344984 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:36.251516 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-60e86b32-a85a-491c-81bc-674f09344984 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:36.254446 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-60e86b32-a85a-491c-81bc-674f09344984 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:36.255437 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-60e86b32-a85a-491c-81bc-674f09344984 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:36.256408 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-60e86b32-a85a-491c-81bc-674f09344984 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:36.483563 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-60e86b32-a85a-491c-81bc-674f09344984 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:23:36.499557 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-60e86b32-a85a-491c-81bc-674f09344984 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/e13ba2a1-731c-4fc7-b8d2-db3ce6199eb6" status: 200 len: 1507 microversion: 2.1 time: 0.272680 Oct 08 21:23:36.502544 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2750/5576] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:23:36 2022] GET /compute/v2.1/servers/e13ba2a1-731c-4fc7-b8d2-db3ce6199eb6 => generated 1507 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:23:37.527178 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-1086c752-1a2c-46e7-bd8b-dbcbc11f227a tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:23:37.528628 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-1086c752-1a2c-46e7-bd8b-dbcbc11f227a tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: e13ba2a1-731c-4fc7-b8d2-db3ce6199eb6] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:23:37.541272 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1086c752-1a2c-46e7-bd8b-dbcbc11f227a tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:37.542091 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1086c752-1a2c-46e7-bd8b-dbcbc11f227a tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:37.542867 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1086c752-1a2c-46e7-bd8b-dbcbc11f227a tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:37.543847 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1086c752-1a2c-46e7-bd8b-dbcbc11f227a tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:37.544546 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1086c752-1a2c-46e7-bd8b-dbcbc11f227a tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:37.545304 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1086c752-1a2c-46e7-bd8b-dbcbc11f227a tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:37.837247 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-1086c752-1a2c-46e7-bd8b-dbcbc11f227a tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:23:37.848560 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-1086c752-1a2c-46e7-bd8b-dbcbc11f227a tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/e13ba2a1-731c-4fc7-b8d2-db3ce6199eb6" status: 200 len: 1504 microversion: 2.1 time: 0.326275 Oct 08 21:23:37.850606 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2827/5577] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:23:37 2022] GET /compute/v2.1/servers/e13ba2a1-731c-4fc7-b8d2-db3ce6199eb6 => generated 1504 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:23:38.872714 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-9ef5f6b0-0167-40ad-ab30-cec26659b6e5 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:23:38.874258 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-9ef5f6b0-0167-40ad-ab30-cec26659b6e5 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: e13ba2a1-731c-4fc7-b8d2-db3ce6199eb6] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:23:38.886474 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9ef5f6b0-0167-40ad-ab30-cec26659b6e5 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:38.886979 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9ef5f6b0-0167-40ad-ab30-cec26659b6e5 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:38.890986 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9ef5f6b0-0167-40ad-ab30-cec26659b6e5 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:38.892379 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9ef5f6b0-0167-40ad-ab30-cec26659b6e5 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:38.894399 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9ef5f6b0-0167-40ad-ab30-cec26659b6e5 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:38.897866 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9ef5f6b0-0167-40ad-ab30-cec26659b6e5 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:39.108190 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-9ef5f6b0-0167-40ad-ab30-cec26659b6e5 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:23:39.124080 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-9ef5f6b0-0167-40ad-ab30-cec26659b6e5 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/e13ba2a1-731c-4fc7-b8d2-db3ce6199eb6" status: 200 len: 1504 microversion: 2.1 time: 0.255276 Oct 08 21:23:39.141383 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2751/5578] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:23:38 2022] GET /compute/v2.1/servers/e13ba2a1-731c-4fc7-b8d2-db3ce6199eb6 => generated 1504 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:23:40.147973 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-0edbc4aa-d460-4ca6-b681-b5e2db292974 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:23:40.149150 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-0edbc4aa-d460-4ca6-b681-b5e2db292974 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: e13ba2a1-731c-4fc7-b8d2-db3ce6199eb6] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:23:40.161932 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0edbc4aa-d460-4ca6-b681-b5e2db292974 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:40.169920 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0edbc4aa-d460-4ca6-b681-b5e2db292974 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:40.172190 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0edbc4aa-d460-4ca6-b681-b5e2db292974 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:40.174249 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0edbc4aa-d460-4ca6-b681-b5e2db292974 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:40.174932 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0edbc4aa-d460-4ca6-b681-b5e2db292974 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:40.175560 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0edbc4aa-d460-4ca6-b681-b5e2db292974 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:40.446892 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-0edbc4aa-d460-4ca6-b681-b5e2db292974 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:23:40.460188 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-0edbc4aa-d460-4ca6-b681-b5e2db292974 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/e13ba2a1-731c-4fc7-b8d2-db3ce6199eb6" status: 200 len: 1447 microversion: 2.1 time: 0.313691 Oct 08 21:23:40.464154 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2828/5579] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:23:40 2022] GET /compute/v2.1/servers/e13ba2a1-731c-4fc7-b8d2-db3ce6199eb6 => generated 1447 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:23:40.496882 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-cc8fcd67-7fcd-4d63-97c7-b166b6b399a3 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:23:40.497556 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-cc8fcd67-7fcd-4d63-97c7-b166b6b399a3 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 2a61f287-652b-487f-9ecd-fb4d2d1eee62] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:23:40.508003 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cc8fcd67-7fcd-4d63-97c7-b166b6b399a3 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:40.508504 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cc8fcd67-7fcd-4d63-97c7-b166b6b399a3 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:40.509318 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cc8fcd67-7fcd-4d63-97c7-b166b6b399a3 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:40.510259 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cc8fcd67-7fcd-4d63-97c7-b166b6b399a3 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:40.510898 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cc8fcd67-7fcd-4d63-97c7-b166b6b399a3 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:40.511636 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cc8fcd67-7fcd-4d63-97c7-b166b6b399a3 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:40.752268 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-cc8fcd67-7fcd-4d63-97c7-b166b6b399a3 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:23:40.762861 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-cc8fcd67-7fcd-4d63-97c7-b166b6b399a3 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62" status: 200 len: 1670 microversion: 2.1 time: 0.273748 Oct 08 21:23:40.764290 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2752/5580] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:23:40 2022] GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62 => generated 1670 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:23:40.783585 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-b4c2ad8e-c598-4e69-b12b-88686ab15d91 req-5a3ad821-762c-4538-9ed8-b56302f757d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e13ba2a1-731c-4fc7-b8d2-db3ce6199eb6", "name": "network-vif-unplugged", "status": "completed", "tag": "25d82e2d-1449-4722-9702-e6ba8fcc3322"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:23:40.799448 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-449983fb-5ba7-4a0a-80bd-5c766c718b4f tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:23:40.800083 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-449983fb-5ba7-4a0a-80bd-5c766c718b4f tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 2a61f287-652b-487f-9ecd-fb4d2d1eee62] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:23:40.806239 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-b4c2ad8e-c598-4e69-b12b-88686ab15d91 req-5a3ad821-762c-4538-9ed8-b56302f757d7 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:40.806996 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-b4c2ad8e-c598-4e69-b12b-88686ab15d91 req-5a3ad821-762c-4538-9ed8-b56302f757d7 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:40.807891 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-b4c2ad8e-c598-4e69-b12b-88686ab15d91 req-5a3ad821-762c-4538-9ed8-b56302f757d7 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:40.813852 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-449983fb-5ba7-4a0a-80bd-5c766c718b4f tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:40.814366 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-449983fb-5ba7-4a0a-80bd-5c766c718b4f tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:40.814819 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-449983fb-5ba7-4a0a-80bd-5c766c718b4f tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:40.815723 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-449983fb-5ba7-4a0a-80bd-5c766c718b4f tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:40.816518 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-449983fb-5ba7-4a0a-80bd-5c766c718b4f tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:40.816850 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-449983fb-5ba7-4a0a-80bd-5c766c718b4f tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:40.827337 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.compute.server_external_events [req-b4c2ad8e-c598-4e69-b12b-88686ab15d91 req-5a3ad821-762c-4538-9ed8-b56302f757d7 service nova] Unable to find a host for instance e13ba2a1-731c-4fc7-b8d2-db3ce6199eb6. Dropping event network-vif-unplugged {{(pid=140492) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 08 21:23:40.828690 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-b4c2ad8e-c598-4e69-b12b-88686ab15d91 req-5a3ad821-762c-4538-9ed8-b56302f757d7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.065013 Oct 08 21:23:40.829795 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2829/5581] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:23:40 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 67 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Oct 08 21:23:41.018116 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-449983fb-5ba7-4a0a-80bd-5c766c718b4f tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:23:41.032194 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-449983fb-5ba7-4a0a-80bd-5c766c718b4f tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62" status: 200 len: 1670 microversion: 2.1 time: 0.233971 Oct 08 21:23:41.032850 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2753/5582] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:23:40 2022] GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62 => generated 1670 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:23:41.055116 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-d9a1f662-3078-4285-a0cd-95ee5fc46626 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:23:41.056143 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-d9a1f662-3078-4285-a0cd-95ee5fc46626 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 2a61f287-652b-487f-9ecd-fb4d2d1eee62] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:23:41.064542 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d9a1f662-3078-4285-a0cd-95ee5fc46626 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:41.065314 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d9a1f662-3078-4285-a0cd-95ee5fc46626 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:41.066099 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d9a1f662-3078-4285-a0cd-95ee5fc46626 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:41.067093 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d9a1f662-3078-4285-a0cd-95ee5fc46626 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:41.067974 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d9a1f662-3078-4285-a0cd-95ee5fc46626 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:41.068628 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d9a1f662-3078-4285-a0cd-95ee5fc46626 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:41.400724 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-d9a1f662-3078-4285-a0cd-95ee5fc46626 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:23:41.411563 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-d9a1f662-3078-4285-a0cd-95ee5fc46626 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62" status: 200 len: 1670 microversion: 2.1 time: 0.360470 Oct 08 21:23:41.412175 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2830/5583] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:23:41 2022] GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62 => generated 1670 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:23:41.434890 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-8a0bdfd0-70f9-472e-9837-cdb7e05b3161 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:23:41.435817 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-8a0bdfd0-70f9-472e-9837-cdb7e05b3161 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 2a61f287-652b-487f-9ecd-fb4d2d1eee62] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:23:41.446190 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8a0bdfd0-70f9-472e-9837-cdb7e05b3161 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:41.446703 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8a0bdfd0-70f9-472e-9837-cdb7e05b3161 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:41.447159 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8a0bdfd0-70f9-472e-9837-cdb7e05b3161 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:41.447889 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8a0bdfd0-70f9-472e-9837-cdb7e05b3161 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:41.448362 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8a0bdfd0-70f9-472e-9837-cdb7e05b3161 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:41.448802 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8a0bdfd0-70f9-472e-9837-cdb7e05b3161 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:41.703989 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-8a0bdfd0-70f9-472e-9837-cdb7e05b3161 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:23:41.718583 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-8a0bdfd0-70f9-472e-9837-cdb7e05b3161 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62" status: 200 len: 1670 microversion: 2.1 time: 0.286991 Oct 08 21:23:41.719460 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2754/5584] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:23:41 2022] GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62 => generated 1670 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:23:41.748504 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-59a2f33a-92f1-420c-9717-562363e81839 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:23:41.755393 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-59a2f33a-92f1-420c-9717-562363e81839 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:41.756167 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-59a2f33a-92f1-420c-9717-562363e81839 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:41.756798 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-59a2f33a-92f1-420c-9717-562363e81839 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:41.784558 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-59a2f33a-92f1-420c-9717-562363e81839 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 2a61f287-652b-487f-9ecd-fb4d2d1eee62] Going to try to stop instance {{(pid=140492) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 08 21:23:41.859102 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-59a2f33a-92f1-420c-9717-562363e81839 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "POST /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62/action" status: 202 len: 0 microversion: 2.1 time: 0.114265 Oct 08 21:23:41.860490 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2831/5585] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:23:41 2022] POST /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 21:23:41.870048 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-07aea1c0-5a9d-4682-b0dd-d92eebbb6900 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:23:41.870681 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-07aea1c0-5a9d-4682-b0dd-d92eebbb6900 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 2a61f287-652b-487f-9ecd-fb4d2d1eee62] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:23:41.880047 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-07aea1c0-5a9d-4682-b0dd-d92eebbb6900 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:41.880745 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-07aea1c0-5a9d-4682-b0dd-d92eebbb6900 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:41.881667 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-07aea1c0-5a9d-4682-b0dd-d92eebbb6900 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:41.882663 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-07aea1c0-5a9d-4682-b0dd-d92eebbb6900 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:41.883301 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-07aea1c0-5a9d-4682-b0dd-d92eebbb6900 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:41.884113 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-07aea1c0-5a9d-4682-b0dd-d92eebbb6900 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:42.359664 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-f986da3d-aad1-449e-8b7a-a397400d01f4 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-1017555630", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "networks": [{"uuid": "4ab60ab2-f975-4ea4-a563-3f27f4c64bb6"}], "key_name": "tempest-TestSecurityGroupsBasicOps-133867488", "security_groups": []}, "os:scheduler_hints": {"different_host": ["9f0543d4-5a51-4c40-8b2e-fbd2a393c903"]}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:23:42.391592 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=4 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:23:42.434405 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.network.neutron [None req-f986da3d-aad1-449e-8b7a-a397400d01f4 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] validate_networks() for [('4ab60ab2-f975-4ea4-a563-3f27f4c64bb6', None, None, None, None, None)] {{(pid=140492) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 21:23:42.566951 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-07aea1c0-5a9d-4682-b0dd-d92eebbb6900 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:23:42.579315 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-07aea1c0-5a9d-4682-b0dd-d92eebbb6900 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62" status: 200 len: 1680 microversion: 2.1 time: 0.713970 Oct 08 21:23:42.593791 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2755/5586] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:23:41 2022] GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62 => generated 1680 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:23:42.904909 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-f986da3d-aad1-449e-8b7a-a397400d01f4 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Flavor limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 21:23:42.905654 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-f986da3d-aad1-449e-8b7a-a397400d01f4 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Image limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 21:23:42.906651 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-f986da3d-aad1-449e-8b7a-a397400d01f4 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Flavor pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 21:23:42.907089 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-f986da3d-aad1-449e-8b7a-a397400d01f4 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Image pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 21:23:42.907884 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-f986da3d-aad1-449e-8b7a-a397400d01f4 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 21:23:42.919064 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f986da3d-aad1-449e-8b7a-a397400d01f4 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:42.919700 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f986da3d-aad1-449e-8b7a-a397400d01f4 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:42.920166 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f986da3d-aad1-449e-8b7a-a397400d01f4 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:42.921116 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f986da3d-aad1-449e-8b7a-a397400d01f4 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:42.921991 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f986da3d-aad1-449e-8b7a-a397400d01f4 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:42.922619 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f986da3d-aad1-449e-8b7a-a397400d01f4 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:42.947753 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-f986da3d-aad1-449e-8b7a-a397400d01f4 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Getting quotas for project e5fd83b3bdef4ba18ba56a9385e26d01. Resources: {'cores', 'instances', 'ram'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:23:42.955028 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-f986da3d-aad1-449e-8b7a-a397400d01f4 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Getting quotas for user 33a0d81fb2dd4891901f27890ce7688e and project e5fd83b3bdef4ba18ba56a9385e26d01. Resources: {'cores', 'instances', 'ram'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:23:42.968503 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-f986da3d-aad1-449e-8b7a-a397400d01f4 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Going to run 1 instances... {{(pid=140492) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 21:23:42.971632 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-f986da3d-aad1-449e-8b7a-a397400d01f4 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] [instance: 9c171da3-7c06-45d8-a745-b6cbaf37b630] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c508bd7f-7db9-4b2c-af7c-be54a855c355',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140492) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 21:23:43.024959 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-f986da3d-aad1-449e-8b7a-a397400d01f4 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 0.677311 Oct 08 21:23:43.025997 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2832/5587] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 21:23:42 2022] POST /compute/v2.1/servers => generated 361 bytes in 681 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 08 21:23:43.038294 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-bbc1bf57-80d6-4e36-a097-15744fe60813 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:23:43.039696 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-bbc1bf57-80d6-4e36-a097-15744fe60813 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] [instance: 9c171da3-7c06-45d8-a745-b6cbaf37b630] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:23:43.127485 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-bbc1bf57-80d6-4e36-a097-15744fe60813 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a0d81fb2dd4891901f27890ce7688e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fd83b3bdef4ba18ba56a9385e26d01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:23:43.135199 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-bbc1bf57-80d6-4e36-a097-15744fe60813 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] 10.222.0.26 "GET /compute/v2.1/servers/9c171da3-7c06-45d8-a745-b6cbaf37b630" status: 200 len: 1241 microversion: 2.1 time: 0.101350 Oct 08 21:23:43.142447 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2756/5588] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:23:43 2022] GET /compute/v2.1/servers/9c171da3-7c06-45d8-a745-b6cbaf37b630 => generated 1241 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:23:43.607015 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-1177c0ab-0f02-4469-9105-ec3e182ed2d7 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:23:43.608291 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-1177c0ab-0f02-4469-9105-ec3e182ed2d7 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 2a61f287-652b-487f-9ecd-fb4d2d1eee62] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:23:43.617499 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1177c0ab-0f02-4469-9105-ec3e182ed2d7 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:43.618313 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1177c0ab-0f02-4469-9105-ec3e182ed2d7 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:43.620089 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1177c0ab-0f02-4469-9105-ec3e182ed2d7 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:43.620826 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1177c0ab-0f02-4469-9105-ec3e182ed2d7 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:43.621694 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1177c0ab-0f02-4469-9105-ec3e182ed2d7 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:43.622420 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1177c0ab-0f02-4469-9105-ec3e182ed2d7 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:43.646959 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:23:43.828300 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-1177c0ab-0f02-4469-9105-ec3e182ed2d7 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:23:43.840304 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-1177c0ab-0f02-4469-9105-ec3e182ed2d7 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62" status: 200 len: 1680 microversion: 2.1 time: 0.238962 Oct 08 21:23:43.850471 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2833/5589] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:23:43 2022] GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62 => generated 1680 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:23:44.159645 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c64af5ee-0658-4154-b869-5d946c6bccf4 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:23:44.160516 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-c64af5ee-0658-4154-b869-5d946c6bccf4 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] [instance: 9c171da3-7c06-45d8-a745-b6cbaf37b630] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:23:44.171756 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c64af5ee-0658-4154-b869-5d946c6bccf4 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:44.172348 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c64af5ee-0658-4154-b869-5d946c6bccf4 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:44.172872 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c64af5ee-0658-4154-b869-5d946c6bccf4 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:44.173702 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c64af5ee-0658-4154-b869-5d946c6bccf4 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:44.174366 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c64af5ee-0658-4154-b869-5d946c6bccf4 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:44.174988 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c64af5ee-0658-4154-b869-5d946c6bccf4 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:44.246224 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-c64af5ee-0658-4154-b869-5d946c6bccf4 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a0d81fb2dd4891901f27890ce7688e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fd83b3bdef4ba18ba56a9385e26d01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:23:44.248761 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=100 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:23:44.258650 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-c64af5ee-0658-4154-b869-5d946c6bccf4 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] 10.222.0.26 "GET /compute/v2.1/servers/9c171da3-7c06-45d8-a745-b6cbaf37b630" status: 200 len: 1293 microversion: 2.1 time: 0.102642 Oct 08 21:23:44.259231 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2757/5590] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:23:44 2022] GET /compute/v2.1/servers/9c171da3-7c06-45d8-a745-b6cbaf37b630 => generated 1293 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:23:44.865237 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-6a857ce6-6929-4c14-81c5-41864e999ba5 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:23:44.865910 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-6a857ce6-6929-4c14-81c5-41864e999ba5 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 2a61f287-652b-487f-9ecd-fb4d2d1eee62] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:23:44.873909 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6a857ce6-6929-4c14-81c5-41864e999ba5 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:44.874559 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6a857ce6-6929-4c14-81c5-41864e999ba5 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:44.875009 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6a857ce6-6929-4c14-81c5-41864e999ba5 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:44.875726 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6a857ce6-6929-4c14-81c5-41864e999ba5 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:44.876191 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6a857ce6-6929-4c14-81c5-41864e999ba5 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:44.876819 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6a857ce6-6929-4c14-81c5-41864e999ba5 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:45.116000 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-6a857ce6-6929-4c14-81c5-41864e999ba5 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:23:45.131944 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-6a857ce6-6929-4c14-81c5-41864e999ba5 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62" status: 200 len: 1680 microversion: 2.1 time: 0.270699 Oct 08 21:23:45.150088 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2834/5591] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:23:44 2022] GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62 => generated 1680 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:23:45.281701 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-af49b830-512a-4552-b406-da01c0074bdc tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:23:45.282795 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-af49b830-512a-4552-b406-da01c0074bdc tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] [instance: 9c171da3-7c06-45d8-a745-b6cbaf37b630] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:23:45.295020 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-af49b830-512a-4552-b406-da01c0074bdc tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:45.296550 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-af49b830-512a-4552-b406-da01c0074bdc tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:45.297011 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-af49b830-512a-4552-b406-da01c0074bdc tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:45.297790 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-af49b830-512a-4552-b406-da01c0074bdc tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:45.298260 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-af49b830-512a-4552-b406-da01c0074bdc tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:45.298698 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-af49b830-512a-4552-b406-da01c0074bdc tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:45.426718 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-af49b830-512a-4552-b406-da01c0074bdc tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a0d81fb2dd4891901f27890ce7688e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fd83b3bdef4ba18ba56a9385e26d01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:23:45.435744 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-af49b830-512a-4552-b406-da01c0074bdc tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] 10.222.0.26 "GET /compute/v2.1/servers/9c171da3-7c06-45d8-a745-b6cbaf37b630" status: 200 len: 1299 microversion: 2.1 time: 0.158347 Oct 08 21:23:45.449674 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2758/5592] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:23:45 2022] GET /compute/v2.1/servers/9c171da3-7c06-45d8-a745-b6cbaf37b630 => generated 1299 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:23:46.090599 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-817b6c16-8c2e-4e7a-aedf-d948f82da058 req-66dbe9b8-f196-440a-8385-4a1b3258ccd2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c171da3-7c06-45d8-a745-b6cbaf37b630", "tag": "8630cf38-fb4d-4165-8c01-3404e43617ea"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:23:46.105289 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-817b6c16-8c2e-4e7a-aedf-d948f82da058 req-66dbe9b8-f196-440a-8385-4a1b3258ccd2 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:46.105976 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-817b6c16-8c2e-4e7a-aedf-d948f82da058 req-66dbe9b8-f196-440a-8385-4a1b3258ccd2 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:46.106606 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-817b6c16-8c2e-4e7a-aedf-d948f82da058 req-66dbe9b8-f196-440a-8385-4a1b3258ccd2 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:46.123762 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-817b6c16-8c2e-4e7a-aedf-d948f82da058 req-66dbe9b8-f196-440a-8385-4a1b3258ccd2 service nova] Creating event network-changed:8630cf38-fb4d-4165-8c01-3404e43617ea for instance 9c171da3-7c06-45d8-a745-b6cbaf37b630 on nch2-master-1 Oct 08 21:23:46.130980 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-817b6c16-8c2e-4e7a-aedf-d948f82da058 req-66dbe9b8-f196-440a-8385-4a1b3258ccd2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048502 Oct 08 21:23:46.132954 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2835/5593] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:23:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 08 21:23:46.163656 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-ac7ab76b-6cd2-4cf7-882a-e61e331e0ba5 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:23:46.164732 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-ac7ab76b-6cd2-4cf7-882a-e61e331e0ba5 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 2a61f287-652b-487f-9ecd-fb4d2d1eee62] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:23:46.171488 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ac7ab76b-6cd2-4cf7-882a-e61e331e0ba5 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:46.171988 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ac7ab76b-6cd2-4cf7-882a-e61e331e0ba5 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:46.172436 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ac7ab76b-6cd2-4cf7-882a-e61e331e0ba5 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:46.173160 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ac7ab76b-6cd2-4cf7-882a-e61e331e0ba5 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:46.173660 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ac7ab76b-6cd2-4cf7-882a-e61e331e0ba5 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:46.174265 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ac7ab76b-6cd2-4cf7-882a-e61e331e0ba5 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:46.387045 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-ac7ab76b-6cd2-4cf7-882a-e61e331e0ba5 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:23:46.396312 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-ac7ab76b-6cd2-4cf7-882a-e61e331e0ba5 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62" status: 200 len: 1680 microversion: 2.1 time: 0.242168 Oct 08 21:23:46.396911 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2759/5594] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:23:46 2022] GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62 => generated 1680 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:23:46.463336 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-209e94e8-7417-4351-88e6-e46ce23b7510 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:23:46.464101 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-209e94e8-7417-4351-88e6-e46ce23b7510 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] [instance: 9c171da3-7c06-45d8-a745-b6cbaf37b630] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:23:46.471598 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-209e94e8-7417-4351-88e6-e46ce23b7510 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:46.472059 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-209e94e8-7417-4351-88e6-e46ce23b7510 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:46.472509 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-209e94e8-7417-4351-88e6-e46ce23b7510 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:46.473656 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-209e94e8-7417-4351-88e6-e46ce23b7510 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:46.474151 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-209e94e8-7417-4351-88e6-e46ce23b7510 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:46.474571 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-209e94e8-7417-4351-88e6-e46ce23b7510 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:46.644049 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-209e94e8-7417-4351-88e6-e46ce23b7510 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a0d81fb2dd4891901f27890ce7688e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fd83b3bdef4ba18ba56a9385e26d01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:23:46.653648 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-209e94e8-7417-4351-88e6-e46ce23b7510 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] 10.222.0.26 "GET /compute/v2.1/servers/9c171da3-7c06-45d8-a745-b6cbaf37b630" status: 200 len: 1299 microversion: 2.1 time: 0.197204 Oct 08 21:23:46.669221 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2836/5595] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:23:46 2022] GET /compute/v2.1/servers/9c171da3-7c06-45d8-a745-b6cbaf37b630 => generated 1299 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:23:47.421173 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-33548a63-3a05-44ff-a1f3-17fb52355521 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:23:47.421927 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-33548a63-3a05-44ff-a1f3-17fb52355521 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 2a61f287-652b-487f-9ecd-fb4d2d1eee62] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:23:47.429221 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-33548a63-3a05-44ff-a1f3-17fb52355521 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:47.429726 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-33548a63-3a05-44ff-a1f3-17fb52355521 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:47.430173 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-33548a63-3a05-44ff-a1f3-17fb52355521 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:47.430881 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-33548a63-3a05-44ff-a1f3-17fb52355521 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:47.431373 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-33548a63-3a05-44ff-a1f3-17fb52355521 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:47.431809 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-33548a63-3a05-44ff-a1f3-17fb52355521 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:47.579403 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-33548a63-3a05-44ff-a1f3-17fb52355521 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:23:47.587953 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-33548a63-3a05-44ff-a1f3-17fb52355521 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62" status: 200 len: 1680 microversion: 2.1 time: 0.170695 Oct 08 21:23:47.588707 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2760/5596] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:23:47 2022] GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62 => generated 1680 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:23:47.676097 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-a739cb23-ac61-45bb-a608-1d4341d8b70d tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:23:47.676872 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-a739cb23-ac61-45bb-a608-1d4341d8b70d tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] [instance: 9c171da3-7c06-45d8-a745-b6cbaf37b630] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:23:47.684422 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a739cb23-ac61-45bb-a608-1d4341d8b70d tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:47.684924 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a739cb23-ac61-45bb-a608-1d4341d8b70d tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:47.685587 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a739cb23-ac61-45bb-a608-1d4341d8b70d tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:47.686503 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a739cb23-ac61-45bb-a608-1d4341d8b70d tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:47.687141 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a739cb23-ac61-45bb-a608-1d4341d8b70d tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:47.687591 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a739cb23-ac61-45bb-a608-1d4341d8b70d tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:47.815588 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-a739cb23-ac61-45bb-a608-1d4341d8b70d tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a0d81fb2dd4891901f27890ce7688e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fd83b3bdef4ba18ba56a9385e26d01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:23:47.824997 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-a739cb23-ac61-45bb-a608-1d4341d8b70d tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] 10.222.0.26 "GET /compute/v2.1/servers/9c171da3-7c06-45d8-a745-b6cbaf37b630" status: 200 len: 1299 microversion: 2.1 time: 0.152858 Oct 08 21:23:47.837529 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2837/5597] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:23:47 2022] GET /compute/v2.1/servers/9c171da3-7c06-45d8-a745-b6cbaf37b630 => generated 1299 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:23:48.611190 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-f1d3bcdc-8b5d-4ca3-a643-7098bed4fb06 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:23:48.612468 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-f1d3bcdc-8b5d-4ca3-a643-7098bed4fb06 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 2a61f287-652b-487f-9ecd-fb4d2d1eee62] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:23:48.621103 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f1d3bcdc-8b5d-4ca3-a643-7098bed4fb06 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:48.621873 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f1d3bcdc-8b5d-4ca3-a643-7098bed4fb06 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:48.622630 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f1d3bcdc-8b5d-4ca3-a643-7098bed4fb06 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:48.623525 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f1d3bcdc-8b5d-4ca3-a643-7098bed4fb06 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:48.624188 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f1d3bcdc-8b5d-4ca3-a643-7098bed4fb06 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:48.624809 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f1d3bcdc-8b5d-4ca3-a643-7098bed4fb06 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:48.778261 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-f1d3bcdc-8b5d-4ca3-a643-7098bed4fb06 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:23:48.786318 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-f1d3bcdc-8b5d-4ca3-a643-7098bed4fb06 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62" status: 200 len: 1680 microversion: 2.1 time: 0.178991 Oct 08 21:23:48.787194 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2761/5598] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:23:48 2022] GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62 => generated 1680 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:23:48.847886 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-d8ba177e-1fb0-495f-9fea-0fd3490aed06 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:23:48.848636 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-d8ba177e-1fb0-495f-9fea-0fd3490aed06 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] [instance: 9c171da3-7c06-45d8-a745-b6cbaf37b630] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:23:48.857515 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d8ba177e-1fb0-495f-9fea-0fd3490aed06 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:48.858197 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d8ba177e-1fb0-495f-9fea-0fd3490aed06 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:48.859011 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d8ba177e-1fb0-495f-9fea-0fd3490aed06 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:48.868409 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d8ba177e-1fb0-495f-9fea-0fd3490aed06 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:48.868961 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d8ba177e-1fb0-495f-9fea-0fd3490aed06 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:48.869865 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d8ba177e-1fb0-495f-9fea-0fd3490aed06 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:48.954833 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-d8ba177e-1fb0-495f-9fea-0fd3490aed06 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a0d81fb2dd4891901f27890ce7688e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fd83b3bdef4ba18ba56a9385e26d01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:23:48.964943 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-d8ba177e-1fb0-495f-9fea-0fd3490aed06 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] 10.222.0.26 "GET /compute/v2.1/servers/9c171da3-7c06-45d8-a745-b6cbaf37b630" status: 200 len: 1299 microversion: 2.1 time: 0.120965 Oct 08 21:23:48.965776 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2838/5599] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:23:48 2022] GET /compute/v2.1/servers/9c171da3-7c06-45d8-a745-b6cbaf37b630 => generated 1299 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:23:49.811501 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-7a17441e-1ab7-4348-986e-6f7b58bf861f tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:23:49.812042 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-7a17441e-1ab7-4348-986e-6f7b58bf861f tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 2a61f287-652b-487f-9ecd-fb4d2d1eee62] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:23:49.819057 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7a17441e-1ab7-4348-986e-6f7b58bf861f tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:49.819559 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7a17441e-1ab7-4348-986e-6f7b58bf861f tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:49.820643 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7a17441e-1ab7-4348-986e-6f7b58bf861f tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:49.821388 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7a17441e-1ab7-4348-986e-6f7b58bf861f tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:49.821859 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7a17441e-1ab7-4348-986e-6f7b58bf861f tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:49.822297 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7a17441e-1ab7-4348-986e-6f7b58bf861f tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:49.953178 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-7a17441e-1ab7-4348-986e-6f7b58bf861f tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:23:49.961046 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-7a17441e-1ab7-4348-986e-6f7b58bf861f tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62" status: 200 len: 1680 microversion: 2.1 time: 0.153600 Oct 08 21:23:49.961652 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2762/5600] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:23:49 2022] GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62 => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:23:49.988910 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-1ce8ce42-c2d1-400d-a212-a8cdf457947c tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:23:49.989563 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-1ce8ce42-c2d1-400d-a212-a8cdf457947c tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] [instance: 9c171da3-7c06-45d8-a745-b6cbaf37b630] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:23:49.996916 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1ce8ce42-c2d1-400d-a212-a8cdf457947c tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:49.997445 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1ce8ce42-c2d1-400d-a212-a8cdf457947c tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:49.997891 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1ce8ce42-c2d1-400d-a212-a8cdf457947c tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:49.998590 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1ce8ce42-c2d1-400d-a212-a8cdf457947c tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:49.999051 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1ce8ce42-c2d1-400d-a212-a8cdf457947c tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:49.999484 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1ce8ce42-c2d1-400d-a212-a8cdf457947c tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:50.080868 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-1ce8ce42-c2d1-400d-a212-a8cdf457947c tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a0d81fb2dd4891901f27890ce7688e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fd83b3bdef4ba18ba56a9385e26d01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:23:50.088585 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-1ce8ce42-c2d1-400d-a212-a8cdf457947c tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] 10.222.0.26 "GET /compute/v2.1/servers/9c171da3-7c06-45d8-a745-b6cbaf37b630" status: 200 len: 1299 microversion: 2.1 time: 0.103548 Oct 08 21:23:50.089158 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2839/5601] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:23:49 2022] GET /compute/v2.1/servers/9c171da3-7c06-45d8-a745-b6cbaf37b630 => generated 1299 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:23:50.697699 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-5ea8e364-cb5d-47fb-a5c1-6252217fdd93 req-897479e6-148a-4819-be9d-129ffbf00654 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c171da3-7c06-45d8-a745-b6cbaf37b630", "name": "network-vif-plugged", "status": "completed", "tag": "8630cf38-fb4d-4165-8c01-3404e43617ea"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:23:50.708295 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-5ea8e364-cb5d-47fb-a5c1-6252217fdd93 req-897479e6-148a-4819-be9d-129ffbf00654 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:50.708842 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-5ea8e364-cb5d-47fb-a5c1-6252217fdd93 req-897479e6-148a-4819-be9d-129ffbf00654 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:50.709231 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-5ea8e364-cb5d-47fb-a5c1-6252217fdd93 req-897479e6-148a-4819-be9d-129ffbf00654 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:50.721029 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-5ea8e364-cb5d-47fb-a5c1-6252217fdd93 req-897479e6-148a-4819-be9d-129ffbf00654 service nova] Creating event network-vif-plugged:8630cf38-fb4d-4165-8c01-3404e43617ea for instance 9c171da3-7c06-45d8-a745-b6cbaf37b630 on nch2-master-1 Oct 08 21:23:50.726006 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-5ea8e364-cb5d-47fb-a5c1-6252217fdd93 req-897479e6-148a-4819-be9d-129ffbf00654 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033043 Oct 08 21:23:50.727160 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2763/5602] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:23:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 08 21:23:50.984163 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-8adbd780-9c34-4d21-a8eb-6983eaeeebb5 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:23:50.984796 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-8adbd780-9c34-4d21-a8eb-6983eaeeebb5 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 2a61f287-652b-487f-9ecd-fb4d2d1eee62] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:23:50.991231 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8adbd780-9c34-4d21-a8eb-6983eaeeebb5 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:50.991831 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8adbd780-9c34-4d21-a8eb-6983eaeeebb5 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:50.992177 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8adbd780-9c34-4d21-a8eb-6983eaeeebb5 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:50.992896 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8adbd780-9c34-4d21-a8eb-6983eaeeebb5 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:50.993398 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8adbd780-9c34-4d21-a8eb-6983eaeeebb5 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:50.993846 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8adbd780-9c34-4d21-a8eb-6983eaeeebb5 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:51.113207 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-23f703e3-7a7d-437c-b146-91b70b706a72 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:23:51.113910 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-23f703e3-7a7d-437c-b146-91b70b706a72 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] [instance: 9c171da3-7c06-45d8-a745-b6cbaf37b630] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:23:51.120406 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-23f703e3-7a7d-437c-b146-91b70b706a72 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:51.120899 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-23f703e3-7a7d-437c-b146-91b70b706a72 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:51.121374 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-23f703e3-7a7d-437c-b146-91b70b706a72 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:51.122078 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-23f703e3-7a7d-437c-b146-91b70b706a72 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:51.122534 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-23f703e3-7a7d-437c-b146-91b70b706a72 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:51.122961 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-23f703e3-7a7d-437c-b146-91b70b706a72 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:51.127289 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-8adbd780-9c34-4d21-a8eb-6983eaeeebb5 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:23:51.136205 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-8adbd780-9c34-4d21-a8eb-6983eaeeebb5 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62" status: 200 len: 1680 microversion: 2.1 time: 0.156202 Oct 08 21:23:51.136801 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2840/5603] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:23:50 2022] GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62 => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:23:51.208373 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-23f703e3-7a7d-437c-b146-91b70b706a72 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a0d81fb2dd4891901f27890ce7688e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fd83b3bdef4ba18ba56a9385e26d01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:23:51.216827 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-23f703e3-7a7d-437c-b146-91b70b706a72 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] 10.222.0.26 "GET /compute/v2.1/servers/9c171da3-7c06-45d8-a745-b6cbaf37b630" status: 200 len: 1299 microversion: 2.1 time: 0.108792 Oct 08 21:23:51.217433 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2764/5604] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:23:51 2022] GET /compute/v2.1/servers/9c171da3-7c06-45d8-a745-b6cbaf37b630 => generated 1299 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:23:52.159861 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-38ff7b32-a4a8-426c-b426-31a48f6d254a tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:23:52.160498 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-38ff7b32-a4a8-426c-b426-31a48f6d254a tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 2a61f287-652b-487f-9ecd-fb4d2d1eee62] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:23:52.168136 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-38ff7b32-a4a8-426c-b426-31a48f6d254a tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:52.168645 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-38ff7b32-a4a8-426c-b426-31a48f6d254a tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:52.169098 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-38ff7b32-a4a8-426c-b426-31a48f6d254a tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:52.169841 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-38ff7b32-a4a8-426c-b426-31a48f6d254a tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:52.170319 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-38ff7b32-a4a8-426c-b426-31a48f6d254a tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:52.170790 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-38ff7b32-a4a8-426c-b426-31a48f6d254a tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:52.240796 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c6de0631-e463-4ef1-a458-7c8aa75652c5 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:23:52.241483 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-c6de0631-e463-4ef1-a458-7c8aa75652c5 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] [instance: 9c171da3-7c06-45d8-a745-b6cbaf37b630] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:23:52.248412 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c6de0631-e463-4ef1-a458-7c8aa75652c5 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:52.248914 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c6de0631-e463-4ef1-a458-7c8aa75652c5 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:52.249376 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c6de0631-e463-4ef1-a458-7c8aa75652c5 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:52.250085 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c6de0631-e463-4ef1-a458-7c8aa75652c5 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:52.250546 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c6de0631-e463-4ef1-a458-7c8aa75652c5 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:52.250971 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c6de0631-e463-4ef1-a458-7c8aa75652c5 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:52.310497 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-38ff7b32-a4a8-426c-b426-31a48f6d254a tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:23:52.318389 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-38ff7b32-a4a8-426c-b426-31a48f6d254a tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62" status: 200 len: 1680 microversion: 2.1 time: 0.162433 Oct 08 21:23:52.318975 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2841/5605] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:23:52 2022] GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62 => generated 1680 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:23:52.334906 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-c6de0631-e463-4ef1-a458-7c8aa75652c5 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a0d81fb2dd4891901f27890ce7688e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fd83b3bdef4ba18ba56a9385e26d01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:23:52.343508 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-c6de0631-e463-4ef1-a458-7c8aa75652c5 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] 10.222.0.26 "GET /compute/v2.1/servers/9c171da3-7c06-45d8-a745-b6cbaf37b630" status: 200 len: 1471 microversion: 2.1 time: 0.106887 Oct 08 21:23:52.344014 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2765/5606] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:23:52 2022] GET /compute/v2.1/servers/9c171da3-7c06-45d8-a745-b6cbaf37b630 => generated 1471 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:23:52.365851 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-443a57dd-5f23-403e-9692-7d2dde469cf4 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:23:52.366473 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-443a57dd-5f23-403e-9692-7d2dde469cf4 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] [instance: 9c171da3-7c06-45d8-a745-b6cbaf37b630] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:23:52.372928 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-443a57dd-5f23-403e-9692-7d2dde469cf4 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:52.373461 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-443a57dd-5f23-403e-9692-7d2dde469cf4 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:52.373908 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-443a57dd-5f23-403e-9692-7d2dde469cf4 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:52.374613 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-443a57dd-5f23-403e-9692-7d2dde469cf4 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:52.375075 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-443a57dd-5f23-403e-9692-7d2dde469cf4 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:52.375509 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-443a57dd-5f23-403e-9692-7d2dde469cf4 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:52.464236 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-443a57dd-5f23-403e-9692-7d2dde469cf4 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a0d81fb2dd4891901f27890ce7688e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fd83b3bdef4ba18ba56a9385e26d01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:23:52.472604 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-443a57dd-5f23-403e-9692-7d2dde469cf4 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] 10.222.0.26 "GET /compute/v2.1/servers/9c171da3-7c06-45d8-a745-b6cbaf37b630" status: 200 len: 1471 microversion: 2.1 time: 0.110565 Oct 08 21:23:52.473207 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2842/5607] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:23:52 2022] GET /compute/v2.1/servers/9c171da3-7c06-45d8-a745-b6cbaf37b630 => generated 1471 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:23:52.495774 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c4d2d45a-2802-40bd-a8f7-8f4d08d6f317 tempest-TestSecurityGroupsBasicOps-167120437 tempest-TestSecurityGroupsBasicOps-167120437-project-admin] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:23:52.496385 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-c4d2d45a-2802-40bd-a8f7-8f4d08d6f317 tempest-TestSecurityGroupsBasicOps-167120437 tempest-TestSecurityGroupsBasicOps-167120437-project-admin] [instance: 9c171da3-7c06-45d8-a745-b6cbaf37b630] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:23:52.503053 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c4d2d45a-2802-40bd-a8f7-8f4d08d6f317 tempest-TestSecurityGroupsBasicOps-167120437 tempest-TestSecurityGroupsBasicOps-167120437-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:52.503654 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c4d2d45a-2802-40bd-a8f7-8f4d08d6f317 tempest-TestSecurityGroupsBasicOps-167120437 tempest-TestSecurityGroupsBasicOps-167120437-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:52.504127 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c4d2d45a-2802-40bd-a8f7-8f4d08d6f317 tempest-TestSecurityGroupsBasicOps-167120437 tempest-TestSecurityGroupsBasicOps-167120437-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:52.504871 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c4d2d45a-2802-40bd-a8f7-8f4d08d6f317 tempest-TestSecurityGroupsBasicOps-167120437 tempest-TestSecurityGroupsBasicOps-167120437-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:52.505505 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c4d2d45a-2802-40bd-a8f7-8f4d08d6f317 tempest-TestSecurityGroupsBasicOps-167120437 tempest-TestSecurityGroupsBasicOps-167120437-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:52.505952 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c4d2d45a-2802-40bd-a8f7-8f4d08d6f317 tempest-TestSecurityGroupsBasicOps-167120437 tempest-TestSecurityGroupsBasicOps-167120437-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:52.585574 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-c4d2d45a-2802-40bd-a8f7-8f4d08d6f317 tempest-TestSecurityGroupsBasicOps-167120437 tempest-TestSecurityGroupsBasicOps-167120437-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/9c171da3-7c06-45d8-a745-b6cbaf37b630" status: 200 len: 1622 microversion: 2.1 time: 0.094116 Oct 08 21:23:52.586155 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2766/5608] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:23:52 2022] GET /compute/v2.1/servers/9c171da3-7c06-45d8-a745-b6cbaf37b630 => generated 1622 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:23:52.608140 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-7cdeedd9-6d73-4a9e-a052-3f5b162e9b59 tempest-TestSecurityGroupsBasicOps-167120437 tempest-TestSecurityGroupsBasicOps-167120437-project-admin] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:23:52.608710 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-7cdeedd9-6d73-4a9e-a052-3f5b162e9b59 tempest-TestSecurityGroupsBasicOps-167120437 tempest-TestSecurityGroupsBasicOps-167120437-project-admin] [instance: 9f0543d4-5a51-4c40-8b2e-fbd2a393c903] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:23:52.614985 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7cdeedd9-6d73-4a9e-a052-3f5b162e9b59 tempest-TestSecurityGroupsBasicOps-167120437 tempest-TestSecurityGroupsBasicOps-167120437-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:52.615488 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7cdeedd9-6d73-4a9e-a052-3f5b162e9b59 tempest-TestSecurityGroupsBasicOps-167120437 tempest-TestSecurityGroupsBasicOps-167120437-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:52.615947 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7cdeedd9-6d73-4a9e-a052-3f5b162e9b59 tempest-TestSecurityGroupsBasicOps-167120437 tempest-TestSecurityGroupsBasicOps-167120437-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:52.617283 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7cdeedd9-6d73-4a9e-a052-3f5b162e9b59 tempest-TestSecurityGroupsBasicOps-167120437 tempest-TestSecurityGroupsBasicOps-167120437-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:52.617779 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7cdeedd9-6d73-4a9e-a052-3f5b162e9b59 tempest-TestSecurityGroupsBasicOps-167120437 tempest-TestSecurityGroupsBasicOps-167120437-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:52.618224 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7cdeedd9-6d73-4a9e-a052-3f5b162e9b59 tempest-TestSecurityGroupsBasicOps-167120437 tempest-TestSecurityGroupsBasicOps-167120437-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:52.757356 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-7cdeedd9-6d73-4a9e-a052-3f5b162e9b59 tempest-TestSecurityGroupsBasicOps-167120437 tempest-TestSecurityGroupsBasicOps-167120437-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/9f0543d4-5a51-4c40-8b2e-fbd2a393c903" status: 200 len: 1913 microversion: 2.1 time: 0.153152 Oct 08 21:23:52.758126 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2843/5609] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:23:52 2022] GET /compute/v2.1/servers/9f0543d4-5a51-4c40-8b2e-fbd2a393c903 => generated 1913 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:23:52.827492 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-bacb6d9a-0b32-4e6c-acaa-f113228b8514 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:23:52.828116 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-bacb6d9a-0b32-4e6c-acaa-f113228b8514 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] [instance: 9c171da3-7c06-45d8-a745-b6cbaf37b630] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:23:52.834609 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bacb6d9a-0b32-4e6c-acaa-f113228b8514 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:52.835105 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bacb6d9a-0b32-4e6c-acaa-f113228b8514 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:52.836036 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bacb6d9a-0b32-4e6c-acaa-f113228b8514 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:52.836747 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bacb6d9a-0b32-4e6c-acaa-f113228b8514 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:52.837224 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bacb6d9a-0b32-4e6c-acaa-f113228b8514 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:52.837659 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bacb6d9a-0b32-4e6c-acaa-f113228b8514 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:52.870946 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-bacb6d9a-0b32-4e6c-acaa-f113228b8514 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] [instance: 9c171da3-7c06-45d8-a745-b6cbaf37b630] Going to try to terminate instance {{(pid=140491) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 21:23:52.950806 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-bacb6d9a-0b32-4e6c-acaa-f113228b8514 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] 10.222.0.26 "DELETE /compute/v2.1/servers/9c171da3-7c06-45d8-a745-b6cbaf37b630" status: 204 len: 0 microversion: 2.1 time: 0.127075 Oct 08 21:23:52.951395 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2767/5610] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:23:52 2022] DELETE /compute/v2.1/servers/9c171da3-7c06-45d8-a745-b6cbaf37b630 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 21:23:52.961358 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-6a5e63b2-3e8a-47ea-8596-3d3be633c13a tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:23:52.961980 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-6a5e63b2-3e8a-47ea-8596-3d3be633c13a tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] [instance: 9c171da3-7c06-45d8-a745-b6cbaf37b630] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:23:52.963968 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=2 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:23:52.964647 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=6 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:23:52.970813 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6a5e63b2-3e8a-47ea-8596-3d3be633c13a tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:52.971307 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6a5e63b2-3e8a-47ea-8596-3d3be633c13a tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:52.971755 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6a5e63b2-3e8a-47ea-8596-3d3be633c13a tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:52.972460 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6a5e63b2-3e8a-47ea-8596-3d3be633c13a tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:52.972923 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6a5e63b2-3e8a-47ea-8596-3d3be633c13a tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:52.973399 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6a5e63b2-3e8a-47ea-8596-3d3be633c13a tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:53.055607 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-6a5e63b2-3e8a-47ea-8596-3d3be633c13a tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a0d81fb2dd4891901f27890ce7688e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fd83b3bdef4ba18ba56a9385e26d01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:23:53.063414 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-6a5e63b2-3e8a-47ea-8596-3d3be633c13a tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] 10.222.0.26 "GET /compute/v2.1/servers/9c171da3-7c06-45d8-a745-b6cbaf37b630" status: 200 len: 1477 microversion: 2.1 time: 0.106864 Oct 08 21:23:53.063984 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2844/5611] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:23:52 2022] GET /compute/v2.1/servers/9c171da3-7c06-45d8-a745-b6cbaf37b630 => generated 1477 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:23:53.342507 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-54bd5571-563c-4b26-b273-b7770a1894eb tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:23:53.343298 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-54bd5571-563c-4b26-b273-b7770a1894eb tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 2a61f287-652b-487f-9ecd-fb4d2d1eee62] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:23:53.345321 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=2 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:23:53.354048 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-54bd5571-563c-4b26-b273-b7770a1894eb tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:53.354048 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-54bd5571-563c-4b26-b273-b7770a1894eb tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:53.354048 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-54bd5571-563c-4b26-b273-b7770a1894eb tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:53.354048 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-54bd5571-563c-4b26-b273-b7770a1894eb tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:53.354471 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-54bd5571-563c-4b26-b273-b7770a1894eb tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:53.354574 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-54bd5571-563c-4b26-b273-b7770a1894eb tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:53.488843 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-54bd5571-563c-4b26-b273-b7770a1894eb tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:23:53.497640 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-54bd5571-563c-4b26-b273-b7770a1894eb tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62" status: 200 len: 1657 microversion: 2.1 time: 0.159582 Oct 08 21:23:53.498157 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2768/5612] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:23:53 2022] GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62 => generated 1657 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:23:53.521002 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-253bcfe3-f94c-4796-800b-375a808648aa tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:23:53.529043 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-253bcfe3-f94c-4796-800b-375a808648aa tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:53.529643 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-253bcfe3-f94c-4796-800b-375a808648aa tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:53.530092 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-253bcfe3-f94c-4796-800b-375a808648aa tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:53.552920 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-253bcfe3-f94c-4796-800b-375a808648aa tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 2a61f287-652b-487f-9ecd-fb4d2d1eee62] Going to try to start instance {{(pid=140492) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 08 21:23:53.597950 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-253bcfe3-f94c-4796-800b-375a808648aa tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "POST /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62/action" status: 202 len: 0 microversion: 2.1 time: 0.080795 Oct 08 21:23:53.598568 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2845/5613] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:23:53 2022] POST /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 21:23:53.607098 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-f90c29c0-a7f1-4d6c-a250-6ce3cf3e519b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:23:53.607657 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-f90c29c0-a7f1-4d6c-a250-6ce3cf3e519b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 2a61f287-652b-487f-9ecd-fb4d2d1eee62] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:23:53.613797 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f90c29c0-a7f1-4d6c-a250-6ce3cf3e519b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:53.614295 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f90c29c0-a7f1-4d6c-a250-6ce3cf3e519b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:53.614746 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f90c29c0-a7f1-4d6c-a250-6ce3cf3e519b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:53.615447 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f90c29c0-a7f1-4d6c-a250-6ce3cf3e519b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:53.615912 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f90c29c0-a7f1-4d6c-a250-6ce3cf3e519b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:53.616345 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f90c29c0-a7f1-4d6c-a250-6ce3cf3e519b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:53.817051 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-f90c29c0-a7f1-4d6c-a250-6ce3cf3e519b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:23:53.826050 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-f90c29c0-a7f1-4d6c-a250-6ce3cf3e519b tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62" status: 200 len: 1666 microversion: 2.1 time: 0.223173 Oct 08 21:23:53.826630 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2769/5614] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:23:53 2022] GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62 => generated 1666 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:23:54.091544 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-76f72d69-556e-4fbb-bcb3-e0f0d835116e tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:23:54.092266 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-76f72d69-556e-4fbb-bcb3-e0f0d835116e tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] [instance: 9c171da3-7c06-45d8-a745-b6cbaf37b630] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:23:54.099167 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-76f72d69-556e-4fbb-bcb3-e0f0d835116e tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:54.099663 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-76f72d69-556e-4fbb-bcb3-e0f0d835116e tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:54.100114 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-76f72d69-556e-4fbb-bcb3-e0f0d835116e tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:54.100833 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-76f72d69-556e-4fbb-bcb3-e0f0d835116e tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:54.101332 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-76f72d69-556e-4fbb-bcb3-e0f0d835116e tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:54.102312 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-76f72d69-556e-4fbb-bcb3-e0f0d835116e tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:54.217123 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-76f72d69-556e-4fbb-bcb3-e0f0d835116e tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a0d81fb2dd4891901f27890ce7688e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fd83b3bdef4ba18ba56a9385e26d01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:23:54.225679 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-76f72d69-556e-4fbb-bcb3-e0f0d835116e tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] 10.222.0.26 "GET /compute/v2.1/servers/9c171da3-7c06-45d8-a745-b6cbaf37b630" status: 200 len: 1477 microversion: 2.1 time: 0.142269 Oct 08 21:23:54.226211 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2846/5615] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:23:54 2022] GET /compute/v2.1/servers/9c171da3-7c06-45d8-a745-b6cbaf37b630 => generated 1477 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:23:54.849663 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-fde60ccd-11c2-4b2b-a1d5-46334da5c133 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:23:54.852716 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-fde60ccd-11c2-4b2b-a1d5-46334da5c133 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 2a61f287-652b-487f-9ecd-fb4d2d1eee62] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:23:54.863864 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fde60ccd-11c2-4b2b-a1d5-46334da5c133 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:54.864733 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fde60ccd-11c2-4b2b-a1d5-46334da5c133 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:54.865281 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fde60ccd-11c2-4b2b-a1d5-46334da5c133 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:54.866102 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fde60ccd-11c2-4b2b-a1d5-46334da5c133 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:54.866665 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fde60ccd-11c2-4b2b-a1d5-46334da5c133 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:54.867474 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fde60ccd-11c2-4b2b-a1d5-46334da5c133 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:55.016295 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-fde60ccd-11c2-4b2b-a1d5-46334da5c133 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:23:55.024394 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-fde60ccd-11c2-4b2b-a1d5-46334da5c133 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62" status: 200 len: 1670 microversion: 2.1 time: 0.179235 Oct 08 21:23:55.024963 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2770/5616] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:23:54 2022] GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62 => generated 1670 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:23:55.056973 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-3d2d8923-85df-4aa1-90ff-6c1c6395fc28 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:23:55.057634 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-3d2d8923-85df-4aa1-90ff-6c1c6395fc28 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 2a61f287-652b-487f-9ecd-fb4d2d1eee62] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:23:55.078308 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3d2d8923-85df-4aa1-90ff-6c1c6395fc28 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:55.081932 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3d2d8923-85df-4aa1-90ff-6c1c6395fc28 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:55.082430 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3d2d8923-85df-4aa1-90ff-6c1c6395fc28 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:55.083200 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3d2d8923-85df-4aa1-90ff-6c1c6395fc28 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:55.083682 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3d2d8923-85df-4aa1-90ff-6c1c6395fc28 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:55.084136 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3d2d8923-85df-4aa1-90ff-6c1c6395fc28 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:55.130700 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-b7796c03-daba-4439-917b-45903d72c086 req-37422f11-d24e-43ce-b3d0-a0a912d0e188 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c171da3-7c06-45d8-a745-b6cbaf37b630", "name": "network-vif-deleted", "tag": "8630cf38-fb4d-4165-8c01-3404e43617ea"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:23:55.142126 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-b7796c03-daba-4439-917b-45903d72c086 req-37422f11-d24e-43ce-b3d0-a0a912d0e188 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:55.142763 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-b7796c03-daba-4439-917b-45903d72c086 req-37422f11-d24e-43ce-b3d0-a0a912d0e188 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:55.143308 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-b7796c03-daba-4439-917b-45903d72c086 req-37422f11-d24e-43ce-b3d0-a0a912d0e188 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:55.160211 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-b7796c03-daba-4439-917b-45903d72c086 req-37422f11-d24e-43ce-b3d0-a0a912d0e188 service nova] Creating event network-vif-deleted:8630cf38-fb4d-4165-8c01-3404e43617ea for instance 9c171da3-7c06-45d8-a745-b6cbaf37b630 on nch2-master-1 Oct 08 21:23:55.166112 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-b7796c03-daba-4439-917b-45903d72c086 req-37422f11-d24e-43ce-b3d0-a0a912d0e188 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038980 Oct 08 21:23:55.168310 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2771/5617] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:23:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:23:55.251303 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-3d2d8923-85df-4aa1-90ff-6c1c6395fc28 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:23:55.256800 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-4f621ac9-3627-405e-8c4a-9f7d3bc4e173 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:23:55.258515 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-4f621ac9-3627-405e-8c4a-9f7d3bc4e173 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] [instance: 9c171da3-7c06-45d8-a745-b6cbaf37b630] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:23:55.263364 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-3d2d8923-85df-4aa1-90ff-6c1c6395fc28 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62" status: 200 len: 1670 microversion: 2.1 time: 0.217741 Oct 08 21:23:55.267421 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2847/5618] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:23:55 2022] GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62 => generated 1670 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:23:55.270507 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4f621ac9-3627-405e-8c4a-9f7d3bc4e173 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:55.271234 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4f621ac9-3627-405e-8c4a-9f7d3bc4e173 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:55.271669 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4f621ac9-3627-405e-8c4a-9f7d3bc4e173 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:55.272557 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4f621ac9-3627-405e-8c4a-9f7d3bc4e173 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:55.273179 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4f621ac9-3627-405e-8c4a-9f7d3bc4e173 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:55.274439 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4f621ac9-3627-405e-8c4a-9f7d3bc4e173 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:55.293958 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-66407d69-bc56-476d-b3b9-cba71d35bd8d tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:23:55.294826 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-66407d69-bc56-476d-b3b9-cba71d35bd8d tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 2a61f287-652b-487f-9ecd-fb4d2d1eee62] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:23:55.301788 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-66407d69-bc56-476d-b3b9-cba71d35bd8d tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:55.302673 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-66407d69-bc56-476d-b3b9-cba71d35bd8d tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:55.303302 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-66407d69-bc56-476d-b3b9-cba71d35bd8d tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:55.304218 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-66407d69-bc56-476d-b3b9-cba71d35bd8d tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:55.305448 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-66407d69-bc56-476d-b3b9-cba71d35bd8d tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:55.306950 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-66407d69-bc56-476d-b3b9-cba71d35bd8d tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:55.382602 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-4f621ac9-3627-405e-8c4a-9f7d3bc4e173 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a0d81fb2dd4891901f27890ce7688e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fd83b3bdef4ba18ba56a9385e26d01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:23:55.396196 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-4f621ac9-3627-405e-8c4a-9f7d3bc4e173 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] 10.222.0.26 "GET /compute/v2.1/servers/9c171da3-7c06-45d8-a745-b6cbaf37b630" status: 200 len: 1477 microversion: 2.1 time: 0.149976 Oct 08 21:23:55.397656 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2772/5619] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:23:55 2022] GET /compute/v2.1/servers/9c171da3-7c06-45d8-a745-b6cbaf37b630 => generated 1477 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:23:55.479561 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-66407d69-bc56-476d-b3b9-cba71d35bd8d tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:23:55.497393 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-66407d69-bc56-476d-b3b9-cba71d35bd8d tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62" status: 200 len: 1670 microversion: 2.1 time: 0.209206 Oct 08 21:23:55.505985 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2848/5620] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:23:55 2022] GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62 => generated 1670 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:23:55.519230 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-dc62e3dc-1828-4506-a867-b8baedff8704 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:23:55.519855 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-dc62e3dc-1828-4506-a867-b8baedff8704 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 2a61f287-652b-487f-9ecd-fb4d2d1eee62] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:23:55.526143 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dc62e3dc-1828-4506-a867-b8baedff8704 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:55.526645 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dc62e3dc-1828-4506-a867-b8baedff8704 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:55.527094 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dc62e3dc-1828-4506-a867-b8baedff8704 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:55.527806 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dc62e3dc-1828-4506-a867-b8baedff8704 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:55.528270 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dc62e3dc-1828-4506-a867-b8baedff8704 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:55.528703 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dc62e3dc-1828-4506-a867-b8baedff8704 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:55.758712 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-dc62e3dc-1828-4506-a867-b8baedff8704 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:23:55.768252 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-dc62e3dc-1828-4506-a867-b8baedff8704 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62" status: 200 len: 1670 microversion: 2.1 time: 0.252831 Oct 08 21:23:55.785793 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2773/5621] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:23:55 2022] GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62 => generated 1670 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:23:55.796241 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-4aeae9e9-1c64-4e0a-93aa-8818b9ca7b3f tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:23:55.797030 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-4aeae9e9-1c64-4e0a-93aa-8818b9ca7b3f tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 2a61f287-652b-487f-9ecd-fb4d2d1eee62] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:23:55.803706 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4aeae9e9-1c64-4e0a-93aa-8818b9ca7b3f tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:55.804217 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4aeae9e9-1c64-4e0a-93aa-8818b9ca7b3f tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:55.804810 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4aeae9e9-1c64-4e0a-93aa-8818b9ca7b3f tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:55.805598 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4aeae9e9-1c64-4e0a-93aa-8818b9ca7b3f tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:55.806077 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4aeae9e9-1c64-4e0a-93aa-8818b9ca7b3f tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:55.806685 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4aeae9e9-1c64-4e0a-93aa-8818b9ca7b3f tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:55.978283 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-4aeae9e9-1c64-4e0a-93aa-8818b9ca7b3f tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:23:55.982851 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:23:55.991879 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-4aeae9e9-1c64-4e0a-93aa-8818b9ca7b3f tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62" status: 200 len: 1670 microversion: 2.1 time: 0.202415 Oct 08 21:23:55.992839 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2849/5622] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:23:55 2022] GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62 => generated 1670 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:23:56.014710 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-0a26e23b-7bca-494e-8703-d65d1ce96ced tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:23:56.015308 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-0a26e23b-7bca-494e-8703-d65d1ce96ced tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 2a61f287-652b-487f-9ecd-fb4d2d1eee62] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:23:56.022466 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0a26e23b-7bca-494e-8703-d65d1ce96ced tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:56.022971 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0a26e23b-7bca-494e-8703-d65d1ce96ced tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:56.023953 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0a26e23b-7bca-494e-8703-d65d1ce96ced tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:56.024865 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0a26e23b-7bca-494e-8703-d65d1ce96ced tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:56.025590 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0a26e23b-7bca-494e-8703-d65d1ce96ced tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:56.026191 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0a26e23b-7bca-494e-8703-d65d1ce96ced tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:56.029250 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:23:56.056385 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.objects.instance [None req-0a26e23b-7bca-494e-8703-d65d1ce96ced tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lazy-loading 'flavor' on Instance uuid 2a61f287-652b-487f-9ecd-fb4d2d1eee62 {{(pid=140491) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 21:23:56.143326 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-0a26e23b-7bca-494e-8703-d65d1ce96ced tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "POST /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62/action" status: 202 len: 0 microversion: 2.1 time: 0.132665 Oct 08 21:23:56.144190 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2774/5623] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:23:56 2022] POST /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62/action => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 21:23:56.153706 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-3d7a6834-642d-4ab7-aea6-a00e9fe5d7f3 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:23:56.154954 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-3d7a6834-642d-4ab7-aea6-a00e9fe5d7f3 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 2a61f287-652b-487f-9ecd-fb4d2d1eee62] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:23:56.170047 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3d7a6834-642d-4ab7-aea6-a00e9fe5d7f3 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:56.170643 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3d7a6834-642d-4ab7-aea6-a00e9fe5d7f3 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:56.171220 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3d7a6834-642d-4ab7-aea6-a00e9fe5d7f3 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:56.172260 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3d7a6834-642d-4ab7-aea6-a00e9fe5d7f3 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:56.172869 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3d7a6834-642d-4ab7-aea6-a00e9fe5d7f3 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:56.173351 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3d7a6834-642d-4ab7-aea6-a00e9fe5d7f3 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:56.342087 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-3d7a6834-642d-4ab7-aea6-a00e9fe5d7f3 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:23:56.368005 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-3d7a6834-642d-4ab7-aea6-a00e9fe5d7f3 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62" status: 200 len: 1678 microversion: 2.1 time: 0.219228 Oct 08 21:23:56.368725 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2850/5624] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:23:56 2022] GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62 => generated 1678 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:23:56.420484 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-4f3f9cb2-1605-43b3-af52-5e06f9a9db87 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:23:56.421412 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-4f3f9cb2-1605-43b3-af52-5e06f9a9db87 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] [instance: 9c171da3-7c06-45d8-a745-b6cbaf37b630] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:23:56.428662 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4f3f9cb2-1605-43b3-af52-5e06f9a9db87 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:56.429163 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4f3f9cb2-1605-43b3-af52-5e06f9a9db87 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:56.430260 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4f3f9cb2-1605-43b3-af52-5e06f9a9db87 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:56.430977 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4f3f9cb2-1605-43b3-af52-5e06f9a9db87 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:56.431436 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4f3f9cb2-1605-43b3-af52-5e06f9a9db87 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:56.431865 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4f3f9cb2-1605-43b3-af52-5e06f9a9db87 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:56.468558 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4f3f9cb2-1605-43b3-af52-5e06f9a9db87 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:56.469060 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4f3f9cb2-1605-43b3-af52-5e06f9a9db87 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:56.469538 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4f3f9cb2-1605-43b3-af52-5e06f9a9db87 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:56.470002 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.objects.instance [None req-4f3f9cb2-1605-43b3-af52-5e06f9a9db87 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Lazy-loading 'fault' on Instance uuid 9c171da3-7c06-45d8-a745-b6cbaf37b630 {{(pid=140491) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 21:23:56.577835 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-4f3f9cb2-1605-43b3-af52-5e06f9a9db87 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a0d81fb2dd4891901f27890ce7688e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fd83b3bdef4ba18ba56a9385e26d01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:23:56.585470 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-4f3f9cb2-1605-43b3-af52-5e06f9a9db87 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] 10.222.0.26 "GET /compute/v2.1/servers/9c171da3-7c06-45d8-a745-b6cbaf37b630" status: 200 len: 1331 microversion: 2.1 time: 0.169170 Oct 08 21:23:56.586606 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2775/5625] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:23:56 2022] GET /compute/v2.1/servers/9c171da3-7c06-45d8-a745-b6cbaf37b630 => generated 1331 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:23:57.392083 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-53eaa852-1ebc-4e1e-9032-7805fe421c36 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:23:57.393035 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-53eaa852-1ebc-4e1e-9032-7805fe421c36 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 2a61f287-652b-487f-9ecd-fb4d2d1eee62] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:23:57.402512 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-53eaa852-1ebc-4e1e-9032-7805fe421c36 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:57.403193 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-53eaa852-1ebc-4e1e-9032-7805fe421c36 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:57.403861 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-53eaa852-1ebc-4e1e-9032-7805fe421c36 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:57.404808 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-53eaa852-1ebc-4e1e-9032-7805fe421c36 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:57.405317 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-53eaa852-1ebc-4e1e-9032-7805fe421c36 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:57.405767 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-53eaa852-1ebc-4e1e-9032-7805fe421c36 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:57.557799 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-53eaa852-1ebc-4e1e-9032-7805fe421c36 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:23:57.565978 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-53eaa852-1ebc-4e1e-9032-7805fe421c36 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62" status: 200 len: 1661 microversion: 2.1 time: 0.177896 Oct 08 21:23:57.566629 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2851/5626] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:23:57 2022] GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62 => generated 1661 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:23:57.594634 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-107ea812-50c6-49fe-b3ca-e9abefcb68aa tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:23:57.595363 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-107ea812-50c6-49fe-b3ca-e9abefcb68aa tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 2a61f287-652b-487f-9ecd-fb4d2d1eee62] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:23:57.603257 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-107ea812-50c6-49fe-b3ca-e9abefcb68aa tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:57.604008 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-107ea812-50c6-49fe-b3ca-e9abefcb68aa tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:57.604615 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-107ea812-50c6-49fe-b3ca-e9abefcb68aa tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:57.605830 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-107ea812-50c6-49fe-b3ca-e9abefcb68aa tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:57.606463 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-107ea812-50c6-49fe-b3ca-e9abefcb68aa tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:57.606891 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-107ea812-50c6-49fe-b3ca-e9abefcb68aa tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:57.611666 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-83343bfa-ebfe-411e-897d-78512f86e6e3 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:23:57.611666 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-83343bfa-ebfe-411e-897d-78512f86e6e3 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] [instance: 9c171da3-7c06-45d8-a745-b6cbaf37b630] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:23:57.619400 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-83343bfa-ebfe-411e-897d-78512f86e6e3 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:57.620019 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-83343bfa-ebfe-411e-897d-78512f86e6e3 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:57.620580 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-83343bfa-ebfe-411e-897d-78512f86e6e3 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:57.621446 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-83343bfa-ebfe-411e-897d-78512f86e6e3 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:57.622246 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-83343bfa-ebfe-411e-897d-78512f86e6e3 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:57.622791 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-83343bfa-ebfe-411e-897d-78512f86e6e3 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:57.642641 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-83343bfa-ebfe-411e-897d-78512f86e6e3 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] HTTP exception thrown: Instance 9c171da3-7c06-45d8-a745-b6cbaf37b630 could not be found. Oct 08 21:23:57.646168 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-83343bfa-ebfe-411e-897d-78512f86e6e3 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Request method failure captured: Oct 08 21:23:57.646168 ncdv-master-1 devstack@n-api.service[140492]: request: GET /compute/v2.1/servers/9c171da3-7c06-45d8-a745-b6cbaf37b630 HTTP/1.1 Oct 08 21:23:57.646168 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:23:57.646168 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:23:57.646168 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:23:57.646168 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 21:23:57.646168 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:23:57.646168 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:23:57.646168 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:23:57.646168 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:23:57.646168 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeoT3YmNxm_lFxZPMMvXR5jbwJjYnpGXQqDg7Livc_cMqEuohY4AgztTX-AeGR0cDEG_vvOTDlkZchrd2DieRIqXleShUh3nyxH1lTqvPhAmMzPa6zFOyIdjxENunO4MxTb2NC9_dhD1uXJyvjalM6HuaSTuflLpySwMdzg6ThtWmAg Oct 08 21:23:57.646168 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:23:57.646168 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:23:57.646168 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:23:57.646168 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:23:57.646168 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:23:57.646168 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:23:57.646168 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: e5fd83b3bdef4ba18ba56a9385e26d01 Oct 08 21:23:57.646168 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1247845187 Oct 08 21:23:57.646168 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:23:57.646168 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:23:57.646168 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/e5fd83b3bdef4ba18ba56a9385e26d01"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e5fd83b3bdef4ba18ba56a9385e26d01"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_e5fd83b3bdef4ba18ba56a9385e26d01"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e5fd83b3bdef4ba18ba56a9385e26d01"}]}] Oct 08 21:23:57.646168 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1247845187 Oct 08 21:23:57.646168 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: e5fd83b3bdef4ba18ba56a9385e26d01 Oct 08 21:23:57.646168 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1247845187 Oct 08 21:23:57.646168 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-TestSecurityGroupsBasicOps-1247845187-project Oct 08 21:23:57.646168 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:23:57.646168 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:23:57.646168 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 33a0d81fb2dd4891901f27890ce7688e Oct 08 21:23:57.646168 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1247845187-project Oct 08 21:23:57.646168 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 21:23:57.646168 ncdv-master-1 devstack@n-api.service[140492]: exception: Instance 9c171da3-7c06-45d8-a745-b6cbaf37b630 could not be found. Oct 08 21:23:57.646168 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': '9c171da3-7c06-45d8-a745-b6cbaf37b630'} Oct 08 21:23:57.646168 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:23:57.646168 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:23:57.646168 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:23:57.646168 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:23:57.646168 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:23:57.646168 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:23:57.646168 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:23:57.646168 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:23:57.646168 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:23:57.646168 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:23:57.646168 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c171da3-7c06-45d8-a745-b6cbaf37b630 could not be found. Oct 08 21:23:57.646168 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:23:57.646168 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:23:57.646168 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:23:57.646168 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:23:57.646168 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:23:57.646168 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:23:57.646168 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:23:57.646168 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:23:57.646168 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:23:57.646168 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:23:57.646168 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:23:57.646168 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:23:57.646168 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:23:57.646168 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:23:57.646168 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:23:57.646168 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:23:57.646168 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c171da3-7c06-45d8-a745-b6cbaf37b630 could not be found. Oct 08 21:23:57.646168 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:23:57.646168 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:23:57.658653 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:23:57.658653 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:23:57.658653 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:23:57.658653 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:23:57.658653 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:23:57.658653 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:23:57.658653 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c171da3-7c06-45d8-a745-b6cbaf37b630 could not be found. Oct 08 21:23:57.658653 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:23:57.658653 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-83343bfa-ebfe-411e-897d-78512f86e6e3 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Returning 404 to user: Instance 9c171da3-7c06-45d8-a745-b6cbaf37b630 could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:23:57.658653 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-83343bfa-ebfe-411e-897d-78512f86e6e3 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] 10.222.0.26 "GET /compute/v2.1/servers/9c171da3-7c06-45d8-a745-b6cbaf37b630" status: 404 len: 111 microversion: 2.1 time: 0.042518 Oct 08 21:23:57.658653 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2852/5627] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:23:57 2022] GET /compute/v2.1/servers/9c171da3-7c06-45d8-a745-b6cbaf37b630 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:23:57.678484 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-b9af57ba-c990-4bae-9927-0a07b6568939 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:23:57.679073 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-b9af57ba-c990-4bae-9927-0a07b6568939 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] [instance: 3395e57f-ceb7-4984-940c-d9ee3c93b370] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:23:57.687838 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b9af57ba-c990-4bae-9927-0a07b6568939 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:57.688842 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b9af57ba-c990-4bae-9927-0a07b6568939 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:57.689654 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b9af57ba-c990-4bae-9927-0a07b6568939 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:57.690485 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b9af57ba-c990-4bae-9927-0a07b6568939 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:57.691117 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b9af57ba-c990-4bae-9927-0a07b6568939 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:57.691873 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b9af57ba-c990-4bae-9927-0a07b6568939 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:57.699663 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-107ea812-50c6-49fe-b3ca-e9abefcb68aa tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "POST /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62/action" status: 202 len: 0 microversion: 2.1 time: 0.109781 Oct 08 21:23:57.700483 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2776/5628] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:23:57 2022] POST /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 21:23:57.723122 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-0318ee35-c3a6-4a2d-9c96-033993bd9a32 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:23:57.725014 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-0318ee35-c3a6-4a2d-9c96-033993bd9a32 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 2a61f287-652b-487f-9ecd-fb4d2d1eee62] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:23:57.736051 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0318ee35-c3a6-4a2d-9c96-033993bd9a32 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:57.736828 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0318ee35-c3a6-4a2d-9c96-033993bd9a32 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:57.737484 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0318ee35-c3a6-4a2d-9c96-033993bd9a32 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:57.738563 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0318ee35-c3a6-4a2d-9c96-033993bd9a32 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:57.739304 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0318ee35-c3a6-4a2d-9c96-033993bd9a32 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:57.739775 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-b9af57ba-c990-4bae-9927-0a07b6568939 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] [instance: 3395e57f-ceb7-4984-940c-d9ee3c93b370] Going to try to terminate instance {{(pid=140492) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 21:23:57.740245 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0318ee35-c3a6-4a2d-9c96-033993bd9a32 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:57.924548 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-b9af57ba-c990-4bae-9927-0a07b6568939 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] 10.222.0.26 "DELETE /compute/v2.1/servers/3395e57f-ceb7-4984-940c-d9ee3c93b370" status: 204 len: 0 microversion: 2.1 time: 0.251707 Oct 08 21:23:57.925481 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2853/5629] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:23:57 2022] DELETE /compute/v2.1/servers/3395e57f-ceb7-4984-940c-d9ee3c93b370 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 21:23:57.934480 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-97fc5e33-3d2a-47f1-9051-b8a1bb896b01 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:23:57.935202 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-97fc5e33-3d2a-47f1-9051-b8a1bb896b01 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] [instance: 3395e57f-ceb7-4984-940c-d9ee3c93b370] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:23:57.952722 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-97fc5e33-3d2a-47f1-9051-b8a1bb896b01 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:57.953320 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-97fc5e33-3d2a-47f1-9051-b8a1bb896b01 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:57.953781 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-97fc5e33-3d2a-47f1-9051-b8a1bb896b01 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:57.954516 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-97fc5e33-3d2a-47f1-9051-b8a1bb896b01 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:57.954983 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-97fc5e33-3d2a-47f1-9051-b8a1bb896b01 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:57.955418 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-97fc5e33-3d2a-47f1-9051-b8a1bb896b01 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:58.089247 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-0318ee35-c3a6-4a2d-9c96-033993bd9a32 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:23:58.097388 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-0318ee35-c3a6-4a2d-9c96-033993bd9a32 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62" status: 200 len: 1667 microversion: 2.1 time: 0.392536 Oct 08 21:23:58.097977 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2777/5630] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:23:57 2022] GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62 => generated 1667 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:23:58.598567 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-97fc5e33-3d2a-47f1-9051-b8a1bb896b01 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e28f7acd53094828a7863ce2fd775cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b37e8634ac448ea9a86aff144098dd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:23:58.608062 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-97fc5e33-3d2a-47f1-9051-b8a1bb896b01 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] 10.222.0.26 "GET /compute/v2.1/servers/3395e57f-ceb7-4984-940c-d9ee3c93b370" status: 200 len: 1551 microversion: 2.1 time: 0.678282 Oct 08 21:23:58.608656 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2854/5631] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:23:57 2022] GET /compute/v2.1/servers/3395e57f-ceb7-4984-940c-d9ee3c93b370 => generated 1551 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:23:59.123517 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-0b6f5287-2e54-414d-93be-387be3d7d9d2 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:23:59.124534 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-0b6f5287-2e54-414d-93be-387be3d7d9d2 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 2a61f287-652b-487f-9ecd-fb4d2d1eee62] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:23:59.136362 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0b6f5287-2e54-414d-93be-387be3d7d9d2 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:59.136952 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0b6f5287-2e54-414d-93be-387be3d7d9d2 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:59.137680 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0b6f5287-2e54-414d-93be-387be3d7d9d2 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:59.139036 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0b6f5287-2e54-414d-93be-387be3d7d9d2 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:59.139621 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0b6f5287-2e54-414d-93be-387be3d7d9d2 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:59.140610 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0b6f5287-2e54-414d-93be-387be3d7d9d2 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:59.304178 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-0b6f5287-2e54-414d-93be-387be3d7d9d2 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:23:59.316477 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-0b6f5287-2e54-414d-93be-387be3d7d9d2 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62" status: 200 len: 1667 microversion: 2.1 time: 0.197221 Oct 08 21:23:59.321225 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2778/5632] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:23:59 2022] GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62 => generated 1667 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:23:59.634286 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-03952a9e-eb8f-4adc-b11c-31f35b48c4b2 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:23:59.635684 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-03952a9e-eb8f-4adc-b11c-31f35b48c4b2 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] [instance: 3395e57f-ceb7-4984-940c-d9ee3c93b370] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:23:59.643752 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-03952a9e-eb8f-4adc-b11c-31f35b48c4b2 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:59.644260 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-03952a9e-eb8f-4adc-b11c-31f35b48c4b2 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:59.645214 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-03952a9e-eb8f-4adc-b11c-31f35b48c4b2 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:59.646346 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-03952a9e-eb8f-4adc-b11c-31f35b48c4b2 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:23:59.647072 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-03952a9e-eb8f-4adc-b11c-31f35b48c4b2 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:23:59.647630 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-03952a9e-eb8f-4adc-b11c-31f35b48c4b2 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:23:59.977480 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-03952a9e-eb8f-4adc-b11c-31f35b48c4b2 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e28f7acd53094828a7863ce2fd775cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b37e8634ac448ea9a86aff144098dd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:23:59.988841 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-03952a9e-eb8f-4adc-b11c-31f35b48c4b2 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] 10.222.0.26 "GET /compute/v2.1/servers/3395e57f-ceb7-4984-940c-d9ee3c93b370" status: 200 len: 1551 microversion: 2.1 time: 0.359965 Oct 08 21:23:59.989712 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2855/5633] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:23:59 2022] GET /compute/v2.1/servers/3395e57f-ceb7-4984-940c-d9ee3c93b370 => generated 1551 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:24:00.202543 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-ae2a23a3-98a0-4225-a355-8e8af37b2b77 req-d04724b2-980e-4d5c-988e-dff16922fc61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3395e57f-ceb7-4984-940c-d9ee3c93b370", "name": "network-vif-deleted", "tag": "acf8150a-ade0-4204-8e17-ea175dcb345a"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:24:00.210196 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=1 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:24:00.218767 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-ae2a23a3-98a0-4225-a355-8e8af37b2b77 req-d04724b2-980e-4d5c-988e-dff16922fc61 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:00.219682 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-ae2a23a3-98a0-4225-a355-8e8af37b2b77 req-d04724b2-980e-4d5c-988e-dff16922fc61 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:00.220300 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-ae2a23a3-98a0-4225-a355-8e8af37b2b77 req-d04724b2-980e-4d5c-988e-dff16922fc61 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:00.240850 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-ae2a23a3-98a0-4225-a355-8e8af37b2b77 req-d04724b2-980e-4d5c-988e-dff16922fc61 service nova] Creating event network-vif-deleted:acf8150a-ade0-4204-8e17-ea175dcb345a for instance 3395e57f-ceb7-4984-940c-d9ee3c93b370 on nch2-master-1 Oct 08 21:24:00.252561 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-ae2a23a3-98a0-4225-a355-8e8af37b2b77 req-d04724b2-980e-4d5c-988e-dff16922fc61 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054040 Oct 08 21:24:00.253943 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2779/5634] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:24:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:24:00.343197 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-77765e76-0106-4e68-b7ec-0106649b8854 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:24:00.344117 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-77765e76-0106-4e68-b7ec-0106649b8854 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 2a61f287-652b-487f-9ecd-fb4d2d1eee62] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:24:00.353524 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-77765e76-0106-4e68-b7ec-0106649b8854 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:00.354447 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-77765e76-0106-4e68-b7ec-0106649b8854 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:00.355391 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-77765e76-0106-4e68-b7ec-0106649b8854 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:00.357305 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-77765e76-0106-4e68-b7ec-0106649b8854 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:00.358192 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-77765e76-0106-4e68-b7ec-0106649b8854 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:00.359100 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-77765e76-0106-4e68-b7ec-0106649b8854 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:00.665975 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-77765e76-0106-4e68-b7ec-0106649b8854 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:24:00.675159 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-77765e76-0106-4e68-b7ec-0106649b8854 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62" status: 200 len: 1670 microversion: 2.1 time: 0.336495 Oct 08 21:24:00.676039 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2856/5635] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:24:00 2022] GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62 => generated 1670 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:24:00.700756 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-e4028dc9-bdaf-4c2f-a9fb-c255a3498603 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:24:00.701769 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-e4028dc9-bdaf-4c2f-a9fb-c255a3498603 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 2a61f287-652b-487f-9ecd-fb4d2d1eee62] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:24:00.708487 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e4028dc9-bdaf-4c2f-a9fb-c255a3498603 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:00.709408 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e4028dc9-bdaf-4c2f-a9fb-c255a3498603 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:00.710041 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e4028dc9-bdaf-4c2f-a9fb-c255a3498603 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:00.711067 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e4028dc9-bdaf-4c2f-a9fb-c255a3498603 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:00.711549 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e4028dc9-bdaf-4c2f-a9fb-c255a3498603 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:00.711991 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e4028dc9-bdaf-4c2f-a9fb-c255a3498603 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:00.874497 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-e4028dc9-bdaf-4c2f-a9fb-c255a3498603 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:24:00.885410 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-e4028dc9-bdaf-4c2f-a9fb-c255a3498603 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62" status: 200 len: 1670 microversion: 2.1 time: 0.190481 Oct 08 21:24:00.893235 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2780/5636] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:24:00 2022] GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62 => generated 1670 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:24:00.910193 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-a84eff63-e69b-4683-9419-0d1deed95e24 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:24:00.911062 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-a84eff63-e69b-4683-9419-0d1deed95e24 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: e13ba2a1-731c-4fc7-b8d2-db3ce6199eb6] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:24:00.918177 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a84eff63-e69b-4683-9419-0d1deed95e24 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:00.918794 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a84eff63-e69b-4683-9419-0d1deed95e24 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:00.919307 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a84eff63-e69b-4683-9419-0d1deed95e24 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:00.920419 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a84eff63-e69b-4683-9419-0d1deed95e24 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:00.921060 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a84eff63-e69b-4683-9419-0d1deed95e24 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:00.921902 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a84eff63-e69b-4683-9419-0d1deed95e24 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:00.957842 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-a84eff63-e69b-4683-9419-0d1deed95e24 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: e13ba2a1-731c-4fc7-b8d2-db3ce6199eb6] Going to try to terminate instance {{(pid=140492) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 21:24:00.972559 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.compute.api [None req-a84eff63-e69b-4683-9419-0d1deed95e24 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: e13ba2a1-731c-4fc7-b8d2-db3ce6199eb6] Working on deleting snapshot b84ca7b0-0dc8-4201-80aa-b56e9d976b5d from shelved instance... Oct 08 21:24:01.016963 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-971345ae-c0fc-47c7-bb5e-d8ce1a6633b2 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:24:01.019066 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-971345ae-c0fc-47c7-bb5e-d8ce1a6633b2 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] [instance: 3395e57f-ceb7-4984-940c-d9ee3c93b370] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:24:01.028230 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-971345ae-c0fc-47c7-bb5e-d8ce1a6633b2 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:01.028862 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-971345ae-c0fc-47c7-bb5e-d8ce1a6633b2 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:01.029475 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-971345ae-c0fc-47c7-bb5e-d8ce1a6633b2 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:01.030488 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-971345ae-c0fc-47c7-bb5e-d8ce1a6633b2 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:01.031021 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-971345ae-c0fc-47c7-bb5e-d8ce1a6633b2 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:01.031595 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-971345ae-c0fc-47c7-bb5e-d8ce1a6633b2 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:01.048673 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-971345ae-c0fc-47c7-bb5e-d8ce1a6633b2 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] HTTP exception thrown: Instance 3395e57f-ceb7-4984-940c-d9ee3c93b370 could not be found. Oct 08 21:24:01.052042 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-971345ae-c0fc-47c7-bb5e-d8ce1a6633b2 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Request method failure captured: Oct 08 21:24:01.052042 ncdv-master-1 devstack@n-api.service[140491]: request: GET /compute/v2.1/servers/3395e57f-ceb7-4984-940c-d9ee3c93b370 HTTP/1.1 Oct 08 21:24:01.052042 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:24:01.052042 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:24:01.052042 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:24:01.052042 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 21:24:01.052042 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:24:01.052042 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:24:01.052042 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:24:01.052042 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:24:01.052042 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQen2S80x1CVAlKwCKZntNH5PQxsmQrq_ROUHyrV4X31LhiiSU0yhqEtSekpzTTt2ymhi_iUL7E8k1oIHYa5XRaIume53jrgq0WDi_uXqQ958DwZ_WEYlLYkPCXMEFlt2hc471wf2KjXPAn83Av9koEdzGk5iNdFNlgkHhLBvVzKU0ZA Oct 08 21:24:01.052042 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:24:01.052042 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:24:01.052042 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:24:01.052042 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:24:01.052042 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:24:01.052042 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:24:01.052042 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 9b37e8634ac448ea9a86aff144098dd4 Oct 08 21:24:01.052042 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-TestNetworkBasicOps-2013528848 Oct 08 21:24:01.052042 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:24:01.052042 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:24:01.052042 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9b37e8634ac448ea9a86aff144098dd4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9b37e8634ac448ea9a86aff144098dd4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9b37e8634ac448ea9a86aff144098dd4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9b37e8634ac448ea9a86aff144098dd4"}]}] Oct 08 21:24:01.052042 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-TestNetworkBasicOps-2013528848 Oct 08 21:24:01.052042 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 9b37e8634ac448ea9a86aff144098dd4 Oct 08 21:24:01.052042 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-TestNetworkBasicOps-2013528848 Oct 08 21:24:01.052042 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-TestNetworkBasicOps-2013528848-project Oct 08 21:24:01.052042 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:24:01.052042 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:24:01.052042 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: e28f7acd53094828a7863ce2fd775cdf Oct 08 21:24:01.052042 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-TestNetworkBasicOps-2013528848-project Oct 08 21:24:01.052042 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:24:01.052042 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance 3395e57f-ceb7-4984-940c-d9ee3c93b370 could not be found. Oct 08 21:24:01.052042 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': '3395e57f-ceb7-4984-940c-d9ee3c93b370'} Oct 08 21:24:01.052042 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:24:01.052042 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:24:01.052042 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:24:01.052042 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:24:01.052042 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:24:01.052042 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:24:01.052042 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:24:01.052042 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:24:01.052042 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:24:01.052042 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:24:01.052042 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3395e57f-ceb7-4984-940c-d9ee3c93b370 could not be found. Oct 08 21:24:01.052042 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:24:01.052042 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:24:01.052042 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:24:01.052042 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:24:01.052042 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:24:01.052042 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:24:01.052042 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:24:01.052042 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:24:01.052042 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:24:01.052042 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:24:01.052042 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:24:01.052042 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:24:01.052042 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:24:01.052042 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:24:01.052042 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:24:01.052042 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:24:01.052042 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3395e57f-ceb7-4984-940c-d9ee3c93b370 could not be found. Oct 08 21:24:01.052042 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:24:01.052042 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:24:01.052042 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:24:01.057461 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:24:01.057461 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:24:01.057461 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:24:01.057461 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:24:01.057461 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:24:01.057461 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3395e57f-ceb7-4984-940c-d9ee3c93b370 could not be found. Oct 08 21:24:01.057461 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:24:01.057461 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-971345ae-c0fc-47c7-bb5e-d8ce1a6633b2 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Returning 404 to user: Instance 3395e57f-ceb7-4984-940c-d9ee3c93b370 could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:24:01.057461 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-971345ae-c0fc-47c7-bb5e-d8ce1a6633b2 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] 10.222.0.26 "GET /compute/v2.1/servers/3395e57f-ceb7-4984-940c-d9ee3c93b370" status: 404 len: 111 microversion: 2.1 time: 0.044571 Oct 08 21:24:01.057461 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2781/5637] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:24:01 2022] GET /compute/v2.1/servers/3395e57f-ceb7-4984-940c-d9ee3c93b370 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:24:01.262359 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-3f6f2adf-93b7-48a1-846e-d78f51bb2564 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Calling method '.version_select at 0x7f1a87767af0>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:24:01.310017 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-3f6f2adf-93b7-48a1-846e-d78f51bb2564 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-60361384" status: 202 len: 0 microversion: 2.1 time: 0.052558 Oct 08 21:24:01.314453 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2782/5638] 10.222.0.26 () {58 vars in 1251 bytes} [Sat Oct 8 21:24:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-60361384 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 21:24:01.953127 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-a84eff63-e69b-4683-9419-0d1deed95e24 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: e13ba2a1-731c-4fc7-b8d2-db3ce6199eb6] Doing local delete in cell 1a13ecad-3f87-496d-a2c5-ac44667fd176(cell1) {{(pid=140492) _delete /opt/stack/nova/nova/compute/api.py:2546}} Oct 08 21:24:01.955410 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a84eff63-e69b-4683-9419-0d1deed95e24 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:01.956654 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a84eff63-e69b-4683-9419-0d1deed95e24 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:01.957316 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a84eff63-e69b-4683-9419-0d1deed95e24 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:01.958139 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.compute.api [None req-a84eff63-e69b-4683-9419-0d1deed95e24 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: e13ba2a1-731c-4fc7-b8d2-db3ce6199eb6] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Oct 08 21:24:01.963992 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.network.neutron [None req-a84eff63-e69b-4683-9419-0d1deed95e24 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: e13ba2a1-731c-4fc7-b8d2-db3ce6199eb6] deallocate_for_instance() {{(pid=140492) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Oct 08 21:24:02.614036 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.network.neutron [None req-a84eff63-e69b-4683-9419-0d1deed95e24 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: e13ba2a1-731c-4fc7-b8d2-db3ce6199eb6] Updating instance_info_cache with network_info: [] {{(pid=140492) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 08 21:24:02.638636 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-d39bf5eb-feec-40ba-8d30-0656edfbeb19 req-58f4b61b-96b7-4d0c-b6ab-1452498c37d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e13ba2a1-731c-4fc7-b8d2-db3ce6199eb6", "name": "network-vif-deleted", "tag": "25d82e2d-1449-4722-9702-e6ba8fcc3322"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:24:02.654340 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-d39bf5eb-feec-40ba-8d30-0656edfbeb19 req-58f4b61b-96b7-4d0c-b6ab-1452498c37d1 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:02.655846 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-d39bf5eb-feec-40ba-8d30-0656edfbeb19 req-58f4b61b-96b7-4d0c-b6ab-1452498c37d1 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:02.656694 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-d39bf5eb-feec-40ba-8d30-0656edfbeb19 req-58f4b61b-96b7-4d0c-b6ab-1452498c37d1 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:02.671553 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.compute.server_external_events [req-d39bf5eb-feec-40ba-8d30-0656edfbeb19 req-58f4b61b-96b7-4d0c-b6ab-1452498c37d1 service nova] Unable to find a host for instance e13ba2a1-731c-4fc7-b8d2-db3ce6199eb6. Dropping event network-vif-deleted {{(pid=140491) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 08 21:24:02.673172 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-d39bf5eb-feec-40ba-8d30-0656edfbeb19 req-58f4b61b-96b7-4d0c-b6ab-1452498c37d1 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.049726 Oct 08 21:24:02.674409 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2783/5639] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:24:02 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 51 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 08 21:24:02.827046 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-a84eff63-e69b-4683-9419-0d1deed95e24 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "DELETE /compute/v2.1/servers/e13ba2a1-731c-4fc7-b8d2-db3ce6199eb6" status: 204 len: 0 microversion: 2.1 time: 1.921287 Oct 08 21:24:02.828508 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2857/5640] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:24:00 2022] DELETE /compute/v2.1/servers/e13ba2a1-731c-4fc7-b8d2-db3ce6199eb6 => generated 0 bytes in 1923 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 21:24:02.862329 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-720af19e-ed9d-4fca-b3da-ab5433171c63 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:24:02.864498 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-720af19e-ed9d-4fca-b3da-ab5433171c63 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: e13ba2a1-731c-4fc7-b8d2-db3ce6199eb6] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:24:02.888935 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-720af19e-ed9d-4fca-b3da-ab5433171c63 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:02.889648 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-720af19e-ed9d-4fca-b3da-ab5433171c63 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:02.890155 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-720af19e-ed9d-4fca-b3da-ab5433171c63 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:02.891284 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-720af19e-ed9d-4fca-b3da-ab5433171c63 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:02.891905 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-720af19e-ed9d-4fca-b3da-ab5433171c63 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:02.892501 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-720af19e-ed9d-4fca-b3da-ab5433171c63 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:02.915134 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-720af19e-ed9d-4fca-b3da-ab5433171c63 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] HTTP exception thrown: Instance e13ba2a1-731c-4fc7-b8d2-db3ce6199eb6 could not be found. Oct 08 21:24:02.916962 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-720af19e-ed9d-4fca-b3da-ab5433171c63 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Request method failure captured: Oct 08 21:24:02.916962 ncdv-master-1 devstack@n-api.service[140491]: request: GET /compute/v2.1/servers/e13ba2a1-731c-4fc7-b8d2-db3ce6199eb6 HTTP/1.1 Oct 08 21:24:02.916962 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:24:02.916962 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:24:02.916962 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:24:02.916962 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 21:24:02.916962 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:24:02.916962 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:24:02.916962 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:24:02.916962 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:24:02.916962 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQejiYlaPI-JtqvK14aYdk5AJQZ9Rj0WfXfezm3HghOQHCqDAnzzaGqHnmcxTg9_bQH8N_IiErrzdvkHM9CcLpkI8dflyFrbZJ8oohauamjv0z3cmdzo6PpuDpJEm2ViNPKrmyHelDYEhGxb7y4b1zyM2T-OENcW1NDh2QOCLmS2DfCA Oct 08 21:24:02.916962 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:24:02.916962 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:24:02.916962 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:24:02.916962 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:24:02.916962 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:24:02.916962 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:24:02.916962 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: bd563fa73afb42c6b26eca3737d7a355 Oct 08 21:24:02.916962 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-ServerActionsTestJSON-1611357772 Oct 08 21:24:02.916962 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:24:02.916962 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:24:02.916962 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/bd563fa73afb42c6b26eca3737d7a355"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/bd563fa73afb42c6b26eca3737d7a355"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_bd563fa73afb42c6b26eca3737d7a355"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/bd563fa73afb42c6b26eca3737d7a355"}]}] Oct 08 21:24:02.916962 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-ServerActionsTestJSON-1611357772 Oct 08 21:24:02.916962 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: bd563fa73afb42c6b26eca3737d7a355 Oct 08 21:24:02.916962 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-ServerActionsTestJSON-1611357772 Oct 08 21:24:02.916962 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-ServerActionsTestJSON-1611357772-project Oct 08 21:24:02.916962 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:24:02.916962 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:24:02.916962 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 2f98e01cab6b49c7a5d239aee95f4a64 Oct 08 21:24:02.916962 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-ServerActionsTestJSON-1611357772-project Oct 08 21:24:02.916962 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:24:02.916962 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance e13ba2a1-731c-4fc7-b8d2-db3ce6199eb6 could not be found. Oct 08 21:24:02.916962 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': 'e13ba2a1-731c-4fc7-b8d2-db3ce6199eb6'} Oct 08 21:24:02.916962 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:24:02.916962 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:24:02.916962 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:24:02.916962 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:24:02.916962 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:24:02.916962 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:24:02.916962 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:24:02.916962 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:24:02.916962 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:24:02.916962 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:24:02.916962 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e13ba2a1-731c-4fc7-b8d2-db3ce6199eb6 could not be found. Oct 08 21:24:02.916962 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:24:02.916962 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:24:02.916962 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:24:02.916962 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:24:02.916962 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:24:02.916962 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:24:02.916962 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:24:02.916962 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:24:02.916962 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:24:02.916962 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:24:02.916962 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:24:02.916962 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:24:02.916962 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:24:02.916962 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:24:02.916962 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:24:02.916962 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:24:02.916962 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e13ba2a1-731c-4fc7-b8d2-db3ce6199eb6 could not be found. Oct 08 21:24:02.916962 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:24:02.916962 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:24:02.916962 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:24:02.933917 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:24:02.933917 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:24:02.933917 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:24:02.933917 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:24:02.933917 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:24:02.933917 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e13ba2a1-731c-4fc7-b8d2-db3ce6199eb6 could not be found. Oct 08 21:24:02.933917 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:24:02.933917 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-720af19e-ed9d-4fca-b3da-ab5433171c63 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Returning 404 to user: Instance e13ba2a1-731c-4fc7-b8d2-db3ce6199eb6 could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:24:02.933917 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-720af19e-ed9d-4fca-b3da-ab5433171c63 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/e13ba2a1-731c-4fc7-b8d2-db3ce6199eb6" status: 404 len: 111 microversion: 2.1 time: 0.085176 Oct 08 21:24:02.933917 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2784/5641] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:24:02 2022] GET /compute/v2.1/servers/e13ba2a1-731c-4fc7-b8d2-db3ce6199eb6 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:24:02.939536 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-1fa4703f-bd21-4a74-aa2b-24bad2764857 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:24:02.940068 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-1fa4703f-bd21-4a74-aa2b-24bad2764857 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: b55b87f6-54c7-4ae0-a7e3-15755f63ff57] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:24:02.949946 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1fa4703f-bd21-4a74-aa2b-24bad2764857 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:02.950456 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1fa4703f-bd21-4a74-aa2b-24bad2764857 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:02.950964 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1fa4703f-bd21-4a74-aa2b-24bad2764857 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:02.951695 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1fa4703f-bd21-4a74-aa2b-24bad2764857 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:02.955653 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1fa4703f-bd21-4a74-aa2b-24bad2764857 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:02.956213 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1fa4703f-bd21-4a74-aa2b-24bad2764857 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:03.001345 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-1fa4703f-bd21-4a74-aa2b-24bad2764857 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: b55b87f6-54c7-4ae0-a7e3-15755f63ff57] Going to try to terminate instance {{(pid=140492) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 21:24:03.003195 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=17,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:24:03.100139 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-1fa4703f-bd21-4a74-aa2b-24bad2764857 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "DELETE /compute/v2.1/servers/b55b87f6-54c7-4ae0-a7e3-15755f63ff57" status: 204 len: 0 microversion: 2.1 time: 0.172986 Oct 08 21:24:03.105604 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2858/5642] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:24:02 2022] DELETE /compute/v2.1/servers/b55b87f6-54c7-4ae0-a7e3-15755f63ff57 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 21:24:03.114538 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-6554d1ce-dba9-424b-9c85-570aae4cbde2 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:24:03.115523 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-6554d1ce-dba9-424b-9c85-570aae4cbde2 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: b55b87f6-54c7-4ae0-a7e3-15755f63ff57] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:24:03.125150 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6554d1ce-dba9-424b-9c85-570aae4cbde2 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:03.125344 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6554d1ce-dba9-424b-9c85-570aae4cbde2 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:03.126371 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6554d1ce-dba9-424b-9c85-570aae4cbde2 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:03.127399 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6554d1ce-dba9-424b-9c85-570aae4cbde2 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:03.128385 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6554d1ce-dba9-424b-9c85-570aae4cbde2 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:03.128988 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6554d1ce-dba9-424b-9c85-570aae4cbde2 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:03.303263 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-6554d1ce-dba9-424b-9c85-570aae4cbde2 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:24:03.316414 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-6554d1ce-dba9-424b-9c85-570aae4cbde2 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/b55b87f6-54c7-4ae0-a7e3-15755f63ff57" status: 200 len: 1465 microversion: 2.1 time: 0.204878 Oct 08 21:24:03.317434 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2785/5643] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:24:03 2022] GET /compute/v2.1/servers/b55b87f6-54c7-4ae0-a7e3-15755f63ff57 => generated 1465 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:24:04.345546 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-a77c1284-328c-451d-bafc-dbe639963933 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:24:04.346278 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-a77c1284-328c-451d-bafc-dbe639963933 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: b55b87f6-54c7-4ae0-a7e3-15755f63ff57] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:24:04.353016 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a77c1284-328c-451d-bafc-dbe639963933 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:04.353650 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a77c1284-328c-451d-bafc-dbe639963933 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:04.354751 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a77c1284-328c-451d-bafc-dbe639963933 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:04.356349 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a77c1284-328c-451d-bafc-dbe639963933 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:04.356806 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a77c1284-328c-451d-bafc-dbe639963933 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:04.357276 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a77c1284-328c-451d-bafc-dbe639963933 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:04.508161 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-a77c1284-328c-451d-bafc-dbe639963933 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:24:04.523864 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-a77c1284-328c-451d-bafc-dbe639963933 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/b55b87f6-54c7-4ae0-a7e3-15755f63ff57" status: 200 len: 1465 microversion: 2.1 time: 0.182613 Oct 08 21:24:04.537694 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2859/5644] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:24:04 2022] GET /compute/v2.1/servers/b55b87f6-54c7-4ae0-a7e3-15755f63ff57 => generated 1465 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:24:05.196099 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-a7b2616f-05b1-43c6-b78b-0ab1f4e6b03f tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:24:05.196737 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-a7b2616f-05b1-43c6-b78b-0ab1f4e6b03f tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] [instance: 9fc4f8d8-fd9e-4513-8d3b-6ec7622db95f] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:24:05.208160 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a7b2616f-05b1-43c6-b78b-0ab1f4e6b03f tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:05.208810 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a7b2616f-05b1-43c6-b78b-0ab1f4e6b03f tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:05.209439 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a7b2616f-05b1-43c6-b78b-0ab1f4e6b03f tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:05.210275 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a7b2616f-05b1-43c6-b78b-0ab1f4e6b03f tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:05.210877 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a7b2616f-05b1-43c6-b78b-0ab1f4e6b03f tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:05.211416 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a7b2616f-05b1-43c6-b78b-0ab1f4e6b03f tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:05.233084 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-0b9a1ec2-ad9e-4a1f-a9ad-f0a8690d2059 req-1f2ec628-e578-4a97-b035-a9fa123240a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9fc4f8d8-fd9e-4513-8d3b-6ec7622db95f", "tag": "0ccd085b-0f6f-4475-aa7b-1c6c9fb6de41"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:24:05.248361 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-0b9a1ec2-ad9e-4a1f-a9ad-f0a8690d2059 req-1f2ec628-e578-4a97-b035-a9fa123240a4 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:05.250403 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-0b9a1ec2-ad9e-4a1f-a9ad-f0a8690d2059 req-1f2ec628-e578-4a97-b035-a9fa123240a4 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:05.250403 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-0b9a1ec2-ad9e-4a1f-a9ad-f0a8690d2059 req-1f2ec628-e578-4a97-b035-a9fa123240a4 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:05.261667 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-a7b2616f-05b1-43c6-b78b-0ab1f4e6b03f tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] [instance: 9fc4f8d8-fd9e-4513-8d3b-6ec7622db95f] Going to try to terminate instance {{(pid=140491) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 21:24:05.271598 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-0b9a1ec2-ad9e-4a1f-a9ad-f0a8690d2059 req-1f2ec628-e578-4a97-b035-a9fa123240a4 service nova] Creating event network-changed:0ccd085b-0f6f-4475-aa7b-1c6c9fb6de41 for instance 9fc4f8d8-fd9e-4513-8d3b-6ec7622db95f on nch2-master-1 Oct 08 21:24:05.278741 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-0b9a1ec2-ad9e-4a1f-a9ad-f0a8690d2059 req-1f2ec628-e578-4a97-b035-a9fa123240a4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052695 Oct 08 21:24:05.281164 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2860/5645] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:24:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:24:05.408517 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-a7b2616f-05b1-43c6-b78b-0ab1f4e6b03f tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] 10.222.0.26 "DELETE /compute/v2.1/servers/9fc4f8d8-fd9e-4513-8d3b-6ec7622db95f" status: 204 len: 0 microversion: 2.1 time: 0.215963 Oct 08 21:24:05.414451 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2786/5646] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:24:05 2022] DELETE /compute/v2.1/servers/9fc4f8d8-fd9e-4513-8d3b-6ec7622db95f => generated 0 bytes in 218 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 21:24:05.422311 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-9223c765-d08a-4cd9-a58e-6b4607e7bb45 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:24:05.424159 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-9223c765-d08a-4cd9-a58e-6b4607e7bb45 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] [instance: 9fc4f8d8-fd9e-4513-8d3b-6ec7622db95f] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:24:05.436583 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9223c765-d08a-4cd9-a58e-6b4607e7bb45 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:05.439555 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9223c765-d08a-4cd9-a58e-6b4607e7bb45 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:05.440422 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9223c765-d08a-4cd9-a58e-6b4607e7bb45 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:05.441422 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9223c765-d08a-4cd9-a58e-6b4607e7bb45 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:05.442256 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9223c765-d08a-4cd9-a58e-6b4607e7bb45 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:05.443630 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9223c765-d08a-4cd9-a58e-6b4607e7bb45 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:05.551552 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-77e88c6d-add4-4697-b12a-24d722f6c39a tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:24:05.552438 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-77e88c6d-add4-4697-b12a-24d722f6c39a tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: b55b87f6-54c7-4ae0-a7e3-15755f63ff57] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:24:05.564714 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-77e88c6d-add4-4697-b12a-24d722f6c39a tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:05.565274 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-77e88c6d-add4-4697-b12a-24d722f6c39a tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:05.566181 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-77e88c6d-add4-4697-b12a-24d722f6c39a tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:05.567107 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-77e88c6d-add4-4697-b12a-24d722f6c39a tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:05.567585 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-77e88c6d-add4-4697-b12a-24d722f6c39a tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:05.568022 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-77e88c6d-add4-4697-b12a-24d722f6c39a tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:05.713862 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-77e88c6d-add4-4697-b12a-24d722f6c39a tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:24:05.729499 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-77e88c6d-add4-4697-b12a-24d722f6c39a tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/b55b87f6-54c7-4ae0-a7e3-15755f63ff57" status: 200 len: 1465 microversion: 2.1 time: 0.184180 Oct 08 21:24:05.730404 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2787/5647] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:24:05 2022] GET /compute/v2.1/servers/b55b87f6-54c7-4ae0-a7e3-15755f63ff57 => generated 1465 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:24:05.850801 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-9223c765-d08a-4cd9-a58e-6b4607e7bb45 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e28f7acd53094828a7863ce2fd775cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b37e8634ac448ea9a86aff144098dd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:24:05.860384 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-9223c765-d08a-4cd9-a58e-6b4607e7bb45 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] 10.222.0.26 "GET /compute/v2.1/servers/9fc4f8d8-fd9e-4513-8d3b-6ec7622db95f" status: 200 len: 1669 microversion: 2.1 time: 0.444014 Oct 08 21:24:05.863785 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2861/5648] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:24:05 2022] GET /compute/v2.1/servers/9fc4f8d8-fd9e-4513-8d3b-6ec7622db95f => generated 1669 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:24:06.049067 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-915134fc-1760-455f-bc5e-af4c041b3c26 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:24:06.049672 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-915134fc-1760-455f-bc5e-af4c041b3c26 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] [instance: 9f0543d4-5a51-4c40-8b2e-fbd2a393c903] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:24:06.056393 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-915134fc-1760-455f-bc5e-af4c041b3c26 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:06.056903 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-915134fc-1760-455f-bc5e-af4c041b3c26 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:06.057577 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-915134fc-1760-455f-bc5e-af4c041b3c26 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:06.058943 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-915134fc-1760-455f-bc5e-af4c041b3c26 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:06.059876 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-915134fc-1760-455f-bc5e-af4c041b3c26 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:06.060018 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-915134fc-1760-455f-bc5e-af4c041b3c26 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:06.099512 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-915134fc-1760-455f-bc5e-af4c041b3c26 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] [instance: 9f0543d4-5a51-4c40-8b2e-fbd2a393c903] Going to try to terminate instance {{(pid=140491) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 21:24:06.138630 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:24:06.209444 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-915134fc-1760-455f-bc5e-af4c041b3c26 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] 10.222.0.26 "DELETE /compute/v2.1/servers/9f0543d4-5a51-4c40-8b2e-fbd2a393c903" status: 204 len: 0 microversion: 2.1 time: 0.165267 Oct 08 21:24:06.211879 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2788/5649] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:24:06 2022] DELETE /compute/v2.1/servers/9f0543d4-5a51-4c40-8b2e-fbd2a393c903 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 21:24:06.224474 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-9a60e04d-d1c4-4eae-9ce1-e6fb7c007d30 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:24:06.225101 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-9a60e04d-d1c4-4eae-9ce1-e6fb7c007d30 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] [instance: 9f0543d4-5a51-4c40-8b2e-fbd2a393c903] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:24:06.235290 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9a60e04d-d1c4-4eae-9ce1-e6fb7c007d30 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:06.236027 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9a60e04d-d1c4-4eae-9ce1-e6fb7c007d30 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:06.236651 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9a60e04d-d1c4-4eae-9ce1-e6fb7c007d30 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:06.237639 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9a60e04d-d1c4-4eae-9ce1-e6fb7c007d30 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:06.238270 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9a60e04d-d1c4-4eae-9ce1-e6fb7c007d30 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:06.238970 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9a60e04d-d1c4-4eae-9ce1-e6fb7c007d30 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:06.464683 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-9a60e04d-d1c4-4eae-9ce1-e6fb7c007d30 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a0d81fb2dd4891901f27890ce7688e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fd83b3bdef4ba18ba56a9385e26d01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:24:06.477261 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-9a60e04d-d1c4-4eae-9ce1-e6fb7c007d30 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] 10.222.0.26 "GET /compute/v2.1/servers/9f0543d4-5a51-4c40-8b2e-fbd2a393c903" status: 200 len: 1768 microversion: 2.1 time: 0.260105 Oct 08 21:24:06.477818 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2862/5650] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:24:06 2022] GET /compute/v2.1/servers/9f0543d4-5a51-4c40-8b2e-fbd2a393c903 => generated 1768 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:24:06.753962 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-3e2658af-42e7-48ab-878b-9531d8bf335c tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:24:06.755346 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-3e2658af-42e7-48ab-878b-9531d8bf335c tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: b55b87f6-54c7-4ae0-a7e3-15755f63ff57] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:24:06.763612 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3e2658af-42e7-48ab-878b-9531d8bf335c tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:06.764111 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3e2658af-42e7-48ab-878b-9531d8bf335c tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:06.764760 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3e2658af-42e7-48ab-878b-9531d8bf335c tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:06.765514 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3e2658af-42e7-48ab-878b-9531d8bf335c tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:06.765976 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3e2658af-42e7-48ab-878b-9531d8bf335c tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:06.766409 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3e2658af-42e7-48ab-878b-9531d8bf335c tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:06.801241 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3e2658af-42e7-48ab-878b-9531d8bf335c tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:06.801923 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3e2658af-42e7-48ab-878b-9531d8bf335c tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:06.802654 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3e2658af-42e7-48ab-878b-9531d8bf335c tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:06.803273 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.objects.instance [None req-3e2658af-42e7-48ab-878b-9531d8bf335c tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lazy-loading 'fault' on Instance uuid b55b87f6-54c7-4ae0-a7e3-15755f63ff57 {{(pid=140491) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 21:24:06.849006 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-3e2658af-42e7-48ab-878b-9531d8bf335c tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:24:06.858466 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-3e2658af-42e7-48ab-878b-9531d8bf335c tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/b55b87f6-54c7-4ae0-a7e3-15755f63ff57" status: 200 len: 1305 microversion: 2.1 time: 0.108614 Oct 08 21:24:06.874137 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2789/5651] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:24:06 2022] GET /compute/v2.1/servers/b55b87f6-54c7-4ae0-a7e3-15755f63ff57 => generated 1305 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:24:06.894836 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-32da71f3-9a24-419b-b7d3-8a47afbefb9e tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:24:06.895471 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-32da71f3-9a24-419b-b7d3-8a47afbefb9e tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] [instance: 9fc4f8d8-fd9e-4513-8d3b-6ec7622db95f] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:24:06.903804 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-32da71f3-9a24-419b-b7d3-8a47afbefb9e tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:06.904612 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-32da71f3-9a24-419b-b7d3-8a47afbefb9e tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:06.905066 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-32da71f3-9a24-419b-b7d3-8a47afbefb9e tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:06.906546 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-32da71f3-9a24-419b-b7d3-8a47afbefb9e tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:06.907258 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-32da71f3-9a24-419b-b7d3-8a47afbefb9e tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:06.907892 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-32da71f3-9a24-419b-b7d3-8a47afbefb9e tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:07.245264 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-32da71f3-9a24-419b-b7d3-8a47afbefb9e tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e28f7acd53094828a7863ce2fd775cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b37e8634ac448ea9a86aff144098dd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:24:07.255939 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-32da71f3-9a24-419b-b7d3-8a47afbefb9e tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] 10.222.0.26 "GET /compute/v2.1/servers/9fc4f8d8-fd9e-4513-8d3b-6ec7622db95f" status: 200 len: 1669 microversion: 2.1 time: 0.365981 Oct 08 21:24:07.256536 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2863/5652] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:24:06 2022] GET /compute/v2.1/servers/9fc4f8d8-fd9e-4513-8d3b-6ec7622db95f => generated 1669 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:24:07.312915 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-ec22b521-839a-49ab-a364-3f28822b65fc req-b40cc161-9b9e-4d17-8e82-061bfddfa9b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b55b87f6-54c7-4ae0-a7e3-15755f63ff57", "name": "network-vif-deleted", "tag": "05df99ed-71f0-4c34-acfd-7058cfaf30c4"}, {"name": "network-changed", "server_uuid": "9f0543d4-5a51-4c40-8b2e-fbd2a393c903", "tag": "a4edc924-cba8-42e2-9312-80f470865159"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:24:07.336292 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-ec22b521-839a-49ab-a364-3f28822b65fc req-b40cc161-9b9e-4d17-8e82-061bfddfa9b9 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:07.336902 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-ec22b521-839a-49ab-a364-3f28822b65fc req-b40cc161-9b9e-4d17-8e82-061bfddfa9b9 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:07.337440 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-ec22b521-839a-49ab-a364-3f28822b65fc req-b40cc161-9b9e-4d17-8e82-061bfddfa9b9 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:07.358956 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-ec22b521-839a-49ab-a364-3f28822b65fc req-b40cc161-9b9e-4d17-8e82-061bfddfa9b9 service nova] Creating event network-vif-deleted:05df99ed-71f0-4c34-acfd-7058cfaf30c4 for instance b55b87f6-54c7-4ae0-a7e3-15755f63ff57 on nch1-master-1 Oct 08 21:24:07.359629 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-ec22b521-839a-49ab-a364-3f28822b65fc req-b40cc161-9b9e-4d17-8e82-061bfddfa9b9 service nova] Creating event network-changed:a4edc924-cba8-42e2-9312-80f470865159 for instance 9f0543d4-5a51-4c40-8b2e-fbd2a393c903 on nch1-master-1 Oct 08 21:24:07.366686 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-ec22b521-839a-49ab-a364-3f28822b65fc req-b40cc161-9b9e-4d17-8e82-061bfddfa9b9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.063430 Oct 08 21:24:07.368281 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2790/5653] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:24:07 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:24:07.510836 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-70e4ad79-c193-48d7-93e6-23f96a9a1f66 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:24:07.511576 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-70e4ad79-c193-48d7-93e6-23f96a9a1f66 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] [instance: 9f0543d4-5a51-4c40-8b2e-fbd2a393c903] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:24:07.519102 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=3 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:24:07.531842 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-70e4ad79-c193-48d7-93e6-23f96a9a1f66 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:07.532945 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-70e4ad79-c193-48d7-93e6-23f96a9a1f66 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:07.533636 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-70e4ad79-c193-48d7-93e6-23f96a9a1f66 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:07.540738 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-70e4ad79-c193-48d7-93e6-23f96a9a1f66 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:07.541350 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-70e4ad79-c193-48d7-93e6-23f96a9a1f66 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:07.541820 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-70e4ad79-c193-48d7-93e6-23f96a9a1f66 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:07.884957 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-5fc3e64d-0bb1-40ce-8cf5-79974b4460bb tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:24:07.886211 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-5fc3e64d-0bb1-40ce-8cf5-79974b4460bb tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: b55b87f6-54c7-4ae0-a7e3-15755f63ff57] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:24:07.896256 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5fc3e64d-0bb1-40ce-8cf5-79974b4460bb tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:07.897276 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5fc3e64d-0bb1-40ce-8cf5-79974b4460bb tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:07.898122 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5fc3e64d-0bb1-40ce-8cf5-79974b4460bb tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:07.899853 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5fc3e64d-0bb1-40ce-8cf5-79974b4460bb tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:07.900814 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5fc3e64d-0bb1-40ce-8cf5-79974b4460bb tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:07.901573 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5fc3e64d-0bb1-40ce-8cf5-79974b4460bb tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:07.938965 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-5fc3e64d-0bb1-40ce-8cf5-79974b4460bb tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] HTTP exception thrown: Instance b55b87f6-54c7-4ae0-a7e3-15755f63ff57 could not be found. Oct 08 21:24:07.942553 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-5fc3e64d-0bb1-40ce-8cf5-79974b4460bb tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Request method failure captured: Oct 08 21:24:07.942553 ncdv-master-1 devstack@n-api.service[140491]: request: GET /compute/v2.1/servers/b55b87f6-54c7-4ae0-a7e3-15755f63ff57 HTTP/1.1 Oct 08 21:24:07.942553 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:24:07.942553 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:24:07.942553 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:24:07.942553 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 21:24:07.942553 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:24:07.942553 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:24:07.942553 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:24:07.942553 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:24:07.942553 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQejiYlaPI-JtqvK14aYdk5AJQZ9Rj0WfXfezm3HghOQHCqDAnzzaGqHnmcxTg9_bQH8N_IiErrzdvkHM9CcLpkI8dflyFrbZJ8oohauamjv0z3cmdzo6PpuDpJEm2ViNPKrmyHelDYEhGxb7y4b1zyM2T-OENcW1NDh2QOCLmS2DfCA Oct 08 21:24:07.942553 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:24:07.942553 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:24:07.942553 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:24:07.942553 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:24:07.942553 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:24:07.942553 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:24:07.942553 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: bd563fa73afb42c6b26eca3737d7a355 Oct 08 21:24:07.942553 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-ServerActionsTestJSON-1611357772 Oct 08 21:24:07.942553 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:24:07.942553 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:24:07.942553 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/bd563fa73afb42c6b26eca3737d7a355"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/bd563fa73afb42c6b26eca3737d7a355"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_bd563fa73afb42c6b26eca3737d7a355"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/bd563fa73afb42c6b26eca3737d7a355"}]}] Oct 08 21:24:07.942553 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-ServerActionsTestJSON-1611357772 Oct 08 21:24:07.942553 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: bd563fa73afb42c6b26eca3737d7a355 Oct 08 21:24:07.942553 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-ServerActionsTestJSON-1611357772 Oct 08 21:24:07.942553 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-ServerActionsTestJSON-1611357772-project Oct 08 21:24:07.942553 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:24:07.942553 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:24:07.942553 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 2f98e01cab6b49c7a5d239aee95f4a64 Oct 08 21:24:07.942553 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-ServerActionsTestJSON-1611357772-project Oct 08 21:24:07.942553 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:24:07.942553 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance b55b87f6-54c7-4ae0-a7e3-15755f63ff57 could not be found. Oct 08 21:24:07.942553 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': 'b55b87f6-54c7-4ae0-a7e3-15755f63ff57'} Oct 08 21:24:07.942553 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:24:07.942553 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:24:07.942553 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:24:07.942553 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:24:07.942553 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:24:07.942553 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:24:07.942553 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:24:07.942553 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:24:07.942553 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:24:07.942553 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:24:07.942553 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b55b87f6-54c7-4ae0-a7e3-15755f63ff57 could not be found. Oct 08 21:24:07.942553 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:24:07.942553 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:24:07.942553 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:24:07.942553 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:24:07.942553 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:24:07.942553 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:24:07.942553 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:24:07.942553 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:24:07.942553 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:24:07.942553 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:24:07.942553 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:24:07.942553 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:24:07.942553 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:24:07.942553 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:24:07.942553 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:24:07.942553 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:24:07.942553 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b55b87f6-54c7-4ae0-a7e3-15755f63ff57 could not be found. Oct 08 21:24:07.942553 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:24:07.942553 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:24:07.942553 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:24:07.949505 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:24:07.949505 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:24:07.949505 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:24:07.949505 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:24:07.949505 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:24:07.949505 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b55b87f6-54c7-4ae0-a7e3-15755f63ff57 could not be found. Oct 08 21:24:07.949505 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:24:07.951227 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-5fc3e64d-0bb1-40ce-8cf5-79974b4460bb tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Returning 404 to user: Instance b55b87f6-54c7-4ae0-a7e3-15755f63ff57 could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:24:07.952142 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-5fc3e64d-0bb1-40ce-8cf5-79974b4460bb tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/b55b87f6-54c7-4ae0-a7e3-15755f63ff57" status: 404 len: 111 microversion: 2.1 time: 0.073367 Oct 08 21:24:07.952738 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2791/5654] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:24:07 2022] GET /compute/v2.1/servers/b55b87f6-54c7-4ae0-a7e3-15755f63ff57 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 08 21:24:07.961452 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-5b019f7c-2c46-4610-8f57-9a1f3c48b75f tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:24:07.961961 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-5b019f7c-2c46-4610-8f57-9a1f3c48b75f tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 4ae315ed-e587-4aec-b3bb-4b76f8b89331] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:24:07.968756 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5b019f7c-2c46-4610-8f57-9a1f3c48b75f tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:07.969542 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5b019f7c-2c46-4610-8f57-9a1f3c48b75f tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:07.969990 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5b019f7c-2c46-4610-8f57-9a1f3c48b75f tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:07.970711 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5b019f7c-2c46-4610-8f57-9a1f3c48b75f tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:07.971353 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5b019f7c-2c46-4610-8f57-9a1f3c48b75f tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:07.971790 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5b019f7c-2c46-4610-8f57-9a1f3c48b75f tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:08.008592 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-5b019f7c-2c46-4610-8f57-9a1f3c48b75f tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 4ae315ed-e587-4aec-b3bb-4b76f8b89331] Going to try to terminate instance {{(pid=140491) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 21:24:08.067576 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-70e4ad79-c193-48d7-93e6-23f96a9a1f66 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a0d81fb2dd4891901f27890ce7688e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fd83b3bdef4ba18ba56a9385e26d01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:24:08.083168 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-70e4ad79-c193-48d7-93e6-23f96a9a1f66 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] 10.222.0.26 "GET /compute/v2.1/servers/9f0543d4-5a51-4c40-8b2e-fbd2a393c903" status: 200 len: 1768 microversion: 2.1 time: 0.585022 Oct 08 21:24:08.083636 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2864/5655] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:24:07 2022] GET /compute/v2.1/servers/9f0543d4-5a51-4c40-8b2e-fbd2a393c903 => generated 1768 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:24:08.149861 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-5b019f7c-2c46-4610-8f57-9a1f3c48b75f tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "DELETE /compute/v2.1/servers/4ae315ed-e587-4aec-b3bb-4b76f8b89331" status: 204 len: 0 microversion: 2.1 time: 0.191152 Oct 08 21:24:08.150882 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2792/5656] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:24:07 2022] DELETE /compute/v2.1/servers/4ae315ed-e587-4aec-b3bb-4b76f8b89331 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 21:24:08.162109 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-f8eb211c-2d4b-41de-bd30-f27ca17bd0df tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:24:08.163189 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-f8eb211c-2d4b-41de-bd30-f27ca17bd0df tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 4ae315ed-e587-4aec-b3bb-4b76f8b89331] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:24:08.170418 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f8eb211c-2d4b-41de-bd30-f27ca17bd0df tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:08.170940 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f8eb211c-2d4b-41de-bd30-f27ca17bd0df tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:08.171397 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f8eb211c-2d4b-41de-bd30-f27ca17bd0df tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:08.172518 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f8eb211c-2d4b-41de-bd30-f27ca17bd0df tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:08.173154 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f8eb211c-2d4b-41de-bd30-f27ca17bd0df tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:08.173634 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f8eb211c-2d4b-41de-bd30-f27ca17bd0df tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:08.285692 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-2c25a4c7-157f-4c80-92d8-6efc23122382 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:24:08.287024 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-2c25a4c7-157f-4c80-92d8-6efc23122382 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] [instance: 9fc4f8d8-fd9e-4513-8d3b-6ec7622db95f] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:24:08.301490 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2c25a4c7-157f-4c80-92d8-6efc23122382 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:08.305261 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2c25a4c7-157f-4c80-92d8-6efc23122382 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:08.306196 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2c25a4c7-157f-4c80-92d8-6efc23122382 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:08.306762 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2c25a4c7-157f-4c80-92d8-6efc23122382 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:08.307370 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2c25a4c7-157f-4c80-92d8-6efc23122382 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:08.307823 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2c25a4c7-157f-4c80-92d8-6efc23122382 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:08.353065 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2c25a4c7-157f-4c80-92d8-6efc23122382 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:08.354295 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2c25a4c7-157f-4c80-92d8-6efc23122382 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:08.355738 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2c25a4c7-157f-4c80-92d8-6efc23122382 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:08.356536 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.objects.instance [None req-2c25a4c7-157f-4c80-92d8-6efc23122382 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lazy-loading 'fault' on Instance uuid 9fc4f8d8-fd9e-4513-8d3b-6ec7622db95f {{(pid=140491) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 21:24:08.412935 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-2c25a4c7-157f-4c80-92d8-6efc23122382 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e28f7acd53094828a7863ce2fd775cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b37e8634ac448ea9a86aff144098dd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:24:08.422895 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-2c25a4c7-157f-4c80-92d8-6efc23122382 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] 10.222.0.26 "GET /compute/v2.1/servers/9fc4f8d8-fd9e-4513-8d3b-6ec7622db95f" status: 200 len: 1338 microversion: 2.1 time: 0.143807 Oct 08 21:24:08.423993 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2793/5657] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:24:08 2022] GET /compute/v2.1/servers/9fc4f8d8-fd9e-4513-8d3b-6ec7622db95f => generated 1338 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:24:08.499642 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-f8eb211c-2d4b-41de-bd30-f27ca17bd0df tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:24:08.512049 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-f8eb211c-2d4b-41de-bd30-f27ca17bd0df tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/4ae315ed-e587-4aec-b3bb-4b76f8b89331" status: 200 len: 1507 microversion: 2.1 time: 0.353758 Oct 08 21:24:08.513028 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2865/5658] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:24:08 2022] GET /compute/v2.1/servers/4ae315ed-e587-4aec-b3bb-4b76f8b89331 => generated 1507 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:24:08.549637 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-82dcf372-482a-43fc-aeac-999e11fa2491 req-a10b41dd-6f3e-4af8-830c-b357b48653ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f0543d4-5a51-4c40-8b2e-fbd2a393c903", "name": "network-vif-deleted", "tag": "a4edc924-cba8-42e2-9312-80f470865159"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:24:08.566630 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-82dcf372-482a-43fc-aeac-999e11fa2491 req-a10b41dd-6f3e-4af8-830c-b357b48653ca service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:08.567247 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-82dcf372-482a-43fc-aeac-999e11fa2491 req-a10b41dd-6f3e-4af8-830c-b357b48653ca service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:08.567816 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-82dcf372-482a-43fc-aeac-999e11fa2491 req-a10b41dd-6f3e-4af8-830c-b357b48653ca service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:08.581388 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-82dcf372-482a-43fc-aeac-999e11fa2491 req-a10b41dd-6f3e-4af8-830c-b357b48653ca service nova] Creating event network-vif-deleted:a4edc924-cba8-42e2-9312-80f470865159 for instance 9f0543d4-5a51-4c40-8b2e-fbd2a393c903 on nch1-master-1 Oct 08 21:24:08.586831 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-82dcf372-482a-43fc-aeac-999e11fa2491 req-a10b41dd-6f3e-4af8-830c-b357b48653ca service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048518 Oct 08 21:24:08.587444 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2794/5659] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:24:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:24:09.108449 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-0814a14e-baa8-4381-8e75-8b18446f7bda tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:24:09.109477 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-0814a14e-baa8-4381-8e75-8b18446f7bda tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] [instance: 9f0543d4-5a51-4c40-8b2e-fbd2a393c903] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:24:09.121878 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0814a14e-baa8-4381-8e75-8b18446f7bda tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:09.122441 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0814a14e-baa8-4381-8e75-8b18446f7bda tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:09.122965 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0814a14e-baa8-4381-8e75-8b18446f7bda tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:09.123665 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0814a14e-baa8-4381-8e75-8b18446f7bda tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:09.124141 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0814a14e-baa8-4381-8e75-8b18446f7bda tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:09.125021 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0814a14e-baa8-4381-8e75-8b18446f7bda tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:09.165145 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0814a14e-baa8-4381-8e75-8b18446f7bda tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:09.165717 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0814a14e-baa8-4381-8e75-8b18446f7bda tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:09.166176 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0814a14e-baa8-4381-8e75-8b18446f7bda tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:09.166644 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.objects.instance [None req-0814a14e-baa8-4381-8e75-8b18446f7bda tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Lazy-loading 'fault' on Instance uuid 9f0543d4-5a51-4c40-8b2e-fbd2a393c903 {{(pid=140492) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 21:24:09.210603 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-0814a14e-baa8-4381-8e75-8b18446f7bda tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a0d81fb2dd4891901f27890ce7688e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fd83b3bdef4ba18ba56a9385e26d01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:24:09.218961 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-0814a14e-baa8-4381-8e75-8b18446f7bda tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] 10.222.0.26 "GET /compute/v2.1/servers/9f0543d4-5a51-4c40-8b2e-fbd2a393c903" status: 200 len: 1535 microversion: 2.1 time: 0.114628 Oct 08 21:24:09.219636 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2866/5660] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:24:09 2022] GET /compute/v2.1/servers/9f0543d4-5a51-4c40-8b2e-fbd2a393c903 => generated 1535 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:24:09.387562 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-ebb0202e-5651-4a75-bd81-153bc77620e0 req-bfa473aa-abea-4f0b-bc86-3e3654dcda69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fc4f8d8-fd9e-4513-8d3b-6ec7622db95f", "name": "network-vif-deleted", "tag": "0ccd085b-0f6f-4475-aa7b-1c6c9fb6de41"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:24:09.397445 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-ebb0202e-5651-4a75-bd81-153bc77620e0 req-bfa473aa-abea-4f0b-bc86-3e3654dcda69 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:09.397879 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-ebb0202e-5651-4a75-bd81-153bc77620e0 req-bfa473aa-abea-4f0b-bc86-3e3654dcda69 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:09.398884 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-ebb0202e-5651-4a75-bd81-153bc77620e0 req-bfa473aa-abea-4f0b-bc86-3e3654dcda69 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:09.421388 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-ebb0202e-5651-4a75-bd81-153bc77620e0 req-bfa473aa-abea-4f0b-bc86-3e3654dcda69 service nova] Creating event network-vif-deleted:0ccd085b-0f6f-4475-aa7b-1c6c9fb6de41 for instance 9fc4f8d8-fd9e-4513-8d3b-6ec7622db95f on nch2-master-1 Oct 08 21:24:09.425960 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-ebb0202e-5651-4a75-bd81-153bc77620e0 req-bfa473aa-abea-4f0b-bc86-3e3654dcda69 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043759 Oct 08 21:24:09.429682 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2795/5661] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:24:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:24:09.448326 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-86df5633-298c-466f-90df-80fe253fb621 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:24:09.449089 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-86df5633-298c-466f-90df-80fe253fb621 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] [instance: 9fc4f8d8-fd9e-4513-8d3b-6ec7622db95f] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:24:09.458018 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-86df5633-298c-466f-90df-80fe253fb621 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:09.458908 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-86df5633-298c-466f-90df-80fe253fb621 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:09.460007 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-86df5633-298c-466f-90df-80fe253fb621 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:09.462001 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-86df5633-298c-466f-90df-80fe253fb621 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:09.462503 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-86df5633-298c-466f-90df-80fe253fb621 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:09.462956 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-86df5633-298c-466f-90df-80fe253fb621 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:09.498224 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-86df5633-298c-466f-90df-80fe253fb621 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:09.498863 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-86df5633-298c-466f-90df-80fe253fb621 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:09.499422 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-86df5633-298c-466f-90df-80fe253fb621 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:09.499963 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.objects.instance [None req-86df5633-298c-466f-90df-80fe253fb621 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lazy-loading 'fault' on Instance uuid 9fc4f8d8-fd9e-4513-8d3b-6ec7622db95f {{(pid=140492) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 21:24:09.537068 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-d1c47e48-9661-446a-93f4-fb41b2870a83 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:24:09.537831 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-d1c47e48-9661-446a-93f4-fb41b2870a83 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 4ae315ed-e587-4aec-b3bb-4b76f8b89331] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:24:09.546390 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d1c47e48-9661-446a-93f4-fb41b2870a83 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:09.547328 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d1c47e48-9661-446a-93f4-fb41b2870a83 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:09.548120 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d1c47e48-9661-446a-93f4-fb41b2870a83 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:09.549101 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d1c47e48-9661-446a-93f4-fb41b2870a83 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:09.549969 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d1c47e48-9661-446a-93f4-fb41b2870a83 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:09.550840 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d1c47e48-9661-446a-93f4-fb41b2870a83 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:09.558133 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-86df5633-298c-466f-90df-80fe253fb621 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e28f7acd53094828a7863ce2fd775cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b37e8634ac448ea9a86aff144098dd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:24:09.567138 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-86df5633-298c-466f-90df-80fe253fb621 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] 10.222.0.26 "GET /compute/v2.1/servers/9fc4f8d8-fd9e-4513-8d3b-6ec7622db95f" status: 200 len: 1338 microversion: 2.1 time: 0.123036 Oct 08 21:24:09.568456 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2867/5662] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:24:09 2022] GET /compute/v2.1/servers/9fc4f8d8-fd9e-4513-8d3b-6ec7622db95f => generated 1338 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:24:09.735567 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-d1c47e48-9661-446a-93f4-fb41b2870a83 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:24:09.744405 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-d1c47e48-9661-446a-93f4-fb41b2870a83 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/4ae315ed-e587-4aec-b3bb-4b76f8b89331" status: 200 len: 1507 microversion: 2.1 time: 0.212870 Oct 08 21:24:09.745081 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2796/5663] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:24:09 2022] GET /compute/v2.1/servers/4ae315ed-e587-4aec-b3bb-4b76f8b89331 => generated 1507 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:24:10.244358 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-10f37649-1697-40f7-9b01-46624f241055 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:24:10.244993 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-10f37649-1697-40f7-9b01-46624f241055 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] [instance: 9f0543d4-5a51-4c40-8b2e-fbd2a393c903] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:24:10.251890 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-10f37649-1697-40f7-9b01-46624f241055 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:10.252406 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-10f37649-1697-40f7-9b01-46624f241055 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:10.252870 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-10f37649-1697-40f7-9b01-46624f241055 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:10.253624 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-10f37649-1697-40f7-9b01-46624f241055 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:10.254288 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-10f37649-1697-40f7-9b01-46624f241055 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:10.254736 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-10f37649-1697-40f7-9b01-46624f241055 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:10.269016 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-10f37649-1697-40f7-9b01-46624f241055 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] HTTP exception thrown: Instance 9f0543d4-5a51-4c40-8b2e-fbd2a393c903 could not be found. Oct 08 21:24:10.270737 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-10f37649-1697-40f7-9b01-46624f241055 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Request method failure captured: Oct 08 21:24:10.270737 ncdv-master-1 devstack@n-api.service[140492]: request: GET /compute/v2.1/servers/9f0543d4-5a51-4c40-8b2e-fbd2a393c903 HTTP/1.1 Oct 08 21:24:10.270737 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:24:10.270737 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:24:10.270737 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:24:10.270737 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 21:24:10.270737 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:24:10.270737 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:24:10.270737 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:24:10.270737 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:24:10.270737 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeoT3YmNxm_lFxZPMMvXR5jbwJjYnpGXQqDg7Livc_cMqEuohY4AgztTX-AeGR0cDEG_vvOTDlkZchrd2DieRIqXleShUh3nyxH1lTqvPhAmMzPa6zFOyIdjxENunO4MxTb2NC9_dhD1uXJyvjalM6HuaSTuflLpySwMdzg6ThtWmAg Oct 08 21:24:10.270737 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:24:10.270737 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:24:10.270737 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:24:10.270737 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:24:10.270737 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:24:10.270737 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:24:10.270737 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: e5fd83b3bdef4ba18ba56a9385e26d01 Oct 08 21:24:10.270737 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1247845187 Oct 08 21:24:10.270737 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:24:10.270737 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:24:10.270737 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/e5fd83b3bdef4ba18ba56a9385e26d01"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e5fd83b3bdef4ba18ba56a9385e26d01"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_e5fd83b3bdef4ba18ba56a9385e26d01"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e5fd83b3bdef4ba18ba56a9385e26d01"}]}] Oct 08 21:24:10.270737 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1247845187 Oct 08 21:24:10.270737 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: e5fd83b3bdef4ba18ba56a9385e26d01 Oct 08 21:24:10.270737 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1247845187 Oct 08 21:24:10.270737 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-TestSecurityGroupsBasicOps-1247845187-project Oct 08 21:24:10.270737 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:24:10.270737 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:24:10.270737 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 33a0d81fb2dd4891901f27890ce7688e Oct 08 21:24:10.270737 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1247845187-project Oct 08 21:24:10.270737 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 21:24:10.270737 ncdv-master-1 devstack@n-api.service[140492]: exception: Instance 9f0543d4-5a51-4c40-8b2e-fbd2a393c903 could not be found. Oct 08 21:24:10.270737 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': '9f0543d4-5a51-4c40-8b2e-fbd2a393c903'} Oct 08 21:24:10.270737 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:24:10.270737 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:24:10.270737 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:24:10.270737 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:24:10.270737 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:24:10.270737 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:24:10.270737 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:24:10.270737 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:24:10.270737 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:24:10.270737 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:24:10.270737 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f0543d4-5a51-4c40-8b2e-fbd2a393c903 could not be found. Oct 08 21:24:10.270737 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:24:10.270737 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:24:10.270737 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:24:10.270737 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:24:10.270737 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:24:10.270737 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:24:10.270737 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:24:10.270737 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:24:10.270737 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:24:10.270737 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:24:10.270737 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:24:10.270737 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:24:10.270737 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:24:10.270737 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:24:10.270737 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:24:10.270737 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:24:10.270737 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f0543d4-5a51-4c40-8b2e-fbd2a393c903 could not be found. Oct 08 21:24:10.270737 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:24:10.270737 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:24:10.280375 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:24:10.280375 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:24:10.280375 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:24:10.280375 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:24:10.280375 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:24:10.280375 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:24:10.280375 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f0543d4-5a51-4c40-8b2e-fbd2a393c903 could not be found. Oct 08 21:24:10.280375 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:24:10.280375 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-10f37649-1697-40f7-9b01-46624f241055 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Returning 404 to user: Instance 9f0543d4-5a51-4c40-8b2e-fbd2a393c903 could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:24:10.280375 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-10f37649-1697-40f7-9b01-46624f241055 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] 10.222.0.26 "GET /compute/v2.1/servers/9f0543d4-5a51-4c40-8b2e-fbd2a393c903" status: 404 len: 111 microversion: 2.1 time: 0.032150 Oct 08 21:24:10.280375 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2868/5664] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:24:10 2022] GET /compute/v2.1/servers/9f0543d4-5a51-4c40-8b2e-fbd2a393c903 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:24:10.601208 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-49562d83-106e-4fb3-8535-7a88a4a242cc tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:24:10.602762 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-49562d83-106e-4fb3-8535-7a88a4a242cc tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] [instance: 9fc4f8d8-fd9e-4513-8d3b-6ec7622db95f] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:24:10.618241 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-49562d83-106e-4fb3-8535-7a88a4a242cc tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:10.619323 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-49562d83-106e-4fb3-8535-7a88a4a242cc tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:10.619927 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-49562d83-106e-4fb3-8535-7a88a4a242cc tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:10.622185 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-49562d83-106e-4fb3-8535-7a88a4a242cc tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:10.632503 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-49562d83-106e-4fb3-8535-7a88a4a242cc tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:10.635900 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-49562d83-106e-4fb3-8535-7a88a4a242cc tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:10.659051 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-49562d83-106e-4fb3-8535-7a88a4a242cc tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] HTTP exception thrown: Instance 9fc4f8d8-fd9e-4513-8d3b-6ec7622db95f could not be found. Oct 08 21:24:10.660810 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-49562d83-106e-4fb3-8535-7a88a4a242cc tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Request method failure captured: Oct 08 21:24:10.660810 ncdv-master-1 devstack@n-api.service[140491]: request: GET /compute/v2.1/servers/9fc4f8d8-fd9e-4513-8d3b-6ec7622db95f HTTP/1.1 Oct 08 21:24:10.660810 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:24:10.660810 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:24:10.660810 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:24:10.660810 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 21:24:10.660810 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:24:10.660810 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:24:10.660810 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:24:10.660810 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:24:10.660810 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQen2S80x1CVAlKwCKZntNH5PQxsmQrq_ROUHyrV4X31LhiiSU0yhqEtSekpzTTt2ymhi_iUL7E8k1oIHYa5XRaIume53jrgq0WDi_uXqQ958DwZ_WEYlLYkPCXMEFlt2hc471wf2KjXPAn83Av9koEdzGk5iNdFNlgkHhLBvVzKU0ZA Oct 08 21:24:10.660810 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:24:10.660810 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:24:10.660810 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:24:10.660810 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:24:10.660810 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:24:10.660810 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:24:10.660810 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 9b37e8634ac448ea9a86aff144098dd4 Oct 08 21:24:10.660810 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-TestNetworkBasicOps-2013528848 Oct 08 21:24:10.660810 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:24:10.660810 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:24:10.660810 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9b37e8634ac448ea9a86aff144098dd4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9b37e8634ac448ea9a86aff144098dd4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9b37e8634ac448ea9a86aff144098dd4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9b37e8634ac448ea9a86aff144098dd4"}]}] Oct 08 21:24:10.660810 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-TestNetworkBasicOps-2013528848 Oct 08 21:24:10.660810 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 9b37e8634ac448ea9a86aff144098dd4 Oct 08 21:24:10.660810 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-TestNetworkBasicOps-2013528848 Oct 08 21:24:10.660810 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-TestNetworkBasicOps-2013528848-project Oct 08 21:24:10.660810 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:24:10.660810 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:24:10.660810 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: e28f7acd53094828a7863ce2fd775cdf Oct 08 21:24:10.660810 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-TestNetworkBasicOps-2013528848-project Oct 08 21:24:10.660810 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:24:10.660810 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance 9fc4f8d8-fd9e-4513-8d3b-6ec7622db95f could not be found. Oct 08 21:24:10.660810 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': '9fc4f8d8-fd9e-4513-8d3b-6ec7622db95f'} Oct 08 21:24:10.660810 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:24:10.660810 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:24:10.660810 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:24:10.660810 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:24:10.660810 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:24:10.660810 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:24:10.660810 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:24:10.660810 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:24:10.660810 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:24:10.660810 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:24:10.660810 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9fc4f8d8-fd9e-4513-8d3b-6ec7622db95f could not be found. Oct 08 21:24:10.660810 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:24:10.660810 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:24:10.660810 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:24:10.660810 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:24:10.660810 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:24:10.660810 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:24:10.660810 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:24:10.660810 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:24:10.660810 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:24:10.660810 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:24:10.660810 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:24:10.660810 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:24:10.660810 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:24:10.660810 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:24:10.660810 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:24:10.660810 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:24:10.660810 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9fc4f8d8-fd9e-4513-8d3b-6ec7622db95f could not be found. Oct 08 21:24:10.660810 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:24:10.660810 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:24:10.660810 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:24:10.665439 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:24:10.665439 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:24:10.665439 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:24:10.665439 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:24:10.665439 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:24:10.665439 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9fc4f8d8-fd9e-4513-8d3b-6ec7622db95f could not be found. Oct 08 21:24:10.665439 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:24:10.665439 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-49562d83-106e-4fb3-8535-7a88a4a242cc tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Returning 404 to user: Instance 9fc4f8d8-fd9e-4513-8d3b-6ec7622db95f could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:24:10.665439 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-49562d83-106e-4fb3-8535-7a88a4a242cc tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] 10.222.0.26 "GET /compute/v2.1/servers/9fc4f8d8-fd9e-4513-8d3b-6ec7622db95f" status: 404 len: 111 microversion: 2.1 time: 0.069615 Oct 08 21:24:10.665439 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2797/5665] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:24:10 2022] GET /compute/v2.1/servers/9fc4f8d8-fd9e-4513-8d3b-6ec7622db95f => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:24:10.767872 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-abe8f7e4-1708-440d-895a-30b66ec87bb2 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:24:10.769243 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-abe8f7e4-1708-440d-895a-30b66ec87bb2 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 4ae315ed-e587-4aec-b3bb-4b76f8b89331] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:24:10.776561 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-abe8f7e4-1708-440d-895a-30b66ec87bb2 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:10.777337 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-abe8f7e4-1708-440d-895a-30b66ec87bb2 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:10.777983 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-abe8f7e4-1708-440d-895a-30b66ec87bb2 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:10.779008 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-abe8f7e4-1708-440d-895a-30b66ec87bb2 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:10.779482 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-abe8f7e4-1708-440d-895a-30b66ec87bb2 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:10.780100 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-abe8f7e4-1708-440d-895a-30b66ec87bb2 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:10.801018 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-abe8f7e4-1708-440d-895a-30b66ec87bb2 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] HTTP exception thrown: Instance 4ae315ed-e587-4aec-b3bb-4b76f8b89331 could not be found. Oct 08 21:24:10.803549 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-abe8f7e4-1708-440d-895a-30b66ec87bb2 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Request method failure captured: Oct 08 21:24:10.803549 ncdv-master-1 devstack@n-api.service[140492]: request: GET /compute/v2.1/servers/4ae315ed-e587-4aec-b3bb-4b76f8b89331 HTTP/1.1 Oct 08 21:24:10.803549 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:24:10.803549 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:24:10.803549 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:24:10.803549 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 21:24:10.803549 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:24:10.803549 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:24:10.803549 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:24:10.803549 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:24:10.803549 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQejiYlaPI-JtqvK14aYdk5AJQZ9Rj0WfXfezm3HghOQHCqDAnzzaGqHnmcxTg9_bQH8N_IiErrzdvkHM9CcLpkI8dflyFrbZJ8oohauamjv0z3cmdzo6PpuDpJEm2ViNPKrmyHelDYEhGxb7y4b1zyM2T-OENcW1NDh2QOCLmS2DfCA Oct 08 21:24:10.803549 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:24:10.803549 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:24:10.803549 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:24:10.803549 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:24:10.803549 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:24:10.803549 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:24:10.803549 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: bd563fa73afb42c6b26eca3737d7a355 Oct 08 21:24:10.803549 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-ServerActionsTestJSON-1611357772 Oct 08 21:24:10.803549 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:24:10.803549 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:24:10.803549 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/bd563fa73afb42c6b26eca3737d7a355"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/bd563fa73afb42c6b26eca3737d7a355"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_bd563fa73afb42c6b26eca3737d7a355"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/bd563fa73afb42c6b26eca3737d7a355"}]}] Oct 08 21:24:10.803549 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-ServerActionsTestJSON-1611357772 Oct 08 21:24:10.803549 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: bd563fa73afb42c6b26eca3737d7a355 Oct 08 21:24:10.803549 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-ServerActionsTestJSON-1611357772 Oct 08 21:24:10.803549 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-ServerActionsTestJSON-1611357772-project Oct 08 21:24:10.803549 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:24:10.803549 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:24:10.803549 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 2f98e01cab6b49c7a5d239aee95f4a64 Oct 08 21:24:10.803549 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-ServerActionsTestJSON-1611357772-project Oct 08 21:24:10.803549 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 21:24:10.803549 ncdv-master-1 devstack@n-api.service[140492]: exception: Instance 4ae315ed-e587-4aec-b3bb-4b76f8b89331 could not be found. Oct 08 21:24:10.803549 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': '4ae315ed-e587-4aec-b3bb-4b76f8b89331'} Oct 08 21:24:10.803549 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:24:10.803549 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:24:10.803549 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:24:10.803549 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:24:10.803549 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:24:10.803549 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:24:10.803549 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:24:10.803549 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:24:10.803549 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:24:10.803549 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:24:10.803549 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ae315ed-e587-4aec-b3bb-4b76f8b89331 could not be found. Oct 08 21:24:10.803549 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:24:10.803549 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:24:10.803549 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:24:10.803549 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:24:10.803549 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:24:10.803549 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:24:10.803549 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:24:10.803549 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:24:10.803549 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:24:10.803549 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:24:10.803549 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:24:10.803549 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:24:10.803549 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:24:10.803549 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:24:10.803549 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:24:10.803549 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:24:10.803549 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ae315ed-e587-4aec-b3bb-4b76f8b89331 could not be found. Oct 08 21:24:10.803549 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:24:10.803549 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:24:10.803549 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:24:10.810743 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:24:10.810743 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:24:10.810743 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:24:10.810743 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:24:10.810743 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:24:10.810743 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ae315ed-e587-4aec-b3bb-4b76f8b89331 could not be found. Oct 08 21:24:10.810743 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:24:10.812305 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-abe8f7e4-1708-440d-895a-30b66ec87bb2 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Returning 404 to user: Instance 4ae315ed-e587-4aec-b3bb-4b76f8b89331 could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:24:10.813284 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-abe8f7e4-1708-440d-895a-30b66ec87bb2 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/4ae315ed-e587-4aec-b3bb-4b76f8b89331" status: 404 len: 111 microversion: 2.1 time: 0.049363 Oct 08 21:24:10.814232 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2869/5666] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:24:10 2022] GET /compute/v2.1/servers/4ae315ed-e587-4aec-b3bb-4b76f8b89331 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:24:10.823927 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-1142453f-4590-4ff2-9a6f-8631f40115b3 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:24:10.824710 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-1142453f-4590-4ff2-9a6f-8631f40115b3 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: e2ddf0fe-e190-4867-8257-539427de8de4] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:24:10.831637 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1142453f-4590-4ff2-9a6f-8631f40115b3 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:10.832235 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1142453f-4590-4ff2-9a6f-8631f40115b3 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:10.836783 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1142453f-4590-4ff2-9a6f-8631f40115b3 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:10.837607 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1142453f-4590-4ff2-9a6f-8631f40115b3 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:10.838162 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1142453f-4590-4ff2-9a6f-8631f40115b3 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:10.838528 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1142453f-4590-4ff2-9a6f-8631f40115b3 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:10.877121 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-1142453f-4590-4ff2-9a6f-8631f40115b3 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: e2ddf0fe-e190-4867-8257-539427de8de4] Going to try to terminate instance {{(pid=140491) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 21:24:10.904510 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-8cdd8bf7-4b14-4c3c-80f3-a5f5ba69cac0 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Calling method '.version_select at 0x7f1a87507b80>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:24:10.940537 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-8cdd8bf7-4b14-4c3c-80f3-a5f5ba69cac0 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-180191898" status: 202 len: 0 microversion: 2.1 time: 0.040587 Oct 08 21:24:10.942080 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2870/5667] 10.222.0.26 () {58 vars in 1254 bytes} [Sat Oct 8 21:24:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-180191898 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 21:24:10.982201 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-1142453f-4590-4ff2-9a6f-8631f40115b3 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "DELETE /compute/v2.1/servers/e2ddf0fe-e190-4867-8257-539427de8de4" status: 204 len: 0 microversion: 2.1 time: 0.163620 Oct 08 21:24:10.983187 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2798/5668] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:24:10 2022] DELETE /compute/v2.1/servers/e2ddf0fe-e190-4867-8257-539427de8de4 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 08 21:24:10.991356 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-39c9e22c-4684-436f-a647-39b91d9d2b55 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:24:10.992727 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-39c9e22c-4684-436f-a647-39b91d9d2b55 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: e2ddf0fe-e190-4867-8257-539427de8de4] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:24:11.002724 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-39c9e22c-4684-436f-a647-39b91d9d2b55 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:11.003247 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-39c9e22c-4684-436f-a647-39b91d9d2b55 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:11.003709 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-39c9e22c-4684-436f-a647-39b91d9d2b55 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:11.004605 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-39c9e22c-4684-436f-a647-39b91d9d2b55 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:11.005086 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-39c9e22c-4684-436f-a647-39b91d9d2b55 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:11.005791 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-39c9e22c-4684-436f-a647-39b91d9d2b55 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:11.377764 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-39c9e22c-4684-436f-a647-39b91d9d2b55 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:24:11.391801 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-39c9e22c-4684-436f-a647-39b91d9d2b55 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/e2ddf0fe-e190-4867-8257-539427de8de4" status: 200 len: 1495 microversion: 2.1 time: 0.404241 Oct 08 21:24:11.392756 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2871/5669] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:24:10 2022] GET /compute/v2.1/servers/e2ddf0fe-e190-4867-8257-539427de8de4 => generated 1495 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:24:11.452079 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-ac390371-1563-4af6-929d-670d6060c680 req-bc8eb702-55a5-45f2-a022-61bde7acf2d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ae315ed-e587-4aec-b3bb-4b76f8b89331", "name": "network-vif-deleted", "tag": "c22673d8-05e8-4489-99a5-50aecd305e93"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:24:11.465102 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-ac390371-1563-4af6-929d-670d6060c680 req-bc8eb702-55a5-45f2-a022-61bde7acf2d0 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:11.465736 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-ac390371-1563-4af6-929d-670d6060c680 req-bc8eb702-55a5-45f2-a022-61bde7acf2d0 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:11.466674 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-ac390371-1563-4af6-929d-670d6060c680 req-bc8eb702-55a5-45f2-a022-61bde7acf2d0 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:11.489755 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-ac390371-1563-4af6-929d-670d6060c680 req-bc8eb702-55a5-45f2-a022-61bde7acf2d0 service nova] Creating event network-vif-deleted:c22673d8-05e8-4489-99a5-50aecd305e93 for instance 4ae315ed-e587-4aec-b3bb-4b76f8b89331 on nch2-master-1 Oct 08 21:24:11.496879 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-ac390371-1563-4af6-929d-670d6060c680 req-bc8eb702-55a5-45f2-a022-61bde7acf2d0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050073 Oct 08 21:24:11.498079 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2799/5670] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:24:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:24:12.010151 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-42bd0227-e094-422f-9517-603c470f9677 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Action: 'create', calling method: .version_select at 0x7f1a8c18a9d0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-621859771", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNzH4muXVmPL4YGVMXWDiEzzRp+n3P2UuSGTxphqekm7L3xKw8vyZ8hGGode1+/54qmuTsA22newPUgAxny9+p56m5zgSzGacYO6u+KSQr2HbAbuq9ya55OUJZfmr9/g+A=="}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:24:12.026297 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-42bd0227-e094-422f-9517-603c470f9677 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Getting quotas for project 3eeb6be960cc408296ecce6353b72f6d. Resources: {'key_pairs'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:24:12.031784 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-42bd0227-e094-422f-9517-603c470f9677 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Getting quotas for user 8219a93945a147c4a57bb6452212fe7c and project 3eeb6be960cc408296ecce6353b72f6d. Resources: {'key_pairs'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:24:12.059182 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-42bd0227-e094-422f-9517-603c470f9677 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.216133 Oct 08 21:24:12.059995 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2872/5671] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Oct 8 21:24:11 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 08 21:24:12.418387 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-bc6d251c-c17c-4950-b5f8-a683dada9bbc tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:24:12.419284 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-bc6d251c-c17c-4950-b5f8-a683dada9bbc tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: e2ddf0fe-e190-4867-8257-539427de8de4] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:24:12.426192 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bc6d251c-c17c-4950-b5f8-a683dada9bbc tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:12.426760 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bc6d251c-c17c-4950-b5f8-a683dada9bbc tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:12.427275 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bc6d251c-c17c-4950-b5f8-a683dada9bbc tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:12.428169 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bc6d251c-c17c-4950-b5f8-a683dada9bbc tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:12.428714 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bc6d251c-c17c-4950-b5f8-a683dada9bbc tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:12.429261 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bc6d251c-c17c-4950-b5f8-a683dada9bbc tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:12.576413 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-bc6d251c-c17c-4950-b5f8-a683dada9bbc tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:24:12.591398 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-bc6d251c-c17c-4950-b5f8-a683dada9bbc tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/e2ddf0fe-e190-4867-8257-539427de8de4" status: 200 len: 1495 microversion: 2.1 time: 0.179045 Oct 08 21:24:12.592017 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2800/5672] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:24:12 2022] GET /compute/v2.1/servers/e2ddf0fe-e190-4867-8257-539427de8de4 => generated 1495 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:24:13.619629 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-59a1db45-b76c-4a7c-937c-5a9a34ac283d tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:24:13.620474 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-59a1db45-b76c-4a7c-937c-5a9a34ac283d tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: e2ddf0fe-e190-4867-8257-539427de8de4] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:24:13.630425 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-59a1db45-b76c-4a7c-937c-5a9a34ac283d tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:13.631627 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-59a1db45-b76c-4a7c-937c-5a9a34ac283d tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:13.632243 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-59a1db45-b76c-4a7c-937c-5a9a34ac283d tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:13.635070 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-59a1db45-b76c-4a7c-937c-5a9a34ac283d tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:13.636183 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-59a1db45-b76c-4a7c-937c-5a9a34ac283d tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:13.637167 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-59a1db45-b76c-4a7c-937c-5a9a34ac283d tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:14.044154 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-59a1db45-b76c-4a7c-937c-5a9a34ac283d tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:24:14.052608 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-59a1db45-b76c-4a7c-937c-5a9a34ac283d tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/e2ddf0fe-e190-4867-8257-539427de8de4" status: 200 len: 1495 microversion: 2.1 time: 0.440108 Oct 08 21:24:14.053218 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2873/5673] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:24:13 2022] GET /compute/v2.1/servers/e2ddf0fe-e190-4867-8257-539427de8de4 => generated 1495 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:24:14.094541 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-acc3e794-5e7a-4a04-ac75-a59076eccf76 req-c6b11146-e067-452b-b774-93dd9d833f02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2ddf0fe-e190-4867-8257-539427de8de4", "name": "network-vif-deleted", "tag": "434860eb-1a99-46b8-bac3-60a6c7233da4"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:24:14.115093 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-acc3e794-5e7a-4a04-ac75-a59076eccf76 req-c6b11146-e067-452b-b774-93dd9d833f02 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:14.115746 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-acc3e794-5e7a-4a04-ac75-a59076eccf76 req-c6b11146-e067-452b-b774-93dd9d833f02 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:14.116326 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-acc3e794-5e7a-4a04-ac75-a59076eccf76 req-c6b11146-e067-452b-b774-93dd9d833f02 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:14.134384 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-acc3e794-5e7a-4a04-ac75-a59076eccf76 req-c6b11146-e067-452b-b774-93dd9d833f02 service nova] Creating event network-vif-deleted:434860eb-1a99-46b8-bac3-60a6c7233da4 for instance e2ddf0fe-e190-4867-8257-539427de8de4 on nch1-master-1 Oct 08 21:24:14.140593 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-acc3e794-5e7a-4a04-ac75-a59076eccf76 req-c6b11146-e067-452b-b774-93dd9d833f02 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053171 Oct 08 21:24:14.142115 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2801/5674] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:24:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:24:15.079229 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-91f67ff6-afe5-4425-ab7d-558869a02d97 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:24:15.080534 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-91f67ff6-afe5-4425-ab7d-558869a02d97 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: e2ddf0fe-e190-4867-8257-539427de8de4] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:24:15.091628 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-91f67ff6-afe5-4425-ab7d-558869a02d97 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:15.092147 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-91f67ff6-afe5-4425-ab7d-558869a02d97 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:15.092618 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-91f67ff6-afe5-4425-ab7d-558869a02d97 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:15.099239 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-91f67ff6-afe5-4425-ab7d-558869a02d97 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:15.100072 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-91f67ff6-afe5-4425-ab7d-558869a02d97 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:15.100529 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-91f67ff6-afe5-4425-ab7d-558869a02d97 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:15.144822 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-91f67ff6-afe5-4425-ab7d-558869a02d97 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] HTTP exception thrown: Instance e2ddf0fe-e190-4867-8257-539427de8de4 could not be found. Oct 08 21:24:15.148012 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-91f67ff6-afe5-4425-ab7d-558869a02d97 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Request method failure captured: Oct 08 21:24:15.148012 ncdv-master-1 devstack@n-api.service[140492]: request: GET /compute/v2.1/servers/e2ddf0fe-e190-4867-8257-539427de8de4 HTTP/1.1 Oct 08 21:24:15.148012 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:24:15.148012 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:24:15.148012 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:24:15.148012 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 21:24:15.148012 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:24:15.148012 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:24:15.148012 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:24:15.148012 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:24:15.148012 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQejiYlaPI-JtqvK14aYdk5AJQZ9Rj0WfXfezm3HghOQHCqDAnzzaGqHnmcxTg9_bQH8N_IiErrzdvkHM9CcLpkI8dflyFrbZJ8oohauamjv0z3cmdzo6PpuDpJEm2ViNPKrmyHelDYEhGxb7y4b1zyM2T-OENcW1NDh2QOCLmS2DfCA Oct 08 21:24:15.148012 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:24:15.148012 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:24:15.148012 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:24:15.148012 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:24:15.148012 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:24:15.148012 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:24:15.148012 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: bd563fa73afb42c6b26eca3737d7a355 Oct 08 21:24:15.148012 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-ServerActionsTestJSON-1611357772 Oct 08 21:24:15.148012 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:24:15.148012 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:24:15.148012 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/bd563fa73afb42c6b26eca3737d7a355"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/bd563fa73afb42c6b26eca3737d7a355"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_bd563fa73afb42c6b26eca3737d7a355"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/bd563fa73afb42c6b26eca3737d7a355"}]}] Oct 08 21:24:15.148012 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-ServerActionsTestJSON-1611357772 Oct 08 21:24:15.148012 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: bd563fa73afb42c6b26eca3737d7a355 Oct 08 21:24:15.148012 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-ServerActionsTestJSON-1611357772 Oct 08 21:24:15.148012 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-ServerActionsTestJSON-1611357772-project Oct 08 21:24:15.148012 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:24:15.148012 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:24:15.148012 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 2f98e01cab6b49c7a5d239aee95f4a64 Oct 08 21:24:15.148012 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-ServerActionsTestJSON-1611357772-project Oct 08 21:24:15.148012 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 21:24:15.148012 ncdv-master-1 devstack@n-api.service[140492]: exception: Instance e2ddf0fe-e190-4867-8257-539427de8de4 could not be found. Oct 08 21:24:15.148012 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': 'e2ddf0fe-e190-4867-8257-539427de8de4'} Oct 08 21:24:15.148012 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:24:15.148012 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:24:15.148012 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:24:15.148012 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:24:15.148012 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:24:15.148012 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:24:15.148012 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:24:15.148012 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:24:15.148012 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:24:15.148012 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:24:15.148012 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2ddf0fe-e190-4867-8257-539427de8de4 could not be found. Oct 08 21:24:15.148012 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:24:15.148012 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:24:15.148012 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:24:15.148012 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:24:15.148012 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:24:15.148012 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:24:15.148012 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:24:15.148012 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:24:15.148012 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:24:15.148012 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:24:15.148012 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:24:15.148012 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:24:15.148012 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:24:15.148012 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:24:15.148012 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:24:15.148012 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:24:15.148012 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2ddf0fe-e190-4867-8257-539427de8de4 could not be found. Oct 08 21:24:15.148012 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:24:15.148012 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:24:15.148012 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:24:15.154167 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:24:15.154167 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:24:15.154167 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:24:15.154167 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:24:15.154167 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:24:15.154167 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2ddf0fe-e190-4867-8257-539427de8de4 could not be found. Oct 08 21:24:15.154167 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:24:15.155991 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-91f67ff6-afe5-4425-ab7d-558869a02d97 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Returning 404 to user: Instance e2ddf0fe-e190-4867-8257-539427de8de4 could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:24:15.157157 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-91f67ff6-afe5-4425-ab7d-558869a02d97 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/e2ddf0fe-e190-4867-8257-539427de8de4" status: 404 len: 111 microversion: 2.1 time: 0.082283 Oct 08 21:24:15.158664 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2874/5675] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:24:15 2022] GET /compute/v2.1/servers/e2ddf0fe-e190-4867-8257-539427de8de4 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:24:15.173568 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-9f1a0b50-1d84-49b9-a5c2-1671646ceb46 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:24:15.175206 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-9f1a0b50-1d84-49b9-a5c2-1671646ceb46 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 2a61f287-652b-487f-9ecd-fb4d2d1eee62] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:24:15.185638 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9f1a0b50-1d84-49b9-a5c2-1671646ceb46 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:15.187797 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9f1a0b50-1d84-49b9-a5c2-1671646ceb46 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:15.188566 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9f1a0b50-1d84-49b9-a5c2-1671646ceb46 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:15.194089 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9f1a0b50-1d84-49b9-a5c2-1671646ceb46 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:15.194972 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9f1a0b50-1d84-49b9-a5c2-1671646ceb46 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:15.196408 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9f1a0b50-1d84-49b9-a5c2-1671646ceb46 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:15.228656 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-9f1a0b50-1d84-49b9-a5c2-1671646ceb46 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 2a61f287-652b-487f-9ecd-fb4d2d1eee62] Going to try to terminate instance {{(pid=140491) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 21:24:15.345325 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-9f1a0b50-1d84-49b9-a5c2-1671646ceb46 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "DELETE /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62" status: 204 len: 0 microversion: 2.1 time: 0.179373 Oct 08 21:24:15.351542 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2802/5676] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:24:15 2022] DELETE /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 21:24:15.359384 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-783b9eac-0276-447f-ad89-3b52dcc8cbea tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:24:15.360397 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-783b9eac-0276-447f-ad89-3b52dcc8cbea tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 2a61f287-652b-487f-9ecd-fb4d2d1eee62] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:24:15.368950 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-783b9eac-0276-447f-ad89-3b52dcc8cbea tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:15.369837 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-783b9eac-0276-447f-ad89-3b52dcc8cbea tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:15.370702 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-783b9eac-0276-447f-ad89-3b52dcc8cbea tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:15.372389 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-783b9eac-0276-447f-ad89-3b52dcc8cbea tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:15.373106 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-783b9eac-0276-447f-ad89-3b52dcc8cbea tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:15.373813 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-783b9eac-0276-447f-ad89-3b52dcc8cbea tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:15.807002 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-783b9eac-0276-447f-ad89-3b52dcc8cbea tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:24:15.815355 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-783b9eac-0276-447f-ad89-3b52dcc8cbea tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62" status: 200 len: 1676 microversion: 2.1 time: 0.461762 Oct 08 21:24:15.840181 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2875/5677] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:24:15 2022] GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62 => generated 1676 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:24:16.846310 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-a7cb4345-d14a-4c7e-9181-3e1abc5a844e tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:24:16.847032 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-a7cb4345-d14a-4c7e-9181-3e1abc5a844e tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 2a61f287-652b-487f-9ecd-fb4d2d1eee62] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:24:16.855842 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a7cb4345-d14a-4c7e-9181-3e1abc5a844e tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:16.856638 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a7cb4345-d14a-4c7e-9181-3e1abc5a844e tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:16.857481 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a7cb4345-d14a-4c7e-9181-3e1abc5a844e tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:16.859194 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a7cb4345-d14a-4c7e-9181-3e1abc5a844e tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:16.859818 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a7cb4345-d14a-4c7e-9181-3e1abc5a844e tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:16.860414 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a7cb4345-d14a-4c7e-9181-3e1abc5a844e tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:16.876581 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-145673dd-b540-47b4-bfeb-273356494202 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] Calling method '.version_select at 0x7f1a8c18a4c0>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:24:16.918963 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-145673dd-b540-47b4-bfeb-273356494202 tempest-TestSecurityGroupsBasicOps-1247845187 tempest-TestSecurityGroupsBasicOps-1247845187-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-133867488" status: 202 len: 0 microversion: 2.1 time: 0.045990 Oct 08 21:24:16.922671 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2876/5678] 10.222.0.26 () {58 vars in 1275 bytes} [Sat Oct 8 21:24:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-133867488 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 21:24:17.302331 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-a7cb4345-d14a-4c7e-9181-3e1abc5a844e tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:24:17.307665 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=4,nova_cell1:UPDATE=3 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:24:17.317091 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-a7cb4345-d14a-4c7e-9181-3e1abc5a844e tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62" status: 200 len: 1676 microversion: 2.1 time: 0.475215 Oct 08 21:24:17.317935 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2803/5679] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:24:16 2022] GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62 => generated 1676 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:24:18.342849 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-c9a7c6c3-e57b-48b7-bc2d-566750b541a9 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:24:18.343488 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-c9a7c6c3-e57b-48b7-bc2d-566750b541a9 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 2a61f287-652b-487f-9ecd-fb4d2d1eee62] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:24:18.353986 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c9a7c6c3-e57b-48b7-bc2d-566750b541a9 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:18.354883 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c9a7c6c3-e57b-48b7-bc2d-566750b541a9 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:18.355944 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c9a7c6c3-e57b-48b7-bc2d-566750b541a9 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:18.356907 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c9a7c6c3-e57b-48b7-bc2d-566750b541a9 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:18.358215 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c9a7c6c3-e57b-48b7-bc2d-566750b541a9 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:18.358909 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c9a7c6c3-e57b-48b7-bc2d-566750b541a9 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:18.769004 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-c9a7c6c3-e57b-48b7-bc2d-566750b541a9 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:24:18.786285 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-c9a7c6c3-e57b-48b7-bc2d-566750b541a9 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62" status: 200 len: 1676 microversion: 2.1 time: 0.448490 Oct 08 21:24:18.802430 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2877/5680] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:24:18 2022] GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62 => generated 1676 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:24:19.814897 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-bbcad5c8-0053-4814-a57c-a9b5b5c21621 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:24:19.815863 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-bbcad5c8-0053-4814-a57c-a9b5b5c21621 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 2a61f287-652b-487f-9ecd-fb4d2d1eee62] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:24:19.830948 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bbcad5c8-0053-4814-a57c-a9b5b5c21621 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:19.845971 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bbcad5c8-0053-4814-a57c-a9b5b5c21621 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:19.846350 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bbcad5c8-0053-4814-a57c-a9b5b5c21621 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:19.847327 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bbcad5c8-0053-4814-a57c-a9b5b5c21621 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:19.847976 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bbcad5c8-0053-4814-a57c-a9b5b5c21621 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:19.848595 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bbcad5c8-0053-4814-a57c-a9b5b5c21621 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:19.963926 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-95c5e5ba-ebeb-4183-8207-a9d88821a2ef req-32ff2af3-e0a7-409f-bc4c-84dcee7b1a87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a61f287-652b-487f-9ecd-fb4d2d1eee62", "name": "network-vif-deleted", "tag": "960ff13a-d0c5-4f5c-af4b-44aec29e7c23"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:24:19.988039 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-95c5e5ba-ebeb-4183-8207-a9d88821a2ef req-32ff2af3-e0a7-409f-bc4c-84dcee7b1a87 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:19.988923 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-95c5e5ba-ebeb-4183-8207-a9d88821a2ef req-32ff2af3-e0a7-409f-bc4c-84dcee7b1a87 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:19.989656 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-95c5e5ba-ebeb-4183-8207-a9d88821a2ef req-32ff2af3-e0a7-409f-bc4c-84dcee7b1a87 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:20.066818 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-95c5e5ba-ebeb-4183-8207-a9d88821a2ef req-32ff2af3-e0a7-409f-bc4c-84dcee7b1a87 service nova] Creating event network-vif-deleted:960ff13a-d0c5-4f5c-af4b-44aec29e7c23 for instance 2a61f287-652b-487f-9ecd-fb4d2d1eee62 on nch1-master-1 Oct 08 21:24:20.075800 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-95c5e5ba-ebeb-4183-8207-a9d88821a2ef req-32ff2af3-e0a7-409f-bc4c-84dcee7b1a87 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117066 Oct 08 21:24:20.079042 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2878/5681] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:24:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 08 21:24:20.147759 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-bbcad5c8-0053-4814-a57c-a9b5b5c21621 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f98e01cab6b49c7a5d239aee95f4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd563fa73afb42c6b26eca3737d7a355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:24:20.156459 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-bbcad5c8-0053-4814-a57c-a9b5b5c21621 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62" status: 200 len: 1608 microversion: 2.1 time: 0.348275 Oct 08 21:24:20.157986 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2804/5682] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:24:19 2022] GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62 => generated 1608 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:24:21.199642 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-bf17c384-1ec8-4c58-92dc-850cc1b25814 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:24:21.201066 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-bf17c384-1ec8-4c58-92dc-850cc1b25814 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] [instance: 2a61f287-652b-487f-9ecd-fb4d2d1eee62] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:24:21.217834 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bf17c384-1ec8-4c58-92dc-850cc1b25814 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:21.218810 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bf17c384-1ec8-4c58-92dc-850cc1b25814 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:21.219591 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bf17c384-1ec8-4c58-92dc-850cc1b25814 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:21.220530 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bf17c384-1ec8-4c58-92dc-850cc1b25814 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:21.221238 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bf17c384-1ec8-4c58-92dc-850cc1b25814 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:21.222273 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bf17c384-1ec8-4c58-92dc-850cc1b25814 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:21.268924 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-bf17c384-1ec8-4c58-92dc-850cc1b25814 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] HTTP exception thrown: Instance 2a61f287-652b-487f-9ecd-fb4d2d1eee62 could not be found. Oct 08 21:24:21.278439 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-bf17c384-1ec8-4c58-92dc-850cc1b25814 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Request method failure captured: Oct 08 21:24:21.278439 ncdv-master-1 devstack@n-api.service[140492]: request: GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62 HTTP/1.1 Oct 08 21:24:21.278439 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:24:21.278439 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:24:21.278439 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:24:21.278439 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 21:24:21.278439 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:24:21.278439 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:24:21.278439 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:24:21.278439 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:24:21.278439 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQejiYlaPI-JtqvK14aYdk5AJQZ9Rj0WfXfezm3HghOQHCqDAnzzaGqHnmcxTg9_bQH8N_IiErrzdvkHM9CcLpkI8dflyFrbZJ8oohauamjv0z3cmdzo6PpuDpJEm2ViNPKrmyHelDYEhGxb7y4b1zyM2T-OENcW1NDh2QOCLmS2DfCA Oct 08 21:24:21.278439 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:24:21.278439 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:24:21.278439 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:24:21.278439 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:24:21.278439 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:24:21.278439 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:24:21.278439 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: bd563fa73afb42c6b26eca3737d7a355 Oct 08 21:24:21.278439 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-ServerActionsTestJSON-1611357772 Oct 08 21:24:21.278439 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:24:21.278439 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:24:21.278439 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/bd563fa73afb42c6b26eca3737d7a355"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/bd563fa73afb42c6b26eca3737d7a355"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_bd563fa73afb42c6b26eca3737d7a355"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/bd563fa73afb42c6b26eca3737d7a355"}]}] Oct 08 21:24:21.278439 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-ServerActionsTestJSON-1611357772 Oct 08 21:24:21.278439 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: bd563fa73afb42c6b26eca3737d7a355 Oct 08 21:24:21.278439 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-ServerActionsTestJSON-1611357772 Oct 08 21:24:21.278439 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-ServerActionsTestJSON-1611357772-project Oct 08 21:24:21.278439 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:24:21.278439 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:24:21.278439 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 2f98e01cab6b49c7a5d239aee95f4a64 Oct 08 21:24:21.278439 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-ServerActionsTestJSON-1611357772-project Oct 08 21:24:21.278439 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 21:24:21.278439 ncdv-master-1 devstack@n-api.service[140492]: exception: Instance 2a61f287-652b-487f-9ecd-fb4d2d1eee62 could not be found. Oct 08 21:24:21.278439 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': '2a61f287-652b-487f-9ecd-fb4d2d1eee62'} Oct 08 21:24:21.278439 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:24:21.278439 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:24:21.278439 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:24:21.278439 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:24:21.278439 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:24:21.278439 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:24:21.278439 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:24:21.278439 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:24:21.278439 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:24:21.278439 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:24:21.278439 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a61f287-652b-487f-9ecd-fb4d2d1eee62 could not be found. Oct 08 21:24:21.278439 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:24:21.278439 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:24:21.278439 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:24:21.278439 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:24:21.278439 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:24:21.278439 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:24:21.278439 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:24:21.278439 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:24:21.278439 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:24:21.278439 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:24:21.278439 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:24:21.278439 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:24:21.278439 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:24:21.278439 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:24:21.278439 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:24:21.278439 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:24:21.278439 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a61f287-652b-487f-9ecd-fb4d2d1eee62 could not be found. Oct 08 21:24:21.278439 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:24:21.278439 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:24:21.278439 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:24:21.284602 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:24:21.284602 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:24:21.284602 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:24:21.284602 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:24:21.284602 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:24:21.284602 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a61f287-652b-487f-9ecd-fb4d2d1eee62 could not be found. Oct 08 21:24:21.284602 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:24:21.284602 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-bf17c384-1ec8-4c58-92dc-850cc1b25814 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Returning 404 to user: Instance 2a61f287-652b-487f-9ecd-fb4d2d1eee62 could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:24:21.287322 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-bf17c384-1ec8-4c58-92dc-850cc1b25814 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62" status: 404 len: 111 microversion: 2.1 time: 0.101686 Oct 08 21:24:21.294759 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2879/5683] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:24:21 2022] GET /compute/v2.1/servers/2a61f287-652b-487f-9ecd-fb4d2d1eee62 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:24:21.300459 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-4c34cd3c-a62d-4a8b-b1e7-4055b8a31693 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] Calling method '.version_select at 0x7f1a876f9280>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:24:21.330187 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-4c34cd3c-a62d-4a8b-b1e7-4055b8a31693 tempest-ServerActionsTestJSON-1611357772 tempest-ServerActionsTestJSON-1611357772-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1238908508" status: 202 len: 0 microversion: 2.1 time: 0.034139 Oct 08 21:24:21.331504 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2805/5684] 10.222.0.26 () {58 vars in 1221 bytes} [Sat Oct 8 21:24:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1238908508 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 21:24:25.477879 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-d76359ec-4903-4bb5-a14b-cfe48da55996 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-380598054", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "networks": [{"uuid": "282ddda3-640f-4bbd-a0bd-35c00602193e"}], "key_name": "tempest-TestNetworkAdvancedServerOps-621859771", "security_groups": [{"name": "tempest-secgroup-smoke-1457116625"}]}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:24:25.506799 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=4 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:24:25.933468 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.network.neutron [None req-d76359ec-4903-4bb5-a14b-cfe48da55996 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] validate_networks() for [('282ddda3-640f-4bbd-a0bd-35c00602193e', None, None, None, None, None)] {{(pid=140492) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 21:24:28.397123 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-d76359ec-4903-4bb5-a14b-cfe48da55996 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Flavor limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 21:24:28.398674 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-d76359ec-4903-4bb5-a14b-cfe48da55996 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Image limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 21:24:28.399747 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-d76359ec-4903-4bb5-a14b-cfe48da55996 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Flavor pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 21:24:28.400354 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-d76359ec-4903-4bb5-a14b-cfe48da55996 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Image pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 21:24:28.400963 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-d76359ec-4903-4bb5-a14b-cfe48da55996 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 21:24:28.411795 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d76359ec-4903-4bb5-a14b-cfe48da55996 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:28.415049 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d76359ec-4903-4bb5-a14b-cfe48da55996 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:28.415773 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d76359ec-4903-4bb5-a14b-cfe48da55996 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:28.418159 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d76359ec-4903-4bb5-a14b-cfe48da55996 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:28.426053 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d76359ec-4903-4bb5-a14b-cfe48da55996 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:28.428883 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d76359ec-4903-4bb5-a14b-cfe48da55996 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:28.493098 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-d76359ec-4903-4bb5-a14b-cfe48da55996 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Getting quotas for project 3eeb6be960cc408296ecce6353b72f6d. Resources: {'cores', 'instances', 'ram'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:24:28.510497 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-d76359ec-4903-4bb5-a14b-cfe48da55996 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Getting quotas for user 8219a93945a147c4a57bb6452212fe7c and project 3eeb6be960cc408296ecce6353b72f6d. Resources: {'cores', 'instances', 'ram'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:24:28.534085 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-d76359ec-4903-4bb5-a14b-cfe48da55996 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Going to run 1 instances... {{(pid=140492) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 21:24:28.542765 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-d76359ec-4903-4bb5-a14b-cfe48da55996 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 86c50f3f-0621-4fa0-92b7-dd09127c1886] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c508bd7f-7db9-4b2c-af7c-be54a855c355',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140492) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 21:24:28.664338 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-d76359ec-4903-4bb5-a14b-cfe48da55996 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 3.202058 Oct 08 21:24:28.672843 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2880/5685] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 21:24:25 2022] POST /compute/v2.1/servers => generated 406 bytes in 3213 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 08 21:24:28.678846 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-26363af2-7762-4475-982f-a7a4d2941717 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:24:28.680667 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-26363af2-7762-4475-982f-a7a4d2941717 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 86c50f3f-0621-4fa0-92b7-dd09127c1886] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:24:28.867649 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-26363af2-7762-4475-982f-a7a4d2941717 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219a93945a147c4a57bb6452212fe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eeb6be960cc408296ecce6353b72f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:24:28.876168 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-26363af2-7762-4475-982f-a7a4d2941717 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "GET /compute/v2.1/servers/86c50f3f-0621-4fa0-92b7-dd09127c1886" status: 200 len: 1265 microversion: 2.1 time: 0.203343 Oct 08 21:24:28.885566 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2806/5686] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:24:28 2022] GET /compute/v2.1/servers/86c50f3f-0621-4fa0-92b7-dd09127c1886 => generated 1265 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:24:29.902343 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-fc4a04fd-50a8-4345-a64f-df21fdf9af27 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:24:29.903372 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-fc4a04fd-50a8-4345-a64f-df21fdf9af27 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 86c50f3f-0621-4fa0-92b7-dd09127c1886] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:24:29.923505 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fc4a04fd-50a8-4345-a64f-df21fdf9af27 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:29.924080 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fc4a04fd-50a8-4345-a64f-df21fdf9af27 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:29.924553 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fc4a04fd-50a8-4345-a64f-df21fdf9af27 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:29.925546 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fc4a04fd-50a8-4345-a64f-df21fdf9af27 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:29.926033 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fc4a04fd-50a8-4345-a64f-df21fdf9af27 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:29.928824 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fc4a04fd-50a8-4345-a64f-df21fdf9af27 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:29.956013 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:24:30.190460 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-fc4a04fd-50a8-4345-a64f-df21fdf9af27 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219a93945a147c4a57bb6452212fe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eeb6be960cc408296ecce6353b72f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:24:30.206691 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-fc4a04fd-50a8-4345-a64f-df21fdf9af27 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "GET /compute/v2.1/servers/86c50f3f-0621-4fa0-92b7-dd09127c1886" status: 200 len: 1261 microversion: 2.1 time: 0.309439 Oct 08 21:24:30.214928 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2881/5687] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:24:29 2022] GET /compute/v2.1/servers/86c50f3f-0621-4fa0-92b7-dd09127c1886 => generated 1261 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:24:30.299837 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-cb763549-6362-4fef-aae1-1237d6cdfeeb tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Action: 'create', calling method: .version_select at 0x7f1a876feee0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1984693876", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBmcgO/TuF9CdVOc1B+f9GhZunw/xwbj5n2nx+u9q5Hx1teZQ0V4V1Rt5pL8odzK9E2NA9LQWHafxANytEVDuw5gwwdrAzQrEhtRBX3vLUb57MI5SULp6QiybXJGGgHFMg=="}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:24:30.315932 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=7 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:24:30.317402 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:SELECT=89,nova_api:DELETE=2,nova_api:UPDATE=5 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:24:30.342923 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-cb763549-6362-4fef-aae1-1237d6cdfeeb tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Getting quotas for project 9b37e8634ac448ea9a86aff144098dd4. Resources: {'key_pairs'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:24:30.366272 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-cb763549-6362-4fef-aae1-1237d6cdfeeb tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Getting quotas for user e28f7acd53094828a7863ce2fd775cdf and project 9b37e8634ac448ea9a86aff144098dd4. Resources: {'key_pairs'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:24:30.475726 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-cb763549-6362-4fef-aae1-1237d6cdfeeb tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.179851 Oct 08 21:24:30.485001 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2807/5688] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Oct 8 21:24:30 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:24:31.244394 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-d384febd-db86-4aee-8d70-15c51c4a80a2 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:24:31.246003 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-d384febd-db86-4aee-8d70-15c51c4a80a2 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 86c50f3f-0621-4fa0-92b7-dd09127c1886] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:24:31.259563 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d384febd-db86-4aee-8d70-15c51c4a80a2 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:31.260514 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d384febd-db86-4aee-8d70-15c51c4a80a2 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:31.261737 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d384febd-db86-4aee-8d70-15c51c4a80a2 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:31.265024 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d384febd-db86-4aee-8d70-15c51c4a80a2 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:31.267034 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d384febd-db86-4aee-8d70-15c51c4a80a2 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:31.268291 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d384febd-db86-4aee-8d70-15c51c4a80a2 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:31.526509 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-d384febd-db86-4aee-8d70-15c51c4a80a2 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219a93945a147c4a57bb6452212fe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eeb6be960cc408296ecce6353b72f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:24:31.543021 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-d384febd-db86-4aee-8d70-15c51c4a80a2 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "GET /compute/v2.1/servers/86c50f3f-0621-4fa0-92b7-dd09127c1886" status: 200 len: 1323 microversion: 2.1 time: 0.303918 Oct 08 21:24:31.562931 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2882/5689] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:24:31 2022] GET /compute/v2.1/servers/86c50f3f-0621-4fa0-92b7-dd09127c1886 => generated 1323 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:24:32.570488 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-d184ee94-9e34-476b-a36c-f9c378ce8b48 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:24:32.572066 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-d184ee94-9e34-476b-a36c-f9c378ce8b48 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 86c50f3f-0621-4fa0-92b7-dd09127c1886] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:24:32.582432 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d184ee94-9e34-476b-a36c-f9c378ce8b48 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:32.583704 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d184ee94-9e34-476b-a36c-f9c378ce8b48 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:32.584576 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d184ee94-9e34-476b-a36c-f9c378ce8b48 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:32.586414 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d184ee94-9e34-476b-a36c-f9c378ce8b48 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:32.587286 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d184ee94-9e34-476b-a36c-f9c378ce8b48 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:32.587963 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d184ee94-9e34-476b-a36c-f9c378ce8b48 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:32.774756 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-d184ee94-9e34-476b-a36c-f9c378ce8b48 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219a93945a147c4a57bb6452212fe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eeb6be960cc408296ecce6353b72f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:24:32.795738 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-d184ee94-9e34-476b-a36c-f9c378ce8b48 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "GET /compute/v2.1/servers/86c50f3f-0621-4fa0-92b7-dd09127c1886" status: 200 len: 1323 microversion: 2.1 time: 0.229534 Oct 08 21:24:32.799037 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2808/5690] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:24:32 2022] GET /compute/v2.1/servers/86c50f3f-0621-4fa0-92b7-dd09127c1886 => generated 1323 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:24:33.829256 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-12d5ceca-2c73-449b-ac5f-c0675f42b526 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:24:33.829925 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-12d5ceca-2c73-449b-ac5f-c0675f42b526 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 86c50f3f-0621-4fa0-92b7-dd09127c1886] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:24:33.841368 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-12d5ceca-2c73-449b-ac5f-c0675f42b526 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:33.841893 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-12d5ceca-2c73-449b-ac5f-c0675f42b526 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:33.842357 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-12d5ceca-2c73-449b-ac5f-c0675f42b526 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:33.845087 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-12d5ceca-2c73-449b-ac5f-c0675f42b526 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:33.845825 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-12d5ceca-2c73-449b-ac5f-c0675f42b526 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:33.852213 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-12d5ceca-2c73-449b-ac5f-c0675f42b526 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:33.916197 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-1bb24f70-674d-4b6d-9848-8ee49f02f3a6 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1146697726", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "networks": [{"uuid": "0a24f3a8-c3c5-4bcd-8848-1f8642badc92"}], "key_name": "tempest-TestNetworkBasicOps-1984693876", "security_groups": [{"name": "tempest-secgroup-smoke-1857495417"}]}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:24:34.216713 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.network.neutron [None req-1bb24f70-674d-4b6d-9848-8ee49f02f3a6 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] validate_networks() for [('0a24f3a8-c3c5-4bcd-8848-1f8642badc92', None, None, None, None, None)] {{(pid=140491) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 21:24:34.396413 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-12d5ceca-2c73-449b-ac5f-c0675f42b526 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219a93945a147c4a57bb6452212fe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eeb6be960cc408296ecce6353b72f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:24:34.412663 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-12d5ceca-2c73-449b-ac5f-c0675f42b526 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "GET /compute/v2.1/servers/86c50f3f-0621-4fa0-92b7-dd09127c1886" status: 200 len: 1391 microversion: 2.1 time: 0.590749 Oct 08 21:24:34.414308 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2883/5691] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:24:33 2022] GET /compute/v2.1/servers/86c50f3f-0621-4fa0-92b7-dd09127c1886 => generated 1391 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:24:34.687927 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-78b1d159-a45b-4bd7-ad75-f1478bf3eff2 req-4247b121-e12b-4585-ba82-1a0295693233 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86c50f3f-0621-4fa0-92b7-dd09127c1886", "tag": "7a7af606-e3b6-432d-8f3d-56cd8778503f"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:24:34.703495 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-78b1d159-a45b-4bd7-ad75-f1478bf3eff2 req-4247b121-e12b-4585-ba82-1a0295693233 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:34.703994 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-78b1d159-a45b-4bd7-ad75-f1478bf3eff2 req-4247b121-e12b-4585-ba82-1a0295693233 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:34.705326 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-78b1d159-a45b-4bd7-ad75-f1478bf3eff2 req-4247b121-e12b-4585-ba82-1a0295693233 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:34.778308 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-78b1d159-a45b-4bd7-ad75-f1478bf3eff2 req-4247b121-e12b-4585-ba82-1a0295693233 service nova] Creating event network-changed:7a7af606-e3b6-432d-8f3d-56cd8778503f for instance 86c50f3f-0621-4fa0-92b7-dd09127c1886 on nch1-master-1 Oct 08 21:24:34.790051 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-78b1d159-a45b-4bd7-ad75-f1478bf3eff2 req-4247b121-e12b-4585-ba82-1a0295693233 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107086 Oct 08 21:24:34.792511 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2884/5692] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:24:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:24:35.439553 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-b36c954d-9a15-4d74-8a23-64752db9a565 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:24:35.440505 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-b36c954d-9a15-4d74-8a23-64752db9a565 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 86c50f3f-0621-4fa0-92b7-dd09127c1886] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:24:35.447189 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b36c954d-9a15-4d74-8a23-64752db9a565 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:35.448028 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b36c954d-9a15-4d74-8a23-64752db9a565 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:35.448766 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b36c954d-9a15-4d74-8a23-64752db9a565 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:35.450417 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b36c954d-9a15-4d74-8a23-64752db9a565 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:35.451183 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b36c954d-9a15-4d74-8a23-64752db9a565 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:35.452856 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b36c954d-9a15-4d74-8a23-64752db9a565 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:35.726672 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-1bb24f70-674d-4b6d-9848-8ee49f02f3a6 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Flavor limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 21:24:35.727209 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-1bb24f70-674d-4b6d-9848-8ee49f02f3a6 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Image limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 21:24:35.727635 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-1bb24f70-674d-4b6d-9848-8ee49f02f3a6 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Flavor pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 21:24:35.728050 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-1bb24f70-674d-4b6d-9848-8ee49f02f3a6 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Image pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 21:24:35.728468 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-1bb24f70-674d-4b6d-9848-8ee49f02f3a6 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 21:24:35.768385 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1bb24f70-674d-4b6d-9848-8ee49f02f3a6 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:35.770189 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1bb24f70-674d-4b6d-9848-8ee49f02f3a6 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:35.772074 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1bb24f70-674d-4b6d-9848-8ee49f02f3a6 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:35.773253 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1bb24f70-674d-4b6d-9848-8ee49f02f3a6 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:35.776509 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1bb24f70-674d-4b6d-9848-8ee49f02f3a6 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:35.781780 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1bb24f70-674d-4b6d-9848-8ee49f02f3a6 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:35.846812 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-1bb24f70-674d-4b6d-9848-8ee49f02f3a6 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Getting quotas for project 9b37e8634ac448ea9a86aff144098dd4. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:24:35.858372 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-1bb24f70-674d-4b6d-9848-8ee49f02f3a6 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Getting quotas for user e28f7acd53094828a7863ce2fd775cdf and project 9b37e8634ac448ea9a86aff144098dd4. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:24:35.895524 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-1bb24f70-674d-4b6d-9848-8ee49f02f3a6 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Going to run 1 instances... {{(pid=140491) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 21:24:35.899357 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-1bb24f70-674d-4b6d-9848-8ee49f02f3a6 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] [instance: bf3f4dd8-48f7-4c5a-aa5f-ee1e8d3f028b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c508bd7f-7db9-4b2c-af7c-be54a855c355',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140491) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 21:24:36.011926 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-1bb24f70-674d-4b6d-9848-8ee49f02f3a6 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.108467 Oct 08 21:24:36.014929 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2809/5693] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 21:24:33 2022] POST /compute/v2.1/servers => generated 406 bytes in 2112 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 08 21:24:36.030798 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-1c176315-aee1-4fc4-a973-4c48f4e43bd6 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:24:36.032135 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-1c176315-aee1-4fc4-a973-4c48f4e43bd6 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] [instance: bf3f4dd8-48f7-4c5a-aa5f-ee1e8d3f028b] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:24:36.219033 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-1c176315-aee1-4fc4-a973-4c48f4e43bd6 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e28f7acd53094828a7863ce2fd775cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b37e8634ac448ea9a86aff144098dd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:24:36.229669 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-1c176315-aee1-4fc4-a973-4c48f4e43bd6 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] 10.222.0.26 "GET /compute/v2.1/servers/bf3f4dd8-48f7-4c5a-aa5f-ee1e8d3f028b" status: 200 len: 1249 microversion: 2.1 time: 0.206960 Oct 08 21:24:36.231852 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2810/5694] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:24:36 2022] GET /compute/v2.1/servers/bf3f4dd8-48f7-4c5a-aa5f-ee1e8d3f028b => generated 1249 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:24:36.371673 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-b36c954d-9a15-4d74-8a23-64752db9a565 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219a93945a147c4a57bb6452212fe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eeb6be960cc408296ecce6353b72f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:24:36.383473 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-b36c954d-9a15-4d74-8a23-64752db9a565 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "GET /compute/v2.1/servers/86c50f3f-0621-4fa0-92b7-dd09127c1886" status: 200 len: 1391 microversion: 2.1 time: 0.947789 Oct 08 21:24:36.386830 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2885/5695] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:24:35 2022] GET /compute/v2.1/servers/86c50f3f-0621-4fa0-92b7-dd09127c1886 => generated 1391 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:24:37.259197 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-214145ce-64f6-42f4-b5be-606f3c70ca08 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:24:37.260719 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-214145ce-64f6-42f4-b5be-606f3c70ca08 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] [instance: bf3f4dd8-48f7-4c5a-aa5f-ee1e8d3f028b] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:24:37.273365 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-214145ce-64f6-42f4-b5be-606f3c70ca08 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:37.278184 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-214145ce-64f6-42f4-b5be-606f3c70ca08 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:37.279040 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-214145ce-64f6-42f4-b5be-606f3c70ca08 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:37.280114 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-214145ce-64f6-42f4-b5be-606f3c70ca08 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:37.281162 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-214145ce-64f6-42f4-b5be-606f3c70ca08 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:37.285159 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-214145ce-64f6-42f4-b5be-606f3c70ca08 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:37.427189 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-faecac70-fd1a-46f6-ab22-9d33edbfca3d tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:24:37.427826 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-faecac70-fd1a-46f6-ab22-9d33edbfca3d tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 86c50f3f-0621-4fa0-92b7-dd09127c1886] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:24:37.453139 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-faecac70-fd1a-46f6-ab22-9d33edbfca3d tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:37.457888 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-faecac70-fd1a-46f6-ab22-9d33edbfca3d tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:37.459154 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-faecac70-fd1a-46f6-ab22-9d33edbfca3d tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:37.461573 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-faecac70-fd1a-46f6-ab22-9d33edbfca3d tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:37.462982 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-faecac70-fd1a-46f6-ab22-9d33edbfca3d tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:37.464297 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-faecac70-fd1a-46f6-ab22-9d33edbfca3d tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:37.680613 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-214145ce-64f6-42f4-b5be-606f3c70ca08 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e28f7acd53094828a7863ce2fd775cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b37e8634ac448ea9a86aff144098dd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:24:37.697874 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-214145ce-64f6-42f4-b5be-606f3c70ca08 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] 10.222.0.26 "GET /compute/v2.1/servers/bf3f4dd8-48f7-4c5a-aa5f-ee1e8d3f028b" status: 200 len: 1301 microversion: 2.1 time: 0.444308 Oct 08 21:24:37.716107 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2811/5696] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:24:37 2022] GET /compute/v2.1/servers/bf3f4dd8-48f7-4c5a-aa5f-ee1e8d3f028b => generated 1301 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:24:37.896517 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-faecac70-fd1a-46f6-ab22-9d33edbfca3d tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219a93945a147c4a57bb6452212fe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eeb6be960cc408296ecce6353b72f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:24:37.907414 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-faecac70-fd1a-46f6-ab22-9d33edbfca3d tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "GET /compute/v2.1/servers/86c50f3f-0621-4fa0-92b7-dd09127c1886" status: 200 len: 1391 microversion: 2.1 time: 0.496149 Oct 08 21:24:37.922678 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2886/5697] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:24:37 2022] GET /compute/v2.1/servers/86c50f3f-0621-4fa0-92b7-dd09127c1886 => generated 1391 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:24:38.755656 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-82eeabe4-9769-4b86-bb39-a1495996d468 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:24:38.757167 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-82eeabe4-9769-4b86-bb39-a1495996d468 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] [instance: bf3f4dd8-48f7-4c5a-aa5f-ee1e8d3f028b] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:24:38.766609 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-82eeabe4-9769-4b86-bb39-a1495996d468 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:38.767411 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-82eeabe4-9769-4b86-bb39-a1495996d468 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:38.768041 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-82eeabe4-9769-4b86-bb39-a1495996d468 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:38.769360 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-82eeabe4-9769-4b86-bb39-a1495996d468 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:38.770000 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-82eeabe4-9769-4b86-bb39-a1495996d468 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:38.770606 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-82eeabe4-9769-4b86-bb39-a1495996d468 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:38.934877 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-44266495-28df-4d64-a6c5-2b5cd832db72 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:24:38.935625 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-44266495-28df-4d64-a6c5-2b5cd832db72 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 86c50f3f-0621-4fa0-92b7-dd09127c1886] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:24:38.956266 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=2 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:24:38.963522 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=6 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:24:38.966257 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=74,nova_api:DELETE=2,nova_api:INSERT=4 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:24:38.973000 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-44266495-28df-4d64-a6c5-2b5cd832db72 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:38.981264 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-44266495-28df-4d64-a6c5-2b5cd832db72 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:38.982206 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-44266495-28df-4d64-a6c5-2b5cd832db72 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:38.985495 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-44266495-28df-4d64-a6c5-2b5cd832db72 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:38.994030 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-44266495-28df-4d64-a6c5-2b5cd832db72 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:38.994923 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-44266495-28df-4d64-a6c5-2b5cd832db72 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:39.486891 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-44266495-28df-4d64-a6c5-2b5cd832db72 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219a93945a147c4a57bb6452212fe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eeb6be960cc408296ecce6353b72f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:24:39.509135 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-44266495-28df-4d64-a6c5-2b5cd832db72 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "GET /compute/v2.1/servers/86c50f3f-0621-4fa0-92b7-dd09127c1886" status: 200 len: 1391 microversion: 2.1 time: 0.579250 Oct 08 21:24:39.520419 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-82eeabe4-9769-4b86-bb39-a1495996d468 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e28f7acd53094828a7863ce2fd775cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b37e8634ac448ea9a86aff144098dd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:24:39.526435 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2887/5698] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:24:38 2022] GET /compute/v2.1/servers/86c50f3f-0621-4fa0-92b7-dd09127c1886 => generated 1391 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:24:39.533568 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-82eeabe4-9769-4b86-bb39-a1495996d468 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] 10.222.0.26 "GET /compute/v2.1/servers/bf3f4dd8-48f7-4c5a-aa5f-ee1e8d3f028b" status: 200 len: 1375 microversion: 2.1 time: 0.808378 Oct 08 21:24:39.548093 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2812/5699] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:24:38 2022] GET /compute/v2.1/servers/bf3f4dd8-48f7-4c5a-aa5f-ee1e8d3f028b => generated 1375 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:24:40.451448 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-0900f6a3-8469-4c3a-a172-5d860a43e79e req-3c7def02-4e4a-407b-a951-fc7d627b3ad2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf3f4dd8-48f7-4c5a-aa5f-ee1e8d3f028b", "tag": "33f61238-6a86-48e4-b690-1f3245ea9c02"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:24:40.506856 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-0900f6a3-8469-4c3a-a172-5d860a43e79e req-3c7def02-4e4a-407b-a951-fc7d627b3ad2 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:40.507959 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-0900f6a3-8469-4c3a-a172-5d860a43e79e req-3c7def02-4e4a-407b-a951-fc7d627b3ad2 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:40.508786 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-0900f6a3-8469-4c3a-a172-5d860a43e79e req-3c7def02-4e4a-407b-a951-fc7d627b3ad2 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:40.533096 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-e0b9c016-4962-4bf8-97d1-77c83283260e tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:24:40.533645 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-e0b9c016-4962-4bf8-97d1-77c83283260e tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 86c50f3f-0621-4fa0-92b7-dd09127c1886] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:24:40.541060 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-0900f6a3-8469-4c3a-a172-5d860a43e79e req-3c7def02-4e4a-407b-a951-fc7d627b3ad2 service nova] Creating event network-changed:33f61238-6a86-48e4-b690-1f3245ea9c02 for instance bf3f4dd8-48f7-4c5a-aa5f-ee1e8d3f028b on nch2-master-1 Oct 08 21:24:40.551097 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e0b9c016-4962-4bf8-97d1-77c83283260e tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:40.551599 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e0b9c016-4962-4bf8-97d1-77c83283260e tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:40.552256 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e0b9c016-4962-4bf8-97d1-77c83283260e tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:40.552418 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-0900f6a3-8469-4c3a-a172-5d860a43e79e req-3c7def02-4e4a-407b-a951-fc7d627b3ad2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117656 Oct 08 21:24:40.553436 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2888/5700] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:24:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:24:40.553673 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e0b9c016-4962-4bf8-97d1-77c83283260e tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:40.554943 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e0b9c016-4962-4bf8-97d1-77c83283260e tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:40.555388 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e0b9c016-4962-4bf8-97d1-77c83283260e tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:40.565262 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-5fde08b4-0c60-4b50-ae2a-f76b81c7c0ed tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:24:40.566606 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-5fde08b4-0c60-4b50-ae2a-f76b81c7c0ed tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] [instance: bf3f4dd8-48f7-4c5a-aa5f-ee1e8d3f028b] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:24:40.575644 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5fde08b4-0c60-4b50-ae2a-f76b81c7c0ed tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:40.586508 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5fde08b4-0c60-4b50-ae2a-f76b81c7c0ed tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:40.587564 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5fde08b4-0c60-4b50-ae2a-f76b81c7c0ed tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:40.589203 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5fde08b4-0c60-4b50-ae2a-f76b81c7c0ed tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:40.589971 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5fde08b4-0c60-4b50-ae2a-f76b81c7c0ed tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:40.590773 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5fde08b4-0c60-4b50-ae2a-f76b81c7c0ed tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:40.889139 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-5fde08b4-0c60-4b50-ae2a-f76b81c7c0ed tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e28f7acd53094828a7863ce2fd775cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b37e8634ac448ea9a86aff144098dd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:24:40.905167 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-5fde08b4-0c60-4b50-ae2a-f76b81c7c0ed tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] 10.222.0.26 "GET /compute/v2.1/servers/bf3f4dd8-48f7-4c5a-aa5f-ee1e8d3f028b" status: 200 len: 1375 microversion: 2.1 time: 0.347119 Oct 08 21:24:40.907430 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2889/5701] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:24:40 2022] GET /compute/v2.1/servers/bf3f4dd8-48f7-4c5a-aa5f-ee1e8d3f028b => generated 1375 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:24:41.009094 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-e0b9c016-4962-4bf8-97d1-77c83283260e tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219a93945a147c4a57bb6452212fe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eeb6be960cc408296ecce6353b72f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:24:41.024510 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-e0b9c016-4962-4bf8-97d1-77c83283260e tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "GET /compute/v2.1/servers/86c50f3f-0621-4fa0-92b7-dd09127c1886" status: 200 len: 1391 microversion: 2.1 time: 0.490876 Oct 08 21:24:41.025568 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2813/5702] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:24:40 2022] GET /compute/v2.1/servers/86c50f3f-0621-4fa0-92b7-dd09127c1886 => generated 1391 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:24:41.932678 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-2efde39c-2653-48ca-b19b-5586e73d0238 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:24:41.933764 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-2efde39c-2653-48ca-b19b-5586e73d0238 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] [instance: bf3f4dd8-48f7-4c5a-aa5f-ee1e8d3f028b] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:24:41.941129 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2efde39c-2653-48ca-b19b-5586e73d0238 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:41.941759 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2efde39c-2653-48ca-b19b-5586e73d0238 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:41.942462 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2efde39c-2653-48ca-b19b-5586e73d0238 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:41.943315 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2efde39c-2653-48ca-b19b-5586e73d0238 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:41.943845 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2efde39c-2653-48ca-b19b-5586e73d0238 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:41.944523 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2efde39c-2653-48ca-b19b-5586e73d0238 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:42.056833 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-1cf333fc-ee95-4015-a41b-2e9e7d44f8eb tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:24:42.057504 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-1cf333fc-ee95-4015-a41b-2e9e7d44f8eb tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 86c50f3f-0621-4fa0-92b7-dd09127c1886] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:24:42.075189 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1cf333fc-ee95-4015-a41b-2e9e7d44f8eb tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:42.076303 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1cf333fc-ee95-4015-a41b-2e9e7d44f8eb tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:42.077441 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1cf333fc-ee95-4015-a41b-2e9e7d44f8eb tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:42.079617 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1cf333fc-ee95-4015-a41b-2e9e7d44f8eb tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:42.080516 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1cf333fc-ee95-4015-a41b-2e9e7d44f8eb tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:42.081172 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1cf333fc-ee95-4015-a41b-2e9e7d44f8eb tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:42.155041 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-2efde39c-2653-48ca-b19b-5586e73d0238 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e28f7acd53094828a7863ce2fd775cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b37e8634ac448ea9a86aff144098dd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:24:42.169541 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-2efde39c-2653-48ca-b19b-5586e73d0238 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] 10.222.0.26 "GET /compute/v2.1/servers/bf3f4dd8-48f7-4c5a-aa5f-ee1e8d3f028b" status: 200 len: 1375 microversion: 2.1 time: 0.240830 Oct 08 21:24:42.170253 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2890/5703] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:24:41 2022] GET /compute/v2.1/servers/bf3f4dd8-48f7-4c5a-aa5f-ee1e8d3f028b => generated 1375 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:24:42.364205 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-1cf333fc-ee95-4015-a41b-2e9e7d44f8eb tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219a93945a147c4a57bb6452212fe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eeb6be960cc408296ecce6353b72f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:24:42.377673 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-1cf333fc-ee95-4015-a41b-2e9e7d44f8eb tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "GET /compute/v2.1/servers/86c50f3f-0621-4fa0-92b7-dd09127c1886" status: 200 len: 1391 microversion: 2.1 time: 0.328780 Oct 08 21:24:42.386045 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2814/5704] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:24:42 2022] GET /compute/v2.1/servers/86c50f3f-0621-4fa0-92b7-dd09127c1886 => generated 1391 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:24:42.520207 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-c44d8b94-9d02-4f67-9264-89b72edd3300 req-18e90800-36ff-49a0-9c0b-b31bdfdccef7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86c50f3f-0621-4fa0-92b7-dd09127c1886", "name": "network-vif-plugged", "status": "completed", "tag": "7a7af606-e3b6-432d-8f3d-56cd8778503f"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:24:42.541833 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-c44d8b94-9d02-4f67-9264-89b72edd3300 req-18e90800-36ff-49a0-9c0b-b31bdfdccef7 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:42.542559 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-c44d8b94-9d02-4f67-9264-89b72edd3300 req-18e90800-36ff-49a0-9c0b-b31bdfdccef7 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:42.543188 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-c44d8b94-9d02-4f67-9264-89b72edd3300 req-18e90800-36ff-49a0-9c0b-b31bdfdccef7 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:42.569256 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-c44d8b94-9d02-4f67-9264-89b72edd3300 req-18e90800-36ff-49a0-9c0b-b31bdfdccef7 service nova] Creating event network-vif-plugged:7a7af606-e3b6-432d-8f3d-56cd8778503f for instance 86c50f3f-0621-4fa0-92b7-dd09127c1886 on nch1-master-1 Oct 08 21:24:42.582070 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-c44d8b94-9d02-4f67-9264-89b72edd3300 req-18e90800-36ff-49a0-9c0b-b31bdfdccef7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065677 Oct 08 21:24:42.585814 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2891/5705] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:24:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:24:43.199579 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-b53ffde1-8004-44b2-bda8-d1cea3e9d2ef tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:24:43.202075 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-b53ffde1-8004-44b2-bda8-d1cea3e9d2ef tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] [instance: bf3f4dd8-48f7-4c5a-aa5f-ee1e8d3f028b] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:24:43.215507 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b53ffde1-8004-44b2-bda8-d1cea3e9d2ef tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:43.243564 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b53ffde1-8004-44b2-bda8-d1cea3e9d2ef tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.028s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:43.245201 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b53ffde1-8004-44b2-bda8-d1cea3e9d2ef tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:43.246334 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b53ffde1-8004-44b2-bda8-d1cea3e9d2ef tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:43.248583 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b53ffde1-8004-44b2-bda8-d1cea3e9d2ef tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:43.249349 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b53ffde1-8004-44b2-bda8-d1cea3e9d2ef tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:43.408574 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-f9bc63d5-9877-4108-89b8-69e97715a129 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:24:43.410809 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-f9bc63d5-9877-4108-89b8-69e97715a129 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 86c50f3f-0621-4fa0-92b7-dd09127c1886] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:24:43.449229 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f9bc63d5-9877-4108-89b8-69e97715a129 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:43.474546 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f9bc63d5-9877-4108-89b8-69e97715a129 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:43.475425 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f9bc63d5-9877-4108-89b8-69e97715a129 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:43.477884 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f9bc63d5-9877-4108-89b8-69e97715a129 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:43.479826 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f9bc63d5-9877-4108-89b8-69e97715a129 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:43.480946 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f9bc63d5-9877-4108-89b8-69e97715a129 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:43.685235 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-f9bc63d5-9877-4108-89b8-69e97715a129 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219a93945a147c4a57bb6452212fe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eeb6be960cc408296ecce6353b72f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:24:43.697401 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-f9bc63d5-9877-4108-89b8-69e97715a129 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "GET /compute/v2.1/servers/86c50f3f-0621-4fa0-92b7-dd09127c1886" status: 200 len: 1391 microversion: 2.1 time: 0.296821 Oct 08 21:24:43.709699 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2892/5706] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:24:43 2022] GET /compute/v2.1/servers/86c50f3f-0621-4fa0-92b7-dd09127c1886 => generated 1391 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:24:43.799796 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-b53ffde1-8004-44b2-bda8-d1cea3e9d2ef tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e28f7acd53094828a7863ce2fd775cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b37e8634ac448ea9a86aff144098dd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:24:43.811286 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-b53ffde1-8004-44b2-bda8-d1cea3e9d2ef tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] 10.222.0.26 "GET /compute/v2.1/servers/bf3f4dd8-48f7-4c5a-aa5f-ee1e8d3f028b" status: 200 len: 1375 microversion: 2.1 time: 0.618927 Oct 08 21:24:43.813301 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2815/5707] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:24:43 2022] GET /compute/v2.1/servers/bf3f4dd8-48f7-4c5a-aa5f-ee1e8d3f028b => generated 1375 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:24:44.723445 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-ded0bdfb-58b2-4329-a9d7-22848fdfb3c1 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:24:44.725021 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-ded0bdfb-58b2-4329-a9d7-22848fdfb3c1 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 86c50f3f-0621-4fa0-92b7-dd09127c1886] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:24:44.738413 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ded0bdfb-58b2-4329-a9d7-22848fdfb3c1 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:44.739334 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ded0bdfb-58b2-4329-a9d7-22848fdfb3c1 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:44.740137 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ded0bdfb-58b2-4329-a9d7-22848fdfb3c1 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:44.741180 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ded0bdfb-58b2-4329-a9d7-22848fdfb3c1 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:44.742506 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ded0bdfb-58b2-4329-a9d7-22848fdfb3c1 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:44.743188 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ded0bdfb-58b2-4329-a9d7-22848fdfb3c1 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:44.837448 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-99f0495b-5aaf-4764-a2c9-f9c70accdc6c tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:24:44.839067 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-99f0495b-5aaf-4764-a2c9-f9c70accdc6c tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] [instance: bf3f4dd8-48f7-4c5a-aa5f-ee1e8d3f028b] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:24:44.856368 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-99f0495b-5aaf-4764-a2c9-f9c70accdc6c tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:44.857104 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-99f0495b-5aaf-4764-a2c9-f9c70accdc6c tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:44.858151 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-99f0495b-5aaf-4764-a2c9-f9c70accdc6c tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:44.861274 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-99f0495b-5aaf-4764-a2c9-f9c70accdc6c tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:44.861944 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-99f0495b-5aaf-4764-a2c9-f9c70accdc6c tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:44.862853 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-99f0495b-5aaf-4764-a2c9-f9c70accdc6c tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:45.122243 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-ded0bdfb-58b2-4329-a9d7-22848fdfb3c1 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219a93945a147c4a57bb6452212fe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eeb6be960cc408296ecce6353b72f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:24:45.132985 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-ded0bdfb-58b2-4329-a9d7-22848fdfb3c1 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "GET /compute/v2.1/servers/86c50f3f-0621-4fa0-92b7-dd09127c1886" status: 200 len: 1563 microversion: 2.1 time: 0.412298 Oct 08 21:24:45.134070 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2893/5708] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:24:44 2022] GET /compute/v2.1/servers/86c50f3f-0621-4fa0-92b7-dd09127c1886 => generated 1563 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:24:45.157787 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-02ba8b64-2ae4-4d76-8f84-acf9e0aee69d tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:24:45.158993 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-02ba8b64-2ae4-4d76-8f84-acf9e0aee69d tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 86c50f3f-0621-4fa0-92b7-dd09127c1886] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:24:45.167079 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-02ba8b64-2ae4-4d76-8f84-acf9e0aee69d tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:45.168003 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-02ba8b64-2ae4-4d76-8f84-acf9e0aee69d tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:45.168712 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-02ba8b64-2ae4-4d76-8f84-acf9e0aee69d tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:45.169844 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-02ba8b64-2ae4-4d76-8f84-acf9e0aee69d tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:45.170819 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-02ba8b64-2ae4-4d76-8f84-acf9e0aee69d tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:45.171504 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-02ba8b64-2ae4-4d76-8f84-acf9e0aee69d tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:45.363790 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-02ba8b64-2ae4-4d76-8f84-acf9e0aee69d tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219a93945a147c4a57bb6452212fe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eeb6be960cc408296ecce6353b72f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:24:45.374058 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-02ba8b64-2ae4-4d76-8f84-acf9e0aee69d tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "GET /compute/v2.1/servers/86c50f3f-0621-4fa0-92b7-dd09127c1886" status: 200 len: 1563 microversion: 2.1 time: 0.220728 Oct 08 21:24:45.375994 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2894/5709] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:24:45 2022] GET /compute/v2.1/servers/86c50f3f-0621-4fa0-92b7-dd09127c1886 => generated 1563 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:24:45.561167 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-138a0428-9c79-41e6-a7c7-411aa57effe0 req-7bfb103c-740a-475f-82a1-c7ca385435db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf3f4dd8-48f7-4c5a-aa5f-ee1e8d3f028b", "name": "network-vif-plugged", "status": "completed", "tag": "33f61238-6a86-48e4-b690-1f3245ea9c02"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:24:45.579365 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-138a0428-9c79-41e6-a7c7-411aa57effe0 req-7bfb103c-740a-475f-82a1-c7ca385435db service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:45.579873 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-138a0428-9c79-41e6-a7c7-411aa57effe0 req-7bfb103c-740a-475f-82a1-c7ca385435db service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:45.580330 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-138a0428-9c79-41e6-a7c7-411aa57effe0 req-7bfb103c-740a-475f-82a1-c7ca385435db service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:45.608252 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-138a0428-9c79-41e6-a7c7-411aa57effe0 req-7bfb103c-740a-475f-82a1-c7ca385435db service nova] Creating event network-vif-plugged:33f61238-6a86-48e4-b690-1f3245ea9c02 for instance bf3f4dd8-48f7-4c5a-aa5f-ee1e8d3f028b on nch2-master-1 Oct 08 21:24:45.618405 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-138a0428-9c79-41e6-a7c7-411aa57effe0 req-7bfb103c-740a-475f-82a1-c7ca385435db service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059144 Oct 08 21:24:45.621958 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2895/5710] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:24:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 08 21:24:45.786556 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-99f0495b-5aaf-4764-a2c9-f9c70accdc6c tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e28f7acd53094828a7863ce2fd775cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b37e8634ac448ea9a86aff144098dd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:24:45.802334 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-99f0495b-5aaf-4764-a2c9-f9c70accdc6c tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] 10.222.0.26 "GET /compute/v2.1/servers/bf3f4dd8-48f7-4c5a-aa5f-ee1e8d3f028b" status: 200 len: 1375 microversion: 2.1 time: 0.970017 Oct 08 21:24:45.805418 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2816/5711] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:24:44 2022] GET /compute/v2.1/servers/bf3f4dd8-48f7-4c5a-aa5f-ee1e8d3f028b => generated 1375 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:24:46.317333 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-c2b455ab-3f7c-48dd-92b9-e7312953b024 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-242682198", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "networks": [{"uuid": "4df612f9-9ea6-4571-a436-3158f7263b2d"}]}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:24:46.411376 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.network.neutron [None req-c2b455ab-3f7c-48dd-92b9-e7312953b024 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] validate_networks() for [('4df612f9-9ea6-4571-a436-3158f7263b2d', None, None, None, None, None)] {{(pid=140492) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 21:24:46.752797 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=2 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:24:46.752797 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=14 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:24:46.841161 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-7f30180f-e5d7-4b0b-9a2d-f2ce58e13a77 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:24:46.844143 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7f30180f-e5d7-4b0b-9a2d-f2ce58e13a77 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:46.845065 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7f30180f-e5d7-4b0b-9a2d-f2ce58e13a77 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:46.845890 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7f30180f-e5d7-4b0b-9a2d-f2ce58e13a77 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:46.846887 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7f30180f-e5d7-4b0b-9a2d-f2ce58e13a77 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:46.849538 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7f30180f-e5d7-4b0b-9a2d-f2ce58e13a77 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:46.850366 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7f30180f-e5d7-4b0b-9a2d-f2ce58e13a77 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:46.916449 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-7f30180f-e5d7-4b0b-9a2d-f2ce58e13a77 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] 10.222.0.26 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 613 microversion: 2.1 time: 0.245114 Oct 08 21:24:46.922285 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2817/5712] 10.222.0.26 () {58 vars in 1185 bytes} [Sat Oct 8 21:24:46 2022] GET /compute/v2.1/os-availability-zone/detail => generated 613 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:24:46.935000 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-79c59f23-cc98-4589-81ce-1f54855360a5 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:24:46.940803 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-79c59f23-cc98-4589-81ce-1f54855360a5 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] [instance: bf3f4dd8-48f7-4c5a-aa5f-ee1e8d3f028b] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:24:46.948795 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-79c59f23-cc98-4589-81ce-1f54855360a5 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:46.949521 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-79c59f23-cc98-4589-81ce-1f54855360a5 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:46.950107 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-79c59f23-cc98-4589-81ce-1f54855360a5 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:46.951006 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-79c59f23-cc98-4589-81ce-1f54855360a5 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:46.951568 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-79c59f23-cc98-4589-81ce-1f54855360a5 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:46.951943 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-79c59f23-cc98-4589-81ce-1f54855360a5 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:47.140745 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-79c59f23-cc98-4589-81ce-1f54855360a5 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e28f7acd53094828a7863ce2fd775cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b37e8634ac448ea9a86aff144098dd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:24:47.149632 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-79c59f23-cc98-4589-81ce-1f54855360a5 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] 10.222.0.26 "GET /compute/v2.1/servers/bf3f4dd8-48f7-4c5a-aa5f-ee1e8d3f028b" status: 200 len: 1548 microversion: 2.1 time: 0.223104 Oct 08 21:24:47.150243 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2818/5713] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:24:46 2022] GET /compute/v2.1/servers/bf3f4dd8-48f7-4c5a-aa5f-ee1e8d3f028b => generated 1548 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:24:47.158443 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-debcd344-3a34-45e4-b658-0fab698ba2a6 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1336808373", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "availability_zone": "nova:nch1-master-1", "networks": [{"uuid": "24cad0b3-7df2-441a-97d4-4c41cdea1a8c"}]}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:24:47.235090 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.network.neutron [None req-debcd344-3a34-45e4-b658-0fab698ba2a6 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] validate_networks() for [('24cad0b3-7df2-441a-97d4-4c41cdea1a8c', None, None, None, None, None)] {{(pid=140491) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 21:24:47.750787 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-debcd344-3a34-45e4-b658-0fab698ba2a6 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Flavor limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 21:24:47.751402 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-debcd344-3a34-45e4-b658-0fab698ba2a6 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Image limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 21:24:47.752757 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-debcd344-3a34-45e4-b658-0fab698ba2a6 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Flavor pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 21:24:47.753423 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-debcd344-3a34-45e4-b658-0fab698ba2a6 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Image pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 21:24:47.754426 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-debcd344-3a34-45e4-b658-0fab698ba2a6 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 21:24:47.768184 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-debcd344-3a34-45e4-b658-0fab698ba2a6 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:47.768762 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-debcd344-3a34-45e4-b658-0fab698ba2a6 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:47.769263 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-debcd344-3a34-45e4-b658-0fab698ba2a6 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:47.770071 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-debcd344-3a34-45e4-b658-0fab698ba2a6 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:47.770542 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-debcd344-3a34-45e4-b658-0fab698ba2a6 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:47.770980 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-debcd344-3a34-45e4-b658-0fab698ba2a6 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:47.794022 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-debcd344-3a34-45e4-b658-0fab698ba2a6 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Getting quotas for project 16eb444f844c4a1e8645da20451f4690. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:24:47.800152 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-debcd344-3a34-45e4-b658-0fab698ba2a6 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Getting quotas for user 91a0e7f4cb9f4c91b9e923a5886b6579 and project 16eb444f844c4a1e8645da20451f4690. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:24:47.816221 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-debcd344-3a34-45e4-b658-0fab698ba2a6 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Going to run 1 instances... {{(pid=140491) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 21:24:47.820518 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-debcd344-3a34-45e4-b658-0fab698ba2a6 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] [instance: 02a7e011-cb93-4cf4-8d1a-5912c3d1701c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c508bd7f-7db9-4b2c-af7c-be54a855c355',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140491) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 21:24:47.869617 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-c2b455ab-3f7c-48dd-92b9-e7312953b024 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Flavor limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 21:24:47.870388 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-c2b455ab-3f7c-48dd-92b9-e7312953b024 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Image limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 21:24:47.870896 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-c2b455ab-3f7c-48dd-92b9-e7312953b024 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Flavor pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 21:24:47.871327 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-c2b455ab-3f7c-48dd-92b9-e7312953b024 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Image pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 21:24:47.871903 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-c2b455ab-3f7c-48dd-92b9-e7312953b024 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 21:24:47.885048 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-debcd344-3a34-45e4-b658-0fab698ba2a6 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.733583 Oct 08 21:24:47.886287 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2819/5714] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 21:24:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 735 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 08 21:24:47.891789 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-48f6ef67-4ae7-4555-b88f-d13472740f3e tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:24:47.892979 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-48f6ef67-4ae7-4555-b88f-d13472740f3e tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] [instance: bf3f4dd8-48f7-4c5a-aa5f-ee1e8d3f028b] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:24:47.900165 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-48f6ef67-4ae7-4555-b88f-d13472740f3e tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:47.900682 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-48f6ef67-4ae7-4555-b88f-d13472740f3e tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:47.901221 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-48f6ef67-4ae7-4555-b88f-d13472740f3e tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:47.902051 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-48f6ef67-4ae7-4555-b88f-d13472740f3e tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:47.902832 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-48f6ef67-4ae7-4555-b88f-d13472740f3e tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:47.903282 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-48f6ef67-4ae7-4555-b88f-d13472740f3e tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:47.914596 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c2b455ab-3f7c-48dd-92b9-e7312953b024 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:47.915111 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c2b455ab-3f7c-48dd-92b9-e7312953b024 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:47.918417 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c2b455ab-3f7c-48dd-92b9-e7312953b024 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:47.919279 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c2b455ab-3f7c-48dd-92b9-e7312953b024 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:47.919771 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c2b455ab-3f7c-48dd-92b9-e7312953b024 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:47.920225 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c2b455ab-3f7c-48dd-92b9-e7312953b024 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:47.958117 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-c2b455ab-3f7c-48dd-92b9-e7312953b024 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Getting quotas for project 53c1365cdc2f42e5ba271ee55f4d8406. Resources: {'cores', 'instances', 'ram'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:24:47.971530 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-c2b455ab-3f7c-48dd-92b9-e7312953b024 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Getting quotas for user a7000e1f74c84240a7f41e8b1da74eff and project 53c1365cdc2f42e5ba271ee55f4d8406. Resources: {'cores', 'instances', 'ram'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:24:47.986999 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-c2b455ab-3f7c-48dd-92b9-e7312953b024 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Going to run 1 instances... {{(pid=140492) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 21:24:47.989840 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-c2b455ab-3f7c-48dd-92b9-e7312953b024 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] [instance: 6954e204-0dc4-481e-a3b9-26acaef64dbb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c508bd7f-7db9-4b2c-af7c-be54a855c355',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140492) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 21:24:48.065686 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-c2b455ab-3f7c-48dd-92b9-e7312953b024 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 1.963586 Oct 08 21:24:48.066943 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2896/5715] 10.222.0.26 () {62 vars in 1188 bytes} [Sat Oct 8 21:24:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 1970 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 08 21:24:48.088206 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-62e40878-3ae8-461d-99e1-153f61b8a19a tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:24:48.088943 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-62e40878-3ae8-461d-99e1-153f61b8a19a tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] [instance: 02a7e011-cb93-4cf4-8d1a-5912c3d1701c] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:24:48.141980 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-48f6ef67-4ae7-4555-b88f-d13472740f3e tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e28f7acd53094828a7863ce2fd775cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b37e8634ac448ea9a86aff144098dd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:24:48.153779 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-48f6ef67-4ae7-4555-b88f-d13472740f3e tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] 10.222.0.26 "GET /compute/v2.1/servers/bf3f4dd8-48f7-4c5a-aa5f-ee1e8d3f028b" status: 200 len: 1548 microversion: 2.1 time: 0.265360 Oct 08 21:24:48.174291 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2820/5716] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:24:47 2022] GET /compute/v2.1/servers/bf3f4dd8-48f7-4c5a-aa5f-ee1e8d3f028b => generated 1548 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:24:48.181004 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-7dd0c922-89ba-4455-a583-e714145ef7b7 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:24:48.181845 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-7dd0c922-89ba-4455-a583-e714145ef7b7 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] [instance: 6954e204-0dc4-481e-a3b9-26acaef64dbb] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:24:48.246841 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-62e40878-3ae8-461d-99e1-153f61b8a19a tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/02a7e011-cb93-4cf4-8d1a-5912c3d1701c" status: 200 len: 1329 microversion: 2.1 time: 0.178040 Oct 08 21:24:48.264987 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2897/5717] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:24:48 2022] GET /compute/v2.1/servers/02a7e011-cb93-4cf4-8d1a-5912c3d1701c => generated 1329 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:24:48.303230 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-7dd0c922-89ba-4455-a583-e714145ef7b7 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7000e1f74c84240a7f41e8b1da74eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c1365cdc2f42e5ba271ee55f4d8406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:24:48.315187 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-7dd0c922-89ba-4455-a583-e714145ef7b7 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7000e1f74c84240a7f41e8b1da74eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c1365cdc2f42e5ba271ee55f4d8406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:24:48.318581 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-7dd0c922-89ba-4455-a583-e714145ef7b7 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7000e1f74c84240a7f41e8b1da74eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c1365cdc2f42e5ba271ee55f4d8406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:24:48.324645 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-7dd0c922-89ba-4455-a583-e714145ef7b7 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] 10.222.0.26 "GET /compute/v2.1/servers/6954e204-0dc4-481e-a3b9-26acaef64dbb" status: 200 len: 1261 microversion: 2.26 time: 0.149003 Oct 08 21:24:48.325366 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2821/5718] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:24:48 2022] GET /compute/v2.1/servers/6954e204-0dc4-481e-a3b9-26acaef64dbb => generated 1261 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:24:49.281141 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-587a450c-a859-47a8-a993-a487f8f42e7b tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:24:49.282766 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-587a450c-a859-47a8-a993-a487f8f42e7b tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] [instance: 02a7e011-cb93-4cf4-8d1a-5912c3d1701c] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:24:49.310274 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-587a450c-a859-47a8-a993-a487f8f42e7b tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:49.311706 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-587a450c-a859-47a8-a993-a487f8f42e7b tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:49.313328 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-587a450c-a859-47a8-a993-a487f8f42e7b tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:49.314576 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-587a450c-a859-47a8-a993-a487f8f42e7b tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:49.325687 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-943fa786-7742-4055-bdb6-425b491fcaad tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:24:49.326844 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-943fa786-7742-4055-bdb6-425b491fcaad tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 86c50f3f-0621-4fa0-92b7-dd09127c1886] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:24:49.331577 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-587a450c-a859-47a8-a993-a487f8f42e7b tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:49.332236 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-587a450c-a859-47a8-a993-a487f8f42e7b tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:49.347066 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-943fa786-7742-4055-bdb6-425b491fcaad tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:49.348022 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-943fa786-7742-4055-bdb6-425b491fcaad tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:49.350496 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-943fa786-7742-4055-bdb6-425b491fcaad tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:49.355041 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-943fa786-7742-4055-bdb6-425b491fcaad tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:49.358585 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-943fa786-7742-4055-bdb6-425b491fcaad tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:49.360406 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-943fa786-7742-4055-bdb6-425b491fcaad tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:49.459307 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-587a450c-a859-47a8-a993-a487f8f42e7b tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/02a7e011-cb93-4cf4-8d1a-5912c3d1701c" status: 200 len: 1338 microversion: 2.1 time: 0.184520 Oct 08 21:24:49.460532 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2898/5719] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:24:49 2022] GET /compute/v2.1/servers/02a7e011-cb93-4cf4-8d1a-5912c3d1701c => generated 1338 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:24:49.466937 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-df20266d-531a-45bc-b857-ae8dd34c1bbb req-2579e10d-04d1-4d1b-b638-18cece10f390 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86c50f3f-0621-4fa0-92b7-dd09127c1886", "tag": "7a7af606-e3b6-432d-8f3d-56cd8778503f"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:24:49.499491 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-df20266d-531a-45bc-b857-ae8dd34c1bbb req-2579e10d-04d1-4d1b-b638-18cece10f390 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:49.500360 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-df20266d-531a-45bc-b857-ae8dd34c1bbb req-2579e10d-04d1-4d1b-b638-18cece10f390 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:49.501069 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-df20266d-531a-45bc-b857-ae8dd34c1bbb req-2579e10d-04d1-4d1b-b638-18cece10f390 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:49.521021 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-df20266d-531a-45bc-b857-ae8dd34c1bbb req-2579e10d-04d1-4d1b-b638-18cece10f390 service nova] Creating event network-changed:7a7af606-e3b6-432d-8f3d-56cd8778503f for instance 86c50f3f-0621-4fa0-92b7-dd09127c1886 on nch1-master-1 Oct 08 21:24:49.528443 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-df20266d-531a-45bc-b857-ae8dd34c1bbb req-2579e10d-04d1-4d1b-b638-18cece10f390 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066270 Oct 08 21:24:49.529780 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2899/5720] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:24:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:24:49.538035 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-30f2c503-dad3-4ab2-a236-19920c7570e1 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:24:49.539654 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-30f2c503-dad3-4ab2-a236-19920c7570e1 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] [instance: 6954e204-0dc4-481e-a3b9-26acaef64dbb] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:24:49.549120 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-30f2c503-dad3-4ab2-a236-19920c7570e1 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:49.551300 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-30f2c503-dad3-4ab2-a236-19920c7570e1 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:49.552412 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-30f2c503-dad3-4ab2-a236-19920c7570e1 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:49.553481 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-30f2c503-dad3-4ab2-a236-19920c7570e1 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:49.554976 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-30f2c503-dad3-4ab2-a236-19920c7570e1 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:49.556506 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-30f2c503-dad3-4ab2-a236-19920c7570e1 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:49.670254 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-30f2c503-dad3-4ab2-a236-19920c7570e1 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7000e1f74c84240a7f41e8b1da74eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c1365cdc2f42e5ba271ee55f4d8406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:24:49.686407 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-30f2c503-dad3-4ab2-a236-19920c7570e1 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7000e1f74c84240a7f41e8b1da74eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c1365cdc2f42e5ba271ee55f4d8406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:24:49.690499 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-30f2c503-dad3-4ab2-a236-19920c7570e1 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7000e1f74c84240a7f41e8b1da74eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c1365cdc2f42e5ba271ee55f4d8406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:24:49.693570 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-30f2c503-dad3-4ab2-a236-19920c7570e1 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] 10.222.0.26 "GET /compute/v2.1/servers/6954e204-0dc4-481e-a3b9-26acaef64dbb" status: 200 len: 1313 microversion: 2.26 time: 0.162383 Oct 08 21:24:49.695982 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2900/5721] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:24:49 2022] GET /compute/v2.1/servers/6954e204-0dc4-481e-a3b9-26acaef64dbb => generated 1313 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:24:49.791616 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-943fa786-7742-4055-bdb6-425b491fcaad tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219a93945a147c4a57bb6452212fe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eeb6be960cc408296ecce6353b72f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:24:49.801550 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-943fa786-7742-4055-bdb6-425b491fcaad tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "GET /compute/v2.1/servers/86c50f3f-0621-4fa0-92b7-dd09127c1886" status: 200 len: 1563 microversion: 2.1 time: 0.480534 Oct 08 21:24:49.805701 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2822/5722] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:24:49 2022] GET /compute/v2.1/servers/86c50f3f-0621-4fa0-92b7-dd09127c1886 => generated 1563 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:24:50.486405 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-12617a31-927d-4834-afd2-d3359a4154db tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:24:50.487019 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-12617a31-927d-4834-afd2-d3359a4154db tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] [instance: 02a7e011-cb93-4cf4-8d1a-5912c3d1701c] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:24:50.498987 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-12617a31-927d-4834-afd2-d3359a4154db tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:50.499714 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-12617a31-927d-4834-afd2-d3359a4154db tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:50.506447 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-12617a31-927d-4834-afd2-d3359a4154db tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:50.507488 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-12617a31-927d-4834-afd2-d3359a4154db tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:50.508118 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-12617a31-927d-4834-afd2-d3359a4154db tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:50.508697 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-12617a31-927d-4834-afd2-d3359a4154db tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:50.674003 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-12617a31-927d-4834-afd2-d3359a4154db tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/02a7e011-cb93-4cf4-8d1a-5912c3d1701c" status: 200 len: 1416 microversion: 2.1 time: 0.185843 Oct 08 21:24:50.690922 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2901/5723] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:24:50 2022] GET /compute/v2.1/servers/02a7e011-cb93-4cf4-8d1a-5912c3d1701c => generated 1416 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:24:50.723997 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-1a40f02c-214e-4c97-bfc9-83541240c7ee tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:24:50.725060 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-1a40f02c-214e-4c97-bfc9-83541240c7ee tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] [instance: 6954e204-0dc4-481e-a3b9-26acaef64dbb] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:24:50.742578 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1a40f02c-214e-4c97-bfc9-83541240c7ee tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:50.747585 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1a40f02c-214e-4c97-bfc9-83541240c7ee tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:50.748199 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1a40f02c-214e-4c97-bfc9-83541240c7ee tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:50.749242 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1a40f02c-214e-4c97-bfc9-83541240c7ee tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:50.750344 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1a40f02c-214e-4c97-bfc9-83541240c7ee tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:50.751640 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1a40f02c-214e-4c97-bfc9-83541240c7ee tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:50.953360 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-1a40f02c-214e-4c97-bfc9-83541240c7ee tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7000e1f74c84240a7f41e8b1da74eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c1365cdc2f42e5ba271ee55f4d8406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:24:50.969326 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-1a40f02c-214e-4c97-bfc9-83541240c7ee tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7000e1f74c84240a7f41e8b1da74eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c1365cdc2f42e5ba271ee55f4d8406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:24:50.971049 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-1a40f02c-214e-4c97-bfc9-83541240c7ee tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7000e1f74c84240a7f41e8b1da74eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c1365cdc2f42e5ba271ee55f4d8406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:24:50.972456 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-1a40f02c-214e-4c97-bfc9-83541240c7ee tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] 10.222.0.26 "GET /compute/v2.1/servers/6954e204-0dc4-481e-a3b9-26acaef64dbb" status: 200 len: 1319 microversion: 2.26 time: 0.253254 Oct 08 21:24:50.980185 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2823/5724] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:24:50 2022] GET /compute/v2.1/servers/6954e204-0dc4-481e-a3b9-26acaef64dbb => generated 1319 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:24:51.703346 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-5692e21b-c191-41ec-8735-ef0ae937b14a tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:24:51.704746 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-5692e21b-c191-41ec-8735-ef0ae937b14a tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] [instance: 02a7e011-cb93-4cf4-8d1a-5912c3d1701c] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:24:51.717976 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5692e21b-c191-41ec-8735-ef0ae937b14a tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:51.718860 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5692e21b-c191-41ec-8735-ef0ae937b14a tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:51.719661 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5692e21b-c191-41ec-8735-ef0ae937b14a tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:51.721248 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5692e21b-c191-41ec-8735-ef0ae937b14a tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:51.721976 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5692e21b-c191-41ec-8735-ef0ae937b14a tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:51.722619 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5692e21b-c191-41ec-8735-ef0ae937b14a tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:51.856705 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=100 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:24:51.863925 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-5692e21b-c191-41ec-8735-ef0ae937b14a tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/02a7e011-cb93-4cf4-8d1a-5912c3d1701c" status: 200 len: 1422 microversion: 2.1 time: 0.164478 Oct 08 21:24:51.882391 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2902/5725] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:24:51 2022] GET /compute/v2.1/servers/02a7e011-cb93-4cf4-8d1a-5912c3d1701c => generated 1422 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:24:52.029624 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-765fb494-9e78-4886-bdd7-56240a537579 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:24:52.031785 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-765fb494-9e78-4886-bdd7-56240a537579 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] [instance: 6954e204-0dc4-481e-a3b9-26acaef64dbb] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:24:52.041704 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-765fb494-9e78-4886-bdd7-56240a537579 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:52.042215 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-765fb494-9e78-4886-bdd7-56240a537579 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:52.042666 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-765fb494-9e78-4886-bdd7-56240a537579 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:52.043932 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-765fb494-9e78-4886-bdd7-56240a537579 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:52.044974 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-765fb494-9e78-4886-bdd7-56240a537579 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:52.049918 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-765fb494-9e78-4886-bdd7-56240a537579 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:52.274489 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-765fb494-9e78-4886-bdd7-56240a537579 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7000e1f74c84240a7f41e8b1da74eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c1365cdc2f42e5ba271ee55f4d8406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:24:52.292946 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-765fb494-9e78-4886-bdd7-56240a537579 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7000e1f74c84240a7f41e8b1da74eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c1365cdc2f42e5ba271ee55f4d8406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:24:52.296806 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-765fb494-9e78-4886-bdd7-56240a537579 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7000e1f74c84240a7f41e8b1da74eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c1365cdc2f42e5ba271ee55f4d8406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:24:52.299483 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-765fb494-9e78-4886-bdd7-56240a537579 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] 10.222.0.26 "GET /compute/v2.1/servers/6954e204-0dc4-481e-a3b9-26acaef64dbb" status: 200 len: 1319 microversion: 2.26 time: 0.292737 Oct 08 21:24:52.302007 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2824/5726] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:24:52 2022] GET /compute/v2.1/servers/6954e204-0dc4-481e-a3b9-26acaef64dbb => generated 1319 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:24:52.762730 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-d6b8c74a-11bc-486c-8b78-b9e03efd2b16 req-24d3b68f-97c0-417e-9289-c0adba82ebdb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf3f4dd8-48f7-4c5a-aa5f-ee1e8d3f028b", "tag": "33f61238-6a86-48e4-b690-1f3245ea9c02"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:24:52.780813 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-d6b8c74a-11bc-486c-8b78-b9e03efd2b16 req-24d3b68f-97c0-417e-9289-c0adba82ebdb service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:52.781825 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-d6b8c74a-11bc-486c-8b78-b9e03efd2b16 req-24d3b68f-97c0-417e-9289-c0adba82ebdb service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:52.784365 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-d6b8c74a-11bc-486c-8b78-b9e03efd2b16 req-24d3b68f-97c0-417e-9289-c0adba82ebdb service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:52.810147 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-d6b8c74a-11bc-486c-8b78-b9e03efd2b16 req-24d3b68f-97c0-417e-9289-c0adba82ebdb service nova] Creating event network-changed:33f61238-6a86-48e4-b690-1f3245ea9c02 for instance bf3f4dd8-48f7-4c5a-aa5f-ee1e8d3f028b on nch2-master-1 Oct 08 21:24:52.823516 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-d6b8c74a-11bc-486c-8b78-b9e03efd2b16 req-24d3b68f-97c0-417e-9289-c0adba82ebdb service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064438 Oct 08 21:24:52.826500 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2903/5727] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:24:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:24:52.889702 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-899682e8-3c1c-423c-96eb-e1a3d9b662a6 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:24:52.890521 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-899682e8-3c1c-423c-96eb-e1a3d9b662a6 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] [instance: 02a7e011-cb93-4cf4-8d1a-5912c3d1701c] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:24:52.901639 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-899682e8-3c1c-423c-96eb-e1a3d9b662a6 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:52.907785 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-899682e8-3c1c-423c-96eb-e1a3d9b662a6 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:52.908804 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-899682e8-3c1c-423c-96eb-e1a3d9b662a6 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:52.910940 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-899682e8-3c1c-423c-96eb-e1a3d9b662a6 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:52.911621 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-899682e8-3c1c-423c-96eb-e1a3d9b662a6 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:52.912299 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-899682e8-3c1c-423c-96eb-e1a3d9b662a6 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:53.326780 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-ae59424f-94b1-4787-9b21-ce69b61baf34 req-dbd12258-a1bd-489f-b2b1-dde4e5a24d78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02a7e011-cb93-4cf4-8d1a-5912c3d1701c", "tag": "6e75fee7-0762-491e-bfd2-47c9b1ab79f8"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:24:53.347133 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-ae59424f-94b1-4787-9b21-ce69b61baf34 req-dbd12258-a1bd-489f-b2b1-dde4e5a24d78 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:53.347793 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-ae59424f-94b1-4787-9b21-ce69b61baf34 req-dbd12258-a1bd-489f-b2b1-dde4e5a24d78 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:53.348925 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-ae59424f-94b1-4787-9b21-ce69b61baf34 req-dbd12258-a1bd-489f-b2b1-dde4e5a24d78 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:53.376880 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-ae59424f-94b1-4787-9b21-ce69b61baf34 req-dbd12258-a1bd-489f-b2b1-dde4e5a24d78 service nova] Creating event network-changed:6e75fee7-0762-491e-bfd2-47c9b1ab79f8 for instance 02a7e011-cb93-4cf4-8d1a-5912c3d1701c on nch1-master-1 Oct 08 21:24:53.397977 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-ae59424f-94b1-4787-9b21-ce69b61baf34 req-dbd12258-a1bd-489f-b2b1-dde4e5a24d78 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075968 Oct 08 21:24:53.399139 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2904/5728] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:24:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:24:53.407404 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-5be720b3-9e4a-4148-bf13-66e1ee5444e5 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:24:53.415180 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-5be720b3-9e4a-4148-bf13-66e1ee5444e5 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] [instance: 6954e204-0dc4-481e-a3b9-26acaef64dbb] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:24:53.447769 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5be720b3-9e4a-4148-bf13-66e1ee5444e5 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:53.452485 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5be720b3-9e4a-4148-bf13-66e1ee5444e5 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:53.453051 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5be720b3-9e4a-4148-bf13-66e1ee5444e5 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:53.453881 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5be720b3-9e4a-4148-bf13-66e1ee5444e5 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:53.454375 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5be720b3-9e4a-4148-bf13-66e1ee5444e5 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:53.457709 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5be720b3-9e4a-4148-bf13-66e1ee5444e5 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:53.601432 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-899682e8-3c1c-423c-96eb-e1a3d9b662a6 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/02a7e011-cb93-4cf4-8d1a-5912c3d1701c" status: 200 len: 1464 microversion: 2.1 time: 0.716496 Oct 08 21:24:53.603405 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2825/5729] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:24:52 2022] GET /compute/v2.1/servers/02a7e011-cb93-4cf4-8d1a-5912c3d1701c => generated 1464 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:24:53.909167 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-5be720b3-9e4a-4148-bf13-66e1ee5444e5 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7000e1f74c84240a7f41e8b1da74eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c1365cdc2f42e5ba271ee55f4d8406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:24:53.923811 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-5be720b3-9e4a-4148-bf13-66e1ee5444e5 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7000e1f74c84240a7f41e8b1da74eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c1365cdc2f42e5ba271ee55f4d8406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:24:53.931738 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-5be720b3-9e4a-4148-bf13-66e1ee5444e5 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7000e1f74c84240a7f41e8b1da74eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c1365cdc2f42e5ba271ee55f4d8406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:24:53.935907 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-5be720b3-9e4a-4148-bf13-66e1ee5444e5 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] 10.222.0.26 "GET /compute/v2.1/servers/6954e204-0dc4-481e-a3b9-26acaef64dbb" status: 200 len: 1361 microversion: 2.26 time: 0.535456 Oct 08 21:24:53.941831 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2905/5730] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:24:53 2022] GET /compute/v2.1/servers/6954e204-0dc4-481e-a3b9-26acaef64dbb => generated 1361 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:24:54.637919 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-2255d1ea-db3c-40f9-be8b-f6470ad7e2e9 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:24:54.639243 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-2255d1ea-db3c-40f9-be8b-f6470ad7e2e9 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] [instance: 02a7e011-cb93-4cf4-8d1a-5912c3d1701c] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:24:54.650106 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2255d1ea-db3c-40f9-be8b-f6470ad7e2e9 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:54.651637 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2255d1ea-db3c-40f9-be8b-f6470ad7e2e9 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:54.652228 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2255d1ea-db3c-40f9-be8b-f6470ad7e2e9 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:54.659175 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2255d1ea-db3c-40f9-be8b-f6470ad7e2e9 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:54.659870 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2255d1ea-db3c-40f9-be8b-f6470ad7e2e9 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:54.660671 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2255d1ea-db3c-40f9-be8b-f6470ad7e2e9 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:54.863403 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-690a3d5b-09ff-4129-9211-a801f0a1c25e req-c06154f1-77fc-43ac-a938-7ef97a966cf3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6954e204-0dc4-481e-a3b9-26acaef64dbb", "tag": "55ffdd5e-4550-4dde-8b42-6efe6154e311"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:24:54.881554 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-690a3d5b-09ff-4129-9211-a801f0a1c25e req-c06154f1-77fc-43ac-a938-7ef97a966cf3 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:54.882290 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-690a3d5b-09ff-4129-9211-a801f0a1c25e req-c06154f1-77fc-43ac-a938-7ef97a966cf3 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:54.882872 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-690a3d5b-09ff-4129-9211-a801f0a1c25e req-c06154f1-77fc-43ac-a938-7ef97a966cf3 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:54.892003 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-2255d1ea-db3c-40f9-be8b-f6470ad7e2e9 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/02a7e011-cb93-4cf4-8d1a-5912c3d1701c" status: 200 len: 1464 microversion: 2.1 time: 0.263097 Oct 08 21:24:54.894022 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2826/5731] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:24:54 2022] GET /compute/v2.1/servers/02a7e011-cb93-4cf4-8d1a-5912c3d1701c => generated 1464 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:24:54.895116 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-690a3d5b-09ff-4129-9211-a801f0a1c25e req-c06154f1-77fc-43ac-a938-7ef97a966cf3 service nova] Creating event network-changed:55ffdd5e-4550-4dde-8b42-6efe6154e311 for instance 6954e204-0dc4-481e-a3b9-26acaef64dbb on nch1-master-1 Oct 08 21:24:54.900684 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-690a3d5b-09ff-4129-9211-a801f0a1c25e req-c06154f1-77fc-43ac-a938-7ef97a966cf3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047426 Oct 08 21:24:54.901388 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2906/5732] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:24:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 08 21:24:54.964896 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-b1008b3e-205d-4fc2-ad6d-1df21ddbc8dd tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:24:54.965544 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-b1008b3e-205d-4fc2-ad6d-1df21ddbc8dd tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] [instance: 6954e204-0dc4-481e-a3b9-26acaef64dbb] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:24:54.974834 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b1008b3e-205d-4fc2-ad6d-1df21ddbc8dd tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:54.976647 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b1008b3e-205d-4fc2-ad6d-1df21ddbc8dd tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:54.977368 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b1008b3e-205d-4fc2-ad6d-1df21ddbc8dd tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:54.978389 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b1008b3e-205d-4fc2-ad6d-1df21ddbc8dd tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:54.978950 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b1008b3e-205d-4fc2-ad6d-1df21ddbc8dd tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:54.979462 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b1008b3e-205d-4fc2-ad6d-1df21ddbc8dd tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:55.244450 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-b1008b3e-205d-4fc2-ad6d-1df21ddbc8dd tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7000e1f74c84240a7f41e8b1da74eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c1365cdc2f42e5ba271ee55f4d8406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:24:55.254955 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-b1008b3e-205d-4fc2-ad6d-1df21ddbc8dd tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7000e1f74c84240a7f41e8b1da74eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c1365cdc2f42e5ba271ee55f4d8406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:24:55.256418 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-b1008b3e-205d-4fc2-ad6d-1df21ddbc8dd tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7000e1f74c84240a7f41e8b1da74eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c1365cdc2f42e5ba271ee55f4d8406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:24:55.258278 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-b1008b3e-205d-4fc2-ad6d-1df21ddbc8dd tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] 10.222.0.26 "GET /compute/v2.1/servers/6954e204-0dc4-481e-a3b9-26acaef64dbb" status: 200 len: 1361 microversion: 2.26 time: 0.298278 Oct 08 21:24:55.258856 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2827/5733] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:24:54 2022] GET /compute/v2.1/servers/6954e204-0dc4-481e-a3b9-26acaef64dbb => generated 1361 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:24:55.917075 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-dc812501-2848-417e-96ef-06ac955a0d43 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:24:55.917875 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-dc812501-2848-417e-96ef-06ac955a0d43 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] [instance: 02a7e011-cb93-4cf4-8d1a-5912c3d1701c] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:24:55.925138 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dc812501-2848-417e-96ef-06ac955a0d43 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:55.925620 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dc812501-2848-417e-96ef-06ac955a0d43 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:55.926073 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dc812501-2848-417e-96ef-06ac955a0d43 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:55.926782 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dc812501-2848-417e-96ef-06ac955a0d43 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:55.927252 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dc812501-2848-417e-96ef-06ac955a0d43 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:55.927698 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dc812501-2848-417e-96ef-06ac955a0d43 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:56.056609 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-dc812501-2848-417e-96ef-06ac955a0d43 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/02a7e011-cb93-4cf4-8d1a-5912c3d1701c" status: 200 len: 1464 microversion: 2.1 time: 0.144278 Oct 08 21:24:56.057335 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2907/5734] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:24:55 2022] GET /compute/v2.1/servers/02a7e011-cb93-4cf4-8d1a-5912c3d1701c => generated 1464 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:24:56.283800 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-3e241edc-2d84-4cae-beaf-da891b1aa146 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:24:56.284533 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-3e241edc-2d84-4cae-beaf-da891b1aa146 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] [instance: 6954e204-0dc4-481e-a3b9-26acaef64dbb] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:24:56.291872 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3e241edc-2d84-4cae-beaf-da891b1aa146 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:56.292406 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3e241edc-2d84-4cae-beaf-da891b1aa146 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:56.292856 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3e241edc-2d84-4cae-beaf-da891b1aa146 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:56.293604 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3e241edc-2d84-4cae-beaf-da891b1aa146 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:56.294075 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3e241edc-2d84-4cae-beaf-da891b1aa146 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:56.294518 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3e241edc-2d84-4cae-beaf-da891b1aa146 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:56.314300 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=100 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:24:56.438753 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-3e241edc-2d84-4cae-beaf-da891b1aa146 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7000e1f74c84240a7f41e8b1da74eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c1365cdc2f42e5ba271ee55f4d8406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:24:56.447938 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-3e241edc-2d84-4cae-beaf-da891b1aa146 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7000e1f74c84240a7f41e8b1da74eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c1365cdc2f42e5ba271ee55f4d8406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:24:56.449516 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-3e241edc-2d84-4cae-beaf-da891b1aa146 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7000e1f74c84240a7f41e8b1da74eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c1365cdc2f42e5ba271ee55f4d8406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:24:56.450819 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-3e241edc-2d84-4cae-beaf-da891b1aa146 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] 10.222.0.26 "GET /compute/v2.1/servers/6954e204-0dc4-481e-a3b9-26acaef64dbb" status: 200 len: 1361 microversion: 2.26 time: 0.171029 Oct 08 21:24:56.451480 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2828/5735] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:24:56 2022] GET /compute/v2.1/servers/6954e204-0dc4-481e-a3b9-26acaef64dbb => generated 1361 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:24:57.080175 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-08aa2366-6343-4df6-9cad-d86cdcdd8f3e tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:24:57.081654 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-08aa2366-6343-4df6-9cad-d86cdcdd8f3e tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] [instance: 02a7e011-cb93-4cf4-8d1a-5912c3d1701c] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:24:57.088360 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-08aa2366-6343-4df6-9cad-d86cdcdd8f3e tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:57.088859 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-08aa2366-6343-4df6-9cad-d86cdcdd8f3e tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:57.089341 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-08aa2366-6343-4df6-9cad-d86cdcdd8f3e tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:57.090058 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-08aa2366-6343-4df6-9cad-d86cdcdd8f3e tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:57.090554 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-08aa2366-6343-4df6-9cad-d86cdcdd8f3e tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:57.091026 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-08aa2366-6343-4df6-9cad-d86cdcdd8f3e tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:57.307194 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-08aa2366-6343-4df6-9cad-d86cdcdd8f3e tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/02a7e011-cb93-4cf4-8d1a-5912c3d1701c" status: 200 len: 1464 microversion: 2.1 time: 0.230999 Oct 08 21:24:57.307981 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2908/5736] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:24:57 2022] GET /compute/v2.1/servers/02a7e011-cb93-4cf4-8d1a-5912c3d1701c => generated 1464 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:24:57.477557 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-5af066a9-c800-4298-92c6-eb9f15299150 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:24:57.478180 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-5af066a9-c800-4298-92c6-eb9f15299150 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] [instance: 6954e204-0dc4-481e-a3b9-26acaef64dbb] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:24:57.485648 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5af066a9-c800-4298-92c6-eb9f15299150 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:57.486149 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5af066a9-c800-4298-92c6-eb9f15299150 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:57.486595 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5af066a9-c800-4298-92c6-eb9f15299150 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:57.487303 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5af066a9-c800-4298-92c6-eb9f15299150 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:57.487766 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5af066a9-c800-4298-92c6-eb9f15299150 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:57.488210 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5af066a9-c800-4298-92c6-eb9f15299150 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:57.617981 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-5af066a9-c800-4298-92c6-eb9f15299150 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7000e1f74c84240a7f41e8b1da74eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c1365cdc2f42e5ba271ee55f4d8406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:24:57.626310 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-5af066a9-c800-4298-92c6-eb9f15299150 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7000e1f74c84240a7f41e8b1da74eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c1365cdc2f42e5ba271ee55f4d8406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:24:57.627800 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-5af066a9-c800-4298-92c6-eb9f15299150 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7000e1f74c84240a7f41e8b1da74eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c1365cdc2f42e5ba271ee55f4d8406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:24:57.628939 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-5af066a9-c800-4298-92c6-eb9f15299150 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] 10.222.0.26 "GET /compute/v2.1/servers/6954e204-0dc4-481e-a3b9-26acaef64dbb" status: 200 len: 1361 microversion: 2.26 time: 0.156073 Oct 08 21:24:57.629546 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2829/5737] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:24:57 2022] GET /compute/v2.1/servers/6954e204-0dc4-481e-a3b9-26acaef64dbb => generated 1361 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:24:58.330562 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-a3b7b1df-17d0-48a4-a730-76eeab1ce339 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:24:58.331192 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-a3b7b1df-17d0-48a4-a730-76eeab1ce339 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] [instance: 02a7e011-cb93-4cf4-8d1a-5912c3d1701c] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:24:58.333477 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=2 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:24:58.336050 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=8 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:24:58.342156 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a3b7b1df-17d0-48a4-a730-76eeab1ce339 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:58.342662 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a3b7b1df-17d0-48a4-a730-76eeab1ce339 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:58.343111 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a3b7b1df-17d0-48a4-a730-76eeab1ce339 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:58.343822 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a3b7b1df-17d0-48a4-a730-76eeab1ce339 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:58.344290 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a3b7b1df-17d0-48a4-a730-76eeab1ce339 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:58.344777 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a3b7b1df-17d0-48a4-a730-76eeab1ce339 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:58.471724 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-a3b7b1df-17d0-48a4-a730-76eeab1ce339 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/02a7e011-cb93-4cf4-8d1a-5912c3d1701c" status: 200 len: 1464 microversion: 2.1 time: 0.145351 Oct 08 21:24:58.472311 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2909/5738] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:24:58 2022] GET /compute/v2.1/servers/02a7e011-cb93-4cf4-8d1a-5912c3d1701c => generated 1464 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:24:58.654944 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-76400487-4d31-408c-a50d-03cc7053eb06 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:24:58.655568 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-76400487-4d31-408c-a50d-03cc7053eb06 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] [instance: 6954e204-0dc4-481e-a3b9-26acaef64dbb] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:24:58.657458 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=4 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:24:58.658254 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=8 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:24:58.666269 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-76400487-4d31-408c-a50d-03cc7053eb06 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:58.666702 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-76400487-4d31-408c-a50d-03cc7053eb06 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:58.667145 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-76400487-4d31-408c-a50d-03cc7053eb06 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:58.667856 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-76400487-4d31-408c-a50d-03cc7053eb06 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:58.668318 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-76400487-4d31-408c-a50d-03cc7053eb06 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:58.668843 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-76400487-4d31-408c-a50d-03cc7053eb06 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:58.809262 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-76400487-4d31-408c-a50d-03cc7053eb06 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7000e1f74c84240a7f41e8b1da74eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c1365cdc2f42e5ba271ee55f4d8406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:24:58.818548 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-76400487-4d31-408c-a50d-03cc7053eb06 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7000e1f74c84240a7f41e8b1da74eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c1365cdc2f42e5ba271ee55f4d8406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:24:58.820735 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-76400487-4d31-408c-a50d-03cc7053eb06 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7000e1f74c84240a7f41e8b1da74eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c1365cdc2f42e5ba271ee55f4d8406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:24:58.821963 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-76400487-4d31-408c-a50d-03cc7053eb06 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] 10.222.0.26 "GET /compute/v2.1/servers/6954e204-0dc4-481e-a3b9-26acaef64dbb" status: 200 len: 1361 microversion: 2.26 time: 0.170963 Oct 08 21:24:58.822566 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2830/5739] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:24:58 2022] GET /compute/v2.1/servers/6954e204-0dc4-481e-a3b9-26acaef64dbb => generated 1361 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:24:59.495734 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-17430364-08fb-4fbe-a84e-0997558d7781 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:24:59.496370 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-17430364-08fb-4fbe-a84e-0997558d7781 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] [instance: 02a7e011-cb93-4cf4-8d1a-5912c3d1701c] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:24:59.503126 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-17430364-08fb-4fbe-a84e-0997558d7781 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:59.503628 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-17430364-08fb-4fbe-a84e-0997558d7781 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:59.504085 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-17430364-08fb-4fbe-a84e-0997558d7781 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:59.504801 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-17430364-08fb-4fbe-a84e-0997558d7781 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:59.505303 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-17430364-08fb-4fbe-a84e-0997558d7781 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:59.505752 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-17430364-08fb-4fbe-a84e-0997558d7781 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:59.630986 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-17430364-08fb-4fbe-a84e-0997558d7781 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/02a7e011-cb93-4cf4-8d1a-5912c3d1701c" status: 200 len: 1464 microversion: 2.1 time: 0.138808 Oct 08 21:24:59.631659 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2910/5740] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:24:59 2022] GET /compute/v2.1/servers/02a7e011-cb93-4cf4-8d1a-5912c3d1701c => generated 1464 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:24:59.847313 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-137860d4-eccf-43bf-ab56-94296f600e37 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:24:59.847932 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-137860d4-eccf-43bf-ab56-94296f600e37 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] [instance: 6954e204-0dc4-481e-a3b9-26acaef64dbb] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:24:59.854930 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-137860d4-eccf-43bf-ab56-94296f600e37 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:59.855422 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-137860d4-eccf-43bf-ab56-94296f600e37 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:59.856119 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-137860d4-eccf-43bf-ab56-94296f600e37 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:59.856818 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-137860d4-eccf-43bf-ab56-94296f600e37 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:24:59.857313 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-137860d4-eccf-43bf-ab56-94296f600e37 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:24:59.857752 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-137860d4-eccf-43bf-ab56-94296f600e37 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:24:59.990895 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-137860d4-eccf-43bf-ab56-94296f600e37 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7000e1f74c84240a7f41e8b1da74eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c1365cdc2f42e5ba271ee55f4d8406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:24:59.999311 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-137860d4-eccf-43bf-ab56-94296f600e37 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7000e1f74c84240a7f41e8b1da74eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c1365cdc2f42e5ba271ee55f4d8406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:25:00.000777 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-137860d4-eccf-43bf-ab56-94296f600e37 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7000e1f74c84240a7f41e8b1da74eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c1365cdc2f42e5ba271ee55f4d8406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:25:00.001951 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-137860d4-eccf-43bf-ab56-94296f600e37 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] 10.222.0.26 "GET /compute/v2.1/servers/6954e204-0dc4-481e-a3b9-26acaef64dbb" status: 200 len: 1361 microversion: 2.26 time: 0.158683 Oct 08 21:25:00.002747 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2831/5741] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:24:59 2022] GET /compute/v2.1/servers/6954e204-0dc4-481e-a3b9-26acaef64dbb => generated 1361 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:25:00.031604 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-27f7b4cf-b6c9-4b67-a351-a6d97267b309 req-0ea13d0e-7e9c-4ece-a4ca-0be4dc26fea0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02a7e011-cb93-4cf4-8d1a-5912c3d1701c", "name": "network-vif-plugged", "status": "completed", "tag": "6e75fee7-0762-491e-bfd2-47c9b1ab79f8"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:25:00.041562 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-27f7b4cf-b6c9-4b67-a351-a6d97267b309 req-0ea13d0e-7e9c-4ece-a4ca-0be4dc26fea0 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:00.042074 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-27f7b4cf-b6c9-4b67-a351-a6d97267b309 req-0ea13d0e-7e9c-4ece-a4ca-0be4dc26fea0 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:00.042527 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-27f7b4cf-b6c9-4b67-a351-a6d97267b309 req-0ea13d0e-7e9c-4ece-a4ca-0be4dc26fea0 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:00.055479 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-27f7b4cf-b6c9-4b67-a351-a6d97267b309 req-0ea13d0e-7e9c-4ece-a4ca-0be4dc26fea0 service nova] Creating event network-vif-plugged:6e75fee7-0762-491e-bfd2-47c9b1ab79f8 for instance 02a7e011-cb93-4cf4-8d1a-5912c3d1701c on nch1-master-1 Oct 08 21:25:00.060413 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-27f7b4cf-b6c9-4b67-a351-a6d97267b309 req-0ea13d0e-7e9c-4ece-a4ca-0be4dc26fea0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032906 Oct 08 21:25:00.061015 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2911/5742] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:25:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:25:00.654647 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-75db2c0c-209e-4c60-a0cd-5df777a6e281 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:25:00.655297 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-75db2c0c-209e-4c60-a0cd-5df777a6e281 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] [instance: 02a7e011-cb93-4cf4-8d1a-5912c3d1701c] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:25:00.657225 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=7 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:25:00.662527 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-75db2c0c-209e-4c60-a0cd-5df777a6e281 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:00.663529 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-75db2c0c-209e-4c60-a0cd-5df777a6e281 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:00.663979 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-75db2c0c-209e-4c60-a0cd-5df777a6e281 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:00.664689 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-75db2c0c-209e-4c60-a0cd-5df777a6e281 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:00.665158 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-75db2c0c-209e-4c60-a0cd-5df777a6e281 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:00.665657 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-75db2c0c-209e-4c60-a0cd-5df777a6e281 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:00.793761 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-75db2c0c-209e-4c60-a0cd-5df777a6e281 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/02a7e011-cb93-4cf4-8d1a-5912c3d1701c" status: 200 len: 1464 microversion: 2.1 time: 0.142725 Oct 08 21:25:00.794346 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2832/5743] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:25:00 2022] GET /compute/v2.1/servers/02a7e011-cb93-4cf4-8d1a-5912c3d1701c => generated 1464 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:25:01.029622 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-1e060cb6-96d2-4efb-8aff-a5b3d5c91afe tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:25:01.030271 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-1e060cb6-96d2-4efb-8aff-a5b3d5c91afe tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] [instance: 6954e204-0dc4-481e-a3b9-26acaef64dbb] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:25:01.037246 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1e060cb6-96d2-4efb-8aff-a5b3d5c91afe tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:01.037748 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1e060cb6-96d2-4efb-8aff-a5b3d5c91afe tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:01.038846 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1e060cb6-96d2-4efb-8aff-a5b3d5c91afe tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:01.039559 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1e060cb6-96d2-4efb-8aff-a5b3d5c91afe tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:01.040033 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1e060cb6-96d2-4efb-8aff-a5b3d5c91afe tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:01.040525 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1e060cb6-96d2-4efb-8aff-a5b3d5c91afe tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:01.172771 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-1e060cb6-96d2-4efb-8aff-a5b3d5c91afe tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7000e1f74c84240a7f41e8b1da74eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c1365cdc2f42e5ba271ee55f4d8406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:25:01.181094 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-1e060cb6-96d2-4efb-8aff-a5b3d5c91afe tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7000e1f74c84240a7f41e8b1da74eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c1365cdc2f42e5ba271ee55f4d8406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:25:01.182575 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-1e060cb6-96d2-4efb-8aff-a5b3d5c91afe tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7000e1f74c84240a7f41e8b1da74eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c1365cdc2f42e5ba271ee55f4d8406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:25:01.183724 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-1e060cb6-96d2-4efb-8aff-a5b3d5c91afe tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] 10.222.0.26 "GET /compute/v2.1/servers/6954e204-0dc4-481e-a3b9-26acaef64dbb" status: 200 len: 1361 microversion: 2.26 time: 0.159474 Oct 08 21:25:01.184283 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2912/5744] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:25:01 2022] GET /compute/v2.1/servers/6954e204-0dc4-481e-a3b9-26acaef64dbb => generated 1361 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:25:01.816232 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-7f1ffb64-3623-4813-911c-3550afff7eee tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:25:01.816852 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-7f1ffb64-3623-4813-911c-3550afff7eee tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] [instance: 02a7e011-cb93-4cf4-8d1a-5912c3d1701c] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:25:01.824191 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7f1ffb64-3623-4813-911c-3550afff7eee tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:01.824684 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7f1ffb64-3623-4813-911c-3550afff7eee tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:01.825135 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7f1ffb64-3623-4813-911c-3550afff7eee tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:01.825870 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7f1ffb64-3623-4813-911c-3550afff7eee tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:01.826340 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7f1ffb64-3623-4813-911c-3550afff7eee tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:01.826778 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7f1ffb64-3623-4813-911c-3550afff7eee tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:01.956591 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-7f1ffb64-3623-4813-911c-3550afff7eee tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/02a7e011-cb93-4cf4-8d1a-5912c3d1701c" status: 200 len: 1649 microversion: 2.1 time: 0.144224 Oct 08 21:25:01.957161 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2833/5745] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:25:01 2022] GET /compute/v2.1/servers/02a7e011-cb93-4cf4-8d1a-5912c3d1701c => generated 1649 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:25:01.978979 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-d18d6ae1-796a-49d3-8351-c745b11d620d tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:25:01.979666 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-d18d6ae1-796a-49d3-8351-c745b11d620d tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] [instance: 02a7e011-cb93-4cf4-8d1a-5912c3d1701c] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:25:01.986090 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d18d6ae1-796a-49d3-8351-c745b11d620d tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:01.986600 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d18d6ae1-796a-49d3-8351-c745b11d620d tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:01.987056 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d18d6ae1-796a-49d3-8351-c745b11d620d tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:01.987775 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d18d6ae1-796a-49d3-8351-c745b11d620d tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:01.988249 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d18d6ae1-796a-49d3-8351-c745b11d620d tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:01.988693 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d18d6ae1-796a-49d3-8351-c745b11d620d tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:02.093014 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-7259d827-88e9-47bf-bfb4-8239d35a659c req-40fd172c-54c2-4f57-b135-c6a76cf84cc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6954e204-0dc4-481e-a3b9-26acaef64dbb", "name": "network-vif-plugged", "status": "completed", "tag": "55ffdd5e-4550-4dde-8b42-6efe6154e311"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:25:02.103336 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-7259d827-88e9-47bf-bfb4-8239d35a659c req-40fd172c-54c2-4f57-b135-c6a76cf84cc0 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:02.103825 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-7259d827-88e9-47bf-bfb4-8239d35a659c req-40fd172c-54c2-4f57-b135-c6a76cf84cc0 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:02.104310 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-7259d827-88e9-47bf-bfb4-8239d35a659c req-40fd172c-54c2-4f57-b135-c6a76cf84cc0 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:02.115820 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-7259d827-88e9-47bf-bfb4-8239d35a659c req-40fd172c-54c2-4f57-b135-c6a76cf84cc0 service nova] Creating event network-vif-plugged:55ffdd5e-4550-4dde-8b42-6efe6154e311 for instance 6954e204-0dc4-481e-a3b9-26acaef64dbb on nch1-master-1 Oct 08 21:25:02.122021 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-7259d827-88e9-47bf-bfb4-8239d35a659c req-40fd172c-54c2-4f57-b135-c6a76cf84cc0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032491 Oct 08 21:25:02.122641 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2834/5746] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:25:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 08 21:25:02.126754 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-d18d6ae1-796a-49d3-8351-c745b11d620d tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/02a7e011-cb93-4cf4-8d1a-5912c3d1701c" status: 200 len: 1649 microversion: 2.1 time: 0.151791 Oct 08 21:25:02.127331 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2913/5747] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:25:01 2022] GET /compute/v2.1/servers/02a7e011-cb93-4cf4-8d1a-5912c3d1701c => generated 1649 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:25:02.149017 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-45e95a1d-5e2a-4830-a3ef-6534dea5c2e3 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:25:02.149744 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-45e95a1d-5e2a-4830-a3ef-6534dea5c2e3 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] [instance: 02a7e011-cb93-4cf4-8d1a-5912c3d1701c] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:25:02.156143 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-45e95a1d-5e2a-4830-a3ef-6534dea5c2e3 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:02.156637 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-45e95a1d-5e2a-4830-a3ef-6534dea5c2e3 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:02.157075 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-45e95a1d-5e2a-4830-a3ef-6534dea5c2e3 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:02.157802 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-45e95a1d-5e2a-4830-a3ef-6534dea5c2e3 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:02.158262 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-45e95a1d-5e2a-4830-a3ef-6534dea5c2e3 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:02.158702 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-45e95a1d-5e2a-4830-a3ef-6534dea5c2e3 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:02.209529 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-147c5c56-99ab-40f9-9a32-94afb2901efa tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:25:02.210240 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-147c5c56-99ab-40f9-9a32-94afb2901efa tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] [instance: 6954e204-0dc4-481e-a3b9-26acaef64dbb] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:25:02.218682 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-147c5c56-99ab-40f9-9a32-94afb2901efa tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:02.219225 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-147c5c56-99ab-40f9-9a32-94afb2901efa tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:02.219682 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-147c5c56-99ab-40f9-9a32-94afb2901efa tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:02.220575 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-147c5c56-99ab-40f9-9a32-94afb2901efa tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:02.221046 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-147c5c56-99ab-40f9-9a32-94afb2901efa tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:02.221515 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-147c5c56-99ab-40f9-9a32-94afb2901efa tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:02.293912 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-45e95a1d-5e2a-4830-a3ef-6534dea5c2e3 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/02a7e011-cb93-4cf4-8d1a-5912c3d1701c" status: 200 len: 1649 microversion: 2.1 time: 0.148813 Oct 08 21:25:02.294515 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2835/5748] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:25:02 2022] GET /compute/v2.1/servers/02a7e011-cb93-4cf4-8d1a-5912c3d1701c => generated 1649 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:25:02.355104 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-5be38e0b-f5dd-49fb-9a95-519ac19e2ab3 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-585694268", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "availability_zone": "nova:nch2-master-1", "networks": [{"uuid": "24cad0b3-7df2-441a-97d4-4c41cdea1a8c"}]}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:25:02.376056 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-147c5c56-99ab-40f9-9a32-94afb2901efa tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7000e1f74c84240a7f41e8b1da74eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c1365cdc2f42e5ba271ee55f4d8406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:25:02.385055 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-147c5c56-99ab-40f9-9a32-94afb2901efa tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7000e1f74c84240a7f41e8b1da74eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c1365cdc2f42e5ba271ee55f4d8406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:25:02.386570 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-147c5c56-99ab-40f9-9a32-94afb2901efa tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7000e1f74c84240a7f41e8b1da74eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c1365cdc2f42e5ba271ee55f4d8406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:25:02.387734 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-147c5c56-99ab-40f9-9a32-94afb2901efa tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] 10.222.0.26 "GET /compute/v2.1/servers/6954e204-0dc4-481e-a3b9-26acaef64dbb" status: 200 len: 1361 microversion: 2.26 time: 0.182598 Oct 08 21:25:02.388335 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2914/5749] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:25:02 2022] GET /compute/v2.1/servers/6954e204-0dc4-481e-a3b9-26acaef64dbb => generated 1361 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 08 21:25:02.416649 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.network.neutron [None req-5be38e0b-f5dd-49fb-9a95-519ac19e2ab3 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] validate_networks() for [('24cad0b3-7df2-441a-97d4-4c41cdea1a8c', None, None, None, None, None)] {{(pid=140491) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 21:25:02.763276 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-5be38e0b-f5dd-49fb-9a95-519ac19e2ab3 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Flavor limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 21:25:02.763706 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-5be38e0b-f5dd-49fb-9a95-519ac19e2ab3 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Image limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 21:25:02.764187 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-5be38e0b-f5dd-49fb-9a95-519ac19e2ab3 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Flavor pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 21:25:02.764601 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-5be38e0b-f5dd-49fb-9a95-519ac19e2ab3 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Image pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 21:25:02.765018 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-5be38e0b-f5dd-49fb-9a95-519ac19e2ab3 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 21:25:02.774635 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5be38e0b-f5dd-49fb-9a95-519ac19e2ab3 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:02.775155 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5be38e0b-f5dd-49fb-9a95-519ac19e2ab3 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:02.775593 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5be38e0b-f5dd-49fb-9a95-519ac19e2ab3 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:02.776326 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5be38e0b-f5dd-49fb-9a95-519ac19e2ab3 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:02.776791 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5be38e0b-f5dd-49fb-9a95-519ac19e2ab3 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:02.777252 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5be38e0b-f5dd-49fb-9a95-519ac19e2ab3 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:02.794424 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-5be38e0b-f5dd-49fb-9a95-519ac19e2ab3 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Getting quotas for project 16eb444f844c4a1e8645da20451f4690. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:25:02.799689 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-5be38e0b-f5dd-49fb-9a95-519ac19e2ab3 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Getting quotas for user 91a0e7f4cb9f4c91b9e923a5886b6579 and project 16eb444f844c4a1e8645da20451f4690. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:25:02.811882 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-5be38e0b-f5dd-49fb-9a95-519ac19e2ab3 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Going to run 1 instances... {{(pid=140491) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 21:25:02.814221 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-5be38e0b-f5dd-49fb-9a95-519ac19e2ab3 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] [instance: f501b8c9-21a5-4a1d-8cc4-e8c00757a8f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c508bd7f-7db9-4b2c-af7c-be54a855c355',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140491) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 21:25:02.862575 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-5be38e0b-f5dd-49fb-9a95-519ac19e2ab3 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.511409 Oct 08 21:25:02.863167 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2836/5750] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 21:25:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 513 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 08 21:25:02.874181 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-45222146-9425-4f3b-9e10-63225a584abc tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:25:02.874803 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-45222146-9425-4f3b-9e10-63225a584abc tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] [instance: f501b8c9-21a5-4a1d-8cc4-e8c00757a8f4] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:25:02.938424 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-45222146-9425-4f3b-9e10-63225a584abc tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/f501b8c9-21a5-4a1d-8cc4-e8c00757a8f4" status: 200 len: 1328 microversion: 2.1 time: 0.067930 Oct 08 21:25:02.939012 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2915/5751] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:25:02 2022] GET /compute/v2.1/servers/f501b8c9-21a5-4a1d-8cc4-e8c00757a8f4 => generated 1328 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:25:03.418997 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-d357d9fd-c577-4e43-9396-77e88b6ed037 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:25:03.419778 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-d357d9fd-c577-4e43-9396-77e88b6ed037 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] [instance: 6954e204-0dc4-481e-a3b9-26acaef64dbb] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:25:03.429204 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d357d9fd-c577-4e43-9396-77e88b6ed037 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:03.429722 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d357d9fd-c577-4e43-9396-77e88b6ed037 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:03.431219 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d357d9fd-c577-4e43-9396-77e88b6ed037 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:03.431219 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d357d9fd-c577-4e43-9396-77e88b6ed037 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:03.431507 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d357d9fd-c577-4e43-9396-77e88b6ed037 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:03.431956 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d357d9fd-c577-4e43-9396-77e88b6ed037 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:03.591534 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-d357d9fd-c577-4e43-9396-77e88b6ed037 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7000e1f74c84240a7f41e8b1da74eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c1365cdc2f42e5ba271ee55f4d8406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:25:03.599683 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-d357d9fd-c577-4e43-9396-77e88b6ed037 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7000e1f74c84240a7f41e8b1da74eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c1365cdc2f42e5ba271ee55f4d8406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:25:03.601695 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-d357d9fd-c577-4e43-9396-77e88b6ed037 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7000e1f74c84240a7f41e8b1da74eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c1365cdc2f42e5ba271ee55f4d8406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:25:03.602833 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-d357d9fd-c577-4e43-9396-77e88b6ed037 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] 10.222.0.26 "GET /compute/v2.1/servers/6954e204-0dc4-481e-a3b9-26acaef64dbb" status: 200 len: 1361 microversion: 2.26 time: 0.188311 Oct 08 21:25:03.603396 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2837/5752] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:25:03 2022] GET /compute/v2.1/servers/6954e204-0dc4-481e-a3b9-26acaef64dbb => generated 1361 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:25:03.961964 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-6eb8d0d7-f974-44ac-95a6-b9200c3a7c99 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:25:03.963350 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-6eb8d0d7-f974-44ac-95a6-b9200c3a7c99 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] [instance: f501b8c9-21a5-4a1d-8cc4-e8c00757a8f4] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:25:03.970152 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6eb8d0d7-f974-44ac-95a6-b9200c3a7c99 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:03.970881 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6eb8d0d7-f974-44ac-95a6-b9200c3a7c99 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:03.971535 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6eb8d0d7-f974-44ac-95a6-b9200c3a7c99 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:03.972503 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6eb8d0d7-f974-44ac-95a6-b9200c3a7c99 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:03.973171 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6eb8d0d7-f974-44ac-95a6-b9200c3a7c99 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:03.973735 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6eb8d0d7-f974-44ac-95a6-b9200c3a7c99 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:04.077990 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-6eb8d0d7-f974-44ac-95a6-b9200c3a7c99 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/f501b8c9-21a5-4a1d-8cc4-e8c00757a8f4" status: 200 len: 1421 microversion: 2.1 time: 0.120316 Oct 08 21:25:04.078570 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2916/5753] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:25:03 2022] GET /compute/v2.1/servers/f501b8c9-21a5-4a1d-8cc4-e8c00757a8f4 => generated 1421 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:25:04.628610 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-bdbb3bb3-58d8-4c7d-b2dc-a354ba4e6e91 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:25:04.629798 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-bdbb3bb3-58d8-4c7d-b2dc-a354ba4e6e91 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] [instance: 6954e204-0dc4-481e-a3b9-26acaef64dbb] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:25:04.637756 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bdbb3bb3-58d8-4c7d-b2dc-a354ba4e6e91 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:04.638268 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bdbb3bb3-58d8-4c7d-b2dc-a354ba4e6e91 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:04.638816 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bdbb3bb3-58d8-4c7d-b2dc-a354ba4e6e91 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:04.639696 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bdbb3bb3-58d8-4c7d-b2dc-a354ba4e6e91 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:04.640356 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bdbb3bb3-58d8-4c7d-b2dc-a354ba4e6e91 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:04.640945 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bdbb3bb3-58d8-4c7d-b2dc-a354ba4e6e91 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:04.774043 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-bdbb3bb3-58d8-4c7d-b2dc-a354ba4e6e91 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7000e1f74c84240a7f41e8b1da74eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c1365cdc2f42e5ba271ee55f4d8406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:25:04.782622 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-bdbb3bb3-58d8-4c7d-b2dc-a354ba4e6e91 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7000e1f74c84240a7f41e8b1da74eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c1365cdc2f42e5ba271ee55f4d8406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:25:04.784096 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-bdbb3bb3-58d8-4c7d-b2dc-a354ba4e6e91 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7000e1f74c84240a7f41e8b1da74eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c1365cdc2f42e5ba271ee55f4d8406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:25:04.785333 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-bdbb3bb3-58d8-4c7d-b2dc-a354ba4e6e91 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] 10.222.0.26 "GET /compute/v2.1/servers/6954e204-0dc4-481e-a3b9-26acaef64dbb" status: 200 len: 1545 microversion: 2.26 time: 0.160666 Oct 08 21:25:04.785909 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2838/5754] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:25:04 2022] GET /compute/v2.1/servers/6954e204-0dc4-481e-a3b9-26acaef64dbb => generated 1545 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:25:04.812398 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-cbb9c8bd-509e-4f2c-a961-b1929fe8a359 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Calling method '.version_select at 0x7f1a874e1f70>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:25:04.823139 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cbb9c8bd-509e-4f2c-a961-b1929fe8a359 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:04.823633 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cbb9c8bd-509e-4f2c-a961-b1929fe8a359 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:04.824079 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cbb9c8bd-509e-4f2c-a961-b1929fe8a359 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:04.824565 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-cbb9c8bd-509e-4f2c-a961-b1929fe8a359 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] [instance: 6954e204-0dc4-481e-a3b9-26acaef64dbb] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:25:04.830104 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cbb9c8bd-509e-4f2c-a961-b1929fe8a359 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:04.830590 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cbb9c8bd-509e-4f2c-a961-b1929fe8a359 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:04.831038 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cbb9c8bd-509e-4f2c-a961-b1929fe8a359 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:04.831734 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cbb9c8bd-509e-4f2c-a961-b1929fe8a359 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:04.832219 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cbb9c8bd-509e-4f2c-a961-b1929fe8a359 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:04.832635 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cbb9c8bd-509e-4f2c-a961-b1929fe8a359 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:04.860100 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cbb9c8bd-509e-4f2c-a961-b1929fe8a359 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:04.860611 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cbb9c8bd-509e-4f2c-a961-b1929fe8a359 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:04.861068 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cbb9c8bd-509e-4f2c-a961-b1929fe8a359 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:04.875281 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cbb9c8bd-509e-4f2c-a961-b1929fe8a359 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:04.875827 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cbb9c8bd-509e-4f2c-a961-b1929fe8a359 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:04.876279 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cbb9c8bd-509e-4f2c-a961-b1929fe8a359 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:04.903161 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.objects.instance [None req-cbb9c8bd-509e-4f2c-a961-b1929fe8a359 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lazy-loading 'flavor' on Instance uuid 6954e204-0dc4-481e-a3b9-26acaef64dbb {{(pid=140492) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 21:25:04.919677 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-cbb9c8bd-509e-4f2c-a961-b1929fe8a359 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] 10.222.0.26 "PUT /compute/v2.1/servers/6954e204-0dc4-481e-a3b9-26acaef64dbb/tags/tempest-tag-1877399185" status: 201 len: 0 microversion: 2.26 time: 0.111557 Oct 08 21:25:04.920465 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2917/5755] 10.222.0.26 () {62 vars in 1380 bytes} [Sat Oct 8 21:25:04 2022] PUT /compute/v2.1/servers/6954e204-0dc4-481e-a3b9-26acaef64dbb/tags/tempest-tag-1877399185 => generated 0 bytes in 113 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 08 21:25:04.930981 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-7bc11c9e-c810-458f-8806-a8447e732670 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Calling method '.version_select at 0x7f1a876f4670>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:25:04.939220 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7bc11c9e-c810-458f-8806-a8447e732670 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:04.939715 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7bc11c9e-c810-458f-8806-a8447e732670 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:04.940159 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7bc11c9e-c810-458f-8806-a8447e732670 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:04.956236 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-7bc11c9e-c810-458f-8806-a8447e732670 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] 10.222.0.26 "GET /compute/v2.1/servers/6954e204-0dc4-481e-a3b9-26acaef64dbb/tags/tempest-tag-1877399185" status: 204 len: 0 microversion: 2.26 time: 0.029810 Oct 08 21:25:04.956941 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2839/5756] 10.222.0.26 () {60 vars in 1361 bytes} [Sat Oct 8 21:25:04 2022] GET /compute/v2.1/servers/6954e204-0dc4-481e-a3b9-26acaef64dbb/tags/tempest-tag-1877399185 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 08 21:25:04.965693 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-1734ad31-5601-47da-93dc-feda97c13603 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Calling method '.version_select at 0x7f1a8c1bc3a0>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:25:04.973846 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1734ad31-5601-47da-93dc-feda97c13603 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:04.974340 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1734ad31-5601-47da-93dc-feda97c13603 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:04.974783 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1734ad31-5601-47da-93dc-feda97c13603 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:04.975264 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-1734ad31-5601-47da-93dc-feda97c13603 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] [instance: 6954e204-0dc4-481e-a3b9-26acaef64dbb] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:25:04.981093 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1734ad31-5601-47da-93dc-feda97c13603 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:04.981626 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1734ad31-5601-47da-93dc-feda97c13603 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:04.982069 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1734ad31-5601-47da-93dc-feda97c13603 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:04.982769 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1734ad31-5601-47da-93dc-feda97c13603 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:04.983391 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1734ad31-5601-47da-93dc-feda97c13603 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:04.983828 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1734ad31-5601-47da-93dc-feda97c13603 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:05.008233 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1734ad31-5601-47da-93dc-feda97c13603 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:05.008731 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1734ad31-5601-47da-93dc-feda97c13603 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:05.009174 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1734ad31-5601-47da-93dc-feda97c13603 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:05.023441 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.objects.instance [None req-1734ad31-5601-47da-93dc-feda97c13603 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lazy-loading 'flavor' on Instance uuid 6954e204-0dc4-481e-a3b9-26acaef64dbb {{(pid=140492) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 21:25:05.038544 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-1734ad31-5601-47da-93dc-feda97c13603 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] 10.222.0.26 "DELETE /compute/v2.1/servers/6954e204-0dc4-481e-a3b9-26acaef64dbb/tags" status: 204 len: 0 microversion: 2.26 time: 0.076998 Oct 08 21:25:05.039175 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2918/5757] 10.222.0.26 () {60 vars in 1295 bytes} [Sat Oct 8 21:25:04 2022] DELETE /compute/v2.1/servers/6954e204-0dc4-481e-a3b9-26acaef64dbb/tags => generated 0 bytes in 78 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 08 21:25:05.050220 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-d1a37a24-b401-437c-b269-f17d80e9d2d2 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Calling method '.version_select at 0x7f1a876f4790>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:25:05.059529 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d1a37a24-b401-437c-b269-f17d80e9d2d2 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:05.060128 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d1a37a24-b401-437c-b269-f17d80e9d2d2 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:05.060647 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d1a37a24-b401-437c-b269-f17d80e9d2d2 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:05.071447 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-d1a37a24-b401-437c-b269-f17d80e9d2d2 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] 10.222.0.26 "GET /compute/v2.1/servers/6954e204-0dc4-481e-a3b9-26acaef64dbb/tags" status: 200 len: 12 microversion: 2.26 time: 0.026482 Oct 08 21:25:05.072056 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2840/5758] 10.222.0.26 () {60 vars in 1292 bytes} [Sat Oct 8 21:25:05 2022] GET /compute/v2.1/servers/6954e204-0dc4-481e-a3b9-26acaef64dbb/tags => generated 12 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:25:05.082575 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-d73f608a-7d91-4087-9e88-cbe959f1c262 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Calling method '.version_select at 0x7f1a913f4040>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:25:05.093214 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d73f608a-7d91-4087-9e88-cbe959f1c262 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:05.093214 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d73f608a-7d91-4087-9e88-cbe959f1c262 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:05.093447 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d73f608a-7d91-4087-9e88-cbe959f1c262 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:05.095048 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-d73f608a-7d91-4087-9e88-cbe959f1c262 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] [instance: 6954e204-0dc4-481e-a3b9-26acaef64dbb] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:25:05.101766 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d73f608a-7d91-4087-9e88-cbe959f1c262 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:05.102376 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-a419c6a9-bca2-4d8b-a3b2-99df84e3fb9c tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:25:05.102908 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d73f608a-7d91-4087-9e88-cbe959f1c262 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:05.103022 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-a419c6a9-bca2-4d8b-a3b2-99df84e3fb9c tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] [instance: f501b8c9-21a5-4a1d-8cc4-e8c00757a8f4] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:25:05.103971 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d73f608a-7d91-4087-9e88-cbe959f1c262 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:05.104963 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d73f608a-7d91-4087-9e88-cbe959f1c262 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:05.106218 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d73f608a-7d91-4087-9e88-cbe959f1c262 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:05.106715 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d73f608a-7d91-4087-9e88-cbe959f1c262 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:05.110075 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a419c6a9-bca2-4d8b-a3b2-99df84e3fb9c tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:05.110922 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a419c6a9-bca2-4d8b-a3b2-99df84e3fb9c tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:05.113033 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a419c6a9-bca2-4d8b-a3b2-99df84e3fb9c tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:05.114100 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a419c6a9-bca2-4d8b-a3b2-99df84e3fb9c tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:05.114865 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a419c6a9-bca2-4d8b-a3b2-99df84e3fb9c tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:05.115556 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a419c6a9-bca2-4d8b-a3b2-99df84e3fb9c tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:05.140732 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d73f608a-7d91-4087-9e88-cbe959f1c262 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:05.141494 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d73f608a-7d91-4087-9e88-cbe959f1c262 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:05.141946 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d73f608a-7d91-4087-9e88-cbe959f1c262 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:05.153313 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d73f608a-7d91-4087-9e88-cbe959f1c262 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:05.153576 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d73f608a-7d91-4087-9e88-cbe959f1c262 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:05.153984 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d73f608a-7d91-4087-9e88-cbe959f1c262 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:05.164150 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=93,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=2,nova_cell1:RELEASE=2,nova_cell1:DELETE=1 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:25:05.186844 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.objects.instance [None req-d73f608a-7d91-4087-9e88-cbe959f1c262 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lazy-loading 'flavor' on Instance uuid 6954e204-0dc4-481e-a3b9-26acaef64dbb {{(pid=140492) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 21:25:05.206342 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-d73f608a-7d91-4087-9e88-cbe959f1c262 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] 10.222.0.26 "PUT /compute/v2.1/servers/6954e204-0dc4-481e-a3b9-26acaef64dbb/tags/tempest-tag-1505999569" status: 201 len: 0 microversion: 2.26 time: 0.127520 Oct 08 21:25:05.207121 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2919/5759] 10.222.0.26 () {62 vars in 1380 bytes} [Sat Oct 8 21:25:05 2022] PUT /compute/v2.1/servers/6954e204-0dc4-481e-a3b9-26acaef64dbb/tags/tempest-tag-1505999569 => generated 0 bytes in 129 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 08 21:25:05.215577 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-6664fa03-90c3-4bb5-8445-fa7c3df0b016 req-e0267333-903d-4c0e-8cd0-5010e4e93357 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f501b8c9-21a5-4a1d-8cc4-e8c00757a8f4", "tag": "d90e8820-7d55-4bf9-85c0-21774955a8e2"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:25:05.231736 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-6664fa03-90c3-4bb5-8445-fa7c3df0b016 req-e0267333-903d-4c0e-8cd0-5010e4e93357 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:05.232409 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-6664fa03-90c3-4bb5-8445-fa7c3df0b016 req-e0267333-903d-4c0e-8cd0-5010e4e93357 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:05.232867 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-6664fa03-90c3-4bb5-8445-fa7c3df0b016 req-e0267333-903d-4c0e-8cd0-5010e4e93357 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:05.245878 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-6664fa03-90c3-4bb5-8445-fa7c3df0b016 req-e0267333-903d-4c0e-8cd0-5010e4e93357 service nova] Creating event network-changed:d90e8820-7d55-4bf9-85c0-21774955a8e2 for instance f501b8c9-21a5-4a1d-8cc4-e8c00757a8f4 on nch2-master-1 Oct 08 21:25:05.251236 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-6664fa03-90c3-4bb5-8445-fa7c3df0b016 req-e0267333-903d-4c0e-8cd0-5010e4e93357 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042375 Oct 08 21:25:05.252218 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2920/5760] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:25:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:25:05.257837 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-a9ff5b54-13ec-400a-978b-c7e494fb5437 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Calling method '.version_select at 0x7f1a913f4af0>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:25:05.265951 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a9ff5b54-13ec-400a-978b-c7e494fb5437 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:05.266437 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a9ff5b54-13ec-400a-978b-c7e494fb5437 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:05.266931 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a9ff5b54-13ec-400a-978b-c7e494fb5437 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:05.277677 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-a9ff5b54-13ec-400a-978b-c7e494fb5437 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] 10.222.0.26 "GET /compute/v2.1/servers/6954e204-0dc4-481e-a3b9-26acaef64dbb/tags" status: 200 len: 36 microversion: 2.26 time: 0.024231 Oct 08 21:25:05.278306 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2921/5761] 10.222.0.26 () {60 vars in 1292 bytes} [Sat Oct 8 21:25:05 2022] GET /compute/v2.1/servers/6954e204-0dc4-481e-a3b9-26acaef64dbb/tags => generated 36 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:25:05.287544 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-a419c6a9-bca2-4d8b-a3b2-99df84e3fb9c tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/f501b8c9-21a5-4a1d-8cc4-e8c00757a8f4" status: 200 len: 1463 microversion: 2.1 time: 0.190104 Oct 08 21:25:05.288931 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2841/5762] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:25:05 2022] GET /compute/v2.1/servers/f501b8c9-21a5-4a1d-8cc4-e8c00757a8f4 => generated 1463 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:25:05.290952 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-08b158c9-6d4c-48cd-817b-31cbbf1d755c tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Calling method '.version_select at 0x7f1a8d1b5550>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:25:05.298703 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-08b158c9-6d4c-48cd-817b-31cbbf1d755c tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:05.299196 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-08b158c9-6d4c-48cd-817b-31cbbf1d755c tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:05.299672 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-08b158c9-6d4c-48cd-817b-31cbbf1d755c tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:05.300299 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-08b158c9-6d4c-48cd-817b-31cbbf1d755c tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] [instance: 6954e204-0dc4-481e-a3b9-26acaef64dbb] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:25:05.306623 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-08b158c9-6d4c-48cd-817b-31cbbf1d755c tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:05.307125 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-08b158c9-6d4c-48cd-817b-31cbbf1d755c tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:05.307599 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-08b158c9-6d4c-48cd-817b-31cbbf1d755c tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:05.308303 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-08b158c9-6d4c-48cd-817b-31cbbf1d755c tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:05.308945 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-08b158c9-6d4c-48cd-817b-31cbbf1d755c tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:05.309486 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-08b158c9-6d4c-48cd-817b-31cbbf1d755c tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:05.334113 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-08b158c9-6d4c-48cd-817b-31cbbf1d755c tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:05.334608 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-08b158c9-6d4c-48cd-817b-31cbbf1d755c tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:05.335082 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-08b158c9-6d4c-48cd-817b-31cbbf1d755c tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:05.359774 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.objects.instance [None req-08b158c9-6d4c-48cd-817b-31cbbf1d755c tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lazy-loading 'flavor' on Instance uuid 6954e204-0dc4-481e-a3b9-26acaef64dbb {{(pid=140492) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 21:25:05.375388 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-08b158c9-6d4c-48cd-817b-31cbbf1d755c tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] 10.222.0.26 "DELETE /compute/v2.1/servers/6954e204-0dc4-481e-a3b9-26acaef64dbb/tags/tempest-tag-1505999569" status: 204 len: 0 microversion: 2.26 time: 0.088940 Oct 08 21:25:05.376156 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2922/5763] 10.222.0.26 () {60 vars in 1364 bytes} [Sat Oct 8 21:25:05 2022] DELETE /compute/v2.1/servers/6954e204-0dc4-481e-a3b9-26acaef64dbb/tags/tempest-tag-1505999569 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 08 21:25:05.384812 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-384c13da-d65c-4145-a32d-52fc33838efd tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Calling method '.version_select at 0x7f1a876f48b0>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:25:05.392677 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-384c13da-d65c-4145-a32d-52fc33838efd tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:05.393167 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-384c13da-d65c-4145-a32d-52fc33838efd tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:05.393635 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-384c13da-d65c-4145-a32d-52fc33838efd tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:05.402572 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-384c13da-d65c-4145-a32d-52fc33838efd tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] 10.222.0.26 "GET /compute/v2.1/servers/6954e204-0dc4-481e-a3b9-26acaef64dbb/tags" status: 200 len: 12 microversion: 2.26 time: 0.022054 Oct 08 21:25:05.403320 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2842/5764] 10.222.0.26 () {60 vars in 1292 bytes} [Sat Oct 8 21:25:05 2022] GET /compute/v2.1/servers/6954e204-0dc4-481e-a3b9-26acaef64dbb/tags => generated 12 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:25:05.414387 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e6b58941-7c70-410e-8fcc-44476a76a132 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Calling method '.version_select at 0x7f1a913a2940>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:25:05.423857 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e6b58941-7c70-410e-8fcc-44476a76a132 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:05.424575 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e6b58941-7c70-410e-8fcc-44476a76a132 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:05.425093 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e6b58941-7c70-410e-8fcc-44476a76a132 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:05.425810 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-e6b58941-7c70-410e-8fcc-44476a76a132 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] [instance: 6954e204-0dc4-481e-a3b9-26acaef64dbb] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:25:05.427875 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:25:05.433755 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e6b58941-7c70-410e-8fcc-44476a76a132 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:05.435246 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e6b58941-7c70-410e-8fcc-44476a76a132 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:05.435704 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e6b58941-7c70-410e-8fcc-44476a76a132 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:05.436527 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e6b58941-7c70-410e-8fcc-44476a76a132 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:05.437020 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e6b58941-7c70-410e-8fcc-44476a76a132 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:05.437494 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e6b58941-7c70-410e-8fcc-44476a76a132 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:05.462341 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e6b58941-7c70-410e-8fcc-44476a76a132 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:05.462766 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e6b58941-7c70-410e-8fcc-44476a76a132 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:05.463214 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e6b58941-7c70-410e-8fcc-44476a76a132 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:05.474189 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.objects.instance [None req-e6b58941-7c70-410e-8fcc-44476a76a132 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lazy-loading 'flavor' on Instance uuid 6954e204-0dc4-481e-a3b9-26acaef64dbb {{(pid=140492) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 21:25:05.489989 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-e6b58941-7c70-410e-8fcc-44476a76a132 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] 10.222.0.26 "DELETE /compute/v2.1/servers/6954e204-0dc4-481e-a3b9-26acaef64dbb/tags" status: 204 len: 0 microversion: 2.26 time: 0.080321 Oct 08 21:25:05.490626 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2923/5765] 10.222.0.26 () {60 vars in 1295 bytes} [Sat Oct 8 21:25:05 2022] DELETE /compute/v2.1/servers/6954e204-0dc4-481e-a3b9-26acaef64dbb/tags => generated 0 bytes in 82 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 08 21:25:05.499957 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-dad3cbde-e909-412c-af82-5995d8bd87a1 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Calling method '.version_select at 0x7f1a87767790>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:25:05.509614 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dad3cbde-e909-412c-af82-5995d8bd87a1 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:05.510097 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dad3cbde-e909-412c-af82-5995d8bd87a1 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:05.510534 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dad3cbde-e909-412c-af82-5995d8bd87a1 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:05.511008 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-dad3cbde-e909-412c-af82-5995d8bd87a1 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] [instance: 6954e204-0dc4-481e-a3b9-26acaef64dbb] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:25:05.516271 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dad3cbde-e909-412c-af82-5995d8bd87a1 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:05.516752 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dad3cbde-e909-412c-af82-5995d8bd87a1 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:05.517258 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dad3cbde-e909-412c-af82-5995d8bd87a1 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:05.518021 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dad3cbde-e909-412c-af82-5995d8bd87a1 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:05.518544 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dad3cbde-e909-412c-af82-5995d8bd87a1 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:05.518975 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dad3cbde-e909-412c-af82-5995d8bd87a1 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:05.546487 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dad3cbde-e909-412c-af82-5995d8bd87a1 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:05.546974 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dad3cbde-e909-412c-af82-5995d8bd87a1 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:05.547477 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dad3cbde-e909-412c-af82-5995d8bd87a1 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:05.556869 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dad3cbde-e909-412c-af82-5995d8bd87a1 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:05.557398 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dad3cbde-e909-412c-af82-5995d8bd87a1 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:05.557842 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dad3cbde-e909-412c-af82-5995d8bd87a1 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:05.582420 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.objects.instance [None req-dad3cbde-e909-412c-af82-5995d8bd87a1 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lazy-loading 'flavor' on Instance uuid 6954e204-0dc4-481e-a3b9-26acaef64dbb {{(pid=140491) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 21:25:05.598997 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-dad3cbde-e909-412c-af82-5995d8bd87a1 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] 10.222.0.26 "PUT /compute/v2.1/servers/6954e204-0dc4-481e-a3b9-26acaef64dbb/tags/tempest-tag-1028669363" status: 201 len: 0 microversion: 2.26 time: 0.102972 Oct 08 21:25:05.599653 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2843/5766] 10.222.0.26 () {62 vars in 1380 bytes} [Sat Oct 8 21:25:05 2022] PUT /compute/v2.1/servers/6954e204-0dc4-481e-a3b9-26acaef64dbb/tags/tempest-tag-1028669363 => generated 0 bytes in 104 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 08 21:25:05.610204 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-0354b157-183b-4d7a-875b-2d15e39f8287 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Calling method '.version_select at 0x7f1a874e1310>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:25:05.620059 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0354b157-183b-4d7a-875b-2d15e39f8287 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:05.620554 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0354b157-183b-4d7a-875b-2d15e39f8287 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:05.621003 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0354b157-183b-4d7a-875b-2d15e39f8287 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:05.621513 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-0354b157-183b-4d7a-875b-2d15e39f8287 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] [instance: 6954e204-0dc4-481e-a3b9-26acaef64dbb] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:25:05.626737 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0354b157-183b-4d7a-875b-2d15e39f8287 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:05.627261 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0354b157-183b-4d7a-875b-2d15e39f8287 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:05.627708 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0354b157-183b-4d7a-875b-2d15e39f8287 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:05.628395 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0354b157-183b-4d7a-875b-2d15e39f8287 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:05.628866 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0354b157-183b-4d7a-875b-2d15e39f8287 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:05.629355 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0354b157-183b-4d7a-875b-2d15e39f8287 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:05.656873 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0354b157-183b-4d7a-875b-2d15e39f8287 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:05.657484 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0354b157-183b-4d7a-875b-2d15e39f8287 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:05.657922 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0354b157-183b-4d7a-875b-2d15e39f8287 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:05.667089 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0354b157-183b-4d7a-875b-2d15e39f8287 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:05.667570 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0354b157-183b-4d7a-875b-2d15e39f8287 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:05.668016 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0354b157-183b-4d7a-875b-2d15e39f8287 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:05.690135 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.objects.instance [None req-0354b157-183b-4d7a-875b-2d15e39f8287 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lazy-loading 'flavor' on Instance uuid 6954e204-0dc4-481e-a3b9-26acaef64dbb {{(pid=140492) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 21:25:05.704458 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-0354b157-183b-4d7a-875b-2d15e39f8287 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] 10.222.0.26 "PUT /compute/v2.1/servers/6954e204-0dc4-481e-a3b9-26acaef64dbb/tags/tempest-tag-446061614" status: 201 len: 0 microversion: 2.26 time: 0.098525 Oct 08 21:25:05.705098 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2924/5767] 10.222.0.26 () {62 vars in 1377 bytes} [Sat Oct 8 21:25:05 2022] PUT /compute/v2.1/servers/6954e204-0dc4-481e-a3b9-26acaef64dbb/tags/tempest-tag-446061614 => generated 0 bytes in 100 msecs (HTTP/1.1 201) 10 headers in 485 bytes (2 switches on core 0) Oct 08 21:25:05.716097 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-34154fe0-f759-406e-bf89-7ac236a52462 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Calling method '.version_select at 0x7f1a876fec10>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:25:05.724630 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-34154fe0-f759-406e-bf89-7ac236a52462 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:05.725107 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-34154fe0-f759-406e-bf89-7ac236a52462 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:05.726298 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-34154fe0-f759-406e-bf89-7ac236a52462 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:05.726782 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-34154fe0-f759-406e-bf89-7ac236a52462 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] [instance: 6954e204-0dc4-481e-a3b9-26acaef64dbb] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:25:05.732316 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-34154fe0-f759-406e-bf89-7ac236a52462 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:05.732790 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-34154fe0-f759-406e-bf89-7ac236a52462 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:05.733249 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-34154fe0-f759-406e-bf89-7ac236a52462 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:05.733926 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-34154fe0-f759-406e-bf89-7ac236a52462 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:05.734390 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-34154fe0-f759-406e-bf89-7ac236a52462 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:05.734818 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-34154fe0-f759-406e-bf89-7ac236a52462 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:05.756314 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-34154fe0-f759-406e-bf89-7ac236a52462 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:05.756831 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-34154fe0-f759-406e-bf89-7ac236a52462 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:05.757300 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-34154fe0-f759-406e-bf89-7ac236a52462 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:05.771048 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.objects.instance [None req-34154fe0-f759-406e-bf89-7ac236a52462 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lazy-loading 'flavor' on Instance uuid 6954e204-0dc4-481e-a3b9-26acaef64dbb {{(pid=140491) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 21:25:05.785474 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-34154fe0-f759-406e-bf89-7ac236a52462 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] 10.222.0.26 "DELETE /compute/v2.1/servers/6954e204-0dc4-481e-a3b9-26acaef64dbb/tags" status: 204 len: 0 microversion: 2.26 time: 0.074431 Oct 08 21:25:05.786072 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2844/5768] 10.222.0.26 () {60 vars in 1295 bytes} [Sat Oct 8 21:25:05 2022] DELETE /compute/v2.1/servers/6954e204-0dc4-481e-a3b9-26acaef64dbb/tags => generated 0 bytes in 76 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 08 21:25:05.795145 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-715ee7e3-311d-4403-88e6-dd413199b6bf tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Calling method '.version_select at 0x7f1a873a8700>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:25:05.802877 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-715ee7e3-311d-4403-88e6-dd413199b6bf tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:05.803367 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-715ee7e3-311d-4403-88e6-dd413199b6bf tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:05.803931 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-715ee7e3-311d-4403-88e6-dd413199b6bf tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:05.812515 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-715ee7e3-311d-4403-88e6-dd413199b6bf tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] 10.222.0.26 "GET /compute/v2.1/servers/6954e204-0dc4-481e-a3b9-26acaef64dbb/tags" status: 200 len: 12 microversion: 2.26 time: 0.021529 Oct 08 21:25:05.813079 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2925/5769] 10.222.0.26 () {60 vars in 1292 bytes} [Sat Oct 8 21:25:05 2022] GET /compute/v2.1/servers/6954e204-0dc4-481e-a3b9-26acaef64dbb/tags => generated 12 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:25:05.823757 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-38453f8e-af7f-4237-a84a-1c1604344657 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Calling method '.version_select at 0x7f1a8786d280>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:25:05.831294 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-38453f8e-af7f-4237-a84a-1c1604344657 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:05.831778 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-38453f8e-af7f-4237-a84a-1c1604344657 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:05.832216 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-38453f8e-af7f-4237-a84a-1c1604344657 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:05.832686 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-38453f8e-af7f-4237-a84a-1c1604344657 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] [instance: 6954e204-0dc4-481e-a3b9-26acaef64dbb] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:25:05.838373 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-38453f8e-af7f-4237-a84a-1c1604344657 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:05.838848 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-38453f8e-af7f-4237-a84a-1c1604344657 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:05.839283 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-38453f8e-af7f-4237-a84a-1c1604344657 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:05.839963 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-38453f8e-af7f-4237-a84a-1c1604344657 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:05.840421 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-38453f8e-af7f-4237-a84a-1c1604344657 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:05.840849 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-38453f8e-af7f-4237-a84a-1c1604344657 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:05.862097 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-38453f8e-af7f-4237-a84a-1c1604344657 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:05.862572 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-38453f8e-af7f-4237-a84a-1c1604344657 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:05.863013 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-38453f8e-af7f-4237-a84a-1c1604344657 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:05.865841 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=96,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=1 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:25:05.874689 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.objects.instance [None req-38453f8e-af7f-4237-a84a-1c1604344657 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lazy-loading 'flavor' on Instance uuid 6954e204-0dc4-481e-a3b9-26acaef64dbb {{(pid=140491) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 21:25:05.889837 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-38453f8e-af7f-4237-a84a-1c1604344657 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] 10.222.0.26 "DELETE /compute/v2.1/servers/6954e204-0dc4-481e-a3b9-26acaef64dbb/tags" status: 204 len: 0 microversion: 2.26 time: 0.070682 Oct 08 21:25:05.890432 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2845/5770] 10.222.0.26 () {60 vars in 1295 bytes} [Sat Oct 8 21:25:05 2022] DELETE /compute/v2.1/servers/6954e204-0dc4-481e-a3b9-26acaef64dbb/tags => generated 0 bytes in 72 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 08 21:25:05.900563 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-7d005a1d-c7db-4585-b9b4-16b80064603a tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Calling method '.version_select at 0x7f1a8c1bc550>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:25:05.910362 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7d005a1d-c7db-4585-b9b4-16b80064603a tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:05.910845 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7d005a1d-c7db-4585-b9b4-16b80064603a tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:05.911294 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7d005a1d-c7db-4585-b9b4-16b80064603a tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:05.911765 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-7d005a1d-c7db-4585-b9b4-16b80064603a tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] [instance: 6954e204-0dc4-481e-a3b9-26acaef64dbb] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:25:05.917995 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7d005a1d-c7db-4585-b9b4-16b80064603a tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:05.918482 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7d005a1d-c7db-4585-b9b4-16b80064603a tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:05.919034 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7d005a1d-c7db-4585-b9b4-16b80064603a tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:05.919728 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7d005a1d-c7db-4585-b9b4-16b80064603a tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:05.920194 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7d005a1d-c7db-4585-b9b4-16b80064603a tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:05.920633 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7d005a1d-c7db-4585-b9b4-16b80064603a tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:05.946841 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7d005a1d-c7db-4585-b9b4-16b80064603a tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:05.947336 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7d005a1d-c7db-4585-b9b4-16b80064603a tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:05.947780 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7d005a1d-c7db-4585-b9b4-16b80064603a tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:05.956115 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7d005a1d-c7db-4585-b9b4-16b80064603a tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:05.956594 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7d005a1d-c7db-4585-b9b4-16b80064603a tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:05.957080 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7d005a1d-c7db-4585-b9b4-16b80064603a tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:05.980082 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.objects.instance [None req-7d005a1d-c7db-4585-b9b4-16b80064603a tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lazy-loading 'flavor' on Instance uuid 6954e204-0dc4-481e-a3b9-26acaef64dbb {{(pid=140492) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 21:25:05.994833 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-7d005a1d-c7db-4585-b9b4-16b80064603a tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] 10.222.0.26 "PUT /compute/v2.1/servers/6954e204-0dc4-481e-a3b9-26acaef64dbb/tags/tempest-tag-1950621960" status: 201 len: 0 microversion: 2.26 time: 0.098967 Oct 08 21:25:05.995472 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2926/5771] 10.222.0.26 () {62 vars in 1380 bytes} [Sat Oct 8 21:25:05 2022] PUT /compute/v2.1/servers/6954e204-0dc4-481e-a3b9-26acaef64dbb/tags/tempest-tag-1950621960 => generated 0 bytes in 100 msecs (HTTP/1.1 201) 10 headers in 486 bytes (2 switches on core 0) Oct 08 21:25:06.005325 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-49b7816d-60a7-4e34-83b9-27c6dc963f75 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Calling method '.version_select at 0x7f1a8761caf0>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:25:06.016752 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-49b7816d-60a7-4e34-83b9-27c6dc963f75 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:06.017272 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-49b7816d-60a7-4e34-83b9-27c6dc963f75 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:06.017716 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-49b7816d-60a7-4e34-83b9-27c6dc963f75 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:06.018196 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-49b7816d-60a7-4e34-83b9-27c6dc963f75 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] [instance: 6954e204-0dc4-481e-a3b9-26acaef64dbb] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:25:06.024373 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-49b7816d-60a7-4e34-83b9-27c6dc963f75 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:06.024867 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-49b7816d-60a7-4e34-83b9-27c6dc963f75 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:06.025358 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-49b7816d-60a7-4e34-83b9-27c6dc963f75 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:06.026062 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-49b7816d-60a7-4e34-83b9-27c6dc963f75 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:06.026547 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-49b7816d-60a7-4e34-83b9-27c6dc963f75 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:06.026976 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-49b7816d-60a7-4e34-83b9-27c6dc963f75 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:06.055542 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-49b7816d-60a7-4e34-83b9-27c6dc963f75 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:06.056043 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-49b7816d-60a7-4e34-83b9-27c6dc963f75 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:06.056572 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-49b7816d-60a7-4e34-83b9-27c6dc963f75 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:06.065623 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-49b7816d-60a7-4e34-83b9-27c6dc963f75 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:06.066112 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-49b7816d-60a7-4e34-83b9-27c6dc963f75 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:06.066555 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-49b7816d-60a7-4e34-83b9-27c6dc963f75 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:06.090712 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.objects.instance [None req-49b7816d-60a7-4e34-83b9-27c6dc963f75 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lazy-loading 'flavor' on Instance uuid 6954e204-0dc4-481e-a3b9-26acaef64dbb {{(pid=140491) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 21:25:06.105961 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-49b7816d-60a7-4e34-83b9-27c6dc963f75 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] 10.222.0.26 "PUT /compute/v2.1/servers/6954e204-0dc4-481e-a3b9-26acaef64dbb/tags/tempest-tag-464840155" status: 201 len: 0 microversion: 2.26 time: 0.104352 Oct 08 21:25:06.106638 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2846/5772] 10.222.0.26 () {62 vars in 1377 bytes} [Sat Oct 8 21:25:06 2022] PUT /compute/v2.1/servers/6954e204-0dc4-481e-a3b9-26acaef64dbb/tags/tempest-tag-464840155 => generated 0 bytes in 106 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Oct 08 21:25:06.116431 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-5ef9057a-deda-462d-ae68-83354972a351 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Action: 'update_all', calling method: .version_select at 0x7f1a91470160>, body: {"tags": ["tempest-tag-835843684", "tempest-tag-225792426"]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:25:06.126120 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5ef9057a-deda-462d-ae68-83354972a351 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:06.126606 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5ef9057a-deda-462d-ae68-83354972a351 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:06.127050 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5ef9057a-deda-462d-ae68-83354972a351 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:06.127528 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-5ef9057a-deda-462d-ae68-83354972a351 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] [instance: 6954e204-0dc4-481e-a3b9-26acaef64dbb] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:25:06.133393 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5ef9057a-deda-462d-ae68-83354972a351 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:06.133878 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5ef9057a-deda-462d-ae68-83354972a351 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:06.134321 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5ef9057a-deda-462d-ae68-83354972a351 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:06.135005 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5ef9057a-deda-462d-ae68-83354972a351 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:06.135506 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5ef9057a-deda-462d-ae68-83354972a351 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:06.135955 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5ef9057a-deda-462d-ae68-83354972a351 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:06.158220 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5ef9057a-deda-462d-ae68-83354972a351 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:06.158703 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5ef9057a-deda-462d-ae68-83354972a351 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:06.159144 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5ef9057a-deda-462d-ae68-83354972a351 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:06.179220 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.objects.instance [None req-5ef9057a-deda-462d-ae68-83354972a351 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lazy-loading 'flavor' on Instance uuid 6954e204-0dc4-481e-a3b9-26acaef64dbb {{(pid=140492) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 21:25:06.194084 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-5ef9057a-deda-462d-ae68-83354972a351 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] 10.222.0.26 "PUT /compute/v2.1/servers/6954e204-0dc4-481e-a3b9-26acaef64dbb/tags" status: 200 len: 60 microversion: 2.26 time: 0.081911 Oct 08 21:25:06.195307 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2927/5773] 10.222.0.26 () {62 vars in 1312 bytes} [Sat Oct 8 21:25:06 2022] PUT /compute/v2.1/servers/6954e204-0dc4-481e-a3b9-26acaef64dbb/tags => generated 60 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:25:06.205394 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-f88511c7-7a55-4c7b-8146-23aeb310223c tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Calling method '.version_select at 0x7f1a8761cb80>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:25:06.213028 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f88511c7-7a55-4c7b-8146-23aeb310223c tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:06.213542 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f88511c7-7a55-4c7b-8146-23aeb310223c tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:06.213982 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f88511c7-7a55-4c7b-8146-23aeb310223c tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:06.222984 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-f88511c7-7a55-4c7b-8146-23aeb310223c tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] 10.222.0.26 "GET /compute/v2.1/servers/6954e204-0dc4-481e-a3b9-26acaef64dbb/tags" status: 200 len: 60 microversion: 2.26 time: 0.021662 Oct 08 21:25:06.223548 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2847/5774] 10.222.0.26 () {60 vars in 1292 bytes} [Sat Oct 8 21:25:06 2022] GET /compute/v2.1/servers/6954e204-0dc4-481e-a3b9-26acaef64dbb/tags => generated 60 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:25:06.233932 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-55edb412-8e8b-4b4f-b863-c5d6d2513032 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Calling method '.version_select at 0x7f1a8c1bcdc0>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:25:06.241985 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-55edb412-8e8b-4b4f-b863-c5d6d2513032 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:06.242471 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-55edb412-8e8b-4b4f-b863-c5d6d2513032 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:06.242912 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-55edb412-8e8b-4b4f-b863-c5d6d2513032 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:06.243388 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-55edb412-8e8b-4b4f-b863-c5d6d2513032 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] [instance: 6954e204-0dc4-481e-a3b9-26acaef64dbb] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:25:06.248619 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-55edb412-8e8b-4b4f-b863-c5d6d2513032 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:06.249098 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-55edb412-8e8b-4b4f-b863-c5d6d2513032 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:06.249572 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-55edb412-8e8b-4b4f-b863-c5d6d2513032 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:06.250286 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-55edb412-8e8b-4b4f-b863-c5d6d2513032 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:06.250748 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-55edb412-8e8b-4b4f-b863-c5d6d2513032 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:06.251179 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-55edb412-8e8b-4b4f-b863-c5d6d2513032 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:06.273575 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-55edb412-8e8b-4b4f-b863-c5d6d2513032 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:06.274063 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-55edb412-8e8b-4b4f-b863-c5d6d2513032 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:06.274504 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-55edb412-8e8b-4b4f-b863-c5d6d2513032 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:06.287902 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.objects.instance [None req-55edb412-8e8b-4b4f-b863-c5d6d2513032 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lazy-loading 'flavor' on Instance uuid 6954e204-0dc4-481e-a3b9-26acaef64dbb {{(pid=140492) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 21:25:06.301787 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-55edb412-8e8b-4b4f-b863-c5d6d2513032 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] 10.222.0.26 "DELETE /compute/v2.1/servers/6954e204-0dc4-481e-a3b9-26acaef64dbb/tags" status: 204 len: 0 microversion: 2.26 time: 0.072202 Oct 08 21:25:06.302384 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2928/5775] 10.222.0.26 () {60 vars in 1295 bytes} [Sat Oct 8 21:25:06 2022] DELETE /compute/v2.1/servers/6954e204-0dc4-481e-a3b9-26acaef64dbb/tags => generated 0 bytes in 73 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 08 21:25:06.311061 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-1b8da3f1-da88-497b-811b-fffb5fe842d7 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:25:06.311691 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-1b8da3f1-da88-497b-811b-fffb5fe842d7 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] [instance: f501b8c9-21a5-4a1d-8cc4-e8c00757a8f4] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:25:06.311839 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-a714c914-2eae-4d73-984b-8cd279286cf9 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:25:06.312342 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-a714c914-2eae-4d73-984b-8cd279286cf9 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] [instance: 6954e204-0dc4-481e-a3b9-26acaef64dbb] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:25:06.318138 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1b8da3f1-da88-497b-811b-fffb5fe842d7 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:06.318264 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a714c914-2eae-4d73-984b-8cd279286cf9 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:06.318647 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1b8da3f1-da88-497b-811b-fffb5fe842d7 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:06.318740 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a714c914-2eae-4d73-984b-8cd279286cf9 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:06.319164 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1b8da3f1-da88-497b-811b-fffb5fe842d7 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:06.319264 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a714c914-2eae-4d73-984b-8cd279286cf9 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:06.320423 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1b8da3f1-da88-497b-811b-fffb5fe842d7 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:06.320520 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a714c914-2eae-4d73-984b-8cd279286cf9 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:06.320941 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a714c914-2eae-4d73-984b-8cd279286cf9 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:06.321040 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1b8da3f1-da88-497b-811b-fffb5fe842d7 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:06.321408 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a714c914-2eae-4d73-984b-8cd279286cf9 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:06.321507 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1b8da3f1-da88-497b-811b-fffb5fe842d7 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:06.347400 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-a714c914-2eae-4d73-984b-8cd279286cf9 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] [instance: 6954e204-0dc4-481e-a3b9-26acaef64dbb] Going to try to terminate instance {{(pid=140492) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 21:25:06.384857 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=88,nova_cell1:DELETE=4,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=3,nova_cell1:RELEASE=2,nova_cell1:UPDATE=1 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:25:06.433707 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-a714c914-2eae-4d73-984b-8cd279286cf9 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] 10.222.0.26 "DELETE /compute/v2.1/servers/6954e204-0dc4-481e-a3b9-26acaef64dbb" status: 204 len: 0 microversion: 2.26 time: 0.125025 Oct 08 21:25:06.435433 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2929/5776] 10.222.0.26 () {60 vars in 1280 bytes} [Sat Oct 8 21:25:06 2022] DELETE /compute/v2.1/servers/6954e204-0dc4-481e-a3b9-26acaef64dbb => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 08 21:25:06.444048 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e6256ed5-7f1e-4a3f-88b8-22d39ca1b1ec tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:25:06.445839 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-e6256ed5-7f1e-4a3f-88b8-22d39ca1b1ec tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] [instance: 6954e204-0dc4-481e-a3b9-26acaef64dbb] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:25:06.455248 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e6256ed5-7f1e-4a3f-88b8-22d39ca1b1ec tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:06.455248 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e6256ed5-7f1e-4a3f-88b8-22d39ca1b1ec tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:06.455248 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e6256ed5-7f1e-4a3f-88b8-22d39ca1b1ec tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:06.455248 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e6256ed5-7f1e-4a3f-88b8-22d39ca1b1ec tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:06.455687 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e6256ed5-7f1e-4a3f-88b8-22d39ca1b1ec tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:06.456246 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e6256ed5-7f1e-4a3f-88b8-22d39ca1b1ec tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:06.459069 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-1b8da3f1-da88-497b-811b-fffb5fe842d7 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/f501b8c9-21a5-4a1d-8cc4-e8c00757a8f4" status: 200 len: 1463 microversion: 2.1 time: 0.151767 Oct 08 21:25:06.459787 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2848/5777] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:25:06 2022] GET /compute/v2.1/servers/f501b8c9-21a5-4a1d-8cc4-e8c00757a8f4 => generated 1463 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:25:06.677888 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-e6256ed5-7f1e-4a3f-88b8-22d39ca1b1ec tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7000e1f74c84240a7f41e8b1da74eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c1365cdc2f42e5ba271ee55f4d8406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:25:06.686982 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-e6256ed5-7f1e-4a3f-88b8-22d39ca1b1ec tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7000e1f74c84240a7f41e8b1da74eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c1365cdc2f42e5ba271ee55f4d8406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:25:06.688432 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-e6256ed5-7f1e-4a3f-88b8-22d39ca1b1ec tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7000e1f74c84240a7f41e8b1da74eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c1365cdc2f42e5ba271ee55f4d8406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:25:06.689701 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-e6256ed5-7f1e-4a3f-88b8-22d39ca1b1ec tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] 10.222.0.26 "GET /compute/v2.1/servers/6954e204-0dc4-481e-a3b9-26acaef64dbb" status: 200 len: 1551 microversion: 2.26 time: 0.250684 Oct 08 21:25:06.690318 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2930/5778] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:25:06 2022] GET /compute/v2.1/servers/6954e204-0dc4-481e-a3b9-26acaef64dbb => generated 1551 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:25:07.482178 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-987553c5-9967-4b60-a02d-8865e5a514e7 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:25:07.482841 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-987553c5-9967-4b60-a02d-8865e5a514e7 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] [instance: f501b8c9-21a5-4a1d-8cc4-e8c00757a8f4] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:25:07.489882 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-987553c5-9967-4b60-a02d-8865e5a514e7 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:07.490385 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-987553c5-9967-4b60-a02d-8865e5a514e7 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:07.490832 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-987553c5-9967-4b60-a02d-8865e5a514e7 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:07.491568 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-987553c5-9967-4b60-a02d-8865e5a514e7 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:07.492029 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-987553c5-9967-4b60-a02d-8865e5a514e7 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:07.492462 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-987553c5-9967-4b60-a02d-8865e5a514e7 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:07.617941 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-987553c5-9967-4b60-a02d-8865e5a514e7 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/f501b8c9-21a5-4a1d-8cc4-e8c00757a8f4" status: 200 len: 1463 microversion: 2.1 time: 0.139673 Oct 08 21:25:07.618516 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2849/5779] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:25:07 2022] GET /compute/v2.1/servers/f501b8c9-21a5-4a1d-8cc4-e8c00757a8f4 => generated 1463 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:25:07.714576 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-9c418b5f-3725-4a6a-8b92-04610b3d57f9 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:25:07.715204 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-9c418b5f-3725-4a6a-8b92-04610b3d57f9 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] [instance: 6954e204-0dc4-481e-a3b9-26acaef64dbb] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:25:07.722294 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9c418b5f-3725-4a6a-8b92-04610b3d57f9 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:07.722794 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9c418b5f-3725-4a6a-8b92-04610b3d57f9 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:07.723248 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9c418b5f-3725-4a6a-8b92-04610b3d57f9 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:07.723957 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9c418b5f-3725-4a6a-8b92-04610b3d57f9 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:07.724427 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9c418b5f-3725-4a6a-8b92-04610b3d57f9 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:07.724867 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9c418b5f-3725-4a6a-8b92-04610b3d57f9 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:07.854084 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-9c418b5f-3725-4a6a-8b92-04610b3d57f9 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7000e1f74c84240a7f41e8b1da74eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c1365cdc2f42e5ba271ee55f4d8406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:25:07.862468 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-9c418b5f-3725-4a6a-8b92-04610b3d57f9 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7000e1f74c84240a7f41e8b1da74eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c1365cdc2f42e5ba271ee55f4d8406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:25:07.863934 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-9c418b5f-3725-4a6a-8b92-04610b3d57f9 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7000e1f74c84240a7f41e8b1da74eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c1365cdc2f42e5ba271ee55f4d8406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:25:07.865133 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-9c418b5f-3725-4a6a-8b92-04610b3d57f9 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] 10.222.0.26 "GET /compute/v2.1/servers/6954e204-0dc4-481e-a3b9-26acaef64dbb" status: 200 len: 1551 microversion: 2.26 time: 0.154580 Oct 08 21:25:07.865726 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2931/5780] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:25:07 2022] GET /compute/v2.1/servers/6954e204-0dc4-481e-a3b9-26acaef64dbb => generated 1551 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 08 21:25:08.334070 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-5972b966-3212-4a1d-8460-01ffa873ded6 req-9896f2ab-daa7-4b2b-bb8d-eeb4948bedd8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6954e204-0dc4-481e-a3b9-26acaef64dbb", "name": "network-vif-deleted", "tag": "55ffdd5e-4550-4dde-8b42-6efe6154e311"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:25:08.344928 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-5972b966-3212-4a1d-8460-01ffa873ded6 req-9896f2ab-daa7-4b2b-bb8d-eeb4948bedd8 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:08.345387 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-5972b966-3212-4a1d-8460-01ffa873ded6 req-9896f2ab-daa7-4b2b-bb8d-eeb4948bedd8 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:08.345998 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-5972b966-3212-4a1d-8460-01ffa873ded6 req-9896f2ab-daa7-4b2b-bb8d-eeb4948bedd8 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:08.364497 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-5972b966-3212-4a1d-8460-01ffa873ded6 req-9896f2ab-daa7-4b2b-bb8d-eeb4948bedd8 service nova] Creating event network-vif-deleted:55ffdd5e-4550-4dde-8b42-6efe6154e311 for instance 6954e204-0dc4-481e-a3b9-26acaef64dbb on nch1-master-1 Oct 08 21:25:08.370718 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-5972b966-3212-4a1d-8460-01ffa873ded6 req-9896f2ab-daa7-4b2b-bb8d-eeb4948bedd8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040769 Oct 08 21:25:08.371702 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2850/5781] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:25:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:25:08.641138 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-465e684c-37d0-475c-aecd-0cf49686228d tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:25:08.641730 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-465e684c-37d0-475c-aecd-0cf49686228d tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] [instance: f501b8c9-21a5-4a1d-8cc4-e8c00757a8f4] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:25:08.648528 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-465e684c-37d0-475c-aecd-0cf49686228d tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:08.649026 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-465e684c-37d0-475c-aecd-0cf49686228d tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:08.649514 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-465e684c-37d0-475c-aecd-0cf49686228d tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:08.650233 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-465e684c-37d0-475c-aecd-0cf49686228d tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:08.650702 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-465e684c-37d0-475c-aecd-0cf49686228d tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:08.651142 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-465e684c-37d0-475c-aecd-0cf49686228d tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:08.775209 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-465e684c-37d0-475c-aecd-0cf49686228d tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/f501b8c9-21a5-4a1d-8cc4-e8c00757a8f4" status: 200 len: 1463 microversion: 2.1 time: 0.137863 Oct 08 21:25:08.775831 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2932/5782] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:25:08 2022] GET /compute/v2.1/servers/f501b8c9-21a5-4a1d-8cc4-e8c00757a8f4 => generated 1463 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:25:08.893061 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-dcf0d937-6f8c-48cd-806a-54e6c7f29233 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:25:08.894797 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-dcf0d937-6f8c-48cd-806a-54e6c7f29233 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] [instance: 6954e204-0dc4-481e-a3b9-26acaef64dbb] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:25:08.902603 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dcf0d937-6f8c-48cd-806a-54e6c7f29233 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:08.903590 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dcf0d937-6f8c-48cd-806a-54e6c7f29233 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:08.904368 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dcf0d937-6f8c-48cd-806a-54e6c7f29233 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:08.905252 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dcf0d937-6f8c-48cd-806a-54e6c7f29233 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:08.905973 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dcf0d937-6f8c-48cd-806a-54e6c7f29233 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:08.906407 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dcf0d937-6f8c-48cd-806a-54e6c7f29233 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:08.947766 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dcf0d937-6f8c-48cd-806a-54e6c7f29233 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:08.948559 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dcf0d937-6f8c-48cd-806a-54e6c7f29233 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:08.949008 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dcf0d937-6f8c-48cd-806a-54e6c7f29233 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:08.949497 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.objects.instance [None req-dcf0d937-6f8c-48cd-806a-54e6c7f29233 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lazy-loading 'fault' on Instance uuid 6954e204-0dc4-481e-a3b9-26acaef64dbb {{(pid=140491) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 21:25:08.997363 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-dcf0d937-6f8c-48cd-806a-54e6c7f29233 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7000e1f74c84240a7f41e8b1da74eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c1365cdc2f42e5ba271ee55f4d8406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:25:09.004822 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-dcf0d937-6f8c-48cd-806a-54e6c7f29233 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7000e1f74c84240a7f41e8b1da74eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c1365cdc2f42e5ba271ee55f4d8406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:25:09.006308 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-dcf0d937-6f8c-48cd-806a-54e6c7f29233 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7000e1f74c84240a7f41e8b1da74eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c1365cdc2f42e5ba271ee55f4d8406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:25:09.008075 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-dcf0d937-6f8c-48cd-806a-54e6c7f29233 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] 10.222.0.26 "GET /compute/v2.1/servers/6954e204-0dc4-481e-a3b9-26acaef64dbb" status: 200 len: 1351 microversion: 2.26 time: 0.121009 Oct 08 21:25:09.008649 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2851/5783] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:25:08 2022] GET /compute/v2.1/servers/6954e204-0dc4-481e-a3b9-26acaef64dbb => generated 1351 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 08 21:25:09.801673 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-98651bd6-57f3-4fd8-ba16-8413cf0de0b6 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:25:09.802242 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-98651bd6-57f3-4fd8-ba16-8413cf0de0b6 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] [instance: f501b8c9-21a5-4a1d-8cc4-e8c00757a8f4] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:25:09.809878 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-98651bd6-57f3-4fd8-ba16-8413cf0de0b6 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:09.810383 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-98651bd6-57f3-4fd8-ba16-8413cf0de0b6 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:09.810835 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-98651bd6-57f3-4fd8-ba16-8413cf0de0b6 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:09.811550 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-98651bd6-57f3-4fd8-ba16-8413cf0de0b6 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:09.812019 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-98651bd6-57f3-4fd8-ba16-8413cf0de0b6 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:09.812459 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-98651bd6-57f3-4fd8-ba16-8413cf0de0b6 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:09.938810 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-98651bd6-57f3-4fd8-ba16-8413cf0de0b6 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/f501b8c9-21a5-4a1d-8cc4-e8c00757a8f4" status: 200 len: 1463 microversion: 2.1 time: 0.140869 Oct 08 21:25:09.939391 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2933/5784] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:25:09 2022] GET /compute/v2.1/servers/f501b8c9-21a5-4a1d-8cc4-e8c00757a8f4 => generated 1463 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:25:10.034265 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-02ef0e9f-739b-45e2-a1ba-fc49429a1546 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:25:10.034990 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-02ef0e9f-739b-45e2-a1ba-fc49429a1546 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] [instance: 6954e204-0dc4-481e-a3b9-26acaef64dbb] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:25:10.042602 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-02ef0e9f-739b-45e2-a1ba-fc49429a1546 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:10.043108 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-02ef0e9f-739b-45e2-a1ba-fc49429a1546 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:10.043558 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-02ef0e9f-739b-45e2-a1ba-fc49429a1546 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:10.044265 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-02ef0e9f-739b-45e2-a1ba-fc49429a1546 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:10.044732 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-02ef0e9f-739b-45e2-a1ba-fc49429a1546 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:10.045168 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-02ef0e9f-739b-45e2-a1ba-fc49429a1546 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:10.059410 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-02ef0e9f-739b-45e2-a1ba-fc49429a1546 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] HTTP exception thrown: Instance 6954e204-0dc4-481e-a3b9-26acaef64dbb could not be found. Oct 08 21:25:10.061009 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-02ef0e9f-739b-45e2-a1ba-fc49429a1546 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Request method failure captured: Oct 08 21:25:10.061009 ncdv-master-1 devstack@n-api.service[140491]: request: GET /compute/v2.1/servers/6954e204-0dc4-481e-a3b9-26acaef64dbb HTTP/1.1 Oct 08 21:25:10.061009 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:25:10.061009 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:25:10.061009 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:25:10.061009 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 21:25:10.061009 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:25:10.061009 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:25:10.061009 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:25:10.061009 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:25:10.061009 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeqdnfDdy8nkHVRYU8Q1NibsUDWDl9blAkekP8910rB4jBV11vAksCswGhz_LMLLeDhcgisuEi-fNVnSkmsKlqGrO5-R8jYtl--M76Gb_f9GaXIbTZriw70SapCnZOkhEoFqlqqVzgFgQFkFNNSMhXzNIJUX-uZ4hiqLf9yLRpe1vhM Oct 08 21:25:10.061009 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:25:10.061009 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:25:10.061009 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:25:10.061009 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:25:10.061009 ncdv-master-1 devstack@n-api.service[140491]: X-Openstack-Nova-Api-Version: 2.26 Oct 08 21:25:10.061009 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:25:10.061009 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:25:10.061009 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 53c1365cdc2f42e5ba271ee55f4d8406 Oct 08 21:25:10.061009 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-ServerTagsTestJSON-1370064214 Oct 08 21:25:10.061009 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:25:10.061009 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:25:10.061009 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/53c1365cdc2f42e5ba271ee55f4d8406"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/53c1365cdc2f42e5ba271ee55f4d8406"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_53c1365cdc2f42e5ba271ee55f4d8406"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/53c1365cdc2f42e5ba271ee55f4d8406"}]}] Oct 08 21:25:10.061009 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-ServerTagsTestJSON-1370064214 Oct 08 21:25:10.061009 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 53c1365cdc2f42e5ba271ee55f4d8406 Oct 08 21:25:10.061009 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-ServerTagsTestJSON-1370064214 Oct 08 21:25:10.061009 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-ServerTagsTestJSON-1370064214-project Oct 08 21:25:10.061009 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:25:10.061009 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:25:10.061009 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: a7000e1f74c84240a7f41e8b1da74eff Oct 08 21:25:10.061009 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-ServerTagsTestJSON-1370064214-project Oct 08 21:25:10.061009 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:25:10.061009 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance 6954e204-0dc4-481e-a3b9-26acaef64dbb could not be found. Oct 08 21:25:10.061009 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': '6954e204-0dc4-481e-a3b9-26acaef64dbb'} Oct 08 21:25:10.061009 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:25:10.061009 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:25:10.061009 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:25:10.061009 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:25:10.061009 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:25:10.061009 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:25:10.061009 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:25:10.061009 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:25:10.061009 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:25:10.061009 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:25:10.061009 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6954e204-0dc4-481e-a3b9-26acaef64dbb could not be found. Oct 08 21:25:10.061009 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:25:10.061009 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:25:10.061009 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:25:10.061009 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:25:10.061009 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:25:10.061009 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:25:10.061009 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:25:10.061009 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:25:10.061009 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:25:10.061009 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:25:10.061009 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:25:10.061009 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:25:10.061009 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:25:10.061009 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:25:10.061009 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:25:10.061009 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:25:10.061009 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6954e204-0dc4-481e-a3b9-26acaef64dbb could not be found. Oct 08 21:25:10.061009 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:25:10.061009 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:25:10.061009 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:25:10.066176 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:25:10.066176 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:25:10.066176 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:25:10.066176 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:25:10.066176 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:25:10.066176 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6954e204-0dc4-481e-a3b9-26acaef64dbb could not be found. Oct 08 21:25:10.066176 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:25:10.066176 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-02ef0e9f-739b-45e2-a1ba-fc49429a1546 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] Returning 404 to user: Instance 6954e204-0dc4-481e-a3b9-26acaef64dbb could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:25:10.066176 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-02ef0e9f-739b-45e2-a1ba-fc49429a1546 tempest-ServerTagsTestJSON-1370064214 tempest-ServerTagsTestJSON-1370064214-project] 10.222.0.26 "GET /compute/v2.1/servers/6954e204-0dc4-481e-a3b9-26acaef64dbb" status: 404 len: 111 microversion: 2.26 time: 0.032178 Oct 08 21:25:10.066176 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2852/5785] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 8 21:25:10 2022] GET /compute/v2.1/servers/6954e204-0dc4-481e-a3b9-26acaef64dbb => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 08 21:25:10.961502 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-0d63bfaa-9372-4f57-b876-f371973bd042 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:25:10.962889 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-0d63bfaa-9372-4f57-b876-f371973bd042 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] [instance: f501b8c9-21a5-4a1d-8cc4-e8c00757a8f4] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:25:10.970766 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0d63bfaa-9372-4f57-b876-f371973bd042 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:10.971500 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0d63bfaa-9372-4f57-b876-f371973bd042 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:10.972089 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0d63bfaa-9372-4f57-b876-f371973bd042 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:10.973149 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0d63bfaa-9372-4f57-b876-f371973bd042 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:10.973860 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0d63bfaa-9372-4f57-b876-f371973bd042 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:10.974439 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0d63bfaa-9372-4f57-b876-f371973bd042 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:11.098044 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-9ded4fe8-ad41-4c9a-a88d-cc7a2dacb7c5 req-ebc7bdf3-fb04-4acb-b75f-08151958ee5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f501b8c9-21a5-4a1d-8cc4-e8c00757a8f4", "name": "network-vif-plugged", "status": "completed", "tag": "d90e8820-7d55-4bf9-85c0-21774955a8e2"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:25:11.141269 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-9ded4fe8-ad41-4c9a-a88d-cc7a2dacb7c5 req-ebc7bdf3-fb04-4acb-b75f-08151958ee5e service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:11.144814 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-9ded4fe8-ad41-4c9a-a88d-cc7a2dacb7c5 req-ebc7bdf3-fb04-4acb-b75f-08151958ee5e service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:11.145451 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-9ded4fe8-ad41-4c9a-a88d-cc7a2dacb7c5 req-ebc7bdf3-fb04-4acb-b75f-08151958ee5e service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:11.167977 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-0d63bfaa-9372-4f57-b876-f371973bd042 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/f501b8c9-21a5-4a1d-8cc4-e8c00757a8f4" status: 200 len: 1463 microversion: 2.1 time: 0.210236 Oct 08 21:25:11.173834 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2934/5786] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:25:10 2022] GET /compute/v2.1/servers/f501b8c9-21a5-4a1d-8cc4-e8c00757a8f4 => generated 1463 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:25:11.175172 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-9ded4fe8-ad41-4c9a-a88d-cc7a2dacb7c5 req-ebc7bdf3-fb04-4acb-b75f-08151958ee5e service nova] Creating event network-vif-plugged:d90e8820-7d55-4bf9-85c0-21774955a8e2 for instance f501b8c9-21a5-4a1d-8cc4-e8c00757a8f4 on nch2-master-1 Oct 08 21:25:11.187992 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-9ded4fe8-ad41-4c9a-a88d-cc7a2dacb7c5 req-ebc7bdf3-fb04-4acb-b75f-08151958ee5e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094835 Oct 08 21:25:11.189084 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2853/5787] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:25:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 08 21:25:11.593624 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e0c60d42-6d0d-4688-995a-51a074cd5dbf tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:25:11.596074 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-e0c60d42-6d0d-4688-995a-51a074cd5dbf tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 86c50f3f-0621-4fa0-92b7-dd09127c1886] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:25:11.602962 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e0c60d42-6d0d-4688-995a-51a074cd5dbf tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:11.603460 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e0c60d42-6d0d-4688-995a-51a074cd5dbf tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:11.603946 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e0c60d42-6d0d-4688-995a-51a074cd5dbf tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:11.604687 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e0c60d42-6d0d-4688-995a-51a074cd5dbf tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:11.605135 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e0c60d42-6d0d-4688-995a-51a074cd5dbf tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:11.605873 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e0c60d42-6d0d-4688-995a-51a074cd5dbf tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:11.669236 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-e0c60d42-6d0d-4688-995a-51a074cd5dbf tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "POST /compute/v2.1/servers/86c50f3f-0621-4fa0-92b7-dd09127c1886/action" status: 200 len: 24550 microversion: 2.1 time: 0.079381 Oct 08 21:25:11.670101 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2935/5788] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:25:11 2022] POST /compute/v2.1/servers/86c50f3f-0621-4fa0-92b7-dd09127c1886/action => generated 24550 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 08 21:25:12.201714 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-18749ef9-6577-4e0c-83e4-91b2e48fbd69 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:25:12.202535 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-18749ef9-6577-4e0c-83e4-91b2e48fbd69 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] [instance: f501b8c9-21a5-4a1d-8cc4-e8c00757a8f4] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:25:12.208937 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-18749ef9-6577-4e0c-83e4-91b2e48fbd69 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:12.209557 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-18749ef9-6577-4e0c-83e4-91b2e48fbd69 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:12.210554 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-18749ef9-6577-4e0c-83e4-91b2e48fbd69 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:12.211403 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-18749ef9-6577-4e0c-83e4-91b2e48fbd69 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:12.211935 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-18749ef9-6577-4e0c-83e4-91b2e48fbd69 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:12.212432 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-18749ef9-6577-4e0c-83e4-91b2e48fbd69 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:12.308283 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-da05cf57-d881-4c3c-8c1a-ed3b23beb68a tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:25:12.310698 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-da05cf57-d881-4c3c-8c1a-ed3b23beb68a tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] [instance: bf3f4dd8-48f7-4c5a-aa5f-ee1e8d3f028b] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:25:12.318251 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-da05cf57-d881-4c3c-8c1a-ed3b23beb68a tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:12.318951 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-da05cf57-d881-4c3c-8c1a-ed3b23beb68a tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:12.319694 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-da05cf57-d881-4c3c-8c1a-ed3b23beb68a tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:12.320622 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-da05cf57-d881-4c3c-8c1a-ed3b23beb68a tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:12.321260 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-da05cf57-d881-4c3c-8c1a-ed3b23beb68a tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:12.321841 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-da05cf57-d881-4c3c-8c1a-ed3b23beb68a tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:12.423368 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-18749ef9-6577-4e0c-83e4-91b2e48fbd69 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/f501b8c9-21a5-4a1d-8cc4-e8c00757a8f4" status: 200 len: 1463 microversion: 2.1 time: 0.226558 Oct 08 21:25:12.425055 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2854/5789] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:25:12 2022] GET /compute/v2.1/servers/f501b8c9-21a5-4a1d-8cc4-e8c00757a8f4 => generated 1463 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:25:12.431551 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-da05cf57-d881-4c3c-8c1a-ed3b23beb68a tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] 10.222.0.26 "POST /compute/v2.1/servers/bf3f4dd8-48f7-4c5a-aa5f-ee1e8d3f028b/action" status: 200 len: 24574 microversion: 2.1 time: 0.127498 Oct 08 21:25:12.432224 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2936/5790] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:25:12 2022] POST /compute/v2.1/servers/bf3f4dd8-48f7-4c5a-aa5f-ee1e8d3f028b/action => generated 24574 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 08 21:25:13.447611 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-65755855-0d1f-4850-9aaa-103c93768767 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:25:13.448810 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-65755855-0d1f-4850-9aaa-103c93768767 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] [instance: f501b8c9-21a5-4a1d-8cc4-e8c00757a8f4] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:25:13.452103 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=2 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:25:13.455430 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=6 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:25:13.467902 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-65755855-0d1f-4850-9aaa-103c93768767 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:13.468623 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-65755855-0d1f-4850-9aaa-103c93768767 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:13.469268 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-65755855-0d1f-4850-9aaa-103c93768767 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:13.470716 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-65755855-0d1f-4850-9aaa-103c93768767 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:13.471668 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-65755855-0d1f-4850-9aaa-103c93768767 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:13.472597 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-65755855-0d1f-4850-9aaa-103c93768767 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:13.683850 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-65755855-0d1f-4850-9aaa-103c93768767 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/f501b8c9-21a5-4a1d-8cc4-e8c00757a8f4" status: 200 len: 1647 microversion: 2.1 time: 0.240039 Oct 08 21:25:13.684455 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2855/5791] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:25:13 2022] GET /compute/v2.1/servers/f501b8c9-21a5-4a1d-8cc4-e8c00757a8f4 => generated 1647 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:25:13.708885 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-317659cd-f3df-4519-b4d1-ce46d7dbfe39 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:25:13.710381 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-317659cd-f3df-4519-b4d1-ce46d7dbfe39 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] [instance: f501b8c9-21a5-4a1d-8cc4-e8c00757a8f4] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:25:13.713938 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=2 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:25:13.722986 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-317659cd-f3df-4519-b4d1-ce46d7dbfe39 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:13.723497 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-317659cd-f3df-4519-b4d1-ce46d7dbfe39 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:13.723944 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-317659cd-f3df-4519-b4d1-ce46d7dbfe39 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:13.726585 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-317659cd-f3df-4519-b4d1-ce46d7dbfe39 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:13.727178 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-317659cd-f3df-4519-b4d1-ce46d7dbfe39 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:13.727935 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-317659cd-f3df-4519-b4d1-ce46d7dbfe39 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:13.885546 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-317659cd-f3df-4519-b4d1-ce46d7dbfe39 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/f501b8c9-21a5-4a1d-8cc4-e8c00757a8f4" status: 200 len: 1647 microversion: 2.1 time: 0.180744 Oct 08 21:25:13.886278 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2937/5792] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:25:13 2022] GET /compute/v2.1/servers/f501b8c9-21a5-4a1d-8cc4-e8c00757a8f4 => generated 1647 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:25:13.907660 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-ba649013-64d2-4b39-a84b-98d6ba4987a7 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:25:13.908396 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-ba649013-64d2-4b39-a84b-98d6ba4987a7 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] [instance: f501b8c9-21a5-4a1d-8cc4-e8c00757a8f4] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:25:13.914595 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ba649013-64d2-4b39-a84b-98d6ba4987a7 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:13.915089 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ba649013-64d2-4b39-a84b-98d6ba4987a7 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:13.915564 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ba649013-64d2-4b39-a84b-98d6ba4987a7 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:13.916269 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ba649013-64d2-4b39-a84b-98d6ba4987a7 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:13.916986 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ba649013-64d2-4b39-a84b-98d6ba4987a7 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:13.917446 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ba649013-64d2-4b39-a84b-98d6ba4987a7 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:14.073930 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-ba649013-64d2-4b39-a84b-98d6ba4987a7 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/f501b8c9-21a5-4a1d-8cc4-e8c00757a8f4" status: 200 len: 1647 microversion: 2.1 time: 0.170060 Oct 08 21:25:14.074703 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2856/5793] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:25:13 2022] GET /compute/v2.1/servers/f501b8c9-21a5-4a1d-8cc4-e8c00757a8f4 => generated 1647 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:25:14.096544 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-1ad6b353-7304-43d2-89cd-642ebe323288 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:25:14.097063 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-1ad6b353-7304-43d2-89cd-642ebe323288 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] [instance: f501b8c9-21a5-4a1d-8cc4-e8c00757a8f4] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:25:14.106089 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1ad6b353-7304-43d2-89cd-642ebe323288 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:14.106820 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1ad6b353-7304-43d2-89cd-642ebe323288 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:14.107470 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1ad6b353-7304-43d2-89cd-642ebe323288 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:14.108421 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1ad6b353-7304-43d2-89cd-642ebe323288 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:14.108965 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1ad6b353-7304-43d2-89cd-642ebe323288 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:14.109493 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1ad6b353-7304-43d2-89cd-642ebe323288 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:14.142048 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-1ad6b353-7304-43d2-89cd-642ebe323288 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] [instance: f501b8c9-21a5-4a1d-8cc4-e8c00757a8f4] Going to try to terminate instance {{(pid=140492) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 21:25:14.236018 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-1ad6b353-7304-43d2-89cd-642ebe323288 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] 10.222.0.26 "DELETE /compute/v2.1/servers/f501b8c9-21a5-4a1d-8cc4-e8c00757a8f4" status: 204 len: 0 microversion: 2.1 time: 0.142837 Oct 08 21:25:14.236955 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2938/5794] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:25:14 2022] DELETE /compute/v2.1/servers/f501b8c9-21a5-4a1d-8cc4-e8c00757a8f4 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 21:25:14.246039 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-e084aef4-a3fb-4cac-a5d1-1af1db1bfd06 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:25:14.246949 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-e084aef4-a3fb-4cac-a5d1-1af1db1bfd06 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] [instance: f501b8c9-21a5-4a1d-8cc4-e8c00757a8f4] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:25:14.254236 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e084aef4-a3fb-4cac-a5d1-1af1db1bfd06 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:14.254748 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e084aef4-a3fb-4cac-a5d1-1af1db1bfd06 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:14.255318 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e084aef4-a3fb-4cac-a5d1-1af1db1bfd06 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:14.256100 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e084aef4-a3fb-4cac-a5d1-1af1db1bfd06 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:14.257160 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e084aef4-a3fb-4cac-a5d1-1af1db1bfd06 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:14.257640 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e084aef4-a3fb-4cac-a5d1-1af1db1bfd06 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:14.393159 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-e084aef4-a3fb-4cac-a5d1-1af1db1bfd06 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/f501b8c9-21a5-4a1d-8cc4-e8c00757a8f4" status: 200 len: 1653 microversion: 2.1 time: 0.151459 Oct 08 21:25:14.397228 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2857/5795] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:25:14 2022] GET /compute/v2.1/servers/f501b8c9-21a5-4a1d-8cc4-e8c00757a8f4 => generated 1653 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:25:15.420128 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-8ae360cf-021a-471b-9643-d724b9554a96 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:25:15.420860 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-8ae360cf-021a-471b-9643-d724b9554a96 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] [instance: f501b8c9-21a5-4a1d-8cc4-e8c00757a8f4] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:25:15.432789 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8ae360cf-021a-471b-9643-d724b9554a96 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:15.433468 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8ae360cf-021a-471b-9643-d724b9554a96 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:15.433923 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8ae360cf-021a-471b-9643-d724b9554a96 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:15.434654 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8ae360cf-021a-471b-9643-d724b9554a96 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:15.435128 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8ae360cf-021a-471b-9643-d724b9554a96 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:15.435569 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8ae360cf-021a-471b-9643-d724b9554a96 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:15.595908 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-8ae360cf-021a-471b-9643-d724b9554a96 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/f501b8c9-21a5-4a1d-8cc4-e8c00757a8f4" status: 200 len: 1653 microversion: 2.1 time: 0.180704 Oct 08 21:25:15.601768 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2939/5796] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:25:15 2022] GET /compute/v2.1/servers/f501b8c9-21a5-4a1d-8cc4-e8c00757a8f4 => generated 1653 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:25:16.063240 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-2171a02e-0863-4fe9-8f10-d56aadad5bdb req-1d8b8ea2-4a1c-4f07-85d8-86b23754f378 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f501b8c9-21a5-4a1d-8cc4-e8c00757a8f4", "name": "network-vif-deleted", "tag": "d90e8820-7d55-4bf9-85c0-21774955a8e2"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:25:16.089411 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-2171a02e-0863-4fe9-8f10-d56aadad5bdb req-1d8b8ea2-4a1c-4f07-85d8-86b23754f378 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:16.090724 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-2171a02e-0863-4fe9-8f10-d56aadad5bdb req-1d8b8ea2-4a1c-4f07-85d8-86b23754f378 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:16.091188 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-2171a02e-0863-4fe9-8f10-d56aadad5bdb req-1d8b8ea2-4a1c-4f07-85d8-86b23754f378 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:16.114445 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-2171a02e-0863-4fe9-8f10-d56aadad5bdb req-1d8b8ea2-4a1c-4f07-85d8-86b23754f378 service nova] Creating event network-vif-deleted:d90e8820-7d55-4bf9-85c0-21774955a8e2 for instance f501b8c9-21a5-4a1d-8cc4-e8c00757a8f4 on nch2-master-1 Oct 08 21:25:16.124885 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-2171a02e-0863-4fe9-8f10-d56aadad5bdb req-1d8b8ea2-4a1c-4f07-85d8-86b23754f378 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063917 Oct 08 21:25:16.126460 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2858/5797] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:25:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:25:16.621613 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-dfd9a4b4-b253-4186-ae6d-2475fd9cade5 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:25:16.622252 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-dfd9a4b4-b253-4186-ae6d-2475fd9cade5 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] [instance: f501b8c9-21a5-4a1d-8cc4-e8c00757a8f4] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:25:16.650529 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dfd9a4b4-b253-4186-ae6d-2475fd9cade5 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:16.652006 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dfd9a4b4-b253-4186-ae6d-2475fd9cade5 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:16.654314 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dfd9a4b4-b253-4186-ae6d-2475fd9cade5 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:16.655334 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dfd9a4b4-b253-4186-ae6d-2475fd9cade5 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:16.658115 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dfd9a4b4-b253-4186-ae6d-2475fd9cade5 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:16.658451 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dfd9a4b4-b253-4186-ae6d-2475fd9cade5 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:16.744489 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dfd9a4b4-b253-4186-ae6d-2475fd9cade5 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:16.745393 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dfd9a4b4-b253-4186-ae6d-2475fd9cade5 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:16.747708 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dfd9a4b4-b253-4186-ae6d-2475fd9cade5 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:16.748440 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.objects.instance [None req-dfd9a4b4-b253-4186-ae6d-2475fd9cade5 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Lazy-loading 'fault' on Instance uuid f501b8c9-21a5-4a1d-8cc4-e8c00757a8f4 {{(pid=140492) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 21:25:16.849067 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-dfd9a4b4-b253-4186-ae6d-2475fd9cade5 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/f501b8c9-21a5-4a1d-8cc4-e8c00757a8f4" status: 200 len: 1453 microversion: 2.1 time: 0.231396 Oct 08 21:25:16.849716 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2940/5798] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:25:16 2022] GET /compute/v2.1/servers/f501b8c9-21a5-4a1d-8cc4-e8c00757a8f4 => generated 1453 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:25:17.876447 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-66396526-bd89-4651-ba10-87a26f24f53f tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:25:17.877804 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-66396526-bd89-4651-ba10-87a26f24f53f tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] [instance: f501b8c9-21a5-4a1d-8cc4-e8c00757a8f4] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:25:17.890185 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-66396526-bd89-4651-ba10-87a26f24f53f tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:17.893890 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-66396526-bd89-4651-ba10-87a26f24f53f tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:17.894471 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-66396526-bd89-4651-ba10-87a26f24f53f tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:17.895348 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-66396526-bd89-4651-ba10-87a26f24f53f tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:17.895932 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-66396526-bd89-4651-ba10-87a26f24f53f tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:17.896644 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-66396526-bd89-4651-ba10-87a26f24f53f tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:17.915501 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-66396526-bd89-4651-ba10-87a26f24f53f tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] HTTP exception thrown: Instance f501b8c9-21a5-4a1d-8cc4-e8c00757a8f4 could not be found. Oct 08 21:25:17.917418 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-66396526-bd89-4651-ba10-87a26f24f53f tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Request method failure captured: Oct 08 21:25:17.917418 ncdv-master-1 devstack@n-api.service[140491]: request: GET /compute/v2.1/servers/f501b8c9-21a5-4a1d-8cc4-e8c00757a8f4 HTTP/1.1 Oct 08 21:25:17.917418 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:25:17.917418 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:25:17.917418 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:25:17.917418 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 21:25:17.917418 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:25:17.917418 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:25:17.917418 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:25:17.917418 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:25:17.917418 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeqe8lmpMdGlE7DKyAR87snLg3nFBpTRmtnZsQweYq_a6LY7heBb9Q96k7NYJGxQqhW76EUebGCE5QLw7FexioYlpsHzxFr1w68dUHE-DDSSQyqsv46vd8uQuJ690lV1da8cTOEznjEIJTdfFA3sFLIDIEw3UxZA8E3dGktCzyxDUlc Oct 08 21:25:17.917418 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:25:17.917418 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:25:17.917418 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:25:17.917418 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:25:17.917418 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:25:17.917418 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:25:17.917418 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 16eb444f844c4a1e8645da20451f4690 Oct 08 21:25:17.917418 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-TestServerMultinode-925739624 Oct 08 21:25:17.917418 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,admin,member Oct 08 21:25:17.917418 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,admin,member Oct 08 21:25:17.917418 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/16eb444f844c4a1e8645da20451f4690"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/16eb444f844c4a1e8645da20451f4690"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_16eb444f844c4a1e8645da20451f4690"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/16eb444f844c4a1e8645da20451f4690"}]}] Oct 08 21:25:17.917418 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-TestServerMultinode-925739624 Oct 08 21:25:17.917418 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 16eb444f844c4a1e8645da20451f4690 Oct 08 21:25:17.917418 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-TestServerMultinode-925739624 Oct 08 21:25:17.917418 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-TestServerMultinode-925739624-project-admin Oct 08 21:25:17.917418 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:25:17.917418 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:25:17.917418 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 91a0e7f4cb9f4c91b9e923a5886b6579 Oct 08 21:25:17.917418 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-TestServerMultinode-925739624-project-admin Oct 08 21:25:17.917418 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:25:17.917418 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance f501b8c9-21a5-4a1d-8cc4-e8c00757a8f4 could not be found. Oct 08 21:25:17.917418 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': 'f501b8c9-21a5-4a1d-8cc4-e8c00757a8f4'} Oct 08 21:25:17.917418 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:25:17.917418 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:25:17.917418 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:25:17.917418 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:25:17.917418 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:25:17.917418 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:25:17.917418 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:25:17.917418 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:25:17.917418 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:25:17.917418 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:25:17.917418 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f501b8c9-21a5-4a1d-8cc4-e8c00757a8f4 could not be found. Oct 08 21:25:17.917418 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:25:17.917418 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:25:17.917418 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:25:17.917418 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:25:17.917418 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:25:17.917418 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:25:17.917418 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:25:17.917418 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:25:17.917418 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:25:17.917418 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:25:17.917418 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:25:17.917418 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:25:17.917418 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:25:17.917418 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:25:17.917418 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:25:17.917418 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:25:17.917418 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f501b8c9-21a5-4a1d-8cc4-e8c00757a8f4 could not be found. Oct 08 21:25:17.917418 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:25:17.917418 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:25:17.917418 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:25:17.922034 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:25:17.922034 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:25:17.922034 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:25:17.922034 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:25:17.922034 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:25:17.922034 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f501b8c9-21a5-4a1d-8cc4-e8c00757a8f4 could not be found. Oct 08 21:25:17.922034 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:25:17.922034 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-66396526-bd89-4651-ba10-87a26f24f53f tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Returning 404 to user: Instance f501b8c9-21a5-4a1d-8cc4-e8c00757a8f4 could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:25:17.922034 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-66396526-bd89-4651-ba10-87a26f24f53f tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/f501b8c9-21a5-4a1d-8cc4-e8c00757a8f4" status: 404 len: 111 microversion: 2.1 time: 0.050526 Oct 08 21:25:17.925463 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2859/5799] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:25:17 2022] GET /compute/v2.1/servers/f501b8c9-21a5-4a1d-8cc4-e8c00757a8f4 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:25:17.931582 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-6b2638ce-7b71-4890-af38-c1a2f1ecdfc3 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:25:17.932172 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-6b2638ce-7b71-4890-af38-c1a2f1ecdfc3 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] [instance: 02a7e011-cb93-4cf4-8d1a-5912c3d1701c] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:25:17.951962 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6b2638ce-7b71-4890-af38-c1a2f1ecdfc3 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:17.952524 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6b2638ce-7b71-4890-af38-c1a2f1ecdfc3 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:17.952991 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6b2638ce-7b71-4890-af38-c1a2f1ecdfc3 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:17.954503 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6b2638ce-7b71-4890-af38-c1a2f1ecdfc3 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:17.954903 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6b2638ce-7b71-4890-af38-c1a2f1ecdfc3 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:17.955341 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6b2638ce-7b71-4890-af38-c1a2f1ecdfc3 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:17.998266 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-6b2638ce-7b71-4890-af38-c1a2f1ecdfc3 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] [instance: 02a7e011-cb93-4cf4-8d1a-5912c3d1701c] Going to try to terminate instance {{(pid=140492) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 21:25:18.132605 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-6b2638ce-7b71-4890-af38-c1a2f1ecdfc3 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] 10.222.0.26 "DELETE /compute/v2.1/servers/02a7e011-cb93-4cf4-8d1a-5912c3d1701c" status: 204 len: 0 microversion: 2.1 time: 0.203523 Oct 08 21:25:18.134797 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2941/5800] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:25:17 2022] DELETE /compute/v2.1/servers/02a7e011-cb93-4cf4-8d1a-5912c3d1701c => generated 0 bytes in 209 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 21:25:18.142924 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-0e6be1eb-0a55-4f1a-a8c9-bf57530cd669 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:25:18.143553 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-0e6be1eb-0a55-4f1a-a8c9-bf57530cd669 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] [instance: 02a7e011-cb93-4cf4-8d1a-5912c3d1701c] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:25:18.151926 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0e6be1eb-0a55-4f1a-a8c9-bf57530cd669 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:18.152677 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0e6be1eb-0a55-4f1a-a8c9-bf57530cd669 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:18.153557 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0e6be1eb-0a55-4f1a-a8c9-bf57530cd669 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:18.154675 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0e6be1eb-0a55-4f1a-a8c9-bf57530cd669 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:18.155688 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0e6be1eb-0a55-4f1a-a8c9-bf57530cd669 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:18.156500 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0e6be1eb-0a55-4f1a-a8c9-bf57530cd669 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:18.399047 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-0e6be1eb-0a55-4f1a-a8c9-bf57530cd669 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/02a7e011-cb93-4cf4-8d1a-5912c3d1701c" status: 200 len: 1655 microversion: 2.1 time: 0.258931 Oct 08 21:25:18.400115 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2860/5801] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:25:18 2022] GET /compute/v2.1/servers/02a7e011-cb93-4cf4-8d1a-5912c3d1701c => generated 1655 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:25:19.423532 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-8aa7b721-54ee-4b39-b286-0d47076e1c6e tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:25:19.424374 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-8aa7b721-54ee-4b39-b286-0d47076e1c6e tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] [instance: 02a7e011-cb93-4cf4-8d1a-5912c3d1701c] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:25:19.434866 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8aa7b721-54ee-4b39-b286-0d47076e1c6e tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:19.434866 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8aa7b721-54ee-4b39-b286-0d47076e1c6e tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:19.435641 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8aa7b721-54ee-4b39-b286-0d47076e1c6e tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:19.436549 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-0e6be1eb-0a55-4f1a-a8c9-bf57530cd669 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:25:19.436977 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8aa7b721-54ee-4b39-b286-0d47076e1c6e tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:19.437382 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8aa7b721-54ee-4b39-b286-0d47076e1c6e tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:19.437599 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-0e6be1eb-0a55-4f1a-a8c9-bf57530cd669 tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] 10.222.0.26 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001360 Oct 08 21:25:19.438227 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8aa7b721-54ee-4b39-b286-0d47076e1c6e tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:19.438591 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2861/5802] 10.222.0.26 () {56 vars in 886 bytes} [Sat Oct 8 21:25:19 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 08 21:25:19.588339 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:25:19.592126 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-8aa7b721-54ee-4b39-b286-0d47076e1c6e tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/02a7e011-cb93-4cf4-8d1a-5912c3d1701c" status: 200 len: 1655 microversion: 2.1 time: 0.173301 Oct 08 21:25:19.594412 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2942/5803] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:25:19 2022] GET /compute/v2.1/servers/02a7e011-cb93-4cf4-8d1a-5912c3d1701c => generated 1655 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:25:20.055846 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-93bf1ee8-8f7f-4225-bafe-8d2e49f6ffea req-018b1471-3d01-4ba6-b216-f965d22186a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02a7e011-cb93-4cf4-8d1a-5912c3d1701c", "name": "network-vif-deleted", "tag": "6e75fee7-0762-491e-bfd2-47c9b1ab79f8"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:25:20.067224 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-93bf1ee8-8f7f-4225-bafe-8d2e49f6ffea req-018b1471-3d01-4ba6-b216-f965d22186a8 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:20.067954 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-93bf1ee8-8f7f-4225-bafe-8d2e49f6ffea req-018b1471-3d01-4ba6-b216-f965d22186a8 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:20.068391 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-93bf1ee8-8f7f-4225-bafe-8d2e49f6ffea req-018b1471-3d01-4ba6-b216-f965d22186a8 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:20.082083 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-93bf1ee8-8f7f-4225-bafe-8d2e49f6ffea req-018b1471-3d01-4ba6-b216-f965d22186a8 service nova] Creating event network-vif-deleted:6e75fee7-0762-491e-bfd2-47c9b1ab79f8 for instance 02a7e011-cb93-4cf4-8d1a-5912c3d1701c on nch1-master-1 Oct 08 21:25:20.089056 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-93bf1ee8-8f7f-4225-bafe-8d2e49f6ffea req-018b1471-3d01-4ba6-b216-f965d22186a8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037206 Oct 08 21:25:20.092993 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2862/5804] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:25:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:25:20.617301 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-171a3c6d-7a23-492e-b25d-a1b0bda856cc tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:25:20.617925 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-171a3c6d-7a23-492e-b25d-a1b0bda856cc tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] [instance: 02a7e011-cb93-4cf4-8d1a-5912c3d1701c] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:25:20.644321 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-171a3c6d-7a23-492e-b25d-a1b0bda856cc tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:20.644917 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-171a3c6d-7a23-492e-b25d-a1b0bda856cc tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:20.645385 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-171a3c6d-7a23-492e-b25d-a1b0bda856cc tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:20.646183 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-171a3c6d-7a23-492e-b25d-a1b0bda856cc tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:20.646674 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-171a3c6d-7a23-492e-b25d-a1b0bda856cc tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:20.647186 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-171a3c6d-7a23-492e-b25d-a1b0bda856cc tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:20.710811 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-171a3c6d-7a23-492e-b25d-a1b0bda856cc tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:20.711410 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-171a3c6d-7a23-492e-b25d-a1b0bda856cc tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:20.712036 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-171a3c6d-7a23-492e-b25d-a1b0bda856cc tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:20.712745 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.objects.instance [None req-171a3c6d-7a23-492e-b25d-a1b0bda856cc tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Lazy-loading 'fault' on Instance uuid 02a7e011-cb93-4cf4-8d1a-5912c3d1701c {{(pid=140492) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 21:25:20.777751 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-171a3c6d-7a23-492e-b25d-a1b0bda856cc tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/02a7e011-cb93-4cf4-8d1a-5912c3d1701c" status: 200 len: 1454 microversion: 2.1 time: 0.164715 Oct 08 21:25:20.778948 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2943/5805] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:25:20 2022] GET /compute/v2.1/servers/02a7e011-cb93-4cf4-8d1a-5912c3d1701c => generated 1454 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:25:21.803196 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-905c424a-0621-42f5-ac23-353526c8cbff tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:25:21.804416 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-905c424a-0621-42f5-ac23-353526c8cbff tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] [instance: 02a7e011-cb93-4cf4-8d1a-5912c3d1701c] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:25:21.812295 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-905c424a-0621-42f5-ac23-353526c8cbff tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:21.812815 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-905c424a-0621-42f5-ac23-353526c8cbff tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:21.813369 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-905c424a-0621-42f5-ac23-353526c8cbff tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:21.814125 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-905c424a-0621-42f5-ac23-353526c8cbff tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:21.814984 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-905c424a-0621-42f5-ac23-353526c8cbff tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:21.815561 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-905c424a-0621-42f5-ac23-353526c8cbff tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:21.830847 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-905c424a-0621-42f5-ac23-353526c8cbff tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] HTTP exception thrown: Instance 02a7e011-cb93-4cf4-8d1a-5912c3d1701c could not be found. Oct 08 21:25:21.832660 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-905c424a-0621-42f5-ac23-353526c8cbff tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Request method failure captured: Oct 08 21:25:21.832660 ncdv-master-1 devstack@n-api.service[140491]: request: GET /compute/v2.1/servers/02a7e011-cb93-4cf4-8d1a-5912c3d1701c HTTP/1.1 Oct 08 21:25:21.832660 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:25:21.832660 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:25:21.832660 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:25:21.832660 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 21:25:21.832660 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:25:21.832660 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:25:21.832660 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:25:21.832660 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:25:21.832660 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeqe8lmpMdGlE7DKyAR87snLg3nFBpTRmtnZsQweYq_a6LY7heBb9Q96k7NYJGxQqhW76EUebGCE5QLw7FexioYlpsHzxFr1w68dUHE-DDSSQyqsv46vd8uQuJ690lV1da8cTOEznjEIJTdfFA3sFLIDIEw3UxZA8E3dGktCzyxDUlc Oct 08 21:25:21.832660 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:25:21.832660 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:25:21.832660 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:25:21.832660 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:25:21.832660 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:25:21.832660 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:25:21.832660 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 16eb444f844c4a1e8645da20451f4690 Oct 08 21:25:21.832660 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-TestServerMultinode-925739624 Oct 08 21:25:21.832660 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,admin,member Oct 08 21:25:21.832660 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,admin,member Oct 08 21:25:21.832660 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/16eb444f844c4a1e8645da20451f4690"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/16eb444f844c4a1e8645da20451f4690"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_16eb444f844c4a1e8645da20451f4690"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/16eb444f844c4a1e8645da20451f4690"}]}] Oct 08 21:25:21.832660 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-TestServerMultinode-925739624 Oct 08 21:25:21.832660 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 16eb444f844c4a1e8645da20451f4690 Oct 08 21:25:21.832660 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-TestServerMultinode-925739624 Oct 08 21:25:21.832660 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-TestServerMultinode-925739624-project-admin Oct 08 21:25:21.832660 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:25:21.832660 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:25:21.832660 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 91a0e7f4cb9f4c91b9e923a5886b6579 Oct 08 21:25:21.832660 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-TestServerMultinode-925739624-project-admin Oct 08 21:25:21.832660 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:25:21.832660 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance 02a7e011-cb93-4cf4-8d1a-5912c3d1701c could not be found. Oct 08 21:25:21.832660 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': '02a7e011-cb93-4cf4-8d1a-5912c3d1701c'} Oct 08 21:25:21.832660 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:25:21.832660 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:25:21.832660 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:25:21.832660 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:25:21.832660 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:25:21.832660 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:25:21.832660 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:25:21.832660 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:25:21.832660 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:25:21.832660 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:25:21.832660 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02a7e011-cb93-4cf4-8d1a-5912c3d1701c could not be found. Oct 08 21:25:21.832660 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:25:21.832660 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:25:21.832660 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:25:21.832660 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:25:21.832660 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:25:21.832660 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:25:21.832660 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:25:21.832660 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:25:21.832660 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:25:21.832660 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:25:21.832660 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:25:21.832660 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:25:21.832660 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:25:21.832660 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:25:21.832660 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:25:21.832660 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:25:21.832660 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02a7e011-cb93-4cf4-8d1a-5912c3d1701c could not be found. Oct 08 21:25:21.832660 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:25:21.832660 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:25:21.832660 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:25:21.838106 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:25:21.838106 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:25:21.838106 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:25:21.838106 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:25:21.838106 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:25:21.838106 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02a7e011-cb93-4cf4-8d1a-5912c3d1701c could not be found. Oct 08 21:25:21.838106 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:25:21.838106 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-905c424a-0621-42f5-ac23-353526c8cbff tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] Returning 404 to user: Instance 02a7e011-cb93-4cf4-8d1a-5912c3d1701c could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:25:21.838106 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-905c424a-0621-42f5-ac23-353526c8cbff tempest-TestServerMultinode-925739624 tempest-TestServerMultinode-925739624-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/02a7e011-cb93-4cf4-8d1a-5912c3d1701c" status: 404 len: 111 microversion: 2.1 time: 0.036470 Oct 08 21:25:21.838106 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2863/5806] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:25:21 2022] GET /compute/v2.1/servers/02a7e011-cb93-4cf4-8d1a-5912c3d1701c => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:25:22.665931 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-4e21533b-07b3-40ec-9218-d45e6e3969f9 tempest-TestNetworkAdvancedServerOps-1736509213 tempest-TestNetworkAdvancedServerOps-1736509213-project-admin] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:25:22.666674 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-4e21533b-07b3-40ec-9218-d45e6e3969f9 tempest-TestNetworkAdvancedServerOps-1736509213 tempest-TestNetworkAdvancedServerOps-1736509213-project-admin] [instance: 86c50f3f-0621-4fa0-92b7-dd09127c1886] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:25:22.674257 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4e21533b-07b3-40ec-9218-d45e6e3969f9 tempest-TestNetworkAdvancedServerOps-1736509213 tempest-TestNetworkAdvancedServerOps-1736509213-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:22.674854 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4e21533b-07b3-40ec-9218-d45e6e3969f9 tempest-TestNetworkAdvancedServerOps-1736509213 tempest-TestNetworkAdvancedServerOps-1736509213-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:22.675363 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4e21533b-07b3-40ec-9218-d45e6e3969f9 tempest-TestNetworkAdvancedServerOps-1736509213 tempest-TestNetworkAdvancedServerOps-1736509213-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:22.676156 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4e21533b-07b3-40ec-9218-d45e6e3969f9 tempest-TestNetworkAdvancedServerOps-1736509213 tempest-TestNetworkAdvancedServerOps-1736509213-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:22.676693 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4e21533b-07b3-40ec-9218-d45e6e3969f9 tempest-TestNetworkAdvancedServerOps-1736509213 tempest-TestNetworkAdvancedServerOps-1736509213-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:22.677217 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4e21533b-07b3-40ec-9218-d45e6e3969f9 tempest-TestNetworkAdvancedServerOps-1736509213 tempest-TestNetworkAdvancedServerOps-1736509213-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:22.930075 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-4e21533b-07b3-40ec-9218-d45e6e3969f9 tempest-TestNetworkAdvancedServerOps-1736509213 tempest-TestNetworkAdvancedServerOps-1736509213-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/86c50f3f-0621-4fa0-92b7-dd09127c1886" status: 200 len: 1833 microversion: 2.1 time: 0.268326 Oct 08 21:25:22.930681 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2944/5807] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:25:22 2022] GET /compute/v2.1/servers/86c50f3f-0621-4fa0-92b7-dd09127c1886 => generated 1833 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:25:22.954386 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-3a4d5299-13c9-4c8e-b593-eaa3d464277f tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:25:22.955622 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-3a4d5299-13c9-4c8e-b593-eaa3d464277f tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 86c50f3f-0621-4fa0-92b7-dd09127c1886] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:25:22.963477 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3a4d5299-13c9-4c8e-b593-eaa3d464277f tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:22.963979 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3a4d5299-13c9-4c8e-b593-eaa3d464277f tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:22.964431 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3a4d5299-13c9-4c8e-b593-eaa3d464277f tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:22.965149 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3a4d5299-13c9-4c8e-b593-eaa3d464277f tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:22.965672 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3a4d5299-13c9-4c8e-b593-eaa3d464277f tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:22.966106 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3a4d5299-13c9-4c8e-b593-eaa3d464277f tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:23.268404 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-3a4d5299-13c9-4c8e-b593-eaa3d464277f tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219a93945a147c4a57bb6452212fe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eeb6be960cc408296ecce6353b72f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:25:23.278645 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-3a4d5299-13c9-4c8e-b593-eaa3d464277f tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "GET /compute/v2.1/servers/86c50f3f-0621-4fa0-92b7-dd09127c1886" status: 200 len: 1682 microversion: 2.1 time: 0.328175 Oct 08 21:25:23.279450 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2864/5808] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:25:22 2022] GET /compute/v2.1/servers/86c50f3f-0621-4fa0-92b7-dd09127c1886 => generated 1682 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:25:23.377044 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-21009bb9-d402-4458-88ed-746a397554ce tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:25:23.379499 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-21009bb9-d402-4458-88ed-746a397554ce tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 86c50f3f-0621-4fa0-92b7-dd09127c1886] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:25:23.386289 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-21009bb9-d402-4458-88ed-746a397554ce tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:23.386878 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-21009bb9-d402-4458-88ed-746a397554ce tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:23.387457 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-21009bb9-d402-4458-88ed-746a397554ce tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:23.388253 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-21009bb9-d402-4458-88ed-746a397554ce tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:23.388853 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-21009bb9-d402-4458-88ed-746a397554ce tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:23.389734 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-21009bb9-d402-4458-88ed-746a397554ce tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:23.449039 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-21009bb9-d402-4458-88ed-746a397554ce tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "POST /compute/v2.1/servers/86c50f3f-0621-4fa0-92b7-dd09127c1886/action" status: 200 len: 32621 microversion: 2.1 time: 0.076189 Oct 08 21:25:23.450199 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2945/5809] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:25:23 2022] POST /compute/v2.1/servers/86c50f3f-0621-4fa0-92b7-dd09127c1886/action => generated 32621 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 08 21:25:23.563241 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-e8eda905-143b-4707-b4f4-0a443d593d11 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:25:23.565615 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-e8eda905-143b-4707-b4f4-0a443d593d11 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] [instance: bf3f4dd8-48f7-4c5a-aa5f-ee1e8d3f028b] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:25:23.572582 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e8eda905-143b-4707-b4f4-0a443d593d11 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:23.573086 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e8eda905-143b-4707-b4f4-0a443d593d11 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:23.573651 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e8eda905-143b-4707-b4f4-0a443d593d11 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:23.574374 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e8eda905-143b-4707-b4f4-0a443d593d11 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:23.574867 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e8eda905-143b-4707-b4f4-0a443d593d11 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:23.575373 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e8eda905-143b-4707-b4f4-0a443d593d11 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:23.617785 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e2fa47b6-e2ec-4f7a-9357-fac345042825 tempest-TestNetworkAdvancedServerOps-1736509213 tempest-TestNetworkAdvancedServerOps-1736509213-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:25:23.618490 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-e2fa47b6-e2ec-4f7a-9357-fac345042825 tempest-TestNetworkAdvancedServerOps-1736509213 tempest-TestNetworkAdvancedServerOps-1736509213-project-admin] [instance: 86c50f3f-0621-4fa0-92b7-dd09127c1886] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:25:23.627783 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e2fa47b6-e2ec-4f7a-9357-fac345042825 tempest-TestNetworkAdvancedServerOps-1736509213 tempest-TestNetworkAdvancedServerOps-1736509213-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:23.628483 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e2fa47b6-e2ec-4f7a-9357-fac345042825 tempest-TestNetworkAdvancedServerOps-1736509213 tempest-TestNetworkAdvancedServerOps-1736509213-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:23.629139 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e2fa47b6-e2ec-4f7a-9357-fac345042825 tempest-TestNetworkAdvancedServerOps-1736509213 tempest-TestNetworkAdvancedServerOps-1736509213-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:23.630286 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e2fa47b6-e2ec-4f7a-9357-fac345042825 tempest-TestNetworkAdvancedServerOps-1736509213 tempest-TestNetworkAdvancedServerOps-1736509213-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:23.631223 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-e8eda905-143b-4707-b4f4-0a443d593d11 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] 10.222.0.26 "POST /compute/v2.1/servers/bf3f4dd8-48f7-4c5a-aa5f-ee1e8d3f028b/action" status: 200 len: 32642 microversion: 2.1 time: 0.071487 Oct 08 21:25:23.632523 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2865/5810] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:25:23 2022] POST /compute/v2.1/servers/bf3f4dd8-48f7-4c5a-aa5f-ee1e8d3f028b/action => generated 32642 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 08 21:25:23.636935 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e2fa47b6-e2ec-4f7a-9357-fac345042825 tempest-TestNetworkAdvancedServerOps-1736509213 tempest-TestNetworkAdvancedServerOps-1736509213-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:23.637561 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e2fa47b6-e2ec-4f7a-9357-fac345042825 tempest-TestNetworkAdvancedServerOps-1736509213 tempest-TestNetworkAdvancedServerOps-1736509213-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:23.745854 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-e2fa47b6-e2ec-4f7a-9357-fac345042825 tempest-TestNetworkAdvancedServerOps-1736509213 tempest-TestNetworkAdvancedServerOps-1736509213-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'a691762d84b24f50926fa20dfc4d4ad9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3661b4b41b604beea175732bb476f4a7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:25:23.747177 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-e2fa47b6-e2ec-4f7a-9357-fac345042825 tempest-TestNetworkAdvancedServerOps-1736509213 tempest-TestNetworkAdvancedServerOps-1736509213-project-admin] [instance: 86c50f3f-0621-4fa0-92b7-dd09127c1886] flavor_id is None. Assuming migration. {{(pid=140492) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 08 21:25:23.747688 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-e2fa47b6-e2ec-4f7a-9357-fac345042825 tempest-TestNetworkAdvancedServerOps-1736509213 tempest-TestNetworkAdvancedServerOps-1736509213-project-admin] [instance: 86c50f3f-0621-4fa0-92b7-dd09127c1886] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=140492) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 08 21:25:23.986869 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-e2fa47b6-e2ec-4f7a-9357-fac345042825 tempest-TestNetworkAdvancedServerOps-1736509213 tempest-TestNetworkAdvancedServerOps-1736509213-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/86c50f3f-0621-4fa0-92b7-dd09127c1886/action" status: 202 len: 0 microversion: 2.1 time: 0.376242 Oct 08 21:25:23.987513 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2946/5811] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:25:23 2022] POST /compute/v2.1/servers/86c50f3f-0621-4fa0-92b7-dd09127c1886/action => generated 0 bytes in 378 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 08 21:25:23.997907 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-2926082c-f9c6-40e2-a3e0-ee18a6839438 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:25:23.998624 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-2926082c-f9c6-40e2-a3e0-ee18a6839438 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 86c50f3f-0621-4fa0-92b7-dd09127c1886] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:25:24.013391 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2926082c-f9c6-40e2-a3e0-ee18a6839438 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:24.014189 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2926082c-f9c6-40e2-a3e0-ee18a6839438 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:24.014917 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2926082c-f9c6-40e2-a3e0-ee18a6839438 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:24.015945 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2926082c-f9c6-40e2-a3e0-ee18a6839438 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:24.018189 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2926082c-f9c6-40e2-a3e0-ee18a6839438 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:24.018889 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2926082c-f9c6-40e2-a3e0-ee18a6839438 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:24.060606 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=96,nova_cell1:DELETE=1,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=1,nova_cell1:RELEASE=1 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:25:24.367735 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-2926082c-f9c6-40e2-a3e0-ee18a6839438 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219a93945a147c4a57bb6452212fe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eeb6be960cc408296ecce6353b72f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:25:24.375745 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-2926082c-f9c6-40e2-a3e0-ee18a6839438 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "GET /compute/v2.1/servers/86c50f3f-0621-4fa0-92b7-dd09127c1886" status: 200 len: 1691 microversion: 2.1 time: 0.383078 Oct 08 21:25:24.376655 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2866/5812] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:25:23 2022] GET /compute/v2.1/servers/86c50f3f-0621-4fa0-92b7-dd09127c1886 => generated 1691 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:25:25.404603 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-acd54305-7223-4f6a-a9bd-b0a8c1da9d05 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:25:25.405861 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-acd54305-7223-4f6a-a9bd-b0a8c1da9d05 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 86c50f3f-0621-4fa0-92b7-dd09127c1886] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:25:25.414776 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-f491752f-46fe-4fab-87cb-291b6f4bd9f5 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:25:25.416100 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-f491752f-46fe-4fab-87cb-291b6f4bd9f5 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] [instance: bf3f4dd8-48f7-4c5a-aa5f-ee1e8d3f028b] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:25:25.438556 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f491752f-46fe-4fab-87cb-291b6f4bd9f5 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:25.443462 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f491752f-46fe-4fab-87cb-291b6f4bd9f5 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:25.444208 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f491752f-46fe-4fab-87cb-291b6f4bd9f5 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:25.448004 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-acd54305-7223-4f6a-a9bd-b0a8c1da9d05 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:25.448907 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f491752f-46fe-4fab-87cb-291b6f4bd9f5 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:25.449975 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-acd54305-7223-4f6a-a9bd-b0a8c1da9d05 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:25.450424 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-acd54305-7223-4f6a-a9bd-b0a8c1da9d05 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:25.451152 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-acd54305-7223-4f6a-a9bd-b0a8c1da9d05 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:25.451616 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-acd54305-7223-4f6a-a9bd-b0a8c1da9d05 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:25.452049 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-acd54305-7223-4f6a-a9bd-b0a8c1da9d05 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:25.456849 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f491752f-46fe-4fab-87cb-291b6f4bd9f5 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:25.456849 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f491752f-46fe-4fab-87cb-291b6f4bd9f5 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:25.511267 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-f491752f-46fe-4fab-87cb-291b6f4bd9f5 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] [instance: bf3f4dd8-48f7-4c5a-aa5f-ee1e8d3f028b] Going to try to terminate instance {{(pid=140491) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 21:25:25.627144 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:25:25.644792 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-f491752f-46fe-4fab-87cb-291b6f4bd9f5 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] 10.222.0.26 "DELETE /compute/v2.1/servers/bf3f4dd8-48f7-4c5a-aa5f-ee1e8d3f028b" status: 204 len: 0 microversion: 2.1 time: 0.234734 Oct 08 21:25:25.650119 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2867/5813] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:25:25 2022] DELETE /compute/v2.1/servers/bf3f4dd8-48f7-4c5a-aa5f-ee1e8d3f028b => generated 0 bytes in 237 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 08 21:25:25.662795 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-47f0bd78-30c9-44ca-94e6-10e3275e65c6 req-d02e1964-7453-4963-9ed2-a86f9c788f10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf3f4dd8-48f7-4c5a-aa5f-ee1e8d3f028b", "tag": "33f61238-6a86-48e4-b690-1f3245ea9c02"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:25:25.673431 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-47f0bd78-30c9-44ca-94e6-10e3275e65c6 req-d02e1964-7453-4963-9ed2-a86f9c788f10 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:25.673928 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-47f0bd78-30c9-44ca-94e6-10e3275e65c6 req-d02e1964-7453-4963-9ed2-a86f9c788f10 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:25.674377 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-47f0bd78-30c9-44ca-94e6-10e3275e65c6 req-d02e1964-7453-4963-9ed2-a86f9c788f10 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:25.688478 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-47f0bd78-30c9-44ca-94e6-10e3275e65c6 req-d02e1964-7453-4963-9ed2-a86f9c788f10 service nova] Creating event network-changed:33f61238-6a86-48e4-b690-1f3245ea9c02 for instance bf3f4dd8-48f7-4c5a-aa5f-ee1e8d3f028b on nch2-master-1 Oct 08 21:25:25.696510 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-47f0bd78-30c9-44ca-94e6-10e3275e65c6 req-d02e1964-7453-4963-9ed2-a86f9c788f10 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041700 Oct 08 21:25:25.714332 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2868/5814] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:25:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:25:25.836595 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-acd54305-7223-4f6a-a9bd-b0a8c1da9d05 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219a93945a147c4a57bb6452212fe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eeb6be960cc408296ecce6353b72f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:25:25.847226 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-acd54305-7223-4f6a-a9bd-b0a8c1da9d05 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "GET /compute/v2.1/servers/86c50f3f-0621-4fa0-92b7-dd09127c1886" status: 200 len: 1691 microversion: 2.1 time: 0.449198 Oct 08 21:25:25.848766 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2947/5815] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:25:25 2022] GET /compute/v2.1/servers/86c50f3f-0621-4fa0-92b7-dd09127c1886 => generated 1691 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:25:25.854645 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-ec33cdd7-c4bc-40b4-b455-d964b2659d81 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:25:25.855325 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-ec33cdd7-c4bc-40b4-b455-d964b2659d81 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] [instance: bf3f4dd8-48f7-4c5a-aa5f-ee1e8d3f028b] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:25:25.867797 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ec33cdd7-c4bc-40b4-b455-d964b2659d81 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:25.868669 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ec33cdd7-c4bc-40b4-b455-d964b2659d81 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:25.869413 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ec33cdd7-c4bc-40b4-b455-d964b2659d81 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:25.870481 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ec33cdd7-c4bc-40b4-b455-d964b2659d81 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:25.871318 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ec33cdd7-c4bc-40b4-b455-d964b2659d81 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:25.871954 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ec33cdd7-c4bc-40b4-b455-d964b2659d81 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:25.926665 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-823755cc-e0aa-4c86-b533-bda874299f80 tempest-ExtensionsTest-360833182 tempest-ExtensionsTest-360833182-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:25:25.928823 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-823755cc-e0aa-4c86-b533-bda874299f80 tempest-ExtensionsTest-360833182 tempest-ExtensionsTest-360833182-project] 10.222.0.26 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.212706 Oct 08 21:25:25.933889 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2869/5816] 10.222.0.26 () {58 vars in 1170 bytes} [Sat Oct 8 21:25:25 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:25:25.938840 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-82c6508b-2a6b-4fbf-82b3-1124774568d7 tempest-ExtensionsTest-360833182 tempest-ExtensionsTest-360833182-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:25:25.941136 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-82c6508b-2a6b-4fbf-82b3-1124774568d7 tempest-ExtensionsTest-360833182 tempest-ExtensionsTest-360833182-project] 10.222.0.26 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.006033 Oct 08 21:25:25.958160 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2870/5817] 10.222.0.26 () {58 vars in 1134 bytes} [Sat Oct 8 21:25:25 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 08 21:25:26.160341 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-ec33cdd7-c4bc-40b4-b455-d964b2659d81 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e28f7acd53094828a7863ce2fd775cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b37e8634ac448ea9a86aff144098dd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:25:26.174026 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-ec33cdd7-c4bc-40b4-b455-d964b2659d81 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] 10.222.0.26 "GET /compute/v2.1/servers/bf3f4dd8-48f7-4c5a-aa5f-ee1e8d3f028b" status: 200 len: 1672 microversion: 2.1 time: 0.323638 Oct 08 21:25:26.175881 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2948/5818] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:25:25 2022] GET /compute/v2.1/servers/bf3f4dd8-48f7-4c5a-aa5f-ee1e8d3f028b => generated 1672 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:25:26.873522 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-cef3e43b-51f0-43bb-9f76-0706baf29d95 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:25:26.874903 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-cef3e43b-51f0-43bb-9f76-0706baf29d95 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 86c50f3f-0621-4fa0-92b7-dd09127c1886] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:25:26.886965 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cef3e43b-51f0-43bb-9f76-0706baf29d95 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:26.901173 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cef3e43b-51f0-43bb-9f76-0706baf29d95 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:26.904074 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cef3e43b-51f0-43bb-9f76-0706baf29d95 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:26.904861 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cef3e43b-51f0-43bb-9f76-0706baf29d95 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:26.905402 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cef3e43b-51f0-43bb-9f76-0706baf29d95 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:26.905850 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cef3e43b-51f0-43bb-9f76-0706baf29d95 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:27.206146 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-cef3e43b-51f0-43bb-9f76-0706baf29d95 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219a93945a147c4a57bb6452212fe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eeb6be960cc408296ecce6353b72f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:25:27.209988 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-c0e6e939-02d2-4ccd-839d-36c4e90e0d72 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:25:27.210630 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-c0e6e939-02d2-4ccd-839d-36c4e90e0d72 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] [instance: bf3f4dd8-48f7-4c5a-aa5f-ee1e8d3f028b] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:25:27.228335 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-cef3e43b-51f0-43bb-9f76-0706baf29d95 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "GET /compute/v2.1/servers/86c50f3f-0621-4fa0-92b7-dd09127c1886" status: 200 len: 1691 microversion: 2.1 time: 0.355026 Oct 08 21:25:27.245213 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2871/5819] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:25:26 2022] GET /compute/v2.1/servers/86c50f3f-0621-4fa0-92b7-dd09127c1886 => generated 1691 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:25:27.246375 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c0e6e939-02d2-4ccd-839d-36c4e90e0d72 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:27.246375 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c0e6e939-02d2-4ccd-839d-36c4e90e0d72 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:27.246375 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c0e6e939-02d2-4ccd-839d-36c4e90e0d72 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:27.253750 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c0e6e939-02d2-4ccd-839d-36c4e90e0d72 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:27.253750 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c0e6e939-02d2-4ccd-839d-36c4e90e0d72 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:27.253750 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c0e6e939-02d2-4ccd-839d-36c4e90e0d72 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:27.780411 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-c0e6e939-02d2-4ccd-839d-36c4e90e0d72 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e28f7acd53094828a7863ce2fd775cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b37e8634ac448ea9a86aff144098dd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:25:27.791011 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-c0e6e939-02d2-4ccd-839d-36c4e90e0d72 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] 10.222.0.26 "GET /compute/v2.1/servers/bf3f4dd8-48f7-4c5a-aa5f-ee1e8d3f028b" status: 200 len: 1672 microversion: 2.1 time: 0.591787 Oct 08 21:25:27.791863 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2949/5820] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:25:27 2022] GET /compute/v2.1/servers/bf3f4dd8-48f7-4c5a-aa5f-ee1e8d3f028b => generated 1672 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:25:28.263215 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-0a6c1f56-590a-4c90-88ef-35d3df964b28 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:25:28.264423 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-0a6c1f56-590a-4c90-88ef-35d3df964b28 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 86c50f3f-0621-4fa0-92b7-dd09127c1886] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:25:28.273070 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0a6c1f56-590a-4c90-88ef-35d3df964b28 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:28.273860 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0a6c1f56-590a-4c90-88ef-35d3df964b28 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:28.274472 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0a6c1f56-590a-4c90-88ef-35d3df964b28 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:28.275711 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0a6c1f56-590a-4c90-88ef-35d3df964b28 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:28.276679 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0a6c1f56-590a-4c90-88ef-35d3df964b28 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:28.277335 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0a6c1f56-590a-4c90-88ef-35d3df964b28 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:28.478029 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-0a6c1f56-590a-4c90-88ef-35d3df964b28 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219a93945a147c4a57bb6452212fe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eeb6be960cc408296ecce6353b72f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:25:28.493047 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-0a6c1f56-590a-4c90-88ef-35d3df964b28 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "GET /compute/v2.1/servers/86c50f3f-0621-4fa0-92b7-dd09127c1886" status: 200 len: 1691 microversion: 2.1 time: 0.235787 Oct 08 21:25:28.493684 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2872/5821] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:25:28 2022] GET /compute/v2.1/servers/86c50f3f-0621-4fa0-92b7-dd09127c1886 => generated 1691 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:25:28.755091 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-337911ff-487c-4007-8d0d-c8ac03e017ee req-555e4df8-dca8-4edd-991d-bdc97c5fdca0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf3f4dd8-48f7-4c5a-aa5f-ee1e8d3f028b", "name": "network-vif-deleted", "tag": "33f61238-6a86-48e4-b690-1f3245ea9c02"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:25:28.768926 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-337911ff-487c-4007-8d0d-c8ac03e017ee req-555e4df8-dca8-4edd-991d-bdc97c5fdca0 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:28.769805 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-337911ff-487c-4007-8d0d-c8ac03e017ee req-555e4df8-dca8-4edd-991d-bdc97c5fdca0 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:28.770393 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-337911ff-487c-4007-8d0d-c8ac03e017ee req-555e4df8-dca8-4edd-991d-bdc97c5fdca0 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:28.784836 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-337911ff-487c-4007-8d0d-c8ac03e017ee req-555e4df8-dca8-4edd-991d-bdc97c5fdca0 service nova] Creating event network-vif-deleted:33f61238-6a86-48e4-b690-1f3245ea9c02 for instance bf3f4dd8-48f7-4c5a-aa5f-ee1e8d3f028b on nch2-master-1 Oct 08 21:25:28.790704 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-337911ff-487c-4007-8d0d-c8ac03e017ee req-555e4df8-dca8-4edd-991d-bdc97c5fdca0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040438 Oct 08 21:25:28.791730 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2950/5822] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:25:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:25:28.816477 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-40f57cba-37ba-42b2-825d-222c3cedcbf7 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:25:28.817452 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-40f57cba-37ba-42b2-825d-222c3cedcbf7 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] [instance: bf3f4dd8-48f7-4c5a-aa5f-ee1e8d3f028b] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:25:28.825471 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-40f57cba-37ba-42b2-825d-222c3cedcbf7 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:28.826465 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-40f57cba-37ba-42b2-825d-222c3cedcbf7 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:28.827194 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-40f57cba-37ba-42b2-825d-222c3cedcbf7 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:28.828135 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-40f57cba-37ba-42b2-825d-222c3cedcbf7 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:28.828853 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-40f57cba-37ba-42b2-825d-222c3cedcbf7 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:28.829826 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-40f57cba-37ba-42b2-825d-222c3cedcbf7 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:29.282827 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-40f57cba-37ba-42b2-825d-222c3cedcbf7 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e28f7acd53094828a7863ce2fd775cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b37e8634ac448ea9a86aff144098dd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:25:29.293135 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-40f57cba-37ba-42b2-825d-222c3cedcbf7 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] 10.222.0.26 "GET /compute/v2.1/servers/bf3f4dd8-48f7-4c5a-aa5f-ee1e8d3f028b" status: 200 len: 1334 microversion: 2.1 time: 0.481339 Oct 08 21:25:29.293868 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2873/5823] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:25:28 2022] GET /compute/v2.1/servers/bf3f4dd8-48f7-4c5a-aa5f-ee1e8d3f028b => generated 1334 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:25:29.460062 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-5b1ded84-f21f-4b59-93a5-514d056ff802 tempest-VolumesTestJSON-1864942771 tempest-VolumesTestJSON-1864942771-project] Calling method '.version_select at 0x7f1a87e78f70>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:25:29.514225 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-5b1ded84-f21f-4b59-93a5-514d056ff802 tempest-VolumesTestJSON-1864942771 tempest-VolumesTestJSON-1864942771-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/cc8ec713-6bf9-4647-b376-a29a4d373cb4" status: 200 len: 343 microversion: 2.1 time: 0.058419 Oct 08 21:25:29.514974 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2951/5824] 10.222.0.26 () {58 vars in 1245 bytes} [Sat Oct 8 21:25:29 2022] GET /compute/v2.1/os-volumes/cc8ec713-6bf9-4647-b376-a29a4d373cb4 => generated 343 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:25:29.516018 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-b94fd983-cd58-4716-b88a-724b8752ad91 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:25:29.516855 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-b94fd983-cd58-4716-b88a-724b8752ad91 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 86c50f3f-0621-4fa0-92b7-dd09127c1886] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:25:29.523233 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b94fd983-cd58-4716-b88a-724b8752ad91 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:29.523952 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b94fd983-cd58-4716-b88a-724b8752ad91 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:29.524816 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b94fd983-cd58-4716-b88a-724b8752ad91 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:29.525966 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b94fd983-cd58-4716-b88a-724b8752ad91 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:29.526463 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b94fd983-cd58-4716-b88a-724b8752ad91 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:29.526897 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b94fd983-cd58-4716-b88a-724b8752ad91 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:29.755336 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-b94fd983-cd58-4716-b88a-724b8752ad91 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219a93945a147c4a57bb6452212fe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eeb6be960cc408296ecce6353b72f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:25:29.762621 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-b94fd983-cd58-4716-b88a-724b8752ad91 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "GET /compute/v2.1/servers/86c50f3f-0621-4fa0-92b7-dd09127c1886" status: 200 len: 1696 microversion: 2.1 time: 0.250639 Oct 08 21:25:29.776528 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2874/5825] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:25:29 2022] GET /compute/v2.1/servers/86c50f3f-0621-4fa0-92b7-dd09127c1886 => generated 1696 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:25:30.316766 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-24f4f5c3-f242-48c3-a221-acc87c7eb1d0 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:25:30.317630 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-24f4f5c3-f242-48c3-a221-acc87c7eb1d0 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] [instance: bf3f4dd8-48f7-4c5a-aa5f-ee1e8d3f028b] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:25:30.325692 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-24f4f5c3-f242-48c3-a221-acc87c7eb1d0 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:30.326187 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-24f4f5c3-f242-48c3-a221-acc87c7eb1d0 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:30.326630 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-24f4f5c3-f242-48c3-a221-acc87c7eb1d0 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:30.327335 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-24f4f5c3-f242-48c3-a221-acc87c7eb1d0 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:30.327798 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-24f4f5c3-f242-48c3-a221-acc87c7eb1d0 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:30.328231 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-24f4f5c3-f242-48c3-a221-acc87c7eb1d0 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:30.345323 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-24f4f5c3-f242-48c3-a221-acc87c7eb1d0 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] HTTP exception thrown: Instance bf3f4dd8-48f7-4c5a-aa5f-ee1e8d3f028b could not be found. Oct 08 21:25:30.346908 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-24f4f5c3-f242-48c3-a221-acc87c7eb1d0 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Request method failure captured: Oct 08 21:25:30.346908 ncdv-master-1 devstack@n-api.service[140492]: request: GET /compute/v2.1/servers/bf3f4dd8-48f7-4c5a-aa5f-ee1e8d3f028b HTTP/1.1 Oct 08 21:25:30.346908 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:25:30.346908 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:25:30.346908 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:25:30.346908 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 21:25:30.346908 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:25:30.346908 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:25:30.346908 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:25:30.346908 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:25:30.346908 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQen2S80x1CVAlKwCKZntNH5PQxsmQrq_ROUHyrV4X31LhiiSU0yhqEtSekpzTTt2ymhi_iUL7E8k1oIHYa5XRaIume53jrgq0WDi_uXqQ958DwZ_WEYlLYkPCXMEFlt2hc471wf2KjXPAn83Av9koEdzGk5iNdFNlgkHhLBvVzKU0ZA Oct 08 21:25:30.346908 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:25:30.346908 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:25:30.346908 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:25:30.346908 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:25:30.346908 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:25:30.346908 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:25:30.346908 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 9b37e8634ac448ea9a86aff144098dd4 Oct 08 21:25:30.346908 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-TestNetworkBasicOps-2013528848 Oct 08 21:25:30.346908 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:25:30.346908 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:25:30.346908 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9b37e8634ac448ea9a86aff144098dd4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9b37e8634ac448ea9a86aff144098dd4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9b37e8634ac448ea9a86aff144098dd4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9b37e8634ac448ea9a86aff144098dd4"}]}] Oct 08 21:25:30.346908 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-TestNetworkBasicOps-2013528848 Oct 08 21:25:30.346908 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 9b37e8634ac448ea9a86aff144098dd4 Oct 08 21:25:30.346908 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-TestNetworkBasicOps-2013528848 Oct 08 21:25:30.346908 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-TestNetworkBasicOps-2013528848-project Oct 08 21:25:30.346908 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:25:30.346908 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:25:30.346908 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: e28f7acd53094828a7863ce2fd775cdf Oct 08 21:25:30.346908 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-TestNetworkBasicOps-2013528848-project Oct 08 21:25:30.346908 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 21:25:30.346908 ncdv-master-1 devstack@n-api.service[140492]: exception: Instance bf3f4dd8-48f7-4c5a-aa5f-ee1e8d3f028b could not be found. Oct 08 21:25:30.346908 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': 'bf3f4dd8-48f7-4c5a-aa5f-ee1e8d3f028b'} Oct 08 21:25:30.346908 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:25:30.346908 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:25:30.346908 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:25:30.346908 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:25:30.346908 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:25:30.346908 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:25:30.346908 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:25:30.346908 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:25:30.346908 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:25:30.346908 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:25:30.346908 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf3f4dd8-48f7-4c5a-aa5f-ee1e8d3f028b could not be found. Oct 08 21:25:30.346908 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:25:30.346908 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:25:30.346908 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:25:30.346908 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:25:30.346908 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:25:30.346908 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:25:30.346908 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:25:30.346908 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:25:30.346908 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:25:30.346908 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:25:30.346908 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:25:30.346908 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:25:30.346908 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:25:30.346908 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:25:30.346908 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:25:30.346908 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:25:30.346908 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf3f4dd8-48f7-4c5a-aa5f-ee1e8d3f028b could not be found. Oct 08 21:25:30.346908 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:25:30.346908 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:25:30.346908 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:25:30.350412 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:25:30.350412 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:25:30.350412 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:25:30.350412 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:25:30.350412 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:25:30.350412 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf3f4dd8-48f7-4c5a-aa5f-ee1e8d3f028b could not be found. Oct 08 21:25:30.350412 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:25:30.350412 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-24f4f5c3-f242-48c3-a221-acc87c7eb1d0 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Returning 404 to user: Instance bf3f4dd8-48f7-4c5a-aa5f-ee1e8d3f028b could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:25:30.350412 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-24f4f5c3-f242-48c3-a221-acc87c7eb1d0 tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] 10.222.0.26 "GET /compute/v2.1/servers/bf3f4dd8-48f7-4c5a-aa5f-ee1e8d3f028b" status: 404 len: 111 microversion: 2.1 time: 0.036314 Oct 08 21:25:30.350412 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2952/5826] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:25:30 2022] GET /compute/v2.1/servers/bf3f4dd8-48f7-4c5a-aa5f-ee1e8d3f028b => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 08 21:25:30.517761 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-0901eff9-1f21-4010-b0bc-8ed9bd330eef tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] Calling method '.version_select at 0x7f1a9136d550>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:25:30.542818 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-0901eff9-1f21-4010-b0bc-8ed9bd330eef tempest-TestNetworkBasicOps-2013528848 tempest-TestNetworkBasicOps-2013528848-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1984693876" status: 202 len: 0 microversion: 2.1 time: 0.028853 Oct 08 21:25:30.544022 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2875/5827] 10.222.0.26 () {58 vars in 1257 bytes} [Sat Oct 8 21:25:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1984693876 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 21:25:30.789702 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-034948a8-4344-4978-b68e-3db0d7f89fbb tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:25:30.790690 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-034948a8-4344-4978-b68e-3db0d7f89fbb tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 86c50f3f-0621-4fa0-92b7-dd09127c1886] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:25:30.798742 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-034948a8-4344-4978-b68e-3db0d7f89fbb tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:30.799388 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-034948a8-4344-4978-b68e-3db0d7f89fbb tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:30.800104 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-034948a8-4344-4978-b68e-3db0d7f89fbb tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:30.801078 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-034948a8-4344-4978-b68e-3db0d7f89fbb tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:30.801730 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-034948a8-4344-4978-b68e-3db0d7f89fbb tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:30.802417 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-034948a8-4344-4978-b68e-3db0d7f89fbb tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:30.903194 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-0f38138e-5184-4127-a897-719c8fa80fc3 tempest-VolumesTestJSON-1864942771 tempest-VolumesTestJSON-1864942771-project] Calling method '.version_select at 0x7f1a876f8700>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:25:30.961106 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-0f38138e-5184-4127-a897-719c8fa80fc3 tempest-VolumesTestJSON-1864942771 tempest-VolumesTestJSON-1864942771-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/29309fbc-7aec-438e-a519-56906244c6c3" status: 200 len: 343 microversion: 2.1 time: 0.062510 Oct 08 21:25:30.961873 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2876/5828] 10.222.0.26 () {58 vars in 1245 bytes} [Sat Oct 8 21:25:30 2022] GET /compute/v2.1/os-volumes/29309fbc-7aec-438e-a519-56906244c6c3 => generated 343 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 08 21:25:31.449915 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-034948a8-4344-4978-b68e-3db0d7f89fbb tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219a93945a147c4a57bb6452212fe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eeb6be960cc408296ecce6353b72f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:25:31.460319 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-034948a8-4344-4978-b68e-3db0d7f89fbb tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "GET /compute/v2.1/servers/86c50f3f-0621-4fa0-92b7-dd09127c1886" status: 200 len: 1696 microversion: 2.1 time: 0.676623 Oct 08 21:25:31.463169 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2953/5829] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:25:30 2022] GET /compute/v2.1/servers/86c50f3f-0621-4fa0-92b7-dd09127c1886 => generated 1696 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:25:32.465665 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-6fb660d7-dd7f-4cfc-a19a-65b575728225 tempest-VolumesTestJSON-1864942771 tempest-VolumesTestJSON-1864942771-project] Calling method '.version_select at 0x7f1a876f90d0>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:25:32.484449 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-b49cfb16-69cd-4563-aa75-0c6cc3cee88b tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:25:32.485715 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-b49cfb16-69cd-4563-aa75-0c6cc3cee88b tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 86c50f3f-0621-4fa0-92b7-dd09127c1886] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:25:32.518370 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b49cfb16-69cd-4563-aa75-0c6cc3cee88b tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:32.523209 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b49cfb16-69cd-4563-aa75-0c6cc3cee88b tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:32.524120 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b49cfb16-69cd-4563-aa75-0c6cc3cee88b tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:32.532085 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b49cfb16-69cd-4563-aa75-0c6cc3cee88b tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:32.532676 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b49cfb16-69cd-4563-aa75-0c6cc3cee88b tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:32.533218 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b49cfb16-69cd-4563-aa75-0c6cc3cee88b tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:32.591011 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-6fb660d7-dd7f-4cfc-a19a-65b575728225 tempest-VolumesTestJSON-1864942771 tempest-VolumesTestJSON-1864942771-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/c425b4ac-661d-47ec-a822-857e7482347d" status: 200 len: 343 microversion: 2.1 time: 0.132235 Oct 08 21:25:32.591444 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2877/5830] 10.222.0.26 () {58 vars in 1245 bytes} [Sat Oct 8 21:25:32 2022] GET /compute/v2.1/os-volumes/c425b4ac-661d-47ec-a822-857e7482347d => generated 343 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 08 21:25:32.614053 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-5c767e5f-4437-4547-ae54-e0365657dbde tempest-VolumesTestJSON-1864942771 tempest-VolumesTestJSON-1864942771-project] Calling method '.version_select at 0x7f1a876f94c0>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:25:32.717837 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-5c767e5f-4437-4547-ae54-e0365657dbde tempest-VolumesTestJSON-1864942771 tempest-VolumesTestJSON-1864942771-project] 10.222.0.26 "GET /compute/v2.1/os-volumes" status: 200 len: 1012 microversion: 2.1 time: 0.113521 Oct 08 21:25:32.718574 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2878/5831] 10.222.0.26 () {58 vars in 1134 bytes} [Sat Oct 8 21:25:32 2022] GET /compute/v2.1/os-volumes => generated 1012 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:25:32.733630 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-3119084e-0da4-4a98-9f26-0b007d85dff6 tempest-VolumesTestJSON-1864942771 tempest-VolumesTestJSON-1864942771-project] Calling method '.version_select at 0x7f1a875e23a0>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:25:32.823058 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-3119084e-0da4-4a98-9f26-0b007d85dff6 tempest-VolumesTestJSON-1864942771 tempest-VolumesTestJSON-1864942771-project] 10.222.0.26 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 679 microversion: 2.1 time: 0.093443 Oct 08 21:25:32.824020 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2879/5832] 10.222.0.26 () {58 vars in 1149 bytes} [Sat Oct 8 21:25:32 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 679 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 08 21:25:32.838627 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-b9c1e8e0-613b-4736-a4ab-d7a16be90f94 tempest-VolumesTestJSON-1864942771 tempest-VolumesTestJSON-1864942771-project] Calling method '.version_select at 0x7f1a875dd700>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:25:32.842043 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-b49cfb16-69cd-4563-aa75-0c6cc3cee88b tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219a93945a147c4a57bb6452212fe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eeb6be960cc408296ecce6353b72f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:25:32.852331 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-b49cfb16-69cd-4563-aa75-0c6cc3cee88b tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "GET /compute/v2.1/servers/86c50f3f-0621-4fa0-92b7-dd09127c1886" status: 200 len: 1696 microversion: 2.1 time: 0.371849 Oct 08 21:25:32.853317 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2954/5833] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:25:32 2022] GET /compute/v2.1/servers/86c50f3f-0621-4fa0-92b7-dd09127c1886 => generated 1696 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:25:32.944282 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-b9c1e8e0-613b-4736-a4ab-d7a16be90f94 tempest-VolumesTestJSON-1864942771 tempest-VolumesTestJSON-1864942771-project] 10.222.0.26 "GET /compute/v2.1/os-volumes" status: 200 len: 1012 microversion: 2.1 time: 0.110652 Oct 08 21:25:32.945512 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2880/5834] 10.222.0.26 () {58 vars in 1134 bytes} [Sat Oct 8 21:25:32 2022] GET /compute/v2.1/os-volumes => generated 1012 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:25:32.959838 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-a9e964e2-a825-4f9f-a68b-2085b696c8e7 tempest-VolumesTestJSON-1864942771 tempest-VolumesTestJSON-1864942771-project] Calling method '.version_select at 0x7f1a8c7aa5e0>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:25:33.050058 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-a9e964e2-a825-4f9f-a68b-2085b696c8e7 tempest-VolumesTestJSON-1864942771 tempest-VolumesTestJSON-1864942771-project] 10.222.0.26 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 346 microversion: 2.1 time: 0.095048 Oct 08 21:25:33.051580 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2955/5835] 10.222.0.26 () {58 vars in 1167 bytes} [Sat Oct 8 21:25:32 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 346 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:25:33.067809 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-34858039-14eb-4918-a877-e5a43b92edbe tempest-VolumesTestJSON-1864942771 tempest-VolumesTestJSON-1864942771-project] Calling method '.version_select at 0x7f1a8761c4c0>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:25:33.228694 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-34858039-14eb-4918-a877-e5a43b92edbe tempest-VolumesTestJSON-1864942771 tempest-VolumesTestJSON-1864942771-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 679 microversion: 2.1 time: 0.165817 Oct 08 21:25:33.229520 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2881/5836] 10.222.0.26 () {58 vars in 1170 bytes} [Sat Oct 8 21:25:33 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 679 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:25:33.244941 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-b2f928d9-89df-4d40-9262-4b05b393676e tempest-VolumesTestJSON-1864942771 tempest-VolumesTestJSON-1864942771-project] Calling method '.version_select at 0x7f1a8c758e50>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:25:33.366011 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-b2f928d9-89df-4d40-9262-4b05b393676e tempest-VolumesTestJSON-1864942771 tempest-VolumesTestJSON-1864942771-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1012 microversion: 2.1 time: 0.124867 Oct 08 21:25:33.366589 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2956/5837] 10.222.0.26 () {58 vars in 1155 bytes} [Sat Oct 8 21:25:33 2022] GET /compute/v2.1/os-volumes/detail => generated 1012 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:25:33.384750 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-ee3a3972-ef0a-4a01-8d2b-5ce45ce7fb5b tempest-VolumesTestJSON-1864942771 tempest-VolumesTestJSON-1864942771-project] Calling method '.version_select at 0x7f1a8ca3b700>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:25:33.509261 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-ee3a3972-ef0a-4a01-8d2b-5ce45ce7fb5b tempest-VolumesTestJSON-1864942771 tempest-VolumesTestJSON-1864942771-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 346 microversion: 2.1 time: 0.133045 Oct 08 21:25:33.510222 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2882/5838] 10.222.0.26 () {58 vars in 1188 bytes} [Sat Oct 8 21:25:33 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 346 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:25:33.526113 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-78439708-08f0-48bb-a074-25aab68f156d tempest-VolumesTestJSON-1864942771 tempest-VolumesTestJSON-1864942771-project] Calling method '.version_select at 0x7f1a8c8eaca0>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:25:33.645503 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-78439708-08f0-48bb-a074-25aab68f156d tempest-VolumesTestJSON-1864942771 tempest-VolumesTestJSON-1864942771-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1012 microversion: 2.1 time: 0.125193 Oct 08 21:25:33.658517 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2957/5839] 10.222.0.26 () {58 vars in 1155 bytes} [Sat Oct 8 21:25:33 2022] GET /compute/v2.1/os-volumes/detail => generated 1012 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:25:33.882873 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-72cbf188-6a7e-49c4-8c10-579c4b42a49b tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:25:33.894081 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-72cbf188-6a7e-49c4-8c10-579c4b42a49b tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 86c50f3f-0621-4fa0-92b7-dd09127c1886] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:25:33.901468 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-72cbf188-6a7e-49c4-8c10-579c4b42a49b tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:33.902260 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-72cbf188-6a7e-49c4-8c10-579c4b42a49b tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:33.902932 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-72cbf188-6a7e-49c4-8c10-579c4b42a49b tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:33.903716 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-72cbf188-6a7e-49c4-8c10-579c4b42a49b tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:33.904411 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-72cbf188-6a7e-49c4-8c10-579c4b42a49b tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:33.905562 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-72cbf188-6a7e-49c4-8c10-579c4b42a49b tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:34.110079 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-72cbf188-6a7e-49c4-8c10-579c4b42a49b tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219a93945a147c4a57bb6452212fe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eeb6be960cc408296ecce6353b72f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:25:34.125804 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-72cbf188-6a7e-49c4-8c10-579c4b42a49b tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "GET /compute/v2.1/servers/86c50f3f-0621-4fa0-92b7-dd09127c1886" status: 200 len: 1696 microversion: 2.1 time: 0.249166 Oct 08 21:25:34.131977 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2883/5840] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:25:33 2022] GET /compute/v2.1/servers/86c50f3f-0621-4fa0-92b7-dd09127c1886 => generated 1696 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:25:35.154075 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-396ab1cd-1c63-4453-93d8-84838a4bbc94 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:25:35.154931 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-396ab1cd-1c63-4453-93d8-84838a4bbc94 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 86c50f3f-0621-4fa0-92b7-dd09127c1886] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:25:35.162280 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-396ab1cd-1c63-4453-93d8-84838a4bbc94 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:35.163520 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-396ab1cd-1c63-4453-93d8-84838a4bbc94 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:35.164082 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-396ab1cd-1c63-4453-93d8-84838a4bbc94 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:35.164909 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-396ab1cd-1c63-4453-93d8-84838a4bbc94 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:35.165612 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-396ab1cd-1c63-4453-93d8-84838a4bbc94 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:35.166094 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-396ab1cd-1c63-4453-93d8-84838a4bbc94 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:35.333820 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-396ab1cd-1c63-4453-93d8-84838a4bbc94 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219a93945a147c4a57bb6452212fe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eeb6be960cc408296ecce6353b72f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:25:35.342650 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-396ab1cd-1c63-4453-93d8-84838a4bbc94 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "GET /compute/v2.1/servers/86c50f3f-0621-4fa0-92b7-dd09127c1886" status: 200 len: 1696 microversion: 2.1 time: 0.194369 Oct 08 21:25:35.343561 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2958/5841] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:25:35 2022] GET /compute/v2.1/servers/86c50f3f-0621-4fa0-92b7-dd09127c1886 => generated 1696 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:25:36.380656 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-0c66ce09-36e7-45d6-b7e7-fa201c327b69 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:25:36.380656 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-0c66ce09-36e7-45d6-b7e7-fa201c327b69 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 86c50f3f-0621-4fa0-92b7-dd09127c1886] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:25:36.383185 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0c66ce09-36e7-45d6-b7e7-fa201c327b69 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:36.383756 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0c66ce09-36e7-45d6-b7e7-fa201c327b69 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:36.384424 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0c66ce09-36e7-45d6-b7e7-fa201c327b69 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:36.385157 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0c66ce09-36e7-45d6-b7e7-fa201c327b69 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:36.385638 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0c66ce09-36e7-45d6-b7e7-fa201c327b69 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:36.386296 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0c66ce09-36e7-45d6-b7e7-fa201c327b69 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:36.559043 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-0c66ce09-36e7-45d6-b7e7-fa201c327b69 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219a93945a147c4a57bb6452212fe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eeb6be960cc408296ecce6353b72f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:25:36.569572 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-0c66ce09-36e7-45d6-b7e7-fa201c327b69 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "GET /compute/v2.1/servers/86c50f3f-0621-4fa0-92b7-dd09127c1886" status: 200 len: 1696 microversion: 2.1 time: 0.201787 Oct 08 21:25:36.570450 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2884/5842] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:25:36 2022] GET /compute/v2.1/servers/86c50f3f-0621-4fa0-92b7-dd09127c1886 => generated 1696 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:25:37.595236 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-2eb3ed99-1b28-4d37-9374-57411ba5b2f9 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:25:37.596238 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-2eb3ed99-1b28-4d37-9374-57411ba5b2f9 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 86c50f3f-0621-4fa0-92b7-dd09127c1886] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:25:37.599543 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=3 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:25:37.606164 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2eb3ed99-1b28-4d37-9374-57411ba5b2f9 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:37.606667 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2eb3ed99-1b28-4d37-9374-57411ba5b2f9 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:37.607748 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2eb3ed99-1b28-4d37-9374-57411ba5b2f9 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:37.608484 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2eb3ed99-1b28-4d37-9374-57411ba5b2f9 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:37.608957 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2eb3ed99-1b28-4d37-9374-57411ba5b2f9 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:37.609428 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2eb3ed99-1b28-4d37-9374-57411ba5b2f9 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:37.822119 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-2eb3ed99-1b28-4d37-9374-57411ba5b2f9 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219a93945a147c4a57bb6452212fe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eeb6be960cc408296ecce6353b72f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:25:37.830198 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-2eb3ed99-1b28-4d37-9374-57411ba5b2f9 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "GET /compute/v2.1/servers/86c50f3f-0621-4fa0-92b7-dd09127c1886" status: 200 len: 1696 microversion: 2.1 time: 0.239206 Oct 08 21:25:37.830946 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2959/5843] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:25:37 2022] GET /compute/v2.1/servers/86c50f3f-0621-4fa0-92b7-dd09127c1886 => generated 1696 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:25:38.855697 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-045d9524-99f5-4a94-bd54-3a8f4361754a tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:25:38.856584 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-045d9524-99f5-4a94-bd54-3a8f4361754a tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 86c50f3f-0621-4fa0-92b7-dd09127c1886] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:25:38.863653 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-045d9524-99f5-4a94-bd54-3a8f4361754a tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:38.864040 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-045d9524-99f5-4a94-bd54-3a8f4361754a tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:38.864489 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-045d9524-99f5-4a94-bd54-3a8f4361754a tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:38.865205 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-045d9524-99f5-4a94-bd54-3a8f4361754a tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:38.866283 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-045d9524-99f5-4a94-bd54-3a8f4361754a tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:38.866721 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-045d9524-99f5-4a94-bd54-3a8f4361754a tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:39.012888 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-045d9524-99f5-4a94-bd54-3a8f4361754a tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219a93945a147c4a57bb6452212fe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eeb6be960cc408296ecce6353b72f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:25:39.021536 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-045d9524-99f5-4a94-bd54-3a8f4361754a tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "GET /compute/v2.1/servers/86c50f3f-0621-4fa0-92b7-dd09127c1886" status: 200 len: 1696 microversion: 2.1 time: 0.170018 Oct 08 21:25:39.022929 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2885/5844] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:25:38 2022] GET /compute/v2.1/servers/86c50f3f-0621-4fa0-92b7-dd09127c1886 => generated 1696 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:25:40.046112 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-92c02843-34e4-4700-a3b9-94fc3c3ecb87 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:25:40.046740 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-92c02843-34e4-4700-a3b9-94fc3c3ecb87 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 86c50f3f-0621-4fa0-92b7-dd09127c1886] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:25:40.053878 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-92c02843-34e4-4700-a3b9-94fc3c3ecb87 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:40.054376 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-92c02843-34e4-4700-a3b9-94fc3c3ecb87 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:40.054825 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-92c02843-34e4-4700-a3b9-94fc3c3ecb87 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:40.055713 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-92c02843-34e4-4700-a3b9-94fc3c3ecb87 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:40.056235 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-92c02843-34e4-4700-a3b9-94fc3c3ecb87 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:40.056675 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-92c02843-34e4-4700-a3b9-94fc3c3ecb87 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:40.190347 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-92c02843-34e4-4700-a3b9-94fc3c3ecb87 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219a93945a147c4a57bb6452212fe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eeb6be960cc408296ecce6353b72f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:25:40.198983 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-92c02843-34e4-4700-a3b9-94fc3c3ecb87 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "GET /compute/v2.1/servers/86c50f3f-0621-4fa0-92b7-dd09127c1886" status: 200 len: 1696 microversion: 2.1 time: 0.156893 Oct 08 21:25:40.199572 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2960/5845] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:25:40 2022] GET /compute/v2.1/servers/86c50f3f-0621-4fa0-92b7-dd09127c1886 => generated 1696 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:25:41.221545 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-def082c8-b8c1-42d7-aeac-6aa26df4c4bb tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:25:41.222866 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-def082c8-b8c1-42d7-aeac-6aa26df4c4bb tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 86c50f3f-0621-4fa0-92b7-dd09127c1886] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:25:41.230516 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-def082c8-b8c1-42d7-aeac-6aa26df4c4bb tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:41.231264 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-def082c8-b8c1-42d7-aeac-6aa26df4c4bb tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:41.232274 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-def082c8-b8c1-42d7-aeac-6aa26df4c4bb tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:41.233112 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-def082c8-b8c1-42d7-aeac-6aa26df4c4bb tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:41.233599 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-def082c8-b8c1-42d7-aeac-6aa26df4c4bb tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:41.234283 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-def082c8-b8c1-42d7-aeac-6aa26df4c4bb tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:41.391501 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-def082c8-b8c1-42d7-aeac-6aa26df4c4bb tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219a93945a147c4a57bb6452212fe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eeb6be960cc408296ecce6353b72f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:25:41.400602 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-def082c8-b8c1-42d7-aeac-6aa26df4c4bb tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "GET /compute/v2.1/servers/86c50f3f-0621-4fa0-92b7-dd09127c1886" status: 200 len: 1695 microversion: 2.1 time: 0.182704 Oct 08 21:25:41.401520 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2886/5846] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:25:41 2022] GET /compute/v2.1/servers/86c50f3f-0621-4fa0-92b7-dd09127c1886 => generated 1695 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:25:41.750332 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-f4b96d9b-0172-41d2-9665-8fff80a8e0d9 req-5135c0b3-7a9a-4684-9a8c-18620ae47c2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86c50f3f-0621-4fa0-92b7-dd09127c1886", "name": "network-vif-unplugged", "status": "completed", "tag": "7a7af606-e3b6-432d-8f3d-56cd8778503f"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:25:41.761701 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-f4b96d9b-0172-41d2-9665-8fff80a8e0d9 req-5135c0b3-7a9a-4684-9a8c-18620ae47c2c service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:41.762184 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-f4b96d9b-0172-41d2-9665-8fff80a8e0d9 req-5135c0b3-7a9a-4684-9a8c-18620ae47c2c service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:41.762620 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-f4b96d9b-0172-41d2-9665-8fff80a8e0d9 req-5135c0b3-7a9a-4684-9a8c-18620ae47c2c service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:41.776115 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-f4b96d9b-0172-41d2-9665-8fff80a8e0d9 req-5135c0b3-7a9a-4684-9a8c-18620ae47c2c service nova] Creating event network-vif-unplugged:7a7af606-e3b6-432d-8f3d-56cd8778503f for instance 86c50f3f-0621-4fa0-92b7-dd09127c1886 on nch2-master-1 Oct 08 21:25:41.782026 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [req-f4b96d9b-0172-41d2-9665-8fff80a8e0d9 req-5135c0b3-7a9a-4684-9a8c-18620ae47c2c service nova] Instance 86c50f3f-0621-4fa0-92b7-dd09127c1886 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140492) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 08 21:25:41.793299 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-f4b96d9b-0172-41d2-9665-8fff80a8e0d9 req-5135c0b3-7a9a-4684-9a8c-18620ae47c2c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046595 Oct 08 21:25:41.793907 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2961/5847] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:25:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:25:42.426476 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-15766e68-4bb6-42b9-b61f-a674109d0802 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:25:42.427262 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-15766e68-4bb6-42b9-b61f-a674109d0802 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 86c50f3f-0621-4fa0-92b7-dd09127c1886] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:25:42.436132 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-15766e68-4bb6-42b9-b61f-a674109d0802 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:42.436936 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-15766e68-4bb6-42b9-b61f-a674109d0802 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:42.437652 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-15766e68-4bb6-42b9-b61f-a674109d0802 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:42.438452 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-15766e68-4bb6-42b9-b61f-a674109d0802 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:42.439359 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-15766e68-4bb6-42b9-b61f-a674109d0802 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:42.439997 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-15766e68-4bb6-42b9-b61f-a674109d0802 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:42.619474 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-15766e68-4bb6-42b9-b61f-a674109d0802 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219a93945a147c4a57bb6452212fe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eeb6be960cc408296ecce6353b72f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:25:42.629695 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-15766e68-4bb6-42b9-b61f-a674109d0802 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "GET /compute/v2.1/servers/86c50f3f-0621-4fa0-92b7-dd09127c1886" status: 200 len: 1695 microversion: 2.1 time: 0.206200 Oct 08 21:25:42.630294 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2887/5848] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:25:42 2022] GET /compute/v2.1/servers/86c50f3f-0621-4fa0-92b7-dd09127c1886 => generated 1695 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:25:43.656598 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-90063112-5b06-478e-9e6d-9715b05f9e33 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:25:43.657465 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-90063112-5b06-478e-9e6d-9715b05f9e33 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 86c50f3f-0621-4fa0-92b7-dd09127c1886] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:25:43.664287 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-90063112-5b06-478e-9e6d-9715b05f9e33 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:43.664789 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-90063112-5b06-478e-9e6d-9715b05f9e33 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:43.665294 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-90063112-5b06-478e-9e6d-9715b05f9e33 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:43.666177 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-90063112-5b06-478e-9e6d-9715b05f9e33 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:43.666647 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-90063112-5b06-478e-9e6d-9715b05f9e33 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:43.667097 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-90063112-5b06-478e-9e6d-9715b05f9e33 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:43.808226 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-50ca1dda-037e-493b-ac7e-80c614da07a8 req-4b1a1ce1-6eb5-4d83-8d37-d7d935556c74 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86c50f3f-0621-4fa0-92b7-dd09127c1886", "tag": "7a7af606-e3b6-432d-8f3d-56cd8778503f"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:25:43.814569 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-90063112-5b06-478e-9e6d-9715b05f9e33 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219a93945a147c4a57bb6452212fe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eeb6be960cc408296ecce6353b72f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:25:43.819624 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-50ca1dda-037e-493b-ac7e-80c614da07a8 req-4b1a1ce1-6eb5-4d83-8d37-d7d935556c74 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:43.821111 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-50ca1dda-037e-493b-ac7e-80c614da07a8 req-4b1a1ce1-6eb5-4d83-8d37-d7d935556c74 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:43.821581 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-50ca1dda-037e-493b-ac7e-80c614da07a8 req-4b1a1ce1-6eb5-4d83-8d37-d7d935556c74 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:43.822985 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-90063112-5b06-478e-9e6d-9715b05f9e33 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "GET /compute/v2.1/servers/86c50f3f-0621-4fa0-92b7-dd09127c1886" status: 200 len: 1693 microversion: 2.1 time: 0.171589 Oct 08 21:25:43.823772 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2962/5849] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:25:43 2022] GET /compute/v2.1/servers/86c50f3f-0621-4fa0-92b7-dd09127c1886 => generated 1693 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:25:43.834741 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-50ca1dda-037e-493b-ac7e-80c614da07a8 req-4b1a1ce1-6eb5-4d83-8d37-d7d935556c74 service nova] Creating event network-changed:7a7af606-e3b6-432d-8f3d-56cd8778503f for instance 86c50f3f-0621-4fa0-92b7-dd09127c1886 on nch2-master-1 Oct 08 21:25:43.840229 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [req-50ca1dda-037e-493b-ac7e-80c614da07a8 req-4b1a1ce1-6eb5-4d83-8d37-d7d935556c74 service nova] Instance 86c50f3f-0621-4fa0-92b7-dd09127c1886 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140491) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 08 21:25:43.851552 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-50ca1dda-037e-493b-ac7e-80c614da07a8 req-4b1a1ce1-6eb5-4d83-8d37-d7d935556c74 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047755 Oct 08 21:25:43.852168 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2888/5850] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:25:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 08 21:25:44.846993 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-43fa34ee-06b1-4dc0-821f-c8d8b4c2c54b tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:25:44.847615 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-43fa34ee-06b1-4dc0-821f-c8d8b4c2c54b tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 86c50f3f-0621-4fa0-92b7-dd09127c1886] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:25:44.855341 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-43fa34ee-06b1-4dc0-821f-c8d8b4c2c54b tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:44.856122 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-43fa34ee-06b1-4dc0-821f-c8d8b4c2c54b tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:44.856586 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-43fa34ee-06b1-4dc0-821f-c8d8b4c2c54b tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:44.857354 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-43fa34ee-06b1-4dc0-821f-c8d8b4c2c54b tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:44.857823 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-43fa34ee-06b1-4dc0-821f-c8d8b4c2c54b tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:44.858262 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-43fa34ee-06b1-4dc0-821f-c8d8b4c2c54b tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:44.873569 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:25:45.228352 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-43fa34ee-06b1-4dc0-821f-c8d8b4c2c54b tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219a93945a147c4a57bb6452212fe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eeb6be960cc408296ecce6353b72f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:25:45.237146 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-43fa34ee-06b1-4dc0-821f-c8d8b4c2c54b tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "GET /compute/v2.1/servers/86c50f3f-0621-4fa0-92b7-dd09127c1886" status: 200 len: 1690 microversion: 2.1 time: 0.394042 Oct 08 21:25:45.238289 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2963/5851] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:25:44 2022] GET /compute/v2.1/servers/86c50f3f-0621-4fa0-92b7-dd09127c1886 => generated 1690 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:25:45.271074 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-0afe2c5e-2775-4f32-aec1-72a5f231981c tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:25:45.273176 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-0afe2c5e-2775-4f32-aec1-72a5f231981c tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 86c50f3f-0621-4fa0-92b7-dd09127c1886] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:25:45.290124 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0afe2c5e-2775-4f32-aec1-72a5f231981c tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:45.290868 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0afe2c5e-2775-4f32-aec1-72a5f231981c tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:45.293568 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0afe2c5e-2775-4f32-aec1-72a5f231981c tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:45.295374 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0afe2c5e-2775-4f32-aec1-72a5f231981c tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:45.296111 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0afe2c5e-2775-4f32-aec1-72a5f231981c tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:45.296886 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0afe2c5e-2775-4f32-aec1-72a5f231981c tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:45.375310 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-0afe2c5e-2775-4f32-aec1-72a5f231981c tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "POST /compute/v2.1/servers/86c50f3f-0621-4fa0-92b7-dd09127c1886/action" status: 204 len: 0 microversion: 2.1 time: 0.115697 Oct 08 21:25:45.376238 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2889/5852] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:25:45 2022] POST /compute/v2.1/servers/86c50f3f-0621-4fa0-92b7-dd09127c1886/action => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 21:25:45.384504 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-23a3d680-c468-4f6f-89ea-4ab2a2997424 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:25:45.385125 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-23a3d680-c468-4f6f-89ea-4ab2a2997424 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 86c50f3f-0621-4fa0-92b7-dd09127c1886] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:25:45.391503 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-23a3d680-c468-4f6f-89ea-4ab2a2997424 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:45.392002 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-23a3d680-c468-4f6f-89ea-4ab2a2997424 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:45.392456 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-23a3d680-c468-4f6f-89ea-4ab2a2997424 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:45.393338 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-23a3d680-c468-4f6f-89ea-4ab2a2997424 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:45.393710 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-23a3d680-c468-4f6f-89ea-4ab2a2997424 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:45.394137 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-23a3d680-c468-4f6f-89ea-4ab2a2997424 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:45.667522 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-23a3d680-c468-4f6f-89ea-4ab2a2997424 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219a93945a147c4a57bb6452212fe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eeb6be960cc408296ecce6353b72f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:25:45.681445 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-23a3d680-c468-4f6f-89ea-4ab2a2997424 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "GET /compute/v2.1/servers/86c50f3f-0621-4fa0-92b7-dd09127c1886" status: 200 len: 1690 microversion: 2.1 time: 0.300834 Oct 08 21:25:45.682932 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2964/5853] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:25:45 2022] GET /compute/v2.1/servers/86c50f3f-0621-4fa0-92b7-dd09127c1886 => generated 1690 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:25:46.707043 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-3daee0b4-b7fb-4255-b6f4-b18e1074ad6f tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:25:46.707757 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-3daee0b4-b7fb-4255-b6f4-b18e1074ad6f tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 86c50f3f-0621-4fa0-92b7-dd09127c1886] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:25:46.715587 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3daee0b4-b7fb-4255-b6f4-b18e1074ad6f tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:46.717092 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3daee0b4-b7fb-4255-b6f4-b18e1074ad6f tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:46.717092 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3daee0b4-b7fb-4255-b6f4-b18e1074ad6f tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:46.721736 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3daee0b4-b7fb-4255-b6f4-b18e1074ad6f tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:46.722234 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3daee0b4-b7fb-4255-b6f4-b18e1074ad6f tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:46.722685 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3daee0b4-b7fb-4255-b6f4-b18e1074ad6f tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:46.876608 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-3daee0b4-b7fb-4255-b6f4-b18e1074ad6f tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219a93945a147c4a57bb6452212fe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eeb6be960cc408296ecce6353b72f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:25:46.885879 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-3daee0b4-b7fb-4255-b6f4-b18e1074ad6f tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "GET /compute/v2.1/servers/86c50f3f-0621-4fa0-92b7-dd09127c1886" status: 200 len: 1690 microversion: 2.1 time: 0.183918 Oct 08 21:25:46.886447 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2890/5854] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:25:46 2022] GET /compute/v2.1/servers/86c50f3f-0621-4fa0-92b7-dd09127c1886 => generated 1690 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:25:47.236127 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-8f2868e5-cf85-42f4-b4a1-407d91e11ce5 req-5a07c529-711f-4640-b921-27207e1b87d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86c50f3f-0621-4fa0-92b7-dd09127c1886", "name": "network-vif-plugged", "status": "completed", "tag": "7a7af606-e3b6-432d-8f3d-56cd8778503f"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:25:47.247218 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-8f2868e5-cf85-42f4-b4a1-407d91e11ce5 req-5a07c529-711f-4640-b921-27207e1b87d7 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:47.247701 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-8f2868e5-cf85-42f4-b4a1-407d91e11ce5 req-5a07c529-711f-4640-b921-27207e1b87d7 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:47.248904 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-8f2868e5-cf85-42f4-b4a1-407d91e11ce5 req-5a07c529-711f-4640-b921-27207e1b87d7 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:47.262078 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-8f2868e5-cf85-42f4-b4a1-407d91e11ce5 req-5a07c529-711f-4640-b921-27207e1b87d7 service nova] Creating event network-vif-plugged:7a7af606-e3b6-432d-8f3d-56cd8778503f for instance 86c50f3f-0621-4fa0-92b7-dd09127c1886 on nch2-master-1 Oct 08 21:25:47.267067 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-8f2868e5-cf85-42f4-b4a1-407d91e11ce5 req-5a07c529-711f-4640-b921-27207e1b87d7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035262 Oct 08 21:25:47.267987 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2965/5855] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:25:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:25:47.915039 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-ae6c392a-b876-4bb2-98ce-5fb546261711 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:25:47.915867 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-ae6c392a-b876-4bb2-98ce-5fb546261711 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 86c50f3f-0621-4fa0-92b7-dd09127c1886] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:25:47.924031 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ae6c392a-b876-4bb2-98ce-5fb546261711 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:47.924616 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ae6c392a-b876-4bb2-98ce-5fb546261711 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:47.925146 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ae6c392a-b876-4bb2-98ce-5fb546261711 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:47.926068 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ae6c392a-b876-4bb2-98ce-5fb546261711 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:25:47.926867 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ae6c392a-b876-4bb2-98ce-5fb546261711 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:25:47.927570 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ae6c392a-b876-4bb2-98ce-5fb546261711 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:25:47.932328 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:25:48.080076 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-ae6c392a-b876-4bb2-98ce-5fb546261711 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219a93945a147c4a57bb6452212fe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eeb6be960cc408296ecce6353b72f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:25:48.090014 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-ae6c392a-b876-4bb2-98ce-5fb546261711 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "GET /compute/v2.1/servers/86c50f3f-0621-4fa0-92b7-dd09127c1886" status: 200 len: 1682 microversion: 2.1 time: 0.180378 Oct 08 21:25:48.092493 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2891/5856] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:25:47 2022] GET /compute/v2.1/servers/86c50f3f-0621-4fa0-92b7-dd09127c1886 => generated 1682 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:26:10.283242 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=13 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:26:10.284111 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=11 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:26:10.288761 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-dd205e9c-76dc-4283-a139-d613c343f7d8 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:26:10.291103 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-dd205e9c-76dc-4283-a139-d613c343f7d8 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 86c50f3f-0621-4fa0-92b7-dd09127c1886] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:26:10.298386 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dd205e9c-76dc-4283-a139-d613c343f7d8 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:26:10.298890 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dd205e9c-76dc-4283-a139-d613c343f7d8 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:26:10.299342 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dd205e9c-76dc-4283-a139-d613c343f7d8 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:26:10.300063 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dd205e9c-76dc-4283-a139-d613c343f7d8 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:26:10.300597 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dd205e9c-76dc-4283-a139-d613c343f7d8 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:26:10.300974 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dd205e9c-76dc-4283-a139-d613c343f7d8 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:26:10.354739 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-dd205e9c-76dc-4283-a139-d613c343f7d8 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "POST /compute/v2.1/servers/86c50f3f-0621-4fa0-92b7-dd09127c1886/action" status: 200 len: 24577 microversion: 2.1 time: 0.072585 Oct 08 21:26:10.355428 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2966/5857] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:26:10 2022] POST /compute/v2.1/servers/86c50f3f-0621-4fa0-92b7-dd09127c1886/action => generated 24577 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 08 21:26:16.597268 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-4ad3cde3-8154-4e45-a734-0f7a517ec384 tempest-TestNetworkAdvancedServerOps-1736509213 tempest-TestNetworkAdvancedServerOps-1736509213-project-admin] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:26:16.597977 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-4ad3cde3-8154-4e45-a734-0f7a517ec384 tempest-TestNetworkAdvancedServerOps-1736509213 tempest-TestNetworkAdvancedServerOps-1736509213-project-admin] [instance: 86c50f3f-0621-4fa0-92b7-dd09127c1886] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:26:16.600108 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:SELECT=32,nova_api:DELETE=1 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:26:16.600900 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=5 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:26:16.608986 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4ad3cde3-8154-4e45-a734-0f7a517ec384 tempest-TestNetworkAdvancedServerOps-1736509213 tempest-TestNetworkAdvancedServerOps-1736509213-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:26:16.609511 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4ad3cde3-8154-4e45-a734-0f7a517ec384 tempest-TestNetworkAdvancedServerOps-1736509213 tempest-TestNetworkAdvancedServerOps-1736509213-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:26:16.610025 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4ad3cde3-8154-4e45-a734-0f7a517ec384 tempest-TestNetworkAdvancedServerOps-1736509213 tempest-TestNetworkAdvancedServerOps-1736509213-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:26:16.610738 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4ad3cde3-8154-4e45-a734-0f7a517ec384 tempest-TestNetworkAdvancedServerOps-1736509213 tempest-TestNetworkAdvancedServerOps-1736509213-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:26:16.611197 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4ad3cde3-8154-4e45-a734-0f7a517ec384 tempest-TestNetworkAdvancedServerOps-1736509213 tempest-TestNetworkAdvancedServerOps-1736509213-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:26:16.611628 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4ad3cde3-8154-4e45-a734-0f7a517ec384 tempest-TestNetworkAdvancedServerOps-1736509213 tempest-TestNetworkAdvancedServerOps-1736509213-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:26:16.751568 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-4ad3cde3-8154-4e45-a734-0f7a517ec384 tempest-TestNetworkAdvancedServerOps-1736509213 tempest-TestNetworkAdvancedServerOps-1736509213-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/86c50f3f-0621-4fa0-92b7-dd09127c1886" status: 200 len: 1833 microversion: 2.1 time: 0.158278 Oct 08 21:26:16.752402 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2892/5858] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:26:16 2022] GET /compute/v2.1/servers/86c50f3f-0621-4fa0-92b7-dd09127c1886 => generated 1833 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:26:18.045638 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-c5eca1c6-e417-4c2e-b269-9354d52e9f09 req-aefdde53-37b4-47a5-aa2f-e079a931375a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86c50f3f-0621-4fa0-92b7-dd09127c1886", "tag": "7a7af606-e3b6-432d-8f3d-56cd8778503f"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:26:18.050891 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-c604dd9a-0c63-4d8d-adb6-fe8b4024362c tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:26:18.051497 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-c604dd9a-0c63-4d8d-adb6-fe8b4024362c tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 86c50f3f-0621-4fa0-92b7-dd09127c1886] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:26:18.065252 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-c5eca1c6-e417-4c2e-b269-9354d52e9f09 req-aefdde53-37b4-47a5-aa2f-e079a931375a service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:26:18.067300 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c604dd9a-0c63-4d8d-adb6-fe8b4024362c tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:26:18.067893 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c604dd9a-0c63-4d8d-adb6-fe8b4024362c tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:26:18.068951 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c604dd9a-0c63-4d8d-adb6-fe8b4024362c tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:26:18.069562 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-c5eca1c6-e417-4c2e-b269-9354d52e9f09 req-aefdde53-37b4-47a5-aa2f-e079a931375a service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:26:18.070068 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-c5eca1c6-e417-4c2e-b269-9354d52e9f09 req-aefdde53-37b4-47a5-aa2f-e079a931375a service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:26:18.070763 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c604dd9a-0c63-4d8d-adb6-fe8b4024362c tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:26:18.071243 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c604dd9a-0c63-4d8d-adb6-fe8b4024362c tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:26:18.073499 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c604dd9a-0c63-4d8d-adb6-fe8b4024362c tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:26:18.094503 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-c5eca1c6-e417-4c2e-b269-9354d52e9f09 req-aefdde53-37b4-47a5-aa2f-e079a931375a service nova] Creating event network-changed:7a7af606-e3b6-432d-8f3d-56cd8778503f for instance 86c50f3f-0621-4fa0-92b7-dd09127c1886 on nch2-master-1 Oct 08 21:26:18.104357 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-c5eca1c6-e417-4c2e-b269-9354d52e9f09 req-aefdde53-37b4-47a5-aa2f-e079a931375a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061035 Oct 08 21:26:18.105455 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2893/5859] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:26:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 08 21:26:18.109649 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-c604dd9a-0c63-4d8d-adb6-fe8b4024362c tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 86c50f3f-0621-4fa0-92b7-dd09127c1886] Going to try to terminate instance {{(pid=140492) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 21:26:18.210416 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-c604dd9a-0c63-4d8d-adb6-fe8b4024362c tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "DELETE /compute/v2.1/servers/86c50f3f-0621-4fa0-92b7-dd09127c1886" status: 204 len: 0 microversion: 2.1 time: 0.170953 Oct 08 21:26:18.217015 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2967/5860] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:26:18 2022] DELETE /compute/v2.1/servers/86c50f3f-0621-4fa0-92b7-dd09127c1886 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 21:26:18.222087 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-e98cba24-e3b6-427e-af4c-e8ec75b232d7 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:26:18.223109 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-e98cba24-e3b6-427e-af4c-e8ec75b232d7 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 86c50f3f-0621-4fa0-92b7-dd09127c1886] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:26:18.230052 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e98cba24-e3b6-427e-af4c-e8ec75b232d7 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:26:18.230658 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e98cba24-e3b6-427e-af4c-e8ec75b232d7 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:26:18.231609 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e98cba24-e3b6-427e-af4c-e8ec75b232d7 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:26:18.232391 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e98cba24-e3b6-427e-af4c-e8ec75b232d7 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:26:18.232977 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e98cba24-e3b6-427e-af4c-e8ec75b232d7 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:26:18.233620 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e98cba24-e3b6-427e-af4c-e8ec75b232d7 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:26:18.398673 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-e98cba24-e3b6-427e-af4c-e8ec75b232d7 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219a93945a147c4a57bb6452212fe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eeb6be960cc408296ecce6353b72f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:26:18.406823 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-e98cba24-e3b6-427e-af4c-e8ec75b232d7 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "GET /compute/v2.1/servers/86c50f3f-0621-4fa0-92b7-dd09127c1886" status: 200 len: 1688 microversion: 2.1 time: 0.190257 Oct 08 21:26:18.407985 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2894/5861] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:26:18 2022] GET /compute/v2.1/servers/86c50f3f-0621-4fa0-92b7-dd09127c1886 => generated 1688 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:26:19.431604 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e52f8fb6-9650-4577-ae59-3edfb4a36b15 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:26:19.432672 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-e52f8fb6-9650-4577-ae59-3edfb4a36b15 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 86c50f3f-0621-4fa0-92b7-dd09127c1886] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:26:19.440862 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e52f8fb6-9650-4577-ae59-3edfb4a36b15 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:26:19.441581 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e52f8fb6-9650-4577-ae59-3edfb4a36b15 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:26:19.442183 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e52f8fb6-9650-4577-ae59-3edfb4a36b15 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:26:19.443196 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e52f8fb6-9650-4577-ae59-3edfb4a36b15 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:26:19.443787 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e52f8fb6-9650-4577-ae59-3edfb4a36b15 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:26:19.444294 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e52f8fb6-9650-4577-ae59-3edfb4a36b15 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:26:19.786923 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-e52f8fb6-9650-4577-ae59-3edfb4a36b15 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219a93945a147c4a57bb6452212fe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eeb6be960cc408296ecce6353b72f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:26:19.796726 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-e52f8fb6-9650-4577-ae59-3edfb4a36b15 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "GET /compute/v2.1/servers/86c50f3f-0621-4fa0-92b7-dd09127c1886" status: 200 len: 1688 microversion: 2.1 time: 0.369521 Oct 08 21:26:19.811563 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2968/5862] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:26:19 2022] GET /compute/v2.1/servers/86c50f3f-0621-4fa0-92b7-dd09127c1886 => generated 1688 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:26:20.170452 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-364ac2b2-7a68-4a5a-8e66-ae0e2ba5001e req-71c0435d-2740-4032-ba61-daf5a5ec5948 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86c50f3f-0621-4fa0-92b7-dd09127c1886", "name": "network-vif-deleted", "tag": "7a7af606-e3b6-432d-8f3d-56cd8778503f"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:26:20.183322 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-364ac2b2-7a68-4a5a-8e66-ae0e2ba5001e req-71c0435d-2740-4032-ba61-daf5a5ec5948 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:26:20.183870 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-364ac2b2-7a68-4a5a-8e66-ae0e2ba5001e req-71c0435d-2740-4032-ba61-daf5a5ec5948 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:26:20.184258 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-364ac2b2-7a68-4a5a-8e66-ae0e2ba5001e req-71c0435d-2740-4032-ba61-daf5a5ec5948 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:26:20.197839 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-364ac2b2-7a68-4a5a-8e66-ae0e2ba5001e req-71c0435d-2740-4032-ba61-daf5a5ec5948 service nova] Creating event network-vif-deleted:7a7af606-e3b6-432d-8f3d-56cd8778503f for instance 86c50f3f-0621-4fa0-92b7-dd09127c1886 on nch2-master-1 Oct 08 21:26:20.202606 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-364ac2b2-7a68-4a5a-8e66-ae0e2ba5001e req-71c0435d-2740-4032-ba61-daf5a5ec5948 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036230 Oct 08 21:26:20.203210 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2895/5863] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:26:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:26:20.821155 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-6035df5d-cb11-40c5-9062-442feaba076a tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:26:20.821948 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-6035df5d-cb11-40c5-9062-442feaba076a tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 86c50f3f-0621-4fa0-92b7-dd09127c1886] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:26:20.829129 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6035df5d-cb11-40c5-9062-442feaba076a tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:26:20.829661 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6035df5d-cb11-40c5-9062-442feaba076a tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:26:20.830114 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6035df5d-cb11-40c5-9062-442feaba076a tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:26:20.830829 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6035df5d-cb11-40c5-9062-442feaba076a tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:26:20.831306 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6035df5d-cb11-40c5-9062-442feaba076a tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:26:20.831734 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6035df5d-cb11-40c5-9062-442feaba076a tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:26:20.845694 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-6035df5d-cb11-40c5-9062-442feaba076a tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] HTTP exception thrown: Instance 86c50f3f-0621-4fa0-92b7-dd09127c1886 could not be found. Oct 08 21:26:20.847348 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-6035df5d-cb11-40c5-9062-442feaba076a tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Request method failure captured: Oct 08 21:26:20.847348 ncdv-master-1 devstack@n-api.service[140492]: request: GET /compute/v2.1/servers/86c50f3f-0621-4fa0-92b7-dd09127c1886 HTTP/1.1 Oct 08 21:26:20.847348 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:26:20.847348 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:26:20.847348 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:26:20.847348 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 21:26:20.847348 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:26:20.847348 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:26:20.847348 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:26:20.847348 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:26:20.847348 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQep7EvEBtlUVHm2Z-xMUemo1fDuPodMx_QgvV--hhoE4MZz4OfLqVPlQBRPz5RXJ-HR4rz7JLlm8ih4Dn0GIB8br_D1WCF0uLTJeFZ1bD6SPHzzM0aO_EdLw0wg9AzNCfT-tNLgSCtS6oMoxL2RTAOI-_GcrcxStl7sgnRfFgr5x1Qs Oct 08 21:26:20.847348 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:26:20.847348 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:26:20.847348 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:26:20.847348 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:26:20.847348 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:26:20.847348 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:26:20.847348 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 3eeb6be960cc408296ecce6353b72f6d Oct 08 21:26:20.847348 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-651255446 Oct 08 21:26:20.847348 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:26:20.847348 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:26:20.847348 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3eeb6be960cc408296ecce6353b72f6d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3eeb6be960cc408296ecce6353b72f6d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3eeb6be960cc408296ecce6353b72f6d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3eeb6be960cc408296ecce6353b72f6d"}]}] Oct 08 21:26:20.847348 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-TestNetworkAdvancedServerOps-651255446 Oct 08 21:26:20.847348 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 3eeb6be960cc408296ecce6353b72f6d Oct 08 21:26:20.847348 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-651255446 Oct 08 21:26:20.847348 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-TestNetworkAdvancedServerOps-651255446-project Oct 08 21:26:20.847348 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:26:20.847348 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:26:20.847348 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 8219a93945a147c4a57bb6452212fe7c Oct 08 21:26:20.847348 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-TestNetworkAdvancedServerOps-651255446-project Oct 08 21:26:20.847348 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 21:26:20.847348 ncdv-master-1 devstack@n-api.service[140492]: exception: Instance 86c50f3f-0621-4fa0-92b7-dd09127c1886 could not be found. Oct 08 21:26:20.847348 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': '86c50f3f-0621-4fa0-92b7-dd09127c1886'} Oct 08 21:26:20.847348 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:26:20.847348 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:26:20.847348 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:26:20.847348 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:26:20.847348 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:26:20.847348 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:26:20.847348 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:26:20.847348 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:26:20.847348 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:26:20.847348 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:26:20.847348 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86c50f3f-0621-4fa0-92b7-dd09127c1886 could not be found. Oct 08 21:26:20.847348 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:26:20.847348 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:26:20.847348 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:26:20.847348 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:26:20.847348 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:26:20.847348 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:26:20.847348 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:26:20.847348 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:26:20.847348 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:26:20.847348 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:26:20.847348 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:26:20.847348 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:26:20.847348 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:26:20.847348 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:26:20.847348 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:26:20.847348 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:26:20.847348 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86c50f3f-0621-4fa0-92b7-dd09127c1886 could not be found. Oct 08 21:26:20.847348 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:26:20.847348 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:26:20.851978 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:26:20.851978 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:26:20.851978 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:26:20.851978 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:26:20.851978 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:26:20.851978 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:26:20.851978 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86c50f3f-0621-4fa0-92b7-dd09127c1886 could not be found. Oct 08 21:26:20.851978 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:26:20.851978 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-6035df5d-cb11-40c5-9062-442feaba076a tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Returning 404 to user: Instance 86c50f3f-0621-4fa0-92b7-dd09127c1886 could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:26:20.851978 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-6035df5d-cb11-40c5-9062-442feaba076a tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "GET /compute/v2.1/servers/86c50f3f-0621-4fa0-92b7-dd09127c1886" status: 404 len: 111 microversion: 2.1 time: 0.031490 Oct 08 21:26:20.851978 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2969/5864] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:26:20 2022] GET /compute/v2.1/servers/86c50f3f-0621-4fa0-92b7-dd09127c1886 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:26:24.605874 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-58708581-1cae-4ab9-af6f-eb705e1535cf tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Calling method '.version_select at 0x7f1a875e4a60>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:26:24.658328 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-58708581-1cae-4ab9-af6f-eb705e1535cf tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-621859771" status: 202 len: 0 microversion: 2.1 time: 0.066089 Oct 08 21:26:24.659351 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2896/5865] 10.222.0.26 () {58 vars in 1281 bytes} [Sat Oct 8 21:26:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-621859771 => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 21:26:24.691576 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-512f44a3-040e-451d-bde1-9cf18dda21f0 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Action: 'create', calling method: .version_select at 0x7f1a87cef790>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1537072806", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH3rtvLQQ6Js3PWKVmU3cFiCtlRaxNHz7P4h0emhf3n9r6gnAeMf889Zb8B4O6N8wYLu6Tf1NczuJae0dhXijVrViBhWkAvNA+wqb14+7msmopragJ5xPZbBNjTr+uxNLg=="}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:26:24.708510 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-512f44a3-040e-451d-bde1-9cf18dda21f0 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Getting quotas for project 3eeb6be960cc408296ecce6353b72f6d. Resources: {'key_pairs'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:26:24.715449 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-512f44a3-040e-451d-bde1-9cf18dda21f0 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Getting quotas for user 8219a93945a147c4a57bb6452212fe7c and project 3eeb6be960cc408296ecce6353b72f6d. Resources: {'key_pairs'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:26:24.741289 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-512f44a3-040e-451d-bde1-9cf18dda21f0 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.053589 Oct 08 21:26:24.741901 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2970/5866] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Oct 8 21:26:24 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:26:32.896428 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=16 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:26:32.903165 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-2f6af000-214f-48e6-933d-70d3598b290c tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-753035031", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "networks": [{"uuid": "4852499a-e610-4e6a-953e-71b500a585b4"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1537072806", "security_groups": [{"name": "tempest-secgroup-smoke-455896968"}]}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:26:33.050100 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.network.neutron [None req-2f6af000-214f-48e6-933d-70d3598b290c tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] validate_networks() for [('4852499a-e610-4e6a-953e-71b500a585b4', None, None, None, None, None)] {{(pid=140491) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 21:26:33.641491 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-2f6af000-214f-48e6-933d-70d3598b290c tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Flavor limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 21:26:33.642253 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-2f6af000-214f-48e6-933d-70d3598b290c tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Image limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 21:26:33.643036 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-2f6af000-214f-48e6-933d-70d3598b290c tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Flavor pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 21:26:33.643681 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-2f6af000-214f-48e6-933d-70d3598b290c tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Image pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 21:26:33.644330 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-2f6af000-214f-48e6-933d-70d3598b290c tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 21:26:33.659229 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2f6af000-214f-48e6-933d-70d3598b290c tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:26:33.660093 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2f6af000-214f-48e6-933d-70d3598b290c tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:26:33.660777 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2f6af000-214f-48e6-933d-70d3598b290c tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:26:33.662102 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2f6af000-214f-48e6-933d-70d3598b290c tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:26:33.662817 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2f6af000-214f-48e6-933d-70d3598b290c tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:26:33.663577 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2f6af000-214f-48e6-933d-70d3598b290c tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:26:33.690247 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-2f6af000-214f-48e6-933d-70d3598b290c tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Getting quotas for project 3eeb6be960cc408296ecce6353b72f6d. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:26:33.697531 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-2f6af000-214f-48e6-933d-70d3598b290c tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Getting quotas for user 8219a93945a147c4a57bb6452212fe7c and project 3eeb6be960cc408296ecce6353b72f6d. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:26:33.714276 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-2f6af000-214f-48e6-933d-70d3598b290c tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Going to run 1 instances... {{(pid=140491) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 21:26:33.717366 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-2f6af000-214f-48e6-933d-70d3598b290c tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 7b14670a-d0c7-4eae-b840-062a79fbd06a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c508bd7f-7db9-4b2c-af7c-be54a855c355',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140491) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 21:26:33.785080 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-2f6af000-214f-48e6-933d-70d3598b290c tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.891931 Oct 08 21:26:33.787372 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2897/5867] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 21:26:32 2022] POST /compute/v2.1/servers => generated 405 bytes in 894 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 08 21:26:33.796062 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:26:33.801664 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-b5ccb6c2-c9e1-4fef-816d-66a9131aa506 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:26:33.802677 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-b5ccb6c2-c9e1-4fef-816d-66a9131aa506 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 7b14670a-d0c7-4eae-b840-062a79fbd06a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:26:34.000838 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-b5ccb6c2-c9e1-4fef-816d-66a9131aa506 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219a93945a147c4a57bb6452212fe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eeb6be960cc408296ecce6353b72f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:26:34.010121 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-b5ccb6c2-c9e1-4fef-816d-66a9131aa506 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "GET /compute/v2.1/servers/7b14670a-d0c7-4eae-b840-062a79fbd06a" status: 200 len: 1266 microversion: 2.1 time: 0.215935 Oct 08 21:26:34.029999 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2971/5868] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:26:33 2022] GET /compute/v2.1/servers/7b14670a-d0c7-4eae-b840-062a79fbd06a => generated 1266 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:26:35.042363 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-4ff086fe-eee4-4bab-994f-012977e8bcb0 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:26:35.043606 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-4ff086fe-eee4-4bab-994f-012977e8bcb0 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 7b14670a-d0c7-4eae-b840-062a79fbd06a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:26:35.051770 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4ff086fe-eee4-4bab-994f-012977e8bcb0 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:26:35.052290 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4ff086fe-eee4-4bab-994f-012977e8bcb0 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:26:35.052747 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4ff086fe-eee4-4bab-994f-012977e8bcb0 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:26:35.053510 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4ff086fe-eee4-4bab-994f-012977e8bcb0 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:26:35.054075 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4ff086fe-eee4-4bab-994f-012977e8bcb0 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:26:35.054538 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4ff086fe-eee4-4bab-994f-012977e8bcb0 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:26:35.215033 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-4ff086fe-eee4-4bab-994f-012977e8bcb0 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219a93945a147c4a57bb6452212fe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eeb6be960cc408296ecce6353b72f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:26:35.229362 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-4ff086fe-eee4-4bab-994f-012977e8bcb0 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "GET /compute/v2.1/servers/7b14670a-d0c7-4eae-b840-062a79fbd06a" status: 200 len: 1326 microversion: 2.1 time: 0.194793 Oct 08 21:26:35.230410 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2898/5869] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:26:35 2022] GET /compute/v2.1/servers/7b14670a-d0c7-4eae-b840-062a79fbd06a => generated 1326 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:26:36.254141 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-626f8d43-8582-4eed-a96d-f9a794da096a tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:26:36.254814 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-626f8d43-8582-4eed-a96d-f9a794da096a tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 7b14670a-d0c7-4eae-b840-062a79fbd06a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:26:36.262622 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-626f8d43-8582-4eed-a96d-f9a794da096a tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:26:36.263400 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-626f8d43-8582-4eed-a96d-f9a794da096a tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:26:36.264077 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-626f8d43-8582-4eed-a96d-f9a794da096a tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:26:36.265022 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-626f8d43-8582-4eed-a96d-f9a794da096a tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:26:36.265706 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-626f8d43-8582-4eed-a96d-f9a794da096a tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:26:36.266346 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-626f8d43-8582-4eed-a96d-f9a794da096a tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:26:36.586188 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-626f8d43-8582-4eed-a96d-f9a794da096a tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219a93945a147c4a57bb6452212fe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eeb6be960cc408296ecce6353b72f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:26:36.594195 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-626f8d43-8582-4eed-a96d-f9a794da096a tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "GET /compute/v2.1/servers/7b14670a-d0c7-4eae-b840-062a79fbd06a" status: 200 len: 1391 microversion: 2.1 time: 0.344588 Oct 08 21:26:36.594896 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2972/5870] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:26:36 2022] GET /compute/v2.1/servers/7b14670a-d0c7-4eae-b840-062a79fbd06a => generated 1391 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:26:37.311794 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-22e1870e-976d-4567-8c8e-89c7316d9518 req-ad362c34-a93f-403b-a4da-866e7c0f4b3b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b14670a-d0c7-4eae-b840-062a79fbd06a", "tag": "97ae22d5-6b77-4de4-8076-53c65d74c4d7"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:26:37.324880 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-22e1870e-976d-4567-8c8e-89c7316d9518 req-ad362c34-a93f-403b-a4da-866e7c0f4b3b service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:26:37.325401 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-22e1870e-976d-4567-8c8e-89c7316d9518 req-ad362c34-a93f-403b-a4da-866e7c0f4b3b service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:26:37.325846 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-22e1870e-976d-4567-8c8e-89c7316d9518 req-ad362c34-a93f-403b-a4da-866e7c0f4b3b service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:26:37.338152 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-22e1870e-976d-4567-8c8e-89c7316d9518 req-ad362c34-a93f-403b-a4da-866e7c0f4b3b service nova] Creating event network-changed:97ae22d5-6b77-4de4-8076-53c65d74c4d7 for instance 7b14670a-d0c7-4eae-b840-062a79fbd06a on nch1-master-1 Oct 08 21:26:37.343233 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-22e1870e-976d-4567-8c8e-89c7316d9518 req-ad362c34-a93f-403b-a4da-866e7c0f4b3b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035037 Oct 08 21:26:37.344142 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2899/5871] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:26:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:26:37.619339 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-8326ff32-bc9d-435c-a0f7-eced24a19ee4 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:26:37.619888 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-8326ff32-bc9d-435c-a0f7-eced24a19ee4 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 7b14670a-d0c7-4eae-b840-062a79fbd06a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:26:37.626853 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8326ff32-bc9d-435c-a0f7-eced24a19ee4 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:26:37.627408 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8326ff32-bc9d-435c-a0f7-eced24a19ee4 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:26:37.627857 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8326ff32-bc9d-435c-a0f7-eced24a19ee4 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:26:37.628586 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8326ff32-bc9d-435c-a0f7-eced24a19ee4 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:26:37.629054 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8326ff32-bc9d-435c-a0f7-eced24a19ee4 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:26:37.629524 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8326ff32-bc9d-435c-a0f7-eced24a19ee4 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:26:37.942033 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-8326ff32-bc9d-435c-a0f7-eced24a19ee4 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219a93945a147c4a57bb6452212fe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eeb6be960cc408296ecce6353b72f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:26:37.950712 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-8326ff32-bc9d-435c-a0f7-eced24a19ee4 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "GET /compute/v2.1/servers/7b14670a-d0c7-4eae-b840-062a79fbd06a" status: 200 len: 1391 microversion: 2.1 time: 0.335929 Oct 08 21:26:37.965519 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2973/5872] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:26:37 2022] GET /compute/v2.1/servers/7b14670a-d0c7-4eae-b840-062a79fbd06a => generated 1391 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:26:38.975823 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-4c41dc72-9c7b-4ec4-920e-49d160547e06 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:26:38.977830 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-4c41dc72-9c7b-4ec4-920e-49d160547e06 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 7b14670a-d0c7-4eae-b840-062a79fbd06a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:26:38.987096 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4c41dc72-9c7b-4ec4-920e-49d160547e06 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:26:38.987591 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4c41dc72-9c7b-4ec4-920e-49d160547e06 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:26:38.988235 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4c41dc72-9c7b-4ec4-920e-49d160547e06 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:26:38.989148 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4c41dc72-9c7b-4ec4-920e-49d160547e06 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:26:38.989637 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4c41dc72-9c7b-4ec4-920e-49d160547e06 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:26:38.990075 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4c41dc72-9c7b-4ec4-920e-49d160547e06 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:26:39.226885 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-4c41dc72-9c7b-4ec4-920e-49d160547e06 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219a93945a147c4a57bb6452212fe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eeb6be960cc408296ecce6353b72f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:26:39.235263 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-4c41dc72-9c7b-4ec4-920e-49d160547e06 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "GET /compute/v2.1/servers/7b14670a-d0c7-4eae-b840-062a79fbd06a" status: 200 len: 1391 microversion: 2.1 time: 0.264462 Oct 08 21:26:39.235944 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2900/5873] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:26:38 2022] GET /compute/v2.1/servers/7b14670a-d0c7-4eae-b840-062a79fbd06a => generated 1391 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:26:40.258057 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e216940c-384c-4bf8-a80c-8c3fa87de976 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:26:40.258737 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-e216940c-384c-4bf8-a80c-8c3fa87de976 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 7b14670a-d0c7-4eae-b840-062a79fbd06a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:26:40.265729 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e216940c-384c-4bf8-a80c-8c3fa87de976 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:26:40.266232 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e216940c-384c-4bf8-a80c-8c3fa87de976 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:26:40.266687 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e216940c-384c-4bf8-a80c-8c3fa87de976 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:26:40.267445 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e216940c-384c-4bf8-a80c-8c3fa87de976 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:26:40.267915 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e216940c-384c-4bf8-a80c-8c3fa87de976 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:26:40.268349 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e216940c-384c-4bf8-a80c-8c3fa87de976 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:26:40.430805 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-e216940c-384c-4bf8-a80c-8c3fa87de976 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219a93945a147c4a57bb6452212fe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eeb6be960cc408296ecce6353b72f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:26:40.439168 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-e216940c-384c-4bf8-a80c-8c3fa87de976 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "GET /compute/v2.1/servers/7b14670a-d0c7-4eae-b840-062a79fbd06a" status: 200 len: 1391 microversion: 2.1 time: 0.185066 Oct 08 21:26:40.439757 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2974/5874] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:26:40 2022] GET /compute/v2.1/servers/7b14670a-d0c7-4eae-b840-062a79fbd06a => generated 1391 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:26:41.462738 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-84cbfa05-bcca-4c77-addd-80a00b7b383f tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:26:41.463477 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-84cbfa05-bcca-4c77-addd-80a00b7b383f tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 7b14670a-d0c7-4eae-b840-062a79fbd06a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:26:41.470453 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-84cbfa05-bcca-4c77-addd-80a00b7b383f tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:26:41.470972 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-84cbfa05-bcca-4c77-addd-80a00b7b383f tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:26:41.471512 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-84cbfa05-bcca-4c77-addd-80a00b7b383f tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:26:41.472292 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-84cbfa05-bcca-4c77-addd-80a00b7b383f tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:26:41.472832 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-84cbfa05-bcca-4c77-addd-80a00b7b383f tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:26:41.473399 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-84cbfa05-bcca-4c77-addd-80a00b7b383f tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:26:41.680808 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-84cbfa05-bcca-4c77-addd-80a00b7b383f tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219a93945a147c4a57bb6452212fe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eeb6be960cc408296ecce6353b72f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:26:41.689480 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-84cbfa05-bcca-4c77-addd-80a00b7b383f tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "GET /compute/v2.1/servers/7b14670a-d0c7-4eae-b840-062a79fbd06a" status: 200 len: 1391 microversion: 2.1 time: 0.230731 Oct 08 21:26:41.701475 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2901/5875] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:26:41 2022] GET /compute/v2.1/servers/7b14670a-d0c7-4eae-b840-062a79fbd06a => generated 1391 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:26:42.517489 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-eeaa8706-d60b-4de0-aee6-c05b1420cc83 req-1037c232-bf9d-4f86-8018-e2b148825e61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b14670a-d0c7-4eae-b840-062a79fbd06a", "name": "network-vif-plugged", "status": "completed", "tag": "97ae22d5-6b77-4de4-8076-53c65d74c4d7"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:26:42.524861 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:26:42.530699 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-eeaa8706-d60b-4de0-aee6-c05b1420cc83 req-1037c232-bf9d-4f86-8018-e2b148825e61 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:26:42.531192 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-eeaa8706-d60b-4de0-aee6-c05b1420cc83 req-1037c232-bf9d-4f86-8018-e2b148825e61 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:26:42.531668 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-eeaa8706-d60b-4de0-aee6-c05b1420cc83 req-1037c232-bf9d-4f86-8018-e2b148825e61 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:26:42.544880 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-eeaa8706-d60b-4de0-aee6-c05b1420cc83 req-1037c232-bf9d-4f86-8018-e2b148825e61 service nova] Creating event network-vif-plugged:97ae22d5-6b77-4de4-8076-53c65d74c4d7 for instance 7b14670a-d0c7-4eae-b840-062a79fbd06a on nch1-master-1 Oct 08 21:26:42.550484 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-eeaa8706-d60b-4de0-aee6-c05b1420cc83 req-1037c232-bf9d-4f86-8018-e2b148825e61 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036690 Oct 08 21:26:42.551335 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2975/5876] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:26:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 08 21:26:42.714702 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-7c996b84-022b-4872-908c-cd3166c98956 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:26:42.715475 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-7c996b84-022b-4872-908c-cd3166c98956 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 7b14670a-d0c7-4eae-b840-062a79fbd06a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:26:42.724337 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7c996b84-022b-4872-908c-cd3166c98956 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:26:42.725326 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7c996b84-022b-4872-908c-cd3166c98956 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:26:42.726017 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7c996b84-022b-4872-908c-cd3166c98956 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:26:42.726955 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7c996b84-022b-4872-908c-cd3166c98956 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:26:42.727742 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7c996b84-022b-4872-908c-cd3166c98956 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:26:42.728248 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7c996b84-022b-4872-908c-cd3166c98956 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:26:42.896961 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-7c996b84-022b-4872-908c-cd3166c98956 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219a93945a147c4a57bb6452212fe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eeb6be960cc408296ecce6353b72f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:26:42.905375 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-7c996b84-022b-4872-908c-cd3166c98956 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "GET /compute/v2.1/servers/7b14670a-d0c7-4eae-b840-062a79fbd06a" status: 200 len: 1391 microversion: 2.1 time: 0.195749 Oct 08 21:26:42.905984 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2902/5877] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:26:42 2022] GET /compute/v2.1/servers/7b14670a-d0c7-4eae-b840-062a79fbd06a => generated 1391 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:26:43.929980 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-61da9f83-851e-4d06-ab36-5cb45dccab07 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:26:43.930827 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-61da9f83-851e-4d06-ab36-5cb45dccab07 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 7b14670a-d0c7-4eae-b840-062a79fbd06a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:26:43.937731 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-61da9f83-851e-4d06-ab36-5cb45dccab07 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:26:43.938320 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-61da9f83-851e-4d06-ab36-5cb45dccab07 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:26:43.938845 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-61da9f83-851e-4d06-ab36-5cb45dccab07 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:26:43.939640 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-61da9f83-851e-4d06-ab36-5cb45dccab07 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:26:43.940180 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-61da9f83-851e-4d06-ab36-5cb45dccab07 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:26:43.940689 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-61da9f83-851e-4d06-ab36-5cb45dccab07 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:26:44.005963 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=6 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:26:44.115396 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-61da9f83-851e-4d06-ab36-5cb45dccab07 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219a93945a147c4a57bb6452212fe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eeb6be960cc408296ecce6353b72f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:26:44.123570 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-61da9f83-851e-4d06-ab36-5cb45dccab07 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "GET /compute/v2.1/servers/7b14670a-d0c7-4eae-b840-062a79fbd06a" status: 200 len: 1391 microversion: 2.1 time: 0.199302 Oct 08 21:26:44.124164 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2976/5878] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:26:43 2022] GET /compute/v2.1/servers/7b14670a-d0c7-4eae-b840-062a79fbd06a => generated 1391 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:26:45.147969 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-8c287d4f-0469-40c7-9374-edc8b336f474 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:26:45.148671 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-8c287d4f-0469-40c7-9374-edc8b336f474 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 7b14670a-d0c7-4eae-b840-062a79fbd06a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:26:45.152246 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=2 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:26:45.153166 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=6 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:26:45.163254 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8c287d4f-0469-40c7-9374-edc8b336f474 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:26:45.163760 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8c287d4f-0469-40c7-9374-edc8b336f474 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:26:45.164203 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8c287d4f-0469-40c7-9374-edc8b336f474 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:26:45.165519 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8c287d4f-0469-40c7-9374-edc8b336f474 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:26:45.165989 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8c287d4f-0469-40c7-9374-edc8b336f474 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:26:45.166419 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8c287d4f-0469-40c7-9374-edc8b336f474 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:26:45.306119 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-8c287d4f-0469-40c7-9374-edc8b336f474 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219a93945a147c4a57bb6452212fe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eeb6be960cc408296ecce6353b72f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:26:45.314230 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-8c287d4f-0469-40c7-9374-edc8b336f474 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "GET /compute/v2.1/servers/7b14670a-d0c7-4eae-b840-062a79fbd06a" status: 200 len: 1563 microversion: 2.1 time: 0.170043 Oct 08 21:26:45.314738 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2903/5879] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:26:45 2022] GET /compute/v2.1/servers/7b14670a-d0c7-4eae-b840-062a79fbd06a => generated 1563 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:26:45.337014 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-c7fd3ec0-a305-47d0-8825-ca40c6d60dd8 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:26:45.337772 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-c7fd3ec0-a305-47d0-8825-ca40c6d60dd8 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 7b14670a-d0c7-4eae-b840-062a79fbd06a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:26:45.344864 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c7fd3ec0-a305-47d0-8825-ca40c6d60dd8 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:26:45.345413 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c7fd3ec0-a305-47d0-8825-ca40c6d60dd8 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:26:45.345869 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c7fd3ec0-a305-47d0-8825-ca40c6d60dd8 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:26:45.346593 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c7fd3ec0-a305-47d0-8825-ca40c6d60dd8 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:26:45.347061 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c7fd3ec0-a305-47d0-8825-ca40c6d60dd8 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:26:45.347509 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c7fd3ec0-a305-47d0-8825-ca40c6d60dd8 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:26:45.505716 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-c7fd3ec0-a305-47d0-8825-ca40c6d60dd8 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219a93945a147c4a57bb6452212fe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eeb6be960cc408296ecce6353b72f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:26:45.513409 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-c7fd3ec0-a305-47d0-8825-ca40c6d60dd8 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "GET /compute/v2.1/servers/7b14670a-d0c7-4eae-b840-062a79fbd06a" status: 200 len: 1563 microversion: 2.1 time: 0.180190 Oct 08 21:26:45.513996 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2977/5880] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:26:45 2022] GET /compute/v2.1/servers/7b14670a-d0c7-4eae-b840-062a79fbd06a => generated 1563 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:26:47.523908 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-ac086a9a-2e2b-460c-ba68-2375287ee98e req-0592d058-0f6d-4839-a175-66f65110e944 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b14670a-d0c7-4eae-b840-062a79fbd06a", "tag": "97ae22d5-6b77-4de4-8076-53c65d74c4d7"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:26:47.529517 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-2ddee51a-0ce6-4bc4-8239-d1dfcb38c5e2 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:26:47.530252 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-2ddee51a-0ce6-4bc4-8239-d1dfcb38c5e2 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 7b14670a-d0c7-4eae-b840-062a79fbd06a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:26:47.534061 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:SELECT=39,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:26:47.541044 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2ddee51a-0ce6-4bc4-8239-d1dfcb38c5e2 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:26:47.541572 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2ddee51a-0ce6-4bc4-8239-d1dfcb38c5e2 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:26:47.544572 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-ac086a9a-2e2b-460c-ba68-2375287ee98e req-0592d058-0f6d-4839-a175-66f65110e944 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:26:47.545877 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-ac086a9a-2e2b-460c-ba68-2375287ee98e req-0592d058-0f6d-4839-a175-66f65110e944 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:26:47.546148 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2ddee51a-0ce6-4bc4-8239-d1dfcb38c5e2 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:26:47.547041 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-ac086a9a-2e2b-460c-ba68-2375287ee98e req-0592d058-0f6d-4839-a175-66f65110e944 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:26:47.547900 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2ddee51a-0ce6-4bc4-8239-d1dfcb38c5e2 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:26:47.549730 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2ddee51a-0ce6-4bc4-8239-d1dfcb38c5e2 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:26:47.550351 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2ddee51a-0ce6-4bc4-8239-d1dfcb38c5e2 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:26:47.578215 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-ac086a9a-2e2b-460c-ba68-2375287ee98e req-0592d058-0f6d-4839-a175-66f65110e944 service nova] Creating event network-changed:97ae22d5-6b77-4de4-8076-53c65d74c4d7 for instance 7b14670a-d0c7-4eae-b840-062a79fbd06a on nch1-master-1 Oct 08 21:26:47.583464 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-ac086a9a-2e2b-460c-ba68-2375287ee98e req-0592d058-0f6d-4839-a175-66f65110e944 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064488 Oct 08 21:26:47.584073 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2978/5881] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:26:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:26:47.774605 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-2ddee51a-0ce6-4bc4-8239-d1dfcb38c5e2 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219a93945a147c4a57bb6452212fe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eeb6be960cc408296ecce6353b72f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:26:47.783214 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-2ddee51a-0ce6-4bc4-8239-d1dfcb38c5e2 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "GET /compute/v2.1/servers/7b14670a-d0c7-4eae-b840-062a79fbd06a" status: 200 len: 1563 microversion: 2.1 time: 0.271004 Oct 08 21:26:47.783965 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2904/5882] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:26:47 2022] GET /compute/v2.1/servers/7b14670a-d0c7-4eae-b840-062a79fbd06a => generated 1563 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:27:11.081375 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-107ec193-25a0-4ab8-a882-01b076a83073 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:27:11.083608 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-107ec193-25a0-4ab8-a882-01b076a83073 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 7b14670a-d0c7-4eae-b840-062a79fbd06a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:27:11.085941 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=7 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:27:11.086597 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=34 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:27:11.094119 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-107ec193-25a0-4ab8-a882-01b076a83073 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:27:11.094617 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-107ec193-25a0-4ab8-a882-01b076a83073 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:27:11.095062 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-107ec193-25a0-4ab8-a882-01b076a83073 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:27:11.095761 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-107ec193-25a0-4ab8-a882-01b076a83073 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:27:11.096223 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-107ec193-25a0-4ab8-a882-01b076a83073 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:27:11.096654 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-107ec193-25a0-4ab8-a882-01b076a83073 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:27:11.151057 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-107ec193-25a0-4ab8-a882-01b076a83073 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "POST /compute/v2.1/servers/7b14670a-d0c7-4eae-b840-062a79fbd06a/action" status: 200 len: 24558 microversion: 2.1 time: 0.074131 Oct 08 21:27:11.151753 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2979/5883] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:27:11 2022] POST /compute/v2.1/servers/7b14670a-d0c7-4eae-b840-062a79fbd06a/action => generated 24558 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 08 21:27:22.148496 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-32c5b20c-52ea-44de-a8ab-98a66e4131e2 tempest-TestNetworkAdvancedServerOps-1736509213 tempest-TestNetworkAdvancedServerOps-1736509213-project-admin] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:27:22.149116 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-32c5b20c-52ea-44de-a8ab-98a66e4131e2 tempest-TestNetworkAdvancedServerOps-1736509213 tempest-TestNetworkAdvancedServerOps-1736509213-project-admin] [instance: 7b14670a-d0c7-4eae-b840-062a79fbd06a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:27:22.151254 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:SELECT=1 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:27:22.152172 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=40 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:27:22.159997 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-32c5b20c-52ea-44de-a8ab-98a66e4131e2 tempest-TestNetworkAdvancedServerOps-1736509213 tempest-TestNetworkAdvancedServerOps-1736509213-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:27:22.160493 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-32c5b20c-52ea-44de-a8ab-98a66e4131e2 tempest-TestNetworkAdvancedServerOps-1736509213 tempest-TestNetworkAdvancedServerOps-1736509213-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:27:22.160938 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-32c5b20c-52ea-44de-a8ab-98a66e4131e2 tempest-TestNetworkAdvancedServerOps-1736509213 tempest-TestNetworkAdvancedServerOps-1736509213-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:27:22.161677 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-32c5b20c-52ea-44de-a8ab-98a66e4131e2 tempest-TestNetworkAdvancedServerOps-1736509213 tempest-TestNetworkAdvancedServerOps-1736509213-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:27:22.162143 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-32c5b20c-52ea-44de-a8ab-98a66e4131e2 tempest-TestNetworkAdvancedServerOps-1736509213 tempest-TestNetworkAdvancedServerOps-1736509213-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:27:22.162594 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-32c5b20c-52ea-44de-a8ab-98a66e4131e2 tempest-TestNetworkAdvancedServerOps-1736509213 tempest-TestNetworkAdvancedServerOps-1736509213-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:27:22.484634 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-32c5b20c-52ea-44de-a8ab-98a66e4131e2 tempest-TestNetworkAdvancedServerOps-1736509213 tempest-TestNetworkAdvancedServerOps-1736509213-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/7b14670a-d0c7-4eae-b840-062a79fbd06a" status: 200 len: 1833 microversion: 2.1 time: 0.340144 Oct 08 21:27:22.501721 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2905/5884] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:27:22 2022] GET /compute/v2.1/servers/7b14670a-d0c7-4eae-b840-062a79fbd06a => generated 1833 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:27:22.509650 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-7b34fd50-a53f-4fe9-bcaf-43c87d27f0c7 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:27:22.510378 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-7b34fd50-a53f-4fe9-bcaf-43c87d27f0c7 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 7b14670a-d0c7-4eae-b840-062a79fbd06a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:27:22.514258 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=2 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:27:22.514978 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=4 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:27:22.521873 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7b34fd50-a53f-4fe9-bcaf-43c87d27f0c7 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:27:22.522640 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7b34fd50-a53f-4fe9-bcaf-43c87d27f0c7 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:27:22.523104 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7b34fd50-a53f-4fe9-bcaf-43c87d27f0c7 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:27:22.523865 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7b34fd50-a53f-4fe9-bcaf-43c87d27f0c7 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:27:22.524346 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7b34fd50-a53f-4fe9-bcaf-43c87d27f0c7 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:27:22.524789 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7b34fd50-a53f-4fe9-bcaf-43c87d27f0c7 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:27:22.742939 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-7b34fd50-a53f-4fe9-bcaf-43c87d27f0c7 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219a93945a147c4a57bb6452212fe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eeb6be960cc408296ecce6353b72f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:27:22.751484 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-7b34fd50-a53f-4fe9-bcaf-43c87d27f0c7 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "GET /compute/v2.1/servers/7b14670a-d0c7-4eae-b840-062a79fbd06a" status: 200 len: 1682 microversion: 2.1 time: 0.246719 Oct 08 21:27:22.752117 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2980/5885] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:27:22 2022] GET /compute/v2.1/servers/7b14670a-d0c7-4eae-b840-062a79fbd06a => generated 1682 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:27:22.851177 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c55e8f40-75a7-4bfb-bc9a-0a721d05ff27 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:27:22.853472 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-c55e8f40-75a7-4bfb-bc9a-0a721d05ff27 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 7b14670a-d0c7-4eae-b840-062a79fbd06a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:27:22.860244 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c55e8f40-75a7-4bfb-bc9a-0a721d05ff27 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:27:22.860747 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c55e8f40-75a7-4bfb-bc9a-0a721d05ff27 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:27:22.861181 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c55e8f40-75a7-4bfb-bc9a-0a721d05ff27 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:27:22.861924 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c55e8f40-75a7-4bfb-bc9a-0a721d05ff27 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:27:22.862375 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c55e8f40-75a7-4bfb-bc9a-0a721d05ff27 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:27:22.862984 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c55e8f40-75a7-4bfb-bc9a-0a721d05ff27 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:27:22.916601 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-c55e8f40-75a7-4bfb-bc9a-0a721d05ff27 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "POST /compute/v2.1/servers/7b14670a-d0c7-4eae-b840-062a79fbd06a/action" status: 200 len: 32621 microversion: 2.1 time: 0.069220 Oct 08 21:27:22.917504 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2906/5886] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:27:22 2022] POST /compute/v2.1/servers/7b14670a-d0c7-4eae-b840-062a79fbd06a/action => generated 32621 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 08 21:27:23.069396 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-a87cefaa-cb3b-4a73-b40b-13cc2f039dbe tempest-TestNetworkAdvancedServerOps-1736509213 tempest-TestNetworkAdvancedServerOps-1736509213-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:27:23.070273 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-a87cefaa-cb3b-4a73-b40b-13cc2f039dbe tempest-TestNetworkAdvancedServerOps-1736509213 tempest-TestNetworkAdvancedServerOps-1736509213-project-admin] [instance: 7b14670a-d0c7-4eae-b840-062a79fbd06a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:27:23.076955 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a87cefaa-cb3b-4a73-b40b-13cc2f039dbe tempest-TestNetworkAdvancedServerOps-1736509213 tempest-TestNetworkAdvancedServerOps-1736509213-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:27:23.077508 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a87cefaa-cb3b-4a73-b40b-13cc2f039dbe tempest-TestNetworkAdvancedServerOps-1736509213 tempest-TestNetworkAdvancedServerOps-1736509213-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:27:23.077957 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a87cefaa-cb3b-4a73-b40b-13cc2f039dbe tempest-TestNetworkAdvancedServerOps-1736509213 tempest-TestNetworkAdvancedServerOps-1736509213-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:27:23.078667 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a87cefaa-cb3b-4a73-b40b-13cc2f039dbe tempest-TestNetworkAdvancedServerOps-1736509213 tempest-TestNetworkAdvancedServerOps-1736509213-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:27:23.079132 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a87cefaa-cb3b-4a73-b40b-13cc2f039dbe tempest-TestNetworkAdvancedServerOps-1736509213 tempest-TestNetworkAdvancedServerOps-1736509213-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:27:23.079565 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a87cefaa-cb3b-4a73-b40b-13cc2f039dbe tempest-TestNetworkAdvancedServerOps-1736509213 tempest-TestNetworkAdvancedServerOps-1736509213-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:27:23.107657 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-a87cefaa-cb3b-4a73-b40b-13cc2f039dbe tempest-TestNetworkAdvancedServerOps-1736509213 tempest-TestNetworkAdvancedServerOps-1736509213-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'a691762d84b24f50926fa20dfc4d4ad9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3661b4b41b604beea175732bb476f4a7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:27:23.108539 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-a87cefaa-cb3b-4a73-b40b-13cc2f039dbe tempest-TestNetworkAdvancedServerOps-1736509213 tempest-TestNetworkAdvancedServerOps-1736509213-project-admin] [instance: 7b14670a-d0c7-4eae-b840-062a79fbd06a] flavor_id is None. Assuming migration. {{(pid=140492) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 08 21:27:23.108997 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-a87cefaa-cb3b-4a73-b40b-13cc2f039dbe tempest-TestNetworkAdvancedServerOps-1736509213 tempest-TestNetworkAdvancedServerOps-1736509213-project-admin] [instance: 7b14670a-d0c7-4eae-b840-062a79fbd06a] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=140492) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 08 21:27:23.428120 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-a87cefaa-cb3b-4a73-b40b-13cc2f039dbe tempest-TestNetworkAdvancedServerOps-1736509213 tempest-TestNetworkAdvancedServerOps-1736509213-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/7b14670a-d0c7-4eae-b840-062a79fbd06a/action" status: 202 len: 0 microversion: 2.1 time: 0.362557 Oct 08 21:27:23.428863 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2981/5887] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:27:23 2022] POST /compute/v2.1/servers/7b14670a-d0c7-4eae-b840-062a79fbd06a/action => generated 0 bytes in 364 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 21:27:23.438821 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-3a118958-59a9-4ac1-8e82-592d115efb6a tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:27:23.440316 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-3a118958-59a9-4ac1-8e82-592d115efb6a tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 7b14670a-d0c7-4eae-b840-062a79fbd06a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:27:23.452280 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3a118958-59a9-4ac1-8e82-592d115efb6a tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:27:23.453423 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3a118958-59a9-4ac1-8e82-592d115efb6a tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:27:23.454062 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3a118958-59a9-4ac1-8e82-592d115efb6a tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:27:23.455031 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3a118958-59a9-4ac1-8e82-592d115efb6a tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:27:23.455832 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3a118958-59a9-4ac1-8e82-592d115efb6a tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:27:23.456410 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3a118958-59a9-4ac1-8e82-592d115efb6a tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:27:23.630211 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-3a118958-59a9-4ac1-8e82-592d115efb6a tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219a93945a147c4a57bb6452212fe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eeb6be960cc408296ecce6353b72f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:27:23.640565 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-3a118958-59a9-4ac1-8e82-592d115efb6a tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "GET /compute/v2.1/servers/7b14670a-d0c7-4eae-b840-062a79fbd06a" status: 200 len: 1691 microversion: 2.1 time: 0.207285 Oct 08 21:27:23.641147 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2907/5888] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:27:23 2022] GET /compute/v2.1/servers/7b14670a-d0c7-4eae-b840-062a79fbd06a => generated 1691 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:27:24.667091 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-23d08c74-2878-4ca5-ab55-efa286a472e0 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:27:24.667799 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-23d08c74-2878-4ca5-ab55-efa286a472e0 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 7b14670a-d0c7-4eae-b840-062a79fbd06a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:27:24.674714 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-23d08c74-2878-4ca5-ab55-efa286a472e0 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:27:24.675295 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-23d08c74-2878-4ca5-ab55-efa286a472e0 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:27:24.675818 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-23d08c74-2878-4ca5-ab55-efa286a472e0 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:27:24.676617 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-23d08c74-2878-4ca5-ab55-efa286a472e0 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:27:24.677176 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-23d08c74-2878-4ca5-ab55-efa286a472e0 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:27:24.677718 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-23d08c74-2878-4ca5-ab55-efa286a472e0 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:27:24.918481 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-23d08c74-2878-4ca5-ab55-efa286a472e0 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219a93945a147c4a57bb6452212fe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eeb6be960cc408296ecce6353b72f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:27:24.929660 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-23d08c74-2878-4ca5-ab55-efa286a472e0 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "GET /compute/v2.1/servers/7b14670a-d0c7-4eae-b840-062a79fbd06a" status: 200 len: 1691 microversion: 2.1 time: 0.267429 Oct 08 21:27:24.930543 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2982/5889] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:27:24 2022] GET /compute/v2.1/servers/7b14670a-d0c7-4eae-b840-062a79fbd06a => generated 1691 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:27:25.953576 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-8f5930af-fbf0-42d8-aabd-d1dd8c2dc08f tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:27:25.954196 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-8f5930af-fbf0-42d8-aabd-d1dd8c2dc08f tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 7b14670a-d0c7-4eae-b840-062a79fbd06a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:27:25.961988 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8f5930af-fbf0-42d8-aabd-d1dd8c2dc08f tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:27:25.962482 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8f5930af-fbf0-42d8-aabd-d1dd8c2dc08f tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:27:25.962926 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8f5930af-fbf0-42d8-aabd-d1dd8c2dc08f tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:27:25.963628 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8f5930af-fbf0-42d8-aabd-d1dd8c2dc08f tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:27:25.964087 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8f5930af-fbf0-42d8-aabd-d1dd8c2dc08f tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:27:25.964616 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8f5930af-fbf0-42d8-aabd-d1dd8c2dc08f tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:27:26.103527 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-8f5930af-fbf0-42d8-aabd-d1dd8c2dc08f tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219a93945a147c4a57bb6452212fe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eeb6be960cc408296ecce6353b72f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:27:26.112245 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-8f5930af-fbf0-42d8-aabd-d1dd8c2dc08f tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "GET /compute/v2.1/servers/7b14670a-d0c7-4eae-b840-062a79fbd06a" status: 200 len: 1696 microversion: 2.1 time: 0.162482 Oct 08 21:27:26.112825 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2908/5890] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:27:25 2022] GET /compute/v2.1/servers/7b14670a-d0c7-4eae-b840-062a79fbd06a => generated 1696 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:27:27.136450 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-a56fae7e-f168-47bd-bb6f-1c139b679fcc tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:27:27.137159 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-a56fae7e-f168-47bd-bb6f-1c139b679fcc tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 7b14670a-d0c7-4eae-b840-062a79fbd06a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:27:27.144788 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a56fae7e-f168-47bd-bb6f-1c139b679fcc tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:27:27.145320 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a56fae7e-f168-47bd-bb6f-1c139b679fcc tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:27:27.145766 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a56fae7e-f168-47bd-bb6f-1c139b679fcc tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:27:27.146477 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a56fae7e-f168-47bd-bb6f-1c139b679fcc tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:27:27.146942 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a56fae7e-f168-47bd-bb6f-1c139b679fcc tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:27:27.147403 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a56fae7e-f168-47bd-bb6f-1c139b679fcc tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:27:27.291051 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-a56fae7e-f168-47bd-bb6f-1c139b679fcc tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219a93945a147c4a57bb6452212fe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eeb6be960cc408296ecce6353b72f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:27:27.301947 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-a56fae7e-f168-47bd-bb6f-1c139b679fcc tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "GET /compute/v2.1/servers/7b14670a-d0c7-4eae-b840-062a79fbd06a" status: 200 len: 1696 microversion: 2.1 time: 0.169362 Oct 08 21:27:27.302650 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2983/5891] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:27:27 2022] GET /compute/v2.1/servers/7b14670a-d0c7-4eae-b840-062a79fbd06a => generated 1696 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:27:28.326988 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-3f5f4eb6-b67a-414a-a29d-6511b5e749c9 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:27:28.328805 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-3f5f4eb6-b67a-414a-a29d-6511b5e749c9 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 7b14670a-d0c7-4eae-b840-062a79fbd06a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:27:28.336859 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3f5f4eb6-b67a-414a-a29d-6511b5e749c9 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:27:28.338131 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3f5f4eb6-b67a-414a-a29d-6511b5e749c9 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:27:28.338878 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3f5f4eb6-b67a-414a-a29d-6511b5e749c9 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:27:28.340210 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3f5f4eb6-b67a-414a-a29d-6511b5e749c9 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:27:28.341101 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3f5f4eb6-b67a-414a-a29d-6511b5e749c9 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:27:28.342592 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3f5f4eb6-b67a-414a-a29d-6511b5e749c9 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:27:28.501082 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-3f5f4eb6-b67a-414a-a29d-6511b5e749c9 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219a93945a147c4a57bb6452212fe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eeb6be960cc408296ecce6353b72f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:27:28.509917 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-3f5f4eb6-b67a-414a-a29d-6511b5e749c9 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "GET /compute/v2.1/servers/7b14670a-d0c7-4eae-b840-062a79fbd06a" status: 200 len: 1696 microversion: 2.1 time: 0.187794 Oct 08 21:27:28.519548 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2909/5892] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:27:28 2022] GET /compute/v2.1/servers/7b14670a-d0c7-4eae-b840-062a79fbd06a => generated 1696 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:27:29.540182 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-925752c5-86be-4391-8411-c06a12efa5b7 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:27:29.542416 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-925752c5-86be-4391-8411-c06a12efa5b7 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 7b14670a-d0c7-4eae-b840-062a79fbd06a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:27:29.551903 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-925752c5-86be-4391-8411-c06a12efa5b7 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:27:29.552471 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-925752c5-86be-4391-8411-c06a12efa5b7 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:27:29.553142 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-925752c5-86be-4391-8411-c06a12efa5b7 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:27:29.554195 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-925752c5-86be-4391-8411-c06a12efa5b7 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:27:29.554863 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-925752c5-86be-4391-8411-c06a12efa5b7 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:27:29.555495 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-925752c5-86be-4391-8411-c06a12efa5b7 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:27:29.761079 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-925752c5-86be-4391-8411-c06a12efa5b7 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219a93945a147c4a57bb6452212fe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eeb6be960cc408296ecce6353b72f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:27:29.771236 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-925752c5-86be-4391-8411-c06a12efa5b7 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "GET /compute/v2.1/servers/7b14670a-d0c7-4eae-b840-062a79fbd06a" status: 200 len: 1696 microversion: 2.1 time: 0.239062 Oct 08 21:27:29.772823 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2984/5893] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:27:29 2022] GET /compute/v2.1/servers/7b14670a-d0c7-4eae-b840-062a79fbd06a => generated 1696 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:27:30.796805 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-017d383f-48d6-4738-9b3b-21dfab29f8e4 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:27:30.797813 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-017d383f-48d6-4738-9b3b-21dfab29f8e4 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 7b14670a-d0c7-4eae-b840-062a79fbd06a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:27:30.805510 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-017d383f-48d6-4738-9b3b-21dfab29f8e4 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:27:30.806070 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-017d383f-48d6-4738-9b3b-21dfab29f8e4 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:27:30.806530 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-017d383f-48d6-4738-9b3b-21dfab29f8e4 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:27:30.807486 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-017d383f-48d6-4738-9b3b-21dfab29f8e4 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:27:30.808118 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-017d383f-48d6-4738-9b3b-21dfab29f8e4 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:27:30.808562 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-017d383f-48d6-4738-9b3b-21dfab29f8e4 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:27:31.191519 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-017d383f-48d6-4738-9b3b-21dfab29f8e4 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219a93945a147c4a57bb6452212fe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eeb6be960cc408296ecce6353b72f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:27:31.199878 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-017d383f-48d6-4738-9b3b-21dfab29f8e4 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "GET /compute/v2.1/servers/7b14670a-d0c7-4eae-b840-062a79fbd06a" status: 200 len: 1696 microversion: 2.1 time: 0.407731 Oct 08 21:27:31.200474 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2910/5894] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:27:30 2022] GET /compute/v2.1/servers/7b14670a-d0c7-4eae-b840-062a79fbd06a => generated 1696 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:27:32.224602 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-4aef546c-9b90-46c8-a78b-29c9dc6dcf64 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:27:32.225242 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-4aef546c-9b90-46c8-a78b-29c9dc6dcf64 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 7b14670a-d0c7-4eae-b840-062a79fbd06a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:27:32.232226 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4aef546c-9b90-46c8-a78b-29c9dc6dcf64 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:27:32.232726 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4aef546c-9b90-46c8-a78b-29c9dc6dcf64 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:27:32.233168 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4aef546c-9b90-46c8-a78b-29c9dc6dcf64 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:27:32.234090 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4aef546c-9b90-46c8-a78b-29c9dc6dcf64 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:27:32.234963 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4aef546c-9b90-46c8-a78b-29c9dc6dcf64 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:27:32.235400 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4aef546c-9b90-46c8-a78b-29c9dc6dcf64 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:27:32.384773 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-4aef546c-9b90-46c8-a78b-29c9dc6dcf64 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219a93945a147c4a57bb6452212fe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eeb6be960cc408296ecce6353b72f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:27:32.395159 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-4aef546c-9b90-46c8-a78b-29c9dc6dcf64 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "GET /compute/v2.1/servers/7b14670a-d0c7-4eae-b840-062a79fbd06a" status: 200 len: 1696 microversion: 2.1 time: 0.174880 Oct 08 21:27:32.395921 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2985/5895] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:27:32 2022] GET /compute/v2.1/servers/7b14670a-d0c7-4eae-b840-062a79fbd06a => generated 1696 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:27:33.420476 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-e2eae7e8-5a84-4854-895e-3fc0c13db259 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:27:33.421837 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-e2eae7e8-5a84-4854-895e-3fc0c13db259 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 7b14670a-d0c7-4eae-b840-062a79fbd06a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:27:33.429230 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e2eae7e8-5a84-4854-895e-3fc0c13db259 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:27:33.429733 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e2eae7e8-5a84-4854-895e-3fc0c13db259 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:27:33.430183 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e2eae7e8-5a84-4854-895e-3fc0c13db259 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:27:33.430900 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e2eae7e8-5a84-4854-895e-3fc0c13db259 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:27:33.431385 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e2eae7e8-5a84-4854-895e-3fc0c13db259 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:27:33.432013 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e2eae7e8-5a84-4854-895e-3fc0c13db259 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:27:33.587454 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-e2eae7e8-5a84-4854-895e-3fc0c13db259 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219a93945a147c4a57bb6452212fe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eeb6be960cc408296ecce6353b72f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:27:33.596940 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-e2eae7e8-5a84-4854-895e-3fc0c13db259 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "GET /compute/v2.1/servers/7b14670a-d0c7-4eae-b840-062a79fbd06a" status: 200 len: 1696 microversion: 2.1 time: 0.180609 Oct 08 21:27:33.597585 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2911/5896] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:27:33 2022] GET /compute/v2.1/servers/7b14670a-d0c7-4eae-b840-062a79fbd06a => generated 1696 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:27:34.622029 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e519b35d-ad2f-4bf7-bf16-17f7bd3ca475 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:27:34.622918 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-e519b35d-ad2f-4bf7-bf16-17f7bd3ca475 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 7b14670a-d0c7-4eae-b840-062a79fbd06a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:27:34.634692 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e519b35d-ad2f-4bf7-bf16-17f7bd3ca475 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:27:34.635366 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e519b35d-ad2f-4bf7-bf16-17f7bd3ca475 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:27:34.635979 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e519b35d-ad2f-4bf7-bf16-17f7bd3ca475 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:27:34.637023 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e519b35d-ad2f-4bf7-bf16-17f7bd3ca475 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:27:34.648503 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e519b35d-ad2f-4bf7-bf16-17f7bd3ca475 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:27:34.649368 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e519b35d-ad2f-4bf7-bf16-17f7bd3ca475 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:27:34.991657 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-e519b35d-ad2f-4bf7-bf16-17f7bd3ca475 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219a93945a147c4a57bb6452212fe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eeb6be960cc408296ecce6353b72f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:27:34.999964 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-e519b35d-ad2f-4bf7-bf16-17f7bd3ca475 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "GET /compute/v2.1/servers/7b14670a-d0c7-4eae-b840-062a79fbd06a" status: 200 len: 1696 microversion: 2.1 time: 0.383360 Oct 08 21:27:35.000804 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2986/5897] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:27:34 2022] GET /compute/v2.1/servers/7b14670a-d0c7-4eae-b840-062a79fbd06a => generated 1696 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:27:36.028279 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c8875760-36df-4fa1-90c8-f05884eec3ec tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:27:36.030354 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-c8875760-36df-4fa1-90c8-f05884eec3ec tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 7b14670a-d0c7-4eae-b840-062a79fbd06a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:27:36.040148 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c8875760-36df-4fa1-90c8-f05884eec3ec tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:27:36.045442 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c8875760-36df-4fa1-90c8-f05884eec3ec tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:27:36.048115 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c8875760-36df-4fa1-90c8-f05884eec3ec tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:27:36.049531 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c8875760-36df-4fa1-90c8-f05884eec3ec tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:27:36.054544 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c8875760-36df-4fa1-90c8-f05884eec3ec tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:27:36.055134 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c8875760-36df-4fa1-90c8-f05884eec3ec tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:27:36.303320 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-c8875760-36df-4fa1-90c8-f05884eec3ec tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219a93945a147c4a57bb6452212fe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eeb6be960cc408296ecce6353b72f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:27:36.312508 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-c8875760-36df-4fa1-90c8-f05884eec3ec tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "GET /compute/v2.1/servers/7b14670a-d0c7-4eae-b840-062a79fbd06a" status: 200 len: 1696 microversion: 2.1 time: 0.288129 Oct 08 21:27:36.313126 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2912/5898] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:27:36 2022] GET /compute/v2.1/servers/7b14670a-d0c7-4eae-b840-062a79fbd06a => generated 1696 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:27:37.117994 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-1f3947b5-acc5-42b1-960b-3eb455b7bcb2 tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Action: 'create', calling method: .version_select at 0x7f1a87507550>, body: {"keypair": {"name": "tempest-TestServerBasicOps-768857520", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKsEXCLhUSe08u9ZDc4MnDUZKXefvX8Uo2PLcZL9UrGTIw+52arf+9NU3GT9xhu9RFIzvL5DbFpFzKNtuaVaLWuXApnpKc48WCEc9rWXfJC3PZt5fI/8Im/KFGMLGpGV7g=="}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:27:37.135685 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-1f3947b5-acc5-42b1-960b-3eb455b7bcb2 tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Getting quotas for project 79a6a8bf389b4191816195072295a080. Resources: {'key_pairs'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:27:37.142141 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-1f3947b5-acc5-42b1-960b-3eb455b7bcb2 tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Getting quotas for user 6100a1568dd042e58ce63e4b30a87429 and project 79a6a8bf389b4191816195072295a080. Resources: {'key_pairs'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:27:37.171324 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-1f3947b5-acc5-42b1-960b-3eb455b7bcb2 tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.237361 Oct 08 21:27:37.171944 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2987/5899] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Oct 8 21:27:36 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:27:37.336417 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-905b28fa-5ac3-4333-93f2-3afcf431df97 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:27:37.337172 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-905b28fa-5ac3-4333-93f2-3afcf431df97 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 7b14670a-d0c7-4eae-b840-062a79fbd06a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:27:37.359129 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-905b28fa-5ac3-4333-93f2-3afcf431df97 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:27:37.359642 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-905b28fa-5ac3-4333-93f2-3afcf431df97 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:27:37.360088 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-905b28fa-5ac3-4333-93f2-3afcf431df97 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:27:37.360820 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-905b28fa-5ac3-4333-93f2-3afcf431df97 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:27:37.361312 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-905b28fa-5ac3-4333-93f2-3afcf431df97 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:27:37.361751 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-905b28fa-5ac3-4333-93f2-3afcf431df97 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:27:37.587282 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-905b28fa-5ac3-4333-93f2-3afcf431df97 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219a93945a147c4a57bb6452212fe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eeb6be960cc408296ecce6353b72f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:27:37.597730 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-905b28fa-5ac3-4333-93f2-3afcf431df97 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "GET /compute/v2.1/servers/7b14670a-d0c7-4eae-b840-062a79fbd06a" status: 200 len: 1696 microversion: 2.1 time: 0.265279 Oct 08 21:27:37.598619 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2913/5900] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:27:37 2022] GET /compute/v2.1/servers/7b14670a-d0c7-4eae-b840-062a79fbd06a => generated 1696 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:27:38.299310 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-22a91750-d6a2-4c80-9ad7-0c6f7211cfe3 tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-1469034015", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-768857520", "security_groups": [{"name": "tempest-secgroup-smoke-84202922"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "22a870f7-f6f7-4577-bd75-86c5dedca383"}]}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:27:38.420156 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.network.neutron [None req-22a91750-d6a2-4c80-9ad7-0c6f7211cfe3 tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] validate_networks() for [('22a870f7-f6f7-4577-bd75-86c5dedca383', None, None, None, None, None)] {{(pid=140492) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 21:27:38.626071 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-bae06002-f603-47cd-a9d7-af821619edc9 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:27:38.626806 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-bae06002-f603-47cd-a9d7-af821619edc9 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 7b14670a-d0c7-4eae-b840-062a79fbd06a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:27:38.634591 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bae06002-f603-47cd-a9d7-af821619edc9 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:27:38.635390 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bae06002-f603-47cd-a9d7-af821619edc9 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:27:38.635836 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bae06002-f603-47cd-a9d7-af821619edc9 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:27:38.637038 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bae06002-f603-47cd-a9d7-af821619edc9 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:27:38.637538 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bae06002-f603-47cd-a9d7-af821619edc9 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:27:38.637982 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bae06002-f603-47cd-a9d7-af821619edc9 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:27:38.792968 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-bae06002-f603-47cd-a9d7-af821619edc9 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219a93945a147c4a57bb6452212fe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eeb6be960cc408296ecce6353b72f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:27:38.801967 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-bae06002-f603-47cd-a9d7-af821619edc9 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "GET /compute/v2.1/servers/7b14670a-d0c7-4eae-b840-062a79fbd06a" status: 200 len: 1696 microversion: 2.1 time: 0.181782 Oct 08 21:27:38.803003 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2914/5901] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:27:38 2022] GET /compute/v2.1/servers/7b14670a-d0c7-4eae-b840-062a79fbd06a => generated 1696 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:27:39.251191 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-22a91750-d6a2-4c80-9ad7-0c6f7211cfe3 tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Getting quotas for project 79a6a8bf389b4191816195072295a080. Resources: dict_keys(['metadata_items']) {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:27:39.256535 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-22a91750-d6a2-4c80-9ad7-0c6f7211cfe3 tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Getting quotas for user 6100a1568dd042e58ce63e4b30a87429 and project 79a6a8bf389b4191816195072295a080. Resources: dict_keys(['metadata_items']) {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:27:39.269611 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-22a91750-d6a2-4c80-9ad7-0c6f7211cfe3 tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Flavor limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 21:27:39.270046 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-22a91750-d6a2-4c80-9ad7-0c6f7211cfe3 tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Image limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 21:27:39.270592 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-22a91750-d6a2-4c80-9ad7-0c6f7211cfe3 tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Flavor pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 21:27:39.271021 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-22a91750-d6a2-4c80-9ad7-0c6f7211cfe3 tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Image pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 21:27:39.271452 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-22a91750-d6a2-4c80-9ad7-0c6f7211cfe3 tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 21:27:39.280967 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-22a91750-d6a2-4c80-9ad7-0c6f7211cfe3 tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:27:39.281544 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-22a91750-d6a2-4c80-9ad7-0c6f7211cfe3 tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:27:39.281994 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-22a91750-d6a2-4c80-9ad7-0c6f7211cfe3 tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:27:39.282770 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-22a91750-d6a2-4c80-9ad7-0c6f7211cfe3 tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:27:39.283244 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-22a91750-d6a2-4c80-9ad7-0c6f7211cfe3 tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:27:39.283824 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-22a91750-d6a2-4c80-9ad7-0c6f7211cfe3 tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:27:39.303332 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-22a91750-d6a2-4c80-9ad7-0c6f7211cfe3 tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Getting quotas for project 79a6a8bf389b4191816195072295a080. Resources: {'cores', 'instances', 'ram'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:27:39.308728 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-22a91750-d6a2-4c80-9ad7-0c6f7211cfe3 tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Getting quotas for user 6100a1568dd042e58ce63e4b30a87429 and project 79a6a8bf389b4191816195072295a080. Resources: {'cores', 'instances', 'ram'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:27:39.321557 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-22a91750-d6a2-4c80-9ad7-0c6f7211cfe3 tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Going to run 1 instances... {{(pid=140492) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 21:27:39.323938 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-22a91750-d6a2-4c80-9ad7-0c6f7211cfe3 tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] [instance: 931e11c7-9245-4481-b1eb-588fd86e30a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c508bd7f-7db9-4b2c-af7c-be54a855c355',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140492) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 21:27:39.376581 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-22a91750-d6a2-4c80-9ad7-0c6f7211cfe3 tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.082618 Oct 08 21:27:39.377629 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2988/5902] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 21:27:38 2022] POST /compute/v2.1/servers => generated 404 bytes in 1084 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 08 21:27:39.389723 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-a1caff27-2876-4f28-b0ae-a6e5d7749de1 tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:27:39.390639 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-a1caff27-2876-4f28-b0ae-a6e5d7749de1 tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] [instance: 931e11c7-9245-4481-b1eb-588fd86e30a6] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:27:39.467159 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-a1caff27-2876-4f28-b0ae-a6e5d7749de1 tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6100a1568dd042e58ce63e4b30a87429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a6a8bf389b4191816195072295a080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:27:39.476482 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-a1caff27-2876-4f28-b0ae-a6e5d7749de1 tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] 10.222.0.26 "GET /compute/v2.1/servers/931e11c7-9245-4481-b1eb-588fd86e30a6" status: 200 len: 1302 microversion: 2.1 time: 0.091369 Oct 08 21:27:39.477315 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2915/5903] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:27:39 2022] GET /compute/v2.1/servers/931e11c7-9245-4481-b1eb-588fd86e30a6 => generated 1302 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:27:39.827691 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e58c12fc-1418-4ea1-b0c4-164f9608c05c tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:27:39.828320 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-e58c12fc-1418-4ea1-b0c4-164f9608c05c tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 7b14670a-d0c7-4eae-b840-062a79fbd06a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:27:39.835981 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e58c12fc-1418-4ea1-b0c4-164f9608c05c tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:27:39.836590 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e58c12fc-1418-4ea1-b0c4-164f9608c05c tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:27:39.837043 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e58c12fc-1418-4ea1-b0c4-164f9608c05c tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:27:39.837823 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e58c12fc-1418-4ea1-b0c4-164f9608c05c tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:27:39.838289 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e58c12fc-1418-4ea1-b0c4-164f9608c05c tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:27:39.838729 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e58c12fc-1418-4ea1-b0c4-164f9608c05c tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:27:40.007746 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-e58c12fc-1418-4ea1-b0c4-164f9608c05c tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219a93945a147c4a57bb6452212fe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eeb6be960cc408296ecce6353b72f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:27:40.016747 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-e58c12fc-1418-4ea1-b0c4-164f9608c05c tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "GET /compute/v2.1/servers/7b14670a-d0c7-4eae-b840-062a79fbd06a" status: 200 len: 1696 microversion: 2.1 time: 0.194260 Oct 08 21:27:40.017573 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2989/5904] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:27:39 2022] GET /compute/v2.1/servers/7b14670a-d0c7-4eae-b840-062a79fbd06a => generated 1696 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:27:40.499878 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-ad2aecf1-3ec3-409e-a0bd-20cce814c569 tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:27:40.501290 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-ad2aecf1-3ec3-409e-a0bd-20cce814c569 tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] [instance: 931e11c7-9245-4481-b1eb-588fd86e30a6] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:27:40.510392 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ad2aecf1-3ec3-409e-a0bd-20cce814c569 tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:27:40.511146 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ad2aecf1-3ec3-409e-a0bd-20cce814c569 tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:27:40.511810 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ad2aecf1-3ec3-409e-a0bd-20cce814c569 tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:27:40.512718 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ad2aecf1-3ec3-409e-a0bd-20cce814c569 tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:27:40.513251 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ad2aecf1-3ec3-409e-a0bd-20cce814c569 tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:27:40.513689 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ad2aecf1-3ec3-409e-a0bd-20cce814c569 tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:27:40.587146 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-ad2aecf1-3ec3-409e-a0bd-20cce814c569 tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6100a1568dd042e58ce63e4b30a87429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a6a8bf389b4191816195072295a080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:27:40.595401 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-ad2aecf1-3ec3-409e-a0bd-20cce814c569 tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] 10.222.0.26 "GET /compute/v2.1/servers/931e11c7-9245-4481-b1eb-588fd86e30a6" status: 200 len: 1362 microversion: 2.1 time: 0.099592 Oct 08 21:27:40.596297 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2916/5905] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:27:40 2022] GET /compute/v2.1/servers/931e11c7-9245-4481-b1eb-588fd86e30a6 => generated 1362 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:27:41.040568 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-3752b72f-ef57-40dc-8c73-75e0dc060d7b tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:27:41.041412 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-3752b72f-ef57-40dc-8c73-75e0dc060d7b tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 7b14670a-d0c7-4eae-b840-062a79fbd06a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:27:41.048397 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3752b72f-ef57-40dc-8c73-75e0dc060d7b tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:27:41.048972 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3752b72f-ef57-40dc-8c73-75e0dc060d7b tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:27:41.049530 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3752b72f-ef57-40dc-8c73-75e0dc060d7b tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:27:41.050372 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3752b72f-ef57-40dc-8c73-75e0dc060d7b tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:27:41.050904 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3752b72f-ef57-40dc-8c73-75e0dc060d7b tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:27:41.051440 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3752b72f-ef57-40dc-8c73-75e0dc060d7b tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:27:41.281786 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-3752b72f-ef57-40dc-8c73-75e0dc060d7b tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219a93945a147c4a57bb6452212fe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eeb6be960cc408296ecce6353b72f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:27:41.294227 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-3752b72f-ef57-40dc-8c73-75e0dc060d7b tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "GET /compute/v2.1/servers/7b14670a-d0c7-4eae-b840-062a79fbd06a" status: 200 len: 1696 microversion: 2.1 time: 0.257743 Oct 08 21:27:41.295548 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2990/5906] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:27:41 2022] GET /compute/v2.1/servers/7b14670a-d0c7-4eae-b840-062a79fbd06a => generated 1696 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:27:41.623539 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-6200bbe9-b77b-4f72-aa7e-397e6d41e3db tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:27:41.624295 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-6200bbe9-b77b-4f72-aa7e-397e6d41e3db tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] [instance: 931e11c7-9245-4481-b1eb-588fd86e30a6] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:27:41.631782 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6200bbe9-b77b-4f72-aa7e-397e6d41e3db tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:27:41.632364 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6200bbe9-b77b-4f72-aa7e-397e6d41e3db tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:27:41.632815 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6200bbe9-b77b-4f72-aa7e-397e6d41e3db tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:27:41.633603 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6200bbe9-b77b-4f72-aa7e-397e6d41e3db tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:27:41.635343 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6200bbe9-b77b-4f72-aa7e-397e6d41e3db tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:27:41.635815 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6200bbe9-b77b-4f72-aa7e-397e6d41e3db tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:27:41.776658 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-6200bbe9-b77b-4f72-aa7e-397e6d41e3db tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6100a1568dd042e58ce63e4b30a87429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a6a8bf389b4191816195072295a080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:27:41.784551 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-6200bbe9-b77b-4f72-aa7e-397e6d41e3db tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] 10.222.0.26 "GET /compute/v2.1/servers/931e11c7-9245-4481-b1eb-588fd86e30a6" status: 200 len: 1426 microversion: 2.1 time: 0.166986 Oct 08 21:27:41.785144 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2917/5907] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:27:41 2022] GET /compute/v2.1/servers/931e11c7-9245-4481-b1eb-588fd86e30a6 => generated 1426 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:27:42.076854 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-25fa4fe7-4f94-4277-966f-4abf1cfc839e req-970837f7-a549-4be3-8343-5892a2d03a70 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "931e11c7-9245-4481-b1eb-588fd86e30a6", "tag": "29382ecd-3ca3-4bac-98c7-eec27d44e5b8"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:27:42.094273 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-25fa4fe7-4f94-4277-966f-4abf1cfc839e req-970837f7-a549-4be3-8343-5892a2d03a70 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:27:42.095005 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-25fa4fe7-4f94-4277-966f-4abf1cfc839e req-970837f7-a549-4be3-8343-5892a2d03a70 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:27:42.095623 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-25fa4fe7-4f94-4277-966f-4abf1cfc839e req-970837f7-a549-4be3-8343-5892a2d03a70 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:27:42.108634 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-25fa4fe7-4f94-4277-966f-4abf1cfc839e req-970837f7-a549-4be3-8343-5892a2d03a70 service nova] Creating event network-changed:29382ecd-3ca3-4bac-98c7-eec27d44e5b8 for instance 931e11c7-9245-4481-b1eb-588fd86e30a6 on nch2-master-1 Oct 08 21:27:42.113682 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-25fa4fe7-4f94-4277-966f-4abf1cfc839e req-970837f7-a549-4be3-8343-5892a2d03a70 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045159 Oct 08 21:27:42.114598 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2991/5908] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:27:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:27:42.320282 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-2d4cf75c-483a-44af-b96e-0bc087028b87 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:27:42.320904 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-2d4cf75c-483a-44af-b96e-0bc087028b87 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 7b14670a-d0c7-4eae-b840-062a79fbd06a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:27:42.327854 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2d4cf75c-483a-44af-b96e-0bc087028b87 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:27:42.328356 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2d4cf75c-483a-44af-b96e-0bc087028b87 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:27:42.328799 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2d4cf75c-483a-44af-b96e-0bc087028b87 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:27:42.329585 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2d4cf75c-483a-44af-b96e-0bc087028b87 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:27:42.330212 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2d4cf75c-483a-44af-b96e-0bc087028b87 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:27:42.330806 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2d4cf75c-483a-44af-b96e-0bc087028b87 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:27:42.482821 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-2d4cf75c-483a-44af-b96e-0bc087028b87 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219a93945a147c4a57bb6452212fe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eeb6be960cc408296ecce6353b72f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:27:42.497633 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-2d4cf75c-483a-44af-b96e-0bc087028b87 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "GET /compute/v2.1/servers/7b14670a-d0c7-4eae-b840-062a79fbd06a" status: 200 len: 1696 microversion: 2.1 time: 0.181316 Oct 08 21:27:42.498185 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2918/5909] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:27:42 2022] GET /compute/v2.1/servers/7b14670a-d0c7-4eae-b840-062a79fbd06a => generated 1696 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:27:42.808541 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-537813f4-9049-4659-84a8-c9583aeb6e55 tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:27:42.809317 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-537813f4-9049-4659-84a8-c9583aeb6e55 tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] [instance: 931e11c7-9245-4481-b1eb-588fd86e30a6] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:27:42.816186 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-537813f4-9049-4659-84a8-c9583aeb6e55 tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:27:42.816684 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-537813f4-9049-4659-84a8-c9583aeb6e55 tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:27:42.817132 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-537813f4-9049-4659-84a8-c9583aeb6e55 tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:27:42.817864 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-537813f4-9049-4659-84a8-c9583aeb6e55 tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:27:42.818332 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-537813f4-9049-4659-84a8-c9583aeb6e55 tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:27:42.818768 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-537813f4-9049-4659-84a8-c9583aeb6e55 tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:27:42.955171 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-537813f4-9049-4659-84a8-c9583aeb6e55 tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6100a1568dd042e58ce63e4b30a87429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a6a8bf389b4191816195072295a080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:27:42.963006 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-537813f4-9049-4659-84a8-c9583aeb6e55 tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] 10.222.0.26 "GET /compute/v2.1/servers/931e11c7-9245-4481-b1eb-588fd86e30a6" status: 200 len: 1426 microversion: 2.1 time: 0.158852 Oct 08 21:27:42.963580 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2992/5910] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:27:42 2022] GET /compute/v2.1/servers/931e11c7-9245-4481-b1eb-588fd86e30a6 => generated 1426 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:27:43.525731 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-54f39756-bd36-4c14-b9b6-dc3a4c285c27 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:27:43.526346 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-54f39756-bd36-4c14-b9b6-dc3a4c285c27 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 7b14670a-d0c7-4eae-b840-062a79fbd06a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:27:43.533838 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-54f39756-bd36-4c14-b9b6-dc3a4c285c27 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:27:43.534330 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-54f39756-bd36-4c14-b9b6-dc3a4c285c27 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:27:43.534771 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-54f39756-bd36-4c14-b9b6-dc3a4c285c27 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:27:43.535473 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-54f39756-bd36-4c14-b9b6-dc3a4c285c27 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:27:43.535932 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-54f39756-bd36-4c14-b9b6-dc3a4c285c27 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:27:43.536360 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-54f39756-bd36-4c14-b9b6-dc3a4c285c27 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:27:43.684833 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-54f39756-bd36-4c14-b9b6-dc3a4c285c27 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219a93945a147c4a57bb6452212fe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eeb6be960cc408296ecce6353b72f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:27:43.692677 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-54f39756-bd36-4c14-b9b6-dc3a4c285c27 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "GET /compute/v2.1/servers/7b14670a-d0c7-4eae-b840-062a79fbd06a" status: 200 len: 1695 microversion: 2.1 time: 0.170815 Oct 08 21:27:43.693277 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2919/5911] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:27:43 2022] GET /compute/v2.1/servers/7b14670a-d0c7-4eae-b840-062a79fbd06a => generated 1695 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:27:43.985131 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-8a7d65d1-6589-40e8-bfbd-e6df4a7aac00 tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:27:43.985907 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-8a7d65d1-6589-40e8-bfbd-e6df4a7aac00 tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] [instance: 931e11c7-9245-4481-b1eb-588fd86e30a6] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:27:43.992999 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8a7d65d1-6589-40e8-bfbd-e6df4a7aac00 tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:27:43.993529 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8a7d65d1-6589-40e8-bfbd-e6df4a7aac00 tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:27:43.993974 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8a7d65d1-6589-40e8-bfbd-e6df4a7aac00 tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:27:43.994679 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8a7d65d1-6589-40e8-bfbd-e6df4a7aac00 tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:27:43.995140 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8a7d65d1-6589-40e8-bfbd-e6df4a7aac00 tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:27:43.995572 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8a7d65d1-6589-40e8-bfbd-e6df4a7aac00 tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:27:44.195016 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-21609e21-28b0-4785-8647-902f85db9886 req-30219289-9bae-42b8-a823-53c4d3ce7454 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b14670a-d0c7-4eae-b840-062a79fbd06a", "name": "network-vif-unplugged", "status": "completed", "tag": "97ae22d5-6b77-4de4-8076-53c65d74c4d7"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:27:44.205255 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-21609e21-28b0-4785-8647-902f85db9886 req-30219289-9bae-42b8-a823-53c4d3ce7454 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:27:44.205741 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-21609e21-28b0-4785-8647-902f85db9886 req-30219289-9bae-42b8-a823-53c4d3ce7454 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:27:44.206217 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-21609e21-28b0-4785-8647-902f85db9886 req-30219289-9bae-42b8-a823-53c4d3ce7454 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:27:44.218661 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-21609e21-28b0-4785-8647-902f85db9886 req-30219289-9bae-42b8-a823-53c4d3ce7454 service nova] Creating event network-vif-unplugged:97ae22d5-6b77-4de4-8076-53c65d74c4d7 for instance 7b14670a-d0c7-4eae-b840-062a79fbd06a on nch2-master-1 Oct 08 21:27:44.224899 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [req-21609e21-28b0-4785-8647-902f85db9886 req-30219289-9bae-42b8-a823-53c4d3ce7454 service nova] Instance 7b14670a-d0c7-4eae-b840-062a79fbd06a is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140491) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 08 21:27:44.239615 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-21609e21-28b0-4785-8647-902f85db9886 req-30219289-9bae-42b8-a823-53c4d3ce7454 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048367 Oct 08 21:27:44.240243 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2920/5912] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:27:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 08 21:27:44.329625 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-8a7d65d1-6589-40e8-bfbd-e6df4a7aac00 tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6100a1568dd042e58ce63e4b30a87429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a6a8bf389b4191816195072295a080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:27:44.338050 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-8a7d65d1-6589-40e8-bfbd-e6df4a7aac00 tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] 10.222.0.26 "GET /compute/v2.1/servers/931e11c7-9245-4481-b1eb-588fd86e30a6" status: 200 len: 1426 microversion: 2.1 time: 0.357044 Oct 08 21:27:44.338648 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2993/5913] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:27:43 2022] GET /compute/v2.1/servers/931e11c7-9245-4481-b1eb-588fd86e30a6 => generated 1426 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:27:44.717808 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c91a0d1f-a8de-4168-8e9b-5c2adb60514e tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:27:44.719164 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-c91a0d1f-a8de-4168-8e9b-5c2adb60514e tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 7b14670a-d0c7-4eae-b840-062a79fbd06a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:27:44.725877 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c91a0d1f-a8de-4168-8e9b-5c2adb60514e tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:27:44.726369 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c91a0d1f-a8de-4168-8e9b-5c2adb60514e tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:27:44.727047 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c91a0d1f-a8de-4168-8e9b-5c2adb60514e tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:27:44.727773 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c91a0d1f-a8de-4168-8e9b-5c2adb60514e tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:27:44.728236 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c91a0d1f-a8de-4168-8e9b-5c2adb60514e tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:27:44.728670 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c91a0d1f-a8de-4168-8e9b-5c2adb60514e tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:27:44.865785 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-c91a0d1f-a8de-4168-8e9b-5c2adb60514e tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219a93945a147c4a57bb6452212fe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eeb6be960cc408296ecce6353b72f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:27:44.874310 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-c91a0d1f-a8de-4168-8e9b-5c2adb60514e tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "GET /compute/v2.1/servers/7b14670a-d0c7-4eae-b840-062a79fbd06a" status: 200 len: 1695 microversion: 2.1 time: 0.162112 Oct 08 21:27:44.874898 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2921/5914] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:27:44 2022] GET /compute/v2.1/servers/7b14670a-d0c7-4eae-b840-062a79fbd06a => generated 1695 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:27:45.364035 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e2919e14-c2ff-4f4a-bc7c-90462307319b tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:27:45.364655 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-e2919e14-c2ff-4f4a-bc7c-90462307319b tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] [instance: 931e11c7-9245-4481-b1eb-588fd86e30a6] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:27:45.371580 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e2919e14-c2ff-4f4a-bc7c-90462307319b tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:27:45.372092 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e2919e14-c2ff-4f4a-bc7c-90462307319b tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:27:45.372520 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e2919e14-c2ff-4f4a-bc7c-90462307319b tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:27:45.373310 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e2919e14-c2ff-4f4a-bc7c-90462307319b tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:27:45.373775 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e2919e14-c2ff-4f4a-bc7c-90462307319b tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:27:45.374207 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e2919e14-c2ff-4f4a-bc7c-90462307319b tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:27:45.510734 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-e2919e14-c2ff-4f4a-bc7c-90462307319b tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6100a1568dd042e58ce63e4b30a87429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a6a8bf389b4191816195072295a080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:27:45.519041 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-e2919e14-c2ff-4f4a-bc7c-90462307319b tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] 10.222.0.26 "GET /compute/v2.1/servers/931e11c7-9245-4481-b1eb-588fd86e30a6" status: 200 len: 1426 microversion: 2.1 time: 0.158921 Oct 08 21:27:45.519610 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2994/5915] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:27:45 2022] GET /compute/v2.1/servers/931e11c7-9245-4481-b1eb-588fd86e30a6 => generated 1426 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:27:45.897385 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-86de3755-ef99-401f-be6f-858ee416f120 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:27:45.897935 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-86de3755-ef99-401f-be6f-858ee416f120 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 7b14670a-d0c7-4eae-b840-062a79fbd06a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:27:45.904833 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-86de3755-ef99-401f-be6f-858ee416f120 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:27:45.905360 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-86de3755-ef99-401f-be6f-858ee416f120 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:27:45.905812 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-86de3755-ef99-401f-be6f-858ee416f120 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:27:45.906544 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-86de3755-ef99-401f-be6f-858ee416f120 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:27:45.907010 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-86de3755-ef99-401f-be6f-858ee416f120 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:27:45.907447 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-86de3755-ef99-401f-be6f-858ee416f120 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:27:46.044046 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-86de3755-ef99-401f-be6f-858ee416f120 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219a93945a147c4a57bb6452212fe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eeb6be960cc408296ecce6353b72f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:27:46.051986 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-86de3755-ef99-401f-be6f-858ee416f120 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "GET /compute/v2.1/servers/7b14670a-d0c7-4eae-b840-062a79fbd06a" status: 200 len: 1693 microversion: 2.1 time: 0.158555 Oct 08 21:27:46.052730 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2922/5916] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:27:45 2022] GET /compute/v2.1/servers/7b14670a-d0c7-4eae-b840-062a79fbd06a => generated 1693 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:27:46.323162 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-6a6b9aa4-b287-4537-9e5f-037bece19cb1 req-00c5f130-fc31-4fd9-8bd4-757965ff0e96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b14670a-d0c7-4eae-b840-062a79fbd06a", "tag": "97ae22d5-6b77-4de4-8076-53c65d74c4d7"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:27:46.332617 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-6a6b9aa4-b287-4537-9e5f-037bece19cb1 req-00c5f130-fc31-4fd9-8bd4-757965ff0e96 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:27:46.333099 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-6a6b9aa4-b287-4537-9e5f-037bece19cb1 req-00c5f130-fc31-4fd9-8bd4-757965ff0e96 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:27:46.333603 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-6a6b9aa4-b287-4537-9e5f-037bece19cb1 req-00c5f130-fc31-4fd9-8bd4-757965ff0e96 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:27:46.345103 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-6a6b9aa4-b287-4537-9e5f-037bece19cb1 req-00c5f130-fc31-4fd9-8bd4-757965ff0e96 service nova] Creating event network-changed:97ae22d5-6b77-4de4-8076-53c65d74c4d7 for instance 7b14670a-d0c7-4eae-b840-062a79fbd06a on nch2-master-1 Oct 08 21:27:46.350526 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [req-6a6b9aa4-b287-4537-9e5f-037bece19cb1 req-00c5f130-fc31-4fd9-8bd4-757965ff0e96 service nova] Instance 7b14670a-d0c7-4eae-b840-062a79fbd06a is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140492) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 08 21:27:46.362248 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-6a6b9aa4-b287-4537-9e5f-037bece19cb1 req-00c5f130-fc31-4fd9-8bd4-757965ff0e96 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103777 Oct 08 21:27:46.362633 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2995/5917] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:27:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:27:46.542240 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-99de6e37-0610-4373-b6f8-c14b3b135441 tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:27:46.542964 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-99de6e37-0610-4373-b6f8-c14b3b135441 tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] [instance: 931e11c7-9245-4481-b1eb-588fd86e30a6] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:27:46.550373 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-99de6e37-0610-4373-b6f8-c14b3b135441 tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:27:46.550867 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-99de6e37-0610-4373-b6f8-c14b3b135441 tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:27:46.551304 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-99de6e37-0610-4373-b6f8-c14b3b135441 tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:27:46.552012 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-99de6e37-0610-4373-b6f8-c14b3b135441 tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:27:46.552469 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-99de6e37-0610-4373-b6f8-c14b3b135441 tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:27:46.552896 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-99de6e37-0610-4373-b6f8-c14b3b135441 tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:27:46.557267 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=100 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:27:46.720473 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-99de6e37-0610-4373-b6f8-c14b3b135441 tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6100a1568dd042e58ce63e4b30a87429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a6a8bf389b4191816195072295a080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:27:46.729098 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-99de6e37-0610-4373-b6f8-c14b3b135441 tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] 10.222.0.26 "GET /compute/v2.1/servers/931e11c7-9245-4481-b1eb-588fd86e30a6" status: 200 len: 1426 microversion: 2.1 time: 0.190846 Oct 08 21:27:46.729901 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2923/5918] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:27:46 2022] GET /compute/v2.1/servers/931e11c7-9245-4481-b1eb-588fd86e30a6 => generated 1426 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:27:47.078129 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-cac1f15a-b753-4ab2-8963-c1db6de91716 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:27:47.078754 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-cac1f15a-b753-4ab2-8963-c1db6de91716 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 7b14670a-d0c7-4eae-b840-062a79fbd06a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:27:47.085362 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cac1f15a-b753-4ab2-8963-c1db6de91716 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:27:47.085859 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cac1f15a-b753-4ab2-8963-c1db6de91716 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:27:47.086304 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cac1f15a-b753-4ab2-8963-c1db6de91716 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:27:47.087054 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cac1f15a-b753-4ab2-8963-c1db6de91716 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:27:47.087518 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cac1f15a-b753-4ab2-8963-c1db6de91716 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:27:47.087949 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cac1f15a-b753-4ab2-8963-c1db6de91716 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:27:47.370565 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-cac1f15a-b753-4ab2-8963-c1db6de91716 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219a93945a147c4a57bb6452212fe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eeb6be960cc408296ecce6353b72f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:27:47.380129 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-cac1f15a-b753-4ab2-8963-c1db6de91716 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "GET /compute/v2.1/servers/7b14670a-d0c7-4eae-b840-062a79fbd06a" status: 200 len: 1690 microversion: 2.1 time: 0.307769 Oct 08 21:27:47.380711 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2996/5919] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:27:47 2022] GET /compute/v2.1/servers/7b14670a-d0c7-4eae-b840-062a79fbd06a => generated 1690 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:27:47.403870 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-87286726-c0d9-4101-8b49-9da06ddf9916 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:27:47.404427 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-87286726-c0d9-4101-8b49-9da06ddf9916 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 7b14670a-d0c7-4eae-b840-062a79fbd06a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:27:47.411151 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-87286726-c0d9-4101-8b49-9da06ddf9916 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:27:47.411636 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-87286726-c0d9-4101-8b49-9da06ddf9916 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:27:47.412073 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-87286726-c0d9-4101-8b49-9da06ddf9916 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:27:47.412770 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-87286726-c0d9-4101-8b49-9da06ddf9916 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:27:47.413249 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-87286726-c0d9-4101-8b49-9da06ddf9916 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:27:47.413681 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-87286726-c0d9-4101-8b49-9da06ddf9916 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:27:47.755505 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e3df6a29-16be-4e17-ab78-83e57bf8d0d0 tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:27:47.756483 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-e3df6a29-16be-4e17-ab78-83e57bf8d0d0 tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] [instance: 931e11c7-9245-4481-b1eb-588fd86e30a6] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:27:47.765810 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e3df6a29-16be-4e17-ab78-83e57bf8d0d0 tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:27:47.766569 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e3df6a29-16be-4e17-ab78-83e57bf8d0d0 tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:27:47.767354 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e3df6a29-16be-4e17-ab78-83e57bf8d0d0 tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:27:47.768241 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e3df6a29-16be-4e17-ab78-83e57bf8d0d0 tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:27:47.769071 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e3df6a29-16be-4e17-ab78-83e57bf8d0d0 tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:27:47.769829 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e3df6a29-16be-4e17-ab78-83e57bf8d0d0 tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:27:47.798604 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:27:47.856469 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-87286726-c0d9-4101-8b49-9da06ddf9916 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "POST /compute/v2.1/servers/7b14670a-d0c7-4eae-b840-062a79fbd06a/action" status: 202 len: 0 microversion: 2.1 time: 0.456193 Oct 08 21:27:47.863484 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2924/5920] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:27:47 2022] POST /compute/v2.1/servers/7b14670a-d0c7-4eae-b840-062a79fbd06a/action => generated 0 bytes in 461 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 21:27:47.870986 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-b624137e-8c14-4de2-950d-1024f3ebb053 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:27:47.871713 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-b624137e-8c14-4de2-950d-1024f3ebb053 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 7b14670a-d0c7-4eae-b840-062a79fbd06a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:27:47.888461 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b624137e-8c14-4de2-950d-1024f3ebb053 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:27:47.888970 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b624137e-8c14-4de2-950d-1024f3ebb053 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:27:47.889442 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b624137e-8c14-4de2-950d-1024f3ebb053 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:27:47.890506 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b624137e-8c14-4de2-950d-1024f3ebb053 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:27:47.890995 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b624137e-8c14-4de2-950d-1024f3ebb053 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:27:47.891447 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b624137e-8c14-4de2-950d-1024f3ebb053 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:27:48.029412 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-e3df6a29-16be-4e17-ab78-83e57bf8d0d0 tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6100a1568dd042e58ce63e4b30a87429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a6a8bf389b4191816195072295a080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:27:48.048733 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-e3df6a29-16be-4e17-ab78-83e57bf8d0d0 tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] 10.222.0.26 "GET /compute/v2.1/servers/931e11c7-9245-4481-b1eb-588fd86e30a6" status: 200 len: 1426 microversion: 2.1 time: 0.297067 Oct 08 21:27:48.049651 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2997/5921] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:27:47 2022] GET /compute/v2.1/servers/931e11c7-9245-4481-b1eb-588fd86e30a6 => generated 1426 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:27:48.060661 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-947a0886-d7fc-4598-b8fd-71685c367cc1 req-754f21e0-5596-46d3-8f55-81577d17f0bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "931e11c7-9245-4481-b1eb-588fd86e30a6", "name": "network-vif-plugged", "status": "completed", "tag": "29382ecd-3ca3-4bac-98c7-eec27d44e5b8"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:27:48.076791 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-947a0886-d7fc-4598-b8fd-71685c367cc1 req-754f21e0-5596-46d3-8f55-81577d17f0bd service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:27:48.077621 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-947a0886-d7fc-4598-b8fd-71685c367cc1 req-754f21e0-5596-46d3-8f55-81577d17f0bd service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:27:48.078245 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-947a0886-d7fc-4598-b8fd-71685c367cc1 req-754f21e0-5596-46d3-8f55-81577d17f0bd service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:27:48.093837 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-947a0886-d7fc-4598-b8fd-71685c367cc1 req-754f21e0-5596-46d3-8f55-81577d17f0bd service nova] Creating event network-vif-plugged:29382ecd-3ca3-4bac-98c7-eec27d44e5b8 for instance 931e11c7-9245-4481-b1eb-588fd86e30a6 on nch2-master-1 Oct 08 21:27:48.100507 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-947a0886-d7fc-4598-b8fd-71685c367cc1 req-754f21e0-5596-46d3-8f55-81577d17f0bd service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047107 Oct 08 21:27:48.101826 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2998/5922] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:27:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:27:48.119637 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-b624137e-8c14-4de2-950d-1024f3ebb053 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219a93945a147c4a57bb6452212fe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eeb6be960cc408296ecce6353b72f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:27:48.130074 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-b624137e-8c14-4de2-950d-1024f3ebb053 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "GET /compute/v2.1/servers/7b14670a-d0c7-4eae-b840-062a79fbd06a" status: 200 len: 1689 microversion: 2.1 time: 0.264537 Oct 08 21:27:48.131214 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2925/5923] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:27:47 2022] GET /compute/v2.1/servers/7b14670a-d0c7-4eae-b840-062a79fbd06a => generated 1689 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:27:49.072587 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-03e8dbc5-4345-4546-983b-9a4c09abde22 tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:27:49.073422 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-03e8dbc5-4345-4546-983b-9a4c09abde22 tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] [instance: 931e11c7-9245-4481-b1eb-588fd86e30a6] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:27:49.081114 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-03e8dbc5-4345-4546-983b-9a4c09abde22 tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:27:49.081767 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-03e8dbc5-4345-4546-983b-9a4c09abde22 tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:27:49.082073 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-03e8dbc5-4345-4546-983b-9a4c09abde22 tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:27:49.082776 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-03e8dbc5-4345-4546-983b-9a4c09abde22 tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:27:49.083236 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-03e8dbc5-4345-4546-983b-9a4c09abde22 tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:27:49.083700 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-03e8dbc5-4345-4546-983b-9a4c09abde22 tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:27:49.155892 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-5a524702-3125-4806-8637-7ad7fcc510fe tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:27:49.156508 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-5a524702-3125-4806-8637-7ad7fcc510fe tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 7b14670a-d0c7-4eae-b840-062a79fbd06a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:27:49.163389 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5a524702-3125-4806-8637-7ad7fcc510fe tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:27:49.163887 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5a524702-3125-4806-8637-7ad7fcc510fe tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:27:49.164334 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5a524702-3125-4806-8637-7ad7fcc510fe tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:27:49.165037 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5a524702-3125-4806-8637-7ad7fcc510fe tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:27:49.165532 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5a524702-3125-4806-8637-7ad7fcc510fe tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:27:49.165965 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5a524702-3125-4806-8637-7ad7fcc510fe tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:27:49.276551 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-03e8dbc5-4345-4546-983b-9a4c09abde22 tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6100a1568dd042e58ce63e4b30a87429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a6a8bf389b4191816195072295a080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:27:49.284513 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-03e8dbc5-4345-4546-983b-9a4c09abde22 tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] 10.222.0.26 "GET /compute/v2.1/servers/931e11c7-9245-4481-b1eb-588fd86e30a6" status: 200 len: 1426 microversion: 2.1 time: 0.216314 Oct 08 21:27:49.285107 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 2999/5924] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:27:49 2022] GET /compute/v2.1/servers/931e11c7-9245-4481-b1eb-588fd86e30a6 => generated 1426 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:27:49.306773 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-5a524702-3125-4806-8637-7ad7fcc510fe tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219a93945a147c4a57bb6452212fe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eeb6be960cc408296ecce6353b72f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:27:49.315355 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-5a524702-3125-4806-8637-7ad7fcc510fe tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "GET /compute/v2.1/servers/7b14670a-d0c7-4eae-b840-062a79fbd06a" status: 200 len: 1689 microversion: 2.1 time: 0.163557 Oct 08 21:27:49.318928 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2926/5925] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:27:49 2022] GET /compute/v2.1/servers/7b14670a-d0c7-4eae-b840-062a79fbd06a => generated 1689 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:27:50.129004 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-131a29b4-e3f4-4733-b830-a546d4236495 req-9b043aa2-d332-490b-88de-28473e2b1f99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b14670a-d0c7-4eae-b840-062a79fbd06a", "name": "network-vif-plugged", "status": "completed", "tag": "97ae22d5-6b77-4de4-8076-53c65d74c4d7"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:27:50.133880 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=2 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:27:50.134695 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=14 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:27:50.142576 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-131a29b4-e3f4-4733-b830-a546d4236495 req-9b043aa2-d332-490b-88de-28473e2b1f99 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:27:50.143065 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-131a29b4-e3f4-4733-b830-a546d4236495 req-9b043aa2-d332-490b-88de-28473e2b1f99 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:27:50.143498 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-131a29b4-e3f4-4733-b830-a546d4236495 req-9b043aa2-d332-490b-88de-28473e2b1f99 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:27:50.155613 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-131a29b4-e3f4-4733-b830-a546d4236495 req-9b043aa2-d332-490b-88de-28473e2b1f99 service nova] Creating event network-vif-plugged:97ae22d5-6b77-4de4-8076-53c65d74c4d7 for instance 7b14670a-d0c7-4eae-b840-062a79fbd06a on nch2-master-1 Oct 08 21:27:50.160899 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [req-131a29b4-e3f4-4733-b830-a546d4236495 req-9b043aa2-d332-490b-88de-28473e2b1f99 service nova] Instance 7b14670a-d0c7-4eae-b840-062a79fbd06a is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140492) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 08 21:27:50.171378 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-131a29b4-e3f4-4733-b830-a546d4236495 req-9b043aa2-d332-490b-88de-28473e2b1f99 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046096 Oct 08 21:27:50.171966 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3000/5926] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:27:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:27:50.307008 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-2ee8c69f-5fbc-4a9b-b9e8-0e0bfa4a1159 tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:27:50.307755 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-2ee8c69f-5fbc-4a9b-b9e8-0e0bfa4a1159 tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] [instance: 931e11c7-9245-4481-b1eb-588fd86e30a6] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:27:50.310266 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=2 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:27:50.316300 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2ee8c69f-5fbc-4a9b-b9e8-0e0bfa4a1159 tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:27:50.316796 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2ee8c69f-5fbc-4a9b-b9e8-0e0bfa4a1159 tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:27:50.317268 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2ee8c69f-5fbc-4a9b-b9e8-0e0bfa4a1159 tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:27:50.318003 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2ee8c69f-5fbc-4a9b-b9e8-0e0bfa4a1159 tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:27:50.318466 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2ee8c69f-5fbc-4a9b-b9e8-0e0bfa4a1159 tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:27:50.318897 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2ee8c69f-5fbc-4a9b-b9e8-0e0bfa4a1159 tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:27:50.345584 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-71819d7a-793f-454a-821d-6fd3079d7372 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:27:50.346381 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-71819d7a-793f-454a-821d-6fd3079d7372 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 7b14670a-d0c7-4eae-b840-062a79fbd06a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:27:50.353253 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-71819d7a-793f-454a-821d-6fd3079d7372 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:27:50.353966 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-71819d7a-793f-454a-821d-6fd3079d7372 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:27:50.354214 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-71819d7a-793f-454a-821d-6fd3079d7372 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:27:50.354938 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-71819d7a-793f-454a-821d-6fd3079d7372 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:27:50.355843 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-71819d7a-793f-454a-821d-6fd3079d7372 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:27:50.355843 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-71819d7a-793f-454a-821d-6fd3079d7372 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:27:50.455652 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-2ee8c69f-5fbc-4a9b-b9e8-0e0bfa4a1159 tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6100a1568dd042e58ce63e4b30a87429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a6a8bf389b4191816195072295a080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:27:50.463896 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-2ee8c69f-5fbc-4a9b-b9e8-0e0bfa4a1159 tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] 10.222.0.26 "GET /compute/v2.1/servers/931e11c7-9245-4481-b1eb-588fd86e30a6" status: 200 len: 1605 microversion: 2.1 time: 0.160693 Oct 08 21:27:50.464566 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2927/5927] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:27:50 2022] GET /compute/v2.1/servers/931e11c7-9245-4481-b1eb-588fd86e30a6 => generated 1605 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:27:50.486846 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-6efaca9e-a326-4ca5-9a91-cef80ca4d481 tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:27:50.487710 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-6efaca9e-a326-4ca5-9a91-cef80ca4d481 tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] [instance: 931e11c7-9245-4481-b1eb-588fd86e30a6] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:27:50.494113 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6efaca9e-a326-4ca5-9a91-cef80ca4d481 tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:27:50.494605 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6efaca9e-a326-4ca5-9a91-cef80ca4d481 tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:27:50.495048 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6efaca9e-a326-4ca5-9a91-cef80ca4d481 tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:27:50.495767 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6efaca9e-a326-4ca5-9a91-cef80ca4d481 tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:27:50.496228 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6efaca9e-a326-4ca5-9a91-cef80ca4d481 tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:27:50.496660 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6efaca9e-a326-4ca5-9a91-cef80ca4d481 tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:27:50.511203 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-71819d7a-793f-454a-821d-6fd3079d7372 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219a93945a147c4a57bb6452212fe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eeb6be960cc408296ecce6353b72f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:27:50.519510 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-71819d7a-793f-454a-821d-6fd3079d7372 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "GET /compute/v2.1/servers/7b14670a-d0c7-4eae-b840-062a79fbd06a" status: 200 len: 1689 microversion: 2.1 time: 0.178381 Oct 08 21:27:50.520096 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3001/5928] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:27:50 2022] GET /compute/v2.1/servers/7b14670a-d0c7-4eae-b840-062a79fbd06a => generated 1689 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:27:50.633504 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-6efaca9e-a326-4ca5-9a91-cef80ca4d481 tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6100a1568dd042e58ce63e4b30a87429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a6a8bf389b4191816195072295a080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:27:50.641665 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-6efaca9e-a326-4ca5-9a91-cef80ca4d481 tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] 10.222.0.26 "GET /compute/v2.1/servers/931e11c7-9245-4481-b1eb-588fd86e30a6" status: 200 len: 1605 microversion: 2.1 time: 0.159157 Oct 08 21:27:50.642240 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2928/5929] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:27:50 2022] GET /compute/v2.1/servers/931e11c7-9245-4481-b1eb-588fd86e30a6 => generated 1605 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:27:50.678573 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-c132056b-bc7f-4741-b888-698a6196593f tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:27:50.679259 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-c132056b-bc7f-4741-b888-698a6196593f tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] [instance: 931e11c7-9245-4481-b1eb-588fd86e30a6] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:27:50.686663 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c132056b-bc7f-4741-b888-698a6196593f tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:27:50.687163 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c132056b-bc7f-4741-b888-698a6196593f tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:27:50.687608 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c132056b-bc7f-4741-b888-698a6196593f tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:27:50.688312 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c132056b-bc7f-4741-b888-698a6196593f tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:27:50.688777 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c132056b-bc7f-4741-b888-698a6196593f tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:27:50.689230 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c132056b-bc7f-4741-b888-698a6196593f tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:27:50.824563 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-c132056b-bc7f-4741-b888-698a6196593f tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6100a1568dd042e58ce63e4b30a87429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a6a8bf389b4191816195072295a080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:27:50.832417 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-c132056b-bc7f-4741-b888-698a6196593f tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] 10.222.0.26 "GET /compute/v2.1/servers/931e11c7-9245-4481-b1eb-588fd86e30a6" status: 200 len: 1605 microversion: 2.1 time: 0.160547 Oct 08 21:27:50.832986 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3002/5930] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:27:50 2022] GET /compute/v2.1/servers/931e11c7-9245-4481-b1eb-588fd86e30a6 => generated 1605 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:27:51.543850 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-202d957c-cb4b-4fb0-a86e-b2524ec5c56a tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:27:51.544583 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-202d957c-cb4b-4fb0-a86e-b2524ec5c56a tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 7b14670a-d0c7-4eae-b840-062a79fbd06a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:27:51.551642 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-202d957c-cb4b-4fb0-a86e-b2524ec5c56a tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:27:51.552146 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-202d957c-cb4b-4fb0-a86e-b2524ec5c56a tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:27:51.552594 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-202d957c-cb4b-4fb0-a86e-b2524ec5c56a tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:27:51.553340 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-202d957c-cb4b-4fb0-a86e-b2524ec5c56a tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:27:51.553806 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-202d957c-cb4b-4fb0-a86e-b2524ec5c56a tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:27:51.554244 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-202d957c-cb4b-4fb0-a86e-b2524ec5c56a tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:27:51.703809 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-202d957c-cb4b-4fb0-a86e-b2524ec5c56a tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219a93945a147c4a57bb6452212fe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eeb6be960cc408296ecce6353b72f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:27:51.712003 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-202d957c-cb4b-4fb0-a86e-b2524ec5c56a tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "GET /compute/v2.1/servers/7b14670a-d0c7-4eae-b840-062a79fbd06a" status: 200 len: 1689 microversion: 2.1 time: 0.172183 Oct 08 21:27:51.712583 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2929/5931] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:27:51 2022] GET /compute/v2.1/servers/7b14670a-d0c7-4eae-b840-062a79fbd06a => generated 1689 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:27:52.142448 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-b58f8d28-3d32-47ac-ac26-e239aa528f61 req-f5b39732-1c87-413d-b817-c0259cb33647 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b14670a-d0c7-4eae-b840-062a79fbd06a", "name": "network-vif-unplugged", "status": "completed", "tag": "97ae22d5-6b77-4de4-8076-53c65d74c4d7"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:27:52.153129 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-b58f8d28-3d32-47ac-ac26-e239aa528f61 req-f5b39732-1c87-413d-b817-c0259cb33647 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:27:52.153644 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-b58f8d28-3d32-47ac-ac26-e239aa528f61 req-f5b39732-1c87-413d-b817-c0259cb33647 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:27:52.154081 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-b58f8d28-3d32-47ac-ac26-e239aa528f61 req-f5b39732-1c87-413d-b817-c0259cb33647 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:27:52.166186 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-b58f8d28-3d32-47ac-ac26-e239aa528f61 req-f5b39732-1c87-413d-b817-c0259cb33647 service nova] Creating event network-vif-unplugged:97ae22d5-6b77-4de4-8076-53c65d74c4d7 for instance 7b14670a-d0c7-4eae-b840-062a79fbd06a on nch1-master-1 Oct 08 21:27:52.172416 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [req-b58f8d28-3d32-47ac-ac26-e239aa528f61 req-f5b39732-1c87-413d-b817-c0259cb33647 service nova] Instance 7b14670a-d0c7-4eae-b840-062a79fbd06a is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140492) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 08 21:27:52.184013 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-b58f8d28-3d32-47ac-ac26-e239aa528f61 req-f5b39732-1c87-413d-b817-c0259cb33647 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045069 Oct 08 21:27:52.185916 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3003/5932] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:27:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:27:52.736963 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-eba857a3-7430-47b4-977a-a168c0bbfa10 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:27:52.737638 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-eba857a3-7430-47b4-977a-a168c0bbfa10 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 7b14670a-d0c7-4eae-b840-062a79fbd06a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:27:52.740433 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:SELECT=57 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:27:52.746073 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-eba857a3-7430-47b4-977a-a168c0bbfa10 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:27:52.746581 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-eba857a3-7430-47b4-977a-a168c0bbfa10 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:27:52.747053 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-eba857a3-7430-47b4-977a-a168c0bbfa10 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:27:52.747815 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-eba857a3-7430-47b4-977a-a168c0bbfa10 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:27:52.748288 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-eba857a3-7430-47b4-977a-a168c0bbfa10 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:27:52.748723 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-eba857a3-7430-47b4-977a-a168c0bbfa10 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:27:52.892181 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-eba857a3-7430-47b4-977a-a168c0bbfa10 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219a93945a147c4a57bb6452212fe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eeb6be960cc408296ecce6353b72f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:27:52.900522 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-eba857a3-7430-47b4-977a-a168c0bbfa10 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "GET /compute/v2.1/servers/7b14670a-d0c7-4eae-b840-062a79fbd06a" status: 200 len: 1689 microversion: 2.1 time: 0.168436 Oct 08 21:27:52.901122 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2930/5933] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:27:52 2022] GET /compute/v2.1/servers/7b14670a-d0c7-4eae-b840-062a79fbd06a => generated 1689 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:27:53.929674 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-1c6b3884-0339-4847-b56f-aff749ecd4b5 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:27:53.930962 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-1c6b3884-0339-4847-b56f-aff749ecd4b5 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 7b14670a-d0c7-4eae-b840-062a79fbd06a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:27:53.936261 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=4 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:27:53.940237 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1c6b3884-0339-4847-b56f-aff749ecd4b5 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:27:53.940743 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1c6b3884-0339-4847-b56f-aff749ecd4b5 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:27:53.941244 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1c6b3884-0339-4847-b56f-aff749ecd4b5 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:27:53.942157 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1c6b3884-0339-4847-b56f-aff749ecd4b5 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:27:53.942975 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1c6b3884-0339-4847-b56f-aff749ecd4b5 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:27:53.943690 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1c6b3884-0339-4847-b56f-aff749ecd4b5 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:27:54.156858 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-1c6b3884-0339-4847-b56f-aff749ecd4b5 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219a93945a147c4a57bb6452212fe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eeb6be960cc408296ecce6353b72f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:27:54.164920 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-1c6b3884-0339-4847-b56f-aff749ecd4b5 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "GET /compute/v2.1/servers/7b14670a-d0c7-4eae-b840-062a79fbd06a" status: 200 len: 1689 microversion: 2.1 time: 0.244288 Oct 08 21:27:54.165614 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3004/5934] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:27:53 2022] GET /compute/v2.1/servers/7b14670a-d0c7-4eae-b840-062a79fbd06a => generated 1689 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:27:54.202069 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-8e078d48-47f9-469f-a4ee-70ed82d31351 req-5564c720-4662-46d5-9305-471bdecec6f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b14670a-d0c7-4eae-b840-062a79fbd06a", "tag": "97ae22d5-6b77-4de4-8076-53c65d74c4d7"}, {"name": "network-changed", "server_uuid": "931e11c7-9245-4481-b1eb-588fd86e30a6", "tag": "29382ecd-3ca3-4bac-98c7-eec27d44e5b8"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:27:54.214527 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-8e078d48-47f9-469f-a4ee-70ed82d31351 req-5564c720-4662-46d5-9305-471bdecec6f1 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:27:54.215130 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-8e078d48-47f9-469f-a4ee-70ed82d31351 req-5564c720-4662-46d5-9305-471bdecec6f1 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:27:54.215646 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-8e078d48-47f9-469f-a4ee-70ed82d31351 req-5564c720-4662-46d5-9305-471bdecec6f1 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:27:54.229706 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-8e078d48-47f9-469f-a4ee-70ed82d31351 req-5564c720-4662-46d5-9305-471bdecec6f1 service nova] Creating event network-changed:97ae22d5-6b77-4de4-8076-53c65d74c4d7 for instance 7b14670a-d0c7-4eae-b840-062a79fbd06a on nch1-master-1 Oct 08 21:27:54.230452 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-8e078d48-47f9-469f-a4ee-70ed82d31351 req-5564c720-4662-46d5-9305-471bdecec6f1 service nova] Creating event network-changed:29382ecd-3ca3-4bac-98c7-eec27d44e5b8 for instance 931e11c7-9245-4481-b1eb-588fd86e30a6 on nch2-master-1 Oct 08 21:27:54.236672 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [req-8e078d48-47f9-469f-a4ee-70ed82d31351 req-5564c720-4662-46d5-9305-471bdecec6f1 service nova] Instance 7b14670a-d0c7-4eae-b840-062a79fbd06a is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140491) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 08 21:27:54.250112 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-8e078d48-47f9-469f-a4ee-70ed82d31351 req-5564c720-4662-46d5-9305-471bdecec6f1 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.052316 Oct 08 21:27:54.251080 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2931/5935] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:27:54 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 08 21:27:55.189173 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-b817c077-027f-4e30-9107-a642b36b1169 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:27:55.189837 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-b817c077-027f-4e30-9107-a642b36b1169 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 7b14670a-d0c7-4eae-b840-062a79fbd06a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:27:55.196650 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b817c077-027f-4e30-9107-a642b36b1169 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:27:55.197149 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b817c077-027f-4e30-9107-a642b36b1169 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:27:55.197631 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b817c077-027f-4e30-9107-a642b36b1169 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:27:55.198344 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b817c077-027f-4e30-9107-a642b36b1169 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:27:55.198810 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b817c077-027f-4e30-9107-a642b36b1169 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:27:55.199250 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b817c077-027f-4e30-9107-a642b36b1169 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:27:55.444062 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-b817c077-027f-4e30-9107-a642b36b1169 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219a93945a147c4a57bb6452212fe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eeb6be960cc408296ecce6353b72f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:27:55.452875 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-b817c077-027f-4e30-9107-a642b36b1169 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "GET /compute/v2.1/servers/7b14670a-d0c7-4eae-b840-062a79fbd06a" status: 200 len: 1689 microversion: 2.1 time: 0.268851 Oct 08 21:27:55.454186 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3005/5936] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:27:55 2022] GET /compute/v2.1/servers/7b14670a-d0c7-4eae-b840-062a79fbd06a => generated 1689 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:27:56.479740 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-4feb03f3-9a83-411a-a11b-2cca9960f784 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:27:56.480538 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-4feb03f3-9a83-411a-a11b-2cca9960f784 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 7b14670a-d0c7-4eae-b840-062a79fbd06a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:27:56.488255 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4feb03f3-9a83-411a-a11b-2cca9960f784 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:27:56.488763 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4feb03f3-9a83-411a-a11b-2cca9960f784 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:27:56.489243 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4feb03f3-9a83-411a-a11b-2cca9960f784 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:27:56.489984 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4feb03f3-9a83-411a-a11b-2cca9960f784 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:27:56.490483 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4feb03f3-9a83-411a-a11b-2cca9960f784 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:27:56.490921 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4feb03f3-9a83-411a-a11b-2cca9960f784 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:27:56.631843 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-4feb03f3-9a83-411a-a11b-2cca9960f784 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219a93945a147c4a57bb6452212fe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eeb6be960cc408296ecce6353b72f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:27:56.640920 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-4feb03f3-9a83-411a-a11b-2cca9960f784 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "GET /compute/v2.1/servers/7b14670a-d0c7-4eae-b840-062a79fbd06a" status: 200 len: 1682 microversion: 2.1 time: 0.166410 Oct 08 21:27:56.642050 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2932/5937] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:27:56 2022] GET /compute/v2.1/servers/7b14670a-d0c7-4eae-b840-062a79fbd06a => generated 1682 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:28:00.793132 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-0ae46592-1cac-449e-9b88-4d83fbe14ea0 req-60aa6987-3cde-4ff5-9e05-fdc1e5b64057 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b14670a-d0c7-4eae-b840-062a79fbd06a", "name": "network-vif-plugged", "status": "completed", "tag": "97ae22d5-6b77-4de4-8076-53c65d74c4d7"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:28:00.804473 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-0ae46592-1cac-449e-9b88-4d83fbe14ea0 req-60aa6987-3cde-4ff5-9e05-fdc1e5b64057 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:28:00.804962 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-0ae46592-1cac-449e-9b88-4d83fbe14ea0 req-60aa6987-3cde-4ff5-9e05-fdc1e5b64057 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:28:00.805521 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-0ae46592-1cac-449e-9b88-4d83fbe14ea0 req-60aa6987-3cde-4ff5-9e05-fdc1e5b64057 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:28:00.816781 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-0ae46592-1cac-449e-9b88-4d83fbe14ea0 req-60aa6987-3cde-4ff5-9e05-fdc1e5b64057 service nova] Creating event network-vif-plugged:97ae22d5-6b77-4de4-8076-53c65d74c4d7 for instance 7b14670a-d0c7-4eae-b840-062a79fbd06a on nch1-master-1 Oct 08 21:28:00.821897 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-0ae46592-1cac-449e-9b88-4d83fbe14ea0 req-60aa6987-3cde-4ff5-9e05-fdc1e5b64057 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032502 Oct 08 21:28:00.822509 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3006/5938] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:28:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:28:22.874485 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-96e6485e-b9b4-4f03-ac0d-5c2fab6ae9ec tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:28:22.876630 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-96e6485e-b9b4-4f03-ac0d-5c2fab6ae9ec tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 7b14670a-d0c7-4eae-b840-062a79fbd06a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:28:22.879210 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:SELECT=5 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:28:22.879896 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:28:22.885884 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-96e6485e-b9b4-4f03-ac0d-5c2fab6ae9ec tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:28:22.886381 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-96e6485e-b9b4-4f03-ac0d-5c2fab6ae9ec tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:28:22.886832 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-96e6485e-b9b4-4f03-ac0d-5c2fab6ae9ec tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:28:22.887547 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-96e6485e-b9b4-4f03-ac0d-5c2fab6ae9ec tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:28:22.888013 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-96e6485e-b9b4-4f03-ac0d-5c2fab6ae9ec tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:28:22.888449 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-96e6485e-b9b4-4f03-ac0d-5c2fab6ae9ec tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:28:22.943462 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-96e6485e-b9b4-4f03-ac0d-5c2fab6ae9ec tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "POST /compute/v2.1/servers/7b14670a-d0c7-4eae-b840-062a79fbd06a/action" status: 200 len: 63089 microversion: 2.1 time: 0.073956 Oct 08 21:28:22.944110 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2933/5939] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:28:22 2022] POST /compute/v2.1/servers/7b14670a-d0c7-4eae-b840-062a79fbd06a/action => generated 63089 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 08 21:28:28.722271 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=5 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:28:28.723018 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=44 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:28:28.727610 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-280798fb-c9dd-4327-95bf-bc388b2084db tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:28:28.728236 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-280798fb-c9dd-4327-95bf-bc388b2084db tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] [instance: 931e11c7-9245-4481-b1eb-588fd86e30a6] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:28:28.735556 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-280798fb-c9dd-4327-95bf-bc388b2084db tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:28:28.736055 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-280798fb-c9dd-4327-95bf-bc388b2084db tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:28:28.736504 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-280798fb-c9dd-4327-95bf-bc388b2084db tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:28:28.737224 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-280798fb-c9dd-4327-95bf-bc388b2084db tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:28:28.737698 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-280798fb-c9dd-4327-95bf-bc388b2084db tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:28:28.738136 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-280798fb-c9dd-4327-95bf-bc388b2084db tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:28:28.763329 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-280798fb-c9dd-4327-95bf-bc388b2084db tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] 10.222.0.26 "GET /compute/v2.1/servers/931e11c7-9245-4481-b1eb-588fd86e30a6/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.042503 Oct 08 21:28:28.763931 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3007/5940] 10.222.0.26 () {58 vars in 1293 bytes} [Sat Oct 8 21:28:28 2022] GET /compute/v2.1/servers/931e11c7-9245-4481-b1eb-588fd86e30a6/os-server-password => generated 116 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:28:29.310975 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-7c5a2628-7eaf-4f46-a240-46b065ebdca3 tempest-TestNetworkAdvancedServerOps-1736509213 tempest-TestNetworkAdvancedServerOps-1736509213-project-admin] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:28:29.311677 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-7c5a2628-7eaf-4f46-a240-46b065ebdca3 tempest-TestNetworkAdvancedServerOps-1736509213 tempest-TestNetworkAdvancedServerOps-1736509213-project-admin] [instance: 7b14670a-d0c7-4eae-b840-062a79fbd06a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:28:29.319235 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7c5a2628-7eaf-4f46-a240-46b065ebdca3 tempest-TestNetworkAdvancedServerOps-1736509213 tempest-TestNetworkAdvancedServerOps-1736509213-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:28:29.319716 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7c5a2628-7eaf-4f46-a240-46b065ebdca3 tempest-TestNetworkAdvancedServerOps-1736509213 tempest-TestNetworkAdvancedServerOps-1736509213-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:28:29.320158 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7c5a2628-7eaf-4f46-a240-46b065ebdca3 tempest-TestNetworkAdvancedServerOps-1736509213 tempest-TestNetworkAdvancedServerOps-1736509213-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:28:29.320853 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7c5a2628-7eaf-4f46-a240-46b065ebdca3 tempest-TestNetworkAdvancedServerOps-1736509213 tempest-TestNetworkAdvancedServerOps-1736509213-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:28:29.321335 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7c5a2628-7eaf-4f46-a240-46b065ebdca3 tempest-TestNetworkAdvancedServerOps-1736509213 tempest-TestNetworkAdvancedServerOps-1736509213-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:28:29.321763 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7c5a2628-7eaf-4f46-a240-46b065ebdca3 tempest-TestNetworkAdvancedServerOps-1736509213 tempest-TestNetworkAdvancedServerOps-1736509213-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:28:29.454614 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-7c5a2628-7eaf-4f46-a240-46b065ebdca3 tempest-TestNetworkAdvancedServerOps-1736509213 tempest-TestNetworkAdvancedServerOps-1736509213-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/7b14670a-d0c7-4eae-b840-062a79fbd06a" status: 200 len: 1833 microversion: 2.1 time: 0.147837 Oct 08 21:28:29.455189 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2934/5941] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:28:29 2022] GET /compute/v2.1/servers/7b14670a-d0c7-4eae-b840-062a79fbd06a => generated 1833 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:28:30.300449 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-7984c1e2-40a4-4313-a672-5503a348c47c tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:28:30.301450 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-7984c1e2-40a4-4313-a672-5503a348c47c tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 7b14670a-d0c7-4eae-b840-062a79fbd06a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:28:30.302164 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-a72dad3e-b1bb-4d1c-b5bf-45386689c720 req-6176c44b-d30f-4597-bb25-e6b1d076eab7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b14670a-d0c7-4eae-b840-062a79fbd06a", "tag": "97ae22d5-6b77-4de4-8076-53c65d74c4d7"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:28:30.308619 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7984c1e2-40a4-4313-a672-5503a348c47c tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:28:30.309743 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7984c1e2-40a4-4313-a672-5503a348c47c tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:28:30.310237 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7984c1e2-40a4-4313-a672-5503a348c47c tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:28:30.311102 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7984c1e2-40a4-4313-a672-5503a348c47c tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:28:30.311438 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7984c1e2-40a4-4313-a672-5503a348c47c tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:28:30.311869 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7984c1e2-40a4-4313-a672-5503a348c47c tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:28:30.313474 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-a72dad3e-b1bb-4d1c-b5bf-45386689c720 req-6176c44b-d30f-4597-bb25-e6b1d076eab7 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:28:30.314011 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-a72dad3e-b1bb-4d1c-b5bf-45386689c720 req-6176c44b-d30f-4597-bb25-e6b1d076eab7 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:28:30.314673 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-a72dad3e-b1bb-4d1c-b5bf-45386689c720 req-6176c44b-d30f-4597-bb25-e6b1d076eab7 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:28:30.327984 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-a72dad3e-b1bb-4d1c-b5bf-45386689c720 req-6176c44b-d30f-4597-bb25-e6b1d076eab7 service nova] Creating event network-changed:97ae22d5-6b77-4de4-8076-53c65d74c4d7 for instance 7b14670a-d0c7-4eae-b840-062a79fbd06a on nch1-master-1 Oct 08 21:28:30.333275 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-a72dad3e-b1bb-4d1c-b5bf-45386689c720 req-6176c44b-d30f-4597-bb25-e6b1d076eab7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034910 Oct 08 21:28:30.333899 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2935/5942] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:28:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 08 21:28:30.342107 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-7984c1e2-40a4-4313-a672-5503a348c47c tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 7b14670a-d0c7-4eae-b840-062a79fbd06a] Going to try to terminate instance {{(pid=140492) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 21:28:30.433835 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-7984c1e2-40a4-4313-a672-5503a348c47c tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "DELETE /compute/v2.1/servers/7b14670a-d0c7-4eae-b840-062a79fbd06a" status: 204 len: 0 microversion: 2.1 time: 0.137239 Oct 08 21:28:30.435440 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3008/5943] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:28:30 2022] DELETE /compute/v2.1/servers/7b14670a-d0c7-4eae-b840-062a79fbd06a => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 21:28:30.445220 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-77327a61-36fe-4750-b043-d9e0c29cd0a2 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:28:30.446952 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-77327a61-36fe-4750-b043-d9e0c29cd0a2 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 7b14670a-d0c7-4eae-b840-062a79fbd06a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:28:30.455017 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-77327a61-36fe-4750-b043-d9e0c29cd0a2 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:28:30.456343 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-77327a61-36fe-4750-b043-d9e0c29cd0a2 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:28:30.457091 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-77327a61-36fe-4750-b043-d9e0c29cd0a2 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:28:30.458548 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-77327a61-36fe-4750-b043-d9e0c29cd0a2 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:28:30.460848 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-77327a61-36fe-4750-b043-d9e0c29cd0a2 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:28:30.460848 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-77327a61-36fe-4750-b043-d9e0c29cd0a2 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:28:30.616186 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-77327a61-36fe-4750-b043-d9e0c29cd0a2 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219a93945a147c4a57bb6452212fe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eeb6be960cc408296ecce6353b72f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:28:30.624793 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-77327a61-36fe-4750-b043-d9e0c29cd0a2 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "GET /compute/v2.1/servers/7b14670a-d0c7-4eae-b840-062a79fbd06a" status: 200 len: 1688 microversion: 2.1 time: 0.184590 Oct 08 21:28:30.625414 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2936/5944] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:28:30 2022] GET /compute/v2.1/servers/7b14670a-d0c7-4eae-b840-062a79fbd06a => generated 1688 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:28:31.648734 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-806f71a1-a431-43d4-9983-91f2a785a194 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:28:31.649508 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-806f71a1-a431-43d4-9983-91f2a785a194 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 7b14670a-d0c7-4eae-b840-062a79fbd06a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:28:31.656442 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-806f71a1-a431-43d4-9983-91f2a785a194 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:28:31.656949 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-806f71a1-a431-43d4-9983-91f2a785a194 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:28:31.657460 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-806f71a1-a431-43d4-9983-91f2a785a194 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:28:31.658319 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-806f71a1-a431-43d4-9983-91f2a785a194 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:28:31.658718 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-806f71a1-a431-43d4-9983-91f2a785a194 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:28:31.659154 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-806f71a1-a431-43d4-9983-91f2a785a194 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:28:31.830911 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-806f71a1-a431-43d4-9983-91f2a785a194 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219a93945a147c4a57bb6452212fe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eeb6be960cc408296ecce6353b72f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:28:31.838796 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-806f71a1-a431-43d4-9983-91f2a785a194 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "GET /compute/v2.1/servers/7b14670a-d0c7-4eae-b840-062a79fbd06a" status: 200 len: 1688 microversion: 2.1 time: 0.194403 Oct 08 21:28:31.839377 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3009/5945] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:28:31 2022] GET /compute/v2.1/servers/7b14670a-d0c7-4eae-b840-062a79fbd06a => generated 1688 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:28:32.426438 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-0293a0f9-953e-41c0-b73a-eac30505c9b8 req-6edde025-c919-45b5-88a5-d2b87b3d5c1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b14670a-d0c7-4eae-b840-062a79fbd06a", "name": "network-vif-deleted", "tag": "97ae22d5-6b77-4de4-8076-53c65d74c4d7"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:28:32.436057 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-0293a0f9-953e-41c0-b73a-eac30505c9b8 req-6edde025-c919-45b5-88a5-d2b87b3d5c1b service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:28:32.436542 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-0293a0f9-953e-41c0-b73a-eac30505c9b8 req-6edde025-c919-45b5-88a5-d2b87b3d5c1b service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:28:32.437000 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-0293a0f9-953e-41c0-b73a-eac30505c9b8 req-6edde025-c919-45b5-88a5-d2b87b3d5c1b service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:28:32.448342 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-0293a0f9-953e-41c0-b73a-eac30505c9b8 req-6edde025-c919-45b5-88a5-d2b87b3d5c1b service nova] Creating event network-vif-deleted:97ae22d5-6b77-4de4-8076-53c65d74c4d7 for instance 7b14670a-d0c7-4eae-b840-062a79fbd06a on nch1-master-1 Oct 08 21:28:32.453018 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-0293a0f9-953e-41c0-b73a-eac30505c9b8 req-6edde025-c919-45b5-88a5-d2b87b3d5c1b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103403 Oct 08 21:28:32.453665 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2937/5946] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:28:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:28:32.861867 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-36a80f4b-e13a-46f0-8028-ec8d57fa74c5 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:28:32.862493 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-36a80f4b-e13a-46f0-8028-ec8d57fa74c5 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 7b14670a-d0c7-4eae-b840-062a79fbd06a] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:28:32.869564 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-36a80f4b-e13a-46f0-8028-ec8d57fa74c5 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:28:32.870008 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-36a80f4b-e13a-46f0-8028-ec8d57fa74c5 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:28:32.870463 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-36a80f4b-e13a-46f0-8028-ec8d57fa74c5 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:28:32.871182 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-36a80f4b-e13a-46f0-8028-ec8d57fa74c5 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:28:32.871659 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-36a80f4b-e13a-46f0-8028-ec8d57fa74c5 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:28:32.872101 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-36a80f4b-e13a-46f0-8028-ec8d57fa74c5 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:28:32.907815 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-36a80f4b-e13a-46f0-8028-ec8d57fa74c5 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:28:32.908313 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-36a80f4b-e13a-46f0-8028-ec8d57fa74c5 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:28:32.908793 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-36a80f4b-e13a-46f0-8028-ec8d57fa74c5 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:28:32.909293 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.objects.instance [None req-36a80f4b-e13a-46f0-8028-ec8d57fa74c5 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lazy-loading 'fault' on Instance uuid 7b14670a-d0c7-4eae-b840-062a79fbd06a {{(pid=140492) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 21:28:32.951474 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-36a80f4b-e13a-46f0-8028-ec8d57fa74c5 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219a93945a147c4a57bb6452212fe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eeb6be960cc408296ecce6353b72f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:28:32.958841 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-36a80f4b-e13a-46f0-8028-ec8d57fa74c5 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "GET /compute/v2.1/servers/7b14670a-d0c7-4eae-b840-062a79fbd06a" status: 200 len: 1356 microversion: 2.1 time: 0.101124 Oct 08 21:28:32.959435 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3010/5947] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:28:32 2022] GET /compute/v2.1/servers/7b14670a-d0c7-4eae-b840-062a79fbd06a => generated 1356 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:28:33.984429 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-3863fa38-2f14-46f2-ab2b-41abac821415 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:28:33.985142 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-3863fa38-2f14-46f2-ab2b-41abac821415 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 7b14670a-d0c7-4eae-b840-062a79fbd06a] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:28:33.991449 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3863fa38-2f14-46f2-ab2b-41abac821415 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:28:33.991956 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3863fa38-2f14-46f2-ab2b-41abac821415 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:28:33.992404 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3863fa38-2f14-46f2-ab2b-41abac821415 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:28:33.993111 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3863fa38-2f14-46f2-ab2b-41abac821415 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:28:33.993606 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3863fa38-2f14-46f2-ab2b-41abac821415 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:28:33.994045 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3863fa38-2f14-46f2-ab2b-41abac821415 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:28:34.007512 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-3863fa38-2f14-46f2-ab2b-41abac821415 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] HTTP exception thrown: Instance 7b14670a-d0c7-4eae-b840-062a79fbd06a could not be found. Oct 08 21:28:34.009137 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-3863fa38-2f14-46f2-ab2b-41abac821415 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Request method failure captured: Oct 08 21:28:34.009137 ncdv-master-1 devstack@n-api.service[140491]: request: GET /compute/v2.1/servers/7b14670a-d0c7-4eae-b840-062a79fbd06a HTTP/1.1 Oct 08 21:28:34.009137 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:28:34.009137 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:28:34.009137 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:28:34.009137 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 21:28:34.009137 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:28:34.009137 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:28:34.009137 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:28:34.009137 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:28:34.009137 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQep7EvEBtlUVHm2Z-xMUemo1fDuPodMx_QgvV--hhoE4MZz4OfLqVPlQBRPz5RXJ-HR4rz7JLlm8ih4Dn0GIB8br_D1WCF0uLTJeFZ1bD6SPHzzM0aO_EdLw0wg9AzNCfT-tNLgSCtS6oMoxL2RTAOI-_GcrcxStl7sgnRfFgr5x1Qs Oct 08 21:28:34.009137 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:28:34.009137 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:28:34.009137 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:28:34.009137 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:28:34.009137 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:28:34.009137 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:28:34.009137 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 3eeb6be960cc408296ecce6353b72f6d Oct 08 21:28:34.009137 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-651255446 Oct 08 21:28:34.009137 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:28:34.009137 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:28:34.009137 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3eeb6be960cc408296ecce6353b72f6d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3eeb6be960cc408296ecce6353b72f6d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3eeb6be960cc408296ecce6353b72f6d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3eeb6be960cc408296ecce6353b72f6d"}]}] Oct 08 21:28:34.009137 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-TestNetworkAdvancedServerOps-651255446 Oct 08 21:28:34.009137 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 3eeb6be960cc408296ecce6353b72f6d Oct 08 21:28:34.009137 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-651255446 Oct 08 21:28:34.009137 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-TestNetworkAdvancedServerOps-651255446-project Oct 08 21:28:34.009137 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:28:34.009137 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:28:34.009137 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 8219a93945a147c4a57bb6452212fe7c Oct 08 21:28:34.009137 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-TestNetworkAdvancedServerOps-651255446-project Oct 08 21:28:34.009137 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:28:34.009137 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance 7b14670a-d0c7-4eae-b840-062a79fbd06a could not be found. Oct 08 21:28:34.009137 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': '7b14670a-d0c7-4eae-b840-062a79fbd06a'} Oct 08 21:28:34.009137 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:28:34.009137 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:28:34.009137 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:28:34.009137 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:28:34.009137 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:28:34.009137 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:28:34.009137 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:28:34.009137 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:28:34.009137 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:28:34.009137 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:28:34.009137 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b14670a-d0c7-4eae-b840-062a79fbd06a could not be found. Oct 08 21:28:34.009137 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:28:34.009137 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:28:34.009137 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:28:34.009137 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:28:34.009137 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:28:34.009137 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:28:34.009137 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:28:34.009137 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:28:34.009137 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:28:34.009137 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:28:34.009137 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:28:34.009137 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:28:34.009137 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:28:34.009137 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:28:34.009137 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:28:34.009137 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:28:34.009137 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b14670a-d0c7-4eae-b840-062a79fbd06a could not be found. Oct 08 21:28:34.009137 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:28:34.009137 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:28:34.013115 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:28:34.013115 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:28:34.013115 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:28:34.013115 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:28:34.013115 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:28:34.013115 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:28:34.013115 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b14670a-d0c7-4eae-b840-062a79fbd06a could not be found. Oct 08 21:28:34.013115 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:28:34.013115 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-3863fa38-2f14-46f2-ab2b-41abac821415 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Returning 404 to user: Instance 7b14670a-d0c7-4eae-b840-062a79fbd06a could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:28:34.013115 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-3863fa38-2f14-46f2-ab2b-41abac821415 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "GET /compute/v2.1/servers/7b14670a-d0c7-4eae-b840-062a79fbd06a" status: 404 len: 111 microversion: 2.1 time: 0.032245 Oct 08 21:28:34.013115 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2938/5948] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:28:33 2022] GET /compute/v2.1/servers/7b14670a-d0c7-4eae-b840-062a79fbd06a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:28:37.253559 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-c3312e5b-cb37-44bb-8195-bc839569a93f tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Calling method '.version_select at 0x7f1a87c56f70>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:28:37.277125 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-c3312e5b-cb37-44bb-8195-bc839569a93f tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1537072806" status: 202 len: 0 microversion: 2.1 time: 0.027928 Oct 08 21:28:37.277818 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3011/5949] 10.222.0.26 () {58 vars in 1284 bytes} [Sat Oct 8 21:28:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1537072806 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 21:28:37.314692 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-60de6622-f624-4a29-8e4a-09849becadcf tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Action: 'create', calling method: .version_select at 0x7f1a8c917a60>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1241881951", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBYnRtL00UWK6ptEeygFLP4M0FfFSOBUihj0grulAfW+e7+8d7one7jzckeG4r4SfF54UcDH6RppqA0N92mmAXhMNHxqlqSLPNNEoELeVXTOxuG5ynz++5lhzDa4Z/uXIQ=="}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:28:37.332214 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-60de6622-f624-4a29-8e4a-09849becadcf tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Getting quotas for project 3eeb6be960cc408296ecce6353b72f6d. Resources: {'key_pairs'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:28:37.338138 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-60de6622-f624-4a29-8e4a-09849becadcf tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Getting quotas for user 8219a93945a147c4a57bb6452212fe7c and project 3eeb6be960cc408296ecce6353b72f6d. Resources: {'key_pairs'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:28:37.362166 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-60de6622-f624-4a29-8e4a-09849becadcf tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.052083 Oct 08 21:28:37.362681 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2939/5950] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Oct 8 21:28:37 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:28:42.880957 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-2b3e5e62-ac61-47b9-a054-3af8ee5eeab9 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1237979203", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "networks": [{"uuid": "e0ef3cae-44a3-4a3d-a27f-f073a50a9b7c"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1241881951", "security_groups": [{"name": "tempest-secgroup-smoke-318848843"}]}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:28:42.955435 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:28:42.990709 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.network.neutron [None req-2b3e5e62-ac61-47b9-a054-3af8ee5eeab9 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] validate_networks() for [('e0ef3cae-44a3-4a3d-a27f-f073a50a9b7c', None, None, None, None, None)] {{(pid=140492) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 21:28:43.486163 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-2b3e5e62-ac61-47b9-a054-3af8ee5eeab9 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Flavor limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 21:28:43.489146 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-2b3e5e62-ac61-47b9-a054-3af8ee5eeab9 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Image limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 21:28:43.490722 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-2b3e5e62-ac61-47b9-a054-3af8ee5eeab9 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Flavor pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 21:28:43.491173 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-2b3e5e62-ac61-47b9-a054-3af8ee5eeab9 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Image pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 21:28:43.491664 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-2b3e5e62-ac61-47b9-a054-3af8ee5eeab9 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 21:28:43.505551 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2b3e5e62-ac61-47b9-a054-3af8ee5eeab9 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:28:43.506055 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2b3e5e62-ac61-47b9-a054-3af8ee5eeab9 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:28:43.506509 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2b3e5e62-ac61-47b9-a054-3af8ee5eeab9 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:28:43.507340 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2b3e5e62-ac61-47b9-a054-3af8ee5eeab9 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:28:43.508446 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2b3e5e62-ac61-47b9-a054-3af8ee5eeab9 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:28:43.509467 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2b3e5e62-ac61-47b9-a054-3af8ee5eeab9 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:28:43.542850 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-2b3e5e62-ac61-47b9-a054-3af8ee5eeab9 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Getting quotas for project 3eeb6be960cc408296ecce6353b72f6d. Resources: {'cores', 'instances', 'ram'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:28:43.549944 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-2b3e5e62-ac61-47b9-a054-3af8ee5eeab9 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Getting quotas for user 8219a93945a147c4a57bb6452212fe7c and project 3eeb6be960cc408296ecce6353b72f6d. Resources: {'cores', 'instances', 'ram'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:28:43.565646 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-2b3e5e62-ac61-47b9-a054-3af8ee5eeab9 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Going to run 1 instances... {{(pid=140492) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 21:28:43.569776 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-2b3e5e62-ac61-47b9-a054-3af8ee5eeab9 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 91efce57-cc54-4e70-8867-fc8ce13d6117] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c508bd7f-7db9-4b2c-af7c-be54a855c355',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140492) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 21:28:43.646595 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-2b3e5e62-ac61-47b9-a054-3af8ee5eeab9 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.771797 Oct 08 21:28:43.655267 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3012/5951] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 21:28:42 2022] POST /compute/v2.1/servers => generated 405 bytes in 781 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 08 21:28:43.667489 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-995682c7-53c0-4bfa-a6c1-b81c15ca3863 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:28:43.668710 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-995682c7-53c0-4bfa-a6c1-b81c15ca3863 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 91efce57-cc54-4e70-8867-fc8ce13d6117] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:28:43.746879 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-995682c7-53c0-4bfa-a6c1-b81c15ca3863 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219a93945a147c4a57bb6452212fe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eeb6be960cc408296ecce6353b72f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:28:43.756924 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-995682c7-53c0-4bfa-a6c1-b81c15ca3863 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "GET /compute/v2.1/servers/91efce57-cc54-4e70-8867-fc8ce13d6117" status: 200 len: 1267 microversion: 2.1 time: 0.093500 Oct 08 21:28:43.758121 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2940/5952] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:28:43 2022] GET /compute/v2.1/servers/91efce57-cc54-4e70-8867-fc8ce13d6117 => generated 1267 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:28:44.780838 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-bcd4f0e4-e4b9-48db-90ca-4da89577092b tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:28:44.781487 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-bcd4f0e4-e4b9-48db-90ca-4da89577092b tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 91efce57-cc54-4e70-8867-fc8ce13d6117] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:28:44.787614 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bcd4f0e4-e4b9-48db-90ca-4da89577092b tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:28:44.788107 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bcd4f0e4-e4b9-48db-90ca-4da89577092b tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:28:44.788552 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bcd4f0e4-e4b9-48db-90ca-4da89577092b tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:28:44.789285 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bcd4f0e4-e4b9-48db-90ca-4da89577092b tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:28:44.789760 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bcd4f0e4-e4b9-48db-90ca-4da89577092b tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:28:44.790310 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bcd4f0e4-e4b9-48db-90ca-4da89577092b tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:28:44.861567 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-bcd4f0e4-e4b9-48db-90ca-4da89577092b tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219a93945a147c4a57bb6452212fe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eeb6be960cc408296ecce6353b72f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:28:44.869803 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-bcd4f0e4-e4b9-48db-90ca-4da89577092b tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "GET /compute/v2.1/servers/91efce57-cc54-4e70-8867-fc8ce13d6117" status: 200 len: 1319 microversion: 2.1 time: 0.093614 Oct 08 21:28:44.870401 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3013/5953] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:28:44 2022] GET /compute/v2.1/servers/91efce57-cc54-4e70-8867-fc8ce13d6117 => generated 1319 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:28:45.895247 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c1265788-e7eb-4734-8a1d-4b5eaa35b8c3 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:28:45.895886 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-c1265788-e7eb-4734-8a1d-4b5eaa35b8c3 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 91efce57-cc54-4e70-8867-fc8ce13d6117] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:28:45.905999 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=22 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:28:45.915710 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c1265788-e7eb-4734-8a1d-4b5eaa35b8c3 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:28:45.916842 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c1265788-e7eb-4734-8a1d-4b5eaa35b8c3 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:28:45.917713 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c1265788-e7eb-4734-8a1d-4b5eaa35b8c3 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:28:45.918940 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c1265788-e7eb-4734-8a1d-4b5eaa35b8c3 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:28:45.919774 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c1265788-e7eb-4734-8a1d-4b5eaa35b8c3 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:28:45.920427 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c1265788-e7eb-4734-8a1d-4b5eaa35b8c3 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:28:46.160249 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-c1265788-e7eb-4734-8a1d-4b5eaa35b8c3 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219a93945a147c4a57bb6452212fe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eeb6be960cc408296ecce6353b72f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:28:46.168596 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-c1265788-e7eb-4734-8a1d-4b5eaa35b8c3 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "GET /compute/v2.1/servers/91efce57-cc54-4e70-8867-fc8ce13d6117" status: 200 len: 1392 microversion: 2.1 time: 0.278352 Oct 08 21:28:46.169248 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2941/5954] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:28:45 2022] GET /compute/v2.1/servers/91efce57-cc54-4e70-8867-fc8ce13d6117 => generated 1392 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:28:46.538660 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-3a07b558-1756-4e50-bad1-1fb90af57397 req-be02dfc0-ed97-4b01-844b-89ed08ff6c34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91efce57-cc54-4e70-8867-fc8ce13d6117", "tag": "d1524c09-88b8-4e8e-8958-452eebdafd18"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:28:46.551179 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-3a07b558-1756-4e50-bad1-1fb90af57397 req-be02dfc0-ed97-4b01-844b-89ed08ff6c34 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:28:46.552008 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-3a07b558-1756-4e50-bad1-1fb90af57397 req-be02dfc0-ed97-4b01-844b-89ed08ff6c34 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:28:46.552601 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-3a07b558-1756-4e50-bad1-1fb90af57397 req-be02dfc0-ed97-4b01-844b-89ed08ff6c34 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:28:46.564499 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-3a07b558-1756-4e50-bad1-1fb90af57397 req-be02dfc0-ed97-4b01-844b-89ed08ff6c34 service nova] Creating event network-changed:d1524c09-88b8-4e8e-8958-452eebdafd18 for instance 91efce57-cc54-4e70-8867-fc8ce13d6117 on nch1-master-1 Oct 08 21:28:46.569537 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-3a07b558-1756-4e50-bad1-1fb90af57397 req-be02dfc0-ed97-4b01-844b-89ed08ff6c34 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034702 Oct 08 21:28:46.570405 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3014/5955] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:28:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:28:47.192491 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-e2ad1a4a-4e7f-4762-819c-b3a66750b97d tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:28:47.193224 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-e2ad1a4a-4e7f-4762-819c-b3a66750b97d tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 91efce57-cc54-4e70-8867-fc8ce13d6117] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:28:47.200348 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e2ad1a4a-4e7f-4762-819c-b3a66750b97d tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:28:47.200841 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e2ad1a4a-4e7f-4762-819c-b3a66750b97d tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:28:47.201307 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e2ad1a4a-4e7f-4762-819c-b3a66750b97d tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:28:47.202025 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e2ad1a4a-4e7f-4762-819c-b3a66750b97d tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:28:47.202481 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e2ad1a4a-4e7f-4762-819c-b3a66750b97d tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:28:47.202908 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e2ad1a4a-4e7f-4762-819c-b3a66750b97d tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:28:47.339515 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-e2ad1a4a-4e7f-4762-819c-b3a66750b97d tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219a93945a147c4a57bb6452212fe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eeb6be960cc408296ecce6353b72f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:28:47.348077 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-e2ad1a4a-4e7f-4762-819c-b3a66750b97d tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "GET /compute/v2.1/servers/91efce57-cc54-4e70-8867-fc8ce13d6117" status: 200 len: 1392 microversion: 2.1 time: 0.159686 Oct 08 21:28:47.348647 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2942/5956] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:28:47 2022] GET /compute/v2.1/servers/91efce57-cc54-4e70-8867-fc8ce13d6117 => generated 1392 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:28:48.373680 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-53e880d9-e4eb-4570-b70f-52e805dc7caa tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:28:48.374380 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-53e880d9-e4eb-4570-b70f-52e805dc7caa tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 91efce57-cc54-4e70-8867-fc8ce13d6117] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:28:48.380666 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-53e880d9-e4eb-4570-b70f-52e805dc7caa tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:28:48.381153 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-53e880d9-e4eb-4570-b70f-52e805dc7caa tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:28:48.381636 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-53e880d9-e4eb-4570-b70f-52e805dc7caa tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:28:48.382344 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-53e880d9-e4eb-4570-b70f-52e805dc7caa tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:28:48.382812 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-53e880d9-e4eb-4570-b70f-52e805dc7caa tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:28:48.383242 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-53e880d9-e4eb-4570-b70f-52e805dc7caa tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:28:48.518905 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-53e880d9-e4eb-4570-b70f-52e805dc7caa tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219a93945a147c4a57bb6452212fe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eeb6be960cc408296ecce6353b72f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:28:48.527337 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-53e880d9-e4eb-4570-b70f-52e805dc7caa tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "GET /compute/v2.1/servers/91efce57-cc54-4e70-8867-fc8ce13d6117" status: 200 len: 1392 microversion: 2.1 time: 0.159390 Oct 08 21:28:48.527985 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3015/5957] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:28:48 2022] GET /compute/v2.1/servers/91efce57-cc54-4e70-8867-fc8ce13d6117 => generated 1392 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:28:49.550253 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-acb5518e-c4cf-456b-9a7f-d59d6840d4a5 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:28:49.550867 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-acb5518e-c4cf-456b-9a7f-d59d6840d4a5 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 91efce57-cc54-4e70-8867-fc8ce13d6117] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:28:49.557785 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-acb5518e-c4cf-456b-9a7f-d59d6840d4a5 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:28:49.558274 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-acb5518e-c4cf-456b-9a7f-d59d6840d4a5 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:28:49.558717 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-acb5518e-c4cf-456b-9a7f-d59d6840d4a5 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:28:49.559411 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-acb5518e-c4cf-456b-9a7f-d59d6840d4a5 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:28:49.559872 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-acb5518e-c4cf-456b-9a7f-d59d6840d4a5 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:28:49.560891 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-acb5518e-c4cf-456b-9a7f-d59d6840d4a5 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:28:49.691575 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-acb5518e-c4cf-456b-9a7f-d59d6840d4a5 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219a93945a147c4a57bb6452212fe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eeb6be960cc408296ecce6353b72f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:28:49.699393 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-acb5518e-c4cf-456b-9a7f-d59d6840d4a5 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "GET /compute/v2.1/servers/91efce57-cc54-4e70-8867-fc8ce13d6117" status: 200 len: 1392 microversion: 2.1 time: 0.153064 Oct 08 21:28:49.699970 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2943/5958] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:28:49 2022] GET /compute/v2.1/servers/91efce57-cc54-4e70-8867-fc8ce13d6117 => generated 1392 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:28:50.723256 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-21f4e562-5a1d-4e5b-9d72-eebee9dc2a11 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:28:50.723876 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-21f4e562-5a1d-4e5b-9d72-eebee9dc2a11 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 91efce57-cc54-4e70-8867-fc8ce13d6117] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:28:50.731052 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-21f4e562-5a1d-4e5b-9d72-eebee9dc2a11 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:28:50.731492 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-21f4e562-5a1d-4e5b-9d72-eebee9dc2a11 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:28:50.731937 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-21f4e562-5a1d-4e5b-9d72-eebee9dc2a11 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:28:50.732711 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-21f4e562-5a1d-4e5b-9d72-eebee9dc2a11 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:28:50.733463 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-21f4e562-5a1d-4e5b-9d72-eebee9dc2a11 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:28:50.733896 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-21f4e562-5a1d-4e5b-9d72-eebee9dc2a11 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:28:50.870681 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-21f4e562-5a1d-4e5b-9d72-eebee9dc2a11 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219a93945a147c4a57bb6452212fe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eeb6be960cc408296ecce6353b72f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:28:50.879676 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-21f4e562-5a1d-4e5b-9d72-eebee9dc2a11 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "GET /compute/v2.1/servers/91efce57-cc54-4e70-8867-fc8ce13d6117" status: 200 len: 1392 microversion: 2.1 time: 0.160340 Oct 08 21:28:50.880248 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3016/5959] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:28:50 2022] GET /compute/v2.1/servers/91efce57-cc54-4e70-8867-fc8ce13d6117 => generated 1392 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:28:51.903317 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-23ba2371-4e0e-44d0-badf-c4b8e758af94 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:28:51.904356 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-23ba2371-4e0e-44d0-badf-c4b8e758af94 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 91efce57-cc54-4e70-8867-fc8ce13d6117] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:28:51.911249 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-23ba2371-4e0e-44d0-badf-c4b8e758af94 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:28:51.911736 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-23ba2371-4e0e-44d0-badf-c4b8e758af94 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:28:51.912180 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-23ba2371-4e0e-44d0-badf-c4b8e758af94 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:28:51.912874 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-23ba2371-4e0e-44d0-badf-c4b8e758af94 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:28:51.913364 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-23ba2371-4e0e-44d0-badf-c4b8e758af94 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:28:51.913792 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-23ba2371-4e0e-44d0-badf-c4b8e758af94 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:28:52.043614 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-23ba2371-4e0e-44d0-badf-c4b8e758af94 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219a93945a147c4a57bb6452212fe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eeb6be960cc408296ecce6353b72f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:28:52.052022 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-23ba2371-4e0e-44d0-badf-c4b8e758af94 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "GET /compute/v2.1/servers/91efce57-cc54-4e70-8867-fc8ce13d6117" status: 200 len: 1392 microversion: 2.1 time: 0.152718 Oct 08 21:28:52.052591 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2944/5960] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:28:51 2022] GET /compute/v2.1/servers/91efce57-cc54-4e70-8867-fc8ce13d6117 => generated 1392 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:28:53.075749 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-5c9bc008-3e13-42ef-9468-f998676a4122 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:28:53.076463 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-5c9bc008-3e13-42ef-9468-f998676a4122 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 91efce57-cc54-4e70-8867-fc8ce13d6117] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:28:53.079249 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=1 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:28:53.081837 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-c2ad9e63-804d-4db2-aade-064ab6a223a4 req-85bdd778-3763-4b86-8f83-5782ed7b1f22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91efce57-cc54-4e70-8867-fc8ce13d6117", "name": "network-vif-plugged", "status": "completed", "tag": "d1524c09-88b8-4e8e-8958-452eebdafd18"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:28:53.084967 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5c9bc008-3e13-42ef-9468-f998676a4122 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:28:53.085516 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5c9bc008-3e13-42ef-9468-f998676a4122 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:28:53.086027 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5c9bc008-3e13-42ef-9468-f998676a4122 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:28:53.086702 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5c9bc008-3e13-42ef-9468-f998676a4122 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:28:53.087173 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5c9bc008-3e13-42ef-9468-f998676a4122 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:28:53.087645 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5c9bc008-3e13-42ef-9468-f998676a4122 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:28:53.092606 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-c2ad9e63-804d-4db2-aade-064ab6a223a4 req-85bdd778-3763-4b86-8f83-5782ed7b1f22 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:28:53.093176 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-c2ad9e63-804d-4db2-aade-064ab6a223a4 req-85bdd778-3763-4b86-8f83-5782ed7b1f22 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:28:53.093675 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-c2ad9e63-804d-4db2-aade-064ab6a223a4 req-85bdd778-3763-4b86-8f83-5782ed7b1f22 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:28:53.104243 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-c2ad9e63-804d-4db2-aade-064ab6a223a4 req-85bdd778-3763-4b86-8f83-5782ed7b1f22 service nova] Creating event network-vif-plugged:d1524c09-88b8-4e8e-8958-452eebdafd18 for instance 91efce57-cc54-4e70-8867-fc8ce13d6117 on nch1-master-1 Oct 08 21:28:53.109845 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-c2ad9e63-804d-4db2-aade-064ab6a223a4 req-85bdd778-3763-4b86-8f83-5782ed7b1f22 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103868 Oct 08 21:28:53.110615 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3017/5961] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:28:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:28:53.271342 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-5c9bc008-3e13-42ef-9468-f998676a4122 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219a93945a147c4a57bb6452212fe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eeb6be960cc408296ecce6353b72f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:28:53.280529 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-5c9bc008-3e13-42ef-9468-f998676a4122 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "GET /compute/v2.1/servers/91efce57-cc54-4e70-8867-fc8ce13d6117" status: 200 len: 1392 microversion: 2.1 time: 0.208658 Oct 08 21:28:53.293773 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2945/5962] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:28:53 2022] GET /compute/v2.1/servers/91efce57-cc54-4e70-8867-fc8ce13d6117 => generated 1392 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:28:54.302769 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=2 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:28:54.304186 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=6 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:28:54.309648 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-a2d6b15d-ffb7-4d19-b200-0fc2bb34ae83 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:28:54.310357 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-a2d6b15d-ffb7-4d19-b200-0fc2bb34ae83 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 91efce57-cc54-4e70-8867-fc8ce13d6117] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:28:54.317777 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a2d6b15d-ffb7-4d19-b200-0fc2bb34ae83 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:28:54.318291 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a2d6b15d-ffb7-4d19-b200-0fc2bb34ae83 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:28:54.318734 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a2d6b15d-ffb7-4d19-b200-0fc2bb34ae83 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:28:54.319487 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a2d6b15d-ffb7-4d19-b200-0fc2bb34ae83 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:28:54.319953 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a2d6b15d-ffb7-4d19-b200-0fc2bb34ae83 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:28:54.320385 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a2d6b15d-ffb7-4d19-b200-0fc2bb34ae83 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:28:54.456337 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-a2d6b15d-ffb7-4d19-b200-0fc2bb34ae83 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219a93945a147c4a57bb6452212fe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eeb6be960cc408296ecce6353b72f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:28:54.464264 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-a2d6b15d-ffb7-4d19-b200-0fc2bb34ae83 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "GET /compute/v2.1/servers/91efce57-cc54-4e70-8867-fc8ce13d6117" status: 200 len: 1392 microversion: 2.1 time: 0.162436 Oct 08 21:28:54.464938 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3018/5963] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:28:54 2022] GET /compute/v2.1/servers/91efce57-cc54-4e70-8867-fc8ce13d6117 => generated 1392 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:28:55.487589 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-8ef684a1-1b50-4d6a-9fb0-8daf5f14ca4f tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:28:55.488385 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-8ef684a1-1b50-4d6a-9fb0-8daf5f14ca4f tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 91efce57-cc54-4e70-8867-fc8ce13d6117] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:28:55.490183 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=6 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:28:55.496505 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8ef684a1-1b50-4d6a-9fb0-8daf5f14ca4f tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:28:55.497031 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8ef684a1-1b50-4d6a-9fb0-8daf5f14ca4f tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:28:55.497513 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8ef684a1-1b50-4d6a-9fb0-8daf5f14ca4f tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:28:55.498233 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8ef684a1-1b50-4d6a-9fb0-8daf5f14ca4f tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:28:55.499197 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8ef684a1-1b50-4d6a-9fb0-8daf5f14ca4f tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:28:55.499637 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8ef684a1-1b50-4d6a-9fb0-8daf5f14ca4f tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:28:55.636117 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-8ef684a1-1b50-4d6a-9fb0-8daf5f14ca4f tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219a93945a147c4a57bb6452212fe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eeb6be960cc408296ecce6353b72f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:28:55.644654 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-8ef684a1-1b50-4d6a-9fb0-8daf5f14ca4f tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "GET /compute/v2.1/servers/91efce57-cc54-4e70-8867-fc8ce13d6117" status: 200 len: 1565 microversion: 2.1 time: 0.161407 Oct 08 21:28:55.645239 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2946/5964] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:28:55 2022] GET /compute/v2.1/servers/91efce57-cc54-4e70-8867-fc8ce13d6117 => generated 1565 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:28:55.667176 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-547f0d83-6b69-4094-8acc-e3e8e38113db tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:28:55.667842 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-547f0d83-6b69-4094-8acc-e3e8e38113db tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 91efce57-cc54-4e70-8867-fc8ce13d6117] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:28:55.675268 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-547f0d83-6b69-4094-8acc-e3e8e38113db tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:28:55.675764 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-547f0d83-6b69-4094-8acc-e3e8e38113db tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:28:55.676238 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-547f0d83-6b69-4094-8acc-e3e8e38113db tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:28:55.676974 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-547f0d83-6b69-4094-8acc-e3e8e38113db tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:28:55.677461 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-547f0d83-6b69-4094-8acc-e3e8e38113db tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:28:55.677897 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-547f0d83-6b69-4094-8acc-e3e8e38113db tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:28:55.815464 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-547f0d83-6b69-4094-8acc-e3e8e38113db tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219a93945a147c4a57bb6452212fe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eeb6be960cc408296ecce6353b72f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:28:55.824940 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-547f0d83-6b69-4094-8acc-e3e8e38113db tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "GET /compute/v2.1/servers/91efce57-cc54-4e70-8867-fc8ce13d6117" status: 200 len: 1565 microversion: 2.1 time: 0.162101 Oct 08 21:28:55.825555 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3019/5965] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:28:55 2022] GET /compute/v2.1/servers/91efce57-cc54-4e70-8867-fc8ce13d6117 => generated 1565 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:28:57.740791 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-3825adc4-028e-48aa-8807-35a38b385a59 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:28:57.745521 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-3825adc4-028e-48aa-8807-35a38b385a59 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 91efce57-cc54-4e70-8867-fc8ce13d6117] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:28:57.746272 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-a4db9b3f-0f09-470e-8493-3454001d5f9f req-0b8645f1-b90e-4a76-ba4a-13553703d7b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91efce57-cc54-4e70-8867-fc8ce13d6117", "tag": "d1524c09-88b8-4e8e-8958-452eebdafd18"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:28:57.757398 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-a4db9b3f-0f09-470e-8493-3454001d5f9f req-0b8645f1-b90e-4a76-ba4a-13553703d7b9 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:28:57.758247 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-a4db9b3f-0f09-470e-8493-3454001d5f9f req-0b8645f1-b90e-4a76-ba4a-13553703d7b9 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:28:57.758775 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-a4db9b3f-0f09-470e-8493-3454001d5f9f req-0b8645f1-b90e-4a76-ba4a-13553703d7b9 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:28:57.762107 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3825adc4-028e-48aa-8807-35a38b385a59 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:28:57.763032 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3825adc4-028e-48aa-8807-35a38b385a59 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:28:57.763567 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3825adc4-028e-48aa-8807-35a38b385a59 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:28:57.764836 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3825adc4-028e-48aa-8807-35a38b385a59 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:28:57.765903 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3825adc4-028e-48aa-8807-35a38b385a59 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:28:57.766790 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3825adc4-028e-48aa-8807-35a38b385a59 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:28:57.773209 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-a4db9b3f-0f09-470e-8493-3454001d5f9f req-0b8645f1-b90e-4a76-ba4a-13553703d7b9 service nova] Creating event network-changed:d1524c09-88b8-4e8e-8958-452eebdafd18 for instance 91efce57-cc54-4e70-8867-fc8ce13d6117 on nch1-master-1 Oct 08 21:28:57.779064 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-a4db9b3f-0f09-470e-8493-3454001d5f9f req-0b8645f1-b90e-4a76-ba4a-13553703d7b9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036450 Oct 08 21:28:57.780375 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3020/5966] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:28:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:28:58.009389 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-3825adc4-028e-48aa-8807-35a38b385a59 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219a93945a147c4a57bb6452212fe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eeb6be960cc408296ecce6353b72f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:28:58.018357 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-3825adc4-028e-48aa-8807-35a38b385a59 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "GET /compute/v2.1/servers/91efce57-cc54-4e70-8867-fc8ce13d6117" status: 200 len: 1565 microversion: 2.1 time: 0.281387 Oct 08 21:28:58.019159 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2947/5967] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:28:57 2022] GET /compute/v2.1/servers/91efce57-cc54-4e70-8867-fc8ce13d6117 => generated 1565 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:29:21.269577 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:29:21.270328 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=38 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:29:21.328890 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-b1ea0c04-1138-4a17-b184-c03ed3040870 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:29:21.331361 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-b1ea0c04-1138-4a17-b184-c03ed3040870 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 91efce57-cc54-4e70-8867-fc8ce13d6117] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:29:21.337553 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b1ea0c04-1138-4a17-b184-c03ed3040870 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:29:21.338038 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b1ea0c04-1138-4a17-b184-c03ed3040870 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:29:21.338481 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b1ea0c04-1138-4a17-b184-c03ed3040870 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:29:21.339179 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b1ea0c04-1138-4a17-b184-c03ed3040870 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:29:21.339640 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b1ea0c04-1138-4a17-b184-c03ed3040870 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:29:21.340072 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b1ea0c04-1138-4a17-b184-c03ed3040870 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:29:21.390774 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-b1ea0c04-1138-4a17-b184-c03ed3040870 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "POST /compute/v2.1/servers/91efce57-cc54-4e70-8867-fc8ce13d6117/action" status: 200 len: 24571 microversion: 2.1 time: 0.126750 Oct 08 21:29:21.391399 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3021/5968] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:29:21 2022] POST /compute/v2.1/servers/91efce57-cc54-4e70-8867-fc8ce13d6117/action => generated 24571 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 08 21:29:32.496596 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c14230d5-c06f-42c6-aa18-89033f0ebe3f tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:29:32.497230 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-c14230d5-c06f-42c6-aa18-89033f0ebe3f tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 91efce57-cc54-4e70-8867-fc8ce13d6117] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:29:32.500241 ncdv-master-1 devstack@n-api.service[140491]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 08 21:29:32.500390 ncdv-master-1 devstack@n-api.service[140491]: Sat Oct 8 21:29:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/91efce57-cc54-4e70-8867-fc8ce13d6117 (ip 10.222.0.26) !!! Oct 08 21:29:32.501726 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:SELECT=5 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:29:32.502382 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=42 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:29:32.510415 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c14230d5-c06f-42c6-aa18-89033f0ebe3f tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:29:32.510906 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c14230d5-c06f-42c6-aa18-89033f0ebe3f tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:29:32.511384 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c14230d5-c06f-42c6-aa18-89033f0ebe3f tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:29:32.512120 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c14230d5-c06f-42c6-aa18-89033f0ebe3f tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:29:32.512583 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c14230d5-c06f-42c6-aa18-89033f0ebe3f tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:29:32.513012 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c14230d5-c06f-42c6-aa18-89033f0ebe3f tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:29:32.646608 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-c14230d5-c06f-42c6-aa18-89033f0ebe3f tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219a93945a147c4a57bb6452212fe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eeb6be960cc408296ecce6353b72f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:29:32.656068 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-c14230d5-c06f-42c6-aa18-89033f0ebe3f tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "GET /compute/v2.1/servers/91efce57-cc54-4e70-8867-fc8ce13d6117" status: 200 len: 1683 microversion: 2.1 time: 0.163306 Oct 08 21:29:32.657311 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2948/5969] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:29:32 2022] GET /compute/v2.1/servers/91efce57-cc54-4e70-8867-fc8ce13d6117 => generated 1683 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:29:32.756427 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-0eda0be8-053f-4faa-9495-10dcc804dea3 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:29:32.758806 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-0eda0be8-053f-4faa-9495-10dcc804dea3 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 91efce57-cc54-4e70-8867-fc8ce13d6117] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:29:32.761516 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=2 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:29:32.762182 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=4 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:29:32.768818 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0eda0be8-053f-4faa-9495-10dcc804dea3 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:29:32.769345 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0eda0be8-053f-4faa-9495-10dcc804dea3 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:29:32.769797 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0eda0be8-053f-4faa-9495-10dcc804dea3 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:29:32.770509 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0eda0be8-053f-4faa-9495-10dcc804dea3 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:29:32.770977 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0eda0be8-053f-4faa-9495-10dcc804dea3 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:29:32.771408 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0eda0be8-053f-4faa-9495-10dcc804dea3 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:29:32.824157 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-0eda0be8-053f-4faa-9495-10dcc804dea3 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "POST /compute/v2.1/servers/91efce57-cc54-4e70-8867-fc8ce13d6117/action" status: 200 len: 32636 microversion: 2.1 time: 0.071872 Oct 08 21:29:32.824810 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3022/5970] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:29:32 2022] POST /compute/v2.1/servers/91efce57-cc54-4e70-8867-fc8ce13d6117/action => generated 32636 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 08 21:29:33.083271 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-d94975ce-3e67-4878-bff6-d89bff2b372d tempest-TestNetworkAdvancedServerOps-1736509213 tempest-TestNetworkAdvancedServerOps-1736509213-project-admin] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:29:33.083898 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-d94975ce-3e67-4878-bff6-d89bff2b372d tempest-TestNetworkAdvancedServerOps-1736509213 tempest-TestNetworkAdvancedServerOps-1736509213-project-admin] [instance: 91efce57-cc54-4e70-8867-fc8ce13d6117] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:29:33.089978 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d94975ce-3e67-4878-bff6-d89bff2b372d tempest-TestNetworkAdvancedServerOps-1736509213 tempest-TestNetworkAdvancedServerOps-1736509213-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:29:33.090473 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d94975ce-3e67-4878-bff6-d89bff2b372d tempest-TestNetworkAdvancedServerOps-1736509213 tempest-TestNetworkAdvancedServerOps-1736509213-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:29:33.090920 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d94975ce-3e67-4878-bff6-d89bff2b372d tempest-TestNetworkAdvancedServerOps-1736509213 tempest-TestNetworkAdvancedServerOps-1736509213-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:29:33.091624 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d94975ce-3e67-4878-bff6-d89bff2b372d tempest-TestNetworkAdvancedServerOps-1736509213 tempest-TestNetworkAdvancedServerOps-1736509213-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:29:33.092090 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d94975ce-3e67-4878-bff6-d89bff2b372d tempest-TestNetworkAdvancedServerOps-1736509213 tempest-TestNetworkAdvancedServerOps-1736509213-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:29:33.092526 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d94975ce-3e67-4878-bff6-d89bff2b372d tempest-TestNetworkAdvancedServerOps-1736509213 tempest-TestNetworkAdvancedServerOps-1736509213-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:29:33.224113 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-d94975ce-3e67-4878-bff6-d89bff2b372d tempest-TestNetworkAdvancedServerOps-1736509213 tempest-TestNetworkAdvancedServerOps-1736509213-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/91efce57-cc54-4e70-8867-fc8ce13d6117" status: 200 len: 1834 microversion: 2.1 time: 0.250254 Oct 08 21:29:33.224697 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2949/5971] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:29:32 2022] GET /compute/v2.1/servers/91efce57-cc54-4e70-8867-fc8ce13d6117 => generated 1834 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:29:33.255466 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-7c61f8e2-29b8-4758-9841-3909fd1ada63 tempest-TestNetworkAdvancedServerOps-1736509213 tempest-TestNetworkAdvancedServerOps-1736509213-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:29:33.257981 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-7c61f8e2-29b8-4758-9841-3909fd1ada63 tempest-TestNetworkAdvancedServerOps-1736509213 tempest-TestNetworkAdvancedServerOps-1736509213-project-admin] [instance: 91efce57-cc54-4e70-8867-fc8ce13d6117] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:29:33.265083 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7c61f8e2-29b8-4758-9841-3909fd1ada63 tempest-TestNetworkAdvancedServerOps-1736509213 tempest-TestNetworkAdvancedServerOps-1736509213-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:29:33.265605 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7c61f8e2-29b8-4758-9841-3909fd1ada63 tempest-TestNetworkAdvancedServerOps-1736509213 tempest-TestNetworkAdvancedServerOps-1736509213-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:29:33.266052 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7c61f8e2-29b8-4758-9841-3909fd1ada63 tempest-TestNetworkAdvancedServerOps-1736509213 tempest-TestNetworkAdvancedServerOps-1736509213-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:29:33.266754 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7c61f8e2-29b8-4758-9841-3909fd1ada63 tempest-TestNetworkAdvancedServerOps-1736509213 tempest-TestNetworkAdvancedServerOps-1736509213-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:29:33.267216 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7c61f8e2-29b8-4758-9841-3909fd1ada63 tempest-TestNetworkAdvancedServerOps-1736509213 tempest-TestNetworkAdvancedServerOps-1736509213-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:29:33.267654 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7c61f8e2-29b8-4758-9841-3909fd1ada63 tempest-TestNetworkAdvancedServerOps-1736509213 tempest-TestNetworkAdvancedServerOps-1736509213-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:29:33.300474 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.objects.instance [None req-7c61f8e2-29b8-4758-9841-3909fd1ada63 tempest-TestNetworkAdvancedServerOps-1736509213 tempest-TestNetworkAdvancedServerOps-1736509213-project-admin] Lazy-loading 'flavor' on Instance uuid 91efce57-cc54-4e70-8867-fc8ce13d6117 {{(pid=140492) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 21:29:33.312341 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-7c61f8e2-29b8-4758-9841-3909fd1ada63 tempest-TestNetworkAdvancedServerOps-1736509213 tempest-TestNetworkAdvancedServerOps-1736509213-project-admin] [instance: 91efce57-cc54-4e70-8867-fc8ce13d6117] Going to try to live migrate instance to another host {{(pid=140492) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 08 21:29:34.663478 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-7c61f8e2-29b8-4758-9841-3909fd1ada63 tempest-TestNetworkAdvancedServerOps-1736509213 tempest-TestNetworkAdvancedServerOps-1736509213-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/91efce57-cc54-4e70-8867-fc8ce13d6117/action" status: 202 len: 0 microversion: 2.1 time: 1.412166 Oct 08 21:29:34.668285 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3023/5972] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:29:33 2022] POST /compute/v2.1/servers/91efce57-cc54-4e70-8867-fc8ce13d6117/action => generated 0 bytes in 1418 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 21:29:34.674980 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-852332d2-1526-4ac5-8b61-678e650262b0 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:29:34.676490 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-852332d2-1526-4ac5-8b61-678e650262b0 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 91efce57-cc54-4e70-8867-fc8ce13d6117] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:29:34.684618 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-852332d2-1526-4ac5-8b61-678e650262b0 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:29:34.685106 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-852332d2-1526-4ac5-8b61-678e650262b0 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:29:34.685582 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-852332d2-1526-4ac5-8b61-678e650262b0 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:29:34.686439 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-852332d2-1526-4ac5-8b61-678e650262b0 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:29:34.686896 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-852332d2-1526-4ac5-8b61-678e650262b0 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:29:34.687328 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-852332d2-1526-4ac5-8b61-678e650262b0 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:29:34.833333 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-852332d2-1526-4ac5-8b61-678e650262b0 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219a93945a147c4a57bb6452212fe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eeb6be960cc408296ecce6353b72f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:29:34.841784 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-852332d2-1526-4ac5-8b61-678e650262b0 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "GET /compute/v2.1/servers/91efce57-cc54-4e70-8867-fc8ce13d6117" status: 200 len: 1693 microversion: 2.1 time: 0.172163 Oct 08 21:29:34.842378 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2950/5973] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:29:34 2022] GET /compute/v2.1/servers/91efce57-cc54-4e70-8867-fc8ce13d6117 => generated 1693 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:29:35.726659 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-f6fd6aa8-6e65-46d4-8ade-b6e19fafa40d req-45bb9b45-2174-482c-b92b-c34c62e2f199 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91efce57-cc54-4e70-8867-fc8ce13d6117", "name": "network-vif-unplugged", "status": "completed", "tag": "d1524c09-88b8-4e8e-8958-452eebdafd18"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:29:35.738162 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-f6fd6aa8-6e65-46d4-8ade-b6e19fafa40d req-45bb9b45-2174-482c-b92b-c34c62e2f199 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:29:35.738720 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-f6fd6aa8-6e65-46d4-8ade-b6e19fafa40d req-45bb9b45-2174-482c-b92b-c34c62e2f199 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:29:35.739250 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-f6fd6aa8-6e65-46d4-8ade-b6e19fafa40d req-45bb9b45-2174-482c-b92b-c34c62e2f199 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:29:35.753892 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-f6fd6aa8-6e65-46d4-8ade-b6e19fafa40d req-45bb9b45-2174-482c-b92b-c34c62e2f199 service nova] Creating event network-vif-unplugged:d1524c09-88b8-4e8e-8958-452eebdafd18 for instance 91efce57-cc54-4e70-8867-fc8ce13d6117 on nch1-master-1 Oct 08 21:29:35.758973 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-f6fd6aa8-6e65-46d4-8ade-b6e19fafa40d req-45bb9b45-2174-482c-b92b-c34c62e2f199 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036139 Oct 08 21:29:35.759598 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3024/5974] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:29:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:29:35.867886 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-de56a465-81a9-4a40-8f38-ed4d45009044 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:29:35.868544 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-de56a465-81a9-4a40-8f38-ed4d45009044 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 91efce57-cc54-4e70-8867-fc8ce13d6117] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:29:35.875734 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-de56a465-81a9-4a40-8f38-ed4d45009044 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:29:35.876230 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-de56a465-81a9-4a40-8f38-ed4d45009044 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:29:35.876681 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-de56a465-81a9-4a40-8f38-ed4d45009044 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:29:35.877600 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-de56a465-81a9-4a40-8f38-ed4d45009044 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:29:35.878079 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-de56a465-81a9-4a40-8f38-ed4d45009044 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:29:35.878520 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-de56a465-81a9-4a40-8f38-ed4d45009044 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:29:36.014231 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-de56a465-81a9-4a40-8f38-ed4d45009044 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219a93945a147c4a57bb6452212fe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eeb6be960cc408296ecce6353b72f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:29:36.022900 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-de56a465-81a9-4a40-8f38-ed4d45009044 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "GET /compute/v2.1/servers/91efce57-cc54-4e70-8867-fc8ce13d6117" status: 200 len: 1693 microversion: 2.1 time: 0.159047 Oct 08 21:29:36.023575 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2951/5975] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:29:35 2022] GET /compute/v2.1/servers/91efce57-cc54-4e70-8867-fc8ce13d6117 => generated 1693 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:29:37.046890 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-b051d806-9889-4139-9349-e6ae9a194963 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:29:37.047606 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-b051d806-9889-4139-9349-e6ae9a194963 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 91efce57-cc54-4e70-8867-fc8ce13d6117] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:29:37.054906 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b051d806-9889-4139-9349-e6ae9a194963 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:29:37.055398 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b051d806-9889-4139-9349-e6ae9a194963 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:29:37.055844 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b051d806-9889-4139-9349-e6ae9a194963 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:29:37.056546 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b051d806-9889-4139-9349-e6ae9a194963 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:29:37.057009 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b051d806-9889-4139-9349-e6ae9a194963 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:29:37.057479 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b051d806-9889-4139-9349-e6ae9a194963 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:29:37.193138 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-b051d806-9889-4139-9349-e6ae9a194963 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219a93945a147c4a57bb6452212fe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eeb6be960cc408296ecce6353b72f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:29:37.200870 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-b051d806-9889-4139-9349-e6ae9a194963 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "GET /compute/v2.1/servers/91efce57-cc54-4e70-8867-fc8ce13d6117" status: 200 len: 1693 microversion: 2.1 time: 0.158296 Oct 08 21:29:37.201476 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3025/5976] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:29:37 2022] GET /compute/v2.1/servers/91efce57-cc54-4e70-8867-fc8ce13d6117 => generated 1693 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:29:37.778513 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-3613ffd0-a662-48f2-8ef7-221ccf7041e4 req-e0888de4-708b-4fd8-9e2b-2feae7c83f7c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91efce57-cc54-4e70-8867-fc8ce13d6117", "tag": "d1524c09-88b8-4e8e-8958-452eebdafd18"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:29:37.788862 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-3613ffd0-a662-48f2-8ef7-221ccf7041e4 req-e0888de4-708b-4fd8-9e2b-2feae7c83f7c service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:29:37.789385 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-3613ffd0-a662-48f2-8ef7-221ccf7041e4 req-e0888de4-708b-4fd8-9e2b-2feae7c83f7c service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:29:37.789828 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-3613ffd0-a662-48f2-8ef7-221ccf7041e4 req-e0888de4-708b-4fd8-9e2b-2feae7c83f7c service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:29:37.801049 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-3613ffd0-a662-48f2-8ef7-221ccf7041e4 req-e0888de4-708b-4fd8-9e2b-2feae7c83f7c service nova] Creating event network-changed:d1524c09-88b8-4e8e-8958-452eebdafd18 for instance 91efce57-cc54-4e70-8867-fc8ce13d6117 on nch1-master-1 Oct 08 21:29:37.806122 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-3613ffd0-a662-48f2-8ef7-221ccf7041e4 req-e0888de4-708b-4fd8-9e2b-2feae7c83f7c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031301 Oct 08 21:29:37.806719 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2952/5977] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:29:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:29:38.226712 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-009c06cc-af5f-4900-9cd0-2d9ee9c41ae6 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:29:38.227335 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-009c06cc-af5f-4900-9cd0-2d9ee9c41ae6 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 91efce57-cc54-4e70-8867-fc8ce13d6117] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:29:38.236948 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-009c06cc-af5f-4900-9cd0-2d9ee9c41ae6 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:29:38.237620 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-009c06cc-af5f-4900-9cd0-2d9ee9c41ae6 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:29:38.238278 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-009c06cc-af5f-4900-9cd0-2d9ee9c41ae6 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:29:38.239038 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-009c06cc-af5f-4900-9cd0-2d9ee9c41ae6 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:29:38.239466 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-009c06cc-af5f-4900-9cd0-2d9ee9c41ae6 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:29:38.239900 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-009c06cc-af5f-4900-9cd0-2d9ee9c41ae6 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:29:38.372310 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-009c06cc-af5f-4900-9cd0-2d9ee9c41ae6 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219a93945a147c4a57bb6452212fe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eeb6be960cc408296ecce6353b72f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:29:38.381039 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-009c06cc-af5f-4900-9cd0-2d9ee9c41ae6 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "GET /compute/v2.1/servers/91efce57-cc54-4e70-8867-fc8ce13d6117" status: 200 len: 1693 microversion: 2.1 time: 0.159240 Oct 08 21:29:38.381664 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3026/5978] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:29:38 2022] GET /compute/v2.1/servers/91efce57-cc54-4e70-8867-fc8ce13d6117 => generated 1693 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:29:39.407611 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-bda867bb-0085-402a-996b-6ba1ee759136 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:29:39.408297 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-bda867bb-0085-402a-996b-6ba1ee759136 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 91efce57-cc54-4e70-8867-fc8ce13d6117] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:29:39.414932 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bda867bb-0085-402a-996b-6ba1ee759136 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:29:39.415425 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bda867bb-0085-402a-996b-6ba1ee759136 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:29:39.415869 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bda867bb-0085-402a-996b-6ba1ee759136 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:29:39.416571 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bda867bb-0085-402a-996b-6ba1ee759136 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:29:39.417035 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bda867bb-0085-402a-996b-6ba1ee759136 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:29:39.417493 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bda867bb-0085-402a-996b-6ba1ee759136 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:29:39.553389 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-bda867bb-0085-402a-996b-6ba1ee759136 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219a93945a147c4a57bb6452212fe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eeb6be960cc408296ecce6353b72f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:29:39.561344 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-bda867bb-0085-402a-996b-6ba1ee759136 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "GET /compute/v2.1/servers/91efce57-cc54-4e70-8867-fc8ce13d6117" status: 200 len: 1693 microversion: 2.1 time: 0.159408 Oct 08 21:29:39.561919 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2953/5979] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:29:39 2022] GET /compute/v2.1/servers/91efce57-cc54-4e70-8867-fc8ce13d6117 => generated 1693 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:29:40.584443 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-130f260e-fcea-4ed0-897e-7e3b7fe24c65 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:29:40.585073 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-130f260e-fcea-4ed0-897e-7e3b7fe24c65 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 91efce57-cc54-4e70-8867-fc8ce13d6117] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:29:40.592018 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-130f260e-fcea-4ed0-897e-7e3b7fe24c65 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:29:40.592517 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-130f260e-fcea-4ed0-897e-7e3b7fe24c65 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:29:40.592975 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-130f260e-fcea-4ed0-897e-7e3b7fe24c65 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:29:40.594302 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-130f260e-fcea-4ed0-897e-7e3b7fe24c65 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:29:40.594802 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-130f260e-fcea-4ed0-897e-7e3b7fe24c65 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:29:40.595241 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-130f260e-fcea-4ed0-897e-7e3b7fe24c65 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:29:40.727925 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-130f260e-fcea-4ed0-897e-7e3b7fe24c65 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219a93945a147c4a57bb6452212fe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eeb6be960cc408296ecce6353b72f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:29:40.736790 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-130f260e-fcea-4ed0-897e-7e3b7fe24c65 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "GET /compute/v2.1/servers/91efce57-cc54-4e70-8867-fc8ce13d6117" status: 200 len: 1693 microversion: 2.1 time: 0.156202 Oct 08 21:29:40.737324 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3027/5980] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:29:40 2022] GET /compute/v2.1/servers/91efce57-cc54-4e70-8867-fc8ce13d6117 => generated 1693 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:29:41.759903 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-8cc98a14-0f5e-4800-a5a6-2b0cb33c1e4a tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:29:41.760516 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-8cc98a14-0f5e-4800-a5a6-2b0cb33c1e4a tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 91efce57-cc54-4e70-8867-fc8ce13d6117] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:29:41.767605 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8cc98a14-0f5e-4800-a5a6-2b0cb33c1e4a tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:29:41.768098 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8cc98a14-0f5e-4800-a5a6-2b0cb33c1e4a tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:29:41.768548 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8cc98a14-0f5e-4800-a5a6-2b0cb33c1e4a tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:29:41.769282 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8cc98a14-0f5e-4800-a5a6-2b0cb33c1e4a tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:29:41.769753 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8cc98a14-0f5e-4800-a5a6-2b0cb33c1e4a tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:29:41.770185 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8cc98a14-0f5e-4800-a5a6-2b0cb33c1e4a tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:29:41.908461 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-8cc98a14-0f5e-4800-a5a6-2b0cb33c1e4a tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219a93945a147c4a57bb6452212fe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eeb6be960cc408296ecce6353b72f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:29:41.916556 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-8cc98a14-0f5e-4800-a5a6-2b0cb33c1e4a tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "GET /compute/v2.1/servers/91efce57-cc54-4e70-8867-fc8ce13d6117" status: 200 len: 1693 microversion: 2.1 time: 0.160559 Oct 08 21:29:41.917145 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2954/5981] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:29:41 2022] GET /compute/v2.1/servers/91efce57-cc54-4e70-8867-fc8ce13d6117 => generated 1693 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:29:42.940550 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-de14c777-69b9-4b43-bd70-023780652cad tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:29:42.941104 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-de14c777-69b9-4b43-bd70-023780652cad tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 91efce57-cc54-4e70-8867-fc8ce13d6117] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:29:42.948371 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-de14c777-69b9-4b43-bd70-023780652cad tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:29:42.948894 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-de14c777-69b9-4b43-bd70-023780652cad tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:29:42.949371 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-de14c777-69b9-4b43-bd70-023780652cad tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:29:42.950082 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-de14c777-69b9-4b43-bd70-023780652cad tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:29:42.950541 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-de14c777-69b9-4b43-bd70-023780652cad tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:29:42.950971 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-de14c777-69b9-4b43-bd70-023780652cad tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:29:43.382856 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-de14c777-69b9-4b43-bd70-023780652cad tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219a93945a147c4a57bb6452212fe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eeb6be960cc408296ecce6353b72f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:29:43.390984 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-de14c777-69b9-4b43-bd70-023780652cad tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "GET /compute/v2.1/servers/91efce57-cc54-4e70-8867-fc8ce13d6117" status: 200 len: 1683 microversion: 2.1 time: 0.455018 Oct 08 21:29:43.391598 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3028/5982] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:29:42 2022] GET /compute/v2.1/servers/91efce57-cc54-4e70-8867-fc8ce13d6117 => generated 1683 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:29:43.414416 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-535ee41b-931a-40f9-ae18-03db6dee5f04 tempest-TestNetworkAdvancedServerOps-1736509213 tempest-TestNetworkAdvancedServerOps-1736509213-project-admin] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:29:43.415040 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-535ee41b-931a-40f9-ae18-03db6dee5f04 tempest-TestNetworkAdvancedServerOps-1736509213 tempest-TestNetworkAdvancedServerOps-1736509213-project-admin] [instance: 91efce57-cc54-4e70-8867-fc8ce13d6117] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:29:43.422996 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-535ee41b-931a-40f9-ae18-03db6dee5f04 tempest-TestNetworkAdvancedServerOps-1736509213 tempest-TestNetworkAdvancedServerOps-1736509213-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:29:43.423534 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-535ee41b-931a-40f9-ae18-03db6dee5f04 tempest-TestNetworkAdvancedServerOps-1736509213 tempest-TestNetworkAdvancedServerOps-1736509213-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:29:43.423989 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-535ee41b-931a-40f9-ae18-03db6dee5f04 tempest-TestNetworkAdvancedServerOps-1736509213 tempest-TestNetworkAdvancedServerOps-1736509213-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:29:43.424707 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-535ee41b-931a-40f9-ae18-03db6dee5f04 tempest-TestNetworkAdvancedServerOps-1736509213 tempest-TestNetworkAdvancedServerOps-1736509213-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:29:43.425173 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-535ee41b-931a-40f9-ae18-03db6dee5f04 tempest-TestNetworkAdvancedServerOps-1736509213 tempest-TestNetworkAdvancedServerOps-1736509213-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:29:43.425650 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-535ee41b-931a-40f9-ae18-03db6dee5f04 tempest-TestNetworkAdvancedServerOps-1736509213 tempest-TestNetworkAdvancedServerOps-1736509213-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:29:43.557613 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-535ee41b-931a-40f9-ae18-03db6dee5f04 tempest-TestNetworkAdvancedServerOps-1736509213 tempest-TestNetworkAdvancedServerOps-1736509213-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/91efce57-cc54-4e70-8867-fc8ce13d6117" status: 200 len: 1834 microversion: 2.1 time: 0.146866 Oct 08 21:29:43.558384 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2955/5983] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:29:43 2022] GET /compute/v2.1/servers/91efce57-cc54-4e70-8867-fc8ce13d6117 => generated 1834 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:29:43.581379 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-7a83f6a8-d763-4317-b81e-6385c5ffbb04 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:29:43.582003 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-7a83f6a8-d763-4317-b81e-6385c5ffbb04 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 91efce57-cc54-4e70-8867-fc8ce13d6117] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:29:43.588097 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7a83f6a8-d763-4317-b81e-6385c5ffbb04 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:29:43.588872 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7a83f6a8-d763-4317-b81e-6385c5ffbb04 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:29:43.589357 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7a83f6a8-d763-4317-b81e-6385c5ffbb04 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:29:43.590089 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7a83f6a8-d763-4317-b81e-6385c5ffbb04 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:29:43.590557 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7a83f6a8-d763-4317-b81e-6385c5ffbb04 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:29:43.590994 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7a83f6a8-d763-4317-b81e-6385c5ffbb04 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:29:43.724628 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-7a83f6a8-d763-4317-b81e-6385c5ffbb04 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219a93945a147c4a57bb6452212fe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eeb6be960cc408296ecce6353b72f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:29:43.736010 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-7a83f6a8-d763-4317-b81e-6385c5ffbb04 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "GET /compute/v2.1/servers/91efce57-cc54-4e70-8867-fc8ce13d6117" status: 200 len: 1683 microversion: 2.1 time: 0.158844 Oct 08 21:29:43.736534 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3029/5984] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:29:43 2022] GET /compute/v2.1/servers/91efce57-cc54-4e70-8867-fc8ce13d6117 => generated 1683 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:29:43.831995 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-fe19accd-39c8-47eb-bd01-1ec8ca0d993c tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:29:43.834307 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-fe19accd-39c8-47eb-bd01-1ec8ca0d993c tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 91efce57-cc54-4e70-8867-fc8ce13d6117] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:29:43.840667 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fe19accd-39c8-47eb-bd01-1ec8ca0d993c tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:29:43.841158 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fe19accd-39c8-47eb-bd01-1ec8ca0d993c tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:29:43.841631 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fe19accd-39c8-47eb-bd01-1ec8ca0d993c tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:29:43.842331 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fe19accd-39c8-47eb-bd01-1ec8ca0d993c tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:29:43.842790 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fe19accd-39c8-47eb-bd01-1ec8ca0d993c tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:29:43.843219 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fe19accd-39c8-47eb-bd01-1ec8ca0d993c tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:29:43.894770 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-fe19accd-39c8-47eb-bd01-1ec8ca0d993c tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "POST /compute/v2.1/servers/91efce57-cc54-4e70-8867-fc8ce13d6117/action" status: 200 len: 38729 microversion: 2.1 time: 0.067086 Oct 08 21:29:43.895389 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2956/5985] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:29:43 2022] POST /compute/v2.1/servers/91efce57-cc54-4e70-8867-fc8ce13d6117/action => generated 38729 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 08 21:29:44.855703 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-0a258f72-fb65-48b9-9a14-817462310807 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:29:44.856222 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-0a258f72-fb65-48b9-9a14-817462310807 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 91efce57-cc54-4e70-8867-fc8ce13d6117] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:29:44.858293 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-5e36d228-17bc-499e-a7da-bfda6d20dba1 req-147e46cc-81ca-4166-b7b8-134c248d3d9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91efce57-cc54-4e70-8867-fc8ce13d6117", "tag": "d1524c09-88b8-4e8e-8958-452eebdafd18"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:29:44.864166 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0a258f72-fb65-48b9-9a14-817462310807 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:29:44.864663 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0a258f72-fb65-48b9-9a14-817462310807 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:29:44.865105 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0a258f72-fb65-48b9-9a14-817462310807 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:29:44.866327 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0a258f72-fb65-48b9-9a14-817462310807 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:29:44.866850 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0a258f72-fb65-48b9-9a14-817462310807 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:29:44.867285 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0a258f72-fb65-48b9-9a14-817462310807 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:29:44.871152 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-5e36d228-17bc-499e-a7da-bfda6d20dba1 req-147e46cc-81ca-4166-b7b8-134c248d3d9d service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:29:44.871754 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-5e36d228-17bc-499e-a7da-bfda6d20dba1 req-147e46cc-81ca-4166-b7b8-134c248d3d9d service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:29:44.872295 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-5e36d228-17bc-499e-a7da-bfda6d20dba1 req-147e46cc-81ca-4166-b7b8-134c248d3d9d service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:29:44.885113 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-5e36d228-17bc-499e-a7da-bfda6d20dba1 req-147e46cc-81ca-4166-b7b8-134c248d3d9d service nova] Creating event network-changed:d1524c09-88b8-4e8e-8958-452eebdafd18 for instance 91efce57-cc54-4e70-8867-fc8ce13d6117 on nch2-master-1 Oct 08 21:29:44.890067 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-5e36d228-17bc-499e-a7da-bfda6d20dba1 req-147e46cc-81ca-4166-b7b8-134c248d3d9d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036110 Oct 08 21:29:44.891163 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2957/5986] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:29:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:29:44.896966 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-0a258f72-fb65-48b9-9a14-817462310807 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 91efce57-cc54-4e70-8867-fc8ce13d6117] Going to try to terminate instance {{(pid=140492) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 21:29:44.985274 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-0a258f72-fb65-48b9-9a14-817462310807 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "DELETE /compute/v2.1/servers/91efce57-cc54-4e70-8867-fc8ce13d6117" status: 204 len: 0 microversion: 2.1 time: 0.132426 Oct 08 21:29:44.989248 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3030/5987] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:29:44 2022] DELETE /compute/v2.1/servers/91efce57-cc54-4e70-8867-fc8ce13d6117 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 21:29:44.995936 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-a718b21a-6d26-49d0-99a7-4060657c01ce tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:29:44.996911 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-a718b21a-6d26-49d0-99a7-4060657c01ce tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 91efce57-cc54-4e70-8867-fc8ce13d6117] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:29:45.003875 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a718b21a-6d26-49d0-99a7-4060657c01ce tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:29:45.004378 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a718b21a-6d26-49d0-99a7-4060657c01ce tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:29:45.004829 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a718b21a-6d26-49d0-99a7-4060657c01ce tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:29:45.005579 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a718b21a-6d26-49d0-99a7-4060657c01ce tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:29:45.006047 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a718b21a-6d26-49d0-99a7-4060657c01ce tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:29:45.006659 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a718b21a-6d26-49d0-99a7-4060657c01ce tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:29:45.154800 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-a718b21a-6d26-49d0-99a7-4060657c01ce tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219a93945a147c4a57bb6452212fe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eeb6be960cc408296ecce6353b72f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:29:45.163973 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-a718b21a-6d26-49d0-99a7-4060657c01ce tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "GET /compute/v2.1/servers/91efce57-cc54-4e70-8867-fc8ce13d6117" status: 200 len: 1689 microversion: 2.1 time: 0.172930 Oct 08 21:29:45.178008 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2958/5988] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:29:44 2022] GET /compute/v2.1/servers/91efce57-cc54-4e70-8867-fc8ce13d6117 => generated 1689 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:29:46.191707 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-94f95441-7ca9-42dc-b7ba-7b05ab4b3c95 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:29:46.192437 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-94f95441-7ca9-42dc-b7ba-7b05ab4b3c95 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 91efce57-cc54-4e70-8867-fc8ce13d6117] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:29:46.200168 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-94f95441-7ca9-42dc-b7ba-7b05ab4b3c95 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:29:46.200672 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-94f95441-7ca9-42dc-b7ba-7b05ab4b3c95 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:29:46.201116 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-94f95441-7ca9-42dc-b7ba-7b05ab4b3c95 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:29:46.201990 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-94f95441-7ca9-42dc-b7ba-7b05ab4b3c95 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:29:46.202456 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-94f95441-7ca9-42dc-b7ba-7b05ab4b3c95 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:29:46.202888 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-94f95441-7ca9-42dc-b7ba-7b05ab4b3c95 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:29:46.217550 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-94f95441-7ca9-42dc-b7ba-7b05ab4b3c95 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] HTTP exception thrown: Instance 91efce57-cc54-4e70-8867-fc8ce13d6117 could not be found. Oct 08 21:29:46.219736 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-94f95441-7ca9-42dc-b7ba-7b05ab4b3c95 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Request method failure captured: Oct 08 21:29:46.219736 ncdv-master-1 devstack@n-api.service[140492]: request: GET /compute/v2.1/servers/91efce57-cc54-4e70-8867-fc8ce13d6117 HTTP/1.1 Oct 08 21:29:46.219736 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:29:46.219736 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:29:46.219736 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:29:46.219736 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 21:29:46.219736 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:29:46.219736 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:29:46.219736 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:29:46.219736 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:29:46.219736 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQep7EvEBtlUVHm2Z-xMUemo1fDuPodMx_QgvV--hhoE4MZz4OfLqVPlQBRPz5RXJ-HR4rz7JLlm8ih4Dn0GIB8br_D1WCF0uLTJeFZ1bD6SPHzzM0aO_EdLw0wg9AzNCfT-tNLgSCtS6oMoxL2RTAOI-_GcrcxStl7sgnRfFgr5x1Qs Oct 08 21:29:46.219736 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:29:46.219736 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:29:46.219736 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:29:46.219736 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:29:46.219736 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:29:46.219736 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:29:46.219736 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 3eeb6be960cc408296ecce6353b72f6d Oct 08 21:29:46.219736 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-651255446 Oct 08 21:29:46.219736 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:29:46.219736 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:29:46.219736 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3eeb6be960cc408296ecce6353b72f6d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3eeb6be960cc408296ecce6353b72f6d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3eeb6be960cc408296ecce6353b72f6d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3eeb6be960cc408296ecce6353b72f6d"}]}] Oct 08 21:29:46.219736 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-TestNetworkAdvancedServerOps-651255446 Oct 08 21:29:46.219736 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 3eeb6be960cc408296ecce6353b72f6d Oct 08 21:29:46.219736 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-651255446 Oct 08 21:29:46.219736 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-TestNetworkAdvancedServerOps-651255446-project Oct 08 21:29:46.219736 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:29:46.219736 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:29:46.219736 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 8219a93945a147c4a57bb6452212fe7c Oct 08 21:29:46.219736 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-TestNetworkAdvancedServerOps-651255446-project Oct 08 21:29:46.219736 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 21:29:46.219736 ncdv-master-1 devstack@n-api.service[140492]: exception: Instance 91efce57-cc54-4e70-8867-fc8ce13d6117 could not be found. Oct 08 21:29:46.219736 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': '91efce57-cc54-4e70-8867-fc8ce13d6117'} Oct 08 21:29:46.219736 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:29:46.219736 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:29:46.219736 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:29:46.219736 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:29:46.219736 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:29:46.219736 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:29:46.219736 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:29:46.219736 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:29:46.219736 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:29:46.219736 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:29:46.219736 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91efce57-cc54-4e70-8867-fc8ce13d6117 could not be found. Oct 08 21:29:46.219736 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:29:46.219736 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:29:46.219736 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:29:46.219736 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:29:46.219736 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:29:46.219736 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:29:46.219736 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:29:46.219736 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:29:46.219736 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:29:46.219736 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:29:46.219736 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:29:46.219736 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:29:46.219736 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:29:46.219736 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:29:46.219736 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:29:46.219736 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:29:46.219736 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91efce57-cc54-4e70-8867-fc8ce13d6117 could not be found. Oct 08 21:29:46.219736 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:29:46.219736 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:29:46.224158 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:29:46.224158 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:29:46.224158 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:29:46.224158 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:29:46.224158 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:29:46.224158 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:29:46.224158 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91efce57-cc54-4e70-8867-fc8ce13d6117 could not be found. Oct 08 21:29:46.224158 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:29:46.224158 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-94f95441-7ca9-42dc-b7ba-7b05ab4b3c95 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Returning 404 to user: Instance 91efce57-cc54-4e70-8867-fc8ce13d6117 could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:29:46.224158 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-94f95441-7ca9-42dc-b7ba-7b05ab4b3c95 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "GET /compute/v2.1/servers/91efce57-cc54-4e70-8867-fc8ce13d6117" status: 404 len: 111 microversion: 2.1 time: 0.034339 Oct 08 21:29:46.224158 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3031/5989] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:29:46 2022] GET /compute/v2.1/servers/91efce57-cc54-4e70-8867-fc8ce13d6117 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:29:46.907009 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-1efac535-eb5d-48d9-ad7f-804e3bddbd79 req-8d22abbb-5881-42e8-82ad-73385ec5bfa2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91efce57-cc54-4e70-8867-fc8ce13d6117", "name": "network-vif-deleted", "tag": "d1524c09-88b8-4e8e-8958-452eebdafd18"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:29:46.917278 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-1efac535-eb5d-48d9-ad7f-804e3bddbd79 req-8d22abbb-5881-42e8-82ad-73385ec5bfa2 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:29:46.917755 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-1efac535-eb5d-48d9-ad7f-804e3bddbd79 req-8d22abbb-5881-42e8-82ad-73385ec5bfa2 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:29:46.918188 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-1efac535-eb5d-48d9-ad7f-804e3bddbd79 req-8d22abbb-5881-42e8-82ad-73385ec5bfa2 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:29:46.930600 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-1efac535-eb5d-48d9-ad7f-804e3bddbd79 req-8d22abbb-5881-42e8-82ad-73385ec5bfa2 service nova] Creating event network-vif-deleted:d1524c09-88b8-4e8e-8958-452eebdafd18 for instance 91efce57-cc54-4e70-8867-fc8ce13d6117 on nch2-master-1 Oct 08 21:29:46.935790 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-1efac535-eb5d-48d9-ad7f-804e3bddbd79 req-8d22abbb-5881-42e8-82ad-73385ec5bfa2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033859 Oct 08 21:29:46.936771 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2959/5990] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:29:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:29:49.611256 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-b4bef27f-7b01-4982-9f72-cf420f385eae tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Calling method '.version_select at 0x7f1a8ca76c10>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:29:49.637076 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-b4bef27f-7b01-4982-9f72-cf420f385eae tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1241881951" status: 202 len: 0 microversion: 2.1 time: 0.029855 Oct 08 21:29:49.638011 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3032/5991] 10.222.0.26 () {58 vars in 1284 bytes} [Sat Oct 8 21:29:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1241881951 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 21:29:49.666477 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-d71be8ac-7329-4b01-bceb-21c366db1d82 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Action: 'create', calling method: .version_select at 0x7f1a8786daf0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-925050340", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDoJKrRkGj36Sj9q1rrJoCW8sFTgSfzZo+UkKYMhMg8vp+PMRTBfmlKXqp55O4xhegcNrRqv0Sv4E/Q8wvhfwjJZm4QgEglc5LS/iljPPshDKI7nRqJ5E0PJH7d8RCWkFg=="}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:29:49.690476 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-d71be8ac-7329-4b01-bceb-21c366db1d82 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Getting quotas for project 3eeb6be960cc408296ecce6353b72f6d. Resources: {'key_pairs'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:29:49.696173 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-d71be8ac-7329-4b01-bceb-21c366db1d82 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Getting quotas for user 8219a93945a147c4a57bb6452212fe7c and project 3eeb6be960cc408296ecce6353b72f6d. Resources: {'key_pairs'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:29:49.719890 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-d71be8ac-7329-4b01-bceb-21c366db1d82 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.058299 Oct 08 21:29:49.720500 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2960/5992] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Oct 8 21:29:49 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:29:55.141539 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-7153f34c-b915-4457-a9ec-072fca4ea19b tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-774001861", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "networks": [{"uuid": "46e5f562-97af-4b65-8bfa-e13500e9b93a"}], "key_name": "tempest-TestNetworkAdvancedServerOps-925050340", "security_groups": [{"name": "tempest-secgroup-smoke-158598533"}]}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:29:55.271143 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.network.neutron [None req-7153f34c-b915-4457-a9ec-072fca4ea19b tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] validate_networks() for [('46e5f562-97af-4b65-8bfa-e13500e9b93a', None, None, None, None, None)] {{(pid=140492) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 21:29:55.734876 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-7153f34c-b915-4457-a9ec-072fca4ea19b tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Flavor limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 21:29:55.735317 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-7153f34c-b915-4457-a9ec-072fca4ea19b tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Image limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 21:29:55.735806 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-7153f34c-b915-4457-a9ec-072fca4ea19b tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Flavor pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 21:29:55.736232 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-7153f34c-b915-4457-a9ec-072fca4ea19b tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Image pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 21:29:55.736657 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-7153f34c-b915-4457-a9ec-072fca4ea19b tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 21:29:55.746948 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7153f34c-b915-4457-a9ec-072fca4ea19b tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:29:55.747453 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7153f34c-b915-4457-a9ec-072fca4ea19b tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:29:55.747917 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7153f34c-b915-4457-a9ec-072fca4ea19b tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:29:55.748749 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7153f34c-b915-4457-a9ec-072fca4ea19b tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:29:55.749451 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7153f34c-b915-4457-a9ec-072fca4ea19b tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:29:55.749929 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7153f34c-b915-4457-a9ec-072fca4ea19b tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:29:55.770438 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-7153f34c-b915-4457-a9ec-072fca4ea19b tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Getting quotas for project 3eeb6be960cc408296ecce6353b72f6d. Resources: {'cores', 'instances', 'ram'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:29:55.776339 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-7153f34c-b915-4457-a9ec-072fca4ea19b tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Getting quotas for user 8219a93945a147c4a57bb6452212fe7c and project 3eeb6be960cc408296ecce6353b72f6d. Resources: {'cores', 'instances', 'ram'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:29:55.791347 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-7153f34c-b915-4457-a9ec-072fca4ea19b tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Going to run 1 instances... {{(pid=140492) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 21:29:55.793995 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-7153f34c-b915-4457-a9ec-072fca4ea19b tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 26380fee-a566-413d-97bf-cebd90ec2aab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c508bd7f-7db9-4b2c-af7c-be54a855c355',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140492) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 21:29:55.846083 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-7153f34c-b915-4457-a9ec-072fca4ea19b tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.709955 Oct 08 21:29:55.853427 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3033/5993] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 21:29:55 2022] POST /compute/v2.1/servers => generated 405 bytes in 718 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 08 21:29:55.860283 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-7be00788-8fab-4a4d-88a1-f8bd42a69315 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:29:55.861045 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-7be00788-8fab-4a4d-88a1-f8bd42a69315 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 26380fee-a566-413d-97bf-cebd90ec2aab] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:29:55.956531 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-7be00788-8fab-4a4d-88a1-f8bd42a69315 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219a93945a147c4a57bb6452212fe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eeb6be960cc408296ecce6353b72f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:29:55.966419 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-7be00788-8fab-4a4d-88a1-f8bd42a69315 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "GET /compute/v2.1/servers/26380fee-a566-413d-97bf-cebd90ec2aab" status: 200 len: 1265 microversion: 2.1 time: 0.111679 Oct 08 21:29:55.972866 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2961/5994] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:29:55 2022] GET /compute/v2.1/servers/26380fee-a566-413d-97bf-cebd90ec2aab => generated 1265 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:29:56.992067 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-4f920a1a-dd2e-4351-91d8-cb3bccd4804b tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:29:56.992703 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-4f920a1a-dd2e-4351-91d8-cb3bccd4804b tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 26380fee-a566-413d-97bf-cebd90ec2aab] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:29:56.998880 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4f920a1a-dd2e-4351-91d8-cb3bccd4804b tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:29:56.999384 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4f920a1a-dd2e-4351-91d8-cb3bccd4804b tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:29:57.000340 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4f920a1a-dd2e-4351-91d8-cb3bccd4804b tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:29:57.001054 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4f920a1a-dd2e-4351-91d8-cb3bccd4804b tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:29:57.001554 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4f920a1a-dd2e-4351-91d8-cb3bccd4804b tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:29:57.001996 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4f920a1a-dd2e-4351-91d8-cb3bccd4804b tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:29:57.069805 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-4f920a1a-dd2e-4351-91d8-cb3bccd4804b tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219a93945a147c4a57bb6452212fe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eeb6be960cc408296ecce6353b72f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:29:57.077635 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-4f920a1a-dd2e-4351-91d8-cb3bccd4804b tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "GET /compute/v2.1/servers/26380fee-a566-413d-97bf-cebd90ec2aab" status: 200 len: 1317 microversion: 2.1 time: 0.090381 Oct 08 21:29:57.078786 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3034/5995] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:29:56 2022] GET /compute/v2.1/servers/26380fee-a566-413d-97bf-cebd90ec2aab => generated 1317 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:29:58.101356 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-fae47f4d-6922-4038-9163-455965fef410 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:29:58.103104 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-fae47f4d-6922-4038-9163-455965fef410 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 26380fee-a566-413d-97bf-cebd90ec2aab] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:29:58.110348 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=58 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:29:58.118423 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fae47f4d-6922-4038-9163-455965fef410 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:29:58.119249 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fae47f4d-6922-4038-9163-455965fef410 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:29:58.119820 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fae47f4d-6922-4038-9163-455965fef410 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:29:58.120744 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fae47f4d-6922-4038-9163-455965fef410 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:29:58.121428 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fae47f4d-6922-4038-9163-455965fef410 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:29:58.122077 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fae47f4d-6922-4038-9163-455965fef410 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:29:58.357671 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-fae47f4d-6922-4038-9163-455965fef410 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219a93945a147c4a57bb6452212fe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eeb6be960cc408296ecce6353b72f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:29:58.370339 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-fae47f4d-6922-4038-9163-455965fef410 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "GET /compute/v2.1/servers/26380fee-a566-413d-97bf-cebd90ec2aab" status: 200 len: 1390 microversion: 2.1 time: 0.272606 Oct 08 21:29:58.371454 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2962/5996] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:29:58 2022] GET /compute/v2.1/servers/26380fee-a566-413d-97bf-cebd90ec2aab => generated 1390 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:29:59.027319 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-990cfd2b-e767-4c03-b776-e6176ee16298 req-bc7d11e6-2682-4a7f-87e3-5376331c8d9a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26380fee-a566-413d-97bf-cebd90ec2aab", "tag": "e6bc0164-02e4-4b9c-9842-a6841a51af8c"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:29:59.040212 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-990cfd2b-e767-4c03-b776-e6176ee16298 req-bc7d11e6-2682-4a7f-87e3-5376331c8d9a service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:29:59.040700 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-990cfd2b-e767-4c03-b776-e6176ee16298 req-bc7d11e6-2682-4a7f-87e3-5376331c8d9a service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:29:59.041360 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-990cfd2b-e767-4c03-b776-e6176ee16298 req-bc7d11e6-2682-4a7f-87e3-5376331c8d9a service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:29:59.053617 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-990cfd2b-e767-4c03-b776-e6176ee16298 req-bc7d11e6-2682-4a7f-87e3-5376331c8d9a service nova] Creating event network-changed:e6bc0164-02e4-4b9c-9842-a6841a51af8c for instance 26380fee-a566-413d-97bf-cebd90ec2aab on nch1-master-1 Oct 08 21:29:59.059153 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-990cfd2b-e767-4c03-b776-e6176ee16298 req-bc7d11e6-2682-4a7f-87e3-5376331c8d9a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036346 Oct 08 21:29:59.059778 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3035/5997] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:29:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:29:59.396471 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c21f2176-8166-4260-9340-b18ff8f5099b tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:29:59.397170 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-c21f2176-8166-4260-9340-b18ff8f5099b tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 26380fee-a566-413d-97bf-cebd90ec2aab] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:29:59.404080 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c21f2176-8166-4260-9340-b18ff8f5099b tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:29:59.404881 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c21f2176-8166-4260-9340-b18ff8f5099b tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:29:59.405593 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c21f2176-8166-4260-9340-b18ff8f5099b tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:29:59.406587 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c21f2176-8166-4260-9340-b18ff8f5099b tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:29:59.407458 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c21f2176-8166-4260-9340-b18ff8f5099b tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:29:59.408212 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c21f2176-8166-4260-9340-b18ff8f5099b tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:29:59.561278 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-c21f2176-8166-4260-9340-b18ff8f5099b tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219a93945a147c4a57bb6452212fe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eeb6be960cc408296ecce6353b72f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:29:59.569743 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-c21f2176-8166-4260-9340-b18ff8f5099b tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "GET /compute/v2.1/servers/26380fee-a566-413d-97bf-cebd90ec2aab" status: 200 len: 1390 microversion: 2.1 time: 0.177160 Oct 08 21:29:59.570320 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2963/5998] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:29:59 2022] GET /compute/v2.1/servers/26380fee-a566-413d-97bf-cebd90ec2aab => generated 1390 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:30:00.592558 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-c5057caf-9ca4-4654-aba2-c093eeb8aa65 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:30:00.593326 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-c5057caf-9ca4-4654-aba2-c093eeb8aa65 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 26380fee-a566-413d-97bf-cebd90ec2aab] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:30:00.601081 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c5057caf-9ca4-4654-aba2-c093eeb8aa65 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:30:00.601625 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c5057caf-9ca4-4654-aba2-c093eeb8aa65 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:30:00.602080 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c5057caf-9ca4-4654-aba2-c093eeb8aa65 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:30:00.602792 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c5057caf-9ca4-4654-aba2-c093eeb8aa65 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:30:00.603264 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c5057caf-9ca4-4654-aba2-c093eeb8aa65 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:30:00.603705 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c5057caf-9ca4-4654-aba2-c093eeb8aa65 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:30:00.740724 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-c5057caf-9ca4-4654-aba2-c093eeb8aa65 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219a93945a147c4a57bb6452212fe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eeb6be960cc408296ecce6353b72f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:30:00.748714 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-c5057caf-9ca4-4654-aba2-c093eeb8aa65 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "GET /compute/v2.1/servers/26380fee-a566-413d-97bf-cebd90ec2aab" status: 200 len: 1390 microversion: 2.1 time: 0.160545 Oct 08 21:30:00.749324 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3036/5999] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:30:00 2022] GET /compute/v2.1/servers/26380fee-a566-413d-97bf-cebd90ec2aab => generated 1390 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:30:01.772345 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-8240810a-70d5-43f5-8a00-2b3849518367 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:30:01.772924 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-8240810a-70d5-43f5-8a00-2b3849518367 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 26380fee-a566-413d-97bf-cebd90ec2aab] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:30:01.780085 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8240810a-70d5-43f5-8a00-2b3849518367 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:30:01.780587 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8240810a-70d5-43f5-8a00-2b3849518367 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:30:01.781657 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8240810a-70d5-43f5-8a00-2b3849518367 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:30:01.782378 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8240810a-70d5-43f5-8a00-2b3849518367 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:30:01.782851 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8240810a-70d5-43f5-8a00-2b3849518367 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:30:01.783296 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8240810a-70d5-43f5-8a00-2b3849518367 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:30:01.916944 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-8240810a-70d5-43f5-8a00-2b3849518367 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219a93945a147c4a57bb6452212fe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eeb6be960cc408296ecce6353b72f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:30:01.924979 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-8240810a-70d5-43f5-8a00-2b3849518367 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "GET /compute/v2.1/servers/26380fee-a566-413d-97bf-cebd90ec2aab" status: 200 len: 1390 microversion: 2.1 time: 0.156643 Oct 08 21:30:01.925597 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2964/6000] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:30:01 2022] GET /compute/v2.1/servers/26380fee-a566-413d-97bf-cebd90ec2aab => generated 1390 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:30:02.947820 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-8f7f3e08-776c-4a93-8d05-0db6602abc92 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:30:02.948434 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-8f7f3e08-776c-4a93-8d05-0db6602abc92 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 26380fee-a566-413d-97bf-cebd90ec2aab] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:30:02.951233 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:30:02.957059 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8f7f3e08-776c-4a93-8d05-0db6602abc92 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:30:02.957606 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8f7f3e08-776c-4a93-8d05-0db6602abc92 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:30:02.958045 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8f7f3e08-776c-4a93-8d05-0db6602abc92 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:30:02.958746 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8f7f3e08-776c-4a93-8d05-0db6602abc92 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:30:02.959203 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8f7f3e08-776c-4a93-8d05-0db6602abc92 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:30:02.959636 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8f7f3e08-776c-4a93-8d05-0db6602abc92 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:30:02.963090 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:30:03.098258 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-8f7f3e08-776c-4a93-8d05-0db6602abc92 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219a93945a147c4a57bb6452212fe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eeb6be960cc408296ecce6353b72f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:30:03.106041 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-8f7f3e08-776c-4a93-8d05-0db6602abc92 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "GET /compute/v2.1/servers/26380fee-a566-413d-97bf-cebd90ec2aab" status: 200 len: 1390 microversion: 2.1 time: 0.162154 Oct 08 21:30:03.106616 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3037/6001] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:30:02 2022] GET /compute/v2.1/servers/26380fee-a566-413d-97bf-cebd90ec2aab => generated 1390 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:30:04.128756 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-34077dc6-54ee-47f1-965d-f0e1da3a97fc tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:30:04.129382 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-34077dc6-54ee-47f1-965d-f0e1da3a97fc tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 26380fee-a566-413d-97bf-cebd90ec2aab] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:30:04.131955 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=1 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:30:04.138410 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-34077dc6-54ee-47f1-965d-f0e1da3a97fc tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:30:04.139035 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-34077dc6-54ee-47f1-965d-f0e1da3a97fc tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:30:04.139459 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-34077dc6-54ee-47f1-965d-f0e1da3a97fc tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:30:04.140676 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-34077dc6-54ee-47f1-965d-f0e1da3a97fc tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:30:04.141143 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-34077dc6-54ee-47f1-965d-f0e1da3a97fc tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:30:04.141604 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-34077dc6-54ee-47f1-965d-f0e1da3a97fc tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:30:04.270943 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-34077dc6-54ee-47f1-965d-f0e1da3a97fc tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219a93945a147c4a57bb6452212fe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eeb6be960cc408296ecce6353b72f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:30:04.278813 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-34077dc6-54ee-47f1-965d-f0e1da3a97fc tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "GET /compute/v2.1/servers/26380fee-a566-413d-97bf-cebd90ec2aab" status: 200 len: 1390 microversion: 2.1 time: 0.154354 Oct 08 21:30:04.279395 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2965/6002] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:30:04 2022] GET /compute/v2.1/servers/26380fee-a566-413d-97bf-cebd90ec2aab => generated 1390 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:30:05.301300 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-bb51e0b1-d6b5-4b90-bb9b-8db370c3d872 req-4085fc70-edd8-4474-9f41-ca59c84e344c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26380fee-a566-413d-97bf-cebd90ec2aab", "name": "network-vif-plugged", "status": "completed", "tag": "e6bc0164-02e4-4b9c-9842-a6841a51af8c"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:30:05.303248 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-a2956cab-7f8a-4af2-9898-0bce6fb7e5ed tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:30:05.303949 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-a2956cab-7f8a-4af2-9898-0bce6fb7e5ed tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 26380fee-a566-413d-97bf-cebd90ec2aab] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:30:05.312794 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-bb51e0b1-d6b5-4b90-bb9b-8db370c3d872 req-4085fc70-edd8-4474-9f41-ca59c84e344c service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:30:05.313031 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a2956cab-7f8a-4af2-9898-0bce6fb7e5ed tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:30:05.313424 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-bb51e0b1-d6b5-4b90-bb9b-8db370c3d872 req-4085fc70-edd8-4474-9f41-ca59c84e344c service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:30:05.313699 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a2956cab-7f8a-4af2-9898-0bce6fb7e5ed tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:30:05.313824 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-bb51e0b1-d6b5-4b90-bb9b-8db370c3d872 req-4085fc70-edd8-4474-9f41-ca59c84e344c service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:30:05.314606 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a2956cab-7f8a-4af2-9898-0bce6fb7e5ed tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:30:05.315401 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a2956cab-7f8a-4af2-9898-0bce6fb7e5ed tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:30:05.316085 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a2956cab-7f8a-4af2-9898-0bce6fb7e5ed tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:30:05.316725 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a2956cab-7f8a-4af2-9898-0bce6fb7e5ed tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:30:05.325562 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-bb51e0b1-d6b5-4b90-bb9b-8db370c3d872 req-4085fc70-edd8-4474-9f41-ca59c84e344c service nova] Creating event network-vif-plugged:e6bc0164-02e4-4b9c-9842-a6841a51af8c for instance 26380fee-a566-413d-97bf-cebd90ec2aab on nch1-master-1 Oct 08 21:30:05.330822 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-bb51e0b1-d6b5-4b90-bb9b-8db370c3d872 req-4085fc70-edd8-4474-9f41-ca59c84e344c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034263 Oct 08 21:30:05.331602 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3038/6003] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:30:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:30:05.518212 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-a2956cab-7f8a-4af2-9898-0bce6fb7e5ed tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219a93945a147c4a57bb6452212fe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eeb6be960cc408296ecce6353b72f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:30:05.526422 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-a2956cab-7f8a-4af2-9898-0bce6fb7e5ed tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "GET /compute/v2.1/servers/26380fee-a566-413d-97bf-cebd90ec2aab" status: 200 len: 1390 microversion: 2.1 time: 0.227776 Oct 08 21:30:05.527129 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2966/6004] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:30:05 2022] GET /compute/v2.1/servers/26380fee-a566-413d-97bf-cebd90ec2aab => generated 1390 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:30:06.548153 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=2 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:30:06.549035 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=6 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:30:06.554361 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-16284984-732c-4d28-8b1a-761f27614052 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:30:06.555222 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-16284984-732c-4d28-8b1a-761f27614052 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 26380fee-a566-413d-97bf-cebd90ec2aab] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:30:06.563536 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-16284984-732c-4d28-8b1a-761f27614052 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:30:06.564061 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-16284984-732c-4d28-8b1a-761f27614052 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:30:06.564502 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-16284984-732c-4d28-8b1a-761f27614052 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:30:06.565490 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-16284984-732c-4d28-8b1a-761f27614052 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:30:06.565996 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-16284984-732c-4d28-8b1a-761f27614052 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:30:06.566439 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-16284984-732c-4d28-8b1a-761f27614052 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:30:06.714587 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-16284984-732c-4d28-8b1a-761f27614052 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219a93945a147c4a57bb6452212fe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eeb6be960cc408296ecce6353b72f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:30:06.723420 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-16284984-732c-4d28-8b1a-761f27614052 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "GET /compute/v2.1/servers/26380fee-a566-413d-97bf-cebd90ec2aab" status: 200 len: 1390 microversion: 2.1 time: 0.176259 Oct 08 21:30:06.727705 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3039/6005] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:30:06 2022] GET /compute/v2.1/servers/26380fee-a566-413d-97bf-cebd90ec2aab => generated 1390 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:30:07.747018 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-1dabd362-099a-4ad5-bf55-c31654ed8d53 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:30:07.747564 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-1dabd362-099a-4ad5-bf55-c31654ed8d53 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 26380fee-a566-413d-97bf-cebd90ec2aab] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:30:07.750081 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=6 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:30:07.757719 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1dabd362-099a-4ad5-bf55-c31654ed8d53 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:30:07.758211 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1dabd362-099a-4ad5-bf55-c31654ed8d53 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:30:07.758654 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1dabd362-099a-4ad5-bf55-c31654ed8d53 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:30:07.759356 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1dabd362-099a-4ad5-bf55-c31654ed8d53 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:30:07.759816 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1dabd362-099a-4ad5-bf55-c31654ed8d53 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:30:07.760245 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1dabd362-099a-4ad5-bf55-c31654ed8d53 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:30:07.894933 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-1dabd362-099a-4ad5-bf55-c31654ed8d53 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219a93945a147c4a57bb6452212fe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eeb6be960cc408296ecce6353b72f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:30:07.902803 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-1dabd362-099a-4ad5-bf55-c31654ed8d53 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "GET /compute/v2.1/servers/26380fee-a566-413d-97bf-cebd90ec2aab" status: 200 len: 1562 microversion: 2.1 time: 0.159842 Oct 08 21:30:07.903379 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2967/6006] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:30:07 2022] GET /compute/v2.1/servers/26380fee-a566-413d-97bf-cebd90ec2aab => generated 1562 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:30:07.925532 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-ebc222cd-e728-413c-b4a3-bf6a58d8c4c8 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:30:07.926154 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-ebc222cd-e728-413c-b4a3-bf6a58d8c4c8 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 26380fee-a566-413d-97bf-cebd90ec2aab] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:30:07.933226 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ebc222cd-e728-413c-b4a3-bf6a58d8c4c8 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:30:07.933725 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ebc222cd-e728-413c-b4a3-bf6a58d8c4c8 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:30:07.934178 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ebc222cd-e728-413c-b4a3-bf6a58d8c4c8 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:30:07.934884 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ebc222cd-e728-413c-b4a3-bf6a58d8c4c8 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:30:07.935353 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ebc222cd-e728-413c-b4a3-bf6a58d8c4c8 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:30:07.935789 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ebc222cd-e728-413c-b4a3-bf6a58d8c4c8 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:30:08.068497 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-ebc222cd-e728-413c-b4a3-bf6a58d8c4c8 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219a93945a147c4a57bb6452212fe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eeb6be960cc408296ecce6353b72f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:30:08.076326 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-ebc222cd-e728-413c-b4a3-bf6a58d8c4c8 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "GET /compute/v2.1/servers/26380fee-a566-413d-97bf-cebd90ec2aab" status: 200 len: 1562 microversion: 2.1 time: 0.155188 Oct 08 21:30:08.076903 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3040/6007] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:30:07 2022] GET /compute/v2.1/servers/26380fee-a566-413d-97bf-cebd90ec2aab => generated 1562 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:30:09.987404 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-7153abf6-485e-4af0-98d6-62b19ec0a42a tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:30:09.988022 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-7153abf6-485e-4af0-98d6-62b19ec0a42a tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 26380fee-a566-413d-97bf-cebd90ec2aab] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:30:09.990293 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-cfbbe5a2-5c83-4a9e-9f4d-0d3a15fd1d21 req-97742cc4-0389-492c-a694-69688b888f7a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26380fee-a566-413d-97bf-cebd90ec2aab", "tag": "e6bc0164-02e4-4b9c-9842-a6841a51af8c"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:30:09.995635 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7153abf6-485e-4af0-98d6-62b19ec0a42a tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:30:09.996131 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7153abf6-485e-4af0-98d6-62b19ec0a42a tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:30:09.996574 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7153abf6-485e-4af0-98d6-62b19ec0a42a tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:30:09.997503 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7153abf6-485e-4af0-98d6-62b19ec0a42a tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:30:09.997962 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7153abf6-485e-4af0-98d6-62b19ec0a42a tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:30:09.998651 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7153abf6-485e-4af0-98d6-62b19ec0a42a tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:30:10.001493 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-cfbbe5a2-5c83-4a9e-9f4d-0d3a15fd1d21 req-97742cc4-0389-492c-a694-69688b888f7a service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:30:10.002058 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-cfbbe5a2-5c83-4a9e-9f4d-0d3a15fd1d21 req-97742cc4-0389-492c-a694-69688b888f7a service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:30:10.002622 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-cfbbe5a2-5c83-4a9e-9f4d-0d3a15fd1d21 req-97742cc4-0389-492c-a694-69688b888f7a service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:30:10.014993 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-cfbbe5a2-5c83-4a9e-9f4d-0d3a15fd1d21 req-97742cc4-0389-492c-a694-69688b888f7a service nova] Creating event network-changed:e6bc0164-02e4-4b9c-9842-a6841a51af8c for instance 26380fee-a566-413d-97bf-cebd90ec2aab on nch1-master-1 Oct 08 21:30:10.020349 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-cfbbe5a2-5c83-4a9e-9f4d-0d3a15fd1d21 req-97742cc4-0389-492c-a694-69688b888f7a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033820 Oct 08 21:30:10.021562 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3041/6008] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:30:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:30:10.234515 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-7153abf6-485e-4af0-98d6-62b19ec0a42a tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219a93945a147c4a57bb6452212fe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eeb6be960cc408296ecce6353b72f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:30:10.243338 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-7153abf6-485e-4af0-98d6-62b19ec0a42a tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "GET /compute/v2.1/servers/26380fee-a566-413d-97bf-cebd90ec2aab" status: 200 len: 1562 microversion: 2.1 time: 0.260730 Oct 08 21:30:10.244342 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2968/6009] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:30:09 2022] GET /compute/v2.1/servers/26380fee-a566-413d-97bf-cebd90ec2aab => generated 1562 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:30:33.547191 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=9 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:30:33.547854 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=21 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:30:33.552760 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-c659d375-184e-4e19-9a5a-13ca11166440 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:30:33.555045 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-c659d375-184e-4e19-9a5a-13ca11166440 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 26380fee-a566-413d-97bf-cebd90ec2aab] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:30:33.562810 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c659d375-184e-4e19-9a5a-13ca11166440 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:30:33.563296 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c659d375-184e-4e19-9a5a-13ca11166440 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:30:33.563742 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c659d375-184e-4e19-9a5a-13ca11166440 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:30:33.564434 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c659d375-184e-4e19-9a5a-13ca11166440 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:30:33.564894 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c659d375-184e-4e19-9a5a-13ca11166440 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:30:33.565372 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c659d375-184e-4e19-9a5a-13ca11166440 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:30:33.619160 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-c659d375-184e-4e19-9a5a-13ca11166440 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "POST /compute/v2.1/servers/26380fee-a566-413d-97bf-cebd90ec2aab/action" status: 200 len: 24573 microversion: 2.1 time: 0.073918 Oct 08 21:30:33.620106 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3042/6010] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:30:33 2022] POST /compute/v2.1/servers/26380fee-a566-413d-97bf-cebd90ec2aab/action => generated 24573 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 08 21:30:44.647937 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-1051720c-2ffa-4163-a76d-a93878049838 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:30:44.650658 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-1051720c-2ffa-4163-a76d-a93878049838 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 26380fee-a566-413d-97bf-cebd90ec2aab] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:30:44.652715 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:SELECT=7 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:30:44.653407 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=42 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:30:44.659434 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1051720c-2ffa-4163-a76d-a93878049838 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:30:44.659930 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1051720c-2ffa-4163-a76d-a93878049838 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:30:44.660381 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1051720c-2ffa-4163-a76d-a93878049838 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:30:44.661094 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1051720c-2ffa-4163-a76d-a93878049838 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:30:44.661586 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1051720c-2ffa-4163-a76d-a93878049838 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:30:44.662029 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1051720c-2ffa-4163-a76d-a93878049838 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:30:44.740336 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-1051720c-2ffa-4163-a76d-a93878049838 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Flavor limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 21:30:44.740784 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-1051720c-2ffa-4163-a76d-a93878049838 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Image limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 21:30:44.741294 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-1051720c-2ffa-4163-a76d-a93878049838 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Flavor pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 21:30:44.741715 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-1051720c-2ffa-4163-a76d-a93878049838 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Image pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 21:30:44.742133 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-1051720c-2ffa-4163-a76d-a93878049838 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 21:30:44.802497 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-1051720c-2ffa-4163-a76d-a93878049838 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 26380fee-a566-413d-97bf-cebd90ec2aab] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:30:44.808336 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1051720c-2ffa-4163-a76d-a93878049838 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:30:44.808937 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1051720c-2ffa-4163-a76d-a93878049838 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:30:44.809925 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1051720c-2ffa-4163-a76d-a93878049838 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:30:44.810658 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1051720c-2ffa-4163-a76d-a93878049838 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:30:44.811119 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1051720c-2ffa-4163-a76d-a93878049838 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:30:44.811552 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1051720c-2ffa-4163-a76d-a93878049838 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:30:44.838696 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-1051720c-2ffa-4163-a76d-a93878049838 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "POST /compute/v2.1/servers/26380fee-a566-413d-97bf-cebd90ec2aab/action" status: 202 len: 1137 microversion: 2.1 time: 0.195083 Oct 08 21:30:44.839358 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2969/6011] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:30:44 2022] POST /compute/v2.1/servers/26380fee-a566-413d-97bf-cebd90ec2aab/action => generated 1137 bytes in 196 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 08 21:30:44.861609 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-67455e5c-a105-457e-a523-8d5b1ac9ad18 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:30:44.862644 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-67455e5c-a105-457e-a523-8d5b1ac9ad18 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 26380fee-a566-413d-97bf-cebd90ec2aab] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:30:44.866218 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=2 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:30:44.867243 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=4 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:30:44.876573 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-67455e5c-a105-457e-a523-8d5b1ac9ad18 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:30:44.877077 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-67455e5c-a105-457e-a523-8d5b1ac9ad18 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:30:44.877548 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-67455e5c-a105-457e-a523-8d5b1ac9ad18 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:30:44.878259 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-67455e5c-a105-457e-a523-8d5b1ac9ad18 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:30:44.878722 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-67455e5c-a105-457e-a523-8d5b1ac9ad18 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:30:44.879152 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-67455e5c-a105-457e-a523-8d5b1ac9ad18 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:30:45.013613 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-67455e5c-a105-457e-a523-8d5b1ac9ad18 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219a93945a147c4a57bb6452212fe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eeb6be960cc408296ecce6353b72f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:30:45.021524 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-67455e5c-a105-457e-a523-8d5b1ac9ad18 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "GET /compute/v2.1/servers/26380fee-a566-413d-97bf-cebd90ec2aab" status: 200 len: 1690 microversion: 2.1 time: 0.165831 Oct 08 21:30:45.022107 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3043/6012] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:30:44 2022] GET /compute/v2.1/servers/26380fee-a566-413d-97bf-cebd90ec2aab => generated 1690 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:30:46.044912 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-09d279d5-f21d-46b8-89af-61d7201cec81 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:30:46.045553 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-09d279d5-f21d-46b8-89af-61d7201cec81 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 26380fee-a566-413d-97bf-cebd90ec2aab] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:30:46.052638 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-09d279d5-f21d-46b8-89af-61d7201cec81 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:30:46.053130 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-09d279d5-f21d-46b8-89af-61d7201cec81 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:30:46.053610 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-09d279d5-f21d-46b8-89af-61d7201cec81 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:30:46.054314 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-09d279d5-f21d-46b8-89af-61d7201cec81 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:30:46.054782 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-09d279d5-f21d-46b8-89af-61d7201cec81 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:30:46.055215 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-09d279d5-f21d-46b8-89af-61d7201cec81 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:30:46.186048 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-09d279d5-f21d-46b8-89af-61d7201cec81 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219a93945a147c4a57bb6452212fe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eeb6be960cc408296ecce6353b72f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:30:46.193845 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-09d279d5-f21d-46b8-89af-61d7201cec81 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "GET /compute/v2.1/servers/26380fee-a566-413d-97bf-cebd90ec2aab" status: 200 len: 1690 microversion: 2.1 time: 0.152902 Oct 08 21:30:46.194428 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2970/6013] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:30:46 2022] GET /compute/v2.1/servers/26380fee-a566-413d-97bf-cebd90ec2aab => generated 1690 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:30:47.218593 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e350dd61-4996-41d0-829d-c00cffd756b7 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:30:47.219137 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-e350dd61-4996-41d0-829d-c00cffd756b7 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 26380fee-a566-413d-97bf-cebd90ec2aab] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:30:47.226044 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e350dd61-4996-41d0-829d-c00cffd756b7 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:30:47.226530 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e350dd61-4996-41d0-829d-c00cffd756b7 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:30:47.226972 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e350dd61-4996-41d0-829d-c00cffd756b7 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:30:47.227681 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e350dd61-4996-41d0-829d-c00cffd756b7 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:30:47.228138 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e350dd61-4996-41d0-829d-c00cffd756b7 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:30:47.228566 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e350dd61-4996-41d0-829d-c00cffd756b7 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:30:47.359444 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-e350dd61-4996-41d0-829d-c00cffd756b7 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219a93945a147c4a57bb6452212fe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eeb6be960cc408296ecce6353b72f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:30:47.367184 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-e350dd61-4996-41d0-829d-c00cffd756b7 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "GET /compute/v2.1/servers/26380fee-a566-413d-97bf-cebd90ec2aab" status: 200 len: 1690 microversion: 2.1 time: 0.153256 Oct 08 21:30:47.367753 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3044/6014] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:30:47 2022] GET /compute/v2.1/servers/26380fee-a566-413d-97bf-cebd90ec2aab => generated 1690 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:30:48.390154 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-7fa87dac-81b5-454f-9d49-dc0e66e660a9 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:30:48.390770 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-7fa87dac-81b5-454f-9d49-dc0e66e660a9 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 26380fee-a566-413d-97bf-cebd90ec2aab] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:30:48.397701 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7fa87dac-81b5-454f-9d49-dc0e66e660a9 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:30:48.398194 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7fa87dac-81b5-454f-9d49-dc0e66e660a9 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:30:48.398640 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7fa87dac-81b5-454f-9d49-dc0e66e660a9 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:30:48.399341 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7fa87dac-81b5-454f-9d49-dc0e66e660a9 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:30:48.399800 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7fa87dac-81b5-454f-9d49-dc0e66e660a9 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:30:48.400235 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7fa87dac-81b5-454f-9d49-dc0e66e660a9 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:30:48.534492 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-7fa87dac-81b5-454f-9d49-dc0e66e660a9 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219a93945a147c4a57bb6452212fe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eeb6be960cc408296ecce6353b72f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:30:48.542396 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-7fa87dac-81b5-454f-9d49-dc0e66e660a9 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "GET /compute/v2.1/servers/26380fee-a566-413d-97bf-cebd90ec2aab" status: 200 len: 1690 microversion: 2.1 time: 0.156160 Oct 08 21:30:48.542971 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2971/6015] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:30:48 2022] GET /compute/v2.1/servers/26380fee-a566-413d-97bf-cebd90ec2aab => generated 1690 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:30:49.566964 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-b68dfbde-0db0-4047-bbf3-7e37560e2468 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:30:49.567598 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-b68dfbde-0db0-4047-bbf3-7e37560e2468 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 26380fee-a566-413d-97bf-cebd90ec2aab] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:30:49.575141 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b68dfbde-0db0-4047-bbf3-7e37560e2468 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:30:49.575634 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b68dfbde-0db0-4047-bbf3-7e37560e2468 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:30:49.576077 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b68dfbde-0db0-4047-bbf3-7e37560e2468 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:30:49.576844 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b68dfbde-0db0-4047-bbf3-7e37560e2468 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:30:49.577344 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b68dfbde-0db0-4047-bbf3-7e37560e2468 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:30:49.577778 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b68dfbde-0db0-4047-bbf3-7e37560e2468 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:30:49.721104 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-b68dfbde-0db0-4047-bbf3-7e37560e2468 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219a93945a147c4a57bb6452212fe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eeb6be960cc408296ecce6353b72f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:30:49.729419 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-b68dfbde-0db0-4047-bbf3-7e37560e2468 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "GET /compute/v2.1/servers/26380fee-a566-413d-97bf-cebd90ec2aab" status: 200 len: 1690 microversion: 2.1 time: 0.166352 Oct 08 21:30:49.730152 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3045/6016] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:30:49 2022] GET /compute/v2.1/servers/26380fee-a566-413d-97bf-cebd90ec2aab => generated 1690 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:30:50.753396 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-e548c3ec-92be-44a3-b74a-fae25e1e7efa tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:30:50.753922 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-e548c3ec-92be-44a3-b74a-fae25e1e7efa tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 26380fee-a566-413d-97bf-cebd90ec2aab] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:30:50.760981 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e548c3ec-92be-44a3-b74a-fae25e1e7efa tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:30:50.761504 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e548c3ec-92be-44a3-b74a-fae25e1e7efa tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:30:50.761950 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e548c3ec-92be-44a3-b74a-fae25e1e7efa tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:30:50.763315 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e548c3ec-92be-44a3-b74a-fae25e1e7efa tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:30:50.763804 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e548c3ec-92be-44a3-b74a-fae25e1e7efa tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:30:50.764262 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e548c3ec-92be-44a3-b74a-fae25e1e7efa tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:30:50.896320 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-e548c3ec-92be-44a3-b74a-fae25e1e7efa tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219a93945a147c4a57bb6452212fe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eeb6be960cc408296ecce6353b72f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:30:50.904461 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-e548c3ec-92be-44a3-b74a-fae25e1e7efa tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "GET /compute/v2.1/servers/26380fee-a566-413d-97bf-cebd90ec2aab" status: 200 len: 1690 microversion: 2.1 time: 0.155140 Oct 08 21:30:50.905043 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2972/6017] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:30:50 2022] GET /compute/v2.1/servers/26380fee-a566-413d-97bf-cebd90ec2aab => generated 1690 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:30:51.928567 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-033bcb38-c99b-404d-8f6c-aa8458364476 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:30:51.929152 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-033bcb38-c99b-404d-8f6c-aa8458364476 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 26380fee-a566-413d-97bf-cebd90ec2aab] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:30:51.936682 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-033bcb38-c99b-404d-8f6c-aa8458364476 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:30:51.937199 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-033bcb38-c99b-404d-8f6c-aa8458364476 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:30:51.937656 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-033bcb38-c99b-404d-8f6c-aa8458364476 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:30:51.938363 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-033bcb38-c99b-404d-8f6c-aa8458364476 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:30:51.938837 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-033bcb38-c99b-404d-8f6c-aa8458364476 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:30:51.939277 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-033bcb38-c99b-404d-8f6c-aa8458364476 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:30:52.070121 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-033bcb38-c99b-404d-8f6c-aa8458364476 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219a93945a147c4a57bb6452212fe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eeb6be960cc408296ecce6353b72f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:30:52.078571 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-033bcb38-c99b-404d-8f6c-aa8458364476 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "GET /compute/v2.1/servers/26380fee-a566-413d-97bf-cebd90ec2aab" status: 200 len: 1690 microversion: 2.1 time: 0.154203 Oct 08 21:30:52.079155 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3046/6018] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:30:51 2022] GET /compute/v2.1/servers/26380fee-a566-413d-97bf-cebd90ec2aab => generated 1690 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:30:53.102023 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-27ed7af3-a403-4db1-8ce9-564e94bd2266 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:30:53.102650 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-27ed7af3-a403-4db1-8ce9-564e94bd2266 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 26380fee-a566-413d-97bf-cebd90ec2aab] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:30:53.109906 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-27ed7af3-a403-4db1-8ce9-564e94bd2266 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:30:53.110410 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-27ed7af3-a403-4db1-8ce9-564e94bd2266 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:30:53.110863 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-27ed7af3-a403-4db1-8ce9-564e94bd2266 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:30:53.111576 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-27ed7af3-a403-4db1-8ce9-564e94bd2266 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:30:53.112048 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-27ed7af3-a403-4db1-8ce9-564e94bd2266 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:30:53.112489 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-27ed7af3-a403-4db1-8ce9-564e94bd2266 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:30:53.241050 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-27ed7af3-a403-4db1-8ce9-564e94bd2266 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219a93945a147c4a57bb6452212fe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eeb6be960cc408296ecce6353b72f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:30:53.249085 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-27ed7af3-a403-4db1-8ce9-564e94bd2266 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "GET /compute/v2.1/servers/26380fee-a566-413d-97bf-cebd90ec2aab" status: 200 len: 1690 microversion: 2.1 time: 0.151021 Oct 08 21:30:53.249673 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2973/6019] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:30:53 2022] GET /compute/v2.1/servers/26380fee-a566-413d-97bf-cebd90ec2aab => generated 1690 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:30:54.273433 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-54aa0e89-c4a7-4cd3-916c-6038b8795c85 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:30:54.274055 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-54aa0e89-c4a7-4cd3-916c-6038b8795c85 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 26380fee-a566-413d-97bf-cebd90ec2aab] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:30:54.281535 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-54aa0e89-c4a7-4cd3-916c-6038b8795c85 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:30:54.282028 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-54aa0e89-c4a7-4cd3-916c-6038b8795c85 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:30:54.282479 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-54aa0e89-c4a7-4cd3-916c-6038b8795c85 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:30:54.283187 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-54aa0e89-c4a7-4cd3-916c-6038b8795c85 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:30:54.283652 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-54aa0e89-c4a7-4cd3-916c-6038b8795c85 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:30:54.284087 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-54aa0e89-c4a7-4cd3-916c-6038b8795c85 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:30:54.419027 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-54aa0e89-c4a7-4cd3-916c-6038b8795c85 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219a93945a147c4a57bb6452212fe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eeb6be960cc408296ecce6353b72f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:30:54.426890 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-54aa0e89-c4a7-4cd3-916c-6038b8795c85 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "GET /compute/v2.1/servers/26380fee-a566-413d-97bf-cebd90ec2aab" status: 200 len: 1690 microversion: 2.1 time: 0.157402 Oct 08 21:30:54.427469 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3047/6020] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:30:54 2022] GET /compute/v2.1/servers/26380fee-a566-413d-97bf-cebd90ec2aab => generated 1690 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:30:55.450272 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-ecf46943-d31f-4140-a9e0-c50f19c82aeb tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:30:55.450900 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-ecf46943-d31f-4140-a9e0-c50f19c82aeb tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 26380fee-a566-413d-97bf-cebd90ec2aab] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:30:55.458042 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ecf46943-d31f-4140-a9e0-c50f19c82aeb tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:30:55.458535 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ecf46943-d31f-4140-a9e0-c50f19c82aeb tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:30:55.458982 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ecf46943-d31f-4140-a9e0-c50f19c82aeb tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:30:55.459682 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ecf46943-d31f-4140-a9e0-c50f19c82aeb tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:30:55.460143 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ecf46943-d31f-4140-a9e0-c50f19c82aeb tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:30:55.460573 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ecf46943-d31f-4140-a9e0-c50f19c82aeb tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:30:55.597600 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-ecf46943-d31f-4140-a9e0-c50f19c82aeb tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219a93945a147c4a57bb6452212fe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eeb6be960cc408296ecce6353b72f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:30:55.605774 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-ecf46943-d31f-4140-a9e0-c50f19c82aeb tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "GET /compute/v2.1/servers/26380fee-a566-413d-97bf-cebd90ec2aab" status: 200 len: 1690 microversion: 2.1 time: 0.159590 Oct 08 21:30:55.606352 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2974/6021] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:30:55 2022] GET /compute/v2.1/servers/26380fee-a566-413d-97bf-cebd90ec2aab => generated 1690 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:30:56.629784 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-d2977716-5450-425f-84a2-063c92bb68de tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:30:56.630405 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-d2977716-5450-425f-84a2-063c92bb68de tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 26380fee-a566-413d-97bf-cebd90ec2aab] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:30:56.639315 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d2977716-5450-425f-84a2-063c92bb68de tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:30:56.639813 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d2977716-5450-425f-84a2-063c92bb68de tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:30:56.640262 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d2977716-5450-425f-84a2-063c92bb68de tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:30:56.640969 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d2977716-5450-425f-84a2-063c92bb68de tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:30:56.641467 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d2977716-5450-425f-84a2-063c92bb68de tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:30:56.641907 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d2977716-5450-425f-84a2-063c92bb68de tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:30:56.775160 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-d2977716-5450-425f-84a2-063c92bb68de tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219a93945a147c4a57bb6452212fe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eeb6be960cc408296ecce6353b72f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:30:56.782993 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-d2977716-5450-425f-84a2-063c92bb68de tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "GET /compute/v2.1/servers/26380fee-a566-413d-97bf-cebd90ec2aab" status: 200 len: 1690 microversion: 2.1 time: 0.157115 Oct 08 21:30:56.783569 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3048/6022] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:30:56 2022] GET /compute/v2.1/servers/26380fee-a566-413d-97bf-cebd90ec2aab => generated 1690 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:30:57.806870 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-cccd8704-b22f-4af4-af3c-48b8b32d76a4 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:30:57.807413 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-cccd8704-b22f-4af4-af3c-48b8b32d76a4 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 26380fee-a566-413d-97bf-cebd90ec2aab] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:30:57.814436 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cccd8704-b22f-4af4-af3c-48b8b32d76a4 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:30:57.814929 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cccd8704-b22f-4af4-af3c-48b8b32d76a4 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:30:57.815385 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cccd8704-b22f-4af4-af3c-48b8b32d76a4 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:30:57.817384 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cccd8704-b22f-4af4-af3c-48b8b32d76a4 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:30:57.817875 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cccd8704-b22f-4af4-af3c-48b8b32d76a4 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:30:57.818348 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cccd8704-b22f-4af4-af3c-48b8b32d76a4 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:30:57.956445 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-cccd8704-b22f-4af4-af3c-48b8b32d76a4 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219a93945a147c4a57bb6452212fe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eeb6be960cc408296ecce6353b72f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:30:57.964403 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-cccd8704-b22f-4af4-af3c-48b8b32d76a4 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "GET /compute/v2.1/servers/26380fee-a566-413d-97bf-cebd90ec2aab" status: 200 len: 1690 microversion: 2.1 time: 0.161540 Oct 08 21:30:57.964967 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2975/6023] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:30:57 2022] GET /compute/v2.1/servers/26380fee-a566-413d-97bf-cebd90ec2aab => generated 1690 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:30:58.988324 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-1222fa2f-d775-485f-9e1d-a704c8f0b331 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:30:58.988978 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-1222fa2f-d775-485f-9e1d-a704c8f0b331 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 26380fee-a566-413d-97bf-cebd90ec2aab] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:30:58.995771 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1222fa2f-d775-485f-9e1d-a704c8f0b331 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:30:58.996267 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1222fa2f-d775-485f-9e1d-a704c8f0b331 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:30:58.996716 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1222fa2f-d775-485f-9e1d-a704c8f0b331 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:30:58.997457 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1222fa2f-d775-485f-9e1d-a704c8f0b331 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:30:58.997924 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1222fa2f-d775-485f-9e1d-a704c8f0b331 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:30:58.998359 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1222fa2f-d775-485f-9e1d-a704c8f0b331 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:30:59.126268 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-1222fa2f-d775-485f-9e1d-a704c8f0b331 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219a93945a147c4a57bb6452212fe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eeb6be960cc408296ecce6353b72f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:30:59.134228 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-1222fa2f-d775-485f-9e1d-a704c8f0b331 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "GET /compute/v2.1/servers/26380fee-a566-413d-97bf-cebd90ec2aab" status: 200 len: 1690 microversion: 2.1 time: 0.149830 Oct 08 21:30:59.134807 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3049/6024] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:30:58 2022] GET /compute/v2.1/servers/26380fee-a566-413d-97bf-cebd90ec2aab => generated 1690 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:31:00.158581 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-6a209376-fc64-4999-835d-9645f1d449a0 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:31:00.159225 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-6a209376-fc64-4999-835d-9645f1d449a0 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 26380fee-a566-413d-97bf-cebd90ec2aab] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:31:00.166204 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6a209376-fc64-4999-835d-9645f1d449a0 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:31:00.166697 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6a209376-fc64-4999-835d-9645f1d449a0 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:31:00.167144 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6a209376-fc64-4999-835d-9645f1d449a0 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:31:00.167843 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6a209376-fc64-4999-835d-9645f1d449a0 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:31:00.168310 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6a209376-fc64-4999-835d-9645f1d449a0 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:31:00.168743 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6a209376-fc64-4999-835d-9645f1d449a0 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:31:00.302785 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-6a209376-fc64-4999-835d-9645f1d449a0 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219a93945a147c4a57bb6452212fe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eeb6be960cc408296ecce6353b72f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:31:00.310698 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-6a209376-fc64-4999-835d-9645f1d449a0 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "GET /compute/v2.1/servers/26380fee-a566-413d-97bf-cebd90ec2aab" status: 200 len: 1690 microversion: 2.1 time: 0.155998 Oct 08 21:31:00.311410 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2976/6025] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:31:00 2022] GET /compute/v2.1/servers/26380fee-a566-413d-97bf-cebd90ec2aab => generated 1690 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:31:01.333811 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-4e46e665-7938-4420-b13a-4b92944b049e tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:31:01.334470 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-4e46e665-7938-4420-b13a-4b92944b049e tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 26380fee-a566-413d-97bf-cebd90ec2aab] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:31:01.341462 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4e46e665-7938-4420-b13a-4b92944b049e tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:31:01.341954 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4e46e665-7938-4420-b13a-4b92944b049e tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:31:01.342412 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4e46e665-7938-4420-b13a-4b92944b049e tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:31:01.343118 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4e46e665-7938-4420-b13a-4b92944b049e tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:31:01.343591 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4e46e665-7938-4420-b13a-4b92944b049e tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:31:01.344033 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4e46e665-7938-4420-b13a-4b92944b049e tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:31:01.475514 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-4e46e665-7938-4420-b13a-4b92944b049e tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219a93945a147c4a57bb6452212fe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eeb6be960cc408296ecce6353b72f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:31:01.492338 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-4e46e665-7938-4420-b13a-4b92944b049e tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "GET /compute/v2.1/servers/26380fee-a566-413d-97bf-cebd90ec2aab" status: 200 len: 1690 microversion: 2.1 time: 0.162243 Oct 08 21:31:01.492926 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3050/6026] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:31:01 2022] GET /compute/v2.1/servers/26380fee-a566-413d-97bf-cebd90ec2aab => generated 1690 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:31:02.516990 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-0136fca8-1b42-4dad-8240-1497ca1225ed tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:31:02.517637 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-0136fca8-1b42-4dad-8240-1497ca1225ed tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 26380fee-a566-413d-97bf-cebd90ec2aab] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:31:02.523842 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0136fca8-1b42-4dad-8240-1497ca1225ed tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:31:02.524340 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0136fca8-1b42-4dad-8240-1497ca1225ed tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:31:02.524787 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0136fca8-1b42-4dad-8240-1497ca1225ed tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:31:02.525515 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0136fca8-1b42-4dad-8240-1497ca1225ed tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:31:02.525981 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0136fca8-1b42-4dad-8240-1497ca1225ed tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:31:02.526413 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0136fca8-1b42-4dad-8240-1497ca1225ed tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:31:02.662828 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-0136fca8-1b42-4dad-8240-1497ca1225ed tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219a93945a147c4a57bb6452212fe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eeb6be960cc408296ecce6353b72f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:31:02.670585 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-0136fca8-1b42-4dad-8240-1497ca1225ed tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "GET /compute/v2.1/servers/26380fee-a566-413d-97bf-cebd90ec2aab" status: 200 len: 1696 microversion: 2.1 time: 0.158464 Oct 08 21:31:02.671156 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2977/6027] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:31:02 2022] GET /compute/v2.1/servers/26380fee-a566-413d-97bf-cebd90ec2aab => generated 1696 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:31:03.695901 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-d7251116-40e7-4523-8afa-cc03b6e2a4e7 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:31:03.696485 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-d7251116-40e7-4523-8afa-cc03b6e2a4e7 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 26380fee-a566-413d-97bf-cebd90ec2aab] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:31:03.704042 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d7251116-40e7-4523-8afa-cc03b6e2a4e7 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:31:03.704537 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d7251116-40e7-4523-8afa-cc03b6e2a4e7 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:31:03.704981 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d7251116-40e7-4523-8afa-cc03b6e2a4e7 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:31:03.705723 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d7251116-40e7-4523-8afa-cc03b6e2a4e7 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:31:03.706193 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d7251116-40e7-4523-8afa-cc03b6e2a4e7 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:31:03.706635 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d7251116-40e7-4523-8afa-cc03b6e2a4e7 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:31:03.838450 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-d7251116-40e7-4523-8afa-cc03b6e2a4e7 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219a93945a147c4a57bb6452212fe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eeb6be960cc408296ecce6353b72f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:31:03.846949 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-d7251116-40e7-4523-8afa-cc03b6e2a4e7 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "GET /compute/v2.1/servers/26380fee-a566-413d-97bf-cebd90ec2aab" status: 200 len: 1696 microversion: 2.1 time: 0.155048 Oct 08 21:31:03.847532 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3051/6028] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:31:03 2022] GET /compute/v2.1/servers/26380fee-a566-413d-97bf-cebd90ec2aab => generated 1696 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:31:04.870110 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-d2e2a4ac-9fff-465a-9481-3c2eeb32a16f tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:31:04.870733 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-d2e2a4ac-9fff-465a-9481-3c2eeb32a16f tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 26380fee-a566-413d-97bf-cebd90ec2aab] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:31:04.877618 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d2e2a4ac-9fff-465a-9481-3c2eeb32a16f tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:31:04.878115 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d2e2a4ac-9fff-465a-9481-3c2eeb32a16f tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:31:04.878570 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d2e2a4ac-9fff-465a-9481-3c2eeb32a16f tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:31:04.879280 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d2e2a4ac-9fff-465a-9481-3c2eeb32a16f tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:31:04.879746 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d2e2a4ac-9fff-465a-9481-3c2eeb32a16f tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:31:04.880181 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d2e2a4ac-9fff-465a-9481-3c2eeb32a16f tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:31:05.009423 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-d2e2a4ac-9fff-465a-9481-3c2eeb32a16f tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219a93945a147c4a57bb6452212fe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eeb6be960cc408296ecce6353b72f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:31:05.017818 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-d2e2a4ac-9fff-465a-9481-3c2eeb32a16f tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "GET /compute/v2.1/servers/26380fee-a566-413d-97bf-cebd90ec2aab" status: 200 len: 1681 microversion: 2.1 time: 0.151760 Oct 08 21:31:05.018400 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2978/6029] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:31:04 2022] GET /compute/v2.1/servers/26380fee-a566-413d-97bf-cebd90ec2aab => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:31:05.663611 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-6f05a139-b72e-4789-822f-197300813cde req-0e7a6d76-d4a6-4cd5-b01f-a82b6690a97d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26380fee-a566-413d-97bf-cebd90ec2aab", "name": "network-vif-unplugged", "status": "completed", "tag": "e6bc0164-02e4-4b9c-9842-a6841a51af8c"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:31:05.673660 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-6f05a139-b72e-4789-822f-197300813cde req-0e7a6d76-d4a6-4cd5-b01f-a82b6690a97d service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:31:05.674239 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-6f05a139-b72e-4789-822f-197300813cde req-0e7a6d76-d4a6-4cd5-b01f-a82b6690a97d service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:31:05.674749 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-6f05a139-b72e-4789-822f-197300813cde req-0e7a6d76-d4a6-4cd5-b01f-a82b6690a97d service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:31:05.688059 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-6f05a139-b72e-4789-822f-197300813cde req-0e7a6d76-d4a6-4cd5-b01f-a82b6690a97d service nova] Creating event network-vif-unplugged:e6bc0164-02e4-4b9c-9842-a6841a51af8c for instance 26380fee-a566-413d-97bf-cebd90ec2aab on nch1-master-1 Oct 08 21:31:05.694754 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-6f05a139-b72e-4789-822f-197300813cde req-0e7a6d76-d4a6-4cd5-b01f-a82b6690a97d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034662 Oct 08 21:31:05.695390 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3052/6030] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:31:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:31:07.711295 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-2619bccb-99f2-48aa-9474-889461b4d96a req-f6a2607f-fc3d-4be5-ace1-a7aa070b843c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26380fee-a566-413d-97bf-cebd90ec2aab", "name": "network-vif-plugged", "status": "completed", "tag": "e6bc0164-02e4-4b9c-9842-a6841a51af8c"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:31:07.722243 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-2619bccb-99f2-48aa-9474-889461b4d96a req-f6a2607f-fc3d-4be5-ace1-a7aa070b843c service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:31:07.722724 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-2619bccb-99f2-48aa-9474-889461b4d96a req-f6a2607f-fc3d-4be5-ace1-a7aa070b843c service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:31:07.723162 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-2619bccb-99f2-48aa-9474-889461b4d96a req-f6a2607f-fc3d-4be5-ace1-a7aa070b843c service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:31:07.735372 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-2619bccb-99f2-48aa-9474-889461b4d96a req-f6a2607f-fc3d-4be5-ace1-a7aa070b843c service nova] Creating event network-vif-plugged:e6bc0164-02e4-4b9c-9842-a6841a51af8c for instance 26380fee-a566-413d-97bf-cebd90ec2aab on nch1-master-1 Oct 08 21:31:07.740577 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-2619bccb-99f2-48aa-9474-889461b4d96a req-f6a2607f-fc3d-4be5-ace1-a7aa070b843c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033047 Oct 08 21:31:07.741172 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2979/6031] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:31:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:31:31.220995 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-1f4c81b3-d45a-4732-b1cc-fbba807f7564 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:31:31.223333 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-1f4c81b3-d45a-4732-b1cc-fbba807f7564 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 26380fee-a566-413d-97bf-cebd90ec2aab] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:31:31.226380 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=20 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:31:31.227035 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=56 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:31:31.233513 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1f4c81b3-d45a-4732-b1cc-fbba807f7564 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:31:31.234002 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1f4c81b3-d45a-4732-b1cc-fbba807f7564 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:31:31.234447 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1f4c81b3-d45a-4732-b1cc-fbba807f7564 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:31:31.235145 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1f4c81b3-d45a-4732-b1cc-fbba807f7564 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:31:31.235611 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1f4c81b3-d45a-4732-b1cc-fbba807f7564 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:31:31.236041 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1f4c81b3-d45a-4732-b1cc-fbba807f7564 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:31:31.290101 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-1f4c81b3-d45a-4732-b1cc-fbba807f7564 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "POST /compute/v2.1/servers/26380fee-a566-413d-97bf-cebd90ec2aab/action" status: 200 len: 24559 microversion: 2.1 time: 0.073253 Oct 08 21:31:31.290775 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3053/6032] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:31:31 2022] POST /compute/v2.1/servers/26380fee-a566-413d-97bf-cebd90ec2aab/action => generated 24559 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 08 21:31:43.544702 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:SELECT=26 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:31:43.545616 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:31:43.548177 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-87739780-6cd8-45e2-85b8-3dcf899bea79 req-9a63d55d-5095-4b7e-ba39-6bf64cb13869 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26380fee-a566-413d-97bf-cebd90ec2aab", "tag": "e6bc0164-02e4-4b9c-9842-a6841a51af8c"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:31:43.550265 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-f964f0d1-ed74-41a6-b1e8-b4da127c2785 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:31:43.550957 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-f964f0d1-ed74-41a6-b1e8-b4da127c2785 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 26380fee-a566-413d-97bf-cebd90ec2aab] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:31:43.554685 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=2 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:31:43.555367 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=4 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:31:43.560356 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f964f0d1-ed74-41a6-b1e8-b4da127c2785 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:31:43.561128 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f964f0d1-ed74-41a6-b1e8-b4da127c2785 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:31:43.561819 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f964f0d1-ed74-41a6-b1e8-b4da127c2785 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:31:43.562625 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f964f0d1-ed74-41a6-b1e8-b4da127c2785 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:31:43.562880 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-87739780-6cd8-45e2-85b8-3dcf899bea79 req-9a63d55d-5095-4b7e-ba39-6bf64cb13869 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:31:43.563246 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f964f0d1-ed74-41a6-b1e8-b4da127c2785 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:31:43.563366 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-87739780-6cd8-45e2-85b8-3dcf899bea79 req-9a63d55d-5095-4b7e-ba39-6bf64cb13869 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:31:43.563683 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-87739780-6cd8-45e2-85b8-3dcf899bea79 req-9a63d55d-5095-4b7e-ba39-6bf64cb13869 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:31:43.563791 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f964f0d1-ed74-41a6-b1e8-b4da127c2785 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:31:43.576575 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-87739780-6cd8-45e2-85b8-3dcf899bea79 req-9a63d55d-5095-4b7e-ba39-6bf64cb13869 service nova] Creating event network-changed:e6bc0164-02e4-4b9c-9842-a6841a51af8c for instance 26380fee-a566-413d-97bf-cebd90ec2aab on nch1-master-1 Oct 08 21:31:43.582376 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-87739780-6cd8-45e2-85b8-3dcf899bea79 req-9a63d55d-5095-4b7e-ba39-6bf64cb13869 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038933 Oct 08 21:31:43.583311 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3054/6033] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:31:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:31:43.593279 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-f964f0d1-ed74-41a6-b1e8-b4da127c2785 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 26380fee-a566-413d-97bf-cebd90ec2aab] Going to try to terminate instance {{(pid=140491) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 21:31:43.694163 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-f964f0d1-ed74-41a6-b1e8-b4da127c2785 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "DELETE /compute/v2.1/servers/26380fee-a566-413d-97bf-cebd90ec2aab" status: 204 len: 0 microversion: 2.1 time: 0.150989 Oct 08 21:31:43.697970 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2980/6034] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:31:43 2022] DELETE /compute/v2.1/servers/26380fee-a566-413d-97bf-cebd90ec2aab => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 21:31:43.707342 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-76f3bf75-ba72-49c3-aa91-627c07e4e1c9 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:31:43.708122 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-76f3bf75-ba72-49c3-aa91-627c07e4e1c9 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 26380fee-a566-413d-97bf-cebd90ec2aab] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:31:43.715065 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-76f3bf75-ba72-49c3-aa91-627c07e4e1c9 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:31:43.716357 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-76f3bf75-ba72-49c3-aa91-627c07e4e1c9 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:31:43.716918 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-76f3bf75-ba72-49c3-aa91-627c07e4e1c9 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:31:43.717683 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-76f3bf75-ba72-49c3-aa91-627c07e4e1c9 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:31:43.718154 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-76f3bf75-ba72-49c3-aa91-627c07e4e1c9 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:31:43.718591 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-76f3bf75-ba72-49c3-aa91-627c07e4e1c9 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:31:43.866105 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-76f3bf75-ba72-49c3-aa91-627c07e4e1c9 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219a93945a147c4a57bb6452212fe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eeb6be960cc408296ecce6353b72f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:31:43.874281 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-76f3bf75-ba72-49c3-aa91-627c07e4e1c9 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "GET /compute/v2.1/servers/26380fee-a566-413d-97bf-cebd90ec2aab" status: 200 len: 1687 microversion: 2.1 time: 0.171612 Oct 08 21:31:43.889211 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3055/6035] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:31:43 2022] GET /compute/v2.1/servers/26380fee-a566-413d-97bf-cebd90ec2aab => generated 1687 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:31:44.899538 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-dd1a1067-9380-4258-84a6-6cfdff08a518 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:31:44.900265 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-dd1a1067-9380-4258-84a6-6cfdff08a518 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 26380fee-a566-413d-97bf-cebd90ec2aab] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:31:44.907724 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dd1a1067-9380-4258-84a6-6cfdff08a518 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:31:44.908228 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dd1a1067-9380-4258-84a6-6cfdff08a518 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:31:44.908685 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dd1a1067-9380-4258-84a6-6cfdff08a518 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:31:44.909445 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dd1a1067-9380-4258-84a6-6cfdff08a518 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:31:44.909915 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dd1a1067-9380-4258-84a6-6cfdff08a518 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:31:44.910356 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dd1a1067-9380-4258-84a6-6cfdff08a518 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:31:45.059118 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-dd1a1067-9380-4258-84a6-6cfdff08a518 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219a93945a147c4a57bb6452212fe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eeb6be960cc408296ecce6353b72f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:31:45.068268 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-dd1a1067-9380-4258-84a6-6cfdff08a518 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "GET /compute/v2.1/servers/26380fee-a566-413d-97bf-cebd90ec2aab" status: 200 len: 1687 microversion: 2.1 time: 0.173020 Oct 08 21:31:45.069056 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2981/6036] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:31:44 2022] GET /compute/v2.1/servers/26380fee-a566-413d-97bf-cebd90ec2aab => generated 1687 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:31:45.598939 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-5f319000-a565-4b90-a809-3e1d9428cfd6 req-07bcbf20-e07e-41f0-8348-657352043184 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26380fee-a566-413d-97bf-cebd90ec2aab", "name": "network-vif-deleted", "tag": "e6bc0164-02e4-4b9c-9842-a6841a51af8c"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:31:45.610549 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-5f319000-a565-4b90-a809-3e1d9428cfd6 req-07bcbf20-e07e-41f0-8348-657352043184 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:31:45.611153 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-5f319000-a565-4b90-a809-3e1d9428cfd6 req-07bcbf20-e07e-41f0-8348-657352043184 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:31:45.611756 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-5f319000-a565-4b90-a809-3e1d9428cfd6 req-07bcbf20-e07e-41f0-8348-657352043184 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:31:45.625363 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-5f319000-a565-4b90-a809-3e1d9428cfd6 req-07bcbf20-e07e-41f0-8348-657352043184 service nova] Creating event network-vif-deleted:e6bc0164-02e4-4b9c-9842-a6841a51af8c for instance 26380fee-a566-413d-97bf-cebd90ec2aab on nch1-master-1 Oct 08 21:31:45.631597 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-5f319000-a565-4b90-a809-3e1d9428cfd6 req-07bcbf20-e07e-41f0-8348-657352043184 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036412 Oct 08 21:31:45.632198 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3056/6037] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:31:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:31:46.091874 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-1083f6e5-e539-4694-b638-4262c234adaa tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:31:46.092503 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-1083f6e5-e539-4694-b638-4262c234adaa tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 26380fee-a566-413d-97bf-cebd90ec2aab] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:31:46.099502 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1083f6e5-e539-4694-b638-4262c234adaa tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:31:46.100256 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1083f6e5-e539-4694-b638-4262c234adaa tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:31:46.100712 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1083f6e5-e539-4694-b638-4262c234adaa tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:31:46.101454 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1083f6e5-e539-4694-b638-4262c234adaa tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:31:46.101929 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1083f6e5-e539-4694-b638-4262c234adaa tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:31:46.102374 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1083f6e5-e539-4694-b638-4262c234adaa tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:31:46.135915 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1083f6e5-e539-4694-b638-4262c234adaa tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:31:46.136343 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1083f6e5-e539-4694-b638-4262c234adaa tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:31:46.136796 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1083f6e5-e539-4694-b638-4262c234adaa tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:31:46.137334 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.objects.instance [None req-1083f6e5-e539-4694-b638-4262c234adaa tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lazy-loading 'fault' on Instance uuid 26380fee-a566-413d-97bf-cebd90ec2aab {{(pid=140491) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 21:31:46.180444 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-1083f6e5-e539-4694-b638-4262c234adaa tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8219a93945a147c4a57bb6452212fe7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eeb6be960cc408296ecce6353b72f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:31:46.188280 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-1083f6e5-e539-4694-b638-4262c234adaa tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "GET /compute/v2.1/servers/26380fee-a566-413d-97bf-cebd90ec2aab" status: 200 len: 1355 microversion: 2.1 time: 0.100361 Oct 08 21:31:46.188868 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2982/6038] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:31:46 2022] GET /compute/v2.1/servers/26380fee-a566-413d-97bf-cebd90ec2aab => generated 1355 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:31:47.211877 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-f89bb7d8-4af0-4646-a979-e47c814f0b35 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:31:47.212596 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-f89bb7d8-4af0-4646-a979-e47c814f0b35 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] [instance: 26380fee-a566-413d-97bf-cebd90ec2aab] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:31:47.219747 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f89bb7d8-4af0-4646-a979-e47c814f0b35 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:31:47.220244 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f89bb7d8-4af0-4646-a979-e47c814f0b35 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:31:47.221162 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f89bb7d8-4af0-4646-a979-e47c814f0b35 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:31:47.221850 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f89bb7d8-4af0-4646-a979-e47c814f0b35 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:31:47.222317 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f89bb7d8-4af0-4646-a979-e47c814f0b35 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:31:47.222752 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f89bb7d8-4af0-4646-a979-e47c814f0b35 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:31:47.237326 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-f89bb7d8-4af0-4646-a979-e47c814f0b35 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] HTTP exception thrown: Instance 26380fee-a566-413d-97bf-cebd90ec2aab could not be found. Oct 08 21:31:47.238942 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-f89bb7d8-4af0-4646-a979-e47c814f0b35 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Request method failure captured: Oct 08 21:31:47.238942 ncdv-master-1 devstack@n-api.service[140492]: request: GET /compute/v2.1/servers/26380fee-a566-413d-97bf-cebd90ec2aab HTTP/1.1 Oct 08 21:31:47.238942 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:31:47.238942 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:31:47.238942 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:31:47.238942 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 21:31:47.238942 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:31:47.238942 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:31:47.238942 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:31:47.238942 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:31:47.238942 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQep7EvEBtlUVHm2Z-xMUemo1fDuPodMx_QgvV--hhoE4MZz4OfLqVPlQBRPz5RXJ-HR4rz7JLlm8ih4Dn0GIB8br_D1WCF0uLTJeFZ1bD6SPHzzM0aO_EdLw0wg9AzNCfT-tNLgSCtS6oMoxL2RTAOI-_GcrcxStl7sgnRfFgr5x1Qs Oct 08 21:31:47.238942 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:31:47.238942 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:31:47.238942 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:31:47.238942 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:31:47.238942 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:31:47.238942 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:31:47.238942 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 3eeb6be960cc408296ecce6353b72f6d Oct 08 21:31:47.238942 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-651255446 Oct 08 21:31:47.238942 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:31:47.238942 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:31:47.238942 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3eeb6be960cc408296ecce6353b72f6d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3eeb6be960cc408296ecce6353b72f6d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3eeb6be960cc408296ecce6353b72f6d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3eeb6be960cc408296ecce6353b72f6d"}]}] Oct 08 21:31:47.238942 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-TestNetworkAdvancedServerOps-651255446 Oct 08 21:31:47.238942 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 3eeb6be960cc408296ecce6353b72f6d Oct 08 21:31:47.238942 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-651255446 Oct 08 21:31:47.238942 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-TestNetworkAdvancedServerOps-651255446-project Oct 08 21:31:47.238942 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:31:47.238942 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:31:47.238942 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 8219a93945a147c4a57bb6452212fe7c Oct 08 21:31:47.238942 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-TestNetworkAdvancedServerOps-651255446-project Oct 08 21:31:47.238942 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 21:31:47.238942 ncdv-master-1 devstack@n-api.service[140492]: exception: Instance 26380fee-a566-413d-97bf-cebd90ec2aab could not be found. Oct 08 21:31:47.238942 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': '26380fee-a566-413d-97bf-cebd90ec2aab'} Oct 08 21:31:47.238942 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:31:47.238942 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:31:47.238942 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:31:47.238942 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:31:47.238942 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:31:47.238942 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:31:47.238942 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:31:47.238942 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:31:47.238942 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:31:47.238942 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:31:47.238942 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26380fee-a566-413d-97bf-cebd90ec2aab could not be found. Oct 08 21:31:47.238942 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:31:47.238942 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:31:47.238942 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:31:47.238942 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:31:47.238942 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:31:47.238942 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:31:47.238942 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:31:47.238942 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:31:47.238942 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:31:47.238942 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:31:47.238942 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:31:47.238942 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:31:47.238942 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:31:47.238942 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:31:47.238942 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:31:47.238942 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:31:47.238942 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26380fee-a566-413d-97bf-cebd90ec2aab could not be found. Oct 08 21:31:47.238942 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:31:47.238942 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:31:47.243119 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:31:47.243119 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:31:47.243119 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:31:47.243119 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:31:47.243119 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:31:47.243119 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:31:47.243119 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26380fee-a566-413d-97bf-cebd90ec2aab could not be found. Oct 08 21:31:47.243119 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:31:47.243119 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-f89bb7d8-4af0-4646-a979-e47c814f0b35 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Returning 404 to user: Instance 26380fee-a566-413d-97bf-cebd90ec2aab could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:31:47.243119 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-f89bb7d8-4af0-4646-a979-e47c814f0b35 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "GET /compute/v2.1/servers/26380fee-a566-413d-97bf-cebd90ec2aab" status: 404 len: 111 microversion: 2.1 time: 0.032802 Oct 08 21:31:47.243119 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3057/6039] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:31:47 2022] GET /compute/v2.1/servers/26380fee-a566-413d-97bf-cebd90ec2aab => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:31:50.310770 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-e21dea3d-569f-45dc-a6eb-3565a8b4ab87 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] Calling method '.version_select at 0x7f1a876aeca0>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:31:50.332861 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-e21dea3d-569f-45dc-a6eb-3565a8b4ab87 tempest-TestNetworkAdvancedServerOps-651255446 tempest-TestNetworkAdvancedServerOps-651255446-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-925050340" status: 202 len: 0 microversion: 2.1 time: 0.026552 Oct 08 21:31:50.333701 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2983/6040] 10.222.0.26 () {58 vars in 1281 bytes} [Sat Oct 8 21:31:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-925050340 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 21:31:54.168641 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-d1cac51f-485d-444d-8c4a-f41381d06e28 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-1324092056", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "networks": [{"uuid": "3a3245be-d23d-46a0-beb6-8700dc5f1992"}]}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:31:54.221835 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.network.neutron [None req-d1cac51f-485d-444d-8c4a-f41381d06e28 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] validate_networks() for [('3a3245be-d23d-46a0-beb6-8700dc5f1992', None, None, None, None, None)] {{(pid=140492) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 21:31:54.573081 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-d1cac51f-485d-444d-8c4a-f41381d06e28 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Flavor limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 21:31:54.573551 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-d1cac51f-485d-444d-8c4a-f41381d06e28 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Image limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 21:31:54.574062 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-d1cac51f-485d-444d-8c4a-f41381d06e28 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Flavor pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 21:31:54.574479 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-d1cac51f-485d-444d-8c4a-f41381d06e28 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Image pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 21:31:54.574897 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-d1cac51f-485d-444d-8c4a-f41381d06e28 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 21:31:54.583922 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d1cac51f-485d-444d-8c4a-f41381d06e28 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:31:54.584409 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d1cac51f-485d-444d-8c4a-f41381d06e28 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:31:54.584848 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d1cac51f-485d-444d-8c4a-f41381d06e28 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:31:54.585627 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d1cac51f-485d-444d-8c4a-f41381d06e28 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:31:54.586087 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d1cac51f-485d-444d-8c4a-f41381d06e28 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:31:54.586515 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d1cac51f-485d-444d-8c4a-f41381d06e28 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:31:54.603649 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-d1cac51f-485d-444d-8c4a-f41381d06e28 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Getting quotas for project 83ec57e206564c6ea7676aa86bd6e369. Resources: {'cores', 'instances', 'ram'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:31:54.609664 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-d1cac51f-485d-444d-8c4a-f41381d06e28 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Getting quotas for user 4c2c620715814d3ea000ae6c0dd21f0a and project 83ec57e206564c6ea7676aa86bd6e369. Resources: {'cores', 'instances', 'ram'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:31:54.623053 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-d1cac51f-485d-444d-8c4a-f41381d06e28 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Going to run 1 instances... {{(pid=140492) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 21:31:54.625507 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-d1cac51f-485d-444d-8c4a-f41381d06e28 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] [instance: ee832e69-87cb-47bb-b089-04f2b42dcb65] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c508bd7f-7db9-4b2c-af7c-be54a855c355',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140492) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 21:31:54.670568 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-d1cac51f-485d-444d-8c4a-f41381d06e28 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.646498 Oct 08 21:31:54.671223 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3058/6041] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 21:31:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 648 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 08 21:31:54.688256 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-627b983f-3382-40ab-9bad-8d2a46301a55 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:31:54.689565 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-627b983f-3382-40ab-9bad-8d2a46301a55 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] [instance: ee832e69-87cb-47bb-b089-04f2b42dcb65] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:31:54.742187 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-627b983f-3382-40ab-9bad-8d2a46301a55 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2c620715814d3ea000ae6c0dd21f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83ec57e206564c6ea7676aa86bd6e369', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:31:54.750066 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-627b983f-3382-40ab-9bad-8d2a46301a55 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] 10.222.0.26 "GET /compute/v2.1/servers/ee832e69-87cb-47bb-b089-04f2b42dcb65" status: 200 len: 1215 microversion: 2.1 time: 0.067818 Oct 08 21:31:54.750643 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2984/6042] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:31:54 2022] GET /compute/v2.1/servers/ee832e69-87cb-47bb-b089-04f2b42dcb65 => generated 1215 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:31:55.773815 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-188014a1-9c52-4e4e-8caf-05464d155e37 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:31:55.774493 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-188014a1-9c52-4e4e-8caf-05464d155e37 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] [instance: ee832e69-87cb-47bb-b089-04f2b42dcb65] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:31:55.781480 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-188014a1-9c52-4e4e-8caf-05464d155e37 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:31:55.782278 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-188014a1-9c52-4e4e-8caf-05464d155e37 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:31:55.782728 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-188014a1-9c52-4e4e-8caf-05464d155e37 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:31:55.783491 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-188014a1-9c52-4e4e-8caf-05464d155e37 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:31:55.784197 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-188014a1-9c52-4e4e-8caf-05464d155e37 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:31:55.784731 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-188014a1-9c52-4e4e-8caf-05464d155e37 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:31:55.851870 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-188014a1-9c52-4e4e-8caf-05464d155e37 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2c620715814d3ea000ae6c0dd21f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83ec57e206564c6ea7676aa86bd6e369', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:31:55.860205 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-188014a1-9c52-4e4e-8caf-05464d155e37 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] 10.222.0.26 "GET /compute/v2.1/servers/ee832e69-87cb-47bb-b089-04f2b42dcb65" status: 200 len: 1285 microversion: 2.1 time: 0.091345 Oct 08 21:31:55.860981 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3059/6043] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:31:55 2022] GET /compute/v2.1/servers/ee832e69-87cb-47bb-b089-04f2b42dcb65 => generated 1285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:31:56.883968 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-7ff19d63-5628-422b-83df-d27253bfb9a4 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:31:56.884589 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-7ff19d63-5628-422b-83df-d27253bfb9a4 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] [instance: ee832e69-87cb-47bb-b089-04f2b42dcb65] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:31:56.888021 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:31:56.893951 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7ff19d63-5628-422b-83df-d27253bfb9a4 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:31:56.894450 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7ff19d63-5628-422b-83df-d27253bfb9a4 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:31:56.894892 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7ff19d63-5628-422b-83df-d27253bfb9a4 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:31:56.895634 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7ff19d63-5628-422b-83df-d27253bfb9a4 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:31:56.896094 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7ff19d63-5628-422b-83df-d27253bfb9a4 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:31:56.896523 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7ff19d63-5628-422b-83df-d27253bfb9a4 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:31:57.096969 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-7ff19d63-5628-422b-83df-d27253bfb9a4 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2c620715814d3ea000ae6c0dd21f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83ec57e206564c6ea7676aa86bd6e369', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:31:57.105441 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-7ff19d63-5628-422b-83df-d27253bfb9a4 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] 10.222.0.26 "GET /compute/v2.1/servers/ee832e69-87cb-47bb-b089-04f2b42dcb65" status: 200 len: 1315 microversion: 2.1 time: 0.225310 Oct 08 21:31:57.106133 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2985/6044] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:31:56 2022] GET /compute/v2.1/servers/ee832e69-87cb-47bb-b089-04f2b42dcb65 => generated 1315 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:31:57.145400 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-f4ac1652-22ee-4750-bace-961254c403cd req-ef8e9d98-5479-4569-9f02-41c89b1e9915 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee832e69-87cb-47bb-b089-04f2b42dcb65", "tag": "16e78a54-6a97-4958-b60b-3b8a54bda851"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:31:57.157498 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-f4ac1652-22ee-4750-bace-961254c403cd req-ef8e9d98-5479-4569-9f02-41c89b1e9915 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:31:57.157983 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-f4ac1652-22ee-4750-bace-961254c403cd req-ef8e9d98-5479-4569-9f02-41c89b1e9915 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:31:57.158425 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-f4ac1652-22ee-4750-bace-961254c403cd req-ef8e9d98-5479-4569-9f02-41c89b1e9915 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:31:57.173006 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-f4ac1652-22ee-4750-bace-961254c403cd req-ef8e9d98-5479-4569-9f02-41c89b1e9915 service nova] Creating event network-changed:16e78a54-6a97-4958-b60b-3b8a54bda851 for instance ee832e69-87cb-47bb-b089-04f2b42dcb65 on nch1-master-1 Oct 08 21:31:57.177974 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-f4ac1652-22ee-4750-bace-961254c403cd req-ef8e9d98-5479-4569-9f02-41c89b1e9915 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036463 Oct 08 21:31:57.178635 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3060/6045] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:31:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 08 21:31:58.130513 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-8934a680-5dc6-41c5-90a6-e764ab596ab3 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:31:58.131074 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-8934a680-5dc6-41c5-90a6-e764ab596ab3 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] [instance: ee832e69-87cb-47bb-b089-04f2b42dcb65] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:31:58.141548 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8934a680-5dc6-41c5-90a6-e764ab596ab3 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:31:58.142412 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8934a680-5dc6-41c5-90a6-e764ab596ab3 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:31:58.143193 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8934a680-5dc6-41c5-90a6-e764ab596ab3 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:31:58.144454 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8934a680-5dc6-41c5-90a6-e764ab596ab3 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:31:58.145346 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8934a680-5dc6-41c5-90a6-e764ab596ab3 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:31:58.146132 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8934a680-5dc6-41c5-90a6-e764ab596ab3 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:31:58.280480 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-8934a680-5dc6-41c5-90a6-e764ab596ab3 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2c620715814d3ea000ae6c0dd21f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83ec57e206564c6ea7676aa86bd6e369', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:31:58.288258 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-8934a680-5dc6-41c5-90a6-e764ab596ab3 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] 10.222.0.26 "GET /compute/v2.1/servers/ee832e69-87cb-47bb-b089-04f2b42dcb65" status: 200 len: 1315 microversion: 2.1 time: 0.161808 Oct 08 21:31:58.288846 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2986/6046] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:31:58 2022] GET /compute/v2.1/servers/ee832e69-87cb-47bb-b089-04f2b42dcb65 => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:31:59.312285 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-891b95af-3f57-422d-9c26-98df035f44eb tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:31:59.312992 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-891b95af-3f57-422d-9c26-98df035f44eb tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] [instance: ee832e69-87cb-47bb-b089-04f2b42dcb65] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:31:59.319212 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-891b95af-3f57-422d-9c26-98df035f44eb tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:31:59.319701 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-891b95af-3f57-422d-9c26-98df035f44eb tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:31:59.320145 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-891b95af-3f57-422d-9c26-98df035f44eb tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:31:59.320848 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-891b95af-3f57-422d-9c26-98df035f44eb tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:31:59.321332 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-891b95af-3f57-422d-9c26-98df035f44eb tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:31:59.321762 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-891b95af-3f57-422d-9c26-98df035f44eb tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:31:59.456143 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-891b95af-3f57-422d-9c26-98df035f44eb tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2c620715814d3ea000ae6c0dd21f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83ec57e206564c6ea7676aa86bd6e369', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:31:59.464625 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-891b95af-3f57-422d-9c26-98df035f44eb tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] 10.222.0.26 "GET /compute/v2.1/servers/ee832e69-87cb-47bb-b089-04f2b42dcb65" status: 200 len: 1315 microversion: 2.1 time: 0.156956 Oct 08 21:31:59.465229 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3061/6047] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:31:59 2022] GET /compute/v2.1/servers/ee832e69-87cb-47bb-b089-04f2b42dcb65 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:32:00.488440 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-128ccc84-bc29-432e-8f1b-c692ca92bb25 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:32:00.489068 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-128ccc84-bc29-432e-8f1b-c692ca92bb25 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] [instance: ee832e69-87cb-47bb-b089-04f2b42dcb65] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:32:00.496679 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-128ccc84-bc29-432e-8f1b-c692ca92bb25 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:32:00.497176 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-128ccc84-bc29-432e-8f1b-c692ca92bb25 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:32:00.497644 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-128ccc84-bc29-432e-8f1b-c692ca92bb25 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:32:00.498352 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-128ccc84-bc29-432e-8f1b-c692ca92bb25 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:32:00.498819 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-128ccc84-bc29-432e-8f1b-c692ca92bb25 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:32:00.499287 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-128ccc84-bc29-432e-8f1b-c692ca92bb25 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:32:00.627891 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-128ccc84-bc29-432e-8f1b-c692ca92bb25 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2c620715814d3ea000ae6c0dd21f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83ec57e206564c6ea7676aa86bd6e369', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:32:00.635566 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-128ccc84-bc29-432e-8f1b-c692ca92bb25 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] 10.222.0.26 "GET /compute/v2.1/servers/ee832e69-87cb-47bb-b089-04f2b42dcb65" status: 200 len: 1315 microversion: 2.1 time: 0.151083 Oct 08 21:32:00.636141 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2987/6048] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:32:00 2022] GET /compute/v2.1/servers/ee832e69-87cb-47bb-b089-04f2b42dcb65 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:32:01.659169 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-d304dccf-3904-4e19-bb0f-dad49beb8f92 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:32:01.659866 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-d304dccf-3904-4e19-bb0f-dad49beb8f92 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] [instance: ee832e69-87cb-47bb-b089-04f2b42dcb65] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:32:01.668074 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d304dccf-3904-4e19-bb0f-dad49beb8f92 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:32:01.668582 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d304dccf-3904-4e19-bb0f-dad49beb8f92 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:32:01.669029 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d304dccf-3904-4e19-bb0f-dad49beb8f92 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:32:01.669780 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d304dccf-3904-4e19-bb0f-dad49beb8f92 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:32:01.670247 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d304dccf-3904-4e19-bb0f-dad49beb8f92 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:32:01.670683 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d304dccf-3904-4e19-bb0f-dad49beb8f92 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:32:01.900630 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-d304dccf-3904-4e19-bb0f-dad49beb8f92 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2c620715814d3ea000ae6c0dd21f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83ec57e206564c6ea7676aa86bd6e369', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:32:01.908957 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-d304dccf-3904-4e19-bb0f-dad49beb8f92 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] 10.222.0.26 "GET /compute/v2.1/servers/ee832e69-87cb-47bb-b089-04f2b42dcb65" status: 200 len: 1315 microversion: 2.1 time: 0.254151 Oct 08 21:32:01.909573 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3062/6049] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:32:01 2022] GET /compute/v2.1/servers/ee832e69-87cb-47bb-b089-04f2b42dcb65 => generated 1315 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:32:02.933636 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-e3d67449-10ec-4001-82e6-615bb6ecc207 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:32:02.934171 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-e3d67449-10ec-4001-82e6-615bb6ecc207 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] [instance: ee832e69-87cb-47bb-b089-04f2b42dcb65] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:32:02.940651 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e3d67449-10ec-4001-82e6-615bb6ecc207 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:32:02.941170 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e3d67449-10ec-4001-82e6-615bb6ecc207 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:32:02.941643 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e3d67449-10ec-4001-82e6-615bb6ecc207 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:32:02.942353 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e3d67449-10ec-4001-82e6-615bb6ecc207 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:32:02.942819 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e3d67449-10ec-4001-82e6-615bb6ecc207 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:32:02.943257 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e3d67449-10ec-4001-82e6-615bb6ecc207 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:32:03.074402 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-e3d67449-10ec-4001-82e6-615bb6ecc207 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2c620715814d3ea000ae6c0dd21f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83ec57e206564c6ea7676aa86bd6e369', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:32:03.082400 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-e3d67449-10ec-4001-82e6-615bb6ecc207 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] 10.222.0.26 "GET /compute/v2.1/servers/ee832e69-87cb-47bb-b089-04f2b42dcb65" status: 200 len: 1315 microversion: 2.1 time: 0.153555 Oct 08 21:32:03.082985 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2988/6050] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:32:02 2022] GET /compute/v2.1/servers/ee832e69-87cb-47bb-b089-04f2b42dcb65 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:32:03.816162 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-72df8ec1-6e34-4a95-b20b-c763f9493151 req-0293ed98-bf4d-4af2-b136-72306c94e61d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee832e69-87cb-47bb-b089-04f2b42dcb65", "name": "network-vif-plugged", "status": "completed", "tag": "16e78a54-6a97-4958-b60b-3b8a54bda851"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:32:03.830053 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-72df8ec1-6e34-4a95-b20b-c763f9493151 req-0293ed98-bf4d-4af2-b136-72306c94e61d service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:32:03.830770 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-72df8ec1-6e34-4a95-b20b-c763f9493151 req-0293ed98-bf4d-4af2-b136-72306c94e61d service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:32:03.831242 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-72df8ec1-6e34-4a95-b20b-c763f9493151 req-0293ed98-bf4d-4af2-b136-72306c94e61d service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:32:03.842740 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-72df8ec1-6e34-4a95-b20b-c763f9493151 req-0293ed98-bf4d-4af2-b136-72306c94e61d service nova] Creating event network-vif-plugged:16e78a54-6a97-4958-b60b-3b8a54bda851 for instance ee832e69-87cb-47bb-b089-04f2b42dcb65 on nch1-master-1 Oct 08 21:32:03.847679 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-72df8ec1-6e34-4a95-b20b-c763f9493151 req-0293ed98-bf4d-4af2-b136-72306c94e61d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035313 Oct 08 21:32:03.848546 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3063/6051] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:32:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:32:04.105976 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-ee8df696-9351-4b03-a2d9-076565cf9308 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:32:04.106620 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-ee8df696-9351-4b03-a2d9-076565cf9308 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] [instance: ee832e69-87cb-47bb-b089-04f2b42dcb65] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:32:04.113516 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ee8df696-9351-4b03-a2d9-076565cf9308 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:32:04.114010 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ee8df696-9351-4b03-a2d9-076565cf9308 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:32:04.114456 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ee8df696-9351-4b03-a2d9-076565cf9308 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:32:04.115152 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ee8df696-9351-4b03-a2d9-076565cf9308 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:32:04.115615 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ee8df696-9351-4b03-a2d9-076565cf9308 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:32:04.116047 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ee8df696-9351-4b03-a2d9-076565cf9308 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:32:04.249221 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-ee8df696-9351-4b03-a2d9-076565cf9308 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2c620715814d3ea000ae6c0dd21f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83ec57e206564c6ea7676aa86bd6e369', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:32:04.256968 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-ee8df696-9351-4b03-a2d9-076565cf9308 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] 10.222.0.26 "GET /compute/v2.1/servers/ee832e69-87cb-47bb-b089-04f2b42dcb65" status: 200 len: 1315 microversion: 2.1 time: 0.155004 Oct 08 21:32:04.257575 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2989/6052] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:32:04 2022] GET /compute/v2.1/servers/ee832e69-87cb-47bb-b089-04f2b42dcb65 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:32:05.278835 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=2 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:32:05.279753 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=6 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:32:05.285212 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-bebbf9fd-cb1d-4278-adde-7eab344dd0f7 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:32:05.285935 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-bebbf9fd-cb1d-4278-adde-7eab344dd0f7 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] [instance: ee832e69-87cb-47bb-b089-04f2b42dcb65] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:32:05.293620 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bebbf9fd-cb1d-4278-adde-7eab344dd0f7 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:32:05.294120 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bebbf9fd-cb1d-4278-adde-7eab344dd0f7 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:32:05.294569 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bebbf9fd-cb1d-4278-adde-7eab344dd0f7 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:32:05.295281 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bebbf9fd-cb1d-4278-adde-7eab344dd0f7 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:32:05.295748 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bebbf9fd-cb1d-4278-adde-7eab344dd0f7 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:32:05.296184 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bebbf9fd-cb1d-4278-adde-7eab344dd0f7 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:32:05.426166 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-bebbf9fd-cb1d-4278-adde-7eab344dd0f7 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2c620715814d3ea000ae6c0dd21f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83ec57e206564c6ea7676aa86bd6e369', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:32:05.434107 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-bebbf9fd-cb1d-4278-adde-7eab344dd0f7 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] 10.222.0.26 "GET /compute/v2.1/servers/ee832e69-87cb-47bb-b089-04f2b42dcb65" status: 200 len: 1502 microversion: 2.1 time: 0.156262 Oct 08 21:32:05.434689 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3064/6053] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:32:05 2022] GET /compute/v2.1/servers/ee832e69-87cb-47bb-b089-04f2b42dcb65 => generated 1502 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:32:05.456486 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-dc994986-9cd6-42f1-9b32-51574863bf52 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:32:05.457137 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-dc994986-9cd6-42f1-9b32-51574863bf52 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] [instance: ee832e69-87cb-47bb-b089-04f2b42dcb65] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:32:05.459097 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=2 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:32:05.465775 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dc994986-9cd6-42f1-9b32-51574863bf52 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:32:05.466303 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dc994986-9cd6-42f1-9b32-51574863bf52 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:32:05.466753 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dc994986-9cd6-42f1-9b32-51574863bf52 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:32:05.467460 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dc994986-9cd6-42f1-9b32-51574863bf52 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:32:05.467928 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dc994986-9cd6-42f1-9b32-51574863bf52 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:32:05.468365 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dc994986-9cd6-42f1-9b32-51574863bf52 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:32:05.597607 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-dc994986-9cd6-42f1-9b32-51574863bf52 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2c620715814d3ea000ae6c0dd21f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83ec57e206564c6ea7676aa86bd6e369', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:32:05.606348 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-dc994986-9cd6-42f1-9b32-51574863bf52 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] 10.222.0.26 "GET /compute/v2.1/servers/ee832e69-87cb-47bb-b089-04f2b42dcb65" status: 200 len: 1502 microversion: 2.1 time: 0.153862 Oct 08 21:32:05.606925 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2990/6054] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:32:05 2022] GET /compute/v2.1/servers/ee832e69-87cb-47bb-b089-04f2b42dcb65 => generated 1502 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:32:05.628505 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-6ae8f4c1-89c7-4bb4-b15f-d73dedba8d7f tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:32:05.628989 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-6ae8f4c1-89c7-4bb4-b15f-d73dedba8d7f tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] [instance: ee832e69-87cb-47bb-b089-04f2b42dcb65] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:32:05.635019 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6ae8f4c1-89c7-4bb4-b15f-d73dedba8d7f tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:32:05.635517 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6ae8f4c1-89c7-4bb4-b15f-d73dedba8d7f tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:32:05.636497 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6ae8f4c1-89c7-4bb4-b15f-d73dedba8d7f tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:32:05.637226 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6ae8f4c1-89c7-4bb4-b15f-d73dedba8d7f tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:32:05.637701 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6ae8f4c1-89c7-4bb4-b15f-d73dedba8d7f tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:32:05.638142 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6ae8f4c1-89c7-4bb4-b15f-d73dedba8d7f tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:32:05.661168 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.objects.instance [None req-6ae8f4c1-89c7-4bb4-b15f-d73dedba8d7f tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Lazy-loading 'flavor' on Instance uuid ee832e69-87cb-47bb-b089-04f2b42dcb65 {{(pid=140492) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 21:32:05.726730 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-6ae8f4c1-89c7-4bb4-b15f-d73dedba8d7f tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] 10.222.0.26 "POST /compute/v2.1/servers/ee832e69-87cb-47bb-b089-04f2b42dcb65/action" status: 202 len: 0 microversion: 2.1 time: 0.101980 Oct 08 21:32:05.727377 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3065/6055] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:32:05 2022] POST /compute/v2.1/servers/ee832e69-87cb-47bb-b089-04f2b42dcb65/action => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 21:32:05.735516 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-17973456-2246-4c24-88c1-31998b8f8093 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:32:05.736143 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-17973456-2246-4c24-88c1-31998b8f8093 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] [instance: ee832e69-87cb-47bb-b089-04f2b42dcb65] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:32:05.742272 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-17973456-2246-4c24-88c1-31998b8f8093 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:32:05.742814 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-17973456-2246-4c24-88c1-31998b8f8093 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:32:05.743283 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-17973456-2246-4c24-88c1-31998b8f8093 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:32:05.743976 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-17973456-2246-4c24-88c1-31998b8f8093 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:32:05.744491 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-17973456-2246-4c24-88c1-31998b8f8093 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:32:05.745706 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-17973456-2246-4c24-88c1-31998b8f8093 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:32:05.875954 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-17973456-2246-4c24-88c1-31998b8f8093 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2c620715814d3ea000ae6c0dd21f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83ec57e206564c6ea7676aa86bd6e369', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:32:05.883962 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-17973456-2246-4c24-88c1-31998b8f8093 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] 10.222.0.26 "GET /compute/v2.1/servers/ee832e69-87cb-47bb-b089-04f2b42dcb65" status: 200 len: 1510 microversion: 2.1 time: 0.152263 Oct 08 21:32:05.884479 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2991/6056] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:32:05 2022] GET /compute/v2.1/servers/ee832e69-87cb-47bb-b089-04f2b42dcb65 => generated 1510 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:32:06.908876 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-f551917f-3b92-4c44-9a58-6c44a1a7a9ce tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:32:06.909607 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-f551917f-3b92-4c44-9a58-6c44a1a7a9ce tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] [instance: ee832e69-87cb-47bb-b089-04f2b42dcb65] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:32:06.915892 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f551917f-3b92-4c44-9a58-6c44a1a7a9ce tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:32:06.916380 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f551917f-3b92-4c44-9a58-6c44a1a7a9ce tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:32:06.916829 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f551917f-3b92-4c44-9a58-6c44a1a7a9ce tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:32:06.918178 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f551917f-3b92-4c44-9a58-6c44a1a7a9ce tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:32:06.918640 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f551917f-3b92-4c44-9a58-6c44a1a7a9ce tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:32:06.919102 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f551917f-3b92-4c44-9a58-6c44a1a7a9ce tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:32:07.052639 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-f551917f-3b92-4c44-9a58-6c44a1a7a9ce tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2c620715814d3ea000ae6c0dd21f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83ec57e206564c6ea7676aa86bd6e369', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:32:07.060638 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-f551917f-3b92-4c44-9a58-6c44a1a7a9ce tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] 10.222.0.26 "GET /compute/v2.1/servers/ee832e69-87cb-47bb-b089-04f2b42dcb65" status: 200 len: 1493 microversion: 2.1 time: 0.156965 Oct 08 21:32:07.061251 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3066/6057] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:32:06 2022] GET /compute/v2.1/servers/ee832e69-87cb-47bb-b089-04f2b42dcb65 => generated 1493 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:32:07.083162 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-234c5b08-9a01-45e6-8980-3018e01473ab tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:32:07.083709 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-234c5b08-9a01-45e6-8980-3018e01473ab tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] [instance: ee832e69-87cb-47bb-b089-04f2b42dcb65] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:32:07.091580 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-234c5b08-9a01-45e6-8980-3018e01473ab tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:32:07.092078 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-234c5b08-9a01-45e6-8980-3018e01473ab tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:32:07.092522 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-234c5b08-9a01-45e6-8980-3018e01473ab tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:32:07.093251 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-234c5b08-9a01-45e6-8980-3018e01473ab tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:32:07.093841 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-234c5b08-9a01-45e6-8980-3018e01473ab tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:32:07.094217 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-234c5b08-9a01-45e6-8980-3018e01473ab tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:32:07.160584 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-234c5b08-9a01-45e6-8980-3018e01473ab tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] 10.222.0.26 "POST /compute/v2.1/servers/ee832e69-87cb-47bb-b089-04f2b42dcb65/action" status: 202 len: 0 microversion: 2.1 time: 0.081254 Oct 08 21:32:07.161243 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2992/6058] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:32:07 2022] POST /compute/v2.1/servers/ee832e69-87cb-47bb-b089-04f2b42dcb65/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 21:32:07.170274 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-59684497-38b4-4686-9b8a-b79933a22ba9 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:32:07.170908 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-59684497-38b4-4686-9b8a-b79933a22ba9 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] [instance: ee832e69-87cb-47bb-b089-04f2b42dcb65] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:32:07.176923 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-59684497-38b4-4686-9b8a-b79933a22ba9 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:32:07.177568 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-59684497-38b4-4686-9b8a-b79933a22ba9 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:32:07.178289 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-59684497-38b4-4686-9b8a-b79933a22ba9 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:32:07.179293 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-59684497-38b4-4686-9b8a-b79933a22ba9 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:32:07.179977 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-59684497-38b4-4686-9b8a-b79933a22ba9 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:32:07.180478 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-59684497-38b4-4686-9b8a-b79933a22ba9 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:32:07.322534 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-59684497-38b4-4686-9b8a-b79933a22ba9 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2c620715814d3ea000ae6c0dd21f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83ec57e206564c6ea7676aa86bd6e369', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:32:07.331147 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-59684497-38b4-4686-9b8a-b79933a22ba9 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] 10.222.0.26 "GET /compute/v2.1/servers/ee832e69-87cb-47bb-b089-04f2b42dcb65" status: 200 len: 1499 microversion: 2.1 time: 0.165612 Oct 08 21:32:07.331719 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3067/6059] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:32:07 2022] GET /compute/v2.1/servers/ee832e69-87cb-47bb-b089-04f2b42dcb65 => generated 1499 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:32:08.356264 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-2b2f4aee-1351-484a-854b-609379e703aa tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:32:08.356976 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-2b2f4aee-1351-484a-854b-609379e703aa tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] [instance: ee832e69-87cb-47bb-b089-04f2b42dcb65] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:32:08.363634 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2b2f4aee-1351-484a-854b-609379e703aa tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:32:08.364149 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2b2f4aee-1351-484a-854b-609379e703aa tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:32:08.364604 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2b2f4aee-1351-484a-854b-609379e703aa tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:32:08.365363 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2b2f4aee-1351-484a-854b-609379e703aa tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:32:08.365839 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2b2f4aee-1351-484a-854b-609379e703aa tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:32:08.366281 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2b2f4aee-1351-484a-854b-609379e703aa tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:32:08.515871 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-2b2f4aee-1351-484a-854b-609379e703aa tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2c620715814d3ea000ae6c0dd21f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83ec57e206564c6ea7676aa86bd6e369', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:32:08.523792 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-2b2f4aee-1351-484a-854b-609379e703aa tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] 10.222.0.26 "GET /compute/v2.1/servers/ee832e69-87cb-47bb-b089-04f2b42dcb65" status: 200 len: 1499 microversion: 2.1 time: 0.173400 Oct 08 21:32:08.524394 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2993/6060] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:32:08 2022] GET /compute/v2.1/servers/ee832e69-87cb-47bb-b089-04f2b42dcb65 => generated 1499 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:32:09.548096 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-1eb6e79e-8673-42ee-a02b-fd3752a4270a tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:32:09.548630 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-1eb6e79e-8673-42ee-a02b-fd3752a4270a tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] [instance: ee832e69-87cb-47bb-b089-04f2b42dcb65] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:32:09.555579 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1eb6e79e-8673-42ee-a02b-fd3752a4270a tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:32:09.556067 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1eb6e79e-8673-42ee-a02b-fd3752a4270a tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:32:09.556508 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1eb6e79e-8673-42ee-a02b-fd3752a4270a tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:32:09.557224 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1eb6e79e-8673-42ee-a02b-fd3752a4270a tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:32:09.558315 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1eb6e79e-8673-42ee-a02b-fd3752a4270a tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:32:09.558784 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1eb6e79e-8673-42ee-a02b-fd3752a4270a tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:32:09.690211 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-1eb6e79e-8673-42ee-a02b-fd3752a4270a tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2c620715814d3ea000ae6c0dd21f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83ec57e206564c6ea7676aa86bd6e369', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:32:09.697921 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-1eb6e79e-8673-42ee-a02b-fd3752a4270a tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] 10.222.0.26 "GET /compute/v2.1/servers/ee832e69-87cb-47bb-b089-04f2b42dcb65" status: 200 len: 1502 microversion: 2.1 time: 0.153882 Oct 08 21:32:09.698730 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3068/6061] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:32:09 2022] GET /compute/v2.1/servers/ee832e69-87cb-47bb-b089-04f2b42dcb65 => generated 1502 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:32:09.720504 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-75237602-b45c-4806-85ea-275cf6d4d843 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:32:09.721053 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-75237602-b45c-4806-85ea-275cf6d4d843 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] [instance: ee832e69-87cb-47bb-b089-04f2b42dcb65] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:32:09.728370 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-75237602-b45c-4806-85ea-275cf6d4d843 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:32:09.728868 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-75237602-b45c-4806-85ea-275cf6d4d843 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:32:09.729862 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-75237602-b45c-4806-85ea-275cf6d4d843 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:32:09.730565 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-75237602-b45c-4806-85ea-275cf6d4d843 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:32:09.731021 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-75237602-b45c-4806-85ea-275cf6d4d843 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:32:09.731452 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-75237602-b45c-4806-85ea-275cf6d4d843 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:32:09.755154 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.objects.instance [None req-75237602-b45c-4806-85ea-275cf6d4d843 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Lazy-loading 'flavor' on Instance uuid ee832e69-87cb-47bb-b089-04f2b42dcb65 {{(pid=140491) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 21:32:09.820443 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-75237602-b45c-4806-85ea-275cf6d4d843 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] 10.222.0.26 "POST /compute/v2.1/servers/ee832e69-87cb-47bb-b089-04f2b42dcb65/action" status: 202 len: 0 microversion: 2.1 time: 0.103604 Oct 08 21:32:09.821004 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2994/6062] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:32:09 2022] POST /compute/v2.1/servers/ee832e69-87cb-47bb-b089-04f2b42dcb65/action => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 21:32:09.829359 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-4ab2e8b2-746b-45b3-9891-8226a44896b8 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:32:09.830006 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-4ab2e8b2-746b-45b3-9891-8226a44896b8 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] [instance: ee832e69-87cb-47bb-b089-04f2b42dcb65] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:32:09.836228 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4ab2e8b2-746b-45b3-9891-8226a44896b8 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:32:09.836790 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4ab2e8b2-746b-45b3-9891-8226a44896b8 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:32:09.837323 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4ab2e8b2-746b-45b3-9891-8226a44896b8 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:32:09.838182 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4ab2e8b2-746b-45b3-9891-8226a44896b8 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:32:09.839127 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4ab2e8b2-746b-45b3-9891-8226a44896b8 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:32:09.839616 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4ab2e8b2-746b-45b3-9891-8226a44896b8 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:32:09.968373 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-4ab2e8b2-746b-45b3-9891-8226a44896b8 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2c620715814d3ea000ae6c0dd21f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83ec57e206564c6ea7676aa86bd6e369', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:32:09.976351 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-4ab2e8b2-746b-45b3-9891-8226a44896b8 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] 10.222.0.26 "GET /compute/v2.1/servers/ee832e69-87cb-47bb-b089-04f2b42dcb65" status: 200 len: 1510 microversion: 2.1 time: 0.150959 Oct 08 21:32:09.976920 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3069/6063] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:32:09 2022] GET /compute/v2.1/servers/ee832e69-87cb-47bb-b089-04f2b42dcb65 => generated 1510 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:32:11.002249 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-df9eadf3-1486-45c1-81ac-53d184b56bbe tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:32:11.002991 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-df9eadf3-1486-45c1-81ac-53d184b56bbe tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] [instance: ee832e69-87cb-47bb-b089-04f2b42dcb65] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:32:11.009348 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-df9eadf3-1486-45c1-81ac-53d184b56bbe tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:32:11.009841 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-df9eadf3-1486-45c1-81ac-53d184b56bbe tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:32:11.010290 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-df9eadf3-1486-45c1-81ac-53d184b56bbe tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:32:11.011029 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-df9eadf3-1486-45c1-81ac-53d184b56bbe tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:32:11.011498 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-df9eadf3-1486-45c1-81ac-53d184b56bbe tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:32:11.011930 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-df9eadf3-1486-45c1-81ac-53d184b56bbe tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:32:11.142070 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-df9eadf3-1486-45c1-81ac-53d184b56bbe tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2c620715814d3ea000ae6c0dd21f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83ec57e206564c6ea7676aa86bd6e369', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:32:11.149921 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-df9eadf3-1486-45c1-81ac-53d184b56bbe tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] 10.222.0.26 "GET /compute/v2.1/servers/ee832e69-87cb-47bb-b089-04f2b42dcb65" status: 200 len: 1493 microversion: 2.1 time: 0.152838 Oct 08 21:32:11.150491 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2995/6064] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:32:10 2022] GET /compute/v2.1/servers/ee832e69-87cb-47bb-b089-04f2b42dcb65 => generated 1493 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:32:11.172984 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-c748b61c-9ea0-45f1-a398-d8fa4729d19f tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:32:11.173559 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-c748b61c-9ea0-45f1-a398-d8fa4729d19f tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] [instance: ee832e69-87cb-47bb-b089-04f2b42dcb65] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:32:11.180455 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c748b61c-9ea0-45f1-a398-d8fa4729d19f tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:32:11.180954 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c748b61c-9ea0-45f1-a398-d8fa4729d19f tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:32:11.181459 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c748b61c-9ea0-45f1-a398-d8fa4729d19f tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:32:11.182163 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c748b61c-9ea0-45f1-a398-d8fa4729d19f tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:32:11.183190 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c748b61c-9ea0-45f1-a398-d8fa4729d19f tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:32:11.183624 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c748b61c-9ea0-45f1-a398-d8fa4729d19f tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:32:11.248942 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-c748b61c-9ea0-45f1-a398-d8fa4729d19f tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] 10.222.0.26 "POST /compute/v2.1/servers/ee832e69-87cb-47bb-b089-04f2b42dcb65/action" status: 202 len: 0 microversion: 2.1 time: 0.079613 Oct 08 21:32:11.249631 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3070/6065] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:32:11 2022] POST /compute/v2.1/servers/ee832e69-87cb-47bb-b089-04f2b42dcb65/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 21:32:11.257872 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-66a32822-6388-4077-b448-c2384259402a tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:32:11.258502 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-66a32822-6388-4077-b448-c2384259402a tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] [instance: ee832e69-87cb-47bb-b089-04f2b42dcb65] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:32:11.264758 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-66a32822-6388-4077-b448-c2384259402a tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:32:11.265395 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-66a32822-6388-4077-b448-c2384259402a tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:32:11.265847 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-66a32822-6388-4077-b448-c2384259402a tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:32:11.266568 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-66a32822-6388-4077-b448-c2384259402a tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:32:11.267143 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-66a32822-6388-4077-b448-c2384259402a tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:32:11.267467 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-66a32822-6388-4077-b448-c2384259402a tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:32:11.461654 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-66a32822-6388-4077-b448-c2384259402a tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2c620715814d3ea000ae6c0dd21f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83ec57e206564c6ea7676aa86bd6e369', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:32:11.470216 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-66a32822-6388-4077-b448-c2384259402a tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] 10.222.0.26 "GET /compute/v2.1/servers/ee832e69-87cb-47bb-b089-04f2b42dcb65" status: 200 len: 1499 microversion: 2.1 time: 0.216321 Oct 08 21:32:11.470802 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2996/6066] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:32:11 2022] GET /compute/v2.1/servers/ee832e69-87cb-47bb-b089-04f2b42dcb65 => generated 1499 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:32:12.495865 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-567ff0f1-ae4e-4520-a465-741f5c1b3060 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:32:12.496686 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-567ff0f1-ae4e-4520-a465-741f5c1b3060 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] [instance: ee832e69-87cb-47bb-b089-04f2b42dcb65] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:32:12.503196 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-567ff0f1-ae4e-4520-a465-741f5c1b3060 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:32:12.503702 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-567ff0f1-ae4e-4520-a465-741f5c1b3060 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:32:12.504159 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-567ff0f1-ae4e-4520-a465-741f5c1b3060 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:32:12.504870 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-567ff0f1-ae4e-4520-a465-741f5c1b3060 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:32:12.505383 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-567ff0f1-ae4e-4520-a465-741f5c1b3060 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:32:12.505828 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-567ff0f1-ae4e-4520-a465-741f5c1b3060 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:32:12.640004 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-567ff0f1-ae4e-4520-a465-741f5c1b3060 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2c620715814d3ea000ae6c0dd21f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83ec57e206564c6ea7676aa86bd6e369', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:32:12.643749 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:32:12.648969 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-567ff0f1-ae4e-4520-a465-741f5c1b3060 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] 10.222.0.26 "GET /compute/v2.1/servers/ee832e69-87cb-47bb-b089-04f2b42dcb65" status: 200 len: 1502 microversion: 2.1 time: 0.158533 Oct 08 21:32:12.649565 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3071/6067] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:32:12 2022] GET /compute/v2.1/servers/ee832e69-87cb-47bb-b089-04f2b42dcb65 => generated 1502 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:32:12.671444 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-f348402d-c274-432e-9ca9-9ae5d74684c8 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:32:12.671956 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-f348402d-c274-432e-9ca9-9ae5d74684c8 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] [instance: ee832e69-87cb-47bb-b089-04f2b42dcb65] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:32:12.678959 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f348402d-c274-432e-9ca9-9ae5d74684c8 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:32:12.679458 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f348402d-c274-432e-9ca9-9ae5d74684c8 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:32:12.679906 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f348402d-c274-432e-9ca9-9ae5d74684c8 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:32:12.680653 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f348402d-c274-432e-9ca9-9ae5d74684c8 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:32:12.681118 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f348402d-c274-432e-9ca9-9ae5d74684c8 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:32:12.681580 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f348402d-c274-432e-9ca9-9ae5d74684c8 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:32:12.710187 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-f348402d-c274-432e-9ca9-9ae5d74684c8 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] [instance: ee832e69-87cb-47bb-b089-04f2b42dcb65] Going to try to terminate instance {{(pid=140491) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 21:32:12.744594 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:32:12.787934 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-f348402d-c274-432e-9ca9-9ae5d74684c8 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] 10.222.0.26 "DELETE /compute/v2.1/servers/ee832e69-87cb-47bb-b089-04f2b42dcb65" status: 204 len: 0 microversion: 2.1 time: 0.120076 Oct 08 21:32:12.788839 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2997/6068] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:32:12 2022] DELETE /compute/v2.1/servers/ee832e69-87cb-47bb-b089-04f2b42dcb65 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 21:32:12.797216 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-632c8e87-d699-421f-94df-4a0bb1587757 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:32:12.797833 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-632c8e87-d699-421f-94df-4a0bb1587757 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] [instance: ee832e69-87cb-47bb-b089-04f2b42dcb65] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:32:12.804951 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-632c8e87-d699-421f-94df-4a0bb1587757 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:32:12.805472 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-632c8e87-d699-421f-94df-4a0bb1587757 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:32:12.805923 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-632c8e87-d699-421f-94df-4a0bb1587757 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:32:12.806629 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-632c8e87-d699-421f-94df-4a0bb1587757 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:32:12.807608 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-632c8e87-d699-421f-94df-4a0bb1587757 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:32:12.808048 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-632c8e87-d699-421f-94df-4a0bb1587757 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:32:12.939783 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-632c8e87-d699-421f-94df-4a0bb1587757 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2c620715814d3ea000ae6c0dd21f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83ec57e206564c6ea7676aa86bd6e369', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:32:12.947589 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-632c8e87-d699-421f-94df-4a0bb1587757 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] 10.222.0.26 "GET /compute/v2.1/servers/ee832e69-87cb-47bb-b089-04f2b42dcb65" status: 200 len: 1508 microversion: 2.1 time: 0.154363 Oct 08 21:32:12.948755 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3072/6069] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:32:12 2022] GET /compute/v2.1/servers/ee832e69-87cb-47bb-b089-04f2b42dcb65 => generated 1508 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:32:13.971754 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-88e2fd54-7231-44dd-ad7e-5edb1b330f8e tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:32:13.972730 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-88e2fd54-7231-44dd-ad7e-5edb1b330f8e tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] [instance: ee832e69-87cb-47bb-b089-04f2b42dcb65] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:32:13.975540 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:32:13.980930 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-88e2fd54-7231-44dd-ad7e-5edb1b330f8e tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:32:13.981462 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-88e2fd54-7231-44dd-ad7e-5edb1b330f8e tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:32:13.981919 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-88e2fd54-7231-44dd-ad7e-5edb1b330f8e tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:32:13.982663 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-88e2fd54-7231-44dd-ad7e-5edb1b330f8e tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:32:13.983134 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-88e2fd54-7231-44dd-ad7e-5edb1b330f8e tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:32:13.983576 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-88e2fd54-7231-44dd-ad7e-5edb1b330f8e tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:32:14.117804 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-88e2fd54-7231-44dd-ad7e-5edb1b330f8e tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2c620715814d3ea000ae6c0dd21f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83ec57e206564c6ea7676aa86bd6e369', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:32:14.125996 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-88e2fd54-7231-44dd-ad7e-5edb1b330f8e tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] 10.222.0.26 "GET /compute/v2.1/servers/ee832e69-87cb-47bb-b089-04f2b42dcb65" status: 200 len: 1508 microversion: 2.1 time: 0.158519 Oct 08 21:32:14.126583 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2998/6070] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:32:13 2022] GET /compute/v2.1/servers/ee832e69-87cb-47bb-b089-04f2b42dcb65 => generated 1508 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:32:15.138639 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-4da05bcf-1b28-48e9-9589-e104ae4d00b3 req-1efb2ffc-6502-4a2d-8d63-423dd540c52c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee832e69-87cb-47bb-b089-04f2b42dcb65", "name": "network-vif-deleted", "tag": "16e78a54-6a97-4958-b60b-3b8a54bda851"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:32:15.145654 ncdv-master-1 devstack@n-api.service[140492]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 08 21:32:15.145820 ncdv-master-1 devstack@n-api.service[140492]: Sat Oct 8 21:32:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.26) !!! Oct 08 21:32:15.147924 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=3 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:32:15.149759 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-cfcf9a16-5a33-4155-9a07-1cc00fab4e68 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:32:15.151246 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-cfcf9a16-5a33-4155-9a07-1cc00fab4e68 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] [instance: ee832e69-87cb-47bb-b089-04f2b42dcb65] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:32:15.159441 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cfcf9a16-5a33-4155-9a07-1cc00fab4e68 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:32:15.159943 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cfcf9a16-5a33-4155-9a07-1cc00fab4e68 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:32:15.160927 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cfcf9a16-5a33-4155-9a07-1cc00fab4e68 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:32:15.161119 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cfcf9a16-5a33-4155-9a07-1cc00fab4e68 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:32:15.161678 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cfcf9a16-5a33-4155-9a07-1cc00fab4e68 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:32:15.162074 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cfcf9a16-5a33-4155-9a07-1cc00fab4e68 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:32:15.163105 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-4da05bcf-1b28-48e9-9589-e104ae4d00b3 req-1efb2ffc-6502-4a2d-8d63-423dd540c52c service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:32:15.163649 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-4da05bcf-1b28-48e9-9589-e104ae4d00b3 req-1efb2ffc-6502-4a2d-8d63-423dd540c52c service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:32:15.164158 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-4da05bcf-1b28-48e9-9589-e104ae4d00b3 req-1efb2ffc-6502-4a2d-8d63-423dd540c52c service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:32:15.176819 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-4da05bcf-1b28-48e9-9589-e104ae4d00b3 req-1efb2ffc-6502-4a2d-8d63-423dd540c52c service nova] Creating event network-vif-deleted:16e78a54-6a97-4958-b60b-3b8a54bda851 for instance ee832e69-87cb-47bb-b089-04f2b42dcb65 on nch1-master-1 Oct 08 21:32:15.182356 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-4da05bcf-1b28-48e9-9589-e104ae4d00b3 req-1efb2ffc-6502-4a2d-8d63-423dd540c52c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047580 Oct 08 21:32:15.182961 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3073/6071] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:32:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:32:15.232558 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-cfcf9a16-5a33-4155-9a07-1cc00fab4e68 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2c620715814d3ea000ae6c0dd21f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83ec57e206564c6ea7676aa86bd6e369', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:32:15.240549 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-cfcf9a16-5a33-4155-9a07-1cc00fab4e68 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] 10.222.0.26 "GET /compute/v2.1/servers/ee832e69-87cb-47bb-b089-04f2b42dcb65" status: 200 len: 1300 microversion: 2.1 time: 0.094697 Oct 08 21:32:15.241209 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 2999/6072] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:32:15 2022] GET /compute/v2.1/servers/ee832e69-87cb-47bb-b089-04f2b42dcb65 => generated 1300 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:32:16.264040 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-fe1a4309-0a3a-4eec-9b34-a8ee0350b313 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:32:16.264747 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-fe1a4309-0a3a-4eec-9b34-a8ee0350b313 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] [instance: ee832e69-87cb-47bb-b089-04f2b42dcb65] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:32:16.272186 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fe1a4309-0a3a-4eec-9b34-a8ee0350b313 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:32:16.272673 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fe1a4309-0a3a-4eec-9b34-a8ee0350b313 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:32:16.273113 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fe1a4309-0a3a-4eec-9b34-a8ee0350b313 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:32:16.273844 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fe1a4309-0a3a-4eec-9b34-a8ee0350b313 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:32:16.274306 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fe1a4309-0a3a-4eec-9b34-a8ee0350b313 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:32:16.274735 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fe1a4309-0a3a-4eec-9b34-a8ee0350b313 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:32:16.288064 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-fe1a4309-0a3a-4eec-9b34-a8ee0350b313 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] HTTP exception thrown: Instance ee832e69-87cb-47bb-b089-04f2b42dcb65 could not be found. Oct 08 21:32:16.289689 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-fe1a4309-0a3a-4eec-9b34-a8ee0350b313 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Request method failure captured: Oct 08 21:32:16.289689 ncdv-master-1 devstack@n-api.service[140492]: request: GET /compute/v2.1/servers/ee832e69-87cb-47bb-b089-04f2b42dcb65 HTTP/1.1 Oct 08 21:32:16.289689 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:32:16.289689 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:32:16.289689 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:32:16.289689 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 21:32:16.289689 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:32:16.289689 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:32:16.289689 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:32:16.289689 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:32:16.289689 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQexIo1f93uIsNMOTkzX8a9A7z-BcR9YvCjfX89LVwX8PBVvovWdw8z2PEPvz0mtBEnUO1ZX_S1izgRo8uw6yVMN6mMSE1Amxe1RLkdA0y1-_Kmlk3vtg_yv4Oz6A0htH5haf3vvt6n9LUNR-8mEulO_8lxR9aMBpZN5KwL0ijplS9Rs Oct 08 21:32:16.289689 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:32:16.289689 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:32:16.289689 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:32:16.289689 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:32:16.289689 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:32:16.289689 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:32:16.289689 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 83ec57e206564c6ea7676aa86bd6e369 Oct 08 21:32:16.289689 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-TestServerAdvancedOps-1914612798 Oct 08 21:32:16.289689 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:32:16.289689 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:32:16.289689 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/83ec57e206564c6ea7676aa86bd6e369"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/83ec57e206564c6ea7676aa86bd6e369"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_83ec57e206564c6ea7676aa86bd6e369"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/83ec57e206564c6ea7676aa86bd6e369"}]}] Oct 08 21:32:16.289689 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-TestServerAdvancedOps-1914612798 Oct 08 21:32:16.289689 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 83ec57e206564c6ea7676aa86bd6e369 Oct 08 21:32:16.289689 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-TestServerAdvancedOps-1914612798 Oct 08 21:32:16.289689 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-TestServerAdvancedOps-1914612798-project Oct 08 21:32:16.289689 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:32:16.289689 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:32:16.289689 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 4c2c620715814d3ea000ae6c0dd21f0a Oct 08 21:32:16.289689 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-TestServerAdvancedOps-1914612798-project Oct 08 21:32:16.289689 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 21:32:16.289689 ncdv-master-1 devstack@n-api.service[140492]: exception: Instance ee832e69-87cb-47bb-b089-04f2b42dcb65 could not be found. Oct 08 21:32:16.289689 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': 'ee832e69-87cb-47bb-b089-04f2b42dcb65'} Oct 08 21:32:16.289689 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:32:16.289689 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:32:16.289689 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:32:16.289689 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:32:16.289689 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:32:16.289689 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:32:16.289689 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:32:16.289689 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:32:16.289689 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:32:16.289689 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:32:16.289689 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee832e69-87cb-47bb-b089-04f2b42dcb65 could not be found. Oct 08 21:32:16.289689 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:32:16.289689 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:32:16.289689 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:32:16.289689 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:32:16.289689 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:32:16.289689 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:32:16.289689 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:32:16.289689 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:32:16.289689 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:32:16.289689 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:32:16.289689 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:32:16.289689 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:32:16.289689 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:32:16.289689 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:32:16.289689 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:32:16.289689 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:32:16.289689 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee832e69-87cb-47bb-b089-04f2b42dcb65 could not be found. Oct 08 21:32:16.289689 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:32:16.289689 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:32:16.289689 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:32:16.294477 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:32:16.294477 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:32:16.294477 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:32:16.294477 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:32:16.294477 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:32:16.294477 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee832e69-87cb-47bb-b089-04f2b42dcb65 could not be found. Oct 08 21:32:16.294477 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:32:16.294477 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-fe1a4309-0a3a-4eec-9b34-a8ee0350b313 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] Returning 404 to user: Instance ee832e69-87cb-47bb-b089-04f2b42dcb65 could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:32:16.294477 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-fe1a4309-0a3a-4eec-9b34-a8ee0350b313 tempest-TestServerAdvancedOps-1914612798 tempest-TestServerAdvancedOps-1914612798-project] 10.222.0.26 "GET /compute/v2.1/servers/ee832e69-87cb-47bb-b089-04f2b42dcb65" status: 404 len: 111 microversion: 2.1 time: 0.031332 Oct 08 21:32:16.294477 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3074/6073] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:32:16 2022] GET /compute/v2.1/servers/ee832e69-87cb-47bb-b089-04f2b42dcb65 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:32:32.220476 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-f1a7d09c-7d50-45c5-a25e-8d1a5de702bf tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:32:32.220476 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-f1a7d09c-7d50-45c5-a25e-8d1a5de702bf tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] [instance: 931e11c7-9245-4481-b1eb-588fd86e30a6] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:32:32.220476 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:SELECT=3 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:32:32.220476 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=15,nova_cell1:INSERT=1 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:32:32.240438 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f1a7d09c-7d50-45c5-a25e-8d1a5de702bf tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:32:32.242092 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f1a7d09c-7d50-45c5-a25e-8d1a5de702bf tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:32:32.243107 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f1a7d09c-7d50-45c5-a25e-8d1a5de702bf tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:32:32.244132 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f1a7d09c-7d50-45c5-a25e-8d1a5de702bf tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:32:32.244872 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f1a7d09c-7d50-45c5-a25e-8d1a5de702bf tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:32:32.245676 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f1a7d09c-7d50-45c5-a25e-8d1a5de702bf tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:32:32.286420 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-f1a7d09c-7d50-45c5-a25e-8d1a5de702bf tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] [instance: 931e11c7-9245-4481-b1eb-588fd86e30a6] Going to try to terminate instance {{(pid=140491) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 21:32:32.418261 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-f1a7d09c-7d50-45c5-a25e-8d1a5de702bf tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] 10.222.0.26 "DELETE /compute/v2.1/servers/931e11c7-9245-4481-b1eb-588fd86e30a6" status: 204 len: 0 microversion: 2.1 time: 0.203422 Oct 08 21:32:32.419898 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3000/6074] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:32:32 2022] DELETE /compute/v2.1/servers/931e11c7-9245-4481-b1eb-588fd86e30a6 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 21:32:32.430939 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-18f985aa-74cb-46bc-a45c-63427c67857e tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:32:32.434686 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-18f985aa-74cb-46bc-a45c-63427c67857e tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] [instance: 931e11c7-9245-4481-b1eb-588fd86e30a6] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:32:32.441573 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=3 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:32:32.447887 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=10 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:32:32.460036 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-18f985aa-74cb-46bc-a45c-63427c67857e tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:32:32.465413 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-18f985aa-74cb-46bc-a45c-63427c67857e tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:32:32.466253 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-18f985aa-74cb-46bc-a45c-63427c67857e tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:32:32.467035 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-18f985aa-74cb-46bc-a45c-63427c67857e tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:32:32.472064 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-18f985aa-74cb-46bc-a45c-63427c67857e tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:32:32.472989 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-18f985aa-74cb-46bc-a45c-63427c67857e tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:32:32.962633 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-18f985aa-74cb-46bc-a45c-63427c67857e tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6100a1568dd042e58ce63e4b30a87429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a6a8bf389b4191816195072295a080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:32:32.976928 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-18f985aa-74cb-46bc-a45c-63427c67857e tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] 10.222.0.26 "GET /compute/v2.1/servers/931e11c7-9245-4481-b1eb-588fd86e30a6" status: 200 len: 1730 microversion: 2.1 time: 0.552379 Oct 08 21:32:32.981282 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3075/6075] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:32:32 2022] GET /compute/v2.1/servers/931e11c7-9245-4481-b1eb-588fd86e30a6 => generated 1730 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:32:34.005150 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-691a7f97-3845-4fb7-a341-88c35bf8a405 tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:32:34.009313 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-691a7f97-3845-4fb7-a341-88c35bf8a405 tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] [instance: 931e11c7-9245-4481-b1eb-588fd86e30a6] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:32:34.018008 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-691a7f97-3845-4fb7-a341-88c35bf8a405 tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:32:34.018961 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-691a7f97-3845-4fb7-a341-88c35bf8a405 tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:32:34.019805 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-691a7f97-3845-4fb7-a341-88c35bf8a405 tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:32:34.021007 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-691a7f97-3845-4fb7-a341-88c35bf8a405 tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:32:34.022073 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-691a7f97-3845-4fb7-a341-88c35bf8a405 tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:32:34.022853 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-691a7f97-3845-4fb7-a341-88c35bf8a405 tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:32:34.341812 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-691a7f97-3845-4fb7-a341-88c35bf8a405 tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6100a1568dd042e58ce63e4b30a87429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a6a8bf389b4191816195072295a080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:32:34.355038 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-691a7f97-3845-4fb7-a341-88c35bf8a405 tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] 10.222.0.26 "GET /compute/v2.1/servers/931e11c7-9245-4481-b1eb-588fd86e30a6" status: 200 len: 1730 microversion: 2.1 time: 0.356326 Oct 08 21:32:34.356399 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3001/6076] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:32:33 2022] GET /compute/v2.1/servers/931e11c7-9245-4481-b1eb-588fd86e30a6 => generated 1730 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:32:34.955644 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-9993e98b-8cbe-4178-a491-ecd537e55780 req-feb31fc7-fb4b-4493-9d06-a81505e2116e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "931e11c7-9245-4481-b1eb-588fd86e30a6", "name": "network-vif-deleted", "tag": "29382ecd-3ca3-4bac-98c7-eec27d44e5b8"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:32:34.966190 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-9993e98b-8cbe-4178-a491-ecd537e55780 req-feb31fc7-fb4b-4493-9d06-a81505e2116e service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:32:34.966931 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-9993e98b-8cbe-4178-a491-ecd537e55780 req-feb31fc7-fb4b-4493-9d06-a81505e2116e service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:32:34.967367 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-9993e98b-8cbe-4178-a491-ecd537e55780 req-feb31fc7-fb4b-4493-9d06-a81505e2116e service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:32:34.980235 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-9993e98b-8cbe-4178-a491-ecd537e55780 req-feb31fc7-fb4b-4493-9d06-a81505e2116e service nova] Creating event network-vif-deleted:29382ecd-3ca3-4bac-98c7-eec27d44e5b8 for instance 931e11c7-9245-4481-b1eb-588fd86e30a6 on nch2-master-1 Oct 08 21:32:34.985618 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-9993e98b-8cbe-4178-a491-ecd537e55780 req-feb31fc7-fb4b-4493-9d06-a81505e2116e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034829 Oct 08 21:32:34.986274 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3076/6077] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:32:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:32:35.380024 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-400d2314-6d93-437c-8379-ba927d0cb33b tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:32:35.380652 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-400d2314-6d93-437c-8379-ba927d0cb33b tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] [instance: 931e11c7-9245-4481-b1eb-588fd86e30a6] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:32:35.395045 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-400d2314-6d93-437c-8379-ba927d0cb33b tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:32:35.395764 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-400d2314-6d93-437c-8379-ba927d0cb33b tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:32:35.396209 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-400d2314-6d93-437c-8379-ba927d0cb33b tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:32:35.397229 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-400d2314-6d93-437c-8379-ba927d0cb33b tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:32:35.397856 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-400d2314-6d93-437c-8379-ba927d0cb33b tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:32:35.398468 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-400d2314-6d93-437c-8379-ba927d0cb33b tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:32:35.438915 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-400d2314-6d93-437c-8379-ba927d0cb33b tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:32:35.439417 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-400d2314-6d93-437c-8379-ba927d0cb33b tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:32:35.439903 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-400d2314-6d93-437c-8379-ba927d0cb33b tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:32:35.440368 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.objects.instance [None req-400d2314-6d93-437c-8379-ba927d0cb33b tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Lazy-loading 'fault' on Instance uuid 931e11c7-9245-4481-b1eb-588fd86e30a6 {{(pid=140491) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 21:32:35.489163 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-400d2314-6d93-437c-8379-ba927d0cb33b tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6100a1568dd042e58ce63e4b30a87429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a6a8bf389b4191816195072295a080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:32:35.498692 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-400d2314-6d93-437c-8379-ba927d0cb33b tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] 10.222.0.26 "GET /compute/v2.1/servers/931e11c7-9245-4481-b1eb-588fd86e30a6" status: 200 len: 1388 microversion: 2.1 time: 0.122540 Oct 08 21:32:35.500888 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3002/6078] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:32:35 2022] GET /compute/v2.1/servers/931e11c7-9245-4481-b1eb-588fd86e30a6 => generated 1388 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:32:36.633166 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-bf57114d-954a-4438-b4a6-63a8ea2ec705 tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:32:36.634425 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-bf57114d-954a-4438-b4a6-63a8ea2ec705 tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] [instance: 931e11c7-9245-4481-b1eb-588fd86e30a6] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:32:36.641538 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bf57114d-954a-4438-b4a6-63a8ea2ec705 tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:32:36.642195 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bf57114d-954a-4438-b4a6-63a8ea2ec705 tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:32:36.642738 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bf57114d-954a-4438-b4a6-63a8ea2ec705 tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:32:36.643584 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bf57114d-954a-4438-b4a6-63a8ea2ec705 tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:32:36.644055 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bf57114d-954a-4438-b4a6-63a8ea2ec705 tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:32:36.644714 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bf57114d-954a-4438-b4a6-63a8ea2ec705 tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:32:36.661850 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-bf57114d-954a-4438-b4a6-63a8ea2ec705 tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] HTTP exception thrown: Instance 931e11c7-9245-4481-b1eb-588fd86e30a6 could not be found. Oct 08 21:32:36.663532 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-bf57114d-954a-4438-b4a6-63a8ea2ec705 tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Request method failure captured: Oct 08 21:32:36.663532 ncdv-master-1 devstack@n-api.service[140492]: request: GET /compute/v2.1/servers/931e11c7-9245-4481-b1eb-588fd86e30a6 HTTP/1.1 Oct 08 21:32:36.663532 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:32:36.663532 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:32:36.663532 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:32:36.663532 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 21:32:36.663532 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:32:36.663532 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:32:36.663532 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:32:36.663532 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:32:36.663532 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQetDmKzec_40-1E_ROnu2MXqpLqQTsECI3reZN-nlGMq2RR1VzQf1k_bZfTKzaHTuGknsPiQI2dFmyD3wQUJxmQfK9KKT-EKJcBTUc2FlZWVlXoiMpByXZibS8WL54HMxrtWiidwokGYMzuYBzyezjSK5BWx0wf3C9cW4LGK8BlsBTg Oct 08 21:32:36.663532 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:32:36.663532 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:32:36.663532 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:32:36.663532 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:32:36.663532 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:32:36.663532 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:32:36.663532 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 79a6a8bf389b4191816195072295a080 Oct 08 21:32:36.663532 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-TestServerBasicOps-1565608439 Oct 08 21:32:36.663532 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:32:36.663532 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:32:36.663532 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/79a6a8bf389b4191816195072295a080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/79a6a8bf389b4191816195072295a080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_79a6a8bf389b4191816195072295a080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/79a6a8bf389b4191816195072295a080"}]}] Oct 08 21:32:36.663532 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-TestServerBasicOps-1565608439 Oct 08 21:32:36.663532 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 79a6a8bf389b4191816195072295a080 Oct 08 21:32:36.663532 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-TestServerBasicOps-1565608439 Oct 08 21:32:36.663532 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-TestServerBasicOps-1565608439-project Oct 08 21:32:36.663532 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:32:36.663532 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:32:36.663532 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 6100a1568dd042e58ce63e4b30a87429 Oct 08 21:32:36.663532 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-TestServerBasicOps-1565608439-project Oct 08 21:32:36.663532 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 21:32:36.663532 ncdv-master-1 devstack@n-api.service[140492]: exception: Instance 931e11c7-9245-4481-b1eb-588fd86e30a6 could not be found. Oct 08 21:32:36.663532 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': '931e11c7-9245-4481-b1eb-588fd86e30a6'} Oct 08 21:32:36.663532 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:32:36.663532 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:32:36.663532 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:32:36.663532 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:32:36.663532 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:32:36.663532 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:32:36.663532 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:32:36.663532 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:32:36.663532 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:32:36.663532 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:32:36.663532 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 931e11c7-9245-4481-b1eb-588fd86e30a6 could not be found. Oct 08 21:32:36.663532 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:32:36.663532 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:32:36.663532 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:32:36.663532 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:32:36.663532 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:32:36.663532 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:32:36.663532 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:32:36.663532 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:32:36.663532 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:32:36.663532 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:32:36.663532 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:32:36.663532 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:32:36.663532 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:32:36.663532 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:32:36.663532 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:32:36.663532 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:32:36.663532 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 931e11c7-9245-4481-b1eb-588fd86e30a6 could not be found. Oct 08 21:32:36.663532 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:32:36.663532 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:32:36.663532 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:32:36.669086 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:32:36.669086 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:32:36.669086 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:32:36.669086 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:32:36.669086 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:32:36.669086 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 931e11c7-9245-4481-b1eb-588fd86e30a6 could not be found. Oct 08 21:32:36.669086 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:32:36.669086 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-bf57114d-954a-4438-b4a6-63a8ea2ec705 tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Returning 404 to user: Instance 931e11c7-9245-4481-b1eb-588fd86e30a6 could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:32:36.669086 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-bf57114d-954a-4438-b4a6-63a8ea2ec705 tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] 10.222.0.26 "GET /compute/v2.1/servers/931e11c7-9245-4481-b1eb-588fd86e30a6" status: 404 len: 111 microversion: 2.1 time: 0.142797 Oct 08 21:32:36.669086 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3077/6079] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:32:36 2022] GET /compute/v2.1/servers/931e11c7-9245-4481-b1eb-588fd86e30a6 => generated 111 bytes in 147 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:32:37.106951 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-0224d5c2-c3cb-414f-860e-d400698dd7b7 tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:32:37.107517 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-0224d5c2-c3cb-414f-860e-d400698dd7b7 tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] [instance: 931e11c7-9245-4481-b1eb-588fd86e30a6] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:32:37.114576 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0224d5c2-c3cb-414f-860e-d400698dd7b7 tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:32:37.115008 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0224d5c2-c3cb-414f-860e-d400698dd7b7 tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:32:37.115454 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0224d5c2-c3cb-414f-860e-d400698dd7b7 tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:32:37.116189 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0224d5c2-c3cb-414f-860e-d400698dd7b7 tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:32:37.116654 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0224d5c2-c3cb-414f-860e-d400698dd7b7 tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:32:37.117089 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0224d5c2-c3cb-414f-860e-d400698dd7b7 tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:32:37.134821 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-0224d5c2-c3cb-414f-860e-d400698dd7b7 tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] HTTP exception thrown: Instance 931e11c7-9245-4481-b1eb-588fd86e30a6 could not be found. Oct 08 21:32:37.136502 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-0224d5c2-c3cb-414f-860e-d400698dd7b7 tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Request method failure captured: Oct 08 21:32:37.136502 ncdv-master-1 devstack@n-api.service[140491]: request: DELETE /compute/v2.1/servers/931e11c7-9245-4481-b1eb-588fd86e30a6 HTTP/1.1 Oct 08 21:32:37.136502 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:32:37.136502 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:32:37.136502 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:32:37.136502 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 21:32:37.136502 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:32:37.136502 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:32:37.136502 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:32:37.136502 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:32:37.136502 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQetDmKzec_40-1E_ROnu2MXqpLqQTsECI3reZN-nlGMq2RR1VzQf1k_bZfTKzaHTuGknsPiQI2dFmyD3wQUJxmQfK9KKT-EKJcBTUc2FlZWVlXoiMpByXZibS8WL54HMxrtWiidwokGYMzuYBzyezjSK5BWx0wf3C9cW4LGK8BlsBTg Oct 08 21:32:37.136502 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:32:37.136502 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:32:37.136502 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:32:37.136502 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:32:37.136502 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:32:37.136502 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:32:37.136502 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 79a6a8bf389b4191816195072295a080 Oct 08 21:32:37.136502 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-TestServerBasicOps-1565608439 Oct 08 21:32:37.136502 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:32:37.136502 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:32:37.136502 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/79a6a8bf389b4191816195072295a080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/79a6a8bf389b4191816195072295a080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_79a6a8bf389b4191816195072295a080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/79a6a8bf389b4191816195072295a080"}]}] Oct 08 21:32:37.136502 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-TestServerBasicOps-1565608439 Oct 08 21:32:37.136502 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 79a6a8bf389b4191816195072295a080 Oct 08 21:32:37.136502 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-TestServerBasicOps-1565608439 Oct 08 21:32:37.136502 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-TestServerBasicOps-1565608439-project Oct 08 21:32:37.136502 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:32:37.136502 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:32:37.136502 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 6100a1568dd042e58ce63e4b30a87429 Oct 08 21:32:37.136502 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-TestServerBasicOps-1565608439-project Oct 08 21:32:37.136502 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:32:37.136502 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance 931e11c7-9245-4481-b1eb-588fd86e30a6 could not be found. Oct 08 21:32:37.136502 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': '931e11c7-9245-4481-b1eb-588fd86e30a6'} Oct 08 21:32:37.136502 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:32:37.136502 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:32:37.136502 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:32:37.136502 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:32:37.136502 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:32:37.136502 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:32:37.136502 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:32:37.136502 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:32:37.136502 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:32:37.136502 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:32:37.136502 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 931e11c7-9245-4481-b1eb-588fd86e30a6 could not be found. Oct 08 21:32:37.136502 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:32:37.136502 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:32:37.136502 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:32:37.136502 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:32:37.136502 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:32:37.136502 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:32:37.136502 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:32:37.136502 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:32:37.136502 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:32:37.136502 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:32:37.136502 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 08 21:32:37.136502 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 08 21:32:37.136502 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 08 21:32:37.136502 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 08 21:32:37.136502 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:32:37.136502 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:32:37.136502 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:32:37.136502 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:32:37.140700 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 931e11c7-9245-4481-b1eb-588fd86e30a6 could not be found. Oct 08 21:32:37.140700 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:32:37.140700 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:32:37.140700 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:32:37.140700 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:32:37.140700 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:32:37.140700 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:32:37.140700 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:32:37.140700 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:32:37.140700 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 931e11c7-9245-4481-b1eb-588fd86e30a6 could not be found. Oct 08 21:32:37.140700 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:32:37.140700 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-0224d5c2-c3cb-414f-860e-d400698dd7b7 tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Returning 404 to user: Instance 931e11c7-9245-4481-b1eb-588fd86e30a6 could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:32:37.140700 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-0224d5c2-c3cb-414f-860e-d400698dd7b7 tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] 10.222.0.26 "DELETE /compute/v2.1/servers/931e11c7-9245-4481-b1eb-588fd86e30a6" status: 404 len: 111 microversion: 2.1 time: 0.035041 Oct 08 21:32:37.140700 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3003/6080] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:32:37 2022] DELETE /compute/v2.1/servers/931e11c7-9245-4481-b1eb-588fd86e30a6 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:32:37.146742 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-ac9d0898-cfc8-42d6-abd2-5cb943e6abab tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:32:37.147367 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-ac9d0898-cfc8-42d6-abd2-5cb943e6abab tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] [instance: 931e11c7-9245-4481-b1eb-588fd86e30a6] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:32:37.153547 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ac9d0898-cfc8-42d6-abd2-5cb943e6abab tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:32:37.154041 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ac9d0898-cfc8-42d6-abd2-5cb943e6abab tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:32:37.154490 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ac9d0898-cfc8-42d6-abd2-5cb943e6abab tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:32:37.155191 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ac9d0898-cfc8-42d6-abd2-5cb943e6abab tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:32:37.155686 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ac9d0898-cfc8-42d6-abd2-5cb943e6abab tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:32:37.156121 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ac9d0898-cfc8-42d6-abd2-5cb943e6abab tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:32:37.170152 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-ac9d0898-cfc8-42d6-abd2-5cb943e6abab tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] HTTP exception thrown: Instance 931e11c7-9245-4481-b1eb-588fd86e30a6 could not be found. Oct 08 21:32:37.171667 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-ac9d0898-cfc8-42d6-abd2-5cb943e6abab tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Request method failure captured: Oct 08 21:32:37.171667 ncdv-master-1 devstack@n-api.service[140492]: request: GET /compute/v2.1/servers/931e11c7-9245-4481-b1eb-588fd86e30a6 HTTP/1.1 Oct 08 21:32:37.171667 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:32:37.171667 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:32:37.171667 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:32:37.171667 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 21:32:37.171667 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:32:37.171667 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:32:37.171667 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:32:37.171667 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:32:37.171667 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQetDmKzec_40-1E_ROnu2MXqpLqQTsECI3reZN-nlGMq2RR1VzQf1k_bZfTKzaHTuGknsPiQI2dFmyD3wQUJxmQfK9KKT-EKJcBTUc2FlZWVlXoiMpByXZibS8WL54HMxrtWiidwokGYMzuYBzyezjSK5BWx0wf3C9cW4LGK8BlsBTg Oct 08 21:32:37.171667 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:32:37.171667 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:32:37.171667 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:32:37.171667 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:32:37.171667 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:32:37.171667 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:32:37.171667 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 79a6a8bf389b4191816195072295a080 Oct 08 21:32:37.171667 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-TestServerBasicOps-1565608439 Oct 08 21:32:37.171667 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:32:37.171667 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:32:37.171667 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/79a6a8bf389b4191816195072295a080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/79a6a8bf389b4191816195072295a080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_79a6a8bf389b4191816195072295a080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/79a6a8bf389b4191816195072295a080"}]}] Oct 08 21:32:37.171667 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-TestServerBasicOps-1565608439 Oct 08 21:32:37.171667 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 79a6a8bf389b4191816195072295a080 Oct 08 21:32:37.171667 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-TestServerBasicOps-1565608439 Oct 08 21:32:37.171667 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-TestServerBasicOps-1565608439-project Oct 08 21:32:37.171667 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:32:37.171667 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:32:37.171667 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 6100a1568dd042e58ce63e4b30a87429 Oct 08 21:32:37.171667 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-TestServerBasicOps-1565608439-project Oct 08 21:32:37.171667 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 21:32:37.171667 ncdv-master-1 devstack@n-api.service[140492]: exception: Instance 931e11c7-9245-4481-b1eb-588fd86e30a6 could not be found. Oct 08 21:32:37.171667 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': '931e11c7-9245-4481-b1eb-588fd86e30a6'} Oct 08 21:32:37.171667 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:32:37.171667 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:32:37.171667 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:32:37.171667 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:32:37.171667 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:32:37.171667 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:32:37.171667 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:32:37.171667 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:32:37.171667 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:32:37.171667 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:32:37.171667 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 931e11c7-9245-4481-b1eb-588fd86e30a6 could not be found. Oct 08 21:32:37.171667 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:32:37.171667 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:32:37.171667 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:32:37.171667 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:32:37.171667 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:32:37.171667 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:32:37.171667 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:32:37.171667 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:32:37.171667 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:32:37.171667 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:32:37.171667 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:32:37.171667 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:32:37.171667 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:32:37.171667 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:32:37.171667 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:32:37.171667 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:32:37.171667 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 931e11c7-9245-4481-b1eb-588fd86e30a6 could not be found. Oct 08 21:32:37.171667 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:32:37.171667 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:32:37.171667 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:32:37.176044 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:32:37.176044 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:32:37.176044 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:32:37.176044 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:32:37.176044 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:32:37.176044 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 931e11c7-9245-4481-b1eb-588fd86e30a6 could not be found. Oct 08 21:32:37.176044 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:32:37.176044 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-ac9d0898-cfc8-42d6-abd2-5cb943e6abab tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Returning 404 to user: Instance 931e11c7-9245-4481-b1eb-588fd86e30a6 could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:32:37.176044 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-ac9d0898-cfc8-42d6-abd2-5cb943e6abab tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] 10.222.0.26 "GET /compute/v2.1/servers/931e11c7-9245-4481-b1eb-588fd86e30a6" status: 404 len: 111 microversion: 2.1 time: 0.030272 Oct 08 21:32:37.176044 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3078/6081] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:32:37 2022] GET /compute/v2.1/servers/931e11c7-9245-4481-b1eb-588fd86e30a6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:32:37.331731 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-0b4658a9-f150-446d-b358-eb2d577731ff tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] Calling method '.version_select at 0x7f1a877ec940>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:32:37.353769 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-0b4658a9-f150-446d-b358-eb2d577731ff tempest-TestServerBasicOps-1565608439 tempest-TestServerBasicOps-1565608439-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-768857520" status: 202 len: 0 microversion: 2.1 time: 0.024519 Oct 08 21:32:37.354591 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3004/6082] 10.222.0.26 () {58 vars in 1251 bytes} [Sat Oct 8 21:32:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-768857520 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 21:32:43.860894 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-99d1199c-30d1-4a65-83c3-8184396a7199 tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Action: 'create', calling method: .version_select at 0x7f1a8c025ca0>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-1856620467", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJXbXR+IO9v1o2WNfDMoeGAOrPHPuHKYCiLKsbfC/PWpx1LhP2aoaxNMizS6T+Gpvbpyxj7RbpggOLFRW+doFoQntunVh9jPlaxvdRymskA0ZNTt6TN0BIZpVfJuKqzZDQ=="}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:32:43.877610 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-99d1199c-30d1-4a65-83c3-8184396a7199 tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Getting quotas for project 5c13f3a9d12c4710882a17d9d06b3473. Resources: {'key_pairs'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:32:43.884458 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-99d1199c-30d1-4a65-83c3-8184396a7199 tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Getting quotas for user 0f0e898ea13845068ead117311106b0c and project 5c13f3a9d12c4710882a17d9d06b3473. Resources: {'key_pairs'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:32:43.917234 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-99d1199c-30d1-4a65-83c3-8184396a7199 tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.060112 Oct 08 21:32:43.918127 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3079/6083] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Oct 8 21:32:43 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 08 21:32:45.169530 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-1c0599a5-005c-4529-829a-c6d4aa38d905 tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-262188881", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "67154ed5-2fda-4ed4-9784-d919a9ecdfd3", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-1856620467", "security_groups": [{"name": "tempest-secgroup-smoke-223898639"}], "networks": [{"uuid": "79ecab12-9e58-4b09-9abc-dee3352bcf4d"}]}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:32:45.403288 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.network.neutron [None req-1c0599a5-005c-4529-829a-c6d4aa38d905 tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] validate_networks() for [('79ecab12-9e58-4b09-9abc-dee3352bcf4d', None, None, None, None, None)] {{(pid=140491) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 21:32:45.929508 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-1c0599a5-005c-4529-829a-c6d4aa38d905 tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Flavor limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 21:32:45.929982 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-1c0599a5-005c-4529-829a-c6d4aa38d905 tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Image limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 21:32:45.930878 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-1c0599a5-005c-4529-829a-c6d4aa38d905 tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Flavor pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 21:32:45.931334 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-1c0599a5-005c-4529-829a-c6d4aa38d905 tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Image pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 21:32:45.931769 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-1c0599a5-005c-4529-829a-c6d4aa38d905 tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 21:32:45.941129 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1c0599a5-005c-4529-829a-c6d4aa38d905 tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:32:45.941633 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1c0599a5-005c-4529-829a-c6d4aa38d905 tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:32:45.942069 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1c0599a5-005c-4529-829a-c6d4aa38d905 tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:32:45.942897 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1c0599a5-005c-4529-829a-c6d4aa38d905 tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:32:45.943277 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1c0599a5-005c-4529-829a-c6d4aa38d905 tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:32:45.943704 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1c0599a5-005c-4529-829a-c6d4aa38d905 tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:32:45.961763 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-1c0599a5-005c-4529-829a-c6d4aa38d905 tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Getting quotas for project 5c13f3a9d12c4710882a17d9d06b3473. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:32:45.967151 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-1c0599a5-005c-4529-829a-c6d4aa38d905 tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Getting quotas for user 0f0e898ea13845068ead117311106b0c and project 5c13f3a9d12c4710882a17d9d06b3473. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:32:46.028025 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-1c0599a5-005c-4529-829a-c6d4aa38d905 tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Going to run 1 instances... {{(pid=140491) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 21:32:46.030688 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-1c0599a5-005c-4529-829a-c6d4aa38d905 tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] [instance: 52d1cdbf-9250-4363-a404-10d7a5d9fffd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='67154ed5-2fda-4ed4-9784-d919a9ecdfd3',volume_size=None,volume_type=None)] {{(pid=140491) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 21:32:46.171841 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-1c0599a5-005c-4529-829a-c6d4aa38d905 tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.007385 Oct 08 21:32:46.173553 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3005/6084] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 21:32:45 2022] POST /compute/v2.1/servers => generated 405 bytes in 1010 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 08 21:32:46.184484 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-6004a91a-9707-4785-a46f-51f895a5e09b tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:32:46.185299 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-6004a91a-9707-4785-a46f-51f895a5e09b tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] [instance: 52d1cdbf-9250-4363-a404-10d7a5d9fffd] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:32:46.257805 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-6004a91a-9707-4785-a46f-51f895a5e09b tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0e898ea13845068ead117311106b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13f3a9d12c4710882a17d9d06b3473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:32:46.275670 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-6004a91a-9707-4785-a46f-51f895a5e09b tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] 10.222.0.26 "GET /compute/v2.1/servers/52d1cdbf-9250-4363-a404-10d7a5d9fffd" status: 200 len: 1098 microversion: 2.1 time: 0.094418 Oct 08 21:32:46.291265 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3080/6085] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:32:46 2022] GET /compute/v2.1/servers/52d1cdbf-9250-4363-a404-10d7a5d9fffd => generated 1098 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:32:47.300666 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-132bb58f-ffb2-4c5f-b602-4eb33283dcb0 tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:32:47.301320 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-132bb58f-ffb2-4c5f-b602-4eb33283dcb0 tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] [instance: 52d1cdbf-9250-4363-a404-10d7a5d9fffd] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:32:47.307716 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-132bb58f-ffb2-4c5f-b602-4eb33283dcb0 tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:32:47.308214 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-132bb58f-ffb2-4c5f-b602-4eb33283dcb0 tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:32:47.308787 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-132bb58f-ffb2-4c5f-b602-4eb33283dcb0 tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:32:47.309488 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-132bb58f-ffb2-4c5f-b602-4eb33283dcb0 tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:32:47.310003 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-132bb58f-ffb2-4c5f-b602-4eb33283dcb0 tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:32:47.310441 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-132bb58f-ffb2-4c5f-b602-4eb33283dcb0 tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:32:47.380994 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-132bb58f-ffb2-4c5f-b602-4eb33283dcb0 tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0e898ea13845068ead117311106b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13f3a9d12c4710882a17d9d06b3473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:32:47.390120 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-132bb58f-ffb2-4c5f-b602-4eb33283dcb0 tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] 10.222.0.26 "GET /compute/v2.1/servers/52d1cdbf-9250-4363-a404-10d7a5d9fffd" status: 200 len: 1148 microversion: 2.1 time: 0.094060 Oct 08 21:32:47.390796 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3006/6086] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:32:47 2022] GET /compute/v2.1/servers/52d1cdbf-9250-4363-a404-10d7a5d9fffd => generated 1148 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:32:48.420872 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-50673673-70ca-4570-a2ce-802c912c673d tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:32:48.423530 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-50673673-70ca-4570-a2ce-802c912c673d tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] [instance: 52d1cdbf-9250-4363-a404-10d7a5d9fffd] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:32:48.434859 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=12 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:32:48.439751 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-50673673-70ca-4570-a2ce-802c912c673d tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:32:48.440802 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-50673673-70ca-4570-a2ce-802c912c673d tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:32:48.441251 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-50673673-70ca-4570-a2ce-802c912c673d tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:32:48.442586 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-50673673-70ca-4570-a2ce-802c912c673d tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:32:48.443129 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-50673673-70ca-4570-a2ce-802c912c673d tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:32:48.444229 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-50673673-70ca-4570-a2ce-802c912c673d tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:32:48.546844 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-50673673-70ca-4570-a2ce-802c912c673d tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0e898ea13845068ead117311106b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13f3a9d12c4710882a17d9d06b3473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:32:48.556367 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-50673673-70ca-4570-a2ce-802c912c673d tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] 10.222.0.26 "GET /compute/v2.1/servers/52d1cdbf-9250-4363-a404-10d7a5d9fffd" status: 200 len: 1214 microversion: 2.1 time: 0.146406 Oct 08 21:32:48.557035 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3081/6087] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:32:48 2022] GET /compute/v2.1/servers/52d1cdbf-9250-4363-a404-10d7a5d9fffd => generated 1214 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:32:49.580824 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-8a226766-8b3d-4900-824b-873b81641057 tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:32:49.581968 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-8a226766-8b3d-4900-824b-873b81641057 tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] [instance: 52d1cdbf-9250-4363-a404-10d7a5d9fffd] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:32:49.595316 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8a226766-8b3d-4900-824b-873b81641057 tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:32:49.596170 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8a226766-8b3d-4900-824b-873b81641057 tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:32:49.596820 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8a226766-8b3d-4900-824b-873b81641057 tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:32:49.597721 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8a226766-8b3d-4900-824b-873b81641057 tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:32:49.598251 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8a226766-8b3d-4900-824b-873b81641057 tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:32:49.606180 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8a226766-8b3d-4900-824b-873b81641057 tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:32:49.897227 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-8a226766-8b3d-4900-824b-873b81641057 tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0e898ea13845068ead117311106b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13f3a9d12c4710882a17d9d06b3473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:32:49.908373 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-8a226766-8b3d-4900-824b-873b81641057 tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] 10.222.0.26 "GET /compute/v2.1/servers/52d1cdbf-9250-4363-a404-10d7a5d9fffd" status: 200 len: 1214 microversion: 2.1 time: 0.331929 Oct 08 21:32:49.910130 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3007/6088] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:32:49 2022] GET /compute/v2.1/servers/52d1cdbf-9250-4363-a404-10d7a5d9fffd => generated 1214 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:32:50.934822 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-ed6bb600-4162-4f2d-ac71-e156ce5013d8 tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:32:50.935960 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-ed6bb600-4162-4f2d-ac71-e156ce5013d8 tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] [instance: 52d1cdbf-9250-4363-a404-10d7a5d9fffd] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:32:50.947267 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ed6bb600-4162-4f2d-ac71-e156ce5013d8 tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:32:50.947787 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ed6bb600-4162-4f2d-ac71-e156ce5013d8 tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:32:50.948250 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ed6bb600-4162-4f2d-ac71-e156ce5013d8 tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:32:50.949163 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ed6bb600-4162-4f2d-ac71-e156ce5013d8 tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:32:50.949658 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ed6bb600-4162-4f2d-ac71-e156ce5013d8 tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:32:50.950103 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ed6bb600-4162-4f2d-ac71-e156ce5013d8 tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:32:51.133525 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-81f1db98-e295-4f25-8021-69fa010cb9e0 req-b27616f4-d102-4ca8-a909-2a3da29f0fb3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52d1cdbf-9250-4363-a404-10d7a5d9fffd", "tag": "d18ff6ec-36c0-4028-8a20-58b35240bfd4"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:32:51.147947 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-81f1db98-e295-4f25-8021-69fa010cb9e0 req-b27616f4-d102-4ca8-a909-2a3da29f0fb3 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:32:51.148896 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-81f1db98-e295-4f25-8021-69fa010cb9e0 req-b27616f4-d102-4ca8-a909-2a3da29f0fb3 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:32:51.149671 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-81f1db98-e295-4f25-8021-69fa010cb9e0 req-b27616f4-d102-4ca8-a909-2a3da29f0fb3 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:32:51.165284 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-81f1db98-e295-4f25-8021-69fa010cb9e0 req-b27616f4-d102-4ca8-a909-2a3da29f0fb3 service nova] Creating event network-changed:d18ff6ec-36c0-4028-8a20-58b35240bfd4 for instance 52d1cdbf-9250-4363-a404-10d7a5d9fffd on nch1-master-1 Oct 08 21:32:51.172254 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-81f1db98-e295-4f25-8021-69fa010cb9e0 req-b27616f4-d102-4ca8-a909-2a3da29f0fb3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042966 Oct 08 21:32:51.173544 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3008/6089] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:32:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 08 21:32:51.204440 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-ed6bb600-4162-4f2d-ac71-e156ce5013d8 tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0e898ea13845068ead117311106b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13f3a9d12c4710882a17d9d06b3473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:32:51.212806 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-ed6bb600-4162-4f2d-ac71-e156ce5013d8 tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] 10.222.0.26 "GET /compute/v2.1/servers/52d1cdbf-9250-4363-a404-10d7a5d9fffd" status: 200 len: 1269 microversion: 2.1 time: 0.282106 Oct 08 21:32:51.229222 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3082/6090] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:32:50 2022] GET /compute/v2.1/servers/52d1cdbf-9250-4363-a404-10d7a5d9fffd => generated 1269 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:32:52.245177 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-2ed0002d-ba7e-4e45-a577-58cd7d2cbc10 tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:32:52.246014 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-2ed0002d-ba7e-4e45-a577-58cd7d2cbc10 tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] [instance: 52d1cdbf-9250-4363-a404-10d7a5d9fffd] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:32:52.260936 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2ed0002d-ba7e-4e45-a577-58cd7d2cbc10 tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:32:52.261420 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2ed0002d-ba7e-4e45-a577-58cd7d2cbc10 tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:32:52.261916 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2ed0002d-ba7e-4e45-a577-58cd7d2cbc10 tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:32:52.266128 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2ed0002d-ba7e-4e45-a577-58cd7d2cbc10 tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:32:52.266749 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2ed0002d-ba7e-4e45-a577-58cd7d2cbc10 tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:32:52.267806 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2ed0002d-ba7e-4e45-a577-58cd7d2cbc10 tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:32:52.544282 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-2ed0002d-ba7e-4e45-a577-58cd7d2cbc10 tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0e898ea13845068ead117311106b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13f3a9d12c4710882a17d9d06b3473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:32:52.555156 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-2ed0002d-ba7e-4e45-a577-58cd7d2cbc10 tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] 10.222.0.26 "GET /compute/v2.1/servers/52d1cdbf-9250-4363-a404-10d7a5d9fffd" status: 200 len: 1269 microversion: 2.1 time: 0.321856 Oct 08 21:32:52.556613 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3009/6091] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:32:52 2022] GET /compute/v2.1/servers/52d1cdbf-9250-4363-a404-10d7a5d9fffd => generated 1269 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:32:53.579513 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-d9e17b9e-05de-42cc-afd4-68fbdf04e426 tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:32:53.580228 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-d9e17b9e-05de-42cc-afd4-68fbdf04e426 tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] [instance: 52d1cdbf-9250-4363-a404-10d7a5d9fffd] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:32:53.588081 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d9e17b9e-05de-42cc-afd4-68fbdf04e426 tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:32:53.588948 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d9e17b9e-05de-42cc-afd4-68fbdf04e426 tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:32:53.589495 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d9e17b9e-05de-42cc-afd4-68fbdf04e426 tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:32:53.590852 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d9e17b9e-05de-42cc-afd4-68fbdf04e426 tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:32:53.591392 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d9e17b9e-05de-42cc-afd4-68fbdf04e426 tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:32:53.592075 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d9e17b9e-05de-42cc-afd4-68fbdf04e426 tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:32:53.756649 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-d9e17b9e-05de-42cc-afd4-68fbdf04e426 tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0e898ea13845068ead117311106b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13f3a9d12c4710882a17d9d06b3473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:32:53.767510 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-d9e17b9e-05de-42cc-afd4-68fbdf04e426 tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] 10.222.0.26 "GET /compute/v2.1/servers/52d1cdbf-9250-4363-a404-10d7a5d9fffd" status: 200 len: 1269 microversion: 2.1 time: 0.192067 Oct 08 21:32:53.768115 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3083/6092] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:32:53 2022] GET /compute/v2.1/servers/52d1cdbf-9250-4363-a404-10d7a5d9fffd => generated 1269 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:32:54.792545 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-bcb65c08-44bc-42b8-8dfc-85fe43761170 tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:32:54.794189 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-bcb65c08-44bc-42b8-8dfc-85fe43761170 tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] [instance: 52d1cdbf-9250-4363-a404-10d7a5d9fffd] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:32:54.801169 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bcb65c08-44bc-42b8-8dfc-85fe43761170 tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:32:54.801696 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bcb65c08-44bc-42b8-8dfc-85fe43761170 tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:32:54.802214 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bcb65c08-44bc-42b8-8dfc-85fe43761170 tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:32:54.802948 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bcb65c08-44bc-42b8-8dfc-85fe43761170 tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:32:54.803445 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bcb65c08-44bc-42b8-8dfc-85fe43761170 tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:32:54.803884 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bcb65c08-44bc-42b8-8dfc-85fe43761170 tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:32:55.010054 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-bcb65c08-44bc-42b8-8dfc-85fe43761170 tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0e898ea13845068ead117311106b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13f3a9d12c4710882a17d9d06b3473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:32:55.018484 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-bcb65c08-44bc-42b8-8dfc-85fe43761170 tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] 10.222.0.26 "GET /compute/v2.1/servers/52d1cdbf-9250-4363-a404-10d7a5d9fffd" status: 200 len: 1269 microversion: 2.1 time: 0.230403 Oct 08 21:32:55.033738 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3010/6093] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:32:54 2022] GET /compute/v2.1/servers/52d1cdbf-9250-4363-a404-10d7a5d9fffd => generated 1269 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:32:56.042797 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-5b5f9f78-3341-4e56-85ee-b26326d8f947 tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:32:56.044603 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-5b5f9f78-3341-4e56-85ee-b26326d8f947 tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] [instance: 52d1cdbf-9250-4363-a404-10d7a5d9fffd] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:32:56.053110 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5b5f9f78-3341-4e56-85ee-b26326d8f947 tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:32:56.053839 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5b5f9f78-3341-4e56-85ee-b26326d8f947 tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:32:56.054616 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5b5f9f78-3341-4e56-85ee-b26326d8f947 tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:32:56.055878 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5b5f9f78-3341-4e56-85ee-b26326d8f947 tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:32:56.056520 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5b5f9f78-3341-4e56-85ee-b26326d8f947 tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:32:56.057228 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5b5f9f78-3341-4e56-85ee-b26326d8f947 tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:32:56.271030 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=6 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:32:56.287209 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-5b5f9f78-3341-4e56-85ee-b26326d8f947 tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0e898ea13845068ead117311106b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13f3a9d12c4710882a17d9d06b3473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:32:56.297284 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-5b5f9f78-3341-4e56-85ee-b26326d8f947 tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] 10.222.0.26 "GET /compute/v2.1/servers/52d1cdbf-9250-4363-a404-10d7a5d9fffd" status: 200 len: 1269 microversion: 2.1 time: 0.258350 Oct 08 21:32:56.304676 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3084/6094] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:32:56 2022] GET /compute/v2.1/servers/52d1cdbf-9250-4363-a404-10d7a5d9fffd => generated 1269 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:32:57.324958 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-1004c12f-d149-4d95-857b-707459672a1a tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:32:57.325820 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-1004c12f-d149-4d95-857b-707459672a1a tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] [instance: 52d1cdbf-9250-4363-a404-10d7a5d9fffd] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:32:57.330212 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=2 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:32:57.331368 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=6 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:32:57.337114 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1004c12f-d149-4d95-857b-707459672a1a tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:32:57.337825 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1004c12f-d149-4d95-857b-707459672a1a tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:32:57.338311 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1004c12f-d149-4d95-857b-707459672a1a tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:32:57.339073 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1004c12f-d149-4d95-857b-707459672a1a tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:32:57.339771 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1004c12f-d149-4d95-857b-707459672a1a tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:32:57.340373 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1004c12f-d149-4d95-857b-707459672a1a tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:32:57.495800 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-1004c12f-d149-4d95-857b-707459672a1a tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0e898ea13845068ead117311106b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13f3a9d12c4710882a17d9d06b3473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:32:57.505495 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-1004c12f-d149-4d95-857b-707459672a1a tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] 10.222.0.26 "GET /compute/v2.1/servers/52d1cdbf-9250-4363-a404-10d7a5d9fffd" status: 200 len: 1269 microversion: 2.1 time: 0.185111 Oct 08 21:32:57.513791 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3011/6095] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:32:57 2022] GET /compute/v2.1/servers/52d1cdbf-9250-4363-a404-10d7a5d9fffd => generated 1269 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:32:58.529043 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-7ab1ff67-38c2-463d-b33c-355a5f377820 tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:32:58.529703 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-7ab1ff67-38c2-463d-b33c-355a5f377820 tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] [instance: 52d1cdbf-9250-4363-a404-10d7a5d9fffd] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:32:58.536864 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7ab1ff67-38c2-463d-b33c-355a5f377820 tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:32:58.537398 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7ab1ff67-38c2-463d-b33c-355a5f377820 tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:32:58.537856 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7ab1ff67-38c2-463d-b33c-355a5f377820 tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:32:58.539175 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7ab1ff67-38c2-463d-b33c-355a5f377820 tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:32:58.539640 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7ab1ff67-38c2-463d-b33c-355a5f377820 tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:32:58.540115 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7ab1ff67-38c2-463d-b33c-355a5f377820 tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:32:58.677207 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-7ab1ff67-38c2-463d-b33c-355a5f377820 tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0e898ea13845068ead117311106b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13f3a9d12c4710882a17d9d06b3473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:32:58.686287 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-7ab1ff67-38c2-463d-b33c-355a5f377820 tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] 10.222.0.26 "GET /compute/v2.1/servers/52d1cdbf-9250-4363-a404-10d7a5d9fffd" status: 200 len: 1269 microversion: 2.1 time: 0.161027 Oct 08 21:32:58.686875 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3085/6096] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:32:58 2022] GET /compute/v2.1/servers/52d1cdbf-9250-4363-a404-10d7a5d9fffd => generated 1269 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:32:59.711368 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-13cfea03-90de-40b8-9301-935da8b9457c tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:32:59.711989 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-13cfea03-90de-40b8-9301-935da8b9457c tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] [instance: 52d1cdbf-9250-4363-a404-10d7a5d9fffd] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:32:59.719014 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-13cfea03-90de-40b8-9301-935da8b9457c tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:32:59.719782 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-13cfea03-90de-40b8-9301-935da8b9457c tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:32:59.720230 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-13cfea03-90de-40b8-9301-935da8b9457c tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:32:59.720934 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-13cfea03-90de-40b8-9301-935da8b9457c tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:32:59.721427 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-13cfea03-90de-40b8-9301-935da8b9457c tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:32:59.721863 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-13cfea03-90de-40b8-9301-935da8b9457c tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:32:59.856096 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-13cfea03-90de-40b8-9301-935da8b9457c tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0e898ea13845068ead117311106b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13f3a9d12c4710882a17d9d06b3473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:32:59.864258 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-13cfea03-90de-40b8-9301-935da8b9457c tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] 10.222.0.26 "GET /compute/v2.1/servers/52d1cdbf-9250-4363-a404-10d7a5d9fffd" status: 200 len: 1269 microversion: 2.1 time: 0.157505 Oct 08 21:32:59.864950 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3012/6097] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:32:59 2022] GET /compute/v2.1/servers/52d1cdbf-9250-4363-a404-10d7a5d9fffd => generated 1269 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:33:00.132151 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-08c137dc-3284-4503-8243-23260ce485b5 req-3555c3bf-3e83-4923-baa7-53d1c671b73c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52d1cdbf-9250-4363-a404-10d7a5d9fffd", "name": "network-vif-plugged", "status": "completed", "tag": "d18ff6ec-36c0-4028-8a20-58b35240bfd4"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:33:00.144484 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-08c137dc-3284-4503-8243-23260ce485b5 req-3555c3bf-3e83-4923-baa7-53d1c671b73c service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:33:00.145263 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-08c137dc-3284-4503-8243-23260ce485b5 req-3555c3bf-3e83-4923-baa7-53d1c671b73c service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:33:00.145765 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-08c137dc-3284-4503-8243-23260ce485b5 req-3555c3bf-3e83-4923-baa7-53d1c671b73c service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:33:00.158809 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-08c137dc-3284-4503-8243-23260ce485b5 req-3555c3bf-3e83-4923-baa7-53d1c671b73c service nova] Creating event network-vif-plugged:d18ff6ec-36c0-4028-8a20-58b35240bfd4 for instance 52d1cdbf-9250-4363-a404-10d7a5d9fffd on nch1-master-1 Oct 08 21:33:00.165434 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-08c137dc-3284-4503-8243-23260ce485b5 req-3555c3bf-3e83-4923-baa7-53d1c671b73c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041534 Oct 08 21:33:00.167136 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3086/6098] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:33:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:33:00.887764 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-5b396280-1d34-4d5b-bb5f-1ff2fa9a5ab7 tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:33:00.888319 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-5b396280-1d34-4d5b-bb5f-1ff2fa9a5ab7 tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] [instance: 52d1cdbf-9250-4363-a404-10d7a5d9fffd] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:33:00.895171 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5b396280-1d34-4d5b-bb5f-1ff2fa9a5ab7 tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:33:00.895668 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5b396280-1d34-4d5b-bb5f-1ff2fa9a5ab7 tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:33:00.896118 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5b396280-1d34-4d5b-bb5f-1ff2fa9a5ab7 tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:33:00.896826 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5b396280-1d34-4d5b-bb5f-1ff2fa9a5ab7 tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:33:00.897387 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5b396280-1d34-4d5b-bb5f-1ff2fa9a5ab7 tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:33:00.897828 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5b396280-1d34-4d5b-bb5f-1ff2fa9a5ab7 tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:33:01.046417 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-5b396280-1d34-4d5b-bb5f-1ff2fa9a5ab7 tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0e898ea13845068ead117311106b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13f3a9d12c4710882a17d9d06b3473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:33:01.056128 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-5b396280-1d34-4d5b-bb5f-1ff2fa9a5ab7 tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] 10.222.0.26 "GET /compute/v2.1/servers/52d1cdbf-9250-4363-a404-10d7a5d9fffd" status: 200 len: 1269 microversion: 2.1 time: 0.172258 Oct 08 21:33:01.057145 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3013/6099] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:33:00 2022] GET /compute/v2.1/servers/52d1cdbf-9250-4363-a404-10d7a5d9fffd => generated 1269 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:33:01.528726 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-a99ee953-3c40-4be6-b04a-ee0af6dd697e tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-4115332", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "de6e7b16-78e1-462c-a0b2-d3e5809f2605", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "4d64b136-ce87-445f-a822-d4ba1b8b55a2"}]}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:33:01.624195 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.network.neutron [None req-a99ee953-3c40-4be6-b04a-ee0af6dd697e tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] validate_networks() for [('4d64b136-ce87-445f-a822-d4ba1b8b55a2', None, None, None, None, None)] {{(pid=140492) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 21:33:02.080322 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c9abeb38-347b-4c66-86c1-d849c69e0fc1 tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:33:02.081678 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-c9abeb38-347b-4c66-86c1-d849c69e0fc1 tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] [instance: 52d1cdbf-9250-4363-a404-10d7a5d9fffd] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:33:02.089506 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c9abeb38-347b-4c66-86c1-d849c69e0fc1 tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:33:02.090299 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c9abeb38-347b-4c66-86c1-d849c69e0fc1 tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:33:02.091630 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c9abeb38-347b-4c66-86c1-d849c69e0fc1 tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:33:02.092487 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c9abeb38-347b-4c66-86c1-d849c69e0fc1 tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:33:02.093126 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c9abeb38-347b-4c66-86c1-d849c69e0fc1 tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:33:02.093594 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c9abeb38-347b-4c66-86c1-d849c69e0fc1 tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:33:02.150622 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-a99ee953-3c40-4be6-b04a-ee0af6dd697e tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Flavor limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 21:33:02.151295 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-a99ee953-3c40-4be6-b04a-ee0af6dd697e tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Image limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 21:33:02.151972 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-a99ee953-3c40-4be6-b04a-ee0af6dd697e tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Flavor pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 21:33:02.152617 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-a99ee953-3c40-4be6-b04a-ee0af6dd697e tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Image pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 21:33:02.153301 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-a99ee953-3c40-4be6-b04a-ee0af6dd697e tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 21:33:02.163707 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a99ee953-3c40-4be6-b04a-ee0af6dd697e tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:33:02.164545 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a99ee953-3c40-4be6-b04a-ee0af6dd697e tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:33:02.165139 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a99ee953-3c40-4be6-b04a-ee0af6dd697e tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:33:02.166090 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a99ee953-3c40-4be6-b04a-ee0af6dd697e tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:33:02.167766 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a99ee953-3c40-4be6-b04a-ee0af6dd697e tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:33:02.168442 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a99ee953-3c40-4be6-b04a-ee0af6dd697e tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:33:02.197820 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-a99ee953-3c40-4be6-b04a-ee0af6dd697e tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Getting quotas for project 8d9857e88402494e964f2099de5bb60c. Resources: {'cores', 'instances', 'ram'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:33:02.212252 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-a99ee953-3c40-4be6-b04a-ee0af6dd697e tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Getting quotas for user 7ac4eff18a664804af16cf21321f9290 and project 8d9857e88402494e964f2099de5bb60c. Resources: {'cores', 'instances', 'ram'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:33:02.227247 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-a99ee953-3c40-4be6-b04a-ee0af6dd697e tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Going to run 1 instances... {{(pid=140492) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 21:33:02.229941 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-a99ee953-3c40-4be6-b04a-ee0af6dd697e tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] [instance: d5f9c92e-4201-45f7-86f8-8b6e5764c3a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='de6e7b16-78e1-462c-a0b2-d3e5809f2605',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140492) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 21:33:02.252521 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-c9abeb38-347b-4c66-86c1-d849c69e0fc1 tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0e898ea13845068ead117311106b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13f3a9d12c4710882a17d9d06b3473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:33:02.262108 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-c9abeb38-347b-4c66-86c1-d849c69e0fc1 tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] 10.222.0.26 "GET /compute/v2.1/servers/52d1cdbf-9250-4363-a404-10d7a5d9fffd" status: 200 len: 1458 microversion: 2.1 time: 0.185829 Oct 08 21:33:02.263778 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3014/6100] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:33:02 2022] GET /compute/v2.1/servers/52d1cdbf-9250-4363-a404-10d7a5d9fffd => generated 1458 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:33:02.286172 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-2c53a288-b886-4afe-9347-da3534127d0b tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:33:02.286799 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-2c53a288-b886-4afe-9347-da3534127d0b tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] [instance: 52d1cdbf-9250-4363-a404-10d7a5d9fffd] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:33:02.291651 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:33:02.297078 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2c53a288-b886-4afe-9347-da3534127d0b tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:33:02.297889 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2c53a288-b886-4afe-9347-da3534127d0b tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:33:02.298562 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2c53a288-b886-4afe-9347-da3534127d0b tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:33:02.299511 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2c53a288-b886-4afe-9347-da3534127d0b tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:33:02.300632 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2c53a288-b886-4afe-9347-da3534127d0b tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:33:02.301405 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2c53a288-b886-4afe-9347-da3534127d0b tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:33:02.306140 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:33:02.348916 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-a99ee953-3c40-4be6-b04a-ee0af6dd697e tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.824836 Oct 08 21:33:02.350123 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3087/6101] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 21:33:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 828 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 08 21:33:02.362148 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-204bd0fb-fc9c-407b-8c0e-6c4f472d3e9c tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:33:02.362955 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-204bd0fb-fc9c-407b-8c0e-6c4f472d3e9c tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] [instance: d5f9c92e-4201-45f7-86f8-8b6e5764c3a6] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:33:02.440358 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-204bd0fb-fc9c-407b-8c0e-6c4f472d3e9c tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac4eff18a664804af16cf21321f9290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9857e88402494e964f2099de5bb60c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:33:02.451574 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-204bd0fb-fc9c-407b-8c0e-6c4f472d3e9c tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] 10.222.0.26 "GET /compute/v2.1/servers/d5f9c92e-4201-45f7-86f8-8b6e5764c3a6" status: 200 len: 1054 microversion: 2.1 time: 0.093891 Oct 08 21:33:02.453585 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3088/6102] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:33:02 2022] GET /compute/v2.1/servers/d5f9c92e-4201-45f7-86f8-8b6e5764c3a6 => generated 1054 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:33:02.529029 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-2c53a288-b886-4afe-9347-da3534127d0b tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0e898ea13845068ead117311106b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13f3a9d12c4710882a17d9d06b3473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:33:02.537172 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-2c53a288-b886-4afe-9347-da3534127d0b tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] 10.222.0.26 "GET /compute/v2.1/servers/52d1cdbf-9250-4363-a404-10d7a5d9fffd" status: 200 len: 1458 microversion: 2.1 time: 0.255090 Oct 08 21:33:02.541252 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3015/6103] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:33:02 2022] GET /compute/v2.1/servers/52d1cdbf-9250-4363-a404-10d7a5d9fffd => generated 1458 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:33:03.477153 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-fac48e6a-117c-4fa8-a43a-1f1d8f780edb tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:33:03.477810 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-fac48e6a-117c-4fa8-a43a-1f1d8f780edb tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] [instance: d5f9c92e-4201-45f7-86f8-8b6e5764c3a6] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:33:03.485581 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=4 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:33:03.488304 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fac48e6a-117c-4fa8-a43a-1f1d8f780edb tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:33:03.489420 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fac48e6a-117c-4fa8-a43a-1f1d8f780edb tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:33:03.490076 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fac48e6a-117c-4fa8-a43a-1f1d8f780edb tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:33:03.491963 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fac48e6a-117c-4fa8-a43a-1f1d8f780edb tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:33:03.492646 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fac48e6a-117c-4fa8-a43a-1f1d8f780edb tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:33:03.493312 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fac48e6a-117c-4fa8-a43a-1f1d8f780edb tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:33:03.609526 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-fac48e6a-117c-4fa8-a43a-1f1d8f780edb tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac4eff18a664804af16cf21321f9290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9857e88402494e964f2099de5bb60c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:33:03.622891 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-fac48e6a-117c-4fa8-a43a-1f1d8f780edb tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] 10.222.0.26 "GET /compute/v2.1/servers/d5f9c92e-4201-45f7-86f8-8b6e5764c3a6" status: 200 len: 1114 microversion: 2.1 time: 0.150223 Oct 08 21:33:03.623494 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3089/6104] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:33:03 2022] GET /compute/v2.1/servers/d5f9c92e-4201-45f7-86f8-8b6e5764c3a6 => generated 1114 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:33:04.652969 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-af8c7204-2bb2-46e2-8271-2767e2073f88 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:33:04.654763 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-af8c7204-2bb2-46e2-8271-2767e2073f88 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] [instance: d5f9c92e-4201-45f7-86f8-8b6e5764c3a6] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:33:04.665308 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-af8c7204-2bb2-46e2-8271-2767e2073f88 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:33:04.666519 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-af8c7204-2bb2-46e2-8271-2767e2073f88 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:33:04.667456 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-af8c7204-2bb2-46e2-8271-2767e2073f88 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:33:04.668387 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-af8c7204-2bb2-46e2-8271-2767e2073f88 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:33:04.669409 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-af8c7204-2bb2-46e2-8271-2767e2073f88 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:33:04.669995 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-af8c7204-2bb2-46e2-8271-2767e2073f88 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:33:04.742824 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-af8c7204-2bb2-46e2-8271-2767e2073f88 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac4eff18a664804af16cf21321f9290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9857e88402494e964f2099de5bb60c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:33:04.751773 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-af8c7204-2bb2-46e2-8271-2767e2073f88 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] 10.222.0.26 "GET /compute/v2.1/servers/d5f9c92e-4201-45f7-86f8-8b6e5764c3a6" status: 200 len: 1124 microversion: 2.1 time: 0.104220 Oct 08 21:33:04.752384 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3016/6105] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:33:04 2022] GET /compute/v2.1/servers/d5f9c92e-4201-45f7-86f8-8b6e5764c3a6 => generated 1124 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:33:05.453252 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-871ab242-27cb-47c1-b0d1-301f0eba1f38 req-8c3cda84-8425-43db-8629-6effc7e2bda1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52d1cdbf-9250-4363-a404-10d7a5d9fffd", "tag": "d18ff6ec-36c0-4028-8a20-58b35240bfd4"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:33:05.494660 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-871ab242-27cb-47c1-b0d1-301f0eba1f38 req-8c3cda84-8425-43db-8629-6effc7e2bda1 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:33:05.495169 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-871ab242-27cb-47c1-b0d1-301f0eba1f38 req-8c3cda84-8425-43db-8629-6effc7e2bda1 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:33:05.495615 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-871ab242-27cb-47c1-b0d1-301f0eba1f38 req-8c3cda84-8425-43db-8629-6effc7e2bda1 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:33:05.526697 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-871ab242-27cb-47c1-b0d1-301f0eba1f38 req-8c3cda84-8425-43db-8629-6effc7e2bda1 service nova] Creating event network-changed:d18ff6ec-36c0-4028-8a20-58b35240bfd4 for instance 52d1cdbf-9250-4363-a404-10d7a5d9fffd on nch1-master-1 Oct 08 21:33:05.544514 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-871ab242-27cb-47c1-b0d1-301f0eba1f38 req-8c3cda84-8425-43db-8629-6effc7e2bda1 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.331271 Oct 08 21:33:05.545424 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3090/6106] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:33:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:33:05.776025 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-d532ae5d-f1aa-491d-880f-6d4a81654381 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:33:05.777396 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-d532ae5d-f1aa-491d-880f-6d4a81654381 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] [instance: d5f9c92e-4201-45f7-86f8-8b6e5764c3a6] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:33:05.785031 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d532ae5d-f1aa-491d-880f-6d4a81654381 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:33:05.785865 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d532ae5d-f1aa-491d-880f-6d4a81654381 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:33:05.786559 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d532ae5d-f1aa-491d-880f-6d4a81654381 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:33:05.788161 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d532ae5d-f1aa-491d-880f-6d4a81654381 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:33:05.788849 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d532ae5d-f1aa-491d-880f-6d4a81654381 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:33:05.789540 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d532ae5d-f1aa-491d-880f-6d4a81654381 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:33:06.194359 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-d532ae5d-f1aa-491d-880f-6d4a81654381 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac4eff18a664804af16cf21321f9290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9857e88402494e964f2099de5bb60c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:33:06.211745 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-d532ae5d-f1aa-491d-880f-6d4a81654381 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] 10.222.0.26 "GET /compute/v2.1/servers/d5f9c92e-4201-45f7-86f8-8b6e5764c3a6" status: 200 len: 1166 microversion: 2.1 time: 0.440082 Oct 08 21:33:06.227239 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3017/6107] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:33:05 2022] GET /compute/v2.1/servers/d5f9c92e-4201-45f7-86f8-8b6e5764c3a6 => generated 1166 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:33:06.838261 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-71c98b48-b8a9-4406-89b0-6bef9f29bb6f req-08811ce0-df90-4f8b-b25b-dfade13db509 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52d1cdbf-9250-4363-a404-10d7a5d9fffd", "tag": "d18ff6ec-36c0-4028-8a20-58b35240bfd4"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:33:06.848479 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-71c98b48-b8a9-4406-89b0-6bef9f29bb6f req-08811ce0-df90-4f8b-b25b-dfade13db509 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:33:06.848978 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-71c98b48-b8a9-4406-89b0-6bef9f29bb6f req-08811ce0-df90-4f8b-b25b-dfade13db509 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:33:06.849451 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-71c98b48-b8a9-4406-89b0-6bef9f29bb6f req-08811ce0-df90-4f8b-b25b-dfade13db509 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:33:06.862094 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-71c98b48-b8a9-4406-89b0-6bef9f29bb6f req-08811ce0-df90-4f8b-b25b-dfade13db509 service nova] Creating event network-changed:d18ff6ec-36c0-4028-8a20-58b35240bfd4 for instance 52d1cdbf-9250-4363-a404-10d7a5d9fffd on nch1-master-1 Oct 08 21:33:06.873072 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-71c98b48-b8a9-4406-89b0-6bef9f29bb6f req-08811ce0-df90-4f8b-b25b-dfade13db509 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035032 Oct 08 21:33:06.873072 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3091/6108] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:33:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:33:07.239517 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-294c8ca0-83fc-4a6d-be6c-d0bdf23510a6 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:33:07.240817 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-294c8ca0-83fc-4a6d-be6c-d0bdf23510a6 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] [instance: d5f9c92e-4201-45f7-86f8-8b6e5764c3a6] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:33:07.248887 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-294c8ca0-83fc-4a6d-be6c-d0bdf23510a6 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:33:07.249635 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-294c8ca0-83fc-4a6d-be6c-d0bdf23510a6 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:33:07.250259 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-294c8ca0-83fc-4a6d-be6c-d0bdf23510a6 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:33:07.251268 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-294c8ca0-83fc-4a6d-be6c-d0bdf23510a6 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:33:07.251884 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-294c8ca0-83fc-4a6d-be6c-d0bdf23510a6 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:33:07.252470 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-294c8ca0-83fc-4a6d-be6c-d0bdf23510a6 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:33:07.480580 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-294c8ca0-83fc-4a6d-be6c-d0bdf23510a6 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac4eff18a664804af16cf21321f9290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9857e88402494e964f2099de5bb60c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:33:07.489742 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-294c8ca0-83fc-4a6d-be6c-d0bdf23510a6 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] 10.222.0.26 "GET /compute/v2.1/servers/d5f9c92e-4201-45f7-86f8-8b6e5764c3a6" status: 200 len: 1166 microversion: 2.1 time: 0.255699 Oct 08 21:33:07.507708 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3018/6109] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:33:07 2022] GET /compute/v2.1/servers/d5f9c92e-4201-45f7-86f8-8b6e5764c3a6 => generated 1166 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:33:07.562365 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-3051fdce-b760-4834-9664-cc43f570abec req-3fe62cf1-ab54-4db5-bb1e-02724a6a5c9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5f9c92e-4201-45f7-86f8-8b6e5764c3a6", "tag": "83e6e5de-79c8-4030-8f5f-a0e0708767d6"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:33:07.572696 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-3051fdce-b760-4834-9664-cc43f570abec req-3fe62cf1-ab54-4db5-bb1e-02724a6a5c9d service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:33:07.573522 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-3051fdce-b760-4834-9664-cc43f570abec req-3fe62cf1-ab54-4db5-bb1e-02724a6a5c9d service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:33:07.574469 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-3051fdce-b760-4834-9664-cc43f570abec req-3fe62cf1-ab54-4db5-bb1e-02724a6a5c9d service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:33:07.586992 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-3051fdce-b760-4834-9664-cc43f570abec req-3fe62cf1-ab54-4db5-bb1e-02724a6a5c9d service nova] Creating event network-changed:83e6e5de-79c8-4030-8f5f-a0e0708767d6 for instance d5f9c92e-4201-45f7-86f8-8b6e5764c3a6 on nch2-master-1 Oct 08 21:33:07.592601 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-3051fdce-b760-4834-9664-cc43f570abec req-3fe62cf1-ab54-4db5-bb1e-02724a6a5c9d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034831 Oct 08 21:33:07.593465 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3092/6110] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:33:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:33:08.516706 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-e2c2831d-6e85-4510-874d-15703f66e3dd tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:33:08.517697 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-e2c2831d-6e85-4510-874d-15703f66e3dd tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] [instance: d5f9c92e-4201-45f7-86f8-8b6e5764c3a6] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:33:08.529219 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e2c2831d-6e85-4510-874d-15703f66e3dd tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:33:08.529720 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e2c2831d-6e85-4510-874d-15703f66e3dd tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:33:08.530373 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e2c2831d-6e85-4510-874d-15703f66e3dd tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:33:08.531591 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e2c2831d-6e85-4510-874d-15703f66e3dd tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:33:08.532221 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e2c2831d-6e85-4510-874d-15703f66e3dd tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:33:08.532813 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e2c2831d-6e85-4510-874d-15703f66e3dd tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:33:08.667018 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-e2c2831d-6e85-4510-874d-15703f66e3dd tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac4eff18a664804af16cf21321f9290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9857e88402494e964f2099de5bb60c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:33:08.675271 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-e2c2831d-6e85-4510-874d-15703f66e3dd tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] 10.222.0.26 "GET /compute/v2.1/servers/d5f9c92e-4201-45f7-86f8-8b6e5764c3a6" status: 200 len: 1212 microversion: 2.1 time: 0.166569 Oct 08 21:33:08.675849 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3019/6111] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:33:08 2022] GET /compute/v2.1/servers/d5f9c92e-4201-45f7-86f8-8b6e5764c3a6 => generated 1212 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:33:08.883251 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-8fd3b364-2caa-4dcd-9649-b071a5cf3d85 req-071dedd1-39fc-4265-9e14-90236364cf04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52d1cdbf-9250-4363-a404-10d7a5d9fffd", "tag": "d18ff6ec-36c0-4028-8a20-58b35240bfd4"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:33:08.892950 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-8fd3b364-2caa-4dcd-9649-b071a5cf3d85 req-071dedd1-39fc-4265-9e14-90236364cf04 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:33:08.893456 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-8fd3b364-2caa-4dcd-9649-b071a5cf3d85 req-071dedd1-39fc-4265-9e14-90236364cf04 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:33:08.893894 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-8fd3b364-2caa-4dcd-9649-b071a5cf3d85 req-071dedd1-39fc-4265-9e14-90236364cf04 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:33:08.904773 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-8fd3b364-2caa-4dcd-9649-b071a5cf3d85 req-071dedd1-39fc-4265-9e14-90236364cf04 service nova] Creating event network-changed:d18ff6ec-36c0-4028-8a20-58b35240bfd4 for instance 52d1cdbf-9250-4363-a404-10d7a5d9fffd on nch1-master-1 Oct 08 21:33:08.909610 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-8fd3b364-2caa-4dcd-9649-b071a5cf3d85 req-071dedd1-39fc-4265-9e14-90236364cf04 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032035 Oct 08 21:33:08.910191 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3093/6112] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:33:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:33:09.698889 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-3b0833e8-34f2-4c47-8e29-00dfa30c95e0 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:33:09.699420 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-3b0833e8-34f2-4c47-8e29-00dfa30c95e0 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] [instance: d5f9c92e-4201-45f7-86f8-8b6e5764c3a6] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:33:09.706552 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3b0833e8-34f2-4c47-8e29-00dfa30c95e0 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:33:09.707050 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3b0833e8-34f2-4c47-8e29-00dfa30c95e0 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:33:09.707502 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3b0833e8-34f2-4c47-8e29-00dfa30c95e0 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:33:09.708216 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3b0833e8-34f2-4c47-8e29-00dfa30c95e0 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:33:09.708691 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3b0833e8-34f2-4c47-8e29-00dfa30c95e0 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:33:09.709668 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3b0833e8-34f2-4c47-8e29-00dfa30c95e0 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:33:09.840804 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-3b0833e8-34f2-4c47-8e29-00dfa30c95e0 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac4eff18a664804af16cf21321f9290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9857e88402494e964f2099de5bb60c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:33:09.848940 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-3b0833e8-34f2-4c47-8e29-00dfa30c95e0 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] 10.222.0.26 "GET /compute/v2.1/servers/d5f9c92e-4201-45f7-86f8-8b6e5764c3a6" status: 200 len: 1200 microversion: 2.1 time: 0.154189 Oct 08 21:33:09.849542 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3020/6113] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:33:09 2022] GET /compute/v2.1/servers/d5f9c92e-4201-45f7-86f8-8b6e5764c3a6 => generated 1200 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:33:10.873755 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-2032e976-b146-429c-8b99-75ec0fc1c147 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:33:10.874362 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-2032e976-b146-429c-8b99-75ec0fc1c147 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] [instance: d5f9c92e-4201-45f7-86f8-8b6e5764c3a6] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:33:10.880905 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2032e976-b146-429c-8b99-75ec0fc1c147 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:33:10.881439 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2032e976-b146-429c-8b99-75ec0fc1c147 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:33:10.881887 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2032e976-b146-429c-8b99-75ec0fc1c147 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:33:10.882587 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2032e976-b146-429c-8b99-75ec0fc1c147 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:33:10.883075 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2032e976-b146-429c-8b99-75ec0fc1c147 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:33:10.883504 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2032e976-b146-429c-8b99-75ec0fc1c147 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:33:11.021204 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-2032e976-b146-429c-8b99-75ec0fc1c147 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac4eff18a664804af16cf21321f9290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9857e88402494e964f2099de5bb60c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:33:11.029445 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-2032e976-b146-429c-8b99-75ec0fc1c147 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] 10.222.0.26 "GET /compute/v2.1/servers/d5f9c92e-4201-45f7-86f8-8b6e5764c3a6" status: 200 len: 1200 microversion: 2.1 time: 0.160905 Oct 08 21:33:11.030031 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3094/6114] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:33:10 2022] GET /compute/v2.1/servers/d5f9c92e-4201-45f7-86f8-8b6e5764c3a6 => generated 1200 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:33:12.053274 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-bba2dff2-b63a-44b0-bf64-3f5a0ada439f tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:33:12.053934 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-bba2dff2-b63a-44b0-bf64-3f5a0ada439f tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] [instance: d5f9c92e-4201-45f7-86f8-8b6e5764c3a6] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:33:12.060940 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bba2dff2-b63a-44b0-bf64-3f5a0ada439f tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:33:12.061498 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bba2dff2-b63a-44b0-bf64-3f5a0ada439f tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:33:12.061952 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bba2dff2-b63a-44b0-bf64-3f5a0ada439f tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:33:12.062667 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bba2dff2-b63a-44b0-bf64-3f5a0ada439f tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:33:12.063132 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bba2dff2-b63a-44b0-bf64-3f5a0ada439f tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:33:12.063570 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bba2dff2-b63a-44b0-bf64-3f5a0ada439f tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:33:12.193824 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-bba2dff2-b63a-44b0-bf64-3f5a0ada439f tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac4eff18a664804af16cf21321f9290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9857e88402494e964f2099de5bb60c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:33:12.201696 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-bba2dff2-b63a-44b0-bf64-3f5a0ada439f tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] 10.222.0.26 "GET /compute/v2.1/servers/d5f9c92e-4201-45f7-86f8-8b6e5764c3a6" status: 200 len: 1200 microversion: 2.1 time: 0.153034 Oct 08 21:33:12.202278 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3021/6115] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:33:12 2022] GET /compute/v2.1/servers/d5f9c92e-4201-45f7-86f8-8b6e5764c3a6 => generated 1200 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:33:13.225392 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-c3de4c07-9767-4e77-830f-5714417ed374 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:33:13.226622 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-c3de4c07-9767-4e77-830f-5714417ed374 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] [instance: d5f9c92e-4201-45f7-86f8-8b6e5764c3a6] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:33:13.230860 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=2 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:33:13.231557 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=8 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:33:13.236150 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c3de4c07-9767-4e77-830f-5714417ed374 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:33:13.236663 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c3de4c07-9767-4e77-830f-5714417ed374 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:33:13.237115 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c3de4c07-9767-4e77-830f-5714417ed374 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:33:13.237921 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c3de4c07-9767-4e77-830f-5714417ed374 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:33:13.238370 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c3de4c07-9767-4e77-830f-5714417ed374 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:33:13.238809 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c3de4c07-9767-4e77-830f-5714417ed374 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:33:13.384409 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-c3de4c07-9767-4e77-830f-5714417ed374 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac4eff18a664804af16cf21321f9290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9857e88402494e964f2099de5bb60c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:33:13.392407 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-c3de4c07-9767-4e77-830f-5714417ed374 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] 10.222.0.26 "GET /compute/v2.1/servers/d5f9c92e-4201-45f7-86f8-8b6e5764c3a6" status: 200 len: 1200 microversion: 2.1 time: 0.171305 Oct 08 21:33:13.393004 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3095/6116] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:33:13 2022] GET /compute/v2.1/servers/d5f9c92e-4201-45f7-86f8-8b6e5764c3a6 => generated 1200 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:33:14.415990 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-433814f3-bc01-44f1-bdc5-03351314fece tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:33:14.416589 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-433814f3-bc01-44f1-bdc5-03351314fece tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] [instance: d5f9c92e-4201-45f7-86f8-8b6e5764c3a6] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:33:14.423571 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-433814f3-bc01-44f1-bdc5-03351314fece tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:33:14.424061 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-433814f3-bc01-44f1-bdc5-03351314fece tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:33:14.424505 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-433814f3-bc01-44f1-bdc5-03351314fece tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:33:14.425212 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-433814f3-bc01-44f1-bdc5-03351314fece tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:33:14.425748 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-433814f3-bc01-44f1-bdc5-03351314fece tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:33:14.426180 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-433814f3-bc01-44f1-bdc5-03351314fece tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:33:14.559217 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-433814f3-bc01-44f1-bdc5-03351314fece tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac4eff18a664804af16cf21321f9290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9857e88402494e964f2099de5bb60c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:33:14.567154 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-433814f3-bc01-44f1-bdc5-03351314fece tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] 10.222.0.26 "GET /compute/v2.1/servers/d5f9c92e-4201-45f7-86f8-8b6e5764c3a6" status: 200 len: 1200 microversion: 2.1 time: 0.155602 Oct 08 21:33:14.567735 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3022/6117] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:33:14 2022] GET /compute/v2.1/servers/d5f9c92e-4201-45f7-86f8-8b6e5764c3a6 => generated 1200 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:33:15.359192 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-e9f8e3eb-95f7-487a-ad19-9b7f70781b10 req-a470899a-7727-4fb3-b10c-6b157a9711e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5f9c92e-4201-45f7-86f8-8b6e5764c3a6", "name": "network-vif-plugged", "status": "completed", "tag": "83e6e5de-79c8-4030-8f5f-a0e0708767d6"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:33:15.371358 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-e9f8e3eb-95f7-487a-ad19-9b7f70781b10 req-a470899a-7727-4fb3-b10c-6b157a9711e4 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:33:15.371847 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-e9f8e3eb-95f7-487a-ad19-9b7f70781b10 req-a470899a-7727-4fb3-b10c-6b157a9711e4 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:33:15.372287 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-e9f8e3eb-95f7-487a-ad19-9b7f70781b10 req-a470899a-7727-4fb3-b10c-6b157a9711e4 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:33:15.384489 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-e9f8e3eb-95f7-487a-ad19-9b7f70781b10 req-a470899a-7727-4fb3-b10c-6b157a9711e4 service nova] Creating event network-vif-plugged:83e6e5de-79c8-4030-8f5f-a0e0708767d6 for instance d5f9c92e-4201-45f7-86f8-8b6e5764c3a6 on nch2-master-1 Oct 08 21:33:15.389733 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-e9f8e3eb-95f7-487a-ad19-9b7f70781b10 req-a470899a-7727-4fb3-b10c-6b157a9711e4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034261 Oct 08 21:33:15.390348 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3096/6118] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:33:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:33:15.589787 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-a93b29d6-2560-4b89-9f25-80fcfab3bf70 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:33:15.590334 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-a93b29d6-2560-4b89-9f25-80fcfab3bf70 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] [instance: d5f9c92e-4201-45f7-86f8-8b6e5764c3a6] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:33:15.597648 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a93b29d6-2560-4b89-9f25-80fcfab3bf70 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:33:15.598138 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a93b29d6-2560-4b89-9f25-80fcfab3bf70 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:33:15.598578 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a93b29d6-2560-4b89-9f25-80fcfab3bf70 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:33:15.599315 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a93b29d6-2560-4b89-9f25-80fcfab3bf70 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:33:15.599777 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a93b29d6-2560-4b89-9f25-80fcfab3bf70 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:33:15.600236 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a93b29d6-2560-4b89-9f25-80fcfab3bf70 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:33:15.736703 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-a93b29d6-2560-4b89-9f25-80fcfab3bf70 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac4eff18a664804af16cf21321f9290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9857e88402494e964f2099de5bb60c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:33:15.745255 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-a93b29d6-2560-4b89-9f25-80fcfab3bf70 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] 10.222.0.26 "GET /compute/v2.1/servers/d5f9c92e-4201-45f7-86f8-8b6e5764c3a6" status: 200 len: 1200 microversion: 2.1 time: 0.159433 Oct 08 21:33:15.745850 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3023/6119] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:33:15 2022] GET /compute/v2.1/servers/d5f9c92e-4201-45f7-86f8-8b6e5764c3a6 => generated 1200 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:33:16.768685 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-4d8c4070-a49a-4395-9fa0-be1d5867ebd8 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:33:16.769375 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-4d8c4070-a49a-4395-9fa0-be1d5867ebd8 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] [instance: d5f9c92e-4201-45f7-86f8-8b6e5764c3a6] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:33:16.776321 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4d8c4070-a49a-4395-9fa0-be1d5867ebd8 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:33:16.776814 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4d8c4070-a49a-4395-9fa0-be1d5867ebd8 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:33:16.777279 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4d8c4070-a49a-4395-9fa0-be1d5867ebd8 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:33:16.777983 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4d8c4070-a49a-4395-9fa0-be1d5867ebd8 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:33:16.778446 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4d8c4070-a49a-4395-9fa0-be1d5867ebd8 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:33:16.778877 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4d8c4070-a49a-4395-9fa0-be1d5867ebd8 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:33:16.907785 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-4d8c4070-a49a-4395-9fa0-be1d5867ebd8 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac4eff18a664804af16cf21321f9290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9857e88402494e964f2099de5bb60c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:33:16.915837 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-4d8c4070-a49a-4395-9fa0-be1d5867ebd8 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] 10.222.0.26 "GET /compute/v2.1/servers/d5f9c92e-4201-45f7-86f8-8b6e5764c3a6" status: 200 len: 1387 microversion: 2.1 time: 0.152346 Oct 08 21:33:16.916625 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3097/6120] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:33:16 2022] GET /compute/v2.1/servers/d5f9c92e-4201-45f7-86f8-8b6e5764c3a6 => generated 1387 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:33:16.938383 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-b33f3080-14cd-4f5c-adf2-6ad09dea209d tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:33:16.939008 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-b33f3080-14cd-4f5c-adf2-6ad09dea209d tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] [instance: d5f9c92e-4201-45f7-86f8-8b6e5764c3a6] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:33:16.946600 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b33f3080-14cd-4f5c-adf2-6ad09dea209d tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:33:16.947097 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b33f3080-14cd-4f5c-adf2-6ad09dea209d tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:33:16.947551 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b33f3080-14cd-4f5c-adf2-6ad09dea209d tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:33:16.948293 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b33f3080-14cd-4f5c-adf2-6ad09dea209d tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:33:16.948763 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b33f3080-14cd-4f5c-adf2-6ad09dea209d tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:33:16.949227 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b33f3080-14cd-4f5c-adf2-6ad09dea209d tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:33:17.079716 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-b33f3080-14cd-4f5c-adf2-6ad09dea209d tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac4eff18a664804af16cf21321f9290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9857e88402494e964f2099de5bb60c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:33:17.088283 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-b33f3080-14cd-4f5c-adf2-6ad09dea209d tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] 10.222.0.26 "GET /compute/v2.1/servers/d5f9c92e-4201-45f7-86f8-8b6e5764c3a6" status: 200 len: 1387 microversion: 2.1 time: 0.153770 Oct 08 21:33:17.088866 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3024/6121] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:33:16 2022] GET /compute/v2.1/servers/d5f9c92e-4201-45f7-86f8-8b6e5764c3a6 => generated 1387 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:33:17.110358 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-f9b49a68-8b22-489e-a31e-825807ccddf5 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:33:17.110982 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-f9b49a68-8b22-489e-a31e-825807ccddf5 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] [instance: d5f9c92e-4201-45f7-86f8-8b6e5764c3a6] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:33:17.117026 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f9b49a68-8b22-489e-a31e-825807ccddf5 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:33:17.117554 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f9b49a68-8b22-489e-a31e-825807ccddf5 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:33:17.118010 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f9b49a68-8b22-489e-a31e-825807ccddf5 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:33:17.118715 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f9b49a68-8b22-489e-a31e-825807ccddf5 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:33:17.119184 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f9b49a68-8b22-489e-a31e-825807ccddf5 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:33:17.119671 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f9b49a68-8b22-489e-a31e-825807ccddf5 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:33:17.247064 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-f9b49a68-8b22-489e-a31e-825807ccddf5 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac4eff18a664804af16cf21321f9290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9857e88402494e964f2099de5bb60c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:33:17.254978 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-f9b49a68-8b22-489e-a31e-825807ccddf5 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] 10.222.0.26 "GET /compute/v2.1/servers/d5f9c92e-4201-45f7-86f8-8b6e5764c3a6" status: 200 len: 1387 microversion: 2.1 time: 0.148456 Oct 08 21:33:17.255641 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3098/6122] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:33:17 2022] GET /compute/v2.1/servers/d5f9c92e-4201-45f7-86f8-8b6e5764c3a6 => generated 1387 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:33:17.333987 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-d68fb730-3ed1-4a48-b65e-9916c403b4b8 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:33:17.334496 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-d68fb730-3ed1-4a48-b65e-9916c403b4b8 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] [instance: d5f9c92e-4201-45f7-86f8-8b6e5764c3a6] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:33:17.341380 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d68fb730-3ed1-4a48-b65e-9916c403b4b8 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:33:17.341880 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d68fb730-3ed1-4a48-b65e-9916c403b4b8 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:33:17.342338 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d68fb730-3ed1-4a48-b65e-9916c403b4b8 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:33:17.343032 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d68fb730-3ed1-4a48-b65e-9916c403b4b8 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:33:17.343753 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d68fb730-3ed1-4a48-b65e-9916c403b4b8 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:33:17.344189 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d68fb730-3ed1-4a48-b65e-9916c403b4b8 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:33:17.368822 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-d68fb730-3ed1-4a48-b65e-9916c403b4b8 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] [instance: d5f9c92e-4201-45f7-86f8-8b6e5764c3a6] Going to try to terminate instance {{(pid=140491) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 21:33:17.445907 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-d68fb730-3ed1-4a48-b65e-9916c403b4b8 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] 10.222.0.26 "DELETE /compute/v2.1/servers/d5f9c92e-4201-45f7-86f8-8b6e5764c3a6" status: 204 len: 0 microversion: 2.1 time: 0.115184 Oct 08 21:33:17.447047 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3025/6123] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:33:17 2022] DELETE /compute/v2.1/servers/d5f9c92e-4201-45f7-86f8-8b6e5764c3a6 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 21:33:17.455287 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-814e7ca8-bace-41e8-95fc-80e607f3af77 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:33:17.455892 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-814e7ca8-bace-41e8-95fc-80e607f3af77 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] [instance: d5f9c92e-4201-45f7-86f8-8b6e5764c3a6] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:33:17.462596 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-814e7ca8-bace-41e8-95fc-80e607f3af77 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:33:17.463094 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-814e7ca8-bace-41e8-95fc-80e607f3af77 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:33:17.463538 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-814e7ca8-bace-41e8-95fc-80e607f3af77 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:33:17.464267 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-814e7ca8-bace-41e8-95fc-80e607f3af77 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:33:17.464728 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-814e7ca8-bace-41e8-95fc-80e607f3af77 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:33:17.465157 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-814e7ca8-bace-41e8-95fc-80e607f3af77 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:33:17.599617 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-814e7ca8-bace-41e8-95fc-80e607f3af77 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac4eff18a664804af16cf21321f9290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9857e88402494e964f2099de5bb60c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:33:17.607495 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-814e7ca8-bace-41e8-95fc-80e607f3af77 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] 10.222.0.26 "GET /compute/v2.1/servers/d5f9c92e-4201-45f7-86f8-8b6e5764c3a6" status: 200 len: 1393 microversion: 2.1 time: 0.156166 Oct 08 21:33:17.608069 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3099/6124] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:33:17 2022] GET /compute/v2.1/servers/d5f9c92e-4201-45f7-86f8-8b6e5764c3a6 => generated 1393 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:33:18.632651 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-74f08a53-d0df-48d4-a96c-5f9d2a7a72b8 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:33:18.633326 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-74f08a53-d0df-48d4-a96c-5f9d2a7a72b8 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] [instance: d5f9c92e-4201-45f7-86f8-8b6e5764c3a6] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:33:18.640375 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-74f08a53-d0df-48d4-a96c-5f9d2a7a72b8 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:33:18.640873 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-74f08a53-d0df-48d4-a96c-5f9d2a7a72b8 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:33:18.641352 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-74f08a53-d0df-48d4-a96c-5f9d2a7a72b8 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:33:18.642068 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-74f08a53-d0df-48d4-a96c-5f9d2a7a72b8 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:33:18.642538 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-74f08a53-d0df-48d4-a96c-5f9d2a7a72b8 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:33:18.642977 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-74f08a53-d0df-48d4-a96c-5f9d2a7a72b8 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:33:18.778330 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-74f08a53-d0df-48d4-a96c-5f9d2a7a72b8 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac4eff18a664804af16cf21321f9290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9857e88402494e964f2099de5bb60c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:33:18.786291 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-74f08a53-d0df-48d4-a96c-5f9d2a7a72b8 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] 10.222.0.26 "GET /compute/v2.1/servers/d5f9c92e-4201-45f7-86f8-8b6e5764c3a6" status: 200 len: 1393 microversion: 2.1 time: 0.158137 Oct 08 21:33:18.786883 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3026/6125] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:33:18 2022] GET /compute/v2.1/servers/d5f9c92e-4201-45f7-86f8-8b6e5764c3a6 => generated 1393 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:33:19.379958 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-e95fb244-bcf8-48f5-a27c-3842ee0fb9d1 req-555c08f5-bf24-4115-916f-92a7486b9140 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5f9c92e-4201-45f7-86f8-8b6e5764c3a6", "name": "network-vif-deleted", "tag": "83e6e5de-79c8-4030-8f5f-a0e0708767d6"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:33:19.392604 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-e95fb244-bcf8-48f5-a27c-3842ee0fb9d1 req-555c08f5-bf24-4115-916f-92a7486b9140 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:33:19.393085 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-e95fb244-bcf8-48f5-a27c-3842ee0fb9d1 req-555c08f5-bf24-4115-916f-92a7486b9140 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:33:19.393608 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-e95fb244-bcf8-48f5-a27c-3842ee0fb9d1 req-555c08f5-bf24-4115-916f-92a7486b9140 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:33:19.396699 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=81 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:33:19.408464 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-e95fb244-bcf8-48f5-a27c-3842ee0fb9d1 req-555c08f5-bf24-4115-916f-92a7486b9140 service nova] Creating event network-vif-deleted:83e6e5de-79c8-4030-8f5f-a0e0708767d6 for instance d5f9c92e-4201-45f7-86f8-8b6e5764c3a6 on nch2-master-1 Oct 08 21:33:19.414382 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-e95fb244-bcf8-48f5-a27c-3842ee0fb9d1 req-555c08f5-bf24-4115-916f-92a7486b9140 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038185 Oct 08 21:33:19.415260 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3100/6126] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:33:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:33:19.809533 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-1ed2c03d-69e6-425a-9247-2aacbda79de9 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:33:19.810818 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-1ed2c03d-69e6-425a-9247-2aacbda79de9 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] [instance: d5f9c92e-4201-45f7-86f8-8b6e5764c3a6] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:33:19.818177 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1ed2c03d-69e6-425a-9247-2aacbda79de9 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:33:19.818714 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1ed2c03d-69e6-425a-9247-2aacbda79de9 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:33:19.819701 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1ed2c03d-69e6-425a-9247-2aacbda79de9 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:33:19.820748 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1ed2c03d-69e6-425a-9247-2aacbda79de9 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:33:19.821302 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1ed2c03d-69e6-425a-9247-2aacbda79de9 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:33:19.821750 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1ed2c03d-69e6-425a-9247-2aacbda79de9 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:33:19.856859 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1ed2c03d-69e6-425a-9247-2aacbda79de9 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:33:19.857613 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1ed2c03d-69e6-425a-9247-2aacbda79de9 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:33:19.858293 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1ed2c03d-69e6-425a-9247-2aacbda79de9 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:33:19.858950 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.objects.instance [None req-1ed2c03d-69e6-425a-9247-2aacbda79de9 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lazy-loading 'fault' on Instance uuid d5f9c92e-4201-45f7-86f8-8b6e5764c3a6 {{(pid=140491) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 21:33:19.903241 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-1ed2c03d-69e6-425a-9247-2aacbda79de9 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac4eff18a664804af16cf21321f9290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9857e88402494e964f2099de5bb60c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:33:19.911400 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-1ed2c03d-69e6-425a-9247-2aacbda79de9 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] 10.222.0.26 "GET /compute/v2.1/servers/d5f9c92e-4201-45f7-86f8-8b6e5764c3a6" status: 200 len: 1190 microversion: 2.1 time: 0.106523 Oct 08 21:33:19.912079 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3027/6127] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:33:19 2022] GET /compute/v2.1/servers/d5f9c92e-4201-45f7-86f8-8b6e5764c3a6 => generated 1190 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:33:20.936807 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-6a9a1e29-d05e-4a6f-9af2-e71c409ed56d tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:33:20.937471 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-6a9a1e29-d05e-4a6f-9af2-e71c409ed56d tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] [instance: d5f9c92e-4201-45f7-86f8-8b6e5764c3a6] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:33:20.943785 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6a9a1e29-d05e-4a6f-9af2-e71c409ed56d tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:33:20.944952 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6a9a1e29-d05e-4a6f-9af2-e71c409ed56d tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:33:20.945431 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6a9a1e29-d05e-4a6f-9af2-e71c409ed56d tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:33:20.946141 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6a9a1e29-d05e-4a6f-9af2-e71c409ed56d tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:33:20.946607 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6a9a1e29-d05e-4a6f-9af2-e71c409ed56d tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:33:20.947043 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6a9a1e29-d05e-4a6f-9af2-e71c409ed56d tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:33:20.960371 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-6a9a1e29-d05e-4a6f-9af2-e71c409ed56d tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] HTTP exception thrown: Instance d5f9c92e-4201-45f7-86f8-8b6e5764c3a6 could not be found. Oct 08 21:33:20.962015 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-6a9a1e29-d05e-4a6f-9af2-e71c409ed56d tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Request method failure captured: Oct 08 21:33:20.962015 ncdv-master-1 devstack@n-api.service[140492]: request: GET /compute/v2.1/servers/d5f9c92e-4201-45f7-86f8-8b6e5764c3a6 HTTP/1.1 Oct 08 21:33:20.962015 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:33:20.962015 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:33:20.962015 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:33:20.962015 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 21:33:20.962015 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:33:20.962015 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:33:20.962015 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:33:20.962015 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:33:20.962015 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeyESueD2G2p08fpZng5dUIvJRbscky3tGNIT1dlSRltWQwygOyYfQAwVe7KLvB4NB9Rvs7JJ6Z3bstxj1FPhWmo56k4nFHZVnko_1G4tfE_I1T9paCtzZG8sfJM33h9PLTo7_TpIQ4aSXx-QLhm7_UAuDXZaIvpFH6pLdWcKYlBxWo Oct 08 21:33:20.962015 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:33:20.962015 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:33:20.962015 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:33:20.962015 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:33:20.962015 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:33:20.962015 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:33:20.962015 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 8d9857e88402494e964f2099de5bb60c Oct 08 21:33:20.962015 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-TestVolumeBootPattern-1770467933 Oct 08 21:33:20.962015 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:33:20.962015 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:33:20.962015 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8d9857e88402494e964f2099de5bb60c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8d9857e88402494e964f2099de5bb60c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8d9857e88402494e964f2099de5bb60c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8d9857e88402494e964f2099de5bb60c"}]}] Oct 08 21:33:20.962015 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-TestVolumeBootPattern-1770467933 Oct 08 21:33:20.962015 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 8d9857e88402494e964f2099de5bb60c Oct 08 21:33:20.962015 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-TestVolumeBootPattern-1770467933 Oct 08 21:33:20.962015 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-TestVolumeBootPattern-1770467933-project Oct 08 21:33:20.962015 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:33:20.962015 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:33:20.962015 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 7ac4eff18a664804af16cf21321f9290 Oct 08 21:33:20.962015 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-TestVolumeBootPattern-1770467933-project Oct 08 21:33:20.962015 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 21:33:20.962015 ncdv-master-1 devstack@n-api.service[140492]: exception: Instance d5f9c92e-4201-45f7-86f8-8b6e5764c3a6 could not be found. Oct 08 21:33:20.962015 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': 'd5f9c92e-4201-45f7-86f8-8b6e5764c3a6'} Oct 08 21:33:20.962015 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:33:20.962015 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:33:20.962015 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:33:20.962015 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:33:20.962015 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:33:20.962015 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:33:20.962015 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:33:20.962015 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:33:20.962015 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:33:20.962015 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:33:20.962015 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5f9c92e-4201-45f7-86f8-8b6e5764c3a6 could not be found. Oct 08 21:33:20.962015 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:33:20.962015 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:33:20.962015 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:33:20.962015 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:33:20.962015 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:33:20.962015 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:33:20.962015 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:33:20.962015 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:33:20.962015 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:33:20.962015 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:33:20.962015 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:33:20.962015 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:33:20.962015 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:33:20.962015 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:33:20.962015 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:33:20.962015 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:33:20.962015 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5f9c92e-4201-45f7-86f8-8b6e5764c3a6 could not be found. Oct 08 21:33:20.962015 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:33:20.962015 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:33:20.962015 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:33:20.966202 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:33:20.966202 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:33:20.966202 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:33:20.966202 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:33:20.966202 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:33:20.966202 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5f9c92e-4201-45f7-86f8-8b6e5764c3a6 could not be found. Oct 08 21:33:20.966202 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:33:20.966202 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-6a9a1e29-d05e-4a6f-9af2-e71c409ed56d tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Returning 404 to user: Instance d5f9c92e-4201-45f7-86f8-8b6e5764c3a6 could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:33:20.966202 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-6a9a1e29-d05e-4a6f-9af2-e71c409ed56d tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] 10.222.0.26 "GET /compute/v2.1/servers/d5f9c92e-4201-45f7-86f8-8b6e5764c3a6" status: 404 len: 111 microversion: 2.1 time: 0.031965 Oct 08 21:33:20.966202 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3101/6128] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:33:20 2022] GET /compute/v2.1/servers/d5f9c92e-4201-45f7-86f8-8b6e5764c3a6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:33:20.994881 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-ac8ceb9e-a491-4d08-bf3a-59e45186bc59 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:33:20.995392 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-ac8ceb9e-a491-4d08-bf3a-59e45186bc59 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] [instance: d5f9c92e-4201-45f7-86f8-8b6e5764c3a6] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:33:21.002272 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ac8ceb9e-a491-4d08-bf3a-59e45186bc59 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:33:21.002788 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ac8ceb9e-a491-4d08-bf3a-59e45186bc59 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:33:21.003238 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ac8ceb9e-a491-4d08-bf3a-59e45186bc59 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:33:21.003945 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ac8ceb9e-a491-4d08-bf3a-59e45186bc59 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:33:21.004413 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ac8ceb9e-a491-4d08-bf3a-59e45186bc59 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:33:21.004850 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ac8ceb9e-a491-4d08-bf3a-59e45186bc59 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:33:21.019105 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-ac8ceb9e-a491-4d08-bf3a-59e45186bc59 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] HTTP exception thrown: Instance d5f9c92e-4201-45f7-86f8-8b6e5764c3a6 could not be found. Oct 08 21:33:21.020780 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-ac8ceb9e-a491-4d08-bf3a-59e45186bc59 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Request method failure captured: Oct 08 21:33:21.020780 ncdv-master-1 devstack@n-api.service[140491]: request: DELETE /compute/v2.1/servers/d5f9c92e-4201-45f7-86f8-8b6e5764c3a6 HTTP/1.1 Oct 08 21:33:21.020780 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:33:21.020780 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:33:21.020780 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:33:21.020780 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 21:33:21.020780 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:33:21.020780 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:33:21.020780 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:33:21.020780 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:33:21.020780 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeyESueD2G2p08fpZng5dUIvJRbscky3tGNIT1dlSRltWQwygOyYfQAwVe7KLvB4NB9Rvs7JJ6Z3bstxj1FPhWmo56k4nFHZVnko_1G4tfE_I1T9paCtzZG8sfJM33h9PLTo7_TpIQ4aSXx-QLhm7_UAuDXZaIvpFH6pLdWcKYlBxWo Oct 08 21:33:21.020780 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:33:21.020780 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:33:21.020780 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:33:21.020780 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:33:21.020780 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:33:21.020780 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:33:21.020780 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 8d9857e88402494e964f2099de5bb60c Oct 08 21:33:21.020780 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-TestVolumeBootPattern-1770467933 Oct 08 21:33:21.020780 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:33:21.020780 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:33:21.020780 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8d9857e88402494e964f2099de5bb60c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8d9857e88402494e964f2099de5bb60c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8d9857e88402494e964f2099de5bb60c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8d9857e88402494e964f2099de5bb60c"}]}] Oct 08 21:33:21.020780 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-TestVolumeBootPattern-1770467933 Oct 08 21:33:21.020780 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 8d9857e88402494e964f2099de5bb60c Oct 08 21:33:21.020780 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-TestVolumeBootPattern-1770467933 Oct 08 21:33:21.020780 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-TestVolumeBootPattern-1770467933-project Oct 08 21:33:21.020780 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:33:21.020780 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:33:21.020780 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 7ac4eff18a664804af16cf21321f9290 Oct 08 21:33:21.020780 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-TestVolumeBootPattern-1770467933-project Oct 08 21:33:21.020780 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:33:21.020780 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance d5f9c92e-4201-45f7-86f8-8b6e5764c3a6 could not be found. Oct 08 21:33:21.020780 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': 'd5f9c92e-4201-45f7-86f8-8b6e5764c3a6'} Oct 08 21:33:21.020780 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:33:21.020780 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:33:21.020780 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:33:21.020780 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:33:21.020780 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:33:21.020780 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:33:21.020780 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:33:21.020780 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:33:21.020780 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:33:21.020780 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:33:21.020780 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5f9c92e-4201-45f7-86f8-8b6e5764c3a6 could not be found. Oct 08 21:33:21.020780 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:33:21.020780 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:33:21.020780 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:33:21.020780 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:33:21.020780 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:33:21.020780 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:33:21.020780 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:33:21.020780 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:33:21.020780 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:33:21.020780 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:33:21.020780 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 08 21:33:21.020780 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 08 21:33:21.020780 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 08 21:33:21.020780 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 08 21:33:21.020780 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:33:21.020780 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:33:21.020780 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:33:21.020780 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:33:21.025062 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5f9c92e-4201-45f7-86f8-8b6e5764c3a6 could not be found. Oct 08 21:33:21.025062 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:33:21.025062 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:33:21.025062 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:33:21.025062 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:33:21.025062 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:33:21.025062 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:33:21.025062 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:33:21.025062 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:33:21.025062 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5f9c92e-4201-45f7-86f8-8b6e5764c3a6 could not be found. Oct 08 21:33:21.025062 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:33:21.025062 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-ac8ceb9e-a491-4d08-bf3a-59e45186bc59 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Returning 404 to user: Instance d5f9c92e-4201-45f7-86f8-8b6e5764c3a6 could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:33:21.025062 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-ac8ceb9e-a491-4d08-bf3a-59e45186bc59 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] 10.222.0.26 "DELETE /compute/v2.1/servers/d5f9c92e-4201-45f7-86f8-8b6e5764c3a6" status: 404 len: 111 microversion: 2.1 time: 0.031870 Oct 08 21:33:21.025062 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3028/6129] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:33:20 2022] DELETE /compute/v2.1/servers/d5f9c92e-4201-45f7-86f8-8b6e5764c3a6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:33:21.030928 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-f534a55d-4012-492f-bb71-cc05aa5850f5 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:33:21.031550 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-f534a55d-4012-492f-bb71-cc05aa5850f5 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] [instance: d5f9c92e-4201-45f7-86f8-8b6e5764c3a6] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:33:21.038252 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f534a55d-4012-492f-bb71-cc05aa5850f5 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:33:21.038742 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f534a55d-4012-492f-bb71-cc05aa5850f5 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:33:21.039187 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f534a55d-4012-492f-bb71-cc05aa5850f5 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:33:21.039891 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f534a55d-4012-492f-bb71-cc05aa5850f5 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:33:21.040355 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f534a55d-4012-492f-bb71-cc05aa5850f5 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:33:21.040792 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f534a55d-4012-492f-bb71-cc05aa5850f5 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:33:21.057693 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-f534a55d-4012-492f-bb71-cc05aa5850f5 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] HTTP exception thrown: Instance d5f9c92e-4201-45f7-86f8-8b6e5764c3a6 could not be found. Oct 08 21:33:21.059231 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-f534a55d-4012-492f-bb71-cc05aa5850f5 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Request method failure captured: Oct 08 21:33:21.059231 ncdv-master-1 devstack@n-api.service[140492]: request: GET /compute/v2.1/servers/d5f9c92e-4201-45f7-86f8-8b6e5764c3a6 HTTP/1.1 Oct 08 21:33:21.059231 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:33:21.059231 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:33:21.059231 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:33:21.059231 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 21:33:21.059231 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:33:21.059231 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:33:21.059231 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:33:21.059231 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:33:21.059231 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeyESueD2G2p08fpZng5dUIvJRbscky3tGNIT1dlSRltWQwygOyYfQAwVe7KLvB4NB9Rvs7JJ6Z3bstxj1FPhWmo56k4nFHZVnko_1G4tfE_I1T9paCtzZG8sfJM33h9PLTo7_TpIQ4aSXx-QLhm7_UAuDXZaIvpFH6pLdWcKYlBxWo Oct 08 21:33:21.059231 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:33:21.059231 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:33:21.059231 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:33:21.059231 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:33:21.059231 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:33:21.059231 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:33:21.059231 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 8d9857e88402494e964f2099de5bb60c Oct 08 21:33:21.059231 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-TestVolumeBootPattern-1770467933 Oct 08 21:33:21.059231 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:33:21.059231 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:33:21.059231 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8d9857e88402494e964f2099de5bb60c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8d9857e88402494e964f2099de5bb60c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8d9857e88402494e964f2099de5bb60c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8d9857e88402494e964f2099de5bb60c"}]}] Oct 08 21:33:21.059231 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-TestVolumeBootPattern-1770467933 Oct 08 21:33:21.059231 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 8d9857e88402494e964f2099de5bb60c Oct 08 21:33:21.059231 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-TestVolumeBootPattern-1770467933 Oct 08 21:33:21.059231 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-TestVolumeBootPattern-1770467933-project Oct 08 21:33:21.059231 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:33:21.059231 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:33:21.059231 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 7ac4eff18a664804af16cf21321f9290 Oct 08 21:33:21.059231 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-TestVolumeBootPattern-1770467933-project Oct 08 21:33:21.059231 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 21:33:21.059231 ncdv-master-1 devstack@n-api.service[140492]: exception: Instance d5f9c92e-4201-45f7-86f8-8b6e5764c3a6 could not be found. Oct 08 21:33:21.059231 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': 'd5f9c92e-4201-45f7-86f8-8b6e5764c3a6'} Oct 08 21:33:21.059231 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:33:21.059231 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:33:21.059231 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:33:21.059231 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:33:21.059231 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:33:21.059231 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:33:21.059231 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:33:21.059231 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:33:21.059231 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:33:21.059231 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:33:21.059231 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5f9c92e-4201-45f7-86f8-8b6e5764c3a6 could not be found. Oct 08 21:33:21.059231 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:33:21.059231 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:33:21.059231 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:33:21.059231 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:33:21.059231 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:33:21.059231 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:33:21.059231 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:33:21.059231 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:33:21.059231 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:33:21.059231 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:33:21.059231 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:33:21.059231 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:33:21.059231 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:33:21.059231 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:33:21.059231 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:33:21.059231 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:33:21.059231 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5f9c92e-4201-45f7-86f8-8b6e5764c3a6 could not be found. Oct 08 21:33:21.059231 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:33:21.059231 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:33:21.059231 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:33:21.063195 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:33:21.063195 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:33:21.063195 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:33:21.063195 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:33:21.063195 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:33:21.063195 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5f9c92e-4201-45f7-86f8-8b6e5764c3a6 could not be found. Oct 08 21:33:21.063195 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:33:21.063195 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-f534a55d-4012-492f-bb71-cc05aa5850f5 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Returning 404 to user: Instance d5f9c92e-4201-45f7-86f8-8b6e5764c3a6 could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:33:21.063195 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-f534a55d-4012-492f-bb71-cc05aa5850f5 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] 10.222.0.26 "GET /compute/v2.1/servers/d5f9c92e-4201-45f7-86f8-8b6e5764c3a6" status: 404 len: 111 microversion: 2.1 time: 0.033576 Oct 08 21:33:21.063195 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3102/6130] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:33:21 2022] GET /compute/v2.1/servers/d5f9c92e-4201-45f7-86f8-8b6e5764c3a6 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 08 21:33:24.891156 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c7547d2c-2403-4590-9be8-81e725d5e470 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-1486841364", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "40d2e48f-3ae3-4ed6-8694-d04a58635bfb", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "4d64b136-ce87-445f-a822-d4ba1b8b55a2"}]}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:33:24.953827 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.network.neutron [None req-c7547d2c-2403-4590-9be8-81e725d5e470 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] validate_networks() for [('4d64b136-ce87-445f-a822-d4ba1b8b55a2', None, None, None, None, None)] {{(pid=140491) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 21:33:25.315939 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-c7547d2c-2403-4590-9be8-81e725d5e470 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Flavor limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 21:33:25.316385 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-c7547d2c-2403-4590-9be8-81e725d5e470 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Image limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 21:33:25.316863 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-c7547d2c-2403-4590-9be8-81e725d5e470 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Flavor pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 21:33:25.317315 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-c7547d2c-2403-4590-9be8-81e725d5e470 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Image pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 21:33:25.317735 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-c7547d2c-2403-4590-9be8-81e725d5e470 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 21:33:25.326751 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c7547d2c-2403-4590-9be8-81e725d5e470 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:33:25.327246 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c7547d2c-2403-4590-9be8-81e725d5e470 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:33:25.327956 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c7547d2c-2403-4590-9be8-81e725d5e470 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:33:25.328789 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c7547d2c-2403-4590-9be8-81e725d5e470 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:33:25.329321 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c7547d2c-2403-4590-9be8-81e725d5e470 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:33:25.329808 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c7547d2c-2403-4590-9be8-81e725d5e470 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:33:25.348541 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-c7547d2c-2403-4590-9be8-81e725d5e470 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Getting quotas for project 8d9857e88402494e964f2099de5bb60c. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:33:25.355027 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-c7547d2c-2403-4590-9be8-81e725d5e470 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Getting quotas for user 7ac4eff18a664804af16cf21321f9290 and project 8d9857e88402494e964f2099de5bb60c. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:33:25.415458 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-c7547d2c-2403-4590-9be8-81e725d5e470 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Going to run 1 instances... {{(pid=140491) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 21:33:25.417813 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-c7547d2c-2403-4590-9be8-81e725d5e470 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] [instance: 49141073-10f4-42fb-8fa5-1d8c8eca6d2e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='40d2e48f-3ae3-4ed6-8694-d04a58635bfb',volume_size=None,volume_type=None)] {{(pid=140491) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 21:33:25.550789 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-c7547d2c-2403-4590-9be8-81e725d5e470 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.663568 Oct 08 21:33:25.551435 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3029/6131] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 21:33:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 665 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 08 21:33:25.562931 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-bac1ab3c-1705-4abe-ba68-6088ec356193 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:33:25.563694 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-bac1ab3c-1705-4abe-ba68-6088ec356193 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] [instance: 49141073-10f4-42fb-8fa5-1d8c8eca6d2e] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:33:25.624639 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-bac1ab3c-1705-4abe-ba68-6088ec356193 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac4eff18a664804af16cf21321f9290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9857e88402494e964f2099de5bb60c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:33:25.633428 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-bac1ab3c-1705-4abe-ba68-6088ec356193 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] 10.222.0.26 "GET /compute/v2.1/servers/49141073-10f4-42fb-8fa5-1d8c8eca6d2e" status: 200 len: 1071 microversion: 2.1 time: 0.073816 Oct 08 21:33:25.634029 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3103/6132] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:33:25 2022] GET /compute/v2.1/servers/49141073-10f4-42fb-8fa5-1d8c8eca6d2e => generated 1071 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:33:26.656899 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-e3c71246-2207-43e4-b142-7620d7a2955c tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:33:26.657556 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-e3c71246-2207-43e4-b142-7620d7a2955c tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] [instance: 49141073-10f4-42fb-8fa5-1d8c8eca6d2e] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:33:26.664958 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e3c71246-2207-43e4-b142-7620d7a2955c tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:33:26.665491 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e3c71246-2207-43e4-b142-7620d7a2955c tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:33:26.665959 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e3c71246-2207-43e4-b142-7620d7a2955c tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:33:26.666709 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e3c71246-2207-43e4-b142-7620d7a2955c tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:33:26.667615 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e3c71246-2207-43e4-b142-7620d7a2955c tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:33:26.668059 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e3c71246-2207-43e4-b142-7620d7a2955c tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:33:26.744063 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-e3c71246-2207-43e4-b142-7620d7a2955c tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac4eff18a664804af16cf21321f9290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9857e88402494e964f2099de5bb60c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:33:26.752848 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-e3c71246-2207-43e4-b142-7620d7a2955c tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] 10.222.0.26 "GET /compute/v2.1/servers/49141073-10f4-42fb-8fa5-1d8c8eca6d2e" status: 200 len: 1187 microversion: 2.1 time: 0.100923 Oct 08 21:33:26.754063 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3030/6133] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:33:26 2022] GET /compute/v2.1/servers/49141073-10f4-42fb-8fa5-1d8c8eca6d2e => generated 1187 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:33:27.777631 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-55ced17f-368e-42f7-b919-ca4884b5e9aa tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:33:27.778401 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-55ced17f-368e-42f7-b919-ca4884b5e9aa tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] [instance: 49141073-10f4-42fb-8fa5-1d8c8eca6d2e] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:33:27.787842 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-55ced17f-368e-42f7-b919-ca4884b5e9aa tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:33:27.788752 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-55ced17f-368e-42f7-b919-ca4884b5e9aa tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:33:27.789563 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-55ced17f-368e-42f7-b919-ca4884b5e9aa tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:33:27.790468 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-55ced17f-368e-42f7-b919-ca4884b5e9aa tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:33:27.791094 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-55ced17f-368e-42f7-b919-ca4884b5e9aa tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:33:27.791672 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-55ced17f-368e-42f7-b919-ca4884b5e9aa tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:33:28.004459 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-55ced17f-368e-42f7-b919-ca4884b5e9aa tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac4eff18a664804af16cf21321f9290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9857e88402494e964f2099de5bb60c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:33:28.013867 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-55ced17f-368e-42f7-b919-ca4884b5e9aa tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] 10.222.0.26 "GET /compute/v2.1/servers/49141073-10f4-42fb-8fa5-1d8c8eca6d2e" status: 200 len: 1229 microversion: 2.1 time: 0.241606 Oct 08 21:33:28.014454 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3104/6134] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:33:27 2022] GET /compute/v2.1/servers/49141073-10f4-42fb-8fa5-1d8c8eca6d2e => generated 1229 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:33:28.094146 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-d885368c-b3fd-4968-bb06-102a9c5b8254 req-bd6e5a71-d1a7-44a5-9c58-7a290b77676e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49141073-10f4-42fb-8fa5-1d8c8eca6d2e", "tag": "a594cece-e4f9-4d3f-ac43-adca4ac3762d"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:33:28.110960 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-d885368c-b3fd-4968-bb06-102a9c5b8254 req-bd6e5a71-d1a7-44a5-9c58-7a290b77676e service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:33:28.111846 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-d885368c-b3fd-4968-bb06-102a9c5b8254 req-bd6e5a71-d1a7-44a5-9c58-7a290b77676e service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:33:28.112339 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-d885368c-b3fd-4968-bb06-102a9c5b8254 req-bd6e5a71-d1a7-44a5-9c58-7a290b77676e service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:33:28.118561 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:33:28.127482 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-d885368c-b3fd-4968-bb06-102a9c5b8254 req-bd6e5a71-d1a7-44a5-9c58-7a290b77676e service nova] Creating event network-changed:a594cece-e4f9-4d3f-ac43-adca4ac3762d for instance 49141073-10f4-42fb-8fa5-1d8c8eca6d2e on nch2-master-1 Oct 08 21:33:28.133620 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-d885368c-b3fd-4968-bb06-102a9c5b8254 req-bd6e5a71-d1a7-44a5-9c58-7a290b77676e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045148 Oct 08 21:33:28.134496 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3031/6135] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:33:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 08 21:33:29.037953 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-db31da7e-2277-42a6-9d8b-71b967bb9483 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:33:29.038483 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-db31da7e-2277-42a6-9d8b-71b967bb9483 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] [instance: 49141073-10f4-42fb-8fa5-1d8c8eca6d2e] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:33:29.046201 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-db31da7e-2277-42a6-9d8b-71b967bb9483 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:33:29.046708 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-db31da7e-2277-42a6-9d8b-71b967bb9483 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:33:29.047163 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-db31da7e-2277-42a6-9d8b-71b967bb9483 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:33:29.048091 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-db31da7e-2277-42a6-9d8b-71b967bb9483 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:33:29.048463 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-db31da7e-2277-42a6-9d8b-71b967bb9483 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:33:29.048949 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-db31da7e-2277-42a6-9d8b-71b967bb9483 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:33:29.194510 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-db31da7e-2277-42a6-9d8b-71b967bb9483 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac4eff18a664804af16cf21321f9290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9857e88402494e964f2099de5bb60c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:33:29.204576 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-db31da7e-2277-42a6-9d8b-71b967bb9483 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] 10.222.0.26 "GET /compute/v2.1/servers/49141073-10f4-42fb-8fa5-1d8c8eca6d2e" status: 200 len: 1217 microversion: 2.1 time: 0.170354 Oct 08 21:33:29.205671 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3105/6136] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:33:29 2022] GET /compute/v2.1/servers/49141073-10f4-42fb-8fa5-1d8c8eca6d2e => generated 1217 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:33:30.233245 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-3ef836ab-9278-44c5-a133-8d7fa67781d9 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:33:30.233873 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-3ef836ab-9278-44c5-a133-8d7fa67781d9 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] [instance: 49141073-10f4-42fb-8fa5-1d8c8eca6d2e] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:33:30.240995 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3ef836ab-9278-44c5-a133-8d7fa67781d9 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:33:30.241527 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3ef836ab-9278-44c5-a133-8d7fa67781d9 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:33:30.241975 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3ef836ab-9278-44c5-a133-8d7fa67781d9 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:33:30.242681 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3ef836ab-9278-44c5-a133-8d7fa67781d9 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:33:30.243145 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3ef836ab-9278-44c5-a133-8d7fa67781d9 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:33:30.243583 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3ef836ab-9278-44c5-a133-8d7fa67781d9 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:33:30.372311 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-3ef836ab-9278-44c5-a133-8d7fa67781d9 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac4eff18a664804af16cf21321f9290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9857e88402494e964f2099de5bb60c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:33:30.380216 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-3ef836ab-9278-44c5-a133-8d7fa67781d9 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] 10.222.0.26 "GET /compute/v2.1/servers/49141073-10f4-42fb-8fa5-1d8c8eca6d2e" status: 200 len: 1217 microversion: 2.1 time: 0.152652 Oct 08 21:33:30.380803 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3032/6137] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:33:30 2022] GET /compute/v2.1/servers/49141073-10f4-42fb-8fa5-1d8c8eca6d2e => generated 1217 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:33:31.404191 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-0a4ac100-f9e2-41f0-9b13-c34f4feca03d tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:33:31.404817 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-0a4ac100-f9e2-41f0-9b13-c34f4feca03d tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] [instance: 49141073-10f4-42fb-8fa5-1d8c8eca6d2e] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:33:31.411846 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0a4ac100-f9e2-41f0-9b13-c34f4feca03d tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:33:31.412344 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0a4ac100-f9e2-41f0-9b13-c34f4feca03d tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:33:31.412799 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0a4ac100-f9e2-41f0-9b13-c34f4feca03d tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:33:31.414113 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0a4ac100-f9e2-41f0-9b13-c34f4feca03d tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:33:31.414585 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0a4ac100-f9e2-41f0-9b13-c34f4feca03d tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:33:31.415028 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0a4ac100-f9e2-41f0-9b13-c34f4feca03d tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:33:31.548365 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-0a4ac100-f9e2-41f0-9b13-c34f4feca03d tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac4eff18a664804af16cf21321f9290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9857e88402494e964f2099de5bb60c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:33:31.556213 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-0a4ac100-f9e2-41f0-9b13-c34f4feca03d tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] 10.222.0.26 "GET /compute/v2.1/servers/49141073-10f4-42fb-8fa5-1d8c8eca6d2e" status: 200 len: 1217 microversion: 2.1 time: 0.156275 Oct 08 21:33:31.556796 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3106/6138] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:33:31 2022] GET /compute/v2.1/servers/49141073-10f4-42fb-8fa5-1d8c8eca6d2e => generated 1217 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:33:32.579564 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-a5cd72b6-d6e1-401e-bcf4-a82c552b73de tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:33:32.580231 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-a5cd72b6-d6e1-401e-bcf4-a82c552b73de tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] [instance: 49141073-10f4-42fb-8fa5-1d8c8eca6d2e] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:33:32.582553 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:33:32.589408 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a5cd72b6-d6e1-401e-bcf4-a82c552b73de tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:33:32.589953 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a5cd72b6-d6e1-401e-bcf4-a82c552b73de tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:33:32.590348 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a5cd72b6-d6e1-401e-bcf4-a82c552b73de tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:33:32.591103 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a5cd72b6-d6e1-401e-bcf4-a82c552b73de tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:33:32.591671 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a5cd72b6-d6e1-401e-bcf4-a82c552b73de tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:33:32.592106 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a5cd72b6-d6e1-401e-bcf4-a82c552b73de tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:33:32.733550 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-a5cd72b6-d6e1-401e-bcf4-a82c552b73de tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac4eff18a664804af16cf21321f9290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9857e88402494e964f2099de5bb60c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:33:32.742817 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-a5cd72b6-d6e1-401e-bcf4-a82c552b73de tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] 10.222.0.26 "GET /compute/v2.1/servers/49141073-10f4-42fb-8fa5-1d8c8eca6d2e" status: 200 len: 1217 microversion: 2.1 time: 0.167127 Oct 08 21:33:32.743391 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3033/6139] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:33:32 2022] GET /compute/v2.1/servers/49141073-10f4-42fb-8fa5-1d8c8eca6d2e => generated 1217 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:33:33.766989 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-691adecd-962a-4491-a263-27892d21d3b6 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:33:33.768331 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-691adecd-962a-4491-a263-27892d21d3b6 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] [instance: 49141073-10f4-42fb-8fa5-1d8c8eca6d2e] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:33:33.771356 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=38 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:33:33.778344 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-691adecd-962a-4491-a263-27892d21d3b6 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:33:33.778851 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-691adecd-962a-4491-a263-27892d21d3b6 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:33:33.779305 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-691adecd-962a-4491-a263-27892d21d3b6 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:33:33.780027 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-691adecd-962a-4491-a263-27892d21d3b6 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:33:33.780495 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-691adecd-962a-4491-a263-27892d21d3b6 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:33:33.780930 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-691adecd-962a-4491-a263-27892d21d3b6 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:33:33.922215 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-691adecd-962a-4491-a263-27892d21d3b6 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac4eff18a664804af16cf21321f9290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9857e88402494e964f2099de5bb60c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:33:33.930440 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-691adecd-962a-4491-a263-27892d21d3b6 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] 10.222.0.26 "GET /compute/v2.1/servers/49141073-10f4-42fb-8fa5-1d8c8eca6d2e" status: 200 len: 1217 microversion: 2.1 time: 0.167872 Oct 08 21:33:33.931021 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3107/6140] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:33:33 2022] GET /compute/v2.1/servers/49141073-10f4-42fb-8fa5-1d8c8eca6d2e => generated 1217 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:33:34.954760 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-5113fc2a-c1a1-403d-a354-b326785d2880 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:33:34.955494 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-5113fc2a-c1a1-403d-a354-b326785d2880 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] [instance: 49141073-10f4-42fb-8fa5-1d8c8eca6d2e] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:33:34.963310 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5113fc2a-c1a1-403d-a354-b326785d2880 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:33:34.963816 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5113fc2a-c1a1-403d-a354-b326785d2880 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:33:34.964307 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5113fc2a-c1a1-403d-a354-b326785d2880 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:33:34.965098 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5113fc2a-c1a1-403d-a354-b326785d2880 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:33:34.965665 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5113fc2a-c1a1-403d-a354-b326785d2880 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:33:34.966158 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5113fc2a-c1a1-403d-a354-b326785d2880 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:33:35.106051 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-5113fc2a-c1a1-403d-a354-b326785d2880 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac4eff18a664804af16cf21321f9290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9857e88402494e964f2099de5bb60c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:33:35.114570 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-5113fc2a-c1a1-403d-a354-b326785d2880 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] 10.222.0.26 "GET /compute/v2.1/servers/49141073-10f4-42fb-8fa5-1d8c8eca6d2e" status: 200 len: 1217 microversion: 2.1 time: 0.164150 Oct 08 21:33:35.115132 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3034/6141] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:33:34 2022] GET /compute/v2.1/servers/49141073-10f4-42fb-8fa5-1d8c8eca6d2e => generated 1217 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:33:35.513285 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-aca704c1-198b-4322-8f01-528442055840 req-382d7a2d-25c8-4f7c-a278-dab0e647d2a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49141073-10f4-42fb-8fa5-1d8c8eca6d2e", "name": "network-vif-plugged", "status": "completed", "tag": "a594cece-e4f9-4d3f-ac43-adca4ac3762d"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:33:35.525651 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-aca704c1-198b-4322-8f01-528442055840 req-382d7a2d-25c8-4f7c-a278-dab0e647d2a6 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:33:35.526391 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-aca704c1-198b-4322-8f01-528442055840 req-382d7a2d-25c8-4f7c-a278-dab0e647d2a6 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:33:35.527014 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-aca704c1-198b-4322-8f01-528442055840 req-382d7a2d-25c8-4f7c-a278-dab0e647d2a6 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:33:35.540837 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-aca704c1-198b-4322-8f01-528442055840 req-382d7a2d-25c8-4f7c-a278-dab0e647d2a6 service nova] Creating event network-vif-plugged:a594cece-e4f9-4d3f-ac43-adca4ac3762d for instance 49141073-10f4-42fb-8fa5-1d8c8eca6d2e on nch2-master-1 Oct 08 21:33:35.546034 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-aca704c1-198b-4322-8f01-528442055840 req-382d7a2d-25c8-4f7c-a278-dab0e647d2a6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037860 Oct 08 21:33:35.546683 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3108/6142] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:33:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:33:36.141887 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-4969152e-ba7a-417b-8bad-4ec0cffd2834 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:33:36.142935 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-4969152e-ba7a-417b-8bad-4ec0cffd2834 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] [instance: 49141073-10f4-42fb-8fa5-1d8c8eca6d2e] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:33:36.145058 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=2 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:33:36.145934 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=6 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:33:36.153642 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4969152e-ba7a-417b-8bad-4ec0cffd2834 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:33:36.154139 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4969152e-ba7a-417b-8bad-4ec0cffd2834 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:33:36.154585 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4969152e-ba7a-417b-8bad-4ec0cffd2834 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:33:36.155291 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4969152e-ba7a-417b-8bad-4ec0cffd2834 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:33:36.155760 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4969152e-ba7a-417b-8bad-4ec0cffd2834 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:33:36.156194 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4969152e-ba7a-417b-8bad-4ec0cffd2834 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:33:36.298732 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-4969152e-ba7a-417b-8bad-4ec0cffd2834 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac4eff18a664804af16cf21321f9290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9857e88402494e964f2099de5bb60c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:33:36.308102 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-4969152e-ba7a-417b-8bad-4ec0cffd2834 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] 10.222.0.26 "GET /compute/v2.1/servers/49141073-10f4-42fb-8fa5-1d8c8eca6d2e" status: 200 len: 1217 microversion: 2.1 time: 0.170682 Oct 08 21:33:36.308982 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3035/6143] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:33:36 2022] GET /compute/v2.1/servers/49141073-10f4-42fb-8fa5-1d8c8eca6d2e => generated 1217 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:33:37.329369 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=2 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:33:37.335927 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-a33d19b4-72cb-4cda-83d5-ca0cc1ea466c tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:33:37.336722 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-a33d19b4-72cb-4cda-83d5-ca0cc1ea466c tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] [instance: 49141073-10f4-42fb-8fa5-1d8c8eca6d2e] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:33:37.345021 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a33d19b4-72cb-4cda-83d5-ca0cc1ea466c tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:33:37.345459 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a33d19b4-72cb-4cda-83d5-ca0cc1ea466c tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:33:37.345975 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a33d19b4-72cb-4cda-83d5-ca0cc1ea466c tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:33:37.347484 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a33d19b4-72cb-4cda-83d5-ca0cc1ea466c tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:33:37.348037 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a33d19b4-72cb-4cda-83d5-ca0cc1ea466c tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:33:37.348489 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a33d19b4-72cb-4cda-83d5-ca0cc1ea466c tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:33:37.488695 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-a33d19b4-72cb-4cda-83d5-ca0cc1ea466c tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac4eff18a664804af16cf21321f9290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9857e88402494e964f2099de5bb60c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:33:37.498035 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-a33d19b4-72cb-4cda-83d5-ca0cc1ea466c tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] 10.222.0.26 "GET /compute/v2.1/servers/49141073-10f4-42fb-8fa5-1d8c8eca6d2e" status: 200 len: 1404 microversion: 2.1 time: 0.169782 Oct 08 21:33:37.498616 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3109/6144] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:33:37 2022] GET /compute/v2.1/servers/49141073-10f4-42fb-8fa5-1d8c8eca6d2e => generated 1404 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:33:37.521501 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-585a69db-c6a8-45ba-a1f7-d56f4582199e tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:33:37.522200 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-585a69db-c6a8-45ba-a1f7-d56f4582199e tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] [instance: 49141073-10f4-42fb-8fa5-1d8c8eca6d2e] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:33:37.530151 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-585a69db-c6a8-45ba-a1f7-d56f4582199e tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:33:37.530729 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-585a69db-c6a8-45ba-a1f7-d56f4582199e tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:33:37.531201 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-585a69db-c6a8-45ba-a1f7-d56f4582199e tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:33:37.532152 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-585a69db-c6a8-45ba-a1f7-d56f4582199e tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:33:37.532706 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-585a69db-c6a8-45ba-a1f7-d56f4582199e tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:33:37.533164 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-585a69db-c6a8-45ba-a1f7-d56f4582199e tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:33:37.674028 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-585a69db-c6a8-45ba-a1f7-d56f4582199e tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac4eff18a664804af16cf21321f9290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9857e88402494e964f2099de5bb60c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:33:37.684508 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-585a69db-c6a8-45ba-a1f7-d56f4582199e tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] 10.222.0.26 "GET /compute/v2.1/servers/49141073-10f4-42fb-8fa5-1d8c8eca6d2e" status: 200 len: 1404 microversion: 2.1 time: 0.166923 Oct 08 21:33:37.685091 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3036/6145] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:33:37 2022] GET /compute/v2.1/servers/49141073-10f4-42fb-8fa5-1d8c8eca6d2e => generated 1404 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:33:37.706775 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-a99a4e3c-a5cb-49e1-91d7-aac263509561 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-812530411"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:33:37.709088 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-a99a4e3c-a5cb-49e1-91d7-aac263509561 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] [instance: 49141073-10f4-42fb-8fa5-1d8c8eca6d2e] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:33:37.715528 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a99a4e3c-a5cb-49e1-91d7-aac263509561 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:33:37.716020 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a99a4e3c-a5cb-49e1-91d7-aac263509561 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:33:37.716467 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a99a4e3c-a5cb-49e1-91d7-aac263509561 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:33:37.717484 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a99a4e3c-a5cb-49e1-91d7-aac263509561 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:33:37.717952 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a99a4e3c-a5cb-49e1-91d7-aac263509561 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:33:37.718389 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a99a4e3c-a5cb-49e1-91d7-aac263509561 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:33:37.816027 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.compute.api [None req-a99a4e3c-a5cb-49e1-91d7-aac263509561 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] [instance: 49141073-10f4-42fb-8fa5-1d8c8eca6d2e] Attempting to quiesce instance before volume snapshot. Oct 08 21:33:37.832978 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.compute.api [None req-a99a4e3c-a5cb-49e1-91d7-aac263509561 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] [instance: 49141073-10f4-42fb-8fa5-1d8c8eca6d2e] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Oct 08 21:33:37.908926 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-a99a4e3c-a5cb-49e1-91d7-aac263509561 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] [instance: 49141073-10f4-42fb-8fa5-1d8c8eca6d2e] Creating snapshot from volume 40d2e48f-3ae3-4ed6-8694-d04a58635bfb. {{(pid=140492) snapshot_instance /opt/stack/nova/nova/compute/api.py:3509}} Oct 08 21:33:38.826132 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-a99a4e3c-a5cb-49e1-91d7-aac263509561 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] 10.222.0.26 "POST /compute/v2.1/servers/49141073-10f4-42fb-8fa5-1d8c8eca6d2e/action" status: 202 len: 0 microversion: 2.1 time: 1.123210 Oct 08 21:33:38.826833 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3110/6146] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:33:37 2022] POST /compute/v2.1/servers/49141073-10f4-42fb-8fa5-1d8c8eca6d2e/action => generated 0 bytes in 1125 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 08 21:33:39.978616 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-10f46d91-5000-478a-8b3b-e8d13a31ac5a tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-917977767", "imageRef": "db8798cc-0acd-48da-9aef-aa8925debe0f", "flavorRef": "452", "networks": [{"uuid": "4d64b136-ce87-445f-a822-d4ba1b8b55a2"}]}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:33:40.036072 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.network.neutron [None req-10f46d91-5000-478a-8b3b-e8d13a31ac5a tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] validate_networks() for [('4d64b136-ce87-445f-a822-d4ba1b8b55a2', None, None, None, None, None)] {{(pid=140491) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 21:33:40.736361 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-10f46d91-5000-478a-8b3b-e8d13a31ac5a tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Flavor limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 21:33:40.736796 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-10f46d91-5000-478a-8b3b-e8d13a31ac5a tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Image limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 21:33:40.737324 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-10f46d91-5000-478a-8b3b-e8d13a31ac5a tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Flavor pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 21:33:40.737744 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-10f46d91-5000-478a-8b3b-e8d13a31ac5a tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Image pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 21:33:40.738189 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-10f46d91-5000-478a-8b3b-e8d13a31ac5a tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 21:33:40.747304 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-10f46d91-5000-478a-8b3b-e8d13a31ac5a tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:33:40.747796 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-10f46d91-5000-478a-8b3b-e8d13a31ac5a tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:33:40.748245 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-10f46d91-5000-478a-8b3b-e8d13a31ac5a tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:33:40.748994 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-10f46d91-5000-478a-8b3b-e8d13a31ac5a tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:33:40.751460 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-10f46d91-5000-478a-8b3b-e8d13a31ac5a tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:33:40.751460 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-10f46d91-5000-478a-8b3b-e8d13a31ac5a tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:33:40.767412 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-10f46d91-5000-478a-8b3b-e8d13a31ac5a tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Getting quotas for project 8d9857e88402494e964f2099de5bb60c. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:33:40.772975 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-10f46d91-5000-478a-8b3b-e8d13a31ac5a tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Getting quotas for user 7ac4eff18a664804af16cf21321f9290 and project 8d9857e88402494e964f2099de5bb60c. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:33:40.786792 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-10f46d91-5000-478a-8b3b-e8d13a31ac5a tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Going to run 1 instances... {{(pid=140491) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 21:33:40.789419 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-10f46d91-5000-478a-8b3b-e8d13a31ac5a tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] [instance: 71bc9bcc-a751-418d-9762-64ed92c65e1c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='de1e3a16-a115-4874-8db9-d5fd7be5a555',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=140491) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 21:33:40.865215 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-10f46d91-5000-478a-8b3b-e8d13a31ac5a tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.890393 Oct 08 21:33:40.865906 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3037/6147] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 21:33:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 892 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 08 21:33:40.878227 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-c5c23987-5706-49eb-ba2a-019b59c07645 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:33:40.879592 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-c5c23987-5706-49eb-ba2a-019b59c07645 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] [instance: 71bc9bcc-a751-418d-9762-64ed92c65e1c] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:33:40.942652 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-c5c23987-5706-49eb-ba2a-019b59c07645 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac4eff18a664804af16cf21321f9290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9857e88402494e964f2099de5bb60c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:33:40.943395 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-c5c23987-5706-49eb-ba2a-019b59c07645 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] 10.222.0.26 "GET /compute/v2.1/servers/71bc9bcc-a751-418d-9762-64ed92c65e1c" status: 200 len: 1229 microversion: 2.1 time: 0.070199 Oct 08 21:33:40.944373 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3111/6148] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:33:40 2022] GET /compute/v2.1/servers/71bc9bcc-a751-418d-9762-64ed92c65e1c => generated 1229 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:33:41.966044 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-aa182131-764d-4064-a9ad-4ec081c1a751 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:33:41.967495 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-aa182131-764d-4064-a9ad-4ec081c1a751 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] [instance: 71bc9bcc-a751-418d-9762-64ed92c65e1c] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:33:41.975842 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-aa182131-764d-4064-a9ad-4ec081c1a751 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:33:41.976376 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-aa182131-764d-4064-a9ad-4ec081c1a751 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:33:41.976969 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-aa182131-764d-4064-a9ad-4ec081c1a751 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:33:41.977753 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-aa182131-764d-4064-a9ad-4ec081c1a751 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:33:41.978323 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-aa182131-764d-4064-a9ad-4ec081c1a751 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:33:41.978647 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-aa182131-764d-4064-a9ad-4ec081c1a751 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:33:42.056714 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-aa182131-764d-4064-a9ad-4ec081c1a751 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac4eff18a664804af16cf21321f9290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9857e88402494e964f2099de5bb60c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:33:42.064669 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-aa182131-764d-4064-a9ad-4ec081c1a751 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] 10.222.0.26 "GET /compute/v2.1/servers/71bc9bcc-a751-418d-9762-64ed92c65e1c" status: 200 len: 1299 microversion: 2.1 time: 0.103401 Oct 08 21:33:42.065268 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3038/6149] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:33:41 2022] GET /compute/v2.1/servers/71bc9bcc-a751-418d-9762-64ed92c65e1c => generated 1299 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:33:43.087939 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-9e617be1-41c3-4f96-8afc-6acc691ce707 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:33:43.088662 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-9e617be1-41c3-4f96-8afc-6acc691ce707 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] [instance: 71bc9bcc-a751-418d-9762-64ed92c65e1c] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:33:43.096816 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9e617be1-41c3-4f96-8afc-6acc691ce707 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:33:43.097398 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9e617be1-41c3-4f96-8afc-6acc691ce707 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:33:43.097874 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9e617be1-41c3-4f96-8afc-6acc691ce707 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:33:43.098605 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9e617be1-41c3-4f96-8afc-6acc691ce707 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:33:43.099104 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9e617be1-41c3-4f96-8afc-6acc691ce707 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:33:43.099548 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9e617be1-41c3-4f96-8afc-6acc691ce707 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:33:43.238614 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-9e617be1-41c3-4f96-8afc-6acc691ce707 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac4eff18a664804af16cf21321f9290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9857e88402494e964f2099de5bb60c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:33:43.246582 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-9e617be1-41c3-4f96-8afc-6acc691ce707 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] 10.222.0.26 "GET /compute/v2.1/servers/71bc9bcc-a751-418d-9762-64ed92c65e1c" status: 200 len: 1341 microversion: 2.1 time: 0.162536 Oct 08 21:33:43.247160 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3112/6150] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:33:43 2022] GET /compute/v2.1/servers/71bc9bcc-a751-418d-9762-64ed92c65e1c => generated 1341 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:33:43.420183 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-57c2b0f9-c6e7-4983-989e-b55ee7c89390 req-42d13237-1571-495b-87ec-fff8f16d8c74 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71bc9bcc-a751-418d-9762-64ed92c65e1c", "tag": "504b8813-463c-4278-a359-badd1433d5a1"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:33:43.430105 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-57c2b0f9-c6e7-4983-989e-b55ee7c89390 req-42d13237-1571-495b-87ec-fff8f16d8c74 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:33:43.430873 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-57c2b0f9-c6e7-4983-989e-b55ee7c89390 req-42d13237-1571-495b-87ec-fff8f16d8c74 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:33:43.431404 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-57c2b0f9-c6e7-4983-989e-b55ee7c89390 req-42d13237-1571-495b-87ec-fff8f16d8c74 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:33:43.443391 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-57c2b0f9-c6e7-4983-989e-b55ee7c89390 req-42d13237-1571-495b-87ec-fff8f16d8c74 service nova] Creating event network-changed:504b8813-463c-4278-a359-badd1433d5a1 for instance 71bc9bcc-a751-418d-9762-64ed92c65e1c on nch1-master-1 Oct 08 21:33:43.448306 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-57c2b0f9-c6e7-4983-989e-b55ee7c89390 req-42d13237-1571-495b-87ec-fff8f16d8c74 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103931 Oct 08 21:33:43.449453 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3039/6151] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:33:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:33:44.268869 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-d57c7d27-7e51-479f-b05f-3bee330b4da0 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:33:44.269652 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-d57c7d27-7e51-479f-b05f-3bee330b4da0 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] [instance: 71bc9bcc-a751-418d-9762-64ed92c65e1c] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:33:44.276763 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d57c7d27-7e51-479f-b05f-3bee330b4da0 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:33:44.278228 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d57c7d27-7e51-479f-b05f-3bee330b4da0 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:33:44.278649 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d57c7d27-7e51-479f-b05f-3bee330b4da0 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:33:44.279572 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d57c7d27-7e51-479f-b05f-3bee330b4da0 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:33:44.280058 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d57c7d27-7e51-479f-b05f-3bee330b4da0 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:33:44.280516 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d57c7d27-7e51-479f-b05f-3bee330b4da0 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:33:44.413088 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-d57c7d27-7e51-479f-b05f-3bee330b4da0 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac4eff18a664804af16cf21321f9290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9857e88402494e964f2099de5bb60c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:33:44.421365 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-d57c7d27-7e51-479f-b05f-3bee330b4da0 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] 10.222.0.26 "GET /compute/v2.1/servers/71bc9bcc-a751-418d-9762-64ed92c65e1c" status: 200 len: 1341 microversion: 2.1 time: 0.156507 Oct 08 21:33:44.421949 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3113/6152] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:33:44 2022] GET /compute/v2.1/servers/71bc9bcc-a751-418d-9762-64ed92c65e1c => generated 1341 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:33:45.447163 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-733774b3-5f57-4bdd-b23d-3fdb3bfd64a1 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:33:45.447788 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-733774b3-5f57-4bdd-b23d-3fdb3bfd64a1 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] [instance: 71bc9bcc-a751-418d-9762-64ed92c65e1c] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:33:45.454554 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-733774b3-5f57-4bdd-b23d-3fdb3bfd64a1 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:33:45.455062 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-733774b3-5f57-4bdd-b23d-3fdb3bfd64a1 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:33:45.455545 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-733774b3-5f57-4bdd-b23d-3fdb3bfd64a1 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:33:45.456289 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-733774b3-5f57-4bdd-b23d-3fdb3bfd64a1 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:33:45.456750 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-733774b3-5f57-4bdd-b23d-3fdb3bfd64a1 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:33:45.457206 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-733774b3-5f57-4bdd-b23d-3fdb3bfd64a1 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:33:45.612912 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-733774b3-5f57-4bdd-b23d-3fdb3bfd64a1 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac4eff18a664804af16cf21321f9290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9857e88402494e964f2099de5bb60c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:33:45.623175 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-733774b3-5f57-4bdd-b23d-3fdb3bfd64a1 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] 10.222.0.26 "GET /compute/v2.1/servers/71bc9bcc-a751-418d-9762-64ed92c65e1c" status: 200 len: 1341 microversion: 2.1 time: 0.180772 Oct 08 21:33:45.624232 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3040/6153] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:33:45 2022] GET /compute/v2.1/servers/71bc9bcc-a751-418d-9762-64ed92c65e1c => generated 1341 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:33:46.647749 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-c2a2acd5-fb92-4420-9543-09d5d66ddd45 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:33:46.648572 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-c2a2acd5-fb92-4420-9543-09d5d66ddd45 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] [instance: 71bc9bcc-a751-418d-9762-64ed92c65e1c] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:33:46.655800 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c2a2acd5-fb92-4420-9543-09d5d66ddd45 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:33:46.656356 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c2a2acd5-fb92-4420-9543-09d5d66ddd45 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:33:46.656768 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c2a2acd5-fb92-4420-9543-09d5d66ddd45 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:33:46.657569 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c2a2acd5-fb92-4420-9543-09d5d66ddd45 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:33:46.658038 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c2a2acd5-fb92-4420-9543-09d5d66ddd45 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:33:46.658483 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c2a2acd5-fb92-4420-9543-09d5d66ddd45 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:33:46.803647 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-c2a2acd5-fb92-4420-9543-09d5d66ddd45 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac4eff18a664804af16cf21321f9290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9857e88402494e964f2099de5bb60c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:33:46.812936 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-c2a2acd5-fb92-4420-9543-09d5d66ddd45 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] 10.222.0.26 "GET /compute/v2.1/servers/71bc9bcc-a751-418d-9762-64ed92c65e1c" status: 200 len: 1387 microversion: 2.1 time: 0.169202 Oct 08 21:33:46.813633 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3114/6154] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:33:46 2022] GET /compute/v2.1/servers/71bc9bcc-a751-418d-9762-64ed92c65e1c => generated 1387 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:33:47.837162 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-97d6429f-47a5-485e-a901-990ecda38e4b tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:33:47.837818 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-97d6429f-47a5-485e-a901-990ecda38e4b tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] [instance: 71bc9bcc-a751-418d-9762-64ed92c65e1c] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:33:47.845688 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-97d6429f-47a5-485e-a901-990ecda38e4b tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:33:47.846507 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-97d6429f-47a5-485e-a901-990ecda38e4b tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:33:47.847025 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-97d6429f-47a5-485e-a901-990ecda38e4b tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:33:47.847759 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-97d6429f-47a5-485e-a901-990ecda38e4b tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:33:47.848280 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-97d6429f-47a5-485e-a901-990ecda38e4b tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:33:47.848715 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-97d6429f-47a5-485e-a901-990ecda38e4b tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:33:48.002996 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-97d6429f-47a5-485e-a901-990ecda38e4b tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac4eff18a664804af16cf21321f9290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9857e88402494e964f2099de5bb60c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:33:48.012236 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-97d6429f-47a5-485e-a901-990ecda38e4b tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] 10.222.0.26 "GET /compute/v2.1/servers/71bc9bcc-a751-418d-9762-64ed92c65e1c" status: 200 len: 1375 microversion: 2.1 time: 0.179323 Oct 08 21:33:48.012898 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3041/6155] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:33:47 2022] GET /compute/v2.1/servers/71bc9bcc-a751-418d-9762-64ed92c65e1c => generated 1375 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:33:49.038865 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-486f386a-e0b1-430f-8351-b3c87d5dbdec tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:33:49.039516 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-486f386a-e0b1-430f-8351-b3c87d5dbdec tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] [instance: 71bc9bcc-a751-418d-9762-64ed92c65e1c] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:33:49.047424 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-486f386a-e0b1-430f-8351-b3c87d5dbdec tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:33:49.047934 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-486f386a-e0b1-430f-8351-b3c87d5dbdec tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:33:49.048419 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-486f386a-e0b1-430f-8351-b3c87d5dbdec tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:33:49.049113 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-486f386a-e0b1-430f-8351-b3c87d5dbdec tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:33:49.049693 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-486f386a-e0b1-430f-8351-b3c87d5dbdec tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:33:49.050141 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-486f386a-e0b1-430f-8351-b3c87d5dbdec tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:33:49.188915 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-486f386a-e0b1-430f-8351-b3c87d5dbdec tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac4eff18a664804af16cf21321f9290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9857e88402494e964f2099de5bb60c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:33:49.197726 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-486f386a-e0b1-430f-8351-b3c87d5dbdec tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] 10.222.0.26 "GET /compute/v2.1/servers/71bc9bcc-a751-418d-9762-64ed92c65e1c" status: 200 len: 1375 microversion: 2.1 time: 0.162651 Oct 08 21:33:49.198372 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3115/6156] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:33:49 2022] GET /compute/v2.1/servers/71bc9bcc-a751-418d-9762-64ed92c65e1c => generated 1375 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:33:50.230783 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-88f1228c-f14a-4924-9965-7962daea9e2b tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:33:50.231440 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-88f1228c-f14a-4924-9965-7962daea9e2b tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] [instance: 71bc9bcc-a751-418d-9762-64ed92c65e1c] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:33:50.240493 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-88f1228c-f14a-4924-9965-7962daea9e2b tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:33:50.241005 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-88f1228c-f14a-4924-9965-7962daea9e2b tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:33:50.241451 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-88f1228c-f14a-4924-9965-7962daea9e2b tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:33:50.242243 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-88f1228c-f14a-4924-9965-7962daea9e2b tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:33:50.242703 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-88f1228c-f14a-4924-9965-7962daea9e2b tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:33:50.243363 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-88f1228c-f14a-4924-9965-7962daea9e2b tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:33:50.481842 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-88f1228c-f14a-4924-9965-7962daea9e2b tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac4eff18a664804af16cf21321f9290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9857e88402494e964f2099de5bb60c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:33:50.500298 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-88f1228c-f14a-4924-9965-7962daea9e2b tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] 10.222.0.26 "GET /compute/v2.1/servers/71bc9bcc-a751-418d-9762-64ed92c65e1c" status: 200 len: 1375 microversion: 2.1 time: 0.274148 Oct 08 21:33:50.501012 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3042/6157] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:33:50 2022] GET /compute/v2.1/servers/71bc9bcc-a751-418d-9762-64ed92c65e1c => generated 1375 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:33:50.614048 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-debd0d26-d370-40cd-8efd-ea21dd0cdc57 req-5a61346e-2b2e-43ce-9985-30b6081779f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52d1cdbf-9250-4363-a404-10d7a5d9fffd", "tag": "d18ff6ec-36c0-4028-8a20-58b35240bfd4"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:33:50.615726 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-c0a34183-9a63-4bca-8f70-b4bb81d2a19e tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:33:50.620783 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-c0a34183-9a63-4bca-8f70-b4bb81d2a19e tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] [instance: 52d1cdbf-9250-4363-a404-10d7a5d9fffd] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:33:50.634433 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c0a34183-9a63-4bca-8f70-b4bb81d2a19e tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:33:50.637221 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-debd0d26-d370-40cd-8efd-ea21dd0cdc57 req-5a61346e-2b2e-43ce-9985-30b6081779f0 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:33:50.637985 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-debd0d26-d370-40cd-8efd-ea21dd0cdc57 req-5a61346e-2b2e-43ce-9985-30b6081779f0 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:33:50.638661 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-debd0d26-d370-40cd-8efd-ea21dd0cdc57 req-5a61346e-2b2e-43ce-9985-30b6081779f0 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:33:50.640078 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c0a34183-9a63-4bca-8f70-b4bb81d2a19e tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:33:50.641305 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c0a34183-9a63-4bca-8f70-b4bb81d2a19e tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:33:50.642076 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c0a34183-9a63-4bca-8f70-b4bb81d2a19e tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:33:50.644523 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c0a34183-9a63-4bca-8f70-b4bb81d2a19e tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:33:50.645013 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c0a34183-9a63-4bca-8f70-b4bb81d2a19e tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:33:50.650187 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=76,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:33:50.659393 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-debd0d26-d370-40cd-8efd-ea21dd0cdc57 req-5a61346e-2b2e-43ce-9985-30b6081779f0 service nova] Creating event network-changed:d18ff6ec-36c0-4028-8a20-58b35240bfd4 for instance 52d1cdbf-9250-4363-a404-10d7a5d9fffd on nch1-master-1 Oct 08 21:33:50.667915 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-debd0d26-d370-40cd-8efd-ea21dd0cdc57 req-5a61346e-2b2e-43ce-9985-30b6081779f0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060481 Oct 08 21:33:50.673079 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3043/6158] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:33:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:33:50.705773 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-c0a34183-9a63-4bca-8f70-b4bb81d2a19e tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] [instance: 52d1cdbf-9250-4363-a404-10d7a5d9fffd] Going to try to terminate instance {{(pid=140492) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 21:33:50.824861 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-c0a34183-9a63-4bca-8f70-b4bb81d2a19e tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] 10.222.0.26 "DELETE /compute/v2.1/servers/52d1cdbf-9250-4363-a404-10d7a5d9fffd" status: 204 len: 0 microversion: 2.1 time: 0.218431 Oct 08 21:33:50.826275 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3116/6159] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:33:50 2022] DELETE /compute/v2.1/servers/52d1cdbf-9250-4363-a404-10d7a5d9fffd => generated 0 bytes in 222 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 21:33:50.836458 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-efabe46e-9356-4426-975d-6d84e49d33da tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:33:50.837519 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-efabe46e-9356-4426-975d-6d84e49d33da tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] [instance: 52d1cdbf-9250-4363-a404-10d7a5d9fffd] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:33:50.849875 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=2 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:33:50.851621 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=6 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:33:50.855960 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-efabe46e-9356-4426-975d-6d84e49d33da tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:33:50.856481 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-efabe46e-9356-4426-975d-6d84e49d33da tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:33:50.856945 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-efabe46e-9356-4426-975d-6d84e49d33da tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:33:50.857722 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-efabe46e-9356-4426-975d-6d84e49d33da tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:33:50.858228 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-efabe46e-9356-4426-975d-6d84e49d33da tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:33:50.858671 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-efabe46e-9356-4426-975d-6d84e49d33da tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:33:51.027076 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-efabe46e-9356-4426-975d-6d84e49d33da tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0e898ea13845068ead117311106b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13f3a9d12c4710882a17d9d06b3473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:33:51.035019 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-efabe46e-9356-4426-975d-6d84e49d33da tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] 10.222.0.26 "GET /compute/v2.1/servers/52d1cdbf-9250-4363-a404-10d7a5d9fffd" status: 200 len: 1583 microversion: 2.1 time: 0.203584 Oct 08 21:33:51.035601 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3044/6160] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:33:50 2022] GET /compute/v2.1/servers/52d1cdbf-9250-4363-a404-10d7a5d9fffd => generated 1583 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:33:51.524606 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-f3079e6e-117c-4540-b9bf-a7d694e44da3 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:33:51.525456 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-f3079e6e-117c-4540-b9bf-a7d694e44da3 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] [instance: 71bc9bcc-a751-418d-9762-64ed92c65e1c] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:33:51.527804 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=2 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:33:51.534534 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f3079e6e-117c-4540-b9bf-a7d694e44da3 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:33:51.535061 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f3079e6e-117c-4540-b9bf-a7d694e44da3 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:33:51.535524 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f3079e6e-117c-4540-b9bf-a7d694e44da3 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:33:51.536294 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f3079e6e-117c-4540-b9bf-a7d694e44da3 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:33:51.536773 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f3079e6e-117c-4540-b9bf-a7d694e44da3 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:33:51.537240 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f3079e6e-117c-4540-b9bf-a7d694e44da3 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:33:51.677632 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-f3079e6e-117c-4540-b9bf-a7d694e44da3 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac4eff18a664804af16cf21321f9290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9857e88402494e964f2099de5bb60c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:33:51.686800 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-f3079e6e-117c-4540-b9bf-a7d694e44da3 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] 10.222.0.26 "GET /compute/v2.1/servers/71bc9bcc-a751-418d-9762-64ed92c65e1c" status: 200 len: 1375 microversion: 2.1 time: 0.166444 Oct 08 21:33:51.687804 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3117/6161] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:33:51 2022] GET /compute/v2.1/servers/71bc9bcc-a751-418d-9762-64ed92c65e1c => generated 1375 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:33:52.059973 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-a8b8d9dc-4215-47a1-bae0-67c92899cd5b tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:33:52.060587 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-a8b8d9dc-4215-47a1-bae0-67c92899cd5b tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] [instance: 52d1cdbf-9250-4363-a404-10d7a5d9fffd] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:33:52.068123 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a8b8d9dc-4215-47a1-bae0-67c92899cd5b tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:33:52.068607 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a8b8d9dc-4215-47a1-bae0-67c92899cd5b tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:33:52.069046 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a8b8d9dc-4215-47a1-bae0-67c92899cd5b tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:33:52.069775 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a8b8d9dc-4215-47a1-bae0-67c92899cd5b tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:33:52.070235 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a8b8d9dc-4215-47a1-bae0-67c92899cd5b tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:33:52.070663 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a8b8d9dc-4215-47a1-bae0-67c92899cd5b tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:33:52.297986 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-a8b8d9dc-4215-47a1-bae0-67c92899cd5b tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0e898ea13845068ead117311106b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13f3a9d12c4710882a17d9d06b3473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:33:52.307226 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-a8b8d9dc-4215-47a1-bae0-67c92899cd5b tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] 10.222.0.26 "GET /compute/v2.1/servers/52d1cdbf-9250-4363-a404-10d7a5d9fffd" status: 200 len: 1583 microversion: 2.1 time: 0.251192 Oct 08 21:33:52.310471 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-8682b8e5-636b-4ec6-93ff-5ad0f1c96746 req-9fbc88db-02b4-422c-9ff4-51f904d77e4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71bc9bcc-a751-418d-9762-64ed92c65e1c", "name": "network-vif-plugged", "status": "completed", "tag": "504b8813-463c-4278-a359-badd1433d5a1"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:33:52.321699 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-8682b8e5-636b-4ec6-93ff-5ad0f1c96746 req-9fbc88db-02b4-422c-9ff4-51f904d77e4c service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:33:52.322246 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3045/6162] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:33:52 2022] GET /compute/v2.1/servers/52d1cdbf-9250-4363-a404-10d7a5d9fffd => generated 1583 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:33:52.322530 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-8682b8e5-636b-4ec6-93ff-5ad0f1c96746 req-9fbc88db-02b4-422c-9ff4-51f904d77e4c service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:33:52.323067 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-8682b8e5-636b-4ec6-93ff-5ad0f1c96746 req-9fbc88db-02b4-422c-9ff4-51f904d77e4c service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:33:52.337269 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-8682b8e5-636b-4ec6-93ff-5ad0f1c96746 req-9fbc88db-02b4-422c-9ff4-51f904d77e4c service nova] Creating event network-vif-plugged:504b8813-463c-4278-a359-badd1433d5a1 for instance 71bc9bcc-a751-418d-9762-64ed92c65e1c on nch1-master-1 Oct 08 21:33:52.343826 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-8682b8e5-636b-4ec6-93ff-5ad0f1c96746 req-9fbc88db-02b4-422c-9ff4-51f904d77e4c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038557 Oct 08 21:33:52.344860 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3118/6163] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:33:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:33:52.710681 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-621d79ca-3809-4531-8ed1-fabdcf818e20 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:33:52.711370 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-621d79ca-3809-4531-8ed1-fabdcf818e20 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] [instance: 71bc9bcc-a751-418d-9762-64ed92c65e1c] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:33:52.718265 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-621d79ca-3809-4531-8ed1-fabdcf818e20 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:33:52.718763 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-621d79ca-3809-4531-8ed1-fabdcf818e20 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:33:52.719215 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-621d79ca-3809-4531-8ed1-fabdcf818e20 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:33:52.719927 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-621d79ca-3809-4531-8ed1-fabdcf818e20 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:33:52.720424 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-621d79ca-3809-4531-8ed1-fabdcf818e20 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:33:52.720862 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-621d79ca-3809-4531-8ed1-fabdcf818e20 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:33:52.948852 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-621d79ca-3809-4531-8ed1-fabdcf818e20 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac4eff18a664804af16cf21321f9290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9857e88402494e964f2099de5bb60c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:33:52.956784 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-621d79ca-3809-4531-8ed1-fabdcf818e20 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] 10.222.0.26 "GET /compute/v2.1/servers/71bc9bcc-a751-418d-9762-64ed92c65e1c" status: 200 len: 1375 microversion: 2.1 time: 0.250073 Oct 08 21:33:52.957416 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3046/6164] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:33:52 2022] GET /compute/v2.1/servers/71bc9bcc-a751-418d-9762-64ed92c65e1c => generated 1375 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:33:53.180812 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-4a3ebfe5-2ed7-49bb-af68-cc5882d79769 req-5b4671be-e1d1-4db9-99a8-36d9e474870c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52d1cdbf-9250-4363-a404-10d7a5d9fffd", "name": "network-vif-deleted", "tag": "d18ff6ec-36c0-4028-8a20-58b35240bfd4"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:33:53.191921 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-4a3ebfe5-2ed7-49bb-af68-cc5882d79769 req-5b4671be-e1d1-4db9-99a8-36d9e474870c service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:33:53.192602 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-4a3ebfe5-2ed7-49bb-af68-cc5882d79769 req-5b4671be-e1d1-4db9-99a8-36d9e474870c service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:33:53.193063 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-4a3ebfe5-2ed7-49bb-af68-cc5882d79769 req-5b4671be-e1d1-4db9-99a8-36d9e474870c service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:33:53.207544 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-4a3ebfe5-2ed7-49bb-af68-cc5882d79769 req-5b4671be-e1d1-4db9-99a8-36d9e474870c service nova] Creating event network-vif-deleted:d18ff6ec-36c0-4028-8a20-58b35240bfd4 for instance 52d1cdbf-9250-4363-a404-10d7a5d9fffd on nch1-master-1 Oct 08 21:33:53.212802 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-4a3ebfe5-2ed7-49bb-af68-cc5882d79769 req-5b4671be-e1d1-4db9-99a8-36d9e474870c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035978 Oct 08 21:33:53.213606 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3119/6165] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:33:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:33:53.332819 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-8110b61e-fae6-434c-9dac-e6dd5ae0c436 tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:33:53.333473 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-8110b61e-fae6-434c-9dac-e6dd5ae0c436 tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] [instance: 52d1cdbf-9250-4363-a404-10d7a5d9fffd] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:33:53.340350 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8110b61e-fae6-434c-9dac-e6dd5ae0c436 tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:33:53.340782 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8110b61e-fae6-434c-9dac-e6dd5ae0c436 tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:33:53.341636 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8110b61e-fae6-434c-9dac-e6dd5ae0c436 tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:33:53.342927 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8110b61e-fae6-434c-9dac-e6dd5ae0c436 tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:33:53.343394 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8110b61e-fae6-434c-9dac-e6dd5ae0c436 tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:33:53.343843 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8110b61e-fae6-434c-9dac-e6dd5ae0c436 tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:33:53.407986 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-8110b61e-fae6-434c-9dac-e6dd5ae0c436 tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0e898ea13845068ead117311106b0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13f3a9d12c4710882a17d9d06b3473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:33:53.416916 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-8110b61e-fae6-434c-9dac-e6dd5ae0c436 tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] 10.222.0.26 "GET /compute/v2.1/servers/52d1cdbf-9250-4363-a404-10d7a5d9fffd" status: 200 len: 1229 microversion: 2.1 time: 0.088093 Oct 08 21:33:53.417877 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3047/6166] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:33:53 2022] GET /compute/v2.1/servers/52d1cdbf-9250-4363-a404-10d7a5d9fffd => generated 1229 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:33:53.981887 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-02a54f85-75f6-4f4e-905d-6aac2dfd340c tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:33:53.983370 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-02a54f85-75f6-4f4e-905d-6aac2dfd340c tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] [instance: 71bc9bcc-a751-418d-9762-64ed92c65e1c] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:33:53.990941 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-02a54f85-75f6-4f4e-905d-6aac2dfd340c tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:33:53.991469 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-02a54f85-75f6-4f4e-905d-6aac2dfd340c tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:33:53.992063 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-02a54f85-75f6-4f4e-905d-6aac2dfd340c tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:33:53.992993 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-02a54f85-75f6-4f4e-905d-6aac2dfd340c tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:33:53.993516 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-02a54f85-75f6-4f4e-905d-6aac2dfd340c tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:33:53.993960 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-02a54f85-75f6-4f4e-905d-6aac2dfd340c tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:33:54.129870 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-02a54f85-75f6-4f4e-905d-6aac2dfd340c tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac4eff18a664804af16cf21321f9290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9857e88402494e964f2099de5bb60c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:33:54.137853 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-02a54f85-75f6-4f4e-905d-6aac2dfd340c tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] 10.222.0.26 "GET /compute/v2.1/servers/71bc9bcc-a751-418d-9762-64ed92c65e1c" status: 200 len: 1563 microversion: 2.1 time: 0.161181 Oct 08 21:33:54.138410 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3120/6167] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:33:53 2022] GET /compute/v2.1/servers/71bc9bcc-a751-418d-9762-64ed92c65e1c => generated 1563 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:33:54.160262 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-d90482fa-f57b-4e03-9544-e2296b1c6c1f tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:33:54.160819 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-d90482fa-f57b-4e03-9544-e2296b1c6c1f tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] [instance: 71bc9bcc-a751-418d-9762-64ed92c65e1c] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:33:54.166914 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d90482fa-f57b-4e03-9544-e2296b1c6c1f tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:33:54.167413 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d90482fa-f57b-4e03-9544-e2296b1c6c1f tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:33:54.167863 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d90482fa-f57b-4e03-9544-e2296b1c6c1f tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:33:54.168569 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d90482fa-f57b-4e03-9544-e2296b1c6c1f tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:33:54.169041 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d90482fa-f57b-4e03-9544-e2296b1c6c1f tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:33:54.169494 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d90482fa-f57b-4e03-9544-e2296b1c6c1f tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:33:54.302590 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-d90482fa-f57b-4e03-9544-e2296b1c6c1f tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac4eff18a664804af16cf21321f9290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9857e88402494e964f2099de5bb60c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:33:54.310549 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-d90482fa-f57b-4e03-9544-e2296b1c6c1f tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] 10.222.0.26 "GET /compute/v2.1/servers/71bc9bcc-a751-418d-9762-64ed92c65e1c" status: 200 len: 1563 microversion: 2.1 time: 0.154256 Oct 08 21:33:54.311168 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3048/6168] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:33:54 2022] GET /compute/v2.1/servers/71bc9bcc-a751-418d-9762-64ed92c65e1c => generated 1563 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:33:54.390045 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-0067723c-c8af-4543-bbb0-8652a6369795 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:33:54.390675 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-0067723c-c8af-4543-bbb0-8652a6369795 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] [instance: 71bc9bcc-a751-418d-9762-64ed92c65e1c] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:33:54.397596 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0067723c-c8af-4543-bbb0-8652a6369795 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:33:54.398107 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0067723c-c8af-4543-bbb0-8652a6369795 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:33:54.398570 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0067723c-c8af-4543-bbb0-8652a6369795 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:33:54.399297 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0067723c-c8af-4543-bbb0-8652a6369795 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:33:54.399778 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0067723c-c8af-4543-bbb0-8652a6369795 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:33:54.400223 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0067723c-c8af-4543-bbb0-8652a6369795 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:33:54.427199 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-0067723c-c8af-4543-bbb0-8652a6369795 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] [instance: 71bc9bcc-a751-418d-9762-64ed92c65e1c] Going to try to terminate instance {{(pid=140492) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 21:33:54.439941 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-5449767e-4a55-42f0-ada6-076ed7cdb947 tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:33:54.440566 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-5449767e-4a55-42f0-ada6-076ed7cdb947 tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] [instance: 52d1cdbf-9250-4363-a404-10d7a5d9fffd] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:33:54.447506 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5449767e-4a55-42f0-ada6-076ed7cdb947 tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:33:54.448013 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5449767e-4a55-42f0-ada6-076ed7cdb947 tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:33:54.448463 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5449767e-4a55-42f0-ada6-076ed7cdb947 tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:33:54.449173 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5449767e-4a55-42f0-ada6-076ed7cdb947 tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:33:54.449678 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5449767e-4a55-42f0-ada6-076ed7cdb947 tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:33:54.450126 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5449767e-4a55-42f0-ada6-076ed7cdb947 tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:33:54.464060 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-5449767e-4a55-42f0-ada6-076ed7cdb947 tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] HTTP exception thrown: Instance 52d1cdbf-9250-4363-a404-10d7a5d9fffd could not be found. Oct 08 21:33:54.466236 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-5449767e-4a55-42f0-ada6-076ed7cdb947 tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Request method failure captured: Oct 08 21:33:54.466236 ncdv-master-1 devstack@n-api.service[140491]: request: GET /compute/v2.1/servers/52d1cdbf-9250-4363-a404-10d7a5d9fffd HTTP/1.1 Oct 08 21:33:54.466236 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:33:54.466236 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:33:54.466236 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:33:54.466236 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 21:33:54.466236 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:33:54.466236 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:33:54.466236 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:33:54.466236 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:33:54.466236 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQexmF6-EtGsS0oupKsrZH99w0merXpVckjw0K-tWKZLtZ1JUoeLKJXj1p6GeWX4hH-9-2pLhN5VWKNIDVxmytzCDmFSDZnhW0CZVvwgJHuqD-ML8BqXR6HBJahTPNyLC_U3JmoPRHjSYzJUM8G4viOqvc7ypLx3ohZKA2HcS2JIj_14 Oct 08 21:33:54.466236 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:33:54.466236 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:33:54.466236 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:33:54.466236 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:33:54.466236 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:33:54.466236 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:33:54.466236 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 5c13f3a9d12c4710882a17d9d06b3473 Oct 08 21:33:54.466236 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-TestVolumeBackupRestore-199632938 Oct 08 21:33:54.466236 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:33:54.466236 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:33:54.466236 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5c13f3a9d12c4710882a17d9d06b3473"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5c13f3a9d12c4710882a17d9d06b3473"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5c13f3a9d12c4710882a17d9d06b3473"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5c13f3a9d12c4710882a17d9d06b3473"}]}] Oct 08 21:33:54.466236 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-TestVolumeBackupRestore-199632938 Oct 08 21:33:54.466236 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 5c13f3a9d12c4710882a17d9d06b3473 Oct 08 21:33:54.466236 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-TestVolumeBackupRestore-199632938 Oct 08 21:33:54.466236 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-TestVolumeBackupRestore-199632938-project Oct 08 21:33:54.466236 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:33:54.466236 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:33:54.466236 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 0f0e898ea13845068ead117311106b0c Oct 08 21:33:54.466236 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-TestVolumeBackupRestore-199632938-project Oct 08 21:33:54.466236 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:33:54.466236 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance 52d1cdbf-9250-4363-a404-10d7a5d9fffd could not be found. Oct 08 21:33:54.466236 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': '52d1cdbf-9250-4363-a404-10d7a5d9fffd'} Oct 08 21:33:54.466236 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:33:54.466236 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:33:54.466236 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:33:54.466236 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:33:54.466236 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:33:54.466236 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:33:54.466236 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:33:54.466236 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:33:54.466236 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:33:54.466236 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:33:54.466236 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52d1cdbf-9250-4363-a404-10d7a5d9fffd could not be found. Oct 08 21:33:54.466236 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:33:54.466236 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:33:54.466236 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:33:54.466236 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:33:54.466236 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:33:54.466236 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:33:54.466236 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:33:54.466236 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:33:54.466236 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:33:54.466236 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:33:54.466236 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:33:54.466236 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:33:54.466236 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:33:54.466236 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:33:54.466236 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:33:54.466236 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:33:54.466236 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52d1cdbf-9250-4363-a404-10d7a5d9fffd could not be found. Oct 08 21:33:54.466236 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:33:54.466236 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:33:54.466236 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:33:54.471672 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:33:54.471672 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:33:54.471672 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:33:54.471672 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:33:54.471672 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:33:54.471672 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52d1cdbf-9250-4363-a404-10d7a5d9fffd could not be found. Oct 08 21:33:54.471672 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:33:54.471672 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-5449767e-4a55-42f0-ada6-076ed7cdb947 tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Returning 404 to user: Instance 52d1cdbf-9250-4363-a404-10d7a5d9fffd could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:33:54.471672 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-5449767e-4a55-42f0-ada6-076ed7cdb947 tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] 10.222.0.26 "GET /compute/v2.1/servers/52d1cdbf-9250-4363-a404-10d7a5d9fffd" status: 404 len: 111 microversion: 2.1 time: 0.032300 Oct 08 21:33:54.472326 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3049/6169] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:33:54 2022] GET /compute/v2.1/servers/52d1cdbf-9250-4363-a404-10d7a5d9fffd => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 08 21:33:54.513358 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-0067723c-c8af-4543-bbb0-8652a6369795 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] 10.222.0.26 "DELETE /compute/v2.1/servers/71bc9bcc-a751-418d-9762-64ed92c65e1c" status: 204 len: 0 microversion: 2.1 time: 0.126684 Oct 08 21:33:54.515228 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3121/6170] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:33:54 2022] DELETE /compute/v2.1/servers/71bc9bcc-a751-418d-9762-64ed92c65e1c => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 21:33:54.524314 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-54a23857-e46d-44c6-b1e5-4baa27df33b1 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:33:54.525212 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-54a23857-e46d-44c6-b1e5-4baa27df33b1 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] [instance: 71bc9bcc-a751-418d-9762-64ed92c65e1c] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:33:54.532151 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-54a23857-e46d-44c6-b1e5-4baa27df33b1 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:33:54.532653 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-54a23857-e46d-44c6-b1e5-4baa27df33b1 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:33:54.533101 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-54a23857-e46d-44c6-b1e5-4baa27df33b1 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:33:54.533844 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-54a23857-e46d-44c6-b1e5-4baa27df33b1 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:33:54.534321 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-54a23857-e46d-44c6-b1e5-4baa27df33b1 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:33:54.534809 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-54a23857-e46d-44c6-b1e5-4baa27df33b1 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:33:54.705713 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-54a23857-e46d-44c6-b1e5-4baa27df33b1 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac4eff18a664804af16cf21321f9290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9857e88402494e964f2099de5bb60c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:33:54.717610 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-5d5ae96b-dc0c-4cff-a0b8-6a34dd8cc089 tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] Calling method '.version_select at 0x7f1a87614790>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:33:54.724135 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-54a23857-e46d-44c6-b1e5-4baa27df33b1 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] 10.222.0.26 "GET /compute/v2.1/servers/71bc9bcc-a751-418d-9762-64ed92c65e1c" status: 200 len: 1569 microversion: 2.1 time: 0.203935 Oct 08 21:33:54.724601 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3050/6171] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:33:54 2022] GET /compute/v2.1/servers/71bc9bcc-a751-418d-9762-64ed92c65e1c => generated 1569 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:33:54.747357 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-5d5ae96b-dc0c-4cff-a0b8-6a34dd8cc089 tempest-TestVolumeBackupRestore-199632938 tempest-TestVolumeBackupRestore-199632938-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1856620467" status: 202 len: 0 microversion: 2.1 time: 0.034984 Oct 08 21:33:54.751930 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3122/6172] 10.222.0.26 () {58 vars in 1269 bytes} [Sat Oct 8 21:33:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1856620467 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 21:33:55.747294 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-05e4eefe-457c-4162-886b-48754aaaa5ea tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:33:55.747995 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-05e4eefe-457c-4162-886b-48754aaaa5ea tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] [instance: 71bc9bcc-a751-418d-9762-64ed92c65e1c] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:33:55.760758 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-05e4eefe-457c-4162-886b-48754aaaa5ea tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:33:55.761381 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-05e4eefe-457c-4162-886b-48754aaaa5ea tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:33:55.761840 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-05e4eefe-457c-4162-886b-48754aaaa5ea tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:33:55.762570 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-05e4eefe-457c-4162-886b-48754aaaa5ea tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:33:55.763036 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-05e4eefe-457c-4162-886b-48754aaaa5ea tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:33:55.763474 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-05e4eefe-457c-4162-886b-48754aaaa5ea tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:33:55.783201 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=100 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:33:55.902682 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-05e4eefe-457c-4162-886b-48754aaaa5ea tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac4eff18a664804af16cf21321f9290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9857e88402494e964f2099de5bb60c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:33:55.911178 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-05e4eefe-457c-4162-886b-48754aaaa5ea tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] 10.222.0.26 "GET /compute/v2.1/servers/71bc9bcc-a751-418d-9762-64ed92c65e1c" status: 200 len: 1569 microversion: 2.1 time: 0.168055 Oct 08 21:33:55.911759 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3051/6173] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:33:55 2022] GET /compute/v2.1/servers/71bc9bcc-a751-418d-9762-64ed92c65e1c => generated 1569 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:33:56.668022 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-909d9ac5-1c8b-4f94-ab27-9c9c6f99d79e req-bf6f6fc4-0053-4a2b-bf6f-f6033ab0a65f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71bc9bcc-a751-418d-9762-64ed92c65e1c", "name": "network-vif-deleted", "tag": "504b8813-463c-4278-a359-badd1433d5a1"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:33:56.684731 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-909d9ac5-1c8b-4f94-ab27-9c9c6f99d79e req-bf6f6fc4-0053-4a2b-bf6f-f6033ab0a65f service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:33:56.685275 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-909d9ac5-1c8b-4f94-ab27-9c9c6f99d79e req-bf6f6fc4-0053-4a2b-bf6f-f6033ab0a65f service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:33:56.685780 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-909d9ac5-1c8b-4f94-ab27-9c9c6f99d79e req-bf6f6fc4-0053-4a2b-bf6f-f6033ab0a65f service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:33:56.700984 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-909d9ac5-1c8b-4f94-ab27-9c9c6f99d79e req-bf6f6fc4-0053-4a2b-bf6f-f6033ab0a65f service nova] Creating event network-vif-deleted:504b8813-463c-4278-a359-badd1433d5a1 for instance 71bc9bcc-a751-418d-9762-64ed92c65e1c on nch1-master-1 Oct 08 21:33:56.708316 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-909d9ac5-1c8b-4f94-ab27-9c9c6f99d79e req-bf6f6fc4-0053-4a2b-bf6f-f6033ab0a65f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045497 Oct 08 21:33:56.709404 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3123/6174] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:33:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 08 21:33:56.934643 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-2c98c576-1333-45cf-b04e-1cbbce81c79d tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:33:56.935209 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-2c98c576-1333-45cf-b04e-1cbbce81c79d tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] [instance: 71bc9bcc-a751-418d-9762-64ed92c65e1c] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:33:56.942895 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2c98c576-1333-45cf-b04e-1cbbce81c79d tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:33:56.943396 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2c98c576-1333-45cf-b04e-1cbbce81c79d tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:33:56.943849 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2c98c576-1333-45cf-b04e-1cbbce81c79d tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:33:56.944565 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2c98c576-1333-45cf-b04e-1cbbce81c79d tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:33:56.945034 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2c98c576-1333-45cf-b04e-1cbbce81c79d tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:33:56.945515 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2c98c576-1333-45cf-b04e-1cbbce81c79d tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:33:57.008075 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-2c98c576-1333-45cf-b04e-1cbbce81c79d tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac4eff18a664804af16cf21321f9290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9857e88402494e964f2099de5bb60c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:33:57.016099 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-2c98c576-1333-45cf-b04e-1cbbce81c79d tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] 10.222.0.26 "GET /compute/v2.1/servers/71bc9bcc-a751-418d-9762-64ed92c65e1c" status: 200 len: 1360 microversion: 2.1 time: 0.085490 Oct 08 21:33:57.016680 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3052/6175] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:33:56 2022] GET /compute/v2.1/servers/71bc9bcc-a751-418d-9762-64ed92c65e1c => generated 1360 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:33:58.040653 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-aca6781b-24b4-4a89-91e8-b2b32ac780d3 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:33:58.041493 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-aca6781b-24b4-4a89-91e8-b2b32ac780d3 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] [instance: 71bc9bcc-a751-418d-9762-64ed92c65e1c] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:33:58.049076 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-aca6781b-24b4-4a89-91e8-b2b32ac780d3 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:33:58.049902 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-aca6781b-24b4-4a89-91e8-b2b32ac780d3 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:33:58.050902 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-aca6781b-24b4-4a89-91e8-b2b32ac780d3 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:33:58.051746 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-aca6781b-24b4-4a89-91e8-b2b32ac780d3 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:33:58.052302 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-aca6781b-24b4-4a89-91e8-b2b32ac780d3 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:33:58.052837 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-aca6781b-24b4-4a89-91e8-b2b32ac780d3 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:33:58.090025 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-aca6781b-24b4-4a89-91e8-b2b32ac780d3 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:33:58.090908 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-aca6781b-24b4-4a89-91e8-b2b32ac780d3 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:33:58.091440 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-aca6781b-24b4-4a89-91e8-b2b32ac780d3 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:33:58.091996 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.objects.instance [None req-aca6781b-24b4-4a89-91e8-b2b32ac780d3 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lazy-loading 'fault' on Instance uuid 71bc9bcc-a751-418d-9762-64ed92c65e1c {{(pid=140492) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 21:33:58.146254 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-aca6781b-24b4-4a89-91e8-b2b32ac780d3 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac4eff18a664804af16cf21321f9290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9857e88402494e964f2099de5bb60c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:33:58.154708 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-aca6781b-24b4-4a89-91e8-b2b32ac780d3 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] 10.222.0.26 "GET /compute/v2.1/servers/71bc9bcc-a751-418d-9762-64ed92c65e1c" status: 200 len: 1319 microversion: 2.1 time: 0.119469 Oct 08 21:33:58.156235 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3124/6176] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:33:58 2022] GET /compute/v2.1/servers/71bc9bcc-a751-418d-9762-64ed92c65e1c => generated 1319 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:33:59.179896 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c58276eb-f9bb-4158-8d5c-a54637175ab8 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:33:59.180530 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-c58276eb-f9bb-4158-8d5c-a54637175ab8 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] [instance: 71bc9bcc-a751-418d-9762-64ed92c65e1c] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:33:59.187839 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c58276eb-f9bb-4158-8d5c-a54637175ab8 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:33:59.188358 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c58276eb-f9bb-4158-8d5c-a54637175ab8 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:33:59.188847 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c58276eb-f9bb-4158-8d5c-a54637175ab8 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:33:59.189646 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c58276eb-f9bb-4158-8d5c-a54637175ab8 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:33:59.190115 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c58276eb-f9bb-4158-8d5c-a54637175ab8 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:33:59.190552 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c58276eb-f9bb-4158-8d5c-a54637175ab8 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:33:59.204939 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-c58276eb-f9bb-4158-8d5c-a54637175ab8 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] HTTP exception thrown: Instance 71bc9bcc-a751-418d-9762-64ed92c65e1c could not be found. Oct 08 21:33:59.206548 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c58276eb-f9bb-4158-8d5c-a54637175ab8 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Request method failure captured: Oct 08 21:33:59.206548 ncdv-master-1 devstack@n-api.service[140491]: request: GET /compute/v2.1/servers/71bc9bcc-a751-418d-9762-64ed92c65e1c HTTP/1.1 Oct 08 21:33:59.206548 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:33:59.206548 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:33:59.206548 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:33:59.206548 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 21:33:59.206548 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:33:59.206548 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:33:59.206548 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:33:59.206548 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:33:59.206548 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeyESueD2G2p08fpZng5dUIvJRbscky3tGNIT1dlSRltWQwygOyYfQAwVe7KLvB4NB9Rvs7JJ6Z3bstxj1FPhWmo56k4nFHZVnko_1G4tfE_I1T9paCtzZG8sfJM33h9PLTo7_TpIQ4aSXx-QLhm7_UAuDXZaIvpFH6pLdWcKYlBxWo Oct 08 21:33:59.206548 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:33:59.206548 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:33:59.206548 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:33:59.206548 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:33:59.206548 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:33:59.206548 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:33:59.206548 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 8d9857e88402494e964f2099de5bb60c Oct 08 21:33:59.206548 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-TestVolumeBootPattern-1770467933 Oct 08 21:33:59.206548 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:33:59.206548 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:33:59.206548 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8d9857e88402494e964f2099de5bb60c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8d9857e88402494e964f2099de5bb60c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8d9857e88402494e964f2099de5bb60c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8d9857e88402494e964f2099de5bb60c"}]}] Oct 08 21:33:59.206548 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-TestVolumeBootPattern-1770467933 Oct 08 21:33:59.206548 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 8d9857e88402494e964f2099de5bb60c Oct 08 21:33:59.206548 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-TestVolumeBootPattern-1770467933 Oct 08 21:33:59.206548 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-TestVolumeBootPattern-1770467933-project Oct 08 21:33:59.206548 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:33:59.206548 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:33:59.206548 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 7ac4eff18a664804af16cf21321f9290 Oct 08 21:33:59.206548 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-TestVolumeBootPattern-1770467933-project Oct 08 21:33:59.206548 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:33:59.206548 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance 71bc9bcc-a751-418d-9762-64ed92c65e1c could not be found. Oct 08 21:33:59.206548 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': '71bc9bcc-a751-418d-9762-64ed92c65e1c'} Oct 08 21:33:59.206548 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:33:59.206548 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:33:59.206548 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:33:59.206548 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:33:59.206548 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:33:59.206548 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:33:59.206548 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:33:59.206548 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:33:59.206548 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:33:59.206548 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:33:59.206548 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71bc9bcc-a751-418d-9762-64ed92c65e1c could not be found. Oct 08 21:33:59.206548 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:33:59.206548 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:33:59.206548 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:33:59.206548 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:33:59.206548 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:33:59.206548 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:33:59.206548 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:33:59.206548 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:33:59.206548 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:33:59.206548 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:33:59.206548 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:33:59.206548 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:33:59.206548 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:33:59.206548 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:33:59.206548 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:33:59.206548 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:33:59.206548 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71bc9bcc-a751-418d-9762-64ed92c65e1c could not be found. Oct 08 21:33:59.206548 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:33:59.206548 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:33:59.206548 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:33:59.210624 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:33:59.210624 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:33:59.210624 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:33:59.210624 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:33:59.210624 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:33:59.210624 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71bc9bcc-a751-418d-9762-64ed92c65e1c could not be found. Oct 08 21:33:59.210624 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:33:59.210624 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c58276eb-f9bb-4158-8d5c-a54637175ab8 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Returning 404 to user: Instance 71bc9bcc-a751-418d-9762-64ed92c65e1c could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:33:59.210624 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-c58276eb-f9bb-4158-8d5c-a54637175ab8 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] 10.222.0.26 "GET /compute/v2.1/servers/71bc9bcc-a751-418d-9762-64ed92c65e1c" status: 404 len: 111 microversion: 2.1 time: 0.032233 Oct 08 21:33:59.212008 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3053/6177] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:33:59 2022] GET /compute/v2.1/servers/71bc9bcc-a751-418d-9762-64ed92c65e1c => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:34:30.285058 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-8bc419f5-2a09-4388-8627-864bae25ece4 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:34:30.285647 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-8bc419f5-2a09-4388-8627-864bae25ece4 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] [instance: 49141073-10f4-42fb-8fa5-1d8c8eca6d2e] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:34:30.288539 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:34:30.289235 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=53,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:34:30.296634 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8bc419f5-2a09-4388-8627-864bae25ece4 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:34:30.297152 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8bc419f5-2a09-4388-8627-864bae25ece4 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:34:30.297637 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8bc419f5-2a09-4388-8627-864bae25ece4 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:34:30.299011 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8bc419f5-2a09-4388-8627-864bae25ece4 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:34:30.299489 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8bc419f5-2a09-4388-8627-864bae25ece4 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:34:30.299945 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8bc419f5-2a09-4388-8627-864bae25ece4 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:34:30.326407 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-8bc419f5-2a09-4388-8627-864bae25ece4 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] [instance: 49141073-10f4-42fb-8fa5-1d8c8eca6d2e] Going to try to terminate instance {{(pid=140492) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 21:34:30.401755 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-8bc419f5-2a09-4388-8627-864bae25ece4 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] 10.222.0.26 "DELETE /compute/v2.1/servers/49141073-10f4-42fb-8fa5-1d8c8eca6d2e" status: 204 len: 0 microversion: 2.1 time: 0.120809 Oct 08 21:34:30.405707 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3125/6178] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:34:30 2022] DELETE /compute/v2.1/servers/49141073-10f4-42fb-8fa5-1d8c8eca6d2e => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 21:34:30.411897 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-f511a6a1-38fa-4999-a4ee-9cf927887989 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:34:30.413112 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-f511a6a1-38fa-4999-a4ee-9cf927887989 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] [instance: 49141073-10f4-42fb-8fa5-1d8c8eca6d2e] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:34:30.415330 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=3 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:34:30.418783 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=13 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:34:30.425609 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f511a6a1-38fa-4999-a4ee-9cf927887989 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:34:30.426116 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f511a6a1-38fa-4999-a4ee-9cf927887989 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:34:30.426574 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f511a6a1-38fa-4999-a4ee-9cf927887989 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:34:30.427303 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f511a6a1-38fa-4999-a4ee-9cf927887989 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:34:30.427777 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f511a6a1-38fa-4999-a4ee-9cf927887989 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:34:30.428219 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f511a6a1-38fa-4999-a4ee-9cf927887989 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:34:30.557814 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-f511a6a1-38fa-4999-a4ee-9cf927887989 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac4eff18a664804af16cf21321f9290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9857e88402494e964f2099de5bb60c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:34:30.565821 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-f511a6a1-38fa-4999-a4ee-9cf927887989 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] 10.222.0.26 "GET /compute/v2.1/servers/49141073-10f4-42fb-8fa5-1d8c8eca6d2e" status: 200 len: 1410 microversion: 2.1 time: 0.158764 Oct 08 21:34:30.566398 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3054/6179] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:34:30 2022] GET /compute/v2.1/servers/49141073-10f4-42fb-8fa5-1d8c8eca6d2e => generated 1410 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:34:31.590016 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-9e7156c8-9fe2-4bad-b24a-e94aaaeab339 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:34:31.590738 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-9e7156c8-9fe2-4bad-b24a-e94aaaeab339 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] [instance: 49141073-10f4-42fb-8fa5-1d8c8eca6d2e] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:34:31.598521 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9e7156c8-9fe2-4bad-b24a-e94aaaeab339 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:34:31.599027 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9e7156c8-9fe2-4bad-b24a-e94aaaeab339 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:34:31.599491 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9e7156c8-9fe2-4bad-b24a-e94aaaeab339 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:34:31.600209 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9e7156c8-9fe2-4bad-b24a-e94aaaeab339 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:34:31.600685 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9e7156c8-9fe2-4bad-b24a-e94aaaeab339 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:34:31.601132 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9e7156c8-9fe2-4bad-b24a-e94aaaeab339 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:34:31.737780 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-9e7156c8-9fe2-4bad-b24a-e94aaaeab339 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac4eff18a664804af16cf21321f9290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9857e88402494e964f2099de5bb60c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:34:31.745605 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-9e7156c8-9fe2-4bad-b24a-e94aaaeab339 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] 10.222.0.26 "GET /compute/v2.1/servers/49141073-10f4-42fb-8fa5-1d8c8eca6d2e" status: 200 len: 1410 microversion: 2.1 time: 0.160167 Oct 08 21:34:31.746177 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3126/6180] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:34:31 2022] GET /compute/v2.1/servers/49141073-10f4-42fb-8fa5-1d8c8eca6d2e => generated 1410 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:34:32.344417 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-a7a4a715-6e1b-427a-b86a-bcc4ca340ae2 req-a36913d8-603c-4403-9def-33071c78df5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49141073-10f4-42fb-8fa5-1d8c8eca6d2e", "name": "network-vif-deleted", "tag": "a594cece-e4f9-4d3f-ac43-adca4ac3762d"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:34:32.355031 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-a7a4a715-6e1b-427a-b86a-bcc4ca340ae2 req-a36913d8-603c-4403-9def-33071c78df5b service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:34:32.355517 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-a7a4a715-6e1b-427a-b86a-bcc4ca340ae2 req-a36913d8-603c-4403-9def-33071c78df5b service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:34:32.355957 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-a7a4a715-6e1b-427a-b86a-bcc4ca340ae2 req-a36913d8-603c-4403-9def-33071c78df5b service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:34:32.368347 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-a7a4a715-6e1b-427a-b86a-bcc4ca340ae2 req-a36913d8-603c-4403-9def-33071c78df5b service nova] Creating event network-vif-deleted:a594cece-e4f9-4d3f-ac43-adca4ac3762d for instance 49141073-10f4-42fb-8fa5-1d8c8eca6d2e on nch2-master-1 Oct 08 21:34:32.373366 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-a7a4a715-6e1b-427a-b86a-bcc4ca340ae2 req-a36913d8-603c-4403-9def-33071c78df5b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032624 Oct 08 21:34:32.373974 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3055/6181] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:34:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:34:32.768610 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-0cf4bcd3-1fa6-4265-aed3-27f5ceab0f82 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:34:32.769265 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-0cf4bcd3-1fa6-4265-aed3-27f5ceab0f82 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] [instance: 49141073-10f4-42fb-8fa5-1d8c8eca6d2e] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:34:32.777373 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0cf4bcd3-1fa6-4265-aed3-27f5ceab0f82 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:34:32.778200 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0cf4bcd3-1fa6-4265-aed3-27f5ceab0f82 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:34:32.778897 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0cf4bcd3-1fa6-4265-aed3-27f5ceab0f82 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:34:32.779712 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0cf4bcd3-1fa6-4265-aed3-27f5ceab0f82 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:34:32.780258 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0cf4bcd3-1fa6-4265-aed3-27f5ceab0f82 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:34:32.780965 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0cf4bcd3-1fa6-4265-aed3-27f5ceab0f82 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:34:32.820143 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0cf4bcd3-1fa6-4265-aed3-27f5ceab0f82 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:34:32.820731 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0cf4bcd3-1fa6-4265-aed3-27f5ceab0f82 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:34:32.821295 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0cf4bcd3-1fa6-4265-aed3-27f5ceab0f82 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:34:32.821831 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.objects.instance [None req-0cf4bcd3-1fa6-4265-aed3-27f5ceab0f82 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lazy-loading 'fault' on Instance uuid 49141073-10f4-42fb-8fa5-1d8c8eca6d2e {{(pid=140492) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 21:34:32.871358 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-0cf4bcd3-1fa6-4265-aed3-27f5ceab0f82 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac4eff18a664804af16cf21321f9290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9857e88402494e964f2099de5bb60c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:34:32.882042 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-0cf4bcd3-1fa6-4265-aed3-27f5ceab0f82 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] 10.222.0.26 "GET /compute/v2.1/servers/49141073-10f4-42fb-8fa5-1d8c8eca6d2e" status: 200 len: 1207 microversion: 2.1 time: 0.117522 Oct 08 21:34:32.885232 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3127/6182] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:34:32 2022] GET /compute/v2.1/servers/49141073-10f4-42fb-8fa5-1d8c8eca6d2e => generated 1207 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:34:33.908589 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-7f8653d2-29a1-40db-aa75-f50c12226bfa tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:34:33.909260 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-7f8653d2-29a1-40db-aa75-f50c12226bfa tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] [instance: 49141073-10f4-42fb-8fa5-1d8c8eca6d2e] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:34:33.915953 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7f8653d2-29a1-40db-aa75-f50c12226bfa tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:34:33.916458 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7f8653d2-29a1-40db-aa75-f50c12226bfa tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:34:33.916908 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7f8653d2-29a1-40db-aa75-f50c12226bfa tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:34:33.917655 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7f8653d2-29a1-40db-aa75-f50c12226bfa tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:34:33.918128 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7f8653d2-29a1-40db-aa75-f50c12226bfa tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:34:33.918567 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7f8653d2-29a1-40db-aa75-f50c12226bfa tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:34:33.934141 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-7f8653d2-29a1-40db-aa75-f50c12226bfa tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] HTTP exception thrown: Instance 49141073-10f4-42fb-8fa5-1d8c8eca6d2e could not be found. Oct 08 21:34:33.936124 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-7f8653d2-29a1-40db-aa75-f50c12226bfa tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Request method failure captured: Oct 08 21:34:33.936124 ncdv-master-1 devstack@n-api.service[140491]: request: GET /compute/v2.1/servers/49141073-10f4-42fb-8fa5-1d8c8eca6d2e HTTP/1.1 Oct 08 21:34:33.936124 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:34:33.936124 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:34:33.936124 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:34:33.936124 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 21:34:33.936124 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:34:33.936124 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:34:33.936124 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:34:33.936124 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:34:33.936124 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeyESueD2G2p08fpZng5dUIvJRbscky3tGNIT1dlSRltWQwygOyYfQAwVe7KLvB4NB9Rvs7JJ6Z3bstxj1FPhWmo56k4nFHZVnko_1G4tfE_I1T9paCtzZG8sfJM33h9PLTo7_TpIQ4aSXx-QLhm7_UAuDXZaIvpFH6pLdWcKYlBxWo Oct 08 21:34:33.936124 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:34:33.936124 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:34:33.936124 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:34:33.936124 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:34:33.936124 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:34:33.936124 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:34:33.936124 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 8d9857e88402494e964f2099de5bb60c Oct 08 21:34:33.936124 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-TestVolumeBootPattern-1770467933 Oct 08 21:34:33.936124 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:34:33.936124 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:34:33.936124 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8d9857e88402494e964f2099de5bb60c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8d9857e88402494e964f2099de5bb60c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8d9857e88402494e964f2099de5bb60c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8d9857e88402494e964f2099de5bb60c"}]}] Oct 08 21:34:33.936124 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-TestVolumeBootPattern-1770467933 Oct 08 21:34:33.936124 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 8d9857e88402494e964f2099de5bb60c Oct 08 21:34:33.936124 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-TestVolumeBootPattern-1770467933 Oct 08 21:34:33.936124 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-TestVolumeBootPattern-1770467933-project Oct 08 21:34:33.936124 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:34:33.936124 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:34:33.936124 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 7ac4eff18a664804af16cf21321f9290 Oct 08 21:34:33.936124 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-TestVolumeBootPattern-1770467933-project Oct 08 21:34:33.936124 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:34:33.936124 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance 49141073-10f4-42fb-8fa5-1d8c8eca6d2e could not be found. Oct 08 21:34:33.936124 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': '49141073-10f4-42fb-8fa5-1d8c8eca6d2e'} Oct 08 21:34:33.936124 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:34:33.936124 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:34:33.936124 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:34:33.936124 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:34:33.936124 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:34:33.936124 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:34:33.936124 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:34:33.936124 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:34:33.936124 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:34:33.936124 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:34:33.936124 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49141073-10f4-42fb-8fa5-1d8c8eca6d2e could not be found. Oct 08 21:34:33.936124 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:34:33.936124 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:34:33.936124 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:34:33.936124 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:34:33.936124 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:34:33.936124 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:34:33.936124 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:34:33.936124 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:34:33.936124 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:34:33.936124 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:34:33.936124 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:34:33.936124 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:34:33.936124 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:34:33.936124 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:34:33.936124 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:34:33.936124 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:34:33.936124 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49141073-10f4-42fb-8fa5-1d8c8eca6d2e could not be found. Oct 08 21:34:33.936124 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:34:33.936124 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:34:33.936124 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:34:33.940842 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:34:33.940842 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:34:33.940842 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:34:33.940842 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:34:33.940842 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:34:33.940842 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49141073-10f4-42fb-8fa5-1d8c8eca6d2e could not be found. Oct 08 21:34:33.940842 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:34:33.940842 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-7f8653d2-29a1-40db-aa75-f50c12226bfa tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Returning 404 to user: Instance 49141073-10f4-42fb-8fa5-1d8c8eca6d2e could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:34:33.940842 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-7f8653d2-29a1-40db-aa75-f50c12226bfa tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] 10.222.0.26 "GET /compute/v2.1/servers/49141073-10f4-42fb-8fa5-1d8c8eca6d2e" status: 404 len: 111 microversion: 2.1 time: 0.035595 Oct 08 21:34:33.940842 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3056/6183] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:34:33 2022] GET /compute/v2.1/servers/49141073-10f4-42fb-8fa5-1d8c8eca6d2e => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:34:35.025561 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-ca712dce-375e-42c8-9227-16e4ea830f7b tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:34:35.026122 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-ca712dce-375e-42c8-9227-16e4ea830f7b tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] [instance: 71bc9bcc-a751-418d-9762-64ed92c65e1c] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:34:35.032872 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ca712dce-375e-42c8-9227-16e4ea830f7b tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:34:35.033415 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ca712dce-375e-42c8-9227-16e4ea830f7b tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:34:35.033875 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ca712dce-375e-42c8-9227-16e4ea830f7b tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:34:35.034590 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ca712dce-375e-42c8-9227-16e4ea830f7b tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:34:35.035065 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ca712dce-375e-42c8-9227-16e4ea830f7b tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:34:35.035513 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ca712dce-375e-42c8-9227-16e4ea830f7b tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:34:35.049175 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-ca712dce-375e-42c8-9227-16e4ea830f7b tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] HTTP exception thrown: Instance 71bc9bcc-a751-418d-9762-64ed92c65e1c could not be found. Oct 08 21:34:35.050876 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-ca712dce-375e-42c8-9227-16e4ea830f7b tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Request method failure captured: Oct 08 21:34:35.050876 ncdv-master-1 devstack@n-api.service[140492]: request: DELETE /compute/v2.1/servers/71bc9bcc-a751-418d-9762-64ed92c65e1c HTTP/1.1 Oct 08 21:34:35.050876 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:34:35.050876 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:34:35.050876 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:34:35.050876 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 21:34:35.050876 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:34:35.050876 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:34:35.050876 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:34:35.050876 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:34:35.050876 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeyESueD2G2p08fpZng5dUIvJRbscky3tGNIT1dlSRltWQwygOyYfQAwVe7KLvB4NB9Rvs7JJ6Z3bstxj1FPhWmo56k4nFHZVnko_1G4tfE_I1T9paCtzZG8sfJM33h9PLTo7_TpIQ4aSXx-QLhm7_UAuDXZaIvpFH6pLdWcKYlBxWo Oct 08 21:34:35.050876 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:34:35.050876 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:34:35.050876 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:34:35.050876 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:34:35.050876 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:34:35.050876 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:34:35.050876 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 8d9857e88402494e964f2099de5bb60c Oct 08 21:34:35.050876 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-TestVolumeBootPattern-1770467933 Oct 08 21:34:35.050876 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:34:35.050876 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:34:35.050876 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8d9857e88402494e964f2099de5bb60c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8d9857e88402494e964f2099de5bb60c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8d9857e88402494e964f2099de5bb60c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8d9857e88402494e964f2099de5bb60c"}]}] Oct 08 21:34:35.050876 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-TestVolumeBootPattern-1770467933 Oct 08 21:34:35.050876 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 8d9857e88402494e964f2099de5bb60c Oct 08 21:34:35.050876 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-TestVolumeBootPattern-1770467933 Oct 08 21:34:35.050876 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-TestVolumeBootPattern-1770467933-project Oct 08 21:34:35.050876 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:34:35.050876 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:34:35.050876 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 7ac4eff18a664804af16cf21321f9290 Oct 08 21:34:35.050876 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-TestVolumeBootPattern-1770467933-project Oct 08 21:34:35.050876 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 21:34:35.050876 ncdv-master-1 devstack@n-api.service[140492]: exception: Instance 71bc9bcc-a751-418d-9762-64ed92c65e1c could not be found. Oct 08 21:34:35.050876 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': '71bc9bcc-a751-418d-9762-64ed92c65e1c'} Oct 08 21:34:35.050876 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:34:35.050876 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:34:35.050876 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:34:35.050876 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:34:35.050876 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:34:35.050876 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:34:35.050876 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:34:35.050876 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:34:35.050876 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:34:35.050876 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:34:35.050876 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71bc9bcc-a751-418d-9762-64ed92c65e1c could not be found. Oct 08 21:34:35.050876 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:34:35.050876 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:34:35.050876 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:34:35.050876 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:34:35.050876 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:34:35.050876 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:34:35.050876 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:34:35.050876 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:34:35.050876 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:34:35.050876 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:34:35.050876 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 08 21:34:35.050876 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 08 21:34:35.050876 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 08 21:34:35.050876 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 08 21:34:35.050876 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:34:35.050876 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:34:35.050876 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:34:35.050876 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:34:35.055251 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71bc9bcc-a751-418d-9762-64ed92c65e1c could not be found. Oct 08 21:34:35.055251 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:34:35.055251 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:34:35.055251 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:34:35.055251 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:34:35.055251 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:34:35.055251 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:34:35.055251 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:34:35.055251 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:34:35.055251 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71bc9bcc-a751-418d-9762-64ed92c65e1c could not be found. Oct 08 21:34:35.055251 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:34:35.055251 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-ca712dce-375e-42c8-9227-16e4ea830f7b tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Returning 404 to user: Instance 71bc9bcc-a751-418d-9762-64ed92c65e1c could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:34:35.055251 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-ca712dce-375e-42c8-9227-16e4ea830f7b tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] 10.222.0.26 "DELETE /compute/v2.1/servers/71bc9bcc-a751-418d-9762-64ed92c65e1c" status: 404 len: 111 microversion: 2.1 time: 0.030607 Oct 08 21:34:35.056309 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3128/6184] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:34:35 2022] DELETE /compute/v2.1/servers/71bc9bcc-a751-418d-9762-64ed92c65e1c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:34:35.060883 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-55706d8a-ef2c-4c18-85e5-b0518adbe706 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:34:35.061526 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-55706d8a-ef2c-4c18-85e5-b0518adbe706 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] [instance: 71bc9bcc-a751-418d-9762-64ed92c65e1c] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:34:35.069111 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-55706d8a-ef2c-4c18-85e5-b0518adbe706 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:34:35.069644 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-55706d8a-ef2c-4c18-85e5-b0518adbe706 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:34:35.070095 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-55706d8a-ef2c-4c18-85e5-b0518adbe706 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:34:35.070916 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-55706d8a-ef2c-4c18-85e5-b0518adbe706 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:34:35.071387 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-55706d8a-ef2c-4c18-85e5-b0518adbe706 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:34:35.071828 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-55706d8a-ef2c-4c18-85e5-b0518adbe706 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:34:35.085438 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-55706d8a-ef2c-4c18-85e5-b0518adbe706 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] HTTP exception thrown: Instance 71bc9bcc-a751-418d-9762-64ed92c65e1c could not be found. Oct 08 21:34:35.086976 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-55706d8a-ef2c-4c18-85e5-b0518adbe706 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Request method failure captured: Oct 08 21:34:35.086976 ncdv-master-1 devstack@n-api.service[140491]: request: GET /compute/v2.1/servers/71bc9bcc-a751-418d-9762-64ed92c65e1c HTTP/1.1 Oct 08 21:34:35.086976 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:34:35.086976 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:34:35.086976 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:34:35.086976 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 21:34:35.086976 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:34:35.086976 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:34:35.086976 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:34:35.086976 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:34:35.086976 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeyESueD2G2p08fpZng5dUIvJRbscky3tGNIT1dlSRltWQwygOyYfQAwVe7KLvB4NB9Rvs7JJ6Z3bstxj1FPhWmo56k4nFHZVnko_1G4tfE_I1T9paCtzZG8sfJM33h9PLTo7_TpIQ4aSXx-QLhm7_UAuDXZaIvpFH6pLdWcKYlBxWo Oct 08 21:34:35.086976 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:34:35.086976 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:34:35.086976 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:34:35.086976 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:34:35.086976 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:34:35.086976 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:34:35.086976 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 8d9857e88402494e964f2099de5bb60c Oct 08 21:34:35.086976 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-TestVolumeBootPattern-1770467933 Oct 08 21:34:35.086976 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:34:35.086976 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:34:35.086976 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8d9857e88402494e964f2099de5bb60c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8d9857e88402494e964f2099de5bb60c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8d9857e88402494e964f2099de5bb60c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8d9857e88402494e964f2099de5bb60c"}]}] Oct 08 21:34:35.086976 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-TestVolumeBootPattern-1770467933 Oct 08 21:34:35.086976 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 8d9857e88402494e964f2099de5bb60c Oct 08 21:34:35.086976 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-TestVolumeBootPattern-1770467933 Oct 08 21:34:35.086976 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-TestVolumeBootPattern-1770467933-project Oct 08 21:34:35.086976 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:34:35.086976 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:34:35.086976 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 7ac4eff18a664804af16cf21321f9290 Oct 08 21:34:35.086976 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-TestVolumeBootPattern-1770467933-project Oct 08 21:34:35.086976 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:34:35.086976 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance 71bc9bcc-a751-418d-9762-64ed92c65e1c could not be found. Oct 08 21:34:35.086976 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': '71bc9bcc-a751-418d-9762-64ed92c65e1c'} Oct 08 21:34:35.086976 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:34:35.086976 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:34:35.086976 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:34:35.086976 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:34:35.086976 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:34:35.086976 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:34:35.086976 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:34:35.086976 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:34:35.086976 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:34:35.086976 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:34:35.086976 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71bc9bcc-a751-418d-9762-64ed92c65e1c could not be found. Oct 08 21:34:35.086976 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:34:35.086976 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:34:35.086976 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:34:35.086976 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:34:35.086976 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:34:35.086976 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:34:35.086976 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:34:35.086976 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:34:35.086976 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:34:35.086976 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:34:35.086976 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:34:35.086976 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:34:35.086976 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:34:35.086976 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:34:35.086976 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:34:35.086976 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:34:35.086976 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71bc9bcc-a751-418d-9762-64ed92c65e1c could not be found. Oct 08 21:34:35.086976 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:34:35.086976 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:34:35.086976 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:34:35.091914 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:34:35.091914 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:34:35.091914 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:34:35.091914 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:34:35.091914 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:34:35.091914 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71bc9bcc-a751-418d-9762-64ed92c65e1c could not be found. Oct 08 21:34:35.091914 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:34:35.091914 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-55706d8a-ef2c-4c18-85e5-b0518adbe706 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Returning 404 to user: Instance 71bc9bcc-a751-418d-9762-64ed92c65e1c could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:34:35.091914 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-55706d8a-ef2c-4c18-85e5-b0518adbe706 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] 10.222.0.26 "GET /compute/v2.1/servers/71bc9bcc-a751-418d-9762-64ed92c65e1c" status: 404 len: 111 microversion: 2.1 time: 0.031425 Oct 08 21:34:35.091914 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3057/6185] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:34:35 2022] GET /compute/v2.1/servers/71bc9bcc-a751-418d-9762-64ed92c65e1c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:34:35.551548 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-17403e16-4bb7-4e4e-940f-aaf4912016fc tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:34:35.552172 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-17403e16-4bb7-4e4e-940f-aaf4912016fc tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] [instance: 49141073-10f4-42fb-8fa5-1d8c8eca6d2e] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:34:35.558236 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-17403e16-4bb7-4e4e-940f-aaf4912016fc tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:34:35.558746 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-17403e16-4bb7-4e4e-940f-aaf4912016fc tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:34:35.559242 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-17403e16-4bb7-4e4e-940f-aaf4912016fc tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:34:35.559957 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-17403e16-4bb7-4e4e-940f-aaf4912016fc tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:34:35.560438 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-17403e16-4bb7-4e4e-940f-aaf4912016fc tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:34:35.560888 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-17403e16-4bb7-4e4e-940f-aaf4912016fc tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:34:35.574738 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-17403e16-4bb7-4e4e-940f-aaf4912016fc tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] HTTP exception thrown: Instance 49141073-10f4-42fb-8fa5-1d8c8eca6d2e could not be found. Oct 08 21:34:35.576275 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-17403e16-4bb7-4e4e-940f-aaf4912016fc tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Request method failure captured: Oct 08 21:34:35.576275 ncdv-master-1 devstack@n-api.service[140492]: request: DELETE /compute/v2.1/servers/49141073-10f4-42fb-8fa5-1d8c8eca6d2e HTTP/1.1 Oct 08 21:34:35.576275 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:34:35.576275 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:34:35.576275 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:34:35.576275 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 21:34:35.576275 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:34:35.576275 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:34:35.576275 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:34:35.576275 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:34:35.576275 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeyESueD2G2p08fpZng5dUIvJRbscky3tGNIT1dlSRltWQwygOyYfQAwVe7KLvB4NB9Rvs7JJ6Z3bstxj1FPhWmo56k4nFHZVnko_1G4tfE_I1T9paCtzZG8sfJM33h9PLTo7_TpIQ4aSXx-QLhm7_UAuDXZaIvpFH6pLdWcKYlBxWo Oct 08 21:34:35.576275 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:34:35.576275 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:34:35.576275 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:34:35.576275 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:34:35.576275 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:34:35.576275 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:34:35.576275 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 8d9857e88402494e964f2099de5bb60c Oct 08 21:34:35.576275 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-TestVolumeBootPattern-1770467933 Oct 08 21:34:35.576275 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:34:35.576275 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:34:35.576275 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8d9857e88402494e964f2099de5bb60c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8d9857e88402494e964f2099de5bb60c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8d9857e88402494e964f2099de5bb60c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8d9857e88402494e964f2099de5bb60c"}]}] Oct 08 21:34:35.576275 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-TestVolumeBootPattern-1770467933 Oct 08 21:34:35.576275 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 8d9857e88402494e964f2099de5bb60c Oct 08 21:34:35.576275 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-TestVolumeBootPattern-1770467933 Oct 08 21:34:35.576275 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-TestVolumeBootPattern-1770467933-project Oct 08 21:34:35.576275 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:34:35.576275 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:34:35.576275 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 7ac4eff18a664804af16cf21321f9290 Oct 08 21:34:35.576275 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-TestVolumeBootPattern-1770467933-project Oct 08 21:34:35.576275 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 21:34:35.576275 ncdv-master-1 devstack@n-api.service[140492]: exception: Instance 49141073-10f4-42fb-8fa5-1d8c8eca6d2e could not be found. Oct 08 21:34:35.576275 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': '49141073-10f4-42fb-8fa5-1d8c8eca6d2e'} Oct 08 21:34:35.576275 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:34:35.576275 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:34:35.576275 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:34:35.576275 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:34:35.576275 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:34:35.576275 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:34:35.576275 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:34:35.576275 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:34:35.576275 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:34:35.576275 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:34:35.576275 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49141073-10f4-42fb-8fa5-1d8c8eca6d2e could not be found. Oct 08 21:34:35.576275 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:34:35.576275 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:34:35.576275 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:34:35.576275 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:34:35.576275 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:34:35.576275 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:34:35.576275 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:34:35.576275 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:34:35.576275 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:34:35.576275 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:34:35.576275 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 08 21:34:35.576275 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 08 21:34:35.576275 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 08 21:34:35.576275 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 08 21:34:35.576275 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:34:35.576275 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:34:35.576275 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:34:35.576275 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:34:35.580590 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49141073-10f4-42fb-8fa5-1d8c8eca6d2e could not be found. Oct 08 21:34:35.580590 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:34:35.580590 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:34:35.580590 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:34:35.580590 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:34:35.580590 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:34:35.580590 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:34:35.580590 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:34:35.580590 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:34:35.580590 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49141073-10f4-42fb-8fa5-1d8c8eca6d2e could not be found. Oct 08 21:34:35.580590 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:34:35.580590 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-17403e16-4bb7-4e4e-940f-aaf4912016fc tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Returning 404 to user: Instance 49141073-10f4-42fb-8fa5-1d8c8eca6d2e could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:34:35.580590 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-17403e16-4bb7-4e4e-940f-aaf4912016fc tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] 10.222.0.26 "DELETE /compute/v2.1/servers/49141073-10f4-42fb-8fa5-1d8c8eca6d2e" status: 404 len: 111 microversion: 2.1 time: 0.030079 Oct 08 21:34:35.580590 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3129/6186] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:34:35 2022] DELETE /compute/v2.1/servers/49141073-10f4-42fb-8fa5-1d8c8eca6d2e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:34:35.587496 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-0dbdbb14-51e4-48d5-a408-8d91ae7339da tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:34:35.588118 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-0dbdbb14-51e4-48d5-a408-8d91ae7339da tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] [instance: 49141073-10f4-42fb-8fa5-1d8c8eca6d2e] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:34:35.594664 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0dbdbb14-51e4-48d5-a408-8d91ae7339da tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:34:35.595166 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0dbdbb14-51e4-48d5-a408-8d91ae7339da tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:34:35.595615 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0dbdbb14-51e4-48d5-a408-8d91ae7339da tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:34:35.596328 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0dbdbb14-51e4-48d5-a408-8d91ae7339da tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:34:35.596799 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0dbdbb14-51e4-48d5-a408-8d91ae7339da tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:34:35.597260 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0dbdbb14-51e4-48d5-a408-8d91ae7339da tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:34:35.611694 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-0dbdbb14-51e4-48d5-a408-8d91ae7339da tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] HTTP exception thrown: Instance 49141073-10f4-42fb-8fa5-1d8c8eca6d2e could not be found. Oct 08 21:34:35.613279 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-0dbdbb14-51e4-48d5-a408-8d91ae7339da tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Request method failure captured: Oct 08 21:34:35.613279 ncdv-master-1 devstack@n-api.service[140491]: request: GET /compute/v2.1/servers/49141073-10f4-42fb-8fa5-1d8c8eca6d2e HTTP/1.1 Oct 08 21:34:35.613279 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:34:35.613279 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:34:35.613279 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:34:35.613279 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 21:34:35.613279 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:34:35.613279 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:34:35.613279 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:34:35.613279 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:34:35.613279 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeyESueD2G2p08fpZng5dUIvJRbscky3tGNIT1dlSRltWQwygOyYfQAwVe7KLvB4NB9Rvs7JJ6Z3bstxj1FPhWmo56k4nFHZVnko_1G4tfE_I1T9paCtzZG8sfJM33h9PLTo7_TpIQ4aSXx-QLhm7_UAuDXZaIvpFH6pLdWcKYlBxWo Oct 08 21:34:35.613279 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:34:35.613279 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:34:35.613279 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:34:35.613279 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:34:35.613279 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:34:35.613279 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:34:35.613279 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 8d9857e88402494e964f2099de5bb60c Oct 08 21:34:35.613279 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-TestVolumeBootPattern-1770467933 Oct 08 21:34:35.613279 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:34:35.613279 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:34:35.613279 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8d9857e88402494e964f2099de5bb60c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8d9857e88402494e964f2099de5bb60c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8d9857e88402494e964f2099de5bb60c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8d9857e88402494e964f2099de5bb60c"}]}] Oct 08 21:34:35.613279 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-TestVolumeBootPattern-1770467933 Oct 08 21:34:35.613279 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 8d9857e88402494e964f2099de5bb60c Oct 08 21:34:35.613279 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-TestVolumeBootPattern-1770467933 Oct 08 21:34:35.613279 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-TestVolumeBootPattern-1770467933-project Oct 08 21:34:35.613279 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:34:35.613279 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:34:35.613279 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 7ac4eff18a664804af16cf21321f9290 Oct 08 21:34:35.613279 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-TestVolumeBootPattern-1770467933-project Oct 08 21:34:35.613279 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:34:35.613279 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance 49141073-10f4-42fb-8fa5-1d8c8eca6d2e could not be found. Oct 08 21:34:35.613279 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': '49141073-10f4-42fb-8fa5-1d8c8eca6d2e'} Oct 08 21:34:35.613279 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:34:35.613279 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:34:35.613279 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:34:35.613279 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:34:35.613279 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:34:35.613279 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:34:35.613279 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:34:35.613279 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:34:35.613279 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:34:35.613279 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:34:35.613279 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49141073-10f4-42fb-8fa5-1d8c8eca6d2e could not be found. Oct 08 21:34:35.613279 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:34:35.613279 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:34:35.613279 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:34:35.613279 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:34:35.613279 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:34:35.613279 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:34:35.613279 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:34:35.613279 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:34:35.613279 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:34:35.613279 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:34:35.613279 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:34:35.613279 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:34:35.613279 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:34:35.613279 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:34:35.613279 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:34:35.613279 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:34:35.613279 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49141073-10f4-42fb-8fa5-1d8c8eca6d2e could not be found. Oct 08 21:34:35.613279 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:34:35.613279 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:34:35.613279 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:34:35.619524 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:34:35.619524 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:34:35.619524 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:34:35.619524 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:34:35.619524 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:34:35.619524 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49141073-10f4-42fb-8fa5-1d8c8eca6d2e could not be found. Oct 08 21:34:35.619524 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:34:35.619524 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-0dbdbb14-51e4-48d5-a408-8d91ae7339da tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Returning 404 to user: Instance 49141073-10f4-42fb-8fa5-1d8c8eca6d2e could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:34:35.619524 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-0dbdbb14-51e4-48d5-a408-8d91ae7339da tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] 10.222.0.26 "GET /compute/v2.1/servers/49141073-10f4-42fb-8fa5-1d8c8eca6d2e" status: 404 len: 111 microversion: 2.1 time: 0.033063 Oct 08 21:34:35.619524 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3058/6187] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:34:35 2022] GET /compute/v2.1/servers/49141073-10f4-42fb-8fa5-1d8c8eca6d2e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 08 21:34:35.685365 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-52fa0d45-4477-40a5-886f-f1983a0c6d68 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Action: 'create', calling method: .version_select at 0x7f1a8d02ef70>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-281319770", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBl0tzFt/ekgwIIWHo+M0awzafEtIuAIURDKKoBTB5TDXPA47T2TCOulbuG/wE1X0IgJoTxABW+LfiSVt2cPx4fpbjXOCSy6dDd+TB2oIH1mjWCOFQA03Tqqa5xMBcRI/Q=="}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:34:35.701952 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-52fa0d45-4477-40a5-886f-f1983a0c6d68 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Getting quotas for project 8d9857e88402494e964f2099de5bb60c. Resources: {'key_pairs'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:34:35.707178 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-52fa0d45-4477-40a5-886f-f1983a0c6d68 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Getting quotas for user 7ac4eff18a664804af16cf21321f9290 and project 8d9857e88402494e964f2099de5bb60c. Resources: {'key_pairs'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:34:35.730087 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-52fa0d45-4477-40a5-886f-f1983a0c6d68 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.048601 Oct 08 21:34:35.730696 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3130/6188] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Oct 8 21:34:35 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:34:38.225498 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-568df2fd-57d5-4b6b-8047-577f62fe8341 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1984880928", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-281319770", "security_groups": [{"name": "tempest-secgroup-smoke-441952254"}], "block_device_mapping_v2": [{"uuid": "35b4d884-2f36-4b2a-b436-df821ca02419", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "4d64b136-ce87-445f-a822-d4ba1b8b55a2"}]}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:34:38.346156 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.network.neutron [None req-568df2fd-57d5-4b6b-8047-577f62fe8341 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] validate_networks() for [('4d64b136-ce87-445f-a822-d4ba1b8b55a2', None, None, None, None, None)] {{(pid=140491) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 21:34:38.728741 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-568df2fd-57d5-4b6b-8047-577f62fe8341 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Flavor limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 21:34:38.729173 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-568df2fd-57d5-4b6b-8047-577f62fe8341 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Image limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 21:34:38.729682 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-568df2fd-57d5-4b6b-8047-577f62fe8341 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Flavor pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 21:34:38.730097 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-568df2fd-57d5-4b6b-8047-577f62fe8341 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Image pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 21:34:38.730515 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-568df2fd-57d5-4b6b-8047-577f62fe8341 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 21:34:38.739571 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-568df2fd-57d5-4b6b-8047-577f62fe8341 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:34:38.740052 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-568df2fd-57d5-4b6b-8047-577f62fe8341 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:34:38.740492 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-568df2fd-57d5-4b6b-8047-577f62fe8341 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:34:38.741246 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-568df2fd-57d5-4b6b-8047-577f62fe8341 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:34:38.741711 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-568df2fd-57d5-4b6b-8047-577f62fe8341 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:34:38.742140 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-568df2fd-57d5-4b6b-8047-577f62fe8341 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:34:38.759077 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-568df2fd-57d5-4b6b-8047-577f62fe8341 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Getting quotas for project 8d9857e88402494e964f2099de5bb60c. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:34:38.764351 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-568df2fd-57d5-4b6b-8047-577f62fe8341 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Getting quotas for user 7ac4eff18a664804af16cf21321f9290 and project 8d9857e88402494e964f2099de5bb60c. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:34:38.828031 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-568df2fd-57d5-4b6b-8047-577f62fe8341 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Going to run 1 instances... {{(pid=140491) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 21:34:38.830768 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-568df2fd-57d5-4b6b-8047-577f62fe8341 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] [instance: aee8a6a8-6de5-42bd-a185-4bacc2b1e490] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='35b4d884-2f36-4b2a-b436-df821ca02419',volume_size=None,volume_type=None)] {{(pid=140491) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 21:34:38.958323 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-568df2fd-57d5-4b6b-8047-577f62fe8341 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.736698 Oct 08 21:34:38.958977 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3059/6189] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 21:34:38 2022] POST /compute/v2.1/servers => generated 405 bytes in 738 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 08 21:34:38.972032 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-4837e998-2c4c-4ac5-a99c-d34e33a220aa tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:34:38.972674 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-4837e998-2c4c-4ac5-a99c-d34e33a220aa tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] [instance: aee8a6a8-6de5-42bd-a185-4bacc2b1e490] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:34:39.036448 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-4837e998-2c4c-4ac5-a99c-d34e33a220aa tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac4eff18a664804af16cf21321f9290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9857e88402494e964f2099de5bb60c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:34:39.043549 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-4837e998-2c4c-4ac5-a99c-d34e33a220aa tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] 10.222.0.26 "GET /compute/v2.1/servers/aee8a6a8-6de5-42bd-a185-4bacc2b1e490" status: 200 len: 1094 microversion: 2.1 time: 0.077094 Oct 08 21:34:39.044059 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3131/6190] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:34:38 2022] GET /compute/v2.1/servers/aee8a6a8-6de5-42bd-a185-4bacc2b1e490 => generated 1094 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:34:40.066419 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-a1f01f00-8e26-47d5-89c9-3fe4ce9d3d9c tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:34:40.067045 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-a1f01f00-8e26-47d5-89c9-3fe4ce9d3d9c tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] [instance: aee8a6a8-6de5-42bd-a185-4bacc2b1e490] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:34:40.073390 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a1f01f00-8e26-47d5-89c9-3fe4ce9d3d9c tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:34:40.073897 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a1f01f00-8e26-47d5-89c9-3fe4ce9d3d9c tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:34:40.074350 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a1f01f00-8e26-47d5-89c9-3fe4ce9d3d9c tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:34:40.075067 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a1f01f00-8e26-47d5-89c9-3fe4ce9d3d9c tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:34:40.075539 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a1f01f00-8e26-47d5-89c9-3fe4ce9d3d9c tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:34:40.075980 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a1f01f00-8e26-47d5-89c9-3fe4ce9d3d9c tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:34:40.173663 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-a1f01f00-8e26-47d5-89c9-3fe4ce9d3d9c tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac4eff18a664804af16cf21321f9290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9857e88402494e964f2099de5bb60c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:34:40.187042 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-a1f01f00-8e26-47d5-89c9-3fe4ce9d3d9c tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] 10.222.0.26 "GET /compute/v2.1/servers/aee8a6a8-6de5-42bd-a185-4bacc2b1e490" status: 200 len: 1192 microversion: 2.1 time: 0.125387 Oct 08 21:34:40.187695 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3060/6191] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:34:40 2022] GET /compute/v2.1/servers/aee8a6a8-6de5-42bd-a185-4bacc2b1e490 => generated 1192 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:34:41.210693 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-f63033ea-41ef-4cf4-8643-3a2292f491dc tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:34:41.211338 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-f63033ea-41ef-4cf4-8643-3a2292f491dc tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] [instance: aee8a6a8-6de5-42bd-a185-4bacc2b1e490] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:34:41.220204 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f63033ea-41ef-4cf4-8643-3a2292f491dc tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:34:41.221002 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f63033ea-41ef-4cf4-8643-3a2292f491dc tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:34:41.221711 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f63033ea-41ef-4cf4-8643-3a2292f491dc tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:34:41.222665 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f63033ea-41ef-4cf4-8643-3a2292f491dc tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:34:41.223157 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f63033ea-41ef-4cf4-8643-3a2292f491dc tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:34:41.223796 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f63033ea-41ef-4cf4-8643-3a2292f491dc tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:34:41.381620 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-f63033ea-41ef-4cf4-8643-3a2292f491dc tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac4eff18a664804af16cf21321f9290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9857e88402494e964f2099de5bb60c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:34:41.392447 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-f63033ea-41ef-4cf4-8643-3a2292f491dc tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] 10.222.0.26 "GET /compute/v2.1/servers/aee8a6a8-6de5-42bd-a185-4bacc2b1e490" status: 200 len: 1277 microversion: 2.1 time: 0.184087 Oct 08 21:34:41.393403 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3132/6192] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:34:41 2022] GET /compute/v2.1/servers/aee8a6a8-6de5-42bd-a185-4bacc2b1e490 => generated 1277 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:34:41.602801 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-7ec7a9fd-3548-4f67-95c0-f9187127b272 req-292d4135-fb4f-4f95-945a-f85fd7c2d202 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aee8a6a8-6de5-42bd-a185-4bacc2b1e490", "tag": "c6426c28-b0b1-4f00-bdb9-3b64dec793de"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:34:41.614503 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-7ec7a9fd-3548-4f67-95c0-f9187127b272 req-292d4135-fb4f-4f95-945a-f85fd7c2d202 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:34:41.615104 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-7ec7a9fd-3548-4f67-95c0-f9187127b272 req-292d4135-fb4f-4f95-945a-f85fd7c2d202 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:34:41.615629 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-7ec7a9fd-3548-4f67-95c0-f9187127b272 req-292d4135-fb4f-4f95-945a-f85fd7c2d202 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:34:41.628905 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-7ec7a9fd-3548-4f67-95c0-f9187127b272 req-292d4135-fb4f-4f95-945a-f85fd7c2d202 service nova] Creating event network-changed:c6426c28-b0b1-4f00-bdb9-3b64dec793de for instance aee8a6a8-6de5-42bd-a185-4bacc2b1e490 on nch1-master-1 Oct 08 21:34:41.634096 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-7ec7a9fd-3548-4f67-95c0-f9187127b272 req-292d4135-fb4f-4f95-945a-f85fd7c2d202 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035115 Oct 08 21:34:41.634885 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3061/6193] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:34:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 08 21:34:42.415959 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-efc89cd9-dfa9-4242-a345-b1111b6eff00 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:34:42.416626 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-efc89cd9-dfa9-4242-a345-b1111b6eff00 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] [instance: aee8a6a8-6de5-42bd-a185-4bacc2b1e490] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:34:42.424025 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-efc89cd9-dfa9-4242-a345-b1111b6eff00 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:34:42.424541 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-efc89cd9-dfa9-4242-a345-b1111b6eff00 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:34:42.425032 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-efc89cd9-dfa9-4242-a345-b1111b6eff00 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:34:42.425889 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-efc89cd9-dfa9-4242-a345-b1111b6eff00 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:34:42.426373 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-efc89cd9-dfa9-4242-a345-b1111b6eff00 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:34:42.426827 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-efc89cd9-dfa9-4242-a345-b1111b6eff00 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:34:42.563584 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-efc89cd9-dfa9-4242-a345-b1111b6eff00 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac4eff18a664804af16cf21321f9290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9857e88402494e964f2099de5bb60c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:34:42.571407 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-efc89cd9-dfa9-4242-a345-b1111b6eff00 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] 10.222.0.26 "GET /compute/v2.1/servers/aee8a6a8-6de5-42bd-a185-4bacc2b1e490" status: 200 len: 1265 microversion: 2.1 time: 0.159407 Oct 08 21:34:42.571991 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3133/6194] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:34:42 2022] GET /compute/v2.1/servers/aee8a6a8-6de5-42bd-a185-4bacc2b1e490 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:34:43.597121 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-ab8523dc-2d45-4718-bbd6-169e253b1aad tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:34:43.597774 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-ab8523dc-2d45-4718-bbd6-169e253b1aad tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] [instance: aee8a6a8-6de5-42bd-a185-4bacc2b1e490] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:34:43.604032 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ab8523dc-2d45-4718-bbd6-169e253b1aad tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:34:43.604521 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ab8523dc-2d45-4718-bbd6-169e253b1aad tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:34:43.604965 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ab8523dc-2d45-4718-bbd6-169e253b1aad tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:34:43.605686 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ab8523dc-2d45-4718-bbd6-169e253b1aad tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:34:43.606149 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ab8523dc-2d45-4718-bbd6-169e253b1aad tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:34:43.606577 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ab8523dc-2d45-4718-bbd6-169e253b1aad tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:34:43.740640 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-ab8523dc-2d45-4718-bbd6-169e253b1aad tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac4eff18a664804af16cf21321f9290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9857e88402494e964f2099de5bb60c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:34:43.748341 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-ab8523dc-2d45-4718-bbd6-169e253b1aad tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] 10.222.0.26 "GET /compute/v2.1/servers/aee8a6a8-6de5-42bd-a185-4bacc2b1e490" status: 200 len: 1265 microversion: 2.1 time: 0.157102 Oct 08 21:34:43.748917 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3062/6195] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:34:43 2022] GET /compute/v2.1/servers/aee8a6a8-6de5-42bd-a185-4bacc2b1e490 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:34:44.770893 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-79f340bf-cb41-43e6-bb70-6fed0ab7d2e2 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:34:44.771529 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-79f340bf-cb41-43e6-bb70-6fed0ab7d2e2 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] [instance: aee8a6a8-6de5-42bd-a185-4bacc2b1e490] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:34:44.778542 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-79f340bf-cb41-43e6-bb70-6fed0ab7d2e2 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:34:44.779051 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-79f340bf-cb41-43e6-bb70-6fed0ab7d2e2 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:34:44.779516 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-79f340bf-cb41-43e6-bb70-6fed0ab7d2e2 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:34:44.780239 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-79f340bf-cb41-43e6-bb70-6fed0ab7d2e2 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:34:44.780722 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-79f340bf-cb41-43e6-bb70-6fed0ab7d2e2 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:34:44.781220 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-79f340bf-cb41-43e6-bb70-6fed0ab7d2e2 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:34:44.912339 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-79f340bf-cb41-43e6-bb70-6fed0ab7d2e2 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac4eff18a664804af16cf21321f9290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9857e88402494e964f2099de5bb60c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:34:44.920600 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-79f340bf-cb41-43e6-bb70-6fed0ab7d2e2 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] 10.222.0.26 "GET /compute/v2.1/servers/aee8a6a8-6de5-42bd-a185-4bacc2b1e490" status: 200 len: 1265 microversion: 2.1 time: 0.153655 Oct 08 21:34:44.921239 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3134/6196] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:34:44 2022] GET /compute/v2.1/servers/aee8a6a8-6de5-42bd-a185-4bacc2b1e490 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:34:45.944295 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-75ddd2df-684b-4143-90d6-093f2eaeef0e tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:34:45.944834 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-75ddd2df-684b-4143-90d6-093f2eaeef0e tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] [instance: aee8a6a8-6de5-42bd-a185-4bacc2b1e490] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:34:45.952012 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-75ddd2df-684b-4143-90d6-093f2eaeef0e tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:34:45.952508 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-75ddd2df-684b-4143-90d6-093f2eaeef0e tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:34:45.952955 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-75ddd2df-684b-4143-90d6-093f2eaeef0e tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:34:45.953696 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-75ddd2df-684b-4143-90d6-093f2eaeef0e tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:34:45.954842 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-75ddd2df-684b-4143-90d6-093f2eaeef0e tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:34:45.955308 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-75ddd2df-684b-4143-90d6-093f2eaeef0e tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:34:46.088543 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-75ddd2df-684b-4143-90d6-093f2eaeef0e tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac4eff18a664804af16cf21321f9290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9857e88402494e964f2099de5bb60c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:34:46.096477 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-75ddd2df-684b-4143-90d6-093f2eaeef0e tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] 10.222.0.26 "GET /compute/v2.1/servers/aee8a6a8-6de5-42bd-a185-4bacc2b1e490" status: 200 len: 1265 microversion: 2.1 time: 0.156233 Oct 08 21:34:46.097043 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3063/6197] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:34:45 2022] GET /compute/v2.1/servers/aee8a6a8-6de5-42bd-a185-4bacc2b1e490 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:34:46.708973 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-65840c84-3834-45c0-a5b9-53a09fe389ed req-08f580d5-6b60-405c-b39c-708b810eded7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aee8a6a8-6de5-42bd-a185-4bacc2b1e490", "name": "network-vif-plugged", "status": "completed", "tag": "c6426c28-b0b1-4f00-bdb9-3b64dec793de"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:34:46.719182 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-65840c84-3834-45c0-a5b9-53a09fe389ed req-08f580d5-6b60-405c-b39c-708b810eded7 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:34:46.719834 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-65840c84-3834-45c0-a5b9-53a09fe389ed req-08f580d5-6b60-405c-b39c-708b810eded7 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:34:46.720295 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-65840c84-3834-45c0-a5b9-53a09fe389ed req-08f580d5-6b60-405c-b39c-708b810eded7 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:34:46.731604 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-65840c84-3834-45c0-a5b9-53a09fe389ed req-08f580d5-6b60-405c-b39c-708b810eded7 service nova] Creating event network-vif-plugged:c6426c28-b0b1-4f00-bdb9-3b64dec793de for instance aee8a6a8-6de5-42bd-a185-4bacc2b1e490 on nch1-master-1 Oct 08 21:34:46.736841 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-65840c84-3834-45c0-a5b9-53a09fe389ed req-08f580d5-6b60-405c-b39c-708b810eded7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.162359 Oct 08 21:34:46.737480 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3135/6198] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:34:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:34:47.119510 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-fd69c881-1b46-4f1f-895c-dc1788dd6153 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:34:47.120135 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-fd69c881-1b46-4f1f-895c-dc1788dd6153 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] [instance: aee8a6a8-6de5-42bd-a185-4bacc2b1e490] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:34:47.127674 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fd69c881-1b46-4f1f-895c-dc1788dd6153 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:34:47.128169 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fd69c881-1b46-4f1f-895c-dc1788dd6153 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:34:47.128620 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fd69c881-1b46-4f1f-895c-dc1788dd6153 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:34:47.129361 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fd69c881-1b46-4f1f-895c-dc1788dd6153 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:34:47.129831 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fd69c881-1b46-4f1f-895c-dc1788dd6153 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:34:47.130270 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fd69c881-1b46-4f1f-895c-dc1788dd6153 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:34:47.258947 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-fd69c881-1b46-4f1f-895c-dc1788dd6153 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac4eff18a664804af16cf21321f9290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9857e88402494e964f2099de5bb60c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:34:47.266803 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-fd69c881-1b46-4f1f-895c-dc1788dd6153 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] 10.222.0.26 "GET /compute/v2.1/servers/aee8a6a8-6de5-42bd-a185-4bacc2b1e490" status: 200 len: 1265 microversion: 2.1 time: 0.151298 Oct 08 21:34:47.267398 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3064/6199] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:34:47 2022] GET /compute/v2.1/servers/aee8a6a8-6de5-42bd-a185-4bacc2b1e490 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:34:48.290304 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-f489e221-912b-4512-a6af-29a75e51b8c5 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:34:48.291003 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-f489e221-912b-4512-a6af-29a75e51b8c5 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] [instance: aee8a6a8-6de5-42bd-a185-4bacc2b1e490] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:34:48.298643 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f489e221-912b-4512-a6af-29a75e51b8c5 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:34:48.299154 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f489e221-912b-4512-a6af-29a75e51b8c5 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:34:48.299613 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f489e221-912b-4512-a6af-29a75e51b8c5 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:34:48.300357 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f489e221-912b-4512-a6af-29a75e51b8c5 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:34:48.301209 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f489e221-912b-4512-a6af-29a75e51b8c5 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:34:48.301674 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f489e221-912b-4512-a6af-29a75e51b8c5 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:34:48.439189 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-f489e221-912b-4512-a6af-29a75e51b8c5 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac4eff18a664804af16cf21321f9290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9857e88402494e964f2099de5bb60c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:34:48.447124 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-f489e221-912b-4512-a6af-29a75e51b8c5 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] 10.222.0.26 "GET /compute/v2.1/servers/aee8a6a8-6de5-42bd-a185-4bacc2b1e490" status: 200 len: 1452 microversion: 2.1 time: 0.161577 Oct 08 21:34:48.447713 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3136/6200] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:34:48 2022] GET /compute/v2.1/servers/aee8a6a8-6de5-42bd-a185-4bacc2b1e490 => generated 1452 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:34:48.470243 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-8f20ab58-a0b4-48d1-b8bb-576e8dcd88b4 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:34:48.470867 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-8f20ab58-a0b4-48d1-b8bb-576e8dcd88b4 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] [instance: aee8a6a8-6de5-42bd-a185-4bacc2b1e490] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:34:48.477996 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8f20ab58-a0b4-48d1-b8bb-576e8dcd88b4 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:34:48.478497 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8f20ab58-a0b4-48d1-b8bb-576e8dcd88b4 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:34:48.478953 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8f20ab58-a0b4-48d1-b8bb-576e8dcd88b4 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:34:48.479671 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8f20ab58-a0b4-48d1-b8bb-576e8dcd88b4 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:34:48.480140 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8f20ab58-a0b4-48d1-b8bb-576e8dcd88b4 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:34:48.480581 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8f20ab58-a0b4-48d1-b8bb-576e8dcd88b4 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:34:48.614180 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-8f20ab58-a0b4-48d1-b8bb-576e8dcd88b4 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac4eff18a664804af16cf21321f9290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9857e88402494e964f2099de5bb60c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:34:48.622149 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-8f20ab58-a0b4-48d1-b8bb-576e8dcd88b4 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] 10.222.0.26 "GET /compute/v2.1/servers/aee8a6a8-6de5-42bd-a185-4bacc2b1e490" status: 200 len: 1452 microversion: 2.1 time: 0.155823 Oct 08 21:34:48.622724 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3065/6201] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:34:48 2022] GET /compute/v2.1/servers/aee8a6a8-6de5-42bd-a185-4bacc2b1e490 => generated 1452 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:34:50.343775 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-a782ae13-fafc-4842-8ec4-2d496bcd9948 req-1b460912-dfc2-4cfd-a260-2e6d178c84b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aee8a6a8-6de5-42bd-a185-4bacc2b1e490", "tag": "c6426c28-b0b1-4f00-bdb9-3b64dec793de"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:34:50.349286 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=6 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:34:50.356446 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-a782ae13-fafc-4842-8ec4-2d496bcd9948 req-1b460912-dfc2-4cfd-a260-2e6d178c84b5 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:34:50.356945 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-a782ae13-fafc-4842-8ec4-2d496bcd9948 req-1b460912-dfc2-4cfd-a260-2e6d178c84b5 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:34:50.357433 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-a782ae13-fafc-4842-8ec4-2d496bcd9948 req-1b460912-dfc2-4cfd-a260-2e6d178c84b5 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:34:50.370159 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-a782ae13-fafc-4842-8ec4-2d496bcd9948 req-1b460912-dfc2-4cfd-a260-2e6d178c84b5 service nova] Creating event network-changed:c6426c28-b0b1-4f00-bdb9-3b64dec793de for instance aee8a6a8-6de5-42bd-a185-4bacc2b1e490 on nch1-master-1 Oct 08 21:34:50.375457 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-a782ae13-fafc-4842-8ec4-2d496bcd9948 req-1b460912-dfc2-4cfd-a260-2e6d178c84b5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035215 Oct 08 21:34:50.376394 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3137/6202] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:34:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:36:55.385942 ncdv-master-1 devstack@n-api.service[140491]: ERROR oslo.messaging._drivers.impl_rabbit [-] [389347c8-adfb-4c72-885b-6416d41737c1] AMQP server on 10.222.0.26:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 08 21:36:55.387114 ncdv-master-1 devstack@n-api.service[140491]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5b834fae-ca0a-46cb-bcaa-52f744fce5f9] AMQP server on 10.222.0.26:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 08 21:36:55.387473 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=2 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:36:55.388259 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=6 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:36:55.389409 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:36:55.390184 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=48 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:36:55.391201 ncdv-master-1 devstack@n-api.service[140491]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 08 21:36:55.391344 ncdv-master-1 devstack@n-api.service[140491]: Sat Oct 8 21:36:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/aee8a6a8-6de5-42bd-a185-4bacc2b1e490 (ip 10.222.0.26) !!! Oct 08 21:36:55.397424 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-6fc5c572-3b24-425a-9fbf-f81c9ea5bca0 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:36:55.397930 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-6fc5c572-3b24-425a-9fbf-f81c9ea5bca0 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] [instance: aee8a6a8-6de5-42bd-a185-4bacc2b1e490] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:36:55.407804 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6fc5c572-3b24-425a-9fbf-f81c9ea5bca0 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:36:55.408290 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6fc5c572-3b24-425a-9fbf-f81c9ea5bca0 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:36:55.408731 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6fc5c572-3b24-425a-9fbf-f81c9ea5bca0 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:36:55.409462 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6fc5c572-3b24-425a-9fbf-f81c9ea5bca0 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:36:55.409924 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6fc5c572-3b24-425a-9fbf-f81c9ea5bca0 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:36:55.410360 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6fc5c572-3b24-425a-9fbf-f81c9ea5bca0 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:36:55.440376 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-6fc5c572-3b24-425a-9fbf-f81c9ea5bca0 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] [instance: aee8a6a8-6de5-42bd-a185-4bacc2b1e490] Going to try to terminate instance {{(pid=140491) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 21:36:55.518984 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-6fc5c572-3b24-425a-9fbf-f81c9ea5bca0 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] 10.222.0.26 "DELETE /compute/v2.1/servers/aee8a6a8-6de5-42bd-a185-4bacc2b1e490" status: 204 len: 0 microversion: 2.1 time: 0.138158 Oct 08 21:36:55.519819 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3066/6203] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:36:55 2022] DELETE /compute/v2.1/servers/aee8a6a8-6de5-42bd-a185-4bacc2b1e490 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 21:36:55.529466 ncdv-master-1 devstack@n-api.service[140492]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a92ae347-69e9-4ac8-bb66-e8def9f99758] AMQP server on 10.222.0.26:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 08 21:36:55.531991 ncdv-master-1 devstack@n-api.service[140492]: ERROR oslo.messaging._drivers.impl_rabbit [-] [bab1eda8-a2f4-4cbf-a1fb-a5a6d7c2688e] AMQP server on 10.222.0.26:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 08 21:36:55.532583 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:36:55.533658 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:36:55.535125 ncdv-master-1 devstack@n-api.service[140492]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 08 21:36:55.535469 ncdv-master-1 devstack@n-api.service[140492]: Sat Oct 8 21:36:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/aee8a6a8-6de5-42bd-a185-4bacc2b1e490 (ip 10.222.0.26) !!! Oct 08 21:36:55.537881 ncdv-master-1 devstack@n-api.service[140492]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 08 21:36:55.538030 ncdv-master-1 devstack@n-api.service[140492]: Sat Oct 8 21:36:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/aee8a6a8-6de5-42bd-a185-4bacc2b1e490 (ip 10.222.0.26) !!! Oct 08 21:36:55.551624 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-78cf9b47-7625-441d-a9d5-ab5720edc9bf tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:36:55.552376 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-78cf9b47-7625-441d-a9d5-ab5720edc9bf tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] [instance: aee8a6a8-6de5-42bd-a185-4bacc2b1e490] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:36:55.562470 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-78cf9b47-7625-441d-a9d5-ab5720edc9bf tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:36:55.563611 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-78cf9b47-7625-441d-a9d5-ab5720edc9bf tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:36:55.564068 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-78cf9b47-7625-441d-a9d5-ab5720edc9bf tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:36:55.564789 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-78cf9b47-7625-441d-a9d5-ab5720edc9bf tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:36:55.565289 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-78cf9b47-7625-441d-a9d5-ab5720edc9bf tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:36:55.565738 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-78cf9b47-7625-441d-a9d5-ab5720edc9bf tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:36:55.697762 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-78cf9b47-7625-441d-a9d5-ab5720edc9bf tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac4eff18a664804af16cf21321f9290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9857e88402494e964f2099de5bb60c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:36:55.705687 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-78cf9b47-7625-441d-a9d5-ab5720edc9bf tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] 10.222.0.26 "GET /compute/v2.1/servers/aee8a6a8-6de5-42bd-a185-4bacc2b1e490" status: 200 len: 1577 microversion: 2.1 time: 0.180928 Oct 08 21:36:55.706267 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3138/6204] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:36:55 2022] GET /compute/v2.1/servers/aee8a6a8-6de5-42bd-a185-4bacc2b1e490 => generated 1577 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:36:56.731725 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-bc7aa4a7-8f20-4bf8-9575-57ab2486f303 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:36:56.732432 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-bc7aa4a7-8f20-4bf8-9575-57ab2486f303 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] [instance: aee8a6a8-6de5-42bd-a185-4bacc2b1e490] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:36:56.741730 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bc7aa4a7-8f20-4bf8-9575-57ab2486f303 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:36:56.742222 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bc7aa4a7-8f20-4bf8-9575-57ab2486f303 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:36:56.742665 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bc7aa4a7-8f20-4bf8-9575-57ab2486f303 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:36:56.743364 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bc7aa4a7-8f20-4bf8-9575-57ab2486f303 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:36:56.743823 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bc7aa4a7-8f20-4bf8-9575-57ab2486f303 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:36:56.744253 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bc7aa4a7-8f20-4bf8-9575-57ab2486f303 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:36:56.749868 ncdv-master-1 devstack@n-api.service[140491]: INFO oslo.messaging._drivers.impl_rabbit [-] [389347c8-adfb-4c72-885b-6416d41737c1] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 34068. Oct 08 21:36:56.752633 ncdv-master-1 devstack@n-api.service[140491]: INFO oslo.messaging._drivers.impl_rabbit [-] [5b834fae-ca0a-46cb-bcaa-52f744fce5f9] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 34070. Oct 08 21:36:56.883560 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-bc7aa4a7-8f20-4bf8-9575-57ab2486f303 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac4eff18a664804af16cf21321f9290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9857e88402494e964f2099de5bb60c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:36:56.891529 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-bc7aa4a7-8f20-4bf8-9575-57ab2486f303 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] 10.222.0.26 "GET /compute/v2.1/servers/aee8a6a8-6de5-42bd-a185-4bacc2b1e490" status: 200 len: 1577 microversion: 2.1 time: 0.165210 Oct 08 21:36:56.892104 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3067/6205] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:36:56 2022] GET /compute/v2.1/servers/aee8a6a8-6de5-42bd-a185-4bacc2b1e490 => generated 1577 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:36:57.914057 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-b37c5aa0-9a9b-4ee1-a3ce-8b2b8f13a04f tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:36:57.914896 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-b37c5aa0-9a9b-4ee1-a3ce-8b2b8f13a04f tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] [instance: aee8a6a8-6de5-42bd-a185-4bacc2b1e490] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:36:57.929802 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b37c5aa0-9a9b-4ee1-a3ce-8b2b8f13a04f tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:36:57.930232 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b37c5aa0-9a9b-4ee1-a3ce-8b2b8f13a04f tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:36:57.930786 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b37c5aa0-9a9b-4ee1-a3ce-8b2b8f13a04f tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:36:57.931431 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b37c5aa0-9a9b-4ee1-a3ce-8b2b8f13a04f tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:36:57.931849 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b37c5aa0-9a9b-4ee1-a3ce-8b2b8f13a04f tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:36:57.932382 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b37c5aa0-9a9b-4ee1-a3ce-8b2b8f13a04f tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:36:57.943020 ncdv-master-1 devstack@n-api.service[140492]: INFO oslo.messaging._drivers.impl_rabbit [-] [bab1eda8-a2f4-4cbf-a1fb-a5a6d7c2688e] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 34076. Oct 08 21:36:57.957974 ncdv-master-1 devstack@n-api.service[140492]: INFO oslo.messaging._drivers.impl_rabbit [-] [a92ae347-69e9-4ac8-bb66-e8def9f99758] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 34074. Oct 08 21:36:58.006031 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-b37c5aa0-9a9b-4ee1-a3ce-8b2b8f13a04f tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac4eff18a664804af16cf21321f9290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9857e88402494e964f2099de5bb60c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:36:58.014051 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-b37c5aa0-9a9b-4ee1-a3ce-8b2b8f13a04f tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] 10.222.0.26 "GET /compute/v2.1/servers/aee8a6a8-6de5-42bd-a185-4bacc2b1e490" status: 200 len: 1510 microversion: 2.1 time: 0.103975 Oct 08 21:36:58.014641 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3139/6206] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:36:57 2022] GET /compute/v2.1/servers/aee8a6a8-6de5-42bd-a185-4bacc2b1e490 => generated 1510 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:36:58.213046 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-a8d95984-ec84-4c3b-b6eb-53964a8e77f0 req-c2891090-bc21-41ee-ac6e-8275676643c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aee8a6a8-6de5-42bd-a185-4bacc2b1e490", "name": "network-vif-deleted", "tag": "c6426c28-b0b1-4f00-bdb9-3b64dec793de"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:36:58.224785 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-a8d95984-ec84-4c3b-b6eb-53964a8e77f0 req-c2891090-bc21-41ee-ac6e-8275676643c7 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:36:58.225881 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-a8d95984-ec84-4c3b-b6eb-53964a8e77f0 req-c2891090-bc21-41ee-ac6e-8275676643c7 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:36:58.226502 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-a8d95984-ec84-4c3b-b6eb-53964a8e77f0 req-c2891090-bc21-41ee-ac6e-8275676643c7 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:36:58.239844 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-a8d95984-ec84-4c3b-b6eb-53964a8e77f0 req-c2891090-bc21-41ee-ac6e-8275676643c7 service nova] Creating event network-vif-deleted:c6426c28-b0b1-4f00-bdb9-3b64dec793de for instance aee8a6a8-6de5-42bd-a185-4bacc2b1e490 on nch1-master-1 Oct 08 21:36:58.245145 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-a8d95984-ec84-4c3b-b6eb-53964a8e77f0 req-c2891090-bc21-41ee-ac6e-8275676643c7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036654 Oct 08 21:36:58.245793 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3068/6207] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:36:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:36:59.038411 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-72ee5347-60dd-4527-b7c1-62f1c70c1493 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:36:59.039183 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-72ee5347-60dd-4527-b7c1-62f1c70c1493 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] [instance: aee8a6a8-6de5-42bd-a185-4bacc2b1e490] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:36:59.046301 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-72ee5347-60dd-4527-b7c1-62f1c70c1493 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:36:59.046814 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-72ee5347-60dd-4527-b7c1-62f1c70c1493 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:36:59.047308 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-72ee5347-60dd-4527-b7c1-62f1c70c1493 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:36:59.048039 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-72ee5347-60dd-4527-b7c1-62f1c70c1493 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:36:59.048562 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-72ee5347-60dd-4527-b7c1-62f1c70c1493 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:36:59.049014 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-72ee5347-60dd-4527-b7c1-62f1c70c1493 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:36:59.063615 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-72ee5347-60dd-4527-b7c1-62f1c70c1493 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] HTTP exception thrown: Instance aee8a6a8-6de5-42bd-a185-4bacc2b1e490 could not be found. Oct 08 21:36:59.065597 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-72ee5347-60dd-4527-b7c1-62f1c70c1493 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Request method failure captured: Oct 08 21:36:59.065597 ncdv-master-1 devstack@n-api.service[140492]: request: GET /compute/v2.1/servers/aee8a6a8-6de5-42bd-a185-4bacc2b1e490 HTTP/1.1 Oct 08 21:36:59.065597 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:36:59.065597 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:36:59.065597 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:36:59.065597 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 21:36:59.065597 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:36:59.065597 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:36:59.065597 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:36:59.065597 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:36:59.065597 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeyESueD2G2p08fpZng5dUIvJRbscky3tGNIT1dlSRltWQwygOyYfQAwVe7KLvB4NB9Rvs7JJ6Z3bstxj1FPhWmo56k4nFHZVnko_1G4tfE_I1T9paCtzZG8sfJM33h9PLTo7_TpIQ4aSXx-QLhm7_UAuDXZaIvpFH6pLdWcKYlBxWo Oct 08 21:36:59.065597 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:36:59.065597 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:36:59.065597 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:36:59.065597 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:36:59.065597 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:36:59.065597 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:36:59.065597 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 8d9857e88402494e964f2099de5bb60c Oct 08 21:36:59.065597 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-TestVolumeBootPattern-1770467933 Oct 08 21:36:59.065597 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:36:59.065597 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:36:59.065597 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8d9857e88402494e964f2099de5bb60c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8d9857e88402494e964f2099de5bb60c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8d9857e88402494e964f2099de5bb60c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8d9857e88402494e964f2099de5bb60c"}]}] Oct 08 21:36:59.065597 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-TestVolumeBootPattern-1770467933 Oct 08 21:36:59.065597 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 8d9857e88402494e964f2099de5bb60c Oct 08 21:36:59.065597 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-TestVolumeBootPattern-1770467933 Oct 08 21:36:59.065597 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-TestVolumeBootPattern-1770467933-project Oct 08 21:36:59.065597 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:36:59.065597 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:36:59.065597 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 7ac4eff18a664804af16cf21321f9290 Oct 08 21:36:59.065597 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-TestVolumeBootPattern-1770467933-project Oct 08 21:36:59.065597 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 21:36:59.065597 ncdv-master-1 devstack@n-api.service[140492]: exception: Instance aee8a6a8-6de5-42bd-a185-4bacc2b1e490 could not be found. Oct 08 21:36:59.065597 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': 'aee8a6a8-6de5-42bd-a185-4bacc2b1e490'} Oct 08 21:36:59.065597 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:36:59.065597 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:36:59.065597 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:36:59.065597 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:36:59.065597 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:36:59.065597 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:36:59.065597 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:36:59.065597 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:36:59.065597 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:36:59.065597 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:36:59.065597 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aee8a6a8-6de5-42bd-a185-4bacc2b1e490 could not be found. Oct 08 21:36:59.065597 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:36:59.065597 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:36:59.065597 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:36:59.065597 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:36:59.065597 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:36:59.065597 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:36:59.065597 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:36:59.065597 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:36:59.065597 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:36:59.065597 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:36:59.065597 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:36:59.065597 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:36:59.065597 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:36:59.065597 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:36:59.065597 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:36:59.065597 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:36:59.065597 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aee8a6a8-6de5-42bd-a185-4bacc2b1e490 could not be found. Oct 08 21:36:59.065597 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:36:59.065597 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:36:59.065597 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:36:59.070308 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:36:59.070308 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:36:59.070308 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:36:59.070308 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:36:59.070308 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:36:59.070308 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aee8a6a8-6de5-42bd-a185-4bacc2b1e490 could not be found. Oct 08 21:36:59.070308 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:36:59.070308 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-72ee5347-60dd-4527-b7c1-62f1c70c1493 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Returning 404 to user: Instance aee8a6a8-6de5-42bd-a185-4bacc2b1e490 could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:36:59.070308 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-72ee5347-60dd-4527-b7c1-62f1c70c1493 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] 10.222.0.26 "GET /compute/v2.1/servers/aee8a6a8-6de5-42bd-a185-4bacc2b1e490" status: 404 len: 111 microversion: 2.1 time: 0.032676 Oct 08 21:36:59.070308 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3140/6208] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:36:59 2022] GET /compute/v2.1/servers/aee8a6a8-6de5-42bd-a185-4bacc2b1e490 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:36:59.149779 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-4b045876-af20-4623-ab63-cd2f43bcf3f6 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-919348158", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-281319770", "security_groups": [{"name": "tempest-secgroup-smoke-441952254"}], "block_device_mapping_v2": [{"uuid": "35b4d884-2f36-4b2a-b436-df821ca02419", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "4d64b136-ce87-445f-a822-d4ba1b8b55a2"}]}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:36:59.271257 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.network.neutron [None req-4b045876-af20-4623-ab63-cd2f43bcf3f6 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] validate_networks() for [('4d64b136-ce87-445f-a822-d4ba1b8b55a2', None, None, None, None, None)] {{(pid=140491) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 21:36:59.649505 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-4b045876-af20-4623-ab63-cd2f43bcf3f6 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Flavor limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 21:36:59.649944 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-4b045876-af20-4623-ab63-cd2f43bcf3f6 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Image limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 21:36:59.650533 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-4b045876-af20-4623-ab63-cd2f43bcf3f6 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Flavor pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 21:36:59.650946 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-4b045876-af20-4623-ab63-cd2f43bcf3f6 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Image pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 21:36:59.651470 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-4b045876-af20-4623-ab63-cd2f43bcf3f6 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 21:36:59.660465 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4b045876-af20-4623-ab63-cd2f43bcf3f6 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:36:59.660964 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4b045876-af20-4623-ab63-cd2f43bcf3f6 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:36:59.661450 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4b045876-af20-4623-ab63-cd2f43bcf3f6 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:36:59.662205 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4b045876-af20-4623-ab63-cd2f43bcf3f6 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:36:59.662669 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4b045876-af20-4623-ab63-cd2f43bcf3f6 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:36:59.663107 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4b045876-af20-4623-ab63-cd2f43bcf3f6 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:36:59.680135 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-4b045876-af20-4623-ab63-cd2f43bcf3f6 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Getting quotas for project 8d9857e88402494e964f2099de5bb60c. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:36:59.685500 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-4b045876-af20-4623-ab63-cd2f43bcf3f6 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Getting quotas for user 7ac4eff18a664804af16cf21321f9290 and project 8d9857e88402494e964f2099de5bb60c. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:36:59.745100 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-4b045876-af20-4623-ab63-cd2f43bcf3f6 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Going to run 1 instances... {{(pid=140491) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 21:36:59.747510 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-4b045876-af20-4623-ab63-cd2f43bcf3f6 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] [instance: 195a4f47-6189-4513-81cc-a7ea67707076] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='35b4d884-2f36-4b2a-b436-df821ca02419',volume_size=None,volume_type=None)] {{(pid=140491) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 21:36:59.875084 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-4b045876-af20-4623-ab63-cd2f43bcf3f6 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.729677 Oct 08 21:36:59.876325 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3069/6209] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 21:36:59 2022] POST /compute/v2.1/servers => generated 405 bytes in 732 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 08 21:36:59.887703 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-45904041-eb16-41f1-8e4e-e3ad6e730121 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:36:59.888373 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-45904041-eb16-41f1-8e4e-e3ad6e730121 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] [instance: 195a4f47-6189-4513-81cc-a7ea67707076] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:36:59.944230 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-45904041-eb16-41f1-8e4e-e3ad6e730121 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac4eff18a664804af16cf21321f9290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9857e88402494e964f2099de5bb60c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:36:59.951222 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-45904041-eb16-41f1-8e4e-e3ad6e730121 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] 10.222.0.26 "GET /compute/v2.1/servers/195a4f47-6189-4513-81cc-a7ea67707076" status: 200 len: 1093 microversion: 2.1 time: 0.067413 Oct 08 21:36:59.951925 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3141/6210] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:36:59 2022] GET /compute/v2.1/servers/195a4f47-6189-4513-81cc-a7ea67707076 => generated 1093 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:37:00.987424 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-30776a9c-a704-4710-860f-8861bc7f7557 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:37:00.990287 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-30776a9c-a704-4710-860f-8861bc7f7557 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] [instance: 195a4f47-6189-4513-81cc-a7ea67707076] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:37:01.001150 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-30776a9c-a704-4710-860f-8861bc7f7557 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:37:01.001676 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-30776a9c-a704-4710-860f-8861bc7f7557 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:37:01.002130 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-30776a9c-a704-4710-860f-8861bc7f7557 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:37:01.002851 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-30776a9c-a704-4710-860f-8861bc7f7557 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:37:01.003313 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-30776a9c-a704-4710-860f-8861bc7f7557 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:37:01.003929 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-30776a9c-a704-4710-860f-8861bc7f7557 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:37:01.072123 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-30776a9c-a704-4710-860f-8861bc7f7557 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac4eff18a664804af16cf21321f9290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9857e88402494e964f2099de5bb60c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:37:01.079454 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-30776a9c-a704-4710-860f-8861bc7f7557 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] 10.222.0.26 "GET /compute/v2.1/servers/195a4f47-6189-4513-81cc-a7ea67707076" status: 200 len: 1209 microversion: 2.1 time: 0.108942 Oct 08 21:37:01.080057 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3070/6211] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:37:00 2022] GET /compute/v2.1/servers/195a4f47-6189-4513-81cc-a7ea67707076 => generated 1209 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:37:02.102249 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-4ee7b5ce-358e-4837-99c2-1ac7e3ce745a tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:37:02.102895 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-4ee7b5ce-358e-4837-99c2-1ac7e3ce745a tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] [instance: 195a4f47-6189-4513-81cc-a7ea67707076] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:37:02.112382 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4ee7b5ce-358e-4837-99c2-1ac7e3ce745a tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:37:02.113099 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4ee7b5ce-358e-4837-99c2-1ac7e3ce745a tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:37:02.113608 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4ee7b5ce-358e-4837-99c2-1ac7e3ce745a tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:37:02.114397 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4ee7b5ce-358e-4837-99c2-1ac7e3ce745a tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:37:02.115144 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4ee7b5ce-358e-4837-99c2-1ac7e3ce745a tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:37:02.115569 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4ee7b5ce-358e-4837-99c2-1ac7e3ce745a tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:37:02.309965 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-4ee7b5ce-358e-4837-99c2-1ac7e3ce745a tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac4eff18a664804af16cf21321f9290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9857e88402494e964f2099de5bb60c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:37:02.318236 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-4ee7b5ce-358e-4837-99c2-1ac7e3ce745a tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] 10.222.0.26 "GET /compute/v2.1/servers/195a4f47-6189-4513-81cc-a7ea67707076" status: 200 len: 1264 microversion: 2.1 time: 0.219968 Oct 08 21:37:02.319108 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3142/6212] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:37:02 2022] GET /compute/v2.1/servers/195a4f47-6189-4513-81cc-a7ea67707076 => generated 1264 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:37:02.387576 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-a353b734-5ed0-4383-8d7a-d6718756be28 req-28bf218b-b4ca-430e-ae8d-39d525e17578 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "195a4f47-6189-4513-81cc-a7ea67707076", "tag": "21c55940-ec54-46dd-a987-ab70b90d2e06"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:37:02.399587 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-a353b734-5ed0-4383-8d7a-d6718756be28 req-28bf218b-b4ca-430e-ae8d-39d525e17578 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:37:02.400307 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-a353b734-5ed0-4383-8d7a-d6718756be28 req-28bf218b-b4ca-430e-ae8d-39d525e17578 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:37:02.400841 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-a353b734-5ed0-4383-8d7a-d6718756be28 req-28bf218b-b4ca-430e-ae8d-39d525e17578 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:37:02.412847 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-a353b734-5ed0-4383-8d7a-d6718756be28 req-28bf218b-b4ca-430e-ae8d-39d525e17578 service nova] Creating event network-changed:21c55940-ec54-46dd-a987-ab70b90d2e06 for instance 195a4f47-6189-4513-81cc-a7ea67707076 on nch2-master-1 Oct 08 21:37:02.417909 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-a353b734-5ed0-4383-8d7a-d6718756be28 req-28bf218b-b4ca-430e-ae8d-39d525e17578 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034077 Oct 08 21:37:02.418738 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3071/6213] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:37:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:37:03.342980 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-23238275-91a0-4008-9cb8-1e613a24ae8b tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:37:03.343763 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-23238275-91a0-4008-9cb8-1e613a24ae8b tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] [instance: 195a4f47-6189-4513-81cc-a7ea67707076] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:37:03.352728 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-23238275-91a0-4008-9cb8-1e613a24ae8b tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:37:03.353538 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-23238275-91a0-4008-9cb8-1e613a24ae8b tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:37:03.354000 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-23238275-91a0-4008-9cb8-1e613a24ae8b tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:37:03.354732 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-23238275-91a0-4008-9cb8-1e613a24ae8b tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:37:03.355212 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-23238275-91a0-4008-9cb8-1e613a24ae8b tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:37:03.355662 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-23238275-91a0-4008-9cb8-1e613a24ae8b tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:37:03.584262 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-23238275-91a0-4008-9cb8-1e613a24ae8b tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac4eff18a664804af16cf21321f9290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9857e88402494e964f2099de5bb60c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:37:03.592388 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-23238275-91a0-4008-9cb8-1e613a24ae8b tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] 10.222.0.26 "GET /compute/v2.1/servers/195a4f47-6189-4513-81cc-a7ea67707076" status: 200 len: 1264 microversion: 2.1 time: 0.253377 Oct 08 21:37:03.593079 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3143/6214] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:37:03 2022] GET /compute/v2.1/servers/195a4f47-6189-4513-81cc-a7ea67707076 => generated 1264 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:37:04.617760 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-07fe99ed-94f3-4232-bee8-26684e3c76c3 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:37:04.618468 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-07fe99ed-94f3-4232-bee8-26684e3c76c3 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] [instance: 195a4f47-6189-4513-81cc-a7ea67707076] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:37:04.624811 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-07fe99ed-94f3-4232-bee8-26684e3c76c3 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:37:04.625304 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-07fe99ed-94f3-4232-bee8-26684e3c76c3 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:37:04.626387 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-07fe99ed-94f3-4232-bee8-26684e3c76c3 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:37:04.627108 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-07fe99ed-94f3-4232-bee8-26684e3c76c3 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:37:04.627570 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-07fe99ed-94f3-4232-bee8-26684e3c76c3 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:37:04.627997 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-07fe99ed-94f3-4232-bee8-26684e3c76c3 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:37:04.768304 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-07fe99ed-94f3-4232-bee8-26684e3c76c3 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac4eff18a664804af16cf21321f9290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9857e88402494e964f2099de5bb60c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:37:04.776171 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-07fe99ed-94f3-4232-bee8-26684e3c76c3 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] 10.222.0.26 "GET /compute/v2.1/servers/195a4f47-6189-4513-81cc-a7ea67707076" status: 200 len: 1264 microversion: 2.1 time: 0.163646 Oct 08 21:37:04.776759 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3072/6215] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:37:04 2022] GET /compute/v2.1/servers/195a4f47-6189-4513-81cc-a7ea67707076 => generated 1264 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:37:05.799734 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e4622aa3-be54-477c-a1a0-2843ba303462 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:37:05.800278 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-e4622aa3-be54-477c-a1a0-2843ba303462 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] [instance: 195a4f47-6189-4513-81cc-a7ea67707076] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:37:05.807219 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e4622aa3-be54-477c-a1a0-2843ba303462 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:37:05.807722 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e4622aa3-be54-477c-a1a0-2843ba303462 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:37:05.808175 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e4622aa3-be54-477c-a1a0-2843ba303462 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:37:05.808887 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e4622aa3-be54-477c-a1a0-2843ba303462 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:37:05.809399 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e4622aa3-be54-477c-a1a0-2843ba303462 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:37:05.809844 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e4622aa3-be54-477c-a1a0-2843ba303462 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:37:05.941540 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-e4622aa3-be54-477c-a1a0-2843ba303462 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac4eff18a664804af16cf21321f9290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9857e88402494e964f2099de5bb60c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:37:05.949340 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-e4622aa3-be54-477c-a1a0-2843ba303462 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] 10.222.0.26 "GET /compute/v2.1/servers/195a4f47-6189-4513-81cc-a7ea67707076" status: 200 len: 1264 microversion: 2.1 time: 0.154069 Oct 08 21:37:05.949920 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3144/6216] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:37:05 2022] GET /compute/v2.1/servers/195a4f47-6189-4513-81cc-a7ea67707076 => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:37:06.972069 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-34074ce1-4556-4634-a910-c25c9b28f197 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:37:06.972684 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-34074ce1-4556-4634-a910-c25c9b28f197 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] [instance: 195a4f47-6189-4513-81cc-a7ea67707076] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:37:06.979686 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-34074ce1-4556-4634-a910-c25c9b28f197 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:37:06.980173 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-34074ce1-4556-4634-a910-c25c9b28f197 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:37:06.980617 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-34074ce1-4556-4634-a910-c25c9b28f197 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:37:06.981349 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-34074ce1-4556-4634-a910-c25c9b28f197 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:37:06.981811 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-34074ce1-4556-4634-a910-c25c9b28f197 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:37:06.982239 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-34074ce1-4556-4634-a910-c25c9b28f197 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:37:07.122329 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-34074ce1-4556-4634-a910-c25c9b28f197 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac4eff18a664804af16cf21321f9290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9857e88402494e964f2099de5bb60c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:37:07.130181 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-34074ce1-4556-4634-a910-c25c9b28f197 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] 10.222.0.26 "GET /compute/v2.1/servers/195a4f47-6189-4513-81cc-a7ea67707076" status: 200 len: 1264 microversion: 2.1 time: 0.162566 Oct 08 21:37:07.130770 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3073/6217] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:37:06 2022] GET /compute/v2.1/servers/195a4f47-6189-4513-81cc-a7ea67707076 => generated 1264 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:37:08.151946 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-7b2f432e-9d25-43b4-9e60-a41a5ecc19db tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:37:08.152585 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-7b2f432e-9d25-43b4-9e60-a41a5ecc19db tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] [instance: 195a4f47-6189-4513-81cc-a7ea67707076] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:37:08.159604 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7b2f432e-9d25-43b4-9e60-a41a5ecc19db tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:37:08.160112 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7b2f432e-9d25-43b4-9e60-a41a5ecc19db tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:37:08.160604 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7b2f432e-9d25-43b4-9e60-a41a5ecc19db tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:37:08.161350 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7b2f432e-9d25-43b4-9e60-a41a5ecc19db tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:37:08.161837 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7b2f432e-9d25-43b4-9e60-a41a5ecc19db tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:37:08.162315 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7b2f432e-9d25-43b4-9e60-a41a5ecc19db tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:37:08.300217 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-7b2f432e-9d25-43b4-9e60-a41a5ecc19db tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac4eff18a664804af16cf21321f9290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9857e88402494e964f2099de5bb60c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:37:08.308202 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-7b2f432e-9d25-43b4-9e60-a41a5ecc19db tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] 10.222.0.26 "GET /compute/v2.1/servers/195a4f47-6189-4513-81cc-a7ea67707076" status: 200 len: 1264 microversion: 2.1 time: 0.160169 Oct 08 21:37:08.308818 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3145/6218] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:37:08 2022] GET /compute/v2.1/servers/195a4f47-6189-4513-81cc-a7ea67707076 => generated 1264 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:37:08.390001 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-d80deac5-1d54-4071-bfb0-cbd6cd44ec09 req-cb38cab1-8de7-4473-8a55-f1d3e706e57e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "195a4f47-6189-4513-81cc-a7ea67707076", "name": "network-vif-plugged", "status": "completed", "tag": "21c55940-ec54-46dd-a987-ab70b90d2e06"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:37:08.400490 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-d80deac5-1d54-4071-bfb0-cbd6cd44ec09 req-cb38cab1-8de7-4473-8a55-f1d3e706e57e service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:37:08.401013 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-d80deac5-1d54-4071-bfb0-cbd6cd44ec09 req-cb38cab1-8de7-4473-8a55-f1d3e706e57e service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:37:08.401484 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-d80deac5-1d54-4071-bfb0-cbd6cd44ec09 req-cb38cab1-8de7-4473-8a55-f1d3e706e57e service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:37:08.413433 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-d80deac5-1d54-4071-bfb0-cbd6cd44ec09 req-cb38cab1-8de7-4473-8a55-f1d3e706e57e service nova] Creating event network-vif-plugged:21c55940-ec54-46dd-a987-ab70b90d2e06 for instance 195a4f47-6189-4513-81cc-a7ea67707076 on nch2-master-1 Oct 08 21:37:08.418443 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-d80deac5-1d54-4071-bfb0-cbd6cd44ec09 req-cb38cab1-8de7-4473-8a55-f1d3e706e57e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032265 Oct 08 21:37:08.419030 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3074/6219] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:37:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:37:09.330585 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-cae7b3cb-1b7b-41f2-9134-e21215bc4375 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:37:09.331553 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-cae7b3cb-1b7b-41f2-9134-e21215bc4375 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] [instance: 195a4f47-6189-4513-81cc-a7ea67707076] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:37:09.338515 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cae7b3cb-1b7b-41f2-9134-e21215bc4375 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:37:09.339023 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cae7b3cb-1b7b-41f2-9134-e21215bc4375 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:37:09.339492 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cae7b3cb-1b7b-41f2-9134-e21215bc4375 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:37:09.340208 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cae7b3cb-1b7b-41f2-9134-e21215bc4375 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:37:09.340688 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cae7b3cb-1b7b-41f2-9134-e21215bc4375 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:37:09.341136 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cae7b3cb-1b7b-41f2-9134-e21215bc4375 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:37:09.475751 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-cae7b3cb-1b7b-41f2-9134-e21215bc4375 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac4eff18a664804af16cf21321f9290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9857e88402494e964f2099de5bb60c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:37:09.485474 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-cae7b3cb-1b7b-41f2-9134-e21215bc4375 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] 10.222.0.26 "GET /compute/v2.1/servers/195a4f47-6189-4513-81cc-a7ea67707076" status: 200 len: 1264 microversion: 2.1 time: 0.158637 Oct 08 21:37:09.486920 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3146/6220] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:37:09 2022] GET /compute/v2.1/servers/195a4f47-6189-4513-81cc-a7ea67707076 => generated 1264 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:37:10.507577 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=2 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:37:10.508361 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=6 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:37:10.512884 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-39bc557e-8551-4041-baa4-1dd8d4f8dbda tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:37:10.513661 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-39bc557e-8551-4041-baa4-1dd8d4f8dbda tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] [instance: 195a4f47-6189-4513-81cc-a7ea67707076] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:37:10.520927 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-39bc557e-8551-4041-baa4-1dd8d4f8dbda tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:37:10.521467 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-39bc557e-8551-4041-baa4-1dd8d4f8dbda tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:37:10.521918 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-39bc557e-8551-4041-baa4-1dd8d4f8dbda tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:37:10.522633 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-39bc557e-8551-4041-baa4-1dd8d4f8dbda tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:37:10.523104 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-39bc557e-8551-4041-baa4-1dd8d4f8dbda tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:37:10.523545 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-39bc557e-8551-4041-baa4-1dd8d4f8dbda tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:37:10.656328 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-39bc557e-8551-4041-baa4-1dd8d4f8dbda tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac4eff18a664804af16cf21321f9290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9857e88402494e964f2099de5bb60c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:37:10.664805 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-39bc557e-8551-4041-baa4-1dd8d4f8dbda tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] 10.222.0.26 "GET /compute/v2.1/servers/195a4f47-6189-4513-81cc-a7ea67707076" status: 200 len: 1452 microversion: 2.1 time: 0.159070 Oct 08 21:37:10.665413 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3075/6221] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:37:10 2022] GET /compute/v2.1/servers/195a4f47-6189-4513-81cc-a7ea67707076 => generated 1452 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:37:10.687055 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-c3135d6a-bc38-4713-9b90-b3c10448792a tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:37:10.687693 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-c3135d6a-bc38-4713-9b90-b3c10448792a tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] [instance: 195a4f47-6189-4513-81cc-a7ea67707076] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:37:10.689593 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=2 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:37:10.695643 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c3135d6a-bc38-4713-9b90-b3c10448792a tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:37:10.696149 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c3135d6a-bc38-4713-9b90-b3c10448792a tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:37:10.696608 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c3135d6a-bc38-4713-9b90-b3c10448792a tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:37:10.697358 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c3135d6a-bc38-4713-9b90-b3c10448792a tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:37:10.697837 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c3135d6a-bc38-4713-9b90-b3c10448792a tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:37:10.698284 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c3135d6a-bc38-4713-9b90-b3c10448792a tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:37:10.831754 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-c3135d6a-bc38-4713-9b90-b3c10448792a tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac4eff18a664804af16cf21321f9290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9857e88402494e964f2099de5bb60c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:37:10.839593 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-c3135d6a-bc38-4713-9b90-b3c10448792a tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] 10.222.0.26 "GET /compute/v2.1/servers/195a4f47-6189-4513-81cc-a7ea67707076" status: 200 len: 1452 microversion: 2.1 time: 0.156393 Oct 08 21:37:10.840176 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3147/6222] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:37:10 2022] GET /compute/v2.1/servers/195a4f47-6189-4513-81cc-a7ea67707076 => generated 1452 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:37:12.734886 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-b17c5fb1-4f8b-498a-b404-a97b4ed9bd5c req-7bf2bafe-51b9-4876-9332-123caac25c7a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "195a4f47-6189-4513-81cc-a7ea67707076", "tag": "21c55940-ec54-46dd-a987-ab70b90d2e06"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:37:12.745101 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-b17c5fb1-4f8b-498a-b404-a97b4ed9bd5c req-7bf2bafe-51b9-4876-9332-123caac25c7a service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:37:12.745633 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-b17c5fb1-4f8b-498a-b404-a97b4ed9bd5c req-7bf2bafe-51b9-4876-9332-123caac25c7a service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:37:12.746080 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-b17c5fb1-4f8b-498a-b404-a97b4ed9bd5c req-7bf2bafe-51b9-4876-9332-123caac25c7a service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:37:12.757860 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-b17c5fb1-4f8b-498a-b404-a97b4ed9bd5c req-7bf2bafe-51b9-4876-9332-123caac25c7a service nova] Creating event network-changed:21c55940-ec54-46dd-a987-ab70b90d2e06 for instance 195a4f47-6189-4513-81cc-a7ea67707076 on nch2-master-1 Oct 08 21:37:12.762876 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-b17c5fb1-4f8b-498a-b404-a97b4ed9bd5c req-7bf2bafe-51b9-4876-9332-123caac25c7a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031808 Oct 08 21:37:12.763719 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3076/6223] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:37:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 08 21:38:54.122672 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=22 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:38:54.123502 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=50 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:38:54.124371 ncdv-master-1 devstack@n-api.service[140492]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 08 21:38:54.124538 ncdv-master-1 devstack@n-api.service[140492]: Sat Oct 8 21:38:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.26) !!! Oct 08 21:38:54.129547 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-1f35b2ff-0deb-441c-b45a-78238cc391d6 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-359366122", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-281319770", "security_groups": [{"name": "tempest-secgroup-smoke-441952254"}], "block_device_mapping_v2": [{"uuid": "65306e30-518e-4a44-99d2-d9613008ad70", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "4d64b136-ce87-445f-a822-d4ba1b8b55a2"}]}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:38:54.309009 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.network.neutron [None req-1f35b2ff-0deb-441c-b45a-78238cc391d6 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] validate_networks() for [('4d64b136-ce87-445f-a822-d4ba1b8b55a2', None, None, None, None, None)] {{(pid=140492) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 21:38:54.741630 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-1f35b2ff-0deb-441c-b45a-78238cc391d6 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Flavor limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 21:38:54.742135 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-1f35b2ff-0deb-441c-b45a-78238cc391d6 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Image limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 21:38:54.742670 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-1f35b2ff-0deb-441c-b45a-78238cc391d6 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Flavor pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 21:38:54.743157 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-1f35b2ff-0deb-441c-b45a-78238cc391d6 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Image pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 21:38:54.743598 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-1f35b2ff-0deb-441c-b45a-78238cc391d6 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 21:38:54.752315 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1f35b2ff-0deb-441c-b45a-78238cc391d6 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:38:54.753358 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1f35b2ff-0deb-441c-b45a-78238cc391d6 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:38:54.753820 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1f35b2ff-0deb-441c-b45a-78238cc391d6 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:38:54.754572 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1f35b2ff-0deb-441c-b45a-78238cc391d6 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:38:54.755054 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1f35b2ff-0deb-441c-b45a-78238cc391d6 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:38:54.755505 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1f35b2ff-0deb-441c-b45a-78238cc391d6 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:38:54.772981 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-1f35b2ff-0deb-441c-b45a-78238cc391d6 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Getting quotas for project 8d9857e88402494e964f2099de5bb60c. Resources: {'cores', 'instances', 'ram'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:38:54.778464 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-1f35b2ff-0deb-441c-b45a-78238cc391d6 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Getting quotas for user 7ac4eff18a664804af16cf21321f9290 and project 8d9857e88402494e964f2099de5bb60c. Resources: {'cores', 'instances', 'ram'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:38:54.836895 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-1f35b2ff-0deb-441c-b45a-78238cc391d6 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Going to run 1 instances... {{(pid=140492) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 21:38:54.839186 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-1f35b2ff-0deb-441c-b45a-78238cc391d6 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] [instance: 7ea371be-4910-49a2-93db-c315ce278a84] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='65306e30-518e-4a44-99d2-d9613008ad70',volume_size=None,volume_type=None)] {{(pid=140492) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 21:38:54.966487 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-1f35b2ff-0deb-441c-b45a-78238cc391d6 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.845625 Oct 08 21:38:54.967151 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3148/6224] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 21:38:54 2022] POST /compute/v2.1/servers => generated 405 bytes in 847 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 08 21:38:54.977637 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:38:54.978827 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:38:54.984636 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-b8f023cb-5b4c-4fc1-87d5-ed28c5c834ac tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:38:54.985388 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-b8f023cb-5b4c-4fc1-87d5-ed28c5c834ac tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] [instance: 7ea371be-4910-49a2-93db-c315ce278a84] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:38:55.172609 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-b8f023cb-5b4c-4fc1-87d5-ed28c5c834ac tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac4eff18a664804af16cf21321f9290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9857e88402494e964f2099de5bb60c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:38:55.180737 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-b8f023cb-5b4c-4fc1-87d5-ed28c5c834ac tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] 10.222.0.26 "GET /compute/v2.1/servers/7ea371be-4910-49a2-93db-c315ce278a84" status: 200 len: 1093 microversion: 2.1 time: 0.205908 Oct 08 21:38:55.181329 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3077/6225] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:38:54 2022] GET /compute/v2.1/servers/7ea371be-4910-49a2-93db-c315ce278a84 => generated 1093 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:38:56.206184 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-20da0f2d-8bfe-4af8-a6ae-9c05bedb21c9 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:38:56.206881 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-20da0f2d-8bfe-4af8-a6ae-9c05bedb21c9 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] [instance: 7ea371be-4910-49a2-93db-c315ce278a84] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:38:56.213757 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-20da0f2d-8bfe-4af8-a6ae-9c05bedb21c9 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:38:56.214278 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-20da0f2d-8bfe-4af8-a6ae-9c05bedb21c9 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:38:56.214720 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-20da0f2d-8bfe-4af8-a6ae-9c05bedb21c9 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:38:56.215440 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-20da0f2d-8bfe-4af8-a6ae-9c05bedb21c9 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:38:56.215917 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-20da0f2d-8bfe-4af8-a6ae-9c05bedb21c9 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:38:56.216395 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-20da0f2d-8bfe-4af8-a6ae-9c05bedb21c9 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:38:56.277298 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-20da0f2d-8bfe-4af8-a6ae-9c05bedb21c9 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac4eff18a664804af16cf21321f9290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9857e88402494e964f2099de5bb60c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:38:56.285075 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-20da0f2d-8bfe-4af8-a6ae-9c05bedb21c9 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] 10.222.0.26 "GET /compute/v2.1/servers/7ea371be-4910-49a2-93db-c315ce278a84" status: 200 len: 1143 microversion: 2.1 time: 0.085205 Oct 08 21:38:56.285670 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3149/6226] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:38:56 2022] GET /compute/v2.1/servers/7ea371be-4910-49a2-93db-c315ce278a84 => generated 1143 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:38:57.308293 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-2f55ff5d-4bf8-418d-b1b2-7fe216d2d4fb tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:38:57.309622 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-2f55ff5d-4bf8-418d-b1b2-7fe216d2d4fb tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] [instance: 7ea371be-4910-49a2-93db-c315ce278a84] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:38:57.316936 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2f55ff5d-4bf8-418d-b1b2-7fe216d2d4fb tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:38:57.317548 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2f55ff5d-4bf8-418d-b1b2-7fe216d2d4fb tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:38:57.318104 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2f55ff5d-4bf8-418d-b1b2-7fe216d2d4fb tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:38:57.318905 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2f55ff5d-4bf8-418d-b1b2-7fe216d2d4fb tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:38:57.319532 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2f55ff5d-4bf8-418d-b1b2-7fe216d2d4fb tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:38:57.320041 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2f55ff5d-4bf8-418d-b1b2-7fe216d2d4fb tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:38:57.393646 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-2f55ff5d-4bf8-418d-b1b2-7fe216d2d4fb tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac4eff18a664804af16cf21321f9290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9857e88402494e964f2099de5bb60c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:38:57.401811 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-2f55ff5d-4bf8-418d-b1b2-7fe216d2d4fb tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] 10.222.0.26 "GET /compute/v2.1/servers/7ea371be-4910-49a2-93db-c315ce278a84" status: 200 len: 1209 microversion: 2.1 time: 0.097737 Oct 08 21:38:57.402397 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3078/6227] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:38:57 2022] GET /compute/v2.1/servers/7ea371be-4910-49a2-93db-c315ce278a84 => generated 1209 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:38:58.423920 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-8878a802-c3e8-47ab-a83f-b93711e08d17 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:38:58.425137 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-8878a802-c3e8-47ab-a83f-b93711e08d17 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] [instance: 7ea371be-4910-49a2-93db-c315ce278a84] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:38:58.431567 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8878a802-c3e8-47ab-a83f-b93711e08d17 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:38:58.432071 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8878a802-c3e8-47ab-a83f-b93711e08d17 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:38:58.432530 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8878a802-c3e8-47ab-a83f-b93711e08d17 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:38:58.433264 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8878a802-c3e8-47ab-a83f-b93711e08d17 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:38:58.433742 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8878a802-c3e8-47ab-a83f-b93711e08d17 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:38:58.434188 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8878a802-c3e8-47ab-a83f-b93711e08d17 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:38:58.579872 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-8b7e20bd-83d0-49e2-8a28-e4b06dcaaefe req-0dd89d07-1a5c-4ca0-9276-2207ea293ff4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ea371be-4910-49a2-93db-c315ce278a84", "tag": "55f80f28-d799-4e3f-8171-0a109bf211a9"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:38:58.589259 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-8b7e20bd-83d0-49e2-8a28-e4b06dcaaefe req-0dd89d07-1a5c-4ca0-9276-2207ea293ff4 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:38:58.589991 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-8b7e20bd-83d0-49e2-8a28-e4b06dcaaefe req-0dd89d07-1a5c-4ca0-9276-2207ea293ff4 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:38:58.590438 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-8b7e20bd-83d0-49e2-8a28-e4b06dcaaefe req-0dd89d07-1a5c-4ca0-9276-2207ea293ff4 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:38:58.602798 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-8b7e20bd-83d0-49e2-8a28-e4b06dcaaefe req-0dd89d07-1a5c-4ca0-9276-2207ea293ff4 service nova] Creating event network-changed:55f80f28-d799-4e3f-8171-0a109bf211a9 for instance 7ea371be-4910-49a2-93db-c315ce278a84 on nch1-master-1 Oct 08 21:38:58.607870 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-8b7e20bd-83d0-49e2-8a28-e4b06dcaaefe req-0dd89d07-1a5c-4ca0-9276-2207ea293ff4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122238 Oct 08 21:38:58.608641 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3079/6228] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:38:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:38:58.616962 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-8878a802-c3e8-47ab-a83f-b93711e08d17 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac4eff18a664804af16cf21321f9290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9857e88402494e964f2099de5bb60c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:38:58.624935 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-8878a802-c3e8-47ab-a83f-b93711e08d17 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] 10.222.0.26 "GET /compute/v2.1/servers/7ea371be-4910-49a2-93db-c315ce278a84" status: 200 len: 1264 microversion: 2.1 time: 0.204955 Oct 08 21:38:58.625554 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3150/6229] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:38:58 2022] GET /compute/v2.1/servers/7ea371be-4910-49a2-93db-c315ce278a84 => generated 1264 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:38:59.649352 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-5061e438-685a-4fc8-b4fc-8ddbcba23dee tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:38:59.650089 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-5061e438-685a-4fc8-b4fc-8ddbcba23dee tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] [instance: 7ea371be-4910-49a2-93db-c315ce278a84] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:38:59.656312 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5061e438-685a-4fc8-b4fc-8ddbcba23dee tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:38:59.656808 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5061e438-685a-4fc8-b4fc-8ddbcba23dee tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:38:59.657273 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5061e438-685a-4fc8-b4fc-8ddbcba23dee tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:38:59.657983 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5061e438-685a-4fc8-b4fc-8ddbcba23dee tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:38:59.658528 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5061e438-685a-4fc8-b4fc-8ddbcba23dee tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:38:59.658999 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5061e438-685a-4fc8-b4fc-8ddbcba23dee tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:39:00.101408 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-5061e438-685a-4fc8-b4fc-8ddbcba23dee tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac4eff18a664804af16cf21321f9290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9857e88402494e964f2099de5bb60c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:39:00.109319 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-5061e438-685a-4fc8-b4fc-8ddbcba23dee tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] 10.222.0.26 "GET /compute/v2.1/servers/7ea371be-4910-49a2-93db-c315ce278a84" status: 200 len: 1264 microversion: 2.1 time: 0.465010 Oct 08 21:39:00.109901 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3080/6230] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:38:59 2022] GET /compute/v2.1/servers/7ea371be-4910-49a2-93db-c315ce278a84 => generated 1264 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:39:01.132704 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-0594f73d-3b70-4fe4-81a6-3c65ae481b12 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:39:01.133381 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-0594f73d-3b70-4fe4-81a6-3c65ae481b12 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] [instance: 7ea371be-4910-49a2-93db-c315ce278a84] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:39:01.140412 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0594f73d-3b70-4fe4-81a6-3c65ae481b12 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:39:01.140869 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0594f73d-3b70-4fe4-81a6-3c65ae481b12 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:39:01.141359 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0594f73d-3b70-4fe4-81a6-3c65ae481b12 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:39:01.142081 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0594f73d-3b70-4fe4-81a6-3c65ae481b12 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:39:01.142568 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0594f73d-3b70-4fe4-81a6-3c65ae481b12 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:39:01.143508 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0594f73d-3b70-4fe4-81a6-3c65ae481b12 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:39:01.275307 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-0594f73d-3b70-4fe4-81a6-3c65ae481b12 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac4eff18a664804af16cf21321f9290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9857e88402494e964f2099de5bb60c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:39:01.283140 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-0594f73d-3b70-4fe4-81a6-3c65ae481b12 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] 10.222.0.26 "GET /compute/v2.1/servers/7ea371be-4910-49a2-93db-c315ce278a84" status: 200 len: 1264 microversion: 2.1 time: 0.154414 Oct 08 21:39:01.284379 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3151/6231] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:39:01 2022] GET /compute/v2.1/servers/7ea371be-4910-49a2-93db-c315ce278a84 => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:39:02.306322 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-3cda0533-9638-40fe-aef7-97e0f6804c05 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:39:02.306943 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-3cda0533-9638-40fe-aef7-97e0f6804c05 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] [instance: 7ea371be-4910-49a2-93db-c315ce278a84] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:39:02.313890 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3cda0533-9638-40fe-aef7-97e0f6804c05 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:39:02.314384 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3cda0533-9638-40fe-aef7-97e0f6804c05 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:39:02.314832 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3cda0533-9638-40fe-aef7-97e0f6804c05 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:39:02.315533 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3cda0533-9638-40fe-aef7-97e0f6804c05 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:39:02.315999 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3cda0533-9638-40fe-aef7-97e0f6804c05 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:39:02.316430 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3cda0533-9638-40fe-aef7-97e0f6804c05 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:39:02.448406 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-3cda0533-9638-40fe-aef7-97e0f6804c05 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac4eff18a664804af16cf21321f9290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9857e88402494e964f2099de5bb60c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:39:02.456920 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-3cda0533-9638-40fe-aef7-97e0f6804c05 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] 10.222.0.26 "GET /compute/v2.1/servers/7ea371be-4910-49a2-93db-c315ce278a84" status: 200 len: 1264 microversion: 2.1 time: 0.154550 Oct 08 21:39:02.457649 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3081/6232] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:39:02 2022] GET /compute/v2.1/servers/7ea371be-4910-49a2-93db-c315ce278a84 => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:39:03.480187 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-0c8ef1a3-6133-4490-a9eb-6fd432aa9f2e tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:39:03.481450 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-0c8ef1a3-6133-4490-a9eb-6fd432aa9f2e tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] [instance: 7ea371be-4910-49a2-93db-c315ce278a84] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:39:03.488517 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0c8ef1a3-6133-4490-a9eb-6fd432aa9f2e tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:39:03.489797 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0c8ef1a3-6133-4490-a9eb-6fd432aa9f2e tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:39:03.490578 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0c8ef1a3-6133-4490-a9eb-6fd432aa9f2e tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:39:03.491495 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0c8ef1a3-6133-4490-a9eb-6fd432aa9f2e tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:39:03.492182 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0c8ef1a3-6133-4490-a9eb-6fd432aa9f2e tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:39:03.492636 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0c8ef1a3-6133-4490-a9eb-6fd432aa9f2e tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:39:03.635203 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-0c8ef1a3-6133-4490-a9eb-6fd432aa9f2e tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac4eff18a664804af16cf21321f9290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9857e88402494e964f2099de5bb60c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:39:03.643479 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-0c8ef1a3-6133-4490-a9eb-6fd432aa9f2e tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] 10.222.0.26 "GET /compute/v2.1/servers/7ea371be-4910-49a2-93db-c315ce278a84" status: 200 len: 1264 microversion: 2.1 time: 0.167141 Oct 08 21:39:03.644082 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3152/6233] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:39:03 2022] GET /compute/v2.1/servers/7ea371be-4910-49a2-93db-c315ce278a84 => generated 1264 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:39:04.666850 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-ffb3acdd-cd0b-427a-946f-82ff7b5df3a4 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:39:04.667452 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-ffb3acdd-cd0b-427a-946f-82ff7b5df3a4 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] [instance: 7ea371be-4910-49a2-93db-c315ce278a84] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:39:04.674456 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ffb3acdd-cd0b-427a-946f-82ff7b5df3a4 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:39:04.675227 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ffb3acdd-cd0b-427a-946f-82ff7b5df3a4 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:39:04.675682 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ffb3acdd-cd0b-427a-946f-82ff7b5df3a4 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:39:04.676396 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ffb3acdd-cd0b-427a-946f-82ff7b5df3a4 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:39:04.676940 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ffb3acdd-cd0b-427a-946f-82ff7b5df3a4 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:39:04.677408 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ffb3acdd-cd0b-427a-946f-82ff7b5df3a4 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:39:04.821080 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-ffb3acdd-cd0b-427a-946f-82ff7b5df3a4 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac4eff18a664804af16cf21321f9290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9857e88402494e964f2099de5bb60c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:39:04.829294 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-ffb3acdd-cd0b-427a-946f-82ff7b5df3a4 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] 10.222.0.26 "GET /compute/v2.1/servers/7ea371be-4910-49a2-93db-c315ce278a84" status: 200 len: 1264 microversion: 2.1 time: 0.166412 Oct 08 21:39:04.829949 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3082/6234] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:39:04 2022] GET /compute/v2.1/servers/7ea371be-4910-49a2-93db-c315ce278a84 => generated 1264 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:39:05.652154 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-38532f30-7254-4ce8-a2a4-2f5e2cfb36a0 req-13280abe-c50c-4619-8949-578ea4db0273 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ea371be-4910-49a2-93db-c315ce278a84", "name": "network-vif-plugged", "status": "completed", "tag": "55f80f28-d799-4e3f-8171-0a109bf211a9"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:39:05.658311 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=2 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:39:05.659151 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=6 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:39:05.665751 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-38532f30-7254-4ce8-a2a4-2f5e2cfb36a0 req-13280abe-c50c-4619-8949-578ea4db0273 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:39:05.666388 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-38532f30-7254-4ce8-a2a4-2f5e2cfb36a0 req-13280abe-c50c-4619-8949-578ea4db0273 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:39:05.666847 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-38532f30-7254-4ce8-a2a4-2f5e2cfb36a0 req-13280abe-c50c-4619-8949-578ea4db0273 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:39:05.678936 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-38532f30-7254-4ce8-a2a4-2f5e2cfb36a0 req-13280abe-c50c-4619-8949-578ea4db0273 service nova] Creating event network-vif-plugged:55f80f28-d799-4e3f-8171-0a109bf211a9 for instance 7ea371be-4910-49a2-93db-c315ce278a84 on nch1-master-1 Oct 08 21:39:05.684918 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-38532f30-7254-4ce8-a2a4-2f5e2cfb36a0 req-13280abe-c50c-4619-8949-578ea4db0273 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036784 Oct 08 21:39:05.685565 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3153/6235] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:39:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 08 21:39:05.852544 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-ecf9d5b2-2bad-4570-bbea-3ead63fe3b2e tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:39:05.853168 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-ecf9d5b2-2bad-4570-bbea-3ead63fe3b2e tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] [instance: 7ea371be-4910-49a2-93db-c315ce278a84] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:39:05.855331 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=2 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:39:05.861516 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ecf9d5b2-2bad-4570-bbea-3ead63fe3b2e tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:39:05.862014 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ecf9d5b2-2bad-4570-bbea-3ead63fe3b2e tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:39:05.862460 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ecf9d5b2-2bad-4570-bbea-3ead63fe3b2e tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:39:05.863171 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ecf9d5b2-2bad-4570-bbea-3ead63fe3b2e tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:39:05.863646 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ecf9d5b2-2bad-4570-bbea-3ead63fe3b2e tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:39:05.864084 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ecf9d5b2-2bad-4570-bbea-3ead63fe3b2e tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:39:05.998139 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-ecf9d5b2-2bad-4570-bbea-3ead63fe3b2e tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac4eff18a664804af16cf21321f9290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9857e88402494e964f2099de5bb60c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:39:06.006531 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-ecf9d5b2-2bad-4570-bbea-3ead63fe3b2e tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] 10.222.0.26 "GET /compute/v2.1/servers/7ea371be-4910-49a2-93db-c315ce278a84" status: 200 len: 1264 microversion: 2.1 time: 0.158548 Oct 08 21:39:06.007110 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3083/6236] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:39:05 2022] GET /compute/v2.1/servers/7ea371be-4910-49a2-93db-c315ce278a84 => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:39:07.031254 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-10ed92ff-b0a9-4e5e-a65b-0ee8c0cc3339 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:39:07.031887 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-10ed92ff-b0a9-4e5e-a65b-0ee8c0cc3339 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] [instance: 7ea371be-4910-49a2-93db-c315ce278a84] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:39:07.038375 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-10ed92ff-b0a9-4e5e-a65b-0ee8c0cc3339 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:39:07.038894 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-10ed92ff-b0a9-4e5e-a65b-0ee8c0cc3339 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:39:07.039361 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-10ed92ff-b0a9-4e5e-a65b-0ee8c0cc3339 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:39:07.040091 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-10ed92ff-b0a9-4e5e-a65b-0ee8c0cc3339 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:39:07.040573 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-10ed92ff-b0a9-4e5e-a65b-0ee8c0cc3339 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:39:07.041022 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-10ed92ff-b0a9-4e5e-a65b-0ee8c0cc3339 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:39:07.175865 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-10ed92ff-b0a9-4e5e-a65b-0ee8c0cc3339 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac4eff18a664804af16cf21321f9290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9857e88402494e964f2099de5bb60c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:39:07.184192 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-10ed92ff-b0a9-4e5e-a65b-0ee8c0cc3339 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] 10.222.0.26 "GET /compute/v2.1/servers/7ea371be-4910-49a2-93db-c315ce278a84" status: 200 len: 1451 microversion: 2.1 time: 0.158262 Oct 08 21:39:07.184772 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3154/6237] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:39:07 2022] GET /compute/v2.1/servers/7ea371be-4910-49a2-93db-c315ce278a84 => generated 1451 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:39:07.206763 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-813ba8e6-9071-49e5-97f6-ff40e51471a9 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:39:07.207383 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-813ba8e6-9071-49e5-97f6-ff40e51471a9 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] [instance: 7ea371be-4910-49a2-93db-c315ce278a84] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:39:07.214390 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-813ba8e6-9071-49e5-97f6-ff40e51471a9 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:39:07.214888 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-813ba8e6-9071-49e5-97f6-ff40e51471a9 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:39:07.215337 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-813ba8e6-9071-49e5-97f6-ff40e51471a9 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:39:07.216044 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-813ba8e6-9071-49e5-97f6-ff40e51471a9 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:39:07.216533 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-813ba8e6-9071-49e5-97f6-ff40e51471a9 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:39:07.216970 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-813ba8e6-9071-49e5-97f6-ff40e51471a9 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:39:07.347398 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-813ba8e6-9071-49e5-97f6-ff40e51471a9 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac4eff18a664804af16cf21321f9290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9857e88402494e964f2099de5bb60c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:39:07.355406 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-813ba8e6-9071-49e5-97f6-ff40e51471a9 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] 10.222.0.26 "GET /compute/v2.1/servers/7ea371be-4910-49a2-93db-c315ce278a84" status: 200 len: 1451 microversion: 2.1 time: 0.152548 Oct 08 21:39:07.355965 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3084/6238] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:39:07 2022] GET /compute/v2.1/servers/7ea371be-4910-49a2-93db-c315ce278a84 => generated 1451 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:39:09.352488 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-ec65a5e6-8d8d-460f-b6f4-50f2d6e75800 req-653407fd-9d1c-433d-971e-cd3d1b7ea43b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ea371be-4910-49a2-93db-c315ce278a84", "tag": "55f80f28-d799-4e3f-8171-0a109bf211a9"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:39:09.364447 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-ec65a5e6-8d8d-460f-b6f4-50f2d6e75800 req-653407fd-9d1c-433d-971e-cd3d1b7ea43b service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:39:09.365247 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-ec65a5e6-8d8d-460f-b6f4-50f2d6e75800 req-653407fd-9d1c-433d-971e-cd3d1b7ea43b service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:39:09.365707 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-ec65a5e6-8d8d-460f-b6f4-50f2d6e75800 req-653407fd-9d1c-433d-971e-cd3d1b7ea43b service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:39:09.377407 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-ec65a5e6-8d8d-460f-b6f4-50f2d6e75800 req-653407fd-9d1c-433d-971e-cd3d1b7ea43b service nova] Creating event network-changed:55f80f28-d799-4e3f-8171-0a109bf211a9 for instance 7ea371be-4910-49a2-93db-c315ce278a84 on nch1-master-1 Oct 08 21:39:09.383812 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-ec65a5e6-8d8d-460f-b6f4-50f2d6e75800 req-653407fd-9d1c-433d-971e-cd3d1b7ea43b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035318 Oct 08 21:39:09.384015 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3155/6239] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:39:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 08 21:40:49.734876 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-6d4e2768-d2e6-4651-be09-479567de294e tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:40:49.735461 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:40:49.735857 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-6d4e2768-d2e6-4651-be09-479567de294e tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] [instance: 7ea371be-4910-49a2-93db-c315ce278a84] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:40:49.736441 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=36 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:40:49.741703 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:SELECT=18 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:40:49.742549 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=38 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:40:49.742669 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-f72a2a6c-1605-48e4-a59e-f3772134c797 req-ec150a59-9bce-4c64-8fd1-b78dd78e6685 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ea371be-4910-49a2-93db-c315ce278a84", "tag": "55f80f28-d799-4e3f-8171-0a109bf211a9"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:40:49.743777 ncdv-master-1 devstack@n-api.service[140491]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 08 21:40:49.744124 ncdv-master-1 devstack@n-api.service[140491]: Sat Oct 8 21:40:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7ea371be-4910-49a2-93db-c315ce278a84 (ip 10.222.0.26) !!! Oct 08 21:40:49.745293 ncdv-master-1 devstack@n-api.service[140491]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 08 21:40:49.745576 ncdv-master-1 devstack@n-api.service[140491]: Sat Oct 8 21:40:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7ea371be-4910-49a2-93db-c315ce278a84 (ip 10.222.0.26) !!! Oct 08 21:40:49.749993 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6d4e2768-d2e6-4651-be09-479567de294e tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:40:49.750496 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6d4e2768-d2e6-4651-be09-479567de294e tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:40:49.750947 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6d4e2768-d2e6-4651-be09-479567de294e tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:40:49.751670 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6d4e2768-d2e6-4651-be09-479567de294e tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:40:49.752331 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6d4e2768-d2e6-4651-be09-479567de294e tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:40:49.752924 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6d4e2768-d2e6-4651-be09-479567de294e tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:40:49.758178 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-f72a2a6c-1605-48e4-a59e-f3772134c797 req-ec150a59-9bce-4c64-8fd1-b78dd78e6685 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:40:49.758704 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-f72a2a6c-1605-48e4-a59e-f3772134c797 req-ec150a59-9bce-4c64-8fd1-b78dd78e6685 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:40:49.759167 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-f72a2a6c-1605-48e4-a59e-f3772134c797 req-ec150a59-9bce-4c64-8fd1-b78dd78e6685 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:40:49.772587 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-f72a2a6c-1605-48e4-a59e-f3772134c797 req-ec150a59-9bce-4c64-8fd1-b78dd78e6685 service nova] Creating event network-changed:55f80f28-d799-4e3f-8171-0a109bf211a9 for instance 7ea371be-4910-49a2-93db-c315ce278a84 on nch1-master-1 Oct 08 21:40:49.777838 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-f72a2a6c-1605-48e4-a59e-f3772134c797 req-ec150a59-9bce-4c64-8fd1-b78dd78e6685 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045102 Oct 08 21:40:49.778824 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3156/6240] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:40:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 08 21:40:49.786462 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-6d4e2768-d2e6-4651-be09-479567de294e tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] [instance: 7ea371be-4910-49a2-93db-c315ce278a84] Going to try to terminate instance {{(pid=140491) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 21:40:49.870563 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-6d4e2768-d2e6-4651-be09-479567de294e tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] 10.222.0.26 "DELETE /compute/v2.1/servers/7ea371be-4910-49a2-93db-c315ce278a84" status: 204 len: 0 microversion: 2.1 time: 0.141439 Oct 08 21:40:49.871306 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3085/6241] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:40:49 2022] DELETE /compute/v2.1/servers/7ea371be-4910-49a2-93db-c315ce278a84 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 21:40:49.882194 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-c12c0b6f-54c4-416b-8cbe-b255f9dc0776 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:40:49.883392 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-c12c0b6f-54c4-416b-8cbe-b255f9dc0776 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] [instance: 7ea371be-4910-49a2-93db-c315ce278a84] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:40:49.891185 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c12c0b6f-54c4-416b-8cbe-b255f9dc0776 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:40:49.891831 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c12c0b6f-54c4-416b-8cbe-b255f9dc0776 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:40:49.892551 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c12c0b6f-54c4-416b-8cbe-b255f9dc0776 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:40:49.896812 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c12c0b6f-54c4-416b-8cbe-b255f9dc0776 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:40:49.896812 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c12c0b6f-54c4-416b-8cbe-b255f9dc0776 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:40:49.896812 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c12c0b6f-54c4-416b-8cbe-b255f9dc0776 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:40:50.030607 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-c12c0b6f-54c4-416b-8cbe-b255f9dc0776 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac4eff18a664804af16cf21321f9290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9857e88402494e964f2099de5bb60c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:40:50.038495 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-c12c0b6f-54c4-416b-8cbe-b255f9dc0776 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] 10.222.0.26 "GET /compute/v2.1/servers/7ea371be-4910-49a2-93db-c315ce278a84" status: 200 len: 1575 microversion: 2.1 time: 0.161913 Oct 08 21:40:50.039071 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3157/6242] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:40:49 2022] GET /compute/v2.1/servers/7ea371be-4910-49a2-93db-c315ce278a84 => generated 1575 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:40:51.063710 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c1b2ae2a-3201-4727-b122-5802c539b645 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:40:51.064538 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-c1b2ae2a-3201-4727-b122-5802c539b645 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] [instance: 7ea371be-4910-49a2-93db-c315ce278a84] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:40:51.071678 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c1b2ae2a-3201-4727-b122-5802c539b645 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:40:51.072172 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c1b2ae2a-3201-4727-b122-5802c539b645 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:40:51.072615 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c1b2ae2a-3201-4727-b122-5802c539b645 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:40:51.073349 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c1b2ae2a-3201-4727-b122-5802c539b645 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:40:51.074068 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c1b2ae2a-3201-4727-b122-5802c539b645 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:40:51.074530 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c1b2ae2a-3201-4727-b122-5802c539b645 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:40:51.253582 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-c1b2ae2a-3201-4727-b122-5802c539b645 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac4eff18a664804af16cf21321f9290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9857e88402494e964f2099de5bb60c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:40:51.261509 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-c1b2ae2a-3201-4727-b122-5802c539b645 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] 10.222.0.26 "GET /compute/v2.1/servers/7ea371be-4910-49a2-93db-c315ce278a84" status: 200 len: 1575 microversion: 2.1 time: 0.202269 Oct 08 21:40:51.262095 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3086/6243] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:40:51 2022] GET /compute/v2.1/servers/7ea371be-4910-49a2-93db-c315ce278a84 => generated 1575 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:40:52.026169 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-f3092f7f-9738-4038-bfdc-767be9a3a1ed req-218f313f-cd95-4c1a-810d-5807d78002fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ea371be-4910-49a2-93db-c315ce278a84", "name": "network-vif-deleted", "tag": "55f80f28-d799-4e3f-8171-0a109bf211a9"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:40:52.037557 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-f3092f7f-9738-4038-bfdc-767be9a3a1ed req-218f313f-cd95-4c1a-810d-5807d78002fd service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:40:52.038088 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-f3092f7f-9738-4038-bfdc-767be9a3a1ed req-218f313f-cd95-4c1a-810d-5807d78002fd service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:40:52.039258 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-f3092f7f-9738-4038-bfdc-767be9a3a1ed req-218f313f-cd95-4c1a-810d-5807d78002fd service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:40:52.052783 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-f3092f7f-9738-4038-bfdc-767be9a3a1ed req-218f313f-cd95-4c1a-810d-5807d78002fd service nova] Creating event network-vif-deleted:55f80f28-d799-4e3f-8171-0a109bf211a9 for instance 7ea371be-4910-49a2-93db-c315ce278a84 on nch1-master-1 Oct 08 21:40:52.058009 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-f3092f7f-9738-4038-bfdc-767be9a3a1ed req-218f313f-cd95-4c1a-810d-5807d78002fd service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035762 Oct 08 21:40:52.058601 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3158/6244] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:40:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:40:52.286447 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c325942e-e214-4b50-8a94-1fe261c95841 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:40:52.289088 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-c325942e-e214-4b50-8a94-1fe261c95841 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] [instance: 7ea371be-4910-49a2-93db-c315ce278a84] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:40:52.299954 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c325942e-e214-4b50-8a94-1fe261c95841 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:40:52.300782 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c325942e-e214-4b50-8a94-1fe261c95841 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:40:52.301511 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c325942e-e214-4b50-8a94-1fe261c95841 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:40:52.302852 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c325942e-e214-4b50-8a94-1fe261c95841 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:40:52.303367 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c325942e-e214-4b50-8a94-1fe261c95841 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:40:52.303993 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c325942e-e214-4b50-8a94-1fe261c95841 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:40:52.349920 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c325942e-e214-4b50-8a94-1fe261c95841 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:40:52.350569 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c325942e-e214-4b50-8a94-1fe261c95841 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:40:52.351029 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c325942e-e214-4b50-8a94-1fe261c95841 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:40:52.351496 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.objects.instance [None req-c325942e-e214-4b50-8a94-1fe261c95841 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lazy-loading 'fault' on Instance uuid 7ea371be-4910-49a2-93db-c315ce278a84 {{(pid=140491) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 21:40:52.400752 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-c325942e-e214-4b50-8a94-1fe261c95841 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac4eff18a664804af16cf21321f9290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9857e88402494e964f2099de5bb60c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:40:52.415030 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-c325942e-e214-4b50-8a94-1fe261c95841 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] 10.222.0.26 "GET /compute/v2.1/servers/7ea371be-4910-49a2-93db-c315ce278a84" status: 200 len: 1229 microversion: 2.1 time: 0.134893 Oct 08 21:40:52.416213 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3087/6245] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:40:52 2022] GET /compute/v2.1/servers/7ea371be-4910-49a2-93db-c315ce278a84 => generated 1229 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:40:53.440012 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-8371cc2d-c847-4442-a386-3240255556d7 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:40:53.440739 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-8371cc2d-c847-4442-a386-3240255556d7 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] [instance: 7ea371be-4910-49a2-93db-c315ce278a84] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:40:53.447878 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8371cc2d-c847-4442-a386-3240255556d7 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:40:53.448384 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8371cc2d-c847-4442-a386-3240255556d7 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:40:53.449095 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8371cc2d-c847-4442-a386-3240255556d7 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:40:53.450485 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8371cc2d-c847-4442-a386-3240255556d7 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:40:53.450967 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8371cc2d-c847-4442-a386-3240255556d7 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:40:53.451415 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8371cc2d-c847-4442-a386-3240255556d7 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:40:53.464516 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-8371cc2d-c847-4442-a386-3240255556d7 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] HTTP exception thrown: Instance 7ea371be-4910-49a2-93db-c315ce278a84 could not be found. Oct 08 21:40:53.466431 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-8371cc2d-c847-4442-a386-3240255556d7 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Request method failure captured: Oct 08 21:40:53.466431 ncdv-master-1 devstack@n-api.service[140492]: request: GET /compute/v2.1/servers/7ea371be-4910-49a2-93db-c315ce278a84 HTTP/1.1 Oct 08 21:40:53.466431 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:40:53.466431 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:40:53.466431 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:40:53.466431 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 21:40:53.466431 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:40:53.466431 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:40:53.466431 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:40:53.466431 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:40:53.466431 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeyESueD2G2p08fpZng5dUIvJRbscky3tGNIT1dlSRltWQwygOyYfQAwVe7KLvB4NB9Rvs7JJ6Z3bstxj1FPhWmo56k4nFHZVnko_1G4tfE_I1T9paCtzZG8sfJM33h9PLTo7_TpIQ4aSXx-QLhm7_UAuDXZaIvpFH6pLdWcKYlBxWo Oct 08 21:40:53.466431 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:40:53.466431 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:40:53.466431 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:40:53.466431 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:40:53.466431 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:40:53.466431 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:40:53.466431 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 8d9857e88402494e964f2099de5bb60c Oct 08 21:40:53.466431 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-TestVolumeBootPattern-1770467933 Oct 08 21:40:53.466431 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:40:53.466431 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:40:53.466431 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8d9857e88402494e964f2099de5bb60c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8d9857e88402494e964f2099de5bb60c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8d9857e88402494e964f2099de5bb60c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8d9857e88402494e964f2099de5bb60c"}]}] Oct 08 21:40:53.466431 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-TestVolumeBootPattern-1770467933 Oct 08 21:40:53.466431 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 8d9857e88402494e964f2099de5bb60c Oct 08 21:40:53.466431 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-TestVolumeBootPattern-1770467933 Oct 08 21:40:53.466431 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-TestVolumeBootPattern-1770467933-project Oct 08 21:40:53.466431 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:40:53.466431 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:40:53.466431 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 7ac4eff18a664804af16cf21321f9290 Oct 08 21:40:53.466431 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-TestVolumeBootPattern-1770467933-project Oct 08 21:40:53.466431 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 21:40:53.466431 ncdv-master-1 devstack@n-api.service[140492]: exception: Instance 7ea371be-4910-49a2-93db-c315ce278a84 could not be found. Oct 08 21:40:53.466431 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': '7ea371be-4910-49a2-93db-c315ce278a84'} Oct 08 21:40:53.466431 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:40:53.466431 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:40:53.466431 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:40:53.466431 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:40:53.466431 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:40:53.466431 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:40:53.466431 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:40:53.466431 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:40:53.466431 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:40:53.466431 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:40:53.466431 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ea371be-4910-49a2-93db-c315ce278a84 could not be found. Oct 08 21:40:53.466431 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:40:53.466431 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:40:53.466431 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:40:53.466431 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:40:53.466431 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:40:53.466431 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:40:53.466431 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:40:53.466431 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:40:53.466431 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:40:53.466431 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:40:53.466431 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:40:53.466431 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:40:53.466431 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:40:53.466431 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:40:53.466431 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:40:53.466431 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:40:53.466431 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ea371be-4910-49a2-93db-c315ce278a84 could not be found. Oct 08 21:40:53.466431 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:40:53.466431 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:40:53.466431 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:40:53.471148 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:40:53.471148 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:40:53.471148 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:40:53.471148 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:40:53.471148 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:40:53.471148 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ea371be-4910-49a2-93db-c315ce278a84 could not be found. Oct 08 21:40:53.471148 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:40:53.471148 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-8371cc2d-c847-4442-a386-3240255556d7 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Returning 404 to user: Instance 7ea371be-4910-49a2-93db-c315ce278a84 could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:40:53.471148 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-8371cc2d-c847-4442-a386-3240255556d7 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] 10.222.0.26 "GET /compute/v2.1/servers/7ea371be-4910-49a2-93db-c315ce278a84" status: 404 len: 111 microversion: 2.1 time: 0.032236 Oct 08 21:40:53.471148 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3159/6246] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:40:53 2022] GET /compute/v2.1/servers/7ea371be-4910-49a2-93db-c315ce278a84 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:41:26.409468 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-8b439759-44d8-4e38-b79e-07652eee1f9b tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:41:26.410029 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-8b439759-44d8-4e38-b79e-07652eee1f9b tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] [instance: 195a4f47-6189-4513-81cc-a7ea67707076] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:41:26.412498 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:41:26.413387 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:41:26.413520 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=8 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:41:26.414603 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=12 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:41:26.423310 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8b439759-44d8-4e38-b79e-07652eee1f9b tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:41:26.423998 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8b439759-44d8-4e38-b79e-07652eee1f9b tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:41:26.424966 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8b439759-44d8-4e38-b79e-07652eee1f9b tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:41:26.426574 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8b439759-44d8-4e38-b79e-07652eee1f9b tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:41:26.426833 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8b439759-44d8-4e38-b79e-07652eee1f9b tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:41:26.427627 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8b439759-44d8-4e38-b79e-07652eee1f9b tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:41:26.461884 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-8b439759-44d8-4e38-b79e-07652eee1f9b tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] [instance: 195a4f47-6189-4513-81cc-a7ea67707076] Going to try to terminate instance {{(pid=140491) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 21:41:26.503730 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-6f6fdfb3-79d7-466c-b2c9-9170463a0f63 req-e5c7a1ae-b617-4399-85f4-e007d8eba1cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "195a4f47-6189-4513-81cc-a7ea67707076", "tag": "21c55940-ec54-46dd-a987-ab70b90d2e06"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:41:26.514442 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-6f6fdfb3-79d7-466c-b2c9-9170463a0f63 req-e5c7a1ae-b617-4399-85f4-e007d8eba1cd service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:41:26.515048 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-6f6fdfb3-79d7-466c-b2c9-9170463a0f63 req-e5c7a1ae-b617-4399-85f4-e007d8eba1cd service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:41:26.515572 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-6f6fdfb3-79d7-466c-b2c9-9170463a0f63 req-e5c7a1ae-b617-4399-85f4-e007d8eba1cd service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:41:26.529276 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-6f6fdfb3-79d7-466c-b2c9-9170463a0f63 req-e5c7a1ae-b617-4399-85f4-e007d8eba1cd service nova] Creating event network-changed:21c55940-ec54-46dd-a987-ab70b90d2e06 for instance 195a4f47-6189-4513-81cc-a7ea67707076 on nch2-master-1 Oct 08 21:41:26.534385 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-6f6fdfb3-79d7-466c-b2c9-9170463a0f63 req-e5c7a1ae-b617-4399-85f4-e007d8eba1cd service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126140 Oct 08 21:41:26.535072 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3160/6247] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:41:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:41:26.552330 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-8b439759-44d8-4e38-b79e-07652eee1f9b tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] 10.222.0.26 "DELETE /compute/v2.1/servers/195a4f47-6189-4513-81cc-a7ea67707076" status: 204 len: 0 microversion: 2.1 time: 0.146746 Oct 08 21:41:26.553281 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3088/6248] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:41:26 2022] DELETE /compute/v2.1/servers/195a4f47-6189-4513-81cc-a7ea67707076 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 21:41:26.563647 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-0319cae4-821b-404a-a5cc-1073a94d8d87 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:41:26.564673 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-0319cae4-821b-404a-a5cc-1073a94d8d87 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] [instance: 195a4f47-6189-4513-81cc-a7ea67707076] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:41:26.572444 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0319cae4-821b-404a-a5cc-1073a94d8d87 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:41:26.573373 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0319cae4-821b-404a-a5cc-1073a94d8d87 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:41:26.573936 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0319cae4-821b-404a-a5cc-1073a94d8d87 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:41:26.575325 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0319cae4-821b-404a-a5cc-1073a94d8d87 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:41:26.576101 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0319cae4-821b-404a-a5cc-1073a94d8d87 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:41:26.577514 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0319cae4-821b-404a-a5cc-1073a94d8d87 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:41:26.721645 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-0319cae4-821b-404a-a5cc-1073a94d8d87 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac4eff18a664804af16cf21321f9290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9857e88402494e964f2099de5bb60c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:41:26.730042 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-0319cae4-821b-404a-a5cc-1073a94d8d87 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] 10.222.0.26 "GET /compute/v2.1/servers/195a4f47-6189-4513-81cc-a7ea67707076" status: 200 len: 1576 microversion: 2.1 time: 0.172403 Oct 08 21:41:26.730930 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3161/6249] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:41:26 2022] GET /compute/v2.1/servers/195a4f47-6189-4513-81cc-a7ea67707076 => generated 1576 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:41:27.754217 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-92850c8a-149b-4eb3-ba41-fe18b8abc72d tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:41:27.755052 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-92850c8a-149b-4eb3-ba41-fe18b8abc72d tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] [instance: 195a4f47-6189-4513-81cc-a7ea67707076] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:41:27.761512 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-92850c8a-149b-4eb3-ba41-fe18b8abc72d tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:41:27.762033 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-92850c8a-149b-4eb3-ba41-fe18b8abc72d tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:41:27.762490 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-92850c8a-149b-4eb3-ba41-fe18b8abc72d tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:41:27.763191 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-92850c8a-149b-4eb3-ba41-fe18b8abc72d tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:41:27.763654 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-92850c8a-149b-4eb3-ba41-fe18b8abc72d tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:41:27.764086 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-92850c8a-149b-4eb3-ba41-fe18b8abc72d tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:41:27.896179 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-92850c8a-149b-4eb3-ba41-fe18b8abc72d tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac4eff18a664804af16cf21321f9290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9857e88402494e964f2099de5bb60c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:41:27.905528 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-92850c8a-149b-4eb3-ba41-fe18b8abc72d tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] 10.222.0.26 "GET /compute/v2.1/servers/195a4f47-6189-4513-81cc-a7ea67707076" status: 200 len: 1576 microversion: 2.1 time: 0.155494 Oct 08 21:41:27.906340 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3089/6250] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:41:27 2022] GET /compute/v2.1/servers/195a4f47-6189-4513-81cc-a7ea67707076 => generated 1576 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:41:28.557328 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-786377ba-451d-4bac-aad2-e77be49283f9 req-7c8c7d2f-9945-4ca9-afc3-ea3bd42e338d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "195a4f47-6189-4513-81cc-a7ea67707076", "name": "network-vif-deleted", "tag": "21c55940-ec54-46dd-a987-ab70b90d2e06"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:41:28.569997 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-786377ba-451d-4bac-aad2-e77be49283f9 req-7c8c7d2f-9945-4ca9-afc3-ea3bd42e338d service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:41:28.570511 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-786377ba-451d-4bac-aad2-e77be49283f9 req-7c8c7d2f-9945-4ca9-afc3-ea3bd42e338d service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:41:28.570968 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-786377ba-451d-4bac-aad2-e77be49283f9 req-7c8c7d2f-9945-4ca9-afc3-ea3bd42e338d service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:41:28.584291 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-786377ba-451d-4bac-aad2-e77be49283f9 req-7c8c7d2f-9945-4ca9-afc3-ea3bd42e338d service nova] Creating event network-vif-deleted:21c55940-ec54-46dd-a987-ab70b90d2e06 for instance 195a4f47-6189-4513-81cc-a7ea67707076 on nch2-master-1 Oct 08 21:41:28.590591 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-786377ba-451d-4bac-aad2-e77be49283f9 req-7c8c7d2f-9945-4ca9-afc3-ea3bd42e338d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036698 Oct 08 21:41:28.591039 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3162/6251] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:41:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:41:28.929430 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-6a939af4-4e33-4b9a-983e-4e7bba24ec90 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:41:28.930064 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-6a939af4-4e33-4b9a-983e-4e7bba24ec90 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] [instance: 195a4f47-6189-4513-81cc-a7ea67707076] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:41:28.937476 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6a939af4-4e33-4b9a-983e-4e7bba24ec90 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:41:28.938131 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6a939af4-4e33-4b9a-983e-4e7bba24ec90 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:41:28.938610 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6a939af4-4e33-4b9a-983e-4e7bba24ec90 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:41:28.939329 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6a939af4-4e33-4b9a-983e-4e7bba24ec90 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:41:28.939790 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6a939af4-4e33-4b9a-983e-4e7bba24ec90 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:41:28.940221 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6a939af4-4e33-4b9a-983e-4e7bba24ec90 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:41:28.974502 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6a939af4-4e33-4b9a-983e-4e7bba24ec90 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:41:28.974988 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6a939af4-4e33-4b9a-983e-4e7bba24ec90 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:41:28.975430 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6a939af4-4e33-4b9a-983e-4e7bba24ec90 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:41:28.975886 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.objects.instance [None req-6a939af4-4e33-4b9a-983e-4e7bba24ec90 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lazy-loading 'fault' on Instance uuid 195a4f47-6189-4513-81cc-a7ea67707076 {{(pid=140491) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 21:41:29.021179 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-6a939af4-4e33-4b9a-983e-4e7bba24ec90 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac4eff18a664804af16cf21321f9290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9857e88402494e964f2099de5bb60c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:41:29.029758 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-6a939af4-4e33-4b9a-983e-4e7bba24ec90 tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] 10.222.0.26 "GET /compute/v2.1/servers/195a4f47-6189-4513-81cc-a7ea67707076" status: 200 len: 1229 microversion: 2.1 time: 0.104293 Oct 08 21:41:29.030274 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3090/6252] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:41:28 2022] GET /compute/v2.1/servers/195a4f47-6189-4513-81cc-a7ea67707076 => generated 1229 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:41:30.054510 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-38d5f051-fab3-41e9-bd82-5c854860418e tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:41:30.055237 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-38d5f051-fab3-41e9-bd82-5c854860418e tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] [instance: 195a4f47-6189-4513-81cc-a7ea67707076] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:41:30.062497 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-38d5f051-fab3-41e9-bd82-5c854860418e tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:41:30.063001 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-38d5f051-fab3-41e9-bd82-5c854860418e tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:41:30.063463 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-38d5f051-fab3-41e9-bd82-5c854860418e tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:41:30.064176 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-38d5f051-fab3-41e9-bd82-5c854860418e tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:41:30.064657 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-38d5f051-fab3-41e9-bd82-5c854860418e tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:41:30.065106 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-38d5f051-fab3-41e9-bd82-5c854860418e tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:41:30.080638 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-38d5f051-fab3-41e9-bd82-5c854860418e tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] HTTP exception thrown: Instance 195a4f47-6189-4513-81cc-a7ea67707076 could not be found. Oct 08 21:41:30.082310 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-38d5f051-fab3-41e9-bd82-5c854860418e tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Request method failure captured: Oct 08 21:41:30.082310 ncdv-master-1 devstack@n-api.service[140492]: request: GET /compute/v2.1/servers/195a4f47-6189-4513-81cc-a7ea67707076 HTTP/1.1 Oct 08 21:41:30.082310 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:41:30.082310 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:41:30.082310 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:41:30.082310 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 21:41:30.082310 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:41:30.082310 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:41:30.082310 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:41:30.082310 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:41:30.082310 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeyESueD2G2p08fpZng5dUIvJRbscky3tGNIT1dlSRltWQwygOyYfQAwVe7KLvB4NB9Rvs7JJ6Z3bstxj1FPhWmo56k4nFHZVnko_1G4tfE_I1T9paCtzZG8sfJM33h9PLTo7_TpIQ4aSXx-QLhm7_UAuDXZaIvpFH6pLdWcKYlBxWo Oct 08 21:41:30.082310 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:41:30.082310 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:41:30.082310 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:41:30.082310 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:41:30.082310 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:41:30.082310 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:41:30.082310 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 8d9857e88402494e964f2099de5bb60c Oct 08 21:41:30.082310 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-TestVolumeBootPattern-1770467933 Oct 08 21:41:30.082310 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:41:30.082310 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:41:30.082310 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8d9857e88402494e964f2099de5bb60c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8d9857e88402494e964f2099de5bb60c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8d9857e88402494e964f2099de5bb60c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8d9857e88402494e964f2099de5bb60c"}]}] Oct 08 21:41:30.082310 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-TestVolumeBootPattern-1770467933 Oct 08 21:41:30.082310 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 8d9857e88402494e964f2099de5bb60c Oct 08 21:41:30.082310 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-TestVolumeBootPattern-1770467933 Oct 08 21:41:30.082310 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-TestVolumeBootPattern-1770467933-project Oct 08 21:41:30.082310 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:41:30.082310 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:41:30.082310 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 7ac4eff18a664804af16cf21321f9290 Oct 08 21:41:30.082310 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-TestVolumeBootPattern-1770467933-project Oct 08 21:41:30.082310 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 21:41:30.082310 ncdv-master-1 devstack@n-api.service[140492]: exception: Instance 195a4f47-6189-4513-81cc-a7ea67707076 could not be found. Oct 08 21:41:30.082310 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': '195a4f47-6189-4513-81cc-a7ea67707076'} Oct 08 21:41:30.082310 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:41:30.082310 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:41:30.082310 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:41:30.082310 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:41:30.082310 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:41:30.082310 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:41:30.082310 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:41:30.082310 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:41:30.082310 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:41:30.082310 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:41:30.082310 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 195a4f47-6189-4513-81cc-a7ea67707076 could not be found. Oct 08 21:41:30.082310 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:41:30.082310 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:41:30.082310 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:41:30.082310 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:41:30.082310 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:41:30.082310 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:41:30.082310 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:41:30.082310 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:41:30.082310 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:41:30.082310 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:41:30.082310 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:41:30.082310 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:41:30.082310 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:41:30.082310 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:41:30.082310 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:41:30.082310 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:41:30.082310 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 195a4f47-6189-4513-81cc-a7ea67707076 could not be found. Oct 08 21:41:30.082310 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:41:30.082310 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:41:30.082310 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:41:30.086656 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:41:30.086656 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:41:30.086656 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:41:30.086656 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:41:30.086656 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:41:30.086656 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 195a4f47-6189-4513-81cc-a7ea67707076 could not be found. Oct 08 21:41:30.086656 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:41:30.086656 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-38d5f051-fab3-41e9-bd82-5c854860418e tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Returning 404 to user: Instance 195a4f47-6189-4513-81cc-a7ea67707076 could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:41:30.086656 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-38d5f051-fab3-41e9-bd82-5c854860418e tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] 10.222.0.26 "GET /compute/v2.1/servers/195a4f47-6189-4513-81cc-a7ea67707076" status: 404 len: 111 microversion: 2.1 time: 0.033498 Oct 08 21:41:30.086656 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3163/6253] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:41:30 2022] GET /compute/v2.1/servers/195a4f47-6189-4513-81cc-a7ea67707076 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:41:30.525372 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-cc4afac3-5172-4e31-a97b-5c09e2fd28ba tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:41:30.525870 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-cc4afac3-5172-4e31-a97b-5c09e2fd28ba tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] [instance: aee8a6a8-6de5-42bd-a185-4bacc2b1e490] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:41:30.533456 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cc4afac3-5172-4e31-a97b-5c09e2fd28ba tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:41:30.533955 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cc4afac3-5172-4e31-a97b-5c09e2fd28ba tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:41:30.534409 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cc4afac3-5172-4e31-a97b-5c09e2fd28ba tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:41:30.535120 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cc4afac3-5172-4e31-a97b-5c09e2fd28ba tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:41:30.535587 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cc4afac3-5172-4e31-a97b-5c09e2fd28ba tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:41:30.536026 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cc4afac3-5172-4e31-a97b-5c09e2fd28ba tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:41:30.549586 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-cc4afac3-5172-4e31-a97b-5c09e2fd28ba tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] HTTP exception thrown: Instance aee8a6a8-6de5-42bd-a185-4bacc2b1e490 could not be found. Oct 08 21:41:30.551263 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-cc4afac3-5172-4e31-a97b-5c09e2fd28ba tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Request method failure captured: Oct 08 21:41:30.551263 ncdv-master-1 devstack@n-api.service[140491]: request: DELETE /compute/v2.1/servers/aee8a6a8-6de5-42bd-a185-4bacc2b1e490 HTTP/1.1 Oct 08 21:41:30.551263 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:41:30.551263 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:41:30.551263 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:41:30.551263 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 21:41:30.551263 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:41:30.551263 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:41:30.551263 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:41:30.551263 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:41:30.551263 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQeyESueD2G2p08fpZng5dUIvJRbscky3tGNIT1dlSRltWQwygOyYfQAwVe7KLvB4NB9Rvs7JJ6Z3bstxj1FPhWmo56k4nFHZVnko_1G4tfE_I1T9paCtzZG8sfJM33h9PLTo7_TpIQ4aSXx-QLhm7_UAuDXZaIvpFH6pLdWcKYlBxWo Oct 08 21:41:30.551263 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:41:30.551263 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:41:30.551263 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:41:30.551263 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:41:30.551263 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:41:30.551263 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:41:30.551263 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 8d9857e88402494e964f2099de5bb60c Oct 08 21:41:30.551263 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-TestVolumeBootPattern-1770467933 Oct 08 21:41:30.551263 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:41:30.551263 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:41:30.551263 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8d9857e88402494e964f2099de5bb60c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8d9857e88402494e964f2099de5bb60c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8d9857e88402494e964f2099de5bb60c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8d9857e88402494e964f2099de5bb60c"}]}] Oct 08 21:41:30.551263 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-TestVolumeBootPattern-1770467933 Oct 08 21:41:30.551263 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 8d9857e88402494e964f2099de5bb60c Oct 08 21:41:30.551263 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-TestVolumeBootPattern-1770467933 Oct 08 21:41:30.551263 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-TestVolumeBootPattern-1770467933-project Oct 08 21:41:30.551263 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:41:30.551263 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:41:30.551263 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 7ac4eff18a664804af16cf21321f9290 Oct 08 21:41:30.551263 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-TestVolumeBootPattern-1770467933-project Oct 08 21:41:30.551263 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:41:30.551263 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance aee8a6a8-6de5-42bd-a185-4bacc2b1e490 could not be found. Oct 08 21:41:30.551263 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': 'aee8a6a8-6de5-42bd-a185-4bacc2b1e490'} Oct 08 21:41:30.551263 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:41:30.551263 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:41:30.551263 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:41:30.551263 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:41:30.551263 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:41:30.551263 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:41:30.551263 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:41:30.551263 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:41:30.551263 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:41:30.551263 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:41:30.551263 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aee8a6a8-6de5-42bd-a185-4bacc2b1e490 could not be found. Oct 08 21:41:30.551263 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:41:30.551263 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:41:30.551263 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:41:30.551263 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:41:30.551263 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:41:30.551263 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:41:30.551263 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:41:30.551263 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:41:30.551263 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:41:30.551263 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:41:30.551263 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 08 21:41:30.551263 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 08 21:41:30.551263 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 08 21:41:30.551263 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 08 21:41:30.551263 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:41:30.551263 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:41:30.551263 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:41:30.551263 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:41:30.555201 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aee8a6a8-6de5-42bd-a185-4bacc2b1e490 could not be found. Oct 08 21:41:30.555201 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:41:30.555201 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:41:30.555201 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:41:30.555201 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:41:30.555201 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:41:30.555201 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:41:30.555201 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:41:30.555201 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:41:30.555201 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aee8a6a8-6de5-42bd-a185-4bacc2b1e490 could not be found. Oct 08 21:41:30.555201 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:41:30.555201 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-cc4afac3-5172-4e31-a97b-5c09e2fd28ba tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Returning 404 to user: Instance aee8a6a8-6de5-42bd-a185-4bacc2b1e490 could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:41:30.555201 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-cc4afac3-5172-4e31-a97b-5c09e2fd28ba tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] 10.222.0.26 "DELETE /compute/v2.1/servers/aee8a6a8-6de5-42bd-a185-4bacc2b1e490" status: 404 len: 111 microversion: 2.1 time: 0.031374 Oct 08 21:41:30.555201 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3091/6254] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:41:30 2022] DELETE /compute/v2.1/servers/aee8a6a8-6de5-42bd-a185-4bacc2b1e490 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:41:30.561880 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-d8d5aece-bbbc-4efe-a999-5d28f7d1be2c tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:41:30.562520 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-d8d5aece-bbbc-4efe-a999-5d28f7d1be2c tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] [instance: aee8a6a8-6de5-42bd-a185-4bacc2b1e490] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:41:30.568518 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d8d5aece-bbbc-4efe-a999-5d28f7d1be2c tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:41:30.569031 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d8d5aece-bbbc-4efe-a999-5d28f7d1be2c tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:41:30.569532 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d8d5aece-bbbc-4efe-a999-5d28f7d1be2c tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:41:30.570259 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d8d5aece-bbbc-4efe-a999-5d28f7d1be2c tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:41:30.570742 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d8d5aece-bbbc-4efe-a999-5d28f7d1be2c tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:41:30.571199 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d8d5aece-bbbc-4efe-a999-5d28f7d1be2c tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:41:30.585516 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-d8d5aece-bbbc-4efe-a999-5d28f7d1be2c tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] HTTP exception thrown: Instance aee8a6a8-6de5-42bd-a185-4bacc2b1e490 could not be found. Oct 08 21:41:30.587038 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-d8d5aece-bbbc-4efe-a999-5d28f7d1be2c tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Request method failure captured: Oct 08 21:41:30.587038 ncdv-master-1 devstack@n-api.service[140492]: request: GET /compute/v2.1/servers/aee8a6a8-6de5-42bd-a185-4bacc2b1e490 HTTP/1.1 Oct 08 21:41:30.587038 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:41:30.587038 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:41:30.587038 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:41:30.587038 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 21:41:30.587038 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:41:30.587038 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:41:30.587038 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:41:30.587038 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:41:30.587038 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQeyESueD2G2p08fpZng5dUIvJRbscky3tGNIT1dlSRltWQwygOyYfQAwVe7KLvB4NB9Rvs7JJ6Z3bstxj1FPhWmo56k4nFHZVnko_1G4tfE_I1T9paCtzZG8sfJM33h9PLTo7_TpIQ4aSXx-QLhm7_UAuDXZaIvpFH6pLdWcKYlBxWo Oct 08 21:41:30.587038 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:41:30.587038 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:41:30.587038 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:41:30.587038 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:41:30.587038 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:41:30.587038 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:41:30.587038 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 8d9857e88402494e964f2099de5bb60c Oct 08 21:41:30.587038 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-TestVolumeBootPattern-1770467933 Oct 08 21:41:30.587038 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:41:30.587038 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:41:30.587038 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8d9857e88402494e964f2099de5bb60c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8d9857e88402494e964f2099de5bb60c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8d9857e88402494e964f2099de5bb60c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8d9857e88402494e964f2099de5bb60c"}]}] Oct 08 21:41:30.587038 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-TestVolumeBootPattern-1770467933 Oct 08 21:41:30.587038 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 8d9857e88402494e964f2099de5bb60c Oct 08 21:41:30.587038 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-TestVolumeBootPattern-1770467933 Oct 08 21:41:30.587038 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-TestVolumeBootPattern-1770467933-project Oct 08 21:41:30.587038 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:41:30.587038 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:41:30.587038 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 7ac4eff18a664804af16cf21321f9290 Oct 08 21:41:30.587038 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-TestVolumeBootPattern-1770467933-project Oct 08 21:41:30.587038 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 21:41:30.587038 ncdv-master-1 devstack@n-api.service[140492]: exception: Instance aee8a6a8-6de5-42bd-a185-4bacc2b1e490 could not be found. Oct 08 21:41:30.587038 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': 'aee8a6a8-6de5-42bd-a185-4bacc2b1e490'} Oct 08 21:41:30.587038 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:41:30.587038 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:41:30.587038 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:41:30.587038 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:41:30.587038 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:41:30.587038 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:41:30.587038 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:41:30.587038 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:41:30.587038 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:41:30.587038 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:41:30.587038 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aee8a6a8-6de5-42bd-a185-4bacc2b1e490 could not be found. Oct 08 21:41:30.587038 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:41:30.587038 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:41:30.587038 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:41:30.587038 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:41:30.587038 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:41:30.587038 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:41:30.587038 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:41:30.587038 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:41:30.587038 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:41:30.587038 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:41:30.587038 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:41:30.587038 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:41:30.587038 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:41:30.587038 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:41:30.587038 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:41:30.587038 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:41:30.587038 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aee8a6a8-6de5-42bd-a185-4bacc2b1e490 could not be found. Oct 08 21:41:30.587038 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:41:30.587038 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:41:30.587038 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:41:30.592228 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:41:30.592228 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:41:30.592228 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:41:30.592228 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:41:30.592228 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:41:30.592228 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aee8a6a8-6de5-42bd-a185-4bacc2b1e490 could not be found. Oct 08 21:41:30.592228 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:41:30.592228 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-d8d5aece-bbbc-4efe-a999-5d28f7d1be2c tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Returning 404 to user: Instance aee8a6a8-6de5-42bd-a185-4bacc2b1e490 could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:41:30.592228 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-d8d5aece-bbbc-4efe-a999-5d28f7d1be2c tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] 10.222.0.26 "GET /compute/v2.1/servers/aee8a6a8-6de5-42bd-a185-4bacc2b1e490" status: 404 len: 111 microversion: 2.1 time: 0.030469 Oct 08 21:41:30.592228 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3164/6255] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:41:30 2022] GET /compute/v2.1/servers/aee8a6a8-6de5-42bd-a185-4bacc2b1e490 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:41:31.883280 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-d291eb54-8f60-41a5-b03f-a9ac842267ad tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] Calling method '.version_select at 0x7f1a8cc82940>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:41:31.912727 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-d291eb54-8f60-41a5-b03f-a9ac842267ad tempest-TestVolumeBootPattern-1770467933 tempest-TestVolumeBootPattern-1770467933-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-281319770" status: 202 len: 0 microversion: 2.1 time: 0.033256 Oct 08 21:41:31.913219 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3092/6256] 10.222.0.26 () {58 vars in 1260 bytes} [Sat Oct 8 21:41:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-281319770 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 21:41:50.494329 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=10 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:41:50.495336 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=14 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:41:50.605415 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-17562514-a173-44a1-9bc3-4c4fb9e2faa7 tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-213332792", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:41:50.658468 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.network.neutron [None req-17562514-a173-44a1-9bc3-4c4fb9e2faa7 tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] validate_networks() for None {{(pid=140492) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 21:41:50.935580 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-17562514-a173-44a1-9bc3-4c4fb9e2faa7 tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] Flavor limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 21:41:50.936029 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-17562514-a173-44a1-9bc3-4c4fb9e2faa7 tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] Image limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 21:41:50.936532 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-17562514-a173-44a1-9bc3-4c4fb9e2faa7 tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] Flavor pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 21:41:50.936963 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-17562514-a173-44a1-9bc3-4c4fb9e2faa7 tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] Image pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 21:41:50.937470 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-17562514-a173-44a1-9bc3-4c4fb9e2faa7 tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 21:41:50.946477 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-17562514-a173-44a1-9bc3-4c4fb9e2faa7 tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:41:50.946982 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-17562514-a173-44a1-9bc3-4c4fb9e2faa7 tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:41:50.947706 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-17562514-a173-44a1-9bc3-4c4fb9e2faa7 tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:41:50.948466 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-17562514-a173-44a1-9bc3-4c4fb9e2faa7 tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:41:50.948945 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-17562514-a173-44a1-9bc3-4c4fb9e2faa7 tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:41:50.949428 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-17562514-a173-44a1-9bc3-4c4fb9e2faa7 tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:41:50.966266 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-17562514-a173-44a1-9bc3-4c4fb9e2faa7 tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] Getting quotas for project 5a63a83e582d420994af2f99ff94a18d. Resources: {'cores', 'instances', 'ram'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:41:50.971590 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-17562514-a173-44a1-9bc3-4c4fb9e2faa7 tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] Getting quotas for user 6cffbc45fdf3426684cf1478cac3f6b5 and project 5a63a83e582d420994af2f99ff94a18d. Resources: {'cores', 'instances', 'ram'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:41:50.984503 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-17562514-a173-44a1-9bc3-4c4fb9e2faa7 tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] Going to run 1 instances... {{(pid=140492) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 21:41:50.986838 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-17562514-a173-44a1-9bc3-4c4fb9e2faa7 tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] [instance: b07ff176-fb3f-4f10-8a5e-ea4953909503] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c508bd7f-7db9-4b2c-af7c-be54a855c355',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140492) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 21:41:51.028400 ncdv-master-1 devstack@n-api.service[140492]: ERROR oslo.messaging._drivers.impl_rabbit [None req-17562514-a173-44a1-9bc3-4c4fb9e2faa7 tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] [b5026c4e-e11f-4e59-b944-81868efe4103] AMQP server on 10.222.0.26:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 08 21:41:52.035624 ncdv-master-1 devstack@n-api.service[140492]: INFO oslo.messaging._drivers.impl_rabbit [None req-17562514-a173-44a1-9bc3-4c4fb9e2faa7 tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] [b5026c4e-e11f-4e59-b944-81868efe4103] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 34758. Oct 08 21:41:52.039502 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-17562514-a173-44a1-9bc3-4c4fb9e2faa7 tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.551172 Oct 08 21:41:52.040160 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3165/6257] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 21:41:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 1552 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 08 21:41:52.051359 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=30,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:41:52.052128 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:41:52.056794 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-4d6aa326-896f-476f-b8bf-0013892a793b tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:41:52.057463 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-4d6aa326-896f-476f-b8bf-0013892a793b tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] [instance: b07ff176-fb3f-4f10-8a5e-ea4953909503] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:41:52.118810 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-4d6aa326-896f-476f-b8bf-0013892a793b tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cffbc45fdf3426684cf1478cac3f6b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a63a83e582d420994af2f99ff94a18d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:41:52.126048 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-4d6aa326-896f-476f-b8bf-0013892a793b tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] 10.222.0.26 "GET /compute/v2.1/servers/b07ff176-fb3f-4f10-8a5e-ea4953909503" status: 200 len: 1221 microversion: 2.1 time: 0.076575 Oct 08 21:41:52.126630 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3093/6258] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:41:52 2022] GET /compute/v2.1/servers/b07ff176-fb3f-4f10-8a5e-ea4953909503 => generated 1221 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:41:53.150126 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-61f21a12-89dd-4c65-bd48-8427bd8c063a tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:41:53.150757 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-61f21a12-89dd-4c65-bd48-8427bd8c063a tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] [instance: b07ff176-fb3f-4f10-8a5e-ea4953909503] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:41:53.156964 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-61f21a12-89dd-4c65-bd48-8427bd8c063a tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:41:53.157501 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-61f21a12-89dd-4c65-bd48-8427bd8c063a tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:41:53.157960 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-61f21a12-89dd-4c65-bd48-8427bd8c063a tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:41:53.158666 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-61f21a12-89dd-4c65-bd48-8427bd8c063a tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:41:53.159140 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-61f21a12-89dd-4c65-bd48-8427bd8c063a tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:41:53.159624 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-61f21a12-89dd-4c65-bd48-8427bd8c063a tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:41:53.221825 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-61f21a12-89dd-4c65-bd48-8427bd8c063a tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cffbc45fdf3426684cf1478cac3f6b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a63a83e582d420994af2f99ff94a18d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:41:53.230442 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-61f21a12-89dd-4c65-bd48-8427bd8c063a tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] 10.222.0.26 "GET /compute/v2.1/servers/b07ff176-fb3f-4f10-8a5e-ea4953909503" status: 200 len: 1273 microversion: 2.1 time: 0.085120 Oct 08 21:41:53.231578 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3166/6259] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:41:53 2022] GET /compute/v2.1/servers/b07ff176-fb3f-4f10-8a5e-ea4953909503 => generated 1273 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:41:54.254295 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-2b0ce3fd-72c4-45b1-9a63-1f9a500f4158 tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:41:54.255229 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-2b0ce3fd-72c4-45b1-9a63-1f9a500f4158 tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] [instance: b07ff176-fb3f-4f10-8a5e-ea4953909503] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:41:54.263546 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2b0ce3fd-72c4-45b1-9a63-1f9a500f4158 tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:41:54.264352 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2b0ce3fd-72c4-45b1-9a63-1f9a500f4158 tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:41:54.266169 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2b0ce3fd-72c4-45b1-9a63-1f9a500f4158 tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:41:54.266969 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2b0ce3fd-72c4-45b1-9a63-1f9a500f4158 tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:41:54.267505 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2b0ce3fd-72c4-45b1-9a63-1f9a500f4158 tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:41:54.268103 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2b0ce3fd-72c4-45b1-9a63-1f9a500f4158 tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:41:54.744578 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-2b0ce3fd-72c4-45b1-9a63-1f9a500f4158 tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cffbc45fdf3426684cf1478cac3f6b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a63a83e582d420994af2f99ff94a18d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:41:54.752542 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-2b0ce3fd-72c4-45b1-9a63-1f9a500f4158 tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] 10.222.0.26 "GET /compute/v2.1/servers/b07ff176-fb3f-4f10-8a5e-ea4953909503" status: 200 len: 1321 microversion: 2.1 time: 0.502250 Oct 08 21:41:54.753113 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3094/6260] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:41:54 2022] GET /compute/v2.1/servers/b07ff176-fb3f-4f10-8a5e-ea4953909503 => generated 1321 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:41:55.133516 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-b8653cd3-09dd-4c5d-94b0-caf1b457fe6f req-2844621d-e308-4210-8165-6cf094a31372 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b07ff176-fb3f-4f10-8a5e-ea4953909503", "tag": "251e1ba0-4bd3-4155-89e2-a75beb85bd9e"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:41:55.145973 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-b8653cd3-09dd-4c5d-94b0-caf1b457fe6f req-2844621d-e308-4210-8165-6cf094a31372 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:41:55.146578 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-b8653cd3-09dd-4c5d-94b0-caf1b457fe6f req-2844621d-e308-4210-8165-6cf094a31372 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:41:55.147106 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-b8653cd3-09dd-4c5d-94b0-caf1b457fe6f req-2844621d-e308-4210-8165-6cf094a31372 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:41:55.158757 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-b8653cd3-09dd-4c5d-94b0-caf1b457fe6f req-2844621d-e308-4210-8165-6cf094a31372 service nova] Creating event network-changed:251e1ba0-4bd3-4155-89e2-a75beb85bd9e for instance b07ff176-fb3f-4f10-8a5e-ea4953909503 on nch1-master-1 Oct 08 21:41:55.163920 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-b8653cd3-09dd-4c5d-94b0-caf1b457fe6f req-2844621d-e308-4210-8165-6cf094a31372 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034219 Oct 08 21:41:55.164693 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3167/6261] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:41:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:41:55.775769 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-f15dea8f-9024-4b93-81ce-3b3a352fcbec tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:41:55.776387 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-f15dea8f-9024-4b93-81ce-3b3a352fcbec tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] [instance: b07ff176-fb3f-4f10-8a5e-ea4953909503] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:41:55.783981 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f15dea8f-9024-4b93-81ce-3b3a352fcbec tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:41:55.784469 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f15dea8f-9024-4b93-81ce-3b3a352fcbec tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:41:55.784913 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f15dea8f-9024-4b93-81ce-3b3a352fcbec tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:41:55.785640 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f15dea8f-9024-4b93-81ce-3b3a352fcbec tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:41:55.786103 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f15dea8f-9024-4b93-81ce-3b3a352fcbec tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:41:55.786535 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f15dea8f-9024-4b93-81ce-3b3a352fcbec tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:41:55.913825 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-f15dea8f-9024-4b93-81ce-3b3a352fcbec tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cffbc45fdf3426684cf1478cac3f6b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a63a83e582d420994af2f99ff94a18d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:41:55.921522 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-f15dea8f-9024-4b93-81ce-3b3a352fcbec tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] 10.222.0.26 "GET /compute/v2.1/servers/b07ff176-fb3f-4f10-8a5e-ea4953909503" status: 200 len: 1321 microversion: 2.1 time: 0.149693 Oct 08 21:41:55.922096 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3095/6262] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:41:55 2022] GET /compute/v2.1/servers/b07ff176-fb3f-4f10-8a5e-ea4953909503 => generated 1321 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:41:56.945699 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-f55b08cf-d721-4761-a977-a64877a4d07a tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:41:56.946455 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-f55b08cf-d721-4761-a977-a64877a4d07a tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] [instance: b07ff176-fb3f-4f10-8a5e-ea4953909503] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:41:56.953453 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f55b08cf-d721-4761-a977-a64877a4d07a tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:41:56.953965 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f55b08cf-d721-4761-a977-a64877a4d07a tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:41:56.954416 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f55b08cf-d721-4761-a977-a64877a4d07a tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:41:56.955137 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f55b08cf-d721-4761-a977-a64877a4d07a tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:41:56.955641 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f55b08cf-d721-4761-a977-a64877a4d07a tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:41:56.956085 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f55b08cf-d721-4761-a977-a64877a4d07a tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:41:57.088327 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-f55b08cf-d721-4761-a977-a64877a4d07a tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cffbc45fdf3426684cf1478cac3f6b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a63a83e582d420994af2f99ff94a18d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:41:57.096687 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-f55b08cf-d721-4761-a977-a64877a4d07a tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] 10.222.0.26 "GET /compute/v2.1/servers/b07ff176-fb3f-4f10-8a5e-ea4953909503" status: 200 len: 1321 microversion: 2.1 time: 0.156198 Oct 08 21:41:57.097277 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3168/6263] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:41:56 2022] GET /compute/v2.1/servers/b07ff176-fb3f-4f10-8a5e-ea4953909503 => generated 1321 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:41:58.119132 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-1c36a52a-160a-4b13-9f5b-6ea5254f5a79 tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:41:58.119757 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-1c36a52a-160a-4b13-9f5b-6ea5254f5a79 tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] [instance: b07ff176-fb3f-4f10-8a5e-ea4953909503] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:41:58.126160 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1c36a52a-160a-4b13-9f5b-6ea5254f5a79 tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:41:58.126666 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1c36a52a-160a-4b13-9f5b-6ea5254f5a79 tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:41:58.127121 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1c36a52a-160a-4b13-9f5b-6ea5254f5a79 tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:41:58.127834 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1c36a52a-160a-4b13-9f5b-6ea5254f5a79 tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:41:58.128306 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1c36a52a-160a-4b13-9f5b-6ea5254f5a79 tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:41:58.128742 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1c36a52a-160a-4b13-9f5b-6ea5254f5a79 tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:41:58.257554 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-1c36a52a-160a-4b13-9f5b-6ea5254f5a79 tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cffbc45fdf3426684cf1478cac3f6b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a63a83e582d420994af2f99ff94a18d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:41:58.265450 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-1c36a52a-160a-4b13-9f5b-6ea5254f5a79 tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] 10.222.0.26 "GET /compute/v2.1/servers/b07ff176-fb3f-4f10-8a5e-ea4953909503" status: 200 len: 1321 microversion: 2.1 time: 0.150268 Oct 08 21:41:58.266030 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3096/6264] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:41:58 2022] GET /compute/v2.1/servers/b07ff176-fb3f-4f10-8a5e-ea4953909503 => generated 1321 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:41:59.288266 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-a8da676f-6530-4b2d-8241-8077b78e9ed0 tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:41:59.288900 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-a8da676f-6530-4b2d-8241-8077b78e9ed0 tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] [instance: b07ff176-fb3f-4f10-8a5e-ea4953909503] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:41:59.295726 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a8da676f-6530-4b2d-8241-8077b78e9ed0 tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:41:59.296232 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a8da676f-6530-4b2d-8241-8077b78e9ed0 tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:41:59.296686 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a8da676f-6530-4b2d-8241-8077b78e9ed0 tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:41:59.297419 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a8da676f-6530-4b2d-8241-8077b78e9ed0 tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:41:59.297900 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a8da676f-6530-4b2d-8241-8077b78e9ed0 tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:41:59.298343 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a8da676f-6530-4b2d-8241-8077b78e9ed0 tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:41:59.429357 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-a8da676f-6530-4b2d-8241-8077b78e9ed0 tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cffbc45fdf3426684cf1478cac3f6b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a63a83e582d420994af2f99ff94a18d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:41:59.437718 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-a8da676f-6530-4b2d-8241-8077b78e9ed0 tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] 10.222.0.26 "GET /compute/v2.1/servers/b07ff176-fb3f-4f10-8a5e-ea4953909503" status: 200 len: 1321 microversion: 2.1 time: 0.153507 Oct 08 21:41:59.438289 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3169/6265] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:41:59 2022] GET /compute/v2.1/servers/b07ff176-fb3f-4f10-8a5e-ea4953909503 => generated 1321 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:42:00.460399 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-1097753e-f699-4633-810f-ffb769f8d362 tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:42:00.461008 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-1097753e-f699-4633-810f-ffb769f8d362 tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] [instance: b07ff176-fb3f-4f10-8a5e-ea4953909503] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:42:00.467964 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1097753e-f699-4633-810f-ffb769f8d362 tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:42:00.468453 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1097753e-f699-4633-810f-ffb769f8d362 tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:42:00.468896 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1097753e-f699-4633-810f-ffb769f8d362 tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:42:00.469624 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1097753e-f699-4633-810f-ffb769f8d362 tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:42:00.470084 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1097753e-f699-4633-810f-ffb769f8d362 tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:42:00.470517 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1097753e-f699-4633-810f-ffb769f8d362 tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:42:00.608459 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-1097753e-f699-4633-810f-ffb769f8d362 tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cffbc45fdf3426684cf1478cac3f6b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a63a83e582d420994af2f99ff94a18d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:42:00.616294 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-1097753e-f699-4633-810f-ffb769f8d362 tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] 10.222.0.26 "GET /compute/v2.1/servers/b07ff176-fb3f-4f10-8a5e-ea4953909503" status: 200 len: 1321 microversion: 2.1 time: 0.159824 Oct 08 21:42:00.616902 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3097/6266] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:42:00 2022] GET /compute/v2.1/servers/b07ff176-fb3f-4f10-8a5e-ea4953909503 => generated 1321 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:42:00.763714 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-25cb4a45-c61e-4c67-93d4-c3a7296a476d req-c2178e2b-dc6b-4cf7-b97e-e96e67b309dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b07ff176-fb3f-4f10-8a5e-ea4953909503", "name": "network-vif-plugged", "status": "completed", "tag": "251e1ba0-4bd3-4155-89e2-a75beb85bd9e"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:42:00.773131 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-25cb4a45-c61e-4c67-93d4-c3a7296a476d req-c2178e2b-dc6b-4cf7-b97e-e96e67b309dc service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:42:00.773667 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-25cb4a45-c61e-4c67-93d4-c3a7296a476d req-c2178e2b-dc6b-4cf7-b97e-e96e67b309dc service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:42:00.774127 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-25cb4a45-c61e-4c67-93d4-c3a7296a476d req-c2178e2b-dc6b-4cf7-b97e-e96e67b309dc service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:42:00.785216 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-25cb4a45-c61e-4c67-93d4-c3a7296a476d req-c2178e2b-dc6b-4cf7-b97e-e96e67b309dc service nova] Creating event network-vif-plugged:251e1ba0-4bd3-4155-89e2-a75beb85bd9e for instance b07ff176-fb3f-4f10-8a5e-ea4953909503 on nch1-master-1 Oct 08 21:42:00.790189 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-25cb4a45-c61e-4c67-93d4-c3a7296a476d req-c2178e2b-dc6b-4cf7-b97e-e96e67b309dc service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125345 Oct 08 21:42:00.790778 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3170/6267] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:42:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:42:01.639769 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-36d7e16d-8ae9-47dd-b3f8-7a250642ca62 tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:42:01.640382 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-36d7e16d-8ae9-47dd-b3f8-7a250642ca62 tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] [instance: b07ff176-fb3f-4f10-8a5e-ea4953909503] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:42:01.647322 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-36d7e16d-8ae9-47dd-b3f8-7a250642ca62 tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:42:01.647814 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-36d7e16d-8ae9-47dd-b3f8-7a250642ca62 tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:42:01.648257 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-36d7e16d-8ae9-47dd-b3f8-7a250642ca62 tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:42:01.648956 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-36d7e16d-8ae9-47dd-b3f8-7a250642ca62 tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:42:01.649440 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-36d7e16d-8ae9-47dd-b3f8-7a250642ca62 tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:42:01.649874 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-36d7e16d-8ae9-47dd-b3f8-7a250642ca62 tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:42:01.782315 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-36d7e16d-8ae9-47dd-b3f8-7a250642ca62 tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cffbc45fdf3426684cf1478cac3f6b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a63a83e582d420994af2f99ff94a18d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:42:01.790113 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-36d7e16d-8ae9-47dd-b3f8-7a250642ca62 tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] 10.222.0.26 "GET /compute/v2.1/servers/b07ff176-fb3f-4f10-8a5e-ea4953909503" status: 200 len: 1321 microversion: 2.1 time: 0.154907 Oct 08 21:42:01.790682 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3098/6268] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:42:01 2022] GET /compute/v2.1/servers/b07ff176-fb3f-4f10-8a5e-ea4953909503 => generated 1321 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:42:02.808896 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=2 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:42:02.809649 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=6 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:42:02.815181 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-6057339c-66b8-4f40-8624-78c4286502fb tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:42:02.816164 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-6057339c-66b8-4f40-8624-78c4286502fb tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] [instance: b07ff176-fb3f-4f10-8a5e-ea4953909503] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:42:02.823225 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6057339c-66b8-4f40-8624-78c4286502fb tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:42:02.823727 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6057339c-66b8-4f40-8624-78c4286502fb tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:42:02.824286 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6057339c-66b8-4f40-8624-78c4286502fb tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:42:02.825000 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6057339c-66b8-4f40-8624-78c4286502fb tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:42:02.825503 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6057339c-66b8-4f40-8624-78c4286502fb tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:42:02.825948 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6057339c-66b8-4f40-8624-78c4286502fb tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:42:02.957613 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-6057339c-66b8-4f40-8624-78c4286502fb tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cffbc45fdf3426684cf1478cac3f6b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a63a83e582d420994af2f99ff94a18d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:42:02.966012 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-6057339c-66b8-4f40-8624-78c4286502fb tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] 10.222.0.26 "GET /compute/v2.1/servers/b07ff176-fb3f-4f10-8a5e-ea4953909503" status: 200 len: 1470 microversion: 2.1 time: 0.158084 Oct 08 21:42:02.966503 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3171/6269] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:42:02 2022] GET /compute/v2.1/servers/b07ff176-fb3f-4f10-8a5e-ea4953909503 => generated 1470 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:42:02.991066 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=2 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:42:03.045362 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-a8a158ab-752c-4990-9e7e-60d548a9d37a tempest-ServersAdminNegativeTestJSON-1451073167 tempest-ServersAdminNegativeTestJSON-1451073167-project-admin] Calling method '.version_select at 0x7f1a8c8ca940>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:42:03.111547 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-a8a158ab-752c-4990-9e7e-60d548a9d37a tempest-ServersAdminNegativeTestJSON-1451073167 tempest-ServersAdminNegativeTestJSON-1451073167-project-admin] 10.222.0.26 "GET /compute/v2.1/os-quota-sets/e0db56a031a4484489dac0b36fe1e336" status: 200 len: 371 microversion: 2.1 time: 0.124976 Oct 08 21:42:03.112122 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3099/6270] 10.222.0.26 () {58 vars in 1242 bytes} [Sat Oct 8 21:42:02 2022] GET /compute/v2.1/os-quota-sets/e0db56a031a4484489dac0b36fe1e336 => generated 371 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:42:03.124035 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-40485626-9a46-4fc4-8c7b-cf68fcc13a3f tempest-ServersAdminNegativeTestJSON-1451073167 tempest-ServersAdminNegativeTestJSON-1451073167-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-301463264", "id": 31405703, "os-flavor-access:is_public": "True"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:42:03.141974 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-40485626-9a46-4fc4-8c7b-cf68fcc13a3f tempest-ServersAdminNegativeTestJSON-1451073167 tempest-ServersAdminNegativeTestJSON-1451073167-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 431 microversion: 2.1 time: 0.021726 Oct 08 21:42:03.142535 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3172/6271] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 21:42:03 2022] POST /compute/v2.1/flavors => generated 431 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 08 21:42:03.154950 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-66db14f3-11b8-4bc5-a442-9ada16a916b5 tempest-ServersAdminNegativeTestJSON-1451073167 tempest-ServersAdminNegativeTestJSON-1451073167-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "31405703"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:42:03.157288 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-66db14f3-11b8-4bc5-a442-9ada16a916b5 tempest-ServersAdminNegativeTestJSON-1451073167 tempest-ServersAdminNegativeTestJSON-1451073167-project-admin] [instance: b07ff176-fb3f-4f10-8a5e-ea4953909503] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:42:03.164695 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-66db14f3-11b8-4bc5-a442-9ada16a916b5 tempest-ServersAdminNegativeTestJSON-1451073167 tempest-ServersAdminNegativeTestJSON-1451073167-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:42:03.165208 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-66db14f3-11b8-4bc5-a442-9ada16a916b5 tempest-ServersAdminNegativeTestJSON-1451073167 tempest-ServersAdminNegativeTestJSON-1451073167-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:42:03.165671 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-66db14f3-11b8-4bc5-a442-9ada16a916b5 tempest-ServersAdminNegativeTestJSON-1451073167 tempest-ServersAdminNegativeTestJSON-1451073167-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:42:03.166384 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-66db14f3-11b8-4bc5-a442-9ada16a916b5 tempest-ServersAdminNegativeTestJSON-1451073167 tempest-ServersAdminNegativeTestJSON-1451073167-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:42:03.166853 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-66db14f3-11b8-4bc5-a442-9ada16a916b5 tempest-ServersAdminNegativeTestJSON-1451073167 tempest-ServersAdminNegativeTestJSON-1451073167-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:42:03.167300 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-66db14f3-11b8-4bc5-a442-9ada16a916b5 tempest-ServersAdminNegativeTestJSON-1451073167 tempest-ServersAdminNegativeTestJSON-1451073167-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:42:03.363205 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-66db14f3-11b8-4bc5-a442-9ada16a916b5 tempest-ServersAdminNegativeTestJSON-1451073167 tempest-ServersAdminNegativeTestJSON-1451073167-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '033f6de070454d3d86de05d560a8fe93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0db56a031a4484489dac0b36fe1e336', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:42:03.369533 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-66db14f3-11b8-4bc5-a442-9ada16a916b5 tempest-ServersAdminNegativeTestJSON-1451073167 tempest-ServersAdminNegativeTestJSON-1451073167-project-admin] [instance: b07ff176-fb3f-4f10-8a5e-ea4953909503] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-301463264 {{(pid=140491) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 08 21:42:03.376756 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-66db14f3-11b8-4bc5-a442-9ada16a916b5 tempest-ServersAdminNegativeTestJSON-1451073167 tempest-ServersAdminNegativeTestJSON-1451073167-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:42:03.377297 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-66db14f3-11b8-4bc5-a442-9ada16a916b5 tempest-ServersAdminNegativeTestJSON-1451073167 tempest-ServersAdminNegativeTestJSON-1451073167-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:42:03.377741 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-66db14f3-11b8-4bc5-a442-9ada16a916b5 tempest-ServersAdminNegativeTestJSON-1451073167 tempest-ServersAdminNegativeTestJSON-1451073167-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:42:03.378477 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-66db14f3-11b8-4bc5-a442-9ada16a916b5 tempest-ServersAdminNegativeTestJSON-1451073167 tempest-ServersAdminNegativeTestJSON-1451073167-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:42:03.378943 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-66db14f3-11b8-4bc5-a442-9ada16a916b5 tempest-ServersAdminNegativeTestJSON-1451073167 tempest-ServersAdminNegativeTestJSON-1451073167-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:42:03.379376 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-66db14f3-11b8-4bc5-a442-9ada16a916b5 tempest-ServersAdminNegativeTestJSON-1451073167 tempest-ServersAdminNegativeTestJSON-1451073167-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:42:03.400573 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-66db14f3-11b8-4bc5-a442-9ada16a916b5 tempest-ServersAdminNegativeTestJSON-1451073167 tempest-ServersAdminNegativeTestJSON-1451073167-project-admin] Getting quotas for project 5a63a83e582d420994af2f99ff94a18d. Resources: {'cores', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:42:03.405811 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-66db14f3-11b8-4bc5-a442-9ada16a916b5 tempest-ServersAdminNegativeTestJSON-1451073167 tempest-ServersAdminNegativeTestJSON-1451073167-project-admin] Getting quotas for user 6cffbc45fdf3426684cf1478cac3f6b5 and project 5a63a83e582d420994af2f99ff94a18d. Resources: {'cores', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:42:03.417872 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.compute.api [None req-66db14f3-11b8-4bc5-a442-9ada16a916b5 tempest-ServersAdminNegativeTestJSON-1451073167 tempest-ServersAdminNegativeTestJSON-1451073167-project-admin] ram quota exceeded for e0db56a031a4484489dac0b36fe1e336, tried to resize instance. Oct 08 21:42:03.418409 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-66db14f3-11b8-4bc5-a442-9ada16a916b5 tempest-ServersAdminNegativeTestJSON-1451073167 tempest-ServersAdminNegativeTestJSON-1451073167-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 08 21:42:03.420386 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-66db14f3-11b8-4bc5-a442-9ada16a916b5 tempest-ServersAdminNegativeTestJSON-1451073167 tempest-ServersAdminNegativeTestJSON-1451073167-project-admin] Request method failure captured: Oct 08 21:42:03.420386 ncdv-master-1 devstack@n-api.service[140491]: request: POST /compute/v2.1/servers/b07ff176-fb3f-4f10-8a5e-ea4953909503/action HTTP/1.1 Oct 08 21:42:03.420386 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:42:03.420386 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:42:03.420386 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:42:03.420386 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 37 Oct 08 21:42:03.420386 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:42:03.420386 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:42:03.420386 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:42:03.420386 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:42:03.420386 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQe6e1cW3UJx5scfRShAmWBjtMh6zxXpf4cFnQ6BStHzTPuxhM0zkF0HOhyzFU2_hrJVUKeQeY5QKynrqy7Z5pq8Rh4vNz7XAXBc94DdkXMQFXF3alkrxDVQRajSGpfH4ei6TF7_rsCGQmJY8VR3y7J-RN3xUHLo2E4qvCBE-vN2cXGY Oct 08 21:42:03.420386 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:42:03.420386 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:42:03.420386 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:42:03.420386 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:42:03.420386 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:42:03.420386 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:42:03.420386 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: e0db56a031a4484489dac0b36fe1e336 Oct 08 21:42:03.420386 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1451073167 Oct 08 21:42:03.420386 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,admin,member Oct 08 21:42:03.420386 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,admin,member Oct 08 21:42:03.420386 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/e0db56a031a4484489dac0b36fe1e336"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e0db56a031a4484489dac0b36fe1e336"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_e0db56a031a4484489dac0b36fe1e336"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e0db56a031a4484489dac0b36fe1e336"}]}] Oct 08 21:42:03.420386 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1451073167 Oct 08 21:42:03.420386 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: e0db56a031a4484489dac0b36fe1e336 Oct 08 21:42:03.420386 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1451073167 Oct 08 21:42:03.420386 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-ServersAdminNegativeTestJSON-1451073167-project-admin Oct 08 21:42:03.420386 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:42:03.420386 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:42:03.420386 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 033f6de070454d3d86de05d560a8fe93 Oct 08 21:42:03.420386 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1451073167-project-admin Oct 08 21:42:03.420386 ncdv-master-1 devstack@n-api.service[140491]: Oct 08 21:42:03.420386 ncdv-master-1 devstack@n-api.service[140491]: {"resize": {"flavorRef": "31405703"}} Oct 08 21:42:03.420386 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:42:03.420386 ncdv-master-1 devstack@n-api.service[140491]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 08 21:42:03.420386 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': 'b07ff176-fb3f-4f10-8a5e-ea4953909503', 'body': {'resize': {'flavorRef': '31405703'}}} Oct 08 21:42:03.420386 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:42:03.420386 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:42:03.420386 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Oct 08 21:42:03.420386 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Oct 08 21:42:03.420386 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 08 21:42:03.420386 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 08 21:42:03.420386 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 08 21:42:03.420386 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc Oct 08 21:42:03.420386 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 08 21:42:03.420386 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 08 21:42:03.420386 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 08 21:42:03.420386 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 08 21:42:03.420386 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 08 21:42:03.420386 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 08 21:42:03.420386 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 08 21:42:03.420386 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 08 21:42:03.420386 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Oct 08 21:42:03.420386 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 08 21:42:03.420386 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Oct 08 21:42:03.420386 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:42:03.420386 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:42:03.420386 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:42:03.420386 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:42:03.420386 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 08 21:42:03.420386 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 08 21:42:03.420386 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 08 21:42:03.420386 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 08 21:42:03.420386 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 08 21:42:03.424479 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 08 21:42:03.424479 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 08 21:42:03.424479 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 08 21:42:03.424479 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 08 21:42:03.424479 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 08 21:42:03.424479 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 08 21:42:03.424479 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 08 21:42:03.424479 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 08 21:42:03.424479 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 08 21:42:03.424479 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Oct 08 21:42:03.424479 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Oct 08 21:42:03.424479 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Oct 08 21:42:03.424479 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 08 21:42:03.424479 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 08 21:42:03.424479 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:42:03.424479 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:42:03.424479 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:42:03.424479 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:42:03.424479 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:42:03.424479 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:42:03.424479 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:42:03.424479 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:42:03.424479 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:42:03.424479 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:42:03.424479 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 21:42:03.424479 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 21:42:03.424479 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 08 21:42:03.424479 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 08 21:42:03.424479 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Oct 08 21:42:03.424479 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 08 21:42:03.424479 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 08 21:42:03.424479 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:42:03.424479 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:42:03.424479 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:42:03.424479 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:42:03.424479 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:42:03.424479 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:42:03.424479 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:42:03.424479 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:42:03.424479 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 08 21:42:03.424479 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:42:03.424479 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-66db14f3-11b8-4bc5-a442-9ada16a916b5 tempest-ServersAdminNegativeTestJSON-1451073167 tempest-ServersAdminNegativeTestJSON-1451073167-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:42:03.424479 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-66db14f3-11b8-4bc5-a442-9ada16a916b5 tempest-ServersAdminNegativeTestJSON-1451073167 tempest-ServersAdminNegativeTestJSON-1451073167-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/b07ff176-fb3f-4f10-8a5e-ea4953909503/action" status: 403 len: 118 microversion: 2.1 time: 0.271403 Oct 08 21:42:03.424479 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3100/6272] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:42:03 2022] POST /compute/v2.1/servers/b07ff176-fb3f-4f10-8a5e-ea4953909503/action => generated 118 bytes in 272 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:42:03.431096 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-42ecfd92-126c-4835-b21d-0a17b34edb32 tempest-ServersAdminNegativeTestJSON-1451073167 tempest-ServersAdminNegativeTestJSON-1451073167-project-admin] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:42:03.448664 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-42ecfd92-126c-4835-b21d-0a17b34edb32 tempest-ServersAdminNegativeTestJSON-1451073167 tempest-ServersAdminNegativeTestJSON-1451073167-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/31405703" status: 202 len: 0 microversion: 2.1 time: 0.021683 Oct 08 21:42:03.450131 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3173/6273] 10.222.0.26 () {58 vars in 1155 bytes} [Sat Oct 8 21:42:03 2022] DELETE /compute/v2.1/flavors/31405703 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 21:42:03.458074 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-ca5ece44-92fa-4326-981b-e0360b6a93a7 tempest-ServersAdminNegativeTestJSON-1451073167 tempest-ServersAdminNegativeTestJSON-1451073167-project-admin] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:42:03.479015 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-ca5ece44-92fa-4326-981b-e0360b6a93a7 tempest-ServersAdminNegativeTestJSON-1451073167 tempest-ServersAdminNegativeTestJSON-1451073167-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024599 Oct 08 21:42:03.479607 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3101/6274] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Oct 8 21:42:03 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:42:03.500192 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-1fbd3a59-60fd-4f36-a413-ee77213fa898 tempest-ServersAdminNegativeTestJSON-1451073167 tempest-ServersAdminNegativeTestJSON-1451073167-project-admin] Calling method '.version_select at 0x7f1a874ea160>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:42:03.569403 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-1fbd3a59-60fd-4f36-a413-ee77213fa898 tempest-ServersAdminNegativeTestJSON-1451073167 tempest-ServersAdminNegativeTestJSON-1451073167-project-admin] 10.222.0.26 "GET /compute/v2.1/os-quota-sets/e0db56a031a4484489dac0b36fe1e336" status: 200 len: 371 microversion: 2.1 time: 0.073661 Oct 08 21:42:03.569965 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3174/6275] 10.222.0.26 () {58 vars in 1242 bytes} [Sat Oct 8 21:42:03 2022] GET /compute/v2.1/os-quota-sets/e0db56a031a4484489dac0b36fe1e336 => generated 371 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:42:03.582577 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-96744d8a-2687-4612-addb-3788afeb30f7 tempest-ServersAdminNegativeTestJSON-1451073167 tempest-ServersAdminNegativeTestJSON-1451073167-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-965146083", "id": 280497602, "os-flavor-access:is_public": "True"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:42:03.600749 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-96744d8a-2687-4612-addb-3788afeb30f7 tempest-ServersAdminNegativeTestJSON-1451073167 tempest-ServersAdminNegativeTestJSON-1451073167-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 433 microversion: 2.1 time: 0.021929 Oct 08 21:42:03.601363 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3102/6276] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 21:42:03 2022] POST /compute/v2.1/flavors => generated 433 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:42:03.613525 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-928ef6e1-ce36-49c5-80b7-bcc3db2d2a09 tempest-ServersAdminNegativeTestJSON-1451073167 tempest-ServersAdminNegativeTestJSON-1451073167-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "280497602"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:42:03.615764 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-928ef6e1-ce36-49c5-80b7-bcc3db2d2a09 tempest-ServersAdminNegativeTestJSON-1451073167 tempest-ServersAdminNegativeTestJSON-1451073167-project-admin] [instance: b07ff176-fb3f-4f10-8a5e-ea4953909503] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:42:03.622467 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-928ef6e1-ce36-49c5-80b7-bcc3db2d2a09 tempest-ServersAdminNegativeTestJSON-1451073167 tempest-ServersAdminNegativeTestJSON-1451073167-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:42:03.622993 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-928ef6e1-ce36-49c5-80b7-bcc3db2d2a09 tempest-ServersAdminNegativeTestJSON-1451073167 tempest-ServersAdminNegativeTestJSON-1451073167-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:42:03.623451 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-928ef6e1-ce36-49c5-80b7-bcc3db2d2a09 tempest-ServersAdminNegativeTestJSON-1451073167 tempest-ServersAdminNegativeTestJSON-1451073167-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:42:03.624161 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-928ef6e1-ce36-49c5-80b7-bcc3db2d2a09 tempest-ServersAdminNegativeTestJSON-1451073167 tempest-ServersAdminNegativeTestJSON-1451073167-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:42:03.624633 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-928ef6e1-ce36-49c5-80b7-bcc3db2d2a09 tempest-ServersAdminNegativeTestJSON-1451073167 tempest-ServersAdminNegativeTestJSON-1451073167-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:42:03.625077 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-928ef6e1-ce36-49c5-80b7-bcc3db2d2a09 tempest-ServersAdminNegativeTestJSON-1451073167 tempest-ServersAdminNegativeTestJSON-1451073167-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:42:03.710284 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-928ef6e1-ce36-49c5-80b7-bcc3db2d2a09 tempest-ServersAdminNegativeTestJSON-1451073167 tempest-ServersAdminNegativeTestJSON-1451073167-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '033f6de070454d3d86de05d560a8fe93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0db56a031a4484489dac0b36fe1e336', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:42:03.716751 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-928ef6e1-ce36-49c5-80b7-bcc3db2d2a09 tempest-ServersAdminNegativeTestJSON-1451073167 tempest-ServersAdminNegativeTestJSON-1451073167-project-admin] [instance: b07ff176-fb3f-4f10-8a5e-ea4953909503] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-965146083 {{(pid=140492) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 08 21:42:03.724090 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-928ef6e1-ce36-49c5-80b7-bcc3db2d2a09 tempest-ServersAdminNegativeTestJSON-1451073167 tempest-ServersAdminNegativeTestJSON-1451073167-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:42:03.724589 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-928ef6e1-ce36-49c5-80b7-bcc3db2d2a09 tempest-ServersAdminNegativeTestJSON-1451073167 tempest-ServersAdminNegativeTestJSON-1451073167-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:42:03.725041 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-928ef6e1-ce36-49c5-80b7-bcc3db2d2a09 tempest-ServersAdminNegativeTestJSON-1451073167 tempest-ServersAdminNegativeTestJSON-1451073167-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:42:03.725827 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-928ef6e1-ce36-49c5-80b7-bcc3db2d2a09 tempest-ServersAdminNegativeTestJSON-1451073167 tempest-ServersAdminNegativeTestJSON-1451073167-project-admin] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:42:03.726284 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-928ef6e1-ce36-49c5-80b7-bcc3db2d2a09 tempest-ServersAdminNegativeTestJSON-1451073167 tempest-ServersAdminNegativeTestJSON-1451073167-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:42:03.726722 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-928ef6e1-ce36-49c5-80b7-bcc3db2d2a09 tempest-ServersAdminNegativeTestJSON-1451073167 tempest-ServersAdminNegativeTestJSON-1451073167-project-admin] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:42:03.748773 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-928ef6e1-ce36-49c5-80b7-bcc3db2d2a09 tempest-ServersAdminNegativeTestJSON-1451073167 tempest-ServersAdminNegativeTestJSON-1451073167-project-admin] Getting quotas for project 5a63a83e582d420994af2f99ff94a18d. Resources: {'cores', 'ram'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:42:03.753894 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-928ef6e1-ce36-49c5-80b7-bcc3db2d2a09 tempest-ServersAdminNegativeTestJSON-1451073167 tempest-ServersAdminNegativeTestJSON-1451073167-project-admin] Getting quotas for user 6cffbc45fdf3426684cf1478cac3f6b5 and project 5a63a83e582d420994af2f99ff94a18d. Resources: {'cores', 'ram'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:42:03.766100 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.compute.api [None req-928ef6e1-ce36-49c5-80b7-bcc3db2d2a09 tempest-ServersAdminNegativeTestJSON-1451073167 tempest-ServersAdminNegativeTestJSON-1451073167-project-admin] cores quota exceeded for e0db56a031a4484489dac0b36fe1e336, tried to resize instance. Oct 08 21:42:03.766651 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-928ef6e1-ce36-49c5-80b7-bcc3db2d2a09 tempest-ServersAdminNegativeTestJSON-1451073167 tempest-ServersAdminNegativeTestJSON-1451073167-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 08 21:42:03.768701 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-928ef6e1-ce36-49c5-80b7-bcc3db2d2a09 tempest-ServersAdminNegativeTestJSON-1451073167 tempest-ServersAdminNegativeTestJSON-1451073167-project-admin] Request method failure captured: Oct 08 21:42:03.768701 ncdv-master-1 devstack@n-api.service[140492]: request: POST /compute/v2.1/servers/b07ff176-fb3f-4f10-8a5e-ea4953909503/action HTTP/1.1 Oct 08 21:42:03.768701 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:42:03.768701 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:42:03.768701 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:42:03.768701 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 38 Oct 08 21:42:03.768701 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:42:03.768701 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:42:03.768701 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:42:03.768701 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:42:03.768701 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQe6e1cW3UJx5scfRShAmWBjtMh6zxXpf4cFnQ6BStHzTPuxhM0zkF0HOhyzFU2_hrJVUKeQeY5QKynrqy7Z5pq8Rh4vNz7XAXBc94DdkXMQFXF3alkrxDVQRajSGpfH4ei6TF7_rsCGQmJY8VR3y7J-RN3xUHLo2E4qvCBE-vN2cXGY Oct 08 21:42:03.768701 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:42:03.768701 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:42:03.768701 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:42:03.768701 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:42:03.768701 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:42:03.768701 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:42:03.768701 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: e0db56a031a4484489dac0b36fe1e336 Oct 08 21:42:03.768701 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1451073167 Oct 08 21:42:03.768701 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,admin,member Oct 08 21:42:03.768701 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,admin,member Oct 08 21:42:03.768701 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/e0db56a031a4484489dac0b36fe1e336"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e0db56a031a4484489dac0b36fe1e336"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_e0db56a031a4484489dac0b36fe1e336"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e0db56a031a4484489dac0b36fe1e336"}]}] Oct 08 21:42:03.768701 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1451073167 Oct 08 21:42:03.768701 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: e0db56a031a4484489dac0b36fe1e336 Oct 08 21:42:03.768701 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1451073167 Oct 08 21:42:03.768701 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-ServersAdminNegativeTestJSON-1451073167-project-admin Oct 08 21:42:03.768701 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:42:03.768701 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:42:03.768701 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 033f6de070454d3d86de05d560a8fe93 Oct 08 21:42:03.768701 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1451073167-project-admin Oct 08 21:42:03.768701 ncdv-master-1 devstack@n-api.service[140492]: Oct 08 21:42:03.768701 ncdv-master-1 devstack@n-api.service[140492]: {"resize": {"flavorRef": "280497602"}} Oct 08 21:42:03.768701 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 21:42:03.768701 ncdv-master-1 devstack@n-api.service[140492]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 08 21:42:03.768701 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': 'b07ff176-fb3f-4f10-8a5e-ea4953909503', 'body': {'resize': {'flavorRef': '280497602'}}} Oct 08 21:42:03.768701 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:42:03.768701 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:42:03.768701 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Oct 08 21:42:03.768701 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Oct 08 21:42:03.768701 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 08 21:42:03.768701 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 08 21:42:03.768701 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 08 21:42:03.768701 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc Oct 08 21:42:03.768701 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 08 21:42:03.768701 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 08 21:42:03.768701 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 08 21:42:03.768701 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 08 21:42:03.768701 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 08 21:42:03.768701 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 08 21:42:03.768701 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 08 21:42:03.768701 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 08 21:42:03.768701 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Oct 08 21:42:03.768701 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 08 21:42:03.768701 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Oct 08 21:42:03.768701 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:42:03.768701 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:42:03.768701 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:42:03.768701 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:42:03.768701 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 08 21:42:03.768701 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 08 21:42:03.768701 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 08 21:42:03.768701 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 08 21:42:03.768701 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 08 21:42:03.773289 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 08 21:42:03.773289 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 08 21:42:03.773289 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 08 21:42:03.773289 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 08 21:42:03.773289 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 08 21:42:03.773289 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 08 21:42:03.773289 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 08 21:42:03.773289 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 08 21:42:03.773289 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 08 21:42:03.773289 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Oct 08 21:42:03.773289 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Oct 08 21:42:03.773289 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Oct 08 21:42:03.773289 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 08 21:42:03.773289 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 08 21:42:03.773289 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:42:03.773289 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:42:03.773289 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:42:03.773289 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:42:03.773289 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:42:03.773289 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:42:03.773289 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:42:03.773289 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:42:03.773289 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:42:03.773289 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:42:03.773289 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 21:42:03.773289 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 21:42:03.773289 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 08 21:42:03.773289 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 08 21:42:03.773289 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Oct 08 21:42:03.773289 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 08 21:42:03.773289 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 08 21:42:03.773289 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:42:03.773289 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:42:03.773289 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:42:03.773289 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:42:03.773289 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:42:03.773289 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:42:03.773289 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:42:03.773289 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:42:03.773289 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 08 21:42:03.773289 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:42:03.773289 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-928ef6e1-ce36-49c5-80b7-bcc3db2d2a09 tempest-ServersAdminNegativeTestJSON-1451073167 tempest-ServersAdminNegativeTestJSON-1451073167-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:42:03.773289 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-928ef6e1-ce36-49c5-80b7-bcc3db2d2a09 tempest-ServersAdminNegativeTestJSON-1451073167 tempest-ServersAdminNegativeTestJSON-1451073167-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/b07ff176-fb3f-4f10-8a5e-ea4953909503/action" status: 403 len: 113 microversion: 2.1 time: 0.160745 Oct 08 21:42:03.773289 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3175/6277] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:42:03 2022] POST /compute/v2.1/servers/b07ff176-fb3f-4f10-8a5e-ea4953909503/action => generated 113 bytes in 162 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:42:03.779127 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c9cd87cf-c46b-40b7-b333-552e401ed62d tempest-ServersAdminNegativeTestJSON-1451073167 tempest-ServersAdminNegativeTestJSON-1451073167-project-admin] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:42:03.796782 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-c9cd87cf-c46b-40b7-b333-552e401ed62d tempest-ServersAdminNegativeTestJSON-1451073167 tempest-ServersAdminNegativeTestJSON-1451073167-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/280497602" status: 202 len: 0 microversion: 2.1 time: 0.021449 Oct 08 21:42:03.797364 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3103/6278] 10.222.0.26 () {58 vars in 1158 bytes} [Sat Oct 8 21:42:03 2022] DELETE /compute/v2.1/flavors/280497602 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 21:42:03.804968 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-9a0b0686-ddae-439b-848c-97248f3619b3 tempest-ServersAdminNegativeTestJSON-1451073167 tempest-ServersAdminNegativeTestJSON-1451073167-project-admin] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:42:03.828423 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-9a0b0686-ddae-439b-848c-97248f3619b3 tempest-ServersAdminNegativeTestJSON-1451073167 tempest-ServersAdminNegativeTestJSON-1451073167-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.026981 Oct 08 21:42:03.829065 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3176/6279] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Oct 8 21:42:03 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:42:03.849007 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-31183190-b8ce-4775-b302-717d3ac32e07 tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:42:03.849496 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-31183190-b8ce-4775-b302-717d3ac32e07 tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] [instance: b07ff176-fb3f-4f10-8a5e-ea4953909503] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:42:03.856135 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-31183190-b8ce-4775-b302-717d3ac32e07 tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:42:03.856641 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-31183190-b8ce-4775-b302-717d3ac32e07 tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:42:03.857100 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-31183190-b8ce-4775-b302-717d3ac32e07 tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:42:03.857844 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-31183190-b8ce-4775-b302-717d3ac32e07 tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:42:03.858318 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-31183190-b8ce-4775-b302-717d3ac32e07 tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:42:03.858756 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-31183190-b8ce-4775-b302-717d3ac32e07 tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:42:03.888450 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-31183190-b8ce-4775-b302-717d3ac32e07 tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] [instance: b07ff176-fb3f-4f10-8a5e-ea4953909503] Going to try to terminate instance {{(pid=140491) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 21:42:03.963235 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-31183190-b8ce-4775-b302-717d3ac32e07 tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] 10.222.0.26 "DELETE /compute/v2.1/servers/b07ff176-fb3f-4f10-8a5e-ea4953909503" status: 204 len: 0 microversion: 2.1 time: 0.118127 Oct 08 21:42:03.963929 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3104/6280] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:42:03 2022] DELETE /compute/v2.1/servers/b07ff176-fb3f-4f10-8a5e-ea4953909503 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 21:42:03.972336 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-44befd73-f9b3-4561-8f3d-eb4facf253fe tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:42:03.972995 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-44befd73-f9b3-4561-8f3d-eb4facf253fe tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] [instance: b07ff176-fb3f-4f10-8a5e-ea4953909503] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:42:03.979106 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-44befd73-f9b3-4561-8f3d-eb4facf253fe tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:42:03.979622 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-44befd73-f9b3-4561-8f3d-eb4facf253fe tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:42:03.980091 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-44befd73-f9b3-4561-8f3d-eb4facf253fe tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:42:03.981368 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-44befd73-f9b3-4561-8f3d-eb4facf253fe tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:42:03.981855 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-44befd73-f9b3-4561-8f3d-eb4facf253fe tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:42:03.982310 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-44befd73-f9b3-4561-8f3d-eb4facf253fe tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:42:04.116701 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-44befd73-f9b3-4561-8f3d-eb4facf253fe tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cffbc45fdf3426684cf1478cac3f6b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a63a83e582d420994af2f99ff94a18d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:42:04.124535 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-44befd73-f9b3-4561-8f3d-eb4facf253fe tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] 10.222.0.26 "GET /compute/v2.1/servers/b07ff176-fb3f-4f10-8a5e-ea4953909503" status: 200 len: 1476 microversion: 2.1 time: 0.156432 Oct 08 21:42:04.125111 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3177/6281] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:42:03 2022] GET /compute/v2.1/servers/b07ff176-fb3f-4f10-8a5e-ea4953909503 => generated 1476 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:42:05.151782 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-1102582f-edd5-4221-bc4f-afd60e67eb95 tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:42:05.152497 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-1102582f-edd5-4221-bc4f-afd60e67eb95 tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] [instance: b07ff176-fb3f-4f10-8a5e-ea4953909503] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:42:05.159591 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1102582f-edd5-4221-bc4f-afd60e67eb95 tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:42:05.160091 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1102582f-edd5-4221-bc4f-afd60e67eb95 tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:42:05.160546 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1102582f-edd5-4221-bc4f-afd60e67eb95 tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:42:05.161286 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1102582f-edd5-4221-bc4f-afd60e67eb95 tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:42:05.161762 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1102582f-edd5-4221-bc4f-afd60e67eb95 tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:42:05.162203 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1102582f-edd5-4221-bc4f-afd60e67eb95 tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:42:05.291914 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-1102582f-edd5-4221-bc4f-afd60e67eb95 tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cffbc45fdf3426684cf1478cac3f6b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a63a83e582d420994af2f99ff94a18d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:42:05.300369 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-1102582f-edd5-4221-bc4f-afd60e67eb95 tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] 10.222.0.26 "GET /compute/v2.1/servers/b07ff176-fb3f-4f10-8a5e-ea4953909503" status: 200 len: 1476 microversion: 2.1 time: 0.152959 Oct 08 21:42:05.300951 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3105/6282] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:42:05 2022] GET /compute/v2.1/servers/b07ff176-fb3f-4f10-8a5e-ea4953909503 => generated 1476 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:42:05.956765 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-c4bf93cb-f70a-4055-806b-e02708a37de9 req-03958a00-7a04-4f0e-9e60-270d542a0e5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b07ff176-fb3f-4f10-8a5e-ea4953909503", "name": "network-vif-deleted", "tag": "251e1ba0-4bd3-4155-89e2-a75beb85bd9e"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:42:05.970203 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-c4bf93cb-f70a-4055-806b-e02708a37de9 req-03958a00-7a04-4f0e-9e60-270d542a0e5f service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:42:05.970766 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-c4bf93cb-f70a-4055-806b-e02708a37de9 req-03958a00-7a04-4f0e-9e60-270d542a0e5f service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:42:05.971332 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-c4bf93cb-f70a-4055-806b-e02708a37de9 req-03958a00-7a04-4f0e-9e60-270d542a0e5f service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:42:05.985445 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-c4bf93cb-f70a-4055-806b-e02708a37de9 req-03958a00-7a04-4f0e-9e60-270d542a0e5f service nova] Creating event network-vif-deleted:251e1ba0-4bd3-4155-89e2-a75beb85bd9e for instance b07ff176-fb3f-4f10-8a5e-ea4953909503 on nch1-master-1 Oct 08 21:42:05.990598 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-c4bf93cb-f70a-4055-806b-e02708a37de9 req-03958a00-7a04-4f0e-9e60-270d542a0e5f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041783 Oct 08 21:42:05.991528 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3178/6283] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:42:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:42:06.323954 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-f0179a91-b6b9-49ae-81f5-f46ae312e31d tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:42:06.324601 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-f0179a91-b6b9-49ae-81f5-f46ae312e31d tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] [instance: b07ff176-fb3f-4f10-8a5e-ea4953909503] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:42:06.332326 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f0179a91-b6b9-49ae-81f5-f46ae312e31d tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:42:06.332819 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f0179a91-b6b9-49ae-81f5-f46ae312e31d tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:42:06.333295 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f0179a91-b6b9-49ae-81f5-f46ae312e31d tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:42:06.333998 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f0179a91-b6b9-49ae-81f5-f46ae312e31d tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:42:06.334458 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f0179a91-b6b9-49ae-81f5-f46ae312e31d tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:42:06.334907 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f0179a91-b6b9-49ae-81f5-f46ae312e31d tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:42:06.365426 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f0179a91-b6b9-49ae-81f5-f46ae312e31d tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:42:06.365839 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f0179a91-b6b9-49ae-81f5-f46ae312e31d tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:42:06.366277 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f0179a91-b6b9-49ae-81f5-f46ae312e31d tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:42:06.366726 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.objects.instance [None req-f0179a91-b6b9-49ae-81f5-f46ae312e31d tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] Lazy-loading 'fault' on Instance uuid b07ff176-fb3f-4f10-8a5e-ea4953909503 {{(pid=140491) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 21:42:06.409359 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-f0179a91-b6b9-49ae-81f5-f46ae312e31d tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cffbc45fdf3426684cf1478cac3f6b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a63a83e582d420994af2f99ff94a18d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:42:06.417670 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-f0179a91-b6b9-49ae-81f5-f46ae312e31d tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] 10.222.0.26 "GET /compute/v2.1/servers/b07ff176-fb3f-4f10-8a5e-ea4953909503" status: 200 len: 1311 microversion: 2.1 time: 0.097852 Oct 08 21:42:06.418274 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3106/6284] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:42:06 2022] GET /compute/v2.1/servers/b07ff176-fb3f-4f10-8a5e-ea4953909503 => generated 1311 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:42:07.440992 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-26966f0e-fb1e-452a-a14e-ba5836b5c5dd tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:42:07.441720 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-26966f0e-fb1e-452a-a14e-ba5836b5c5dd tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] [instance: b07ff176-fb3f-4f10-8a5e-ea4953909503] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:42:07.449254 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-26966f0e-fb1e-452a-a14e-ba5836b5c5dd tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:42:07.449837 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-26966f0e-fb1e-452a-a14e-ba5836b5c5dd tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:42:07.451164 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-26966f0e-fb1e-452a-a14e-ba5836b5c5dd tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:42:07.451939 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-26966f0e-fb1e-452a-a14e-ba5836b5c5dd tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:42:07.452477 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-26966f0e-fb1e-452a-a14e-ba5836b5c5dd tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:42:07.453022 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-26966f0e-fb1e-452a-a14e-ba5836b5c5dd tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:42:07.467271 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-26966f0e-fb1e-452a-a14e-ba5836b5c5dd tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] HTTP exception thrown: Instance b07ff176-fb3f-4f10-8a5e-ea4953909503 could not be found. Oct 08 21:42:07.468908 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-26966f0e-fb1e-452a-a14e-ba5836b5c5dd tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] Request method failure captured: Oct 08 21:42:07.468908 ncdv-master-1 devstack@n-api.service[140492]: request: GET /compute/v2.1/servers/b07ff176-fb3f-4f10-8a5e-ea4953909503 HTTP/1.1 Oct 08 21:42:07.468908 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:42:07.468908 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:42:07.468908 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:42:07.468908 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 21:42:07.468908 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:42:07.468908 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:42:07.468908 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:42:07.468908 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:42:07.468908 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQe6dTkCRKe5FpwudFn9cQfITCgTSmyMb7J8TuwyxFMbU7DsIfT7_ek-ZtR8zGzMtVpzKhAgTQVMo7h2-KUBwnimlCPaRHEUODdRn7QmkDZ2Oq6jaSBHwFSNXD56XF_T9esfzUFTDjM5BGNlyqQ04-dDp1pEgru3jn_GXLNiv_JMbV48 Oct 08 21:42:07.468908 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:42:07.468908 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:42:07.468908 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:42:07.468908 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:42:07.468908 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:42:07.468908 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:42:07.468908 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 5a63a83e582d420994af2f99ff94a18d Oct 08 21:42:07.468908 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1875607106 Oct 08 21:42:07.468908 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:42:07.468908 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:42:07.468908 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5a63a83e582d420994af2f99ff94a18d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5a63a83e582d420994af2f99ff94a18d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5a63a83e582d420994af2f99ff94a18d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5a63a83e582d420994af2f99ff94a18d"}]}] Oct 08 21:42:07.468908 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1875607106 Oct 08 21:42:07.468908 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 5a63a83e582d420994af2f99ff94a18d Oct 08 21:42:07.468908 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1875607106 Oct 08 21:42:07.468908 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-ServersAdminNegativeTestJSON-1875607106-project Oct 08 21:42:07.468908 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:42:07.468908 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:42:07.468908 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 6cffbc45fdf3426684cf1478cac3f6b5 Oct 08 21:42:07.468908 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1875607106-project Oct 08 21:42:07.468908 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 21:42:07.468908 ncdv-master-1 devstack@n-api.service[140492]: exception: Instance b07ff176-fb3f-4f10-8a5e-ea4953909503 could not be found. Oct 08 21:42:07.468908 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': 'b07ff176-fb3f-4f10-8a5e-ea4953909503'} Oct 08 21:42:07.468908 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:42:07.468908 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:42:07.468908 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:42:07.468908 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:42:07.468908 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:42:07.468908 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:42:07.468908 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:42:07.468908 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:42:07.468908 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:42:07.468908 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:42:07.468908 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b07ff176-fb3f-4f10-8a5e-ea4953909503 could not be found. Oct 08 21:42:07.468908 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:42:07.468908 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:42:07.468908 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:42:07.468908 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:42:07.468908 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:42:07.468908 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:42:07.468908 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:42:07.468908 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:42:07.468908 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:42:07.468908 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:42:07.468908 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:42:07.468908 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:42:07.468908 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:42:07.468908 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:42:07.468908 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:42:07.468908 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:42:07.468908 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b07ff176-fb3f-4f10-8a5e-ea4953909503 could not be found. Oct 08 21:42:07.468908 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:42:07.468908 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:42:07.473079 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:42:07.473079 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:42:07.473079 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:42:07.473079 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:42:07.473079 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:42:07.473079 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:42:07.473079 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b07ff176-fb3f-4f10-8a5e-ea4953909503 could not be found. Oct 08 21:42:07.473079 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:42:07.473079 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-26966f0e-fb1e-452a-a14e-ba5836b5c5dd tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] Returning 404 to user: Instance b07ff176-fb3f-4f10-8a5e-ea4953909503 could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:42:07.473079 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-26966f0e-fb1e-452a-a14e-ba5836b5c5dd tempest-ServersAdminNegativeTestJSON-1875607106 tempest-ServersAdminNegativeTestJSON-1875607106-project] 10.222.0.26 "GET /compute/v2.1/servers/b07ff176-fb3f-4f10-8a5e-ea4953909503" status: 404 len: 111 microversion: 2.1 time: 0.033684 Oct 08 21:42:07.473079 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3179/6285] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:42:07 2022] GET /compute/v2.1/servers/b07ff176-fb3f-4f10-8a5e-ea4953909503 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:42:13.420100 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=2 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:42:13.420892 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=3 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:42:13.546962 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-972c2024-9205-4ea8-a598-83e73cf3be2b tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-795945943", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "networks": [{"uuid": "75f72335-1528-47ec-8607-468185cea984"}]}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:42:13.604153 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.network.neutron [None req-972c2024-9205-4ea8-a598-83e73cf3be2b tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] validate_networks() for [('75f72335-1528-47ec-8607-468185cea984', None, None, None, None, None)] {{(pid=140491) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 21:42:13.982254 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-972c2024-9205-4ea8-a598-83e73cf3be2b tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Flavor limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 21:42:13.982692 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-972c2024-9205-4ea8-a598-83e73cf3be2b tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Image limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 21:42:13.983179 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-972c2024-9205-4ea8-a598-83e73cf3be2b tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Flavor pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 21:42:13.983602 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-972c2024-9205-4ea8-a598-83e73cf3be2b tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Image pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 21:42:13.984024 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-972c2024-9205-4ea8-a598-83e73cf3be2b tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 21:42:13.993069 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-972c2024-9205-4ea8-a598-83e73cf3be2b tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:42:13.993591 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-972c2024-9205-4ea8-a598-83e73cf3be2b tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:42:13.994035 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-972c2024-9205-4ea8-a598-83e73cf3be2b tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:42:13.994776 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-972c2024-9205-4ea8-a598-83e73cf3be2b tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:42:13.995242 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-972c2024-9205-4ea8-a598-83e73cf3be2b tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:42:13.995678 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-972c2024-9205-4ea8-a598-83e73cf3be2b tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:42:14.013689 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-972c2024-9205-4ea8-a598-83e73cf3be2b tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Getting quotas for project 1b9165c14330434ba951ad616b3f76ce. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:42:14.019038 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-972c2024-9205-4ea8-a598-83e73cf3be2b tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Getting quotas for user 8a8cc619b5f742a3a2849d2d424082cb and project 1b9165c14330434ba951ad616b3f76ce. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:42:14.031460 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-972c2024-9205-4ea8-a598-83e73cf3be2b tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Going to run 1 instances... {{(pid=140491) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 21:42:14.033812 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-972c2024-9205-4ea8-a598-83e73cf3be2b tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] [instance: 016e35b1-b9d2-41c2-bce1-7689c7846f08] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c508bd7f-7db9-4b2c-af7c-be54a855c355',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140491) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 21:42:14.080895 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-972c2024-9205-4ea8-a598-83e73cf3be2b tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.666947 Oct 08 21:42:14.081909 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3107/6286] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 21:42:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 669 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 08 21:42:14.094024 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-0928317b-a3fc-4f47-adc1-ecd40d83b3f3 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:42:14.094673 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-0928317b-a3fc-4f47-adc1-ecd40d83b3f3 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] [instance: 016e35b1-b9d2-41c2-bce1-7689c7846f08] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:42:14.099636 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=2 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:42:14.100718 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=3 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:42:14.165650 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-0928317b-a3fc-4f47-adc1-ecd40d83b3f3 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8cc619b5f742a3a2849d2d424082cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9165c14330434ba951ad616b3f76ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:42:14.175719 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-0928317b-a3fc-4f47-adc1-ecd40d83b3f3 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] 10.222.0.26 "GET /compute/v2.1/servers/016e35b1-b9d2-41c2-bce1-7689c7846f08" status: 200 len: 1214 microversion: 2.1 time: 0.085941 Oct 08 21:42:14.176313 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3180/6287] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:42:14 2022] GET /compute/v2.1/servers/016e35b1-b9d2-41c2-bce1-7689c7846f08 => generated 1214 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:42:15.200848 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-12d1a377-78d6-46be-8955-965e7309b082 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:42:15.201636 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-12d1a377-78d6-46be-8955-965e7309b082 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] [instance: 016e35b1-b9d2-41c2-bce1-7689c7846f08] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:42:15.209098 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-12d1a377-78d6-46be-8955-965e7309b082 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:42:15.209633 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-12d1a377-78d6-46be-8955-965e7309b082 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:42:15.210082 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-12d1a377-78d6-46be-8955-965e7309b082 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:42:15.210791 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-12d1a377-78d6-46be-8955-965e7309b082 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:42:15.211258 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-12d1a377-78d6-46be-8955-965e7309b082 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:42:15.211726 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-12d1a377-78d6-46be-8955-965e7309b082 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:42:15.280286 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-12d1a377-78d6-46be-8955-965e7309b082 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8cc619b5f742a3a2849d2d424082cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9165c14330434ba951ad616b3f76ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:42:15.289666 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-12d1a377-78d6-46be-8955-965e7309b082 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] 10.222.0.26 "GET /compute/v2.1/servers/016e35b1-b9d2-41c2-bce1-7689c7846f08" status: 200 len: 1266 microversion: 2.1 time: 0.094344 Oct 08 21:42:15.290537 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3108/6288] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:42:15 2022] GET /compute/v2.1/servers/016e35b1-b9d2-41c2-bce1-7689c7846f08 => generated 1266 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:42:16.319667 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-8f24f2e3-0701-4bb1-95b4-610a2cd92c1e tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:42:16.322058 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-8f24f2e3-0701-4bb1-95b4-610a2cd92c1e tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] [instance: 016e35b1-b9d2-41c2-bce1-7689c7846f08] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:42:16.342841 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8f24f2e3-0701-4bb1-95b4-610a2cd92c1e tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:42:16.344092 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8f24f2e3-0701-4bb1-95b4-610a2cd92c1e tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:42:16.344939 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8f24f2e3-0701-4bb1-95b4-610a2cd92c1e tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:42:16.346566 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8f24f2e3-0701-4bb1-95b4-610a2cd92c1e tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:42:16.347268 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8f24f2e3-0701-4bb1-95b4-610a2cd92c1e tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:42:16.348766 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8f24f2e3-0701-4bb1-95b4-610a2cd92c1e tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:42:16.515212 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-8f24f2e3-0701-4bb1-95b4-610a2cd92c1e tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8cc619b5f742a3a2849d2d424082cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9165c14330434ba951ad616b3f76ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:42:16.524925 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-8f24f2e3-0701-4bb1-95b4-610a2cd92c1e tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] 10.222.0.26 "GET /compute/v2.1/servers/016e35b1-b9d2-41c2-bce1-7689c7846f08" status: 200 len: 1314 microversion: 2.1 time: 0.214208 Oct 08 21:42:16.538112 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3181/6289] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:42:16 2022] GET /compute/v2.1/servers/016e35b1-b9d2-41c2-bce1-7689c7846f08 => generated 1314 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:42:16.880815 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-351ee73d-dfcf-42f1-8c22-ddf8d5a734f3 req-deff1086-1851-478a-9460-73f1d9fa1d7c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "016e35b1-b9d2-41c2-bce1-7689c7846f08", "tag": "0b92e1d9-17d9-41ef-ac59-f7d96ff07efd"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:42:16.910922 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-351ee73d-dfcf-42f1-8c22-ddf8d5a734f3 req-deff1086-1851-478a-9460-73f1d9fa1d7c service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:42:16.911412 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-351ee73d-dfcf-42f1-8c22-ddf8d5a734f3 req-deff1086-1851-478a-9460-73f1d9fa1d7c service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:42:16.911842 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-351ee73d-dfcf-42f1-8c22-ddf8d5a734f3 req-deff1086-1851-478a-9460-73f1d9fa1d7c service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:42:16.928492 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-351ee73d-dfcf-42f1-8c22-ddf8d5a734f3 req-deff1086-1851-478a-9460-73f1d9fa1d7c service nova] Creating event network-changed:0b92e1d9-17d9-41ef-ac59-f7d96ff07efd for instance 016e35b1-b9d2-41c2-bce1-7689c7846f08 on nch1-master-1 Oct 08 21:42:16.933910 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-351ee73d-dfcf-42f1-8c22-ddf8d5a734f3 req-deff1086-1851-478a-9460-73f1d9fa1d7c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063935 Oct 08 21:42:16.935409 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3109/6290] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:42:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:42:17.550223 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-3c802dfb-d9fb-4a71-ae9c-62124de8af3e tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:42:17.550897 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-3c802dfb-d9fb-4a71-ae9c-62124de8af3e tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] [instance: 016e35b1-b9d2-41c2-bce1-7689c7846f08] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:42:17.557905 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3c802dfb-d9fb-4a71-ae9c-62124de8af3e tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:42:17.558434 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3c802dfb-d9fb-4a71-ae9c-62124de8af3e tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:42:17.558895 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3c802dfb-d9fb-4a71-ae9c-62124de8af3e tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:42:17.559737 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3c802dfb-d9fb-4a71-ae9c-62124de8af3e tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:42:17.560215 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3c802dfb-d9fb-4a71-ae9c-62124de8af3e tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:42:17.560660 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3c802dfb-d9fb-4a71-ae9c-62124de8af3e tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:42:17.697369 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-3c802dfb-d9fb-4a71-ae9c-62124de8af3e tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8cc619b5f742a3a2849d2d424082cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9165c14330434ba951ad616b3f76ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:42:17.705110 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-3c802dfb-d9fb-4a71-ae9c-62124de8af3e tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] 10.222.0.26 "GET /compute/v2.1/servers/016e35b1-b9d2-41c2-bce1-7689c7846f08" status: 200 len: 1314 microversion: 2.1 time: 0.158971 Oct 08 21:42:17.705709 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3182/6291] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:42:17 2022] GET /compute/v2.1/servers/016e35b1-b9d2-41c2-bce1-7689c7846f08 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:42:18.728488 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-ab9fbe29-5568-41af-a52b-8b3ec26e8222 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:42:18.729363 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-ab9fbe29-5568-41af-a52b-8b3ec26e8222 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] [instance: 016e35b1-b9d2-41c2-bce1-7689c7846f08] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:42:18.737623 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ab9fbe29-5568-41af-a52b-8b3ec26e8222 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:42:18.738125 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ab9fbe29-5568-41af-a52b-8b3ec26e8222 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:42:18.738574 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ab9fbe29-5568-41af-a52b-8b3ec26e8222 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:42:18.739321 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ab9fbe29-5568-41af-a52b-8b3ec26e8222 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:42:18.739785 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ab9fbe29-5568-41af-a52b-8b3ec26e8222 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:42:18.740219 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ab9fbe29-5568-41af-a52b-8b3ec26e8222 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:42:18.920011 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-ab9fbe29-5568-41af-a52b-8b3ec26e8222 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8cc619b5f742a3a2849d2d424082cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9165c14330434ba951ad616b3f76ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:42:18.927994 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-ab9fbe29-5568-41af-a52b-8b3ec26e8222 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] 10.222.0.26 "GET /compute/v2.1/servers/016e35b1-b9d2-41c2-bce1-7689c7846f08" status: 200 len: 1314 microversion: 2.1 time: 0.203852 Oct 08 21:42:18.928578 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3110/6292] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:42:18 2022] GET /compute/v2.1/servers/016e35b1-b9d2-41c2-bce1-7689c7846f08 => generated 1314 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:42:19.952652 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-dc47d99f-04d7-44cd-9469-2e433342eebf tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:42:19.953321 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-dc47d99f-04d7-44cd-9469-2e433342eebf tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] [instance: 016e35b1-b9d2-41c2-bce1-7689c7846f08] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:42:19.960272 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dc47d99f-04d7-44cd-9469-2e433342eebf tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:42:19.960776 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dc47d99f-04d7-44cd-9469-2e433342eebf tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:42:19.961261 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dc47d99f-04d7-44cd-9469-2e433342eebf tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:42:19.961990 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dc47d99f-04d7-44cd-9469-2e433342eebf tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:42:19.962472 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dc47d99f-04d7-44cd-9469-2e433342eebf tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:42:19.962927 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dc47d99f-04d7-44cd-9469-2e433342eebf tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:42:20.093940 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-dc47d99f-04d7-44cd-9469-2e433342eebf tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8cc619b5f742a3a2849d2d424082cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9165c14330434ba951ad616b3f76ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:42:20.101714 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-dc47d99f-04d7-44cd-9469-2e433342eebf tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] 10.222.0.26 "GET /compute/v2.1/servers/016e35b1-b9d2-41c2-bce1-7689c7846f08" status: 200 len: 1314 microversion: 2.1 time: 0.153753 Oct 08 21:42:20.102292 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3183/6293] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:42:19 2022] GET /compute/v2.1/servers/016e35b1-b9d2-41c2-bce1-7689c7846f08 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:42:21.124642 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-cfa2e3b1-8c23-4d50-835d-ed5c5bc1551b tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:42:21.125264 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-cfa2e3b1-8c23-4d50-835d-ed5c5bc1551b tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] [instance: 016e35b1-b9d2-41c2-bce1-7689c7846f08] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:42:21.132064 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cfa2e3b1-8c23-4d50-835d-ed5c5bc1551b tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:42:21.132553 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cfa2e3b1-8c23-4d50-835d-ed5c5bc1551b tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:42:21.132996 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cfa2e3b1-8c23-4d50-835d-ed5c5bc1551b tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:42:21.133725 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cfa2e3b1-8c23-4d50-835d-ed5c5bc1551b tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:42:21.134184 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cfa2e3b1-8c23-4d50-835d-ed5c5bc1551b tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:42:21.134611 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cfa2e3b1-8c23-4d50-835d-ed5c5bc1551b tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:42:21.266120 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-cfa2e3b1-8c23-4d50-835d-ed5c5bc1551b tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8cc619b5f742a3a2849d2d424082cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9165c14330434ba951ad616b3f76ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:42:21.273828 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-cfa2e3b1-8c23-4d50-835d-ed5c5bc1551b tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] 10.222.0.26 "GET /compute/v2.1/servers/016e35b1-b9d2-41c2-bce1-7689c7846f08" status: 200 len: 1314 microversion: 2.1 time: 0.153148 Oct 08 21:42:21.274397 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3111/6294] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:42:21 2022] GET /compute/v2.1/servers/016e35b1-b9d2-41c2-bce1-7689c7846f08 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:42:22.295976 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-9ec352e8-fdd9-4fc1-ac08-6f6f880f08eb tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:42:22.296615 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-9ec352e8-fdd9-4fc1-ac08-6f6f880f08eb tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] [instance: 016e35b1-b9d2-41c2-bce1-7689c7846f08] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:42:22.300126 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:42:22.305800 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9ec352e8-fdd9-4fc1-ac08-6f6f880f08eb tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:42:22.306302 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9ec352e8-fdd9-4fc1-ac08-6f6f880f08eb tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:42:22.306759 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9ec352e8-fdd9-4fc1-ac08-6f6f880f08eb tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:42:22.307486 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9ec352e8-fdd9-4fc1-ac08-6f6f880f08eb tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:42:22.307961 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9ec352e8-fdd9-4fc1-ac08-6f6f880f08eb tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:42:22.308403 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9ec352e8-fdd9-4fc1-ac08-6f6f880f08eb tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:42:22.311881 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=72 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:42:22.442211 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-9ec352e8-fdd9-4fc1-ac08-6f6f880f08eb tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8cc619b5f742a3a2849d2d424082cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9165c14330434ba951ad616b3f76ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:42:22.450844 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-9ec352e8-fdd9-4fc1-ac08-6f6f880f08eb tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] 10.222.0.26 "GET /compute/v2.1/servers/016e35b1-b9d2-41c2-bce1-7689c7846f08" status: 200 len: 1314 microversion: 2.1 time: 0.158816 Oct 08 21:42:22.451422 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3184/6295] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:42:22 2022] GET /compute/v2.1/servers/016e35b1-b9d2-41c2-bce1-7689c7846f08 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:42:22.758176 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-d0a8bed3-83ff-4a26-8cf5-73ba7484c966 req-3fbc7943-ba86-49a5-85af-d3dadad921a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "016e35b1-b9d2-41c2-bce1-7689c7846f08", "name": "network-vif-plugged", "status": "completed", "tag": "0b92e1d9-17d9-41ef-ac59-f7d96ff07efd"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:42:22.764808 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=4,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:42:22.771137 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-d0a8bed3-83ff-4a26-8cf5-73ba7484c966 req-3fbc7943-ba86-49a5-85af-d3dadad921a6 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:42:22.771815 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-d0a8bed3-83ff-4a26-8cf5-73ba7484c966 req-3fbc7943-ba86-49a5-85af-d3dadad921a6 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:42:22.772260 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-d0a8bed3-83ff-4a26-8cf5-73ba7484c966 req-3fbc7943-ba86-49a5-85af-d3dadad921a6 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:42:22.777125 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:42:22.786453 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-d0a8bed3-83ff-4a26-8cf5-73ba7484c966 req-3fbc7943-ba86-49a5-85af-d3dadad921a6 service nova] Creating event network-vif-plugged:0b92e1d9-17d9-41ef-ac59-f7d96ff07efd for instance 016e35b1-b9d2-41c2-bce1-7689c7846f08 on nch1-master-1 Oct 08 21:42:22.792852 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-d0a8bed3-83ff-4a26-8cf5-73ba7484c966 req-3fbc7943-ba86-49a5-85af-d3dadad921a6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038325 Oct 08 21:42:22.793545 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3112/6296] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:42:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:42:23.474151 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-a6844b8e-00d9-4bc0-9664-dba32b931583 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:42:23.474784 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-a6844b8e-00d9-4bc0-9664-dba32b931583 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] [instance: 016e35b1-b9d2-41c2-bce1-7689c7846f08] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:42:23.482442 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a6844b8e-00d9-4bc0-9664-dba32b931583 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:42:23.482944 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a6844b8e-00d9-4bc0-9664-dba32b931583 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:42:23.483401 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a6844b8e-00d9-4bc0-9664-dba32b931583 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:42:23.484122 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a6844b8e-00d9-4bc0-9664-dba32b931583 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:42:23.484597 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a6844b8e-00d9-4bc0-9664-dba32b931583 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:42:23.485049 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a6844b8e-00d9-4bc0-9664-dba32b931583 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:42:23.618621 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-a6844b8e-00d9-4bc0-9664-dba32b931583 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8cc619b5f742a3a2849d2d424082cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9165c14330434ba951ad616b3f76ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:42:23.626420 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-a6844b8e-00d9-4bc0-9664-dba32b931583 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] 10.222.0.26 "GET /compute/v2.1/servers/016e35b1-b9d2-41c2-bce1-7689c7846f08" status: 200 len: 1314 microversion: 2.1 time: 0.156176 Oct 08 21:42:23.627003 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3185/6297] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:42:23 2022] GET /compute/v2.1/servers/016e35b1-b9d2-41c2-bce1-7689c7846f08 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:42:24.647529 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=2 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:42:24.648371 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=6 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:42:24.653093 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-ef8fc4b7-0633-40e4-9e72-f704d76266cb tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:42:24.653833 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-ef8fc4b7-0633-40e4-9e72-f704d76266cb tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] [instance: 016e35b1-b9d2-41c2-bce1-7689c7846f08] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:42:24.662740 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ef8fc4b7-0633-40e4-9e72-f704d76266cb tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:42:24.663237 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ef8fc4b7-0633-40e4-9e72-f704d76266cb tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:42:24.663682 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ef8fc4b7-0633-40e4-9e72-f704d76266cb tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:42:24.664391 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ef8fc4b7-0633-40e4-9e72-f704d76266cb tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:42:24.664858 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ef8fc4b7-0633-40e4-9e72-f704d76266cb tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:42:24.665330 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ef8fc4b7-0633-40e4-9e72-f704d76266cb tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:42:24.801510 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-ef8fc4b7-0633-40e4-9e72-f704d76266cb tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8cc619b5f742a3a2849d2d424082cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9165c14330434ba951ad616b3f76ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:42:24.809443 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-ef8fc4b7-0633-40e4-9e72-f704d76266cb tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] 10.222.0.26 "GET /compute/v2.1/servers/016e35b1-b9d2-41c2-bce1-7689c7846f08" status: 200 len: 1500 microversion: 2.1 time: 0.163682 Oct 08 21:42:24.810561 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3113/6298] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:42:24 2022] GET /compute/v2.1/servers/016e35b1-b9d2-41c2-bce1-7689c7846f08 => generated 1500 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:42:24.832432 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-f72584fc-5e9c-425c-8848-f56391183057 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:42:24.834751 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-f72584fc-5e9c-425c-8848-f56391183057 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] [instance: 016e35b1-b9d2-41c2-bce1-7689c7846f08] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:42:24.836691 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=2 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:42:24.843293 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f72584fc-5e9c-425c-8848-f56391183057 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:42:24.843795 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f72584fc-5e9c-425c-8848-f56391183057 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:42:24.844251 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f72584fc-5e9c-425c-8848-f56391183057 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:42:24.844957 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f72584fc-5e9c-425c-8848-f56391183057 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:42:24.845459 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f72584fc-5e9c-425c-8848-f56391183057 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:42:24.845923 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f72584fc-5e9c-425c-8848-f56391183057 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:42:24.874471 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-f72584fc-5e9c-425c-8848-f56391183057 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '8a8cc619b5f742a3a2849d2d424082cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9165c14330434ba951ad616b3f76ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:42:24.880102 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-f72584fc-5e9c-425c-8848-f56391183057 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] [instance: 016e35b1-b9d2-41c2-bce1-7689c7846f08] Old instance type m1.heat2, new instance type m1.heat {{(pid=140492) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 08 21:42:24.886601 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-f72584fc-5e9c-425c-8848-f56391183057 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Flavor limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 21:42:24.887037 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-f72584fc-5e9c-425c-8848-f56391183057 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Image limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 21:42:24.887527 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-f72584fc-5e9c-425c-8848-f56391183057 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Flavor pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 21:42:24.887952 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-f72584fc-5e9c-425c-8848-f56391183057 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Image pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 21:42:24.888378 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-f72584fc-5e9c-425c-8848-f56391183057 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 21:42:24.949936 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-f72584fc-5e9c-425c-8848-f56391183057 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] 10.222.0.26 "POST /compute/v2.1/servers/016e35b1-b9d2-41c2-bce1-7689c7846f08/action" status: 202 len: 0 microversion: 2.1 time: 0.121527 Oct 08 21:42:24.950691 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3186/6299] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:42:24 2022] POST /compute/v2.1/servers/016e35b1-b9d2-41c2-bce1-7689c7846f08/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 21:42:24.958839 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-5efcb5be-847a-4937-9a6a-88e4060a1e93 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:42:24.959464 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-5efcb5be-847a-4937-9a6a-88e4060a1e93 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] [instance: 016e35b1-b9d2-41c2-bce1-7689c7846f08] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:42:24.966490 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5efcb5be-847a-4937-9a6a-88e4060a1e93 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:42:24.967000 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5efcb5be-847a-4937-9a6a-88e4060a1e93 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:42:24.967452 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5efcb5be-847a-4937-9a6a-88e4060a1e93 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:42:24.968176 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5efcb5be-847a-4937-9a6a-88e4060a1e93 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:42:24.968664 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5efcb5be-847a-4937-9a6a-88e4060a1e93 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:42:24.969127 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5efcb5be-847a-4937-9a6a-88e4060a1e93 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:42:25.102177 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-5efcb5be-847a-4937-9a6a-88e4060a1e93 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8cc619b5f742a3a2849d2d424082cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9165c14330434ba951ad616b3f76ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:42:25.111014 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-5efcb5be-847a-4937-9a6a-88e4060a1e93 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] 10.222.0.26 "GET /compute/v2.1/servers/016e35b1-b9d2-41c2-bce1-7689c7846f08" status: 200 len: 1509 microversion: 2.1 time: 0.155992 Oct 08 21:42:25.111633 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3114/6300] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:42:24 2022] GET /compute/v2.1/servers/016e35b1-b9d2-41c2-bce1-7689c7846f08 => generated 1509 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:42:26.134685 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-676474ba-3c61-4617-881d-01194bacf6bd tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:42:26.135274 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-676474ba-3c61-4617-881d-01194bacf6bd tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] [instance: 016e35b1-b9d2-41c2-bce1-7689c7846f08] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:42:26.145319 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-676474ba-3c61-4617-881d-01194bacf6bd tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:42:26.145827 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-676474ba-3c61-4617-881d-01194bacf6bd tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:42:26.146288 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-676474ba-3c61-4617-881d-01194bacf6bd tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:42:26.147012 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-676474ba-3c61-4617-881d-01194bacf6bd tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:42:26.147485 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-676474ba-3c61-4617-881d-01194bacf6bd tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:42:26.147934 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-676474ba-3c61-4617-881d-01194bacf6bd tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:42:26.276663 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-676474ba-3c61-4617-881d-01194bacf6bd tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8cc619b5f742a3a2849d2d424082cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9165c14330434ba951ad616b3f76ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:42:26.285771 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-676474ba-3c61-4617-881d-01194bacf6bd tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] 10.222.0.26 "GET /compute/v2.1/servers/016e35b1-b9d2-41c2-bce1-7689c7846f08" status: 200 len: 1509 microversion: 2.1 time: 0.155810 Oct 08 21:42:26.286490 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3187/6301] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:42:26 2022] GET /compute/v2.1/servers/016e35b1-b9d2-41c2-bce1-7689c7846f08 => generated 1509 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:42:27.309369 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-f481841e-d213-4359-85fb-f4b18e8c4d64 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:42:27.309989 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-f481841e-d213-4359-85fb-f4b18e8c4d64 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] [instance: 016e35b1-b9d2-41c2-bce1-7689c7846f08] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:42:27.316381 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f481841e-d213-4359-85fb-f4b18e8c4d64 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:42:27.316873 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f481841e-d213-4359-85fb-f4b18e8c4d64 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:42:27.317341 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f481841e-d213-4359-85fb-f4b18e8c4d64 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:42:27.318039 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f481841e-d213-4359-85fb-f4b18e8c4d64 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:42:27.318495 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f481841e-d213-4359-85fb-f4b18e8c4d64 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:42:27.318923 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f481841e-d213-4359-85fb-f4b18e8c4d64 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:42:27.453254 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-f481841e-d213-4359-85fb-f4b18e8c4d64 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8cc619b5f742a3a2849d2d424082cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9165c14330434ba951ad616b3f76ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:42:27.461091 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-f481841e-d213-4359-85fb-f4b18e8c4d64 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] 10.222.0.26 "GET /compute/v2.1/servers/016e35b1-b9d2-41c2-bce1-7689c7846f08" status: 200 len: 1514 microversion: 2.1 time: 0.155681 Oct 08 21:42:27.461697 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3115/6302] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:42:27 2022] GET /compute/v2.1/servers/016e35b1-b9d2-41c2-bce1-7689c7846f08 => generated 1514 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:42:28.484484 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-f648bf28-b097-4357-b0e9-fd429c2e4525 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:42:28.485130 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-f648bf28-b097-4357-b0e9-fd429c2e4525 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] [instance: 016e35b1-b9d2-41c2-bce1-7689c7846f08] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:42:28.491629 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f648bf28-b097-4357-b0e9-fd429c2e4525 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:42:28.492140 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f648bf28-b097-4357-b0e9-fd429c2e4525 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:42:28.492671 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f648bf28-b097-4357-b0e9-fd429c2e4525 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:42:28.493437 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f648bf28-b097-4357-b0e9-fd429c2e4525 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:42:28.493920 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f648bf28-b097-4357-b0e9-fd429c2e4525 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:42:28.494378 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f648bf28-b097-4357-b0e9-fd429c2e4525 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:42:28.627994 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-f648bf28-b097-4357-b0e9-fd429c2e4525 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8cc619b5f742a3a2849d2d424082cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9165c14330434ba951ad616b3f76ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:42:28.635730 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-f648bf28-b097-4357-b0e9-fd429c2e4525 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] 10.222.0.26 "GET /compute/v2.1/servers/016e35b1-b9d2-41c2-bce1-7689c7846f08" status: 200 len: 1514 microversion: 2.1 time: 0.155702 Oct 08 21:42:28.636303 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3188/6303] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:42:28 2022] GET /compute/v2.1/servers/016e35b1-b9d2-41c2-bce1-7689c7846f08 => generated 1514 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:42:29.659192 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-becece0d-64b4-4f66-ac34-05ff3a47a303 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:42:29.659734 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-becece0d-64b4-4f66-ac34-05ff3a47a303 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] [instance: 016e35b1-b9d2-41c2-bce1-7689c7846f08] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:42:29.666677 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-becece0d-64b4-4f66-ac34-05ff3a47a303 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:42:29.667171 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-becece0d-64b4-4f66-ac34-05ff3a47a303 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:42:29.667619 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-becece0d-64b4-4f66-ac34-05ff3a47a303 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:42:29.668318 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-becece0d-64b4-4f66-ac34-05ff3a47a303 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:42:29.668783 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-becece0d-64b4-4f66-ac34-05ff3a47a303 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:42:29.669239 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-becece0d-64b4-4f66-ac34-05ff3a47a303 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:42:29.800526 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-becece0d-64b4-4f66-ac34-05ff3a47a303 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8cc619b5f742a3a2849d2d424082cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9165c14330434ba951ad616b3f76ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:42:29.808394 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-becece0d-64b4-4f66-ac34-05ff3a47a303 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] 10.222.0.26 "GET /compute/v2.1/servers/016e35b1-b9d2-41c2-bce1-7689c7846f08" status: 200 len: 1514 microversion: 2.1 time: 0.153199 Oct 08 21:42:29.808979 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3116/6304] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:42:29 2022] GET /compute/v2.1/servers/016e35b1-b9d2-41c2-bce1-7689c7846f08 => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:42:30.831241 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-cecfffed-f14b-4cdf-8de5-7e1bbe4641ec tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:42:30.831869 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-cecfffed-f14b-4cdf-8de5-7e1bbe4641ec tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] [instance: 016e35b1-b9d2-41c2-bce1-7689c7846f08] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:42:30.835085 ncdv-master-1 devstack@n-api.service[140492]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 08 21:42:30.835220 ncdv-master-1 devstack@n-api.service[140492]: Sat Oct 8 21:42:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/016e35b1-b9d2-41c2-bce1-7689c7846f08 (ip 10.222.0.26) !!! Oct 08 21:42:30.842481 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cecfffed-f14b-4cdf-8de5-7e1bbe4641ec tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:42:30.842988 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cecfffed-f14b-4cdf-8de5-7e1bbe4641ec tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:42:30.843446 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cecfffed-f14b-4cdf-8de5-7e1bbe4641ec tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:42:30.844164 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cecfffed-f14b-4cdf-8de5-7e1bbe4641ec tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:42:30.844645 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cecfffed-f14b-4cdf-8de5-7e1bbe4641ec tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:42:30.845092 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cecfffed-f14b-4cdf-8de5-7e1bbe4641ec tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:42:30.978356 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-cecfffed-f14b-4cdf-8de5-7e1bbe4641ec tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8cc619b5f742a3a2849d2d424082cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9165c14330434ba951ad616b3f76ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:42:30.986091 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-cecfffed-f14b-4cdf-8de5-7e1bbe4641ec tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] 10.222.0.26 "GET /compute/v2.1/servers/016e35b1-b9d2-41c2-bce1-7689c7846f08" status: 200 len: 1514 microversion: 2.1 time: 0.158755 Oct 08 21:42:30.986668 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3189/6305] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:42:30 2022] GET /compute/v2.1/servers/016e35b1-b9d2-41c2-bce1-7689c7846f08 => generated 1514 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:42:32.008849 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-dcce902f-9de1-4623-9db0-3759396601e3 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:42:32.009518 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-dcce902f-9de1-4623-9db0-3759396601e3 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] [instance: 016e35b1-b9d2-41c2-bce1-7689c7846f08] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:42:32.016478 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dcce902f-9de1-4623-9db0-3759396601e3 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:42:32.016966 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dcce902f-9de1-4623-9db0-3759396601e3 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:42:32.017440 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dcce902f-9de1-4623-9db0-3759396601e3 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:42:32.018142 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dcce902f-9de1-4623-9db0-3759396601e3 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:42:32.018611 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dcce902f-9de1-4623-9db0-3759396601e3 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:42:32.019066 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dcce902f-9de1-4623-9db0-3759396601e3 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:42:32.151961 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-dcce902f-9de1-4623-9db0-3759396601e3 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8cc619b5f742a3a2849d2d424082cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9165c14330434ba951ad616b3f76ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:42:32.160291 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-dcce902f-9de1-4623-9db0-3759396601e3 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] 10.222.0.26 "GET /compute/v2.1/servers/016e35b1-b9d2-41c2-bce1-7689c7846f08" status: 200 len: 1514 microversion: 2.1 time: 0.155407 Oct 08 21:42:32.160872 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3117/6306] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:42:32 2022] GET /compute/v2.1/servers/016e35b1-b9d2-41c2-bce1-7689c7846f08 => generated 1514 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:42:33.183874 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-b83b33e5-7114-4b55-89b6-46c839ffb6bb tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:42:33.184423 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-b83b33e5-7114-4b55-89b6-46c839ffb6bb tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] [instance: 016e35b1-b9d2-41c2-bce1-7689c7846f08] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:42:33.191949 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b83b33e5-7114-4b55-89b6-46c839ffb6bb tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:42:33.192459 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b83b33e5-7114-4b55-89b6-46c839ffb6bb tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:42:33.192922 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b83b33e5-7114-4b55-89b6-46c839ffb6bb tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:42:33.193676 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b83b33e5-7114-4b55-89b6-46c839ffb6bb tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:42:33.194170 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b83b33e5-7114-4b55-89b6-46c839ffb6bb tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:42:33.194624 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b83b33e5-7114-4b55-89b6-46c839ffb6bb tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:42:33.330128 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-b83b33e5-7114-4b55-89b6-46c839ffb6bb tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8cc619b5f742a3a2849d2d424082cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9165c14330434ba951ad616b3f76ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:42:33.338006 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-b83b33e5-7114-4b55-89b6-46c839ffb6bb tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] 10.222.0.26 "GET /compute/v2.1/servers/016e35b1-b9d2-41c2-bce1-7689c7846f08" status: 200 len: 1514 microversion: 2.1 time: 0.158174 Oct 08 21:42:33.338588 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3190/6307] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:42:33 2022] GET /compute/v2.1/servers/016e35b1-b9d2-41c2-bce1-7689c7846f08 => generated 1514 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:42:34.361478 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-119ff6d5-9812-4170-b5cb-af48c43b38d2 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:42:34.362125 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-119ff6d5-9812-4170-b5cb-af48c43b38d2 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] [instance: 016e35b1-b9d2-41c2-bce1-7689c7846f08] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:42:34.369047 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-119ff6d5-9812-4170-b5cb-af48c43b38d2 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:42:34.369569 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-119ff6d5-9812-4170-b5cb-af48c43b38d2 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:42:34.370009 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-119ff6d5-9812-4170-b5cb-af48c43b38d2 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:42:34.370708 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-119ff6d5-9812-4170-b5cb-af48c43b38d2 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:42:34.371164 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-119ff6d5-9812-4170-b5cb-af48c43b38d2 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:42:34.371591 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-119ff6d5-9812-4170-b5cb-af48c43b38d2 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:42:34.501801 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-119ff6d5-9812-4170-b5cb-af48c43b38d2 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8cc619b5f742a3a2849d2d424082cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9165c14330434ba951ad616b3f76ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:42:34.509617 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-119ff6d5-9812-4170-b5cb-af48c43b38d2 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] 10.222.0.26 "GET /compute/v2.1/servers/016e35b1-b9d2-41c2-bce1-7689c7846f08" status: 200 len: 1514 microversion: 2.1 time: 0.152147 Oct 08 21:42:34.510197 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3118/6308] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:42:34 2022] GET /compute/v2.1/servers/016e35b1-b9d2-41c2-bce1-7689c7846f08 => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:42:35.533701 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-ca8a1778-5fc4-4126-904f-86dcc6fbe247 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:42:35.534337 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-ca8a1778-5fc4-4126-904f-86dcc6fbe247 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] [instance: 016e35b1-b9d2-41c2-bce1-7689c7846f08] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:42:35.541439 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ca8a1778-5fc4-4126-904f-86dcc6fbe247 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:42:35.541949 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ca8a1778-5fc4-4126-904f-86dcc6fbe247 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:42:35.542409 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ca8a1778-5fc4-4126-904f-86dcc6fbe247 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:42:35.543124 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ca8a1778-5fc4-4126-904f-86dcc6fbe247 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:42:35.543604 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ca8a1778-5fc4-4126-904f-86dcc6fbe247 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:42:35.544080 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ca8a1778-5fc4-4126-904f-86dcc6fbe247 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:42:35.672815 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-ca8a1778-5fc4-4126-904f-86dcc6fbe247 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8cc619b5f742a3a2849d2d424082cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9165c14330434ba951ad616b3f76ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:42:35.680616 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-ca8a1778-5fc4-4126-904f-86dcc6fbe247 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] 10.222.0.26 "GET /compute/v2.1/servers/016e35b1-b9d2-41c2-bce1-7689c7846f08" status: 200 len: 1514 microversion: 2.1 time: 0.151485 Oct 08 21:42:35.681205 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3191/6309] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:42:35 2022] GET /compute/v2.1/servers/016e35b1-b9d2-41c2-bce1-7689c7846f08 => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:42:36.703496 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-4e63874a-8ec3-4b8f-8f47-4edbe2d72dcb tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:42:36.704144 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-4e63874a-8ec3-4b8f-8f47-4edbe2d72dcb tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] [instance: 016e35b1-b9d2-41c2-bce1-7689c7846f08] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:42:36.711253 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4e63874a-8ec3-4b8f-8f47-4edbe2d72dcb tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:42:36.711742 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4e63874a-8ec3-4b8f-8f47-4edbe2d72dcb tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:42:36.712186 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4e63874a-8ec3-4b8f-8f47-4edbe2d72dcb tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:42:36.712886 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4e63874a-8ec3-4b8f-8f47-4edbe2d72dcb tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:42:36.713380 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4e63874a-8ec3-4b8f-8f47-4edbe2d72dcb tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:42:36.713812 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4e63874a-8ec3-4b8f-8f47-4edbe2d72dcb tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:42:36.843469 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-4e63874a-8ec3-4b8f-8f47-4edbe2d72dcb tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8cc619b5f742a3a2849d2d424082cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9165c14330434ba951ad616b3f76ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:42:36.851222 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-4e63874a-8ec3-4b8f-8f47-4edbe2d72dcb tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] 10.222.0.26 "GET /compute/v2.1/servers/016e35b1-b9d2-41c2-bce1-7689c7846f08" status: 200 len: 1514 microversion: 2.1 time: 0.151723 Oct 08 21:42:36.851787 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3119/6310] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:42:36 2022] GET /compute/v2.1/servers/016e35b1-b9d2-41c2-bce1-7689c7846f08 => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:42:37.875462 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-44644ebc-b472-4f24-88a7-b9aa1d1f07d6 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:42:37.876023 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-44644ebc-b472-4f24-88a7-b9aa1d1f07d6 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] [instance: 016e35b1-b9d2-41c2-bce1-7689c7846f08] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:42:37.883102 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-44644ebc-b472-4f24-88a7-b9aa1d1f07d6 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:42:37.883611 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-44644ebc-b472-4f24-88a7-b9aa1d1f07d6 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:42:37.884070 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-44644ebc-b472-4f24-88a7-b9aa1d1f07d6 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:42:37.884789 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-44644ebc-b472-4f24-88a7-b9aa1d1f07d6 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:42:37.885306 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-44644ebc-b472-4f24-88a7-b9aa1d1f07d6 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:42:37.885758 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-44644ebc-b472-4f24-88a7-b9aa1d1f07d6 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:42:38.013329 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-44644ebc-b472-4f24-88a7-b9aa1d1f07d6 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8cc619b5f742a3a2849d2d424082cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9165c14330434ba951ad616b3f76ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:42:38.021027 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-44644ebc-b472-4f24-88a7-b9aa1d1f07d6 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] 10.222.0.26 "GET /compute/v2.1/servers/016e35b1-b9d2-41c2-bce1-7689c7846f08" status: 200 len: 1514 microversion: 2.1 time: 0.150195 Oct 08 21:42:38.021642 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3192/6311] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:42:37 2022] GET /compute/v2.1/servers/016e35b1-b9d2-41c2-bce1-7689c7846f08 => generated 1514 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:42:39.043101 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-8e7342dd-8818-44b7-bdbd-206ab91222c9 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:42:39.043800 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-8e7342dd-8818-44b7-bdbd-206ab91222c9 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] [instance: 016e35b1-b9d2-41c2-bce1-7689c7846f08] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:42:39.051282 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8e7342dd-8818-44b7-bdbd-206ab91222c9 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:42:39.051806 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8e7342dd-8818-44b7-bdbd-206ab91222c9 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:42:39.052257 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8e7342dd-8818-44b7-bdbd-206ab91222c9 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:42:39.052968 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8e7342dd-8818-44b7-bdbd-206ab91222c9 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:42:39.053460 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8e7342dd-8818-44b7-bdbd-206ab91222c9 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:42:39.053899 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8e7342dd-8818-44b7-bdbd-206ab91222c9 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:42:39.186123 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-8e7342dd-8818-44b7-bdbd-206ab91222c9 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8cc619b5f742a3a2849d2d424082cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9165c14330434ba951ad616b3f76ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:42:39.194009 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-8e7342dd-8818-44b7-bdbd-206ab91222c9 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] 10.222.0.26 "GET /compute/v2.1/servers/016e35b1-b9d2-41c2-bce1-7689c7846f08" status: 200 len: 1514 microversion: 2.1 time: 0.154896 Oct 08 21:42:39.194582 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3120/6312] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:42:39 2022] GET /compute/v2.1/servers/016e35b1-b9d2-41c2-bce1-7689c7846f08 => generated 1514 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:42:40.219266 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-cc1d4d43-5476-428a-af38-03d9d2078041 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:42:40.219899 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-cc1d4d43-5476-428a-af38-03d9d2078041 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] [instance: 016e35b1-b9d2-41c2-bce1-7689c7846f08] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:42:40.226803 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cc1d4d43-5476-428a-af38-03d9d2078041 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:42:40.227309 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cc1d4d43-5476-428a-af38-03d9d2078041 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:42:40.227760 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cc1d4d43-5476-428a-af38-03d9d2078041 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:42:40.228498 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cc1d4d43-5476-428a-af38-03d9d2078041 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:42:40.228970 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cc1d4d43-5476-428a-af38-03d9d2078041 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:42:40.229455 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cc1d4d43-5476-428a-af38-03d9d2078041 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:42:40.365733 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-cc1d4d43-5476-428a-af38-03d9d2078041 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8cc619b5f742a3a2849d2d424082cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9165c14330434ba951ad616b3f76ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:42:40.374110 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-cc1d4d43-5476-428a-af38-03d9d2078041 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] 10.222.0.26 "GET /compute/v2.1/servers/016e35b1-b9d2-41c2-bce1-7689c7846f08" status: 200 len: 1514 microversion: 2.1 time: 0.159824 Oct 08 21:42:40.374702 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3193/6313] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:42:40 2022] GET /compute/v2.1/servers/016e35b1-b9d2-41c2-bce1-7689c7846f08 => generated 1514 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:42:41.397494 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-a04e770e-b1b5-40e4-847f-1c26b5238d65 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:42:41.398113 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-a04e770e-b1b5-40e4-847f-1c26b5238d65 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] [instance: 016e35b1-b9d2-41c2-bce1-7689c7846f08] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:42:41.405382 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a04e770e-b1b5-40e4-847f-1c26b5238d65 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:42:41.405869 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a04e770e-b1b5-40e4-847f-1c26b5238d65 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:42:41.406309 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a04e770e-b1b5-40e4-847f-1c26b5238d65 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:42:41.407007 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a04e770e-b1b5-40e4-847f-1c26b5238d65 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:42:41.407462 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a04e770e-b1b5-40e4-847f-1c26b5238d65 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:42:41.407888 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a04e770e-b1b5-40e4-847f-1c26b5238d65 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:42:41.538784 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-a04e770e-b1b5-40e4-847f-1c26b5238d65 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8cc619b5f742a3a2849d2d424082cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9165c14330434ba951ad616b3f76ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:42:41.547563 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-a04e770e-b1b5-40e4-847f-1c26b5238d65 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] 10.222.0.26 "GET /compute/v2.1/servers/016e35b1-b9d2-41c2-bce1-7689c7846f08" status: 200 len: 1514 microversion: 2.1 time: 0.154021 Oct 08 21:42:41.548121 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3121/6314] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:42:41 2022] GET /compute/v2.1/servers/016e35b1-b9d2-41c2-bce1-7689c7846f08 => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:42:42.570972 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-cc32beec-6b20-4f6b-b3d2-569fbdfa6e0f tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:42:42.571791 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-cc32beec-6b20-4f6b-b3d2-569fbdfa6e0f tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] [instance: 016e35b1-b9d2-41c2-bce1-7689c7846f08] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:42:42.579266 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cc32beec-6b20-4f6b-b3d2-569fbdfa6e0f tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:42:42.579771 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cc32beec-6b20-4f6b-b3d2-569fbdfa6e0f tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:42:42.580232 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cc32beec-6b20-4f6b-b3d2-569fbdfa6e0f tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:42:42.580948 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cc32beec-6b20-4f6b-b3d2-569fbdfa6e0f tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:42:42.581454 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cc32beec-6b20-4f6b-b3d2-569fbdfa6e0f tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:42:42.581904 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cc32beec-6b20-4f6b-b3d2-569fbdfa6e0f tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:42:42.710727 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-cc32beec-6b20-4f6b-b3d2-569fbdfa6e0f tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8cc619b5f742a3a2849d2d424082cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9165c14330434ba951ad616b3f76ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:42:42.718534 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-cc32beec-6b20-4f6b-b3d2-569fbdfa6e0f tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] 10.222.0.26 "GET /compute/v2.1/servers/016e35b1-b9d2-41c2-bce1-7689c7846f08" status: 200 len: 1514 microversion: 2.1 time: 0.151566 Oct 08 21:42:42.719136 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3194/6315] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:42:42 2022] GET /compute/v2.1/servers/016e35b1-b9d2-41c2-bce1-7689c7846f08 => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:42:43.742298 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-23159388-9220-4b76-9a78-e2332a0a88a4 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:42:43.742846 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-23159388-9220-4b76-9a78-e2332a0a88a4 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] [instance: 016e35b1-b9d2-41c2-bce1-7689c7846f08] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:42:43.749806 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-23159388-9220-4b76-9a78-e2332a0a88a4 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:42:43.750305 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-23159388-9220-4b76-9a78-e2332a0a88a4 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:42:43.750759 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-23159388-9220-4b76-9a78-e2332a0a88a4 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:42:43.751470 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-23159388-9220-4b76-9a78-e2332a0a88a4 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:42:43.751937 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-23159388-9220-4b76-9a78-e2332a0a88a4 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:42:43.752378 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-23159388-9220-4b76-9a78-e2332a0a88a4 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:42:43.882994 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-23159388-9220-4b76-9a78-e2332a0a88a4 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8cc619b5f742a3a2849d2d424082cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9165c14330434ba951ad616b3f76ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:42:43.891380 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-23159388-9220-4b76-9a78-e2332a0a88a4 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] 10.222.0.26 "GET /compute/v2.1/servers/016e35b1-b9d2-41c2-bce1-7689c7846f08" status: 200 len: 1514 microversion: 2.1 time: 0.153111 Oct 08 21:42:43.891967 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3122/6316] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:42:43 2022] GET /compute/v2.1/servers/016e35b1-b9d2-41c2-bce1-7689c7846f08 => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:42:44.914729 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-1f553a06-8cf4-4a4f-b13b-821790244ed7 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:42:44.915360 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-1f553a06-8cf4-4a4f-b13b-821790244ed7 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] [instance: 016e35b1-b9d2-41c2-bce1-7689c7846f08] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:42:44.922341 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1f553a06-8cf4-4a4f-b13b-821790244ed7 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:42:44.922848 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1f553a06-8cf4-4a4f-b13b-821790244ed7 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:42:44.923305 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1f553a06-8cf4-4a4f-b13b-821790244ed7 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:42:44.924020 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1f553a06-8cf4-4a4f-b13b-821790244ed7 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:42:44.924501 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1f553a06-8cf4-4a4f-b13b-821790244ed7 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:42:44.924948 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1f553a06-8cf4-4a4f-b13b-821790244ed7 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:42:45.056020 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-1f553a06-8cf4-4a4f-b13b-821790244ed7 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8cc619b5f742a3a2849d2d424082cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9165c14330434ba951ad616b3f76ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:42:45.064427 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-1f553a06-8cf4-4a4f-b13b-821790244ed7 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] 10.222.0.26 "GET /compute/v2.1/servers/016e35b1-b9d2-41c2-bce1-7689c7846f08" status: 200 len: 1514 microversion: 2.1 time: 0.153595 Oct 08 21:42:45.065000 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3195/6317] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:42:44 2022] GET /compute/v2.1/servers/016e35b1-b9d2-41c2-bce1-7689c7846f08 => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:42:46.088476 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-91feefa9-e957-40e1-9c3d-da02d3411774 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:42:46.089092 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-91feefa9-e957-40e1-9c3d-da02d3411774 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] [instance: 016e35b1-b9d2-41c2-bce1-7689c7846f08] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:42:46.096797 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-91feefa9-e957-40e1-9c3d-da02d3411774 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:42:46.097313 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-91feefa9-e957-40e1-9c3d-da02d3411774 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:42:46.097755 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-91feefa9-e957-40e1-9c3d-da02d3411774 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:42:46.098455 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-91feefa9-e957-40e1-9c3d-da02d3411774 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:42:46.098916 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-91feefa9-e957-40e1-9c3d-da02d3411774 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:42:46.099345 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-91feefa9-e957-40e1-9c3d-da02d3411774 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:42:46.230522 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-91feefa9-e957-40e1-9c3d-da02d3411774 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8cc619b5f742a3a2849d2d424082cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9165c14330434ba951ad616b3f76ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:42:46.238330 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-91feefa9-e957-40e1-9c3d-da02d3411774 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] 10.222.0.26 "GET /compute/v2.1/servers/016e35b1-b9d2-41c2-bce1-7689c7846f08" status: 200 len: 1514 microversion: 2.1 time: 0.153757 Oct 08 21:42:46.238911 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3123/6318] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:42:46 2022] GET /compute/v2.1/servers/016e35b1-b9d2-41c2-bce1-7689c7846f08 => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:42:47.261303 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e33ac0d0-6cb4-443f-8425-6e2c69306ea5 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:42:47.261933 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-e33ac0d0-6cb4-443f-8425-6e2c69306ea5 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] [instance: 016e35b1-b9d2-41c2-bce1-7689c7846f08] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:42:47.269604 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e33ac0d0-6cb4-443f-8425-6e2c69306ea5 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:42:47.270124 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e33ac0d0-6cb4-443f-8425-6e2c69306ea5 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:42:47.270576 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e33ac0d0-6cb4-443f-8425-6e2c69306ea5 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:42:47.271284 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e33ac0d0-6cb4-443f-8425-6e2c69306ea5 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:42:47.271761 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e33ac0d0-6cb4-443f-8425-6e2c69306ea5 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:42:47.272207 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e33ac0d0-6cb4-443f-8425-6e2c69306ea5 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:42:47.400945 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-e33ac0d0-6cb4-443f-8425-6e2c69306ea5 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8cc619b5f742a3a2849d2d424082cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9165c14330434ba951ad616b3f76ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:42:47.408771 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-e33ac0d0-6cb4-443f-8425-6e2c69306ea5 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] 10.222.0.26 "GET /compute/v2.1/servers/016e35b1-b9d2-41c2-bce1-7689c7846f08" status: 200 len: 1514 microversion: 2.1 time: 0.151434 Oct 08 21:42:47.409390 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3196/6319] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:42:47 2022] GET /compute/v2.1/servers/016e35b1-b9d2-41c2-bce1-7689c7846f08 => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:42:48.431665 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-668ad184-b767-4c58-8f8e-ce3d2abc7ff9 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:42:48.432292 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-668ad184-b767-4c58-8f8e-ce3d2abc7ff9 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] [instance: 016e35b1-b9d2-41c2-bce1-7689c7846f08] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:42:48.439397 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-668ad184-b767-4c58-8f8e-ce3d2abc7ff9 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:42:48.439893 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-668ad184-b767-4c58-8f8e-ce3d2abc7ff9 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:42:48.440342 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-668ad184-b767-4c58-8f8e-ce3d2abc7ff9 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:42:48.441057 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-668ad184-b767-4c58-8f8e-ce3d2abc7ff9 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:42:48.441568 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-668ad184-b767-4c58-8f8e-ce3d2abc7ff9 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:42:48.442009 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-668ad184-b767-4c58-8f8e-ce3d2abc7ff9 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:42:48.574223 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-668ad184-b767-4c58-8f8e-ce3d2abc7ff9 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8cc619b5f742a3a2849d2d424082cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9165c14330434ba951ad616b3f76ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:42:48.582532 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-668ad184-b767-4c58-8f8e-ce3d2abc7ff9 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] 10.222.0.26 "GET /compute/v2.1/servers/016e35b1-b9d2-41c2-bce1-7689c7846f08" status: 200 len: 1514 microversion: 2.1 time: 0.154853 Oct 08 21:42:48.583099 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3124/6320] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:42:48 2022] GET /compute/v2.1/servers/016e35b1-b9d2-41c2-bce1-7689c7846f08 => generated 1514 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:42:49.605816 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-34095593-b815-48d0-a3a6-1d4d5aadda0b tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:42:49.606484 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-34095593-b815-48d0-a3a6-1d4d5aadda0b tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] [instance: 016e35b1-b9d2-41c2-bce1-7689c7846f08] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:42:49.614071 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-34095593-b815-48d0-a3a6-1d4d5aadda0b tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:42:49.614581 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-34095593-b815-48d0-a3a6-1d4d5aadda0b tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:42:49.615048 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-34095593-b815-48d0-a3a6-1d4d5aadda0b tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:42:49.615773 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-34095593-b815-48d0-a3a6-1d4d5aadda0b tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:42:49.616321 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-34095593-b815-48d0-a3a6-1d4d5aadda0b tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:42:49.616730 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-34095593-b815-48d0-a3a6-1d4d5aadda0b tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:42:49.747827 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-34095593-b815-48d0-a3a6-1d4d5aadda0b tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8cc619b5f742a3a2849d2d424082cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9165c14330434ba951ad616b3f76ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:42:49.755663 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-34095593-b815-48d0-a3a6-1d4d5aadda0b tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] 10.222.0.26 "GET /compute/v2.1/servers/016e35b1-b9d2-41c2-bce1-7689c7846f08" status: 200 len: 1514 microversion: 2.1 time: 0.153773 Oct 08 21:42:49.756237 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3197/6321] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:42:49 2022] GET /compute/v2.1/servers/016e35b1-b9d2-41c2-bce1-7689c7846f08 => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:42:50.779023 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c227396d-b26a-42b1-bc82-29eaac2055fe tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:42:50.779641 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-c227396d-b26a-42b1-bc82-29eaac2055fe tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] [instance: 016e35b1-b9d2-41c2-bce1-7689c7846f08] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:42:50.786521 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c227396d-b26a-42b1-bc82-29eaac2055fe tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:42:50.787011 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c227396d-b26a-42b1-bc82-29eaac2055fe tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:42:50.787452 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c227396d-b26a-42b1-bc82-29eaac2055fe tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:42:50.788148 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c227396d-b26a-42b1-bc82-29eaac2055fe tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:42:50.788606 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c227396d-b26a-42b1-bc82-29eaac2055fe tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:42:50.789034 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c227396d-b26a-42b1-bc82-29eaac2055fe tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:42:50.918628 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-c227396d-b26a-42b1-bc82-29eaac2055fe tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8cc619b5f742a3a2849d2d424082cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9165c14330434ba951ad616b3f76ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:42:50.926975 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-c227396d-b26a-42b1-bc82-29eaac2055fe tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] 10.222.0.26 "GET /compute/v2.1/servers/016e35b1-b9d2-41c2-bce1-7689c7846f08" status: 200 len: 1514 microversion: 2.1 time: 0.151896 Oct 08 21:42:50.927550 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3125/6322] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:42:50 2022] GET /compute/v2.1/servers/016e35b1-b9d2-41c2-bce1-7689c7846f08 => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:42:51.950035 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-ecf57d40-01f5-4bd7-811f-9ac99d2e808c tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:42:51.951193 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-ecf57d40-01f5-4bd7-811f-9ac99d2e808c tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] [instance: 016e35b1-b9d2-41c2-bce1-7689c7846f08] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:42:51.958128 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ecf57d40-01f5-4bd7-811f-9ac99d2e808c tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:42:51.958632 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ecf57d40-01f5-4bd7-811f-9ac99d2e808c tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:42:51.959087 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ecf57d40-01f5-4bd7-811f-9ac99d2e808c tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:42:51.959801 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ecf57d40-01f5-4bd7-811f-9ac99d2e808c tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:42:51.960276 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ecf57d40-01f5-4bd7-811f-9ac99d2e808c tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:42:51.960720 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ecf57d40-01f5-4bd7-811f-9ac99d2e808c tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:42:52.088844 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-ecf57d40-01f5-4bd7-811f-9ac99d2e808c tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8cc619b5f742a3a2849d2d424082cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9165c14330434ba951ad616b3f76ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:42:52.097121 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-ecf57d40-01f5-4bd7-811f-9ac99d2e808c tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] 10.222.0.26 "GET /compute/v2.1/servers/016e35b1-b9d2-41c2-bce1-7689c7846f08" status: 200 len: 1514 microversion: 2.1 time: 0.151284 Oct 08 21:42:52.097727 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3198/6323] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:42:51 2022] GET /compute/v2.1/servers/016e35b1-b9d2-41c2-bce1-7689c7846f08 => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:42:53.119984 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-b914cab2-9189-4aaa-aef1-01fa8091bd8c tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:42:53.120610 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-b914cab2-9189-4aaa-aef1-01fa8091bd8c tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] [instance: 016e35b1-b9d2-41c2-bce1-7689c7846f08] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:42:53.128108 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b914cab2-9189-4aaa-aef1-01fa8091bd8c tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:42:53.128607 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b914cab2-9189-4aaa-aef1-01fa8091bd8c tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:42:53.129058 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b914cab2-9189-4aaa-aef1-01fa8091bd8c tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:42:53.129796 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b914cab2-9189-4aaa-aef1-01fa8091bd8c tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:42:53.130264 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b914cab2-9189-4aaa-aef1-01fa8091bd8c tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:42:53.130700 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b914cab2-9189-4aaa-aef1-01fa8091bd8c tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:42:53.260242 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-b914cab2-9189-4aaa-aef1-01fa8091bd8c tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8cc619b5f742a3a2849d2d424082cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9165c14330434ba951ad616b3f76ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:42:53.268844 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-b914cab2-9189-4aaa-aef1-01fa8091bd8c tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] 10.222.0.26 "GET /compute/v2.1/servers/016e35b1-b9d2-41c2-bce1-7689c7846f08" status: 200 len: 1514 microversion: 2.1 time: 0.152740 Oct 08 21:42:53.269456 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3126/6324] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:42:53 2022] GET /compute/v2.1/servers/016e35b1-b9d2-41c2-bce1-7689c7846f08 => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:42:54.291773 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-db07fb1f-a02d-4565-a24d-ad9a164cf809 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:42:54.292476 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-db07fb1f-a02d-4565-a24d-ad9a164cf809 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] [instance: 016e35b1-b9d2-41c2-bce1-7689c7846f08] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:42:54.295747 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=34 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:42:54.302448 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-db07fb1f-a02d-4565-a24d-ad9a164cf809 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:42:54.302980 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-db07fb1f-a02d-4565-a24d-ad9a164cf809 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:42:54.303452 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-db07fb1f-a02d-4565-a24d-ad9a164cf809 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:42:54.304201 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-db07fb1f-a02d-4565-a24d-ad9a164cf809 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:42:54.304689 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-db07fb1f-a02d-4565-a24d-ad9a164cf809 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:42:54.305144 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-db07fb1f-a02d-4565-a24d-ad9a164cf809 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:42:54.310689 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:42:54.522191 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-db07fb1f-a02d-4565-a24d-ad9a164cf809 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8cc619b5f742a3a2849d2d424082cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9165c14330434ba951ad616b3f76ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:42:54.530097 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-db07fb1f-a02d-4565-a24d-ad9a164cf809 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] 10.222.0.26 "GET /compute/v2.1/servers/016e35b1-b9d2-41c2-bce1-7689c7846f08" status: 200 len: 1513 microversion: 2.1 time: 0.242255 Oct 08 21:42:54.530701 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3199/6325] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:42:54 2022] GET /compute/v2.1/servers/016e35b1-b9d2-41c2-bce1-7689c7846f08 => generated 1513 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:42:54.580300 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-a209429f-7d56-4166-8ae2-9ed228afa324 req-fbed425b-e2f7-4797-9ecd-98bb809379ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "016e35b1-b9d2-41c2-bce1-7689c7846f08", "name": "network-vif-unplugged", "status": "completed", "tag": "0b92e1d9-17d9-41ef-ac59-f7d96ff07efd"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:42:54.591402 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-a209429f-7d56-4166-8ae2-9ed228afa324 req-fbed425b-e2f7-4797-9ecd-98bb809379ca service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:42:54.591997 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-a209429f-7d56-4166-8ae2-9ed228afa324 req-fbed425b-e2f7-4797-9ecd-98bb809379ca service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:42:54.592440 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-a209429f-7d56-4166-8ae2-9ed228afa324 req-fbed425b-e2f7-4797-9ecd-98bb809379ca service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:42:54.604311 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-a209429f-7d56-4166-8ae2-9ed228afa324 req-fbed425b-e2f7-4797-9ecd-98bb809379ca service nova] Creating event network-vif-unplugged:0b92e1d9-17d9-41ef-ac59-f7d96ff07efd for instance 016e35b1-b9d2-41c2-bce1-7689c7846f08 on nch2-master-1 Oct 08 21:42:54.610928 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [req-a209429f-7d56-4166-8ae2-9ed228afa324 req-fbed425b-e2f7-4797-9ecd-98bb809379ca service nova] Instance 016e35b1-b9d2-41c2-bce1-7689c7846f08 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140491) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 08 21:42:54.622583 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-a209429f-7d56-4166-8ae2-9ed228afa324 req-fbed425b-e2f7-4797-9ecd-98bb809379ca service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045994 Oct 08 21:42:54.623270 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3127/6326] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:42:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 08 21:42:55.554208 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-5e687fe8-bffd-4250-98f8-5203e3791a71 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:42:55.554875 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-5e687fe8-bffd-4250-98f8-5203e3791a71 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] [instance: 016e35b1-b9d2-41c2-bce1-7689c7846f08] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:42:55.562292 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5e687fe8-bffd-4250-98f8-5203e3791a71 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:42:55.562797 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5e687fe8-bffd-4250-98f8-5203e3791a71 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:42:55.563255 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5e687fe8-bffd-4250-98f8-5203e3791a71 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:42:55.563967 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5e687fe8-bffd-4250-98f8-5203e3791a71 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:42:55.564444 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5e687fe8-bffd-4250-98f8-5203e3791a71 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:42:55.565002 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5e687fe8-bffd-4250-98f8-5203e3791a71 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:42:55.696617 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-5e687fe8-bffd-4250-98f8-5203e3791a71 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8cc619b5f742a3a2849d2d424082cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9165c14330434ba951ad616b3f76ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:42:55.704970 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-5e687fe8-bffd-4250-98f8-5203e3791a71 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] 10.222.0.26 "GET /compute/v2.1/servers/016e35b1-b9d2-41c2-bce1-7689c7846f08" status: 200 len: 1511 microversion: 2.1 time: 0.154711 Oct 08 21:42:55.705580 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3200/6327] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:42:55 2022] GET /compute/v2.1/servers/016e35b1-b9d2-41c2-bce1-7689c7846f08 => generated 1511 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:42:56.649923 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-b800a0a3-0c5f-4fdc-b4e9-37a45f1143e1 req-4b291457-7454-49b8-b85c-f3a4d648a7b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "016e35b1-b9d2-41c2-bce1-7689c7846f08", "tag": "0b92e1d9-17d9-41ef-ac59-f7d96ff07efd"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:42:56.655453 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:SELECT=32 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:42:56.661505 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-b800a0a3-0c5f-4fdc-b4e9-37a45f1143e1 req-4b291457-7454-49b8-b85c-f3a4d648a7b5 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:42:56.661985 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-b800a0a3-0c5f-4fdc-b4e9-37a45f1143e1 req-4b291457-7454-49b8-b85c-f3a4d648a7b5 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:42:56.662421 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-b800a0a3-0c5f-4fdc-b4e9-37a45f1143e1 req-4b291457-7454-49b8-b85c-f3a4d648a7b5 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:42:56.666283 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=90 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:42:56.674706 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-b800a0a3-0c5f-4fdc-b4e9-37a45f1143e1 req-4b291457-7454-49b8-b85c-f3a4d648a7b5 service nova] Creating event network-changed:0b92e1d9-17d9-41ef-ac59-f7d96ff07efd for instance 016e35b1-b9d2-41c2-bce1-7689c7846f08 on nch2-master-1 Oct 08 21:42:56.679958 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [req-b800a0a3-0c5f-4fdc-b4e9-37a45f1143e1 req-4b291457-7454-49b8-b85c-f3a4d648a7b5 service nova] Instance 016e35b1-b9d2-41c2-bce1-7689c7846f08 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140491) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 08 21:42:56.690705 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-b800a0a3-0c5f-4fdc-b4e9-37a45f1143e1 req-4b291457-7454-49b8-b85c-f3a4d648a7b5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045947 Oct 08 21:42:56.691306 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3128/6328] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:42:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:42:56.727987 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-6181054e-c313-441a-a6c7-a8011706f2af tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:42:56.728624 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-6181054e-c313-441a-a6c7-a8011706f2af tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] [instance: 016e35b1-b9d2-41c2-bce1-7689c7846f08] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:42:56.735891 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6181054e-c313-441a-a6c7-a8011706f2af tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:42:56.736424 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6181054e-c313-441a-a6c7-a8011706f2af tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:42:56.736861 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6181054e-c313-441a-a6c7-a8011706f2af tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:42:56.737805 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6181054e-c313-441a-a6c7-a8011706f2af tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:42:56.738568 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6181054e-c313-441a-a6c7-a8011706f2af tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:42:56.739075 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6181054e-c313-441a-a6c7-a8011706f2af tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:42:56.971252 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-6181054e-c313-441a-a6c7-a8011706f2af tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8cc619b5f742a3a2849d2d424082cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9165c14330434ba951ad616b3f76ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:42:56.980598 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-6181054e-c313-441a-a6c7-a8011706f2af tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] 10.222.0.26 "GET /compute/v2.1/servers/016e35b1-b9d2-41c2-bce1-7689c7846f08" status: 200 len: 1511 microversion: 2.1 time: 0.256497 Oct 08 21:42:56.991619 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3201/6329] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:42:56 2022] GET /compute/v2.1/servers/016e35b1-b9d2-41c2-bce1-7689c7846f08 => generated 1511 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:42:58.005525 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-016a658e-7a6a-4f18-8e23-a972094bd891 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:42:58.006210 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-016a658e-7a6a-4f18-8e23-a972094bd891 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] [instance: 016e35b1-b9d2-41c2-bce1-7689c7846f08] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:42:58.012430 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-016a658e-7a6a-4f18-8e23-a972094bd891 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:42:58.013471 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-016a658e-7a6a-4f18-8e23-a972094bd891 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:42:58.013922 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-016a658e-7a6a-4f18-8e23-a972094bd891 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:42:58.014624 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-016a658e-7a6a-4f18-8e23-a972094bd891 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:42:58.015092 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-016a658e-7a6a-4f18-8e23-a972094bd891 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:42:58.015526 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-016a658e-7a6a-4f18-8e23-a972094bd891 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:42:58.146315 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-016a658e-7a6a-4f18-8e23-a972094bd891 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8cc619b5f742a3a2849d2d424082cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9165c14330434ba951ad616b3f76ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:42:58.154686 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-016a658e-7a6a-4f18-8e23-a972094bd891 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] 10.222.0.26 "GET /compute/v2.1/servers/016e35b1-b9d2-41c2-bce1-7689c7846f08" status: 200 len: 1508 microversion: 2.1 time: 0.154466 Oct 08 21:42:58.155268 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3129/6330] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:42:57 2022] GET /compute/v2.1/servers/016e35b1-b9d2-41c2-bce1-7689c7846f08 => generated 1508 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:42:58.176689 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-9f52f9aa-ad3c-4adc-8f62-cc92f0e5f33b tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:42:58.177238 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-9f52f9aa-ad3c-4adc-8f62-cc92f0e5f33b tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] [instance: 016e35b1-b9d2-41c2-bce1-7689c7846f08] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:42:58.183321 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9f52f9aa-ad3c-4adc-8f62-cc92f0e5f33b tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:42:58.183834 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9f52f9aa-ad3c-4adc-8f62-cc92f0e5f33b tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:42:58.184296 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9f52f9aa-ad3c-4adc-8f62-cc92f0e5f33b tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:42:58.185023 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9f52f9aa-ad3c-4adc-8f62-cc92f0e5f33b tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:42:58.185532 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9f52f9aa-ad3c-4adc-8f62-cc92f0e5f33b tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:42:58.185982 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9f52f9aa-ad3c-4adc-8f62-cc92f0e5f33b tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:42:58.212687 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-9f52f9aa-ad3c-4adc-8f62-cc92f0e5f33b tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] [instance: 016e35b1-b9d2-41c2-bce1-7689c7846f08] Going to try to terminate instance {{(pid=140492) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 21:42:58.264871 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.compute.api [None req-9f52f9aa-ad3c-4adc-8f62-cc92f0e5f33b tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] [instance: 016e35b1-b9d2-41c2-bce1-7689c7846f08] Found an unconfirmed migration during delete, id: 16, status: finished Oct 08 21:42:59.801056 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-9f52f9aa-ad3c-4adc-8f62-cc92f0e5f33b tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] 10.222.0.26 "DELETE /compute/v2.1/servers/016e35b1-b9d2-41c2-bce1-7689c7846f08" status: 204 len: 0 microversion: 2.1 time: 1.627987 Oct 08 21:42:59.802104 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3202/6331] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:42:58 2022] DELETE /compute/v2.1/servers/016e35b1-b9d2-41c2-bce1-7689c7846f08 => generated 0 bytes in 1630 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 21:42:59.811681 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-6c126cc6-3efc-47c4-a0b5-ceb1c93b5fa6 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:42:59.812297 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-6c126cc6-3efc-47c4-a0b5-ceb1c93b5fa6 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] [instance: 016e35b1-b9d2-41c2-bce1-7689c7846f08] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:42:59.819256 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6c126cc6-3efc-47c4-a0b5-ceb1c93b5fa6 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:42:59.819740 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6c126cc6-3efc-47c4-a0b5-ceb1c93b5fa6 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:42:59.820180 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6c126cc6-3efc-47c4-a0b5-ceb1c93b5fa6 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:42:59.821138 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6c126cc6-3efc-47c4-a0b5-ceb1c93b5fa6 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:42:59.821633 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6c126cc6-3efc-47c4-a0b5-ceb1c93b5fa6 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:42:59.822063 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6c126cc6-3efc-47c4-a0b5-ceb1c93b5fa6 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:42:59.900046 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-12755f09-3918-4bac-9c40-5bf184c791a8 req-0757b946-4996-44aa-bd76-5786b6d6aa97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "016e35b1-b9d2-41c2-bce1-7689c7846f08", "name": "network-vif-plugged", "status": "completed", "tag": "0b92e1d9-17d9-41ef-ac59-f7d96ff07efd"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:42:59.910277 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-12755f09-3918-4bac-9c40-5bf184c791a8 req-0757b946-4996-44aa-bd76-5786b6d6aa97 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:42:59.910784 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-12755f09-3918-4bac-9c40-5bf184c791a8 req-0757b946-4996-44aa-bd76-5786b6d6aa97 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:42:59.911228 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-12755f09-3918-4bac-9c40-5bf184c791a8 req-0757b946-4996-44aa-bd76-5786b6d6aa97 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:42:59.926560 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-12755f09-3918-4bac-9c40-5bf184c791a8 req-0757b946-4996-44aa-bd76-5786b6d6aa97 service nova] Creating event network-vif-plugged:0b92e1d9-17d9-41ef-ac59-f7d96ff07efd for instance 016e35b1-b9d2-41c2-bce1-7689c7846f08 on nch2-master-1 Oct 08 21:42:59.931878 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-12755f09-3918-4bac-9c40-5bf184c791a8 req-0757b946-4996-44aa-bd76-5786b6d6aa97 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035832 Oct 08 21:42:59.932799 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3203/6332] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:42:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 08 21:42:59.959828 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-6c126cc6-3efc-47c4-a0b5-ceb1c93b5fa6 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8cc619b5f742a3a2849d2d424082cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9165c14330434ba951ad616b3f76ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:42:59.968435 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-6c126cc6-3efc-47c4-a0b5-ceb1c93b5fa6 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] 10.222.0.26 "GET /compute/v2.1/servers/016e35b1-b9d2-41c2-bce1-7689c7846f08" status: 200 len: 1500 microversion: 2.1 time: 0.162084 Oct 08 21:42:59.969023 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3130/6333] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:42:59 2022] GET /compute/v2.1/servers/016e35b1-b9d2-41c2-bce1-7689c7846f08 => generated 1500 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:43:00.991861 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-4a809238-3f6c-4042-850e-68c8263c98a8 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:43:00.992589 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-4a809238-3f6c-4042-850e-68c8263c98a8 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] [instance: 016e35b1-b9d2-41c2-bce1-7689c7846f08] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:43:01.000355 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4a809238-3f6c-4042-850e-68c8263c98a8 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:43:01.000858 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4a809238-3f6c-4042-850e-68c8263c98a8 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:43:01.001350 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4a809238-3f6c-4042-850e-68c8263c98a8 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:43:01.002056 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4a809238-3f6c-4042-850e-68c8263c98a8 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:43:01.002529 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4a809238-3f6c-4042-850e-68c8263c98a8 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:43:01.002975 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4a809238-3f6c-4042-850e-68c8263c98a8 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:43:01.223798 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-4a809238-3f6c-4042-850e-68c8263c98a8 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8cc619b5f742a3a2849d2d424082cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9165c14330434ba951ad616b3f76ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:43:01.232210 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-4a809238-3f6c-4042-850e-68c8263c98a8 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] 10.222.0.26 "GET /compute/v2.1/servers/016e35b1-b9d2-41c2-bce1-7689c7846f08" status: 200 len: 1500 microversion: 2.1 time: 0.243980 Oct 08 21:43:01.232797 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3204/6334] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:43:00 2022] GET /compute/v2.1/servers/016e35b1-b9d2-41c2-bce1-7689c7846f08 => generated 1500 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:43:01.556284 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-31099f8c-7548-469e-b842-0e53aac4c269 req-3156a545-9ec9-4ef6-a29e-055b9d2d03ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "016e35b1-b9d2-41c2-bce1-7689c7846f08", "name": "network-vif-deleted", "tag": "0b92e1d9-17d9-41ef-ac59-f7d96ff07efd"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:43:01.567708 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-31099f8c-7548-469e-b842-0e53aac4c269 req-3156a545-9ec9-4ef6-a29e-055b9d2d03ce service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:43:01.568194 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-31099f8c-7548-469e-b842-0e53aac4c269 req-3156a545-9ec9-4ef6-a29e-055b9d2d03ce service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:43:01.568649 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-31099f8c-7548-469e-b842-0e53aac4c269 req-3156a545-9ec9-4ef6-a29e-055b9d2d03ce service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:43:01.581338 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-31099f8c-7548-469e-b842-0e53aac4c269 req-3156a545-9ec9-4ef6-a29e-055b9d2d03ce service nova] Creating event network-vif-deleted:0b92e1d9-17d9-41ef-ac59-f7d96ff07efd for instance 016e35b1-b9d2-41c2-bce1-7689c7846f08 on nch2-master-1 Oct 08 21:43:01.586505 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-31099f8c-7548-469e-b842-0e53aac4c269 req-3156a545-9ec9-4ef6-a29e-055b9d2d03ce service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033939 Oct 08 21:43:01.587110 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3131/6335] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:43:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:43:02.255687 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-55b82f11-8da4-45d4-b086-5e526267e5f5 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:43:02.256316 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-55b82f11-8da4-45d4-b086-5e526267e5f5 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] [instance: 016e35b1-b9d2-41c2-bce1-7689c7846f08] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:43:02.263239 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-55b82f11-8da4-45d4-b086-5e526267e5f5 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:43:02.263743 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-55b82f11-8da4-45d4-b086-5e526267e5f5 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:43:02.264198 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-55b82f11-8da4-45d4-b086-5e526267e5f5 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:43:02.264912 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-55b82f11-8da4-45d4-b086-5e526267e5f5 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:43:02.265430 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-55b82f11-8da4-45d4-b086-5e526267e5f5 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:43:02.265873 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-55b82f11-8da4-45d4-b086-5e526267e5f5 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:43:02.279551 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-55b82f11-8da4-45d4-b086-5e526267e5f5 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] HTTP exception thrown: Instance 016e35b1-b9d2-41c2-bce1-7689c7846f08 could not be found. Oct 08 21:43:02.281175 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-55b82f11-8da4-45d4-b086-5e526267e5f5 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Request method failure captured: Oct 08 21:43:02.281175 ncdv-master-1 devstack@n-api.service[140492]: request: GET /compute/v2.1/servers/016e35b1-b9d2-41c2-bce1-7689c7846f08 HTTP/1.1 Oct 08 21:43:02.281175 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:43:02.281175 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:43:02.281175 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:43:02.281175 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 21:43:02.281175 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:43:02.281175 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:43:02.281175 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:43:02.281175 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:43:02.281175 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQe61DsSDlMFg0YcI-JcG1MMTx6nLYGNLLlYQwnQiWCEuRxy6OSEom5J7NrXbYhdffCKyPFhb9hV47RbhbNgxzRaOig7BDZM7nex8NtYIGj41hrQcXoTvdik_J-5IU6R4E5qo1OXYs0KLhgvahAqxnZfFjaWc6_8SHvCG7siRedOMdYk Oct 08 21:43:02.281175 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:43:02.281175 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:43:02.281175 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:43:02.281175 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:43:02.281175 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:43:02.281175 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:43:02.281175 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 1b9165c14330434ba951ad616b3f76ce Oct 08 21:43:02.281175 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-DeleteServersTestJSON-2081937791 Oct 08 21:43:02.281175 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:43:02.281175 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:43:02.281175 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1b9165c14330434ba951ad616b3f76ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1b9165c14330434ba951ad616b3f76ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1b9165c14330434ba951ad616b3f76ce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1b9165c14330434ba951ad616b3f76ce"}]}] Oct 08 21:43:02.281175 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-DeleteServersTestJSON-2081937791 Oct 08 21:43:02.281175 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 1b9165c14330434ba951ad616b3f76ce Oct 08 21:43:02.281175 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-DeleteServersTestJSON-2081937791 Oct 08 21:43:02.281175 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-DeleteServersTestJSON-2081937791-project Oct 08 21:43:02.281175 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:43:02.281175 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:43:02.281175 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 8a8cc619b5f742a3a2849d2d424082cb Oct 08 21:43:02.281175 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-DeleteServersTestJSON-2081937791-project Oct 08 21:43:02.281175 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 21:43:02.281175 ncdv-master-1 devstack@n-api.service[140492]: exception: Instance 016e35b1-b9d2-41c2-bce1-7689c7846f08 could not be found. Oct 08 21:43:02.281175 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': '016e35b1-b9d2-41c2-bce1-7689c7846f08'} Oct 08 21:43:02.281175 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:43:02.281175 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:43:02.281175 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:43:02.281175 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:43:02.281175 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:43:02.281175 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:43:02.281175 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:43:02.281175 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:43:02.281175 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:43:02.281175 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:43:02.281175 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 016e35b1-b9d2-41c2-bce1-7689c7846f08 could not be found. Oct 08 21:43:02.281175 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:43:02.281175 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:43:02.281175 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:43:02.281175 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:43:02.281175 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:43:02.281175 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:43:02.281175 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:43:02.281175 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:43:02.281175 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:43:02.281175 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:43:02.281175 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:43:02.281175 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:43:02.281175 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:43:02.281175 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:43:02.281175 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:43:02.281175 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:43:02.281175 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 016e35b1-b9d2-41c2-bce1-7689c7846f08 could not be found. Oct 08 21:43:02.281175 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:43:02.281175 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:43:02.281175 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:43:02.285606 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:43:02.285606 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:43:02.285606 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:43:02.285606 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:43:02.285606 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:43:02.285606 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 016e35b1-b9d2-41c2-bce1-7689c7846f08 could not be found. Oct 08 21:43:02.285606 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:43:02.285606 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-55b82f11-8da4-45d4-b086-5e526267e5f5 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Returning 404 to user: Instance 016e35b1-b9d2-41c2-bce1-7689c7846f08 could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:43:02.285606 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-55b82f11-8da4-45d4-b086-5e526267e5f5 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] 10.222.0.26 "GET /compute/v2.1/servers/016e35b1-b9d2-41c2-bce1-7689c7846f08" status: 404 len: 111 microversion: 2.1 time: 0.030842 Oct 08 21:43:02.285606 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3205/6336] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:43:02 2022] GET /compute/v2.1/servers/016e35b1-b9d2-41c2-bce1-7689c7846f08 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:43:02.298314 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-1296f9f8-5e0c-480c-bf8e-2a6813d5e628 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:43:02.298915 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-1296f9f8-5e0c-480c-bf8e-2a6813d5e628 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] [instance: 016e35b1-b9d2-41c2-bce1-7689c7846f08] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:43:02.305283 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1296f9f8-5e0c-480c-bf8e-2a6813d5e628 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:43:02.305781 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1296f9f8-5e0c-480c-bf8e-2a6813d5e628 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:43:02.306228 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1296f9f8-5e0c-480c-bf8e-2a6813d5e628 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:43:02.306932 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1296f9f8-5e0c-480c-bf8e-2a6813d5e628 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:43:02.307398 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1296f9f8-5e0c-480c-bf8e-2a6813d5e628 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:43:02.307834 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1296f9f8-5e0c-480c-bf8e-2a6813d5e628 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:43:02.321517 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-1296f9f8-5e0c-480c-bf8e-2a6813d5e628 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] HTTP exception thrown: Instance 016e35b1-b9d2-41c2-bce1-7689c7846f08 could not be found. Oct 08 21:43:02.323162 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-1296f9f8-5e0c-480c-bf8e-2a6813d5e628 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Request method failure captured: Oct 08 21:43:02.323162 ncdv-master-1 devstack@n-api.service[140491]: request: DELETE /compute/v2.1/servers/016e35b1-b9d2-41c2-bce1-7689c7846f08 HTTP/1.1 Oct 08 21:43:02.323162 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:43:02.323162 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:43:02.323162 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:43:02.323162 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 21:43:02.323162 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:43:02.323162 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:43:02.323162 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:43:02.323162 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:43:02.323162 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQe61DsSDlMFg0YcI-JcG1MMTx6nLYGNLLlYQwnQiWCEuRxy6OSEom5J7NrXbYhdffCKyPFhb9hV47RbhbNgxzRaOig7BDZM7nex8NtYIGj41hrQcXoTvdik_J-5IU6R4E5qo1OXYs0KLhgvahAqxnZfFjaWc6_8SHvCG7siRedOMdYk Oct 08 21:43:02.323162 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:43:02.323162 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:43:02.323162 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:43:02.323162 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:43:02.323162 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:43:02.323162 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:43:02.323162 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 1b9165c14330434ba951ad616b3f76ce Oct 08 21:43:02.323162 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-DeleteServersTestJSON-2081937791 Oct 08 21:43:02.323162 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:43:02.323162 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:43:02.323162 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1b9165c14330434ba951ad616b3f76ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1b9165c14330434ba951ad616b3f76ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1b9165c14330434ba951ad616b3f76ce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1b9165c14330434ba951ad616b3f76ce"}]}] Oct 08 21:43:02.323162 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-DeleteServersTestJSON-2081937791 Oct 08 21:43:02.323162 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 1b9165c14330434ba951ad616b3f76ce Oct 08 21:43:02.323162 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-DeleteServersTestJSON-2081937791 Oct 08 21:43:02.323162 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-DeleteServersTestJSON-2081937791-project Oct 08 21:43:02.323162 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:43:02.323162 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:43:02.323162 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 8a8cc619b5f742a3a2849d2d424082cb Oct 08 21:43:02.323162 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-DeleteServersTestJSON-2081937791-project Oct 08 21:43:02.323162 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:43:02.323162 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance 016e35b1-b9d2-41c2-bce1-7689c7846f08 could not be found. Oct 08 21:43:02.323162 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': '016e35b1-b9d2-41c2-bce1-7689c7846f08'} Oct 08 21:43:02.323162 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:43:02.323162 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:43:02.323162 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:43:02.323162 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:43:02.323162 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:43:02.323162 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:43:02.323162 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:43:02.323162 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:43:02.323162 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:43:02.323162 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:43:02.323162 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 016e35b1-b9d2-41c2-bce1-7689c7846f08 could not be found. Oct 08 21:43:02.323162 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:43:02.323162 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:43:02.323162 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:43:02.323162 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:43:02.323162 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:43:02.323162 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:43:02.323162 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:43:02.323162 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:43:02.323162 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:43:02.323162 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:43:02.323162 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 08 21:43:02.323162 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 08 21:43:02.323162 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 08 21:43:02.323162 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 08 21:43:02.323162 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:43:02.323162 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:43:02.323162 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:43:02.323162 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:43:02.326890 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 016e35b1-b9d2-41c2-bce1-7689c7846f08 could not be found. Oct 08 21:43:02.326890 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:43:02.326890 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:43:02.326890 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:43:02.326890 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:43:02.326890 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:43:02.326890 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:43:02.326890 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:43:02.326890 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:43:02.326890 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 016e35b1-b9d2-41c2-bce1-7689c7846f08 could not be found. Oct 08 21:43:02.326890 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:43:02.326890 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-1296f9f8-5e0c-480c-bf8e-2a6813d5e628 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Returning 404 to user: Instance 016e35b1-b9d2-41c2-bce1-7689c7846f08 could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:43:02.326890 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-1296f9f8-5e0c-480c-bf8e-2a6813d5e628 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] 10.222.0.26 "DELETE /compute/v2.1/servers/016e35b1-b9d2-41c2-bce1-7689c7846f08" status: 404 len: 111 microversion: 2.1 time: 0.031175 Oct 08 21:43:02.326890 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3132/6337] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:43:02 2022] DELETE /compute/v2.1/servers/016e35b1-b9d2-41c2-bce1-7689c7846f08 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:43:02.336852 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-4d0fbc7a-ee4a-4f8a-a164-0bdf8d2a1916 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:43:02.337521 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-4d0fbc7a-ee4a-4f8a-a164-0bdf8d2a1916 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] [instance: 016e35b1-b9d2-41c2-bce1-7689c7846f08] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:43:02.345220 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4d0fbc7a-ee4a-4f8a-a164-0bdf8d2a1916 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:43:02.345731 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4d0fbc7a-ee4a-4f8a-a164-0bdf8d2a1916 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:43:02.346190 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4d0fbc7a-ee4a-4f8a-a164-0bdf8d2a1916 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:43:02.346911 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4d0fbc7a-ee4a-4f8a-a164-0bdf8d2a1916 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:43:02.347385 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4d0fbc7a-ee4a-4f8a-a164-0bdf8d2a1916 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:43:02.347832 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4d0fbc7a-ee4a-4f8a-a164-0bdf8d2a1916 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:43:02.365380 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-4d0fbc7a-ee4a-4f8a-a164-0bdf8d2a1916 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] HTTP exception thrown: Instance 016e35b1-b9d2-41c2-bce1-7689c7846f08 could not be found. Oct 08 21:43:02.366925 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-4d0fbc7a-ee4a-4f8a-a164-0bdf8d2a1916 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Request method failure captured: Oct 08 21:43:02.366925 ncdv-master-1 devstack@n-api.service[140492]: request: GET /compute/v2.1/servers/016e35b1-b9d2-41c2-bce1-7689c7846f08 HTTP/1.1 Oct 08 21:43:02.366925 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:43:02.366925 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:43:02.366925 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:43:02.366925 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 21:43:02.366925 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:43:02.366925 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:43:02.366925 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:43:02.366925 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:43:02.366925 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQe61DsSDlMFg0YcI-JcG1MMTx6nLYGNLLlYQwnQiWCEuRxy6OSEom5J7NrXbYhdffCKyPFhb9hV47RbhbNgxzRaOig7BDZM7nex8NtYIGj41hrQcXoTvdik_J-5IU6R4E5qo1OXYs0KLhgvahAqxnZfFjaWc6_8SHvCG7siRedOMdYk Oct 08 21:43:02.366925 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:43:02.366925 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:43:02.366925 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:43:02.366925 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:43:02.366925 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:43:02.366925 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:43:02.366925 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 1b9165c14330434ba951ad616b3f76ce Oct 08 21:43:02.366925 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-DeleteServersTestJSON-2081937791 Oct 08 21:43:02.366925 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:43:02.366925 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:43:02.366925 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1b9165c14330434ba951ad616b3f76ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1b9165c14330434ba951ad616b3f76ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1b9165c14330434ba951ad616b3f76ce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1b9165c14330434ba951ad616b3f76ce"}]}] Oct 08 21:43:02.366925 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-DeleteServersTestJSON-2081937791 Oct 08 21:43:02.366925 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 1b9165c14330434ba951ad616b3f76ce Oct 08 21:43:02.366925 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-DeleteServersTestJSON-2081937791 Oct 08 21:43:02.366925 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-DeleteServersTestJSON-2081937791-project Oct 08 21:43:02.366925 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:43:02.366925 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:43:02.366925 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 8a8cc619b5f742a3a2849d2d424082cb Oct 08 21:43:02.366925 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-DeleteServersTestJSON-2081937791-project Oct 08 21:43:02.366925 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 21:43:02.366925 ncdv-master-1 devstack@n-api.service[140492]: exception: Instance 016e35b1-b9d2-41c2-bce1-7689c7846f08 could not be found. Oct 08 21:43:02.366925 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': '016e35b1-b9d2-41c2-bce1-7689c7846f08'} Oct 08 21:43:02.366925 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:43:02.366925 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:43:02.366925 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:43:02.366925 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:43:02.366925 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:43:02.366925 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:43:02.366925 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:43:02.366925 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:43:02.366925 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:43:02.366925 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:43:02.366925 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 016e35b1-b9d2-41c2-bce1-7689c7846f08 could not be found. Oct 08 21:43:02.366925 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:43:02.366925 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:43:02.366925 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:43:02.366925 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:43:02.366925 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:43:02.366925 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:43:02.366925 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:43:02.366925 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:43:02.366925 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:43:02.366925 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:43:02.366925 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:43:02.366925 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:43:02.366925 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:43:02.366925 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:43:02.366925 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:43:02.366925 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:43:02.366925 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 016e35b1-b9d2-41c2-bce1-7689c7846f08 could not be found. Oct 08 21:43:02.366925 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:43:02.366925 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:43:02.366925 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:43:02.371513 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:43:02.371513 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:43:02.371513 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:43:02.371513 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:43:02.371513 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:43:02.371513 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 016e35b1-b9d2-41c2-bce1-7689c7846f08 could not be found. Oct 08 21:43:02.371513 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:43:02.371513 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-4d0fbc7a-ee4a-4f8a-a164-0bdf8d2a1916 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] Returning 404 to user: Instance 016e35b1-b9d2-41c2-bce1-7689c7846f08 could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:43:02.371513 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-4d0fbc7a-ee4a-4f8a-a164-0bdf8d2a1916 tempest-DeleteServersTestJSON-2081937791 tempest-DeleteServersTestJSON-2081937791-project] 10.222.0.26 "GET /compute/v2.1/servers/016e35b1-b9d2-41c2-bce1-7689c7846f08" status: 404 len: 111 microversion: 2.1 time: 0.038999 Oct 08 21:43:02.371513 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3206/6338] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:43:02 2022] GET /compute/v2.1/servers/016e35b1-b9d2-41c2-bce1-7689c7846f08 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:43:10.986865 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-e3027935-3359-4559-8cf4-f5c05c64f667 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-872758500", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "networks": [{"uuid": "688af551-9106-4b92-beb8-062298ee01e4"}]}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:43:11.047333 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.network.neutron [None req-e3027935-3359-4559-8cf4-f5c05c64f667 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] validate_networks() for [('688af551-9106-4b92-beb8-062298ee01e4', None, None, None, None, None)] {{(pid=140491) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 21:43:11.428011 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-e3027935-3359-4559-8cf4-f5c05c64f667 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Flavor limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 21:43:11.428569 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-e3027935-3359-4559-8cf4-f5c05c64f667 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Image limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 21:43:11.429060 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-e3027935-3359-4559-8cf4-f5c05c64f667 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Flavor pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 21:43:11.429539 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-e3027935-3359-4559-8cf4-f5c05c64f667 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Image pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 21:43:11.429962 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-e3027935-3359-4559-8cf4-f5c05c64f667 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 21:43:11.441527 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e3027935-3359-4559-8cf4-f5c05c64f667 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:43:11.442251 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e3027935-3359-4559-8cf4-f5c05c64f667 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:43:11.442731 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e3027935-3359-4559-8cf4-f5c05c64f667 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:43:11.443475 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e3027935-3359-4559-8cf4-f5c05c64f667 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:43:11.443943 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e3027935-3359-4559-8cf4-f5c05c64f667 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:43:11.444380 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e3027935-3359-4559-8cf4-f5c05c64f667 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:43:11.466261 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-e3027935-3359-4559-8cf4-f5c05c64f667 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Getting quotas for project 1be36356ccbf4266819b18ca6cee6d97. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:43:11.471660 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-e3027935-3359-4559-8cf4-f5c05c64f667 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Getting quotas for user b2beee1a677a47b48dd244a12de6dac0 and project 1be36356ccbf4266819b18ca6cee6d97. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:43:11.484472 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-e3027935-3359-4559-8cf4-f5c05c64f667 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Going to run 1 instances... {{(pid=140491) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 21:43:11.486958 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-e3027935-3359-4559-8cf4-f5c05c64f667 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] [instance: a3f6deb2-34ba-4813-9c6c-433cfa3108c6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c508bd7f-7db9-4b2c-af7c-be54a855c355',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140491) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 21:43:11.532592 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-e3027935-3359-4559-8cf4-f5c05c64f667 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.672580 Oct 08 21:43:11.533283 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3133/6339] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 21:43:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 674 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 08 21:43:11.544757 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-a85c216f-b27a-4f55-8090-709c5d1e7345 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:43:11.545446 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-a85c216f-b27a-4f55-8090-709c5d1e7345 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] [instance: a3f6deb2-34ba-4813-9c6c-433cfa3108c6] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:43:11.600789 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-a85c216f-b27a-4f55-8090-709c5d1e7345 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2beee1a677a47b48dd244a12de6dac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be36356ccbf4266819b18ca6cee6d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:43:11.608409 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-a85c216f-b27a-4f55-8090-709c5d1e7345 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] 10.222.0.26 "GET /compute/v2.1/servers/a3f6deb2-34ba-4813-9c6c-433cfa3108c6" status: 200 len: 1217 microversion: 2.1 time: 0.067970 Oct 08 21:43:11.608985 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3207/6340] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:43:11 2022] GET /compute/v2.1/servers/a3f6deb2-34ba-4813-9c6c-433cfa3108c6 => generated 1217 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:43:12.632700 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-8e61b4eb-55da-442c-9f88-9c4719fa1bfa tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:43:12.636837 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-8e61b4eb-55da-442c-9f88-9c4719fa1bfa tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] [instance: a3f6deb2-34ba-4813-9c6c-433cfa3108c6] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:43:12.645941 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8e61b4eb-55da-442c-9f88-9c4719fa1bfa tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:43:12.646517 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8e61b4eb-55da-442c-9f88-9c4719fa1bfa tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:43:12.647036 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8e61b4eb-55da-442c-9f88-9c4719fa1bfa tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:43:12.647871 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8e61b4eb-55da-442c-9f88-9c4719fa1bfa tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:43:12.648422 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8e61b4eb-55da-442c-9f88-9c4719fa1bfa tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:43:12.648909 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8e61b4eb-55da-442c-9f88-9c4719fa1bfa tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:43:12.748448 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-8e61b4eb-55da-442c-9f88-9c4719fa1bfa tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2beee1a677a47b48dd244a12de6dac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be36356ccbf4266819b18ca6cee6d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:43:12.774589 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-8e61b4eb-55da-442c-9f88-9c4719fa1bfa tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] 10.222.0.26 "GET /compute/v2.1/servers/a3f6deb2-34ba-4813-9c6c-433cfa3108c6" status: 200 len: 1277 microversion: 2.1 time: 0.146652 Oct 08 21:43:12.787379 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3134/6341] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:43:12 2022] GET /compute/v2.1/servers/a3f6deb2-34ba-4813-9c6c-433cfa3108c6 => generated 1277 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:43:13.795430 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:43:13.800872 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-545fe739-d1cb-4505-9b2a-f6896a8e8597 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:43:13.801753 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-545fe739-d1cb-4505-9b2a-f6896a8e8597 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] [instance: a3f6deb2-34ba-4813-9c6c-433cfa3108c6] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:43:13.811057 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-545fe739-d1cb-4505-9b2a-f6896a8e8597 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:43:13.811578 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-545fe739-d1cb-4505-9b2a-f6896a8e8597 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:43:13.812243 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-545fe739-d1cb-4505-9b2a-f6896a8e8597 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:43:13.812984 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-545fe739-d1cb-4505-9b2a-f6896a8e8597 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:43:13.813675 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-545fe739-d1cb-4505-9b2a-f6896a8e8597 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:43:13.814135 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-545fe739-d1cb-4505-9b2a-f6896a8e8597 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:43:13.966633 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-545fe739-d1cb-4505-9b2a-f6896a8e8597 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2beee1a677a47b48dd244a12de6dac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be36356ccbf4266819b18ca6cee6d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:43:13.974865 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-545fe739-d1cb-4505-9b2a-f6896a8e8597 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] 10.222.0.26 "GET /compute/v2.1/servers/a3f6deb2-34ba-4813-9c6c-433cfa3108c6" status: 200 len: 1317 microversion: 2.1 time: 0.180275 Oct 08 21:43:13.975535 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3208/6342] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:43:13 2022] GET /compute/v2.1/servers/a3f6deb2-34ba-4813-9c6c-433cfa3108c6 => generated 1317 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:43:14.192754 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-5cd8d0b3-9487-49ca-91a1-3016580240dd req-59c90d06-6731-469f-97b5-e69fa96cee8b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3f6deb2-34ba-4813-9c6c-433cfa3108c6", "tag": "992c958b-e57c-4976-bbdb-f57c202f3723"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:43:14.204904 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-5cd8d0b3-9487-49ca-91a1-3016580240dd req-59c90d06-6731-469f-97b5-e69fa96cee8b service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:43:14.205506 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-5cd8d0b3-9487-49ca-91a1-3016580240dd req-59c90d06-6731-469f-97b5-e69fa96cee8b service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:43:14.206021 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-5cd8d0b3-9487-49ca-91a1-3016580240dd req-59c90d06-6731-469f-97b5-e69fa96cee8b service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:43:14.223942 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-5cd8d0b3-9487-49ca-91a1-3016580240dd req-59c90d06-6731-469f-97b5-e69fa96cee8b service nova] Creating event network-changed:992c958b-e57c-4976-bbdb-f57c202f3723 for instance a3f6deb2-34ba-4813-9c6c-433cfa3108c6 on nch1-master-1 Oct 08 21:43:14.229305 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-5cd8d0b3-9487-49ca-91a1-3016580240dd req-59c90d06-6731-469f-97b5-e69fa96cee8b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041408 Oct 08 21:43:14.230107 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3135/6343] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:43:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:43:14.999560 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-d796365b-30da-4ec5-8772-e13120e2d4e7 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:43:15.000193 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-d796365b-30da-4ec5-8772-e13120e2d4e7 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] [instance: a3f6deb2-34ba-4813-9c6c-433cfa3108c6] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:43:15.007113 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d796365b-30da-4ec5-8772-e13120e2d4e7 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:43:15.007622 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d796365b-30da-4ec5-8772-e13120e2d4e7 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:43:15.008082 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d796365b-30da-4ec5-8772-e13120e2d4e7 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:43:15.008789 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d796365b-30da-4ec5-8772-e13120e2d4e7 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:43:15.009288 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d796365b-30da-4ec5-8772-e13120e2d4e7 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:43:15.009734 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d796365b-30da-4ec5-8772-e13120e2d4e7 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:43:15.136386 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-d796365b-30da-4ec5-8772-e13120e2d4e7 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2beee1a677a47b48dd244a12de6dac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be36356ccbf4266819b18ca6cee6d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:43:15.144707 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-d796365b-30da-4ec5-8772-e13120e2d4e7 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] 10.222.0.26 "GET /compute/v2.1/servers/a3f6deb2-34ba-4813-9c6c-433cfa3108c6" status: 200 len: 1317 microversion: 2.1 time: 0.149529 Oct 08 21:43:15.145299 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3209/6344] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:43:14 2022] GET /compute/v2.1/servers/a3f6deb2-34ba-4813-9c6c-433cfa3108c6 => generated 1317 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:43:16.167854 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-8102622d-9092-4e20-8a77-0f90aed9767c tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:43:16.168580 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-8102622d-9092-4e20-8a77-0f90aed9767c tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] [instance: a3f6deb2-34ba-4813-9c6c-433cfa3108c6] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:43:16.174982 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8102622d-9092-4e20-8a77-0f90aed9767c tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:43:16.175468 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8102622d-9092-4e20-8a77-0f90aed9767c tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:43:16.175910 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8102622d-9092-4e20-8a77-0f90aed9767c tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:43:16.176608 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8102622d-9092-4e20-8a77-0f90aed9767c tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:43:16.177068 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8102622d-9092-4e20-8a77-0f90aed9767c tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:43:16.177530 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8102622d-9092-4e20-8a77-0f90aed9767c tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:43:16.309856 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-8102622d-9092-4e20-8a77-0f90aed9767c tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2beee1a677a47b48dd244a12de6dac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be36356ccbf4266819b18ca6cee6d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:43:16.318123 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-8102622d-9092-4e20-8a77-0f90aed9767c tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] 10.222.0.26 "GET /compute/v2.1/servers/a3f6deb2-34ba-4813-9c6c-433cfa3108c6" status: 200 len: 1317 microversion: 2.1 time: 0.155397 Oct 08 21:43:16.318693 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3136/6345] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:43:16 2022] GET /compute/v2.1/servers/a3f6deb2-34ba-4813-9c6c-433cfa3108c6 => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:43:17.341587 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-44d19217-a7da-4ae8-a0dc-103b766f44af tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:43:17.342337 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-44d19217-a7da-4ae8-a0dc-103b766f44af tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] [instance: a3f6deb2-34ba-4813-9c6c-433cfa3108c6] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:43:17.349333 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-44d19217-a7da-4ae8-a0dc-103b766f44af tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:43:17.349844 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-44d19217-a7da-4ae8-a0dc-103b766f44af tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:43:17.350304 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-44d19217-a7da-4ae8-a0dc-103b766f44af tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:43:17.351055 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-44d19217-a7da-4ae8-a0dc-103b766f44af tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:43:17.351535 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-44d19217-a7da-4ae8-a0dc-103b766f44af tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:43:17.351986 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-44d19217-a7da-4ae8-a0dc-103b766f44af tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:43:17.490008 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-44d19217-a7da-4ae8-a0dc-103b766f44af tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2beee1a677a47b48dd244a12de6dac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be36356ccbf4266819b18ca6cee6d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:43:17.497911 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-44d19217-a7da-4ae8-a0dc-103b766f44af tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] 10.222.0.26 "GET /compute/v2.1/servers/a3f6deb2-34ba-4813-9c6c-433cfa3108c6" status: 200 len: 1317 microversion: 2.1 time: 0.160275 Oct 08 21:43:17.499106 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3210/6346] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:43:17 2022] GET /compute/v2.1/servers/a3f6deb2-34ba-4813-9c6c-433cfa3108c6 => generated 1317 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:43:18.520415 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-726e03e0-04e7-4060-b969-5073f50a13fb tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:43:18.521034 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-726e03e0-04e7-4060-b969-5073f50a13fb tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] [instance: a3f6deb2-34ba-4813-9c6c-433cfa3108c6] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:43:18.528005 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-726e03e0-04e7-4060-b969-5073f50a13fb tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:43:18.528490 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-726e03e0-04e7-4060-b969-5073f50a13fb tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:43:18.528928 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-726e03e0-04e7-4060-b969-5073f50a13fb tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:43:18.530301 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-726e03e0-04e7-4060-b969-5073f50a13fb tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:43:18.531065 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-726e03e0-04e7-4060-b969-5073f50a13fb tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:43:18.531169 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-726e03e0-04e7-4060-b969-5073f50a13fb tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:43:18.659311 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-726e03e0-04e7-4060-b969-5073f50a13fb tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2beee1a677a47b48dd244a12de6dac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be36356ccbf4266819b18ca6cee6d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:43:18.666987 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-726e03e0-04e7-4060-b969-5073f50a13fb tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] 10.222.0.26 "GET /compute/v2.1/servers/a3f6deb2-34ba-4813-9c6c-433cfa3108c6" status: 200 len: 1317 microversion: 2.1 time: 0.150533 Oct 08 21:43:18.667561 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3137/6347] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:43:18 2022] GET /compute/v2.1/servers/a3f6deb2-34ba-4813-9c6c-433cfa3108c6 => generated 1317 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:43:19.050779 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-3a84b7ef-f621-4753-9cf6-f6e9533bb2ac req-dc32160f-f852-4ad7-b6b4-64d4ccf5a1b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3f6deb2-34ba-4813-9c6c-433cfa3108c6", "name": "network-vif-plugged", "status": "completed", "tag": "992c958b-e57c-4976-bbdb-f57c202f3723"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:43:19.062263 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-3a84b7ef-f621-4753-9cf6-f6e9533bb2ac req-dc32160f-f852-4ad7-b6b4-64d4ccf5a1b0 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:43:19.062767 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-3a84b7ef-f621-4753-9cf6-f6e9533bb2ac req-dc32160f-f852-4ad7-b6b4-64d4ccf5a1b0 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:43:19.063223 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-3a84b7ef-f621-4753-9cf6-f6e9533bb2ac req-dc32160f-f852-4ad7-b6b4-64d4ccf5a1b0 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:43:19.075019 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-3a84b7ef-f621-4753-9cf6-f6e9533bb2ac req-dc32160f-f852-4ad7-b6b4-64d4ccf5a1b0 service nova] Creating event network-vif-plugged:992c958b-e57c-4976-bbdb-f57c202f3723 for instance a3f6deb2-34ba-4813-9c6c-433cfa3108c6 on nch1-master-1 Oct 08 21:43:19.079913 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-3a84b7ef-f621-4753-9cf6-f6e9533bb2ac req-dc32160f-f852-4ad7-b6b4-64d4ccf5a1b0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032996 Oct 08 21:43:19.080568 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3211/6348] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:43:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 08 21:43:19.689601 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-4a145379-78fc-4d25-9311-be705beecc2b tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:43:19.690219 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-4a145379-78fc-4d25-9311-be705beecc2b tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] [instance: a3f6deb2-34ba-4813-9c6c-433cfa3108c6] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:43:19.697381 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4a145379-78fc-4d25-9311-be705beecc2b tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:43:19.697899 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4a145379-78fc-4d25-9311-be705beecc2b tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:43:19.698342 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4a145379-78fc-4d25-9311-be705beecc2b tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:43:19.699053 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4a145379-78fc-4d25-9311-be705beecc2b tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:43:19.699497 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4a145379-78fc-4d25-9311-be705beecc2b tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:43:19.699925 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4a145379-78fc-4d25-9311-be705beecc2b tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:43:19.836859 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-4a145379-78fc-4d25-9311-be705beecc2b tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2beee1a677a47b48dd244a12de6dac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be36356ccbf4266819b18ca6cee6d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:43:19.845307 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-4a145379-78fc-4d25-9311-be705beecc2b tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] 10.222.0.26 "GET /compute/v2.1/servers/a3f6deb2-34ba-4813-9c6c-433cfa3108c6" status: 200 len: 1317 microversion: 2.1 time: 0.159670 Oct 08 21:43:19.845888 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3138/6349] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:43:19 2022] GET /compute/v2.1/servers/a3f6deb2-34ba-4813-9c6c-433cfa3108c6 => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:43:20.869178 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-b15544b5-df52-4f50-939e-671996a7b25f tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:43:20.869940 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-b15544b5-df52-4f50-939e-671996a7b25f tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] [instance: a3f6deb2-34ba-4813-9c6c-433cfa3108c6] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:43:20.876152 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b15544b5-df52-4f50-939e-671996a7b25f tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:43:20.876653 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b15544b5-df52-4f50-939e-671996a7b25f tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:43:20.877111 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b15544b5-df52-4f50-939e-671996a7b25f tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:43:20.877844 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b15544b5-df52-4f50-939e-671996a7b25f tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:43:20.878346 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b15544b5-df52-4f50-939e-671996a7b25f tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:43:20.878787 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b15544b5-df52-4f50-939e-671996a7b25f tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:43:21.006906 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-b15544b5-df52-4f50-939e-671996a7b25f tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2beee1a677a47b48dd244a12de6dac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be36356ccbf4266819b18ca6cee6d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:43:21.014712 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-b15544b5-df52-4f50-939e-671996a7b25f tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] 10.222.0.26 "GET /compute/v2.1/servers/a3f6deb2-34ba-4813-9c6c-433cfa3108c6" status: 200 len: 1507 microversion: 2.1 time: 0.150587 Oct 08 21:43:21.015289 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3212/6350] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:43:20 2022] GET /compute/v2.1/servers/a3f6deb2-34ba-4813-9c6c-433cfa3108c6 => generated 1507 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:43:21.037780 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-109266c9-5b74-4b1c-ad83-24e4c71516c2 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:43:21.038409 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-109266c9-5b74-4b1c-ad83-24e4c71516c2 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] [instance: a3f6deb2-34ba-4813-9c6c-433cfa3108c6] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:43:21.045983 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-109266c9-5b74-4b1c-ad83-24e4c71516c2 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:43:21.046482 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-109266c9-5b74-4b1c-ad83-24e4c71516c2 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:43:21.046935 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-109266c9-5b74-4b1c-ad83-24e4c71516c2 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:43:21.047646 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-109266c9-5b74-4b1c-ad83-24e4c71516c2 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:43:21.048116 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-109266c9-5b74-4b1c-ad83-24e4c71516c2 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:43:21.048557 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-109266c9-5b74-4b1c-ad83-24e4c71516c2 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:43:21.178464 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-109266c9-5b74-4b1c-ad83-24e4c71516c2 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2beee1a677a47b48dd244a12de6dac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be36356ccbf4266819b18ca6cee6d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:43:21.186263 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-109266c9-5b74-4b1c-ad83-24e4c71516c2 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] 10.222.0.26 "GET /compute/v2.1/servers/a3f6deb2-34ba-4813-9c6c-433cfa3108c6" status: 200 len: 1507 microversion: 2.1 time: 0.152386 Oct 08 21:43:21.186847 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3139/6351] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:43:21 2022] GET /compute/v2.1/servers/a3f6deb2-34ba-4813-9c6c-433cfa3108c6 => generated 1507 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:43:21.208417 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e70008f2-80f3-4ad7-bc60-12589a65fb2f tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:43:21.210855 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-e70008f2-80f3-4ad7-bc60-12589a65fb2f tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] [instance: a3f6deb2-34ba-4813-9c6c-433cfa3108c6] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:43:21.216796 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e70008f2-80f3-4ad7-bc60-12589a65fb2f tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:43:21.217929 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e70008f2-80f3-4ad7-bc60-12589a65fb2f tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:43:21.218387 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e70008f2-80f3-4ad7-bc60-12589a65fb2f tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:43:21.219087 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e70008f2-80f3-4ad7-bc60-12589a65fb2f tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:43:21.219557 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e70008f2-80f3-4ad7-bc60-12589a65fb2f tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:43:21.219998 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e70008f2-80f3-4ad7-bc60-12589a65fb2f tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:43:21.283334 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-e70008f2-80f3-4ad7-bc60-12589a65fb2f tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] 10.222.0.26 "PUT /compute/v2.1/servers/a3f6deb2-34ba-4813-9c6c-433cfa3108c6" status: 200 len: 1079 microversion: 2.1 time: 0.078756 Oct 08 21:43:21.283957 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3213/6352] 10.222.0.26 () {60 vars in 1256 bytes} [Sat Oct 8 21:43:21 2022] PUT /compute/v2.1/servers/a3f6deb2-34ba-4813-9c6c-433cfa3108c6 => generated 1079 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:43:21.301954 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-279fd680-00cb-495b-9a42-7c0c9c7209e6 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:43:21.302577 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-279fd680-00cb-495b-9a42-7c0c9c7209e6 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] [instance: a3f6deb2-34ba-4813-9c6c-433cfa3108c6] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:43:21.308641 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-279fd680-00cb-495b-9a42-7c0c9c7209e6 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:43:21.309137 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-279fd680-00cb-495b-9a42-7c0c9c7209e6 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:43:21.309628 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-279fd680-00cb-495b-9a42-7c0c9c7209e6 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:43:21.310376 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-279fd680-00cb-495b-9a42-7c0c9c7209e6 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:43:21.310832 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-279fd680-00cb-495b-9a42-7c0c9c7209e6 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:43:21.311257 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-279fd680-00cb-495b-9a42-7c0c9c7209e6 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:43:21.439212 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-279fd680-00cb-495b-9a42-7c0c9c7209e6 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2beee1a677a47b48dd244a12de6dac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be36356ccbf4266819b18ca6cee6d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:43:21.447370 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-279fd680-00cb-495b-9a42-7c0c9c7209e6 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] 10.222.0.26 "GET /compute/v2.1/servers/a3f6deb2-34ba-4813-9c6c-433cfa3108c6" status: 200 len: 1505 microversion: 2.1 time: 0.149259 Oct 08 21:43:21.447944 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3140/6353] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:43:21 2022] GET /compute/v2.1/servers/a3f6deb2-34ba-4813-9c6c-433cfa3108c6 => generated 1505 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:43:21.469811 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-9f8be2f7-2384-4eec-bcc9-b3efab6956d6 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:43:21.470445 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-9f8be2f7-2384-4eec-bcc9-b3efab6956d6 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] [instance: a3f6deb2-34ba-4813-9c6c-433cfa3108c6] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:43:21.476705 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9f8be2f7-2384-4eec-bcc9-b3efab6956d6 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:43:21.477257 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9f8be2f7-2384-4eec-bcc9-b3efab6956d6 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:43:21.477730 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9f8be2f7-2384-4eec-bcc9-b3efab6956d6 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:43:21.478506 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9f8be2f7-2384-4eec-bcc9-b3efab6956d6 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:43:21.479146 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9f8be2f7-2384-4eec-bcc9-b3efab6956d6 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:43:21.479630 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9f8be2f7-2384-4eec-bcc9-b3efab6956d6 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:43:21.604924 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=2 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:43:21.609159 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-9f8be2f7-2384-4eec-bcc9-b3efab6956d6 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2beee1a677a47b48dd244a12de6dac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be36356ccbf4266819b18ca6cee6d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:43:21.617419 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-9f8be2f7-2384-4eec-bcc9-b3efab6956d6 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] 10.222.0.26 "GET /compute/v2.1/servers/a3f6deb2-34ba-4813-9c6c-433cfa3108c6" status: 200 len: 1505 microversion: 2.1 time: 0.152040 Oct 08 21:43:21.618004 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3214/6354] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:43:21 2022] GET /compute/v2.1/servers/a3f6deb2-34ba-4813-9c6c-433cfa3108c6 => generated 1505 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:43:21.639023 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-aa8767a5-2ff8-40fe-b849-b7267de3ffe0 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:43:21.641410 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-aa8767a5-2ff8-40fe-b849-b7267de3ffe0 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] [instance: a3f6deb2-34ba-4813-9c6c-433cfa3108c6] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:43:21.643512 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=2 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:43:21.644323 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=6 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:43:21.650541 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-aa8767a5-2ff8-40fe-b849-b7267de3ffe0 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:43:21.651041 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-aa8767a5-2ff8-40fe-b849-b7267de3ffe0 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:43:21.651491 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-aa8767a5-2ff8-40fe-b849-b7267de3ffe0 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:43:21.652205 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-aa8767a5-2ff8-40fe-b849-b7267de3ffe0 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:43:21.652671 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-aa8767a5-2ff8-40fe-b849-b7267de3ffe0 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:43:21.653113 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-aa8767a5-2ff8-40fe-b849-b7267de3ffe0 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:43:21.683075 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-aa8767a5-2ff8-40fe-b849-b7267de3ffe0 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'b2beee1a677a47b48dd244a12de6dac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be36356ccbf4266819b18ca6cee6d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:43:21.688605 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-aa8767a5-2ff8-40fe-b849-b7267de3ffe0 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] [instance: a3f6deb2-34ba-4813-9c6c-433cfa3108c6] Old instance type m1.heat2, new instance type m1.heat {{(pid=140491) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 08 21:43:21.695655 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-aa8767a5-2ff8-40fe-b849-b7267de3ffe0 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Flavor limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 21:43:21.696092 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-aa8767a5-2ff8-40fe-b849-b7267de3ffe0 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Image limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 21:43:21.696582 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-aa8767a5-2ff8-40fe-b849-b7267de3ffe0 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Flavor pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 21:43:21.697004 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-aa8767a5-2ff8-40fe-b849-b7267de3ffe0 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Image pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 21:43:21.697452 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-aa8767a5-2ff8-40fe-b849-b7267de3ffe0 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 21:43:21.763233 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-aa8767a5-2ff8-40fe-b849-b7267de3ffe0 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] 10.222.0.26 "POST /compute/v2.1/servers/a3f6deb2-34ba-4813-9c6c-433cfa3108c6/action" status: 202 len: 0 microversion: 2.1 time: 0.128161 Oct 08 21:43:21.763882 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3141/6355] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:43:21 2022] POST /compute/v2.1/servers/a3f6deb2-34ba-4813-9c6c-433cfa3108c6/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 21:43:21.772006 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-ff548312-b6fd-46be-8f9c-a75b09c8d6ec tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:43:21.772710 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-ff548312-b6fd-46be-8f9c-a75b09c8d6ec tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] [instance: a3f6deb2-34ba-4813-9c6c-433cfa3108c6] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:43:21.780272 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ff548312-b6fd-46be-8f9c-a75b09c8d6ec tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:43:21.781336 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ff548312-b6fd-46be-8f9c-a75b09c8d6ec tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:43:21.781336 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ff548312-b6fd-46be-8f9c-a75b09c8d6ec tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:43:21.782001 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ff548312-b6fd-46be-8f9c-a75b09c8d6ec tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:43:21.782488 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ff548312-b6fd-46be-8f9c-a75b09c8d6ec tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:43:21.782957 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ff548312-b6fd-46be-8f9c-a75b09c8d6ec tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:43:21.947917 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-ff548312-b6fd-46be-8f9c-a75b09c8d6ec tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2beee1a677a47b48dd244a12de6dac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be36356ccbf4266819b18ca6cee6d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:43:21.957518 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-ff548312-b6fd-46be-8f9c-a75b09c8d6ec tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] 10.222.0.26 "GET /compute/v2.1/servers/a3f6deb2-34ba-4813-9c6c-433cfa3108c6" status: 200 len: 1516 microversion: 2.1 time: 0.189204 Oct 08 21:43:21.958475 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3215/6356] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:43:21 2022] GET /compute/v2.1/servers/a3f6deb2-34ba-4813-9c6c-433cfa3108c6 => generated 1516 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:43:22.982984 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-6875d2d1-02be-4f55-a9fa-99b8638482b4 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:43:22.983737 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-6875d2d1-02be-4f55-a9fa-99b8638482b4 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] [instance: a3f6deb2-34ba-4813-9c6c-433cfa3108c6] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:43:22.991215 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6875d2d1-02be-4f55-a9fa-99b8638482b4 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:43:22.991719 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6875d2d1-02be-4f55-a9fa-99b8638482b4 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:43:22.992170 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6875d2d1-02be-4f55-a9fa-99b8638482b4 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:43:22.992891 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6875d2d1-02be-4f55-a9fa-99b8638482b4 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:43:22.993386 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6875d2d1-02be-4f55-a9fa-99b8638482b4 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:43:22.993827 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6875d2d1-02be-4f55-a9fa-99b8638482b4 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:43:23.204487 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-6875d2d1-02be-4f55-a9fa-99b8638482b4 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2beee1a677a47b48dd244a12de6dac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be36356ccbf4266819b18ca6cee6d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:43:23.212504 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-6875d2d1-02be-4f55-a9fa-99b8638482b4 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] 10.222.0.26 "GET /compute/v2.1/servers/a3f6deb2-34ba-4813-9c6c-433cfa3108c6" status: 200 len: 1516 microversion: 2.1 time: 0.234606 Oct 08 21:43:23.213099 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3142/6357] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:43:22 2022] GET /compute/v2.1/servers/a3f6deb2-34ba-4813-9c6c-433cfa3108c6 => generated 1516 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:43:24.235656 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-c7cfd1c5-336c-431b-8079-0c0e377f4f29 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:43:24.236324 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-c7cfd1c5-336c-431b-8079-0c0e377f4f29 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] [instance: a3f6deb2-34ba-4813-9c6c-433cfa3108c6] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:43:24.243596 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c7cfd1c5-336c-431b-8079-0c0e377f4f29 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:43:24.244109 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c7cfd1c5-336c-431b-8079-0c0e377f4f29 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:43:24.244571 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c7cfd1c5-336c-431b-8079-0c0e377f4f29 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:43:24.245338 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c7cfd1c5-336c-431b-8079-0c0e377f4f29 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:43:24.245820 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c7cfd1c5-336c-431b-8079-0c0e377f4f29 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:43:24.246275 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c7cfd1c5-336c-431b-8079-0c0e377f4f29 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:43:24.375224 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-c7cfd1c5-336c-431b-8079-0c0e377f4f29 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2beee1a677a47b48dd244a12de6dac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be36356ccbf4266819b18ca6cee6d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:43:24.382972 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-c7cfd1c5-336c-431b-8079-0c0e377f4f29 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] 10.222.0.26 "GET /compute/v2.1/servers/a3f6deb2-34ba-4813-9c6c-433cfa3108c6" status: 200 len: 1521 microversion: 2.1 time: 0.151355 Oct 08 21:43:24.383548 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3216/6358] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:43:24 2022] GET /compute/v2.1/servers/a3f6deb2-34ba-4813-9c6c-433cfa3108c6 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:43:25.406840 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c25a7fad-ba42-4a9c-9f2c-db0cf144f070 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:43:25.407448 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-c25a7fad-ba42-4a9c-9f2c-db0cf144f070 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] [instance: a3f6deb2-34ba-4813-9c6c-433cfa3108c6] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:43:25.414367 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c25a7fad-ba42-4a9c-9f2c-db0cf144f070 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:43:25.414846 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c25a7fad-ba42-4a9c-9f2c-db0cf144f070 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:43:25.415286 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c25a7fad-ba42-4a9c-9f2c-db0cf144f070 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:43:25.415980 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c25a7fad-ba42-4a9c-9f2c-db0cf144f070 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:43:25.416437 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c25a7fad-ba42-4a9c-9f2c-db0cf144f070 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:43:25.416861 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c25a7fad-ba42-4a9c-9f2c-db0cf144f070 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:43:25.792925 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-c25a7fad-ba42-4a9c-9f2c-db0cf144f070 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2beee1a677a47b48dd244a12de6dac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be36356ccbf4266819b18ca6cee6d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:43:25.800754 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-c25a7fad-ba42-4a9c-9f2c-db0cf144f070 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] 10.222.0.26 "GET /compute/v2.1/servers/a3f6deb2-34ba-4813-9c6c-433cfa3108c6" status: 200 len: 1521 microversion: 2.1 time: 0.398366 Oct 08 21:43:25.801354 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3143/6359] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:43:25 2022] GET /compute/v2.1/servers/a3f6deb2-34ba-4813-9c6c-433cfa3108c6 => generated 1521 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:43:26.822760 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-2424a2f5-3dad-4cd3-b62d-6500acf0fea2 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:43:26.823391 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-2424a2f5-3dad-4cd3-b62d-6500acf0fea2 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] [instance: a3f6deb2-34ba-4813-9c6c-433cfa3108c6] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:43:26.826149 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:43:26.831807 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2424a2f5-3dad-4cd3-b62d-6500acf0fea2 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:43:26.832318 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2424a2f5-3dad-4cd3-b62d-6500acf0fea2 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:43:26.832781 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2424a2f5-3dad-4cd3-b62d-6500acf0fea2 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:43:26.833578 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2424a2f5-3dad-4cd3-b62d-6500acf0fea2 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:43:26.834059 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2424a2f5-3dad-4cd3-b62d-6500acf0fea2 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:43:26.834505 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2424a2f5-3dad-4cd3-b62d-6500acf0fea2 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:43:26.966748 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-2424a2f5-3dad-4cd3-b62d-6500acf0fea2 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2beee1a677a47b48dd244a12de6dac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be36356ccbf4266819b18ca6cee6d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:43:26.975028 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-2424a2f5-3dad-4cd3-b62d-6500acf0fea2 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] 10.222.0.26 "GET /compute/v2.1/servers/a3f6deb2-34ba-4813-9c6c-433cfa3108c6" status: 200 len: 1521 microversion: 2.1 time: 0.156412 Oct 08 21:43:26.975609 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3217/6360] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:43:26 2022] GET /compute/v2.1/servers/a3f6deb2-34ba-4813-9c6c-433cfa3108c6 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:43:27.999306 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-eec7c788-7242-4167-9a45-4fc7c84751aa tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:43:27.999942 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-eec7c788-7242-4167-9a45-4fc7c84751aa tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] [instance: a3f6deb2-34ba-4813-9c6c-433cfa3108c6] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:43:28.001920 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:43:28.008047 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-eec7c788-7242-4167-9a45-4fc7c84751aa tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:43:28.008544 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-eec7c788-7242-4167-9a45-4fc7c84751aa tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:43:28.009004 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-eec7c788-7242-4167-9a45-4fc7c84751aa tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:43:28.009739 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-eec7c788-7242-4167-9a45-4fc7c84751aa tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:43:28.010209 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-eec7c788-7242-4167-9a45-4fc7c84751aa tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:43:28.010646 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-eec7c788-7242-4167-9a45-4fc7c84751aa tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:43:28.015169 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:43:28.141694 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-eec7c788-7242-4167-9a45-4fc7c84751aa tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2beee1a677a47b48dd244a12de6dac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be36356ccbf4266819b18ca6cee6d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:43:28.149511 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-eec7c788-7242-4167-9a45-4fc7c84751aa tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] 10.222.0.26 "GET /compute/v2.1/servers/a3f6deb2-34ba-4813-9c6c-433cfa3108c6" status: 200 len: 1521 microversion: 2.1 time: 0.154979 Oct 08 21:43:28.150099 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3144/6361] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:43:27 2022] GET /compute/v2.1/servers/a3f6deb2-34ba-4813-9c6c-433cfa3108c6 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:43:29.171905 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-181969e9-d2d3-48be-9d60-38599f0c139a tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:43:29.172540 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-181969e9-d2d3-48be-9d60-38599f0c139a tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] [instance: a3f6deb2-34ba-4813-9c6c-433cfa3108c6] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:43:29.179458 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-181969e9-d2d3-48be-9d60-38599f0c139a tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:43:29.179963 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-181969e9-d2d3-48be-9d60-38599f0c139a tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:43:29.180423 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-181969e9-d2d3-48be-9d60-38599f0c139a tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:43:29.181138 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-181969e9-d2d3-48be-9d60-38599f0c139a tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:43:29.181656 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-181969e9-d2d3-48be-9d60-38599f0c139a tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:43:29.182104 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-181969e9-d2d3-48be-9d60-38599f0c139a tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:43:29.310522 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-181969e9-d2d3-48be-9d60-38599f0c139a tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2beee1a677a47b48dd244a12de6dac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be36356ccbf4266819b18ca6cee6d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:43:29.318778 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-181969e9-d2d3-48be-9d60-38599f0c139a tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] 10.222.0.26 "GET /compute/v2.1/servers/a3f6deb2-34ba-4813-9c6c-433cfa3108c6" status: 200 len: 1521 microversion: 2.1 time: 0.150828 Oct 08 21:43:29.319356 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3218/6362] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:43:29 2022] GET /compute/v2.1/servers/a3f6deb2-34ba-4813-9c6c-433cfa3108c6 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:43:30.343052 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-0657a4e8-25a8-4e65-9c55-3c483bc7d665 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:43:30.343627 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-0657a4e8-25a8-4e65-9c55-3c483bc7d665 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] [instance: a3f6deb2-34ba-4813-9c6c-433cfa3108c6] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:43:30.350622 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0657a4e8-25a8-4e65-9c55-3c483bc7d665 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:43:30.351115 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0657a4e8-25a8-4e65-9c55-3c483bc7d665 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:43:30.351558 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0657a4e8-25a8-4e65-9c55-3c483bc7d665 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:43:30.352260 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0657a4e8-25a8-4e65-9c55-3c483bc7d665 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:43:30.352717 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0657a4e8-25a8-4e65-9c55-3c483bc7d665 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:43:30.353143 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0657a4e8-25a8-4e65-9c55-3c483bc7d665 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:43:30.482741 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-0657a4e8-25a8-4e65-9c55-3c483bc7d665 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2beee1a677a47b48dd244a12de6dac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be36356ccbf4266819b18ca6cee6d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:43:30.491166 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-0657a4e8-25a8-4e65-9c55-3c483bc7d665 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] 10.222.0.26 "GET /compute/v2.1/servers/a3f6deb2-34ba-4813-9c6c-433cfa3108c6" status: 200 len: 1521 microversion: 2.1 time: 0.152831 Oct 08 21:43:30.491750 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3145/6363] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:43:30 2022] GET /compute/v2.1/servers/a3f6deb2-34ba-4813-9c6c-433cfa3108c6 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:43:31.514920 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-1b90bd53-edbb-443f-89cc-fbf75d9927c1 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:43:31.515577 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-1b90bd53-edbb-443f-89cc-fbf75d9927c1 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] [instance: a3f6deb2-34ba-4813-9c6c-433cfa3108c6] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:43:31.522760 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1b90bd53-edbb-443f-89cc-fbf75d9927c1 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:43:31.523273 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1b90bd53-edbb-443f-89cc-fbf75d9927c1 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:43:31.523761 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1b90bd53-edbb-443f-89cc-fbf75d9927c1 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:43:31.524535 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1b90bd53-edbb-443f-89cc-fbf75d9927c1 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:43:31.525041 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1b90bd53-edbb-443f-89cc-fbf75d9927c1 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:43:31.525524 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1b90bd53-edbb-443f-89cc-fbf75d9927c1 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:43:31.661168 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-1b90bd53-edbb-443f-89cc-fbf75d9927c1 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2beee1a677a47b48dd244a12de6dac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be36356ccbf4266819b18ca6cee6d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:43:31.668970 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-1b90bd53-edbb-443f-89cc-fbf75d9927c1 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] 10.222.0.26 "GET /compute/v2.1/servers/a3f6deb2-34ba-4813-9c6c-433cfa3108c6" status: 200 len: 1521 microversion: 2.1 time: 0.158320 Oct 08 21:43:31.669576 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3219/6364] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:43:31 2022] GET /compute/v2.1/servers/a3f6deb2-34ba-4813-9c6c-433cfa3108c6 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:43:32.692498 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-5c8d58d1-36f6-46ce-9ab0-ddf6f671153f tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:43:32.693164 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-5c8d58d1-36f6-46ce-9ab0-ddf6f671153f tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] [instance: a3f6deb2-34ba-4813-9c6c-433cfa3108c6] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:43:32.700989 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5c8d58d1-36f6-46ce-9ab0-ddf6f671153f tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:43:32.701513 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5c8d58d1-36f6-46ce-9ab0-ddf6f671153f tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:43:32.701957 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5c8d58d1-36f6-46ce-9ab0-ddf6f671153f tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:43:32.702661 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5c8d58d1-36f6-46ce-9ab0-ddf6f671153f tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:43:32.703124 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5c8d58d1-36f6-46ce-9ab0-ddf6f671153f tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:43:32.703581 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5c8d58d1-36f6-46ce-9ab0-ddf6f671153f tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:43:32.830986 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-5c8d58d1-36f6-46ce-9ab0-ddf6f671153f tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2beee1a677a47b48dd244a12de6dac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be36356ccbf4266819b18ca6cee6d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:43:32.838752 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-5c8d58d1-36f6-46ce-9ab0-ddf6f671153f tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] 10.222.0.26 "GET /compute/v2.1/servers/a3f6deb2-34ba-4813-9c6c-433cfa3108c6" status: 200 len: 1521 microversion: 2.1 time: 0.150304 Oct 08 21:43:32.839326 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3146/6365] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:43:32 2022] GET /compute/v2.1/servers/a3f6deb2-34ba-4813-9c6c-433cfa3108c6 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:43:33.861901 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-260b7cef-a6b7-42f2-9197-8307216b4b98 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:43:33.862534 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-260b7cef-a6b7-42f2-9197-8307216b4b98 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] [instance: a3f6deb2-34ba-4813-9c6c-433cfa3108c6] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:43:33.869575 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-260b7cef-a6b7-42f2-9197-8307216b4b98 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:43:33.870088 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-260b7cef-a6b7-42f2-9197-8307216b4b98 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:43:33.870549 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-260b7cef-a6b7-42f2-9197-8307216b4b98 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:43:33.871263 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-260b7cef-a6b7-42f2-9197-8307216b4b98 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:43:33.871742 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-260b7cef-a6b7-42f2-9197-8307216b4b98 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:43:33.872189 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-260b7cef-a6b7-42f2-9197-8307216b4b98 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:43:34.002434 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-260b7cef-a6b7-42f2-9197-8307216b4b98 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2beee1a677a47b48dd244a12de6dac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be36356ccbf4266819b18ca6cee6d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:43:34.010210 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-260b7cef-a6b7-42f2-9197-8307216b4b98 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] 10.222.0.26 "GET /compute/v2.1/servers/a3f6deb2-34ba-4813-9c6c-433cfa3108c6" status: 200 len: 1521 microversion: 2.1 time: 0.152250 Oct 08 21:43:34.010786 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3220/6366] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:43:33 2022] GET /compute/v2.1/servers/a3f6deb2-34ba-4813-9c6c-433cfa3108c6 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:43:35.032899 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-1c49200a-e6c3-410c-bc6f-6c8454698960 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:43:35.033619 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-1c49200a-e6c3-410c-bc6f-6c8454698960 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] [instance: a3f6deb2-34ba-4813-9c6c-433cfa3108c6] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:43:35.040462 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1c49200a-e6c3-410c-bc6f-6c8454698960 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:43:35.040957 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1c49200a-e6c3-410c-bc6f-6c8454698960 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:43:35.041438 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1c49200a-e6c3-410c-bc6f-6c8454698960 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:43:35.042144 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1c49200a-e6c3-410c-bc6f-6c8454698960 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:43:35.042611 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1c49200a-e6c3-410c-bc6f-6c8454698960 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:43:35.043047 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1c49200a-e6c3-410c-bc6f-6c8454698960 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:43:35.173324 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-1c49200a-e6c3-410c-bc6f-6c8454698960 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2beee1a677a47b48dd244a12de6dac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be36356ccbf4266819b18ca6cee6d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:43:35.181166 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-1c49200a-e6c3-410c-bc6f-6c8454698960 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] 10.222.0.26 "GET /compute/v2.1/servers/a3f6deb2-34ba-4813-9c6c-433cfa3108c6" status: 200 len: 1521 microversion: 2.1 time: 0.152244 Oct 08 21:43:35.181772 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3147/6367] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:43:35 2022] GET /compute/v2.1/servers/a3f6deb2-34ba-4813-9c6c-433cfa3108c6 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:43:36.204475 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-83e0e8ac-252d-4c53-a3cf-856bb5c11047 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:43:36.205115 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-83e0e8ac-252d-4c53-a3cf-856bb5c11047 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] [instance: a3f6deb2-34ba-4813-9c6c-433cfa3108c6] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:43:36.212106 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-83e0e8ac-252d-4c53-a3cf-856bb5c11047 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:43:36.212617 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-83e0e8ac-252d-4c53-a3cf-856bb5c11047 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:43:36.213077 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-83e0e8ac-252d-4c53-a3cf-856bb5c11047 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:43:36.213849 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-83e0e8ac-252d-4c53-a3cf-856bb5c11047 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:43:36.214329 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-83e0e8ac-252d-4c53-a3cf-856bb5c11047 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:43:36.214779 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-83e0e8ac-252d-4c53-a3cf-856bb5c11047 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:43:36.348934 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-83e0e8ac-252d-4c53-a3cf-856bb5c11047 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2beee1a677a47b48dd244a12de6dac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be36356ccbf4266819b18ca6cee6d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:43:36.356781 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-83e0e8ac-252d-4c53-a3cf-856bb5c11047 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] 10.222.0.26 "GET /compute/v2.1/servers/a3f6deb2-34ba-4813-9c6c-433cfa3108c6" status: 200 len: 1521 microversion: 2.1 time: 0.156739 Oct 08 21:43:36.357374 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3221/6368] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:43:36 2022] GET /compute/v2.1/servers/a3f6deb2-34ba-4813-9c6c-433cfa3108c6 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:43:37.379692 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-504c0599-8214-4c19-953c-7c282c4e8061 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:43:37.380303 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-504c0599-8214-4c19-953c-7c282c4e8061 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] [instance: a3f6deb2-34ba-4813-9c6c-433cfa3108c6] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:43:37.387259 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-504c0599-8214-4c19-953c-7c282c4e8061 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:43:37.387747 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-504c0599-8214-4c19-953c-7c282c4e8061 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:43:37.388185 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-504c0599-8214-4c19-953c-7c282c4e8061 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:43:37.388931 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-504c0599-8214-4c19-953c-7c282c4e8061 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:43:37.389461 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-504c0599-8214-4c19-953c-7c282c4e8061 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:43:37.389893 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-504c0599-8214-4c19-953c-7c282c4e8061 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:43:37.518089 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-504c0599-8214-4c19-953c-7c282c4e8061 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2beee1a677a47b48dd244a12de6dac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be36356ccbf4266819b18ca6cee6d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:43:37.526647 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-504c0599-8214-4c19-953c-7c282c4e8061 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] 10.222.0.26 "GET /compute/v2.1/servers/a3f6deb2-34ba-4813-9c6c-433cfa3108c6" status: 200 len: 1521 microversion: 2.1 time: 0.150953 Oct 08 21:43:37.527249 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3148/6369] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:43:37 2022] GET /compute/v2.1/servers/a3f6deb2-34ba-4813-9c6c-433cfa3108c6 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:43:38.550475 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-f1713362-ed93-425b-a012-86299ef88322 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:43:38.551106 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-f1713362-ed93-425b-a012-86299ef88322 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] [instance: a3f6deb2-34ba-4813-9c6c-433cfa3108c6] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:43:38.558060 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f1713362-ed93-425b-a012-86299ef88322 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:43:38.558564 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f1713362-ed93-425b-a012-86299ef88322 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:43:38.559028 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f1713362-ed93-425b-a012-86299ef88322 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:43:38.559732 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f1713362-ed93-425b-a012-86299ef88322 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:43:38.560207 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f1713362-ed93-425b-a012-86299ef88322 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:43:38.560680 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f1713362-ed93-425b-a012-86299ef88322 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:43:38.689065 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-f1713362-ed93-425b-a012-86299ef88322 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2beee1a677a47b48dd244a12de6dac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be36356ccbf4266819b18ca6cee6d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:43:38.697073 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-f1713362-ed93-425b-a012-86299ef88322 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] 10.222.0.26 "GET /compute/v2.1/servers/a3f6deb2-34ba-4813-9c6c-433cfa3108c6" status: 200 len: 1521 microversion: 2.1 time: 0.150533 Oct 08 21:43:38.697683 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3222/6370] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:43:38 2022] GET /compute/v2.1/servers/a3f6deb2-34ba-4813-9c6c-433cfa3108c6 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:43:39.721473 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-f6df2c6c-d075-4404-b0b2-952c006d477f tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:43:39.722095 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-f6df2c6c-d075-4404-b0b2-952c006d477f tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] [instance: a3f6deb2-34ba-4813-9c6c-433cfa3108c6] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:43:39.729138 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f6df2c6c-d075-4404-b0b2-952c006d477f tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:43:39.729667 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f6df2c6c-d075-4404-b0b2-952c006d477f tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:43:39.730119 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f6df2c6c-d075-4404-b0b2-952c006d477f tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:43:39.730899 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f6df2c6c-d075-4404-b0b2-952c006d477f tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:43:39.731296 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f6df2c6c-d075-4404-b0b2-952c006d477f tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:43:39.731755 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f6df2c6c-d075-4404-b0b2-952c006d477f tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:43:39.865714 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-f6df2c6c-d075-4404-b0b2-952c006d477f tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2beee1a677a47b48dd244a12de6dac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be36356ccbf4266819b18ca6cee6d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:43:39.874072 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-f6df2c6c-d075-4404-b0b2-952c006d477f tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] 10.222.0.26 "GET /compute/v2.1/servers/a3f6deb2-34ba-4813-9c6c-433cfa3108c6" status: 200 len: 1521 microversion: 2.1 time: 0.156549 Oct 08 21:43:39.874680 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3149/6371] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:43:39 2022] GET /compute/v2.1/servers/a3f6deb2-34ba-4813-9c6c-433cfa3108c6 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:43:40.897707 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-8e202111-f5b7-4a65-8b7f-65aeb345a2d8 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:43:40.898349 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-8e202111-f5b7-4a65-8b7f-65aeb345a2d8 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] [instance: a3f6deb2-34ba-4813-9c6c-433cfa3108c6] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:43:40.905421 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8e202111-f5b7-4a65-8b7f-65aeb345a2d8 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:43:40.905936 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8e202111-f5b7-4a65-8b7f-65aeb345a2d8 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:43:40.906407 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8e202111-f5b7-4a65-8b7f-65aeb345a2d8 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:43:40.907132 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8e202111-f5b7-4a65-8b7f-65aeb345a2d8 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:43:40.907613 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8e202111-f5b7-4a65-8b7f-65aeb345a2d8 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:43:40.908066 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8e202111-f5b7-4a65-8b7f-65aeb345a2d8 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:43:41.038104 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-8e202111-f5b7-4a65-8b7f-65aeb345a2d8 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2beee1a677a47b48dd244a12de6dac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be36356ccbf4266819b18ca6cee6d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:43:41.046880 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-8e202111-f5b7-4a65-8b7f-65aeb345a2d8 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] 10.222.0.26 "GET /compute/v2.1/servers/a3f6deb2-34ba-4813-9c6c-433cfa3108c6" status: 200 len: 1521 microversion: 2.1 time: 0.153098 Oct 08 21:43:41.047473 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3223/6372] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:43:40 2022] GET /compute/v2.1/servers/a3f6deb2-34ba-4813-9c6c-433cfa3108c6 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:43:42.069821 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-0c67763f-46d0-41eb-8b55-b4d38a71899d tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:43:42.070632 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-0c67763f-46d0-41eb-8b55-b4d38a71899d tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] [instance: a3f6deb2-34ba-4813-9c6c-433cfa3108c6] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:43:42.077617 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0c67763f-46d0-41eb-8b55-b4d38a71899d tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:43:42.078095 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0c67763f-46d0-41eb-8b55-b4d38a71899d tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:43:42.078538 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0c67763f-46d0-41eb-8b55-b4d38a71899d tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:43:42.079235 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0c67763f-46d0-41eb-8b55-b4d38a71899d tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:43:42.079696 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0c67763f-46d0-41eb-8b55-b4d38a71899d tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:43:42.080123 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0c67763f-46d0-41eb-8b55-b4d38a71899d tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:43:42.215056 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-0c67763f-46d0-41eb-8b55-b4d38a71899d tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2beee1a677a47b48dd244a12de6dac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be36356ccbf4266819b18ca6cee6d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:43:42.223634 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-0c67763f-46d0-41eb-8b55-b4d38a71899d tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] 10.222.0.26 "GET /compute/v2.1/servers/a3f6deb2-34ba-4813-9c6c-433cfa3108c6" status: 200 len: 1521 microversion: 2.1 time: 0.157841 Oct 08 21:43:42.224216 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3150/6373] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:43:42 2022] GET /compute/v2.1/servers/a3f6deb2-34ba-4813-9c6c-433cfa3108c6 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:43:43.246498 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-68a8d582-cf2b-4fd8-8575-5d9022ebf814 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:43:43.247130 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-68a8d582-cf2b-4fd8-8575-5d9022ebf814 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] [instance: a3f6deb2-34ba-4813-9c6c-433cfa3108c6] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:43:43.254734 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-68a8d582-cf2b-4fd8-8575-5d9022ebf814 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:43:43.255233 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-68a8d582-cf2b-4fd8-8575-5d9022ebf814 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:43:43.255686 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-68a8d582-cf2b-4fd8-8575-5d9022ebf814 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:43:43.256395 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-68a8d582-cf2b-4fd8-8575-5d9022ebf814 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:43:43.256867 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-68a8d582-cf2b-4fd8-8575-5d9022ebf814 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:43:43.257337 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-68a8d582-cf2b-4fd8-8575-5d9022ebf814 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:43:43.275763 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:43:43.394962 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-68a8d582-cf2b-4fd8-8575-5d9022ebf814 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2beee1a677a47b48dd244a12de6dac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be36356ccbf4266819b18ca6cee6d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:43:43.403229 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-68a8d582-cf2b-4fd8-8575-5d9022ebf814 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] 10.222.0.26 "GET /compute/v2.1/servers/a3f6deb2-34ba-4813-9c6c-433cfa3108c6" status: 200 len: 1521 microversion: 2.1 time: 0.160609 Oct 08 21:43:43.403806 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3224/6374] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:43:43 2022] GET /compute/v2.1/servers/a3f6deb2-34ba-4813-9c6c-433cfa3108c6 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:43:44.426980 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-fb200109-cc6f-4435-8704-db6a28683a25 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:43:44.427628 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-fb200109-cc6f-4435-8704-db6a28683a25 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] [instance: a3f6deb2-34ba-4813-9c6c-433cfa3108c6] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:43:44.435098 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fb200109-cc6f-4435-8704-db6a28683a25 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:43:44.436259 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fb200109-cc6f-4435-8704-db6a28683a25 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:43:44.436710 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fb200109-cc6f-4435-8704-db6a28683a25 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:43:44.437456 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fb200109-cc6f-4435-8704-db6a28683a25 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:43:44.437921 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fb200109-cc6f-4435-8704-db6a28683a25 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:43:44.438384 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fb200109-cc6f-4435-8704-db6a28683a25 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:43:44.574458 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-fb200109-cc6f-4435-8704-db6a28683a25 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2beee1a677a47b48dd244a12de6dac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be36356ccbf4266819b18ca6cee6d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:43:44.582466 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-fb200109-cc6f-4435-8704-db6a28683a25 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] 10.222.0.26 "GET /compute/v2.1/servers/a3f6deb2-34ba-4813-9c6c-433cfa3108c6" status: 200 len: 1521 microversion: 2.1 time: 0.159520 Oct 08 21:43:44.583045 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3151/6375] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:43:44 2022] GET /compute/v2.1/servers/a3f6deb2-34ba-4813-9c6c-433cfa3108c6 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:43:45.604629 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-da42dadb-c9ba-4a82-8499-892488d2720d tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:43:45.605305 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-da42dadb-c9ba-4a82-8499-892488d2720d tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] [instance: a3f6deb2-34ba-4813-9c6c-433cfa3108c6] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:43:45.613618 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-da42dadb-c9ba-4a82-8499-892488d2720d tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:43:45.614130 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-da42dadb-c9ba-4a82-8499-892488d2720d tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:43:45.614586 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-da42dadb-c9ba-4a82-8499-892488d2720d tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:43:45.615307 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-da42dadb-c9ba-4a82-8499-892488d2720d tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:43:45.615781 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-da42dadb-c9ba-4a82-8499-892488d2720d tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:43:45.616226 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-da42dadb-c9ba-4a82-8499-892488d2720d tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:43:45.750308 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-da42dadb-c9ba-4a82-8499-892488d2720d tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2beee1a677a47b48dd244a12de6dac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be36356ccbf4266819b18ca6cee6d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:43:45.758516 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-da42dadb-c9ba-4a82-8499-892488d2720d tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] 10.222.0.26 "GET /compute/v2.1/servers/a3f6deb2-34ba-4813-9c6c-433cfa3108c6" status: 200 len: 1521 microversion: 2.1 time: 0.157817 Oct 08 21:43:45.759115 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3225/6376] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:43:45 2022] GET /compute/v2.1/servers/a3f6deb2-34ba-4813-9c6c-433cfa3108c6 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:43:46.782478 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-d118523a-0199-41ab-a53a-85b514de8ff0 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:43:46.783102 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-d118523a-0199-41ab-a53a-85b514de8ff0 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] [instance: a3f6deb2-34ba-4813-9c6c-433cfa3108c6] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:43:46.790100 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d118523a-0199-41ab-a53a-85b514de8ff0 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:43:46.790592 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d118523a-0199-41ab-a53a-85b514de8ff0 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:43:46.791041 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d118523a-0199-41ab-a53a-85b514de8ff0 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:43:46.791741 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d118523a-0199-41ab-a53a-85b514de8ff0 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:43:46.792205 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d118523a-0199-41ab-a53a-85b514de8ff0 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:43:46.792638 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d118523a-0199-41ab-a53a-85b514de8ff0 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:43:46.923666 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-d118523a-0199-41ab-a53a-85b514de8ff0 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2beee1a677a47b48dd244a12de6dac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be36356ccbf4266819b18ca6cee6d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:43:46.931512 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-d118523a-0199-41ab-a53a-85b514de8ff0 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] 10.222.0.26 "GET /compute/v2.1/servers/a3f6deb2-34ba-4813-9c6c-433cfa3108c6" status: 200 len: 1521 microversion: 2.1 time: 0.153583 Oct 08 21:43:46.932093 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3152/6377] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:43:46 2022] GET /compute/v2.1/servers/a3f6deb2-34ba-4813-9c6c-433cfa3108c6 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:43:47.954463 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-dc673685-edf7-4938-92c5-a35e7f6a42a5 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:43:47.955099 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-dc673685-edf7-4938-92c5-a35e7f6a42a5 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] [instance: a3f6deb2-34ba-4813-9c6c-433cfa3108c6] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:43:47.962141 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dc673685-edf7-4938-92c5-a35e7f6a42a5 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:43:47.962652 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dc673685-edf7-4938-92c5-a35e7f6a42a5 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:43:47.963118 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dc673685-edf7-4938-92c5-a35e7f6a42a5 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:43:47.963840 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dc673685-edf7-4938-92c5-a35e7f6a42a5 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:43:47.964318 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dc673685-edf7-4938-92c5-a35e7f6a42a5 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:43:47.964769 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dc673685-edf7-4938-92c5-a35e7f6a42a5 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:43:48.097710 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-dc673685-edf7-4938-92c5-a35e7f6a42a5 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2beee1a677a47b48dd244a12de6dac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be36356ccbf4266819b18ca6cee6d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:43:48.105537 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-dc673685-edf7-4938-92c5-a35e7f6a42a5 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] 10.222.0.26 "GET /compute/v2.1/servers/a3f6deb2-34ba-4813-9c6c-433cfa3108c6" status: 200 len: 1521 microversion: 2.1 time: 0.155036 Oct 08 21:43:48.106150 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3226/6378] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:43:47 2022] GET /compute/v2.1/servers/a3f6deb2-34ba-4813-9c6c-433cfa3108c6 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:43:49.129706 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-887c13ae-113d-4c02-8780-2f54d707a7cc tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:43:49.130329 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-887c13ae-113d-4c02-8780-2f54d707a7cc tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] [instance: a3f6deb2-34ba-4813-9c6c-433cfa3108c6] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:43:49.137357 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-887c13ae-113d-4c02-8780-2f54d707a7cc tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:43:49.137858 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-887c13ae-113d-4c02-8780-2f54d707a7cc tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:43:49.138306 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-887c13ae-113d-4c02-8780-2f54d707a7cc tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:43:49.139009 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-887c13ae-113d-4c02-8780-2f54d707a7cc tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:43:49.139477 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-887c13ae-113d-4c02-8780-2f54d707a7cc tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:43:49.139913 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-887c13ae-113d-4c02-8780-2f54d707a7cc tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:43:49.266381 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-887c13ae-113d-4c02-8780-2f54d707a7cc tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2beee1a677a47b48dd244a12de6dac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be36356ccbf4266819b18ca6cee6d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:43:49.274145 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-887c13ae-113d-4c02-8780-2f54d707a7cc tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] 10.222.0.26 "GET /compute/v2.1/servers/a3f6deb2-34ba-4813-9c6c-433cfa3108c6" status: 200 len: 1521 microversion: 2.1 time: 0.148362 Oct 08 21:43:49.274720 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3153/6379] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:43:49 2022] GET /compute/v2.1/servers/a3f6deb2-34ba-4813-9c6c-433cfa3108c6 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:43:50.297382 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-6d19a829-37f2-420b-9b01-a74f03ed270c tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:43:50.298324 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-6d19a829-37f2-420b-9b01-a74f03ed270c tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] [instance: a3f6deb2-34ba-4813-9c6c-433cfa3108c6] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:43:50.305548 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6d19a829-37f2-420b-9b01-a74f03ed270c tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:43:50.306087 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6d19a829-37f2-420b-9b01-a74f03ed270c tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:43:50.306502 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6d19a829-37f2-420b-9b01-a74f03ed270c tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:43:50.307216 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6d19a829-37f2-420b-9b01-a74f03ed270c tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:43:50.307688 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6d19a829-37f2-420b-9b01-a74f03ed270c tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:43:50.308130 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6d19a829-37f2-420b-9b01-a74f03ed270c tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:43:50.440883 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-6d19a829-37f2-420b-9b01-a74f03ed270c tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2beee1a677a47b48dd244a12de6dac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be36356ccbf4266819b18ca6cee6d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:43:50.448970 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-6d19a829-37f2-420b-9b01-a74f03ed270c tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] 10.222.0.26 "GET /compute/v2.1/servers/a3f6deb2-34ba-4813-9c6c-433cfa3108c6" status: 200 len: 1521 microversion: 2.1 time: 0.155612 Oct 08 21:43:50.449583 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3227/6380] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:43:50 2022] GET /compute/v2.1/servers/a3f6deb2-34ba-4813-9c6c-433cfa3108c6 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:43:51.025099 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-edd6d6e7-2558-4811-b857-5b49ea0b9969 req-a457eba8-c501-4fd5-8930-3b1a31b45b8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3f6deb2-34ba-4813-9c6c-433cfa3108c6", "name": "network-vif-unplugged", "status": "completed", "tag": "992c958b-e57c-4976-bbdb-f57c202f3723"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:43:51.035223 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-edd6d6e7-2558-4811-b857-5b49ea0b9969 req-a457eba8-c501-4fd5-8930-3b1a31b45b8e service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:43:51.035866 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-edd6d6e7-2558-4811-b857-5b49ea0b9969 req-a457eba8-c501-4fd5-8930-3b1a31b45b8e service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:43:51.036408 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-edd6d6e7-2558-4811-b857-5b49ea0b9969 req-a457eba8-c501-4fd5-8930-3b1a31b45b8e service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:43:51.049559 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-edd6d6e7-2558-4811-b857-5b49ea0b9969 req-a457eba8-c501-4fd5-8930-3b1a31b45b8e service nova] Creating event network-vif-unplugged:992c958b-e57c-4976-bbdb-f57c202f3723 for instance a3f6deb2-34ba-4813-9c6c-433cfa3108c6 on nch2-master-1 Oct 08 21:43:51.055538 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [req-edd6d6e7-2558-4811-b857-5b49ea0b9969 req-a457eba8-c501-4fd5-8930-3b1a31b45b8e service nova] Instance a3f6deb2-34ba-4813-9c6c-433cfa3108c6 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140491) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 08 21:43:51.066863 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-edd6d6e7-2558-4811-b857-5b49ea0b9969 req-a457eba8-c501-4fd5-8930-3b1a31b45b8e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045753 Oct 08 21:43:51.067471 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3154/6381] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:43:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:43:51.472064 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-8fbc46bd-1c69-44be-9b42-64e8e3f64fd6 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:43:51.472710 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-8fbc46bd-1c69-44be-9b42-64e8e3f64fd6 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] [instance: a3f6deb2-34ba-4813-9c6c-433cfa3108c6] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:43:51.480025 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8fbc46bd-1c69-44be-9b42-64e8e3f64fd6 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:43:51.480915 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8fbc46bd-1c69-44be-9b42-64e8e3f64fd6 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:43:51.481030 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8fbc46bd-1c69-44be-9b42-64e8e3f64fd6 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:43:51.481743 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8fbc46bd-1c69-44be-9b42-64e8e3f64fd6 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:43:51.482713 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8fbc46bd-1c69-44be-9b42-64e8e3f64fd6 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:43:51.483188 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8fbc46bd-1c69-44be-9b42-64e8e3f64fd6 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:43:51.684937 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-8fbc46bd-1c69-44be-9b42-64e8e3f64fd6 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2beee1a677a47b48dd244a12de6dac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be36356ccbf4266819b18ca6cee6d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:43:51.692999 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-8fbc46bd-1c69-44be-9b42-64e8e3f64fd6 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] 10.222.0.26 "GET /compute/v2.1/servers/a3f6deb2-34ba-4813-9c6c-433cfa3108c6" status: 200 len: 1520 microversion: 2.1 time: 0.224912 Oct 08 21:43:51.693628 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3228/6382] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:43:51 2022] GET /compute/v2.1/servers/a3f6deb2-34ba-4813-9c6c-433cfa3108c6 => generated 1520 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:43:52.718970 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-b6cce4b6-68ca-4964-ae8b-cb96a41d0b46 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:43:52.719676 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-b6cce4b6-68ca-4964-ae8b-cb96a41d0b46 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] [instance: a3f6deb2-34ba-4813-9c6c-433cfa3108c6] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:43:52.725910 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b6cce4b6-68ca-4964-ae8b-cb96a41d0b46 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:43:52.726397 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b6cce4b6-68ca-4964-ae8b-cb96a41d0b46 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:43:52.726838 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b6cce4b6-68ca-4964-ae8b-cb96a41d0b46 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:43:52.727532 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b6cce4b6-68ca-4964-ae8b-cb96a41d0b46 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:43:52.727987 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b6cce4b6-68ca-4964-ae8b-cb96a41d0b46 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:43:52.728422 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b6cce4b6-68ca-4964-ae8b-cb96a41d0b46 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:43:52.863491 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-b6cce4b6-68ca-4964-ae8b-cb96a41d0b46 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2beee1a677a47b48dd244a12de6dac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be36356ccbf4266819b18ca6cee6d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:43:52.871326 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-b6cce4b6-68ca-4964-ae8b-cb96a41d0b46 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] 10.222.0.26 "GET /compute/v2.1/servers/a3f6deb2-34ba-4813-9c6c-433cfa3108c6" status: 200 len: 1518 microversion: 2.1 time: 0.158236 Oct 08 21:43:52.871908 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3155/6383] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:43:52 2022] GET /compute/v2.1/servers/a3f6deb2-34ba-4813-9c6c-433cfa3108c6 => generated 1518 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:43:53.084277 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-4b442d41-e8b3-4d48-be55-342917222cb9 req-57a469a5-8438-4947-adbf-8b86ec881d64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3f6deb2-34ba-4813-9c6c-433cfa3108c6", "tag": "992c958b-e57c-4976-bbdb-f57c202f3723"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:43:53.095410 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-4b442d41-e8b3-4d48-be55-342917222cb9 req-57a469a5-8438-4947-adbf-8b86ec881d64 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:43:53.095913 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-4b442d41-e8b3-4d48-be55-342917222cb9 req-57a469a5-8438-4947-adbf-8b86ec881d64 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:43:53.096376 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-4b442d41-e8b3-4d48-be55-342917222cb9 req-57a469a5-8438-4947-adbf-8b86ec881d64 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:43:53.108684 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-4b442d41-e8b3-4d48-be55-342917222cb9 req-57a469a5-8438-4947-adbf-8b86ec881d64 service nova] Creating event network-changed:992c958b-e57c-4976-bbdb-f57c202f3723 for instance a3f6deb2-34ba-4813-9c6c-433cfa3108c6 on nch2-master-1 Oct 08 21:43:53.114798 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [req-4b442d41-e8b3-4d48-be55-342917222cb9 req-57a469a5-8438-4947-adbf-8b86ec881d64 service nova] Instance a3f6deb2-34ba-4813-9c6c-433cfa3108c6 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140492) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 08 21:43:53.126249 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-4b442d41-e8b3-4d48-be55-342917222cb9 req-57a469a5-8438-4947-adbf-8b86ec881d64 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045661 Oct 08 21:43:53.127570 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3229/6384] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:43:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 08 21:43:53.895602 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c93cf2cb-60fc-4911-ac67-9a5ab59ad4c5 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:43:53.896136 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-c93cf2cb-60fc-4911-ac67-9a5ab59ad4c5 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] [instance: a3f6deb2-34ba-4813-9c6c-433cfa3108c6] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:43:53.903104 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c93cf2cb-60fc-4911-ac67-9a5ab59ad4c5 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:43:53.903599 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c93cf2cb-60fc-4911-ac67-9a5ab59ad4c5 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:43:53.904054 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c93cf2cb-60fc-4911-ac67-9a5ab59ad4c5 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:43:53.904758 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c93cf2cb-60fc-4911-ac67-9a5ab59ad4c5 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:43:53.905245 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c93cf2cb-60fc-4911-ac67-9a5ab59ad4c5 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:43:53.905688 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c93cf2cb-60fc-4911-ac67-9a5ab59ad4c5 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:43:54.035047 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-c93cf2cb-60fc-4911-ac67-9a5ab59ad4c5 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2beee1a677a47b48dd244a12de6dac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be36356ccbf4266819b18ca6cee6d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:43:54.042865 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-c93cf2cb-60fc-4911-ac67-9a5ab59ad4c5 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] 10.222.0.26 "GET /compute/v2.1/servers/a3f6deb2-34ba-4813-9c6c-433cfa3108c6" status: 200 len: 1515 microversion: 2.1 time: 0.151289 Oct 08 21:43:54.043443 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3156/6385] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:43:53 2022] GET /compute/v2.1/servers/a3f6deb2-34ba-4813-9c6c-433cfa3108c6 => generated 1515 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:43:54.066870 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e2c2d13a-3235-44aa-86fb-f237dd405199 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:43:54.067516 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-e2c2d13a-3235-44aa-86fb-f237dd405199 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] [instance: a3f6deb2-34ba-4813-9c6c-433cfa3108c6] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:43:54.074111 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e2c2d13a-3235-44aa-86fb-f237dd405199 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:43:54.074626 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e2c2d13a-3235-44aa-86fb-f237dd405199 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:43:54.075087 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e2c2d13a-3235-44aa-86fb-f237dd405199 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:43:54.075802 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e2c2d13a-3235-44aa-86fb-f237dd405199 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:43:54.076281 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e2c2d13a-3235-44aa-86fb-f237dd405199 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:43:54.076732 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e2c2d13a-3235-44aa-86fb-f237dd405199 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:43:54.137677 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-e2c2d13a-3235-44aa-86fb-f237dd405199 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] 10.222.0.26 "POST /compute/v2.1/servers/a3f6deb2-34ba-4813-9c6c-433cfa3108c6/action" status: 204 len: 0 microversion: 2.1 time: 0.074898 Oct 08 21:43:54.138361 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3230/6386] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:43:54 2022] POST /compute/v2.1/servers/a3f6deb2-34ba-4813-9c6c-433cfa3108c6/action => generated 0 bytes in 77 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 21:43:54.146861 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-7acc0ab7-6e12-4156-a41d-55f6d3ba4c3a tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:43:54.147537 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-7acc0ab7-6e12-4156-a41d-55f6d3ba4c3a tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] [instance: a3f6deb2-34ba-4813-9c6c-433cfa3108c6] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:43:54.153836 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7acc0ab7-6e12-4156-a41d-55f6d3ba4c3a tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:43:54.154419 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7acc0ab7-6e12-4156-a41d-55f6d3ba4c3a tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:43:54.154978 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7acc0ab7-6e12-4156-a41d-55f6d3ba4c3a tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:43:54.155762 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7acc0ab7-6e12-4156-a41d-55f6d3ba4c3a tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:43:54.156298 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7acc0ab7-6e12-4156-a41d-55f6d3ba4c3a tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:43:54.156812 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7acc0ab7-6e12-4156-a41d-55f6d3ba4c3a tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:43:54.377857 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-7acc0ab7-6e12-4156-a41d-55f6d3ba4c3a tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2beee1a677a47b48dd244a12de6dac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be36356ccbf4266819b18ca6cee6d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:43:54.385986 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-7acc0ab7-6e12-4156-a41d-55f6d3ba4c3a tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] 10.222.0.26 "GET /compute/v2.1/servers/a3f6deb2-34ba-4813-9c6c-433cfa3108c6" status: 200 len: 1515 microversion: 2.1 time: 0.243096 Oct 08 21:43:54.386828 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3157/6387] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:43:54 2022] GET /compute/v2.1/servers/a3f6deb2-34ba-4813-9c6c-433cfa3108c6 => generated 1515 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:43:55.410233 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-d1d8f7e1-d7e8-4d71-a3f3-2848eaa0729e tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:43:55.410886 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-d1d8f7e1-d7e8-4d71-a3f3-2848eaa0729e tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] [instance: a3f6deb2-34ba-4813-9c6c-433cfa3108c6] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:43:55.417405 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d1d8f7e1-d7e8-4d71-a3f3-2848eaa0729e tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:43:55.417925 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d1d8f7e1-d7e8-4d71-a3f3-2848eaa0729e tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:43:55.418389 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d1d8f7e1-d7e8-4d71-a3f3-2848eaa0729e tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:43:55.419189 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d1d8f7e1-d7e8-4d71-a3f3-2848eaa0729e tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:43:55.419686 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d1d8f7e1-d7e8-4d71-a3f3-2848eaa0729e tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:43:55.420142 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d1d8f7e1-d7e8-4d71-a3f3-2848eaa0729e tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:43:55.624164 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-d1d8f7e1-d7e8-4d71-a3f3-2848eaa0729e tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2beee1a677a47b48dd244a12de6dac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be36356ccbf4266819b18ca6cee6d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:43:55.632313 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-d1d8f7e1-d7e8-4d71-a3f3-2848eaa0729e tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] 10.222.0.26 "GET /compute/v2.1/servers/a3f6deb2-34ba-4813-9c6c-433cfa3108c6" status: 200 len: 1515 microversion: 2.1 time: 0.227841 Oct 08 21:43:55.632932 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3231/6388] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:43:55 2022] GET /compute/v2.1/servers/a3f6deb2-34ba-4813-9c6c-433cfa3108c6 => generated 1515 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:43:56.263281 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-3f618cc4-2fcc-4225-84bb-a0ce82292fc9 req-b6bdd52e-86e4-4734-9bf9-ebf8ae02fb4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3f6deb2-34ba-4813-9c6c-433cfa3108c6", "name": "network-vif-plugged", "status": "completed", "tag": "992c958b-e57c-4976-bbdb-f57c202f3723"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:43:56.277179 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-3f618cc4-2fcc-4225-84bb-a0ce82292fc9 req-b6bdd52e-86e4-4734-9bf9-ebf8ae02fb4d service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:43:56.277682 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-3f618cc4-2fcc-4225-84bb-a0ce82292fc9 req-b6bdd52e-86e4-4734-9bf9-ebf8ae02fb4d service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:43:56.278120 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-3f618cc4-2fcc-4225-84bb-a0ce82292fc9 req-b6bdd52e-86e4-4734-9bf9-ebf8ae02fb4d service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:43:56.289820 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-3f618cc4-2fcc-4225-84bb-a0ce82292fc9 req-b6bdd52e-86e4-4734-9bf9-ebf8ae02fb4d service nova] Creating event network-vif-plugged:992c958b-e57c-4976-bbdb-f57c202f3723 for instance a3f6deb2-34ba-4813-9c6c-433cfa3108c6 on nch2-master-1 Oct 08 21:43:56.294874 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-3f618cc4-2fcc-4225-84bb-a0ce82292fc9 req-b6bdd52e-86e4-4734-9bf9-ebf8ae02fb4d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036010 Oct 08 21:43:56.295755 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3158/6389] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:43:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:43:56.655896 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-451cbae5-bbb8-45e9-84bd-4f2fbcbbe64b tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:43:56.656448 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-451cbae5-bbb8-45e9-84bd-4f2fbcbbe64b tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] [instance: a3f6deb2-34ba-4813-9c6c-433cfa3108c6] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:43:56.663349 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-451cbae5-bbb8-45e9-84bd-4f2fbcbbe64b tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:43:56.663850 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-451cbae5-bbb8-45e9-84bd-4f2fbcbbe64b tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:43:56.664305 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-451cbae5-bbb8-45e9-84bd-4f2fbcbbe64b tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:43:56.665011 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-451cbae5-bbb8-45e9-84bd-4f2fbcbbe64b tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:43:56.665515 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-451cbae5-bbb8-45e9-84bd-4f2fbcbbe64b tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:43:56.665958 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-451cbae5-bbb8-45e9-84bd-4f2fbcbbe64b tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:43:56.797380 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-451cbae5-bbb8-45e9-84bd-4f2fbcbbe64b tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2beee1a677a47b48dd244a12de6dac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be36356ccbf4266819b18ca6cee6d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:43:56.805208 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-451cbae5-bbb8-45e9-84bd-4f2fbcbbe64b tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] 10.222.0.26 "GET /compute/v2.1/servers/a3f6deb2-34ba-4813-9c6c-433cfa3108c6" status: 200 len: 1507 microversion: 2.1 time: 0.153363 Oct 08 21:43:56.805801 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3232/6390] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:43:56 2022] GET /compute/v2.1/servers/a3f6deb2-34ba-4813-9c6c-433cfa3108c6 => generated 1507 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:43:56.827760 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c0e88b2b-ac79-4f93-b5f9-12b9dec0b9ef tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:43:56.828463 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-c0e88b2b-ac79-4f93-b5f9-12b9dec0b9ef tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] [instance: a3f6deb2-34ba-4813-9c6c-433cfa3108c6] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:43:56.835127 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c0e88b2b-ac79-4f93-b5f9-12b9dec0b9ef tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:43:56.835648 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c0e88b2b-ac79-4f93-b5f9-12b9dec0b9ef tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:43:56.836093 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c0e88b2b-ac79-4f93-b5f9-12b9dec0b9ef tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:43:56.836790 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c0e88b2b-ac79-4f93-b5f9-12b9dec0b9ef tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:43:56.837286 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c0e88b2b-ac79-4f93-b5f9-12b9dec0b9ef tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:43:56.837713 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c0e88b2b-ac79-4f93-b5f9-12b9dec0b9ef tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:43:57.022757 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-c0e88b2b-ac79-4f93-b5f9-12b9dec0b9ef tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2beee1a677a47b48dd244a12de6dac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be36356ccbf4266819b18ca6cee6d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:43:57.030979 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-c0e88b2b-ac79-4f93-b5f9-12b9dec0b9ef tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] 10.222.0.26 "GET /compute/v2.1/servers/a3f6deb2-34ba-4813-9c6c-433cfa3108c6" status: 200 len: 1507 microversion: 2.1 time: 0.207689 Oct 08 21:43:57.031552 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3159/6391] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:43:56 2022] GET /compute/v2.1/servers/a3f6deb2-34ba-4813-9c6c-433cfa3108c6 => generated 1507 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:43:57.056587 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-33800257-ad72-4ee6-ad15-5a2b873f2f6f tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Action: 'create', calling method: .version_select at 0x7f1a8c0623a0>, body: {"keypair": {"name": "tempest-keypair-510640017", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL+rmb9wNG+0gkPnjqWi5iSUJ9sne2ieJ891IOe6Xh6n1u/UBoMP0SYqvS4dfZYZOGSvLC3kma/hgo57ZmA08Jru7ZA+ezoGfxy+bkFlrHpjmfyjDLH4MOFXHQEGbpEkbg=="}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:43:57.062048 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=32 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:43:57.073937 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-33800257-ad72-4ee6-ad15-5a2b873f2f6f tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Getting quotas for project 1be36356ccbf4266819b18ca6cee6d97. Resources: {'key_pairs'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:43:57.079143 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-33800257-ad72-4ee6-ad15-5a2b873f2f6f tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Getting quotas for user b2beee1a677a47b48dd244a12de6dac0 and project 1be36356ccbf4266819b18ca6cee6d97. Resources: {'key_pairs'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:43:57.107223 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-33800257-ad72-4ee6-ad15-5a2b873f2f6f tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.054520 Oct 08 21:43:57.107838 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3233/6392] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Oct 8 21:43:57 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 08 21:43:58.271346 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-ec808641-27b6-4960-bc10-d2485fb15af3 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:43:58.271962 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-ec808641-27b6-4960-bc10-d2485fb15af3 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] [instance: a3f6deb2-34ba-4813-9c6c-433cfa3108c6] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:43:58.274965 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:SELECT=32 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:43:58.281386 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ec808641-27b6-4960-bc10-d2485fb15af3 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:43:58.281890 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ec808641-27b6-4960-bc10-d2485fb15af3 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:43:58.282348 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ec808641-27b6-4960-bc10-d2485fb15af3 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:43:58.283092 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ec808641-27b6-4960-bc10-d2485fb15af3 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:43:58.283561 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ec808641-27b6-4960-bc10-d2485fb15af3 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:43:58.283998 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ec808641-27b6-4960-bc10-d2485fb15af3 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:43:58.288119 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=90 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:43:58.418176 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-ec808641-27b6-4960-bc10-d2485fb15af3 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2beee1a677a47b48dd244a12de6dac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be36356ccbf4266819b18ca6cee6d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:43:58.426641 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-ec808641-27b6-4960-bc10-d2485fb15af3 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] 10.222.0.26 "GET /compute/v2.1/servers/a3f6deb2-34ba-4813-9c6c-433cfa3108c6" status: 200 len: 1507 microversion: 2.1 time: 0.159263 Oct 08 21:43:58.427215 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3160/6393] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:43:58 2022] GET /compute/v2.1/servers/a3f6deb2-34ba-4813-9c6c-433cfa3108c6 => generated 1507 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:43:58.449969 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e2541d07-dd0b-4a48-a67b-1be70e17edfb tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:43:58.450500 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-e2541d07-dd0b-4a48-a67b-1be70e17edfb tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] [instance: a3f6deb2-34ba-4813-9c6c-433cfa3108c6] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:43:58.457228 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e2541d07-dd0b-4a48-a67b-1be70e17edfb tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:43:58.457747 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e2541d07-dd0b-4a48-a67b-1be70e17edfb tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:43:58.458217 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e2541d07-dd0b-4a48-a67b-1be70e17edfb tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:43:58.458936 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e2541d07-dd0b-4a48-a67b-1be70e17edfb tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:43:58.459420 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e2541d07-dd0b-4a48-a67b-1be70e17edfb tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:43:58.459874 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e2541d07-dd0b-4a48-a67b-1be70e17edfb tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:43:58.485547 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-e2541d07-dd0b-4a48-a67b-1be70e17edfb tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] [instance: a3f6deb2-34ba-4813-9c6c-433cfa3108c6] Going to try to terminate instance {{(pid=140492) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 21:43:58.562051 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-e2541d07-dd0b-4a48-a67b-1be70e17edfb tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] 10.222.0.26 "DELETE /compute/v2.1/servers/a3f6deb2-34ba-4813-9c6c-433cfa3108c6" status: 204 len: 0 microversion: 2.1 time: 0.116837 Oct 08 21:43:58.562784 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3234/6394] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:43:58 2022] DELETE /compute/v2.1/servers/a3f6deb2-34ba-4813-9c6c-433cfa3108c6 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 21:43:58.617606 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-bf69baa1-4345-475a-a7b2-190aa3260ef8 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1670878203", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "networks": [{"uuid": "688af551-9106-4b92-beb8-062298ee01e4"}]}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:43:58.671540 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.network.neutron [None req-bf69baa1-4345-475a-a7b2-190aa3260ef8 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] validate_networks() for [('688af551-9106-4b92-beb8-062298ee01e4', None, None, None, None, None)] {{(pid=140491) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 21:43:59.036025 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-bf69baa1-4345-475a-a7b2-190aa3260ef8 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Flavor limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 21:43:59.036460 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-bf69baa1-4345-475a-a7b2-190aa3260ef8 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Image limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 21:43:59.036949 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-bf69baa1-4345-475a-a7b2-190aa3260ef8 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Flavor pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 21:43:59.037412 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-bf69baa1-4345-475a-a7b2-190aa3260ef8 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Image pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 21:43:59.037836 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-bf69baa1-4345-475a-a7b2-190aa3260ef8 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 21:43:59.046866 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bf69baa1-4345-475a-a7b2-190aa3260ef8 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:43:59.047353 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bf69baa1-4345-475a-a7b2-190aa3260ef8 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:43:59.047798 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bf69baa1-4345-475a-a7b2-190aa3260ef8 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:43:59.048538 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bf69baa1-4345-475a-a7b2-190aa3260ef8 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:43:59.049003 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bf69baa1-4345-475a-a7b2-190aa3260ef8 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:43:59.049473 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bf69baa1-4345-475a-a7b2-190aa3260ef8 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:43:59.066888 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-bf69baa1-4345-475a-a7b2-190aa3260ef8 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Getting quotas for project 1be36356ccbf4266819b18ca6cee6d97. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:43:59.072433 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-bf69baa1-4345-475a-a7b2-190aa3260ef8 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Getting quotas for user b2beee1a677a47b48dd244a12de6dac0 and project 1be36356ccbf4266819b18ca6cee6d97. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:43:59.085533 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-bf69baa1-4345-475a-a7b2-190aa3260ef8 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Going to run 1 instances... {{(pid=140491) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 21:43:59.087836 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-bf69baa1-4345-475a-a7b2-190aa3260ef8 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] [instance: fc399f31-567a-44d4-b68a-899a9870aadb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c508bd7f-7db9-4b2c-af7c-be54a855c355',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140491) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 21:43:59.132516 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-bf69baa1-4345-475a-a7b2-190aa3260ef8 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.518952 Oct 08 21:43:59.133176 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3161/6395] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 21:43:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 520 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 08 21:43:59.145379 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-ec0d83bc-eb09-4f45-b561-bbc1f77ee96a tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:43:59.146106 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-ec0d83bc-eb09-4f45-b561-bbc1f77ee96a tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] [instance: fc399f31-567a-44d4-b68a-899a9870aadb] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:43:59.203839 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-ec0d83bc-eb09-4f45-b561-bbc1f77ee96a tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2beee1a677a47b48dd244a12de6dac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be36356ccbf4266819b18ca6cee6d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:43:59.211129 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-ec0d83bc-eb09-4f45-b561-bbc1f77ee96a tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] 10.222.0.26 "GET /compute/v2.1/servers/fc399f31-567a-44d4-b68a-899a9870aadb" status: 200 len: 1218 microversion: 2.1 time: 0.069970 Oct 08 21:43:59.211717 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3235/6396] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:43:59 2022] GET /compute/v2.1/servers/fc399f31-567a-44d4-b68a-899a9870aadb => generated 1218 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:44:00.237274 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c71cf219-6039-40ff-8c93-4bf0c532fddf tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:44:00.237907 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-c71cf219-6039-40ff-8c93-4bf0c532fddf tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] [instance: fc399f31-567a-44d4-b68a-899a9870aadb] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:44:00.245156 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c71cf219-6039-40ff-8c93-4bf0c532fddf tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:44:00.245719 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c71cf219-6039-40ff-8c93-4bf0c532fddf tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:44:00.246169 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c71cf219-6039-40ff-8c93-4bf0c532fddf tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:44:00.246885 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c71cf219-6039-40ff-8c93-4bf0c532fddf tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:44:00.247354 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c71cf219-6039-40ff-8c93-4bf0c532fddf tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:44:00.247791 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c71cf219-6039-40ff-8c93-4bf0c532fddf tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:44:00.313958 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-c71cf219-6039-40ff-8c93-4bf0c532fddf tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2beee1a677a47b48dd244a12de6dac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be36356ccbf4266819b18ca6cee6d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:44:00.323433 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-c71cf219-6039-40ff-8c93-4bf0c532fddf tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] 10.222.0.26 "GET /compute/v2.1/servers/fc399f31-567a-44d4-b68a-899a9870aadb" status: 200 len: 1270 microversion: 2.1 time: 0.091904 Oct 08 21:44:00.332860 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3162/6397] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:44:00 2022] GET /compute/v2.1/servers/fc399f31-567a-44d4-b68a-899a9870aadb => generated 1270 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:44:00.411106 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-229fd5e4-16ec-405c-a592-9c8a4223304f req-cd86740d-348f-469b-abf3-1dc4135ab056 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3f6deb2-34ba-4813-9c6c-433cfa3108c6", "name": "network-vif-deleted", "tag": "992c958b-e57c-4976-bbdb-f57c202f3723"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:44:00.426759 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-229fd5e4-16ec-405c-a592-9c8a4223304f req-cd86740d-348f-469b-abf3-1dc4135ab056 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:44:00.427686 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-229fd5e4-16ec-405c-a592-9c8a4223304f req-cd86740d-348f-469b-abf3-1dc4135ab056 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:44:00.428372 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-229fd5e4-16ec-405c-a592-9c8a4223304f req-cd86740d-348f-469b-abf3-1dc4135ab056 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:44:00.448706 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-229fd5e4-16ec-405c-a592-9c8a4223304f req-cd86740d-348f-469b-abf3-1dc4135ab056 service nova] Creating event network-vif-deleted:992c958b-e57c-4976-bbdb-f57c202f3723 for instance a3f6deb2-34ba-4813-9c6c-433cfa3108c6 on nch2-master-1 Oct 08 21:44:00.458130 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-229fd5e4-16ec-405c-a592-9c8a4223304f req-cd86740d-348f-469b-abf3-1dc4135ab056 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050850 Oct 08 21:44:00.459810 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3236/6398] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:44:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:44:01.348180 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-76cce506-a7d4-444c-a381-ed77644505c6 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:44:01.348791 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-76cce506-a7d4-444c-a381-ed77644505c6 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] [instance: fc399f31-567a-44d4-b68a-899a9870aadb] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:44:01.355933 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-76cce506-a7d4-444c-a381-ed77644505c6 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:44:01.356433 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-76cce506-a7d4-444c-a381-ed77644505c6 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:44:01.357019 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-76cce506-a7d4-444c-a381-ed77644505c6 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:44:01.357976 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-76cce506-a7d4-444c-a381-ed77644505c6 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:44:01.358437 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-76cce506-a7d4-444c-a381-ed77644505c6 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:44:01.359045 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-76cce506-a7d4-444c-a381-ed77644505c6 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:44:01.490263 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-76cce506-a7d4-444c-a381-ed77644505c6 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2beee1a677a47b48dd244a12de6dac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be36356ccbf4266819b18ca6cee6d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:44:01.499483 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-76cce506-a7d4-444c-a381-ed77644505c6 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] 10.222.0.26 "GET /compute/v2.1/servers/fc399f31-567a-44d4-b68a-899a9870aadb" status: 200 len: 1318 microversion: 2.1 time: 0.155486 Oct 08 21:44:01.500073 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3163/6399] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:44:01 2022] GET /compute/v2.1/servers/fc399f31-567a-44d4-b68a-899a9870aadb => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:44:02.494461 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-a70ffcb3-fefc-496d-87a5-cd671408b045 req-411c3e0c-21e0-40a2-9c9b-2d2fe9714d72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc399f31-567a-44d4-b68a-899a9870aadb", "tag": "d870e1ed-0cd2-4df8-ac8a-d3e4addc828b"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:44:02.503968 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-a70ffcb3-fefc-496d-87a5-cd671408b045 req-411c3e0c-21e0-40a2-9c9b-2d2fe9714d72 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:44:02.504468 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-a70ffcb3-fefc-496d-87a5-cd671408b045 req-411c3e0c-21e0-40a2-9c9b-2d2fe9714d72 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:44:02.504921 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-a70ffcb3-fefc-496d-87a5-cd671408b045 req-411c3e0c-21e0-40a2-9c9b-2d2fe9714d72 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:44:02.516250 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-a70ffcb3-fefc-496d-87a5-cd671408b045 req-411c3e0c-21e0-40a2-9c9b-2d2fe9714d72 service nova] Creating event network-changed:d870e1ed-0cd2-4df8-ac8a-d3e4addc828b for instance fc399f31-567a-44d4-b68a-899a9870aadb on nch2-master-1 Oct 08 21:44:02.521076 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-a70ffcb3-fefc-496d-87a5-cd671408b045 req-411c3e0c-21e0-40a2-9c9b-2d2fe9714d72 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031805 Oct 08 21:44:02.521723 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3237/6400] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:44:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:44:02.522269 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-1d052fdd-ba26-4c71-9115-e05c377ddc63 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:44:02.522917 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-1d052fdd-ba26-4c71-9115-e05c377ddc63 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] [instance: fc399f31-567a-44d4-b68a-899a9870aadb] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:44:02.530618 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1d052fdd-ba26-4c71-9115-e05c377ddc63 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:44:02.531106 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1d052fdd-ba26-4c71-9115-e05c377ddc63 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:44:02.531604 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1d052fdd-ba26-4c71-9115-e05c377ddc63 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:44:02.532345 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1d052fdd-ba26-4c71-9115-e05c377ddc63 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:44:02.532809 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1d052fdd-ba26-4c71-9115-e05c377ddc63 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:44:02.533299 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1d052fdd-ba26-4c71-9115-e05c377ddc63 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:44:02.669067 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-1d052fdd-ba26-4c71-9115-e05c377ddc63 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2beee1a677a47b48dd244a12de6dac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be36356ccbf4266819b18ca6cee6d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:44:02.676997 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-1d052fdd-ba26-4c71-9115-e05c377ddc63 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] 10.222.0.26 "GET /compute/v2.1/servers/fc399f31-567a-44d4-b68a-899a9870aadb" status: 200 len: 1318 microversion: 2.1 time: 0.158727 Oct 08 21:44:02.677614 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3164/6401] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:44:02 2022] GET /compute/v2.1/servers/fc399f31-567a-44d4-b68a-899a9870aadb => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:44:03.701625 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-ddaa7985-d42f-45d9-8e7b-3d12441abdf1 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:44:03.702351 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-ddaa7985-d42f-45d9-8e7b-3d12441abdf1 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] [instance: fc399f31-567a-44d4-b68a-899a9870aadb] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:44:03.708587 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ddaa7985-d42f-45d9-8e7b-3d12441abdf1 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:44:03.709128 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ddaa7985-d42f-45d9-8e7b-3d12441abdf1 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:44:03.709642 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ddaa7985-d42f-45d9-8e7b-3d12441abdf1 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:44:03.710365 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ddaa7985-d42f-45d9-8e7b-3d12441abdf1 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:44:03.710850 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ddaa7985-d42f-45d9-8e7b-3d12441abdf1 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:44:03.711298 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ddaa7985-d42f-45d9-8e7b-3d12441abdf1 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:44:03.862475 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-ddaa7985-d42f-45d9-8e7b-3d12441abdf1 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2beee1a677a47b48dd244a12de6dac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be36356ccbf4266819b18ca6cee6d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:44:03.871121 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-ddaa7985-d42f-45d9-8e7b-3d12441abdf1 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] 10.222.0.26 "GET /compute/v2.1/servers/fc399f31-567a-44d4-b68a-899a9870aadb" status: 200 len: 1318 microversion: 2.1 time: 0.174614 Oct 08 21:44:03.871720 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3238/6402] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:44:03 2022] GET /compute/v2.1/servers/fc399f31-567a-44d4-b68a-899a9870aadb => generated 1318 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:44:04.893670 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-68160f33-b6b6-4eaf-9a8a-963bb6aa5fae tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:44:04.894281 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-68160f33-b6b6-4eaf-9a8a-963bb6aa5fae tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] [instance: fc399f31-567a-44d4-b68a-899a9870aadb] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:44:04.901292 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-68160f33-b6b6-4eaf-9a8a-963bb6aa5fae tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:44:04.901778 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-68160f33-b6b6-4eaf-9a8a-963bb6aa5fae tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:44:04.902231 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-68160f33-b6b6-4eaf-9a8a-963bb6aa5fae tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:44:04.902928 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-68160f33-b6b6-4eaf-9a8a-963bb6aa5fae tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:44:04.903390 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-68160f33-b6b6-4eaf-9a8a-963bb6aa5fae tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:44:04.903818 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-68160f33-b6b6-4eaf-9a8a-963bb6aa5fae tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:44:05.031359 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-68160f33-b6b6-4eaf-9a8a-963bb6aa5fae tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2beee1a677a47b48dd244a12de6dac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be36356ccbf4266819b18ca6cee6d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:44:05.039071 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-68160f33-b6b6-4eaf-9a8a-963bb6aa5fae tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] 10.222.0.26 "GET /compute/v2.1/servers/fc399f31-567a-44d4-b68a-899a9870aadb" status: 200 len: 1318 microversion: 2.1 time: 0.149216 Oct 08 21:44:05.039648 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3165/6403] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:44:04 2022] GET /compute/v2.1/servers/fc399f31-567a-44d4-b68a-899a9870aadb => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:44:06.061622 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-54cac184-17bf-4f3d-b5f8-3f4777d9a14e tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:44:06.062726 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-54cac184-17bf-4f3d-b5f8-3f4777d9a14e tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] [instance: fc399f31-567a-44d4-b68a-899a9870aadb] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:44:06.069973 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-54cac184-17bf-4f3d-b5f8-3f4777d9a14e tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:44:06.070477 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-54cac184-17bf-4f3d-b5f8-3f4777d9a14e tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:44:06.070931 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-54cac184-17bf-4f3d-b5f8-3f4777d9a14e tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:44:06.071639 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-54cac184-17bf-4f3d-b5f8-3f4777d9a14e tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:44:06.072120 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-54cac184-17bf-4f3d-b5f8-3f4777d9a14e tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:44:06.072557 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-54cac184-17bf-4f3d-b5f8-3f4777d9a14e tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:44:06.207581 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-54cac184-17bf-4f3d-b5f8-3f4777d9a14e tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2beee1a677a47b48dd244a12de6dac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be36356ccbf4266819b18ca6cee6d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:44:06.215634 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-54cac184-17bf-4f3d-b5f8-3f4777d9a14e tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] 10.222.0.26 "GET /compute/v2.1/servers/fc399f31-567a-44d4-b68a-899a9870aadb" status: 200 len: 1318 microversion: 2.1 time: 0.158008 Oct 08 21:44:06.228205 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3239/6404] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:44:06 2022] GET /compute/v2.1/servers/fc399f31-567a-44d4-b68a-899a9870aadb => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:44:06.315320 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-d787cb4b-8af8-45d6-9ad2-aa3cc7045d25 req-0299051f-2088-4bd0-b947-2743a5c707a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc399f31-567a-44d4-b68a-899a9870aadb", "name": "network-vif-plugged", "status": "completed", "tag": "d870e1ed-0cd2-4df8-ac8a-d3e4addc828b"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:44:06.326570 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-d787cb4b-8af8-45d6-9ad2-aa3cc7045d25 req-0299051f-2088-4bd0-b947-2743a5c707a2 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:44:06.327058 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-d787cb4b-8af8-45d6-9ad2-aa3cc7045d25 req-0299051f-2088-4bd0-b947-2743a5c707a2 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:44:06.327565 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-d787cb4b-8af8-45d6-9ad2-aa3cc7045d25 req-0299051f-2088-4bd0-b947-2743a5c707a2 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:44:06.339189 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-d787cb4b-8af8-45d6-9ad2-aa3cc7045d25 req-0299051f-2088-4bd0-b947-2743a5c707a2 service nova] Creating event network-vif-plugged:d870e1ed-0cd2-4df8-ac8a-d3e4addc828b for instance fc399f31-567a-44d4-b68a-899a9870aadb on nch2-master-1 Oct 08 21:44:06.344122 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-d787cb4b-8af8-45d6-9ad2-aa3cc7045d25 req-0299051f-2088-4bd0-b947-2743a5c707a2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033573 Oct 08 21:44:06.344726 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3166/6405] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:44:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:44:07.238150 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-37d5c092-c074-4066-aaa9-67e7ec2b561e tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:44:07.238789 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-37d5c092-c074-4066-aaa9-67e7ec2b561e tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] [instance: fc399f31-567a-44d4-b68a-899a9870aadb] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:44:07.245824 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-37d5c092-c074-4066-aaa9-67e7ec2b561e tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:44:07.246340 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-37d5c092-c074-4066-aaa9-67e7ec2b561e tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:44:07.246806 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-37d5c092-c074-4066-aaa9-67e7ec2b561e tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:44:07.247530 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-37d5c092-c074-4066-aaa9-67e7ec2b561e tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:44:07.248020 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-37d5c092-c074-4066-aaa9-67e7ec2b561e tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:44:07.248471 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-37d5c092-c074-4066-aaa9-67e7ec2b561e tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:44:07.384235 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-37d5c092-c074-4066-aaa9-67e7ec2b561e tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2beee1a677a47b48dd244a12de6dac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be36356ccbf4266819b18ca6cee6d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:44:07.392844 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-37d5c092-c074-4066-aaa9-67e7ec2b561e tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] 10.222.0.26 "GET /compute/v2.1/servers/fc399f31-567a-44d4-b68a-899a9870aadb" status: 200 len: 1318 microversion: 2.1 time: 0.158615 Oct 08 21:44:07.393667 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3240/6406] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:44:07 2022] GET /compute/v2.1/servers/fc399f31-567a-44d4-b68a-899a9870aadb => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:44:08.417238 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-f0a56178-1013-40f4-b858-1ea22142cbbb tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:44:08.417951 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-f0a56178-1013-40f4-b858-1ea22142cbbb tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] [instance: fc399f31-567a-44d4-b68a-899a9870aadb] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:44:08.424446 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f0a56178-1013-40f4-b858-1ea22142cbbb tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:44:08.424945 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f0a56178-1013-40f4-b858-1ea22142cbbb tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:44:08.425428 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f0a56178-1013-40f4-b858-1ea22142cbbb tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:44:08.426145 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f0a56178-1013-40f4-b858-1ea22142cbbb tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:44:08.426614 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f0a56178-1013-40f4-b858-1ea22142cbbb tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:44:08.427050 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f0a56178-1013-40f4-b858-1ea22142cbbb tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:44:08.564267 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-f0a56178-1013-40f4-b858-1ea22142cbbb tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2beee1a677a47b48dd244a12de6dac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be36356ccbf4266819b18ca6cee6d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:44:08.572354 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-f0a56178-1013-40f4-b858-1ea22142cbbb tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] 10.222.0.26 "GET /compute/v2.1/servers/fc399f31-567a-44d4-b68a-899a9870aadb" status: 200 len: 1508 microversion: 2.1 time: 0.160350 Oct 08 21:44:08.572931 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3167/6407] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:44:08 2022] GET /compute/v2.1/servers/fc399f31-567a-44d4-b68a-899a9870aadb => generated 1508 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:44:08.595566 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-2e6a4330-0293-4bbf-ab64-bd172fe6ebd5 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:44:08.596031 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-2e6a4330-0293-4bbf-ab64-bd172fe6ebd5 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] [instance: fc399f31-567a-44d4-b68a-899a9870aadb] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:44:08.603193 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2e6a4330-0293-4bbf-ab64-bd172fe6ebd5 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:44:08.603707 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2e6a4330-0293-4bbf-ab64-bd172fe6ebd5 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:44:08.604173 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2e6a4330-0293-4bbf-ab64-bd172fe6ebd5 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:44:08.604902 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2e6a4330-0293-4bbf-ab64-bd172fe6ebd5 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:44:08.605427 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2e6a4330-0293-4bbf-ab64-bd172fe6ebd5 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:44:08.605883 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2e6a4330-0293-4bbf-ab64-bd172fe6ebd5 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:44:08.733878 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-2e6a4330-0293-4bbf-ab64-bd172fe6ebd5 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2beee1a677a47b48dd244a12de6dac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be36356ccbf4266819b18ca6cee6d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:44:08.741626 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-2e6a4330-0293-4bbf-ab64-bd172fe6ebd5 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] 10.222.0.26 "GET /compute/v2.1/servers/fc399f31-567a-44d4-b68a-899a9870aadb" status: 200 len: 1508 microversion: 2.1 time: 0.150607 Oct 08 21:44:08.742217 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3241/6408] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:44:08 2022] GET /compute/v2.1/servers/fc399f31-567a-44d4-b68a-899a9870aadb => generated 1508 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:44:08.764442 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-81ae5568-3913-42f2-bd71-4d9fb1c508b7 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:44:08.767432 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-81ae5568-3913-42f2-bd71-4d9fb1c508b7 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] [instance: fc399f31-567a-44d4-b68a-899a9870aadb] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:44:08.773620 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-81ae5568-3913-42f2-bd71-4d9fb1c508b7 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:44:08.774120 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-81ae5568-3913-42f2-bd71-4d9fb1c508b7 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:44:08.774567 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-81ae5568-3913-42f2-bd71-4d9fb1c508b7 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:44:08.775309 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-81ae5568-3913-42f2-bd71-4d9fb1c508b7 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:44:08.775772 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-81ae5568-3913-42f2-bd71-4d9fb1c508b7 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:44:08.776207 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-81ae5568-3913-42f2-bd71-4d9fb1c508b7 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:44:08.804706 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-81ae5568-3913-42f2-bd71-4d9fb1c508b7 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'b2beee1a677a47b48dd244a12de6dac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be36356ccbf4266819b18ca6cee6d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:44:08.810103 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-81ae5568-3913-42f2-bd71-4d9fb1c508b7 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] [instance: fc399f31-567a-44d4-b68a-899a9870aadb] Old instance type m1.heat2, new instance type m1.heat {{(pid=140491) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 08 21:44:08.817150 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-81ae5568-3913-42f2-bd71-4d9fb1c508b7 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Flavor limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 21:44:08.817606 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-81ae5568-3913-42f2-bd71-4d9fb1c508b7 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Image limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 21:44:08.818090 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-81ae5568-3913-42f2-bd71-4d9fb1c508b7 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Flavor pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 21:44:08.818508 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-81ae5568-3913-42f2-bd71-4d9fb1c508b7 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Image pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 21:44:08.818929 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-81ae5568-3913-42f2-bd71-4d9fb1c508b7 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 21:44:08.882266 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-81ae5568-3913-42f2-bd71-4d9fb1c508b7 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] 10.222.0.26 "POST /compute/v2.1/servers/fc399f31-567a-44d4-b68a-899a9870aadb/action" status: 202 len: 0 microversion: 2.1 time: 0.121677 Oct 08 21:44:08.882875 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3168/6409] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:44:08 2022] POST /compute/v2.1/servers/fc399f31-567a-44d4-b68a-899a9870aadb/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 21:44:08.891841 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-da96363d-4b13-4b29-97a8-589d0fc82195 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:44:08.892472 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-da96363d-4b13-4b29-97a8-589d0fc82195 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] [instance: fc399f31-567a-44d4-b68a-899a9870aadb] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:44:08.898527 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-da96363d-4b13-4b29-97a8-589d0fc82195 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:44:08.899032 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-da96363d-4b13-4b29-97a8-589d0fc82195 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:44:08.899489 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-da96363d-4b13-4b29-97a8-589d0fc82195 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:44:08.900237 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-da96363d-4b13-4b29-97a8-589d0fc82195 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:44:08.900712 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-da96363d-4b13-4b29-97a8-589d0fc82195 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:44:08.901154 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-da96363d-4b13-4b29-97a8-589d0fc82195 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:44:08.906160 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:44:09.069713 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-da96363d-4b13-4b29-97a8-589d0fc82195 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2beee1a677a47b48dd244a12de6dac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be36356ccbf4266819b18ca6cee6d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:44:09.078396 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-da96363d-4b13-4b29-97a8-589d0fc82195 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] 10.222.0.26 "GET /compute/v2.1/servers/fc399f31-567a-44d4-b68a-899a9870aadb" status: 200 len: 1515 microversion: 2.1 time: 0.190464 Oct 08 21:44:09.078971 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3242/6410] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:44:08 2022] GET /compute/v2.1/servers/fc399f31-567a-44d4-b68a-899a9870aadb => generated 1515 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:44:10.098460 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=2 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:44:10.099169 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=6 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:44:10.101152 ncdv-master-1 devstack@n-api.service[140491]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 08 21:44:10.101392 ncdv-master-1 devstack@n-api.service[140491]: Sat Oct 8 21:44:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/fc399f31-567a-44d4-b68a-899a9870aadb (ip 10.222.0.26) !!! Oct 08 21:44:10.105779 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-9d5b29fd-aeaf-43b1-abf1-75eae9b64584 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:44:10.106397 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-9d5b29fd-aeaf-43b1-abf1-75eae9b64584 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] [instance: fc399f31-567a-44d4-b68a-899a9870aadb] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:44:10.117372 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9d5b29fd-aeaf-43b1-abf1-75eae9b64584 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:44:10.117979 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9d5b29fd-aeaf-43b1-abf1-75eae9b64584 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:44:10.118475 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9d5b29fd-aeaf-43b1-abf1-75eae9b64584 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:44:10.119183 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9d5b29fd-aeaf-43b1-abf1-75eae9b64584 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:44:10.119650 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9d5b29fd-aeaf-43b1-abf1-75eae9b64584 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:44:10.120081 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9d5b29fd-aeaf-43b1-abf1-75eae9b64584 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:44:10.260533 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-9d5b29fd-aeaf-43b1-abf1-75eae9b64584 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2beee1a677a47b48dd244a12de6dac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be36356ccbf4266819b18ca6cee6d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:44:10.269748 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-9d5b29fd-aeaf-43b1-abf1-75eae9b64584 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] 10.222.0.26 "GET /compute/v2.1/servers/fc399f31-567a-44d4-b68a-899a9870aadb" status: 200 len: 1515 microversion: 2.1 time: 0.172243 Oct 08 21:44:10.270337 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3169/6411] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:44:10 2022] GET /compute/v2.1/servers/fc399f31-567a-44d4-b68a-899a9870aadb => generated 1515 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:44:11.292384 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-09f7d67f-f5a0-47ce-baa4-0997e821963d tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:44:11.293044 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-09f7d67f-f5a0-47ce-baa4-0997e821963d tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] [instance: fc399f31-567a-44d4-b68a-899a9870aadb] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:44:11.294963 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=6 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:44:11.302533 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-09f7d67f-f5a0-47ce-baa4-0997e821963d tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:44:11.303032 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-09f7d67f-f5a0-47ce-baa4-0997e821963d tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:44:11.303488 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-09f7d67f-f5a0-47ce-baa4-0997e821963d tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:44:11.304198 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-09f7d67f-f5a0-47ce-baa4-0997e821963d tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:44:11.304673 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-09f7d67f-f5a0-47ce-baa4-0997e821963d tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:44:11.305117 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-09f7d67f-f5a0-47ce-baa4-0997e821963d tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:44:11.435169 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-09f7d67f-f5a0-47ce-baa4-0997e821963d tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2beee1a677a47b48dd244a12de6dac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be36356ccbf4266819b18ca6cee6d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:44:11.443184 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-09f7d67f-f5a0-47ce-baa4-0997e821963d tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] 10.222.0.26 "GET /compute/v2.1/servers/fc399f31-567a-44d4-b68a-899a9870aadb" status: 200 len: 1520 microversion: 2.1 time: 0.154665 Oct 08 21:44:11.443767 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3243/6412] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:44:11 2022] GET /compute/v2.1/servers/fc399f31-567a-44d4-b68a-899a9870aadb => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:44:12.467401 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c637974b-1e9e-4053-aa34-5a14c57836ab tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:44:12.468070 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-c637974b-1e9e-4053-aa34-5a14c57836ab tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] [instance: fc399f31-567a-44d4-b68a-899a9870aadb] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:44:12.475178 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c637974b-1e9e-4053-aa34-5a14c57836ab tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:44:12.475678 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c637974b-1e9e-4053-aa34-5a14c57836ab tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:44:12.476130 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c637974b-1e9e-4053-aa34-5a14c57836ab tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:44:12.476854 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c637974b-1e9e-4053-aa34-5a14c57836ab tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:44:12.477346 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c637974b-1e9e-4053-aa34-5a14c57836ab tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:44:12.477790 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c637974b-1e9e-4053-aa34-5a14c57836ab tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:44:12.612600 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-c637974b-1e9e-4053-aa34-5a14c57836ab tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2beee1a677a47b48dd244a12de6dac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be36356ccbf4266819b18ca6cee6d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:44:12.620505 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-c637974b-1e9e-4053-aa34-5a14c57836ab tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] 10.222.0.26 "GET /compute/v2.1/servers/fc399f31-567a-44d4-b68a-899a9870aadb" status: 200 len: 1520 microversion: 2.1 time: 0.157096 Oct 08 21:44:12.621083 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3170/6413] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:44:12 2022] GET /compute/v2.1/servers/fc399f31-567a-44d4-b68a-899a9870aadb => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:44:13.644625 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-0e6d6aa6-c7fc-4ce6-9a57-68eadffbdb94 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:44:13.645285 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-0e6d6aa6-c7fc-4ce6-9a57-68eadffbdb94 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] [instance: fc399f31-567a-44d4-b68a-899a9870aadb] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:44:13.652399 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0e6d6aa6-c7fc-4ce6-9a57-68eadffbdb94 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:44:13.652905 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0e6d6aa6-c7fc-4ce6-9a57-68eadffbdb94 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:44:13.653392 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0e6d6aa6-c7fc-4ce6-9a57-68eadffbdb94 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:44:13.654104 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0e6d6aa6-c7fc-4ce6-9a57-68eadffbdb94 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:44:13.654583 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0e6d6aa6-c7fc-4ce6-9a57-68eadffbdb94 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:44:13.655026 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0e6d6aa6-c7fc-4ce6-9a57-68eadffbdb94 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:44:13.789688 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-0e6d6aa6-c7fc-4ce6-9a57-68eadffbdb94 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2beee1a677a47b48dd244a12de6dac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be36356ccbf4266819b18ca6cee6d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:44:13.797651 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-0e6d6aa6-c7fc-4ce6-9a57-68eadffbdb94 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] 10.222.0.26 "GET /compute/v2.1/servers/fc399f31-567a-44d4-b68a-899a9870aadb" status: 200 len: 1520 microversion: 2.1 time: 0.157945 Oct 08 21:44:13.798233 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3244/6414] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:44:13 2022] GET /compute/v2.1/servers/fc399f31-567a-44d4-b68a-899a9870aadb => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:44:14.820595 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-5a16b4d5-e64f-4b54-949d-ff8b8fdb415d tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:44:14.821233 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-5a16b4d5-e64f-4b54-949d-ff8b8fdb415d tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] [instance: fc399f31-567a-44d4-b68a-899a9870aadb] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:44:14.828213 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5a16b4d5-e64f-4b54-949d-ff8b8fdb415d tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:44:14.828734 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5a16b4d5-e64f-4b54-949d-ff8b8fdb415d tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:44:14.829221 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5a16b4d5-e64f-4b54-949d-ff8b8fdb415d tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:44:14.829925 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5a16b4d5-e64f-4b54-949d-ff8b8fdb415d tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:44:14.830383 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5a16b4d5-e64f-4b54-949d-ff8b8fdb415d tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:44:14.830810 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5a16b4d5-e64f-4b54-949d-ff8b8fdb415d tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:44:14.958204 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-5a16b4d5-e64f-4b54-949d-ff8b8fdb415d tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2beee1a677a47b48dd244a12de6dac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be36356ccbf4266819b18ca6cee6d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:44:14.965927 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-5a16b4d5-e64f-4b54-949d-ff8b8fdb415d tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] 10.222.0.26 "GET /compute/v2.1/servers/fc399f31-567a-44d4-b68a-899a9870aadb" status: 200 len: 1520 microversion: 2.1 time: 0.149493 Oct 08 21:44:14.966495 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3171/6415] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:44:14 2022] GET /compute/v2.1/servers/fc399f31-567a-44d4-b68a-899a9870aadb => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:44:15.989938 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-7e864c9c-71d2-4636-b3c6-4f640e57f80a tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:44:15.990598 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-7e864c9c-71d2-4636-b3c6-4f640e57f80a tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] [instance: fc399f31-567a-44d4-b68a-899a9870aadb] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:44:15.997733 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7e864c9c-71d2-4636-b3c6-4f640e57f80a tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:44:15.998244 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7e864c9c-71d2-4636-b3c6-4f640e57f80a tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:44:15.998709 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7e864c9c-71d2-4636-b3c6-4f640e57f80a tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:44:16.000052 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7e864c9c-71d2-4636-b3c6-4f640e57f80a tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:44:16.000533 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7e864c9c-71d2-4636-b3c6-4f640e57f80a tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:44:16.000981 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7e864c9c-71d2-4636-b3c6-4f640e57f80a tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:44:16.134923 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-7e864c9c-71d2-4636-b3c6-4f640e57f80a tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2beee1a677a47b48dd244a12de6dac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be36356ccbf4266819b18ca6cee6d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:44:16.142758 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-7e864c9c-71d2-4636-b3c6-4f640e57f80a tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] 10.222.0.26 "GET /compute/v2.1/servers/fc399f31-567a-44d4-b68a-899a9870aadb" status: 200 len: 1520 microversion: 2.1 time: 0.157019 Oct 08 21:44:16.143336 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3245/6416] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:44:15 2022] GET /compute/v2.1/servers/fc399f31-567a-44d4-b68a-899a9870aadb => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:44:17.165487 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-ec6c2508-334a-474b-8dce-e3e3a84748bf tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:44:17.166183 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-ec6c2508-334a-474b-8dce-e3e3a84748bf tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] [instance: fc399f31-567a-44d4-b68a-899a9870aadb] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:44:17.173115 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ec6c2508-334a-474b-8dce-e3e3a84748bf tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:44:17.173646 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ec6c2508-334a-474b-8dce-e3e3a84748bf tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:44:17.174101 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ec6c2508-334a-474b-8dce-e3e3a84748bf tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:44:17.174814 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ec6c2508-334a-474b-8dce-e3e3a84748bf tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:44:17.175282 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ec6c2508-334a-474b-8dce-e3e3a84748bf tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:44:17.175720 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ec6c2508-334a-474b-8dce-e3e3a84748bf tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:44:17.307756 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-ec6c2508-334a-474b-8dce-e3e3a84748bf tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2beee1a677a47b48dd244a12de6dac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be36356ccbf4266819b18ca6cee6d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:44:17.316120 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-ec6c2508-334a-474b-8dce-e3e3a84748bf tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] 10.222.0.26 "GET /compute/v2.1/servers/fc399f31-567a-44d4-b68a-899a9870aadb" status: 200 len: 1520 microversion: 2.1 time: 0.154633 Oct 08 21:44:17.316727 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3172/6417] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:44:17 2022] GET /compute/v2.1/servers/fc399f31-567a-44d4-b68a-899a9870aadb => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:44:18.339828 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e54c3d6a-6061-46ba-9ae4-8227bd382f58 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:44:18.340458 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-e54c3d6a-6061-46ba-9ae4-8227bd382f58 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] [instance: fc399f31-567a-44d4-b68a-899a9870aadb] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:44:18.348276 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e54c3d6a-6061-46ba-9ae4-8227bd382f58 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:44:18.348821 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e54c3d6a-6061-46ba-9ae4-8227bd382f58 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:44:18.349307 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e54c3d6a-6061-46ba-9ae4-8227bd382f58 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:44:18.350026 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e54c3d6a-6061-46ba-9ae4-8227bd382f58 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:44:18.350501 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e54c3d6a-6061-46ba-9ae4-8227bd382f58 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:44:18.350947 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e54c3d6a-6061-46ba-9ae4-8227bd382f58 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:44:18.484017 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-e54c3d6a-6061-46ba-9ae4-8227bd382f58 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2beee1a677a47b48dd244a12de6dac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be36356ccbf4266819b18ca6cee6d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:44:18.492057 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-e54c3d6a-6061-46ba-9ae4-8227bd382f58 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] 10.222.0.26 "GET /compute/v2.1/servers/fc399f31-567a-44d4-b68a-899a9870aadb" status: 200 len: 1520 microversion: 2.1 time: 0.156044 Oct 08 21:44:18.492632 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3246/6418] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:44:18 2022] GET /compute/v2.1/servers/fc399f31-567a-44d4-b68a-899a9870aadb => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:44:19.515953 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-8e6c57b3-8015-449a-9ca7-92e94a2f569d tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:44:19.516581 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-8e6c57b3-8015-449a-9ca7-92e94a2f569d tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] [instance: fc399f31-567a-44d4-b68a-899a9870aadb] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:44:19.523652 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8e6c57b3-8015-449a-9ca7-92e94a2f569d tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:44:19.524146 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8e6c57b3-8015-449a-9ca7-92e94a2f569d tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:44:19.524599 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8e6c57b3-8015-449a-9ca7-92e94a2f569d tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:44:19.525337 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8e6c57b3-8015-449a-9ca7-92e94a2f569d tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:44:19.525824 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8e6c57b3-8015-449a-9ca7-92e94a2f569d tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:44:19.526248 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8e6c57b3-8015-449a-9ca7-92e94a2f569d tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:44:19.656744 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-8e6c57b3-8015-449a-9ca7-92e94a2f569d tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2beee1a677a47b48dd244a12de6dac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be36356ccbf4266819b18ca6cee6d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:44:19.664625 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-8e6c57b3-8015-449a-9ca7-92e94a2f569d tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] 10.222.0.26 "GET /compute/v2.1/servers/fc399f31-567a-44d4-b68a-899a9870aadb" status: 200 len: 1520 microversion: 2.1 time: 0.152675 Oct 08 21:44:19.665229 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3173/6419] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:44:19 2022] GET /compute/v2.1/servers/fc399f31-567a-44d4-b68a-899a9870aadb => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:44:20.688043 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-dc233cc1-fc56-41e4-bc74-5dc0a5d05dc0 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:44:20.688594 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-dc233cc1-fc56-41e4-bc74-5dc0a5d05dc0 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] [instance: fc399f31-567a-44d4-b68a-899a9870aadb] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:44:20.695916 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dc233cc1-fc56-41e4-bc74-5dc0a5d05dc0 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:44:20.696432 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dc233cc1-fc56-41e4-bc74-5dc0a5d05dc0 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:44:20.696897 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dc233cc1-fc56-41e4-bc74-5dc0a5d05dc0 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:44:20.697653 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dc233cc1-fc56-41e4-bc74-5dc0a5d05dc0 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:44:20.698134 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dc233cc1-fc56-41e4-bc74-5dc0a5d05dc0 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:44:20.698588 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dc233cc1-fc56-41e4-bc74-5dc0a5d05dc0 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:44:20.832335 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-dc233cc1-fc56-41e4-bc74-5dc0a5d05dc0 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2beee1a677a47b48dd244a12de6dac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be36356ccbf4266819b18ca6cee6d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:44:20.840110 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-dc233cc1-fc56-41e4-bc74-5dc0a5d05dc0 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] 10.222.0.26 "GET /compute/v2.1/servers/fc399f31-567a-44d4-b68a-899a9870aadb" status: 200 len: 1520 microversion: 2.1 time: 0.156683 Oct 08 21:44:20.840680 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3247/6420] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:44:20 2022] GET /compute/v2.1/servers/fc399f31-567a-44d4-b68a-899a9870aadb => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:44:21.863512 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-0fa93b8a-f91e-40a4-b254-02b104d0a204 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:44:21.864186 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-0fa93b8a-f91e-40a4-b254-02b104d0a204 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] [instance: fc399f31-567a-44d4-b68a-899a9870aadb] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:44:21.871041 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0fa93b8a-f91e-40a4-b254-02b104d0a204 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:44:21.871531 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0fa93b8a-f91e-40a4-b254-02b104d0a204 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:44:21.871974 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0fa93b8a-f91e-40a4-b254-02b104d0a204 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:44:21.872675 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0fa93b8a-f91e-40a4-b254-02b104d0a204 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:44:21.873137 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0fa93b8a-f91e-40a4-b254-02b104d0a204 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:44:21.873600 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0fa93b8a-f91e-40a4-b254-02b104d0a204 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:44:22.001172 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-0fa93b8a-f91e-40a4-b254-02b104d0a204 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2beee1a677a47b48dd244a12de6dac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be36356ccbf4266819b18ca6cee6d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:44:22.009099 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-0fa93b8a-f91e-40a4-b254-02b104d0a204 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] 10.222.0.26 "GET /compute/v2.1/servers/fc399f31-567a-44d4-b68a-899a9870aadb" status: 200 len: 1520 microversion: 2.1 time: 0.149518 Oct 08 21:44:22.009650 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3174/6421] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:44:21 2022] GET /compute/v2.1/servers/fc399f31-567a-44d4-b68a-899a9870aadb => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:44:23.033211 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e6001bfa-85f2-434f-8222-f0cbbfc6a62a tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:44:23.033859 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-e6001bfa-85f2-434f-8222-f0cbbfc6a62a tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] [instance: fc399f31-567a-44d4-b68a-899a9870aadb] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:44:23.040820 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e6001bfa-85f2-434f-8222-f0cbbfc6a62a tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:44:23.041360 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e6001bfa-85f2-434f-8222-f0cbbfc6a62a tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:44:23.041821 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e6001bfa-85f2-434f-8222-f0cbbfc6a62a tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:44:23.042535 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e6001bfa-85f2-434f-8222-f0cbbfc6a62a tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:44:23.043012 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e6001bfa-85f2-434f-8222-f0cbbfc6a62a tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:44:23.043459 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e6001bfa-85f2-434f-8222-f0cbbfc6a62a tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:44:23.171569 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-e6001bfa-85f2-434f-8222-f0cbbfc6a62a tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2beee1a677a47b48dd244a12de6dac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be36356ccbf4266819b18ca6cee6d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:44:23.179268 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-e6001bfa-85f2-434f-8222-f0cbbfc6a62a tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] 10.222.0.26 "GET /compute/v2.1/servers/fc399f31-567a-44d4-b68a-899a9870aadb" status: 200 len: 1520 microversion: 2.1 time: 0.150604 Oct 08 21:44:23.179846 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3248/6422] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:44:23 2022] GET /compute/v2.1/servers/fc399f31-567a-44d4-b68a-899a9870aadb => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:44:24.202307 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-960c6378-4380-4de3-975e-9e515832d08c tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:44:24.202928 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-960c6378-4380-4de3-975e-9e515832d08c tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] [instance: fc399f31-567a-44d4-b68a-899a9870aadb] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:44:24.209963 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-960c6378-4380-4de3-975e-9e515832d08c tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:44:24.210458 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-960c6378-4380-4de3-975e-9e515832d08c tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:44:24.210904 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-960c6378-4380-4de3-975e-9e515832d08c tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:44:24.211613 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-960c6378-4380-4de3-975e-9e515832d08c tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:44:24.212081 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-960c6378-4380-4de3-975e-9e515832d08c tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:44:24.212517 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-960c6378-4380-4de3-975e-9e515832d08c tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:44:24.344992 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-960c6378-4380-4de3-975e-9e515832d08c tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2beee1a677a47b48dd244a12de6dac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be36356ccbf4266819b18ca6cee6d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:44:24.352817 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-960c6378-4380-4de3-975e-9e515832d08c tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] 10.222.0.26 "GET /compute/v2.1/servers/fc399f31-567a-44d4-b68a-899a9870aadb" status: 200 len: 1520 microversion: 2.1 time: 0.154450 Oct 08 21:44:24.353423 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3175/6423] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:44:24 2022] GET /compute/v2.1/servers/fc399f31-567a-44d4-b68a-899a9870aadb => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:44:25.376507 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-40a88186-db35-4db2-a83e-a623dde9da45 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:44:25.377140 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-40a88186-db35-4db2-a83e-a623dde9da45 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] [instance: fc399f31-567a-44d4-b68a-899a9870aadb] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:44:25.384088 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-40a88186-db35-4db2-a83e-a623dde9da45 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:44:25.384592 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-40a88186-db35-4db2-a83e-a623dde9da45 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:44:25.385054 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-40a88186-db35-4db2-a83e-a623dde9da45 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:44:25.385797 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-40a88186-db35-4db2-a83e-a623dde9da45 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:44:25.386277 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-40a88186-db35-4db2-a83e-a623dde9da45 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:44:25.386721 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-40a88186-db35-4db2-a83e-a623dde9da45 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:44:25.518482 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-40a88186-db35-4db2-a83e-a623dde9da45 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2beee1a677a47b48dd244a12de6dac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be36356ccbf4266819b18ca6cee6d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:44:25.526327 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-40a88186-db35-4db2-a83e-a623dde9da45 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] 10.222.0.26 "GET /compute/v2.1/servers/fc399f31-567a-44d4-b68a-899a9870aadb" status: 200 len: 1520 microversion: 2.1 time: 0.154277 Oct 08 21:44:25.526912 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3249/6424] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:44:25 2022] GET /compute/v2.1/servers/fc399f31-567a-44d4-b68a-899a9870aadb => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:44:26.548639 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-be04ca4f-416b-4a09-8757-f088077ec9be tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:44:26.549291 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-be04ca4f-416b-4a09-8757-f088077ec9be tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] [instance: fc399f31-567a-44d4-b68a-899a9870aadb] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:44:26.556452 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-be04ca4f-416b-4a09-8757-f088077ec9be tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:44:26.556973 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-be04ca4f-416b-4a09-8757-f088077ec9be tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:44:26.557456 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-be04ca4f-416b-4a09-8757-f088077ec9be tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:44:26.558162 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-be04ca4f-416b-4a09-8757-f088077ec9be tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:44:26.558619 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-be04ca4f-416b-4a09-8757-f088077ec9be tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:44:26.559050 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-be04ca4f-416b-4a09-8757-f088077ec9be tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:44:26.691061 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-be04ca4f-416b-4a09-8757-f088077ec9be tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2beee1a677a47b48dd244a12de6dac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be36356ccbf4266819b18ca6cee6d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:44:26.693295 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:44:26.700987 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-be04ca4f-416b-4a09-8757-f088077ec9be tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] 10.222.0.26 "GET /compute/v2.1/servers/fc399f31-567a-44d4-b68a-899a9870aadb" status: 200 len: 1520 microversion: 2.1 time: 0.156254 Oct 08 21:44:26.701649 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3176/6425] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:44:26 2022] GET /compute/v2.1/servers/fc399f31-567a-44d4-b68a-899a9870aadb => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:44:27.724476 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-d8ec9233-d5e4-4c0b-b8b3-fca6c6e8200a tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:44:27.725105 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-d8ec9233-d5e4-4c0b-b8b3-fca6c6e8200a tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] [instance: fc399f31-567a-44d4-b68a-899a9870aadb] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:44:27.727979 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:44:27.734590 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d8ec9233-d5e4-4c0b-b8b3-fca6c6e8200a tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:44:27.735034 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d8ec9233-d5e4-4c0b-b8b3-fca6c6e8200a tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:44:27.735493 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d8ec9233-d5e4-4c0b-b8b3-fca6c6e8200a tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:44:27.736213 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d8ec9233-d5e4-4c0b-b8b3-fca6c6e8200a tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:44:27.736695 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d8ec9233-d5e4-4c0b-b8b3-fca6c6e8200a tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:44:27.737141 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d8ec9233-d5e4-4c0b-b8b3-fca6c6e8200a tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:44:27.870070 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-d8ec9233-d5e4-4c0b-b8b3-fca6c6e8200a tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2beee1a677a47b48dd244a12de6dac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be36356ccbf4266819b18ca6cee6d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:44:27.877924 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-d8ec9233-d5e4-4c0b-b8b3-fca6c6e8200a tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] 10.222.0.26 "GET /compute/v2.1/servers/fc399f31-567a-44d4-b68a-899a9870aadb" status: 200 len: 1520 microversion: 2.1 time: 0.157369 Oct 08 21:44:27.878507 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3250/6426] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:44:27 2022] GET /compute/v2.1/servers/fc399f31-567a-44d4-b68a-899a9870aadb => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:44:28.901543 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-6f129a20-c630-49c3-a2d0-9aca1c737da7 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:44:28.902195 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-6f129a20-c630-49c3-a2d0-9aca1c737da7 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] [instance: fc399f31-567a-44d4-b68a-899a9870aadb] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:44:28.904757 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:44:28.911365 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6f129a20-c630-49c3-a2d0-9aca1c737da7 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:44:28.911861 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6f129a20-c630-49c3-a2d0-9aca1c737da7 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:44:28.912311 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6f129a20-c630-49c3-a2d0-9aca1c737da7 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:44:28.913019 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6f129a20-c630-49c3-a2d0-9aca1c737da7 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:44:28.913517 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6f129a20-c630-49c3-a2d0-9aca1c737da7 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:44:28.913954 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6f129a20-c630-49c3-a2d0-9aca1c737da7 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:44:29.046195 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-6f129a20-c630-49c3-a2d0-9aca1c737da7 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2beee1a677a47b48dd244a12de6dac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be36356ccbf4266819b18ca6cee6d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:44:29.054089 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-6f129a20-c630-49c3-a2d0-9aca1c737da7 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] 10.222.0.26 "GET /compute/v2.1/servers/fc399f31-567a-44d4-b68a-899a9870aadb" status: 200 len: 1520 microversion: 2.1 time: 0.156523 Oct 08 21:44:29.054677 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3177/6427] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:44:28 2022] GET /compute/v2.1/servers/fc399f31-567a-44d4-b68a-899a9870aadb => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:44:30.078075 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-1674e962-c561-4289-b5d3-db70dd3af8cc tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:44:30.078707 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-1674e962-c561-4289-b5d3-db70dd3af8cc tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] [instance: fc399f31-567a-44d4-b68a-899a9870aadb] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:44:30.085032 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1674e962-c561-4289-b5d3-db70dd3af8cc tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:44:30.085570 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1674e962-c561-4289-b5d3-db70dd3af8cc tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:44:30.086030 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1674e962-c561-4289-b5d3-db70dd3af8cc tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:44:30.086745 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1674e962-c561-4289-b5d3-db70dd3af8cc tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:44:30.087230 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1674e962-c561-4289-b5d3-db70dd3af8cc tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:44:30.087682 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1674e962-c561-4289-b5d3-db70dd3af8cc tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:44:30.216431 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-1674e962-c561-4289-b5d3-db70dd3af8cc tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2beee1a677a47b48dd244a12de6dac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be36356ccbf4266819b18ca6cee6d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:44:30.224202 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-1674e962-c561-4289-b5d3-db70dd3af8cc tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] 10.222.0.26 "GET /compute/v2.1/servers/fc399f31-567a-44d4-b68a-899a9870aadb" status: 200 len: 1520 microversion: 2.1 time: 0.150832 Oct 08 21:44:30.224778 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3251/6428] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:44:30 2022] GET /compute/v2.1/servers/fc399f31-567a-44d4-b68a-899a9870aadb => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:44:31.248043 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-a625de5a-f18d-405a-8e06-203b97188b79 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:44:31.249248 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-a625de5a-f18d-405a-8e06-203b97188b79 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] [instance: fc399f31-567a-44d4-b68a-899a9870aadb] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:44:31.256176 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a625de5a-f18d-405a-8e06-203b97188b79 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:44:31.256672 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a625de5a-f18d-405a-8e06-203b97188b79 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:44:31.257122 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a625de5a-f18d-405a-8e06-203b97188b79 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:44:31.257914 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a625de5a-f18d-405a-8e06-203b97188b79 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:44:31.258379 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a625de5a-f18d-405a-8e06-203b97188b79 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:44:31.258813 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a625de5a-f18d-405a-8e06-203b97188b79 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:44:31.387991 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-a625de5a-f18d-405a-8e06-203b97188b79 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2beee1a677a47b48dd244a12de6dac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be36356ccbf4266819b18ca6cee6d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:44:31.396365 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-a625de5a-f18d-405a-8e06-203b97188b79 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] 10.222.0.26 "GET /compute/v2.1/servers/fc399f31-567a-44d4-b68a-899a9870aadb" status: 200 len: 1520 microversion: 2.1 time: 0.152375 Oct 08 21:44:31.396943 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3178/6429] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:44:31 2022] GET /compute/v2.1/servers/fc399f31-567a-44d4-b68a-899a9870aadb => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:44:32.419251 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-12fb43ae-16af-488d-9b2b-a6658aaa85d6 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:44:32.419890 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-12fb43ae-16af-488d-9b2b-a6658aaa85d6 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] [instance: fc399f31-567a-44d4-b68a-899a9870aadb] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:44:32.426795 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-12fb43ae-16af-488d-9b2b-a6658aaa85d6 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:44:32.427306 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-12fb43ae-16af-488d-9b2b-a6658aaa85d6 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:44:32.427767 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-12fb43ae-16af-488d-9b2b-a6658aaa85d6 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:44:32.428484 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-12fb43ae-16af-488d-9b2b-a6658aaa85d6 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:44:32.428962 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-12fb43ae-16af-488d-9b2b-a6658aaa85d6 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:44:32.429440 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-12fb43ae-16af-488d-9b2b-a6658aaa85d6 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:44:32.570159 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-12fb43ae-16af-488d-9b2b-a6658aaa85d6 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2beee1a677a47b48dd244a12de6dac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be36356ccbf4266819b18ca6cee6d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:44:32.578627 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-12fb43ae-16af-488d-9b2b-a6658aaa85d6 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] 10.222.0.26 "GET /compute/v2.1/servers/fc399f31-567a-44d4-b68a-899a9870aadb" status: 200 len: 1520 microversion: 2.1 time: 0.163229 Oct 08 21:44:32.579204 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3252/6430] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:44:32 2022] GET /compute/v2.1/servers/fc399f31-567a-44d4-b68a-899a9870aadb => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:44:33.602151 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-fe1bb5a8-af74-458d-8b38-51be8aa05543 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:44:33.602802 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-fe1bb5a8-af74-458d-8b38-51be8aa05543 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] [instance: fc399f31-567a-44d4-b68a-899a9870aadb] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:44:33.610482 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fe1bb5a8-af74-458d-8b38-51be8aa05543 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:44:33.610978 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fe1bb5a8-af74-458d-8b38-51be8aa05543 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:44:33.611420 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fe1bb5a8-af74-458d-8b38-51be8aa05543 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:44:33.612125 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fe1bb5a8-af74-458d-8b38-51be8aa05543 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:44:33.612591 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fe1bb5a8-af74-458d-8b38-51be8aa05543 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:44:33.613029 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fe1bb5a8-af74-458d-8b38-51be8aa05543 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:44:33.740573 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-fe1bb5a8-af74-458d-8b38-51be8aa05543 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2beee1a677a47b48dd244a12de6dac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be36356ccbf4266819b18ca6cee6d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:44:33.748886 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-fe1bb5a8-af74-458d-8b38-51be8aa05543 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] 10.222.0.26 "GET /compute/v2.1/servers/fc399f31-567a-44d4-b68a-899a9870aadb" status: 200 len: 1520 microversion: 2.1 time: 0.150680 Oct 08 21:44:33.749503 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3179/6431] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:44:33 2022] GET /compute/v2.1/servers/fc399f31-567a-44d4-b68a-899a9870aadb => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:44:34.771950 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-553e2fad-52a7-461c-9a3b-e69a2d8cf2e1 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:44:34.772574 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-553e2fad-52a7-461c-9a3b-e69a2d8cf2e1 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] [instance: fc399f31-567a-44d4-b68a-899a9870aadb] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:44:34.779635 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-553e2fad-52a7-461c-9a3b-e69a2d8cf2e1 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:44:34.780170 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-553e2fad-52a7-461c-9a3b-e69a2d8cf2e1 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:44:34.780624 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-553e2fad-52a7-461c-9a3b-e69a2d8cf2e1 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:44:34.781374 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-553e2fad-52a7-461c-9a3b-e69a2d8cf2e1 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:44:34.781852 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-553e2fad-52a7-461c-9a3b-e69a2d8cf2e1 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:44:34.782293 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-553e2fad-52a7-461c-9a3b-e69a2d8cf2e1 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:44:34.912269 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-553e2fad-52a7-461c-9a3b-e69a2d8cf2e1 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2beee1a677a47b48dd244a12de6dac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be36356ccbf4266819b18ca6cee6d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:44:34.920611 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-553e2fad-52a7-461c-9a3b-e69a2d8cf2e1 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] 10.222.0.26 "GET /compute/v2.1/servers/fc399f31-567a-44d4-b68a-899a9870aadb" status: 200 len: 1520 microversion: 2.1 time: 0.152068 Oct 08 21:44:34.921209 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3253/6432] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:44:34 2022] GET /compute/v2.1/servers/fc399f31-567a-44d4-b68a-899a9870aadb => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:44:35.942726 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-678a0472-8002-44e2-9c93-44f6dcbb31a7 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:44:35.943352 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-678a0472-8002-44e2-9c93-44f6dcbb31a7 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] [instance: fc399f31-567a-44d4-b68a-899a9870aadb] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:44:35.950544 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-678a0472-8002-44e2-9c93-44f6dcbb31a7 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:44:35.951040 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-678a0472-8002-44e2-9c93-44f6dcbb31a7 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:44:35.951516 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-678a0472-8002-44e2-9c93-44f6dcbb31a7 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:44:35.952229 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-678a0472-8002-44e2-9c93-44f6dcbb31a7 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:44:35.952699 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-678a0472-8002-44e2-9c93-44f6dcbb31a7 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:44:35.953141 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-678a0472-8002-44e2-9c93-44f6dcbb31a7 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:44:36.087003 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-678a0472-8002-44e2-9c93-44f6dcbb31a7 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2beee1a677a47b48dd244a12de6dac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be36356ccbf4266819b18ca6cee6d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:44:36.095608 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-678a0472-8002-44e2-9c93-44f6dcbb31a7 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] 10.222.0.26 "GET /compute/v2.1/servers/fc399f31-567a-44d4-b68a-899a9870aadb" status: 200 len: 1520 microversion: 2.1 time: 0.156873 Oct 08 21:44:36.096189 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3180/6433] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:44:35 2022] GET /compute/v2.1/servers/fc399f31-567a-44d4-b68a-899a9870aadb => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:44:37.118510 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-169828d0-1b25-4d78-a662-16924decbc16 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:44:37.119111 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-169828d0-1b25-4d78-a662-16924decbc16 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] [instance: fc399f31-567a-44d4-b68a-899a9870aadb] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:44:37.126669 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-169828d0-1b25-4d78-a662-16924decbc16 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:44:37.127182 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-169828d0-1b25-4d78-a662-16924decbc16 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:44:37.127645 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-169828d0-1b25-4d78-a662-16924decbc16 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:44:37.128369 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-169828d0-1b25-4d78-a662-16924decbc16 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:44:37.128849 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-169828d0-1b25-4d78-a662-16924decbc16 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:44:37.129329 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-169828d0-1b25-4d78-a662-16924decbc16 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:44:37.261858 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-169828d0-1b25-4d78-a662-16924decbc16 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2beee1a677a47b48dd244a12de6dac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be36356ccbf4266819b18ca6cee6d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:44:37.269750 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-169828d0-1b25-4d78-a662-16924decbc16 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] 10.222.0.26 "GET /compute/v2.1/servers/fc399f31-567a-44d4-b68a-899a9870aadb" status: 200 len: 1520 microversion: 2.1 time: 0.155272 Oct 08 21:44:37.270329 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3254/6434] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:44:37 2022] GET /compute/v2.1/servers/fc399f31-567a-44d4-b68a-899a9870aadb => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:44:38.293247 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-971f2eb0-3d8f-45a0-9239-6a22c0f59ae9 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:44:38.293865 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-971f2eb0-3d8f-45a0-9239-6a22c0f59ae9 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] [instance: fc399f31-567a-44d4-b68a-899a9870aadb] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:44:38.301364 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-971f2eb0-3d8f-45a0-9239-6a22c0f59ae9 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:44:38.301863 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-971f2eb0-3d8f-45a0-9239-6a22c0f59ae9 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:44:38.302311 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-971f2eb0-3d8f-45a0-9239-6a22c0f59ae9 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:44:38.303030 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-971f2eb0-3d8f-45a0-9239-6a22c0f59ae9 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:44:38.303490 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-971f2eb0-3d8f-45a0-9239-6a22c0f59ae9 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:44:38.303924 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-971f2eb0-3d8f-45a0-9239-6a22c0f59ae9 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:44:38.758887 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-971f2eb0-3d8f-45a0-9239-6a22c0f59ae9 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2beee1a677a47b48dd244a12de6dac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be36356ccbf4266819b18ca6cee6d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:44:38.766956 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-971f2eb0-3d8f-45a0-9239-6a22c0f59ae9 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] 10.222.0.26 "GET /compute/v2.1/servers/fc399f31-567a-44d4-b68a-899a9870aadb" status: 200 len: 1519 microversion: 2.1 time: 0.477690 Oct 08 21:44:38.767547 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3181/6435] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:44:38 2022] GET /compute/v2.1/servers/fc399f31-567a-44d4-b68a-899a9870aadb => generated 1519 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:44:38.883605 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-5c3b1938-ec04-495a-949e-d2cfb331f0ba req-6da07ce4-29b4-46a2-b0a2-f5f2d8063d85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc399f31-567a-44d4-b68a-899a9870aadb", "name": "network-vif-unplugged", "status": "completed", "tag": "d870e1ed-0cd2-4df8-ac8a-d3e4addc828b"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:44:38.893752 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-5c3b1938-ec04-495a-949e-d2cfb331f0ba req-6da07ce4-29b4-46a2-b0a2-f5f2d8063d85 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:44:38.894245 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-5c3b1938-ec04-495a-949e-d2cfb331f0ba req-6da07ce4-29b4-46a2-b0a2-f5f2d8063d85 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:44:38.894704 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-5c3b1938-ec04-495a-949e-d2cfb331f0ba req-6da07ce4-29b4-46a2-b0a2-f5f2d8063d85 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:44:38.906552 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-5c3b1938-ec04-495a-949e-d2cfb331f0ba req-6da07ce4-29b4-46a2-b0a2-f5f2d8063d85 service nova] Creating event network-vif-unplugged:d870e1ed-0cd2-4df8-ac8a-d3e4addc828b for instance fc399f31-567a-44d4-b68a-899a9870aadb on nch1-master-1 Oct 08 21:44:38.912607 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [req-5c3b1938-ec04-495a-949e-d2cfb331f0ba req-6da07ce4-29b4-46a2-b0a2-f5f2d8063d85 service nova] Instance fc399f31-567a-44d4-b68a-899a9870aadb is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140492) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 08 21:44:38.924295 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-5c3b1938-ec04-495a-949e-d2cfb331f0ba req-6da07ce4-29b4-46a2-b0a2-f5f2d8063d85 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.115049 Oct 08 21:44:38.925059 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3255/6436] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:44:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 08 21:44:39.790290 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-db5e7479-05a4-481a-a268-0ef4ddfdfb77 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:44:39.790908 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-db5e7479-05a4-481a-a268-0ef4ddfdfb77 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] [instance: fc399f31-567a-44d4-b68a-899a9870aadb] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:44:39.797840 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-db5e7479-05a4-481a-a268-0ef4ddfdfb77 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:44:39.798395 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-db5e7479-05a4-481a-a268-0ef4ddfdfb77 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:44:39.798865 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-db5e7479-05a4-481a-a268-0ef4ddfdfb77 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:44:39.799564 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-db5e7479-05a4-481a-a268-0ef4ddfdfb77 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:44:39.800025 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-db5e7479-05a4-481a-a268-0ef4ddfdfb77 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:44:39.800455 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-db5e7479-05a4-481a-a268-0ef4ddfdfb77 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:44:39.929977 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-db5e7479-05a4-481a-a268-0ef4ddfdfb77 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2beee1a677a47b48dd244a12de6dac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be36356ccbf4266819b18ca6cee6d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:44:39.937778 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-db5e7479-05a4-481a-a268-0ef4ddfdfb77 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] 10.222.0.26 "GET /compute/v2.1/servers/fc399f31-567a-44d4-b68a-899a9870aadb" status: 200 len: 1517 microversion: 2.1 time: 0.151391 Oct 08 21:44:39.938350 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3182/6437] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:44:39 2022] GET /compute/v2.1/servers/fc399f31-567a-44d4-b68a-899a9870aadb => generated 1517 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:44:40.940901 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-6089ff15-2b55-4bf4-9e6a-0e200e80b83d req-f0c87dc4-9212-4e42-af62-20557aa21c94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc399f31-567a-44d4-b68a-899a9870aadb", "tag": "d870e1ed-0cd2-4df8-ac8a-d3e4addc828b"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:44:40.950890 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-6089ff15-2b55-4bf4-9e6a-0e200e80b83d req-f0c87dc4-9212-4e42-af62-20557aa21c94 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:44:40.951387 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-6089ff15-2b55-4bf4-9e6a-0e200e80b83d req-f0c87dc4-9212-4e42-af62-20557aa21c94 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:44:40.951836 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-6089ff15-2b55-4bf4-9e6a-0e200e80b83d req-f0c87dc4-9212-4e42-af62-20557aa21c94 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:44:40.955742 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=82 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:44:40.961498 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-2dc2c56d-c3bd-4b75-bf1c-6bb9575e942d tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:44:40.962154 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-2dc2c56d-c3bd-4b75-bf1c-6bb9575e942d tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] [instance: fc399f31-567a-44d4-b68a-899a9870aadb] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:44:40.965377 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-6089ff15-2b55-4bf4-9e6a-0e200e80b83d req-f0c87dc4-9212-4e42-af62-20557aa21c94 service nova] Creating event network-changed:d870e1ed-0cd2-4df8-ac8a-d3e4addc828b for instance fc399f31-567a-44d4-b68a-899a9870aadb on nch1-master-1 Oct 08 21:44:40.969173 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2dc2c56d-c3bd-4b75-bf1c-6bb9575e942d tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:44:40.969699 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2dc2c56d-c3bd-4b75-bf1c-6bb9575e942d tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:44:40.970655 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2dc2c56d-c3bd-4b75-bf1c-6bb9575e942d tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:44:40.971336 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [req-6089ff15-2b55-4bf4-9e6a-0e200e80b83d req-f0c87dc4-9212-4e42-af62-20557aa21c94 service nova] Instance fc399f31-567a-44d4-b68a-899a9870aadb is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140492) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 08 21:44:40.971479 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2dc2c56d-c3bd-4b75-bf1c-6bb9575e942d tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:44:40.971893 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2dc2c56d-c3bd-4b75-bf1c-6bb9575e942d tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:44:40.972327 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2dc2c56d-c3bd-4b75-bf1c-6bb9575e942d tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:44:40.982233 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-6089ff15-2b55-4bf4-9e6a-0e200e80b83d req-f0c87dc4-9212-4e42-af62-20557aa21c94 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046273 Oct 08 21:44:40.982893 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3256/6438] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:44:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:44:41.206069 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-2dc2c56d-c3bd-4b75-bf1c-6bb9575e942d tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2beee1a677a47b48dd244a12de6dac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be36356ccbf4266819b18ca6cee6d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:44:41.214447 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-2dc2c56d-c3bd-4b75-bf1c-6bb9575e942d tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] 10.222.0.26 "GET /compute/v2.1/servers/fc399f31-567a-44d4-b68a-899a9870aadb" status: 200 len: 1517 microversion: 2.1 time: 0.257097 Oct 08 21:44:41.215293 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3183/6439] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:44:40 2022] GET /compute/v2.1/servers/fc399f31-567a-44d4-b68a-899a9870aadb => generated 1517 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:44:42.239422 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e0425cad-0567-4b71-98c4-0f87f1f1dc1d tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:44:42.240147 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-e0425cad-0567-4b71-98c4-0f87f1f1dc1d tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] [instance: fc399f31-567a-44d4-b68a-899a9870aadb] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:44:42.246357 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e0425cad-0567-4b71-98c4-0f87f1f1dc1d tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:44:42.246866 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e0425cad-0567-4b71-98c4-0f87f1f1dc1d tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:44:42.247327 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e0425cad-0567-4b71-98c4-0f87f1f1dc1d tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:44:42.248049 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e0425cad-0567-4b71-98c4-0f87f1f1dc1d tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:44:42.248528 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e0425cad-0567-4b71-98c4-0f87f1f1dc1d tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:44:42.248977 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e0425cad-0567-4b71-98c4-0f87f1f1dc1d tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:44:42.381031 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-e0425cad-0567-4b71-98c4-0f87f1f1dc1d tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2beee1a677a47b48dd244a12de6dac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be36356ccbf4266819b18ca6cee6d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:44:42.388874 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-e0425cad-0567-4b71-98c4-0f87f1f1dc1d tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] 10.222.0.26 "GET /compute/v2.1/servers/fc399f31-567a-44d4-b68a-899a9870aadb" status: 200 len: 1514 microversion: 2.1 time: 0.154499 Oct 08 21:44:42.389474 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3257/6440] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:44:42 2022] GET /compute/v2.1/servers/fc399f31-567a-44d4-b68a-899a9870aadb => generated 1514 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:44:42.412356 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-64debeab-42d6-44f5-9863-8596bd7ae262 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:44:42.412886 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-64debeab-42d6-44f5-9863-8596bd7ae262 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] [instance: fc399f31-567a-44d4-b68a-899a9870aadb] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:44:42.419901 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-64debeab-42d6-44f5-9863-8596bd7ae262 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:44:42.420401 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-64debeab-42d6-44f5-9863-8596bd7ae262 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:44:42.420854 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-64debeab-42d6-44f5-9863-8596bd7ae262 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:44:42.421597 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-64debeab-42d6-44f5-9863-8596bd7ae262 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:44:42.422067 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-64debeab-42d6-44f5-9863-8596bd7ae262 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:44:42.422507 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-64debeab-42d6-44f5-9863-8596bd7ae262 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:44:42.481073 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-64debeab-42d6-44f5-9863-8596bd7ae262 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] 10.222.0.26 "POST /compute/v2.1/servers/fc399f31-567a-44d4-b68a-899a9870aadb/action" status: 204 len: 0 microversion: 2.1 time: 0.072936 Oct 08 21:44:42.481773 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3184/6441] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:44:42 2022] POST /compute/v2.1/servers/fc399f31-567a-44d4-b68a-899a9870aadb/action => generated 0 bytes in 74 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 21:44:42.496415 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-f30d435c-73f7-4cf5-96bb-a6ee8da38a34 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:44:42.497163 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-f30d435c-73f7-4cf5-96bb-a6ee8da38a34 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] [instance: fc399f31-567a-44d4-b68a-899a9870aadb] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:44:42.504062 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f30d435c-73f7-4cf5-96bb-a6ee8da38a34 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:44:42.504764 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f30d435c-73f7-4cf5-96bb-a6ee8da38a34 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:44:42.505319 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f30d435c-73f7-4cf5-96bb-a6ee8da38a34 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:44:42.506054 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f30d435c-73f7-4cf5-96bb-a6ee8da38a34 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:44:42.506539 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f30d435c-73f7-4cf5-96bb-a6ee8da38a34 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:44:42.506987 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f30d435c-73f7-4cf5-96bb-a6ee8da38a34 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:44:42.718843 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-f30d435c-73f7-4cf5-96bb-a6ee8da38a34 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2beee1a677a47b48dd244a12de6dac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be36356ccbf4266819b18ca6cee6d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:44:42.727202 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-f30d435c-73f7-4cf5-96bb-a6ee8da38a34 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] 10.222.0.26 "GET /compute/v2.1/servers/fc399f31-567a-44d4-b68a-899a9870aadb" status: 200 len: 1514 microversion: 2.1 time: 0.241114 Oct 08 21:44:42.727786 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3258/6442] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:44:42 2022] GET /compute/v2.1/servers/fc399f31-567a-44d4-b68a-899a9870aadb => generated 1514 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:44:43.498228 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-e1f0eab6-f6f5-495b-b6a8-70eb0e396822 req-7ce970b9-d949-4d10-9a90-ff9b7330b679 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc399f31-567a-44d4-b68a-899a9870aadb", "name": "network-vif-plugged", "status": "completed", "tag": "d870e1ed-0cd2-4df8-ac8a-d3e4addc828b"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:44:43.509113 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-e1f0eab6-f6f5-495b-b6a8-70eb0e396822 req-7ce970b9-d949-4d10-9a90-ff9b7330b679 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:44:43.509630 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-e1f0eab6-f6f5-495b-b6a8-70eb0e396822 req-7ce970b9-d949-4d10-9a90-ff9b7330b679 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:44:43.510069 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-e1f0eab6-f6f5-495b-b6a8-70eb0e396822 req-7ce970b9-d949-4d10-9a90-ff9b7330b679 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:44:43.522243 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-e1f0eab6-f6f5-495b-b6a8-70eb0e396822 req-7ce970b9-d949-4d10-9a90-ff9b7330b679 service nova] Creating event network-vif-plugged:d870e1ed-0cd2-4df8-ac8a-d3e4addc828b for instance fc399f31-567a-44d4-b68a-899a9870aadb on nch1-master-1 Oct 08 21:44:43.527633 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [req-e1f0eab6-f6f5-495b-b6a8-70eb0e396822 req-7ce970b9-d949-4d10-9a90-ff9b7330b679 service nova] Instance fc399f31-567a-44d4-b68a-899a9870aadb is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140491) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 08 21:44:43.539573 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-e1f0eab6-f6f5-495b-b6a8-70eb0e396822 req-7ce970b9-d949-4d10-9a90-ff9b7330b679 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046058 Oct 08 21:44:43.541241 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3185/6443] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:44:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:44:43.750650 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-28f9ed47-b3a3-4a96-91df-5e45b149487f tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:44:43.751896 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-28f9ed47-b3a3-4a96-91df-5e45b149487f tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] [instance: fc399f31-567a-44d4-b68a-899a9870aadb] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:44:43.758815 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-28f9ed47-b3a3-4a96-91df-5e45b149487f tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:44:43.759320 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-28f9ed47-b3a3-4a96-91df-5e45b149487f tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:44:43.759780 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-28f9ed47-b3a3-4a96-91df-5e45b149487f tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:44:43.760495 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-28f9ed47-b3a3-4a96-91df-5e45b149487f tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:44:43.760971 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-28f9ed47-b3a3-4a96-91df-5e45b149487f tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:44:43.761447 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-28f9ed47-b3a3-4a96-91df-5e45b149487f tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:44:43.891134 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-28f9ed47-b3a3-4a96-91df-5e45b149487f tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2beee1a677a47b48dd244a12de6dac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be36356ccbf4266819b18ca6cee6d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:44:43.899248 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-28f9ed47-b3a3-4a96-91df-5e45b149487f tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] 10.222.0.26 "GET /compute/v2.1/servers/fc399f31-567a-44d4-b68a-899a9870aadb" status: 200 len: 1506 microversion: 2.1 time: 0.152367 Oct 08 21:44:43.899783 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3259/6444] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:44:43 2022] GET /compute/v2.1/servers/fc399f31-567a-44d4-b68a-899a9870aadb => generated 1506 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:44:43.922169 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-07ca7bf8-e7f6-406c-8872-a47d35757b10 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:44:43.922879 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-07ca7bf8-e7f6-406c-8872-a47d35757b10 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] [instance: fc399f31-567a-44d4-b68a-899a9870aadb] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:44:43.929731 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-07ca7bf8-e7f6-406c-8872-a47d35757b10 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:44:43.930264 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-07ca7bf8-e7f6-406c-8872-a47d35757b10 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:44:43.930693 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-07ca7bf8-e7f6-406c-8872-a47d35757b10 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:44:43.931396 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-07ca7bf8-e7f6-406c-8872-a47d35757b10 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:44:43.931856 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-07ca7bf8-e7f6-406c-8872-a47d35757b10 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:44:43.932289 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-07ca7bf8-e7f6-406c-8872-a47d35757b10 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:44:44.061057 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-07ca7bf8-e7f6-406c-8872-a47d35757b10 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2beee1a677a47b48dd244a12de6dac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be36356ccbf4266819b18ca6cee6d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:44:44.069105 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-07ca7bf8-e7f6-406c-8872-a47d35757b10 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] 10.222.0.26 "GET /compute/v2.1/servers/fc399f31-567a-44d4-b68a-899a9870aadb" status: 200 len: 1506 microversion: 2.1 time: 0.151057 Oct 08 21:44:44.069711 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3186/6445] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:44:43 2022] GET /compute/v2.1/servers/fc399f31-567a-44d4-b68a-899a9870aadb => generated 1506 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:44:44.090590 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e2c0971b-6b5f-431a-9147-8f391f4b523c tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:44:44.091226 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-e2c0971b-6b5f-431a-9147-8f391f4b523c tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] [instance: fc399f31-567a-44d4-b68a-899a9870aadb] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:44:44.097782 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e2c0971b-6b5f-431a-9147-8f391f4b523c tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:44:44.098286 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e2c0971b-6b5f-431a-9147-8f391f4b523c tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:44:44.098745 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e2c0971b-6b5f-431a-9147-8f391f4b523c tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:44:44.099461 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e2c0971b-6b5f-431a-9147-8f391f4b523c tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:44:44.099938 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e2c0971b-6b5f-431a-9147-8f391f4b523c tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:44:44.100391 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e2c0971b-6b5f-431a-9147-8f391f4b523c tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:44:44.234143 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-e2c0971b-6b5f-431a-9147-8f391f4b523c tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2beee1a677a47b48dd244a12de6dac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be36356ccbf4266819b18ca6cee6d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:44:44.242500 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-e2c0971b-6b5f-431a-9147-8f391f4b523c tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] 10.222.0.26 "GET /compute/v2.1/servers/fc399f31-567a-44d4-b68a-899a9870aadb" status: 200 len: 1506 microversion: 2.1 time: 0.155753 Oct 08 21:44:44.243089 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3260/6446] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:44:44 2022] GET /compute/v2.1/servers/fc399f31-567a-44d4-b68a-899a9870aadb => generated 1506 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:44:44.263893 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-280c8842-e724-43ec-9966-e35c5a103d22 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:44:44.264391 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-280c8842-e724-43ec-9966-e35c5a103d22 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] [instance: fc399f31-567a-44d4-b68a-899a9870aadb] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:44:44.270960 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-280c8842-e724-43ec-9966-e35c5a103d22 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:44:44.271449 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-280c8842-e724-43ec-9966-e35c5a103d22 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:44:44.271888 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-280c8842-e724-43ec-9966-e35c5a103d22 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:44:44.272581 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-280c8842-e724-43ec-9966-e35c5a103d22 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:44:44.273045 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-280c8842-e724-43ec-9966-e35c5a103d22 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:44:44.273508 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-280c8842-e724-43ec-9966-e35c5a103d22 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:44:44.298576 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-280c8842-e724-43ec-9966-e35c5a103d22 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] [instance: fc399f31-567a-44d4-b68a-899a9870aadb] Going to try to terminate instance {{(pid=140491) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 21:44:44.372038 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-280c8842-e724-43ec-9966-e35c5a103d22 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] 10.222.0.26 "DELETE /compute/v2.1/servers/fc399f31-567a-44d4-b68a-899a9870aadb" status: 204 len: 0 microversion: 2.1 time: 0.111719 Oct 08 21:44:44.372667 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3187/6447] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:44:44 2022] DELETE /compute/v2.1/servers/fc399f31-567a-44d4-b68a-899a9870aadb => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 21:44:44.387090 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-db4aa9aa-a1b0-4be8-9a9e-b159108a20c5 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:44:44.387624 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-db4aa9aa-a1b0-4be8-9a9e-b159108a20c5 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] [instance: fc399f31-567a-44d4-b68a-899a9870aadb] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:44:44.394200 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-db4aa9aa-a1b0-4be8-9a9e-b159108a20c5 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:44:44.394714 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-db4aa9aa-a1b0-4be8-9a9e-b159108a20c5 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:44:44.395179 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-db4aa9aa-a1b0-4be8-9a9e-b159108a20c5 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:44:44.395904 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-db4aa9aa-a1b0-4be8-9a9e-b159108a20c5 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:44:44.396390 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-db4aa9aa-a1b0-4be8-9a9e-b159108a20c5 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:44:44.396844 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-db4aa9aa-a1b0-4be8-9a9e-b159108a20c5 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:44:44.422455 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-db4aa9aa-a1b0-4be8-9a9e-b159108a20c5 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] [instance: fc399f31-567a-44d4-b68a-899a9870aadb] Going to try to terminate instance {{(pid=140492) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 21:44:44.468485 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.compute.api [None req-db4aa9aa-a1b0-4be8-9a9e-b159108a20c5 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] [instance: fc399f31-567a-44d4-b68a-899a9870aadb] Instance is already in deleting state, ignoring this request Oct 08 21:44:44.469380 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-db4aa9aa-a1b0-4be8-9a9e-b159108a20c5 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] 10.222.0.26 "DELETE /compute/v2.1/servers/fc399f31-567a-44d4-b68a-899a9870aadb" status: 204 len: 0 microversion: 2.1 time: 0.086169 Oct 08 21:44:44.470593 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3261/6448] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:44:44 2022] DELETE /compute/v2.1/servers/fc399f31-567a-44d4-b68a-899a9870aadb => generated 0 bytes in 88 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 08 21:44:44.479299 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-122871e7-4f8e-4d5a-9628-bbf631e000dc tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:44:44.480014 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-122871e7-4f8e-4d5a-9628-bbf631e000dc tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] [instance: fc399f31-567a-44d4-b68a-899a9870aadb] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:44:44.486218 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-122871e7-4f8e-4d5a-9628-bbf631e000dc tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:44:44.486720 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-122871e7-4f8e-4d5a-9628-bbf631e000dc tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:44:44.487171 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-122871e7-4f8e-4d5a-9628-bbf631e000dc tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:44:44.487887 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-122871e7-4f8e-4d5a-9628-bbf631e000dc tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:44:44.488353 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-122871e7-4f8e-4d5a-9628-bbf631e000dc tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:44:44.488790 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-122871e7-4f8e-4d5a-9628-bbf631e000dc tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:44:44.622642 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-122871e7-4f8e-4d5a-9628-bbf631e000dc tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2beee1a677a47b48dd244a12de6dac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be36356ccbf4266819b18ca6cee6d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:44:44.630995 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-122871e7-4f8e-4d5a-9628-bbf631e000dc tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] 10.222.0.26 "GET /compute/v2.1/servers/fc399f31-567a-44d4-b68a-899a9870aadb" status: 200 len: 1512 microversion: 2.1 time: 0.155953 Oct 08 21:44:44.631567 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3188/6449] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:44:44 2022] GET /compute/v2.1/servers/fc399f31-567a-44d4-b68a-899a9870aadb => generated 1512 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:44:45.654475 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-230ee5b4-87c9-4738-9f5d-1c35a20327ff tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:44:45.655107 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-230ee5b4-87c9-4738-9f5d-1c35a20327ff tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] [instance: fc399f31-567a-44d4-b68a-899a9870aadb] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:44:45.662590 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-230ee5b4-87c9-4738-9f5d-1c35a20327ff tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:44:45.663096 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-230ee5b4-87c9-4738-9f5d-1c35a20327ff tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:44:45.663559 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-230ee5b4-87c9-4738-9f5d-1c35a20327ff tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:44:45.664296 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-230ee5b4-87c9-4738-9f5d-1c35a20327ff tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:44:45.664776 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-230ee5b4-87c9-4738-9f5d-1c35a20327ff tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:44:45.665249 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-230ee5b4-87c9-4738-9f5d-1c35a20327ff tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:44:45.795203 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-230ee5b4-87c9-4738-9f5d-1c35a20327ff tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2beee1a677a47b48dd244a12de6dac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be36356ccbf4266819b18ca6cee6d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:44:45.802999 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-230ee5b4-87c9-4738-9f5d-1c35a20327ff tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] 10.222.0.26 "GET /compute/v2.1/servers/fc399f31-567a-44d4-b68a-899a9870aadb" status: 200 len: 1512 microversion: 2.1 time: 0.152471 Oct 08 21:44:45.803577 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3262/6450] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:44:45 2022] GET /compute/v2.1/servers/fc399f31-567a-44d4-b68a-899a9870aadb => generated 1512 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:44:46.282905 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-f289675c-f52c-4db4-8e48-d4cc48acf3d9 req-ea5a0eb5-cce5-4423-9c2f-7a5eda807309 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc399f31-567a-44d4-b68a-899a9870aadb", "name": "network-vif-deleted", "tag": "d870e1ed-0cd2-4df8-ac8a-d3e4addc828b"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:44:46.294023 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-f289675c-f52c-4db4-8e48-d4cc48acf3d9 req-ea5a0eb5-cce5-4423-9c2f-7a5eda807309 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:44:46.294502 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-f289675c-f52c-4db4-8e48-d4cc48acf3d9 req-ea5a0eb5-cce5-4423-9c2f-7a5eda807309 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:44:46.294934 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-f289675c-f52c-4db4-8e48-d4cc48acf3d9 req-ea5a0eb5-cce5-4423-9c2f-7a5eda807309 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:44:46.306379 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-f289675c-f52c-4db4-8e48-d4cc48acf3d9 req-ea5a0eb5-cce5-4423-9c2f-7a5eda807309 service nova] Creating event network-vif-deleted:d870e1ed-0cd2-4df8-ac8a-d3e4addc828b for instance fc399f31-567a-44d4-b68a-899a9870aadb on nch1-master-1 Oct 08 21:44:46.311817 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-f289675c-f52c-4db4-8e48-d4cc48acf3d9 req-ea5a0eb5-cce5-4423-9c2f-7a5eda807309 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032627 Oct 08 21:44:46.312488 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3189/6451] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:44:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:44:46.825824 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-0f1da409-d121-4693-a06c-6970eae2dd23 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:44:46.826404 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-0f1da409-d121-4693-a06c-6970eae2dd23 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] [instance: fc399f31-567a-44d4-b68a-899a9870aadb] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:44:46.833425 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0f1da409-d121-4693-a06c-6970eae2dd23 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:44:46.833930 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0f1da409-d121-4693-a06c-6970eae2dd23 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:44:46.834388 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0f1da409-d121-4693-a06c-6970eae2dd23 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:44:46.835097 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0f1da409-d121-4693-a06c-6970eae2dd23 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:44:46.835572 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0f1da409-d121-4693-a06c-6970eae2dd23 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:44:46.836014 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0f1da409-d121-4693-a06c-6970eae2dd23 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:44:46.849780 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-0f1da409-d121-4693-a06c-6970eae2dd23 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] HTTP exception thrown: Instance fc399f31-567a-44d4-b68a-899a9870aadb could not be found. Oct 08 21:44:46.851421 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-0f1da409-d121-4693-a06c-6970eae2dd23 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Request method failure captured: Oct 08 21:44:46.851421 ncdv-master-1 devstack@n-api.service[140492]: request: GET /compute/v2.1/servers/fc399f31-567a-44d4-b68a-899a9870aadb HTTP/1.1 Oct 08 21:44:46.851421 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:44:46.851421 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:44:46.851421 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:44:46.851421 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 21:44:46.851421 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:44:46.851421 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:44:46.851421 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:44:46.851421 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:44:46.851421 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQe7ujcdysfWgKdZoGkgnE3EajHi2ll90Abd8yxvcDDtgzYpJ4fz2fZCwCMXBcIVDegiM7lP1r8YAi23asihc9Z7ZZ6a9glSWPD-iTjS2lfBQS4oIhxnO_fj3BB8q8HJ_WsUCI7H42VQ3WCjUKLcr3CQ0jf8InpXI74dH6vZ_tJhoCCU Oct 08 21:44:46.851421 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:44:46.851421 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:44:46.851421 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:44:46.851421 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:44:46.851421 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:44:46.851421 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:44:46.851421 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 1be36356ccbf4266819b18ca6cee6d97 Oct 08 21:44:46.851421 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-ServerDiskConfigTestJSON-67474496 Oct 08 21:44:46.851421 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:44:46.851421 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:44:46.851421 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1be36356ccbf4266819b18ca6cee6d97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1be36356ccbf4266819b18ca6cee6d97"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1be36356ccbf4266819b18ca6cee6d97"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1be36356ccbf4266819b18ca6cee6d97"}]}] Oct 08 21:44:46.851421 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-ServerDiskConfigTestJSON-67474496 Oct 08 21:44:46.851421 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 1be36356ccbf4266819b18ca6cee6d97 Oct 08 21:44:46.851421 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-67474496 Oct 08 21:44:46.851421 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-ServerDiskConfigTestJSON-67474496-project Oct 08 21:44:46.851421 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:44:46.851421 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:44:46.851421 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: b2beee1a677a47b48dd244a12de6dac0 Oct 08 21:44:46.851421 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-ServerDiskConfigTestJSON-67474496-project Oct 08 21:44:46.851421 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 21:44:46.851421 ncdv-master-1 devstack@n-api.service[140492]: exception: Instance fc399f31-567a-44d4-b68a-899a9870aadb could not be found. Oct 08 21:44:46.851421 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': 'fc399f31-567a-44d4-b68a-899a9870aadb'} Oct 08 21:44:46.851421 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:44:46.851421 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:44:46.851421 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:44:46.851421 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:44:46.851421 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:44:46.851421 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:44:46.851421 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:44:46.851421 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:44:46.851421 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:44:46.851421 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:44:46.851421 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc399f31-567a-44d4-b68a-899a9870aadb could not be found. Oct 08 21:44:46.851421 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:44:46.851421 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:44:46.851421 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:44:46.851421 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:44:46.851421 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:44:46.851421 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:44:46.851421 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:44:46.851421 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:44:46.851421 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:44:46.851421 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:44:46.851421 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:44:46.851421 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:44:46.851421 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:44:46.851421 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:44:46.851421 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:44:46.851421 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:44:46.851421 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc399f31-567a-44d4-b68a-899a9870aadb could not be found. Oct 08 21:44:46.851421 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:44:46.851421 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:44:46.851421 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:44:46.856323 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:44:46.856323 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:44:46.856323 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:44:46.856323 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:44:46.856323 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:44:46.856323 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc399f31-567a-44d4-b68a-899a9870aadb could not be found. Oct 08 21:44:46.856323 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:44:46.856323 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-0f1da409-d121-4693-a06c-6970eae2dd23 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Returning 404 to user: Instance fc399f31-567a-44d4-b68a-899a9870aadb could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:44:46.856323 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-0f1da409-d121-4693-a06c-6970eae2dd23 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] 10.222.0.26 "GET /compute/v2.1/servers/fc399f31-567a-44d4-b68a-899a9870aadb" status: 404 len: 111 microversion: 2.1 time: 0.031026 Oct 08 21:44:46.856323 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3263/6452] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:44:46 2022] GET /compute/v2.1/servers/fc399f31-567a-44d4-b68a-899a9870aadb => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:44:46.862833 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-7a89cf64-e3ec-485d-a410-b38b809186c1 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Calling method '.version_select at 0x7f1a876ae700>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:44:46.885167 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-7a89cf64-e3ec-485d-a410-b38b809186c1 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-510640017" status: 202 len: 0 microversion: 2.1 time: 0.027186 Oct 08 21:44:46.885773 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3190/6453] 10.222.0.26 () {58 vars in 1218 bytes} [Sat Oct 8 21:44:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-510640017 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 21:44:47.478884 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-97a77d20-1836-4a6d-b6b7-896d221c69f6 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:44:47.479415 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-97a77d20-1836-4a6d-b6b7-896d221c69f6 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] [instance: a3f6deb2-34ba-4813-9c6c-433cfa3108c6] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:44:47.485714 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-97a77d20-1836-4a6d-b6b7-896d221c69f6 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:44:47.486230 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-97a77d20-1836-4a6d-b6b7-896d221c69f6 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:44:47.486697 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-97a77d20-1836-4a6d-b6b7-896d221c69f6 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:44:47.487427 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-97a77d20-1836-4a6d-b6b7-896d221c69f6 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:44:47.487912 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-97a77d20-1836-4a6d-b6b7-896d221c69f6 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:44:47.488371 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-97a77d20-1836-4a6d-b6b7-896d221c69f6 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:44:47.502302 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-97a77d20-1836-4a6d-b6b7-896d221c69f6 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] HTTP exception thrown: Instance a3f6deb2-34ba-4813-9c6c-433cfa3108c6 could not be found. Oct 08 21:44:47.503849 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-97a77d20-1836-4a6d-b6b7-896d221c69f6 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Request method failure captured: Oct 08 21:44:47.503849 ncdv-master-1 devstack@n-api.service[140492]: request: DELETE /compute/v2.1/servers/a3f6deb2-34ba-4813-9c6c-433cfa3108c6 HTTP/1.1 Oct 08 21:44:47.503849 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:44:47.503849 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:44:47.503849 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:44:47.503849 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 21:44:47.503849 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:44:47.503849 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:44:47.503849 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:44:47.503849 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:44:47.503849 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQe7ujcdysfWgKdZoGkgnE3EajHi2ll90Abd8yxvcDDtgzYpJ4fz2fZCwCMXBcIVDegiM7lP1r8YAi23asihc9Z7ZZ6a9glSWPD-iTjS2lfBQS4oIhxnO_fj3BB8q8HJ_WsUCI7H42VQ3WCjUKLcr3CQ0jf8InpXI74dH6vZ_tJhoCCU Oct 08 21:44:47.503849 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:44:47.503849 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:44:47.503849 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:44:47.503849 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:44:47.503849 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:44:47.503849 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:44:47.503849 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 1be36356ccbf4266819b18ca6cee6d97 Oct 08 21:44:47.503849 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-ServerDiskConfigTestJSON-67474496 Oct 08 21:44:47.503849 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:44:47.503849 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:44:47.503849 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1be36356ccbf4266819b18ca6cee6d97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1be36356ccbf4266819b18ca6cee6d97"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1be36356ccbf4266819b18ca6cee6d97"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1be36356ccbf4266819b18ca6cee6d97"}]}] Oct 08 21:44:47.503849 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-ServerDiskConfigTestJSON-67474496 Oct 08 21:44:47.503849 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 1be36356ccbf4266819b18ca6cee6d97 Oct 08 21:44:47.503849 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-67474496 Oct 08 21:44:47.503849 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-ServerDiskConfigTestJSON-67474496-project Oct 08 21:44:47.503849 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:44:47.503849 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:44:47.503849 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: b2beee1a677a47b48dd244a12de6dac0 Oct 08 21:44:47.503849 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-ServerDiskConfigTestJSON-67474496-project Oct 08 21:44:47.503849 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 21:44:47.503849 ncdv-master-1 devstack@n-api.service[140492]: exception: Instance a3f6deb2-34ba-4813-9c6c-433cfa3108c6 could not be found. Oct 08 21:44:47.503849 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': 'a3f6deb2-34ba-4813-9c6c-433cfa3108c6'} Oct 08 21:44:47.503849 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:44:47.503849 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:44:47.503849 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:44:47.503849 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:44:47.503849 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:44:47.503849 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:44:47.503849 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:44:47.503849 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:44:47.503849 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:44:47.503849 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:44:47.503849 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3f6deb2-34ba-4813-9c6c-433cfa3108c6 could not be found. Oct 08 21:44:47.503849 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:44:47.503849 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:44:47.503849 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:44:47.503849 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:44:47.503849 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:44:47.503849 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:44:47.503849 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:44:47.503849 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:44:47.503849 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:44:47.503849 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:44:47.503849 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 08 21:44:47.503849 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 08 21:44:47.503849 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 08 21:44:47.503849 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 08 21:44:47.503849 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:44:47.503849 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:44:47.503849 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:44:47.503849 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:44:47.508726 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3f6deb2-34ba-4813-9c6c-433cfa3108c6 could not be found. Oct 08 21:44:47.508726 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:44:47.508726 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:44:47.508726 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:44:47.508726 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:44:47.508726 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:44:47.508726 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:44:47.508726 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:44:47.508726 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:44:47.508726 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3f6deb2-34ba-4813-9c6c-433cfa3108c6 could not be found. Oct 08 21:44:47.508726 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:44:47.508726 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-97a77d20-1836-4a6d-b6b7-896d221c69f6 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Returning 404 to user: Instance a3f6deb2-34ba-4813-9c6c-433cfa3108c6 could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:44:47.508726 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-97a77d20-1836-4a6d-b6b7-896d221c69f6 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] 10.222.0.26 "DELETE /compute/v2.1/servers/a3f6deb2-34ba-4813-9c6c-433cfa3108c6" status: 404 len: 111 microversion: 2.1 time: 0.030405 Oct 08 21:44:47.508726 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3264/6454] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:44:47 2022] DELETE /compute/v2.1/servers/a3f6deb2-34ba-4813-9c6c-433cfa3108c6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:44:47.514923 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-7db700b1-d165-4520-93b6-f9c683954719 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:44:47.515679 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-7db700b1-d165-4520-93b6-f9c683954719 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] [instance: a3f6deb2-34ba-4813-9c6c-433cfa3108c6] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:44:47.526197 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7db700b1-d165-4520-93b6-f9c683954719 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:44:47.526699 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7db700b1-d165-4520-93b6-f9c683954719 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:44:47.527152 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7db700b1-d165-4520-93b6-f9c683954719 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:44:47.527861 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7db700b1-d165-4520-93b6-f9c683954719 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:44:47.528332 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7db700b1-d165-4520-93b6-f9c683954719 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:44:47.528793 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7db700b1-d165-4520-93b6-f9c683954719 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:44:47.542976 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-7db700b1-d165-4520-93b6-f9c683954719 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] HTTP exception thrown: Instance a3f6deb2-34ba-4813-9c6c-433cfa3108c6 could not be found. Oct 08 21:44:47.544629 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-7db700b1-d165-4520-93b6-f9c683954719 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Request method failure captured: Oct 08 21:44:47.544629 ncdv-master-1 devstack@n-api.service[140491]: request: GET /compute/v2.1/servers/a3f6deb2-34ba-4813-9c6c-433cfa3108c6 HTTP/1.1 Oct 08 21:44:47.544629 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:44:47.544629 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:44:47.544629 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:44:47.544629 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 21:44:47.544629 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:44:47.544629 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:44:47.544629 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:44:47.544629 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:44:47.544629 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQe7ujcdysfWgKdZoGkgnE3EajHi2ll90Abd8yxvcDDtgzYpJ4fz2fZCwCMXBcIVDegiM7lP1r8YAi23asihc9Z7ZZ6a9glSWPD-iTjS2lfBQS4oIhxnO_fj3BB8q8HJ_WsUCI7H42VQ3WCjUKLcr3CQ0jf8InpXI74dH6vZ_tJhoCCU Oct 08 21:44:47.544629 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:44:47.544629 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:44:47.544629 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:44:47.544629 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:44:47.544629 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:44:47.544629 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:44:47.544629 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 1be36356ccbf4266819b18ca6cee6d97 Oct 08 21:44:47.544629 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-ServerDiskConfigTestJSON-67474496 Oct 08 21:44:47.544629 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:44:47.544629 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:44:47.544629 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1be36356ccbf4266819b18ca6cee6d97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1be36356ccbf4266819b18ca6cee6d97"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1be36356ccbf4266819b18ca6cee6d97"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1be36356ccbf4266819b18ca6cee6d97"}]}] Oct 08 21:44:47.544629 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-ServerDiskConfigTestJSON-67474496 Oct 08 21:44:47.544629 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 1be36356ccbf4266819b18ca6cee6d97 Oct 08 21:44:47.544629 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-67474496 Oct 08 21:44:47.544629 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-ServerDiskConfigTestJSON-67474496-project Oct 08 21:44:47.544629 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:44:47.544629 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:44:47.544629 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: b2beee1a677a47b48dd244a12de6dac0 Oct 08 21:44:47.544629 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-ServerDiskConfigTestJSON-67474496-project Oct 08 21:44:47.544629 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:44:47.544629 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance a3f6deb2-34ba-4813-9c6c-433cfa3108c6 could not be found. Oct 08 21:44:47.544629 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': 'a3f6deb2-34ba-4813-9c6c-433cfa3108c6'} Oct 08 21:44:47.544629 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:44:47.544629 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:44:47.544629 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:44:47.544629 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:44:47.544629 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:44:47.544629 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:44:47.544629 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:44:47.544629 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:44:47.544629 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:44:47.544629 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:44:47.544629 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3f6deb2-34ba-4813-9c6c-433cfa3108c6 could not be found. Oct 08 21:44:47.544629 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:44:47.544629 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:44:47.544629 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:44:47.544629 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:44:47.544629 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:44:47.544629 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:44:47.544629 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:44:47.544629 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:44:47.544629 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:44:47.544629 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:44:47.544629 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:44:47.544629 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:44:47.544629 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:44:47.544629 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:44:47.544629 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:44:47.544629 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:44:47.544629 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3f6deb2-34ba-4813-9c6c-433cfa3108c6 could not be found. Oct 08 21:44:47.544629 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:44:47.544629 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:44:47.544629 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:44:47.549495 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:44:47.549495 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:44:47.549495 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:44:47.549495 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:44:47.549495 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:44:47.549495 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3f6deb2-34ba-4813-9c6c-433cfa3108c6 could not be found. Oct 08 21:44:47.549495 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:44:47.549495 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-7db700b1-d165-4520-93b6-f9c683954719 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] Returning 404 to user: Instance a3f6deb2-34ba-4813-9c6c-433cfa3108c6 could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:44:47.549495 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-7db700b1-d165-4520-93b6-f9c683954719 tempest-ServerDiskConfigTestJSON-67474496 tempest-ServerDiskConfigTestJSON-67474496-project] 10.222.0.26 "GET /compute/v2.1/servers/a3f6deb2-34ba-4813-9c6c-433cfa3108c6" status: 404 len: 111 microversion: 2.1 time: 0.036082 Oct 08 21:44:47.549495 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3191/6455] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:44:47 2022] GET /compute/v2.1/servers/a3f6deb2-34ba-4813-9c6c-433cfa3108c6 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:44:56.072615 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-821a04be-08f6-4b0c-90a7-41dfd91a2435 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Action: 'create', calling method: .version_select at 0x7f1a874a8e50>, body: {"keypair": {"name": "tempest-keypair-1142039836", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHOt5sCRj5CQlpGdvvLHfgSdmXFUVfzWzxaknpZ8aLx+W1wAbw1PmlHyMCrlY5zyT+9WoIlhWxx/D6bswInNyLo8Y9prPdNH62iFD1sYh68tcRG5Qm2FdpBO3gN21/Gvlw=="}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:44:56.090277 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-821a04be-08f6-4b0c-90a7-41dfd91a2435 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Getting quotas for project 3718dd3e536649b5bf1970ff06ddea69. Resources: {'key_pairs'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:44:56.095984 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-821a04be-08f6-4b0c-90a7-41dfd91a2435 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Getting quotas for user 5e838176b44c4f23b470cfc152f79990 and project 3718dd3e536649b5bf1970ff06ddea69. Resources: {'key_pairs'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:44:56.123120 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-821a04be-08f6-4b0c-90a7-41dfd91a2435 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.171652 Oct 08 21:44:56.123958 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3265/6456] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Oct 8 21:44:55 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:44:57.392805 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-5e2e3df9-c2a2-4f0c-9d09-ae4571af7f3d tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1670934080", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "99fc871d-a990-4798-830c-471348036e9e"}], "security_groups": [{"name": "tempest-securitygroup--1818474219"}], "key_name": "tempest-keypair-1142039836", "user_data": "}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:44:57.500514 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.network.neutron [None req-5e2e3df9-c2a2-4f0c-9d09-ae4571af7f3d tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] validate_networks() for [('99fc871d-a990-4798-830c-471348036e9e', None, None, None, None, None)] {{(pid=140491) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 21:44:57.534749 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:44:57.899956 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-5e2e3df9-c2a2-4f0c-9d09-ae4571af7f3d tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Flavor limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 21:44:57.900524 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-5e2e3df9-c2a2-4f0c-9d09-ae4571af7f3d tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Image limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 21:44:57.901101 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-5e2e3df9-c2a2-4f0c-9d09-ae4571af7f3d tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Flavor pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 21:44:57.901554 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-5e2e3df9-c2a2-4f0c-9d09-ae4571af7f3d tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Image pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 21:44:57.902041 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-5e2e3df9-c2a2-4f0c-9d09-ae4571af7f3d tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 21:44:57.911845 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5e2e3df9-c2a2-4f0c-9d09-ae4571af7f3d tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:44:57.912343 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5e2e3df9-c2a2-4f0c-9d09-ae4571af7f3d tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:44:57.912794 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5e2e3df9-c2a2-4f0c-9d09-ae4571af7f3d tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:44:57.913787 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5e2e3df9-c2a2-4f0c-9d09-ae4571af7f3d tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:44:57.914261 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5e2e3df9-c2a2-4f0c-9d09-ae4571af7f3d tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:44:57.914700 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5e2e3df9-c2a2-4f0c-9d09-ae4571af7f3d tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:44:57.932270 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-5e2e3df9-c2a2-4f0c-9d09-ae4571af7f3d tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Getting quotas for project 3718dd3e536649b5bf1970ff06ddea69. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:44:57.937996 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-5e2e3df9-c2a2-4f0c-9d09-ae4571af7f3d tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Getting quotas for user 5e838176b44c4f23b470cfc152f79990 and project 3718dd3e536649b5bf1970ff06ddea69. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:44:57.951136 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-5e2e3df9-c2a2-4f0c-9d09-ae4571af7f3d tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Going to run 1 instances... {{(pid=140491) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 21:44:57.953501 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-5e2e3df9-c2a2-4f0c-9d09-ae4571af7f3d tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: a3c87119-d9e1-433a-a43d-7aa600968dd0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c508bd7f-7db9-4b2c-af7c-be54a855c355',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140491) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 21:44:58.002200 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-5e2e3df9-c2a2-4f0c-9d09-ae4571af7f3d tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.614569 Oct 08 21:44:58.003037 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3192/6457] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 21:44:57 2022] POST /compute/v2.1/servers => generated 409 bytes in 616 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 08 21:44:58.014008 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-2bda06c9-3033-4f39-8f85-e90e5ca34fab tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:44:58.014541 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-2bda06c9-3033-4f39-8f85-e90e5ca34fab tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: a3c87119-d9e1-433a-a43d-7aa600968dd0] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:44:58.017414 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:44:58.018252 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:44:58.081336 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-2bda06c9-3033-4f39-8f85-e90e5ca34fab tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e838176b44c4f23b470cfc152f79990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3718dd3e536649b5bf1970ff06ddea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:44:58.091215 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-2bda06c9-3033-4f39-8f85-e90e5ca34fab tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/a3c87119-d9e1-433a-a43d-7aa600968dd0" status: 200 len: 1239 microversion: 2.1 time: 0.080913 Oct 08 21:44:58.091989 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3266/6458] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:44:58 2022] GET /compute/v2.1/servers/a3c87119-d9e1-433a-a43d-7aa600968dd0 => generated 1239 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:44:59.114926 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-8d7eedcd-9025-4f04-82e5-c4159a21d20a tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:44:59.115547 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-8d7eedcd-9025-4f04-82e5-c4159a21d20a tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: a3c87119-d9e1-433a-a43d-7aa600968dd0] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:44:59.119391 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:44:59.127900 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8d7eedcd-9025-4f04-82e5-c4159a21d20a tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:44:59.128787 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8d7eedcd-9025-4f04-82e5-c4159a21d20a tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:44:59.129430 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8d7eedcd-9025-4f04-82e5-c4159a21d20a tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:44:59.130329 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8d7eedcd-9025-4f04-82e5-c4159a21d20a tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:44:59.130800 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8d7eedcd-9025-4f04-82e5-c4159a21d20a tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:44:59.131427 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8d7eedcd-9025-4f04-82e5-c4159a21d20a tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:44:59.213363 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-8d7eedcd-9025-4f04-82e5-c4159a21d20a tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e838176b44c4f23b470cfc152f79990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3718dd3e536649b5bf1970ff06ddea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:44:59.224785 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-8d7eedcd-9025-4f04-82e5-c4159a21d20a tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/a3c87119-d9e1-433a-a43d-7aa600968dd0" status: 200 len: 1291 microversion: 2.1 time: 0.114007 Oct 08 21:44:59.227175 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3193/6459] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:44:59 2022] GET /compute/v2.1/servers/a3c87119-d9e1-433a-a43d-7aa600968dd0 => generated 1291 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:45:00.250410 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-f84b493b-5d7b-4812-83f5-7f1ee1ed2a76 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:45:00.251780 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-f84b493b-5d7b-4812-83f5-7f1ee1ed2a76 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: a3c87119-d9e1-433a-a43d-7aa600968dd0] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:45:00.258986 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f84b493b-5d7b-4812-83f5-7f1ee1ed2a76 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:45:00.259576 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f84b493b-5d7b-4812-83f5-7f1ee1ed2a76 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:45:00.260131 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f84b493b-5d7b-4812-83f5-7f1ee1ed2a76 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:45:00.260929 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f84b493b-5d7b-4812-83f5-7f1ee1ed2a76 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:45:00.261508 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f84b493b-5d7b-4812-83f5-7f1ee1ed2a76 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:45:00.262031 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f84b493b-5d7b-4812-83f5-7f1ee1ed2a76 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:45:00.400005 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-f84b493b-5d7b-4812-83f5-7f1ee1ed2a76 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e838176b44c4f23b470cfc152f79990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3718dd3e536649b5bf1970ff06ddea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:45:00.408587 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-f84b493b-5d7b-4812-83f5-7f1ee1ed2a76 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/a3c87119-d9e1-433a-a43d-7aa600968dd0" status: 200 len: 1365 microversion: 2.1 time: 0.162070 Oct 08 21:45:00.409717 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3267/6460] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:45:00 2022] GET /compute/v2.1/servers/a3c87119-d9e1-433a-a43d-7aa600968dd0 => generated 1365 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:45:00.705995 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-9e200652-7484-4f10-8373-084eda203c16 req-ad6f7e40-6a3c-49f4-a0eb-8ffccad63bcb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3c87119-d9e1-433a-a43d-7aa600968dd0", "tag": "579db8d5-7575-4d12-ad97-ed15ad970529"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:45:00.717027 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-9e200652-7484-4f10-8373-084eda203c16 req-ad6f7e40-6a3c-49f4-a0eb-8ffccad63bcb service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:45:00.717546 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-9e200652-7484-4f10-8373-084eda203c16 req-ad6f7e40-6a3c-49f4-a0eb-8ffccad63bcb service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:45:00.717986 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-9e200652-7484-4f10-8373-084eda203c16 req-ad6f7e40-6a3c-49f4-a0eb-8ffccad63bcb service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:45:00.730282 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-9e200652-7484-4f10-8373-084eda203c16 req-ad6f7e40-6a3c-49f4-a0eb-8ffccad63bcb service nova] Creating event network-changed:579db8d5-7575-4d12-ad97-ed15ad970529 for instance a3c87119-d9e1-433a-a43d-7aa600968dd0 on nch1-master-1 Oct 08 21:45:00.735793 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-9e200652-7484-4f10-8373-084eda203c16 req-ad6f7e40-6a3c-49f4-a0eb-8ffccad63bcb service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042665 Oct 08 21:45:00.736399 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3194/6461] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:45:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:45:01.431963 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-73abb23a-e9c3-4fd5-a815-766d74d8a85c tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:45:01.432549 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-73abb23a-e9c3-4fd5-a815-766d74d8a85c tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: a3c87119-d9e1-433a-a43d-7aa600968dd0] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:45:01.440009 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-73abb23a-e9c3-4fd5-a815-766d74d8a85c tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:45:01.440518 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-73abb23a-e9c3-4fd5-a815-766d74d8a85c tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:45:01.440981 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-73abb23a-e9c3-4fd5-a815-766d74d8a85c tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:45:01.441733 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-73abb23a-e9c3-4fd5-a815-766d74d8a85c tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:45:01.442216 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-73abb23a-e9c3-4fd5-a815-766d74d8a85c tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:45:01.442695 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-73abb23a-e9c3-4fd5-a815-766d74d8a85c tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:45:01.572891 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-73abb23a-e9c3-4fd5-a815-766d74d8a85c tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e838176b44c4f23b470cfc152f79990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3718dd3e536649b5bf1970ff06ddea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:45:01.580750 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-73abb23a-e9c3-4fd5-a815-766d74d8a85c tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/a3c87119-d9e1-433a-a43d-7aa600968dd0" status: 200 len: 1365 microversion: 2.1 time: 0.152830 Oct 08 21:45:01.581348 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3268/6462] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:45:01 2022] GET /compute/v2.1/servers/a3c87119-d9e1-433a-a43d-7aa600968dd0 => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:45:02.604446 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-2e0320a4-25d8-490b-a202-aa5b1cc68a23 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:45:02.605158 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-2e0320a4-25d8-490b-a202-aa5b1cc68a23 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: a3c87119-d9e1-433a-a43d-7aa600968dd0] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:45:02.611531 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2e0320a4-25d8-490b-a202-aa5b1cc68a23 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:45:02.612029 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2e0320a4-25d8-490b-a202-aa5b1cc68a23 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:45:02.612483 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2e0320a4-25d8-490b-a202-aa5b1cc68a23 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:45:02.613213 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2e0320a4-25d8-490b-a202-aa5b1cc68a23 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:45:02.613688 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2e0320a4-25d8-490b-a202-aa5b1cc68a23 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:45:02.614130 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2e0320a4-25d8-490b-a202-aa5b1cc68a23 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:45:02.818756 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-2e0320a4-25d8-490b-a202-aa5b1cc68a23 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e838176b44c4f23b470cfc152f79990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3718dd3e536649b5bf1970ff06ddea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:45:02.826668 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-2e0320a4-25d8-490b-a202-aa5b1cc68a23 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/a3c87119-d9e1-433a-a43d-7aa600968dd0" status: 200 len: 1365 microversion: 2.1 time: 0.227272 Oct 08 21:45:02.827258 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3195/6463] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:45:02 2022] GET /compute/v2.1/servers/a3c87119-d9e1-433a-a43d-7aa600968dd0 => generated 1365 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:45:03.849887 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-1fa51699-d37c-49d4-b382-6a68f0f26dc3 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:45:03.850448 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-1fa51699-d37c-49d4-b382-6a68f0f26dc3 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: a3c87119-d9e1-433a-a43d-7aa600968dd0] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:45:03.857752 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1fa51699-d37c-49d4-b382-6a68f0f26dc3 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:45:03.858274 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1fa51699-d37c-49d4-b382-6a68f0f26dc3 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:45:03.858743 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1fa51699-d37c-49d4-b382-6a68f0f26dc3 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:45:03.859472 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1fa51699-d37c-49d4-b382-6a68f0f26dc3 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:45:03.859961 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1fa51699-d37c-49d4-b382-6a68f0f26dc3 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:45:03.860417 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1fa51699-d37c-49d4-b382-6a68f0f26dc3 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:45:04.271876 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-1fa51699-d37c-49d4-b382-6a68f0f26dc3 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e838176b44c4f23b470cfc152f79990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3718dd3e536649b5bf1970ff06ddea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:45:04.279676 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-1fa51699-d37c-49d4-b382-6a68f0f26dc3 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/a3c87119-d9e1-433a-a43d-7aa600968dd0" status: 200 len: 1365 microversion: 2.1 time: 0.433834 Oct 08 21:45:04.280249 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3269/6464] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:45:03 2022] GET /compute/v2.1/servers/a3c87119-d9e1-433a-a43d-7aa600968dd0 => generated 1365 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:45:05.303948 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-5e989363-9087-4da6-aae3-af98ad270540 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:45:05.304563 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-5e989363-9087-4da6-aae3-af98ad270540 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: a3c87119-d9e1-433a-a43d-7aa600968dd0] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:45:05.311644 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5e989363-9087-4da6-aae3-af98ad270540 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:45:05.312135 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5e989363-9087-4da6-aae3-af98ad270540 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:45:05.312579 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5e989363-9087-4da6-aae3-af98ad270540 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:45:05.314006 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5e989363-9087-4da6-aae3-af98ad270540 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:45:05.314464 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5e989363-9087-4da6-aae3-af98ad270540 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:45:05.314895 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5e989363-9087-4da6-aae3-af98ad270540 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:45:05.442828 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-5e989363-9087-4da6-aae3-af98ad270540 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e838176b44c4f23b470cfc152f79990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3718dd3e536649b5bf1970ff06ddea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:45:05.450828 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-5e989363-9087-4da6-aae3-af98ad270540 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/a3c87119-d9e1-433a-a43d-7aa600968dd0" status: 200 len: 1365 microversion: 2.1 time: 0.151422 Oct 08 21:45:05.452219 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3196/6465] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:45:05 2022] GET /compute/v2.1/servers/a3c87119-d9e1-433a-a43d-7aa600968dd0 => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:45:05.679950 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-b4770517-b661-47cd-8b75-a3138e7e8f9d req-11193585-52ac-4464-9b84-58ca7760b564 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3c87119-d9e1-433a-a43d-7aa600968dd0", "name": "network-vif-plugged", "status": "completed", "tag": "579db8d5-7575-4d12-ad97-ed15ad970529"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:45:05.691023 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-b4770517-b661-47cd-8b75-a3138e7e8f9d req-11193585-52ac-4464-9b84-58ca7760b564 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:45:05.691530 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-b4770517-b661-47cd-8b75-a3138e7e8f9d req-11193585-52ac-4464-9b84-58ca7760b564 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:45:05.691992 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-b4770517-b661-47cd-8b75-a3138e7e8f9d req-11193585-52ac-4464-9b84-58ca7760b564 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:45:05.703610 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-b4770517-b661-47cd-8b75-a3138e7e8f9d req-11193585-52ac-4464-9b84-58ca7760b564 service nova] Creating event network-vif-plugged:579db8d5-7575-4d12-ad97-ed15ad970529 for instance a3c87119-d9e1-433a-a43d-7aa600968dd0 on nch1-master-1 Oct 08 21:45:05.708572 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-b4770517-b661-47cd-8b75-a3138e7e8f9d req-11193585-52ac-4464-9b84-58ca7760b564 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032324 Oct 08 21:45:05.709204 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3270/6466] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:45:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:45:06.476388 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-1b1d9739-ac8b-462e-9a36-4e9cb77c8e28 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:45:06.477380 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-1b1d9739-ac8b-462e-9a36-4e9cb77c8e28 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: a3c87119-d9e1-433a-a43d-7aa600968dd0] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:45:06.486417 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1b1d9739-ac8b-462e-9a36-4e9cb77c8e28 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:45:06.487164 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1b1d9739-ac8b-462e-9a36-4e9cb77c8e28 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:45:06.487826 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1b1d9739-ac8b-462e-9a36-4e9cb77c8e28 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:45:06.488884 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1b1d9739-ac8b-462e-9a36-4e9cb77c8e28 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:45:06.489617 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1b1d9739-ac8b-462e-9a36-4e9cb77c8e28 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:45:06.490275 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1b1d9739-ac8b-462e-9a36-4e9cb77c8e28 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:45:06.621912 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-1b1d9739-ac8b-462e-9a36-4e9cb77c8e28 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e838176b44c4f23b470cfc152f79990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3718dd3e536649b5bf1970ff06ddea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:45:06.630309 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-1b1d9739-ac8b-462e-9a36-4e9cb77c8e28 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/a3c87119-d9e1-433a-a43d-7aa600968dd0" status: 200 len: 1365 microversion: 2.1 time: 0.160312 Oct 08 21:45:06.630877 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3197/6467] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:45:06 2022] GET /compute/v2.1/servers/a3c87119-d9e1-433a-a43d-7aa600968dd0 => generated 1365 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:45:07.654975 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-41bfb81f-3c82-495b-a6bf-91a9799675e5 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:45:07.655621 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-41bfb81f-3c82-495b-a6bf-91a9799675e5 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: a3c87119-d9e1-433a-a43d-7aa600968dd0] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:45:07.662516 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-41bfb81f-3c82-495b-a6bf-91a9799675e5 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:45:07.663031 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-41bfb81f-3c82-495b-a6bf-91a9799675e5 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:45:07.663499 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-41bfb81f-3c82-495b-a6bf-91a9799675e5 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:45:07.664221 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-41bfb81f-3c82-495b-a6bf-91a9799675e5 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:45:07.664707 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-41bfb81f-3c82-495b-a6bf-91a9799675e5 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:45:07.665164 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-41bfb81f-3c82-495b-a6bf-91a9799675e5 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:45:07.795088 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-41bfb81f-3c82-495b-a6bf-91a9799675e5 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e838176b44c4f23b470cfc152f79990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3718dd3e536649b5bf1970ff06ddea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:45:07.803054 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-41bfb81f-3c82-495b-a6bf-91a9799675e5 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/a3c87119-d9e1-433a-a43d-7aa600968dd0" status: 200 len: 1552 microversion: 2.1 time: 0.153367 Oct 08 21:45:07.803631 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3271/6468] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:45:07 2022] GET /compute/v2.1/servers/a3c87119-d9e1-433a-a43d-7aa600968dd0 => generated 1552 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:45:07.826984 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-ae07d558-f047-4411-97f3-ff2e6ae3d5ab tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:45:07.827495 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-ae07d558-f047-4411-97f3-ff2e6ae3d5ab tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: a3c87119-d9e1-433a-a43d-7aa600968dd0] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:45:07.834919 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ae07d558-f047-4411-97f3-ff2e6ae3d5ab tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:45:07.835412 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ae07d558-f047-4411-97f3-ff2e6ae3d5ab tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:45:07.835863 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ae07d558-f047-4411-97f3-ff2e6ae3d5ab tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:45:07.836569 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ae07d558-f047-4411-97f3-ff2e6ae3d5ab tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:45:07.837033 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ae07d558-f047-4411-97f3-ff2e6ae3d5ab tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:45:07.837490 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ae07d558-f047-4411-97f3-ff2e6ae3d5ab tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:45:07.918078 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-ae07d558-f047-4411-97f3-ff2e6ae3d5ab tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/a3c87119-d9e1-433a-a43d-7aa600968dd0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095109 Oct 08 21:45:07.918701 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3198/6469] 10.222.0.26 () {58 vars in 1275 bytes} [Sat Oct 8 21:45:07 2022] GET /compute/v2.1/servers/a3c87119-d9e1-433a-a43d-7aa600968dd0/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:45:08.849955 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-43f940ed-5fc5-478c-8244-6de6bf129c61 req-e5f61c58-df53-4191-8a9e-f74b6f1817c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3c87119-d9e1-433a-a43d-7aa600968dd0", "tag": "579db8d5-7575-4d12-ad97-ed15ad970529"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:45:08.854818 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=6 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:45:08.861836 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-43f940ed-5fc5-478c-8244-6de6bf129c61 req-e5f61c58-df53-4191-8a9e-f74b6f1817c2 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:45:08.862382 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-43f940ed-5fc5-478c-8244-6de6bf129c61 req-e5f61c58-df53-4191-8a9e-f74b6f1817c2 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:45:08.862842 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-43f940ed-5fc5-478c-8244-6de6bf129c61 req-e5f61c58-df53-4191-8a9e-f74b6f1817c2 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:45:08.874847 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-43f940ed-5fc5-478c-8244-6de6bf129c61 req-e5f61c58-df53-4191-8a9e-f74b6f1817c2 service nova] Creating event network-changed:579db8d5-7575-4d12-ad97-ed15ad970529 for instance a3c87119-d9e1-433a-a43d-7aa600968dd0 on nch1-master-1 Oct 08 21:45:08.880577 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-43f940ed-5fc5-478c-8244-6de6bf129c61 req-e5f61c58-df53-4191-8a9e-f74b6f1817c2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034280 Oct 08 21:45:08.881216 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3272/6470] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:45:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:45:44.787866 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=2 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:45:44.788673 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=6 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:45:44.790541 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:SELECT=11 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:45:44.791235 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=32 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:45:44.795345 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-d45a6b8c-c72d-48ff-8fc8-079d9dac1d9e tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:45:44.795951 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-d45a6b8c-c72d-48ff-8fc8-079d9dac1d9e tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: a3c87119-d9e1-433a-a43d-7aa600968dd0] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:45:44.804524 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d45a6b8c-c72d-48ff-8fc8-079d9dac1d9e tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:45:44.805011 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d45a6b8c-c72d-48ff-8fc8-079d9dac1d9e tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:45:44.805504 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d45a6b8c-c72d-48ff-8fc8-079d9dac1d9e tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:45:44.806201 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d45a6b8c-c72d-48ff-8fc8-079d9dac1d9e tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:45:44.806659 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d45a6b8c-c72d-48ff-8fc8-079d9dac1d9e tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:45:44.807090 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d45a6b8c-c72d-48ff-8fc8-079d9dac1d9e tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:45:44.944450 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-d45a6b8c-c72d-48ff-8fc8-079d9dac1d9e tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e838176b44c4f23b470cfc152f79990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3718dd3e536649b5bf1970ff06ddea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:45:44.952338 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-d45a6b8c-c72d-48ff-8fc8-079d9dac1d9e tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/a3c87119-d9e1-433a-a43d-7aa600968dd0" status: 200 len: 1670 microversion: 2.1 time: 0.165288 Oct 08 21:45:44.952905 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3199/6471] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:45:44 2022] GET /compute/v2.1/servers/a3c87119-d9e1-433a-a43d-7aa600968dd0 => generated 1670 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:45:44.974167 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=15 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:45:44.974987 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=28 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:45:44.979176 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-17827b7c-c6f0-4b18-8756-e8570edc8b6d tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:45:44.979900 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-17827b7c-c6f0-4b18-8756-e8570edc8b6d tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: a3c87119-d9e1-433a-a43d-7aa600968dd0] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:45:44.986906 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-17827b7c-c6f0-4b18-8756-e8570edc8b6d tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:45:44.987419 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-17827b7c-c6f0-4b18-8756-e8570edc8b6d tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:45:44.987880 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-17827b7c-c6f0-4b18-8756-e8570edc8b6d tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:45:44.988596 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-17827b7c-c6f0-4b18-8756-e8570edc8b6d tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:45:44.989076 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-17827b7c-c6f0-4b18-8756-e8570edc8b6d tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:45:44.989554 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-17827b7c-c6f0-4b18-8756-e8570edc8b6d tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:45:45.118502 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-17827b7c-c6f0-4b18-8756-e8570edc8b6d tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e838176b44c4f23b470cfc152f79990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3718dd3e536649b5bf1970ff06ddea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:45:45.126268 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-17827b7c-c6f0-4b18-8756-e8570edc8b6d tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/a3c87119-d9e1-433a-a43d-7aa600968dd0" status: 200 len: 1670 microversion: 2.1 time: 0.154115 Oct 08 21:45:45.126847 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3273/6472] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:45:44 2022] GET /compute/v2.1/servers/a3c87119-d9e1-433a-a43d-7aa600968dd0 => generated 1670 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:45:45.148299 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-641bb4a0-57a8-4fbc-9393-da9bdae10770 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:45:45.148911 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-641bb4a0-57a8-4fbc-9393-da9bdae10770 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: a3c87119-d9e1-433a-a43d-7aa600968dd0] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:45:45.154982 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-641bb4a0-57a8-4fbc-9393-da9bdae10770 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:45:45.155469 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-641bb4a0-57a8-4fbc-9393-da9bdae10770 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:45:45.155916 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-641bb4a0-57a8-4fbc-9393-da9bdae10770 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:45:45.156614 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-641bb4a0-57a8-4fbc-9393-da9bdae10770 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:45:45.157074 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-641bb4a0-57a8-4fbc-9393-da9bdae10770 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:45:45.157534 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-641bb4a0-57a8-4fbc-9393-da9bdae10770 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:45:45.286460 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-641bb4a0-57a8-4fbc-9393-da9bdae10770 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e838176b44c4f23b470cfc152f79990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3718dd3e536649b5bf1970ff06ddea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:45:45.294258 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-641bb4a0-57a8-4fbc-9393-da9bdae10770 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/a3c87119-d9e1-433a-a43d-7aa600968dd0" status: 200 len: 1670 microversion: 2.1 time: 0.149854 Oct 08 21:45:45.294831 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3200/6473] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:45:45 2022] GET /compute/v2.1/servers/a3c87119-d9e1-433a-a43d-7aa600968dd0 => generated 1670 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:45:45.316783 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-643b2167-ba75-4b16-939d-f8d66f6235e9 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:45:45.319306 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-643b2167-ba75-4b16-939d-f8d66f6235e9 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: a3c87119-d9e1-433a-a43d-7aa600968dd0] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:45:45.325368 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-643b2167-ba75-4b16-939d-f8d66f6235e9 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:45:45.325878 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-643b2167-ba75-4b16-939d-f8d66f6235e9 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:45:45.326374 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-643b2167-ba75-4b16-939d-f8d66f6235e9 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:45:45.327092 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-643b2167-ba75-4b16-939d-f8d66f6235e9 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:45:45.327574 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-643b2167-ba75-4b16-939d-f8d66f6235e9 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:45:45.328026 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-643b2167-ba75-4b16-939d-f8d66f6235e9 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:45:45.356192 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-643b2167-ba75-4b16-939d-f8d66f6235e9 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '5e838176b44c4f23b470cfc152f79990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3718dd3e536649b5bf1970ff06ddea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:45:45.361570 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-643b2167-ba75-4b16-939d-f8d66f6235e9 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: a3c87119-d9e1-433a-a43d-7aa600968dd0] Old instance type m1.heat2, new instance type m1.heat {{(pid=140492) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 08 21:45:45.368081 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-643b2167-ba75-4b16-939d-f8d66f6235e9 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Flavor limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 21:45:45.368529 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-643b2167-ba75-4b16-939d-f8d66f6235e9 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Image limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 21:45:45.369013 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-643b2167-ba75-4b16-939d-f8d66f6235e9 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Flavor pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 21:45:45.369478 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-643b2167-ba75-4b16-939d-f8d66f6235e9 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Image pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 21:45:45.369919 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-643b2167-ba75-4b16-939d-f8d66f6235e9 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 21:45:45.434481 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-643b2167-ba75-4b16-939d-f8d66f6235e9 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "POST /compute/v2.1/servers/a3c87119-d9e1-433a-a43d-7aa600968dd0/action" status: 202 len: 0 microversion: 2.1 time: 0.121774 Oct 08 21:45:45.435099 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3274/6474] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:45:45 2022] POST /compute/v2.1/servers/a3c87119-d9e1-433a-a43d-7aa600968dd0/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 21:45:45.444110 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-0ad759a6-d12a-4431-896b-4643a2ce6aa8 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:45:45.444840 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-0ad759a6-d12a-4431-896b-4643a2ce6aa8 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: a3c87119-d9e1-433a-a43d-7aa600968dd0] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:45:45.451528 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0ad759a6-d12a-4431-896b-4643a2ce6aa8 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:45:45.452025 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0ad759a6-d12a-4431-896b-4643a2ce6aa8 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:45:45.452484 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0ad759a6-d12a-4431-896b-4643a2ce6aa8 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:45:45.453213 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0ad759a6-d12a-4431-896b-4643a2ce6aa8 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:45:45.453695 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0ad759a6-d12a-4431-896b-4643a2ce6aa8 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:45:45.454134 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0ad759a6-d12a-4431-896b-4643a2ce6aa8 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:45:45.592986 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-0ad759a6-d12a-4431-896b-4643a2ce6aa8 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e838176b44c4f23b470cfc152f79990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3718dd3e536649b5bf1970ff06ddea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:45:45.601267 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-0ad759a6-d12a-4431-896b-4643a2ce6aa8 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/a3c87119-d9e1-433a-a43d-7aa600968dd0" status: 200 len: 1679 microversion: 2.1 time: 0.161749 Oct 08 21:45:45.601915 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3201/6475] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:45:45 2022] GET /compute/v2.1/servers/a3c87119-d9e1-433a-a43d-7aa600968dd0 => generated 1679 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:45:46.624170 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-abd81e92-dc41-44f2-8f83-3a2887c24bc8 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:45:46.624927 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-abd81e92-dc41-44f2-8f83-3a2887c24bc8 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: a3c87119-d9e1-433a-a43d-7aa600968dd0] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:45:46.632737 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-abd81e92-dc41-44f2-8f83-3a2887c24bc8 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:45:46.633364 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-abd81e92-dc41-44f2-8f83-3a2887c24bc8 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:45:46.633898 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-abd81e92-dc41-44f2-8f83-3a2887c24bc8 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:45:46.634695 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-abd81e92-dc41-44f2-8f83-3a2887c24bc8 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:45:46.635184 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-abd81e92-dc41-44f2-8f83-3a2887c24bc8 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:45:46.635634 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-abd81e92-dc41-44f2-8f83-3a2887c24bc8 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:45:46.775424 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-abd81e92-dc41-44f2-8f83-3a2887c24bc8 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e838176b44c4f23b470cfc152f79990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3718dd3e536649b5bf1970ff06ddea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:45:46.784063 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-abd81e92-dc41-44f2-8f83-3a2887c24bc8 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/a3c87119-d9e1-433a-a43d-7aa600968dd0" status: 200 len: 1679 microversion: 2.1 time: 0.163846 Oct 08 21:45:46.784644 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3275/6476] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:45:46 2022] GET /compute/v2.1/servers/a3c87119-d9e1-433a-a43d-7aa600968dd0 => generated 1679 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:45:47.806444 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-9f908d1e-66cb-4763-8302-a35c3b18fd84 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:45:47.806975 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-9f908d1e-66cb-4763-8302-a35c3b18fd84 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: a3c87119-d9e1-433a-a43d-7aa600968dd0] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:45:47.813962 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9f908d1e-66cb-4763-8302-a35c3b18fd84 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:45:47.814486 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9f908d1e-66cb-4763-8302-a35c3b18fd84 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:45:47.814939 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9f908d1e-66cb-4763-8302-a35c3b18fd84 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:45:47.815647 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9f908d1e-66cb-4763-8302-a35c3b18fd84 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:45:47.816118 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9f908d1e-66cb-4763-8302-a35c3b18fd84 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:45:47.816557 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9f908d1e-66cb-4763-8302-a35c3b18fd84 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:45:47.945177 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-9f908d1e-66cb-4763-8302-a35c3b18fd84 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e838176b44c4f23b470cfc152f79990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3718dd3e536649b5bf1970ff06ddea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:45:47.952976 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-9f908d1e-66cb-4763-8302-a35c3b18fd84 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/a3c87119-d9e1-433a-a43d-7aa600968dd0" status: 200 len: 1684 microversion: 2.1 time: 0.150620 Oct 08 21:45:47.953582 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3202/6477] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:45:47 2022] GET /compute/v2.1/servers/a3c87119-d9e1-433a-a43d-7aa600968dd0 => generated 1684 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:45:48.976918 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-f130a0da-836c-46d9-93e9-d3d8b1d2bd3e tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:45:48.977576 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-f130a0da-836c-46d9-93e9-d3d8b1d2bd3e tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: a3c87119-d9e1-433a-a43d-7aa600968dd0] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:45:48.984717 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f130a0da-836c-46d9-93e9-d3d8b1d2bd3e tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:45:48.985255 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f130a0da-836c-46d9-93e9-d3d8b1d2bd3e tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:45:48.985828 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f130a0da-836c-46d9-93e9-d3d8b1d2bd3e tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:45:48.987052 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f130a0da-836c-46d9-93e9-d3d8b1d2bd3e tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:45:48.987536 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f130a0da-836c-46d9-93e9-d3d8b1d2bd3e tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:45:48.987990 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f130a0da-836c-46d9-93e9-d3d8b1d2bd3e tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:45:49.120504 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-f130a0da-836c-46d9-93e9-d3d8b1d2bd3e tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e838176b44c4f23b470cfc152f79990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3718dd3e536649b5bf1970ff06ddea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:45:49.128502 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-f130a0da-836c-46d9-93e9-d3d8b1d2bd3e tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/a3c87119-d9e1-433a-a43d-7aa600968dd0" status: 200 len: 1684 microversion: 2.1 time: 0.155489 Oct 08 21:45:49.129077 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3276/6478] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:45:48 2022] GET /compute/v2.1/servers/a3c87119-d9e1-433a-a43d-7aa600968dd0 => generated 1684 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:45:50.152643 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-2be01433-1942-4237-b5b1-bc6ed2ed936d tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:45:50.153181 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-2be01433-1942-4237-b5b1-bc6ed2ed936d tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: a3c87119-d9e1-433a-a43d-7aa600968dd0] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:45:50.160748 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2be01433-1942-4237-b5b1-bc6ed2ed936d tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:45:50.161263 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2be01433-1942-4237-b5b1-bc6ed2ed936d tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:45:50.161712 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2be01433-1942-4237-b5b1-bc6ed2ed936d tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:45:50.162411 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2be01433-1942-4237-b5b1-bc6ed2ed936d tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:45:50.162869 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2be01433-1942-4237-b5b1-bc6ed2ed936d tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:45:50.163299 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2be01433-1942-4237-b5b1-bc6ed2ed936d tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:45:50.291257 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-2be01433-1942-4237-b5b1-bc6ed2ed936d tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e838176b44c4f23b470cfc152f79990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3718dd3e536649b5bf1970ff06ddea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:45:50.299636 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-2be01433-1942-4237-b5b1-bc6ed2ed936d tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/a3c87119-d9e1-433a-a43d-7aa600968dd0" status: 200 len: 1684 microversion: 2.1 time: 0.151665 Oct 08 21:45:50.300212 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3203/6479] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:45:50 2022] GET /compute/v2.1/servers/a3c87119-d9e1-433a-a43d-7aa600968dd0 => generated 1684 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:45:51.323740 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-368b5081-c8f5-41f1-97a1-81ac270df098 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:45:51.324374 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-368b5081-c8f5-41f1-97a1-81ac270df098 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: a3c87119-d9e1-433a-a43d-7aa600968dd0] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:45:51.332567 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-368b5081-c8f5-41f1-97a1-81ac270df098 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:45:51.333080 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-368b5081-c8f5-41f1-97a1-81ac270df098 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:45:51.333566 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-368b5081-c8f5-41f1-97a1-81ac270df098 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:45:51.334292 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-368b5081-c8f5-41f1-97a1-81ac270df098 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:45:51.334776 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-368b5081-c8f5-41f1-97a1-81ac270df098 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:45:51.335228 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-368b5081-c8f5-41f1-97a1-81ac270df098 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:45:51.462402 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-368b5081-c8f5-41f1-97a1-81ac270df098 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e838176b44c4f23b470cfc152f79990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3718dd3e536649b5bf1970ff06ddea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:45:51.470120 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-368b5081-c8f5-41f1-97a1-81ac270df098 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/a3c87119-d9e1-433a-a43d-7aa600968dd0" status: 200 len: 1684 microversion: 2.1 time: 0.150471 Oct 08 21:45:51.470706 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3277/6480] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:45:51 2022] GET /compute/v2.1/servers/a3c87119-d9e1-433a-a43d-7aa600968dd0 => generated 1684 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:45:52.493299 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c56524de-2f48-4e24-8a5b-5235cb6dd15d tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:45:52.493918 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-c56524de-2f48-4e24-8a5b-5235cb6dd15d tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: a3c87119-d9e1-433a-a43d-7aa600968dd0] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:45:52.500964 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c56524de-2f48-4e24-8a5b-5235cb6dd15d tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:45:52.501503 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c56524de-2f48-4e24-8a5b-5235cb6dd15d tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:45:52.501952 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c56524de-2f48-4e24-8a5b-5235cb6dd15d tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:45:52.502802 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c56524de-2f48-4e24-8a5b-5235cb6dd15d tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:45:52.503334 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c56524de-2f48-4e24-8a5b-5235cb6dd15d tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:45:52.503767 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c56524de-2f48-4e24-8a5b-5235cb6dd15d tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:45:52.637796 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-c56524de-2f48-4e24-8a5b-5235cb6dd15d tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e838176b44c4f23b470cfc152f79990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3718dd3e536649b5bf1970ff06ddea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:45:52.646125 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-c56524de-2f48-4e24-8a5b-5235cb6dd15d tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/a3c87119-d9e1-433a-a43d-7aa600968dd0" status: 200 len: 1684 microversion: 2.1 time: 0.156849 Oct 08 21:45:52.646890 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3204/6481] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:45:52 2022] GET /compute/v2.1/servers/a3c87119-d9e1-433a-a43d-7aa600968dd0 => generated 1684 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:45:53.670183 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-f2bc6ff0-0cad-4e28-85a0-7b766d40761f tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:45:53.670818 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-f2bc6ff0-0cad-4e28-85a0-7b766d40761f tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: a3c87119-d9e1-433a-a43d-7aa600968dd0] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:45:53.677913 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f2bc6ff0-0cad-4e28-85a0-7b766d40761f tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:45:53.678427 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f2bc6ff0-0cad-4e28-85a0-7b766d40761f tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:45:53.678895 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f2bc6ff0-0cad-4e28-85a0-7b766d40761f tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:45:53.679623 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f2bc6ff0-0cad-4e28-85a0-7b766d40761f tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:45:53.680109 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f2bc6ff0-0cad-4e28-85a0-7b766d40761f tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:45:53.680565 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f2bc6ff0-0cad-4e28-85a0-7b766d40761f tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:45:53.816476 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-f2bc6ff0-0cad-4e28-85a0-7b766d40761f tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e838176b44c4f23b470cfc152f79990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3718dd3e536649b5bf1970ff06ddea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:45:53.824632 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-f2bc6ff0-0cad-4e28-85a0-7b766d40761f tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/a3c87119-d9e1-433a-a43d-7aa600968dd0" status: 200 len: 1684 microversion: 2.1 time: 0.158409 Oct 08 21:45:53.825238 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3278/6482] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:45:53 2022] GET /compute/v2.1/servers/a3c87119-d9e1-433a-a43d-7aa600968dd0 => generated 1684 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:45:54.848903 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c015da0d-d58c-4604-a03f-ed890c6535c7 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:45:54.849569 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-c015da0d-d58c-4604-a03f-ed890c6535c7 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: a3c87119-d9e1-433a-a43d-7aa600968dd0] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:45:54.856609 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c015da0d-d58c-4604-a03f-ed890c6535c7 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:45:54.857099 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c015da0d-d58c-4604-a03f-ed890c6535c7 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:45:54.857574 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c015da0d-d58c-4604-a03f-ed890c6535c7 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:45:54.858274 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c015da0d-d58c-4604-a03f-ed890c6535c7 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:45:54.858757 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c015da0d-d58c-4604-a03f-ed890c6535c7 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:45:54.859188 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c015da0d-d58c-4604-a03f-ed890c6535c7 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:45:54.991533 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-c015da0d-d58c-4604-a03f-ed890c6535c7 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e838176b44c4f23b470cfc152f79990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3718dd3e536649b5bf1970ff06ddea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:45:54.999351 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-c015da0d-d58c-4604-a03f-ed890c6535c7 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/a3c87119-d9e1-433a-a43d-7aa600968dd0" status: 200 len: 1684 microversion: 2.1 time: 0.155072 Oct 08 21:45:54.999927 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3205/6483] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:45:54 2022] GET /compute/v2.1/servers/a3c87119-d9e1-433a-a43d-7aa600968dd0 => generated 1684 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:45:56.021615 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-573837f4-bf53-464c-9ea2-4e2a6a4a0295 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:45:56.022273 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-573837f4-bf53-464c-9ea2-4e2a6a4a0295 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: a3c87119-d9e1-433a-a43d-7aa600968dd0] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:45:56.029405 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-573837f4-bf53-464c-9ea2-4e2a6a4a0295 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:45:56.029915 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-573837f4-bf53-464c-9ea2-4e2a6a4a0295 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:45:56.030373 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-573837f4-bf53-464c-9ea2-4e2a6a4a0295 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:45:56.031082 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-573837f4-bf53-464c-9ea2-4e2a6a4a0295 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:45:56.031555 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-573837f4-bf53-464c-9ea2-4e2a6a4a0295 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:45:56.032033 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-573837f4-bf53-464c-9ea2-4e2a6a4a0295 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:45:56.167101 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-573837f4-bf53-464c-9ea2-4e2a6a4a0295 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e838176b44c4f23b470cfc152f79990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3718dd3e536649b5bf1970ff06ddea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:45:56.174982 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-573837f4-bf53-464c-9ea2-4e2a6a4a0295 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/a3c87119-d9e1-433a-a43d-7aa600968dd0" status: 200 len: 1684 microversion: 2.1 time: 0.157297 Oct 08 21:45:56.175636 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3279/6484] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:45:56 2022] GET /compute/v2.1/servers/a3c87119-d9e1-433a-a43d-7aa600968dd0 => generated 1684 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:45:57.198417 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-27d4aa19-03e4-4fd2-bcb8-bb338ee1e908 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:45:57.199036 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-27d4aa19-03e4-4fd2-bcb8-bb338ee1e908 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: a3c87119-d9e1-433a-a43d-7aa600968dd0] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:45:57.205404 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-27d4aa19-03e4-4fd2-bcb8-bb338ee1e908 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:45:57.205900 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-27d4aa19-03e4-4fd2-bcb8-bb338ee1e908 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:45:57.206348 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-27d4aa19-03e4-4fd2-bcb8-bb338ee1e908 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:45:57.207046 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-27d4aa19-03e4-4fd2-bcb8-bb338ee1e908 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:45:57.207510 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-27d4aa19-03e4-4fd2-bcb8-bb338ee1e908 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:45:57.207942 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-27d4aa19-03e4-4fd2-bcb8-bb338ee1e908 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:45:57.341703 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-27d4aa19-03e4-4fd2-bcb8-bb338ee1e908 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e838176b44c4f23b470cfc152f79990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3718dd3e536649b5bf1970ff06ddea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:45:57.350028 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-27d4aa19-03e4-4fd2-bcb8-bb338ee1e908 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/a3c87119-d9e1-433a-a43d-7aa600968dd0" status: 200 len: 1684 microversion: 2.1 time: 0.155710 Oct 08 21:45:57.350671 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3206/6485] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:45:57 2022] GET /compute/v2.1/servers/a3c87119-d9e1-433a-a43d-7aa600968dd0 => generated 1684 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:45:58.373675 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-a7b68bfe-d274-41b2-b0c6-5f3a832cf2dd tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:45:58.374316 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-a7b68bfe-d274-41b2-b0c6-5f3a832cf2dd tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: a3c87119-d9e1-433a-a43d-7aa600968dd0] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:45:58.381271 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a7b68bfe-d274-41b2-b0c6-5f3a832cf2dd tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:45:58.381777 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a7b68bfe-d274-41b2-b0c6-5f3a832cf2dd tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:45:58.382238 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a7b68bfe-d274-41b2-b0c6-5f3a832cf2dd tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:45:58.382946 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a7b68bfe-d274-41b2-b0c6-5f3a832cf2dd tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:45:58.383419 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a7b68bfe-d274-41b2-b0c6-5f3a832cf2dd tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:45:58.383862 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a7b68bfe-d274-41b2-b0c6-5f3a832cf2dd tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:45:58.513884 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-a7b68bfe-d274-41b2-b0c6-5f3a832cf2dd tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e838176b44c4f23b470cfc152f79990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3718dd3e536649b5bf1970ff06ddea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:45:58.521738 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-a7b68bfe-d274-41b2-b0c6-5f3a832cf2dd tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/a3c87119-d9e1-433a-a43d-7aa600968dd0" status: 200 len: 1684 microversion: 2.1 time: 0.151991 Oct 08 21:45:58.522322 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3280/6486] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:45:58 2022] GET /compute/v2.1/servers/a3c87119-d9e1-433a-a43d-7aa600968dd0 => generated 1684 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:45:59.544134 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-89418c9f-62b6-4237-8c86-c0f4a0064f99 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:45:59.544753 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-89418c9f-62b6-4237-8c86-c0f4a0064f99 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: a3c87119-d9e1-433a-a43d-7aa600968dd0] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:45:59.551829 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-89418c9f-62b6-4237-8c86-c0f4a0064f99 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:45:59.552327 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-89418c9f-62b6-4237-8c86-c0f4a0064f99 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:45:59.552776 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-89418c9f-62b6-4237-8c86-c0f4a0064f99 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:45:59.553507 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-89418c9f-62b6-4237-8c86-c0f4a0064f99 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:45:59.553998 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-89418c9f-62b6-4237-8c86-c0f4a0064f99 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:45:59.554435 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-89418c9f-62b6-4237-8c86-c0f4a0064f99 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:45:59.682813 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-89418c9f-62b6-4237-8c86-c0f4a0064f99 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e838176b44c4f23b470cfc152f79990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3718dd3e536649b5bf1970ff06ddea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:45:59.691149 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-89418c9f-62b6-4237-8c86-c0f4a0064f99 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/a3c87119-d9e1-433a-a43d-7aa600968dd0" status: 200 len: 1684 microversion: 2.1 time: 0.151093 Oct 08 21:45:59.691725 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3207/6487] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:45:59 2022] GET /compute/v2.1/servers/a3c87119-d9e1-433a-a43d-7aa600968dd0 => generated 1684 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:46:00.714939 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-8c0a4a2b-a6a9-4618-a6e6-7945424a9472 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:46:00.715588 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-8c0a4a2b-a6a9-4618-a6e6-7945424a9472 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: a3c87119-d9e1-433a-a43d-7aa600968dd0] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:46:00.723298 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8c0a4a2b-a6a9-4618-a6e6-7945424a9472 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:46:00.723814 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8c0a4a2b-a6a9-4618-a6e6-7945424a9472 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:46:00.724287 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8c0a4a2b-a6a9-4618-a6e6-7945424a9472 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:46:00.725018 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8c0a4a2b-a6a9-4618-a6e6-7945424a9472 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:46:00.725531 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8c0a4a2b-a6a9-4618-a6e6-7945424a9472 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:46:00.725994 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8c0a4a2b-a6a9-4618-a6e6-7945424a9472 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:46:00.861220 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-8c0a4a2b-a6a9-4618-a6e6-7945424a9472 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e838176b44c4f23b470cfc152f79990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3718dd3e536649b5bf1970ff06ddea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:46:00.869069 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-8c0a4a2b-a6a9-4618-a6e6-7945424a9472 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/a3c87119-d9e1-433a-a43d-7aa600968dd0" status: 200 len: 1684 microversion: 2.1 time: 0.158078 Oct 08 21:46:00.869679 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3281/6488] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:46:00 2022] GET /compute/v2.1/servers/a3c87119-d9e1-433a-a43d-7aa600968dd0 => generated 1684 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:46:01.891869 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-112cd159-2b07-4ea6-af44-b9f62baf518c tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:46:01.892428 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-112cd159-2b07-4ea6-af44-b9f62baf518c tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: a3c87119-d9e1-433a-a43d-7aa600968dd0] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:46:01.899409 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-112cd159-2b07-4ea6-af44-b9f62baf518c tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:46:01.899919 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-112cd159-2b07-4ea6-af44-b9f62baf518c tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:46:01.900366 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-112cd159-2b07-4ea6-af44-b9f62baf518c tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:46:01.901154 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-112cd159-2b07-4ea6-af44-b9f62baf518c tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:46:01.901660 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-112cd159-2b07-4ea6-af44-b9f62baf518c tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:46:01.902101 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-112cd159-2b07-4ea6-af44-b9f62baf518c tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:46:02.028900 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-112cd159-2b07-4ea6-af44-b9f62baf518c tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e838176b44c4f23b470cfc152f79990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3718dd3e536649b5bf1970ff06ddea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:46:02.037270 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-112cd159-2b07-4ea6-af44-b9f62baf518c tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/a3c87119-d9e1-433a-a43d-7aa600968dd0" status: 200 len: 1684 microversion: 2.1 time: 0.149411 Oct 08 21:46:02.037852 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3208/6489] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:46:01 2022] GET /compute/v2.1/servers/a3c87119-d9e1-433a-a43d-7aa600968dd0 => generated 1684 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:46:03.061351 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-8fe531ea-3320-4aae-8184-67149fe411ea tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:46:03.061994 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-8fe531ea-3320-4aae-8184-67149fe411ea tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: a3c87119-d9e1-433a-a43d-7aa600968dd0] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:46:03.069917 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8fe531ea-3320-4aae-8184-67149fe411ea tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:46:03.070651 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8fe531ea-3320-4aae-8184-67149fe411ea tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:46:03.071389 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8fe531ea-3320-4aae-8184-67149fe411ea tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:46:03.072149 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8fe531ea-3320-4aae-8184-67149fe411ea tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:46:03.072641 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8fe531ea-3320-4aae-8184-67149fe411ea tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:46:03.073099 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8fe531ea-3320-4aae-8184-67149fe411ea tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:46:03.201091 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-8fe531ea-3320-4aae-8184-67149fe411ea tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e838176b44c4f23b470cfc152f79990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3718dd3e536649b5bf1970ff06ddea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:46:03.208919 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-8fe531ea-3320-4aae-8184-67149fe411ea tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/a3c87119-d9e1-433a-a43d-7aa600968dd0" status: 200 len: 1684 microversion: 2.1 time: 0.151674 Oct 08 21:46:03.209532 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3282/6490] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:46:03 2022] GET /compute/v2.1/servers/a3c87119-d9e1-433a-a43d-7aa600968dd0 => generated 1684 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:46:04.231607 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-e6202d46-04ce-492d-aa04-b277ae5b8149 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:46:04.232413 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-e6202d46-04ce-492d-aa04-b277ae5b8149 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: a3c87119-d9e1-433a-a43d-7aa600968dd0] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:46:04.240112 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e6202d46-04ce-492d-aa04-b277ae5b8149 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:46:04.240615 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e6202d46-04ce-492d-aa04-b277ae5b8149 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:46:04.241071 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e6202d46-04ce-492d-aa04-b277ae5b8149 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:46:04.241830 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e6202d46-04ce-492d-aa04-b277ae5b8149 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:46:04.242459 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e6202d46-04ce-492d-aa04-b277ae5b8149 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:46:04.242900 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e6202d46-04ce-492d-aa04-b277ae5b8149 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:46:04.524985 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-e6202d46-04ce-492d-aa04-b277ae5b8149 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e838176b44c4f23b470cfc152f79990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3718dd3e536649b5bf1970ff06ddea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:46:04.534489 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-e6202d46-04ce-492d-aa04-b277ae5b8149 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/a3c87119-d9e1-433a-a43d-7aa600968dd0" status: 200 len: 1684 microversion: 2.1 time: 0.306883 Oct 08 21:46:04.535359 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3209/6491] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:46:04 2022] GET /compute/v2.1/servers/a3c87119-d9e1-433a-a43d-7aa600968dd0 => generated 1684 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:46:05.055465 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-e2869790-b856-4164-8ba3-48bc11e394c1 req-c522aa83-377a-49f0-a7b2-809d3c019a50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3c87119-d9e1-433a-a43d-7aa600968dd0", "name": "network-vif-unplugged", "status": "completed", "tag": "579db8d5-7575-4d12-ad97-ed15ad970529"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:46:05.066533 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-e2869790-b856-4164-8ba3-48bc11e394c1 req-c522aa83-377a-49f0-a7b2-809d3c019a50 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:46:05.067037 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-e2869790-b856-4164-8ba3-48bc11e394c1 req-c522aa83-377a-49f0-a7b2-809d3c019a50 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:46:05.067754 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-e2869790-b856-4164-8ba3-48bc11e394c1 req-c522aa83-377a-49f0-a7b2-809d3c019a50 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:46:05.079745 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-e2869790-b856-4164-8ba3-48bc11e394c1 req-c522aa83-377a-49f0-a7b2-809d3c019a50 service nova] Creating event network-vif-unplugged:579db8d5-7575-4d12-ad97-ed15ad970529 for instance a3c87119-d9e1-433a-a43d-7aa600968dd0 on nch2-master-1 Oct 08 21:46:05.086915 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [req-e2869790-b856-4164-8ba3-48bc11e394c1 req-c522aa83-377a-49f0-a7b2-809d3c019a50 service nova] Instance a3c87119-d9e1-433a-a43d-7aa600968dd0 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140492) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 08 21:46:05.097967 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-e2869790-b856-4164-8ba3-48bc11e394c1 req-c522aa83-377a-49f0-a7b2-809d3c019a50 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046266 Oct 08 21:46:05.098751 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3283/6492] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:46:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:46:05.563188 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-4e65620f-4921-4a98-b5a1-af3cfee6c5ae tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:46:05.563910 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-4e65620f-4921-4a98-b5a1-af3cfee6c5ae tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: a3c87119-d9e1-433a-a43d-7aa600968dd0] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:46:05.571555 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4e65620f-4921-4a98-b5a1-af3cfee6c5ae tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:46:05.572284 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4e65620f-4921-4a98-b5a1-af3cfee6c5ae tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:46:05.573144 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4e65620f-4921-4a98-b5a1-af3cfee6c5ae tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:46:05.573460 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4e65620f-4921-4a98-b5a1-af3cfee6c5ae tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:46:05.573928 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4e65620f-4921-4a98-b5a1-af3cfee6c5ae tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:46:05.574356 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4e65620f-4921-4a98-b5a1-af3cfee6c5ae tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:46:05.709126 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-4e65620f-4921-4a98-b5a1-af3cfee6c5ae tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e838176b44c4f23b470cfc152f79990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3718dd3e536649b5bf1970ff06ddea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:46:05.719495 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-4e65620f-4921-4a98-b5a1-af3cfee6c5ae tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/a3c87119-d9e1-433a-a43d-7aa600968dd0" status: 200 len: 1683 microversion: 2.1 time: 0.160393 Oct 08 21:46:05.720096 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3210/6493] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:46:05 2022] GET /compute/v2.1/servers/a3c87119-d9e1-433a-a43d-7aa600968dd0 => generated 1683 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:46:06.745646 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-1fe366f1-3ca3-4b42-96c0-bd215216fe86 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:46:06.746372 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-1fe366f1-3ca3-4b42-96c0-bd215216fe86 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: a3c87119-d9e1-433a-a43d-7aa600968dd0] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:46:06.753406 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1fe366f1-3ca3-4b42-96c0-bd215216fe86 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:46:06.753923 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1fe366f1-3ca3-4b42-96c0-bd215216fe86 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:46:06.754384 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1fe366f1-3ca3-4b42-96c0-bd215216fe86 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:46:06.755106 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1fe366f1-3ca3-4b42-96c0-bd215216fe86 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:46:06.755588 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1fe366f1-3ca3-4b42-96c0-bd215216fe86 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:46:06.756038 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1fe366f1-3ca3-4b42-96c0-bd215216fe86 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:46:06.889495 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-1fe366f1-3ca3-4b42-96c0-bd215216fe86 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e838176b44c4f23b470cfc152f79990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3718dd3e536649b5bf1970ff06ddea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:46:06.897392 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-1fe366f1-3ca3-4b42-96c0-bd215216fe86 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/a3c87119-d9e1-433a-a43d-7aa600968dd0" status: 200 len: 1681 microversion: 2.1 time: 0.157153 Oct 08 21:46:06.897977 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3284/6494] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:46:06 2022] GET /compute/v2.1/servers/a3c87119-d9e1-433a-a43d-7aa600968dd0 => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:46:07.112959 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-c8db7b85-4a64-496a-93ee-83c4a9c5b9b4 req-c0c35b8a-8b16-4858-a740-76f5553ce907 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3c87119-d9e1-433a-a43d-7aa600968dd0", "tag": "579db8d5-7575-4d12-ad97-ed15ad970529"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:46:07.123308 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-c8db7b85-4a64-496a-93ee-83c4a9c5b9b4 req-c0c35b8a-8b16-4858-a740-76f5553ce907 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:46:07.123788 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-c8db7b85-4a64-496a-93ee-83c4a9c5b9b4 req-c0c35b8a-8b16-4858-a740-76f5553ce907 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:46:07.124223 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-c8db7b85-4a64-496a-93ee-83c4a9c5b9b4 req-c0c35b8a-8b16-4858-a740-76f5553ce907 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:46:07.135715 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-c8db7b85-4a64-496a-93ee-83c4a9c5b9b4 req-c0c35b8a-8b16-4858-a740-76f5553ce907 service nova] Creating event network-changed:579db8d5-7575-4d12-ad97-ed15ad970529 for instance a3c87119-d9e1-433a-a43d-7aa600968dd0 on nch2-master-1 Oct 08 21:46:07.140979 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [req-c8db7b85-4a64-496a-93ee-83c4a9c5b9b4 req-c0c35b8a-8b16-4858-a740-76f5553ce907 service nova] Instance a3c87119-d9e1-433a-a43d-7aa600968dd0 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140491) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 08 21:46:07.151693 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-c8db7b85-4a64-496a-93ee-83c4a9c5b9b4 req-c0c35b8a-8b16-4858-a740-76f5553ce907 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043013 Oct 08 21:46:07.152261 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3211/6495] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:46:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:46:07.920579 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-99850e80-0dd8-4775-b664-b7936088df63 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:46:07.921241 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-99850e80-0dd8-4775-b664-b7936088df63 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: a3c87119-d9e1-433a-a43d-7aa600968dd0] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:46:07.928142 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-99850e80-0dd8-4775-b664-b7936088df63 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:46:07.928647 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-99850e80-0dd8-4775-b664-b7936088df63 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:46:07.929102 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-99850e80-0dd8-4775-b664-b7936088df63 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:46:07.929847 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-99850e80-0dd8-4775-b664-b7936088df63 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:46:07.930325 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-99850e80-0dd8-4775-b664-b7936088df63 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:46:07.930770 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-99850e80-0dd8-4775-b664-b7936088df63 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:46:08.057895 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-99850e80-0dd8-4775-b664-b7936088df63 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e838176b44c4f23b470cfc152f79990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3718dd3e536649b5bf1970ff06ddea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:46:08.065642 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-99850e80-0dd8-4775-b664-b7936088df63 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/a3c87119-d9e1-433a-a43d-7aa600968dd0" status: 200 len: 1678 microversion: 2.1 time: 0.149145 Oct 08 21:46:08.066708 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3285/6496] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:46:07 2022] GET /compute/v2.1/servers/a3c87119-d9e1-433a-a43d-7aa600968dd0 => generated 1678 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:46:08.090012 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c0369adb-2b5f-43ab-a568-c253d13463e4 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:46:08.090663 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-c0369adb-2b5f-43ab-a568-c253d13463e4 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: a3c87119-d9e1-433a-a43d-7aa600968dd0] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:46:08.096857 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c0369adb-2b5f-43ab-a568-c253d13463e4 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:46:08.097450 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c0369adb-2b5f-43ab-a568-c253d13463e4 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:46:08.097895 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c0369adb-2b5f-43ab-a568-c253d13463e4 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:46:08.098681 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c0369adb-2b5f-43ab-a568-c253d13463e4 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:46:08.099149 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c0369adb-2b5f-43ab-a568-c253d13463e4 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:46:08.099583 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c0369adb-2b5f-43ab-a568-c253d13463e4 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:46:08.157563 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-c0369adb-2b5f-43ab-a568-c253d13463e4 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "POST /compute/v2.1/servers/a3c87119-d9e1-433a-a43d-7aa600968dd0/action" status: 204 len: 0 microversion: 2.1 time: 0.071734 Oct 08 21:46:08.158194 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3212/6497] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:46:08 2022] POST /compute/v2.1/servers/a3c87119-d9e1-433a-a43d-7aa600968dd0/action => generated 0 bytes in 73 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 21:46:08.166449 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-adbc2467-3d61-4bde-b9a4-9ff5a1589ae2 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:46:08.167040 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-adbc2467-3d61-4bde-b9a4-9ff5a1589ae2 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: a3c87119-d9e1-433a-a43d-7aa600968dd0] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:46:08.173125 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-adbc2467-3d61-4bde-b9a4-9ff5a1589ae2 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:46:08.173667 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-adbc2467-3d61-4bde-b9a4-9ff5a1589ae2 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:46:08.174132 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-adbc2467-3d61-4bde-b9a4-9ff5a1589ae2 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:46:08.175053 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-adbc2467-3d61-4bde-b9a4-9ff5a1589ae2 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:46:08.176115 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-adbc2467-3d61-4bde-b9a4-9ff5a1589ae2 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:46:08.176573 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-adbc2467-3d61-4bde-b9a4-9ff5a1589ae2 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:46:08.311983 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-adbc2467-3d61-4bde-b9a4-9ff5a1589ae2 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e838176b44c4f23b470cfc152f79990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3718dd3e536649b5bf1970ff06ddea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:46:08.320826 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-adbc2467-3d61-4bde-b9a4-9ff5a1589ae2 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/a3c87119-d9e1-433a-a43d-7aa600968dd0" status: 200 len: 1678 microversion: 2.1 time: 0.158260 Oct 08 21:46:08.321446 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3286/6498] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:46:08 2022] GET /compute/v2.1/servers/a3c87119-d9e1-433a-a43d-7aa600968dd0 => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:46:09.344692 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-75081bc2-4873-423f-9b85-112cb5bde9d7 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:46:09.345435 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-75081bc2-4873-423f-9b85-112cb5bde9d7 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: a3c87119-d9e1-433a-a43d-7aa600968dd0] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:46:09.353053 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-75081bc2-4873-423f-9b85-112cb5bde9d7 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:46:09.353580 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-75081bc2-4873-423f-9b85-112cb5bde9d7 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:46:09.354025 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-75081bc2-4873-423f-9b85-112cb5bde9d7 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:46:09.354721 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-75081bc2-4873-423f-9b85-112cb5bde9d7 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:46:09.355180 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-75081bc2-4873-423f-9b85-112cb5bde9d7 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:46:09.355609 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-75081bc2-4873-423f-9b85-112cb5bde9d7 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:46:09.501337 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-75081bc2-4873-423f-9b85-112cb5bde9d7 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e838176b44c4f23b470cfc152f79990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3718dd3e536649b5bf1970ff06ddea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:46:09.509430 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-75081bc2-4873-423f-9b85-112cb5bde9d7 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/a3c87119-d9e1-433a-a43d-7aa600968dd0" status: 200 len: 1678 microversion: 2.1 time: 0.169065 Oct 08 21:46:09.510017 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3213/6499] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:46:09 2022] GET /compute/v2.1/servers/a3c87119-d9e1-433a-a43d-7aa600968dd0 => generated 1678 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:46:10.531929 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-be6787ad-1724-4e8d-b8a2-a7d7ac9475cd tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:46:10.532570 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-be6787ad-1724-4e8d-b8a2-a7d7ac9475cd tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: a3c87119-d9e1-433a-a43d-7aa600968dd0] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:46:10.541074 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-be6787ad-1724-4e8d-b8a2-a7d7ac9475cd tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:46:10.541622 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-be6787ad-1724-4e8d-b8a2-a7d7ac9475cd tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:46:10.542088 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-be6787ad-1724-4e8d-b8a2-a7d7ac9475cd tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:46:10.542812 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-be6787ad-1724-4e8d-b8a2-a7d7ac9475cd tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:46:10.543292 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-be6787ad-1724-4e8d-b8a2-a7d7ac9475cd tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:46:10.543743 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-be6787ad-1724-4e8d-b8a2-a7d7ac9475cd tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:46:10.674159 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-be6787ad-1724-4e8d-b8a2-a7d7ac9475cd tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e838176b44c4f23b470cfc152f79990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3718dd3e536649b5bf1970ff06ddea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:46:10.682558 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-be6787ad-1724-4e8d-b8a2-a7d7ac9475cd tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/a3c87119-d9e1-433a-a43d-7aa600968dd0" status: 200 len: 1670 microversion: 2.1 time: 0.154552 Oct 08 21:46:10.683136 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3287/6500] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:46:10 2022] GET /compute/v2.1/servers/a3c87119-d9e1-433a-a43d-7aa600968dd0 => generated 1670 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:46:10.705300 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-81d83c55-07ec-46bd-b9f8-ad616da29cfe tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:46:10.705916 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-81d83c55-07ec-46bd-b9f8-ad616da29cfe tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: a3c87119-d9e1-433a-a43d-7aa600968dd0] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:46:10.712820 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-81d83c55-07ec-46bd-b9f8-ad616da29cfe tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:46:10.713347 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-81d83c55-07ec-46bd-b9f8-ad616da29cfe tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:46:10.713791 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-81d83c55-07ec-46bd-b9f8-ad616da29cfe tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:46:10.714493 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-81d83c55-07ec-46bd-b9f8-ad616da29cfe tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:46:10.714963 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-81d83c55-07ec-46bd-b9f8-ad616da29cfe tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:46:10.715394 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-81d83c55-07ec-46bd-b9f8-ad616da29cfe tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:46:10.850207 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-81d83c55-07ec-46bd-b9f8-ad616da29cfe tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e838176b44c4f23b470cfc152f79990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3718dd3e536649b5bf1970ff06ddea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:46:10.852598 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:46:10.859588 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-81d83c55-07ec-46bd-b9f8-ad616da29cfe tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/a3c87119-d9e1-433a-a43d-7aa600968dd0" status: 200 len: 1670 microversion: 2.1 time: 0.158144 Oct 08 21:46:10.860169 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3214/6501] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:46:10 2022] GET /compute/v2.1/servers/a3c87119-d9e1-433a-a43d-7aa600968dd0 => generated 1670 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:46:10.882305 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-735056e1-8e5d-46a3-8ae9-5cd033f1f15c tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:46:10.883087 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-735056e1-8e5d-46a3-8ae9-5cd033f1f15c tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: a3c87119-d9e1-433a-a43d-7aa600968dd0] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:46:10.889373 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-735056e1-8e5d-46a3-8ae9-5cd033f1f15c tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:46:10.890022 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-735056e1-8e5d-46a3-8ae9-5cd033f1f15c tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:46:10.890569 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-735056e1-8e5d-46a3-8ae9-5cd033f1f15c tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:46:10.891361 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-735056e1-8e5d-46a3-8ae9-5cd033f1f15c tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:46:10.891972 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-735056e1-8e5d-46a3-8ae9-5cd033f1f15c tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:46:10.892660 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-735056e1-8e5d-46a3-8ae9-5cd033f1f15c tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:46:10.898555 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-2e347484-8119-4047-b8d1-2061a8a719e1 req-278ad938-b691-4cb2-bce7-9964db8f5712 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3c87119-d9e1-433a-a43d-7aa600968dd0", "name": "network-vif-plugged", "status": "completed", "tag": "579db8d5-7575-4d12-ad97-ed15ad970529"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:46:10.911849 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-2e347484-8119-4047-b8d1-2061a8a719e1 req-278ad938-b691-4cb2-bce7-9964db8f5712 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:46:10.912345 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-2e347484-8119-4047-b8d1-2061a8a719e1 req-278ad938-b691-4cb2-bce7-9964db8f5712 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:46:10.912790 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-2e347484-8119-4047-b8d1-2061a8a719e1 req-278ad938-b691-4cb2-bce7-9964db8f5712 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:46:10.916221 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:46:10.926499 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-2e347484-8119-4047-b8d1-2061a8a719e1 req-278ad938-b691-4cb2-bce7-9964db8f5712 service nova] Creating event network-vif-plugged:579db8d5-7575-4d12-ad97-ed15ad970529 for instance a3c87119-d9e1-433a-a43d-7aa600968dd0 on nch2-master-1 Oct 08 21:46:10.931575 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-2e347484-8119-4047-b8d1-2061a8a719e1 req-278ad938-b691-4cb2-bce7-9964db8f5712 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038156 Oct 08 21:46:10.932534 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3215/6502] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:46:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 08 21:46:11.031874 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-735056e1-8e5d-46a3-8ae9-5cd033f1f15c tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e838176b44c4f23b470cfc152f79990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3718dd3e536649b5bf1970ff06ddea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:46:11.040163 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-735056e1-8e5d-46a3-8ae9-5cd033f1f15c tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/a3c87119-d9e1-433a-a43d-7aa600968dd0" status: 200 len: 1670 microversion: 2.1 time: 0.161776 Oct 08 21:46:11.040735 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3288/6503] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:46:10 2022] GET /compute/v2.1/servers/a3c87119-d9e1-433a-a43d-7aa600968dd0 => generated 1670 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:46:11.063120 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-ab077292-45d6-4b6e-bfbe-f4579b4786d8 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:46:11.063703 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-ab077292-45d6-4b6e-bfbe-f4579b4786d8 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: a3c87119-d9e1-433a-a43d-7aa600968dd0] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:46:11.070253 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ab077292-45d6-4b6e-bfbe-f4579b4786d8 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:46:11.070741 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ab077292-45d6-4b6e-bfbe-f4579b4786d8 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:46:11.071183 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ab077292-45d6-4b6e-bfbe-f4579b4786d8 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:46:11.071894 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ab077292-45d6-4b6e-bfbe-f4579b4786d8 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:46:11.072334 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ab077292-45d6-4b6e-bfbe-f4579b4786d8 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:46:11.072768 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ab077292-45d6-4b6e-bfbe-f4579b4786d8 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:46:11.098789 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-ab077292-45d6-4b6e-bfbe-f4579b4786d8 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: a3c87119-d9e1-433a-a43d-7aa600968dd0] Going to try to terminate instance {{(pid=140491) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 21:46:11.175889 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-ab077292-45d6-4b6e-bfbe-f4579b4786d8 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "DELETE /compute/v2.1/servers/a3c87119-d9e1-433a-a43d-7aa600968dd0" status: 204 len: 0 microversion: 2.1 time: 0.116298 Oct 08 21:46:11.176935 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3216/6504] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:46:11 2022] DELETE /compute/v2.1/servers/a3c87119-d9e1-433a-a43d-7aa600968dd0 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 21:46:11.185343 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-c80b9067-4ca4-4e33-85bf-339d81794bfa tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:46:11.185974 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-c80b9067-4ca4-4e33-85bf-339d81794bfa tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: a3c87119-d9e1-433a-a43d-7aa600968dd0] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:46:11.192000 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c80b9067-4ca4-4e33-85bf-339d81794bfa tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:46:11.192757 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c80b9067-4ca4-4e33-85bf-339d81794bfa tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:46:11.193237 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c80b9067-4ca4-4e33-85bf-339d81794bfa tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:46:11.194150 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c80b9067-4ca4-4e33-85bf-339d81794bfa tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:46:11.194625 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c80b9067-4ca4-4e33-85bf-339d81794bfa tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:46:11.195068 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c80b9067-4ca4-4e33-85bf-339d81794bfa tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:46:11.325916 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-c80b9067-4ca4-4e33-85bf-339d81794bfa tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e838176b44c4f23b470cfc152f79990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3718dd3e536649b5bf1970ff06ddea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:46:11.334317 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-c80b9067-4ca4-4e33-85bf-339d81794bfa tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/a3c87119-d9e1-433a-a43d-7aa600968dd0" status: 200 len: 1676 microversion: 2.1 time: 0.152961 Oct 08 21:46:11.335081 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3289/6505] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:46:11 2022] GET /compute/v2.1/servers/a3c87119-d9e1-433a-a43d-7aa600968dd0 => generated 1676 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:46:12.358831 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-dee1ac3d-d5e7-4bdb-ad32-279001202bb1 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:46:12.359536 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-dee1ac3d-d5e7-4bdb-ad32-279001202bb1 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: a3c87119-d9e1-433a-a43d-7aa600968dd0] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:46:12.367232 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dee1ac3d-d5e7-4bdb-ad32-279001202bb1 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:46:12.367723 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dee1ac3d-d5e7-4bdb-ad32-279001202bb1 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:46:12.368166 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dee1ac3d-d5e7-4bdb-ad32-279001202bb1 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:46:12.368865 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dee1ac3d-d5e7-4bdb-ad32-279001202bb1 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:46:12.369351 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dee1ac3d-d5e7-4bdb-ad32-279001202bb1 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:46:12.369781 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dee1ac3d-d5e7-4bdb-ad32-279001202bb1 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:46:12.501960 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-dee1ac3d-d5e7-4bdb-ad32-279001202bb1 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e838176b44c4f23b470cfc152f79990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3718dd3e536649b5bf1970ff06ddea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:46:12.509991 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-dee1ac3d-d5e7-4bdb-ad32-279001202bb1 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/a3c87119-d9e1-433a-a43d-7aa600968dd0" status: 200 len: 1676 microversion: 2.1 time: 0.155446 Oct 08 21:46:12.510570 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3217/6506] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:46:12 2022] GET /compute/v2.1/servers/a3c87119-d9e1-433a-a43d-7aa600968dd0 => generated 1676 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:46:13.534499 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e8e2c61d-4cf7-46da-bfc3-4443615e4de4 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:46:13.535835 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-e8e2c61d-4cf7-46da-bfc3-4443615e4de4 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: a3c87119-d9e1-433a-a43d-7aa600968dd0] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:46:13.542905 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e8e2c61d-4cf7-46da-bfc3-4443615e4de4 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:46:13.543748 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e8e2c61d-4cf7-46da-bfc3-4443615e4de4 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:46:13.544302 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e8e2c61d-4cf7-46da-bfc3-4443615e4de4 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:46:13.545273 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e8e2c61d-4cf7-46da-bfc3-4443615e4de4 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:46:13.545852 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e8e2c61d-4cf7-46da-bfc3-4443615e4de4 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:46:13.546396 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e8e2c61d-4cf7-46da-bfc3-4443615e4de4 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:46:13.641579 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-e8e2c61d-4cf7-46da-bfc3-4443615e4de4 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e838176b44c4f23b470cfc152f79990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3718dd3e536649b5bf1970ff06ddea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:46:13.649711 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-e8e2c61d-4cf7-46da-bfc3-4443615e4de4 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/a3c87119-d9e1-433a-a43d-7aa600968dd0" status: 200 len: 1608 microversion: 2.1 time: 0.119614 Oct 08 21:46:13.650300 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3290/6507] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:46:13 2022] GET /compute/v2.1/servers/a3c87119-d9e1-433a-a43d-7aa600968dd0 => generated 1608 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:46:13.719301 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-ebc93b87-99e8-4c60-a92c-48f45fc31faa req-82938ac7-6b35-4ebb-a8dd-0e3da9f77165 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3c87119-d9e1-433a-a43d-7aa600968dd0", "name": "network-vif-deleted", "tag": "579db8d5-7575-4d12-ad97-ed15ad970529"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:46:13.730489 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-ebc93b87-99e8-4c60-a92c-48f45fc31faa req-82938ac7-6b35-4ebb-a8dd-0e3da9f77165 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:46:13.730489 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-ebc93b87-99e8-4c60-a92c-48f45fc31faa req-82938ac7-6b35-4ebb-a8dd-0e3da9f77165 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:46:13.730813 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-ebc93b87-99e8-4c60-a92c-48f45fc31faa req-82938ac7-6b35-4ebb-a8dd-0e3da9f77165 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:46:13.743905 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-ebc93b87-99e8-4c60-a92c-48f45fc31faa req-82938ac7-6b35-4ebb-a8dd-0e3da9f77165 service nova] Creating event network-vif-deleted:579db8d5-7575-4d12-ad97-ed15ad970529 for instance a3c87119-d9e1-433a-a43d-7aa600968dd0 on nch2-master-1 Oct 08 21:46:13.749074 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-ebc93b87-99e8-4c60-a92c-48f45fc31faa req-82938ac7-6b35-4ebb-a8dd-0e3da9f77165 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033769 Oct 08 21:46:13.752910 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3218/6508] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:46:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:46:14.673587 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-11467fe4-2633-4719-bd35-b853e1d3796f tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:46:14.674269 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-11467fe4-2633-4719-bd35-b853e1d3796f tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: a3c87119-d9e1-433a-a43d-7aa600968dd0] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:46:14.681488 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-11467fe4-2633-4719-bd35-b853e1d3796f tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:46:14.681985 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-11467fe4-2633-4719-bd35-b853e1d3796f tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:46:14.682444 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-11467fe4-2633-4719-bd35-b853e1d3796f tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:46:14.683162 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-11467fe4-2633-4719-bd35-b853e1d3796f tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:46:14.683668 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-11467fe4-2633-4719-bd35-b853e1d3796f tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:46:14.684119 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-11467fe4-2633-4719-bd35-b853e1d3796f tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:46:14.699178 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-11467fe4-2633-4719-bd35-b853e1d3796f tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] HTTP exception thrown: Instance a3c87119-d9e1-433a-a43d-7aa600968dd0 could not be found. Oct 08 21:46:14.700860 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-11467fe4-2633-4719-bd35-b853e1d3796f tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Request method failure captured: Oct 08 21:46:14.700860 ncdv-master-1 devstack@n-api.service[140492]: request: GET /compute/v2.1/servers/a3c87119-d9e1-433a-a43d-7aa600968dd0 HTTP/1.1 Oct 08 21:46:14.700860 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:46:14.700860 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:46:14.700860 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:46:14.700860 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 21:46:14.700860 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:46:14.700860 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:46:14.700860 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:46:14.700860 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:46:14.700860 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQe9X_YMmNKk_IiLIrhiybTebPLsigD2oA9w_czixVt5baNHq-v99rHVO91kLbytmMA9O9LoejjDppyvtcuO0H46ugJTY6ixLOqtY6uw1GAjA-8XlGpO40NZ8LLPXXTy7eheVZj7WNy7D46LDg2xb5lZmDKadBVs_1JcZ4-Tt9c91XNk Oct 08 21:46:14.700860 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:46:14.700860 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:46:14.700860 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:46:14.700860 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:46:14.700860 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:46:14.700860 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:46:14.700860 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 3718dd3e536649b5bf1970ff06ddea69 Oct 08 21:46:14.700860 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-ServerActionsTestJSON-775805645 Oct 08 21:46:14.700860 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:46:14.700860 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:46:14.700860 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3718dd3e536649b5bf1970ff06ddea69"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3718dd3e536649b5bf1970ff06ddea69"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3718dd3e536649b5bf1970ff06ddea69"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3718dd3e536649b5bf1970ff06ddea69"}]}] Oct 08 21:46:14.700860 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-ServerActionsTestJSON-775805645 Oct 08 21:46:14.700860 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 3718dd3e536649b5bf1970ff06ddea69 Oct 08 21:46:14.700860 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-ServerActionsTestJSON-775805645 Oct 08 21:46:14.700860 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-ServerActionsTestJSON-775805645-project Oct 08 21:46:14.700860 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:46:14.700860 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:46:14.700860 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 5e838176b44c4f23b470cfc152f79990 Oct 08 21:46:14.700860 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-ServerActionsTestJSON-775805645-project Oct 08 21:46:14.700860 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 21:46:14.700860 ncdv-master-1 devstack@n-api.service[140492]: exception: Instance a3c87119-d9e1-433a-a43d-7aa600968dd0 could not be found. Oct 08 21:46:14.700860 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': 'a3c87119-d9e1-433a-a43d-7aa600968dd0'} Oct 08 21:46:14.700860 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:46:14.700860 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:46:14.700860 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:46:14.700860 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:46:14.700860 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:46:14.700860 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:46:14.700860 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:46:14.700860 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:46:14.700860 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:46:14.700860 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:46:14.700860 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3c87119-d9e1-433a-a43d-7aa600968dd0 could not be found. Oct 08 21:46:14.700860 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:46:14.700860 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:46:14.700860 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:46:14.700860 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:46:14.700860 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:46:14.700860 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:46:14.700860 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:46:14.700860 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:46:14.700860 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:46:14.700860 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:46:14.700860 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:46:14.700860 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:46:14.700860 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:46:14.700860 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:46:14.700860 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:46:14.700860 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:46:14.700860 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3c87119-d9e1-433a-a43d-7aa600968dd0 could not be found. Oct 08 21:46:14.700860 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:46:14.700860 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:46:14.700860 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:46:14.706222 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:46:14.706222 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:46:14.706222 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:46:14.706222 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:46:14.706222 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:46:14.706222 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3c87119-d9e1-433a-a43d-7aa600968dd0 could not be found. Oct 08 21:46:14.706222 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:46:14.706222 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-11467fe4-2633-4719-bd35-b853e1d3796f tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Returning 404 to user: Instance a3c87119-d9e1-433a-a43d-7aa600968dd0 could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:46:14.706222 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-11467fe4-2633-4719-bd35-b853e1d3796f tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/a3c87119-d9e1-433a-a43d-7aa600968dd0" status: 404 len: 111 microversion: 2.1 time: 0.033094 Oct 08 21:46:14.706222 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3291/6509] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:46:14 2022] GET /compute/v2.1/servers/a3c87119-d9e1-433a-a43d-7aa600968dd0 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:46:14.718801 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-507ce045-7e33-494e-a095-c221ba3db773 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:46:14.719592 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-507ce045-7e33-494e-a095-c221ba3db773 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: a3c87119-d9e1-433a-a43d-7aa600968dd0] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:46:14.726215 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-507ce045-7e33-494e-a095-c221ba3db773 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:46:14.726708 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-507ce045-7e33-494e-a095-c221ba3db773 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:46:14.727151 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-507ce045-7e33-494e-a095-c221ba3db773 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:46:14.727854 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-507ce045-7e33-494e-a095-c221ba3db773 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:46:14.728314 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-507ce045-7e33-494e-a095-c221ba3db773 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:46:14.728743 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-507ce045-7e33-494e-a095-c221ba3db773 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:46:14.743640 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-507ce045-7e33-494e-a095-c221ba3db773 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] HTTP exception thrown: Instance a3c87119-d9e1-433a-a43d-7aa600968dd0 could not be found. Oct 08 21:46:14.745388 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-507ce045-7e33-494e-a095-c221ba3db773 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Request method failure captured: Oct 08 21:46:14.745388 ncdv-master-1 devstack@n-api.service[140491]: request: GET /compute/v2.1/servers/a3c87119-d9e1-433a-a43d-7aa600968dd0 HTTP/1.1 Oct 08 21:46:14.745388 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:46:14.745388 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:46:14.745388 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:46:14.745388 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 21:46:14.745388 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:46:14.745388 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:46:14.745388 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:46:14.745388 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:46:14.745388 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQe9X_YMmNKk_IiLIrhiybTebPLsigD2oA9w_czixVt5baNHq-v99rHVO91kLbytmMA9O9LoejjDppyvtcuO0H46ugJTY6ixLOqtY6uw1GAjA-8XlGpO40NZ8LLPXXTy7eheVZj7WNy7D46LDg2xb5lZmDKadBVs_1JcZ4-Tt9c91XNk Oct 08 21:46:14.745388 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:46:14.745388 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:46:14.745388 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:46:14.745388 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:46:14.745388 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:46:14.745388 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:46:14.745388 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 3718dd3e536649b5bf1970ff06ddea69 Oct 08 21:46:14.745388 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-ServerActionsTestJSON-775805645 Oct 08 21:46:14.745388 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:46:14.745388 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:46:14.745388 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3718dd3e536649b5bf1970ff06ddea69"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3718dd3e536649b5bf1970ff06ddea69"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3718dd3e536649b5bf1970ff06ddea69"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3718dd3e536649b5bf1970ff06ddea69"}]}] Oct 08 21:46:14.745388 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-ServerActionsTestJSON-775805645 Oct 08 21:46:14.745388 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 3718dd3e536649b5bf1970ff06ddea69 Oct 08 21:46:14.745388 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-ServerActionsTestJSON-775805645 Oct 08 21:46:14.745388 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-ServerActionsTestJSON-775805645-project Oct 08 21:46:14.745388 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:46:14.745388 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:46:14.745388 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 5e838176b44c4f23b470cfc152f79990 Oct 08 21:46:14.745388 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-ServerActionsTestJSON-775805645-project Oct 08 21:46:14.745388 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:46:14.745388 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance a3c87119-d9e1-433a-a43d-7aa600968dd0 could not be found. Oct 08 21:46:14.745388 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': 'a3c87119-d9e1-433a-a43d-7aa600968dd0'} Oct 08 21:46:14.745388 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:46:14.745388 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:46:14.745388 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:46:14.745388 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:46:14.745388 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:46:14.745388 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:46:14.745388 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:46:14.745388 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:46:14.745388 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:46:14.745388 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:46:14.745388 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3c87119-d9e1-433a-a43d-7aa600968dd0 could not be found. Oct 08 21:46:14.745388 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:46:14.745388 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:46:14.745388 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:46:14.745388 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:46:14.745388 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:46:14.745388 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:46:14.745388 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:46:14.745388 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:46:14.745388 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:46:14.745388 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:46:14.745388 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:46:14.745388 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:46:14.745388 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:46:14.745388 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:46:14.745388 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:46:14.745388 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:46:14.745388 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3c87119-d9e1-433a-a43d-7aa600968dd0 could not be found. Oct 08 21:46:14.745388 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:46:14.745388 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:46:14.745388 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:46:14.749837 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:46:14.749837 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:46:14.749837 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:46:14.749837 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:46:14.749837 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:46:14.749837 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3c87119-d9e1-433a-a43d-7aa600968dd0 could not be found. Oct 08 21:46:14.749837 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:46:14.749837 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-507ce045-7e33-494e-a095-c221ba3db773 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Returning 404 to user: Instance a3c87119-d9e1-433a-a43d-7aa600968dd0 could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:46:14.749837 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-507ce045-7e33-494e-a095-c221ba3db773 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/a3c87119-d9e1-433a-a43d-7aa600968dd0" status: 404 len: 111 microversion: 2.1 time: 0.032604 Oct 08 21:46:14.751218 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3219/6510] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:46:14 2022] GET /compute/v2.1/servers/a3c87119-d9e1-433a-a43d-7aa600968dd0 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:46:14.798191 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-1ed975df-5afa-4064-8f1f-0aac011025a6 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-8359702", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "networks": [{"uuid": "99fc871d-a990-4798-830c-471348036e9e"}], "security_groups": [{"name": "tempest-securitygroup--1818474219"}], "key_name": "tempest-keypair-1142039836", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:46:14.906173 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.network.neutron [None req-1ed975df-5afa-4064-8f1f-0aac011025a6 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] validate_networks() for [('99fc871d-a990-4798-830c-471348036e9e', None, None, None, None, None)] {{(pid=140492) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 21:46:15.082433 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=45 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:46:15.323129 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-1ed975df-5afa-4064-8f1f-0aac011025a6 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Flavor limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 21:46:15.323591 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-1ed975df-5afa-4064-8f1f-0aac011025a6 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Image limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 21:46:15.324092 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-1ed975df-5afa-4064-8f1f-0aac011025a6 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Flavor pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 21:46:15.324562 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-1ed975df-5afa-4064-8f1f-0aac011025a6 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Image pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 21:46:15.324998 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-1ed975df-5afa-4064-8f1f-0aac011025a6 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 21:46:15.334031 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1ed975df-5afa-4064-8f1f-0aac011025a6 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:46:15.334559 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1ed975df-5afa-4064-8f1f-0aac011025a6 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:46:15.335018 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1ed975df-5afa-4064-8f1f-0aac011025a6 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:46:15.335772 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1ed975df-5afa-4064-8f1f-0aac011025a6 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:46:15.336247 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1ed975df-5afa-4064-8f1f-0aac011025a6 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:46:15.336697 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1ed975df-5afa-4064-8f1f-0aac011025a6 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:46:15.354007 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-1ed975df-5afa-4064-8f1f-0aac011025a6 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Getting quotas for project 3718dd3e536649b5bf1970ff06ddea69. Resources: {'cores', 'instances', 'ram'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:46:15.359385 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-1ed975df-5afa-4064-8f1f-0aac011025a6 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Getting quotas for user 5e838176b44c4f23b470cfc152f79990 and project 3718dd3e536649b5bf1970ff06ddea69. Resources: {'cores', 'instances', 'ram'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:46:15.372357 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-1ed975df-5afa-4064-8f1f-0aac011025a6 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Going to run 1 instances... {{(pid=140492) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 21:46:15.374709 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-1ed975df-5afa-4064-8f1f-0aac011025a6 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: fb5b6e20-bd92-4b53-bed6-4e747e8c84ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c508bd7f-7db9-4b2c-af7c-be54a855c355',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140492) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 21:46:15.420601 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-1ed975df-5afa-4064-8f1f-0aac011025a6 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.626474 Oct 08 21:46:15.421290 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3292/6511] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 21:46:14 2022] POST /compute/v2.1/servers => generated 406 bytes in 628 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 08 21:46:15.432984 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-633248c2-1491-418a-9fe5-a4fee121a75b tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:46:15.433643 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-633248c2-1491-418a-9fe5-a4fee121a75b tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: fb5b6e20-bd92-4b53-bed6-4e747e8c84ca] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:46:15.435645 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:46:15.494120 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-633248c2-1491-418a-9fe5-a4fee121a75b tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e838176b44c4f23b470cfc152f79990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3718dd3e536649b5bf1970ff06ddea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:46:15.501219 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-633248c2-1491-418a-9fe5-a4fee121a75b tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/fb5b6e20-bd92-4b53-bed6-4e747e8c84ca" status: 200 len: 1236 microversion: 2.1 time: 0.072023 Oct 08 21:46:15.502015 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3220/6512] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:46:15 2022] GET /compute/v2.1/servers/fb5b6e20-bd92-4b53-bed6-4e747e8c84ca => generated 1236 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:46:16.524927 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-da9d4624-3040-4c84-8b42-c1e6fa6acbde tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:46:16.525698 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-da9d4624-3040-4c84-8b42-c1e6fa6acbde tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: fb5b6e20-bd92-4b53-bed6-4e747e8c84ca] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:46:16.532664 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-da9d4624-3040-4c84-8b42-c1e6fa6acbde tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:46:16.533315 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-da9d4624-3040-4c84-8b42-c1e6fa6acbde tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:46:16.533857 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-da9d4624-3040-4c84-8b42-c1e6fa6acbde tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:46:16.536400 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-da9d4624-3040-4c84-8b42-c1e6fa6acbde tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:46:16.536973 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-da9d4624-3040-4c84-8b42-c1e6fa6acbde tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:46:16.538130 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-da9d4624-3040-4c84-8b42-c1e6fa6acbde tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:46:16.608719 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-da9d4624-3040-4c84-8b42-c1e6fa6acbde tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e838176b44c4f23b470cfc152f79990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3718dd3e536649b5bf1970ff06ddea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:46:16.618154 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-da9d4624-3040-4c84-8b42-c1e6fa6acbde tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/fb5b6e20-bd92-4b53-bed6-4e747e8c84ca" status: 200 len: 1296 microversion: 2.1 time: 0.097935 Oct 08 21:46:16.618996 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3293/6513] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:46:16 2022] GET /compute/v2.1/servers/fb5b6e20-bd92-4b53-bed6-4e747e8c84ca => generated 1296 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:46:17.642515 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-74cc6aec-0bee-4515-b8ab-3171034a9825 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:46:17.643135 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-74cc6aec-0bee-4515-b8ab-3171034a9825 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: fb5b6e20-bd92-4b53-bed6-4e747e8c84ca] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:46:17.655047 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-74cc6aec-0bee-4515-b8ab-3171034a9825 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:46:17.655551 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-74cc6aec-0bee-4515-b8ab-3171034a9825 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:46:17.656001 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-74cc6aec-0bee-4515-b8ab-3171034a9825 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:46:17.656721 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-74cc6aec-0bee-4515-b8ab-3171034a9825 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:46:17.657208 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-74cc6aec-0bee-4515-b8ab-3171034a9825 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:46:17.657680 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-74cc6aec-0bee-4515-b8ab-3171034a9825 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:46:17.869980 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-74cc6aec-0bee-4515-b8ab-3171034a9825 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e838176b44c4f23b470cfc152f79990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3718dd3e536649b5bf1970ff06ddea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:46:17.877808 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-74cc6aec-0bee-4515-b8ab-3171034a9825 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/fb5b6e20-bd92-4b53-bed6-4e747e8c84ca" status: 200 len: 1362 microversion: 2.1 time: 0.239355 Oct 08 21:46:17.878458 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3221/6514] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:46:17 2022] GET /compute/v2.1/servers/fb5b6e20-bd92-4b53-bed6-4e747e8c84ca => generated 1362 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:46:18.003204 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-6affb045-ab1f-45c3-9aee-060ab7b8f243 req-156d16b2-c2df-4628-b10a-7b4d140dee40 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb5b6e20-bd92-4b53-bed6-4e747e8c84ca", "tag": "1231878f-b2f2-4e5a-974f-7f22d86c8c69"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:46:18.015820 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-6affb045-ab1f-45c3-9aee-060ab7b8f243 req-156d16b2-c2df-4628-b10a-7b4d140dee40 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:46:18.016337 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-6affb045-ab1f-45c3-9aee-060ab7b8f243 req-156d16b2-c2df-4628-b10a-7b4d140dee40 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:46:18.016798 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-6affb045-ab1f-45c3-9aee-060ab7b8f243 req-156d16b2-c2df-4628-b10a-7b4d140dee40 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:46:18.031738 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-6affb045-ab1f-45c3-9aee-060ab7b8f243 req-156d16b2-c2df-4628-b10a-7b4d140dee40 service nova] Creating event network-changed:1231878f-b2f2-4e5a-974f-7f22d86c8c69 for instance fb5b6e20-bd92-4b53-bed6-4e747e8c84ca on nch1-master-1 Oct 08 21:46:18.037316 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-6affb045-ab1f-45c3-9aee-060ab7b8f243 req-156d16b2-c2df-4628-b10a-7b4d140dee40 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038206 Oct 08 21:46:18.037929 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3294/6515] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:46:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:46:18.901521 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-f957f637-1ffa-4e33-9aa1-fb89bce122de tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:46:18.902118 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-f957f637-1ffa-4e33-9aa1-fb89bce122de tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: fb5b6e20-bd92-4b53-bed6-4e747e8c84ca] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:46:18.909085 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f957f637-1ffa-4e33-9aa1-fb89bce122de tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:46:18.909645 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f957f637-1ffa-4e33-9aa1-fb89bce122de tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:46:18.910091 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f957f637-1ffa-4e33-9aa1-fb89bce122de tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:46:18.910783 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f957f637-1ffa-4e33-9aa1-fb89bce122de tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:46:18.911243 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f957f637-1ffa-4e33-9aa1-fb89bce122de tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:46:18.911673 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f957f637-1ffa-4e33-9aa1-fb89bce122de tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:46:19.045346 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-f957f637-1ffa-4e33-9aa1-fb89bce122de tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e838176b44c4f23b470cfc152f79990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3718dd3e536649b5bf1970ff06ddea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:46:19.053740 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-f957f637-1ffa-4e33-9aa1-fb89bce122de tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/fb5b6e20-bd92-4b53-bed6-4e747e8c84ca" status: 200 len: 1362 microversion: 2.1 time: 0.156126 Oct 08 21:46:19.054314 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3222/6516] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:46:18 2022] GET /compute/v2.1/servers/fb5b6e20-bd92-4b53-bed6-4e747e8c84ca => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:46:20.077670 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-ebda3678-2b0f-455f-afb6-ccb949c2eea9 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:46:20.078461 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-ebda3678-2b0f-455f-afb6-ccb949c2eea9 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: fb5b6e20-bd92-4b53-bed6-4e747e8c84ca] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:46:20.086339 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ebda3678-2b0f-455f-afb6-ccb949c2eea9 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:46:20.086847 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ebda3678-2b0f-455f-afb6-ccb949c2eea9 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:46:20.087309 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ebda3678-2b0f-455f-afb6-ccb949c2eea9 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:46:20.088041 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ebda3678-2b0f-455f-afb6-ccb949c2eea9 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:46:20.088520 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ebda3678-2b0f-455f-afb6-ccb949c2eea9 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:46:20.088975 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ebda3678-2b0f-455f-afb6-ccb949c2eea9 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:46:20.222712 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-ebda3678-2b0f-455f-afb6-ccb949c2eea9 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e838176b44c4f23b470cfc152f79990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3718dd3e536649b5bf1970ff06ddea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:46:20.230630 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-ebda3678-2b0f-455f-afb6-ccb949c2eea9 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/fb5b6e20-bd92-4b53-bed6-4e747e8c84ca" status: 200 len: 1362 microversion: 2.1 time: 0.157298 Oct 08 21:46:20.231208 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3295/6517] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:46:20 2022] GET /compute/v2.1/servers/fb5b6e20-bd92-4b53-bed6-4e747e8c84ca => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:46:21.254766 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-7126c7a1-b1b6-4565-9cba-4fe256277ee7 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:46:21.255376 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-7126c7a1-b1b6-4565-9cba-4fe256277ee7 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: fb5b6e20-bd92-4b53-bed6-4e747e8c84ca] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:46:21.262529 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7126c7a1-b1b6-4565-9cba-4fe256277ee7 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:46:21.263028 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7126c7a1-b1b6-4565-9cba-4fe256277ee7 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:46:21.263481 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7126c7a1-b1b6-4565-9cba-4fe256277ee7 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:46:21.264189 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7126c7a1-b1b6-4565-9cba-4fe256277ee7 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:46:21.264658 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7126c7a1-b1b6-4565-9cba-4fe256277ee7 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:46:21.265100 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7126c7a1-b1b6-4565-9cba-4fe256277ee7 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:46:21.392294 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-7126c7a1-b1b6-4565-9cba-4fe256277ee7 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e838176b44c4f23b470cfc152f79990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3718dd3e536649b5bf1970ff06ddea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:46:21.400933 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-7126c7a1-b1b6-4565-9cba-4fe256277ee7 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/fb5b6e20-bd92-4b53-bed6-4e747e8c84ca" status: 200 len: 1362 microversion: 2.1 time: 0.150682 Oct 08 21:46:21.401532 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3223/6518] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:46:21 2022] GET /compute/v2.1/servers/fb5b6e20-bd92-4b53-bed6-4e747e8c84ca => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:46:22.080167 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-8a02012f-b688-4d79-86f6-42e7af3b64f7 req-4640bfa4-70df-4084-a13f-bd2b371f7c27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb5b6e20-bd92-4b53-bed6-4e747e8c84ca", "name": "network-vif-plugged", "status": "completed", "tag": "1231878f-b2f2-4e5a-974f-7f22d86c8c69"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:46:22.092753 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-8a02012f-b688-4d79-86f6-42e7af3b64f7 req-4640bfa4-70df-4084-a13f-bd2b371f7c27 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:46:22.093471 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-8a02012f-b688-4d79-86f6-42e7af3b64f7 req-4640bfa4-70df-4084-a13f-bd2b371f7c27 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:46:22.093931 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-8a02012f-b688-4d79-86f6-42e7af3b64f7 req-4640bfa4-70df-4084-a13f-bd2b371f7c27 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:46:22.105653 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-8a02012f-b688-4d79-86f6-42e7af3b64f7 req-4640bfa4-70df-4084-a13f-bd2b371f7c27 service nova] Creating event network-vif-plugged:1231878f-b2f2-4e5a-974f-7f22d86c8c69 for instance fb5b6e20-bd92-4b53-bed6-4e747e8c84ca on nch1-master-1 Oct 08 21:46:22.110619 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-8a02012f-b688-4d79-86f6-42e7af3b64f7 req-4640bfa4-70df-4084-a13f-bd2b371f7c27 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034217 Oct 08 21:46:22.111215 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3296/6519] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:46:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:46:22.423895 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-6697f5db-42fb-4cdd-885a-887caca5fbf8 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:46:22.424519 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-6697f5db-42fb-4cdd-885a-887caca5fbf8 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: fb5b6e20-bd92-4b53-bed6-4e747e8c84ca] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:46:22.431587 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6697f5db-42fb-4cdd-885a-887caca5fbf8 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:46:22.432088 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6697f5db-42fb-4cdd-885a-887caca5fbf8 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:46:22.432534 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6697f5db-42fb-4cdd-885a-887caca5fbf8 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:46:22.433265 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6697f5db-42fb-4cdd-885a-887caca5fbf8 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:46:22.433737 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6697f5db-42fb-4cdd-885a-887caca5fbf8 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:46:22.434173 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6697f5db-42fb-4cdd-885a-887caca5fbf8 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:46:22.567766 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-6697f5db-42fb-4cdd-885a-887caca5fbf8 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e838176b44c4f23b470cfc152f79990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3718dd3e536649b5bf1970ff06ddea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:46:22.575570 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-6697f5db-42fb-4cdd-885a-887caca5fbf8 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/fb5b6e20-bd92-4b53-bed6-4e747e8c84ca" status: 200 len: 1362 microversion: 2.1 time: 0.155613 Oct 08 21:46:22.576140 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3224/6520] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:46:22 2022] GET /compute/v2.1/servers/fb5b6e20-bd92-4b53-bed6-4e747e8c84ca => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:46:23.599791 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-8ac7b6f0-d68b-460e-bad4-133504ce1f01 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:46:23.600516 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-8ac7b6f0-d68b-460e-bad4-133504ce1f01 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: fb5b6e20-bd92-4b53-bed6-4e747e8c84ca] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:46:23.607748 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8ac7b6f0-d68b-460e-bad4-133504ce1f01 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:46:23.608249 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8ac7b6f0-d68b-460e-bad4-133504ce1f01 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:46:23.608704 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8ac7b6f0-d68b-460e-bad4-133504ce1f01 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:46:23.609445 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8ac7b6f0-d68b-460e-bad4-133504ce1f01 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:46:23.609921 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8ac7b6f0-d68b-460e-bad4-133504ce1f01 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:46:23.610366 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8ac7b6f0-d68b-460e-bad4-133504ce1f01 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:46:23.747760 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-8ac7b6f0-d68b-460e-bad4-133504ce1f01 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e838176b44c4f23b470cfc152f79990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3718dd3e536649b5bf1970ff06ddea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:46:23.756149 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-8ac7b6f0-d68b-460e-bad4-133504ce1f01 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/fb5b6e20-bd92-4b53-bed6-4e747e8c84ca" status: 200 len: 1550 microversion: 2.1 time: 0.161309 Oct 08 21:46:23.756753 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3297/6521] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:46:23 2022] GET /compute/v2.1/servers/fb5b6e20-bd92-4b53-bed6-4e747e8c84ca => generated 1550 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:46:23.778407 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-eef836ec-88cd-405f-87aa-0e0bf8acbf17 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:46:23.778953 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-eef836ec-88cd-405f-87aa-0e0bf8acbf17 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: fb5b6e20-bd92-4b53-bed6-4e747e8c84ca] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:46:23.786408 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-eef836ec-88cd-405f-87aa-0e0bf8acbf17 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:46:23.786903 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-eef836ec-88cd-405f-87aa-0e0bf8acbf17 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:46:23.787354 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-eef836ec-88cd-405f-87aa-0e0bf8acbf17 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:46:23.788056 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-eef836ec-88cd-405f-87aa-0e0bf8acbf17 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:46:23.788525 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-eef836ec-88cd-405f-87aa-0e0bf8acbf17 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:46:23.788960 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-eef836ec-88cd-405f-87aa-0e0bf8acbf17 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:46:23.866869 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-eef836ec-88cd-405f-87aa-0e0bf8acbf17 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/fb5b6e20-bd92-4b53-bed6-4e747e8c84ca/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092321 Oct 08 21:46:23.867479 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3225/6522] 10.222.0.26 () {58 vars in 1275 bytes} [Sat Oct 8 21:46:23 2022] GET /compute/v2.1/servers/fb5b6e20-bd92-4b53-bed6-4e747e8c84ca/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:46:25.025266 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-4083567e-d7da-4b5d-a327-ef5800894aa6 req-318c1c83-99c7-4459-93b0-104a232e329e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb5b6e20-bd92-4b53-bed6-4e747e8c84ca", "tag": "1231878f-b2f2-4e5a-974f-7f22d86c8c69"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:46:25.035671 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-4083567e-d7da-4b5d-a327-ef5800894aa6 req-318c1c83-99c7-4459-93b0-104a232e329e service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:46:25.036177 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-4083567e-d7da-4b5d-a327-ef5800894aa6 req-318c1c83-99c7-4459-93b0-104a232e329e service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:46:25.036635 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-4083567e-d7da-4b5d-a327-ef5800894aa6 req-318c1c83-99c7-4459-93b0-104a232e329e service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:46:25.048544 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-4083567e-d7da-4b5d-a327-ef5800894aa6 req-318c1c83-99c7-4459-93b0-104a232e329e service nova] Creating event network-changed:1231878f-b2f2-4e5a-974f-7f22d86c8c69 for instance fb5b6e20-bd92-4b53-bed6-4e747e8c84ca on nch1-master-1 Oct 08 21:46:25.053984 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-4083567e-d7da-4b5d-a327-ef5800894aa6 req-318c1c83-99c7-4459-93b0-104a232e329e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032393 Oct 08 21:46:25.054611 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3298/6523] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:46:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:46:58.174980 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=2 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:46:58.176059 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:SELECT=13 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:46:58.176587 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=55,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:46:58.180867 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-bfa1b9d2-697e-4f78-848b-5740f485bb34 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:46:58.188660 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bfa1b9d2-697e-4f78-848b-5740f485bb34 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:46:58.189144 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bfa1b9d2-697e-4f78-848b-5740f485bb34 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:46:58.190111 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bfa1b9d2-697e-4f78-848b-5740f485bb34 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:46:58.213515 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-bfa1b9d2-697e-4f78-848b-5740f485bb34 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: fb5b6e20-bd92-4b53-bed6-4e747e8c84ca] Going to try to stop instance {{(pid=140491) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 08 21:46:58.254953 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-bfa1b9d2-697e-4f78-848b-5740f485bb34 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "POST /compute/v2.1/servers/fb5b6e20-bd92-4b53-bed6-4e747e8c84ca/action" status: 202 len: 0 microversion: 2.1 time: 0.081451 Oct 08 21:46:58.255586 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3226/6524] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:46:58 2022] POST /compute/v2.1/servers/fb5b6e20-bd92-4b53-bed6-4e747e8c84ca/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 21:46:58.264415 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-7cd2ce68-ebf2-4c45-b333-b4ed01bacf58 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:46:58.265152 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-7cd2ce68-ebf2-4c45-b333-b4ed01bacf58 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: fb5b6e20-bd92-4b53-bed6-4e747e8c84ca] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:46:58.267666 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=2 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:46:58.268936 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=6 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:46:58.269897 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=24,nova_api:INSERT=3 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:46:58.271037 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=42 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:46:58.279261 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7cd2ce68-ebf2-4c45-b333-b4ed01bacf58 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:46:58.279788 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7cd2ce68-ebf2-4c45-b333-b4ed01bacf58 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:46:58.280255 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7cd2ce68-ebf2-4c45-b333-b4ed01bacf58 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:46:58.281011 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7cd2ce68-ebf2-4c45-b333-b4ed01bacf58 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:46:58.281513 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7cd2ce68-ebf2-4c45-b333-b4ed01bacf58 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:46:58.281968 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7cd2ce68-ebf2-4c45-b333-b4ed01bacf58 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:46:58.415698 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-7cd2ce68-ebf2-4c45-b333-b4ed01bacf58 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e838176b44c4f23b470cfc152f79990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3718dd3e536649b5bf1970ff06ddea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:46:58.423621 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-7cd2ce68-ebf2-4c45-b333-b4ed01bacf58 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/fb5b6e20-bd92-4b53-bed6-4e747e8c84ca" status: 200 len: 1678 microversion: 2.1 time: 0.163601 Oct 08 21:46:58.424257 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3299/6525] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:46:58 2022] GET /compute/v2.1/servers/fb5b6e20-bd92-4b53-bed6-4e747e8c84ca => generated 1678 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:46:59.448313 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-2f117fa4-3505-46fe-8ebf-1e7bcd6aafbd tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:46:59.449022 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-2f117fa4-3505-46fe-8ebf-1e7bcd6aafbd tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: fb5b6e20-bd92-4b53-bed6-4e747e8c84ca] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:46:59.455956 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2f117fa4-3505-46fe-8ebf-1e7bcd6aafbd tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:46:59.456448 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2f117fa4-3505-46fe-8ebf-1e7bcd6aafbd tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:46:59.456894 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2f117fa4-3505-46fe-8ebf-1e7bcd6aafbd tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:46:59.457619 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2f117fa4-3505-46fe-8ebf-1e7bcd6aafbd tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:46:59.458083 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2f117fa4-3505-46fe-8ebf-1e7bcd6aafbd tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:46:59.458516 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2f117fa4-3505-46fe-8ebf-1e7bcd6aafbd tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:46:59.597520 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-2f117fa4-3505-46fe-8ebf-1e7bcd6aafbd tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e838176b44c4f23b470cfc152f79990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3718dd3e536649b5bf1970ff06ddea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:46:59.605290 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-2f117fa4-3505-46fe-8ebf-1e7bcd6aafbd tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/fb5b6e20-bd92-4b53-bed6-4e747e8c84ca" status: 200 len: 1678 microversion: 2.1 time: 0.162105 Oct 08 21:46:59.605880 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3227/6526] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:46:59 2022] GET /compute/v2.1/servers/fb5b6e20-bd92-4b53-bed6-4e747e8c84ca => generated 1678 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:47:00.628412 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-3938ce63-5cee-434c-b385-7b0f4434e4e1 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:47:00.629045 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-3938ce63-5cee-434c-b385-7b0f4434e4e1 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: fb5b6e20-bd92-4b53-bed6-4e747e8c84ca] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:47:00.636059 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3938ce63-5cee-434c-b385-7b0f4434e4e1 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:47:00.636569 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3938ce63-5cee-434c-b385-7b0f4434e4e1 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:47:00.637033 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3938ce63-5cee-434c-b385-7b0f4434e4e1 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:47:00.637783 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3938ce63-5cee-434c-b385-7b0f4434e4e1 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:47:00.638265 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3938ce63-5cee-434c-b385-7b0f4434e4e1 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:47:00.638715 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3938ce63-5cee-434c-b385-7b0f4434e4e1 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:47:00.767035 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-3938ce63-5cee-434c-b385-7b0f4434e4e1 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e838176b44c4f23b470cfc152f79990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3718dd3e536649b5bf1970ff06ddea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:47:00.775470 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-3938ce63-5cee-434c-b385-7b0f4434e4e1 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/fb5b6e20-bd92-4b53-bed6-4e747e8c84ca" status: 200 len: 1678 microversion: 2.1 time: 0.151185 Oct 08 21:47:00.776056 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3300/6527] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:47:00 2022] GET /compute/v2.1/servers/fb5b6e20-bd92-4b53-bed6-4e747e8c84ca => generated 1678 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:47:01.799888 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-e8dc4e03-e12f-4534-b5c4-465b6da71657 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:47:01.800412 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-e8dc4e03-e12f-4534-b5c4-465b6da71657 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: fb5b6e20-bd92-4b53-bed6-4e747e8c84ca] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:47:01.807312 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e8dc4e03-e12f-4534-b5c4-465b6da71657 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:47:01.807801 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e8dc4e03-e12f-4534-b5c4-465b6da71657 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:47:01.808243 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e8dc4e03-e12f-4534-b5c4-465b6da71657 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:47:01.808940 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e8dc4e03-e12f-4534-b5c4-465b6da71657 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:47:01.809428 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e8dc4e03-e12f-4534-b5c4-465b6da71657 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:47:01.809860 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e8dc4e03-e12f-4534-b5c4-465b6da71657 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:47:01.942754 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-e8dc4e03-e12f-4534-b5c4-465b6da71657 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e838176b44c4f23b470cfc152f79990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3718dd3e536649b5bf1970ff06ddea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:47:01.950758 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-e8dc4e03-e12f-4534-b5c4-465b6da71657 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/fb5b6e20-bd92-4b53-bed6-4e747e8c84ca" status: 200 len: 1678 microversion: 2.1 time: 0.155600 Oct 08 21:47:01.951342 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3228/6528] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:47:01 2022] GET /compute/v2.1/servers/fb5b6e20-bd92-4b53-bed6-4e747e8c84ca => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:47:02.974335 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-886e432d-fee2-4557-a3df-21ef49571bfd tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:47:02.974966 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-886e432d-fee2-4557-a3df-21ef49571bfd tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: fb5b6e20-bd92-4b53-bed6-4e747e8c84ca] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:47:02.981931 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-886e432d-fee2-4557-a3df-21ef49571bfd tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:47:02.982524 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-886e432d-fee2-4557-a3df-21ef49571bfd tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:47:02.982984 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-886e432d-fee2-4557-a3df-21ef49571bfd tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:47:02.983702 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-886e432d-fee2-4557-a3df-21ef49571bfd tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:47:02.984179 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-886e432d-fee2-4557-a3df-21ef49571bfd tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:47:02.984625 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-886e432d-fee2-4557-a3df-21ef49571bfd tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:47:03.118266 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-886e432d-fee2-4557-a3df-21ef49571bfd tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e838176b44c4f23b470cfc152f79990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3718dd3e536649b5bf1970ff06ddea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:47:03.126197 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-886e432d-fee2-4557-a3df-21ef49571bfd tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/fb5b6e20-bd92-4b53-bed6-4e747e8c84ca" status: 200 len: 1678 microversion: 2.1 time: 0.156341 Oct 08 21:47:03.126810 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3301/6529] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:47:02 2022] GET /compute/v2.1/servers/fb5b6e20-bd92-4b53-bed6-4e747e8c84ca => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:47:04.150472 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-1a022300-5be4-4e00-8b7c-fb4a364ce7a0 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:47:04.151087 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-1a022300-5be4-4e00-8b7c-fb4a364ce7a0 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: fb5b6e20-bd92-4b53-bed6-4e747e8c84ca] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:47:04.159273 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1a022300-5be4-4e00-8b7c-fb4a364ce7a0 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:47:04.159911 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1a022300-5be4-4e00-8b7c-fb4a364ce7a0 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:47:04.160385 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1a022300-5be4-4e00-8b7c-fb4a364ce7a0 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:47:04.161300 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1a022300-5be4-4e00-8b7c-fb4a364ce7a0 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:47:04.161824 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1a022300-5be4-4e00-8b7c-fb4a364ce7a0 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:47:04.162284 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1a022300-5be4-4e00-8b7c-fb4a364ce7a0 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:47:04.290579 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-1a022300-5be4-4e00-8b7c-fb4a364ce7a0 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e838176b44c4f23b470cfc152f79990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3718dd3e536649b5bf1970ff06ddea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:47:04.298460 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-1a022300-5be4-4e00-8b7c-fb4a364ce7a0 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/fb5b6e20-bd92-4b53-bed6-4e747e8c84ca" status: 200 len: 1678 microversion: 2.1 time: 0.151919 Oct 08 21:47:04.299038 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3229/6530] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:47:04 2022] GET /compute/v2.1/servers/fb5b6e20-bd92-4b53-bed6-4e747e8c84ca => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:47:05.321765 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-be6420d9-ceb8-4cbd-9e8a-98c1cf067f1c tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:47:05.322433 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-be6420d9-ceb8-4cbd-9e8a-98c1cf067f1c tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: fb5b6e20-bd92-4b53-bed6-4e747e8c84ca] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:47:05.329365 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-be6420d9-ceb8-4cbd-9e8a-98c1cf067f1c tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:47:05.330445 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-be6420d9-ceb8-4cbd-9e8a-98c1cf067f1c tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:47:05.330954 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-be6420d9-ceb8-4cbd-9e8a-98c1cf067f1c tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:47:05.331678 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-be6420d9-ceb8-4cbd-9e8a-98c1cf067f1c tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:47:05.332163 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-be6420d9-ceb8-4cbd-9e8a-98c1cf067f1c tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:47:05.332614 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-be6420d9-ceb8-4cbd-9e8a-98c1cf067f1c tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:47:05.461240 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-be6420d9-ceb8-4cbd-9e8a-98c1cf067f1c tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e838176b44c4f23b470cfc152f79990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3718dd3e536649b5bf1970ff06ddea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:47:05.468940 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-be6420d9-ceb8-4cbd-9e8a-98c1cf067f1c tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/fb5b6e20-bd92-4b53-bed6-4e747e8c84ca" status: 200 len: 1678 microversion: 2.1 time: 0.151130 Oct 08 21:47:05.469541 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3302/6531] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:47:05 2022] GET /compute/v2.1/servers/fb5b6e20-bd92-4b53-bed6-4e747e8c84ca => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:47:06.493164 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-78d62e1f-5d3c-4a67-87f7-cf35dd86f873 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:47:06.493954 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-78d62e1f-5d3c-4a67-87f7-cf35dd86f873 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: fb5b6e20-bd92-4b53-bed6-4e747e8c84ca] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:47:06.501031 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-78d62e1f-5d3c-4a67-87f7-cf35dd86f873 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:47:06.501556 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-78d62e1f-5d3c-4a67-87f7-cf35dd86f873 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:47:06.502001 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-78d62e1f-5d3c-4a67-87f7-cf35dd86f873 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:47:06.502706 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-78d62e1f-5d3c-4a67-87f7-cf35dd86f873 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:47:06.503165 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-78d62e1f-5d3c-4a67-87f7-cf35dd86f873 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:47:06.503591 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-78d62e1f-5d3c-4a67-87f7-cf35dd86f873 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:47:06.634545 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-78d62e1f-5d3c-4a67-87f7-cf35dd86f873 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e838176b44c4f23b470cfc152f79990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3718dd3e536649b5bf1970ff06ddea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:47:06.643008 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-78d62e1f-5d3c-4a67-87f7-cf35dd86f873 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/fb5b6e20-bd92-4b53-bed6-4e747e8c84ca" status: 200 len: 1678 microversion: 2.1 time: 0.153679 Oct 08 21:47:06.643586 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3230/6532] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:47:06 2022] GET /compute/v2.1/servers/fb5b6e20-bd92-4b53-bed6-4e747e8c84ca => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:47:07.666696 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-bb41504d-b9ab-4353-9c89-eb4c149cde4e tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:47:07.667339 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-bb41504d-b9ab-4353-9c89-eb4c149cde4e tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: fb5b6e20-bd92-4b53-bed6-4e747e8c84ca] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:47:07.674923 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bb41504d-b9ab-4353-9c89-eb4c149cde4e tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:47:07.675435 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bb41504d-b9ab-4353-9c89-eb4c149cde4e tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:47:07.675895 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bb41504d-b9ab-4353-9c89-eb4c149cde4e tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:47:07.676652 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bb41504d-b9ab-4353-9c89-eb4c149cde4e tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:47:07.677136 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bb41504d-b9ab-4353-9c89-eb4c149cde4e tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:47:07.677614 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bb41504d-b9ab-4353-9c89-eb4c149cde4e tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:47:07.810345 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-bb41504d-b9ab-4353-9c89-eb4c149cde4e tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e838176b44c4f23b470cfc152f79990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3718dd3e536649b5bf1970ff06ddea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:47:07.818434 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-bb41504d-b9ab-4353-9c89-eb4c149cde4e tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/fb5b6e20-bd92-4b53-bed6-4e747e8c84ca" status: 200 len: 1678 microversion: 2.1 time: 0.155699 Oct 08 21:47:07.819008 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3303/6533] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:47:07 2022] GET /compute/v2.1/servers/fb5b6e20-bd92-4b53-bed6-4e747e8c84ca => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:47:08.841594 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-4ed230bd-18dd-454c-b81d-4fac0d507f2a tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:47:08.842218 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-4ed230bd-18dd-454c-b81d-4fac0d507f2a tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: fb5b6e20-bd92-4b53-bed6-4e747e8c84ca] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:47:08.850021 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4ed230bd-18dd-454c-b81d-4fac0d507f2a tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:47:08.850519 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4ed230bd-18dd-454c-b81d-4fac0d507f2a tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:47:08.850970 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4ed230bd-18dd-454c-b81d-4fac0d507f2a tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:47:08.851676 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4ed230bd-18dd-454c-b81d-4fac0d507f2a tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:47:08.852146 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4ed230bd-18dd-454c-b81d-4fac0d507f2a tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:47:08.852583 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4ed230bd-18dd-454c-b81d-4fac0d507f2a tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:47:08.979990 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-4ed230bd-18dd-454c-b81d-4fac0d507f2a tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e838176b44c4f23b470cfc152f79990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3718dd3e536649b5bf1970ff06ddea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:47:08.987748 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-4ed230bd-18dd-454c-b81d-4fac0d507f2a tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/fb5b6e20-bd92-4b53-bed6-4e747e8c84ca" status: 200 len: 1655 microversion: 2.1 time: 0.150155 Oct 08 21:47:08.988318 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3231/6534] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:47:08 2022] GET /compute/v2.1/servers/fb5b6e20-bd92-4b53-bed6-4e747e8c84ca => generated 1655 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:47:09.009648 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-410e9822-a581-46d7-b411-68db168b0174 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:47:09.011951 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-410e9822-a581-46d7-b411-68db168b0174 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: fb5b6e20-bd92-4b53-bed6-4e747e8c84ca] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:47:09.019932 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-410e9822-a581-46d7-b411-68db168b0174 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:47:09.020444 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-410e9822-a581-46d7-b411-68db168b0174 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:47:09.020911 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-410e9822-a581-46d7-b411-68db168b0174 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:47:09.021669 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-410e9822-a581-46d7-b411-68db168b0174 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:47:09.022153 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-410e9822-a581-46d7-b411-68db168b0174 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:47:09.022631 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-410e9822-a581-46d7-b411-68db168b0174 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:47:09.054238 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-410e9822-a581-46d7-b411-68db168b0174 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '5e838176b44c4f23b470cfc152f79990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3718dd3e536649b5bf1970ff06ddea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:47:09.059946 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-410e9822-a581-46d7-b411-68db168b0174 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: fb5b6e20-bd92-4b53-bed6-4e747e8c84ca] Old instance type m1.heat2, new instance type m1.heat {{(pid=140492) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 08 21:47:09.066932 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-410e9822-a581-46d7-b411-68db168b0174 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Flavor limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 21:47:09.067380 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-410e9822-a581-46d7-b411-68db168b0174 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Image limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 21:47:09.067876 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-410e9822-a581-46d7-b411-68db168b0174 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Flavor pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 21:47:09.068307 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-410e9822-a581-46d7-b411-68db168b0174 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Image pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 21:47:09.068740 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-410e9822-a581-46d7-b411-68db168b0174 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 21:47:09.132475 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-410e9822-a581-46d7-b411-68db168b0174 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "POST /compute/v2.1/servers/fb5b6e20-bd92-4b53-bed6-4e747e8c84ca/action" status: 202 len: 0 microversion: 2.1 time: 0.126666 Oct 08 21:47:09.133014 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3304/6535] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:47:09 2022] POST /compute/v2.1/servers/fb5b6e20-bd92-4b53-bed6-4e747e8c84ca/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 21:47:09.141033 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-84458384-56f3-4638-96ed-1a2127436131 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:47:09.141703 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-84458384-56f3-4638-96ed-1a2127436131 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: fb5b6e20-bd92-4b53-bed6-4e747e8c84ca] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:47:09.148167 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-84458384-56f3-4638-96ed-1a2127436131 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:47:09.148656 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-84458384-56f3-4638-96ed-1a2127436131 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:47:09.149102 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-84458384-56f3-4638-96ed-1a2127436131 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:47:09.149826 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-84458384-56f3-4638-96ed-1a2127436131 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:47:09.150286 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-84458384-56f3-4638-96ed-1a2127436131 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:47:09.150715 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-84458384-56f3-4638-96ed-1a2127436131 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:47:09.286823 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-84458384-56f3-4638-96ed-1a2127436131 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e838176b44c4f23b470cfc152f79990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3718dd3e536649b5bf1970ff06ddea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:47:09.295269 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-84458384-56f3-4638-96ed-1a2127436131 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/fb5b6e20-bd92-4b53-bed6-4e747e8c84ca" status: 200 len: 1678 microversion: 2.1 time: 0.158063 Oct 08 21:47:09.295845 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3232/6536] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:47:09 2022] GET /compute/v2.1/servers/fb5b6e20-bd92-4b53-bed6-4e747e8c84ca => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:47:10.320216 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-703fe9bd-0153-441c-8906-0aa0c693eb53 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:47:10.320854 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-703fe9bd-0153-441c-8906-0aa0c693eb53 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: fb5b6e20-bd92-4b53-bed6-4e747e8c84ca] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:47:10.327850 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-703fe9bd-0153-441c-8906-0aa0c693eb53 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:47:10.328362 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-703fe9bd-0153-441c-8906-0aa0c693eb53 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:47:10.328829 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-703fe9bd-0153-441c-8906-0aa0c693eb53 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:47:10.329751 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-703fe9bd-0153-441c-8906-0aa0c693eb53 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:47:10.330716 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-703fe9bd-0153-441c-8906-0aa0c693eb53 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:47:10.331161 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-703fe9bd-0153-441c-8906-0aa0c693eb53 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:47:10.465608 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-703fe9bd-0153-441c-8906-0aa0c693eb53 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e838176b44c4f23b470cfc152f79990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3718dd3e536649b5bf1970ff06ddea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:47:10.473444 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-703fe9bd-0153-441c-8906-0aa0c693eb53 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/fb5b6e20-bd92-4b53-bed6-4e747e8c84ca" status: 200 len: 1678 microversion: 2.1 time: 0.158280 Oct 08 21:47:10.480941 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3305/6537] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:47:10 2022] GET /compute/v2.1/servers/fb5b6e20-bd92-4b53-bed6-4e747e8c84ca => generated 1678 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:47:11.502331 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-82445841-5fdb-4624-8d4d-b4fb44e6b2e4 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:47:11.502948 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-82445841-5fdb-4624-8d4d-b4fb44e6b2e4 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: fb5b6e20-bd92-4b53-bed6-4e747e8c84ca] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:47:11.509961 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-82445841-5fdb-4624-8d4d-b4fb44e6b2e4 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:47:11.510452 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-82445841-5fdb-4624-8d4d-b4fb44e6b2e4 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:47:11.510899 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-82445841-5fdb-4624-8d4d-b4fb44e6b2e4 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:47:11.511603 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-82445841-5fdb-4624-8d4d-b4fb44e6b2e4 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:47:11.512092 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-82445841-5fdb-4624-8d4d-b4fb44e6b2e4 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:47:11.512503 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-82445841-5fdb-4624-8d4d-b4fb44e6b2e4 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:47:11.644531 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-82445841-5fdb-4624-8d4d-b4fb44e6b2e4 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e838176b44c4f23b470cfc152f79990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3718dd3e536649b5bf1970ff06ddea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:47:11.652363 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-82445841-5fdb-4624-8d4d-b4fb44e6b2e4 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/fb5b6e20-bd92-4b53-bed6-4e747e8c84ca" status: 200 len: 1683 microversion: 2.1 time: 0.154547 Oct 08 21:47:11.652937 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3233/6538] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:47:11 2022] GET /compute/v2.1/servers/fb5b6e20-bd92-4b53-bed6-4e747e8c84ca => generated 1683 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:47:12.676749 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-9bdc56ea-f619-472d-ada1-e34cfb57fb34 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:47:12.677444 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-9bdc56ea-f619-472d-ada1-e34cfb57fb34 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: fb5b6e20-bd92-4b53-bed6-4e747e8c84ca] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:47:12.684430 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9bdc56ea-f619-472d-ada1-e34cfb57fb34 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:47:12.684973 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9bdc56ea-f619-472d-ada1-e34cfb57fb34 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:47:12.685479 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9bdc56ea-f619-472d-ada1-e34cfb57fb34 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:47:12.686211 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9bdc56ea-f619-472d-ada1-e34cfb57fb34 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:47:12.686697 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9bdc56ea-f619-472d-ada1-e34cfb57fb34 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:47:12.687150 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9bdc56ea-f619-472d-ada1-e34cfb57fb34 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:47:12.824054 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-9bdc56ea-f619-472d-ada1-e34cfb57fb34 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e838176b44c4f23b470cfc152f79990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3718dd3e536649b5bf1970ff06ddea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:47:12.832477 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-9bdc56ea-f619-472d-ada1-e34cfb57fb34 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/fb5b6e20-bd92-4b53-bed6-4e747e8c84ca" status: 200 len: 1683 microversion: 2.1 time: 0.159694 Oct 08 21:47:12.833048 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3306/6539] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:47:12 2022] GET /compute/v2.1/servers/fb5b6e20-bd92-4b53-bed6-4e747e8c84ca => generated 1683 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:47:13.790840 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-804efa11-1c80-4906-a3f0-340f2bcbe329 req-9f2c580c-0c34-4ba0-b24f-4184e5cc74b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb5b6e20-bd92-4b53-bed6-4e747e8c84ca", "name": "network-vif-unplugged", "status": "completed", "tag": "1231878f-b2f2-4e5a-974f-7f22d86c8c69"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:47:13.801519 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-804efa11-1c80-4906-a3f0-340f2bcbe329 req-9f2c580c-0c34-4ba0-b24f-4184e5cc74b3 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:47:13.802014 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-804efa11-1c80-4906-a3f0-340f2bcbe329 req-9f2c580c-0c34-4ba0-b24f-4184e5cc74b3 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:47:13.802469 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-804efa11-1c80-4906-a3f0-340f2bcbe329 req-9f2c580c-0c34-4ba0-b24f-4184e5cc74b3 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:47:13.814722 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-804efa11-1c80-4906-a3f0-340f2bcbe329 req-9f2c580c-0c34-4ba0-b24f-4184e5cc74b3 service nova] Creating event network-vif-unplugged:1231878f-b2f2-4e5a-974f-7f22d86c8c69 for instance fb5b6e20-bd92-4b53-bed6-4e747e8c84ca on nch2-master-1 Oct 08 21:47:13.820674 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [req-804efa11-1c80-4906-a3f0-340f2bcbe329 req-9f2c580c-0c34-4ba0-b24f-4184e5cc74b3 service nova] Instance fb5b6e20-bd92-4b53-bed6-4e747e8c84ca is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140491) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 08 21:47:13.832675 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-804efa11-1c80-4906-a3f0-340f2bcbe329 req-9f2c580c-0c34-4ba0-b24f-4184e5cc74b3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.116071 Oct 08 21:47:13.833322 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3234/6540] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:47:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:47:13.856303 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-75e283a0-cf3d-4098-8dde-763b3505d2f9 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:47:13.857064 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-75e283a0-cf3d-4098-8dde-763b3505d2f9 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: fb5b6e20-bd92-4b53-bed6-4e747e8c84ca] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:47:13.865125 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-75e283a0-cf3d-4098-8dde-763b3505d2f9 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:47:13.865670 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-75e283a0-cf3d-4098-8dde-763b3505d2f9 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:47:13.866137 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-75e283a0-cf3d-4098-8dde-763b3505d2f9 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:47:13.866869 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-75e283a0-cf3d-4098-8dde-763b3505d2f9 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:47:13.867355 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-75e283a0-cf3d-4098-8dde-763b3505d2f9 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:47:13.867808 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-75e283a0-cf3d-4098-8dde-763b3505d2f9 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:47:14.066454 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-75e283a0-cf3d-4098-8dde-763b3505d2f9 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e838176b44c4f23b470cfc152f79990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3718dd3e536649b5bf1970ff06ddea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:47:14.074771 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-75e283a0-cf3d-4098-8dde-763b3505d2f9 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/fb5b6e20-bd92-4b53-bed6-4e747e8c84ca" status: 200 len: 1682 microversion: 2.1 time: 0.222512 Oct 08 21:47:14.075354 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3307/6541] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:47:13 2022] GET /compute/v2.1/servers/fb5b6e20-bd92-4b53-bed6-4e747e8c84ca => generated 1682 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:47:15.099038 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-f59b7ad8-8186-40bd-bf8d-067dae77c067 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:47:15.099662 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-f59b7ad8-8186-40bd-bf8d-067dae77c067 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: fb5b6e20-bd92-4b53-bed6-4e747e8c84ca] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:47:15.106972 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f59b7ad8-8186-40bd-bf8d-067dae77c067 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:47:15.107484 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f59b7ad8-8186-40bd-bf8d-067dae77c067 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:47:15.107940 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f59b7ad8-8186-40bd-bf8d-067dae77c067 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:47:15.108661 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f59b7ad8-8186-40bd-bf8d-067dae77c067 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:47:15.109133 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f59b7ad8-8186-40bd-bf8d-067dae77c067 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:47:15.109601 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f59b7ad8-8186-40bd-bf8d-067dae77c067 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:47:15.255674 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-f59b7ad8-8186-40bd-bf8d-067dae77c067 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e838176b44c4f23b470cfc152f79990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3718dd3e536649b5bf1970ff06ddea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:47:15.263997 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-f59b7ad8-8186-40bd-bf8d-067dae77c067 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/fb5b6e20-bd92-4b53-bed6-4e747e8c84ca" status: 200 len: 1682 microversion: 2.1 time: 0.169689 Oct 08 21:47:15.264579 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3235/6542] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:47:15 2022] GET /compute/v2.1/servers/fb5b6e20-bd92-4b53-bed6-4e747e8c84ca => generated 1682 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:47:15.851412 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-666fe2ac-2e71-42e1-9eb0-3862f4eefaca req-9980c15a-a3b3-4c46-9e3b-8984058ec24e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb5b6e20-bd92-4b53-bed6-4e747e8c84ca", "tag": "1231878f-b2f2-4e5a-974f-7f22d86c8c69"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:47:15.861748 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-666fe2ac-2e71-42e1-9eb0-3862f4eefaca req-9980c15a-a3b3-4c46-9e3b-8984058ec24e service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:47:15.862256 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-666fe2ac-2e71-42e1-9eb0-3862f4eefaca req-9980c15a-a3b3-4c46-9e3b-8984058ec24e service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:47:15.862715 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-666fe2ac-2e71-42e1-9eb0-3862f4eefaca req-9980c15a-a3b3-4c46-9e3b-8984058ec24e service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:47:15.874632 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-666fe2ac-2e71-42e1-9eb0-3862f4eefaca req-9980c15a-a3b3-4c46-9e3b-8984058ec24e service nova] Creating event network-changed:1231878f-b2f2-4e5a-974f-7f22d86c8c69 for instance fb5b6e20-bd92-4b53-bed6-4e747e8c84ca on nch2-master-1 Oct 08 21:47:15.880032 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [req-666fe2ac-2e71-42e1-9eb0-3862f4eefaca req-9980c15a-a3b3-4c46-9e3b-8984058ec24e service nova] Instance fb5b6e20-bd92-4b53-bed6-4e747e8c84ca is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140492) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 08 21:47:15.891253 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-666fe2ac-2e71-42e1-9eb0-3862f4eefaca req-9980c15a-a3b3-4c46-9e3b-8984058ec24e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043549 Oct 08 21:47:15.891853 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3308/6543] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:47:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:47:16.286938 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-b95ef7f4-1724-4476-8f46-cb7eba804822 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:47:16.288389 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-b95ef7f4-1724-4476-8f46-cb7eba804822 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: fb5b6e20-bd92-4b53-bed6-4e747e8c84ca] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:47:16.297440 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b95ef7f4-1724-4476-8f46-cb7eba804822 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:47:16.298403 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b95ef7f4-1724-4476-8f46-cb7eba804822 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:47:16.299087 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b95ef7f4-1724-4476-8f46-cb7eba804822 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:47:16.300776 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b95ef7f4-1724-4476-8f46-cb7eba804822 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:47:16.301480 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b95ef7f4-1724-4476-8f46-cb7eba804822 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:47:16.302122 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b95ef7f4-1724-4476-8f46-cb7eba804822 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:47:16.516343 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-b95ef7f4-1724-4476-8f46-cb7eba804822 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e838176b44c4f23b470cfc152f79990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3718dd3e536649b5bf1970ff06ddea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:47:16.525339 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-b95ef7f4-1724-4476-8f46-cb7eba804822 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/fb5b6e20-bd92-4b53-bed6-4e747e8c84ca" status: 200 len: 1676 microversion: 2.1 time: 0.242256 Oct 08 21:47:16.526006 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3236/6544] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:47:16 2022] GET /compute/v2.1/servers/fb5b6e20-bd92-4b53-bed6-4e747e8c84ca => generated 1676 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:47:16.549257 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-b0f9d48a-77f1-400e-9764-b0813ff3ef8c tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:47:16.549954 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-b0f9d48a-77f1-400e-9764-b0813ff3ef8c tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: fb5b6e20-bd92-4b53-bed6-4e747e8c84ca] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:47:16.556414 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b0f9d48a-77f1-400e-9764-b0813ff3ef8c tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:47:16.556918 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b0f9d48a-77f1-400e-9764-b0813ff3ef8c tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:47:16.557421 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b0f9d48a-77f1-400e-9764-b0813ff3ef8c tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:47:16.558156 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b0f9d48a-77f1-400e-9764-b0813ff3ef8c tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:47:16.558644 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b0f9d48a-77f1-400e-9764-b0813ff3ef8c tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:47:16.559100 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b0f9d48a-77f1-400e-9764-b0813ff3ef8c tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:47:16.621339 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-b0f9d48a-77f1-400e-9764-b0813ff3ef8c tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "POST /compute/v2.1/servers/fb5b6e20-bd92-4b53-bed6-4e747e8c84ca/action" status: 204 len: 0 microversion: 2.1 time: 0.076164 Oct 08 21:47:16.622028 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3309/6545] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:47:16 2022] POST /compute/v2.1/servers/fb5b6e20-bd92-4b53-bed6-4e747e8c84ca/action => generated 0 bytes in 78 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 21:47:16.631303 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-ebc8ebf0-ff29-493c-9822-9a2c3b949f80 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:47:16.631930 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-ebc8ebf0-ff29-493c-9822-9a2c3b949f80 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: fb5b6e20-bd92-4b53-bed6-4e747e8c84ca] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:47:16.641845 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ebc8ebf0-ff29-493c-9822-9a2c3b949f80 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:47:16.643823 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ebc8ebf0-ff29-493c-9822-9a2c3b949f80 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:47:16.645282 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ebc8ebf0-ff29-493c-9822-9a2c3b949f80 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:47:16.646031 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ebc8ebf0-ff29-493c-9822-9a2c3b949f80 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:47:16.647783 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ebc8ebf0-ff29-493c-9822-9a2c3b949f80 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:47:16.648313 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ebc8ebf0-ff29-493c-9822-9a2c3b949f80 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:47:16.873669 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-ebc8ebf0-ff29-493c-9822-9a2c3b949f80 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e838176b44c4f23b470cfc152f79990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3718dd3e536649b5bf1970ff06ddea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:47:16.882038 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-ebc8ebf0-ff29-493c-9822-9a2c3b949f80 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/fb5b6e20-bd92-4b53-bed6-4e747e8c84ca" status: 200 len: 1676 microversion: 2.1 time: 0.255837 Oct 08 21:47:16.882618 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3237/6546] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:47:16 2022] GET /compute/v2.1/servers/fb5b6e20-bd92-4b53-bed6-4e747e8c84ca => generated 1676 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:47:17.907197 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-20cbbfdd-3415-4766-8c07-6df058755947 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:47:17.908102 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-20cbbfdd-3415-4766-8c07-6df058755947 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: fb5b6e20-bd92-4b53-bed6-4e747e8c84ca] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:47:17.916503 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-20cbbfdd-3415-4766-8c07-6df058755947 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:47:17.917314 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-20cbbfdd-3415-4766-8c07-6df058755947 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:47:17.917784 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-20cbbfdd-3415-4766-8c07-6df058755947 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:47:17.918519 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-20cbbfdd-3415-4766-8c07-6df058755947 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:47:17.919262 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-20cbbfdd-3415-4766-8c07-6df058755947 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:47:17.919720 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-20cbbfdd-3415-4766-8c07-6df058755947 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:47:18.167849 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-20cbbfdd-3415-4766-8c07-6df058755947 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e838176b44c4f23b470cfc152f79990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3718dd3e536649b5bf1970ff06ddea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:47:18.175948 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-20cbbfdd-3415-4766-8c07-6df058755947 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/fb5b6e20-bd92-4b53-bed6-4e747e8c84ca" status: 200 len: 1676 microversion: 2.1 time: 0.272981 Oct 08 21:47:18.176552 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3310/6547] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:47:17 2022] GET /compute/v2.1/servers/fb5b6e20-bd92-4b53-bed6-4e747e8c84ca => generated 1676 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:47:19.200230 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-088dbd53-2369-4925-8981-9eb22c27d704 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:47:19.200852 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-088dbd53-2369-4925-8981-9eb22c27d704 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: fb5b6e20-bd92-4b53-bed6-4e747e8c84ca] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:47:19.209303 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-088dbd53-2369-4925-8981-9eb22c27d704 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:47:19.209816 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-088dbd53-2369-4925-8981-9eb22c27d704 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:47:19.210267 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-088dbd53-2369-4925-8981-9eb22c27d704 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:47:19.210980 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-088dbd53-2369-4925-8981-9eb22c27d704 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:47:19.211444 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-088dbd53-2369-4925-8981-9eb22c27d704 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:47:19.215354 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-088dbd53-2369-4925-8981-9eb22c27d704 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:47:19.344585 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-9f4e1db8-5860-4cdd-99a7-72e4d3af5943 req-2936888f-c128-4d19-a61d-b1b4e22b6a95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb5b6e20-bd92-4b53-bed6-4e747e8c84ca", "name": "network-vif-plugged", "status": "completed", "tag": "1231878f-b2f2-4e5a-974f-7f22d86c8c69"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:47:19.353690 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-088dbd53-2369-4925-8981-9eb22c27d704 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e838176b44c4f23b470cfc152f79990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3718dd3e536649b5bf1970ff06ddea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:47:19.354539 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-9f4e1db8-5860-4cdd-99a7-72e4d3af5943 req-2936888f-c128-4d19-a61d-b1b4e22b6a95 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:47:19.355054 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-9f4e1db8-5860-4cdd-99a7-72e4d3af5943 req-2936888f-c128-4d19-a61d-b1b4e22b6a95 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:47:19.355509 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-9f4e1db8-5860-4cdd-99a7-72e4d3af5943 req-2936888f-c128-4d19-a61d-b1b4e22b6a95 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:47:19.361538 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-088dbd53-2369-4925-8981-9eb22c27d704 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/fb5b6e20-bd92-4b53-bed6-4e747e8c84ca" status: 200 len: 1655 microversion: 2.1 time: 0.165258 Oct 08 21:47:19.363023 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3238/6548] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:47:19 2022] GET /compute/v2.1/servers/fb5b6e20-bd92-4b53-bed6-4e747e8c84ca => generated 1655 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:47:19.367552 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-9f4e1db8-5860-4cdd-99a7-72e4d3af5943 req-2936888f-c128-4d19-a61d-b1b4e22b6a95 service nova] Creating event network-vif-plugged:1231878f-b2f2-4e5a-974f-7f22d86c8c69 for instance fb5b6e20-bd92-4b53-bed6-4e747e8c84ca on nch2-master-1 Oct 08 21:47:19.372551 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-9f4e1db8-5860-4cdd-99a7-72e4d3af5943 req-2936888f-c128-4d19-a61d-b1b4e22b6a95 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100473 Oct 08 21:47:19.373141 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3311/6549] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:47:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 08 21:47:19.384352 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-94666575-d01d-4dd7-94d5-af28d15a0010 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:47:19.384973 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-94666575-d01d-4dd7-94d5-af28d15a0010 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: fb5b6e20-bd92-4b53-bed6-4e747e8c84ca] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:47:19.390981 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-94666575-d01d-4dd7-94d5-af28d15a0010 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:47:19.391501 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-94666575-d01d-4dd7-94d5-af28d15a0010 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:47:19.391947 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-94666575-d01d-4dd7-94d5-af28d15a0010 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:47:19.392651 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-94666575-d01d-4dd7-94d5-af28d15a0010 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:47:19.393740 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-94666575-d01d-4dd7-94d5-af28d15a0010 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:47:19.394177 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-94666575-d01d-4dd7-94d5-af28d15a0010 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:47:19.522715 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-94666575-d01d-4dd7-94d5-af28d15a0010 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e838176b44c4f23b470cfc152f79990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3718dd3e536649b5bf1970ff06ddea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:47:19.530638 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-94666575-d01d-4dd7-94d5-af28d15a0010 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/fb5b6e20-bd92-4b53-bed6-4e747e8c84ca" status: 200 len: 1655 microversion: 2.1 time: 0.149991 Oct 08 21:47:19.531222 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3239/6550] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:47:19 2022] GET /compute/v2.1/servers/fb5b6e20-bd92-4b53-bed6-4e747e8c84ca => generated 1655 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:47:19.554209 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-04a4cd36-9f9b-4e0c-b44d-136b18b203ee tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:47:19.560537 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-04a4cd36-9f9b-4e0c-b44d-136b18b203ee tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:47:19.561043 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-04a4cd36-9f9b-4e0c-b44d-136b18b203ee tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:47:19.561532 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-04a4cd36-9f9b-4e0c-b44d-136b18b203ee tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:47:19.584143 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-04a4cd36-9f9b-4e0c-b44d-136b18b203ee tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: fb5b6e20-bd92-4b53-bed6-4e747e8c84ca] Going to try to start instance {{(pid=140492) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 08 21:47:19.625602 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-04a4cd36-9f9b-4e0c-b44d-136b18b203ee tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "POST /compute/v2.1/servers/fb5b6e20-bd92-4b53-bed6-4e747e8c84ca/action" status: 202 len: 0 microversion: 2.1 time: 0.075412 Oct 08 21:47:19.626147 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3312/6551] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:47:19 2022] POST /compute/v2.1/servers/fb5b6e20-bd92-4b53-bed6-4e747e8c84ca/action => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 21:47:19.634221 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-6750653e-42b4-4d59-b1a9-36feef2c38c6 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:47:19.634837 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-6750653e-42b4-4d59-b1a9-36feef2c38c6 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: fb5b6e20-bd92-4b53-bed6-4e747e8c84ca] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:47:19.640918 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6750653e-42b4-4d59-b1a9-36feef2c38c6 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:47:19.641493 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6750653e-42b4-4d59-b1a9-36feef2c38c6 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:47:19.642012 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6750653e-42b4-4d59-b1a9-36feef2c38c6 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:47:19.642714 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6750653e-42b4-4d59-b1a9-36feef2c38c6 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:47:19.643754 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6750653e-42b4-4d59-b1a9-36feef2c38c6 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:47:19.644206 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6750653e-42b4-4d59-b1a9-36feef2c38c6 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:47:19.785219 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-6750653e-42b4-4d59-b1a9-36feef2c38c6 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e838176b44c4f23b470cfc152f79990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3718dd3e536649b5bf1970ff06ddea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:47:19.793523 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-6750653e-42b4-4d59-b1a9-36feef2c38c6 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/fb5b6e20-bd92-4b53-bed6-4e747e8c84ca" status: 200 len: 1664 microversion: 2.1 time: 0.163026 Oct 08 21:47:19.794125 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3240/6552] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:47:19 2022] GET /compute/v2.1/servers/fb5b6e20-bd92-4b53-bed6-4e747e8c84ca => generated 1664 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:47:20.819239 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-9bfe6b0d-a442-440f-9b39-7eb3d3102f31 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:47:20.819875 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-9bfe6b0d-a442-440f-9b39-7eb3d3102f31 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: fb5b6e20-bd92-4b53-bed6-4e747e8c84ca] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:47:20.826394 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9bfe6b0d-a442-440f-9b39-7eb3d3102f31 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:47:20.826906 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9bfe6b0d-a442-440f-9b39-7eb3d3102f31 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:47:20.827366 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9bfe6b0d-a442-440f-9b39-7eb3d3102f31 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:47:20.828088 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9bfe6b0d-a442-440f-9b39-7eb3d3102f31 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:47:20.828559 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9bfe6b0d-a442-440f-9b39-7eb3d3102f31 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:47:20.829006 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9bfe6b0d-a442-440f-9b39-7eb3d3102f31 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:47:20.831965 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:47:20.960917 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-9bfe6b0d-a442-440f-9b39-7eb3d3102f31 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e838176b44c4f23b470cfc152f79990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3718dd3e536649b5bf1970ff06ddea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:47:20.969140 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-9bfe6b0d-a442-440f-9b39-7eb3d3102f31 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/fb5b6e20-bd92-4b53-bed6-4e747e8c84ca" status: 200 len: 1668 microversion: 2.1 time: 0.156034 Oct 08 21:47:20.969735 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3313/6553] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:47:20 2022] GET /compute/v2.1/servers/fb5b6e20-bd92-4b53-bed6-4e747e8c84ca => generated 1668 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:47:20.991666 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-233b3905-0154-45a2-aeb3-303e415d90d1 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:47:20.992165 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-233b3905-0154-45a2-aeb3-303e415d90d1 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: fb5b6e20-bd92-4b53-bed6-4e747e8c84ca] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:47:20.999074 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-233b3905-0154-45a2-aeb3-303e415d90d1 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:47:20.999562 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-233b3905-0154-45a2-aeb3-303e415d90d1 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:47:21.000000 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-233b3905-0154-45a2-aeb3-303e415d90d1 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:47:21.000695 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-233b3905-0154-45a2-aeb3-303e415d90d1 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:47:21.001154 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-233b3905-0154-45a2-aeb3-303e415d90d1 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:47:21.001638 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-233b3905-0154-45a2-aeb3-303e415d90d1 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:47:21.027188 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-233b3905-0154-45a2-aeb3-303e415d90d1 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: fb5b6e20-bd92-4b53-bed6-4e747e8c84ca] Going to try to terminate instance {{(pid=140491) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 21:47:21.029962 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:47:21.102500 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-233b3905-0154-45a2-aeb3-303e415d90d1 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "DELETE /compute/v2.1/servers/fb5b6e20-bd92-4b53-bed6-4e747e8c84ca" status: 204 len: 0 microversion: 2.1 time: 0.114242 Oct 08 21:47:21.103057 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3241/6554] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:47:20 2022] DELETE /compute/v2.1/servers/fb5b6e20-bd92-4b53-bed6-4e747e8c84ca => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 21:47:21.111691 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-afdfee8b-362e-41f7-b917-95d80ad15b3e tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:47:21.112864 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-afdfee8b-362e-41f7-b917-95d80ad15b3e tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: fb5b6e20-bd92-4b53-bed6-4e747e8c84ca] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:47:21.119123 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-afdfee8b-362e-41f7-b917-95d80ad15b3e tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:47:21.119628 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-afdfee8b-362e-41f7-b917-95d80ad15b3e tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:47:21.120096 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-afdfee8b-362e-41f7-b917-95d80ad15b3e tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:47:21.120820 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-afdfee8b-362e-41f7-b917-95d80ad15b3e tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:47:21.121359 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-afdfee8b-362e-41f7-b917-95d80ad15b3e tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:47:21.121813 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-afdfee8b-362e-41f7-b917-95d80ad15b3e tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:47:21.258623 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-afdfee8b-362e-41f7-b917-95d80ad15b3e tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e838176b44c4f23b470cfc152f79990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3718dd3e536649b5bf1970ff06ddea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:47:21.266575 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-afdfee8b-362e-41f7-b917-95d80ad15b3e tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/fb5b6e20-bd92-4b53-bed6-4e747e8c84ca" status: 200 len: 1674 microversion: 2.1 time: 0.158985 Oct 08 21:47:21.267151 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3314/6555] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:47:21 2022] GET /compute/v2.1/servers/fb5b6e20-bd92-4b53-bed6-4e747e8c84ca => generated 1674 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:47:22.290378 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-6627f24f-d50d-4419-8a89-b42fd1181be8 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:47:22.291088 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-6627f24f-d50d-4419-8a89-b42fd1181be8 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: fb5b6e20-bd92-4b53-bed6-4e747e8c84ca] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:47:22.298044 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6627f24f-d50d-4419-8a89-b42fd1181be8 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:47:22.298540 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6627f24f-d50d-4419-8a89-b42fd1181be8 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:47:22.298992 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6627f24f-d50d-4419-8a89-b42fd1181be8 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:47:22.300239 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6627f24f-d50d-4419-8a89-b42fd1181be8 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:47:22.300708 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6627f24f-d50d-4419-8a89-b42fd1181be8 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:47:22.301142 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6627f24f-d50d-4419-8a89-b42fd1181be8 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:47:22.433502 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-6627f24f-d50d-4419-8a89-b42fd1181be8 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e838176b44c4f23b470cfc152f79990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3718dd3e536649b5bf1970ff06ddea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:47:22.442462 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-6627f24f-d50d-4419-8a89-b42fd1181be8 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/fb5b6e20-bd92-4b53-bed6-4e747e8c84ca" status: 200 len: 1674 microversion: 2.1 time: 0.156367 Oct 08 21:47:22.443434 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3242/6556] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:47:22 2022] GET /compute/v2.1/servers/fb5b6e20-bd92-4b53-bed6-4e747e8c84ca => generated 1674 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:47:23.465429 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-6db9d213-4765-42f0-b008-0e508dbf0464 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:47:23.466072 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-6db9d213-4765-42f0-b008-0e508dbf0464 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: fb5b6e20-bd92-4b53-bed6-4e747e8c84ca] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:47:23.475253 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6db9d213-4765-42f0-b008-0e508dbf0464 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:47:23.475775 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6db9d213-4765-42f0-b008-0e508dbf0464 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:47:23.476236 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6db9d213-4765-42f0-b008-0e508dbf0464 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:47:23.477294 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6db9d213-4765-42f0-b008-0e508dbf0464 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:47:23.477778 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6db9d213-4765-42f0-b008-0e508dbf0464 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:47:23.480915 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6db9d213-4765-42f0-b008-0e508dbf0464 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:47:23.532159 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-342837d9-0fd8-42a2-af48-4daf5ab4c6cd req-ec2956e2-16ac-48e3-82cc-28fb59631ad2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb5b6e20-bd92-4b53-bed6-4e747e8c84ca", "name": "network-vif-deleted", "tag": "1231878f-b2f2-4e5a-974f-7f22d86c8c69"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:47:23.543282 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-342837d9-0fd8-42a2-af48-4daf5ab4c6cd req-ec2956e2-16ac-48e3-82cc-28fb59631ad2 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:47:23.544021 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-342837d9-0fd8-42a2-af48-4daf5ab4c6cd req-ec2956e2-16ac-48e3-82cc-28fb59631ad2 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:47:23.545623 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-342837d9-0fd8-42a2-af48-4daf5ab4c6cd req-ec2956e2-16ac-48e3-82cc-28fb59631ad2 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:47:23.560058 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-342837d9-0fd8-42a2-af48-4daf5ab4c6cd req-ec2956e2-16ac-48e3-82cc-28fb59631ad2 service nova] Creating event network-vif-deleted:1231878f-b2f2-4e5a-974f-7f22d86c8c69 for instance fb5b6e20-bd92-4b53-bed6-4e747e8c84ca on nch2-master-1 Oct 08 21:47:23.566083 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-342837d9-0fd8-42a2-af48-4daf5ab4c6cd req-ec2956e2-16ac-48e3-82cc-28fb59631ad2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056751 Oct 08 21:47:23.567052 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3243/6557] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:47:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 08 21:47:23.595571 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-6db9d213-4765-42f0-b008-0e508dbf0464 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e838176b44c4f23b470cfc152f79990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3718dd3e536649b5bf1970ff06ddea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:47:23.612660 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-6db9d213-4765-42f0-b008-0e508dbf0464 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/fb5b6e20-bd92-4b53-bed6-4e747e8c84ca" status: 200 len: 1606 microversion: 2.1 time: 0.150028 Oct 08 21:47:23.613483 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3315/6558] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:47:23 2022] GET /compute/v2.1/servers/fb5b6e20-bd92-4b53-bed6-4e747e8c84ca => generated 1606 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:47:24.637709 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-e33cadce-324f-4c7b-a0e2-32a4987fe28f tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:47:24.638338 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-e33cadce-324f-4c7b-a0e2-32a4987fe28f tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: fb5b6e20-bd92-4b53-bed6-4e747e8c84ca] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:47:24.645160 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e33cadce-324f-4c7b-a0e2-32a4987fe28f tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:47:24.645673 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e33cadce-324f-4c7b-a0e2-32a4987fe28f tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:47:24.646116 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e33cadce-324f-4c7b-a0e2-32a4987fe28f tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:47:24.646815 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e33cadce-324f-4c7b-a0e2-32a4987fe28f tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:47:24.647315 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e33cadce-324f-4c7b-a0e2-32a4987fe28f tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:47:24.647747 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e33cadce-324f-4c7b-a0e2-32a4987fe28f tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:47:24.661774 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-e33cadce-324f-4c7b-a0e2-32a4987fe28f tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] HTTP exception thrown: Instance fb5b6e20-bd92-4b53-bed6-4e747e8c84ca could not be found. Oct 08 21:47:24.663392 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-e33cadce-324f-4c7b-a0e2-32a4987fe28f tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Request method failure captured: Oct 08 21:47:24.663392 ncdv-master-1 devstack@n-api.service[140491]: request: GET /compute/v2.1/servers/fb5b6e20-bd92-4b53-bed6-4e747e8c84ca HTTP/1.1 Oct 08 21:47:24.663392 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:47:24.663392 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:47:24.663392 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:47:24.663392 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 21:47:24.663392 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:47:24.663392 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:47:24.663392 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:47:24.663392 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:47:24.663392 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQe9X_YMmNKk_IiLIrhiybTebPLsigD2oA9w_czixVt5baNHq-v99rHVO91kLbytmMA9O9LoejjDppyvtcuO0H46ugJTY6ixLOqtY6uw1GAjA-8XlGpO40NZ8LLPXXTy7eheVZj7WNy7D46LDg2xb5lZmDKadBVs_1JcZ4-Tt9c91XNk Oct 08 21:47:24.663392 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:47:24.663392 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:47:24.663392 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:47:24.663392 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:47:24.663392 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:47:24.663392 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:47:24.663392 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 3718dd3e536649b5bf1970ff06ddea69 Oct 08 21:47:24.663392 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-ServerActionsTestJSON-775805645 Oct 08 21:47:24.663392 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:47:24.663392 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:47:24.663392 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3718dd3e536649b5bf1970ff06ddea69"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3718dd3e536649b5bf1970ff06ddea69"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3718dd3e536649b5bf1970ff06ddea69"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3718dd3e536649b5bf1970ff06ddea69"}]}] Oct 08 21:47:24.663392 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-ServerActionsTestJSON-775805645 Oct 08 21:47:24.663392 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 3718dd3e536649b5bf1970ff06ddea69 Oct 08 21:47:24.663392 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-ServerActionsTestJSON-775805645 Oct 08 21:47:24.663392 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-ServerActionsTestJSON-775805645-project Oct 08 21:47:24.663392 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:47:24.663392 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:47:24.663392 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 5e838176b44c4f23b470cfc152f79990 Oct 08 21:47:24.663392 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-ServerActionsTestJSON-775805645-project Oct 08 21:47:24.663392 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:47:24.663392 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance fb5b6e20-bd92-4b53-bed6-4e747e8c84ca could not be found. Oct 08 21:47:24.663392 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': 'fb5b6e20-bd92-4b53-bed6-4e747e8c84ca'} Oct 08 21:47:24.663392 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:47:24.663392 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:47:24.663392 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:47:24.663392 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:47:24.663392 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:47:24.663392 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:47:24.663392 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:47:24.663392 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:47:24.663392 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:47:24.663392 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:47:24.663392 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb5b6e20-bd92-4b53-bed6-4e747e8c84ca could not be found. Oct 08 21:47:24.663392 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:47:24.663392 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:47:24.663392 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:47:24.663392 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:47:24.663392 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:47:24.663392 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:47:24.663392 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:47:24.663392 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:47:24.663392 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:47:24.663392 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:47:24.663392 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:47:24.663392 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:47:24.663392 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:47:24.663392 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:47:24.663392 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:47:24.663392 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:47:24.663392 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb5b6e20-bd92-4b53-bed6-4e747e8c84ca could not be found. Oct 08 21:47:24.663392 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:47:24.663392 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:47:24.663392 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:47:24.668447 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:47:24.668447 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:47:24.668447 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:47:24.668447 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:47:24.668447 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:47:24.668447 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb5b6e20-bd92-4b53-bed6-4e747e8c84ca could not be found. Oct 08 21:47:24.668447 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:47:24.668447 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-e33cadce-324f-4c7b-a0e2-32a4987fe28f tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Returning 404 to user: Instance fb5b6e20-bd92-4b53-bed6-4e747e8c84ca could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:47:24.668447 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-e33cadce-324f-4c7b-a0e2-32a4987fe28f tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/fb5b6e20-bd92-4b53-bed6-4e747e8c84ca" status: 404 len: 111 microversion: 2.1 time: 0.032338 Oct 08 21:47:24.668447 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3244/6559] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:47:24 2022] GET /compute/v2.1/servers/fb5b6e20-bd92-4b53-bed6-4e747e8c84ca => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:47:24.680382 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-13249f4b-637e-4543-8c13-1e2cb04cdce2 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:47:24.681017 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-13249f4b-637e-4543-8c13-1e2cb04cdce2 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: fb5b6e20-bd92-4b53-bed6-4e747e8c84ca] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:47:24.688012 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-13249f4b-637e-4543-8c13-1e2cb04cdce2 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:47:24.688518 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-13249f4b-637e-4543-8c13-1e2cb04cdce2 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:47:24.688978 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-13249f4b-637e-4543-8c13-1e2cb04cdce2 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:47:24.689722 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-13249f4b-637e-4543-8c13-1e2cb04cdce2 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:47:24.690221 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-13249f4b-637e-4543-8c13-1e2cb04cdce2 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:47:24.690668 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-13249f4b-637e-4543-8c13-1e2cb04cdce2 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:47:24.704202 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-13249f4b-637e-4543-8c13-1e2cb04cdce2 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] HTTP exception thrown: Instance fb5b6e20-bd92-4b53-bed6-4e747e8c84ca could not be found. Oct 08 21:47:24.706409 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-13249f4b-637e-4543-8c13-1e2cb04cdce2 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Request method failure captured: Oct 08 21:47:24.706409 ncdv-master-1 devstack@n-api.service[140492]: request: GET /compute/v2.1/servers/fb5b6e20-bd92-4b53-bed6-4e747e8c84ca HTTP/1.1 Oct 08 21:47:24.706409 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:47:24.706409 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:47:24.706409 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:47:24.706409 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 21:47:24.706409 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:47:24.706409 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:47:24.706409 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:47:24.706409 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:47:24.706409 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQe9X_YMmNKk_IiLIrhiybTebPLsigD2oA9w_czixVt5baNHq-v99rHVO91kLbytmMA9O9LoejjDppyvtcuO0H46ugJTY6ixLOqtY6uw1GAjA-8XlGpO40NZ8LLPXXTy7eheVZj7WNy7D46LDg2xb5lZmDKadBVs_1JcZ4-Tt9c91XNk Oct 08 21:47:24.706409 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:47:24.706409 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:47:24.706409 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:47:24.706409 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:47:24.706409 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:47:24.706409 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:47:24.706409 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 3718dd3e536649b5bf1970ff06ddea69 Oct 08 21:47:24.706409 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-ServerActionsTestJSON-775805645 Oct 08 21:47:24.706409 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:47:24.706409 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:47:24.706409 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3718dd3e536649b5bf1970ff06ddea69"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3718dd3e536649b5bf1970ff06ddea69"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3718dd3e536649b5bf1970ff06ddea69"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3718dd3e536649b5bf1970ff06ddea69"}]}] Oct 08 21:47:24.706409 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-ServerActionsTestJSON-775805645 Oct 08 21:47:24.706409 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 3718dd3e536649b5bf1970ff06ddea69 Oct 08 21:47:24.706409 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-ServerActionsTestJSON-775805645 Oct 08 21:47:24.706409 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-ServerActionsTestJSON-775805645-project Oct 08 21:47:24.706409 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:47:24.706409 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:47:24.706409 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 5e838176b44c4f23b470cfc152f79990 Oct 08 21:47:24.706409 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-ServerActionsTestJSON-775805645-project Oct 08 21:47:24.706409 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 21:47:24.706409 ncdv-master-1 devstack@n-api.service[140492]: exception: Instance fb5b6e20-bd92-4b53-bed6-4e747e8c84ca could not be found. Oct 08 21:47:24.706409 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': 'fb5b6e20-bd92-4b53-bed6-4e747e8c84ca'} Oct 08 21:47:24.706409 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:47:24.706409 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:47:24.706409 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:47:24.706409 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:47:24.706409 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:47:24.706409 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:47:24.706409 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:47:24.706409 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:47:24.706409 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:47:24.706409 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:47:24.706409 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb5b6e20-bd92-4b53-bed6-4e747e8c84ca could not be found. Oct 08 21:47:24.706409 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:47:24.706409 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:47:24.706409 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:47:24.706409 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:47:24.706409 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:47:24.706409 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:47:24.706409 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:47:24.706409 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:47:24.706409 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:47:24.706409 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:47:24.706409 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:47:24.706409 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:47:24.706409 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:47:24.706409 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:47:24.706409 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:47:24.706409 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:47:24.706409 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb5b6e20-bd92-4b53-bed6-4e747e8c84ca could not be found. Oct 08 21:47:24.706409 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:47:24.706409 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:47:24.706409 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:47:24.711179 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:47:24.711179 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:47:24.711179 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:47:24.711179 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:47:24.711179 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:47:24.711179 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb5b6e20-bd92-4b53-bed6-4e747e8c84ca could not be found. Oct 08 21:47:24.711179 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:47:24.711179 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-13249f4b-637e-4543-8c13-1e2cb04cdce2 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Returning 404 to user: Instance fb5b6e20-bd92-4b53-bed6-4e747e8c84ca could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:47:24.711179 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-13249f4b-637e-4543-8c13-1e2cb04cdce2 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/fb5b6e20-bd92-4b53-bed6-4e747e8c84ca" status: 404 len: 111 microversion: 2.1 time: 0.031420 Oct 08 21:47:24.711179 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3316/6560] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:47:24 2022] GET /compute/v2.1/servers/fb5b6e20-bd92-4b53-bed6-4e747e8c84ca => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:47:24.755435 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-ac871980-e8f6-4605-ba86-c642c05ae399 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-203396", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "networks": [{"uuid": "99fc871d-a990-4798-830c-471348036e9e"}], "security_groups": [{"name": "tempest-securitygroup--1818474219"}], "key_name": "tempest-keypair-1142039836", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:47:24.861465 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.network.neutron [None req-ac871980-e8f6-4605-ba86-c642c05ae399 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] validate_networks() for [('99fc871d-a990-4798-830c-471348036e9e', None, None, None, None, None)] {{(pid=140491) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 21:47:25.521501 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-ac871980-e8f6-4605-ba86-c642c05ae399 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Flavor limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 21:47:25.521958 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-ac871980-e8f6-4605-ba86-c642c05ae399 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Image limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 21:47:25.522438 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-ac871980-e8f6-4605-ba86-c642c05ae399 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Flavor pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 21:47:25.522852 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-ac871980-e8f6-4605-ba86-c642c05ae399 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Image pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 21:47:25.523303 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-ac871980-e8f6-4605-ba86-c642c05ae399 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 21:47:25.532252 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ac871980-e8f6-4605-ba86-c642c05ae399 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:47:25.532739 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ac871980-e8f6-4605-ba86-c642c05ae399 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:47:25.533202 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ac871980-e8f6-4605-ba86-c642c05ae399 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:47:25.534022 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ac871980-e8f6-4605-ba86-c642c05ae399 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:47:25.534484 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ac871980-e8f6-4605-ba86-c642c05ae399 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:47:25.534917 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ac871980-e8f6-4605-ba86-c642c05ae399 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:47:25.552144 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-ac871980-e8f6-4605-ba86-c642c05ae399 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Getting quotas for project 3718dd3e536649b5bf1970ff06ddea69. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:47:25.557461 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-ac871980-e8f6-4605-ba86-c642c05ae399 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Getting quotas for user 5e838176b44c4f23b470cfc152f79990 and project 3718dd3e536649b5bf1970ff06ddea69. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:47:25.570744 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-ac871980-e8f6-4605-ba86-c642c05ae399 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Going to run 1 instances... {{(pid=140491) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 21:47:25.573041 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-ac871980-e8f6-4605-ba86-c642c05ae399 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: 521af341-8ec9-4dc5-901f-68a80a167d46] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c508bd7f-7db9-4b2c-af7c-be54a855c355',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140491) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 21:47:25.620513 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-ac871980-e8f6-4605-ba86-c642c05ae399 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.868916 Oct 08 21:47:25.621160 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3245/6561] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 21:47:24 2022] POST /compute/v2.1/servers => generated 406 bytes in 870 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 08 21:47:25.632584 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-7b492d42-0ec2-4125-ba06-951ff4efeed4 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:47:25.633251 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-7b492d42-0ec2-4125-ba06-951ff4efeed4 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: 521af341-8ec9-4dc5-901f-68a80a167d46] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:47:25.685945 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-7b492d42-0ec2-4125-ba06-951ff4efeed4 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e838176b44c4f23b470cfc152f79990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3718dd3e536649b5bf1970ff06ddea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:47:25.699333 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-7b492d42-0ec2-4125-ba06-951ff4efeed4 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/521af341-8ec9-4dc5-901f-68a80a167d46" status: 200 len: 1235 microversion: 2.1 time: 0.070636 Oct 08 21:47:25.699936 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3317/6562] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:47:25 2022] GET /compute/v2.1/servers/521af341-8ec9-4dc5-901f-68a80a167d46 => generated 1235 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:47:26.723849 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-7eaea20f-788a-42a0-9b9c-b94c430df357 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:47:26.724497 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-7eaea20f-788a-42a0-9b9c-b94c430df357 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: 521af341-8ec9-4dc5-901f-68a80a167d46] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:47:26.731491 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7eaea20f-788a-42a0-9b9c-b94c430df357 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:47:26.731992 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7eaea20f-788a-42a0-9b9c-b94c430df357 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:47:26.732461 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7eaea20f-788a-42a0-9b9c-b94c430df357 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:47:26.733205 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7eaea20f-788a-42a0-9b9c-b94c430df357 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:47:26.733679 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7eaea20f-788a-42a0-9b9c-b94c430df357 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:47:26.734119 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7eaea20f-788a-42a0-9b9c-b94c430df357 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:47:26.795638 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-7eaea20f-788a-42a0-9b9c-b94c430df357 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e838176b44c4f23b470cfc152f79990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3718dd3e536649b5bf1970ff06ddea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:47:26.804252 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-7eaea20f-788a-42a0-9b9c-b94c430df357 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/521af341-8ec9-4dc5-901f-68a80a167d46" status: 200 len: 1287 microversion: 2.1 time: 0.085355 Oct 08 21:47:26.804846 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3246/6563] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:47:26 2022] GET /compute/v2.1/servers/521af341-8ec9-4dc5-901f-68a80a167d46 => generated 1287 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:47:27.828091 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-9d3e7524-6516-4451-8f1e-308234f3a4db tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:47:27.828652 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-9d3e7524-6516-4451-8f1e-308234f3a4db tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: 521af341-8ec9-4dc5-901f-68a80a167d46] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:47:27.837241 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9d3e7524-6516-4451-8f1e-308234f3a4db tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:47:27.837802 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9d3e7524-6516-4451-8f1e-308234f3a4db tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:47:27.838513 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9d3e7524-6516-4451-8f1e-308234f3a4db tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:47:27.839806 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9d3e7524-6516-4451-8f1e-308234f3a4db tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:47:27.840388 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9d3e7524-6516-4451-8f1e-308234f3a4db tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:47:27.842360 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9d3e7524-6516-4451-8f1e-308234f3a4db tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:47:27.980236 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-9d3e7524-6516-4451-8f1e-308234f3a4db tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e838176b44c4f23b470cfc152f79990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3718dd3e536649b5bf1970ff06ddea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:47:27.988189 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-9d3e7524-6516-4451-8f1e-308234f3a4db tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/521af341-8ec9-4dc5-901f-68a80a167d46" status: 200 len: 1361 microversion: 2.1 time: 0.164113 Oct 08 21:47:27.988771 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3318/6564] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:47:27 2022] GET /compute/v2.1/servers/521af341-8ec9-4dc5-901f-68a80a167d46 => generated 1361 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:47:28.308327 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-70735201-1226-4852-b725-5da34c435af6 req-48ce70e1-c53e-46cd-a549-9969c6209a1f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "521af341-8ec9-4dc5-901f-68a80a167d46", "tag": "4b829301-69ef-4c13-a79b-a380d89ef693"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:47:28.319116 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:47:28.327898 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-70735201-1226-4852-b725-5da34c435af6 req-48ce70e1-c53e-46cd-a549-9969c6209a1f service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:47:28.328631 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-70735201-1226-4852-b725-5da34c435af6 req-48ce70e1-c53e-46cd-a549-9969c6209a1f service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:47:28.329221 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-70735201-1226-4852-b725-5da34c435af6 req-48ce70e1-c53e-46cd-a549-9969c6209a1f service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:47:28.342985 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-70735201-1226-4852-b725-5da34c435af6 req-48ce70e1-c53e-46cd-a549-9969c6209a1f service nova] Creating event network-changed:4b829301-69ef-4c13-a79b-a380d89ef693 for instance 521af341-8ec9-4dc5-901f-68a80a167d46 on nch1-master-1 Oct 08 21:47:28.349473 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-70735201-1226-4852-b725-5da34c435af6 req-48ce70e1-c53e-46cd-a549-9969c6209a1f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045825 Oct 08 21:47:28.350428 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3247/6565] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:47:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:47:29.011493 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-743302b8-a35e-45fe-8c6b-6669c53876f1 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:47:29.012106 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-743302b8-a35e-45fe-8c6b-6669c53876f1 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: 521af341-8ec9-4dc5-901f-68a80a167d46] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:47:29.014888 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=47 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:47:29.021145 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-743302b8-a35e-45fe-8c6b-6669c53876f1 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:47:29.021684 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-743302b8-a35e-45fe-8c6b-6669c53876f1 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:47:29.022145 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-743302b8-a35e-45fe-8c6b-6669c53876f1 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:47:29.022866 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-743302b8-a35e-45fe-8c6b-6669c53876f1 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:47:29.023344 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-743302b8-a35e-45fe-8c6b-6669c53876f1 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:47:29.023790 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-743302b8-a35e-45fe-8c6b-6669c53876f1 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:47:29.151574 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-743302b8-a35e-45fe-8c6b-6669c53876f1 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e838176b44c4f23b470cfc152f79990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3718dd3e536649b5bf1970ff06ddea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:47:29.159469 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-743302b8-a35e-45fe-8c6b-6669c53876f1 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/521af341-8ec9-4dc5-901f-68a80a167d46" status: 200 len: 1361 microversion: 2.1 time: 0.151912 Oct 08 21:47:29.160039 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3319/6566] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:47:29 2022] GET /compute/v2.1/servers/521af341-8ec9-4dc5-901f-68a80a167d46 => generated 1361 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:47:30.181845 ncdv-master-1 devstack@n-api.service[140491]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 08 21:47:30.182384 ncdv-master-1 devstack@n-api.service[140491]: Sat Oct 8 21:47:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/521af341-8ec9-4dc5-901f-68a80a167d46 (ip 10.222.0.26) !!! Oct 08 21:47:30.186387 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-d92ae21f-6959-4648-8ee0-1784af152c10 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:47:30.187336 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-d92ae21f-6959-4648-8ee0-1784af152c10 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: 521af341-8ec9-4dc5-901f-68a80a167d46] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:47:30.196015 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d92ae21f-6959-4648-8ee0-1784af152c10 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:47:30.196513 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d92ae21f-6959-4648-8ee0-1784af152c10 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:47:30.197016 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d92ae21f-6959-4648-8ee0-1784af152c10 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:47:30.197774 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d92ae21f-6959-4648-8ee0-1784af152c10 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:47:30.198238 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d92ae21f-6959-4648-8ee0-1784af152c10 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:47:30.198677 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d92ae21f-6959-4648-8ee0-1784af152c10 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:47:30.340224 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-d92ae21f-6959-4648-8ee0-1784af152c10 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e838176b44c4f23b470cfc152f79990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3718dd3e536649b5bf1970ff06ddea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:47:30.349019 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-d92ae21f-6959-4648-8ee0-1784af152c10 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/521af341-8ec9-4dc5-901f-68a80a167d46" status: 200 len: 1361 microversion: 2.1 time: 0.169511 Oct 08 21:47:30.349640 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3248/6567] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:47:30 2022] GET /compute/v2.1/servers/521af341-8ec9-4dc5-901f-68a80a167d46 => generated 1361 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:47:31.372985 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-1c1a6685-f417-416d-b638-14097df5ebe5 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:47:31.373642 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-1c1a6685-f417-416d-b638-14097df5ebe5 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: 521af341-8ec9-4dc5-901f-68a80a167d46] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:47:31.376858 ncdv-master-1 devstack@n-api.service[140492]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 08 21:47:31.377001 ncdv-master-1 devstack@n-api.service[140492]: Sat Oct 8 21:47:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/521af341-8ec9-4dc5-901f-68a80a167d46 (ip 10.222.0.26) !!! Oct 08 21:47:31.384292 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1c1a6685-f417-416d-b638-14097df5ebe5 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:47:31.384795 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1c1a6685-f417-416d-b638-14097df5ebe5 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:47:31.385279 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1c1a6685-f417-416d-b638-14097df5ebe5 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:47:31.385997 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1c1a6685-f417-416d-b638-14097df5ebe5 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:47:31.386473 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1c1a6685-f417-416d-b638-14097df5ebe5 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:47:31.386919 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1c1a6685-f417-416d-b638-14097df5ebe5 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:47:31.516537 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-1c1a6685-f417-416d-b638-14097df5ebe5 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e838176b44c4f23b470cfc152f79990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3718dd3e536649b5bf1970ff06ddea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:47:31.524409 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-1c1a6685-f417-416d-b638-14097df5ebe5 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/521af341-8ec9-4dc5-901f-68a80a167d46" status: 200 len: 1361 microversion: 2.1 time: 0.155386 Oct 08 21:47:31.524992 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3320/6568] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:47:31 2022] GET /compute/v2.1/servers/521af341-8ec9-4dc5-901f-68a80a167d46 => generated 1361 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:47:32.457019 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-4238517e-b1e9-4279-9bb1-600c0a8fb301 req-82ceb8d7-f75b-4ae0-a7fc-03151b2f0584 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "521af341-8ec9-4dc5-901f-68a80a167d46", "name": "network-vif-plugged", "status": "completed", "tag": "4b829301-69ef-4c13-a79b-a380d89ef693"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:47:32.468657 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-4238517e-b1e9-4279-9bb1-600c0a8fb301 req-82ceb8d7-f75b-4ae0-a7fc-03151b2f0584 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:47:32.469149 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-4238517e-b1e9-4279-9bb1-600c0a8fb301 req-82ceb8d7-f75b-4ae0-a7fc-03151b2f0584 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:47:32.469604 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-4238517e-b1e9-4279-9bb1-600c0a8fb301 req-82ceb8d7-f75b-4ae0-a7fc-03151b2f0584 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:47:32.483001 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-4238517e-b1e9-4279-9bb1-600c0a8fb301 req-82ceb8d7-f75b-4ae0-a7fc-03151b2f0584 service nova] Creating event network-vif-plugged:4b829301-69ef-4c13-a79b-a380d89ef693 for instance 521af341-8ec9-4dc5-901f-68a80a167d46 on nch1-master-1 Oct 08 21:47:32.490002 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-4238517e-b1e9-4279-9bb1-600c0a8fb301 req-82ceb8d7-f75b-4ae0-a7fc-03151b2f0584 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037547 Oct 08 21:47:32.490605 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3249/6569] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:47:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 08 21:47:32.547683 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e996b99d-716b-4754-81a6-b9e121c2be3f tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:47:32.548276 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-e996b99d-716b-4754-81a6-b9e121c2be3f tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: 521af341-8ec9-4dc5-901f-68a80a167d46] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:47:32.556575 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e996b99d-716b-4754-81a6-b9e121c2be3f tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:47:32.557088 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e996b99d-716b-4754-81a6-b9e121c2be3f tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:47:32.557570 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e996b99d-716b-4754-81a6-b9e121c2be3f tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:47:32.558292 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e996b99d-716b-4754-81a6-b9e121c2be3f tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:47:32.558772 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e996b99d-716b-4754-81a6-b9e121c2be3f tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:47:32.559218 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e996b99d-716b-4754-81a6-b9e121c2be3f tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:47:32.695540 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-e996b99d-716b-4754-81a6-b9e121c2be3f tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e838176b44c4f23b470cfc152f79990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3718dd3e536649b5bf1970ff06ddea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:47:32.703384 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-e996b99d-716b-4754-81a6-b9e121c2be3f tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/521af341-8ec9-4dc5-901f-68a80a167d46" status: 200 len: 1361 microversion: 2.1 time: 0.159730 Oct 08 21:47:32.703958 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3321/6570] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:47:32 2022] GET /compute/v2.1/servers/521af341-8ec9-4dc5-901f-68a80a167d46 => generated 1361 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:47:33.727737 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-e3fa5426-a050-40ff-be83-7b8c31b736ea tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:47:33.728448 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-e3fa5426-a050-40ff-be83-7b8c31b736ea tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: 521af341-8ec9-4dc5-901f-68a80a167d46] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:47:33.735801 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e3fa5426-a050-40ff-be83-7b8c31b736ea tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:47:33.736238 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e3fa5426-a050-40ff-be83-7b8c31b736ea tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:47:33.737211 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e3fa5426-a050-40ff-be83-7b8c31b736ea tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:47:33.737914 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e3fa5426-a050-40ff-be83-7b8c31b736ea tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:47:33.738382 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e3fa5426-a050-40ff-be83-7b8c31b736ea tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:47:33.738817 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e3fa5426-a050-40ff-be83-7b8c31b736ea tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:47:33.872059 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-e3fa5426-a050-40ff-be83-7b8c31b736ea tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e838176b44c4f23b470cfc152f79990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3718dd3e536649b5bf1970ff06ddea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:47:33.881314 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-e3fa5426-a050-40ff-be83-7b8c31b736ea tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/521af341-8ec9-4dc5-901f-68a80a167d46" status: 200 len: 1361 microversion: 2.1 time: 0.157748 Oct 08 21:47:33.881972 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3250/6571] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:47:33 2022] GET /compute/v2.1/servers/521af341-8ec9-4dc5-901f-68a80a167d46 => generated 1361 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:47:34.903954 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-6ccf1845-fee2-4753-bb83-7a17ada56600 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:47:34.904586 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-6ccf1845-fee2-4753-bb83-7a17ada56600 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: 521af341-8ec9-4dc5-901f-68a80a167d46] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:47:34.911663 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6ccf1845-fee2-4753-bb83-7a17ada56600 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:47:34.912176 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6ccf1845-fee2-4753-bb83-7a17ada56600 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:47:34.912636 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6ccf1845-fee2-4753-bb83-7a17ada56600 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:47:34.913408 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6ccf1845-fee2-4753-bb83-7a17ada56600 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:47:34.913895 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6ccf1845-fee2-4753-bb83-7a17ada56600 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:47:34.914351 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6ccf1845-fee2-4753-bb83-7a17ada56600 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:47:35.043620 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-6ccf1845-fee2-4753-bb83-7a17ada56600 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e838176b44c4f23b470cfc152f79990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3718dd3e536649b5bf1970ff06ddea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:47:35.051869 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-6ccf1845-fee2-4753-bb83-7a17ada56600 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/521af341-8ec9-4dc5-901f-68a80a167d46" status: 200 len: 1549 microversion: 2.1 time: 0.151894 Oct 08 21:47:35.052442 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3322/6572] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:47:34 2022] GET /compute/v2.1/servers/521af341-8ec9-4dc5-901f-68a80a167d46 => generated 1549 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:47:35.075294 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-761f367f-2267-48e0-875f-fb55a8b8fdfa tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:47:35.075798 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-761f367f-2267-48e0-875f-fb55a8b8fdfa tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: 521af341-8ec9-4dc5-901f-68a80a167d46] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:47:35.082644 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-761f367f-2267-48e0-875f-fb55a8b8fdfa tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:47:35.083132 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-761f367f-2267-48e0-875f-fb55a8b8fdfa tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:47:35.083579 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-761f367f-2267-48e0-875f-fb55a8b8fdfa tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:47:35.084273 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-761f367f-2267-48e0-875f-fb55a8b8fdfa tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:47:35.084733 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-761f367f-2267-48e0-875f-fb55a8b8fdfa tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:47:35.085159 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-761f367f-2267-48e0-875f-fb55a8b8fdfa tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:47:35.161061 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-761f367f-2267-48e0-875f-fb55a8b8fdfa tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/521af341-8ec9-4dc5-901f-68a80a167d46/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.089580 Oct 08 21:47:35.161687 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3251/6573] 10.222.0.26 () {58 vars in 1275 bytes} [Sat Oct 8 21:47:35 2022] GET /compute/v2.1/servers/521af341-8ec9-4dc5-901f-68a80a167d46/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:47:36.085113 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-581470ab-344a-4d1c-b567-5a5a3bee5479 req-56496d31-3f6a-4448-aa33-9023d142d384 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "521af341-8ec9-4dc5-901f-68a80a167d46", "tag": "4b829301-69ef-4c13-a79b-a380d89ef693"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:47:36.090193 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=2 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:47:36.097122 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-581470ab-344a-4d1c-b567-5a5a3bee5479 req-56496d31-3f6a-4448-aa33-9023d142d384 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:47:36.097701 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-581470ab-344a-4d1c-b567-5a5a3bee5479 req-56496d31-3f6a-4448-aa33-9023d142d384 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:47:36.098180 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-581470ab-344a-4d1c-b567-5a5a3bee5479 req-56496d31-3f6a-4448-aa33-9023d142d384 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:47:36.109931 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-581470ab-344a-4d1c-b567-5a5a3bee5479 req-56496d31-3f6a-4448-aa33-9023d142d384 service nova] Creating event network-changed:4b829301-69ef-4c13-a79b-a380d89ef693 for instance 521af341-8ec9-4dc5-901f-68a80a167d46 on nch1-master-1 Oct 08 21:47:36.116198 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-581470ab-344a-4d1c-b567-5a5a3bee5479 req-56496d31-3f6a-4448-aa33-9023d142d384 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034852 Oct 08 21:47:36.117209 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3323/6574] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:47:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:48:09.225664 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=2 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:48:09.226481 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=6 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:48:09.228726 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:SELECT=9 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:48:09.229427 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:48:09.234328 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-1e296e70-a200-4072-898a-f0ed00df859c tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:48:09.236570 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-1e296e70-a200-4072-898a-f0ed00df859c tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: 521af341-8ec9-4dc5-901f-68a80a167d46] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:48:09.245279 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1e296e70-a200-4072-898a-f0ed00df859c tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:48:09.245773 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1e296e70-a200-4072-898a-f0ed00df859c tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:48:09.246219 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1e296e70-a200-4072-898a-f0ed00df859c tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:48:09.246921 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1e296e70-a200-4072-898a-f0ed00df859c tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:48:09.247393 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1e296e70-a200-4072-898a-f0ed00df859c tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:48:09.247830 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1e296e70-a200-4072-898a-f0ed00df859c tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:48:09.277711 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-1e296e70-a200-4072-898a-f0ed00df859c tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '5e838176b44c4f23b470cfc152f79990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3718dd3e536649b5bf1970ff06ddea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:48:09.283227 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-1e296e70-a200-4072-898a-f0ed00df859c tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: 521af341-8ec9-4dc5-901f-68a80a167d46] Old instance type m1.heat2, new instance type m1.heat {{(pid=140491) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 08 21:48:09.289782 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-1e296e70-a200-4072-898a-f0ed00df859c tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Flavor limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 21:48:09.290209 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-1e296e70-a200-4072-898a-f0ed00df859c tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Image limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 21:48:09.290697 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-1e296e70-a200-4072-898a-f0ed00df859c tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Flavor pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 21:48:09.291112 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-1e296e70-a200-4072-898a-f0ed00df859c tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Image pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 21:48:09.291532 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-1e296e70-a200-4072-898a-f0ed00df859c tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 21:48:09.359008 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-1e296e70-a200-4072-898a-f0ed00df859c tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "POST /compute/v2.1/servers/521af341-8ec9-4dc5-901f-68a80a167d46/action" status: 202 len: 0 microversion: 2.1 time: 0.134027 Oct 08 21:48:09.359593 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3252/6575] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:48:09 2022] POST /compute/v2.1/servers/521af341-8ec9-4dc5-901f-68a80a167d46/action => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 21:48:09.366232 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=9 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:48:09.367097 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=51 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:48:09.372237 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-5f8979c1-bec0-4824-9d9c-0bfc28c72d68 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:48:09.372597 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-5f8979c1-bec0-4824-9d9c-0bfc28c72d68 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: 521af341-8ec9-4dc5-901f-68a80a167d46] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:48:09.380469 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5f8979c1-bec0-4824-9d9c-0bfc28c72d68 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:48:09.381094 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5f8979c1-bec0-4824-9d9c-0bfc28c72d68 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:48:09.381688 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5f8979c1-bec0-4824-9d9c-0bfc28c72d68 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:48:09.382616 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5f8979c1-bec0-4824-9d9c-0bfc28c72d68 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:48:09.383198 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5f8979c1-bec0-4824-9d9c-0bfc28c72d68 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:48:09.383669 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5f8979c1-bec0-4824-9d9c-0bfc28c72d68 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:48:09.553313 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-5f8979c1-bec0-4824-9d9c-0bfc28c72d68 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e838176b44c4f23b470cfc152f79990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3718dd3e536649b5bf1970ff06ddea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:48:09.561540 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-5f8979c1-bec0-4824-9d9c-0bfc28c72d68 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/521af341-8ec9-4dc5-901f-68a80a167d46" status: 200 len: 1676 microversion: 2.1 time: 0.197278 Oct 08 21:48:09.562147 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3324/6576] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:48:09 2022] GET /compute/v2.1/servers/521af341-8ec9-4dc5-901f-68a80a167d46 => generated 1676 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:48:10.586576 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-b9d62699-d38f-4bd8-a2ad-c1ed0683199b tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:48:10.587198 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-b9d62699-d38f-4bd8-a2ad-c1ed0683199b tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: 521af341-8ec9-4dc5-901f-68a80a167d46] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:48:10.594227 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b9d62699-d38f-4bd8-a2ad-c1ed0683199b tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:48:10.594730 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b9d62699-d38f-4bd8-a2ad-c1ed0683199b tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:48:10.595183 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b9d62699-d38f-4bd8-a2ad-c1ed0683199b tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:48:10.595893 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b9d62699-d38f-4bd8-a2ad-c1ed0683199b tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:48:10.596361 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b9d62699-d38f-4bd8-a2ad-c1ed0683199b tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:48:10.596808 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b9d62699-d38f-4bd8-a2ad-c1ed0683199b tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:48:10.723917 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-b9d62699-d38f-4bd8-a2ad-c1ed0683199b tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e838176b44c4f23b470cfc152f79990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3718dd3e536649b5bf1970ff06ddea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:48:10.731882 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-b9d62699-d38f-4bd8-a2ad-c1ed0683199b tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/521af341-8ec9-4dc5-901f-68a80a167d46" status: 200 len: 1676 microversion: 2.1 time: 0.150020 Oct 08 21:48:10.732397 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3253/6577] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:48:10 2022] GET /compute/v2.1/servers/521af341-8ec9-4dc5-901f-68a80a167d46 => generated 1676 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:48:11.755493 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-04d51bd7-e074-4394-9ab7-1846f0a80dce tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:48:11.756135 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-04d51bd7-e074-4394-9ab7-1846f0a80dce tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: 521af341-8ec9-4dc5-901f-68a80a167d46] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:48:11.763793 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-04d51bd7-e074-4394-9ab7-1846f0a80dce tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:48:11.764296 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-04d51bd7-e074-4394-9ab7-1846f0a80dce tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:48:11.764766 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-04d51bd7-e074-4394-9ab7-1846f0a80dce tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:48:11.765526 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-04d51bd7-e074-4394-9ab7-1846f0a80dce tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:48:11.766012 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-04d51bd7-e074-4394-9ab7-1846f0a80dce tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:48:11.766467 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-04d51bd7-e074-4394-9ab7-1846f0a80dce tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:48:11.896528 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-04d51bd7-e074-4394-9ab7-1846f0a80dce tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e838176b44c4f23b470cfc152f79990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3718dd3e536649b5bf1970ff06ddea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:48:11.904446 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-04d51bd7-e074-4394-9ab7-1846f0a80dce tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/521af341-8ec9-4dc5-901f-68a80a167d46" status: 200 len: 1681 microversion: 2.1 time: 0.152924 Oct 08 21:48:11.905024 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3325/6578] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:48:11 2022] GET /compute/v2.1/servers/521af341-8ec9-4dc5-901f-68a80a167d46 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:48:12.928668 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-40bea2b5-a362-4ec1-87ae-5d45d5689149 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:48:12.929266 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-40bea2b5-a362-4ec1-87ae-5d45d5689149 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: 521af341-8ec9-4dc5-901f-68a80a167d46] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:48:12.936170 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-40bea2b5-a362-4ec1-87ae-5d45d5689149 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:48:12.936656 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-40bea2b5-a362-4ec1-87ae-5d45d5689149 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:48:12.937100 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-40bea2b5-a362-4ec1-87ae-5d45d5689149 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:48:12.937820 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-40bea2b5-a362-4ec1-87ae-5d45d5689149 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:48:12.938280 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-40bea2b5-a362-4ec1-87ae-5d45d5689149 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:48:12.938705 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-40bea2b5-a362-4ec1-87ae-5d45d5689149 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:48:13.074121 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-40bea2b5-a362-4ec1-87ae-5d45d5689149 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e838176b44c4f23b470cfc152f79990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3718dd3e536649b5bf1970ff06ddea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:48:13.082335 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-40bea2b5-a362-4ec1-87ae-5d45d5689149 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/521af341-8ec9-4dc5-901f-68a80a167d46" status: 200 len: 1681 microversion: 2.1 time: 0.158136 Oct 08 21:48:13.082906 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3254/6579] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:48:12 2022] GET /compute/v2.1/servers/521af341-8ec9-4dc5-901f-68a80a167d46 => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:48:14.106838 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-15b2c136-62f2-47ae-92e6-bc7f54b8eaf0 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:48:14.107475 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-15b2c136-62f2-47ae-92e6-bc7f54b8eaf0 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: 521af341-8ec9-4dc5-901f-68a80a167d46] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:48:14.115323 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-15b2c136-62f2-47ae-92e6-bc7f54b8eaf0 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:48:14.115832 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-15b2c136-62f2-47ae-92e6-bc7f54b8eaf0 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:48:14.116292 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-15b2c136-62f2-47ae-92e6-bc7f54b8eaf0 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:48:14.117011 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-15b2c136-62f2-47ae-92e6-bc7f54b8eaf0 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:48:14.117518 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-15b2c136-62f2-47ae-92e6-bc7f54b8eaf0 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:48:14.117966 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-15b2c136-62f2-47ae-92e6-bc7f54b8eaf0 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:48:14.254221 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-15b2c136-62f2-47ae-92e6-bc7f54b8eaf0 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e838176b44c4f23b470cfc152f79990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3718dd3e536649b5bf1970ff06ddea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:48:14.262199 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-15b2c136-62f2-47ae-92e6-bc7f54b8eaf0 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/521af341-8ec9-4dc5-901f-68a80a167d46" status: 200 len: 1681 microversion: 2.1 time: 0.159425 Oct 08 21:48:14.262783 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3326/6580] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:48:14 2022] GET /compute/v2.1/servers/521af341-8ec9-4dc5-901f-68a80a167d46 => generated 1681 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:48:15.285158 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-3e645b58-a255-4ddb-b1a4-728a39a40255 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:48:15.285802 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-3e645b58-a255-4ddb-b1a4-728a39a40255 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: 521af341-8ec9-4dc5-901f-68a80a167d46] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:48:15.292806 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3e645b58-a255-4ddb-b1a4-728a39a40255 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:48:15.293321 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3e645b58-a255-4ddb-b1a4-728a39a40255 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:48:15.293766 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3e645b58-a255-4ddb-b1a4-728a39a40255 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:48:15.294464 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3e645b58-a255-4ddb-b1a4-728a39a40255 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:48:15.294925 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3e645b58-a255-4ddb-b1a4-728a39a40255 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:48:15.295362 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3e645b58-a255-4ddb-b1a4-728a39a40255 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:48:15.423275 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-3e645b58-a255-4ddb-b1a4-728a39a40255 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e838176b44c4f23b470cfc152f79990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3718dd3e536649b5bf1970ff06ddea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:48:15.431049 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-3e645b58-a255-4ddb-b1a4-728a39a40255 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/521af341-8ec9-4dc5-901f-68a80a167d46" status: 200 len: 1681 microversion: 2.1 time: 0.149828 Oct 08 21:48:15.431618 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3255/6581] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:48:15 2022] GET /compute/v2.1/servers/521af341-8ec9-4dc5-901f-68a80a167d46 => generated 1681 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:48:16.455644 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-836169f0-69bd-4c5d-9005-6a6daf88ab77 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:48:16.456454 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-836169f0-69bd-4c5d-9005-6a6daf88ab77 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: 521af341-8ec9-4dc5-901f-68a80a167d46] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:48:16.463739 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-836169f0-69bd-4c5d-9005-6a6daf88ab77 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:48:16.464250 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-836169f0-69bd-4c5d-9005-6a6daf88ab77 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:48:16.464712 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-836169f0-69bd-4c5d-9005-6a6daf88ab77 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:48:16.465466 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-836169f0-69bd-4c5d-9005-6a6daf88ab77 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:48:16.465958 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-836169f0-69bd-4c5d-9005-6a6daf88ab77 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:48:16.466410 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-836169f0-69bd-4c5d-9005-6a6daf88ab77 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:48:16.614184 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-836169f0-69bd-4c5d-9005-6a6daf88ab77 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e838176b44c4f23b470cfc152f79990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3718dd3e536649b5bf1970ff06ddea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:48:16.621971 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-836169f0-69bd-4c5d-9005-6a6daf88ab77 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/521af341-8ec9-4dc5-901f-68a80a167d46" status: 200 len: 1681 microversion: 2.1 time: 0.170386 Oct 08 21:48:16.622543 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3327/6582] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:48:16 2022] GET /compute/v2.1/servers/521af341-8ec9-4dc5-901f-68a80a167d46 => generated 1681 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:48:17.645624 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-591d8a7e-6598-4116-bf6a-eaf6922a626f tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:48:17.646239 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-591d8a7e-6598-4116-bf6a-eaf6922a626f tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: 521af341-8ec9-4dc5-901f-68a80a167d46] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:48:17.653210 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-591d8a7e-6598-4116-bf6a-eaf6922a626f tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:48:17.653717 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-591d8a7e-6598-4116-bf6a-eaf6922a626f tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:48:17.654160 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-591d8a7e-6598-4116-bf6a-eaf6922a626f tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:48:17.654863 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-591d8a7e-6598-4116-bf6a-eaf6922a626f tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:48:17.655323 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-591d8a7e-6598-4116-bf6a-eaf6922a626f tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:48:17.655758 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-591d8a7e-6598-4116-bf6a-eaf6922a626f tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:48:17.793174 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-591d8a7e-6598-4116-bf6a-eaf6922a626f tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e838176b44c4f23b470cfc152f79990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3718dd3e536649b5bf1970ff06ddea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:48:17.801071 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-591d8a7e-6598-4116-bf6a-eaf6922a626f tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/521af341-8ec9-4dc5-901f-68a80a167d46" status: 200 len: 1681 microversion: 2.1 time: 0.159360 Oct 08 21:48:17.801676 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3256/6583] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:48:17 2022] GET /compute/v2.1/servers/521af341-8ec9-4dc5-901f-68a80a167d46 => generated 1681 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:48:18.824016 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e24bd8c5-5caf-4b2c-9e36-e0b28cb0243a tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:48:18.824646 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-e24bd8c5-5caf-4b2c-9e36-e0b28cb0243a tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: 521af341-8ec9-4dc5-901f-68a80a167d46] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:48:18.831473 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e24bd8c5-5caf-4b2c-9e36-e0b28cb0243a tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:48:18.831977 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e24bd8c5-5caf-4b2c-9e36-e0b28cb0243a tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:48:18.832432 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e24bd8c5-5caf-4b2c-9e36-e0b28cb0243a tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:48:18.833261 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e24bd8c5-5caf-4b2c-9e36-e0b28cb0243a tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:48:18.833743 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e24bd8c5-5caf-4b2c-9e36-e0b28cb0243a tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:48:18.834192 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e24bd8c5-5caf-4b2c-9e36-e0b28cb0243a tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:48:18.966071 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-e24bd8c5-5caf-4b2c-9e36-e0b28cb0243a tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e838176b44c4f23b470cfc152f79990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3718dd3e536649b5bf1970ff06ddea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:48:18.974325 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-e24bd8c5-5caf-4b2c-9e36-e0b28cb0243a tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/521af341-8ec9-4dc5-901f-68a80a167d46" status: 200 len: 1681 microversion: 2.1 time: 0.154383 Oct 08 21:48:18.974924 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3328/6584] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:48:18 2022] GET /compute/v2.1/servers/521af341-8ec9-4dc5-901f-68a80a167d46 => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:48:19.997824 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-10e4eca4-02f3-4dbe-a291-28c6e73e1f2e tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:48:19.998444 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-10e4eca4-02f3-4dbe-a291-28c6e73e1f2e tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: 521af341-8ec9-4dc5-901f-68a80a167d46] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:48:20.006194 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-10e4eca4-02f3-4dbe-a291-28c6e73e1f2e tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:48:20.006680 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-10e4eca4-02f3-4dbe-a291-28c6e73e1f2e tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:48:20.007118 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-10e4eca4-02f3-4dbe-a291-28c6e73e1f2e tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:48:20.007810 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-10e4eca4-02f3-4dbe-a291-28c6e73e1f2e tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:48:20.008273 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-10e4eca4-02f3-4dbe-a291-28c6e73e1f2e tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:48:20.008700 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-10e4eca4-02f3-4dbe-a291-28c6e73e1f2e tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:48:20.152195 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-10e4eca4-02f3-4dbe-a291-28c6e73e1f2e tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e838176b44c4f23b470cfc152f79990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3718dd3e536649b5bf1970ff06ddea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:48:20.161236 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-10e4eca4-02f3-4dbe-a291-28c6e73e1f2e tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/521af341-8ec9-4dc5-901f-68a80a167d46" status: 200 len: 1681 microversion: 2.1 time: 0.167294 Oct 08 21:48:20.161814 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3257/6585] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:48:19 2022] GET /compute/v2.1/servers/521af341-8ec9-4dc5-901f-68a80a167d46 => generated 1681 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:48:21.184892 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-5d6561ba-ced6-4faa-aec1-f0acc4d20ea6 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:48:21.185547 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-5d6561ba-ced6-4faa-aec1-f0acc4d20ea6 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: 521af341-8ec9-4dc5-901f-68a80a167d46] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:48:21.193335 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5d6561ba-ced6-4faa-aec1-f0acc4d20ea6 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:48:21.193842 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5d6561ba-ced6-4faa-aec1-f0acc4d20ea6 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:48:21.194300 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5d6561ba-ced6-4faa-aec1-f0acc4d20ea6 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:48:21.195017 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5d6561ba-ced6-4faa-aec1-f0acc4d20ea6 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:48:21.195491 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5d6561ba-ced6-4faa-aec1-f0acc4d20ea6 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:48:21.195935 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5d6561ba-ced6-4faa-aec1-f0acc4d20ea6 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:48:21.324451 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-5d6561ba-ced6-4faa-aec1-f0acc4d20ea6 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e838176b44c4f23b470cfc152f79990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3718dd3e536649b5bf1970ff06ddea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:48:21.333074 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-5d6561ba-ced6-4faa-aec1-f0acc4d20ea6 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/521af341-8ec9-4dc5-901f-68a80a167d46" status: 200 len: 1681 microversion: 2.1 time: 0.152065 Oct 08 21:48:21.333690 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3329/6586] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:48:21 2022] GET /compute/v2.1/servers/521af341-8ec9-4dc5-901f-68a80a167d46 => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:48:22.355992 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-a4ca305f-1fe3-4bf8-9e51-88873b731f8d tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:48:22.356612 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-a4ca305f-1fe3-4bf8-9e51-88873b731f8d tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: 521af341-8ec9-4dc5-901f-68a80a167d46] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:48:22.363639 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a4ca305f-1fe3-4bf8-9e51-88873b731f8d tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:48:22.364158 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a4ca305f-1fe3-4bf8-9e51-88873b731f8d tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:48:22.364600 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a4ca305f-1fe3-4bf8-9e51-88873b731f8d tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:48:22.365326 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a4ca305f-1fe3-4bf8-9e51-88873b731f8d tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:48:22.365789 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a4ca305f-1fe3-4bf8-9e51-88873b731f8d tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:48:22.366219 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a4ca305f-1fe3-4bf8-9e51-88873b731f8d tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:48:22.496477 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-a4ca305f-1fe3-4bf8-9e51-88873b731f8d tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e838176b44c4f23b470cfc152f79990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3718dd3e536649b5bf1970ff06ddea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:48:22.504227 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-a4ca305f-1fe3-4bf8-9e51-88873b731f8d tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/521af341-8ec9-4dc5-901f-68a80a167d46" status: 200 len: 1681 microversion: 2.1 time: 0.152132 Oct 08 21:48:22.504800 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3258/6587] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:48:22 2022] GET /compute/v2.1/servers/521af341-8ec9-4dc5-901f-68a80a167d46 => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:48:23.527969 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-df5a9d15-1836-4290-bd84-4706de92af9f tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:48:23.528679 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-df5a9d15-1836-4290-bd84-4706de92af9f tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: 521af341-8ec9-4dc5-901f-68a80a167d46] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:48:23.538171 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-df5a9d15-1836-4290-bd84-4706de92af9f tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:48:23.538737 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-df5a9d15-1836-4290-bd84-4706de92af9f tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:48:23.539269 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-df5a9d15-1836-4290-bd84-4706de92af9f tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:48:23.540115 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-df5a9d15-1836-4290-bd84-4706de92af9f tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:48:23.540608 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-df5a9d15-1836-4290-bd84-4706de92af9f tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:48:23.541066 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-df5a9d15-1836-4290-bd84-4706de92af9f tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:48:23.792959 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-df5a9d15-1836-4290-bd84-4706de92af9f tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e838176b44c4f23b470cfc152f79990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3718dd3e536649b5bf1970ff06ddea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:48:23.801059 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-df5a9d15-1836-4290-bd84-4706de92af9f tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/521af341-8ec9-4dc5-901f-68a80a167d46" status: 200 len: 1680 microversion: 2.1 time: 0.276979 Oct 08 21:48:23.801851 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3330/6588] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:48:23 2022] GET /compute/v2.1/servers/521af341-8ec9-4dc5-901f-68a80a167d46 => generated 1680 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:48:23.969217 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-f46c7e8b-e437-4bf0-a50e-85dda77c4b80 req-a62f0d25-68f9-4486-95f6-e8c50f2733e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "521af341-8ec9-4dc5-901f-68a80a167d46", "name": "network-vif-unplugged", "status": "completed", "tag": "4b829301-69ef-4c13-a79b-a380d89ef693"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:48:23.980777 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-f46c7e8b-e437-4bf0-a50e-85dda77c4b80 req-a62f0d25-68f9-4486-95f6-e8c50f2733e2 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:48:23.981293 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-f46c7e8b-e437-4bf0-a50e-85dda77c4b80 req-a62f0d25-68f9-4486-95f6-e8c50f2733e2 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:48:23.981742 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-f46c7e8b-e437-4bf0-a50e-85dda77c4b80 req-a62f0d25-68f9-4486-95f6-e8c50f2733e2 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:48:23.994183 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-f46c7e8b-e437-4bf0-a50e-85dda77c4b80 req-a62f0d25-68f9-4486-95f6-e8c50f2733e2 service nova] Creating event network-vif-unplugged:4b829301-69ef-4c13-a79b-a380d89ef693 for instance 521af341-8ec9-4dc5-901f-68a80a167d46 on nch2-master-1 Oct 08 21:48:23.999645 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [req-f46c7e8b-e437-4bf0-a50e-85dda77c4b80 req-a62f0d25-68f9-4486-95f6-e8c50f2733e2 service nova] Instance 521af341-8ec9-4dc5-901f-68a80a167d46 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140491) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 08 21:48:24.011407 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-f46c7e8b-e437-4bf0-a50e-85dda77c4b80 req-a62f0d25-68f9-4486-95f6-e8c50f2733e2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045878 Oct 08 21:48:24.012031 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3259/6589] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:48:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 08 21:48:24.824723 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-3596fe25-90ff-4383-939f-ac7888f05ea0 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:48:24.825449 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-3596fe25-90ff-4383-939f-ac7888f05ea0 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: 521af341-8ec9-4dc5-901f-68a80a167d46] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:48:24.832354 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3596fe25-90ff-4383-939f-ac7888f05ea0 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:48:24.832877 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3596fe25-90ff-4383-939f-ac7888f05ea0 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:48:24.833381 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3596fe25-90ff-4383-939f-ac7888f05ea0 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:48:24.834183 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3596fe25-90ff-4383-939f-ac7888f05ea0 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:48:24.834669 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3596fe25-90ff-4383-939f-ac7888f05ea0 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:48:24.835124 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3596fe25-90ff-4383-939f-ac7888f05ea0 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:48:25.009663 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-3596fe25-90ff-4383-939f-ac7888f05ea0 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e838176b44c4f23b470cfc152f79990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3718dd3e536649b5bf1970ff06ddea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:48:25.017883 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-3596fe25-90ff-4383-939f-ac7888f05ea0 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/521af341-8ec9-4dc5-901f-68a80a167d46" status: 200 len: 1680 microversion: 2.1 time: 0.197054 Oct 08 21:48:25.018497 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3331/6590] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:48:24 2022] GET /compute/v2.1/servers/521af341-8ec9-4dc5-901f-68a80a167d46 => generated 1680 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:48:26.041645 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-5f4f5067-d8bd-4fb0-a720-013599ef4301 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:48:26.042125 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-cb8dd643-6b07-4542-85c6-bb4ff0d19133 req-0a2b808e-07ae-4a39-8d03-e1a4bdf98fb1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "521af341-8ec9-4dc5-901f-68a80a167d46", "tag": "4b829301-69ef-4c13-a79b-a380d89ef693"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:48:26.042506 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-5f4f5067-d8bd-4fb0-a720-013599ef4301 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: 521af341-8ec9-4dc5-901f-68a80a167d46] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:48:26.050662 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5f4f5067-d8bd-4fb0-a720-013599ef4301 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:48:26.051166 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5f4f5067-d8bd-4fb0-a720-013599ef4301 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:48:26.051619 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5f4f5067-d8bd-4fb0-a720-013599ef4301 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:48:26.052333 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5f4f5067-d8bd-4fb0-a720-013599ef4301 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:48:26.052801 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5f4f5067-d8bd-4fb0-a720-013599ef4301 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:48:26.052918 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-cb8dd643-6b07-4542-85c6-bb4ff0d19133 req-0a2b808e-07ae-4a39-8d03-e1a4bdf98fb1 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:48:26.053267 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5f4f5067-d8bd-4fb0-a720-013599ef4301 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:48:26.053366 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-cb8dd643-6b07-4542-85c6-bb4ff0d19133 req-0a2b808e-07ae-4a39-8d03-e1a4bdf98fb1 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:48:26.053805 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-cb8dd643-6b07-4542-85c6-bb4ff0d19133 req-0a2b808e-07ae-4a39-8d03-e1a4bdf98fb1 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:48:26.066559 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-cb8dd643-6b07-4542-85c6-bb4ff0d19133 req-0a2b808e-07ae-4a39-8d03-e1a4bdf98fb1 service nova] Creating event network-changed:4b829301-69ef-4c13-a79b-a380d89ef693 for instance 521af341-8ec9-4dc5-901f-68a80a167d46 on nch2-master-1 Oct 08 21:48:26.072146 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [req-cb8dd643-6b07-4542-85c6-bb4ff0d19133 req-0a2b808e-07ae-4a39-8d03-e1a4bdf98fb1 service nova] Instance 521af341-8ec9-4dc5-901f-68a80a167d46 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140492) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 08 21:48:26.083058 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-cb8dd643-6b07-4542-85c6-bb4ff0d19133 req-0a2b808e-07ae-4a39-8d03-e1a4bdf98fb1 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044733 Oct 08 21:48:26.083664 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3332/6591] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:48:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 08 21:48:26.275191 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-5f4f5067-d8bd-4fb0-a720-013599ef4301 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e838176b44c4f23b470cfc152f79990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3718dd3e536649b5bf1970ff06ddea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:48:26.283065 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-5f4f5067-d8bd-4fb0-a720-013599ef4301 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/521af341-8ec9-4dc5-901f-68a80a167d46" status: 200 len: 1678 microversion: 2.1 time: 0.245703 Oct 08 21:48:26.283599 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3260/6592] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:48:26 2022] GET /compute/v2.1/servers/521af341-8ec9-4dc5-901f-68a80a167d46 => generated 1678 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:48:27.307978 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-aa0d6c95-353f-45cc-b41f-4c922877951c tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:48:27.308621 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-aa0d6c95-353f-45cc-b41f-4c922877951c tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: 521af341-8ec9-4dc5-901f-68a80a167d46] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:48:27.315438 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-aa0d6c95-353f-45cc-b41f-4c922877951c tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:48:27.316196 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-aa0d6c95-353f-45cc-b41f-4c922877951c tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:48:27.316925 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-aa0d6c95-353f-45cc-b41f-4c922877951c tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:48:27.317680 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-aa0d6c95-353f-45cc-b41f-4c922877951c tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:48:27.318156 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-aa0d6c95-353f-45cc-b41f-4c922877951c tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:48:27.318603 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-aa0d6c95-353f-45cc-b41f-4c922877951c tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:48:27.458807 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-aa0d6c95-353f-45cc-b41f-4c922877951c tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e838176b44c4f23b470cfc152f79990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3718dd3e536649b5bf1970ff06ddea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:48:27.466968 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-aa0d6c95-353f-45cc-b41f-4c922877951c tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/521af341-8ec9-4dc5-901f-68a80a167d46" status: 200 len: 1675 microversion: 2.1 time: 0.164191 Oct 08 21:48:27.467561 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3333/6593] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:48:27 2022] GET /compute/v2.1/servers/521af341-8ec9-4dc5-901f-68a80a167d46 => generated 1675 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:48:27.490136 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-85068006-c2c9-4969-8ee9-cdcaeb4d6ef1 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:48:27.490666 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-85068006-c2c9-4969-8ee9-cdcaeb4d6ef1 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: 521af341-8ec9-4dc5-901f-68a80a167d46] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:48:27.496884 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-85068006-c2c9-4969-8ee9-cdcaeb4d6ef1 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:48:27.497451 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-85068006-c2c9-4969-8ee9-cdcaeb4d6ef1 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:48:27.497906 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-85068006-c2c9-4969-8ee9-cdcaeb4d6ef1 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:48:27.498623 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-85068006-c2c9-4969-8ee9-cdcaeb4d6ef1 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:48:27.499092 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-85068006-c2c9-4969-8ee9-cdcaeb4d6ef1 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:48:27.499530 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-85068006-c2c9-4969-8ee9-cdcaeb4d6ef1 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:48:27.540202 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-85068006-c2c9-4969-8ee9-cdcaeb4d6ef1 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:48:27.540692 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-85068006-c2c9-4969-8ee9-cdcaeb4d6ef1 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:48:27.541139 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-85068006-c2c9-4969-8ee9-cdcaeb4d6ef1 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:48:27.541907 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-85068006-c2c9-4969-8ee9-cdcaeb4d6ef1 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:48:27.542374 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-85068006-c2c9-4969-8ee9-cdcaeb4d6ef1 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:48:27.542808 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-85068006-c2c9-4969-8ee9-cdcaeb4d6ef1 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:48:27.563935 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-85068006-c2c9-4969-8ee9-cdcaeb4d6ef1 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Getting quotas for project 3718dd3e536649b5bf1970ff06ddea69. Resources: {'cores', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:48:27.570096 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-85068006-c2c9-4969-8ee9-cdcaeb4d6ef1 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Getting quotas for user 5e838176b44c4f23b470cfc152f79990 and project 3718dd3e536649b5bf1970ff06ddea69. Resources: {'cores', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:48:27.672085 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-85068006-c2c9-4969-8ee9-cdcaeb4d6ef1 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "POST /compute/v2.1/servers/521af341-8ec9-4dc5-901f-68a80a167d46/action" status: 202 len: 0 microversion: 2.1 time: 0.186519 Oct 08 21:48:27.672717 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3261/6594] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:48:27 2022] POST /compute/v2.1/servers/521af341-8ec9-4dc5-901f-68a80a167d46/action => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 21:48:27.681632 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-fa915a7a-b23b-4e2e-8e82-544f3d0d1b94 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:48:27.682281 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-fa915a7a-b23b-4e2e-8e82-544f3d0d1b94 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: 521af341-8ec9-4dc5-901f-68a80a167d46] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:48:27.689080 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fa915a7a-b23b-4e2e-8e82-544f3d0d1b94 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:48:27.689649 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fa915a7a-b23b-4e2e-8e82-544f3d0d1b94 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:48:27.691223 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fa915a7a-b23b-4e2e-8e82-544f3d0d1b94 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:48:27.692095 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fa915a7a-b23b-4e2e-8e82-544f3d0d1b94 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:48:27.692942 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fa915a7a-b23b-4e2e-8e82-544f3d0d1b94 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:48:27.693550 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fa915a7a-b23b-4e2e-8e82-544f3d0d1b94 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:48:27.904065 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-fa915a7a-b23b-4e2e-8e82-544f3d0d1b94 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e838176b44c4f23b470cfc152f79990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3718dd3e536649b5bf1970ff06ddea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:48:27.913747 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-fa915a7a-b23b-4e2e-8e82-544f3d0d1b94 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/521af341-8ec9-4dc5-901f-68a80a167d46" status: 200 len: 1674 microversion: 2.1 time: 0.236057 Oct 08 21:48:27.915097 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3334/6595] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:48:27 2022] GET /compute/v2.1/servers/521af341-8ec9-4dc5-901f-68a80a167d46 => generated 1674 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:48:28.938274 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-24af06d5-be7b-4e59-9b5a-06d9402a7d30 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:48:28.938985 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-24af06d5-be7b-4e59-9b5a-06d9402a7d30 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: 521af341-8ec9-4dc5-901f-68a80a167d46] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:48:28.945613 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-24af06d5-be7b-4e59-9b5a-06d9402a7d30 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:48:28.946107 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-24af06d5-be7b-4e59-9b5a-06d9402a7d30 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:48:28.946558 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-24af06d5-be7b-4e59-9b5a-06d9402a7d30 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:48:28.947266 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-24af06d5-be7b-4e59-9b5a-06d9402a7d30 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:48:28.947733 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-24af06d5-be7b-4e59-9b5a-06d9402a7d30 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:48:28.948166 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-24af06d5-be7b-4e59-9b5a-06d9402a7d30 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:48:29.082753 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-24af06d5-be7b-4e59-9b5a-06d9402a7d30 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e838176b44c4f23b470cfc152f79990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3718dd3e536649b5bf1970ff06ddea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:48:29.090850 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-24af06d5-be7b-4e59-9b5a-06d9402a7d30 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/521af341-8ec9-4dc5-901f-68a80a167d46" status: 200 len: 1674 microversion: 2.1 time: 0.158002 Oct 08 21:48:29.091438 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3262/6596] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:48:28 2022] GET /compute/v2.1/servers/521af341-8ec9-4dc5-901f-68a80a167d46 => generated 1674 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:48:29.636630 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-a54404b6-ced6-4ff3-8aa3-82a95593f8a1 req-510622a3-d2ba-4106-9348-ceee09d9e2f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "521af341-8ec9-4dc5-901f-68a80a167d46", "name": "network-vif-plugged", "status": "completed", "tag": "4b829301-69ef-4c13-a79b-a380d89ef693"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:48:29.647426 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-a54404b6-ced6-4ff3-8aa3-82a95593f8a1 req-510622a3-d2ba-4106-9348-ceee09d9e2f4 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:48:29.647945 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-a54404b6-ced6-4ff3-8aa3-82a95593f8a1 req-510622a3-d2ba-4106-9348-ceee09d9e2f4 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:48:29.648404 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-a54404b6-ced6-4ff3-8aa3-82a95593f8a1 req-510622a3-d2ba-4106-9348-ceee09d9e2f4 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:48:29.660950 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-a54404b6-ced6-4ff3-8aa3-82a95593f8a1 req-510622a3-d2ba-4106-9348-ceee09d9e2f4 service nova] Creating event network-vif-plugged:4b829301-69ef-4c13-a79b-a380d89ef693 for instance 521af341-8ec9-4dc5-901f-68a80a167d46 on nch2-master-1 Oct 08 21:48:29.667052 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [req-a54404b6-ced6-4ff3-8aa3-82a95593f8a1 req-510622a3-d2ba-4106-9348-ceee09d9e2f4 service nova] Instance 521af341-8ec9-4dc5-901f-68a80a167d46 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140492) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 08 21:48:29.678882 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-a54404b6-ced6-4ff3-8aa3-82a95593f8a1 req-510622a3-d2ba-4106-9348-ceee09d9e2f4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045755 Oct 08 21:48:29.679355 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3335/6597] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:48:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:48:30.115186 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-0afc698c-a183-4906-ba38-dbfc85c29243 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:48:30.115761 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-0afc698c-a183-4906-ba38-dbfc85c29243 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: 521af341-8ec9-4dc5-901f-68a80a167d46] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:48:30.122862 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0afc698c-a183-4906-ba38-dbfc85c29243 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:48:30.123480 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0afc698c-a183-4906-ba38-dbfc85c29243 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:48:30.123983 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0afc698c-a183-4906-ba38-dbfc85c29243 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:48:30.124630 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0afc698c-a183-4906-ba38-dbfc85c29243 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:48:30.125098 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0afc698c-a183-4906-ba38-dbfc85c29243 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:48:30.125574 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0afc698c-a183-4906-ba38-dbfc85c29243 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:48:30.258121 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-0afc698c-a183-4906-ba38-dbfc85c29243 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e838176b44c4f23b470cfc152f79990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3718dd3e536649b5bf1970ff06ddea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:48:30.266054 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-0afc698c-a183-4906-ba38-dbfc85c29243 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/521af341-8ec9-4dc5-901f-68a80a167d46" status: 200 len: 1674 microversion: 2.1 time: 0.155615 Oct 08 21:48:30.266636 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3263/6598] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:48:30 2022] GET /compute/v2.1/servers/521af341-8ec9-4dc5-901f-68a80a167d46 => generated 1674 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:48:30.718411 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-e01d565d-b181-42cd-8693-fb5e38f37e38 req-119530cc-628c-4e4b-80d1-6f908dea507a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "521af341-8ec9-4dc5-901f-68a80a167d46", "name": "network-vif-unplugged", "status": "completed", "tag": "4b829301-69ef-4c13-a79b-a380d89ef693"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:48:30.729719 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-e01d565d-b181-42cd-8693-fb5e38f37e38 req-119530cc-628c-4e4b-80d1-6f908dea507a service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:48:30.730220 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-e01d565d-b181-42cd-8693-fb5e38f37e38 req-119530cc-628c-4e4b-80d1-6f908dea507a service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:48:30.730668 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-e01d565d-b181-42cd-8693-fb5e38f37e38 req-119530cc-628c-4e4b-80d1-6f908dea507a service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:48:30.742441 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-e01d565d-b181-42cd-8693-fb5e38f37e38 req-119530cc-628c-4e4b-80d1-6f908dea507a service nova] Creating event network-vif-unplugged:4b829301-69ef-4c13-a79b-a380d89ef693 for instance 521af341-8ec9-4dc5-901f-68a80a167d46 on nch1-master-1 Oct 08 21:48:30.747886 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [req-e01d565d-b181-42cd-8693-fb5e38f37e38 req-119530cc-628c-4e4b-80d1-6f908dea507a service nova] Instance 521af341-8ec9-4dc5-901f-68a80a167d46 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140492) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 08 21:48:30.758566 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-e01d565d-b181-42cd-8693-fb5e38f37e38 req-119530cc-628c-4e4b-80d1-6f908dea507a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045432 Oct 08 21:48:30.759180 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3336/6599] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:48:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 08 21:48:31.289281 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-f0cf45e2-8916-459c-941a-febb3e8ab154 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:48:31.290034 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-f0cf45e2-8916-459c-941a-febb3e8ab154 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: 521af341-8ec9-4dc5-901f-68a80a167d46] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:48:31.296884 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f0cf45e2-8916-459c-941a-febb3e8ab154 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:48:31.297465 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f0cf45e2-8916-459c-941a-febb3e8ab154 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:48:31.297910 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f0cf45e2-8916-459c-941a-febb3e8ab154 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:48:31.298616 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f0cf45e2-8916-459c-941a-febb3e8ab154 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:48:31.299597 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f0cf45e2-8916-459c-941a-febb3e8ab154 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:48:31.300073 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f0cf45e2-8916-459c-941a-febb3e8ab154 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:48:31.319295 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:48:31.502076 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-f0cf45e2-8916-459c-941a-febb3e8ab154 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e838176b44c4f23b470cfc152f79990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3718dd3e536649b5bf1970ff06ddea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:48:31.509989 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-f0cf45e2-8916-459c-941a-febb3e8ab154 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/521af341-8ec9-4dc5-901f-68a80a167d46" status: 200 len: 1674 microversion: 2.1 time: 0.224562 Oct 08 21:48:31.510575 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3264/6600] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:48:31 2022] GET /compute/v2.1/servers/521af341-8ec9-4dc5-901f-68a80a167d46 => generated 1674 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:48:32.536599 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-f2f2714c-6b89-4776-976f-2a6a5b5aa0c9 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:48:32.537350 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-f2f2714c-6b89-4776-976f-2a6a5b5aa0c9 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: 521af341-8ec9-4dc5-901f-68a80a167d46] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:48:32.543672 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f2f2714c-6b89-4776-976f-2a6a5b5aa0c9 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:48:32.544174 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f2f2714c-6b89-4776-976f-2a6a5b5aa0c9 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:48:32.544633 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f2f2714c-6b89-4776-976f-2a6a5b5aa0c9 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:48:32.545379 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f2f2714c-6b89-4776-976f-2a6a5b5aa0c9 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:48:32.545856 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f2f2714c-6b89-4776-976f-2a6a5b5aa0c9 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:48:32.546305 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f2f2714c-6b89-4776-976f-2a6a5b5aa0c9 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:48:32.685256 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-f2f2714c-6b89-4776-976f-2a6a5b5aa0c9 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e838176b44c4f23b470cfc152f79990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3718dd3e536649b5bf1970ff06ddea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:48:32.693310 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-f2f2714c-6b89-4776-976f-2a6a5b5aa0c9 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/521af341-8ec9-4dc5-901f-68a80a167d46" status: 200 len: 1674 microversion: 2.1 time: 0.162914 Oct 08 21:48:32.693885 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3337/6601] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:48:32 2022] GET /compute/v2.1/servers/521af341-8ec9-4dc5-901f-68a80a167d46 => generated 1674 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:48:32.791544 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-08da1689-2a21-461e-8c48-fe48ab5fb948 req-91f37812-2d3c-45b6-89f6-9826f321027c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "521af341-8ec9-4dc5-901f-68a80a167d46", "tag": "4b829301-69ef-4c13-a79b-a380d89ef693"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:48:32.801955 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-08da1689-2a21-461e-8c48-fe48ab5fb948 req-91f37812-2d3c-45b6-89f6-9826f321027c service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:48:32.802440 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-08da1689-2a21-461e-8c48-fe48ab5fb948 req-91f37812-2d3c-45b6-89f6-9826f321027c service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:48:32.802886 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-08da1689-2a21-461e-8c48-fe48ab5fb948 req-91f37812-2d3c-45b6-89f6-9826f321027c service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:48:32.814439 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-08da1689-2a21-461e-8c48-fe48ab5fb948 req-91f37812-2d3c-45b6-89f6-9826f321027c service nova] Creating event network-changed:4b829301-69ef-4c13-a79b-a380d89ef693 for instance 521af341-8ec9-4dc5-901f-68a80a167d46 on nch1-master-1 Oct 08 21:48:32.820126 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [req-08da1689-2a21-461e-8c48-fe48ab5fb948 req-91f37812-2d3c-45b6-89f6-9826f321027c service nova] Instance 521af341-8ec9-4dc5-901f-68a80a167d46 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140491) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 08 21:48:32.831119 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-08da1689-2a21-461e-8c48-fe48ab5fb948 req-91f37812-2d3c-45b6-89f6-9826f321027c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042783 Oct 08 21:48:32.831706 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3265/6602] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:48:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:48:33.716363 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-28ab5efb-a979-49d5-b241-2286530c596d tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:48:33.717141 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-28ab5efb-a979-49d5-b241-2286530c596d tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: 521af341-8ec9-4dc5-901f-68a80a167d46] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:48:33.724586 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-28ab5efb-a979-49d5-b241-2286530c596d tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:48:33.725134 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-28ab5efb-a979-49d5-b241-2286530c596d tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:48:33.725639 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-28ab5efb-a979-49d5-b241-2286530c596d tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:48:33.726370 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-28ab5efb-a979-49d5-b241-2286530c596d tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:48:33.726854 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-28ab5efb-a979-49d5-b241-2286530c596d tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:48:33.727305 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-28ab5efb-a979-49d5-b241-2286530c596d tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:48:33.859819 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-28ab5efb-a979-49d5-b241-2286530c596d tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e838176b44c4f23b470cfc152f79990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3718dd3e536649b5bf1970ff06ddea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:48:33.867676 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-28ab5efb-a979-49d5-b241-2286530c596d tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/521af341-8ec9-4dc5-901f-68a80a167d46" status: 200 len: 1667 microversion: 2.1 time: 0.155354 Oct 08 21:48:33.868253 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3338/6603] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:48:33 2022] GET /compute/v2.1/servers/521af341-8ec9-4dc5-901f-68a80a167d46 => generated 1667 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:48:33.891557 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-0ca93200-19b9-42b3-8f60-22ef3e2957d2 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:48:33.892202 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-0ca93200-19b9-42b3-8f60-22ef3e2957d2 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: 521af341-8ec9-4dc5-901f-68a80a167d46] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:48:33.899155 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0ca93200-19b9-42b3-8f60-22ef3e2957d2 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:48:33.899652 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0ca93200-19b9-42b3-8f60-22ef3e2957d2 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:48:33.900109 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0ca93200-19b9-42b3-8f60-22ef3e2957d2 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:48:33.900814 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0ca93200-19b9-42b3-8f60-22ef3e2957d2 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:48:33.901311 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0ca93200-19b9-42b3-8f60-22ef3e2957d2 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:48:33.901753 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0ca93200-19b9-42b3-8f60-22ef3e2957d2 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:48:34.034953 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-0ca93200-19b9-42b3-8f60-22ef3e2957d2 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e838176b44c4f23b470cfc152f79990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3718dd3e536649b5bf1970ff06ddea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:48:34.042980 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-0ca93200-19b9-42b3-8f60-22ef3e2957d2 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/521af341-8ec9-4dc5-901f-68a80a167d46" status: 200 len: 1667 microversion: 2.1 time: 0.156609 Oct 08 21:48:34.043565 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3266/6604] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:48:33 2022] GET /compute/v2.1/servers/521af341-8ec9-4dc5-901f-68a80a167d46 => generated 1667 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:48:34.065494 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-c6c77115-d94f-4f4c-9a32-81f391c061b1 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:48:34.066381 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-c6c77115-d94f-4f4c-9a32-81f391c061b1 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: 521af341-8ec9-4dc5-901f-68a80a167d46] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:48:34.072439 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c6c77115-d94f-4f4c-9a32-81f391c061b1 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:48:34.072951 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c6c77115-d94f-4f4c-9a32-81f391c061b1 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:48:34.073470 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c6c77115-d94f-4f4c-9a32-81f391c061b1 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:48:34.074195 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c6c77115-d94f-4f4c-9a32-81f391c061b1 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:48:34.074681 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c6c77115-d94f-4f4c-9a32-81f391c061b1 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:48:34.075133 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c6c77115-d94f-4f4c-9a32-81f391c061b1 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:48:34.207846 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-c6c77115-d94f-4f4c-9a32-81f391c061b1 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e838176b44c4f23b470cfc152f79990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3718dd3e536649b5bf1970ff06ddea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:48:34.215728 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-c6c77115-d94f-4f4c-9a32-81f391c061b1 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/521af341-8ec9-4dc5-901f-68a80a167d46" status: 200 len: 1667 microversion: 2.1 time: 0.154732 Oct 08 21:48:34.216309 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3339/6605] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:48:34 2022] GET /compute/v2.1/servers/521af341-8ec9-4dc5-901f-68a80a167d46 => generated 1667 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:48:34.238077 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-89dffa1f-ca56-4e6c-a6d1-7316be100097 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:48:34.238589 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-89dffa1f-ca56-4e6c-a6d1-7316be100097 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: 521af341-8ec9-4dc5-901f-68a80a167d46] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:48:34.244575 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-89dffa1f-ca56-4e6c-a6d1-7316be100097 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:48:34.245076 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-89dffa1f-ca56-4e6c-a6d1-7316be100097 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:48:34.245565 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-89dffa1f-ca56-4e6c-a6d1-7316be100097 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:48:34.246276 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-89dffa1f-ca56-4e6c-a6d1-7316be100097 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:48:34.246749 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-89dffa1f-ca56-4e6c-a6d1-7316be100097 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:48:34.247209 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-89dffa1f-ca56-4e6c-a6d1-7316be100097 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:48:34.276319 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-89dffa1f-ca56-4e6c-a6d1-7316be100097 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: 521af341-8ec9-4dc5-901f-68a80a167d46] Going to try to terminate instance {{(pid=140491) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 21:48:34.352720 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-89dffa1f-ca56-4e6c-a6d1-7316be100097 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "DELETE /compute/v2.1/servers/521af341-8ec9-4dc5-901f-68a80a167d46" status: 204 len: 0 microversion: 2.1 time: 0.118503 Oct 08 21:48:34.353731 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3267/6606] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:48:34 2022] DELETE /compute/v2.1/servers/521af341-8ec9-4dc5-901f-68a80a167d46 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 21:48:34.362477 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-a1facc94-6d37-4184-8be8-26c301348ee8 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:48:34.363157 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-a1facc94-6d37-4184-8be8-26c301348ee8 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: 521af341-8ec9-4dc5-901f-68a80a167d46] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:48:34.369593 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a1facc94-6d37-4184-8be8-26c301348ee8 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:48:34.370113 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a1facc94-6d37-4184-8be8-26c301348ee8 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:48:34.370586 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a1facc94-6d37-4184-8be8-26c301348ee8 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:48:34.371314 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a1facc94-6d37-4184-8be8-26c301348ee8 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:48:34.371798 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a1facc94-6d37-4184-8be8-26c301348ee8 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:48:34.372257 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a1facc94-6d37-4184-8be8-26c301348ee8 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:48:34.502808 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-a1facc94-6d37-4184-8be8-26c301348ee8 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e838176b44c4f23b470cfc152f79990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3718dd3e536649b5bf1970ff06ddea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:48:34.510613 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-a1facc94-6d37-4184-8be8-26c301348ee8 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/521af341-8ec9-4dc5-901f-68a80a167d46" status: 200 len: 1673 microversion: 2.1 time: 0.152725 Oct 08 21:48:34.511180 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3340/6607] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:48:34 2022] GET /compute/v2.1/servers/521af341-8ec9-4dc5-901f-68a80a167d46 => generated 1673 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:48:35.534399 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-634cd313-e7e1-4490-ad06-231f7a099452 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:48:35.535548 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-634cd313-e7e1-4490-ad06-231f7a099452 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: 521af341-8ec9-4dc5-901f-68a80a167d46] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:48:35.543118 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-634cd313-e7e1-4490-ad06-231f7a099452 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:48:35.543644 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-634cd313-e7e1-4490-ad06-231f7a099452 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:48:35.544079 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-634cd313-e7e1-4490-ad06-231f7a099452 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:48:35.544794 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-634cd313-e7e1-4490-ad06-231f7a099452 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:48:35.545293 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-634cd313-e7e1-4490-ad06-231f7a099452 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:48:35.545733 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-634cd313-e7e1-4490-ad06-231f7a099452 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:48:35.683205 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-634cd313-e7e1-4490-ad06-231f7a099452 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e838176b44c4f23b470cfc152f79990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3718dd3e536649b5bf1970ff06ddea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:48:35.691965 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-634cd313-e7e1-4490-ad06-231f7a099452 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/521af341-8ec9-4dc5-901f-68a80a167d46" status: 200 len: 1673 microversion: 2.1 time: 0.161924 Oct 08 21:48:35.692560 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3268/6608] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:48:35 2022] GET /compute/v2.1/servers/521af341-8ec9-4dc5-901f-68a80a167d46 => generated 1673 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:48:36.512952 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-a56faf89-8e08-42c8-9423-6c671b608d5f req-a7583882-f4a5-4b77-a61e-1e1bbca30902 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "521af341-8ec9-4dc5-901f-68a80a167d46", "name": "network-vif-deleted", "tag": "4b829301-69ef-4c13-a79b-a380d89ef693"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:48:36.527167 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-a56faf89-8e08-42c8-9423-6c671b608d5f req-a7583882-f4a5-4b77-a61e-1e1bbca30902 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:48:36.527675 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-a56faf89-8e08-42c8-9423-6c671b608d5f req-a7583882-f4a5-4b77-a61e-1e1bbca30902 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:48:36.528130 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-a56faf89-8e08-42c8-9423-6c671b608d5f req-a7583882-f4a5-4b77-a61e-1e1bbca30902 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:48:36.541283 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-a56faf89-8e08-42c8-9423-6c671b608d5f req-a7583882-f4a5-4b77-a61e-1e1bbca30902 service nova] Creating event network-vif-deleted:4b829301-69ef-4c13-a79b-a380d89ef693 for instance 521af341-8ec9-4dc5-901f-68a80a167d46 on nch1-master-1 Oct 08 21:48:36.549266 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-a56faf89-8e08-42c8-9423-6c671b608d5f req-a7583882-f4a5-4b77-a61e-1e1bbca30902 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040136 Oct 08 21:48:36.549891 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3341/6609] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:48:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:48:36.715526 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-281a925f-6654-451f-a11b-dfb92a956afd tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:48:36.716181 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-281a925f-6654-451f-a11b-dfb92a956afd tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: 521af341-8ec9-4dc5-901f-68a80a167d46] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:48:36.724056 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-281a925f-6654-451f-a11b-dfb92a956afd tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:48:36.724560 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-281a925f-6654-451f-a11b-dfb92a956afd tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:48:36.725011 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-281a925f-6654-451f-a11b-dfb92a956afd tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:48:36.725755 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-281a925f-6654-451f-a11b-dfb92a956afd tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:48:36.726220 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-281a925f-6654-451f-a11b-dfb92a956afd tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:48:36.726703 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-281a925f-6654-451f-a11b-dfb92a956afd tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:48:36.759326 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-281a925f-6654-451f-a11b-dfb92a956afd tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:48:36.759813 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-281a925f-6654-451f-a11b-dfb92a956afd tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:48:36.760257 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-281a925f-6654-451f-a11b-dfb92a956afd tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:48:36.760710 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.objects.instance [None req-281a925f-6654-451f-a11b-dfb92a956afd tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lazy-loading 'fault' on Instance uuid 521af341-8ec9-4dc5-901f-68a80a167d46 {{(pid=140491) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 21:48:36.802781 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-281a925f-6654-451f-a11b-dfb92a956afd tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e838176b44c4f23b470cfc152f79990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3718dd3e536649b5bf1970ff06ddea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:48:36.810763 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-281a925f-6654-451f-a11b-dfb92a956afd tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/521af341-8ec9-4dc5-901f-68a80a167d46" status: 200 len: 1325 microversion: 2.1 time: 0.099101 Oct 08 21:48:36.811345 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3269/6610] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:48:36 2022] GET /compute/v2.1/servers/521af341-8ec9-4dc5-901f-68a80a167d46 => generated 1325 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:48:37.836153 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-8db3af92-7109-40c3-99db-1fb8cdea1b7e tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:48:37.836805 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-8db3af92-7109-40c3-99db-1fb8cdea1b7e tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: 521af341-8ec9-4dc5-901f-68a80a167d46] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:48:37.843148 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8db3af92-7109-40c3-99db-1fb8cdea1b7e tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:48:37.843662 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8db3af92-7109-40c3-99db-1fb8cdea1b7e tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:48:37.844129 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8db3af92-7109-40c3-99db-1fb8cdea1b7e tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:48:37.844863 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8db3af92-7109-40c3-99db-1fb8cdea1b7e tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:48:37.845396 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8db3af92-7109-40c3-99db-1fb8cdea1b7e tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:48:37.845872 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8db3af92-7109-40c3-99db-1fb8cdea1b7e tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:48:37.850038 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=100 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:48:37.860065 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-8db3af92-7109-40c3-99db-1fb8cdea1b7e tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] HTTP exception thrown: Instance 521af341-8ec9-4dc5-901f-68a80a167d46 could not be found. Oct 08 21:48:37.861802 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-8db3af92-7109-40c3-99db-1fb8cdea1b7e tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Request method failure captured: Oct 08 21:48:37.861802 ncdv-master-1 devstack@n-api.service[140492]: request: GET /compute/v2.1/servers/521af341-8ec9-4dc5-901f-68a80a167d46 HTTP/1.1 Oct 08 21:48:37.861802 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:48:37.861802 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:48:37.861802 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:48:37.861802 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 21:48:37.861802 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:48:37.861802 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:48:37.861802 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:48:37.861802 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:48:37.861802 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQe9X_YMmNKk_IiLIrhiybTebPLsigD2oA9w_czixVt5baNHq-v99rHVO91kLbytmMA9O9LoejjDppyvtcuO0H46ugJTY6ixLOqtY6uw1GAjA-8XlGpO40NZ8LLPXXTy7eheVZj7WNy7D46LDg2xb5lZmDKadBVs_1JcZ4-Tt9c91XNk Oct 08 21:48:37.861802 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:48:37.861802 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:48:37.861802 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:48:37.861802 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:48:37.861802 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:48:37.861802 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:48:37.861802 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 3718dd3e536649b5bf1970ff06ddea69 Oct 08 21:48:37.861802 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-ServerActionsTestJSON-775805645 Oct 08 21:48:37.861802 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:48:37.861802 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:48:37.861802 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3718dd3e536649b5bf1970ff06ddea69"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3718dd3e536649b5bf1970ff06ddea69"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3718dd3e536649b5bf1970ff06ddea69"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3718dd3e536649b5bf1970ff06ddea69"}]}] Oct 08 21:48:37.861802 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-ServerActionsTestJSON-775805645 Oct 08 21:48:37.861802 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 3718dd3e536649b5bf1970ff06ddea69 Oct 08 21:48:37.861802 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-ServerActionsTestJSON-775805645 Oct 08 21:48:37.861802 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-ServerActionsTestJSON-775805645-project Oct 08 21:48:37.861802 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:48:37.861802 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:48:37.861802 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 5e838176b44c4f23b470cfc152f79990 Oct 08 21:48:37.861802 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-ServerActionsTestJSON-775805645-project Oct 08 21:48:37.861802 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 21:48:37.861802 ncdv-master-1 devstack@n-api.service[140492]: exception: Instance 521af341-8ec9-4dc5-901f-68a80a167d46 could not be found. Oct 08 21:48:37.861802 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': '521af341-8ec9-4dc5-901f-68a80a167d46'} Oct 08 21:48:37.861802 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:48:37.861802 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:48:37.861802 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:48:37.861802 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:48:37.861802 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:48:37.861802 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:48:37.861802 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:48:37.861802 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:48:37.861802 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:48:37.861802 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:48:37.861802 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 521af341-8ec9-4dc5-901f-68a80a167d46 could not be found. Oct 08 21:48:37.861802 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:48:37.861802 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:48:37.861802 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:48:37.861802 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:48:37.861802 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:48:37.861802 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:48:37.861802 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:48:37.861802 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:48:37.861802 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:48:37.861802 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:48:37.861802 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:48:37.861802 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:48:37.861802 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:48:37.861802 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:48:37.861802 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:48:37.861802 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:48:37.861802 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 521af341-8ec9-4dc5-901f-68a80a167d46 could not be found. Oct 08 21:48:37.861802 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:48:37.861802 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:48:37.861802 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:48:37.867056 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:48:37.867056 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:48:37.867056 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:48:37.867056 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:48:37.867056 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:48:37.867056 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 521af341-8ec9-4dc5-901f-68a80a167d46 could not be found. Oct 08 21:48:37.867056 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:48:37.867056 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-8db3af92-7109-40c3-99db-1fb8cdea1b7e tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Returning 404 to user: Instance 521af341-8ec9-4dc5-901f-68a80a167d46 could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:48:37.867056 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-8db3af92-7109-40c3-99db-1fb8cdea1b7e tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/521af341-8ec9-4dc5-901f-68a80a167d46" status: 404 len: 111 microversion: 2.1 time: 0.032992 Oct 08 21:48:37.867056 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3342/6611] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:48:37 2022] GET /compute/v2.1/servers/521af341-8ec9-4dc5-901f-68a80a167d46 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:48:37.878973 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-f99d38c9-fd4a-4e4d-85ce-d89f71939380 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:48:37.879615 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-f99d38c9-fd4a-4e4d-85ce-d89f71939380 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: 521af341-8ec9-4dc5-901f-68a80a167d46] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:48:37.881712 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=3 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:48:37.888254 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f99d38c9-fd4a-4e4d-85ce-d89f71939380 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:48:37.888754 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f99d38c9-fd4a-4e4d-85ce-d89f71939380 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:48:37.889247 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f99d38c9-fd4a-4e4d-85ce-d89f71939380 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:48:37.889940 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f99d38c9-fd4a-4e4d-85ce-d89f71939380 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:48:37.890407 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f99d38c9-fd4a-4e4d-85ce-d89f71939380 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:48:37.890847 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f99d38c9-fd4a-4e4d-85ce-d89f71939380 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:48:37.905053 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-f99d38c9-fd4a-4e4d-85ce-d89f71939380 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] HTTP exception thrown: Instance 521af341-8ec9-4dc5-901f-68a80a167d46 could not be found. Oct 08 21:48:37.906750 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-f99d38c9-fd4a-4e4d-85ce-d89f71939380 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Request method failure captured: Oct 08 21:48:37.906750 ncdv-master-1 devstack@n-api.service[140491]: request: GET /compute/v2.1/servers/521af341-8ec9-4dc5-901f-68a80a167d46 HTTP/1.1 Oct 08 21:48:37.906750 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:48:37.906750 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:48:37.906750 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:48:37.906750 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 21:48:37.906750 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:48:37.906750 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:48:37.906750 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:48:37.906750 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:48:37.906750 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQe9X_YMmNKk_IiLIrhiybTebPLsigD2oA9w_czixVt5baNHq-v99rHVO91kLbytmMA9O9LoejjDppyvtcuO0H46ugJTY6ixLOqtY6uw1GAjA-8XlGpO40NZ8LLPXXTy7eheVZj7WNy7D46LDg2xb5lZmDKadBVs_1JcZ4-Tt9c91XNk Oct 08 21:48:37.906750 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:48:37.906750 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:48:37.906750 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:48:37.906750 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:48:37.906750 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:48:37.906750 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:48:37.906750 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 3718dd3e536649b5bf1970ff06ddea69 Oct 08 21:48:37.906750 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-ServerActionsTestJSON-775805645 Oct 08 21:48:37.906750 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:48:37.906750 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:48:37.906750 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3718dd3e536649b5bf1970ff06ddea69"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3718dd3e536649b5bf1970ff06ddea69"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3718dd3e536649b5bf1970ff06ddea69"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3718dd3e536649b5bf1970ff06ddea69"}]}] Oct 08 21:48:37.906750 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-ServerActionsTestJSON-775805645 Oct 08 21:48:37.906750 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 3718dd3e536649b5bf1970ff06ddea69 Oct 08 21:48:37.906750 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-ServerActionsTestJSON-775805645 Oct 08 21:48:37.906750 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-ServerActionsTestJSON-775805645-project Oct 08 21:48:37.906750 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:48:37.906750 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:48:37.906750 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 5e838176b44c4f23b470cfc152f79990 Oct 08 21:48:37.906750 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-ServerActionsTestJSON-775805645-project Oct 08 21:48:37.906750 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:48:37.906750 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance 521af341-8ec9-4dc5-901f-68a80a167d46 could not be found. Oct 08 21:48:37.906750 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': '521af341-8ec9-4dc5-901f-68a80a167d46'} Oct 08 21:48:37.906750 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:48:37.906750 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:48:37.906750 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:48:37.906750 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:48:37.906750 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:48:37.906750 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:48:37.906750 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:48:37.906750 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:48:37.906750 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:48:37.906750 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:48:37.906750 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 521af341-8ec9-4dc5-901f-68a80a167d46 could not be found. Oct 08 21:48:37.906750 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:48:37.906750 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:48:37.906750 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:48:37.906750 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:48:37.906750 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:48:37.906750 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:48:37.906750 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:48:37.906750 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:48:37.906750 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:48:37.906750 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:48:37.906750 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:48:37.906750 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:48:37.906750 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:48:37.906750 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:48:37.906750 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:48:37.906750 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:48:37.906750 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 521af341-8ec9-4dc5-901f-68a80a167d46 could not be found. Oct 08 21:48:37.906750 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:48:37.906750 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:48:37.906750 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:48:37.911958 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:48:37.911958 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:48:37.911958 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:48:37.911958 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:48:37.911958 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:48:37.911958 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 521af341-8ec9-4dc5-901f-68a80a167d46 could not be found. Oct 08 21:48:37.911958 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:48:37.911958 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-f99d38c9-fd4a-4e4d-85ce-d89f71939380 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Returning 404 to user: Instance 521af341-8ec9-4dc5-901f-68a80a167d46 could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:48:37.911958 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-f99d38c9-fd4a-4e4d-85ce-d89f71939380 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/521af341-8ec9-4dc5-901f-68a80a167d46" status: 404 len: 111 microversion: 2.1 time: 0.033575 Oct 08 21:48:37.911958 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3270/6612] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:48:37 2022] GET /compute/v2.1/servers/521af341-8ec9-4dc5-901f-68a80a167d46 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:48:37.958058 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-7be711f1-3ca3-4d71-b71a-9f7648c27eda tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-832099076", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "networks": [{"uuid": "99fc871d-a990-4798-830c-471348036e9e"}], "security_groups": [{"name": "tempest-securitygroup--1818474219"}], "key_name": "tempest-keypair-1142039836", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:48:38.062232 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.network.neutron [None req-7be711f1-3ca3-4d71-b71a-9f7648c27eda tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] validate_networks() for [('99fc871d-a990-4798-830c-471348036e9e', None, None, None, None, None)] {{(pid=140492) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 21:48:38.426947 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-7be711f1-3ca3-4d71-b71a-9f7648c27eda tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Flavor limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 21:48:38.427396 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-7be711f1-3ca3-4d71-b71a-9f7648c27eda tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Image limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 21:48:38.427900 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-7be711f1-3ca3-4d71-b71a-9f7648c27eda tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Flavor pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 21:48:38.428336 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-7be711f1-3ca3-4d71-b71a-9f7648c27eda tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Image pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 21:48:38.428773 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-7be711f1-3ca3-4d71-b71a-9f7648c27eda tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 21:48:38.437773 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7be711f1-3ca3-4d71-b71a-9f7648c27eda tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:48:38.438279 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7be711f1-3ca3-4d71-b71a-9f7648c27eda tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:48:38.438737 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7be711f1-3ca3-4d71-b71a-9f7648c27eda tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:48:38.439530 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7be711f1-3ca3-4d71-b71a-9f7648c27eda tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:48:38.440009 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7be711f1-3ca3-4d71-b71a-9f7648c27eda tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:48:38.440457 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7be711f1-3ca3-4d71-b71a-9f7648c27eda tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:48:38.457633 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-7be711f1-3ca3-4d71-b71a-9f7648c27eda tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Getting quotas for project 3718dd3e536649b5bf1970ff06ddea69. Resources: {'cores', 'instances', 'ram'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:48:38.463193 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-7be711f1-3ca3-4d71-b71a-9f7648c27eda tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Getting quotas for user 5e838176b44c4f23b470cfc152f79990 and project 3718dd3e536649b5bf1970ff06ddea69. Resources: {'cores', 'instances', 'ram'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:48:38.476975 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-7be711f1-3ca3-4d71-b71a-9f7648c27eda tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Going to run 1 instances... {{(pid=140492) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 21:48:38.479412 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-7be711f1-3ca3-4d71-b71a-9f7648c27eda tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: fc217b69-e791-45d2-95eb-c76defe17db7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c508bd7f-7db9-4b2c-af7c-be54a855c355',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140492) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 21:48:38.527302 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-7be711f1-3ca3-4d71-b71a-9f7648c27eda tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.573735 Oct 08 21:48:38.527955 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3343/6613] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 21:48:37 2022] POST /compute/v2.1/servers => generated 406 bytes in 575 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 08 21:48:38.539781 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-a9b336f2-f196-431c-8e41-7ec0a3f9fd33 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:48:38.540396 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-a9b336f2-f196-431c-8e41-7ec0a3f9fd33 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: fc217b69-e791-45d2-95eb-c76defe17db7] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:48:38.596316 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-a9b336f2-f196-431c-8e41-7ec0a3f9fd33 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e838176b44c4f23b470cfc152f79990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3718dd3e536649b5bf1970ff06ddea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:48:38.603485 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-a9b336f2-f196-431c-8e41-7ec0a3f9fd33 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/fc217b69-e791-45d2-95eb-c76defe17db7" status: 200 len: 1238 microversion: 2.1 time: 0.067551 Oct 08 21:48:38.604057 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3271/6614] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:48:38 2022] GET /compute/v2.1/servers/fc217b69-e791-45d2-95eb-c76defe17db7 => generated 1238 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:48:39.629663 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-24dbbbea-32e3-4c26-ba28-51d7650d06f3 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:48:39.630457 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-24dbbbea-32e3-4c26-ba28-51d7650d06f3 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: fc217b69-e791-45d2-95eb-c76defe17db7] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:48:39.634415 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=3 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:48:39.638569 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-24dbbbea-32e3-4c26-ba28-51d7650d06f3 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:48:39.639100 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-24dbbbea-32e3-4c26-ba28-51d7650d06f3 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:48:39.639569 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-24dbbbea-32e3-4c26-ba28-51d7650d06f3 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:48:39.640318 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-24dbbbea-32e3-4c26-ba28-51d7650d06f3 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:48:39.640810 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-24dbbbea-32e3-4c26-ba28-51d7650d06f3 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:48:39.641299 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-24dbbbea-32e3-4c26-ba28-51d7650d06f3 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:48:39.721567 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-24dbbbea-32e3-4c26-ba28-51d7650d06f3 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e838176b44c4f23b470cfc152f79990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3718dd3e536649b5bf1970ff06ddea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:48:39.729537 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-24dbbbea-32e3-4c26-ba28-51d7650d06f3 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/fc217b69-e791-45d2-95eb-c76defe17db7" status: 200 len: 1296 microversion: 2.1 time: 0.106147 Oct 08 21:48:39.730387 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3344/6615] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:48:39 2022] GET /compute/v2.1/servers/fc217b69-e791-45d2-95eb-c76defe17db7 => generated 1296 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:48:40.755172 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-b622b30f-3fbd-4316-ba2d-2cb131afa00c tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:48:40.756040 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-b622b30f-3fbd-4316-ba2d-2cb131afa00c tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: fc217b69-e791-45d2-95eb-c76defe17db7] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:48:40.759515 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=2 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:48:40.766112 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b622b30f-3fbd-4316-ba2d-2cb131afa00c tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:48:40.766618 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b622b30f-3fbd-4316-ba2d-2cb131afa00c tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:48:40.767071 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b622b30f-3fbd-4316-ba2d-2cb131afa00c tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:48:40.768444 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b622b30f-3fbd-4316-ba2d-2cb131afa00c tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:48:40.769242 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b622b30f-3fbd-4316-ba2d-2cb131afa00c tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:48:40.769680 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b622b30f-3fbd-4316-ba2d-2cb131afa00c tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:48:40.911439 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-b622b30f-3fbd-4316-ba2d-2cb131afa00c tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e838176b44c4f23b470cfc152f79990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3718dd3e536649b5bf1970ff06ddea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:48:40.919218 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-b622b30f-3fbd-4316-ba2d-2cb131afa00c tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/fc217b69-e791-45d2-95eb-c76defe17db7" status: 200 len: 1364 microversion: 2.1 time: 0.169932 Oct 08 21:48:40.919792 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3272/6616] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:48:40 2022] GET /compute/v2.1/servers/fc217b69-e791-45d2-95eb-c76defe17db7 => generated 1364 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:48:41.193744 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-9d8b30af-9837-4111-92a9-5aa70b61e54f req-72624365-8591-4c33-896d-0b1404254838 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc217b69-e791-45d2-95eb-c76defe17db7", "tag": "d5f56a74-2ae4-45c6-bd45-8116441f198c"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:48:41.207949 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-9d8b30af-9837-4111-92a9-5aa70b61e54f req-72624365-8591-4c33-896d-0b1404254838 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:48:41.208543 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-9d8b30af-9837-4111-92a9-5aa70b61e54f req-72624365-8591-4c33-896d-0b1404254838 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:48:41.209084 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-9d8b30af-9837-4111-92a9-5aa70b61e54f req-72624365-8591-4c33-896d-0b1404254838 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:48:41.222341 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-9d8b30af-9837-4111-92a9-5aa70b61e54f req-72624365-8591-4c33-896d-0b1404254838 service nova] Creating event network-changed:d5f56a74-2ae4-45c6-bd45-8116441f198c for instance fc217b69-e791-45d2-95eb-c76defe17db7 on nch2-master-1 Oct 08 21:48:41.227533 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-9d8b30af-9837-4111-92a9-5aa70b61e54f req-72624365-8591-4c33-896d-0b1404254838 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039179 Oct 08 21:48:41.228145 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3345/6617] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:48:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:48:41.943155 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-ad826b10-5eaa-4d34-8af6-c9b95e37b57c tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:48:41.943703 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-ad826b10-5eaa-4d34-8af6-c9b95e37b57c tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: fc217b69-e791-45d2-95eb-c76defe17db7] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:48:41.950608 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ad826b10-5eaa-4d34-8af6-c9b95e37b57c tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:48:41.951120 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ad826b10-5eaa-4d34-8af6-c9b95e37b57c tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:48:41.951559 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ad826b10-5eaa-4d34-8af6-c9b95e37b57c tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:48:41.952255 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ad826b10-5eaa-4d34-8af6-c9b95e37b57c tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:48:41.952712 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ad826b10-5eaa-4d34-8af6-c9b95e37b57c tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:48:41.953141 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ad826b10-5eaa-4d34-8af6-c9b95e37b57c tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:48:42.080631 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-ad826b10-5eaa-4d34-8af6-c9b95e37b57c tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e838176b44c4f23b470cfc152f79990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3718dd3e536649b5bf1970ff06ddea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:48:42.089062 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-ad826b10-5eaa-4d34-8af6-c9b95e37b57c tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/fc217b69-e791-45d2-95eb-c76defe17db7" status: 200 len: 1364 microversion: 2.1 time: 0.150217 Oct 08 21:48:42.089660 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3273/6618] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:48:41 2022] GET /compute/v2.1/servers/fc217b69-e791-45d2-95eb-c76defe17db7 => generated 1364 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:48:43.113368 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-fe08f115-cd77-45bb-aa68-825b37c29edd tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:48:43.114098 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-fe08f115-cd77-45bb-aa68-825b37c29edd tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: fc217b69-e791-45d2-95eb-c76defe17db7] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:48:43.121335 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fe08f115-cd77-45bb-aa68-825b37c29edd tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:48:43.121847 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fe08f115-cd77-45bb-aa68-825b37c29edd tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:48:43.122312 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fe08f115-cd77-45bb-aa68-825b37c29edd tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:48:43.123037 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fe08f115-cd77-45bb-aa68-825b37c29edd tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:48:43.123518 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fe08f115-cd77-45bb-aa68-825b37c29edd tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:48:43.123967 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fe08f115-cd77-45bb-aa68-825b37c29edd tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:48:43.260732 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-fe08f115-cd77-45bb-aa68-825b37c29edd tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e838176b44c4f23b470cfc152f79990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3718dd3e536649b5bf1970ff06ddea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:48:43.269158 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-fe08f115-cd77-45bb-aa68-825b37c29edd tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/fc217b69-e791-45d2-95eb-c76defe17db7" status: 200 len: 1364 microversion: 2.1 time: 0.160258 Oct 08 21:48:43.269744 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3346/6619] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:48:43 2022] GET /compute/v2.1/servers/fc217b69-e791-45d2-95eb-c76defe17db7 => generated 1364 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:48:44.292590 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-8faec34d-eb69-416a-bc4b-f33edd0f7338 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:48:44.293217 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-8faec34d-eb69-416a-bc4b-f33edd0f7338 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: fc217b69-e791-45d2-95eb-c76defe17db7] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:48:44.300159 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8faec34d-eb69-416a-bc4b-f33edd0f7338 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:48:44.300647 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8faec34d-eb69-416a-bc4b-f33edd0f7338 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:48:44.301085 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8faec34d-eb69-416a-bc4b-f33edd0f7338 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:48:44.302317 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8faec34d-eb69-416a-bc4b-f33edd0f7338 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:48:44.302773 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8faec34d-eb69-416a-bc4b-f33edd0f7338 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:48:44.303199 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8faec34d-eb69-416a-bc4b-f33edd0f7338 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:48:44.438422 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-8faec34d-eb69-416a-bc4b-f33edd0f7338 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e838176b44c4f23b470cfc152f79990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3718dd3e536649b5bf1970ff06ddea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:48:44.447145 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-8faec34d-eb69-416a-bc4b-f33edd0f7338 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/fc217b69-e791-45d2-95eb-c76defe17db7" status: 200 len: 1364 microversion: 2.1 time: 0.158408 Oct 08 21:48:44.447662 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3274/6620] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:48:44 2022] GET /compute/v2.1/servers/fc217b69-e791-45d2-95eb-c76defe17db7 => generated 1364 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:48:45.470698 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-d601c401-53af-4a71-9e87-327557a4a5c9 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:48:45.471339 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-d601c401-53af-4a71-9e87-327557a4a5c9 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: fc217b69-e791-45d2-95eb-c76defe17db7] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:48:45.478485 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d601c401-53af-4a71-9e87-327557a4a5c9 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:48:45.479004 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d601c401-53af-4a71-9e87-327557a4a5c9 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:48:45.479474 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d601c401-53af-4a71-9e87-327557a4a5c9 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:48:45.480210 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d601c401-53af-4a71-9e87-327557a4a5c9 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:48:45.480855 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d601c401-53af-4a71-9e87-327557a4a5c9 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:48:45.481135 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d601c401-53af-4a71-9e87-327557a4a5c9 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:48:45.613170 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-d601c401-53af-4a71-9e87-327557a4a5c9 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e838176b44c4f23b470cfc152f79990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3718dd3e536649b5bf1970ff06ddea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:48:45.621910 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-d601c401-53af-4a71-9e87-327557a4a5c9 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/fc217b69-e791-45d2-95eb-c76defe17db7" status: 200 len: 1364 microversion: 2.1 time: 0.155218 Oct 08 21:48:45.622709 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3347/6621] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:48:45 2022] GET /compute/v2.1/servers/fc217b69-e791-45d2-95eb-c76defe17db7 => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:48:45.732269 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-446b2cdf-a21c-46aa-81db-95b718ab94a9 req-281cd4b8-7176-438a-9337-c5cc8d703ea6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc217b69-e791-45d2-95eb-c76defe17db7", "name": "network-vif-plugged", "status": "completed", "tag": "d5f56a74-2ae4-45c6-bd45-8116441f198c"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:48:45.752631 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-446b2cdf-a21c-46aa-81db-95b718ab94a9 req-281cd4b8-7176-438a-9337-c5cc8d703ea6 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:48:45.753262 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-446b2cdf-a21c-46aa-81db-95b718ab94a9 req-281cd4b8-7176-438a-9337-c5cc8d703ea6 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:48:45.753768 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-446b2cdf-a21c-46aa-81db-95b718ab94a9 req-281cd4b8-7176-438a-9337-c5cc8d703ea6 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:48:45.769138 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-446b2cdf-a21c-46aa-81db-95b718ab94a9 req-281cd4b8-7176-438a-9337-c5cc8d703ea6 service nova] Creating event network-vif-plugged:d5f56a74-2ae4-45c6-bd45-8116441f198c for instance fc217b69-e791-45d2-95eb-c76defe17db7 on nch2-master-1 Oct 08 21:48:45.775086 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-446b2cdf-a21c-46aa-81db-95b718ab94a9 req-281cd4b8-7176-438a-9337-c5cc8d703ea6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046513 Oct 08 21:48:45.775633 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3275/6622] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:48:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:48:46.646335 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-52cabf3c-7c53-4f4f-9401-f7643518ab0c tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:48:46.646980 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-52cabf3c-7c53-4f4f-9401-f7643518ab0c tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: fc217b69-e791-45d2-95eb-c76defe17db7] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:48:46.654061 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-52cabf3c-7c53-4f4f-9401-f7643518ab0c tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:48:46.654581 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-52cabf3c-7c53-4f4f-9401-f7643518ab0c tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:48:46.655050 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-52cabf3c-7c53-4f4f-9401-f7643518ab0c tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:48:46.655779 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-52cabf3c-7c53-4f4f-9401-f7643518ab0c tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:48:46.656276 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-52cabf3c-7c53-4f4f-9401-f7643518ab0c tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:48:46.656735 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-52cabf3c-7c53-4f4f-9401-f7643518ab0c tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:48:46.788887 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-52cabf3c-7c53-4f4f-9401-f7643518ab0c tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e838176b44c4f23b470cfc152f79990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3718dd3e536649b5bf1970ff06ddea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:48:46.796793 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-52cabf3c-7c53-4f4f-9401-f7643518ab0c tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/fc217b69-e791-45d2-95eb-c76defe17db7" status: 200 len: 1364 microversion: 2.1 time: 0.154976 Oct 08 21:48:46.797399 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3348/6623] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:48:46 2022] GET /compute/v2.1/servers/fc217b69-e791-45d2-95eb-c76defe17db7 => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:48:47.821772 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-a965c433-2fcb-4bc0-804e-f6c6f3c0b95a tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:48:47.822428 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-a965c433-2fcb-4bc0-804e-f6c6f3c0b95a tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: fc217b69-e791-45d2-95eb-c76defe17db7] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:48:47.828756 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a965c433-2fcb-4bc0-804e-f6c6f3c0b95a tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:48:47.829283 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a965c433-2fcb-4bc0-804e-f6c6f3c0b95a tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:48:47.829731 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a965c433-2fcb-4bc0-804e-f6c6f3c0b95a tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:48:47.830436 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a965c433-2fcb-4bc0-804e-f6c6f3c0b95a tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:48:47.830896 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a965c433-2fcb-4bc0-804e-f6c6f3c0b95a tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:48:47.831330 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a965c433-2fcb-4bc0-804e-f6c6f3c0b95a tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:48:47.960760 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-a965c433-2fcb-4bc0-804e-f6c6f3c0b95a tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e838176b44c4f23b470cfc152f79990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3718dd3e536649b5bf1970ff06ddea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:48:47.968524 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-a965c433-2fcb-4bc0-804e-f6c6f3c0b95a tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/fc217b69-e791-45d2-95eb-c76defe17db7" status: 200 len: 1552 microversion: 2.1 time: 0.151998 Oct 08 21:48:47.969100 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3276/6624] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:48:47 2022] GET /compute/v2.1/servers/fc217b69-e791-45d2-95eb-c76defe17db7 => generated 1552 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:48:47.992770 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-92e13ec6-8337-44a2-910a-1c3bef0f1761 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:48:47.993158 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-92e13ec6-8337-44a2-910a-1c3bef0f1761 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: fc217b69-e791-45d2-95eb-c76defe17db7] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:48:48.000158 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-92e13ec6-8337-44a2-910a-1c3bef0f1761 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:48:48.000664 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-92e13ec6-8337-44a2-910a-1c3bef0f1761 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:48:48.001146 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-92e13ec6-8337-44a2-910a-1c3bef0f1761 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:48:48.001892 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-92e13ec6-8337-44a2-910a-1c3bef0f1761 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:48:48.002370 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-92e13ec6-8337-44a2-910a-1c3bef0f1761 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:48:48.002818 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-92e13ec6-8337-44a2-910a-1c3bef0f1761 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:48:48.079056 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-92e13ec6-8337-44a2-910a-1c3bef0f1761 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/fc217b69-e791-45d2-95eb-c76defe17db7/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091261 Oct 08 21:48:48.079657 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3349/6625] 10.222.0.26 () {58 vars in 1275 bytes} [Sat Oct 8 21:48:47 2022] GET /compute/v2.1/servers/fc217b69-e791-45d2-95eb-c76defe17db7/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:48:49.013533 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-18301693-6688-4645-83d4-1f07289c528e req-11dde93d-1466-4009-83f5-3c3259feb39e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc217b69-e791-45d2-95eb-c76defe17db7", "tag": "d5f56a74-2ae4-45c6-bd45-8116441f198c"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:48:49.018939 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=2 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:48:49.026274 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-18301693-6688-4645-83d4-1f07289c528e req-11dde93d-1466-4009-83f5-3c3259feb39e service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:48:49.026846 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-18301693-6688-4645-83d4-1f07289c528e req-11dde93d-1466-4009-83f5-3c3259feb39e service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:48:49.027380 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-18301693-6688-4645-83d4-1f07289c528e req-11dde93d-1466-4009-83f5-3c3259feb39e service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:48:49.039855 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-18301693-6688-4645-83d4-1f07289c528e req-11dde93d-1466-4009-83f5-3c3259feb39e service nova] Creating event network-changed:d5f56a74-2ae4-45c6-bd45-8116441f198c for instance fc217b69-e791-45d2-95eb-c76defe17db7 on nch2-master-1 Oct 08 21:48:49.045226 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-18301693-6688-4645-83d4-1f07289c528e req-11dde93d-1466-4009-83f5-3c3259feb39e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035308 Oct 08 21:48:49.046134 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3277/6626] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:48:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:49:23.271966 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=2 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:49:23.273278 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=6 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:49:23.275266 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=11 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:49:23.275993 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=32 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:49:23.281319 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-fdf65ed0-3279-4cb2-8c69-46ac5a2a173c tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:49:23.281958 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-fdf65ed0-3279-4cb2-8c69-46ac5a2a173c tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: fc217b69-e791-45d2-95eb-c76defe17db7] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:49:23.290418 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fdf65ed0-3279-4cb2-8c69-46ac5a2a173c tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:49:23.290931 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fdf65ed0-3279-4cb2-8c69-46ac5a2a173c tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:49:23.291394 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fdf65ed0-3279-4cb2-8c69-46ac5a2a173c tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:49:23.292114 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fdf65ed0-3279-4cb2-8c69-46ac5a2a173c tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:49:23.292599 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fdf65ed0-3279-4cb2-8c69-46ac5a2a173c tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:49:23.293054 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fdf65ed0-3279-4cb2-8c69-46ac5a2a173c tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:49:23.488306 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-fdf65ed0-3279-4cb2-8c69-46ac5a2a173c tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e838176b44c4f23b470cfc152f79990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3718dd3e536649b5bf1970ff06ddea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:49:23.496818 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-fdf65ed0-3279-4cb2-8c69-46ac5a2a173c tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/fc217b69-e791-45d2-95eb-c76defe17db7" status: 200 len: 1670 microversion: 2.1 time: 0.225676 Oct 08 21:49:23.497407 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3350/6627] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:49:23 2022] GET /compute/v2.1/servers/fc217b69-e791-45d2-95eb-c76defe17db7 => generated 1670 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:49:23.519634 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-89fd5ccb-ba33-42da-a00b-47216a8c9efd tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d9a80439-6df2-422f-8a08-47768518e62c"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:49:23.522095 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-89fd5ccb-ba33-42da-a00b-47216a8c9efd tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: fc217b69-e791-45d2-95eb-c76defe17db7] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:49:23.524526 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:SELECT=11 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:49:23.525260 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:49:23.532420 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-89fd5ccb-ba33-42da-a00b-47216a8c9efd tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:49:23.532910 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-89fd5ccb-ba33-42da-a00b-47216a8c9efd tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:49:23.533383 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-89fd5ccb-ba33-42da-a00b-47216a8c9efd tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:49:23.534089 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-89fd5ccb-ba33-42da-a00b-47216a8c9efd tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:49:23.534546 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-89fd5ccb-ba33-42da-a00b-47216a8c9efd tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:49:23.534979 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-89fd5ccb-ba33-42da-a00b-47216a8c9efd tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:49:23.958821 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-89fd5ccb-ba33-42da-a00b-47216a8c9efd tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "POST /compute/v2.1/servers/fc217b69-e791-45d2-95eb-c76defe17db7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.443296 Oct 08 21:49:23.960618 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3278/6628] 10.222.0.26 () {60 vars in 1323 bytes} [Sat Oct 8 21:49:23 2022] POST /compute/v2.1/servers/fc217b69-e791-45d2-95eb-c76defe17db7/os-volume_attachments => generated 194 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:49:27.265333 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-ccbbf63f-9347-49e5-9cde-dff212524ec8 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:49:27.267728 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-ccbbf63f-9347-49e5-9cde-dff212524ec8 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: fc217b69-e791-45d2-95eb-c76defe17db7] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:49:27.274710 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ccbbf63f-9347-49e5-9cde-dff212524ec8 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:49:27.275217 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ccbbf63f-9347-49e5-9cde-dff212524ec8 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:49:27.275676 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ccbbf63f-9347-49e5-9cde-dff212524ec8 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:49:27.276389 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ccbbf63f-9347-49e5-9cde-dff212524ec8 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:49:27.277061 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ccbbf63f-9347-49e5-9cde-dff212524ec8 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:49:27.277554 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ccbbf63f-9347-49e5-9cde-dff212524ec8 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:49:27.306320 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-ccbbf63f-9347-49e5-9cde-dff212524ec8 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '5e838176b44c4f23b470cfc152f79990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3718dd3e536649b5bf1970ff06ddea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:49:27.311814 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-ccbbf63f-9347-49e5-9cde-dff212524ec8 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: fc217b69-e791-45d2-95eb-c76defe17db7] Old instance type m1.heat2, new instance type m1.heat {{(pid=140492) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 08 21:49:27.319721 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-ccbbf63f-9347-49e5-9cde-dff212524ec8 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Flavor limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 21:49:27.320165 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-ccbbf63f-9347-49e5-9cde-dff212524ec8 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Image limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 21:49:27.320660 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-ccbbf63f-9347-49e5-9cde-dff212524ec8 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Flavor pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 21:49:27.321094 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-ccbbf63f-9347-49e5-9cde-dff212524ec8 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Image pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 21:49:27.321549 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-ccbbf63f-9347-49e5-9cde-dff212524ec8 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 21:49:27.384532 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-ccbbf63f-9347-49e5-9cde-dff212524ec8 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "POST /compute/v2.1/servers/fc217b69-e791-45d2-95eb-c76defe17db7/action" status: 202 len: 0 microversion: 2.1 time: 0.123191 Oct 08 21:49:27.385149 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3351/6629] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:49:27 2022] POST /compute/v2.1/servers/fc217b69-e791-45d2-95eb-c76defe17db7/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 21:49:27.394822 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-7e47f075-92d2-4ebe-86f8-6d2a5511e827 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:49:27.395621 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-7e47f075-92d2-4ebe-86f8-6d2a5511e827 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: fc217b69-e791-45d2-95eb-c76defe17db7] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:49:27.402046 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7e47f075-92d2-4ebe-86f8-6d2a5511e827 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:49:27.402485 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7e47f075-92d2-4ebe-86f8-6d2a5511e827 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:49:27.402988 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7e47f075-92d2-4ebe-86f8-6d2a5511e827 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:49:27.403711 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7e47f075-92d2-4ebe-86f8-6d2a5511e827 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:49:27.404194 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7e47f075-92d2-4ebe-86f8-6d2a5511e827 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:49:27.404624 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7e47f075-92d2-4ebe-86f8-6d2a5511e827 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:49:27.540999 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-7e47f075-92d2-4ebe-86f8-6d2a5511e827 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e838176b44c4f23b470cfc152f79990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3718dd3e536649b5bf1970ff06ddea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:49:27.549467 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-7e47f075-92d2-4ebe-86f8-6d2a5511e827 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/fc217b69-e791-45d2-95eb-c76defe17db7" status: 200 len: 1725 microversion: 2.1 time: 0.159876 Oct 08 21:49:27.550051 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3279/6630] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:49:27 2022] GET /compute/v2.1/servers/fc217b69-e791-45d2-95eb-c76defe17db7 => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:49:28.574889 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-b8d025cb-93c7-4ac6-94c4-461f30960540 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:49:28.575532 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-b8d025cb-93c7-4ac6-94c4-461f30960540 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: fc217b69-e791-45d2-95eb-c76defe17db7] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:49:28.583295 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b8d025cb-93c7-4ac6-94c4-461f30960540 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:49:28.583818 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b8d025cb-93c7-4ac6-94c4-461f30960540 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:49:28.584287 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b8d025cb-93c7-4ac6-94c4-461f30960540 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:49:28.585027 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b8d025cb-93c7-4ac6-94c4-461f30960540 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:49:28.585549 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b8d025cb-93c7-4ac6-94c4-461f30960540 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:49:28.586011 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b8d025cb-93c7-4ac6-94c4-461f30960540 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:49:28.806019 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-b8d025cb-93c7-4ac6-94c4-461f30960540 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e838176b44c4f23b470cfc152f79990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3718dd3e536649b5bf1970ff06ddea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:49:28.814336 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-b8d025cb-93c7-4ac6-94c4-461f30960540 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/fc217b69-e791-45d2-95eb-c76defe17db7" status: 200 len: 1725 microversion: 2.1 time: 0.245085 Oct 08 21:49:28.814926 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3352/6631] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:49:28 2022] GET /compute/v2.1/servers/fc217b69-e791-45d2-95eb-c76defe17db7 => generated 1725 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:49:29.838445 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-38336956-6062-41a6-99c1-7667887766f8 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:49:29.838967 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-38336956-6062-41a6-99c1-7667887766f8 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: fc217b69-e791-45d2-95eb-c76defe17db7] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:49:29.845870 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-38336956-6062-41a6-99c1-7667887766f8 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:49:29.846361 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-38336956-6062-41a6-99c1-7667887766f8 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:49:29.846808 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-38336956-6062-41a6-99c1-7667887766f8 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:49:29.847505 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-38336956-6062-41a6-99c1-7667887766f8 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:49:29.847965 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-38336956-6062-41a6-99c1-7667887766f8 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:49:29.848399 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-38336956-6062-41a6-99c1-7667887766f8 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:49:29.978152 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-38336956-6062-41a6-99c1-7667887766f8 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e838176b44c4f23b470cfc152f79990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3718dd3e536649b5bf1970ff06ddea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:49:29.986625 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-38336956-6062-41a6-99c1-7667887766f8 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/fc217b69-e791-45d2-95eb-c76defe17db7" status: 200 len: 1730 microversion: 2.1 time: 0.152262 Oct 08 21:49:29.987199 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3280/6632] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:49:29 2022] GET /compute/v2.1/servers/fc217b69-e791-45d2-95eb-c76defe17db7 => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:49:31.010325 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-301f56c8-e39b-46f3-baae-dd9f9f0ee4a0 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:49:31.010988 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-301f56c8-e39b-46f3-baae-dd9f9f0ee4a0 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: fc217b69-e791-45d2-95eb-c76defe17db7] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:49:31.017911 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-301f56c8-e39b-46f3-baae-dd9f9f0ee4a0 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:49:31.018422 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-301f56c8-e39b-46f3-baae-dd9f9f0ee4a0 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:49:31.018879 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-301f56c8-e39b-46f3-baae-dd9f9f0ee4a0 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:49:31.019593 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-301f56c8-e39b-46f3-baae-dd9f9f0ee4a0 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:49:31.020069 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-301f56c8-e39b-46f3-baae-dd9f9f0ee4a0 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:49:31.020514 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-301f56c8-e39b-46f3-baae-dd9f9f0ee4a0 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:49:31.153397 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-301f56c8-e39b-46f3-baae-dd9f9f0ee4a0 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e838176b44c4f23b470cfc152f79990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3718dd3e536649b5bf1970ff06ddea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:49:31.161672 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-301f56c8-e39b-46f3-baae-dd9f9f0ee4a0 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/fc217b69-e791-45d2-95eb-c76defe17db7" status: 200 len: 1730 microversion: 2.1 time: 0.155267 Oct 08 21:49:31.162251 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3353/6633] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:49:31 2022] GET /compute/v2.1/servers/fc217b69-e791-45d2-95eb-c76defe17db7 => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:49:32.185256 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-5995ea45-003c-476e-82fe-25c31957883b tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:49:32.185901 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-5995ea45-003c-476e-82fe-25c31957883b tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: fc217b69-e791-45d2-95eb-c76defe17db7] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:49:32.193090 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5995ea45-003c-476e-82fe-25c31957883b tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:49:32.193619 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5995ea45-003c-476e-82fe-25c31957883b tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:49:32.194070 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5995ea45-003c-476e-82fe-25c31957883b tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:49:32.194800 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5995ea45-003c-476e-82fe-25c31957883b tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:49:32.195265 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5995ea45-003c-476e-82fe-25c31957883b tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:49:32.195700 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5995ea45-003c-476e-82fe-25c31957883b tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:49:32.331437 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-5995ea45-003c-476e-82fe-25c31957883b tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e838176b44c4f23b470cfc152f79990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3718dd3e536649b5bf1970ff06ddea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:49:32.340174 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-5995ea45-003c-476e-82fe-25c31957883b tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/fc217b69-e791-45d2-95eb-c76defe17db7" status: 200 len: 1730 microversion: 2.1 time: 0.158929 Oct 08 21:49:32.340745 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3281/6634] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:49:32 2022] GET /compute/v2.1/servers/fc217b69-e791-45d2-95eb-c76defe17db7 => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:49:33.363201 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-ec7c5cc6-7446-44ff-8816-f26512389cef tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:49:33.363930 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-ec7c5cc6-7446-44ff-8816-f26512389cef tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: fc217b69-e791-45d2-95eb-c76defe17db7] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:49:33.372054 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ec7c5cc6-7446-44ff-8816-f26512389cef tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:49:33.372577 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ec7c5cc6-7446-44ff-8816-f26512389cef tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:49:33.373044 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ec7c5cc6-7446-44ff-8816-f26512389cef tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:49:33.373985 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ec7c5cc6-7446-44ff-8816-f26512389cef tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:49:33.374478 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ec7c5cc6-7446-44ff-8816-f26512389cef tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:49:33.374937 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ec7c5cc6-7446-44ff-8816-f26512389cef tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:49:33.504512 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-ec7c5cc6-7446-44ff-8816-f26512389cef tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e838176b44c4f23b470cfc152f79990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3718dd3e536649b5bf1970ff06ddea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:49:33.512987 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-ec7c5cc6-7446-44ff-8816-f26512389cef tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/fc217b69-e791-45d2-95eb-c76defe17db7" status: 200 len: 1730 microversion: 2.1 time: 0.153794 Oct 08 21:49:33.513584 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3354/6635] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:49:33 2022] GET /compute/v2.1/servers/fc217b69-e791-45d2-95eb-c76defe17db7 => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:49:34.536124 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c4bf60ef-0fcc-4831-8b30-0bde126f1484 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:49:34.536743 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-c4bf60ef-0fcc-4831-8b30-0bde126f1484 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: fc217b69-e791-45d2-95eb-c76defe17db7] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:49:34.543783 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c4bf60ef-0fcc-4831-8b30-0bde126f1484 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:49:34.544277 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c4bf60ef-0fcc-4831-8b30-0bde126f1484 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:49:34.544725 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c4bf60ef-0fcc-4831-8b30-0bde126f1484 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:49:34.545464 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c4bf60ef-0fcc-4831-8b30-0bde126f1484 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:49:34.545926 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c4bf60ef-0fcc-4831-8b30-0bde126f1484 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:49:34.546361 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c4bf60ef-0fcc-4831-8b30-0bde126f1484 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:49:34.732463 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-c4bf60ef-0fcc-4831-8b30-0bde126f1484 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e838176b44c4f23b470cfc152f79990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3718dd3e536649b5bf1970ff06ddea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:49:34.741381 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-c4bf60ef-0fcc-4831-8b30-0bde126f1484 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/fc217b69-e791-45d2-95eb-c76defe17db7" status: 200 len: 1730 microversion: 2.1 time: 0.208629 Oct 08 21:49:34.741964 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3282/6636] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:49:34 2022] GET /compute/v2.1/servers/fc217b69-e791-45d2-95eb-c76defe17db7 => generated 1730 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:49:35.765443 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-3d4f883e-59b5-4bcf-b397-640b1614a37d tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:49:35.766009 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-3d4f883e-59b5-4bcf-b397-640b1614a37d tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: fc217b69-e791-45d2-95eb-c76defe17db7] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:49:35.775972 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3d4f883e-59b5-4bcf-b397-640b1614a37d tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:49:35.776485 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3d4f883e-59b5-4bcf-b397-640b1614a37d tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:49:35.776947 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3d4f883e-59b5-4bcf-b397-640b1614a37d tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:49:35.777747 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3d4f883e-59b5-4bcf-b397-640b1614a37d tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:49:35.778252 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3d4f883e-59b5-4bcf-b397-640b1614a37d tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:49:35.778666 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3d4f883e-59b5-4bcf-b397-640b1614a37d tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:49:35.950075 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-3d4f883e-59b5-4bcf-b397-640b1614a37d tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e838176b44c4f23b470cfc152f79990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3718dd3e536649b5bf1970ff06ddea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:49:35.958550 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-3d4f883e-59b5-4bcf-b397-640b1614a37d tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/fc217b69-e791-45d2-95eb-c76defe17db7" status: 200 len: 1730 microversion: 2.1 time: 0.197239 Oct 08 21:49:35.959128 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3355/6637] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:49:35 2022] GET /compute/v2.1/servers/fc217b69-e791-45d2-95eb-c76defe17db7 => generated 1730 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:49:36.982330 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-019cda15-9fea-46e6-8262-07291a70e354 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:49:36.982950 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-019cda15-9fea-46e6-8262-07291a70e354 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: fc217b69-e791-45d2-95eb-c76defe17db7] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:49:36.989884 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-019cda15-9fea-46e6-8262-07291a70e354 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:49:36.990372 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-019cda15-9fea-46e6-8262-07291a70e354 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:49:36.990905 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-019cda15-9fea-46e6-8262-07291a70e354 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:49:36.991618 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-019cda15-9fea-46e6-8262-07291a70e354 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:49:36.992084 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-019cda15-9fea-46e6-8262-07291a70e354 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:49:36.992514 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-019cda15-9fea-46e6-8262-07291a70e354 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:49:37.119710 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-019cda15-9fea-46e6-8262-07291a70e354 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e838176b44c4f23b470cfc152f79990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3718dd3e536649b5bf1970ff06ddea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:49:37.128031 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-019cda15-9fea-46e6-8262-07291a70e354 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/fc217b69-e791-45d2-95eb-c76defe17db7" status: 200 len: 1730 microversion: 2.1 time: 0.149639 Oct 08 21:49:37.128611 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3283/6638] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:49:36 2022] GET /compute/v2.1/servers/fc217b69-e791-45d2-95eb-c76defe17db7 => generated 1730 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:49:38.151698 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-b1dff0eb-c341-46ee-af06-be30adf8228e tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:49:38.152263 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-b1dff0eb-c341-46ee-af06-be30adf8228e tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: fc217b69-e791-45d2-95eb-c76defe17db7] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:49:38.159322 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b1dff0eb-c341-46ee-af06-be30adf8228e tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:49:38.159833 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b1dff0eb-c341-46ee-af06-be30adf8228e tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:49:38.160298 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b1dff0eb-c341-46ee-af06-be30adf8228e tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:49:38.161015 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b1dff0eb-c341-46ee-af06-be30adf8228e tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:49:38.161526 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b1dff0eb-c341-46ee-af06-be30adf8228e tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:49:38.161979 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b1dff0eb-c341-46ee-af06-be30adf8228e tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:49:38.290688 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-b1dff0eb-c341-46ee-af06-be30adf8228e tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e838176b44c4f23b470cfc152f79990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3718dd3e536649b5bf1970ff06ddea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:49:38.299589 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-b1dff0eb-c341-46ee-af06-be30adf8228e tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/fc217b69-e791-45d2-95eb-c76defe17db7" status: 200 len: 1730 microversion: 2.1 time: 0.151895 Oct 08 21:49:38.300181 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3356/6639] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:49:38 2022] GET /compute/v2.1/servers/fc217b69-e791-45d2-95eb-c76defe17db7 => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:49:39.321898 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-042136fc-091b-471f-9d15-85907b6c1e3b tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:49:39.322508 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-042136fc-091b-471f-9d15-85907b6c1e3b tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: fc217b69-e791-45d2-95eb-c76defe17db7] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:49:39.329470 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-042136fc-091b-471f-9d15-85907b6c1e3b tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:49:39.329967 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-042136fc-091b-471f-9d15-85907b6c1e3b tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:49:39.330414 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-042136fc-091b-471f-9d15-85907b6c1e3b tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:49:39.331116 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-042136fc-091b-471f-9d15-85907b6c1e3b tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:49:39.331581 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-042136fc-091b-471f-9d15-85907b6c1e3b tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:49:39.332015 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-042136fc-091b-471f-9d15-85907b6c1e3b tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:49:39.465831 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-042136fc-091b-471f-9d15-85907b6c1e3b tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e838176b44c4f23b470cfc152f79990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3718dd3e536649b5bf1970ff06ddea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:49:39.474721 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-042136fc-091b-471f-9d15-85907b6c1e3b tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/fc217b69-e791-45d2-95eb-c76defe17db7" status: 200 len: 1730 microversion: 2.1 time: 0.156706 Oct 08 21:49:39.475349 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3284/6640] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:49:39 2022] GET /compute/v2.1/servers/fc217b69-e791-45d2-95eb-c76defe17db7 => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:49:40.497823 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-5635ba37-dc0f-4cfa-8490-1bf5f7853573 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:49:40.498457 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-5635ba37-dc0f-4cfa-8490-1bf5f7853573 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: fc217b69-e791-45d2-95eb-c76defe17db7] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:49:40.505393 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5635ba37-dc0f-4cfa-8490-1bf5f7853573 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:49:40.505904 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5635ba37-dc0f-4cfa-8490-1bf5f7853573 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:49:40.506363 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5635ba37-dc0f-4cfa-8490-1bf5f7853573 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:49:40.507080 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5635ba37-dc0f-4cfa-8490-1bf5f7853573 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:49:40.507565 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5635ba37-dc0f-4cfa-8490-1bf5f7853573 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:49:40.508007 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5635ba37-dc0f-4cfa-8490-1bf5f7853573 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:49:40.636640 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-5635ba37-dc0f-4cfa-8490-1bf5f7853573 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e838176b44c4f23b470cfc152f79990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3718dd3e536649b5bf1970ff06ddea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:49:40.644909 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-5635ba37-dc0f-4cfa-8490-1bf5f7853573 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/fc217b69-e791-45d2-95eb-c76defe17db7" status: 200 len: 1730 microversion: 2.1 time: 0.151052 Oct 08 21:49:40.645517 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3357/6641] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:49:40 2022] GET /compute/v2.1/servers/fc217b69-e791-45d2-95eb-c76defe17db7 => generated 1730 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:49:41.669693 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-728d7339-8c69-455a-b37f-d887632179e4 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:49:41.670315 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-728d7339-8c69-455a-b37f-d887632179e4 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: fc217b69-e791-45d2-95eb-c76defe17db7] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:49:41.678281 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-728d7339-8c69-455a-b37f-d887632179e4 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:49:41.678816 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-728d7339-8c69-455a-b37f-d887632179e4 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:49:41.679364 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-728d7339-8c69-455a-b37f-d887632179e4 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:49:41.680156 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-728d7339-8c69-455a-b37f-d887632179e4 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:49:41.680716 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-728d7339-8c69-455a-b37f-d887632179e4 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:49:41.681163 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-728d7339-8c69-455a-b37f-d887632179e4 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:49:41.915795 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-728d7339-8c69-455a-b37f-d887632179e4 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e838176b44c4f23b470cfc152f79990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3718dd3e536649b5bf1970ff06ddea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:49:41.924447 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-728d7339-8c69-455a-b37f-d887632179e4 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/fc217b69-e791-45d2-95eb-c76defe17db7" status: 200 len: 1730 microversion: 2.1 time: 0.260101 Oct 08 21:49:41.925037 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3285/6642] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:49:41 2022] GET /compute/v2.1/servers/fc217b69-e791-45d2-95eb-c76defe17db7 => generated 1730 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:49:42.436343 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-0d424594-e80c-40ab-b43b-e76088b55814 req-43586907-f53f-4401-98c8-58cfd91818c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc217b69-e791-45d2-95eb-c76defe17db7", "name": "network-vif-unplugged", "status": "completed", "tag": "d5f56a74-2ae4-45c6-bd45-8116441f198c"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:49:42.446611 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-0d424594-e80c-40ab-b43b-e76088b55814 req-43586907-f53f-4401-98c8-58cfd91818c1 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:49:42.447109 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-0d424594-e80c-40ab-b43b-e76088b55814 req-43586907-f53f-4401-98c8-58cfd91818c1 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:49:42.448088 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-0d424594-e80c-40ab-b43b-e76088b55814 req-43586907-f53f-4401-98c8-58cfd91818c1 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:49:42.460058 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-0d424594-e80c-40ab-b43b-e76088b55814 req-43586907-f53f-4401-98c8-58cfd91818c1 service nova] Creating event network-vif-unplugged:d5f56a74-2ae4-45c6-bd45-8116441f198c for instance fc217b69-e791-45d2-95eb-c76defe17db7 on nch1-master-1 Oct 08 21:49:42.466368 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [req-0d424594-e80c-40ab-b43b-e76088b55814 req-43586907-f53f-4401-98c8-58cfd91818c1 service nova] Instance fc217b69-e791-45d2-95eb-c76defe17db7 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140492) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 08 21:49:42.481047 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-0d424594-e80c-40ab-b43b-e76088b55814 req-43586907-f53f-4401-98c8-58cfd91818c1 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.110081 Oct 08 21:49:42.481704 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3358/6643] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:49:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:49:42.948566 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-fdd4cfc0-01a8-4f03-9d08-a62e5f37ece4 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:49:42.949236 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-fdd4cfc0-01a8-4f03-9d08-a62e5f37ece4 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: fc217b69-e791-45d2-95eb-c76defe17db7] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:49:42.956227 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fdd4cfc0-01a8-4f03-9d08-a62e5f37ece4 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:49:42.956724 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fdd4cfc0-01a8-4f03-9d08-a62e5f37ece4 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:49:42.957166 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fdd4cfc0-01a8-4f03-9d08-a62e5f37ece4 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:49:42.957896 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fdd4cfc0-01a8-4f03-9d08-a62e5f37ece4 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:49:42.958357 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fdd4cfc0-01a8-4f03-9d08-a62e5f37ece4 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:49:42.958785 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fdd4cfc0-01a8-4f03-9d08-a62e5f37ece4 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:49:43.176263 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-fdd4cfc0-01a8-4f03-9d08-a62e5f37ece4 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e838176b44c4f23b470cfc152f79990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3718dd3e536649b5bf1970ff06ddea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:49:43.185306 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-fdd4cfc0-01a8-4f03-9d08-a62e5f37ece4 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/fc217b69-e791-45d2-95eb-c76defe17db7" status: 200 len: 1729 microversion: 2.1 time: 0.240649 Oct 08 21:49:43.185899 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3286/6644] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:49:42 2022] GET /compute/v2.1/servers/fc217b69-e791-45d2-95eb-c76defe17db7 => generated 1729 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:49:44.211928 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-513397d4-81f4-4265-a13c-05891372e63c tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:49:44.212926 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-513397d4-81f4-4265-a13c-05891372e63c tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: fc217b69-e791-45d2-95eb-c76defe17db7] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:49:44.220169 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-513397d4-81f4-4265-a13c-05891372e63c tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:49:44.220677 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-513397d4-81f4-4265-a13c-05891372e63c tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:49:44.221144 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-513397d4-81f4-4265-a13c-05891372e63c tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:49:44.221900 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-513397d4-81f4-4265-a13c-05891372e63c tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:49:44.222384 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-513397d4-81f4-4265-a13c-05891372e63c tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:49:44.222838 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-513397d4-81f4-4265-a13c-05891372e63c tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:49:44.446318 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-513397d4-81f4-4265-a13c-05891372e63c tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e838176b44c4f23b470cfc152f79990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3718dd3e536649b5bf1970ff06ddea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:49:44.455212 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-513397d4-81f4-4265-a13c-05891372e63c tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/fc217b69-e791-45d2-95eb-c76defe17db7" status: 200 len: 1727 microversion: 2.1 time: 0.249257 Oct 08 21:49:44.455808 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3359/6645] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:49:44 2022] GET /compute/v2.1/servers/fc217b69-e791-45d2-95eb-c76defe17db7 => generated 1727 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:49:44.508789 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-4553b606-c74f-4ff5-964a-6dda76bf8c46 req-064bf0db-7b32-4da2-9b50-3be64d2b6650 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc217b69-e791-45d2-95eb-c76defe17db7", "tag": "d5f56a74-2ae4-45c6-bd45-8116441f198c"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:49:44.519747 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-4553b606-c74f-4ff5-964a-6dda76bf8c46 req-064bf0db-7b32-4da2-9b50-3be64d2b6650 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:49:44.520326 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-4553b606-c74f-4ff5-964a-6dda76bf8c46 req-064bf0db-7b32-4da2-9b50-3be64d2b6650 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:49:44.520805 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-4553b606-c74f-4ff5-964a-6dda76bf8c46 req-064bf0db-7b32-4da2-9b50-3be64d2b6650 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:49:44.533792 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-4553b606-c74f-4ff5-964a-6dda76bf8c46 req-064bf0db-7b32-4da2-9b50-3be64d2b6650 service nova] Creating event network-changed:d5f56a74-2ae4-45c6-bd45-8116441f198c for instance fc217b69-e791-45d2-95eb-c76defe17db7 on nch1-master-1 Oct 08 21:49:44.539448 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [req-4553b606-c74f-4ff5-964a-6dda76bf8c46 req-064bf0db-7b32-4da2-9b50-3be64d2b6650 service nova] Instance fc217b69-e791-45d2-95eb-c76defe17db7 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140491) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 08 21:49:44.550176 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-4553b606-c74f-4ff5-964a-6dda76bf8c46 req-064bf0db-7b32-4da2-9b50-3be64d2b6650 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046696 Oct 08 21:49:44.550786 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3287/6646] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:49:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 08 21:49:45.479629 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-9d5ff4a2-3b7f-4aeb-af1a-8039727b045d tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:49:45.480708 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-9d5ff4a2-3b7f-4aeb-af1a-8039727b045d tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: fc217b69-e791-45d2-95eb-c76defe17db7] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:49:45.487293 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9d5ff4a2-3b7f-4aeb-af1a-8039727b045d tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:49:45.487802 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9d5ff4a2-3b7f-4aeb-af1a-8039727b045d tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:49:45.488265 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9d5ff4a2-3b7f-4aeb-af1a-8039727b045d tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:49:45.488988 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9d5ff4a2-3b7f-4aeb-af1a-8039727b045d tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:49:45.489494 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9d5ff4a2-3b7f-4aeb-af1a-8039727b045d tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:49:45.489973 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9d5ff4a2-3b7f-4aeb-af1a-8039727b045d tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:49:45.626147 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-9d5ff4a2-3b7f-4aeb-af1a-8039727b045d tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e838176b44c4f23b470cfc152f79990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3718dd3e536649b5bf1970ff06ddea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:49:45.635128 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-9d5ff4a2-3b7f-4aeb-af1a-8039727b045d tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/fc217b69-e791-45d2-95eb-c76defe17db7" status: 200 len: 1727 microversion: 2.1 time: 0.159435 Oct 08 21:49:45.635720 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3360/6647] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:49:45 2022] GET /compute/v2.1/servers/fc217b69-e791-45d2-95eb-c76defe17db7 => generated 1727 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:49:46.660678 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-03b1866a-23f5-4f96-8f47-b8925a5155bd tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:49:46.661423 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-03b1866a-23f5-4f96-8f47-b8925a5155bd tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: fc217b69-e791-45d2-95eb-c76defe17db7] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:49:46.667706 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-03b1866a-23f5-4f96-8f47-b8925a5155bd tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:49:46.668193 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-03b1866a-23f5-4f96-8f47-b8925a5155bd tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:49:46.668631 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-03b1866a-23f5-4f96-8f47-b8925a5155bd tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:49:46.669353 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-03b1866a-23f5-4f96-8f47-b8925a5155bd tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:49:46.669809 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-03b1866a-23f5-4f96-8f47-b8925a5155bd tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:49:46.670237 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-03b1866a-23f5-4f96-8f47-b8925a5155bd tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:49:46.804265 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-03b1866a-23f5-4f96-8f47-b8925a5155bd tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e838176b44c4f23b470cfc152f79990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3718dd3e536649b5bf1970ff06ddea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:49:46.812562 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-03b1866a-23f5-4f96-8f47-b8925a5155bd tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/fc217b69-e791-45d2-95eb-c76defe17db7" status: 200 len: 1727 microversion: 2.1 time: 0.157026 Oct 08 21:49:46.813144 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3288/6648] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:49:46 2022] GET /compute/v2.1/servers/fc217b69-e791-45d2-95eb-c76defe17db7 => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:49:47.836433 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-192385c5-c2cf-47e2-8f86-4914944db9a1 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:49:47.837035 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-192385c5-c2cf-47e2-8f86-4914944db9a1 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: fc217b69-e791-45d2-95eb-c76defe17db7] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:49:47.844031 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-192385c5-c2cf-47e2-8f86-4914944db9a1 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:49:47.844541 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-192385c5-c2cf-47e2-8f86-4914944db9a1 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:49:47.845011 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-192385c5-c2cf-47e2-8f86-4914944db9a1 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:49:47.845762 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-192385c5-c2cf-47e2-8f86-4914944db9a1 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:49:47.846243 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-192385c5-c2cf-47e2-8f86-4914944db9a1 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:49:47.846696 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-192385c5-c2cf-47e2-8f86-4914944db9a1 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:49:47.979235 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-192385c5-c2cf-47e2-8f86-4914944db9a1 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e838176b44c4f23b470cfc152f79990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3718dd3e536649b5bf1970ff06ddea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:49:47.988139 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-192385c5-c2cf-47e2-8f86-4914944db9a1 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/fc217b69-e791-45d2-95eb-c76defe17db7" status: 200 len: 1724 microversion: 2.1 time: 0.156333 Oct 08 21:49:47.988724 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3361/6649] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:49:47 2022] GET /compute/v2.1/servers/fc217b69-e791-45d2-95eb-c76defe17db7 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:49:48.011604 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-d3a35e4d-a731-45a2-a24e-10130467d817 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:49:48.012188 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-d3a35e4d-a731-45a2-a24e-10130467d817 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: fc217b69-e791-45d2-95eb-c76defe17db7] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:49:48.019119 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d3a35e4d-a731-45a2-a24e-10130467d817 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:49:48.019619 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d3a35e4d-a731-45a2-a24e-10130467d817 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:49:48.020072 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d3a35e4d-a731-45a2-a24e-10130467d817 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:49:48.020780 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d3a35e4d-a731-45a2-a24e-10130467d817 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:49:48.021278 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d3a35e4d-a731-45a2-a24e-10130467d817 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:49:48.021720 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d3a35e4d-a731-45a2-a24e-10130467d817 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:49:48.058990 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d3a35e4d-a731-45a2-a24e-10130467d817 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:49:48.059479 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d3a35e4d-a731-45a2-a24e-10130467d817 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:49:48.059928 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d3a35e4d-a731-45a2-a24e-10130467d817 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:49:48.060671 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d3a35e4d-a731-45a2-a24e-10130467d817 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:49:48.061138 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d3a35e4d-a731-45a2-a24e-10130467d817 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:49:48.061603 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d3a35e4d-a731-45a2-a24e-10130467d817 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:49:48.082665 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-d3a35e4d-a731-45a2-a24e-10130467d817 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Getting quotas for project 3718dd3e536649b5bf1970ff06ddea69. Resources: {'cores', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:49:48.088473 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-d3a35e4d-a731-45a2-a24e-10130467d817 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Getting quotas for user 5e838176b44c4f23b470cfc152f79990 and project 3718dd3e536649b5bf1970ff06ddea69. Resources: {'cores', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:49:48.186872 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-d3a35e4d-a731-45a2-a24e-10130467d817 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "POST /compute/v2.1/servers/fc217b69-e791-45d2-95eb-c76defe17db7/action" status: 202 len: 0 microversion: 2.1 time: 0.178995 Oct 08 21:49:48.187512 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3289/6650] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:49:48 2022] POST /compute/v2.1/servers/fc217b69-e791-45d2-95eb-c76defe17db7/action => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 08 21:49:48.196537 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-2a46ef08-3317-4182-ae69-1d3e898c47c9 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:49:48.197199 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-2a46ef08-3317-4182-ae69-1d3e898c47c9 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: fc217b69-e791-45d2-95eb-c76defe17db7] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:49:48.203486 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2a46ef08-3317-4182-ae69-1d3e898c47c9 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:49:48.204002 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2a46ef08-3317-4182-ae69-1d3e898c47c9 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:49:48.204499 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2a46ef08-3317-4182-ae69-1d3e898c47c9 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:49:48.205280 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2a46ef08-3317-4182-ae69-1d3e898c47c9 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:49:48.205831 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2a46ef08-3317-4182-ae69-1d3e898c47c9 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:49:48.206294 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2a46ef08-3317-4182-ae69-1d3e898c47c9 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:49:48.343154 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-2a46ef08-3317-4182-ae69-1d3e898c47c9 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e838176b44c4f23b470cfc152f79990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3718dd3e536649b5bf1970ff06ddea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:49:48.352550 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-2a46ef08-3317-4182-ae69-1d3e898c47c9 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/fc217b69-e791-45d2-95eb-c76defe17db7" status: 200 len: 1723 microversion: 2.1 time: 0.160457 Oct 08 21:49:48.353148 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3362/6651] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:49:48 2022] GET /compute/v2.1/servers/fc217b69-e791-45d2-95eb-c76defe17db7 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:49:49.100279 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-f76783de-25a6-4b44-8fef-3acc685a9edd req-72aa57d7-354e-4bda-b959-022d7b59ce2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc217b69-e791-45d2-95eb-c76defe17db7", "name": "network-vif-plugged", "status": "completed", "tag": "d5f56a74-2ae4-45c6-bd45-8116441f198c"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:49:49.116222 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-f76783de-25a6-4b44-8fef-3acc685a9edd req-72aa57d7-354e-4bda-b959-022d7b59ce2c service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:49:49.116717 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-f76783de-25a6-4b44-8fef-3acc685a9edd req-72aa57d7-354e-4bda-b959-022d7b59ce2c service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:49:49.117165 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-f76783de-25a6-4b44-8fef-3acc685a9edd req-72aa57d7-354e-4bda-b959-022d7b59ce2c service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:49:49.128877 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-f76783de-25a6-4b44-8fef-3acc685a9edd req-72aa57d7-354e-4bda-b959-022d7b59ce2c service nova] Creating event network-vif-plugged:d5f56a74-2ae4-45c6-bd45-8116441f198c for instance fc217b69-e791-45d2-95eb-c76defe17db7 on nch1-master-1 Oct 08 21:49:49.131864 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:49:49.137412 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [req-f76783de-25a6-4b44-8fef-3acc685a9edd req-72aa57d7-354e-4bda-b959-022d7b59ce2c service nova] Instance fc217b69-e791-45d2-95eb-c76defe17db7 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140491) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 08 21:49:49.149278 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-f76783de-25a6-4b44-8fef-3acc685a9edd req-72aa57d7-354e-4bda-b959-022d7b59ce2c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054620 Oct 08 21:49:49.149839 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3290/6652] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:49:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:49:49.376070 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-f5b1bb74-1c93-4b59-97db-0aad03dd8473 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:49:49.376713 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-f5b1bb74-1c93-4b59-97db-0aad03dd8473 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: fc217b69-e791-45d2-95eb-c76defe17db7] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:49:49.383837 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f5b1bb74-1c93-4b59-97db-0aad03dd8473 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:49:49.384360 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f5b1bb74-1c93-4b59-97db-0aad03dd8473 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:49:49.384858 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f5b1bb74-1c93-4b59-97db-0aad03dd8473 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:49:49.385612 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f5b1bb74-1c93-4b59-97db-0aad03dd8473 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:49:49.386102 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f5b1bb74-1c93-4b59-97db-0aad03dd8473 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:49:49.386559 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f5b1bb74-1c93-4b59-97db-0aad03dd8473 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:49:49.521275 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-f5b1bb74-1c93-4b59-97db-0aad03dd8473 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e838176b44c4f23b470cfc152f79990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3718dd3e536649b5bf1970ff06ddea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:49:49.530133 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-f5b1bb74-1c93-4b59-97db-0aad03dd8473 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/fc217b69-e791-45d2-95eb-c76defe17db7" status: 200 len: 1723 microversion: 2.1 time: 0.158067 Oct 08 21:49:49.530716 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3363/6653] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:49:49 2022] GET /compute/v2.1/servers/fc217b69-e791-45d2-95eb-c76defe17db7 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:49:50.555682 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-2139447d-b139-49ce-b0c1-079800014968 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:49:50.556394 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-2139447d-b139-49ce-b0c1-079800014968 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: fc217b69-e791-45d2-95eb-c76defe17db7] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:49:50.563003 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2139447d-b139-49ce-b0c1-079800014968 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:49:50.563501 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2139447d-b139-49ce-b0c1-079800014968 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:49:50.563951 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2139447d-b139-49ce-b0c1-079800014968 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:49:50.564661 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2139447d-b139-49ce-b0c1-079800014968 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:49:50.565425 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2139447d-b139-49ce-b0c1-079800014968 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:49:50.565863 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2139447d-b139-49ce-b0c1-079800014968 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:49:50.697842 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-2139447d-b139-49ce-b0c1-079800014968 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e838176b44c4f23b470cfc152f79990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3718dd3e536649b5bf1970ff06ddea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:49:50.706183 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-2139447d-b139-49ce-b0c1-079800014968 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/fc217b69-e791-45d2-95eb-c76defe17db7" status: 200 len: 1723 microversion: 2.1 time: 0.156424 Oct 08 21:49:50.706772 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3291/6654] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:49:50 2022] GET /compute/v2.1/servers/fc217b69-e791-45d2-95eb-c76defe17db7 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:49:51.729567 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-0f68bcf1-43a0-4857-9d7e-12f4b3f438e7 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:49:51.730217 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-0f68bcf1-43a0-4857-9d7e-12f4b3f438e7 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: fc217b69-e791-45d2-95eb-c76defe17db7] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:49:51.738438 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0f68bcf1-43a0-4857-9d7e-12f4b3f438e7 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:49:51.739133 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0f68bcf1-43a0-4857-9d7e-12f4b3f438e7 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:49:51.739839 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0f68bcf1-43a0-4857-9d7e-12f4b3f438e7 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:49:51.741274 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0f68bcf1-43a0-4857-9d7e-12f4b3f438e7 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:49:51.741899 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0f68bcf1-43a0-4857-9d7e-12f4b3f438e7 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:49:51.742382 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0f68bcf1-43a0-4857-9d7e-12f4b3f438e7 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:49:51.875132 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-0f68bcf1-43a0-4857-9d7e-12f4b3f438e7 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e838176b44c4f23b470cfc152f79990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3718dd3e536649b5bf1970ff06ddea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:49:51.884338 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-0f68bcf1-43a0-4857-9d7e-12f4b3f438e7 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/fc217b69-e791-45d2-95eb-c76defe17db7" status: 200 len: 1723 microversion: 2.1 time: 0.158943 Oct 08 21:49:51.885098 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3364/6655] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:49:51 2022] GET /compute/v2.1/servers/fc217b69-e791-45d2-95eb-c76defe17db7 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:49:52.809246 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-31aa8082-b5b4-4866-898c-800c990727f4 req-65e6949f-54a0-4b4d-9b01-1c8dd6022643 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc217b69-e791-45d2-95eb-c76defe17db7", "name": "network-vif-unplugged", "status": "completed", "tag": "d5f56a74-2ae4-45c6-bd45-8116441f198c"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:49:52.819346 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-31aa8082-b5b4-4866-898c-800c990727f4 req-65e6949f-54a0-4b4d-9b01-1c8dd6022643 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:49:52.819841 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-31aa8082-b5b4-4866-898c-800c990727f4 req-65e6949f-54a0-4b4d-9b01-1c8dd6022643 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:49:52.820281 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-31aa8082-b5b4-4866-898c-800c990727f4 req-65e6949f-54a0-4b4d-9b01-1c8dd6022643 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:49:52.832377 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-31aa8082-b5b4-4866-898c-800c990727f4 req-65e6949f-54a0-4b4d-9b01-1c8dd6022643 service nova] Creating event network-vif-unplugged:d5f56a74-2ae4-45c6-bd45-8116441f198c for instance fc217b69-e791-45d2-95eb-c76defe17db7 on nch2-master-1 Oct 08 21:49:52.838632 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [req-31aa8082-b5b4-4866-898c-800c990727f4 req-65e6949f-54a0-4b4d-9b01-1c8dd6022643 service nova] Instance fc217b69-e791-45d2-95eb-c76defe17db7 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140491) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 08 21:49:52.849202 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-31aa8082-b5b4-4866-898c-800c990727f4 req-65e6949f-54a0-4b4d-9b01-1c8dd6022643 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.095194 Oct 08 21:49:52.850384 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3292/6656] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:49:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:49:52.908040 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e56a5a8d-79c3-4735-a206-7a5d4df6d7e9 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:49:52.908686 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-e56a5a8d-79c3-4735-a206-7a5d4df6d7e9 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: fc217b69-e791-45d2-95eb-c76defe17db7] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:49:52.915713 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e56a5a8d-79c3-4735-a206-7a5d4df6d7e9 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:49:52.916232 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e56a5a8d-79c3-4735-a206-7a5d4df6d7e9 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:49:52.916707 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e56a5a8d-79c3-4735-a206-7a5d4df6d7e9 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:49:52.917474 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e56a5a8d-79c3-4735-a206-7a5d4df6d7e9 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:49:52.917962 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e56a5a8d-79c3-4735-a206-7a5d4df6d7e9 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:49:52.918424 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e56a5a8d-79c3-4735-a206-7a5d4df6d7e9 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:49:52.940917 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:49:53.123323 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-e56a5a8d-79c3-4735-a206-7a5d4df6d7e9 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e838176b44c4f23b470cfc152f79990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3718dd3e536649b5bf1970ff06ddea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:49:53.132512 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-e56a5a8d-79c3-4735-a206-7a5d4df6d7e9 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/fc217b69-e791-45d2-95eb-c76defe17db7" status: 200 len: 1723 microversion: 2.1 time: 0.228513 Oct 08 21:49:53.133094 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3365/6657] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:49:52 2022] GET /compute/v2.1/servers/fc217b69-e791-45d2-95eb-c76defe17db7 => generated 1723 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:49:54.157618 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-f0e2a76d-6762-493f-84d7-11b6d4ee939e tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:49:54.158306 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-f0e2a76d-6762-493f-84d7-11b6d4ee939e tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: fc217b69-e791-45d2-95eb-c76defe17db7] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:49:54.160308 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:49:54.166224 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f0e2a76d-6762-493f-84d7-11b6d4ee939e tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:49:54.166797 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f0e2a76d-6762-493f-84d7-11b6d4ee939e tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:49:54.167254 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f0e2a76d-6762-493f-84d7-11b6d4ee939e tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:49:54.167968 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f0e2a76d-6762-493f-84d7-11b6d4ee939e tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:49:54.168434 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f0e2a76d-6762-493f-84d7-11b6d4ee939e tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:49:54.168872 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f0e2a76d-6762-493f-84d7-11b6d4ee939e tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:49:54.305996 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-f0e2a76d-6762-493f-84d7-11b6d4ee939e tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e838176b44c4f23b470cfc152f79990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3718dd3e536649b5bf1970ff06ddea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:49:54.314517 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-f0e2a76d-6762-493f-84d7-11b6d4ee939e tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/fc217b69-e791-45d2-95eb-c76defe17db7" status: 200 len: 1723 microversion: 2.1 time: 0.162266 Oct 08 21:49:54.315357 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3293/6658] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:49:54 2022] GET /compute/v2.1/servers/fc217b69-e791-45d2-95eb-c76defe17db7 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:49:54.872642 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-be700bf6-1e14-4619-b536-459f6f0f7d2a req-a332138e-d20a-4f44-8c8b-68bc531e339f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc217b69-e791-45d2-95eb-c76defe17db7", "tag": "d5f56a74-2ae4-45c6-bd45-8116441f198c"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:49:54.882723 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=37 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:49:54.888421 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-be700bf6-1e14-4619-b536-459f6f0f7d2a req-a332138e-d20a-4f44-8c8b-68bc531e339f service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:49:54.888939 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-be700bf6-1e14-4619-b536-459f6f0f7d2a req-a332138e-d20a-4f44-8c8b-68bc531e339f service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:49:54.889498 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-be700bf6-1e14-4619-b536-459f6f0f7d2a req-a332138e-d20a-4f44-8c8b-68bc531e339f service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:49:54.905680 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-be700bf6-1e14-4619-b536-459f6f0f7d2a req-a332138e-d20a-4f44-8c8b-68bc531e339f service nova] Creating event network-changed:d5f56a74-2ae4-45c6-bd45-8116441f198c for instance fc217b69-e791-45d2-95eb-c76defe17db7 on nch2-master-1 Oct 08 21:49:54.912201 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [req-be700bf6-1e14-4619-b536-459f6f0f7d2a req-a332138e-d20a-4f44-8c8b-68bc531e339f service nova] Instance fc217b69-e791-45d2-95eb-c76defe17db7 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140492) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 08 21:49:54.923126 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-be700bf6-1e14-4619-b536-459f6f0f7d2a req-a332138e-d20a-4f44-8c8b-68bc531e339f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054292 Oct 08 21:49:54.923746 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3366/6659] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:49:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:49:55.339485 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-910839fb-c9a0-4f8a-83f2-0a1e8dca181a tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:49:55.340112 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-910839fb-c9a0-4f8a-83f2-0a1e8dca181a tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: fc217b69-e791-45d2-95eb-c76defe17db7] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:49:55.346579 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-910839fb-c9a0-4f8a-83f2-0a1e8dca181a tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:49:55.347125 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-910839fb-c9a0-4f8a-83f2-0a1e8dca181a tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:49:55.347631 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-910839fb-c9a0-4f8a-83f2-0a1e8dca181a tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:49:55.348462 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-910839fb-c9a0-4f8a-83f2-0a1e8dca181a tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:49:55.348934 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-910839fb-c9a0-4f8a-83f2-0a1e8dca181a tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:49:55.349894 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-910839fb-c9a0-4f8a-83f2-0a1e8dca181a tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:49:55.617987 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-910839fb-c9a0-4f8a-83f2-0a1e8dca181a tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e838176b44c4f23b470cfc152f79990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3718dd3e536649b5bf1970ff06ddea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:49:55.626675 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-910839fb-c9a0-4f8a-83f2-0a1e8dca181a tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/fc217b69-e791-45d2-95eb-c76defe17db7" status: 200 len: 1723 microversion: 2.1 time: 0.292052 Oct 08 21:49:55.627268 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3294/6660] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:49:55 2022] GET /compute/v2.1/servers/fc217b69-e791-45d2-95eb-c76defe17db7 => generated 1723 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:49:56.652496 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-1d3f5613-7b4b-412d-9595-0ee099c30f86 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:49:56.653250 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-1d3f5613-7b4b-412d-9595-0ee099c30f86 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: fc217b69-e791-45d2-95eb-c76defe17db7] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:49:56.659617 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1d3f5613-7b4b-412d-9595-0ee099c30f86 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:49:56.660112 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1d3f5613-7b4b-412d-9595-0ee099c30f86 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:49:56.660576 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1d3f5613-7b4b-412d-9595-0ee099c30f86 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:49:56.661326 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1d3f5613-7b4b-412d-9595-0ee099c30f86 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:49:56.662303 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1d3f5613-7b4b-412d-9595-0ee099c30f86 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:49:56.662755 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1d3f5613-7b4b-412d-9595-0ee099c30f86 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:49:56.794122 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-1d3f5613-7b4b-412d-9595-0ee099c30f86 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e838176b44c4f23b470cfc152f79990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3718dd3e536649b5bf1970ff06ddea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:49:56.803085 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-1d3f5613-7b4b-412d-9595-0ee099c30f86 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/fc217b69-e791-45d2-95eb-c76defe17db7" status: 200 len: 1723 microversion: 2.1 time: 0.155212 Oct 08 21:49:56.803661 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3367/6661] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:49:56 2022] GET /compute/v2.1/servers/fc217b69-e791-45d2-95eb-c76defe17db7 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:49:57.826201 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-08c271e6-eac4-4446-be5e-419e7aca5064 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:49:57.826721 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-08c271e6-eac4-4446-be5e-419e7aca5064 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: fc217b69-e791-45d2-95eb-c76defe17db7] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:49:57.832762 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-08c271e6-eac4-4446-be5e-419e7aca5064 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:49:57.833286 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-08c271e6-eac4-4446-be5e-419e7aca5064 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:49:57.833770 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-08c271e6-eac4-4446-be5e-419e7aca5064 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:49:57.834494 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-08c271e6-eac4-4446-be5e-419e7aca5064 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:49:57.834955 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-08c271e6-eac4-4446-be5e-419e7aca5064 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:49:57.835383 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-08c271e6-eac4-4446-be5e-419e7aca5064 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:49:57.969520 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-08c271e6-eac4-4446-be5e-419e7aca5064 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e838176b44c4f23b470cfc152f79990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3718dd3e536649b5bf1970ff06ddea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:49:57.978112 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-08c271e6-eac4-4446-be5e-419e7aca5064 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/fc217b69-e791-45d2-95eb-c76defe17db7" status: 200 len: 1716 microversion: 2.1 time: 0.156217 Oct 08 21:49:57.978901 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3295/6662] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:49:57 2022] GET /compute/v2.1/servers/fc217b69-e791-45d2-95eb-c76defe17db7 => generated 1716 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:49:58.001154 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-c6dc9c3a-7e85-463d-a9d0-d91ba8ccee7c tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:49:58.001824 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-c6dc9c3a-7e85-463d-a9d0-d91ba8ccee7c tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: fc217b69-e791-45d2-95eb-c76defe17db7] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:49:58.008608 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c6dc9c3a-7e85-463d-a9d0-d91ba8ccee7c tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:49:58.009130 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c6dc9c3a-7e85-463d-a9d0-d91ba8ccee7c tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:49:58.009625 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c6dc9c3a-7e85-463d-a9d0-d91ba8ccee7c tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:49:58.010361 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c6dc9c3a-7e85-463d-a9d0-d91ba8ccee7c tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:49:58.010852 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c6dc9c3a-7e85-463d-a9d0-d91ba8ccee7c tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:49:58.011312 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c6dc9c3a-7e85-463d-a9d0-d91ba8ccee7c tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:49:58.147146 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-c6dc9c3a-7e85-463d-a9d0-d91ba8ccee7c tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e838176b44c4f23b470cfc152f79990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3718dd3e536649b5bf1970ff06ddea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:49:58.155712 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-c6dc9c3a-7e85-463d-a9d0-d91ba8ccee7c tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/fc217b69-e791-45d2-95eb-c76defe17db7" status: 200 len: 1716 microversion: 2.1 time: 0.158884 Oct 08 21:49:58.156314 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3368/6663] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:49:57 2022] GET /compute/v2.1/servers/fc217b69-e791-45d2-95eb-c76defe17db7 => generated 1716 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:49:58.178951 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-1ed79edf-f460-4c39-8c08-6ecb38b5dabc tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:49:58.180344 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-1ed79edf-f460-4c39-8c08-6ecb38b5dabc tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: fc217b69-e791-45d2-95eb-c76defe17db7] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:49:58.182529 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=3 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:49:58.188333 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1ed79edf-f460-4c39-8c08-6ecb38b5dabc tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:49:58.188838 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1ed79edf-f460-4c39-8c08-6ecb38b5dabc tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:49:58.189315 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1ed79edf-f460-4c39-8c08-6ecb38b5dabc tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:49:58.190291 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1ed79edf-f460-4c39-8c08-6ecb38b5dabc tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:49:58.190757 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1ed79edf-f460-4c39-8c08-6ecb38b5dabc tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:49:58.191195 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1ed79edf-f460-4c39-8c08-6ecb38b5dabc tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:49:58.320738 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-1ed79edf-f460-4c39-8c08-6ecb38b5dabc tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e838176b44c4f23b470cfc152f79990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3718dd3e536649b5bf1970ff06ddea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:49:58.329268 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-1ed79edf-f460-4c39-8c08-6ecb38b5dabc tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/fc217b69-e791-45d2-95eb-c76defe17db7" status: 200 len: 1716 microversion: 2.1 time: 0.154800 Oct 08 21:49:58.329859 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3296/6664] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:49:58 2022] GET /compute/v2.1/servers/fc217b69-e791-45d2-95eb-c76defe17db7 => generated 1716 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:49:58.352560 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-023dd351-694b-4e4e-acf4-790d779614eb tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:49:58.353109 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-023dd351-694b-4e4e-acf4-790d779614eb tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: fc217b69-e791-45d2-95eb-c76defe17db7] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:49:58.359413 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-023dd351-694b-4e4e-acf4-790d779614eb tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:49:58.359924 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-023dd351-694b-4e4e-acf4-790d779614eb tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:49:58.360387 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-023dd351-694b-4e4e-acf4-790d779614eb tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:49:58.361112 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-023dd351-694b-4e4e-acf4-790d779614eb tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:49:58.361623 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-023dd351-694b-4e4e-acf4-790d779614eb tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:49:58.362076 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-023dd351-694b-4e4e-acf4-790d779614eb tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:49:58.388738 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-023dd351-694b-4e4e-acf4-790d779614eb tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: fc217b69-e791-45d2-95eb-c76defe17db7] Going to try to terminate instance {{(pid=140492) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 21:49:58.474334 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-023dd351-694b-4e4e-acf4-790d779614eb tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "DELETE /compute/v2.1/servers/fc217b69-e791-45d2-95eb-c76defe17db7" status: 204 len: 0 microversion: 2.1 time: 0.125755 Oct 08 21:49:58.478375 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3369/6665] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:49:58 2022] DELETE /compute/v2.1/servers/fc217b69-e791-45d2-95eb-c76defe17db7 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 21:49:58.484643 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-7f01aaae-b822-4aad-b075-fb84dfd28120 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:49:58.490488 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-7f01aaae-b822-4aad-b075-fb84dfd28120 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: fc217b69-e791-45d2-95eb-c76defe17db7] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:49:58.495276 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7f01aaae-b822-4aad-b075-fb84dfd28120 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:49:58.495862 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7f01aaae-b822-4aad-b075-fb84dfd28120 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:49:58.496373 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7f01aaae-b822-4aad-b075-fb84dfd28120 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:49:58.497166 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7f01aaae-b822-4aad-b075-fb84dfd28120 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:49:58.497759 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7f01aaae-b822-4aad-b075-fb84dfd28120 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:49:58.498261 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7f01aaae-b822-4aad-b075-fb84dfd28120 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:49:58.638160 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-7f01aaae-b822-4aad-b075-fb84dfd28120 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e838176b44c4f23b470cfc152f79990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3718dd3e536649b5bf1970ff06ddea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:49:58.646575 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-7f01aaae-b822-4aad-b075-fb84dfd28120 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/fc217b69-e791-45d2-95eb-c76defe17db7" status: 200 len: 1722 microversion: 2.1 time: 0.166312 Oct 08 21:49:58.647149 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3297/6666] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:49:58 2022] GET /compute/v2.1/servers/fc217b69-e791-45d2-95eb-c76defe17db7 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:49:59.671690 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-b72f4197-46a3-4763-ad74-67bd69156de0 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:49:59.672430 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-b72f4197-46a3-4763-ad74-67bd69156de0 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: fc217b69-e791-45d2-95eb-c76defe17db7] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:49:59.679588 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b72f4197-46a3-4763-ad74-67bd69156de0 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:49:59.680113 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b72f4197-46a3-4763-ad74-67bd69156de0 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:49:59.681202 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b72f4197-46a3-4763-ad74-67bd69156de0 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:49:59.681951 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b72f4197-46a3-4763-ad74-67bd69156de0 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:49:59.682441 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b72f4197-46a3-4763-ad74-67bd69156de0 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:49:59.682900 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b72f4197-46a3-4763-ad74-67bd69156de0 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:49:59.815398 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-b72f4197-46a3-4763-ad74-67bd69156de0 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e838176b44c4f23b470cfc152f79990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3718dd3e536649b5bf1970ff06ddea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:49:59.824289 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-b72f4197-46a3-4763-ad74-67bd69156de0 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/fc217b69-e791-45d2-95eb-c76defe17db7" status: 200 len: 1722 microversion: 2.1 time: 0.156999 Oct 08 21:49:59.824866 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3370/6667] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:49:59 2022] GET /compute/v2.1/servers/fc217b69-e791-45d2-95eb-c76defe17db7 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:50:00.104350 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-195ea52f-2246-4ece-8841-625288c51eab req-90d82e3a-c976-440e-bf72-718621f9fce3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc217b69-e791-45d2-95eb-c76defe17db7", "name": "network-vif-plugged", "status": "completed", "tag": "d5f56a74-2ae4-45c6-bd45-8116441f198c"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:50:00.116069 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-195ea52f-2246-4ece-8841-625288c51eab req-90d82e3a-c976-440e-bf72-718621f9fce3 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:50:00.116550 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-195ea52f-2246-4ece-8841-625288c51eab req-90d82e3a-c976-440e-bf72-718621f9fce3 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:50:00.116985 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-195ea52f-2246-4ece-8841-625288c51eab req-90d82e3a-c976-440e-bf72-718621f9fce3 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:50:00.130515 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-195ea52f-2246-4ece-8841-625288c51eab req-90d82e3a-c976-440e-bf72-718621f9fce3 service nova] Creating event network-vif-plugged:d5f56a74-2ae4-45c6-bd45-8116441f198c for instance fc217b69-e791-45d2-95eb-c76defe17db7 on nch2-master-1 Oct 08 21:50:00.136525 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-195ea52f-2246-4ece-8841-625288c51eab req-90d82e3a-c976-440e-bf72-718621f9fce3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035961 Oct 08 21:50:00.137104 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3298/6668] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:50:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:50:00.848215 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-2aae6fc4-af1d-456d-861f-3fb3a815ad1a tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:50:00.849008 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-2aae6fc4-af1d-456d-861f-3fb3a815ad1a tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: fc217b69-e791-45d2-95eb-c76defe17db7] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:50:00.856528 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2aae6fc4-af1d-456d-861f-3fb3a815ad1a tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:50:00.857054 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2aae6fc4-af1d-456d-861f-3fb3a815ad1a tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:50:00.857564 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2aae6fc4-af1d-456d-861f-3fb3a815ad1a tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:50:00.858303 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2aae6fc4-af1d-456d-861f-3fb3a815ad1a tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:50:00.858822 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2aae6fc4-af1d-456d-861f-3fb3a815ad1a tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:50:00.859282 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2aae6fc4-af1d-456d-861f-3fb3a815ad1a tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:50:00.955312 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-2aae6fc4-af1d-456d-861f-3fb3a815ad1a tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e838176b44c4f23b470cfc152f79990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3718dd3e536649b5bf1970ff06ddea69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:50:00.959960 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-f49458a2-52ca-44ed-a374-6c19e069f3af req-11a84beb-4249-4700-b3d9-9e280347189c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc217b69-e791-45d2-95eb-c76defe17db7", "name": "network-vif-deleted", "tag": "d5f56a74-2ae4-45c6-bd45-8116441f198c"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:50:00.967984 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-2aae6fc4-af1d-456d-861f-3fb3a815ad1a tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/fc217b69-e791-45d2-95eb-c76defe17db7" status: 200 len: 1654 microversion: 2.1 time: 0.123667 Oct 08 21:50:00.980575 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-f49458a2-52ca-44ed-a374-6c19e069f3af req-11a84beb-4249-4700-b3d9-9e280347189c service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:50:00.981732 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-f49458a2-52ca-44ed-a374-6c19e069f3af req-11a84beb-4249-4700-b3d9-9e280347189c service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:50:00.981902 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3371/6669] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:50:00 2022] GET /compute/v2.1/servers/fc217b69-e791-45d2-95eb-c76defe17db7 => generated 1654 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:50:00.982587 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-f49458a2-52ca-44ed-a374-6c19e069f3af req-11a84beb-4249-4700-b3d9-9e280347189c service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:50:01.005712 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-f49458a2-52ca-44ed-a374-6c19e069f3af req-11a84beb-4249-4700-b3d9-9e280347189c service nova] Creating event network-vif-deleted:d5f56a74-2ae4-45c6-bd45-8116441f198c for instance fc217b69-e791-45d2-95eb-c76defe17db7 on nch2-master-1 Oct 08 21:50:01.010707 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-f49458a2-52ca-44ed-a374-6c19e069f3af req-11a84beb-4249-4700-b3d9-9e280347189c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060259 Oct 08 21:50:01.011257 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3299/6670] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:50:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:50:01.993400 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e5413479-ddbe-404c-98d6-1028420bcc6c tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:50:01.994048 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-e5413479-ddbe-404c-98d6-1028420bcc6c tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: fc217b69-e791-45d2-95eb-c76defe17db7] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:50:02.001135 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e5413479-ddbe-404c-98d6-1028420bcc6c tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:50:02.001692 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e5413479-ddbe-404c-98d6-1028420bcc6c tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:50:02.002166 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e5413479-ddbe-404c-98d6-1028420bcc6c tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:50:02.002900 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e5413479-ddbe-404c-98d6-1028420bcc6c tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:50:02.003390 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e5413479-ddbe-404c-98d6-1028420bcc6c tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:50:02.003848 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e5413479-ddbe-404c-98d6-1028420bcc6c tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:50:02.017930 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-e5413479-ddbe-404c-98d6-1028420bcc6c tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] HTTP exception thrown: Instance fc217b69-e791-45d2-95eb-c76defe17db7 could not be found. Oct 08 21:50:02.019595 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e5413479-ddbe-404c-98d6-1028420bcc6c tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Request method failure captured: Oct 08 21:50:02.019595 ncdv-master-1 devstack@n-api.service[140492]: request: GET /compute/v2.1/servers/fc217b69-e791-45d2-95eb-c76defe17db7 HTTP/1.1 Oct 08 21:50:02.019595 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:50:02.019595 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:50:02.019595 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:50:02.019595 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 21:50:02.019595 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:50:02.019595 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:50:02.019595 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:50:02.019595 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:50:02.019595 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQe9X_YMmNKk_IiLIrhiybTebPLsigD2oA9w_czixVt5baNHq-v99rHVO91kLbytmMA9O9LoejjDppyvtcuO0H46ugJTY6ixLOqtY6uw1GAjA-8XlGpO40NZ8LLPXXTy7eheVZj7WNy7D46LDg2xb5lZmDKadBVs_1JcZ4-Tt9c91XNk Oct 08 21:50:02.019595 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:50:02.019595 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:50:02.019595 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:50:02.019595 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:50:02.019595 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:50:02.019595 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:50:02.019595 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 3718dd3e536649b5bf1970ff06ddea69 Oct 08 21:50:02.019595 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-ServerActionsTestJSON-775805645 Oct 08 21:50:02.019595 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:50:02.019595 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:50:02.019595 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3718dd3e536649b5bf1970ff06ddea69"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3718dd3e536649b5bf1970ff06ddea69"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3718dd3e536649b5bf1970ff06ddea69"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3718dd3e536649b5bf1970ff06ddea69"}]}] Oct 08 21:50:02.019595 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-ServerActionsTestJSON-775805645 Oct 08 21:50:02.019595 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 3718dd3e536649b5bf1970ff06ddea69 Oct 08 21:50:02.019595 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-ServerActionsTestJSON-775805645 Oct 08 21:50:02.019595 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-ServerActionsTestJSON-775805645-project Oct 08 21:50:02.019595 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:50:02.019595 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:50:02.019595 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 5e838176b44c4f23b470cfc152f79990 Oct 08 21:50:02.019595 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-ServerActionsTestJSON-775805645-project Oct 08 21:50:02.019595 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 21:50:02.019595 ncdv-master-1 devstack@n-api.service[140492]: exception: Instance fc217b69-e791-45d2-95eb-c76defe17db7 could not be found. Oct 08 21:50:02.019595 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': 'fc217b69-e791-45d2-95eb-c76defe17db7'} Oct 08 21:50:02.019595 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:50:02.019595 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:50:02.019595 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:50:02.019595 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:50:02.019595 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:50:02.019595 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:50:02.019595 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:50:02.019595 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:50:02.019595 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:50:02.019595 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:50:02.019595 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc217b69-e791-45d2-95eb-c76defe17db7 could not be found. Oct 08 21:50:02.019595 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:50:02.019595 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:50:02.019595 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:50:02.019595 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:50:02.019595 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:50:02.019595 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:50:02.019595 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:50:02.019595 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:50:02.019595 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:50:02.019595 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:50:02.019595 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:50:02.019595 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:50:02.019595 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:50:02.019595 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:50:02.019595 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:50:02.019595 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:50:02.019595 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc217b69-e791-45d2-95eb-c76defe17db7 could not be found. Oct 08 21:50:02.019595 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:50:02.019595 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:50:02.019595 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:50:02.025270 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:50:02.025270 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:50:02.025270 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:50:02.025270 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:50:02.025270 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:50:02.025270 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc217b69-e791-45d2-95eb-c76defe17db7 could not be found. Oct 08 21:50:02.025270 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:50:02.025270 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e5413479-ddbe-404c-98d6-1028420bcc6c tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Returning 404 to user: Instance fc217b69-e791-45d2-95eb-c76defe17db7 could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:50:02.025270 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-e5413479-ddbe-404c-98d6-1028420bcc6c tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/fc217b69-e791-45d2-95eb-c76defe17db7" status: 404 len: 111 microversion: 2.1 time: 0.031790 Oct 08 21:50:02.025270 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3372/6671] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:50:01 2022] GET /compute/v2.1/servers/fc217b69-e791-45d2-95eb-c76defe17db7 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:50:02.085099 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-86a3633f-6662-46bd-b7d1-7f79c0a4f4c8 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:50:02.087391 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-86a3633f-6662-46bd-b7d1-7f79c0a4f4c8 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: fc217b69-e791-45d2-95eb-c76defe17db7] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:50:02.093690 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-86a3633f-6662-46bd-b7d1-7f79c0a4f4c8 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:50:02.094189 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-86a3633f-6662-46bd-b7d1-7f79c0a4f4c8 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:50:02.094639 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-86a3633f-6662-46bd-b7d1-7f79c0a4f4c8 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:50:02.095349 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-86a3633f-6662-46bd-b7d1-7f79c0a4f4c8 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:50:02.095820 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-86a3633f-6662-46bd-b7d1-7f79c0a4f4c8 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:50:02.096257 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-86a3633f-6662-46bd-b7d1-7f79c0a4f4c8 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:50:02.108914 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-86a3633f-6662-46bd-b7d1-7f79c0a4f4c8 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] HTTP exception thrown: Instance fc217b69-e791-45d2-95eb-c76defe17db7 could not be found. Oct 08 21:50:02.110605 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-86a3633f-6662-46bd-b7d1-7f79c0a4f4c8 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Request method failure captured: Oct 08 21:50:02.110605 ncdv-master-1 devstack@n-api.service[140491]: request: GET /compute/v2.1/servers/fc217b69-e791-45d2-95eb-c76defe17db7/os-volume_attachments HTTP/1.1 Oct 08 21:50:02.110605 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:50:02.110605 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:50:02.110605 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:50:02.110605 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 21:50:02.110605 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:50:02.110605 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:50:02.110605 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:50:02.110605 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:50:02.110605 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQe9X_YMmNKk_IiLIrhiybTebPLsigD2oA9w_czixVt5baNHq-v99rHVO91kLbytmMA9O9LoejjDppyvtcuO0H46ugJTY6ixLOqtY6uw1GAjA-8XlGpO40NZ8LLPXXTy7eheVZj7WNy7D46LDg2xb5lZmDKadBVs_1JcZ4-Tt9c91XNk Oct 08 21:50:02.110605 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:50:02.110605 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:50:02.110605 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:50:02.110605 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:50:02.110605 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:50:02.110605 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:50:02.110605 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 3718dd3e536649b5bf1970ff06ddea69 Oct 08 21:50:02.110605 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-ServerActionsTestJSON-775805645 Oct 08 21:50:02.110605 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:50:02.110605 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:50:02.110605 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3718dd3e536649b5bf1970ff06ddea69"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3718dd3e536649b5bf1970ff06ddea69"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3718dd3e536649b5bf1970ff06ddea69"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3718dd3e536649b5bf1970ff06ddea69"}]}] Oct 08 21:50:02.110605 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-ServerActionsTestJSON-775805645 Oct 08 21:50:02.110605 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 3718dd3e536649b5bf1970ff06ddea69 Oct 08 21:50:02.110605 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-ServerActionsTestJSON-775805645 Oct 08 21:50:02.110605 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-ServerActionsTestJSON-775805645-project Oct 08 21:50:02.110605 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:50:02.110605 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:50:02.110605 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 5e838176b44c4f23b470cfc152f79990 Oct 08 21:50:02.110605 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-ServerActionsTestJSON-775805645-project Oct 08 21:50:02.110605 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:50:02.110605 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance fc217b69-e791-45d2-95eb-c76defe17db7 could not be found. Oct 08 21:50:02.110605 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'server_id': 'fc217b69-e791-45d2-95eb-c76defe17db7'} Oct 08 21:50:02.110605 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:50:02.110605 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:50:02.110605 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:50:02.110605 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:50:02.110605 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:50:02.110605 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:50:02.110605 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:50:02.110605 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:50:02.110605 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:50:02.110605 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:50:02.110605 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc217b69-e791-45d2-95eb-c76defe17db7 could not be found. Oct 08 21:50:02.110605 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:50:02.110605 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:50:02.110605 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:50:02.110605 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:50:02.110605 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:50:02.110605 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:50:02.110605 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:50:02.110605 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:50:02.110605 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:50:02.110605 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:50:02.110605 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 08 21:50:02.110605 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 21:50:02.110605 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 08 21:50:02.110605 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 21:50:02.110605 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 08 21:50:02.110605 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 08 21:50:02.110605 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:50:02.110605 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:50:02.115514 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc217b69-e791-45d2-95eb-c76defe17db7 could not be found. Oct 08 21:50:02.115514 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:50:02.115514 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:50:02.115514 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:50:02.115514 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:50:02.115514 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:50:02.115514 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:50:02.115514 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:50:02.115514 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:50:02.115514 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc217b69-e791-45d2-95eb-c76defe17db7 could not be found. Oct 08 21:50:02.115514 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:50:02.115514 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-86a3633f-6662-46bd-b7d1-7f79c0a4f4c8 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Returning 404 to user: Instance fc217b69-e791-45d2-95eb-c76defe17db7 could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:50:02.115514 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-86a3633f-6662-46bd-b7d1-7f79c0a4f4c8 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/fc217b69-e791-45d2-95eb-c76defe17db7/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.032718 Oct 08 21:50:02.115514 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3300/6672] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Oct 8 21:50:02 2022] GET /compute/v2.1/servers/fc217b69-e791-45d2-95eb-c76defe17db7/os-volume_attachments => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:50:03.316778 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-d0d0a29d-839c-44a0-bf88-ed84fbc59f43 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:50:03.317334 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-d0d0a29d-839c-44a0-bf88-ed84fbc59f43 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: fc217b69-e791-45d2-95eb-c76defe17db7] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:50:03.324558 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d0d0a29d-839c-44a0-bf88-ed84fbc59f43 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:50:03.325103 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d0d0a29d-839c-44a0-bf88-ed84fbc59f43 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:50:03.325604 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d0d0a29d-839c-44a0-bf88-ed84fbc59f43 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:50:03.326335 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d0d0a29d-839c-44a0-bf88-ed84fbc59f43 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:50:03.326822 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d0d0a29d-839c-44a0-bf88-ed84fbc59f43 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:50:03.327279 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d0d0a29d-839c-44a0-bf88-ed84fbc59f43 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:50:03.344285 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-d0d0a29d-839c-44a0-bf88-ed84fbc59f43 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] HTTP exception thrown: Instance fc217b69-e791-45d2-95eb-c76defe17db7 could not be found. Oct 08 21:50:03.345884 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-d0d0a29d-839c-44a0-bf88-ed84fbc59f43 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Request method failure captured: Oct 08 21:50:03.345884 ncdv-master-1 devstack@n-api.service[140492]: request: DELETE /compute/v2.1/servers/fc217b69-e791-45d2-95eb-c76defe17db7 HTTP/1.1 Oct 08 21:50:03.345884 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:50:03.345884 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:50:03.345884 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:50:03.345884 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 21:50:03.345884 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:50:03.345884 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:50:03.345884 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:50:03.345884 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:50:03.345884 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQe9X_YMmNKk_IiLIrhiybTebPLsigD2oA9w_czixVt5baNHq-v99rHVO91kLbytmMA9O9LoejjDppyvtcuO0H46ugJTY6ixLOqtY6uw1GAjA-8XlGpO40NZ8LLPXXTy7eheVZj7WNy7D46LDg2xb5lZmDKadBVs_1JcZ4-Tt9c91XNk Oct 08 21:50:03.345884 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:50:03.345884 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:50:03.345884 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:50:03.345884 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:50:03.345884 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:50:03.345884 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:50:03.345884 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 3718dd3e536649b5bf1970ff06ddea69 Oct 08 21:50:03.345884 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-ServerActionsTestJSON-775805645 Oct 08 21:50:03.345884 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:50:03.345884 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:50:03.345884 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3718dd3e536649b5bf1970ff06ddea69"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3718dd3e536649b5bf1970ff06ddea69"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3718dd3e536649b5bf1970ff06ddea69"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3718dd3e536649b5bf1970ff06ddea69"}]}] Oct 08 21:50:03.345884 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-ServerActionsTestJSON-775805645 Oct 08 21:50:03.345884 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 3718dd3e536649b5bf1970ff06ddea69 Oct 08 21:50:03.345884 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-ServerActionsTestJSON-775805645 Oct 08 21:50:03.345884 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-ServerActionsTestJSON-775805645-project Oct 08 21:50:03.345884 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:50:03.345884 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:50:03.345884 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 5e838176b44c4f23b470cfc152f79990 Oct 08 21:50:03.345884 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-ServerActionsTestJSON-775805645-project Oct 08 21:50:03.345884 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 21:50:03.345884 ncdv-master-1 devstack@n-api.service[140492]: exception: Instance fc217b69-e791-45d2-95eb-c76defe17db7 could not be found. Oct 08 21:50:03.345884 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': 'fc217b69-e791-45d2-95eb-c76defe17db7'} Oct 08 21:50:03.345884 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:50:03.345884 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:50:03.345884 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:50:03.345884 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:50:03.345884 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:50:03.345884 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:50:03.345884 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:50:03.345884 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:50:03.345884 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:50:03.345884 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:50:03.345884 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc217b69-e791-45d2-95eb-c76defe17db7 could not be found. Oct 08 21:50:03.345884 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:50:03.345884 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:50:03.345884 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:50:03.345884 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:50:03.345884 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:50:03.345884 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:50:03.345884 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:50:03.345884 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:50:03.345884 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:50:03.345884 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:50:03.345884 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 08 21:50:03.345884 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 08 21:50:03.345884 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 08 21:50:03.345884 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 08 21:50:03.345884 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:50:03.345884 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:50:03.345884 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:50:03.345884 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:50:03.351379 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc217b69-e791-45d2-95eb-c76defe17db7 could not be found. Oct 08 21:50:03.351379 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:50:03.351379 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:50:03.351379 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:50:03.351379 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:50:03.351379 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:50:03.351379 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:50:03.351379 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:50:03.351379 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:50:03.351379 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc217b69-e791-45d2-95eb-c76defe17db7 could not be found. Oct 08 21:50:03.351379 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:50:03.351379 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-d0d0a29d-839c-44a0-bf88-ed84fbc59f43 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Returning 404 to user: Instance fc217b69-e791-45d2-95eb-c76defe17db7 could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:50:03.351379 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-d0d0a29d-839c-44a0-bf88-ed84fbc59f43 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "DELETE /compute/v2.1/servers/fc217b69-e791-45d2-95eb-c76defe17db7" status: 404 len: 111 microversion: 2.1 time: 0.034736 Oct 08 21:50:03.351379 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3373/6673] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:50:03 2022] DELETE /compute/v2.1/servers/fc217b69-e791-45d2-95eb-c76defe17db7 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:50:03.356434 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-4fa68c7a-1041-4f60-b7d4-f61ded107ebc tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:50:03.357057 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-4fa68c7a-1041-4f60-b7d4-f61ded107ebc tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: fc217b69-e791-45d2-95eb-c76defe17db7] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:50:03.364109 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4fa68c7a-1041-4f60-b7d4-f61ded107ebc tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:50:03.364607 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4fa68c7a-1041-4f60-b7d4-f61ded107ebc tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:50:03.365054 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4fa68c7a-1041-4f60-b7d4-f61ded107ebc tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:50:03.365797 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4fa68c7a-1041-4f60-b7d4-f61ded107ebc tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:50:03.366267 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4fa68c7a-1041-4f60-b7d4-f61ded107ebc tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:50:03.366708 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4fa68c7a-1041-4f60-b7d4-f61ded107ebc tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:50:03.381419 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-4fa68c7a-1041-4f60-b7d4-f61ded107ebc tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] HTTP exception thrown: Instance fc217b69-e791-45d2-95eb-c76defe17db7 could not be found. Oct 08 21:50:03.383022 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-4fa68c7a-1041-4f60-b7d4-f61ded107ebc tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Request method failure captured: Oct 08 21:50:03.383022 ncdv-master-1 devstack@n-api.service[140491]: request: GET /compute/v2.1/servers/fc217b69-e791-45d2-95eb-c76defe17db7 HTTP/1.1 Oct 08 21:50:03.383022 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:50:03.383022 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:50:03.383022 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:50:03.383022 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 21:50:03.383022 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:50:03.383022 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:50:03.383022 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:50:03.383022 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:50:03.383022 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQe9X_YMmNKk_IiLIrhiybTebPLsigD2oA9w_czixVt5baNHq-v99rHVO91kLbytmMA9O9LoejjDppyvtcuO0H46ugJTY6ixLOqtY6uw1GAjA-8XlGpO40NZ8LLPXXTy7eheVZj7WNy7D46LDg2xb5lZmDKadBVs_1JcZ4-Tt9c91XNk Oct 08 21:50:03.383022 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:50:03.383022 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:50:03.383022 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:50:03.383022 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:50:03.383022 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:50:03.383022 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:50:03.383022 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 3718dd3e536649b5bf1970ff06ddea69 Oct 08 21:50:03.383022 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-ServerActionsTestJSON-775805645 Oct 08 21:50:03.383022 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:50:03.383022 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:50:03.383022 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3718dd3e536649b5bf1970ff06ddea69"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3718dd3e536649b5bf1970ff06ddea69"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3718dd3e536649b5bf1970ff06ddea69"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3718dd3e536649b5bf1970ff06ddea69"}]}] Oct 08 21:50:03.383022 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-ServerActionsTestJSON-775805645 Oct 08 21:50:03.383022 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 3718dd3e536649b5bf1970ff06ddea69 Oct 08 21:50:03.383022 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-ServerActionsTestJSON-775805645 Oct 08 21:50:03.383022 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-ServerActionsTestJSON-775805645-project Oct 08 21:50:03.383022 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:50:03.383022 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:50:03.383022 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 5e838176b44c4f23b470cfc152f79990 Oct 08 21:50:03.383022 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-ServerActionsTestJSON-775805645-project Oct 08 21:50:03.383022 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:50:03.383022 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance fc217b69-e791-45d2-95eb-c76defe17db7 could not be found. Oct 08 21:50:03.383022 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': 'fc217b69-e791-45d2-95eb-c76defe17db7'} Oct 08 21:50:03.383022 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:50:03.383022 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:50:03.383022 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:50:03.383022 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:50:03.383022 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:50:03.383022 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:50:03.383022 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:50:03.383022 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:50:03.383022 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:50:03.383022 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:50:03.383022 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc217b69-e791-45d2-95eb-c76defe17db7 could not be found. Oct 08 21:50:03.383022 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:50:03.383022 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:50:03.383022 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:50:03.383022 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:50:03.383022 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:50:03.383022 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:50:03.383022 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:50:03.383022 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:50:03.383022 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:50:03.383022 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:50:03.383022 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:50:03.383022 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:50:03.383022 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:50:03.383022 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:50:03.383022 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:50:03.383022 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:50:03.383022 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc217b69-e791-45d2-95eb-c76defe17db7 could not be found. Oct 08 21:50:03.383022 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:50:03.383022 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:50:03.383022 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:50:03.388111 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:50:03.388111 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:50:03.388111 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:50:03.388111 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:50:03.388111 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:50:03.388111 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc217b69-e791-45d2-95eb-c76defe17db7 could not be found. Oct 08 21:50:03.388111 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:50:03.388111 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-4fa68c7a-1041-4f60-b7d4-f61ded107ebc tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Returning 404 to user: Instance fc217b69-e791-45d2-95eb-c76defe17db7 could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:50:03.388111 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-4fa68c7a-1041-4f60-b7d4-f61ded107ebc tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/fc217b69-e791-45d2-95eb-c76defe17db7" status: 404 len: 111 microversion: 2.1 time: 0.031930 Oct 08 21:50:03.388111 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3301/6674] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:50:03 2022] GET /compute/v2.1/servers/fc217b69-e791-45d2-95eb-c76defe17db7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:50:03.393078 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e2bc4d4b-fb6d-4142-a94d-fb1f82aa0831 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:50:03.393633 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-e2bc4d4b-fb6d-4142-a94d-fb1f82aa0831 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: 521af341-8ec9-4dc5-901f-68a80a167d46] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:50:03.400382 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e2bc4d4b-fb6d-4142-a94d-fb1f82aa0831 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:50:03.400897 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e2bc4d4b-fb6d-4142-a94d-fb1f82aa0831 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:50:03.401396 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e2bc4d4b-fb6d-4142-a94d-fb1f82aa0831 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:50:03.402125 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e2bc4d4b-fb6d-4142-a94d-fb1f82aa0831 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:50:03.402620 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e2bc4d4b-fb6d-4142-a94d-fb1f82aa0831 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:50:03.403078 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e2bc4d4b-fb6d-4142-a94d-fb1f82aa0831 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:50:03.416658 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-e2bc4d4b-fb6d-4142-a94d-fb1f82aa0831 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] HTTP exception thrown: Instance 521af341-8ec9-4dc5-901f-68a80a167d46 could not be found. Oct 08 21:50:03.418244 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e2bc4d4b-fb6d-4142-a94d-fb1f82aa0831 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Request method failure captured: Oct 08 21:50:03.418244 ncdv-master-1 devstack@n-api.service[140492]: request: DELETE /compute/v2.1/servers/521af341-8ec9-4dc5-901f-68a80a167d46 HTTP/1.1 Oct 08 21:50:03.418244 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:50:03.418244 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:50:03.418244 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:50:03.418244 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 21:50:03.418244 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:50:03.418244 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:50:03.418244 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:50:03.418244 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:50:03.418244 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQe9X_YMmNKk_IiLIrhiybTebPLsigD2oA9w_czixVt5baNHq-v99rHVO91kLbytmMA9O9LoejjDppyvtcuO0H46ugJTY6ixLOqtY6uw1GAjA-8XlGpO40NZ8LLPXXTy7eheVZj7WNy7D46LDg2xb5lZmDKadBVs_1JcZ4-Tt9c91XNk Oct 08 21:50:03.418244 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:50:03.418244 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:50:03.418244 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:50:03.418244 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:50:03.418244 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:50:03.418244 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:50:03.418244 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 3718dd3e536649b5bf1970ff06ddea69 Oct 08 21:50:03.418244 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-ServerActionsTestJSON-775805645 Oct 08 21:50:03.418244 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:50:03.418244 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:50:03.418244 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3718dd3e536649b5bf1970ff06ddea69"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3718dd3e536649b5bf1970ff06ddea69"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3718dd3e536649b5bf1970ff06ddea69"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3718dd3e536649b5bf1970ff06ddea69"}]}] Oct 08 21:50:03.418244 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-ServerActionsTestJSON-775805645 Oct 08 21:50:03.418244 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 3718dd3e536649b5bf1970ff06ddea69 Oct 08 21:50:03.418244 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-ServerActionsTestJSON-775805645 Oct 08 21:50:03.418244 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-ServerActionsTestJSON-775805645-project Oct 08 21:50:03.418244 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:50:03.418244 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:50:03.418244 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 5e838176b44c4f23b470cfc152f79990 Oct 08 21:50:03.418244 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-ServerActionsTestJSON-775805645-project Oct 08 21:50:03.418244 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 21:50:03.418244 ncdv-master-1 devstack@n-api.service[140492]: exception: Instance 521af341-8ec9-4dc5-901f-68a80a167d46 could not be found. Oct 08 21:50:03.418244 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': '521af341-8ec9-4dc5-901f-68a80a167d46'} Oct 08 21:50:03.418244 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:50:03.418244 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:50:03.418244 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:50:03.418244 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:50:03.418244 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:50:03.418244 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:50:03.418244 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:50:03.418244 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:50:03.418244 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:50:03.418244 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:50:03.418244 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 521af341-8ec9-4dc5-901f-68a80a167d46 could not be found. Oct 08 21:50:03.418244 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:50:03.418244 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:50:03.418244 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:50:03.418244 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:50:03.418244 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:50:03.418244 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:50:03.418244 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:50:03.418244 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:50:03.418244 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:50:03.418244 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:50:03.418244 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 08 21:50:03.418244 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 08 21:50:03.418244 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 08 21:50:03.418244 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 08 21:50:03.418244 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:50:03.418244 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:50:03.418244 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:50:03.418244 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:50:03.423279 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 521af341-8ec9-4dc5-901f-68a80a167d46 could not be found. Oct 08 21:50:03.423279 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:50:03.423279 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:50:03.423279 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:50:03.423279 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:50:03.423279 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:50:03.423279 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:50:03.423279 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:50:03.423279 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:50:03.423279 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 521af341-8ec9-4dc5-901f-68a80a167d46 could not be found. Oct 08 21:50:03.423279 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:50:03.423279 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e2bc4d4b-fb6d-4142-a94d-fb1f82aa0831 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Returning 404 to user: Instance 521af341-8ec9-4dc5-901f-68a80a167d46 could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:50:03.423279 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-e2bc4d4b-fb6d-4142-a94d-fb1f82aa0831 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "DELETE /compute/v2.1/servers/521af341-8ec9-4dc5-901f-68a80a167d46" status: 404 len: 111 microversion: 2.1 time: 0.030558 Oct 08 21:50:03.423279 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3374/6675] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:50:03 2022] DELETE /compute/v2.1/servers/521af341-8ec9-4dc5-901f-68a80a167d46 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:50:03.427928 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-962e621d-e5df-4ebd-b3c9-d2fb3f41c343 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:50:03.428552 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-962e621d-e5df-4ebd-b3c9-d2fb3f41c343 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: 521af341-8ec9-4dc5-901f-68a80a167d46] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:50:03.434679 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-962e621d-e5df-4ebd-b3c9-d2fb3f41c343 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:50:03.435177 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-962e621d-e5df-4ebd-b3c9-d2fb3f41c343 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:50:03.435627 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-962e621d-e5df-4ebd-b3c9-d2fb3f41c343 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:50:03.436334 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-962e621d-e5df-4ebd-b3c9-d2fb3f41c343 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:50:03.436803 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-962e621d-e5df-4ebd-b3c9-d2fb3f41c343 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:50:03.437263 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-962e621d-e5df-4ebd-b3c9-d2fb3f41c343 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:50:03.451596 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-962e621d-e5df-4ebd-b3c9-d2fb3f41c343 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] HTTP exception thrown: Instance 521af341-8ec9-4dc5-901f-68a80a167d46 could not be found. Oct 08 21:50:03.453113 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-962e621d-e5df-4ebd-b3c9-d2fb3f41c343 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Request method failure captured: Oct 08 21:50:03.453113 ncdv-master-1 devstack@n-api.service[140491]: request: GET /compute/v2.1/servers/521af341-8ec9-4dc5-901f-68a80a167d46 HTTP/1.1 Oct 08 21:50:03.453113 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:50:03.453113 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:50:03.453113 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:50:03.453113 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 21:50:03.453113 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:50:03.453113 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:50:03.453113 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:50:03.453113 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:50:03.453113 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQe9X_YMmNKk_IiLIrhiybTebPLsigD2oA9w_czixVt5baNHq-v99rHVO91kLbytmMA9O9LoejjDppyvtcuO0H46ugJTY6ixLOqtY6uw1GAjA-8XlGpO40NZ8LLPXXTy7eheVZj7WNy7D46LDg2xb5lZmDKadBVs_1JcZ4-Tt9c91XNk Oct 08 21:50:03.453113 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:50:03.453113 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:50:03.453113 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:50:03.453113 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:50:03.453113 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:50:03.453113 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:50:03.453113 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 3718dd3e536649b5bf1970ff06ddea69 Oct 08 21:50:03.453113 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-ServerActionsTestJSON-775805645 Oct 08 21:50:03.453113 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:50:03.453113 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:50:03.453113 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3718dd3e536649b5bf1970ff06ddea69"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3718dd3e536649b5bf1970ff06ddea69"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3718dd3e536649b5bf1970ff06ddea69"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3718dd3e536649b5bf1970ff06ddea69"}]}] Oct 08 21:50:03.453113 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-ServerActionsTestJSON-775805645 Oct 08 21:50:03.453113 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 3718dd3e536649b5bf1970ff06ddea69 Oct 08 21:50:03.453113 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-ServerActionsTestJSON-775805645 Oct 08 21:50:03.453113 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-ServerActionsTestJSON-775805645-project Oct 08 21:50:03.453113 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:50:03.453113 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:50:03.453113 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 5e838176b44c4f23b470cfc152f79990 Oct 08 21:50:03.453113 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-ServerActionsTestJSON-775805645-project Oct 08 21:50:03.453113 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:50:03.453113 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance 521af341-8ec9-4dc5-901f-68a80a167d46 could not be found. Oct 08 21:50:03.453113 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': '521af341-8ec9-4dc5-901f-68a80a167d46'} Oct 08 21:50:03.453113 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:50:03.453113 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:50:03.453113 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:50:03.453113 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:50:03.453113 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:50:03.453113 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:50:03.453113 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:50:03.453113 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:50:03.453113 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:50:03.453113 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:50:03.453113 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 521af341-8ec9-4dc5-901f-68a80a167d46 could not be found. Oct 08 21:50:03.453113 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:50:03.453113 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:50:03.453113 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:50:03.453113 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:50:03.453113 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:50:03.453113 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:50:03.453113 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:50:03.453113 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:50:03.453113 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:50:03.453113 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:50:03.453113 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:50:03.453113 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:50:03.453113 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:50:03.453113 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:50:03.453113 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:50:03.453113 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:50:03.453113 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 521af341-8ec9-4dc5-901f-68a80a167d46 could not be found. Oct 08 21:50:03.453113 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:50:03.453113 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:50:03.453113 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:50:03.459218 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:50:03.459218 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:50:03.459218 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:50:03.459218 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:50:03.459218 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:50:03.459218 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 521af341-8ec9-4dc5-901f-68a80a167d46 could not be found. Oct 08 21:50:03.459218 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:50:03.459218 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-962e621d-e5df-4ebd-b3c9-d2fb3f41c343 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Returning 404 to user: Instance 521af341-8ec9-4dc5-901f-68a80a167d46 could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:50:03.459218 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-962e621d-e5df-4ebd-b3c9-d2fb3f41c343 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/521af341-8ec9-4dc5-901f-68a80a167d46" status: 404 len: 111 microversion: 2.1 time: 0.030488 Oct 08 21:50:03.459218 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3302/6676] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:50:03 2022] GET /compute/v2.1/servers/521af341-8ec9-4dc5-901f-68a80a167d46 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:50:03.463972 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e02ee2b2-f017-4334-850d-23416ebcc64f tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:50:03.464632 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-e02ee2b2-f017-4334-850d-23416ebcc64f tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: fb5b6e20-bd92-4b53-bed6-4e747e8c84ca] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:50:03.470770 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e02ee2b2-f017-4334-850d-23416ebcc64f tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:50:03.471275 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e02ee2b2-f017-4334-850d-23416ebcc64f tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:50:03.471734 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e02ee2b2-f017-4334-850d-23416ebcc64f tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:50:03.472449 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e02ee2b2-f017-4334-850d-23416ebcc64f tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:50:03.472929 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e02ee2b2-f017-4334-850d-23416ebcc64f tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:50:03.473436 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e02ee2b2-f017-4334-850d-23416ebcc64f tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:50:03.487280 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-e02ee2b2-f017-4334-850d-23416ebcc64f tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] HTTP exception thrown: Instance fb5b6e20-bd92-4b53-bed6-4e747e8c84ca could not be found. Oct 08 21:50:03.488862 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e02ee2b2-f017-4334-850d-23416ebcc64f tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Request method failure captured: Oct 08 21:50:03.488862 ncdv-master-1 devstack@n-api.service[140492]: request: DELETE /compute/v2.1/servers/fb5b6e20-bd92-4b53-bed6-4e747e8c84ca HTTP/1.1 Oct 08 21:50:03.488862 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:50:03.488862 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:50:03.488862 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:50:03.488862 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 21:50:03.488862 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:50:03.488862 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:50:03.488862 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:50:03.488862 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:50:03.488862 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQe9X_YMmNKk_IiLIrhiybTebPLsigD2oA9w_czixVt5baNHq-v99rHVO91kLbytmMA9O9LoejjDppyvtcuO0H46ugJTY6ixLOqtY6uw1GAjA-8XlGpO40NZ8LLPXXTy7eheVZj7WNy7D46LDg2xb5lZmDKadBVs_1JcZ4-Tt9c91XNk Oct 08 21:50:03.488862 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:50:03.488862 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:50:03.488862 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:50:03.488862 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:50:03.488862 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:50:03.488862 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:50:03.488862 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 3718dd3e536649b5bf1970ff06ddea69 Oct 08 21:50:03.488862 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-ServerActionsTestJSON-775805645 Oct 08 21:50:03.488862 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:50:03.488862 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:50:03.488862 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3718dd3e536649b5bf1970ff06ddea69"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3718dd3e536649b5bf1970ff06ddea69"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3718dd3e536649b5bf1970ff06ddea69"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3718dd3e536649b5bf1970ff06ddea69"}]}] Oct 08 21:50:03.488862 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-ServerActionsTestJSON-775805645 Oct 08 21:50:03.488862 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 3718dd3e536649b5bf1970ff06ddea69 Oct 08 21:50:03.488862 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-ServerActionsTestJSON-775805645 Oct 08 21:50:03.488862 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-ServerActionsTestJSON-775805645-project Oct 08 21:50:03.488862 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:50:03.488862 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:50:03.488862 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 5e838176b44c4f23b470cfc152f79990 Oct 08 21:50:03.488862 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-ServerActionsTestJSON-775805645-project Oct 08 21:50:03.488862 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 21:50:03.488862 ncdv-master-1 devstack@n-api.service[140492]: exception: Instance fb5b6e20-bd92-4b53-bed6-4e747e8c84ca could not be found. Oct 08 21:50:03.488862 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': 'fb5b6e20-bd92-4b53-bed6-4e747e8c84ca'} Oct 08 21:50:03.488862 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:50:03.488862 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:50:03.488862 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:50:03.488862 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:50:03.488862 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:50:03.488862 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:50:03.488862 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:50:03.488862 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:50:03.488862 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:50:03.488862 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:50:03.488862 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb5b6e20-bd92-4b53-bed6-4e747e8c84ca could not be found. Oct 08 21:50:03.488862 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:50:03.488862 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:50:03.488862 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:50:03.488862 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:50:03.488862 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:50:03.488862 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:50:03.488862 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:50:03.488862 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:50:03.488862 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:50:03.488862 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:50:03.488862 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 08 21:50:03.488862 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 08 21:50:03.488862 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 08 21:50:03.488862 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 08 21:50:03.488862 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:50:03.488862 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:50:03.488862 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:50:03.488862 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:50:03.493091 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb5b6e20-bd92-4b53-bed6-4e747e8c84ca could not be found. Oct 08 21:50:03.493091 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:50:03.493091 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:50:03.493091 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:50:03.493091 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:50:03.493091 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:50:03.493091 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:50:03.493091 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:50:03.493091 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:50:03.493091 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb5b6e20-bd92-4b53-bed6-4e747e8c84ca could not be found. Oct 08 21:50:03.493091 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:50:03.493091 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e02ee2b2-f017-4334-850d-23416ebcc64f tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Returning 404 to user: Instance fb5b6e20-bd92-4b53-bed6-4e747e8c84ca could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:50:03.493091 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-e02ee2b2-f017-4334-850d-23416ebcc64f tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "DELETE /compute/v2.1/servers/fb5b6e20-bd92-4b53-bed6-4e747e8c84ca" status: 404 len: 111 microversion: 2.1 time: 0.030329 Oct 08 21:50:03.493091 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3375/6677] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:50:03 2022] DELETE /compute/v2.1/servers/fb5b6e20-bd92-4b53-bed6-4e747e8c84ca => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:50:03.499502 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-d8642077-8b43-44ec-a19a-7c073a4487a9 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:50:03.500156 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-d8642077-8b43-44ec-a19a-7c073a4487a9 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: fb5b6e20-bd92-4b53-bed6-4e747e8c84ca] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:50:03.506895 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d8642077-8b43-44ec-a19a-7c073a4487a9 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:50:03.507384 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d8642077-8b43-44ec-a19a-7c073a4487a9 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:50:03.507827 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d8642077-8b43-44ec-a19a-7c073a4487a9 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:50:03.508552 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d8642077-8b43-44ec-a19a-7c073a4487a9 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:50:03.509031 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d8642077-8b43-44ec-a19a-7c073a4487a9 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:50:03.509477 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d8642077-8b43-44ec-a19a-7c073a4487a9 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:50:03.523546 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-d8642077-8b43-44ec-a19a-7c073a4487a9 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] HTTP exception thrown: Instance fb5b6e20-bd92-4b53-bed6-4e747e8c84ca could not be found. Oct 08 21:50:03.525080 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-d8642077-8b43-44ec-a19a-7c073a4487a9 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Request method failure captured: Oct 08 21:50:03.525080 ncdv-master-1 devstack@n-api.service[140491]: request: GET /compute/v2.1/servers/fb5b6e20-bd92-4b53-bed6-4e747e8c84ca HTTP/1.1 Oct 08 21:50:03.525080 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:50:03.525080 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:50:03.525080 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:50:03.525080 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 21:50:03.525080 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:50:03.525080 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:50:03.525080 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:50:03.525080 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:50:03.525080 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQe9X_YMmNKk_IiLIrhiybTebPLsigD2oA9w_czixVt5baNHq-v99rHVO91kLbytmMA9O9LoejjDppyvtcuO0H46ugJTY6ixLOqtY6uw1GAjA-8XlGpO40NZ8LLPXXTy7eheVZj7WNy7D46LDg2xb5lZmDKadBVs_1JcZ4-Tt9c91XNk Oct 08 21:50:03.525080 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:50:03.525080 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:50:03.525080 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:50:03.525080 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:50:03.525080 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:50:03.525080 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:50:03.525080 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 3718dd3e536649b5bf1970ff06ddea69 Oct 08 21:50:03.525080 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-ServerActionsTestJSON-775805645 Oct 08 21:50:03.525080 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:50:03.525080 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:50:03.525080 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3718dd3e536649b5bf1970ff06ddea69"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3718dd3e536649b5bf1970ff06ddea69"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3718dd3e536649b5bf1970ff06ddea69"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3718dd3e536649b5bf1970ff06ddea69"}]}] Oct 08 21:50:03.525080 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-ServerActionsTestJSON-775805645 Oct 08 21:50:03.525080 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 3718dd3e536649b5bf1970ff06ddea69 Oct 08 21:50:03.525080 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-ServerActionsTestJSON-775805645 Oct 08 21:50:03.525080 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-ServerActionsTestJSON-775805645-project Oct 08 21:50:03.525080 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:50:03.525080 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:50:03.525080 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 5e838176b44c4f23b470cfc152f79990 Oct 08 21:50:03.525080 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-ServerActionsTestJSON-775805645-project Oct 08 21:50:03.525080 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:50:03.525080 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance fb5b6e20-bd92-4b53-bed6-4e747e8c84ca could not be found. Oct 08 21:50:03.525080 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': 'fb5b6e20-bd92-4b53-bed6-4e747e8c84ca'} Oct 08 21:50:03.525080 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:50:03.525080 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:50:03.525080 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:50:03.525080 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:50:03.525080 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:50:03.525080 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:50:03.525080 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:50:03.525080 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:50:03.525080 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:50:03.525080 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:50:03.525080 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb5b6e20-bd92-4b53-bed6-4e747e8c84ca could not be found. Oct 08 21:50:03.525080 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:50:03.525080 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:50:03.525080 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:50:03.525080 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:50:03.525080 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:50:03.525080 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:50:03.525080 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:50:03.525080 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:50:03.525080 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:50:03.525080 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:50:03.525080 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:50:03.525080 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:50:03.525080 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:50:03.525080 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:50:03.525080 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:50:03.525080 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:50:03.525080 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb5b6e20-bd92-4b53-bed6-4e747e8c84ca could not be found. Oct 08 21:50:03.525080 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:50:03.525080 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:50:03.525080 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:50:03.530000 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:50:03.530000 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:50:03.530000 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:50:03.530000 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:50:03.530000 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:50:03.530000 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb5b6e20-bd92-4b53-bed6-4e747e8c84ca could not be found. Oct 08 21:50:03.530000 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:50:03.530000 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-d8642077-8b43-44ec-a19a-7c073a4487a9 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Returning 404 to user: Instance fb5b6e20-bd92-4b53-bed6-4e747e8c84ca could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:50:03.530000 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-d8642077-8b43-44ec-a19a-7c073a4487a9 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/fb5b6e20-bd92-4b53-bed6-4e747e8c84ca" status: 404 len: 111 microversion: 2.1 time: 0.031042 Oct 08 21:50:03.530000 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3303/6678] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:50:03 2022] GET /compute/v2.1/servers/fb5b6e20-bd92-4b53-bed6-4e747e8c84ca => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:50:03.534805 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-1837d8fb-17ae-4adf-91c8-c545137aa0b7 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:50:03.535353 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-1837d8fb-17ae-4adf-91c8-c545137aa0b7 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: a3c87119-d9e1-433a-a43d-7aa600968dd0] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:50:03.541331 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1837d8fb-17ae-4adf-91c8-c545137aa0b7 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:50:03.541835 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1837d8fb-17ae-4adf-91c8-c545137aa0b7 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:50:03.542355 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1837d8fb-17ae-4adf-91c8-c545137aa0b7 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:50:03.543015 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1837d8fb-17ae-4adf-91c8-c545137aa0b7 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:50:03.543495 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1837d8fb-17ae-4adf-91c8-c545137aa0b7 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:50:03.543943 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1837d8fb-17ae-4adf-91c8-c545137aa0b7 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:50:03.557431 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-1837d8fb-17ae-4adf-91c8-c545137aa0b7 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] HTTP exception thrown: Instance a3c87119-d9e1-433a-a43d-7aa600968dd0 could not be found. Oct 08 21:50:03.558980 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-1837d8fb-17ae-4adf-91c8-c545137aa0b7 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Request method failure captured: Oct 08 21:50:03.558980 ncdv-master-1 devstack@n-api.service[140492]: request: DELETE /compute/v2.1/servers/a3c87119-d9e1-433a-a43d-7aa600968dd0 HTTP/1.1 Oct 08 21:50:03.558980 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:50:03.558980 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:50:03.558980 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:50:03.558980 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 21:50:03.558980 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:50:03.558980 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:50:03.558980 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:50:03.558980 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:50:03.558980 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQe9X_YMmNKk_IiLIrhiybTebPLsigD2oA9w_czixVt5baNHq-v99rHVO91kLbytmMA9O9LoejjDppyvtcuO0H46ugJTY6ixLOqtY6uw1GAjA-8XlGpO40NZ8LLPXXTy7eheVZj7WNy7D46LDg2xb5lZmDKadBVs_1JcZ4-Tt9c91XNk Oct 08 21:50:03.558980 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:50:03.558980 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:50:03.558980 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:50:03.558980 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:50:03.558980 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:50:03.558980 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:50:03.558980 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: 3718dd3e536649b5bf1970ff06ddea69 Oct 08 21:50:03.558980 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-ServerActionsTestJSON-775805645 Oct 08 21:50:03.558980 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:50:03.558980 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:50:03.558980 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3718dd3e536649b5bf1970ff06ddea69"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3718dd3e536649b5bf1970ff06ddea69"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3718dd3e536649b5bf1970ff06ddea69"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3718dd3e536649b5bf1970ff06ddea69"}]}] Oct 08 21:50:03.558980 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-ServerActionsTestJSON-775805645 Oct 08 21:50:03.558980 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: 3718dd3e536649b5bf1970ff06ddea69 Oct 08 21:50:03.558980 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-ServerActionsTestJSON-775805645 Oct 08 21:50:03.558980 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-ServerActionsTestJSON-775805645-project Oct 08 21:50:03.558980 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:50:03.558980 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:50:03.558980 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 5e838176b44c4f23b470cfc152f79990 Oct 08 21:50:03.558980 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-ServerActionsTestJSON-775805645-project Oct 08 21:50:03.558980 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 21:50:03.558980 ncdv-master-1 devstack@n-api.service[140492]: exception: Instance a3c87119-d9e1-433a-a43d-7aa600968dd0 could not be found. Oct 08 21:50:03.558980 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': 'a3c87119-d9e1-433a-a43d-7aa600968dd0'} Oct 08 21:50:03.558980 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:50:03.558980 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:50:03.558980 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:50:03.558980 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:50:03.558980 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:50:03.558980 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:50:03.558980 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:50:03.558980 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:50:03.558980 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:50:03.558980 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:50:03.558980 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3c87119-d9e1-433a-a43d-7aa600968dd0 could not be found. Oct 08 21:50:03.558980 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:50:03.558980 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:50:03.558980 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:50:03.558980 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:50:03.558980 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:50:03.558980 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:50:03.558980 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:50:03.558980 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:50:03.558980 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:50:03.558980 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:50:03.558980 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 08 21:50:03.558980 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 08 21:50:03.558980 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 08 21:50:03.558980 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 08 21:50:03.558980 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:50:03.558980 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:50:03.558980 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:50:03.558980 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:50:03.563658 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3c87119-d9e1-433a-a43d-7aa600968dd0 could not be found. Oct 08 21:50:03.563658 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:50:03.563658 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:50:03.563658 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:50:03.563658 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:50:03.563658 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:50:03.563658 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:50:03.563658 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:50:03.563658 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:50:03.563658 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3c87119-d9e1-433a-a43d-7aa600968dd0 could not be found. Oct 08 21:50:03.563658 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:50:03.563658 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-1837d8fb-17ae-4adf-91c8-c545137aa0b7 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Returning 404 to user: Instance a3c87119-d9e1-433a-a43d-7aa600968dd0 could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:50:03.563658 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-1837d8fb-17ae-4adf-91c8-c545137aa0b7 tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "DELETE /compute/v2.1/servers/a3c87119-d9e1-433a-a43d-7aa600968dd0" status: 404 len: 111 microversion: 2.1 time: 0.029455 Oct 08 21:50:03.563658 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3376/6679] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:50:03 2022] DELETE /compute/v2.1/servers/a3c87119-d9e1-433a-a43d-7aa600968dd0 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 08 21:50:03.569549 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-4a080fc2-ffcb-4db9-b395-15250841527a tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:50:03.570292 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-4a080fc2-ffcb-4db9-b395-15250841527a tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] [instance: a3c87119-d9e1-433a-a43d-7aa600968dd0] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:50:03.576368 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4a080fc2-ffcb-4db9-b395-15250841527a tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:50:03.576866 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4a080fc2-ffcb-4db9-b395-15250841527a tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:50:03.577341 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4a080fc2-ffcb-4db9-b395-15250841527a tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:50:03.578049 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4a080fc2-ffcb-4db9-b395-15250841527a tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:50:03.578515 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4a080fc2-ffcb-4db9-b395-15250841527a tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:50:03.578952 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4a080fc2-ffcb-4db9-b395-15250841527a tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:50:03.592954 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-4a080fc2-ffcb-4db9-b395-15250841527a tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] HTTP exception thrown: Instance a3c87119-d9e1-433a-a43d-7aa600968dd0 could not be found. Oct 08 21:50:03.594496 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-4a080fc2-ffcb-4db9-b395-15250841527a tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Request method failure captured: Oct 08 21:50:03.594496 ncdv-master-1 devstack@n-api.service[140491]: request: GET /compute/v2.1/servers/a3c87119-d9e1-433a-a43d-7aa600968dd0 HTTP/1.1 Oct 08 21:50:03.594496 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:50:03.594496 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:50:03.594496 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:50:03.594496 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 21:50:03.594496 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:50:03.594496 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:50:03.594496 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:50:03.594496 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:50:03.594496 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQe9X_YMmNKk_IiLIrhiybTebPLsigD2oA9w_czixVt5baNHq-v99rHVO91kLbytmMA9O9LoejjDppyvtcuO0H46ugJTY6ixLOqtY6uw1GAjA-8XlGpO40NZ8LLPXXTy7eheVZj7WNy7D46LDg2xb5lZmDKadBVs_1JcZ4-Tt9c91XNk Oct 08 21:50:03.594496 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:50:03.594496 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:50:03.594496 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:50:03.594496 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:50:03.594496 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:50:03.594496 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:50:03.594496 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 3718dd3e536649b5bf1970ff06ddea69 Oct 08 21:50:03.594496 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-ServerActionsTestJSON-775805645 Oct 08 21:50:03.594496 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:50:03.594496 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:50:03.594496 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3718dd3e536649b5bf1970ff06ddea69"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3718dd3e536649b5bf1970ff06ddea69"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3718dd3e536649b5bf1970ff06ddea69"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3718dd3e536649b5bf1970ff06ddea69"}]}] Oct 08 21:50:03.594496 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-ServerActionsTestJSON-775805645 Oct 08 21:50:03.594496 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 3718dd3e536649b5bf1970ff06ddea69 Oct 08 21:50:03.594496 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-ServerActionsTestJSON-775805645 Oct 08 21:50:03.594496 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-ServerActionsTestJSON-775805645-project Oct 08 21:50:03.594496 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:50:03.594496 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:50:03.594496 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 5e838176b44c4f23b470cfc152f79990 Oct 08 21:50:03.594496 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-ServerActionsTestJSON-775805645-project Oct 08 21:50:03.594496 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:50:03.594496 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance a3c87119-d9e1-433a-a43d-7aa600968dd0 could not be found. Oct 08 21:50:03.594496 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': 'a3c87119-d9e1-433a-a43d-7aa600968dd0'} Oct 08 21:50:03.594496 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:50:03.594496 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:50:03.594496 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:50:03.594496 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:50:03.594496 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:50:03.594496 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:50:03.594496 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:50:03.594496 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:50:03.594496 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:50:03.594496 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:50:03.594496 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3c87119-d9e1-433a-a43d-7aa600968dd0 could not be found. Oct 08 21:50:03.594496 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:50:03.594496 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:50:03.594496 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:50:03.594496 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:50:03.594496 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:50:03.594496 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:50:03.594496 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:50:03.594496 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:50:03.594496 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:50:03.594496 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:50:03.594496 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:50:03.594496 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:50:03.594496 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:50:03.594496 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:50:03.594496 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:50:03.594496 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:50:03.594496 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3c87119-d9e1-433a-a43d-7aa600968dd0 could not be found. Oct 08 21:50:03.594496 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:50:03.594496 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:50:03.594496 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:50:03.602140 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:50:03.602140 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:50:03.602140 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:50:03.602140 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:50:03.602140 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:50:03.602140 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3c87119-d9e1-433a-a43d-7aa600968dd0 could not be found. Oct 08 21:50:03.602140 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:50:03.602140 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-4a080fc2-ffcb-4db9-b395-15250841527a tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Returning 404 to user: Instance a3c87119-d9e1-433a-a43d-7aa600968dd0 could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:50:03.602140 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-4a080fc2-ffcb-4db9-b395-15250841527a tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "GET /compute/v2.1/servers/a3c87119-d9e1-433a-a43d-7aa600968dd0" status: 404 len: 111 microversion: 2.1 time: 0.031069 Oct 08 21:50:03.602140 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3304/6680] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:50:03 2022] GET /compute/v2.1/servers/a3c87119-d9e1-433a-a43d-7aa600968dd0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:50:03.604645 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-df713f40-db44-4e33-9065-b117afe45c3f tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] Calling method '.version_select at 0x7f1a8c0625e0>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:50:03.629141 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-df713f40-db44-4e33-9065-b117afe45c3f tempest-ServerActionsTestJSON-775805645 tempest-ServerActionsTestJSON-775805645-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1142039836" status: 202 len: 0 microversion: 2.1 time: 0.028500 Oct 08 21:50:03.629759 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3377/6681] 10.222.0.26 () {58 vars in 1221 bytes} [Sat Oct 8 21:50:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1142039836 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 21:50:12.547802 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-588e58ef-d61e-4261-9053-d4bb302f5bca tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1100760703", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "networks": [{"uuid": "c0a2879f-f0db-4049-bb30-fcf595f843f6"}]}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:50:12.609807 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.network.neutron [None req-588e58ef-d61e-4261-9053-d4bb302f5bca tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] validate_networks() for [('c0a2879f-f0db-4049-bb30-fcf595f843f6', None, None, None, None, None)] {{(pid=140491) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 21:50:13.043786 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-588e58ef-d61e-4261-9053-d4bb302f5bca tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Flavor limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 21:50:13.044222 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-588e58ef-d61e-4261-9053-d4bb302f5bca tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Image limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 21:50:13.044708 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-588e58ef-d61e-4261-9053-d4bb302f5bca tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Flavor pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 21:50:13.045132 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-588e58ef-d61e-4261-9053-d4bb302f5bca tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Image pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 21:50:13.045703 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-588e58ef-d61e-4261-9053-d4bb302f5bca tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 21:50:13.055359 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-588e58ef-d61e-4261-9053-d4bb302f5bca tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:50:13.055868 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-588e58ef-d61e-4261-9053-d4bb302f5bca tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:50:13.056311 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-588e58ef-d61e-4261-9053-d4bb302f5bca tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:50:13.057053 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-588e58ef-d61e-4261-9053-d4bb302f5bca tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:50:13.057557 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-588e58ef-d61e-4261-9053-d4bb302f5bca tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:50:13.057992 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-588e58ef-d61e-4261-9053-d4bb302f5bca tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:50:13.075768 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-588e58ef-d61e-4261-9053-d4bb302f5bca tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Getting quotas for project a7e9d160d2fc4f5fb7ccb312246c977e. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:50:13.081284 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-588e58ef-d61e-4261-9053-d4bb302f5bca tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Getting quotas for user 94a4c8a5bd25448a8479a4316479ba18 and project a7e9d160d2fc4f5fb7ccb312246c977e. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:50:13.095429 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-588e58ef-d61e-4261-9053-d4bb302f5bca tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Going to run 1 instances... {{(pid=140491) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 21:50:13.097816 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-588e58ef-d61e-4261-9053-d4bb302f5bca tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] [instance: 7e381a81-bf8d-484a-850f-acec73f77ada] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c508bd7f-7db9-4b2c-af7c-be54a855c355',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140491) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 21:50:13.145353 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-588e58ef-d61e-4261-9053-d4bb302f5bca tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.728705 Oct 08 21:50:13.149547 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3305/6682] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 21:50:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 733 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 08 21:50:13.158656 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-06693a07-468a-4bed-8da9-d229b068b6f2 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:50:13.159941 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-06693a07-468a-4bed-8da9-d229b068b6f2 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] [instance: 7e381a81-bf8d-484a-850f-acec73f77ada] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:50:13.231635 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-06693a07-468a-4bed-8da9-d229b068b6f2 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94a4c8a5bd25448a8479a4316479ba18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e9d160d2fc4f5fb7ccb312246c977e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:50:13.259702 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-06693a07-468a-4bed-8da9-d229b068b6f2 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] 10.222.0.26 "GET /compute/v2.1/servers/7e381a81-bf8d-484a-850f-acec73f77ada" status: 200 len: 1217 microversion: 2.1 time: 0.105067 Oct 08 21:50:13.261007 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3378/6683] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:50:13 2022] GET /compute/v2.1/servers/7e381a81-bf8d-484a-850f-acec73f77ada => generated 1217 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:50:14.283978 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c9262be9-ea43-4901-b1de-8014e21e03e8 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:50:14.284585 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-c9262be9-ea43-4901-b1de-8014e21e03e8 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] [instance: 7e381a81-bf8d-484a-850f-acec73f77ada] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:50:14.293612 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c9262be9-ea43-4901-b1de-8014e21e03e8 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:50:14.294115 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c9262be9-ea43-4901-b1de-8014e21e03e8 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:50:14.294567 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c9262be9-ea43-4901-b1de-8014e21e03e8 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:50:14.295277 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c9262be9-ea43-4901-b1de-8014e21e03e8 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:50:14.295750 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c9262be9-ea43-4901-b1de-8014e21e03e8 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:50:14.296193 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c9262be9-ea43-4901-b1de-8014e21e03e8 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:50:14.358001 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-c9262be9-ea43-4901-b1de-8014e21e03e8 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94a4c8a5bd25448a8479a4316479ba18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e9d160d2fc4f5fb7ccb312246c977e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:50:14.365942 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-c9262be9-ea43-4901-b1de-8014e21e03e8 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] 10.222.0.26 "GET /compute/v2.1/servers/7e381a81-bf8d-484a-850f-acec73f77ada" status: 200 len: 1269 microversion: 2.1 time: 0.086883 Oct 08 21:50:14.366539 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3306/6684] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:50:14 2022] GET /compute/v2.1/servers/7e381a81-bf8d-484a-850f-acec73f77ada => generated 1269 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:50:15.387980 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-4c20812a-9ac6-4b10-8558-7fd60cad31cc tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:50:15.389229 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-4c20812a-9ac6-4b10-8558-7fd60cad31cc tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] [instance: 7e381a81-bf8d-484a-850f-acec73f77ada] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:50:15.391576 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:50:15.411560 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4c20812a-9ac6-4b10-8558-7fd60cad31cc tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:50:15.412347 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4c20812a-9ac6-4b10-8558-7fd60cad31cc tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:50:15.412978 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4c20812a-9ac6-4b10-8558-7fd60cad31cc tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:50:15.413960 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4c20812a-9ac6-4b10-8558-7fd60cad31cc tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:50:15.415136 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4c20812a-9ac6-4b10-8558-7fd60cad31cc tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:50:15.415870 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4c20812a-9ac6-4b10-8558-7fd60cad31cc tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:50:15.628424 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-4c20812a-9ac6-4b10-8558-7fd60cad31cc tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94a4c8a5bd25448a8479a4316479ba18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e9d160d2fc4f5fb7ccb312246c977e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:50:15.649563 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-4c20812a-9ac6-4b10-8558-7fd60cad31cc tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] 10.222.0.26 "GET /compute/v2.1/servers/7e381a81-bf8d-484a-850f-acec73f77ada" status: 200 len: 1317 microversion: 2.1 time: 0.254878 Oct 08 21:50:15.651420 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3379/6685] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:50:15 2022] GET /compute/v2.1/servers/7e381a81-bf8d-484a-850f-acec73f77ada => generated 1317 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:50:16.311221 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-059aa1dd-ef6b-471d-ba17-f227d3010219 req-a1286f1b-1591-4a72-bb75-55f8e029c7ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e381a81-bf8d-484a-850f-acec73f77ada", "tag": "cbce56f6-46d3-46f7-b73e-7aa73ad7cdf2"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:50:16.322535 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-059aa1dd-ef6b-471d-ba17-f227d3010219 req-a1286f1b-1591-4a72-bb75-55f8e029c7ff service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:50:16.323103 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-059aa1dd-ef6b-471d-ba17-f227d3010219 req-a1286f1b-1591-4a72-bb75-55f8e029c7ff service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:50:16.323627 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-059aa1dd-ef6b-471d-ba17-f227d3010219 req-a1286f1b-1591-4a72-bb75-55f8e029c7ff service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:50:16.336679 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-059aa1dd-ef6b-471d-ba17-f227d3010219 req-a1286f1b-1591-4a72-bb75-55f8e029c7ff service nova] Creating event network-changed:cbce56f6-46d3-46f7-b73e-7aa73ad7cdf2 for instance 7e381a81-bf8d-484a-850f-acec73f77ada on nch1-master-1 Oct 08 21:50:16.341801 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-059aa1dd-ef6b-471d-ba17-f227d3010219 req-a1286f1b-1591-4a72-bb75-55f8e029c7ff service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094555 Oct 08 21:50:16.342427 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3307/6686] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:50:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:50:16.674339 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-495f171f-90f8-4ac4-a8d3-76ad4d49ed59 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:50:16.675550 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-495f171f-90f8-4ac4-a8d3-76ad4d49ed59 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] [instance: 7e381a81-bf8d-484a-850f-acec73f77ada] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:50:16.684890 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-495f171f-90f8-4ac4-a8d3-76ad4d49ed59 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:50:16.685460 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-495f171f-90f8-4ac4-a8d3-76ad4d49ed59 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:50:16.685928 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-495f171f-90f8-4ac4-a8d3-76ad4d49ed59 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:50:16.686690 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-495f171f-90f8-4ac4-a8d3-76ad4d49ed59 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:50:16.687174 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-495f171f-90f8-4ac4-a8d3-76ad4d49ed59 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:50:16.687631 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-495f171f-90f8-4ac4-a8d3-76ad4d49ed59 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:50:16.846973 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-495f171f-90f8-4ac4-a8d3-76ad4d49ed59 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94a4c8a5bd25448a8479a4316479ba18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e9d160d2fc4f5fb7ccb312246c977e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:50:16.856686 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-495f171f-90f8-4ac4-a8d3-76ad4d49ed59 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] 10.222.0.26 "GET /compute/v2.1/servers/7e381a81-bf8d-484a-850f-acec73f77ada" status: 200 len: 1317 microversion: 2.1 time: 0.186343 Oct 08 21:50:16.865268 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3380/6687] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:50:16 2022] GET /compute/v2.1/servers/7e381a81-bf8d-484a-850f-acec73f77ada => generated 1317 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:50:17.882274 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-77debd10-cb64-42af-b5c8-686805cdb35b tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:50:17.882975 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-77debd10-cb64-42af-b5c8-686805cdb35b tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] [instance: 7e381a81-bf8d-484a-850f-acec73f77ada] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:50:17.889412 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-77debd10-cb64-42af-b5c8-686805cdb35b tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:50:17.889908 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-77debd10-cb64-42af-b5c8-686805cdb35b tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:50:17.890355 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-77debd10-cb64-42af-b5c8-686805cdb35b tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:50:17.891062 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-77debd10-cb64-42af-b5c8-686805cdb35b tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:50:17.891522 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-77debd10-cb64-42af-b5c8-686805cdb35b tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:50:17.891950 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-77debd10-cb64-42af-b5c8-686805cdb35b tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:50:18.093848 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-77debd10-cb64-42af-b5c8-686805cdb35b tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94a4c8a5bd25448a8479a4316479ba18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e9d160d2fc4f5fb7ccb312246c977e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:50:18.101711 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-77debd10-cb64-42af-b5c8-686805cdb35b tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] 10.222.0.26 "GET /compute/v2.1/servers/7e381a81-bf8d-484a-850f-acec73f77ada" status: 200 len: 1317 microversion: 2.1 time: 0.225634 Oct 08 21:50:18.102300 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3308/6688] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:50:17 2022] GET /compute/v2.1/servers/7e381a81-bf8d-484a-850f-acec73f77ada => generated 1317 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:50:19.124858 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-cdcb587d-ce60-4011-b06f-8deb302033d9 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:50:19.125523 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-cdcb587d-ce60-4011-b06f-8deb302033d9 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] [instance: 7e381a81-bf8d-484a-850f-acec73f77ada] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:50:19.133157 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cdcb587d-ce60-4011-b06f-8deb302033d9 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:50:19.133701 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cdcb587d-ce60-4011-b06f-8deb302033d9 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:50:19.134163 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cdcb587d-ce60-4011-b06f-8deb302033d9 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:50:19.134879 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cdcb587d-ce60-4011-b06f-8deb302033d9 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:50:19.135429 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cdcb587d-ce60-4011-b06f-8deb302033d9 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:50:19.135881 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cdcb587d-ce60-4011-b06f-8deb302033d9 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:50:19.265141 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-cdcb587d-ce60-4011-b06f-8deb302033d9 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94a4c8a5bd25448a8479a4316479ba18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e9d160d2fc4f5fb7ccb312246c977e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:50:19.273695 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-cdcb587d-ce60-4011-b06f-8deb302033d9 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] 10.222.0.26 "GET /compute/v2.1/servers/7e381a81-bf8d-484a-850f-acec73f77ada" status: 200 len: 1317 microversion: 2.1 time: 0.152791 Oct 08 21:50:19.274277 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3381/6689] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:50:19 2022] GET /compute/v2.1/servers/7e381a81-bf8d-484a-850f-acec73f77ada => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:50:20.295845 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-42f1c47a-9754-4709-817b-2e8b72c0f803 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:50:20.296458 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-42f1c47a-9754-4709-817b-2e8b72c0f803 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] [instance: 7e381a81-bf8d-484a-850f-acec73f77ada] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:50:20.304059 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-42f1c47a-9754-4709-817b-2e8b72c0f803 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:50:20.304544 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-42f1c47a-9754-4709-817b-2e8b72c0f803 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:50:20.304985 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-42f1c47a-9754-4709-817b-2e8b72c0f803 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:50:20.305708 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-42f1c47a-9754-4709-817b-2e8b72c0f803 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:50:20.306167 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-42f1c47a-9754-4709-817b-2e8b72c0f803 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:50:20.306598 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-42f1c47a-9754-4709-817b-2e8b72c0f803 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:50:20.434442 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-42f1c47a-9754-4709-817b-2e8b72c0f803 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94a4c8a5bd25448a8479a4316479ba18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e9d160d2fc4f5fb7ccb312246c977e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:50:20.442996 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-42f1c47a-9754-4709-817b-2e8b72c0f803 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] 10.222.0.26 "GET /compute/v2.1/servers/7e381a81-bf8d-484a-850f-acec73f77ada" status: 200 len: 1317 microversion: 2.1 time: 0.150400 Oct 08 21:50:20.443572 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3309/6690] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:50:20 2022] GET /compute/v2.1/servers/7e381a81-bf8d-484a-850f-acec73f77ada => generated 1317 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:50:21.465332 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-cc5a2ca7-ead7-4d31-bea4-1d21a18bb5f3 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:50:21.465983 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-cc5a2ca7-ead7-4d31-bea4-1d21a18bb5f3 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] [instance: 7e381a81-bf8d-484a-850f-acec73f77ada] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:50:21.472928 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cc5a2ca7-ead7-4d31-bea4-1d21a18bb5f3 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:50:21.473517 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cc5a2ca7-ead7-4d31-bea4-1d21a18bb5f3 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:50:21.473985 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cc5a2ca7-ead7-4d31-bea4-1d21a18bb5f3 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:50:21.474729 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cc5a2ca7-ead7-4d31-bea4-1d21a18bb5f3 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:50:21.475220 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cc5a2ca7-ead7-4d31-bea4-1d21a18bb5f3 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:50:21.475681 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cc5a2ca7-ead7-4d31-bea4-1d21a18bb5f3 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:50:21.613434 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-cc5a2ca7-ead7-4d31-bea4-1d21a18bb5f3 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94a4c8a5bd25448a8479a4316479ba18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e9d160d2fc4f5fb7ccb312246c977e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:50:21.621840 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-cc5a2ca7-ead7-4d31-bea4-1d21a18bb5f3 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] 10.222.0.26 "GET /compute/v2.1/servers/7e381a81-bf8d-484a-850f-acec73f77ada" status: 200 len: 1317 microversion: 2.1 time: 0.160441 Oct 08 21:50:21.622434 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3382/6691] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:50:21 2022] GET /compute/v2.1/servers/7e381a81-bf8d-484a-850f-acec73f77ada => generated 1317 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:50:22.644075 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-0dc067c2-d077-48ab-9af1-1e8270a9cc1b tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:50:22.644619 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-0dc067c2-d077-48ab-9af1-1e8270a9cc1b tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] [instance: 7e381a81-bf8d-484a-850f-acec73f77ada] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:50:22.651748 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0dc067c2-d077-48ab-9af1-1e8270a9cc1b tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:50:22.652245 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0dc067c2-d077-48ab-9af1-1e8270a9cc1b tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:50:22.652688 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0dc067c2-d077-48ab-9af1-1e8270a9cc1b tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:50:22.653421 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0dc067c2-d077-48ab-9af1-1e8270a9cc1b tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:50:22.653879 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0dc067c2-d077-48ab-9af1-1e8270a9cc1b tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:50:22.654310 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0dc067c2-d077-48ab-9af1-1e8270a9cc1b tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:50:22.658368 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=77 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:50:22.789149 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-0dc067c2-d077-48ab-9af1-1e8270a9cc1b tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94a4c8a5bd25448a8479a4316479ba18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e9d160d2fc4f5fb7ccb312246c977e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:50:22.796873 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-0dc067c2-d077-48ab-9af1-1e8270a9cc1b tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] 10.222.0.26 "GET /compute/v2.1/servers/7e381a81-bf8d-484a-850f-acec73f77ada" status: 200 len: 1317 microversion: 2.1 time: 0.156699 Oct 08 21:50:22.797483 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3310/6692] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:50:22 2022] GET /compute/v2.1/servers/7e381a81-bf8d-484a-850f-acec73f77ada => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:50:23.322511 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=2 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:50:23.376134 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-7caa9560-89bd-4dd9-98ff-dafdd35d8c06 req-fb9ec519-dddb-4688-9c95-6199c5a0b00a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e381a81-bf8d-484a-850f-acec73f77ada", "name": "network-vif-plugged", "status": "completed", "tag": "cbce56f6-46d3-46f7-b73e-7aa73ad7cdf2"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:50:23.386194 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-7caa9560-89bd-4dd9-98ff-dafdd35d8c06 req-fb9ec519-dddb-4688-9c95-6199c5a0b00a service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:50:23.386699 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-7caa9560-89bd-4dd9-98ff-dafdd35d8c06 req-fb9ec519-dddb-4688-9c95-6199c5a0b00a service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:50:23.387160 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-7caa9560-89bd-4dd9-98ff-dafdd35d8c06 req-fb9ec519-dddb-4688-9c95-6199c5a0b00a service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:50:23.398864 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-7caa9560-89bd-4dd9-98ff-dafdd35d8c06 req-fb9ec519-dddb-4688-9c95-6199c5a0b00a service nova] Creating event network-vif-plugged:cbce56f6-46d3-46f7-b73e-7aa73ad7cdf2 for instance 7e381a81-bf8d-484a-850f-acec73f77ada on nch1-master-1 Oct 08 21:50:23.403855 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-7caa9560-89bd-4dd9-98ff-dafdd35d8c06 req-fb9ec519-dddb-4688-9c95-6199c5a0b00a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086661 Oct 08 21:50:23.404444 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3383/6693] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:50:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 08 21:50:23.820624 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-72726dba-d898-4c4d-86a2-5315f29b64ae tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:50:23.821217 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-72726dba-d898-4c4d-86a2-5315f29b64ae tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] [instance: 7e381a81-bf8d-484a-850f-acec73f77ada] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:50:23.823114 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=2 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:50:23.823882 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=6 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:50:23.830648 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-72726dba-d898-4c4d-86a2-5315f29b64ae tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:50:23.831145 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-72726dba-d898-4c4d-86a2-5315f29b64ae tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:50:23.831594 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-72726dba-d898-4c4d-86a2-5315f29b64ae tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:50:23.832299 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-72726dba-d898-4c4d-86a2-5315f29b64ae tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:50:23.833418 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-72726dba-d898-4c4d-86a2-5315f29b64ae tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:50:23.833861 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-72726dba-d898-4c4d-86a2-5315f29b64ae tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:50:23.964955 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-72726dba-d898-4c4d-86a2-5315f29b64ae tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94a4c8a5bd25448a8479a4316479ba18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e9d160d2fc4f5fb7ccb312246c977e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:50:23.972879 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-72726dba-d898-4c4d-86a2-5315f29b64ae tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] 10.222.0.26 "GET /compute/v2.1/servers/7e381a81-bf8d-484a-850f-acec73f77ada" status: 200 len: 1317 microversion: 2.1 time: 0.156720 Oct 08 21:50:23.973530 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3311/6694] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:50:23 2022] GET /compute/v2.1/servers/7e381a81-bf8d-484a-850f-acec73f77ada => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:50:24.997330 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-c22fb449-8cbd-4d5d-8afc-69faaeca51d1 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:50:24.997989 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-c22fb449-8cbd-4d5d-8afc-69faaeca51d1 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] [instance: 7e381a81-bf8d-484a-850f-acec73f77ada] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:50:24.999960 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:50:25.006423 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c22fb449-8cbd-4d5d-8afc-69faaeca51d1 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:50:25.006923 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c22fb449-8cbd-4d5d-8afc-69faaeca51d1 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:50:25.007381 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c22fb449-8cbd-4d5d-8afc-69faaeca51d1 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:50:25.008099 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c22fb449-8cbd-4d5d-8afc-69faaeca51d1 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:50:25.008579 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c22fb449-8cbd-4d5d-8afc-69faaeca51d1 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:50:25.009027 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c22fb449-8cbd-4d5d-8afc-69faaeca51d1 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:50:25.140446 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-c22fb449-8cbd-4d5d-8afc-69faaeca51d1 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94a4c8a5bd25448a8479a4316479ba18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e9d160d2fc4f5fb7ccb312246c977e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:50:25.149418 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-c22fb449-8cbd-4d5d-8afc-69faaeca51d1 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] 10.222.0.26 "GET /compute/v2.1/servers/7e381a81-bf8d-484a-850f-acec73f77ada" status: 200 len: 1505 microversion: 2.1 time: 0.157724 Oct 08 21:50:25.150361 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3384/6695] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:50:24 2022] GET /compute/v2.1/servers/7e381a81-bf8d-484a-850f-acec73f77ada => generated 1505 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:50:25.210609 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-4ee47e0e-db9b-4ebc-92a5-44cf7860f3dc tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1246674261", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "networks": [{"uuid": "c0a2879f-f0db-4049-bb30-fcf595f843f6"}]}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:50:25.219948 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:50:25.265443 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.network.neutron [None req-4ee47e0e-db9b-4ebc-92a5-44cf7860f3dc tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] validate_networks() for [('c0a2879f-f0db-4049-bb30-fcf595f843f6', None, None, None, None, None)] {{(pid=140491) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 21:50:25.626507 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-4ee47e0e-db9b-4ebc-92a5-44cf7860f3dc tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Flavor limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 21:50:25.626934 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-4ee47e0e-db9b-4ebc-92a5-44cf7860f3dc tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Image limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 21:50:25.627445 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-4ee47e0e-db9b-4ebc-92a5-44cf7860f3dc tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Flavor pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 21:50:25.627859 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-4ee47e0e-db9b-4ebc-92a5-44cf7860f3dc tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Image pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 21:50:25.628275 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-4ee47e0e-db9b-4ebc-92a5-44cf7860f3dc tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 21:50:25.638169 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4ee47e0e-db9b-4ebc-92a5-44cf7860f3dc tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:50:25.638634 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4ee47e0e-db9b-4ebc-92a5-44cf7860f3dc tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:50:25.639071 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4ee47e0e-db9b-4ebc-92a5-44cf7860f3dc tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:50:25.639797 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4ee47e0e-db9b-4ebc-92a5-44cf7860f3dc tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:50:25.640250 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4ee47e0e-db9b-4ebc-92a5-44cf7860f3dc tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:50:25.640678 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4ee47e0e-db9b-4ebc-92a5-44cf7860f3dc tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:50:25.657356 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-4ee47e0e-db9b-4ebc-92a5-44cf7860f3dc tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Getting quotas for project a7e9d160d2fc4f5fb7ccb312246c977e. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:50:25.662615 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-4ee47e0e-db9b-4ebc-92a5-44cf7860f3dc tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Getting quotas for user 94a4c8a5bd25448a8479a4316479ba18 and project a7e9d160d2fc4f5fb7ccb312246c977e. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:50:25.674787 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-4ee47e0e-db9b-4ebc-92a5-44cf7860f3dc tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Going to run 1 instances... {{(pid=140491) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 21:50:25.677078 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-4ee47e0e-db9b-4ebc-92a5-44cf7860f3dc tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] [instance: 3248249e-5727-42fe-b705-18f7809d9366] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c508bd7f-7db9-4b2c-af7c-be54a855c355',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140491) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 21:50:25.721794 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-4ee47e0e-db9b-4ebc-92a5-44cf7860f3dc tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.515545 Oct 08 21:50:25.722449 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3312/6696] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 21:50:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 517 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 08 21:50:25.733553 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-2e22a6fb-6664-4dca-a47a-c2b2086d0955 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:50:25.734201 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-2e22a6fb-6664-4dca-a47a-c2b2086d0955 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] [instance: 3248249e-5727-42fe-b705-18f7809d9366] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:50:25.790661 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-2e22a6fb-6664-4dca-a47a-c2b2086d0955 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94a4c8a5bd25448a8479a4316479ba18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e9d160d2fc4f5fb7ccb312246c977e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:50:25.799730 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-2e22a6fb-6664-4dca-a47a-c2b2086d0955 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] 10.222.0.26 "GET /compute/v2.1/servers/3248249e-5727-42fe-b705-18f7809d9366" status: 200 len: 1217 microversion: 2.1 time: 0.069965 Oct 08 21:50:25.800679 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3385/6697] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:50:25 2022] GET /compute/v2.1/servers/3248249e-5727-42fe-b705-18f7809d9366 => generated 1217 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:50:26.826734 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-baba4424-40e8-4d84-be9f-676a85e14161 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:50:26.831697 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-baba4424-40e8-4d84-be9f-676a85e14161 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] [instance: 3248249e-5727-42fe-b705-18f7809d9366] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:50:26.838417 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-baba4424-40e8-4d84-be9f-676a85e14161 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:50:26.838914 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-baba4424-40e8-4d84-be9f-676a85e14161 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:50:26.839341 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-baba4424-40e8-4d84-be9f-676a85e14161 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:50:26.840072 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-baba4424-40e8-4d84-be9f-676a85e14161 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:50:26.840532 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-baba4424-40e8-4d84-be9f-676a85e14161 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:50:26.840960 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-baba4424-40e8-4d84-be9f-676a85e14161 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:50:26.904490 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-baba4424-40e8-4d84-be9f-676a85e14161 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94a4c8a5bd25448a8479a4316479ba18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e9d160d2fc4f5fb7ccb312246c977e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:50:26.913232 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-baba4424-40e8-4d84-be9f-676a85e14161 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] 10.222.0.26 "GET /compute/v2.1/servers/3248249e-5727-42fe-b705-18f7809d9366" status: 200 len: 1275 microversion: 2.1 time: 0.091343 Oct 08 21:50:26.913900 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3313/6698] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:50:26 2022] GET /compute/v2.1/servers/3248249e-5727-42fe-b705-18f7809d9366 => generated 1275 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:50:27.935945 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-b2ec4290-e5d8-4e30-9cbb-b4fe489de427 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:50:27.936585 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-b2ec4290-e5d8-4e30-9cbb-b4fe489de427 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] [instance: 3248249e-5727-42fe-b705-18f7809d9366] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:50:27.945463 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b2ec4290-e5d8-4e30-9cbb-b4fe489de427 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:50:27.945972 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b2ec4290-e5d8-4e30-9cbb-b4fe489de427 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:50:27.946652 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b2ec4290-e5d8-4e30-9cbb-b4fe489de427 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:50:27.947385 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b2ec4290-e5d8-4e30-9cbb-b4fe489de427 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:50:27.947859 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b2ec4290-e5d8-4e30-9cbb-b4fe489de427 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:50:27.948475 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b2ec4290-e5d8-4e30-9cbb-b4fe489de427 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:50:28.209164 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-b2ec4290-e5d8-4e30-9cbb-b4fe489de427 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94a4c8a5bd25448a8479a4316479ba18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e9d160d2fc4f5fb7ccb312246c977e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:50:28.217674 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-b2ec4290-e5d8-4e30-9cbb-b4fe489de427 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] 10.222.0.26 "GET /compute/v2.1/servers/3248249e-5727-42fe-b705-18f7809d9366" status: 200 len: 1317 microversion: 2.1 time: 0.285603 Oct 08 21:50:28.218359 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3386/6699] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:50:27 2022] GET /compute/v2.1/servers/3248249e-5727-42fe-b705-18f7809d9366 => generated 1317 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:50:28.430805 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-63f1f296-444a-4ac9-beab-0ac7633e7b7a req-3eac9c73-097a-497d-ae96-b6025590fae9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3248249e-5727-42fe-b705-18f7809d9366", "tag": "516cfa3c-42d3-460b-9f78-b39319bf0148"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:50:28.441136 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-63f1f296-444a-4ac9-beab-0ac7633e7b7a req-3eac9c73-097a-497d-ae96-b6025590fae9 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:50:28.441645 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-63f1f296-444a-4ac9-beab-0ac7633e7b7a req-3eac9c73-097a-497d-ae96-b6025590fae9 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:50:28.442083 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-63f1f296-444a-4ac9-beab-0ac7633e7b7a req-3eac9c73-097a-497d-ae96-b6025590fae9 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:50:28.453988 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-63f1f296-444a-4ac9-beab-0ac7633e7b7a req-3eac9c73-097a-497d-ae96-b6025590fae9 service nova] Creating event network-changed:516cfa3c-42d3-460b-9f78-b39319bf0148 for instance 3248249e-5727-42fe-b705-18f7809d9366 on nch2-master-1 Oct 08 21:50:28.459750 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-63f1f296-444a-4ac9-beab-0ac7633e7b7a req-3eac9c73-097a-497d-ae96-b6025590fae9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033920 Oct 08 21:50:28.460350 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3314/6700] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:50:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:50:29.242731 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-a9f5bfce-2844-4945-967a-5e6bc9684901 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:50:29.243401 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-a9f5bfce-2844-4945-967a-5e6bc9684901 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] [instance: 3248249e-5727-42fe-b705-18f7809d9366] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:50:29.250432 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a9f5bfce-2844-4945-967a-5e6bc9684901 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:50:29.250950 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a9f5bfce-2844-4945-967a-5e6bc9684901 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:50:29.251416 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a9f5bfce-2844-4945-967a-5e6bc9684901 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:50:29.252140 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a9f5bfce-2844-4945-967a-5e6bc9684901 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:50:29.252627 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a9f5bfce-2844-4945-967a-5e6bc9684901 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:50:29.253084 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a9f5bfce-2844-4945-967a-5e6bc9684901 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:50:29.382548 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-a9f5bfce-2844-4945-967a-5e6bc9684901 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94a4c8a5bd25448a8479a4316479ba18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e9d160d2fc4f5fb7ccb312246c977e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:50:29.390303 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-a9f5bfce-2844-4945-967a-5e6bc9684901 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] 10.222.0.26 "GET /compute/v2.1/servers/3248249e-5727-42fe-b705-18f7809d9366" status: 200 len: 1317 microversion: 2.1 time: 0.152036 Oct 08 21:50:29.390886 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3387/6701] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:50:29 2022] GET /compute/v2.1/servers/3248249e-5727-42fe-b705-18f7809d9366 => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:50:30.413324 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-7ffcb175-859f-4ec1-939a-1a4b15334cea tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:50:30.414030 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-7ffcb175-859f-4ec1-939a-1a4b15334cea tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] [instance: 3248249e-5727-42fe-b705-18f7809d9366] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:50:30.421409 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7ffcb175-859f-4ec1-939a-1a4b15334cea tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:50:30.421901 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7ffcb175-859f-4ec1-939a-1a4b15334cea tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:50:30.422342 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7ffcb175-859f-4ec1-939a-1a4b15334cea tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:50:30.423040 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7ffcb175-859f-4ec1-939a-1a4b15334cea tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:50:30.423500 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7ffcb175-859f-4ec1-939a-1a4b15334cea tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:50:30.423931 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7ffcb175-859f-4ec1-939a-1a4b15334cea tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:50:30.558525 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-7ffcb175-859f-4ec1-939a-1a4b15334cea tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94a4c8a5bd25448a8479a4316479ba18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e9d160d2fc4f5fb7ccb312246c977e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:50:30.566899 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-7ffcb175-859f-4ec1-939a-1a4b15334cea tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] 10.222.0.26 "GET /compute/v2.1/servers/3248249e-5727-42fe-b705-18f7809d9366" status: 200 len: 1317 microversion: 2.1 time: 0.158390 Oct 08 21:50:30.567475 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3315/6702] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:50:30 2022] GET /compute/v2.1/servers/3248249e-5727-42fe-b705-18f7809d9366 => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:50:31.589029 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-f5b711af-06a5-4002-9129-79a1d8b5d55f tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:50:31.589771 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-f5b711af-06a5-4002-9129-79a1d8b5d55f tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] [instance: 3248249e-5727-42fe-b705-18f7809d9366] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:50:31.596793 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f5b711af-06a5-4002-9129-79a1d8b5d55f tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:50:31.597352 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f5b711af-06a5-4002-9129-79a1d8b5d55f tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:50:31.597828 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f5b711af-06a5-4002-9129-79a1d8b5d55f tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:50:31.598561 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f5b711af-06a5-4002-9129-79a1d8b5d55f tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:50:31.599052 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f5b711af-06a5-4002-9129-79a1d8b5d55f tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:50:31.599545 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f5b711af-06a5-4002-9129-79a1d8b5d55f tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:50:31.733513 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-f5b711af-06a5-4002-9129-79a1d8b5d55f tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94a4c8a5bd25448a8479a4316479ba18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e9d160d2fc4f5fb7ccb312246c977e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:50:31.741885 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-f5b711af-06a5-4002-9129-79a1d8b5d55f tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] 10.222.0.26 "GET /compute/v2.1/servers/3248249e-5727-42fe-b705-18f7809d9366" status: 200 len: 1317 microversion: 2.1 time: 0.156743 Oct 08 21:50:31.742483 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3388/6703] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:50:31 2022] GET /compute/v2.1/servers/3248249e-5727-42fe-b705-18f7809d9366 => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:50:32.272402 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-788ca344-7b52-4fdb-b893-6cd2426f2cd6 req-bc6cb1bf-16b4-499a-87b3-3b550d5c8e36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3248249e-5727-42fe-b705-18f7809d9366", "name": "network-vif-plugged", "status": "completed", "tag": "516cfa3c-42d3-460b-9f78-b39319bf0148"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:50:32.283742 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-788ca344-7b52-4fdb-b893-6cd2426f2cd6 req-bc6cb1bf-16b4-499a-87b3-3b550d5c8e36 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:50:32.284524 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-788ca344-7b52-4fdb-b893-6cd2426f2cd6 req-bc6cb1bf-16b4-499a-87b3-3b550d5c8e36 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:50:32.285328 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-788ca344-7b52-4fdb-b893-6cd2426f2cd6 req-bc6cb1bf-16b4-499a-87b3-3b550d5c8e36 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:50:32.297761 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-788ca344-7b52-4fdb-b893-6cd2426f2cd6 req-bc6cb1bf-16b4-499a-87b3-3b550d5c8e36 service nova] Creating event network-vif-plugged:516cfa3c-42d3-460b-9f78-b39319bf0148 for instance 3248249e-5727-42fe-b705-18f7809d9366 on nch2-master-1 Oct 08 21:50:32.302819 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-788ca344-7b52-4fdb-b893-6cd2426f2cd6 req-bc6cb1bf-16b4-499a-87b3-3b550d5c8e36 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034631 Oct 08 21:50:32.303949 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3316/6704] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:50:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:50:32.765629 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-c616d900-2677-4199-a270-3d81c190ee3a tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:50:32.766276 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-c616d900-2677-4199-a270-3d81c190ee3a tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] [instance: 3248249e-5727-42fe-b705-18f7809d9366] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:50:32.774745 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c616d900-2677-4199-a270-3d81c190ee3a tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:50:32.775139 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c616d900-2677-4199-a270-3d81c190ee3a tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:50:32.775607 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c616d900-2677-4199-a270-3d81c190ee3a tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:50:32.776394 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c616d900-2677-4199-a270-3d81c190ee3a tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:50:32.776941 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c616d900-2677-4199-a270-3d81c190ee3a tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:50:32.777611 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c616d900-2677-4199-a270-3d81c190ee3a tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:50:32.909740 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-c616d900-2677-4199-a270-3d81c190ee3a tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94a4c8a5bd25448a8479a4316479ba18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e9d160d2fc4f5fb7ccb312246c977e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:50:32.918222 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-c616d900-2677-4199-a270-3d81c190ee3a tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] 10.222.0.26 "GET /compute/v2.1/servers/3248249e-5727-42fe-b705-18f7809d9366" status: 200 len: 1317 microversion: 2.1 time: 0.156547 Oct 08 21:50:32.918816 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3389/6705] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:50:32 2022] GET /compute/v2.1/servers/3248249e-5727-42fe-b705-18f7809d9366 => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:50:33.942085 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c42e2476-61d9-4eb3-a2ef-460000e39a64 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:50:33.942783 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-c42e2476-61d9-4eb3-a2ef-460000e39a64 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] [instance: 3248249e-5727-42fe-b705-18f7809d9366] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:50:33.949161 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c42e2476-61d9-4eb3-a2ef-460000e39a64 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:50:33.949679 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c42e2476-61d9-4eb3-a2ef-460000e39a64 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:50:33.950123 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c42e2476-61d9-4eb3-a2ef-460000e39a64 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:50:33.950817 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c42e2476-61d9-4eb3-a2ef-460000e39a64 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:50:33.951276 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c42e2476-61d9-4eb3-a2ef-460000e39a64 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:50:33.951727 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c42e2476-61d9-4eb3-a2ef-460000e39a64 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:50:34.084085 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-c42e2476-61d9-4eb3-a2ef-460000e39a64 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94a4c8a5bd25448a8479a4316479ba18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e9d160d2fc4f5fb7ccb312246c977e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:50:34.092633 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-c42e2476-61d9-4eb3-a2ef-460000e39a64 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] 10.222.0.26 "GET /compute/v2.1/servers/3248249e-5727-42fe-b705-18f7809d9366" status: 200 len: 1506 microversion: 2.1 time: 0.156029 Oct 08 21:50:34.093233 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3317/6706] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:50:33 2022] GET /compute/v2.1/servers/3248249e-5727-42fe-b705-18f7809d9366 => generated 1506 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:50:34.114520 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-4f199891-ba36-4792-8571-88b6d4c69fff tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:50:34.115049 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-4f199891-ba36-4792-8571-88b6d4c69fff tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] [instance: 3248249e-5727-42fe-b705-18f7809d9366] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:50:34.122145 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4f199891-ba36-4792-8571-88b6d4c69fff tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:50:34.122658 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4f199891-ba36-4792-8571-88b6d4c69fff tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:50:34.123124 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4f199891-ba36-4792-8571-88b6d4c69fff tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:50:34.123854 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4f199891-ba36-4792-8571-88b6d4c69fff tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:50:34.124337 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4f199891-ba36-4792-8571-88b6d4c69fff tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:50:34.124791 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4f199891-ba36-4792-8571-88b6d4c69fff tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:50:34.153761 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-4f199891-ba36-4792-8571-88b6d4c69fff tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] [instance: 3248249e-5727-42fe-b705-18f7809d9366] Going to try to terminate instance {{(pid=140492) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 21:50:34.239440 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-4f199891-ba36-4792-8571-88b6d4c69fff tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] 10.222.0.26 "DELETE /compute/v2.1/servers/3248249e-5727-42fe-b705-18f7809d9366" status: 204 len: 0 microversion: 2.1 time: 0.128553 Oct 08 21:50:34.240111 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3390/6707] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:50:34 2022] DELETE /compute/v2.1/servers/3248249e-5727-42fe-b705-18f7809d9366 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 21:50:34.248313 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-65548127-8794-409b-bec7-6f4feb588dcd tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:50:34.248936 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-65548127-8794-409b-bec7-6f4feb588dcd tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] [instance: 3248249e-5727-42fe-b705-18f7809d9366] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:50:34.254992 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-65548127-8794-409b-bec7-6f4feb588dcd tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:50:34.255992 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-65548127-8794-409b-bec7-6f4feb588dcd tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:50:34.256452 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-65548127-8794-409b-bec7-6f4feb588dcd tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:50:34.257150 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-65548127-8794-409b-bec7-6f4feb588dcd tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:50:34.257640 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-65548127-8794-409b-bec7-6f4feb588dcd tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:50:34.258072 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-65548127-8794-409b-bec7-6f4feb588dcd tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:50:34.385069 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-65548127-8794-409b-bec7-6f4feb588dcd tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94a4c8a5bd25448a8479a4316479ba18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e9d160d2fc4f5fb7ccb312246c977e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:50:34.392834 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-65548127-8794-409b-bec7-6f4feb588dcd tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] 10.222.0.26 "GET /compute/v2.1/servers/3248249e-5727-42fe-b705-18f7809d9366" status: 200 len: 1512 microversion: 2.1 time: 0.148437 Oct 08 21:50:34.393440 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3318/6708] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:50:34 2022] GET /compute/v2.1/servers/3248249e-5727-42fe-b705-18f7809d9366 => generated 1512 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:50:35.418142 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-5a5d305c-11a0-4fe7-b655-5faa3a492198 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:50:35.418907 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-5a5d305c-11a0-4fe7-b655-5faa3a492198 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] [instance: 3248249e-5727-42fe-b705-18f7809d9366] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:50:35.425824 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5a5d305c-11a0-4fe7-b655-5faa3a492198 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:50:35.426337 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5a5d305c-11a0-4fe7-b655-5faa3a492198 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:50:35.426800 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5a5d305c-11a0-4fe7-b655-5faa3a492198 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:50:35.427571 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5a5d305c-11a0-4fe7-b655-5faa3a492198 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:50:35.428052 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5a5d305c-11a0-4fe7-b655-5faa3a492198 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:50:35.428501 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5a5d305c-11a0-4fe7-b655-5faa3a492198 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:50:35.643740 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-5a5d305c-11a0-4fe7-b655-5faa3a492198 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94a4c8a5bd25448a8479a4316479ba18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e9d160d2fc4f5fb7ccb312246c977e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:50:35.652299 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-5a5d305c-11a0-4fe7-b655-5faa3a492198 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] 10.222.0.26 "GET /compute/v2.1/servers/3248249e-5727-42fe-b705-18f7809d9366" status: 200 len: 1512 microversion: 2.1 time: 0.238549 Oct 08 21:50:35.652884 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3391/6709] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:50:35 2022] GET /compute/v2.1/servers/3248249e-5727-42fe-b705-18f7809d9366 => generated 1512 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:50:36.017155 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-b3349f29-2b88-4d65-a26b-20a914ec01dd req-062f9623-24b7-424d-950f-978bfab9a643 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3248249e-5727-42fe-b705-18f7809d9366", "name": "network-vif-deleted", "tag": "516cfa3c-42d3-460b-9f78-b39319bf0148"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:50:36.027277 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=2 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:50:36.028021 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=6 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:50:36.040783 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-b3349f29-2b88-4d65-a26b-20a914ec01dd req-062f9623-24b7-424d-950f-978bfab9a643 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:50:36.041639 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-b3349f29-2b88-4d65-a26b-20a914ec01dd req-062f9623-24b7-424d-950f-978bfab9a643 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:50:36.042080 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-b3349f29-2b88-4d65-a26b-20a914ec01dd req-062f9623-24b7-424d-950f-978bfab9a643 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:50:36.055194 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-b3349f29-2b88-4d65-a26b-20a914ec01dd req-062f9623-24b7-424d-950f-978bfab9a643 service nova] Creating event network-vif-deleted:516cfa3c-42d3-460b-9f78-b39319bf0148 for instance 3248249e-5727-42fe-b705-18f7809d9366 on nch2-master-1 Oct 08 21:50:36.060326 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-b3349f29-2b88-4d65-a26b-20a914ec01dd req-062f9623-24b7-424d-950f-978bfab9a643 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049548 Oct 08 21:50:36.061204 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3319/6710] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:50:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:50:36.675290 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-76fdd6ed-475f-4eb2-b807-bb635040435b tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:50:36.675864 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-76fdd6ed-475f-4eb2-b807-bb635040435b tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] [instance: 3248249e-5727-42fe-b705-18f7809d9366] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:50:36.678517 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=2 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:50:36.684716 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-76fdd6ed-475f-4eb2-b807-bb635040435b tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:50:36.685251 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-76fdd6ed-475f-4eb2-b807-bb635040435b tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:50:36.685721 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-76fdd6ed-475f-4eb2-b807-bb635040435b tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:50:36.686452 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-76fdd6ed-475f-4eb2-b807-bb635040435b tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:50:36.686938 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-76fdd6ed-475f-4eb2-b807-bb635040435b tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:50:36.687392 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-76fdd6ed-475f-4eb2-b807-bb635040435b tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:50:36.701470 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-76fdd6ed-475f-4eb2-b807-bb635040435b tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] HTTP exception thrown: Instance 3248249e-5727-42fe-b705-18f7809d9366 could not be found. Oct 08 21:50:36.703149 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-76fdd6ed-475f-4eb2-b807-bb635040435b tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Request method failure captured: Oct 08 21:50:36.703149 ncdv-master-1 devstack@n-api.service[140492]: request: GET /compute/v2.1/servers/3248249e-5727-42fe-b705-18f7809d9366 HTTP/1.1 Oct 08 21:50:36.703149 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:50:36.703149 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:50:36.703149 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:50:36.703149 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 21:50:36.703149 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:50:36.703149 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:50:36.703149 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:50:36.703149 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:50:36.703149 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQfCUvRtFKF8HUOWB72alsv4ILps4UncOFTjm8EQ1I6mtg5n5UzlllWPm6z-4c_iVFYz1vpPNFE_t_z5yz_gt5_V0ESlhEOR5zPJDdtkFA_kgatAMZGiNotPCxF4OdZt9wMGJuPGNYCZ_PC6e0txzNu049eHN3QLG9DDbsTYSYBU07-U Oct 08 21:50:36.703149 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:50:36.703149 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:50:36.703149 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:50:36.703149 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:50:36.703149 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:50:36.703149 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:50:36.703149 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: a7e9d160d2fc4f5fb7ccb312246c977e Oct 08 21:50:36.703149 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-ServersNegativeTestJSON-971785938 Oct 08 21:50:36.703149 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:50:36.703149 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:50:36.703149 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/a7e9d160d2fc4f5fb7ccb312246c977e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a7e9d160d2fc4f5fb7ccb312246c977e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_a7e9d160d2fc4f5fb7ccb312246c977e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a7e9d160d2fc4f5fb7ccb312246c977e"}]}] Oct 08 21:50:36.703149 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-ServersNegativeTestJSON-971785938 Oct 08 21:50:36.703149 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: a7e9d160d2fc4f5fb7ccb312246c977e Oct 08 21:50:36.703149 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-ServersNegativeTestJSON-971785938 Oct 08 21:50:36.703149 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-ServersNegativeTestJSON-971785938-project Oct 08 21:50:36.703149 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:50:36.703149 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:50:36.703149 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 94a4c8a5bd25448a8479a4316479ba18 Oct 08 21:50:36.703149 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-ServersNegativeTestJSON-971785938-project Oct 08 21:50:36.703149 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 21:50:36.703149 ncdv-master-1 devstack@n-api.service[140492]: exception: Instance 3248249e-5727-42fe-b705-18f7809d9366 could not be found. Oct 08 21:50:36.703149 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': '3248249e-5727-42fe-b705-18f7809d9366'} Oct 08 21:50:36.703149 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:50:36.703149 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:50:36.703149 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:50:36.703149 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:50:36.703149 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:50:36.703149 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:50:36.703149 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:50:36.703149 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:50:36.703149 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:50:36.703149 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:50:36.703149 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3248249e-5727-42fe-b705-18f7809d9366 could not be found. Oct 08 21:50:36.703149 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:50:36.703149 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:50:36.703149 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:50:36.703149 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:50:36.703149 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:50:36.703149 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:50:36.703149 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:50:36.703149 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:50:36.703149 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:50:36.703149 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:50:36.703149 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:50:36.703149 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:50:36.703149 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:50:36.703149 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:50:36.703149 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:50:36.703149 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:50:36.703149 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3248249e-5727-42fe-b705-18f7809d9366 could not be found. Oct 08 21:50:36.703149 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:50:36.703149 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:50:36.703149 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:50:36.709305 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:50:36.709305 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:50:36.709305 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:50:36.709305 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:50:36.709305 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:50:36.709305 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3248249e-5727-42fe-b705-18f7809d9366 could not be found. Oct 08 21:50:36.709305 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:50:36.709305 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-76fdd6ed-475f-4eb2-b807-bb635040435b tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Returning 404 to user: Instance 3248249e-5727-42fe-b705-18f7809d9366 could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:50:36.709305 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-76fdd6ed-475f-4eb2-b807-bb635040435b tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] 10.222.0.26 "GET /compute/v2.1/servers/3248249e-5727-42fe-b705-18f7809d9366" status: 404 len: 111 microversion: 2.1 time: 0.033448 Oct 08 21:50:36.709305 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3392/6711] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:50:36 2022] GET /compute/v2.1/servers/3248249e-5727-42fe-b705-18f7809d9366 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:50:36.714928 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-9bbca7ee-4de4-4aaf-9084-80b0f674d6c6 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:50:36.715699 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-9bbca7ee-4de4-4aaf-9084-80b0f674d6c6 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] [instance: 7e381a81-bf8d-484a-850f-acec73f77ada] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:50:36.722195 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9bbca7ee-4de4-4aaf-9084-80b0f674d6c6 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:50:36.722693 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9bbca7ee-4de4-4aaf-9084-80b0f674d6c6 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:50:36.723143 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9bbca7ee-4de4-4aaf-9084-80b0f674d6c6 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:50:36.723856 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9bbca7ee-4de4-4aaf-9084-80b0f674d6c6 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:50:36.724919 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9bbca7ee-4de4-4aaf-9084-80b0f674d6c6 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:50:36.725395 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9bbca7ee-4de4-4aaf-9084-80b0f674d6c6 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:50:36.855944 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-9bbca7ee-4de4-4aaf-9084-80b0f674d6c6 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94a4c8a5bd25448a8479a4316479ba18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e9d160d2fc4f5fb7ccb312246c977e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:50:36.863720 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-9bbca7ee-4de4-4aaf-9084-80b0f674d6c6 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] 10.222.0.26 "GET /compute/v2.1/servers/7e381a81-bf8d-484a-850f-acec73f77ada" status: 200 len: 1505 microversion: 2.1 time: 0.153187 Oct 08 21:50:36.864290 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3320/6712] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:50:36 2022] GET /compute/v2.1/servers/7e381a81-bf8d-484a-850f-acec73f77ada => generated 1505 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:50:36.885568 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-b4603a6a-2392-47a1-9f1d-c19c9654903b tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:50:36.888016 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-b4603a6a-2392-47a1-9f1d-c19c9654903b tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] [instance: 14a46aa4-6f35-4daf-a57a-b0ce0dff2534] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:50:36.893631 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-b4603a6a-2392-47a1-9f1d-c19c9654903b tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] HTTP exception thrown: Instance 14a46aa4-6f35-4daf-a57a-b0ce0dff2534 could not be found. Oct 08 21:50:36.895201 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-b4603a6a-2392-47a1-9f1d-c19c9654903b tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Request method failure captured: Oct 08 21:50:36.895201 ncdv-master-1 devstack@n-api.service[140492]: request: POST /compute/v2.1/servers/14a46aa4-6f35-4daf-a57a-b0ce0dff2534/action HTTP/1.1 Oct 08 21:50:36.895201 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:50:36.895201 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:50:36.895201 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:50:36.895201 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 32 Oct 08 21:50:36.895201 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:50:36.895201 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:50:36.895201 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:50:36.895201 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:50:36.895201 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQfCUvRtFKF8HUOWB72alsv4ILps4UncOFTjm8EQ1I6mtg5n5UzlllWPm6z-4c_iVFYz1vpPNFE_t_z5yz_gt5_V0ESlhEOR5zPJDdtkFA_kgatAMZGiNotPCxF4OdZt9wMGJuPGNYCZ_PC6e0txzNu049eHN3QLG9DDbsTYSYBU07-U Oct 08 21:50:36.895201 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:50:36.895201 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:50:36.895201 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:50:36.895201 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:50:36.895201 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:50:36.895201 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:50:36.895201 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: a7e9d160d2fc4f5fb7ccb312246c977e Oct 08 21:50:36.895201 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-ServersNegativeTestJSON-971785938 Oct 08 21:50:36.895201 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:50:36.895201 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:50:36.895201 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/a7e9d160d2fc4f5fb7ccb312246c977e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a7e9d160d2fc4f5fb7ccb312246c977e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_a7e9d160d2fc4f5fb7ccb312246c977e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a7e9d160d2fc4f5fb7ccb312246c977e"}]}] Oct 08 21:50:36.895201 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-ServersNegativeTestJSON-971785938 Oct 08 21:50:36.895201 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: a7e9d160d2fc4f5fb7ccb312246c977e Oct 08 21:50:36.895201 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-ServersNegativeTestJSON-971785938 Oct 08 21:50:36.895201 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-ServersNegativeTestJSON-971785938-project Oct 08 21:50:36.895201 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:50:36.895201 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:50:36.895201 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 94a4c8a5bd25448a8479a4316479ba18 Oct 08 21:50:36.895201 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-ServersNegativeTestJSON-971785938-project Oct 08 21:50:36.895201 ncdv-master-1 devstack@n-api.service[140492]: Oct 08 21:50:36.895201 ncdv-master-1 devstack@n-api.service[140492]: {"resize": {"flavorRef": "452"}} Oct 08 21:50:36.895201 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 21:50:36.895201 ncdv-master-1 devstack@n-api.service[140492]: exception: Instance 14a46aa4-6f35-4daf-a57a-b0ce0dff2534 could not be found. Oct 08 21:50:36.895201 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': '14a46aa4-6f35-4daf-a57a-b0ce0dff2534', 'body': {'resize': {'flavorRef': '452'}}} Oct 08 21:50:36.895201 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:50:36.895201 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:50:36.895201 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:50:36.895201 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:50:36.895201 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:50:36.895201 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:50:36.895201 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 08 21:50:36.895201 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 08 21:50:36.895201 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14a46aa4-6f35-4daf-a57a-b0ce0dff2534 could not be found. Oct 08 21:50:36.895201 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:50:36.895201 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:50:36.895201 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:50:36.895201 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:50:36.895201 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:50:36.895201 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:50:36.895201 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:50:36.895201 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:50:36.895201 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:50:36.895201 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:50:36.895201 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 21:50:36.895201 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 21:50:36.895201 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 08 21:50:36.895201 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 08 21:50:36.895201 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Oct 08 21:50:36.895201 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Oct 08 21:50:36.895201 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:50:36.895201 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:50:36.895201 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:50:36.895201 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:50:36.900565 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14a46aa4-6f35-4daf-a57a-b0ce0dff2534 could not be found. Oct 08 21:50:36.900565 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:50:36.900565 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:50:36.900565 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:50:36.900565 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:50:36.900565 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:50:36.900565 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:50:36.900565 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:50:36.900565 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:50:36.900565 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14a46aa4-6f35-4daf-a57a-b0ce0dff2534 could not be found. Oct 08 21:50:36.900565 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:50:36.900565 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-b4603a6a-2392-47a1-9f1d-c19c9654903b tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Returning 404 to user: Instance 14a46aa4-6f35-4daf-a57a-b0ce0dff2534 could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:50:36.900565 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-b4603a6a-2392-47a1-9f1d-c19c9654903b tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] 10.222.0.26 "POST /compute/v2.1/servers/14a46aa4-6f35-4daf-a57a-b0ce0dff2534/action" status: 404 len: 111 microversion: 2.1 time: 0.015627 Oct 08 21:50:36.900565 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3393/6713] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:50:36 2022] POST /compute/v2.1/servers/14a46aa4-6f35-4daf-a57a-b0ce0dff2534/action => generated 111 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:50:36.905371 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-d47856f9-fdcd-4e1e-8f42-6ade73d109d0 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:50:36.905983 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-d47856f9-fdcd-4e1e-8f42-6ade73d109d0 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] [instance: 7e381a81-bf8d-484a-850f-acec73f77ada] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:50:36.912575 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d47856f9-fdcd-4e1e-8f42-6ade73d109d0 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:50:36.913056 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d47856f9-fdcd-4e1e-8f42-6ade73d109d0 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:50:36.913518 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d47856f9-fdcd-4e1e-8f42-6ade73d109d0 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:50:36.914212 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d47856f9-fdcd-4e1e-8f42-6ade73d109d0 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:50:36.914666 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d47856f9-fdcd-4e1e-8f42-6ade73d109d0 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:50:36.915094 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d47856f9-fdcd-4e1e-8f42-6ade73d109d0 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:50:37.048691 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-d47856f9-fdcd-4e1e-8f42-6ade73d109d0 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94a4c8a5bd25448a8479a4316479ba18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e9d160d2fc4f5fb7ccb312246c977e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:50:37.057112 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-d47856f9-fdcd-4e1e-8f42-6ade73d109d0 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] 10.222.0.26 "GET /compute/v2.1/servers/7e381a81-bf8d-484a-850f-acec73f77ada" status: 200 len: 1505 microversion: 2.1 time: 0.155488 Oct 08 21:50:37.057718 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3321/6714] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:50:36 2022] GET /compute/v2.1/servers/7e381a81-bf8d-484a-850f-acec73f77ada => generated 1505 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:50:37.080216 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-9f11d047-7e58-4c58-8a7e-00a1a036c7eb tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:50:37.080854 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-9f11d047-7e58-4c58-8a7e-00a1a036c7eb tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] [instance: 7e381a81-bf8d-484a-850f-acec73f77ada] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:50:37.088538 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9f11d047-7e58-4c58-8a7e-00a1a036c7eb tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:50:37.089044 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9f11d047-7e58-4c58-8a7e-00a1a036c7eb tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:50:37.089539 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9f11d047-7e58-4c58-8a7e-00a1a036c7eb tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:50:37.090254 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9f11d047-7e58-4c58-8a7e-00a1a036c7eb tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:50:37.090735 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9f11d047-7e58-4c58-8a7e-00a1a036c7eb tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:50:37.091185 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9f11d047-7e58-4c58-8a7e-00a1a036c7eb tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:50:37.218527 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-9f11d047-7e58-4c58-8a7e-00a1a036c7eb tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94a4c8a5bd25448a8479a4316479ba18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e9d160d2fc4f5fb7ccb312246c977e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:50:37.226712 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-9f11d047-7e58-4c58-8a7e-00a1a036c7eb tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] 10.222.0.26 "GET /compute/v2.1/servers/7e381a81-bf8d-484a-850f-acec73f77ada" status: 200 len: 1505 microversion: 2.1 time: 0.150363 Oct 08 21:50:37.227330 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3394/6715] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:50:37 2022] GET /compute/v2.1/servers/7e381a81-bf8d-484a-850f-acec73f77ada => generated 1505 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:50:37.248703 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-10b5ef75-390e-43d9-a8b8-0baae1c210b9 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "2d9e9e51-6da6-41ba-a7e3-fbaaca4bf139"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:50:37.250936 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-10b5ef75-390e-43d9-a8b8-0baae1c210b9 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] [instance: 7e381a81-bf8d-484a-850f-acec73f77ada] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:50:37.257600 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-10b5ef75-390e-43d9-a8b8-0baae1c210b9 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:50:37.258098 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-10b5ef75-390e-43d9-a8b8-0baae1c210b9 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:50:37.258545 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-10b5ef75-390e-43d9-a8b8-0baae1c210b9 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:50:37.259257 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-10b5ef75-390e-43d9-a8b8-0baae1c210b9 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:50:37.259728 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-10b5ef75-390e-43d9-a8b8-0baae1c210b9 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:50:37.260168 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-10b5ef75-390e-43d9-a8b8-0baae1c210b9 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:50:37.289105 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-10b5ef75-390e-43d9-a8b8-0baae1c210b9 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '94a4c8a5bd25448a8479a4316479ba18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e9d160d2fc4f5fb7ccb312246c977e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:50:37.293862 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-10b5ef75-390e-43d9-a8b8-0baae1c210b9 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] HTTP exception thrown: Flavor 2d9e9e51-6da6-41ba-a7e3-fbaaca4bf139 could not be found. Oct 08 21:50:37.295764 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-10b5ef75-390e-43d9-a8b8-0baae1c210b9 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Request method failure captured: Oct 08 21:50:37.295764 ncdv-master-1 devstack@n-api.service[140491]: request: POST /compute/v2.1/servers/7e381a81-bf8d-484a-850f-acec73f77ada/action HTTP/1.1 Oct 08 21:50:37.295764 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:50:37.295764 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:50:37.295764 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:50:37.295764 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 65 Oct 08 21:50:37.295764 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:50:37.295764 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:50:37.295764 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:50:37.295764 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:50:37.295764 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQfCUvRtFKF8HUOWB72alsv4ILps4UncOFTjm8EQ1I6mtg5n5UzlllWPm6z-4c_iVFYz1vpPNFE_t_z5yz_gt5_V0ESlhEOR5zPJDdtkFA_kgatAMZGiNotPCxF4OdZt9wMGJuPGNYCZ_PC6e0txzNu049eHN3QLG9DDbsTYSYBU07-U Oct 08 21:50:37.295764 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:50:37.295764 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:50:37.295764 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:50:37.295764 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:50:37.295764 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:50:37.295764 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:50:37.295764 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: a7e9d160d2fc4f5fb7ccb312246c977e Oct 08 21:50:37.295764 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-ServersNegativeTestJSON-971785938 Oct 08 21:50:37.295764 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:50:37.295764 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:50:37.295764 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/a7e9d160d2fc4f5fb7ccb312246c977e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a7e9d160d2fc4f5fb7ccb312246c977e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_a7e9d160d2fc4f5fb7ccb312246c977e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a7e9d160d2fc4f5fb7ccb312246c977e"}]}] Oct 08 21:50:37.295764 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-ServersNegativeTestJSON-971785938 Oct 08 21:50:37.295764 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: a7e9d160d2fc4f5fb7ccb312246c977e Oct 08 21:50:37.295764 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-ServersNegativeTestJSON-971785938 Oct 08 21:50:37.295764 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-ServersNegativeTestJSON-971785938-project Oct 08 21:50:37.295764 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:50:37.295764 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:50:37.295764 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 94a4c8a5bd25448a8479a4316479ba18 Oct 08 21:50:37.295764 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-ServersNegativeTestJSON-971785938-project Oct 08 21:50:37.295764 ncdv-master-1 devstack@n-api.service[140491]: Oct 08 21:50:37.295764 ncdv-master-1 devstack@n-api.service[140491]: {"resize": {"flavorRef": "2d9e9e51-6da6-41ba-a7e3-fbaaca4bf139"}} Oct 08 21:50:37.295764 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:50:37.295764 ncdv-master-1 devstack@n-api.service[140491]: exception: Flavor 2d9e9e51-6da6-41ba-a7e3-fbaaca4bf139 could not be found. Oct 08 21:50:37.295764 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': '7e381a81-bf8d-484a-850f-acec73f77ada', 'body': {'resize': {'flavorRef': '2d9e9e51-6da6-41ba-a7e3-fbaaca4bf139'}}} Oct 08 21:50:37.295764 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:50:37.295764 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:50:37.295764 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 08 21:50:37.295764 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 08 21:50:37.295764 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 08 21:50:37.295764 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 08 21:50:37.295764 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 08 21:50:37.295764 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 08 21:50:37.295764 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 08 21:50:37.295764 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 08 21:50:37.295764 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 08 21:50:37.295764 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 08 21:50:37.295764 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 08 21:50:37.295764 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 08 21:50:37.295764 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 08 21:50:37.295764 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 08 21:50:37.295764 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4200, in resize Oct 08 21:50:37.295764 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Oct 08 21:50:37.295764 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 08 21:50:37.295764 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 08 21:50:37.295764 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 08 21:50:37.295764 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 08 21:50:37.295764 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 08 21:50:37.295764 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 08 21:50:37.295764 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 08 21:50:37.295764 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:50:37.295764 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 08 21:50:37.300489 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 08 21:50:37.300489 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 2d9e9e51-6da6-41ba-a7e3-fbaaca4bf139 could not be found. Oct 08 21:50:37.300489 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:50:37.300489 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:50:37.300489 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:50:37.300489 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:50:37.300489 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:50:37.300489 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:50:37.300489 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:50:37.300489 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:50:37.300489 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:50:37.300489 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:50:37.300489 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 08 21:50:37.300489 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 08 21:50:37.300489 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 08 21:50:37.300489 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 08 21:50:37.300489 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Oct 08 21:50:37.300489 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 08 21:50:37.300489 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 2d9e9e51-6da6-41ba-a7e3-fbaaca4bf139 could not be found. Oct 08 21:50:37.300489 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:50:37.300489 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:50:37.300489 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:50:37.300489 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:50:37.300489 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:50:37.300489 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:50:37.300489 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:50:37.300489 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:50:37.300489 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 2d9e9e51-6da6-41ba-a7e3-fbaaca4bf139 could not be found. Oct 08 21:50:37.300489 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:50:37.300489 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-10b5ef75-390e-43d9-a8b8-0baae1c210b9 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Returning 400 to user: Flavor 2d9e9e51-6da6-41ba-a7e3-fbaaca4bf139 could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:50:37.300489 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-10b5ef75-390e-43d9-a8b8-0baae1c210b9 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] 10.222.0.26 "POST /compute/v2.1/servers/7e381a81-bf8d-484a-850f-acec73f77ada/action" status: 400 len: 107 microversion: 2.1 time: 0.052591 Oct 08 21:50:37.300489 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3322/6716] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:50:37 2022] POST /compute/v2.1/servers/7e381a81-bf8d-484a-850f-acec73f77ada/action => generated 107 bytes in 54 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 08 21:50:37.306191 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-a3fa5028-baea-4ae7-9415-6b2331db6caa tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:50:37.306838 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-a3fa5028-baea-4ae7-9415-6b2331db6caa tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] [instance: 7e381a81-bf8d-484a-850f-acec73f77ada] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:50:37.312835 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a3fa5028-baea-4ae7-9415-6b2331db6caa tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:50:37.313390 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a3fa5028-baea-4ae7-9415-6b2331db6caa tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:50:37.313882 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a3fa5028-baea-4ae7-9415-6b2331db6caa tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:50:37.314870 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a3fa5028-baea-4ae7-9415-6b2331db6caa tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:50:37.315355 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a3fa5028-baea-4ae7-9415-6b2331db6caa tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:50:37.315815 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a3fa5028-baea-4ae7-9415-6b2331db6caa tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:50:37.447245 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-a3fa5028-baea-4ae7-9415-6b2331db6caa tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94a4c8a5bd25448a8479a4316479ba18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e9d160d2fc4f5fb7ccb312246c977e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:50:37.455344 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-a3fa5028-baea-4ae7-9415-6b2331db6caa tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] 10.222.0.26 "GET /compute/v2.1/servers/7e381a81-bf8d-484a-850f-acec73f77ada" status: 200 len: 1505 microversion: 2.1 time: 0.153060 Oct 08 21:50:37.455939 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3395/6717] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:50:37 2022] GET /compute/v2.1/servers/7e381a81-bf8d-484a-850f-acec73f77ada => generated 1505 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:50:37.479265 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-8e0d5391-d800-4e0d-b854-5b1272183521 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:50:37.479885 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-8e0d5391-d800-4e0d-b854-5b1272183521 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] [instance: 7e381a81-bf8d-484a-850f-acec73f77ada] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:50:37.486113 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8e0d5391-d800-4e0d-b854-5b1272183521 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:50:37.486614 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8e0d5391-d800-4e0d-b854-5b1272183521 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:50:37.487066 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8e0d5391-d800-4e0d-b854-5b1272183521 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:50:37.487776 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8e0d5391-d800-4e0d-b854-5b1272183521 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:50:37.488242 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8e0d5391-d800-4e0d-b854-5b1272183521 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:50:37.488870 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8e0d5391-d800-4e0d-b854-5b1272183521 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:50:37.619565 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-8e0d5391-d800-4e0d-b854-5b1272183521 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94a4c8a5bd25448a8479a4316479ba18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e9d160d2fc4f5fb7ccb312246c977e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:50:37.627451 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-8e0d5391-d800-4e0d-b854-5b1272183521 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] 10.222.0.26 "GET /compute/v2.1/servers/7e381a81-bf8d-484a-850f-acec73f77ada" status: 200 len: 1505 microversion: 2.1 time: 0.152056 Oct 08 21:50:37.628030 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3323/6718] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:50:37 2022] GET /compute/v2.1/servers/7e381a81-bf8d-484a-850f-acec73f77ada => generated 1505 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:50:37.649775 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e03862e1-7ed8-4346-bb62-58ca75c3c6b4 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:50:37.653399 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e03862e1-7ed8-4346-bb62-58ca75c3c6b4 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Request method failure captured: Oct 08 21:50:37.653399 ncdv-master-1 devstack@n-api.service[140492]: request: POST /compute/v2.1/servers/7e381a81-bf8d-484a-850f-acec73f77ada/action HTTP/1.1 Oct 08 21:50:37.653399 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:50:37.653399 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:50:37.653399 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:50:37.653399 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 29 Oct 08 21:50:37.653399 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:50:37.653399 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:50:37.653399 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:50:37.653399 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:50:37.653399 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQfCUvRtFKF8HUOWB72alsv4ILps4UncOFTjm8EQ1I6mtg5n5UzlllWPm6z-4c_iVFYz1vpPNFE_t_z5yz_gt5_V0ESlhEOR5zPJDdtkFA_kgatAMZGiNotPCxF4OdZt9wMGJuPGNYCZ_PC6e0txzNu049eHN3QLG9DDbsTYSYBU07-U Oct 08 21:50:37.653399 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:50:37.653399 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:50:37.653399 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:50:37.653399 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:50:37.653399 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:50:37.653399 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:50:37.653399 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: a7e9d160d2fc4f5fb7ccb312246c977e Oct 08 21:50:37.653399 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-ServersNegativeTestJSON-971785938 Oct 08 21:50:37.653399 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:50:37.653399 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:50:37.653399 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/a7e9d160d2fc4f5fb7ccb312246c977e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a7e9d160d2fc4f5fb7ccb312246c977e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_a7e9d160d2fc4f5fb7ccb312246c977e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a7e9d160d2fc4f5fb7ccb312246c977e"}]}] Oct 08 21:50:37.653399 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-ServersNegativeTestJSON-971785938 Oct 08 21:50:37.653399 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: a7e9d160d2fc4f5fb7ccb312246c977e Oct 08 21:50:37.653399 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-ServersNegativeTestJSON-971785938 Oct 08 21:50:37.653399 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-ServersNegativeTestJSON-971785938-project Oct 08 21:50:37.653399 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:50:37.653399 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:50:37.653399 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 94a4c8a5bd25448a8479a4316479ba18 Oct 08 21:50:37.653399 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-ServersNegativeTestJSON-971785938-project Oct 08 21:50:37.653399 ncdv-master-1 devstack@n-api.service[140492]: Oct 08 21:50:37.653399 ncdv-master-1 devstack@n-api.service[140492]: {"resize": {"flavorRef": ""}} Oct 08 21:50:37.653399 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 21:50:37.653399 ncdv-master-1 devstack@n-api.service[140492]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 08 21:50:37.653399 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': '7e381a81-bf8d-484a-850f-acec73f77ada', 'body': {'resize': {'flavorRef': ''}}} Oct 08 21:50:37.653399 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:50:37.653399 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:50:37.653399 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 08 21:50:37.653399 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 08 21:50:37.653399 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 08 21:50:37.653399 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise error Oct 08 21:50:37.653399 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 08 21:50:37.653399 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:50:37.653399 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Oct 08 21:50:37.653399 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Oct 08 21:50:37.653399 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:50:37.653399 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi On instance['resize']: Oct 08 21:50:37.653399 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi '' Oct 08 21:50:37.653399 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:50:37.653399 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:50:37.653399 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:50:37.653399 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:50:37.653399 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:50:37.653399 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:50:37.653399 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:50:37.653399 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:50:37.653399 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:50:37.653399 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:50:37.653399 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 08 21:50:37.653399 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 08 21:50:37.653399 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 08 21:50:37.653399 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 08 21:50:37.653399 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 08 21:50:37.653399 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 08 21:50:37.653399 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 08 21:50:37.653399 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:50:37.653399 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:50:37.658412 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:50:37.658412 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:50:37.658412 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:50:37.658412 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:50:37.658412 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 08 21:50:37.658412 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 08 21:50:37.658412 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 08 21:50:37.658412 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:50:37.658412 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e03862e1-7ed8-4346-bb62-58ca75c3c6b4 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:50:37.658412 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-e03862e1-7ed8-4346-bb62-58ca75c3c6b4 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] 10.222.0.26 "POST /compute/v2.1/servers/7e381a81-bf8d-484a-850f-acec73f77ada/action" status: 400 len: 113 microversion: 2.1 time: 0.009056 Oct 08 21:50:37.658412 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3396/6719] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:50:37 2022] POST /compute/v2.1/servers/7e381a81-bf8d-484a-850f-acec73f77ada/action => generated 113 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 08 21:50:37.663686 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-e3edf771-3d72-46d4-b8f8-86c01c391ed0 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:50:37.664305 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-e3edf771-3d72-46d4-b8f8-86c01c391ed0 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] [instance: 7e381a81-bf8d-484a-850f-acec73f77ada] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:50:37.670314 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e3edf771-3d72-46d4-b8f8-86c01c391ed0 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:50:37.670808 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e3edf771-3d72-46d4-b8f8-86c01c391ed0 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:50:37.671251 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e3edf771-3d72-46d4-b8f8-86c01c391ed0 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:50:37.671956 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e3edf771-3d72-46d4-b8f8-86c01c391ed0 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:50:37.672424 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e3edf771-3d72-46d4-b8f8-86c01c391ed0 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:50:37.672859 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e3edf771-3d72-46d4-b8f8-86c01c391ed0 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:50:37.805374 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-e3edf771-3d72-46d4-b8f8-86c01c391ed0 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94a4c8a5bd25448a8479a4316479ba18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e9d160d2fc4f5fb7ccb312246c977e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:50:37.813130 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-e3edf771-3d72-46d4-b8f8-86c01c391ed0 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] 10.222.0.26 "GET /compute/v2.1/servers/7e381a81-bf8d-484a-850f-acec73f77ada" status: 200 len: 1505 microversion: 2.1 time: 0.153296 Oct 08 21:50:37.813736 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3324/6720] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:50:37 2022] GET /compute/v2.1/servers/7e381a81-bf8d-484a-850f-acec73f77ada => generated 1505 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:50:37.840229 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-7254d762-2484-4785-8612-67ca702ec0ea tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:50:37.840870 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-7254d762-2484-4785-8612-67ca702ec0ea tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] [instance: 3248249e-5727-42fe-b705-18f7809d9366] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:50:37.848223 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7254d762-2484-4785-8612-67ca702ec0ea tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:50:37.848735 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7254d762-2484-4785-8612-67ca702ec0ea tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:50:37.849842 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7254d762-2484-4785-8612-67ca702ec0ea tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:50:37.850576 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7254d762-2484-4785-8612-67ca702ec0ea tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:50:37.851060 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7254d762-2484-4785-8612-67ca702ec0ea tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:50:37.851515 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7254d762-2484-4785-8612-67ca702ec0ea tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:50:37.864669 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-7254d762-2484-4785-8612-67ca702ec0ea tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] HTTP exception thrown: Instance 3248249e-5727-42fe-b705-18f7809d9366 could not be found. Oct 08 21:50:37.866833 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-7254d762-2484-4785-8612-67ca702ec0ea tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Request method failure captured: Oct 08 21:50:37.866833 ncdv-master-1 devstack@n-api.service[140492]: request: DELETE /compute/v2.1/servers/3248249e-5727-42fe-b705-18f7809d9366 HTTP/1.1 Oct 08 21:50:37.866833 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:50:37.866833 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:50:37.866833 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:50:37.866833 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 21:50:37.866833 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:50:37.866833 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:50:37.866833 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:50:37.866833 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:50:37.866833 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQfCUvRtFKF8HUOWB72alsv4ILps4UncOFTjm8EQ1I6mtg5n5UzlllWPm6z-4c_iVFYz1vpPNFE_t_z5yz_gt5_V0ESlhEOR5zPJDdtkFA_kgatAMZGiNotPCxF4OdZt9wMGJuPGNYCZ_PC6e0txzNu049eHN3QLG9DDbsTYSYBU07-U Oct 08 21:50:37.866833 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:50:37.866833 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:50:37.866833 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:50:37.866833 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:50:37.866833 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:50:37.866833 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:50:37.866833 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: a7e9d160d2fc4f5fb7ccb312246c977e Oct 08 21:50:37.866833 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-ServersNegativeTestJSON-971785938 Oct 08 21:50:37.866833 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:50:37.866833 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:50:37.866833 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/a7e9d160d2fc4f5fb7ccb312246c977e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a7e9d160d2fc4f5fb7ccb312246c977e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_a7e9d160d2fc4f5fb7ccb312246c977e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a7e9d160d2fc4f5fb7ccb312246c977e"}]}] Oct 08 21:50:37.866833 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-ServersNegativeTestJSON-971785938 Oct 08 21:50:37.866833 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: a7e9d160d2fc4f5fb7ccb312246c977e Oct 08 21:50:37.866833 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-ServersNegativeTestJSON-971785938 Oct 08 21:50:37.866833 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-ServersNegativeTestJSON-971785938-project Oct 08 21:50:37.866833 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:50:37.866833 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:50:37.866833 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 94a4c8a5bd25448a8479a4316479ba18 Oct 08 21:50:37.866833 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-ServersNegativeTestJSON-971785938-project Oct 08 21:50:37.866833 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 21:50:37.866833 ncdv-master-1 devstack@n-api.service[140492]: exception: Instance 3248249e-5727-42fe-b705-18f7809d9366 could not be found. Oct 08 21:50:37.866833 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': '3248249e-5727-42fe-b705-18f7809d9366'} Oct 08 21:50:37.866833 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:50:37.866833 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:50:37.866833 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:50:37.866833 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:50:37.866833 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:50:37.866833 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:50:37.866833 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:50:37.866833 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:50:37.866833 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:50:37.866833 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:50:37.866833 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3248249e-5727-42fe-b705-18f7809d9366 could not be found. Oct 08 21:50:37.866833 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:50:37.866833 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:50:37.866833 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:50:37.866833 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:50:37.866833 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:50:37.866833 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:50:37.866833 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:50:37.866833 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:50:37.866833 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:50:37.866833 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:50:37.866833 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 08 21:50:37.866833 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 08 21:50:37.866833 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 08 21:50:37.866833 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 08 21:50:37.866833 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:50:37.866833 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:50:37.866833 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:50:37.866833 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:50:37.871924 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3248249e-5727-42fe-b705-18f7809d9366 could not be found. Oct 08 21:50:37.871924 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:50:37.871924 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:50:37.871924 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:50:37.871924 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:50:37.871924 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:50:37.871924 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:50:37.871924 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:50:37.871924 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:50:37.871924 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3248249e-5727-42fe-b705-18f7809d9366 could not be found. Oct 08 21:50:37.871924 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:50:37.871924 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-7254d762-2484-4785-8612-67ca702ec0ea tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Returning 404 to user: Instance 3248249e-5727-42fe-b705-18f7809d9366 could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:50:37.871924 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-7254d762-2484-4785-8612-67ca702ec0ea tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] 10.222.0.26 "DELETE /compute/v2.1/servers/3248249e-5727-42fe-b705-18f7809d9366" status: 404 len: 111 microversion: 2.1 time: 0.032809 Oct 08 21:50:37.871924 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3397/6721] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:50:37 2022] DELETE /compute/v2.1/servers/3248249e-5727-42fe-b705-18f7809d9366 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:50:37.876795 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-e0a3040c-292a-473f-b961-557ffa106fee tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:50:37.877506 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-e0a3040c-292a-473f-b961-557ffa106fee tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] [instance: 3248249e-5727-42fe-b705-18f7809d9366] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:50:37.883599 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e0a3040c-292a-473f-b961-557ffa106fee tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:50:37.884085 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e0a3040c-292a-473f-b961-557ffa106fee tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:50:37.884530 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e0a3040c-292a-473f-b961-557ffa106fee tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:50:37.885248 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e0a3040c-292a-473f-b961-557ffa106fee tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:50:37.885708 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e0a3040c-292a-473f-b961-557ffa106fee tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:50:37.886135 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e0a3040c-292a-473f-b961-557ffa106fee tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:50:37.899638 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-e0a3040c-292a-473f-b961-557ffa106fee tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] HTTP exception thrown: Instance 3248249e-5727-42fe-b705-18f7809d9366 could not be found. Oct 08 21:50:37.901179 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-e0a3040c-292a-473f-b961-557ffa106fee tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Request method failure captured: Oct 08 21:50:37.901179 ncdv-master-1 devstack@n-api.service[140491]: request: GET /compute/v2.1/servers/3248249e-5727-42fe-b705-18f7809d9366 HTTP/1.1 Oct 08 21:50:37.901179 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:50:37.901179 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:50:37.901179 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:50:37.901179 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 21:50:37.901179 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:50:37.901179 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:50:37.901179 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:50:37.901179 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:50:37.901179 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQfCUvRtFKF8HUOWB72alsv4ILps4UncOFTjm8EQ1I6mtg5n5UzlllWPm6z-4c_iVFYz1vpPNFE_t_z5yz_gt5_V0ESlhEOR5zPJDdtkFA_kgatAMZGiNotPCxF4OdZt9wMGJuPGNYCZ_PC6e0txzNu049eHN3QLG9DDbsTYSYBU07-U Oct 08 21:50:37.901179 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:50:37.901179 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:50:37.901179 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:50:37.901179 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:50:37.901179 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:50:37.901179 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:50:37.901179 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: a7e9d160d2fc4f5fb7ccb312246c977e Oct 08 21:50:37.901179 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-ServersNegativeTestJSON-971785938 Oct 08 21:50:37.901179 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:50:37.901179 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:50:37.901179 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/a7e9d160d2fc4f5fb7ccb312246c977e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a7e9d160d2fc4f5fb7ccb312246c977e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_a7e9d160d2fc4f5fb7ccb312246c977e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a7e9d160d2fc4f5fb7ccb312246c977e"}]}] Oct 08 21:50:37.901179 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-ServersNegativeTestJSON-971785938 Oct 08 21:50:37.901179 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: a7e9d160d2fc4f5fb7ccb312246c977e Oct 08 21:50:37.901179 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-ServersNegativeTestJSON-971785938 Oct 08 21:50:37.901179 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-ServersNegativeTestJSON-971785938-project Oct 08 21:50:37.901179 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:50:37.901179 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:50:37.901179 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 94a4c8a5bd25448a8479a4316479ba18 Oct 08 21:50:37.901179 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-ServersNegativeTestJSON-971785938-project Oct 08 21:50:37.901179 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:50:37.901179 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance 3248249e-5727-42fe-b705-18f7809d9366 could not be found. Oct 08 21:50:37.901179 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': '3248249e-5727-42fe-b705-18f7809d9366'} Oct 08 21:50:37.901179 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:50:37.901179 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:50:37.901179 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:50:37.901179 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:50:37.901179 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:50:37.901179 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:50:37.901179 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:50:37.901179 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:50:37.901179 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:50:37.901179 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:50:37.901179 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3248249e-5727-42fe-b705-18f7809d9366 could not be found. Oct 08 21:50:37.901179 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:50:37.901179 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:50:37.901179 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:50:37.901179 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:50:37.901179 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:50:37.901179 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:50:37.901179 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:50:37.901179 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:50:37.901179 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:50:37.901179 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:50:37.901179 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:50:37.901179 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:50:37.901179 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:50:37.901179 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:50:37.901179 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:50:37.901179 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:50:37.901179 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3248249e-5727-42fe-b705-18f7809d9366 could not be found. Oct 08 21:50:37.901179 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:50:37.901179 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:50:37.901179 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:50:37.905988 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:50:37.905988 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:50:37.905988 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:50:37.905988 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:50:37.905988 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:50:37.905988 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3248249e-5727-42fe-b705-18f7809d9366 could not be found. Oct 08 21:50:37.905988 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:50:37.905988 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-e0a3040c-292a-473f-b961-557ffa106fee tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Returning 404 to user: Instance 3248249e-5727-42fe-b705-18f7809d9366 could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:50:37.905988 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-e0a3040c-292a-473f-b961-557ffa106fee tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] 10.222.0.26 "GET /compute/v2.1/servers/3248249e-5727-42fe-b705-18f7809d9366" status: 404 len: 111 microversion: 2.1 time: 0.029647 Oct 08 21:50:37.905988 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3325/6722] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:50:37 2022] GET /compute/v2.1/servers/3248249e-5727-42fe-b705-18f7809d9366 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:50:37.910938 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-da228729-c475-4c25-8d50-268c89cf3e19 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:50:37.911464 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-da228729-c475-4c25-8d50-268c89cf3e19 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] [instance: 7e381a81-bf8d-484a-850f-acec73f77ada] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:50:37.918099 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-da228729-c475-4c25-8d50-268c89cf3e19 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:50:37.918613 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-da228729-c475-4c25-8d50-268c89cf3e19 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:50:37.919082 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-da228729-c475-4c25-8d50-268c89cf3e19 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:50:37.919804 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-da228729-c475-4c25-8d50-268c89cf3e19 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:50:37.920288 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-da228729-c475-4c25-8d50-268c89cf3e19 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:50:37.920742 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-da228729-c475-4c25-8d50-268c89cf3e19 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:50:37.949296 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-da228729-c475-4c25-8d50-268c89cf3e19 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] [instance: 7e381a81-bf8d-484a-850f-acec73f77ada] Going to try to terminate instance {{(pid=140492) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 21:50:37.952070 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:50:38.024972 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-da228729-c475-4c25-8d50-268c89cf3e19 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] 10.222.0.26 "DELETE /compute/v2.1/servers/7e381a81-bf8d-484a-850f-acec73f77ada" status: 204 len: 0 microversion: 2.1 time: 0.117627 Oct 08 21:50:38.025600 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3398/6723] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:50:37 2022] DELETE /compute/v2.1/servers/7e381a81-bf8d-484a-850f-acec73f77ada => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 21:50:38.033817 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-3a4f6c4f-6016-4d9f-b584-ad319ce5e11c tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:50:38.034443 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-3a4f6c4f-6016-4d9f-b584-ad319ce5e11c tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] [instance: 7e381a81-bf8d-484a-850f-acec73f77ada] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:50:38.042131 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3a4f6c4f-6016-4d9f-b584-ad319ce5e11c tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:50:38.042618 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3a4f6c4f-6016-4d9f-b584-ad319ce5e11c tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:50:38.043066 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3a4f6c4f-6016-4d9f-b584-ad319ce5e11c tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:50:38.043773 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3a4f6c4f-6016-4d9f-b584-ad319ce5e11c tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:50:38.044238 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3a4f6c4f-6016-4d9f-b584-ad319ce5e11c tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:50:38.044670 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3a4f6c4f-6016-4d9f-b584-ad319ce5e11c tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:50:38.173858 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-3a4f6c4f-6016-4d9f-b584-ad319ce5e11c tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94a4c8a5bd25448a8479a4316479ba18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e9d160d2fc4f5fb7ccb312246c977e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:50:38.182238 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-3a4f6c4f-6016-4d9f-b584-ad319ce5e11c tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] 10.222.0.26 "GET /compute/v2.1/servers/7e381a81-bf8d-484a-850f-acec73f77ada" status: 200 len: 1511 microversion: 2.1 time: 0.152483 Oct 08 21:50:38.182821 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3326/6724] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:50:38 2022] GET /compute/v2.1/servers/7e381a81-bf8d-484a-850f-acec73f77ada => generated 1511 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:50:39.205983 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-bb273de9-b60b-4cdb-a927-d30a040845fc tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:50:39.206713 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-bb273de9-b60b-4cdb-a927-d30a040845fc tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] [instance: 7e381a81-bf8d-484a-850f-acec73f77ada] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:50:39.213769 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bb273de9-b60b-4cdb-a927-d30a040845fc tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:50:39.214276 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bb273de9-b60b-4cdb-a927-d30a040845fc tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:50:39.214736 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bb273de9-b60b-4cdb-a927-d30a040845fc tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:50:39.215445 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bb273de9-b60b-4cdb-a927-d30a040845fc tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:50:39.215921 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bb273de9-b60b-4cdb-a927-d30a040845fc tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:50:39.216367 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bb273de9-b60b-4cdb-a927-d30a040845fc tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:50:39.348229 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-bb273de9-b60b-4cdb-a927-d30a040845fc tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94a4c8a5bd25448a8479a4316479ba18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e9d160d2fc4f5fb7ccb312246c977e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:50:39.357063 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-bb273de9-b60b-4cdb-a927-d30a040845fc tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] 10.222.0.26 "GET /compute/v2.1/servers/7e381a81-bf8d-484a-850f-acec73f77ada" status: 200 len: 1511 microversion: 2.1 time: 0.155462 Oct 08 21:50:39.357718 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3399/6725] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:50:39 2022] GET /compute/v2.1/servers/7e381a81-bf8d-484a-850f-acec73f77ada => generated 1511 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:50:39.899274 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-9b02b16d-5244-45d7-873d-d505042663f8 req-ea7dd1ec-4d80-4426-b367-cb241b727dea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e381a81-bf8d-484a-850f-acec73f77ada", "name": "network-vif-deleted", "tag": "cbce56f6-46d3-46f7-b73e-7aa73ad7cdf2"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:50:39.912785 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-9b02b16d-5244-45d7-873d-d505042663f8 req-ea7dd1ec-4d80-4426-b367-cb241b727dea service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:50:39.913303 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-9b02b16d-5244-45d7-873d-d505042663f8 req-ea7dd1ec-4d80-4426-b367-cb241b727dea service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:50:39.913825 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-9b02b16d-5244-45d7-873d-d505042663f8 req-ea7dd1ec-4d80-4426-b367-cb241b727dea service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:50:39.926675 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-9b02b16d-5244-45d7-873d-d505042663f8 req-ea7dd1ec-4d80-4426-b367-cb241b727dea service nova] Creating event network-vif-deleted:cbce56f6-46d3-46f7-b73e-7aa73ad7cdf2 for instance 7e381a81-bf8d-484a-850f-acec73f77ada on nch1-master-1 Oct 08 21:50:39.932351 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-9b02b16d-5244-45d7-873d-d505042663f8 req-ea7dd1ec-4d80-4426-b367-cb241b727dea service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037349 Oct 08 21:50:39.933651 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3327/6726] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:50:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:50:40.380219 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-d5ecfa08-3e81-4420-b975-c25ab0334840 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:50:40.381472 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-d5ecfa08-3e81-4420-b975-c25ab0334840 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] [instance: 7e381a81-bf8d-484a-850f-acec73f77ada] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:50:40.388676 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d5ecfa08-3e81-4420-b975-c25ab0334840 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:50:40.389181 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d5ecfa08-3e81-4420-b975-c25ab0334840 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:50:40.389672 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d5ecfa08-3e81-4420-b975-c25ab0334840 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:50:40.390511 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d5ecfa08-3e81-4420-b975-c25ab0334840 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:50:40.391031 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d5ecfa08-3e81-4420-b975-c25ab0334840 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:50:40.391498 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d5ecfa08-3e81-4420-b975-c25ab0334840 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:50:40.425679 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d5ecfa08-3e81-4420-b975-c25ab0334840 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:50:40.426181 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d5ecfa08-3e81-4420-b975-c25ab0334840 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:50:40.426642 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d5ecfa08-3e81-4420-b975-c25ab0334840 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:50:40.427113 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.objects.instance [None req-d5ecfa08-3e81-4420-b975-c25ab0334840 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Lazy-loading 'fault' on Instance uuid 7e381a81-bf8d-484a-850f-acec73f77ada {{(pid=140492) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 21:50:40.469234 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-d5ecfa08-3e81-4420-b975-c25ab0334840 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94a4c8a5bd25448a8479a4316479ba18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e9d160d2fc4f5fb7ccb312246c977e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:50:40.477571 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-d5ecfa08-3e81-4420-b975-c25ab0334840 tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] 10.222.0.26 "GET /compute/v2.1/servers/7e381a81-bf8d-484a-850f-acec73f77ada" status: 200 len: 1307 microversion: 2.1 time: 0.101168 Oct 08 21:50:40.478475 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3400/6727] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:50:40 2022] GET /compute/v2.1/servers/7e381a81-bf8d-484a-850f-acec73f77ada => generated 1307 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:50:41.503257 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-fb2a28ed-60eb-49e6-863b-480ff714a7fc tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:50:41.503964 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-fb2a28ed-60eb-49e6-863b-480ff714a7fc tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] [instance: 7e381a81-bf8d-484a-850f-acec73f77ada] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:50:41.510328 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fb2a28ed-60eb-49e6-863b-480ff714a7fc tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:50:41.510822 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fb2a28ed-60eb-49e6-863b-480ff714a7fc tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:50:41.511272 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fb2a28ed-60eb-49e6-863b-480ff714a7fc tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:50:41.511973 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fb2a28ed-60eb-49e6-863b-480ff714a7fc tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:50:41.512437 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fb2a28ed-60eb-49e6-863b-480ff714a7fc tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:50:41.512869 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-fb2a28ed-60eb-49e6-863b-480ff714a7fc tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:50:41.526823 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-fb2a28ed-60eb-49e6-863b-480ff714a7fc tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] HTTP exception thrown: Instance 7e381a81-bf8d-484a-850f-acec73f77ada could not be found. Oct 08 21:50:41.528439 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-fb2a28ed-60eb-49e6-863b-480ff714a7fc tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Request method failure captured: Oct 08 21:50:41.528439 ncdv-master-1 devstack@n-api.service[140491]: request: GET /compute/v2.1/servers/7e381a81-bf8d-484a-850f-acec73f77ada HTTP/1.1 Oct 08 21:50:41.528439 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:50:41.528439 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:50:41.528439 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:50:41.528439 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 21:50:41.528439 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:50:41.528439 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:50:41.528439 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:50:41.528439 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:50:41.528439 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQfCUvRtFKF8HUOWB72alsv4ILps4UncOFTjm8EQ1I6mtg5n5UzlllWPm6z-4c_iVFYz1vpPNFE_t_z5yz_gt5_V0ESlhEOR5zPJDdtkFA_kgatAMZGiNotPCxF4OdZt9wMGJuPGNYCZ_PC6e0txzNu049eHN3QLG9DDbsTYSYBU07-U Oct 08 21:50:41.528439 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:50:41.528439 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:50:41.528439 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:50:41.528439 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:50:41.528439 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:50:41.528439 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:50:41.528439 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: a7e9d160d2fc4f5fb7ccb312246c977e Oct 08 21:50:41.528439 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-ServersNegativeTestJSON-971785938 Oct 08 21:50:41.528439 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:50:41.528439 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:50:41.528439 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/a7e9d160d2fc4f5fb7ccb312246c977e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a7e9d160d2fc4f5fb7ccb312246c977e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_a7e9d160d2fc4f5fb7ccb312246c977e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a7e9d160d2fc4f5fb7ccb312246c977e"}]}] Oct 08 21:50:41.528439 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-ServersNegativeTestJSON-971785938 Oct 08 21:50:41.528439 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: a7e9d160d2fc4f5fb7ccb312246c977e Oct 08 21:50:41.528439 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-ServersNegativeTestJSON-971785938 Oct 08 21:50:41.528439 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-ServersNegativeTestJSON-971785938-project Oct 08 21:50:41.528439 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:50:41.528439 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:50:41.528439 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 94a4c8a5bd25448a8479a4316479ba18 Oct 08 21:50:41.528439 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-ServersNegativeTestJSON-971785938-project Oct 08 21:50:41.528439 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:50:41.528439 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance 7e381a81-bf8d-484a-850f-acec73f77ada could not be found. Oct 08 21:50:41.528439 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': '7e381a81-bf8d-484a-850f-acec73f77ada'} Oct 08 21:50:41.528439 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:50:41.528439 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:50:41.528439 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:50:41.528439 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:50:41.528439 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:50:41.528439 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:50:41.528439 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:50:41.528439 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:50:41.528439 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:50:41.528439 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:50:41.528439 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e381a81-bf8d-484a-850f-acec73f77ada could not be found. Oct 08 21:50:41.528439 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:50:41.528439 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:50:41.528439 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:50:41.528439 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:50:41.528439 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:50:41.528439 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:50:41.528439 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:50:41.528439 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:50:41.528439 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:50:41.528439 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:50:41.528439 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:50:41.528439 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:50:41.528439 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:50:41.528439 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:50:41.528439 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:50:41.528439 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:50:41.528439 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e381a81-bf8d-484a-850f-acec73f77ada could not be found. Oct 08 21:50:41.528439 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:50:41.528439 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:50:41.528439 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:50:41.533730 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:50:41.533730 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:50:41.533730 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:50:41.533730 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:50:41.533730 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:50:41.533730 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e381a81-bf8d-484a-850f-acec73f77ada could not be found. Oct 08 21:50:41.533730 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:50:41.533730 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-fb2a28ed-60eb-49e6-863b-480ff714a7fc tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] Returning 404 to user: Instance 7e381a81-bf8d-484a-850f-acec73f77ada could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:50:41.533730 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-fb2a28ed-60eb-49e6-863b-480ff714a7fc tempest-ServersNegativeTestJSON-971785938 tempest-ServersNegativeTestJSON-971785938-project] 10.222.0.26 "GET /compute/v2.1/servers/7e381a81-bf8d-484a-850f-acec73f77ada" status: 404 len: 111 microversion: 2.1 time: 0.031775 Oct 08 21:50:41.533730 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3328/6728] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:50:41 2022] GET /compute/v2.1/servers/7e381a81-bf8d-484a-850f-acec73f77ada => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:51:21.572864 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-1c02e05c-7636-4cc2-bb21-7c0c1d43c229 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Action: 'create', calling method: .version_select at 0x7f1a874e3a60>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-912932776", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKxiMXoTy/9ReMaG+KrPpwwzG8Ld2ttigQ6duROVzJOkqh6d/vZ9iJhsUWG91wvHvHntVEUoYWi+g/kqAacgCHfff72kDhqxEhF5XqmhgFCyxjUiaqzeh2raVJr27JeJlw=="}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:51:21.578754 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=2 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:51:21.579450 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:51:21.601877 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-1c02e05c-7636-4cc2-bb21-7c0c1d43c229 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Getting quotas for project c3c1dbcc78cc4349b68eb40eb879be88. Resources: {'key_pairs'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:51:21.607197 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-1c02e05c-7636-4cc2-bb21-7c0c1d43c229 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Getting quotas for user 80a96d23b9a84b03a0549f1d57be4779 and project c3c1dbcc78cc4349b68eb40eb879be88. Resources: {'key_pairs'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:51:21.631595 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-1c02e05c-7636-4cc2-bb21-7c0c1d43c229 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.063577 Oct 08 21:51:21.632349 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3401/6729] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Oct 8 21:51:21 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:51:21.689676 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-d319e2dc-2ca6-413a-b5b8-669a5e5abc31 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-74030680", "imageRef": "32814ea8-1724-4bd2-8bf1-9290c7fcf3a1", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-912932776", "networks": [{"uuid": "8da279d7-bbf4-4ddf-b706-120d97c39a88"}]}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:51:21.698749 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:51:21.699415 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=83 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:51:21.700611 ncdv-master-1 devstack@n-api.service[140491]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 08 21:51:21.700777 ncdv-master-1 devstack@n-api.service[140491]: Sat Oct 8 21:51:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.26) !!! Oct 08 21:51:21.755064 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.network.neutron [None req-d319e2dc-2ca6-413a-b5b8-669a5e5abc31 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] validate_networks() for [('8da279d7-bbf4-4ddf-b706-120d97c39a88', None, None, None, None, None)] {{(pid=140491) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 21:51:22.271167 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-d319e2dc-2ca6-413a-b5b8-669a5e5abc31 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Flavor limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 21:51:22.271603 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-d319e2dc-2ca6-413a-b5b8-669a5e5abc31 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Image limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 21:51:22.272092 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-d319e2dc-2ca6-413a-b5b8-669a5e5abc31 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Flavor pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 21:51:22.272516 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-d319e2dc-2ca6-413a-b5b8-669a5e5abc31 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Image pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 21:51:22.272939 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-d319e2dc-2ca6-413a-b5b8-669a5e5abc31 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 21:51:22.284323 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d319e2dc-2ca6-413a-b5b8-669a5e5abc31 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:51:22.284818 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d319e2dc-2ca6-413a-b5b8-669a5e5abc31 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:51:22.285299 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d319e2dc-2ca6-413a-b5b8-669a5e5abc31 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:51:22.286075 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d319e2dc-2ca6-413a-b5b8-669a5e5abc31 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:51:22.286579 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d319e2dc-2ca6-413a-b5b8-669a5e5abc31 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:51:22.287018 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d319e2dc-2ca6-413a-b5b8-669a5e5abc31 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:51:22.309106 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-d319e2dc-2ca6-413a-b5b8-669a5e5abc31 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Getting quotas for project c3c1dbcc78cc4349b68eb40eb879be88. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:51:22.314763 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-d319e2dc-2ca6-413a-b5b8-669a5e5abc31 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Getting quotas for user 80a96d23b9a84b03a0549f1d57be4779 and project c3c1dbcc78cc4349b68eb40eb879be88. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:51:22.328380 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-d319e2dc-2ca6-413a-b5b8-669a5e5abc31 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Going to run 1 instances... {{(pid=140491) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 21:51:22.330754 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-d319e2dc-2ca6-413a-b5b8-669a5e5abc31 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] [instance: 6476864f-c49c-4231-aee3-a3184db8712d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='32814ea8-1724-4bd2-8bf1-9290c7fcf3a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140491) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 21:51:22.376454 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-d319e2dc-2ca6-413a-b5b8-669a5e5abc31 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.691058 Oct 08 21:51:22.377108 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3329/6730] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 21:51:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 692 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 08 21:51:22.389202 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-c1217254-9b2d-4890-9e02-1224d2857564 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:51:22.389884 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-c1217254-9b2d-4890-9e02-1224d2857564 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] [instance: 6476864f-c49c-4231-aee3-a3184db8712d] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:51:22.446162 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-c1217254-9b2d-4890-9e02-1224d2857564 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a96d23b9a84b03a0549f1d57be4779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c1dbcc78cc4349b68eb40eb879be88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:51:22.453917 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-c1217254-9b2d-4890-9e02-1224d2857564 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] 10.222.0.26 "GET /compute/v2.1/servers/6476864f-c49c-4231-aee3-a3184db8712d" status: 200 len: 1256 microversion: 2.1 time: 0.069112 Oct 08 21:51:22.454507 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3402/6731] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:51:22 2022] GET /compute/v2.1/servers/6476864f-c49c-4231-aee3-a3184db8712d => generated 1256 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:51:23.480883 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-d8132f7c-69f3-44c7-98aa-aa4fda452ec1 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:51:23.482987 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-d8132f7c-69f3-44c7-98aa-aa4fda452ec1 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] [instance: 6476864f-c49c-4231-aee3-a3184db8712d] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:51:23.495596 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d8132f7c-69f3-44c7-98aa-aa4fda452ec1 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:51:23.496454 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d8132f7c-69f3-44c7-98aa-aa4fda452ec1 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:51:23.496910 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d8132f7c-69f3-44c7-98aa-aa4fda452ec1 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:51:23.497682 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d8132f7c-69f3-44c7-98aa-aa4fda452ec1 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:51:23.498387 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d8132f7c-69f3-44c7-98aa-aa4fda452ec1 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:51:23.498834 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d8132f7c-69f3-44c7-98aa-aa4fda452ec1 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:51:23.579985 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-d8132f7c-69f3-44c7-98aa-aa4fda452ec1 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a96d23b9a84b03a0549f1d57be4779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c1dbcc78cc4349b68eb40eb879be88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:51:23.588653 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-d8132f7c-69f3-44c7-98aa-aa4fda452ec1 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] 10.222.0.26 "GET /compute/v2.1/servers/6476864f-c49c-4231-aee3-a3184db8712d" status: 200 len: 1326 microversion: 2.1 time: 0.115726 Oct 08 21:51:23.589269 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3330/6732] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:51:23 2022] GET /compute/v2.1/servers/6476864f-c49c-4231-aee3-a3184db8712d => generated 1326 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:51:24.611665 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-d13de3ac-9e1b-4a52-bc7e-ea4aad84db00 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:51:24.613131 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-d13de3ac-9e1b-4a52-bc7e-ea4aad84db00 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] [instance: 6476864f-c49c-4231-aee3-a3184db8712d] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:51:24.623455 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d13de3ac-9e1b-4a52-bc7e-ea4aad84db00 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:51:24.624488 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d13de3ac-9e1b-4a52-bc7e-ea4aad84db00 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:51:24.625230 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d13de3ac-9e1b-4a52-bc7e-ea4aad84db00 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:51:24.626237 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d13de3ac-9e1b-4a52-bc7e-ea4aad84db00 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:51:24.626952 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d13de3ac-9e1b-4a52-bc7e-ea4aad84db00 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:51:24.627586 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d13de3ac-9e1b-4a52-bc7e-ea4aad84db00 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:51:24.776053 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-d13de3ac-9e1b-4a52-bc7e-ea4aad84db00 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a96d23b9a84b03a0549f1d57be4779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c1dbcc78cc4349b68eb40eb879be88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:51:24.790911 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-d13de3ac-9e1b-4a52-bc7e-ea4aad84db00 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] 10.222.0.26 "GET /compute/v2.1/servers/6476864f-c49c-4231-aee3-a3184db8712d" status: 200 len: 1356 microversion: 2.1 time: 0.182898 Oct 08 21:51:24.792219 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3403/6733] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:51:24 2022] GET /compute/v2.1/servers/6476864f-c49c-4231-aee3-a3184db8712d => generated 1356 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:51:25.817137 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-24a9273b-7d11-4aed-9737-b70b973dec88 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:51:25.819420 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-24a9273b-7d11-4aed-9737-b70b973dec88 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] [instance: 6476864f-c49c-4231-aee3-a3184db8712d] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:51:25.826679 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-24a9273b-7d11-4aed-9737-b70b973dec88 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:51:25.827293 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-24a9273b-7d11-4aed-9737-b70b973dec88 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:51:25.827776 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-24a9273b-7d11-4aed-9737-b70b973dec88 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:51:25.828497 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-24a9273b-7d11-4aed-9737-b70b973dec88 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:51:25.829002 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-24a9273b-7d11-4aed-9737-b70b973dec88 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:51:25.829463 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-24a9273b-7d11-4aed-9737-b70b973dec88 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:51:25.967260 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-24a9273b-7d11-4aed-9737-b70b973dec88 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a96d23b9a84b03a0549f1d57be4779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c1dbcc78cc4349b68eb40eb879be88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:51:25.976062 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-24a9273b-7d11-4aed-9737-b70b973dec88 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] 10.222.0.26 "GET /compute/v2.1/servers/6476864f-c49c-4231-aee3-a3184db8712d" status: 200 len: 1356 microversion: 2.1 time: 0.164158 Oct 08 21:51:25.976704 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3331/6734] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:51:25 2022] GET /compute/v2.1/servers/6476864f-c49c-4231-aee3-a3184db8712d => generated 1356 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:51:27.061993 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-7d849292-9900-4d8f-b54c-422757db5fee tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:51:27.062650 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-7d849292-9900-4d8f-b54c-422757db5fee tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] [instance: 6476864f-c49c-4231-aee3-a3184db8712d] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:51:27.076622 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7d849292-9900-4d8f-b54c-422757db5fee tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:51:27.077151 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7d849292-9900-4d8f-b54c-422757db5fee tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:51:27.077667 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7d849292-9900-4d8f-b54c-422757db5fee tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:51:27.078416 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7d849292-9900-4d8f-b54c-422757db5fee tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:51:27.078902 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7d849292-9900-4d8f-b54c-422757db5fee tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:51:27.079355 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7d849292-9900-4d8f-b54c-422757db5fee tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:51:27.216427 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-7d849292-9900-4d8f-b54c-422757db5fee tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a96d23b9a84b03a0549f1d57be4779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c1dbcc78cc4349b68eb40eb879be88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:51:27.226165 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-7d849292-9900-4d8f-b54c-422757db5fee tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] 10.222.0.26 "GET /compute/v2.1/servers/6476864f-c49c-4231-aee3-a3184db8712d" status: 200 len: 1356 microversion: 2.1 time: 0.197763 Oct 08 21:51:27.226759 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3404/6735] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:51:27 2022] GET /compute/v2.1/servers/6476864f-c49c-4231-aee3-a3184db8712d => generated 1356 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:51:28.263651 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-835f9ab0-7e49-49ce-863c-e89113b41d67 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:51:28.268317 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-835f9ab0-7e49-49ce-863c-e89113b41d67 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] [instance: 6476864f-c49c-4231-aee3-a3184db8712d] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:51:28.275853 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-835f9ab0-7e49-49ce-863c-e89113b41d67 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:51:28.276348 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-835f9ab0-7e49-49ce-863c-e89113b41d67 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:51:28.276793 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-835f9ab0-7e49-49ce-863c-e89113b41d67 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:51:28.277536 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-835f9ab0-7e49-49ce-863c-e89113b41d67 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:51:28.278021 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-835f9ab0-7e49-49ce-863c-e89113b41d67 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:51:28.278597 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-835f9ab0-7e49-49ce-863c-e89113b41d67 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:51:28.438562 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-835f9ab0-7e49-49ce-863c-e89113b41d67 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a96d23b9a84b03a0549f1d57be4779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c1dbcc78cc4349b68eb40eb879be88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:51:28.447388 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-835f9ab0-7e49-49ce-863c-e89113b41d67 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] 10.222.0.26 "GET /compute/v2.1/servers/6476864f-c49c-4231-aee3-a3184db8712d" status: 200 len: 1356 microversion: 2.1 time: 0.192439 Oct 08 21:51:28.447966 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3332/6736] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:51:28 2022] GET /compute/v2.1/servers/6476864f-c49c-4231-aee3-a3184db8712d => generated 1356 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:51:29.472179 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-4e05bcb1-1c2f-4453-8f31-7815904809f2 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:51:29.473061 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-4e05bcb1-1c2f-4453-8f31-7815904809f2 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] [instance: 6476864f-c49c-4231-aee3-a3184db8712d] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:51:29.480075 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4e05bcb1-1c2f-4453-8f31-7815904809f2 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:51:29.480692 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4e05bcb1-1c2f-4453-8f31-7815904809f2 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:51:29.481259 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4e05bcb1-1c2f-4453-8f31-7815904809f2 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:51:29.493089 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4e05bcb1-1c2f-4453-8f31-7815904809f2 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:51:29.494145 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4e05bcb1-1c2f-4453-8f31-7815904809f2 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:51:29.494734 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4e05bcb1-1c2f-4453-8f31-7815904809f2 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:51:29.645991 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-4e05bcb1-1c2f-4453-8f31-7815904809f2 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a96d23b9a84b03a0549f1d57be4779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c1dbcc78cc4349b68eb40eb879be88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:51:29.654884 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-4e05bcb1-1c2f-4453-8f31-7815904809f2 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] 10.222.0.26 "GET /compute/v2.1/servers/6476864f-c49c-4231-aee3-a3184db8712d" status: 200 len: 1356 microversion: 2.1 time: 0.186760 Oct 08 21:51:29.655462 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3405/6737] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:51:29 2022] GET /compute/v2.1/servers/6476864f-c49c-4231-aee3-a3184db8712d => generated 1356 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:51:30.683700 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-13f32fc9-0b5d-4900-8825-668b013068c1 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:51:30.684331 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-13f32fc9-0b5d-4900-8825-668b013068c1 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] [instance: 6476864f-c49c-4231-aee3-a3184db8712d] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:51:30.693121 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-13f32fc9-0b5d-4900-8825-668b013068c1 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:51:30.693667 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-13f32fc9-0b5d-4900-8825-668b013068c1 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:51:30.694126 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-13f32fc9-0b5d-4900-8825-668b013068c1 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:51:30.694923 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-13f32fc9-0b5d-4900-8825-668b013068c1 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:51:30.695346 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-13f32fc9-0b5d-4900-8825-668b013068c1 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:51:30.695951 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-13f32fc9-0b5d-4900-8825-668b013068c1 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:51:30.839958 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-13f32fc9-0b5d-4900-8825-668b013068c1 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a96d23b9a84b03a0549f1d57be4779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c1dbcc78cc4349b68eb40eb879be88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:51:30.848247 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-13f32fc9-0b5d-4900-8825-668b013068c1 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] 10.222.0.26 "GET /compute/v2.1/servers/6476864f-c49c-4231-aee3-a3184db8712d" status: 200 len: 1356 microversion: 2.1 time: 0.168560 Oct 08 21:51:30.854607 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3333/6738] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:51:30 2022] GET /compute/v2.1/servers/6476864f-c49c-4231-aee3-a3184db8712d => generated 1356 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:51:31.879021 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-c9baf3a6-dd7d-4dff-883e-62118b8cd603 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:51:31.880212 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-c9baf3a6-dd7d-4dff-883e-62118b8cd603 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] [instance: 6476864f-c49c-4231-aee3-a3184db8712d] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:51:31.888134 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c9baf3a6-dd7d-4dff-883e-62118b8cd603 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:51:31.888648 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c9baf3a6-dd7d-4dff-883e-62118b8cd603 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:51:31.889110 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c9baf3a6-dd7d-4dff-883e-62118b8cd603 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:51:31.889888 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c9baf3a6-dd7d-4dff-883e-62118b8cd603 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:51:31.890367 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c9baf3a6-dd7d-4dff-883e-62118b8cd603 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:51:31.890816 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c9baf3a6-dd7d-4dff-883e-62118b8cd603 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:51:32.026182 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-c9baf3a6-dd7d-4dff-883e-62118b8cd603 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a96d23b9a84b03a0549f1d57be4779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c1dbcc78cc4349b68eb40eb879be88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:51:32.034260 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-c9baf3a6-dd7d-4dff-883e-62118b8cd603 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] 10.222.0.26 "GET /compute/v2.1/servers/6476864f-c49c-4231-aee3-a3184db8712d" status: 200 len: 1356 microversion: 2.1 time: 0.159950 Oct 08 21:51:32.034852 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3406/6739] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:51:31 2022] GET /compute/v2.1/servers/6476864f-c49c-4231-aee3-a3184db8712d => generated 1356 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:51:33.057606 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-7b4e508b-3403-4cbc-94dc-cb33c74066dd tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:51:33.058317 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-7b4e508b-3403-4cbc-94dc-cb33c74066dd tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] [instance: 6476864f-c49c-4231-aee3-a3184db8712d] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:51:33.061357 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=2 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:51:33.062126 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=6 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:51:33.070400 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7b4e508b-3403-4cbc-94dc-cb33c74066dd tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:51:33.071164 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7b4e508b-3403-4cbc-94dc-cb33c74066dd tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:51:33.071664 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7b4e508b-3403-4cbc-94dc-cb33c74066dd tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:51:33.072492 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7b4e508b-3403-4cbc-94dc-cb33c74066dd tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:51:33.073010 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7b4e508b-3403-4cbc-94dc-cb33c74066dd tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:51:33.073514 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7b4e508b-3403-4cbc-94dc-cb33c74066dd tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:51:33.276998 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-7b4e508b-3403-4cbc-94dc-cb33c74066dd tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a96d23b9a84b03a0549f1d57be4779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c1dbcc78cc4349b68eb40eb879be88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:51:33.284974 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-7b4e508b-3403-4cbc-94dc-cb33c74066dd tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] 10.222.0.26 "GET /compute/v2.1/servers/6476864f-c49c-4231-aee3-a3184db8712d" status: 200 len: 1356 microversion: 2.1 time: 0.231435 Oct 08 21:51:33.286306 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3334/6740] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:51:33 2022] GET /compute/v2.1/servers/6476864f-c49c-4231-aee3-a3184db8712d => generated 1356 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:51:33.345228 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-f20ef3f4-e8ba-4145-ad15-10844a64ed65 req-b252e61f-0189-4cd5-9db4-2dcbe91523ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6476864f-c49c-4231-aee3-a3184db8712d", "tag": "f0bf3d14-32f1-4efc-9de5-2b455861ed88"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:51:33.359690 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=6 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:51:33.367672 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-f20ef3f4-e8ba-4145-ad15-10844a64ed65 req-b252e61f-0189-4cd5-9db4-2dcbe91523ee service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:51:33.368272 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-f20ef3f4-e8ba-4145-ad15-10844a64ed65 req-b252e61f-0189-4cd5-9db4-2dcbe91523ee service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:51:33.368774 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-f20ef3f4-e8ba-4145-ad15-10844a64ed65 req-b252e61f-0189-4cd5-9db4-2dcbe91523ee service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:51:33.382386 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-f20ef3f4-e8ba-4145-ad15-10844a64ed65 req-b252e61f-0189-4cd5-9db4-2dcbe91523ee service nova] Creating event network-changed:f0bf3d14-32f1-4efc-9de5-2b455861ed88 for instance 6476864f-c49c-4231-aee3-a3184db8712d on nch1-master-1 Oct 08 21:51:33.388034 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-f20ef3f4-e8ba-4145-ad15-10844a64ed65 req-b252e61f-0189-4cd5-9db4-2dcbe91523ee service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046530 Oct 08 21:51:33.388969 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3407/6741] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:51:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 08 21:51:34.308572 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-930b831c-5edb-4aa5-a966-56ab97885daf tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:51:34.309246 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-930b831c-5edb-4aa5-a966-56ab97885daf tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] [instance: 6476864f-c49c-4231-aee3-a3184db8712d] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:51:34.316538 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-930b831c-5edb-4aa5-a966-56ab97885daf tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:51:34.317081 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-930b831c-5edb-4aa5-a966-56ab97885daf tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:51:34.317555 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-930b831c-5edb-4aa5-a966-56ab97885daf tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:51:34.318267 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-930b831c-5edb-4aa5-a966-56ab97885daf tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:51:34.318739 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-930b831c-5edb-4aa5-a966-56ab97885daf tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:51:34.319209 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-930b831c-5edb-4aa5-a966-56ab97885daf tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:51:34.453316 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-930b831c-5edb-4aa5-a966-56ab97885daf tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a96d23b9a84b03a0549f1d57be4779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c1dbcc78cc4349b68eb40eb879be88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:51:34.461582 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-930b831c-5edb-4aa5-a966-56ab97885daf tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] 10.222.0.26 "GET /compute/v2.1/servers/6476864f-c49c-4231-aee3-a3184db8712d" status: 200 len: 1356 microversion: 2.1 time: 0.156916 Oct 08 21:51:34.462158 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3335/6742] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:51:34 2022] GET /compute/v2.1/servers/6476864f-c49c-4231-aee3-a3184db8712d => generated 1356 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:51:35.485584 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-7793ab39-bd8f-49a3-8412-4e8512e15077 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:51:35.486322 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-7793ab39-bd8f-49a3-8412-4e8512e15077 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] [instance: 6476864f-c49c-4231-aee3-a3184db8712d] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:51:35.493262 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7793ab39-bd8f-49a3-8412-4e8512e15077 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:51:35.493774 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7793ab39-bd8f-49a3-8412-4e8512e15077 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:51:35.494238 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7793ab39-bd8f-49a3-8412-4e8512e15077 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:51:35.494992 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7793ab39-bd8f-49a3-8412-4e8512e15077 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:51:35.495481 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7793ab39-bd8f-49a3-8412-4e8512e15077 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:51:35.495966 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7793ab39-bd8f-49a3-8412-4e8512e15077 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:51:35.626088 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-7793ab39-bd8f-49a3-8412-4e8512e15077 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a96d23b9a84b03a0549f1d57be4779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c1dbcc78cc4349b68eb40eb879be88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:51:35.633995 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-7793ab39-bd8f-49a3-8412-4e8512e15077 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] 10.222.0.26 "GET /compute/v2.1/servers/6476864f-c49c-4231-aee3-a3184db8712d" status: 200 len: 1356 microversion: 2.1 time: 0.153660 Oct 08 21:51:35.634577 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3408/6743] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:51:35 2022] GET /compute/v2.1/servers/6476864f-c49c-4231-aee3-a3184db8712d => generated 1356 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:51:36.655939 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-b05dafb1-4285-413c-9986-3dbab769fc83 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:51:36.656556 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-b05dafb1-4285-413c-9986-3dbab769fc83 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] [instance: 6476864f-c49c-4231-aee3-a3184db8712d] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:51:36.664135 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b05dafb1-4285-413c-9986-3dbab769fc83 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:51:36.664625 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b05dafb1-4285-413c-9986-3dbab769fc83 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:51:36.665063 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b05dafb1-4285-413c-9986-3dbab769fc83 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:51:36.665794 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b05dafb1-4285-413c-9986-3dbab769fc83 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:51:36.666253 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b05dafb1-4285-413c-9986-3dbab769fc83 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:51:36.666681 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b05dafb1-4285-413c-9986-3dbab769fc83 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:51:36.798031 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-b05dafb1-4285-413c-9986-3dbab769fc83 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a96d23b9a84b03a0549f1d57be4779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c1dbcc78cc4349b68eb40eb879be88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:51:36.805715 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-b05dafb1-4285-413c-9986-3dbab769fc83 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] 10.222.0.26 "GET /compute/v2.1/servers/6476864f-c49c-4231-aee3-a3184db8712d" status: 200 len: 1356 microversion: 2.1 time: 0.153741 Oct 08 21:51:36.806283 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3336/6744] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:51:36 2022] GET /compute/v2.1/servers/6476864f-c49c-4231-aee3-a3184db8712d => generated 1356 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:51:37.828612 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-462b8868-6995-40fb-a4ab-9a1acf9f349c tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:51:37.829176 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-462b8868-6995-40fb-a4ab-9a1acf9f349c tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] [instance: 6476864f-c49c-4231-aee3-a3184db8712d] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:51:37.836217 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-462b8868-6995-40fb-a4ab-9a1acf9f349c tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:51:37.836730 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-462b8868-6995-40fb-a4ab-9a1acf9f349c tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:51:37.837221 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-462b8868-6995-40fb-a4ab-9a1acf9f349c tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:51:37.837951 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-462b8868-6995-40fb-a4ab-9a1acf9f349c tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:51:37.838434 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-462b8868-6995-40fb-a4ab-9a1acf9f349c tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:51:37.838885 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-462b8868-6995-40fb-a4ab-9a1acf9f349c tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:51:37.973429 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-462b8868-6995-40fb-a4ab-9a1acf9f349c tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a96d23b9a84b03a0549f1d57be4779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c1dbcc78cc4349b68eb40eb879be88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:51:37.981375 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-462b8868-6995-40fb-a4ab-9a1acf9f349c tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] 10.222.0.26 "GET /compute/v2.1/servers/6476864f-c49c-4231-aee3-a3184db8712d" status: 200 len: 1356 microversion: 2.1 time: 0.156716 Oct 08 21:51:37.981960 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3409/6745] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:51:37 2022] GET /compute/v2.1/servers/6476864f-c49c-4231-aee3-a3184db8712d => generated 1356 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:51:39.003889 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-953473b4-ccc8-472b-aaea-7e514bac7248 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:51:39.005080 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-953473b4-ccc8-472b-aaea-7e514bac7248 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] [instance: 6476864f-c49c-4231-aee3-a3184db8712d] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:51:39.019212 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-953473b4-ccc8-472b-aaea-7e514bac7248 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:51:39.019704 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-953473b4-ccc8-472b-aaea-7e514bac7248 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:51:39.020152 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-953473b4-ccc8-472b-aaea-7e514bac7248 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:51:39.020849 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-953473b4-ccc8-472b-aaea-7e514bac7248 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:51:39.021338 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-953473b4-ccc8-472b-aaea-7e514bac7248 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:51:39.021768 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-953473b4-ccc8-472b-aaea-7e514bac7248 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:51:39.156060 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-953473b4-ccc8-472b-aaea-7e514bac7248 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a96d23b9a84b03a0549f1d57be4779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c1dbcc78cc4349b68eb40eb879be88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:51:39.163762 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-953473b4-ccc8-472b-aaea-7e514bac7248 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] 10.222.0.26 "GET /compute/v2.1/servers/6476864f-c49c-4231-aee3-a3184db8712d" status: 200 len: 1356 microversion: 2.1 time: 0.163795 Oct 08 21:51:39.164331 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3337/6746] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:51:38 2022] GET /compute/v2.1/servers/6476864f-c49c-4231-aee3-a3184db8712d => generated 1356 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:51:39.639613 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-67bfb8ed-a74f-4490-adaa-a71a5cec976c req-fd65d8f4-cef9-4dfa-97f4-9d70511f6d14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6476864f-c49c-4231-aee3-a3184db8712d", "name": "network-vif-plugged", "status": "completed", "tag": "f0bf3d14-32f1-4efc-9de5-2b455861ed88"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:51:39.653915 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-67bfb8ed-a74f-4490-adaa-a71a5cec976c req-fd65d8f4-cef9-4dfa-97f4-9d70511f6d14 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:51:39.654432 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-67bfb8ed-a74f-4490-adaa-a71a5cec976c req-fd65d8f4-cef9-4dfa-97f4-9d70511f6d14 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:51:39.654898 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-67bfb8ed-a74f-4490-adaa-a71a5cec976c req-fd65d8f4-cef9-4dfa-97f4-9d70511f6d14 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:51:39.666997 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-67bfb8ed-a74f-4490-adaa-a71a5cec976c req-fd65d8f4-cef9-4dfa-97f4-9d70511f6d14 service nova] Creating event network-vif-plugged:f0bf3d14-32f1-4efc-9de5-2b455861ed88 for instance 6476864f-c49c-4231-aee3-a3184db8712d on nch1-master-1 Oct 08 21:51:39.672248 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-67bfb8ed-a74f-4490-adaa-a71a5cec976c req-fd65d8f4-cef9-4dfa-97f4-9d70511f6d14 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036503 Oct 08 21:51:39.672891 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3410/6747] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:51:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:51:40.186965 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-74ec0504-5001-482e-90ac-9127aa4253f4 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:51:40.187500 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-74ec0504-5001-482e-90ac-9127aa4253f4 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] [instance: 6476864f-c49c-4231-aee3-a3184db8712d] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:51:40.195317 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-74ec0504-5001-482e-90ac-9127aa4253f4 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:51:40.195819 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-74ec0504-5001-482e-90ac-9127aa4253f4 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:51:40.196271 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-74ec0504-5001-482e-90ac-9127aa4253f4 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:51:40.196983 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-74ec0504-5001-482e-90ac-9127aa4253f4 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:51:40.197489 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-74ec0504-5001-482e-90ac-9127aa4253f4 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:51:40.197933 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-74ec0504-5001-482e-90ac-9127aa4253f4 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:51:40.326507 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-74ec0504-5001-482e-90ac-9127aa4253f4 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a96d23b9a84b03a0549f1d57be4779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c1dbcc78cc4349b68eb40eb879be88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:51:40.334959 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-74ec0504-5001-482e-90ac-9127aa4253f4 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] 10.222.0.26 "GET /compute/v2.1/servers/6476864f-c49c-4231-aee3-a3184db8712d" status: 200 len: 1356 microversion: 2.1 time: 0.152112 Oct 08 21:51:40.335538 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3338/6748] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:51:40 2022] GET /compute/v2.1/servers/6476864f-c49c-4231-aee3-a3184db8712d => generated 1356 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:51:41.359308 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-6d655b66-4cdb-42cb-90c4-7c3ab4378af6 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:51:41.359963 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-6d655b66-4cdb-42cb-90c4-7c3ab4378af6 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] [instance: 6476864f-c49c-4231-aee3-a3184db8712d] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:51:41.366335 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6d655b66-4cdb-42cb-90c4-7c3ab4378af6 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:51:41.366853 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6d655b66-4cdb-42cb-90c4-7c3ab4378af6 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:51:41.367328 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6d655b66-4cdb-42cb-90c4-7c3ab4378af6 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:51:41.368059 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6d655b66-4cdb-42cb-90c4-7c3ab4378af6 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:51:41.368548 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6d655b66-4cdb-42cb-90c4-7c3ab4378af6 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:51:41.369009 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6d655b66-4cdb-42cb-90c4-7c3ab4378af6 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:51:41.501310 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-6d655b66-4cdb-42cb-90c4-7c3ab4378af6 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a96d23b9a84b03a0549f1d57be4779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c1dbcc78cc4349b68eb40eb879be88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:51:41.509263 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-6d655b66-4cdb-42cb-90c4-7c3ab4378af6 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] 10.222.0.26 "GET /compute/v2.1/servers/6476864f-c49c-4231-aee3-a3184db8712d" status: 200 len: 1546 microversion: 2.1 time: 0.155268 Oct 08 21:51:41.509847 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3411/6749] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:51:41 2022] GET /compute/v2.1/servers/6476864f-c49c-4231-aee3-a3184db8712d => generated 1546 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:51:41.531416 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-5ff4c199-f2e7-41aa-b546-75e4e5482b11 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:51:41.532049 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-5ff4c199-f2e7-41aa-b546-75e4e5482b11 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] [instance: 6476864f-c49c-4231-aee3-a3184db8712d] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:51:41.539512 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5ff4c199-f2e7-41aa-b546-75e4e5482b11 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:51:41.540007 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5ff4c199-f2e7-41aa-b546-75e4e5482b11 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:51:41.540455 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5ff4c199-f2e7-41aa-b546-75e4e5482b11 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:51:41.541159 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5ff4c199-f2e7-41aa-b546-75e4e5482b11 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:51:41.541648 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5ff4c199-f2e7-41aa-b546-75e4e5482b11 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:51:41.542086 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5ff4c199-f2e7-41aa-b546-75e4e5482b11 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:51:41.675397 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-5ff4c199-f2e7-41aa-b546-75e4e5482b11 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a96d23b9a84b03a0549f1d57be4779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c1dbcc78cc4349b68eb40eb879be88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:51:41.684042 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-5ff4c199-f2e7-41aa-b546-75e4e5482b11 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] 10.222.0.26 "GET /compute/v2.1/servers/6476864f-c49c-4231-aee3-a3184db8712d" status: 200 len: 1546 microversion: 2.1 time: 0.156458 Oct 08 21:51:41.684649 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3339/6750] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:51:41 2022] GET /compute/v2.1/servers/6476864f-c49c-4231-aee3-a3184db8712d => generated 1546 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:51:41.705786 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-6abd1dc2-0479-45df-8ea3-0d4a49cf18a6 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:51:41.710597 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-6abd1dc2-0479-45df-8ea3-0d4a49cf18a6 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '80a96d23b9a84b03a0549f1d57be4779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c1dbcc78cc4349b68eb40eb879be88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:51:41.711387 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-6abd1dc2-0479-45df-8ea3-0d4a49cf18a6 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Searching by: {'deleted': False, 'project_id': 'c3c1dbcc78cc4349b68eb40eb879be88'} {{(pid=140492) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 08 21:51:41.716806 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6abd1dc2-0479-45df-8ea3-0d4a49cf18a6 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:51:41.717344 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6abd1dc2-0479-45df-8ea3-0d4a49cf18a6 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:51:41.717800 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6abd1dc2-0479-45df-8ea3-0d4a49cf18a6 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:51:41.718547 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6abd1dc2-0479-45df-8ea3-0d4a49cf18a6 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:51:41.719043 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6abd1dc2-0479-45df-8ea3-0d4a49cf18a6 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:51:41.719473 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6abd1dc2-0479-45df-8ea3-0d4a49cf18a6 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:51:41.746944 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.multi_cell_list [None req-6abd1dc2-0479-45df-8ea3-0d4a49cf18a6 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=140492) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 08 21:51:41.774722 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-6abd1dc2-0479-45df-8ea3-0d4a49cf18a6 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] 10.222.0.26 "GET /compute/v2.1/servers" status: 200 len: 341 microversion: 2.1 time: 0.072752 Oct 08 21:51:41.775321 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3412/6751] 10.222.0.26 () {58 vars in 1125 bytes} [Sat Oct 8 21:51:41 2022] GET /compute/v2.1/servers => generated 341 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:51:41.787786 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-31b5e733-5e99-4c8c-999b-13eff574073e tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:51:41.788405 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-31b5e733-5e99-4c8c-999b-13eff574073e tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] [instance: 6476864f-c49c-4231-aee3-a3184db8712d] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:51:41.794492 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-31b5e733-5e99-4c8c-999b-13eff574073e tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:51:41.794986 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-31b5e733-5e99-4c8c-999b-13eff574073e tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:51:41.795433 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-31b5e733-5e99-4c8c-999b-13eff574073e tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:51:41.796137 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-31b5e733-5e99-4c8c-999b-13eff574073e tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:51:41.796599 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-31b5e733-5e99-4c8c-999b-13eff574073e tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:51:41.797030 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-31b5e733-5e99-4c8c-999b-13eff574073e tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:51:41.923672 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-31b5e733-5e99-4c8c-999b-13eff574073e tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a96d23b9a84b03a0549f1d57be4779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c1dbcc78cc4349b68eb40eb879be88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:51:41.932298 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-31b5e733-5e99-4c8c-999b-13eff574073e tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] 10.222.0.26 "GET /compute/v2.1/servers/6476864f-c49c-4231-aee3-a3184db8712d" status: 200 len: 1546 microversion: 2.1 time: 0.149216 Oct 08 21:51:41.932872 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3340/6752] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:51:41 2022] GET /compute/v2.1/servers/6476864f-c49c-4231-aee3-a3184db8712d => generated 1546 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:51:43.474562 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-5667dd56-e0a5-4f29-9f12-a19eedec9c61 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e43bda1c-c18a-48a3-81f9-12a65dd43532"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:51:43.477009 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-5667dd56-e0a5-4f29-9f12-a19eedec9c61 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] [instance: 6476864f-c49c-4231-aee3-a3184db8712d] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:51:43.484162 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5667dd56-e0a5-4f29-9f12-a19eedec9c61 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:51:43.484670 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5667dd56-e0a5-4f29-9f12-a19eedec9c61 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:51:43.485129 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5667dd56-e0a5-4f29-9f12-a19eedec9c61 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:51:43.485875 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5667dd56-e0a5-4f29-9f12-a19eedec9c61 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:51:43.486353 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5667dd56-e0a5-4f29-9f12-a19eedec9c61 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:51:43.486797 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5667dd56-e0a5-4f29-9f12-a19eedec9c61 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:51:43.729948 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-5667dd56-e0a5-4f29-9f12-a19eedec9c61 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] 10.222.0.26 "POST /compute/v2.1/servers/6476864f-c49c-4231-aee3-a3184db8712d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.259790 Oct 08 21:51:43.730601 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3413/6753] 10.222.0.26 () {60 vars in 1323 bytes} [Sat Oct 8 21:51:43 2022] POST /compute/v2.1/servers/6476864f-c49c-4231-aee3-a3184db8712d/os-volume_attachments => generated 194 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:51:48.330860 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-0802b49c-e451-4783-a7d5-423f2cd02891 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:51:48.331510 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-0802b49c-e451-4783-a7d5-423f2cd02891 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] [instance: 6476864f-c49c-4231-aee3-a3184db8712d] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:51:48.338699 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0802b49c-e451-4783-a7d5-423f2cd02891 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:51:48.339193 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0802b49c-e451-4783-a7d5-423f2cd02891 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:51:48.339633 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0802b49c-e451-4783-a7d5-423f2cd02891 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:51:48.340334 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0802b49c-e451-4783-a7d5-423f2cd02891 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:51:48.340799 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0802b49c-e451-4783-a7d5-423f2cd02891 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:51:48.341257 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0802b49c-e451-4783-a7d5-423f2cd02891 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:51:48.475087 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-0802b49c-e451-4783-a7d5-423f2cd02891 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a96d23b9a84b03a0549f1d57be4779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c1dbcc78cc4349b68eb40eb879be88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:51:48.483728 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-0802b49c-e451-4783-a7d5-423f2cd02891 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] 10.222.0.26 "GET /compute/v2.1/servers/6476864f-c49c-4231-aee3-a3184db8712d" status: 200 len: 1592 microversion: 2.1 time: 0.156755 Oct 08 21:51:48.484297 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3341/6754] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:51:48 2022] GET /compute/v2.1/servers/6476864f-c49c-4231-aee3-a3184db8712d => generated 1592 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:51:50.109945 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-ff98dcb2-234a-4b8b-afb4-9059be9645d5 req-f1d92d1c-60ee-4ffb-a8f5-7f91a2ef3c95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6476864f-c49c-4231-aee3-a3184db8712d", "tag": "f0bf3d14-32f1-4efc-9de5-2b455861ed88"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:51:50.121719 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-ff98dcb2-234a-4b8b-afb4-9059be9645d5 req-f1d92d1c-60ee-4ffb-a8f5-7f91a2ef3c95 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:51:50.122239 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-ff98dcb2-234a-4b8b-afb4-9059be9645d5 req-f1d92d1c-60ee-4ffb-a8f5-7f91a2ef3c95 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:51:50.123032 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-ff98dcb2-234a-4b8b-afb4-9059be9645d5 req-f1d92d1c-60ee-4ffb-a8f5-7f91a2ef3c95 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:51:50.135331 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-ff98dcb2-234a-4b8b-afb4-9059be9645d5 req-f1d92d1c-60ee-4ffb-a8f5-7f91a2ef3c95 service nova] Creating event network-changed:f0bf3d14-32f1-4efc-9de5-2b455861ed88 for instance 6476864f-c49c-4231-aee3-a3184db8712d on nch1-master-1 Oct 08 21:51:50.140409 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-ff98dcb2-234a-4b8b-afb4-9059be9645d5 req-f1d92d1c-60ee-4ffb-a8f5-7f91a2ef3c95 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035682 Oct 08 21:51:50.141423 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3414/6755] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:51:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:51:51.111896 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-bfce5206-ead9-499d-a9e1-b7e9d598139e tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-2077762925"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:51:51.112450 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-bfce5206-ead9-499d-a9e1-b7e9d598139e tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] [instance: 6476864f-c49c-4231-aee3-a3184db8712d] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:51:51.120110 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bfce5206-ead9-499d-a9e1-b7e9d598139e tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:51:51.120600 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bfce5206-ead9-499d-a9e1-b7e9d598139e tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:51:51.121043 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bfce5206-ead9-499d-a9e1-b7e9d598139e tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:51:51.121856 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bfce5206-ead9-499d-a9e1-b7e9d598139e tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:51:51.123534 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bfce5206-ead9-499d-a9e1-b7e9d598139e tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:51:51.123843 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-bfce5206-ead9-499d-a9e1-b7e9d598139e tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:51:51.539469 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.network.security_group_api [None req-bfce5206-ead9-499d-a9e1-b7e9d598139e tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Adding security group 5c904cf7-a940-47c5-ac45-b604718ca8ff to port f0bf3d14-32f1-4efc-9de5-2b455861ed88 Oct 08 21:51:51.844260 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-bfce5206-ead9-499d-a9e1-b7e9d598139e tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] 10.222.0.26 "POST /compute/v2.1/servers/6476864f-c49c-4231-aee3-a3184db8712d/action" status: 202 len: 0 microversion: 2.1 time: 0.736253 Oct 08 21:51:51.845054 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3342/6756] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:51:51 2022] POST /compute/v2.1/servers/6476864f-c49c-4231-aee3-a3184db8712d/action => generated 0 bytes in 738 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 21:51:51.851819 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=2 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:51:51.856354 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-aaf3747c-9276-49d6-b3d5-eef79f66de02 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:51:51.857138 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-aaf3747c-9276-49d6-b3d5-eef79f66de02 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] [instance: 6476864f-c49c-4231-aee3-a3184db8712d] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:51:51.862306 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:51:51.869979 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-aaf3747c-9276-49d6-b3d5-eef79f66de02 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:51:51.870171 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-aaf3747c-9276-49d6-b3d5-eef79f66de02 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:51:51.870554 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-aaf3747c-9276-49d6-b3d5-eef79f66de02 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:51:51.871292 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-aaf3747c-9276-49d6-b3d5-eef79f66de02 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:51:51.872352 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-aaf3747c-9276-49d6-b3d5-eef79f66de02 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:51:51.872352 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-aaf3747c-9276-49d6-b3d5-eef79f66de02 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:51:51.875624 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:51:52.025140 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-aaf3747c-9276-49d6-b3d5-eef79f66de02 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a96d23b9a84b03a0549f1d57be4779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c1dbcc78cc4349b68eb40eb879be88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:51:52.033722 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-aaf3747c-9276-49d6-b3d5-eef79f66de02 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] 10.222.0.26 "GET /compute/v2.1/servers/6476864f-c49c-4231-aee3-a3184db8712d" status: 200 len: 1757 microversion: 2.1 time: 0.184235 Oct 08 21:51:52.034302 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3415/6757] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:51:51 2022] GET /compute/v2.1/servers/6476864f-c49c-4231-aee3-a3184db8712d => generated 1757 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:51:52.156400 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-d23e96e8-72c4-4a29-8637-2ec1584821f5 req-85e40f0d-5308-4d88-8908-046a0a3f4f08 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6476864f-c49c-4231-aee3-a3184db8712d", "tag": "f0bf3d14-32f1-4efc-9de5-2b455861ed88"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:51:52.161487 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=3 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:51:52.167917 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-d23e96e8-72c4-4a29-8637-2ec1584821f5 req-85e40f0d-5308-4d88-8908-046a0a3f4f08 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:51:52.168406 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-d23e96e8-72c4-4a29-8637-2ec1584821f5 req-85e40f0d-5308-4d88-8908-046a0a3f4f08 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:51:52.168920 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-d23e96e8-72c4-4a29-8637-2ec1584821f5 req-85e40f0d-5308-4d88-8908-046a0a3f4f08 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:51:52.173986 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=79 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:51:52.181743 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-d23e96e8-72c4-4a29-8637-2ec1584821f5 req-85e40f0d-5308-4d88-8908-046a0a3f4f08 service nova] Creating event network-changed:f0bf3d14-32f1-4efc-9de5-2b455861ed88 for instance 6476864f-c49c-4231-aee3-a3184db8712d on nch1-master-1 Oct 08 21:51:52.186890 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-d23e96e8-72c4-4a29-8637-2ec1584821f5 req-85e40f0d-5308-4d88-8908-046a0a3f4f08 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035194 Oct 08 21:51:52.187822 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3343/6758] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:51:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:54:10.870874 ncdv-master-1 devstack@n-api.service[140492]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a92ae347-69e9-4ac8-bb66-e8def9f99758] AMQP server on 10.222.0.26:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 08 21:54:10.875767 ncdv-master-1 devstack@n-api.service[140492]: ERROR oslo.messaging._drivers.impl_rabbit [-] [bab1eda8-a2f4-4cbf-a1fb-a5a6d7c2688e] AMQP server on 10.222.0.26:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 08 21:54:10.875767 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=1 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:54:10.875767 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=5 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:54:10.875767 ncdv-master-1 devstack@n-api.service[140492]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 08 21:54:10.875767 ncdv-master-1 devstack@n-api.service[140492]: Sat Oct 8 21:54:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6476864f-c49c-4231-aee3-a3184db8712d/action (ip 10.222.0.26) !!! Oct 08 21:54:10.875767 ncdv-master-1 devstack@n-api.service[140492]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 08 21:54:10.875767 ncdv-master-1 devstack@n-api.service[140492]: Sat Oct 8 21:54:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6476864f-c49c-4231-aee3-a3184db8712d/action (ip 10.222.0.26) !!! Oct 08 21:54:10.876788 ncdv-master-1 devstack@n-api.service[140492]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 08 21:54:10.876895 ncdv-master-1 devstack@n-api.service[140492]: Sat Oct 8 21:54:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6476864f-c49c-4231-aee3-a3184db8712d/action (ip 10.222.0.26) !!! Oct 08 21:54:10.883118 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-be950e08-65de-4a20-873e-e3608dda8738 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:54:10.885407 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-be950e08-65de-4a20-873e-e3608dda8738 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] [instance: 6476864f-c49c-4231-aee3-a3184db8712d] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:54:10.895770 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-be950e08-65de-4a20-873e-e3608dda8738 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:54:10.896275 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-be950e08-65de-4a20-873e-e3608dda8738 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:54:10.897504 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-be950e08-65de-4a20-873e-e3608dda8738 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:54:10.898464 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-be950e08-65de-4a20-873e-e3608dda8738 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:54:10.898947 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-be950e08-65de-4a20-873e-e3608dda8738 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:54:10.899406 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-be950e08-65de-4a20-873e-e3608dda8738 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:54:10.973460 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-be950e08-65de-4a20-873e-e3608dda8738 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] 10.222.0.26 "POST /compute/v2.1/servers/6476864f-c49c-4231-aee3-a3184db8712d/action" status: 202 len: 0 microversion: 2.1 time: 0.104012 Oct 08 21:54:10.974099 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3416/6759] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:54:10 2022] POST /compute/v2.1/servers/6476864f-c49c-4231-aee3-a3184db8712d/action => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 21:54:10.980418 ncdv-master-1 devstack@n-api.service[140491]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5b834fae-ca0a-46cb-bcaa-52f744fce5f9] AMQP server on 10.222.0.26:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 08 21:54:10.981307 ncdv-master-1 devstack@n-api.service[140491]: ERROR oslo.messaging._drivers.impl_rabbit [-] [389347c8-adfb-4c72-885b-6416d41737c1] AMQP server on 10.222.0.26:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 08 21:54:10.981837 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:SELECT=1 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:54:10.982579 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=1 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:54:10.984347 ncdv-master-1 devstack@n-api.service[140491]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 08 21:54:10.984493 ncdv-master-1 devstack@n-api.service[140491]: Sat Oct 8 21:54:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6476864f-c49c-4231-aee3-a3184db8712d (ip 10.222.0.26) !!! Oct 08 21:54:10.991588 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-8584db69-0cde-46a9-b72b-13ff313e3474 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:54:10.992300 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-8584db69-0cde-46a9-b72b-13ff313e3474 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] [instance: 6476864f-c49c-4231-aee3-a3184db8712d] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:54:11.005022 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8584db69-0cde-46a9-b72b-13ff313e3474 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:54:11.005538 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8584db69-0cde-46a9-b72b-13ff313e3474 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:54:11.005985 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8584db69-0cde-46a9-b72b-13ff313e3474 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:54:11.007261 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8584db69-0cde-46a9-b72b-13ff313e3474 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:54:11.007724 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8584db69-0cde-46a9-b72b-13ff313e3474 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:54:11.008162 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8584db69-0cde-46a9-b72b-13ff313e3474 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:54:11.245766 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-8584db69-0cde-46a9-b72b-13ff313e3474 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a96d23b9a84b03a0549f1d57be4779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c1dbcc78cc4349b68eb40eb879be88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:54:11.254259 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-8584db69-0cde-46a9-b72b-13ff313e3474 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] 10.222.0.26 "GET /compute/v2.1/servers/6476864f-c49c-4231-aee3-a3184db8712d" status: 200 len: 1759 microversion: 2.1 time: 0.275637 Oct 08 21:54:11.254860 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3344/6760] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:54:10 2022] GET /compute/v2.1/servers/6476864f-c49c-4231-aee3-a3184db8712d => generated 1759 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:54:12.281666 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-04c829d6-47f6-4177-ac35-c7acada3334d tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:54:12.283002 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-04c829d6-47f6-4177-ac35-c7acada3334d tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] [instance: 6476864f-c49c-4231-aee3-a3184db8712d] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:54:12.292209 ncdv-master-1 devstack@n-api.service[140492]: INFO oslo.messaging._drivers.impl_rabbit [-] [a92ae347-69e9-4ac8-bb66-e8def9f99758] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 37396. Oct 08 21:54:12.292932 ncdv-master-1 devstack@n-api.service[140492]: INFO oslo.messaging._drivers.impl_rabbit [-] [bab1eda8-a2f4-4cbf-a1fb-a5a6d7c2688e] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 37398. Oct 08 21:54:12.297900 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-04c829d6-47f6-4177-ac35-c7acada3334d tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:54:12.298422 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-04c829d6-47f6-4177-ac35-c7acada3334d tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:54:12.298892 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-04c829d6-47f6-4177-ac35-c7acada3334d tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:54:12.299635 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-04c829d6-47f6-4177-ac35-c7acada3334d tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:54:12.300123 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-04c829d6-47f6-4177-ac35-c7acada3334d tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:54:12.300583 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-04c829d6-47f6-4177-ac35-c7acada3334d tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:54:12.453717 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-04c829d6-47f6-4177-ac35-c7acada3334d tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a96d23b9a84b03a0549f1d57be4779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c1dbcc78cc4349b68eb40eb879be88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:54:12.462741 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-04c829d6-47f6-4177-ac35-c7acada3334d tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] 10.222.0.26 "GET /compute/v2.1/servers/6476864f-c49c-4231-aee3-a3184db8712d" status: 200 len: 1757 microversion: 2.1 time: 0.188318 Oct 08 21:54:12.463326 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3417/6761] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:54:12 2022] GET /compute/v2.1/servers/6476864f-c49c-4231-aee3-a3184db8712d => generated 1757 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:55:27.040576 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-684d0c05-b604-4da1-acd0-0bf6144553cd tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-2077762925"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:55:27.041235 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-684d0c05-b604-4da1-acd0-0bf6144553cd tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] [instance: 6476864f-c49c-4231-aee3-a3184db8712d] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:55:27.045048 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:SELECT=2 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:55:27.045822 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=6 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:55:27.053826 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-684d0c05-b604-4da1-acd0-0bf6144553cd tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:55:27.054353 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-684d0c05-b604-4da1-acd0-0bf6144553cd tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:55:27.054803 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-684d0c05-b604-4da1-acd0-0bf6144553cd tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:55:27.055525 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-684d0c05-b604-4da1-acd0-0bf6144553cd tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:55:27.055991 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-684d0c05-b604-4da1-acd0-0bf6144553cd tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:55:27.056445 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-684d0c05-b604-4da1-acd0-0bf6144553cd tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:55:27.061079 ncdv-master-1 devstack@n-api.service[140491]: INFO oslo.messaging._drivers.impl_rabbit [-] [389347c8-adfb-4c72-885b-6416d41737c1] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 37448. Oct 08 21:55:27.064216 ncdv-master-1 devstack@n-api.service[140491]: INFO oslo.messaging._drivers.impl_rabbit [-] [5b834fae-ca0a-46cb-bcaa-52f744fce5f9] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 37446. Oct 08 21:55:27.320395 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.network.security_group_api [None req-684d0c05-b604-4da1-acd0-0bf6144553cd tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Removing security group 5c904cf7-a940-47c5-ac45-b604718ca8ff from port f0bf3d14-32f1-4efc-9de5-2b455861ed88 Oct 08 21:55:27.626051 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-684d0c05-b604-4da1-acd0-0bf6144553cd tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] 10.222.0.26 "POST /compute/v2.1/servers/6476864f-c49c-4231-aee3-a3184db8712d/action" status: 202 len: 0 microversion: 2.1 time: 0.590059 Oct 08 21:55:27.626700 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3345/6762] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:55:27 2022] POST /compute/v2.1/servers/6476864f-c49c-4231-aee3-a3184db8712d/action => generated 0 bytes in 591 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 21:55:27.640498 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=4 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:55:27.641552 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:55:27.729903 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-d7392805-7231-47d7-92c0-56632fbfe52f req-e4091ffd-2c80-4133-bfa8-b9da007a6052 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6476864f-c49c-4231-aee3-a3184db8712d", "tag": "f0bf3d14-32f1-4efc-9de5-2b455861ed88"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:55:27.739619 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-d7392805-7231-47d7-92c0-56632fbfe52f req-e4091ffd-2c80-4133-bfa8-b9da007a6052 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:55:27.740129 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-d7392805-7231-47d7-92c0-56632fbfe52f req-e4091ffd-2c80-4133-bfa8-b9da007a6052 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:55:27.740593 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-d7392805-7231-47d7-92c0-56632fbfe52f req-e4091ffd-2c80-4133-bfa8-b9da007a6052 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:55:27.753467 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-d7392805-7231-47d7-92c0-56632fbfe52f req-e4091ffd-2c80-4133-bfa8-b9da007a6052 service nova] Creating event network-changed:f0bf3d14-32f1-4efc-9de5-2b455861ed88 for instance 6476864f-c49c-4231-aee3-a3184db8712d on nch1-master-1 Oct 08 21:55:27.758907 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-d7392805-7231-47d7-92c0-56632fbfe52f req-e4091ffd-2c80-4133-bfa8-b9da007a6052 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125442 Oct 08 21:55:27.760404 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3418/6763] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:55:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:55:28.752760 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-67c06a0d-1a2e-4297-8382-ec62455e8c47 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:55:28.753436 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-67c06a0d-1a2e-4297-8382-ec62455e8c47 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] [instance: 6476864f-c49c-4231-aee3-a3184db8712d] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:55:28.760542 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-67c06a0d-1a2e-4297-8382-ec62455e8c47 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:55:28.761393 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-67c06a0d-1a2e-4297-8382-ec62455e8c47 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:55:28.762146 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-67c06a0d-1a2e-4297-8382-ec62455e8c47 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:55:28.763063 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-67c06a0d-1a2e-4297-8382-ec62455e8c47 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:55:28.763730 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-67c06a0d-1a2e-4297-8382-ec62455e8c47 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:55:28.764342 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-67c06a0d-1a2e-4297-8382-ec62455e8c47 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:55:28.772190 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-11cccbe3-c730-4cd9-b207-81e0f4bcc0d3 req-ea94b3b1-910d-4773-8b02-213a99e9a950 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6476864f-c49c-4231-aee3-a3184db8712d", "tag": "f0bf3d14-32f1-4efc-9de5-2b455861ed88"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:55:28.782840 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-11cccbe3-c730-4cd9-b207-81e0f4bcc0d3 req-ea94b3b1-910d-4773-8b02-213a99e9a950 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:55:28.783628 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-11cccbe3-c730-4cd9-b207-81e0f4bcc0d3 req-ea94b3b1-910d-4773-8b02-213a99e9a950 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:55:28.784352 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-11cccbe3-c730-4cd9-b207-81e0f4bcc0d3 req-ea94b3b1-910d-4773-8b02-213a99e9a950 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:55:28.797735 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-11cccbe3-c730-4cd9-b207-81e0f4bcc0d3 req-ea94b3b1-910d-4773-8b02-213a99e9a950 service nova] Creating event network-changed:f0bf3d14-32f1-4efc-9de5-2b455861ed88 for instance 6476864f-c49c-4231-aee3-a3184db8712d on nch1-master-1 Oct 08 21:55:28.801684 ncdv-master-1 devstack@n-api.service[140491]: ERROR oslo.messaging._drivers.impl_rabbit [req-11cccbe3-c730-4cd9-b207-81e0f4bcc0d3 req-ea94b3b1-910d-4773-8b02-213a99e9a950 service nova] [0b833e33-9b8b-4ffb-a634-9f8a27ebd715] AMQP server on 10.222.0.26:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 08 21:55:28.989326 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.objects.instance [None req-67c06a0d-1a2e-4297-8382-ec62455e8c47 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lazy-loading 'services' on Instance uuid 6476864f-c49c-4231-aee3-a3184db8712d {{(pid=140492) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 21:55:29.067527 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-67c06a0d-1a2e-4297-8382-ec62455e8c47 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] 10.222.0.26 "DELETE /compute/v2.1/servers/6476864f-c49c-4231-aee3-a3184db8712d/os-volume_attachments/e43bda1c-c18a-48a3-81f9-12a65dd43532" status: 202 len: 0 microversion: 2.1 time: 0.320652 Oct 08 21:55:29.068138 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3419/6764] 10.222.0.26 () {58 vars in 1416 bytes} [Sat Oct 8 21:55:28 2022] DELETE /compute/v2.1/servers/6476864f-c49c-4231-aee3-a3184db8712d/os-volume_attachments/e43bda1c-c18a-48a3-81f9-12a65dd43532 => generated 0 bytes in 322 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 08 21:55:29.083908 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-f45d06b0-ef9a-4224-b1bf-ec97e557d287 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:55:29.086294 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-f45d06b0-ef9a-4224-b1bf-ec97e557d287 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] [instance: 6476864f-c49c-4231-aee3-a3184db8712d] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:55:29.096838 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f45d06b0-ef9a-4224-b1bf-ec97e557d287 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:55:29.097387 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f45d06b0-ef9a-4224-b1bf-ec97e557d287 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:55:29.097850 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f45d06b0-ef9a-4224-b1bf-ec97e557d287 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:55:29.098586 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f45d06b0-ef9a-4224-b1bf-ec97e557d287 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:55:29.099068 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f45d06b0-ef9a-4224-b1bf-ec97e557d287 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:55:29.099516 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f45d06b0-ef9a-4224-b1bf-ec97e557d287 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:55:29.131813 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-f45d06b0-ef9a-4224-b1bf-ec97e557d287 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] 10.222.0.26 "GET /compute/v2.1/servers/6476864f-c49c-4231-aee3-a3184db8712d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052300 Oct 08 21:55:29.132405 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3420/6765] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Oct 8 21:55:29 2022] GET /compute/v2.1/servers/6476864f-c49c-4231-aee3-a3184db8712d/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:55:29.809813 ncdv-master-1 devstack@n-api.service[140491]: INFO oslo.messaging._drivers.impl_rabbit [req-11cccbe3-c730-4cd9-b207-81e0f4bcc0d3 req-ea94b3b1-910d-4773-8b02-213a99e9a950 service nova] [0b833e33-9b8b-4ffb-a634-9f8a27ebd715] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 37494. Oct 08 21:55:29.814078 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-11cccbe3-c730-4cd9-b207-81e0f4bcc0d3 req-ea94b3b1-910d-4773-8b02-213a99e9a950 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.113338 Oct 08 21:55:29.814711 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3346/6766] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:55:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:55:30.145392 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-6a502ea7-fcc3-4c58-bd3c-391be213c08e tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:55:30.147738 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-6a502ea7-fcc3-4c58-bd3c-391be213c08e tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] [instance: 6476864f-c49c-4231-aee3-a3184db8712d] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:55:30.155378 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6a502ea7-fcc3-4c58-bd3c-391be213c08e tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:55:30.155888 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6a502ea7-fcc3-4c58-bd3c-391be213c08e tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:55:30.156345 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6a502ea7-fcc3-4c58-bd3c-391be213c08e tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:55:30.157078 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6a502ea7-fcc3-4c58-bd3c-391be213c08e tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:55:30.157585 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6a502ea7-fcc3-4c58-bd3c-391be213c08e tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:55:30.158114 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6a502ea7-fcc3-4c58-bd3c-391be213c08e tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:55:30.188003 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-6a502ea7-fcc3-4c58-bd3c-391be213c08e tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] 10.222.0.26 "GET /compute/v2.1/servers/6476864f-c49c-4231-aee3-a3184db8712d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046408 Oct 08 21:55:30.188580 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3421/6767] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Oct 8 21:55:30 2022] GET /compute/v2.1/servers/6476864f-c49c-4231-aee3-a3184db8712d/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 08 21:55:30.201025 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-1f394031-0dcf-4783-b678-868d0a4a68fd tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:55:30.201668 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-1f394031-0dcf-4783-b678-868d0a4a68fd tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] [instance: 6476864f-c49c-4231-aee3-a3184db8712d] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:55:30.208138 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1f394031-0dcf-4783-b678-868d0a4a68fd tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:55:30.208866 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1f394031-0dcf-4783-b678-868d0a4a68fd tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:55:30.209360 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1f394031-0dcf-4783-b678-868d0a4a68fd tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:55:30.210081 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1f394031-0dcf-4783-b678-868d0a4a68fd tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:55:30.210553 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1f394031-0dcf-4783-b678-868d0a4a68fd tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:55:30.211092 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1f394031-0dcf-4783-b678-868d0a4a68fd tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:55:30.286781 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-1f394031-0dcf-4783-b678-868d0a4a68fd tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] HTTP exception thrown: Instance 6476864f-c49c-4231-aee3-a3184db8712d is not attached to volume e43bda1c-c18a-48a3-81f9-12a65dd43532 Oct 08 21:55:30.301421 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-1f394031-0dcf-4783-b678-868d0a4a68fd tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Request method failure captured: Oct 08 21:55:30.301421 ncdv-master-1 devstack@n-api.service[140491]: request: DELETE /compute/v2.1/servers/6476864f-c49c-4231-aee3-a3184db8712d/os-volume_attachments/e43bda1c-c18a-48a3-81f9-12a65dd43532 HTTP/1.1 Oct 08 21:55:30.301421 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:55:30.301421 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:55:30.301421 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:55:30.301421 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 21:55:30.301421 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:55:30.301421 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:55:30.301421 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:55:30.301421 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:55:30.301421 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQfDK0sBnxU25-toQPjh_xlwPkHFtbUJ-L4j_XNO91caR-FXh3oY0uT1RffaG8s3SCYVdNccTclIikzi8dM3iTgFFGtVUdvDq35frKe6hsf1XJvYt7YKrNrk6Oepi3xL1jjhiRnyYH23PsIa3Kg_0xCK4ucp_ftAbw-ZeUGyjv8cyoqQ Oct 08 21:55:30.301421 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:55:30.301421 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:55:30.301421 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:55:30.301421 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:55:30.301421 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:55:30.301421 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:55:30.301421 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: c3c1dbcc78cc4349b68eb40eb879be88 Oct 08 21:55:30.301421 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-TestMinimumBasicScenario-734937097 Oct 08 21:55:30.301421 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:55:30.301421 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:55:30.301421 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/c3c1dbcc78cc4349b68eb40eb879be88"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c3c1dbcc78cc4349b68eb40eb879be88"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_c3c1dbcc78cc4349b68eb40eb879be88"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c3c1dbcc78cc4349b68eb40eb879be88"}]}] Oct 08 21:55:30.301421 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-TestMinimumBasicScenario-734937097 Oct 08 21:55:30.301421 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: c3c1dbcc78cc4349b68eb40eb879be88 Oct 08 21:55:30.301421 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-TestMinimumBasicScenario-734937097 Oct 08 21:55:30.301421 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-TestMinimumBasicScenario-734937097-project Oct 08 21:55:30.301421 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:55:30.301421 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:55:30.301421 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 80a96d23b9a84b03a0549f1d57be4779 Oct 08 21:55:30.301421 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-TestMinimumBasicScenario-734937097-project Oct 08 21:55:30.301421 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:55:30.301421 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance 6476864f-c49c-4231-aee3-a3184db8712d is not attached to volume e43bda1c-c18a-48a3-81f9-12a65dd43532 Oct 08 21:55:30.301421 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'server_id': '6476864f-c49c-4231-aee3-a3184db8712d', 'id': 'e43bda1c-c18a-48a3-81f9-12a65dd43532'} Oct 08 21:55:30.301421 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:55:30.301421 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:55:30.301421 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 08 21:55:30.301421 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 08 21:55:30.301421 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 08 21:55:30.301421 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 08 21:55:30.301421 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 08 21:55:30.301421 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 08 21:55:30.301421 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id e43bda1c-c18a-48a3-81f9-12a65dd43532. Oct 08 21:55:30.301421 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:55:30.301421 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:55:30.301421 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:55:30.301421 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:55:30.301421 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:55:30.301421 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:55:30.301421 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:55:30.301421 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:55:30.301421 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:55:30.301421 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:55:30.301421 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 08 21:55:30.301421 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 08 21:55:30.301421 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6476864f-c49c-4231-aee3-a3184db8712d is not attached to volume e43bda1c-c18a-48a3-81f9-12a65dd43532 Oct 08 21:55:30.301421 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:55:30.301421 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:55:30.301421 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:55:30.301421 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:55:30.301421 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:55:30.301421 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:55:30.307255 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:55:30.307255 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:55:30.307255 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6476864f-c49c-4231-aee3-a3184db8712d is not attached to volume e43bda1c-c18a-48a3-81f9-12a65dd43532 Oct 08 21:55:30.307255 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:55:30.307255 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-1f394031-0dcf-4783-b678-868d0a4a68fd tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Returning 404 to user: Instance 6476864f-c49c-4231-aee3-a3184db8712d is not attached to volume e43bda1c-c18a-48a3-81f9-12a65dd43532 {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:55:30.307255 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-1f394031-0dcf-4783-b678-868d0a4a68fd tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] 10.222.0.26 "DELETE /compute/v2.1/servers/6476864f-c49c-4231-aee3-a3184db8712d/os-volume_attachments/e43bda1c-c18a-48a3-81f9-12a65dd43532" status: 404 len: 154 microversion: 2.1 time: 0.107601 Oct 08 21:55:30.307255 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3347/6768] 10.222.0.26 () {58 vars in 1416 bytes} [Sat Oct 8 21:55:30 2022] DELETE /compute/v2.1/servers/6476864f-c49c-4231-aee3-a3184db8712d/os-volume_attachments/e43bda1c-c18a-48a3-81f9-12a65dd43532 => generated 154 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 08 21:55:31.456864 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-43967fdd-e529-4332-b041-2c737f6f809f tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:55:31.457428 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-43967fdd-e529-4332-b041-2c737f6f809f tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] [instance: 6476864f-c49c-4231-aee3-a3184db8712d] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:55:31.464369 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-43967fdd-e529-4332-b041-2c737f6f809f tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:55:31.464883 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-43967fdd-e529-4332-b041-2c737f6f809f tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:55:31.465382 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-43967fdd-e529-4332-b041-2c737f6f809f tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:55:31.466125 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-43967fdd-e529-4332-b041-2c737f6f809f tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:55:31.466610 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-43967fdd-e529-4332-b041-2c737f6f809f tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:55:31.467070 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-43967fdd-e529-4332-b041-2c737f6f809f tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:55:31.493395 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-43967fdd-e529-4332-b041-2c737f6f809f tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] [instance: 6476864f-c49c-4231-aee3-a3184db8712d] Going to try to terminate instance {{(pid=140492) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 21:55:31.568978 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-43967fdd-e529-4332-b041-2c737f6f809f tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] 10.222.0.26 "DELETE /compute/v2.1/servers/6476864f-c49c-4231-aee3-a3184db8712d" status: 204 len: 0 microversion: 2.1 time: 0.115764 Oct 08 21:55:31.569640 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3422/6769] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:55:31 2022] DELETE /compute/v2.1/servers/6476864f-c49c-4231-aee3-a3184db8712d => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 21:55:31.577906 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-6e3f0ecc-e9da-49d0-a0bc-2f21d71a4bde tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:55:31.578563 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-6e3f0ecc-e9da-49d0-a0bc-2f21d71a4bde tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] [instance: 6476864f-c49c-4231-aee3-a3184db8712d] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:55:31.586091 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6e3f0ecc-e9da-49d0-a0bc-2f21d71a4bde tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:55:31.586646 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6e3f0ecc-e9da-49d0-a0bc-2f21d71a4bde tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:55:31.587094 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6e3f0ecc-e9da-49d0-a0bc-2f21d71a4bde tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:55:31.587851 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6e3f0ecc-e9da-49d0-a0bc-2f21d71a4bde tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:55:31.588313 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6e3f0ecc-e9da-49d0-a0bc-2f21d71a4bde tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:55:31.588745 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6e3f0ecc-e9da-49d0-a0bc-2f21d71a4bde tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:55:31.716157 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-6e3f0ecc-e9da-49d0-a0bc-2f21d71a4bde tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a96d23b9a84b03a0549f1d57be4779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c1dbcc78cc4349b68eb40eb879be88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:55:31.723945 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-6e3f0ecc-e9da-49d0-a0bc-2f21d71a4bde tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] 10.222.0.26 "GET /compute/v2.1/servers/6476864f-c49c-4231-aee3-a3184db8712d" status: 200 len: 1552 microversion: 2.1 time: 0.149892 Oct 08 21:55:31.724515 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3348/6770] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:55:31 2022] GET /compute/v2.1/servers/6476864f-c49c-4231-aee3-a3184db8712d => generated 1552 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:55:32.748659 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-86ea1a89-4a38-48c6-87a0-dd3e69548a68 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:55:32.749355 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-86ea1a89-4a38-48c6-87a0-dd3e69548a68 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] [instance: 6476864f-c49c-4231-aee3-a3184db8712d] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:55:32.757376 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-86ea1a89-4a38-48c6-87a0-dd3e69548a68 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:55:32.757890 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-86ea1a89-4a38-48c6-87a0-dd3e69548a68 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:55:32.758395 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-86ea1a89-4a38-48c6-87a0-dd3e69548a68 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:55:32.759116 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-86ea1a89-4a38-48c6-87a0-dd3e69548a68 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:55:32.759578 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-86ea1a89-4a38-48c6-87a0-dd3e69548a68 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:55:32.760025 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-86ea1a89-4a38-48c6-87a0-dd3e69548a68 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:55:32.893814 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-86ea1a89-4a38-48c6-87a0-dd3e69548a68 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a96d23b9a84b03a0549f1d57be4779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c1dbcc78cc4349b68eb40eb879be88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:55:32.901772 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-86ea1a89-4a38-48c6-87a0-dd3e69548a68 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] 10.222.0.26 "GET /compute/v2.1/servers/6476864f-c49c-4231-aee3-a3184db8712d" status: 200 len: 1552 microversion: 2.1 time: 0.158072 Oct 08 21:55:32.902354 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3423/6771] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:55:32 2022] GET /compute/v2.1/servers/6476864f-c49c-4231-aee3-a3184db8712d => generated 1552 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:55:33.800637 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-2b08f8a9-7ff5-4c90-99bf-1452972e1c28 req-a21a99e9-fbd9-4d77-be2e-b2c9b33c95cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6476864f-c49c-4231-aee3-a3184db8712d", "name": "network-vif-deleted", "tag": "f0bf3d14-32f1-4efc-9de5-2b455861ed88"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:55:33.812318 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-2b08f8a9-7ff5-4c90-99bf-1452972e1c28 req-a21a99e9-fbd9-4d77-be2e-b2c9b33c95cb service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:55:33.813074 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-2b08f8a9-7ff5-4c90-99bf-1452972e1c28 req-a21a99e9-fbd9-4d77-be2e-b2c9b33c95cb service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:55:33.813544 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-2b08f8a9-7ff5-4c90-99bf-1452972e1c28 req-a21a99e9-fbd9-4d77-be2e-b2c9b33c95cb service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:55:33.825649 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-2b08f8a9-7ff5-4c90-99bf-1452972e1c28 req-a21a99e9-fbd9-4d77-be2e-b2c9b33c95cb service nova] Creating event network-vif-deleted:f0bf3d14-32f1-4efc-9de5-2b455861ed88 for instance 6476864f-c49c-4231-aee3-a3184db8712d on nch1-master-1 Oct 08 21:55:33.830673 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-2b08f8a9-7ff5-4c90-99bf-1452972e1c28 req-a21a99e9-fbd9-4d77-be2e-b2c9b33c95cb service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034085 Oct 08 21:55:33.831284 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3349/6772] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:55:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:55:33.925115 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-4b4d823e-7e33-4ee4-a593-051e3987390f tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:55:33.925566 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-4b4d823e-7e33-4ee4-a593-051e3987390f tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] [instance: 6476864f-c49c-4231-aee3-a3184db8712d] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:55:33.933126 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4b4d823e-7e33-4ee4-a593-051e3987390f tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:55:33.933738 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4b4d823e-7e33-4ee4-a593-051e3987390f tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:55:33.934202 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4b4d823e-7e33-4ee4-a593-051e3987390f tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:55:33.934928 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4b4d823e-7e33-4ee4-a593-051e3987390f tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:55:33.935407 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4b4d823e-7e33-4ee4-a593-051e3987390f tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:55:33.935857 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4b4d823e-7e33-4ee4-a593-051e3987390f tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:55:33.967416 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4b4d823e-7e33-4ee4-a593-051e3987390f tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:55:33.967920 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4b4d823e-7e33-4ee4-a593-051e3987390f tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:55:33.968382 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4b4d823e-7e33-4ee4-a593-051e3987390f tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:55:33.968900 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.objects.instance [None req-4b4d823e-7e33-4ee4-a593-051e3987390f tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lazy-loading 'fault' on Instance uuid 6476864f-c49c-4231-aee3-a3184db8712d {{(pid=140492) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 21:55:34.010695 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-4b4d823e-7e33-4ee4-a593-051e3987390f tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a96d23b9a84b03a0549f1d57be4779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c1dbcc78cc4349b68eb40eb879be88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:55:34.018605 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-4b4d823e-7e33-4ee4-a593-051e3987390f tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] 10.222.0.26 "GET /compute/v2.1/servers/6476864f-c49c-4231-aee3-a3184db8712d" status: 200 len: 1346 microversion: 2.1 time: 0.098044 Oct 08 21:55:34.019201 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3424/6773] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:55:33 2022] GET /compute/v2.1/servers/6476864f-c49c-4231-aee3-a3184db8712d => generated 1346 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:55:35.042824 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-9b0d78b0-5ddf-432e-9be1-0b1146718125 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:55:35.043542 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-9b0d78b0-5ddf-432e-9be1-0b1146718125 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] [instance: 6476864f-c49c-4231-aee3-a3184db8712d] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:55:35.049908 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9b0d78b0-5ddf-432e-9be1-0b1146718125 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:55:35.050403 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9b0d78b0-5ddf-432e-9be1-0b1146718125 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:55:35.050857 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9b0d78b0-5ddf-432e-9be1-0b1146718125 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:55:35.051567 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9b0d78b0-5ddf-432e-9be1-0b1146718125 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:55:35.052035 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9b0d78b0-5ddf-432e-9be1-0b1146718125 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:55:35.052477 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9b0d78b0-5ddf-432e-9be1-0b1146718125 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:55:35.066707 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-9b0d78b0-5ddf-432e-9be1-0b1146718125 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] HTTP exception thrown: Instance 6476864f-c49c-4231-aee3-a3184db8712d could not be found. Oct 08 21:55:35.068327 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-9b0d78b0-5ddf-432e-9be1-0b1146718125 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Request method failure captured: Oct 08 21:55:35.068327 ncdv-master-1 devstack@n-api.service[140491]: request: GET /compute/v2.1/servers/6476864f-c49c-4231-aee3-a3184db8712d HTTP/1.1 Oct 08 21:55:35.068327 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:55:35.068327 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:55:35.068327 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:55:35.068327 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 21:55:35.068327 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:55:35.068327 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:55:35.068327 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:55:35.068327 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:55:35.068327 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQfDK0sBnxU25-toQPjh_xlwPkHFtbUJ-L4j_XNO91caR-FXh3oY0uT1RffaG8s3SCYVdNccTclIikzi8dM3iTgFFGtVUdvDq35frKe6hsf1XJvYt7YKrNrk6Oepi3xL1jjhiRnyYH23PsIa3Kg_0xCK4ucp_ftAbw-ZeUGyjv8cyoqQ Oct 08 21:55:35.068327 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:55:35.068327 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:55:35.068327 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:55:35.068327 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:55:35.068327 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:55:35.068327 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:55:35.068327 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: c3c1dbcc78cc4349b68eb40eb879be88 Oct 08 21:55:35.068327 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-TestMinimumBasicScenario-734937097 Oct 08 21:55:35.068327 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:55:35.068327 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:55:35.068327 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/c3c1dbcc78cc4349b68eb40eb879be88"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c3c1dbcc78cc4349b68eb40eb879be88"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_c3c1dbcc78cc4349b68eb40eb879be88"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c3c1dbcc78cc4349b68eb40eb879be88"}]}] Oct 08 21:55:35.068327 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-TestMinimumBasicScenario-734937097 Oct 08 21:55:35.068327 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: c3c1dbcc78cc4349b68eb40eb879be88 Oct 08 21:55:35.068327 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-TestMinimumBasicScenario-734937097 Oct 08 21:55:35.068327 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-TestMinimumBasicScenario-734937097-project Oct 08 21:55:35.068327 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:55:35.068327 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:55:35.068327 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 80a96d23b9a84b03a0549f1d57be4779 Oct 08 21:55:35.068327 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-TestMinimumBasicScenario-734937097-project Oct 08 21:55:35.068327 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:55:35.068327 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance 6476864f-c49c-4231-aee3-a3184db8712d could not be found. Oct 08 21:55:35.068327 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': '6476864f-c49c-4231-aee3-a3184db8712d'} Oct 08 21:55:35.068327 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:55:35.068327 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:55:35.068327 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:55:35.068327 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:55:35.068327 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:55:35.068327 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:55:35.068327 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:55:35.068327 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:55:35.068327 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:55:35.068327 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:55:35.068327 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6476864f-c49c-4231-aee3-a3184db8712d could not be found. Oct 08 21:55:35.068327 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:55:35.068327 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:55:35.068327 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:55:35.068327 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:55:35.068327 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:55:35.068327 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:55:35.068327 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:55:35.068327 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:55:35.068327 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:55:35.068327 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:55:35.068327 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:55:35.068327 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:55:35.068327 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:55:35.068327 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:55:35.068327 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:55:35.068327 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:55:35.068327 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6476864f-c49c-4231-aee3-a3184db8712d could not be found. Oct 08 21:55:35.068327 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:55:35.068327 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:55:35.068327 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:55:35.074864 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:55:35.074864 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:55:35.074864 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:55:35.074864 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:55:35.074864 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:55:35.074864 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6476864f-c49c-4231-aee3-a3184db8712d could not be found. Oct 08 21:55:35.074864 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:55:35.074864 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-9b0d78b0-5ddf-432e-9be1-0b1146718125 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Returning 404 to user: Instance 6476864f-c49c-4231-aee3-a3184db8712d could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:55:35.074864 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-9b0d78b0-5ddf-432e-9be1-0b1146718125 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] 10.222.0.26 "GET /compute/v2.1/servers/6476864f-c49c-4231-aee3-a3184db8712d" status: 404 len: 111 microversion: 2.1 time: 0.032217 Oct 08 21:55:35.074864 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3350/6774] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:55:35 2022] GET /compute/v2.1/servers/6476864f-c49c-4231-aee3-a3184db8712d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:55:35.079341 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-2216edf2-e34b-4973-8c83-02077db6d955 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Calling method '.version_select at 0x7f1a8c20f940>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:55:35.103575 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-2216edf2-e34b-4973-8c83-02077db6d955 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-912932776" status: 202 len: 0 microversion: 2.1 time: 0.028142 Oct 08 21:55:35.104249 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3425/6775] 10.222.0.26 () {58 vars in 1269 bytes} [Sat Oct 8 21:55:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-912932776 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 08 21:55:44.293027 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-4abd0da5-970a-45d7-bfcd-70e066267a00 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Action: 'create', calling method: .version_select at 0x7f1a87642700>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-2064964880", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK4x3KMchU9jYnadMOB7tWrcRrtPmrIyJCcwXHVvxPLQs16ivDKD19cHlrkxt/Hbnj/eoBWwywdbPOn7+KjRta/D2BMI6zsy1COMoYJUPnx0+TcS21eHWjZ5GpK1s+aUkg=="}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:55:44.313123 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-4abd0da5-970a-45d7-bfcd-70e066267a00 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Getting quotas for project c3c1dbcc78cc4349b68eb40eb879be88. Resources: {'key_pairs'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:55:44.319543 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-4abd0da5-970a-45d7-bfcd-70e066267a00 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Getting quotas for user 80a96d23b9a84b03a0549f1d57be4779 and project c3c1dbcc78cc4349b68eb40eb879be88. Resources: {'key_pairs'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:55:44.332923 ncdv-master-1 devstack@n-api.service[140491]: ERROR oslo.messaging._drivers.impl_rabbit [None req-4abd0da5-970a-45d7-bfcd-70e066267a00 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] [62e384ad-183d-418e-844f-07a4fef96c5b] AMQP server on 10.222.0.26:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 08 21:55:45.057647 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=22 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:55:45.340055 ncdv-master-1 devstack@n-api.service[140491]: INFO oslo.messaging._drivers.impl_rabbit [None req-4abd0da5-970a-45d7-bfcd-70e066267a00 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] [62e384ad-183d-418e-844f-07a4fef96c5b] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 37632. Oct 08 21:55:45.353908 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-4abd0da5-970a-45d7-bfcd-70e066267a00 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 1.065298 Oct 08 21:55:45.354517 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3351/6776] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Oct 8 21:55:44 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:55:45.409724 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=51,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:55:45.410522 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:55:45.414819 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-683eeda3-6ba2-4d9f-8248-821d0ba090b2 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-992480733", "imageRef": "aa9faab7-a390-4a2b-86c6-8111185ac2ea", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-2064964880", "networks": [{"uuid": "8da279d7-bbf4-4ddf-b706-120d97c39a88"}]}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:55:45.476871 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.network.neutron [None req-683eeda3-6ba2-4d9f-8248-821d0ba090b2 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] validate_networks() for [('8da279d7-bbf4-4ddf-b706-120d97c39a88', None, None, None, None, None)] {{(pid=140492) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 21:55:45.935592 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-683eeda3-6ba2-4d9f-8248-821d0ba090b2 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Flavor limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 21:55:45.936051 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-683eeda3-6ba2-4d9f-8248-821d0ba090b2 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Image limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 21:55:45.936561 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-683eeda3-6ba2-4d9f-8248-821d0ba090b2 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Flavor pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 21:55:45.937005 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-683eeda3-6ba2-4d9f-8248-821d0ba090b2 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Image pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 21:55:45.937484 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-683eeda3-6ba2-4d9f-8248-821d0ba090b2 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 21:55:45.947262 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-683eeda3-6ba2-4d9f-8248-821d0ba090b2 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:55:45.947954 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-683eeda3-6ba2-4d9f-8248-821d0ba090b2 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:55:45.948439 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-683eeda3-6ba2-4d9f-8248-821d0ba090b2 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:55:45.949445 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-683eeda3-6ba2-4d9f-8248-821d0ba090b2 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:55:45.950106 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-683eeda3-6ba2-4d9f-8248-821d0ba090b2 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:55:45.950677 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-683eeda3-6ba2-4d9f-8248-821d0ba090b2 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:55:45.969287 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-683eeda3-6ba2-4d9f-8248-821d0ba090b2 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Getting quotas for project c3c1dbcc78cc4349b68eb40eb879be88. Resources: {'cores', 'instances', 'ram'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:55:45.974639 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-683eeda3-6ba2-4d9f-8248-821d0ba090b2 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Getting quotas for user 80a96d23b9a84b03a0549f1d57be4779 and project c3c1dbcc78cc4349b68eb40eb879be88. Resources: {'cores', 'instances', 'ram'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:55:45.987686 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-683eeda3-6ba2-4d9f-8248-821d0ba090b2 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Going to run 1 instances... {{(pid=140492) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 21:55:45.990009 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-683eeda3-6ba2-4d9f-8248-821d0ba090b2 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] [instance: 16641093-2638-4915-b23d-0251c0cb7c4f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aa9faab7-a390-4a2b-86c6-8111185ac2ea',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140492) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 21:55:46.038175 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-683eeda3-6ba2-4d9f-8248-821d0ba090b2 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.630373 Oct 08 21:55:46.038840 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3426/6777] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 21:55:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 632 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 08 21:55:46.050527 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-e86518a0-60a7-4f05-a43b-29207c86c090 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:55:46.051241 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-e86518a0-60a7-4f05-a43b-29207c86c090 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] [instance: 16641093-2638-4915-b23d-0251c0cb7c4f] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:55:46.107461 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-e86518a0-60a7-4f05-a43b-29207c86c090 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a96d23b9a84b03a0549f1d57be4779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c1dbcc78cc4349b68eb40eb879be88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:55:46.115221 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-e86518a0-60a7-4f05-a43b-29207c86c090 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] 10.222.0.26 "GET /compute/v2.1/servers/16641093-2638-4915-b23d-0251c0cb7c4f" status: 200 len: 1258 microversion: 2.1 time: 0.068562 Oct 08 21:55:46.116451 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3352/6778] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:55:46 2022] GET /compute/v2.1/servers/16641093-2638-4915-b23d-0251c0cb7c4f => generated 1258 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:55:47.139247 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-8abc7cfe-a622-4b71-9edf-75fbec30a9c6 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:55:47.140528 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-8abc7cfe-a622-4b71-9edf-75fbec30a9c6 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] [instance: 16641093-2638-4915-b23d-0251c0cb7c4f] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:55:47.150466 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8abc7cfe-a622-4b71-9edf-75fbec30a9c6 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:55:47.161506 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8abc7cfe-a622-4b71-9edf-75fbec30a9c6 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:55:47.162078 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8abc7cfe-a622-4b71-9edf-75fbec30a9c6 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:55:47.162795 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8abc7cfe-a622-4b71-9edf-75fbec30a9c6 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:55:47.163293 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8abc7cfe-a622-4b71-9edf-75fbec30a9c6 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:55:47.163752 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8abc7cfe-a622-4b71-9edf-75fbec30a9c6 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:55:47.245371 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-8abc7cfe-a622-4b71-9edf-75fbec30a9c6 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a96d23b9a84b03a0549f1d57be4779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c1dbcc78cc4349b68eb40eb879be88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:55:47.253350 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-8abc7cfe-a622-4b71-9edf-75fbec30a9c6 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] 10.222.0.26 "GET /compute/v2.1/servers/16641093-2638-4915-b23d-0251c0cb7c4f" status: 200 len: 1328 microversion: 2.1 time: 0.119039 Oct 08 21:55:47.253974 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3427/6779] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:55:47 2022] GET /compute/v2.1/servers/16641093-2638-4915-b23d-0251c0cb7c4f => generated 1328 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:55:48.277666 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-37f2dbc6-b45b-401e-b1d9-f9f4dafe9b52 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:55:48.278519 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-37f2dbc6-b45b-401e-b1d9-f9f4dafe9b52 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] [instance: 16641093-2638-4915-b23d-0251c0cb7c4f] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:55:48.285968 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-37f2dbc6-b45b-401e-b1d9-f9f4dafe9b52 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:55:48.286461 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-37f2dbc6-b45b-401e-b1d9-f9f4dafe9b52 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:55:48.286905 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-37f2dbc6-b45b-401e-b1d9-f9f4dafe9b52 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:55:48.287616 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-37f2dbc6-b45b-401e-b1d9-f9f4dafe9b52 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:55:48.288072 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-37f2dbc6-b45b-401e-b1d9-f9f4dafe9b52 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:55:48.288502 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-37f2dbc6-b45b-401e-b1d9-f9f4dafe9b52 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:55:48.430294 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-37f2dbc6-b45b-401e-b1d9-f9f4dafe9b52 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a96d23b9a84b03a0549f1d57be4779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c1dbcc78cc4349b68eb40eb879be88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:55:48.438930 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-37f2dbc6-b45b-401e-b1d9-f9f4dafe9b52 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] 10.222.0.26 "GET /compute/v2.1/servers/16641093-2638-4915-b23d-0251c0cb7c4f" status: 200 len: 1358 microversion: 2.1 time: 0.165819 Oct 08 21:55:48.439527 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3353/6780] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:55:48 2022] GET /compute/v2.1/servers/16641093-2638-4915-b23d-0251c0cb7c4f => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:55:49.466121 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-5b281a56-8460-450f-a926-3f44a890b921 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:55:49.466835 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-5b281a56-8460-450f-a926-3f44a890b921 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] [instance: 16641093-2638-4915-b23d-0251c0cb7c4f] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:55:49.473388 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5b281a56-8460-450f-a926-3f44a890b921 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:55:49.474305 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5b281a56-8460-450f-a926-3f44a890b921 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:55:49.475002 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5b281a56-8460-450f-a926-3f44a890b921 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:55:49.475748 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5b281a56-8460-450f-a926-3f44a890b921 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:55:49.476223 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5b281a56-8460-450f-a926-3f44a890b921 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:55:49.476910 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5b281a56-8460-450f-a926-3f44a890b921 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:55:49.631983 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-5b281a56-8460-450f-a926-3f44a890b921 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a96d23b9a84b03a0549f1d57be4779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c1dbcc78cc4349b68eb40eb879be88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:55:49.641320 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-5b281a56-8460-450f-a926-3f44a890b921 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] 10.222.0.26 "GET /compute/v2.1/servers/16641093-2638-4915-b23d-0251c0cb7c4f" status: 200 len: 1358 microversion: 2.1 time: 0.182388 Oct 08 21:55:49.645257 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3428/6781] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:55:49 2022] GET /compute/v2.1/servers/16641093-2638-4915-b23d-0251c0cb7c4f => generated 1358 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:55:50.664201 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-5ffcf8b7-c763-49f7-b72e-cd322d4f8e64 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:55:50.664848 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-5ffcf8b7-c763-49f7-b72e-cd322d4f8e64 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] [instance: 16641093-2638-4915-b23d-0251c0cb7c4f] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:55:50.672598 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5ffcf8b7-c763-49f7-b72e-cd322d4f8e64 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:55:50.673210 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5ffcf8b7-c763-49f7-b72e-cd322d4f8e64 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:55:50.673693 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5ffcf8b7-c763-49f7-b72e-cd322d4f8e64 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:55:50.674536 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5ffcf8b7-c763-49f7-b72e-cd322d4f8e64 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:55:50.675121 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5ffcf8b7-c763-49f7-b72e-cd322d4f8e64 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:55:50.675590 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5ffcf8b7-c763-49f7-b72e-cd322d4f8e64 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:55:50.832429 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-5ffcf8b7-c763-49f7-b72e-cd322d4f8e64 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a96d23b9a84b03a0549f1d57be4779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c1dbcc78cc4349b68eb40eb879be88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:55:50.841511 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-5ffcf8b7-c763-49f7-b72e-cd322d4f8e64 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] 10.222.0.26 "GET /compute/v2.1/servers/16641093-2638-4915-b23d-0251c0cb7c4f" status: 200 len: 1358 microversion: 2.1 time: 0.181265 Oct 08 21:55:50.842495 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3354/6782] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:55:50 2022] GET /compute/v2.1/servers/16641093-2638-4915-b23d-0251c0cb7c4f => generated 1358 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:55:51.864935 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-46631ffc-5c7c-4c41-8853-e4889e3715e0 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:55:51.865649 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-46631ffc-5c7c-4c41-8853-e4889e3715e0 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] [instance: 16641093-2638-4915-b23d-0251c0cb7c4f] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:55:51.873689 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-46631ffc-5c7c-4c41-8853-e4889e3715e0 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:55:51.874176 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-46631ffc-5c7c-4c41-8853-e4889e3715e0 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:55:51.874634 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-46631ffc-5c7c-4c41-8853-e4889e3715e0 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:55:51.875352 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-46631ffc-5c7c-4c41-8853-e4889e3715e0 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:55:51.875826 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-46631ffc-5c7c-4c41-8853-e4889e3715e0 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:55:51.876270 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-46631ffc-5c7c-4c41-8853-e4889e3715e0 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:55:52.014396 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-46631ffc-5c7c-4c41-8853-e4889e3715e0 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a96d23b9a84b03a0549f1d57be4779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c1dbcc78cc4349b68eb40eb879be88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:55:52.022529 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-46631ffc-5c7c-4c41-8853-e4889e3715e0 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] 10.222.0.26 "GET /compute/v2.1/servers/16641093-2638-4915-b23d-0251c0cb7c4f" status: 200 len: 1358 microversion: 2.1 time: 0.161508 Oct 08 21:55:52.033392 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3429/6783] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:55:51 2022] GET /compute/v2.1/servers/16641093-2638-4915-b23d-0251c0cb7c4f => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:55:53.046458 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-e61ddd09-dd8d-4c7a-9da0-5b5c41d151c5 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:55:53.048398 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-e61ddd09-dd8d-4c7a-9da0-5b5c41d151c5 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] [instance: 16641093-2638-4915-b23d-0251c0cb7c4f] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:55:53.064812 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e61ddd09-dd8d-4c7a-9da0-5b5c41d151c5 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:55:53.065282 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e61ddd09-dd8d-4c7a-9da0-5b5c41d151c5 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:55:53.065730 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e61ddd09-dd8d-4c7a-9da0-5b5c41d151c5 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:55:53.066514 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e61ddd09-dd8d-4c7a-9da0-5b5c41d151c5 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:55:53.067023 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e61ddd09-dd8d-4c7a-9da0-5b5c41d151c5 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:55:53.067476 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e61ddd09-dd8d-4c7a-9da0-5b5c41d151c5 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:55:53.213321 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-e61ddd09-dd8d-4c7a-9da0-5b5c41d151c5 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a96d23b9a84b03a0549f1d57be4779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c1dbcc78cc4349b68eb40eb879be88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:55:53.222252 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-e61ddd09-dd8d-4c7a-9da0-5b5c41d151c5 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] 10.222.0.26 "GET /compute/v2.1/servers/16641093-2638-4915-b23d-0251c0cb7c4f" status: 200 len: 1358 microversion: 2.1 time: 0.180191 Oct 08 21:55:53.222838 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3355/6784] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:55:53 2022] GET /compute/v2.1/servers/16641093-2638-4915-b23d-0251c0cb7c4f => generated 1358 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:55:54.251066 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-5f84c78b-0614-4c17-bb7b-91d114fe349e tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:55:54.251066 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-5f84c78b-0614-4c17-bb7b-91d114fe349e tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] [instance: 16641093-2638-4915-b23d-0251c0cb7c4f] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:55:54.267604 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5f84c78b-0614-4c17-bb7b-91d114fe349e tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:55:54.267604 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5f84c78b-0614-4c17-bb7b-91d114fe349e tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:55:54.267604 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5f84c78b-0614-4c17-bb7b-91d114fe349e tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:55:54.267604 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5f84c78b-0614-4c17-bb7b-91d114fe349e tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:55:54.267604 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5f84c78b-0614-4c17-bb7b-91d114fe349e tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:55:54.267604 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5f84c78b-0614-4c17-bb7b-91d114fe349e tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:55:54.399433 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-5f84c78b-0614-4c17-bb7b-91d114fe349e tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a96d23b9a84b03a0549f1d57be4779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c1dbcc78cc4349b68eb40eb879be88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:55:54.407366 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-5f84c78b-0614-4c17-bb7b-91d114fe349e tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] 10.222.0.26 "GET /compute/v2.1/servers/16641093-2638-4915-b23d-0251c0cb7c4f" status: 200 len: 1358 microversion: 2.1 time: 0.160539 Oct 08 21:55:54.407942 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3430/6785] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:55:54 2022] GET /compute/v2.1/servers/16641093-2638-4915-b23d-0251c0cb7c4f => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:55:55.429936 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-89870c7f-b30f-406c-80d3-16f0d70acdde tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:55:55.430582 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-89870c7f-b30f-406c-80d3-16f0d70acdde tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] [instance: 16641093-2638-4915-b23d-0251c0cb7c4f] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:55:55.437920 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-89870c7f-b30f-406c-80d3-16f0d70acdde tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:55:55.438424 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-89870c7f-b30f-406c-80d3-16f0d70acdde tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:55:55.438873 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-89870c7f-b30f-406c-80d3-16f0d70acdde tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:55:55.439600 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-89870c7f-b30f-406c-80d3-16f0d70acdde tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:55:55.440071 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-89870c7f-b30f-406c-80d3-16f0d70acdde tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:55:55.440512 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-89870c7f-b30f-406c-80d3-16f0d70acdde tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:55:55.585238 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-89870c7f-b30f-406c-80d3-16f0d70acdde tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a96d23b9a84b03a0549f1d57be4779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c1dbcc78cc4349b68eb40eb879be88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:55:55.593842 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-89870c7f-b30f-406c-80d3-16f0d70acdde tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] 10.222.0.26 "GET /compute/v2.1/servers/16641093-2638-4915-b23d-0251c0cb7c4f" status: 200 len: 1358 microversion: 2.1 time: 0.167779 Oct 08 21:55:55.594433 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3356/6786] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:55:55 2022] GET /compute/v2.1/servers/16641093-2638-4915-b23d-0251c0cb7c4f => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:55:56.169627 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-8fb39647-2073-4049-940b-05bdf3e29141 req-a97a31de-084e-4aad-ad80-ae549756d2c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16641093-2638-4915-b23d-0251c0cb7c4f", "tag": "3ac713b7-ef84-4647-8f9e-40b150a95654"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:55:56.178089 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=2 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:55:56.178788 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=6 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:55:56.186456 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-8fb39647-2073-4049-940b-05bdf3e29141 req-a97a31de-084e-4aad-ad80-ae549756d2c2 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:55:56.186980 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-8fb39647-2073-4049-940b-05bdf3e29141 req-a97a31de-084e-4aad-ad80-ae549756d2c2 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:55:56.187448 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-8fb39647-2073-4049-940b-05bdf3e29141 req-a97a31de-084e-4aad-ad80-ae549756d2c2 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:55:56.200772 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-8fb39647-2073-4049-940b-05bdf3e29141 req-a97a31de-084e-4aad-ad80-ae549756d2c2 service nova] Creating event network-changed:3ac713b7-ef84-4647-8f9e-40b150a95654 for instance 16641093-2638-4915-b23d-0251c0cb7c4f on nch2-master-1 Oct 08 21:55:56.206171 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-8fb39647-2073-4049-940b-05bdf3e29141 req-a97a31de-084e-4aad-ad80-ae549756d2c2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041129 Oct 08 21:55:56.206800 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3431/6787] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:55:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:55:56.617136 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-aaf2bba3-c5df-419a-a513-dace5d93d602 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:55:56.617787 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-aaf2bba3-c5df-419a-a513-dace5d93d602 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] [instance: 16641093-2638-4915-b23d-0251c0cb7c4f] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:55:56.619710 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=6 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:55:56.626171 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-aaf2bba3-c5df-419a-a513-dace5d93d602 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:55:56.626718 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-aaf2bba3-c5df-419a-a513-dace5d93d602 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:55:56.627247 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-aaf2bba3-c5df-419a-a513-dace5d93d602 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:55:56.628038 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-aaf2bba3-c5df-419a-a513-dace5d93d602 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:55:56.628535 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-aaf2bba3-c5df-419a-a513-dace5d93d602 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:55:56.628978 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-aaf2bba3-c5df-419a-a513-dace5d93d602 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:55:56.759143 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-aaf2bba3-c5df-419a-a513-dace5d93d602 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a96d23b9a84b03a0549f1d57be4779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c1dbcc78cc4349b68eb40eb879be88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:55:56.767508 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-aaf2bba3-c5df-419a-a513-dace5d93d602 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] 10.222.0.26 "GET /compute/v2.1/servers/16641093-2638-4915-b23d-0251c0cb7c4f" status: 200 len: 1358 microversion: 2.1 time: 0.154315 Oct 08 21:55:56.768091 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3357/6788] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:55:56 2022] GET /compute/v2.1/servers/16641093-2638-4915-b23d-0251c0cb7c4f => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:55:57.791751 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-33d1da83-110b-4d8e-9c56-3cbaf97bca09 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:55:57.792519 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-33d1da83-110b-4d8e-9c56-3cbaf97bca09 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] [instance: 16641093-2638-4915-b23d-0251c0cb7c4f] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:55:57.799697 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-33d1da83-110b-4d8e-9c56-3cbaf97bca09 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:55:57.800204 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-33d1da83-110b-4d8e-9c56-3cbaf97bca09 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:55:57.800664 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-33d1da83-110b-4d8e-9c56-3cbaf97bca09 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:55:57.801417 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-33d1da83-110b-4d8e-9c56-3cbaf97bca09 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:55:57.801901 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-33d1da83-110b-4d8e-9c56-3cbaf97bca09 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:55:57.802353 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-33d1da83-110b-4d8e-9c56-3cbaf97bca09 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:55:57.940727 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-33d1da83-110b-4d8e-9c56-3cbaf97bca09 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a96d23b9a84b03a0549f1d57be4779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c1dbcc78cc4349b68eb40eb879be88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:55:57.949584 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-33d1da83-110b-4d8e-9c56-3cbaf97bca09 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] 10.222.0.26 "GET /compute/v2.1/servers/16641093-2638-4915-b23d-0251c0cb7c4f" status: 200 len: 1358 microversion: 2.1 time: 0.161278 Oct 08 21:55:57.950176 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3432/6789] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:55:57 2022] GET /compute/v2.1/servers/16641093-2638-4915-b23d-0251c0cb7c4f => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:55:58.972380 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-12739aa0-79e5-4807-970c-f91016b214d0 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:55:58.972996 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-12739aa0-79e5-4807-970c-f91016b214d0 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] [instance: 16641093-2638-4915-b23d-0251c0cb7c4f] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:55:58.974942 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:55:58.981964 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-12739aa0-79e5-4807-970c-f91016b214d0 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:55:58.982629 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-12739aa0-79e5-4807-970c-f91016b214d0 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:55:58.983070 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-12739aa0-79e5-4807-970c-f91016b214d0 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:55:58.983770 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-12739aa0-79e5-4807-970c-f91016b214d0 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:55:58.984228 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-12739aa0-79e5-4807-970c-f91016b214d0 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:55:58.984656 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-12739aa0-79e5-4807-970c-f91016b214d0 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:55:59.116549 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-12739aa0-79e5-4807-970c-f91016b214d0 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a96d23b9a84b03a0549f1d57be4779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c1dbcc78cc4349b68eb40eb879be88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:55:59.124281 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-12739aa0-79e5-4807-970c-f91016b214d0 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] 10.222.0.26 "GET /compute/v2.1/servers/16641093-2638-4915-b23d-0251c0cb7c4f" status: 200 len: 1358 microversion: 2.1 time: 0.156052 Oct 08 21:55:59.124854 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3358/6790] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:55:58 2022] GET /compute/v2.1/servers/16641093-2638-4915-b23d-0251c0cb7c4f => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:56:00.146524 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-f576dc8d-e92f-4829-bb3a-8a8fbab0538f tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:56:00.147125 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-f576dc8d-e92f-4829-bb3a-8a8fbab0538f tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] [instance: 16641093-2638-4915-b23d-0251c0cb7c4f] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:56:00.154484 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f576dc8d-e92f-4829-bb3a-8a8fbab0538f tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:56:00.155003 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f576dc8d-e92f-4829-bb3a-8a8fbab0538f tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:56:00.155469 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f576dc8d-e92f-4829-bb3a-8a8fbab0538f tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:56:00.156210 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f576dc8d-e92f-4829-bb3a-8a8fbab0538f tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:56:00.156698 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f576dc8d-e92f-4829-bb3a-8a8fbab0538f tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:56:00.157156 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f576dc8d-e92f-4829-bb3a-8a8fbab0538f tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:56:00.288982 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-f576dc8d-e92f-4829-bb3a-8a8fbab0538f tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a96d23b9a84b03a0549f1d57be4779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c1dbcc78cc4349b68eb40eb879be88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:56:00.297473 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-f576dc8d-e92f-4829-bb3a-8a8fbab0538f tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] 10.222.0.26 "GET /compute/v2.1/servers/16641093-2638-4915-b23d-0251c0cb7c4f" status: 200 len: 1358 microversion: 2.1 time: 0.155060 Oct 08 21:56:00.298074 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3433/6791] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:56:00 2022] GET /compute/v2.1/servers/16641093-2638-4915-b23d-0251c0cb7c4f => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:56:01.320114 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-f6d26de7-ea6e-4489-b394-279f00b680a8 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:56:01.320733 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-f6d26de7-ea6e-4489-b394-279f00b680a8 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] [instance: 16641093-2638-4915-b23d-0251c0cb7c4f] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:56:01.327947 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f6d26de7-ea6e-4489-b394-279f00b680a8 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:56:01.328450 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f6d26de7-ea6e-4489-b394-279f00b680a8 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:56:01.328904 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f6d26de7-ea6e-4489-b394-279f00b680a8 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:56:01.329654 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f6d26de7-ea6e-4489-b394-279f00b680a8 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:56:01.330123 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f6d26de7-ea6e-4489-b394-279f00b680a8 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:56:01.330561 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f6d26de7-ea6e-4489-b394-279f00b680a8 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:56:01.460787 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-f6d26de7-ea6e-4489-b394-279f00b680a8 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a96d23b9a84b03a0549f1d57be4779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c1dbcc78cc4349b68eb40eb879be88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:56:01.468650 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-f6d26de7-ea6e-4489-b394-279f00b680a8 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] 10.222.0.26 "GET /compute/v2.1/servers/16641093-2638-4915-b23d-0251c0cb7c4f" status: 200 len: 1358 microversion: 2.1 time: 0.152424 Oct 08 21:56:01.469253 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3359/6792] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:56:01 2022] GET /compute/v2.1/servers/16641093-2638-4915-b23d-0251c0cb7c4f => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:56:01.693742 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-8f4d8457-e156-4a49-8886-283525cc6105 req-195a71e9-627a-4b78-a869-aee3ccfb5026 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16641093-2638-4915-b23d-0251c0cb7c4f", "name": "network-vif-plugged", "status": "completed", "tag": "3ac713b7-ef84-4647-8f9e-40b150a95654"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:56:01.703494 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-8f4d8457-e156-4a49-8886-283525cc6105 req-195a71e9-627a-4b78-a869-aee3ccfb5026 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:56:01.703875 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-8f4d8457-e156-4a49-8886-283525cc6105 req-195a71e9-627a-4b78-a869-aee3ccfb5026 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:56:01.704339 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-8f4d8457-e156-4a49-8886-283525cc6105 req-195a71e9-627a-4b78-a869-aee3ccfb5026 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:56:01.716028 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-8f4d8457-e156-4a49-8886-283525cc6105 req-195a71e9-627a-4b78-a869-aee3ccfb5026 service nova] Creating event network-vif-plugged:3ac713b7-ef84-4647-8f9e-40b150a95654 for instance 16641093-2638-4915-b23d-0251c0cb7c4f on nch2-master-1 Oct 08 21:56:01.721007 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-8f4d8457-e156-4a49-8886-283525cc6105 req-195a71e9-627a-4b78-a869-aee3ccfb5026 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087584 Oct 08 21:56:01.721643 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3434/6793] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:56:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:56:02.491653 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-cd1323a0-1d56-47e6-b4a6-2c0834450936 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:56:02.492271 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-cd1323a0-1d56-47e6-b4a6-2c0834450936 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] [instance: 16641093-2638-4915-b23d-0251c0cb7c4f] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:56:02.499732 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cd1323a0-1d56-47e6-b4a6-2c0834450936 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:56:02.500222 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cd1323a0-1d56-47e6-b4a6-2c0834450936 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:56:02.500671 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cd1323a0-1d56-47e6-b4a6-2c0834450936 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:56:02.501429 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cd1323a0-1d56-47e6-b4a6-2c0834450936 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:56:02.501894 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cd1323a0-1d56-47e6-b4a6-2c0834450936 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:56:02.502326 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cd1323a0-1d56-47e6-b4a6-2c0834450936 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:56:02.631604 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-cd1323a0-1d56-47e6-b4a6-2c0834450936 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a96d23b9a84b03a0549f1d57be4779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c1dbcc78cc4349b68eb40eb879be88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:56:02.639423 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-cd1323a0-1d56-47e6-b4a6-2c0834450936 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] 10.222.0.26 "GET /compute/v2.1/servers/16641093-2638-4915-b23d-0251c0cb7c4f" status: 200 len: 1358 microversion: 2.1 time: 0.151702 Oct 08 21:56:02.640005 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3360/6794] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:56:02 2022] GET /compute/v2.1/servers/16641093-2638-4915-b23d-0251c0cb7c4f => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:56:03.663823 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-2f1e1bca-1428-47ee-8a3f-152b78981e96 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:56:03.664549 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-2f1e1bca-1428-47ee-8a3f-152b78981e96 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] [instance: 16641093-2638-4915-b23d-0251c0cb7c4f] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:56:03.670979 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2f1e1bca-1428-47ee-8a3f-152b78981e96 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:56:03.671488 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2f1e1bca-1428-47ee-8a3f-152b78981e96 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:56:03.671950 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2f1e1bca-1428-47ee-8a3f-152b78981e96 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:56:03.672665 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2f1e1bca-1428-47ee-8a3f-152b78981e96 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:56:03.673168 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2f1e1bca-1428-47ee-8a3f-152b78981e96 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:56:03.673639 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2f1e1bca-1428-47ee-8a3f-152b78981e96 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:56:03.801307 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-2f1e1bca-1428-47ee-8a3f-152b78981e96 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a96d23b9a84b03a0549f1d57be4779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c1dbcc78cc4349b68eb40eb879be88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:56:03.810516 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-2f1e1bca-1428-47ee-8a3f-152b78981e96 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] 10.222.0.26 "GET /compute/v2.1/servers/16641093-2638-4915-b23d-0251c0cb7c4f" status: 200 len: 1548 microversion: 2.1 time: 0.151892 Oct 08 21:56:03.811091 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3435/6795] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:56:03 2022] GET /compute/v2.1/servers/16641093-2638-4915-b23d-0251c0cb7c4f => generated 1548 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:56:03.832962 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-d44ff951-5687-4dde-a8ef-8c7b5e5f8e80 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:56:03.833682 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-d44ff951-5687-4dde-a8ef-8c7b5e5f8e80 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] [instance: 16641093-2638-4915-b23d-0251c0cb7c4f] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:56:03.840583 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d44ff951-5687-4dde-a8ef-8c7b5e5f8e80 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:56:03.841080 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d44ff951-5687-4dde-a8ef-8c7b5e5f8e80 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:56:03.841565 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d44ff951-5687-4dde-a8ef-8c7b5e5f8e80 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:56:03.842277 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d44ff951-5687-4dde-a8ef-8c7b5e5f8e80 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:56:03.842744 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d44ff951-5687-4dde-a8ef-8c7b5e5f8e80 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:56:03.843188 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d44ff951-5687-4dde-a8ef-8c7b5e5f8e80 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:56:03.976014 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-d44ff951-5687-4dde-a8ef-8c7b5e5f8e80 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a96d23b9a84b03a0549f1d57be4779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c1dbcc78cc4349b68eb40eb879be88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:56:03.983898 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-d44ff951-5687-4dde-a8ef-8c7b5e5f8e80 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] 10.222.0.26 "GET /compute/v2.1/servers/16641093-2638-4915-b23d-0251c0cb7c4f" status: 200 len: 1548 microversion: 2.1 time: 0.154785 Oct 08 21:56:03.984474 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3361/6796] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:56:03 2022] GET /compute/v2.1/servers/16641093-2638-4915-b23d-0251c0cb7c4f => generated 1548 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:56:04.006032 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-1805d8e2-f001-4dd6-bc8c-9251f218ec35 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:56:04.010750 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-1805d8e2-f001-4dd6-bc8c-9251f218ec35 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '80a96d23b9a84b03a0549f1d57be4779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c1dbcc78cc4349b68eb40eb879be88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:56:04.011551 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-1805d8e2-f001-4dd6-bc8c-9251f218ec35 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Searching by: {'deleted': False, 'project_id': 'c3c1dbcc78cc4349b68eb40eb879be88'} {{(pid=140492) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 08 21:56:04.017519 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1805d8e2-f001-4dd6-bc8c-9251f218ec35 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:56:04.018020 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1805d8e2-f001-4dd6-bc8c-9251f218ec35 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:56:04.018479 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1805d8e2-f001-4dd6-bc8c-9251f218ec35 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:56:04.019231 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1805d8e2-f001-4dd6-bc8c-9251f218ec35 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:56:04.019710 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1805d8e2-f001-4dd6-bc8c-9251f218ec35 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:56:04.020160 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1805d8e2-f001-4dd6-bc8c-9251f218ec35 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:56:04.043526 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.multi_cell_list [None req-1805d8e2-f001-4dd6-bc8c-9251f218ec35 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=140492) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 08 21:56:04.070809 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-1805d8e2-f001-4dd6-bc8c-9251f218ec35 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] 10.222.0.26 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.068714 Oct 08 21:56:04.071388 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3436/6797] 10.222.0.26 () {58 vars in 1125 bytes} [Sat Oct 8 21:56:04 2022] GET /compute/v2.1/servers => generated 342 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:56:04.083527 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-0f0ab92e-fffe-4be5-b82c-69fe22eb2093 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:56:04.084181 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-0f0ab92e-fffe-4be5-b82c-69fe22eb2093 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] [instance: 16641093-2638-4915-b23d-0251c0cb7c4f] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:56:04.090232 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0f0ab92e-fffe-4be5-b82c-69fe22eb2093 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:56:04.090722 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0f0ab92e-fffe-4be5-b82c-69fe22eb2093 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:56:04.091165 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0f0ab92e-fffe-4be5-b82c-69fe22eb2093 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:56:04.091870 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0f0ab92e-fffe-4be5-b82c-69fe22eb2093 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:56:04.092332 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0f0ab92e-fffe-4be5-b82c-69fe22eb2093 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:56:04.092764 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0f0ab92e-fffe-4be5-b82c-69fe22eb2093 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:56:04.219486 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-0f0ab92e-fffe-4be5-b82c-69fe22eb2093 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a96d23b9a84b03a0549f1d57be4779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c1dbcc78cc4349b68eb40eb879be88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:56:04.227315 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-0f0ab92e-fffe-4be5-b82c-69fe22eb2093 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] 10.222.0.26 "GET /compute/v2.1/servers/16641093-2638-4915-b23d-0251c0cb7c4f" status: 200 len: 1548 microversion: 2.1 time: 0.147611 Oct 08 21:56:04.227895 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3362/6798] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:56:04 2022] GET /compute/v2.1/servers/16641093-2638-4915-b23d-0251c0cb7c4f => generated 1548 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:56:05.740728 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-82fcd140-496b-4ed1-8fa2-f0bf99955ceb tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0dff6fc1-abc9-4ff3-8bc4-2f1726cfbfaf"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:56:05.743124 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-82fcd140-496b-4ed1-8fa2-f0bf99955ceb tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] [instance: 16641093-2638-4915-b23d-0251c0cb7c4f] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:56:05.750658 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-82fcd140-496b-4ed1-8fa2-f0bf99955ceb tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:56:05.751176 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-82fcd140-496b-4ed1-8fa2-f0bf99955ceb tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:56:05.751646 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-82fcd140-496b-4ed1-8fa2-f0bf99955ceb tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:56:05.752371 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-82fcd140-496b-4ed1-8fa2-f0bf99955ceb tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:56:05.752861 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-82fcd140-496b-4ed1-8fa2-f0bf99955ceb tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:56:05.753349 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-82fcd140-496b-4ed1-8fa2-f0bf99955ceb tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:56:05.990231 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-82fcd140-496b-4ed1-8fa2-f0bf99955ceb tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] 10.222.0.26 "POST /compute/v2.1/servers/16641093-2638-4915-b23d-0251c0cb7c4f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.253252 Oct 08 21:56:05.990912 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3437/6799] 10.222.0.26 () {60 vars in 1323 bytes} [Sat Oct 8 21:56:05 2022] POST /compute/v2.1/servers/16641093-2638-4915-b23d-0251c0cb7c4f/os-volume_attachments => generated 194 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:56:09.354516 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c76b9afa-a5fa-46f4-89c3-7e6312aaa6da tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:56:09.355078 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-c76b9afa-a5fa-46f4-89c3-7e6312aaa6da tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] [instance: 16641093-2638-4915-b23d-0251c0cb7c4f] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:56:09.362300 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c76b9afa-a5fa-46f4-89c3-7e6312aaa6da tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:56:09.362801 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c76b9afa-a5fa-46f4-89c3-7e6312aaa6da tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:56:09.363253 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c76b9afa-a5fa-46f4-89c3-7e6312aaa6da tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:56:09.363960 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c76b9afa-a5fa-46f4-89c3-7e6312aaa6da tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:56:09.364461 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c76b9afa-a5fa-46f4-89c3-7e6312aaa6da tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:56:09.364898 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c76b9afa-a5fa-46f4-89c3-7e6312aaa6da tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:56:09.499798 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-c76b9afa-a5fa-46f4-89c3-7e6312aaa6da tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a96d23b9a84b03a0549f1d57be4779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c1dbcc78cc4349b68eb40eb879be88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:56:09.508211 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-c76b9afa-a5fa-46f4-89c3-7e6312aaa6da tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] 10.222.0.26 "GET /compute/v2.1/servers/16641093-2638-4915-b23d-0251c0cb7c4f" status: 200 len: 1594 microversion: 2.1 time: 0.157626 Oct 08 21:56:09.508784 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3363/6800] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:56:09 2022] GET /compute/v2.1/servers/16641093-2638-4915-b23d-0251c0cb7c4f => generated 1594 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:56:11.061197 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-55e67eb2-98ab-4460-aa62-4aa006a409de req-2a65b583-78f5-4edf-bce4-373bb3ec13f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16641093-2638-4915-b23d-0251c0cb7c4f", "tag": "3ac713b7-ef84-4647-8f9e-40b150a95654"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:56:11.072661 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-55e67eb2-98ab-4460-aa62-4aa006a409de req-2a65b583-78f5-4edf-bce4-373bb3ec13f0 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:56:11.073350 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-55e67eb2-98ab-4460-aa62-4aa006a409de req-2a65b583-78f5-4edf-bce4-373bb3ec13f0 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:56:11.074009 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-55e67eb2-98ab-4460-aa62-4aa006a409de req-2a65b583-78f5-4edf-bce4-373bb3ec13f0 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:56:11.088052 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-55e67eb2-98ab-4460-aa62-4aa006a409de req-2a65b583-78f5-4edf-bce4-373bb3ec13f0 service nova] Creating event network-changed:3ac713b7-ef84-4647-8f9e-40b150a95654 for instance 16641093-2638-4915-b23d-0251c0cb7c4f on nch2-master-1 Oct 08 21:56:11.094065 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-55e67eb2-98ab-4460-aa62-4aa006a409de req-2a65b583-78f5-4edf-bce4-373bb3ec13f0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037211 Oct 08 21:56:11.094764 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3438/6801] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:56:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:56:12.306106 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-d375c91a-c130-4aeb-b361-b2b3ebe93b9d tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1530941005"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:56:12.306659 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-d375c91a-c130-4aeb-b361-b2b3ebe93b9d tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] [instance: 16641093-2638-4915-b23d-0251c0cb7c4f] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:56:12.314483 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d375c91a-c130-4aeb-b361-b2b3ebe93b9d tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:56:12.314985 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d375c91a-c130-4aeb-b361-b2b3ebe93b9d tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:56:12.315456 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d375c91a-c130-4aeb-b361-b2b3ebe93b9d tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:56:12.316157 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d375c91a-c130-4aeb-b361-b2b3ebe93b9d tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:56:12.316627 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d375c91a-c130-4aeb-b361-b2b3ebe93b9d tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:56:12.317057 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d375c91a-c130-4aeb-b361-b2b3ebe93b9d tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:56:12.445852 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.network.security_group_api [None req-d375c91a-c130-4aeb-b361-b2b3ebe93b9d tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Adding security group 30c0a4d7-bc84-473f-a377-f984db7f0116 to port 3ac713b7-ef84-4647-8f9e-40b150a95654 Oct 08 21:56:12.760888 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-d375c91a-c130-4aeb-b361-b2b3ebe93b9d tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] 10.222.0.26 "POST /compute/v2.1/servers/16641093-2638-4915-b23d-0251c0cb7c4f/action" status: 202 len: 0 microversion: 2.1 time: 0.458686 Oct 08 21:56:12.761806 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3364/6802] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:56:12 2022] POST /compute/v2.1/servers/16641093-2638-4915-b23d-0251c0cb7c4f/action => generated 0 bytes in 460 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 21:56:12.772027 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-73a1ba27-f58a-4c09-956e-28fafb70fe3a tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:56:12.772894 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-73a1ba27-f58a-4c09-956e-28fafb70fe3a tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] [instance: 16641093-2638-4915-b23d-0251c0cb7c4f] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:56:12.779682 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-73a1ba27-f58a-4c09-956e-28fafb70fe3a tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:56:12.780343 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-73a1ba27-f58a-4c09-956e-28fafb70fe3a tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:56:12.780942 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-73a1ba27-f58a-4c09-956e-28fafb70fe3a tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:56:12.782706 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-73a1ba27-f58a-4c09-956e-28fafb70fe3a tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:56:12.783309 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-73a1ba27-f58a-4c09-956e-28fafb70fe3a tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:56:12.783960 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-73a1ba27-f58a-4c09-956e-28fafb70fe3a tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:56:13.111810 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-cc7bbd1c-6244-45d8-8b94-ae8d69eca9a7 req-2de2618a-5380-4c39-a06a-a2ccf80298f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16641093-2638-4915-b23d-0251c0cb7c4f", "tag": "3ac713b7-ef84-4647-8f9e-40b150a95654"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:56:13.123900 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-cc7bbd1c-6244-45d8-8b94-ae8d69eca9a7 req-2de2618a-5380-4c39-a06a-a2ccf80298f0 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:56:13.124643 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-cc7bbd1c-6244-45d8-8b94-ae8d69eca9a7 req-2de2618a-5380-4c39-a06a-a2ccf80298f0 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:56:13.125521 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-cc7bbd1c-6244-45d8-8b94-ae8d69eca9a7 req-2de2618a-5380-4c39-a06a-a2ccf80298f0 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:56:13.138995 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-cc7bbd1c-6244-45d8-8b94-ae8d69eca9a7 req-2de2618a-5380-4c39-a06a-a2ccf80298f0 service nova] Creating event network-changed:3ac713b7-ef84-4647-8f9e-40b150a95654 for instance 16641093-2638-4915-b23d-0251c0cb7c4f on nch2-master-1 Oct 08 21:56:13.145707 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-cc7bbd1c-6244-45d8-8b94-ae8d69eca9a7 req-2de2618a-5380-4c39-a06a-a2ccf80298f0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037894 Oct 08 21:56:13.146584 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3365/6803] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:56:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 08 21:56:13.340273 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-73a1ba27-f58a-4c09-956e-28fafb70fe3a tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a96d23b9a84b03a0549f1d57be4779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c1dbcc78cc4349b68eb40eb879be88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:56:13.350019 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-73a1ba27-f58a-4c09-956e-28fafb70fe3a tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] 10.222.0.26 "GET /compute/v2.1/servers/16641093-2638-4915-b23d-0251c0cb7c4f" status: 200 len: 1760 microversion: 2.1 time: 0.582783 Oct 08 21:56:13.350463 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3439/6804] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:56:12 2022] GET /compute/v2.1/servers/16641093-2638-4915-b23d-0251c0cb7c4f => generated 1760 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:56:35.107837 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-67fdb4a6-ecdf-4590-8510-96906a885c32 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:56:35.110253 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-67fdb4a6-ecdf-4590-8510-96906a885c32 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] [instance: 16641093-2638-4915-b23d-0251c0cb7c4f] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:56:35.112526 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:SELECT=15 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:56:35.113279 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=72 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:56:35.119854 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-67fdb4a6-ecdf-4590-8510-96906a885c32 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:56:35.120352 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-67fdb4a6-ecdf-4590-8510-96906a885c32 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:56:35.120800 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-67fdb4a6-ecdf-4590-8510-96906a885c32 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:56:35.121559 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-67fdb4a6-ecdf-4590-8510-96906a885c32 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:56:35.122019 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-67fdb4a6-ecdf-4590-8510-96906a885c32 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:56:35.122451 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-67fdb4a6-ecdf-4590-8510-96906a885c32 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:56:35.197449 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-67fdb4a6-ecdf-4590-8510-96906a885c32 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] 10.222.0.26 "POST /compute/v2.1/servers/16641093-2638-4915-b23d-0251c0cb7c4f/action" status: 202 len: 0 microversion: 2.1 time: 0.094083 Oct 08 21:56:35.198087 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3366/6805] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:56:35 2022] POST /compute/v2.1/servers/16641093-2638-4915-b23d-0251c0cb7c4f/action => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 21:56:35.207237 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-1198bd9f-e0d2-4c82-ab28-3f79067cfce2 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:56:35.207912 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-1198bd9f-e0d2-4c82-ab28-3f79067cfce2 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] [instance: 16641093-2638-4915-b23d-0251c0cb7c4f] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:56:35.210954 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=2 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:56:35.211795 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:56:35.212455 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:56:35.218481 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1198bd9f-e0d2-4c82-ab28-3f79067cfce2 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:56:35.219602 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1198bd9f-e0d2-4c82-ab28-3f79067cfce2 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:56:35.220078 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1198bd9f-e0d2-4c82-ab28-3f79067cfce2 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:56:35.220830 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1198bd9f-e0d2-4c82-ab28-3f79067cfce2 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:56:35.221345 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1198bd9f-e0d2-4c82-ab28-3f79067cfce2 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:56:35.221809 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1198bd9f-e0d2-4c82-ab28-3f79067cfce2 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:56:35.473570 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-1198bd9f-e0d2-4c82-ab28-3f79067cfce2 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a96d23b9a84b03a0549f1d57be4779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c1dbcc78cc4349b68eb40eb879be88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:56:35.482988 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-1198bd9f-e0d2-4c82-ab28-3f79067cfce2 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] 10.222.0.26 "GET /compute/v2.1/servers/16641093-2638-4915-b23d-0251c0cb7c4f" status: 200 len: 1752 microversion: 2.1 time: 0.279128 Oct 08 21:56:35.483811 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3440/6806] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:56:35 2022] GET /compute/v2.1/servers/16641093-2638-4915-b23d-0251c0cb7c4f => generated 1752 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:56:36.507330 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-f7f23728-4793-4ddd-976a-04d3848b4eaf tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:56:36.508043 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-f7f23728-4793-4ddd-976a-04d3848b4eaf tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] [instance: 16641093-2638-4915-b23d-0251c0cb7c4f] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:56:36.514376 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f7f23728-4793-4ddd-976a-04d3848b4eaf tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:56:36.514872 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f7f23728-4793-4ddd-976a-04d3848b4eaf tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:56:36.515319 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f7f23728-4793-4ddd-976a-04d3848b4eaf tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:56:36.516058 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f7f23728-4793-4ddd-976a-04d3848b4eaf tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:56:36.516520 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f7f23728-4793-4ddd-976a-04d3848b4eaf tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:56:36.516954 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f7f23728-4793-4ddd-976a-04d3848b4eaf tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:56:36.665037 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-f7f23728-4793-4ddd-976a-04d3848b4eaf tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a96d23b9a84b03a0549f1d57be4779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c1dbcc78cc4349b68eb40eb879be88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:56:36.674055 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-f7f23728-4793-4ddd-976a-04d3848b4eaf tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] 10.222.0.26 "GET /compute/v2.1/servers/16641093-2638-4915-b23d-0251c0cb7c4f" status: 200 len: 1757 microversion: 2.1 time: 0.172012 Oct 08 21:56:36.674628 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3367/6807] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:56:36 2022] GET /compute/v2.1/servers/16641093-2638-4915-b23d-0251c0cb7c4f => generated 1757 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:56:37.697652 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-6f729ea4-eb02-42a9-a952-a7961865ee3d tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:56:37.698292 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-6f729ea4-eb02-42a9-a952-a7961865ee3d tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] [instance: 16641093-2638-4915-b23d-0251c0cb7c4f] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:56:37.705828 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6f729ea4-eb02-42a9-a952-a7961865ee3d tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:56:37.706332 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6f729ea4-eb02-42a9-a952-a7961865ee3d tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:56:37.706789 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6f729ea4-eb02-42a9-a952-a7961865ee3d tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:56:37.707502 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6f729ea4-eb02-42a9-a952-a7961865ee3d tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:56:37.707975 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6f729ea4-eb02-42a9-a952-a7961865ee3d tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:56:37.708426 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6f729ea4-eb02-42a9-a952-a7961865ee3d tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:56:37.850546 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-6f729ea4-eb02-42a9-a952-a7961865ee3d tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a96d23b9a84b03a0549f1d57be4779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c1dbcc78cc4349b68eb40eb879be88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:56:37.859479 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-6f729ea4-eb02-42a9-a952-a7961865ee3d tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] 10.222.0.26 "GET /compute/v2.1/servers/16641093-2638-4915-b23d-0251c0cb7c4f" status: 200 len: 1757 microversion: 2.1 time: 0.165730 Oct 08 21:56:37.860067 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3441/6808] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:56:37 2022] GET /compute/v2.1/servers/16641093-2638-4915-b23d-0251c0cb7c4f => generated 1757 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:56:38.883628 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c275e2da-4984-42da-b0dd-ecf7a334b6c4 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:56:38.884247 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-c275e2da-4984-42da-b0dd-ecf7a334b6c4 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] [instance: 16641093-2638-4915-b23d-0251c0cb7c4f] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:56:38.891818 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c275e2da-4984-42da-b0dd-ecf7a334b6c4 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:56:38.892314 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c275e2da-4984-42da-b0dd-ecf7a334b6c4 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:56:38.892761 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c275e2da-4984-42da-b0dd-ecf7a334b6c4 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:56:38.893501 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c275e2da-4984-42da-b0dd-ecf7a334b6c4 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:56:38.893966 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c275e2da-4984-42da-b0dd-ecf7a334b6c4 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:56:38.894402 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c275e2da-4984-42da-b0dd-ecf7a334b6c4 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:56:39.037097 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-c275e2da-4984-42da-b0dd-ecf7a334b6c4 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a96d23b9a84b03a0549f1d57be4779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c1dbcc78cc4349b68eb40eb879be88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:56:39.045699 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-c275e2da-4984-42da-b0dd-ecf7a334b6c4 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] 10.222.0.26 "GET /compute/v2.1/servers/16641093-2638-4915-b23d-0251c0cb7c4f" status: 200 len: 1757 microversion: 2.1 time: 0.166028 Oct 08 21:56:39.046275 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3368/6809] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:56:38 2022] GET /compute/v2.1/servers/16641093-2638-4915-b23d-0251c0cb7c4f => generated 1757 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:56:40.069523 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-50f38654-b4ea-479f-bfbc-6bcaf416476a tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:56:40.070217 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-50f38654-b4ea-479f-bfbc-6bcaf416476a tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] [instance: 16641093-2638-4915-b23d-0251c0cb7c4f] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:56:40.077873 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-50f38654-b4ea-479f-bfbc-6bcaf416476a tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:56:40.078383 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-50f38654-b4ea-479f-bfbc-6bcaf416476a tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:56:40.078840 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-50f38654-b4ea-479f-bfbc-6bcaf416476a tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:56:40.079564 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-50f38654-b4ea-479f-bfbc-6bcaf416476a tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:56:40.080055 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-50f38654-b4ea-479f-bfbc-6bcaf416476a tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:56:40.080485 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-50f38654-b4ea-479f-bfbc-6bcaf416476a tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:56:40.228181 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-50f38654-b4ea-479f-bfbc-6bcaf416476a tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a96d23b9a84b03a0549f1d57be4779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c1dbcc78cc4349b68eb40eb879be88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:56:40.236621 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-50f38654-b4ea-479f-bfbc-6bcaf416476a tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] 10.222.0.26 "GET /compute/v2.1/servers/16641093-2638-4915-b23d-0251c0cb7c4f" status: 200 len: 1757 microversion: 2.1 time: 0.171163 Oct 08 21:56:40.237220 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3442/6810] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:56:40 2022] GET /compute/v2.1/servers/16641093-2638-4915-b23d-0251c0cb7c4f => generated 1757 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:56:41.259714 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-1c3a3859-aaa8-445c-a274-1e8b36f981fe tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:56:41.260333 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-1c3a3859-aaa8-445c-a274-1e8b36f981fe tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] [instance: 16641093-2638-4915-b23d-0251c0cb7c4f] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:56:41.267384 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1c3a3859-aaa8-445c-a274-1e8b36f981fe tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:56:41.267874 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1c3a3859-aaa8-445c-a274-1e8b36f981fe tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:56:41.268317 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1c3a3859-aaa8-445c-a274-1e8b36f981fe tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:56:41.269022 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1c3a3859-aaa8-445c-a274-1e8b36f981fe tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:56:41.269521 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1c3a3859-aaa8-445c-a274-1e8b36f981fe tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:56:41.269955 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1c3a3859-aaa8-445c-a274-1e8b36f981fe tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:56:41.414251 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-1c3a3859-aaa8-445c-a274-1e8b36f981fe tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a96d23b9a84b03a0549f1d57be4779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c1dbcc78cc4349b68eb40eb879be88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:56:41.423280 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-1c3a3859-aaa8-445c-a274-1e8b36f981fe tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] 10.222.0.26 "GET /compute/v2.1/servers/16641093-2638-4915-b23d-0251c0cb7c4f" status: 200 len: 1757 microversion: 2.1 time: 0.167496 Oct 08 21:56:41.423853 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3369/6811] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:56:41 2022] GET /compute/v2.1/servers/16641093-2638-4915-b23d-0251c0cb7c4f => generated 1757 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:56:42.446154 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-b6cf7794-d9f6-4c59-aca2-242d5392bf5e tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:56:42.446828 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-b6cf7794-d9f6-4c59-aca2-242d5392bf5e tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] [instance: 16641093-2638-4915-b23d-0251c0cb7c4f] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:56:42.453071 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b6cf7794-d9f6-4c59-aca2-242d5392bf5e tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:56:42.453619 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b6cf7794-d9f6-4c59-aca2-242d5392bf5e tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:56:42.454086 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b6cf7794-d9f6-4c59-aca2-242d5392bf5e tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:56:42.454806 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b6cf7794-d9f6-4c59-aca2-242d5392bf5e tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:56:42.455289 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b6cf7794-d9f6-4c59-aca2-242d5392bf5e tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:56:42.455740 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b6cf7794-d9f6-4c59-aca2-242d5392bf5e tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:56:42.599257 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-b6cf7794-d9f6-4c59-aca2-242d5392bf5e tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a96d23b9a84b03a0549f1d57be4779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c1dbcc78cc4349b68eb40eb879be88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:56:42.607954 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-b6cf7794-d9f6-4c59-aca2-242d5392bf5e tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] 10.222.0.26 "GET /compute/v2.1/servers/16641093-2638-4915-b23d-0251c0cb7c4f" status: 200 len: 1757 microversion: 2.1 time: 0.165899 Oct 08 21:56:42.608542 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3443/6812] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:56:42 2022] GET /compute/v2.1/servers/16641093-2638-4915-b23d-0251c0cb7c4f => generated 1757 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:56:43.632369 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-8754d3de-5a62-461c-9cbc-086a721ad35a tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:56:43.632980 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-8754d3de-5a62-461c-9cbc-086a721ad35a tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] [instance: 16641093-2638-4915-b23d-0251c0cb7c4f] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:56:43.639860 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8754d3de-5a62-461c-9cbc-086a721ad35a tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:56:43.640348 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8754d3de-5a62-461c-9cbc-086a721ad35a tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:56:43.640796 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8754d3de-5a62-461c-9cbc-086a721ad35a tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:56:43.641515 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8754d3de-5a62-461c-9cbc-086a721ad35a tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:56:43.641974 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8754d3de-5a62-461c-9cbc-086a721ad35a tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:56:43.643014 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8754d3de-5a62-461c-9cbc-086a721ad35a tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:56:43.782798 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-8754d3de-5a62-461c-9cbc-086a721ad35a tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a96d23b9a84b03a0549f1d57be4779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c1dbcc78cc4349b68eb40eb879be88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:56:43.791361 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-8754d3de-5a62-461c-9cbc-086a721ad35a tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] 10.222.0.26 "GET /compute/v2.1/servers/16641093-2638-4915-b23d-0251c0cb7c4f" status: 200 len: 1757 microversion: 2.1 time: 0.162865 Oct 08 21:56:43.791948 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3370/6813] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:56:43 2022] GET /compute/v2.1/servers/16641093-2638-4915-b23d-0251c0cb7c4f => generated 1757 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:56:44.816176 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-c9d529fb-12b8-4b7c-8653-04ec36552276 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:56:44.816819 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-c9d529fb-12b8-4b7c-8653-04ec36552276 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] [instance: 16641093-2638-4915-b23d-0251c0cb7c4f] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:56:44.823757 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c9d529fb-12b8-4b7c-8653-04ec36552276 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:56:44.824268 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c9d529fb-12b8-4b7c-8653-04ec36552276 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:56:44.824728 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c9d529fb-12b8-4b7c-8653-04ec36552276 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:56:44.825563 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c9d529fb-12b8-4b7c-8653-04ec36552276 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:56:44.826051 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c9d529fb-12b8-4b7c-8653-04ec36552276 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:56:44.826539 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c9d529fb-12b8-4b7c-8653-04ec36552276 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:56:44.971304 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-c9d529fb-12b8-4b7c-8653-04ec36552276 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a96d23b9a84b03a0549f1d57be4779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c1dbcc78cc4349b68eb40eb879be88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:56:44.979731 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-c9d529fb-12b8-4b7c-8653-04ec36552276 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] 10.222.0.26 "GET /compute/v2.1/servers/16641093-2638-4915-b23d-0251c0cb7c4f" status: 200 len: 1757 microversion: 2.1 time: 0.168386 Oct 08 21:56:44.980319 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3444/6814] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:56:44 2022] GET /compute/v2.1/servers/16641093-2638-4915-b23d-0251c0cb7c4f => generated 1757 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:56:46.002159 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-ff76326f-4858-4c77-aa9c-2cf776dec42d tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:56:46.002775 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-ff76326f-4858-4c77-aa9c-2cf776dec42d tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] [instance: 16641093-2638-4915-b23d-0251c0cb7c4f] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:56:46.009832 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ff76326f-4858-4c77-aa9c-2cf776dec42d tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:56:46.010330 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ff76326f-4858-4c77-aa9c-2cf776dec42d tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:56:46.010805 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ff76326f-4858-4c77-aa9c-2cf776dec42d tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:56:46.011509 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ff76326f-4858-4c77-aa9c-2cf776dec42d tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:56:46.011971 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ff76326f-4858-4c77-aa9c-2cf776dec42d tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:56:46.012405 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ff76326f-4858-4c77-aa9c-2cf776dec42d tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:56:46.153873 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-ff76326f-4858-4c77-aa9c-2cf776dec42d tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a96d23b9a84b03a0549f1d57be4779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c1dbcc78cc4349b68eb40eb879be88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:56:46.162812 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-ff76326f-4858-4c77-aa9c-2cf776dec42d tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] 10.222.0.26 "GET /compute/v2.1/servers/16641093-2638-4915-b23d-0251c0cb7c4f" status: 200 len: 1757 microversion: 2.1 time: 0.164745 Oct 08 21:56:46.163388 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3371/6815] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:56:45 2022] GET /compute/v2.1/servers/16641093-2638-4915-b23d-0251c0cb7c4f => generated 1757 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:56:47.186836 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-5de3be98-5c8c-4a5a-98fa-3710bca110c7 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:56:47.187668 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-5de3be98-5c8c-4a5a-98fa-3710bca110c7 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] [instance: 16641093-2638-4915-b23d-0251c0cb7c4f] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:56:47.194809 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5de3be98-5c8c-4a5a-98fa-3710bca110c7 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:56:47.195318 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5de3be98-5c8c-4a5a-98fa-3710bca110c7 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:56:47.195783 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5de3be98-5c8c-4a5a-98fa-3710bca110c7 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:56:47.196500 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5de3be98-5c8c-4a5a-98fa-3710bca110c7 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:56:47.196979 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5de3be98-5c8c-4a5a-98fa-3710bca110c7 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:56:47.197456 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5de3be98-5c8c-4a5a-98fa-3710bca110c7 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:56:47.338209 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-5de3be98-5c8c-4a5a-98fa-3710bca110c7 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a96d23b9a84b03a0549f1d57be4779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c1dbcc78cc4349b68eb40eb879be88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:56:47.348666 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-5de3be98-5c8c-4a5a-98fa-3710bca110c7 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] 10.222.0.26 "GET /compute/v2.1/servers/16641093-2638-4915-b23d-0251c0cb7c4f" status: 200 len: 1760 microversion: 2.1 time: 0.166334 Oct 08 21:56:47.349482 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3445/6816] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:56:47 2022] GET /compute/v2.1/servers/16641093-2638-4915-b23d-0251c0cb7c4f => generated 1760 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:57:19.859373 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-2b56598e-1504-432a-ad8b-2863780925d8 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1530941005"}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:57:19.859990 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-2b56598e-1504-432a-ad8b-2863780925d8 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] [instance: 16641093-2638-4915-b23d-0251c0cb7c4f] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:57:19.862375 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:SELECT=12 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:57:19.863055 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:57:19.868747 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2b56598e-1504-432a-ad8b-2863780925d8 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:57:19.869299 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2b56598e-1504-432a-ad8b-2863780925d8 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:57:19.869747 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2b56598e-1504-432a-ad8b-2863780925d8 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:57:19.870452 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2b56598e-1504-432a-ad8b-2863780925d8 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:57:19.870911 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2b56598e-1504-432a-ad8b-2863780925d8 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:57:19.871344 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2b56598e-1504-432a-ad8b-2863780925d8 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:57:20.002805 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.network.security_group_api [None req-2b56598e-1504-432a-ad8b-2863780925d8 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Removing security group 30c0a4d7-bc84-473f-a377-f984db7f0116 from port 3ac713b7-ef84-4647-8f9e-40b150a95654 Oct 08 21:57:20.301259 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-2b56598e-1504-432a-ad8b-2863780925d8 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] 10.222.0.26 "POST /compute/v2.1/servers/16641093-2638-4915-b23d-0251c0cb7c4f/action" status: 202 len: 0 microversion: 2.1 time: 0.445801 Oct 08 21:57:20.311434 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3372/6817] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:57:19 2022] POST /compute/v2.1/servers/16641093-2638-4915-b23d-0251c0cb7c4f/action => generated 0 bytes in 457 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 21:57:20.314271 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-dcb9fa0d-d380-4401-8f3a-a9475c38c040 req-a2ba52c7-4dee-4ffb-bd46-e414d63288a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16641093-2638-4915-b23d-0251c0cb7c4f", "tag": "3ac713b7-ef84-4647-8f9e-40b150a95654"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:57:20.323502 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=12 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:57:20.324787 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=36 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:57:20.326756 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-dcb9fa0d-d380-4401-8f3a-a9475c38c040 req-a2ba52c7-4dee-4ffb-bd46-e414d63288a8 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:57:20.327309 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-dcb9fa0d-d380-4401-8f3a-a9475c38c040 req-a2ba52c7-4dee-4ffb-bd46-e414d63288a8 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:57:20.327741 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-dcb9fa0d-d380-4401-8f3a-a9475c38c040 req-a2ba52c7-4dee-4ffb-bd46-e414d63288a8 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:57:20.340536 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-dcb9fa0d-d380-4401-8f3a-a9475c38c040 req-a2ba52c7-4dee-4ffb-bd46-e414d63288a8 service nova] Creating event network-changed:3ac713b7-ef84-4647-8f9e-40b150a95654 for instance 16641093-2638-4915-b23d-0251c0cb7c4f on nch2-master-1 Oct 08 21:57:20.347975 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-dcb9fa0d-d380-4401-8f3a-a9475c38c040 req-a2ba52c7-4dee-4ffb-bd46-e414d63288a8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038565 Oct 08 21:57:20.348926 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3446/6818] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:57:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:57:21.675069 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-6c89aa03-8f27-4a3c-ab17-0c453a1685ee tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:57:21.675581 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-6c89aa03-8f27-4a3c-ab17-0c453a1685ee tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] [instance: 16641093-2638-4915-b23d-0251c0cb7c4f] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:57:21.681753 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6c89aa03-8f27-4a3c-ab17-0c453a1685ee tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:57:21.682244 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6c89aa03-8f27-4a3c-ab17-0c453a1685ee tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:57:21.682981 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6c89aa03-8f27-4a3c-ab17-0c453a1685ee tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:57:21.683686 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6c89aa03-8f27-4a3c-ab17-0c453a1685ee tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:57:21.684159 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6c89aa03-8f27-4a3c-ab17-0c453a1685ee tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:57:21.684570 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6c89aa03-8f27-4a3c-ab17-0c453a1685ee tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:57:21.768573 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.objects.instance [None req-6c89aa03-8f27-4a3c-ab17-0c453a1685ee tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lazy-loading 'services' on Instance uuid 16641093-2638-4915-b23d-0251c0cb7c4f {{(pid=140491) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 21:57:21.842848 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-6c89aa03-8f27-4a3c-ab17-0c453a1685ee tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] 10.222.0.26 "DELETE /compute/v2.1/servers/16641093-2638-4915-b23d-0251c0cb7c4f/os-volume_attachments/0dff6fc1-abc9-4ff3-8bc4-2f1726cfbfaf" status: 202 len: 0 microversion: 2.1 time: 0.172575 Oct 08 21:57:21.843739 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3373/6819] 10.222.0.26 () {58 vars in 1416 bytes} [Sat Oct 8 21:57:21 2022] DELETE /compute/v2.1/servers/16641093-2638-4915-b23d-0251c0cb7c4f/os-volume_attachments/0dff6fc1-abc9-4ff3-8bc4-2f1726cfbfaf => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 21:57:21.854716 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-5b57efee-b764-4bfc-9686-80f051a1cc50 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:57:21.857452 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-5b57efee-b764-4bfc-9686-80f051a1cc50 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] [instance: 16641093-2638-4915-b23d-0251c0cb7c4f] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:57:21.864396 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5b57efee-b764-4bfc-9686-80f051a1cc50 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:57:21.864899 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5b57efee-b764-4bfc-9686-80f051a1cc50 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:57:21.865468 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5b57efee-b764-4bfc-9686-80f051a1cc50 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:57:21.866199 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5b57efee-b764-4bfc-9686-80f051a1cc50 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:57:21.866684 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5b57efee-b764-4bfc-9686-80f051a1cc50 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:57:21.867167 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5b57efee-b764-4bfc-9686-80f051a1cc50 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:57:21.901379 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-5b57efee-b764-4bfc-9686-80f051a1cc50 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] 10.222.0.26 "GET /compute/v2.1/servers/16641093-2638-4915-b23d-0251c0cb7c4f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052216 Oct 08 21:57:21.902129 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3447/6820] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Oct 8 21:57:21 2022] GET /compute/v2.1/servers/16641093-2638-4915-b23d-0251c0cb7c4f/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 08 21:57:22.371639 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-feed11c2-9057-4a4b-b323-e888888f2886 req-946f91e0-13c5-48a8-b88d-dc7acc806465 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16641093-2638-4915-b23d-0251c0cb7c4f", "tag": "3ac713b7-ef84-4647-8f9e-40b150a95654"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:57:22.382204 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-feed11c2-9057-4a4b-b323-e888888f2886 req-946f91e0-13c5-48a8-b88d-dc7acc806465 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:57:22.382686 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-feed11c2-9057-4a4b-b323-e888888f2886 req-946f91e0-13c5-48a8-b88d-dc7acc806465 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:57:22.383130 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-feed11c2-9057-4a4b-b323-e888888f2886 req-946f91e0-13c5-48a8-b88d-dc7acc806465 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:57:22.395339 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-feed11c2-9057-4a4b-b323-e888888f2886 req-946f91e0-13c5-48a8-b88d-dc7acc806465 service nova] Creating event network-changed:3ac713b7-ef84-4647-8f9e-40b150a95654 for instance 16641093-2638-4915-b23d-0251c0cb7c4f on nch2-master-1 Oct 08 21:57:22.400276 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-feed11c2-9057-4a4b-b323-e888888f2886 req-946f91e0-13c5-48a8-b88d-dc7acc806465 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032779 Oct 08 21:57:22.401118 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3374/6821] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:57:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:57:22.914648 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-a9b37895-f81b-4d5f-814b-ee60cbc5e9f2 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:57:22.916919 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-a9b37895-f81b-4d5f-814b-ee60cbc5e9f2 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] [instance: 16641093-2638-4915-b23d-0251c0cb7c4f] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:57:22.924588 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a9b37895-f81b-4d5f-814b-ee60cbc5e9f2 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:57:22.925111 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a9b37895-f81b-4d5f-814b-ee60cbc5e9f2 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:57:22.925611 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a9b37895-f81b-4d5f-814b-ee60cbc5e9f2 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:57:22.926351 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a9b37895-f81b-4d5f-814b-ee60cbc5e9f2 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:57:22.926858 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a9b37895-f81b-4d5f-814b-ee60cbc5e9f2 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:57:22.927339 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a9b37895-f81b-4d5f-814b-ee60cbc5e9f2 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:57:22.957176 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-a9b37895-f81b-4d5f-814b-ee60cbc5e9f2 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] 10.222.0.26 "GET /compute/v2.1/servers/16641093-2638-4915-b23d-0251c0cb7c4f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046654 Oct 08 21:57:22.957774 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3448/6822] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Oct 8 21:57:22 2022] GET /compute/v2.1/servers/16641093-2638-4915-b23d-0251c0cb7c4f/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 08 21:57:22.970866 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-8bf89b5b-a2a7-4166-ac59-704f91da3482 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:57:22.971494 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-8bf89b5b-a2a7-4166-ac59-704f91da3482 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] [instance: 16641093-2638-4915-b23d-0251c0cb7c4f] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:57:22.977862 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8bf89b5b-a2a7-4166-ac59-704f91da3482 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:57:22.978304 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8bf89b5b-a2a7-4166-ac59-704f91da3482 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:57:22.978768 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8bf89b5b-a2a7-4166-ac59-704f91da3482 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:57:22.979460 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8bf89b5b-a2a7-4166-ac59-704f91da3482 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:57:22.979925 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8bf89b5b-a2a7-4166-ac59-704f91da3482 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:57:22.980362 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8bf89b5b-a2a7-4166-ac59-704f91da3482 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:57:23.056038 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-8bf89b5b-a2a7-4166-ac59-704f91da3482 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] HTTP exception thrown: Instance 16641093-2638-4915-b23d-0251c0cb7c4f is not attached to volume 0dff6fc1-abc9-4ff3-8bc4-2f1726cfbfaf Oct 08 21:57:23.057700 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-8bf89b5b-a2a7-4166-ac59-704f91da3482 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Request method failure captured: Oct 08 21:57:23.057700 ncdv-master-1 devstack@n-api.service[140491]: request: DELETE /compute/v2.1/servers/16641093-2638-4915-b23d-0251c0cb7c4f/os-volume_attachments/0dff6fc1-abc9-4ff3-8bc4-2f1726cfbfaf HTTP/1.1 Oct 08 21:57:23.057700 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:57:23.057700 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:57:23.057700 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:57:23.057700 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 21:57:23.057700 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:57:23.057700 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:57:23.057700 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:57:23.057700 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:57:23.057700 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQfDK0sBnxU25-toQPjh_xlwPkHFtbUJ-L4j_XNO91caR-FXh3oY0uT1RffaG8s3SCYVdNccTclIikzi8dM3iTgFFGtVUdvDq35frKe6hsf1XJvYt7YKrNrk6Oepi3xL1jjhiRnyYH23PsIa3Kg_0xCK4ucp_ftAbw-ZeUGyjv8cyoqQ Oct 08 21:57:23.057700 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:57:23.057700 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:57:23.057700 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:57:23.057700 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:57:23.057700 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:57:23.057700 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:57:23.057700 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: c3c1dbcc78cc4349b68eb40eb879be88 Oct 08 21:57:23.057700 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-TestMinimumBasicScenario-734937097 Oct 08 21:57:23.057700 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:57:23.057700 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:57:23.057700 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/c3c1dbcc78cc4349b68eb40eb879be88"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c3c1dbcc78cc4349b68eb40eb879be88"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_c3c1dbcc78cc4349b68eb40eb879be88"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c3c1dbcc78cc4349b68eb40eb879be88"}]}] Oct 08 21:57:23.057700 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-TestMinimumBasicScenario-734937097 Oct 08 21:57:23.057700 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: c3c1dbcc78cc4349b68eb40eb879be88 Oct 08 21:57:23.057700 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-TestMinimumBasicScenario-734937097 Oct 08 21:57:23.057700 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-TestMinimumBasicScenario-734937097-project Oct 08 21:57:23.057700 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:57:23.057700 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:57:23.057700 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 80a96d23b9a84b03a0549f1d57be4779 Oct 08 21:57:23.057700 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-TestMinimumBasicScenario-734937097-project Oct 08 21:57:23.057700 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:57:23.057700 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance 16641093-2638-4915-b23d-0251c0cb7c4f is not attached to volume 0dff6fc1-abc9-4ff3-8bc4-2f1726cfbfaf Oct 08 21:57:23.057700 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'server_id': '16641093-2638-4915-b23d-0251c0cb7c4f', 'id': '0dff6fc1-abc9-4ff3-8bc4-2f1726cfbfaf'} Oct 08 21:57:23.057700 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:57:23.057700 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:57:23.057700 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 08 21:57:23.057700 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 08 21:57:23.057700 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 08 21:57:23.057700 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 08 21:57:23.057700 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 08 21:57:23.057700 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 08 21:57:23.057700 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 0dff6fc1-abc9-4ff3-8bc4-2f1726cfbfaf. Oct 08 21:57:23.057700 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:57:23.057700 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:57:23.057700 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:57:23.057700 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:57:23.057700 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:57:23.057700 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:57:23.057700 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:57:23.057700 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:57:23.057700 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:57:23.057700 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:57:23.057700 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 08 21:57:23.057700 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 08 21:57:23.057700 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16641093-2638-4915-b23d-0251c0cb7c4f is not attached to volume 0dff6fc1-abc9-4ff3-8bc4-2f1726cfbfaf Oct 08 21:57:23.057700 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:57:23.057700 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:57:23.057700 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:57:23.057700 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:57:23.057700 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:57:23.057700 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:57:23.062714 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:57:23.062714 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:57:23.062714 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16641093-2638-4915-b23d-0251c0cb7c4f is not attached to volume 0dff6fc1-abc9-4ff3-8bc4-2f1726cfbfaf Oct 08 21:57:23.062714 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:57:23.062714 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-8bf89b5b-a2a7-4166-ac59-704f91da3482 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Returning 404 to user: Instance 16641093-2638-4915-b23d-0251c0cb7c4f is not attached to volume 0dff6fc1-abc9-4ff3-8bc4-2f1726cfbfaf {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:57:23.062714 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-8bf89b5b-a2a7-4166-ac59-704f91da3482 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] 10.222.0.26 "DELETE /compute/v2.1/servers/16641093-2638-4915-b23d-0251c0cb7c4f/os-volume_attachments/0dff6fc1-abc9-4ff3-8bc4-2f1726cfbfaf" status: 404 len: 154 microversion: 2.1 time: 0.094424 Oct 08 21:57:23.062714 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3375/6823] 10.222.0.26 () {58 vars in 1416 bytes} [Sat Oct 8 21:57:22 2022] DELETE /compute/v2.1/servers/16641093-2638-4915-b23d-0251c0cb7c4f/os-volume_attachments/0dff6fc1-abc9-4ff3-8bc4-2f1726cfbfaf => generated 154 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:57:24.204555 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-3d8c8635-e2dd-4320-bc10-2ed8223ec095 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:57:24.205115 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-3d8c8635-e2dd-4320-bc10-2ed8223ec095 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] [instance: 16641093-2638-4915-b23d-0251c0cb7c4f] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:57:24.212183 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3d8c8635-e2dd-4320-bc10-2ed8223ec095 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:57:24.212694 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3d8c8635-e2dd-4320-bc10-2ed8223ec095 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:57:24.213163 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3d8c8635-e2dd-4320-bc10-2ed8223ec095 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:57:24.213927 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3d8c8635-e2dd-4320-bc10-2ed8223ec095 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:57:24.214418 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3d8c8635-e2dd-4320-bc10-2ed8223ec095 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:57:24.214915 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3d8c8635-e2dd-4320-bc10-2ed8223ec095 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:57:24.241373 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-3d8c8635-e2dd-4320-bc10-2ed8223ec095 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] [instance: 16641093-2638-4915-b23d-0251c0cb7c4f] Going to try to terminate instance {{(pid=140492) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 21:57:24.316010 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-3d8c8635-e2dd-4320-bc10-2ed8223ec095 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] 10.222.0.26 "DELETE /compute/v2.1/servers/16641093-2638-4915-b23d-0251c0cb7c4f" status: 204 len: 0 microversion: 2.1 time: 0.115217 Oct 08 21:57:24.316600 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3449/6824] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:57:24 2022] DELETE /compute/v2.1/servers/16641093-2638-4915-b23d-0251c0cb7c4f => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 21:57:24.324741 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-73e1a03f-50ce-4cd7-9df2-dbdd3eb8d1b2 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:57:24.325412 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-73e1a03f-50ce-4cd7-9df2-dbdd3eb8d1b2 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] [instance: 16641093-2638-4915-b23d-0251c0cb7c4f] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:57:24.332818 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-73e1a03f-50ce-4cd7-9df2-dbdd3eb8d1b2 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:57:24.333339 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-73e1a03f-50ce-4cd7-9df2-dbdd3eb8d1b2 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:57:24.333784 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-73e1a03f-50ce-4cd7-9df2-dbdd3eb8d1b2 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:57:24.334625 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-73e1a03f-50ce-4cd7-9df2-dbdd3eb8d1b2 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:57:24.334978 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-73e1a03f-50ce-4cd7-9df2-dbdd3eb8d1b2 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:57:24.335692 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-73e1a03f-50ce-4cd7-9df2-dbdd3eb8d1b2 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:57:24.468295 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-73e1a03f-50ce-4cd7-9df2-dbdd3eb8d1b2 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a96d23b9a84b03a0549f1d57be4779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c1dbcc78cc4349b68eb40eb879be88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:57:24.476440 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-73e1a03f-50ce-4cd7-9df2-dbdd3eb8d1b2 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] 10.222.0.26 "GET /compute/v2.1/servers/16641093-2638-4915-b23d-0251c0cb7c4f" status: 200 len: 1554 microversion: 2.1 time: 0.155487 Oct 08 21:57:24.477031 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3376/6825] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:57:24 2022] GET /compute/v2.1/servers/16641093-2638-4915-b23d-0251c0cb7c4f => generated 1554 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:57:25.500440 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-24b99ca9-aed7-4b6e-810d-260ccd7fcef9 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:57:25.501305 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-24b99ca9-aed7-4b6e-810d-260ccd7fcef9 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] [instance: 16641093-2638-4915-b23d-0251c0cb7c4f] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:57:25.509113 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-24b99ca9-aed7-4b6e-810d-260ccd7fcef9 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:57:25.509653 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-24b99ca9-aed7-4b6e-810d-260ccd7fcef9 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:57:25.510146 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-24b99ca9-aed7-4b6e-810d-260ccd7fcef9 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:57:25.510871 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-24b99ca9-aed7-4b6e-810d-260ccd7fcef9 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:57:25.511355 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-24b99ca9-aed7-4b6e-810d-260ccd7fcef9 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:57:25.511809 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-24b99ca9-aed7-4b6e-810d-260ccd7fcef9 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:57:25.646142 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-24b99ca9-aed7-4b6e-810d-260ccd7fcef9 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a96d23b9a84b03a0549f1d57be4779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c1dbcc78cc4349b68eb40eb879be88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:57:25.654080 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-24b99ca9-aed7-4b6e-810d-260ccd7fcef9 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] 10.222.0.26 "GET /compute/v2.1/servers/16641093-2638-4915-b23d-0251c0cb7c4f" status: 200 len: 1554 microversion: 2.1 time: 0.158036 Oct 08 21:57:25.654667 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3450/6826] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:57:25 2022] GET /compute/v2.1/servers/16641093-2638-4915-b23d-0251c0cb7c4f => generated 1554 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:57:26.564320 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-6fd3b322-36d6-4fca-9415-0249cdea1425 req-572ff3e0-0160-408b-afd9-3f1104e6e874 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16641093-2638-4915-b23d-0251c0cb7c4f", "name": "network-vif-deleted", "tag": "3ac713b7-ef84-4647-8f9e-40b150a95654"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:57:26.577449 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-6fd3b322-36d6-4fca-9415-0249cdea1425 req-572ff3e0-0160-408b-afd9-3f1104e6e874 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:57:26.577934 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-6fd3b322-36d6-4fca-9415-0249cdea1425 req-572ff3e0-0160-408b-afd9-3f1104e6e874 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:57:26.578371 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-6fd3b322-36d6-4fca-9415-0249cdea1425 req-572ff3e0-0160-408b-afd9-3f1104e6e874 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:57:26.590503 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-6fd3b322-36d6-4fca-9415-0249cdea1425 req-572ff3e0-0160-408b-afd9-3f1104e6e874 service nova] Creating event network-vif-deleted:3ac713b7-ef84-4647-8f9e-40b150a95654 for instance 16641093-2638-4915-b23d-0251c0cb7c4f on nch2-master-1 Oct 08 21:57:26.596129 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-6fd3b322-36d6-4fca-9415-0249cdea1425 req-572ff3e0-0160-408b-afd9-3f1104e6e874 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035275 Oct 08 21:57:26.596747 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3377/6827] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:57:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:57:26.678991 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-6bf08b72-1108-428c-b154-31d0d07fcb7f tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:57:26.679636 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-6bf08b72-1108-428c-b154-31d0d07fcb7f tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] [instance: 16641093-2638-4915-b23d-0251c0cb7c4f] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:57:26.686909 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6bf08b72-1108-428c-b154-31d0d07fcb7f tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:57:26.687681 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6bf08b72-1108-428c-b154-31d0d07fcb7f tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:57:26.688362 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6bf08b72-1108-428c-b154-31d0d07fcb7f tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:57:26.689133 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6bf08b72-1108-428c-b154-31d0d07fcb7f tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:57:26.689649 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6bf08b72-1108-428c-b154-31d0d07fcb7f tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:57:26.690107 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6bf08b72-1108-428c-b154-31d0d07fcb7f tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:57:26.722758 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6bf08b72-1108-428c-b154-31d0d07fcb7f tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:57:26.723221 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6bf08b72-1108-428c-b154-31d0d07fcb7f tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:57:26.723683 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6bf08b72-1108-428c-b154-31d0d07fcb7f tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:57:26.724171 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.objects.instance [None req-6bf08b72-1108-428c-b154-31d0d07fcb7f tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lazy-loading 'fault' on Instance uuid 16641093-2638-4915-b23d-0251c0cb7c4f {{(pid=140492) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 21:57:26.769085 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-6bf08b72-1108-428c-b154-31d0d07fcb7f tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a96d23b9a84b03a0549f1d57be4779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c1dbcc78cc4349b68eb40eb879be88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:57:26.777073 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-6bf08b72-1108-428c-b154-31d0d07fcb7f tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] 10.222.0.26 "GET /compute/v2.1/servers/16641093-2638-4915-b23d-0251c0cb7c4f" status: 200 len: 1348 microversion: 2.1 time: 0.101984 Oct 08 21:57:26.777629 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3451/6828] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:57:26 2022] GET /compute/v2.1/servers/16641093-2638-4915-b23d-0251c0cb7c4f => generated 1348 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:57:27.802425 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-d2d45de1-bb2e-4b1f-910c-f1d99cbadd3f tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:57:27.803133 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-d2d45de1-bb2e-4b1f-910c-f1d99cbadd3f tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] [instance: 16641093-2638-4915-b23d-0251c0cb7c4f] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:57:27.809479 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d2d45de1-bb2e-4b1f-910c-f1d99cbadd3f tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:57:27.810112 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d2d45de1-bb2e-4b1f-910c-f1d99cbadd3f tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:57:27.810560 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d2d45de1-bb2e-4b1f-910c-f1d99cbadd3f tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:57:27.811270 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d2d45de1-bb2e-4b1f-910c-f1d99cbadd3f tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:57:27.811774 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d2d45de1-bb2e-4b1f-910c-f1d99cbadd3f tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:57:27.812421 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d2d45de1-bb2e-4b1f-910c-f1d99cbadd3f tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:57:27.827076 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-d2d45de1-bb2e-4b1f-910c-f1d99cbadd3f tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] HTTP exception thrown: Instance 16641093-2638-4915-b23d-0251c0cb7c4f could not be found. Oct 08 21:57:27.828748 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-d2d45de1-bb2e-4b1f-910c-f1d99cbadd3f tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Request method failure captured: Oct 08 21:57:27.828748 ncdv-master-1 devstack@n-api.service[140491]: request: GET /compute/v2.1/servers/16641093-2638-4915-b23d-0251c0cb7c4f HTTP/1.1 Oct 08 21:57:27.828748 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 21:57:27.828748 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 21:57:27.828748 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 21:57:27.828748 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 21:57:27.828748 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 21:57:27.828748 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 21:57:27.828748 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 21:57:27.828748 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 21:57:27.828748 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQfDK0sBnxU25-toQPjh_xlwPkHFtbUJ-L4j_XNO91caR-FXh3oY0uT1RffaG8s3SCYVdNccTclIikzi8dM3iTgFFGtVUdvDq35frKe6hsf1XJvYt7YKrNrk6Oepi3xL1jjhiRnyYH23PsIa3Kg_0xCK4ucp_ftAbw-ZeUGyjv8cyoqQ Oct 08 21:57:27.828748 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 21:57:27.828748 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 21:57:27.828748 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 21:57:27.828748 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 21:57:27.828748 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 21:57:27.828748 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 21:57:27.828748 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: c3c1dbcc78cc4349b68eb40eb879be88 Oct 08 21:57:27.828748 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-TestMinimumBasicScenario-734937097 Oct 08 21:57:27.828748 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 21:57:27.828748 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 21:57:27.828748 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/c3c1dbcc78cc4349b68eb40eb879be88"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c3c1dbcc78cc4349b68eb40eb879be88"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_c3c1dbcc78cc4349b68eb40eb879be88"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c3c1dbcc78cc4349b68eb40eb879be88"}]}] Oct 08 21:57:27.828748 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-TestMinimumBasicScenario-734937097 Oct 08 21:57:27.828748 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: c3c1dbcc78cc4349b68eb40eb879be88 Oct 08 21:57:27.828748 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-TestMinimumBasicScenario-734937097 Oct 08 21:57:27.828748 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-TestMinimumBasicScenario-734937097-project Oct 08 21:57:27.828748 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 21:57:27.828748 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 21:57:27.828748 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 80a96d23b9a84b03a0549f1d57be4779 Oct 08 21:57:27.828748 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-TestMinimumBasicScenario-734937097-project Oct 08 21:57:27.828748 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 21:57:27.828748 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance 16641093-2638-4915-b23d-0251c0cb7c4f could not be found. Oct 08 21:57:27.828748 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': '16641093-2638-4915-b23d-0251c0cb7c4f'} Oct 08 21:57:27.828748 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:57:27.828748 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:57:27.828748 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:57:27.828748 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:57:27.828748 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:57:27.828748 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:57:27.828748 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:57:27.828748 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:57:27.828748 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:57:27.828748 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:57:27.828748 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16641093-2638-4915-b23d-0251c0cb7c4f could not be found. Oct 08 21:57:27.828748 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:57:27.828748 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:57:27.828748 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:57:27.828748 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:57:27.828748 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:57:27.828748 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:57:27.828748 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:57:27.828748 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:57:27.828748 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:57:27.828748 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:57:27.828748 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:57:27.828748 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:57:27.828748 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:57:27.828748 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:57:27.828748 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:57:27.828748 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:57:27.828748 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16641093-2638-4915-b23d-0251c0cb7c4f could not be found. Oct 08 21:57:27.828748 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:57:27.828748 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:57:27.828748 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:57:27.834840 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:57:27.834840 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:57:27.834840 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:57:27.834840 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:57:27.834840 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:57:27.834840 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16641093-2638-4915-b23d-0251c0cb7c4f could not be found. Oct 08 21:57:27.834840 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 21:57:27.834840 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-d2d45de1-bb2e-4b1f-910c-f1d99cbadd3f tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Returning 404 to user: Instance 16641093-2638-4915-b23d-0251c0cb7c4f could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:57:27.834840 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-d2d45de1-bb2e-4b1f-910c-f1d99cbadd3f tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] 10.222.0.26 "GET /compute/v2.1/servers/16641093-2638-4915-b23d-0251c0cb7c4f" status: 404 len: 111 microversion: 2.1 time: 0.033884 Oct 08 21:57:27.834840 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3378/6829] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:57:27 2022] GET /compute/v2.1/servers/16641093-2638-4915-b23d-0251c0cb7c4f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:57:27.839285 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-7a7c7d4e-3a64-4eb7-8ac6-ab58546c90b7 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] Calling method '.version_select at 0x7f1a9144a670>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:57:27.859489 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-7a7c7d4e-3a64-4eb7-8ac6-ab58546c90b7 tempest-TestMinimumBasicScenario-734937097 tempest-TestMinimumBasicScenario-734937097-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2064964880" status: 202 len: 0 microversion: 2.1 time: 0.024118 Oct 08 21:57:27.860083 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3452/6830] 10.222.0.26 () {58 vars in 1272 bytes} [Sat Oct 8 21:57:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2064964880 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 21:57:36.936306 ncdv-master-1 devstack@n-api.service[140491]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 08 21:57:36.936842 ncdv-master-1 devstack@n-api.service[140491]: Sat Oct 8 21:57:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.26) !!! Oct 08 21:57:37.099772 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-5f7cfa0d-a556-441c-b34f-58f2bed35902 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Action: 'create', calling method: .version_select at 0x7f1a8755f670>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-825523828", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLW4Y17se06GKdWT3dpu/ZE2rs03t1JQSqlj+F39Luo8wULkfJsP1CifkWmYDAcdTXtR5YwlhdzQWC1MW0kWakkeG8ZIDQbNBGHC6pN5gZGdHXFJkrwDzKaZoaWyqc+r8A=="}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:57:37.116228 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-5f7cfa0d-a556-441c-b34f-58f2bed35902 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Getting quotas for project b4acd2b59f7943cbb555876b9df70bee. Resources: {'key_pairs'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:57:37.121531 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-5f7cfa0d-a556-441c-b34f-58f2bed35902 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Getting quotas for user 771e9bc89e9d459e9e1714de7c514f4f and project b4acd2b59f7943cbb555876b9df70bee. Resources: {'key_pairs'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:57:37.146359 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-5f7cfa0d-a556-441c-b34f-58f2bed35902 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.216960 Oct 08 21:57:37.146966 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3379/6831] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Oct 8 21:57:36 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:57:42.820690 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-750a67b3-e938-4c14-b33b-0a45870ec321 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-733271194", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "networks": [{"uuid": "3f372ef7-0626-4dc1-8121-69a607702dc2"}], "key_name": "tempest-TestNetworkAdvancedServerOps-825523828", "security_groups": [{"name": "tempest-secgroup-smoke-1547131812"}]}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:57:42.844380 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:57:42.844718 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:57:42.960983 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.network.neutron [None req-750a67b3-e938-4c14-b33b-0a45870ec321 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] validate_networks() for [('3f372ef7-0626-4dc1-8121-69a607702dc2', None, None, None, None, None)] {{(pid=140492) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 21:57:43.361953 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-750a67b3-e938-4c14-b33b-0a45870ec321 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Flavor limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 21:57:43.362471 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-750a67b3-e938-4c14-b33b-0a45870ec321 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Image limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 21:57:43.363037 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-750a67b3-e938-4c14-b33b-0a45870ec321 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Flavor pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 21:57:43.363535 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-750a67b3-e938-4c14-b33b-0a45870ec321 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Image pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 21:57:43.364042 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-750a67b3-e938-4c14-b33b-0a45870ec321 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 21:57:43.373349 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-750a67b3-e938-4c14-b33b-0a45870ec321 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:57:43.373854 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-750a67b3-e938-4c14-b33b-0a45870ec321 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:57:43.374309 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-750a67b3-e938-4c14-b33b-0a45870ec321 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:57:43.375058 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-750a67b3-e938-4c14-b33b-0a45870ec321 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:57:43.375532 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-750a67b3-e938-4c14-b33b-0a45870ec321 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:57:43.375979 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-750a67b3-e938-4c14-b33b-0a45870ec321 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:57:43.394056 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-750a67b3-e938-4c14-b33b-0a45870ec321 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Getting quotas for project b4acd2b59f7943cbb555876b9df70bee. Resources: {'cores', 'instances', 'ram'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:57:43.400340 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-750a67b3-e938-4c14-b33b-0a45870ec321 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Getting quotas for user 771e9bc89e9d459e9e1714de7c514f4f and project b4acd2b59f7943cbb555876b9df70bee. Resources: {'cores', 'instances', 'ram'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:57:43.416544 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-750a67b3-e938-4c14-b33b-0a45870ec321 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Going to run 1 instances... {{(pid=140492) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 21:57:43.419112 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-750a67b3-e938-4c14-b33b-0a45870ec321 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: 94394628-4e7b-425a-9adb-12070de0fa31] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c508bd7f-7db9-4b2c-af7c-be54a855c355',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140492) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 21:57:43.469098 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-750a67b3-e938-4c14-b33b-0a45870ec321 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.652669 Oct 08 21:57:43.481488 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3453/6832] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 21:57:42 2022] POST /compute/v2.1/servers => generated 406 bytes in 654 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 08 21:57:43.485435 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=31,nova_cell1:INSERT=1 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:57:43.491547 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-221bcfb9-9a3e-4798-a003-f14828f113c7 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:57:43.493673 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-221bcfb9-9a3e-4798-a003-f14828f113c7 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: 94394628-4e7b-425a-9adb-12070de0fa31] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:57:43.565720 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-221bcfb9-9a3e-4798-a003-f14828f113c7 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771e9bc89e9d459e9e1714de7c514f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4acd2b59f7943cbb555876b9df70bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:57:43.574850 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-221bcfb9-9a3e-4798-a003-f14828f113c7 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "GET /compute/v2.1/servers/94394628-4e7b-425a-9adb-12070de0fa31" status: 200 len: 1265 microversion: 2.1 time: 0.093058 Oct 08 21:57:43.575806 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3380/6833] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:57:43 2022] GET /compute/v2.1/servers/94394628-4e7b-425a-9adb-12070de0fa31 => generated 1265 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:57:44.598828 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-25a88c5b-271c-4dcc-ad21-67ea8b2a6e9e tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:57:44.599458 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-25a88c5b-271c-4dcc-ad21-67ea8b2a6e9e tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: 94394628-4e7b-425a-9adb-12070de0fa31] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:57:44.607223 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-25a88c5b-271c-4dcc-ad21-67ea8b2a6e9e tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:57:44.607736 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-25a88c5b-271c-4dcc-ad21-67ea8b2a6e9e tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:57:44.608207 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-25a88c5b-271c-4dcc-ad21-67ea8b2a6e9e tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:57:44.608938 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-25a88c5b-271c-4dcc-ad21-67ea8b2a6e9e tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:57:44.609453 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-25a88c5b-271c-4dcc-ad21-67ea8b2a6e9e tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:57:44.609909 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-25a88c5b-271c-4dcc-ad21-67ea8b2a6e9e tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:57:44.679600 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-25a88c5b-271c-4dcc-ad21-67ea8b2a6e9e tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771e9bc89e9d459e9e1714de7c514f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4acd2b59f7943cbb555876b9df70bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:57:44.691820 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-25a88c5b-271c-4dcc-ad21-67ea8b2a6e9e tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "GET /compute/v2.1/servers/94394628-4e7b-425a-9adb-12070de0fa31" status: 200 len: 1317 microversion: 2.1 time: 0.096540 Oct 08 21:57:44.692448 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3454/6834] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:57:44 2022] GET /compute/v2.1/servers/94394628-4e7b-425a-9adb-12070de0fa31 => generated 1317 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:57:45.718668 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-a85ab1b4-bec9-40f6-b3e2-c125714890e1 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:57:45.720214 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-a85ab1b4-bec9-40f6-b3e2-c125714890e1 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: 94394628-4e7b-425a-9adb-12070de0fa31] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:57:45.731044 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a85ab1b4-bec9-40f6-b3e2-c125714890e1 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:57:45.731794 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a85ab1b4-bec9-40f6-b3e2-c125714890e1 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:57:45.732250 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a85ab1b4-bec9-40f6-b3e2-c125714890e1 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:57:45.733161 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a85ab1b4-bec9-40f6-b3e2-c125714890e1 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:57:45.733887 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a85ab1b4-bec9-40f6-b3e2-c125714890e1 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:57:45.734493 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a85ab1b4-bec9-40f6-b3e2-c125714890e1 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:57:46.002129 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-a85ab1b4-bec9-40f6-b3e2-c125714890e1 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771e9bc89e9d459e9e1714de7c514f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4acd2b59f7943cbb555876b9df70bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:57:46.010039 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-a85ab1b4-bec9-40f6-b3e2-c125714890e1 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "GET /compute/v2.1/servers/94394628-4e7b-425a-9adb-12070de0fa31" status: 200 len: 1391 microversion: 2.1 time: 0.296202 Oct 08 21:57:46.010624 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3381/6835] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:57:45 2022] GET /compute/v2.1/servers/94394628-4e7b-425a-9adb-12070de0fa31 => generated 1391 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:57:46.393092 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-4113c5d8-849c-43b5-bd04-3d19c9b12b2d req-ff806ab6-6f85-441e-9107-01ee88e50108 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94394628-4e7b-425a-9adb-12070de0fa31", "tag": "0244c9b2-f1e4-452a-b390-8f539eb6054a"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:57:46.405875 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-4113c5d8-849c-43b5-bd04-3d19c9b12b2d req-ff806ab6-6f85-441e-9107-01ee88e50108 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:57:46.406382 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-4113c5d8-849c-43b5-bd04-3d19c9b12b2d req-ff806ab6-6f85-441e-9107-01ee88e50108 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:57:46.407596 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-4113c5d8-849c-43b5-bd04-3d19c9b12b2d req-ff806ab6-6f85-441e-9107-01ee88e50108 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:57:46.420632 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-4113c5d8-849c-43b5-bd04-3d19c9b12b2d req-ff806ab6-6f85-441e-9107-01ee88e50108 service nova] Creating event network-changed:0244c9b2-f1e4-452a-b390-8f539eb6054a for instance 94394628-4e7b-425a-9adb-12070de0fa31 on nch1-master-1 Oct 08 21:57:46.425561 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-4113c5d8-849c-43b5-bd04-3d19c9b12b2d req-ff806ab6-6f85-441e-9107-01ee88e50108 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037838 Oct 08 21:57:46.426380 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3455/6836] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:57:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:57:47.032981 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-84f67315-cd70-46d9-8a8f-24a2c1cc4100 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:57:47.033676 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-84f67315-cd70-46d9-8a8f-24a2c1cc4100 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: 94394628-4e7b-425a-9adb-12070de0fa31] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:57:47.040697 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-84f67315-cd70-46d9-8a8f-24a2c1cc4100 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:57:47.041216 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-84f67315-cd70-46d9-8a8f-24a2c1cc4100 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:57:47.041681 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-84f67315-cd70-46d9-8a8f-24a2c1cc4100 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:57:47.042388 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-84f67315-cd70-46d9-8a8f-24a2c1cc4100 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:57:47.042856 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-84f67315-cd70-46d9-8a8f-24a2c1cc4100 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:57:47.043302 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-84f67315-cd70-46d9-8a8f-24a2c1cc4100 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:57:47.177457 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-84f67315-cd70-46d9-8a8f-24a2c1cc4100 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771e9bc89e9d459e9e1714de7c514f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4acd2b59f7943cbb555876b9df70bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:57:47.185170 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-84f67315-cd70-46d9-8a8f-24a2c1cc4100 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "GET /compute/v2.1/servers/94394628-4e7b-425a-9adb-12070de0fa31" status: 200 len: 1391 microversion: 2.1 time: 0.156314 Oct 08 21:57:47.185779 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3382/6837] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:57:47 2022] GET /compute/v2.1/servers/94394628-4e7b-425a-9adb-12070de0fa31 => generated 1391 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:57:48.210117 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-736fa3a5-f4f5-4d1a-8fba-6b0b9e50e61a tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:57:48.210851 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-736fa3a5-f4f5-4d1a-8fba-6b0b9e50e61a tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: 94394628-4e7b-425a-9adb-12070de0fa31] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:57:48.217229 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-736fa3a5-f4f5-4d1a-8fba-6b0b9e50e61a tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:57:48.217743 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-736fa3a5-f4f5-4d1a-8fba-6b0b9e50e61a tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:57:48.218207 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-736fa3a5-f4f5-4d1a-8fba-6b0b9e50e61a tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:57:48.218930 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-736fa3a5-f4f5-4d1a-8fba-6b0b9e50e61a tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:57:48.219411 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-736fa3a5-f4f5-4d1a-8fba-6b0b9e50e61a tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:57:48.219863 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-736fa3a5-f4f5-4d1a-8fba-6b0b9e50e61a tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:57:48.353691 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-736fa3a5-f4f5-4d1a-8fba-6b0b9e50e61a tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771e9bc89e9d459e9e1714de7c514f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4acd2b59f7943cbb555876b9df70bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:57:48.361810 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-736fa3a5-f4f5-4d1a-8fba-6b0b9e50e61a tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "GET /compute/v2.1/servers/94394628-4e7b-425a-9adb-12070de0fa31" status: 200 len: 1391 microversion: 2.1 time: 0.157501 Oct 08 21:57:48.362390 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3456/6838] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:57:48 2022] GET /compute/v2.1/servers/94394628-4e7b-425a-9adb-12070de0fa31 => generated 1391 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:57:49.384992 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-f2f9007d-78c7-4d85-aad6-191cb03cc527 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:57:49.385636 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-f2f9007d-78c7-4d85-aad6-191cb03cc527 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: 94394628-4e7b-425a-9adb-12070de0fa31] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:57:49.392444 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f2f9007d-78c7-4d85-aad6-191cb03cc527 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:57:49.392928 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f2f9007d-78c7-4d85-aad6-191cb03cc527 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:57:49.393404 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f2f9007d-78c7-4d85-aad6-191cb03cc527 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:57:49.394098 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f2f9007d-78c7-4d85-aad6-191cb03cc527 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:57:49.394554 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f2f9007d-78c7-4d85-aad6-191cb03cc527 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:57:49.394981 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f2f9007d-78c7-4d85-aad6-191cb03cc527 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:57:49.529906 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-f2f9007d-78c7-4d85-aad6-191cb03cc527 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771e9bc89e9d459e9e1714de7c514f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4acd2b59f7943cbb555876b9df70bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:57:49.537768 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-f2f9007d-78c7-4d85-aad6-191cb03cc527 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "GET /compute/v2.1/servers/94394628-4e7b-425a-9adb-12070de0fa31" status: 200 len: 1391 microversion: 2.1 time: 0.156737 Oct 08 21:57:49.538393 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3383/6839] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:57:49 2022] GET /compute/v2.1/servers/94394628-4e7b-425a-9adb-12070de0fa31 => generated 1391 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:57:50.560710 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-5b03fb48-b30b-4817-957f-2dc2b36c714c tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:57:50.561316 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-5b03fb48-b30b-4817-957f-2dc2b36c714c tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: 94394628-4e7b-425a-9adb-12070de0fa31] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:57:50.569431 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5b03fb48-b30b-4817-957f-2dc2b36c714c tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:57:50.569935 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5b03fb48-b30b-4817-957f-2dc2b36c714c tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:57:50.570394 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5b03fb48-b30b-4817-957f-2dc2b36c714c tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:57:50.571113 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5b03fb48-b30b-4817-957f-2dc2b36c714c tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:57:50.571591 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5b03fb48-b30b-4817-957f-2dc2b36c714c tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:57:50.572180 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5b03fb48-b30b-4817-957f-2dc2b36c714c tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:57:50.707009 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-5b03fb48-b30b-4817-957f-2dc2b36c714c tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771e9bc89e9d459e9e1714de7c514f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4acd2b59f7943cbb555876b9df70bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:57:50.714807 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-5b03fb48-b30b-4817-957f-2dc2b36c714c tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "GET /compute/v2.1/servers/94394628-4e7b-425a-9adb-12070de0fa31" status: 200 len: 1391 microversion: 2.1 time: 0.158215 Oct 08 21:57:50.715385 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3457/6840] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:57:50 2022] GET /compute/v2.1/servers/94394628-4e7b-425a-9adb-12070de0fa31 => generated 1391 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:57:51.738017 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-09248145-dae8-416b-9239-c8d90551e517 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:57:51.738637 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-09248145-dae8-416b-9239-c8d90551e517 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: 94394628-4e7b-425a-9adb-12070de0fa31] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:57:51.741348 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=1 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:57:51.746722 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-09248145-dae8-416b-9239-c8d90551e517 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:57:51.747214 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-09248145-dae8-416b-9239-c8d90551e517 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:57:51.747663 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-09248145-dae8-416b-9239-c8d90551e517 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:57:51.748367 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-09248145-dae8-416b-9239-c8d90551e517 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:57:51.748834 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-09248145-dae8-416b-9239-c8d90551e517 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:57:51.749301 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-09248145-dae8-416b-9239-c8d90551e517 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:57:51.885370 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-09248145-dae8-416b-9239-c8d90551e517 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771e9bc89e9d459e9e1714de7c514f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4acd2b59f7943cbb555876b9df70bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:57:51.893618 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-09248145-dae8-416b-9239-c8d90551e517 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "GET /compute/v2.1/servers/94394628-4e7b-425a-9adb-12070de0fa31" status: 200 len: 1391 microversion: 2.1 time: 0.160046 Oct 08 21:57:51.894206 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3384/6841] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:57:51 2022] GET /compute/v2.1/servers/94394628-4e7b-425a-9adb-12070de0fa31 => generated 1391 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:57:52.917322 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-c443f6bb-d79e-432c-ba90-060413b71dbc tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:57:52.917964 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-c443f6bb-d79e-432c-ba90-060413b71dbc tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: 94394628-4e7b-425a-9adb-12070de0fa31] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:57:52.924972 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c443f6bb-d79e-432c-ba90-060413b71dbc tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:57:52.925530 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c443f6bb-d79e-432c-ba90-060413b71dbc tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:57:52.925996 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c443f6bb-d79e-432c-ba90-060413b71dbc tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:57:52.926720 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c443f6bb-d79e-432c-ba90-060413b71dbc tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:57:52.927199 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c443f6bb-d79e-432c-ba90-060413b71dbc tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:57:52.927649 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c443f6bb-d79e-432c-ba90-060413b71dbc tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:57:53.058490 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-c443f6bb-d79e-432c-ba90-060413b71dbc tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771e9bc89e9d459e9e1714de7c514f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4acd2b59f7943cbb555876b9df70bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:57:53.067229 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-c443f6bb-d79e-432c-ba90-060413b71dbc tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "GET /compute/v2.1/servers/94394628-4e7b-425a-9adb-12070de0fa31" status: 200 len: 1391 microversion: 2.1 time: 0.153970 Oct 08 21:57:53.067814 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3458/6842] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:57:52 2022] GET /compute/v2.1/servers/94394628-4e7b-425a-9adb-12070de0fa31 => generated 1391 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:57:53.464417 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-b0842fc1-b78f-47a6-a723-351dff959ad5 req-30604c25-409f-4898-ac0c-98e98c55ffee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94394628-4e7b-425a-9adb-12070de0fa31", "name": "network-vif-plugged", "status": "completed", "tag": "0244c9b2-f1e4-452a-b390-8f539eb6054a"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:57:53.477135 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-b0842fc1-b78f-47a6-a723-351dff959ad5 req-30604c25-409f-4898-ac0c-98e98c55ffee service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:57:53.477670 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-b0842fc1-b78f-47a6-a723-351dff959ad5 req-30604c25-409f-4898-ac0c-98e98c55ffee service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:57:53.478111 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-b0842fc1-b78f-47a6-a723-351dff959ad5 req-30604c25-409f-4898-ac0c-98e98c55ffee service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:57:53.490444 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-b0842fc1-b78f-47a6-a723-351dff959ad5 req-30604c25-409f-4898-ac0c-98e98c55ffee service nova] Creating event network-vif-plugged:0244c9b2-f1e4-452a-b390-8f539eb6054a for instance 94394628-4e7b-425a-9adb-12070de0fa31 on nch1-master-1 Oct 08 21:57:53.495503 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-b0842fc1-b78f-47a6-a723-351dff959ad5 req-30604c25-409f-4898-ac0c-98e98c55ffee service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034779 Oct 08 21:57:53.496110 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3385/6843] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:57:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:57:54.090395 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-d3915a0a-0f61-4be6-8993-d645d37acd8c tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:57:54.091043 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-d3915a0a-0f61-4be6-8993-d645d37acd8c tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: 94394628-4e7b-425a-9adb-12070de0fa31] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:57:54.093062 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=2 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:57:54.093782 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=6 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:57:54.101673 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d3915a0a-0f61-4be6-8993-d645d37acd8c tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:57:54.102194 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d3915a0a-0f61-4be6-8993-d645d37acd8c tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:57:54.102661 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d3915a0a-0f61-4be6-8993-d645d37acd8c tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:57:54.103394 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d3915a0a-0f61-4be6-8993-d645d37acd8c tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:57:54.103883 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d3915a0a-0f61-4be6-8993-d645d37acd8c tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:57:54.104348 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d3915a0a-0f61-4be6-8993-d645d37acd8c tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:57:54.235734 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-d3915a0a-0f61-4be6-8993-d645d37acd8c tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771e9bc89e9d459e9e1714de7c514f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4acd2b59f7943cbb555876b9df70bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:57:54.243618 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-d3915a0a-0f61-4be6-8993-d645d37acd8c tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "GET /compute/v2.1/servers/94394628-4e7b-425a-9adb-12070de0fa31" status: 200 len: 1391 microversion: 2.1 time: 0.157177 Oct 08 21:57:54.244201 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3459/6844] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:57:54 2022] GET /compute/v2.1/servers/94394628-4e7b-425a-9adb-12070de0fa31 => generated 1391 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:57:55.263847 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=6 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:57:55.269500 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-97a76e0d-fa92-4ee5-827e-b0087bc5d9b4 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:57:55.270238 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-97a76e0d-fa92-4ee5-827e-b0087bc5d9b4 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: 94394628-4e7b-425a-9adb-12070de0fa31] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:57:55.276812 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-97a76e0d-fa92-4ee5-827e-b0087bc5d9b4 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:57:55.277346 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-97a76e0d-fa92-4ee5-827e-b0087bc5d9b4 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:57:55.277802 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-97a76e0d-fa92-4ee5-827e-b0087bc5d9b4 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:57:55.278506 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-97a76e0d-fa92-4ee5-827e-b0087bc5d9b4 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:57:55.278968 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-97a76e0d-fa92-4ee5-827e-b0087bc5d9b4 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:57:55.279403 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-97a76e0d-fa92-4ee5-827e-b0087bc5d9b4 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:57:55.411710 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-97a76e0d-fa92-4ee5-827e-b0087bc5d9b4 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771e9bc89e9d459e9e1714de7c514f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4acd2b59f7943cbb555876b9df70bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:57:55.419628 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-97a76e0d-fa92-4ee5-827e-b0087bc5d9b4 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "GET /compute/v2.1/servers/94394628-4e7b-425a-9adb-12070de0fa31" status: 200 len: 1564 microversion: 2.1 time: 0.156730 Oct 08 21:57:55.420219 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3386/6845] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:57:55 2022] GET /compute/v2.1/servers/94394628-4e7b-425a-9adb-12070de0fa31 => generated 1564 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:57:55.441839 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-0250c7ef-d84d-43c8-9bc4-877df7b037ee tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:57:55.442484 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-0250c7ef-d84d-43c8-9bc4-877df7b037ee tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: 94394628-4e7b-425a-9adb-12070de0fa31] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:57:55.449511 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0250c7ef-d84d-43c8-9bc4-877df7b037ee tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:57:55.450029 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0250c7ef-d84d-43c8-9bc4-877df7b037ee tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:57:55.450496 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0250c7ef-d84d-43c8-9bc4-877df7b037ee tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:57:55.451229 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0250c7ef-d84d-43c8-9bc4-877df7b037ee tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:57:55.451724 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0250c7ef-d84d-43c8-9bc4-877df7b037ee tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:57:55.452183 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0250c7ef-d84d-43c8-9bc4-877df7b037ee tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:57:55.587719 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-0250c7ef-d84d-43c8-9bc4-877df7b037ee tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771e9bc89e9d459e9e1714de7c514f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4acd2b59f7943cbb555876b9df70bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:57:55.596256 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-0250c7ef-d84d-43c8-9bc4-877df7b037ee tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "GET /compute/v2.1/servers/94394628-4e7b-425a-9adb-12070de0fa31" status: 200 len: 1564 microversion: 2.1 time: 0.158264 Oct 08 21:57:55.596853 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3460/6846] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:57:55 2022] GET /compute/v2.1/servers/94394628-4e7b-425a-9adb-12070de0fa31 => generated 1564 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:57:57.187617 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-7de959c4-58fe-483b-aa8e-45c52fb0a7b4 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:57:57.188241 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-7de959c4-58fe-483b-aa8e-45c52fb0a7b4 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: 94394628-4e7b-425a-9adb-12070de0fa31] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:57:57.196246 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-da56940c-c662-479b-8426-4f33f3d537c4 req-4fad79c5-3655-48f7-8dfe-f0f22cec1bf9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94394628-4e7b-425a-9adb-12070de0fa31", "tag": "0244c9b2-f1e4-452a-b390-8f539eb6054a"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:57:57.209838 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-da56940c-c662-479b-8426-4f33f3d537c4 req-4fad79c5-3655-48f7-8dfe-f0f22cec1bf9 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:57:57.210351 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-da56940c-c662-479b-8426-4f33f3d537c4 req-4fad79c5-3655-48f7-8dfe-f0f22cec1bf9 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:57:57.210818 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-da56940c-c662-479b-8426-4f33f3d537c4 req-4fad79c5-3655-48f7-8dfe-f0f22cec1bf9 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:57:57.213603 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7de959c4-58fe-483b-aa8e-45c52fb0a7b4 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:57:57.214173 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7de959c4-58fe-483b-aa8e-45c52fb0a7b4 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:57:57.214628 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7de959c4-58fe-483b-aa8e-45c52fb0a7b4 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:57:57.215374 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7de959c4-58fe-483b-aa8e-45c52fb0a7b4 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:57:57.216038 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7de959c4-58fe-483b-aa8e-45c52fb0a7b4 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:57:57.216662 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7de959c4-58fe-483b-aa8e-45c52fb0a7b4 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:57:57.250436 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-da56940c-c662-479b-8426-4f33f3d537c4 req-4fad79c5-3655-48f7-8dfe-f0f22cec1bf9 service nova] Creating event network-changed:0244c9b2-f1e4-452a-b390-8f539eb6054a for instance 94394628-4e7b-425a-9adb-12070de0fa31 on nch1-master-1 Oct 08 21:57:57.263004 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-da56940c-c662-479b-8426-4f33f3d537c4 req-4fad79c5-3655-48f7-8dfe-f0f22cec1bf9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070306 Oct 08 21:57:57.264056 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3461/6847] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:57:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:57:57.746296 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-7de959c4-58fe-483b-aa8e-45c52fb0a7b4 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771e9bc89e9d459e9e1714de7c514f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4acd2b59f7943cbb555876b9df70bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:57:57.755173 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-7de959c4-58fe-483b-aa8e-45c52fb0a7b4 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "GET /compute/v2.1/servers/94394628-4e7b-425a-9adb-12070de0fa31" status: 200 len: 1564 microversion: 2.1 time: 0.572007 Oct 08 21:57:57.755933 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3387/6848] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:57:57 2022] GET /compute/v2.1/servers/94394628-4e7b-425a-9adb-12070de0fa31 => generated 1564 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:58:21.095004 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:58:21.095709 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=42 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:58:21.099986 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-9618086d-c972-408e-892c-d847a1583fb3 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:58:21.102366 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-9618086d-c972-408e-892c-d847a1583fb3 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: 94394628-4e7b-425a-9adb-12070de0fa31] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:58:21.109802 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9618086d-c972-408e-892c-d847a1583fb3 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:58:21.110313 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9618086d-c972-408e-892c-d847a1583fb3 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:58:21.110780 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9618086d-c972-408e-892c-d847a1583fb3 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:58:21.111506 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9618086d-c972-408e-892c-d847a1583fb3 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:58:21.111991 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9618086d-c972-408e-892c-d847a1583fb3 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:58:21.112446 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9618086d-c972-408e-892c-d847a1583fb3 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:58:21.168603 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-9618086d-c972-408e-892c-d847a1583fb3 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "POST /compute/v2.1/servers/94394628-4e7b-425a-9adb-12070de0fa31/action" status: 200 len: 24498 microversion: 2.1 time: 0.075556 Oct 08 21:58:21.169339 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3462/6849] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:58:21 2022] POST /compute/v2.1/servers/94394628-4e7b-425a-9adb-12070de0fa31/action => generated 24498 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 08 21:58:32.046337 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-680947f6-58b9-4cf2-b843-cb351290ef42 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:58:32.046876 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-680947f6-58b9-4cf2-b843-cb351290ef42 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: 94394628-4e7b-425a-9adb-12070de0fa31] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:58:32.048910 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:SELECT=7 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:58:32.049728 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=38 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:58:32.055984 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-680947f6-58b9-4cf2-b843-cb351290ef42 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:58:32.056483 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-680947f6-58b9-4cf2-b843-cb351290ef42 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:58:32.056940 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-680947f6-58b9-4cf2-b843-cb351290ef42 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:58:32.057711 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-680947f6-58b9-4cf2-b843-cb351290ef42 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:58:32.058178 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-680947f6-58b9-4cf2-b843-cb351290ef42 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:58:32.058617 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-680947f6-58b9-4cf2-b843-cb351290ef42 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:58:32.125696 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-680947f6-58b9-4cf2-b843-cb351290ef42 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "POST /compute/v2.1/servers/94394628-4e7b-425a-9adb-12070de0fa31/action" status: 202 len: 0 microversion: 2.1 time: 0.083476 Oct 08 21:58:32.126537 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3388/6850] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:58:32 2022] POST /compute/v2.1/servers/94394628-4e7b-425a-9adb-12070de0fa31/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 21:58:32.139091 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-2f1a4791-8ab0-43c4-be83-cbce6b030e20 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:58:32.139855 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-2f1a4791-8ab0-43c4-be83-cbce6b030e20 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: 94394628-4e7b-425a-9adb-12070de0fa31] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:58:32.142849 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=2 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:58:32.143684 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=4 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:58:32.151121 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2f1a4791-8ab0-43c4-be83-cbce6b030e20 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:58:32.151650 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2f1a4791-8ab0-43c4-be83-cbce6b030e20 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:58:32.152123 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2f1a4791-8ab0-43c4-be83-cbce6b030e20 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:58:32.152864 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2f1a4791-8ab0-43c4-be83-cbce6b030e20 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:58:32.153551 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2f1a4791-8ab0-43c4-be83-cbce6b030e20 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:58:32.154035 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2f1a4791-8ab0-43c4-be83-cbce6b030e20 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:58:32.294160 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-2f1a4791-8ab0-43c4-be83-cbce6b030e20 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771e9bc89e9d459e9e1714de7c514f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4acd2b59f7943cbb555876b9df70bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:58:32.302912 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-2f1a4791-8ab0-43c4-be83-cbce6b030e20 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "GET /compute/v2.1/servers/94394628-4e7b-425a-9adb-12070de0fa31" status: 200 len: 1688 microversion: 2.1 time: 0.168178 Oct 08 21:58:32.303462 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3463/6851] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:58:32 2022] GET /compute/v2.1/servers/94394628-4e7b-425a-9adb-12070de0fa31 => generated 1688 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 21:58:33.328587 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-0363d691-1976-4055-b2f5-96263a1d86d1 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:58:33.329345 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-0363d691-1976-4055-b2f5-96263a1d86d1 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: 94394628-4e7b-425a-9adb-12070de0fa31] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:58:33.336371 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0363d691-1976-4055-b2f5-96263a1d86d1 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:58:33.336858 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0363d691-1976-4055-b2f5-96263a1d86d1 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:58:33.337329 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0363d691-1976-4055-b2f5-96263a1d86d1 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:58:33.338026 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0363d691-1976-4055-b2f5-96263a1d86d1 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:58:33.338483 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0363d691-1976-4055-b2f5-96263a1d86d1 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:58:33.338911 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0363d691-1976-4055-b2f5-96263a1d86d1 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:58:33.484415 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-0363d691-1976-4055-b2f5-96263a1d86d1 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771e9bc89e9d459e9e1714de7c514f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4acd2b59f7943cbb555876b9df70bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:58:33.492957 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-0363d691-1976-4055-b2f5-96263a1d86d1 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "GET /compute/v2.1/servers/94394628-4e7b-425a-9adb-12070de0fa31" status: 200 len: 1668 microversion: 2.1 time: 0.168611 Oct 08 21:58:33.493561 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3389/6852] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:58:33 2022] GET /compute/v2.1/servers/94394628-4e7b-425a-9adb-12070de0fa31 => generated 1668 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:58:34.585285 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-b01fc6eb-501e-472c-9f01-b874658dbd9d tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:58:34.587558 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-b01fc6eb-501e-472c-9f01-b874658dbd9d tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: 94394628-4e7b-425a-9adb-12070de0fa31] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:58:34.595445 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b01fc6eb-501e-472c-9f01-b874658dbd9d tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:58:34.595960 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b01fc6eb-501e-472c-9f01-b874658dbd9d tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:58:34.596431 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b01fc6eb-501e-472c-9f01-b874658dbd9d tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:58:34.597151 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b01fc6eb-501e-472c-9f01-b874658dbd9d tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:58:34.597668 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b01fc6eb-501e-472c-9f01-b874658dbd9d tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:58:34.598123 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b01fc6eb-501e-472c-9f01-b874658dbd9d tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:58:34.657143 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-b01fc6eb-501e-472c-9f01-b874658dbd9d tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "POST /compute/v2.1/servers/94394628-4e7b-425a-9adb-12070de0fa31/action" status: 200 len: 32568 microversion: 2.1 time: 0.075579 Oct 08 21:58:34.657750 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3464/6853] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:58:34 2022] POST /compute/v2.1/servers/94394628-4e7b-425a-9adb-12070de0fa31/action => generated 32568 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 08 21:58:34.670181 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-3f932048-b405-4175-ae73-32efd1343596 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:58:34.670706 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-3f932048-b405-4175-ae73-32efd1343596 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: 94394628-4e7b-425a-9adb-12070de0fa31] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:58:34.677614 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3f932048-b405-4175-ae73-32efd1343596 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:58:34.678699 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3f932048-b405-4175-ae73-32efd1343596 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:58:34.679144 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3f932048-b405-4175-ae73-32efd1343596 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:58:34.679848 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3f932048-b405-4175-ae73-32efd1343596 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:58:34.680311 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3f932048-b405-4175-ae73-32efd1343596 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:58:34.680748 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3f932048-b405-4175-ae73-32efd1343596 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:58:34.746343 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-3f932048-b405-4175-ae73-32efd1343596 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "POST /compute/v2.1/servers/94394628-4e7b-425a-9adb-12070de0fa31/action" status: 202 len: 0 microversion: 2.1 time: 0.079915 Oct 08 21:58:34.746981 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3390/6854] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:58:34 2022] POST /compute/v2.1/servers/94394628-4e7b-425a-9adb-12070de0fa31/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 08 21:58:34.755900 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-22a07ec1-e5a9-4d8c-b41c-8f5e9fc48717 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:58:34.756640 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-22a07ec1-e5a9-4d8c-b41c-8f5e9fc48717 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: 94394628-4e7b-425a-9adb-12070de0fa31] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:58:34.763879 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-22a07ec1-e5a9-4d8c-b41c-8f5e9fc48717 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:58:34.764412 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-22a07ec1-e5a9-4d8c-b41c-8f5e9fc48717 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:58:34.764860 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-22a07ec1-e5a9-4d8c-b41c-8f5e9fc48717 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:58:34.765622 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-22a07ec1-e5a9-4d8c-b41c-8f5e9fc48717 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:58:34.766106 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-22a07ec1-e5a9-4d8c-b41c-8f5e9fc48717 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:58:34.766559 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-22a07ec1-e5a9-4d8c-b41c-8f5e9fc48717 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:58:34.907844 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-22a07ec1-e5a9-4d8c-b41c-8f5e9fc48717 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771e9bc89e9d459e9e1714de7c514f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4acd2b59f7943cbb555876b9df70bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:58:34.916395 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-22a07ec1-e5a9-4d8c-b41c-8f5e9fc48717 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "GET /compute/v2.1/servers/94394628-4e7b-425a-9adb-12070de0fa31" status: 200 len: 1675 microversion: 2.1 time: 0.164821 Oct 08 21:58:34.916988 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3465/6855] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:58:34 2022] GET /compute/v2.1/servers/94394628-4e7b-425a-9adb-12070de0fa31 => generated 1675 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:58:35.941509 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-3af4f4e4-4b14-4235-ae84-f29fcbee129e tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:58:35.942131 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-3af4f4e4-4b14-4235-ae84-f29fcbee129e tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: 94394628-4e7b-425a-9adb-12070de0fa31] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:58:35.949177 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3af4f4e4-4b14-4235-ae84-f29fcbee129e tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:58:35.949702 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3af4f4e4-4b14-4235-ae84-f29fcbee129e tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:58:35.950148 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3af4f4e4-4b14-4235-ae84-f29fcbee129e tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:58:35.950859 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3af4f4e4-4b14-4235-ae84-f29fcbee129e tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:58:35.951353 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3af4f4e4-4b14-4235-ae84-f29fcbee129e tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:58:35.951791 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3af4f4e4-4b14-4235-ae84-f29fcbee129e tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:58:36.086262 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-3af4f4e4-4b14-4235-ae84-f29fcbee129e tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771e9bc89e9d459e9e1714de7c514f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4acd2b59f7943cbb555876b9df70bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:58:36.094181 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-3af4f4e4-4b14-4235-ae84-f29fcbee129e tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "GET /compute/v2.1/servers/94394628-4e7b-425a-9adb-12070de0fa31" status: 200 len: 1683 microversion: 2.1 time: 0.158131 Oct 08 21:58:36.094759 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3391/6856] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:58:35 2022] GET /compute/v2.1/servers/94394628-4e7b-425a-9adb-12070de0fa31 => generated 1683 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:58:36.189797 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-9980cfd4-5ea0-4d52-ab67-5f907bb96e79 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:58:36.192081 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-9980cfd4-5ea0-4d52-ab67-5f907bb96e79 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: 94394628-4e7b-425a-9adb-12070de0fa31] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:58:36.200206 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9980cfd4-5ea0-4d52-ab67-5f907bb96e79 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:58:36.200706 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9980cfd4-5ea0-4d52-ab67-5f907bb96e79 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:58:36.201164 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9980cfd4-5ea0-4d52-ab67-5f907bb96e79 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:58:36.201900 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9980cfd4-5ea0-4d52-ab67-5f907bb96e79 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:58:36.202374 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9980cfd4-5ea0-4d52-ab67-5f907bb96e79 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:58:36.202817 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9980cfd4-5ea0-4d52-ab67-5f907bb96e79 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:58:36.253895 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-9980cfd4-5ea0-4d52-ab67-5f907bb96e79 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "POST /compute/v2.1/servers/94394628-4e7b-425a-9adb-12070de0fa31/action" status: 200 len: 37299 microversion: 2.1 time: 0.068216 Oct 08 21:58:36.254552 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3466/6857] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:58:36 2022] POST /compute/v2.1/servers/94394628-4e7b-425a-9adb-12070de0fa31/action => generated 37299 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 08 21:58:37.236574 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-9adf17d6-41f1-42a3-870f-0faa1af85d9a tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:58:37.237171 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-9adf17d6-41f1-42a3-870f-0faa1af85d9a tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: 94394628-4e7b-425a-9adb-12070de0fa31] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:58:37.239277 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-a658f2d2-3d34-4a6f-a8b4-426f5e3cd51b req-7104fc07-db1d-4bdf-bb18-3b758441b594 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94394628-4e7b-425a-9adb-12070de0fa31", "tag": "0244c9b2-f1e4-452a-b390-8f539eb6054a"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:58:37.244753 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9adf17d6-41f1-42a3-870f-0faa1af85d9a tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:58:37.245396 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9adf17d6-41f1-42a3-870f-0faa1af85d9a tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:58:37.245914 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9adf17d6-41f1-42a3-870f-0faa1af85d9a tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:58:37.246698 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9adf17d6-41f1-42a3-870f-0faa1af85d9a tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:58:37.247221 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9adf17d6-41f1-42a3-870f-0faa1af85d9a tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:58:37.247730 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9adf17d6-41f1-42a3-870f-0faa1af85d9a tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:58:37.252007 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-a658f2d2-3d34-4a6f-a8b4-426f5e3cd51b req-7104fc07-db1d-4bdf-bb18-3b758441b594 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:58:37.252587 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-a658f2d2-3d34-4a6f-a8b4-426f5e3cd51b req-7104fc07-db1d-4bdf-bb18-3b758441b594 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:58:37.253331 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-a658f2d2-3d34-4a6f-a8b4-426f5e3cd51b req-7104fc07-db1d-4bdf-bb18-3b758441b594 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:58:37.265684 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-a658f2d2-3d34-4a6f-a8b4-426f5e3cd51b req-7104fc07-db1d-4bdf-bb18-3b758441b594 service nova] Creating event network-changed:0244c9b2-f1e4-452a-b390-8f539eb6054a for instance 94394628-4e7b-425a-9adb-12070de0fa31 on nch1-master-1 Oct 08 21:58:37.271070 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-a658f2d2-3d34-4a6f-a8b4-426f5e3cd51b req-7104fc07-db1d-4bdf-bb18-3b758441b594 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036108 Oct 08 21:58:37.272504 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3467/6858] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:58:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:58:37.276084 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-9adf17d6-41f1-42a3-870f-0faa1af85d9a tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: 94394628-4e7b-425a-9adb-12070de0fa31] Going to try to terminate instance {{(pid=140491) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 21:58:37.365010 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-9adf17d6-41f1-42a3-870f-0faa1af85d9a tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "DELETE /compute/v2.1/servers/94394628-4e7b-425a-9adb-12070de0fa31" status: 204 len: 0 microversion: 2.1 time: 0.132540 Oct 08 21:58:37.366886 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3392/6859] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 21:58:37 2022] DELETE /compute/v2.1/servers/94394628-4e7b-425a-9adb-12070de0fa31 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 21:58:37.376060 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e0e7df4e-3c92-4dfa-a4f8-cce3ff428b80 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:58:37.376810 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-e0e7df4e-3c92-4dfa-a4f8-cce3ff428b80 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: 94394628-4e7b-425a-9adb-12070de0fa31] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:58:37.386500 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e0e7df4e-3c92-4dfa-a4f8-cce3ff428b80 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:58:37.389745 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e0e7df4e-3c92-4dfa-a4f8-cce3ff428b80 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:58:37.390526 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e0e7df4e-3c92-4dfa-a4f8-cce3ff428b80 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:58:37.391514 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e0e7df4e-3c92-4dfa-a4f8-cce3ff428b80 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:58:37.392171 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e0e7df4e-3c92-4dfa-a4f8-cce3ff428b80 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:58:37.392792 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e0e7df4e-3c92-4dfa-a4f8-cce3ff428b80 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:58:37.540698 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-e0e7df4e-3c92-4dfa-a4f8-cce3ff428b80 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771e9bc89e9d459e9e1714de7c514f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4acd2b59f7943cbb555876b9df70bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:58:37.549086 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-e0e7df4e-3c92-4dfa-a4f8-cce3ff428b80 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "GET /compute/v2.1/servers/94394628-4e7b-425a-9adb-12070de0fa31" status: 200 len: 1689 microversion: 2.1 time: 0.177711 Oct 08 21:58:37.549721 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3468/6860] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:58:37 2022] GET /compute/v2.1/servers/94394628-4e7b-425a-9adb-12070de0fa31 => generated 1689 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:58:38.573648 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-e6b39b63-2c22-43d5-82f9-0ff964b40058 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:58:38.574357 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-e6b39b63-2c22-43d5-82f9-0ff964b40058 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: 94394628-4e7b-425a-9adb-12070de0fa31] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:58:38.583485 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e6b39b63-2c22-43d5-82f9-0ff964b40058 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:58:38.583968 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e6b39b63-2c22-43d5-82f9-0ff964b40058 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:58:38.584433 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e6b39b63-2c22-43d5-82f9-0ff964b40058 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:58:38.585162 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e6b39b63-2c22-43d5-82f9-0ff964b40058 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:58:38.585642 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e6b39b63-2c22-43d5-82f9-0ff964b40058 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:58:38.586070 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e6b39b63-2c22-43d5-82f9-0ff964b40058 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:58:38.719005 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-e6b39b63-2c22-43d5-82f9-0ff964b40058 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771e9bc89e9d459e9e1714de7c514f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4acd2b59f7943cbb555876b9df70bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:58:38.727442 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-e6b39b63-2c22-43d5-82f9-0ff964b40058 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "GET /compute/v2.1/servers/94394628-4e7b-425a-9adb-12070de0fa31" status: 200 len: 1689 microversion: 2.1 time: 0.158227 Oct 08 21:58:38.728011 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3393/6861] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:58:38 2022] GET /compute/v2.1/servers/94394628-4e7b-425a-9adb-12070de0fa31 => generated 1689 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:58:39.613237 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-f6ec8aa6-34a5-4d32-bae0-22bda6962fe1 req-3094d602-d906-4bb4-90d4-7069e5d0213a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94394628-4e7b-425a-9adb-12070de0fa31", "name": "network-vif-deleted", "tag": "0244c9b2-f1e4-452a-b390-8f539eb6054a"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:58:39.623763 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-f6ec8aa6-34a5-4d32-bae0-22bda6962fe1 req-3094d602-d906-4bb4-90d4-7069e5d0213a service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:58:39.624269 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-f6ec8aa6-34a5-4d32-bae0-22bda6962fe1 req-3094d602-d906-4bb4-90d4-7069e5d0213a service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:58:39.624782 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-f6ec8aa6-34a5-4d32-bae0-22bda6962fe1 req-3094d602-d906-4bb4-90d4-7069e5d0213a service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:58:39.636462 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-f6ec8aa6-34a5-4d32-bae0-22bda6962fe1 req-3094d602-d906-4bb4-90d4-7069e5d0213a service nova] Creating event network-vif-deleted:0244c9b2-f1e4-452a-b390-8f539eb6054a for instance 94394628-4e7b-425a-9adb-12070de0fa31 on nch1-master-1 Oct 08 21:58:39.641622 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-f6ec8aa6-34a5-4d32-bae0-22bda6962fe1 req-3094d602-d906-4bb4-90d4-7069e5d0213a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032759 Oct 08 21:58:39.642422 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3469/6862] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:58:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:58:39.751019 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-a40e214a-00ac-4494-bab6-3dd665aac11f tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:58:39.751635 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-a40e214a-00ac-4494-bab6-3dd665aac11f tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: 94394628-4e7b-425a-9adb-12070de0fa31] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:58:39.759096 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a40e214a-00ac-4494-bab6-3dd665aac11f tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:58:39.759584 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a40e214a-00ac-4494-bab6-3dd665aac11f tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:58:39.760028 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a40e214a-00ac-4494-bab6-3dd665aac11f tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:58:39.760729 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a40e214a-00ac-4494-bab6-3dd665aac11f tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:58:39.761206 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a40e214a-00ac-4494-bab6-3dd665aac11f tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:58:39.761647 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a40e214a-00ac-4494-bab6-3dd665aac11f tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:58:39.794008 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a40e214a-00ac-4494-bab6-3dd665aac11f tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:58:39.794502 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a40e214a-00ac-4494-bab6-3dd665aac11f tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:58:39.794956 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a40e214a-00ac-4494-bab6-3dd665aac11f tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:58:39.795408 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.objects.instance [None req-a40e214a-00ac-4494-bab6-3dd665aac11f tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lazy-loading 'fault' on Instance uuid 94394628-4e7b-425a-9adb-12070de0fa31 {{(pid=140491) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 21:58:39.838172 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-a40e214a-00ac-4494-bab6-3dd665aac11f tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771e9bc89e9d459e9e1714de7c514f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4acd2b59f7943cbb555876b9df70bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:58:39.845944 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-a40e214a-00ac-4494-bab6-3dd665aac11f tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "GET /compute/v2.1/servers/94394628-4e7b-425a-9adb-12070de0fa31" status: 200 len: 1355 microversion: 2.1 time: 0.098813 Oct 08 21:58:39.846519 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3394/6863] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:58:39 2022] GET /compute/v2.1/servers/94394628-4e7b-425a-9adb-12070de0fa31 => generated 1355 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:58:40.870978 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-1cb1e442-94be-4a34-b1ea-13b7a97ce651 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:58:40.871703 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-1cb1e442-94be-4a34-b1ea-13b7a97ce651 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: 94394628-4e7b-425a-9adb-12070de0fa31] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:58:40.878049 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1cb1e442-94be-4a34-b1ea-13b7a97ce651 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:58:40.878554 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1cb1e442-94be-4a34-b1ea-13b7a97ce651 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:58:40.879014 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1cb1e442-94be-4a34-b1ea-13b7a97ce651 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:58:40.879727 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1cb1e442-94be-4a34-b1ea-13b7a97ce651 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:58:40.880202 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1cb1e442-94be-4a34-b1ea-13b7a97ce651 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:58:40.880643 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1cb1e442-94be-4a34-b1ea-13b7a97ce651 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:58:40.894031 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-1cb1e442-94be-4a34-b1ea-13b7a97ce651 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] HTTP exception thrown: Instance 94394628-4e7b-425a-9adb-12070de0fa31 could not be found. Oct 08 21:58:40.895645 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-1cb1e442-94be-4a34-b1ea-13b7a97ce651 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Request method failure captured: Oct 08 21:58:40.895645 ncdv-master-1 devstack@n-api.service[140492]: request: GET /compute/v2.1/servers/94394628-4e7b-425a-9adb-12070de0fa31 HTTP/1.1 Oct 08 21:58:40.895645 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 21:58:40.895645 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 21:58:40.895645 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 21:58:40.895645 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 21:58:40.895645 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 21:58:40.895645 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 21:58:40.895645 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 21:58:40.895645 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 21:58:40.895645 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQfJQuuM4QaRSXOpK2YhyslcxnkJ03o0TeYKo-1sghAmNBGzTEmttugknoEotMcyK5hDZNRRFN5h_g-OLCqYD0f2cwEDT-h9hsKxYJXhTkmbUu76pLNz3djjSXZaSj_lX8tX8qa-8wLl1CIxv5sl6Y_9B2OxGfOgq2QPxELxT30_sgQc Oct 08 21:58:40.895645 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 21:58:40.895645 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 21:58:40.895645 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 21:58:40.895645 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 21:58:40.895645 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 21:58:40.895645 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 21:58:40.895645 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: b4acd2b59f7943cbb555876b9df70bee Oct 08 21:58:40.895645 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-2097292340 Oct 08 21:58:40.895645 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 21:58:40.895645 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 21:58:40.895645 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b4acd2b59f7943cbb555876b9df70bee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b4acd2b59f7943cbb555876b9df70bee"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b4acd2b59f7943cbb555876b9df70bee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b4acd2b59f7943cbb555876b9df70bee"}]}] Oct 08 21:58:40.895645 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-TestNetworkAdvancedServerOps-2097292340 Oct 08 21:58:40.895645 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: b4acd2b59f7943cbb555876b9df70bee Oct 08 21:58:40.895645 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-2097292340 Oct 08 21:58:40.895645 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-TestNetworkAdvancedServerOps-2097292340-project Oct 08 21:58:40.895645 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 21:58:40.895645 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 21:58:40.895645 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 771e9bc89e9d459e9e1714de7c514f4f Oct 08 21:58:40.895645 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-TestNetworkAdvancedServerOps-2097292340-project Oct 08 21:58:40.895645 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 21:58:40.895645 ncdv-master-1 devstack@n-api.service[140492]: exception: Instance 94394628-4e7b-425a-9adb-12070de0fa31 could not be found. Oct 08 21:58:40.895645 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': '94394628-4e7b-425a-9adb-12070de0fa31'} Oct 08 21:58:40.895645 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 21:58:40.895645 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:58:40.895645 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 21:58:40.895645 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 21:58:40.895645 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 21:58:40.895645 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 21:58:40.895645 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 21:58:40.895645 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 21:58:40.895645 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 21:58:40.895645 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 21:58:40.895645 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94394628-4e7b-425a-9adb-12070de0fa31 could not be found. Oct 08 21:58:40.895645 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:58:40.895645 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:58:40.895645 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:58:40.895645 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:58:40.895645 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:58:40.895645 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:58:40.895645 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 21:58:40.895645 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 21:58:40.895645 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 21:58:40.895645 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 21:58:40.895645 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 21:58:40.895645 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 21:58:40.895645 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 21:58:40.895645 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 21:58:40.895645 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 21:58:40.895645 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 21:58:40.895645 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94394628-4e7b-425a-9adb-12070de0fa31 could not be found. Oct 08 21:58:40.895645 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:58:40.895645 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 21:58:40.902216 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:58:40.902216 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 21:58:40.902216 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 21:58:40.902216 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 21:58:40.902216 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 21:58:40.902216 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 21:58:40.902216 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94394628-4e7b-425a-9adb-12070de0fa31 could not be found. Oct 08 21:58:40.902216 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 21:58:40.902216 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-1cb1e442-94be-4a34-b1ea-13b7a97ce651 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Returning 404 to user: Instance 94394628-4e7b-425a-9adb-12070de0fa31 could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 21:58:40.902216 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-1cb1e442-94be-4a34-b1ea-13b7a97ce651 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "GET /compute/v2.1/servers/94394628-4e7b-425a-9adb-12070de0fa31" status: 404 len: 111 microversion: 2.1 time: 0.032371 Oct 08 21:58:40.902216 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3470/6864] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:58:40 2022] GET /compute/v2.1/servers/94394628-4e7b-425a-9adb-12070de0fa31 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 21:58:44.179120 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-b4fa7af0-7580-4ecf-8c3b-a0b4a7ff23a3 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Calling method '.version_select at 0x7f1a876179d0>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:58:44.204971 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-b4fa7af0-7580-4ecf-8c3b-a0b4a7ff23a3 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-825523828" status: 202 len: 0 microversion: 2.1 time: 0.030068 Oct 08 21:58:44.205422 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3395/6865] 10.222.0.26 () {58 vars in 1281 bytes} [Sat Oct 8 21:58:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-825523828 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 21:58:44.233158 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-796531a9-936f-47be-beab-d6dfffdb2495 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Action: 'create', calling method: .version_select at 0x7f1a91470670>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1892622966", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOBKCymCqCo6QKBWPLOt8qtxadFmO+MBVYkaYwT8w64yodzupT2hVAaptLCr9vcA/isUD2cim4/UcSdrk60f1b01EApAB/cFu4K6KAm+KS3iBgvvNvG9BdxqcawUKvP7Sg=="}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:58:44.249356 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-796531a9-936f-47be-beab-d6dfffdb2495 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Getting quotas for project b4acd2b59f7943cbb555876b9df70bee. Resources: {'key_pairs'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:58:44.255408 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-796531a9-936f-47be-beab-d6dfffdb2495 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Getting quotas for user 771e9bc89e9d459e9e1714de7c514f4f and project b4acd2b59f7943cbb555876b9df70bee. Resources: {'key_pairs'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:58:44.279603 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-796531a9-936f-47be-beab-d6dfffdb2495 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.050476 Oct 08 21:58:44.280214 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3471/6866] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Oct 8 21:58:44 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:58:50.040897 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-f15e7a3e-a56c-4f6b-9b24-8236f52dbfa0 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-2110162659", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "networks": [{"uuid": "bc2491e2-c649-4c28-94c9-37c9824f2183"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1892622966", "security_groups": [{"name": "tempest-secgroup-smoke-2077210460"}]}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:58:50.057094 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:58:50.167570 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.network.neutron [None req-f15e7a3e-a56c-4f6b-9b24-8236f52dbfa0 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] validate_networks() for [('bc2491e2-c649-4c28-94c9-37c9824f2183', None, None, None, None, None)] {{(pid=140491) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 21:58:50.684622 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-f15e7a3e-a56c-4f6b-9b24-8236f52dbfa0 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Flavor limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 21:58:50.685351 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-f15e7a3e-a56c-4f6b-9b24-8236f52dbfa0 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Image limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 21:58:50.685994 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-f15e7a3e-a56c-4f6b-9b24-8236f52dbfa0 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Flavor pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 21:58:50.686758 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-f15e7a3e-a56c-4f6b-9b24-8236f52dbfa0 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Image pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 21:58:50.687648 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-f15e7a3e-a56c-4f6b-9b24-8236f52dbfa0 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 21:58:50.697573 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f15e7a3e-a56c-4f6b-9b24-8236f52dbfa0 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:58:50.698062 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f15e7a3e-a56c-4f6b-9b24-8236f52dbfa0 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:58:50.698508 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f15e7a3e-a56c-4f6b-9b24-8236f52dbfa0 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:58:50.699246 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f15e7a3e-a56c-4f6b-9b24-8236f52dbfa0 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:58:50.699717 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f15e7a3e-a56c-4f6b-9b24-8236f52dbfa0 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:58:50.700265 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f15e7a3e-a56c-4f6b-9b24-8236f52dbfa0 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:58:50.717289 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-f15e7a3e-a56c-4f6b-9b24-8236f52dbfa0 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Getting quotas for project b4acd2b59f7943cbb555876b9df70bee. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 21:58:50.722660 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-f15e7a3e-a56c-4f6b-9b24-8236f52dbfa0 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Getting quotas for user 771e9bc89e9d459e9e1714de7c514f4f and project b4acd2b59f7943cbb555876b9df70bee. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 21:58:50.735110 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-f15e7a3e-a56c-4f6b-9b24-8236f52dbfa0 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Going to run 1 instances... {{(pid=140491) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 21:58:50.737484 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-f15e7a3e-a56c-4f6b-9b24-8236f52dbfa0 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: c6b44a27-e394-4426-a25f-5597c3000a62] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c508bd7f-7db9-4b2c-af7c-be54a855c355',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140491) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 21:58:50.785861 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-f15e7a3e-a56c-4f6b-9b24-8236f52dbfa0 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.749378 Oct 08 21:58:50.786689 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3396/6867] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 21:58:50 2022] POST /compute/v2.1/servers => generated 406 bytes in 751 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 08 21:58:50.798694 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-9fcd602d-dc92-4036-a10c-1df0d6a275f3 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:58:50.799804 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-9fcd602d-dc92-4036-a10c-1df0d6a275f3 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: c6b44a27-e394-4426-a25f-5597c3000a62] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:58:50.879977 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-9fcd602d-dc92-4036-a10c-1df0d6a275f3 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771e9bc89e9d459e9e1714de7c514f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4acd2b59f7943cbb555876b9df70bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:58:50.884980 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=32 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:58:50.895383 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-9fcd602d-dc92-4036-a10c-1df0d6a275f3 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "GET /compute/v2.1/servers/c6b44a27-e394-4426-a25f-5597c3000a62" status: 200 len: 1267 microversion: 2.1 time: 0.097665 Oct 08 21:58:50.896028 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3472/6868] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:58:50 2022] GET /compute/v2.1/servers/c6b44a27-e394-4426-a25f-5597c3000a62 => generated 1267 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:58:51.922028 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-f23e0b06-2867-4939-a6a7-33ef2926c691 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:58:51.922675 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-f23e0b06-2867-4939-a6a7-33ef2926c691 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: c6b44a27-e394-4426-a25f-5597c3000a62] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:58:51.942166 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f23e0b06-2867-4939-a6a7-33ef2926c691 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:58:51.942922 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f23e0b06-2867-4939-a6a7-33ef2926c691 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:58:51.945231 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f23e0b06-2867-4939-a6a7-33ef2926c691 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:58:51.946115 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f23e0b06-2867-4939-a6a7-33ef2926c691 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:58:51.947521 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f23e0b06-2867-4939-a6a7-33ef2926c691 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:58:51.948572 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f23e0b06-2867-4939-a6a7-33ef2926c691 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:58:52.031493 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-f23e0b06-2867-4939-a6a7-33ef2926c691 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771e9bc89e9d459e9e1714de7c514f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4acd2b59f7943cbb555876b9df70bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:58:52.041517 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-f23e0b06-2867-4939-a6a7-33ef2926c691 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "GET /compute/v2.1/servers/c6b44a27-e394-4426-a25f-5597c3000a62" status: 200 len: 1337 microversion: 2.1 time: 0.126879 Oct 08 21:58:52.057052 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3397/6869] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:58:51 2022] GET /compute/v2.1/servers/c6b44a27-e394-4426-a25f-5597c3000a62 => generated 1337 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:58:53.070940 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-2829f29b-6d0d-4b0e-b39e-3cac08bd95c6 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:58:53.072410 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-2829f29b-6d0d-4b0e-b39e-3cac08bd95c6 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: c6b44a27-e394-4426-a25f-5597c3000a62] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:58:53.082212 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2829f29b-6d0d-4b0e-b39e-3cac08bd95c6 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:58:53.082818 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2829f29b-6d0d-4b0e-b39e-3cac08bd95c6 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:58:53.083349 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2829f29b-6d0d-4b0e-b39e-3cac08bd95c6 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:58:53.084686 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2829f29b-6d0d-4b0e-b39e-3cac08bd95c6 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:58:53.085423 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2829f29b-6d0d-4b0e-b39e-3cac08bd95c6 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:58:53.086083 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2829f29b-6d0d-4b0e-b39e-3cac08bd95c6 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:58:53.325117 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-2829f29b-6d0d-4b0e-b39e-3cac08bd95c6 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771e9bc89e9d459e9e1714de7c514f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4acd2b59f7943cbb555876b9df70bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:58:53.333132 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-2829f29b-6d0d-4b0e-b39e-3cac08bd95c6 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "GET /compute/v2.1/servers/c6b44a27-e394-4426-a25f-5597c3000a62" status: 200 len: 1393 microversion: 2.1 time: 0.272487 Oct 08 21:58:53.334576 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3473/6870] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:58:53 2022] GET /compute/v2.1/servers/c6b44a27-e394-4426-a25f-5597c3000a62 => generated 1393 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:58:53.467726 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-b2d84369-501e-4801-98e0-53f17007a0ce req-8caa9c23-5047-43bd-bf7d-9c696216e21a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6b44a27-e394-4426-a25f-5597c3000a62", "tag": "8fd483c9-5a6c-4317-ad15-69e7df15611b"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:58:53.478911 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-b2d84369-501e-4801-98e0-53f17007a0ce req-8caa9c23-5047-43bd-bf7d-9c696216e21a service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:58:53.479676 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-b2d84369-501e-4801-98e0-53f17007a0ce req-8caa9c23-5047-43bd-bf7d-9c696216e21a service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:58:53.480295 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-b2d84369-501e-4801-98e0-53f17007a0ce req-8caa9c23-5047-43bd-bf7d-9c696216e21a service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:58:53.494100 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-b2d84369-501e-4801-98e0-53f17007a0ce req-8caa9c23-5047-43bd-bf7d-9c696216e21a service nova] Creating event network-changed:8fd483c9-5a6c-4317-ad15-69e7df15611b for instance c6b44a27-e394-4426-a25f-5597c3000a62 on nch2-master-1 Oct 08 21:58:53.500388 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-b2d84369-501e-4801-98e0-53f17007a0ce req-8caa9c23-5047-43bd-bf7d-9c696216e21a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036759 Oct 08 21:58:53.501004 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3398/6871] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:58:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:58:54.356907 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-de1b4a95-6ff1-402d-aa4c-d06ae334ce69 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:58:54.357708 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-de1b4a95-6ff1-402d-aa4c-d06ae334ce69 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: c6b44a27-e394-4426-a25f-5597c3000a62] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:58:54.365770 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-de1b4a95-6ff1-402d-aa4c-d06ae334ce69 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:58:54.366285 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-de1b4a95-6ff1-402d-aa4c-d06ae334ce69 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:58:54.366747 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-de1b4a95-6ff1-402d-aa4c-d06ae334ce69 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:58:54.367472 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-de1b4a95-6ff1-402d-aa4c-d06ae334ce69 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:58:54.367953 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-de1b4a95-6ff1-402d-aa4c-d06ae334ce69 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:58:54.368402 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-de1b4a95-6ff1-402d-aa4c-d06ae334ce69 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:58:54.505509 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-de1b4a95-6ff1-402d-aa4c-d06ae334ce69 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771e9bc89e9d459e9e1714de7c514f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4acd2b59f7943cbb555876b9df70bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:58:54.513320 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-de1b4a95-6ff1-402d-aa4c-d06ae334ce69 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "GET /compute/v2.1/servers/c6b44a27-e394-4426-a25f-5597c3000a62" status: 200 len: 1393 microversion: 2.1 time: 0.160382 Oct 08 21:58:54.513972 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3474/6872] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:58:54 2022] GET /compute/v2.1/servers/c6b44a27-e394-4426-a25f-5597c3000a62 => generated 1393 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:58:55.537572 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-a4d4ff5d-ead7-48e0-b402-a2a83acbdcd2 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:58:55.538276 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-a4d4ff5d-ead7-48e0-b402-a2a83acbdcd2 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: c6b44a27-e394-4426-a25f-5597c3000a62] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:58:55.544578 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a4d4ff5d-ead7-48e0-b402-a2a83acbdcd2 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:58:55.545062 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a4d4ff5d-ead7-48e0-b402-a2a83acbdcd2 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:58:55.545552 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a4d4ff5d-ead7-48e0-b402-a2a83acbdcd2 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:58:55.546249 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a4d4ff5d-ead7-48e0-b402-a2a83acbdcd2 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:58:55.546706 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a4d4ff5d-ead7-48e0-b402-a2a83acbdcd2 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:58:55.547133 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a4d4ff5d-ead7-48e0-b402-a2a83acbdcd2 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:58:55.678642 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-a4d4ff5d-ead7-48e0-b402-a2a83acbdcd2 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771e9bc89e9d459e9e1714de7c514f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4acd2b59f7943cbb555876b9df70bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:58:55.686603 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-a4d4ff5d-ead7-48e0-b402-a2a83acbdcd2 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "GET /compute/v2.1/servers/c6b44a27-e394-4426-a25f-5597c3000a62" status: 200 len: 1393 microversion: 2.1 time: 0.154334 Oct 08 21:58:55.687432 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3399/6873] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:58:55 2022] GET /compute/v2.1/servers/c6b44a27-e394-4426-a25f-5597c3000a62 => generated 1393 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:58:56.711299 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-cd0d4a6a-1983-4551-a757-77e85f8f2afb tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:58:56.711944 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-cd0d4a6a-1983-4551-a757-77e85f8f2afb tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: c6b44a27-e394-4426-a25f-5597c3000a62] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:58:56.719029 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cd0d4a6a-1983-4551-a757-77e85f8f2afb tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:58:56.719518 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cd0d4a6a-1983-4551-a757-77e85f8f2afb tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:58:56.719978 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cd0d4a6a-1983-4551-a757-77e85f8f2afb tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:58:56.720697 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cd0d4a6a-1983-4551-a757-77e85f8f2afb tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:58:56.721179 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cd0d4a6a-1983-4551-a757-77e85f8f2afb tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:58:56.721651 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cd0d4a6a-1983-4551-a757-77e85f8f2afb tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:58:56.858950 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-cd0d4a6a-1983-4551-a757-77e85f8f2afb tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771e9bc89e9d459e9e1714de7c514f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4acd2b59f7943cbb555876b9df70bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:58:56.866861 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-cd0d4a6a-1983-4551-a757-77e85f8f2afb tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "GET /compute/v2.1/servers/c6b44a27-e394-4426-a25f-5597c3000a62" status: 200 len: 1393 microversion: 2.1 time: 0.160065 Oct 08 21:58:56.867446 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3475/6874] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:58:56 2022] GET /compute/v2.1/servers/c6b44a27-e394-4426-a25f-5597c3000a62 => generated 1393 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:58:57.889032 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-04b454bb-8a6d-4c4f-8757-7c4fadb217db tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:58:57.889688 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-04b454bb-8a6d-4c4f-8757-7c4fadb217db tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: c6b44a27-e394-4426-a25f-5597c3000a62] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:58:57.896117 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-04b454bb-8a6d-4c4f-8757-7c4fadb217db tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:58:57.896615 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-04b454bb-8a6d-4c4f-8757-7c4fadb217db tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:58:57.897062 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-04b454bb-8a6d-4c4f-8757-7c4fadb217db tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:58:57.897792 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-04b454bb-8a6d-4c4f-8757-7c4fadb217db tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:58:57.898260 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-04b454bb-8a6d-4c4f-8757-7c4fadb217db tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:58:57.898698 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-04b454bb-8a6d-4c4f-8757-7c4fadb217db tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:58:58.029286 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-04b454bb-8a6d-4c4f-8757-7c4fadb217db tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771e9bc89e9d459e9e1714de7c514f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4acd2b59f7943cbb555876b9df70bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:58:58.037535 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-04b454bb-8a6d-4c4f-8757-7c4fadb217db tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "GET /compute/v2.1/servers/c6b44a27-e394-4426-a25f-5597c3000a62" status: 200 len: 1393 microversion: 2.1 time: 0.151913 Oct 08 21:58:58.038108 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3400/6875] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:58:57 2022] GET /compute/v2.1/servers/c6b44a27-e394-4426-a25f-5597c3000a62 => generated 1393 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:58:58.608497 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-c9415689-d8f5-49e0-956f-96735660eef0 req-d8d28090-ec16-4890-ab11-242e0b82902a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6b44a27-e394-4426-a25f-5597c3000a62", "name": "network-vif-plugged", "status": "completed", "tag": "8fd483c9-5a6c-4317-ad15-69e7df15611b"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:58:58.619339 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-c9415689-d8f5-49e0-956f-96735660eef0 req-d8d28090-ec16-4890-ab11-242e0b82902a service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:58:58.619857 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-c9415689-d8f5-49e0-956f-96735660eef0 req-d8d28090-ec16-4890-ab11-242e0b82902a service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:58:58.620320 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-c9415689-d8f5-49e0-956f-96735660eef0 req-d8d28090-ec16-4890-ab11-242e0b82902a service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:58:58.632270 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-c9415689-d8f5-49e0-956f-96735660eef0 req-d8d28090-ec16-4890-ab11-242e0b82902a service nova] Creating event network-vif-plugged:8fd483c9-5a6c-4317-ad15-69e7df15611b for instance c6b44a27-e394-4426-a25f-5597c3000a62 on nch2-master-1 Oct 08 21:58:58.637399 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-c9415689-d8f5-49e0-956f-96735660eef0 req-d8d28090-ec16-4890-ab11-242e0b82902a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032653 Oct 08 21:58:58.638201 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3476/6876] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:58:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 08 21:58:59.060118 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-6807c7f9-a53f-4263-8998-b1d6dbf60693 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:58:59.060743 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-6807c7f9-a53f-4263-8998-b1d6dbf60693 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: c6b44a27-e394-4426-a25f-5597c3000a62] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:58:59.068645 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6807c7f9-a53f-4263-8998-b1d6dbf60693 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:58:59.069150 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6807c7f9-a53f-4263-8998-b1d6dbf60693 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:58:59.069627 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6807c7f9-a53f-4263-8998-b1d6dbf60693 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:58:59.070387 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6807c7f9-a53f-4263-8998-b1d6dbf60693 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:58:59.070964 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6807c7f9-a53f-4263-8998-b1d6dbf60693 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:58:59.071447 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6807c7f9-a53f-4263-8998-b1d6dbf60693 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:58:59.212962 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-6807c7f9-a53f-4263-8998-b1d6dbf60693 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771e9bc89e9d459e9e1714de7c514f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4acd2b59f7943cbb555876b9df70bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:58:59.221257 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-6807c7f9-a53f-4263-8998-b1d6dbf60693 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "GET /compute/v2.1/servers/c6b44a27-e394-4426-a25f-5597c3000a62" status: 200 len: 1393 microversion: 2.1 time: 0.165149 Oct 08 21:58:59.221945 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3401/6877] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:58:59 2022] GET /compute/v2.1/servers/c6b44a27-e394-4426-a25f-5597c3000a62 => generated 1393 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:59:00.245494 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-ec15682e-8329-4a21-8ce7-dea7bd5c2646 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:59:00.246228 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-ec15682e-8329-4a21-8ce7-dea7bd5c2646 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: c6b44a27-e394-4426-a25f-5597c3000a62] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:59:00.252584 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ec15682e-8329-4a21-8ce7-dea7bd5c2646 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:59:00.253098 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ec15682e-8329-4a21-8ce7-dea7bd5c2646 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:59:00.253591 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ec15682e-8329-4a21-8ce7-dea7bd5c2646 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:59:00.254317 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ec15682e-8329-4a21-8ce7-dea7bd5c2646 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:59:00.254805 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ec15682e-8329-4a21-8ce7-dea7bd5c2646 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:59:00.255263 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ec15682e-8329-4a21-8ce7-dea7bd5c2646 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:59:00.394841 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-ec15682e-8329-4a21-8ce7-dea7bd5c2646 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771e9bc89e9d459e9e1714de7c514f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4acd2b59f7943cbb555876b9df70bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:59:00.402711 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-ec15682e-8329-4a21-8ce7-dea7bd5c2646 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "GET /compute/v2.1/servers/c6b44a27-e394-4426-a25f-5597c3000a62" status: 200 len: 1565 microversion: 2.1 time: 0.162460 Oct 08 21:59:00.403302 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3477/6878] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:59:00 2022] GET /compute/v2.1/servers/c6b44a27-e394-4426-a25f-5597c3000a62 => generated 1565 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:59:00.424850 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-f8c7060d-f1c1-4398-ab1c-1ffa46272a22 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:59:00.425514 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-f8c7060d-f1c1-4398-ab1c-1ffa46272a22 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: c6b44a27-e394-4426-a25f-5597c3000a62] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:59:00.432794 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f8c7060d-f1c1-4398-ab1c-1ffa46272a22 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:59:00.433325 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f8c7060d-f1c1-4398-ab1c-1ffa46272a22 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:59:00.433772 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f8c7060d-f1c1-4398-ab1c-1ffa46272a22 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:59:00.434472 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f8c7060d-f1c1-4398-ab1c-1ffa46272a22 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:59:00.434934 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f8c7060d-f1c1-4398-ab1c-1ffa46272a22 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:59:00.435363 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f8c7060d-f1c1-4398-ab1c-1ffa46272a22 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:59:00.564832 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-f8c7060d-f1c1-4398-ab1c-1ffa46272a22 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771e9bc89e9d459e9e1714de7c514f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4acd2b59f7943cbb555876b9df70bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:59:00.573048 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-f8c7060d-f1c1-4398-ab1c-1ffa46272a22 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "GET /compute/v2.1/servers/c6b44a27-e394-4426-a25f-5597c3000a62" status: 200 len: 1565 microversion: 2.1 time: 0.152128 Oct 08 21:59:00.573655 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3402/6879] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:59:00 2022] GET /compute/v2.1/servers/c6b44a27-e394-4426-a25f-5597c3000a62 => generated 1565 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:59:02.398426 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-4a720052-e5c4-4bbe-918c-535ffef4877c tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:59:02.399702 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-4a720052-e5c4-4bbe-918c-535ffef4877c tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: c6b44a27-e394-4426-a25f-5597c3000a62] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:59:02.401686 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-b8ceed1f-b402-4284-af12-936646581a97 req-73427841-80f3-4f21-a4f3-135645578e16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6b44a27-e394-4426-a25f-5597c3000a62", "tag": "8fd483c9-5a6c-4317-ad15-69e7df15611b"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:59:02.402142 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=6 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:59:02.403644 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=1 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:59:02.408962 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4a720052-e5c4-4bbe-918c-535ffef4877c tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:59:02.409538 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4a720052-e5c4-4bbe-918c-535ffef4877c tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:59:02.410036 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4a720052-e5c4-4bbe-918c-535ffef4877c tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:59:02.410886 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4a720052-e5c4-4bbe-918c-535ffef4877c tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:59:02.412067 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4a720052-e5c4-4bbe-918c-535ffef4877c tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:59:02.412759 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4a720052-e5c4-4bbe-918c-535ffef4877c tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:59:02.413101 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=2 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:59:02.414507 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=6 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:59:02.416260 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:59:02.418562 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-b8ceed1f-b402-4284-af12-936646581a97 req-73427841-80f3-4f21-a4f3-135645578e16 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:59:02.419139 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-b8ceed1f-b402-4284-af12-936646581a97 req-73427841-80f3-4f21-a4f3-135645578e16 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:59:02.419777 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-b8ceed1f-b402-4284-af12-936646581a97 req-73427841-80f3-4f21-a4f3-135645578e16 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:59:02.436731 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-b8ceed1f-b402-4284-af12-936646581a97 req-73427841-80f3-4f21-a4f3-135645578e16 service nova] Creating event network-changed:8fd483c9-5a6c-4317-ad15-69e7df15611b for instance c6b44a27-e394-4426-a25f-5597c3000a62 on nch2-master-1 Oct 08 21:59:02.443257 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-b8ceed1f-b402-4284-af12-936646581a97 req-73427841-80f3-4f21-a4f3-135645578e16 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045489 Oct 08 21:59:02.444186 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3403/6880] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 21:59:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 21:59:02.642370 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-4a720052-e5c4-4bbe-918c-535ffef4877c tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771e9bc89e9d459e9e1714de7c514f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4acd2b59f7943cbb555876b9df70bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:59:02.653669 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-4a720052-e5c4-4bbe-918c-535ffef4877c tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "GET /compute/v2.1/servers/c6b44a27-e394-4426-a25f-5597c3000a62" status: 200 len: 1565 microversion: 2.1 time: 0.259205 Oct 08 21:59:02.654692 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3478/6881] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:59:02 2022] GET /compute/v2.1/servers/c6b44a27-e394-4426-a25f-5597c3000a62 => generated 1565 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:59:25.902912 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=36 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:59:25.908250 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-9167bf96-74e1-4ebd-8b74-8bff9c6444d9 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:59:25.910566 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-9167bf96-74e1-4ebd-8b74-8bff9c6444d9 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: c6b44a27-e394-4426-a25f-5597c3000a62] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:59:25.922348 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9167bf96-74e1-4ebd-8b74-8bff9c6444d9 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:59:25.922837 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9167bf96-74e1-4ebd-8b74-8bff9c6444d9 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:59:25.923278 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9167bf96-74e1-4ebd-8b74-8bff9c6444d9 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:59:25.923982 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9167bf96-74e1-4ebd-8b74-8bff9c6444d9 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:59:25.924444 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9167bf96-74e1-4ebd-8b74-8bff9c6444d9 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:59:25.924873 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9167bf96-74e1-4ebd-8b74-8bff9c6444d9 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:59:25.979996 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-9167bf96-74e1-4ebd-8b74-8bff9c6444d9 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "POST /compute/v2.1/servers/c6b44a27-e394-4426-a25f-5597c3000a62/action" status: 200 len: 24572 microversion: 2.1 time: 0.079009 Oct 08 21:59:25.980652 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3404/6882] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:59:25 2022] POST /compute/v2.1/servers/c6b44a27-e394-4426-a25f-5597c3000a62/action => generated 24572 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 08 21:59:32.405260 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-ce2a4746-f773-47b5-b547-4bdb9f0844c8 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 21:59:32.407499 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-ce2a4746-f773-47b5-b547-4bdb9f0844c8 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: c6b44a27-e394-4426-a25f-5597c3000a62] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:59:32.409889 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=1 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:59:32.410557 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=32 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 21:59:32.418996 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ce2a4746-f773-47b5-b547-4bdb9f0844c8 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:59:32.419504 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ce2a4746-f773-47b5-b547-4bdb9f0844c8 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:59:32.419964 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ce2a4746-f773-47b5-b547-4bdb9f0844c8 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:59:32.420689 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ce2a4746-f773-47b5-b547-4bdb9f0844c8 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:59:32.421167 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ce2a4746-f773-47b5-b547-4bdb9f0844c8 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:59:32.421650 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ce2a4746-f773-47b5-b547-4bdb9f0844c8 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:59:32.496812 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-ce2a4746-f773-47b5-b547-4bdb9f0844c8 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "POST /compute/v2.1/servers/c6b44a27-e394-4426-a25f-5597c3000a62/action" status: 202 len: 0 microversion: 2.1 time: 0.095553 Oct 08 21:59:32.497684 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3479/6883] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 21:59:32 2022] POST /compute/v2.1/servers/c6b44a27-e394-4426-a25f-5597c3000a62/action => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 21:59:32.506512 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-3075752b-de1a-4005-838b-cd847c3a5e04 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:59:32.507226 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-3075752b-de1a-4005-838b-cd847c3a5e04 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: c6b44a27-e394-4426-a25f-5597c3000a62] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:59:32.514661 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3075752b-de1a-4005-838b-cd847c3a5e04 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:59:32.515159 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3075752b-de1a-4005-838b-cd847c3a5e04 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:59:32.515621 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3075752b-de1a-4005-838b-cd847c3a5e04 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:59:32.516323 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3075752b-de1a-4005-838b-cd847c3a5e04 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:59:32.516896 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3075752b-de1a-4005-838b-cd847c3a5e04 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:59:32.517322 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3075752b-de1a-4005-838b-cd847c3a5e04 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:59:32.654676 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-3075752b-de1a-4005-838b-cd847c3a5e04 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771e9bc89e9d459e9e1714de7c514f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4acd2b59f7943cbb555876b9df70bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:59:32.663760 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-3075752b-de1a-4005-838b-cd847c3a5e04 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "GET /compute/v2.1/servers/c6b44a27-e394-4426-a25f-5597c3000a62" status: 200 len: 1676 microversion: 2.1 time: 0.161481 Oct 08 21:59:32.664601 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3405/6884] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:59:32 2022] GET /compute/v2.1/servers/c6b44a27-e394-4426-a25f-5597c3000a62 => generated 1676 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:59:33.687401 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-b08121e6-501d-434a-aee2-4e08caf66eb9 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:59:33.688194 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-b08121e6-501d-434a-aee2-4e08caf66eb9 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: c6b44a27-e394-4426-a25f-5597c3000a62] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:59:33.696101 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b08121e6-501d-434a-aee2-4e08caf66eb9 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:59:33.696608 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b08121e6-501d-434a-aee2-4e08caf66eb9 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:59:33.697099 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b08121e6-501d-434a-aee2-4e08caf66eb9 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:59:33.697850 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b08121e6-501d-434a-aee2-4e08caf66eb9 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:59:33.698394 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b08121e6-501d-434a-aee2-4e08caf66eb9 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:59:33.698849 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b08121e6-501d-434a-aee2-4e08caf66eb9 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:59:33.852089 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-b08121e6-501d-434a-aee2-4e08caf66eb9 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771e9bc89e9d459e9e1714de7c514f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4acd2b59f7943cbb555876b9df70bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:59:33.859949 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-b08121e6-501d-434a-aee2-4e08caf66eb9 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "GET /compute/v2.1/servers/c6b44a27-e394-4426-a25f-5597c3000a62" status: 200 len: 1681 microversion: 2.1 time: 0.177105 Oct 08 21:59:33.860539 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3480/6885] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:59:33 2022] GET /compute/v2.1/servers/c6b44a27-e394-4426-a25f-5597c3000a62 => generated 1681 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:59:34.884275 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-aa2fdc62-67d2-4c51-b1be-2e19cc339937 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:59:34.884899 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-aa2fdc62-67d2-4c51-b1be-2e19cc339937 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: c6b44a27-e394-4426-a25f-5597c3000a62] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:59:34.891861 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-aa2fdc62-67d2-4c51-b1be-2e19cc339937 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:59:34.892360 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-aa2fdc62-67d2-4c51-b1be-2e19cc339937 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:59:34.892818 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-aa2fdc62-67d2-4c51-b1be-2e19cc339937 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:59:34.893558 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-aa2fdc62-67d2-4c51-b1be-2e19cc339937 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:59:34.894029 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-aa2fdc62-67d2-4c51-b1be-2e19cc339937 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:59:34.894466 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-aa2fdc62-67d2-4c51-b1be-2e19cc339937 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:59:35.028488 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-aa2fdc62-67d2-4c51-b1be-2e19cc339937 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771e9bc89e9d459e9e1714de7c514f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4acd2b59f7943cbb555876b9df70bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:59:35.036421 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-aa2fdc62-67d2-4c51-b1be-2e19cc339937 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "GET /compute/v2.1/servers/c6b44a27-e394-4426-a25f-5597c3000a62" status: 200 len: 1681 microversion: 2.1 time: 0.156558 Oct 08 21:59:35.037002 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3406/6886] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:59:34 2022] GET /compute/v2.1/servers/c6b44a27-e394-4426-a25f-5597c3000a62 => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:59:36.060538 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-fa5e7fa5-9b57-4670-be05-f69077e117f0 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:59:36.061232 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-fa5e7fa5-9b57-4670-be05-f69077e117f0 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: c6b44a27-e394-4426-a25f-5597c3000a62] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:59:36.068475 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fa5e7fa5-9b57-4670-be05-f69077e117f0 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:59:36.068990 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fa5e7fa5-9b57-4670-be05-f69077e117f0 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:59:36.069492 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fa5e7fa5-9b57-4670-be05-f69077e117f0 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:59:36.070224 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fa5e7fa5-9b57-4670-be05-f69077e117f0 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:59:36.070720 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fa5e7fa5-9b57-4670-be05-f69077e117f0 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:59:36.071185 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fa5e7fa5-9b57-4670-be05-f69077e117f0 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:59:36.201303 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-fa5e7fa5-9b57-4670-be05-f69077e117f0 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771e9bc89e9d459e9e1714de7c514f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4acd2b59f7943cbb555876b9df70bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:59:36.209703 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-fa5e7fa5-9b57-4670-be05-f69077e117f0 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "GET /compute/v2.1/servers/c6b44a27-e394-4426-a25f-5597c3000a62" status: 200 len: 1681 microversion: 2.1 time: 0.153189 Oct 08 21:59:36.210279 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3481/6887] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:59:36 2022] GET /compute/v2.1/servers/c6b44a27-e394-4426-a25f-5597c3000a62 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:59:37.233517 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-b5004f39-653a-471f-9eab-fdd74661841e tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:59:37.234141 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-b5004f39-653a-471f-9eab-fdd74661841e tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: c6b44a27-e394-4426-a25f-5597c3000a62] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:59:37.241813 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b5004f39-653a-471f-9eab-fdd74661841e tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:59:37.242307 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b5004f39-653a-471f-9eab-fdd74661841e tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:59:37.242750 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b5004f39-653a-471f-9eab-fdd74661841e tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:59:37.243450 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b5004f39-653a-471f-9eab-fdd74661841e tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:59:37.243911 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b5004f39-653a-471f-9eab-fdd74661841e tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:59:37.244343 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b5004f39-653a-471f-9eab-fdd74661841e tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:59:37.373978 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-b5004f39-653a-471f-9eab-fdd74661841e tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771e9bc89e9d459e9e1714de7c514f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4acd2b59f7943cbb555876b9df70bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:59:37.381772 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-b5004f39-653a-471f-9eab-fdd74661841e tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "GET /compute/v2.1/servers/c6b44a27-e394-4426-a25f-5597c3000a62" status: 200 len: 1681 microversion: 2.1 time: 0.152278 Oct 08 21:59:37.382397 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3407/6888] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:59:37 2022] GET /compute/v2.1/servers/c6b44a27-e394-4426-a25f-5597c3000a62 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:59:38.404003 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-022559e0-85d2-4675-8368-77bf98aa86db tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:59:38.404647 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-022559e0-85d2-4675-8368-77bf98aa86db tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: c6b44a27-e394-4426-a25f-5597c3000a62] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:59:38.411955 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-022559e0-85d2-4675-8368-77bf98aa86db tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:59:38.412467 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-022559e0-85d2-4675-8368-77bf98aa86db tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:59:38.412929 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-022559e0-85d2-4675-8368-77bf98aa86db tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:59:38.413694 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-022559e0-85d2-4675-8368-77bf98aa86db tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:59:38.414182 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-022559e0-85d2-4675-8368-77bf98aa86db tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:59:38.414630 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-022559e0-85d2-4675-8368-77bf98aa86db tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:59:38.548719 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-022559e0-85d2-4675-8368-77bf98aa86db tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771e9bc89e9d459e9e1714de7c514f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4acd2b59f7943cbb555876b9df70bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:59:38.557175 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-022559e0-85d2-4675-8368-77bf98aa86db tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "GET /compute/v2.1/servers/c6b44a27-e394-4426-a25f-5597c3000a62" status: 200 len: 1681 microversion: 2.1 time: 0.157109 Oct 08 21:59:38.557785 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3482/6889] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:59:38 2022] GET /compute/v2.1/servers/c6b44a27-e394-4426-a25f-5597c3000a62 => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:59:39.581254 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-3398c50b-fe91-43ea-ab65-d3078374a413 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:59:39.581868 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-3398c50b-fe91-43ea-ab65-d3078374a413 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: c6b44a27-e394-4426-a25f-5597c3000a62] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:59:39.589466 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3398c50b-fe91-43ea-ab65-d3078374a413 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:59:39.589953 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3398c50b-fe91-43ea-ab65-d3078374a413 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:59:39.590396 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3398c50b-fe91-43ea-ab65-d3078374a413 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:59:39.591086 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3398c50b-fe91-43ea-ab65-d3078374a413 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:59:39.591551 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3398c50b-fe91-43ea-ab65-d3078374a413 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:59:39.591981 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3398c50b-fe91-43ea-ab65-d3078374a413 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:59:39.731639 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-3398c50b-fe91-43ea-ab65-d3078374a413 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771e9bc89e9d459e9e1714de7c514f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4acd2b59f7943cbb555876b9df70bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:59:39.739526 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-3398c50b-fe91-43ea-ab65-d3078374a413 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "GET /compute/v2.1/servers/c6b44a27-e394-4426-a25f-5597c3000a62" status: 200 len: 1681 microversion: 2.1 time: 0.162436 Oct 08 21:59:39.740758 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3408/6890] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:59:39 2022] GET /compute/v2.1/servers/c6b44a27-e394-4426-a25f-5597c3000a62 => generated 1681 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:59:40.763635 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-048ef2f1-2ce5-4701-bcfd-1e891c6126a4 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:59:40.764280 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-048ef2f1-2ce5-4701-bcfd-1e891c6126a4 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: c6b44a27-e394-4426-a25f-5597c3000a62] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:59:40.771256 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-048ef2f1-2ce5-4701-bcfd-1e891c6126a4 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:59:40.771783 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-048ef2f1-2ce5-4701-bcfd-1e891c6126a4 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:59:40.772751 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-048ef2f1-2ce5-4701-bcfd-1e891c6126a4 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:59:40.773517 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-048ef2f1-2ce5-4701-bcfd-1e891c6126a4 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:59:40.774006 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-048ef2f1-2ce5-4701-bcfd-1e891c6126a4 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:59:40.774468 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-048ef2f1-2ce5-4701-bcfd-1e891c6126a4 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:59:40.909469 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-048ef2f1-2ce5-4701-bcfd-1e891c6126a4 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771e9bc89e9d459e9e1714de7c514f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4acd2b59f7943cbb555876b9df70bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:59:40.917794 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-048ef2f1-2ce5-4701-bcfd-1e891c6126a4 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "GET /compute/v2.1/servers/c6b44a27-e394-4426-a25f-5597c3000a62" status: 200 len: 1681 microversion: 2.1 time: 0.158090 Oct 08 21:59:40.918368 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3483/6891] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:59:40 2022] GET /compute/v2.1/servers/c6b44a27-e394-4426-a25f-5597c3000a62 => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:59:41.941023 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c9fa9107-013c-4543-8eff-08dff40621ad tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:59:41.941672 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-c9fa9107-013c-4543-8eff-08dff40621ad tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: c6b44a27-e394-4426-a25f-5597c3000a62] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:59:41.948252 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c9fa9107-013c-4543-8eff-08dff40621ad tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:59:41.948728 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c9fa9107-013c-4543-8eff-08dff40621ad tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:59:41.949167 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c9fa9107-013c-4543-8eff-08dff40621ad tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:59:41.949881 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c9fa9107-013c-4543-8eff-08dff40621ad tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:59:41.950338 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c9fa9107-013c-4543-8eff-08dff40621ad tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:59:41.950769 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c9fa9107-013c-4543-8eff-08dff40621ad tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:59:42.080341 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-c9fa9107-013c-4543-8eff-08dff40621ad tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771e9bc89e9d459e9e1714de7c514f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4acd2b59f7943cbb555876b9df70bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:59:42.088683 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-c9fa9107-013c-4543-8eff-08dff40621ad tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "GET /compute/v2.1/servers/c6b44a27-e394-4426-a25f-5597c3000a62" status: 200 len: 1681 microversion: 2.1 time: 0.151882 Oct 08 21:59:42.089281 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3409/6892] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:59:41 2022] GET /compute/v2.1/servers/c6b44a27-e394-4426-a25f-5597c3000a62 => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:59:43.113976 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-ad46a5fb-2e38-4bf4-9c5b-4684bed8e2a7 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:59:43.114544 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-ad46a5fb-2e38-4bf4-9c5b-4684bed8e2a7 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: c6b44a27-e394-4426-a25f-5597c3000a62] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:59:43.121563 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ad46a5fb-2e38-4bf4-9c5b-4684bed8e2a7 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:59:43.122070 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ad46a5fb-2e38-4bf4-9c5b-4684bed8e2a7 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:59:43.122530 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ad46a5fb-2e38-4bf4-9c5b-4684bed8e2a7 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:59:43.123254 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ad46a5fb-2e38-4bf4-9c5b-4684bed8e2a7 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:59:43.123729 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ad46a5fb-2e38-4bf4-9c5b-4684bed8e2a7 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:59:43.124177 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ad46a5fb-2e38-4bf4-9c5b-4684bed8e2a7 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:59:43.253046 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-ad46a5fb-2e38-4bf4-9c5b-4684bed8e2a7 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771e9bc89e9d459e9e1714de7c514f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4acd2b59f7943cbb555876b9df70bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:59:43.260908 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-ad46a5fb-2e38-4bf4-9c5b-4684bed8e2a7 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "GET /compute/v2.1/servers/c6b44a27-e394-4426-a25f-5597c3000a62" status: 200 len: 1681 microversion: 2.1 time: 0.152389 Oct 08 21:59:43.261518 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3484/6893] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:59:43 2022] GET /compute/v2.1/servers/c6b44a27-e394-4426-a25f-5597c3000a62 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 21:59:44.284538 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-0b43a233-71fa-41d3-a80e-9489c51216fb tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 21:59:44.285284 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-0b43a233-71fa-41d3-a80e-9489c51216fb tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: c6b44a27-e394-4426-a25f-5597c3000a62] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 21:59:44.292195 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0b43a233-71fa-41d3-a80e-9489c51216fb tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:59:44.292684 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0b43a233-71fa-41d3-a80e-9489c51216fb tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:59:44.293126 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0b43a233-71fa-41d3-a80e-9489c51216fb tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:59:44.293855 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0b43a233-71fa-41d3-a80e-9489c51216fb tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 21:59:44.294336 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0b43a233-71fa-41d3-a80e-9489c51216fb tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 21:59:44.294763 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0b43a233-71fa-41d3-a80e-9489c51216fb tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 21:59:44.429077 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-0b43a233-71fa-41d3-a80e-9489c51216fb tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771e9bc89e9d459e9e1714de7c514f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4acd2b59f7943cbb555876b9df70bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 21:59:44.437301 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-0b43a233-71fa-41d3-a80e-9489c51216fb tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "GET /compute/v2.1/servers/c6b44a27-e394-4426-a25f-5597c3000a62" status: 200 len: 1684 microversion: 2.1 time: 0.157124 Oct 08 21:59:44.437885 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3410/6894] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 21:59:44 2022] GET /compute/v2.1/servers/c6b44a27-e394-4426-a25f-5597c3000a62 => generated 1684 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:00:08.627225 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-fd3b7d4a-894b-4ff9-9fd5-229d6cb49196 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 22:00:08.629436 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-fd3b7d4a-894b-4ff9-9fd5-229d6cb49196 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: c6b44a27-e394-4426-a25f-5597c3000a62] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:00:08.632751 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=12 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 22:00:08.633611 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 22:00:08.640227 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fd3b7d4a-894b-4ff9-9fd5-229d6cb49196 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:00:08.640738 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fd3b7d4a-894b-4ff9-9fd5-229d6cb49196 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:00:08.641271 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fd3b7d4a-894b-4ff9-9fd5-229d6cb49196 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:00:08.641940 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fd3b7d4a-894b-4ff9-9fd5-229d6cb49196 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:00:08.642421 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fd3b7d4a-894b-4ff9-9fd5-229d6cb49196 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:00:08.642911 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fd3b7d4a-894b-4ff9-9fd5-229d6cb49196 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:00:08.700568 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-fd3b7d4a-894b-4ff9-9fd5-229d6cb49196 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "POST /compute/v2.1/servers/c6b44a27-e394-4426-a25f-5597c3000a62/action" status: 200 len: 68689 microversion: 2.1 time: 0.077260 Oct 08 22:00:08.702188 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3485/6895] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 22:00:08 2022] POST /compute/v2.1/servers/c6b44a27-e394-4426-a25f-5597c3000a62/action => generated 68689 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 08 22:00:15.717648 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-3a101d0f-822e-42a5-9b4b-73672894fee3 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:00:15.718373 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-3a101d0f-822e-42a5-9b4b-73672894fee3 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: c6b44a27-e394-4426-a25f-5597c3000a62] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:00:15.720225 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-f36b06b5-bcde-4b46-9492-801a59dd4645 req-adc75d19-b899-4ecc-b00b-c4fd573bf65c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6b44a27-e394-4426-a25f-5597c3000a62", "tag": "8fd483c9-5a6c-4317-ad15-69e7df15611b"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 22:00:15.721038 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:SELECT=15 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 22:00:15.721812 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=40 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 22:00:15.730311 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3a101d0f-822e-42a5-9b4b-73672894fee3 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:00:15.730926 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3a101d0f-822e-42a5-9b4b-73672894fee3 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:00:15.731455 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3a101d0f-822e-42a5-9b4b-73672894fee3 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:00:15.732258 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3a101d0f-822e-42a5-9b4b-73672894fee3 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:00:15.732801 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3a101d0f-822e-42a5-9b4b-73672894fee3 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:00:15.733364 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3a101d0f-822e-42a5-9b4b-73672894fee3 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:00:15.746985 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-f36b06b5-bcde-4b46-9492-801a59dd4645 req-adc75d19-b899-4ecc-b00b-c4fd573bf65c service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:00:15.747546 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-f36b06b5-bcde-4b46-9492-801a59dd4645 req-adc75d19-b899-4ecc-b00b-c4fd573bf65c service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:00:15.748003 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-f36b06b5-bcde-4b46-9492-801a59dd4645 req-adc75d19-b899-4ecc-b00b-c4fd573bf65c service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:00:15.761814 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-f36b06b5-bcde-4b46-9492-801a59dd4645 req-adc75d19-b899-4ecc-b00b-c4fd573bf65c service nova] Creating event network-changed:8fd483c9-5a6c-4317-ad15-69e7df15611b for instance c6b44a27-e394-4426-a25f-5597c3000a62 on nch2-master-1 Oct 08 22:00:15.764143 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-3a101d0f-822e-42a5-9b4b-73672894fee3 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: c6b44a27-e394-4426-a25f-5597c3000a62] Going to try to terminate instance {{(pid=140491) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 22:00:15.767080 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-f36b06b5-bcde-4b46-9492-801a59dd4645 req-adc75d19-b899-4ecc-b00b-c4fd573bf65c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051260 Oct 08 22:00:15.767787 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3486/6896] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 22:00:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 22:00:15.859852 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-3a101d0f-822e-42a5-9b4b-73672894fee3 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "DELETE /compute/v2.1/servers/c6b44a27-e394-4426-a25f-5597c3000a62" status: 204 len: 0 microversion: 2.1 time: 0.146742 Oct 08 22:00:15.864763 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3411/6897] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 22:00:15 2022] DELETE /compute/v2.1/servers/c6b44a27-e394-4426-a25f-5597c3000a62 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 22:00:15.870518 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-a69ee7d9-2614-402a-b585-7d4b88d99352 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:00:15.871337 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-a69ee7d9-2614-402a-b585-7d4b88d99352 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: c6b44a27-e394-4426-a25f-5597c3000a62] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:00:15.878963 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a69ee7d9-2614-402a-b585-7d4b88d99352 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:00:15.879604 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a69ee7d9-2614-402a-b585-7d4b88d99352 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:00:15.880152 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a69ee7d9-2614-402a-b585-7d4b88d99352 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:00:15.880962 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a69ee7d9-2614-402a-b585-7d4b88d99352 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:00:15.881576 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a69ee7d9-2614-402a-b585-7d4b88d99352 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:00:15.882306 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a69ee7d9-2614-402a-b585-7d4b88d99352 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:00:16.043423 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-a69ee7d9-2614-402a-b585-7d4b88d99352 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771e9bc89e9d459e9e1714de7c514f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4acd2b59f7943cbb555876b9df70bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:00:16.051967 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-a69ee7d9-2614-402a-b585-7d4b88d99352 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "GET /compute/v2.1/servers/c6b44a27-e394-4426-a25f-5597c3000a62" status: 200 len: 1690 microversion: 2.1 time: 0.186723 Oct 08 22:00:16.052701 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3487/6898] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:00:15 2022] GET /compute/v2.1/servers/c6b44a27-e394-4426-a25f-5597c3000a62 => generated 1690 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:00:17.076102 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-18b1d1a2-bbcd-4a40-9b9b-e0b06af30a77 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:00:17.076836 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-18b1d1a2-bbcd-4a40-9b9b-e0b06af30a77 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: c6b44a27-e394-4426-a25f-5597c3000a62] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:00:17.083725 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-18b1d1a2-bbcd-4a40-9b9b-e0b06af30a77 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:00:17.084227 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-18b1d1a2-bbcd-4a40-9b9b-e0b06af30a77 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:00:17.084671 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-18b1d1a2-bbcd-4a40-9b9b-e0b06af30a77 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:00:17.085402 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-18b1d1a2-bbcd-4a40-9b9b-e0b06af30a77 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:00:17.085861 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-18b1d1a2-bbcd-4a40-9b9b-e0b06af30a77 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:00:17.086289 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-18b1d1a2-bbcd-4a40-9b9b-e0b06af30a77 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:00:17.220214 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-18b1d1a2-bbcd-4a40-9b9b-e0b06af30a77 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771e9bc89e9d459e9e1714de7c514f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4acd2b59f7943cbb555876b9df70bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:00:17.228844 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-18b1d1a2-bbcd-4a40-9b9b-e0b06af30a77 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "GET /compute/v2.1/servers/c6b44a27-e394-4426-a25f-5597c3000a62" status: 200 len: 1690 microversion: 2.1 time: 0.157005 Oct 08 22:00:17.229451 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3412/6899] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:00:17 2022] GET /compute/v2.1/servers/c6b44a27-e394-4426-a25f-5597c3000a62 => generated 1690 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:00:18.183170 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-9cd860e9-4ba0-44c8-acde-bf69f2072ea2 req-afe86c88-3db3-49dc-a1ae-c8b4b51eb4c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6b44a27-e394-4426-a25f-5597c3000a62", "name": "network-vif-deleted", "tag": "8fd483c9-5a6c-4317-ad15-69e7df15611b"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 22:00:18.197649 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-9cd860e9-4ba0-44c8-acde-bf69f2072ea2 req-afe86c88-3db3-49dc-a1ae-c8b4b51eb4c7 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:00:18.198411 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-9cd860e9-4ba0-44c8-acde-bf69f2072ea2 req-afe86c88-3db3-49dc-a1ae-c8b4b51eb4c7 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:00:18.198614 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-9cd860e9-4ba0-44c8-acde-bf69f2072ea2 req-afe86c88-3db3-49dc-a1ae-c8b4b51eb4c7 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:00:18.212209 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-9cd860e9-4ba0-44c8-acde-bf69f2072ea2 req-afe86c88-3db3-49dc-a1ae-c8b4b51eb4c7 service nova] Creating event network-vif-deleted:8fd483c9-5a6c-4317-ad15-69e7df15611b for instance c6b44a27-e394-4426-a25f-5597c3000a62 on nch2-master-1 Oct 08 22:00:18.218309 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-9cd860e9-4ba0-44c8-acde-bf69f2072ea2 req-afe86c88-3db3-49dc-a1ae-c8b4b51eb4c7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039380 Oct 08 22:00:18.218927 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3488/6900] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 22:00:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 22:00:18.252252 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-dcbd5493-8b11-4cea-b34d-7f2ae996c56e tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:00:18.253079 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-dcbd5493-8b11-4cea-b34d-7f2ae996c56e tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: c6b44a27-e394-4426-a25f-5597c3000a62] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:00:18.261617 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dcbd5493-8b11-4cea-b34d-7f2ae996c56e tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:00:18.262122 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dcbd5493-8b11-4cea-b34d-7f2ae996c56e tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:00:18.262574 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dcbd5493-8b11-4cea-b34d-7f2ae996c56e tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:00:18.263322 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dcbd5493-8b11-4cea-b34d-7f2ae996c56e tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:00:18.263793 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dcbd5493-8b11-4cea-b34d-7f2ae996c56e tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:00:18.264235 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dcbd5493-8b11-4cea-b34d-7f2ae996c56e tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:00:18.296966 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dcbd5493-8b11-4cea-b34d-7f2ae996c56e tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:00:18.297519 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dcbd5493-8b11-4cea-b34d-7f2ae996c56e tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:00:18.297971 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dcbd5493-8b11-4cea-b34d-7f2ae996c56e tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:00:18.298499 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.objects.instance [None req-dcbd5493-8b11-4cea-b34d-7f2ae996c56e tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lazy-loading 'fault' on Instance uuid c6b44a27-e394-4426-a25f-5597c3000a62 {{(pid=140491) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 22:00:18.343245 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-dcbd5493-8b11-4cea-b34d-7f2ae996c56e tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771e9bc89e9d459e9e1714de7c514f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4acd2b59f7943cbb555876b9df70bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:00:18.351885 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-dcbd5493-8b11-4cea-b34d-7f2ae996c56e tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "GET /compute/v2.1/servers/c6b44a27-e394-4426-a25f-5597c3000a62" status: 200 len: 1357 microversion: 2.1 time: 0.103580 Oct 08 22:00:18.353301 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3413/6901] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:00:18 2022] GET /compute/v2.1/servers/c6b44a27-e394-4426-a25f-5597c3000a62 => generated 1357 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:00:19.376075 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-8bc3e90a-f149-4ae7-ab27-bf71c0e97b64 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:00:19.376797 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-8bc3e90a-f149-4ae7-ab27-bf71c0e97b64 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: c6b44a27-e394-4426-a25f-5597c3000a62] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:00:19.384791 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8bc3e90a-f149-4ae7-ab27-bf71c0e97b64 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:00:19.385395 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8bc3e90a-f149-4ae7-ab27-bf71c0e97b64 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:00:19.385858 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8bc3e90a-f149-4ae7-ab27-bf71c0e97b64 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:00:19.386574 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8bc3e90a-f149-4ae7-ab27-bf71c0e97b64 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:00:19.387049 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8bc3e90a-f149-4ae7-ab27-bf71c0e97b64 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:00:19.387498 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8bc3e90a-f149-4ae7-ab27-bf71c0e97b64 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:00:19.401558 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-8bc3e90a-f149-4ae7-ab27-bf71c0e97b64 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] HTTP exception thrown: Instance c6b44a27-e394-4426-a25f-5597c3000a62 could not be found. Oct 08 22:00:19.403180 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-8bc3e90a-f149-4ae7-ab27-bf71c0e97b64 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Request method failure captured: Oct 08 22:00:19.403180 ncdv-master-1 devstack@n-api.service[140492]: request: GET /compute/v2.1/servers/c6b44a27-e394-4426-a25f-5597c3000a62 HTTP/1.1 Oct 08 22:00:19.403180 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 22:00:19.403180 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 22:00:19.403180 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 22:00:19.403180 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 22:00:19.403180 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 22:00:19.403180 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 22:00:19.403180 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 22:00:19.403180 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 22:00:19.403180 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQfJQuuM4QaRSXOpK2YhyslcxnkJ03o0TeYKo-1sghAmNBGzTEmttugknoEotMcyK5hDZNRRFN5h_g-OLCqYD0f2cwEDT-h9hsKxYJXhTkmbUu76pLNz3djjSXZaSj_lX8tX8qa-8wLl1CIxv5sl6Y_9B2OxGfOgq2QPxELxT30_sgQc Oct 08 22:00:19.403180 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 22:00:19.403180 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 22:00:19.403180 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 22:00:19.403180 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 22:00:19.403180 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 22:00:19.403180 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 22:00:19.403180 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: b4acd2b59f7943cbb555876b9df70bee Oct 08 22:00:19.403180 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-2097292340 Oct 08 22:00:19.403180 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 22:00:19.403180 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 22:00:19.403180 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b4acd2b59f7943cbb555876b9df70bee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b4acd2b59f7943cbb555876b9df70bee"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b4acd2b59f7943cbb555876b9df70bee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b4acd2b59f7943cbb555876b9df70bee"}]}] Oct 08 22:00:19.403180 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-TestNetworkAdvancedServerOps-2097292340 Oct 08 22:00:19.403180 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: b4acd2b59f7943cbb555876b9df70bee Oct 08 22:00:19.403180 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-2097292340 Oct 08 22:00:19.403180 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-TestNetworkAdvancedServerOps-2097292340-project Oct 08 22:00:19.403180 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 22:00:19.403180 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 22:00:19.403180 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 771e9bc89e9d459e9e1714de7c514f4f Oct 08 22:00:19.403180 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-TestNetworkAdvancedServerOps-2097292340-project Oct 08 22:00:19.403180 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 22:00:19.403180 ncdv-master-1 devstack@n-api.service[140492]: exception: Instance c6b44a27-e394-4426-a25f-5597c3000a62 could not be found. Oct 08 22:00:19.403180 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': 'c6b44a27-e394-4426-a25f-5597c3000a62'} Oct 08 22:00:19.403180 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 22:00:19.403180 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 22:00:19.403180 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 22:00:19.403180 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 22:00:19.403180 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 22:00:19.403180 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 22:00:19.403180 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 22:00:19.403180 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 22:00:19.403180 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 22:00:19.403180 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 22:00:19.403180 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6b44a27-e394-4426-a25f-5597c3000a62 could not be found. Oct 08 22:00:19.403180 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 22:00:19.403180 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 22:00:19.403180 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 22:00:19.403180 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 22:00:19.403180 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 22:00:19.403180 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 22:00:19.403180 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 22:00:19.403180 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 22:00:19.403180 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 22:00:19.403180 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 22:00:19.403180 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 22:00:19.403180 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 22:00:19.403180 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 22:00:19.403180 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 22:00:19.403180 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 22:00:19.403180 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 22:00:19.403180 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6b44a27-e394-4426-a25f-5597c3000a62 could not be found. Oct 08 22:00:19.403180 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 22:00:19.403180 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 22:00:19.408822 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 22:00:19.408822 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 22:00:19.408822 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 22:00:19.408822 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 22:00:19.408822 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 22:00:19.408822 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 22:00:19.408822 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6b44a27-e394-4426-a25f-5597c3000a62 could not be found. Oct 08 22:00:19.408822 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 22:00:19.408822 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-8bc3e90a-f149-4ae7-ab27-bf71c0e97b64 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Returning 404 to user: Instance c6b44a27-e394-4426-a25f-5597c3000a62 could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 22:00:19.408822 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-8bc3e90a-f149-4ae7-ab27-bf71c0e97b64 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "GET /compute/v2.1/servers/c6b44a27-e394-4426-a25f-5597c3000a62" status: 404 len: 111 microversion: 2.1 time: 0.032867 Oct 08 22:00:19.408822 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3489/6902] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:00:19 2022] GET /compute/v2.1/servers/c6b44a27-e394-4426-a25f-5597c3000a62 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 22:00:22.650927 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-9502f7a5-da5b-46d4-b5a2-9b77604b7cfc tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Calling method '.version_select at 0x7f1a87530040>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:00:22.672862 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-9502f7a5-da5b-46d4-b5a2-9b77604b7cfc tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1892622966" status: 202 len: 0 microversion: 2.1 time: 0.026431 Oct 08 22:00:22.673488 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3414/6903] 10.222.0.26 () {58 vars in 1284 bytes} [Sat Oct 8 22:00:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1892622966 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 22:00:22.710860 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-75e7a3e0-80c5-4d13-8c77-b93c8bd29601 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Action: 'create', calling method: .version_select at 0x7f1a8c16a9d0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1472581118", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC4tcEsbyCD3wK3jUIcfvkD7QwLwa54wnmXx/YLiGgHFNQ+HD08xz/DiXAi5l41lrkfJxODtoCvjt25w5VPropE88gpDZwDufXlrEW8v3W/DPcAqlvpBFvod3paicnbK4A=="}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 22:00:22.729549 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-75e7a3e0-80c5-4d13-8c77-b93c8bd29601 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Getting quotas for project b4acd2b59f7943cbb555876b9df70bee. Resources: {'key_pairs'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 22:00:22.735068 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-75e7a3e0-80c5-4d13-8c77-b93c8bd29601 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Getting quotas for user 771e9bc89e9d459e9e1714de7c514f4f and project b4acd2b59f7943cbb555876b9df70bee. Resources: {'key_pairs'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 22:00:22.760620 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-75e7a3e0-80c5-4d13-8c77-b93c8bd29601 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.054461 Oct 08 22:00:22.761267 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3490/6904] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Oct 8 22:00:22 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 22:00:27.992089 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-164df05d-f7a4-445e-9d3d-cfe754db9f31 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-3252947", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "networks": [{"uuid": "1cfe5086-0c5f-4c02-a8ed-1b297429900f"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1472581118", "security_groups": [{"name": "tempest-secgroup-smoke-604077610"}]}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 22:00:28.233319 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.network.neutron [None req-164df05d-f7a4-445e-9d3d-cfe754db9f31 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] validate_networks() for [('1cfe5086-0c5f-4c02-a8ed-1b297429900f', None, None, None, None, None)] {{(pid=140491) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 22:00:28.347877 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 22:00:28.660224 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-164df05d-f7a4-445e-9d3d-cfe754db9f31 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Flavor limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 22:00:28.660654 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-164df05d-f7a4-445e-9d3d-cfe754db9f31 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Image limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 22:00:28.661142 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-164df05d-f7a4-445e-9d3d-cfe754db9f31 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Flavor pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 22:00:28.661587 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-164df05d-f7a4-445e-9d3d-cfe754db9f31 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Image pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 22:00:28.662013 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-164df05d-f7a4-445e-9d3d-cfe754db9f31 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 22:00:28.671480 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-164df05d-f7a4-445e-9d3d-cfe754db9f31 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:00:28.671963 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-164df05d-f7a4-445e-9d3d-cfe754db9f31 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:00:28.672420 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-164df05d-f7a4-445e-9d3d-cfe754db9f31 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:00:28.673140 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-164df05d-f7a4-445e-9d3d-cfe754db9f31 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:00:28.673625 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-164df05d-f7a4-445e-9d3d-cfe754db9f31 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:00:28.674266 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-164df05d-f7a4-445e-9d3d-cfe754db9f31 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:00:28.693578 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-164df05d-f7a4-445e-9d3d-cfe754db9f31 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Getting quotas for project b4acd2b59f7943cbb555876b9df70bee. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 22:00:28.699216 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-164df05d-f7a4-445e-9d3d-cfe754db9f31 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Getting quotas for user 771e9bc89e9d459e9e1714de7c514f4f and project b4acd2b59f7943cbb555876b9df70bee. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 22:00:28.712223 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-164df05d-f7a4-445e-9d3d-cfe754db9f31 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Going to run 1 instances... {{(pid=140491) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 22:00:28.714590 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-164df05d-f7a4-445e-9d3d-cfe754db9f31 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c508bd7f-7db9-4b2c-af7c-be54a855c355',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140491) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 22:00:28.764233 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-164df05d-f7a4-445e-9d3d-cfe754db9f31 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.777372 Oct 08 22:00:28.765281 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3415/6905] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 22:00:27 2022] POST /compute/v2.1/servers => generated 405 bytes in 779 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 08 22:00:28.777740 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-2a4bb974-2398-4e09-a90b-36833d9fc269 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:00:28.778966 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-2a4bb974-2398-4e09-a90b-36833d9fc269 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:00:28.837340 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-2a4bb974-2398-4e09-a90b-36833d9fc269 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771e9bc89e9d459e9e1714de7c514f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4acd2b59f7943cbb555876b9df70bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:00:28.844744 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-2a4bb974-2398-4e09-a90b-36833d9fc269 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "GET /compute/v2.1/servers/c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc" status: 200 len: 1264 microversion: 2.1 time: 0.071945 Oct 08 22:00:28.845413 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3491/6906] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:00:28 2022] GET /compute/v2.1/servers/c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc => generated 1264 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:00:29.868181 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-62a0c8b3-ddf3-4296-93fe-4bdd9782f295 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:00:29.868795 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-62a0c8b3-ddf3-4296-93fe-4bdd9782f295 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:00:29.876438 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-62a0c8b3-ddf3-4296-93fe-4bdd9782f295 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:00:29.877154 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-62a0c8b3-ddf3-4296-93fe-4bdd9782f295 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:00:29.877641 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-62a0c8b3-ddf3-4296-93fe-4bdd9782f295 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:00:29.878358 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-62a0c8b3-ddf3-4296-93fe-4bdd9782f295 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:00:29.878825 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-62a0c8b3-ddf3-4296-93fe-4bdd9782f295 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:00:29.879263 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-62a0c8b3-ddf3-4296-93fe-4bdd9782f295 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:00:29.942250 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-62a0c8b3-ddf3-4296-93fe-4bdd9782f295 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771e9bc89e9d459e9e1714de7c514f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4acd2b59f7943cbb555876b9df70bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:00:29.950336 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-62a0c8b3-ddf3-4296-93fe-4bdd9782f295 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "GET /compute/v2.1/servers/c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc" status: 200 len: 1316 microversion: 2.1 time: 0.086682 Oct 08 22:00:29.950925 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3416/6907] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:00:29 2022] GET /compute/v2.1/servers/c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc => generated 1316 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:00:30.985618 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-0bcb3598-74b6-404a-8c4f-35e758ce691c tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:00:30.986265 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-0bcb3598-74b6-404a-8c4f-35e758ce691c tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:00:30.993870 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=16 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 22:00:31.002201 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0bcb3598-74b6-404a-8c4f-35e758ce691c tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:00:31.002951 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0bcb3598-74b6-404a-8c4f-35e758ce691c tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:00:31.003616 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0bcb3598-74b6-404a-8c4f-35e758ce691c tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:00:31.004698 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0bcb3598-74b6-404a-8c4f-35e758ce691c tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:00:31.005419 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0bcb3598-74b6-404a-8c4f-35e758ce691c tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:00:31.006554 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0bcb3598-74b6-404a-8c4f-35e758ce691c tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:00:31.181581 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-0bcb3598-74b6-404a-8c4f-35e758ce691c tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771e9bc89e9d459e9e1714de7c514f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4acd2b59f7943cbb555876b9df70bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:00:31.193164 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-0bcb3598-74b6-404a-8c4f-35e758ce691c tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "GET /compute/v2.1/servers/c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc" status: 200 len: 1322 microversion: 2.1 time: 0.222241 Oct 08 22:00:31.197606 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3492/6908] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:00:30 2022] GET /compute/v2.1/servers/c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc => generated 1322 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:00:32.199739 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-835ac12e-165c-442c-a996-89aeba0f5787 req-7170b0e8-fb39-4fd3-a0f6-b6cad1046812 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc", "tag": "a121bcc0-b84b-4f1d-a50a-e3b3f962a8ab"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 22:00:32.211081 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-835ac12e-165c-442c-a996-89aeba0f5787 req-7170b0e8-fb39-4fd3-a0f6-b6cad1046812 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:00:32.211889 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-835ac12e-165c-442c-a996-89aeba0f5787 req-7170b0e8-fb39-4fd3-a0f6-b6cad1046812 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:00:32.212419 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-835ac12e-165c-442c-a996-89aeba0f5787 req-7170b0e8-fb39-4fd3-a0f6-b6cad1046812 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:00:32.221417 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-1fa436ed-81ad-4359-8736-fff542a5e344 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:00:32.222150 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-1fa436ed-81ad-4359-8736-fff542a5e344 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:00:32.229224 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-835ac12e-165c-442c-a996-89aeba0f5787 req-7170b0e8-fb39-4fd3-a0f6-b6cad1046812 service nova] Creating event network-changed:a121bcc0-b84b-4f1d-a50a-e3b3f962a8ab for instance c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc on nch1-master-1 Oct 08 22:00:32.231963 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1fa436ed-81ad-4359-8736-fff542a5e344 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:00:32.232491 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1fa436ed-81ad-4359-8736-fff542a5e344 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:00:32.232965 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1fa436ed-81ad-4359-8736-fff542a5e344 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:00:32.233802 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1fa436ed-81ad-4359-8736-fff542a5e344 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:00:32.234299 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1fa436ed-81ad-4359-8736-fff542a5e344 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:00:32.234612 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-835ac12e-165c-442c-a996-89aeba0f5787 req-7170b0e8-fb39-4fd3-a0f6-b6cad1046812 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097260 Oct 08 22:00:32.234784 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1fa436ed-81ad-4359-8736-fff542a5e344 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:00:32.235242 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3417/6909] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 22:00:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 22:00:32.450431 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-1fa436ed-81ad-4359-8736-fff542a5e344 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771e9bc89e9d459e9e1714de7c514f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4acd2b59f7943cbb555876b9df70bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:00:32.458359 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-1fa436ed-81ad-4359-8736-fff542a5e344 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "GET /compute/v2.1/servers/c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc" status: 200 len: 1389 microversion: 2.1 time: 0.242224 Oct 08 22:00:32.458962 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3493/6910] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:00:32 2022] GET /compute/v2.1/servers/c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc => generated 1389 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 22:00:33.483192 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-be6802a7-9dad-438f-9e1e-7744c7d9b4a1 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:00:33.483933 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-be6802a7-9dad-438f-9e1e-7744c7d9b4a1 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:00:33.490455 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-be6802a7-9dad-438f-9e1e-7744c7d9b4a1 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:00:33.490949 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-be6802a7-9dad-438f-9e1e-7744c7d9b4a1 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:00:33.491398 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-be6802a7-9dad-438f-9e1e-7744c7d9b4a1 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:00:33.492110 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-be6802a7-9dad-438f-9e1e-7744c7d9b4a1 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:00:33.492576 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-be6802a7-9dad-438f-9e1e-7744c7d9b4a1 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:00:33.493011 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-be6802a7-9dad-438f-9e1e-7744c7d9b4a1 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:00:33.628707 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-be6802a7-9dad-438f-9e1e-7744c7d9b4a1 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771e9bc89e9d459e9e1714de7c514f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4acd2b59f7943cbb555876b9df70bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:00:33.637065 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-be6802a7-9dad-438f-9e1e-7744c7d9b4a1 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "GET /compute/v2.1/servers/c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc" status: 200 len: 1389 microversion: 2.1 time: 0.159206 Oct 08 22:00:33.637693 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3418/6911] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:00:33 2022] GET /compute/v2.1/servers/c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc => generated 1389 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:00:34.660190 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-923a9751-c937-4bd7-8a45-04ad981f322b tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:00:34.660747 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-923a9751-c937-4bd7-8a45-04ad981f322b tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:00:34.667744 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-923a9751-c937-4bd7-8a45-04ad981f322b tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:00:34.668260 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-923a9751-c937-4bd7-8a45-04ad981f322b tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:00:34.668724 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-923a9751-c937-4bd7-8a45-04ad981f322b tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:00:34.669477 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-923a9751-c937-4bd7-8a45-04ad981f322b tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:00:34.669964 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-923a9751-c937-4bd7-8a45-04ad981f322b tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:00:34.670417 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-923a9751-c937-4bd7-8a45-04ad981f322b tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:00:34.807510 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-923a9751-c937-4bd7-8a45-04ad981f322b tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771e9bc89e9d459e9e1714de7c514f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4acd2b59f7943cbb555876b9df70bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:00:34.815565 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-923a9751-c937-4bd7-8a45-04ad981f322b tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "GET /compute/v2.1/servers/c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc" status: 200 len: 1389 microversion: 2.1 time: 0.159509 Oct 08 22:00:34.816139 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3494/6912] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:00:34 2022] GET /compute/v2.1/servers/c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc => generated 1389 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:00:35.839953 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-a233860a-9f31-4908-b735-c17850a23c35 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:00:35.840578 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-a233860a-9f31-4908-b735-c17850a23c35 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:00:35.847875 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a233860a-9f31-4908-b735-c17850a23c35 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:00:35.848372 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a233860a-9f31-4908-b735-c17850a23c35 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:00:35.848823 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a233860a-9f31-4908-b735-c17850a23c35 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:00:35.849557 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a233860a-9f31-4908-b735-c17850a23c35 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:00:35.850077 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a233860a-9f31-4908-b735-c17850a23c35 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:00:35.850516 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a233860a-9f31-4908-b735-c17850a23c35 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:00:35.980254 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-a233860a-9f31-4908-b735-c17850a23c35 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771e9bc89e9d459e9e1714de7c514f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4acd2b59f7943cbb555876b9df70bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:00:35.988257 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-a233860a-9f31-4908-b735-c17850a23c35 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "GET /compute/v2.1/servers/c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc" status: 200 len: 1389 microversion: 2.1 time: 0.152330 Oct 08 22:00:35.988960 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3419/6913] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:00:35 2022] GET /compute/v2.1/servers/c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc => generated 1389 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 22:00:37.011822 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-7d3bfe25-b309-4c0f-b1ae-ab9d9b684399 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:00:37.012494 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-7d3bfe25-b309-4c0f-b1ae-ab9d9b684399 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:00:37.019765 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7d3bfe25-b309-4c0f-b1ae-ab9d9b684399 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:00:37.020290 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7d3bfe25-b309-4c0f-b1ae-ab9d9b684399 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:00:37.020765 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7d3bfe25-b309-4c0f-b1ae-ab9d9b684399 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:00:37.022021 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7d3bfe25-b309-4c0f-b1ae-ab9d9b684399 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:00:37.022568 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7d3bfe25-b309-4c0f-b1ae-ab9d9b684399 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:00:37.023049 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7d3bfe25-b309-4c0f-b1ae-ab9d9b684399 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:00:37.154224 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-7d3bfe25-b309-4c0f-b1ae-ab9d9b684399 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771e9bc89e9d459e9e1714de7c514f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4acd2b59f7943cbb555876b9df70bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:00:37.162394 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-7d3bfe25-b309-4c0f-b1ae-ab9d9b684399 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "GET /compute/v2.1/servers/c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc" status: 200 len: 1389 microversion: 2.1 time: 0.154607 Oct 08 22:00:37.162986 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3495/6914] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:00:37 2022] GET /compute/v2.1/servers/c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc => generated 1389 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:00:38.149312 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-3aed3e63-e1b9-4d05-b765-5c3273dd6395 req-5f5223c6-5c06-44a6-b016-9ed0a50d9284 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc", "name": "network-vif-plugged", "status": "completed", "tag": "a121bcc0-b84b-4f1d-a50a-e3b3f962a8ab"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 22:00:38.162856 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-3aed3e63-e1b9-4d05-b765-5c3273dd6395 req-5f5223c6-5c06-44a6-b016-9ed0a50d9284 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:00:38.163705 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-3aed3e63-e1b9-4d05-b765-5c3273dd6395 req-5f5223c6-5c06-44a6-b016-9ed0a50d9284 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:00:38.164142 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-3aed3e63-e1b9-4d05-b765-5c3273dd6395 req-5f5223c6-5c06-44a6-b016-9ed0a50d9284 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:00:38.175652 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-3aed3e63-e1b9-4d05-b765-5c3273dd6395 req-5f5223c6-5c06-44a6-b016-9ed0a50d9284 service nova] Creating event network-vif-plugged:a121bcc0-b84b-4f1d-a50a-e3b3f962a8ab for instance c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc on nch1-master-1 Oct 08 22:00:38.183169 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-3aed3e63-e1b9-4d05-b765-5c3273dd6395 req-5f5223c6-5c06-44a6-b016-9ed0a50d9284 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037673 Oct 08 22:00:38.183854 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3420/6915] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 22:00:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 22:00:38.185111 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-4349cdce-e4be-48b4-9229-a0679a93b605 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:00:38.185936 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-4349cdce-e4be-48b4-9229-a0679a93b605 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:00:38.192985 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4349cdce-e4be-48b4-9229-a0679a93b605 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:00:38.193594 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4349cdce-e4be-48b4-9229-a0679a93b605 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:00:38.194103 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4349cdce-e4be-48b4-9229-a0679a93b605 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:00:38.194844 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4349cdce-e4be-48b4-9229-a0679a93b605 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:00:38.195335 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4349cdce-e4be-48b4-9229-a0679a93b605 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:00:38.195792 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4349cdce-e4be-48b4-9229-a0679a93b605 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:00:38.404250 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-4349cdce-e4be-48b4-9229-a0679a93b605 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771e9bc89e9d459e9e1714de7c514f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4acd2b59f7943cbb555876b9df70bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:00:38.412132 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-4349cdce-e4be-48b4-9229-a0679a93b605 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "GET /compute/v2.1/servers/c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc" status: 200 len: 1389 microversion: 2.1 time: 0.231378 Oct 08 22:00:38.412733 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3496/6916] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:00:38 2022] GET /compute/v2.1/servers/c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc => generated 1389 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:00:39.435657 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-96219be9-7ebc-4915-8e0e-44d9e8f5146e tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:00:39.436270 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-96219be9-7ebc-4915-8e0e-44d9e8f5146e tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:00:39.438668 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=2 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 22:00:39.439594 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=6 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 22:00:39.446841 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-96219be9-7ebc-4915-8e0e-44d9e8f5146e tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:00:39.447336 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-96219be9-7ebc-4915-8e0e-44d9e8f5146e tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:00:39.447779 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-96219be9-7ebc-4915-8e0e-44d9e8f5146e tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:00:39.448491 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-96219be9-7ebc-4915-8e0e-44d9e8f5146e tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:00:39.448953 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-96219be9-7ebc-4915-8e0e-44d9e8f5146e tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:00:39.449420 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-96219be9-7ebc-4915-8e0e-44d9e8f5146e tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:00:39.588952 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-96219be9-7ebc-4915-8e0e-44d9e8f5146e tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771e9bc89e9d459e9e1714de7c514f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4acd2b59f7943cbb555876b9df70bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:00:39.597145 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-96219be9-7ebc-4915-8e0e-44d9e8f5146e tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "GET /compute/v2.1/servers/c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc" status: 200 len: 1389 microversion: 2.1 time: 0.165826 Oct 08 22:00:39.597764 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3421/6917] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:00:39 2022] GET /compute/v2.1/servers/c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc => generated 1389 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:00:40.621244 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-949eafa6-aa9a-4148-839f-961a0a322284 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:00:40.621796 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-949eafa6-aa9a-4148-839f-961a0a322284 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:00:40.623692 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=6 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 22:00:40.625236 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=1 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 22:00:40.631248 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-949eafa6-aa9a-4148-839f-961a0a322284 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:00:40.631765 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-949eafa6-aa9a-4148-839f-961a0a322284 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:00:40.632233 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-949eafa6-aa9a-4148-839f-961a0a322284 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:00:40.632964 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-949eafa6-aa9a-4148-839f-961a0a322284 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:00:40.634053 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-949eafa6-aa9a-4148-839f-961a0a322284 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:00:40.634511 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-949eafa6-aa9a-4148-839f-961a0a322284 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:00:40.768718 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-949eafa6-aa9a-4148-839f-961a0a322284 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771e9bc89e9d459e9e1714de7c514f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4acd2b59f7943cbb555876b9df70bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:00:40.776780 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-949eafa6-aa9a-4148-839f-961a0a322284 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "GET /compute/v2.1/servers/c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc" status: 200 len: 1561 microversion: 2.1 time: 0.160200 Oct 08 22:00:40.777389 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3497/6918] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:00:40 2022] GET /compute/v2.1/servers/c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc => generated 1561 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:00:40.799343 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-32753672-2df1-4621-88cf-d7a955c344f2 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:00:40.799956 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-32753672-2df1-4621-88cf-d7a955c344f2 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:00:40.807658 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-32753672-2df1-4621-88cf-d7a955c344f2 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:00:40.808159 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-32753672-2df1-4621-88cf-d7a955c344f2 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:00:40.808610 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-32753672-2df1-4621-88cf-d7a955c344f2 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:00:40.809355 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-32753672-2df1-4621-88cf-d7a955c344f2 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:00:40.809822 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-32753672-2df1-4621-88cf-d7a955c344f2 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:00:40.810283 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-32753672-2df1-4621-88cf-d7a955c344f2 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:00:40.944648 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-32753672-2df1-4621-88cf-d7a955c344f2 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771e9bc89e9d459e9e1714de7c514f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4acd2b59f7943cbb555876b9df70bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:00:40.952585 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-32753672-2df1-4621-88cf-d7a955c344f2 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "GET /compute/v2.1/servers/c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc" status: 200 len: 1561 microversion: 2.1 time: 0.157393 Oct 08 22:00:40.953154 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3422/6919] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:00:40 2022] GET /compute/v2.1/servers/c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc => generated 1561 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:00:42.535817 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-b3a4cde7-bc1e-442b-ad40-e8b42ac677b3 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:00:42.536468 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-b3a4cde7-bc1e-442b-ad40-e8b42ac677b3 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:00:42.537489 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-beaa822c-dbe7-4dd5-8cc9-9f340922ae32 req-af2b957e-1101-49f4-8a24-b6677d894e2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc", "tag": "a121bcc0-b84b-4f1d-a50a-e3b3f962a8ab"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 22:00:42.543879 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b3a4cde7-bc1e-442b-ad40-e8b42ac677b3 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:00:42.544545 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b3a4cde7-bc1e-442b-ad40-e8b42ac677b3 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:00:42.545305 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b3a4cde7-bc1e-442b-ad40-e8b42ac677b3 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:00:42.546269 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b3a4cde7-bc1e-442b-ad40-e8b42ac677b3 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:00:42.546823 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b3a4cde7-bc1e-442b-ad40-e8b42ac677b3 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:00:42.547335 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b3a4cde7-bc1e-442b-ad40-e8b42ac677b3 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:00:42.548874 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-beaa822c-dbe7-4dd5-8cc9-9f340922ae32 req-af2b957e-1101-49f4-8a24-b6677d894e2d service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:00:42.549393 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-beaa822c-dbe7-4dd5-8cc9-9f340922ae32 req-af2b957e-1101-49f4-8a24-b6677d894e2d service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:00:42.549833 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-beaa822c-dbe7-4dd5-8cc9-9f340922ae32 req-af2b957e-1101-49f4-8a24-b6677d894e2d service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:00:42.563732 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-beaa822c-dbe7-4dd5-8cc9-9f340922ae32 req-af2b957e-1101-49f4-8a24-b6677d894e2d service nova] Creating event network-changed:a121bcc0-b84b-4f1d-a50a-e3b3f962a8ab for instance c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc on nch1-master-1 Oct 08 22:00:42.569500 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-beaa822c-dbe7-4dd5-8cc9-9f340922ae32 req-af2b957e-1101-49f4-8a24-b6677d894e2d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035817 Oct 08 22:00:42.570495 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3423/6920] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 22:00:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 22:00:42.783029 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-b3a4cde7-bc1e-442b-ad40-e8b42ac677b3 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771e9bc89e9d459e9e1714de7c514f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4acd2b59f7943cbb555876b9df70bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:00:42.796575 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-b3a4cde7-bc1e-442b-ad40-e8b42ac677b3 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "GET /compute/v2.1/servers/c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc" status: 200 len: 1561 microversion: 2.1 time: 0.265115 Oct 08 22:00:42.808499 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3498/6921] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:00:42 2022] GET /compute/v2.1/servers/c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc => generated 1561 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:01:06.325096 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-306d6aba-8aef-4660-a975-33c6f5f7755f tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 22:01:06.327386 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-306d6aba-8aef-4660-a975-33c6f5f7755f tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:01:06.329586 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 22:01:06.330245 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=38 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 22:01:06.338220 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-306d6aba-8aef-4660-a975-33c6f5f7755f tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:01:06.338714 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-306d6aba-8aef-4660-a975-33c6f5f7755f tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:01:06.339165 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-306d6aba-8aef-4660-a975-33c6f5f7755f tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:01:06.339872 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-306d6aba-8aef-4660-a975-33c6f5f7755f tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:01:06.340385 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-306d6aba-8aef-4660-a975-33c6f5f7755f tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:01:06.340773 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-306d6aba-8aef-4660-a975-33c6f5f7755f tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:01:06.399232 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-306d6aba-8aef-4660-a975-33c6f5f7755f tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "POST /compute/v2.1/servers/c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc/action" status: 200 len: 24567 microversion: 2.1 time: 0.078575 Oct 08 22:01:06.400009 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3424/6922] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 22:01:06 2022] POST /compute/v2.1/servers/c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc/action => generated 24567 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 08 22:01:17.504393 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-61fafb2d-da65-4651-beba-c71381491f5f tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 22:01:17.506687 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-61fafb2d-da65-4651-beba-c71381491f5f tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:01:17.508904 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=3 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 22:01:17.510062 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=42 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 22:01:17.511537 ncdv-master-1 devstack@n-api.service[140492]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 08 22:01:17.511802 ncdv-master-1 devstack@n-api.service[140492]: Sat Oct 8 22:01:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc/action (ip 10.222.0.26) !!! Oct 08 22:01:17.519165 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-61fafb2d-da65-4651-beba-c71381491f5f tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:01:17.519658 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-61fafb2d-da65-4651-beba-c71381491f5f tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:01:17.520119 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-61fafb2d-da65-4651-beba-c71381491f5f tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:01:17.520836 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-61fafb2d-da65-4651-beba-c71381491f5f tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:01:17.521380 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-61fafb2d-da65-4651-beba-c71381491f5f tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:01:17.521827 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-61fafb2d-da65-4651-beba-c71381491f5f tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:01:17.610632 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-61fafb2d-da65-4651-beba-c71381491f5f tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '771e9bc89e9d459e9e1714de7c514f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4acd2b59f7943cbb555876b9df70bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:01:17.616924 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-61fafb2d-da65-4651-beba-c71381491f5f tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc] Old instance type m1.heat2, new instance type m1.heat {{(pid=140492) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 08 22:01:17.623583 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-61fafb2d-da65-4651-beba-c71381491f5f tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Flavor limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 22:01:17.624022 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-61fafb2d-da65-4651-beba-c71381491f5f tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Image limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 22:01:17.624517 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-61fafb2d-da65-4651-beba-c71381491f5f tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Flavor pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 22:01:17.624946 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-61fafb2d-da65-4651-beba-c71381491f5f tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Image pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 22:01:17.625421 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-61fafb2d-da65-4651-beba-c71381491f5f tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 22:01:17.690283 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-61fafb2d-da65-4651-beba-c71381491f5f tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "POST /compute/v2.1/servers/c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc/action" status: 202 len: 0 microversion: 2.1 time: 0.190024 Oct 08 22:01:17.693260 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3499/6923] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 22:01:17 2022] POST /compute/v2.1/servers/c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc/action => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 22:01:17.699606 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-ffce12af-03f1-409a-a497-82a9a347ad9f tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:01:17.700314 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-ffce12af-03f1-409a-a497-82a9a347ad9f tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:01:17.703255 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=4 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 22:01:17.703895 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:SELECT=2 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 22:01:17.710722 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ffce12af-03f1-409a-a497-82a9a347ad9f tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:01:17.711218 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ffce12af-03f1-409a-a497-82a9a347ad9f tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:01:17.711951 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ffce12af-03f1-409a-a497-82a9a347ad9f tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:01:17.713249 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ffce12af-03f1-409a-a497-82a9a347ad9f tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:01:17.713874 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ffce12af-03f1-409a-a497-82a9a347ad9f tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:01:17.714519 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ffce12af-03f1-409a-a497-82a9a347ad9f tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:01:18.114388 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-ffce12af-03f1-409a-a497-82a9a347ad9f tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771e9bc89e9d459e9e1714de7c514f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4acd2b59f7943cbb555876b9df70bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:01:18.122535 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-ffce12af-03f1-409a-a497-82a9a347ad9f tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "GET /compute/v2.1/servers/c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc" status: 200 len: 1688 microversion: 2.1 time: 0.427209 Oct 08 22:01:18.123310 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3425/6924] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:01:17 2022] GET /compute/v2.1/servers/c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc => generated 1688 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 22:01:19.147949 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-7c08e8e0-6a8f-4de4-a19a-5a54271fc53c tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:01:19.148517 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-7c08e8e0-6a8f-4de4-a19a-5a54271fc53c tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:01:19.156319 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7c08e8e0-6a8f-4de4-a19a-5a54271fc53c tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:01:19.156826 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7c08e8e0-6a8f-4de4-a19a-5a54271fc53c tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:01:19.157311 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7c08e8e0-6a8f-4de4-a19a-5a54271fc53c tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:01:19.158039 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7c08e8e0-6a8f-4de4-a19a-5a54271fc53c tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:01:19.158515 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7c08e8e0-6a8f-4de4-a19a-5a54271fc53c tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:01:19.158961 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7c08e8e0-6a8f-4de4-a19a-5a54271fc53c tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:01:19.383028 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-7c08e8e0-6a8f-4de4-a19a-5a54271fc53c tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771e9bc89e9d459e9e1714de7c514f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4acd2b59f7943cbb555876b9df70bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:01:19.391433 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-7c08e8e0-6a8f-4de4-a19a-5a54271fc53c tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "GET /compute/v2.1/servers/c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc" status: 200 len: 1688 microversion: 2.1 time: 0.248539 Oct 08 22:01:19.392009 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3500/6925] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:01:19 2022] GET /compute/v2.1/servers/c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc => generated 1688 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:01:20.416793 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-041b9802-f04e-450e-918a-ee12037834dd tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:01:20.417440 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-041b9802-f04e-450e-918a-ee12037834dd tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:01:20.424349 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-041b9802-f04e-450e-918a-ee12037834dd tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:01:20.424839 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-041b9802-f04e-450e-918a-ee12037834dd tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:01:20.425312 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-041b9802-f04e-450e-918a-ee12037834dd tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:01:20.426010 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-041b9802-f04e-450e-918a-ee12037834dd tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:01:20.426466 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-041b9802-f04e-450e-918a-ee12037834dd tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:01:20.426894 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-041b9802-f04e-450e-918a-ee12037834dd tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:01:20.561132 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-041b9802-f04e-450e-918a-ee12037834dd tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771e9bc89e9d459e9e1714de7c514f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4acd2b59f7943cbb555876b9df70bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:01:20.569385 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-041b9802-f04e-450e-918a-ee12037834dd tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "GET /compute/v2.1/servers/c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc" status: 200 len: 1693 microversion: 2.1 time: 0.157074 Oct 08 22:01:20.569950 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3426/6926] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:01:20 2022] GET /compute/v2.1/servers/c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc => generated 1693 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:01:21.593635 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-f6edb8d1-a314-47c9-a298-f7476bef9b15 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:01:21.594284 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-f6edb8d1-a314-47c9-a298-f7476bef9b15 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:01:21.601307 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f6edb8d1-a314-47c9-a298-f7476bef9b15 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:01:21.601925 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f6edb8d1-a314-47c9-a298-f7476bef9b15 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:01:21.602425 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f6edb8d1-a314-47c9-a298-f7476bef9b15 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:01:21.603739 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f6edb8d1-a314-47c9-a298-f7476bef9b15 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:01:21.604228 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f6edb8d1-a314-47c9-a298-f7476bef9b15 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:01:21.604686 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f6edb8d1-a314-47c9-a298-f7476bef9b15 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:01:21.737910 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-f6edb8d1-a314-47c9-a298-f7476bef9b15 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771e9bc89e9d459e9e1714de7c514f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4acd2b59f7943cbb555876b9df70bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:01:21.745978 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-f6edb8d1-a314-47c9-a298-f7476bef9b15 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "GET /compute/v2.1/servers/c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc" status: 200 len: 1693 microversion: 2.1 time: 0.156397 Oct 08 22:01:21.746551 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3501/6927] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:01:21 2022] GET /compute/v2.1/servers/c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc => generated 1693 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:01:22.769812 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-d9a60f5c-5652-4b2a-bb04-466071b4e5fe tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:01:22.770354 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-d9a60f5c-5652-4b2a-bb04-466071b4e5fe tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:01:22.777708 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d9a60f5c-5652-4b2a-bb04-466071b4e5fe tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:01:22.778198 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d9a60f5c-5652-4b2a-bb04-466071b4e5fe tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:01:22.778642 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d9a60f5c-5652-4b2a-bb04-466071b4e5fe tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:01:22.779345 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d9a60f5c-5652-4b2a-bb04-466071b4e5fe tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:01:22.779810 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d9a60f5c-5652-4b2a-bb04-466071b4e5fe tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:01:22.780243 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d9a60f5c-5652-4b2a-bb04-466071b4e5fe tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:01:22.911744 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-d9a60f5c-5652-4b2a-bb04-466071b4e5fe tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771e9bc89e9d459e9e1714de7c514f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4acd2b59f7943cbb555876b9df70bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:01:22.920139 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-d9a60f5c-5652-4b2a-bb04-466071b4e5fe tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "GET /compute/v2.1/servers/c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc" status: 200 len: 1693 microversion: 2.1 time: 0.154361 Oct 08 22:01:22.920714 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3427/6928] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:01:22 2022] GET /compute/v2.1/servers/c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc => generated 1693 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:01:23.943504 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-6a1824a4-cfbf-4382-a8d0-545b21ad5a11 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:01:23.944060 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-6a1824a4-cfbf-4382-a8d0-545b21ad5a11 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:01:23.951292 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6a1824a4-cfbf-4382-a8d0-545b21ad5a11 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:01:23.951855 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6a1824a4-cfbf-4382-a8d0-545b21ad5a11 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:01:23.952436 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6a1824a4-cfbf-4382-a8d0-545b21ad5a11 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:01:23.953241 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6a1824a4-cfbf-4382-a8d0-545b21ad5a11 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:01:23.953722 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6a1824a4-cfbf-4382-a8d0-545b21ad5a11 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:01:23.954176 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6a1824a4-cfbf-4382-a8d0-545b21ad5a11 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:01:24.085555 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-6a1824a4-cfbf-4382-a8d0-545b21ad5a11 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771e9bc89e9d459e9e1714de7c514f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4acd2b59f7943cbb555876b9df70bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:01:24.093503 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-6a1824a4-cfbf-4382-a8d0-545b21ad5a11 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "GET /compute/v2.1/servers/c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc" status: 200 len: 1693 microversion: 2.1 time: 0.153966 Oct 08 22:01:24.094080 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3502/6929] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:01:23 2022] GET /compute/v2.1/servers/c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc => generated 1693 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:01:25.116968 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-b6ba55c9-fbcc-45a5-a72f-3676f8f3fb7b tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:01:25.117581 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-b6ba55c9-fbcc-45a5-a72f-3676f8f3fb7b tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:01:25.127216 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b6ba55c9-fbcc-45a5-a72f-3676f8f3fb7b tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:01:25.127718 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b6ba55c9-fbcc-45a5-a72f-3676f8f3fb7b tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:01:25.128168 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b6ba55c9-fbcc-45a5-a72f-3676f8f3fb7b tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:01:25.128871 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b6ba55c9-fbcc-45a5-a72f-3676f8f3fb7b tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:01:25.129391 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b6ba55c9-fbcc-45a5-a72f-3676f8f3fb7b tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:01:25.129811 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b6ba55c9-fbcc-45a5-a72f-3676f8f3fb7b tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:01:25.264863 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-b6ba55c9-fbcc-45a5-a72f-3676f8f3fb7b tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771e9bc89e9d459e9e1714de7c514f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4acd2b59f7943cbb555876b9df70bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:01:25.272626 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-b6ba55c9-fbcc-45a5-a72f-3676f8f3fb7b tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "GET /compute/v2.1/servers/c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc" status: 200 len: 1693 microversion: 2.1 time: 0.159688 Oct 08 22:01:25.273299 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3428/6930] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:01:25 2022] GET /compute/v2.1/servers/c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc => generated 1693 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:01:26.295960 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-7d6bbdf5-6bb1-4c92-b7ae-b863316c2c78 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:01:26.296614 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-7d6bbdf5-6bb1-4c92-b7ae-b863316c2c78 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:01:26.303683 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7d6bbdf5-6bb1-4c92-b7ae-b863316c2c78 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:01:26.304195 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7d6bbdf5-6bb1-4c92-b7ae-b863316c2c78 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:01:26.304657 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7d6bbdf5-6bb1-4c92-b7ae-b863316c2c78 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:01:26.305410 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7d6bbdf5-6bb1-4c92-b7ae-b863316c2c78 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:01:26.305970 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7d6bbdf5-6bb1-4c92-b7ae-b863316c2c78 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:01:26.306423 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7d6bbdf5-6bb1-4c92-b7ae-b863316c2c78 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:01:26.440212 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-7d6bbdf5-6bb1-4c92-b7ae-b863316c2c78 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771e9bc89e9d459e9e1714de7c514f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4acd2b59f7943cbb555876b9df70bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:01:26.448641 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-7d6bbdf5-6bb1-4c92-b7ae-b863316c2c78 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "GET /compute/v2.1/servers/c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc" status: 200 len: 1693 microversion: 2.1 time: 0.156628 Oct 08 22:01:26.449242 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3503/6931] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:01:26 2022] GET /compute/v2.1/servers/c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc => generated 1693 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:01:27.473603 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-55682c6a-e556-4a7f-aae0-f8e2ab264b11 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:01:27.474207 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-55682c6a-e556-4a7f-aae0-f8e2ab264b11 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:01:27.482186 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-55682c6a-e556-4a7f-aae0-f8e2ab264b11 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:01:27.482646 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-55682c6a-e556-4a7f-aae0-f8e2ab264b11 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:01:27.483124 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-55682c6a-e556-4a7f-aae0-f8e2ab264b11 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:01:27.483940 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-55682c6a-e556-4a7f-aae0-f8e2ab264b11 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:01:27.484408 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-55682c6a-e556-4a7f-aae0-f8e2ab264b11 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:01:27.484848 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-55682c6a-e556-4a7f-aae0-f8e2ab264b11 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:01:27.620096 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-55682c6a-e556-4a7f-aae0-f8e2ab264b11 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771e9bc89e9d459e9e1714de7c514f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4acd2b59f7943cbb555876b9df70bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:01:27.628075 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-55682c6a-e556-4a7f-aae0-f8e2ab264b11 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "GET /compute/v2.1/servers/c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc" status: 200 len: 1693 microversion: 2.1 time: 0.158716 Oct 08 22:01:27.628658 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3429/6932] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:01:27 2022] GET /compute/v2.1/servers/c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc => generated 1693 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:01:28.652448 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-f4dc9dc2-4c1a-4774-9292-541f45fee5d2 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:01:28.653079 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-f4dc9dc2-4c1a-4774-9292-541f45fee5d2 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:01:28.660245 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f4dc9dc2-4c1a-4774-9292-541f45fee5d2 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:01:28.660749 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f4dc9dc2-4c1a-4774-9292-541f45fee5d2 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:01:28.661229 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f4dc9dc2-4c1a-4774-9292-541f45fee5d2 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:01:28.661949 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f4dc9dc2-4c1a-4774-9292-541f45fee5d2 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:01:28.662427 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f4dc9dc2-4c1a-4774-9292-541f45fee5d2 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:01:28.662872 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f4dc9dc2-4c1a-4774-9292-541f45fee5d2 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:01:28.796094 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-f4dc9dc2-4c1a-4774-9292-541f45fee5d2 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771e9bc89e9d459e9e1714de7c514f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4acd2b59f7943cbb555876b9df70bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:01:28.803905 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-f4dc9dc2-4c1a-4774-9292-541f45fee5d2 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "GET /compute/v2.1/servers/c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc" status: 200 len: 1693 microversion: 2.1 time: 0.155770 Oct 08 22:01:28.804482 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3504/6933] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:01:28 2022] GET /compute/v2.1/servers/c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc => generated 1693 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:01:29.827380 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-4e5e0df8-b414-49e8-b2d6-8bc100f9b4d8 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:01:29.827930 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-4e5e0df8-b414-49e8-b2d6-8bc100f9b4d8 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:01:29.835203 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4e5e0df8-b414-49e8-b2d6-8bc100f9b4d8 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:01:29.835705 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4e5e0df8-b414-49e8-b2d6-8bc100f9b4d8 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:01:29.836157 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4e5e0df8-b414-49e8-b2d6-8bc100f9b4d8 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:01:29.836877 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4e5e0df8-b414-49e8-b2d6-8bc100f9b4d8 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:01:29.837389 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4e5e0df8-b414-49e8-b2d6-8bc100f9b4d8 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:01:29.837842 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4e5e0df8-b414-49e8-b2d6-8bc100f9b4d8 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:01:29.969735 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-4e5e0df8-b414-49e8-b2d6-8bc100f9b4d8 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771e9bc89e9d459e9e1714de7c514f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4acd2b59f7943cbb555876b9df70bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:01:29.977572 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-4e5e0df8-b414-49e8-b2d6-8bc100f9b4d8 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "GET /compute/v2.1/servers/c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc" status: 200 len: 1693 microversion: 2.1 time: 0.154226 Oct 08 22:01:29.978139 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3430/6934] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:01:29 2022] GET /compute/v2.1/servers/c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc => generated 1693 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:01:31.001790 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-d886e438-c946-4726-bfe0-c6b12a9a758b tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:01:31.002453 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-d886e438-c946-4726-bfe0-c6b12a9a758b tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:01:31.009383 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d886e438-c946-4726-bfe0-c6b12a9a758b tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:01:31.009891 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d886e438-c946-4726-bfe0-c6b12a9a758b tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:01:31.010352 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d886e438-c946-4726-bfe0-c6b12a9a758b tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:01:31.011781 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d886e438-c946-4726-bfe0-c6b12a9a758b tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:01:31.012264 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d886e438-c946-4726-bfe0-c6b12a9a758b tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:01:31.012713 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d886e438-c946-4726-bfe0-c6b12a9a758b tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:01:31.149084 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-d886e438-c946-4726-bfe0-c6b12a9a758b tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771e9bc89e9d459e9e1714de7c514f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4acd2b59f7943cbb555876b9df70bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:01:31.157403 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-d886e438-c946-4726-bfe0-c6b12a9a758b tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "GET /compute/v2.1/servers/c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc" status: 200 len: 1693 microversion: 2.1 time: 0.159493 Oct 08 22:01:31.157994 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3505/6935] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:01:30 2022] GET /compute/v2.1/servers/c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc => generated 1693 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:01:32.180703 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-cd724865-d002-4502-930f-6ee761cedeb1 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:01:32.181357 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-cd724865-d002-4502-930f-6ee761cedeb1 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:01:32.188440 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cd724865-d002-4502-930f-6ee761cedeb1 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:01:32.188932 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cd724865-d002-4502-930f-6ee761cedeb1 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:01:32.189486 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cd724865-d002-4502-930f-6ee761cedeb1 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:01:32.190190 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cd724865-d002-4502-930f-6ee761cedeb1 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:01:32.190655 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cd724865-d002-4502-930f-6ee761cedeb1 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:01:32.191091 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cd724865-d002-4502-930f-6ee761cedeb1 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:01:32.324368 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-cd724865-d002-4502-930f-6ee761cedeb1 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771e9bc89e9d459e9e1714de7c514f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4acd2b59f7943cbb555876b9df70bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:01:32.332284 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-cd724865-d002-4502-930f-6ee761cedeb1 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "GET /compute/v2.1/servers/c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc" status: 200 len: 1693 microversion: 2.1 time: 0.155575 Oct 08 22:01:32.332863 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3431/6936] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:01:32 2022] GET /compute/v2.1/servers/c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc => generated 1693 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:01:33.356672 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-5accc969-182f-4b23-9dad-1ff05892230e tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:01:33.357328 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-5accc969-182f-4b23-9dad-1ff05892230e tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:01:33.364193 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5accc969-182f-4b23-9dad-1ff05892230e tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:01:33.364704 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5accc969-182f-4b23-9dad-1ff05892230e tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:01:33.365164 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5accc969-182f-4b23-9dad-1ff05892230e tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:01:33.365900 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5accc969-182f-4b23-9dad-1ff05892230e tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:01:33.366378 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5accc969-182f-4b23-9dad-1ff05892230e tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:01:33.366820 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5accc969-182f-4b23-9dad-1ff05892230e tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:01:33.807795 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-5accc969-182f-4b23-9dad-1ff05892230e tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771e9bc89e9d459e9e1714de7c514f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4acd2b59f7943cbb555876b9df70bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:01:33.816059 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-5accc969-182f-4b23-9dad-1ff05892230e tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "GET /compute/v2.1/servers/c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc" status: 200 len: 1693 microversion: 2.1 time: 0.464023 Oct 08 22:01:33.816659 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3506/6937] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:01:33 2022] GET /compute/v2.1/servers/c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc => generated 1693 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:01:34.841334 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-1b2a665f-6bf2-47e2-b8d3-c1aa50215e64 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:01:34.841947 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-1b2a665f-6bf2-47e2-b8d3-c1aa50215e64 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:01:34.848841 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1b2a665f-6bf2-47e2-b8d3-c1aa50215e64 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:01:34.849374 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1b2a665f-6bf2-47e2-b8d3-c1aa50215e64 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:01:34.849823 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1b2a665f-6bf2-47e2-b8d3-c1aa50215e64 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:01:34.850531 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1b2a665f-6bf2-47e2-b8d3-c1aa50215e64 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:01:34.850999 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1b2a665f-6bf2-47e2-b8d3-c1aa50215e64 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:01:34.851431 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1b2a665f-6bf2-47e2-b8d3-c1aa50215e64 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:01:34.983853 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-1b2a665f-6bf2-47e2-b8d3-c1aa50215e64 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771e9bc89e9d459e9e1714de7c514f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4acd2b59f7943cbb555876b9df70bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:01:34.991771 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-1b2a665f-6bf2-47e2-b8d3-c1aa50215e64 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "GET /compute/v2.1/servers/c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc" status: 200 len: 1693 microversion: 2.1 time: 0.155517 Oct 08 22:01:34.992353 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3432/6938] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:01:34 2022] GET /compute/v2.1/servers/c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc => generated 1693 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:01:36.014928 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-776d91c7-798f-4544-8bba-c2a2ede976c6 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:01:36.015483 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-776d91c7-798f-4544-8bba-c2a2ede976c6 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:01:36.022615 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-776d91c7-798f-4544-8bba-c2a2ede976c6 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:01:36.023133 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-776d91c7-798f-4544-8bba-c2a2ede976c6 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:01:36.023602 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-776d91c7-798f-4544-8bba-c2a2ede976c6 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:01:36.024333 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-776d91c7-798f-4544-8bba-c2a2ede976c6 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:01:36.024819 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-776d91c7-798f-4544-8bba-c2a2ede976c6 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:01:36.025298 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-776d91c7-798f-4544-8bba-c2a2ede976c6 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:01:36.155625 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-776d91c7-798f-4544-8bba-c2a2ede976c6 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771e9bc89e9d459e9e1714de7c514f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4acd2b59f7943cbb555876b9df70bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:01:36.163631 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-776d91c7-798f-4544-8bba-c2a2ede976c6 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "GET /compute/v2.1/servers/c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc" status: 200 len: 1693 microversion: 2.1 time: 0.152757 Oct 08 22:01:36.164218 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3507/6939] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:01:36 2022] GET /compute/v2.1/servers/c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc => generated 1693 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:01:37.188283 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-a9a378b5-afdb-4487-9741-6acde7dad6c2 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:01:37.188899 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-a9a378b5-afdb-4487-9741-6acde7dad6c2 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:01:37.195776 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a9a378b5-afdb-4487-9741-6acde7dad6c2 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:01:37.196265 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a9a378b5-afdb-4487-9741-6acde7dad6c2 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:01:37.196710 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a9a378b5-afdb-4487-9741-6acde7dad6c2 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:01:37.197444 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a9a378b5-afdb-4487-9741-6acde7dad6c2 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:01:37.197976 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a9a378b5-afdb-4487-9741-6acde7dad6c2 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:01:37.198445 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a9a378b5-afdb-4487-9741-6acde7dad6c2 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:01:37.336137 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-a9a378b5-afdb-4487-9741-6acde7dad6c2 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771e9bc89e9d459e9e1714de7c514f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4acd2b59f7943cbb555876b9df70bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:01:37.344124 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-a9a378b5-afdb-4487-9741-6acde7dad6c2 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "GET /compute/v2.1/servers/c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc" status: 200 len: 1692 microversion: 2.1 time: 0.159940 Oct 08 22:01:37.344747 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3433/6940] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:01:37 2022] GET /compute/v2.1/servers/c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc => generated 1692 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:01:37.434536 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-7b11835a-d4f2-427d-80b6-0d2f950bc013 req-2240fa3f-76f8-4c54-9eae-7ef132b32857 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc", "name": "network-vif-unplugged", "status": "completed", "tag": "a121bcc0-b84b-4f1d-a50a-e3b3f962a8ab"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 22:01:37.445417 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-7b11835a-d4f2-427d-80b6-0d2f950bc013 req-2240fa3f-76f8-4c54-9eae-7ef132b32857 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:01:37.445959 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-7b11835a-d4f2-427d-80b6-0d2f950bc013 req-2240fa3f-76f8-4c54-9eae-7ef132b32857 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:01:37.446470 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-7b11835a-d4f2-427d-80b6-0d2f950bc013 req-2240fa3f-76f8-4c54-9eae-7ef132b32857 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:01:37.459481 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-7b11835a-d4f2-427d-80b6-0d2f950bc013 req-2240fa3f-76f8-4c54-9eae-7ef132b32857 service nova] Creating event network-vif-unplugged:a121bcc0-b84b-4f1d-a50a-e3b3f962a8ab for instance c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc on nch2-master-1 Oct 08 22:01:37.465074 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [req-7b11835a-d4f2-427d-80b6-0d2f950bc013 req-2240fa3f-76f8-4c54-9eae-7ef132b32857 service nova] Instance c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140492) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 08 22:01:37.481569 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-7b11835a-d4f2-427d-80b6-0d2f950bc013 req-2240fa3f-76f8-4c54-9eae-7ef132b32857 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051131 Oct 08 22:01:37.482127 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3508/6941] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 22:01:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 08 22:01:38.367893 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-f232f2c3-9cda-46a4-a753-5511c06fdada tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:01:38.368510 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-f232f2c3-9cda-46a4-a753-5511c06fdada tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:01:38.375552 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f232f2c3-9cda-46a4-a753-5511c06fdada tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:01:38.376283 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f232f2c3-9cda-46a4-a753-5511c06fdada tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:01:38.376738 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f232f2c3-9cda-46a4-a753-5511c06fdada tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:01:38.377485 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f232f2c3-9cda-46a4-a753-5511c06fdada tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:01:38.377951 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f232f2c3-9cda-46a4-a753-5511c06fdada tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:01:38.378398 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f232f2c3-9cda-46a4-a753-5511c06fdada tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:01:38.520289 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-f232f2c3-9cda-46a4-a753-5511c06fdada tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771e9bc89e9d459e9e1714de7c514f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4acd2b59f7943cbb555876b9df70bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:01:38.528576 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-f232f2c3-9cda-46a4-a753-5511c06fdada tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "GET /compute/v2.1/servers/c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc" status: 200 len: 1692 microversion: 2.1 time: 0.164595 Oct 08 22:01:38.529178 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3434/6942] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:01:38 2022] GET /compute/v2.1/servers/c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc => generated 1692 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:01:39.521604 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-1ca2053d-6dec-403e-b18d-b134e032ada6 req-d493ad42-30d1-4777-b197-7408c913d207 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc", "tag": "a121bcc0-b84b-4f1d-a50a-e3b3f962a8ab"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 22:01:39.531773 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-1ca2053d-6dec-403e-b18d-b134e032ada6 req-d493ad42-30d1-4777-b197-7408c913d207 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:01:39.532268 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-1ca2053d-6dec-403e-b18d-b134e032ada6 req-d493ad42-30d1-4777-b197-7408c913d207 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:01:39.532718 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-1ca2053d-6dec-403e-b18d-b134e032ada6 req-d493ad42-30d1-4777-b197-7408c913d207 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:01:39.545146 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-1ca2053d-6dec-403e-b18d-b134e032ada6 req-d493ad42-30d1-4777-b197-7408c913d207 service nova] Creating event network-changed:a121bcc0-b84b-4f1d-a50a-e3b3f962a8ab for instance c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc on nch2-master-1 Oct 08 22:01:39.550601 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [req-1ca2053d-6dec-403e-b18d-b134e032ada6 req-d493ad42-30d1-4777-b197-7408c913d207 service nova] Instance c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140492) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 08 22:01:39.551921 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-39f4e23d-646f-4584-91eb-a4f15a38c035 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:01:39.552538 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-39f4e23d-646f-4584-91eb-a4f15a38c035 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:01:39.559577 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-39f4e23d-646f-4584-91eb-a4f15a38c035 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:01:39.560071 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-39f4e23d-646f-4584-91eb-a4f15a38c035 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:01:39.560527 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-39f4e23d-646f-4584-91eb-a4f15a38c035 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:01:39.561291 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-39f4e23d-646f-4584-91eb-a4f15a38c035 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:01:39.561736 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-1ca2053d-6dec-403e-b18d-b134e032ada6 req-d493ad42-30d1-4777-b197-7408c913d207 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044933 Oct 08 22:01:39.562044 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-39f4e23d-646f-4584-91eb-a4f15a38c035 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:01:39.562329 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3509/6943] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 22:01:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 22:01:39.562536 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-39f4e23d-646f-4584-91eb-a4f15a38c035 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:01:39.705152 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-39f4e23d-646f-4584-91eb-a4f15a38c035 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771e9bc89e9d459e9e1714de7c514f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4acd2b59f7943cbb555876b9df70bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:01:39.713320 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-39f4e23d-646f-4584-91eb-a4f15a38c035 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "GET /compute/v2.1/servers/c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc" status: 200 len: 1690 microversion: 2.1 time: 0.165221 Oct 08 22:01:39.713918 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3435/6944] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:01:39 2022] GET /compute/v2.1/servers/c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc => generated 1690 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 22:01:40.738977 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-ee761696-ee36-481b-adac-6479c1752264 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:01:40.739715 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-ee761696-ee36-481b-adac-6479c1752264 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:01:40.746040 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ee761696-ee36-481b-adac-6479c1752264 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:01:40.746588 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ee761696-ee36-481b-adac-6479c1752264 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:01:40.747068 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ee761696-ee36-481b-adac-6479c1752264 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:01:40.747798 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ee761696-ee36-481b-adac-6479c1752264 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:01:40.748285 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ee761696-ee36-481b-adac-6479c1752264 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:01:40.748743 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ee761696-ee36-481b-adac-6479c1752264 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:01:40.886992 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-ee761696-ee36-481b-adac-6479c1752264 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771e9bc89e9d459e9e1714de7c514f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4acd2b59f7943cbb555876b9df70bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:01:40.895971 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-ee761696-ee36-481b-adac-6479c1752264 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "GET /compute/v2.1/servers/c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc" status: 200 len: 1687 microversion: 2.1 time: 0.162157 Oct 08 22:01:40.896789 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3510/6945] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:01:40 2022] GET /compute/v2.1/servers/c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc => generated 1687 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:01:40.920078 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-2de06663-bbc2-4dde-89f8-14697891e40a tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 22:01:40.920628 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-2de06663-bbc2-4dde-89f8-14697891e40a tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:01:40.927775 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2de06663-bbc2-4dde-89f8-14697891e40a tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:01:40.928280 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2de06663-bbc2-4dde-89f8-14697891e40a tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:01:40.928733 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2de06663-bbc2-4dde-89f8-14697891e40a tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:01:40.929475 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2de06663-bbc2-4dde-89f8-14697891e40a tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:01:40.929944 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2de06663-bbc2-4dde-89f8-14697891e40a tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:01:40.930380 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2de06663-bbc2-4dde-89f8-14697891e40a tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:01:40.998963 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-2de06663-bbc2-4dde-89f8-14697891e40a tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "POST /compute/v2.1/servers/c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc/action" status: 204 len: 0 microversion: 2.1 time: 0.083284 Oct 08 22:01:40.999556 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3436/6946] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 22:01:40 2022] POST /compute/v2.1/servers/c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc/action => generated 0 bytes in 85 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 22:01:41.007678 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-f285908d-c036-404e-87f8-f59c5e212062 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:01:41.008364 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-f285908d-c036-404e-87f8-f59c5e212062 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:01:41.014991 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f285908d-c036-404e-87f8-f59c5e212062 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:01:41.015530 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f285908d-c036-404e-87f8-f59c5e212062 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:01:41.015989 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f285908d-c036-404e-87f8-f59c5e212062 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:01:41.016716 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f285908d-c036-404e-87f8-f59c5e212062 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:01:41.017218 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f285908d-c036-404e-87f8-f59c5e212062 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:01:41.017659 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f285908d-c036-404e-87f8-f59c5e212062 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:01:41.235476 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-f285908d-c036-404e-87f8-f59c5e212062 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771e9bc89e9d459e9e1714de7c514f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4acd2b59f7943cbb555876b9df70bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:01:41.243606 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-f285908d-c036-404e-87f8-f59c5e212062 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "GET /compute/v2.1/servers/c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc" status: 200 len: 1687 microversion: 2.1 time: 0.239703 Oct 08 22:01:41.244201 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3511/6947] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:01:41 2022] GET /compute/v2.1/servers/c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc => generated 1687 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:01:41.267709 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-f73299b9-507f-47ed-a41a-11a1f7b79318 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:01:41.268603 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-f73299b9-507f-47ed-a41a-11a1f7b79318 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:01:41.275319 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f73299b9-507f-47ed-a41a-11a1f7b79318 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:01:41.275883 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f73299b9-507f-47ed-a41a-11a1f7b79318 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:01:41.276326 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f73299b9-507f-47ed-a41a-11a1f7b79318 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:01:41.277044 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f73299b9-507f-47ed-a41a-11a1f7b79318 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:01:41.277604 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f73299b9-507f-47ed-a41a-11a1f7b79318 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:01:41.278688 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f73299b9-507f-47ed-a41a-11a1f7b79318 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:01:41.423239 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-f73299b9-507f-47ed-a41a-11a1f7b79318 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771e9bc89e9d459e9e1714de7c514f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4acd2b59f7943cbb555876b9df70bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:01:41.431120 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-f73299b9-507f-47ed-a41a-11a1f7b79318 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "GET /compute/v2.1/servers/c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc" status: 200 len: 1687 microversion: 2.1 time: 0.168951 Oct 08 22:01:41.431932 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3437/6948] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:01:41 2022] GET /compute/v2.1/servers/c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc => generated 1687 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 22:01:42.455169 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-3fd3f87a-2609-479f-95a5-25aa57c18329 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:01:42.455895 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-3fd3f87a-2609-479f-95a5-25aa57c18329 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:01:42.462701 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3fd3f87a-2609-479f-95a5-25aa57c18329 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:01:42.463351 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3fd3f87a-2609-479f-95a5-25aa57c18329 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:01:42.463827 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3fd3f87a-2609-479f-95a5-25aa57c18329 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:01:42.464551 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3fd3f87a-2609-479f-95a5-25aa57c18329 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:01:42.465036 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3fd3f87a-2609-479f-95a5-25aa57c18329 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:01:42.466030 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3fd3f87a-2609-479f-95a5-25aa57c18329 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:01:42.611751 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-3fd3f87a-2609-479f-95a5-25aa57c18329 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771e9bc89e9d459e9e1714de7c514f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4acd2b59f7943cbb555876b9df70bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:01:42.619694 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-3fd3f87a-2609-479f-95a5-25aa57c18329 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "GET /compute/v2.1/servers/c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc" status: 200 len: 1679 microversion: 2.1 time: 0.168531 Oct 08 22:01:42.620276 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3512/6949] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:01:42 2022] GET /compute/v2.1/servers/c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc => generated 1679 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 22:01:43.329493 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-0ca8fe9a-daee-4e2e-9331-77e79e99779e req-c9573e8c-f221-471c-bfdf-f5761b4aa461 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc", "name": "network-vif-plugged", "status": "completed", "tag": "a121bcc0-b84b-4f1d-a50a-e3b3f962a8ab"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 22:01:43.339980 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-0ca8fe9a-daee-4e2e-9331-77e79e99779e req-c9573e8c-f221-471c-bfdf-f5761b4aa461 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:01:43.340595 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-0ca8fe9a-daee-4e2e-9331-77e79e99779e req-c9573e8c-f221-471c-bfdf-f5761b4aa461 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:01:43.341048 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-0ca8fe9a-daee-4e2e-9331-77e79e99779e req-c9573e8c-f221-471c-bfdf-f5761b4aa461 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:01:43.352339 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-0ca8fe9a-daee-4e2e-9331-77e79e99779e req-c9573e8c-f221-471c-bfdf-f5761b4aa461 service nova] Creating event network-vif-plugged:a121bcc0-b84b-4f1d-a50a-e3b3f962a8ab for instance c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc on nch2-master-1 Oct 08 22:01:43.357841 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-0ca8fe9a-daee-4e2e-9331-77e79e99779e req-c9573e8c-f221-471c-bfdf-f5761b4aa461 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089283 Oct 08 22:01:43.358468 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3438/6950] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 22:01:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 22:02:04.796852 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-1b4f8713-17e5-4780-9579-fea1f08d8149 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 22:02:04.799096 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-1b4f8713-17e5-4780-9579-fea1f08d8149 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:02:04.802170 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=32 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 22:02:04.802857 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 22:02:04.808765 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1b4f8713-17e5-4780-9579-fea1f08d8149 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:02:04.809298 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1b4f8713-17e5-4780-9579-fea1f08d8149 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:02:04.809761 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1b4f8713-17e5-4780-9579-fea1f08d8149 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:02:04.810477 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1b4f8713-17e5-4780-9579-fea1f08d8149 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:02:04.811730 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1b4f8713-17e5-4780-9579-fea1f08d8149 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:02:04.812206 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1b4f8713-17e5-4780-9579-fea1f08d8149 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:02:04.867493 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-1b4f8713-17e5-4780-9579-fea1f08d8149 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "POST /compute/v2.1/servers/c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc/action" status: 200 len: 24579 microversion: 2.1 time: 0.074605 Oct 08 22:02:04.868379 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3513/6951] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 22:02:04 2022] POST /compute/v2.1/servers/c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc/action => generated 24579 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 08 22:02:12.239348 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:SELECT=28 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 22:02:12.240181 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 22:02:12.244195 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-406560af-33af-486d-b9b4-542572a04550 req-ed87639b-dd15-4ffe-8e4e-5ec925645a64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc", "tag": "a121bcc0-b84b-4f1d-a50a-e3b3f962a8ab"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 22:02:12.244645 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-1b39d3f3-8411-4943-8c7f-d6adeb96b8a5 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:02:12.245382 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-1b39d3f3-8411-4943-8c7f-d6adeb96b8a5 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:02:12.253389 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1b39d3f3-8411-4943-8c7f-d6adeb96b8a5 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:02:12.253894 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1b39d3f3-8411-4943-8c7f-d6adeb96b8a5 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:02:12.254332 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1b39d3f3-8411-4943-8c7f-d6adeb96b8a5 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:02:12.255059 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1b39d3f3-8411-4943-8c7f-d6adeb96b8a5 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:02:12.255526 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1b39d3f3-8411-4943-8c7f-d6adeb96b8a5 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:02:12.255959 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1b39d3f3-8411-4943-8c7f-d6adeb96b8a5 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:02:12.256531 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-406560af-33af-486d-b9b4-542572a04550 req-ed87639b-dd15-4ffe-8e4e-5ec925645a64 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:02:12.257438 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-406560af-33af-486d-b9b4-542572a04550 req-ed87639b-dd15-4ffe-8e4e-5ec925645a64 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:02:12.258112 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-406560af-33af-486d-b9b4-542572a04550 req-ed87639b-dd15-4ffe-8e4e-5ec925645a64 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:02:12.270800 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-406560af-33af-486d-b9b4-542572a04550 req-ed87639b-dd15-4ffe-8e4e-5ec925645a64 service nova] Creating event network-changed:a121bcc0-b84b-4f1d-a50a-e3b3f962a8ab for instance c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc on nch2-master-1 Oct 08 22:02:12.276402 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-406560af-33af-486d-b9b4-542572a04550 req-ed87639b-dd15-4ffe-8e4e-5ec925645a64 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036968 Oct 08 22:02:12.277730 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3514/6952] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 22:02:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 22:02:12.285553 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-1b39d3f3-8411-4943-8c7f-d6adeb96b8a5 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc] Going to try to terminate instance {{(pid=140491) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 22:02:12.372520 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-1b39d3f3-8411-4943-8c7f-d6adeb96b8a5 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "DELETE /compute/v2.1/servers/c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc" status: 204 len: 0 microversion: 2.1 time: 0.135304 Oct 08 22:02:12.375728 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3439/6953] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 22:02:12 2022] DELETE /compute/v2.1/servers/c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 22:02:12.384287 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-f6d560c6-4f96-4066-b912-b4f7fd4e8274 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:02:12.384801 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-f6d560c6-4f96-4066-b912-b4f7fd4e8274 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:02:12.393540 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f6d560c6-4f96-4066-b912-b4f7fd4e8274 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:02:12.394052 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f6d560c6-4f96-4066-b912-b4f7fd4e8274 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:02:12.394574 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f6d560c6-4f96-4066-b912-b4f7fd4e8274 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:02:12.395377 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f6d560c6-4f96-4066-b912-b4f7fd4e8274 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:02:12.395936 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f6d560c6-4f96-4066-b912-b4f7fd4e8274 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:02:12.396321 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f6d560c6-4f96-4066-b912-b4f7fd4e8274 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:02:12.562739 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-f6d560c6-4f96-4066-b912-b4f7fd4e8274 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771e9bc89e9d459e9e1714de7c514f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4acd2b59f7943cbb555876b9df70bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:02:12.571658 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-f6d560c6-4f96-4066-b912-b4f7fd4e8274 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "GET /compute/v2.1/servers/c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc" status: 200 len: 1685 microversion: 2.1 time: 0.192640 Oct 08 22:02:12.572248 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3515/6954] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:02:12 2022] GET /compute/v2.1/servers/c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc => generated 1685 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 22:02:13.595637 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-07507539-c819-4658-b09a-d7d8ba507cc9 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:02:13.596381 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-07507539-c819-4658-b09a-d7d8ba507cc9 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:02:13.603368 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-07507539-c819-4658-b09a-d7d8ba507cc9 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:02:13.603874 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-07507539-c819-4658-b09a-d7d8ba507cc9 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:02:13.604326 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-07507539-c819-4658-b09a-d7d8ba507cc9 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:02:13.605039 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-07507539-c819-4658-b09a-d7d8ba507cc9 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:02:13.605536 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-07507539-c819-4658-b09a-d7d8ba507cc9 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:02:13.605978 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-07507539-c819-4658-b09a-d7d8ba507cc9 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:02:13.738457 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-07507539-c819-4658-b09a-d7d8ba507cc9 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771e9bc89e9d459e9e1714de7c514f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4acd2b59f7943cbb555876b9df70bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:02:13.746440 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-07507539-c819-4658-b09a-d7d8ba507cc9 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "GET /compute/v2.1/servers/c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc" status: 200 len: 1685 microversion: 2.1 time: 0.155198 Oct 08 22:02:13.747020 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3440/6955] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:02:13 2022] GET /compute/v2.1/servers/c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc => generated 1685 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:02:14.292697 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-6e468cf4-7f3d-438c-8871-588633fa57f8 req-b65910bf-6bd6-46c8-9a79-74c95c29d31a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc", "name": "network-vif-deleted", "tag": "a121bcc0-b84b-4f1d-a50a-e3b3f962a8ab"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 22:02:14.303815 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-6e468cf4-7f3d-438c-8871-588633fa57f8 req-b65910bf-6bd6-46c8-9a79-74c95c29d31a service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:02:14.304318 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-6e468cf4-7f3d-438c-8871-588633fa57f8 req-b65910bf-6bd6-46c8-9a79-74c95c29d31a service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:02:14.304768 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-6e468cf4-7f3d-438c-8871-588633fa57f8 req-b65910bf-6bd6-46c8-9a79-74c95c29d31a service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:02:14.317367 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-6e468cf4-7f3d-438c-8871-588633fa57f8 req-b65910bf-6bd6-46c8-9a79-74c95c29d31a service nova] Creating event network-vif-deleted:a121bcc0-b84b-4f1d-a50a-e3b3f962a8ab for instance c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc on nch2-master-1 Oct 08 22:02:14.322297 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-6e468cf4-7f3d-438c-8871-588633fa57f8 req-b65910bf-6bd6-46c8-9a79-74c95c29d31a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034180 Oct 08 22:02:14.322912 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3516/6956] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 22:02:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 22:02:14.770428 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c8b1dafd-cae2-4d25-b71e-fe946e7c8d6d tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:02:14.771047 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-c8b1dafd-cae2-4d25-b71e-fe946e7c8d6d tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:02:14.778001 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c8b1dafd-cae2-4d25-b71e-fe946e7c8d6d tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:02:14.778500 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c8b1dafd-cae2-4d25-b71e-fe946e7c8d6d tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:02:14.778952 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c8b1dafd-cae2-4d25-b71e-fe946e7c8d6d tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:02:14.779663 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c8b1dafd-cae2-4d25-b71e-fe946e7c8d6d tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:02:14.780134 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c8b1dafd-cae2-4d25-b71e-fe946e7c8d6d tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:02:14.780576 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c8b1dafd-cae2-4d25-b71e-fe946e7c8d6d tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:02:14.794670 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-c8b1dafd-cae2-4d25-b71e-fe946e7c8d6d tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] HTTP exception thrown: Instance c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc could not be found. Oct 08 22:02:14.796243 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c8b1dafd-cae2-4d25-b71e-fe946e7c8d6d tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Request method failure captured: Oct 08 22:02:14.796243 ncdv-master-1 devstack@n-api.service[140491]: request: GET /compute/v2.1/servers/c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc HTTP/1.1 Oct 08 22:02:14.796243 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 22:02:14.796243 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 22:02:14.796243 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 22:02:14.796243 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 22:02:14.796243 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 22:02:14.796243 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 22:02:14.796243 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 22:02:14.796243 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 22:02:14.796243 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQfJQuuM4QaRSXOpK2YhyslcxnkJ03o0TeYKo-1sghAmNBGzTEmttugknoEotMcyK5hDZNRRFN5h_g-OLCqYD0f2cwEDT-h9hsKxYJXhTkmbUu76pLNz3djjSXZaSj_lX8tX8qa-8wLl1CIxv5sl6Y_9B2OxGfOgq2QPxELxT30_sgQc Oct 08 22:02:14.796243 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 22:02:14.796243 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 22:02:14.796243 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 22:02:14.796243 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 22:02:14.796243 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 22:02:14.796243 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 22:02:14.796243 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: b4acd2b59f7943cbb555876b9df70bee Oct 08 22:02:14.796243 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-2097292340 Oct 08 22:02:14.796243 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 22:02:14.796243 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 22:02:14.796243 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b4acd2b59f7943cbb555876b9df70bee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b4acd2b59f7943cbb555876b9df70bee"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b4acd2b59f7943cbb555876b9df70bee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b4acd2b59f7943cbb555876b9df70bee"}]}] Oct 08 22:02:14.796243 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-TestNetworkAdvancedServerOps-2097292340 Oct 08 22:02:14.796243 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: b4acd2b59f7943cbb555876b9df70bee Oct 08 22:02:14.796243 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-2097292340 Oct 08 22:02:14.796243 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-TestNetworkAdvancedServerOps-2097292340-project Oct 08 22:02:14.796243 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 22:02:14.796243 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 22:02:14.796243 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 771e9bc89e9d459e9e1714de7c514f4f Oct 08 22:02:14.796243 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-TestNetworkAdvancedServerOps-2097292340-project Oct 08 22:02:14.796243 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 22:02:14.796243 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc could not be found. Oct 08 22:02:14.796243 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': 'c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc'} Oct 08 22:02:14.796243 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 22:02:14.796243 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 22:02:14.796243 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 22:02:14.796243 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 22:02:14.796243 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 22:02:14.796243 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 22:02:14.796243 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 22:02:14.796243 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 22:02:14.796243 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 22:02:14.796243 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 22:02:14.796243 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc could not be found. Oct 08 22:02:14.796243 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 22:02:14.796243 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 22:02:14.796243 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 22:02:14.796243 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 22:02:14.796243 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 22:02:14.796243 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 22:02:14.796243 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 22:02:14.796243 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 22:02:14.796243 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 22:02:14.796243 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 22:02:14.796243 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 22:02:14.796243 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 22:02:14.796243 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 22:02:14.796243 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 22:02:14.796243 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 22:02:14.796243 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 22:02:14.796243 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc could not be found. Oct 08 22:02:14.796243 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 22:02:14.796243 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 22:02:14.802938 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 22:02:14.802938 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 22:02:14.802938 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 22:02:14.802938 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 22:02:14.802938 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 22:02:14.802938 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 22:02:14.802938 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc could not be found. Oct 08 22:02:14.802938 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 22:02:14.802938 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c8b1dafd-cae2-4d25-b71e-fe946e7c8d6d tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Returning 404 to user: Instance c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 22:02:14.802938 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-c8b1dafd-cae2-4d25-b71e-fe946e7c8d6d tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "GET /compute/v2.1/servers/c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc" status: 404 len: 111 microversion: 2.1 time: 0.031248 Oct 08 22:02:14.802938 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3441/6957] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:02:14 2022] GET /compute/v2.1/servers/c624f5fc-a6d3-4e4d-b2e7-b7fe8e56a7dc => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 22:02:17.851253 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-2d4120d5-6ad9-4b4c-b1cf-f2db20d5ae1b tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Calling method '.version_select at 0x7f1a91327310>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:02:17.885179 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-2d4120d5-6ad9-4b4c-b1cf-f2db20d5ae1b tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1472581118" status: 202 len: 0 microversion: 2.1 time: 0.044064 Oct 08 22:02:17.885990 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3517/6958] 10.222.0.26 () {58 vars in 1284 bytes} [Sat Oct 8 22:02:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1472581118 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 22:02:17.912204 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-2c57ce1c-e165-48be-b681-1896cf2f2abc tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Action: 'create', calling method: .version_select at 0x7f1a874cc820>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-295491416", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIpsckpVljnTn1BdobaoFYEW0j9L+sUIx2Vf1H+zpvP8knFKa5TQrJwVcQJhUIH+1JIWCLC6og4PU5qDorcHts6+bgSyQi5wHUJvnc3Fjez3lVsFbprk5tT9qSe+YxR4Jw=="}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 22:02:17.930086 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-2c57ce1c-e165-48be-b681-1896cf2f2abc tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Getting quotas for project b4acd2b59f7943cbb555876b9df70bee. Resources: {'key_pairs'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 22:02:17.935520 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-2c57ce1c-e165-48be-b681-1896cf2f2abc tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Getting quotas for user 771e9bc89e9d459e9e1714de7c514f4f and project b4acd2b59f7943cbb555876b9df70bee. Resources: {'key_pairs'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 22:02:17.961342 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-2c57ce1c-e165-48be-b681-1896cf2f2abc tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.053096 Oct 08 22:02:17.961957 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3442/6959] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Oct 8 22:02:17 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 22:02:23.606362 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-5f7d6f3e-072a-40e9-bf52-3938c369c1ef tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-44244397", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "networks": [{"uuid": "89440d80-ce97-43a0-897d-3ab2ef78c533"}], "key_name": "tempest-TestNetworkAdvancedServerOps-295491416", "security_groups": [{"name": "tempest-secgroup-smoke-261371923"}]}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 22:02:23.724792 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.network.neutron [None req-5f7d6f3e-072a-40e9-bf52-3938c369c1ef tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] validate_networks() for [('89440d80-ce97-43a0-897d-3ab2ef78c533', None, None, None, None, None)] {{(pid=140492) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 22:02:24.311492 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=14 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 22:02:24.491391 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-5f7d6f3e-072a-40e9-bf52-3938c369c1ef tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Flavor limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 22:02:24.492076 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-5f7d6f3e-072a-40e9-bf52-3938c369c1ef tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Image limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 22:02:24.492815 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-5f7d6f3e-072a-40e9-bf52-3938c369c1ef tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Flavor pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 22:02:24.493466 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-5f7d6f3e-072a-40e9-bf52-3938c369c1ef tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Image pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 22:02:24.493914 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-5f7d6f3e-072a-40e9-bf52-3938c369c1ef tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 22:02:24.505127 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5f7d6f3e-072a-40e9-bf52-3938c369c1ef tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:02:24.505981 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5f7d6f3e-072a-40e9-bf52-3938c369c1ef tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:02:24.506449 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5f7d6f3e-072a-40e9-bf52-3938c369c1ef tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:02:24.507215 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5f7d6f3e-072a-40e9-bf52-3938c369c1ef tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:02:24.507874 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5f7d6f3e-072a-40e9-bf52-3938c369c1ef tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:02:24.508343 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5f7d6f3e-072a-40e9-bf52-3938c369c1ef tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:02:24.527540 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-5f7d6f3e-072a-40e9-bf52-3938c369c1ef tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Getting quotas for project b4acd2b59f7943cbb555876b9df70bee. Resources: {'cores', 'instances', 'ram'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 22:02:24.533799 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-5f7d6f3e-072a-40e9-bf52-3938c369c1ef tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Getting quotas for user 771e9bc89e9d459e9e1714de7c514f4f and project b4acd2b59f7943cbb555876b9df70bee. Resources: {'cores', 'instances', 'ram'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 22:02:24.548171 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-5f7d6f3e-072a-40e9-bf52-3938c369c1ef tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Going to run 1 instances... {{(pid=140492) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 22:02:24.551756 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-5f7d6f3e-072a-40e9-bf52-3938c369c1ef tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: 36bef5fa-98f8-4f14-91bd-33f97e2c9aa3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c508bd7f-7db9-4b2c-af7c-be54a855c355',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140492) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 22:02:24.601628 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-5f7d6f3e-072a-40e9-bf52-3938c369c1ef tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.998990 Oct 08 22:02:24.603048 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3518/6960] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 22:02:23 2022] POST /compute/v2.1/servers => generated 405 bytes in 1001 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 08 22:02:24.616500 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-4808628f-48e9-4d8a-bdaf-f9bfa1b04a94 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:02:24.617859 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-4808628f-48e9-4d8a-bdaf-f9bfa1b04a94 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: 36bef5fa-98f8-4f14-91bd-33f97e2c9aa3] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:02:24.695225 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-4808628f-48e9-4d8a-bdaf-f9bfa1b04a94 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771e9bc89e9d459e9e1714de7c514f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4acd2b59f7943cbb555876b9df70bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:02:24.702623 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-4808628f-48e9-4d8a-bdaf-f9bfa1b04a94 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "GET /compute/v2.1/servers/36bef5fa-98f8-4f14-91bd-33f97e2c9aa3" status: 200 len: 1264 microversion: 2.1 time: 0.090983 Oct 08 22:02:24.703452 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3443/6961] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:02:24 2022] GET /compute/v2.1/servers/36bef5fa-98f8-4f14-91bd-33f97e2c9aa3 => generated 1264 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:02:25.728559 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-1113593a-6fbc-4e5d-90ce-bf0d223f3796 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:02:25.729682 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-1113593a-6fbc-4e5d-90ce-bf0d223f3796 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: 36bef5fa-98f8-4f14-91bd-33f97e2c9aa3] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:02:25.737286 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1113593a-6fbc-4e5d-90ce-bf0d223f3796 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:02:25.738159 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1113593a-6fbc-4e5d-90ce-bf0d223f3796 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:02:25.738837 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1113593a-6fbc-4e5d-90ce-bf0d223f3796 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:02:25.739960 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1113593a-6fbc-4e5d-90ce-bf0d223f3796 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:02:25.740655 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1113593a-6fbc-4e5d-90ce-bf0d223f3796 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:02:25.741373 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1113593a-6fbc-4e5d-90ce-bf0d223f3796 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:02:25.887937 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-1113593a-6fbc-4e5d-90ce-bf0d223f3796 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771e9bc89e9d459e9e1714de7c514f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4acd2b59f7943cbb555876b9df70bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:02:25.897920 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-1113593a-6fbc-4e5d-90ce-bf0d223f3796 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "GET /compute/v2.1/servers/36bef5fa-98f8-4f14-91bd-33f97e2c9aa3" status: 200 len: 1334 microversion: 2.1 time: 0.175098 Oct 08 22:02:25.898831 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3519/6962] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:02:25 2022] GET /compute/v2.1/servers/36bef5fa-98f8-4f14-91bd-33f97e2c9aa3 => generated 1334 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:02:26.921912 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-56d7e95d-d042-4b0f-bd0a-581fa577f009 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:02:26.923533 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-56d7e95d-d042-4b0f-bd0a-581fa577f009 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: 36bef5fa-98f8-4f14-91bd-33f97e2c9aa3] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:02:26.927082 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 22:02:26.933434 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-56d7e95d-d042-4b0f-bd0a-581fa577f009 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:02:26.933935 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-56d7e95d-d042-4b0f-bd0a-581fa577f009 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:02:26.934379 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-56d7e95d-d042-4b0f-bd0a-581fa577f009 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:02:26.935095 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-56d7e95d-d042-4b0f-bd0a-581fa577f009 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:02:26.935550 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-56d7e95d-d042-4b0f-bd0a-581fa577f009 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:02:26.936903 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-56d7e95d-d042-4b0f-bd0a-581fa577f009 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:02:27.108025 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-56d7e95d-d042-4b0f-bd0a-581fa577f009 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771e9bc89e9d459e9e1714de7c514f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4acd2b59f7943cbb555876b9df70bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:02:27.118168 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-56d7e95d-d042-4b0f-bd0a-581fa577f009 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "GET /compute/v2.1/servers/36bef5fa-98f8-4f14-91bd-33f97e2c9aa3" status: 200 len: 1389 microversion: 2.1 time: 0.200508 Oct 08 22:02:27.118939 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3444/6963] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:02:26 2022] GET /compute/v2.1/servers/36bef5fa-98f8-4f14-91bd-33f97e2c9aa3 => generated 1389 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:02:27.189975 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-9004bb92-0646-4ef5-a0ca-57a239852851 req-b056d58c-7c23-4e6f-b891-329b61a5fc2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36bef5fa-98f8-4f14-91bd-33f97e2c9aa3", "tag": "041ab328-b26e-4a0a-bc94-b5c8db7aa396"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 22:02:27.204282 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-9004bb92-0646-4ef5-a0ca-57a239852851 req-b056d58c-7c23-4e6f-b891-329b61a5fc2d service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:02:27.205090 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-9004bb92-0646-4ef5-a0ca-57a239852851 req-b056d58c-7c23-4e6f-b891-329b61a5fc2d service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:02:27.205657 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-9004bb92-0646-4ef5-a0ca-57a239852851 req-b056d58c-7c23-4e6f-b891-329b61a5fc2d service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:02:27.219851 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-9004bb92-0646-4ef5-a0ca-57a239852851 req-b056d58c-7c23-4e6f-b891-329b61a5fc2d service nova] Creating event network-changed:041ab328-b26e-4a0a-bc94-b5c8db7aa396 for instance 36bef5fa-98f8-4f14-91bd-33f97e2c9aa3 on nch2-master-1 Oct 08 22:02:27.226070 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-9004bb92-0646-4ef5-a0ca-57a239852851 req-b056d58c-7c23-4e6f-b891-329b61a5fc2d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040736 Oct 08 22:02:27.226941 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3520/6964] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 22:02:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 22:02:28.142517 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-aee9d47c-f02c-4511-9106-95bd4060482c tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:02:28.143042 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-aee9d47c-f02c-4511-9106-95bd4060482c tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: 36bef5fa-98f8-4f14-91bd-33f97e2c9aa3] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:02:28.150022 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-aee9d47c-f02c-4511-9106-95bd4060482c tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:02:28.150515 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-aee9d47c-f02c-4511-9106-95bd4060482c tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:02:28.150965 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-aee9d47c-f02c-4511-9106-95bd4060482c tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:02:28.151670 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-aee9d47c-f02c-4511-9106-95bd4060482c tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:02:28.152135 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-aee9d47c-f02c-4511-9106-95bd4060482c tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:02:28.152571 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-aee9d47c-f02c-4511-9106-95bd4060482c tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:02:28.284099 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-aee9d47c-f02c-4511-9106-95bd4060482c tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771e9bc89e9d459e9e1714de7c514f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4acd2b59f7943cbb555876b9df70bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:02:28.292042 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-aee9d47c-f02c-4511-9106-95bd4060482c tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "GET /compute/v2.1/servers/36bef5fa-98f8-4f14-91bd-33f97e2c9aa3" status: 200 len: 1389 microversion: 2.1 time: 0.154197 Oct 08 22:02:28.292617 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3445/6965] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:02:28 2022] GET /compute/v2.1/servers/36bef5fa-98f8-4f14-91bd-33f97e2c9aa3 => generated 1389 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:02:29.316937 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-66367fdf-692b-4b85-95fd-9f27682f44c8 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:02:29.317622 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-66367fdf-692b-4b85-95fd-9f27682f44c8 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: 36bef5fa-98f8-4f14-91bd-33f97e2c9aa3] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:02:29.323961 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-66367fdf-692b-4b85-95fd-9f27682f44c8 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:02:29.324476 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-66367fdf-692b-4b85-95fd-9f27682f44c8 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:02:29.324942 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-66367fdf-692b-4b85-95fd-9f27682f44c8 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:02:29.325697 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-66367fdf-692b-4b85-95fd-9f27682f44c8 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:02:29.326210 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-66367fdf-692b-4b85-95fd-9f27682f44c8 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:02:29.326669 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-66367fdf-692b-4b85-95fd-9f27682f44c8 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:02:29.471074 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-66367fdf-692b-4b85-95fd-9f27682f44c8 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771e9bc89e9d459e9e1714de7c514f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4acd2b59f7943cbb555876b9df70bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:02:29.479670 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-66367fdf-692b-4b85-95fd-9f27682f44c8 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "GET /compute/v2.1/servers/36bef5fa-98f8-4f14-91bd-33f97e2c9aa3" status: 200 len: 1389 microversion: 2.1 time: 0.168795 Oct 08 22:02:29.480300 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3521/6966] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:02:29 2022] GET /compute/v2.1/servers/36bef5fa-98f8-4f14-91bd-33f97e2c9aa3 => generated 1389 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:02:30.502291 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-b6612bbb-dabc-4e9f-82bb-4f6f47ce74bf tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:02:30.502916 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-b6612bbb-dabc-4e9f-82bb-4f6f47ce74bf tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: 36bef5fa-98f8-4f14-91bd-33f97e2c9aa3] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:02:30.509875 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b6612bbb-dabc-4e9f-82bb-4f6f47ce74bf tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:02:30.510375 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b6612bbb-dabc-4e9f-82bb-4f6f47ce74bf tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:02:30.510832 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b6612bbb-dabc-4e9f-82bb-4f6f47ce74bf tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:02:30.511555 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b6612bbb-dabc-4e9f-82bb-4f6f47ce74bf tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:02:30.512021 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b6612bbb-dabc-4e9f-82bb-4f6f47ce74bf tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:02:30.512456 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b6612bbb-dabc-4e9f-82bb-4f6f47ce74bf tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:02:30.646743 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-b6612bbb-dabc-4e9f-82bb-4f6f47ce74bf tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771e9bc89e9d459e9e1714de7c514f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4acd2b59f7943cbb555876b9df70bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:02:30.654600 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-b6612bbb-dabc-4e9f-82bb-4f6f47ce74bf tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "GET /compute/v2.1/servers/36bef5fa-98f8-4f14-91bd-33f97e2c9aa3" status: 200 len: 1389 microversion: 2.1 time: 0.156238 Oct 08 22:02:30.655175 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3446/6967] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:02:30 2022] GET /compute/v2.1/servers/36bef5fa-98f8-4f14-91bd-33f97e2c9aa3 => generated 1389 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:02:31.677304 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-6ed18985-aed1-4524-8d24-c5494f165660 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:02:31.678527 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-6ed18985-aed1-4524-8d24-c5494f165660 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: 36bef5fa-98f8-4f14-91bd-33f97e2c9aa3] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:02:31.685863 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6ed18985-aed1-4524-8d24-c5494f165660 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:02:31.687747 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6ed18985-aed1-4524-8d24-c5494f165660 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:02:31.688230 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6ed18985-aed1-4524-8d24-c5494f165660 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:02:31.689227 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6ed18985-aed1-4524-8d24-c5494f165660 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:02:31.689550 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6ed18985-aed1-4524-8d24-c5494f165660 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:02:31.689911 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6ed18985-aed1-4524-8d24-c5494f165660 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:02:31.839687 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-6ed18985-aed1-4524-8d24-c5494f165660 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771e9bc89e9d459e9e1714de7c514f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4acd2b59f7943cbb555876b9df70bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:02:31.848249 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-6ed18985-aed1-4524-8d24-c5494f165660 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "GET /compute/v2.1/servers/36bef5fa-98f8-4f14-91bd-33f97e2c9aa3" status: 200 len: 1389 microversion: 2.1 time: 0.174923 Oct 08 22:02:31.848844 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3522/6968] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:02:31 2022] GET /compute/v2.1/servers/36bef5fa-98f8-4f14-91bd-33f97e2c9aa3 => generated 1389 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:02:32.871312 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-ecf6a8b2-b7b2-4915-a78f-03c28e51d1ac tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:02:32.871908 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-ecf6a8b2-b7b2-4915-a78f-03c28e51d1ac tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: 36bef5fa-98f8-4f14-91bd-33f97e2c9aa3] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:02:32.879414 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ecf6a8b2-b7b2-4915-a78f-03c28e51d1ac tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:02:32.879917 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ecf6a8b2-b7b2-4915-a78f-03c28e51d1ac tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:02:32.880363 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ecf6a8b2-b7b2-4915-a78f-03c28e51d1ac tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:02:32.881061 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ecf6a8b2-b7b2-4915-a78f-03c28e51d1ac tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:02:32.881561 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ecf6a8b2-b7b2-4915-a78f-03c28e51d1ac tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:02:32.881992 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ecf6a8b2-b7b2-4915-a78f-03c28e51d1ac tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:02:33.013303 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-ecf6a8b2-b7b2-4915-a78f-03c28e51d1ac tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771e9bc89e9d459e9e1714de7c514f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4acd2b59f7943cbb555876b9df70bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:02:33.021180 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-ecf6a8b2-b7b2-4915-a78f-03c28e51d1ac tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "GET /compute/v2.1/servers/36bef5fa-98f8-4f14-91bd-33f97e2c9aa3" status: 200 len: 1389 microversion: 2.1 time: 0.154216 Oct 08 22:02:33.021786 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3447/6969] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:02:32 2022] GET /compute/v2.1/servers/36bef5fa-98f8-4f14-91bd-33f97e2c9aa3 => generated 1389 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:02:33.457561 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-d3e7f9b0-c300-4800-b2d4-667a4bc542ac req-8cfd212d-95e7-429c-868e-be4505f9b2fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36bef5fa-98f8-4f14-91bd-33f97e2c9aa3", "name": "network-vif-plugged", "status": "completed", "tag": "041ab328-b26e-4a0a-bc94-b5c8db7aa396"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 22:02:33.469323 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-d3e7f9b0-c300-4800-b2d4-667a4bc542ac req-8cfd212d-95e7-429c-868e-be4505f9b2fc service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:02:33.469831 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-d3e7f9b0-c300-4800-b2d4-667a4bc542ac req-8cfd212d-95e7-429c-868e-be4505f9b2fc service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:02:33.470290 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-d3e7f9b0-c300-4800-b2d4-667a4bc542ac req-8cfd212d-95e7-429c-868e-be4505f9b2fc service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:02:33.481887 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-d3e7f9b0-c300-4800-b2d4-667a4bc542ac req-8cfd212d-95e7-429c-868e-be4505f9b2fc service nova] Creating event network-vif-plugged:041ab328-b26e-4a0a-bc94-b5c8db7aa396 for instance 36bef5fa-98f8-4f14-91bd-33f97e2c9aa3 on nch2-master-1 Oct 08 22:02:33.487102 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-d3e7f9b0-c300-4800-b2d4-667a4bc542ac req-8cfd212d-95e7-429c-868e-be4505f9b2fc service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033347 Oct 08 22:02:33.487722 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3523/6970] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 22:02:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 22:02:34.044422 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-3e4faac1-0a57-46c5-b3b6-35d08b94ab1d tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:02:34.045046 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-3e4faac1-0a57-46c5-b3b6-35d08b94ab1d tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: 36bef5fa-98f8-4f14-91bd-33f97e2c9aa3] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:02:34.052563 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3e4faac1-0a57-46c5-b3b6-35d08b94ab1d tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:02:34.053064 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3e4faac1-0a57-46c5-b3b6-35d08b94ab1d tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:02:34.053570 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3e4faac1-0a57-46c5-b3b6-35d08b94ab1d tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:02:34.054286 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3e4faac1-0a57-46c5-b3b6-35d08b94ab1d tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:02:34.054758 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3e4faac1-0a57-46c5-b3b6-35d08b94ab1d tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:02:34.055199 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3e4faac1-0a57-46c5-b3b6-35d08b94ab1d tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:02:34.189319 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-3e4faac1-0a57-46c5-b3b6-35d08b94ab1d tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771e9bc89e9d459e9e1714de7c514f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4acd2b59f7943cbb555876b9df70bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:02:34.197133 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-3e4faac1-0a57-46c5-b3b6-35d08b94ab1d tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "GET /compute/v2.1/servers/36bef5fa-98f8-4f14-91bd-33f97e2c9aa3" status: 200 len: 1389 microversion: 2.1 time: 0.156710 Oct 08 22:02:34.197737 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3448/6971] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:02:34 2022] GET /compute/v2.1/servers/36bef5fa-98f8-4f14-91bd-33f97e2c9aa3 => generated 1389 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:02:35.218937 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=2 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 22:02:35.219753 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=6 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 22:02:35.224706 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-5e2647b3-af44-4e24-8c68-143349eaa5d4 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:02:35.225455 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-5e2647b3-af44-4e24-8c68-143349eaa5d4 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: 36bef5fa-98f8-4f14-91bd-33f97e2c9aa3] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:02:35.227265 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=37,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 22:02:35.235182 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5e2647b3-af44-4e24-8c68-143349eaa5d4 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:02:35.235687 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5e2647b3-af44-4e24-8c68-143349eaa5d4 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:02:35.236146 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5e2647b3-af44-4e24-8c68-143349eaa5d4 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:02:35.236862 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5e2647b3-af44-4e24-8c68-143349eaa5d4 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:02:35.237371 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5e2647b3-af44-4e24-8c68-143349eaa5d4 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:02:35.237823 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5e2647b3-af44-4e24-8c68-143349eaa5d4 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:02:35.375503 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-5e2647b3-af44-4e24-8c68-143349eaa5d4 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771e9bc89e9d459e9e1714de7c514f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4acd2b59f7943cbb555876b9df70bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:02:35.383427 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-5e2647b3-af44-4e24-8c68-143349eaa5d4 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "GET /compute/v2.1/servers/36bef5fa-98f8-4f14-91bd-33f97e2c9aa3" status: 200 len: 1560 microversion: 2.1 time: 0.166340 Oct 08 22:02:35.384021 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3524/6972] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:02:35 2022] GET /compute/v2.1/servers/36bef5fa-98f8-4f14-91bd-33f97e2c9aa3 => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:02:35.405954 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-e80bde0c-bbdd-402c-86de-6565afdc4a62 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:02:35.406579 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-e80bde0c-bbdd-402c-86de-6565afdc4a62 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: 36bef5fa-98f8-4f14-91bd-33f97e2c9aa3] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:02:35.408514 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=6 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 22:02:35.414786 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e80bde0c-bbdd-402c-86de-6565afdc4a62 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:02:35.415288 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e80bde0c-bbdd-402c-86de-6565afdc4a62 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:02:35.415741 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e80bde0c-bbdd-402c-86de-6565afdc4a62 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:02:35.416449 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e80bde0c-bbdd-402c-86de-6565afdc4a62 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:02:35.416916 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e80bde0c-bbdd-402c-86de-6565afdc4a62 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:02:35.417463 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e80bde0c-bbdd-402c-86de-6565afdc4a62 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:02:35.549081 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-e80bde0c-bbdd-402c-86de-6565afdc4a62 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771e9bc89e9d459e9e1714de7c514f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4acd2b59f7943cbb555876b9df70bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:02:35.556955 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-e80bde0c-bbdd-402c-86de-6565afdc4a62 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "GET /compute/v2.1/servers/36bef5fa-98f8-4f14-91bd-33f97e2c9aa3" status: 200 len: 1560 microversion: 2.1 time: 0.155554 Oct 08 22:02:35.557578 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3449/6973] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:02:35 2022] GET /compute/v2.1/servers/36bef5fa-98f8-4f14-91bd-33f97e2c9aa3 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:02:37.212283 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-2139cbc9-3ca2-42df-a799-878de944c5a7 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:02:37.212933 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-2139cbc9-3ca2-42df-a799-878de944c5a7 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: 36bef5fa-98f8-4f14-91bd-33f97e2c9aa3] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:02:37.219851 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2139cbc9-3ca2-42df-a799-878de944c5a7 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:02:37.220378 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2139cbc9-3ca2-42df-a799-878de944c5a7 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:02:37.221229 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2139cbc9-3ca2-42df-a799-878de944c5a7 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:02:37.222241 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2139cbc9-3ca2-42df-a799-878de944c5a7 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:02:37.222914 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2139cbc9-3ca2-42df-a799-878de944c5a7 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:02:37.223548 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2139cbc9-3ca2-42df-a799-878de944c5a7 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:02:37.225949 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-3a710eef-dd4d-40bb-9f13-1a7a6191e06a req-5d10ae41-4161-445d-879e-700a1ce7b8f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36bef5fa-98f8-4f14-91bd-33f97e2c9aa3", "tag": "041ab328-b26e-4a0a-bc94-b5c8db7aa396"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 22:02:37.236162 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-3a710eef-dd4d-40bb-9f13-1a7a6191e06a req-5d10ae41-4161-445d-879e-700a1ce7b8f8 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:02:37.236575 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-3a710eef-dd4d-40bb-9f13-1a7a6191e06a req-5d10ae41-4161-445d-879e-700a1ce7b8f8 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:02:37.237016 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-3a710eef-dd4d-40bb-9f13-1a7a6191e06a req-5d10ae41-4161-445d-879e-700a1ce7b8f8 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:02:37.249410 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-3a710eef-dd4d-40bb-9f13-1a7a6191e06a req-5d10ae41-4161-445d-879e-700a1ce7b8f8 service nova] Creating event network-changed:041ab328-b26e-4a0a-bc94-b5c8db7aa396 for instance 36bef5fa-98f8-4f14-91bd-33f97e2c9aa3 on nch2-master-1 Oct 08 22:02:37.254981 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-3a710eef-dd4d-40bb-9f13-1a7a6191e06a req-5d10ae41-4161-445d-879e-700a1ce7b8f8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101263 Oct 08 22:02:37.255958 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3450/6974] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 22:02:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 08 22:02:37.472641 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-2139cbc9-3ca2-42df-a799-878de944c5a7 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771e9bc89e9d459e9e1714de7c514f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4acd2b59f7943cbb555876b9df70bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:02:37.481940 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-2139cbc9-3ca2-42df-a799-878de944c5a7 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "GET /compute/v2.1/servers/36bef5fa-98f8-4f14-91bd-33f97e2c9aa3" status: 200 len: 1560 microversion: 2.1 time: 0.334482 Oct 08 22:02:37.482645 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3525/6975] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:02:37 2022] GET /compute/v2.1/servers/36bef5fa-98f8-4f14-91bd-33f97e2c9aa3 => generated 1560 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:02:58.732104 ncdv-master-1 devstack@n-api.service[140491]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 08 22:02:58.732686 ncdv-master-1 devstack@n-api.service[140491]: Sat Oct 8 22:02:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/36bef5fa-98f8-4f14-91bd-33f97e2c9aa3/action (ip 10.222.0.26) !!! Oct 08 22:02:58.733168 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 22:02:58.733976 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=38 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 22:02:58.738551 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-6133bea1-85ad-41d6-8fe9-e8523fb7d32c tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 22:02:58.740863 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-6133bea1-85ad-41d6-8fe9-e8523fb7d32c tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: 36bef5fa-98f8-4f14-91bd-33f97e2c9aa3] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:02:58.753869 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6133bea1-85ad-41d6-8fe9-e8523fb7d32c tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:02:58.754377 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6133bea1-85ad-41d6-8fe9-e8523fb7d32c tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:02:58.754831 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6133bea1-85ad-41d6-8fe9-e8523fb7d32c tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:02:58.755552 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6133bea1-85ad-41d6-8fe9-e8523fb7d32c tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:02:58.756022 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6133bea1-85ad-41d6-8fe9-e8523fb7d32c tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:02:58.756464 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-6133bea1-85ad-41d6-8fe9-e8523fb7d32c tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:02:58.809729 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-6133bea1-85ad-41d6-8fe9-e8523fb7d32c tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "POST /compute/v2.1/servers/36bef5fa-98f8-4f14-91bd-33f97e2c9aa3/action" status: 200 len: 24574 microversion: 2.1 time: 0.079938 Oct 08 22:02:58.810394 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3451/6976] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 22:02:58 2022] POST /compute/v2.1/servers/36bef5fa-98f8-4f14-91bd-33f97e2c9aa3/action => generated 24574 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 08 22:03:09.823166 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-a73c44c5-335c-459f-9181-430e854023de tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 22:03:09.825511 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=3 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 22:03:09.826197 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=36 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 22:03:09.832748 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a73c44c5-335c-459f-9181-430e854023de tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:03:09.833316 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a73c44c5-335c-459f-9181-430e854023de tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:03:09.833784 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a73c44c5-335c-459f-9181-430e854023de tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:03:09.857656 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-a73c44c5-335c-459f-9181-430e854023de tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: 36bef5fa-98f8-4f14-91bd-33f97e2c9aa3] Going to try to stop instance {{(pid=140492) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 08 22:03:09.899867 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-a73c44c5-335c-459f-9181-430e854023de tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "POST /compute/v2.1/servers/36bef5fa-98f8-4f14-91bd-33f97e2c9aa3/action" status: 202 len: 0 microversion: 2.1 time: 0.080628 Oct 08 22:03:09.900477 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3526/6977] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 22:03:09 2022] POST /compute/v2.1/servers/36bef5fa-98f8-4f14-91bd-33f97e2c9aa3/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 22:03:09.910091 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-59103dd0-8e26-44f4-9998-272391a78bb7 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:03:09.910809 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-59103dd0-8e26-44f4-9998-272391a78bb7 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: 36bef5fa-98f8-4f14-91bd-33f97e2c9aa3] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:03:09.913769 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=4 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 22:03:09.914422 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:SELECT=2 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 22:03:09.920083 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-59103dd0-8e26-44f4-9998-272391a78bb7 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:03:09.920586 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-59103dd0-8e26-44f4-9998-272391a78bb7 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:03:09.921040 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-59103dd0-8e26-44f4-9998-272391a78bb7 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:03:09.921804 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-59103dd0-8e26-44f4-9998-272391a78bb7 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:03:09.922900 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-59103dd0-8e26-44f4-9998-272391a78bb7 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:03:09.923345 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-59103dd0-8e26-44f4-9998-272391a78bb7 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:03:10.061582 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-59103dd0-8e26-44f4-9998-272391a78bb7 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771e9bc89e9d459e9e1714de7c514f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4acd2b59f7943cbb555876b9df70bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:03:10.069422 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-59103dd0-8e26-44f4-9998-272391a78bb7 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "GET /compute/v2.1/servers/36bef5fa-98f8-4f14-91bd-33f97e2c9aa3" status: 200 len: 1689 microversion: 2.1 time: 0.164353 Oct 08 22:03:10.069989 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3452/6978] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:03:09 2022] GET /compute/v2.1/servers/36bef5fa-98f8-4f14-91bd-33f97e2c9aa3 => generated 1689 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:03:11.093336 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-767c1251-3909-4f31-abaa-e28954bdf555 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:03:11.094128 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-767c1251-3909-4f31-abaa-e28954bdf555 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: 36bef5fa-98f8-4f14-91bd-33f97e2c9aa3] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:03:11.101987 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-767c1251-3909-4f31-abaa-e28954bdf555 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:03:11.102503 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-767c1251-3909-4f31-abaa-e28954bdf555 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:03:11.102975 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-767c1251-3909-4f31-abaa-e28954bdf555 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:03:11.103708 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-767c1251-3909-4f31-abaa-e28954bdf555 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:03:11.104193 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-767c1251-3909-4f31-abaa-e28954bdf555 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:03:11.104648 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-767c1251-3909-4f31-abaa-e28954bdf555 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:03:11.239931 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-767c1251-3909-4f31-abaa-e28954bdf555 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771e9bc89e9d459e9e1714de7c514f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4acd2b59f7943cbb555876b9df70bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:03:11.247827 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-767c1251-3909-4f31-abaa-e28954bdf555 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "GET /compute/v2.1/servers/36bef5fa-98f8-4f14-91bd-33f97e2c9aa3" status: 200 len: 1689 microversion: 2.1 time: 0.158804 Oct 08 22:03:11.248406 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3527/6979] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:03:11 2022] GET /compute/v2.1/servers/36bef5fa-98f8-4f14-91bd-33f97e2c9aa3 => generated 1689 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:03:12.271024 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-f75f53e1-edba-4d8b-a844-192b8304ad83 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:03:12.271658 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-f75f53e1-edba-4d8b-a844-192b8304ad83 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: 36bef5fa-98f8-4f14-91bd-33f97e2c9aa3] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:03:12.278755 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f75f53e1-edba-4d8b-a844-192b8304ad83 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:03:12.279256 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f75f53e1-edba-4d8b-a844-192b8304ad83 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:03:12.279711 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f75f53e1-edba-4d8b-a844-192b8304ad83 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:03:12.280425 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f75f53e1-edba-4d8b-a844-192b8304ad83 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:03:12.280895 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f75f53e1-edba-4d8b-a844-192b8304ad83 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:03:12.281374 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f75f53e1-edba-4d8b-a844-192b8304ad83 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:03:12.410469 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-f75f53e1-edba-4d8b-a844-192b8304ad83 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771e9bc89e9d459e9e1714de7c514f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4acd2b59f7943cbb555876b9df70bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:03:12.418290 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-f75f53e1-edba-4d8b-a844-192b8304ad83 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "GET /compute/v2.1/servers/36bef5fa-98f8-4f14-91bd-33f97e2c9aa3" status: 200 len: 1689 microversion: 2.1 time: 0.151206 Oct 08 22:03:12.418867 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3453/6980] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:03:12 2022] GET /compute/v2.1/servers/36bef5fa-98f8-4f14-91bd-33f97e2c9aa3 => generated 1689 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:03:13.442070 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-9466709f-34c9-4df0-81cd-0fddcb8ffdf4 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:03:13.442832 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-9466709f-34c9-4df0-81cd-0fddcb8ffdf4 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: 36bef5fa-98f8-4f14-91bd-33f97e2c9aa3] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:03:13.449398 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9466709f-34c9-4df0-81cd-0fddcb8ffdf4 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:03:13.449912 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9466709f-34c9-4df0-81cd-0fddcb8ffdf4 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:03:13.450379 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9466709f-34c9-4df0-81cd-0fddcb8ffdf4 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:03:13.451107 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9466709f-34c9-4df0-81cd-0fddcb8ffdf4 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:03:13.451588 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9466709f-34c9-4df0-81cd-0fddcb8ffdf4 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:03:13.452040 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9466709f-34c9-4df0-81cd-0fddcb8ffdf4 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:03:13.587060 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-9466709f-34c9-4df0-81cd-0fddcb8ffdf4 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771e9bc89e9d459e9e1714de7c514f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4acd2b59f7943cbb555876b9df70bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:03:13.595141 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-9466709f-34c9-4df0-81cd-0fddcb8ffdf4 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "GET /compute/v2.1/servers/36bef5fa-98f8-4f14-91bd-33f97e2c9aa3" status: 200 len: 1689 microversion: 2.1 time: 0.157740 Oct 08 22:03:13.595730 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3528/6981] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:03:13 2022] GET /compute/v2.1/servers/36bef5fa-98f8-4f14-91bd-33f97e2c9aa3 => generated 1689 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:03:14.618688 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-07835e69-313c-4c38-8bcf-1b3df870c4f1 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:03:14.619316 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-07835e69-313c-4c38-8bcf-1b3df870c4f1 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: 36bef5fa-98f8-4f14-91bd-33f97e2c9aa3] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:03:14.626363 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-07835e69-313c-4c38-8bcf-1b3df870c4f1 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:03:14.626861 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-07835e69-313c-4c38-8bcf-1b3df870c4f1 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:03:14.627317 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-07835e69-313c-4c38-8bcf-1b3df870c4f1 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:03:14.628025 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-07835e69-313c-4c38-8bcf-1b3df870c4f1 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:03:14.628496 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-07835e69-313c-4c38-8bcf-1b3df870c4f1 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:03:14.628933 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-07835e69-313c-4c38-8bcf-1b3df870c4f1 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:03:14.761056 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-07835e69-313c-4c38-8bcf-1b3df870c4f1 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771e9bc89e9d459e9e1714de7c514f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4acd2b59f7943cbb555876b9df70bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:03:14.769379 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-07835e69-313c-4c38-8bcf-1b3df870c4f1 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "GET /compute/v2.1/servers/36bef5fa-98f8-4f14-91bd-33f97e2c9aa3" status: 200 len: 1689 microversion: 2.1 time: 0.154652 Oct 08 22:03:14.769992 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3454/6982] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:03:14 2022] GET /compute/v2.1/servers/36bef5fa-98f8-4f14-91bd-33f97e2c9aa3 => generated 1689 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:03:15.793569 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-742b6a96-d4a0-4d88-97f7-b32f704e8e56 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:03:15.794108 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-742b6a96-d4a0-4d88-97f7-b32f704e8e56 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: 36bef5fa-98f8-4f14-91bd-33f97e2c9aa3] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:03:15.801034 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-742b6a96-d4a0-4d88-97f7-b32f704e8e56 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:03:15.801576 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-742b6a96-d4a0-4d88-97f7-b32f704e8e56 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:03:15.802032 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-742b6a96-d4a0-4d88-97f7-b32f704e8e56 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:03:15.802743 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-742b6a96-d4a0-4d88-97f7-b32f704e8e56 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:03:15.803221 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-742b6a96-d4a0-4d88-97f7-b32f704e8e56 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:03:15.803670 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-742b6a96-d4a0-4d88-97f7-b32f704e8e56 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:03:15.939946 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-742b6a96-d4a0-4d88-97f7-b32f704e8e56 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771e9bc89e9d459e9e1714de7c514f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4acd2b59f7943cbb555876b9df70bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:03:15.947926 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-742b6a96-d4a0-4d88-97f7-b32f704e8e56 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "GET /compute/v2.1/servers/36bef5fa-98f8-4f14-91bd-33f97e2c9aa3" status: 200 len: 1689 microversion: 2.1 time: 0.158368 Oct 08 22:03:15.948514 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3529/6983] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:03:15 2022] GET /compute/v2.1/servers/36bef5fa-98f8-4f14-91bd-33f97e2c9aa3 => generated 1689 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:03:16.971524 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-a8c46d27-f034-42d3-8be0-b658bb09a22d tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:03:16.972146 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-a8c46d27-f034-42d3-8be0-b658bb09a22d tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: 36bef5fa-98f8-4f14-91bd-33f97e2c9aa3] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:03:16.979150 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a8c46d27-f034-42d3-8be0-b658bb09a22d tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:03:16.979645 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a8c46d27-f034-42d3-8be0-b658bb09a22d tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:03:16.980094 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a8c46d27-f034-42d3-8be0-b658bb09a22d tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:03:16.980804 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a8c46d27-f034-42d3-8be0-b658bb09a22d tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:03:16.981329 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a8c46d27-f034-42d3-8be0-b658bb09a22d tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:03:16.981767 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a8c46d27-f034-42d3-8be0-b658bb09a22d tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:03:17.117070 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-a8c46d27-f034-42d3-8be0-b658bb09a22d tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771e9bc89e9d459e9e1714de7c514f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4acd2b59f7943cbb555876b9df70bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:03:17.124890 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-a8c46d27-f034-42d3-8be0-b658bb09a22d tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "GET /compute/v2.1/servers/36bef5fa-98f8-4f14-91bd-33f97e2c9aa3" status: 200 len: 1689 microversion: 2.1 time: 0.157368 Oct 08 22:03:17.126138 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3455/6984] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:03:16 2022] GET /compute/v2.1/servers/36bef5fa-98f8-4f14-91bd-33f97e2c9aa3 => generated 1689 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:03:18.148303 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-6d52903e-e765-430b-b9f8-1bd66edcb64f tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:03:18.148952 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-6d52903e-e765-430b-b9f8-1bd66edcb64f tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: 36bef5fa-98f8-4f14-91bd-33f97e2c9aa3] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:03:18.156467 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6d52903e-e765-430b-b9f8-1bd66edcb64f tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:03:18.156988 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6d52903e-e765-430b-b9f8-1bd66edcb64f tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:03:18.157479 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6d52903e-e765-430b-b9f8-1bd66edcb64f tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:03:18.158211 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6d52903e-e765-430b-b9f8-1bd66edcb64f tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:03:18.158696 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6d52903e-e765-430b-b9f8-1bd66edcb64f tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:03:18.159152 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6d52903e-e765-430b-b9f8-1bd66edcb64f tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:03:18.288744 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-6d52903e-e765-430b-b9f8-1bd66edcb64f tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771e9bc89e9d459e9e1714de7c514f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4acd2b59f7943cbb555876b9df70bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:03:18.296968 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-6d52903e-e765-430b-b9f8-1bd66edcb64f tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "GET /compute/v2.1/servers/36bef5fa-98f8-4f14-91bd-33f97e2c9aa3" status: 200 len: 1689 microversion: 2.1 time: 0.152882 Oct 08 22:03:18.297613 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3530/6985] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:03:18 2022] GET /compute/v2.1/servers/36bef5fa-98f8-4f14-91bd-33f97e2c9aa3 => generated 1689 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:03:19.320367 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-52814b19-fddf-4064-9c83-4620a1fb2090 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:03:19.320992 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-52814b19-fddf-4064-9c83-4620a1fb2090 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: 36bef5fa-98f8-4f14-91bd-33f97e2c9aa3] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:03:19.327902 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-52814b19-fddf-4064-9c83-4620a1fb2090 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:03:19.328891 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-52814b19-fddf-4064-9c83-4620a1fb2090 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:03:19.329381 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-52814b19-fddf-4064-9c83-4620a1fb2090 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:03:19.330087 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-52814b19-fddf-4064-9c83-4620a1fb2090 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:03:19.330546 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-52814b19-fddf-4064-9c83-4620a1fb2090 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:03:19.331007 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-52814b19-fddf-4064-9c83-4620a1fb2090 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:03:19.460639 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-52814b19-fddf-4064-9c83-4620a1fb2090 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771e9bc89e9d459e9e1714de7c514f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4acd2b59f7943cbb555876b9df70bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:03:19.468505 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-52814b19-fddf-4064-9c83-4620a1fb2090 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "GET /compute/v2.1/servers/36bef5fa-98f8-4f14-91bd-33f97e2c9aa3" status: 200 len: 1689 microversion: 2.1 time: 0.152036 Oct 08 22:03:19.469731 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3456/6986] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:03:19 2022] GET /compute/v2.1/servers/36bef5fa-98f8-4f14-91bd-33f97e2c9aa3 => generated 1689 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:03:20.492763 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-cae9cbe7-2def-4913-bda4-66b3d20c75ca tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:03:20.493594 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-cae9cbe7-2def-4913-bda4-66b3d20c75ca tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: 36bef5fa-98f8-4f14-91bd-33f97e2c9aa3] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:03:20.501168 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cae9cbe7-2def-4913-bda4-66b3d20c75ca tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:03:20.501700 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cae9cbe7-2def-4913-bda4-66b3d20c75ca tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:03:20.502161 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cae9cbe7-2def-4913-bda4-66b3d20c75ca tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:03:20.502883 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cae9cbe7-2def-4913-bda4-66b3d20c75ca tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:03:20.503362 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cae9cbe7-2def-4913-bda4-66b3d20c75ca tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:03:20.503809 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cae9cbe7-2def-4913-bda4-66b3d20c75ca tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:03:20.634241 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-cae9cbe7-2def-4913-bda4-66b3d20c75ca tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771e9bc89e9d459e9e1714de7c514f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4acd2b59f7943cbb555876b9df70bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:03:20.642035 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-cae9cbe7-2def-4913-bda4-66b3d20c75ca tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "GET /compute/v2.1/servers/36bef5fa-98f8-4f14-91bd-33f97e2c9aa3" status: 200 len: 1689 microversion: 2.1 time: 0.153352 Oct 08 22:03:20.642617 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3531/6987] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:03:20 2022] GET /compute/v2.1/servers/36bef5fa-98f8-4f14-91bd-33f97e2c9aa3 => generated 1689 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:03:21.665058 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c71f74f2-ca84-4c2e-8e2e-70e8d52a8e9d tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:03:21.665724 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-c71f74f2-ca84-4c2e-8e2e-70e8d52a8e9d tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: 36bef5fa-98f8-4f14-91bd-33f97e2c9aa3] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:03:21.672830 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c71f74f2-ca84-4c2e-8e2e-70e8d52a8e9d tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:03:21.673374 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c71f74f2-ca84-4c2e-8e2e-70e8d52a8e9d tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:03:21.673828 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c71f74f2-ca84-4c2e-8e2e-70e8d52a8e9d tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:03:21.674540 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c71f74f2-ca84-4c2e-8e2e-70e8d52a8e9d tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:03:21.675009 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c71f74f2-ca84-4c2e-8e2e-70e8d52a8e9d tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:03:21.675448 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c71f74f2-ca84-4c2e-8e2e-70e8d52a8e9d tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:03:21.814284 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-c71f74f2-ca84-4c2e-8e2e-70e8d52a8e9d tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771e9bc89e9d459e9e1714de7c514f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4acd2b59f7943cbb555876b9df70bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:03:21.822352 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-c71f74f2-ca84-4c2e-8e2e-70e8d52a8e9d tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "GET /compute/v2.1/servers/36bef5fa-98f8-4f14-91bd-33f97e2c9aa3" status: 200 len: 1689 microversion: 2.1 time: 0.161262 Oct 08 22:03:21.822939 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3457/6988] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:03:21 2022] GET /compute/v2.1/servers/36bef5fa-98f8-4f14-91bd-33f97e2c9aa3 => generated 1689 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:03:22.847498 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-0dd34822-6e70-4a83-8910-9fec605fb74f tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:03:22.848131 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-0dd34822-6e70-4a83-8910-9fec605fb74f tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: 36bef5fa-98f8-4f14-91bd-33f97e2c9aa3] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:03:22.855087 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0dd34822-6e70-4a83-8910-9fec605fb74f tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:03:22.855594 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0dd34822-6e70-4a83-8910-9fec605fb74f tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:03:22.856054 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0dd34822-6e70-4a83-8910-9fec605fb74f tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:03:22.856773 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0dd34822-6e70-4a83-8910-9fec605fb74f tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:03:22.857277 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0dd34822-6e70-4a83-8910-9fec605fb74f tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:03:22.857733 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0dd34822-6e70-4a83-8910-9fec605fb74f tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:03:22.992680 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-0dd34822-6e70-4a83-8910-9fec605fb74f tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771e9bc89e9d459e9e1714de7c514f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4acd2b59f7943cbb555876b9df70bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:03:23.000543 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-0dd34822-6e70-4a83-8910-9fec605fb74f tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "GET /compute/v2.1/servers/36bef5fa-98f8-4f14-91bd-33f97e2c9aa3" status: 200 len: 1689 microversion: 2.1 time: 0.158164 Oct 08 22:03:23.001123 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3532/6989] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:03:22 2022] GET /compute/v2.1/servers/36bef5fa-98f8-4f14-91bd-33f97e2c9aa3 => generated 1689 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:03:24.024125 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-79177040-577a-4126-879d-8fcb17776a66 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:03:24.024705 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-79177040-577a-4126-879d-8fcb17776a66 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: 36bef5fa-98f8-4f14-91bd-33f97e2c9aa3] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:03:24.032261 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-79177040-577a-4126-879d-8fcb17776a66 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:03:24.032758 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-79177040-577a-4126-879d-8fcb17776a66 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:03:24.033221 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-79177040-577a-4126-879d-8fcb17776a66 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:03:24.033938 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-79177040-577a-4126-879d-8fcb17776a66 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:03:24.034403 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-79177040-577a-4126-879d-8fcb17776a66 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:03:24.034843 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-79177040-577a-4126-879d-8fcb17776a66 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:03:24.164140 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-79177040-577a-4126-879d-8fcb17776a66 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771e9bc89e9d459e9e1714de7c514f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4acd2b59f7943cbb555876b9df70bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:03:24.172712 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-79177040-577a-4126-879d-8fcb17776a66 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "GET /compute/v2.1/servers/36bef5fa-98f8-4f14-91bd-33f97e2c9aa3" status: 200 len: 1689 microversion: 2.1 time: 0.152026 Oct 08 22:03:24.173320 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3458/6990] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:03:24 2022] GET /compute/v2.1/servers/36bef5fa-98f8-4f14-91bd-33f97e2c9aa3 => generated 1689 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:03:25.196096 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-c3e9f3f6-1841-4b48-8596-0378f52325a7 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:03:25.196774 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-c3e9f3f6-1841-4b48-8596-0378f52325a7 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: 36bef5fa-98f8-4f14-91bd-33f97e2c9aa3] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:03:25.204484 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c3e9f3f6-1841-4b48-8596-0378f52325a7 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:03:25.205015 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c3e9f3f6-1841-4b48-8596-0378f52325a7 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:03:25.205510 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c3e9f3f6-1841-4b48-8596-0378f52325a7 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:03:25.206229 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c3e9f3f6-1841-4b48-8596-0378f52325a7 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:03:25.206714 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c3e9f3f6-1841-4b48-8596-0378f52325a7 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:03:25.207203 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c3e9f3f6-1841-4b48-8596-0378f52325a7 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:03:25.339785 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-c3e9f3f6-1841-4b48-8596-0378f52325a7 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771e9bc89e9d459e9e1714de7c514f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4acd2b59f7943cbb555876b9df70bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:03:25.348345 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-c3e9f3f6-1841-4b48-8596-0378f52325a7 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "GET /compute/v2.1/servers/36bef5fa-98f8-4f14-91bd-33f97e2c9aa3" status: 200 len: 1666 microversion: 2.1 time: 0.156230 Oct 08 22:03:25.348926 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3533/6991] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:03:25 2022] GET /compute/v2.1/servers/36bef5fa-98f8-4f14-91bd-33f97e2c9aa3 => generated 1666 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 22:03:26.444357 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-68bb6a45-c454-49fe-bf58-5b98987e7917 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 22:03:26.446783 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-68bb6a45-c454-49fe-bf58-5b98987e7917 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: 36bef5fa-98f8-4f14-91bd-33f97e2c9aa3] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:03:26.453779 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-68bb6a45-c454-49fe-bf58-5b98987e7917 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:03:26.454275 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-68bb6a45-c454-49fe-bf58-5b98987e7917 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:03:26.454729 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-68bb6a45-c454-49fe-bf58-5b98987e7917 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:03:26.455447 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-68bb6a45-c454-49fe-bf58-5b98987e7917 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:03:26.455915 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-68bb6a45-c454-49fe-bf58-5b98987e7917 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:03:26.456356 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-68bb6a45-c454-49fe-bf58-5b98987e7917 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:03:26.507635 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-68bb6a45-c454-49fe-bf58-5b98987e7917 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "POST /compute/v2.1/servers/36bef5fa-98f8-4f14-91bd-33f97e2c9aa3/action" status: 200 len: 38383 microversion: 2.1 time: 0.067062 Oct 08 22:03:26.508303 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3459/6992] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 22:03:26 2022] POST /compute/v2.1/servers/36bef5fa-98f8-4f14-91bd-33f97e2c9aa3/action => generated 38383 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 08 22:03:26.520187 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-676e5ec4-8304-43d4-81fd-46d4e65b5f92 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 22:03:26.527461 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-676e5ec4-8304-43d4-81fd-46d4e65b5f92 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:03:26.527970 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-676e5ec4-8304-43d4-81fd-46d4e65b5f92 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:03:26.528432 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-676e5ec4-8304-43d4-81fd-46d4e65b5f92 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:03:26.551546 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-676e5ec4-8304-43d4-81fd-46d4e65b5f92 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: 36bef5fa-98f8-4f14-91bd-33f97e2c9aa3] Going to try to start instance {{(pid=140492) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 08 22:03:26.598907 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-676e5ec4-8304-43d4-81fd-46d4e65b5f92 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "POST /compute/v2.1/servers/36bef5fa-98f8-4f14-91bd-33f97e2c9aa3/action" status: 202 len: 0 microversion: 2.1 time: 0.082350 Oct 08 22:03:26.599718 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3534/6993] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 22:03:26 2022] POST /compute/v2.1/servers/36bef5fa-98f8-4f14-91bd-33f97e2c9aa3/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 22:03:26.614602 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-9812634f-3edb-4273-b555-da2d2d74b044 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:03:26.615562 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-9812634f-3edb-4273-b555-da2d2d74b044 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: 36bef5fa-98f8-4f14-91bd-33f97e2c9aa3] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:03:26.623014 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9812634f-3edb-4273-b555-da2d2d74b044 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:03:26.623588 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9812634f-3edb-4273-b555-da2d2d74b044 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:03:26.624110 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9812634f-3edb-4273-b555-da2d2d74b044 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:03:26.624920 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9812634f-3edb-4273-b555-da2d2d74b044 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:03:26.625512 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9812634f-3edb-4273-b555-da2d2d74b044 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:03:26.626018 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9812634f-3edb-4273-b555-da2d2d74b044 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:03:26.764331 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-9812634f-3edb-4273-b555-da2d2d74b044 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771e9bc89e9d459e9e1714de7c514f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4acd2b59f7943cbb555876b9df70bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:03:26.772828 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-9812634f-3edb-4273-b555-da2d2d74b044 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "GET /compute/v2.1/servers/36bef5fa-98f8-4f14-91bd-33f97e2c9aa3" status: 200 len: 1675 microversion: 2.1 time: 0.163378 Oct 08 22:03:26.773418 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3460/6994] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:03:26 2022] GET /compute/v2.1/servers/36bef5fa-98f8-4f14-91bd-33f97e2c9aa3 => generated 1675 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:03:27.797569 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-3e0cc636-58ab-470c-baa2-cc39b46ff2b6 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:03:27.798852 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-3e0cc636-58ab-470c-baa2-cc39b46ff2b6 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: 36bef5fa-98f8-4f14-91bd-33f97e2c9aa3] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:03:27.805890 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3e0cc636-58ab-470c-baa2-cc39b46ff2b6 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:03:27.806396 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3e0cc636-58ab-470c-baa2-cc39b46ff2b6 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:03:27.806872 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3e0cc636-58ab-470c-baa2-cc39b46ff2b6 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:03:27.807572 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3e0cc636-58ab-470c-baa2-cc39b46ff2b6 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:03:27.808048 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3e0cc636-58ab-470c-baa2-cc39b46ff2b6 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:03:27.808499 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3e0cc636-58ab-470c-baa2-cc39b46ff2b6 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:03:27.944310 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-3e0cc636-58ab-470c-baa2-cc39b46ff2b6 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771e9bc89e9d459e9e1714de7c514f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4acd2b59f7943cbb555876b9df70bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:03:27.952217 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-3e0cc636-58ab-470c-baa2-cc39b46ff2b6 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "GET /compute/v2.1/servers/36bef5fa-98f8-4f14-91bd-33f97e2c9aa3" status: 200 len: 1679 microversion: 2.1 time: 0.159040 Oct 08 22:03:27.952804 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3535/6995] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:03:27 2022] GET /compute/v2.1/servers/36bef5fa-98f8-4f14-91bd-33f97e2c9aa3 => generated 1679 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:03:52.141563 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-7aa2af44-2266-4574-87e4-40f78337231e tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 22:03:52.143856 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-7aa2af44-2266-4574-87e4-40f78337231e tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: 36bef5fa-98f8-4f14-91bd-33f97e2c9aa3] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:03:52.147171 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:SELECT=18 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 22:03:52.147836 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=52 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 22:03:52.154301 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7aa2af44-2266-4574-87e4-40f78337231e tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:03:52.154799 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7aa2af44-2266-4574-87e4-40f78337231e tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:03:52.155249 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7aa2af44-2266-4574-87e4-40f78337231e tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:03:52.155956 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7aa2af44-2266-4574-87e4-40f78337231e tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:03:52.156419 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7aa2af44-2266-4574-87e4-40f78337231e tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:03:52.156852 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7aa2af44-2266-4574-87e4-40f78337231e tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:03:52.211450 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-7aa2af44-2266-4574-87e4-40f78337231e tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "POST /compute/v2.1/servers/36bef5fa-98f8-4f14-91bd-33f97e2c9aa3/action" status: 200 len: 62944 microversion: 2.1 time: 0.073722 Oct 08 22:03:52.212121 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3461/6996] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 22:03:52 2022] POST /compute/v2.1/servers/36bef5fa-98f8-4f14-91bd-33f97e2c9aa3/action => generated 62944 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 08 22:03:59.296034 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-8450eb59-70f6-41ad-8c96-933f2b5298c2 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:03:59.297110 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-8450eb59-70f6-41ad-8c96-933f2b5298c2 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: 36bef5fa-98f8-4f14-91bd-33f97e2c9aa3] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:03:59.298586 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-14d976c0-a831-4a3d-8d43-3c17d549215b req-59fe78fa-76fe-401b-84c6-44af3be39a31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36bef5fa-98f8-4f14-91bd-33f97e2c9aa3", "tag": "041ab328-b26e-4a0a-bc94-b5c8db7aa396"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 22:03:59.300959 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=20 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 22:03:59.302896 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 22:03:59.306773 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8450eb59-70f6-41ad-8c96-933f2b5298c2 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:03:59.307542 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8450eb59-70f6-41ad-8c96-933f2b5298c2 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:03:59.308236 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8450eb59-70f6-41ad-8c96-933f2b5298c2 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:03:59.309307 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8450eb59-70f6-41ad-8c96-933f2b5298c2 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:03:59.310134 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8450eb59-70f6-41ad-8c96-933f2b5298c2 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:03:59.310845 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8450eb59-70f6-41ad-8c96-933f2b5298c2 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:03:59.313398 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-14d976c0-a831-4a3d-8d43-3c17d549215b req-59fe78fa-76fe-401b-84c6-44af3be39a31 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:03:59.313959 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-14d976c0-a831-4a3d-8d43-3c17d549215b req-59fe78fa-76fe-401b-84c6-44af3be39a31 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:03:59.314395 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-14d976c0-a831-4a3d-8d43-3c17d549215b req-59fe78fa-76fe-401b-84c6-44af3be39a31 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:03:59.327232 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-14d976c0-a831-4a3d-8d43-3c17d549215b req-59fe78fa-76fe-401b-84c6-44af3be39a31 service nova] Creating event network-changed:041ab328-b26e-4a0a-bc94-b5c8db7aa396 for instance 36bef5fa-98f8-4f14-91bd-33f97e2c9aa3 on nch2-master-1 Oct 08 22:03:59.333427 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-14d976c0-a831-4a3d-8d43-3c17d549215b req-59fe78fa-76fe-401b-84c6-44af3be39a31 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039314 Oct 08 22:03:59.338218 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3462/6997] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 22:03:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 22:03:59.341544 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-8450eb59-70f6-41ad-8c96-933f2b5298c2 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: 36bef5fa-98f8-4f14-91bd-33f97e2c9aa3] Going to try to terminate instance {{(pid=140492) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 22:03:59.428822 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-8450eb59-70f6-41ad-8c96-933f2b5298c2 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "DELETE /compute/v2.1/servers/36bef5fa-98f8-4f14-91bd-33f97e2c9aa3" status: 204 len: 0 microversion: 2.1 time: 0.136804 Oct 08 22:03:59.429801 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3536/6998] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 22:03:59 2022] DELETE /compute/v2.1/servers/36bef5fa-98f8-4f14-91bd-33f97e2c9aa3 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 22:03:59.439672 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-01d78117-22c7-4bca-8499-b02062c4682e tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:03:59.440395 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-01d78117-22c7-4bca-8499-b02062c4682e tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: 36bef5fa-98f8-4f14-91bd-33f97e2c9aa3] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:03:59.447115 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-01d78117-22c7-4bca-8499-b02062c4682e tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:03:59.447933 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-01d78117-22c7-4bca-8499-b02062c4682e tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:03:59.448423 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-01d78117-22c7-4bca-8499-b02062c4682e tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:03:59.449152 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-01d78117-22c7-4bca-8499-b02062c4682e tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:03:59.449665 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-01d78117-22c7-4bca-8499-b02062c4682e tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:03:59.450096 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-01d78117-22c7-4bca-8499-b02062c4682e tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:03:59.595642 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-01d78117-22c7-4bca-8499-b02062c4682e tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771e9bc89e9d459e9e1714de7c514f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4acd2b59f7943cbb555876b9df70bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:03:59.603688 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-01d78117-22c7-4bca-8499-b02062c4682e tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "GET /compute/v2.1/servers/36bef5fa-98f8-4f14-91bd-33f97e2c9aa3" status: 200 len: 1685 microversion: 2.1 time: 0.169059 Oct 08 22:03:59.604274 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3463/6999] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:03:59 2022] GET /compute/v2.1/servers/36bef5fa-98f8-4f14-91bd-33f97e2c9aa3 => generated 1685 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 22:04:00.628684 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-52cdfb02-4579-4509-b8d6-06ca2ba512a9 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:04:00.629368 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-52cdfb02-4579-4509-b8d6-06ca2ba512a9 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: 36bef5fa-98f8-4f14-91bd-33f97e2c9aa3] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:04:00.636587 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-52cdfb02-4579-4509-b8d6-06ca2ba512a9 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:04:00.637098 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-52cdfb02-4579-4509-b8d6-06ca2ba512a9 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:04:00.637591 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-52cdfb02-4579-4509-b8d6-06ca2ba512a9 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:04:00.638323 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-52cdfb02-4579-4509-b8d6-06ca2ba512a9 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:04:00.638804 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-52cdfb02-4579-4509-b8d6-06ca2ba512a9 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:04:00.639255 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-52cdfb02-4579-4509-b8d6-06ca2ba512a9 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:04:00.836220 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-52cdfb02-4579-4509-b8d6-06ca2ba512a9 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771e9bc89e9d459e9e1714de7c514f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4acd2b59f7943cbb555876b9df70bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:04:00.844958 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-52cdfb02-4579-4509-b8d6-06ca2ba512a9 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "GET /compute/v2.1/servers/36bef5fa-98f8-4f14-91bd-33f97e2c9aa3" status: 200 len: 1685 microversion: 2.1 time: 0.220580 Oct 08 22:04:00.845553 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3537/7000] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:04:00 2022] GET /compute/v2.1/servers/36bef5fa-98f8-4f14-91bd-33f97e2c9aa3 => generated 1685 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:04:01.811338 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-491b3956-86ec-44c9-b9b4-32b3c1a20642 req-ff9852b5-7422-4f51-be53-7d67ba128892 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36bef5fa-98f8-4f14-91bd-33f97e2c9aa3", "name": "network-vif-deleted", "tag": "041ab328-b26e-4a0a-bc94-b5c8db7aa396"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 22:04:01.823602 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-491b3956-86ec-44c9-b9b4-32b3c1a20642 req-ff9852b5-7422-4f51-be53-7d67ba128892 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:04:01.824177 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-491b3956-86ec-44c9-b9b4-32b3c1a20642 req-ff9852b5-7422-4f51-be53-7d67ba128892 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:04:01.824692 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-491b3956-86ec-44c9-b9b4-32b3c1a20642 req-ff9852b5-7422-4f51-be53-7d67ba128892 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:04:01.836356 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-491b3956-86ec-44c9-b9b4-32b3c1a20642 req-ff9852b5-7422-4f51-be53-7d67ba128892 service nova] Creating event network-vif-deleted:041ab328-b26e-4a0a-bc94-b5c8db7aa396 for instance 36bef5fa-98f8-4f14-91bd-33f97e2c9aa3 on nch2-master-1 Oct 08 22:04:01.841115 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-491b3956-86ec-44c9-b9b4-32b3c1a20642 req-ff9852b5-7422-4f51-be53-7d67ba128892 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034648 Oct 08 22:04:01.841760 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3464/7001] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 22:04:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 22:04:01.869904 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-bd3aff73-82b5-43a5-8333-90fd6bd2bcbe tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:04:01.870734 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-bd3aff73-82b5-43a5-8333-90fd6bd2bcbe tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: 36bef5fa-98f8-4f14-91bd-33f97e2c9aa3] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:04:01.878553 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bd3aff73-82b5-43a5-8333-90fd6bd2bcbe tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:04:01.879428 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bd3aff73-82b5-43a5-8333-90fd6bd2bcbe tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:04:01.880750 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bd3aff73-82b5-43a5-8333-90fd6bd2bcbe tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:04:01.881586 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bd3aff73-82b5-43a5-8333-90fd6bd2bcbe tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:04:01.882065 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bd3aff73-82b5-43a5-8333-90fd6bd2bcbe tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:04:01.882516 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bd3aff73-82b5-43a5-8333-90fd6bd2bcbe tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:04:01.915173 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bd3aff73-82b5-43a5-8333-90fd6bd2bcbe tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:04:01.915679 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bd3aff73-82b5-43a5-8333-90fd6bd2bcbe tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:04:01.916136 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bd3aff73-82b5-43a5-8333-90fd6bd2bcbe tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:04:01.916608 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.objects.instance [None req-bd3aff73-82b5-43a5-8333-90fd6bd2bcbe tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lazy-loading 'fault' on Instance uuid 36bef5fa-98f8-4f14-91bd-33f97e2c9aa3 {{(pid=140492) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 22:04:01.959429 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-bd3aff73-82b5-43a5-8333-90fd6bd2bcbe tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771e9bc89e9d459e9e1714de7c514f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4acd2b59f7943cbb555876b9df70bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:04:01.967389 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-bd3aff73-82b5-43a5-8333-90fd6bd2bcbe tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "GET /compute/v2.1/servers/36bef5fa-98f8-4f14-91bd-33f97e2c9aa3" status: 200 len: 1354 microversion: 2.1 time: 0.101365 Oct 08 22:04:01.967976 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3538/7002] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:04:01 2022] GET /compute/v2.1/servers/36bef5fa-98f8-4f14-91bd-33f97e2c9aa3 => generated 1354 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:04:02.992137 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-87117dbf-7a05-45a7-bf12-8b8ecf9215e2 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:04:02.992879 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-87117dbf-7a05-45a7-bf12-8b8ecf9215e2 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: 36bef5fa-98f8-4f14-91bd-33f97e2c9aa3] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:04:02.999276 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-87117dbf-7a05-45a7-bf12-8b8ecf9215e2 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:04:02.999783 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-87117dbf-7a05-45a7-bf12-8b8ecf9215e2 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:04:03.000237 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-87117dbf-7a05-45a7-bf12-8b8ecf9215e2 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:04:03.000950 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-87117dbf-7a05-45a7-bf12-8b8ecf9215e2 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:04:03.001453 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-87117dbf-7a05-45a7-bf12-8b8ecf9215e2 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:04:03.001897 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-87117dbf-7a05-45a7-bf12-8b8ecf9215e2 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:04:03.015968 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-87117dbf-7a05-45a7-bf12-8b8ecf9215e2 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] HTTP exception thrown: Instance 36bef5fa-98f8-4f14-91bd-33f97e2c9aa3 could not be found. Oct 08 22:04:03.017644 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-87117dbf-7a05-45a7-bf12-8b8ecf9215e2 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Request method failure captured: Oct 08 22:04:03.017644 ncdv-master-1 devstack@n-api.service[140491]: request: GET /compute/v2.1/servers/36bef5fa-98f8-4f14-91bd-33f97e2c9aa3 HTTP/1.1 Oct 08 22:04:03.017644 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 22:04:03.017644 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 22:04:03.017644 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 22:04:03.017644 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 22:04:03.017644 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 22:04:03.017644 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 22:04:03.017644 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 22:04:03.017644 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 22:04:03.017644 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQfJQuuM4QaRSXOpK2YhyslcxnkJ03o0TeYKo-1sghAmNBGzTEmttugknoEotMcyK5hDZNRRFN5h_g-OLCqYD0f2cwEDT-h9hsKxYJXhTkmbUu76pLNz3djjSXZaSj_lX8tX8qa-8wLl1CIxv5sl6Y_9B2OxGfOgq2QPxELxT30_sgQc Oct 08 22:04:03.017644 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 22:04:03.017644 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 22:04:03.017644 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 22:04:03.017644 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 22:04:03.017644 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 22:04:03.017644 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 22:04:03.017644 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: b4acd2b59f7943cbb555876b9df70bee Oct 08 22:04:03.017644 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-2097292340 Oct 08 22:04:03.017644 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 22:04:03.017644 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 22:04:03.017644 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b4acd2b59f7943cbb555876b9df70bee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b4acd2b59f7943cbb555876b9df70bee"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b4acd2b59f7943cbb555876b9df70bee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b4acd2b59f7943cbb555876b9df70bee"}]}] Oct 08 22:04:03.017644 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-TestNetworkAdvancedServerOps-2097292340 Oct 08 22:04:03.017644 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: b4acd2b59f7943cbb555876b9df70bee Oct 08 22:04:03.017644 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-2097292340 Oct 08 22:04:03.017644 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-TestNetworkAdvancedServerOps-2097292340-project Oct 08 22:04:03.017644 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 22:04:03.017644 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 22:04:03.017644 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 771e9bc89e9d459e9e1714de7c514f4f Oct 08 22:04:03.017644 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-TestNetworkAdvancedServerOps-2097292340-project Oct 08 22:04:03.017644 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 22:04:03.017644 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance 36bef5fa-98f8-4f14-91bd-33f97e2c9aa3 could not be found. Oct 08 22:04:03.017644 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': '36bef5fa-98f8-4f14-91bd-33f97e2c9aa3'} Oct 08 22:04:03.017644 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 22:04:03.017644 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 22:04:03.017644 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 22:04:03.017644 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 22:04:03.017644 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 22:04:03.017644 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 22:04:03.017644 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 22:04:03.017644 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 22:04:03.017644 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 22:04:03.017644 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 22:04:03.017644 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36bef5fa-98f8-4f14-91bd-33f97e2c9aa3 could not be found. Oct 08 22:04:03.017644 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 22:04:03.017644 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 22:04:03.017644 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 22:04:03.017644 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 22:04:03.017644 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 22:04:03.017644 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 22:04:03.017644 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 22:04:03.017644 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 22:04:03.017644 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 22:04:03.017644 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 22:04:03.017644 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 22:04:03.017644 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 22:04:03.017644 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 22:04:03.017644 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 22:04:03.017644 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 22:04:03.017644 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 22:04:03.017644 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36bef5fa-98f8-4f14-91bd-33f97e2c9aa3 could not be found. Oct 08 22:04:03.017644 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 22:04:03.017644 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 22:04:03.023967 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 22:04:03.023967 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 22:04:03.023967 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 22:04:03.023967 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 22:04:03.023967 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 22:04:03.023967 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 22:04:03.023967 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36bef5fa-98f8-4f14-91bd-33f97e2c9aa3 could not be found. Oct 08 22:04:03.023967 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 22:04:03.023967 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-87117dbf-7a05-45a7-bf12-8b8ecf9215e2 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Returning 404 to user: Instance 36bef5fa-98f8-4f14-91bd-33f97e2c9aa3 could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 22:04:03.023967 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-87117dbf-7a05-45a7-bf12-8b8ecf9215e2 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "GET /compute/v2.1/servers/36bef5fa-98f8-4f14-91bd-33f97e2c9aa3" status: 404 len: 111 microversion: 2.1 time: 0.032267 Oct 08 22:04:03.023967 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3465/7003] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:04:02 2022] GET /compute/v2.1/servers/36bef5fa-98f8-4f14-91bd-33f97e2c9aa3 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 22:04:06.240223 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-687500bb-b580-43f6-a94a-64db1fd6a403 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Calling method '.version_select at 0x7f1a87cef3a0>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:04:06.269671 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-687500bb-b580-43f6-a94a-64db1fd6a403 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-295491416" status: 202 len: 0 microversion: 2.1 time: 0.033998 Oct 08 22:04:06.270920 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3539/7004] 10.222.0.26 () {58 vars in 1281 bytes} [Sat Oct 8 22:04:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-295491416 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 22:04:06.303606 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-3c586ec4-89df-4c85-95e5-984ec462edc4 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Action: 'create', calling method: .version_select at 0x7f1a877def70>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-664303166", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJVB8Dd9MjtosbByetEd+3g43SqowaEbFGAXqAExrI85rI0DOAUorVpv2Rja/CgJBW5wQQyQ4s99xkWBVQKrOoNUQ8CY6vkBY69mNMiMvk7CSxYk8KrVBuwvxKj4UqlTtg=="}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 22:04:06.321546 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-3c586ec4-89df-4c85-95e5-984ec462edc4 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Getting quotas for project b4acd2b59f7943cbb555876b9df70bee. Resources: {'key_pairs'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 22:04:06.327001 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-3c586ec4-89df-4c85-95e5-984ec462edc4 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Getting quotas for user 771e9bc89e9d459e9e1714de7c514f4f and project b4acd2b59f7943cbb555876b9df70bee. Resources: {'key_pairs'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 22:04:06.351397 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-3c586ec4-89df-4c85-95e5-984ec462edc4 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.052106 Oct 08 22:04:06.352016 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3466/7005] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Oct 8 22:04:06 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 22:04:12.275505 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 22:04:12.281105 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-460a0bf2-e857-42c1-a61f-58318b414d35 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-452148258", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "networks": [{"uuid": "b653f697-035e-4825-a05f-845e4376541b"}], "key_name": "tempest-TestNetworkAdvancedServerOps-664303166", "security_groups": [{"name": "tempest-secgroup-smoke-1755537442"}]}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 22:04:12.402623 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.network.neutron [None req-460a0bf2-e857-42c1-a61f-58318b414d35 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] validate_networks() for [('b653f697-035e-4825-a05f-845e4376541b', None, None, None, None, None)] {{(pid=140492) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 22:04:12.805939 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-460a0bf2-e857-42c1-a61f-58318b414d35 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Flavor limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 22:04:12.806509 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-460a0bf2-e857-42c1-a61f-58318b414d35 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Image limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 22:04:12.807163 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-460a0bf2-e857-42c1-a61f-58318b414d35 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Flavor pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 22:04:12.807675 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-460a0bf2-e857-42c1-a61f-58318b414d35 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Image pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 22:04:12.808193 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-460a0bf2-e857-42c1-a61f-58318b414d35 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 22:04:12.817864 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-460a0bf2-e857-42c1-a61f-58318b414d35 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:04:12.818519 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-460a0bf2-e857-42c1-a61f-58318b414d35 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:04:12.819203 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-460a0bf2-e857-42c1-a61f-58318b414d35 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:04:12.820258 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-460a0bf2-e857-42c1-a61f-58318b414d35 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:04:12.820827 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-460a0bf2-e857-42c1-a61f-58318b414d35 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:04:12.821389 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-460a0bf2-e857-42c1-a61f-58318b414d35 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:04:12.840715 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-460a0bf2-e857-42c1-a61f-58318b414d35 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Getting quotas for project b4acd2b59f7943cbb555876b9df70bee. Resources: {'cores', 'instances', 'ram'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 22:04:12.846668 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-460a0bf2-e857-42c1-a61f-58318b414d35 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Getting quotas for user 771e9bc89e9d459e9e1714de7c514f4f and project b4acd2b59f7943cbb555876b9df70bee. Resources: {'cores', 'instances', 'ram'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 22:04:12.860722 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-460a0bf2-e857-42c1-a61f-58318b414d35 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Going to run 1 instances... {{(pid=140492) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 22:04:12.863141 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-460a0bf2-e857-42c1-a61f-58318b414d35 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: 313d1925-a0d4-4ee6-b578-85ca55e96872] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c508bd7f-7db9-4b2c-af7c-be54a855c355',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140492) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 22:04:12.911109 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-460a0bf2-e857-42c1-a61f-58318b414d35 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.636970 Oct 08 22:04:12.912478 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3540/7006] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 22:04:12 2022] POST /compute/v2.1/servers => generated 406 bytes in 639 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 08 22:04:12.923631 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-349d81cd-9abf-499e-8da9-0567bc7410fe tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:04:12.924442 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-349d81cd-9abf-499e-8da9-0567bc7410fe tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: 313d1925-a0d4-4ee6-b578-85ca55e96872] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:04:12.996193 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-349d81cd-9abf-499e-8da9-0567bc7410fe tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771e9bc89e9d459e9e1714de7c514f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4acd2b59f7943cbb555876b9df70bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:04:13.007023 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-349d81cd-9abf-499e-8da9-0567bc7410fe tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "GET /compute/v2.1/servers/313d1925-a0d4-4ee6-b578-85ca55e96872" status: 200 len: 1265 microversion: 2.1 time: 0.086219 Oct 08 22:04:13.021366 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3467/7007] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:04:12 2022] GET /compute/v2.1/servers/313d1925-a0d4-4ee6-b578-85ca55e96872 => generated 1265 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:04:14.034436 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-deb751eb-61bf-4eb7-adb8-eae2cc709dd2 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:04:14.035964 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-deb751eb-61bf-4eb7-adb8-eae2cc709dd2 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: 313d1925-a0d4-4ee6-b578-85ca55e96872] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:04:14.043416 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-deb751eb-61bf-4eb7-adb8-eae2cc709dd2 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:04:14.044286 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-deb751eb-61bf-4eb7-adb8-eae2cc709dd2 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:04:14.044990 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-deb751eb-61bf-4eb7-adb8-eae2cc709dd2 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:04:14.046006 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-deb751eb-61bf-4eb7-adb8-eae2cc709dd2 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:04:14.046729 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-deb751eb-61bf-4eb7-adb8-eae2cc709dd2 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:04:14.047402 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-deb751eb-61bf-4eb7-adb8-eae2cc709dd2 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:04:14.143645 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-deb751eb-61bf-4eb7-adb8-eae2cc709dd2 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771e9bc89e9d459e9e1714de7c514f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4acd2b59f7943cbb555876b9df70bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:04:14.152971 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-deb751eb-61bf-4eb7-adb8-eae2cc709dd2 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "GET /compute/v2.1/servers/313d1925-a0d4-4ee6-b578-85ca55e96872" status: 200 len: 1325 microversion: 2.1 time: 0.123344 Oct 08 22:04:14.172087 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3541/7008] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:04:14 2022] GET /compute/v2.1/servers/313d1925-a0d4-4ee6-b578-85ca55e96872 => generated 1325 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:04:15.178572 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-a1caf7b3-993b-4ffd-a2f2-c9f88a5ed72a tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:04:15.179201 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-a1caf7b3-993b-4ffd-a2f2-c9f88a5ed72a tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: 313d1925-a0d4-4ee6-b578-85ca55e96872] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:04:15.182380 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=16 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 22:04:15.200324 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a1caf7b3-993b-4ffd-a2f2-c9f88a5ed72a tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:04:15.200845 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a1caf7b3-993b-4ffd-a2f2-c9f88a5ed72a tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:04:15.201330 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a1caf7b3-993b-4ffd-a2f2-c9f88a5ed72a tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:04:15.202070 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a1caf7b3-993b-4ffd-a2f2-c9f88a5ed72a tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:04:15.202540 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a1caf7b3-993b-4ffd-a2f2-c9f88a5ed72a tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:04:15.203036 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a1caf7b3-993b-4ffd-a2f2-c9f88a5ed72a tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:04:15.368713 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-a1caf7b3-993b-4ffd-a2f2-c9f88a5ed72a tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771e9bc89e9d459e9e1714de7c514f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4acd2b59f7943cbb555876b9df70bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:04:15.377014 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-a1caf7b3-993b-4ffd-a2f2-c9f88a5ed72a tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "GET /compute/v2.1/servers/313d1925-a0d4-4ee6-b578-85ca55e96872" status: 200 len: 1391 microversion: 2.1 time: 0.202887 Oct 08 22:04:15.377572 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3468/7009] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:04:15 2022] GET /compute/v2.1/servers/313d1925-a0d4-4ee6-b578-85ca55e96872 => generated 1391 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:04:15.687697 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-4c6f4b59-46a5-4e5f-8c0b-a7854a5fdf2e req-6e7f539a-671e-4710-990c-32c43fd6dd12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "313d1925-a0d4-4ee6-b578-85ca55e96872", "tag": "77482adc-93af-4b2d-98cd-be2026a8a5b8"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 22:04:15.699058 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-4c6f4b59-46a5-4e5f-8c0b-a7854a5fdf2e req-6e7f539a-671e-4710-990c-32c43fd6dd12 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:04:15.699567 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-4c6f4b59-46a5-4e5f-8c0b-a7854a5fdf2e req-6e7f539a-671e-4710-990c-32c43fd6dd12 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:04:15.700028 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-4c6f4b59-46a5-4e5f-8c0b-a7854a5fdf2e req-6e7f539a-671e-4710-990c-32c43fd6dd12 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:04:15.712769 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-4c6f4b59-46a5-4e5f-8c0b-a7854a5fdf2e req-6e7f539a-671e-4710-990c-32c43fd6dd12 service nova] Creating event network-changed:77482adc-93af-4b2d-98cd-be2026a8a5b8 for instance 313d1925-a0d4-4ee6-b578-85ca55e96872 on nch1-master-1 Oct 08 22:04:15.717767 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-4c6f4b59-46a5-4e5f-8c0b-a7854a5fdf2e req-6e7f539a-671e-4710-990c-32c43fd6dd12 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034132 Oct 08 22:04:15.718405 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3542/7010] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 22:04:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 22:04:16.400838 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-598a5ab1-97ad-4e86-b21f-ae68d3869bc6 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:04:16.401486 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-598a5ab1-97ad-4e86-b21f-ae68d3869bc6 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: 313d1925-a0d4-4ee6-b578-85ca55e96872] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:04:16.408488 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-598a5ab1-97ad-4e86-b21f-ae68d3869bc6 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:04:16.408985 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-598a5ab1-97ad-4e86-b21f-ae68d3869bc6 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:04:16.409460 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-598a5ab1-97ad-4e86-b21f-ae68d3869bc6 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:04:16.410177 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-598a5ab1-97ad-4e86-b21f-ae68d3869bc6 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:04:16.411132 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-598a5ab1-97ad-4e86-b21f-ae68d3869bc6 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:04:16.411569 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-598a5ab1-97ad-4e86-b21f-ae68d3869bc6 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:04:16.546563 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-598a5ab1-97ad-4e86-b21f-ae68d3869bc6 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771e9bc89e9d459e9e1714de7c514f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4acd2b59f7943cbb555876b9df70bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:04:16.555051 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-598a5ab1-97ad-4e86-b21f-ae68d3869bc6 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "GET /compute/v2.1/servers/313d1925-a0d4-4ee6-b578-85ca55e96872" status: 200 len: 1391 microversion: 2.1 time: 0.158165 Oct 08 22:04:16.555624 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3469/7011] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:04:16 2022] GET /compute/v2.1/servers/313d1925-a0d4-4ee6-b578-85ca55e96872 => generated 1391 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:04:17.579584 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-271d0663-4e10-4f94-89f6-5b4e6dc0b790 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:04:17.580305 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-271d0663-4e10-4f94-89f6-5b4e6dc0b790 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: 313d1925-a0d4-4ee6-b578-85ca55e96872] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:04:17.587123 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-271d0663-4e10-4f94-89f6-5b4e6dc0b790 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:04:17.587626 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-271d0663-4e10-4f94-89f6-5b4e6dc0b790 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:04:17.588089 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-271d0663-4e10-4f94-89f6-5b4e6dc0b790 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:04:17.588836 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-271d0663-4e10-4f94-89f6-5b4e6dc0b790 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:04:17.589352 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-271d0663-4e10-4f94-89f6-5b4e6dc0b790 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:04:17.589801 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-271d0663-4e10-4f94-89f6-5b4e6dc0b790 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:04:17.725243 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-271d0663-4e10-4f94-89f6-5b4e6dc0b790 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771e9bc89e9d459e9e1714de7c514f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4acd2b59f7943cbb555876b9df70bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:04:17.732929 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-271d0663-4e10-4f94-89f6-5b4e6dc0b790 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "GET /compute/v2.1/servers/313d1925-a0d4-4ee6-b578-85ca55e96872" status: 200 len: 1391 microversion: 2.1 time: 0.158709 Oct 08 22:04:17.733535 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3543/7012] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:04:17 2022] GET /compute/v2.1/servers/313d1925-a0d4-4ee6-b578-85ca55e96872 => generated 1391 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:04:18.755808 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-1b2bc812-5e30-45c7-8c86-4e865d6dd751 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:04:18.756427 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-1b2bc812-5e30-45c7-8c86-4e865d6dd751 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: 313d1925-a0d4-4ee6-b578-85ca55e96872] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:04:18.763367 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1b2bc812-5e30-45c7-8c86-4e865d6dd751 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:04:18.763867 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1b2bc812-5e30-45c7-8c86-4e865d6dd751 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:04:18.764326 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1b2bc812-5e30-45c7-8c86-4e865d6dd751 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:04:18.765037 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1b2bc812-5e30-45c7-8c86-4e865d6dd751 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:04:18.765539 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1b2bc812-5e30-45c7-8c86-4e865d6dd751 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:04:18.765980 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1b2bc812-5e30-45c7-8c86-4e865d6dd751 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:04:18.896325 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-1b2bc812-5e30-45c7-8c86-4e865d6dd751 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771e9bc89e9d459e9e1714de7c514f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4acd2b59f7943cbb555876b9df70bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:04:18.904247 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-1b2bc812-5e30-45c7-8c86-4e865d6dd751 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "GET /compute/v2.1/servers/313d1925-a0d4-4ee6-b578-85ca55e96872" status: 200 len: 1391 microversion: 2.1 time: 0.152526 Oct 08 22:04:18.904823 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3470/7013] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:04:18 2022] GET /compute/v2.1/servers/313d1925-a0d4-4ee6-b578-85ca55e96872 => generated 1391 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:04:19.927947 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-db229513-12a9-40a8-9cc6-5f67dde74cc4 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:04:19.928575 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-db229513-12a9-40a8-9cc6-5f67dde74cc4 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: 313d1925-a0d4-4ee6-b578-85ca55e96872] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:04:19.935845 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-db229513-12a9-40a8-9cc6-5f67dde74cc4 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:04:19.936376 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-db229513-12a9-40a8-9cc6-5f67dde74cc4 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:04:19.936823 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-db229513-12a9-40a8-9cc6-5f67dde74cc4 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:04:19.937578 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-db229513-12a9-40a8-9cc6-5f67dde74cc4 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:04:19.938059 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-db229513-12a9-40a8-9cc6-5f67dde74cc4 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:04:19.938510 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-db229513-12a9-40a8-9cc6-5f67dde74cc4 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:04:20.068911 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-db229513-12a9-40a8-9cc6-5f67dde74cc4 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771e9bc89e9d459e9e1714de7c514f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4acd2b59f7943cbb555876b9df70bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:04:20.076761 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-db229513-12a9-40a8-9cc6-5f67dde74cc4 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "GET /compute/v2.1/servers/313d1925-a0d4-4ee6-b578-85ca55e96872" status: 200 len: 1391 microversion: 2.1 time: 0.152760 Oct 08 22:04:20.077369 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3544/7014] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:04:19 2022] GET /compute/v2.1/servers/313d1925-a0d4-4ee6-b578-85ca55e96872 => generated 1391 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 22:04:21.100085 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-5ad2aadc-f8ff-43d5-82e5-542b0f3f002d tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:04:21.100718 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-5ad2aadc-f8ff-43d5-82e5-542b0f3f002d tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: 313d1925-a0d4-4ee6-b578-85ca55e96872] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:04:21.107613 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5ad2aadc-f8ff-43d5-82e5-542b0f3f002d tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:04:21.108174 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5ad2aadc-f8ff-43d5-82e5-542b0f3f002d tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:04:21.108581 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5ad2aadc-f8ff-43d5-82e5-542b0f3f002d tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:04:21.109361 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5ad2aadc-f8ff-43d5-82e5-542b0f3f002d tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:04:21.109805 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5ad2aadc-f8ff-43d5-82e5-542b0f3f002d tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:04:21.110249 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5ad2aadc-f8ff-43d5-82e5-542b0f3f002d tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:04:21.229464 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-b279d2de-d24b-48eb-ac31-41b229d29616 req-f918da28-d4d3-41da-b484-271723153aff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "313d1925-a0d4-4ee6-b578-85ca55e96872", "name": "network-vif-plugged", "status": "completed", "tag": "77482adc-93af-4b2d-98cd-be2026a8a5b8"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 22:04:21.241497 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-b279d2de-d24b-48eb-ac31-41b229d29616 req-f918da28-d4d3-41da-b484-271723153aff service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:04:21.242178 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-b279d2de-d24b-48eb-ac31-41b229d29616 req-f918da28-d4d3-41da-b484-271723153aff service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:04:21.242697 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-b279d2de-d24b-48eb-ac31-41b229d29616 req-f918da28-d4d3-41da-b484-271723153aff service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:04:21.255118 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-5ad2aadc-f8ff-43d5-82e5-542b0f3f002d tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771e9bc89e9d459e9e1714de7c514f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4acd2b59f7943cbb555876b9df70bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:04:21.255574 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-b279d2de-d24b-48eb-ac31-41b229d29616 req-f918da28-d4d3-41da-b484-271723153aff service nova] Creating event network-vif-plugged:77482adc-93af-4b2d-98cd-be2026a8a5b8 for instance 313d1925-a0d4-4ee6-b578-85ca55e96872 on nch1-master-1 Oct 08 22:04:21.261713 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-b279d2de-d24b-48eb-ac31-41b229d29616 req-f918da28-d4d3-41da-b484-271723153aff service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036524 Oct 08 22:04:21.262622 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3545/7015] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 22:04:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 08 22:04:21.263825 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-5ad2aadc-f8ff-43d5-82e5-542b0f3f002d tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "GET /compute/v2.1/servers/313d1925-a0d4-4ee6-b578-85ca55e96872" status: 200 len: 1391 microversion: 2.1 time: 0.167714 Oct 08 22:04:21.264773 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3471/7016] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:04:21 2022] GET /compute/v2.1/servers/313d1925-a0d4-4ee6-b578-85ca55e96872 => generated 1391 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 22:04:22.289289 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-99299049-9d8e-409a-8c17-217f6b0c879e tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:04:22.290042 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-99299049-9d8e-409a-8c17-217f6b0c879e tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: 313d1925-a0d4-4ee6-b578-85ca55e96872] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:04:22.296337 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-99299049-9d8e-409a-8c17-217f6b0c879e tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:04:22.296840 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-99299049-9d8e-409a-8c17-217f6b0c879e tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:04:22.297324 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-99299049-9d8e-409a-8c17-217f6b0c879e tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:04:22.298038 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-99299049-9d8e-409a-8c17-217f6b0c879e tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:04:22.298515 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-99299049-9d8e-409a-8c17-217f6b0c879e tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:04:22.298962 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-99299049-9d8e-409a-8c17-217f6b0c879e tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:04:22.430923 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-99299049-9d8e-409a-8c17-217f6b0c879e tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771e9bc89e9d459e9e1714de7c514f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4acd2b59f7943cbb555876b9df70bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:04:22.439301 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-99299049-9d8e-409a-8c17-217f6b0c879e tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "GET /compute/v2.1/servers/313d1925-a0d4-4ee6-b578-85ca55e96872" status: 200 len: 1391 microversion: 2.1 time: 0.155750 Oct 08 22:04:22.439900 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3546/7017] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:04:22 2022] GET /compute/v2.1/servers/313d1925-a0d4-4ee6-b578-85ca55e96872 => generated 1391 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:04:23.463563 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-4e9019d0-3774-4afd-bbff-039d5d7d1cff tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:04:23.464236 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-4e9019d0-3774-4afd-bbff-039d5d7d1cff tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: 313d1925-a0d4-4ee6-b578-85ca55e96872] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:04:23.466996 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=6 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 22:04:23.467662 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 22:04:23.474937 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4e9019d0-3774-4afd-bbff-039d5d7d1cff tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:04:23.475434 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4e9019d0-3774-4afd-bbff-039d5d7d1cff tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:04:23.475883 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4e9019d0-3774-4afd-bbff-039d5d7d1cff tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:04:23.476596 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4e9019d0-3774-4afd-bbff-039d5d7d1cff tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:04:23.477058 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4e9019d0-3774-4afd-bbff-039d5d7d1cff tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:04:23.477519 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4e9019d0-3774-4afd-bbff-039d5d7d1cff tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:04:23.612326 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-4e9019d0-3774-4afd-bbff-039d5d7d1cff tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771e9bc89e9d459e9e1714de7c514f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4acd2b59f7943cbb555876b9df70bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:04:23.620809 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-4e9019d0-3774-4afd-bbff-039d5d7d1cff tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "GET /compute/v2.1/servers/313d1925-a0d4-4ee6-b578-85ca55e96872" status: 200 len: 1562 microversion: 2.1 time: 0.161222 Oct 08 22:04:23.621428 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3472/7018] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:04:23 2022] GET /compute/v2.1/servers/313d1925-a0d4-4ee6-b578-85ca55e96872 => generated 1562 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:04:23.643168 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-b9678adf-4253-4f48-ba72-4911739b955f tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:04:23.643810 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-b9678adf-4253-4f48-ba72-4911739b955f tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: 313d1925-a0d4-4ee6-b578-85ca55e96872] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:04:23.645853 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=2 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 22:04:23.646541 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=6 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 22:04:23.653225 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b9678adf-4253-4f48-ba72-4911739b955f tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:04:23.653743 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b9678adf-4253-4f48-ba72-4911739b955f tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:04:23.654202 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b9678adf-4253-4f48-ba72-4911739b955f tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:04:23.655346 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b9678adf-4253-4f48-ba72-4911739b955f tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:04:23.655459 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b9678adf-4253-4f48-ba72-4911739b955f tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:04:23.655857 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b9678adf-4253-4f48-ba72-4911739b955f tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:04:23.789069 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-b9678adf-4253-4f48-ba72-4911739b955f tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771e9bc89e9d459e9e1714de7c514f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4acd2b59f7943cbb555876b9df70bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:04:23.797141 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-b9678adf-4253-4f48-ba72-4911739b955f tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "GET /compute/v2.1/servers/313d1925-a0d4-4ee6-b578-85ca55e96872" status: 200 len: 1562 microversion: 2.1 time: 0.157822 Oct 08 22:04:23.797777 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3547/7019] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:04:23 2022] GET /compute/v2.1/servers/313d1925-a0d4-4ee6-b578-85ca55e96872 => generated 1562 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:04:25.376284 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-3825ad5a-8d4a-4633-8ce2-20540a7ccf22 req-48b8a933-62ba-4093-9531-dcd2b87fda0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "313d1925-a0d4-4ee6-b578-85ca55e96872", "tag": "77482adc-93af-4b2d-98cd-be2026a8a5b8"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 22:04:25.379780 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-63b7aafa-5d11-4db7-8db9-b9d73053dbaa tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:04:25.387240 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-63b7aafa-5d11-4db7-8db9-b9d73053dbaa tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: 313d1925-a0d4-4ee6-b578-85ca55e96872] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:04:25.390360 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-3825ad5a-8d4a-4633-8ce2-20540a7ccf22 req-48b8a933-62ba-4093-9531-dcd2b87fda0d service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:04:25.390869 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-3825ad5a-8d4a-4633-8ce2-20540a7ccf22 req-48b8a933-62ba-4093-9531-dcd2b87fda0d service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:04:25.391325 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-3825ad5a-8d4a-4633-8ce2-20540a7ccf22 req-48b8a933-62ba-4093-9531-dcd2b87fda0d service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:04:25.395133 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-63b7aafa-5d11-4db7-8db9-b9d73053dbaa tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:04:25.395632 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-63b7aafa-5d11-4db7-8db9-b9d73053dbaa tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:04:25.396341 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-63b7aafa-5d11-4db7-8db9-b9d73053dbaa tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:04:25.397062 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-63b7aafa-5d11-4db7-8db9-b9d73053dbaa tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:04:25.397578 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-63b7aafa-5d11-4db7-8db9-b9d73053dbaa tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:04:25.398005 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-63b7aafa-5d11-4db7-8db9-b9d73053dbaa tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:04:25.404739 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-3825ad5a-8d4a-4633-8ce2-20540a7ccf22 req-48b8a933-62ba-4093-9531-dcd2b87fda0d service nova] Creating event network-changed:77482adc-93af-4b2d-98cd-be2026a8a5b8 for instance 313d1925-a0d4-4ee6-b578-85ca55e96872 on nch1-master-1 Oct 08 22:04:25.410017 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-3825ad5a-8d4a-4633-8ce2-20540a7ccf22 req-48b8a933-62ba-4093-9531-dcd2b87fda0d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037319 Oct 08 22:04:25.410945 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3548/7020] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 22:04:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 22:04:25.540777 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-63b7aafa-5d11-4db7-8db9-b9d73053dbaa tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771e9bc89e9d459e9e1714de7c514f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4acd2b59f7943cbb555876b9df70bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:04:25.549911 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-63b7aafa-5d11-4db7-8db9-b9d73053dbaa tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "GET /compute/v2.1/servers/313d1925-a0d4-4ee6-b578-85ca55e96872" status: 200 len: 1562 microversion: 2.1 time: 0.180555 Oct 08 22:04:25.550992 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3473/7021] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:04:25 2022] GET /compute/v2.1/servers/313d1925-a0d4-4ee6-b578-85ca55e96872 => generated 1562 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:04:48.847320 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 22:04:48.848125 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=38 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 22:04:48.853091 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-06623d6b-19f6-4554-b0e2-fc62a58beb74 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 22:04:48.855459 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-06623d6b-19f6-4554-b0e2-fc62a58beb74 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: 313d1925-a0d4-4ee6-b578-85ca55e96872] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:04:48.863471 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-06623d6b-19f6-4554-b0e2-fc62a58beb74 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:04:48.863982 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-06623d6b-19f6-4554-b0e2-fc62a58beb74 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:04:48.864451 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-06623d6b-19f6-4554-b0e2-fc62a58beb74 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:04:48.865174 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-06623d6b-19f6-4554-b0e2-fc62a58beb74 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:04:48.865685 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-06623d6b-19f6-4554-b0e2-fc62a58beb74 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:04:48.866139 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-06623d6b-19f6-4554-b0e2-fc62a58beb74 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:04:48.921662 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-06623d6b-19f6-4554-b0e2-fc62a58beb74 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "POST /compute/v2.1/servers/313d1925-a0d4-4ee6-b578-85ca55e96872/action" status: 200 len: 24531 microversion: 2.1 time: 0.076726 Oct 08 22:04:48.922321 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3549/7022] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 22:04:48 2022] POST /compute/v2.1/servers/313d1925-a0d4-4ee6-b578-85ca55e96872/action => generated 24531 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 08 22:04:59.895136 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-81fd2bb0-dfbb-472b-9b26-8cf9210aa0f2 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 22:04:59.895700 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-81fd2bb0-dfbb-472b-9b26-8cf9210aa0f2 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: 313d1925-a0d4-4ee6-b578-85ca55e96872] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:04:59.897929 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:SELECT=3 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 22:04:59.898581 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=36 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 22:04:59.905906 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-81fd2bb0-dfbb-472b-9b26-8cf9210aa0f2 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:04:59.906400 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-81fd2bb0-dfbb-472b-9b26-8cf9210aa0f2 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:04:59.906842 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-81fd2bb0-dfbb-472b-9b26-8cf9210aa0f2 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:04:59.907672 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-81fd2bb0-dfbb-472b-9b26-8cf9210aa0f2 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:04:59.908134 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-81fd2bb0-dfbb-472b-9b26-8cf9210aa0f2 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:04:59.908569 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-81fd2bb0-dfbb-472b-9b26-8cf9210aa0f2 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:04:59.931229 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.objects.instance [None req-81fd2bb0-dfbb-472b-9b26-8cf9210aa0f2 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lazy-loading 'flavor' on Instance uuid 313d1925-a0d4-4ee6-b578-85ca55e96872 {{(pid=140491) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 22:04:59.997092 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-81fd2bb0-dfbb-472b-9b26-8cf9210aa0f2 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "POST /compute/v2.1/servers/313d1925-a0d4-4ee6-b578-85ca55e96872/action" status: 202 len: 0 microversion: 2.1 time: 0.106699 Oct 08 22:04:59.997783 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3474/7023] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 22:04:59 2022] POST /compute/v2.1/servers/313d1925-a0d4-4ee6-b578-85ca55e96872/action => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 22:05:00.007162 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-26def09e-e9e2-48a3-9844-9f40b08e3776 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:05:00.007899 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-26def09e-e9e2-48a3-9844-9f40b08e3776 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: 313d1925-a0d4-4ee6-b578-85ca55e96872] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:05:00.011421 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=4 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 22:05:00.012215 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=2 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 22:05:00.020993 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-26def09e-e9e2-48a3-9844-9f40b08e3776 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:05:00.021536 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-26def09e-e9e2-48a3-9844-9f40b08e3776 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:05:00.022003 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-26def09e-e9e2-48a3-9844-9f40b08e3776 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:05:00.022738 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-26def09e-e9e2-48a3-9844-9f40b08e3776 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:05:00.023222 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-26def09e-e9e2-48a3-9844-9f40b08e3776 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:05:00.023674 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-26def09e-e9e2-48a3-9844-9f40b08e3776 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:05:00.160691 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-26def09e-e9e2-48a3-9844-9f40b08e3776 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771e9bc89e9d459e9e1714de7c514f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4acd2b59f7943cbb555876b9df70bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:05:00.168721 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-26def09e-e9e2-48a3-9844-9f40b08e3776 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "GET /compute/v2.1/servers/313d1925-a0d4-4ee6-b578-85ca55e96872" status: 200 len: 1687 microversion: 2.1 time: 0.165946 Oct 08 22:05:00.169328 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3550/7024] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:05:00 2022] GET /compute/v2.1/servers/313d1925-a0d4-4ee6-b578-85ca55e96872 => generated 1687 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:05:01.193041 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-ab848d15-d18c-4e4a-8763-b7a718301709 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:05:01.193829 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-ab848d15-d18c-4e4a-8763-b7a718301709 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: 313d1925-a0d4-4ee6-b578-85ca55e96872] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:05:01.201177 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ab848d15-d18c-4e4a-8763-b7a718301709 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:05:01.201707 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ab848d15-d18c-4e4a-8763-b7a718301709 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:05:01.202158 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ab848d15-d18c-4e4a-8763-b7a718301709 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:05:01.202863 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ab848d15-d18c-4e4a-8763-b7a718301709 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:05:01.203329 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ab848d15-d18c-4e4a-8763-b7a718301709 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:05:01.203772 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ab848d15-d18c-4e4a-8763-b7a718301709 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:05:01.334582 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-ab848d15-d18c-4e4a-8763-b7a718301709 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771e9bc89e9d459e9e1714de7c514f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4acd2b59f7943cbb555876b9df70bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:05:01.342452 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-ab848d15-d18c-4e4a-8763-b7a718301709 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "GET /compute/v2.1/servers/313d1925-a0d4-4ee6-b578-85ca55e96872" status: 200 len: 1670 microversion: 2.1 time: 0.153788 Oct 08 22:05:01.343026 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3475/7025] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:05:01 2022] GET /compute/v2.1/servers/313d1925-a0d4-4ee6-b578-85ca55e96872 => generated 1670 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:05:02.441686 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-5654c902-be9d-4e6c-93a8-2b8730646e85 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 22:05:02.443912 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-5654c902-be9d-4e6c-93a8-2b8730646e85 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: 313d1925-a0d4-4ee6-b578-85ca55e96872] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:05:02.450933 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5654c902-be9d-4e6c-93a8-2b8730646e85 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:05:02.451446 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5654c902-be9d-4e6c-93a8-2b8730646e85 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:05:02.451915 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5654c902-be9d-4e6c-93a8-2b8730646e85 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:05:02.452640 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5654c902-be9d-4e6c-93a8-2b8730646e85 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:05:02.453122 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5654c902-be9d-4e6c-93a8-2b8730646e85 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:05:02.453601 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5654c902-be9d-4e6c-93a8-2b8730646e85 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:05:02.518257 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-5654c902-be9d-4e6c-93a8-2b8730646e85 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "POST /compute/v2.1/servers/313d1925-a0d4-4ee6-b578-85ca55e96872/action" status: 200 len: 37689 microversion: 2.1 time: 0.080913 Oct 08 22:05:02.518924 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3551/7026] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 22:05:02 2022] POST /compute/v2.1/servers/313d1925-a0d4-4ee6-b578-85ca55e96872/action => generated 37689 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 08 22:05:02.530634 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-0dfd7caa-cbc0-4575-981b-bebddef53e96 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 22:05:02.531194 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-0dfd7caa-cbc0-4575-981b-bebddef53e96 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: 313d1925-a0d4-4ee6-b578-85ca55e96872] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:05:02.538342 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0dfd7caa-cbc0-4575-981b-bebddef53e96 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:05:02.538845 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0dfd7caa-cbc0-4575-981b-bebddef53e96 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:05:02.539296 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0dfd7caa-cbc0-4575-981b-bebddef53e96 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:05:02.540009 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0dfd7caa-cbc0-4575-981b-bebddef53e96 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:05:02.540480 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0dfd7caa-cbc0-4575-981b-bebddef53e96 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:05:02.540930 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0dfd7caa-cbc0-4575-981b-bebddef53e96 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:05:02.607867 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-0dfd7caa-cbc0-4575-981b-bebddef53e96 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "POST /compute/v2.1/servers/313d1925-a0d4-4ee6-b578-85ca55e96872/action" status: 202 len: 0 microversion: 2.1 time: 0.080937 Oct 08 22:05:02.608642 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3476/7027] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 22:05:02 2022] POST /compute/v2.1/servers/313d1925-a0d4-4ee6-b578-85ca55e96872/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 22:05:02.618060 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-9cbabccc-351b-4c0f-bbee-694b5c7964f5 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:05:02.618812 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-9cbabccc-351b-4c0f-bbee-694b5c7964f5 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: 313d1925-a0d4-4ee6-b578-85ca55e96872] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:05:02.627146 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9cbabccc-351b-4c0f-bbee-694b5c7964f5 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:05:02.627904 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9cbabccc-351b-4c0f-bbee-694b5c7964f5 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:05:02.628134 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9cbabccc-351b-4c0f-bbee-694b5c7964f5 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:05:02.628873 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9cbabccc-351b-4c0f-bbee-694b5c7964f5 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:05:02.629364 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9cbabccc-351b-4c0f-bbee-694b5c7964f5 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:05:02.629822 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9cbabccc-351b-4c0f-bbee-694b5c7964f5 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:05:02.859323 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-9cbabccc-351b-4c0f-bbee-694b5c7964f5 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771e9bc89e9d459e9e1714de7c514f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4acd2b59f7943cbb555876b9df70bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:05:02.867881 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-9cbabccc-351b-4c0f-bbee-694b5c7964f5 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "GET /compute/v2.1/servers/313d1925-a0d4-4ee6-b578-85ca55e96872" status: 200 len: 1676 microversion: 2.1 time: 0.254045 Oct 08 22:05:02.868465 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3552/7028] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:05:02 2022] GET /compute/v2.1/servers/313d1925-a0d4-4ee6-b578-85ca55e96872 => generated 1676 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 22:05:03.892548 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-cdc57ef0-90b1-448e-8526-1c76e0256d09 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:05:03.893178 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-cdc57ef0-90b1-448e-8526-1c76e0256d09 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: 313d1925-a0d4-4ee6-b578-85ca55e96872] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:05:03.900704 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cdc57ef0-90b1-448e-8526-1c76e0256d09 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:05:03.901215 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cdc57ef0-90b1-448e-8526-1c76e0256d09 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:05:03.901662 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cdc57ef0-90b1-448e-8526-1c76e0256d09 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:05:03.902365 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cdc57ef0-90b1-448e-8526-1c76e0256d09 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:05:03.902826 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cdc57ef0-90b1-448e-8526-1c76e0256d09 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:05:03.903261 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cdc57ef0-90b1-448e-8526-1c76e0256d09 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:05:04.039172 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-cdc57ef0-90b1-448e-8526-1c76e0256d09 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771e9bc89e9d459e9e1714de7c514f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4acd2b59f7943cbb555876b9df70bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:05:04.047075 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-cdc57ef0-90b1-448e-8526-1c76e0256d09 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "GET /compute/v2.1/servers/313d1925-a0d4-4ee6-b578-85ca55e96872" status: 200 len: 1676 microversion: 2.1 time: 0.159559 Oct 08 22:05:04.048176 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3477/7029] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:05:03 2022] GET /compute/v2.1/servers/313d1925-a0d4-4ee6-b578-85ca55e96872 => generated 1676 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:05:05.071770 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-4990e44a-79f6-42be-b24f-4fc32e37c19a tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:05:05.072414 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-4990e44a-79f6-42be-b24f-4fc32e37c19a tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: 313d1925-a0d4-4ee6-b578-85ca55e96872] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:05:05.080071 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4990e44a-79f6-42be-b24f-4fc32e37c19a tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:05:05.080583 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4990e44a-79f6-42be-b24f-4fc32e37c19a tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:05:05.081049 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4990e44a-79f6-42be-b24f-4fc32e37c19a tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:05:05.081824 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4990e44a-79f6-42be-b24f-4fc32e37c19a tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:05:05.082310 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4990e44a-79f6-42be-b24f-4fc32e37c19a tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:05:05.082763 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4990e44a-79f6-42be-b24f-4fc32e37c19a tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:05:05.216505 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-4990e44a-79f6-42be-b24f-4fc32e37c19a tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771e9bc89e9d459e9e1714de7c514f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4acd2b59f7943cbb555876b9df70bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:05:05.224518 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-4990e44a-79f6-42be-b24f-4fc32e37c19a tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "GET /compute/v2.1/servers/313d1925-a0d4-4ee6-b578-85ca55e96872" status: 200 len: 1679 microversion: 2.1 time: 0.156777 Oct 08 22:05:05.225093 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3553/7030] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:05:05 2022] GET /compute/v2.1/servers/313d1925-a0d4-4ee6-b578-85ca55e96872 => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:05:05.325888 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-4e8f42dd-e70d-4ebd-a945-58eb3127f162 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 22:05:05.328114 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-4e8f42dd-e70d-4ebd-a945-58eb3127f162 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: 313d1925-a0d4-4ee6-b578-85ca55e96872] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:05:05.335645 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4e8f42dd-e70d-4ebd-a945-58eb3127f162 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:05:05.336146 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4e8f42dd-e70d-4ebd-a945-58eb3127f162 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:05:05.336605 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4e8f42dd-e70d-4ebd-a945-58eb3127f162 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:05:05.337351 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4e8f42dd-e70d-4ebd-a945-58eb3127f162 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:05:05.337827 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4e8f42dd-e70d-4ebd-a945-58eb3127f162 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:05:05.338272 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4e8f42dd-e70d-4ebd-a945-58eb3127f162 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:05:05.382266 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-4e8f42dd-e70d-4ebd-a945-58eb3127f162 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "POST /compute/v2.1/servers/313d1925-a0d4-4ee6-b578-85ca55e96872/action" status: 200 len: 37689 microversion: 2.1 time: 0.060347 Oct 08 22:05:05.382909 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3478/7031] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 22:05:05 2022] POST /compute/v2.1/servers/313d1925-a0d4-4ee6-b578-85ca55e96872/action => generated 37689 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 08 22:05:06.700102 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-a9af9942-3915-4610-b3a4-b847ed5598f3 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:05:06.700625 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-a9af9942-3915-4610-b3a4-b847ed5598f3 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: 313d1925-a0d4-4ee6-b578-85ca55e96872] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:05:06.703012 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-d5da5237-f880-421e-b673-993431c7ebe4 req-0b7ef2c1-c91e-49de-acb5-9150797607cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "313d1925-a0d4-4ee6-b578-85ca55e96872", "tag": "77482adc-93af-4b2d-98cd-be2026a8a5b8"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 22:05:06.708991 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a9af9942-3915-4610-b3a4-b847ed5598f3 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:05:06.709621 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a9af9942-3915-4610-b3a4-b847ed5598f3 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:05:06.710365 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a9af9942-3915-4610-b3a4-b847ed5598f3 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:05:06.711343 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a9af9942-3915-4610-b3a4-b847ed5598f3 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:05:06.712027 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a9af9942-3915-4610-b3a4-b847ed5598f3 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:05:06.712487 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-a9af9942-3915-4610-b3a4-b847ed5598f3 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:05:06.715032 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-d5da5237-f880-421e-b673-993431c7ebe4 req-0b7ef2c1-c91e-49de-acb5-9150797607cd service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:05:06.715741 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-d5da5237-f880-421e-b673-993431c7ebe4 req-0b7ef2c1-c91e-49de-acb5-9150797607cd service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:05:06.716189 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-d5da5237-f880-421e-b673-993431c7ebe4 req-0b7ef2c1-c91e-49de-acb5-9150797607cd service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:05:06.728276 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-d5da5237-f880-421e-b673-993431c7ebe4 req-0b7ef2c1-c91e-49de-acb5-9150797607cd service nova] Creating event network-changed:77482adc-93af-4b2d-98cd-be2026a8a5b8 for instance 313d1925-a0d4-4ee6-b578-85ca55e96872 on nch1-master-1 Oct 08 22:05:06.733158 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-d5da5237-f880-421e-b673-993431c7ebe4 req-0b7ef2c1-c91e-49de-acb5-9150797607cd service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034258 Oct 08 22:05:06.733800 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3479/7032] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 22:05:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 22:05:06.743062 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-a9af9942-3915-4610-b3a4-b847ed5598f3 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: 313d1925-a0d4-4ee6-b578-85ca55e96872] Going to try to terminate instance {{(pid=140492) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 22:05:06.836011 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-a9af9942-3915-4610-b3a4-b847ed5598f3 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "DELETE /compute/v2.1/servers/313d1925-a0d4-4ee6-b578-85ca55e96872" status: 204 len: 0 microversion: 2.1 time: 0.139606 Oct 08 22:05:06.840045 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3554/7033] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 22:05:06 2022] DELETE /compute/v2.1/servers/313d1925-a0d4-4ee6-b578-85ca55e96872 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 22:05:06.845924 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-ba220e37-d08f-4b24-91ab-3ba159e81288 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:05:06.846642 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-ba220e37-d08f-4b24-91ab-3ba159e81288 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: 313d1925-a0d4-4ee6-b578-85ca55e96872] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:05:06.854942 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ba220e37-d08f-4b24-91ab-3ba159e81288 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:05:06.855868 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ba220e37-d08f-4b24-91ab-3ba159e81288 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:05:06.856521 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ba220e37-d08f-4b24-91ab-3ba159e81288 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:05:06.857499 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ba220e37-d08f-4b24-91ab-3ba159e81288 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:05:06.858370 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ba220e37-d08f-4b24-91ab-3ba159e81288 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:05:06.859004 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ba220e37-d08f-4b24-91ab-3ba159e81288 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:05:06.997132 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-ba220e37-d08f-4b24-91ab-3ba159e81288 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771e9bc89e9d459e9e1714de7c514f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4acd2b59f7943cbb555876b9df70bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:05:07.005653 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-ba220e37-d08f-4b24-91ab-3ba159e81288 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "GET /compute/v2.1/servers/313d1925-a0d4-4ee6-b578-85ca55e96872" status: 200 len: 1685 microversion: 2.1 time: 0.163926 Oct 08 22:05:07.006341 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3480/7034] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:05:06 2022] GET /compute/v2.1/servers/313d1925-a0d4-4ee6-b578-85ca55e96872 => generated 1685 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:05:08.029942 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-6bef0af9-cc69-4861-931a-6e93bfc80d4a tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:05:08.030699 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-6bef0af9-cc69-4861-931a-6e93bfc80d4a tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: 313d1925-a0d4-4ee6-b578-85ca55e96872] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:05:08.038186 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6bef0af9-cc69-4861-931a-6e93bfc80d4a tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:05:08.038686 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6bef0af9-cc69-4861-931a-6e93bfc80d4a tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:05:08.039148 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6bef0af9-cc69-4861-931a-6e93bfc80d4a tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:05:08.039860 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6bef0af9-cc69-4861-931a-6e93bfc80d4a tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:05:08.040367 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6bef0af9-cc69-4861-931a-6e93bfc80d4a tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:05:08.040814 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6bef0af9-cc69-4861-931a-6e93bfc80d4a tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:05:08.174764 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-6bef0af9-cc69-4861-931a-6e93bfc80d4a tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771e9bc89e9d459e9e1714de7c514f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4acd2b59f7943cbb555876b9df70bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:05:08.182554 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-6bef0af9-cc69-4861-931a-6e93bfc80d4a tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "GET /compute/v2.1/servers/313d1925-a0d4-4ee6-b578-85ca55e96872" status: 200 len: 1685 microversion: 2.1 time: 0.157017 Oct 08 22:05:08.183138 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3555/7035] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:05:08 2022] GET /compute/v2.1/servers/313d1925-a0d4-4ee6-b578-85ca55e96872 => generated 1685 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:05:09.043186 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-229dfe84-15a1-4419-b29d-1b6646cc7ae0 req-1a809caf-5ea4-4a1a-95f7-ca3e6eff2c7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "313d1925-a0d4-4ee6-b578-85ca55e96872", "name": "network-vif-deleted", "tag": "77482adc-93af-4b2d-98cd-be2026a8a5b8"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 22:05:09.054068 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-229dfe84-15a1-4419-b29d-1b6646cc7ae0 req-1a809caf-5ea4-4a1a-95f7-ca3e6eff2c7d service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:05:09.054553 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-229dfe84-15a1-4419-b29d-1b6646cc7ae0 req-1a809caf-5ea4-4a1a-95f7-ca3e6eff2c7d service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:05:09.054999 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-229dfe84-15a1-4419-b29d-1b6646cc7ae0 req-1a809caf-5ea4-4a1a-95f7-ca3e6eff2c7d service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:05:09.067392 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-229dfe84-15a1-4419-b29d-1b6646cc7ae0 req-1a809caf-5ea4-4a1a-95f7-ca3e6eff2c7d service nova] Creating event network-vif-deleted:77482adc-93af-4b2d-98cd-be2026a8a5b8 for instance 313d1925-a0d4-4ee6-b578-85ca55e96872 on nch1-master-1 Oct 08 22:05:09.072497 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-229dfe84-15a1-4419-b29d-1b6646cc7ae0 req-1a809caf-5ea4-4a1a-95f7-ca3e6eff2c7d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032987 Oct 08 22:05:09.073139 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3481/7036] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 22:05:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 22:05:09.208606 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-00f93fe4-1195-4963-9976-0baae1d2ffbc tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:05:09.209406 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-00f93fe4-1195-4963-9976-0baae1d2ffbc tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: 313d1925-a0d4-4ee6-b578-85ca55e96872] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:05:09.216316 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-00f93fe4-1195-4963-9976-0baae1d2ffbc tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:05:09.216816 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-00f93fe4-1195-4963-9976-0baae1d2ffbc tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:05:09.217316 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-00f93fe4-1195-4963-9976-0baae1d2ffbc tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:05:09.218063 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-00f93fe4-1195-4963-9976-0baae1d2ffbc tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:05:09.218510 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-00f93fe4-1195-4963-9976-0baae1d2ffbc tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:05:09.219696 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-00f93fe4-1195-4963-9976-0baae1d2ffbc tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:05:09.251796 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-00f93fe4-1195-4963-9976-0baae1d2ffbc tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:05:09.252234 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-00f93fe4-1195-4963-9976-0baae1d2ffbc tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:05:09.252730 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-00f93fe4-1195-4963-9976-0baae1d2ffbc tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:05:09.253222 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.objects.instance [None req-00f93fe4-1195-4963-9976-0baae1d2ffbc tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lazy-loading 'fault' on Instance uuid 313d1925-a0d4-4ee6-b578-85ca55e96872 {{(pid=140492) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 22:05:09.294060 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-00f93fe4-1195-4963-9976-0baae1d2ffbc tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771e9bc89e9d459e9e1714de7c514f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4acd2b59f7943cbb555876b9df70bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:05:09.302083 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-00f93fe4-1195-4963-9976-0baae1d2ffbc tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "GET /compute/v2.1/servers/313d1925-a0d4-4ee6-b578-85ca55e96872" status: 200 len: 1355 microversion: 2.1 time: 0.097376 Oct 08 22:05:09.303039 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3556/7037] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:05:09 2022] GET /compute/v2.1/servers/313d1925-a0d4-4ee6-b578-85ca55e96872 => generated 1355 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:05:10.327070 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-1c5d0dda-c887-4c4f-9d88-e7dbd5c8ca75 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:05:10.327788 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-1c5d0dda-c887-4c4f-9d88-e7dbd5c8ca75 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] [instance: 313d1925-a0d4-4ee6-b578-85ca55e96872] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:05:10.334538 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1c5d0dda-c887-4c4f-9d88-e7dbd5c8ca75 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:05:10.335037 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1c5d0dda-c887-4c4f-9d88-e7dbd5c8ca75 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:05:10.335489 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1c5d0dda-c887-4c4f-9d88-e7dbd5c8ca75 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:05:10.336207 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1c5d0dda-c887-4c4f-9d88-e7dbd5c8ca75 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:05:10.336675 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1c5d0dda-c887-4c4f-9d88-e7dbd5c8ca75 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:05:10.337110 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1c5d0dda-c887-4c4f-9d88-e7dbd5c8ca75 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:05:10.351318 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-1c5d0dda-c887-4c4f-9d88-e7dbd5c8ca75 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] HTTP exception thrown: Instance 313d1925-a0d4-4ee6-b578-85ca55e96872 could not be found. Oct 08 22:05:10.353033 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-1c5d0dda-c887-4c4f-9d88-e7dbd5c8ca75 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Request method failure captured: Oct 08 22:05:10.353033 ncdv-master-1 devstack@n-api.service[140491]: request: GET /compute/v2.1/servers/313d1925-a0d4-4ee6-b578-85ca55e96872 HTTP/1.1 Oct 08 22:05:10.353033 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 22:05:10.353033 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 22:05:10.353033 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 22:05:10.353033 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 22:05:10.353033 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 22:05:10.353033 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 22:05:10.353033 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 22:05:10.353033 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 22:05:10.353033 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQfJQuuM4QaRSXOpK2YhyslcxnkJ03o0TeYKo-1sghAmNBGzTEmttugknoEotMcyK5hDZNRRFN5h_g-OLCqYD0f2cwEDT-h9hsKxYJXhTkmbUu76pLNz3djjSXZaSj_lX8tX8qa-8wLl1CIxv5sl6Y_9B2OxGfOgq2QPxELxT30_sgQc Oct 08 22:05:10.353033 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 22:05:10.353033 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 22:05:10.353033 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 22:05:10.353033 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 22:05:10.353033 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 22:05:10.353033 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 22:05:10.353033 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: b4acd2b59f7943cbb555876b9df70bee Oct 08 22:05:10.353033 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-2097292340 Oct 08 22:05:10.353033 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 22:05:10.353033 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 22:05:10.353033 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b4acd2b59f7943cbb555876b9df70bee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b4acd2b59f7943cbb555876b9df70bee"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b4acd2b59f7943cbb555876b9df70bee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b4acd2b59f7943cbb555876b9df70bee"}]}] Oct 08 22:05:10.353033 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-TestNetworkAdvancedServerOps-2097292340 Oct 08 22:05:10.353033 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: b4acd2b59f7943cbb555876b9df70bee Oct 08 22:05:10.353033 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-2097292340 Oct 08 22:05:10.353033 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-TestNetworkAdvancedServerOps-2097292340-project Oct 08 22:05:10.353033 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 22:05:10.353033 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 22:05:10.353033 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: 771e9bc89e9d459e9e1714de7c514f4f Oct 08 22:05:10.353033 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-TestNetworkAdvancedServerOps-2097292340-project Oct 08 22:05:10.353033 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 22:05:10.353033 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance 313d1925-a0d4-4ee6-b578-85ca55e96872 could not be found. Oct 08 22:05:10.353033 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': '313d1925-a0d4-4ee6-b578-85ca55e96872'} Oct 08 22:05:10.353033 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 22:05:10.353033 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 22:05:10.353033 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 22:05:10.353033 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 22:05:10.353033 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 22:05:10.353033 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 22:05:10.353033 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 22:05:10.353033 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 22:05:10.353033 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 22:05:10.353033 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 22:05:10.353033 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 313d1925-a0d4-4ee6-b578-85ca55e96872 could not be found. Oct 08 22:05:10.353033 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 22:05:10.353033 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 22:05:10.353033 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 22:05:10.353033 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 22:05:10.353033 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 22:05:10.353033 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 22:05:10.353033 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 22:05:10.353033 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 22:05:10.353033 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 22:05:10.353033 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 22:05:10.353033 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 22:05:10.353033 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 22:05:10.353033 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 22:05:10.353033 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 22:05:10.353033 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 22:05:10.353033 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 22:05:10.353033 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 313d1925-a0d4-4ee6-b578-85ca55e96872 could not be found. Oct 08 22:05:10.353033 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 22:05:10.353033 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 22:05:10.358765 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 22:05:10.358765 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 22:05:10.358765 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 22:05:10.358765 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 22:05:10.358765 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 22:05:10.358765 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 22:05:10.358765 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 313d1925-a0d4-4ee6-b578-85ca55e96872 could not be found. Oct 08 22:05:10.358765 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 22:05:10.358765 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-1c5d0dda-c887-4c4f-9d88-e7dbd5c8ca75 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Returning 404 to user: Instance 313d1925-a0d4-4ee6-b578-85ca55e96872 could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 22:05:10.358765 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-1c5d0dda-c887-4c4f-9d88-e7dbd5c8ca75 tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "GET /compute/v2.1/servers/313d1925-a0d4-4ee6-b578-85ca55e96872" status: 404 len: 111 microversion: 2.1 time: 0.032715 Oct 08 22:05:10.358765 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3482/7038] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:05:10 2022] GET /compute/v2.1/servers/313d1925-a0d4-4ee6-b578-85ca55e96872 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 22:05:13.334236 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e260ccea-ec8d-4323-9a17-ccefd46908eb tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] Calling method '.version_select at 0x7f1a91351160>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:05:13.356339 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-e260ccea-ec8d-4323-9a17-ccefd46908eb tempest-TestNetworkAdvancedServerOps-2097292340 tempest-TestNetworkAdvancedServerOps-2097292340-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-664303166" status: 202 len: 0 microversion: 2.1 time: 0.026174 Oct 08 22:05:13.357014 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3557/7039] 10.222.0.26 () {58 vars in 1281 bytes} [Sat Oct 8 22:05:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-664303166 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 22:05:24.629225 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:SELECT=18 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 22:05:24.630639 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 22:05:24.799402 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-b814406f-56bd-4ab2-bc29-0865b47c64f3 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Action: 'create', calling method: .version_select at 0x7f1a87bde3a0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1975197219", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEa2B+czNZVt6K6yde0Qkrb8aIMDNeaSp32mE+gd9ABzRlEt8ok1k6aOz9ELCQl7rtFbCrLUgBQ1xNKD/h5a5aCVLWyTRLxVVCqSeLozXlqyx0FRGNrYDc5QA1qWWI4tAA=="}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 22:05:24.815924 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-b814406f-56bd-4ab2-bc29-0865b47c64f3 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Getting quotas for project b9c33d4041764691b1ad69f9f1abe60b. Resources: {'key_pairs'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 22:05:24.822390 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-b814406f-56bd-4ab2-bc29-0865b47c64f3 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Getting quotas for user 199e2426220e4cc4b1d37d4075e67cbc and project b9c33d4041764691b1ad69f9f1abe60b. Resources: {'key_pairs'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 22:05:24.847699 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-b814406f-56bd-4ab2-bc29-0865b47c64f3 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.224895 Oct 08 22:05:24.848315 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3483/7040] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Oct 8 22:05:24 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 22:05:25.938730 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 22:05:25.939626 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 22:05:25.944318 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-ff23005f-82a6-4780-9385-ec2fa8914b10 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-27904159", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1975197219", "security_groups": [{"name": "tempest-secgroup-smoke-1218732375"}], "networks": [{"uuid": "df7f8a7c-301f-421e-b8b5-24085e0e3103"}]}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 22:05:26.065061 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.network.neutron [None req-ff23005f-82a6-4780-9385-ec2fa8914b10 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] validate_networks() for [('df7f8a7c-301f-421e-b8b5-24085e0e3103', None, None, None, None, None)] {{(pid=140492) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 22:05:26.448708 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-ff23005f-82a6-4780-9385-ec2fa8914b10 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Flavor limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 22:05:26.449160 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-ff23005f-82a6-4780-9385-ec2fa8914b10 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Image limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 22:05:26.449681 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-ff23005f-82a6-4780-9385-ec2fa8914b10 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Flavor pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 22:05:26.450294 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-ff23005f-82a6-4780-9385-ec2fa8914b10 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Image pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 22:05:26.450764 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-ff23005f-82a6-4780-9385-ec2fa8914b10 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 22:05:26.460203 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ff23005f-82a6-4780-9385-ec2fa8914b10 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:05:26.460705 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ff23005f-82a6-4780-9385-ec2fa8914b10 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:05:26.461159 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ff23005f-82a6-4780-9385-ec2fa8914b10 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:05:26.461967 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ff23005f-82a6-4780-9385-ec2fa8914b10 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:05:26.462446 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ff23005f-82a6-4780-9385-ec2fa8914b10 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:05:26.462891 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ff23005f-82a6-4780-9385-ec2fa8914b10 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:05:26.480902 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-ff23005f-82a6-4780-9385-ec2fa8914b10 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Getting quotas for project b9c33d4041764691b1ad69f9f1abe60b. Resources: {'cores', 'instances', 'ram'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 22:05:26.485856 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-ff23005f-82a6-4780-9385-ec2fa8914b10 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Getting quotas for user 199e2426220e4cc4b1d37d4075e67cbc and project b9c33d4041764691b1ad69f9f1abe60b. Resources: {'cores', 'instances', 'ram'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 22:05:26.498763 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-ff23005f-82a6-4780-9385-ec2fa8914b10 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Going to run 1 instances... {{(pid=140492) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 22:05:26.501271 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-ff23005f-82a6-4780-9385-ec2fa8914b10 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] [instance: 236c09e2-65bd-4ef5-88b1-032329b987cf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c508bd7f-7db9-4b2c-af7c-be54a855c355',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140492) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 22:05:26.549815 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-ff23005f-82a6-4780-9385-ec2fa8914b10 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.613389 Oct 08 22:05:26.550475 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3558/7041] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 22:05:25 2022] POST /compute/v2.1/servers => generated 406 bytes in 615 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 08 22:05:26.562872 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-94826952-d545-484c-b1cb-eaea4c7c9b13 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:05:26.563493 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-94826952-d545-484c-b1cb-eaea4c7c9b13 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] [instance: 236c09e2-65bd-4ef5-88b1-032329b987cf] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:05:26.622835 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-94826952-d545-484c-b1cb-eaea4c7c9b13 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199e2426220e4cc4b1d37d4075e67cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9c33d4041764691b1ad69f9f1abe60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:05:26.632471 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-94826952-d545-484c-b1cb-eaea4c7c9b13 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] 10.222.0.26 "GET /compute/v2.1/servers/236c09e2-65bd-4ef5-88b1-032329b987cf" status: 200 len: 1245 microversion: 2.1 time: 0.074813 Oct 08 22:05:26.633048 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3484/7042] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:05:26 2022] GET /compute/v2.1/servers/236c09e2-65bd-4ef5-88b1-032329b987cf => generated 1245 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:05:27.656665 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-af6e1321-d680-43d9-9308-4dd6bb3c3ada tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:05:27.657254 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-af6e1321-d680-43d9-9308-4dd6bb3c3ada tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] [instance: 236c09e2-65bd-4ef5-88b1-032329b987cf] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:05:27.664645 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-af6e1321-d680-43d9-9308-4dd6bb3c3ada tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:05:27.665284 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-af6e1321-d680-43d9-9308-4dd6bb3c3ada tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:05:27.665850 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-af6e1321-d680-43d9-9308-4dd6bb3c3ada tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:05:27.666712 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-af6e1321-d680-43d9-9308-4dd6bb3c3ada tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:05:27.667269 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-af6e1321-d680-43d9-9308-4dd6bb3c3ada tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:05:27.667795 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-af6e1321-d680-43d9-9308-4dd6bb3c3ada tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:05:27.756966 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-af6e1321-d680-43d9-9308-4dd6bb3c3ada tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199e2426220e4cc4b1d37d4075e67cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9c33d4041764691b1ad69f9f1abe60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:05:27.768451 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-af6e1321-d680-43d9-9308-4dd6bb3c3ada tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] 10.222.0.26 "GET /compute/v2.1/servers/236c09e2-65bd-4ef5-88b1-032329b987cf" status: 200 len: 1297 microversion: 2.1 time: 0.116008 Oct 08 22:05:27.770064 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3559/7043] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:05:27 2022] GET /compute/v2.1/servers/236c09e2-65bd-4ef5-88b1-032329b987cf => generated 1297 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:05:28.793048 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-d9dd5edf-7281-4e38-90c7-1a558af45c52 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:05:28.794377 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-d9dd5edf-7281-4e38-90c7-1a558af45c52 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] [instance: 236c09e2-65bd-4ef5-88b1-032329b987cf] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:05:28.803283 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d9dd5edf-7281-4e38-90c7-1a558af45c52 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:05:28.804119 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d9dd5edf-7281-4e38-90c7-1a558af45c52 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:05:28.804923 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d9dd5edf-7281-4e38-90c7-1a558af45c52 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:05:28.805822 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d9dd5edf-7281-4e38-90c7-1a558af45c52 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:05:28.807566 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d9dd5edf-7281-4e38-90c7-1a558af45c52 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:05:28.808200 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d9dd5edf-7281-4e38-90c7-1a558af45c52 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:05:29.123747 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-d9dd5edf-7281-4e38-90c7-1a558af45c52 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199e2426220e4cc4b1d37d4075e67cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9c33d4041764691b1ad69f9f1abe60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:05:29.135904 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-d9dd5edf-7281-4e38-90c7-1a558af45c52 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] 10.222.0.26 "GET /compute/v2.1/servers/236c09e2-65bd-4ef5-88b1-032329b987cf" status: 200 len: 1371 microversion: 2.1 time: 0.347502 Oct 08 22:05:29.136604 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3485/7044] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:05:28 2022] GET /compute/v2.1/servers/236c09e2-65bd-4ef5-88b1-032329b987cf => generated 1371 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:05:29.258414 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-b7815118-4d19-4b54-8984-82d7097b4882 req-0140ae96-c0f5-43f2-b9c8-180ba81eca48 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "236c09e2-65bd-4ef5-88b1-032329b987cf", "tag": "67f2d802-80ee-4e94-be87-3ffbcfcd063d"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 22:05:29.272197 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-b7815118-4d19-4b54-8984-82d7097b4882 req-0140ae96-c0f5-43f2-b9c8-180ba81eca48 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:05:29.272711 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-b7815118-4d19-4b54-8984-82d7097b4882 req-0140ae96-c0f5-43f2-b9c8-180ba81eca48 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:05:29.273173 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-b7815118-4d19-4b54-8984-82d7097b4882 req-0140ae96-c0f5-43f2-b9c8-180ba81eca48 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:05:29.289386 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-b7815118-4d19-4b54-8984-82d7097b4882 req-0140ae96-c0f5-43f2-b9c8-180ba81eca48 service nova] Creating event network-changed:67f2d802-80ee-4e94-be87-3ffbcfcd063d for instance 236c09e2-65bd-4ef5-88b1-032329b987cf on nch2-master-1 Oct 08 22:05:29.295484 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-b7815118-4d19-4b54-8984-82d7097b4882 req-0140ae96-c0f5-43f2-b9c8-180ba81eca48 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041054 Oct 08 22:05:29.296238 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3560/7045] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 22:05:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 22:05:30.160049 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-2862fcd1-efeb-4740-ad85-ba0435d61131 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:05:30.160677 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-2862fcd1-efeb-4740-ad85-ba0435d61131 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] [instance: 236c09e2-65bd-4ef5-88b1-032329b987cf] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:05:30.167762 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2862fcd1-efeb-4740-ad85-ba0435d61131 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:05:30.168264 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2862fcd1-efeb-4740-ad85-ba0435d61131 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:05:30.168713 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2862fcd1-efeb-4740-ad85-ba0435d61131 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:05:30.169469 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2862fcd1-efeb-4740-ad85-ba0435d61131 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:05:30.169936 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2862fcd1-efeb-4740-ad85-ba0435d61131 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:05:30.170373 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2862fcd1-efeb-4740-ad85-ba0435d61131 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:05:30.303770 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-2862fcd1-efeb-4740-ad85-ba0435d61131 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199e2426220e4cc4b1d37d4075e67cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9c33d4041764691b1ad69f9f1abe60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:05:30.311824 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-2862fcd1-efeb-4740-ad85-ba0435d61131 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] 10.222.0.26 "GET /compute/v2.1/servers/236c09e2-65bd-4ef5-88b1-032329b987cf" status: 200 len: 1371 microversion: 2.1 time: 0.155758 Oct 08 22:05:30.312406 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3486/7046] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:05:30 2022] GET /compute/v2.1/servers/236c09e2-65bd-4ef5-88b1-032329b987cf => generated 1371 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:05:31.335596 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-5de6cffe-bd6e-461b-b167-a45b30372aef tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:05:31.336355 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-5de6cffe-bd6e-461b-b167-a45b30372aef tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] [instance: 236c09e2-65bd-4ef5-88b1-032329b987cf] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:05:31.343191 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5de6cffe-bd6e-461b-b167-a45b30372aef tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:05:31.343700 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5de6cffe-bd6e-461b-b167-a45b30372aef tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:05:31.344171 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5de6cffe-bd6e-461b-b167-a45b30372aef tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:05:31.344886 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5de6cffe-bd6e-461b-b167-a45b30372aef tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:05:31.345402 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5de6cffe-bd6e-461b-b167-a45b30372aef tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:05:31.345853 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5de6cffe-bd6e-461b-b167-a45b30372aef tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:05:31.852441 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-5de6cffe-bd6e-461b-b167-a45b30372aef tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199e2426220e4cc4b1d37d4075e67cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9c33d4041764691b1ad69f9f1abe60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:05:31.861126 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-5de6cffe-bd6e-461b-b167-a45b30372aef tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] 10.222.0.26 "GET /compute/v2.1/servers/236c09e2-65bd-4ef5-88b1-032329b987cf" status: 200 len: 1371 microversion: 2.1 time: 0.530638 Oct 08 22:05:31.861737 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3561/7047] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:05:31 2022] GET /compute/v2.1/servers/236c09e2-65bd-4ef5-88b1-032329b987cf => generated 1371 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:05:32.883990 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-10b91544-b8d2-4132-813d-6e2db4c0a38d tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:05:32.884711 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-10b91544-b8d2-4132-813d-6e2db4c0a38d tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] [instance: 236c09e2-65bd-4ef5-88b1-032329b987cf] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:05:32.892329 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-10b91544-b8d2-4132-813d-6e2db4c0a38d tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:05:32.892830 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-10b91544-b8d2-4132-813d-6e2db4c0a38d tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:05:32.893303 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-10b91544-b8d2-4132-813d-6e2db4c0a38d tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:05:32.894010 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-10b91544-b8d2-4132-813d-6e2db4c0a38d tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:05:32.894478 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-10b91544-b8d2-4132-813d-6e2db4c0a38d tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:05:32.894915 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-10b91544-b8d2-4132-813d-6e2db4c0a38d tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:05:33.027242 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-10b91544-b8d2-4132-813d-6e2db4c0a38d tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199e2426220e4cc4b1d37d4075e67cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9c33d4041764691b1ad69f9f1abe60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:05:33.035085 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-10b91544-b8d2-4132-813d-6e2db4c0a38d tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] 10.222.0.26 "GET /compute/v2.1/servers/236c09e2-65bd-4ef5-88b1-032329b987cf" status: 200 len: 1371 microversion: 2.1 time: 0.155063 Oct 08 22:05:33.035617 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3487/7048] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:05:32 2022] GET /compute/v2.1/servers/236c09e2-65bd-4ef5-88b1-032329b987cf => generated 1371 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:05:34.058048 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-4d6b88bb-564c-48ed-adda-6f6bc9c08a3c tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:05:34.058621 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-4d6b88bb-564c-48ed-adda-6f6bc9c08a3c tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] [instance: 236c09e2-65bd-4ef5-88b1-032329b987cf] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:05:34.065811 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4d6b88bb-564c-48ed-adda-6f6bc9c08a3c tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:05:34.066322 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4d6b88bb-564c-48ed-adda-6f6bc9c08a3c tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:05:34.066783 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4d6b88bb-564c-48ed-adda-6f6bc9c08a3c tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:05:34.067508 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4d6b88bb-564c-48ed-adda-6f6bc9c08a3c tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:05:34.067990 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4d6b88bb-564c-48ed-adda-6f6bc9c08a3c tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:05:34.068441 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4d6b88bb-564c-48ed-adda-6f6bc9c08a3c tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:05:34.206498 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-4d6b88bb-564c-48ed-adda-6f6bc9c08a3c tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199e2426220e4cc4b1d37d4075e67cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9c33d4041764691b1ad69f9f1abe60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:05:34.214362 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-4d6b88bb-564c-48ed-adda-6f6bc9c08a3c tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] 10.222.0.26 "GET /compute/v2.1/servers/236c09e2-65bd-4ef5-88b1-032329b987cf" status: 200 len: 1371 microversion: 2.1 time: 0.160583 Oct 08 22:05:34.215172 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3562/7049] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:05:34 2022] GET /compute/v2.1/servers/236c09e2-65bd-4ef5-88b1-032329b987cf => generated 1371 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:05:34.527091 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-0f7f9a74-46bf-4ca6-941e-dab6c8262322 req-a6192244-ccbf-49d2-9fd7-2eb1ffc6c82a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "236c09e2-65bd-4ef5-88b1-032329b987cf", "name": "network-vif-plugged", "status": "completed", "tag": "67f2d802-80ee-4e94-be87-3ffbcfcd063d"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 22:05:34.539520 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-0f7f9a74-46bf-4ca6-941e-dab6c8262322 req-a6192244-ccbf-49d2-9fd7-2eb1ffc6c82a service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:05:34.540248 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-0f7f9a74-46bf-4ca6-941e-dab6c8262322 req-a6192244-ccbf-49d2-9fd7-2eb1ffc6c82a service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:05:34.540701 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-0f7f9a74-46bf-4ca6-941e-dab6c8262322 req-a6192244-ccbf-49d2-9fd7-2eb1ffc6c82a service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:05:34.551960 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-0f7f9a74-46bf-4ca6-941e-dab6c8262322 req-a6192244-ccbf-49d2-9fd7-2eb1ffc6c82a service nova] Creating event network-vif-plugged:67f2d802-80ee-4e94-be87-3ffbcfcd063d for instance 236c09e2-65bd-4ef5-88b1-032329b987cf on nch2-master-1 Oct 08 22:05:34.556993 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-0f7f9a74-46bf-4ca6-941e-dab6c8262322 req-a6192244-ccbf-49d2-9fd7-2eb1ffc6c82a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033674 Oct 08 22:05:34.558142 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3488/7050] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 22:05:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 22:05:35.238440 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-5dae8021-d14e-489f-a3af-cf3ddb9bce82 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:05:35.239071 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-5dae8021-d14e-489f-a3af-cf3ddb9bce82 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] [instance: 236c09e2-65bd-4ef5-88b1-032329b987cf] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:05:35.245990 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5dae8021-d14e-489f-a3af-cf3ddb9bce82 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:05:35.246491 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5dae8021-d14e-489f-a3af-cf3ddb9bce82 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:05:35.246949 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5dae8021-d14e-489f-a3af-cf3ddb9bce82 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:05:35.247685 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5dae8021-d14e-489f-a3af-cf3ddb9bce82 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:05:35.248160 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5dae8021-d14e-489f-a3af-cf3ddb9bce82 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:05:35.248603 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5dae8021-d14e-489f-a3af-cf3ddb9bce82 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:05:35.378209 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-5dae8021-d14e-489f-a3af-cf3ddb9bce82 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199e2426220e4cc4b1d37d4075e67cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9c33d4041764691b1ad69f9f1abe60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:05:35.386055 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-5dae8021-d14e-489f-a3af-cf3ddb9bce82 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] 10.222.0.26 "GET /compute/v2.1/servers/236c09e2-65bd-4ef5-88b1-032329b987cf" status: 200 len: 1371 microversion: 2.1 time: 0.152217 Oct 08 22:05:35.386639 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3563/7051] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:05:35 2022] GET /compute/v2.1/servers/236c09e2-65bd-4ef5-88b1-032329b987cf => generated 1371 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:05:36.408492 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c4d6e619-ed83-4e58-b99b-434d26ba60a1 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:05:36.409217 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-c4d6e619-ed83-4e58-b99b-434d26ba60a1 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] [instance: 236c09e2-65bd-4ef5-88b1-032329b987cf] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:05:36.416607 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c4d6e619-ed83-4e58-b99b-434d26ba60a1 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:05:36.417177 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c4d6e619-ed83-4e58-b99b-434d26ba60a1 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:05:36.417650 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c4d6e619-ed83-4e58-b99b-434d26ba60a1 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:05:36.418354 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c4d6e619-ed83-4e58-b99b-434d26ba60a1 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:05:36.418825 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c4d6e619-ed83-4e58-b99b-434d26ba60a1 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:05:36.419286 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c4d6e619-ed83-4e58-b99b-434d26ba60a1 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:05:36.552305 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-c4d6e619-ed83-4e58-b99b-434d26ba60a1 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199e2426220e4cc4b1d37d4075e67cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9c33d4041764691b1ad69f9f1abe60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:05:36.560419 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-c4d6e619-ed83-4e58-b99b-434d26ba60a1 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] 10.222.0.26 "GET /compute/v2.1/servers/236c09e2-65bd-4ef5-88b1-032329b987cf" status: 200 len: 1556 microversion: 2.1 time: 0.156222 Oct 08 22:05:36.560990 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3489/7052] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:05:36 2022] GET /compute/v2.1/servers/236c09e2-65bd-4ef5-88b1-032329b987cf => generated 1556 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:05:36.582620 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-f49dd4c2-4398-41f9-bb91-e154f948f985 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:05:36.583254 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-f49dd4c2-4398-41f9-bb91-e154f948f985 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] [instance: 236c09e2-65bd-4ef5-88b1-032329b987cf] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:05:36.586133 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=2 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 22:05:36.586871 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=6 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 22:05:36.593479 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f49dd4c2-4398-41f9-bb91-e154f948f985 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:05:36.594603 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f49dd4c2-4398-41f9-bb91-e154f948f985 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:05:36.595064 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f49dd4c2-4398-41f9-bb91-e154f948f985 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:05:36.595779 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f49dd4c2-4398-41f9-bb91-e154f948f985 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:05:36.596269 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f49dd4c2-4398-41f9-bb91-e154f948f985 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:05:36.596707 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f49dd4c2-4398-41f9-bb91-e154f948f985 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:05:36.743621 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-f49dd4c2-4398-41f9-bb91-e154f948f985 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199e2426220e4cc4b1d37d4075e67cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9c33d4041764691b1ad69f9f1abe60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:05:36.751597 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-f49dd4c2-4398-41f9-bb91-e154f948f985 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] 10.222.0.26 "GET /compute/v2.1/servers/236c09e2-65bd-4ef5-88b1-032329b987cf" status: 200 len: 1556 microversion: 2.1 time: 0.172914 Oct 08 22:05:36.752156 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3564/7053] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:05:36 2022] GET /compute/v2.1/servers/236c09e2-65bd-4ef5-88b1-032329b987cf => generated 1556 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:05:38.384962 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-0ac667e7-d503-440f-89fa-b665f24e640a req-7d86451d-598c-45d0-b110-14eaf4fcc070 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "236c09e2-65bd-4ef5-88b1-032329b987cf", "tag": "67f2d802-80ee-4e94-be87-3ffbcfcd063d"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 22:05:38.389430 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=6 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 22:05:38.396990 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-0ac667e7-d503-440f-89fa-b665f24e640a req-7d86451d-598c-45d0-b110-14eaf4fcc070 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:05:38.397514 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-0ac667e7-d503-440f-89fa-b665f24e640a req-7d86451d-598c-45d0-b110-14eaf4fcc070 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:05:38.397954 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-0ac667e7-d503-440f-89fa-b665f24e640a req-7d86451d-598c-45d0-b110-14eaf4fcc070 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:05:38.409629 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-0ac667e7-d503-440f-89fa-b665f24e640a req-7d86451d-598c-45d0-b110-14eaf4fcc070 service nova] Creating event network-changed:67f2d802-80ee-4e94-be87-3ffbcfcd063d for instance 236c09e2-65bd-4ef5-88b1-032329b987cf on nch2-master-1 Oct 08 22:05:38.414869 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-0ac667e7-d503-440f-89fa-b665f24e640a req-7d86451d-598c-45d0-b110-14eaf4fcc070 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034024 Oct 08 22:05:38.415533 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3490/7054] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 22:05:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 08 22:07:33.462754 ncdv-master-1 devstack@n-api.service[140492]: ERROR oslo.messaging._drivers.impl_rabbit [-] [bab1eda8-a2f4-4cbf-a1fb-a5a6d7c2688e] AMQP server on 10.222.0.26:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 08 22:07:33.463674 ncdv-master-1 devstack@n-api.service[140492]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a92ae347-69e9-4ac8-bb66-e8def9f99758] AMQP server on 10.222.0.26:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 08 22:07:33.464389 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 22:07:33.465338 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=34 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 22:07:33.470890 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-3c2a3d43-19e3-4d23-83de-fa71f842bbe9 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 22:07:33.471448 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-3c2a3d43-19e3-4d23-83de-fa71f842bbe9 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] [instance: 236c09e2-65bd-4ef5-88b1-032329b987cf] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:07:33.479925 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3c2a3d43-19e3-4d23-83de-fa71f842bbe9 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:07:33.480538 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3c2a3d43-19e3-4d23-83de-fa71f842bbe9 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:07:33.480950 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3c2a3d43-19e3-4d23-83de-fa71f842bbe9 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:07:33.482164 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3c2a3d43-19e3-4d23-83de-fa71f842bbe9 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:07:33.482359 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3c2a3d43-19e3-4d23-83de-fa71f842bbe9 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:07:33.482806 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3c2a3d43-19e3-4d23-83de-fa71f842bbe9 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:07:33.509115 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.objects.instance [None req-3c2a3d43-19e3-4d23-83de-fa71f842bbe9 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lazy-loading 'flavor' on Instance uuid 236c09e2-65bd-4ef5-88b1-032329b987cf {{(pid=140492) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 22:07:33.697833 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-3c2a3d43-19e3-4d23-83de-fa71f842bbe9 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] 10.222.0.26 "POST /compute/v2.1/servers/236c09e2-65bd-4ef5-88b1-032329b987cf/action" status: 202 len: 0 microversion: 2.1 time: 0.236654 Oct 08 22:07:33.698435 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3565/7055] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 22:07:33 2022] POST /compute/v2.1/servers/236c09e2-65bd-4ef5-88b1-032329b987cf/action => generated 0 bytes in 238 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 22:07:33.705254 ncdv-master-1 devstack@n-api.service[140491]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5b834fae-ca0a-46cb-bcaa-52f744fce5f9] AMQP server on 10.222.0.26:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 08 22:07:33.706209 ncdv-master-1 devstack@n-api.service[140491]: ERROR oslo.messaging._drivers.impl_rabbit [-] [389347c8-adfb-4c72-885b-6416d41737c1] AMQP server on 10.222.0.26:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 08 22:07:33.707076 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 22:07:33.707887 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=28 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 22:07:33.709486 ncdv-master-1 devstack@n-api.service[140491]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 08 22:07:33.709655 ncdv-master-1 devstack@n-api.service[140491]: Sat Oct 8 22:07:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/236c09e2-65bd-4ef5-88b1-032329b987cf (ip 10.222.0.26) !!! Oct 08 22:07:33.715327 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-16071679-0001-4ed5-92dd-b10f4d25cbde tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:07:33.716264 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-16071679-0001-4ed5-92dd-b10f4d25cbde tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] [instance: 236c09e2-65bd-4ef5-88b1-032329b987cf] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:07:33.726578 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-16071679-0001-4ed5-92dd-b10f4d25cbde tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:07:33.727153 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-16071679-0001-4ed5-92dd-b10f4d25cbde tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:07:33.727617 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-16071679-0001-4ed5-92dd-b10f4d25cbde tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:07:33.728330 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-16071679-0001-4ed5-92dd-b10f4d25cbde tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:07:33.728797 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-16071679-0001-4ed5-92dd-b10f4d25cbde tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:07:33.729256 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-16071679-0001-4ed5-92dd-b10f4d25cbde tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:07:33.863806 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-16071679-0001-4ed5-92dd-b10f4d25cbde tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199e2426220e4cc4b1d37d4075e67cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9c33d4041764691b1ad69f9f1abe60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:07:33.873180 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-16071679-0001-4ed5-92dd-b10f4d25cbde tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] 10.222.0.26 "GET /compute/v2.1/servers/236c09e2-65bd-4ef5-88b1-032329b987cf" status: 200 len: 1681 microversion: 2.1 time: 0.169907 Oct 08 22:07:33.873786 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3491/7056] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:07:33 2022] GET /compute/v2.1/servers/236c09e2-65bd-4ef5-88b1-032329b987cf => generated 1681 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:07:34.898193 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-c9dffca1-7e7c-433b-bf5e-aaf364adf0cd tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:07:34.898880 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-c9dffca1-7e7c-433b-bf5e-aaf364adf0cd tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] [instance: 236c09e2-65bd-4ef5-88b1-032329b987cf] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:07:34.908043 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c9dffca1-7e7c-433b-bf5e-aaf364adf0cd tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:07:34.908556 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c9dffca1-7e7c-433b-bf5e-aaf364adf0cd tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:07:34.909019 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c9dffca1-7e7c-433b-bf5e-aaf364adf0cd tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:07:34.909786 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c9dffca1-7e7c-433b-bf5e-aaf364adf0cd tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:07:34.910271 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c9dffca1-7e7c-433b-bf5e-aaf364adf0cd tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:07:34.910720 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c9dffca1-7e7c-433b-bf5e-aaf364adf0cd tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:07:34.915546 ncdv-master-1 devstack@n-api.service[140492]: INFO oslo.messaging._drivers.impl_rabbit [-] [a92ae347-69e9-4ac8-bb66-e8def9f99758] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 39470. Oct 08 22:07:34.917838 ncdv-master-1 devstack@n-api.service[140492]: INFO oslo.messaging._drivers.impl_rabbit [-] [bab1eda8-a2f4-4cbf-a1fb-a5a6d7c2688e] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 39468. Oct 08 22:07:35.050697 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-c9dffca1-7e7c-433b-bf5e-aaf364adf0cd tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199e2426220e4cc4b1d37d4075e67cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9c33d4041764691b1ad69f9f1abe60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:07:35.059291 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-c9dffca1-7e7c-433b-bf5e-aaf364adf0cd tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] 10.222.0.26 "GET /compute/v2.1/servers/236c09e2-65bd-4ef5-88b1-032329b987cf" status: 200 len: 1681 microversion: 2.1 time: 0.167113 Oct 08 22:07:35.059874 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3566/7057] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:07:34 2022] GET /compute/v2.1/servers/236c09e2-65bd-4ef5-88b1-032329b987cf => generated 1681 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:07:36.082945 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-e895240f-1277-4d45-b10b-6ed92d636ca2 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:07:36.083594 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-e895240f-1277-4d45-b10b-6ed92d636ca2 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] [instance: 236c09e2-65bd-4ef5-88b1-032329b987cf] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:07:36.097356 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e895240f-1277-4d45-b10b-6ed92d636ca2 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:07:36.097863 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e895240f-1277-4d45-b10b-6ed92d636ca2 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:07:36.098328 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e895240f-1277-4d45-b10b-6ed92d636ca2 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:07:36.099050 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e895240f-1277-4d45-b10b-6ed92d636ca2 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:07:36.099594 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e895240f-1277-4d45-b10b-6ed92d636ca2 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:07:36.100041 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e895240f-1277-4d45-b10b-6ed92d636ca2 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:07:36.106342 ncdv-master-1 devstack@n-api.service[140491]: INFO oslo.messaging._drivers.impl_rabbit [-] [5b834fae-ca0a-46cb-bcaa-52f744fce5f9] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 39474. Oct 08 22:07:36.109777 ncdv-master-1 devstack@n-api.service[140491]: INFO oslo.messaging._drivers.impl_rabbit [-] [389347c8-adfb-4c72-885b-6416d41737c1] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 39476. Oct 08 22:07:36.238900 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-e895240f-1277-4d45-b10b-6ed92d636ca2 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199e2426220e4cc4b1d37d4075e67cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9c33d4041764691b1ad69f9f1abe60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:07:36.247358 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-e895240f-1277-4d45-b10b-6ed92d636ca2 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] 10.222.0.26 "GET /compute/v2.1/servers/236c09e2-65bd-4ef5-88b1-032329b987cf" status: 200 len: 1681 microversion: 2.1 time: 0.168493 Oct 08 22:07:36.247935 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3492/7058] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:07:36 2022] GET /compute/v2.1/servers/236c09e2-65bd-4ef5-88b1-032329b987cf => generated 1681 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:07:37.270442 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-08205477-f0e3-4ea8-840e-b3f48de9e2d3 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:07:37.271097 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-08205477-f0e3-4ea8-840e-b3f48de9e2d3 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] [instance: 236c09e2-65bd-4ef5-88b1-032329b987cf] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:07:37.278488 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-08205477-f0e3-4ea8-840e-b3f48de9e2d3 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:07:37.278988 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-08205477-f0e3-4ea8-840e-b3f48de9e2d3 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:07:37.279442 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-08205477-f0e3-4ea8-840e-b3f48de9e2d3 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:07:37.280150 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-08205477-f0e3-4ea8-840e-b3f48de9e2d3 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:07:37.280630 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-08205477-f0e3-4ea8-840e-b3f48de9e2d3 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:07:37.281074 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-08205477-f0e3-4ea8-840e-b3f48de9e2d3 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:07:37.412443 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-08205477-f0e3-4ea8-840e-b3f48de9e2d3 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199e2426220e4cc4b1d37d4075e67cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9c33d4041764691b1ad69f9f1abe60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:07:37.420351 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-08205477-f0e3-4ea8-840e-b3f48de9e2d3 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] 10.222.0.26 "GET /compute/v2.1/servers/236c09e2-65bd-4ef5-88b1-032329b987cf" status: 200 len: 1681 microversion: 2.1 time: 0.153880 Oct 08 22:07:37.420937 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3567/7059] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:07:37 2022] GET /compute/v2.1/servers/236c09e2-65bd-4ef5-88b1-032329b987cf => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:07:38.443445 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-80741c38-7676-4636-bffe-7c7f05ecf2cf tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:07:38.444102 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-80741c38-7676-4636-bffe-7c7f05ecf2cf tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] [instance: 236c09e2-65bd-4ef5-88b1-032329b987cf] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:07:38.451060 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-80741c38-7676-4636-bffe-7c7f05ecf2cf tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:07:38.451564 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-80741c38-7676-4636-bffe-7c7f05ecf2cf tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:07:38.452014 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-80741c38-7676-4636-bffe-7c7f05ecf2cf tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:07:38.452722 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-80741c38-7676-4636-bffe-7c7f05ecf2cf tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:07:38.453209 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-80741c38-7676-4636-bffe-7c7f05ecf2cf tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:07:38.453656 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-80741c38-7676-4636-bffe-7c7f05ecf2cf tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:07:38.583067 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-80741c38-7676-4636-bffe-7c7f05ecf2cf tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199e2426220e4cc4b1d37d4075e67cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9c33d4041764691b1ad69f9f1abe60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:07:38.591431 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-80741c38-7676-4636-bffe-7c7f05ecf2cf tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] 10.222.0.26 "GET /compute/v2.1/servers/236c09e2-65bd-4ef5-88b1-032329b987cf" status: 200 len: 1681 microversion: 2.1 time: 0.151992 Oct 08 22:07:38.592004 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3493/7060] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:07:38 2022] GET /compute/v2.1/servers/236c09e2-65bd-4ef5-88b1-032329b987cf => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:07:39.615035 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-c414c995-9312-410d-9711-53adb1c3ccc2 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:07:39.615736 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-c414c995-9312-410d-9711-53adb1c3ccc2 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] [instance: 236c09e2-65bd-4ef5-88b1-032329b987cf] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:07:39.622703 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c414c995-9312-410d-9711-53adb1c3ccc2 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:07:39.623218 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c414c995-9312-410d-9711-53adb1c3ccc2 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:07:39.623687 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c414c995-9312-410d-9711-53adb1c3ccc2 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:07:39.624411 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c414c995-9312-410d-9711-53adb1c3ccc2 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:07:39.624895 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c414c995-9312-410d-9711-53adb1c3ccc2 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:07:39.625394 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c414c995-9312-410d-9711-53adb1c3ccc2 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:07:39.762567 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-c414c995-9312-410d-9711-53adb1c3ccc2 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199e2426220e4cc4b1d37d4075e67cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9c33d4041764691b1ad69f9f1abe60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:07:39.771312 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-c414c995-9312-410d-9711-53adb1c3ccc2 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] 10.222.0.26 "GET /compute/v2.1/servers/236c09e2-65bd-4ef5-88b1-032329b987cf" status: 200 len: 1681 microversion: 2.1 time: 0.160161 Oct 08 22:07:39.771922 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3568/7061] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:07:39 2022] GET /compute/v2.1/servers/236c09e2-65bd-4ef5-88b1-032329b987cf => generated 1681 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:07:40.795493 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-7f2a52ce-17bb-4af8-aecf-87451af397d4 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:07:40.796114 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-7f2a52ce-17bb-4af8-aecf-87451af397d4 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] [instance: 236c09e2-65bd-4ef5-88b1-032329b987cf] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:07:40.805578 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7f2a52ce-17bb-4af8-aecf-87451af397d4 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:07:40.806073 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7f2a52ce-17bb-4af8-aecf-87451af397d4 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:07:40.806517 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7f2a52ce-17bb-4af8-aecf-87451af397d4 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:07:40.807231 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7f2a52ce-17bb-4af8-aecf-87451af397d4 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:07:40.807689 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7f2a52ce-17bb-4af8-aecf-87451af397d4 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:07:40.808122 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7f2a52ce-17bb-4af8-aecf-87451af397d4 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:07:40.945121 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-7f2a52ce-17bb-4af8-aecf-87451af397d4 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199e2426220e4cc4b1d37d4075e67cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9c33d4041764691b1ad69f9f1abe60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:07:40.952892 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-7f2a52ce-17bb-4af8-aecf-87451af397d4 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] 10.222.0.26 "GET /compute/v2.1/servers/236c09e2-65bd-4ef5-88b1-032329b987cf" status: 200 len: 1681 microversion: 2.1 time: 0.161412 Oct 08 22:07:40.953506 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3494/7062] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:07:40 2022] GET /compute/v2.1/servers/236c09e2-65bd-4ef5-88b1-032329b987cf => generated 1681 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:07:41.977280 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-6ce430e8-87a4-4898-a314-d62ed4b3484d tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:07:41.978016 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-6ce430e8-87a4-4898-a314-d62ed4b3484d tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] [instance: 236c09e2-65bd-4ef5-88b1-032329b987cf] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:07:41.984960 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6ce430e8-87a4-4898-a314-d62ed4b3484d tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:07:41.985498 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6ce430e8-87a4-4898-a314-d62ed4b3484d tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:07:41.985961 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6ce430e8-87a4-4898-a314-d62ed4b3484d tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:07:41.986682 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6ce430e8-87a4-4898-a314-d62ed4b3484d tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:07:41.987160 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6ce430e8-87a4-4898-a314-d62ed4b3484d tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:07:41.987602 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6ce430e8-87a4-4898-a314-d62ed4b3484d tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:07:42.122201 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-6ce430e8-87a4-4898-a314-d62ed4b3484d tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199e2426220e4cc4b1d37d4075e67cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9c33d4041764691b1ad69f9f1abe60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:07:42.130003 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-6ce430e8-87a4-4898-a314-d62ed4b3484d tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] 10.222.0.26 "GET /compute/v2.1/servers/236c09e2-65bd-4ef5-88b1-032329b987cf" status: 200 len: 1681 microversion: 2.1 time: 0.157823 Oct 08 22:07:42.130586 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3569/7063] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:07:41 2022] GET /compute/v2.1/servers/236c09e2-65bd-4ef5-88b1-032329b987cf => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:07:43.153401 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-2c4a117a-0dcb-4370-9e0b-bcf806f8b714 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:07:43.154031 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-2c4a117a-0dcb-4370-9e0b-bcf806f8b714 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] [instance: 236c09e2-65bd-4ef5-88b1-032329b987cf] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:07:43.161057 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2c4a117a-0dcb-4370-9e0b-bcf806f8b714 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:07:43.161599 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2c4a117a-0dcb-4370-9e0b-bcf806f8b714 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:07:43.162056 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2c4a117a-0dcb-4370-9e0b-bcf806f8b714 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:07:43.162774 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2c4a117a-0dcb-4370-9e0b-bcf806f8b714 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:07:43.163248 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2c4a117a-0dcb-4370-9e0b-bcf806f8b714 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:07:43.163690 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2c4a117a-0dcb-4370-9e0b-bcf806f8b714 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:07:43.295729 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-2c4a117a-0dcb-4370-9e0b-bcf806f8b714 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199e2426220e4cc4b1d37d4075e67cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9c33d4041764691b1ad69f9f1abe60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:07:43.304332 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-2c4a117a-0dcb-4370-9e0b-bcf806f8b714 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] 10.222.0.26 "GET /compute/v2.1/servers/236c09e2-65bd-4ef5-88b1-032329b987cf" status: 200 len: 1681 microversion: 2.1 time: 0.154932 Oct 08 22:07:43.304912 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3495/7064] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:07:43 2022] GET /compute/v2.1/servers/236c09e2-65bd-4ef5-88b1-032329b987cf => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:07:44.328044 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-1e2d4fe3-111e-4062-8292-aab83715e8da tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:07:44.328698 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-1e2d4fe3-111e-4062-8292-aab83715e8da tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] [instance: 236c09e2-65bd-4ef5-88b1-032329b987cf] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:07:44.336681 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1e2d4fe3-111e-4062-8292-aab83715e8da tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:07:44.337219 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1e2d4fe3-111e-4062-8292-aab83715e8da tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:07:44.337686 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1e2d4fe3-111e-4062-8292-aab83715e8da tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:07:44.338443 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1e2d4fe3-111e-4062-8292-aab83715e8da tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:07:44.338928 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1e2d4fe3-111e-4062-8292-aab83715e8da tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:07:44.339381 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-1e2d4fe3-111e-4062-8292-aab83715e8da tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:07:44.469275 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-1e2d4fe3-111e-4062-8292-aab83715e8da tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199e2426220e4cc4b1d37d4075e67cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9c33d4041764691b1ad69f9f1abe60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:07:44.477472 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-1e2d4fe3-111e-4062-8292-aab83715e8da tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] 10.222.0.26 "GET /compute/v2.1/servers/236c09e2-65bd-4ef5-88b1-032329b987cf" status: 200 len: 1702 microversion: 2.1 time: 0.153310 Oct 08 22:07:44.478417 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3570/7065] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:07:44 2022] GET /compute/v2.1/servers/236c09e2-65bd-4ef5-88b1-032329b987cf => generated 1702 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:07:45.502538 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-77752f62-bb80-4f02-b945-347ac2b597ba tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:07:45.503223 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-77752f62-bb80-4f02-b945-347ac2b597ba tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] [instance: 236c09e2-65bd-4ef5-88b1-032329b987cf] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:07:45.510744 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-77752f62-bb80-4f02-b945-347ac2b597ba tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:07:45.511242 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-77752f62-bb80-4f02-b945-347ac2b597ba tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:07:45.511690 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-77752f62-bb80-4f02-b945-347ac2b597ba tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:07:45.512397 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-77752f62-bb80-4f02-b945-347ac2b597ba tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:07:45.512862 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-77752f62-bb80-4f02-b945-347ac2b597ba tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:07:45.513322 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-77752f62-bb80-4f02-b945-347ac2b597ba tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:07:45.650138 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-77752f62-bb80-4f02-b945-347ac2b597ba tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199e2426220e4cc4b1d37d4075e67cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9c33d4041764691b1ad69f9f1abe60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:07:45.658310 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-77752f62-bb80-4f02-b945-347ac2b597ba tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] 10.222.0.26 "GET /compute/v2.1/servers/236c09e2-65bd-4ef5-88b1-032329b987cf" status: 200 len: 1702 microversion: 2.1 time: 0.160463 Oct 08 22:07:45.658892 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3496/7066] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:07:45 2022] GET /compute/v2.1/servers/236c09e2-65bd-4ef5-88b1-032329b987cf => generated 1702 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:07:46.681621 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-96b0e709-5e1f-43d3-8178-a0eb2776bb56 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:07:46.682891 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-96b0e709-5e1f-43d3-8178-a0eb2776bb56 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] [instance: 236c09e2-65bd-4ef5-88b1-032329b987cf] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:07:46.689997 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-96b0e709-5e1f-43d3-8178-a0eb2776bb56 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:07:46.690778 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-96b0e709-5e1f-43d3-8178-a0eb2776bb56 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:07:46.691465 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-96b0e709-5e1f-43d3-8178-a0eb2776bb56 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:07:46.692280 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-96b0e709-5e1f-43d3-8178-a0eb2776bb56 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:07:46.692979 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-96b0e709-5e1f-43d3-8178-a0eb2776bb56 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:07:46.693530 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-96b0e709-5e1f-43d3-8178-a0eb2776bb56 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:07:46.850547 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-96b0e709-5e1f-43d3-8178-a0eb2776bb56 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199e2426220e4cc4b1d37d4075e67cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9c33d4041764691b1ad69f9f1abe60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:07:46.860977 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-96b0e709-5e1f-43d3-8178-a0eb2776bb56 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] 10.222.0.26 "GET /compute/v2.1/servers/236c09e2-65bd-4ef5-88b1-032329b987cf" status: 200 len: 1697 microversion: 2.1 time: 0.183773 Oct 08 22:07:46.861996 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3571/7067] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:07:46 2022] GET /compute/v2.1/servers/236c09e2-65bd-4ef5-88b1-032329b987cf => generated 1697 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:07:47.884462 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-738116d3-624e-40c6-8d5f-991baab3f97a tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:07:47.885083 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-738116d3-624e-40c6-8d5f-991baab3f97a tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] [instance: 236c09e2-65bd-4ef5-88b1-032329b987cf] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:07:47.892868 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-738116d3-624e-40c6-8d5f-991baab3f97a tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:07:47.893412 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-738116d3-624e-40c6-8d5f-991baab3f97a tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:07:47.893854 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-738116d3-624e-40c6-8d5f-991baab3f97a tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:07:47.894761 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-738116d3-624e-40c6-8d5f-991baab3f97a tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:07:47.895227 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-738116d3-624e-40c6-8d5f-991baab3f97a tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:07:47.895666 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-738116d3-624e-40c6-8d5f-991baab3f97a tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:07:48.040035 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-738116d3-624e-40c6-8d5f-991baab3f97a tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199e2426220e4cc4b1d37d4075e67cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9c33d4041764691b1ad69f9f1abe60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:07:48.049150 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-738116d3-624e-40c6-8d5f-991baab3f97a tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] 10.222.0.26 "GET /compute/v2.1/servers/236c09e2-65bd-4ef5-88b1-032329b987cf" status: 200 len: 1697 microversion: 2.1 time: 0.168606 Oct 08 22:07:48.066699 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3497/7068] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:07:47 2022] GET /compute/v2.1/servers/236c09e2-65bd-4ef5-88b1-032329b987cf => generated 1697 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:07:49.075778 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-209ff3dd-4859-409f-9514-efbe19e6707a tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:07:49.077076 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-209ff3dd-4859-409f-9514-efbe19e6707a tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] [instance: 236c09e2-65bd-4ef5-88b1-032329b987cf] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:07:49.085604 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-209ff3dd-4859-409f-9514-efbe19e6707a tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:07:49.086577 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-209ff3dd-4859-409f-9514-efbe19e6707a tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:07:49.087129 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-209ff3dd-4859-409f-9514-efbe19e6707a tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:07:49.087996 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-209ff3dd-4859-409f-9514-efbe19e6707a tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:07:49.088585 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-209ff3dd-4859-409f-9514-efbe19e6707a tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:07:49.089311 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-209ff3dd-4859-409f-9514-efbe19e6707a tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:07:49.235438 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-f05a1118-1d73-49e7-b71c-28be44943df4 req-6c326760-76ff-4f91-8888-146067e1a634 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "236c09e2-65bd-4ef5-88b1-032329b987cf", "name": "network-vif-plugged", "status": "completed", "tag": "67f2d802-80ee-4e94-be87-3ffbcfcd063d"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 22:07:49.248930 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-f05a1118-1d73-49e7-b71c-28be44943df4 req-6c326760-76ff-4f91-8888-146067e1a634 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:07:49.249710 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-f05a1118-1d73-49e7-b71c-28be44943df4 req-6c326760-76ff-4f91-8888-146067e1a634 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:07:49.250369 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-f05a1118-1d73-49e7-b71c-28be44943df4 req-6c326760-76ff-4f91-8888-146067e1a634 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:07:49.264295 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-f05a1118-1d73-49e7-b71c-28be44943df4 req-6c326760-76ff-4f91-8888-146067e1a634 service nova] Creating event network-vif-plugged:67f2d802-80ee-4e94-be87-3ffbcfcd063d for instance 236c09e2-65bd-4ef5-88b1-032329b987cf on nch2-master-1 Oct 08 22:07:49.264867 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-209ff3dd-4859-409f-9514-efbe19e6707a tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199e2426220e4cc4b1d37d4075e67cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9c33d4041764691b1ad69f9f1abe60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:07:49.269641 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-f05a1118-1d73-49e7-b71c-28be44943df4 req-6c326760-76ff-4f91-8888-146067e1a634 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.157839 Oct 08 22:07:49.276648 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-209ff3dd-4859-409f-9514-efbe19e6707a tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] 10.222.0.26 "GET /compute/v2.1/servers/236c09e2-65bd-4ef5-88b1-032329b987cf" status: 200 len: 1697 microversion: 2.1 time: 0.206258 Oct 08 22:07:49.285559 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3498/7069] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 22:07:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 08 22:07:49.293501 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3572/7070] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:07:49 2022] GET /compute/v2.1/servers/236c09e2-65bd-4ef5-88b1-032329b987cf => generated 1697 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:07:50.307283 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-25767713-4c55-4617-a2dd-650d7581608d tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:07:50.308090 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-25767713-4c55-4617-a2dd-650d7581608d tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] [instance: 236c09e2-65bd-4ef5-88b1-032329b987cf] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:07:50.317794 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-25767713-4c55-4617-a2dd-650d7581608d tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:07:50.318303 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-25767713-4c55-4617-a2dd-650d7581608d tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:07:50.318839 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-25767713-4c55-4617-a2dd-650d7581608d tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:07:50.319569 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-25767713-4c55-4617-a2dd-650d7581608d tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:07:50.320039 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-25767713-4c55-4617-a2dd-650d7581608d tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:07:50.320479 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-25767713-4c55-4617-a2dd-650d7581608d tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:07:50.478923 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-25767713-4c55-4617-a2dd-650d7581608d tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199e2426220e4cc4b1d37d4075e67cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9c33d4041764691b1ad69f9f1abe60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:07:50.492602 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-25767713-4c55-4617-a2dd-650d7581608d tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] 10.222.0.26 "GET /compute/v2.1/servers/236c09e2-65bd-4ef5-88b1-032329b987cf" status: 200 len: 1697 microversion: 2.1 time: 0.190374 Oct 08 22:07:50.493419 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3499/7071] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:07:50 2022] GET /compute/v2.1/servers/236c09e2-65bd-4ef5-88b1-032329b987cf => generated 1697 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:07:51.517462 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-50bc0378-f999-4f6f-abfd-7c944a45bc87 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:07:51.518909 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-50bc0378-f999-4f6f-abfd-7c944a45bc87 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] [instance: 236c09e2-65bd-4ef5-88b1-032329b987cf] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:07:51.528291 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-50bc0378-f999-4f6f-abfd-7c944a45bc87 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:07:51.529283 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-50bc0378-f999-4f6f-abfd-7c944a45bc87 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:07:51.530013 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-50bc0378-f999-4f6f-abfd-7c944a45bc87 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:07:51.531038 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-50bc0378-f999-4f6f-abfd-7c944a45bc87 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:07:51.531721 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-50bc0378-f999-4f6f-abfd-7c944a45bc87 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:07:51.532432 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-50bc0378-f999-4f6f-abfd-7c944a45bc87 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:07:51.708469 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-50bc0378-f999-4f6f-abfd-7c944a45bc87 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199e2426220e4cc4b1d37d4075e67cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9c33d4041764691b1ad69f9f1abe60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:07:51.717689 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-50bc0378-f999-4f6f-abfd-7c944a45bc87 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] 10.222.0.26 "GET /compute/v2.1/servers/236c09e2-65bd-4ef5-88b1-032329b987cf" status: 200 len: 1697 microversion: 2.1 time: 0.205013 Oct 08 22:07:51.718306 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3573/7072] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:07:51 2022] GET /compute/v2.1/servers/236c09e2-65bd-4ef5-88b1-032329b987cf => generated 1697 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:07:52.763095 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-dbde813d-b7d7-40cb-883e-8bdc87746735 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:07:52.763647 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-dbde813d-b7d7-40cb-883e-8bdc87746735 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] [instance: 236c09e2-65bd-4ef5-88b1-032329b987cf] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:07:52.775911 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dbde813d-b7d7-40cb-883e-8bdc87746735 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:07:52.776989 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dbde813d-b7d7-40cb-883e-8bdc87746735 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:07:52.777652 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dbde813d-b7d7-40cb-883e-8bdc87746735 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:07:52.778951 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dbde813d-b7d7-40cb-883e-8bdc87746735 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:07:52.779520 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dbde813d-b7d7-40cb-883e-8bdc87746735 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:07:52.780002 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dbde813d-b7d7-40cb-883e-8bdc87746735 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:07:52.935869 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-dbde813d-b7d7-40cb-883e-8bdc87746735 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199e2426220e4cc4b1d37d4075e67cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9c33d4041764691b1ad69f9f1abe60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:07:52.944721 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-dbde813d-b7d7-40cb-883e-8bdc87746735 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] 10.222.0.26 "GET /compute/v2.1/servers/236c09e2-65bd-4ef5-88b1-032329b987cf" status: 200 len: 1697 microversion: 2.1 time: 0.185545 Oct 08 22:07:52.957426 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3500/7073] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:07:52 2022] GET /compute/v2.1/servers/236c09e2-65bd-4ef5-88b1-032329b987cf => generated 1697 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:07:53.968726 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-8ad5dc49-826e-4768-ab9c-9f5ba1b32899 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:07:53.969511 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-8ad5dc49-826e-4768-ab9c-9f5ba1b32899 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] [instance: 236c09e2-65bd-4ef5-88b1-032329b987cf] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:07:53.976482 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8ad5dc49-826e-4768-ab9c-9f5ba1b32899 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:07:53.976995 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8ad5dc49-826e-4768-ab9c-9f5ba1b32899 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:07:53.977497 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8ad5dc49-826e-4768-ab9c-9f5ba1b32899 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:07:53.978219 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8ad5dc49-826e-4768-ab9c-9f5ba1b32899 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:07:53.978763 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8ad5dc49-826e-4768-ab9c-9f5ba1b32899 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:07:53.982514 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-8ad5dc49-826e-4768-ab9c-9f5ba1b32899 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:07:54.143322 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-8ad5dc49-826e-4768-ab9c-9f5ba1b32899 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199e2426220e4cc4b1d37d4075e67cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9c33d4041764691b1ad69f9f1abe60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:07:54.153516 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-8ad5dc49-826e-4768-ab9c-9f5ba1b32899 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] 10.222.0.26 "GET /compute/v2.1/servers/236c09e2-65bd-4ef5-88b1-032329b987cf" status: 200 len: 1697 microversion: 2.1 time: 0.188509 Oct 08 22:07:54.154601 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3574/7074] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:07:53 2022] GET /compute/v2.1/servers/236c09e2-65bd-4ef5-88b1-032329b987cf => generated 1697 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:07:55.178667 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-f8b08e66-3f45-49e0-8315-7124a248b807 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:07:55.179341 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-f8b08e66-3f45-49e0-8315-7124a248b807 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] [instance: 236c09e2-65bd-4ef5-88b1-032329b987cf] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:07:55.186468 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f8b08e66-3f45-49e0-8315-7124a248b807 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:07:55.186963 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f8b08e66-3f45-49e0-8315-7124a248b807 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:07:55.187415 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f8b08e66-3f45-49e0-8315-7124a248b807 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:07:55.188130 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f8b08e66-3f45-49e0-8315-7124a248b807 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:07:55.188602 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f8b08e66-3f45-49e0-8315-7124a248b807 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:07:55.189042 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-f8b08e66-3f45-49e0-8315-7124a248b807 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:07:55.322399 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-f8b08e66-3f45-49e0-8315-7124a248b807 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199e2426220e4cc4b1d37d4075e67cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9c33d4041764691b1ad69f9f1abe60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:07:55.330379 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-f8b08e66-3f45-49e0-8315-7124a248b807 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] 10.222.0.26 "GET /compute/v2.1/servers/236c09e2-65bd-4ef5-88b1-032329b987cf" status: 200 len: 1697 microversion: 2.1 time: 0.155924 Oct 08 22:07:55.330971 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3501/7075] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:07:55 2022] GET /compute/v2.1/servers/236c09e2-65bd-4ef5-88b1-032329b987cf => generated 1697 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:07:56.354480 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-5b64a6e6-4877-4576-b5d9-d50da561411a tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:07:56.355042 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-5b64a6e6-4877-4576-b5d9-d50da561411a tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] [instance: 236c09e2-65bd-4ef5-88b1-032329b987cf] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:07:56.362052 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5b64a6e6-4877-4576-b5d9-d50da561411a tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:07:56.362557 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5b64a6e6-4877-4576-b5d9-d50da561411a tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:07:56.363017 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5b64a6e6-4877-4576-b5d9-d50da561411a tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:07:56.363735 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5b64a6e6-4877-4576-b5d9-d50da561411a tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:07:56.364206 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5b64a6e6-4877-4576-b5d9-d50da561411a tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:07:56.364651 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5b64a6e6-4877-4576-b5d9-d50da561411a tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:07:56.495640 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-5b64a6e6-4877-4576-b5d9-d50da561411a tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199e2426220e4cc4b1d37d4075e67cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9c33d4041764691b1ad69f9f1abe60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:07:56.503536 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-5b64a6e6-4877-4576-b5d9-d50da561411a tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] 10.222.0.26 "GET /compute/v2.1/servers/236c09e2-65bd-4ef5-88b1-032329b987cf" status: 200 len: 1679 microversion: 2.1 time: 0.153068 Oct 08 22:07:56.504126 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3575/7076] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:07:56 2022] GET /compute/v2.1/servers/236c09e2-65bd-4ef5-88b1-032329b987cf => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:07:57.526328 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-2c3d3e08-af25-4db3-8123-ffabcbd0f7a7 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:07:57.526986 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-2c3d3e08-af25-4db3-8123-ffabcbd0f7a7 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] [instance: 236c09e2-65bd-4ef5-88b1-032329b987cf] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:07:57.534105 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2c3d3e08-af25-4db3-8123-ffabcbd0f7a7 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:07:57.534604 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2c3d3e08-af25-4db3-8123-ffabcbd0f7a7 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:07:57.535054 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2c3d3e08-af25-4db3-8123-ffabcbd0f7a7 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:07:57.535767 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2c3d3e08-af25-4db3-8123-ffabcbd0f7a7 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:07:57.536236 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2c3d3e08-af25-4db3-8123-ffabcbd0f7a7 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:07:57.536740 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2c3d3e08-af25-4db3-8123-ffabcbd0f7a7 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:07:57.682432 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-2c3d3e08-af25-4db3-8123-ffabcbd0f7a7 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199e2426220e4cc4b1d37d4075e67cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9c33d4041764691b1ad69f9f1abe60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:07:57.691875 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-2c3d3e08-af25-4db3-8123-ffabcbd0f7a7 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] 10.222.0.26 "GET /compute/v2.1/servers/236c09e2-65bd-4ef5-88b1-032329b987cf" status: 200 len: 1679 microversion: 2.1 time: 0.169497 Oct 08 22:07:57.692839 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3502/7077] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:07:57 2022] GET /compute/v2.1/servers/236c09e2-65bd-4ef5-88b1-032329b987cf => generated 1679 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:07:58.715589 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-ef1f2a0b-ac1c-40d7-9748-92b58aa97b7e tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:07:58.716231 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-ef1f2a0b-ac1c-40d7-9748-92b58aa97b7e tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] [instance: 236c09e2-65bd-4ef5-88b1-032329b987cf] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:07:58.723258 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ef1f2a0b-ac1c-40d7-9748-92b58aa97b7e tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:07:58.723774 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ef1f2a0b-ac1c-40d7-9748-92b58aa97b7e tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:07:58.724281 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ef1f2a0b-ac1c-40d7-9748-92b58aa97b7e tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:07:58.725005 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ef1f2a0b-ac1c-40d7-9748-92b58aa97b7e tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:07:58.725521 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ef1f2a0b-ac1c-40d7-9748-92b58aa97b7e tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:07:58.725978 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-ef1f2a0b-ac1c-40d7-9748-92b58aa97b7e tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:07:58.859519 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-ef1f2a0b-ac1c-40d7-9748-92b58aa97b7e tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199e2426220e4cc4b1d37d4075e67cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9c33d4041764691b1ad69f9f1abe60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:07:58.868090 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-ef1f2a0b-ac1c-40d7-9748-92b58aa97b7e tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] 10.222.0.26 "GET /compute/v2.1/servers/236c09e2-65bd-4ef5-88b1-032329b987cf" status: 200 len: 1622 microversion: 2.1 time: 0.156512 Oct 08 22:07:58.868689 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3576/7078] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:07:58 2022] GET /compute/v2.1/servers/236c09e2-65bd-4ef5-88b1-032329b987cf => generated 1622 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:07:58.891061 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-af9e60d4-02dd-49d4-b435-edbc80791feb tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 22:07:58.891691 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-af9e60d4-02dd-49d4-b435-edbc80791feb tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] [instance: 236c09e2-65bd-4ef5-88b1-032329b987cf] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:07:58.898671 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-af9e60d4-02dd-49d4-b435-edbc80791feb tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:07:58.899172 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-af9e60d4-02dd-49d4-b435-edbc80791feb tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:07:58.899622 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-af9e60d4-02dd-49d4-b435-edbc80791feb tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:07:58.900370 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-af9e60d4-02dd-49d4-b435-edbc80791feb tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:07:58.900840 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-af9e60d4-02dd-49d4-b435-edbc80791feb tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:07:58.901309 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-af9e60d4-02dd-49d4-b435-edbc80791feb tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:07:58.983848 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-af9e60d4-02dd-49d4-b435-edbc80791feb tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] [instance: 236c09e2-65bd-4ef5-88b1-032329b987cf] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=140491) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 08 22:07:59.053865 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-af9e60d4-02dd-49d4-b435-edbc80791feb tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] 10.222.0.26 "POST /compute/v2.1/servers/236c09e2-65bd-4ef5-88b1-032329b987cf/action" status: 202 len: 0 microversion: 2.1 time: 0.166570 Oct 08 22:07:59.057575 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3503/7079] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 22:07:58 2022] POST /compute/v2.1/servers/236c09e2-65bd-4ef5-88b1-032329b987cf/action => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 08 22:07:59.062844 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-0e1f4424-1558-4c3a-be04-cb08dfeea507 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:07:59.063508 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-0e1f4424-1558-4c3a-be04-cb08dfeea507 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] [instance: 236c09e2-65bd-4ef5-88b1-032329b987cf] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:07:59.070569 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0e1f4424-1558-4c3a-be04-cb08dfeea507 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:07:59.071287 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0e1f4424-1558-4c3a-be04-cb08dfeea507 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:07:59.071533 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0e1f4424-1558-4c3a-be04-cb08dfeea507 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:07:59.072390 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0e1f4424-1558-4c3a-be04-cb08dfeea507 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:07:59.072762 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0e1f4424-1558-4c3a-be04-cb08dfeea507 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:07:59.073310 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0e1f4424-1558-4c3a-be04-cb08dfeea507 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:07:59.129850 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-d8f63114-7652-41c2-b04e-3effb91c8222 req-2d802b0d-ab07-4bc8-bd3f-da3c649d52ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "236c09e2-65bd-4ef5-88b1-032329b987cf", "name": "network-vif-unplugged", "status": "completed", "tag": "67f2d802-80ee-4e94-be87-3ffbcfcd063d"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 22:07:59.142464 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-d8f63114-7652-41c2-b04e-3effb91c8222 req-2d802b0d-ab07-4bc8-bd3f-da3c649d52ff service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:07:59.142967 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-d8f63114-7652-41c2-b04e-3effb91c8222 req-2d802b0d-ab07-4bc8-bd3f-da3c649d52ff service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:07:59.143438 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-d8f63114-7652-41c2-b04e-3effb91c8222 req-2d802b0d-ab07-4bc8-bd3f-da3c649d52ff service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:07:59.160645 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.compute.server_external_events [req-d8f63114-7652-41c2-b04e-3effb91c8222 req-2d802b0d-ab07-4bc8-bd3f-da3c649d52ff service nova] Unable to find a host for instance 236c09e2-65bd-4ef5-88b1-032329b987cf. Dropping event network-vif-unplugged {{(pid=140491) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 08 22:07:59.162294 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-d8f63114-7652-41c2-b04e-3effb91c8222 req-2d802b0d-ab07-4bc8-bd3f-da3c649d52ff service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.035843 Oct 08 22:07:59.163775 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3504/7080] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 22:07:59 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 39 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Oct 08 22:07:59.228170 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-0e1f4424-1558-4c3a-be04-cb08dfeea507 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199e2426220e4cc4b1d37d4075e67cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9c33d4041764691b1ad69f9f1abe60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:07:59.236555 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-0e1f4424-1558-4c3a-be04-cb08dfeea507 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] 10.222.0.26 "GET /compute/v2.1/servers/236c09e2-65bd-4ef5-88b1-032329b987cf" status: 200 len: 1630 microversion: 2.1 time: 0.177573 Oct 08 22:07:59.237235 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3577/7081] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:07:59 2022] GET /compute/v2.1/servers/236c09e2-65bd-4ef5-88b1-032329b987cf => generated 1630 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:08:00.261501 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-30d08082-259a-449a-b5f1-1ad0fd45108d tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:08:00.262102 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-30d08082-259a-449a-b5f1-1ad0fd45108d tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] [instance: 236c09e2-65bd-4ef5-88b1-032329b987cf] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:08:00.269021 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-30d08082-259a-449a-b5f1-1ad0fd45108d tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:08:00.269551 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-30d08082-259a-449a-b5f1-1ad0fd45108d tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:08:00.269997 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-30d08082-259a-449a-b5f1-1ad0fd45108d tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:08:00.270693 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-30d08082-259a-449a-b5f1-1ad0fd45108d tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:08:00.271759 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-30d08082-259a-449a-b5f1-1ad0fd45108d tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:08:00.272400 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-30d08082-259a-449a-b5f1-1ad0fd45108d tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:08:00.402604 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-30d08082-259a-449a-b5f1-1ad0fd45108d tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199e2426220e4cc4b1d37d4075e67cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9c33d4041764691b1ad69f9f1abe60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:08:00.410417 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-30d08082-259a-449a-b5f1-1ad0fd45108d tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] 10.222.0.26 "GET /compute/v2.1/servers/236c09e2-65bd-4ef5-88b1-032329b987cf" status: 200 len: 1688 microversion: 2.1 time: 0.152857 Oct 08 22:08:00.410998 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3505/7082] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:08:00 2022] GET /compute/v2.1/servers/236c09e2-65bd-4ef5-88b1-032329b987cf => generated 1688 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:08:01.408014 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-2d47227b-942d-4167-8d28-44d4004314c7 req-6f25fa6f-cad5-4ad9-b931-26219c9dbad1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "236c09e2-65bd-4ef5-88b1-032329b987cf", "tag": "67f2d802-80ee-4e94-be87-3ffbcfcd063d"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 22:08:01.418859 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-2d47227b-942d-4167-8d28-44d4004314c7 req-6f25fa6f-cad5-4ad9-b931-26219c9dbad1 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:08:01.419426 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-2d47227b-942d-4167-8d28-44d4004314c7 req-6f25fa6f-cad5-4ad9-b931-26219c9dbad1 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:08:01.419884 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-2d47227b-942d-4167-8d28-44d4004314c7 req-6f25fa6f-cad5-4ad9-b931-26219c9dbad1 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:08:01.432381 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-2d47227b-942d-4167-8d28-44d4004314c7 req-6f25fa6f-cad5-4ad9-b931-26219c9dbad1 service nova] Creating event network-changed:67f2d802-80ee-4e94-be87-3ffbcfcd063d for instance 236c09e2-65bd-4ef5-88b1-032329b987cf on nch1-master-1 Oct 08 22:08:01.435159 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-51802f65-d45a-4df9-a067-6cac67139c4c tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:08:01.435782 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-51802f65-d45a-4df9-a067-6cac67139c4c tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] [instance: 236c09e2-65bd-4ef5-88b1-032329b987cf] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:08:01.437657 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-2d47227b-942d-4167-8d28-44d4004314c7 req-6f25fa6f-cad5-4ad9-b931-26219c9dbad1 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093987 Oct 08 22:08:01.438423 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3578/7083] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 22:08:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 22:08:01.443198 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-51802f65-d45a-4df9-a067-6cac67139c4c tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:08:01.443708 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-51802f65-d45a-4df9-a067-6cac67139c4c tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:08:01.444166 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-51802f65-d45a-4df9-a067-6cac67139c4c tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:08:01.444985 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-51802f65-d45a-4df9-a067-6cac67139c4c tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:08:01.445478 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-51802f65-d45a-4df9-a067-6cac67139c4c tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:08:01.445922 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-51802f65-d45a-4df9-a067-6cac67139c4c tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:08:01.640407 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-51802f65-d45a-4df9-a067-6cac67139c4c tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199e2426220e4cc4b1d37d4075e67cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9c33d4041764691b1ad69f9f1abe60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:08:01.648966 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-51802f65-d45a-4df9-a067-6cac67139c4c tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] 10.222.0.26 "GET /compute/v2.1/servers/236c09e2-65bd-4ef5-88b1-032329b987cf" status: 200 len: 1688 microversion: 2.1 time: 0.218107 Oct 08 22:08:01.649657 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3506/7084] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:08:01 2022] GET /compute/v2.1/servers/236c09e2-65bd-4ef5-88b1-032329b987cf => generated 1688 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 22:08:02.672571 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-eb954bac-d2c3-481a-bd1d-e901bd9fbbdc tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:08:02.673364 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-eb954bac-d2c3-481a-bd1d-e901bd9fbbdc tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] [instance: 236c09e2-65bd-4ef5-88b1-032329b987cf] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:08:02.681902 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-eb954bac-d2c3-481a-bd1d-e901bd9fbbdc tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:08:02.682639 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-eb954bac-d2c3-481a-bd1d-e901bd9fbbdc tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:08:02.683286 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-eb954bac-d2c3-481a-bd1d-e901bd9fbbdc tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:08:02.684221 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-eb954bac-d2c3-481a-bd1d-e901bd9fbbdc tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:08:02.684867 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-eb954bac-d2c3-481a-bd1d-e901bd9fbbdc tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:08:02.685570 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-eb954bac-d2c3-481a-bd1d-e901bd9fbbdc tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:08:02.834623 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-eb954bac-d2c3-481a-bd1d-e901bd9fbbdc tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199e2426220e4cc4b1d37d4075e67cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9c33d4041764691b1ad69f9f1abe60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:08:02.843146 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-eb954bac-d2c3-481a-bd1d-e901bd9fbbdc tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] 10.222.0.26 "GET /compute/v2.1/servers/236c09e2-65bd-4ef5-88b1-032329b987cf" status: 200 len: 1688 microversion: 2.1 time: 0.174809 Oct 08 22:08:02.844381 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3579/7085] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:08:02 2022] GET /compute/v2.1/servers/236c09e2-65bd-4ef5-88b1-032329b987cf => generated 1688 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:08:03.869230 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-39fb018b-8fe3-4ff7-80ab-37af12878eda tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:08:03.869979 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-39fb018b-8fe3-4ff7-80ab-37af12878eda tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] [instance: 236c09e2-65bd-4ef5-88b1-032329b987cf] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:08:03.873417 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 22:08:03.891234 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-39fb018b-8fe3-4ff7-80ab-37af12878eda tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:08:03.891774 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-39fb018b-8fe3-4ff7-80ab-37af12878eda tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:08:03.892205 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-39fb018b-8fe3-4ff7-80ab-37af12878eda tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:08:03.892945 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-39fb018b-8fe3-4ff7-80ab-37af12878eda tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:08:03.893610 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-39fb018b-8fe3-4ff7-80ab-37af12878eda tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:08:03.894054 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-39fb018b-8fe3-4ff7-80ab-37af12878eda tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:08:03.906809 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 22:08:04.066325 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-39fb018b-8fe3-4ff7-80ab-37af12878eda tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199e2426220e4cc4b1d37d4075e67cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9c33d4041764691b1ad69f9f1abe60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:08:04.078179 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-39fb018b-8fe3-4ff7-80ab-37af12878eda tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] 10.222.0.26 "GET /compute/v2.1/servers/236c09e2-65bd-4ef5-88b1-032329b987cf" status: 200 len: 1688 microversion: 2.1 time: 0.213986 Oct 08 22:08:04.079519 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3507/7086] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:08:03 2022] GET /compute/v2.1/servers/236c09e2-65bd-4ef5-88b1-032329b987cf => generated 1688 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:08:05.102548 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-7519e2f7-28c2-4160-8af5-862ed28acea7 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:08:05.103845 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-7519e2f7-28c2-4160-8af5-862ed28acea7 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] [instance: 236c09e2-65bd-4ef5-88b1-032329b987cf] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:08:05.106124 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=31 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 22:08:05.112092 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7519e2f7-28c2-4160-8af5-862ed28acea7 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:08:05.112610 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7519e2f7-28c2-4160-8af5-862ed28acea7 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:08:05.113071 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7519e2f7-28c2-4160-8af5-862ed28acea7 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:08:05.113988 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7519e2f7-28c2-4160-8af5-862ed28acea7 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:08:05.115012 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7519e2f7-28c2-4160-8af5-862ed28acea7 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:08:05.115480 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7519e2f7-28c2-4160-8af5-862ed28acea7 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:08:05.118345 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 22:08:05.260321 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-7519e2f7-28c2-4160-8af5-862ed28acea7 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199e2426220e4cc4b1d37d4075e67cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9c33d4041764691b1ad69f9f1abe60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:08:05.268273 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-7519e2f7-28c2-4160-8af5-862ed28acea7 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] 10.222.0.26 "GET /compute/v2.1/servers/236c09e2-65bd-4ef5-88b1-032329b987cf" status: 200 len: 1688 microversion: 2.1 time: 0.170467 Oct 08 22:08:05.269054 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3580/7087] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:08:05 2022] GET /compute/v2.1/servers/236c09e2-65bd-4ef5-88b1-032329b987cf => generated 1688 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:08:06.291829 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-dfb2b853-b293-4358-88ac-f2bee010c06a tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:08:06.292449 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-dfb2b853-b293-4358-88ac-f2bee010c06a tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] [instance: 236c09e2-65bd-4ef5-88b1-032329b987cf] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:08:06.298634 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dfb2b853-b293-4358-88ac-f2bee010c06a tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:08:06.299131 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dfb2b853-b293-4358-88ac-f2bee010c06a tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:08:06.299583 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dfb2b853-b293-4358-88ac-f2bee010c06a tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:08:06.300288 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dfb2b853-b293-4358-88ac-f2bee010c06a tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:08:06.300757 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dfb2b853-b293-4358-88ac-f2bee010c06a tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:08:06.301216 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-dfb2b853-b293-4358-88ac-f2bee010c06a tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:08:06.450088 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-dfb2b853-b293-4358-88ac-f2bee010c06a tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199e2426220e4cc4b1d37d4075e67cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9c33d4041764691b1ad69f9f1abe60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:08:06.459332 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-dfb2b853-b293-4358-88ac-f2bee010c06a tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] 10.222.0.26 "GET /compute/v2.1/servers/236c09e2-65bd-4ef5-88b1-032329b987cf" status: 200 len: 1688 microversion: 2.1 time: 0.171665 Oct 08 22:08:06.460022 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3508/7088] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:08:06 2022] GET /compute/v2.1/servers/236c09e2-65bd-4ef5-88b1-032329b987cf => generated 1688 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:08:07.489842 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-519bd26d-26ae-4d27-9638-7372afc91ca9 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:08:07.491700 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-519bd26d-26ae-4d27-9638-7372afc91ca9 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] [instance: 236c09e2-65bd-4ef5-88b1-032329b987cf] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:08:07.500291 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-519bd26d-26ae-4d27-9638-7372afc91ca9 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:08:07.500811 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-519bd26d-26ae-4d27-9638-7372afc91ca9 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:08:07.501494 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-519bd26d-26ae-4d27-9638-7372afc91ca9 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:08:07.502187 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-519bd26d-26ae-4d27-9638-7372afc91ca9 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:08:07.502669 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-519bd26d-26ae-4d27-9638-7372afc91ca9 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:08:07.503127 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-519bd26d-26ae-4d27-9638-7372afc91ca9 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:08:07.641206 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-519bd26d-26ae-4d27-9638-7372afc91ca9 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199e2426220e4cc4b1d37d4075e67cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9c33d4041764691b1ad69f9f1abe60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:08:07.649662 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-519bd26d-26ae-4d27-9638-7372afc91ca9 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] 10.222.0.26 "GET /compute/v2.1/servers/236c09e2-65bd-4ef5-88b1-032329b987cf" status: 200 len: 1688 microversion: 2.1 time: 0.170019 Oct 08 22:08:07.650250 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3581/7089] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:08:07 2022] GET /compute/v2.1/servers/236c09e2-65bd-4ef5-88b1-032329b987cf => generated 1688 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:08:08.674023 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-7e7eba5a-586d-4e18-be3c-3f6726b1be5f tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:08:08.675511 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-7e7eba5a-586d-4e18-be3c-3f6726b1be5f tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] [instance: 236c09e2-65bd-4ef5-88b1-032329b987cf] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:08:08.684216 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7e7eba5a-586d-4e18-be3c-3f6726b1be5f tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:08:08.684849 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7e7eba5a-586d-4e18-be3c-3f6726b1be5f tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:08:08.685425 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7e7eba5a-586d-4e18-be3c-3f6726b1be5f tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:08:08.686538 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7e7eba5a-586d-4e18-be3c-3f6726b1be5f tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:08:08.686666 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7e7eba5a-586d-4e18-be3c-3f6726b1be5f tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:08:08.687605 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7e7eba5a-586d-4e18-be3c-3f6726b1be5f tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:08:08.828105 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-7e7eba5a-586d-4e18-be3c-3f6726b1be5f tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199e2426220e4cc4b1d37d4075e67cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9c33d4041764691b1ad69f9f1abe60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:08:08.836621 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-7e7eba5a-586d-4e18-be3c-3f6726b1be5f tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] 10.222.0.26 "GET /compute/v2.1/servers/236c09e2-65bd-4ef5-88b1-032329b987cf" status: 200 len: 1688 microversion: 2.1 time: 0.166904 Oct 08 22:08:08.837225 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3509/7090] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:08:08 2022] GET /compute/v2.1/servers/236c09e2-65bd-4ef5-88b1-032329b987cf => generated 1688 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:08:09.860381 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-0370a255-c88c-4204-b7bf-f2727680bb91 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:08:09.861101 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-0370a255-c88c-4204-b7bf-f2727680bb91 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] [instance: 236c09e2-65bd-4ef5-88b1-032329b987cf] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:08:09.869521 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0370a255-c88c-4204-b7bf-f2727680bb91 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:08:09.870033 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0370a255-c88c-4204-b7bf-f2727680bb91 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:08:09.870490 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0370a255-c88c-4204-b7bf-f2727680bb91 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:08:09.871215 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0370a255-c88c-4204-b7bf-f2727680bb91 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:08:09.871692 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0370a255-c88c-4204-b7bf-f2727680bb91 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:08:09.872132 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0370a255-c88c-4204-b7bf-f2727680bb91 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:08:10.003570 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-0370a255-c88c-4204-b7bf-f2727680bb91 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199e2426220e4cc4b1d37d4075e67cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9c33d4041764691b1ad69f9f1abe60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:08:10.012205 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-0370a255-c88c-4204-b7bf-f2727680bb91 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] 10.222.0.26 "GET /compute/v2.1/servers/236c09e2-65bd-4ef5-88b1-032329b987cf" status: 200 len: 1688 microversion: 2.1 time: 0.155946 Oct 08 22:08:10.012802 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3582/7091] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:08:09 2022] GET /compute/v2.1/servers/236c09e2-65bd-4ef5-88b1-032329b987cf => generated 1688 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:08:11.035686 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-4f1d6078-a4f7-40bc-96cf-b8c9d237b354 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:08:11.037504 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-4f1d6078-a4f7-40bc-96cf-b8c9d237b354 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] [instance: 236c09e2-65bd-4ef5-88b1-032329b987cf] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:08:11.046734 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4f1d6078-a4f7-40bc-96cf-b8c9d237b354 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:08:11.047587 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4f1d6078-a4f7-40bc-96cf-b8c9d237b354 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:08:11.048448 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4f1d6078-a4f7-40bc-96cf-b8c9d237b354 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:08:11.049761 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4f1d6078-a4f7-40bc-96cf-b8c9d237b354 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:08:11.050530 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4f1d6078-a4f7-40bc-96cf-b8c9d237b354 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:08:11.052377 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-4f1d6078-a4f7-40bc-96cf-b8c9d237b354 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:08:11.225822 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-4f1d6078-a4f7-40bc-96cf-b8c9d237b354 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199e2426220e4cc4b1d37d4075e67cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9c33d4041764691b1ad69f9f1abe60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:08:11.233661 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-4f1d6078-a4f7-40bc-96cf-b8c9d237b354 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] 10.222.0.26 "GET /compute/v2.1/servers/236c09e2-65bd-4ef5-88b1-032329b987cf" status: 200 len: 1688 microversion: 2.1 time: 0.201936 Oct 08 22:08:11.234244 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3510/7092] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:08:11 2022] GET /compute/v2.1/servers/236c09e2-65bd-4ef5-88b1-032329b987cf => generated 1688 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:08:12.256636 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-cf44a51f-eb11-4c4a-a6c1-302eca082005 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:08:12.257321 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-cf44a51f-eb11-4c4a-a6c1-302eca082005 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] [instance: 236c09e2-65bd-4ef5-88b1-032329b987cf] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:08:12.264276 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cf44a51f-eb11-4c4a-a6c1-302eca082005 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:08:12.264789 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cf44a51f-eb11-4c4a-a6c1-302eca082005 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:08:12.265272 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cf44a51f-eb11-4c4a-a6c1-302eca082005 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:08:12.266004 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cf44a51f-eb11-4c4a-a6c1-302eca082005 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:08:12.266488 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cf44a51f-eb11-4c4a-a6c1-302eca082005 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:08:12.266946 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cf44a51f-eb11-4c4a-a6c1-302eca082005 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:08:12.398855 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-cf44a51f-eb11-4c4a-a6c1-302eca082005 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199e2426220e4cc4b1d37d4075e67cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9c33d4041764691b1ad69f9f1abe60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:08:12.406803 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-cf44a51f-eb11-4c4a-a6c1-302eca082005 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] 10.222.0.26 "GET /compute/v2.1/servers/236c09e2-65bd-4ef5-88b1-032329b987cf" status: 200 len: 1688 microversion: 2.1 time: 0.154908 Oct 08 22:08:12.407392 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3583/7093] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:08:12 2022] GET /compute/v2.1/servers/236c09e2-65bd-4ef5-88b1-032329b987cf => generated 1688 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:08:13.430342 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-482dc3ea-ca0d-4738-9fc3-caa659f68292 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:08:13.430911 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-482dc3ea-ca0d-4738-9fc3-caa659f68292 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] [instance: 236c09e2-65bd-4ef5-88b1-032329b987cf] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:08:13.438041 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-482dc3ea-ca0d-4738-9fc3-caa659f68292 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:08:13.438547 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-482dc3ea-ca0d-4738-9fc3-caa659f68292 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:08:13.439036 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-482dc3ea-ca0d-4738-9fc3-caa659f68292 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:08:13.439756 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-482dc3ea-ca0d-4738-9fc3-caa659f68292 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:08:13.440234 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-482dc3ea-ca0d-4738-9fc3-caa659f68292 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:08:13.440677 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-482dc3ea-ca0d-4738-9fc3-caa659f68292 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:08:13.573862 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-482dc3ea-ca0d-4738-9fc3-caa659f68292 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199e2426220e4cc4b1d37d4075e67cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9c33d4041764691b1ad69f9f1abe60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:08:13.581719 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-482dc3ea-ca0d-4738-9fc3-caa659f68292 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] 10.222.0.26 "GET /compute/v2.1/servers/236c09e2-65bd-4ef5-88b1-032329b987cf" status: 200 len: 1688 microversion: 2.1 time: 0.155819 Oct 08 22:08:13.582296 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3511/7094] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:08:13 2022] GET /compute/v2.1/servers/236c09e2-65bd-4ef5-88b1-032329b987cf => generated 1688 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:08:14.604795 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-6981fcd7-fcdd-4d9f-94d8-26fc9a22626b tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:08:14.605404 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-6981fcd7-fcdd-4d9f-94d8-26fc9a22626b tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] [instance: 236c09e2-65bd-4ef5-88b1-032329b987cf] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:08:14.612437 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6981fcd7-fcdd-4d9f-94d8-26fc9a22626b tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:08:14.612962 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6981fcd7-fcdd-4d9f-94d8-26fc9a22626b tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:08:14.613456 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6981fcd7-fcdd-4d9f-94d8-26fc9a22626b tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:08:14.614191 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6981fcd7-fcdd-4d9f-94d8-26fc9a22626b tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:08:14.614681 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6981fcd7-fcdd-4d9f-94d8-26fc9a22626b tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:08:14.615142 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6981fcd7-fcdd-4d9f-94d8-26fc9a22626b tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:08:14.749811 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-6981fcd7-fcdd-4d9f-94d8-26fc9a22626b tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199e2426220e4cc4b1d37d4075e67cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9c33d4041764691b1ad69f9f1abe60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:08:14.757716 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-6981fcd7-fcdd-4d9f-94d8-26fc9a22626b tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] 10.222.0.26 "GET /compute/v2.1/servers/236c09e2-65bd-4ef5-88b1-032329b987cf" status: 200 len: 1688 microversion: 2.1 time: 0.157049 Oct 08 22:08:14.758302 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3584/7095] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:08:14 2022] GET /compute/v2.1/servers/236c09e2-65bd-4ef5-88b1-032329b987cf => generated 1688 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:08:15.781247 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-1ff6df4b-49bd-4ba3-85cf-09f95ae16c8c tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:08:15.781773 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-1ff6df4b-49bd-4ba3-85cf-09f95ae16c8c tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] [instance: 236c09e2-65bd-4ef5-88b1-032329b987cf] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:08:15.789306 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1ff6df4b-49bd-4ba3-85cf-09f95ae16c8c tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:08:15.789797 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1ff6df4b-49bd-4ba3-85cf-09f95ae16c8c tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:08:15.790241 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1ff6df4b-49bd-4ba3-85cf-09f95ae16c8c tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:08:15.790938 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1ff6df4b-49bd-4ba3-85cf-09f95ae16c8c tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:08:15.791396 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1ff6df4b-49bd-4ba3-85cf-09f95ae16c8c tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:08:15.791828 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1ff6df4b-49bd-4ba3-85cf-09f95ae16c8c tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:08:15.923539 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-1ff6df4b-49bd-4ba3-85cf-09f95ae16c8c tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199e2426220e4cc4b1d37d4075e67cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9c33d4041764691b1ad69f9f1abe60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:08:15.932216 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-1ff6df4b-49bd-4ba3-85cf-09f95ae16c8c tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] 10.222.0.26 "GET /compute/v2.1/servers/236c09e2-65bd-4ef5-88b1-032329b987cf" status: 200 len: 1688 microversion: 2.1 time: 0.155376 Oct 08 22:08:15.932787 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3512/7096] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:08:15 2022] GET /compute/v2.1/servers/236c09e2-65bd-4ef5-88b1-032329b987cf => generated 1688 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:08:16.956936 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e9209c02-c637-47a9-a260-b10318575b92 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:08:16.957671 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-e9209c02-c637-47a9-a260-b10318575b92 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] [instance: 236c09e2-65bd-4ef5-88b1-032329b987cf] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:08:16.964781 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e9209c02-c637-47a9-a260-b10318575b92 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:08:16.965333 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e9209c02-c637-47a9-a260-b10318575b92 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:08:16.965792 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e9209c02-c637-47a9-a260-b10318575b92 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:08:16.966734 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e9209c02-c637-47a9-a260-b10318575b92 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:08:16.967218 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e9209c02-c637-47a9-a260-b10318575b92 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:08:16.967668 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e9209c02-c637-47a9-a260-b10318575b92 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:08:17.106633 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-e9209c02-c637-47a9-a260-b10318575b92 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199e2426220e4cc4b1d37d4075e67cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9c33d4041764691b1ad69f9f1abe60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:08:17.114778 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-e9209c02-c637-47a9-a260-b10318575b92 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] 10.222.0.26 "GET /compute/v2.1/servers/236c09e2-65bd-4ef5-88b1-032329b987cf" status: 200 len: 1688 microversion: 2.1 time: 0.161751 Oct 08 22:08:17.116084 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3585/7097] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:08:16 2022] GET /compute/v2.1/servers/236c09e2-65bd-4ef5-88b1-032329b987cf => generated 1688 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:08:18.139049 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-3646e00b-2ed8-4607-b48d-698c91f2921b tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:08:18.139691 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-3646e00b-2ed8-4607-b48d-698c91f2921b tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] [instance: 236c09e2-65bd-4ef5-88b1-032329b987cf] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:08:18.147300 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3646e00b-2ed8-4607-b48d-698c91f2921b tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:08:18.147815 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3646e00b-2ed8-4607-b48d-698c91f2921b tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:08:18.148258 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3646e00b-2ed8-4607-b48d-698c91f2921b tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:08:18.148954 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3646e00b-2ed8-4607-b48d-698c91f2921b tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:08:18.149449 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3646e00b-2ed8-4607-b48d-698c91f2921b tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:08:18.149908 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3646e00b-2ed8-4607-b48d-698c91f2921b tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:08:18.283274 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-3646e00b-2ed8-4607-b48d-698c91f2921b tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199e2426220e4cc4b1d37d4075e67cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9c33d4041764691b1ad69f9f1abe60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:08:18.291138 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-3646e00b-2ed8-4607-b48d-698c91f2921b tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] 10.222.0.26 "GET /compute/v2.1/servers/236c09e2-65bd-4ef5-88b1-032329b987cf" status: 200 len: 1688 microversion: 2.1 time: 0.156094 Oct 08 22:08:18.291756 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3513/7098] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:08:18 2022] GET /compute/v2.1/servers/236c09e2-65bd-4ef5-88b1-032329b987cf => generated 1688 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:08:18.558164 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-dd3b4ce0-9bc2-46e6-8ca5-e94c310b0080 req-a7c92177-80ba-4eb4-8892-25110e42cd6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "236c09e2-65bd-4ef5-88b1-032329b987cf", "name": "network-vif-plugged", "status": "completed", "tag": "67f2d802-80ee-4e94-be87-3ffbcfcd063d"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 22:08:18.569912 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-dd3b4ce0-9bc2-46e6-8ca5-e94c310b0080 req-a7c92177-80ba-4eb4-8892-25110e42cd6b service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:08:18.570412 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-dd3b4ce0-9bc2-46e6-8ca5-e94c310b0080 req-a7c92177-80ba-4eb4-8892-25110e42cd6b service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:08:18.570937 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-dd3b4ce0-9bc2-46e6-8ca5-e94c310b0080 req-a7c92177-80ba-4eb4-8892-25110e42cd6b service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:08:18.582100 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-dd3b4ce0-9bc2-46e6-8ca5-e94c310b0080 req-a7c92177-80ba-4eb4-8892-25110e42cd6b service nova] Creating event network-vif-plugged:67f2d802-80ee-4e94-be87-3ffbcfcd063d for instance 236c09e2-65bd-4ef5-88b1-032329b987cf on nch1-master-1 Oct 08 22:08:18.587269 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-dd3b4ce0-9bc2-46e6-8ca5-e94c310b0080 req-a7c92177-80ba-4eb4-8892-25110e42cd6b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032971 Oct 08 22:08:18.587873 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3586/7099] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 22:08:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 22:08:19.315091 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-60c89949-72a9-4022-a7ea-48da5b5b59db tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:08:19.315740 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-60c89949-72a9-4022-a7ea-48da5b5b59db tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] [instance: 236c09e2-65bd-4ef5-88b1-032329b987cf] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:08:19.323317 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-60c89949-72a9-4022-a7ea-48da5b5b59db tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:08:19.323810 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-60c89949-72a9-4022-a7ea-48da5b5b59db tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:08:19.324258 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-60c89949-72a9-4022-a7ea-48da5b5b59db tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:08:19.324969 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-60c89949-72a9-4022-a7ea-48da5b5b59db tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:08:19.325579 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-60c89949-72a9-4022-a7ea-48da5b5b59db tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:08:19.326016 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-60c89949-72a9-4022-a7ea-48da5b5b59db tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:08:19.461754 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-60c89949-72a9-4022-a7ea-48da5b5b59db tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199e2426220e4cc4b1d37d4075e67cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9c33d4041764691b1ad69f9f1abe60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:08:19.469597 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-60c89949-72a9-4022-a7ea-48da5b5b59db tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] 10.222.0.26 "GET /compute/v2.1/servers/236c09e2-65bd-4ef5-88b1-032329b987cf" status: 200 len: 1688 microversion: 2.1 time: 0.158461 Oct 08 22:08:19.470197 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3514/7100] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:08:19 2022] GET /compute/v2.1/servers/236c09e2-65bd-4ef5-88b1-032329b987cf => generated 1688 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:08:20.494308 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-255e8347-8834-446a-a736-63ac239004e5 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:08:20.495015 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-255e8347-8834-446a-a736-63ac239004e5 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] [instance: 236c09e2-65bd-4ef5-88b1-032329b987cf] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:08:20.501459 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-255e8347-8834-446a-a736-63ac239004e5 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:08:20.501974 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-255e8347-8834-446a-a736-63ac239004e5 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:08:20.502445 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-255e8347-8834-446a-a736-63ac239004e5 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:08:20.503196 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-255e8347-8834-446a-a736-63ac239004e5 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:08:20.503651 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-255e8347-8834-446a-a736-63ac239004e5 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:08:20.504106 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-255e8347-8834-446a-a736-63ac239004e5 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:08:20.645176 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-255e8347-8834-446a-a736-63ac239004e5 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199e2426220e4cc4b1d37d4075e67cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9c33d4041764691b1ad69f9f1abe60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:08:20.653671 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-255e8347-8834-446a-a736-63ac239004e5 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] 10.222.0.26 "GET /compute/v2.1/servers/236c09e2-65bd-4ef5-88b1-032329b987cf" status: 200 len: 1675 microversion: 2.1 time: 0.165090 Oct 08 22:08:20.654256 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3587/7101] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:08:20 2022] GET /compute/v2.1/servers/236c09e2-65bd-4ef5-88b1-032329b987cf => generated 1675 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:09:36.985904 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:SELECT=15 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 22:09:36.990497 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=15 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 22:09:36.991827 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=47 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 22:09:36.993083 ncdv-master-1 devstack@n-api.service[140491]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 08 22:09:36.993322 ncdv-master-1 devstack@n-api.service[140491]: Sat Oct 8 22:09:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/236c09e2-65bd-4ef5-88b1-032329b987cf (ip 10.222.0.26) !!! Oct 08 22:09:36.997740 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-e0a5236f-7807-44be-ac06-3371465c69be tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:09:36.998245 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-e0a5236f-7807-44be-ac06-3371465c69be tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] [instance: 236c09e2-65bd-4ef5-88b1-032329b987cf] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:09:37.001986 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=43 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 22:09:37.002913 ncdv-master-1 devstack@n-api.service[140492]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 08 22:09:37.003062 ncdv-master-1 devstack@n-api.service[140492]: Sat Oct 8 22:09:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.26) !!! Oct 08 22:09:37.004367 ncdv-master-1 devstack@n-api.service[140492]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 08 22:09:37.004510 ncdv-master-1 devstack@n-api.service[140492]: Sat Oct 8 22:09:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.26) !!! Oct 08 22:09:37.009853 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-e6a4101d-c775-463c-b2d5-48b68a53da5b req-5ff9d22c-74ae-4afe-99c2-5906258a14a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "236c09e2-65bd-4ef5-88b1-032329b987cf", "tag": "67f2d802-80ee-4e94-be87-3ffbcfcd063d"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 22:09:37.026054 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e0a5236f-7807-44be-ac06-3371465c69be tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:09:37.026546 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e0a5236f-7807-44be-ac06-3371465c69be tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:09:37.026992 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e0a5236f-7807-44be-ac06-3371465c69be tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:09:37.027712 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e0a5236f-7807-44be-ac06-3371465c69be tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:09:37.028172 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e0a5236f-7807-44be-ac06-3371465c69be tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:09:37.028605 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-e0a5236f-7807-44be-ac06-3371465c69be tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:09:37.036317 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-e6a4101d-c775-463c-b2d5-48b68a53da5b req-5ff9d22c-74ae-4afe-99c2-5906258a14a9 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:09:37.036927 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-e6a4101d-c775-463c-b2d5-48b68a53da5b req-5ff9d22c-74ae-4afe-99c2-5906258a14a9 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:09:37.037482 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-e6a4101d-c775-463c-b2d5-48b68a53da5b req-5ff9d22c-74ae-4afe-99c2-5906258a14a9 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:09:37.056825 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-e0a5236f-7807-44be-ac06-3371465c69be tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] [instance: 236c09e2-65bd-4ef5-88b1-032329b987cf] Going to try to terminate instance {{(pid=140491) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 22:09:37.057075 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-e6a4101d-c775-463c-b2d5-48b68a53da5b req-5ff9d22c-74ae-4afe-99c2-5906258a14a9 service nova] Creating event network-changed:67f2d802-80ee-4e94-be87-3ffbcfcd063d for instance 236c09e2-65bd-4ef5-88b1-032329b987cf on nch1-master-1 Oct 08 22:09:37.063820 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-e6a4101d-c775-463c-b2d5-48b68a53da5b req-5ff9d22c-74ae-4afe-99c2-5906258a14a9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075090 Oct 08 22:09:37.064639 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3588/7102] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 22:09:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 22:09:37.143203 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-e0a5236f-7807-44be-ac06-3371465c69be tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] 10.222.0.26 "DELETE /compute/v2.1/servers/236c09e2-65bd-4ef5-88b1-032329b987cf" status: 204 len: 0 microversion: 2.1 time: 0.158931 Oct 08 22:09:37.144051 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3515/7103] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 22:09:36 2022] DELETE /compute/v2.1/servers/236c09e2-65bd-4ef5-88b1-032329b987cf => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 22:09:37.153164 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-265c42b0-c2e8-49ca-b40c-09e6872478db tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:09:37.154127 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-265c42b0-c2e8-49ca-b40c-09e6872478db tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] [instance: 236c09e2-65bd-4ef5-88b1-032329b987cf] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:09:37.162302 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-265c42b0-c2e8-49ca-b40c-09e6872478db tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:09:37.162812 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-265c42b0-c2e8-49ca-b40c-09e6872478db tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:09:37.163266 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-265c42b0-c2e8-49ca-b40c-09e6872478db tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:09:37.163992 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-265c42b0-c2e8-49ca-b40c-09e6872478db tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:09:37.164633 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-265c42b0-c2e8-49ca-b40c-09e6872478db tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:09:37.165091 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-265c42b0-c2e8-49ca-b40c-09e6872478db tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:09:37.301815 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-265c42b0-c2e8-49ca-b40c-09e6872478db tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199e2426220e4cc4b1d37d4075e67cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9c33d4041764691b1ad69f9f1abe60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:09:37.310046 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-265c42b0-c2e8-49ca-b40c-09e6872478db tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] 10.222.0.26 "GET /compute/v2.1/servers/236c09e2-65bd-4ef5-88b1-032329b987cf" status: 200 len: 1681 microversion: 2.1 time: 0.161467 Oct 08 22:09:37.310636 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3589/7104] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:09:37 2022] GET /compute/v2.1/servers/236c09e2-65bd-4ef5-88b1-032329b987cf => generated 1681 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:09:38.334737 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-630ce54e-1332-4c07-8620-477ab2f6b53f tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:09:38.335576 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-630ce54e-1332-4c07-8620-477ab2f6b53f tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] [instance: 236c09e2-65bd-4ef5-88b1-032329b987cf] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:09:38.342720 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-630ce54e-1332-4c07-8620-477ab2f6b53f tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:09:38.343218 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-630ce54e-1332-4c07-8620-477ab2f6b53f tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:09:38.343665 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-630ce54e-1332-4c07-8620-477ab2f6b53f tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:09:38.344389 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-630ce54e-1332-4c07-8620-477ab2f6b53f tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:09:38.344858 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-630ce54e-1332-4c07-8620-477ab2f6b53f tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:09:38.345326 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-630ce54e-1332-4c07-8620-477ab2f6b53f tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:09:38.512724 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-630ce54e-1332-4c07-8620-477ab2f6b53f tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199e2426220e4cc4b1d37d4075e67cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9c33d4041764691b1ad69f9f1abe60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:09:38.520873 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-630ce54e-1332-4c07-8620-477ab2f6b53f tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] 10.222.0.26 "GET /compute/v2.1/servers/236c09e2-65bd-4ef5-88b1-032329b987cf" status: 200 len: 1681 microversion: 2.1 time: 0.190537 Oct 08 22:09:38.521701 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3516/7105] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:09:38 2022] GET /compute/v2.1/servers/236c09e2-65bd-4ef5-88b1-032329b987cf => generated 1681 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:09:39.138716 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-53c19e7e-4cca-4311-a2ed-fc77740f62a3 req-40ad8ab6-13e3-4e00-9b91-37be5c8b3b4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "236c09e2-65bd-4ef5-88b1-032329b987cf", "name": "network-vif-deleted", "tag": "67f2d802-80ee-4e94-be87-3ffbcfcd063d"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 22:09:39.149516 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-53c19e7e-4cca-4311-a2ed-fc77740f62a3 req-40ad8ab6-13e3-4e00-9b91-37be5c8b3b4f service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:09:39.150346 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-53c19e7e-4cca-4311-a2ed-fc77740f62a3 req-40ad8ab6-13e3-4e00-9b91-37be5c8b3b4f service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:09:39.151207 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-53c19e7e-4cca-4311-a2ed-fc77740f62a3 req-40ad8ab6-13e3-4e00-9b91-37be5c8b3b4f service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:09:39.168316 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-53c19e7e-4cca-4311-a2ed-fc77740f62a3 req-40ad8ab6-13e3-4e00-9b91-37be5c8b3b4f service nova] Creating event network-vif-deleted:67f2d802-80ee-4e94-be87-3ffbcfcd063d for instance 236c09e2-65bd-4ef5-88b1-032329b987cf on nch1-master-1 Oct 08 22:09:39.173764 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-53c19e7e-4cca-4311-a2ed-fc77740f62a3 req-40ad8ab6-13e3-4e00-9b91-37be5c8b3b4f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098976 Oct 08 22:09:39.174551 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3590/7106] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 22:09:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 22:09:39.543841 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-787bbebb-1ae6-4490-a940-51b18797589d tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:09:39.544609 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-787bbebb-1ae6-4490-a940-51b18797589d tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] [instance: 236c09e2-65bd-4ef5-88b1-032329b987cf] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:09:39.553069 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-787bbebb-1ae6-4490-a940-51b18797589d tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:09:39.553606 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-787bbebb-1ae6-4490-a940-51b18797589d tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:09:39.554057 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-787bbebb-1ae6-4490-a940-51b18797589d tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:09:39.554824 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-787bbebb-1ae6-4490-a940-51b18797589d tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:09:39.555297 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-787bbebb-1ae6-4490-a940-51b18797589d tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:09:39.555738 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-787bbebb-1ae6-4490-a940-51b18797589d tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:09:39.588747 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-787bbebb-1ae6-4490-a940-51b18797589d tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:09:39.589475 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-787bbebb-1ae6-4490-a940-51b18797589d tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:09:39.589928 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-787bbebb-1ae6-4490-a940-51b18797589d tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:09:39.590391 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.objects.instance [None req-787bbebb-1ae6-4490-a940-51b18797589d tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lazy-loading 'fault' on Instance uuid 236c09e2-65bd-4ef5-88b1-032329b987cf {{(pid=140491) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 22:09:39.639257 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-787bbebb-1ae6-4490-a940-51b18797589d tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199e2426220e4cc4b1d37d4075e67cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9c33d4041764691b1ad69f9f1abe60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:09:39.647624 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-787bbebb-1ae6-4490-a940-51b18797589d tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] 10.222.0.26 "GET /compute/v2.1/servers/236c09e2-65bd-4ef5-88b1-032329b987cf" status: 200 len: 1335 microversion: 2.1 time: 0.107643 Oct 08 22:09:39.648388 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3517/7107] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:09:39 2022] GET /compute/v2.1/servers/236c09e2-65bd-4ef5-88b1-032329b987cf => generated 1335 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:09:40.671739 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-7c4a3bf1-ee06-468a-9a4b-c08c1c47c0e2 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:09:40.672466 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-7c4a3bf1-ee06-468a-9a4b-c08c1c47c0e2 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] [instance: 236c09e2-65bd-4ef5-88b1-032329b987cf] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:09:40.679871 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7c4a3bf1-ee06-468a-9a4b-c08c1c47c0e2 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:09:40.680369 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7c4a3bf1-ee06-468a-9a4b-c08c1c47c0e2 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:09:40.680822 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7c4a3bf1-ee06-468a-9a4b-c08c1c47c0e2 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:09:40.681565 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7c4a3bf1-ee06-468a-9a4b-c08c1c47c0e2 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:09:40.682050 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7c4a3bf1-ee06-468a-9a4b-c08c1c47c0e2 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:09:40.682495 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7c4a3bf1-ee06-468a-9a4b-c08c1c47c0e2 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:09:40.696308 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-7c4a3bf1-ee06-468a-9a4b-c08c1c47c0e2 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] HTTP exception thrown: Instance 236c09e2-65bd-4ef5-88b1-032329b987cf could not be found. Oct 08 22:09:40.698229 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-7c4a3bf1-ee06-468a-9a4b-c08c1c47c0e2 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Request method failure captured: Oct 08 22:09:40.698229 ncdv-master-1 devstack@n-api.service[140492]: request: GET /compute/v2.1/servers/236c09e2-65bd-4ef5-88b1-032329b987cf HTTP/1.1 Oct 08 22:09:40.698229 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 22:09:40.698229 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 22:09:40.698229 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 22:09:40.698229 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 22:09:40.698229 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 22:09:40.698229 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 22:09:40.698229 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 22:09:40.698229 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 22:09:40.698229 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQfQfwOeOD_h28ZXUX0Mio5ykOzikUZ3e8zaAvCoxjW8dzIN62JUSUwvibd0TyKESjD6um23qOgep7ErNu7l16yQbbY1R9acWaVK17v15lYnMb25_LNwTUs17Vs9WrNNcn-D5yP_b9HqZH-fh2_bvi3SY-CWgCAaFy3CkiagVNowU7WA Oct 08 22:09:40.698229 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 22:09:40.698229 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 22:09:40.698229 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 22:09:40.698229 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 22:09:40.698229 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 22:09:40.698229 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 22:09:40.698229 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: b9c33d4041764691b1ad69f9f1abe60b Oct 08 22:09:40.698229 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-TestShelveInstance-1230879253 Oct 08 22:09:40.698229 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 22:09:40.698229 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 22:09:40.698229 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b9c33d4041764691b1ad69f9f1abe60b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b9c33d4041764691b1ad69f9f1abe60b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b9c33d4041764691b1ad69f9f1abe60b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b9c33d4041764691b1ad69f9f1abe60b"}]}] Oct 08 22:09:40.698229 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-TestShelveInstance-1230879253 Oct 08 22:09:40.698229 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: b9c33d4041764691b1ad69f9f1abe60b Oct 08 22:09:40.698229 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-TestShelveInstance-1230879253 Oct 08 22:09:40.698229 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-TestShelveInstance-1230879253-project Oct 08 22:09:40.698229 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 22:09:40.698229 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 22:09:40.698229 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 199e2426220e4cc4b1d37d4075e67cbc Oct 08 22:09:40.698229 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-TestShelveInstance-1230879253-project Oct 08 22:09:40.698229 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 22:09:40.698229 ncdv-master-1 devstack@n-api.service[140492]: exception: Instance 236c09e2-65bd-4ef5-88b1-032329b987cf could not be found. Oct 08 22:09:40.698229 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': '236c09e2-65bd-4ef5-88b1-032329b987cf'} Oct 08 22:09:40.698229 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 22:09:40.698229 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 22:09:40.698229 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 22:09:40.698229 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 22:09:40.698229 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 22:09:40.698229 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 22:09:40.698229 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 22:09:40.698229 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 22:09:40.698229 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 22:09:40.698229 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 22:09:40.698229 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 236c09e2-65bd-4ef5-88b1-032329b987cf could not be found. Oct 08 22:09:40.698229 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 22:09:40.698229 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 22:09:40.698229 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 22:09:40.698229 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 22:09:40.698229 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 22:09:40.698229 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 22:09:40.698229 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 22:09:40.698229 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 22:09:40.698229 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 22:09:40.698229 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 22:09:40.698229 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 22:09:40.698229 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 22:09:40.698229 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 22:09:40.698229 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 22:09:40.698229 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 22:09:40.698229 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 22:09:40.698229 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 236c09e2-65bd-4ef5-88b1-032329b987cf could not be found. Oct 08 22:09:40.698229 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 22:09:40.698229 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 22:09:40.698229 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 22:09:40.703908 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 22:09:40.703908 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 22:09:40.703908 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 22:09:40.703908 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 22:09:40.703908 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 22:09:40.703908 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 236c09e2-65bd-4ef5-88b1-032329b987cf could not be found. Oct 08 22:09:40.703908 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 22:09:40.703908 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-7c4a3bf1-ee06-468a-9a4b-c08c1c47c0e2 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Returning 404 to user: Instance 236c09e2-65bd-4ef5-88b1-032329b987cf could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 22:09:40.703908 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-7c4a3bf1-ee06-468a-9a4b-c08c1c47c0e2 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] 10.222.0.26 "GET /compute/v2.1/servers/236c09e2-65bd-4ef5-88b1-032329b987cf" status: 404 len: 111 microversion: 2.1 time: 0.032590 Oct 08 22:09:40.703908 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3591/7108] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:09:40 2022] GET /compute/v2.1/servers/236c09e2-65bd-4ef5-88b1-032329b987cf => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 22:09:40.859326 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-3224af1d-f829-422c-b492-f5c2b2e4bf92 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Calling method '.version_select at 0x7f1a87716790>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:09:40.884609 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-3224af1d-f829-422c-b492-f5c2b2e4bf92 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1975197219" status: 202 len: 0 microversion: 2.1 time: 0.029239 Oct 08 22:09:40.885259 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3518/7109] 10.222.0.26 () {58 vars in 1254 bytes} [Sat Oct 8 22:09:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1975197219 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 08 22:09:40.907026 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-ed5fe64b-efa2-416a-b1d2-df5f4011bbe3 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Action: 'create', calling method: .version_select at 0x7f1a8c09f3a0>, body: {"keypair": {"name": "tempest-TestShelveInstance-559826009", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBADU82Ikc0nF1GyLsTSULx2jfDmdpX3Cu+Jy0FoxVCg9JpJbVSCNrdMsDEhqC9pptCvmzBTCKN7+cUis2830I+3kWPI3tTNLwSeQbU8qXfNFDTpuqUtDumdg2CM6d6J+5w=="}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 22:09:40.922781 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-ed5fe64b-efa2-416a-b1d2-df5f4011bbe3 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Getting quotas for project b9c33d4041764691b1ad69f9f1abe60b. Resources: {'key_pairs'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 22:09:40.928434 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-ed5fe64b-efa2-416a-b1d2-df5f4011bbe3 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Getting quotas for user 199e2426220e4cc4b1d37d4075e67cbc and project b9c33d4041764691b1ad69f9f1abe60b. Resources: {'key_pairs'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 22:09:40.955479 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-ed5fe64b-efa2-416a-b1d2-df5f4011bbe3 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.052435 Oct 08 22:09:40.956095 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3592/7110] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Oct 8 22:09:40 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 22:09:43.389752 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-5c812225-f487-47d4-b5c6-167f836b7121 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1053058095", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-559826009", "security_groups": [{"name": "tempest-secgroup-smoke-13281213"}], "networks": [{"uuid": "df7f8a7c-301f-421e-b8b5-24085e0e3103"}], "block_device_mapping_v2": [{"uuid": "4a4c2867-d278-4fbe-92da-e4f35447373a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 22:09:43.505419 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.network.neutron [None req-5c812225-f487-47d4-b5c6-167f836b7121 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] validate_networks() for [('df7f8a7c-301f-421e-b8b5-24085e0e3103', None, None, None, None, None)] {{(pid=140491) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 22:09:43.880217 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-5c812225-f487-47d4-b5c6-167f836b7121 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Flavor limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 22:09:43.880662 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-5c812225-f487-47d4-b5c6-167f836b7121 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Image limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 22:09:43.881308 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-5c812225-f487-47d4-b5c6-167f836b7121 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Flavor pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 22:09:43.881762 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-5c812225-f487-47d4-b5c6-167f836b7121 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Image pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 22:09:43.882187 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-5c812225-f487-47d4-b5c6-167f836b7121 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 22:09:43.891105 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5c812225-f487-47d4-b5c6-167f836b7121 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:09:43.891599 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5c812225-f487-47d4-b5c6-167f836b7121 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:09:43.892048 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5c812225-f487-47d4-b5c6-167f836b7121 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:09:43.892788 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5c812225-f487-47d4-b5c6-167f836b7121 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:09:43.893274 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5c812225-f487-47d4-b5c6-167f836b7121 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:09:43.893713 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5c812225-f487-47d4-b5c6-167f836b7121 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:09:43.912165 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-5c812225-f487-47d4-b5c6-167f836b7121 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Getting quotas for project b9c33d4041764691b1ad69f9f1abe60b. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 22:09:43.917466 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-5c812225-f487-47d4-b5c6-167f836b7121 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Getting quotas for user 199e2426220e4cc4b1d37d4075e67cbc and project b9c33d4041764691b1ad69f9f1abe60b. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 22:09:43.975180 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-5c812225-f487-47d4-b5c6-167f836b7121 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Going to run 1 instances... {{(pid=140491) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 22:09:43.977345 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-5c812225-f487-47d4-b5c6-167f836b7121 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] [instance: c9eafd63-0da2-4643-a74d-1e383d6fdeb4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4a4c2867-d278-4fbe-92da-e4f35447373a',volume_size=None,volume_type=None)] {{(pid=140491) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 22:09:44.104449 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-5c812225-f487-47d4-b5c6-167f836b7121 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.719555 Oct 08 22:09:44.105114 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3519/7111] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 22:09:43 2022] POST /compute/v2.1/servers => generated 404 bytes in 721 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 08 22:09:44.117749 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-6115450e-fcfa-4f6f-91a3-704b2dd0353d tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:09:44.118388 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-6115450e-fcfa-4f6f-91a3-704b2dd0353d tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] [instance: c9eafd63-0da2-4643-a74d-1e383d6fdeb4] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:09:44.174656 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-6115450e-fcfa-4f6f-91a3-704b2dd0353d tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199e2426220e4cc4b1d37d4075e67cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9c33d4041764691b1ad69f9f1abe60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:09:44.183269 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-6115450e-fcfa-4f6f-91a3-704b2dd0353d tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] 10.222.0.26 "GET /compute/v2.1/servers/c9eafd63-0da2-4643-a74d-1e383d6fdeb4" status: 200 len: 1088 microversion: 2.1 time: 0.070851 Oct 08 22:09:44.183936 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3593/7112] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:09:44 2022] GET /compute/v2.1/servers/c9eafd63-0da2-4643-a74d-1e383d6fdeb4 => generated 1088 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:09:45.207677 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-13fa8486-77e7-4c09-999b-1d3a64d28605 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:09:45.209491 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-13fa8486-77e7-4c09-999b-1d3a64d28605 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] [instance: c9eafd63-0da2-4643-a74d-1e383d6fdeb4] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:09:45.216825 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-13fa8486-77e7-4c09-999b-1d3a64d28605 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:09:45.217461 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-13fa8486-77e7-4c09-999b-1d3a64d28605 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:09:45.218129 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-13fa8486-77e7-4c09-999b-1d3a64d28605 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:09:45.218858 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-13fa8486-77e7-4c09-999b-1d3a64d28605 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:09:45.219329 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-13fa8486-77e7-4c09-999b-1d3a64d28605 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:09:45.220142 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-13fa8486-77e7-4c09-999b-1d3a64d28605 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:09:45.286689 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-13fa8486-77e7-4c09-999b-1d3a64d28605 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199e2426220e4cc4b1d37d4075e67cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9c33d4041764691b1ad69f9f1abe60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:09:45.295644 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-13fa8486-77e7-4c09-999b-1d3a64d28605 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] 10.222.0.26 "GET /compute/v2.1/servers/c9eafd63-0da2-4643-a74d-1e383d6fdeb4" status: 200 len: 1204 microversion: 2.1 time: 0.093244 Oct 08 22:09:45.296490 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3520/7113] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:09:45 2022] GET /compute/v2.1/servers/c9eafd63-0da2-4643-a74d-1e383d6fdeb4 => generated 1204 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:09:46.319429 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-c28a362d-de8a-4d6e-a3fa-57e7ce10bb81 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:09:46.320065 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-c28a362d-de8a-4d6e-a3fa-57e7ce10bb81 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] [instance: c9eafd63-0da2-4643-a74d-1e383d6fdeb4] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:09:46.327802 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c28a362d-de8a-4d6e-a3fa-57e7ce10bb81 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:09:46.328311 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c28a362d-de8a-4d6e-a3fa-57e7ce10bb81 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:09:46.329115 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c28a362d-de8a-4d6e-a3fa-57e7ce10bb81 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:09:46.329899 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c28a362d-de8a-4d6e-a3fa-57e7ce10bb81 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:09:46.330544 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c28a362d-de8a-4d6e-a3fa-57e7ce10bb81 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:09:46.331169 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c28a362d-de8a-4d6e-a3fa-57e7ce10bb81 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:09:46.560546 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-c28a362d-de8a-4d6e-a3fa-57e7ce10bb81 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199e2426220e4cc4b1d37d4075e67cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9c33d4041764691b1ad69f9f1abe60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:09:46.568612 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-c28a362d-de8a-4d6e-a3fa-57e7ce10bb81 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] 10.222.0.26 "GET /compute/v2.1/servers/c9eafd63-0da2-4643-a74d-1e383d6fdeb4" status: 200 len: 1270 microversion: 2.1 time: 0.253431 Oct 08 22:09:46.569464 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3594/7114] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:09:46 2022] GET /compute/v2.1/servers/c9eafd63-0da2-4643-a74d-1e383d6fdeb4 => generated 1270 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 22:09:46.663008 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-faa59bcd-d077-43ae-bc43-94f315b376cb req-0e8dd75b-9a8a-4586-9152-43fdf5e48cc4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9eafd63-0da2-4643-a74d-1e383d6fdeb4", "tag": "1c8f886c-8e52-4215-a69d-bcebfaed6731"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 22:09:46.676660 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-faa59bcd-d077-43ae-bc43-94f315b376cb req-0e8dd75b-9a8a-4586-9152-43fdf5e48cc4 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:09:46.677153 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-faa59bcd-d077-43ae-bc43-94f315b376cb req-0e8dd75b-9a8a-4586-9152-43fdf5e48cc4 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:09:46.677618 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-faa59bcd-d077-43ae-bc43-94f315b376cb req-0e8dd75b-9a8a-4586-9152-43fdf5e48cc4 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:09:46.693625 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-faa59bcd-d077-43ae-bc43-94f315b376cb req-0e8dd75b-9a8a-4586-9152-43fdf5e48cc4 service nova] Creating event network-changed:1c8f886c-8e52-4215-a69d-bcebfaed6731 for instance c9eafd63-0da2-4643-a74d-1e383d6fdeb4 on nch1-master-1 Oct 08 22:09:46.698711 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-faa59bcd-d077-43ae-bc43-94f315b376cb req-0e8dd75b-9a8a-4586-9152-43fdf5e48cc4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040776 Oct 08 22:09:46.699593 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3521/7115] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 22:09:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 22:09:47.591244 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-b413822c-569d-4391-becb-9dd012353b5e tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:09:47.591781 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-b413822c-569d-4391-becb-9dd012353b5e tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] [instance: c9eafd63-0da2-4643-a74d-1e383d6fdeb4] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:09:47.599217 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b413822c-569d-4391-becb-9dd012353b5e tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:09:47.599770 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b413822c-569d-4391-becb-9dd012353b5e tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:09:47.600230 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b413822c-569d-4391-becb-9dd012353b5e tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:09:47.600946 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b413822c-569d-4391-becb-9dd012353b5e tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:09:47.601471 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b413822c-569d-4391-becb-9dd012353b5e tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:09:47.601924 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b413822c-569d-4391-becb-9dd012353b5e tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:09:47.740946 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-b413822c-569d-4391-becb-9dd012353b5e tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199e2426220e4cc4b1d37d4075e67cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9c33d4041764691b1ad69f9f1abe60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:09:47.748760 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-b413822c-569d-4391-becb-9dd012353b5e tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] 10.222.0.26 "GET /compute/v2.1/servers/c9eafd63-0da2-4643-a74d-1e383d6fdeb4" status: 200 len: 1258 microversion: 2.1 time: 0.161483 Oct 08 22:09:47.749372 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3595/7116] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:09:47 2022] GET /compute/v2.1/servers/c9eafd63-0da2-4643-a74d-1e383d6fdeb4 => generated 1258 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:09:48.773091 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-5f399957-57ba-4b9a-8bbf-48435fb807a3 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:09:48.773826 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-5f399957-57ba-4b9a-8bbf-48435fb807a3 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] [instance: c9eafd63-0da2-4643-a74d-1e383d6fdeb4] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:09:48.780069 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5f399957-57ba-4b9a-8bbf-48435fb807a3 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:09:48.780557 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5f399957-57ba-4b9a-8bbf-48435fb807a3 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:09:48.780998 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5f399957-57ba-4b9a-8bbf-48435fb807a3 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:09:48.781754 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5f399957-57ba-4b9a-8bbf-48435fb807a3 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:09:48.782214 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5f399957-57ba-4b9a-8bbf-48435fb807a3 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:09:48.782646 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5f399957-57ba-4b9a-8bbf-48435fb807a3 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:09:48.918585 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-5f399957-57ba-4b9a-8bbf-48435fb807a3 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199e2426220e4cc4b1d37d4075e67cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9c33d4041764691b1ad69f9f1abe60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:09:48.926736 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-5f399957-57ba-4b9a-8bbf-48435fb807a3 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] 10.222.0.26 "GET /compute/v2.1/servers/c9eafd63-0da2-4643-a74d-1e383d6fdeb4" status: 200 len: 1258 microversion: 2.1 time: 0.158844 Oct 08 22:09:48.928321 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3522/7117] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:09:48 2022] GET /compute/v2.1/servers/c9eafd63-0da2-4643-a74d-1e383d6fdeb4 => generated 1258 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:09:49.949844 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-91b6cdf0-9a26-4ef0-a9af-f2d4a7248b2b tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:09:49.950426 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-91b6cdf0-9a26-4ef0-a9af-f2d4a7248b2b tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] [instance: c9eafd63-0da2-4643-a74d-1e383d6fdeb4] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:09:49.957375 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-91b6cdf0-9a26-4ef0-a9af-f2d4a7248b2b tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:09:49.957911 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-91b6cdf0-9a26-4ef0-a9af-f2d4a7248b2b tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:09:49.958955 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-91b6cdf0-9a26-4ef0-a9af-f2d4a7248b2b tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:09:49.959671 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-91b6cdf0-9a26-4ef0-a9af-f2d4a7248b2b tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:09:49.960190 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-91b6cdf0-9a26-4ef0-a9af-f2d4a7248b2b tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:09:49.960639 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-91b6cdf0-9a26-4ef0-a9af-f2d4a7248b2b tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:09:50.098199 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-91b6cdf0-9a26-4ef0-a9af-f2d4a7248b2b tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199e2426220e4cc4b1d37d4075e67cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9c33d4041764691b1ad69f9f1abe60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:09:50.106051 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-91b6cdf0-9a26-4ef0-a9af-f2d4a7248b2b tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] 10.222.0.26 "GET /compute/v2.1/servers/c9eafd63-0da2-4643-a74d-1e383d6fdeb4" status: 200 len: 1258 microversion: 2.1 time: 0.160194 Oct 08 22:09:50.106635 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3596/7118] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:09:49 2022] GET /compute/v2.1/servers/c9eafd63-0da2-4643-a74d-1e383d6fdeb4 => generated 1258 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:09:51.128981 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-7677e5dd-2223-4501-a89f-0985d1153eaa tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:09:51.129736 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-7677e5dd-2223-4501-a89f-0985d1153eaa tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] [instance: c9eafd63-0da2-4643-a74d-1e383d6fdeb4] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:09:51.136810 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7677e5dd-2223-4501-a89f-0985d1153eaa tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:09:51.137351 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7677e5dd-2223-4501-a89f-0985d1153eaa tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:09:51.137798 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7677e5dd-2223-4501-a89f-0985d1153eaa tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:09:51.138505 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7677e5dd-2223-4501-a89f-0985d1153eaa tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:09:51.138970 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7677e5dd-2223-4501-a89f-0985d1153eaa tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:09:51.139404 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-7677e5dd-2223-4501-a89f-0985d1153eaa tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:09:51.268582 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-7677e5dd-2223-4501-a89f-0985d1153eaa tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199e2426220e4cc4b1d37d4075e67cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9c33d4041764691b1ad69f9f1abe60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:09:51.276495 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-7677e5dd-2223-4501-a89f-0985d1153eaa tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] 10.222.0.26 "GET /compute/v2.1/servers/c9eafd63-0da2-4643-a74d-1e383d6fdeb4" status: 200 len: 1258 microversion: 2.1 time: 0.151491 Oct 08 22:09:51.277081 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3523/7119] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:09:51 2022] GET /compute/v2.1/servers/c9eafd63-0da2-4643-a74d-1e383d6fdeb4 => generated 1258 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:09:52.299775 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-cdf2b62c-ee85-4d60-8689-8f59651f56d6 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:09:52.300416 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-cdf2b62c-ee85-4d60-8689-8f59651f56d6 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] [instance: c9eafd63-0da2-4643-a74d-1e383d6fdeb4] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:09:52.307736 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cdf2b62c-ee85-4d60-8689-8f59651f56d6 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:09:52.308252 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cdf2b62c-ee85-4d60-8689-8f59651f56d6 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:09:52.308719 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cdf2b62c-ee85-4d60-8689-8f59651f56d6 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:09:52.309482 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cdf2b62c-ee85-4d60-8689-8f59651f56d6 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:09:52.309964 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cdf2b62c-ee85-4d60-8689-8f59651f56d6 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:09:52.310420 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cdf2b62c-ee85-4d60-8689-8f59651f56d6 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:09:52.440469 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-cdf2b62c-ee85-4d60-8689-8f59651f56d6 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199e2426220e4cc4b1d37d4075e67cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9c33d4041764691b1ad69f9f1abe60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:09:52.448366 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-cdf2b62c-ee85-4d60-8689-8f59651f56d6 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] 10.222.0.26 "GET /compute/v2.1/servers/c9eafd63-0da2-4643-a74d-1e383d6fdeb4" status: 200 len: 1258 microversion: 2.1 time: 0.152797 Oct 08 22:09:52.448956 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3597/7120] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:09:52 2022] GET /compute/v2.1/servers/c9eafd63-0da2-4643-a74d-1e383d6fdeb4 => generated 1258 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:09:53.471513 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-3783dbdc-b730-40ad-934a-7715ceaba8c5 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:09:53.472120 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-3783dbdc-b730-40ad-934a-7715ceaba8c5 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] [instance: c9eafd63-0da2-4643-a74d-1e383d6fdeb4] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:09:53.480105 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3783dbdc-b730-40ad-934a-7715ceaba8c5 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:09:53.480617 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3783dbdc-b730-40ad-934a-7715ceaba8c5 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:09:53.481139 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3783dbdc-b730-40ad-934a-7715ceaba8c5 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:09:53.481818 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3783dbdc-b730-40ad-934a-7715ceaba8c5 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:09:53.482290 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3783dbdc-b730-40ad-934a-7715ceaba8c5 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:09:53.482731 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-3783dbdc-b730-40ad-934a-7715ceaba8c5 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:09:53.620115 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-3783dbdc-b730-40ad-934a-7715ceaba8c5 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199e2426220e4cc4b1d37d4075e67cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9c33d4041764691b1ad69f9f1abe60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:09:53.628125 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-3783dbdc-b730-40ad-934a-7715ceaba8c5 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] 10.222.0.26 "GET /compute/v2.1/servers/c9eafd63-0da2-4643-a74d-1e383d6fdeb4" status: 200 len: 1258 microversion: 2.1 time: 0.160631 Oct 08 22:09:53.628920 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3524/7121] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:09:53 2022] GET /compute/v2.1/servers/c9eafd63-0da2-4643-a74d-1e383d6fdeb4 => generated 1258 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:09:54.650985 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-195ca638-8e5a-4474-b9f1-e5f21ad164c5 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:09:54.651626 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-195ca638-8e5a-4474-b9f1-e5f21ad164c5 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] [instance: c9eafd63-0da2-4643-a74d-1e383d6fdeb4] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:09:54.654529 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=6 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 22:09:54.660226 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-195ca638-8e5a-4474-b9f1-e5f21ad164c5 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:09:54.660741 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-195ca638-8e5a-4474-b9f1-e5f21ad164c5 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:09:54.661268 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-195ca638-8e5a-4474-b9f1-e5f21ad164c5 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:09:54.661998 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-195ca638-8e5a-4474-b9f1-e5f21ad164c5 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:09:54.662491 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-195ca638-8e5a-4474-b9f1-e5f21ad164c5 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:09:54.662945 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-195ca638-8e5a-4474-b9f1-e5f21ad164c5 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:09:54.797774 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-195ca638-8e5a-4474-b9f1-e5f21ad164c5 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199e2426220e4cc4b1d37d4075e67cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9c33d4041764691b1ad69f9f1abe60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:09:54.806407 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-195ca638-8e5a-4474-b9f1-e5f21ad164c5 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] 10.222.0.26 "GET /compute/v2.1/servers/c9eafd63-0da2-4643-a74d-1e383d6fdeb4" status: 200 len: 1258 microversion: 2.1 time: 0.159403 Oct 08 22:09:54.807322 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3598/7122] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:09:54 2022] GET /compute/v2.1/servers/c9eafd63-0da2-4643-a74d-1e383d6fdeb4 => generated 1258 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:09:55.210699 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-73e60bbe-1854-4e46-a794-d39fcb292950 req-215393e7-9904-4d38-9d15-1594580602bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9eafd63-0da2-4643-a74d-1e383d6fdeb4", "name": "network-vif-plugged", "status": "completed", "tag": "1c8f886c-8e52-4215-a69d-bcebfaed6731"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 22:09:55.215878 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=2 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 22:09:55.216570 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=6 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 22:09:55.224381 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-73e60bbe-1854-4e46-a794-d39fcb292950 req-215393e7-9904-4d38-9d15-1594580602bc service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:09:55.224879 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-73e60bbe-1854-4e46-a794-d39fcb292950 req-215393e7-9904-4d38-9d15-1594580602bc service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:09:55.225368 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-73e60bbe-1854-4e46-a794-d39fcb292950 req-215393e7-9904-4d38-9d15-1594580602bc service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:09:55.237444 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-73e60bbe-1854-4e46-a794-d39fcb292950 req-215393e7-9904-4d38-9d15-1594580602bc service nova] Creating event network-vif-plugged:1c8f886c-8e52-4215-a69d-bcebfaed6731 for instance c9eafd63-0da2-4643-a74d-1e383d6fdeb4 on nch1-master-1 Oct 08 22:09:55.243034 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-73e60bbe-1854-4e46-a794-d39fcb292950 req-215393e7-9904-4d38-9d15-1594580602bc service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037103 Oct 08 22:09:55.243639 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3525/7123] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 22:09:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 22:09:55.830164 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-fe245016-fd9c-4d39-96c9-43f0f36d6873 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:09:55.830797 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-fe245016-fd9c-4d39-96c9-43f0f36d6873 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] [instance: c9eafd63-0da2-4643-a74d-1e383d6fdeb4] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:09:55.838342 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fe245016-fd9c-4d39-96c9-43f0f36d6873 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:09:55.838848 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fe245016-fd9c-4d39-96c9-43f0f36d6873 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:09:55.839310 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fe245016-fd9c-4d39-96c9-43f0f36d6873 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:09:55.840025 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fe245016-fd9c-4d39-96c9-43f0f36d6873 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:09:55.840500 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fe245016-fd9c-4d39-96c9-43f0f36d6873 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:09:55.840948 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-fe245016-fd9c-4d39-96c9-43f0f36d6873 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:09:55.975473 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-fe245016-fd9c-4d39-96c9-43f0f36d6873 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199e2426220e4cc4b1d37d4075e67cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9c33d4041764691b1ad69f9f1abe60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:09:55.983344 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-fe245016-fd9c-4d39-96c9-43f0f36d6873 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] 10.222.0.26 "GET /compute/v2.1/servers/c9eafd63-0da2-4643-a74d-1e383d6fdeb4" status: 200 len: 1258 microversion: 2.1 time: 0.157119 Oct 08 22:09:55.983916 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3599/7124] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:09:55 2022] GET /compute/v2.1/servers/c9eafd63-0da2-4643-a74d-1e383d6fdeb4 => generated 1258 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:09:57.006881 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-b3f3d799-e05e-442a-b206-6495daad6615 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:09:57.007602 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-b3f3d799-e05e-442a-b206-6495daad6615 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] [instance: c9eafd63-0da2-4643-a74d-1e383d6fdeb4] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:09:57.014054 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b3f3d799-e05e-442a-b206-6495daad6615 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:09:57.014560 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b3f3d799-e05e-442a-b206-6495daad6615 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:09:57.015013 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b3f3d799-e05e-442a-b206-6495daad6615 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:09:57.015729 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b3f3d799-e05e-442a-b206-6495daad6615 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:09:57.016199 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b3f3d799-e05e-442a-b206-6495daad6615 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:09:57.016640 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b3f3d799-e05e-442a-b206-6495daad6615 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:09:57.148513 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-b3f3d799-e05e-442a-b206-6495daad6615 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199e2426220e4cc4b1d37d4075e67cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9c33d4041764691b1ad69f9f1abe60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:09:57.156392 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-b3f3d799-e05e-442a-b206-6495daad6615 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] 10.222.0.26 "GET /compute/v2.1/servers/c9eafd63-0da2-4643-a74d-1e383d6fdeb4" status: 200 len: 1443 microversion: 2.1 time: 0.154750 Oct 08 22:09:57.156981 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3526/7125] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:09:57 2022] GET /compute/v2.1/servers/c9eafd63-0da2-4643-a74d-1e383d6fdeb4 => generated 1443 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:09:57.178894 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-6f9181e6-a9f6-479b-9234-bd7d82e94b59 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:09:57.179624 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-6f9181e6-a9f6-479b-9234-bd7d82e94b59 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] [instance: c9eafd63-0da2-4643-a74d-1e383d6fdeb4] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:09:57.186696 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6f9181e6-a9f6-479b-9234-bd7d82e94b59 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:09:57.187207 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6f9181e6-a9f6-479b-9234-bd7d82e94b59 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:09:57.187671 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6f9181e6-a9f6-479b-9234-bd7d82e94b59 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:09:57.188395 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6f9181e6-a9f6-479b-9234-bd7d82e94b59 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:09:57.188882 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6f9181e6-a9f6-479b-9234-bd7d82e94b59 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:09:57.189365 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-6f9181e6-a9f6-479b-9234-bd7d82e94b59 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:09:57.319767 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-6f9181e6-a9f6-479b-9234-bd7d82e94b59 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199e2426220e4cc4b1d37d4075e67cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9c33d4041764691b1ad69f9f1abe60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:09:57.327735 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-6f9181e6-a9f6-479b-9234-bd7d82e94b59 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] 10.222.0.26 "GET /compute/v2.1/servers/c9eafd63-0da2-4643-a74d-1e383d6fdeb4" status: 200 len: 1443 microversion: 2.1 time: 0.152792 Oct 08 22:09:57.328313 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3600/7126] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:09:57 2022] GET /compute/v2.1/servers/c9eafd63-0da2-4643-a74d-1e383d6fdeb4 => generated 1443 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:09:58.889275 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-91ca914a-a615-4605-bf5c-0197c28d7c1f req-bcc00f12-1b2b-48e7-afed-0e2da92c8e7c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9eafd63-0da2-4643-a74d-1e383d6fdeb4", "tag": "1c8f886c-8e52-4215-a69d-bcebfaed6731"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 22:09:58.900551 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-91ca914a-a615-4605-bf5c-0197c28d7c1f req-bcc00f12-1b2b-48e7-afed-0e2da92c8e7c service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:09:58.901035 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-91ca914a-a615-4605-bf5c-0197c28d7c1f req-bcc00f12-1b2b-48e7-afed-0e2da92c8e7c service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:09:58.901508 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-91ca914a-a615-4605-bf5c-0197c28d7c1f req-bcc00f12-1b2b-48e7-afed-0e2da92c8e7c service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:09:58.913908 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-91ca914a-a615-4605-bf5c-0197c28d7c1f req-bcc00f12-1b2b-48e7-afed-0e2da92c8e7c service nova] Creating event network-changed:1c8f886c-8e52-4215-a69d-bcebfaed6731 for instance c9eafd63-0da2-4643-a74d-1e383d6fdeb4 on nch1-master-1 Oct 08 22:09:58.919324 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-91ca914a-a615-4605-bf5c-0197c28d7c1f req-bcc00f12-1b2b-48e7-afed-0e2da92c8e7c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033827 Oct 08 22:09:58.919999 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3527/7127] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 22:09:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 22:12:04.098070 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 22:12:04.098886 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=54 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 22:12:04.156138 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-51c98378-4da9-4df6-800c-da523affb28b tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 22:12:04.156706 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-51c98378-4da9-4df6-800c-da523affb28b tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] [instance: c9eafd63-0da2-4643-a74d-1e383d6fdeb4] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:12:04.162850 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-51c98378-4da9-4df6-800c-da523affb28b tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:12:04.163357 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-51c98378-4da9-4df6-800c-da523affb28b tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:12:04.163812 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-51c98378-4da9-4df6-800c-da523affb28b tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:12:04.164530 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-51c98378-4da9-4df6-800c-da523affb28b tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:12:04.165010 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-51c98378-4da9-4df6-800c-da523affb28b tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:12:04.165490 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-51c98378-4da9-4df6-800c-da523affb28b tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:12:04.189904 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.objects.instance [None req-51c98378-4da9-4df6-800c-da523affb28b tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lazy-loading 'flavor' on Instance uuid c9eafd63-0da2-4643-a74d-1e383d6fdeb4 {{(pid=140492) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 22:12:04.260478 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-51c98378-4da9-4df6-800c-da523affb28b tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] 10.222.0.26 "POST /compute/v2.1/servers/c9eafd63-0da2-4643-a74d-1e383d6fdeb4/action" status: 202 len: 0 microversion: 2.1 time: 0.164317 Oct 08 22:12:04.261069 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3601/7128] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 22:12:04 2022] POST /compute/v2.1/servers/c9eafd63-0da2-4643-a74d-1e383d6fdeb4/action => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 08 22:12:04.267707 ncdv-master-1 devstack@n-api.service[140491]: ERROR oslo.messaging._drivers.impl_rabbit [-] [389347c8-adfb-4c72-885b-6416d41737c1] AMQP server on 10.222.0.26:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 08 22:12:04.268733 ncdv-master-1 devstack@n-api.service[140491]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5b834fae-ca0a-46cb-bcaa-52f744fce5f9] AMQP server on 10.222.0.26:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 08 22:12:04.269388 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 22:12:04.270591 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 22:12:04.277707 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-ef090626-a832-43ae-8e6d-03e191b91049 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:12:04.278435 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-ef090626-a832-43ae-8e6d-03e191b91049 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] [instance: c9eafd63-0da2-4643-a74d-1e383d6fdeb4] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:12:04.288084 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ef090626-a832-43ae-8e6d-03e191b91049 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:12:04.288586 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ef090626-a832-43ae-8e6d-03e191b91049 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:12:04.289044 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ef090626-a832-43ae-8e6d-03e191b91049 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:12:04.289805 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ef090626-a832-43ae-8e6d-03e191b91049 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:12:04.290280 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ef090626-a832-43ae-8e6d-03e191b91049 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:12:04.290719 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-ef090626-a832-43ae-8e6d-03e191b91049 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:12:04.479764 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-ef090626-a832-43ae-8e6d-03e191b91049 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199e2426220e4cc4b1d37d4075e67cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9c33d4041764691b1ad69f9f1abe60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:12:04.488876 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-ef090626-a832-43ae-8e6d-03e191b91049 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] 10.222.0.26 "GET /compute/v2.1/servers/c9eafd63-0da2-4643-a74d-1e383d6fdeb4" status: 200 len: 1567 microversion: 2.1 time: 0.223273 Oct 08 22:12:04.489600 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3528/7129] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:12:04 2022] GET /compute/v2.1/servers/c9eafd63-0da2-4643-a74d-1e383d6fdeb4 => generated 1567 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 22:12:05.514377 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-be340ea2-8d44-4ca3-835c-e3c49e76ef71 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:12:05.515098 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-be340ea2-8d44-4ca3-835c-e3c49e76ef71 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] [instance: c9eafd63-0da2-4643-a74d-1e383d6fdeb4] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:12:05.521470 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-be340ea2-8d44-4ca3-835c-e3c49e76ef71 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:12:05.521979 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-be340ea2-8d44-4ca3-835c-e3c49e76ef71 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:12:05.522440 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-be340ea2-8d44-4ca3-835c-e3c49e76ef71 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:12:05.523160 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-be340ea2-8d44-4ca3-835c-e3c49e76ef71 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:12:05.523639 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-be340ea2-8d44-4ca3-835c-e3c49e76ef71 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:12:05.524088 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-be340ea2-8d44-4ca3-835c-e3c49e76ef71 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:12:05.703828 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-be340ea2-8d44-4ca3-835c-e3c49e76ef71 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199e2426220e4cc4b1d37d4075e67cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9c33d4041764691b1ad69f9f1abe60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:12:05.711714 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-be340ea2-8d44-4ca3-835c-e3c49e76ef71 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] 10.222.0.26 "GET /compute/v2.1/servers/c9eafd63-0da2-4643-a74d-1e383d6fdeb4" status: 200 len: 1567 microversion: 2.1 time: 0.203496 Oct 08 22:12:05.712294 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3602/7130] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:12:05 2022] GET /compute/v2.1/servers/c9eafd63-0da2-4643-a74d-1e383d6fdeb4 => generated 1567 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:12:06.735545 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-2e85aa8e-9c95-4838-b5e4-536bb0304885 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:12:06.736097 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-2e85aa8e-9c95-4838-b5e4-536bb0304885 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] [instance: c9eafd63-0da2-4643-a74d-1e383d6fdeb4] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:12:06.745066 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2e85aa8e-9c95-4838-b5e4-536bb0304885 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:12:06.745594 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2e85aa8e-9c95-4838-b5e4-536bb0304885 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:12:06.746044 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2e85aa8e-9c95-4838-b5e4-536bb0304885 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:12:06.746791 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2e85aa8e-9c95-4838-b5e4-536bb0304885 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:12:06.747269 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2e85aa8e-9c95-4838-b5e4-536bb0304885 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:12:06.747703 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2e85aa8e-9c95-4838-b5e4-536bb0304885 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:12:06.754341 ncdv-master-1 devstack@n-api.service[140491]: INFO oslo.messaging._drivers.impl_rabbit [-] [389347c8-adfb-4c72-885b-6416d41737c1] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 40060. Oct 08 22:12:06.767666 ncdv-master-1 devstack@n-api.service[140491]: INFO oslo.messaging._drivers.impl_rabbit [-] [5b834fae-ca0a-46cb-bcaa-52f744fce5f9] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 40062. Oct 08 22:12:06.886806 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-2e85aa8e-9c95-4838-b5e4-536bb0304885 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199e2426220e4cc4b1d37d4075e67cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9c33d4041764691b1ad69f9f1abe60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:12:06.894899 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-2e85aa8e-9c95-4838-b5e4-536bb0304885 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] 10.222.0.26 "GET /compute/v2.1/servers/c9eafd63-0da2-4643-a74d-1e383d6fdeb4" status: 200 len: 1567 microversion: 2.1 time: 0.163512 Oct 08 22:12:06.895474 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3529/7131] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:12:06 2022] GET /compute/v2.1/servers/c9eafd63-0da2-4643-a74d-1e383d6fdeb4 => generated 1567 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:12:07.918009 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-90414039-68fa-4feb-8f88-b408786916f8 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:12:07.918640 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-90414039-68fa-4feb-8f88-b408786916f8 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] [instance: c9eafd63-0da2-4643-a74d-1e383d6fdeb4] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:12:07.925836 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-90414039-68fa-4feb-8f88-b408786916f8 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:12:07.926337 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-90414039-68fa-4feb-8f88-b408786916f8 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:12:07.926792 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-90414039-68fa-4feb-8f88-b408786916f8 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:12:07.927501 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-90414039-68fa-4feb-8f88-b408786916f8 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:12:07.927980 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-90414039-68fa-4feb-8f88-b408786916f8 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:12:07.928422 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-90414039-68fa-4feb-8f88-b408786916f8 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:12:08.061985 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-90414039-68fa-4feb-8f88-b408786916f8 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199e2426220e4cc4b1d37d4075e67cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9c33d4041764691b1ad69f9f1abe60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:12:08.070422 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-90414039-68fa-4feb-8f88-b408786916f8 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] 10.222.0.26 "GET /compute/v2.1/servers/c9eafd63-0da2-4643-a74d-1e383d6fdeb4" status: 200 len: 1567 microversion: 2.1 time: 0.156351 Oct 08 22:12:08.070967 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3603/7132] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:12:07 2022] GET /compute/v2.1/servers/c9eafd63-0da2-4643-a74d-1e383d6fdeb4 => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:12:09.094351 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-1cea00c3-6def-4c46-a13c-17d064bbf9df tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:12:09.094975 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-1cea00c3-6def-4c46-a13c-17d064bbf9df tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] [instance: c9eafd63-0da2-4643-a74d-1e383d6fdeb4] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:12:09.102011 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1cea00c3-6def-4c46-a13c-17d064bbf9df tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:12:09.102509 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1cea00c3-6def-4c46-a13c-17d064bbf9df tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:12:09.102956 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1cea00c3-6def-4c46-a13c-17d064bbf9df tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:12:09.103699 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1cea00c3-6def-4c46-a13c-17d064bbf9df tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:12:09.104163 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1cea00c3-6def-4c46-a13c-17d064bbf9df tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:12:09.104600 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1cea00c3-6def-4c46-a13c-17d064bbf9df tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:12:09.236977 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-1cea00c3-6def-4c46-a13c-17d064bbf9df tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199e2426220e4cc4b1d37d4075e67cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9c33d4041764691b1ad69f9f1abe60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:12:09.244912 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-1cea00c3-6def-4c46-a13c-17d064bbf9df tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] 10.222.0.26 "GET /compute/v2.1/servers/c9eafd63-0da2-4643-a74d-1e383d6fdeb4" status: 200 len: 1567 microversion: 2.1 time: 0.155142 Oct 08 22:12:09.245521 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3530/7133] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:12:09 2022] GET /compute/v2.1/servers/c9eafd63-0da2-4643-a74d-1e383d6fdeb4 => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:12:10.269161 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-c68166cd-e412-4243-850a-c44bf279b245 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:12:10.269835 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-c68166cd-e412-4243-850a-c44bf279b245 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] [instance: c9eafd63-0da2-4643-a74d-1e383d6fdeb4] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:12:10.276841 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c68166cd-e412-4243-850a-c44bf279b245 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:12:10.277399 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c68166cd-e412-4243-850a-c44bf279b245 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:12:10.277867 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c68166cd-e412-4243-850a-c44bf279b245 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:12:10.278593 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c68166cd-e412-4243-850a-c44bf279b245 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:12:10.279080 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c68166cd-e412-4243-850a-c44bf279b245 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:12:10.279532 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-c68166cd-e412-4243-850a-c44bf279b245 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:12:10.410365 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-c68166cd-e412-4243-850a-c44bf279b245 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199e2426220e4cc4b1d37d4075e67cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9c33d4041764691b1ad69f9f1abe60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:12:10.418504 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-c68166cd-e412-4243-850a-c44bf279b245 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] 10.222.0.26 "GET /compute/v2.1/servers/c9eafd63-0da2-4643-a74d-1e383d6fdeb4" status: 200 len: 1567 microversion: 2.1 time: 0.153384 Oct 08 22:12:10.419121 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3604/7134] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:12:10 2022] GET /compute/v2.1/servers/c9eafd63-0da2-4643-a74d-1e383d6fdeb4 => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:12:11.442378 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-0e6c3266-8926-43da-b945-b8dd26275e2c tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:12:11.443024 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-0e6c3266-8926-43da-b945-b8dd26275e2c tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] [instance: c9eafd63-0da2-4643-a74d-1e383d6fdeb4] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:12:11.450304 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0e6c3266-8926-43da-b945-b8dd26275e2c tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:12:11.450841 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0e6c3266-8926-43da-b945-b8dd26275e2c tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:12:11.451287 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0e6c3266-8926-43da-b945-b8dd26275e2c tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:12:11.451985 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0e6c3266-8926-43da-b945-b8dd26275e2c tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:12:11.452442 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0e6c3266-8926-43da-b945-b8dd26275e2c tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:12:11.453461 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0e6c3266-8926-43da-b945-b8dd26275e2c tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:12:11.591346 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-0e6c3266-8926-43da-b945-b8dd26275e2c tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199e2426220e4cc4b1d37d4075e67cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9c33d4041764691b1ad69f9f1abe60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:12:11.599951 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-0e6c3266-8926-43da-b945-b8dd26275e2c tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] 10.222.0.26 "GET /compute/v2.1/servers/c9eafd63-0da2-4643-a74d-1e383d6fdeb4" status: 200 len: 1567 microversion: 2.1 time: 0.161533 Oct 08 22:12:11.600528 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3531/7135] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:12:11 2022] GET /compute/v2.1/servers/c9eafd63-0da2-4643-a74d-1e383d6fdeb4 => generated 1567 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:12:12.622837 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-7a0d35f2-a977-4ab1-b070-4328e3139759 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:12:12.623467 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-7a0d35f2-a977-4ab1-b070-4328e3139759 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] [instance: c9eafd63-0da2-4643-a74d-1e383d6fdeb4] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:12:12.630496 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7a0d35f2-a977-4ab1-b070-4328e3139759 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:12:12.631000 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7a0d35f2-a977-4ab1-b070-4328e3139759 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:12:12.631455 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7a0d35f2-a977-4ab1-b070-4328e3139759 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:12:12.632169 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7a0d35f2-a977-4ab1-b070-4328e3139759 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:12:12.632652 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7a0d35f2-a977-4ab1-b070-4328e3139759 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:12:12.633096 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-7a0d35f2-a977-4ab1-b070-4328e3139759 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:12:12.761959 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-7a0d35f2-a977-4ab1-b070-4328e3139759 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199e2426220e4cc4b1d37d4075e67cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9c33d4041764691b1ad69f9f1abe60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:12:12.769854 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-7a0d35f2-a977-4ab1-b070-4328e3139759 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] 10.222.0.26 "GET /compute/v2.1/servers/c9eafd63-0da2-4643-a74d-1e383d6fdeb4" status: 200 len: 1567 microversion: 2.1 time: 0.150993 Oct 08 22:12:12.770518 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3605/7136] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:12:12 2022] GET /compute/v2.1/servers/c9eafd63-0da2-4643-a74d-1e383d6fdeb4 => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:12:13.795946 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-69987224-7e6f-45fc-9b90-d5ddce097057 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:12:13.797093 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-69987224-7e6f-45fc-9b90-d5ddce097057 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] [instance: c9eafd63-0da2-4643-a74d-1e383d6fdeb4] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:12:13.804048 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-69987224-7e6f-45fc-9b90-d5ddce097057 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:12:13.804544 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-69987224-7e6f-45fc-9b90-d5ddce097057 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:12:13.804994 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-69987224-7e6f-45fc-9b90-d5ddce097057 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:12:13.805741 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-69987224-7e6f-45fc-9b90-d5ddce097057 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:12:13.806207 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-69987224-7e6f-45fc-9b90-d5ddce097057 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:12:13.806647 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-69987224-7e6f-45fc-9b90-d5ddce097057 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:12:13.938289 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-69987224-7e6f-45fc-9b90-d5ddce097057 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199e2426220e4cc4b1d37d4075e67cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9c33d4041764691b1ad69f9f1abe60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:12:13.946207 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-69987224-7e6f-45fc-9b90-d5ddce097057 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] 10.222.0.26 "GET /compute/v2.1/servers/c9eafd63-0da2-4643-a74d-1e383d6fdeb4" status: 200 len: 1567 microversion: 2.1 time: 0.154482 Oct 08 22:12:13.946792 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3532/7137] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:12:13 2022] GET /compute/v2.1/servers/c9eafd63-0da2-4643-a74d-1e383d6fdeb4 => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:12:14.969266 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-4ffcc998-7a23-4e60-808a-180a7bf1daf1 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:12:14.969910 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-4ffcc998-7a23-4e60-808a-180a7bf1daf1 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] [instance: c9eafd63-0da2-4643-a74d-1e383d6fdeb4] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:12:14.977033 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4ffcc998-7a23-4e60-808a-180a7bf1daf1 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:12:14.977578 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4ffcc998-7a23-4e60-808a-180a7bf1daf1 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:12:14.978045 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4ffcc998-7a23-4e60-808a-180a7bf1daf1 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:12:14.978780 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4ffcc998-7a23-4e60-808a-180a7bf1daf1 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:12:14.979266 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4ffcc998-7a23-4e60-808a-180a7bf1daf1 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:12:14.979721 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4ffcc998-7a23-4e60-808a-180a7bf1daf1 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:12:15.417134 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-4ffcc998-7a23-4e60-808a-180a7bf1daf1 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199e2426220e4cc4b1d37d4075e67cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9c33d4041764691b1ad69f9f1abe60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:12:15.425854 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-4ffcc998-7a23-4e60-808a-180a7bf1daf1 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] 10.222.0.26 "GET /compute/v2.1/servers/c9eafd63-0da2-4643-a74d-1e383d6fdeb4" status: 200 len: 1567 microversion: 2.1 time: 0.460601 Oct 08 22:12:15.426427 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3606/7138] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:12:14 2022] GET /compute/v2.1/servers/c9eafd63-0da2-4643-a74d-1e383d6fdeb4 => generated 1567 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:12:16.449324 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-cbc1e09b-1056-4b09-8bcd-0b05ab98de2c tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:12:16.449956 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-cbc1e09b-1056-4b09-8bcd-0b05ab98de2c tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] [instance: c9eafd63-0da2-4643-a74d-1e383d6fdeb4] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:12:16.457845 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cbc1e09b-1056-4b09-8bcd-0b05ab98de2c tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:12:16.458352 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cbc1e09b-1056-4b09-8bcd-0b05ab98de2c tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:12:16.458813 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cbc1e09b-1056-4b09-8bcd-0b05ab98de2c tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:12:16.459531 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cbc1e09b-1056-4b09-8bcd-0b05ab98de2c tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:12:16.460005 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cbc1e09b-1056-4b09-8bcd-0b05ab98de2c tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:12:16.460444 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cbc1e09b-1056-4b09-8bcd-0b05ab98de2c tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:12:16.595391 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-cbc1e09b-1056-4b09-8bcd-0b05ab98de2c tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199e2426220e4cc4b1d37d4075e67cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9c33d4041764691b1ad69f9f1abe60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:12:16.603381 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-cbc1e09b-1056-4b09-8bcd-0b05ab98de2c tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] 10.222.0.26 "GET /compute/v2.1/servers/c9eafd63-0da2-4643-a74d-1e383d6fdeb4" status: 200 len: 1567 microversion: 2.1 time: 0.158134 Oct 08 22:12:16.603966 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3533/7139] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:12:16 2022] GET /compute/v2.1/servers/c9eafd63-0da2-4643-a74d-1e383d6fdeb4 => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:12:17.628061 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-dd70477f-aeb8-4e7d-a299-810e267217c8 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:12:17.628624 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-dd70477f-aeb8-4e7d-a299-810e267217c8 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] [instance: c9eafd63-0da2-4643-a74d-1e383d6fdeb4] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:12:17.635606 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dd70477f-aeb8-4e7d-a299-810e267217c8 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:12:17.636115 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dd70477f-aeb8-4e7d-a299-810e267217c8 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:12:17.636568 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dd70477f-aeb8-4e7d-a299-810e267217c8 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:12:17.637302 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dd70477f-aeb8-4e7d-a299-810e267217c8 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:12:17.637804 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dd70477f-aeb8-4e7d-a299-810e267217c8 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:12:17.638245 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dd70477f-aeb8-4e7d-a299-810e267217c8 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:12:17.771427 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-dd70477f-aeb8-4e7d-a299-810e267217c8 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199e2426220e4cc4b1d37d4075e67cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9c33d4041764691b1ad69f9f1abe60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:12:17.779213 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-dd70477f-aeb8-4e7d-a299-810e267217c8 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] 10.222.0.26 "GET /compute/v2.1/servers/c9eafd63-0da2-4643-a74d-1e383d6fdeb4" status: 200 len: 1508 microversion: 2.1 time: 0.157203 Oct 08 22:12:17.779791 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3607/7140] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:12:17 2022] GET /compute/v2.1/servers/c9eafd63-0da2-4643-a74d-1e383d6fdeb4 => generated 1508 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:12:17.801830 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-053217c7-ad79-4cb8-988e-6ccfc30667ee tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 22:12:17.802437 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-053217c7-ad79-4cb8-988e-6ccfc30667ee tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] [instance: c9eafd63-0da2-4643-a74d-1e383d6fdeb4] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:12:17.809314 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-053217c7-ad79-4cb8-988e-6ccfc30667ee tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:12:17.809806 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-053217c7-ad79-4cb8-988e-6ccfc30667ee tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:12:17.810248 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-053217c7-ad79-4cb8-988e-6ccfc30667ee tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:12:17.810948 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-053217c7-ad79-4cb8-988e-6ccfc30667ee tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:12:17.811411 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-053217c7-ad79-4cb8-988e-6ccfc30667ee tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:12:17.811844 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-053217c7-ad79-4cb8-988e-6ccfc30667ee tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:12:17.841497 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-053217c7-ad79-4cb8-988e-6ccfc30667ee tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] [instance: c9eafd63-0da2-4643-a74d-1e383d6fdeb4] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=140491) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 08 22:12:17.909171 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-053217c7-ad79-4cb8-988e-6ccfc30667ee tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] 10.222.0.26 "POST /compute/v2.1/servers/c9eafd63-0da2-4643-a74d-1e383d6fdeb4/action" status: 202 len: 0 microversion: 2.1 time: 0.111533 Oct 08 22:12:17.909755 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3534/7141] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 22:12:17 2022] POST /compute/v2.1/servers/c9eafd63-0da2-4643-a74d-1e383d6fdeb4/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 22:12:17.918190 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-75ecc35d-2a6d-41d3-bbdd-1b080ef2bd0e tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:12:17.918828 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-75ecc35d-2a6d-41d3-bbdd-1b080ef2bd0e tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] [instance: c9eafd63-0da2-4643-a74d-1e383d6fdeb4] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:12:17.925342 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-75ecc35d-2a6d-41d3-bbdd-1b080ef2bd0e tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:12:17.925854 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-75ecc35d-2a6d-41d3-bbdd-1b080ef2bd0e tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:12:17.926316 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-75ecc35d-2a6d-41d3-bbdd-1b080ef2bd0e tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:12:17.927045 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-75ecc35d-2a6d-41d3-bbdd-1b080ef2bd0e tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:12:17.927728 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-75ecc35d-2a6d-41d3-bbdd-1b080ef2bd0e tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:12:17.928183 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-75ecc35d-2a6d-41d3-bbdd-1b080ef2bd0e tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:12:18.081577 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-75ecc35d-2a6d-41d3-bbdd-1b080ef2bd0e tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199e2426220e4cc4b1d37d4075e67cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9c33d4041764691b1ad69f9f1abe60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:12:18.089626 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-75ecc35d-2a6d-41d3-bbdd-1b080ef2bd0e tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] 10.222.0.26 "GET /compute/v2.1/servers/c9eafd63-0da2-4643-a74d-1e383d6fdeb4" status: 200 len: 1516 microversion: 2.1 time: 0.175480 Oct 08 22:12:18.090220 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3608/7142] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:12:17 2022] GET /compute/v2.1/servers/c9eafd63-0da2-4643-a74d-1e383d6fdeb4 => generated 1516 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 22:12:19.114756 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-05f267de-6dfc-44da-84d1-d3ed3747bc95 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:12:19.115407 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-05f267de-6dfc-44da-84d1-d3ed3747bc95 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] [instance: c9eafd63-0da2-4643-a74d-1e383d6fdeb4] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:12:19.121631 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-05f267de-6dfc-44da-84d1-d3ed3747bc95 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:12:19.122069 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-05f267de-6dfc-44da-84d1-d3ed3747bc95 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:12:19.122505 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-05f267de-6dfc-44da-84d1-d3ed3747bc95 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:12:19.123204 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-05f267de-6dfc-44da-84d1-d3ed3747bc95 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:12:19.123666 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-05f267de-6dfc-44da-84d1-d3ed3747bc95 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:12:19.124098 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-05f267de-6dfc-44da-84d1-d3ed3747bc95 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:12:19.253522 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-05f267de-6dfc-44da-84d1-d3ed3747bc95 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199e2426220e4cc4b1d37d4075e67cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9c33d4041764691b1ad69f9f1abe60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:12:19.261584 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-05f267de-6dfc-44da-84d1-d3ed3747bc95 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] 10.222.0.26 "GET /compute/v2.1/servers/c9eafd63-0da2-4643-a74d-1e383d6fdeb4" status: 200 len: 1518 microversion: 2.1 time: 0.151437 Oct 08 22:12:19.262166 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3535/7143] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:12:19 2022] GET /compute/v2.1/servers/c9eafd63-0da2-4643-a74d-1e383d6fdeb4 => generated 1518 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:12:19.923838 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-de1e69a5-2c36-4912-ae70-9837d5f9f96a req-0def95e9-4773-4d96-8bd0-8079698e5c4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9eafd63-0da2-4643-a74d-1e383d6fdeb4", "name": "network-vif-unplugged", "status": "completed", "tag": "1c8f886c-8e52-4215-a69d-bcebfaed6731"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 22:12:19.934106 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-de1e69a5-2c36-4912-ae70-9837d5f9f96a req-0def95e9-4773-4d96-8bd0-8079698e5c4f service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:12:19.934656 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-de1e69a5-2c36-4912-ae70-9837d5f9f96a req-0def95e9-4773-4d96-8bd0-8079698e5c4f service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:12:19.935151 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-de1e69a5-2c36-4912-ae70-9837d5f9f96a req-0def95e9-4773-4d96-8bd0-8079698e5c4f service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:12:19.947848 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-de1e69a5-2c36-4912-ae70-9837d5f9f96a req-0def95e9-4773-4d96-8bd0-8079698e5c4f service nova] Creating event network-vif-unplugged:1c8f886c-8e52-4215-a69d-bcebfaed6731 for instance c9eafd63-0da2-4643-a74d-1e383d6fdeb4 on nch2-master-1 Oct 08 22:12:19.954686 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-de1e69a5-2c36-4912-ae70-9837d5f9f96a req-0def95e9-4773-4d96-8bd0-8079698e5c4f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035758 Oct 08 22:12:19.955454 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3609/7144] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 22:12:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 22:12:20.284677 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-52b0215f-acda-4a99-ae6a-9f11f7dae4d5 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:12:20.285424 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-52b0215f-acda-4a99-ae6a-9f11f7dae4d5 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] [instance: c9eafd63-0da2-4643-a74d-1e383d6fdeb4] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:12:20.292509 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-52b0215f-acda-4a99-ae6a-9f11f7dae4d5 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:12:20.293084 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-52b0215f-acda-4a99-ae6a-9f11f7dae4d5 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:12:20.293622 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-52b0215f-acda-4a99-ae6a-9f11f7dae4d5 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:12:20.294670 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-52b0215f-acda-4a99-ae6a-9f11f7dae4d5 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:12:20.295199 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-52b0215f-acda-4a99-ae6a-9f11f7dae4d5 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:12:20.295699 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-52b0215f-acda-4a99-ae6a-9f11f7dae4d5 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:12:20.433612 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-52b0215f-acda-4a99-ae6a-9f11f7dae4d5 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199e2426220e4cc4b1d37d4075e67cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9c33d4041764691b1ad69f9f1abe60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:12:20.442569 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-52b0215f-acda-4a99-ae6a-9f11f7dae4d5 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] 10.222.0.26 "GET /compute/v2.1/servers/c9eafd63-0da2-4643-a74d-1e383d6fdeb4" status: 200 len: 1574 microversion: 2.1 time: 0.162550 Oct 08 22:12:20.449623 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3536/7145] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:12:20 2022] GET /compute/v2.1/servers/c9eafd63-0da2-4643-a74d-1e383d6fdeb4 => generated 1574 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:12:20.778603 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-62418013-5d3f-4da9-b588-8243416624e8 req-e66866ee-425e-4e23-abc0-fa430d59e292 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9eafd63-0da2-4643-a74d-1e383d6fdeb4", "tag": "1c8f886c-8e52-4215-a69d-bcebfaed6731"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 22:12:20.788669 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-62418013-5d3f-4da9-b588-8243416624e8 req-e66866ee-425e-4e23-abc0-fa430d59e292 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:12:20.789176 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-62418013-5d3f-4da9-b588-8243416624e8 req-e66866ee-425e-4e23-abc0-fa430d59e292 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:12:20.789656 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-62418013-5d3f-4da9-b588-8243416624e8 req-e66866ee-425e-4e23-abc0-fa430d59e292 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:12:20.801487 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-62418013-5d3f-4da9-b588-8243416624e8 req-e66866ee-425e-4e23-abc0-fa430d59e292 service nova] Creating event network-changed:1c8f886c-8e52-4215-a69d-bcebfaed6731 for instance c9eafd63-0da2-4643-a74d-1e383d6fdeb4 on nch2-master-1 Oct 08 22:12:20.806616 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-62418013-5d3f-4da9-b588-8243416624e8 req-e66866ee-425e-4e23-abc0-fa430d59e292 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032960 Oct 08 22:12:20.807303 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3610/7146] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 22:12:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 22:12:21.465973 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-d0216715-231e-4353-86b6-635cacad6572 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:12:21.466624 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-d0216715-231e-4353-86b6-635cacad6572 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] [instance: c9eafd63-0da2-4643-a74d-1e383d6fdeb4] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:12:21.474062 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d0216715-231e-4353-86b6-635cacad6572 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:12:21.474706 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d0216715-231e-4353-86b6-635cacad6572 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:12:21.475162 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d0216715-231e-4353-86b6-635cacad6572 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:12:21.475872 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d0216715-231e-4353-86b6-635cacad6572 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:12:21.476336 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d0216715-231e-4353-86b6-635cacad6572 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:12:21.476776 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d0216715-231e-4353-86b6-635cacad6572 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:12:21.607145 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-d0216715-231e-4353-86b6-635cacad6572 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199e2426220e4cc4b1d37d4075e67cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9c33d4041764691b1ad69f9f1abe60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:12:21.615614 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-d0216715-231e-4353-86b6-635cacad6572 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] 10.222.0.26 "GET /compute/v2.1/servers/c9eafd63-0da2-4643-a74d-1e383d6fdeb4" status: 200 len: 1574 microversion: 2.1 time: 0.153641 Oct 08 22:12:21.616190 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3537/7147] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:12:21 2022] GET /compute/v2.1/servers/c9eafd63-0da2-4643-a74d-1e383d6fdeb4 => generated 1574 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:12:22.640214 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-9898d5ef-d7ef-4970-b148-4de9ce779396 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:12:22.640939 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-9898d5ef-d7ef-4970-b148-4de9ce779396 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] [instance: c9eafd63-0da2-4643-a74d-1e383d6fdeb4] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:12:22.647268 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9898d5ef-d7ef-4970-b148-4de9ce779396 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:12:22.647780 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9898d5ef-d7ef-4970-b148-4de9ce779396 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:12:22.648239 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9898d5ef-d7ef-4970-b148-4de9ce779396 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:12:22.648960 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9898d5ef-d7ef-4970-b148-4de9ce779396 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:12:22.649468 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9898d5ef-d7ef-4970-b148-4de9ce779396 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:12:22.649918 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-9898d5ef-d7ef-4970-b148-4de9ce779396 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:12:22.784858 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-9898d5ef-d7ef-4970-b148-4de9ce779396 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199e2426220e4cc4b1d37d4075e67cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9c33d4041764691b1ad69f9f1abe60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:12:22.792694 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-9898d5ef-d7ef-4970-b148-4de9ce779396 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] 10.222.0.26 "GET /compute/v2.1/servers/c9eafd63-0da2-4643-a74d-1e383d6fdeb4" status: 200 len: 1574 microversion: 2.1 time: 0.157611 Oct 08 22:12:22.793307 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3611/7148] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:12:22 2022] GET /compute/v2.1/servers/c9eafd63-0da2-4643-a74d-1e383d6fdeb4 => generated 1574 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 22:12:23.816539 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-68f492dc-ad99-4761-afaf-d5e32f589264 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:12:23.817209 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-68f492dc-ad99-4761-afaf-d5e32f589264 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] [instance: c9eafd63-0da2-4643-a74d-1e383d6fdeb4] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:12:23.824379 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-68f492dc-ad99-4761-afaf-d5e32f589264 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:12:23.824875 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-68f492dc-ad99-4761-afaf-d5e32f589264 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:12:23.825360 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-68f492dc-ad99-4761-afaf-d5e32f589264 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:12:23.826076 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-68f492dc-ad99-4761-afaf-d5e32f589264 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:12:23.826547 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-68f492dc-ad99-4761-afaf-d5e32f589264 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:12:23.826989 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-68f492dc-ad99-4761-afaf-d5e32f589264 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:12:23.960719 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-68f492dc-ad99-4761-afaf-d5e32f589264 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199e2426220e4cc4b1d37d4075e67cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9c33d4041764691b1ad69f9f1abe60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:12:23.968802 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-68f492dc-ad99-4761-afaf-d5e32f589264 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] 10.222.0.26 "GET /compute/v2.1/servers/c9eafd63-0da2-4643-a74d-1e383d6fdeb4" status: 200 len: 1574 microversion: 2.1 time: 0.156823 Oct 08 22:12:23.969403 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3538/7149] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:12:23 2022] GET /compute/v2.1/servers/c9eafd63-0da2-4643-a74d-1e383d6fdeb4 => generated 1574 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:12:24.991705 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-bc4d783a-3fb4-4e35-baa7-86849264c53b tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:12:24.992495 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-bc4d783a-3fb4-4e35-baa7-86849264c53b tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] [instance: c9eafd63-0da2-4643-a74d-1e383d6fdeb4] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:12:24.999510 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bc4d783a-3fb4-4e35-baa7-86849264c53b tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:12:25.000022 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bc4d783a-3fb4-4e35-baa7-86849264c53b tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:12:25.000486 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bc4d783a-3fb4-4e35-baa7-86849264c53b tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:12:25.001232 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bc4d783a-3fb4-4e35-baa7-86849264c53b tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:12:25.001720 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bc4d783a-3fb4-4e35-baa7-86849264c53b tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:12:25.002180 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-bc4d783a-3fb4-4e35-baa7-86849264c53b tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:12:25.134328 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-bc4d783a-3fb4-4e35-baa7-86849264c53b tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199e2426220e4cc4b1d37d4075e67cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9c33d4041764691b1ad69f9f1abe60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:12:25.142861 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-bc4d783a-3fb4-4e35-baa7-86849264c53b tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] 10.222.0.26 "GET /compute/v2.1/servers/c9eafd63-0da2-4643-a74d-1e383d6fdeb4" status: 200 len: 1574 microversion: 2.1 time: 0.155093 Oct 08 22:12:25.143711 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3612/7150] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:12:24 2022] GET /compute/v2.1/servers/c9eafd63-0da2-4643-a74d-1e383d6fdeb4 => generated 1574 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:12:26.166335 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-c5168147-f624-4ddc-b329-d030b8afb979 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:12:26.166999 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-c5168147-f624-4ddc-b329-d030b8afb979 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] [instance: c9eafd63-0da2-4643-a74d-1e383d6fdeb4] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:12:26.174893 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c5168147-f624-4ddc-b329-d030b8afb979 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:12:26.175390 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c5168147-f624-4ddc-b329-d030b8afb979 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:12:26.175844 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c5168147-f624-4ddc-b329-d030b8afb979 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:12:26.176554 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c5168147-f624-4ddc-b329-d030b8afb979 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:12:26.177028 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c5168147-f624-4ddc-b329-d030b8afb979 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:12:26.177508 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-c5168147-f624-4ddc-b329-d030b8afb979 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:12:26.309849 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-c5168147-f624-4ddc-b329-d030b8afb979 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199e2426220e4cc4b1d37d4075e67cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9c33d4041764691b1ad69f9f1abe60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:12:26.317934 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-c5168147-f624-4ddc-b329-d030b8afb979 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] 10.222.0.26 "GET /compute/v2.1/servers/c9eafd63-0da2-4643-a74d-1e383d6fdeb4" status: 200 len: 1574 microversion: 2.1 time: 0.155606 Oct 08 22:12:26.318548 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3539/7151] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:12:26 2022] GET /compute/v2.1/servers/c9eafd63-0da2-4643-a74d-1e383d6fdeb4 => generated 1574 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:12:26.694185 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-9b523b9a-1d5b-4551-8a8c-441d3c316036 req-594c65f7-d2d2-445b-ad54-12bc3eee6e7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9eafd63-0da2-4643-a74d-1e383d6fdeb4", "name": "network-vif-plugged", "status": "completed", "tag": "1c8f886c-8e52-4215-a69d-bcebfaed6731"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 22:12:26.705831 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-9b523b9a-1d5b-4551-8a8c-441d3c316036 req-594c65f7-d2d2-445b-ad54-12bc3eee6e7b service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:12:26.706341 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-9b523b9a-1d5b-4551-8a8c-441d3c316036 req-594c65f7-d2d2-445b-ad54-12bc3eee6e7b service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:12:26.706801 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-9b523b9a-1d5b-4551-8a8c-441d3c316036 req-594c65f7-d2d2-445b-ad54-12bc3eee6e7b service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:12:26.718165 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-9b523b9a-1d5b-4551-8a8c-441d3c316036 req-594c65f7-d2d2-445b-ad54-12bc3eee6e7b service nova] Creating event network-vif-plugged:1c8f886c-8e52-4215-a69d-bcebfaed6731 for instance c9eafd63-0da2-4643-a74d-1e383d6fdeb4 on nch2-master-1 Oct 08 22:12:26.723228 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-9b523b9a-1d5b-4551-8a8c-441d3c316036 req-594c65f7-d2d2-445b-ad54-12bc3eee6e7b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032847 Oct 08 22:12:26.723836 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3613/7152] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 22:12:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 22:12:27.341198 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-5a56c230-5b52-4b7e-a47a-18734f42e1f0 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:12:27.341825 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-5a56c230-5b52-4b7e-a47a-18734f42e1f0 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] [instance: c9eafd63-0da2-4643-a74d-1e383d6fdeb4] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:12:27.348976 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5a56c230-5b52-4b7e-a47a-18734f42e1f0 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:12:27.349511 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5a56c230-5b52-4b7e-a47a-18734f42e1f0 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:12:27.349957 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5a56c230-5b52-4b7e-a47a-18734f42e1f0 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:12:27.350656 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5a56c230-5b52-4b7e-a47a-18734f42e1f0 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:12:27.351120 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5a56c230-5b52-4b7e-a47a-18734f42e1f0 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:12:27.351552 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5a56c230-5b52-4b7e-a47a-18734f42e1f0 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:12:27.484791 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-5a56c230-5b52-4b7e-a47a-18734f42e1f0 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199e2426220e4cc4b1d37d4075e67cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9c33d4041764691b1ad69f9f1abe60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:12:27.492964 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-5a56c230-5b52-4b7e-a47a-18734f42e1f0 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] 10.222.0.26 "GET /compute/v2.1/servers/c9eafd63-0da2-4643-a74d-1e383d6fdeb4" status: 200 len: 1574 microversion: 2.1 time: 0.155663 Oct 08 22:12:27.493583 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3540/7153] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:12:27 2022] GET /compute/v2.1/servers/c9eafd63-0da2-4643-a74d-1e383d6fdeb4 => generated 1574 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:12:28.518083 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-0e9401dd-d098-4d17-82a2-80f818026aa6 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:12:28.518804 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-0e9401dd-d098-4d17-82a2-80f818026aa6 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] [instance: c9eafd63-0da2-4643-a74d-1e383d6fdeb4] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:12:28.525041 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0e9401dd-d098-4d17-82a2-80f818026aa6 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:12:28.525580 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0e9401dd-d098-4d17-82a2-80f818026aa6 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:12:28.526033 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0e9401dd-d098-4d17-82a2-80f818026aa6 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:12:28.526739 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0e9401dd-d098-4d17-82a2-80f818026aa6 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:12:28.527218 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0e9401dd-d098-4d17-82a2-80f818026aa6 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:12:28.527660 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0e9401dd-d098-4d17-82a2-80f818026aa6 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:12:28.661118 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-0e9401dd-d098-4d17-82a2-80f818026aa6 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199e2426220e4cc4b1d37d4075e67cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9c33d4041764691b1ad69f9f1abe60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:12:28.669393 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-0e9401dd-d098-4d17-82a2-80f818026aa6 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] 10.222.0.26 "GET /compute/v2.1/servers/c9eafd63-0da2-4643-a74d-1e383d6fdeb4" status: 200 len: 1561 microversion: 2.1 time: 0.156955 Oct 08 22:12:28.669977 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3614/7154] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:12:28 2022] GET /compute/v2.1/servers/c9eafd63-0da2-4643-a74d-1e383d6fdeb4 => generated 1561 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:13:52.580063 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 22:13:52.581531 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 22:13:52.582359 ncdv-master-1 devstack@n-api.service[140491]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 08 22:13:52.582473 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=28 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 22:13:52.583377 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 22:13:52.583503 ncdv-master-1 devstack@n-api.service[140491]: Sat Oct 8 22:13:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c9eafd63-0da2-4643-a74d-1e383d6fdeb4 (ip 10.222.0.26) !!! Oct 08 22:13:52.584535 ncdv-master-1 devstack@n-api.service[140492]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 08 22:13:52.584883 ncdv-master-1 devstack@n-api.service[140492]: Sat Oct 8 22:13:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.26) !!! Oct 08 22:13:52.586259 ncdv-master-1 devstack@n-api.service[140492]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 08 22:13:52.586362 ncdv-master-1 devstack@n-api.service[140492]: Sat Oct 8 22:13:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.26) !!! Oct 08 22:13:52.588648 ncdv-master-1 devstack@n-api.service[140491]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 08 22:13:52.589122 ncdv-master-1 devstack@n-api.service[140491]: Sat Oct 8 22:13:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c9eafd63-0da2-4643-a74d-1e383d6fdeb4 (ip 10.222.0.26) !!! Oct 08 22:13:52.591445 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-5fcd477a-3483-4e57-94e4-2dda17eb6660 req-1cc7536b-a114-45d0-b0c4-31f15eb9b23c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9eafd63-0da2-4643-a74d-1e383d6fdeb4", "tag": "1c8f886c-8e52-4215-a69d-bcebfaed6731"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 22:13:52.599146 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-1da7899e-973c-4021-b99e-190c43fecdfe tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:13:52.599982 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-1da7899e-973c-4021-b99e-190c43fecdfe tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] [instance: c9eafd63-0da2-4643-a74d-1e383d6fdeb4] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:13:52.607692 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-5fcd477a-3483-4e57-94e4-2dda17eb6660 req-1cc7536b-a114-45d0-b0c4-31f15eb9b23c service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:13:52.608440 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-5fcd477a-3483-4e57-94e4-2dda17eb6660 req-1cc7536b-a114-45d0-b0c4-31f15eb9b23c service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:13:52.609044 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-5fcd477a-3483-4e57-94e4-2dda17eb6660 req-1cc7536b-a114-45d0-b0c4-31f15eb9b23c service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:13:52.622851 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1da7899e-973c-4021-b99e-190c43fecdfe tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:13:52.623488 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1da7899e-973c-4021-b99e-190c43fecdfe tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:13:52.624040 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1da7899e-973c-4021-b99e-190c43fecdfe tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:13:52.624378 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-5fcd477a-3483-4e57-94e4-2dda17eb6660 req-1cc7536b-a114-45d0-b0c4-31f15eb9b23c service nova] Creating event network-changed:1c8f886c-8e52-4215-a69d-bcebfaed6731 for instance c9eafd63-0da2-4643-a74d-1e383d6fdeb4 on nch2-master-1 Oct 08 22:13:52.625079 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1da7899e-973c-4021-b99e-190c43fecdfe tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:13:52.625647 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1da7899e-973c-4021-b99e-190c43fecdfe tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:13:52.626159 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1da7899e-973c-4021-b99e-190c43fecdfe tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:13:52.629527 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-5fcd477a-3483-4e57-94e4-2dda17eb6660 req-1cc7536b-a114-45d0-b0c4-31f15eb9b23c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049295 Oct 08 22:13:52.630643 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3615/7155] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 22:13:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 22:13:52.660147 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-1da7899e-973c-4021-b99e-190c43fecdfe tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] [instance: c9eafd63-0da2-4643-a74d-1e383d6fdeb4] Going to try to terminate instance {{(pid=140491) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 22:13:52.749782 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-1da7899e-973c-4021-b99e-190c43fecdfe tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] 10.222.0.26 "DELETE /compute/v2.1/servers/c9eafd63-0da2-4643-a74d-1e383d6fdeb4" status: 204 len: 0 microversion: 2.1 time: 0.171444 Oct 08 22:13:52.750821 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3541/7156] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 22:13:52 2022] DELETE /compute/v2.1/servers/c9eafd63-0da2-4643-a74d-1e383d6fdeb4 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 22:13:52.759795 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-02701abc-c6be-4e0e-a8f7-762692f1cc8a tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:13:52.760757 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-02701abc-c6be-4e0e-a8f7-762692f1cc8a tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] [instance: c9eafd63-0da2-4643-a74d-1e383d6fdeb4] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:13:52.767380 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-02701abc-c6be-4e0e-a8f7-762692f1cc8a tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:13:52.768080 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-02701abc-c6be-4e0e-a8f7-762692f1cc8a tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:13:52.768775 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-02701abc-c6be-4e0e-a8f7-762692f1cc8a tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:13:52.769613 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-02701abc-c6be-4e0e-a8f7-762692f1cc8a tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:13:52.770168 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-02701abc-c6be-4e0e-a8f7-762692f1cc8a tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:13:52.771340 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-02701abc-c6be-4e0e-a8f7-762692f1cc8a tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:13:52.908337 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-02701abc-c6be-4e0e-a8f7-762692f1cc8a tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199e2426220e4cc4b1d37d4075e67cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9c33d4041764691b1ad69f9f1abe60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:13:52.917094 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-02701abc-c6be-4e0e-a8f7-762692f1cc8a tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] 10.222.0.26 "GET /compute/v2.1/servers/c9eafd63-0da2-4643-a74d-1e383d6fdeb4" status: 200 len: 1567 microversion: 2.1 time: 0.161660 Oct 08 22:13:52.917997 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3616/7157] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:13:52 2022] GET /compute/v2.1/servers/c9eafd63-0da2-4643-a74d-1e383d6fdeb4 => generated 1567 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:13:53.942495 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-0abe59f3-35c6-47e3-b14b-11764819a637 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:13:53.943208 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-0abe59f3-35c6-47e3-b14b-11764819a637 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] [instance: c9eafd63-0da2-4643-a74d-1e383d6fdeb4] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:13:53.950271 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0abe59f3-35c6-47e3-b14b-11764819a637 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:13:53.950767 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0abe59f3-35c6-47e3-b14b-11764819a637 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:13:53.951211 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0abe59f3-35c6-47e3-b14b-11764819a637 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:13:53.951923 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0abe59f3-35c6-47e3-b14b-11764819a637 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:13:53.952384 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0abe59f3-35c6-47e3-b14b-11764819a637 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:13:53.952824 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0abe59f3-35c6-47e3-b14b-11764819a637 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:13:54.088408 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-0abe59f3-35c6-47e3-b14b-11764819a637 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199e2426220e4cc4b1d37d4075e67cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9c33d4041764691b1ad69f9f1abe60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:13:54.096400 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-0abe59f3-35c6-47e3-b14b-11764819a637 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] 10.222.0.26 "GET /compute/v2.1/servers/c9eafd63-0da2-4643-a74d-1e383d6fdeb4" status: 200 len: 1567 microversion: 2.1 time: 0.158199 Oct 08 22:13:54.096980 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3542/7158] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:13:53 2022] GET /compute/v2.1/servers/c9eafd63-0da2-4643-a74d-1e383d6fdeb4 => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:13:54.695864 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-855cb36a-19cb-432f-a180-50fefb4d4203 req-f1cf6b8a-9db1-4c37-beeb-4ab4ce6b1e31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9eafd63-0da2-4643-a74d-1e383d6fdeb4", "name": "network-vif-deleted", "tag": "1c8f886c-8e52-4215-a69d-bcebfaed6731"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 22:13:54.707226 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-855cb36a-19cb-432f-a180-50fefb4d4203 req-f1cf6b8a-9db1-4c37-beeb-4ab4ce6b1e31 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:13:54.707730 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-855cb36a-19cb-432f-a180-50fefb4d4203 req-f1cf6b8a-9db1-4c37-beeb-4ab4ce6b1e31 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:13:54.708185 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-855cb36a-19cb-432f-a180-50fefb4d4203 req-f1cf6b8a-9db1-4c37-beeb-4ab4ce6b1e31 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:13:54.723506 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-855cb36a-19cb-432f-a180-50fefb4d4203 req-f1cf6b8a-9db1-4c37-beeb-4ab4ce6b1e31 service nova] Creating event network-vif-deleted:1c8f886c-8e52-4215-a69d-bcebfaed6731 for instance c9eafd63-0da2-4643-a74d-1e383d6fdeb4 on nch2-master-1 Oct 08 22:13:54.729152 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-855cb36a-19cb-432f-a180-50fefb4d4203 req-f1cf6b8a-9db1-4c37-beeb-4ab4ce6b1e31 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036885 Oct 08 22:13:54.729843 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3617/7159] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 22:13:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 22:13:55.120756 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-012fcad5-1295-403a-baff-fcb2215f8567 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:13:55.121724 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-012fcad5-1295-403a-baff-fcb2215f8567 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] [instance: c9eafd63-0da2-4643-a74d-1e383d6fdeb4] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:13:55.130190 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-012fcad5-1295-403a-baff-fcb2215f8567 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:13:55.130687 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-012fcad5-1295-403a-baff-fcb2215f8567 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:13:55.131276 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-012fcad5-1295-403a-baff-fcb2215f8567 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:13:55.132027 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-012fcad5-1295-403a-baff-fcb2215f8567 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:13:55.132624 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-012fcad5-1295-403a-baff-fcb2215f8567 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:13:55.133298 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-012fcad5-1295-403a-baff-fcb2215f8567 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:13:55.174624 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-012fcad5-1295-403a-baff-fcb2215f8567 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:13:55.175142 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-012fcad5-1295-403a-baff-fcb2215f8567 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:13:55.175768 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-012fcad5-1295-403a-baff-fcb2215f8567 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:13:55.176235 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.objects.instance [None req-012fcad5-1295-403a-baff-fcb2215f8567 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lazy-loading 'fault' on Instance uuid c9eafd63-0da2-4643-a74d-1e383d6fdeb4 {{(pid=140491) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 22:13:55.220208 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-012fcad5-1295-403a-baff-fcb2215f8567 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199e2426220e4cc4b1d37d4075e67cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9c33d4041764691b1ad69f9f1abe60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:13:55.228234 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-012fcad5-1295-403a-baff-fcb2215f8567 tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] 10.222.0.26 "GET /compute/v2.1/servers/c9eafd63-0da2-4643-a74d-1e383d6fdeb4" status: 200 len: 1224 microversion: 2.1 time: 0.112014 Oct 08 22:13:55.228825 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3543/7160] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:13:55 2022] GET /compute/v2.1/servers/c9eafd63-0da2-4643-a74d-1e383d6fdeb4 => generated 1224 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:13:56.253971 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e2e7ae03-a95c-47db-b53f-cf0d3e97025e tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:13:56.254690 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-e2e7ae03-a95c-47db-b53f-cf0d3e97025e tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] [instance: c9eafd63-0da2-4643-a74d-1e383d6fdeb4] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:13:56.261479 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e2e7ae03-a95c-47db-b53f-cf0d3e97025e tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:13:56.261986 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e2e7ae03-a95c-47db-b53f-cf0d3e97025e tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:13:56.262442 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e2e7ae03-a95c-47db-b53f-cf0d3e97025e tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:13:56.263154 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e2e7ae03-a95c-47db-b53f-cf0d3e97025e tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:13:56.263627 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e2e7ae03-a95c-47db-b53f-cf0d3e97025e tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:13:56.264071 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e2e7ae03-a95c-47db-b53f-cf0d3e97025e tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:13:56.278017 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.wsgi [None req-e2e7ae03-a95c-47db-b53f-cf0d3e97025e tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] HTTP exception thrown: Instance c9eafd63-0da2-4643-a74d-1e383d6fdeb4 could not be found. Oct 08 22:13:56.279647 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e2e7ae03-a95c-47db-b53f-cf0d3e97025e tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Request method failure captured: Oct 08 22:13:56.279647 ncdv-master-1 devstack@n-api.service[140492]: request: GET /compute/v2.1/servers/c9eafd63-0da2-4643-a74d-1e383d6fdeb4 HTTP/1.1 Oct 08 22:13:56.279647 ncdv-master-1 devstack@n-api.service[140492]: Accept: application/json Oct 08 22:13:56.279647 ncdv-master-1 devstack@n-api.service[140492]: Accept-Encoding: identity Oct 08 22:13:56.279647 ncdv-master-1 devstack@n-api.service[140492]: Connection: close Oct 08 22:13:56.279647 ncdv-master-1 devstack@n-api.service[140492]: Content-Length: 0 Oct 08 22:13:56.279647 ncdv-master-1 devstack@n-api.service[140492]: Content-Type: application/json Oct 08 22:13:56.279647 ncdv-master-1 devstack@n-api.service[140492]: Host: 10.222.0.26 Oct 08 22:13:56.279647 ncdv-master-1 devstack@n-api.service[140492]: Openstack-System-Scope: None Oct 08 22:13:56.279647 ncdv-master-1 devstack@n-api.service[140492]: User-Agent: python-urllib3/1.26.12 Oct 08 22:13:56.279647 ncdv-master-1 devstack@n-api.service[140492]: X-Auth-Token: gAAAAABjQfQfwOeOD_h28ZXUX0Mio5ykOzikUZ3e8zaAvCoxjW8dzIN62JUSUwvibd0TyKESjD6um23qOgep7ErNu7l16yQbbY1R9acWaVK17v15lYnMb25_LNwTUs17Vs9WrNNcn-D5yP_b9HqZH-fh2_bvi3SY-CWgCAaFy3CkiagVNowU7WA Oct 08 22:13:56.279647 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Id: None Oct 08 22:13:56.279647 ncdv-master-1 devstack@n-api.service[140492]: X-Domain-Name: None Oct 08 22:13:56.279647 ncdv-master-1 devstack@n-api.service[140492]: X-Identity-Status: Confirmed Oct 08 22:13:56.279647 ncdv-master-1 devstack@n-api.service[140492]: X-Is-Admin-Project: True Oct 08 22:13:56.279647 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Id: default Oct 08 22:13:56.279647 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Domain-Name: Default Oct 08 22:13:56.279647 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Id: b9c33d4041764691b1ad69f9f1abe60b Oct 08 22:13:56.279647 ncdv-master-1 devstack@n-api.service[140492]: X-Project-Name: tempest-TestShelveInstance-1230879253 Oct 08 22:13:56.279647 ncdv-master-1 devstack@n-api.service[140492]: X-Role: reader,member Oct 08 22:13:56.279647 ncdv-master-1 devstack@n-api.service[140492]: X-Roles: reader,member Oct 08 22:13:56.279647 ncdv-master-1 devstack@n-api.service[140492]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b9c33d4041764691b1ad69f9f1abe60b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b9c33d4041764691b1ad69f9f1abe60b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b9c33d4041764691b1ad69f9f1abe60b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b9c33d4041764691b1ad69f9f1abe60b"}]}] Oct 08 22:13:56.279647 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant: tempest-TestShelveInstance-1230879253 Oct 08 22:13:56.279647 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Id: b9c33d4041764691b1ad69f9f1abe60b Oct 08 22:13:56.279647 ncdv-master-1 devstack@n-api.service[140492]: X-Tenant-Name: tempest-TestShelveInstance-1230879253 Oct 08 22:13:56.279647 ncdv-master-1 devstack@n-api.service[140492]: X-User: tempest-TestShelveInstance-1230879253-project Oct 08 22:13:56.279647 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Id: default Oct 08 22:13:56.279647 ncdv-master-1 devstack@n-api.service[140492]: X-User-Domain-Name: Default Oct 08 22:13:56.279647 ncdv-master-1 devstack@n-api.service[140492]: X-User-Id: 199e2426220e4cc4b1d37d4075e67cbc Oct 08 22:13:56.279647 ncdv-master-1 devstack@n-api.service[140492]: X-User-Name: tempest-TestShelveInstance-1230879253-project Oct 08 22:13:56.279647 ncdv-master-1 devstack@n-api.service[140492]: method: > Oct 08 22:13:56.279647 ncdv-master-1 devstack@n-api.service[140492]: exception: Instance c9eafd63-0da2-4643-a74d-1e383d6fdeb4 could not be found. Oct 08 22:13:56.279647 ncdv-master-1 devstack@n-api.service[140492]: action_args: {'id': 'c9eafd63-0da2-4643-a74d-1e383d6fdeb4'} Oct 08 22:13:56.279647 ncdv-master-1 devstack@n-api.service[140492]: {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 22:13:56.279647 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 22:13:56.279647 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 22:13:56.279647 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 22:13:56.279647 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 22:13:56.279647 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 22:13:56.279647 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 22:13:56.279647 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 22:13:56.279647 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 22:13:56.279647 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 22:13:56.279647 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9eafd63-0da2-4643-a74d-1e383d6fdeb4 could not be found. Oct 08 22:13:56.279647 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 22:13:56.279647 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 22:13:56.279647 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 22:13:56.279647 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 22:13:56.279647 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 22:13:56.279647 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 22:13:56.279647 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 22:13:56.279647 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 22:13:56.279647 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 22:13:56.279647 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 22:13:56.279647 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 22:13:56.279647 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 22:13:56.279647 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 22:13:56.279647 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 22:13:56.279647 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 22:13:56.279647 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 22:13:56.279647 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9eafd63-0da2-4643-a74d-1e383d6fdeb4 could not be found. Oct 08 22:13:56.279647 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 22:13:56.279647 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 22:13:56.279647 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 22:13:56.283719 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 22:13:56.283719 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 22:13:56.283719 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 22:13:56.283719 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 22:13:56.283719 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 22:13:56.283719 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9eafd63-0da2-4643-a74d-1e383d6fdeb4 could not be found. Oct 08 22:13:56.283719 ncdv-master-1 devstack@n-api.service[140492]: ERROR nova.api.openstack.wsgi Oct 08 22:13:56.283719 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e2e7ae03-a95c-47db-b53f-cf0d3e97025e tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Returning 404 to user: Instance c9eafd63-0da2-4643-a74d-1e383d6fdeb4 could not be found. {{(pid=140492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 22:13:56.283719 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-e2e7ae03-a95c-47db-b53f-cf0d3e97025e tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] 10.222.0.26 "GET /compute/v2.1/servers/c9eafd63-0da2-4643-a74d-1e383d6fdeb4" status: 404 len: 111 microversion: 2.1 time: 0.032231 Oct 08 22:13:56.283719 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3618/7161] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:13:56 2022] GET /compute/v2.1/servers/c9eafd63-0da2-4643-a74d-1e383d6fdeb4 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 22:13:56.442621 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-acea2689-df07-48a6-9dd2-eee1b79b068b tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] Calling method '.version_select at 0x7f1a877c34c0>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:13:56.469045 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-acea2689-df07-48a6-9dd2-eee1b79b068b tempest-TestShelveInstance-1230879253 tempest-TestShelveInstance-1230879253-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-559826009" status: 202 len: 0 microversion: 2.1 time: 0.030146 Oct 08 22:13:56.469752 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3544/7162] 10.222.0.26 () {58 vars in 1251 bytes} [Sat Oct 8 22:13:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-559826009 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 08 22:14:13.745398 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=8 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 22:14:13.746627 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=12 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 22:14:13.966353 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-fc218e1e-cb05-402c-9fe7-89d2319434c2 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Action: 'create', calling method: .version_select at 0x7f1a87485160>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-574754041", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIYz6bTUa7qFzu4lKt3FqP67G1gbEFyIXUQqSo2OCrWtAuVxa9iGKlISIiYpYXm059H816hvw22f4mTN74vWGpT/pzstc90WT8dU89ZFxaEkPTM2wDqKJSgohOiRs+FbQg=="}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 22:14:14.001009 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-fc218e1e-cb05-402c-9fe7-89d2319434c2 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Getting quotas for project 00e9fa73af9541119afd5edb5d180e58. Resources: {'key_pairs'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 22:14:14.006887 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-fc218e1e-cb05-402c-9fe7-89d2319434c2 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Getting quotas for user a42e32e56dd84caab93645385e5a1493 and project 00e9fa73af9541119afd5edb5d180e58. Resources: {'key_pairs'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 22:14:14.038611 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-fc218e1e-cb05-402c-9fe7-89d2319434c2 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.298347 Oct 08 22:14:14.039804 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3619/7163] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Oct 8 22:14:13 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 22:14:15.098986 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-b024731c-1163-4e5e-92ce-a8eb57ba2c22 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1302372416", "imageRef": "c508bd7f-7db9-4b2c-af7c-be54a855c355", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-574754041", "security_groups": [{"name": "tempest-secgroup-smoke-463714693"}], "networks": [{"uuid": "1f0bd3e2-c8df-474e-9118-03b664c5a32a"}]}} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 22:14:15.111512 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 22:14:15.112209 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 22:14:15.228694 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.network.neutron [None req-b024731c-1163-4e5e-92ce-a8eb57ba2c22 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] validate_networks() for [('1f0bd3e2-c8df-474e-9118-03b664c5a32a', None, None, None, None, None)] {{(pid=140491) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 22:14:15.718859 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-b024731c-1163-4e5e-92ce-a8eb57ba2c22 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Flavor limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 22:14:15.719299 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-b024731c-1163-4e5e-92ce-a8eb57ba2c22 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Image limits 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 22:14:15.719789 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-b024731c-1163-4e5e-92ce-a8eb57ba2c22 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Flavor pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 22:14:15.720242 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-b024731c-1163-4e5e-92ce-a8eb57ba2c22 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Image pref 0:0:0 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 22:14:15.720668 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.virt.hardware [None req-b024731c-1163-4e5e-92ce-a8eb57ba2c22 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140491) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 22:14:15.730336 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b024731c-1163-4e5e-92ce-a8eb57ba2c22 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:14:15.730826 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b024731c-1163-4e5e-92ce-a8eb57ba2c22 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:14:15.731274 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b024731c-1163-4e5e-92ce-a8eb57ba2c22 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:14:15.732014 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b024731c-1163-4e5e-92ce-a8eb57ba2c22 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:14:15.732655 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b024731c-1163-4e5e-92ce-a8eb57ba2c22 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:14:15.733109 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b024731c-1163-4e5e-92ce-a8eb57ba2c22 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:14:15.750956 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-b024731c-1163-4e5e-92ce-a8eb57ba2c22 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Getting quotas for project 00e9fa73af9541119afd5edb5d180e58. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 22:14:15.756246 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.quota [None req-b024731c-1163-4e5e-92ce-a8eb57ba2c22 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Getting quotas for user a42e32e56dd84caab93645385e5a1493 and project 00e9fa73af9541119afd5edb5d180e58. Resources: {'cores', 'instances', 'ram'} {{(pid=140491) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 22:14:15.770382 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-b024731c-1163-4e5e-92ce-a8eb57ba2c22 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Going to run 1 instances... {{(pid=140491) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 22:14:15.772594 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-b024731c-1163-4e5e-92ce-a8eb57ba2c22 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] [instance: a2d51aac-8a74-49d3-ac3d-77b791fe832d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c508bd7f-7db9-4b2c-af7c-be54a855c355',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140491) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 22:14:15.829582 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-b024731c-1163-4e5e-92ce-a8eb57ba2c22 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.734966 Oct 08 22:14:15.830474 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3545/7164] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 22:14:15 2022] POST /compute/v2.1/servers => generated 405 bytes in 737 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 08 22:14:15.842588 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-aa696c9f-f649-471c-a720-d482543f6dbd tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:14:15.843248 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-aa696c9f-f649-471c-a720-d482543f6dbd tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] [instance: a2d51aac-8a74-49d3-ac3d-77b791fe832d] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:14:15.901786 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-aa696c9f-f649-471c-a720-d482543f6dbd tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e32e56dd84caab93645385e5a1493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e9fa73af9541119afd5edb5d180e58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:14:15.909315 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-aa696c9f-f649-471c-a720-d482543f6dbd tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] 10.222.0.26 "GET /compute/v2.1/servers/a2d51aac-8a74-49d3-ac3d-77b791fe832d" status: 200 len: 1248 microversion: 2.1 time: 0.071445 Oct 08 22:14:15.910179 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3620/7165] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:14:15 2022] GET /compute/v2.1/servers/a2d51aac-8a74-49d3-ac3d-77b791fe832d => generated 1248 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:14:16.934665 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-a8dea410-ef45-4440-8b02-afd9322767da tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:14:16.935287 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-a8dea410-ef45-4440-8b02-afd9322767da tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] [instance: a2d51aac-8a74-49d3-ac3d-77b791fe832d] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:14:16.941726 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a8dea410-ef45-4440-8b02-afd9322767da tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:14:16.942461 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a8dea410-ef45-4440-8b02-afd9322767da tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:14:16.942908 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a8dea410-ef45-4440-8b02-afd9322767da tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:14:16.943632 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a8dea410-ef45-4440-8b02-afd9322767da tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:14:16.944097 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a8dea410-ef45-4440-8b02-afd9322767da tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:14:16.944531 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a8dea410-ef45-4440-8b02-afd9322767da tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:14:17.010498 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-a8dea410-ef45-4440-8b02-afd9322767da tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e32e56dd84caab93645385e5a1493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e9fa73af9541119afd5edb5d180e58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:14:17.019061 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-a8dea410-ef45-4440-8b02-afd9322767da tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] 10.222.0.26 "GET /compute/v2.1/servers/a2d51aac-8a74-49d3-ac3d-77b791fe832d" status: 200 len: 1300 microversion: 2.1 time: 0.090319 Oct 08 22:14:17.019646 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3546/7166] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:14:16 2022] GET /compute/v2.1/servers/a2d51aac-8a74-49d3-ac3d-77b791fe832d => generated 1300 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:14:18.043162 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-cb5c3f57-3060-4433-b209-3abf29026590 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:14:18.043817 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-cb5c3f57-3060-4433-b209-3abf29026590 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] [instance: a2d51aac-8a74-49d3-ac3d-77b791fe832d] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:14:18.051796 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cb5c3f57-3060-4433-b209-3abf29026590 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:14:18.052320 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cb5c3f57-3060-4433-b209-3abf29026590 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:14:18.052791 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cb5c3f57-3060-4433-b209-3abf29026590 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:14:18.053566 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cb5c3f57-3060-4433-b209-3abf29026590 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:14:18.054054 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cb5c3f57-3060-4433-b209-3abf29026590 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:14:18.054507 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cb5c3f57-3060-4433-b209-3abf29026590 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:14:18.268974 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-cb5c3f57-3060-4433-b209-3abf29026590 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e32e56dd84caab93645385e5a1493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e9fa73af9541119afd5edb5d180e58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:14:18.279411 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-cb5c3f57-3060-4433-b209-3abf29026590 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] 10.222.0.26 "GET /compute/v2.1/servers/a2d51aac-8a74-49d3-ac3d-77b791fe832d" status: 200 len: 1373 microversion: 2.1 time: 0.240394 Oct 08 22:14:18.280423 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3621/7167] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:14:18 2022] GET /compute/v2.1/servers/a2d51aac-8a74-49d3-ac3d-77b791fe832d => generated 1373 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:14:18.989270 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-9fbf10bc-5a28-4a29-aa84-5472c2def448 req-da815721-19a9-40e8-b24b-d46fde674d75 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2d51aac-8a74-49d3-ac3d-77b791fe832d", "tag": "7811a981-7178-413d-9a67-05816a4783a0"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 22:14:19.001623 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-9fbf10bc-5a28-4a29-aa84-5472c2def448 req-da815721-19a9-40e8-b24b-d46fde674d75 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:14:19.002116 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-9fbf10bc-5a28-4a29-aa84-5472c2def448 req-da815721-19a9-40e8-b24b-d46fde674d75 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:14:19.002558 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-9fbf10bc-5a28-4a29-aa84-5472c2def448 req-da815721-19a9-40e8-b24b-d46fde674d75 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:14:19.025734 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-9fbf10bc-5a28-4a29-aa84-5472c2def448 req-da815721-19a9-40e8-b24b-d46fde674d75 service nova] Creating event network-changed:7811a981-7178-413d-9a67-05816a4783a0 for instance a2d51aac-8a74-49d3-ac3d-77b791fe832d on nch1-master-1 Oct 08 22:14:19.030770 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-9fbf10bc-5a28-4a29-aa84-5472c2def448 req-da815721-19a9-40e8-b24b-d46fde674d75 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045325 Oct 08 22:14:19.031384 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3547/7168] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 22:14:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 22:14:19.306472 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-0226ba7c-ec5a-4e88-b125-a9711f392ce6 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:14:19.307115 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-0226ba7c-ec5a-4e88-b125-a9711f392ce6 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] [instance: a2d51aac-8a74-49d3-ac3d-77b791fe832d] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:14:19.314811 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0226ba7c-ec5a-4e88-b125-a9711f392ce6 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:14:19.315335 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0226ba7c-ec5a-4e88-b125-a9711f392ce6 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:14:19.315801 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0226ba7c-ec5a-4e88-b125-a9711f392ce6 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:14:19.316573 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0226ba7c-ec5a-4e88-b125-a9711f392ce6 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:14:19.317056 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0226ba7c-ec5a-4e88-b125-a9711f392ce6 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:14:19.317591 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-0226ba7c-ec5a-4e88-b125-a9711f392ce6 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:14:19.521131 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-0226ba7c-ec5a-4e88-b125-a9711f392ce6 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e32e56dd84caab93645385e5a1493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e9fa73af9541119afd5edb5d180e58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:14:19.529066 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-0226ba7c-ec5a-4e88-b125-a9711f392ce6 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] 10.222.0.26 "GET /compute/v2.1/servers/a2d51aac-8a74-49d3-ac3d-77b791fe832d" status: 200 len: 1373 microversion: 2.1 time: 0.227253 Oct 08 22:14:19.529691 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3622/7169] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:14:19 2022] GET /compute/v2.1/servers/a2d51aac-8a74-49d3-ac3d-77b791fe832d => generated 1373 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 22:14:20.553432 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-a51a0157-c5fe-4814-805c-5c3b22f5f4cd tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:14:20.554142 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-a51a0157-c5fe-4814-805c-5c3b22f5f4cd tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] [instance: a2d51aac-8a74-49d3-ac3d-77b791fe832d] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:14:20.560433 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a51a0157-c5fe-4814-805c-5c3b22f5f4cd tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:14:20.560932 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a51a0157-c5fe-4814-805c-5c3b22f5f4cd tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:14:20.561409 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a51a0157-c5fe-4814-805c-5c3b22f5f4cd tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:14:20.562121 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a51a0157-c5fe-4814-805c-5c3b22f5f4cd tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:14:20.562582 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a51a0157-c5fe-4814-805c-5c3b22f5f4cd tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:14:20.563040 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a51a0157-c5fe-4814-805c-5c3b22f5f4cd tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:14:20.699377 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-a51a0157-c5fe-4814-805c-5c3b22f5f4cd tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e32e56dd84caab93645385e5a1493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e9fa73af9541119afd5edb5d180e58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:14:20.707270 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-a51a0157-c5fe-4814-805c-5c3b22f5f4cd tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] 10.222.0.26 "GET /compute/v2.1/servers/a2d51aac-8a74-49d3-ac3d-77b791fe832d" status: 200 len: 1373 microversion: 2.1 time: 0.159005 Oct 08 22:14:20.707867 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3548/7170] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:14:20 2022] GET /compute/v2.1/servers/a2d51aac-8a74-49d3-ac3d-77b791fe832d => generated 1373 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:14:21.730388 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-20328bf4-284f-4d40-a15f-04bb295dc16a tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:14:21.731062 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-20328bf4-284f-4d40-a15f-04bb295dc16a tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] [instance: a2d51aac-8a74-49d3-ac3d-77b791fe832d] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:14:21.738056 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-20328bf4-284f-4d40-a15f-04bb295dc16a tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:14:21.738573 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-20328bf4-284f-4d40-a15f-04bb295dc16a tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:14:21.739048 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-20328bf4-284f-4d40-a15f-04bb295dc16a tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:14:21.739778 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-20328bf4-284f-4d40-a15f-04bb295dc16a tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:14:21.740269 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-20328bf4-284f-4d40-a15f-04bb295dc16a tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:14:21.740727 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-20328bf4-284f-4d40-a15f-04bb295dc16a tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:14:21.879348 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-20328bf4-284f-4d40-a15f-04bb295dc16a tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e32e56dd84caab93645385e5a1493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e9fa73af9541119afd5edb5d180e58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:14:21.887519 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-20328bf4-284f-4d40-a15f-04bb295dc16a tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] 10.222.0.26 "GET /compute/v2.1/servers/a2d51aac-8a74-49d3-ac3d-77b791fe832d" status: 200 len: 1373 microversion: 2.1 time: 0.161598 Oct 08 22:14:21.888103 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3623/7171] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:14:21 2022] GET /compute/v2.1/servers/a2d51aac-8a74-49d3-ac3d-77b791fe832d => generated 1373 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:14:22.910488 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-d01153c5-6d99-4fa3-af89-9d550e5f3754 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:14:22.911242 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-d01153c5-6d99-4fa3-af89-9d550e5f3754 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] [instance: a2d51aac-8a74-49d3-ac3d-77b791fe832d] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:14:22.918467 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d01153c5-6d99-4fa3-af89-9d550e5f3754 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:14:22.918986 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d01153c5-6d99-4fa3-af89-9d550e5f3754 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:14:22.919426 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d01153c5-6d99-4fa3-af89-9d550e5f3754 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:14:22.920147 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d01153c5-6d99-4fa3-af89-9d550e5f3754 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:14:22.920621 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d01153c5-6d99-4fa3-af89-9d550e5f3754 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:14:22.921382 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d01153c5-6d99-4fa3-af89-9d550e5f3754 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:14:23.058133 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-d01153c5-6d99-4fa3-af89-9d550e5f3754 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e32e56dd84caab93645385e5a1493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e9fa73af9541119afd5edb5d180e58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:14:23.066081 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-d01153c5-6d99-4fa3-af89-9d550e5f3754 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] 10.222.0.26 "GET /compute/v2.1/servers/a2d51aac-8a74-49d3-ac3d-77b791fe832d" status: 200 len: 1373 microversion: 2.1 time: 0.159549 Oct 08 22:14:23.066682 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3549/7172] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:14:22 2022] GET /compute/v2.1/servers/a2d51aac-8a74-49d3-ac3d-77b791fe832d => generated 1373 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:14:24.088776 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-e9fef62f-ba3b-472d-9bf2-2718b53b1d92 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:14:24.089389 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-e9fef62f-ba3b-472d-9bf2-2718b53b1d92 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] [instance: a2d51aac-8a74-49d3-ac3d-77b791fe832d] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:14:24.096489 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e9fef62f-ba3b-472d-9bf2-2718b53b1d92 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:14:24.097008 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e9fef62f-ba3b-472d-9bf2-2718b53b1d92 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:14:24.097505 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e9fef62f-ba3b-472d-9bf2-2718b53b1d92 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:14:24.098243 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e9fef62f-ba3b-472d-9bf2-2718b53b1d92 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:14:24.098731 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e9fef62f-ba3b-472d-9bf2-2718b53b1d92 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:14:24.099192 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-e9fef62f-ba3b-472d-9bf2-2718b53b1d92 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:14:24.229597 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-e9fef62f-ba3b-472d-9bf2-2718b53b1d92 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e32e56dd84caab93645385e5a1493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e9fa73af9541119afd5edb5d180e58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:14:24.237492 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-e9fef62f-ba3b-472d-9bf2-2718b53b1d92 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] 10.222.0.26 "GET /compute/v2.1/servers/a2d51aac-8a74-49d3-ac3d-77b791fe832d" status: 200 len: 1373 microversion: 2.1 time: 0.153333 Oct 08 22:14:24.238069 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3624/7173] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:14:24 2022] GET /compute/v2.1/servers/a2d51aac-8a74-49d3-ac3d-77b791fe832d => generated 1373 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:14:24.519843 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-32710bdf-f487-4320-ad6e-507d2a202d88 req-e300d5d9-f941-4e77-ab47-c7e78f750ad5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2d51aac-8a74-49d3-ac3d-77b791fe832d", "name": "network-vif-plugged", "status": "completed", "tag": "7811a981-7178-413d-9a67-05816a4783a0"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 22:14:24.529727 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-32710bdf-f487-4320-ad6e-507d2a202d88 req-e300d5d9-f941-4e77-ab47-c7e78f750ad5 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:14:24.530224 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-32710bdf-f487-4320-ad6e-507d2a202d88 req-e300d5d9-f941-4e77-ab47-c7e78f750ad5 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:14:24.530674 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-32710bdf-f487-4320-ad6e-507d2a202d88 req-e300d5d9-f941-4e77-ab47-c7e78f750ad5 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:14:24.542664 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-32710bdf-f487-4320-ad6e-507d2a202d88 req-e300d5d9-f941-4e77-ab47-c7e78f750ad5 service nova] Creating event network-vif-plugged:7811a981-7178-413d-9a67-05816a4783a0 for instance a2d51aac-8a74-49d3-ac3d-77b791fe832d on nch1-master-1 Oct 08 22:14:24.547994 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-32710bdf-f487-4320-ad6e-507d2a202d88 req-e300d5d9-f941-4e77-ab47-c7e78f750ad5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102314 Oct 08 22:14:24.548609 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3550/7174] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 22:14:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 22:14:25.261402 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-b306420d-ba61-4a9e-8ad7-84962c7cbaa9 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:14:25.262035 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-b306420d-ba61-4a9e-8ad7-84962c7cbaa9 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] [instance: a2d51aac-8a74-49d3-ac3d-77b791fe832d] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:14:25.268977 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b306420d-ba61-4a9e-8ad7-84962c7cbaa9 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:14:25.269517 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b306420d-ba61-4a9e-8ad7-84962c7cbaa9 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:14:25.269980 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b306420d-ba61-4a9e-8ad7-84962c7cbaa9 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:14:25.270694 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b306420d-ba61-4a9e-8ad7-84962c7cbaa9 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:14:25.271171 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b306420d-ba61-4a9e-8ad7-84962c7cbaa9 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:14:25.271616 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-b306420d-ba61-4a9e-8ad7-84962c7cbaa9 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:14:25.406425 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-b306420d-ba61-4a9e-8ad7-84962c7cbaa9 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e32e56dd84caab93645385e5a1493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e9fa73af9541119afd5edb5d180e58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:14:25.414288 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-b306420d-ba61-4a9e-8ad7-84962c7cbaa9 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] 10.222.0.26 "GET /compute/v2.1/servers/a2d51aac-8a74-49d3-ac3d-77b791fe832d" status: 200 len: 1373 microversion: 2.1 time: 0.157332 Oct 08 22:14:25.414869 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3625/7175] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:14:25 2022] GET /compute/v2.1/servers/a2d51aac-8a74-49d3-ac3d-77b791fe832d => generated 1373 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:14:26.438228 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-9c28d4ab-6284-4ceb-b990-b94fda80ba64 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:14:26.438939 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-9c28d4ab-6284-4ceb-b990-b94fda80ba64 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] [instance: a2d51aac-8a74-49d3-ac3d-77b791fe832d] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:14:26.441764 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=2 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 22:14:26.442506 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=6 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 22:14:26.448783 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9c28d4ab-6284-4ceb-b990-b94fda80ba64 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:14:26.449293 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9c28d4ab-6284-4ceb-b990-b94fda80ba64 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:14:26.449738 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9c28d4ab-6284-4ceb-b990-b94fda80ba64 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:14:26.450436 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9c28d4ab-6284-4ceb-b990-b94fda80ba64 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:14:26.450894 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9c28d4ab-6284-4ceb-b990-b94fda80ba64 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:14:26.451323 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-9c28d4ab-6284-4ceb-b990-b94fda80ba64 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:14:26.584924 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-9c28d4ab-6284-4ceb-b990-b94fda80ba64 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e32e56dd84caab93645385e5a1493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e9fa73af9541119afd5edb5d180e58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:14:26.593556 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-9c28d4ab-6284-4ceb-b990-b94fda80ba64 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] 10.222.0.26 "GET /compute/v2.1/servers/a2d51aac-8a74-49d3-ac3d-77b791fe832d" status: 200 len: 1558 microversion: 2.1 time: 0.159528 Oct 08 22:14:26.594152 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3551/7176] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:14:26 2022] GET /compute/v2.1/servers/a2d51aac-8a74-49d3-ac3d-77b791fe832d => generated 1558 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:14:26.616075 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-4bdfac01-03da-4eb3-9558-687ab0f56423 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:14:26.616636 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-4bdfac01-03da-4eb3-9558-687ab0f56423 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] [instance: a2d51aac-8a74-49d3-ac3d-77b791fe832d] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:14:26.618597 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=6 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 22:14:26.624646 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4bdfac01-03da-4eb3-9558-687ab0f56423 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:14:26.625151 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4bdfac01-03da-4eb3-9558-687ab0f56423 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:14:26.625673 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4bdfac01-03da-4eb3-9558-687ab0f56423 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:14:26.626390 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4bdfac01-03da-4eb3-9558-687ab0f56423 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:14:26.626865 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4bdfac01-03da-4eb3-9558-687ab0f56423 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:14:26.627309 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-4bdfac01-03da-4eb3-9558-687ab0f56423 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:14:26.764581 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-4bdfac01-03da-4eb3-9558-687ab0f56423 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e32e56dd84caab93645385e5a1493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e9fa73af9541119afd5edb5d180e58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:14:26.772557 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-4bdfac01-03da-4eb3-9558-687ab0f56423 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] 10.222.0.26 "GET /compute/v2.1/servers/a2d51aac-8a74-49d3-ac3d-77b791fe832d" status: 200 len: 1558 microversion: 2.1 time: 0.160403 Oct 08 22:14:26.773775 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3626/7177] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:14:26 2022] GET /compute/v2.1/servers/a2d51aac-8a74-49d3-ac3d-77b791fe832d => generated 1558 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:14:28.388670 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-f832a532-9c46-49aa-9451-3646cf9508e4 req-621195db-03de-4fde-86f3-a2938cfbf432 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2d51aac-8a74-49d3-ac3d-77b791fe832d", "tag": "7811a981-7178-413d-9a67-05816a4783a0"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 22:14:28.400054 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-f832a532-9c46-49aa-9451-3646cf9508e4 req-621195db-03de-4fde-86f3-a2938cfbf432 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:14:28.400553 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-f832a532-9c46-49aa-9451-3646cf9508e4 req-621195db-03de-4fde-86f3-a2938cfbf432 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:14:28.401000 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-f832a532-9c46-49aa-9451-3646cf9508e4 req-621195db-03de-4fde-86f3-a2938cfbf432 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:14:28.412507 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-f832a532-9c46-49aa-9451-3646cf9508e4 req-621195db-03de-4fde-86f3-a2938cfbf432 service nova] Creating event network-changed:7811a981-7178-413d-9a67-05816a4783a0 for instance a2d51aac-8a74-49d3-ac3d-77b791fe832d on nch1-master-1 Oct 08 22:14:28.418589 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-f832a532-9c46-49aa-9451-3646cf9508e4 req-621195db-03de-4fde-86f3-a2938cfbf432 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033914 Oct 08 22:14:28.419443 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3552/7178] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 22:14:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 22:16:26.071179 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 22:16:26.071937 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=36 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 22:16:26.072988 ncdv-master-1 devstack@n-api.service[140492]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 08 22:16:26.073128 ncdv-master-1 devstack@n-api.service[140492]: Sat Oct 8 22:16:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a2d51aac-8a74-49d3-ac3d-77b791fe832d/action (ip 10.222.0.26) !!! Oct 08 22:16:26.078198 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-d158bd9c-1451-4fef-8ca6-62f04f4923fe tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1583169574"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 22:16:26.080512 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-d158bd9c-1451-4fef-8ca6-62f04f4923fe tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] [instance: a2d51aac-8a74-49d3-ac3d-77b791fe832d] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:16:26.089484 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d158bd9c-1451-4fef-8ca6-62f04f4923fe tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:16:26.089987 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d158bd9c-1451-4fef-8ca6-62f04f4923fe tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:16:26.090474 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d158bd9c-1451-4fef-8ca6-62f04f4923fe tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:16:26.091187 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d158bd9c-1451-4fef-8ca6-62f04f4923fe tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:16:26.091664 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d158bd9c-1451-4fef-8ca6-62f04f4923fe tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:16:26.092107 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d158bd9c-1451-4fef-8ca6-62f04f4923fe tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:16:26.292858 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-d158bd9c-1451-4fef-8ca6-62f04f4923fe tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] 10.222.0.26 "POST /compute/v2.1/servers/a2d51aac-8a74-49d3-ac3d-77b791fe832d/action" status: 202 len: 0 microversion: 2.1 time: 0.223510 Oct 08 22:16:26.293556 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3627/7179] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 22:16:26 2022] POST /compute/v2.1/servers/a2d51aac-8a74-49d3-ac3d-77b791fe832d/action => generated 0 bytes in 225 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Oct 08 22:16:31.106953 ncdv-master-1 devstack@n-api.service[140491]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5b834fae-ca0a-46cb-bcaa-52f744fce5f9] AMQP server on 10.222.0.26:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 08 22:16:31.108535 ncdv-master-1 devstack@n-api.service[140491]: ERROR oslo.messaging._drivers.impl_rabbit [-] [389347c8-adfb-4c72-885b-6416d41737c1] AMQP server on 10.222.0.26:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 08 22:16:31.109499 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 22:16:31.110271 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=32 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 22:16:31.117866 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-c6387adc-f362-43a5-9501-98a2aea8270f req-178880bb-1ce0-426a-8e29-88674ad5c9ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2d51aac-8a74-49d3-ac3d-77b791fe832d", "name": "network-vif-plugged", "status": "completed", "tag": "7811a981-7178-413d-9a67-05816a4783a0"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 22:16:31.132121 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-c6387adc-f362-43a5-9501-98a2aea8270f req-178880bb-1ce0-426a-8e29-88674ad5c9ab service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:16:31.132616 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-c6387adc-f362-43a5-9501-98a2aea8270f req-178880bb-1ce0-426a-8e29-88674ad5c9ab service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:16:31.133258 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-c6387adc-f362-43a5-9501-98a2aea8270f req-178880bb-1ce0-426a-8e29-88674ad5c9ab service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:16:31.148372 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-c6387adc-f362-43a5-9501-98a2aea8270f req-178880bb-1ce0-426a-8e29-88674ad5c9ab service nova] Creating event network-vif-plugged:7811a981-7178-413d-9a67-05816a4783a0 for instance a2d51aac-8a74-49d3-ac3d-77b791fe832d on nch1-master-1 Oct 08 22:16:31.154688 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-c6387adc-f362-43a5-9501-98a2aea8270f req-178880bb-1ce0-426a-8e29-88674ad5c9ab service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051790 Oct 08 22:16:31.155838 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3553/7180] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 22:16:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 22:16:39.861264 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-561173d0-57ba-443c-946e-62c2fd7b637c tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1370672587", "imageRef": "7d370530-6af1-41e7-b697-cb466625015e", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-574754041", "security_groups": [{"name": "tempest-secgroup-smoke-463714693"}], "networks": [{"uuid": "1f0bd3e2-c8df-474e-9118-03b664c5a32a"}]}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 22:16:39.871073 ncdv-master-1 devstack@n-api.service[140492]: ERROR oslo.messaging._drivers.impl_rabbit [-] [bab1eda8-a2f4-4cbf-a1fb-a5a6d7c2688e] AMQP server on 10.222.0.26:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 08 22:16:39.872800 ncdv-master-1 devstack@n-api.service[140492]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a92ae347-69e9-4ac8-bb66-e8def9f99758] AMQP server on 10.222.0.26:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 08 22:16:39.873291 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=2 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 22:16:39.874116 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 22:16:39.975846 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.network.neutron [None req-561173d0-57ba-443c-946e-62c2fd7b637c tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] validate_networks() for [('1f0bd3e2-c8df-474e-9118-03b664c5a32a', None, None, None, None, None)] {{(pid=140492) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 08 22:16:40.406589 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-561173d0-57ba-443c-946e-62c2fd7b637c tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Flavor limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 08 22:16:40.407040 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-561173d0-57ba-443c-946e-62c2fd7b637c tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Image limits 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 08 22:16:40.407546 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-561173d0-57ba-443c-946e-62c2fd7b637c tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Flavor pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 08 22:16:40.407981 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-561173d0-57ba-443c-946e-62c2fd7b637c tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Image pref 0:0:0 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 08 22:16:40.408418 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.virt.hardware [None req-561173d0-57ba-443c-946e-62c2fd7b637c tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 08 22:16:40.418216 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-561173d0-57ba-443c-946e-62c2fd7b637c tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:16:40.418724 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-561173d0-57ba-443c-946e-62c2fd7b637c tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:16:40.419189 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-561173d0-57ba-443c-946e-62c2fd7b637c tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:16:40.419947 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-561173d0-57ba-443c-946e-62c2fd7b637c tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:16:40.420429 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-561173d0-57ba-443c-946e-62c2fd7b637c tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:16:40.420883 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-561173d0-57ba-443c-946e-62c2fd7b637c tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:16:40.438221 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-561173d0-57ba-443c-946e-62c2fd7b637c tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Getting quotas for project 00e9fa73af9541119afd5edb5d180e58. Resources: {'cores', 'instances', 'ram'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 08 22:16:40.443514 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.quota [None req-561173d0-57ba-443c-946e-62c2fd7b637c tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Getting quotas for user a42e32e56dd84caab93645385e5a1493 and project 00e9fa73af9541119afd5edb5d180e58. Resources: {'cores', 'instances', 'ram'} {{(pid=140492) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 08 22:16:40.456205 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-561173d0-57ba-443c-946e-62c2fd7b637c tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Going to run 1 instances... {{(pid=140492) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 08 22:16:40.458885 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-561173d0-57ba-443c-946e-62c2fd7b637c tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] [instance: 1eaad953-c11e-4bbb-b6c9-e8dc61011f06] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7d370530-6af1-41e7-b697-cb466625015e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140492) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 08 22:16:40.507860 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-561173d0-57ba-443c-946e-62c2fd7b637c tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.650705 Oct 08 22:16:40.508717 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3628/7181] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 8 22:16:39 2022] POST /compute/v2.1/servers => generated 405 bytes in 652 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 08 22:16:40.520998 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-5b2de486-3c7b-47cc-b423-c3f1f396ad06 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:16:40.521740 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-5b2de486-3c7b-47cc-b423-c3f1f396ad06 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] [instance: 1eaad953-c11e-4bbb-b6c9-e8dc61011f06] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:16:40.536417 ncdv-master-1 devstack@n-api.service[140491]: INFO oslo.messaging._drivers.impl_rabbit [-] [5b834fae-ca0a-46cb-bcaa-52f744fce5f9] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 40644. Oct 08 22:16:40.543859 ncdv-master-1 devstack@n-api.service[140491]: INFO oslo.messaging._drivers.impl_rabbit [-] [389347c8-adfb-4c72-885b-6416d41737c1] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 40646. Oct 08 22:16:40.597842 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-5b2de486-3c7b-47cc-b423-c3f1f396ad06 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e32e56dd84caab93645385e5a1493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e9fa73af9541119afd5edb5d180e58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:16:40.605483 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-5b2de486-3c7b-47cc-b423-c3f1f396ad06 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] 10.222.0.26 "GET /compute/v2.1/servers/1eaad953-c11e-4bbb-b6c9-e8dc61011f06" status: 200 len: 1248 microversion: 2.1 time: 0.088974 Oct 08 22:16:40.606055 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3554/7182] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:16:40 2022] GET /compute/v2.1/servers/1eaad953-c11e-4bbb-b6c9-e8dc61011f06 => generated 1248 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:16:41.629771 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-738adadb-b97c-491e-98aa-9bd8d5d0ffcd tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:16:41.630332 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-738adadb-b97c-491e-98aa-9bd8d5d0ffcd tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] [instance: 1eaad953-c11e-4bbb-b6c9-e8dc61011f06] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:16:41.640574 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-738adadb-b97c-491e-98aa-9bd8d5d0ffcd tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:16:41.641083 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-738adadb-b97c-491e-98aa-9bd8d5d0ffcd tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:16:41.641568 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-738adadb-b97c-491e-98aa-9bd8d5d0ffcd tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:16:41.642297 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-738adadb-b97c-491e-98aa-9bd8d5d0ffcd tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:16:41.642773 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-738adadb-b97c-491e-98aa-9bd8d5d0ffcd tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:16:41.643220 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-738adadb-b97c-491e-98aa-9bd8d5d0ffcd tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:16:41.647519 ncdv-master-1 devstack@n-api.service[140492]: INFO oslo.messaging._drivers.impl_rabbit [-] [a92ae347-69e9-4ac8-bb66-e8def9f99758] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 40664. Oct 08 22:16:41.651121 ncdv-master-1 devstack@n-api.service[140492]: INFO oslo.messaging._drivers.impl_rabbit [-] [bab1eda8-a2f4-4cbf-a1fb-a5a6d7c2688e] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 40662. Oct 08 22:16:41.737387 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-738adadb-b97c-491e-98aa-9bd8d5d0ffcd tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e32e56dd84caab93645385e5a1493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e9fa73af9541119afd5edb5d180e58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:16:41.745580 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-738adadb-b97c-491e-98aa-9bd8d5d0ffcd tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] 10.222.0.26 "GET /compute/v2.1/servers/1eaad953-c11e-4bbb-b6c9-e8dc61011f06" status: 200 len: 1308 microversion: 2.1 time: 0.121414 Oct 08 22:16:41.746411 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3629/7183] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:16:41 2022] GET /compute/v2.1/servers/1eaad953-c11e-4bbb-b6c9-e8dc61011f06 => generated 1308 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 22:16:42.769872 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-a2b1eb32-40f6-4e8c-9711-e57c53c8eb15 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:16:42.773280 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-a2b1eb32-40f6-4e8c-9711-e57c53c8eb15 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] [instance: 1eaad953-c11e-4bbb-b6c9-e8dc61011f06] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:16:42.775929 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=2 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 22:16:42.786344 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a2b1eb32-40f6-4e8c-9711-e57c53c8eb15 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:16:42.787717 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a2b1eb32-40f6-4e8c-9711-e57c53c8eb15 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:16:42.788337 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a2b1eb32-40f6-4e8c-9711-e57c53c8eb15 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:16:42.789878 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a2b1eb32-40f6-4e8c-9711-e57c53c8eb15 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:16:42.790497 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a2b1eb32-40f6-4e8c-9711-e57c53c8eb15 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:16:42.791749 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-a2b1eb32-40f6-4e8c-9711-e57c53c8eb15 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:16:42.987762 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-a2b1eb32-40f6-4e8c-9711-e57c53c8eb15 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e32e56dd84caab93645385e5a1493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e9fa73af9541119afd5edb5d180e58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:16:42.998111 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-a2b1eb32-40f6-4e8c-9711-e57c53c8eb15 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] 10.222.0.26 "GET /compute/v2.1/servers/1eaad953-c11e-4bbb-b6c9-e8dc61011f06" status: 200 len: 1373 microversion: 2.1 time: 0.234039 Oct 08 22:16:42.999268 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3555/7184] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:16:42 2022] GET /compute/v2.1/servers/1eaad953-c11e-4bbb-b6c9-e8dc61011f06 => generated 1373 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:16:43.176172 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-880ad666-7c5e-41cf-aea6-61ffcb622fee req-ef3f1b09-7dbc-4cfc-8bc0-8c19c7d37281 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2d51aac-8a74-49d3-ac3d-77b791fe832d", "name": "network-vif-unplugged", "status": "completed", "tag": "7811a981-7178-413d-9a67-05816a4783a0"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 22:16:43.188191 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-880ad666-7c5e-41cf-aea6-61ffcb622fee req-ef3f1b09-7dbc-4cfc-8bc0-8c19c7d37281 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:16:43.188775 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-880ad666-7c5e-41cf-aea6-61ffcb622fee req-ef3f1b09-7dbc-4cfc-8bc0-8c19c7d37281 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:16:43.189344 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-880ad666-7c5e-41cf-aea6-61ffcb622fee req-ef3f1b09-7dbc-4cfc-8bc0-8c19c7d37281 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:16:43.202326 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-880ad666-7c5e-41cf-aea6-61ffcb622fee req-ef3f1b09-7dbc-4cfc-8bc0-8c19c7d37281 service nova] Creating event network-vif-unplugged:7811a981-7178-413d-9a67-05816a4783a0 for instance a2d51aac-8a74-49d3-ac3d-77b791fe832d on nch1-master-1 Oct 08 22:16:43.208088 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-880ad666-7c5e-41cf-aea6-61ffcb622fee req-ef3f1b09-7dbc-4cfc-8bc0-8c19c7d37281 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036496 Oct 08 22:16:43.209224 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3630/7185] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 22:16:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 22:16:44.021932 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-0a458f7c-5e28-476c-ad72-9806f6f9ac8b tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:16:44.022581 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-0a458f7c-5e28-476c-ad72-9806f6f9ac8b tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] [instance: 1eaad953-c11e-4bbb-b6c9-e8dc61011f06] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:16:44.030190 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0a458f7c-5e28-476c-ad72-9806f6f9ac8b tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:16:44.030694 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0a458f7c-5e28-476c-ad72-9806f6f9ac8b tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:16:44.031143 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0a458f7c-5e28-476c-ad72-9806f6f9ac8b tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:16:44.031860 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0a458f7c-5e28-476c-ad72-9806f6f9ac8b tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:16:44.032326 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0a458f7c-5e28-476c-ad72-9806f6f9ac8b tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:16:44.032764 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-0a458f7c-5e28-476c-ad72-9806f6f9ac8b tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:16:44.199223 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-0a458f7c-5e28-476c-ad72-9806f6f9ac8b tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e32e56dd84caab93645385e5a1493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e9fa73af9541119afd5edb5d180e58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:16:44.207091 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-0a458f7c-5e28-476c-ad72-9806f6f9ac8b tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] 10.222.0.26 "GET /compute/v2.1/servers/1eaad953-c11e-4bbb-b6c9-e8dc61011f06" status: 200 len: 1373 microversion: 2.1 time: 0.189286 Oct 08 22:16:44.207686 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3556/7186] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:16:44 2022] GET /compute/v2.1/servers/1eaad953-c11e-4bbb-b6c9-e8dc61011f06 => generated 1373 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:16:45.231667 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-2275ad87-cdfc-4691-9b53-ca6ad9c9431a tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:16:45.232410 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-2275ad87-cdfc-4691-9b53-ca6ad9c9431a tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] [instance: 1eaad953-c11e-4bbb-b6c9-e8dc61011f06] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:16:45.238841 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2275ad87-cdfc-4691-9b53-ca6ad9c9431a tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:16:45.240458 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2275ad87-cdfc-4691-9b53-ca6ad9c9431a tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:16:45.241386 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2275ad87-cdfc-4691-9b53-ca6ad9c9431a tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:16:45.242363 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2275ad87-cdfc-4691-9b53-ca6ad9c9431a tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:16:45.242925 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2275ad87-cdfc-4691-9b53-ca6ad9c9431a tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:16:45.243605 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-2275ad87-cdfc-4691-9b53-ca6ad9c9431a tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:16:45.383914 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-2275ad87-cdfc-4691-9b53-ca6ad9c9431a tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e32e56dd84caab93645385e5a1493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e9fa73af9541119afd5edb5d180e58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:16:45.391664 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-2275ad87-cdfc-4691-9b53-ca6ad9c9431a tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] 10.222.0.26 "GET /compute/v2.1/servers/1eaad953-c11e-4bbb-b6c9-e8dc61011f06" status: 200 len: 1373 microversion: 2.1 time: 0.165742 Oct 08 22:16:45.392223 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3631/7187] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:16:45 2022] GET /compute/v2.1/servers/1eaad953-c11e-4bbb-b6c9-e8dc61011f06 => generated 1373 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:16:46.414890 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-8697e710-c0ad-479a-a665-888700cd71f0 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:16:46.416195 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-8697e710-c0ad-479a-a665-888700cd71f0 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] [instance: 1eaad953-c11e-4bbb-b6c9-e8dc61011f06] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:16:46.423539 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8697e710-c0ad-479a-a665-888700cd71f0 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:16:46.424047 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8697e710-c0ad-479a-a665-888700cd71f0 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:16:46.424499 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8697e710-c0ad-479a-a665-888700cd71f0 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:16:46.425252 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8697e710-c0ad-479a-a665-888700cd71f0 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:16:46.425721 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8697e710-c0ad-479a-a665-888700cd71f0 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:16:46.426159 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8697e710-c0ad-479a-a665-888700cd71f0 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:16:46.563098 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-8697e710-c0ad-479a-a665-888700cd71f0 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e32e56dd84caab93645385e5a1493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e9fa73af9541119afd5edb5d180e58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:16:46.571602 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-8697e710-c0ad-479a-a665-888700cd71f0 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] 10.222.0.26 "GET /compute/v2.1/servers/1eaad953-c11e-4bbb-b6c9-e8dc61011f06" status: 200 len: 1373 microversion: 2.1 time: 0.160929 Oct 08 22:16:46.572182 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3557/7188] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:16:46 2022] GET /compute/v2.1/servers/1eaad953-c11e-4bbb-b6c9-e8dc61011f06 => generated 1373 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:16:47.594327 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-dc0b6e72-533b-4ef3-9f70-94775ba3d057 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:16:47.594963 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-dc0b6e72-533b-4ef3-9f70-94775ba3d057 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] [instance: 1eaad953-c11e-4bbb-b6c9-e8dc61011f06] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:16:47.601943 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dc0b6e72-533b-4ef3-9f70-94775ba3d057 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:16:47.602448 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dc0b6e72-533b-4ef3-9f70-94775ba3d057 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:16:47.602906 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dc0b6e72-533b-4ef3-9f70-94775ba3d057 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:16:47.603617 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dc0b6e72-533b-4ef3-9f70-94775ba3d057 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:16:47.604097 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dc0b6e72-533b-4ef3-9f70-94775ba3d057 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:16:47.604540 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-dc0b6e72-533b-4ef3-9f70-94775ba3d057 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:16:47.747774 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-dc0b6e72-533b-4ef3-9f70-94775ba3d057 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e32e56dd84caab93645385e5a1493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e9fa73af9541119afd5edb5d180e58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:16:47.755528 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-dc0b6e72-533b-4ef3-9f70-94775ba3d057 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] 10.222.0.26 "GET /compute/v2.1/servers/1eaad953-c11e-4bbb-b6c9-e8dc61011f06" status: 200 len: 1373 microversion: 2.1 time: 0.165188 Oct 08 22:16:47.756099 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3632/7189] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:16:47 2022] GET /compute/v2.1/servers/1eaad953-c11e-4bbb-b6c9-e8dc61011f06 => generated 1373 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:16:48.782158 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-1cef4ab7-86bf-49a1-ad21-6f1f444dcf0b tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:16:48.783569 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-1cef4ab7-86bf-49a1-ad21-6f1f444dcf0b tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] [instance: 1eaad953-c11e-4bbb-b6c9-e8dc61011f06] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:16:48.791939 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1cef4ab7-86bf-49a1-ad21-6f1f444dcf0b tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:16:48.792716 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1cef4ab7-86bf-49a1-ad21-6f1f444dcf0b tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:16:48.793364 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1cef4ab7-86bf-49a1-ad21-6f1f444dcf0b tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:16:48.794096 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1cef4ab7-86bf-49a1-ad21-6f1f444dcf0b tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:16:48.794591 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1cef4ab7-86bf-49a1-ad21-6f1f444dcf0b tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:16:48.795007 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-1cef4ab7-86bf-49a1-ad21-6f1f444dcf0b tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:16:48.935696 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-1cef4ab7-86bf-49a1-ad21-6f1f444dcf0b tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e32e56dd84caab93645385e5a1493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e9fa73af9541119afd5edb5d180e58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:16:48.944248 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-1cef4ab7-86bf-49a1-ad21-6f1f444dcf0b tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] 10.222.0.26 "GET /compute/v2.1/servers/1eaad953-c11e-4bbb-b6c9-e8dc61011f06" status: 200 len: 1373 microversion: 2.1 time: 0.167633 Oct 08 22:16:48.945206 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3558/7190] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:16:48 2022] GET /compute/v2.1/servers/1eaad953-c11e-4bbb-b6c9-e8dc61011f06 => generated 1373 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:16:49.968052 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-cae58734-571c-4730-aac7-ef3597c27281 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:16:49.968692 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-cae58734-571c-4730-aac7-ef3597c27281 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] [instance: 1eaad953-c11e-4bbb-b6c9-e8dc61011f06] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:16:49.975640 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cae58734-571c-4730-aac7-ef3597c27281 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:16:49.976154 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cae58734-571c-4730-aac7-ef3597c27281 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:16:49.976614 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cae58734-571c-4730-aac7-ef3597c27281 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:16:49.977486 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cae58734-571c-4730-aac7-ef3597c27281 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:16:49.977972 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cae58734-571c-4730-aac7-ef3597c27281 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:16:49.978423 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cae58734-571c-4730-aac7-ef3597c27281 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:16:50.116703 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-cae58734-571c-4730-aac7-ef3597c27281 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e32e56dd84caab93645385e5a1493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e9fa73af9541119afd5edb5d180e58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:16:50.124982 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-cae58734-571c-4730-aac7-ef3597c27281 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] 10.222.0.26 "GET /compute/v2.1/servers/1eaad953-c11e-4bbb-b6c9-e8dc61011f06" status: 200 len: 1373 microversion: 2.1 time: 0.160915 Oct 08 22:16:50.125588 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3633/7191] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:16:49 2022] GET /compute/v2.1/servers/1eaad953-c11e-4bbb-b6c9-e8dc61011f06 => generated 1373 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:16:51.149810 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-8ff76517-bcd8-44f6-95d9-1211efe57e37 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:16:51.150432 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-8ff76517-bcd8-44f6-95d9-1211efe57e37 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] [instance: 1eaad953-c11e-4bbb-b6c9-e8dc61011f06] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:16:51.153148 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell0:SELECT=2 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 22:16:51.159356 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8ff76517-bcd8-44f6-95d9-1211efe57e37 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:16:51.159872 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8ff76517-bcd8-44f6-95d9-1211efe57e37 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:16:51.160305 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8ff76517-bcd8-44f6-95d9-1211efe57e37 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:16:51.161047 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8ff76517-bcd8-44f6-95d9-1211efe57e37 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:16:51.161546 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8ff76517-bcd8-44f6-95d9-1211efe57e37 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:16:51.161985 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-8ff76517-bcd8-44f6-95d9-1211efe57e37 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:16:51.315514 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-8ff76517-bcd8-44f6-95d9-1211efe57e37 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e32e56dd84caab93645385e5a1493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e9fa73af9541119afd5edb5d180e58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:16:51.323594 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-8ff76517-bcd8-44f6-95d9-1211efe57e37 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] 10.222.0.26 "GET /compute/v2.1/servers/1eaad953-c11e-4bbb-b6c9-e8dc61011f06" status: 200 len: 1373 microversion: 2.1 time: 0.177684 Oct 08 22:16:51.324295 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3559/7192] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:16:51 2022] GET /compute/v2.1/servers/1eaad953-c11e-4bbb-b6c9-e8dc61011f06 => generated 1373 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:16:52.347795 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-5b48fcfa-8419-4980-8854-ffc3f8701882 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:16:52.348423 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-5b48fcfa-8419-4980-8854-ffc3f8701882 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] [instance: 1eaad953-c11e-4bbb-b6c9-e8dc61011f06] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:16:52.350466 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=2 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 22:16:52.351140 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell0:SELECT=6 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 22:16:52.358522 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5b48fcfa-8419-4980-8854-ffc3f8701882 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:16:52.359028 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5b48fcfa-8419-4980-8854-ffc3f8701882 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:16:52.359486 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5b48fcfa-8419-4980-8854-ffc3f8701882 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:16:52.360197 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5b48fcfa-8419-4980-8854-ffc3f8701882 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:16:52.360672 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5b48fcfa-8419-4980-8854-ffc3f8701882 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:16:52.361118 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-5b48fcfa-8419-4980-8854-ffc3f8701882 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:16:52.496381 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-5b48fcfa-8419-4980-8854-ffc3f8701882 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e32e56dd84caab93645385e5a1493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e9fa73af9541119afd5edb5d180e58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:16:52.504248 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-5b48fcfa-8419-4980-8854-ffc3f8701882 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] 10.222.0.26 "GET /compute/v2.1/servers/1eaad953-c11e-4bbb-b6c9-e8dc61011f06" status: 200 len: 1373 microversion: 2.1 time: 0.160443 Oct 08 22:16:52.504822 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3634/7193] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:16:52 2022] GET /compute/v2.1/servers/1eaad953-c11e-4bbb-b6c9-e8dc61011f06 => generated 1373 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:16:53.349194 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-a2d3c47b-938b-4689-872c-b809133afb77 req-8a7c88f3-05f6-4d14-9fb1-931f77789191 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1eaad953-c11e-4bbb-b6c9-e8dc61011f06", "tag": "1bf83d0f-1fe0-4dd8-89ce-4099f4abf12e"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 22:16:53.359631 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-a2d3c47b-938b-4689-872c-b809133afb77 req-8a7c88f3-05f6-4d14-9fb1-931f77789191 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:16:53.360127 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-a2d3c47b-938b-4689-872c-b809133afb77 req-8a7c88f3-05f6-4d14-9fb1-931f77789191 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:16:53.360569 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-a2d3c47b-938b-4689-872c-b809133afb77 req-8a7c88f3-05f6-4d14-9fb1-931f77789191 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:16:53.371570 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-a2d3c47b-938b-4689-872c-b809133afb77 req-8a7c88f3-05f6-4d14-9fb1-931f77789191 service nova] Creating event network-changed:1bf83d0f-1fe0-4dd8-89ce-4099f4abf12e for instance 1eaad953-c11e-4bbb-b6c9-e8dc61011f06 on nch2-master-1 Oct 08 22:16:53.377097 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-a2d3c47b-938b-4689-872c-b809133afb77 req-8a7c88f3-05f6-4d14-9fb1-931f77789191 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125814 Oct 08 22:16:53.377765 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3560/7194] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 22:16:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 22:16:53.527202 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-639d3dde-e87e-4af2-ad06-a9b5c3934ee5 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:16:53.527838 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-639d3dde-e87e-4af2-ad06-a9b5c3934ee5 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] [instance: 1eaad953-c11e-4bbb-b6c9-e8dc61011f06] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:16:53.535753 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-639d3dde-e87e-4af2-ad06-a9b5c3934ee5 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:16:53.536268 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-639d3dde-e87e-4af2-ad06-a9b5c3934ee5 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:16:53.536735 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-639d3dde-e87e-4af2-ad06-a9b5c3934ee5 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:16:53.537484 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-639d3dde-e87e-4af2-ad06-a9b5c3934ee5 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:16:53.537971 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-639d3dde-e87e-4af2-ad06-a9b5c3934ee5 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:16:53.538455 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-639d3dde-e87e-4af2-ad06-a9b5c3934ee5 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:16:53.743972 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-639d3dde-e87e-4af2-ad06-a9b5c3934ee5 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e32e56dd84caab93645385e5a1493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e9fa73af9541119afd5edb5d180e58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:16:53.751987 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-639d3dde-e87e-4af2-ad06-a9b5c3934ee5 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] 10.222.0.26 "GET /compute/v2.1/servers/1eaad953-c11e-4bbb-b6c9-e8dc61011f06" status: 200 len: 1373 microversion: 2.1 time: 0.228640 Oct 08 22:16:53.752590 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3635/7195] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:16:53 2022] GET /compute/v2.1/servers/1eaad953-c11e-4bbb-b6c9-e8dc61011f06 => generated 1373 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:16:54.776746 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-b12072e9-ca8e-4067-a3b8-7b3e1d1c0bed tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:16:54.777527 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-b12072e9-ca8e-4067-a3b8-7b3e1d1c0bed tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] [instance: 1eaad953-c11e-4bbb-b6c9-e8dc61011f06] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:16:54.783998 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b12072e9-ca8e-4067-a3b8-7b3e1d1c0bed tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:16:54.784504 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b12072e9-ca8e-4067-a3b8-7b3e1d1c0bed tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:16:54.784959 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b12072e9-ca8e-4067-a3b8-7b3e1d1c0bed tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:16:54.785708 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b12072e9-ca8e-4067-a3b8-7b3e1d1c0bed tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:16:54.786182 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b12072e9-ca8e-4067-a3b8-7b3e1d1c0bed tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:16:54.786916 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-b12072e9-ca8e-4067-a3b8-7b3e1d1c0bed tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:16:54.924952 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-b12072e9-ca8e-4067-a3b8-7b3e1d1c0bed tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e32e56dd84caab93645385e5a1493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e9fa73af9541119afd5edb5d180e58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:16:54.932861 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-b12072e9-ca8e-4067-a3b8-7b3e1d1c0bed tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] 10.222.0.26 "GET /compute/v2.1/servers/1eaad953-c11e-4bbb-b6c9-e8dc61011f06" status: 200 len: 1373 microversion: 2.1 time: 0.161380 Oct 08 22:16:54.933476 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3561/7196] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:16:54 2022] GET /compute/v2.1/servers/1eaad953-c11e-4bbb-b6c9-e8dc61011f06 => generated 1373 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:16:55.957007 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-134e9b8d-49f0-469f-a392-abb67490ccca tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:16:55.957699 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-134e9b8d-49f0-469f-a392-abb67490ccca tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] [instance: 1eaad953-c11e-4bbb-b6c9-e8dc61011f06] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:16:55.964621 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-134e9b8d-49f0-469f-a392-abb67490ccca tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:16:55.965136 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-134e9b8d-49f0-469f-a392-abb67490ccca tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:16:55.965637 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-134e9b8d-49f0-469f-a392-abb67490ccca tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:16:55.966390 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-134e9b8d-49f0-469f-a392-abb67490ccca tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:16:55.966877 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-134e9b8d-49f0-469f-a392-abb67490ccca tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:16:55.967327 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-134e9b8d-49f0-469f-a392-abb67490ccca tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:16:56.098340 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-134e9b8d-49f0-469f-a392-abb67490ccca tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e32e56dd84caab93645385e5a1493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e9fa73af9541119afd5edb5d180e58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:16:56.106353 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-134e9b8d-49f0-469f-a392-abb67490ccca tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] 10.222.0.26 "GET /compute/v2.1/servers/1eaad953-c11e-4bbb-b6c9-e8dc61011f06" status: 200 len: 1373 microversion: 2.1 time: 0.153313 Oct 08 22:16:56.106940 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3636/7197] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:16:55 2022] GET /compute/v2.1/servers/1eaad953-c11e-4bbb-b6c9-e8dc61011f06 => generated 1373 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:16:57.129032 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-746bd15e-48ec-4c97-b843-21f7b34afc54 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:16:57.129625 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-746bd15e-48ec-4c97-b843-21f7b34afc54 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] [instance: 1eaad953-c11e-4bbb-b6c9-e8dc61011f06] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:16:57.136634 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-746bd15e-48ec-4c97-b843-21f7b34afc54 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:16:57.137130 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-746bd15e-48ec-4c97-b843-21f7b34afc54 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:16:57.137617 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-746bd15e-48ec-4c97-b843-21f7b34afc54 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:16:57.138821 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-746bd15e-48ec-4c97-b843-21f7b34afc54 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:16:57.139287 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-746bd15e-48ec-4c97-b843-21f7b34afc54 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:16:57.139727 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-746bd15e-48ec-4c97-b843-21f7b34afc54 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:16:57.271846 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-746bd15e-48ec-4c97-b843-21f7b34afc54 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e32e56dd84caab93645385e5a1493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e9fa73af9541119afd5edb5d180e58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:16:57.280239 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-746bd15e-48ec-4c97-b843-21f7b34afc54 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] 10.222.0.26 "GET /compute/v2.1/servers/1eaad953-c11e-4bbb-b6c9-e8dc61011f06" status: 200 len: 1373 microversion: 2.1 time: 0.155227 Oct 08 22:16:57.280827 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3562/7198] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:16:57 2022] GET /compute/v2.1/servers/1eaad953-c11e-4bbb-b6c9-e8dc61011f06 => generated 1373 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:16:58.279627 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [req-cffc556d-06b1-42cc-b2b1-2fef507c7fa9 req-8ce4a854-880d-45b2-9432-4135c1017ab7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1eaad953-c11e-4bbb-b6c9-e8dc61011f06", "name": "network-vif-plugged", "status": "completed", "tag": "1bf83d0f-1fe0-4dd8-89ce-4099f4abf12e"}]} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 22:16:58.292818 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-cffc556d-06b1-42cc-b2b1-2fef507c7fa9 req-8ce4a854-880d-45b2-9432-4135c1017ab7 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:16:58.293373 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-cffc556d-06b1-42cc-b2b1-2fef507c7fa9 req-8ce4a854-880d-45b2-9432-4135c1017ab7 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:16:58.293838 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [req-cffc556d-06b1-42cc-b2b1-2fef507c7fa9 req-8ce4a854-880d-45b2-9432-4135c1017ab7 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:16:58.302953 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-2d51335d-98a5-42fd-9785-8233028757bb tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:16:58.303706 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-2d51335d-98a5-42fd-9785-8233028757bb tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] [instance: 1eaad953-c11e-4bbb-b6c9-e8dc61011f06] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:16:58.306379 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.compute.server_external_events [req-cffc556d-06b1-42cc-b2b1-2fef507c7fa9 req-8ce4a854-880d-45b2-9432-4135c1017ab7 service nova] Creating event network-vif-plugged:1bf83d0f-1fe0-4dd8-89ce-4099f4abf12e for instance 1eaad953-c11e-4bbb-b6c9-e8dc61011f06 on nch2-master-1 Oct 08 22:16:58.311703 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2d51335d-98a5-42fd-9785-8233028757bb tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:16:58.312002 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [req-cffc556d-06b1-42cc-b2b1-2fef507c7fa9 req-8ce4a854-880d-45b2-9432-4135c1017ab7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036726 Oct 08 22:16:58.312336 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2d51335d-98a5-42fd-9785-8233028757bb tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:16:58.312939 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3637/7199] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 22:16:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 22:16:58.313063 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2d51335d-98a5-42fd-9785-8233028757bb tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:16:58.313796 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2d51335d-98a5-42fd-9785-8233028757bb tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:16:58.314288 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2d51335d-98a5-42fd-9785-8233028757bb tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:16:58.314670 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-2d51335d-98a5-42fd-9785-8233028757bb tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:16:58.460899 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-2d51335d-98a5-42fd-9785-8233028757bb tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e32e56dd84caab93645385e5a1493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e9fa73af9541119afd5edb5d180e58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:16:58.469364 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-2d51335d-98a5-42fd-9785-8233028757bb tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] 10.222.0.26 "GET /compute/v2.1/servers/1eaad953-c11e-4bbb-b6c9-e8dc61011f06" status: 200 len: 1373 microversion: 2.1 time: 0.170527 Oct 08 22:16:58.469951 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3563/7200] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:16:58 2022] GET /compute/v2.1/servers/1eaad953-c11e-4bbb-b6c9-e8dc61011f06 => generated 1373 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 22:16:59.493078 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-cb3873fe-bed6-46f8-ae8f-db23321a7bd4 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:16:59.493847 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-cb3873fe-bed6-46f8-ae8f-db23321a7bd4 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] [instance: 1eaad953-c11e-4bbb-b6c9-e8dc61011f06] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:16:59.501526 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cb3873fe-bed6-46f8-ae8f-db23321a7bd4 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:16:59.502045 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cb3873fe-bed6-46f8-ae8f-db23321a7bd4 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:16:59.502507 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cb3873fe-bed6-46f8-ae8f-db23321a7bd4 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:16:59.503260 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cb3873fe-bed6-46f8-ae8f-db23321a7bd4 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:16:59.503722 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cb3873fe-bed6-46f8-ae8f-db23321a7bd4 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:16:59.504172 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-cb3873fe-bed6-46f8-ae8f-db23321a7bd4 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:16:59.640435 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-cb3873fe-bed6-46f8-ae8f-db23321a7bd4 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e32e56dd84caab93645385e5a1493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e9fa73af9541119afd5edb5d180e58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:16:59.648333 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-cb3873fe-bed6-46f8-ae8f-db23321a7bd4 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] 10.222.0.26 "GET /compute/v2.1/servers/1eaad953-c11e-4bbb-b6c9-e8dc61011f06" status: 200 len: 1373 microversion: 2.1 time: 0.159574 Oct 08 22:16:59.648922 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3638/7201] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:16:59 2022] GET /compute/v2.1/servers/1eaad953-c11e-4bbb-b6c9-e8dc61011f06 => generated 1373 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:17:00.671922 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-cf68a76f-dfbd-4110-9bf6-7dacf26fbee5 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:17:00.672540 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-cf68a76f-dfbd-4110-9bf6-7dacf26fbee5 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] [instance: 1eaad953-c11e-4bbb-b6c9-e8dc61011f06] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:17:00.679492 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cf68a76f-dfbd-4110-9bf6-7dacf26fbee5 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:17:00.679988 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cf68a76f-dfbd-4110-9bf6-7dacf26fbee5 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:17:00.680434 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cf68a76f-dfbd-4110-9bf6-7dacf26fbee5 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:17:00.681139 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cf68a76f-dfbd-4110-9bf6-7dacf26fbee5 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:17:00.681628 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cf68a76f-dfbd-4110-9bf6-7dacf26fbee5 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:17:00.682065 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cf68a76f-dfbd-4110-9bf6-7dacf26fbee5 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:17:00.812953 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-cf68a76f-dfbd-4110-9bf6-7dacf26fbee5 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e32e56dd84caab93645385e5a1493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e9fa73af9541119afd5edb5d180e58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:17:00.820870 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-cf68a76f-dfbd-4110-9bf6-7dacf26fbee5 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] 10.222.0.26 "GET /compute/v2.1/servers/1eaad953-c11e-4bbb-b6c9-e8dc61011f06" status: 200 len: 1558 microversion: 2.1 time: 0.153350 Oct 08 22:17:00.821486 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3564/7202] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:17:00 2022] GET /compute/v2.1/servers/1eaad953-c11e-4bbb-b6c9-e8dc61011f06 => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:17:00.842732 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-161e63bc-b4a2-491e-af68-1519cd6d7de6 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:17:00.843375 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-161e63bc-b4a2-491e-af68-1519cd6d7de6 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] [instance: 1eaad953-c11e-4bbb-b6c9-e8dc61011f06] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:17:00.850356 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-161e63bc-b4a2-491e-af68-1519cd6d7de6 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:17:00.850876 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-161e63bc-b4a2-491e-af68-1519cd6d7de6 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:17:00.851347 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-161e63bc-b4a2-491e-af68-1519cd6d7de6 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:17:00.852076 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-161e63bc-b4a2-491e-af68-1519cd6d7de6 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:17:00.852591 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-161e63bc-b4a2-491e-af68-1519cd6d7de6 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:17:00.853021 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-161e63bc-b4a2-491e-af68-1519cd6d7de6 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:17:00.991508 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-161e63bc-b4a2-491e-af68-1519cd6d7de6 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e32e56dd84caab93645385e5a1493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e9fa73af9541119afd5edb5d180e58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:17:00.999937 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-161e63bc-b4a2-491e-af68-1519cd6d7de6 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] 10.222.0.26 "GET /compute/v2.1/servers/1eaad953-c11e-4bbb-b6c9-e8dc61011f06" status: 200 len: 1558 microversion: 2.1 time: 0.161152 Oct 08 22:17:01.000524 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3639/7203] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:17:00 2022] GET /compute/v2.1/servers/1eaad953-c11e-4bbb-b6c9-e8dc61011f06 => generated 1558 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:17:02.580695 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-92cc444c-82a7-4b3e-9ce9-1c5fc640f5b9 req-10ec5e85-6ab5-4003-83a2-44bde822e0c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1eaad953-c11e-4bbb-b6c9-e8dc61011f06", "tag": "1bf83d0f-1fe0-4dd8-89ce-4099f4abf12e"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 22:17:02.591864 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-92cc444c-82a7-4b3e-9ce9-1c5fc640f5b9 req-10ec5e85-6ab5-4003-83a2-44bde822e0c6 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:17:02.592427 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-92cc444c-82a7-4b3e-9ce9-1c5fc640f5b9 req-10ec5e85-6ab5-4003-83a2-44bde822e0c6 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:17:02.592934 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-92cc444c-82a7-4b3e-9ce9-1c5fc640f5b9 req-10ec5e85-6ab5-4003-83a2-44bde822e0c6 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:17:02.604418 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-92cc444c-82a7-4b3e-9ce9-1c5fc640f5b9 req-10ec5e85-6ab5-4003-83a2-44bde822e0c6 service nova] Creating event network-changed:1bf83d0f-1fe0-4dd8-89ce-4099f4abf12e for instance 1eaad953-c11e-4bbb-b6c9-e8dc61011f06 on nch2-master-1 Oct 08 22:17:02.610274 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-92cc444c-82a7-4b3e-9ce9-1c5fc640f5b9 req-10ec5e85-6ab5-4003-83a2-44bde822e0c6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033323 Oct 08 22:17:02.610888 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3565/7204] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 22:17:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 22:18:30.266140 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 22:18:30.266927 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=60 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 22:18:30.268129 ncdv-master-1 devstack@n-api.service[140492]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 08 22:18:30.268271 ncdv-master-1 devstack@n-api.service[140492]: Sat Oct 8 22:18:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1eaad953-c11e-4bbb-b6c9-e8dc61011f06/action (ip 10.222.0.26) !!! Oct 08 22:18:30.273012 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-69f3f4ee-020d-4666-a0ae-5e12716b37cc tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-259775093"}} {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 22:18:30.275395 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-69f3f4ee-020d-4666-a0ae-5e12716b37cc tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] [instance: 1eaad953-c11e-4bbb-b6c9-e8dc61011f06] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:18:30.285314 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-69f3f4ee-020d-4666-a0ae-5e12716b37cc tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:18:30.285833 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-69f3f4ee-020d-4666-a0ae-5e12716b37cc tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:18:30.286295 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-69f3f4ee-020d-4666-a0ae-5e12716b37cc tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:18:30.287024 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-69f3f4ee-020d-4666-a0ae-5e12716b37cc tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:18:30.287509 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-69f3f4ee-020d-4666-a0ae-5e12716b37cc tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:18:30.288220 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-69f3f4ee-020d-4666-a0ae-5e12716b37cc tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:18:30.623208 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-69f3f4ee-020d-4666-a0ae-5e12716b37cc tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] 10.222.0.26 "POST /compute/v2.1/servers/1eaad953-c11e-4bbb-b6c9-e8dc61011f06/action" status: 202 len: 0 microversion: 2.1 time: 0.359558 Oct 08 22:18:30.623869 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3640/7205] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 8 22:18:30 2022] POST /compute/v2.1/servers/1eaad953-c11e-4bbb-b6c9-e8dc61011f06/action => generated 0 bytes in 361 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 08 22:18:36.896057 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_api:SELECT=28 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 22:18:36.898062 ncdv-master-1 devstack@n-api.service[140491]: DEBUG dbcounter [-] [140491] Writing DB stats nova_cell1:SELECT=58 {{(pid=140491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 22:18:36.899293 ncdv-master-1 devstack@n-api.service[140491]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 08 22:18:36.899487 ncdv-master-1 devstack@n-api.service[140491]: Sat Oct 8 22:18:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.26) !!! Oct 08 22:18:36.902022 ncdv-master-1 devstack@n-api.service[140491]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 08 22:18:36.902320 ncdv-master-1 devstack@n-api.service[140491]: Sat Oct 8 22:18:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.26) !!! Oct 08 22:18:36.920998 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-98b09368-3716-4e88-8dbf-b2eaee7eecc8 req-4b933d01-9ebc-4ded-a69a-3a9cc19ae1f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1eaad953-c11e-4bbb-b6c9-e8dc61011f06", "name": "network-vif-plugged", "status": "completed", "tag": "1bf83d0f-1fe0-4dd8-89ce-4099f4abf12e"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 22:18:36.953703 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-98b09368-3716-4e88-8dbf-b2eaee7eecc8 req-4b933d01-9ebc-4ded-a69a-3a9cc19ae1f9 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:18:36.954535 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-98b09368-3716-4e88-8dbf-b2eaee7eecc8 req-4b933d01-9ebc-4ded-a69a-3a9cc19ae1f9 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:18:36.954759 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-98b09368-3716-4e88-8dbf-b2eaee7eecc8 req-4b933d01-9ebc-4ded-a69a-3a9cc19ae1f9 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:18:36.967233 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-98b09368-3716-4e88-8dbf-b2eaee7eecc8 req-4b933d01-9ebc-4ded-a69a-3a9cc19ae1f9 service nova] Creating event network-vif-plugged:1bf83d0f-1fe0-4dd8-89ce-4099f4abf12e for instance 1eaad953-c11e-4bbb-b6c9-e8dc61011f06 on nch2-master-1 Oct 08 22:18:36.973250 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-98b09368-3716-4e88-8dbf-b2eaee7eecc8 req-4b933d01-9ebc-4ded-a69a-3a9cc19ae1f9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079537 Oct 08 22:18:36.974145 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3566/7206] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 22:18:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 22:18:44.256430 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-d9c52143-8d29-4347-8b16-c46b9c224bef tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:18:44.257056 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-d9c52143-8d29-4347-8b16-c46b9c224bef tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] [instance: 1eaad953-c11e-4bbb-b6c9-e8dc61011f06] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:18:44.259280 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_api:SELECT=2 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 22:18:44.260168 ncdv-master-1 devstack@n-api.service[140492]: DEBUG dbcounter [-] [140492] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 22:18:44.268210 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d9c52143-8d29-4347-8b16-c46b9c224bef tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:18:44.269007 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d9c52143-8d29-4347-8b16-c46b9c224bef tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:18:44.269504 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d9c52143-8d29-4347-8b16-c46b9c224bef tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:18:44.270464 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d9c52143-8d29-4347-8b16-c46b9c224bef tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:18:44.270959 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d9c52143-8d29-4347-8b16-c46b9c224bef tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:18:44.271415 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d9c52143-8d29-4347-8b16-c46b9c224bef tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:18:44.301020 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-d9c52143-8d29-4347-8b16-c46b9c224bef tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] [instance: 1eaad953-c11e-4bbb-b6c9-e8dc61011f06] Going to try to terminate instance {{(pid=140492) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 22:18:44.323649 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-4631c44e-311f-4622-8029-d9cecfee7950 req-e82a54a4-80f8-4ed7-9d14-3c51bdaca3d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1eaad953-c11e-4bbb-b6c9-e8dc61011f06", "tag": "1bf83d0f-1fe0-4dd8-89ce-4099f4abf12e"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 22:18:44.335339 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-4631c44e-311f-4622-8029-d9cecfee7950 req-e82a54a4-80f8-4ed7-9d14-3c51bdaca3d7 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:18:44.335828 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-4631c44e-311f-4622-8029-d9cecfee7950 req-e82a54a4-80f8-4ed7-9d14-3c51bdaca3d7 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:18:44.336295 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-4631c44e-311f-4622-8029-d9cecfee7950 req-e82a54a4-80f8-4ed7-9d14-3c51bdaca3d7 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:18:44.350072 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-4631c44e-311f-4622-8029-d9cecfee7950 req-e82a54a4-80f8-4ed7-9d14-3c51bdaca3d7 service nova] Creating event network-changed:1bf83d0f-1fe0-4dd8-89ce-4099f4abf12e for instance 1eaad953-c11e-4bbb-b6c9-e8dc61011f06 on nch2-master-1 Oct 08 22:18:44.356377 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-4631c44e-311f-4622-8029-d9cecfee7950 req-e82a54a4-80f8-4ed7-9d14-3c51bdaca3d7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102305 Oct 08 22:18:44.357075 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3567/7207] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 22:18:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 08 22:18:44.392386 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-d9c52143-8d29-4347-8b16-c46b9c224bef tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] 10.222.0.26 "DELETE /compute/v2.1/servers/1eaad953-c11e-4bbb-b6c9-e8dc61011f06" status: 204 len: 0 microversion: 2.1 time: 0.140691 Oct 08 22:18:44.393014 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3641/7208] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 22:18:44 2022] DELETE /compute/v2.1/servers/1eaad953-c11e-4bbb-b6c9-e8dc61011f06 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 22:18:44.402013 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-66ac624c-5f26-4c3f-b367-35fe3467904a tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:18:44.402731 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-66ac624c-5f26-4c3f-b367-35fe3467904a tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] [instance: 1eaad953-c11e-4bbb-b6c9-e8dc61011f06] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:18:44.411279 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-66ac624c-5f26-4c3f-b367-35fe3467904a tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:18:44.411786 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-66ac624c-5f26-4c3f-b367-35fe3467904a tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:18:44.412422 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-66ac624c-5f26-4c3f-b367-35fe3467904a tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:18:44.413445 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-66ac624c-5f26-4c3f-b367-35fe3467904a tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:18:44.414694 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-66ac624c-5f26-4c3f-b367-35fe3467904a tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:18:44.415221 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-66ac624c-5f26-4c3f-b367-35fe3467904a tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:18:44.609382 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-66ac624c-5f26-4c3f-b367-35fe3467904a tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e32e56dd84caab93645385e5a1493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e9fa73af9541119afd5edb5d180e58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:18:44.617488 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-66ac624c-5f26-4c3f-b367-35fe3467904a tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] 10.222.0.26 "GET /compute/v2.1/servers/1eaad953-c11e-4bbb-b6c9-e8dc61011f06" status: 200 len: 1683 microversion: 2.1 time: 0.219845 Oct 08 22:18:44.618010 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3568/7209] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:18:44 2022] GET /compute/v2.1/servers/1eaad953-c11e-4bbb-b6c9-e8dc61011f06 => generated 1683 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:18:45.643282 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-63aee0e2-7de2-42f5-87aa-628461d7c9b7 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:18:45.644551 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-63aee0e2-7de2-42f5-87aa-628461d7c9b7 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] [instance: 1eaad953-c11e-4bbb-b6c9-e8dc61011f06] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:18:45.651235 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-63aee0e2-7de2-42f5-87aa-628461d7c9b7 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:18:45.651748 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-63aee0e2-7de2-42f5-87aa-628461d7c9b7 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:18:45.652195 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-63aee0e2-7de2-42f5-87aa-628461d7c9b7 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:18:45.652917 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-63aee0e2-7de2-42f5-87aa-628461d7c9b7 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:18:45.653420 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-63aee0e2-7de2-42f5-87aa-628461d7c9b7 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:18:45.653864 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-63aee0e2-7de2-42f5-87aa-628461d7c9b7 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:18:45.796297 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-63aee0e2-7de2-42f5-87aa-628461d7c9b7 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e32e56dd84caab93645385e5a1493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e9fa73af9541119afd5edb5d180e58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:18:45.804196 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-63aee0e2-7de2-42f5-87aa-628461d7c9b7 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] 10.222.0.26 "GET /compute/v2.1/servers/1eaad953-c11e-4bbb-b6c9-e8dc61011f06" status: 200 len: 1683 microversion: 2.1 time: 0.165862 Oct 08 22:18:45.804787 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3642/7210] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:18:45 2022] GET /compute/v2.1/servers/1eaad953-c11e-4bbb-b6c9-e8dc61011f06 => generated 1683 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:18:46.462028 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-7790ace6-a6d7-47c2-8455-f02199f47aac req-dbec33c3-b9ae-4164-a4c1-fc4cf88ce9db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1eaad953-c11e-4bbb-b6c9-e8dc61011f06", "name": "network-vif-deleted", "tag": "1bf83d0f-1fe0-4dd8-89ce-4099f4abf12e"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 22:18:46.472809 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-7790ace6-a6d7-47c2-8455-f02199f47aac req-dbec33c3-b9ae-4164-a4c1-fc4cf88ce9db service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:18:46.473260 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-7790ace6-a6d7-47c2-8455-f02199f47aac req-dbec33c3-b9ae-4164-a4c1-fc4cf88ce9db service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:18:46.473708 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-7790ace6-a6d7-47c2-8455-f02199f47aac req-dbec33c3-b9ae-4164-a4c1-fc4cf88ce9db service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:18:46.485512 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-7790ace6-a6d7-47c2-8455-f02199f47aac req-dbec33c3-b9ae-4164-a4c1-fc4cf88ce9db service nova] Creating event network-vif-deleted:1bf83d0f-1fe0-4dd8-89ce-4099f4abf12e for instance 1eaad953-c11e-4bbb-b6c9-e8dc61011f06 on nch2-master-1 Oct 08 22:18:46.490621 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-7790ace6-a6d7-47c2-8455-f02199f47aac req-dbec33c3-b9ae-4164-a4c1-fc4cf88ce9db service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032353 Oct 08 22:18:46.491222 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3569/7211] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 22:18:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 22:18:46.827754 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-da26eaaa-0c9a-4165-8da4-79f80580eb22 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:18:46.829048 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-da26eaaa-0c9a-4165-8da4-79f80580eb22 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] [instance: 1eaad953-c11e-4bbb-b6c9-e8dc61011f06] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:18:46.836468 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-da26eaaa-0c9a-4165-8da4-79f80580eb22 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:18:46.836992 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-da26eaaa-0c9a-4165-8da4-79f80580eb22 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:18:46.837488 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-da26eaaa-0c9a-4165-8da4-79f80580eb22 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:18:46.838230 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-da26eaaa-0c9a-4165-8da4-79f80580eb22 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:18:46.838724 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-da26eaaa-0c9a-4165-8da4-79f80580eb22 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:18:46.839181 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-da26eaaa-0c9a-4165-8da4-79f80580eb22 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:18:46.877438 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-da26eaaa-0c9a-4165-8da4-79f80580eb22 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:18:46.877981 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-da26eaaa-0c9a-4165-8da4-79f80580eb22 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:18:46.878447 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-da26eaaa-0c9a-4165-8da4-79f80580eb22 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:18:46.878920 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.objects.instance [None req-da26eaaa-0c9a-4165-8da4-79f80580eb22 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lazy-loading 'fault' on Instance uuid 1eaad953-c11e-4bbb-b6c9-e8dc61011f06 {{(pid=140492) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 22:18:46.919867 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-da26eaaa-0c9a-4165-8da4-79f80580eb22 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e32e56dd84caab93645385e5a1493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e9fa73af9541119afd5edb5d180e58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:18:46.927816 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-da26eaaa-0c9a-4165-8da4-79f80580eb22 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] 10.222.0.26 "GET /compute/v2.1/servers/1eaad953-c11e-4bbb-b6c9-e8dc61011f06" status: 200 len: 1502 microversion: 2.1 time: 0.104650 Oct 08 22:18:46.928494 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3643/7212] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:18:46 2022] GET /compute/v2.1/servers/1eaad953-c11e-4bbb-b6c9-e8dc61011f06 => generated 1502 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:18:47.953079 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-cd4a7953-2e18-49ba-8c48-a10a578fa7bf tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:18:47.953835 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-cd4a7953-2e18-49ba-8c48-a10a578fa7bf tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] [instance: 1eaad953-c11e-4bbb-b6c9-e8dc61011f06] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:18:47.961105 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cd4a7953-2e18-49ba-8c48-a10a578fa7bf tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:18:47.961707 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cd4a7953-2e18-49ba-8c48-a10a578fa7bf tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:18:47.962157 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cd4a7953-2e18-49ba-8c48-a10a578fa7bf tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:18:47.962867 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cd4a7953-2e18-49ba-8c48-a10a578fa7bf tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:18:47.963335 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cd4a7953-2e18-49ba-8c48-a10a578fa7bf tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:18:47.963772 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-cd4a7953-2e18-49ba-8c48-a10a578fa7bf tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:18:47.977912 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-cd4a7953-2e18-49ba-8c48-a10a578fa7bf tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] HTTP exception thrown: Instance 1eaad953-c11e-4bbb-b6c9-e8dc61011f06 could not be found. Oct 08 22:18:47.979564 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-cd4a7953-2e18-49ba-8c48-a10a578fa7bf tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Request method failure captured: Oct 08 22:18:47.979564 ncdv-master-1 devstack@n-api.service[140491]: request: GET /compute/v2.1/servers/1eaad953-c11e-4bbb-b6c9-e8dc61011f06 HTTP/1.1 Oct 08 22:18:47.979564 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 22:18:47.979564 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 22:18:47.979564 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 22:18:47.979564 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 22:18:47.979564 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 22:18:47.979564 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 22:18:47.979564 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 22:18:47.979564 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 22:18:47.979564 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQfYwYayZ61RNBCfTU2r99bz0gepkPaNF35F1AUzEvlvIkZi4LnwdXgiq2Ljz2u2X0yXkoaknxjksdyAvOlWlFnL9815j8qvQKdnyqIrzUUWJftsEoTNwqJui7ALapWdXLOnNcWbRuWAPI2ZJW7qHPYraWB0pZ0rupwhihKT4kiI2vhQ Oct 08 22:18:47.979564 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 22:18:47.979564 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 22:18:47.979564 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 22:18:47.979564 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 22:18:47.979564 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 22:18:47.979564 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 22:18:47.979564 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 00e9fa73af9541119afd5edb5d180e58 Oct 08 22:18:47.979564 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-TestSnapshotPattern-1378146846 Oct 08 22:18:47.979564 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 22:18:47.979564 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 22:18:47.979564 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/00e9fa73af9541119afd5edb5d180e58"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/00e9fa73af9541119afd5edb5d180e58"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_00e9fa73af9541119afd5edb5d180e58"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/00e9fa73af9541119afd5edb5d180e58"}]}] Oct 08 22:18:47.979564 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-TestSnapshotPattern-1378146846 Oct 08 22:18:47.979564 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 00e9fa73af9541119afd5edb5d180e58 Oct 08 22:18:47.979564 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-TestSnapshotPattern-1378146846 Oct 08 22:18:47.979564 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-TestSnapshotPattern-1378146846-project Oct 08 22:18:47.979564 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 22:18:47.979564 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 22:18:47.979564 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: a42e32e56dd84caab93645385e5a1493 Oct 08 22:18:47.979564 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-TestSnapshotPattern-1378146846-project Oct 08 22:18:47.979564 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 22:18:47.979564 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance 1eaad953-c11e-4bbb-b6c9-e8dc61011f06 could not be found. Oct 08 22:18:47.979564 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': '1eaad953-c11e-4bbb-b6c9-e8dc61011f06'} Oct 08 22:18:47.979564 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 22:18:47.979564 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 22:18:47.979564 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 22:18:47.979564 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 22:18:47.979564 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 22:18:47.979564 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 22:18:47.979564 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 22:18:47.979564 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 22:18:47.979564 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 22:18:47.979564 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 22:18:47.979564 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1eaad953-c11e-4bbb-b6c9-e8dc61011f06 could not be found. Oct 08 22:18:47.979564 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 22:18:47.979564 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 22:18:47.979564 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 22:18:47.979564 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 22:18:47.979564 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 22:18:47.979564 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 22:18:47.979564 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 22:18:47.979564 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 22:18:47.979564 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 22:18:47.979564 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 22:18:47.979564 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 22:18:47.979564 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 22:18:47.979564 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 22:18:47.979564 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 22:18:47.979564 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 22:18:47.979564 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 22:18:47.979564 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1eaad953-c11e-4bbb-b6c9-e8dc61011f06 could not be found. Oct 08 22:18:47.979564 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 22:18:47.979564 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 22:18:47.979564 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 22:18:47.983654 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 22:18:47.983654 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 22:18:47.983654 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 22:18:47.983654 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 22:18:47.983654 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 22:18:47.983654 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1eaad953-c11e-4bbb-b6c9-e8dc61011f06 could not be found. Oct 08 22:18:47.983654 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 22:18:47.983654 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-cd4a7953-2e18-49ba-8c48-a10a578fa7bf tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Returning 404 to user: Instance 1eaad953-c11e-4bbb-b6c9-e8dc61011f06 could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 22:18:47.983654 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-cd4a7953-2e18-49ba-8c48-a10a578fa7bf tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] 10.222.0.26 "GET /compute/v2.1/servers/1eaad953-c11e-4bbb-b6c9-e8dc61011f06" status: 404 len: 111 microversion: 2.1 time: 0.032838 Oct 08 22:18:47.983654 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3570/7213] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:18:47 2022] GET /compute/v2.1/servers/1eaad953-c11e-4bbb-b6c9-e8dc61011f06 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 22:18:49.292110 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-f59d2af3-513b-4928-a058-d404c4df611e tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:18:49.293255 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-f59d2af3-513b-4928-a058-d404c4df611e tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] [instance: a2d51aac-8a74-49d3-ac3d-77b791fe832d] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:18:49.294534 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-d88dc3be-2cd6-4e38-8e3b-5c103166bc37 req-ec027ea9-f7fa-4a8a-a2fb-488ec7585f55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2d51aac-8a74-49d3-ac3d-77b791fe832d", "tag": "7811a981-7178-413d-9a67-05816a4783a0"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 22:18:49.301014 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f59d2af3-513b-4928-a058-d404c4df611e tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:18:49.301758 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f59d2af3-513b-4928-a058-d404c4df611e tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:18:49.302214 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f59d2af3-513b-4928-a058-d404c4df611e tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:18:49.303167 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f59d2af3-513b-4928-a058-d404c4df611e tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:18:49.303796 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f59d2af3-513b-4928-a058-d404c4df611e tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:18:49.304580 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-f59d2af3-513b-4928-a058-d404c4df611e tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:18:49.310766 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-d88dc3be-2cd6-4e38-8e3b-5c103166bc37 req-ec027ea9-f7fa-4a8a-a2fb-488ec7585f55 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:18:49.311344 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-d88dc3be-2cd6-4e38-8e3b-5c103166bc37 req-ec027ea9-f7fa-4a8a-a2fb-488ec7585f55 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:18:49.311790 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-d88dc3be-2cd6-4e38-8e3b-5c103166bc37 req-ec027ea9-f7fa-4a8a-a2fb-488ec7585f55 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:18:49.324283 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-d88dc3be-2cd6-4e38-8e3b-5c103166bc37 req-ec027ea9-f7fa-4a8a-a2fb-488ec7585f55 service nova] Creating event network-changed:7811a981-7178-413d-9a67-05816a4783a0 for instance a2d51aac-8a74-49d3-ac3d-77b791fe832d on nch1-master-1 Oct 08 22:18:49.329974 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-d88dc3be-2cd6-4e38-8e3b-5c103166bc37 req-ec027ea9-f7fa-4a8a-a2fb-488ec7585f55 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039343 Oct 08 22:18:49.330599 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3571/7214] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 22:18:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 08 22:18:49.333576 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-f59d2af3-513b-4928-a058-d404c4df611e tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] [instance: a2d51aac-8a74-49d3-ac3d-77b791fe832d] Going to try to terminate instance {{(pid=140492) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 08 22:18:49.425065 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-f59d2af3-513b-4928-a058-d404c4df611e tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] 10.222.0.26 "DELETE /compute/v2.1/servers/a2d51aac-8a74-49d3-ac3d-77b791fe832d" status: 204 len: 0 microversion: 2.1 time: 0.136983 Oct 08 22:18:49.426279 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3644/7215] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 8 22:18:49 2022] DELETE /compute/v2.1/servers/a2d51aac-8a74-49d3-ac3d-77b791fe832d => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 08 22:18:49.437073 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-5b49b585-8df3-4a25-93b5-b2645e0c5908 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:18:49.437902 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-5b49b585-8df3-4a25-93b5-b2645e0c5908 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] [instance: a2d51aac-8a74-49d3-ac3d-77b791fe832d] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:18:49.444426 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5b49b585-8df3-4a25-93b5-b2645e0c5908 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:18:49.444931 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5b49b585-8df3-4a25-93b5-b2645e0c5908 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:18:49.445406 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5b49b585-8df3-4a25-93b5-b2645e0c5908 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:18:49.446418 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5b49b585-8df3-4a25-93b5-b2645e0c5908 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:18:49.446889 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5b49b585-8df3-4a25-93b5-b2645e0c5908 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:18:49.447314 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-5b49b585-8df3-4a25-93b5-b2645e0c5908 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:18:49.605724 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.policy [None req-5b49b585-8df3-4a25-93b5-b2645e0c5908 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e32e56dd84caab93645385e5a1493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e9fa73af9541119afd5edb5d180e58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140491) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:18:49.613873 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-5b49b585-8df3-4a25-93b5-b2645e0c5908 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] 10.222.0.26 "GET /compute/v2.1/servers/a2d51aac-8a74-49d3-ac3d-77b791fe832d" status: 200 len: 1682 microversion: 2.1 time: 0.181950 Oct 08 22:18:49.614465 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3572/7216] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:18:49 2022] GET /compute/v2.1/servers/a2d51aac-8a74-49d3-ac3d-77b791fe832d => generated 1682 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 08 22:18:50.637787 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-3724345f-50ba-4bba-806c-54cc4c23ec9f tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:18:50.638439 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-3724345f-50ba-4bba-806c-54cc4c23ec9f tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] [instance: a2d51aac-8a74-49d3-ac3d-77b791fe832d] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:18:50.645299 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3724345f-50ba-4bba-806c-54cc4c23ec9f tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:18:50.645809 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3724345f-50ba-4bba-806c-54cc4c23ec9f tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:18:50.646267 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3724345f-50ba-4bba-806c-54cc4c23ec9f tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:18:50.647011 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3724345f-50ba-4bba-806c-54cc4c23ec9f tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:18:50.647487 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3724345f-50ba-4bba-806c-54cc4c23ec9f tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:18:50.648200 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-3724345f-50ba-4bba-806c-54cc4c23ec9f tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:18:50.781047 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-3724345f-50ba-4bba-806c-54cc4c23ec9f tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e32e56dd84caab93645385e5a1493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e9fa73af9541119afd5edb5d180e58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:18:50.789129 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-3724345f-50ba-4bba-806c-54cc4c23ec9f tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] 10.222.0.26 "GET /compute/v2.1/servers/a2d51aac-8a74-49d3-ac3d-77b791fe832d" status: 200 len: 1682 microversion: 2.1 time: 0.155782 Oct 08 22:18:50.789734 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3645/7217] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:18:50 2022] GET /compute/v2.1/servers/a2d51aac-8a74-49d3-ac3d-77b791fe832d => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:18:51.636375 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [req-f122c166-f5ac-466b-ae34-5e229e09780e req-e4745ee7-b003-45fc-beab-a543cb3b8381 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2d51aac-8a74-49d3-ac3d-77b791fe832d", "name": "network-vif-deleted", "tag": "7811a981-7178-413d-9a67-05816a4783a0"}]} {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 08 22:18:51.647677 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-f122c166-f5ac-466b-ae34-5e229e09780e req-e4745ee7-b003-45fc-beab-a543cb3b8381 service nova] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:18:51.648165 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-f122c166-f5ac-466b-ae34-5e229e09780e req-e4745ee7-b003-45fc-beab-a543cb3b8381 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:18:51.648603 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [req-f122c166-f5ac-466b-ae34-5e229e09780e req-e4745ee7-b003-45fc-beab-a543cb3b8381 service nova] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:18:51.660404 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.compute.server_external_events [req-f122c166-f5ac-466b-ae34-5e229e09780e req-e4745ee7-b003-45fc-beab-a543cb3b8381 service nova] Creating event network-vif-deleted:7811a981-7178-413d-9a67-05816a4783a0 for instance a2d51aac-8a74-49d3-ac3d-77b791fe832d on nch1-master-1 Oct 08 22:18:51.665488 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [req-f122c166-f5ac-466b-ae34-5e229e09780e req-e4745ee7-b003-45fc-beab-a543cb3b8381 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032969 Oct 08 22:18:51.666088 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3573/7218] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 8 22:18:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 08 22:18:51.812581 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-d8051415-314d-4242-84a8-113e12bae2e2 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Calling method '>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:18:51.813228 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.compute.api [None req-d8051415-314d-4242-84a8-113e12bae2e2 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] [instance: a2d51aac-8a74-49d3-ac3d-77b791fe832d] Fetching instance by UUID {{(pid=140492) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:18:51.820232 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d8051415-314d-4242-84a8-113e12bae2e2 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:18:51.820757 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d8051415-314d-4242-84a8-113e12bae2e2 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:18:51.821178 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d8051415-314d-4242-84a8-113e12bae2e2 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:18:51.822541 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d8051415-314d-4242-84a8-113e12bae2e2 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:18:51.823021 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d8051415-314d-4242-84a8-113e12bae2e2 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:18:51.823473 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d8051415-314d-4242-84a8-113e12bae2e2 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:18:51.856343 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d8051415-314d-4242-84a8-113e12bae2e2 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:18:51.856854 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d8051415-314d-4242-84a8-113e12bae2e2 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:18:51.857347 ncdv-master-1 devstack@n-api.service[140492]: DEBUG oslo_concurrency.lockutils [None req-d8051415-314d-4242-84a8-113e12bae2e2 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:18:51.858368 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.objects.instance [None req-d8051415-314d-4242-84a8-113e12bae2e2 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lazy-loading 'fault' on Instance uuid a2d51aac-8a74-49d3-ac3d-77b791fe832d {{(pid=140492) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 08 22:18:51.907838 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.policy [None req-d8051415-314d-4242-84a8-113e12bae2e2 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e32e56dd84caab93645385e5a1493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e9fa73af9541119afd5edb5d180e58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140492) authorize /opt/stack/nova/nova/policy.py:199}} Oct 08 22:18:51.916406 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-d8051415-314d-4242-84a8-113e12bae2e2 tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] 10.222.0.26 "GET /compute/v2.1/servers/a2d51aac-8a74-49d3-ac3d-77b791fe832d" status: 200 len: 1338 microversion: 2.1 time: 0.108294 Oct 08 22:18:51.917157 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3646/7219] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:18:51 2022] GET /compute/v2.1/servers/a2d51aac-8a74-49d3-ac3d-77b791fe832d => generated 1338 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 08 22:18:52.941391 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-d1e9fd46-b587-4442-921a-13ae5064c6fe tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Calling method '>' {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:18:52.942096 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.compute.api [None req-d1e9fd46-b587-4442-921a-13ae5064c6fe tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] [instance: a2d51aac-8a74-49d3-ac3d-77b791fe832d] Fetching instance by UUID {{(pid=140491) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 08 22:18:52.948371 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d1e9fd46-b587-4442-921a-13ae5064c6fe tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:18:52.948863 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d1e9fd46-b587-4442-921a-13ae5064c6fe tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:18:52.949340 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d1e9fd46-b587-4442-921a-13ae5064c6fe tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:18:52.950047 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d1e9fd46-b587-4442-921a-13ae5064c6fe tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Acquiring lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 08 22:18:52.950509 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d1e9fd46-b587-4442-921a-13ae5064c6fe tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 08 22:18:52.950940 ncdv-master-1 devstack@n-api.service[140491]: DEBUG oslo_concurrency.lockutils [None req-d1e9fd46-b587-4442-921a-13ae5064c6fe tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Lock "1a13ecad-3f87-496d-a2c5-ac44667fd176" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140491) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 08 22:18:52.964319 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.wsgi [None req-d1e9fd46-b587-4442-921a-13ae5064c6fe tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] HTTP exception thrown: Instance a2d51aac-8a74-49d3-ac3d-77b791fe832d could not be found. Oct 08 22:18:52.965979 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-d1e9fd46-b587-4442-921a-13ae5064c6fe tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Request method failure captured: Oct 08 22:18:52.965979 ncdv-master-1 devstack@n-api.service[140491]: request: GET /compute/v2.1/servers/a2d51aac-8a74-49d3-ac3d-77b791fe832d HTTP/1.1 Oct 08 22:18:52.965979 ncdv-master-1 devstack@n-api.service[140491]: Accept: application/json Oct 08 22:18:52.965979 ncdv-master-1 devstack@n-api.service[140491]: Accept-Encoding: identity Oct 08 22:18:52.965979 ncdv-master-1 devstack@n-api.service[140491]: Connection: close Oct 08 22:18:52.965979 ncdv-master-1 devstack@n-api.service[140491]: Content-Length: 0 Oct 08 22:18:52.965979 ncdv-master-1 devstack@n-api.service[140491]: Content-Type: application/json Oct 08 22:18:52.965979 ncdv-master-1 devstack@n-api.service[140491]: Host: 10.222.0.26 Oct 08 22:18:52.965979 ncdv-master-1 devstack@n-api.service[140491]: Openstack-System-Scope: None Oct 08 22:18:52.965979 ncdv-master-1 devstack@n-api.service[140491]: User-Agent: python-urllib3/1.26.12 Oct 08 22:18:52.965979 ncdv-master-1 devstack@n-api.service[140491]: X-Auth-Token: gAAAAABjQfYwYayZ61RNBCfTU2r99bz0gepkPaNF35F1AUzEvlvIkZi4LnwdXgiq2Ljz2u2X0yXkoaknxjksdyAvOlWlFnL9815j8qvQKdnyqIrzUUWJftsEoTNwqJui7ALapWdXLOnNcWbRuWAPI2ZJW7qHPYraWB0pZ0rupwhihKT4kiI2vhQ Oct 08 22:18:52.965979 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Id: None Oct 08 22:18:52.965979 ncdv-master-1 devstack@n-api.service[140491]: X-Domain-Name: None Oct 08 22:18:52.965979 ncdv-master-1 devstack@n-api.service[140491]: X-Identity-Status: Confirmed Oct 08 22:18:52.965979 ncdv-master-1 devstack@n-api.service[140491]: X-Is-Admin-Project: True Oct 08 22:18:52.965979 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Id: default Oct 08 22:18:52.965979 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Domain-Name: Default Oct 08 22:18:52.965979 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Id: 00e9fa73af9541119afd5edb5d180e58 Oct 08 22:18:52.965979 ncdv-master-1 devstack@n-api.service[140491]: X-Project-Name: tempest-TestSnapshotPattern-1378146846 Oct 08 22:18:52.965979 ncdv-master-1 devstack@n-api.service[140491]: X-Role: reader,member Oct 08 22:18:52.965979 ncdv-master-1 devstack@n-api.service[140491]: X-Roles: reader,member Oct 08 22:18:52.965979 ncdv-master-1 devstack@n-api.service[140491]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/00e9fa73af9541119afd5edb5d180e58"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/00e9fa73af9541119afd5edb5d180e58"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_00e9fa73af9541119afd5edb5d180e58"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/00e9fa73af9541119afd5edb5d180e58"}]}] Oct 08 22:18:52.965979 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant: tempest-TestSnapshotPattern-1378146846 Oct 08 22:18:52.965979 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Id: 00e9fa73af9541119afd5edb5d180e58 Oct 08 22:18:52.965979 ncdv-master-1 devstack@n-api.service[140491]: X-Tenant-Name: tempest-TestSnapshotPattern-1378146846 Oct 08 22:18:52.965979 ncdv-master-1 devstack@n-api.service[140491]: X-User: tempest-TestSnapshotPattern-1378146846-project Oct 08 22:18:52.965979 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Id: default Oct 08 22:18:52.965979 ncdv-master-1 devstack@n-api.service[140491]: X-User-Domain-Name: Default Oct 08 22:18:52.965979 ncdv-master-1 devstack@n-api.service[140491]: X-User-Id: a42e32e56dd84caab93645385e5a1493 Oct 08 22:18:52.965979 ncdv-master-1 devstack@n-api.service[140491]: X-User-Name: tempest-TestSnapshotPattern-1378146846-project Oct 08 22:18:52.965979 ncdv-master-1 devstack@n-api.service[140491]: method: > Oct 08 22:18:52.965979 ncdv-master-1 devstack@n-api.service[140491]: exception: Instance a2d51aac-8a74-49d3-ac3d-77b791fe832d could not be found. Oct 08 22:18:52.965979 ncdv-master-1 devstack@n-api.service[140491]: action_args: {'id': 'a2d51aac-8a74-49d3-ac3d-77b791fe832d'} Oct 08 22:18:52.965979 ncdv-master-1 devstack@n-api.service[140491]: {{(pid=140491) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 08 22:18:52.965979 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 22:18:52.965979 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 08 22:18:52.965979 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 08 22:18:52.965979 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 08 22:18:52.965979 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 08 22:18:52.965979 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 08 22:18:52.965979 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 08 22:18:52.965979 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 08 22:18:52.965979 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 08 22:18:52.965979 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2d51aac-8a74-49d3-ac3d-77b791fe832d could not be found. Oct 08 22:18:52.965979 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 22:18:52.965979 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 22:18:52.965979 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 22:18:52.965979 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 22:18:52.965979 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 22:18:52.965979 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 22:18:52.965979 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 08 22:18:52.965979 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 08 22:18:52.965979 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 08 22:18:52.965979 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 08 22:18:52.965979 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 08 22:18:52.965979 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 08 22:18:52.965979 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 08 22:18:52.965979 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 08 22:18:52.965979 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 08 22:18:52.965979 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 08 22:18:52.965979 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2d51aac-8a74-49d3-ac3d-77b791fe832d could not be found. Oct 08 22:18:52.965979 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 22:18:52.965979 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 08 22:18:52.965979 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 22:18:52.971182 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 08 22:18:52.971182 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 08 22:18:52.971182 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 08 22:18:52.971182 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 08 22:18:52.971182 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 08 22:18:52.971182 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2d51aac-8a74-49d3-ac3d-77b791fe832d could not be found. Oct 08 22:18:52.971182 ncdv-master-1 devstack@n-api.service[140491]: ERROR nova.api.openstack.wsgi Oct 08 22:18:52.971182 ncdv-master-1 devstack@n-api.service[140491]: DEBUG nova.api.openstack.wsgi [None req-d1e9fd46-b587-4442-921a-13ae5064c6fe tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Returning 404 to user: Instance a2d51aac-8a74-49d3-ac3d-77b791fe832d could not be found. {{(pid=140491) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 08 22:18:52.971182 ncdv-master-1 devstack@n-api.service[140491]: INFO nova.api.openstack.requestlog [None req-d1e9fd46-b587-4442-921a-13ae5064c6fe tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] 10.222.0.26 "GET /compute/v2.1/servers/a2d51aac-8a74-49d3-ac3d-77b791fe832d" status: 404 len: 111 microversion: 2.1 time: 0.031722 Oct 08 22:18:52.971182 ncdv-master-1 devstack@n-api.service[140491]: [pid: 140491|app: 0|req: 3574/7220] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 8 22:18:52 2022] GET /compute/v2.1/servers/a2d51aac-8a74-49d3-ac3d-77b791fe832d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 08 22:18:53.131457 ncdv-master-1 devstack@n-api.service[140492]: DEBUG nova.api.openstack.wsgi [None req-1982b164-d3c1-411a-979b-7369fbd7d6aa tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] Calling method '.version_select at 0x7f1a8c070a60>' {{(pid=140492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 08 22:18:53.158813 ncdv-master-1 devstack@n-api.service[140492]: INFO nova.api.openstack.requestlog [None req-1982b164-d3c1-411a-979b-7369fbd7d6aa tempest-TestSnapshotPattern-1378146846 tempest-TestSnapshotPattern-1378146846-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-574754041" status: 202 len: 0 microversion: 2.1 time: 0.031160 Oct 08 22:18:53.159517 ncdv-master-1 devstack@n-api.service[140492]: [pid: 140492|app: 0|req: 3647/7221] 10.222.0.26 () {58 vars in 1254 bytes} [Sat Oct 8 22:18:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-574754041 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)